-- Logs begin at Wed 2022-08-31 15:10:44 UTC, end at Wed 2022-08-31 17:58:46 UTC. -- Aug 31 15:45:16.723933 n-d-850499-9 systemd[1]: Starting Devstack devstack@n-api.service... Aug 31 15:45:16.732468 n-d-850499-9 devstack@n-api.service[106345]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 31 15:45:16.734438 n-d-850499-9 devstack@n-api.service[106345]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 31 15:45:16 2022] *** Aug 31 15:45:16.734438 n-d-850499-9 devstack@n-api.service[106345]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 31 15:45:16.734438 n-d-850499-9 devstack@n-api.service[106345]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 31 15:45:16.734438 n-d-850499-9 devstack@n-api.service[106345]: nodename: n-d-850499-9 Aug 31 15:45:16.734438 n-d-850499-9 devstack@n-api.service[106345]: machine: x86_64 Aug 31 15:45:16.734438 n-d-850499-9 devstack@n-api.service[106345]: clock source: unix Aug 31 15:45:16.734438 n-d-850499-9 devstack@n-api.service[106345]: pcre jit disabled Aug 31 15:45:16.734438 n-d-850499-9 devstack@n-api.service[106345]: detected number of CPU cores: 4 Aug 31 15:45:16.734438 n-d-850499-9 devstack@n-api.service[106345]: current working directory: / Aug 31 15:45:16.734438 n-d-850499-9 devstack@n-api.service[106345]: detected binary path: /usr/bin/uwsgi-core Aug 31 15:45:16.734438 n-d-850499-9 devstack@n-api.service[106345]: your processes number limit is 47680 Aug 31 15:45:16.734438 n-d-850499-9 devstack@n-api.service[106345]: your memory page size is 4096 bytes Aug 31 15:45:16.734438 n-d-850499-9 devstack@n-api.service[106345]: detected max file descriptor number: 2048 Aug 31 15:45:16.734438 n-d-850499-9 devstack@n-api.service[106345]: lock engine: pthread robust mutexes Aug 31 15:45:16.735423 n-d-850499-9 devstack@n-api.service[106345]: thunder lock: enabled Aug 31 15:45:16.735423 n-d-850499-9 devstack@n-api.service[106345]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 31 15:45:16.735423 n-d-850499-9 devstack@n-api.service[106345]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 31 15:45:16.774002 n-d-850499-9 devstack@n-api.service[106345]: Python main interpreter initialized at 0x563d112709c0 Aug 31 15:45:16.774002 n-d-850499-9 devstack@n-api.service[106345]: python threads support enabled Aug 31 15:45:16.774002 n-d-850499-9 devstack@n-api.service[106345]: your server socket listen backlog is limited to 100 connections Aug 31 15:45:16.774002 n-d-850499-9 devstack@n-api.service[106345]: your mercy for graceful operations on workers is 90 seconds Aug 31 15:45:16.774387 n-d-850499-9 devstack@n-api.service[106345]: mapped 403077 bytes (393 KB) for 2 cores Aug 31 15:45:16.774466 n-d-850499-9 devstack@n-api.service[106345]: *** Operational MODE: preforking *** Aug 31 15:45:16.774667 n-d-850499-9 devstack@n-api.service[106345]: *** uWSGI is running in multiple interpreter mode *** Aug 31 15:45:16.774667 n-d-850499-9 devstack@n-api.service[106345]: spawned uWSGI master process (pid: 106345) Aug 31 15:45:16.774866 n-d-850499-9 systemd[1]: Started Devstack devstack@n-api.service. Aug 31 15:45:16.776106 n-d-850499-9 devstack@n-api.service[106345]: spawned uWSGI worker 1 (pid: 106346, cores: 1) Aug 31 15:45:16.776106 n-d-850499-9 devstack@n-api.service[106345]: spawned uWSGI worker 2 (pid: 106347, cores: 1) Aug 31 15:45:16.776106 n-d-850499-9 devstack@n-api.service[106345]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 31 15:45:17.433647 n-d-850499-9 devstack@n-api.service[106347]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 31 15:45:17.436522 n-d-850499-9 devstack@n-api.service[106346]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 31 15:45:18.523608 n-d-850499-9 devstack@n-api.service[106347]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 15:45:18.523608 n-d-850499-9 devstack@n-api.service[106347]: from cryptography.utils import int_from_bytes Aug 31 15:45:18.524165 n-d-850499-9 devstack@n-api.service[106347]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 15:45:18.524165 n-d-850499-9 devstack@n-api.service[106347]: from cryptography.utils import int_from_bytes Aug 31 15:45:18.526078 n-d-850499-9 devstack@n-api.service[106346]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 15:45:18.526078 n-d-850499-9 devstack@n-api.service[106346]: from cryptography.utils import int_from_bytes Aug 31 15:45:18.526657 n-d-850499-9 devstack@n-api.service[106346]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 15:45:18.526657 n-d-850499-9 devstack@n-api.service[106346]: from cryptography.utils import int_from_bytes Aug 31 15:45:21.078798 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 15:45:21.079362 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 15:45:21.079583 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 15:45:21.079946 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 15:45:21.080202 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 15:45:21.080542 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 15:45:21.081156 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.081251 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 15:45:21.081343 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.081466 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.081580 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 15:45:21.081783 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.081946 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 15:45:21.082112 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.082199 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 15:45:21.082421 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.082583 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.082740 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.082912 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.083055 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.083236 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.083379 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.083594 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.083684 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.083931 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.084019 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.084246 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.084331 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-850499-9 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.084569 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.084662 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.084891 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.085028 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.085196 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.085290 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.085463 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.085561 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.085785 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.085874 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.086104 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.086251 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-850499-9 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.086410 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.086559 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.086721 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.086905 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.087071 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.087387 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.087598 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.087758 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.087897 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.088086 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.088234 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.088381 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.088562 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.088764 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.088893 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.089046 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.089209 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.089347 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.089487 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.089640 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.089786 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.089916 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.090054 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.090184 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.090321 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.090503 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-850499-9 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.090635 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.090819 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.090959 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.091129 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.091267 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.091440 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.091616 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.091876 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.092022 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.092187 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.092309 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-850499-9 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.092493 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.092626 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.092810 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.092941 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.093143 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.093257 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.093450 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.093666 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.093763 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.093980 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.094078 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.094291 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.094376 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.094611 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.094703 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.094952 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.095094 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.095248 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.095333 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.095589 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.095677 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.095908 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.096003 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.096216 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.096323 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.096515 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.096610 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.096763 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.096849 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.097068 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.097152 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.097388 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.097481 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.097706 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.097793 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.098012 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.098096 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.098250 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.098342 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.098497 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.098583 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.098813 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.098899 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.099125 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.099239 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.099435 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.099553 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.099778 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.099862 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.100038 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.100125 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.100291 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.100379 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.100612 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.100698 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.100933 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.101023 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.101242 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.101330 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.101549 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.101644 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.101855 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.101947 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.102164 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.102252 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.102472 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.102565 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.103289 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.103412 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.103623 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.103728 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.104018 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.104165 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.61 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.104344 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.104437 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.61 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.104666 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.104759 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.104994 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.105088 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.105309 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.105397 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.105637 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.105730 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.105955 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.106047 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.61 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.106285 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.106417 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.61 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.106592 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.106690 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.106897 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.106986 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.107206 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.107292 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.107542 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.107634 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.107876 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.107964 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.108179 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.108279 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.108429 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.108532 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.108730 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.108818 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.109038 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.109123 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.109353 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.109456 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.109659 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.109755 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.109966 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.110062 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.110248 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.110411 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.110553 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.110639 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.110855 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.110947 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.111161 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.111256 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.111465 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.111568 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.111795 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.111881 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.112104 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.112265 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.112411 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.112546 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.112681 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.112816 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.112988 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.113136 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.113291 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.113428 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.113597 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.113732 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.113905 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.114065 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.114212 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.114345 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.114497 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.114628 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.114802 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.114958 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.115093 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.115235 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.115407 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.115535 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.115734 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.115833 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.116039 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.116131 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.116348 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.116455 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.116647 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.116743 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.116951 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.117048 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.117270 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.117357 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.117574 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.117673 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.117876 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.117962 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.118193 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.118279 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.119071 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.119228 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.119387 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.119567 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.119726 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.119871 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.120039 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.120183 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.120349 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.120494 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.120672 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.120800 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.120994 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.121092 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.121271 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.121397 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.121595 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.121704 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.121906 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.122001 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.122220 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.122384 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.122525 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.122671 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.122812 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.122945 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.123114 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.123250 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.123424 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.123606 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.123755 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.123841 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.124065 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.124162 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.124370 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.124466 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.124695 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.124788 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.125023 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.125108 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.125341 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.125479 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.125651 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.125739 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.125962 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.126055 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.126285 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:45:21.126374 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.126604 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.126701 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.126917 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.127001 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.127233 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.127326 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.127580 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.127669 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.127894 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.127979 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.128207 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.128294 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.128518 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.128614 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.128837 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.128932 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.129160 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.129246 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.129488 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.129571 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.129802 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.129895 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.130114 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.130222 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.130430 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.130517 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.130738 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.130831 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.131055 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.131148 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.131381 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.131466 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.131725 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.131896 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.132034 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.132120 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.132354 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.132439 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.132669 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.132769 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.132993 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.133080 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.133313 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.133404 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.133633 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.133729 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.133943 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.134029 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.134310 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.134512 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.134608 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.134908 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.135003 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.135188 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.135274 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.135538 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.135642 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.135868 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.135989 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.136178 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.136279 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.136493 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.136612 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.136803 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.136901 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.137111 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.137199 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.137422 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.137525 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.137734 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.137828 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.138046 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.138143 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.138366 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.138461 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.138680 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.138774 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.138995 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.139089 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.139311 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.139400 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.139645 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.139745 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.139961 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.140046 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.140269 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.140363 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.140578 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.140664 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.140886 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.140972 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.141191 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.141279 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.141496 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.141582 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.141799 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.141884 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.142110 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.142197 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.142418 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.142569 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.142738 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.142885 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.143049 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.143184 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.143357 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.143520 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.143702 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.143851 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.144007 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.144150 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.144319 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.144454 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.144626 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.144771 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.144936 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.145072 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.145241 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.145386 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.145554 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.145708 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.145866 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.145998 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.146171 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.146307 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.146486 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.146623 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.146796 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.146937 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.147101 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.147237 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.147408 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.147596 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.147753 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.147887 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.148020 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.148153 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.148334 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.148489 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.148659 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.148787 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.148943 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.149078 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.149242 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.149375 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.149538 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.150232 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.150469 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.150733 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.150872 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.151009 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.151149 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.151284 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.151418 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.151579 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.151713 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.151902 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.152063 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.152232 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.152376 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.152526 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.152676 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.152837 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.152988 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.153160 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.153301 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.153470 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.153616 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.153776 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.153915 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.154078 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.154237 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.154401 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.154535 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.154677 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.154822 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.154959 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.155106 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.155247 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.155383 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.155561 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.155711 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.155855 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.156013 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.156150 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.156293 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.156427 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.156599 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.156737 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.156912 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.157046 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.157228 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.157365 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.157520 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.157685 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.157821 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.157969 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.158131 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.158270 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.158441 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.158587 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.158743 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.158857 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.159062 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.159182 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.159376 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.159521 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.159710 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.159836 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.160019 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.160152 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.160330 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.160462 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.160679 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.160766 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.160989 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.161076 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.161338 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.161436 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.161668 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.161754 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.161977 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.162065 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.162293 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.162382 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.162601 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.162735 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.162919 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.163007 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.163226 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.163312 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.163558 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.163663 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.163864 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.163949 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.164178 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.164265 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.164505 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.164592 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.164822 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.164907 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.165137 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.165223 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.165505 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.165594 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.165837 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.165949 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.166127 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.166225 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.166436 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.166531 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.166746 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.166840 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.167055 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.167130 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.167364 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.167450 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.167706 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.167809 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.168017 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.168105 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.168334 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.168420 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.168642 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.168740 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.168960 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.169048 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.169276 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.169368 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.169589 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.169676 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.169887 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.169972 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.170198 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.170283 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.170519 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.170616 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.170837 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.170925 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.171141 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.171225 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.171451 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.171558 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.171797 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.171885 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.172107 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.172196 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.172418 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.172507 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.172724 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.172859 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.173025 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.173120 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.173328 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.173417 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.173637 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.173723 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.173953 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.174049 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.174261 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.174348 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.174570 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.174658 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.174874 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.174974 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.175187 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.175274 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.175493 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.175616 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.175819 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.175934 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.176127 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.176227 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.176437 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.176531 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.176757 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.176853 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.177066 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.177151 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.177377 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.177461 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.177687 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.177774 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.177989 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.178074 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.178293 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.178379 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.178600 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.178687 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.178909 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.179002 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.179216 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.179305 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.179549 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.179654 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.179842 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.179929 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.180184 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.180276 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.180492 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.180580 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.180796 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.181538 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.181789 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.181886 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.181970 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.182103 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.182269 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.182357 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.182582 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.182684 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.182892 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.182979 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.183201 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.183286 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.183546 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.183696 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.183860 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.183948 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.184168 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.184256 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.184478 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.184575 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.184792 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.184878 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.185102 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.185187 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.185415 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.185504 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.185738 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.185824 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.186047 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.186149 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.186361 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.186469 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.186670 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.186784 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.186974 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.187060 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.187285 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.187373 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.187624 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.187728 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.187943 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.188191 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.188287 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.188522 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.188618 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.188836 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.188970 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.189159 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.189255 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.189477 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.189563 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.189784 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.189877 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.190103 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.190206 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.190427 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.190514 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.190744 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.190993 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.191079 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.191330 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.191418 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.191661 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.191761 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.191968 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.192054 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.192276 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.192365 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.192580 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.192666 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.192884 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.193019 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.193187 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.193288 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.193497 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.193591 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.193801 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.193890 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.194106 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.194201 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.194411 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.194498 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.194714 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.194800 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.195027 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.195123 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.195329 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.195423 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.195664 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.195753 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.195969 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.196058 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.196283 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.196383 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.197167 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.197278 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.197537 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.197678 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.197840 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.198018 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.198160 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.198333 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.198476 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.198655 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.198789 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.198986 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.199129 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.199283 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.199410 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.199616 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.199777 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.199946 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.200083 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.200262 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.200389 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.200572 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.200711 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.200880 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.201015 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.201191 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.201319 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.201539 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.201626 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.201851 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.201937 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.202193 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.202282 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.202492 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.202585 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.202801 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.202887 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.203109 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.203197 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.203417 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.203530 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.203750 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.203851 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.204053 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.204140 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.204362 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.204448 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.204664 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.204759 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.204976 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.205061 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.205282 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.205369 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.205827 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.205928 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.206138 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.206272 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.206447 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.206534 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.206756 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.206865 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.207056 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.207144 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.207361 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.207446 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.207688 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.207779 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.207997 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.208083 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.208296 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.208383 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.208598 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.208699 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.208899 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.208986 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.209209 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.209349 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.209513 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.209659 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.209798 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.209937 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.210117 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.210249 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.210424 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.210557 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.210709 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.210849 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.211014 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.211158 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.211303 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.211442 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.211632 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.211773 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.211907 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.212052 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.212263 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.212398 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.212642 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.212783 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.213063 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.213212 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.213376 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.213511 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.213690 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.213838 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.213998 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.214145 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.214286 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.214421 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.214595 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.214733 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.214905 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.215043 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.215204 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.215341 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.215520 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.215658 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.215882 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.216022 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.216164 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.216304 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.216438 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.216576 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.216744 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.216891 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.217014 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.217102 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.217319 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.217413 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.217623 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.217712 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.217929 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.218024 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.218234 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.218332 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.218544 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.218631 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.218854 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.218949 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.219161 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.219258 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.219468 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.219624 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.219816 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.219904 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.220127 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.220228 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.220436 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.220522 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.220740 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.220835 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.221042 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.221175 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.221359 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.221449 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.221670 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.221757 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.221984 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.222075 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.222288 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.222382 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.222593 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.222679 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.222912 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.223008 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.223224 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.223317 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.223554 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.223658 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.223875 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.223962 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.224184 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.224271 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.224504 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.224590 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.224804 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.224891 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.225112 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.225206 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.225422 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.225508 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.225727 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.225814 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.226035 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.226120 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.226346 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.226495 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.226656 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.226743 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.226966 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.227052 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.227275 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.227371 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.227604 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.227694 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.227951 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.228043 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.228269 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.228433 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.228575 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.228670 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.228884 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.228971 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.229191 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.229286 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.229503 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.229597 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.229807 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.229900 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.230109 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.230198 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.230415 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.230510 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.230719 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.230806 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.231029 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.231126 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.231328 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.231413 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.231661 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.231764 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.231976 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.232064 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.232282 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.232376 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.232609 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.232705 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.232921 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.233009 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.233226 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.233313 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.233537 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.233700 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.233852 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.233995 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.234131 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.234276 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.234435 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.234581 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.234834 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.234972 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.235143 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.235282 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.235452 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.235631 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.235771 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.235934 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.236068 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.236205 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.236342 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.236489 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.236666 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.236802 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.236968 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.237113 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.237262 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.237405 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.237553 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.237690 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.237863 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.237998 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.238168 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.238306 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.238486 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.238619 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.238875 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.239012 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.239182 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.239322 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.239487 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.239687 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.239823 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.239959 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.240109 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.240245 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.240414 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.240552 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.240721 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.240868 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.241047 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.241187 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.241357 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.241495 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.241682 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.241779 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.242005 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.242091 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.242313 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.242420 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.242633 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.242721 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.242952 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.243091 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.243262 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.243988 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.244176 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.244316 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.244481 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.244616 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.244942 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.245036 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.245272 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.245368 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.245583 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.245679 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.245904 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.245990 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.246215 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.246322 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.246540 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.246670 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.246866 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.246953 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.247182 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.247312 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.247533 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.247674 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.247839 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.248017 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.248159 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.248299 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.248480 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.248620 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.248798 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.248937 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.249122 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.249270 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.249481 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.249613 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.249791 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.249929 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.250103 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.250251 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.250397 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.250543 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.250709 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.250874 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.251040 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.251232 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.251369 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.251528 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.251685 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.251835 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.251982 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.252129 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.252267 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.252414 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.252569 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.252768 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.252944 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.253107 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.253247 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.253400 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.253553 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.253689 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.253834 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.253971 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.254143 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.254282 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.254438 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.254574 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.254706 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.254795 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.255009 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.255096 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.255351 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.255439 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.255687 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.255780 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.256008 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.256095 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.256335 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.256422 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.256648 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.256777 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.256959 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.257055 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.257277 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.257372 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.257589 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.257690 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.257902 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.258002 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.258209 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.258308 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.258532 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.258618 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.258835 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.258922 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.259209 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.259307 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.259538 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.259632 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.259848 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.259939 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.260153 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.260243 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.260459 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.260548 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.260769 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.260862 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.261070 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.261158 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.261374 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.261460 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.261675 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.261761 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.261997 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.262087 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.262300 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.262388 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.262620 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.262715 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.262927 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.263017 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.263231 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.263317 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.263550 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.263651 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.263857 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.263946 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.264176 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.264263 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.264484 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.264581 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.264793 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.264881 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.265105 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.265198 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.265451 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.265548 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.265770 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.265864 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.266081 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.266172 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.266392 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.266494 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.266703 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.266791 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.267011 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.267101 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.267323 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.267410 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.267662 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.267753 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.267974 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.268063 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.268290 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.268379 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.268605 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.268692 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.268921 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.269007 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.269239 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.269443 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.269593 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.269774 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.269909 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.270089 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.270302 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.270448 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.270602 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.270738 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.270873 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.271015 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.271151 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.271292 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.271436 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.271625 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.271717 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.271938 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.272073 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.272249 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.272550 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.272685 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.272876 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.273023 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.273193 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.273331 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.273513 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.273648 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.273833 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.273972 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.274144 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.274291 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.274459 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.275103 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.275307 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.275469 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.275661 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.275795 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.275955 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.276099 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.276272 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.276413 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.276581 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.276716 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.276896 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.277043 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.277212 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.277300 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.277526 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.277644 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.277839 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.277968 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.278151 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.278290 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.278463 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.278610 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.278776 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.278930 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.279087 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.279292 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.279381 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.280482 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.280657 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.280808 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.280969 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.281118 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.281262 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.281262 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.281262 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.281262 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.281733 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.281849 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.281988 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.282175 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.282371 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.282495 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.282687 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.282813 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.283019 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.283115 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.283347 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.283442 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.283711 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.283802 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.284031 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.284127 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.284351 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.284485 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.284683 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.284770 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.284992 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.285081 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.285298 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.285385 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.285612 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.285698 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.285924 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.286012 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.286229 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.286316 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.286553 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.286648 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.286864 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.287077 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.287171 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.287401 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.287488 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.287766 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.287870 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.288098 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.288318 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.288443 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.288668 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.288765 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.288986 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.289074 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.289312 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.289407 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.289637 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.289737 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.289960 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.290053 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.290361 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.290459 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.290742 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.290839 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.291055 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.291146 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.291365 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.291459 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.291708 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.291814 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.292023 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.292110 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.292333 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.292420 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.292639 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.292727 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.292951 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.293198 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.293286 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.293549 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.293646 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.293857 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.293953 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.294164 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.294251 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.294494 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.294591 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.294802 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.294891 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.295108 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.295195 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.295414 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.295533 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.295752 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.295839 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.296058 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.296147 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.296363 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.296452 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.296667 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.296754 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.296972 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.297069 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.297283 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.297374 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.297587 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.297673 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.297895 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.298031 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.298199 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.298315 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.298511 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.298607 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.298814 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.298909 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.299126 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.299270 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.299440 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.299546 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.299777 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.299878 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.300088 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.300176 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.300405 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.300492 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.300715 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.300876 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.301024 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.301120 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.301332 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.301419 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.301639 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.301734 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.301949 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.302048 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.302256 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.302342 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.302569 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.302665 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.302877 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.303118 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.303205 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.303458 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.303590 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.303808 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.303896 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.304147 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.304244 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.304478 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.304574 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.304784 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.304874 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.305090 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.305187 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.305395 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.305497 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.305712 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.305800 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.306576 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.306668 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.306966 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.307078 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.307206 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.307345 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.307540 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.307636 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.307857 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.307947 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.308171 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.308422 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.308517 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.308760 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.308866 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.309078 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.309164 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.309387 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.309482 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.309698 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.309798 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.310011 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.310153 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.310324 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.310471 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.310616 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.310778 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.310936 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.311075 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.311249 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.311394 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.311586 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.311722 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.311894 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.312032 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.312211 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.312346 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.312527 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.312677 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.312835 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.312981 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.313146 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.313290 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.313457 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.313601 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.313767 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.313905 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.314077 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.314222 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.314391 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.314531 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.314692 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.314827 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.315000 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.315097 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.315311 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.315420 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.315649 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.315759 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.315997 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.316095 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.316322 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.316409 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.316646 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.316735 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.316968 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.317056 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.317290 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.317415 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.317599 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.317685 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.317914 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.318010 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.318223 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.318317 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.318534 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.318621 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.318857 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.318946 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.319188 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.319274 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.319519 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.319621 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.319829 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.319917 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.320136 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.320251 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.320447 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.320569 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.320758 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.320893 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.321078 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.321219 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.321387 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.321656 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.321748 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.322032 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.322128 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.322344 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.322444 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.322653 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.322740 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.323038 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.323357 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.323677 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.323999 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.324202 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.324561 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.324901 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.324988 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.325235 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.325331 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.325549 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.325637 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.325862 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.325952 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.326175 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.326276 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.326480 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.326566 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.326788 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.326876 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.327098 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.327186 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.327405 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.327550 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.327738 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.327824 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.328051 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.328140 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.328359 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.328453 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.328667 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.328753 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.329018 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.329118 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.329277 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.329363 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.329593 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.329691 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.329902 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.329989 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.330211 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.330301 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.330518 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.330866 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.331082 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.331169 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.331390 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.331477 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.331724 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.331893 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.332038 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.332127 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.332348 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.332482 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.332657 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.332754 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.332966 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.333052 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.333277 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.333372 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.333586 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.333674 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.333895 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.333981 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.334208 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.334296 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.334521 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.334610 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.334831 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.334918 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.335160 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.335255 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.335488 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.335597 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.335818 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.335904 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.336143 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.336231 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.336459 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.336548 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.336775 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.336862 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.337590 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.337736 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.337914 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.338009 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.338245 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.338335 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.338557 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.338656 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.338870 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.339002 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.339183 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.339271 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.339516 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.339620 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.339830 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.339919 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.340149 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.340236 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.340461 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.340550 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.340773 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.340866 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.341089 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.341176 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.341407 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.341502 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.341731 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.341818 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.342054 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.342141 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.342363 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.342458 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.342688 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.342778 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.343002 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.343101 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.343320 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.343408 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.343663 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.343768 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.343984 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.344081 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.344302 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.344390 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.344621 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.344714 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.344934 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.345030 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.345239 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.345329 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.345482 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 15:45:21.345578 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.345867 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.346199 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.346533 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.346848 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.347180 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.347522 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.347883 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.348203 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.348556 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.348889 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.349210 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.349529 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.349839 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:45:21.350321 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 15:45:21.499895 n-d-850499-9 devstack@n-api.service[106347]: INFO dbcounter [None req-55faaa5a-384a-4e22-9dc1-4400c8894187 None None] Registered counter for database nova_api Aug 31 15:45:21.503237 n-d-850499-9 devstack@n-api.service[106346]: INFO dbcounter [None req-ae7cb449-fed9-4ef8-8655-d186c9d27bd6 None None] Registered counter for database nova_api Aug 31 15:45:21.521136 n-d-850499-9 devstack@n-api.service[106347]: DEBUG oslo_db.sqlalchemy.engines [None req-55faaa5a-384a-4e22-9dc1-4400c8894187 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106347) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 15:45:21.523839 n-d-850499-9 devstack@n-api.service[106346]: DEBUG oslo_db.sqlalchemy.engines [None req-ae7cb449-fed9-4ef8-8655-d186c9d27bd6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106346) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 15:45:21.528665 n-d-850499-9 devstack@n-api.service[106347]: DEBUG dbcounter [-] [106347] Writer thread running {{(pid=106347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 15:45:21.530999 n-d-850499-9 devstack@n-api.service[106346]: DEBUG dbcounter [-] [106346] Writer thread running {{(pid=106346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 15:45:21.585530 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.context [None req-55faaa5a-384a-4e22-9dc1-4400c8894187 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9f6d6683-96bf-42a7-a78d-78a22f1453ed(cell1) {{(pid=106347) load_cells /opt/stack/nova/nova/context.py:464}} Aug 31 15:45:21.588209 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.context [None req-ae7cb449-fed9-4ef8-8655-d186c9d27bd6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9f6d6683-96bf-42a7-a78d-78a22f1453ed(cell1) {{(pid=106346) load_cells /opt/stack/nova/nova/context.py:464}} Aug 31 15:45:21.590057 n-d-850499-9 devstack@n-api.service[106347]: DEBUG oslo_concurrency.lockutils [None req-55faaa5a-384a-4e22-9dc1-4400c8894187 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106347) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:45:21.590534 n-d-850499-9 devstack@n-api.service[106347]: DEBUG oslo_concurrency.lockutils [None req-55faaa5a-384a-4e22-9dc1-4400c8894187 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106347) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:45:21.592000 n-d-850499-9 devstack@n-api.service[106346]: DEBUG oslo_concurrency.lockutils [None req-ae7cb449-fed9-4ef8-8655-d186c9d27bd6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:45:21.592126 n-d-850499-9 devstack@n-api.service[106347]: DEBUG oslo_concurrency.lockutils [None req-55faaa5a-384a-4e22-9dc1-4400c8894187 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106347) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:45:21.592468 n-d-850499-9 devstack@n-api.service[106346]: DEBUG oslo_concurrency.lockutils [None req-ae7cb449-fed9-4ef8-8655-d186c9d27bd6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:45:21.592866 n-d-850499-9 devstack@n-api.service[106347]: DEBUG oslo_concurrency.lockutils [None req-55faaa5a-384a-4e22-9dc1-4400c8894187 None None] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106347) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:45:21.593309 n-d-850499-9 devstack@n-api.service[106347]: DEBUG oslo_concurrency.lockutils [None req-55faaa5a-384a-4e22-9dc1-4400c8894187 None None] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106347) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:45:21.594016 n-d-850499-9 devstack@n-api.service[106346]: DEBUG oslo_concurrency.lockutils [None req-ae7cb449-fed9-4ef8-8655-d186c9d27bd6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:45:21.594748 n-d-850499-9 devstack@n-api.service[106346]: DEBUG oslo_concurrency.lockutils [None req-ae7cb449-fed9-4ef8-8655-d186c9d27bd6 None None] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:45:21.595187 n-d-850499-9 devstack@n-api.service[106346]: DEBUG oslo_concurrency.lockutils [None req-ae7cb449-fed9-4ef8-8655-d186c9d27bd6 None None] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:45:21.595282 n-d-850499-9 devstack@n-api.service[106347]: DEBUG oslo_concurrency.lockutils [None req-55faaa5a-384a-4e22-9dc1-4400c8894187 None None] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106347) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:45:21.597189 n-d-850499-9 devstack@n-api.service[106346]: DEBUG oslo_concurrency.lockutils [None req-ae7cb449-fed9-4ef8-8655-d186c9d27bd6 None None] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106346) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:45:21.597293 n-d-850499-9 devstack@n-api.service[106347]: INFO dbcounter [None req-55faaa5a-384a-4e22-9dc1-4400c8894187 None None] Registered counter for database nova_cell0 Aug 31 15:45:21.599127 n-d-850499-9 devstack@n-api.service[106346]: INFO dbcounter [None req-ae7cb449-fed9-4ef8-8655-d186c9d27bd6 None None] Registered counter for database nova_cell0 Aug 31 15:45:21.601199 n-d-850499-9 devstack@n-api.service[106347]: INFO dbcounter [None req-55faaa5a-384a-4e22-9dc1-4400c8894187 None None] Registered counter for database nova_cell1 Aug 31 15:45:21.603170 n-d-850499-9 devstack@n-api.service[106346]: INFO dbcounter [None req-ae7cb449-fed9-4ef8-8655-d186c9d27bd6 None None] Registered counter for database nova_cell1 Aug 31 15:45:21.608411 n-d-850499-9 devstack@n-api.service[106347]: DEBUG oslo_db.sqlalchemy.engines [None req-55faaa5a-384a-4e22-9dc1-4400c8894187 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106347) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 15:45:21.610601 n-d-850499-9 devstack@n-api.service[106347]: DEBUG oslo_db.sqlalchemy.engines [None req-55faaa5a-384a-4e22-9dc1-4400c8894187 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106347) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 15:45:21.611976 n-d-850499-9 devstack@n-api.service[106346]: DEBUG oslo_db.sqlalchemy.engines [None req-ae7cb449-fed9-4ef8-8655-d186c9d27bd6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106346) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 15:45:21.616564 n-d-850499-9 devstack@n-api.service[106346]: DEBUG dbcounter [-] [106346] Writer thread running {{(pid=106346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 15:45:21.617370 n-d-850499-9 devstack@n-api.service[106347]: DEBUG dbcounter [-] [106347] Writer thread running {{(pid=106347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 15:45:21.617485 n-d-850499-9 devstack@n-api.service[106346]: DEBUG oslo_db.sqlalchemy.engines [None req-ae7cb449-fed9-4ef8-8655-d186c9d27bd6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106346) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 15:45:21.617717 n-d-850499-9 devstack@n-api.service[106347]: DEBUG dbcounter [-] [106347] Writer thread running {{(pid=106347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 15:45:21.760963 n-d-850499-9 devstack@n-api.service[106346]: DEBUG dbcounter [-] [106346] Writer thread running {{(pid=106346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 15:45:21.767350 n-d-850499-9 devstack@n-api.service[106347]: INFO dbcounter [None req-55faaa5a-384a-4e22-9dc1-4400c8894187 None None] Registered counter for database nova_cell0 Aug 31 15:45:21.769825 n-d-850499-9 devstack@n-api.service[106346]: INFO dbcounter [None req-ae7cb449-fed9-4ef8-8655-d186c9d27bd6 None None] Registered counter for database nova_cell0 Aug 31 15:45:21.774323 n-d-850499-9 devstack@n-api.service[106347]: DEBUG oslo_db.sqlalchemy.engines [None req-55faaa5a-384a-4e22-9dc1-4400c8894187 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106347) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 15:45:21.780419 n-d-850499-9 devstack@n-api.service[106347]: DEBUG dbcounter [-] [106347] Writer thread running {{(pid=106347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 15:45:21.782094 n-d-850499-9 devstack@n-api.service[106346]: DEBUG oslo_db.sqlalchemy.engines [None req-ae7cb449-fed9-4ef8-8655-d186c9d27bd6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106346) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 15:45:21.786375 n-d-850499-9 devstack@n-api.service[106346]: DEBUG dbcounter [-] [106346] Writer thread running {{(pid=106346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 15:45:22.120507 n-d-850499-9 devstack@n-api.service[106347]: WARNING keystonemiddleware.auth_token [None req-55faaa5a-384a-4e22-9dc1-4400c8894187 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 15:45:22.127953 n-d-850499-9 devstack@n-api.service[106347]: WARNING keystonemiddleware.auth_token [None req-55faaa5a-384a-4e22-9dc1-4400c8894187 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 15:45:22.128280 n-d-850499-9 devstack@n-api.service[106346]: WARNING keystonemiddleware.auth_token [None req-ae7cb449-fed9-4ef8-8655-d186c9d27bd6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 15:45:22.136313 n-d-850499-9 devstack@n-api.service[106346]: WARNING keystonemiddleware.auth_token [None req-ae7cb449-fed9-4ef8-8655-d186c9d27bd6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 15:45:22.471417 n-d-850499-9 devstack@n-api.service[106347]: WARNING keystonemiddleware.auth_token [None req-55faaa5a-384a-4e22-9dc1-4400c8894187 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 15:45:22.477424 n-d-850499-9 devstack@n-api.service[106347]: WARNING keystonemiddleware.auth_token [None req-55faaa5a-384a-4e22-9dc1-4400c8894187 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 15:45:22.482656 n-d-850499-9 devstack@n-api.service[106347]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563d112709c0 pid: 106347 (default app) Aug 31 15:45:22.482875 n-d-850499-9 devstack@n-api.service[106346]: WARNING keystonemiddleware.auth_token [None req-ae7cb449-fed9-4ef8-8655-d186c9d27bd6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 15:45:22.484748 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi [None req-55faaa5a-384a-4e22-9dc1-4400c8894187 None None] Calling method '>' {{(pid=106347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:45:22.485942 n-d-850499-9 devstack@n-api.service[106347]: INFO nova.api.openstack.requestlog [None req-55faaa5a-384a-4e22-9dc1-4400c8894187 None None] 10.222.0.61 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001727 Aug 31 15:45:22.486338 n-d-850499-9 devstack@n-api.service[106347]: [pid: 106347|app: 0|req: 1/1] 10.222.0.61 () {50 vars in 788 bytes} [Wed Aug 31 15:45:22 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:45:22.489082 n-d-850499-9 devstack@n-api.service[106346]: WARNING keystonemiddleware.auth_token [None req-ae7cb449-fed9-4ef8-8655-d186c9d27bd6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 15:45:22.494816 n-d-850499-9 devstack@n-api.service[106346]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563d112709c0 pid: 106346 (default app) Aug 31 15:46:41.172138 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi [None req-55faaa5a-384a-4e22-9dc1-4400c8894187 None None] Calling method '>' {{(pid=106347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:46:41.173161 n-d-850499-9 devstack@n-api.service[106347]: INFO nova.api.openstack.requestlog [None req-55faaa5a-384a-4e22-9dc1-4400c8894187 None None] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Aug 31 15:46:41.174016 n-d-850499-9 devstack@n-api.service[106347]: [pid: 106347|app: 0|req: 2/2] 10.222.0.61 () {54 vars in 931 bytes} [Wed Aug 31 15:46:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:46:41.188142 n-d-850499-9 devstack@n-api.service[106346]: DEBUG dbcounter [-] [106346] Writing DB stats nova_api:SELECT=3 {{(pid=106346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:46:41.189957 n-d-850499-9 devstack@n-api.service[106346]: DEBUG dbcounter [-] [106346] Writing DB stats nova_cell0:SELECT=3 {{(pid=106346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:46:41.191022 n-d-850499-9 devstack@n-api.service[106346]: DEBUG dbcounter [-] [106346] Writing DB stats nova_cell1:SELECT=3 {{(pid=106346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:46:41.192363 n-d-850499-9 devstack@n-api.service[106346]: DEBUG dbcounter [-] [106346] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:46:42.094094 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi [None req-309a8337-702a-468a-ba92-ec8d40233a2c admin admin] Calling method '>' {{(pid=106346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:46:42.126497 n-d-850499-9 devstack@n-api.service[106346]: INFO nova.api.openstack.requestlog [None req-309a8337-702a-468a-ba92-ec8d40233a2c admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.944543 Aug 31 15:46:42.127487 n-d-850499-9 devstack@n-api.service[106346]: [pid: 106346|app: 0|req: 1/3] 10.222.0.61 () {60 vars in 1292 bytes} [Wed Aug 31 15:46:41 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:46:44.570616 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi [None req-55faaa5a-384a-4e22-9dc1-4400c8894187 None None] Calling method '>' {{(pid=106347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:46:44.571840 n-d-850499-9 devstack@n-api.service[106347]: INFO nova.api.openstack.requestlog [None req-55faaa5a-384a-4e22-9dc1-4400c8894187 None None] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001687 Aug 31 15:46:44.572654 n-d-850499-9 devstack@n-api.service[106347]: [pid: 106347|app: 0|req: 3/4] 10.222.0.61 () {54 vars in 931 bytes} [Wed Aug 31 15:46:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:46:45.022633 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi [None req-6c03b390-a6da-49ba-988b-ca5b00d4fb43 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "ram": 256, "vcpus": 1, "name": "cirros256", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "id": "c1"}} {{(pid=106346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:46:45.073707 n-d-850499-9 devstack@n-api.service[106346]: INFO nova.api.openstack.requestlog [None req-6c03b390-a6da-49ba-988b-ca5b00d4fb43 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.494487 Aug 31 15:46:45.074509 n-d-850499-9 devstack@n-api.service[106346]: [pid: 106346|app: 0|req: 2/5] 10.222.0.61 () {64 vars in 1283 bytes} [Wed Aug 31 15:46:44 2022] POST /compute/v2.1/flavors => generated 407 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 15:46:45.306195 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi [None req-a1d1f64e-b884-45a9-9fab-42c93458d0dc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:46:45.312609 n-d-850499-9 devstack@n-api.service[106347]: DEBUG dbcounter [-] [106347] Writing DB stats nova_api:SELECT=3 {{(pid=106347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:46:45.313413 n-d-850499-9 devstack@n-api.service[106347]: DEBUG dbcounter [-] [106347] Writing DB stats nova_cell1:SELECT=3 {{(pid=106347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:46:45.314541 n-d-850499-9 devstack@n-api.service[106347]: DEBUG dbcounter [-] [106347] Writing DB stats nova_cell0:SELECT=3 {{(pid=106347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:46:45.315584 n-d-850499-9 devstack@n-api.service[106347]: DEBUG dbcounter [-] [106347] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:46:45.376586 n-d-850499-9 devstack@n-api.service[106347]: INFO nova.api.openstack.requestlog [None req-a1d1f64e-b884-45a9-9fab-42c93458d0dc admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.293051 Aug 31 15:46:45.377109 n-d-850499-9 devstack@n-api.service[106347]: [pid: 106347|app: 0|req: 4/6] 10.222.0.61 () {64 vars in 1336 bytes} [Wed Aug 31 15:46:45 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:46:47.827862 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi [None req-6c03b390-a6da-49ba-988b-ca5b00d4fb43 admin admin] Calling method '>' {{(pid=106346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:46:47.829747 n-d-850499-9 devstack@n-api.service[106346]: INFO nova.api.openstack.requestlog [None req-6c03b390-a6da-49ba-988b-ca5b00d4fb43 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002118 Aug 31 15:46:47.830144 n-d-850499-9 devstack@n-api.service[106346]: [pid: 106346|app: 0|req: 3/7] 10.222.0.61 () {54 vars in 931 bytes} [Wed Aug 31 15:46:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:46:48.573260 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi [None req-e1299c57-2432-4198-b95d-0e9ac391cea2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "ram": 512, "id": "d1", "rxtx_factor": 1.0, "disk": 5}} {{(pid=106347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:46:48.634146 n-d-850499-9 devstack@n-api.service[106347]: INFO nova.api.openstack.requestlog [None req-e1299c57-2432-4198-b95d-0e9ac391cea2 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.797323 Aug 31 15:46:48.635317 n-d-850499-9 devstack@n-api.service[106347]: [pid: 106347|app: 0|req: 5/8] 10.222.0.61 () {64 vars in 1283 bytes} [Wed Aug 31 15:46:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 15:46:48.648794 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi [None req-61e802c7-85b4-453a-bc76-62b6d62d8bfa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:46:48.698295 n-d-850499-9 devstack@n-api.service[106346]: INFO nova.api.openstack.requestlog [None req-61e802c7-85b4-453a-bc76-62b6d62d8bfa admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.053926 Aug 31 15:46:48.699215 n-d-850499-9 devstack@n-api.service[106346]: [pid: 106346|app: 0|req: 4/9] 10.222.0.61 () {64 vars in 1336 bytes} [Wed Aug 31 15:46:48 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:46:51.481904 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi [None req-e1299c57-2432-4198-b95d-0e9ac391cea2 admin admin] Calling method '>' {{(pid=106347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:46:51.482926 n-d-850499-9 devstack@n-api.service[106347]: INFO nova.api.openstack.requestlog [None req-e1299c57-2432-4198-b95d-0e9ac391cea2 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Aug 31 15:46:51.483589 n-d-850499-9 devstack@n-api.service[106347]: [pid: 106347|app: 0|req: 6/10] 10.222.0.61 () {54 vars in 931 bytes} [Wed Aug 31 15:46:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:46:51.925107 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi [None req-c3a3c898-208d-4bae-9a35-e65dd81d829d admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "disk": 10, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "name": "ds1G", "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=106346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:46:51.951072 n-d-850499-9 devstack@n-api.service[106346]: INFO nova.api.openstack.requestlog [None req-c3a3c898-208d-4bae-9a35-e65dd81d829d admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.461250 Aug 31 15:46:51.959975 n-d-850499-9 devstack@n-api.service[106346]: [pid: 106346|app: 0|req: 5/11] 10.222.0.61 () {64 vars in 1283 bytes} [Wed Aug 31 15:46:51 2022] POST /compute/v2.1/flavors => generated 404 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 15:46:51.966201 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi [None req-824d1fa1-01fb-4931-b109-8aa13f504c0a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:46:51.996169 n-d-850499-9 devstack@n-api.service[106347]: INFO nova.api.openstack.requestlog [None req-824d1fa1-01fb-4931-b109-8aa13f504c0a admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033774 Aug 31 15:46:52.006977 n-d-850499-9 devstack@n-api.service[106347]: [pid: 106347|app: 0|req: 7/12] 10.222.0.61 () {64 vars in 1336 bytes} [Wed Aug 31 15:46:51 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:46:54.652307 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi [None req-c3a3c898-208d-4bae-9a35-e65dd81d829d admin admin] Calling method '>' {{(pid=106346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:46:54.654579 n-d-850499-9 devstack@n-api.service[106346]: INFO nova.api.openstack.requestlog [None req-c3a3c898-208d-4bae-9a35-e65dd81d829d admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002566 Aug 31 15:46:54.655748 n-d-850499-9 devstack@n-api.service[106346]: [pid: 106346|app: 0|req: 6/13] 10.222.0.61 () {54 vars in 931 bytes} [Wed Aug 31 15:46:54 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:46:55.120183 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi [None req-a12e9ca3-1c6a-4ba0-b5bc-255df9d11389 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "ds2G", "swap": 0, "id": "d3", "disk": 10, "ram": 2048, "rxtx_factor": 1.0, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:46:55.142555 n-d-850499-9 devstack@n-api.service[106347]: INFO nova.api.openstack.requestlog [None req-a12e9ca3-1c6a-4ba0-b5bc-255df9d11389 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.480575 Aug 31 15:46:55.143810 n-d-850499-9 devstack@n-api.service[106347]: [pid: 106347|app: 0|req: 8/14] 10.222.0.61 () {64 vars in 1283 bytes} [Wed Aug 31 15:46:54 2022] POST /compute/v2.1/flavors => generated 404 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 15:46:55.156460 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi [None req-2b136810-e1c9-425a-a472-0901ad8d86b9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:46:55.185792 n-d-850499-9 devstack@n-api.service[106346]: INFO nova.api.openstack.requestlog [None req-2b136810-e1c9-425a-a472-0901ad8d86b9 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033293 Aug 31 15:46:55.186705 n-d-850499-9 devstack@n-api.service[106346]: [pid: 106346|app: 0|req: 7/15] 10.222.0.61 () {64 vars in 1336 bytes} [Wed Aug 31 15:46:55 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:46:57.620181 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi [None req-a12e9ca3-1c6a-4ba0-b5bc-255df9d11389 admin admin] Calling method '>' {{(pid=106347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:46:57.621732 n-d-850499-9 devstack@n-api.service[106347]: INFO nova.api.openstack.requestlog [None req-a12e9ca3-1c6a-4ba0-b5bc-255df9d11389 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002106 Aug 31 15:46:57.622292 n-d-850499-9 devstack@n-api.service[106347]: [pid: 106347|app: 0|req: 9/16] 10.222.0.61 () {54 vars in 931 bytes} [Wed Aug 31 15:46:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:46:58.137152 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi [None req-a8e16350-22ed-41ee-8ea0-49af2056c6e1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "disk": 20, "id": "d4", "rxtx_factor": 1.0, "ram": 4096, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=106346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:46:58.168522 n-d-850499-9 devstack@n-api.service[106346]: INFO nova.api.openstack.requestlog [None req-a8e16350-22ed-41ee-8ea0-49af2056c6e1 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.538972 Aug 31 15:46:58.169085 n-d-850499-9 devstack@n-api.service[106346]: [pid: 106346|app: 0|req: 8/17] 10.222.0.61 () {64 vars in 1283 bytes} [Wed Aug 31 15:46:57 2022] POST /compute/v2.1/flavors => generated 404 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 15:46:58.185651 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi [None req-cec19b56-243b-4aed-b1e9-4a6609108ca1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:46:58.218123 n-d-850499-9 devstack@n-api.service[106347]: INFO nova.api.openstack.requestlog [None req-cec19b56-243b-4aed-b1e9-4a6609108ca1 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036932 Aug 31 15:46:58.226800 n-d-850499-9 devstack@n-api.service[106347]: [pid: 106347|app: 0|req: 10/18] 10.222.0.61 () {64 vars in 1336 bytes} [Wed Aug 31 15:46:58 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:47:00.765231 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi [None req-a8e16350-22ed-41ee-8ea0-49af2056c6e1 admin admin] Calling method '>' {{(pid=106346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:47:00.766256 n-d-850499-9 devstack@n-api.service[106346]: INFO nova.api.openstack.requestlog [None req-a8e16350-22ed-41ee-8ea0-49af2056c6e1 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Aug 31 15:47:00.771829 n-d-850499-9 devstack@n-api.service[106346]: [pid: 106346|app: 0|req: 9/19] 10.222.0.61 () {54 vars in 931 bytes} [Wed Aug 31 15:47:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:47:01.294469 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi [None req-1f84e4e1-0e4a-406d-b32d-635e7c15e5d5 admin admin] Calling method '>' {{(pid=106347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:47:01.320630 n-d-850499-9 devstack@n-api.service[106347]: INFO nova.api.openstack.requestlog [None req-1f84e4e1-0e4a-406d-b32d-635e7c15e5d5 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.547244 Aug 31 15:47:01.321521 n-d-850499-9 devstack@n-api.service[106347]: [pid: 106347|app: 0|req: 11/20] 10.222.0.61 () {60 vars in 1292 bytes} [Wed Aug 31 15:47:00 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:47:03.752860 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi [None req-a8e16350-22ed-41ee-8ea0-49af2056c6e1 admin admin] Calling method '>' {{(pid=106346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:47:03.754144 n-d-850499-9 devstack@n-api.service[106346]: INFO nova.api.openstack.requestlog [None req-a8e16350-22ed-41ee-8ea0-49af2056c6e1 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001905 Aug 31 15:47:03.754637 n-d-850499-9 devstack@n-api.service[106346]: [pid: 106346|app: 0|req: 10/21] 10.222.0.61 () {54 vars in 931 bytes} [Wed Aug 31 15:47:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:47:04.237914 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi [None req-f9f45c91-75f2-4e35-8bca-a06720b0577d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "os-flavor-access:is_public": true, "ram": 512, "vcpus": 1, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "id": "1"}} {{(pid=106347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:47:04.258230 n-d-850499-9 devstack@n-api.service[106347]: INFO nova.api.openstack.requestlog [None req-f9f45c91-75f2-4e35-8bca-a06720b0577d admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.494616 Aug 31 15:47:04.259475 n-d-850499-9 devstack@n-api.service[106347]: [pid: 106347|app: 0|req: 12/22] 10.222.0.61 () {64 vars in 1283 bytes} [Wed Aug 31 15:47:03 2022] POST /compute/v2.1/flavors => generated 402 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 15:47:04.275791 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi [None req-c700f980-0c4f-4be5-8725-e685de2f797d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:47:04.305575 n-d-850499-9 devstack@n-api.service[106346]: INFO nova.api.openstack.requestlog [None req-c700f980-0c4f-4be5-8725-e685de2f797d admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035293 Aug 31 15:47:04.306597 n-d-850499-9 devstack@n-api.service[106346]: [pid: 106346|app: 0|req: 11/23] 10.222.0.61 () {64 vars in 1333 bytes} [Wed Aug 31 15:47:04 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:47:06.715191 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi [None req-f9f45c91-75f2-4e35-8bca-a06720b0577d admin admin] Calling method '>' {{(pid=106347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:47:06.716251 n-d-850499-9 devstack@n-api.service[106347]: INFO nova.api.openstack.requestlog [None req-f9f45c91-75f2-4e35-8bca-a06720b0577d admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Aug 31 15:47:06.716651 n-d-850499-9 devstack@n-api.service[106347]: [pid: 106347|app: 0|req: 13/24] 10.222.0.61 () {54 vars in 931 bytes} [Wed Aug 31 15:47:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:47:07.185649 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi [None req-8d9ea1d5-bb87-4793-bc95-9e75a812b2bb admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.small", "id": "2", "disk": 20, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:47:07.212206 n-d-850499-9 devstack@n-api.service[106346]: INFO nova.api.openstack.requestlog [None req-8d9ea1d5-bb87-4793-bc95-9e75a812b2bb admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.488947 Aug 31 15:47:07.212912 n-d-850499-9 devstack@n-api.service[106346]: [pid: 106346|app: 0|req: 12/25] 10.222.0.61 () {64 vars in 1283 bytes} [Wed Aug 31 15:47:06 2022] POST /compute/v2.1/flavors => generated 405 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 15:47:07.226195 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi [None req-441f0ddf-3659-4fd1-9bc6-8c3819b02c1f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:47:07.252123 n-d-850499-9 devstack@n-api.service[106347]: INFO nova.api.openstack.requestlog [None req-441f0ddf-3659-4fd1-9bc6-8c3819b02c1f admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030824 Aug 31 15:47:07.252838 n-d-850499-9 devstack@n-api.service[106347]: [pid: 106347|app: 0|req: 14/26] 10.222.0.61 () {64 vars in 1333 bytes} [Wed Aug 31 15:47:07 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:47:09.709454 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi [None req-8d9ea1d5-bb87-4793-bc95-9e75a812b2bb admin admin] Calling method '>' {{(pid=106346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:47:09.711250 n-d-850499-9 devstack@n-api.service[106346]: INFO nova.api.openstack.requestlog [None req-8d9ea1d5-bb87-4793-bc95-9e75a812b2bb admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002048 Aug 31 15:47:09.712032 n-d-850499-9 devstack@n-api.service[106346]: [pid: 106346|app: 0|req: 13/27] 10.222.0.61 () {54 vars in 931 bytes} [Wed Aug 31 15:47:09 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:47:10.127778 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi [None req-23191163-73bb-4c7c-aff6-92c605f1338b admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "ram": 4096, "rxtx_factor": 1.0, "vcpus": 2, "id": "3", "swap": 0}} {{(pid=106347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:47:10.154198 n-d-850499-9 devstack@n-api.service[106347]: INFO nova.api.openstack.requestlog [None req-23191163-73bb-4c7c-aff6-92c605f1338b admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.434464 Aug 31 15:47:10.154922 n-d-850499-9 devstack@n-api.service[106347]: [pid: 106347|app: 0|req: 15/28] 10.222.0.61 () {64 vars in 1283 bytes} [Wed Aug 31 15:47:09 2022] POST /compute/v2.1/flavors => generated 406 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 15:47:10.167828 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi [None req-5a7d7445-f6d3-4fae-b89d-ee4cf72bd1e4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:47:10.193041 n-d-850499-9 devstack@n-api.service[106346]: INFO nova.api.openstack.requestlog [None req-5a7d7445-f6d3-4fae-b89d-ee4cf72bd1e4 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028811 Aug 31 15:47:10.199982 n-d-850499-9 devstack@n-api.service[106346]: [pid: 106346|app: 0|req: 14/29] 10.222.0.61 () {64 vars in 1333 bytes} [Wed Aug 31 15:47:10 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:47:12.592462 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi [None req-23191163-73bb-4c7c-aff6-92c605f1338b admin admin] Calling method '>' {{(pid=106347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:47:12.593470 n-d-850499-9 devstack@n-api.service[106347]: INFO nova.api.openstack.requestlog [None req-23191163-73bb-4c7c-aff6-92c605f1338b admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Aug 31 15:47:12.593877 n-d-850499-9 devstack@n-api.service[106347]: [pid: 106347|app: 0|req: 16/30] 10.222.0.61 () {54 vars in 931 bytes} [Wed Aug 31 15:47:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:47:12.994934 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi [None req-4e5ac138-daa2-4f5e-b5f1-4122727f695b admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "rxtx_factor": 1.0, "name": "m1.large", "os-flavor-access:is_public": true, "disk": 80, "ram": 8192}} {{(pid=106346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:47:13.001248 n-d-850499-9 devstack@n-api.service[106346]: DEBUG dbcounter [-] [106346] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=106346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:47:13.017494 n-d-850499-9 devstack@n-api.service[106346]: INFO nova.api.openstack.requestlog [None req-4e5ac138-daa2-4f5e-b5f1-4122727f695b admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.417328 Aug 31 15:47:13.018054 n-d-850499-9 devstack@n-api.service[106346]: [pid: 106346|app: 0|req: 15/31] 10.222.0.61 () {64 vars in 1283 bytes} [Wed Aug 31 15:47:12 2022] POST /compute/v2.1/flavors => generated 405 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 15:47:13.030304 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi [None req-6db6b740-cfac-4808-9b7b-00cac2a05d50 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:47:13.058780 n-d-850499-9 devstack@n-api.service[106347]: INFO nova.api.openstack.requestlog [None req-6db6b740-cfac-4808-9b7b-00cac2a05d50 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032425 Aug 31 15:47:13.059541 n-d-850499-9 devstack@n-api.service[106347]: [pid: 106347|app: 0|req: 17/32] 10.222.0.61 () {64 vars in 1333 bytes} [Wed Aug 31 15:47:13 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:47:15.528566 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi [None req-4e5ac138-daa2-4f5e-b5f1-4122727f695b admin admin] Calling method '>' {{(pid=106346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:47:15.529582 n-d-850499-9 devstack@n-api.service[106346]: INFO nova.api.openstack.requestlog [None req-4e5ac138-daa2-4f5e-b5f1-4122727f695b admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Aug 31 15:47:15.529992 n-d-850499-9 devstack@n-api.service[106346]: [pid: 106346|app: 0|req: 16/33] 10.222.0.61 () {54 vars in 931 bytes} [Wed Aug 31 15:47:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:47:15.996531 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi [None req-23606016-e8c0-45ad-9bd0-154f92c51321 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "disk": 160, "swap": 0, "name": "m1.xlarge", "ram": 16384, "os-flavor-access:is_public": true, "vcpus": 8, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:47:16.002321 n-d-850499-9 devstack@n-api.service[106347]: DEBUG dbcounter [-] [106347] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=106347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:47:16.024837 n-d-850499-9 devstack@n-api.service[106347]: INFO nova.api.openstack.requestlog [None req-23606016-e8c0-45ad-9bd0-154f92c51321 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.488486 Aug 31 15:47:16.027581 n-d-850499-9 devstack@n-api.service[106347]: [pid: 106347|app: 0|req: 18/34] 10.222.0.61 () {64 vars in 1283 bytes} [Wed Aug 31 15:47:15 2022] POST /compute/v2.1/flavors => generated 408 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 15:47:16.038646 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi [None req-3f309fe6-2c2f-42c2-8861-f3c076a2be95 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:47:16.066952 n-d-850499-9 devstack@n-api.service[106346]: INFO nova.api.openstack.requestlog [None req-3f309fe6-2c2f-42c2-8861-f3c076a2be95 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033009 Aug 31 15:47:16.067879 n-d-850499-9 devstack@n-api.service[106346]: [pid: 106346|app: 0|req: 17/35] 10.222.0.61 () {64 vars in 1333 bytes} [Wed Aug 31 15:47:16 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:47:39.250350 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi [None req-23606016-e8c0-45ad-9bd0-154f92c51321 admin admin] Calling method '>' {{(pid=106347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:47:39.251272 n-d-850499-9 devstack@n-api.service[106347]: INFO nova.api.openstack.requestlog [None req-23606016-e8c0-45ad-9bd0-154f92c51321 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Aug 31 15:47:39.251706 n-d-850499-9 devstack@n-api.service[106347]: [pid: 106347|app: 0|req: 19/36] 10.222.0.61 () {54 vars in 931 bytes} [Wed Aug 31 15:47:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:47:39.262195 n-d-850499-9 devstack@n-api.service[106346]: DEBUG dbcounter [-] [106346] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=106346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:47:39.650893 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi [None req-33e85e84-993e-4db5-bad3-6552fd755c1a admin admin] Calling method '>' {{(pid=106346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:47:39.668960 n-d-850499-9 devstack@n-api.service[106346]: INFO nova.api.openstack.requestlog [None req-33e85e84-993e-4db5-bad3-6552fd755c1a admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.411228 Aug 31 15:47:39.669492 n-d-850499-9 devstack@n-api.service[106346]: [pid: 106346|app: 0|req: 18/37] 10.222.0.61 () {60 vars in 1292 bytes} [Wed Aug 31 15:47:39 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 15:47:40.740101 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi [None req-23606016-e8c0-45ad-9bd0-154f92c51321 admin admin] Calling method '>' {{(pid=106347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:47:40.741133 n-d-850499-9 devstack@n-api.service[106347]: INFO nova.api.openstack.requestlog [None req-23606016-e8c0-45ad-9bd0-154f92c51321 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001534 Aug 31 15:47:40.741529 n-d-850499-9 devstack@n-api.service[106347]: [pid: 106347|app: 0|req: 20/38] 10.222.0.61 () {56 vars in 1074 bytes} [Wed Aug 31 15:47:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:47:41.293606 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi [None req-d3347380-7fa2-4e8d-a8bc-0f91db990167 admin admin] Calling method '>' {{(pid=106346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:47:41.299291 n-d-850499-9 devstack@n-api.service[106346]: INFO nova.api.openstack.wsgi [None req-d3347380-7fa2-4e8d-a8bc-0f91db990167 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 31 15:47:41.302678 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi [None req-d3347380-7fa2-4e8d-a8bc-0f91db990167 admin admin] Request method failure captured: Aug 31 15:47:41.302678 n-d-850499-9 devstack@n-api.service[106346]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 31 15:47:41.302678 n-d-850499-9 devstack@n-api.service[106346]: Accept: application/json Aug 31 15:47:41.302678 n-d-850499-9 devstack@n-api.service[106346]: Accept-Encoding: gzip, deflate Aug 31 15:47:41.302678 n-d-850499-9 devstack@n-api.service[106346]: Connection: keep-alive Aug 31 15:47:41.302678 n-d-850499-9 devstack@n-api.service[106346]: Content-Length: 0 Aug 31 15:47:41.302678 n-d-850499-9 devstack@n-api.service[106346]: Host: 10.222.0.61 Aug 31 15:47:41.302678 n-d-850499-9 devstack@n-api.service[106346]: Openstack-Api-Version: compute 2.90 Aug 31 15:47:41.302678 n-d-850499-9 devstack@n-api.service[106346]: Openstack-System-Scope: None Aug 31 15:47:41.302678 n-d-850499-9 devstack@n-api.service[106346]: User-Agent: python-novaclient Aug 31 15:47:41.302678 n-d-850499-9 devstack@n-api.service[106346]: X-Auth-Token: gAAAAABjD4KcFsv0STnCMwhd9Av3qa0sl4AFdlwGWnd-QnkIaP2J5GxoBx26nyNjVcFwjA5G4OJhpOc5zp9qEVpcT_lnwE6dGxxoycOjGpH3Ta_QZEe3OnBppXqfLoJ_6jWbh7OEt-3OQb-ylfjJHi4f9L-iFcgwk8REgGvjyQEX1YH6Jnmf_NM Aug 31 15:47:41.302678 n-d-850499-9 devstack@n-api.service[106346]: X-Domain-Id: None Aug 31 15:47:41.302678 n-d-850499-9 devstack@n-api.service[106346]: X-Domain-Name: None Aug 31 15:47:41.302678 n-d-850499-9 devstack@n-api.service[106346]: X-Identity-Status: Confirmed Aug 31 15:47:41.302678 n-d-850499-9 devstack@n-api.service[106346]: X-Is-Admin-Project: True Aug 31 15:47:41.302678 n-d-850499-9 devstack@n-api.service[106346]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 15:47:41.302678 n-d-850499-9 devstack@n-api.service[106346]: X-Project-Domain-Id: default Aug 31 15:47:41.302678 n-d-850499-9 devstack@n-api.service[106346]: X-Project-Domain-Name: Default Aug 31 15:47:41.302678 n-d-850499-9 devstack@n-api.service[106346]: X-Project-Id: 3eea5e201ec243d28a91d4abbbc142ae Aug 31 15:47:41.302678 n-d-850499-9 devstack@n-api.service[106346]: X-Project-Name: admin Aug 31 15:47:41.302678 n-d-850499-9 devstack@n-api.service[106346]: X-Role: reader,admin,member Aug 31 15:47:41.302678 n-d-850499-9 devstack@n-api.service[106346]: X-Roles: reader,admin,member Aug 31 15:47:41.304486 n-d-850499-9 devstack@n-api.service[106346]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/3eea5e201ec243d28a91d4abbbc142ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/3eea5e201ec243d28a91d4abbbc142ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_3eea5e201ec243d28a91d4abbbc142ae", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/3eea5e201ec243d28a91d4abbbc142ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 15:47:41.304486 n-d-850499-9 devstack@n-api.service[106346]: X-Tenant: admin Aug 31 15:47:41.304486 n-d-850499-9 devstack@n-api.service[106346]: X-Tenant-Id: 3eea5e201ec243d28a91d4abbbc142ae Aug 31 15:47:41.304486 n-d-850499-9 devstack@n-api.service[106346]: X-Tenant-Name: admin Aug 31 15:47:41.304486 n-d-850499-9 devstack@n-api.service[106346]: X-User: admin Aug 31 15:47:41.304486 n-d-850499-9 devstack@n-api.service[106346]: X-User-Domain-Id: default Aug 31 15:47:41.304486 n-d-850499-9 devstack@n-api.service[106346]: X-User-Domain-Name: Default Aug 31 15:47:41.304486 n-d-850499-9 devstack@n-api.service[106346]: X-User-Id: 89457b093ae547728391fec96887f7f3 Aug 31 15:47:41.304486 n-d-850499-9 devstack@n-api.service[106346]: X-User-Name: admin Aug 31 15:47:41.304486 n-d-850499-9 devstack@n-api.service[106346]: method: > Aug 31 15:47:41.304486 n-d-850499-9 devstack@n-api.service[106346]: exception: Flavor 42 could not be found. Aug 31 15:47:41.304486 n-d-850499-9 devstack@n-api.service[106346]: action_args: {'id': '42'} Aug 31 15:47:41.304486 n-d-850499-9 devstack@n-api.service[106346]: {{(pid=106346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:47:41.304486 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:47:41.308496 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 15:47:41.308496 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 15:47:41.308496 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 15:47:41.308496 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 15:47:41.308496 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 15:47:41.308496 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 15:47:41.308496 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 15:47:41.308496 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 15:47:41.308496 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 15:47:41.308496 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:47:41.308496 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 15:47:41.308496 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 15:47:41.308496 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 31 15:47:41.308496 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi Aug 31 15:47:41.308496 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:47:41.308496 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi Aug 31 15:47:41.308496 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:47:41.308496 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:47:41.308496 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:47:41.309880 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:47:41.309880 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:47:41.309880 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:47:41.309880 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:47:41.309880 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 15:47:41.309880 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:47:41.309880 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 31 15:47:41.309880 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi Aug 31 15:47:41.309880 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:47:41.309880 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi Aug 31 15:47:41.309880 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:47:41.309880 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:47:41.309880 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:47:41.309880 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:47:41.309880 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:47:41.309880 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 31 15:47:41.309880 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi Aug 31 15:47:41.309880 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi [None req-d3347380-7fa2-4e8d-a8bc-0f91db990167 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106346) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:47:41.311107 n-d-850499-9 devstack@n-api.service[106346]: INFO nova.api.openstack.requestlog [None req-d3347380-7fa2-4e8d-a8bc-0f91db990167 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.402824 Aug 31 15:47:41.311107 n-d-850499-9 devstack@n-api.service[106346]: [pid: 106346|app: 0|req: 19/39] 10.222.0.61 () {60 vars in 1190 bytes} [Wed Aug 31 15:47:40 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 404 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 15:47:41.314232 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi [None req-45118ba6-1315-4ed6-8474-a157496c16a6 admin admin] Calling method '>' {{(pid=106347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:47:41.337393 n-d-850499-9 devstack@n-api.service[106347]: INFO nova.api.openstack.requestlog [None req-45118ba6-1315-4ed6-8474-a157496c16a6 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027090 Aug 31 15:47:41.337917 n-d-850499-9 devstack@n-api.service[106347]: [pid: 106347|app: 0|req: 21/40] 10.222.0.61 () {60 vars in 1210 bytes} [Wed Aug 31 15:47:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:47:41.349901 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi [None req-80998475-7286-4118-8015-8c44971fcd05 admin admin] Calling method '>' {{(pid=106346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:47:41.372731 n-d-850499-9 devstack@n-api.service[106346]: INFO nova.api.openstack.requestlog [None req-80998475-7286-4118-8015-8c44971fcd05 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026411 Aug 31 15:47:41.373258 n-d-850499-9 devstack@n-api.service[106346]: [pid: 106346|app: 0|req: 20/41] 10.222.0.61 () {60 vars in 1210 bytes} [Wed Aug 31 15:47:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:47:41.383472 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi [None req-1210c8fd-b32e-4e68-851b-198a4980025b admin admin] Calling method '>' {{(pid=106347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:47:41.392469 n-d-850499-9 devstack@n-api.service[106347]: INFO nova.api.openstack.wsgi [None req-1210c8fd-b32e-4e68-851b-198a4980025b admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 31 15:47:41.395807 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi [None req-1210c8fd-b32e-4e68-851b-198a4980025b admin admin] Request method failure captured: Aug 31 15:47:41.395807 n-d-850499-9 devstack@n-api.service[106347]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 31 15:47:41.395807 n-d-850499-9 devstack@n-api.service[106347]: Accept: application/json Aug 31 15:47:41.395807 n-d-850499-9 devstack@n-api.service[106347]: Accept-Encoding: gzip, deflate Aug 31 15:47:41.395807 n-d-850499-9 devstack@n-api.service[106347]: Connection: keep-alive Aug 31 15:47:41.395807 n-d-850499-9 devstack@n-api.service[106347]: Content-Length: 0 Aug 31 15:47:41.395807 n-d-850499-9 devstack@n-api.service[106347]: Host: 10.222.0.61 Aug 31 15:47:41.395807 n-d-850499-9 devstack@n-api.service[106347]: Openstack-Api-Version: compute 2.90 Aug 31 15:47:41.395807 n-d-850499-9 devstack@n-api.service[106347]: Openstack-System-Scope: None Aug 31 15:47:41.395807 n-d-850499-9 devstack@n-api.service[106347]: User-Agent: python-novaclient Aug 31 15:47:41.395807 n-d-850499-9 devstack@n-api.service[106347]: X-Auth-Token: gAAAAABjD4KcFsv0STnCMwhd9Av3qa0sl4AFdlwGWnd-QnkIaP2J5GxoBx26nyNjVcFwjA5G4OJhpOc5zp9qEVpcT_lnwE6dGxxoycOjGpH3Ta_QZEe3OnBppXqfLoJ_6jWbh7OEt-3OQb-ylfjJHi4f9L-iFcgwk8REgGvjyQEX1YH6Jnmf_NM Aug 31 15:47:41.395807 n-d-850499-9 devstack@n-api.service[106347]: X-Domain-Id: None Aug 31 15:47:41.395807 n-d-850499-9 devstack@n-api.service[106347]: X-Domain-Name: None Aug 31 15:47:41.395807 n-d-850499-9 devstack@n-api.service[106347]: X-Identity-Status: Confirmed Aug 31 15:47:41.395807 n-d-850499-9 devstack@n-api.service[106347]: X-Is-Admin-Project: True Aug 31 15:47:41.395807 n-d-850499-9 devstack@n-api.service[106347]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 15:47:41.395807 n-d-850499-9 devstack@n-api.service[106347]: X-Project-Domain-Id: default Aug 31 15:47:41.395807 n-d-850499-9 devstack@n-api.service[106347]: X-Project-Domain-Name: Default Aug 31 15:47:41.395807 n-d-850499-9 devstack@n-api.service[106347]: X-Project-Id: 3eea5e201ec243d28a91d4abbbc142ae Aug 31 15:47:41.395807 n-d-850499-9 devstack@n-api.service[106347]: X-Project-Name: admin Aug 31 15:47:41.395807 n-d-850499-9 devstack@n-api.service[106347]: X-Role: reader,admin,member Aug 31 15:47:41.395807 n-d-850499-9 devstack@n-api.service[106347]: X-Roles: reader,admin,member Aug 31 15:47:41.397280 n-d-850499-9 devstack@n-api.service[106347]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/3eea5e201ec243d28a91d4abbbc142ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/3eea5e201ec243d28a91d4abbbc142ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_3eea5e201ec243d28a91d4abbbc142ae", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/3eea5e201ec243d28a91d4abbbc142ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 15:47:41.397280 n-d-850499-9 devstack@n-api.service[106347]: X-Tenant: admin Aug 31 15:47:41.397280 n-d-850499-9 devstack@n-api.service[106347]: X-Tenant-Id: 3eea5e201ec243d28a91d4abbbc142ae Aug 31 15:47:41.397280 n-d-850499-9 devstack@n-api.service[106347]: X-Tenant-Name: admin Aug 31 15:47:41.397280 n-d-850499-9 devstack@n-api.service[106347]: X-User: admin Aug 31 15:47:41.397280 n-d-850499-9 devstack@n-api.service[106347]: X-User-Domain-Id: default Aug 31 15:47:41.397280 n-d-850499-9 devstack@n-api.service[106347]: X-User-Domain-Name: Default Aug 31 15:47:41.397280 n-d-850499-9 devstack@n-api.service[106347]: X-User-Id: 89457b093ae547728391fec96887f7f3 Aug 31 15:47:41.397280 n-d-850499-9 devstack@n-api.service[106347]: X-User-Name: admin Aug 31 15:47:41.397280 n-d-850499-9 devstack@n-api.service[106347]: method: > Aug 31 15:47:41.397280 n-d-850499-9 devstack@n-api.service[106347]: exception: Flavor 42 could not be found. Aug 31 15:47:41.397280 n-d-850499-9 devstack@n-api.service[106347]: action_args: {'id': '42'} Aug 31 15:47:41.397280 n-d-850499-9 devstack@n-api.service[106347]: {{(pid=106347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:47:41.397280 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:47:41.398238 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 15:47:41.398238 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 15:47:41.398238 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 15:47:41.398238 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 15:47:41.398238 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 15:47:41.398238 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 15:47:41.398238 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 15:47:41.398238 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 15:47:41.398238 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 15:47:41.398238 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:47:41.398238 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 15:47:41.398238 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 15:47:41.398238 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 31 15:47:41.398238 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi Aug 31 15:47:41.398238 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:47:41.398238 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi Aug 31 15:47:41.398238 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:47:41.398238 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:47:41.398238 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:47:41.399697 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:47:41.399697 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:47:41.399697 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:47:41.399697 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:47:41.399697 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 15:47:41.399697 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:47:41.399697 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 31 15:47:41.399697 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi Aug 31 15:47:41.399697 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:47:41.399697 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi Aug 31 15:47:41.399697 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:47:41.399697 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:47:41.399697 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:47:41.399697 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:47:41.399697 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:47:41.399697 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 31 15:47:41.399697 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi Aug 31 15:47:41.399697 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi [None req-1210c8fd-b32e-4e68-851b-198a4980025b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106347) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:47:41.401156 n-d-850499-9 devstack@n-api.service[106347]: INFO nova.api.openstack.requestlog [None req-1210c8fd-b32e-4e68-851b-198a4980025b admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.018249 Aug 31 15:47:41.401156 n-d-850499-9 devstack@n-api.service[106347]: [pid: 106347|app: 0|req: 22/42] 10.222.0.61 () {60 vars in 1190 bytes} [Wed Aug 31 15:47:41 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 15:47:42.380052 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi [None req-80998475-7286-4118-8015-8c44971fcd05 admin admin] Calling method '>' {{(pid=106346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:47:42.381068 n-d-850499-9 devstack@n-api.service[106346]: INFO nova.api.openstack.requestlog [None req-80998475-7286-4118-8015-8c44971fcd05 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Aug 31 15:47:42.381500 n-d-850499-9 devstack@n-api.service[106346]: [pid: 106346|app: 0|req: 21/43] 10.222.0.61 () {56 vars in 1074 bytes} [Wed Aug 31 15:47:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:47:42.919877 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi [None req-445980cd-785b-4cb9-a607-42b108f65870 admin admin] Calling method '>' {{(pid=106347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:47:42.925829 n-d-850499-9 devstack@n-api.service[106347]: INFO nova.api.openstack.wsgi [None req-445980cd-785b-4cb9-a607-42b108f65870 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 31 15:47:42.927360 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi [None req-445980cd-785b-4cb9-a607-42b108f65870 admin admin] Request method failure captured: Aug 31 15:47:42.927360 n-d-850499-9 devstack@n-api.service[106347]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 31 15:47:42.927360 n-d-850499-9 devstack@n-api.service[106347]: Accept: application/json Aug 31 15:47:42.927360 n-d-850499-9 devstack@n-api.service[106347]: Accept-Encoding: gzip, deflate Aug 31 15:47:42.927360 n-d-850499-9 devstack@n-api.service[106347]: Connection: keep-alive Aug 31 15:47:42.927360 n-d-850499-9 devstack@n-api.service[106347]: Content-Length: 0 Aug 31 15:47:42.927360 n-d-850499-9 devstack@n-api.service[106347]: Host: 10.222.0.61 Aug 31 15:47:42.927360 n-d-850499-9 devstack@n-api.service[106347]: Openstack-Api-Version: compute 2.90 Aug 31 15:47:42.927360 n-d-850499-9 devstack@n-api.service[106347]: Openstack-System-Scope: None Aug 31 15:47:42.927360 n-d-850499-9 devstack@n-api.service[106347]: User-Agent: python-novaclient Aug 31 15:47:42.927360 n-d-850499-9 devstack@n-api.service[106347]: X-Auth-Token: gAAAAABjD4KedBXlomKD837aw52963_82AXb5Zoej8NRb8Ol84FBVeN8qd4MxfUP3c0BXIf71GyYgIOXEt2lyoMzJKbpDBox_0o9ruoUVF3HF5XeR_gSyRoqOQjv3_6TSnYgr-Dn9ikxOktVUKrXI7tJGdgJOHamIAD1hdsvW8rn-eBjBlCPniA Aug 31 15:47:42.927360 n-d-850499-9 devstack@n-api.service[106347]: X-Domain-Id: None Aug 31 15:47:42.927360 n-d-850499-9 devstack@n-api.service[106347]: X-Domain-Name: None Aug 31 15:47:42.927360 n-d-850499-9 devstack@n-api.service[106347]: X-Identity-Status: Confirmed Aug 31 15:47:42.927360 n-d-850499-9 devstack@n-api.service[106347]: X-Is-Admin-Project: True Aug 31 15:47:42.927360 n-d-850499-9 devstack@n-api.service[106347]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 15:47:42.927360 n-d-850499-9 devstack@n-api.service[106347]: X-Project-Domain-Id: default Aug 31 15:47:42.927360 n-d-850499-9 devstack@n-api.service[106347]: X-Project-Domain-Name: Default Aug 31 15:47:42.927360 n-d-850499-9 devstack@n-api.service[106347]: X-Project-Id: 3eea5e201ec243d28a91d4abbbc142ae Aug 31 15:47:42.927360 n-d-850499-9 devstack@n-api.service[106347]: X-Project-Name: admin Aug 31 15:47:42.927360 n-d-850499-9 devstack@n-api.service[106347]: X-Role: reader,admin,member Aug 31 15:47:42.927360 n-d-850499-9 devstack@n-api.service[106347]: X-Roles: reader,admin,member Aug 31 15:47:42.928878 n-d-850499-9 devstack@n-api.service[106347]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/3eea5e201ec243d28a91d4abbbc142ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/3eea5e201ec243d28a91d4abbbc142ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_3eea5e201ec243d28a91d4abbbc142ae", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/3eea5e201ec243d28a91d4abbbc142ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 15:47:42.928878 n-d-850499-9 devstack@n-api.service[106347]: X-Tenant: admin Aug 31 15:47:42.928878 n-d-850499-9 devstack@n-api.service[106347]: X-Tenant-Id: 3eea5e201ec243d28a91d4abbbc142ae Aug 31 15:47:42.928878 n-d-850499-9 devstack@n-api.service[106347]: X-Tenant-Name: admin Aug 31 15:47:42.928878 n-d-850499-9 devstack@n-api.service[106347]: X-User: admin Aug 31 15:47:42.928878 n-d-850499-9 devstack@n-api.service[106347]: X-User-Domain-Id: default Aug 31 15:47:42.928878 n-d-850499-9 devstack@n-api.service[106347]: X-User-Domain-Name: Default Aug 31 15:47:42.928878 n-d-850499-9 devstack@n-api.service[106347]: X-User-Id: 89457b093ae547728391fec96887f7f3 Aug 31 15:47:42.928878 n-d-850499-9 devstack@n-api.service[106347]: X-User-Name: admin Aug 31 15:47:42.928878 n-d-850499-9 devstack@n-api.service[106347]: method: > Aug 31 15:47:42.928878 n-d-850499-9 devstack@n-api.service[106347]: exception: Flavor 84 could not be found. Aug 31 15:47:42.928878 n-d-850499-9 devstack@n-api.service[106347]: action_args: {'id': '84'} Aug 31 15:47:42.928878 n-d-850499-9 devstack@n-api.service[106347]: {{(pid=106347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:47:42.928878 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:47:42.930220 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 15:47:42.930220 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 15:47:42.930220 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 15:47:42.930220 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 15:47:42.930220 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 15:47:42.930220 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 15:47:42.930220 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 15:47:42.930220 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 15:47:42.930220 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 15:47:42.930220 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:47:42.930220 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 15:47:42.930220 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 15:47:42.930220 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 31 15:47:42.930220 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi Aug 31 15:47:42.930220 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:47:42.930220 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi Aug 31 15:47:42.930220 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:47:42.930220 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:47:42.930220 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:47:42.931283 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:47:42.931283 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:47:42.931283 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:47:42.931283 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:47:42.931283 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 15:47:42.931283 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:47:42.931283 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 31 15:47:42.931283 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi Aug 31 15:47:42.931283 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:47:42.931283 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi Aug 31 15:47:42.931283 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:47:42.931283 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:47:42.931283 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:47:42.931283 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:47:42.931283 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:47:42.931283 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 31 15:47:42.931283 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi Aug 31 15:47:42.931283 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi [None req-445980cd-785b-4cb9-a607-42b108f65870 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106347) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:47:42.932341 n-d-850499-9 devstack@n-api.service[106347]: INFO nova.api.openstack.requestlog [None req-445980cd-785b-4cb9-a607-42b108f65870 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.407058 Aug 31 15:47:42.932341 n-d-850499-9 devstack@n-api.service[106347]: [pid: 106347|app: 0|req: 23/44] 10.222.0.61 () {60 vars in 1190 bytes} [Wed Aug 31 15:47:42 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 408 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 15:47:42.938862 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi [None req-2a8b04ec-13af-4778-ba04-a98d4d5a4d73 admin admin] Calling method '>' {{(pid=106346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:47:42.954393 n-d-850499-9 devstack@n-api.service[106346]: INFO nova.api.openstack.requestlog [None req-2a8b04ec-13af-4778-ba04-a98d4d5a4d73 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019072 Aug 31 15:47:42.954920 n-d-850499-9 devstack@n-api.service[106346]: [pid: 106346|app: 0|req: 22/45] 10.222.0.61 () {60 vars in 1210 bytes} [Wed Aug 31 15:47:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 15:47:42.964849 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi [None req-dd698f46-c09c-4e70-814e-d1e3460985d6 admin admin] Calling method '>' {{(pid=106347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:47:42.980046 n-d-850499-9 devstack@n-api.service[106347]: INFO nova.api.openstack.requestlog [None req-dd698f46-c09c-4e70-814e-d1e3460985d6 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018879 Aug 31 15:47:42.980573 n-d-850499-9 devstack@n-api.service[106347]: [pid: 106347|app: 0|req: 24/46] 10.222.0.61 () {60 vars in 1210 bytes} [Wed Aug 31 15:47:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:47:42.989820 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi [None req-180e2d12-df7a-4d84-96ec-b13d098d0901 admin admin] Calling method '>' {{(pid=106346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:47:42.995818 n-d-850499-9 devstack@n-api.service[106346]: INFO nova.api.openstack.wsgi [None req-180e2d12-df7a-4d84-96ec-b13d098d0901 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 31 15:47:42.997322 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi [None req-180e2d12-df7a-4d84-96ec-b13d098d0901 admin admin] Request method failure captured: Aug 31 15:47:42.997322 n-d-850499-9 devstack@n-api.service[106346]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 31 15:47:42.997322 n-d-850499-9 devstack@n-api.service[106346]: Accept: application/json Aug 31 15:47:42.997322 n-d-850499-9 devstack@n-api.service[106346]: Accept-Encoding: gzip, deflate Aug 31 15:47:42.997322 n-d-850499-9 devstack@n-api.service[106346]: Connection: keep-alive Aug 31 15:47:42.997322 n-d-850499-9 devstack@n-api.service[106346]: Content-Length: 0 Aug 31 15:47:42.997322 n-d-850499-9 devstack@n-api.service[106346]: Host: 10.222.0.61 Aug 31 15:47:42.997322 n-d-850499-9 devstack@n-api.service[106346]: Openstack-Api-Version: compute 2.90 Aug 31 15:47:42.997322 n-d-850499-9 devstack@n-api.service[106346]: Openstack-System-Scope: None Aug 31 15:47:42.997322 n-d-850499-9 devstack@n-api.service[106346]: User-Agent: python-novaclient Aug 31 15:47:42.997322 n-d-850499-9 devstack@n-api.service[106346]: X-Auth-Token: gAAAAABjD4KedBXlomKD837aw52963_82AXb5Zoej8NRb8Ol84FBVeN8qd4MxfUP3c0BXIf71GyYgIOXEt2lyoMzJKbpDBox_0o9ruoUVF3HF5XeR_gSyRoqOQjv3_6TSnYgr-Dn9ikxOktVUKrXI7tJGdgJOHamIAD1hdsvW8rn-eBjBlCPniA Aug 31 15:47:42.997322 n-d-850499-9 devstack@n-api.service[106346]: X-Domain-Id: None Aug 31 15:47:42.997322 n-d-850499-9 devstack@n-api.service[106346]: X-Domain-Name: None Aug 31 15:47:42.997322 n-d-850499-9 devstack@n-api.service[106346]: X-Identity-Status: Confirmed Aug 31 15:47:42.997322 n-d-850499-9 devstack@n-api.service[106346]: X-Is-Admin-Project: True Aug 31 15:47:42.997322 n-d-850499-9 devstack@n-api.service[106346]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 15:47:42.997322 n-d-850499-9 devstack@n-api.service[106346]: X-Project-Domain-Id: default Aug 31 15:47:42.997322 n-d-850499-9 devstack@n-api.service[106346]: X-Project-Domain-Name: Default Aug 31 15:47:42.997322 n-d-850499-9 devstack@n-api.service[106346]: X-Project-Id: 3eea5e201ec243d28a91d4abbbc142ae Aug 31 15:47:42.997322 n-d-850499-9 devstack@n-api.service[106346]: X-Project-Name: admin Aug 31 15:47:42.997322 n-d-850499-9 devstack@n-api.service[106346]: X-Role: reader,admin,member Aug 31 15:47:42.997322 n-d-850499-9 devstack@n-api.service[106346]: X-Roles: reader,admin,member Aug 31 15:47:42.998601 n-d-850499-9 devstack@n-api.service[106346]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/3eea5e201ec243d28a91d4abbbc142ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/3eea5e201ec243d28a91d4abbbc142ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_3eea5e201ec243d28a91d4abbbc142ae", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/3eea5e201ec243d28a91d4abbbc142ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 15:47:42.998601 n-d-850499-9 devstack@n-api.service[106346]: X-Tenant: admin Aug 31 15:47:42.998601 n-d-850499-9 devstack@n-api.service[106346]: X-Tenant-Id: 3eea5e201ec243d28a91d4abbbc142ae Aug 31 15:47:42.998601 n-d-850499-9 devstack@n-api.service[106346]: X-Tenant-Name: admin Aug 31 15:47:42.998601 n-d-850499-9 devstack@n-api.service[106346]: X-User: admin Aug 31 15:47:42.998601 n-d-850499-9 devstack@n-api.service[106346]: X-User-Domain-Id: default Aug 31 15:47:42.998601 n-d-850499-9 devstack@n-api.service[106346]: X-User-Domain-Name: Default Aug 31 15:47:42.998601 n-d-850499-9 devstack@n-api.service[106346]: X-User-Id: 89457b093ae547728391fec96887f7f3 Aug 31 15:47:42.998601 n-d-850499-9 devstack@n-api.service[106346]: X-User-Name: admin Aug 31 15:47:42.998601 n-d-850499-9 devstack@n-api.service[106346]: method: > Aug 31 15:47:42.998601 n-d-850499-9 devstack@n-api.service[106346]: exception: Flavor 84 could not be found. Aug 31 15:47:42.998601 n-d-850499-9 devstack@n-api.service[106346]: action_args: {'id': '84'} Aug 31 15:47:42.998601 n-d-850499-9 devstack@n-api.service[106346]: {{(pid=106346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:47:42.998601 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:47:42.999461 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 15:47:42.999461 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 15:47:42.999461 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 15:47:42.999461 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 15:47:42.999461 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 15:47:42.999461 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 15:47:42.999461 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 15:47:42.999461 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 15:47:42.999461 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 15:47:42.999461 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:47:42.999461 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 15:47:42.999461 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 15:47:42.999461 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 31 15:47:42.999461 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi Aug 31 15:47:42.999461 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:47:42.999461 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi Aug 31 15:47:42.999461 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:47:42.999461 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:47:42.999461 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:47:43.000533 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:47:43.000533 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:47:43.000533 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:47:43.000533 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:47:43.000533 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 15:47:43.000533 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:47:43.000533 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 31 15:47:43.000533 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi Aug 31 15:47:43.000533 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:47:43.000533 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi Aug 31 15:47:43.000533 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:47:43.000533 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:47:43.000533 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:47:43.000533 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:47:43.000533 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:47:43.000533 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 31 15:47:43.000533 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi Aug 31 15:47:43.000533 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi [None req-180e2d12-df7a-4d84-96ec-b13d098d0901 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106346) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:47:43.001499 n-d-850499-9 devstack@n-api.service[106346]: INFO nova.api.openstack.requestlog [None req-180e2d12-df7a-4d84-96ec-b13d098d0901 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012424 Aug 31 15:47:43.001499 n-d-850499-9 devstack@n-api.service[106346]: [pid: 106346|app: 0|req: 23/47] 10.222.0.61 () {60 vars in 1190 bytes} [Wed Aug 31 15:47:42 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 31 15:47:43.971972 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi [None req-dd698f46-c09c-4e70-814e-d1e3460985d6 admin admin] Calling method '>' {{(pid=106347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:47:43.972973 n-d-850499-9 devstack@n-api.service[106347]: INFO nova.api.openstack.requestlog [None req-dd698f46-c09c-4e70-814e-d1e3460985d6 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Aug 31 15:47:43.973370 n-d-850499-9 devstack@n-api.service[106347]: [pid: 106347|app: 0|req: 25/48] 10.222.0.61 () {56 vars in 1074 bytes} [Wed Aug 31 15:47:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:47:44.516212 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi [None req-ce35a33c-25d9-4e85-b237-2afcf87f434f admin admin] Calling method '>' {{(pid=106346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:47:44.522011 n-d-850499-9 devstack@n-api.service[106346]: INFO nova.api.openstack.wsgi [None req-ce35a33c-25d9-4e85-b237-2afcf87f434f admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 31 15:47:44.523690 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi [None req-ce35a33c-25d9-4e85-b237-2afcf87f434f admin admin] Request method failure captured: Aug 31 15:47:44.523690 n-d-850499-9 devstack@n-api.service[106346]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 31 15:47:44.523690 n-d-850499-9 devstack@n-api.service[106346]: Accept: application/json Aug 31 15:47:44.523690 n-d-850499-9 devstack@n-api.service[106346]: Accept-Encoding: gzip, deflate Aug 31 15:47:44.523690 n-d-850499-9 devstack@n-api.service[106346]: Connection: keep-alive Aug 31 15:47:44.523690 n-d-850499-9 devstack@n-api.service[106346]: Content-Length: 0 Aug 31 15:47:44.523690 n-d-850499-9 devstack@n-api.service[106346]: Host: 10.222.0.61 Aug 31 15:47:44.523690 n-d-850499-9 devstack@n-api.service[106346]: Openstack-Api-Version: compute 2.90 Aug 31 15:47:44.523690 n-d-850499-9 devstack@n-api.service[106346]: Openstack-System-Scope: None Aug 31 15:47:44.523690 n-d-850499-9 devstack@n-api.service[106346]: User-Agent: python-novaclient Aug 31 15:47:44.523690 n-d-850499-9 devstack@n-api.service[106346]: X-Auth-Token: gAAAAABjD4Kf3zK8rZL1cRP07ywBP5Rfi8FxD7YkXH9XhXqtKKMU7YmMShZ0vLzifEzrw5e1yv762LHKJ0AxFCn5Im_j_xqRDwoHP4dwp0U89oXWetay-bzvsKtM_-bBcVINEP8-bU6gOQF66-L1xvrGsh-geKD2GTi-ezVyy9UbQS8ysP71eMY Aug 31 15:47:44.523690 n-d-850499-9 devstack@n-api.service[106346]: X-Domain-Id: None Aug 31 15:47:44.523690 n-d-850499-9 devstack@n-api.service[106346]: X-Domain-Name: None Aug 31 15:47:44.523690 n-d-850499-9 devstack@n-api.service[106346]: X-Identity-Status: Confirmed Aug 31 15:47:44.523690 n-d-850499-9 devstack@n-api.service[106346]: X-Is-Admin-Project: True Aug 31 15:47:44.523690 n-d-850499-9 devstack@n-api.service[106346]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 15:47:44.523690 n-d-850499-9 devstack@n-api.service[106346]: X-Project-Domain-Id: default Aug 31 15:47:44.523690 n-d-850499-9 devstack@n-api.service[106346]: X-Project-Domain-Name: Default Aug 31 15:47:44.523690 n-d-850499-9 devstack@n-api.service[106346]: X-Project-Id: 3eea5e201ec243d28a91d4abbbc142ae Aug 31 15:47:44.523690 n-d-850499-9 devstack@n-api.service[106346]: X-Project-Name: admin Aug 31 15:47:44.523690 n-d-850499-9 devstack@n-api.service[106346]: X-Role: reader,admin,member Aug 31 15:47:44.523690 n-d-850499-9 devstack@n-api.service[106346]: X-Roles: reader,admin,member Aug 31 15:47:44.525148 n-d-850499-9 devstack@n-api.service[106346]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/3eea5e201ec243d28a91d4abbbc142ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/3eea5e201ec243d28a91d4abbbc142ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_3eea5e201ec243d28a91d4abbbc142ae", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/3eea5e201ec243d28a91d4abbbc142ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 15:47:44.525148 n-d-850499-9 devstack@n-api.service[106346]: X-Tenant: admin Aug 31 15:47:44.525148 n-d-850499-9 devstack@n-api.service[106346]: X-Tenant-Id: 3eea5e201ec243d28a91d4abbbc142ae Aug 31 15:47:44.525148 n-d-850499-9 devstack@n-api.service[106346]: X-Tenant-Name: admin Aug 31 15:47:44.525148 n-d-850499-9 devstack@n-api.service[106346]: X-User: admin Aug 31 15:47:44.525148 n-d-850499-9 devstack@n-api.service[106346]: X-User-Domain-Id: default Aug 31 15:47:44.525148 n-d-850499-9 devstack@n-api.service[106346]: X-User-Domain-Name: Default Aug 31 15:47:44.525148 n-d-850499-9 devstack@n-api.service[106346]: X-User-Id: 89457b093ae547728391fec96887f7f3 Aug 31 15:47:44.525148 n-d-850499-9 devstack@n-api.service[106346]: X-User-Name: admin Aug 31 15:47:44.525148 n-d-850499-9 devstack@n-api.service[106346]: method: > Aug 31 15:47:44.525148 n-d-850499-9 devstack@n-api.service[106346]: exception: Flavor 451 could not be found. Aug 31 15:47:44.525148 n-d-850499-9 devstack@n-api.service[106346]: action_args: {'id': '451'} Aug 31 15:47:44.525148 n-d-850499-9 devstack@n-api.service[106346]: {{(pid=106346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:47:44.525148 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:47:44.526035 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 15:47:44.526035 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 15:47:44.526035 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 15:47:44.526035 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 15:47:44.526035 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 15:47:44.526035 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 15:47:44.526035 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 15:47:44.526035 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 15:47:44.526035 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 15:47:44.526035 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:47:44.526035 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 15:47:44.526035 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 15:47:44.526035 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 31 15:47:44.526035 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi Aug 31 15:47:44.526035 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:47:44.526035 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi Aug 31 15:47:44.526035 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:47:44.526035 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:47:44.526035 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:47:44.527156 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:47:44.527156 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:47:44.527156 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:47:44.527156 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:47:44.527156 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 15:47:44.527156 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:47:44.527156 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 31 15:47:44.527156 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi Aug 31 15:47:44.527156 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:47:44.527156 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi Aug 31 15:47:44.527156 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:47:44.527156 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:47:44.527156 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:47:44.527156 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:47:44.527156 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:47:44.527156 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 31 15:47:44.527156 n-d-850499-9 devstack@n-api.service[106346]: ERROR nova.api.openstack.wsgi Aug 31 15:47:44.527156 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi [None req-ce35a33c-25d9-4e85-b237-2afcf87f434f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106346) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:47:44.528501 n-d-850499-9 devstack@n-api.service[106346]: INFO nova.api.openstack.requestlog [None req-ce35a33c-25d9-4e85-b237-2afcf87f434f admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.399348 Aug 31 15:47:44.528501 n-d-850499-9 devstack@n-api.service[106346]: [pid: 106346|app: 0|req: 24/49] 10.222.0.61 () {60 vars in 1193 bytes} [Wed Aug 31 15:47:44 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 400 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 15:47:44.534548 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi [None req-bce276d5-6ccf-4f93-9713-17ec807878db admin admin] Calling method '>' {{(pid=106347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:47:44.549912 n-d-850499-9 devstack@n-api.service[106347]: INFO nova.api.openstack.requestlog [None req-bce276d5-6ccf-4f93-9713-17ec807878db admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018872 Aug 31 15:47:44.550434 n-d-850499-9 devstack@n-api.service[106347]: [pid: 106347|app: 0|req: 26/50] 10.222.0.61 () {60 vars in 1210 bytes} [Wed Aug 31 15:47:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:47:44.560579 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi [None req-cc437799-8ef5-4896-b982-97d4b15f3e8b admin admin] Calling method '>' {{(pid=106346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:47:44.577331 n-d-850499-9 devstack@n-api.service[106346]: INFO nova.api.openstack.requestlog [None req-cc437799-8ef5-4896-b982-97d4b15f3e8b admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019913 Aug 31 15:47:44.577914 n-d-850499-9 devstack@n-api.service[106346]: [pid: 106346|app: 0|req: 25/51] 10.222.0.61 () {60 vars in 1210 bytes} [Wed Aug 31 15:47:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 15:47:44.587764 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi [None req-5700131e-f83b-4251-8b52-7ce03ce16be0 admin admin] Calling method '>' {{(pid=106347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:47:44.593098 n-d-850499-9 devstack@n-api.service[106347]: INFO nova.api.openstack.wsgi [None req-5700131e-f83b-4251-8b52-7ce03ce16be0 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 31 15:47:44.594588 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi [None req-5700131e-f83b-4251-8b52-7ce03ce16be0 admin admin] Request method failure captured: Aug 31 15:47:44.594588 n-d-850499-9 devstack@n-api.service[106347]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 31 15:47:44.594588 n-d-850499-9 devstack@n-api.service[106347]: Accept: application/json Aug 31 15:47:44.594588 n-d-850499-9 devstack@n-api.service[106347]: Accept-Encoding: gzip, deflate Aug 31 15:47:44.594588 n-d-850499-9 devstack@n-api.service[106347]: Connection: keep-alive Aug 31 15:47:44.594588 n-d-850499-9 devstack@n-api.service[106347]: Content-Length: 0 Aug 31 15:47:44.594588 n-d-850499-9 devstack@n-api.service[106347]: Host: 10.222.0.61 Aug 31 15:47:44.594588 n-d-850499-9 devstack@n-api.service[106347]: Openstack-Api-Version: compute 2.90 Aug 31 15:47:44.594588 n-d-850499-9 devstack@n-api.service[106347]: Openstack-System-Scope: None Aug 31 15:47:44.594588 n-d-850499-9 devstack@n-api.service[106347]: User-Agent: python-novaclient Aug 31 15:47:44.594588 n-d-850499-9 devstack@n-api.service[106347]: X-Auth-Token: gAAAAABjD4Kf3zK8rZL1cRP07ywBP5Rfi8FxD7YkXH9XhXqtKKMU7YmMShZ0vLzifEzrw5e1yv762LHKJ0AxFCn5Im_j_xqRDwoHP4dwp0U89oXWetay-bzvsKtM_-bBcVINEP8-bU6gOQF66-L1xvrGsh-geKD2GTi-ezVyy9UbQS8ysP71eMY Aug 31 15:47:44.594588 n-d-850499-9 devstack@n-api.service[106347]: X-Domain-Id: None Aug 31 15:47:44.594588 n-d-850499-9 devstack@n-api.service[106347]: X-Domain-Name: None Aug 31 15:47:44.594588 n-d-850499-9 devstack@n-api.service[106347]: X-Identity-Status: Confirmed Aug 31 15:47:44.594588 n-d-850499-9 devstack@n-api.service[106347]: X-Is-Admin-Project: True Aug 31 15:47:44.594588 n-d-850499-9 devstack@n-api.service[106347]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 15:47:44.594588 n-d-850499-9 devstack@n-api.service[106347]: X-Project-Domain-Id: default Aug 31 15:47:44.594588 n-d-850499-9 devstack@n-api.service[106347]: X-Project-Domain-Name: Default Aug 31 15:47:44.594588 n-d-850499-9 devstack@n-api.service[106347]: X-Project-Id: 3eea5e201ec243d28a91d4abbbc142ae Aug 31 15:47:44.594588 n-d-850499-9 devstack@n-api.service[106347]: X-Project-Name: admin Aug 31 15:47:44.594588 n-d-850499-9 devstack@n-api.service[106347]: X-Role: reader,admin,member Aug 31 15:47:44.594588 n-d-850499-9 devstack@n-api.service[106347]: X-Roles: reader,admin,member Aug 31 15:47:44.596082 n-d-850499-9 devstack@n-api.service[106347]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/3eea5e201ec243d28a91d4abbbc142ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/3eea5e201ec243d28a91d4abbbc142ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_3eea5e201ec243d28a91d4abbbc142ae", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/3eea5e201ec243d28a91d4abbbc142ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 15:47:44.596082 n-d-850499-9 devstack@n-api.service[106347]: X-Tenant: admin Aug 31 15:47:44.596082 n-d-850499-9 devstack@n-api.service[106347]: X-Tenant-Id: 3eea5e201ec243d28a91d4abbbc142ae Aug 31 15:47:44.596082 n-d-850499-9 devstack@n-api.service[106347]: X-Tenant-Name: admin Aug 31 15:47:44.596082 n-d-850499-9 devstack@n-api.service[106347]: X-User: admin Aug 31 15:47:44.596082 n-d-850499-9 devstack@n-api.service[106347]: X-User-Domain-Id: default Aug 31 15:47:44.596082 n-d-850499-9 devstack@n-api.service[106347]: X-User-Domain-Name: Default Aug 31 15:47:44.596082 n-d-850499-9 devstack@n-api.service[106347]: X-User-Id: 89457b093ae547728391fec96887f7f3 Aug 31 15:47:44.596082 n-d-850499-9 devstack@n-api.service[106347]: X-User-Name: admin Aug 31 15:47:44.596082 n-d-850499-9 devstack@n-api.service[106347]: method: > Aug 31 15:47:44.596082 n-d-850499-9 devstack@n-api.service[106347]: exception: Flavor 451 could not be found. Aug 31 15:47:44.596082 n-d-850499-9 devstack@n-api.service[106347]: action_args: {'id': '451'} Aug 31 15:47:44.596082 n-d-850499-9 devstack@n-api.service[106347]: {{(pid=106347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:47:44.596082 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:47:44.597250 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 15:47:44.597250 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 15:47:44.597250 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 15:47:44.597250 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 15:47:44.597250 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 15:47:44.597250 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 15:47:44.597250 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 15:47:44.597250 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 15:47:44.597250 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 15:47:44.597250 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:47:44.597250 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 15:47:44.597250 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 15:47:44.597250 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 31 15:47:44.597250 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi Aug 31 15:47:44.597250 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:47:44.597250 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi Aug 31 15:47:44.597250 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:47:44.597250 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:47:44.597250 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:47:44.598506 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:47:44.598506 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:47:44.598506 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:47:44.598506 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:47:44.598506 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 15:47:44.598506 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:47:44.598506 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 31 15:47:44.598506 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi Aug 31 15:47:44.598506 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:47:44.598506 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi Aug 31 15:47:44.598506 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:47:44.598506 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:47:44.598506 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:47:44.598506 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:47:44.598506 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:47:44.598506 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 31 15:47:44.598506 n-d-850499-9 devstack@n-api.service[106347]: ERROR nova.api.openstack.wsgi Aug 31 15:47:44.598506 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi [None req-5700131e-f83b-4251-8b52-7ce03ce16be0 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106347) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:47:44.599833 n-d-850499-9 devstack@n-api.service[106347]: INFO nova.api.openstack.requestlog [None req-5700131e-f83b-4251-8b52-7ce03ce16be0 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011924 Aug 31 15:47:44.599833 n-d-850499-9 devstack@n-api.service[106347]: [pid: 106347|app: 0|req: 27/52] 10.222.0.61 () {60 vars in 1193 bytes} [Wed Aug 31 15:47:44 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 15:47:45.600841 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi [None req-cc437799-8ef5-4896-b982-97d4b15f3e8b admin admin] Calling method '>' {{(pid=106346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:47:45.602567 n-d-850499-9 devstack@n-api.service[106346]: INFO nova.api.openstack.requestlog [None req-cc437799-8ef5-4896-b982-97d4b15f3e8b admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001958 Aug 31 15:47:45.602968 n-d-850499-9 devstack@n-api.service[106346]: [pid: 106346|app: 0|req: 26/53] 10.222.0.61 () {56 vars in 1074 bytes} [Wed Aug 31 15:47:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:47:46.149289 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi [None req-95d8e07e-ba7d-4f49-b039-6d9999dd2454 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:47:46.168394 n-d-850499-9 devstack@n-api.service[106347]: INFO nova.api.openstack.requestlog [None req-95d8e07e-ba7d-4f49-b039-6d9999dd2454 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.427893 Aug 31 15:47:46.168937 n-d-850499-9 devstack@n-api.service[106347]: [pid: 106347|app: 0|req: 28/54] 10.222.0.61 () {64 vars in 1235 bytes} [Wed Aug 31 15:47:45 2022] POST /compute/v2.1/flavors => generated 404 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 15:47:47.165924 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi [None req-cc437799-8ef5-4896-b982-97d4b15f3e8b admin admin] Calling method '>' {{(pid=106346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:47:47.166938 n-d-850499-9 devstack@n-api.service[106346]: INFO nova.api.openstack.requestlog [None req-cc437799-8ef5-4896-b982-97d4b15f3e8b admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Aug 31 15:47:47.167336 n-d-850499-9 devstack@n-api.service[106346]: [pid: 106346|app: 0|req: 27/55] 10.222.0.61 () {56 vars in 1074 bytes} [Wed Aug 31 15:47:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:47:47.696945 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi [None req-7e04e0ff-4270-4353-9a3e-43e51864801c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:47:47.715710 n-d-850499-9 devstack@n-api.service[106347]: INFO nova.api.openstack.requestlog [None req-7e04e0ff-4270-4353-9a3e-43e51864801c admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.411996 Aug 31 15:47:47.716254 n-d-850499-9 devstack@n-api.service[106347]: [pid: 106347|app: 0|req: 29/56] 10.222.0.61 () {64 vars in 1235 bytes} [Wed Aug 31 15:47:47 2022] POST /compute/v2.1/flavors => generated 405 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 15:47:48.694212 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi [None req-cc437799-8ef5-4896-b982-97d4b15f3e8b admin admin] Calling method '>' {{(pid=106346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:47:48.695740 n-d-850499-9 devstack@n-api.service[106346]: INFO nova.api.openstack.requestlog [None req-cc437799-8ef5-4896-b982-97d4b15f3e8b admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Aug 31 15:47:48.696141 n-d-850499-9 devstack@n-api.service[106346]: [pid: 106346|app: 0|req: 28/57] 10.222.0.61 () {56 vars in 1074 bytes} [Wed Aug 31 15:47:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 15:47:49.222285 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi [None req-e4058230-9ee5-452e-844a-8eef574d19b7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:47:49.241579 n-d-850499-9 devstack@n-api.service[106347]: INFO nova.api.openstack.requestlog [None req-e4058230-9ee5-452e-844a-8eef574d19b7 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.407650 Aug 31 15:47:49.243250 n-d-850499-9 devstack@n-api.service[106347]: [pid: 106347|app: 0|req: 30/58] 10.222.0.61 () {64 vars in 1235 bytes} [Wed Aug 31 15:47:48 2022] POST /compute/v2.1/flavors => generated 407 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 15:47:50.219920 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi [None req-cc437799-8ef5-4896-b982-97d4b15f3e8b admin admin] Calling method '>' {{(pid=106346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:47:50.220941 n-d-850499-9 devstack@n-api.service[106346]: INFO nova.api.openstack.requestlog [None req-cc437799-8ef5-4896-b982-97d4b15f3e8b admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Aug 31 15:47:50.221341 n-d-850499-9 devstack@n-api.service[106346]: [pid: 106346|app: 0|req: 29/59] 10.222.0.61 () {56 vars in 1074 bytes} [Wed Aug 31 15:47:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:47:50.759638 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi [None req-c633ccd0-11f3-4bcc-94d3-46d045699bbc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:47:50.778873 n-d-850499-9 devstack@n-api.service[106347]: INFO nova.api.openstack.requestlog [None req-c633ccd0-11f3-4bcc-94d3-46d045699bbc admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.413492 Aug 31 15:47:50.779418 n-d-850499-9 devstack@n-api.service[106347]: [pid: 106347|app: 0|req: 31/60] 10.222.0.61 () {64 vars in 1235 bytes} [Wed Aug 31 15:47:50 2022] POST /compute/v2.1/flavors => generated 409 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 15:47:51.757014 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi [None req-cc437799-8ef5-4896-b982-97d4b15f3e8b admin admin] Calling method '>' {{(pid=106346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:47:51.759104 n-d-850499-9 devstack@n-api.service[106346]: INFO nova.api.openstack.requestlog [None req-cc437799-8ef5-4896-b982-97d4b15f3e8b admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Aug 31 15:47:51.759549 n-d-850499-9 devstack@n-api.service[106346]: [pid: 106346|app: 0|req: 30/61] 10.222.0.61 () {56 vars in 1074 bytes} [Wed Aug 31 15:47:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:47:52.282060 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi [None req-90aea0cf-e543-442a-bb82-a704fa49e8bf admin admin] Calling method '>' {{(pid=106347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:47:52.302822 n-d-850499-9 devstack@n-api.service[106347]: INFO nova.api.openstack.requestlog [None req-90aea0cf-e543-442a-bb82-a704fa49e8bf admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.405881 Aug 31 15:47:52.303289 n-d-850499-9 devstack@n-api.service[106347]: [pid: 106347|app: 0|req: 32/62] 10.222.0.61 () {60 vars in 1202 bytes} [Wed Aug 31 15:47:51 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:48:45.858696 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi [None req-cc437799-8ef5-4896-b982-97d4b15f3e8b admin admin] Calling method '>' {{(pid=106346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:48:45.859741 n-d-850499-9 devstack@n-api.service[106346]: INFO nova.api.openstack.requestlog [None req-cc437799-8ef5-4896-b982-97d4b15f3e8b admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Aug 31 15:48:45.860153 n-d-850499-9 devstack@n-api.service[106346]: [pid: 106346|app: 0|req: 31/63] 10.222.0.61 () {54 vars in 931 bytes} [Wed Aug 31 15:48:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:48:45.870680 n-d-850499-9 devstack@n-api.service[106347]: DEBUG dbcounter [-] [106347] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=106347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:48:46.268255 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi [None req-fdf09e41-78e5-41ba-a87a-df51ac3bb1e2 admin admin] Calling method '>' {{(pid=106347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:48:46.288561 n-d-850499-9 devstack@n-api.service[106347]: INFO nova.api.openstack.requestlog [None req-fdf09e41-78e5-41ba-a87a-df51ac3bb1e2 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.422592 Aug 31 15:48:46.289100 n-d-850499-9 devstack@n-api.service[106347]: [pid: 106347|app: 0|req: 33/64] 10.222.0.61 () {60 vars in 1292 bytes} [Wed Aug 31 15:48:45 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:48:46.311403 n-d-850499-9 devstack@n-api.service[106346]: DEBUG dbcounter [-] [106346] Writing DB stats nova_api:SELECT=14 {{(pid=106346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:48:46.315234 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi [None req-2876afa9-cb0a-4e16-b2c1-8f061284f10e admin admin] Calling method '>' {{(pid=106346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:48:46.324239 n-d-850499-9 devstack@n-api.service[106346]: INFO nova.api.openstack.requestlog [None req-2876afa9-cb0a-4e16-b2c1-8f061284f10e admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014233 Aug 31 15:48:46.324762 n-d-850499-9 devstack@n-api.service[106346]: [pid: 106346|app: 0|req: 32/65] 10.222.0.61 () {60 vars in 1283 bytes} [Wed Aug 31 15:48:46 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:48:46.336463 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi [None req-b71b5385-a764-43ec-9134-e39f7717660c admin admin] Calling method '>' {{(pid=106347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:48:46.344060 n-d-850499-9 devstack@n-api.service[106347]: INFO nova.api.openstack.requestlog [None req-b71b5385-a764-43ec-9134-e39f7717660c admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011451 Aug 31 15:48:46.344564 n-d-850499-9 devstack@n-api.service[106347]: [pid: 106347|app: 0|req: 34/66] 10.222.0.61 () {60 vars in 1286 bytes} [Wed Aug 31 15:48:46 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:48:46.355832 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi [None req-c7916ebd-3c77-4b47-812c-36bb43d645c5 admin admin] Calling method '>' {{(pid=106346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:48:46.363400 n-d-850499-9 devstack@n-api.service[106346]: INFO nova.api.openstack.requestlog [None req-c7916ebd-3c77-4b47-812c-36bb43d645c5 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011117 Aug 31 15:48:46.363899 n-d-850499-9 devstack@n-api.service[106346]: [pid: 106346|app: 0|req: 33/67] 10.222.0.61 () {60 vars in 1286 bytes} [Wed Aug 31 15:48:46 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:48:46.376482 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi [None req-2165bcb3-4221-403a-8983-76cb5dcc5127 admin admin] Calling method '>' {{(pid=106347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:48:46.384673 n-d-850499-9 devstack@n-api.service[106347]: INFO nova.api.openstack.requestlog [None req-2165bcb3-4221-403a-8983-76cb5dcc5127 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012045 Aug 31 15:48:46.385190 n-d-850499-9 devstack@n-api.service[106347]: [pid: 106347|app: 0|req: 35/68] 10.222.0.61 () {60 vars in 1283 bytes} [Wed Aug 31 15:48:46 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:54:12.129045 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi [None req-c7916ebd-3c77-4b47-812c-36bb43d645c5 admin admin] Calling method '>' {{(pid=106346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:12.130048 n-d-850499-9 devstack@n-api.service[106346]: INFO nova.api.openstack.requestlog [None req-c7916ebd-3c77-4b47-812c-36bb43d645c5 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001871 Aug 31 15:54:12.130439 n-d-850499-9 devstack@n-api.service[106346]: [pid: 106346|app: 0|req: 34/69] 10.222.0.61 () {56 vars in 1074 bytes} [Wed Aug 31 15:54:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:54:12.272336 n-d-850499-9 devstack@n-api.service[106347]: DEBUG dbcounter [-] [106347] Writing DB stats nova_api:SELECT=6 {{(pid=106347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:54:12.425233 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi [None req-c35f1e5a-0f73-452b-b326-c2d923f54e2d admin admin] Calling method '>' {{(pid=106347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:12.428973 n-d-850499-9 devstack@n-api.service[106347]: DEBUG oslo_concurrency.lockutils [None req-c35f1e5a-0f73-452b-b326-c2d923f54e2d admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106347) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:12.429441 n-d-850499-9 devstack@n-api.service[106347]: DEBUG oslo_concurrency.lockutils [None req-c35f1e5a-0f73-452b-b326-c2d923f54e2d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106347) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:12.429887 n-d-850499-9 devstack@n-api.service[106347]: DEBUG oslo_concurrency.lockutils [None req-c35f1e5a-0f73-452b-b326-c2d923f54e2d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106347) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:12.430585 n-d-850499-9 devstack@n-api.service[106347]: DEBUG oslo_concurrency.lockutils [None req-c35f1e5a-0f73-452b-b326-c2d923f54e2d admin admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106347) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:12.431052 n-d-850499-9 devstack@n-api.service[106347]: DEBUG oslo_concurrency.lockutils [None req-c35f1e5a-0f73-452b-b326-c2d923f54e2d admin admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106347) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:12.431461 n-d-850499-9 devstack@n-api.service[106347]: DEBUG oslo_concurrency.lockutils [None req-c35f1e5a-0f73-452b-b326-c2d923f54e2d admin admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106347) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:12.471775 n-d-850499-9 devstack@n-api.service[106347]: INFO nova.api.openstack.requestlog [None req-c35f1e5a-0f73-452b-b326-c2d923f54e2d admin admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.90 time: 0.200758 Aug 31 15:54:12.472339 n-d-850499-9 devstack@n-api.service[106347]: [pid: 106347|app: 0|req: 36/70] 10.222.0.61 () {60 vars in 1193 bytes} [Wed Aug 31 15:54:12 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:54:13.296583 n-d-850499-9 devstack@n-api.service[106346]: DEBUG nova.api.openstack.wsgi [None req-c7916ebd-3c77-4b47-812c-36bb43d645c5 admin admin] Calling method '>' {{(pid=106346) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:13.298156 n-d-850499-9 devstack@n-api.service[106346]: INFO nova.api.openstack.requestlog [None req-c7916ebd-3c77-4b47-812c-36bb43d645c5 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001997 Aug 31 15:54:13.298542 n-d-850499-9 devstack@n-api.service[106346]: [pid: 106346|app: 0|req: 35/71] 10.222.0.61 () {56 vars in 1074 bytes} [Wed Aug 31 15:54:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:54:13.491037 n-d-850499-9 devstack@n-api.service[106347]: DEBUG nova.api.openstack.wsgi [None req-e3d2b6b8-fddc-41ef-97f9-12d0f236fc3a admin admin] Calling method '>' {{(pid=106347) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:13.494446 n-d-850499-9 devstack@n-api.service[106347]: DEBUG oslo_concurrency.lockutils [None req-e3d2b6b8-fddc-41ef-97f9-12d0f236fc3a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106347) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:13.494920 n-d-850499-9 devstack@n-api.service[106347]: DEBUG oslo_concurrency.lockutils [None req-e3d2b6b8-fddc-41ef-97f9-12d0f236fc3a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106347) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:13.495397 n-d-850499-9 devstack@n-api.service[106347]: DEBUG oslo_concurrency.lockutils [None req-e3d2b6b8-fddc-41ef-97f9-12d0f236fc3a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106347) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:13.496137 n-d-850499-9 devstack@n-api.service[106347]: DEBUG oslo_concurrency.lockutils [None req-e3d2b6b8-fddc-41ef-97f9-12d0f236fc3a admin admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106347) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:13.496586 n-d-850499-9 devstack@n-api.service[106347]: DEBUG oslo_concurrency.lockutils [None req-e3d2b6b8-fddc-41ef-97f9-12d0f236fc3a admin admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106347) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:13.497087 n-d-850499-9 devstack@n-api.service[106347]: DEBUG oslo_concurrency.lockutils [None req-e3d2b6b8-fddc-41ef-97f9-12d0f236fc3a admin admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106347) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:13.521723 n-d-850499-9 devstack@n-api.service[106347]: INFO nova.api.openstack.requestlog [None req-e3d2b6b8-fddc-41ef-97f9-12d0f236fc3a admin admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.90 time: 0.084750 Aug 31 15:54:13.522292 n-d-850499-9 devstack@n-api.service[106347]: [pid: 106347|app: 0|req: 37/72] 10.222.0.61 () {60 vars in 1193 bytes} [Wed Aug 31 15:54:13 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:54:59.333607 n-d-850499-9 systemd[1]: Stopping Devstack devstack@n-api.service... Aug 31 15:54:59.334205 n-d-850499-9 devstack@n-api.service[106345]: Wed Aug 31 15:54:59 2022 - graceful shutdown triggered... Aug 31 15:54:59.334653 n-d-850499-9 devstack@n-api.service[106346]: Gracefully killing worker 1 (pid: 106346)... Aug 31 15:54:59.335104 n-d-850499-9 devstack@n-api.service[106347]: Gracefully killing worker 2 (pid: 106347)... Aug 31 15:55:00.334289 n-d-850499-9 devstack@n-api.service[106345]: worker 1 buried after 1 seconds Aug 31 15:55:00.334289 n-d-850499-9 devstack@n-api.service[106345]: worker 2 buried after 1 seconds Aug 31 15:55:00.334289 n-d-850499-9 devstack@n-api.service[106345]: goodbye to uWSGI. Aug 31 15:55:00.336552 n-d-850499-9 systemd[1]: devstack@n-api.service: Succeeded. Aug 31 15:55:00.337134 n-d-850499-9 systemd[1]: Stopped Devstack devstack@n-api.service. Aug 31 15:55:00.340122 n-d-850499-9 systemd[1]: Starting Devstack devstack@n-api.service... Aug 31 15:55:00.365661 n-d-850499-9 devstack@n-api.service[122192]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 31 15:55:00.387974 n-d-850499-9 devstack@n-api.service[122192]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 31 15:55:00 2022] *** Aug 31 15:55:00.387974 n-d-850499-9 devstack@n-api.service[122192]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 31 15:55:00.387974 n-d-850499-9 devstack@n-api.service[122192]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 31 15:55:00.387974 n-d-850499-9 devstack@n-api.service[122192]: nodename: n-d-850499-9 Aug 31 15:55:00.387974 n-d-850499-9 devstack@n-api.service[122192]: machine: x86_64 Aug 31 15:55:00.387974 n-d-850499-9 devstack@n-api.service[122192]: clock source: unix Aug 31 15:55:00.387974 n-d-850499-9 devstack@n-api.service[122192]: pcre jit disabled Aug 31 15:55:00.387974 n-d-850499-9 devstack@n-api.service[122192]: detected number of CPU cores: 4 Aug 31 15:55:00.387974 n-d-850499-9 devstack@n-api.service[122192]: current working directory: / Aug 31 15:55:00.387974 n-d-850499-9 devstack@n-api.service[122192]: detected binary path: /usr/bin/uwsgi-core Aug 31 15:55:00.387974 n-d-850499-9 devstack@n-api.service[122192]: your processes number limit is 47680 Aug 31 15:55:00.387974 n-d-850499-9 devstack@n-api.service[122192]: your memory page size is 4096 bytes Aug 31 15:55:00.387974 n-d-850499-9 devstack@n-api.service[122192]: detected max file descriptor number: 2048 Aug 31 15:55:00.387974 n-d-850499-9 devstack@n-api.service[122192]: lock engine: pthread robust mutexes Aug 31 15:55:00.389287 n-d-850499-9 devstack@n-api.service[122192]: thunder lock: enabled Aug 31 15:55:00.389287 n-d-850499-9 devstack@n-api.service[122192]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 31 15:55:00.389287 n-d-850499-9 devstack@n-api.service[122192]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 31 15:55:00.431284 n-d-850499-9 devstack@n-api.service[122192]: Python main interpreter initialized at 0x55a819dc19c0 Aug 31 15:55:00.431284 n-d-850499-9 devstack@n-api.service[122192]: python threads support enabled Aug 31 15:55:00.431284 n-d-850499-9 devstack@n-api.service[122192]: your server socket listen backlog is limited to 100 connections Aug 31 15:55:00.431284 n-d-850499-9 devstack@n-api.service[122192]: your mercy for graceful operations on workers is 90 seconds Aug 31 15:55:00.431831 n-d-850499-9 devstack@n-api.service[122192]: mapped 403077 bytes (393 KB) for 2 cores Aug 31 15:55:00.431831 n-d-850499-9 devstack@n-api.service[122192]: *** Operational MODE: preforking *** Aug 31 15:55:00.432018 n-d-850499-9 devstack@n-api.service[122192]: *** uWSGI is running in multiple interpreter mode *** Aug 31 15:55:00.432018 n-d-850499-9 devstack@n-api.service[122192]: spawned uWSGI master process (pid: 122192) Aug 31 15:55:00.432189 n-d-850499-9 systemd[1]: Started Devstack devstack@n-api.service. Aug 31 15:55:00.443560 n-d-850499-9 devstack@n-api.service[122192]: spawned uWSGI worker 1 (pid: 122256, cores: 1) Aug 31 15:55:00.443560 n-d-850499-9 devstack@n-api.service[122192]: spawned uWSGI worker 2 (pid: 122257, cores: 1) Aug 31 15:55:00.443560 n-d-850499-9 devstack@n-api.service[122192]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 31 15:55:01.120713 n-d-850499-9 devstack@n-api.service[122257]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 31 15:55:01.125547 n-d-850499-9 devstack@n-api.service[122256]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 31 15:55:02.312288 n-d-850499-9 devstack@n-api.service[122256]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 15:55:02.312288 n-d-850499-9 devstack@n-api.service[122256]: from cryptography.utils import int_from_bytes Aug 31 15:55:02.312991 n-d-850499-9 devstack@n-api.service[122256]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 15:55:02.312991 n-d-850499-9 devstack@n-api.service[122256]: from cryptography.utils import int_from_bytes Aug 31 15:55:02.315615 n-d-850499-9 devstack@n-api.service[122257]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 15:55:02.315615 n-d-850499-9 devstack@n-api.service[122257]: from cryptography.utils import int_from_bytes Aug 31 15:55:02.316074 n-d-850499-9 devstack@n-api.service[122257]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 15:55:02.316074 n-d-850499-9 devstack@n-api.service[122257]: from cryptography.utils import int_from_bytes Aug 31 15:55:04.753522 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 15:55:04.754109 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 15:55:04.754241 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 15:55:04.754610 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 15:55:04.754867 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 15:55:04.755262 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.755624 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.755953 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.756278 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.756608 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.756922 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.757248 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.757572 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.757903 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.758167 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.758484 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.758810 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-850499-9 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.759138 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.759455 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.759797 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.760120 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.760430 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.760753 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.761081 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.761595 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.762052 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.762364 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.762687 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.763030 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.763353 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.763717 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.764042 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.764355 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.764682 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.764998 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.765413 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-850499-9 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.765737 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.766053 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.766916 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.767339 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.767690 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.768006 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.768331 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.768658 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.768969 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.769303 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.769623 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.769953 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.770275 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.770584 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.770901 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.771221 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.771559 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.771869 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.772176 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.772428 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.772741 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.773066 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.773389 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.773715 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.773994 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.774221 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.774541 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.774864 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.775178 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.775489 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.775822 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.776133 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.776443 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.776752 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.777061 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.777372 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.777697 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.778017 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.778345 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.778660 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.778983 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.779397 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.61 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.779683 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.61 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.780005 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.780349 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.780673 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.780986 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.781306 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.781635 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.782564 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.782880 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.783195 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.783534 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.783883 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.784192 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.784447 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.784754 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.785068 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.785391 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.785704 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.786014 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.786326 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.786630 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.786942 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.787253 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.787586 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.787901 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.788212 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.788524 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.788837 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.789150 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.789459 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.789794 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.790120 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.790435 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.790746 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.791058 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.791369 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.791717 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.792030 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.792340 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.792668 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.792976 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.793290 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.793614 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.793927 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.794237 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.794559 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.794864 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.795177 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.795526 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.795827 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.796137 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.796444 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.796752 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.797060 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.797368 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.797940 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.798467 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.798940 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.799449 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.800001 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.800328 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.800648 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.800967 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.801295 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.801644 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.801983 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.802333 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.802654 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.802993 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.803328 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.803677 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.804012 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.804321 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.804657 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.804978 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.805299 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.805618 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.805944 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.806269 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.806599 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.806921 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.807242 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.807588 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.807908 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.808235 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.808566 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.808889 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.809205 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.809554 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.809906 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.810226 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.810555 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.810885 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.811201 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.811536 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.811855 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.812186 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.812525 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.812844 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.813208 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.813529 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.813857 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.814176 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.814493 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.814809 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.815127 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.815442 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.815808 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.816136 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.816463 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.816783 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.817103 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.817423 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.817741 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.818060 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.818380 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.818692 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.819000 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.819309 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.819654 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.819962 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.820288 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.820622 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.820938 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.821275 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.821585 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.821901 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.822219 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.822534 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.822845 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.823163 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.823476 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.823809 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.824138 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.824454 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.824761 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.825091 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.825406 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.825727 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.826064 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.826377 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.826692 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.827009 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.827342 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.827692 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.828010 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.828328 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.829207 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.829558 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.829960 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.830379 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.830714 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.831178 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.831359 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.831670 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.831993 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.832350 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.832609 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.832930 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.833246 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.833558 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.833879 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.834186 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.834544 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.834813 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.835125 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.835434 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.835766 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.836075 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.836638 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.836930 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 15:55:04.837676 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.837826 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 15:55:04.837981 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.837981 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.838268 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 15:55:04.838429 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.838578 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 15:55:04.838734 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.838888 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 15:55:04.839035 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.839197 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.839381 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.839578 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.839734 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.839899 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.840135 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.840297 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.840452 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.840608 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.840799 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.840961 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.841108 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.841431 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.841594 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.841774 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.841937 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.842096 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.842258 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.842437 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.842600 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.842754 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.842902 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.843054 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-850499-9 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.843224 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.843375 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.843552 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.843716 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.843865 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.844033 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.844189 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.844412 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.845144 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.845244 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.845340 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.845425 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.845518 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.845518 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.845670 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.845759 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.846072 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.846179 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.846391 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.846484 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.846710 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.846809 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.847027 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.847133 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.847352 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.847443 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.847694 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.847799 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.848022 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.848122 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.848339 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.848444 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.848658 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.848749 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.848971 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.849061 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.849295 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.849414 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.849602 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.849691 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-850499-9 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.849921 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.850019 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.850258 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.850348 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.850595 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.850687 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.850912 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.851023 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.851227 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.851317 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.851609 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.851707 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.851896 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.851990 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.852206 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.852296 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.852540 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.852716 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.853551 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.853727 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.853881 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.854031 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.854179 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.854411 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.854593 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.854746 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.854894 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.855052 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.855219 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.855476 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.855657 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.855817 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.855973 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.856127 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.856285 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.856448 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.856596 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.856750 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.856904 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.857069 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.857217 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.857380 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.857537 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.857694 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.857694 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.857988 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.858143 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.858310 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.858463 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.858463 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.858786 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.858944 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.859173 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.859322 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.859564 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.859720 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.859896 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.860059 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.860233 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.860457 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.860618 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.860772 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.860926 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.860926 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.861242 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.861390 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.861390 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.861867 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.862175 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.862372 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.862527 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.862683 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.862832 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.862986 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.863132 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.863292 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.863452 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.863688 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.863846 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.864004 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.864160 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.864318 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.864466 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.864466 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.864759 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.61 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.864759 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.61 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.865059 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.865215 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.865368 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.865628 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.865790 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.865946 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.866102 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.866256 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.866403 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.866548 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.866701 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.866848 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.867004 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.867150 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.867295 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.867447 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.867706 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.867855 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.868010 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.868165 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.868311 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.868463 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.868616 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.868770 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.868770 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.869057 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.869212 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.869358 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.869504 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.869670 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.869824 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.869979 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.870136 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.870283 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.870448 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.870675 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.870828 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.870983 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.871141 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.871295 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.871449 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.871634 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.871813 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.872131 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.872318 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.872466 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.872621 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.872768 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.872920 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.873066 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.873227 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.873376 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.873522 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.873674 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.873832 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.873987 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.874143 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.874299 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.874454 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.874609 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.874756 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.874915 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.875061 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.875215 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.875371 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.875579 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.875893 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.876072 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.876309 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.876477 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.876639 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.876788 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.876934 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.877088 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.877242 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.877398 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.877569 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.877718 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.877718 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.877996 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.878164 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.878164 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.878459 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.878614 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.878769 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.878928 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.879082 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.879241 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.879404 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.879590 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.879751 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.879905 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.880068 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.880230 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.880391 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.880546 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.880808 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.880976 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.881131 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.881298 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.881453 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.881614 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.881776 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.881947 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.882248 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.882433 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.882594 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.882749 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.882902 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.883055 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.883207 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.883368 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.883559 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.883783 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.883945 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.884108 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.884275 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.884436 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.884608 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.884762 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.884924 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.885078 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.885239 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.885401 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.885556 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.885707 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.885878 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:55:04.886129 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.886303 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.886459 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.886620 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.886792 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.886792 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.887093 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.887256 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.887416 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.887613 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.887779 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.888044 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.888337 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.888509 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.888665 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.888819 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.889033 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.889196 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.889364 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.889534 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.889697 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.889860 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.890066 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.890232 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.890406 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.890568 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.890728 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.890986 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.891702 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.891897 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.892124 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.892453 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.892625 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.892781 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.892941 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.893110 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.893110 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.893424 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.893590 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.893744 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.893905 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.894073 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.894240 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.894392 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.894544 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.894703 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.894856 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.895026 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.895181 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.895334 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.895782 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.896327 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.896515 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.896515 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.896821 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.897026 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.897026 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.897332 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.897499 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.897654 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.897857 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.898023 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.898178 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.898339 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.898547 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.898719 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.898875 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.899065 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.899304 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.899471 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.899699 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.899856 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.900017 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.900178 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.900339 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.900502 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.900657 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.900865 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.901157 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.901451 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.901629 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.901800 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.901962 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.902161 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.902388 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.902746 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.902911 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.903079 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.903241 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.903397 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.903581 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.903749 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.903905 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.904078 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.904241 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.904394 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.904555 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.904764 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.904971 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.905141 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.905303 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.905457 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.905617 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.905818 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.905993 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.906197 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.906376 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.906698 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.907463 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.907689 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.907861 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.908055 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.908258 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.908417 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.908578 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.908732 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.908945 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.909103 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.909278 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.909480 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.909641 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.909802 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.909971 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.910126 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.910279 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.910432 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.910585 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.910747 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.910909 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.911064 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.911304 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.911482 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.911672 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.911837 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.912001 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.912163 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.912326 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.912488 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.912814 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.912986 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.913143 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.913304 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.913458 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.913619 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.913785 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.913951 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.914108 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.914108 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.914108 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.914578 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.914746 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.914911 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.915073 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.915227 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.915380 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.915568 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.915742 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.915926 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.916091 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.916255 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.916418 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.916572 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.916750 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.916993 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.916993 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.917309 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.917474 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.917682 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.917839 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.918007 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.918007 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.918300 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.918454 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.918615 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.918777 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.918931 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.919090 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.919244 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.919406 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.919594 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.919763 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.919917 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.919917 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.920238 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.920401 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.920569 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.920731 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.920885 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.921038 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.921199 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.921458 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.921628 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.921792 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.921946 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.922107 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.922283 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.922492 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.922731 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.923037 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.923199 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.923362 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.923572 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.923752 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.923908 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.924062 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.924215 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.924369 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.924530 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.924706 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.924860 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.925014 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.925174 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.925329 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.925567 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.925724 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.925878 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.926039 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.926202 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.926357 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.926520 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.926520 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.926830 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.927003 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.927253 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.927423 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.927614 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.927816 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.927971 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.928126 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.928331 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.928497 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.928660 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.928816 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.928981 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.929145 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.929300 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.929462 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.929625 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.929780 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.929934 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.930098 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.930098 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.930401 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.930564 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.930722 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.930884 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.931049 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.931210 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.931379 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.931719 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.931881 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.932048 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.932213 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.932375 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.932538 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.932693 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.932854 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.933159 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.933318 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.933565 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.933722 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.933883 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.934046 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.934208 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.934363 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.934526 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.934688 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.934850 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.935012 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.935168 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.935329 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.935527 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.935688 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.935853 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.936015 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.936177 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.936339 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.936504 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.936665 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.936827 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.936981 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.937136 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.937397 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.937566 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.937740 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.937895 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.937895 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.938313 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.938486 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.938642 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.939004 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.939162 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.939326 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.939481 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.939481 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.939838 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.939838 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.940153 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.940316 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.940478 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.940642 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.940797 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.940958 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.941112 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.941274 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.941436 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.941600 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.941851 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.942018 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.942180 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.942345 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.942510 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.942665 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.942818 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.942971 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.943289 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.943462 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.943659 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.943816 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.943969 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.944123 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.944286 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.944452 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.944621 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.944776 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.944937 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.944937 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.945237 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.945391 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.945554 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.945709 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.945862 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.946015 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.946177 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.946341 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.946513 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.946513 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.946814 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.946969 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.947121 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.947283 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.947554 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.947719 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.947873 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.948027 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.948027 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.948341 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.948503 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.948677 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.948840 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.949001 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.949156 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.949322 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.949483 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.949638 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.949792 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.949945 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.950108 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.950262 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.950416 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.950568 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.950738 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.950902 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.951069 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.951224 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.951388 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.951579 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.951749 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.951987 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.952163 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.952327 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.952482 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.952636 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.952806 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.952960 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.953122 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.953444 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.954174 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.954621 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.954805 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.954975 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.955131 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.955293 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.955455 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.955634 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.955801 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.955991 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.956149 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.956311 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.956474 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.956680 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.956848 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.957012 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.957168 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.957376 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.957376 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.957782 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.957942 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.958157 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.958328 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.958519 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.958696 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.958853 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.959020 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.959183 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.959345 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.959561 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.959561 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.959861 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.960028 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.960191 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.960355 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.960520 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.960682 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.960837 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.960999 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.961154 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.961324 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.961486 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.961662 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.961869 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.962122 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.962551 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.962715 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.962892 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.963054 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.963217 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.963380 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.963716 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.963873 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.964039 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.964195 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.964355 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.964519 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.964677 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.964906 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.964906 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.964906 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.965359 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.965516 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.965678 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.965842 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.965997 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.966158 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.966313 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.966466 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.966620 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.966782 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.966954 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.967109 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.967263 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.967424 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.968083 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.968256 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.968412 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.968568 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.968723 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.968878 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.969045 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.969201 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.969501 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.969766 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.969978 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.970136 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.970300 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.970467 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.970622 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.970777 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.970931 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.971100 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.971263 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.971263 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.971632 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.971795 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.971969 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.972150 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.972386 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.972546 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.972710 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.972873 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.973043 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.973215 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.973370 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.973543 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.973855 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.974026 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.974192 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.974347 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.974509 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.974662 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.974824 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.974997 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.975161 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.975316 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.975477 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.975669 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.975824 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.975992 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.976159 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.976331 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.976486 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.976639 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.976793 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.976959 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.977123 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.977285 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.977449 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.977616 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.977780 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.977935 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.977935 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.978351 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.978518 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.978680 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.978850 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.979013 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.979169 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.979323 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.979485 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.979694 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.979862 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.980027 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.980182 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.980343 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.980512 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.980680 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.980835 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.980988 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.981141 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.981296 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.981296 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.981296 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.981745 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.981898 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.982052 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.982205 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.982377 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.982623 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.982784 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.982946 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.983109 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.983272 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.983427 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.983658 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.983999 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.984172 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.984340 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.984504 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.984673 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.984829 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.985549 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.985715 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.985871 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.986025 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.986188 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.986343 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.986506 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.986661 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.986823 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.986977 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.987144 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.987299 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.987454 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.987642 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.987822 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.987979 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.988142 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.988400 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.988577 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.988736 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.988892 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.989146 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.989304 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.989459 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.989614 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.989776 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.989952 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.990125 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.990280 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.990442 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.990604 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.990768 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.990931 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.991099 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.991261 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.991426 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.992192 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.992356 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.992523 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.992780 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.992948 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.993105 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.993258 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.993412 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.993566 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.993730 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.993893 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.994213 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.994374 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.994374 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.994692 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.994860 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.995015 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.995176 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.995330 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.995492 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.995686 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.995849 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.996012 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.996167 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.996330 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.996484 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.996646 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.996808 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.997249 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.997437 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.998599 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.998776 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.998948 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.999108 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.999264 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.999418 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.999619 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.999793 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:04.999962 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.000125 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.000290 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.000290 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.001209 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.001388 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.001574 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.001882 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.002055 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.002221 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.002221 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.002524 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.002680 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.002919 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.003080 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.003248 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.003412 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.003635 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.003812 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.005382 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.005556 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.005716 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.005882 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.006037 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.006192 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.006347 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.006510 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.006665 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.006840 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.006997 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.007150 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.007303 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.007458 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.007639 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.007812 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.007978 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.008158 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.008320 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.008477 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.008655 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.008832 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.009095 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.009265 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.009430 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.009595 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.009759 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.009923 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.010078 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.010078 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.010379 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.010536 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.010704 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.010867 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.011032 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.011188 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.011341 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.011534 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.011708 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.011864 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.012025 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.012025 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.012326 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.012495 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.012660 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.012814 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.013063 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.013224 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.013378 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.013542 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.013699 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.013853 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.014007 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.014007 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.014463 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.014635 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.014792 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.014956 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.015111 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.015111 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.015466 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.015666 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.015860 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.016025 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.016260 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.016431 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.016595 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.016751 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.016913 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.017068 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.017223 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.017398 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.017563 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.017726 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.017882 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.018035 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.018188 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.018348 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.018348 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.018348 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.018804 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.018959 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.019138 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.019397 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.019601 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.019760 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.019914 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.020081 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.020237 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.020409 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.020565 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.020727 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.020894 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.043793 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.044274 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.044503 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.044503 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.048428 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.049633 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.052543 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.052715 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.052857 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.052995 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.053146 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.053284 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.053418 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.053568 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.053726 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.053971 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.054115 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.054376 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.054518 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.054653 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.054934 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.055123 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.055274 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.055430 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.055777 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.055924 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.056128 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.056267 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.056401 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.056547 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.056681 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.056829 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.056964 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.057099 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.057232 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.057365 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.057498 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.057639 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.057786 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.057942 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.058079 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.058213 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.058358 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.058500 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.058636 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.058771 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.058771 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.059025 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.059167 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.059303 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.059303 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.059595 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.059595 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.059856 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.059856 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.060133 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.060268 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.060402 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.060537 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.060671 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.060865 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.061003 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.061138 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.061272 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.061407 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.061557 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.061693 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.061846 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.061982 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.062116 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.062251 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.062393 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.062548 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.062790 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.062934 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.063157 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.063849 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.064922 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.066278 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.067225 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.067225 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.068668 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.068737 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.068796 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.068852 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.068928 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.068988 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.069042 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.069096 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.069151 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.069215 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.069273 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.069329 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.069385 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.069491 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.069598 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.069675 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.069735 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.069789 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.069844 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.069899 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.069953 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.070015 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.070071 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.070126 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.070181 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.070235 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.070289 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.070351 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.070351 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 15:55:05.070451 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.070451 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.070451 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.070451 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.070451 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.070451 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.070451 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.070451 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.070853 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.070853 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.070853 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.070853 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.070853 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.070853 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.070853 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.070853 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.071221 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.071221 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.071221 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.071221 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.071221 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.071221 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.071221 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.071221 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.071609 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.071609 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.071609 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.071609 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.071609 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.071609 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.071609 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.071609 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.071968 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.071968 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.071968 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.071968 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.071968 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.071968 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.071968 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.071968 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.072336 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.072336 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.072336 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.072336 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.072336 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.072336 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.072336 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.072336 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.072684 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.072684 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.072684 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.072684 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.072684 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.072684 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.072684 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.072684 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.073041 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.073041 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.073041 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.073041 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.073041 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.073041 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.073041 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.073362 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.073362 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.073362 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.073362 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.073362 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.073362 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.073362 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.073362 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.073730 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.073730 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.073730 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.073730 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.073730 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.073730 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.073730 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.073730 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.074158 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.074158 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.074158 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.074158 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.074158 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.074158 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.074158 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.074158 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.074509 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.074509 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.074509 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.074509 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.074509 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.074509 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.074509 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.074509 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.074859 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.074859 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.074859 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.074859 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.074859 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.074859 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.074859 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.074859 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.075231 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.075231 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.075231 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.075231 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.075231 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.075231 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.075231 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.075231 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.075691 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.075691 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.075691 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.075691 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.075691 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.075691 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.075691 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.075691 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.077048 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.077048 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.077048 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.077048 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.077048 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.077048 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.077048 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.077048 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.077855 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.077855 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.077855 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.077855 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.077855 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.077855 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.077855 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.077855 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.079439 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.079439 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.079439 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.079439 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.079439 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.079439 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.079439 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.079439 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.080236 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.080236 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.080236 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.080236 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.080236 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.080236 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.080236 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.080236 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.081047 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.081047 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.081047 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.081047 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.081047 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.081047 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.081047 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.081047 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.081991 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.081991 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.081991 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.081991 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.081991 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.081991 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.081991 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.081991 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.082792 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.082792 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.083001 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.083250 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.083597 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.083920 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.084239 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.084559 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.084889 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.085230 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.085554 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.085895 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.086305 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.086627 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.086956 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.087585 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.087907 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.088243 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.088574 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.088897 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.089231 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.089554 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.089891 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.090240 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.090576 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.090911 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.091225 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.091560 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.091878 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.092198 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.092529 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.092851 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.093166 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.093479 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.093798 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.094113 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.094987 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.096065 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.096276 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.096691 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.096910 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.097233 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.097554 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.097873 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.098191 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.098508 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.098830 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.099150 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.099462 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.099804 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.100117 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.100431 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.100774 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.101115 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.101443 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.101775 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.102097 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.102956 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.102956 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.103192 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.103376 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.103732 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.104056 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.104400 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.104720 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.105044 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.105367 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.105688 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.106007 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.106386 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.106785 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.106989 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.107305 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.107662 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.107994 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.108323 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.108653 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.108975 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.109313 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.109635 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.110053 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.110884 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.111216 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.111570 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.111902 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.112227 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.113022 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.113022 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.113199 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.113514 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.113846 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.114139 n-d-850499-9 devstack@n-api.service[122256]: INFO dbcounter [None req-8dd89021-ba22-4607-be7f-1b7eab04d7b0 None None] Registered counter for database nova_api Aug 31 15:55:05.114227 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.114483 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.114815 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.115175 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.115519 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.115873 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.116210 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.116536 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.116850 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.117164 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:55:05.117412 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122257) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 15:55:05.138625 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_db.sqlalchemy.engines [None req-8dd89021-ba22-4607-be7f-1b7eab04d7b0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122256) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 15:55:05.146747 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writer thread running {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 15:55:05.182966 n-d-850499-9 devstack@n-api.service[122257]: INFO dbcounter [None req-4cf54c2a-06be-4c9f-98f6-0bd2bee4b937 None None] Registered counter for database nova_api Aug 31 15:55:05.204444 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.context [None req-8dd89021-ba22-4607-be7f-1b7eab04d7b0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9f6d6683-96bf-42a7-a78d-78a22f1453ed(cell1) {{(pid=122256) load_cells /opt/stack/nova/nova/context.py:464}} Aug 31 15:55:05.204711 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_db.sqlalchemy.engines [None req-4cf54c2a-06be-4c9f-98f6-0bd2bee4b937 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122257) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 15:55:05.208559 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8dd89021-ba22-4607-be7f-1b7eab04d7b0 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:05.209044 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8dd89021-ba22-4607-be7f-1b7eab04d7b0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:05.210627 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8dd89021-ba22-4607-be7f-1b7eab04d7b0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:05.211366 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8dd89021-ba22-4607-be7f-1b7eab04d7b0 None None] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:05.211773 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writer thread running {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 15:55:05.211978 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8dd89021-ba22-4607-be7f-1b7eab04d7b0 None None] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:05.214077 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8dd89021-ba22-4607-be7f-1b7eab04d7b0 None None] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:05.216216 n-d-850499-9 devstack@n-api.service[122256]: INFO dbcounter [None req-8dd89021-ba22-4607-be7f-1b7eab04d7b0 None None] Registered counter for database nova_cell0 Aug 31 15:55:05.222184 n-d-850499-9 devstack@n-api.service[122256]: INFO dbcounter [None req-8dd89021-ba22-4607-be7f-1b7eab04d7b0 None None] Registered counter for database nova_cell1 Aug 31 15:55:05.229611 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_db.sqlalchemy.engines [None req-8dd89021-ba22-4607-be7f-1b7eab04d7b0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122256) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 15:55:05.231292 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_db.sqlalchemy.engines [None req-8dd89021-ba22-4607-be7f-1b7eab04d7b0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122256) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 15:55:05.237853 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writer thread running {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 15:55:05.240086 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writer thread running {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 15:55:05.272315 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.context [None req-4cf54c2a-06be-4c9f-98f6-0bd2bee4b937 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9f6d6683-96bf-42a7-a78d-78a22f1453ed(cell1) {{(pid=122257) load_cells /opt/stack/nova/nova/context.py:464}} Aug 31 15:55:05.276322 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4cf54c2a-06be-4c9f-98f6-0bd2bee4b937 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:05.276807 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4cf54c2a-06be-4c9f-98f6-0bd2bee4b937 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:05.278403 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4cf54c2a-06be-4c9f-98f6-0bd2bee4b937 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:05.279174 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4cf54c2a-06be-4c9f-98f6-0bd2bee4b937 None None] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:05.279663 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4cf54c2a-06be-4c9f-98f6-0bd2bee4b937 None None] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:05.281675 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4cf54c2a-06be-4c9f-98f6-0bd2bee4b937 None None] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:05.284865 n-d-850499-9 devstack@n-api.service[122257]: INFO dbcounter [None req-4cf54c2a-06be-4c9f-98f6-0bd2bee4b937 None None] Registered counter for database nova_cell0 Aug 31 15:55:05.290283 n-d-850499-9 devstack@n-api.service[122257]: INFO dbcounter [None req-4cf54c2a-06be-4c9f-98f6-0bd2bee4b937 None None] Registered counter for database nova_cell1 Aug 31 15:55:05.297561 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_db.sqlalchemy.engines [None req-4cf54c2a-06be-4c9f-98f6-0bd2bee4b937 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122257) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 15:55:05.299407 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_db.sqlalchemy.engines [None req-4cf54c2a-06be-4c9f-98f6-0bd2bee4b937 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122257) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 15:55:05.306183 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writer thread running {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 15:55:05.307599 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writer thread running {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 15:55:05.395439 n-d-850499-9 devstack@n-api.service[122256]: INFO dbcounter [None req-8dd89021-ba22-4607-be7f-1b7eab04d7b0 None None] Registered counter for database nova_cell0 Aug 31 15:55:05.402510 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_db.sqlalchemy.engines [None req-8dd89021-ba22-4607-be7f-1b7eab04d7b0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122256) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 15:55:05.407832 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writer thread running {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 15:55:05.467394 n-d-850499-9 devstack@n-api.service[122257]: INFO dbcounter [None req-4cf54c2a-06be-4c9f-98f6-0bd2bee4b937 None None] Registered counter for database nova_cell0 Aug 31 15:55:05.476198 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_db.sqlalchemy.engines [None req-4cf54c2a-06be-4c9f-98f6-0bd2bee4b937 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122257) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 15:55:05.480733 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writer thread running {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 15:55:05.727357 n-d-850499-9 devstack@n-api.service[122256]: WARNING keystonemiddleware.auth_token [None req-8dd89021-ba22-4607-be7f-1b7eab04d7b0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 15:55:05.734585 n-d-850499-9 devstack@n-api.service[122256]: WARNING keystonemiddleware.auth_token [None req-8dd89021-ba22-4607-be7f-1b7eab04d7b0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 15:55:05.822572 n-d-850499-9 devstack@n-api.service[122257]: WARNING keystonemiddleware.auth_token [None req-4cf54c2a-06be-4c9f-98f6-0bd2bee4b937 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 15:55:05.830380 n-d-850499-9 devstack@n-api.service[122257]: WARNING keystonemiddleware.auth_token [None req-4cf54c2a-06be-4c9f-98f6-0bd2bee4b937 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 15:55:06.080383 n-d-850499-9 devstack@n-api.service[122256]: WARNING keystonemiddleware.auth_token [None req-8dd89021-ba22-4607-be7f-1b7eab04d7b0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 15:55:06.086374 n-d-850499-9 devstack@n-api.service[122256]: WARNING keystonemiddleware.auth_token [None req-8dd89021-ba22-4607-be7f-1b7eab04d7b0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 15:55:06.091998 n-d-850499-9 devstack@n-api.service[122256]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a819dc19c0 pid: 122256 (default app) Aug 31 15:55:06.171886 n-d-850499-9 devstack@n-api.service[122257]: WARNING keystonemiddleware.auth_token [None req-4cf54c2a-06be-4c9f-98f6-0bd2bee4b937 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 15:55:06.178034 n-d-850499-9 devstack@n-api.service[122257]: WARNING keystonemiddleware.auth_token [None req-4cf54c2a-06be-4c9f-98f6-0bd2bee4b937 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 15:55:06.183397 n-d-850499-9 devstack@n-api.service[122257]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a819dc19c0 pid: 122257 (default app) Aug 31 15:55:48.393557 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=3 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:55:48.395536 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=3 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:55:48.399167 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=3 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:55:48.401172 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=3 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:55:49.141848 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=3 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:55:49.142766 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=3 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:55:49.143834 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=3 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:55:49.144702 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=3 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:55:50.250453 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8a682d29-8298-4971-9165-3602da31e773 tempest-HypervisorAdminUnderV252Test-368969212 tempest-HypervisorAdminUnderV252Test-368969212-project-admin] Calling method '.version_select at 0x7f5aeaa1d8b0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:50.258599 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8a682d29-8298-4971-9165-3602da31e773 tempest-HypervisorAdminUnderV252Test-368969212 tempest-HypervisorAdminUnderV252Test-368969212-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9f6d6683-96bf-42a7-a78d-78a22f1453ed(cell1) {{(pid=122256) load_cells /opt/stack/nova/nova/compute/api.py:319}} Aug 31 15:55:50.259852 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8a682d29-8298-4971-9165-3602da31e773 tempest-HypervisorAdminUnderV252Test-368969212 tempest-HypervisorAdminUnderV252Test-368969212-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:50.260463 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8a682d29-8298-4971-9165-3602da31e773 tempest-HypervisorAdminUnderV252Test-368969212 tempest-HypervisorAdminUnderV252Test-368969212-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:50.261404 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8a682d29-8298-4971-9165-3602da31e773 tempest-HypervisorAdminUnderV252Test-368969212 tempest-HypervisorAdminUnderV252Test-368969212-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:50.289679 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8a682d29-8298-4971-9165-3602da31e773 tempest-HypervisorAdminUnderV252Test-368969212 tempest-HypervisorAdminUnderV252Test-368969212-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:50.290335 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8a682d29-8298-4971-9165-3602da31e773 tempest-HypervisorAdminUnderV252Test-368969212 tempest-HypervisorAdminUnderV252Test-368969212-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:50.290917 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8a682d29-8298-4971-9165-3602da31e773 tempest-HypervisorAdminUnderV252Test-368969212 tempest-HypervisorAdminUnderV252Test-368969212-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:50.306000 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8a682d29-8298-4971-9165-3602da31e773 tempest-HypervisorAdminUnderV252Test-368969212 tempest-HypervisorAdminUnderV252Test-368969212-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:50.306736 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8a682d29-8298-4971-9165-3602da31e773 tempest-HypervisorAdminUnderV252Test-368969212 tempest-HypervisorAdminUnderV252Test-368969212-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:50.307175 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8a682d29-8298-4971-9165-3602da31e773 tempest-HypervisorAdminUnderV252Test-368969212 tempest-HypervisorAdminUnderV252Test-368969212-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:50.315626 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8a682d29-8298-4971-9165-3602da31e773 tempest-HypervisorAdminUnderV252Test-368969212 tempest-HypervisorAdminUnderV252Test-368969212-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 1.928217 Aug 31 15:55:50.315880 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1/1] 10.222.0.61 () {58 vars in 1146 bytes} [Wed Aug 31 15:55:48 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 1931 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:55:50.610469 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f8fd6453-6bec-4c96-82b7-2bf9c74b05bf tempest-QuotaClassesAdmin257Test-54939239 tempest-QuotaClassesAdmin257Test-54939239-project-admin] Calling method '.version_select at 0x7f5aeaa1df70>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:50.639311 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f8fd6453-6bec-4c96-82b7-2bf9c74b05bf tempest-QuotaClassesAdmin257Test-54939239 tempest-QuotaClassesAdmin257Test-54939239-project-admin] 10.222.0.61 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.322066 Aug 31 15:55:50.641380 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2/2] 10.222.0.61 () {60 vars in 1226 bytes} [Wed Aug 31 15:55:50 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 15:55:50.882083 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-31a265ee-b530-455d-ae70-019b05b66721 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] Calling method '.version_select at 0x7f5aeaa218b0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:50.890248 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-31a265ee-b530-455d-ae70-019b05b66721 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9f6d6683-96bf-42a7-a78d-78a22f1453ed(cell1) {{(pid=122257) load_cells /opt/stack/nova/nova/compute/api.py:319}} Aug 31 15:55:50.891376 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-31a265ee-b530-455d-ae70-019b05b66721 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:50.892035 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-31a265ee-b530-455d-ae70-019b05b66721 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:50.892617 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-31a265ee-b530-455d-ae70-019b05b66721 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:50.894989 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d965170f-48f6-455d-baa3-ca71877159f1 tempest-AggregatesAdminTestV241-1942945972 tempest-AggregatesAdminTestV241-1942945972-project-admin] Calling method '.version_select at 0x7f5aea8c03a0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:50.901857 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d965170f-48f6-455d-baa3-ca71877159f1 tempest-AggregatesAdminTestV241-1942945972 tempest-AggregatesAdminTestV241-1942945972-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:50.903748 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d965170f-48f6-455d-baa3-ca71877159f1 tempest-AggregatesAdminTestV241-1942945972 tempest-AggregatesAdminTestV241-1942945972-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:50.904926 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d965170f-48f6-455d-baa3-ca71877159f1 tempest-AggregatesAdminTestV241-1942945972 tempest-AggregatesAdminTestV241-1942945972-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:50.933584 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-31a265ee-b530-455d-ae70-019b05b66721 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:50.934210 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d965170f-48f6-455d-baa3-ca71877159f1 tempest-AggregatesAdminTestV241-1942945972 tempest-AggregatesAdminTestV241-1942945972-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:50.934915 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d965170f-48f6-455d-baa3-ca71877159f1 tempest-AggregatesAdminTestV241-1942945972 tempest-AggregatesAdminTestV241-1942945972-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:50.935620 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d965170f-48f6-455d-baa3-ca71877159f1 tempest-AggregatesAdminTestV241-1942945972 tempest-AggregatesAdminTestV241-1942945972-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:50.935726 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-31a265ee-b530-455d-ae70-019b05b66721 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:50.937315 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-31a265ee-b530-455d-ae70-019b05b66721 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:50.966942 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-31a265ee-b530-455d-ae70-019b05b66721 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:50.967248 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d965170f-48f6-455d-baa3-ca71877159f1 tempest-AggregatesAdminTestV241-1942945972 tempest-AggregatesAdminTestV241-1942945972-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:50.968651 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d965170f-48f6-455d-baa3-ca71877159f1 tempest-AggregatesAdminTestV241-1942945972 tempest-AggregatesAdminTestV241-1942945972-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:50.969601 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d965170f-48f6-455d-baa3-ca71877159f1 tempest-AggregatesAdminTestV241-1942945972 tempest-AggregatesAdminTestV241-1942945972-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:50.973852 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-31a265ee-b530-455d-ae70-019b05b66721 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:50.974480 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-31a265ee-b530-455d-ae70-019b05b66721 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:50.986827 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d965170f-48f6-455d-baa3-ca71877159f1 tempest-AggregatesAdminTestV241-1942945972 tempest-AggregatesAdminTestV241-1942945972-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 0.344028 Aug 31 15:55:50.990500 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-31a265ee-b530-455d-ae70-019b05b66721 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 1.864043 Aug 31 15:55:50.990666 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3/3] 10.222.0.61 () {60 vars in 1208 bytes} [Wed Aug 31 15:55:50 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:55:50.992910 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1/4] 10.222.0.61 () {58 vars in 1167 bytes} [Wed Aug 31 15:55:49 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 1869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:51.004083 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e7fd2adf-ad90-41a6-a8fc-5f77a3102661 tempest-HypervisorAdminUnderV252Test-368969212 tempest-HypervisorAdminUnderV252Test-368969212-project-admin] Calling method '.version_select at 0x7f5aea8d7d30>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:51.006023 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e7fd2adf-ad90-41a6-a8fc-5f77a3102661 tempest-HypervisorAdminUnderV252Test-368969212 tempest-HypervisorAdminUnderV252Test-368969212-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:51.006821 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e7fd2adf-ad90-41a6-a8fc-5f77a3102661 tempest-HypervisorAdminUnderV252Test-368969212 tempest-HypervisorAdminUnderV252Test-368969212-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:51.007408 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e7fd2adf-ad90-41a6-a8fc-5f77a3102661 tempest-HypervisorAdminUnderV252Test-368969212 tempest-HypervisorAdminUnderV252Test-368969212-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:51.029204 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e7fd2adf-ad90-41a6-a8fc-5f77a3102661 tempest-HypervisorAdminUnderV252Test-368969212 tempest-HypervisorAdminUnderV252Test-368969212-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:51.029891 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e7fd2adf-ad90-41a6-a8fc-5f77a3102661 tempest-HypervisorAdminUnderV252Test-368969212 tempest-HypervisorAdminUnderV252Test-368969212-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:51.031110 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e7fd2adf-ad90-41a6-a8fc-5f77a3102661 tempest-HypervisorAdminUnderV252Test-368969212 tempest-HypervisorAdminUnderV252Test-368969212-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:51.077678 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e7fd2adf-ad90-41a6-a8fc-5f77a3102661 tempest-HypervisorAdminUnderV252Test-368969212 tempest-HypervisorAdminUnderV252Test-368969212-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:51.078390 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e7fd2adf-ad90-41a6-a8fc-5f77a3102661 tempest-HypervisorAdminUnderV252Test-368969212 tempest-HypervisorAdminUnderV252Test-368969212-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:51.078975 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e7fd2adf-ad90-41a6-a8fc-5f77a3102661 tempest-HypervisorAdminUnderV252Test-368969212 tempest-HypervisorAdminUnderV252Test-368969212-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:51.086910 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e7fd2adf-ad90-41a6-a8fc-5f77a3102661 tempest-HypervisorAdminUnderV252Test-368969212 tempest-HypervisorAdminUnderV252Test-368969212-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hypervisors/n-h1-850499-9/servers" status: 200 len: 104 microversion: 2.1 time: 0.095080 Aug 31 15:55:51.088545 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4/5] 10.222.0.61 () {58 vars in 1212 bytes} [Wed Aug 31 15:55:50 2022] GET /compute/v2.1/os-hypervisors/n-h1-850499-9/servers => generated 104 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:55:51.307948 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-737f23d6-f298-4041-8ea7-e9d546277008 tempest-FlavorsAccessTestJSON-539412469 tempest-FlavorsAccessTestJSON-539412469-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-2051487513", "id": 61697619, "os-flavor-access:is_public": "False"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:55:51.346027 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-333895a5-9f8c-4184-8cc6-eaadfc9afbae tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:51.350470 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-333895a5-9f8c-4184-8cc6-eaadfc9afbae tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:51.352204 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-333895a5-9f8c-4184-8cc6-eaadfc9afbae tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:51.352648 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-333895a5-9f8c-4184-8cc6-eaadfc9afbae tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:51.354847 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-333895a5-9f8c-4184-8cc6-eaadfc9afbae tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:51.355354 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-333895a5-9f8c-4184-8cc6-eaadfc9afbae tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:51.356170 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-333895a5-9f8c-4184-8cc6-eaadfc9afbae tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:51.399000 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-737f23d6-f298-4041-8ea7-e9d546277008 tempest-FlavorsAccessTestJSON-539412469 tempest-FlavorsAccessTestJSON-539412469-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.404830 Aug 31 15:55:51.408310 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2/6] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 15:55:50 2022] POST /compute/v2.1/flavors => generated 425 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:55:51.413882 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-bbe4135d-d8e3-4759-9fc5-0c88d6fbc440 tempest-QuotaClassesAdmin257Test-54939239 tempest-QuotaClassesAdmin257Test-54939239-project-admin] Action: 'update', calling method: .version_select at 0x7f5aeaa211f0>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:55:51.438842 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-333895a5-9f8c-4184-8cc6-eaadfc9afbae tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] 10.222.0.61 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.347822 Aug 31 15:55:51.440026 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 5/7] 10.222.0.61 () {58 vars in 1176 bytes} [Wed Aug 31 15:55:51 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:55:51.445258 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-51a51985-8d73-43a4-bcb6-ac0c2da3c155 tempest-AggregatesAdminTestV241-1942945972 tempest-AggregatesAdminTestV241-1942945972-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-847072812"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:55:51.475753 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.aggregate [None req-51a51985-8d73-43a4-bcb6-ac0c2da3c155 tempest-AggregatesAdminTestV241-1942945972 tempest-AggregatesAdminTestV241-1942945972-project-admin] Generated uuid 94812969-dbac-4bf4-a9b1-024efd593b3b for aggregate {{(pid=122256) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 31 15:55:51.570432 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-51a51985-8d73-43a4-bcb6-ac0c2da3c155 tempest-AggregatesAdminTestV241-1942945972 tempest-AggregatesAdminTestV241-1942945972-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.41 time: 0.128225 Aug 31 15:55:51.574622 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 6/8] 10.222.0.61 () {62 vars in 1205 bytes} [Wed Aug 31 15:55:51 2022] POST /compute/v2.1/os-aggregates => generated 245 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 15:55:51.582751 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a0bfb728-825e-40ac-afe4-930a45979ccd tempest-HypervisorAdminUnderV252Test-368969212 tempest-HypervisorAdminUnderV252Test-368969212-project-admin] Calling method '.version_select at 0x7f5aea7ec0d0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:51.585247 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a0bfb728-825e-40ac-afe4-930a45979ccd tempest-HypervisorAdminUnderV252Test-368969212 tempest-HypervisorAdminUnderV252Test-368969212-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:51.585744 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a0bfb728-825e-40ac-afe4-930a45979ccd tempest-HypervisorAdminUnderV252Test-368969212 tempest-HypervisorAdminUnderV252Test-368969212-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:51.586191 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a0bfb728-825e-40ac-afe4-930a45979ccd tempest-HypervisorAdminUnderV252Test-368969212 tempest-HypervisorAdminUnderV252Test-368969212-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:51.605002 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a0bfb728-825e-40ac-afe4-930a45979ccd tempest-HypervisorAdminUnderV252Test-368969212 tempest-HypervisorAdminUnderV252Test-368969212-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:51.605578 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a0bfb728-825e-40ac-afe4-930a45979ccd tempest-HypervisorAdminUnderV252Test-368969212 tempest-HypervisorAdminUnderV252Test-368969212-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:51.606243 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a0bfb728-825e-40ac-afe4-930a45979ccd tempest-HypervisorAdminUnderV252Test-368969212 tempest-HypervisorAdminUnderV252Test-368969212-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:51.619687 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a0bfb728-825e-40ac-afe4-930a45979ccd tempest-HypervisorAdminUnderV252Test-368969212 tempest-HypervisorAdminUnderV252Test-368969212-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:51.619921 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a0bfb728-825e-40ac-afe4-930a45979ccd tempest-HypervisorAdminUnderV252Test-368969212 tempest-HypervisorAdminUnderV252Test-368969212-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:51.620284 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a0bfb728-825e-40ac-afe4-930a45979ccd tempest-HypervisorAdminUnderV252Test-368969212 tempest-HypervisorAdminUnderV252Test-368969212-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:51.627841 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a0bfb728-825e-40ac-afe4-930a45979ccd tempest-HypervisorAdminUnderV252Test-368969212 tempest-HypervisorAdminUnderV252Test-368969212-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.051891 Aug 31 15:55:51.628882 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 7/9] 10.222.0.61 () {58 vars in 1146 bytes} [Wed Aug 31 15:55:51 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:55:51.634162 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a38bad9d-b41c-46d5-bcb4-ddbc833507fd tempest-FlavorsAccessTestJSON-539412469 tempest-FlavorsAccessTestJSON-539412469-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "9115696d76054a198a51fb1367787ddd"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:55:51.770176 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-bbe4135d-d8e3-4759-9fc5-0c88d6fbc440 tempest-QuotaClassesAdmin257Test-54939239 tempest-QuotaClassesAdmin257Test-54939239-project-admin] 10.222.0.61 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.360638 Aug 31 15:55:51.774660 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3/10] 10.222.0.61 () {62 vars in 1247 bytes} [Wed Aug 31 15:55:51 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 15:55:51.783680 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d1a81e32-ccda-4daa-8591-e8f3975c2a12 tempest-AggregatesAdminTestV241-1942945972 tempest-AggregatesAdminTestV241-1942945972-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1054678291"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:55:52.029953 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d1a81e32-ccda-4daa-8591-e8f3975c2a12 tempest-AggregatesAdminTestV241-1942945972 tempest-AggregatesAdminTestV241-1942945972-project-admin] 10.222.0.61 "PUT /compute/v2.1/os-aggregates/1" status: 200 len: 299 microversion: 2.41 time: 0.253836 Aug 31 15:55:52.037094 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4/11] 10.222.0.61 () {62 vars in 1210 bytes} [Wed Aug 31 15:55:51 2022] PUT /compute/v2.1/os-aggregates/1 => generated 299 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 15:55:52.037094 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8b7788cc-2c1b-4893-b993-139179698ba0 tempest-HypervisorAdminUnderV252Test-368969212 tempest-HypervisorAdminUnderV252Test-368969212-project-admin] Calling method '.version_select at 0x7f5aea81b670>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:52.058753 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b7788cc-2c1b-4893-b993-139179698ba0 tempest-HypervisorAdminUnderV252Test-368969212 tempest-HypervisorAdminUnderV252Test-368969212-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:52.075225 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b7788cc-2c1b-4893-b993-139179698ba0 tempest-HypervisorAdminUnderV252Test-368969212 tempest-HypervisorAdminUnderV252Test-368969212-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:52.079336 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b7788cc-2c1b-4893-b993-139179698ba0 tempest-HypervisorAdminUnderV252Test-368969212 tempest-HypervisorAdminUnderV252Test-368969212-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:52.140247 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b7788cc-2c1b-4893-b993-139179698ba0 tempest-HypervisorAdminUnderV252Test-368969212 tempest-HypervisorAdminUnderV252Test-368969212-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:52.140895 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b7788cc-2c1b-4893-b993-139179698ba0 tempest-HypervisorAdminUnderV252Test-368969212 tempest-HypervisorAdminUnderV252Test-368969212-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:52.141825 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b7788cc-2c1b-4893-b993-139179698ba0 tempest-HypervisorAdminUnderV252Test-368969212 tempest-HypervisorAdminUnderV252Test-368969212-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:52.155863 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8b7788cc-2c1b-4893-b993-139179698ba0 tempest-HypervisorAdminUnderV252Test-368969212 tempest-HypervisorAdminUnderV252Test-368969212-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hypervisors/n-h1-850499-9/search" status: 200 len: 104 microversion: 2.1 time: 0.123647 Aug 31 15:55:52.158939 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 5/12] 10.222.0.61 () {58 vars in 1209 bytes} [Wed Aug 31 15:55:52 2022] GET /compute/v2.1/os-hypervisors/n-h1-850499-9/search => generated 104 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:55:52.166559 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a38bad9d-b41c-46d5-bcb4-ddbc833507fd tempest-FlavorsAccessTestJSON-539412469 tempest-FlavorsAccessTestJSON-539412469-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors/61697619/action" status: 200 len: 95 microversion: 2.1 time: 0.536378 Aug 31 15:55:52.167777 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 8/13] 10.222.0.61 () {60 vars in 1194 bytes} [Wed Aug 31 15:55:51 2022] POST /compute/v2.1/flavors/61697619/action => generated 95 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 15:55:52.172653 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-fd9fe590-00a7-4f5d-8920-9a603e98228e tempest-QuotaClassesAdmin257Test-54939239 tempest-QuotaClassesAdmin257Test-54939239-project-admin] Calling method '.version_select at 0x7f5aea81bd30>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:52.177356 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0c835343-90ac-486b-9b46-cbee6d28c406 tempest-AggregatesAdminTestV241-1942945972 tempest-AggregatesAdminTestV241-1942945972-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:52.207242 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-fd9fe590-00a7-4f5d-8920-9a603e98228e tempest-QuotaClassesAdmin257Test-54939239 tempest-QuotaClassesAdmin257Test-54939239-project-admin] 10.222.0.61 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.043922 Aug 31 15:55:52.207855 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 6/14] 10.222.0.61 () {60 vars in 1226 bytes} [Wed Aug 31 15:55:52 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 15:55:52.226888 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0c835343-90ac-486b-9b46-cbee6d28c406 tempest-AggregatesAdminTestV241-1942945972 tempest-AggregatesAdminTestV241-1942945972-project-admin] 10.222.0.61 "GET /compute/v2.1/os-aggregates/1" status: 200 len: 299 microversion: 2.41 time: 0.056569 Aug 31 15:55:52.229190 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 9/15] 10.222.0.61 () {60 vars in 1190 bytes} [Wed Aug 31 15:55:52 2022] GET /compute/v2.1/os-aggregates/1 => generated 299 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 15:55:52.243642 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a11f70b3-524c-49af-b92d-02b96381b109 tempest-QuotaClassesAdmin257Test-54939239 tempest-QuotaClassesAdmin257Test-54939239-project-admin] Action: 'update', calling method: .version_select at 0x7f5ae9f86280>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:55:52.356954 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a11f70b3-524c-49af-b92d-02b96381b109 tempest-QuotaClassesAdmin257Test-54939239 tempest-QuotaClassesAdmin257Test-54939239-project-admin] 10.222.0.61 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.118723 Aug 31 15:55:52.360144 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 10/16] 10.222.0.61 () {62 vars in 1247 bytes} [Wed Aug 31 15:55:52 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 15:55:52.368429 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1b10050c-8e6c-4be3-971c-758edae2dd83 tempest-AggregatesAdminTestV241-1942945972 tempest-AggregatesAdminTestV241-1942945972-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-850499-9"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:55:52.388676 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1b10050c-8e6c-4be3-971c-758edae2dd83 tempest-AggregatesAdminTestV241-1942945972 tempest-AggregatesAdminTestV241-1942945972-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:52.389895 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1b10050c-8e6c-4be3-971c-758edae2dd83 tempest-AggregatesAdminTestV241-1942945972 tempest-AggregatesAdminTestV241-1942945972-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:52.390904 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1b10050c-8e6c-4be3-971c-758edae2dd83 tempest-AggregatesAdminTestV241-1942945972 tempest-AggregatesAdminTestV241-1942945972-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:52.604662 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d9809416-5340-47c9-ad42-8b50bfaad07d tempest-FlavorsAccessTestJSON-1578494889 tempest-FlavorsAccessTestJSON-1578494889-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:52.695227 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d9809416-5340-47c9-ad42-8b50bfaad07d tempest-FlavorsAccessTestJSON-1578494889 tempest-FlavorsAccessTestJSON-1578494889-project] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 5406 microversion: 2.1 time: 0.486278 Aug 31 15:55:52.695875 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 7/17] 10.222.0.61 () {58 vars in 1146 bytes} [Wed Aug 31 15:55:52 2022] GET /compute/v2.1/flavors/detail => generated 5406 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:52.717285 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d4c81c28-ec48-4190-bd15-79ce3c53eab9 tempest-FlavorsAccessTestJSON-539412469 tempest-FlavorsAccessTestJSON-539412469-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "9115696d76054a198a51fb1367787ddd"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:55:53.679081 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d4c81c28-ec48-4190-bd15-79ce3c53eab9 tempest-FlavorsAccessTestJSON-539412469 tempest-FlavorsAccessTestJSON-539412469-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors/61697619/action" status: 200 len: 21 microversion: 2.1 time: 0.965661 Aug 31 15:55:53.686204 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 8/18] 10.222.0.61 () {60 vars in 1194 bytes} [Wed Aug 31 15:55:52 2022] POST /compute/v2.1/flavors/61697619/action => generated 21 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 31 15:55:53.691155 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0b15d5c0-d394-48d6-ad6e-d5c61e9f8c0c tempest-FlavorsAccessTestJSON-1578494889 tempest-FlavorsAccessTestJSON-1578494889-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:53.725336 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1b10050c-8e6c-4be3-971c-758edae2dd83 tempest-AggregatesAdminTestV241-1942945972 tempest-AggregatesAdminTestV241-1942945972-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 314 microversion: 2.41 time: 1.363657 Aug 31 15:55:53.727882 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 11/19] 10.222.0.61 () {62 vars in 1232 bytes} [Wed Aug 31 15:55:52 2022] POST /compute/v2.1/os-aggregates/1/action => generated 314 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 15:55:53.739375 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0b15d5c0-d394-48d6-ad6e-d5c61e9f8c0c tempest-FlavorsAccessTestJSON-1578494889 tempest-FlavorsAccessTestJSON-1578494889-project] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.051900 Aug 31 15:55:53.742118 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-29eab012-64d4-4b69-a7df-5eda8c6f0725 tempest-AggregatesAdminTestV241-1942945972 tempest-AggregatesAdminTestV241-1942945972-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-850499-9"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:55:53.753171 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 9/20] 10.222.0.61 () {58 vars in 1146 bytes} [Wed Aug 31 15:55:53 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:53.760187 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-29eab012-64d4-4b69-a7df-5eda8c6f0725 tempest-AggregatesAdminTestV241-1942945972 tempest-AggregatesAdminTestV241-1942945972-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:53.760809 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-29eab012-64d4-4b69-a7df-5eda8c6f0725 tempest-AggregatesAdminTestV241-1942945972 tempest-AggregatesAdminTestV241-1942945972-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:53.761520 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-29eab012-64d4-4b69-a7df-5eda8c6f0725 tempest-AggregatesAdminTestV241-1942945972 tempest-AggregatesAdminTestV241-1942945972-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:53.774917 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-cceba02d-6402-4528-abb7-bfd035dcd4be tempest-FlavorsAccessTestJSON-539412469 tempest-FlavorsAccessTestJSON-539412469-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:53.846988 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-cceba02d-6402-4528-abb7-bfd035dcd4be tempest-FlavorsAccessTestJSON-539412469 tempest-FlavorsAccessTestJSON-539412469-project-admin] 10.222.0.61 "DELETE /compute/v2.1/flavors/61697619" status: 202 len: 0 microversion: 2.1 time: 0.075529 Aug 31 15:55:53.848034 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 10/21] 10.222.0.61 () {58 vars in 1155 bytes} [Wed Aug 31 15:55:53 2022] DELETE /compute/v2.1/flavors/61697619 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 15:55:53.857275 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d7e073fe-1913-451b-96d2-3a8aa7bb1598 tempest-FlavorsAccessTestJSON-539412469 tempest-FlavorsAccessTestJSON-539412469-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:53.944329 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d7e073fe-1913-451b-96d2-3a8aa7bb1598 tempest-FlavorsAccessTestJSON-539412469 tempest-FlavorsAccessTestJSON-539412469-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.091050 Aug 31 15:55:53.961097 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 11/22] 10.222.0.61 () {58 vars in 1146 bytes} [Wed Aug 31 15:55:53 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:55:53.977014 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-29eab012-64d4-4b69-a7df-5eda8c6f0725 tempest-AggregatesAdminTestV241-1942945972 tempest-AggregatesAdminTestV241-1942945972-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 299 microversion: 2.41 time: 0.237327 Aug 31 15:55:53.978259 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 12/23] 10.222.0.61 () {62 vars in 1232 bytes} [Wed Aug 31 15:55:53 2022] POST /compute/v2.1/os-aggregates/1/action => generated 299 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 15:55:53.987087 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e4c29db4-47f1-4591-a44f-fea157eb2d97 tempest-FlavorsAccessTestJSON-539412469 tempest-FlavorsAccessTestJSON-539412469-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1964706442", "id": 249914684, "os-flavor-access:is_public": "False"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:55:54.005952 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5326dc4e-23a2-42a7-bd7e-d2afe0fde6eb tempest-AggregatesAdminTestV241-1942945972 tempest-AggregatesAdminTestV241-1942945972-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:54.031137 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e4c29db4-47f1-4591-a44f-fea157eb2d97 tempest-FlavorsAccessTestJSON-539412469 tempest-FlavorsAccessTestJSON-539412469-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.062678 Aug 31 15:55:54.039563 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 12/24] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 15:55:53 2022] POST /compute/v2.1/flavors => generated 428 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:55:54.047903 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c07eccc9-2b91-4610-8025-42d63d12481c tempest-FlavorsAccessTestJSON-539412469 tempest-FlavorsAccessTestJSON-539412469-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:54.085365 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5326dc4e-23a2-42a7-bd7e-d2afe0fde6eb tempest-AggregatesAdminTestV241-1942945972 tempest-AggregatesAdminTestV241-1942945972-project-admin] 10.222.0.61 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.41 time: 0.098148 Aug 31 15:55:54.085954 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 13/25] 10.222.0.61 () {60 vars in 1193 bytes} [Wed Aug 31 15:55:53 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:55:54.123066 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c07eccc9-2b91-4610-8025-42d63d12481c tempest-FlavorsAccessTestJSON-539412469 tempest-FlavorsAccessTestJSON-539412469-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/249914684/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.079130 Aug 31 15:55:54.125865 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 13/26] 10.222.0.61 () {58 vars in 1206 bytes} [Wed Aug 31 15:55:54 2022] GET /compute/v2.1/flavors/249914684/os-flavor-access => generated 21 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 31 15:55:54.126826 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-939040e0-01a8-4125-8112-033b1059deb3 tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-817659863"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:55:54.141329 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.aggregate [None req-939040e0-01a8-4125-8112-033b1059deb3 tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] Generated uuid e3338922-833a-40b5-a912-557127166b65 for aggregate {{(pid=122256) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 31 15:55:54.150615 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ddde9277-608e-4a1e-85a8-aa418eebcf95 tempest-FlavorsAccessTestJSON-539412469 tempest-FlavorsAccessTestJSON-539412469-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:54.201307 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ddde9277-608e-4a1e-85a8-aa418eebcf95 tempest-FlavorsAccessTestJSON-539412469 tempest-FlavorsAccessTestJSON-539412469-project-admin] 10.222.0.61 "DELETE /compute/v2.1/flavors/249914684" status: 202 len: 0 microversion: 2.1 time: 0.068468 Aug 31 15:55:54.203269 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 14/27] 10.222.0.61 () {58 vars in 1158 bytes} [Wed Aug 31 15:55:54 2022] DELETE /compute/v2.1/flavors/249914684 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 15:55:54.220404 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-20a82263-f661-4509-8176-0d15d62422d4 tempest-FlavorsAccessTestJSON-539412469 tempest-FlavorsAccessTestJSON-539412469-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:54.229812 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-939040e0-01a8-4125-8112-033b1059deb3 tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.121599 Aug 31 15:55:54.239198 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 14/28] 10.222.0.61 () {60 vars in 1164 bytes} [Wed Aug 31 15:55:54 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:55:54.245882 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-775804ed-56b0-4bab-9cec-360bbe1c9440 tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-850499-9"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:55:54.252874 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-20a82263-f661-4509-8176-0d15d62422d4 tempest-FlavorsAccessTestJSON-539412469 tempest-FlavorsAccessTestJSON-539412469-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.043184 Aug 31 15:55:54.254693 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 15/29] 10.222.0.61 () {58 vars in 1146 bytes} [Wed Aug 31 15:55:54 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:54.276080 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-775804ed-56b0-4bab-9cec-360bbe1c9440 tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:54.277149 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-775804ed-56b0-4bab-9cec-360bbe1c9440 tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:54.277749 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-775804ed-56b0-4bab-9cec-360bbe1c9440 tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:54.538268 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-775804ed-56b0-4bab-9cec-360bbe1c9440 tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 241 microversion: 2.1 time: 0.297600 Aug 31 15:55:54.538872 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 15/30] 10.222.0.61 () {60 vars in 1191 bytes} [Wed Aug 31 15:55:54 2022] POST /compute/v2.1/os-aggregates/2/action => generated 241 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:55:54.551465 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8ba7f43e-ed50-41f5-91cc-79f4e7e50be5 tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-850499-9"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:55:54.577278 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8ba7f43e-ed50-41f5-91cc-79f4e7e50be5 tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:54.577778 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8ba7f43e-ed50-41f5-91cc-79f4e7e50be5 tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:54.578222 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8ba7f43e-ed50-41f5-91cc-79f4e7e50be5 tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:54.627961 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=10,nova_api:UPDATE=8,nova_api:DELETE=7 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:55:54.669117 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-8ba7f43e-ed50-41f5-91cc-79f4e7e50be5 tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] HTTP exception thrown: Aggregate 2 already has host n-h1-850499-9. Aug 31 15:55:54.716851 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8ba7f43e-ed50-41f5-91cc-79f4e7e50be5 tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] Request method failure captured: Aug 31 15:55:54.716851 n-d-850499-9 devstack@n-api.service[122257]: request: POST /compute/v2.1/os-aggregates/2/action HTTP/1.1 Aug 31 15:55:54.716851 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 15:55:54.716851 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 15:55:54.716851 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 15:55:54.716851 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 39 Aug 31 15:55:54.716851 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 15:55:54.716851 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 15:55:54.716851 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 15:55:54.716851 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 15:55:54.716851 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4SGQIQoHeMzleKeuN86FNKPcC70EDN3vvnbv5OP60F3GKzilNbO986Ebl4P9Ns_7fZw90Bs5FqY4IJ9jx1mntbxztRbT4O47wiLT9GZ_VsOGsx0hBsPT0oayVTcpf-y2h3Escl2kyQTF-POOAwUJKtU9TWiek0xftsoY-gAipBE-sE Aug 31 15:55:54.716851 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 15:55:54.716851 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 15:55:54.716851 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 15:55:54.716851 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 15:55:54.716851 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 15:55:54.716851 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 15:55:54.716851 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 7bbe02d5716d48d9bcff3357923a7933 Aug 31 15:55:54.716851 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1569510051 Aug 31 15:55:54.716851 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,admin,member Aug 31 15:55:54.716851 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,admin,member Aug 31 15:55:54.719385 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7bbe02d5716d48d9bcff3357923a7933"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7bbe02d5716d48d9bcff3357923a7933"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7bbe02d5716d48d9bcff3357923a7933", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7bbe02d5716d48d9bcff3357923a7933"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 15:55:54.719385 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1569510051 Aug 31 15:55:54.719385 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 7bbe02d5716d48d9bcff3357923a7933 Aug 31 15:55:54.719385 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1569510051 Aug 31 15:55:54.719385 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin Aug 31 15:55:54.719385 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 15:55:54.719385 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 15:55:54.719385 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: b8ab15c6ae7049e68e5bd2f1a0a709b4 Aug 31 15:55:54.719385 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin Aug 31 15:55:54.719385 n-d-850499-9 devstack@n-api.service[122257]: Aug 31 15:55:54.719385 n-d-850499-9 devstack@n-api.service[122257]: {"add_host": {"host": "n-h1-850499-9"}} Aug 31 15:55:54.719385 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 15:55:54.719385 n-d-850499-9 devstack@n-api.service[122257]: exception: Aggregate 2 already has host n-h1-850499-9. Aug 31 15:55:54.720854 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '2', 'body': {'add_host': {'host': 'n-h1-850499-9'}}} Aug 31 15:55:54.720854 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:55:54.720854 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:55:54.720854 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 15:55:54.720854 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 31 15:55:54.720854 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 15:55:54.720854 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 31 15:55:54.720854 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 15:55:54.720854 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 31 15:55:54.720854 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 15:55:54.720854 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 31 15:55:54.720854 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 15:55:54.720854 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 15:55:54.720854 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 15:55:54.720854 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi result.read() Aug 31 15:55:54.720854 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 15:55:54.720854 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 31 15:55:54.720854 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 15:55:54.720854 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 31 15:55:54.722511 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 15:55:54.722511 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 31 15:55:54.722511 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 15:55:54.722511 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 31 15:55:54.722511 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h1-850499-9-2' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Aug 31 15:55:54.722511 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:55:54.722511 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 31 15:55:54.722511 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:55:54.722511 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:55:54.722511 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Aug 31 15:55:54.722511 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Aug 31 15:55:54.722511 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 31 15:55:54.722511 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi session.flush() Aug 31 15:55:54.722511 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 31 15:55:54.722511 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 31 15:55:54.722511 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 31 15:55:54.722511 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 31 15:55:54.722511 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 31 15:55:54.722511 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 31 15:55:54.723968 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 15:55:54.723968 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception Aug 31 15:55:54.723968 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 31 15:55:54.723968 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 31 15:55:54.723968 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 31 15:55:54.723968 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 31 15:55:54.723968 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 31 15:55:54.723968 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 31 15:55:54.723968 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 31 15:55:54.723968 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 31 15:55:54.723968 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 31 15:55:54.723968 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 31 15:55:54.723968 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 31 15:55:54.723968 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 31 15:55:54.723968 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 31 15:55:54.723968 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 31 15:55:54.723968 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 31 15:55:54.723968 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 31 15:55:54.725470 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 31 15:55:54.725470 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 31 15:55:54.725470 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 31 15:55:54.725470 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 31 15:55:54.725470 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 15:55:54.725470 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception Aug 31 15:55:54.725470 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 15:55:54.725470 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 31 15:55:54.725470 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 15:55:54.725470 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 31 15:55:54.725470 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 15:55:54.725470 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 31 15:55:54.725470 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 15:55:54.725470 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 31 15:55:54.725470 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 15:55:54.725470 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 15:55:54.725470 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 15:55:54.725470 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi result.read() Aug 31 15:55:54.727025 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 15:55:54.727025 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 31 15:55:54.727025 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 15:55:54.727025 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 31 15:55:54.727025 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 15:55:54.727025 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 31 15:55:54.727025 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 15:55:54.727025 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 31 15:55:54.727025 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h1-850499-9-2' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Aug 31 15:55:54.727025 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Aug 31 15:55:54.727025 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 31, 15, 55, 54, 618434), 'updated_at': None, 'host': 'n-h1-850499-9', 'aggregate_id': 2}] Aug 31 15:55:54.727025 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 31 15:55:54.727025 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:55:54.727025 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:55:54.727025 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:55:54.727025 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:55:54.727025 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Aug 31 15:55:54.728029 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Aug 31 15:55:54.728029 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 31 15:55:54.728029 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 31 15:55:54.728029 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 15:55:54.728029 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 31 15:55:54.728029 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 15:55:54.728029 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise self.value Aug 31 15:55:54.728029 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 31 15:55:54.728029 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 31 15:55:54.728029 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6639, in add_host_to_aggregate Aug 31 15:55:54.728029 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Aug 31 15:55:54.728029 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 31 15:55:54.728029 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 31 15:55:54.728029 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Aug 31 15:55:54.728029 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Aug 31 15:55:54.728029 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Aug 31 15:55:54.728029 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Aug 31 15:55:54.728029 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 2 already has host n-h1-850499-9. Aug 31 15:55:54.728029 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:55:54.728029 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:55:54.729870 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:55:54.729870 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:55:54.729870 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:55:54.729870 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:55:54.729870 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:55:54.729870 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:55:54.729870 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:55:54.729870 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:55:54.729870 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:55:54.729870 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:55:54.729870 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Aug 31 15:55:54.729870 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Aug 31 15:55:54.729870 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 2 already has host n-h1-850499-9. Aug 31 15:55:54.729870 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:55:54.729870 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:55:54.729870 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:55:54.729870 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:55:54.729870 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:55:54.729870 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:55:54.729870 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:55:54.729870 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:55:54.731987 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 2 already has host n-h1-850499-9. Aug 31 15:55:54.731987 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:55:54.731987 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8ba7f43e-ed50-41f5-91cc-79f4e7e50be5 tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] Returning 409 to user: Aggregate 2 already has host n-h1-850499-9. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:55:54.731987 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8ba7f43e-ed50-41f5-91cc-79f4e7e50be5 tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates/2/action" status: 409 len: 95 microversion: 2.1 time: 0.172183 Aug 31 15:55:54.731987 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 16/31] 10.222.0.61 () {60 vars in 1191 bytes} [Wed Aug 31 15:55:54 2022] POST /compute/v2.1/os-aggregates/2/action => generated 95 bytes in 186 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Aug 31 15:55:54.741716 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3041d530-bff8-45d9-a067-3235e38dfc97 tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-850499-9"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:55:54.771638 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3041d530-bff8-45d9-a067-3235e38dfc97 tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:54.772551 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3041d530-bff8-45d9-a067-3235e38dfc97 tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:54.773147 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3041d530-bff8-45d9-a067-3235e38dfc97 tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:55.039314 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3041d530-bff8-45d9-a067-3235e38dfc97 tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 226 microversion: 2.1 time: 0.301816 Aug 31 15:55:55.049009 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 16/32] 10.222.0.61 () {60 vars in 1191 bytes} [Wed Aug 31 15:55:54 2022] POST /compute/v2.1/os-aggregates/2/action => generated 226 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 15:55:55.054117 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0b31a52a-23ba-49f2-aa08-b13e0db55d71 tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:55.156886 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0b31a52a-23ba-49f2-aa08-b13e0db55d71 tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] 10.222.0.61 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.099000 Aug 31 15:55:55.165053 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 17/33] 10.222.0.61 () {58 vars in 1152 bytes} [Wed Aug 31 15:55:55 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 31 15:55:55.183965 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-dcad7de2-91c5-42af-987e-2dde9b3c2274 tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1135287036"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:55:55.191144 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.aggregate [None req-dcad7de2-91c5-42af-987e-2dde9b3c2274 tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] Generated uuid ea26eed4-23d0-402e-9c77-de4eb005f419 for aggregate {{(pid=122257) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 31 15:55:55.302587 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-dcad7de2-91c5-42af-987e-2dde9b3c2274 tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.136111 Aug 31 15:55:55.320389 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 18/34] 10.222.0.61 () {60 vars in 1164 bytes} [Wed Aug 31 15:55:55 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:55:55.353631 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-26102e2e-6009-44a8-944c-042c02b66afe tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-204945747", "name": "tempest-test_aggregate-1205984557"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:55:55.392738 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.aggregate [None req-26102e2e-6009-44a8-944c-042c02b66afe tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] Generated uuid 9c129d0c-7d02-44b4-8627-1e0b867725e5 for aggregate {{(pid=122257) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 31 15:55:55.445764 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-26102e2e-6009-44a8-944c-042c02b66afe tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.114895 Aug 31 15:55:55.448532 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 19/35] 10.222.0.61 () {60 vars in 1165 bytes} [Wed Aug 31 15:55:55 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:55:55.864794 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4adb99db-11da-4c14-8dbe-038be6c2efd7 tempest-FlavorsAccessNegativeTestJSON-51119877 tempest-FlavorsAccessNegativeTestJSON-51119877-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1868206789", "id": 450896847, "os-flavor-access:is_public": "False"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:55:55.909450 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4adb99db-11da-4c14-8dbe-038be6c2efd7 tempest-FlavorsAccessNegativeTestJSON-51119877 tempest-FlavorsAccessNegativeTestJSON-51119877-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.754282 Aug 31 15:55:55.910627 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 17/36] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 15:55:55 2022] POST /compute/v2.1/flavors => generated 436 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 15:55:55.922972 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3b0315ac-cb41-4da1-9944-ce1c3ebbf1a3 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:55.951394 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3b0315ac-cb41-4da1-9944-ce1c3ebbf1a3 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] 10.222.0.61 "GET /compute/v2.1/os-aggregates" status: 200 len: 515 microversion: 2.1 time: 0.038043 Aug 31 15:55:55.957153 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 18/37] 10.222.0.61 () {58 vars in 1143 bytes} [Wed Aug 31 15:55:55 2022] GET /compute/v2.1/os-aggregates => generated 515 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:55:55.966691 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e138b592-b09f-4151-a6df-b040d7067285 tempest-FlavorsAccessNegativeTestJSON-51119877 tempest-FlavorsAccessNegativeTestJSON-51119877-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "98fd39a94454468792a9e1ef60fe9337"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:55:55.993358 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3e9cf562-636d-4642-9365-1c1a0d06b223 tempest-AggregatesAdminNegativeTestJSON-148728318 tempest-AggregatesAdminNegativeTestJSON-148728318-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-850499-9"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:55:55.998623 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3e9cf562-636d-4642-9365-1c1a0d06b223 tempest-AggregatesAdminNegativeTestJSON-148728318 tempest-AggregatesAdminNegativeTestJSON-148728318-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '7be97b44590b40ccaee241d020cfd674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f9a9a381df493d9963697f8e6f4b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:56.005106 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3e9cf562-636d-4642-9365-1c1a0d06b223 tempest-AggregatesAdminNegativeTestJSON-148728318 tempest-AggregatesAdminNegativeTestJSON-148728318-project] Request method failure captured: Aug 31 15:55:56.005106 n-d-850499-9 devstack@n-api.service[122257]: request: POST /compute/v2.1/os-aggregates/3/action HTTP/1.1 Aug 31 15:55:56.005106 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 15:55:56.005106 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 15:55:56.005106 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 15:55:56.005106 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 39 Aug 31 15:55:56.005106 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 15:55:56.005106 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 15:55:56.005106 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 15:55:56.005106 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 15:55:56.005106 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4SCylM4XlpqpHr7br_SNtINz4kKLsmoxZFU3yRQqIUaF5qH9TxqaBPIeqf9ekYJ7E0Mzhf8YAs3u2Z4Me-JhE-FBwxcq4Z4T3e_6qmZ311AsdkpeBRMvRJcA647S3Chjq-8kSCbOj0mRLKOX_gZtA7_5RwYQZ-k6ogyns7nGw2XTx4 Aug 31 15:55:56.005106 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 15:55:56.005106 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 15:55:56.005106 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 15:55:56.005106 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 15:55:56.005106 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 15:55:56.005106 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 15:55:56.005106 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 28f9a9a381df493d9963697f8e6f4b8f Aug 31 15:55:56.005106 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-148728318 Aug 31 15:55:56.005106 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 15:55:56.005106 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 15:55:56.006444 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/28f9a9a381df493d9963697f8e6f4b8f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/28f9a9a381df493d9963697f8e6f4b8f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_28f9a9a381df493d9963697f8e6f4b8f", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/28f9a9a381df493d9963697f8e6f4b8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 15:55:56.006444 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-148728318 Aug 31 15:55:56.006444 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 28f9a9a381df493d9963697f8e6f4b8f Aug 31 15:55:56.006444 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-148728318 Aug 31 15:55:56.006444 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-AggregatesAdminNegativeTestJSON-148728318-project Aug 31 15:55:56.006444 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 15:55:56.006444 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 15:55:56.006444 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 7be97b44590b40ccaee241d020cfd674 Aug 31 15:55:56.006444 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-148728318-project Aug 31 15:55:56.006444 n-d-850499-9 devstack@n-api.service[122257]: Aug 31 15:55:56.006444 n-d-850499-9 devstack@n-api.service[122257]: {"add_host": {"host": "n-h1-850499-9"}} Aug 31 15:55:56.006444 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 15:55:56.006444 n-d-850499-9 devstack@n-api.service[122257]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 31 15:55:56.007251 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '3', 'body': {'add_host': {'host': 'n-h1-850499-9'}}} Aug 31 15:55:56.007251 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:55:56.007251 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:55:56.007251 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:55:56.007251 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:55:56.007251 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:55:56.007251 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:55:56.007251 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:55:56.007251 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:55:56.007251 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:55:56.007251 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:55:56.007251 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Aug 31 15:55:56.007251 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Aug 31 15:55:56.007251 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 31 15:55:56.007251 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 31 15:55:56.007251 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 31 15:55:56.007251 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 31 15:55:56.007251 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 15:55:56.007251 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 31 15:55:56.008387 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 15:55:56.008387 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise self.value Aug 31 15:55:56.008387 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 31 15:55:56.008387 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 31 15:55:56.008387 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 31 15:55:56.008387 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 31 15:55:56.008387 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 31 15:55:56.008387 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 31 15:55:56.008387 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 31 15:55:56.008387 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:55:56.008387 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:55:56.008387 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:55:56.008387 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:55:56.008387 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:55:56.008387 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:55:56.008387 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 31 15:55:56.008387 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 31 15:55:56.008387 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 31 15:55:56.008387 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:55:56.020214 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3e9cf562-636d-4642-9365-1c1a0d06b223 tempest-AggregatesAdminNegativeTestJSON-148728318 tempest-AggregatesAdminNegativeTestJSON-148728318-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:55:56.033844 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3e9cf562-636d-4642-9365-1c1a0d06b223 tempest-AggregatesAdminNegativeTestJSON-148728318 tempest-AggregatesAdminNegativeTestJSON-148728318-project] 10.222.0.61 "POST /compute/v2.1/os-aggregates/3/action" status: 403 len: 118 microversion: 2.1 time: 0.575416 Aug 31 15:55:56.036395 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 20/38] 10.222.0.61 () {60 vars in 1191 bytes} [Wed Aug 31 15:55:55 2022] POST /compute/v2.1/os-aggregates/3/action => generated 118 bytes in 587 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:55:56.069587 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c20ba3bf-0eba-4159-88fb-ba07bebd9166 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-850499-9"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:55:56.118475 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c20ba3bf-0eba-4159-88fb-ba07bebd9166 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:56.123380 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c20ba3bf-0eba-4159-88fb-ba07bebd9166 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:56.124003 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c20ba3bf-0eba-4159-88fb-ba07bebd9166 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:56.722483 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=6,nova_api:UPDATE=7,nova_api:DELETE=4 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:55:56.751839 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e138b592-b09f-4151-a6df-b040d7067285 tempest-FlavorsAccessNegativeTestJSON-51119877 tempest-FlavorsAccessNegativeTestJSON-51119877-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors/450896847/action" status: 200 len: 96 microversion: 2.1 time: 0.788966 Aug 31 15:55:56.758091 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 19/39] 10.222.0.61 () {60 vars in 1197 bytes} [Wed Aug 31 15:55:55 2022] POST /compute/v2.1/flavors/450896847/action => generated 96 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 15:55:56.771211 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-da55f2dd-7bc9-4711-9140-06a25d68d61f tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:56.843310 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-da55f2dd-7bc9-4711-9140-06a25d68d61f tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] 10.222.0.61 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.086106 Aug 31 15:55:56.867745 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 20/40] 10.222.0.61 () {58 vars in 1152 bytes} [Wed Aug 31 15:55:56 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 31 15:55:56.886197 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8ec0e228-e4ac-4c76-a0de-578ebc36be62 tempest-FlavorsAccessNegativeTestJSON-51119877 tempest-FlavorsAccessNegativeTestJSON-51119877-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "98fd39a94454468792a9e1ef60fe9337"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:55:57.726435 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-8ec0e228-e4ac-4c76-a0de-578ebc36be62 tempest-FlavorsAccessNegativeTestJSON-51119877 tempest-FlavorsAccessNegativeTestJSON-51119877-project-admin] HTTP exception thrown: Flavor access already exists for flavor 17 and project 98fd39a94454468792a9e1ef60fe9337 combination. Aug 31 15:55:57.751169 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8ec0e228-e4ac-4c76-a0de-578ebc36be62 tempest-FlavorsAccessNegativeTestJSON-51119877 tempest-FlavorsAccessNegativeTestJSON-51119877-project-admin] Request method failure captured: Aug 31 15:55:57.751169 n-d-850499-9 devstack@n-api.service[122256]: request: POST /compute/v2.1/flavors/450896847/action HTTP/1.1 Aug 31 15:55:57.751169 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 15:55:57.751169 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 15:55:57.751169 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 15:55:57.751169 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 67 Aug 31 15:55:57.751169 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 15:55:57.751169 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 15:55:57.751169 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 15:55:57.751169 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 15:55:57.751169 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4SISwCtbuPhw8ws1oP1nxWWwUFe5VZNH26xM3jn-_t98M1GBTg5TwuxccfhxZT27sIaEEWPPDgDKdttZ-zAd6WEUHBx4y3PwYYPdJ4MVzShurElCKU9sQddiCQHoNWd1_2xNE8rv8PcArXxmdFK4ZgQsgU_qQ8Wz45Bwpjhhq3Wm-Y Aug 31 15:55:57.751169 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 15:55:57.751169 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 15:55:57.751169 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 15:55:57.751169 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 15:55:57.751169 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 15:55:57.751169 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 15:55:57.751169 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 4edc3cab8a66460b938ba19068e2e800 Aug 31 15:55:57.751169 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-51119877 Aug 31 15:55:57.751169 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,admin,member Aug 31 15:55:57.751169 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,admin,member Aug 31 15:55:57.752542 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4edc3cab8a66460b938ba19068e2e800"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/4edc3cab8a66460b938ba19068e2e800"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_4edc3cab8a66460b938ba19068e2e800", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4edc3cab8a66460b938ba19068e2e800"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 15:55:57.752542 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-51119877 Aug 31 15:55:57.752542 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 4edc3cab8a66460b938ba19068e2e800 Aug 31 15:55:57.752542 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-51119877 Aug 31 15:55:57.752542 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-FlavorsAccessNegativeTestJSON-51119877-project-admin Aug 31 15:55:57.752542 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 15:55:57.752542 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 15:55:57.752542 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: ecb7a8e9e16848a9a6fad26e5e56c223 Aug 31 15:55:57.752542 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-51119877-project-admin Aug 31 15:55:57.752542 n-d-850499-9 devstack@n-api.service[122256]: Aug 31 15:55:57.752542 n-d-850499-9 devstack@n-api.service[122256]: {"addTenantAccess": {"tenant": "98fd39a94454468792a9e1ef60fe9337"}} Aug 31 15:55:57.752542 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 15:55:57.753433 n-d-850499-9 devstack@n-api.service[122256]: exception: Flavor access already exists for flavor 17 and project 98fd39a94454468792a9e1ef60fe9337 combination. Aug 31 15:55:57.753433 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '450896847', 'body': {'addTenantAccess': {'tenant': '98fd39a94454468792a9e1ef60fe9337'}}} Aug 31 15:55:57.753433 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:55:57.753433 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:55:57.753433 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 15:55:57.753433 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 31 15:55:57.753433 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 15:55:57.753433 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 31 15:55:57.753433 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 15:55:57.753433 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 31 15:55:57.753433 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 15:55:57.753433 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 31 15:55:57.753433 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 15:55:57.753433 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 15:55:57.753433 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 15:55:57.753433 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi result.read() Aug 31 15:55:57.753433 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 15:55:57.753433 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 31 15:55:57.754428 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 15:55:57.754428 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 31 15:55:57.754428 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 15:55:57.754428 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 31 15:55:57.754428 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 15:55:57.754428 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 31 15:55:57.754428 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '17-98fd39a94454468792a9e1ef60fe9337' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Aug 31 15:55:57.754428 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:55:57.754428 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 31 15:55:57.754428 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:55:57.754428 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:55:57.754428 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Aug 31 15:55:57.754428 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi project.save(context.session) Aug 31 15:55:57.754428 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 31 15:55:57.754428 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi session.flush() Aug 31 15:55:57.754428 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 31 15:55:57.754428 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 31 15:55:57.754428 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 31 15:55:57.754428 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 31 15:55:57.756323 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 31 15:55:57.756323 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 31 15:55:57.756323 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 15:55:57.756323 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception Aug 31 15:55:57.756323 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 31 15:55:57.756323 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 31 15:55:57.756323 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 31 15:55:57.756323 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 31 15:55:57.756323 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 31 15:55:57.756323 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 31 15:55:57.756323 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 31 15:55:57.756323 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 31 15:55:57.756323 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 31 15:55:57.756323 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 31 15:55:57.756323 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 31 15:55:57.756323 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 31 15:55:57.756323 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 31 15:55:57.756323 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 31 15:55:57.758496 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 31 15:55:57.758496 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 31 15:55:57.758496 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 31 15:55:57.758496 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 31 15:55:57.758496 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 31 15:55:57.758496 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 31 15:55:57.758496 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 15:55:57.758496 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception Aug 31 15:55:57.758496 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 15:55:57.758496 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 31 15:55:57.758496 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 15:55:57.758496 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 31 15:55:57.758496 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 15:55:57.758496 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 31 15:55:57.758496 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 15:55:57.758496 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 31 15:55:57.758496 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 15:55:57.758496 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 15:55:57.759947 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 15:55:57.759947 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi result.read() Aug 31 15:55:57.759947 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 15:55:57.759947 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 31 15:55:57.759947 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 15:55:57.759947 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 31 15:55:57.759947 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 15:55:57.759947 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 31 15:55:57.759947 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 15:55:57.759947 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 31 15:55:57.759947 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '17-98fd39a94454468792a9e1ef60fe9337' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Aug 31 15:55:57.759947 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Aug 31 15:55:57.759947 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 31, 15, 55, 57, 720128), 'updated_at': None, 'flavor_id': 17, 'project_id': '98fd39a94454468792a9e1ef60fe9337'}] Aug 31 15:55:57.759947 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 31 15:55:57.759947 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:55:57.759947 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:55:57.759947 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:55:57.760923 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:55:57.760923 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Aug 31 15:55:57.760923 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Aug 31 15:55:57.760923 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 31 15:55:57.760923 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 31 15:55:57.760923 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Aug 31 15:55:57.760923 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Aug 31 15:55:57.760923 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Aug 31 15:55:57.760923 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Aug 31 15:55:57.760923 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Aug 31 15:55:57.760923 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Aug 31 15:55:57.760923 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 31 15:55:57.760923 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 31 15:55:57.760923 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Aug 31 15:55:57.760923 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Aug 31 15:55:57.760923 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 17 and project 98fd39a94454468792a9e1ef60fe9337 combination. Aug 31 15:55:57.760923 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:55:57.760923 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:55:57.760923 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:55:57.764086 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:55:57.764086 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:55:57.764086 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:55:57.764086 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:55:57.764086 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:55:57.764086 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:55:57.764086 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:55:57.764086 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:55:57.764086 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:55:57.764086 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Aug 31 15:55:57.764086 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Aug 31 15:55:57.764086 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 17 and project 98fd39a94454468792a9e1ef60fe9337 combination. Aug 31 15:55:57.764086 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:55:57.764086 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:55:57.764086 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:55:57.764086 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:55:57.764086 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:55:57.764086 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:55:57.764086 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:55:57.764086 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:55:57.765933 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 17 and project 98fd39a94454468792a9e1ef60fe9337 combination. Aug 31 15:55:57.765933 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:55:57.769131 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8ec0e228-e4ac-4c76-a0de-578ebc36be62 tempest-FlavorsAccessNegativeTestJSON-51119877 tempest-FlavorsAccessNegativeTestJSON-51119877-project-admin] Returning 409 to user: Flavor access already exists for flavor 17 and project 98fd39a94454468792a9e1ef60fe9337 combination. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:55:57.770050 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8ec0e228-e4ac-4c76-a0de-578ebc36be62 tempest-FlavorsAccessNegativeTestJSON-51119877 tempest-FlavorsAccessNegativeTestJSON-51119877-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors/450896847/action" status: 409 len: 152 microversion: 2.1 time: 0.900422 Aug 31 15:55:57.771763 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 21/41] 10.222.0.61 () {60 vars in 1197 bytes} [Wed Aug 31 15:55:56 2022] POST /compute/v2.1/flavors/450896847/action => generated 152 bytes in 903 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 31 15:55:57.780292 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-043ebc5a-ae4c-47a4-99f5-76c3cebddd5c tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1117382871"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:55:57.786673 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.aggregate [None req-043ebc5a-ae4c-47a4-99f5-76c3cebddd5c tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] Generated uuid d1774a6d-e767-478f-a4c9-2284612c452b for aggregate {{(pid=122256) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 31 15:55:57.817698 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-043ebc5a-ae4c-47a4-99f5-76c3cebddd5c tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.044807 Aug 31 15:55:57.818297 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 22/42] 10.222.0.61 () {60 vars in 1164 bytes} [Wed Aug 31 15:55:57 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:55:57.848408 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f40fc7bf-ec38-44a2-8a2f-fcc2c3e6954f tempest-FlavorsAccessNegativeTestJSON-51119877 tempest-FlavorsAccessNegativeTestJSON-51119877-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "98fd39a94454468792a9e1ef60fe9337"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:55:58.615911 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c20ba3bf-0eba-4159-88fb-ba07bebd9166 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 313 microversion: 2.1 time: 2.572399 Aug 31 15:55:58.629697 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 21/43] 10.222.0.61 () {60 vars in 1191 bytes} [Wed Aug 31 15:55:56 2022] POST /compute/v2.1/os-aggregates/4/action => generated 313 bytes in 2575 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:55:58.629697 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8ceeaec0-883d-4464-8a0c-4fd847231fef tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-1988223393"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:55:58.642019 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8ceeaec0-883d-4464-8a0c-4fd847231fef tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:58.644245 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8ceeaec0-883d-4464-8a0c-4fd847231fef tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:58.644783 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8ceeaec0-883d-4464-8a0c-4fd847231fef tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:58.658537 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8ceeaec0-883d-4464-8a0c-4fd847231fef tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:58.659121 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8ceeaec0-883d-4464-8a0c-4fd847231fef tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:58.660073 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8ceeaec0-883d-4464-8a0c-4fd847231fef tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:58.670077 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-8ceeaec0-883d-4464-8a0c-4fd847231fef tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-1988223393 could not be found. Aug 31 15:55:58.674311 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8ceeaec0-883d-4464-8a0c-4fd847231fef tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] Request method failure captured: Aug 31 15:55:58.674311 n-d-850499-9 devstack@n-api.service[122257]: request: POST /compute/v2.1/os-aggregates/5/action HTTP/1.1 Aug 31 15:55:58.674311 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 15:55:58.674311 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 15:55:58.674311 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 15:55:58.674311 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 58 Aug 31 15:55:58.674311 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 15:55:58.674311 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 15:55:58.674311 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 15:55:58.674311 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 15:55:58.674311 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4SGQIQoHeMzleKeuN86FNKPcC70EDN3vvnbv5OP60F3GKzilNbO986Ebl4P9Ns_7fZw90Bs5FqY4IJ9jx1mntbxztRbT4O47wiLT9GZ_VsOGsx0hBsPT0oayVTcpf-y2h3Escl2kyQTF-POOAwUJKtU9TWiek0xftsoY-gAipBE-sE Aug 31 15:55:58.674311 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 15:55:58.674311 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 15:55:58.674311 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 15:55:58.674311 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 15:55:58.674311 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 15:55:58.674311 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 15:55:58.674311 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 7bbe02d5716d48d9bcff3357923a7933 Aug 31 15:55:58.674311 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1569510051 Aug 31 15:55:58.674311 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,admin,member Aug 31 15:55:58.674311 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,admin,member Aug 31 15:55:58.675730 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7bbe02d5716d48d9bcff3357923a7933"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7bbe02d5716d48d9bcff3357923a7933"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7bbe02d5716d48d9bcff3357923a7933", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7bbe02d5716d48d9bcff3357923a7933"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 15:55:58.675730 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1569510051 Aug 31 15:55:58.675730 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 7bbe02d5716d48d9bcff3357923a7933 Aug 31 15:55:58.675730 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1569510051 Aug 31 15:55:58.675730 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin Aug 31 15:55:58.675730 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 15:55:58.675730 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 15:55:58.675730 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: b8ab15c6ae7049e68e5bd2f1a0a709b4 Aug 31 15:55:58.675730 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin Aug 31 15:55:58.675730 n-d-850499-9 devstack@n-api.service[122257]: Aug 31 15:55:58.675730 n-d-850499-9 devstack@n-api.service[122257]: {"add_host": {"host": "tempest-nonexist_host-1988223393"}} Aug 31 15:55:58.675730 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 15:55:58.676314 n-d-850499-9 devstack@n-api.service[122257]: exception: Compute host tempest-nonexist_host-1988223393 could not be found. Aug 31 15:55:58.676314 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '5', 'body': {'add_host': {'host': 'tempest-nonexist_host-1988223393'}}} Aug 31 15:55:58.676314 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:55:58.676314 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:55:58.676314 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5997, in _get_service_in_cell_by_host Aug 31 15:55:58.676314 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 31 15:55:58.676314 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 15:55:58.676314 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 15:55:58.676314 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 31 15:55:58.676314 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 31 15:55:58.676314 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 31 15:55:58.676314 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 31 15:55:58.676314 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 31 15:55:58.676314 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 31 15:55:58.676314 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-1988223393' is not mapped to any cell Aug 31 15:55:58.676314 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:55:58.676314 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:55:58.676314 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:55:58.676314 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:55:58.676314 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6003, in _get_service_in_cell_by_host Aug 31 15:55:58.677611 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Aug 31 15:55:58.677611 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6065, in _find_service_in_cell Aug 31 15:55:58.677611 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 31 15:55:58.677611 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 31 15:55:58.677611 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:55:58.677611 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:55:58.677611 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:55:58.677611 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:55:58.677611 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Aug 31 15:55:58.677611 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Aug 31 15:55:58.677611 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 31 15:55:58.677611 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 31 15:55:58.677611 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 15:55:58.677611 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 31 15:55:58.677611 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 15:55:58.677611 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise self.value Aug 31 15:55:58.677611 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 31 15:55:58.677611 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 31 15:55:58.677611 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6619, in add_host_to_aggregate Aug 31 15:55:58.677611 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Aug 31 15:55:58.678799 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Aug 31 15:55:58.678799 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Aug 31 15:55:58.678799 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-1988223393 could not be found. Aug 31 15:55:58.678799 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:55:58.678799 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:55:58.678799 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:55:58.678799 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:55:58.678799 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:55:58.678799 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:55:58.678799 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:55:58.678799 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:55:58.678799 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:55:58.678799 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:55:58.678799 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:55:58.678799 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:55:58.678799 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Aug 31 15:55:58.678799 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:55:58.678799 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-1988223393 could not be found. Aug 31 15:55:58.678799 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:55:58.678799 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:55:58.678799 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:55:58.680212 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:55:58.680212 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:55:58.680212 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:55:58.680212 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:55:58.680212 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:55:58.680212 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-1988223393 could not be found. Aug 31 15:55:58.680212 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:55:58.680212 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8ceeaec0-883d-4464-8a0c-4fd847231fef tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-1988223393 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:55:58.680212 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8ceeaec0-883d-4464-8a0c-4fd847231fef tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates/5/action" status: 404 len: 111 microversion: 2.1 time: 0.057544 Aug 31 15:55:58.680212 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 22/44] 10.222.0.61 () {60 vars in 1191 bytes} [Wed Aug 31 15:55:58 2022] POST /compute/v2.1/os-aggregates/5/action => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:55:58.686656 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e9b0f3ec-e51f-4d44-8f38-83400a592ceb tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:58.713955 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e9b0f3ec-e51f-4d44-8f38-83400a592ceb tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] 10.222.0.61 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.032097 Aug 31 15:55:58.714865 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 23/45] 10.222.0.61 () {58 vars in 1152 bytes} [Wed Aug 31 15:55:58 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 31 15:55:58.726329 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-302dd90a-2364-47d1-b762-d18e2d51678d tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:55:58.734923 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-302dd90a-2364-47d1-b762-d18e2d51678d tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] Request method failure captured: Aug 31 15:55:58.734923 n-d-850499-9 devstack@n-api.service[122257]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 31 15:55:58.734923 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 15:55:58.734923 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 15:55:58.734923 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 15:55:58.734923 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 283 Aug 31 15:55:58.734923 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 15:55:58.734923 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 15:55:58.734923 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 15:55:58.734923 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 15:55:58.734923 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4SGQIQoHeMzleKeuN86FNKPcC70EDN3vvnbv5OP60F3GKzilNbO986Ebl4P9Ns_7fZw90Bs5FqY4IJ9jx1mntbxztRbT4O47wiLT9GZ_VsOGsx0hBsPT0oayVTcpf-y2h3Escl2kyQTF-POOAwUJKtU9TWiek0xftsoY-gAipBE-sE Aug 31 15:55:58.734923 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 15:55:58.734923 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 15:55:58.734923 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 15:55:58.734923 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 15:55:58.734923 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 15:55:58.734923 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 15:55:58.734923 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 7bbe02d5716d48d9bcff3357923a7933 Aug 31 15:55:58.734923 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1569510051 Aug 31 15:55:58.734923 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,admin,member Aug 31 15:55:58.734923 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,admin,member Aug 31 15:55:58.736213 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7bbe02d5716d48d9bcff3357923a7933"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7bbe02d5716d48d9bcff3357923a7933"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7bbe02d5716d48d9bcff3357923a7933", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7bbe02d5716d48d9bcff3357923a7933"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 15:55:58.736213 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1569510051 Aug 31 15:55:58.736213 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 7bbe02d5716d48d9bcff3357923a7933 Aug 31 15:55:58.736213 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1569510051 Aug 31 15:55:58.736213 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin Aug 31 15:55:58.736213 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 15:55:58.736213 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 15:55:58.736213 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: b8ab15c6ae7049e68e5bd2f1a0a709b4 Aug 31 15:55:58.736213 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin Aug 31 15:55:58.736213 n-d-850499-9 devstack@n-api.service[122257]: Aug 31 15:55:58.736696 n-d-850499-9 devstack@n-api.service[122257]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 31 15:55:58.736696 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 15:55:58.736696 n-d-850499-9 devstack@n-api.service[122257]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 31 15:55:58.736696 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 31 15:55:58.736696 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:55:58.736696 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:55:58.736696 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 15:55:58.736696 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 15:55:58.736696 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 15:55:58.736696 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise error Aug 31 15:55:58.737188 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 31 15:55:58.737188 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:55:58.737188 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Aug 31 15:55:58.737188 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 31 15:55:58.737188 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:55:58.737188 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Aug 31 15:55:58.737188 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 31 15:55:58.737188 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:55:58.737188 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:55:58.737188 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:55:58.737188 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:55:58.737188 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:55:58.737188 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:55:58.737188 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:55:58.737188 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:55:58.737188 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:55:58.737188 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:55:58.738670 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:55:58.738670 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:55:58.738670 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 15:55:58.738670 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 15:55:58.738670 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 15:55:58.738670 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 15:55:58.738670 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 15:55:58.738670 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 15:55:58.738670 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 31 15:55:58.738670 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:55:58.738670 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:55:58.738670 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:55:58.738670 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:55:58.738670 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:55:58.738670 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:55:58.739567 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 15:55:58.739567 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 15:55:58.739567 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 31 15:55:58.739567 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:55:58.739567 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-302dd90a-2364-47d1-b762-d18e2d51678d tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:55:58.739903 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-302dd90a-2364-47d1-b762-d18e2d51678d tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.014018 Aug 31 15:55:58.739903 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 24/46] 10.222.0.61 () {60 vars in 1165 bytes} [Wed Aug 31 15:55:58 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 15:55:58.746224 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4dff6588-2d90-48fb-b68a-b990782feb58 tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:55:58.750265 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4dff6588-2d90-48fb-b68a-b990782feb58 tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] Request method failure captured: Aug 31 15:55:58.750265 n-d-850499-9 devstack@n-api.service[122257]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 31 15:55:58.750265 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 15:55:58.750265 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 15:55:58.750265 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 15:55:58.750265 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 27 Aug 31 15:55:58.750265 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 15:55:58.750265 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 15:55:58.750265 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 15:55:58.750265 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 15:55:58.750265 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4SGQIQoHeMzleKeuN86FNKPcC70EDN3vvnbv5OP60F3GKzilNbO986Ebl4P9Ns_7fZw90Bs5FqY4IJ9jx1mntbxztRbT4O47wiLT9GZ_VsOGsx0hBsPT0oayVTcpf-y2h3Escl2kyQTF-POOAwUJKtU9TWiek0xftsoY-gAipBE-sE Aug 31 15:55:58.750265 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 15:55:58.750265 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 15:55:58.750265 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 15:55:58.750265 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 15:55:58.750265 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 15:55:58.750265 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 15:55:58.750265 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 7bbe02d5716d48d9bcff3357923a7933 Aug 31 15:55:58.750265 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1569510051 Aug 31 15:55:58.750265 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,admin,member Aug 31 15:55:58.750265 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,admin,member Aug 31 15:55:58.751708 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7bbe02d5716d48d9bcff3357923a7933"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7bbe02d5716d48d9bcff3357923a7933"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7bbe02d5716d48d9bcff3357923a7933", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7bbe02d5716d48d9bcff3357923a7933"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 15:55:58.751708 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1569510051 Aug 31 15:55:58.751708 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 7bbe02d5716d48d9bcff3357923a7933 Aug 31 15:55:58.751708 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1569510051 Aug 31 15:55:58.751708 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin Aug 31 15:55:58.751708 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 15:55:58.751708 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 15:55:58.751708 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: b8ab15c6ae7049e68e5bd2f1a0a709b4 Aug 31 15:55:58.751708 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin Aug 31 15:55:58.751708 n-d-850499-9 devstack@n-api.service[122257]: Aug 31 15:55:58.751708 n-d-850499-9 devstack@n-api.service[122257]: {"aggregate": {"name": ""}} Aug 31 15:55:58.751708 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 15:55:58.751708 n-d-850499-9 devstack@n-api.service[122257]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 31 15:55:58.752354 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'body': {'aggregate': {'name': ''}}} Aug 31 15:55:58.752354 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:55:58.752354 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:55:58.752354 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 15:55:58.752354 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 15:55:58.752354 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 15:55:58.752354 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise error Aug 31 15:55:58.752354 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 31 15:55:58.752354 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:55:58.752354 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Aug 31 15:55:58.752354 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 31 15:55:58.752354 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:55:58.752354 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Aug 31 15:55:58.752354 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi '' Aug 31 15:55:58.752354 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:55:58.752354 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:55:58.752354 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:55:58.752354 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:55:58.752354 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:55:58.752354 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:55:58.752354 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:55:58.752354 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:55:58.752354 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:55:58.753472 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:55:58.753472 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:55:58.753472 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:55:58.753472 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 15:55:58.753472 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 15:55:58.753472 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 15:55:58.753472 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 15:55:58.753472 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 15:55:58.753472 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 15:55:58.753472 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 31 15:55:58.753472 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:55:58.753472 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:55:58.753472 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:55:58.753472 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:55:58.753472 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:55:58.753472 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:55:58.753472 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 15:55:58.753472 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 15:55:58.753472 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 31 15:55:58.753472 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:55:58.754750 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4dff6588-2d90-48fb-b68a-b990782feb58 tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:55:58.754750 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4dff6588-2d90-48fb-b68a-b990782feb58 tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.009457 Aug 31 15:55:58.756406 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 25/47] 10.222.0.61 () {60 vars in 1164 bytes} [Wed Aug 31 15:55:58 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 15:55:58.762923 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3f6f2005-5ae3-406e-bf67-23de1e075045 tempest-AggregatesAdminNegativeTestJSON-148728318 tempest-AggregatesAdminNegativeTestJSON-148728318-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-830185016"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:55:58.785529 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3f6f2005-5ae3-406e-bf67-23de1e075045 tempest-AggregatesAdminNegativeTestJSON-148728318 tempest-AggregatesAdminNegativeTestJSON-148728318-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '7be97b44590b40ccaee241d020cfd674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f9a9a381df493d9963697f8e6f4b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:58.798359 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3f6f2005-5ae3-406e-bf67-23de1e075045 tempest-AggregatesAdminNegativeTestJSON-148728318 tempest-AggregatesAdminNegativeTestJSON-148728318-project] Request method failure captured: Aug 31 15:55:58.798359 n-d-850499-9 devstack@n-api.service[122257]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 31 15:55:58.798359 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 15:55:58.798359 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 15:55:58.798359 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 15:55:58.798359 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 59 Aug 31 15:55:58.798359 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 15:55:58.798359 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 15:55:58.798359 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 15:55:58.798359 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 15:55:58.798359 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4SCylM4XlpqpHr7br_SNtINz4kKLsmoxZFU3yRQqIUaF5qH9TxqaBPIeqf9ekYJ7E0Mzhf8YAs3u2Z4Me-JhE-FBwxcq4Z4T3e_6qmZ311AsdkpeBRMvRJcA647S3Chjq-8kSCbOj0mRLKOX_gZtA7_5RwYQZ-k6ogyns7nGw2XTx4 Aug 31 15:55:58.798359 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 15:55:58.798359 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 15:55:58.798359 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 15:55:58.798359 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 15:55:58.798359 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 15:55:58.798359 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 15:55:58.798359 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 28f9a9a381df493d9963697f8e6f4b8f Aug 31 15:55:58.798359 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-148728318 Aug 31 15:55:58.798359 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 15:55:58.798359 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 15:55:58.799467 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/28f9a9a381df493d9963697f8e6f4b8f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/28f9a9a381df493d9963697f8e6f4b8f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_28f9a9a381df493d9963697f8e6f4b8f", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/28f9a9a381df493d9963697f8e6f4b8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 15:55:58.799467 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-148728318 Aug 31 15:55:58.799467 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 28f9a9a381df493d9963697f8e6f4b8f Aug 31 15:55:58.799467 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-148728318 Aug 31 15:55:58.799467 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-AggregatesAdminNegativeTestJSON-148728318-project Aug 31 15:55:58.799467 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 15:55:58.799467 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 15:55:58.799467 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 7be97b44590b40ccaee241d020cfd674 Aug 31 15:55:58.799467 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-148728318-project Aug 31 15:55:58.799467 n-d-850499-9 devstack@n-api.service[122257]: Aug 31 15:55:58.799467 n-d-850499-9 devstack@n-api.service[122257]: {"aggregate": {"name": "tempest-test_aggregate-830185016"}} Aug 31 15:55:58.799467 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 15:55:58.799467 n-d-850499-9 devstack@n-api.service[122257]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 31 15:55:58.800203 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-830185016'}}} Aug 31 15:55:58.800203 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:55:58.800203 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:55:58.800203 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:55:58.800203 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:55:58.800203 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:55:58.800203 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:55:58.800203 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:55:58.800203 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:55:58.800203 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:55:58.800203 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:55:58.800203 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:55:58.800203 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:55:58.800203 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Aug 31 15:55:58.800203 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Aug 31 15:55:58.800203 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 31 15:55:58.800203 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 31 15:55:58.800203 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 31 15:55:58.800203 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 31 15:55:58.801142 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 15:55:58.801142 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 31 15:55:58.801142 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 15:55:58.801142 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise self.value Aug 31 15:55:58.801142 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 31 15:55:58.801142 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 31 15:55:58.801142 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 31 15:55:58.801142 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 31 15:55:58.801142 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 31 15:55:58.801142 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 31 15:55:58.801142 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 31 15:55:58.801142 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:55:58.801142 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:55:58.801142 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:55:58.801142 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:55:58.801142 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:55:58.801142 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:55:58.801142 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 31 15:55:58.801142 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 31 15:55:58.801142 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 31 15:55:58.802101 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:55:58.804283 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3f6f2005-5ae3-406e-bf67-23de1e075045 tempest-AggregatesAdminNegativeTestJSON-148728318 tempest-AggregatesAdminNegativeTestJSON-148728318-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:55:58.805988 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3f6f2005-5ae3-406e-bf67-23de1e075045 tempest-AggregatesAdminNegativeTestJSON-148728318 tempest-AggregatesAdminNegativeTestJSON-148728318-project] 10.222.0.61 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.047290 Aug 31 15:55:58.809631 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 26/48] 10.222.0.61 () {60 vars in 1164 bytes} [Wed Aug 31 15:55:58 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 51 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 31 15:55:58.836600 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d5d30459-3a49-4bd5-83f1-1c1b4d0e9eba tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2122138624"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:55:58.847790 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.aggregate [None req-d5d30459-3a49-4bd5-83f1-1c1b4d0e9eba tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] Generated uuid e23da447-bc90-48af-b17d-0330d04c851d for aggregate {{(pid=122257) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 31 15:55:58.898776 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d5d30459-3a49-4bd5-83f1-1c1b4d0e9eba tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.082653 Aug 31 15:55:58.900290 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 27/49] 10.222.0.61 () {60 vars in 1164 bytes} [Wed Aug 31 15:55:58 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:55:58.933774 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-edbd0130-c9ef-4c83-b42e-df6c5d21202c tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2122138624"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:55:58.950101 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.aggregate [None req-edbd0130-c9ef-4c83-b42e-df6c5d21202c tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] Generated uuid d8aa1d98-6dc0-4eeb-b5cf-e9938eb14ff1 for aggregate {{(pid=122257) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 31 15:55:58.980796 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-edbd0130-c9ef-4c83-b42e-df6c5d21202c tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-2122138624 already exists. Aug 31 15:55:58.989636 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-edbd0130-c9ef-4c83-b42e-df6c5d21202c tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] Request method failure captured: Aug 31 15:55:58.989636 n-d-850499-9 devstack@n-api.service[122257]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 31 15:55:58.989636 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 15:55:58.989636 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 15:55:58.989636 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 15:55:58.989636 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 60 Aug 31 15:55:58.989636 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 15:55:58.989636 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 15:55:58.989636 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 15:55:58.989636 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 15:55:58.989636 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4SGQIQoHeMzleKeuN86FNKPcC70EDN3vvnbv5OP60F3GKzilNbO986Ebl4P9Ns_7fZw90Bs5FqY4IJ9jx1mntbxztRbT4O47wiLT9GZ_VsOGsx0hBsPT0oayVTcpf-y2h3Escl2kyQTF-POOAwUJKtU9TWiek0xftsoY-gAipBE-sE Aug 31 15:55:58.989636 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 15:55:58.989636 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 15:55:58.989636 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 15:55:58.989636 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 15:55:58.989636 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 15:55:58.989636 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 15:55:58.989636 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 7bbe02d5716d48d9bcff3357923a7933 Aug 31 15:55:58.989636 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1569510051 Aug 31 15:55:58.989636 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,admin,member Aug 31 15:55:58.989636 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,admin,member Aug 31 15:55:58.991016 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7bbe02d5716d48d9bcff3357923a7933"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7bbe02d5716d48d9bcff3357923a7933"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7bbe02d5716d48d9bcff3357923a7933", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7bbe02d5716d48d9bcff3357923a7933"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 15:55:58.991016 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1569510051 Aug 31 15:55:58.991016 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 7bbe02d5716d48d9bcff3357923a7933 Aug 31 15:55:58.991016 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1569510051 Aug 31 15:55:58.991016 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin Aug 31 15:55:58.991016 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 15:55:58.991016 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 15:55:58.991016 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: b8ab15c6ae7049e68e5bd2f1a0a709b4 Aug 31 15:55:58.991016 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin Aug 31 15:55:58.991016 n-d-850499-9 devstack@n-api.service[122257]: Aug 31 15:55:58.991016 n-d-850499-9 devstack@n-api.service[122257]: {"aggregate": {"name": "tempest-test_aggregate-2122138624"}} Aug 31 15:55:58.991016 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 15:55:58.991016 n-d-850499-9 devstack@n-api.service[122257]: exception: Aggregate tempest-test_aggregate-2122138624 already exists. Aug 31 15:55:58.991813 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-2122138624'}}} Aug 31 15:55:58.991813 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:55:58.991813 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:55:58.991813 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Aug 31 15:55:58.991813 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Aug 31 15:55:58.991813 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 31 15:55:58.991813 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 31 15:55:58.991813 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 15:55:58.991813 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 31 15:55:58.991813 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 15:55:58.991813 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise self.value Aug 31 15:55:58.991813 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 31 15:55:58.991813 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 31 15:55:58.991813 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6456, in create_aggregate Aug 31 15:55:58.991813 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi aggregate.create() Aug 31 15:55:58.991813 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 31 15:55:58.991813 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 31 15:55:58.991813 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Aug 31 15:55:58.991813 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Aug 31 15:55:58.992949 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 31 15:55:58.992949 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 31 15:55:58.992949 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Aug 31 15:55:58.992949 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Aug 31 15:55:58.992949 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-2122138624 already exists. Aug 31 15:55:58.992949 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:55:58.992949 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:55:58.992949 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:55:58.992949 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:55:58.992949 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:55:58.992949 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:55:58.992949 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:55:58.992949 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:55:58.992949 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:55:58.992949 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:55:58.992949 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:55:58.992949 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:55:58.992949 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:55:58.992949 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:55:58.992949 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Aug 31 15:55:58.994158 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Aug 31 15:55:58.994158 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-2122138624 already exists. Aug 31 15:55:58.994158 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:55:58.994158 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:55:58.994158 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:55:58.994158 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:55:58.994158 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:55:58.994158 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:55:58.994158 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:55:58.994158 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:55:58.994158 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-2122138624 already exists. Aug 31 15:55:58.994158 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:55:58.995945 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-edbd0130-c9ef-4c83-b42e-df6c5d21202c tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-2122138624 already exists. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:55:58.998484 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-edbd0130-c9ef-4c83-b42e-df6c5d21202c tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.089683 Aug 31 15:55:59.001447 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 28/50] 10.222.0.61 () {60 vars in 1164 bytes} [Wed Aug 31 15:55:58 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 93 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 31 15:55:59.015997 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5a7d2b71-9b90-41a6-9662-71a5c3157026 tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:59.071895 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5a7d2b71-9b90-41a6-9662-71a5c3157026 tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] 10.222.0.61 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.067420 Aug 31 15:55:59.072695 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 29/51] 10.222.0.61 () {58 vars in 1152 bytes} [Wed Aug 31 15:55:59 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 31 15:55:59.086905 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-11aaedd2-8d37-432a-b03e-a8bca4a2f999 tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1764861750"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:55:59.097231 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.aggregate [None req-11aaedd2-8d37-432a-b03e-a8bca4a2f999 tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] Generated uuid 41131447-cae4-477c-ae8f-75afe28fbb23 for aggregate {{(pid=122257) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 31 15:55:59.153518 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-11aaedd2-8d37-432a-b03e-a8bca4a2f999 tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.071653 Aug 31 15:55:59.162093 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 30/52] 10.222.0.61 () {60 vars in 1164 bytes} [Wed Aug 31 15:55:59 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:55:59.176555 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2dcdc0c8-5941-45d6-b3f7-efbea5ef9066 tempest-AggregatesAdminNegativeTestJSON-148728318 tempest-AggregatesAdminNegativeTestJSON-148728318-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:59.179544 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2dcdc0c8-5941-45d6-b3f7-efbea5ef9066 tempest-AggregatesAdminNegativeTestJSON-148728318 tempest-AggregatesAdminNegativeTestJSON-148728318-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '7be97b44590b40ccaee241d020cfd674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f9a9a381df493d9963697f8e6f4b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:59.182158 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2dcdc0c8-5941-45d6-b3f7-efbea5ef9066 tempest-AggregatesAdminNegativeTestJSON-148728318 tempest-AggregatesAdminNegativeTestJSON-148728318-project] Request method failure captured: Aug 31 15:55:59.182158 n-d-850499-9 devstack@n-api.service[122257]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Aug 31 15:55:59.182158 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 15:55:59.182158 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 15:55:59.182158 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 15:55:59.182158 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 15:55:59.182158 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 15:55:59.182158 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 15:55:59.182158 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 15:55:59.182158 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 15:55:59.182158 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4SCylM4XlpqpHr7br_SNtINz4kKLsmoxZFU3yRQqIUaF5qH9TxqaBPIeqf9ekYJ7E0Mzhf8YAs3u2Z4Me-JhE-FBwxcq4Z4T3e_6qmZ311AsdkpeBRMvRJcA647S3Chjq-8kSCbOj0mRLKOX_gZtA7_5RwYQZ-k6ogyns7nGw2XTx4 Aug 31 15:55:59.182158 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 15:55:59.182158 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 15:55:59.182158 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 15:55:59.182158 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 15:55:59.182158 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 15:55:59.182158 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 15:55:59.182158 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 28f9a9a381df493d9963697f8e6f4b8f Aug 31 15:55:59.182158 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-148728318 Aug 31 15:55:59.182158 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 15:55:59.182158 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 15:55:59.183487 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/28f9a9a381df493d9963697f8e6f4b8f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/28f9a9a381df493d9963697f8e6f4b8f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_28f9a9a381df493d9963697f8e6f4b8f", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/28f9a9a381df493d9963697f8e6f4b8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 15:55:59.183487 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-148728318 Aug 31 15:55:59.183487 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 28f9a9a381df493d9963697f8e6f4b8f Aug 31 15:55:59.183487 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-148728318 Aug 31 15:55:59.183487 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-AggregatesAdminNegativeTestJSON-148728318-project Aug 31 15:55:59.183487 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 15:55:59.183487 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 15:55:59.183487 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 7be97b44590b40ccaee241d020cfd674 Aug 31 15:55:59.183487 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-148728318-project Aug 31 15:55:59.183487 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 15:55:59.183487 n-d-850499-9 devstack@n-api.service[122257]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 31 15:55:59.183487 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '7'} Aug 31 15:55:59.184301 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:55:59.184301 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:55:59.184301 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:55:59.184301 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:55:59.184301 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:55:59.184301 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:55:59.184301 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:55:59.184301 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:55:59.184301 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Aug 31 15:55:59.184301 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Aug 31 15:55:59.184301 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 31 15:55:59.184301 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 31 15:55:59.184301 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 31 15:55:59.184301 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 31 15:55:59.184301 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 15:55:59.184301 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 31 15:55:59.184301 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 15:55:59.184301 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise self.value Aug 31 15:55:59.184301 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 31 15:55:59.187517 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 31 15:55:59.187517 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 31 15:55:59.187517 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 31 15:55:59.187517 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 31 15:55:59.187517 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 31 15:55:59.187517 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 31 15:55:59.187517 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:55:59.187517 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:55:59.187517 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:55:59.187517 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:55:59.187517 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:55:59.187517 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:55:59.187517 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 31 15:55:59.187517 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 31 15:55:59.187517 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 31 15:55:59.187517 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:55:59.190358 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2dcdc0c8-5941-45d6-b3f7-efbea5ef9066 tempest-AggregatesAdminNegativeTestJSON-148728318 tempest-AggregatesAdminNegativeTestJSON-148728318-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:55:59.192191 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2dcdc0c8-5941-45d6-b3f7-efbea5ef9066 tempest-AggregatesAdminNegativeTestJSON-148728318 tempest-AggregatesAdminNegativeTestJSON-148728318-project] 10.222.0.61 "DELETE /compute/v2.1/os-aggregates/7" status: 403 len: 116 microversion: 2.1 time: 0.027918 Aug 31 15:55:59.198019 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 31/53] 10.222.0.61 () {58 vars in 1152 bytes} [Wed Aug 31 15:55:59 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 116 bytes in 34 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:55:59.206711 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-af3f95b9-78e1-412d-85b5-56fd9f8a2d3c tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:59.244039 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-af3f95b9-78e1-412d-85b5-56fd9f8a2d3c tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] 10.222.0.61 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.042563 Aug 31 15:55:59.249979 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 32/54] 10.222.0.61 () {58 vars in 1152 bytes} [Wed Aug 31 15:55:59 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 31 15:55:59.257287 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b47bc6d9-f3d0-43b5-8dfc-59661f4549a9 tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:59.266844 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f40fc7bf-ec38-44a2-8a2f-fcc2c3e6954f tempest-FlavorsAccessNegativeTestJSON-51119877 tempest-FlavorsAccessNegativeTestJSON-51119877-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors/450896847/action" status: 200 len: 21 microversion: 2.1 time: 1.436336 Aug 31 15:55:59.268623 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 23/55] 10.222.0.61 () {60 vars in 1197 bytes} [Wed Aug 31 15:55:57 2022] POST /compute/v2.1/flavors/450896847/action => generated 21 bytes in 1450 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 15:55:59.278427 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-43fb70d8-d3f5-470e-bf20-6b404905b18e tempest-FlavorsAccessNegativeTestJSON-51119877 tempest-FlavorsAccessNegativeTestJSON-51119877-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:59.281236 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-b47bc6d9-f3d0-43b5-8dfc-59661f4549a9 tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Aug 31 15:55:59.289317 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b47bc6d9-f3d0-43b5-8dfc-59661f4549a9 tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] Request method failure captured: Aug 31 15:55:59.289317 n-d-850499-9 devstack@n-api.service[122257]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Aug 31 15:55:59.289317 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 15:55:59.289317 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 15:55:59.289317 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 15:55:59.289317 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 15:55:59.289317 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 15:55:59.289317 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 15:55:59.289317 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 15:55:59.289317 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 15:55:59.289317 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4SGQIQoHeMzleKeuN86FNKPcC70EDN3vvnbv5OP60F3GKzilNbO986Ebl4P9Ns_7fZw90Bs5FqY4IJ9jx1mntbxztRbT4O47wiLT9GZ_VsOGsx0hBsPT0oayVTcpf-y2h3Escl2kyQTF-POOAwUJKtU9TWiek0xftsoY-gAipBE-sE Aug 31 15:55:59.289317 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 15:55:59.289317 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 15:55:59.289317 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 15:55:59.289317 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 15:55:59.289317 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 15:55:59.289317 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 15:55:59.289317 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 7bbe02d5716d48d9bcff3357923a7933 Aug 31 15:55:59.289317 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1569510051 Aug 31 15:55:59.289317 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,admin,member Aug 31 15:55:59.289317 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,admin,member Aug 31 15:55:59.290436 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7bbe02d5716d48d9bcff3357923a7933"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7bbe02d5716d48d9bcff3357923a7933"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7bbe02d5716d48d9bcff3357923a7933", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7bbe02d5716d48d9bcff3357923a7933"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 15:55:59.290436 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1569510051 Aug 31 15:55:59.290436 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 7bbe02d5716d48d9bcff3357923a7933 Aug 31 15:55:59.290436 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1569510051 Aug 31 15:55:59.290436 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin Aug 31 15:55:59.290436 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 15:55:59.290436 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 15:55:59.290436 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: b8ab15c6ae7049e68e5bd2f1a0a709b4 Aug 31 15:55:59.290436 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin Aug 31 15:55:59.290436 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 15:55:59.290436 n-d-850499-9 devstack@n-api.service[122257]: exception: Aggregate -1 could not be found. Aug 31 15:55:59.290436 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '-1'} Aug 31 15:55:59.291027 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:55:59.291027 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:55:59.291027 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 31 15:55:59.291027 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 31 15:55:59.291027 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 31 15:55:59.291027 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 31 15:55:59.291027 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 15:55:59.291027 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 31 15:55:59.291027 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 15:55:59.291027 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise self.value Aug 31 15:55:59.291027 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 31 15:55:59.291027 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 31 15:55:59.291027 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6515, in delete_aggregate Aug 31 15:55:59.291027 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 31 15:55:59.291027 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 15:55:59.291027 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 15:55:59.291027 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 31 15:55:59.291027 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 31 15:55:59.291027 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 31 15:55:59.292236 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 31 15:55:59.292236 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 31 15:55:59.292236 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 31 15:55:59.292236 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Aug 31 15:55:59.292236 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:55:59.292236 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:55:59.292236 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:55:59.292236 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:55:59.292236 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:55:59.292236 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:55:59.292236 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:55:59.292236 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:55:59.292236 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:55:59.292236 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:55:59.292236 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 31 15:55:59.292236 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:55:59.292236 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Aug 31 15:55:59.292236 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:55:59.292236 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:55:59.292236 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:55:59.292236 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:55:59.293401 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:55:59.293401 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:55:59.293401 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:55:59.293401 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:55:59.293401 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Aug 31 15:55:59.293401 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:55:59.305832 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b47bc6d9-f3d0-43b5-8dfc-59661f4549a9 tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:55:59.306419 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b47bc6d9-f3d0-43b5-8dfc-59661f4549a9 tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] 10.222.0.61 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.055193 Aug 31 15:55:59.310579 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 33/56] 10.222.0.61 () {58 vars in 1155 bytes} [Wed Aug 31 15:55:59 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 31 15:55:59.327302 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0e79f90b-864a-4018-aa36-8e7fb392d2eb tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-481755488"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:55:59.330868 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.aggregate [None req-0e79f90b-864a-4018-aa36-8e7fb392d2eb tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] Generated uuid 3a02f5a5-7e0f-4304-a172-0ea0d513a1a6 for aggregate {{(pid=122257) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 31 15:55:59.358766 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-43fb70d8-d3f5-470e-bf20-6b404905b18e tempest-FlavorsAccessNegativeTestJSON-51119877 tempest-FlavorsAccessNegativeTestJSON-51119877-project-admin] 10.222.0.61 "DELETE /compute/v2.1/flavors/450896847" status: 202 len: 0 microversion: 2.1 time: 0.083378 Aug 31 15:55:59.360042 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 24/57] 10.222.0.61 () {58 vars in 1158 bytes} [Wed Aug 31 15:55:59 2022] DELETE /compute/v2.1/flavors/450896847 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 15:55:59.375664 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7240b880-57db-4ef1-b12d-1f597bf5b1e9 tempest-FlavorsAccessNegativeTestJSON-51119877 tempest-FlavorsAccessNegativeTestJSON-51119877-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:59.397400 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0e79f90b-864a-4018-aa36-8e7fb392d2eb tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.077397 Aug 31 15:55:59.408167 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 34/58] 10.222.0.61 () {60 vars in 1164 bytes} [Wed Aug 31 15:55:59 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:55:59.440251 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7240b880-57db-4ef1-b12d-1f597bf5b1e9 tempest-FlavorsAccessNegativeTestJSON-51119877 tempest-FlavorsAccessNegativeTestJSON-51119877-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.071958 Aug 31 15:55:59.441493 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 25/59] 10.222.0.61 () {58 vars in 1146 bytes} [Wed Aug 31 15:55:59 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:59.463944 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-48dfefcf-7c09-4719-a88d-b047bae37655 tempest-AggregatesAdminNegativeTestJSON-148728318 tempest-AggregatesAdminNegativeTestJSON-148728318-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:59.466128 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-48dfefcf-7c09-4719-a88d-b047bae37655 tempest-AggregatesAdminNegativeTestJSON-148728318 tempest-AggregatesAdminNegativeTestJSON-148728318-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '7be97b44590b40ccaee241d020cfd674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f9a9a381df493d9963697f8e6f4b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:59.470213 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-48dfefcf-7c09-4719-a88d-b047bae37655 tempest-AggregatesAdminNegativeTestJSON-148728318 tempest-AggregatesAdminNegativeTestJSON-148728318-project] Request method failure captured: Aug 31 15:55:59.470213 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/os-aggregates/8 HTTP/1.1 Aug 31 15:55:59.470213 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 15:55:59.470213 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 15:55:59.470213 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 15:55:59.470213 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 15:55:59.470213 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 15:55:59.470213 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 15:55:59.470213 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 15:55:59.470213 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 15:55:59.470213 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4SCylM4XlpqpHr7br_SNtINz4kKLsmoxZFU3yRQqIUaF5qH9TxqaBPIeqf9ekYJ7E0Mzhf8YAs3u2Z4Me-JhE-FBwxcq4Z4T3e_6qmZ311AsdkpeBRMvRJcA647S3Chjq-8kSCbOj0mRLKOX_gZtA7_5RwYQZ-k6ogyns7nGw2XTx4 Aug 31 15:55:59.470213 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 15:55:59.470213 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 15:55:59.470213 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 15:55:59.470213 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 15:55:59.470213 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 15:55:59.470213 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 15:55:59.470213 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 28f9a9a381df493d9963697f8e6f4b8f Aug 31 15:55:59.470213 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-148728318 Aug 31 15:55:59.470213 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 15:55:59.470213 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 15:55:59.471547 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/28f9a9a381df493d9963697f8e6f4b8f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/28f9a9a381df493d9963697f8e6f4b8f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_28f9a9a381df493d9963697f8e6f4b8f", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/28f9a9a381df493d9963697f8e6f4b8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 15:55:59.471547 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-148728318 Aug 31 15:55:59.471547 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 28f9a9a381df493d9963697f8e6f4b8f Aug 31 15:55:59.471547 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-148728318 Aug 31 15:55:59.471547 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-AggregatesAdminNegativeTestJSON-148728318-project Aug 31 15:55:59.471547 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 15:55:59.471547 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 15:55:59.471547 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 7be97b44590b40ccaee241d020cfd674 Aug 31 15:55:59.471547 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-148728318-project Aug 31 15:55:59.471547 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 15:55:59.471547 n-d-850499-9 devstack@n-api.service[122256]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 31 15:55:59.471547 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '8'} Aug 31 15:55:59.472254 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:55:59.472254 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:55:59.472254 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:55:59.472254 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:55:59.472254 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:55:59.472254 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:55:59.472254 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:55:59.472254 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:55:59.472254 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Aug 31 15:55:59.472254 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Aug 31 15:55:59.472254 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 31 15:55:59.472254 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 31 15:55:59.472254 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 31 15:55:59.472254 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 31 15:55:59.472254 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 15:55:59.472254 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 31 15:55:59.472254 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 15:55:59.472254 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise self.value Aug 31 15:55:59.472254 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 31 15:55:59.473406 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 31 15:55:59.473406 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 31 15:55:59.473406 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 31 15:55:59.473406 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 31 15:55:59.473406 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 31 15:55:59.473406 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 31 15:55:59.473406 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:55:59.473406 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:55:59.473406 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:55:59.473406 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:55:59.473406 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:55:59.473406 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:55:59.473406 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 31 15:55:59.473406 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 31 15:55:59.473406 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 31 15:55:59.473406 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:55:59.475174 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-48dfefcf-7c09-4719-a88d-b047bae37655 tempest-AggregatesAdminNegativeTestJSON-148728318 tempest-AggregatesAdminNegativeTestJSON-148728318-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:55:59.476354 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-48dfefcf-7c09-4719-a88d-b047bae37655 tempest-AggregatesAdminNegativeTestJSON-148728318 tempest-AggregatesAdminNegativeTestJSON-148728318-project] 10.222.0.61 "GET /compute/v2.1/os-aggregates/8" status: 403 len: 114 microversion: 2.1 time: 0.033081 Aug 31 15:55:59.477583 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 26/60] 10.222.0.61 () {58 vars in 1149 bytes} [Wed Aug 31 15:55:59 2022] GET /compute/v2.1/os-aggregates/8 => generated 114 bytes in 35 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:55:59.484130 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e28bddac-e62e-4f0c-995d-07d6c9d89025 tempest-FlavorsAccessNegativeTestJSON-51119877 tempest-FlavorsAccessNegativeTestJSON-51119877-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1650975120", "id": 1531167907, "os-flavor-access:is_public": "True"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:55:59.515291 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e28bddac-e62e-4f0c-995d-07d6c9d89025 tempest-FlavorsAccessNegativeTestJSON-51119877 tempest-FlavorsAccessNegativeTestJSON-51119877-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.035804 Aug 31 15:55:59.522813 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 27/61] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 15:55:59 2022] POST /compute/v2.1/flavors => generated 438 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:55:59.538696 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9904793e-e16b-4d29-99fd-1fcd08d82fdb tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:59.569506 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9904793e-e16b-4d29-99fd-1fcd08d82fdb tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] 10.222.0.61 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.045548 Aug 31 15:55:59.574102 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 28/62] 10.222.0.61 () {58 vars in 1152 bytes} [Wed Aug 31 15:55:59 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 31 15:55:59.585382 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-45a46a23-5ac2-4459-9472-71424921c029 tempest-FlavorsAccessNegativeTestJSON-51119877 tempest-FlavorsAccessNegativeTestJSON-51119877-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:59.603108 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-45a46a23-5ac2-4459-9472-71424921c029 tempest-FlavorsAccessNegativeTestJSON-51119877 tempest-FlavorsAccessNegativeTestJSON-51119877-project-admin] HTTP exception thrown: Access list not available for public flavors. Aug 31 15:55:59.606809 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-45a46a23-5ac2-4459-9472-71424921c029 tempest-FlavorsAccessNegativeTestJSON-51119877 tempest-FlavorsAccessNegativeTestJSON-51119877-project-admin] Request method failure captured: Aug 31 15:55:59.606809 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/flavors/1531167907/os-flavor-access HTTP/1.1 Aug 31 15:55:59.606809 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 15:55:59.606809 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 15:55:59.606809 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 15:55:59.606809 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 15:55:59.606809 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 15:55:59.606809 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 15:55:59.606809 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 15:55:59.606809 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 15:55:59.606809 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4SISwCtbuPhw8ws1oP1nxWWwUFe5VZNH26xM3jn-_t98M1GBTg5TwuxccfhxZT27sIaEEWPPDgDKdttZ-zAd6WEUHBx4y3PwYYPdJ4MVzShurElCKU9sQddiCQHoNWd1_2xNE8rv8PcArXxmdFK4ZgQsgU_qQ8Wz45Bwpjhhq3Wm-Y Aug 31 15:55:59.606809 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 15:55:59.606809 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 15:55:59.606809 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 15:55:59.606809 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 15:55:59.606809 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 15:55:59.606809 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 15:55:59.606809 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 4edc3cab8a66460b938ba19068e2e800 Aug 31 15:55:59.606809 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-51119877 Aug 31 15:55:59.606809 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,admin,member Aug 31 15:55:59.606809 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,admin,member Aug 31 15:55:59.608797 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4edc3cab8a66460b938ba19068e2e800"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/4edc3cab8a66460b938ba19068e2e800"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_4edc3cab8a66460b938ba19068e2e800", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4edc3cab8a66460b938ba19068e2e800"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 15:55:59.608797 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-51119877 Aug 31 15:55:59.608797 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 4edc3cab8a66460b938ba19068e2e800 Aug 31 15:55:59.608797 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-51119877 Aug 31 15:55:59.608797 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-FlavorsAccessNegativeTestJSON-51119877-project-admin Aug 31 15:55:59.608797 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 15:55:59.608797 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 15:55:59.608797 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: ecb7a8e9e16848a9a6fad26e5e56c223 Aug 31 15:55:59.608797 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-51119877-project-admin Aug 31 15:55:59.608797 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 15:55:59.608797 n-d-850499-9 devstack@n-api.service[122256]: exception: Access list not available for public flavors. Aug 31 15:55:59.608797 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'flavor_id': '1531167907'} Aug 31 15:55:59.609491 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:55:59.609491 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:55:59.609491 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:55:59.609491 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:55:59.609491 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:55:59.609491 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:55:59.609491 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:55:59.609491 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:55:59.609491 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Aug 31 15:55:59.609491 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 31 15:55:59.609491 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Aug 31 15:55:59.609491 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:55:59.609491 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:55:59.609491 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:55:59.609491 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:55:59.609491 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:55:59.609491 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:55:59.609491 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:55:59.609491 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:55:59.609491 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Aug 31 15:55:59.609491 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:55:59.610696 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-45a46a23-5ac2-4459-9472-71424921c029 tempest-FlavorsAccessNegativeTestJSON-51119877 tempest-FlavorsAccessNegativeTestJSON-51119877-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:55:59.610696 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-45a46a23-5ac2-4459-9472-71424921c029 tempest-FlavorsAccessNegativeTestJSON-51119877 tempest-FlavorsAccessNegativeTestJSON-51119877-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/1531167907/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.033302 Aug 31 15:55:59.610696 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 29/63] 10.222.0.61 () {58 vars in 1209 bytes} [Wed Aug 31 15:55:59 2022] GET /compute/v2.1/flavors/1531167907/os-flavor-access => generated 91 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 31 15:55:59.620599 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ff554858-15f0-4236-a5aa-a7d2c64eb6bc tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:59.630721 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-ff554858-15f0-4236-a5aa-a7d2c64eb6bc tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Aug 31 15:55:59.639528 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ff554858-15f0-4236-a5aa-a7d2c64eb6bc tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] Request method failure captured: Aug 31 15:55:59.639528 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Aug 31 15:55:59.639528 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 15:55:59.639528 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 15:55:59.639528 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 15:55:59.639528 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 15:55:59.639528 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 15:55:59.639528 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 15:55:59.639528 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 15:55:59.639528 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 15:55:59.639528 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4SGQIQoHeMzleKeuN86FNKPcC70EDN3vvnbv5OP60F3GKzilNbO986Ebl4P9Ns_7fZw90Bs5FqY4IJ9jx1mntbxztRbT4O47wiLT9GZ_VsOGsx0hBsPT0oayVTcpf-y2h3Escl2kyQTF-POOAwUJKtU9TWiek0xftsoY-gAipBE-sE Aug 31 15:55:59.639528 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 15:55:59.639528 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 15:55:59.639528 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 15:55:59.639528 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 15:55:59.639528 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 15:55:59.639528 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 15:55:59.639528 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 7bbe02d5716d48d9bcff3357923a7933 Aug 31 15:55:59.639528 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1569510051 Aug 31 15:55:59.639528 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,admin,member Aug 31 15:55:59.639528 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,admin,member Aug 31 15:55:59.640764 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7bbe02d5716d48d9bcff3357923a7933"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7bbe02d5716d48d9bcff3357923a7933"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7bbe02d5716d48d9bcff3357923a7933", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7bbe02d5716d48d9bcff3357923a7933"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 15:55:59.640764 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1569510051 Aug 31 15:55:59.640764 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 7bbe02d5716d48d9bcff3357923a7933 Aug 31 15:55:59.640764 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1569510051 Aug 31 15:55:59.640764 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin Aug 31 15:55:59.640764 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 15:55:59.640764 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 15:55:59.640764 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: b8ab15c6ae7049e68e5bd2f1a0a709b4 Aug 31 15:55:59.640764 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin Aug 31 15:55:59.640764 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 15:55:59.640764 n-d-850499-9 devstack@n-api.service[122256]: exception: Aggregate -1 could not be found. Aug 31 15:55:59.640764 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '-1'} Aug 31 15:55:59.641769 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:55:59.641769 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:55:59.641769 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 31 15:55:59.641769 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 31 15:55:59.641769 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6462, in get_aggregate Aug 31 15:55:59.641769 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 31 15:55:59.641769 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 15:55:59.641769 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 15:55:59.641769 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 31 15:55:59.641769 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 31 15:55:59.641769 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 31 15:55:59.641769 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 31 15:55:59.641769 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 31 15:55:59.641769 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 31 15:55:59.641769 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Aug 31 15:55:59.641769 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:55:59.641769 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:55:59.641769 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:55:59.641769 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:55:59.641769 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:55:59.642725 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:55:59.642725 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:55:59.642725 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:55:59.642725 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:55:59.642725 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:55:59.642725 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 31 15:55:59.642725 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:55:59.642725 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Aug 31 15:55:59.642725 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:55:59.642725 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:55:59.642725 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:55:59.642725 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:55:59.642725 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:55:59.642725 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:55:59.642725 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:55:59.642725 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:55:59.642725 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Aug 31 15:55:59.642725 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:55:59.645532 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ff554858-15f0-4236-a5aa-a7d2c64eb6bc tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:55:59.646588 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ff554858-15f0-4236-a5aa-a7d2c64eb6bc tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] 10.222.0.61 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.034747 Aug 31 15:55:59.647320 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 30/64] 10.222.0.61 () {58 vars in 1152 bytes} [Wed Aug 31 15:55:59 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 31 15:55:59.655651 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a200e54b-6920-491f-8e3f-a310df18462b tempest-FlavorsAccessNegativeTestJSON-51119877 tempest-FlavorsAccessNegativeTestJSON-51119877-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:59.682704 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a200e54b-6920-491f-8e3f-a310df18462b tempest-FlavorsAccessNegativeTestJSON-51119877 tempest-FlavorsAccessNegativeTestJSON-51119877-project-admin] 10.222.0.61 "DELETE /compute/v2.1/flavors/1531167907" status: 202 len: 0 microversion: 2.1 time: 0.034163 Aug 31 15:55:59.683712 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 31/65] 10.222.0.61 () {58 vars in 1161 bytes} [Wed Aug 31 15:55:59 2022] DELETE /compute/v2.1/flavors/1531167907 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 15:55:59.692282 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5a97c51d-5a79-41e2-a482-a759872edc0c tempest-AggregatesAdminNegativeTestJSON-148728318 tempest-AggregatesAdminNegativeTestJSON-148728318-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:59.693832 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5a97c51d-5a79-41e2-a482-a759872edc0c tempest-AggregatesAdminNegativeTestJSON-148728318 tempest-AggregatesAdminNegativeTestJSON-148728318-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '7be97b44590b40ccaee241d020cfd674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f9a9a381df493d9963697f8e6f4b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:59.695600 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5a97c51d-5a79-41e2-a482-a759872edc0c tempest-AggregatesAdminNegativeTestJSON-148728318 tempest-AggregatesAdminNegativeTestJSON-148728318-project] Request method failure captured: Aug 31 15:55:59.695600 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Aug 31 15:55:59.695600 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 15:55:59.695600 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 15:55:59.695600 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 15:55:59.695600 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 15:55:59.695600 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 15:55:59.695600 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 15:55:59.695600 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 15:55:59.695600 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 15:55:59.695600 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4SCylM4XlpqpHr7br_SNtINz4kKLsmoxZFU3yRQqIUaF5qH9TxqaBPIeqf9ekYJ7E0Mzhf8YAs3u2Z4Me-JhE-FBwxcq4Z4T3e_6qmZ311AsdkpeBRMvRJcA647S3Chjq-8kSCbOj0mRLKOX_gZtA7_5RwYQZ-k6ogyns7nGw2XTx4 Aug 31 15:55:59.695600 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 15:55:59.695600 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 15:55:59.695600 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 15:55:59.695600 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 15:55:59.695600 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 15:55:59.695600 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 15:55:59.695600 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 28f9a9a381df493d9963697f8e6f4b8f Aug 31 15:55:59.695600 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-148728318 Aug 31 15:55:59.695600 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 15:55:59.695600 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 15:55:59.696696 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/28f9a9a381df493d9963697f8e6f4b8f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/28f9a9a381df493d9963697f8e6f4b8f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_28f9a9a381df493d9963697f8e6f4b8f", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/28f9a9a381df493d9963697f8e6f4b8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 15:55:59.696696 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-148728318 Aug 31 15:55:59.696696 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 28f9a9a381df493d9963697f8e6f4b8f Aug 31 15:55:59.696696 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-148728318 Aug 31 15:55:59.696696 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-AggregatesAdminNegativeTestJSON-148728318-project Aug 31 15:55:59.696696 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 15:55:59.696696 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 15:55:59.696696 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 7be97b44590b40ccaee241d020cfd674 Aug 31 15:55:59.696696 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-148728318-project Aug 31 15:55:59.696696 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 15:55:59.696696 n-d-850499-9 devstack@n-api.service[122256]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 31 15:55:59.696696 n-d-850499-9 devstack@n-api.service[122256]: action_args: {} Aug 31 15:55:59.697323 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:55:59.697323 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:55:59.697323 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:55:59.697323 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:55:59.697323 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:55:59.697323 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:55:59.697323 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:55:59.697323 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:55:59.697323 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Aug 31 15:55:59.697323 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Aug 31 15:55:59.697323 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 31 15:55:59.697323 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 31 15:55:59.697323 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 31 15:55:59.697323 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 31 15:55:59.697323 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 15:55:59.697323 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 31 15:55:59.697323 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 15:55:59.697323 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise self.value Aug 31 15:55:59.697323 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 31 15:55:59.698270 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 31 15:55:59.698270 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 31 15:55:59.698270 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 31 15:55:59.698270 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 31 15:55:59.698270 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 31 15:55:59.698270 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 31 15:55:59.698270 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:55:59.698270 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:55:59.698270 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:55:59.698270 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:55:59.698270 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:55:59.698270 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:55:59.698270 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 31 15:55:59.698270 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 31 15:55:59.698270 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 31 15:55:59.698270 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:55:59.698270 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5a97c51d-5a79-41e2-a482-a759872edc0c tempest-AggregatesAdminNegativeTestJSON-148728318 tempest-AggregatesAdminNegativeTestJSON-148728318-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:55:59.699105 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5a97c51d-5a79-41e2-a482-a759872edc0c tempest-AggregatesAdminNegativeTestJSON-148728318 tempest-AggregatesAdminNegativeTestJSON-148728318-project] 10.222.0.61 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.013967 Aug 31 15:55:59.699829 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 32/66] 10.222.0.61 () {58 vars in 1143 bytes} [Wed Aug 31 15:55:59 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:55:59.722295 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3b87ed29-e91c-4665-b134-2975aec8a766 tempest-FlavorsAccessNegativeTestJSON-51119877 tempest-FlavorsAccessNegativeTestJSON-51119877-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:59.748164 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3b87ed29-e91c-4665-b134-2975aec8a766 tempest-FlavorsAccessNegativeTestJSON-51119877 tempest-FlavorsAccessNegativeTestJSON-51119877-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.046696 Aug 31 15:55:59.749880 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 33/67] 10.222.0.61 () {58 vars in 1146 bytes} [Wed Aug 31 15:55:59 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:59.767738 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5c3ac1e4-0378-48ff-b5ee-fa150f2c5b56 tempest-FlavorsAccessNegativeTestJSON-51119877 tempest-FlavorsAccessNegativeTestJSON-51119877-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1102569101", "id": 704738012, "os-flavor-access:is_public": "False"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:55:59.787254 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5c3ac1e4-0378-48ff-b5ee-fa150f2c5b56 tempest-FlavorsAccessNegativeTestJSON-51119877 tempest-FlavorsAccessNegativeTestJSON-51119877-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.023140 Aug 31 15:55:59.787688 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 34/68] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 15:55:59 2022] POST /compute/v2.1/flavors => generated 436 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:55:59.903219 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-225148f8-e4b4-4dd1-86b4-5f89094cdae1 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-1611211530", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "availability_zone": "tempest-test_az-204945747"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:55:59.929483 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-225148f8-e4b4-4dd1-86b4-5f89094cdae1 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:59.929908 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-225148f8-e4b4-4dd1-86b4-5f89094cdae1 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:59.930457 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-225148f8-e4b4-4dd1-86b4-5f89094cdae1 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:59.931314 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-225148f8-e4b4-4dd1-86b4-5f89094cdae1 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:59.931896 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-225148f8-e4b4-4dd1-86b4-5f89094cdae1 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:59.932429 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-225148f8-e4b4-4dd1-86b4-5f89094cdae1 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:00.353989 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ac9851b8-28d3-4291-95ae-d8a2df33c72e tempest-FlavorsAccessNegativeTestJSON-856995153 tempest-FlavorsAccessNegativeTestJSON-856995153-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "98fd39a94454468792a9e1ef60fe9337"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:56:00.362721 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ac9851b8-28d3-4291-95ae-d8a2df33c72e tempest-FlavorsAccessNegativeTestJSON-856995153 tempest-FlavorsAccessNegativeTestJSON-856995153-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '85e4e2a472314406833a40fdd059b90b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fd39a94454468792a9e1ef60fe9337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:00.366979 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ac9851b8-28d3-4291-95ae-d8a2df33c72e tempest-FlavorsAccessNegativeTestJSON-856995153 tempest-FlavorsAccessNegativeTestJSON-856995153-project] Request method failure captured: Aug 31 15:56:00.366979 n-d-850499-9 devstack@n-api.service[122256]: request: POST /compute/v2.1/flavors/704738012/action HTTP/1.1 Aug 31 15:56:00.366979 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 15:56:00.366979 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 15:56:00.366979 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 15:56:00.366979 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 67 Aug 31 15:56:00.366979 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 15:56:00.366979 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 15:56:00.366979 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 15:56:00.366979 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 15:56:00.366979 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4SHw_8g7UoZQWttghCy2uTpbp5YplnOHIwR0JJa_VkN6Q6CTHRROYGqiQ2iqgZJp_rtQ-kFnoCAVz9I-mg4v-5RDLiKFSPB2DrW-VIyYdx75oeDKZBVpQtMuwpCh7aStOWRrqtKSPSjSRu_486LunfqcS3YT3AQ4r5_qSDrAJSdwAY Aug 31 15:56:00.366979 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 15:56:00.366979 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 15:56:00.366979 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 15:56:00.366979 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 15:56:00.366979 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 15:56:00.366979 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 15:56:00.366979 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 98fd39a94454468792a9e1ef60fe9337 Aug 31 15:56:00.366979 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-856995153 Aug 31 15:56:00.366979 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 15:56:00.366979 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 15:56:00.368423 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/98fd39a94454468792a9e1ef60fe9337"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/98fd39a94454468792a9e1ef60fe9337"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_98fd39a94454468792a9e1ef60fe9337", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/98fd39a94454468792a9e1ef60fe9337"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 15:56:00.368423 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-856995153 Aug 31 15:56:00.368423 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 98fd39a94454468792a9e1ef60fe9337 Aug 31 15:56:00.368423 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-856995153 Aug 31 15:56:00.368423 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-FlavorsAccessNegativeTestJSON-856995153-project Aug 31 15:56:00.368423 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 15:56:00.368423 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 15:56:00.368423 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 85e4e2a472314406833a40fdd059b90b Aug 31 15:56:00.368423 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-856995153-project Aug 31 15:56:00.368423 n-d-850499-9 devstack@n-api.service[122256]: Aug 31 15:56:00.368423 n-d-850499-9 devstack@n-api.service[122256]: {"addTenantAccess": {"tenant": "98fd39a94454468792a9e1ef60fe9337"}} Aug 31 15:56:00.368423 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 15:56:00.369219 n-d-850499-9 devstack@n-api.service[122256]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 31 15:56:00.369219 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '704738012', 'body': {'addTenantAccess': {'tenant': '98fd39a94454468792a9e1ef60fe9337'}}} Aug 31 15:56:00.369219 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:56:00.369219 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:56:00.369219 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:56:00.369219 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:56:00.369219 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:56:00.369219 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:56:00.369219 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:56:00.369219 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:56:00.369219 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:56:00.369219 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:56:00.369219 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Aug 31 15:56:00.369219 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Aug 31 15:56:00.369219 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 31 15:56:00.369219 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 31 15:56:00.369219 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 31 15:56:00.369219 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 31 15:56:00.369219 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 15:56:00.370351 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 31 15:56:00.370351 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 15:56:00.370351 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise self.value Aug 31 15:56:00.370351 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 31 15:56:00.370351 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 31 15:56:00.370351 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 31 15:56:00.370351 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 31 15:56:00.370351 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 31 15:56:00.370351 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 31 15:56:00.370351 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 31 15:56:00.370351 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:56:00.370351 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:56:00.370351 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:56:00.370351 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:56:00.370351 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:56:00.370351 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:56:00.370351 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 31 15:56:00.370351 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 31 15:56:00.370351 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 31 15:56:00.370351 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:56:00.371548 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ac9851b8-28d3-4291-95ae-d8a2df33c72e tempest-FlavorsAccessNegativeTestJSON-856995153 tempest-FlavorsAccessNegativeTestJSON-856995153-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:56:00.371548 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ac9851b8-28d3-4291-95ae-d8a2df33c72e tempest-FlavorsAccessNegativeTestJSON-856995153 tempest-FlavorsAccessNegativeTestJSON-856995153-project] 10.222.0.61 "POST /compute/v2.1/flavors/704738012/action" status: 403 len: 130 microversion: 2.1 time: 0.575271 Aug 31 15:56:00.373475 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 35/69] 10.222.0.61 () {60 vars in 1197 bytes} [Wed Aug 31 15:55:59 2022] POST /compute/v2.1/flavors/704738012/action => generated 130 bytes in 578 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:56:00.732250 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ae2483a6-886c-4692-b19b-6779fadea375 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:00.751690 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ae2483a6-886c-4692-b19b-6779fadea375 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] 10.222.0.61 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.375276 Aug 31 15:56:00.761334 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 36/70] 10.222.0.61 () {58 vars in 1137 bytes} [Wed Aug 31 15:56:00 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:56:00.767040 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2a42ffbf-2dc2-4c44-bc73-53e6f38a8d13 tempest-FlavorsAccessNegativeTestJSON-51119877 tempest-FlavorsAccessNegativeTestJSON-51119877-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:00.800690 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2a42ffbf-2dc2-4c44-bc73-53e6f38a8d13 tempest-FlavorsAccessNegativeTestJSON-51119877 tempest-FlavorsAccessNegativeTestJSON-51119877-project-admin] 10.222.0.61 "DELETE /compute/v2.1/flavors/704738012" status: 202 len: 0 microversion: 2.1 time: 0.038124 Aug 31 15:56:00.801795 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 37/71] 10.222.0.61 () {58 vars in 1158 bytes} [Wed Aug 31 15:56:00 2022] DELETE /compute/v2.1/flavors/704738012 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 15:56:01.085153 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-225148f8-e4b4-4dd1-86b4-5f89094cdae1 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] validate_networks() for None {{(pid=122257) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 15:56:01.113849 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-bfdaa61e-989e-47fd-822d-5b4d5de35873 tempest-ServersWithSpecificFlavorTestJSON-1517669509 tempest-ServersWithSpecificFlavorTestJSON-1517669509-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-1938878027", "id": 1461368607, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:56:01.158170 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-bfdaa61e-989e-47fd-822d-5b4d5de35873 tempest-ServersWithSpecificFlavorTestJSON-1517669509 tempest-ServersWithSpecificFlavorTestJSON-1517669509-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.354315 Aug 31 15:56:01.166089 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 38/72] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 15:56:00 2022] POST /compute/v2.1/flavors => generated 425 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:56:01.180517 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ccdb85ac-e7fd-4113-b798-016af164b2e7 tempest-FlavorsAccessNegativeTestJSON-51119877 tempest-FlavorsAccessNegativeTestJSON-51119877-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:01.239840 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ccdb85ac-e7fd-4113-b798-016af164b2e7 tempest-FlavorsAccessNegativeTestJSON-51119877 tempest-FlavorsAccessNegativeTestJSON-51119877-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 5406 microversion: 2.1 time: 0.072297 Aug 31 15:56:01.240328 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 39/73] 10.222.0.61 () {58 vars in 1146 bytes} [Wed Aug 31 15:56:01 2022] GET /compute/v2.1/flavors/detail => generated 5406 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:01.253387 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3388b0c3-71db-4024-8a80-214e913d8d2a tempest-ServersWithSpecificFlavorTestJSON-1517669509 tempest-ServersWithSpecificFlavorTestJSON-1517669509-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:01.261938 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3388b0c3-71db-4024-8a80-214e913d8d2a tempest-ServersWithSpecificFlavorTestJSON-1517669509 tempest-ServersWithSpecificFlavorTestJSON-1517669509-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.020532 Aug 31 15:56:01.269054 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 40/74] 10.222.0.61 () {58 vars in 1182 bytes} [Wed Aug 31 15:56:01 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 15:56:01.278900 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-111ea57a-57d1-4eb7-8257-00c24e685b57 tempest-FlavorsAccessNegativeTestJSON-51119877 tempest-FlavorsAccessNegativeTestJSON-51119877-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-890472232", "id": 1970434948, "os-flavor-access:is_public": "False"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:56:01.318424 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-111ea57a-57d1-4eb7-8257-00c24e685b57 tempest-FlavorsAccessNegativeTestJSON-51119877 tempest-FlavorsAccessNegativeTestJSON-51119877-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.047316 Aug 31 15:56:01.322980 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 41/75] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 15:56:01 2022] POST /compute/v2.1/flavors => generated 438 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:56:01.334595 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f09e8636-4987-4814-8ac6-75e3ac6f8136 tempest-ServersWithSpecificFlavorTestJSON-1517669509 tempest-ServersWithSpecificFlavorTestJSON-1517669509-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-321693938", "id": 212044327, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:56:01.366883 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f09e8636-4987-4814-8ac6-75e3ac6f8136 tempest-ServersWithSpecificFlavorTestJSON-1517669509 tempest-ServersWithSpecificFlavorTestJSON-1517669509-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 421 microversion: 2.1 time: 0.042735 Aug 31 15:56:01.367458 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 42/76] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 15:56:01 2022] POST /compute/v2.1/flavors => generated 421 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:56:01.376217 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f88178b3-c989-44ca-9118-b94ed82eb2d8 tempest-FlavorsAccessNegativeTestJSON-51119877 tempest-FlavorsAccessNegativeTestJSON-51119877-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "98fd39a94454468792a9e1ef60fe9337"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:56:01.390764 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:56:01.488247 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-225148f8-e4b4-4dd1-86b4-5f89094cdae1 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 15:56:01.489318 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-225148f8-e4b4-4dd1-86b4-5f89094cdae1 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 15:56:01.490370 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-225148f8-e4b4-4dd1-86b4-5f89094cdae1 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 15:56:01.491191 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-225148f8-e4b4-4dd1-86b4-5f89094cdae1 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 15:56:01.491816 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-225148f8-e4b4-4dd1-86b4-5f89094cdae1 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 15:56:01.511953 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-225148f8-e4b4-4dd1-86b4-5f89094cdae1 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:01.513366 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-225148f8-e4b4-4dd1-86b4-5f89094cdae1 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:01.514538 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-225148f8-e4b4-4dd1-86b4-5f89094cdae1 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:01.515788 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-225148f8-e4b4-4dd1-86b4-5f89094cdae1 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:01.517244 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-225148f8-e4b4-4dd1-86b4-5f89094cdae1 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:01.517835 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-225148f8-e4b4-4dd1-86b4-5f89094cdae1 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:01.564899 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-225148f8-e4b4-4dd1-86b4-5f89094cdae1 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Getting quotas for project 8904771b5154454896715024aa20bbcd. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:56:01.572273 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-225148f8-e4b4-4dd1-86b4-5f89094cdae1 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Getting quotas for user dbe750fe96e2444489edce1b2750fa1e and project 8904771b5154454896715024aa20bbcd. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:56:01.587744 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-225148f8-e4b4-4dd1-86b4-5f89094cdae1 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Going to run 1 instances... {{(pid=122257) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 15:56:01.590601 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-225148f8-e4b4-4dd1-86b4-5f89094cdae1 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] [instance: 94898cf4-0065-4b87-acb5-e8d11bd1529a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 15:56:01.670072 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-225148f8-e4b4-4dd1-86b4-5f89094cdae1 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.259814 Aug 31 15:56:01.672130 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 35/77] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 15:55:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 2263 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 15:56:01.680119 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4703c498-67af-4307-8f16-ad3f073e32b1 tempest-ServersWithSpecificFlavorTestJSON-1517669509 tempest-ServersWithSpecificFlavorTestJSON-1517669509-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:01.704646 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4703c498-67af-4307-8f16-ad3f073e32b1 tempest-ServersWithSpecificFlavorTestJSON-1517669509 tempest-ServersWithSpecificFlavorTestJSON-1517669509-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.028020 Aug 31 15:56:01.706528 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 36/78] 10.222.0.61 () {58 vars in 1182 bytes} [Wed Aug 31 15:56:01 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 15:56:01.715548 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8355c067-0fa7-4c5a-a24e-7fa63956d7fc tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:01.716379 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8355c067-0fa7-4c5a-a24e-7fa63956d7fc tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] [instance: 94898cf4-0065-4b87-acb5-e8d11bd1529a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:01.849872 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8355c067-0fa7-4c5a-a24e-7fa63956d7fc tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe750fe96e2444489edce1b2750fa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8904771b5154454896715024aa20bbcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:01.866057 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8355c067-0fa7-4c5a-a24e-7fa63956d7fc tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] 10.222.0.61 "GET /compute/v2.1/servers/94898cf4-0065-4b87-acb5-e8d11bd1529a" status: 200 len: 1242 microversion: 2.1 time: 0.158375 Aug 31 15:56:01.867140 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 37/79] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:01 2022] GET /compute/v2.1/servers/94898cf4-0065-4b87-acb5-e8d11bd1529a => generated 1242 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:01.872575 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-94b47bb1-b7a3-4554-904d-25140b365d3f tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Action: 'create', calling method: .version_select at 0x7f5ae9ac65e0>, body: {"keypair": {"name": "tempest-keypair-1481695302", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHmgEbJagPlmXxjceT8djBrzt73bOOfss8XXm2rbzdoMknqwSFfw0iL7XqDNXqPB2ufF8e45EPpzxCOYvosEGbm1V48dP6VlFThr4bi1N7Yl6/u/plDDWDaFLMVN1nOdFA=="}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:56:01.897947 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-94b47bb1-b7a3-4554-904d-25140b365d3f tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Getting quotas for project f6e5507d53224d19804717493d60bb71. Resources: {'key_pairs'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:56:01.903274 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-94b47bb1-b7a3-4554-904d-25140b365d3f tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Getting quotas for user fa377b1dedae45d2a804919e5ea69a00 and project f6e5507d53224d19804717493d60bb71. Resources: {'key_pairs'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:56:01.913494 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=8,nova_api:INSERT=10 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:56:01.935153 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-94b47bb1-b7a3-4554-904d-25140b365d3f tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.066230 Aug 31 15:56:01.936557 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 38/80] 10.222.0.61 () {60 vars in 1159 bytes} [Wed Aug 31 15:56:01 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:56:02.010892 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f88178b3-c989-44ca-9118-b94ed82eb2d8 tempest-FlavorsAccessNegativeTestJSON-51119877 tempest-FlavorsAccessNegativeTestJSON-51119877-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors/1970434948/action" status: 200 len: 97 microversion: 2.1 time: 0.642341 Aug 31 15:56:02.011516 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 43/81] 10.222.0.61 () {60 vars in 1200 bytes} [Wed Aug 31 15:56:01 2022] POST /compute/v2.1/flavors/1970434948/action => generated 97 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 15:56:02.028043 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6e79b911-cfdd-48b4-b834-3b08c28eb1f9 tempest-FlavorsAccessNegativeTestJSON-856995153 tempest-FlavorsAccessNegativeTestJSON-856995153-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "98fd39a94454468792a9e1ef60fe9337"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:56:02.033541 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-6e79b911-cfdd-48b4-b834-3b08c28eb1f9 tempest-FlavorsAccessNegativeTestJSON-856995153 tempest-FlavorsAccessNegativeTestJSON-856995153-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '85e4e2a472314406833a40fdd059b90b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fd39a94454468792a9e1ef60fe9337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:02.036129 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6e79b911-cfdd-48b4-b834-3b08c28eb1f9 tempest-FlavorsAccessNegativeTestJSON-856995153 tempest-FlavorsAccessNegativeTestJSON-856995153-project] Request method failure captured: Aug 31 15:56:02.036129 n-d-850499-9 devstack@n-api.service[122257]: request: POST /compute/v2.1/flavors/1970434948/action HTTP/1.1 Aug 31 15:56:02.036129 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 15:56:02.036129 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 15:56:02.036129 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 15:56:02.036129 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 70 Aug 31 15:56:02.036129 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 15:56:02.036129 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 15:56:02.036129 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 15:56:02.036129 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 15:56:02.036129 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4SHw_8g7UoZQWttghCy2uTpbp5YplnOHIwR0JJa_VkN6Q6CTHRROYGqiQ2iqgZJp_rtQ-kFnoCAVz9I-mg4v-5RDLiKFSPB2DrW-VIyYdx75oeDKZBVpQtMuwpCh7aStOWRrqtKSPSjSRu_486LunfqcS3YT3AQ4r5_qSDrAJSdwAY Aug 31 15:56:02.036129 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 15:56:02.036129 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 15:56:02.036129 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 15:56:02.036129 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 15:56:02.036129 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 15:56:02.036129 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 15:56:02.036129 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 98fd39a94454468792a9e1ef60fe9337 Aug 31 15:56:02.036129 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-856995153 Aug 31 15:56:02.036129 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 15:56:02.036129 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 15:56:02.037613 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/98fd39a94454468792a9e1ef60fe9337"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/98fd39a94454468792a9e1ef60fe9337"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_98fd39a94454468792a9e1ef60fe9337", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/98fd39a94454468792a9e1ef60fe9337"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 15:56:02.037613 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-856995153 Aug 31 15:56:02.037613 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 98fd39a94454468792a9e1ef60fe9337 Aug 31 15:56:02.037613 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-856995153 Aug 31 15:56:02.037613 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-FlavorsAccessNegativeTestJSON-856995153-project Aug 31 15:56:02.037613 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 15:56:02.037613 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 15:56:02.037613 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 85e4e2a472314406833a40fdd059b90b Aug 31 15:56:02.037613 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-856995153-project Aug 31 15:56:02.037613 n-d-850499-9 devstack@n-api.service[122257]: Aug 31 15:56:02.037613 n-d-850499-9 devstack@n-api.service[122257]: {"removeTenantAccess": {"tenant": "98fd39a94454468792a9e1ef60fe9337"}} Aug 31 15:56:02.037613 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 15:56:02.038299 n-d-850499-9 devstack@n-api.service[122257]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 31 15:56:02.038299 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '1970434948', 'body': {'removeTenantAccess': {'tenant': '98fd39a94454468792a9e1ef60fe9337'}}} Aug 31 15:56:02.038299 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:56:02.038299 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:56:02.038299 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:56:02.038299 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:56:02.038299 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:56:02.038299 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:56:02.038299 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:56:02.038299 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:56:02.038299 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:56:02.038299 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:56:02.038299 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Aug 31 15:56:02.038299 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi context.can( Aug 31 15:56:02.038299 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 31 15:56:02.038299 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 31 15:56:02.038299 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 31 15:56:02.038299 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 31 15:56:02.038299 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 15:56:02.038299 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 31 15:56:02.040817 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 15:56:02.040817 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise self.value Aug 31 15:56:02.040817 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 31 15:56:02.040817 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 31 15:56:02.040817 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 31 15:56:02.040817 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 31 15:56:02.040817 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 31 15:56:02.040817 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 31 15:56:02.040817 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 31 15:56:02.040817 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:56:02.040817 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:56:02.040817 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:56:02.040817 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:56:02.040817 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:56:02.040817 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:56:02.040817 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 31 15:56:02.040817 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 31 15:56:02.040817 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 31 15:56:02.040817 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:56:02.043393 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6e79b911-cfdd-48b4-b834-3b08c28eb1f9 tempest-FlavorsAccessNegativeTestJSON-856995153 tempest-FlavorsAccessNegativeTestJSON-856995153-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:56:02.044343 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6e79b911-cfdd-48b4-b834-3b08c28eb1f9 tempest-FlavorsAccessNegativeTestJSON-856995153 tempest-FlavorsAccessNegativeTestJSON-856995153-project] 10.222.0.61 "POST /compute/v2.1/flavors/1970434948/action" status: 403 len: 133 microversion: 2.1 time: 0.023465 Aug 31 15:56:02.048389 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 39/82] 10.222.0.61 () {60 vars in 1200 bytes} [Wed Aug 31 15:56:02 2022] POST /compute/v2.1/flavors/1970434948/action => generated 133 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:56:02.055935 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7e51b21c-7dc1-43bf-87f9-1c8148e755d2 tempest-FlavorsAccessNegativeTestJSON-51119877 tempest-FlavorsAccessNegativeTestJSON-51119877-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "98fd39a94454468792a9e1ef60fe9337"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:56:02.353742 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=4 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:56:02.919568 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7e51b21c-7dc1-43bf-87f9-1c8148e755d2 tempest-FlavorsAccessNegativeTestJSON-51119877 tempest-FlavorsAccessNegativeTestJSON-51119877-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors/1970434948/action" status: 200 len: 21 microversion: 2.1 time: 0.867750 Aug 31 15:56:02.920184 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 44/83] 10.222.0.61 () {60 vars in 1200 bytes} [Wed Aug 31 15:56:02 2022] POST /compute/v2.1/flavors/1970434948/action => generated 21 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 15:56:02.931958 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-97d2bcf5-7e90-4b74-aea3-9824aea31c95 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:02.932869 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-97d2bcf5-7e90-4b74-aea3-9824aea31c95 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] [instance: 94898cf4-0065-4b87-acb5-e8d11bd1529a] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:02.949863 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f128110f-97ea-4609-b16a-1b6c885f8518 tempest-InstanceUsageAuditLogTestJSON-1535076715 tempest-InstanceUsageAuditLogTestJSON-1535076715-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:03.003274 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f128110f-97ea-4609-b16a-1b6c885f8518 tempest-InstanceUsageAuditLogTestJSON-1535076715 tempest-InstanceUsageAuditLogTestJSON-1535076715-project-admin] 10.222.0.61 "GET /compute/v2.1/os-instance_usage_audit_log/2022-08-31 15:56:02" status: 200 len: 318 microversion: 2.1 time: 0.551346 Aug 31 15:56:03.017845 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 40/84] 10.222.0.61 () {58 vars in 1251 bytes} [Wed Aug 31 15:56:02 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-08-31%2015%3A56%3A02 => generated 318 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:56:03.022578 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-495a6cb6-8e99-4461-8fc2-768888cdb7e2 tempest-FlavorsAccessNegativeTestJSON-51119877 tempest-FlavorsAccessNegativeTestJSON-51119877-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:03.065751 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-495a6cb6-8e99-4461-8fc2-768888cdb7e2 tempest-FlavorsAccessNegativeTestJSON-51119877 tempest-FlavorsAccessNegativeTestJSON-51119877-project-admin] 10.222.0.61 "DELETE /compute/v2.1/flavors/1970434948" status: 202 len: 0 microversion: 2.1 time: 0.046704 Aug 31 15:56:03.066449 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 41/85] 10.222.0.61 () {58 vars in 1161 bytes} [Wed Aug 31 15:56:03 2022] DELETE /compute/v2.1/flavors/1970434948 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 15:56:03.072466 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-bb91deda-7f47-4b1e-891f-ab3b65a3d07e tempest-InstanceUsageAuditLogTestJSON-1535076715 tempest-InstanceUsageAuditLogTestJSON-1535076715-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:03.102025 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-bb91deda-7f47-4b1e-891f-ab3b65a3d07e tempest-InstanceUsageAuditLogTestJSON-1535076715 tempest-InstanceUsageAuditLogTestJSON-1535076715-project-admin] 10.222.0.61 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.034453 Aug 31 15:56:03.110024 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 42/86] 10.222.0.61 () {58 vars in 1185 bytes} [Wed Aug 31 15:56:03 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:56:03.110024 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-dd2eb518-5742-49c5-a657-71d192f42e6e tempest-FlavorsAccessNegativeTestJSON-51119877 tempest-FlavorsAccessNegativeTestJSON-51119877-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:03.136013 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-dd2eb518-5742-49c5-a657-71d192f42e6e tempest-FlavorsAccessNegativeTestJSON-51119877 tempest-FlavorsAccessNegativeTestJSON-51119877-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.030046 Aug 31 15:56:03.142287 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 43/87] 10.222.0.61 () {58 vars in 1146 bytes} [Wed Aug 31 15:56:03 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:03.168993 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0aedcc3b-8255-4cee-ad3c-2fe63445a192 tempest-FlavorsAccessNegativeTestJSON-51119877 tempest-FlavorsAccessNegativeTestJSON-51119877-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1873645521", "id": 1609773617, "os-flavor-access:is_public": "False"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:56:03.230111 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0aedcc3b-8255-4cee-ad3c-2fe63445a192 tempest-FlavorsAccessNegativeTestJSON-51119877 tempest-FlavorsAccessNegativeTestJSON-51119877-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.073015 Aug 31 15:56:03.234231 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 44/88] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 15:56:03 2022] POST /compute/v2.1/flavors => generated 439 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:56:03.254424 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9bec5766-3367-4ff3-9879-fbc756e2d7e2 tempest-FlavorsAccessNegativeTestJSON-51119877 tempest-FlavorsAccessNegativeTestJSON-51119877-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "ac7f672ed8f145f78600de50063788b2"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:56:04.048207 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-97d2bcf5-7e90-4b74-aea3-9824aea31c95 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe750fe96e2444489edce1b2750fa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8904771b5154454896715024aa20bbcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:04.071966 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-97d2bcf5-7e90-4b74-aea3-9824aea31c95 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] 10.222.0.61 "GET /compute/v2.1/servers/94898cf4-0065-4b87-acb5-e8d11bd1529a" status: 200 len: 1242 microversion: 2.1 time: 1.146979 Aug 31 15:56:04.072557 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 45/89] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:02 2022] GET /compute/v2.1/servers/94898cf4-0065-4b87-acb5-e8d11bd1529a => generated 1242 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:04.306861 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-9bec5766-3367-4ff3-9879-fbc756e2d7e2 tempest-FlavorsAccessNegativeTestJSON-51119877 tempest-FlavorsAccessNegativeTestJSON-51119877-project-admin] HTTP exception thrown: Flavor access not found for 23 / ac7f672ed8f145f78600de50063788b2 combination. Aug 31 15:56:04.309006 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9bec5766-3367-4ff3-9879-fbc756e2d7e2 tempest-FlavorsAccessNegativeTestJSON-51119877 tempest-FlavorsAccessNegativeTestJSON-51119877-project-admin] Request method failure captured: Aug 31 15:56:04.309006 n-d-850499-9 devstack@n-api.service[122257]: request: POST /compute/v2.1/flavors/1609773617/action HTTP/1.1 Aug 31 15:56:04.309006 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 15:56:04.309006 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 15:56:04.309006 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 15:56:04.309006 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 70 Aug 31 15:56:04.309006 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 15:56:04.309006 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 15:56:04.309006 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 15:56:04.309006 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 15:56:04.309006 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4SISwCtbuPhw8ws1oP1nxWWwUFe5VZNH26xM3jn-_t98M1GBTg5TwuxccfhxZT27sIaEEWPPDgDKdttZ-zAd6WEUHBx4y3PwYYPdJ4MVzShurElCKU9sQddiCQHoNWd1_2xNE8rv8PcArXxmdFK4ZgQsgU_qQ8Wz45Bwpjhhq3Wm-Y Aug 31 15:56:04.309006 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 15:56:04.309006 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 15:56:04.309006 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 15:56:04.309006 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 15:56:04.309006 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 15:56:04.309006 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 15:56:04.309006 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 4edc3cab8a66460b938ba19068e2e800 Aug 31 15:56:04.309006 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-51119877 Aug 31 15:56:04.309006 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,admin,member Aug 31 15:56:04.309006 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,admin,member Aug 31 15:56:04.310324 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4edc3cab8a66460b938ba19068e2e800"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/4edc3cab8a66460b938ba19068e2e800"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_4edc3cab8a66460b938ba19068e2e800", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4edc3cab8a66460b938ba19068e2e800"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 15:56:04.310324 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-51119877 Aug 31 15:56:04.310324 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 4edc3cab8a66460b938ba19068e2e800 Aug 31 15:56:04.310324 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-51119877 Aug 31 15:56:04.310324 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-FlavorsAccessNegativeTestJSON-51119877-project-admin Aug 31 15:56:04.310324 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 15:56:04.310324 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 15:56:04.310324 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: ecb7a8e9e16848a9a6fad26e5e56c223 Aug 31 15:56:04.310324 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-51119877-project-admin Aug 31 15:56:04.310324 n-d-850499-9 devstack@n-api.service[122257]: Aug 31 15:56:04.310324 n-d-850499-9 devstack@n-api.service[122257]: {"removeTenantAccess": {"tenant": "ac7f672ed8f145f78600de50063788b2"}} Aug 31 15:56:04.310324 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 15:56:04.311151 n-d-850499-9 devstack@n-api.service[122257]: exception: Flavor access not found for 23 / ac7f672ed8f145f78600de50063788b2 combination. Aug 31 15:56:04.311151 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '1609773617', 'body': {'removeTenantAccess': {'tenant': 'ac7f672ed8f145f78600de50063788b2'}}} Aug 31 15:56:04.311151 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:56:04.311151 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:56:04.311151 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Aug 31 15:56:04.311151 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Aug 31 15:56:04.311151 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 31 15:56:04.311151 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 31 15:56:04.311151 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Aug 31 15:56:04.311151 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Aug 31 15:56:04.311151 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Aug 31 15:56:04.311151 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Aug 31 15:56:04.311151 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Aug 31 15:56:04.311151 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Aug 31 15:56:04.311151 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 31 15:56:04.311151 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 31 15:56:04.311151 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Aug 31 15:56:04.311151 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Aug 31 15:56:04.312248 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 23 / ac7f672ed8f145f78600de50063788b2 combination. Aug 31 15:56:04.312248 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:56:04.312248 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:56:04.312248 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:56:04.312248 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:56:04.312248 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:56:04.312248 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:56:04.312248 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:56:04.312248 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:56:04.312248 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:56:04.312248 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:56:04.312248 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:56:04.312248 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:56:04.312248 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Aug 31 15:56:04.312248 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:56:04.312248 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 23 / ac7f672ed8f145f78600de50063788b2 combination. Aug 31 15:56:04.312248 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:56:04.312248 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:56:04.312248 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:56:04.312248 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:56:04.313421 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:56:04.313421 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:56:04.313421 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:56:04.313421 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:56:04.313421 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 23 / ac7f672ed8f145f78600de50063788b2 combination. Aug 31 15:56:04.313421 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:56:04.313421 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9bec5766-3367-4ff3-9879-fbc756e2d7e2 tempest-FlavorsAccessNegativeTestJSON-51119877 tempest-FlavorsAccessNegativeTestJSON-51119877-project-admin] Returning 404 to user: Flavor access not found for 23 / ac7f672ed8f145f78600de50063788b2 combination. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:56:04.313421 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9bec5766-3367-4ff3-9879-fbc756e2d7e2 tempest-FlavorsAccessNegativeTestJSON-51119877 tempest-FlavorsAccessNegativeTestJSON-51119877-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors/1609773617/action" status: 404 len: 124 microversion: 2.1 time: 1.068310 Aug 31 15:56:04.315979 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 45/90] 10.222.0.61 () {60 vars in 1200 bytes} [Wed Aug 31 15:56:03 2022] POST /compute/v2.1/flavors/1609773617/action => generated 124 bytes in 1074 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:56:04.320814 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-08e9305c-3411-42c6-ae72-2d3453414d02 tempest-FlavorsAccessNegativeTestJSON-51119877 tempest-FlavorsAccessNegativeTestJSON-51119877-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:04.325607 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:INSERT=9,nova_api:SELECT=76,nova_api:DELETE=15 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:56:04.348948 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-08e9305c-3411-42c6-ae72-2d3453414d02 tempest-FlavorsAccessNegativeTestJSON-51119877 tempest-FlavorsAccessNegativeTestJSON-51119877-project-admin] 10.222.0.61 "DELETE /compute/v2.1/flavors/1609773617" status: 202 len: 0 microversion: 2.1 time: 0.030419 Aug 31 15:56:04.350103 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 46/91] 10.222.0.61 () {58 vars in 1161 bytes} [Wed Aug 31 15:56:04 2022] DELETE /compute/v2.1/flavors/1609773617 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 15:56:04.357650 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-61e698c6-4121-4ec2-a287-478a585a9021 tempest-FlavorsAccessNegativeTestJSON-51119877 tempest-FlavorsAccessNegativeTestJSON-51119877-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:04.385521 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-61e698c6-4121-4ec2-a287-478a585a9021 tempest-FlavorsAccessNegativeTestJSON-51119877 tempest-FlavorsAccessNegativeTestJSON-51119877-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.031401 Aug 31 15:56:04.398215 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 46/92] 10.222.0.61 () {58 vars in 1146 bytes} [Wed Aug 31 15:56:04 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:04.609834 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8a64447c-e057-4280-8833-d7b6a6b89797 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1561218407", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "212044327", "adminPass": "***", "networks": [{"uuid": "a1f95b9f-d175-4a95-ba3a-5b211dcce0fe"}], "security_groups": [{"name": "tempest-securitygroup--1505251891"}], "key_name": "tempest-keypair-1481695302", "user_data": "}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:56:04.840749 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=42 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:56:04.962856 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-8a64447c-e057-4280-8833-d7b6a6b89797 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] validate_networks() for [('a1f95b9f-d175-4a95-ba3a-5b211dcce0fe', None, None, None, None, None)] {{(pid=122257) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 15:56:05.054543 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5ea2f49b-d63c-45b5-a985-6b473a756f91 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-1830430042", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "networks": "none"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:56:05.144149 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-5ea2f49b-d63c-45b5-a985-6b473a756f91 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 15:56:05.144573 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-5ea2f49b-d63c-45b5-a985-6b473a756f91 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 15:56:05.145046 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-5ea2f49b-d63c-45b5-a985-6b473a756f91 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 15:56:05.145455 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-5ea2f49b-d63c-45b5-a985-6b473a756f91 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 15:56:05.145865 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-5ea2f49b-d63c-45b5-a985-6b473a756f91 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 15:56:05.161950 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5ea2f49b-d63c-45b5-a985-6b473a756f91 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:05.162974 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5ea2f49b-d63c-45b5-a985-6b473a756f91 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:05.163747 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5ea2f49b-d63c-45b5-a985-6b473a756f91 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:05.165173 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5ea2f49b-d63c-45b5-a985-6b473a756f91 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:05.165771 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5ea2f49b-d63c-45b5-a985-6b473a756f91 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:05.166341 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5ea2f49b-d63c-45b5-a985-6b473a756f91 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:05.196338 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-5ea2f49b-d63c-45b5-a985-6b473a756f91 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Getting quotas for project 7215005b204d402fa6d443359e7d1ba6. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:56:05.202298 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-5ea2f49b-d63c-45b5-a985-6b473a756f91 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Getting quotas for user 887c3d4e70ed4a8192eff4beecb58db5 and project 7215005b204d402fa6d443359e7d1ba6. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:56:05.218296 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5ea2f49b-d63c-45b5-a985-6b473a756f91 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Going to run 1 instances... {{(pid=122256) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 15:56:05.221794 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5ea2f49b-d63c-45b5-a985-6b473a756f91 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] [instance: f2162319-5635-4c77-920d-9ecb3221d174] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 15:56:05.296739 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5ea2f49b-d63c-45b5-a985-6b473a756f91 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.838448 Aug 31 15:56:05.297529 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 47/93] 10.222.0.61 () {62 vars in 1188 bytes} [Wed Aug 31 15:56:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 840 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 31 15:56:05.304359 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7ee75eeb-dad5-4c0d-9627-fa0e6f3d5471 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:05.305111 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7ee75eeb-dad5-4c0d-9627-fa0e6f3d5471 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] [instance: 94898cf4-0065-4b87-acb5-e8d11bd1529a] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:05.314375 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7ee75eeb-dad5-4c0d-9627-fa0e6f3d5471 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:05.314973 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7ee75eeb-dad5-4c0d-9627-fa0e6f3d5471 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:05.315776 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7ee75eeb-dad5-4c0d-9627-fa0e6f3d5471 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:05.316703 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7ee75eeb-dad5-4c0d-9627-fa0e6f3d5471 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:05.317767 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7ee75eeb-dad5-4c0d-9627-fa0e6f3d5471 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:05.318426 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7ee75eeb-dad5-4c0d-9627-fa0e6f3d5471 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:05.678745 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7ee75eeb-dad5-4c0d-9627-fa0e6f3d5471 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe750fe96e2444489edce1b2750fa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8904771b5154454896715024aa20bbcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:05.702075 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7ee75eeb-dad5-4c0d-9627-fa0e6f3d5471 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] 10.222.0.61 "GET /compute/v2.1/servers/94898cf4-0065-4b87-acb5-e8d11bd1529a" status: 200 len: 1296 microversion: 2.1 time: 0.402227 Aug 31 15:56:05.705426 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 48/94] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:05 2022] GET /compute/v2.1/servers/94898cf4-0065-4b87-acb5-e8d11bd1529a => generated 1296 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:05.710546 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ff81d936-339b-45f2-a2b7-fe35d323c17d tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:56:05.721124 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ff81d936-339b-45f2-a2b7-fe35d323c17d tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] [instance: f2162319-5635-4c77-920d-9ecb3221d174] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:05.898421 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ff81d936-339b-45f2-a2b7-fe35d323c17d tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:05.908801 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ff81d936-339b-45f2-a2b7-fe35d323c17d tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:05.910322 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ff81d936-339b-45f2-a2b7-fe35d323c17d tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:05.922803 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ff81d936-339b-45f2-a2b7-fe35d323c17d tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] 10.222.0.61 "PUT /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174" status: 200 len: 1359 microversion: 2.75 time: 0.215510 Aug 31 15:56:05.925378 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 49/95] 10.222.0.61 () {62 vars in 1297 bytes} [Wed Aug 31 15:56:05 2022] PUT /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174 => generated 1359 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:56:05.953421 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7538c353-89c4-4ffe-bc4c-496fdd2f472b tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:05.954288 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7538c353-89c4-4ffe-bc4c-496fdd2f472b tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] [instance: f2162319-5635-4c77-920d-9ecb3221d174] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:06.130500 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7538c353-89c4-4ffe-bc4c-496fdd2f472b tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:06.144541 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7538c353-89c4-4ffe-bc4c-496fdd2f472b tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:06.156558 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7538c353-89c4-4ffe-bc4c-496fdd2f472b tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:06.170002 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7538c353-89c4-4ffe-bc4c-496fdd2f472b tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] 10.222.0.61 "GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174" status: 200 len: 1359 microversion: 2.75 time: 0.220793 Aug 31 15:56:06.172738 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 50/96] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:56:05 2022] GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174 => generated 1359 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:56:06.517376 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1468c4b4-8997-4f46-9930-cd70e3748c90 tempest-FlavorsV255TestJSON-1053766963 tempest-FlavorsV255TestJSON-1053766963-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-331002595", "id": 1686453229, "os-flavor-access:is_public": "True"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:56:06.601305 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1468c4b4-8997-4f46-9930-cd70e3748c90 tempest-FlavorsV255TestJSON-1053766963 tempest-FlavorsV255TestJSON-1053766963-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 448 microversion: 2.55 time: 0.425522 Aug 31 15:56:06.610282 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 51/97] 10.222.0.61 () {62 vars in 1188 bytes} [Wed Aug 31 15:56:06 2022] POST /compute/v2.1/flavors => generated 448 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 15:56:07.153287 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b19b2d45-cd4c-4f03-91fd-8aa7b9292169 tempest-FlavorsV255TestJSON-1104526233 tempest-FlavorsV255TestJSON-1104526233-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:07.171825 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b19b2d45-cd4c-4f03-91fd-8aa7b9292169 tempest-FlavorsV255TestJSON-1104526233 tempest-FlavorsV255TestJSON-1104526233-project] 10.222.0.61 "GET /compute/v2.1/flavors/1686453229" status: 200 len: 448 microversion: 2.55 time: 0.536121 Aug 31 15:56:07.180791 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 52/98] 10.222.0.61 () {60 vars in 1199 bytes} [Wed Aug 31 15:56:06 2022] GET /compute/v2.1/flavors/1686453229 => generated 448 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 15:56:07.186136 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ff6005f4-b655-45dd-822a-0b06d2ff8e46 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:07.196427 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ff6005f4-b655-45dd-822a-0b06d2ff8e46 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] [instance: 94898cf4-0065-4b87-acb5-e8d11bd1529a] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:07.207132 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ff6005f4-b655-45dd-822a-0b06d2ff8e46 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:07.212274 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ff6005f4-b655-45dd-822a-0b06d2ff8e46 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:07.212987 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ff6005f4-b655-45dd-822a-0b06d2ff8e46 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:07.215449 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ff6005f4-b655-45dd-822a-0b06d2ff8e46 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:07.216190 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ff6005f4-b655-45dd-822a-0b06d2ff8e46 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:07.219084 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ff6005f4-b655-45dd-822a-0b06d2ff8e46 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:07.388247 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ff6005f4-b655-45dd-822a-0b06d2ff8e46 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe750fe96e2444489edce1b2750fa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8904771b5154454896715024aa20bbcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:07.416008 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ff6005f4-b655-45dd-822a-0b06d2ff8e46 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] 10.222.0.61 "GET /compute/v2.1/servers/94898cf4-0065-4b87-acb5-e8d11bd1529a" status: 200 len: 1296 microversion: 2.1 time: 0.230380 Aug 31 15:56:07.417542 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 53/99] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:07 2022] GET /compute/v2.1/servers/94898cf4-0065-4b87-acb5-e8d11bd1529a => generated 1296 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:07.432711 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4bf3ce63-5298-4837-9d5b-7560e3806629 tempest-FlavorsV255TestJSON-1053766963 tempest-FlavorsV255TestJSON-1053766963-project-admin] Action: 'update', calling method: .version_select at 0x7f5aeade1f70>, body: {"flavor": {"description": "new"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:56:07.493326 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4bf3ce63-5298-4837-9d5b-7560e3806629 tempest-FlavorsV255TestJSON-1053766963 tempest-FlavorsV255TestJSON-1053766963-project-admin] 10.222.0.61 "PUT /compute/v2.1/flavors/1686453229" status: 200 len: 449 microversion: 2.55 time: 0.072775 Aug 31 15:56:07.495735 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 54/100] 10.222.0.61 () {62 vars in 1219 bytes} [Wed Aug 31 15:56:07 2022] PUT /compute/v2.1/flavors/1686453229 => generated 449 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 15:56:07.525381 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3d5ee564-a9d2-49bb-a466-b44216fbe06b tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:07.527218 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3d5ee564-a9d2-49bb-a466-b44216fbe06b tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] [instance: f2162319-5635-4c77-920d-9ecb3221d174] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:07.542551 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3d5ee564-a9d2-49bb-a466-b44216fbe06b tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:07.549963 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3d5ee564-a9d2-49bb-a466-b44216fbe06b tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:07.550616 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3d5ee564-a9d2-49bb-a466-b44216fbe06b tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:07.551556 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3d5ee564-a9d2-49bb-a466-b44216fbe06b tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:07.552190 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3d5ee564-a9d2-49bb-a466-b44216fbe06b tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:07.552760 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3d5ee564-a9d2-49bb-a466-b44216fbe06b tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:07.606745 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-8a64447c-e057-4280-8833-d7b6a6b89797 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 15:56:07.609381 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-8a64447c-e057-4280-8833-d7b6a6b89797 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 15:56:07.610107 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-8a64447c-e057-4280-8833-d7b6a6b89797 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 15:56:07.610727 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-8a64447c-e057-4280-8833-d7b6a6b89797 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 15:56:07.611584 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-8a64447c-e057-4280-8833-d7b6a6b89797 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 15:56:07.623879 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8a64447c-e057-4280-8833-d7b6a6b89797 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:07.625121 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8a64447c-e057-4280-8833-d7b6a6b89797 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:07.625788 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8a64447c-e057-4280-8833-d7b6a6b89797 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:07.627257 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8a64447c-e057-4280-8833-d7b6a6b89797 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:07.628133 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8a64447c-e057-4280-8833-d7b6a6b89797 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:07.628794 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8a64447c-e057-4280-8833-d7b6a6b89797 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:07.684207 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-8a64447c-e057-4280-8833-d7b6a6b89797 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Getting quotas for project f6e5507d53224d19804717493d60bb71. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:56:07.694306 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-8a64447c-e057-4280-8833-d7b6a6b89797 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Getting quotas for user fa377b1dedae45d2a804919e5ea69a00 and project f6e5507d53224d19804717493d60bb71. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:56:07.757787 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8a64447c-e057-4280-8833-d7b6a6b89797 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Going to run 1 instances... {{(pid=122257) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 15:56:07.770910 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8a64447c-e057-4280-8833-d7b6a6b89797 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] [instance: 3a0126e3-2324-4892-8908-2b6d2d5e2158] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 15:56:07.867335 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8a64447c-e057-4280-8833-d7b6a6b89797 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.266258 Aug 31 15:56:07.875322 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 47/101] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 15:56:04 2022] POST /compute/v2.1/servers => generated 402 bytes in 3274 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 15:56:07.884230 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8080f629-db5d-46af-aa7b-1bd6c64518cb tempest-FlavorsV255TestJSON-1104526233 tempest-FlavorsV255TestJSON-1104526233-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:07.928312 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8080f629-db5d-46af-aa7b-1bd6c64518cb tempest-FlavorsV255TestJSON-1104526233 tempest-FlavorsV255TestJSON-1104526233-project] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 6592 microversion: 2.55 time: 0.049352 Aug 31 15:56:07.934240 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 48/102] 10.222.0.61 () {60 vars in 1187 bytes} [Wed Aug 31 15:56:07 2022] GET /compute/v2.1/flavors/detail => generated 6592 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:56:07.947089 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4b221163-aabe-4cc0-bd30-a237e4b88b2e tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:07.948980 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4b221163-aabe-4cc0-bd30-a237e4b88b2e tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] [instance: 3a0126e3-2324-4892-8908-2b6d2d5e2158] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:08.088680 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3d5ee564-a9d2-49bb-a466-b44216fbe06b tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:08.104208 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3d5ee564-a9d2-49bb-a466-b44216fbe06b tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:08.112592 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3d5ee564-a9d2-49bb-a466-b44216fbe06b tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:08.130572 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3d5ee564-a9d2-49bb-a466-b44216fbe06b tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] 10.222.0.61 "GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174" status: 200 len: 1411 microversion: 2.75 time: 0.633183 Aug 31 15:56:08.145018 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 55/103] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:56:07 2022] GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174 => generated 1411 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:56:08.151973 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ce1a436e-3dc8-4e36-9bcd-980c9b076fc0 tempest-FlavorsV255TestJSON-1104526233 tempest-FlavorsV255TestJSON-1104526233-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:08.174084 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-4b221163-aabe-4cc0-bd30-a237e4b88b2e tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377b1dedae45d2a804919e5ea69a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e5507d53224d19804717493d60bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:08.189107 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4b221163-aabe-4cc0-bd30-a237e4b88b2e tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] 10.222.0.61 "GET /compute/v2.1/servers/3a0126e3-2324-4892-8908-2b6d2d5e2158" status: 200 len: 1263 microversion: 2.1 time: 0.249643 Aug 31 15:56:08.190211 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 49/104] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:07 2022] GET /compute/v2.1/servers/3a0126e3-2324-4892-8908-2b6d2d5e2158 => generated 1263 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:08.250947 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ce1a436e-3dc8-4e36-9bcd-980c9b076fc0 tempest-FlavorsV255TestJSON-1104526233 tempest-FlavorsV255TestJSON-1104526233-project] 10.222.0.61 "GET /compute/v2.1/flavors" status: 200 len: 3682 microversion: 2.55 time: 0.118638 Aug 31 15:56:08.258216 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 56/105] 10.222.0.61 () {60 vars in 1166 bytes} [Wed Aug 31 15:56:08 2022] GET /compute/v2.1/flavors => generated 3682 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:56:08.282159 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-84874bde-4e15-4e4f-9d99-2188bfed48ba tempest-FlavorsV255TestJSON-1053766963 tempest-FlavorsV255TestJSON-1053766963-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:08.339278 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-84874bde-4e15-4e4f-9d99-2188bfed48ba tempest-FlavorsV255TestJSON-1053766963 tempest-FlavorsV255TestJSON-1053766963-project-admin] 10.222.0.61 "DELETE /compute/v2.1/flavors/1686453229" status: 202 len: 0 microversion: 2.55 time: 0.063421 Aug 31 15:56:08.345137 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 50/106] 10.222.0.61 () {60 vars in 1202 bytes} [Wed Aug 31 15:56:08 2022] DELETE /compute/v2.1/flavors/1686453229 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 15:56:08.349679 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8fefea34-a008-48ea-80de-12c98b56f3ea tempest-FlavorsV255TestJSON-1053766963 tempest-FlavorsV255TestJSON-1053766963-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:08.406452 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8fefea34-a008-48ea-80de-12c98b56f3ea tempest-FlavorsV255TestJSON-1053766963 tempest-FlavorsV255TestJSON-1053766963-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 6153 microversion: 2.55 time: 0.057887 Aug 31 15:56:08.410819 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 57/107] 10.222.0.61 () {60 vars in 1187 bytes} [Wed Aug 31 15:56:08 2022] GET /compute/v2.1/flavors/detail => generated 6153 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:56:08.440475 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-24b84e8c-c000-452c-9001-71ef4c2fcdf3 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:08.444211 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-24b84e8c-c000-452c-9001-71ef4c2fcdf3 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] [instance: 94898cf4-0065-4b87-acb5-e8d11bd1529a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:08.471262 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-24b84e8c-c000-452c-9001-71ef4c2fcdf3 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:08.472377 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-24b84e8c-c000-452c-9001-71ef4c2fcdf3 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:08.475075 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-24b84e8c-c000-452c-9001-71ef4c2fcdf3 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:08.478225 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-24b84e8c-c000-452c-9001-71ef4c2fcdf3 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:08.481422 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-24b84e8c-c000-452c-9001-71ef4c2fcdf3 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:08.484737 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-24b84e8c-c000-452c-9001-71ef4c2fcdf3 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:09.162610 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-95f89cef-53a2-4b4d-8e1e-79ed3c457581 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:09.165006 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-95f89cef-53a2-4b4d-8e1e-79ed3c457581 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] [instance: f2162319-5635-4c77-920d-9ecb3221d174] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:09.199128 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-95f89cef-53a2-4b4d-8e1e-79ed3c457581 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:09.209379 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-95f89cef-53a2-4b4d-8e1e-79ed3c457581 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:09.210171 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-95f89cef-53a2-4b4d-8e1e-79ed3c457581 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:09.211243 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-95f89cef-53a2-4b4d-8e1e-79ed3c457581 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:09.212213 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-95f89cef-53a2-4b4d-8e1e-79ed3c457581 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:09.216182 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-95f89cef-53a2-4b4d-8e1e-79ed3c457581 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:09.332520 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-24b84e8c-c000-452c-9001-71ef4c2fcdf3 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe750fe96e2444489edce1b2750fa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8904771b5154454896715024aa20bbcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:09.354073 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-24b84e8c-c000-452c-9001-71ef4c2fcdf3 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] 10.222.0.61 "GET /compute/v2.1/servers/94898cf4-0065-4b87-acb5-e8d11bd1529a" status: 200 len: 1338 microversion: 2.1 time: 0.919047 Aug 31 15:56:09.355425 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 51/108] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:08 2022] GET /compute/v2.1/servers/94898cf4-0065-4b87-acb5-e8d11bd1529a => generated 1338 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:09.362135 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-67ac1054-bb91-48be-9faa-bf2b49f6d1ea tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:09.363178 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-67ac1054-bb91-48be-9faa-bf2b49f6d1ea tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] [instance: 3a0126e3-2324-4892-8908-2b6d2d5e2158] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:09.370433 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-67ac1054-bb91-48be-9faa-bf2b49f6d1ea tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:09.371349 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-67ac1054-bb91-48be-9faa-bf2b49f6d1ea tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:09.372137 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-67ac1054-bb91-48be-9faa-bf2b49f6d1ea tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:09.373278 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-67ac1054-bb91-48be-9faa-bf2b49f6d1ea tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:09.374159 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-67ac1054-bb91-48be-9faa-bf2b49f6d1ea tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:09.374942 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-67ac1054-bb91-48be-9faa-bf2b49f6d1ea tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:09.476724 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-95f89cef-53a2-4b4d-8e1e-79ed3c457581 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:09.486547 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-95f89cef-53a2-4b4d-8e1e-79ed3c457581 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:09.489868 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-95f89cef-53a2-4b4d-8e1e-79ed3c457581 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:09.511521 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-95f89cef-53a2-4b4d-8e1e-79ed3c457581 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] 10.222.0.61 "GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174" status: 200 len: 1417 microversion: 2.75 time: 0.353037 Aug 31 15:56:09.511829 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-67ac1054-bb91-48be-9faa-bf2b49f6d1ea tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377b1dedae45d2a804919e5ea69a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e5507d53224d19804717493d60bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:09.520740 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 58/109] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:56:09 2022] GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174 => generated 1417 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:56:09.539865 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-67ac1054-bb91-48be-9faa-bf2b49f6d1ea tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] 10.222.0.61 "GET /compute/v2.1/servers/3a0126e3-2324-4892-8908-2b6d2d5e2158" status: 200 len: 1259 microversion: 2.1 time: 0.183051 Aug 31 15:56:09.541643 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 52/110] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:09 2022] GET /compute/v2.1/servers/3a0126e3-2324-4892-8908-2b6d2d5e2158 => generated 1259 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:10.378453 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e9d61fd3-c65c-417b-9d0c-fb61b678d94f tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:10.379667 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e9d61fd3-c65c-417b-9d0c-fb61b678d94f tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] [instance: 94898cf4-0065-4b87-acb5-e8d11bd1529a] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:10.403707 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e9d61fd3-c65c-417b-9d0c-fb61b678d94f tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:10.410795 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e9d61fd3-c65c-417b-9d0c-fb61b678d94f tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:10.411852 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e9d61fd3-c65c-417b-9d0c-fb61b678d94f tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:10.413966 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e9d61fd3-c65c-417b-9d0c-fb61b678d94f tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:10.415973 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e9d61fd3-c65c-417b-9d0c-fb61b678d94f tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:10.416668 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e9d61fd3-c65c-417b-9d0c-fb61b678d94f tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:10.545801 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-878d1d04-27cd-4d3e-9aba-1d5412f3d7ec tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:10.546733 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-878d1d04-27cd-4d3e-9aba-1d5412f3d7ec tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] [instance: f2162319-5635-4c77-920d-9ecb3221d174] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:10.559543 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-878d1d04-27cd-4d3e-9aba-1d5412f3d7ec tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:10.561669 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-878d1d04-27cd-4d3e-9aba-1d5412f3d7ec tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:10.563939 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-878d1d04-27cd-4d3e-9aba-1d5412f3d7ec tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:10.565734 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-878d1d04-27cd-4d3e-9aba-1d5412f3d7ec tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:10.568306 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-878d1d04-27cd-4d3e-9aba-1d5412f3d7ec tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:10.569621 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-878d1d04-27cd-4d3e-9aba-1d5412f3d7ec tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:11.013536 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-878d1d04-27cd-4d3e-9aba-1d5412f3d7ec tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:11.031013 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-878d1d04-27cd-4d3e-9aba-1d5412f3d7ec tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:11.037649 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-878d1d04-27cd-4d3e-9aba-1d5412f3d7ec tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:11.063783 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-878d1d04-27cd-4d3e-9aba-1d5412f3d7ec tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] 10.222.0.61 "GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174" status: 200 len: 1417 microversion: 2.75 time: 0.520809 Aug 31 15:56:11.067263 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 53/111] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:56:10 2022] GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174 => generated 1417 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:56:11.079479 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ff3e9590-317b-4d2b-85e0-3ee1194391f8 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:11.080563 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ff3e9590-317b-4d2b-85e0-3ee1194391f8 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] [instance: 3a0126e3-2324-4892-8908-2b6d2d5e2158] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:11.105442 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ff3e9590-317b-4d2b-85e0-3ee1194391f8 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:11.113693 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ff3e9590-317b-4d2b-85e0-3ee1194391f8 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:11.115128 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ff3e9590-317b-4d2b-85e0-3ee1194391f8 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:11.118079 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ff3e9590-317b-4d2b-85e0-3ee1194391f8 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:11.119595 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ff3e9590-317b-4d2b-85e0-3ee1194391f8 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:11.120237 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ff3e9590-317b-4d2b-85e0-3ee1194391f8 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:11.220823 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e9d61fd3-c65c-417b-9d0c-fb61b678d94f tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe750fe96e2444489edce1b2750fa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8904771b5154454896715024aa20bbcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:11.228397 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e9d61fd3-c65c-417b-9d0c-fb61b678d94f tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] 10.222.0.61 "GET /compute/v2.1/servers/94898cf4-0065-4b87-acb5-e8d11bd1529a" status: 200 len: 1338 microversion: 2.1 time: 0.855684 Aug 31 15:56:11.228986 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 59/112] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:10 2022] GET /compute/v2.1/servers/94898cf4-0065-4b87-acb5-e8d11bd1529a => generated 1338 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:11.278096 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ff3e9590-317b-4d2b-85e0-3ee1194391f8 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377b1dedae45d2a804919e5ea69a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e5507d53224d19804717493d60bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:11.289643 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ff3e9590-317b-4d2b-85e0-3ee1194391f8 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] 10.222.0.61 "GET /compute/v2.1/servers/3a0126e3-2324-4892-8908-2b6d2d5e2158" status: 200 len: 1321 microversion: 2.1 time: 0.220581 Aug 31 15:56:11.294989 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 54/113] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:11 2022] GET /compute/v2.1/servers/3a0126e3-2324-4892-8908-2b6d2d5e2158 => generated 1321 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:12.106152 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-42c2bba9-acb0-4233-82c7-2188ec9407a6 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:12.106749 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-42c2bba9-acb0-4233-82c7-2188ec9407a6 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] [instance: f2162319-5635-4c77-920d-9ecb3221d174] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:12.141792 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42c2bba9-acb0-4233-82c7-2188ec9407a6 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:12.142226 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42c2bba9-acb0-4233-82c7-2188ec9407a6 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:12.144526 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42c2bba9-acb0-4233-82c7-2188ec9407a6 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:12.146258 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42c2bba9-acb0-4233-82c7-2188ec9407a6 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:12.147188 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42c2bba9-acb0-4233-82c7-2188ec9407a6 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:12.148220 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42c2bba9-acb0-4233-82c7-2188ec9407a6 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:12.274254 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-578cfc55-2a09-4adc-8b3d-43c1c5144dfc tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:12.276432 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-578cfc55-2a09-4adc-8b3d-43c1c5144dfc tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] [instance: 94898cf4-0065-4b87-acb5-e8d11bd1529a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:12.307248 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-578cfc55-2a09-4adc-8b3d-43c1c5144dfc tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:12.309553 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-578cfc55-2a09-4adc-8b3d-43c1c5144dfc tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:12.311620 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-578cfc55-2a09-4adc-8b3d-43c1c5144dfc tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:12.313958 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-578cfc55-2a09-4adc-8b3d-43c1c5144dfc tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:12.314764 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-578cfc55-2a09-4adc-8b3d-43c1c5144dfc tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:12.315572 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-578cfc55-2a09-4adc-8b3d-43c1c5144dfc tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:12.346312 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-42c2bba9-acb0-4233-82c7-2188ec9407a6 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:12.369057 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-42c2bba9-acb0-4233-82c7-2188ec9407a6 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:12.374470 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-42c2bba9-acb0-4233-82c7-2188ec9407a6 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:12.390464 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-42c2bba9-acb0-4233-82c7-2188ec9407a6 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] 10.222.0.61 "GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174" status: 200 len: 1417 microversion: 2.75 time: 0.292409 Aug 31 15:56:12.397756 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 60/114] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:56:12 2022] GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174 => generated 1417 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:56:12.405503 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-69ea858e-c9f4-4ce6-a133-64e4b5ccd155 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:12.406740 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-69ea858e-c9f4-4ce6-a133-64e4b5ccd155 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] [instance: 3a0126e3-2324-4892-8908-2b6d2d5e2158] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:12.434295 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-69ea858e-c9f4-4ce6-a133-64e4b5ccd155 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:12.435216 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-69ea858e-c9f4-4ce6-a133-64e4b5ccd155 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:12.436772 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-69ea858e-c9f4-4ce6-a133-64e4b5ccd155 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:12.438063 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-69ea858e-c9f4-4ce6-a133-64e4b5ccd155 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:12.438932 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-69ea858e-c9f4-4ce6-a133-64e4b5ccd155 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:12.439770 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-69ea858e-c9f4-4ce6-a133-64e4b5ccd155 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:12.616611 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-69ea858e-c9f4-4ce6-a133-64e4b5ccd155 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377b1dedae45d2a804919e5ea69a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e5507d53224d19804717493d60bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:12.632488 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-69ea858e-c9f4-4ce6-a133-64e4b5ccd155 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] 10.222.0.61 "GET /compute/v2.1/servers/3a0126e3-2324-4892-8908-2b6d2d5e2158" status: 200 len: 1321 microversion: 2.1 time: 0.233323 Aug 31 15:56:12.633168 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 61/115] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:12 2022] GET /compute/v2.1/servers/3a0126e3-2324-4892-8908-2b6d2d5e2158 => generated 1321 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:12.752023 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-578cfc55-2a09-4adc-8b3d-43c1c5144dfc tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe750fe96e2444489edce1b2750fa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8904771b5154454896715024aa20bbcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:12.761979 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-578cfc55-2a09-4adc-8b3d-43c1c5144dfc tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] 10.222.0.61 "GET /compute/v2.1/servers/94898cf4-0065-4b87-acb5-e8d11bd1529a" status: 200 len: 1338 microversion: 2.1 time: 0.499435 Aug 31 15:56:12.768137 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 55/116] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:12 2022] GET /compute/v2.1/servers/94898cf4-0065-4b87-acb5-e8d11bd1529a => generated 1338 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:13.429768 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-dc9d78c4-b42b-4d2e-aff2-fdbe5fcf7e6e tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:13.431224 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-dc9d78c4-b42b-4d2e-aff2-fdbe5fcf7e6e tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] [instance: f2162319-5635-4c77-920d-9ecb3221d174] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:13.439579 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dc9d78c4-b42b-4d2e-aff2-fdbe5fcf7e6e tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:13.440377 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dc9d78c4-b42b-4d2e-aff2-fdbe5fcf7e6e tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:13.441000 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dc9d78c4-b42b-4d2e-aff2-fdbe5fcf7e6e tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:13.442004 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dc9d78c4-b42b-4d2e-aff2-fdbe5fcf7e6e tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:13.442630 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dc9d78c4-b42b-4d2e-aff2-fdbe5fcf7e6e tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:13.443326 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dc9d78c4-b42b-4d2e-aff2-fdbe5fcf7e6e tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:13.550966 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1d9dea09-5be7-4d29-8008-57f9efe3f16a tempest-FlavorsV2NegativeTest-1759592407 tempest-FlavorsV2NegativeTest-1759592407-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:13.568937 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1d9dea09-5be7-4d29-8008-57f9efe3f16a tempest-FlavorsV2NegativeTest-1759592407 tempest-FlavorsV2NegativeTest-1759592407-project] 10.222.0.61 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.685656 Aug 31 15:56:13.570142 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 62/117] 10.222.0.61 () {58 vars in 1137 bytes} [Wed Aug 31 15:56:12 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:56:13.657644 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e01c6165-f48d-48b1-90c4-333a3776acb8 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:13.658465 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e01c6165-f48d-48b1-90c4-333a3776acb8 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] [instance: 3a0126e3-2324-4892-8908-2b6d2d5e2158] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:13.665197 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e01c6165-f48d-48b1-90c4-333a3776acb8 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:13.681041 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e01c6165-f48d-48b1-90c4-333a3776acb8 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:13.683472 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e01c6165-f48d-48b1-90c4-333a3776acb8 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:13.688446 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e01c6165-f48d-48b1-90c4-333a3776acb8 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:13.691138 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e01c6165-f48d-48b1-90c4-333a3776acb8 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:13.695046 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-dc9d78c4-b42b-4d2e-aff2-fdbe5fcf7e6e tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:13.696125 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e01c6165-f48d-48b1-90c4-333a3776acb8 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:13.713255 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-dc9d78c4-b42b-4d2e-aff2-fdbe5fcf7e6e tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:13.722936 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-dc9d78c4-b42b-4d2e-aff2-fdbe5fcf7e6e tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:13.735406 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-dc9d78c4-b42b-4d2e-aff2-fdbe5fcf7e6e tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] 10.222.0.61 "GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174" status: 200 len: 1417 microversion: 2.75 time: 0.313901 Aug 31 15:56:13.746154 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 56/118] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:56:13 2022] GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174 => generated 1417 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:56:13.799027 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b87fd3af-b3a9-47e4-9cd6-b6438dd99b19 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:13.799850 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b87fd3af-b3a9-47e4-9cd6-b6438dd99b19 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] [instance: 94898cf4-0065-4b87-acb5-e8d11bd1529a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:13.812548 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b87fd3af-b3a9-47e4-9cd6-b6438dd99b19 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:13.813007 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b87fd3af-b3a9-47e4-9cd6-b6438dd99b19 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:13.813431 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b87fd3af-b3a9-47e4-9cd6-b6438dd99b19 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:13.814062 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b87fd3af-b3a9-47e4-9cd6-b6438dd99b19 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:13.820134 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b87fd3af-b3a9-47e4-9cd6-b6438dd99b19 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:13.820965 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b87fd3af-b3a9-47e4-9cd6-b6438dd99b19 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:14.534762 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e01c6165-f48d-48b1-90c4-333a3776acb8 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377b1dedae45d2a804919e5ea69a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e5507d53224d19804717493d60bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:14.543617 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e01c6165-f48d-48b1-90c4-333a3776acb8 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] 10.222.0.61 "GET /compute/v2.1/servers/3a0126e3-2324-4892-8908-2b6d2d5e2158" status: 200 len: 1389 microversion: 2.1 time: 0.890669 Aug 31 15:56:14.551735 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b87fd3af-b3a9-47e4-9cd6-b6438dd99b19 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe750fe96e2444489edce1b2750fa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8904771b5154454896715024aa20bbcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:14.563827 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b87fd3af-b3a9-47e4-9cd6-b6438dd99b19 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] 10.222.0.61 "GET /compute/v2.1/servers/94898cf4-0065-4b87-acb5-e8d11bd1529a" status: 200 len: 1338 microversion: 2.1 time: 0.775139 Aug 31 15:56:14.576018 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 63/119] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:13 2022] GET /compute/v2.1/servers/3a0126e3-2324-4892-8908-2b6d2d5e2158 => generated 1389 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:14.584822 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 57/120] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:13 2022] GET /compute/v2.1/servers/94898cf4-0065-4b87-acb5-e8d11bd1529a => generated 1338 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:14.970507 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-b99d5e6d-b99c-422a-b5ba-f3506c54c9bb req-4eeeaf99-bda2-4351-be36-c51f3bb468fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94898cf4-0065-4b87-acb5-e8d11bd1529a", "tag": "455d9782-e6ff-49f1-b13c-8ca98fbeb37c"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:56:15.019170 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-b99d5e6d-b99c-422a-b5ba-f3506c54c9bb req-4eeeaf99-bda2-4351-be36-c51f3bb468fd service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:15.025479 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-b99d5e6d-b99c-422a-b5ba-f3506c54c9bb req-4eeeaf99-bda2-4351-be36-c51f3bb468fd service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:15.027911 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-b99d5e6d-b99c-422a-b5ba-f3506c54c9bb req-4eeeaf99-bda2-4351-be36-c51f3bb468fd service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:15.081672 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-b99d5e6d-b99c-422a-b5ba-f3506c54c9bb req-4eeeaf99-bda2-4351-be36-c51f3bb468fd service nova] Creating event network-changed:455d9782-e6ff-49f1-b13c-8ca98fbeb37c for instance 94898cf4-0065-4b87-acb5-e8d11bd1529a on n-h1-850499-9 Aug 31 15:56:15.082409 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-b99d5e6d-b99c-422a-b5ba-f3506c54c9bb req-4eeeaf99-bda2-4351-be36-c51f3bb468fd service nova] Acquiring lock "compute-rpcapi-router" {{(pid=122256) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 31 15:56:15.083793 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-b99d5e6d-b99c-422a-b5ba-f3506c54c9bb req-4eeeaf99-bda2-4351-be36-c51f3bb468fd service nova] Acquired lock "compute-rpcapi-router" {{(pid=122256) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 31 15:56:15.085764 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0e0ce6f8-721b-4697-8722-c6f9ec6c5bc7 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:15.087880 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0e0ce6f8-721b-4697-8722-c6f9ec6c5bc7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:15.089994 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0e0ce6f8-721b-4697-8722-c6f9ec6c5bc7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:15.090871 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0e0ce6f8-721b-4697-8722-c6f9ec6c5bc7 None None] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:15.093564 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0e0ce6f8-721b-4697-8722-c6f9ec6c5bc7 None None] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:15.094137 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0e0ce6f8-721b-4697-8722-c6f9ec6c5bc7 None None] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:15.127444 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.compute.rpcapi [None req-0e0ce6f8-721b-4697-8722-c6f9ec6c5bc7 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 31 15:56:15.135573 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0e0ce6f8-721b-4697-8722-c6f9ec6c5bc7 None None] Releasing lock "compute-rpcapi-router" {{(pid=122256) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 31 15:56:15.137007 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5e744580-c4eb-45a6-a528-081d496470fe tempest-KeyPairsV210TestJSON-2059539415 tempest-KeyPairsV210TestJSON-2059539415-project-admin] Action: 'create', calling method: .version_select at 0x7f5ae9a37f70>, body: {"keypair": {"name": "tempest-keypair-873104908", "type": "ssh", "user_id": "0af4bbc68c5a4c9e84f3de31352ad5c4", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP9SeR4PeNFRXA0YaXxh3Onac6ckX5g/LjRyPpcqDm3L5feaMvwLoffMUGXYne6vbd12vQ1x3qT5+kJjm/v+Csq9vu4XF4QZiwVBoxHC0zzZZTqc9vJsLbARFk+Kc+tVwQ=="}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:56:15.179313 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0e0ce6f8-721b-4697-8722-c6f9ec6c5bc7 None None] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.600277 Aug 31 15:56:15.182341 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 64/121] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 15:56:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:56:15.201088 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-5e744580-c4eb-45a6-a528-081d496470fe tempest-KeyPairsV210TestJSON-2059539415 tempest-KeyPairsV210TestJSON-2059539415-project-admin] Getting quotas for project 8c19e8f9c10b434591d96c2e14d053ba. Resources: {'key_pairs'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:56:15.203548 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-80a34831-06b1-4ff7-8194-820ac6e4156e tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:15.204355 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-80a34831-06b1-4ff7-8194-820ac6e4156e tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] [instance: f2162319-5635-4c77-920d-9ecb3221d174] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:15.223787 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-5e744580-c4eb-45a6-a528-081d496470fe tempest-KeyPairsV210TestJSON-2059539415 tempest-KeyPairsV210TestJSON-2059539415-project-admin] Getting quotas for user f5738016960441aebfd49e1eda1b3a60 and project 8c19e8f9c10b434591d96c2e14d053ba. Resources: {'key_pairs'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:56:15.229039 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-80a34831-06b1-4ff7-8194-820ac6e4156e tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:15.229631 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-80a34831-06b1-4ff7-8194-820ac6e4156e tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:15.230206 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-80a34831-06b1-4ff7-8194-820ac6e4156e tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:15.236132 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-80a34831-06b1-4ff7-8194-820ac6e4156e tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:15.236757 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-80a34831-06b1-4ff7-8194-820ac6e4156e tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:15.237216 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-80a34831-06b1-4ff7-8194-820ac6e4156e tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:15.269022 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5e744580-c4eb-45a6-a528-081d496470fe tempest-KeyPairsV210TestJSON-2059539415 tempest-KeyPairsV210TestJSON-2059539415-project-admin] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.643141 Aug 31 15:56:15.270407 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 58/122] 10.222.0.61 () {62 vars in 1200 bytes} [Wed Aug 31 15:56:14 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 647 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 31 15:56:15.288161 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a5a2e1a2-3f12-4927-9c74-996e96ef5ae3 tempest-KeyPairsV210TestJSON-2059539415 tempest-KeyPairsV210TestJSON-2059539415-project-admin] Action: 'create', calling method: .version_select at 0x7f5ae99b8550>, body: {"keypair": {"name": "tempest-keypair-845004547", "type": "ssh", "user_id": "0af4bbc68c5a4c9e84f3de31352ad5c4", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEcGQQXsBnn/HL5pVjij8tkt7cMYVF9LJRAB+yI9iJ/GqVQrO4y8g+jm3rRmHOqY8IOR46HXwrF0XDkakXf/pk6a5uowUb5vKXRWm9MWtsEV6YkPhx14gkphVZiUG2Uanw=="}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:56:15.313157 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-a5a2e1a2-3f12-4927-9c74-996e96ef5ae3 tempest-KeyPairsV210TestJSON-2059539415 tempest-KeyPairsV210TestJSON-2059539415-project-admin] Getting quotas for project 8c19e8f9c10b434591d96c2e14d053ba. Resources: {'key_pairs'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:56:15.323953 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-a5a2e1a2-3f12-4927-9c74-996e96ef5ae3 tempest-KeyPairsV210TestJSON-2059539415 tempest-KeyPairsV210TestJSON-2059539415-project-admin] Getting quotas for user f5738016960441aebfd49e1eda1b3a60 and project 8c19e8f9c10b434591d96c2e14d053ba. Resources: {'key_pairs'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:56:15.375445 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a5a2e1a2-3f12-4927-9c74-996e96ef5ae3 tempest-KeyPairsV210TestJSON-2059539415 tempest-KeyPairsV210TestJSON-2059539415-project-admin] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.079585 Aug 31 15:56:15.377918 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 59/123] 10.222.0.61 () {62 vars in 1200 bytes} [Wed Aug 31 15:56:15 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 98 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 31 15:56:15.391465 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a0847317-08b9-4e77-8e14-378eb8488cd8 tempest-KeyPairsV210TestJSON-2059539415 tempest-KeyPairsV210TestJSON-2059539415-project-admin] Calling method '.version_select at 0x7f5ae99ac1f0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:15.417012 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a0847317-08b9-4e77-8e14-378eb8488cd8 tempest-KeyPairsV210TestJSON-2059539415 tempest-KeyPairsV210TestJSON-2059539415-project-admin] 10.222.0.61 "GET /compute/v2.1/os-keypairs/tempest-keypair-873104908?user_id=0af4bbc68c5a4c9e84f3de31352ad5c4" status: 200 len: 511 microversion: 2.10 time: 0.032238 Aug 31 15:56:15.418210 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 60/124] 10.222.0.61 () {60 vars in 1337 bytes} [Wed Aug 31 15:56:15 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-873104908?user_id=0af4bbc68c5a4c9e84f3de31352ad5c4 => generated 511 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 15:56:15.440684 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-48a0dd47-bd06-452b-a321-00626c3af6dd tempest-KeyPairsV210TestJSON-2059539415 tempest-KeyPairsV210TestJSON-2059539415-project-admin] Action: 'create', calling method: .version_select at 0x7f5ae99acc10>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-1310246643", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN2OVUGJzd8qXF2pqFlqA9z3IS5h8WS6hOA/PQW+02TiMPUsfZk2V2CpQLBl8gMIEc/l8HhH16QZ6x3s6veoHfxSbHM30znTfCG0B/Pn1aAK13yPnNBGHZ7x3f/3ArUGug=="}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:56:15.462281 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=7,nova_api:DELETE=7 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:56:15.471245 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-48a0dd47-bd06-452b-a321-00626c3af6dd tempest-KeyPairsV210TestJSON-2059539415 tempest-KeyPairsV210TestJSON-2059539415-project-admin] Getting quotas for project 8c19e8f9c10b434591d96c2e14d053ba. Resources: {'key_pairs'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:56:15.492056 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-48a0dd47-bd06-452b-a321-00626c3af6dd tempest-KeyPairsV210TestJSON-2059539415 tempest-KeyPairsV210TestJSON-2059539415-project-admin] Getting quotas for user f5738016960441aebfd49e1eda1b3a60 and project 8c19e8f9c10b434591d96c2e14d053ba. Resources: {'key_pairs'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:56:15.531093 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-80a34831-06b1-4ff7-8194-820ac6e4156e tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:15.544004 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-80a34831-06b1-4ff7-8194-820ac6e4156e tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:15.553057 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-80a34831-06b1-4ff7-8194-820ac6e4156e tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:15.572014 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-48a0dd47-bd06-452b-a321-00626c3af6dd tempest-KeyPairsV210TestJSON-2059539415 tempest-KeyPairsV210TestJSON-2059539415-project-admin] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.136256 Aug 31 15:56:15.578082 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 61/125] 10.222.0.61 () {62 vars in 1200 bytes} [Wed Aug 31 15:56:15 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 143 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 31 15:56:15.578766 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-80a34831-06b1-4ff7-8194-820ac6e4156e tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] 10.222.0.61 "GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174" status: 200 len: 1417 microversion: 2.75 time: 0.393178 Aug 31 15:56:15.581803 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 65/126] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:56:15 2022] GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174 => generated 1417 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:56:15.607894 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-33b0c542-3370-48dc-b480-cdb1d9c9ec11 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:15.609918 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-cb9916ee-cf2e-44ce-b4dd-255c5d4d1aad tempest-KeyPairsV210TestJSON-2059539415 tempest-KeyPairsV210TestJSON-2059539415-project-admin] Calling method '.version_select at 0x7f5ae99a6c10>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:15.611467 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-33b0c542-3370-48dc-b480-cdb1d9c9ec11 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] [instance: 3a0126e3-2324-4892-8908-2b6d2d5e2158] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:15.625541 n-d-850499-9 devstack@n-api.service[122256]: WARNING oslo_db.sqlalchemy.utils [None req-cb9916ee-cf2e-44ce-b4dd-255c5d4d1aad tempest-KeyPairsV210TestJSON-2059539415 tempest-KeyPairsV210TestJSON-2059539415-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Aug 31 15:56:15.630666 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-33b0c542-3370-48dc-b480-cdb1d9c9ec11 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:15.632847 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-33b0c542-3370-48dc-b480-cdb1d9c9ec11 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:15.635294 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-33b0c542-3370-48dc-b480-cdb1d9c9ec11 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:15.637557 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-33b0c542-3370-48dc-b480-cdb1d9c9ec11 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:15.642061 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-33b0c542-3370-48dc-b480-cdb1d9c9ec11 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:15.644294 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-33b0c542-3370-48dc-b480-cdb1d9c9ec11 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:15.655351 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-cb9916ee-cf2e-44ce-b4dd-255c5d4d1aad tempest-KeyPairsV210TestJSON-2059539415 tempest-KeyPairsV210TestJSON-2059539415-project-admin] 10.222.0.61 "GET /compute/v2.1/os-keypairs?user_id=0af4bbc68c5a4c9e84f3de31352ad5c4" status: 200 len: 724 microversion: 2.10 time: 0.057637 Aug 31 15:56:15.656454 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 66/127] 10.222.0.61 () {60 vars in 1259 bytes} [Wed Aug 31 15:56:15 2022] GET /compute/v2.1/os-keypairs?user_id=0af4bbc68c5a4c9e84f3de31352ad5c4 => generated 724 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 15:56:15.674513 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-58955464-7072-4b60-a3ad-0467c14726f8 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:15.677449 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-58955464-7072-4b60-a3ad-0467c14726f8 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] [instance: 94898cf4-0065-4b87-acb5-e8d11bd1529a] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:15.712809 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-58955464-7072-4b60-a3ad-0467c14726f8 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:15.713758 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-58955464-7072-4b60-a3ad-0467c14726f8 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:15.715124 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-58955464-7072-4b60-a3ad-0467c14726f8 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:15.719003 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-58955464-7072-4b60-a3ad-0467c14726f8 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:15.720461 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-58955464-7072-4b60-a3ad-0467c14726f8 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:15.720911 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-58955464-7072-4b60-a3ad-0467c14726f8 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:16.137401 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=12 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:56:16.968463 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-58955464-7072-4b60-a3ad-0467c14726f8 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe750fe96e2444489edce1b2750fa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8904771b5154454896715024aa20bbcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:16.987253 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-58955464-7072-4b60-a3ad-0467c14726f8 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] 10.222.0.61 "GET /compute/v2.1/servers/94898cf4-0065-4b87-acb5-e8d11bd1529a" status: 200 len: 1338 microversion: 2.1 time: 1.327869 Aug 31 15:56:16.992655 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 67/128] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:15 2022] GET /compute/v2.1/servers/94898cf4-0065-4b87-acb5-e8d11bd1529a => generated 1338 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:17.009638 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8232a93a-3f8b-47ce-8f72-601cc688e483 tempest-KeyPairsV210TestJSON-2059539415 tempest-KeyPairsV210TestJSON-2059539415-project-admin] Calling method '.version_select at 0x7f5ae99a64c0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:17.014856 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-33b0c542-3370-48dc-b480-cdb1d9c9ec11 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377b1dedae45d2a804919e5ea69a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e5507d53224d19804717493d60bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:17.031265 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-33b0c542-3370-48dc-b480-cdb1d9c9ec11 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] 10.222.0.61 "GET /compute/v2.1/servers/3a0126e3-2324-4892-8908-2b6d2d5e2158" status: 200 len: 1389 microversion: 2.1 time: 1.442738 Aug 31 15:56:17.048703 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 62/129] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:15 2022] GET /compute/v2.1/servers/3a0126e3-2324-4892-8908-2b6d2d5e2158 => generated 1389 bytes in 1462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:17.075470 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-13694040-803e-4996-8f5a-ff2b0bfd7f44 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:17.081306 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-13694040-803e-4996-8f5a-ff2b0bfd7f44 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] [instance: f2162319-5635-4c77-920d-9ecb3221d174] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:17.113904 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8232a93a-3f8b-47ce-8f72-601cc688e483 tempest-KeyPairsV210TestJSON-2059539415 tempest-KeyPairsV210TestJSON-2059539415-project-admin] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1310246643" status: 204 len: 0 microversion: 2.10 time: 0.117751 Aug 31 15:56:17.115819 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-13694040-803e-4996-8f5a-ff2b0bfd7f44 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:17.116633 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-13694040-803e-4996-8f5a-ff2b0bfd7f44 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:17.118704 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 68/130] 10.222.0.61 () {60 vars in 1325 bytes} [Wed Aug 31 15:56:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1310246643 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 15:56:17.120126 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-13694040-803e-4996-8f5a-ff2b0bfd7f44 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:17.126329 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-13694040-803e-4996-8f5a-ff2b0bfd7f44 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:17.129557 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-13694040-803e-4996-8f5a-ff2b0bfd7f44 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:17.131328 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-13694040-803e-4996-8f5a-ff2b0bfd7f44 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:17.146613 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4ce170ed-3b48-4477-9261-6eaeb14be3df tempest-KeyPairsV210TestJSON-2059539415 tempest-KeyPairsV210TestJSON-2059539415-project-admin] Calling method '.version_select at 0x7f5ae9a48ca0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:17.245206 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4ce170ed-3b48-4477-9261-6eaeb14be3df tempest-KeyPairsV210TestJSON-2059539415 tempest-KeyPairsV210TestJSON-2059539415-project-admin] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-845004547?user_id=0af4bbc68c5a4c9e84f3de31352ad5c4" status: 204 len: 0 microversion: 2.10 time: 0.117323 Aug 31 15:56:17.256802 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 69/131] 10.222.0.61 () {60 vars in 1340 bytes} [Wed Aug 31 15:56:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-845004547?user_id=0af4bbc68c5a4c9e84f3de31352ad5c4 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 15:56:17.282133 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6db4baed-a26a-4f4b-b794-0cb678dfd125 tempest-KeyPairsV210TestJSON-2059539415 tempest-KeyPairsV210TestJSON-2059539415-project-admin] Calling method '.version_select at 0x7f5ae9a48430>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:17.341642 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=5,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:56:17.366414 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6db4baed-a26a-4f4b-b794-0cb678dfd125 tempest-KeyPairsV210TestJSON-2059539415 tempest-KeyPairsV210TestJSON-2059539415-project-admin] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-873104908?user_id=0af4bbc68c5a4c9e84f3de31352ad5c4" status: 204 len: 0 microversion: 2.10 time: 0.103373 Aug 31 15:56:17.369986 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 70/132] 10.222.0.61 () {60 vars in 1340 bytes} [Wed Aug 31 15:56:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-873104908?user_id=0af4bbc68c5a4c9e84f3de31352ad5c4 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 15:56:17.499232 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-13694040-803e-4996-8f5a-ff2b0bfd7f44 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:17.524875 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-13694040-803e-4996-8f5a-ff2b0bfd7f44 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:17.531194 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-13694040-803e-4996-8f5a-ff2b0bfd7f44 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:17.560604 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-13694040-803e-4996-8f5a-ff2b0bfd7f44 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] 10.222.0.61 "GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174" status: 200 len: 1417 microversion: 2.75 time: 0.510331 Aug 31 15:56:17.566383 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 63/133] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:56:17 2022] GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174 => generated 1417 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:56:18.014635 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7f968f25-e2a8-450c-84c6-7397480c0a3f tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:18.015925 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7f968f25-e2a8-450c-84c6-7397480c0a3f tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] [instance: 94898cf4-0065-4b87-acb5-e8d11bd1529a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:18.031816 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=8 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:56:18.043009 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7f968f25-e2a8-450c-84c6-7397480c0a3f tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:18.048179 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7f968f25-e2a8-450c-84c6-7397480c0a3f tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:18.048735 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7f968f25-e2a8-450c-84c6-7397480c0a3f tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:18.049389 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7f968f25-e2a8-450c-84c6-7397480c0a3f tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:18.049911 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7f968f25-e2a8-450c-84c6-7397480c0a3f tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:18.050397 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7f968f25-e2a8-450c-84c6-7397480c0a3f tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:18.174898 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-199d80ff-4e44-4751-8ce2-a795b08f03c0 tempest-HypervisorAdminV228Test-422901712 tempest-HypervisorAdminV228Test-422901712-project-admin] Calling method '.version_select at 0x7f5ae9a48b80>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:18.176880 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-199d80ff-4e44-4751-8ce2-a795b08f03c0 tempest-HypervisorAdminV228Test-422901712 tempest-HypervisorAdminV228Test-422901712-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:18.177889 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-199d80ff-4e44-4751-8ce2-a795b08f03c0 tempest-HypervisorAdminV228Test-422901712 tempest-HypervisorAdminV228Test-422901712-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:18.178767 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-199d80ff-4e44-4751-8ce2-a795b08f03c0 tempest-HypervisorAdminV228Test-422901712 tempest-HypervisorAdminV228Test-422901712-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:18.277372 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-199d80ff-4e44-4751-8ce2-a795b08f03c0 tempest-HypervisorAdminV228Test-422901712 tempest-HypervisorAdminV228Test-422901712-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:18.277871 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-199d80ff-4e44-4751-8ce2-a795b08f03c0 tempest-HypervisorAdminV228Test-422901712 tempest-HypervisorAdminV228Test-422901712-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:18.278314 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-199d80ff-4e44-4751-8ce2-a795b08f03c0 tempest-HypervisorAdminV228Test-422901712 tempest-HypervisorAdminV228Test-422901712-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:18.327103 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-199d80ff-4e44-4751-8ce2-a795b08f03c0 tempest-HypervisorAdminV228Test-422901712 tempest-HypervisorAdminV228Test-422901712-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:18.340436 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-199d80ff-4e44-4751-8ce2-a795b08f03c0 tempest-HypervisorAdminV228Test-422901712 tempest-HypervisorAdminV228Test-422901712-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:18.340943 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-199d80ff-4e44-4751-8ce2-a795b08f03c0 tempest-HypervisorAdminV228Test-422901712 tempest-HypervisorAdminV228Test-422901712-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:18.348730 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-199d80ff-4e44-4751-8ce2-a795b08f03c0 tempest-HypervisorAdminV228Test-422901712 tempest-HypervisorAdminV228Test-422901712-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.857579 Aug 31 15:56:18.355439 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 71/134] 10.222.0.61 () {60 vars in 1187 bytes} [Wed Aug 31 15:56:17 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 15:56:18.363459 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-873d5414-d705-4bd4-a492-b62150a886cb tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:18.372346 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-873d5414-d705-4bd4-a492-b62150a886cb tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] [instance: 3a0126e3-2324-4892-8908-2b6d2d5e2158] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:18.384502 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-873d5414-d705-4bd4-a492-b62150a886cb tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:18.385085 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-873d5414-d705-4bd4-a492-b62150a886cb tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:18.385567 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-873d5414-d705-4bd4-a492-b62150a886cb tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:18.386286 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-873d5414-d705-4bd4-a492-b62150a886cb tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:18.386877 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-873d5414-d705-4bd4-a492-b62150a886cb tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:18.387318 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-873d5414-d705-4bd4-a492-b62150a886cb tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:18.455345 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7f968f25-e2a8-450c-84c6-7397480c0a3f tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe750fe96e2444489edce1b2750fa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8904771b5154454896715024aa20bbcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:18.469242 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7f968f25-e2a8-450c-84c6-7397480c0a3f tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] 10.222.0.61 "GET /compute/v2.1/servers/94898cf4-0065-4b87-acb5-e8d11bd1529a" status: 200 len: 1338 microversion: 2.1 time: 0.455625 Aug 31 15:56:18.472632 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 64/135] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:18 2022] GET /compute/v2.1/servers/94898cf4-0065-4b87-acb5-e8d11bd1529a => generated 1338 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:18.484810 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7a729983-f874-447f-b782-7ebf8a6cad24 tempest-HypervisorAdminV228Test-422901712 tempest-HypervisorAdminV228Test-422901712-project-admin] Calling method '.version_select at 0x7f5ae997b160>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:18.494434 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7a729983-f874-447f-b782-7ebf8a6cad24 tempest-HypervisorAdminV228Test-422901712 tempest-HypervisorAdminV228Test-422901712-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:18.496324 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7a729983-f874-447f-b782-7ebf8a6cad24 tempest-HypervisorAdminV228Test-422901712 tempest-HypervisorAdminV228Test-422901712-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:18.501097 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7a729983-f874-447f-b782-7ebf8a6cad24 tempest-HypervisorAdminV228Test-422901712 tempest-HypervisorAdminV228Test-422901712-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:18.553217 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7a729983-f874-447f-b782-7ebf8a6cad24 tempest-HypervisorAdminV228Test-422901712 tempest-HypervisorAdminV228Test-422901712-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:18.556303 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7a729983-f874-447f-b782-7ebf8a6cad24 tempest-HypervisorAdminV228Test-422901712 tempest-HypervisorAdminV228Test-422901712-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:18.558396 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7a729983-f874-447f-b782-7ebf8a6cad24 tempest-HypervisorAdminV228Test-422901712 tempest-HypervisorAdminV228Test-422901712-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:18.589604 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7a729983-f874-447f-b782-7ebf8a6cad24 tempest-HypervisorAdminV228Test-422901712 tempest-HypervisorAdminV228Test-422901712-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.115443 Aug 31 15:56:18.595520 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 65/136] 10.222.0.61 () {60 vars in 1193 bytes} [Wed Aug 31 15:56:18 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 15:56:18.911592 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-bff123c5-6d9e-4523-a968-85309915b012 req-c4a68ffd-2a80-4229-ab9f-3210062d9e92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a0126e3-2324-4892-8908-2b6d2d5e2158", "tag": "6968d1bb-5c27-4bac-b8bf-3218d05fdca9"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:56:18.943341 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-873d5414-d705-4bd4-a492-b62150a886cb tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377b1dedae45d2a804919e5ea69a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e5507d53224d19804717493d60bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:18.950298 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-bff123c5-6d9e-4523-a968-85309915b012 req-c4a68ffd-2a80-4229-ab9f-3210062d9e92 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:18.951698 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-bff123c5-6d9e-4523-a968-85309915b012 req-c4a68ffd-2a80-4229-ab9f-3210062d9e92 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:18.970851 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-873d5414-d705-4bd4-a492-b62150a886cb tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] 10.222.0.61 "GET /compute/v2.1/servers/3a0126e3-2324-4892-8908-2b6d2d5e2158" status: 200 len: 1389 microversion: 2.1 time: 0.613957 Aug 31 15:56:18.972767 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-bff123c5-6d9e-4523-a968-85309915b012 req-c4a68ffd-2a80-4229-ab9f-3210062d9e92 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:18.976433 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 72/137] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:18 2022] GET /compute/v2.1/servers/3a0126e3-2324-4892-8908-2b6d2d5e2158 => generated 1389 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:18.993253 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9dd2dadc-7a05-442d-a0d6-94268b9cdb96 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:18.994909 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9dd2dadc-7a05-442d-a0d6-94268b9cdb96 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] [instance: f2162319-5635-4c77-920d-9ecb3221d174] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:19.010549 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9dd2dadc-7a05-442d-a0d6-94268b9cdb96 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:19.012428 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9dd2dadc-7a05-442d-a0d6-94268b9cdb96 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:19.023780 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9dd2dadc-7a05-442d-a0d6-94268b9cdb96 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:19.024941 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9dd2dadc-7a05-442d-a0d6-94268b9cdb96 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:19.025622 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9dd2dadc-7a05-442d-a0d6-94268b9cdb96 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:19.027847 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9dd2dadc-7a05-442d-a0d6-94268b9cdb96 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:19.064012 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-bff123c5-6d9e-4523-a968-85309915b012 req-c4a68ffd-2a80-4229-ab9f-3210062d9e92 service nova] Creating event network-changed:6968d1bb-5c27-4bac-b8bf-3218d05fdca9 for instance 3a0126e3-2324-4892-8908-2b6d2d5e2158 on n-h2-850499-9 Aug 31 15:56:19.067792 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-bff123c5-6d9e-4523-a968-85309915b012 req-c4a68ffd-2a80-4229-ab9f-3210062d9e92 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=122257) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 31 15:56:19.067792 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-bff123c5-6d9e-4523-a968-85309915b012 req-c4a68ffd-2a80-4229-ab9f-3210062d9e92 service nova] Acquired lock "compute-rpcapi-router" {{(pid=122257) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 31 15:56:19.068701 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-197cf2f0-941b-4811-a382-c5dbb0630964 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:19.069829 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-197cf2f0-941b-4811-a382-c5dbb0630964 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:19.070959 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-197cf2f0-941b-4811-a382-c5dbb0630964 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:19.072349 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-197cf2f0-941b-4811-a382-c5dbb0630964 None None] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:19.073266 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-197cf2f0-941b-4811-a382-c5dbb0630964 None None] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:19.073892 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-197cf2f0-941b-4811-a382-c5dbb0630964 None None] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:19.091581 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.compute.rpcapi [None req-197cf2f0-941b-4811-a382-c5dbb0630964 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 31 15:56:19.093766 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-197cf2f0-941b-4811-a382-c5dbb0630964 None None] Releasing lock "compute-rpcapi-router" {{(pid=122257) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 31 15:56:19.151200 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-197cf2f0-941b-4811-a382-c5dbb0630964 None None] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.552643 Aug 31 15:56:19.159889 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 66/138] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 15:56:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:56:19.282835 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-9dd2dadc-7a05-442d-a0d6-94268b9cdb96 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:19.314361 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-9dd2dadc-7a05-442d-a0d6-94268b9cdb96 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:19.317320 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-9dd2dadc-7a05-442d-a0d6-94268b9cdb96 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:19.346221 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9dd2dadc-7a05-442d-a0d6-94268b9cdb96 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] 10.222.0.61 "GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174" status: 200 len: 1417 microversion: 2.75 time: 0.368604 Aug 31 15:56:19.346824 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 73/139] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:56:18 2022] GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174 => generated 1417 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:56:19.502323 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3d5388ea-2034-4e0e-a064-5c610e84ea00 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:19.506343 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3d5388ea-2034-4e0e-a064-5c610e84ea00 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] [instance: 94898cf4-0065-4b87-acb5-e8d11bd1529a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:19.542740 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3d5388ea-2034-4e0e-a064-5c610e84ea00 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:19.545262 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3d5388ea-2034-4e0e-a064-5c610e84ea00 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:19.548208 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3d5388ea-2034-4e0e-a064-5c610e84ea00 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:19.552121 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3d5388ea-2034-4e0e-a064-5c610e84ea00 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:19.553433 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3d5388ea-2034-4e0e-a064-5c610e84ea00 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:19.556218 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3d5388ea-2034-4e0e-a064-5c610e84ea00 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:19.578730 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=93 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:56:19.902051 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3d5388ea-2034-4e0e-a064-5c610e84ea00 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe750fe96e2444489edce1b2750fa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8904771b5154454896715024aa20bbcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:19.911239 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3d5388ea-2034-4e0e-a064-5c610e84ea00 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] 10.222.0.61 "GET /compute/v2.1/servers/94898cf4-0065-4b87-acb5-e8d11bd1529a" status: 200 len: 1338 microversion: 2.1 time: 0.420397 Aug 31 15:56:19.915098 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 67/140] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:19 2022] GET /compute/v2.1/servers/94898cf4-0065-4b87-acb5-e8d11bd1529a => generated 1338 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:20.000196 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d230945e-bde3-411a-9629-edd705749683 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:20.001250 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d230945e-bde3-411a-9629-edd705749683 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] [instance: 3a0126e3-2324-4892-8908-2b6d2d5e2158] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:20.017898 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d230945e-bde3-411a-9629-edd705749683 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:20.025348 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d230945e-bde3-411a-9629-edd705749683 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:20.027126 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d230945e-bde3-411a-9629-edd705749683 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:20.030817 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d230945e-bde3-411a-9629-edd705749683 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:20.031710 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d230945e-bde3-411a-9629-edd705749683 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:20.032306 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d230945e-bde3-411a-9629-edd705749683 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:20.398258 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a5c489fa-3966-482e-a417-3a2a6c54976f tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:20.398825 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a5c489fa-3966-482e-a417-3a2a6c54976f tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] [instance: f2162319-5635-4c77-920d-9ecb3221d174] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:20.413525 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a5c489fa-3966-482e-a417-3a2a6c54976f tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:20.415636 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a5c489fa-3966-482e-a417-3a2a6c54976f tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:20.419184 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a5c489fa-3966-482e-a417-3a2a6c54976f tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:20.424060 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a5c489fa-3966-482e-a417-3a2a6c54976f tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:20.424770 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a5c489fa-3966-482e-a417-3a2a6c54976f tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:20.425963 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a5c489fa-3966-482e-a417-3a2a6c54976f tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:20.645145 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a5c489fa-3966-482e-a417-3a2a6c54976f tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:20.664768 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a5c489fa-3966-482e-a417-3a2a6c54976f tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:20.668955 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a5c489fa-3966-482e-a417-3a2a6c54976f tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:20.678299 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a5c489fa-3966-482e-a417-3a2a6c54976f tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] 10.222.0.61 "GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174" status: 200 len: 1417 microversion: 2.75 time: 0.283401 Aug 31 15:56:20.702058 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 68/141] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:56:20 2022] GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174 => generated 1417 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 15:56:20.755920 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d230945e-bde3-411a-9629-edd705749683 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377b1dedae45d2a804919e5ea69a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e5507d53224d19804717493d60bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:20.769310 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d230945e-bde3-411a-9629-edd705749683 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] 10.222.0.61 "GET /compute/v2.1/servers/3a0126e3-2324-4892-8908-2b6d2d5e2158" status: 200 len: 1389 microversion: 2.1 time: 0.774349 Aug 31 15:56:20.771448 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 74/142] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:19 2022] GET /compute/v2.1/servers/3a0126e3-2324-4892-8908-2b6d2d5e2158 => generated 1389 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:20.937654 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-eaaadd87-b450-45d5-9da2-7f1c2b222792 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:20.938690 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-eaaadd87-b450-45d5-9da2-7f1c2b222792 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] [instance: 94898cf4-0065-4b87-acb5-e8d11bd1529a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:20.950575 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eaaadd87-b450-45d5-9da2-7f1c2b222792 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:20.952579 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eaaadd87-b450-45d5-9da2-7f1c2b222792 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:20.953312 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eaaadd87-b450-45d5-9da2-7f1c2b222792 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:20.955415 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eaaadd87-b450-45d5-9da2-7f1c2b222792 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:20.956247 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eaaadd87-b450-45d5-9da2-7f1c2b222792 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:20.959077 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eaaadd87-b450-45d5-9da2-7f1c2b222792 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:21.533511 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-eaaadd87-b450-45d5-9da2-7f1c2b222792 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe750fe96e2444489edce1b2750fa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8904771b5154454896715024aa20bbcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:21.548032 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-eaaadd87-b450-45d5-9da2-7f1c2b222792 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] 10.222.0.61 "GET /compute/v2.1/servers/94898cf4-0065-4b87-acb5-e8d11bd1529a" status: 200 len: 1338 microversion: 2.1 time: 0.615543 Aug 31 15:56:21.548768 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 69/143] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:20 2022] GET /compute/v2.1/servers/94898cf4-0065-4b87-acb5-e8d11bd1529a => generated 1338 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:21.710116 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5e042e1b-db63-4e12-aa1c-da37e7428742 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:21.711001 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5e042e1b-db63-4e12-aa1c-da37e7428742 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] [instance: f2162319-5635-4c77-920d-9ecb3221d174] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:21.726890 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5e042e1b-db63-4e12-aa1c-da37e7428742 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:21.728403 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5e042e1b-db63-4e12-aa1c-da37e7428742 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:21.730497 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5e042e1b-db63-4e12-aa1c-da37e7428742 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:21.733436 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5e042e1b-db63-4e12-aa1c-da37e7428742 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:21.734213 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5e042e1b-db63-4e12-aa1c-da37e7428742 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:21.736337 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5e042e1b-db63-4e12-aa1c-da37e7428742 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:21.795897 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5cd3f7f8-76d8-4b43-b212-c126bc422672 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:21.797135 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5cd3f7f8-76d8-4b43-b212-c126bc422672 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] [instance: 3a0126e3-2324-4892-8908-2b6d2d5e2158] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:21.828034 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5cd3f7f8-76d8-4b43-b212-c126bc422672 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:21.829325 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5cd3f7f8-76d8-4b43-b212-c126bc422672 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:21.832658 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5cd3f7f8-76d8-4b43-b212-c126bc422672 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:21.838889 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5cd3f7f8-76d8-4b43-b212-c126bc422672 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:21.839714 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5cd3f7f8-76d8-4b43-b212-c126bc422672 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:21.844136 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5cd3f7f8-76d8-4b43-b212-c126bc422672 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:21.994048 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5e042e1b-db63-4e12-aa1c-da37e7428742 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:22.019883 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5e042e1b-db63-4e12-aa1c-da37e7428742 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:22.052302 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5e042e1b-db63-4e12-aa1c-da37e7428742 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:22.080718 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5e042e1b-db63-4e12-aa1c-da37e7428742 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] 10.222.0.61 "GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174" status: 200 len: 1417 microversion: 2.75 time: 0.373800 Aug 31 15:56:22.082818 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 75/144] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:56:21 2022] GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174 => generated 1417 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:56:22.454946 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5cd3f7f8-76d8-4b43-b212-c126bc422672 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377b1dedae45d2a804919e5ea69a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e5507d53224d19804717493d60bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:22.473995 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5cd3f7f8-76d8-4b43-b212-c126bc422672 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] 10.222.0.61 "GET /compute/v2.1/servers/3a0126e3-2324-4892-8908-2b6d2d5e2158" status: 200 len: 1389 microversion: 2.1 time: 0.683459 Aug 31 15:56:22.474590 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 70/145] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:21 2022] GET /compute/v2.1/servers/3a0126e3-2324-4892-8908-2b6d2d5e2158 => generated 1389 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:22.590612 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-188e9422-e14a-4b08-a705-256992cb8b86 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:22.596664 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-188e9422-e14a-4b08-a705-256992cb8b86 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] [instance: 94898cf4-0065-4b87-acb5-e8d11bd1529a] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:22.650501 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-188e9422-e14a-4b08-a705-256992cb8b86 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:22.653490 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-188e9422-e14a-4b08-a705-256992cb8b86 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:22.657794 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-188e9422-e14a-4b08-a705-256992cb8b86 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:22.658718 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-188e9422-e14a-4b08-a705-256992cb8b86 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:22.659210 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-188e9422-e14a-4b08-a705-256992cb8b86 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:22.659724 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-188e9422-e14a-4b08-a705-256992cb8b86 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:22.709800 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=100 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:56:22.972383 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3acbdbeb-6875-4bec-9108-400d3c7f7340 tempest-FlavorsV2NegativeTest-1759592407 tempest-FlavorsV2NegativeTest-1759592407-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1988803134", "imageRef": "780642bc-c452-4029-93d6-ef511905d5ad", "flavorRef": "452"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:56:23.048737 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-3acbdbeb-6875-4bec-9108-400d3c7f7340 tempest-FlavorsV2NegativeTest-1759592407 tempest-FlavorsV2NegativeTest-1759592407-project] validate_networks() for None {{(pid=122257) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 15:56:23.105667 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-188e9422-e14a-4b08-a705-256992cb8b86 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe750fe96e2444489edce1b2750fa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8904771b5154454896715024aa20bbcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:23.118824 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-188e9422-e14a-4b08-a705-256992cb8b86 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] 10.222.0.61 "GET /compute/v2.1/servers/94898cf4-0065-4b87-acb5-e8d11bd1529a" status: 200 len: 1338 microversion: 2.1 time: 0.548514 Aug 31 15:56:23.119411 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 76/146] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:22 2022] GET /compute/v2.1/servers/94898cf4-0065-4b87-acb5-e8d11bd1529a => generated 1338 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:23.129866 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1e486385-9d12-4574-984d-030c80710fbb tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:23.134064 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1e486385-9d12-4574-984d-030c80710fbb tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] [instance: f2162319-5635-4c77-920d-9ecb3221d174] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:23.146526 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1e486385-9d12-4574-984d-030c80710fbb tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:23.147032 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1e486385-9d12-4574-984d-030c80710fbb tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:23.147475 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1e486385-9d12-4574-984d-030c80710fbb tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:23.148214 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1e486385-9d12-4574-984d-030c80710fbb tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:23.148673 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1e486385-9d12-4574-984d-030c80710fbb tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:23.149092 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1e486385-9d12-4574-984d-030c80710fbb tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:23.335164 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1e486385-9d12-4574-984d-030c80710fbb tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:23.346664 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1e486385-9d12-4574-984d-030c80710fbb tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:23.355776 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1e486385-9d12-4574-984d-030c80710fbb tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:23.364182 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1e486385-9d12-4574-984d-030c80710fbb tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] 10.222.0.61 "GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174" status: 200 len: 1417 microversion: 2.75 time: 0.239576 Aug 31 15:56:23.367948 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 77/147] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:56:23 2022] GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174 => generated 1417 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:56:23.468520 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-3acbdbeb-6875-4bec-9108-400d3c7f7340 tempest-FlavorsV2NegativeTest-1759592407 tempest-FlavorsV2NegativeTest-1759592407-project] HTTP exception thrown: Flavor's memory is too small for requested image. Aug 31 15:56:23.471372 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3acbdbeb-6875-4bec-9108-400d3c7f7340 tempest-FlavorsV2NegativeTest-1759592407 tempest-FlavorsV2NegativeTest-1759592407-project] Request method failure captured: Aug 31 15:56:23.471372 n-d-850499-9 devstack@n-api.service[122257]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 31 15:56:23.471372 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 15:56:23.471372 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 15:56:23.471372 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 15:56:23.471372 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 143 Aug 31 15:56:23.471372 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 15:56:23.471372 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 15:56:23.471372 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 15:56:23.471372 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 15:56:23.471372 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4Scm--jVaGG088OWevrAKsyWEO1lUnbNy0ztxrbHEAQbAW43GNOqt-z-E7YNs8ot550rqENnYxJuBG5KdGvIoFHryKikRPMEwzyFAoBCRBTPLB6mI6kGev9p8na0Cux4xj49N1DPZ6N3nefb6AL8toNfB84Fua7h48WIle6UjyZLMY Aug 31 15:56:23.471372 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 15:56:23.471372 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 15:56:23.471372 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 15:56:23.471372 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 15:56:23.471372 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 15:56:23.471372 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 15:56:23.471372 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: a31faa3161c940578ace9bd612eaa024 Aug 31 15:56:23.471372 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-FlavorsV2NegativeTest-1759592407 Aug 31 15:56:23.471372 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 15:56:23.471372 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 15:56:23.472895 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a31faa3161c940578ace9bd612eaa024"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a31faa3161c940578ace9bd612eaa024"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a31faa3161c940578ace9bd612eaa024", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a31faa3161c940578ace9bd612eaa024"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 15:56:23.472895 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-FlavorsV2NegativeTest-1759592407 Aug 31 15:56:23.472895 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: a31faa3161c940578ace9bd612eaa024 Aug 31 15:56:23.472895 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-1759592407 Aug 31 15:56:23.472895 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-FlavorsV2NegativeTest-1759592407-project Aug 31 15:56:23.472895 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 15:56:23.472895 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 15:56:23.472895 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 5e2bf769753f48529edb29315aa40254 Aug 31 15:56:23.472895 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-FlavorsV2NegativeTest-1759592407-project Aug 31 15:56:23.472895 n-d-850499-9 devstack@n-api.service[122257]: Aug 31 15:56:23.472895 n-d-850499-9 devstack@n-api.service[122257]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1988803134", "imageRef": "780642bc-c452-4029-93d6-ef511905d5ad", "flavorRef": "452"}} Aug 31 15:56:23.472895 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 15:56:23.473718 n-d-850499-9 devstack@n-api.service[122257]: exception: Flavor's memory is too small for requested image. Aug 31 15:56:23.473718 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-1988803134', 'imageRef': '780642bc-c452-4029-93d6-ef511905d5ad', 'flavorRef': '452'}}} Aug 31 15:56:23.473718 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:56:23.473718 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:56:23.473718 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 31 15:56:23.473718 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 31 15:56:23.473718 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 31 15:56:23.473718 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 31 15:56:23.473718 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Aug 31 15:56:23.473718 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Aug 31 15:56:23.473718 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Aug 31 15:56:23.473718 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Aug 31 15:56:23.473718 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Aug 31 15:56:23.473718 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Aug 31 15:56:23.473718 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Aug 31 15:56:23.473718 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Aug 31 15:56:23.473718 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Aug 31 15:56:23.473718 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:56:23.473718 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:56:23.473718 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:56:23.475298 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:56:23.475298 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:56:23.475298 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:56:23.475298 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:56:23.475298 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:56:23.475298 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:56:23.475298 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:56:23.475298 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:56:23.475298 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:56:23.475298 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:56:23.475298 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:56:23.475298 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:56:23.475298 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:56:23.475298 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 31 15:56:23.475298 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Aug 31 15:56:23.475298 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 31 15:56:23.475298 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Aug 31 15:56:23.475298 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:56:23.475298 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:56:23.475298 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:56:23.475298 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:56:23.476968 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:56:23.476968 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:56:23.476968 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:56:23.476968 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:56:23.476968 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Aug 31 15:56:23.476968 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:56:23.478368 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3acbdbeb-6875-4bec-9108-400d3c7f7340 tempest-FlavorsV2NegativeTest-1759592407 tempest-FlavorsV2NegativeTest-1759592407-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:56:23.479646 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3acbdbeb-6875-4bec-9108-400d3c7f7340 tempest-FlavorsV2NegativeTest-1759592407 tempest-FlavorsV2NegativeTest-1759592407-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.511492 Aug 31 15:56:23.480428 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 71/148] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 15:56:22 2022] POST /compute/v2.1/servers => generated 93 bytes in 514 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Aug 31 15:56:23.500918 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5cd8dc29-b488-41d2-97a6-a90f02eabf08 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:23.502047 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5cd8dc29-b488-41d2-97a6-a90f02eabf08 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] [instance: 3a0126e3-2324-4892-8908-2b6d2d5e2158] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:23.510226 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5cd8dc29-b488-41d2-97a6-a90f02eabf08 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:23.510955 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5cd8dc29-b488-41d2-97a6-a90f02eabf08 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:23.511706 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5cd8dc29-b488-41d2-97a6-a90f02eabf08 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:23.512807 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5cd8dc29-b488-41d2-97a6-a90f02eabf08 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:23.514084 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5cd8dc29-b488-41d2-97a6-a90f02eabf08 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:23.515037 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5cd8dc29-b488-41d2-97a6-a90f02eabf08 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:23.822277 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5cd8dc29-b488-41d2-97a6-a90f02eabf08 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377b1dedae45d2a804919e5ea69a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e5507d53224d19804717493d60bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:23.834046 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5cd8dc29-b488-41d2-97a6-a90f02eabf08 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] 10.222.0.61 "GET /compute/v2.1/servers/3a0126e3-2324-4892-8908-2b6d2d5e2158" status: 200 len: 1389 microversion: 2.1 time: 0.338021 Aug 31 15:56:23.839531 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 78/149] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:23 2022] GET /compute/v2.1/servers/3a0126e3-2324-4892-8908-2b6d2d5e2158 => generated 1389 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:24.141341 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a150142c-3216-4a40-96c3-8dd48fc7644a tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:24.141922 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a150142c-3216-4a40-96c3-8dd48fc7644a tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] [instance: 94898cf4-0065-4b87-acb5-e8d11bd1529a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:24.155866 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a150142c-3216-4a40-96c3-8dd48fc7644a tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:24.156314 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a150142c-3216-4a40-96c3-8dd48fc7644a tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:24.156754 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a150142c-3216-4a40-96c3-8dd48fc7644a tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:24.157485 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a150142c-3216-4a40-96c3-8dd48fc7644a tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:24.157943 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a150142c-3216-4a40-96c3-8dd48fc7644a tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:24.158367 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a150142c-3216-4a40-96c3-8dd48fc7644a tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:24.401930 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a05bfc8a-0412-4b4c-ad41-0ed6357d6c8b tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:24.402290 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a05bfc8a-0412-4b4c-ad41-0ed6357d6c8b tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] [instance: f2162319-5635-4c77-920d-9ecb3221d174] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:24.411368 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a05bfc8a-0412-4b4c-ad41-0ed6357d6c8b tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:24.411907 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a05bfc8a-0412-4b4c-ad41-0ed6357d6c8b tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:24.412354 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a05bfc8a-0412-4b4c-ad41-0ed6357d6c8b tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:24.414216 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a05bfc8a-0412-4b4c-ad41-0ed6357d6c8b tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:24.416681 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a05bfc8a-0412-4b4c-ad41-0ed6357d6c8b tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:24.417150 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a05bfc8a-0412-4b4c-ad41-0ed6357d6c8b tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:24.506646 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a150142c-3216-4a40-96c3-8dd48fc7644a tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe750fe96e2444489edce1b2750fa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8904771b5154454896715024aa20bbcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:24.521682 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a150142c-3216-4a40-96c3-8dd48fc7644a tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] 10.222.0.61 "GET /compute/v2.1/servers/94898cf4-0065-4b87-acb5-e8d11bd1529a" status: 200 len: 1338 microversion: 2.1 time: 0.384893 Aug 31 15:56:24.528052 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 72/150] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:24 2022] GET /compute/v2.1/servers/94898cf4-0065-4b87-acb5-e8d11bd1529a => generated 1338 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:24.584379 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a05bfc8a-0412-4b4c-ad41-0ed6357d6c8b tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:24.597505 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a05bfc8a-0412-4b4c-ad41-0ed6357d6c8b tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:24.598967 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a05bfc8a-0412-4b4c-ad41-0ed6357d6c8b tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:24.604863 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a05bfc8a-0412-4b4c-ad41-0ed6357d6c8b tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] 10.222.0.61 "GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174" status: 200 len: 1417 microversion: 2.75 time: 0.212993 Aug 31 15:56:24.606060 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 79/151] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:56:24 2022] GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174 => generated 1417 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:56:24.862255 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-85c98b5b-211e-4d6d-8ca8-0914f665f4d4 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:24.863271 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-85c98b5b-211e-4d6d-8ca8-0914f665f4d4 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] [instance: 3a0126e3-2324-4892-8908-2b6d2d5e2158] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:24.876782 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-85c98b5b-211e-4d6d-8ca8-0914f665f4d4 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:24.877965 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-85c98b5b-211e-4d6d-8ca8-0914f665f4d4 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:24.879457 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-85c98b5b-211e-4d6d-8ca8-0914f665f4d4 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:24.880392 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-85c98b5b-211e-4d6d-8ca8-0914f665f4d4 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:24.881054 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-85c98b5b-211e-4d6d-8ca8-0914f665f4d4 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:24.881849 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-85c98b5b-211e-4d6d-8ca8-0914f665f4d4 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:25.119879 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-85c98b5b-211e-4d6d-8ca8-0914f665f4d4 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377b1dedae45d2a804919e5ea69a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e5507d53224d19804717493d60bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:25.130707 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-85c98b5b-211e-4d6d-8ca8-0914f665f4d4 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] 10.222.0.61 "GET /compute/v2.1/servers/3a0126e3-2324-4892-8908-2b6d2d5e2158" status: 200 len: 1389 microversion: 2.1 time: 0.276639 Aug 31 15:56:25.130707 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 73/152] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:24 2022] GET /compute/v2.1/servers/3a0126e3-2324-4892-8908-2b6d2d5e2158 => generated 1389 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:25.550646 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-64646268-cf6e-44d2-8a2f-3809247a9c93 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:25.552286 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-64646268-cf6e-44d2-8a2f-3809247a9c93 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] [instance: 94898cf4-0065-4b87-acb5-e8d11bd1529a] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:25.562552 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=4 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:56:25.566598 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-64646268-cf6e-44d2-8a2f-3809247a9c93 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:25.569034 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-64646268-cf6e-44d2-8a2f-3809247a9c93 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:25.569744 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-64646268-cf6e-44d2-8a2f-3809247a9c93 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:25.570916 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-64646268-cf6e-44d2-8a2f-3809247a9c93 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:25.572509 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-64646268-cf6e-44d2-8a2f-3809247a9c93 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:25.572976 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-64646268-cf6e-44d2-8a2f-3809247a9c93 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:25.634211 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-27dfbfca-b0a1-4229-b86c-f989b1ed46ca tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:25.635414 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-27dfbfca-b0a1-4229-b86c-f989b1ed46ca tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] [instance: f2162319-5635-4c77-920d-9ecb3221d174] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:25.645979 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=65,nova_cell0:UPDATE=7 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:56:25.648886 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-27dfbfca-b0a1-4229-b86c-f989b1ed46ca tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:25.649391 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-27dfbfca-b0a1-4229-b86c-f989b1ed46ca tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:25.652633 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-27dfbfca-b0a1-4229-b86c-f989b1ed46ca tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:25.653417 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-27dfbfca-b0a1-4229-b86c-f989b1ed46ca tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:25.654637 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-27dfbfca-b0a1-4229-b86c-f989b1ed46ca tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:25.655077 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-27dfbfca-b0a1-4229-b86c-f989b1ed46ca tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:25.754853 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-64646268-cf6e-44d2-8a2f-3809247a9c93 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe750fe96e2444489edce1b2750fa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8904771b5154454896715024aa20bbcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:25.765591 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-64646268-cf6e-44d2-8a2f-3809247a9c93 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] 10.222.0.61 "GET /compute/v2.1/servers/94898cf4-0065-4b87-acb5-e8d11bd1529a" status: 200 len: 1338 microversion: 2.1 time: 0.220706 Aug 31 15:56:25.768908 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 80/153] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:25 2022] GET /compute/v2.1/servers/94898cf4-0065-4b87-acb5-e8d11bd1529a => generated 1338 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:25.811428 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-27dfbfca-b0a1-4229-b86c-f989b1ed46ca tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:25.827040 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-27dfbfca-b0a1-4229-b86c-f989b1ed46ca tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:25.837236 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-27dfbfca-b0a1-4229-b86c-f989b1ed46ca tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:25.845355 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-27dfbfca-b0a1-4229-b86c-f989b1ed46ca tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] 10.222.0.61 "GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174" status: 200 len: 1417 microversion: 2.75 time: 0.216815 Aug 31 15:56:25.846527 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 74/154] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:56:25 2022] GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174 => generated 1417 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 15:56:25.972203 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c7b39a7b-49ac-435f-b2be-6139f773f945 tempest-HypervisorAdminNegativeUnderV252Test-548839919 tempest-HypervisorAdminNegativeUnderV252Test-548839919-project-admin] Calling method '.version_select at 0x7f5ae98eb0d0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:25.974317 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c7b39a7b-49ac-435f-b2be-6139f773f945 tempest-HypervisorAdminNegativeUnderV252Test-548839919 tempest-HypervisorAdminNegativeUnderV252Test-548839919-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:25.974811 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c7b39a7b-49ac-435f-b2be-6139f773f945 tempest-HypervisorAdminNegativeUnderV252Test-548839919 tempest-HypervisorAdminNegativeUnderV252Test-548839919-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:25.975254 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c7b39a7b-49ac-435f-b2be-6139f773f945 tempest-HypervisorAdminNegativeUnderV252Test-548839919 tempest-HypervisorAdminNegativeUnderV252Test-548839919-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:26.151615 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-cbeac405-a5ee-49f4-8cf2-c31eca37935e tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:26.152619 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-cbeac405-a5ee-49f4-8cf2-c31eca37935e tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] [instance: 3a0126e3-2324-4892-8908-2b6d2d5e2158] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:26.164972 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c7b39a7b-49ac-435f-b2be-6139f773f945 tempest-HypervisorAdminNegativeUnderV252Test-548839919 tempest-HypervisorAdminNegativeUnderV252Test-548839919-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:26.165682 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c7b39a7b-49ac-435f-b2be-6139f773f945 tempest-HypervisorAdminNegativeUnderV252Test-548839919 tempest-HypervisorAdminNegativeUnderV252Test-548839919-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:26.166295 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c7b39a7b-49ac-435f-b2be-6139f773f945 tempest-HypervisorAdminNegativeUnderV252Test-548839919 tempest-HypervisorAdminNegativeUnderV252Test-548839919-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:26.169948 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cbeac405-a5ee-49f4-8cf2-c31eca37935e tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:26.172388 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cbeac405-a5ee-49f4-8cf2-c31eca37935e tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:26.175277 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cbeac405-a5ee-49f4-8cf2-c31eca37935e tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:26.179479 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cbeac405-a5ee-49f4-8cf2-c31eca37935e tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:26.180097 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cbeac405-a5ee-49f4-8cf2-c31eca37935e tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:26.180363 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c7b39a7b-49ac-435f-b2be-6139f773f945 tempest-HypervisorAdminNegativeUnderV252Test-548839919 tempest-HypervisorAdminNegativeUnderV252Test-548839919-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:26.180978 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c7b39a7b-49ac-435f-b2be-6139f773f945 tempest-HypervisorAdminNegativeUnderV252Test-548839919 tempest-HypervisorAdminNegativeUnderV252Test-548839919-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:26.181563 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c7b39a7b-49ac-435f-b2be-6139f773f945 tempest-HypervisorAdminNegativeUnderV252Test-548839919 tempest-HypervisorAdminNegativeUnderV252Test-548839919-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:26.181675 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cbeac405-a5ee-49f4-8cf2-c31eca37935e tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:26.190556 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c7b39a7b-49ac-435f-b2be-6139f773f945 tempest-HypervisorAdminNegativeUnderV252Test-548839919 tempest-HypervisorAdminNegativeUnderV252Test-548839919-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.367420 Aug 31 15:56:26.191668 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 81/155] 10.222.0.61 () {58 vars in 1146 bytes} [Wed Aug 31 15:56:25 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 15:56:26.602396 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5f5389c4-b151-4afa-a8b8-685b90cff6bb tempest-HypervisorAdminNegativeUnderV252Test-1299015296 tempest-HypervisorAdminNegativeUnderV252Test-1299015296-project] Calling method '.version_select at 0x7f5ae98ebee0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:26.605517 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5f5389c4-b151-4afa-a8b8-685b90cff6bb tempest-HypervisorAdminNegativeUnderV252Test-1299015296 tempest-HypervisorAdminNegativeUnderV252Test-1299015296-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '613dd1651d05463f8c551e8ae1408bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c30c5a89f24ab2b795d41fb941f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:26.609037 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5f5389c4-b151-4afa-a8b8-685b90cff6bb tempest-HypervisorAdminNegativeUnderV252Test-1299015296 tempest-HypervisorAdminNegativeUnderV252Test-1299015296-project] Request method failure captured: Aug 31 15:56:26.609037 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/os-hypervisors/n-h1-850499-9/search HTTP/1.1 Aug 31 15:56:26.609037 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 15:56:26.609037 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 15:56:26.609037 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 15:56:26.609037 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 15:56:26.609037 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 15:56:26.609037 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 15:56:26.609037 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 15:56:26.609037 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 15:56:26.609037 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4SoovzTRZ-f98O7lfYZl2jA2oAvAGPBH-ucabjQ8e8YZybY_bjR1xjAqmUzZni2FQwPLZ1bqT1c3NijwwuEX4Pmo5_UQbGK1pCjkqnEoK6SxhCQVcB8AyF0LNED2QwuZzp3vB55eBJ2SArfHwU-_xyl4kVlOCLPuW-_BtkTV6vTtZw Aug 31 15:56:26.609037 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 15:56:26.609037 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 15:56:26.609037 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 15:56:26.609037 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 15:56:26.609037 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 15:56:26.609037 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 15:56:26.609037 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: f0c30c5a89f24ab2b795d41fb941f7ff Aug 31 15:56:26.609037 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1299015296 Aug 31 15:56:26.609037 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 15:56:26.609037 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 15:56:26.610554 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f0c30c5a89f24ab2b795d41fb941f7ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f0c30c5a89f24ab2b795d41fb941f7ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f0c30c5a89f24ab2b795d41fb941f7ff", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f0c30c5a89f24ab2b795d41fb941f7ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 15:56:26.610554 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1299015296 Aug 31 15:56:26.610554 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: f0c30c5a89f24ab2b795d41fb941f7ff Aug 31 15:56:26.610554 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1299015296 Aug 31 15:56:26.610554 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1299015296-project Aug 31 15:56:26.610554 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 15:56:26.610554 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 15:56:26.610554 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 613dd1651d05463f8c551e8ae1408bde Aug 31 15:56:26.610554 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1299015296-project Aug 31 15:56:26.610554 n-d-850499-9 devstack@n-api.service[122256]: method: Aug 31 15:56:26.610554 n-d-850499-9 devstack@n-api.service[122256]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 31 15:56:26.610554 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': 'n-h1-850499-9'} Aug 31 15:56:26.611400 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:56:26.611400 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:56:26.611400 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:56:26.611400 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:56:26.611400 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:56:26.611400 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:56:26.611400 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 15:56:26.611400 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 15:56:26.611400 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:56:26.611400 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:56:26.611400 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Aug 31 15:56:26.611400 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Aug 31 15:56:26.611400 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 31 15:56:26.611400 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 31 15:56:26.611400 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 31 15:56:26.611400 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 31 15:56:26.611400 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 15:56:26.611400 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 31 15:56:26.611400 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 15:56:26.612665 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise self.value Aug 31 15:56:26.612665 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 31 15:56:26.612665 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 31 15:56:26.612665 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 31 15:56:26.612665 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 31 15:56:26.612665 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 31 15:56:26.612665 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 31 15:56:26.612665 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 31 15:56:26.612665 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:56:26.612665 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:56:26.612665 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:56:26.612665 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:56:26.612665 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:56:26.612665 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:56:26.612665 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 31 15:56:26.612665 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 31 15:56:26.612665 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 31 15:56:26.612665 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:56:26.619387 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5f5389c4-b151-4afa-a8b8-685b90cff6bb tempest-HypervisorAdminNegativeUnderV252Test-1299015296 tempest-HypervisorAdminNegativeUnderV252Test-1299015296-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:56:26.621030 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5f5389c4-b151-4afa-a8b8-685b90cff6bb tempest-HypervisorAdminNegativeUnderV252Test-1299015296 tempest-HypervisorAdminNegativeUnderV252Test-1299015296-project] 10.222.0.61 "GET /compute/v2.1/os-hypervisors/n-h1-850499-9/search" status: 403 len: 117 microversion: 2.1 time: 0.418978 Aug 31 15:56:26.622257 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 82/156] 10.222.0.61 () {58 vars in 1209 bytes} [Wed Aug 31 15:56:26 2022] GET /compute/v2.1/os-hypervisors/n-h1-850499-9/search => generated 117 bytes in 421 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:56:26.635424 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7f6d4db1-349e-4bb7-9df6-d0bff580c70c tempest-HypervisorAdminNegativeUnderV252Test-548839919 tempest-HypervisorAdminNegativeUnderV252Test-548839919-project-admin] Calling method '.version_select at 0x7f5ae99c4a60>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:26.641585 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7f6d4db1-349e-4bb7-9df6-d0bff580c70c tempest-HypervisorAdminNegativeUnderV252Test-548839919 tempest-HypervisorAdminNegativeUnderV252Test-548839919-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:26.642392 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7f6d4db1-349e-4bb7-9df6-d0bff580c70c tempest-HypervisorAdminNegativeUnderV252Test-548839919 tempest-HypervisorAdminNegativeUnderV252Test-548839919-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:26.643965 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7f6d4db1-349e-4bb7-9df6-d0bff580c70c tempest-HypervisorAdminNegativeUnderV252Test-548839919 tempest-HypervisorAdminNegativeUnderV252Test-548839919-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:26.666521 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-7f6d4db1-349e-4bb7-9df6-d0bff580c70c tempest-HypervisorAdminNegativeUnderV252Test-548839919 tempest-HypervisorAdminNegativeUnderV252Test-548839919-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 31 15:56:26.674303 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7f6d4db1-349e-4bb7-9df6-d0bff580c70c tempest-HypervisorAdminNegativeUnderV252Test-548839919 tempest-HypervisorAdminNegativeUnderV252Test-548839919-project-admin] Request method failure captured: Aug 31 15:56:26.674303 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Aug 31 15:56:26.674303 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 15:56:26.674303 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 15:56:26.674303 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 15:56:26.674303 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 15:56:26.674303 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 15:56:26.674303 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 15:56:26.674303 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 15:56:26.674303 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 15:56:26.674303 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4SplKgX_Obctv3wY805hs8ox4MMtuVY38jdshoUElMs93c_1xyOZazNZU-NhWpa0F2RUQsbYysQnwcIZX7r96KVGxiJ3zoZmclf5aSYiDY7dJVg8IvzxHKmGl1wJSQ0Wlr5YKfBIEjxaqbvQDgc4FlCNfXRUkoPjm76Dqov0_-vPVM Aug 31 15:56:26.674303 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 15:56:26.674303 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 15:56:26.674303 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 15:56:26.674303 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 15:56:26.674303 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 15:56:26.674303 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 15:56:26.674303 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: cf1fabd21019465b9dc28a8d06cf98be Aug 31 15:56:26.674303 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-548839919 Aug 31 15:56:26.674303 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,admin,member Aug 31 15:56:26.674303 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,admin,member Aug 31 15:56:26.675788 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/cf1fabd21019465b9dc28a8d06cf98be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/cf1fabd21019465b9dc28a8d06cf98be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_cf1fabd21019465b9dc28a8d06cf98be", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/cf1fabd21019465b9dc28a8d06cf98be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 15:56:26.675788 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-548839919 Aug 31 15:56:26.675788 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: cf1fabd21019465b9dc28a8d06cf98be Aug 31 15:56:26.675788 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-548839919 Aug 31 15:56:26.675788 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-548839919-project-admin Aug 31 15:56:26.675788 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 15:56:26.675788 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 15:56:26.675788 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 21429b30f7334497976162ff3d1698e3 Aug 31 15:56:26.675788 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-548839919-project-admin Aug 31 15:56:26.675788 n-d-850499-9 devstack@n-api.service[122256]: method: Aug 31 15:56:26.675788 n-d-850499-9 devstack@n-api.service[122256]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 31 15:56:26.675788 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': 'nonexistent_hypervisor_name'} Aug 31 15:56:26.676570 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:56:26.676570 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:56:26.676570 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:56:26.676570 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:56:26.676570 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:56:26.676570 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:56:26.676570 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 15:56:26.676570 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 15:56:26.676570 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:56:26.676570 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:56:26.676570 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Aug 31 15:56:26.676570 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Aug 31 15:56:26.676570 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Aug 31 15:56:26.676570 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 31 15:56:26.676570 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 31 15:56:26.676570 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:56:26.676570 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:56:26.676570 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:56:26.676570 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:56:26.676570 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:56:26.677825 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:56:26.677825 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:56:26.677825 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:56:26.677825 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 31 15:56:26.677825 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:56:26.681293 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7f6d4db1-349e-4bb7-9df6-d0bff580c70c tempest-HypervisorAdminNegativeUnderV252Test-548839919 tempest-HypervisorAdminNegativeUnderV252Test-548839919-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:56:26.683383 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7f6d4db1-349e-4bb7-9df6-d0bff580c70c tempest-HypervisorAdminNegativeUnderV252Test-548839919 tempest-HypervisorAdminNegativeUnderV252Test-548839919-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.055338 Aug 31 15:56:26.686218 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 83/157] 10.222.0.61 () {58 vars in 1251 bytes} [Wed Aug 31 15:56:26 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 15:56:26.700483 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-cb0464de-48d5-4cb8-81f6-619bc88c97e1 tempest-HypervisorAdminNegativeUnderV252Test-548839919 tempest-HypervisorAdminNegativeUnderV252Test-548839919-project-admin] Calling method '.version_select at 0x7f5ae98eb5e0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:26.703395 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cb0464de-48d5-4cb8-81f6-619bc88c97e1 tempest-HypervisorAdminNegativeUnderV252Test-548839919 tempest-HypervisorAdminNegativeUnderV252Test-548839919-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:26.713494 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cb0464de-48d5-4cb8-81f6-619bc88c97e1 tempest-HypervisorAdminNegativeUnderV252Test-548839919 tempest-HypervisorAdminNegativeUnderV252Test-548839919-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:26.713960 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cb0464de-48d5-4cb8-81f6-619bc88c97e1 tempest-HypervisorAdminNegativeUnderV252Test-548839919 tempest-HypervisorAdminNegativeUnderV252Test-548839919-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:26.746972 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cb0464de-48d5-4cb8-81f6-619bc88c97e1 tempest-HypervisorAdminNegativeUnderV252Test-548839919 tempest-HypervisorAdminNegativeUnderV252Test-548839919-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:26.749273 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cb0464de-48d5-4cb8-81f6-619bc88c97e1 tempest-HypervisorAdminNegativeUnderV252Test-548839919 tempest-HypervisorAdminNegativeUnderV252Test-548839919-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:26.750056 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cb0464de-48d5-4cb8-81f6-619bc88c97e1 tempest-HypervisorAdminNegativeUnderV252Test-548839919 tempest-HypervisorAdminNegativeUnderV252Test-548839919-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:26.782419 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cb0464de-48d5-4cb8-81f6-619bc88c97e1 tempest-HypervisorAdminNegativeUnderV252Test-548839919 tempest-HypervisorAdminNegativeUnderV252Test-548839919-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:26.788218 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cb0464de-48d5-4cb8-81f6-619bc88c97e1 tempest-HypervisorAdminNegativeUnderV252Test-548839919 tempest-HypervisorAdminNegativeUnderV252Test-548839919-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:26.788817 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cb0464de-48d5-4cb8-81f6-619bc88c97e1 tempest-HypervisorAdminNegativeUnderV252Test-548839919 tempest-HypervisorAdminNegativeUnderV252Test-548839919-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:26.804525 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-cb0464de-48d5-4cb8-81f6-619bc88c97e1 tempest-HypervisorAdminNegativeUnderV252Test-548839919 tempest-HypervisorAdminNegativeUnderV252Test-548839919-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.114432 Aug 31 15:56:26.808688 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 84/158] 10.222.0.61 () {58 vars in 1146 bytes} [Wed Aug 31 15:56:26 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:56:26.820183 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3b3e9759-1951-468a-86d3-c9e63ffb8809 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:26.820997 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3b3e9759-1951-468a-86d3-c9e63ffb8809 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] [instance: 94898cf4-0065-4b87-acb5-e8d11bd1529a] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:26.835229 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3b3e9759-1951-468a-86d3-c9e63ffb8809 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:26.839017 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3b3e9759-1951-468a-86d3-c9e63ffb8809 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:26.839771 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3b3e9759-1951-468a-86d3-c9e63ffb8809 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:26.840709 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3b3e9759-1951-468a-86d3-c9e63ffb8809 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:26.844451 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3b3e9759-1951-468a-86d3-c9e63ffb8809 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:26.845118 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3b3e9759-1951-468a-86d3-c9e63ffb8809 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:26.846791 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-cbeac405-a5ee-49f4-8cf2-c31eca37935e tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377b1dedae45d2a804919e5ea69a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e5507d53224d19804717493d60bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:26.874401 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-cbeac405-a5ee-49f4-8cf2-c31eca37935e tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] 10.222.0.61 "GET /compute/v2.1/servers/3a0126e3-2324-4892-8908-2b6d2d5e2158" status: 200 len: 1389 microversion: 2.1 time: 0.727984 Aug 31 15:56:26.878792 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 75/159] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:26 2022] GET /compute/v2.1/servers/3a0126e3-2324-4892-8908-2b6d2d5e2158 => generated 1389 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:56:26.890056 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5be1f9f0-bd6c-4d72-8cb9-be88b0fbdb8e tempest-HypervisorAdminNegativeUnderV252Test-1299015296 tempest-HypervisorAdminNegativeUnderV252Test-1299015296-project] Calling method '.version_select at 0x7f5ae98c4a60>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:26.893945 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5be1f9f0-bd6c-4d72-8cb9-be88b0fbdb8e tempest-HypervisorAdminNegativeUnderV252Test-1299015296 tempest-HypervisorAdminNegativeUnderV252Test-1299015296-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '613dd1651d05463f8c551e8ae1408bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c30c5a89f24ab2b795d41fb941f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:26.902444 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5be1f9f0-bd6c-4d72-8cb9-be88b0fbdb8e tempest-HypervisorAdminNegativeUnderV252Test-1299015296 tempest-HypervisorAdminNegativeUnderV252Test-1299015296-project] Request method failure captured: Aug 31 15:56:26.902444 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Aug 31 15:56:26.902444 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 15:56:26.902444 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 15:56:26.902444 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 15:56:26.902444 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 15:56:26.902444 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 15:56:26.902444 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 15:56:26.902444 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 15:56:26.902444 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 15:56:26.902444 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4SoovzTRZ-f98O7lfYZl2jA2oAvAGPBH-ucabjQ8e8YZybY_bjR1xjAqmUzZni2FQwPLZ1bqT1c3NijwwuEX4Pmo5_UQbGK1pCjkqnEoK6SxhCQVcB8AyF0LNED2QwuZzp3vB55eBJ2SArfHwU-_xyl4kVlOCLPuW-_BtkTV6vTtZw Aug 31 15:56:26.902444 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 15:56:26.902444 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 15:56:26.902444 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 15:56:26.902444 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 15:56:26.902444 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 15:56:26.902444 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 15:56:26.902444 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: f0c30c5a89f24ab2b795d41fb941f7ff Aug 31 15:56:26.902444 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1299015296 Aug 31 15:56:26.902444 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 15:56:26.902444 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 15:56:26.905060 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f0c30c5a89f24ab2b795d41fb941f7ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f0c30c5a89f24ab2b795d41fb941f7ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f0c30c5a89f24ab2b795d41fb941f7ff", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f0c30c5a89f24ab2b795d41fb941f7ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 15:56:26.905060 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1299015296 Aug 31 15:56:26.905060 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: f0c30c5a89f24ab2b795d41fb941f7ff Aug 31 15:56:26.905060 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1299015296 Aug 31 15:56:26.905060 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1299015296-project Aug 31 15:56:26.905060 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 15:56:26.905060 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 15:56:26.905060 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 613dd1651d05463f8c551e8ae1408bde Aug 31 15:56:26.905060 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1299015296-project Aug 31 15:56:26.905060 n-d-850499-9 devstack@n-api.service[122257]: method: Aug 31 15:56:26.905060 n-d-850499-9 devstack@n-api.service[122257]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 31 15:56:26.905060 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '1'} Aug 31 15:56:26.906499 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:56:26.906499 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:56:26.906499 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:56:26.906499 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:56:26.906499 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:56:26.906499 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:56:26.906499 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 15:56:26.906499 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 15:56:26.906499 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:56:26.906499 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:56:26.906499 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Aug 31 15:56:26.906499 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Aug 31 15:56:26.906499 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 31 15:56:26.906499 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 31 15:56:26.906499 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 31 15:56:26.906499 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 31 15:56:26.906499 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 15:56:26.906499 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 31 15:56:26.906499 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 15:56:26.907690 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise self.value Aug 31 15:56:26.907690 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 31 15:56:26.907690 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 31 15:56:26.907690 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 31 15:56:26.907690 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 31 15:56:26.907690 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 31 15:56:26.907690 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 31 15:56:26.907690 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 31 15:56:26.907690 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:56:26.907690 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:56:26.907690 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:56:26.907690 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:56:26.907690 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:56:26.907690 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:56:26.907690 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 31 15:56:26.907690 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 31 15:56:26.907690 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 31 15:56:26.907690 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:56:26.910874 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5be1f9f0-bd6c-4d72-8cb9-be88b0fbdb8e tempest-HypervisorAdminNegativeUnderV252Test-1299015296 tempest-HypervisorAdminNegativeUnderV252Test-1299015296-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:56:26.912001 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5be1f9f0-bd6c-4d72-8cb9-be88b0fbdb8e tempest-HypervisorAdminNegativeUnderV252Test-1299015296 tempest-HypervisorAdminNegativeUnderV252Test-1299015296-project] 10.222.0.61 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.031723 Aug 31 15:56:26.913269 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 76/160] 10.222.0.61 () {58 vars in 1176 bytes} [Wed Aug 31 15:56:26 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 33 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:56:26.918371 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0ba5309d-95a7-4f06-9d2f-361df6687bb9 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:26.919165 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0ba5309d-95a7-4f06-9d2f-361df6687bb9 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] [instance: f2162319-5635-4c77-920d-9ecb3221d174] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:26.945784 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0ba5309d-95a7-4f06-9d2f-361df6687bb9 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:26.948161 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0ba5309d-95a7-4f06-9d2f-361df6687bb9 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:26.948776 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0ba5309d-95a7-4f06-9d2f-361df6687bb9 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:26.949657 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0ba5309d-95a7-4f06-9d2f-361df6687bb9 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:26.952357 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0ba5309d-95a7-4f06-9d2f-361df6687bb9 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:26.952978 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0ba5309d-95a7-4f06-9d2f-361df6687bb9 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:27.165179 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0ba5309d-95a7-4f06-9d2f-361df6687bb9 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:27.182229 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0ba5309d-95a7-4f06-9d2f-361df6687bb9 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:27.186505 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0ba5309d-95a7-4f06-9d2f-361df6687bb9 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:27.188108 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3b3e9759-1951-468a-86d3-c9e63ffb8809 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe750fe96e2444489edce1b2750fa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8904771b5154454896715024aa20bbcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:27.203719 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0ba5309d-95a7-4f06-9d2f-361df6687bb9 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] 10.222.0.61 "GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174" status: 200 len: 1417 microversion: 2.75 time: 0.289178 Aug 31 15:56:27.204674 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 77/161] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:56:26 2022] GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174 => generated 1417 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:56:27.206500 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3b3e9759-1951-468a-86d3-c9e63ffb8809 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] 10.222.0.61 "GET /compute/v2.1/servers/94898cf4-0065-4b87-acb5-e8d11bd1529a" status: 200 len: 1338 microversion: 2.1 time: 0.396551 Aug 31 15:56:27.212130 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 85/162] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:26 2022] GET /compute/v2.1/servers/94898cf4-0065-4b87-acb5-e8d11bd1529a => generated 1338 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:27.213297 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f610dc47-c20e-4b59-9c35-222704099675 tempest-HypervisorAdminNegativeUnderV252Test-548839919 tempest-HypervisorAdminNegativeUnderV252Test-548839919-project-admin] Calling method '.version_select at 0x7f5ae9ad9dc0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:27.222175 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f610dc47-c20e-4b59-9c35-222704099675 tempest-HypervisorAdminNegativeUnderV252Test-548839919 tempest-HypervisorAdminNegativeUnderV252Test-548839919-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:27.230716 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f610dc47-c20e-4b59-9c35-222704099675 tempest-HypervisorAdminNegativeUnderV252Test-548839919 tempest-HypervisorAdminNegativeUnderV252Test-548839919-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:27.232005 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f610dc47-c20e-4b59-9c35-222704099675 tempest-HypervisorAdminNegativeUnderV252Test-548839919 tempest-HypervisorAdminNegativeUnderV252Test-548839919-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:27.257203 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-f610dc47-c20e-4b59-9c35-222704099675 tempest-HypervisorAdminNegativeUnderV252Test-548839919 tempest-HypervisorAdminNegativeUnderV252Test-548839919-project-admin] HTTP exception thrown: No hypervisor matching '02498148-16f7-470b-a0e1-5cdb5a747057' could be found. Aug 31 15:56:27.265387 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f610dc47-c20e-4b59-9c35-222704099675 tempest-HypervisorAdminNegativeUnderV252Test-548839919 tempest-HypervisorAdminNegativeUnderV252Test-548839919-project-admin] Request method failure captured: Aug 31 15:56:27.265387 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/os-hypervisors/02498148-16f7-470b-a0e1-5cdb5a747057/servers HTTP/1.1 Aug 31 15:56:27.265387 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 15:56:27.265387 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 15:56:27.265387 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 15:56:27.265387 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 15:56:27.265387 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 15:56:27.265387 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 15:56:27.265387 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 15:56:27.265387 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 15:56:27.265387 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4SplKgX_Obctv3wY805hs8ox4MMtuVY38jdshoUElMs93c_1xyOZazNZU-NhWpa0F2RUQsbYysQnwcIZX7r96KVGxiJ3zoZmclf5aSYiDY7dJVg8IvzxHKmGl1wJSQ0Wlr5YKfBIEjxaqbvQDgc4FlCNfXRUkoPjm76Dqov0_-vPVM Aug 31 15:56:27.265387 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 15:56:27.265387 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 15:56:27.265387 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 15:56:27.265387 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 15:56:27.265387 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 15:56:27.265387 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 15:56:27.265387 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: cf1fabd21019465b9dc28a8d06cf98be Aug 31 15:56:27.265387 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-548839919 Aug 31 15:56:27.265387 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,admin,member Aug 31 15:56:27.265387 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,admin,member Aug 31 15:56:27.266898 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/cf1fabd21019465b9dc28a8d06cf98be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/cf1fabd21019465b9dc28a8d06cf98be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_cf1fabd21019465b9dc28a8d06cf98be", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/cf1fabd21019465b9dc28a8d06cf98be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 15:56:27.266898 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-548839919 Aug 31 15:56:27.266898 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: cf1fabd21019465b9dc28a8d06cf98be Aug 31 15:56:27.266898 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-548839919 Aug 31 15:56:27.266898 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-548839919-project-admin Aug 31 15:56:27.266898 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 15:56:27.266898 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 15:56:27.266898 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 21429b30f7334497976162ff3d1698e3 Aug 31 15:56:27.266898 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-548839919-project-admin Aug 31 15:56:27.266898 n-d-850499-9 devstack@n-api.service[122257]: method: Aug 31 15:56:27.266898 n-d-850499-9 devstack@n-api.service[122257]: exception: No hypervisor matching '02498148-16f7-470b-a0e1-5cdb5a747057' could be found. Aug 31 15:56:27.266898 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '02498148-16f7-470b-a0e1-5cdb5a747057'} Aug 31 15:56:27.267727 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:56:27.267727 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:56:27.267727 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:56:27.267727 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:56:27.267727 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:56:27.267727 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:56:27.267727 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 15:56:27.267727 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 15:56:27.267727 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:56:27.267727 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:56:27.267727 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Aug 31 15:56:27.267727 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Aug 31 15:56:27.267727 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Aug 31 15:56:27.267727 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 31 15:56:27.267727 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '02498148-16f7-470b-a0e1-5cdb5a747057' could be found. Aug 31 15:56:27.267727 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:56:27.267727 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:56:27.267727 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:56:27.267727 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:56:27.268968 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:56:27.268968 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:56:27.268968 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:56:27.268968 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:56:27.268968 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '02498148-16f7-470b-a0e1-5cdb5a747057' could be found. Aug 31 15:56:27.268968 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:56:27.270828 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f610dc47-c20e-4b59-9c35-222704099675 tempest-HypervisorAdminNegativeUnderV252Test-548839919 tempest-HypervisorAdminNegativeUnderV252Test-548839919-project-admin] Returning 404 to user: No hypervisor matching '02498148-16f7-470b-a0e1-5cdb5a747057' could be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:56:27.273529 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f610dc47-c20e-4b59-9c35-222704099675 tempest-HypervisorAdminNegativeUnderV252Test-548839919 tempest-HypervisorAdminNegativeUnderV252Test-548839919-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hypervisors/02498148-16f7-470b-a0e1-5cdb5a747057/servers" status: 404 len: 123 microversion: 2.1 time: 0.067088 Aug 31 15:56:27.274261 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 78/163] 10.222.0.61 () {58 vars in 1281 bytes} [Wed Aug 31 15:56:27 2022] GET /compute/v2.1/os-hypervisors/02498148-16f7-470b-a0e1-5cdb5a747057/servers => generated 123 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:56:27.702747 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-fc8ba63b-afc2-408d-80ba-1aaa0f87ed47 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-650459557", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:56:27.852218 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-fc8ba63b-afc2-408d-80ba-1aaa0f87ed47 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] validate_networks() for None {{(pid=122256) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 15:56:27.898337 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-23175e6d-cb58-4896-9515-f1a9001acbfc tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:27.899542 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-23175e6d-cb58-4896-9515-f1a9001acbfc tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] [instance: 3a0126e3-2324-4892-8908-2b6d2d5e2158] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:27.912902 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-23175e6d-cb58-4896-9515-f1a9001acbfc tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:27.914452 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-23175e6d-cb58-4896-9515-f1a9001acbfc tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:27.916291 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-23175e6d-cb58-4896-9515-f1a9001acbfc tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:27.918359 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-23175e6d-cb58-4896-9515-f1a9001acbfc tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:27.919061 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-23175e6d-cb58-4896-9515-f1a9001acbfc tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:27.919809 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-23175e6d-cb58-4896-9515-f1a9001acbfc tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:28.589648 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-fc8ba63b-afc2-408d-80ba-1aaa0f87ed47 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 15:56:28.590269 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-fc8ba63b-afc2-408d-80ba-1aaa0f87ed47 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 15:56:28.590898 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-fc8ba63b-afc2-408d-80ba-1aaa0f87ed47 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 15:56:28.592330 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-fc8ba63b-afc2-408d-80ba-1aaa0f87ed47 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 15:56:28.593037 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-fc8ba63b-afc2-408d-80ba-1aaa0f87ed47 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 15:56:28.610596 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fc8ba63b-afc2-408d-80ba-1aaa0f87ed47 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:28.611097 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fc8ba63b-afc2-408d-80ba-1aaa0f87ed47 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:28.611779 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fc8ba63b-afc2-408d-80ba-1aaa0f87ed47 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:28.612297 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fc8ba63b-afc2-408d-80ba-1aaa0f87ed47 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:28.621581 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fc8ba63b-afc2-408d-80ba-1aaa0f87ed47 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:28.622312 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fc8ba63b-afc2-408d-80ba-1aaa0f87ed47 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:28.668428 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-fc8ba63b-afc2-408d-80ba-1aaa0f87ed47 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Getting quotas for project 6f665e5697c4453c872940b4c0a88772. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:56:28.684254 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-fc8ba63b-afc2-408d-80ba-1aaa0f87ed47 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Getting quotas for user fedc04be9f46432fb954d7dbcfe53488 and project 6f665e5697c4453c872940b4c0a88772. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:56:28.715572 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-fc8ba63b-afc2-408d-80ba-1aaa0f87ed47 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Going to run 1 instances... {{(pid=122256) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 15:56:28.721250 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-fc8ba63b-afc2-408d-80ba-1aaa0f87ed47 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] [instance: 1b233a49-d4f5-412d-8239-74df4ce63aa5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 15:56:28.824940 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-23175e6d-cb58-4896-9515-f1a9001acbfc tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377b1dedae45d2a804919e5ea69a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e5507d53224d19804717493d60bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:28.839062 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-23175e6d-cb58-4896-9515-f1a9001acbfc tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] 10.222.0.61 "GET /compute/v2.1/servers/3a0126e3-2324-4892-8908-2b6d2d5e2158" status: 200 len: 1389 microversion: 2.1 time: 0.944646 Aug 31 15:56:28.860437 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 79/164] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:27 2022] GET /compute/v2.1/servers/3a0126e3-2324-4892-8908-2b6d2d5e2158 => generated 1389 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:56:28.873449 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-af71ecdc-2f17-4ab1-818e-231a4fe945c6 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:28.874271 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-af71ecdc-2f17-4ab1-818e-231a4fe945c6 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] [instance: 94898cf4-0065-4b87-acb5-e8d11bd1529a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:28.898995 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-fc8ba63b-afc2-408d-80ba-1aaa0f87ed47 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.435479 Aug 31 15:56:28.901957 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-af71ecdc-2f17-4ab1-818e-231a4fe945c6 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:28.902466 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-af71ecdc-2f17-4ab1-818e-231a4fe945c6 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:28.902901 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-af71ecdc-2f17-4ab1-818e-231a4fe945c6 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:28.903585 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 86/165] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 15:56:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1441 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 15:56:28.906953 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-af71ecdc-2f17-4ab1-818e-231a4fe945c6 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:28.907927 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-af71ecdc-2f17-4ab1-818e-231a4fe945c6 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:28.912684 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-af71ecdc-2f17-4ab1-818e-231a4fe945c6 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:28.917949 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e7bb5a9f-078c-417f-80b5-2818b9b4c70b tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:28.918905 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e7bb5a9f-078c-417f-80b5-2818b9b4c70b tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] [instance: f2162319-5635-4c77-920d-9ecb3221d174] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:28.933529 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e7bb5a9f-078c-417f-80b5-2818b9b4c70b tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:28.935955 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e7bb5a9f-078c-417f-80b5-2818b9b4c70b tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:28.937545 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e7bb5a9f-078c-417f-80b5-2818b9b4c70b tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:28.939628 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e7bb5a9f-078c-417f-80b5-2818b9b4c70b tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:28.940967 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e7bb5a9f-078c-417f-80b5-2818b9b4c70b tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:28.942983 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e7bb5a9f-078c-417f-80b5-2818b9b4c70b tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:29.088132 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:56:29.200039 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e7bb5a9f-078c-417f-80b5-2818b9b4c70b tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:29.213490 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e7bb5a9f-078c-417f-80b5-2818b9b4c70b tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:29.215885 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e7bb5a9f-078c-417f-80b5-2818b9b4c70b tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:29.226805 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e7bb5a9f-078c-417f-80b5-2818b9b4c70b tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] 10.222.0.61 "GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174" status: 200 len: 1417 microversion: 2.75 time: 0.320063 Aug 31 15:56:29.241517 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 87/166] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:56:28 2022] GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174 => generated 1417 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:56:29.259450 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-77481730-15c5-4071-b475-e831696ca0fe tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:29.260328 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-77481730-15c5-4071-b475-e831696ca0fe tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] [instance: 1b233a49-d4f5-412d-8239-74df4ce63aa5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:29.338326 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-77481730-15c5-4071-b475-e831696ca0fe tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc04be9f46432fb954d7dbcfe53488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f665e5697c4453c872940b4c0a88772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:29.363270 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-77481730-15c5-4071-b475-e831696ca0fe tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] 10.222.0.61 "GET /compute/v2.1/servers/1b233a49-d4f5-412d-8239-74df4ce63aa5" status: 200 len: 1216 microversion: 2.1 time: 0.120539 Aug 31 15:56:29.366490 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 88/167] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:29 2022] GET /compute/v2.1/servers/1b233a49-d4f5-412d-8239-74df4ce63aa5 => generated 1216 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:29.474984 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-af71ecdc-2f17-4ab1-818e-231a4fe945c6 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe750fe96e2444489edce1b2750fa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8904771b5154454896715024aa20bbcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:29.499449 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-af71ecdc-2f17-4ab1-818e-231a4fe945c6 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] 10.222.0.61 "GET /compute/v2.1/servers/94898cf4-0065-4b87-acb5-e8d11bd1529a" status: 200 len: 1338 microversion: 2.1 time: 0.633871 Aug 31 15:56:29.514588 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 80/168] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:28 2022] GET /compute/v2.1/servers/94898cf4-0065-4b87-acb5-e8d11bd1529a => generated 1338 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:29.877414 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-720d4dc3-8c23-464f-9cfc-f4042197ecdf tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:29.878241 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-720d4dc3-8c23-464f-9cfc-f4042197ecdf tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] [instance: 3a0126e3-2324-4892-8908-2b6d2d5e2158] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:29.900508 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-720d4dc3-8c23-464f-9cfc-f4042197ecdf tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:29.905199 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-720d4dc3-8c23-464f-9cfc-f4042197ecdf tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:29.905801 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-720d4dc3-8c23-464f-9cfc-f4042197ecdf tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:29.909973 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-720d4dc3-8c23-464f-9cfc-f4042197ecdf tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:29.912216 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-720d4dc3-8c23-464f-9cfc-f4042197ecdf tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:29.917982 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-720d4dc3-8c23-464f-9cfc-f4042197ecdf tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:30.254384 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e8e90c72-9692-4d1f-adca-521e4e175086 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:30.255610 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e8e90c72-9692-4d1f-adca-521e4e175086 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] [instance: f2162319-5635-4c77-920d-9ecb3221d174] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:30.281051 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e8e90c72-9692-4d1f-adca-521e4e175086 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:30.281435 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e8e90c72-9692-4d1f-adca-521e4e175086 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:30.286467 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e8e90c72-9692-4d1f-adca-521e4e175086 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:30.290026 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e8e90c72-9692-4d1f-adca-521e4e175086 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:30.291137 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e8e90c72-9692-4d1f-adca-521e4e175086 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:30.292348 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e8e90c72-9692-4d1f-adca-521e4e175086 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:30.345913 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-720d4dc3-8c23-464f-9cfc-f4042197ecdf tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377b1dedae45d2a804919e5ea69a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e5507d53224d19804717493d60bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:30.361597 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-720d4dc3-8c23-464f-9cfc-f4042197ecdf tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] 10.222.0.61 "GET /compute/v2.1/servers/3a0126e3-2324-4892-8908-2b6d2d5e2158" status: 200 len: 1389 microversion: 2.1 time: 0.494885 Aug 31 15:56:30.364066 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 89/169] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:29 2022] GET /compute/v2.1/servers/3a0126e3-2324-4892-8908-2b6d2d5e2158 => generated 1389 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:30.391640 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8b03360e-991d-4ad0-bc8f-829a7bc8c009 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:30.393619 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8b03360e-991d-4ad0-bc8f-829a7bc8c009 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] [instance: 1b233a49-d4f5-412d-8239-74df4ce63aa5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:30.402704 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8b03360e-991d-4ad0-bc8f-829a7bc8c009 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:30.405195 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8b03360e-991d-4ad0-bc8f-829a7bc8c009 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:30.405653 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8b03360e-991d-4ad0-bc8f-829a7bc8c009 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:30.413874 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8b03360e-991d-4ad0-bc8f-829a7bc8c009 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:30.414484 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8b03360e-991d-4ad0-bc8f-829a7bc8c009 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:30.416265 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8b03360e-991d-4ad0-bc8f-829a7bc8c009 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:30.438773 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e8e90c72-9692-4d1f-adca-521e4e175086 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:30.453671 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e8e90c72-9692-4d1f-adca-521e4e175086 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:30.459165 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e8e90c72-9692-4d1f-adca-521e4e175086 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:30.468013 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e8e90c72-9692-4d1f-adca-521e4e175086 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] 10.222.0.61 "GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174" status: 200 len: 1417 microversion: 2.75 time: 0.218663 Aug 31 15:56:30.469070 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 81/170] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:56:30 2022] GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174 => generated 1417 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:56:30.522966 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4ba4476b-4524-4557-b6da-830a0b4ee886 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:30.524215 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4ba4476b-4524-4557-b6da-830a0b4ee886 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] [instance: 94898cf4-0065-4b87-acb5-e8d11bd1529a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:30.538016 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4ba4476b-4524-4557-b6da-830a0b4ee886 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:30.538764 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4ba4476b-4524-4557-b6da-830a0b4ee886 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:30.543948 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4ba4476b-4524-4557-b6da-830a0b4ee886 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:30.546432 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4ba4476b-4524-4557-b6da-830a0b4ee886 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:30.550465 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4ba4476b-4524-4557-b6da-830a0b4ee886 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:30.551221 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4ba4476b-4524-4557-b6da-830a0b4ee886 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:30.594409 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8b03360e-991d-4ad0-bc8f-829a7bc8c009 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc04be9f46432fb954d7dbcfe53488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f665e5697c4453c872940b4c0a88772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:30.605583 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8b03360e-991d-4ad0-bc8f-829a7bc8c009 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] 10.222.0.61 "GET /compute/v2.1/servers/1b233a49-d4f5-412d-8239-74df4ce63aa5" status: 200 len: 1289 microversion: 2.1 time: 0.220085 Aug 31 15:56:30.611126 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 90/171] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:30 2022] GET /compute/v2.1/servers/1b233a49-d4f5-412d-8239-74df4ce63aa5 => generated 1289 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:31.080718 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-4ba4476b-4524-4557-b6da-830a0b4ee886 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe750fe96e2444489edce1b2750fa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8904771b5154454896715024aa20bbcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:31.093455 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4ba4476b-4524-4557-b6da-830a0b4ee886 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] 10.222.0.61 "GET /compute/v2.1/servers/94898cf4-0065-4b87-acb5-e8d11bd1529a" status: 200 len: 1338 microversion: 2.1 time: 0.571034 Aug 31 15:56:31.094758 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 82/172] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:30 2022] GET /compute/v2.1/servers/94898cf4-0065-4b87-acb5-e8d11bd1529a => generated 1338 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:31.391252 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7f159262-b2e0-48a3-abfd-3c72df1b87b8 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:31.391979 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7f159262-b2e0-48a3-abfd-3c72df1b87b8 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] [instance: 3a0126e3-2324-4892-8908-2b6d2d5e2158] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:31.412470 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7f159262-b2e0-48a3-abfd-3c72df1b87b8 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:31.414225 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7f159262-b2e0-48a3-abfd-3c72df1b87b8 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:31.416937 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7f159262-b2e0-48a3-abfd-3c72df1b87b8 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:31.419080 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7f159262-b2e0-48a3-abfd-3c72df1b87b8 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:31.419808 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7f159262-b2e0-48a3-abfd-3c72df1b87b8 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:31.423159 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7f159262-b2e0-48a3-abfd-3c72df1b87b8 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:31.502230 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3c1200cc-81d2-43e3-97f1-eb6539b05a8c tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:31.502956 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3c1200cc-81d2-43e3-97f1-eb6539b05a8c tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] [instance: f2162319-5635-4c77-920d-9ecb3221d174] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:31.522133 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3c1200cc-81d2-43e3-97f1-eb6539b05a8c tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:31.522654 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3c1200cc-81d2-43e3-97f1-eb6539b05a8c tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:31.523117 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3c1200cc-81d2-43e3-97f1-eb6539b05a8c tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:31.526126 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3c1200cc-81d2-43e3-97f1-eb6539b05a8c tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:31.526609 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3c1200cc-81d2-43e3-97f1-eb6539b05a8c tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:31.530286 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3c1200cc-81d2-43e3-97f1-eb6539b05a8c tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:32.148782 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3c1200cc-81d2-43e3-97f1-eb6539b05a8c tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:32.181947 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3c1200cc-81d2-43e3-97f1-eb6539b05a8c tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:32.190314 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3c1200cc-81d2-43e3-97f1-eb6539b05a8c tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:32.217299 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3c1200cc-81d2-43e3-97f1-eb6539b05a8c tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] 10.222.0.61 "GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174" status: 200 len: 1417 microversion: 2.75 time: 0.718225 Aug 31 15:56:32.217957 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 83/173] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:56:31 2022] GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174 => generated 1417 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 15:56:32.278080 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0a2f83f1-bdb3-4aa7-848a-07bf9934ae36 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:32.288755 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0a2f83f1-bdb3-4aa7-848a-07bf9934ae36 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] [instance: 1b233a49-d4f5-412d-8239-74df4ce63aa5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:32.318455 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0a2f83f1-bdb3-4aa7-848a-07bf9934ae36 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:32.319653 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0a2f83f1-bdb3-4aa7-848a-07bf9934ae36 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:32.320283 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0a2f83f1-bdb3-4aa7-848a-07bf9934ae36 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:32.321506 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0a2f83f1-bdb3-4aa7-848a-07bf9934ae36 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:32.322634 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0a2f83f1-bdb3-4aa7-848a-07bf9934ae36 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:32.323561 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0a2f83f1-bdb3-4aa7-848a-07bf9934ae36 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:32.467926 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7f159262-b2e0-48a3-abfd-3c72df1b87b8 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377b1dedae45d2a804919e5ea69a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e5507d53224d19804717493d60bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:32.484138 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7f159262-b2e0-48a3-abfd-3c72df1b87b8 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] 10.222.0.61 "GET /compute/v2.1/servers/3a0126e3-2324-4892-8908-2b6d2d5e2158" status: 200 len: 1389 microversion: 2.1 time: 1.097250 Aug 31 15:56:32.484748 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 91/174] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:31 2022] GET /compute/v2.1/servers/3a0126e3-2324-4892-8908-2b6d2d5e2158 => generated 1389 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:32.501805 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-be468283-67f0-4c2f-abe9-5bf3522ddf6b tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:32.502437 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-be468283-67f0-4c2f-abe9-5bf3522ddf6b tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] [instance: 94898cf4-0065-4b87-acb5-e8d11bd1529a] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:32.526611 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-be468283-67f0-4c2f-abe9-5bf3522ddf6b tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:32.528728 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-be468283-67f0-4c2f-abe9-5bf3522ddf6b tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:32.529392 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-be468283-67f0-4c2f-abe9-5bf3522ddf6b tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:32.530257 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-be468283-67f0-4c2f-abe9-5bf3522ddf6b tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:32.530756 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-be468283-67f0-4c2f-abe9-5bf3522ddf6b tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:32.540066 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-be468283-67f0-4c2f-abe9-5bf3522ddf6b tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:32.568704 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0a2f83f1-bdb3-4aa7-848a-07bf9934ae36 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc04be9f46432fb954d7dbcfe53488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f665e5697c4453c872940b4c0a88772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:32.586754 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0a2f83f1-bdb3-4aa7-848a-07bf9934ae36 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] 10.222.0.61 "GET /compute/v2.1/servers/1b233a49-d4f5-412d-8239-74df4ce63aa5" status: 200 len: 1295 microversion: 2.1 time: 0.364012 Aug 31 15:56:32.588113 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 84/175] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:32 2022] GET /compute/v2.1/servers/1b233a49-d4f5-412d-8239-74df4ce63aa5 => generated 1295 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:32.882697 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-be468283-67f0-4c2f-abe9-5bf3522ddf6b tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe750fe96e2444489edce1b2750fa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8904771b5154454896715024aa20bbcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:32.892481 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-be468283-67f0-4c2f-abe9-5bf3522ddf6b tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] 10.222.0.61 "GET /compute/v2.1/servers/94898cf4-0065-4b87-acb5-e8d11bd1529a" status: 200 len: 1338 microversion: 2.1 time: 0.406651 Aug 31 15:56:32.904244 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 92/176] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:32 2022] GET /compute/v2.1/servers/94898cf4-0065-4b87-acb5-e8d11bd1529a => generated 1338 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:33.253265 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6a201216-57df-452b-a210-df8a49fed20c tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:33.255459 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6a201216-57df-452b-a210-df8a49fed20c tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] [instance: f2162319-5635-4c77-920d-9ecb3221d174] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:33.286542 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6a201216-57df-452b-a210-df8a49fed20c tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:33.287429 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6a201216-57df-452b-a210-df8a49fed20c tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:33.288231 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6a201216-57df-452b-a210-df8a49fed20c tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:33.289391 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6a201216-57df-452b-a210-df8a49fed20c tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:33.290004 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6a201216-57df-452b-a210-df8a49fed20c tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:33.290582 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6a201216-57df-452b-a210-df8a49fed20c tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:33.497119 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-5da81125-dfc2-4c42-826c-7328b816b162 req-a629e47b-6f61-4611-aeec-ac128eccd3cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94898cf4-0065-4b87-acb5-e8d11bd1529a", "name": "network-vif-plugged", "status": "completed", "tag": "455d9782-e6ff-49f1-b13c-8ca98fbeb37c"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:56:33.515530 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-6a201216-57df-452b-a210-df8a49fed20c tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:33.555612 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-6a201216-57df-452b-a210-df8a49fed20c tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:33.555805 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-5da81125-dfc2-4c42-826c-7328b816b162 req-a629e47b-6f61-4611-aeec-ac128eccd3cd service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:33.556196 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-5da81125-dfc2-4c42-826c-7328b816b162 req-a629e47b-6f61-4611-aeec-ac128eccd3cd service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:33.556636 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-5da81125-dfc2-4c42-826c-7328b816b162 req-a629e47b-6f61-4611-aeec-ac128eccd3cd service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:33.557324 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-6a201216-57df-452b-a210-df8a49fed20c tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:33.580783 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6a201216-57df-452b-a210-df8a49fed20c tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] 10.222.0.61 "GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174" status: 200 len: 1438 microversion: 2.75 time: 0.336171 Aug 31 15:56:33.583846 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-5da81125-dfc2-4c42-826c-7328b816b162 req-a629e47b-6f61-4611-aeec-ac128eccd3cd service nova] Creating event network-vif-plugged:455d9782-e6ff-49f1-b13c-8ca98fbeb37c for instance 94898cf4-0065-4b87-acb5-e8d11bd1529a on n-h1-850499-9 Aug 31 15:56:33.584279 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 85/177] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:56:33 2022] GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174 => generated 1438 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:56:33.595329 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0ff7dcd9-aa29-4da0-b72e-943fbc9e1639 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:33.597228 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-5da81125-dfc2-4c42-826c-7328b816b162 req-a629e47b-6f61-4611-aeec-ac128eccd3cd service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.242783 Aug 31 15:56:33.597985 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 93/178] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 15:56:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 15:56:33.598807 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0ff7dcd9-aa29-4da0-b72e-943fbc9e1639 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] [instance: 3a0126e3-2324-4892-8908-2b6d2d5e2158] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:33.619984 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0ff7dcd9-aa29-4da0-b72e-943fbc9e1639 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:33.621480 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3dccac46-60bf-4dd1-ac00-19f4ad7c32b2 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:33.622030 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3dccac46-60bf-4dd1-ac00-19f4ad7c32b2 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] [instance: 1b233a49-d4f5-412d-8239-74df4ce63aa5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:33.626261 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0ff7dcd9-aa29-4da0-b72e-943fbc9e1639 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:33.627775 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0ff7dcd9-aa29-4da0-b72e-943fbc9e1639 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:33.630594 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0ff7dcd9-aa29-4da0-b72e-943fbc9e1639 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:33.634588 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0ff7dcd9-aa29-4da0-b72e-943fbc9e1639 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:33.635456 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0ff7dcd9-aa29-4da0-b72e-943fbc9e1639 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:33.656371 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3dccac46-60bf-4dd1-ac00-19f4ad7c32b2 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:33.656876 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3dccac46-60bf-4dd1-ac00-19f4ad7c32b2 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:33.657320 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3dccac46-60bf-4dd1-ac00-19f4ad7c32b2 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:33.658101 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3dccac46-60bf-4dd1-ac00-19f4ad7c32b2 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:33.658562 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3dccac46-60bf-4dd1-ac00-19f4ad7c32b2 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:33.658989 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3dccac46-60bf-4dd1-ac00-19f4ad7c32b2 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:33.678774 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=100 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:56:34.165975 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0ff7dcd9-aa29-4da0-b72e-943fbc9e1639 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377b1dedae45d2a804919e5ea69a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e5507d53224d19804717493d60bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:34.181027 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0ff7dcd9-aa29-4da0-b72e-943fbc9e1639 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] 10.222.0.61 "GET /compute/v2.1/servers/3a0126e3-2324-4892-8908-2b6d2d5e2158" status: 200 len: 1389 microversion: 2.1 time: 0.595633 Aug 31 15:56:34.187477 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 86/179] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:33 2022] GET /compute/v2.1/servers/3a0126e3-2324-4892-8908-2b6d2d5e2158 => generated 1389 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:34.196846 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b14499df-3db5-42af-8448-b1d52fa3c3c0 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:56:34.207180 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b14499df-3db5-42af-8448-b1d52fa3c3c0 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] [instance: f2162319-5635-4c77-920d-9ecb3221d174] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:34.221769 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b14499df-3db5-42af-8448-b1d52fa3c3c0 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:34.222312 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b14499df-3db5-42af-8448-b1d52fa3c3c0 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:34.225657 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b14499df-3db5-42af-8448-b1d52fa3c3c0 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:34.226622 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b14499df-3db5-42af-8448-b1d52fa3c3c0 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:34.229309 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b14499df-3db5-42af-8448-b1d52fa3c3c0 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:34.230012 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b14499df-3db5-42af-8448-b1d52fa3c3c0 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:34.235587 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3dccac46-60bf-4dd1-ac00-19f4ad7c32b2 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc04be9f46432fb954d7dbcfe53488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f665e5697c4453c872940b4c0a88772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:34.247951 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3dccac46-60bf-4dd1-ac00-19f4ad7c32b2 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] 10.222.0.61 "GET /compute/v2.1/servers/1b233a49-d4f5-412d-8239-74df4ce63aa5" status: 200 len: 1337 microversion: 2.1 time: 0.638008 Aug 31 15:56:34.250434 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 94/180] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:33 2022] GET /compute/v2.1/servers/1b233a49-d4f5-412d-8239-74df4ce63aa5 => generated 1337 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:34.255535 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-868d79f8-cd73-4e59-86de-245777bdbf56 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:34.256137 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-868d79f8-cd73-4e59-86de-245777bdbf56 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] [instance: 94898cf4-0065-4b87-acb5-e8d11bd1529a] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:34.273827 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-868d79f8-cd73-4e59-86de-245777bdbf56 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:34.274328 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-868d79f8-cd73-4e59-86de-245777bdbf56 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:34.274763 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-868d79f8-cd73-4e59-86de-245777bdbf56 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:34.275474 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-868d79f8-cd73-4e59-86de-245777bdbf56 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:34.275956 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-868d79f8-cd73-4e59-86de-245777bdbf56 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:34.276382 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-868d79f8-cd73-4e59-86de-245777bdbf56 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:34.418303 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-b14499df-3db5-42af-8448-b1d52fa3c3c0 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 15:56:34.418729 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-b14499df-3db5-42af-8448-b1d52fa3c3c0 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 15:56:34.419191 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-b14499df-3db5-42af-8448-b1d52fa3c3c0 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 15:56:34.420428 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-b14499df-3db5-42af-8448-b1d52fa3c3c0 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 15:56:34.421005 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-b14499df-3db5-42af-8448-b1d52fa3c3c0 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 15:56:34.586792 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b14499df-3db5-42af-8448-b1d52fa3c3c0 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] [instance: f2162319-5635-4c77-920d-9ecb3221d174] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:34.601699 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b14499df-3db5-42af-8448-b1d52fa3c3c0 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:34.602212 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b14499df-3db5-42af-8448-b1d52fa3c3c0 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:34.602949 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b14499df-3db5-42af-8448-b1d52fa3c3c0 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:34.603634 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b14499df-3db5-42af-8448-b1d52fa3c3c0 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:34.604093 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b14499df-3db5-42af-8448-b1d52fa3c3c0 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:34.604519 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b14499df-3db5-42af-8448-b1d52fa3c3c0 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:34.854134 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b14499df-3db5-42af-8448-b1d52fa3c3c0 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:34.862807 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-868d79f8-cd73-4e59-86de-245777bdbf56 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe750fe96e2444489edce1b2750fa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8904771b5154454896715024aa20bbcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:34.866171 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b14499df-3db5-42af-8448-b1d52fa3c3c0 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:34.867709 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b14499df-3db5-42af-8448-b1d52fa3c3c0 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:34.883637 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b14499df-3db5-42af-8448-b1d52fa3c3c0 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] 10.222.0.61 "POST /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174/action" status: 202 len: 1495 microversion: 2.75 time: 0.694759 Aug 31 15:56:34.884258 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-868d79f8-cd73-4e59-86de-245777bdbf56 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] 10.222.0.61 "GET /compute/v2.1/servers/94898cf4-0065-4b87-acb5-e8d11bd1529a" status: 200 len: 1338 microversion: 2.1 time: 0.630697 Aug 31 15:56:34.889610 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 87/181] 10.222.0.61 () {62 vars in 1319 bytes} [Wed Aug 31 15:56:34 2022] POST /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174/action => generated 1495 bytes in 701 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 31 15:56:34.898713 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 95/182] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:34 2022] GET /compute/v2.1/servers/94898cf4-0065-4b87-acb5-e8d11bd1529a => generated 1338 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:34.920133 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f708975c-d239-40e7-8b23-96442e4e29ec tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:34.923134 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f708975c-d239-40e7-8b23-96442e4e29ec tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] [instance: f2162319-5635-4c77-920d-9ecb3221d174] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:34.940120 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f708975c-d239-40e7-8b23-96442e4e29ec tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:34.940991 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f708975c-d239-40e7-8b23-96442e4e29ec tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:34.942176 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f708975c-d239-40e7-8b23-96442e4e29ec tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:34.945780 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f708975c-d239-40e7-8b23-96442e4e29ec tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:34.946667 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f708975c-d239-40e7-8b23-96442e4e29ec tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:34.948357 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f708975c-d239-40e7-8b23-96442e4e29ec tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:35.116982 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2d39afa4-6730-4949-bf00-bbbf93efe033 tempest-InstanceUsageAuditLogNegativeTestJSON-428252471 tempest-InstanceUsageAuditLogNegativeTestJSON-428252471-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:35.118499 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-2d39afa4-6730-4949-bf00-bbbf93efe033 tempest-InstanceUsageAuditLogNegativeTestJSON-428252471 tempest-InstanceUsageAuditLogNegativeTestJSON-428252471-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Aug 31 15:56:35.126482 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2d39afa4-6730-4949-bf00-bbbf93efe033 tempest-InstanceUsageAuditLogNegativeTestJSON-428252471 tempest-InstanceUsageAuditLogNegativeTestJSON-428252471-project-admin] Request method failure captured: Aug 31 15:56:35.126482 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Aug 31 15:56:35.126482 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 15:56:35.126482 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 15:56:35.126482 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 15:56:35.126482 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 15:56:35.126482 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 15:56:35.126482 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 15:56:35.126482 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 15:56:35.126482 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 15:56:35.126482 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4SxoT4Mpzcy__vx851cyuAaWZ1ER545GQOapnun2dVj8J8G4nmN4fmz5SHD_xrO--CydXphyRdfp7AwTw6qPA0b1aenO2nTusZxVE9eKve3arD0PIStt8kAgaYKH_ss8ms24nr4BO6ivQpAqfMY6rPeY3q1niZX07Z5PBmqS12RGlo Aug 31 15:56:35.126482 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 15:56:35.126482 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 15:56:35.126482 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 15:56:35.126482 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 15:56:35.126482 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 15:56:35.126482 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 15:56:35.126482 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 8ee60425ac8649fb8e91d2c98f4ed23d Aug 31 15:56:35.126482 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-428252471 Aug 31 15:56:35.126482 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,admin,member Aug 31 15:56:35.126482 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,admin,member Aug 31 15:56:35.127953 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8ee60425ac8649fb8e91d2c98f4ed23d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/8ee60425ac8649fb8e91d2c98f4ed23d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_8ee60425ac8649fb8e91d2c98f4ed23d", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8ee60425ac8649fb8e91d2c98f4ed23d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 15:56:35.127953 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-428252471 Aug 31 15:56:35.127953 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 8ee60425ac8649fb8e91d2c98f4ed23d Aug 31 15:56:35.127953 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-428252471 Aug 31 15:56:35.127953 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-428252471-project-admin Aug 31 15:56:35.127953 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 15:56:35.127953 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 15:56:35.127953 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 6dd6b47e2cda479fa1657f7152414165 Aug 31 15:56:35.127953 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-428252471-project-admin Aug 31 15:56:35.127953 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 15:56:35.127953 n-d-850499-9 devstack@n-api.service[122257]: exception: Invalid timestamp for date invalid_time Aug 31 15:56:35.128758 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': 'invalid_time'} Aug 31 15:56:35.128758 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:56:35.128758 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:56:35.128758 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Aug 31 15:56:35.128758 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Aug 31 15:56:35.128758 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Aug 31 15:56:35.128758 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Aug 31 15:56:35.128758 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Aug 31 15:56:35.128758 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Aug 31 15:56:35.128758 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Aug 31 15:56:35.128758 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:56:35.128758 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:56:35.128758 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:56:35.128758 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:56:35.128758 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:56:35.128758 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:56:35.128758 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:56:35.128758 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:56:35.128758 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:56:35.128758 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:56:35.129998 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Aug 31 15:56:35.129998 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Aug 31 15:56:35.129998 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Aug 31 15:56:35.129998 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:56:35.129998 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:56:35.129998 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:56:35.129998 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:56:35.129998 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:56:35.129998 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:56:35.129998 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:56:35.129998 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:56:35.129998 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Aug 31 15:56:35.129998 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:56:35.131703 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2d39afa4-6730-4949-bf00-bbbf93efe033 tempest-InstanceUsageAuditLogNegativeTestJSON-428252471 tempest-InstanceUsageAuditLogNegativeTestJSON-428252471-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:56:35.132712 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2d39afa4-6730-4949-bf00-bbbf93efe033 tempest-InstanceUsageAuditLogNegativeTestJSON-428252471 tempest-InstanceUsageAuditLogNegativeTestJSON-428252471-project-admin] 10.222.0.61 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.241927 Aug 31 15:56:35.133742 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 88/183] 10.222.0.61 () {58 vars in 1224 bytes} [Wed Aug 31 15:56:34 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 243 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 31 15:56:35.320132 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f708975c-d239-40e7-8b23-96442e4e29ec tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:35.332903 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-048c22fc-5805-47f8-a28f-c35319590288 tempest-InstanceUsageAuditLogNegativeTestJSON-1125008 tempest-InstanceUsageAuditLogNegativeTestJSON-1125008-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:35.335844 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-048c22fc-5805-47f8-a28f-c35319590288 tempest-InstanceUsageAuditLogNegativeTestJSON-1125008 tempest-InstanceUsageAuditLogNegativeTestJSON-1125008-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '8f34626f41754dfd98cb44833d994167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbe600d7d434947ace1e2b80b79963d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:35.336548 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f708975c-d239-40e7-8b23-96442e4e29ec tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:35.340282 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-048c22fc-5805-47f8-a28f-c35319590288 tempest-InstanceUsageAuditLogNegativeTestJSON-1125008 tempest-InstanceUsageAuditLogNegativeTestJSON-1125008-project] Request method failure captured: Aug 31 15:56:35.340282 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Aug 31 15:56:35.340282 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 15:56:35.340282 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 15:56:35.340282 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 15:56:35.340282 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 15:56:35.340282 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 15:56:35.340282 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 15:56:35.340282 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 15:56:35.340282 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 15:56:35.340282 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4Swv17aPhLL-HSh69hVX0tVKsI6N7DvY8wDE0KRmL2GdNJswmkSS6naHUO3uJQpsGv0zWRY183H5a5U1lq5ZFvfRS7cw3C1Jz7kPVLj66BOkPmCdY0B-TcC4E_am9m9qZoDHtp8-5SB_TFAC2KyxDsq58Ogf_a9nT9eqLPt7StU030 Aug 31 15:56:35.340282 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 15:56:35.340282 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 15:56:35.340282 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 15:56:35.340282 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 15:56:35.340282 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 15:56:35.340282 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 15:56:35.340282 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 5bbe600d7d434947ace1e2b80b79963d Aug 31 15:56:35.340282 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1125008 Aug 31 15:56:35.340282 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 15:56:35.340282 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 15:56:35.342763 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5bbe600d7d434947ace1e2b80b79963d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5bbe600d7d434947ace1e2b80b79963d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5bbe600d7d434947ace1e2b80b79963d", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5bbe600d7d434947ace1e2b80b79963d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 15:56:35.342763 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1125008 Aug 31 15:56:35.342763 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 5bbe600d7d434947ace1e2b80b79963d Aug 31 15:56:35.342763 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1125008 Aug 31 15:56:35.342763 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1125008-project Aug 31 15:56:35.342763 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 15:56:35.342763 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 15:56:35.342763 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 8f34626f41754dfd98cb44833d994167 Aug 31 15:56:35.342763 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1125008-project Aug 31 15:56:35.342763 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 15:56:35.342763 n-d-850499-9 devstack@n-api.service[122257]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 31 15:56:35.343426 n-d-850499-9 devstack@n-api.service[122257]: action_args: {} Aug 31 15:56:35.343426 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:56:35.343426 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:56:35.343426 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:56:35.343426 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:56:35.343426 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:56:35.343426 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:56:35.343426 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:56:35.343426 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:56:35.343426 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Aug 31 15:56:35.343426 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Aug 31 15:56:35.343426 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 31 15:56:35.343426 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 31 15:56:35.343426 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 31 15:56:35.343426 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 31 15:56:35.343426 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 15:56:35.343426 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 31 15:56:35.343426 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 15:56:35.343426 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise self.value Aug 31 15:56:35.343426 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 31 15:56:35.344487 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 31 15:56:35.344487 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 31 15:56:35.344487 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 31 15:56:35.344487 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 31 15:56:35.344487 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 31 15:56:35.344487 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 31 15:56:35.344487 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:56:35.344487 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:56:35.344487 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:56:35.344487 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:56:35.344487 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:56:35.344487 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:56:35.344487 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 31 15:56:35.344487 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 31 15:56:35.344487 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 31 15:56:35.344487 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:56:35.345336 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f708975c-d239-40e7-8b23-96442e4e29ec tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:35.347297 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-048c22fc-5805-47f8-a28f-c35319590288 tempest-InstanceUsageAuditLogNegativeTestJSON-1125008 tempest-InstanceUsageAuditLogNegativeTestJSON-1125008-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:56:35.348719 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-048c22fc-5805-47f8-a28f-c35319590288 tempest-InstanceUsageAuditLogNegativeTestJSON-1125008 tempest-InstanceUsageAuditLogNegativeTestJSON-1125008-project] 10.222.0.61 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.209556 Aug 31 15:56:35.349935 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 89/184] 10.222.0.61 () {58 vars in 1185 bytes} [Wed Aug 31 15:56:35 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 211 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 31 15:56:35.359553 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-01a585f9-14af-4766-955a-1f152fdc252b tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:35.360855 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f708975c-d239-40e7-8b23-96442e4e29ec tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] 10.222.0.61 "GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174" status: 200 len: 1447 microversion: 2.75 time: 0.450859 Aug 31 15:56:35.361300 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-01a585f9-14af-4766-955a-1f152fdc252b tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] [instance: 3a0126e3-2324-4892-8908-2b6d2d5e2158] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:35.368383 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-01a585f9-14af-4766-955a-1f152fdc252b tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:35.369299 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-01a585f9-14af-4766-955a-1f152fdc252b tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:35.370079 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-01a585f9-14af-4766-955a-1f152fdc252b tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:35.371029 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-01a585f9-14af-4766-955a-1f152fdc252b tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:35.371710 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-01a585f9-14af-4766-955a-1f152fdc252b tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:35.372426 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-01a585f9-14af-4766-955a-1f152fdc252b tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:35.379272 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 96/185] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:56:34 2022] GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174 => generated 1447 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:56:35.385343 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0b9d4d1e-327f-4175-9f81-859b55ad2f1b tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:35.386426 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0b9d4d1e-327f-4175-9f81-859b55ad2f1b tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] [instance: 1b233a49-d4f5-412d-8239-74df4ce63aa5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:35.393352 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0b9d4d1e-327f-4175-9f81-859b55ad2f1b tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:35.394062 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0b9d4d1e-327f-4175-9f81-859b55ad2f1b tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:35.394680 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0b9d4d1e-327f-4175-9f81-859b55ad2f1b tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:35.396015 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0b9d4d1e-327f-4175-9f81-859b55ad2f1b tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:35.399678 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0b9d4d1e-327f-4175-9f81-859b55ad2f1b tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:35.400354 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0b9d4d1e-327f-4175-9f81-859b55ad2f1b tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:35.413404 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=100 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:56:35.869816 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-01a585f9-14af-4766-955a-1f152fdc252b tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377b1dedae45d2a804919e5ea69a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e5507d53224d19804717493d60bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:35.874932 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-0b9d4d1e-327f-4175-9f81-859b55ad2f1b tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc04be9f46432fb954d7dbcfe53488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f665e5697c4453c872940b4c0a88772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:35.882487 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-01a585f9-14af-4766-955a-1f152fdc252b tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] 10.222.0.61 "GET /compute/v2.1/servers/3a0126e3-2324-4892-8908-2b6d2d5e2158" status: 200 len: 1389 microversion: 2.1 time: 0.530740 Aug 31 15:56:35.882782 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0b9d4d1e-327f-4175-9f81-859b55ad2f1b tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] 10.222.0.61 "GET /compute/v2.1/servers/1b233a49-d4f5-412d-8239-74df4ce63aa5" status: 200 len: 1337 microversion: 2.1 time: 0.501880 Aug 31 15:56:35.883638 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 97/186] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:35 2022] GET /compute/v2.1/servers/1b233a49-d4f5-412d-8239-74df4ce63aa5 => generated 1337 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:35.889903 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a6523468-9dc8-47c1-a44f-cd5c6a4147be tempest-InstanceUsageAuditLogNegativeTestJSON-1125008 tempest-InstanceUsageAuditLogNegativeTestJSON-1125008-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:35.890303 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 90/187] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:35 2022] GET /compute/v2.1/servers/3a0126e3-2324-4892-8908-2b6d2d5e2158 => generated 1389 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:35.892765 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a6523468-9dc8-47c1-a44f-cd5c6a4147be tempest-InstanceUsageAuditLogNegativeTestJSON-1125008 tempest-InstanceUsageAuditLogNegativeTestJSON-1125008-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '8f34626f41754dfd98cb44833d994167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbe600d7d434947ace1e2b80b79963d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:35.894893 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a6523468-9dc8-47c1-a44f-cd5c6a4147be tempest-InstanceUsageAuditLogNegativeTestJSON-1125008 tempest-InstanceUsageAuditLogNegativeTestJSON-1125008-project] Request method failure captured: Aug 31 15:56:35.894893 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-08-31%2015:56:35 HTTP/1.1 Aug 31 15:56:35.894893 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 15:56:35.894893 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 15:56:35.894893 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 15:56:35.894893 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 15:56:35.894893 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 15:56:35.894893 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 15:56:35.894893 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 15:56:35.894893 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 15:56:35.894893 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4Swv17aPhLL-HSh69hVX0tVKsI6N7DvY8wDE0KRmL2GdNJswmkSS6naHUO3uJQpsGv0zWRY183H5a5U1lq5ZFvfRS7cw3C1Jz7kPVLj66BOkPmCdY0B-TcC4E_am9m9qZoDHtp8-5SB_TFAC2KyxDsq58Ogf_a9nT9eqLPt7StU030 Aug 31 15:56:35.894893 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 15:56:35.894893 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 15:56:35.894893 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 15:56:35.894893 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 15:56:35.894893 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 15:56:35.894893 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 15:56:35.894893 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 5bbe600d7d434947ace1e2b80b79963d Aug 31 15:56:35.894893 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1125008 Aug 31 15:56:35.894893 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 15:56:35.894893 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 15:56:35.896486 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5bbe600d7d434947ace1e2b80b79963d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5bbe600d7d434947ace1e2b80b79963d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5bbe600d7d434947ace1e2b80b79963d", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5bbe600d7d434947ace1e2b80b79963d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 15:56:35.896486 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1125008 Aug 31 15:56:35.896486 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 5bbe600d7d434947ace1e2b80b79963d Aug 31 15:56:35.896486 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1125008 Aug 31 15:56:35.896486 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1125008-project Aug 31 15:56:35.896486 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 15:56:35.896486 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 15:56:35.896486 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 8f34626f41754dfd98cb44833d994167 Aug 31 15:56:35.896486 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1125008-project Aug 31 15:56:35.896486 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 15:56:35.896486 n-d-850499-9 devstack@n-api.service[122256]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 31 15:56:35.897214 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '2022-08-31 15:56:35'} Aug 31 15:56:35.897214 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:56:35.897214 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:56:35.897214 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:56:35.897214 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:56:35.897214 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:56:35.897214 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:56:35.897214 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:56:35.897214 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:56:35.897214 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Aug 31 15:56:35.897214 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Aug 31 15:56:35.897214 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 31 15:56:35.897214 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 31 15:56:35.897214 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 31 15:56:35.897214 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 31 15:56:35.897214 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 15:56:35.897214 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 31 15:56:35.897214 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 15:56:35.897214 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise self.value Aug 31 15:56:35.897214 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 31 15:56:35.898548 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 31 15:56:35.898548 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 31 15:56:35.898548 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 31 15:56:35.898548 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 31 15:56:35.898548 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 31 15:56:35.898548 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 31 15:56:35.898548 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:56:35.898548 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:56:35.898548 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:56:35.898548 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:56:35.898548 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:56:35.898548 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:56:35.898548 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 31 15:56:35.898548 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 31 15:56:35.898548 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 31 15:56:35.898548 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:56:35.900142 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a6523468-9dc8-47c1-a44f-cd5c6a4147be tempest-InstanceUsageAuditLogNegativeTestJSON-1125008 tempest-InstanceUsageAuditLogNegativeTestJSON-1125008-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:56:35.900771 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a6523468-9dc8-47c1-a44f-cd5c6a4147be tempest-InstanceUsageAuditLogNegativeTestJSON-1125008 tempest-InstanceUsageAuditLogNegativeTestJSON-1125008-project] 10.222.0.61 "GET /compute/v2.1/os-instance_usage_audit_log/2022-08-31 15:56:35" status: 403 len: 128 microversion: 2.1 time: 0.016009 Aug 31 15:56:35.901494 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 98/188] 10.222.0.61 () {58 vars in 1251 bytes} [Wed Aug 31 15:56:35 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-08-31%2015%3A56%3A35 => generated 128 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:56:35.918719 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-cb7f41da-e04f-4d8b-accf-7e46cd4d7274 req-426eaceb-a23f-48b2-b41a-5405dcd5288b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b233a49-d4f5-412d-8239-74df4ce63aa5", "tag": "f56ba330-3206-4322-9474-e01afa8afef9"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:56:35.934298 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-34711f78-4afc-4544-bf96-387821379e83 req-045c0eb4-816d-46c9-a59a-1145de790c8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a0126e3-2324-4892-8908-2b6d2d5e2158", "name": "network-vif-plugged", "status": "completed", "tag": "6968d1bb-5c27-4bac-b8bf-3218d05fdca9"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:56:35.944888 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-cb7f41da-e04f-4d8b-accf-7e46cd4d7274 req-426eaceb-a23f-48b2-b41a-5405dcd5288b service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:35.945911 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-cb7f41da-e04f-4d8b-accf-7e46cd4d7274 req-426eaceb-a23f-48b2-b41a-5405dcd5288b service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:35.947939 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-cb7f41da-e04f-4d8b-accf-7e46cd4d7274 req-426eaceb-a23f-48b2-b41a-5405dcd5288b service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:35.964715 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-34711f78-4afc-4544-bf96-387821379e83 req-045c0eb4-816d-46c9-a59a-1145de790c8a service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:35.969200 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-34711f78-4afc-4544-bf96-387821379e83 req-045c0eb4-816d-46c9-a59a-1145de790c8a service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:35.972863 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-34711f78-4afc-4544-bf96-387821379e83 req-045c0eb4-816d-46c9-a59a-1145de790c8a service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:35.975999 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-cb7f41da-e04f-4d8b-accf-7e46cd4d7274 req-426eaceb-a23f-48b2-b41a-5405dcd5288b service nova] Creating event network-changed:f56ba330-3206-4322-9474-e01afa8afef9 for instance 1b233a49-d4f5-412d-8239-74df4ce63aa5 on n-h1-850499-9 Aug 31 15:56:35.987280 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-cb7f41da-e04f-4d8b-accf-7e46cd4d7274 req-426eaceb-a23f-48b2-b41a-5405dcd5288b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091436 Aug 31 15:56:35.989073 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 91/189] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 15:56:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:56:35.995966 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-34711f78-4afc-4544-bf96-387821379e83 req-045c0eb4-816d-46c9-a59a-1145de790c8a service nova] Creating event network-vif-plugged:6968d1bb-5c27-4bac-b8bf-3218d05fdca9 for instance 3a0126e3-2324-4892-8908-2b6d2d5e2158 on n-h2-850499-9 Aug 31 15:56:36.002002 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-57d5ea12-9647-4b12-a70a-c29520821ece tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:36.002923 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-57d5ea12-9647-4b12-a70a-c29520821ece tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] [instance: 94898cf4-0065-4b87-acb5-e8d11bd1529a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:36.008860 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-34711f78-4afc-4544-bf96-387821379e83 req-045c0eb4-816d-46c9-a59a-1145de790c8a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103180 Aug 31 15:56:36.010913 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 99/190] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 15:56:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:56:36.019243 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-57d5ea12-9647-4b12-a70a-c29520821ece tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:36.019788 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-57d5ea12-9647-4b12-a70a-c29520821ece tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:36.020285 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-57d5ea12-9647-4b12-a70a-c29520821ece tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:36.021078 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-57d5ea12-9647-4b12-a70a-c29520821ece tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:36.021705 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-57d5ea12-9647-4b12-a70a-c29520821ece tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:36.022196 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-57d5ea12-9647-4b12-a70a-c29520821ece tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:36.387412 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6ef2d5f9-dc47-4e67-a2da-f90f47df8c4a tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:36.388702 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6ef2d5f9-dc47-4e67-a2da-f90f47df8c4a tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] [instance: f2162319-5635-4c77-920d-9ecb3221d174] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:36.397400 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6ef2d5f9-dc47-4e67-a2da-f90f47df8c4a tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:36.403138 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6ef2d5f9-dc47-4e67-a2da-f90f47df8c4a tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:36.404568 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6ef2d5f9-dc47-4e67-a2da-f90f47df8c4a tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:36.405798 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6ef2d5f9-dc47-4e67-a2da-f90f47df8c4a tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:36.406488 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6ef2d5f9-dc47-4e67-a2da-f90f47df8c4a tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:36.407325 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6ef2d5f9-dc47-4e67-a2da-f90f47df8c4a tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:36.795384 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-6ef2d5f9-dc47-4e67-a2da-f90f47df8c4a tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:36.804191 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-6ef2d5f9-dc47-4e67-a2da-f90f47df8c4a tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:36.805661 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-6ef2d5f9-dc47-4e67-a2da-f90f47df8c4a tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:36.821382 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6ef2d5f9-dc47-4e67-a2da-f90f47df8c4a tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] 10.222.0.61 "GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174" status: 200 len: 1447 microversion: 2.75 time: 0.438919 Aug 31 15:56:36.822342 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 100/191] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:56:36 2022] GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174 => generated 1447 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:56:36.843587 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-57d5ea12-9647-4b12-a70a-c29520821ece tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe750fe96e2444489edce1b2750fa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8904771b5154454896715024aa20bbcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:36.853643 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-57d5ea12-9647-4b12-a70a-c29520821ece tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] 10.222.0.61 "GET /compute/v2.1/servers/94898cf4-0065-4b87-acb5-e8d11bd1529a" status: 200 len: 1338 microversion: 2.1 time: 0.862639 Aug 31 15:56:36.861062 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 92/192] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:35 2022] GET /compute/v2.1/servers/94898cf4-0065-4b87-acb5-e8d11bd1529a => generated 1338 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:36.907692 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-405ead5e-c3b4-4928-b958-1a75b80d2149 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:36.909087 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-405ead5e-c3b4-4928-b958-1a75b80d2149 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] [instance: 3a0126e3-2324-4892-8908-2b6d2d5e2158] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:36.913839 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-03741302-a5c2-4e66-b9ec-7b325cf3d5ba tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:36.914442 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-03741302-a5c2-4e66-b9ec-7b325cf3d5ba tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] [instance: 1b233a49-d4f5-412d-8239-74df4ce63aa5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:36.923491 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-405ead5e-c3b4-4928-b958-1a75b80d2149 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:36.924267 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-405ead5e-c3b4-4928-b958-1a75b80d2149 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:36.925243 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-405ead5e-c3b4-4928-b958-1a75b80d2149 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:36.926219 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-405ead5e-c3b4-4928-b958-1a75b80d2149 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:36.926331 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-03741302-a5c2-4e66-b9ec-7b325cf3d5ba tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:36.926750 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-03741302-a5c2-4e66-b9ec-7b325cf3d5ba tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:36.927217 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-405ead5e-c3b4-4928-b958-1a75b80d2149 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:36.927969 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-405ead5e-c3b4-4928-b958-1a75b80d2149 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:36.947150 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-03741302-a5c2-4e66-b9ec-7b325cf3d5ba tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:36.950126 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-03741302-a5c2-4e66-b9ec-7b325cf3d5ba tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:36.950758 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-03741302-a5c2-4e66-b9ec-7b325cf3d5ba tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:36.951211 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-03741302-a5c2-4e66-b9ec-7b325cf3d5ba tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:37.666593 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-03741302-a5c2-4e66-b9ec-7b325cf3d5ba tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc04be9f46432fb954d7dbcfe53488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f665e5697c4453c872940b4c0a88772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:37.676000 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-03741302-a5c2-4e66-b9ec-7b325cf3d5ba tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] 10.222.0.61 "GET /compute/v2.1/servers/1b233a49-d4f5-412d-8239-74df4ce63aa5" status: 200 len: 1337 microversion: 2.1 time: 0.773104 Aug 31 15:56:37.685311 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 101/193] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:36 2022] GET /compute/v2.1/servers/1b233a49-d4f5-412d-8239-74df4ce63aa5 => generated 1337 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:37.718251 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-405ead5e-c3b4-4928-b958-1a75b80d2149 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377b1dedae45d2a804919e5ea69a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e5507d53224d19804717493d60bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:37.727268 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-405ead5e-c3b4-4928-b958-1a75b80d2149 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] 10.222.0.61 "GET /compute/v2.1/servers/3a0126e3-2324-4892-8908-2b6d2d5e2158" status: 200 len: 1389 microversion: 2.1 time: 0.823879 Aug 31 15:56:37.734927 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 93/194] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:36 2022] GET /compute/v2.1/servers/3a0126e3-2324-4892-8908-2b6d2d5e2158 => generated 1389 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:56:37.848036 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-056b12c5-e729-482e-ac47-f77cfe5350eb tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:37.848656 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-056b12c5-e729-482e-ac47-f77cfe5350eb tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] [instance: f2162319-5635-4c77-920d-9ecb3221d174] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:37.860617 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-056b12c5-e729-482e-ac47-f77cfe5350eb tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:37.861657 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-056b12c5-e729-482e-ac47-f77cfe5350eb tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:37.862254 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-056b12c5-e729-482e-ac47-f77cfe5350eb tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:37.863143 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-056b12c5-e729-482e-ac47-f77cfe5350eb tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:37.863929 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-056b12c5-e729-482e-ac47-f77cfe5350eb tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:37.864495 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-056b12c5-e729-482e-ac47-f77cfe5350eb tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:37.883244 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-993910ab-cd1e-4cc0-bab4-00aaff949b20 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:37.884607 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-993910ab-cd1e-4cc0-bab4-00aaff949b20 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] [instance: 94898cf4-0065-4b87-acb5-e8d11bd1529a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:37.909223 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-993910ab-cd1e-4cc0-bab4-00aaff949b20 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:37.910404 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-993910ab-cd1e-4cc0-bab4-00aaff949b20 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:37.911984 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-993910ab-cd1e-4cc0-bab4-00aaff949b20 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:37.913052 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-993910ab-cd1e-4cc0-bab4-00aaff949b20 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:37.936249 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-993910ab-cd1e-4cc0-bab4-00aaff949b20 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:37.936721 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-993910ab-cd1e-4cc0-bab4-00aaff949b20 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:38.036460 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-056b12c5-e729-482e-ac47-f77cfe5350eb tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:38.053744 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-056b12c5-e729-482e-ac47-f77cfe5350eb tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:38.055406 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-056b12c5-e729-482e-ac47-f77cfe5350eb tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:38.072401 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-056b12c5-e729-482e-ac47-f77cfe5350eb tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] 10.222.0.61 "GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174" status: 200 len: 1447 microversion: 2.75 time: 0.228122 Aug 31 15:56:38.073978 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 102/195] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:56:37 2022] GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174 => generated 1447 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:56:38.677463 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-993910ab-cd1e-4cc0-bab4-00aaff949b20 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe750fe96e2444489edce1b2750fa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8904771b5154454896715024aa20bbcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:38.689532 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-993910ab-cd1e-4cc0-bab4-00aaff949b20 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] 10.222.0.61 "GET /compute/v2.1/servers/94898cf4-0065-4b87-acb5-e8d11bd1529a" status: 200 len: 1488 microversion: 2.1 time: 0.811753 Aug 31 15:56:38.692092 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 94/196] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:37 2022] GET /compute/v2.1/servers/94898cf4-0065-4b87-acb5-e8d11bd1529a => generated 1488 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:38.717041 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-41fc30d1-5f16-42c1-8e65-5fe02a7255e7 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:38.718489 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-41fc30d1-5f16-42c1-8e65-5fe02a7255e7 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] [instance: 1b233a49-d4f5-412d-8239-74df4ce63aa5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:38.719862 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-054ba93b-f1b0-4c2d-8520-3ecea01f1bcb tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:38.720487 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-054ba93b-f1b0-4c2d-8520-3ecea01f1bcb tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] [instance: 94898cf4-0065-4b87-acb5-e8d11bd1529a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:38.721515 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:56:38.727749 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-054ba93b-f1b0-4c2d-8520-3ecea01f1bcb tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:38.728797 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-054ba93b-f1b0-4c2d-8520-3ecea01f1bcb tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:38.729556 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-054ba93b-f1b0-4c2d-8520-3ecea01f1bcb tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:38.730483 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-054ba93b-f1b0-4c2d-8520-3ecea01f1bcb tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:38.731146 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-054ba93b-f1b0-4c2d-8520-3ecea01f1bcb tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:38.731774 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-054ba93b-f1b0-4c2d-8520-3ecea01f1bcb tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:38.733387 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-41fc30d1-5f16-42c1-8e65-5fe02a7255e7 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:38.733975 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-41fc30d1-5f16-42c1-8e65-5fe02a7255e7 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:38.734433 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-41fc30d1-5f16-42c1-8e65-5fe02a7255e7 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:38.735336 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-41fc30d1-5f16-42c1-8e65-5fe02a7255e7 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:38.735847 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-41fc30d1-5f16-42c1-8e65-5fe02a7255e7 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:38.736282 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-41fc30d1-5f16-42c1-8e65-5fe02a7255e7 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:39.365871 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-41fc30d1-5f16-42c1-8e65-5fe02a7255e7 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc04be9f46432fb954d7dbcfe53488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f665e5697c4453c872940b4c0a88772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:39.374923 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=8 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:56:39.394095 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-41fc30d1-5f16-42c1-8e65-5fe02a7255e7 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] 10.222.0.61 "GET /compute/v2.1/servers/1b233a49-d4f5-412d-8239-74df4ce63aa5" status: 200 len: 1337 microversion: 2.1 time: 0.684034 Aug 31 15:56:39.395121 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 103/197] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:38 2022] GET /compute/v2.1/servers/1b233a49-d4f5-412d-8239-74df4ce63aa5 => generated 1337 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:39.402062 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-10c8b8f3-ffa9-4053-bd4c-a987872213e3 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:39.403122 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-10c8b8f3-ffa9-4053-bd4c-a987872213e3 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] [instance: 3a0126e3-2324-4892-8908-2b6d2d5e2158] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:39.408732 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:DELETE=1,nova_api:SELECT=96,nova_api:INSERT=3 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:56:39.413726 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-10c8b8f3-ffa9-4053-bd4c-a987872213e3 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:39.414311 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-10c8b8f3-ffa9-4053-bd4c-a987872213e3 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:39.414809 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-10c8b8f3-ffa9-4053-bd4c-a987872213e3 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:39.415901 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-10c8b8f3-ffa9-4053-bd4c-a987872213e3 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:39.416576 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-10c8b8f3-ffa9-4053-bd4c-a987872213e3 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:39.417096 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-10c8b8f3-ffa9-4053-bd4c-a987872213e3 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:39.613795 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-054ba93b-f1b0-4c2d-8520-3ecea01f1bcb tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/94898cf4-0065-4b87-acb5-e8d11bd1529a" status: 200 len: 1639 microversion: 2.1 time: 0.899426 Aug 31 15:56:39.615010 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 95/198] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:38 2022] GET /compute/v2.1/servers/94898cf4-0065-4b87-acb5-e8d11bd1529a => generated 1639 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:56:39.624155 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6faa05c7-7436-466f-a68c-287e2ce3cecc tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:39.625251 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6faa05c7-7436-466f-a68c-287e2ce3cecc tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] [instance: f2162319-5635-4c77-920d-9ecb3221d174] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:39.636312 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6faa05c7-7436-466f-a68c-287e2ce3cecc tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:39.641353 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6faa05c7-7436-466f-a68c-287e2ce3cecc tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:39.642023 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6faa05c7-7436-466f-a68c-287e2ce3cecc tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:39.644672 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6faa05c7-7436-466f-a68c-287e2ce3cecc tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:39.645686 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6faa05c7-7436-466f-a68c-287e2ce3cecc tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:39.646491 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6faa05c7-7436-466f-a68c-287e2ce3cecc tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:39.769923 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-10c8b8f3-ffa9-4053-bd4c-a987872213e3 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377b1dedae45d2a804919e5ea69a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e5507d53224d19804717493d60bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:39.770816 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-6faa05c7-7436-466f-a68c-287e2ce3cecc tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:39.786490 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-10c8b8f3-ffa9-4053-bd4c-a987872213e3 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] 10.222.0.61 "GET /compute/v2.1/servers/3a0126e3-2324-4892-8908-2b6d2d5e2158" status: 200 len: 1589 microversion: 2.1 time: 0.383452 Aug 31 15:56:39.787988 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 104/199] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:39 2022] GET /compute/v2.1/servers/3a0126e3-2324-4892-8908-2b6d2d5e2158 => generated 1589 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:39.796677 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6a3776d1-8b71-49de-bd55-ea2f947b0dd2 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:39.797881 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6a3776d1-8b71-49de-bd55-ea2f947b0dd2 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] [instance: 94898cf4-0065-4b87-acb5-e8d11bd1529a] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:39.808169 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-6faa05c7-7436-466f-a68c-287e2ce3cecc tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:39.811933 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-6faa05c7-7436-466f-a68c-287e2ce3cecc tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:39.813312 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6a3776d1-8b71-49de-bd55-ea2f947b0dd2 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:39.819245 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6a3776d1-8b71-49de-bd55-ea2f947b0dd2 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:39.820020 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6a3776d1-8b71-49de-bd55-ea2f947b0dd2 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:39.821150 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6a3776d1-8b71-49de-bd55-ea2f947b0dd2 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:39.821852 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6a3776d1-8b71-49de-bd55-ea2f947b0dd2 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:39.822542 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6a3776d1-8b71-49de-bd55-ea2f947b0dd2 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:39.823324 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6faa05c7-7436-466f-a68c-287e2ce3cecc tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] 10.222.0.61 "GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174" status: 200 len: 1447 microversion: 2.75 time: 0.206905 Aug 31 15:56:39.824659 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 96/200] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:56:39 2022] GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174 => generated 1447 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:56:39.832480 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5332e9a7-7b54-49ac-a770-bd89935aa4c2 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:39.833361 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5332e9a7-7b54-49ac-a770-bd89935aa4c2 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] [instance: 3a0126e3-2324-4892-8908-2b6d2d5e2158] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:39.843135 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5332e9a7-7b54-49ac-a770-bd89935aa4c2 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:39.844290 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5332e9a7-7b54-49ac-a770-bd89935aa4c2 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:39.845014 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5332e9a7-7b54-49ac-a770-bd89935aa4c2 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:39.846390 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5332e9a7-7b54-49ac-a770-bd89935aa4c2 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:39.847715 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5332e9a7-7b54-49ac-a770-bd89935aa4c2 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:39.848848 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5332e9a7-7b54-49ac-a770-bd89935aa4c2 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:39.892728 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6a3776d1-8b71-49de-bd55-ea2f947b0dd2 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] [instance: 94898cf4-0065-4b87-acb5-e8d11bd1529a] Going to try to terminate instance {{(pid=122256) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 15:56:40.127378 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6a3776d1-8b71-49de-bd55-ea2f947b0dd2 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] 10.222.0.61 "DELETE /compute/v2.1/servers/94898cf4-0065-4b87-acb5-e8d11bd1529a" status: 204 len: 0 microversion: 2.1 time: 0.337620 Aug 31 15:56:40.128452 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 105/201] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 15:56:39 2022] DELETE /compute/v2.1/servers/94898cf4-0065-4b87-acb5-e8d11bd1529a => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 15:56:40.145265 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-51f2bcfb-8238-4f6d-8ffe-f418dfac5e54 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:40.146584 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-51f2bcfb-8238-4f6d-8ffe-f418dfac5e54 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] [instance: 94898cf4-0065-4b87-acb5-e8d11bd1529a] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:40.162246 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-51f2bcfb-8238-4f6d-8ffe-f418dfac5e54 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:40.164746 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-51f2bcfb-8238-4f6d-8ffe-f418dfac5e54 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:40.165543 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-51f2bcfb-8238-4f6d-8ffe-f418dfac5e54 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:40.166942 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-51f2bcfb-8238-4f6d-8ffe-f418dfac5e54 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:40.167783 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-51f2bcfb-8238-4f6d-8ffe-f418dfac5e54 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:40.168264 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-51f2bcfb-8238-4f6d-8ffe-f418dfac5e54 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:40.222923 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5332e9a7-7b54-49ac-a770-bd89935aa4c2 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] 10.222.0.61 "GET /compute/v2.1/servers/3a0126e3-2324-4892-8908-2b6d2d5e2158/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.396709 Aug 31 15:56:40.223679 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 97/202] 10.222.0.61 () {58 vars in 1275 bytes} [Wed Aug 31 15:56:39 2022] GET /compute/v2.1/servers/3a0126e3-2324-4892-8908-2b6d2d5e2158/os-interface => generated 285 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:56:40.416311 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-423da746-dfeb-4726-82a0-56c2e8ca700b tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:40.417249 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-423da746-dfeb-4726-82a0-56c2e8ca700b tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] [instance: 1b233a49-d4f5-412d-8239-74df4ce63aa5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:40.430245 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-423da746-dfeb-4726-82a0-56c2e8ca700b tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:40.435864 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-423da746-dfeb-4726-82a0-56c2e8ca700b tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:40.436793 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-423da746-dfeb-4726-82a0-56c2e8ca700b tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:40.437820 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-423da746-dfeb-4726-82a0-56c2e8ca700b tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:40.438569 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-423da746-dfeb-4726-82a0-56c2e8ca700b tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:40.439256 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-423da746-dfeb-4726-82a0-56c2e8ca700b tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:40.681533 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-51f2bcfb-8238-4f6d-8ffe-f418dfac5e54 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe750fe96e2444489edce1b2750fa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8904771b5154454896715024aa20bbcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:40.701704 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-51f2bcfb-8238-4f6d-8ffe-f418dfac5e54 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] 10.222.0.61 "GET /compute/v2.1/servers/94898cf4-0065-4b87-acb5-e8d11bd1529a" status: 200 len: 1494 microversion: 2.1 time: 0.567709 Aug 31 15:56:40.707242 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 106/203] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:40 2022] GET /compute/v2.1/servers/94898cf4-0065-4b87-acb5-e8d11bd1529a => generated 1494 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:40.853903 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-301c4e6d-3248-49f3-9709-ab19738e18a6 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:40.854982 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-301c4e6d-3248-49f3-9709-ab19738e18a6 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] [instance: f2162319-5635-4c77-920d-9ecb3221d174] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:40.865285 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-301c4e6d-3248-49f3-9709-ab19738e18a6 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:40.869547 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-301c4e6d-3248-49f3-9709-ab19738e18a6 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:40.870214 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-301c4e6d-3248-49f3-9709-ab19738e18a6 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:40.871190 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-301c4e6d-3248-49f3-9709-ab19738e18a6 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:40.871882 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-301c4e6d-3248-49f3-9709-ab19738e18a6 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:40.872577 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-301c4e6d-3248-49f3-9709-ab19738e18a6 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:40.983229 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-423da746-dfeb-4726-82a0-56c2e8ca700b tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc04be9f46432fb954d7dbcfe53488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f665e5697c4453c872940b4c0a88772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:40.995865 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-423da746-dfeb-4726-82a0-56c2e8ca700b tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] 10.222.0.61 "GET /compute/v2.1/servers/1b233a49-d4f5-412d-8239-74df4ce63aa5" status: 200 len: 1337 microversion: 2.1 time: 0.583425 Aug 31 15:56:40.999527 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 98/204] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:40 2022] GET /compute/v2.1/servers/1b233a49-d4f5-412d-8239-74df4ce63aa5 => generated 1337 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:56:41.054089 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-301c4e6d-3248-49f3-9709-ab19738e18a6 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:41.098444 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-301c4e6d-3248-49f3-9709-ab19738e18a6 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:41.105616 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-301c4e6d-3248-49f3-9709-ab19738e18a6 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:41.144690 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-301c4e6d-3248-49f3-9709-ab19738e18a6 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] 10.222.0.61 "GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174" status: 200 len: 1447 microversion: 2.75 time: 0.294506 Aug 31 15:56:41.150281 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 107/205] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:56:40 2022] GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174 => generated 1447 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:56:41.734736 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e5e55df9-82cf-426d-abc9-ab2cba506f6f tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:41.735599 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e5e55df9-82cf-426d-abc9-ab2cba506f6f tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] [instance: 94898cf4-0065-4b87-acb5-e8d11bd1529a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:41.754494 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e5e55df9-82cf-426d-abc9-ab2cba506f6f tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:41.755382 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e5e55df9-82cf-426d-abc9-ab2cba506f6f tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:41.756113 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e5e55df9-82cf-426d-abc9-ab2cba506f6f tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:41.757611 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e5e55df9-82cf-426d-abc9-ab2cba506f6f tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:41.758439 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e5e55df9-82cf-426d-abc9-ab2cba506f6f tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:41.758982 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e5e55df9-82cf-426d-abc9-ab2cba506f6f tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:42.043282 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0b34cc3a-fad9-45f4-9d0b-526468ef4790 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:42.044058 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0b34cc3a-fad9-45f4-9d0b-526468ef4790 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] [instance: 1b233a49-d4f5-412d-8239-74df4ce63aa5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:42.076397 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0b34cc3a-fad9-45f4-9d0b-526468ef4790 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:42.078697 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0b34cc3a-fad9-45f4-9d0b-526468ef4790 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:42.080544 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0b34cc3a-fad9-45f4-9d0b-526468ef4790 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:42.083933 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0b34cc3a-fad9-45f4-9d0b-526468ef4790 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:42.085965 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0b34cc3a-fad9-45f4-9d0b-526468ef4790 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:42.086639 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0b34cc3a-fad9-45f4-9d0b-526468ef4790 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:42.443840 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e5e55df9-82cf-426d-abc9-ab2cba506f6f tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe750fe96e2444489edce1b2750fa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8904771b5154454896715024aa20bbcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:42.461613 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e5e55df9-82cf-426d-abc9-ab2cba506f6f tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] 10.222.0.61 "GET /compute/v2.1/servers/94898cf4-0065-4b87-acb5-e8d11bd1529a" status: 200 len: 1494 microversion: 2.1 time: 0.731954 Aug 31 15:56:42.466558 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 99/206] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:41 2022] GET /compute/v2.1/servers/94898cf4-0065-4b87-acb5-e8d11bd1529a => generated 1494 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:42.476438 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3f58ae46-d206-435f-afc5-111aaacbc522 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:42.481594 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3f58ae46-d206-435f-afc5-111aaacbc522 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] [instance: f2162319-5635-4c77-920d-9ecb3221d174] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:42.493144 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:56:42.495039 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3f58ae46-d206-435f-afc5-111aaacbc522 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:42.498027 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3f58ae46-d206-435f-afc5-111aaacbc522 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:42.500595 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3f58ae46-d206-435f-afc5-111aaacbc522 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:42.501641 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3f58ae46-d206-435f-afc5-111aaacbc522 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:42.502225 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3f58ae46-d206-435f-afc5-111aaacbc522 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:42.506146 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3f58ae46-d206-435f-afc5-111aaacbc522 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:42.565496 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-0b34cc3a-fad9-45f4-9d0b-526468ef4790 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc04be9f46432fb954d7dbcfe53488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f665e5697c4453c872940b4c0a88772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:42.579820 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0b34cc3a-fad9-45f4-9d0b-526468ef4790 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] 10.222.0.61 "GET /compute/v2.1/servers/1b233a49-d4f5-412d-8239-74df4ce63aa5" status: 200 len: 1337 microversion: 2.1 time: 0.540612 Aug 31 15:56:42.583484 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 108/207] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:42 2022] GET /compute/v2.1/servers/1b233a49-d4f5-412d-8239-74df4ce63aa5 => generated 1337 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:56:42.756464 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3f58ae46-d206-435f-afc5-111aaacbc522 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:42.766376 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3f58ae46-d206-435f-afc5-111aaacbc522 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:42.767904 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3f58ae46-d206-435f-afc5-111aaacbc522 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:42.779061 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3f58ae46-d206-435f-afc5-111aaacbc522 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] 10.222.0.61 "GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174" status: 200 len: 1447 microversion: 2.75 time: 0.309273 Aug 31 15:56:42.788801 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 100/208] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:56:42 2022] GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174 => generated 1447 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:56:43.486801 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-06162489-8b2f-44ca-89d1-b286c82f2710 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:43.487424 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-06162489-8b2f-44ca-89d1-b286c82f2710 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] [instance: 94898cf4-0065-4b87-acb5-e8d11bd1529a] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:43.505344 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-06162489-8b2f-44ca-89d1-b286c82f2710 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:43.505868 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-06162489-8b2f-44ca-89d1-b286c82f2710 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:43.506293 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-06162489-8b2f-44ca-89d1-b286c82f2710 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:43.507019 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-06162489-8b2f-44ca-89d1-b286c82f2710 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:43.507473 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-06162489-8b2f-44ca-89d1-b286c82f2710 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:43.507924 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-06162489-8b2f-44ca-89d1-b286c82f2710 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:43.602468 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-75c16c06-d2ca-4716-845e-2c2e679de571 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:43.603076 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-75c16c06-d2ca-4716-845e-2c2e679de571 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] [instance: 1b233a49-d4f5-412d-8239-74df4ce63aa5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:43.615452 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-75c16c06-d2ca-4716-845e-2c2e679de571 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:43.616072 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-75c16c06-d2ca-4716-845e-2c2e679de571 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:43.616515 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-75c16c06-d2ca-4716-845e-2c2e679de571 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:43.625793 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-75c16c06-d2ca-4716-845e-2c2e679de571 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:43.626370 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-75c16c06-d2ca-4716-845e-2c2e679de571 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:43.628708 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-75c16c06-d2ca-4716-845e-2c2e679de571 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:44.078891 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-75c16c06-d2ca-4716-845e-2c2e679de571 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc04be9f46432fb954d7dbcfe53488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f665e5697c4453c872940b4c0a88772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:44.092640 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-75c16c06-d2ca-4716-845e-2c2e679de571 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] 10.222.0.61 "GET /compute/v2.1/servers/1b233a49-d4f5-412d-8239-74df4ce63aa5" status: 200 len: 1337 microversion: 2.1 time: 0.492842 Aug 31 15:56:44.093889 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 101/209] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:43 2022] GET /compute/v2.1/servers/1b233a49-d4f5-412d-8239-74df4ce63aa5 => generated 1337 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:44.110718 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f7397052-34f0-40df-8ce9-fc404345ca8d tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:44.118627 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f7397052-34f0-40df-8ce9-fc404345ca8d tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] [instance: f2162319-5635-4c77-920d-9ecb3221d174] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:44.145328 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f7397052-34f0-40df-8ce9-fc404345ca8d tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:44.145924 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f7397052-34f0-40df-8ce9-fc404345ca8d tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:44.146429 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f7397052-34f0-40df-8ce9-fc404345ca8d tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:44.147281 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f7397052-34f0-40df-8ce9-fc404345ca8d tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:44.147890 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f7397052-34f0-40df-8ce9-fc404345ca8d tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:44.148701 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f7397052-34f0-40df-8ce9-fc404345ca8d tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:44.334498 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f7397052-34f0-40df-8ce9-fc404345ca8d tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:44.361472 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-06162489-8b2f-44ca-89d1-b286c82f2710 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe750fe96e2444489edce1b2750fa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8904771b5154454896715024aa20bbcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:44.369639 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f7397052-34f0-40df-8ce9-fc404345ca8d tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:44.384061 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-06162489-8b2f-44ca-89d1-b286c82f2710 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] 10.222.0.61 "GET /compute/v2.1/servers/94898cf4-0065-4b87-acb5-e8d11bd1529a" status: 200 len: 1494 microversion: 2.1 time: 0.901126 Aug 31 15:56:44.387530 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f7397052-34f0-40df-8ce9-fc404345ca8d tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:44.388743 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 109/210] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:43 2022] GET /compute/v2.1/servers/94898cf4-0065-4b87-acb5-e8d11bd1529a => generated 1494 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:44.402486 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f7397052-34f0-40df-8ce9-fc404345ca8d tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] 10.222.0.61 "GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174" status: 200 len: 1447 microversion: 2.75 time: 0.300752 Aug 31 15:56:44.418235 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-d8190f83-6dd3-451e-8512-7390d22522af req-69f0d382-28e0-4060-a7bc-28e47f21b702 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94898cf4-0065-4b87-acb5-e8d11bd1529a", "name": "network-vif-deleted", "tag": "455d9782-e6ff-49f1-b13c-8ca98fbeb37c"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:56:44.424079 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 102/211] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:56:44 2022] GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174 => generated 1447 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:56:44.458657 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-d8190f83-6dd3-451e-8512-7390d22522af req-69f0d382-28e0-4060-a7bc-28e47f21b702 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:44.460487 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-d8190f83-6dd3-451e-8512-7390d22522af req-69f0d382-28e0-4060-a7bc-28e47f21b702 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:44.463799 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-d8190f83-6dd3-451e-8512-7390d22522af req-69f0d382-28e0-4060-a7bc-28e47f21b702 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:44.495333 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-d8190f83-6dd3-451e-8512-7390d22522af req-69f0d382-28e0-4060-a7bc-28e47f21b702 service nova] Creating event network-vif-deleted:455d9782-e6ff-49f1-b13c-8ca98fbeb37c for instance 94898cf4-0065-4b87-acb5-e8d11bd1529a on n-h1-850499-9 Aug 31 15:56:44.504124 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ed9477e3-61dc-45cd-adc6-95e4c1d20fc3 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:44.504787 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ed9477e3-61dc-45cd-adc6-95e4c1d20fc3 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] [instance: 3a0126e3-2324-4892-8908-2b6d2d5e2158] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:44.515633 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ed9477e3-61dc-45cd-adc6-95e4c1d20fc3 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:44.516133 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ed9477e3-61dc-45cd-adc6-95e4c1d20fc3 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:44.516589 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ed9477e3-61dc-45cd-adc6-95e4c1d20fc3 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:44.517299 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ed9477e3-61dc-45cd-adc6-95e4c1d20fc3 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:44.517790 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ed9477e3-61dc-45cd-adc6-95e4c1d20fc3 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:44.518192 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ed9477e3-61dc-45cd-adc6-95e4c1d20fc3 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:44.538822 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-d8190f83-6dd3-451e-8512-7390d22522af req-69f0d382-28e0-4060-a7bc-28e47f21b702 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124898 Aug 31 15:56:44.542339 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 110/212] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 15:56:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:56:45.114997 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e2e6ff3c-398b-436c-984f-379812584231 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:45.115897 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e2e6ff3c-398b-436c-984f-379812584231 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] [instance: 1b233a49-d4f5-412d-8239-74df4ce63aa5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:45.121386 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ed9477e3-61dc-45cd-adc6-95e4c1d20fc3 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377b1dedae45d2a804919e5ea69a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e5507d53224d19804717493d60bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:45.126745 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:56:45.132252 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e2e6ff3c-398b-436c-984f-379812584231 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:45.135969 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e2e6ff3c-398b-436c-984f-379812584231 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:45.136865 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e2e6ff3c-398b-436c-984f-379812584231 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:45.145300 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e2e6ff3c-398b-436c-984f-379812584231 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:45.148530 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ed9477e3-61dc-45cd-adc6-95e4c1d20fc3 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] 10.222.0.61 "GET /compute/v2.1/servers/3a0126e3-2324-4892-8908-2b6d2d5e2158" status: 200 len: 1589 microversion: 2.1 time: 0.646175 Aug 31 15:56:45.148816 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e2e6ff3c-398b-436c-984f-379812584231 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:45.151271 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e2e6ff3c-398b-436c-984f-379812584231 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:45.158272 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 103/213] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:44 2022] GET /compute/v2.1/servers/3a0126e3-2324-4892-8908-2b6d2d5e2158 => generated 1589 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:56:45.410112 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e29ea720-0ee3-4d2d-b905-a536ba1a364e tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:45.411099 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e29ea720-0ee3-4d2d-b905-a536ba1a364e tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] [instance: 94898cf4-0065-4b87-acb5-e8d11bd1529a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:45.445543 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e29ea720-0ee3-4d2d-b905-a536ba1a364e tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:45.446400 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e29ea720-0ee3-4d2d-b905-a536ba1a364e tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:45.458070 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e29ea720-0ee3-4d2d-b905-a536ba1a364e tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:45.459292 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e29ea720-0ee3-4d2d-b905-a536ba1a364e tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:45.461721 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e29ea720-0ee3-4d2d-b905-a536ba1a364e tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:45.465519 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e29ea720-0ee3-4d2d-b905-a536ba1a364e tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:45.489227 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-e29ea720-0ee3-4d2d-b905-a536ba1a364e tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] HTTP exception thrown: Instance 94898cf4-0065-4b87-acb5-e8d11bd1529a could not be found. Aug 31 15:56:45.491835 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e29ea720-0ee3-4d2d-b905-a536ba1a364e tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Request method failure captured: Aug 31 15:56:45.491835 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/94898cf4-0065-4b87-acb5-e8d11bd1529a HTTP/1.1 Aug 31 15:56:45.491835 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 15:56:45.491835 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 15:56:45.491835 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 15:56:45.491835 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 15:56:45.491835 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 15:56:45.491835 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 15:56:45.491835 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 15:56:45.491835 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 15:56:45.491835 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4SBryFy-qbZNypcrpZJQn7P--qsWMdneHJ7fIuhYrBblreBL5Wui0XnbjJ0jpjRy0UQ09bfPdMsC5apan-70Y2Ppe7QKkmYl72T8OjWNWuCeVG73VMKBXnm8nL3aM1Nr3NRtQ1h2nUBl0Oq-3hss79ya65nP47RRV3eHMUEqMJ2USc Aug 31 15:56:45.491835 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 15:56:45.491835 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 15:56:45.491835 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 15:56:45.491835 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 15:56:45.491835 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 15:56:45.491835 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 15:56:45.491835 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 8904771b5154454896715024aa20bbcd Aug 31 15:56:45.491835 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-AggregatesAdminTestJSON-1609274046 Aug 31 15:56:45.491835 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 15:56:45.491835 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 15:56:45.492988 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8904771b5154454896715024aa20bbcd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/8904771b5154454896715024aa20bbcd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_8904771b5154454896715024aa20bbcd", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8904771b5154454896715024aa20bbcd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 15:56:45.492988 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-AggregatesAdminTestJSON-1609274046 Aug 31 15:56:45.492988 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 8904771b5154454896715024aa20bbcd Aug 31 15:56:45.492988 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1609274046 Aug 31 15:56:45.492988 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-AggregatesAdminTestJSON-1609274046-project Aug 31 15:56:45.492988 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 15:56:45.492988 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 15:56:45.492988 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: dbe750fe96e2444489edce1b2750fa1e Aug 31 15:56:45.492988 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-AggregatesAdminTestJSON-1609274046-project Aug 31 15:56:45.492988 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 15:56:45.492988 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance 94898cf4-0065-4b87-acb5-e8d11bd1529a could not be found. Aug 31 15:56:45.492988 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '94898cf4-0065-4b87-acb5-e8d11bd1529a'} Aug 31 15:56:45.493649 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:56:45.493649 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:56:45.493649 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 15:56:45.493649 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 15:56:45.493649 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 15:56:45.493649 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 15:56:45.493649 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 15:56:45.493649 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 15:56:45.493649 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 15:56:45.493649 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 15:56:45.493649 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94898cf4-0065-4b87-acb5-e8d11bd1529a could not be found. Aug 31 15:56:45.493649 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:56:45.493649 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:56:45.493649 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:56:45.493649 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:56:45.493649 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:56:45.493649 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:56:45.493649 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:56:45.493649 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:56:45.493649 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:56:45.494793 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:56:45.494793 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 15:56:45.494793 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 15:56:45.494793 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 15:56:45.494793 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 15:56:45.494793 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 15:56:45.494793 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:56:45.494793 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94898cf4-0065-4b87-acb5-e8d11bd1529a could not be found. Aug 31 15:56:45.494793 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:56:45.494793 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:56:45.494793 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:56:45.494793 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:56:45.494793 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:56:45.494793 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:56:45.494793 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:56:45.494793 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:56:45.494793 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94898cf4-0065-4b87-acb5-e8d11bd1529a could not be found. Aug 31 15:56:45.494793 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:56:45.497602 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e29ea720-0ee3-4d2d-b905-a536ba1a364e tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Returning 404 to user: Instance 94898cf4-0065-4b87-acb5-e8d11bd1529a could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:56:45.499183 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e29ea720-0ee3-4d2d-b905-a536ba1a364e tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] 10.222.0.61 "GET /compute/v2.1/servers/94898cf4-0065-4b87-acb5-e8d11bd1529a" status: 404 len: 111 microversion: 2.1 time: 0.094045 Aug 31 15:56:45.500028 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 104/214] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:45 2022] GET /compute/v2.1/servers/94898cf4-0065-4b87-acb5-e8d11bd1529a => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 15:56:45.505815 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1980e59d-06ec-4b5a-9c7e-0e13edc8c35e tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:45.507029 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1980e59d-06ec-4b5a-9c7e-0e13edc8c35e tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] [instance: f2162319-5635-4c77-920d-9ecb3221d174] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:45.517246 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1980e59d-06ec-4b5a-9c7e-0e13edc8c35e tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:45.518799 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1980e59d-06ec-4b5a-9c7e-0e13edc8c35e tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:45.521549 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1980e59d-06ec-4b5a-9c7e-0e13edc8c35e tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:45.522673 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1980e59d-06ec-4b5a-9c7e-0e13edc8c35e tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:45.525666 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1980e59d-06ec-4b5a-9c7e-0e13edc8c35e tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:45.526722 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1980e59d-06ec-4b5a-9c7e-0e13edc8c35e tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:45.797933 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-1980e59d-06ec-4b5a-9c7e-0e13edc8c35e tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:45.815627 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-1980e59d-06ec-4b5a-9c7e-0e13edc8c35e tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:45.818577 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-1980e59d-06ec-4b5a-9c7e-0e13edc8c35e tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:45.829389 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1980e59d-06ec-4b5a-9c7e-0e13edc8c35e tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] 10.222.0.61 "GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174" status: 200 len: 1447 microversion: 2.75 time: 0.327374 Aug 31 15:56:45.830507 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 105/215] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:56:45 2022] GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174 => generated 1447 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:56:45.840466 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e92c43f3-297f-4b82-8c3f-ecff65ee108e tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-850499-9"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:56:45.877287 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e92c43f3-297f-4b82-8c3f-ecff65ee108e tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:45.878884 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e92c43f3-297f-4b82-8c3f-ecff65ee108e tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:45.882568 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e92c43f3-297f-4b82-8c3f-ecff65ee108e tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:45.993188 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e2e6ff3c-398b-436c-984f-379812584231 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc04be9f46432fb954d7dbcfe53488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f665e5697c4453c872940b4c0a88772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:46.005820 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e2e6ff3c-398b-436c-984f-379812584231 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] 10.222.0.61 "GET /compute/v2.1/servers/1b233a49-d4f5-412d-8239-74df4ce63aa5" status: 200 len: 1337 microversion: 2.1 time: 0.895607 Aug 31 15:56:46.013892 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 111/216] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:45 2022] GET /compute/v2.1/servers/1b233a49-d4f5-412d-8239-74df4ce63aa5 => generated 1337 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:56:46.164818 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e92c43f3-297f-4b82-8c3f-ecff65ee108e tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 298 microversion: 2.1 time: 0.332978 Aug 31 15:56:46.177792 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 106/217] 10.222.0.61 () {60 vars in 1191 bytes} [Wed Aug 31 15:56:45 2022] POST /compute/v2.1/os-aggregates/4/action => generated 298 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:56:46.191457 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d1edecb4-c308-4d3e-affe-b9f16d98b6b9 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:46.234263 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d1edecb4-c308-4d3e-affe-b9f16d98b6b9 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] 10.222.0.61 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.046583 Aug 31 15:56:46.250812 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-70986319-0bdf-4f1a-afff-d02a5cd28017 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1085432179"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:56:46.254841 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.aggregate [None req-70986319-0bdf-4f1a-afff-d02a5cd28017 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] Generated uuid 984d7fd2-d360-4688-ae6f-4a3f6417021a for aggregate {{(pid=122257) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 31 15:56:46.256788 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 112/218] 10.222.0.61 () {58 vars in 1152 bytes} [Wed Aug 31 15:56:46 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 31 15:56:46.286956 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-70986319-0bdf-4f1a-afff-d02a5cd28017 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.040639 Aug 31 15:56:46.295298 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 107/219] 10.222.0.61 () {60 vars in 1164 bytes} [Wed Aug 31 15:56:46 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:56:46.306724 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0f2d68c3-8ab5-486c-9c69-9cad495df5a2 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-850499-9"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:56:46.322180 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0f2d68c3-8ab5-486c-9c69-9cad495df5a2 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:46.323154 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0f2d68c3-8ab5-486c-9c69-9cad495df5a2 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:46.323857 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0f2d68c3-8ab5-486c-9c69-9cad495df5a2 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:46.560236 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0f2d68c3-8ab5-486c-9c69-9cad495df5a2 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 242 microversion: 2.1 time: 0.258005 Aug 31 15:56:46.561270 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 113/220] 10.222.0.61 () {60 vars in 1191 bytes} [Wed Aug 31 15:56:46 2022] POST /compute/v2.1/os-aggregates/9/action => generated 242 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:56:46.586560 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8ba2f7db-42be-4566-a087-1129226dc4b6 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:46.602505 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8ba2f7db-42be-4566-a087-1129226dc4b6 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] 10.222.0.61 "GET /compute/v2.1/os-aggregates/9" status: 200 len: 242 microversion: 2.1 time: 0.031630 Aug 31 15:56:46.605725 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 108/221] 10.222.0.61 () {58 vars in 1149 bytes} [Wed Aug 31 15:56:46 2022] GET /compute/v2.1/os-aggregates/9 => generated 242 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:56:46.615231 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-db27edff-4a9f-4a64-b1fb-8392b5e691fe tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-850499-9"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:56:46.638237 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-db27edff-4a9f-4a64-b1fb-8392b5e691fe tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:46.641420 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-db27edff-4a9f-4a64-b1fb-8392b5e691fe tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:46.642722 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-db27edff-4a9f-4a64-b1fb-8392b5e691fe tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:46.875663 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-db27edff-4a9f-4a64-b1fb-8392b5e691fe tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 227 microversion: 2.1 time: 0.264451 Aug 31 15:56:46.876346 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 114/222] 10.222.0.61 () {60 vars in 1191 bytes} [Wed Aug 31 15:56:46 2022] POST /compute/v2.1/os-aggregates/9/action => generated 227 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 15:56:46.886211 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-06a2fdfe-6634-44b6-8365-a54628dec9ee tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:46.887128 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-06a2fdfe-6634-44b6-8365-a54628dec9ee tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] [instance: f2162319-5635-4c77-920d-9ecb3221d174] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:46.899724 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-06a2fdfe-6634-44b6-8365-a54628dec9ee tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:46.900321 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-06a2fdfe-6634-44b6-8365-a54628dec9ee tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:46.901059 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-06a2fdfe-6634-44b6-8365-a54628dec9ee tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:46.903070 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-06a2fdfe-6634-44b6-8365-a54628dec9ee tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:46.904887 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-06a2fdfe-6634-44b6-8365-a54628dec9ee tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:46.905658 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-06a2fdfe-6634-44b6-8365-a54628dec9ee tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:46.950370 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d6a253a8-0833-43f8-94bf-1338dbe808cc tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-748860459", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "networks": [{"uuid": "c780b733-916d-48a3-99f1-727aee35e4fb"}]}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:56:47.003240 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-06a2fdfe-6634-44b6-8365-a54628dec9ee tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:47.016789 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-06a2fdfe-6634-44b6-8365-a54628dec9ee tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:47.019076 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-06a2fdfe-6634-44b6-8365-a54628dec9ee tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:47.027327 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-06a2fdfe-6634-44b6-8365-a54628dec9ee tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] 10.222.0.61 "GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174" status: 200 len: 1447 microversion: 2.75 time: 0.149654 Aug 31 15:56:47.028465 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 115/223] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:56:46 2022] GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174 => generated 1447 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:56:47.035824 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-8c87e2a8-d4a9-4c69-92bc-e0666a6adf92 req-14aae2a5-ef6a-47f3-bed5-2217af8a0c74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a0126e3-2324-4892-8908-2b6d2d5e2158", "tag": "6968d1bb-5c27-4bac-b8bf-3218d05fdca9"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:56:47.049756 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-d6a253a8-0833-43f8-94bf-1338dbe808cc tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] validate_networks() for [('c780b733-916d-48a3-99f1-727aee35e4fb', None, None, None, None, None)] {{(pid=122257) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 15:56:47.052395 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-8c87e2a8-d4a9-4c69-92bc-e0666a6adf92 req-14aae2a5-ef6a-47f3-bed5-2217af8a0c74 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:47.053466 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-8c87e2a8-d4a9-4c69-92bc-e0666a6adf92 req-14aae2a5-ef6a-47f3-bed5-2217af8a0c74 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:47.054727 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-8c87e2a8-d4a9-4c69-92bc-e0666a6adf92 req-14aae2a5-ef6a-47f3-bed5-2217af8a0c74 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:47.061144 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:56:47.074084 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-8c87e2a8-d4a9-4c69-92bc-e0666a6adf92 req-14aae2a5-ef6a-47f3-bed5-2217af8a0c74 service nova] Creating event network-changed:6968d1bb-5c27-4bac-b8bf-3218d05fdca9 for instance 3a0126e3-2324-4892-8908-2b6d2d5e2158 on n-h2-850499-9 Aug 31 15:56:47.084691 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-8c87e2a8-d4a9-4c69-92bc-e0666a6adf92 req-14aae2a5-ef6a-47f3-bed5-2217af8a0c74 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054700 Aug 31 15:56:47.087629 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 116/224] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 15:56:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:56:47.097724 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-bb535144-de98-472a-96bd-5ea25112347a tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:47.130314 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-bb535144-de98-472a-96bd-5ea25112347a tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] 10.222.0.61 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.040853 Aug 31 15:56:47.132137 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 117/225] 10.222.0.61 () {58 vars in 1152 bytes} [Wed Aug 31 15:56:47 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 31 15:56:47.149564 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f6b1433b-5b12-48c5-ada0-c49b6be21e6f tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:47.150748 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f6b1433b-5b12-48c5-ada0-c49b6be21e6f tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] [instance: 1b233a49-d4f5-412d-8239-74df4ce63aa5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:47.161658 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f6b1433b-5b12-48c5-ada0-c49b6be21e6f tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:47.162454 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f6b1433b-5b12-48c5-ada0-c49b6be21e6f tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:47.163913 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f6b1433b-5b12-48c5-ada0-c49b6be21e6f tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:47.164943 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f6b1433b-5b12-48c5-ada0-c49b6be21e6f tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:47.165558 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f6b1433b-5b12-48c5-ada0-c49b6be21e6f tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:47.166138 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f6b1433b-5b12-48c5-ada0-c49b6be21e6f tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:47.593169 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f6b1433b-5b12-48c5-ada0-c49b6be21e6f tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc04be9f46432fb954d7dbcfe53488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f665e5697c4453c872940b4c0a88772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:47.608276 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f6b1433b-5b12-48c5-ada0-c49b6be21e6f tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] 10.222.0.61 "GET /compute/v2.1/servers/1b233a49-d4f5-412d-8239-74df4ce63aa5" status: 200 len: 1316 microversion: 2.1 time: 0.469517 Aug 31 15:56:47.609012 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 118/226] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:47 2022] GET /compute/v2.1/servers/1b233a49-d4f5-412d-8239-74df4ce63aa5 => generated 1316 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:47.621026 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9d0ef3e5-f615-4e48-8aeb-af37949085da tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-7870315"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:56:47.624770 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.aggregate [None req-9d0ef3e5-f615-4e48-8aeb-af37949085da tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] Generated uuid d338b5c5-63ac-43d7-a2bf-65b523a69f5e for aggregate {{(pid=122256) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 31 15:56:47.662916 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9d0ef3e5-f615-4e48-8aeb-af37949085da tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates" status: 200 len: 196 microversion: 2.1 time: 0.050090 Aug 31 15:56:47.665173 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 119/227] 10.222.0.61 () {60 vars in 1164 bytes} [Wed Aug 31 15:56:47 2022] POST /compute/v2.1/os-aggregates => generated 196 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:56:47.680941 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-12b105fb-756d-491f-9964-b3b7e2062a15 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-850499-9"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:56:47.702502 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-d6a253a8-0833-43f8-94bf-1338dbe808cc tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 15:56:47.703731 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-d6a253a8-0833-43f8-94bf-1338dbe808cc tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 15:56:47.704393 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-d6a253a8-0833-43f8-94bf-1338dbe808cc tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 15:56:47.705356 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-d6a253a8-0833-43f8-94bf-1338dbe808cc tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 15:56:47.705937 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-d6a253a8-0833-43f8-94bf-1338dbe808cc tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 15:56:47.714350 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-12b105fb-756d-491f-9964-b3b7e2062a15 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:47.717092 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d6a253a8-0833-43f8-94bf-1338dbe808cc tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:47.717790 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d6a253a8-0833-43f8-94bf-1338dbe808cc tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:47.718375 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d6a253a8-0833-43f8-94bf-1338dbe808cc tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:47.719789 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d6a253a8-0833-43f8-94bf-1338dbe808cc tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:47.720417 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d6a253a8-0833-43f8-94bf-1338dbe808cc tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:47.720690 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-12b105fb-756d-491f-9964-b3b7e2062a15 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:47.721032 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d6a253a8-0833-43f8-94bf-1338dbe808cc tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:47.721944 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-12b105fb-756d-491f-9964-b3b7e2062a15 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:47.753730 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-d6a253a8-0833-43f8-94bf-1338dbe808cc tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Getting quotas for project 150e5f8e376a40e089de8ed092e269fd. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:56:47.760325 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-d6a253a8-0833-43f8-94bf-1338dbe808cc tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Getting quotas for user de0e032fc09b48ada1dfe99e549aa623 and project 150e5f8e376a40e089de8ed092e269fd. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:56:47.779256 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d6a253a8-0833-43f8-94bf-1338dbe808cc tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Going to run 1 instances... {{(pid=122257) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 15:56:47.782199 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d6a253a8-0833-43f8-94bf-1338dbe808cc tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 15:56:47.915720 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d6a253a8-0833-43f8-94bf-1338dbe808cc tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.167300 Aug 31 15:56:47.923022 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 109/228] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 15:56:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1170 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 15:56:47.936131 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-cf15a056-8a31-448a-89b4-319e70d18376 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:47.936954 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-cf15a056-8a31-448a-89b4-319e70d18376 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:48.017370 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-12b105fb-756d-491f-9964-b3b7e2062a15 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 240 microversion: 2.1 time: 0.342311 Aug 31 15:56:48.018349 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 120/229] 10.222.0.61 () {60 vars in 1194 bytes} [Wed Aug 31 15:56:47 2022] POST /compute/v2.1/os-aggregates/10/action => generated 240 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:56:48.030228 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-046f823b-ff9c-47f6-9a6e-84f261a3e937 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:48.040881 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-cf15a056-8a31-448a-89b4-319e70d18376 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:48.056153 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-cf15a056-8a31-448a-89b4-319e70d18376 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56" status: 200 len: 1210 microversion: 2.1 time: 0.121882 Aug 31 15:56:48.058524 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 110/230] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:47 2022] GET /compute/v2.1/servers/bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56 => generated 1210 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:48.078072 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-046f823b-ff9c-47f6-9a6e-84f261a3e937 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] 10.222.0.61 "GET /compute/v2.1/os-aggregates" status: 200 len: 243 microversion: 2.1 time: 0.052685 Aug 31 15:56:48.078671 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 121/231] 10.222.0.61 () {58 vars in 1143 bytes} [Wed Aug 31 15:56:48 2022] GET /compute/v2.1/os-aggregates => generated 243 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 15:56:48.086466 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b27abb27-a457-4125-bf04-40fb26596186 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:48.088119 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b27abb27-a457-4125-bf04-40fb26596186 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] [instance: f2162319-5635-4c77-920d-9ecb3221d174] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:48.095521 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-194789c8-a5b3-4994-9bf5-e19f16624e25 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-850499-9"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:56:48.096399 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b27abb27-a457-4125-bf04-40fb26596186 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:48.096968 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b27abb27-a457-4125-bf04-40fb26596186 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:48.099358 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b27abb27-a457-4125-bf04-40fb26596186 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:48.100592 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b27abb27-a457-4125-bf04-40fb26596186 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:48.103198 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b27abb27-a457-4125-bf04-40fb26596186 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:48.105325 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b27abb27-a457-4125-bf04-40fb26596186 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:48.123772 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-194789c8-a5b3-4994-9bf5-e19f16624e25 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:48.124264 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-194789c8-a5b3-4994-9bf5-e19f16624e25 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:48.124903 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-194789c8-a5b3-4994-9bf5-e19f16624e25 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:48.306609 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b27abb27-a457-4125-bf04-40fb26596186 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:48.326970 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b27abb27-a457-4125-bf04-40fb26596186 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:48.330182 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b27abb27-a457-4125-bf04-40fb26596186 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:48.340498 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b27abb27-a457-4125-bf04-40fb26596186 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] 10.222.0.61 "GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174" status: 200 len: 1447 microversion: 2.75 time: 0.280653 Aug 31 15:56:48.342488 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 111/232] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:56:48 2022] GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174 => generated 1447 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:56:48.428452 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-194789c8-a5b3-4994-9bf5-e19f16624e25 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 225 microversion: 2.1 time: 0.338683 Aug 31 15:56:48.429712 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 122/233] 10.222.0.61 () {60 vars in 1194 bytes} [Wed Aug 31 15:56:48 2022] POST /compute/v2.1/os-aggregates/10/action => generated 225 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:56:48.458414 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e4a3b982-7f9c-413c-a38c-7f283261b7a4 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:48.512925 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e4a3b982-7f9c-413c-a38c-7f283261b7a4 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] 10.222.0.61 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.075024 Aug 31 15:56:48.514268 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 112/234] 10.222.0.61 () {58 vars in 1155 bytes} [Wed Aug 31 15:56:48 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 31 15:56:48.528525 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7ef250db-9a59-439f-a768-9ad6003d525e tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-356445042"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:56:48.533140 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.aggregate [None req-7ef250db-9a59-439f-a768-9ad6003d525e tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] Generated uuid f0feaae9-6948-476d-b69a-55b64e7fef4b for aggregate {{(pid=122256) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 31 15:56:48.559231 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-fa5b7e48-d05a-4a00-81fe-263606aff6b9 req-a6894658-791e-4a11-8ba3-d2f6e1611e32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b233a49-d4f5-412d-8239-74df4ce63aa5", "name": "network-vif-plugged", "status": "completed", "tag": "f56ba330-3206-4322-9474-e01afa8afef9"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:56:48.590281 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-fa5b7e48-d05a-4a00-81fe-263606aff6b9 req-a6894658-791e-4a11-8ba3-d2f6e1611e32 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:48.593789 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-fa5b7e48-d05a-4a00-81fe-263606aff6b9 req-a6894658-791e-4a11-8ba3-d2f6e1611e32 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:48.594478 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-fa5b7e48-d05a-4a00-81fe-263606aff6b9 req-a6894658-791e-4a11-8ba3-d2f6e1611e32 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:48.604241 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7ef250db-9a59-439f-a768-9ad6003d525e tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.082367 Aug 31 15:56:48.604990 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 123/235] 10.222.0.61 () {60 vars in 1164 bytes} [Wed Aug 31 15:56:48 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:56:48.616598 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-95ed5a0d-5ade-4ea1-a900-abdee9d1d8b0 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-850499-9"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:56:48.646862 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-fa5b7e48-d05a-4a00-81fe-263606aff6b9 req-a6894658-791e-4a11-8ba3-d2f6e1611e32 service nova] Creating event network-vif-plugged:f56ba330-3206-4322-9474-e01afa8afef9 for instance 1b233a49-d4f5-412d-8239-74df4ce63aa5 on n-h1-850499-9 Aug 31 15:56:48.648567 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-95ed5a0d-5ade-4ea1-a900-abdee9d1d8b0 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:48.649168 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-95ed5a0d-5ade-4ea1-a900-abdee9d1d8b0 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:48.654212 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-95ed5a0d-5ade-4ea1-a900-abdee9d1d8b0 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:48.656895 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-fa5b7e48-d05a-4a00-81fe-263606aff6b9 req-a6894658-791e-4a11-8ba3-d2f6e1611e32 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107150 Aug 31 15:56:48.658234 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 113/236] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 15:56:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:56:48.669811 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0a3ac8f2-9f61-4cba-ad13-cdf39215ba01 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:48.671181 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0a3ac8f2-9f61-4cba-ad13-cdf39215ba01 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] [instance: 1b233a49-d4f5-412d-8239-74df4ce63aa5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:48.691429 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0a3ac8f2-9f61-4cba-ad13-cdf39215ba01 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:48.692394 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0a3ac8f2-9f61-4cba-ad13-cdf39215ba01 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:48.693161 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0a3ac8f2-9f61-4cba-ad13-cdf39215ba01 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:48.694565 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0a3ac8f2-9f61-4cba-ad13-cdf39215ba01 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:48.695366 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0a3ac8f2-9f61-4cba-ad13-cdf39215ba01 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:48.696725 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0a3ac8f2-9f61-4cba-ad13-cdf39215ba01 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:49.061875 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-95ed5a0d-5ade-4ea1-a900-abdee9d1d8b0 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 242 microversion: 2.1 time: 0.448832 Aug 31 15:56:49.062646 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 124/237] 10.222.0.61 () {60 vars in 1194 bytes} [Wed Aug 31 15:56:48 2022] POST /compute/v2.1/os-aggregates/11/action => generated 242 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:56:49.074025 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-15052698-45b0-48ea-8e15-b8221d74d2d5 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-850499-9"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:56:49.111848 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-15052698-45b0-48ea-8e15-b8221d74d2d5 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:49.114738 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-15052698-45b0-48ea-8e15-b8221d74d2d5 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:49.115374 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-15052698-45b0-48ea-8e15-b8221d74d2d5 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:49.245327 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0a3ac8f2-9f61-4cba-ad13-cdf39215ba01 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc04be9f46432fb954d7dbcfe53488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f665e5697c4453c872940b4c0a88772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:49.259015 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0a3ac8f2-9f61-4cba-ad13-cdf39215ba01 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] 10.222.0.61 "GET /compute/v2.1/servers/1b233a49-d4f5-412d-8239-74df4ce63aa5" status: 200 len: 1316 microversion: 2.1 time: 0.599039 Aug 31 15:56:49.259772 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 114/238] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:48 2022] GET /compute/v2.1/servers/1b233a49-d4f5-412d-8239-74df4ce63aa5 => generated 1316 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:49.275648 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e5ed537f-9030-4512-8cd3-d9aa9d00b433 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:49.276515 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e5ed537f-9030-4512-8cd3-d9aa9d00b433 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:49.298098 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e5ed537f-9030-4512-8cd3-d9aa9d00b433 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:49.304381 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e5ed537f-9030-4512-8cd3-d9aa9d00b433 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:49.309084 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e5ed537f-9030-4512-8cd3-d9aa9d00b433 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:49.310445 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e5ed537f-9030-4512-8cd3-d9aa9d00b433 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:49.311701 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e5ed537f-9030-4512-8cd3-d9aa9d00b433 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:49.312716 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e5ed537f-9030-4512-8cd3-d9aa9d00b433 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:49.457118 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-15052698-45b0-48ea-8e15-b8221d74d2d5 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 227 microversion: 2.1 time: 0.385634 Aug 31 15:56:49.462275 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 125/239] 10.222.0.61 () {60 vars in 1194 bytes} [Wed Aug 31 15:56:49 2022] POST /compute/v2.1/os-aggregates/11/action => generated 227 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:56:49.483994 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-70bfaa39-35f9-4ce8-a00b-42d36586c7e4 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:49.484619 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-70bfaa39-35f9-4ce8-a00b-42d36586c7e4 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] [instance: f2162319-5635-4c77-920d-9ecb3221d174] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:49.520266 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-70bfaa39-35f9-4ce8-a00b-42d36586c7e4 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:49.530385 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-70bfaa39-35f9-4ce8-a00b-42d36586c7e4 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:49.532884 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-70bfaa39-35f9-4ce8-a00b-42d36586c7e4 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:49.533871 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-70bfaa39-35f9-4ce8-a00b-42d36586c7e4 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:49.534530 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-70bfaa39-35f9-4ce8-a00b-42d36586c7e4 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:49.538721 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-70bfaa39-35f9-4ce8-a00b-42d36586c7e4 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:49.541111 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e5ed537f-9030-4512-8cd3-d9aa9d00b433 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:49.558382 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e5ed537f-9030-4512-8cd3-d9aa9d00b433 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56" status: 200 len: 1206 microversion: 2.1 time: 0.291610 Aug 31 15:56:49.560080 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 115/240] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:49 2022] GET /compute/v2.1/servers/bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56 => generated 1206 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:49.569069 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ca627687-b12a-4fa2-a765-2f5a2a933a07 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:49.611846 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ca627687-b12a-4fa2-a765-2f5a2a933a07 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] 10.222.0.61 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.043498 Aug 31 15:56:49.612875 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 116/241] 10.222.0.61 () {58 vars in 1155 bytes} [Wed Aug 31 15:56:49 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 31 15:56:49.627040 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0fbc79f4-d26a-47cf-8343-627bf005620c tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1064143232"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:56:49.662439 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.aggregate [None req-0fbc79f4-d26a-47cf-8343-627bf005620c tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] Generated uuid d1bb4baa-2547-40be-b8ae-51a24a76c697 for aggregate {{(pid=122257) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 31 15:56:49.664855 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-70bfaa39-35f9-4ce8-a00b-42d36586c7e4 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:49.674409 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-70bfaa39-35f9-4ce8-a00b-42d36586c7e4 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:49.676453 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-70bfaa39-35f9-4ce8-a00b-42d36586c7e4 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:49.680183 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1,nova_api:DELETE=7,nova_api:INSERT=5 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:56:49.686057 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-70bfaa39-35f9-4ce8-a00b-42d36586c7e4 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] 10.222.0.61 "GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174" status: 200 len: 1447 microversion: 2.75 time: 0.222426 Aug 31 15:56:49.688187 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 126/242] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:56:49 2022] GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174 => generated 1447 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:56:49.694906 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-88b8d3bb-297c-45c1-9153-a259cde91ee1 tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1988350405"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:56:49.699356 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.aggregate [None req-88b8d3bb-297c-45c1-9153-a259cde91ee1 tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] Generated uuid 9749cc53-9a12-4418-99ba-243a5deef616 for aggregate {{(pid=122256) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 31 15:56:49.712639 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0fbc79f4-d26a-47cf-8343-627bf005620c tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.091952 Aug 31 15:56:49.720681 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 117/243] 10.222.0.61 () {60 vars in 1164 bytes} [Wed Aug 31 15:56:49 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:56:49.732742 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f5bec1e6-b6b6-4ce4-82a4-c29dd23015fd tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:49.740110 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-88b8d3bb-297c-45c1-9153-a259cde91ee1 tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.048390 Aug 31 15:56:49.746475 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 127/244] 10.222.0.61 () {60 vars in 1164 bytes} [Wed Aug 31 15:56:49 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:56:49.757340 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-db04a8c6-87ad-4044-9ddc-b8031f6b03da tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-850499-9"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:56:49.765141 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f5bec1e6-b6b6-4ce4-82a4-c29dd23015fd tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] 10.222.0.61 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.043242 Aug 31 15:56:49.769567 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 118/245] 10.222.0.61 () {58 vars in 1155 bytes} [Wed Aug 31 15:56:49 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 31 15:56:49.774988 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0ef0753d-9b8f-40a6-bc9a-f5a940b785f5 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:49.785853 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-db04a8c6-87ad-4044-9ddc-b8031f6b03da tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:49.786990 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-db04a8c6-87ad-4044-9ddc-b8031f6b03da tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:49.787690 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-db04a8c6-87ad-4044-9ddc-b8031f6b03da tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:49.791467 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-0ef0753d-9b8f-40a6-bc9a-f5a940b785f5 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] HTTP exception thrown: Aggregate 12 could not be found. Aug 31 15:56:49.795880 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0ef0753d-9b8f-40a6-bc9a-f5a940b785f5 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] Request method failure captured: Aug 31 15:56:49.795880 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/os-aggregates/12 HTTP/1.1 Aug 31 15:56:49.795880 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 15:56:49.795880 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 15:56:49.795880 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 15:56:49.795880 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 15:56:49.795880 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 15:56:49.795880 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 15:56:49.795880 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 15:56:49.795880 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 15:56:49.795880 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4SEV8Pp3taaJNgJIhulxJZ8CXr1m_MRzhJUipJ9dQx1h0TzOyZlLiKNLpcB-f1bSxQHU8rsW7RHzyce8ecfWMj70n4MSdMgxWDOe8V8FNjgqty6Lm_D4VK3QKZYjTAf4hz4T1d_4RC3V7Tn6w32FDGd9gTw9FPd7ePk1n0OJ1qmeW0 Aug 31 15:56:49.795880 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 15:56:49.795880 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 15:56:49.795880 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 15:56:49.795880 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 15:56:49.795880 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 15:56:49.795880 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 15:56:49.795880 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 54d9f46f341846218c3d7fc77f80ddeb Aug 31 15:56:49.795880 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-AggregatesAdminTestJSON-1355413937 Aug 31 15:56:49.795880 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,admin,member Aug 31 15:56:49.795880 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,admin,member Aug 31 15:56:49.797459 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/54d9f46f341846218c3d7fc77f80ddeb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/54d9f46f341846218c3d7fc77f80ddeb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_54d9f46f341846218c3d7fc77f80ddeb", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/54d9f46f341846218c3d7fc77f80ddeb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 15:56:49.797459 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-AggregatesAdminTestJSON-1355413937 Aug 31 15:56:49.797459 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 54d9f46f341846218c3d7fc77f80ddeb Aug 31 15:56:49.797459 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1355413937 Aug 31 15:56:49.797459 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-AggregatesAdminTestJSON-1355413937-project-admin Aug 31 15:56:49.797459 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 15:56:49.797459 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 15:56:49.797459 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 61e0f13b306443b89dd0573f513dfdba Aug 31 15:56:49.797459 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-AggregatesAdminTestJSON-1355413937-project-admin Aug 31 15:56:49.797459 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 15:56:49.797459 n-d-850499-9 devstack@n-api.service[122257]: exception: Aggregate 12 could not be found. Aug 31 15:56:49.797459 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '12'} Aug 31 15:56:49.797459 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:56:49.798402 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:56:49.798402 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 31 15:56:49.798402 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 31 15:56:49.798402 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6462, in get_aggregate Aug 31 15:56:49.798402 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 31 15:56:49.798402 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 15:56:49.798402 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 15:56:49.798402 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 31 15:56:49.798402 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 31 15:56:49.798402 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 31 15:56:49.798402 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 31 15:56:49.798402 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 31 15:56:49.798402 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 31 15:56:49.798402 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 12 could not be found. Aug 31 15:56:49.798402 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:56:49.798402 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:56:49.798402 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:56:49.798402 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:56:49.798402 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:56:49.799493 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:56:49.799493 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:56:49.799493 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:56:49.799493 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:56:49.799493 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:56:49.799493 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 31 15:56:49.799493 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:56:49.799493 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 12 could not be found. Aug 31 15:56:49.799493 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:56:49.799493 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:56:49.799493 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:56:49.799493 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:56:49.799493 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:56:49.799493 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:56:49.799493 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:56:49.799493 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:56:49.799493 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 12 could not be found. Aug 31 15:56:49.799493 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:56:49.801943 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0ef0753d-9b8f-40a6-bc9a-f5a940b785f5 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] Returning 404 to user: Aggregate 12 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:56:49.803171 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0ef0753d-9b8f-40a6-bc9a-f5a940b785f5 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] 10.222.0.61 "GET /compute/v2.1/os-aggregates/12" status: 404 len: 78 microversion: 2.1 time: 0.032394 Aug 31 15:56:49.810098 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 119/246] 10.222.0.61 () {58 vars in 1152 bytes} [Wed Aug 31 15:56:49 2022] GET /compute/v2.1/os-aggregates/12 => generated 78 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 31 15:56:49.816625 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c1eb7c26-8864-4c71-b339-c28709ef1554 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:49.828927 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-c1eb7c26-8864-4c71-b339-c28709ef1554 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] HTTP exception thrown: Aggregate 12 could not be found. Aug 31 15:56:49.831357 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c1eb7c26-8864-4c71-b339-c28709ef1554 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] Request method failure captured: Aug 31 15:56:49.831357 n-d-850499-9 devstack@n-api.service[122257]: request: DELETE /compute/v2.1/os-aggregates/12 HTTP/1.1 Aug 31 15:56:49.831357 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 15:56:49.831357 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 15:56:49.831357 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 15:56:49.831357 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 15:56:49.831357 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 15:56:49.831357 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 15:56:49.831357 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 15:56:49.831357 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 15:56:49.831357 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4SEV8Pp3taaJNgJIhulxJZ8CXr1m_MRzhJUipJ9dQx1h0TzOyZlLiKNLpcB-f1bSxQHU8rsW7RHzyce8ecfWMj70n4MSdMgxWDOe8V8FNjgqty6Lm_D4VK3QKZYjTAf4hz4T1d_4RC3V7Tn6w32FDGd9gTw9FPd7ePk1n0OJ1qmeW0 Aug 31 15:56:49.831357 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 15:56:49.831357 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 15:56:49.831357 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 15:56:49.831357 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 15:56:49.831357 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 15:56:49.831357 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 15:56:49.831357 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 54d9f46f341846218c3d7fc77f80ddeb Aug 31 15:56:49.831357 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-AggregatesAdminTestJSON-1355413937 Aug 31 15:56:49.831357 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,admin,member Aug 31 15:56:49.831357 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,admin,member Aug 31 15:56:49.832794 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/54d9f46f341846218c3d7fc77f80ddeb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/54d9f46f341846218c3d7fc77f80ddeb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_54d9f46f341846218c3d7fc77f80ddeb", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/54d9f46f341846218c3d7fc77f80ddeb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 15:56:49.832794 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-AggregatesAdminTestJSON-1355413937 Aug 31 15:56:49.832794 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 54d9f46f341846218c3d7fc77f80ddeb Aug 31 15:56:49.832794 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1355413937 Aug 31 15:56:49.832794 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-AggregatesAdminTestJSON-1355413937-project-admin Aug 31 15:56:49.832794 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 15:56:49.832794 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 15:56:49.832794 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 61e0f13b306443b89dd0573f513dfdba Aug 31 15:56:49.832794 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-AggregatesAdminTestJSON-1355413937-project-admin Aug 31 15:56:49.832794 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 15:56:49.832794 n-d-850499-9 devstack@n-api.service[122257]: exception: Aggregate 12 could not be found. Aug 31 15:56:49.832794 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '12'} Aug 31 15:56:49.832794 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:56:49.833653 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:56:49.833653 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 31 15:56:49.833653 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 31 15:56:49.833653 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 31 15:56:49.833653 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 31 15:56:49.833653 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 15:56:49.833653 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 31 15:56:49.833653 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 15:56:49.833653 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise self.value Aug 31 15:56:49.833653 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 31 15:56:49.833653 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 31 15:56:49.833653 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6515, in delete_aggregate Aug 31 15:56:49.833653 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 31 15:56:49.833653 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 15:56:49.833653 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 15:56:49.833653 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 31 15:56:49.833653 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 31 15:56:49.833653 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 31 15:56:49.833653 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 31 15:56:49.834868 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 31 15:56:49.834868 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 31 15:56:49.834868 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 12 could not be found. Aug 31 15:56:49.834868 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:56:49.834868 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:56:49.834868 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:56:49.834868 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:56:49.834868 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:56:49.834868 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:56:49.834868 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:56:49.834868 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:56:49.834868 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:56:49.834868 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:56:49.834868 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 31 15:56:49.834868 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:56:49.834868 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 12 could not be found. Aug 31 15:56:49.834868 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:56:49.834868 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:56:49.834868 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:56:49.834868 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:56:49.834868 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:56:49.836191 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:56:49.836191 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:56:49.836191 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:56:49.836191 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 12 could not be found. Aug 31 15:56:49.836191 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:56:49.838176 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c1eb7c26-8864-4c71-b339-c28709ef1554 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] Returning 404 to user: Aggregate 12 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:56:49.839185 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c1eb7c26-8864-4c71-b339-c28709ef1554 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] 10.222.0.61 "DELETE /compute/v2.1/os-aggregates/12" status: 404 len: 78 microversion: 2.1 time: 0.027776 Aug 31 15:56:49.839926 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 120/247] 10.222.0.61 () {58 vars in 1155 bytes} [Wed Aug 31 15:56:49 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 78 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 31 15:56:49.850375 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b25cebc1-91af-42e0-bffd-4fa250187976 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1220539431", "name": "tempest-test_aggregate-1183451228"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:56:49.854165 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.aggregate [None req-b25cebc1-91af-42e0-bffd-4fa250187976 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] Generated uuid dc542045-1130-4571-a435-8c060147fd06 for aggregate {{(pid=122257) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 31 15:56:49.900373 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b25cebc1-91af-42e0-bffd-4fa250187976 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates" status: 200 len: 223 microversion: 2.1 time: 0.054843 Aug 31 15:56:49.901432 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 121/248] 10.222.0.61 () {60 vars in 1165 bytes} [Wed Aug 31 15:56:49 2022] POST /compute/v2.1/os-aggregates => generated 223 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:56:49.913274 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7064e624-8009-461a-99bf-f3f45a0703a8 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:49.932268 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=7,nova_api:INSERT=7 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:56:49.960743 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7064e624-8009-461a-99bf-f3f45a0703a8 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] 10.222.0.61 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.052333 Aug 31 15:56:49.962086 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 122/249] 10.222.0.61 () {58 vars in 1155 bytes} [Wed Aug 31 15:56:49 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Aug 31 15:56:49.983992 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d24fa946-d843-4633-b7da-c9960814ebc5 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:49.994816 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-db04a8c6-87ad-4044-9ddc-b8031f6b03da tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 243 microversion: 2.1 time: 0.242462 Aug 31 15:56:49.996733 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 128/250] 10.222.0.61 () {60 vars in 1194 bytes} [Wed Aug 31 15:56:49 2022] POST /compute/v2.1/os-aggregates/13/action => generated 243 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:56:50.008021 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3029c9fa-478a-4a2d-b6de-3fb767be949b tempest-AggregatesAdminNegativeTestJSON-148728318 tempest-AggregatesAdminNegativeTestJSON-148728318-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-850499-9"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:56:50.014465 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-d24fa946-d843-4633-b7da-c9960814ebc5 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Aug 31 15:56:50.017573 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3029c9fa-478a-4a2d-b6de-3fb767be949b tempest-AggregatesAdminNegativeTestJSON-148728318 tempest-AggregatesAdminNegativeTestJSON-148728318-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '7be97b44590b40ccaee241d020cfd674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f9a9a381df493d9963697f8e6f4b8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:50.019352 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3029c9fa-478a-4a2d-b6de-3fb767be949b tempest-AggregatesAdminNegativeTestJSON-148728318 tempest-AggregatesAdminNegativeTestJSON-148728318-project] Request method failure captured: Aug 31 15:56:50.019352 n-d-850499-9 devstack@n-api.service[122256]: request: POST /compute/v2.1/os-aggregates/13/action HTTP/1.1 Aug 31 15:56:50.019352 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 15:56:50.019352 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 15:56:50.019352 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 15:56:50.019352 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 42 Aug 31 15:56:50.019352 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 15:56:50.019352 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 15:56:50.019352 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 15:56:50.019352 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 15:56:50.019352 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4SCylM4XlpqpHr7br_SNtINz4kKLsmoxZFU3yRQqIUaF5qH9TxqaBPIeqf9ekYJ7E0Mzhf8YAs3u2Z4Me-JhE-FBwxcq4Z4T3e_6qmZ311AsdkpeBRMvRJcA647S3Chjq-8kSCbOj0mRLKOX_gZtA7_5RwYQZ-k6ogyns7nGw2XTx4 Aug 31 15:56:50.019352 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 15:56:50.019352 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 15:56:50.019352 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 15:56:50.019352 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 15:56:50.019352 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 15:56:50.019352 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 15:56:50.019352 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 28f9a9a381df493d9963697f8e6f4b8f Aug 31 15:56:50.019352 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-148728318 Aug 31 15:56:50.019352 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 15:56:50.019352 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 15:56:50.020613 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/28f9a9a381df493d9963697f8e6f4b8f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/28f9a9a381df493d9963697f8e6f4b8f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_28f9a9a381df493d9963697f8e6f4b8f", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/28f9a9a381df493d9963697f8e6f4b8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 15:56:50.020613 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-148728318 Aug 31 15:56:50.020613 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 28f9a9a381df493d9963697f8e6f4b8f Aug 31 15:56:50.020613 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-148728318 Aug 31 15:56:50.020613 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-AggregatesAdminNegativeTestJSON-148728318-project Aug 31 15:56:50.020613 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 15:56:50.020613 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 15:56:50.020613 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 7be97b44590b40ccaee241d020cfd674 Aug 31 15:56:50.020613 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-148728318-project Aug 31 15:56:50.020613 n-d-850499-9 devstack@n-api.service[122256]: Aug 31 15:56:50.020613 n-d-850499-9 devstack@n-api.service[122256]: {"remove_host": {"host": "n-h1-850499-9"}} Aug 31 15:56:50.020613 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 15:56:50.020613 n-d-850499-9 devstack@n-api.service[122256]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 31 15:56:50.021340 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '13', 'body': {'remove_host': {'host': 'n-h1-850499-9'}}} Aug 31 15:56:50.021340 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:56:50.021340 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:56:50.021340 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:56:50.021340 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:56:50.021340 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:56:50.021340 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:56:50.021340 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:56:50.021340 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:56:50.021340 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:56:50.021340 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:56:50.021340 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Aug 31 15:56:50.021340 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Aug 31 15:56:50.021340 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 31 15:56:50.021340 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 31 15:56:50.021340 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 31 15:56:50.021340 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 31 15:56:50.021340 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 15:56:50.021340 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 31 15:56:50.022402 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 15:56:50.022402 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise self.value Aug 31 15:56:50.022402 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 31 15:56:50.022402 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 31 15:56:50.022402 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 31 15:56:50.022402 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 31 15:56:50.022402 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 31 15:56:50.022402 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 31 15:56:50.022402 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 31 15:56:50.022402 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:56:50.022402 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:56:50.022402 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:56:50.022402 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:56:50.022402 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:56:50.022402 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:56:50.022402 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 31 15:56:50.022402 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 31 15:56:50.022402 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 31 15:56:50.022402 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:56:50.023608 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d24fa946-d843-4633-b7da-c9960814ebc5 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] Request method failure captured: Aug 31 15:56:50.023608 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/os-aggregates/14 HTTP/1.1 Aug 31 15:56:50.023608 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 15:56:50.023608 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 15:56:50.023608 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 15:56:50.023608 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 15:56:50.023608 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 15:56:50.023608 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 15:56:50.023608 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 15:56:50.023608 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 15:56:50.023608 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4SEV8Pp3taaJNgJIhulxJZ8CXr1m_MRzhJUipJ9dQx1h0TzOyZlLiKNLpcB-f1bSxQHU8rsW7RHzyce8ecfWMj70n4MSdMgxWDOe8V8FNjgqty6Lm_D4VK3QKZYjTAf4hz4T1d_4RC3V7Tn6w32FDGd9gTw9FPd7ePk1n0OJ1qmeW0 Aug 31 15:56:50.023608 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 15:56:50.023608 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 15:56:50.023608 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 15:56:50.023608 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 15:56:50.023608 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 15:56:50.023608 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 15:56:50.023608 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 54d9f46f341846218c3d7fc77f80ddeb Aug 31 15:56:50.023608 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-AggregatesAdminTestJSON-1355413937 Aug 31 15:56:50.023608 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,admin,member Aug 31 15:56:50.023608 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,admin,member Aug 31 15:56:50.024784 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/54d9f46f341846218c3d7fc77f80ddeb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/54d9f46f341846218c3d7fc77f80ddeb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_54d9f46f341846218c3d7fc77f80ddeb", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/54d9f46f341846218c3d7fc77f80ddeb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 15:56:50.024784 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-AggregatesAdminTestJSON-1355413937 Aug 31 15:56:50.024784 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 54d9f46f341846218c3d7fc77f80ddeb Aug 31 15:56:50.024784 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1355413937 Aug 31 15:56:50.024784 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-AggregatesAdminTestJSON-1355413937-project-admin Aug 31 15:56:50.024784 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 15:56:50.024784 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 15:56:50.024784 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 61e0f13b306443b89dd0573f513dfdba Aug 31 15:56:50.024784 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-AggregatesAdminTestJSON-1355413937-project-admin Aug 31 15:56:50.024784 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 15:56:50.024784 n-d-850499-9 devstack@n-api.service[122257]: exception: Aggregate 14 could not be found. Aug 31 15:56:50.024784 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '14'} Aug 31 15:56:50.024784 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:56:50.025476 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:56:50.025476 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 31 15:56:50.025476 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 31 15:56:50.025476 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6462, in get_aggregate Aug 31 15:56:50.025476 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 31 15:56:50.025476 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 15:56:50.025476 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 15:56:50.025476 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 31 15:56:50.025476 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 31 15:56:50.025476 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 31 15:56:50.025476 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 31 15:56:50.025476 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 31 15:56:50.025476 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 31 15:56:50.025476 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Aug 31 15:56:50.025476 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:56:50.025476 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:56:50.025476 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:56:50.025476 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:56:50.025476 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:56:50.026469 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:56:50.026469 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:56:50.026469 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:56:50.026469 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:56:50.026469 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:56:50.026469 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 31 15:56:50.026469 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:56:50.026469 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Aug 31 15:56:50.026469 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:56:50.026469 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:56:50.026469 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:56:50.026469 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:56:50.026469 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:56:50.026469 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:56:50.026469 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:56:50.026469 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:56:50.026469 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Aug 31 15:56:50.026469 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:56:50.027417 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d24fa946-d843-4633-b7da-c9960814ebc5 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:56:50.027483 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3029c9fa-478a-4a2d-b6de-3fb767be949b tempest-AggregatesAdminNegativeTestJSON-148728318 tempest-AggregatesAdminNegativeTestJSON-148728318-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:56:50.027483 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3029c9fa-478a-4a2d-b6de-3fb767be949b tempest-AggregatesAdminNegativeTestJSON-148728318 tempest-AggregatesAdminNegativeTestJSON-148728318-project] 10.222.0.61 "POST /compute/v2.1/os-aggregates/13/action" status: 403 len: 121 microversion: 2.1 time: 0.020667 Aug 31 15:56:50.033251 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d24fa946-d843-4633-b7da-c9960814ebc5 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] 10.222.0.61 "GET /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.054811 Aug 31 15:56:50.033915 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 123/251] 10.222.0.61 () {58 vars in 1152 bytes} [Wed Aug 31 15:56:49 2022] GET /compute/v2.1/os-aggregates/14 => generated 78 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 31 15:56:50.034519 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 129/252] 10.222.0.61 () {60 vars in 1194 bytes} [Wed Aug 31 15:56:50 2022] POST /compute/v2.1/os-aggregates/13/action => generated 121 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 31 15:56:50.049335 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8deb3fb1-b98e-459e-a677-70c25f1fab03 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:50.052384 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9b013ec5-55b0-47bb-bbda-697d44ce90f4 tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-850499-9"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:56:50.071300 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9b013ec5-55b0-47bb-bbda-697d44ce90f4 tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:50.072201 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-8deb3fb1-b98e-459e-a677-70c25f1fab03 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Aug 31 15:56:50.072880 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9b013ec5-55b0-47bb-bbda-697d44ce90f4 tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:50.073687 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9b013ec5-55b0-47bb-bbda-697d44ce90f4 tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:50.074030 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8deb3fb1-b98e-459e-a677-70c25f1fab03 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] Request method failure captured: Aug 31 15:56:50.074030 n-d-850499-9 devstack@n-api.service[122257]: request: DELETE /compute/v2.1/os-aggregates/14 HTTP/1.1 Aug 31 15:56:50.074030 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 15:56:50.074030 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 15:56:50.074030 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 15:56:50.074030 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 15:56:50.074030 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 15:56:50.074030 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 15:56:50.074030 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 15:56:50.074030 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 15:56:50.074030 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4SEV8Pp3taaJNgJIhulxJZ8CXr1m_MRzhJUipJ9dQx1h0TzOyZlLiKNLpcB-f1bSxQHU8rsW7RHzyce8ecfWMj70n4MSdMgxWDOe8V8FNjgqty6Lm_D4VK3QKZYjTAf4hz4T1d_4RC3V7Tn6w32FDGd9gTw9FPd7ePk1n0OJ1qmeW0 Aug 31 15:56:50.074030 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 15:56:50.074030 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 15:56:50.074030 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 15:56:50.074030 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 15:56:50.074030 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 15:56:50.074030 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 15:56:50.074030 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 54d9f46f341846218c3d7fc77f80ddeb Aug 31 15:56:50.074030 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-AggregatesAdminTestJSON-1355413937 Aug 31 15:56:50.074030 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,admin,member Aug 31 15:56:50.074030 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,admin,member Aug 31 15:56:50.076037 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/54d9f46f341846218c3d7fc77f80ddeb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/54d9f46f341846218c3d7fc77f80ddeb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_54d9f46f341846218c3d7fc77f80ddeb", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/54d9f46f341846218c3d7fc77f80ddeb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 15:56:50.076037 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-AggregatesAdminTestJSON-1355413937 Aug 31 15:56:50.076037 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 54d9f46f341846218c3d7fc77f80ddeb Aug 31 15:56:50.076037 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1355413937 Aug 31 15:56:50.076037 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-AggregatesAdminTestJSON-1355413937-project-admin Aug 31 15:56:50.076037 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 15:56:50.076037 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 15:56:50.076037 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 61e0f13b306443b89dd0573f513dfdba Aug 31 15:56:50.076037 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-AggregatesAdminTestJSON-1355413937-project-admin Aug 31 15:56:50.076037 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 15:56:50.076037 n-d-850499-9 devstack@n-api.service[122257]: exception: Aggregate 14 could not be found. Aug 31 15:56:50.076037 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '14'} Aug 31 15:56:50.076037 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:56:50.076872 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:56:50.076872 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 31 15:56:50.076872 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 31 15:56:50.076872 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 31 15:56:50.076872 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 31 15:56:50.076872 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 15:56:50.076872 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 31 15:56:50.076872 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 15:56:50.076872 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise self.value Aug 31 15:56:50.076872 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 31 15:56:50.076872 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 31 15:56:50.076872 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6515, in delete_aggregate Aug 31 15:56:50.076872 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 31 15:56:50.076872 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 15:56:50.076872 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 15:56:50.076872 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 31 15:56:50.076872 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 31 15:56:50.076872 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 31 15:56:50.076872 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 31 15:56:50.078077 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 31 15:56:50.078077 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 31 15:56:50.078077 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Aug 31 15:56:50.078077 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:56:50.078077 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:56:50.078077 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:56:50.078077 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:56:50.078077 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:56:50.078077 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:56:50.078077 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:56:50.078077 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:56:50.078077 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:56:50.078077 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:56:50.078077 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 31 15:56:50.078077 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:56:50.078077 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Aug 31 15:56:50.078077 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:56:50.078077 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:56:50.078077 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:56:50.078077 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:56:50.078077 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:56:50.079402 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:56:50.079402 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:56:50.079402 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:56:50.079402 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Aug 31 15:56:50.079402 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:56:50.079402 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8deb3fb1-b98e-459e-a677-70c25f1fab03 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:56:50.079402 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8deb3fb1-b98e-459e-a677-70c25f1fab03 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] 10.222.0.61 "DELETE /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.037247 Aug 31 15:56:50.079402 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 124/253] 10.222.0.61 () {58 vars in 1155 bytes} [Wed Aug 31 15:56:50 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 78 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 31 15:56:50.091811 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2e25334c-b7a5-4177-bfda-05c27ed3a812 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1325073561"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:56:50.096255 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.aggregate [None req-2e25334c-b7a5-4177-bfda-05c27ed3a812 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] Generated uuid 64638118-6bb8-4d53-9a7d-dd83b5ab0576 for aggregate {{(pid=122257) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 31 15:56:50.134015 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2e25334c-b7a5-4177-bfda-05c27ed3a812 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.052260 Aug 31 15:56:50.135833 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 125/254] 10.222.0.61 () {60 vars in 1164 bytes} [Wed Aug 31 15:56:50 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:56:50.169835 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1a6a0f22-9d17-4d56-93e1-0e2061950de2 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:50.184415 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1a6a0f22-9d17-4d56-93e1-0e2061950de2 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] 10.222.0.61 "GET /compute/v2.1/os-aggregates/15" status: 200 len: 228 microversion: 2.1 time: 0.041280 Aug 31 15:56:50.185862 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 126/255] 10.222.0.61 () {58 vars in 1152 bytes} [Wed Aug 31 15:56:50 2022] GET /compute/v2.1/os-aggregates/15 => generated 228 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 15:56:50.217866 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b0b0a809-03bc-4b78-ad40-747425494c2c tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:56:50.335731 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b0b0a809-03bc-4b78-ad40-747425494c2c tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates/15/action" status: 200 len: 266 microversion: 2.1 time: 0.117896 Aug 31 15:56:50.343549 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 127/256] 10.222.0.61 () {60 vars in 1194 bytes} [Wed Aug 31 15:56:50 2022] POST /compute/v2.1/os-aggregates/15/action => generated 266 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:56:50.350069 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b1a54cc0-15e4-42c2-9775-fd67a34d7254 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:50.354827 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b1a54cc0-15e4-42c2-9775-fd67a34d7254 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] [instance: 1b233a49-d4f5-412d-8239-74df4ce63aa5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:50.365870 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b1a54cc0-15e4-42c2-9775-fd67a34d7254 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:50.366594 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b1a54cc0-15e4-42c2-9775-fd67a34d7254 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:50.367395 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b1a54cc0-15e4-42c2-9775-fd67a34d7254 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:50.368406 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b1a54cc0-15e4-42c2-9775-fd67a34d7254 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:50.369060 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b1a54cc0-15e4-42c2-9775-fd67a34d7254 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:50.371696 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b1a54cc0-15e4-42c2-9775-fd67a34d7254 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:50.404492 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9b013ec5-55b0-47bb-bbda-697d44ce90f4 tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 228 microversion: 2.1 time: 0.364820 Aug 31 15:56:50.412457 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 130/257] 10.222.0.61 () {60 vars in 1194 bytes} [Wed Aug 31 15:56:50 2022] POST /compute/v2.1/os-aggregates/13/action => generated 228 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:56:50.418180 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0649391f-98ea-45cc-b679-bf98a138765a tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:50.428042 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0649391f-98ea-45cc-b679-bf98a138765a tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] 10.222.0.61 "GET /compute/v2.1/os-aggregates/15" status: 200 len: 242 microversion: 2.1 time: 0.014072 Aug 31 15:56:50.429268 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 131/258] 10.222.0.61 () {58 vars in 1152 bytes} [Wed Aug 31 15:56:50 2022] GET /compute/v2.1/os-aggregates/15 => generated 242 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:56:50.436032 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-543e1d34-e93c-4d97-9499-1fcce56bcdcb tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:50.484941 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-543e1d34-e93c-4d97-9499-1fcce56bcdcb tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] 10.222.0.61 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.054399 Aug 31 15:56:50.491380 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 132/259] 10.222.0.61 () {58 vars in 1155 bytes} [Wed Aug 31 15:56:50 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 31 15:56:50.501006 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-603a246e-2b89-4d10-b345-897dca216a65 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:50.555424 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-603a246e-2b89-4d10-b345-897dca216a65 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] 10.222.0.61 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.062103 Aug 31 15:56:50.556724 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 133/260] 10.222.0.61 () {58 vars in 1155 bytes} [Wed Aug 31 15:56:50 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 31 15:56:50.563309 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-41b4410b-01a2-483a-943f-5a436f0846bb tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1840432148"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:56:50.579198 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.aggregate [None req-41b4410b-01a2-483a-943f-5a436f0846bb tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] Generated uuid 343d4ed2-6945-4727-af9d-1841beadfb5a for aggregate {{(pid=122256) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 31 15:56:50.645216 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-41b4410b-01a2-483a-943f-5a436f0846bb tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.087258 Aug 31 15:56:50.654354 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 134/261] 10.222.0.61 () {60 vars in 1164 bytes} [Wed Aug 31 15:56:50 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:56:50.663454 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-cf22480c-7cab-4936-8ab6-8f5c92b01f64 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1212143132", "availability_zone": "tempest-test_az-1935536074"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:56:50.715337 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b1a54cc0-15e4-42c2-9775-fd67a34d7254 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc04be9f46432fb954d7dbcfe53488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f665e5697c4453c872940b4c0a88772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:50.718152 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.aggregate [None req-cf22480c-7cab-4936-8ab6-8f5c92b01f64 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] Generated uuid e1216fee-29a7-4834-9435-7b1c27ab2ba3 for aggregate {{(pid=122256) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 31 15:56:50.728811 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b1a54cc0-15e4-42c2-9775-fd67a34d7254 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] 10.222.0.61 "GET /compute/v2.1/servers/1b233a49-d4f5-412d-8239-74df4ce63aa5" status: 200 len: 1316 microversion: 2.1 time: 0.388393 Aug 31 15:56:50.729507 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 128/262] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:50 2022] GET /compute/v2.1/servers/1b233a49-d4f5-412d-8239-74df4ce63aa5 => generated 1316 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:50.736467 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1b4578ed-648e-4fc9-b8e7-d55892304e8e tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:50.737077 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1b4578ed-648e-4fc9-b8e7-d55892304e8e tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:50.746224 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1b4578ed-648e-4fc9-b8e7-d55892304e8e tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:50.747761 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1b4578ed-648e-4fc9-b8e7-d55892304e8e tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:50.748173 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1b4578ed-648e-4fc9-b8e7-d55892304e8e tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:50.748877 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1b4578ed-648e-4fc9-b8e7-d55892304e8e tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:50.749343 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1b4578ed-648e-4fc9-b8e7-d55892304e8e tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:50.749766 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1b4578ed-648e-4fc9-b8e7-d55892304e8e tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:50.799746 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-cf22480c-7cab-4936-8ab6-8f5c92b01f64 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates" status: 200 len: 223 microversion: 2.1 time: 0.141881 Aug 31 15:56:50.800676 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 135/263] 10.222.0.61 () {60 vars in 1165 bytes} [Wed Aug 31 15:56:50 2022] POST /compute/v2.1/os-aggregates => generated 223 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:56:50.807532 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-48433c45-f935-4875-a1d2-91641404b881 tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:56:50.821598 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-48433c45-f935-4875-a1d2-91641404b881 tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:50.822367 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-48433c45-f935-4875-a1d2-91641404b881 tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:50.823004 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-48433c45-f935-4875-a1d2-91641404b881 tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:50.834894 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-48433c45-f935-4875-a1d2-91641404b881 tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:50.836109 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-48433c45-f935-4875-a1d2-91641404b881 tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:50.837184 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-48433c45-f935-4875-a1d2-91641404b881 tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:50.884366 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.compute.aggregates [None req-48433c45-f935-4875-a1d2-91641404b881 tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] Failed to remove host nonexist_host from aggregate 16. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Aug 31 15:56:50.888125 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-48433c45-f935-4875-a1d2-91641404b881 tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 16 Aug 31 15:56:50.891568 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-48433c45-f935-4875-a1d2-91641404b881 tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] Request method failure captured: Aug 31 15:56:50.891568 n-d-850499-9 devstack@n-api.service[122256]: request: POST /compute/v2.1/os-aggregates/16/action HTTP/1.1 Aug 31 15:56:50.891568 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 15:56:50.891568 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 15:56:50.891568 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 15:56:50.891568 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 42 Aug 31 15:56:50.891568 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 15:56:50.891568 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 15:56:50.891568 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 15:56:50.891568 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 15:56:50.891568 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4SGQIQoHeMzleKeuN86FNKPcC70EDN3vvnbv5OP60F3GKzilNbO986Ebl4P9Ns_7fZw90Bs5FqY4IJ9jx1mntbxztRbT4O47wiLT9GZ_VsOGsx0hBsPT0oayVTcpf-y2h3Escl2kyQTF-POOAwUJKtU9TWiek0xftsoY-gAipBE-sE Aug 31 15:56:50.891568 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 15:56:50.891568 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 15:56:50.891568 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 15:56:50.891568 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 15:56:50.891568 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 15:56:50.891568 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 15:56:50.891568 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 7bbe02d5716d48d9bcff3357923a7933 Aug 31 15:56:50.891568 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1569510051 Aug 31 15:56:50.891568 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,admin,member Aug 31 15:56:50.891568 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,admin,member Aug 31 15:56:50.893013 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7bbe02d5716d48d9bcff3357923a7933"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7bbe02d5716d48d9bcff3357923a7933"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7bbe02d5716d48d9bcff3357923a7933", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7bbe02d5716d48d9bcff3357923a7933"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 15:56:50.893013 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1569510051 Aug 31 15:56:50.893013 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 7bbe02d5716d48d9bcff3357923a7933 Aug 31 15:56:50.893013 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1569510051 Aug 31 15:56:50.893013 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin Aug 31 15:56:50.893013 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 15:56:50.893013 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 15:56:50.893013 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: b8ab15c6ae7049e68e5bd2f1a0a709b4 Aug 31 15:56:50.893013 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin Aug 31 15:56:50.893013 n-d-850499-9 devstack@n-api.service[122256]: Aug 31 15:56:50.893013 n-d-850499-9 devstack@n-api.service[122256]: {"remove_host": {"host": "nonexist_host"}} Aug 31 15:56:50.893013 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 15:56:50.893013 n-d-850499-9 devstack@n-api.service[122256]: exception: Cannot remove host nonexist_host in aggregate 16 Aug 31 15:56:50.893886 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '16', 'body': {'remove_host': {'host': 'nonexist_host'}}} Aug 31 15:56:50.893886 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:56:50.893886 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:56:50.893886 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5997, in _get_service_in_cell_by_host Aug 31 15:56:50.893886 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 31 15:56:50.893886 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 15:56:50.893886 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 15:56:50.893886 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 31 15:56:50.893886 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 31 15:56:50.893886 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 31 15:56:50.893886 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 31 15:56:50.893886 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 31 15:56:50.893886 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 31 15:56:50.893886 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Aug 31 15:56:50.893886 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:56:50.893886 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:56:50.893886 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:56:50.893886 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:56:50.893886 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6003, in _get_service_in_cell_by_host Aug 31 15:56:50.893886 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Aug 31 15:56:50.895203 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6065, in _find_service_in_cell Aug 31 15:56:50.895203 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 31 15:56:50.895203 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 31 15:56:50.895203 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:56:50.895203 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:56:50.895203 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:56:50.895203 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:56:50.895203 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Aug 31 15:56:50.895203 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Aug 31 15:56:50.895203 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 31 15:56:50.895203 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 31 15:56:50.895203 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 15:56:50.895203 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 31 15:56:50.895203 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 15:56:50.895203 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise self.value Aug 31 15:56:50.895203 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 31 15:56:50.895203 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 31 15:56:50.895203 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6681, in remove_host_from_aggregate Aug 31 15:56:50.895203 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Aug 31 15:56:50.895203 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Aug 31 15:56:50.897647 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Aug 31 15:56:50.897647 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Aug 31 15:56:50.897647 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:56:50.897647 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:56:50.897647 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:56:50.897647 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:56:50.897647 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:56:50.897647 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:56:50.897647 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:56:50.897647 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:56:50.897647 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:56:50.897647 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:56:50.897647 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:56:50.897647 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:56:50.897647 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Aug 31 15:56:50.897647 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 31 15:56:50.897647 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 16 Aug 31 15:56:50.897647 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:56:50.897647 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:56:50.897647 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:56:50.897647 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:56:50.899243 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:56:50.899243 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:56:50.899243 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:56:50.899243 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:56:50.899243 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 16 Aug 31 15:56:50.899243 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:56:50.901479 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-48433c45-f935-4875-a1d2-91641404b881 tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 16 {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:56:50.902551 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-48433c45-f935-4875-a1d2-91641404b881 tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates/16/action" status: 404 len: 94 microversion: 2.1 time: 0.100313 Aug 31 15:56:50.904200 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 136/264] 10.222.0.61 () {60 vars in 1194 bytes} [Wed Aug 31 15:56:50 2022] POST /compute/v2.1/os-aggregates/16/action => generated 94 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 31 15:56:50.913556 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-462d457c-37d8-41ec-b78f-04849752c3c1 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:50.914201 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-1b4578ed-648e-4fc9-b8e7-d55892304e8e tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:50.914732 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-462d457c-37d8-41ec-b78f-04849752c3c1 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] [instance: f2162319-5635-4c77-920d-9ecb3221d174] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:50.924440 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-462d457c-37d8-41ec-b78f-04849752c3c1 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:50.925356 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-462d457c-37d8-41ec-b78f-04849752c3c1 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:50.925983 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-462d457c-37d8-41ec-b78f-04849752c3c1 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:50.929055 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1b4578ed-648e-4fc9-b8e7-d55892304e8e tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56" status: 200 len: 1262 microversion: 2.1 time: 0.194127 Aug 31 15:56:50.929520 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-462d457c-37d8-41ec-b78f-04849752c3c1 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:50.930063 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 129/265] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:50 2022] GET /compute/v2.1/servers/bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56 => generated 1262 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:50.930435 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-462d457c-37d8-41ec-b78f-04849752c3c1 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:50.931490 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-462d457c-37d8-41ec-b78f-04849752c3c1 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:50.943928 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b7e00fa0-9465-4c52-9cf5-7270a976a624 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1212143132_new", "availability_zone": "tempest-test_az-1935536074_new"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:56:51.018245 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b7e00fa0-9465-4c52-9cf5-7270a976a624 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:51.024071 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b7e00fa0-9465-4c52-9cf5-7270a976a624 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:51.024911 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b7e00fa0-9465-4c52-9cf5-7270a976a624 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:51.037722 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-462d457c-37d8-41ec-b78f-04849752c3c1 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:51.047930 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-462d457c-37d8-41ec-b78f-04849752c3c1 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:51.050726 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-462d457c-37d8-41ec-b78f-04849752c3c1 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:51.058187 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-462d457c-37d8-41ec-b78f-04849752c3c1 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] 10.222.0.61 "GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174" status: 200 len: 1447 microversion: 2.75 time: 0.151965 Aug 31 15:56:51.060123 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 137/266] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:56:50 2022] GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174 => generated 1447 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:56:51.067453 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b927d445-5602-4b9f-8e37-1e1d28987235 tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:51.102299 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b7e00fa0-9465-4c52-9cf5-7270a976a624 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] 10.222.0.61 "PUT /compute/v2.1/os-aggregates/17" status: 200 len: 337 microversion: 2.1 time: 0.161198 Aug 31 15:56:51.102299 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 130/267] 10.222.0.61 () {60 vars in 1173 bytes} [Wed Aug 31 15:56:50 2022] PUT /compute/v2.1/os-aggregates/17 => generated 337 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:56:51.122966 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9b6dffc3-64da-4baf-bc2f-f83365e04171 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:51.155081 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b927d445-5602-4b9f-8e37-1e1d28987235 tempest-AggregatesAdminNegativeTestJSON-1569510051 tempest-AggregatesAdminNegativeTestJSON-1569510051-project-admin] 10.222.0.61 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.093703 Aug 31 15:56:51.156972 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 138/268] 10.222.0.61 () {58 vars in 1155 bytes} [Wed Aug 31 15:56:51 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 31 15:56:51.163151 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9b6dffc3-64da-4baf-bc2f-f83365e04171 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] 10.222.0.61 "GET /compute/v2.1/os-aggregates" status: 200 len: 555 microversion: 2.1 time: 0.039410 Aug 31 15:56:51.172883 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 131/269] 10.222.0.61 () {58 vars in 1143 bytes} [Wed Aug 31 15:56:51 2022] GET /compute/v2.1/os-aggregates => generated 555 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:56:51.182872 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-58729fd4-7da4-4d69-b112-cc9f34f6fd45 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:51.243090 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-58729fd4-7da4-4d69-b112-cc9f34f6fd45 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] 10.222.0.61 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.063917 Aug 31 15:56:51.244844 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 139/270] 10.222.0.61 () {58 vars in 1155 bytes} [Wed Aug 31 15:56:51 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 31 15:56:51.256794 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-18a3eeb0-8a56-4999-8949-38e9dc18e1f3 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1179952587"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:56:51.261722 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.aggregate [None req-18a3eeb0-8a56-4999-8949-38e9dc18e1f3 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] Generated uuid a408f87d-98bb-4955-95d8-62d3ea4a1a21 for aggregate {{(pid=122257) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 31 15:56:51.321986 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-18a3eeb0-8a56-4999-8949-38e9dc18e1f3 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.071263 Aug 31 15:56:51.330195 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 132/271] 10.222.0.61 () {60 vars in 1164 bytes} [Wed Aug 31 15:56:51 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:56:51.335003 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5ce02511-fd2a-456a-b652-397140ba5498 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:51.351057 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5ce02511-fd2a-456a-b652-397140ba5498 tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] 10.222.0.61 "GET /compute/v2.1/os-aggregates" status: 200 len: 231 microversion: 2.1 time: 0.019671 Aug 31 15:56:51.354930 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 140/272] 10.222.0.61 () {58 vars in 1143 bytes} [Wed Aug 31 15:56:51 2022] GET /compute/v2.1/os-aggregates => generated 231 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:56:51.373693 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a5f41f72-c23f-47de-8986-5250e033776e tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:51.442644 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a5f41f72-c23f-47de-8986-5250e033776e tempest-AggregatesAdminTestJSON-1355413937 tempest-AggregatesAdminTestJSON-1355413937-project-admin] 10.222.0.61 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.078379 Aug 31 15:56:51.443227 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 141/273] 10.222.0.61 () {58 vars in 1155 bytes} [Wed Aug 31 15:56:51 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 31 15:56:51.465302 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b942ade3-58e0-4d46-b852-e4d48f7f139d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-737543307", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "networks": [{"uuid": "46991353-f00e-44c7-9ba5-793d81b25791"}]}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:56:51.469590 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-685e38de-a5ac-4433-a8e5-47a61a739112 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:51.470372 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-685e38de-a5ac-4433-a8e5-47a61a739112 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] [instance: 94898cf4-0065-4b87-acb5-e8d11bd1529a] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:51.485916 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-685e38de-a5ac-4433-a8e5-47a61a739112 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:51.486590 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-685e38de-a5ac-4433-a8e5-47a61a739112 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:51.487172 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-685e38de-a5ac-4433-a8e5-47a61a739112 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:51.488075 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-685e38de-a5ac-4433-a8e5-47a61a739112 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:51.492141 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-685e38de-a5ac-4433-a8e5-47a61a739112 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:51.492898 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-685e38de-a5ac-4433-a8e5-47a61a739112 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:51.517000 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-685e38de-a5ac-4433-a8e5-47a61a739112 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] HTTP exception thrown: Instance 94898cf4-0065-4b87-acb5-e8d11bd1529a could not be found. Aug 31 15:56:51.527334 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-685e38de-a5ac-4433-a8e5-47a61a739112 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Request method failure captured: Aug 31 15:56:51.527334 n-d-850499-9 devstack@n-api.service[122256]: request: DELETE /compute/v2.1/servers/94898cf4-0065-4b87-acb5-e8d11bd1529a HTTP/1.1 Aug 31 15:56:51.527334 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 15:56:51.527334 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 15:56:51.527334 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 15:56:51.527334 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 15:56:51.527334 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 15:56:51.527334 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 15:56:51.527334 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 15:56:51.527334 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 15:56:51.527334 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4SBryFy-qbZNypcrpZJQn7P--qsWMdneHJ7fIuhYrBblreBL5Wui0XnbjJ0jpjRy0UQ09bfPdMsC5apan-70Y2Ppe7QKkmYl72T8OjWNWuCeVG73VMKBXnm8nL3aM1Nr3NRtQ1h2nUBl0Oq-3hss79ya65nP47RRV3eHMUEqMJ2USc Aug 31 15:56:51.527334 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 15:56:51.527334 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 15:56:51.527334 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 15:56:51.527334 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 15:56:51.527334 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 15:56:51.527334 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 15:56:51.527334 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 8904771b5154454896715024aa20bbcd Aug 31 15:56:51.527334 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-AggregatesAdminTestJSON-1609274046 Aug 31 15:56:51.527334 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 15:56:51.527334 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 15:56:51.528666 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8904771b5154454896715024aa20bbcd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/8904771b5154454896715024aa20bbcd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_8904771b5154454896715024aa20bbcd", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8904771b5154454896715024aa20bbcd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 15:56:51.528666 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-AggregatesAdminTestJSON-1609274046 Aug 31 15:56:51.528666 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 8904771b5154454896715024aa20bbcd Aug 31 15:56:51.528666 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1609274046 Aug 31 15:56:51.528666 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-AggregatesAdminTestJSON-1609274046-project Aug 31 15:56:51.528666 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 15:56:51.528666 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 15:56:51.528666 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: dbe750fe96e2444489edce1b2750fa1e Aug 31 15:56:51.528666 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-AggregatesAdminTestJSON-1609274046-project Aug 31 15:56:51.528666 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 15:56:51.528666 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance 94898cf4-0065-4b87-acb5-e8d11bd1529a could not be found. Aug 31 15:56:51.528666 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '94898cf4-0065-4b87-acb5-e8d11bd1529a'} Aug 31 15:56:51.529325 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:56:51.529325 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:56:51.529325 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 15:56:51.529325 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 15:56:51.529325 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 15:56:51.529325 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 15:56:51.529325 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 15:56:51.529325 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 15:56:51.529325 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 15:56:51.529325 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 15:56:51.529325 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94898cf4-0065-4b87-acb5-e8d11bd1529a could not be found. Aug 31 15:56:51.529325 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:56:51.529325 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:56:51.529325 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:56:51.529325 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:56:51.529325 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:56:51.529325 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:56:51.529325 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:56:51.529325 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:56:51.529325 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:56:51.530345 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:56:51.530345 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 15:56:51.530345 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 15:56:51.530345 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 15:56:51.530345 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 15:56:51.530345 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 15:56:51.530345 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 15:56:51.530345 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 15:56:51.530345 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:56:51.530345 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94898cf4-0065-4b87-acb5-e8d11bd1529a could not be found. Aug 31 15:56:51.530345 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:56:51.530345 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:56:51.530345 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:56:51.530345 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:56:51.530345 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:56:51.530345 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:56:51.530345 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:56:51.530345 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:56:51.530345 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94898cf4-0065-4b87-acb5-e8d11bd1529a could not be found. Aug 31 15:56:51.530345 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:56:51.534918 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-685e38de-a5ac-4433-a8e5-47a61a739112 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Returning 404 to user: Instance 94898cf4-0065-4b87-acb5-e8d11bd1529a could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:56:51.536136 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-685e38de-a5ac-4433-a8e5-47a61a739112 tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] 10.222.0.61 "DELETE /compute/v2.1/servers/94898cf4-0065-4b87-acb5-e8d11bd1529a" status: 404 len: 111 microversion: 2.1 time: 0.082752 Aug 31 15:56:51.536900 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 142/274] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 15:56:51 2022] DELETE /compute/v2.1/servers/94898cf4-0065-4b87-acb5-e8d11bd1529a => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:56:51.551270 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-b942ade3-58e0-4d46-b852-e4d48f7f139d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] validate_networks() for [('46991353-f00e-44c7-9ba5-793d81b25791', None, None, None, None, None)] {{(pid=122257) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 15:56:51.551457 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7d099321-6523-46c0-813c-f346e28dba9b tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:51.552244 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7d099321-6523-46c0-813c-f346e28dba9b tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] [instance: 94898cf4-0065-4b87-acb5-e8d11bd1529a] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:51.566885 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7d099321-6523-46c0-813c-f346e28dba9b tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:51.569128 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7d099321-6523-46c0-813c-f346e28dba9b tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:51.569649 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7d099321-6523-46c0-813c-f346e28dba9b tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:51.570441 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7d099321-6523-46c0-813c-f346e28dba9b tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:51.572324 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7d099321-6523-46c0-813c-f346e28dba9b tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:51.572764 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7d099321-6523-46c0-813c-f346e28dba9b tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:51.602887 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-7d099321-6523-46c0-813c-f346e28dba9b tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] HTTP exception thrown: Instance 94898cf4-0065-4b87-acb5-e8d11bd1529a could not be found. Aug 31 15:56:51.604477 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7d099321-6523-46c0-813c-f346e28dba9b tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Request method failure captured: Aug 31 15:56:51.604477 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/94898cf4-0065-4b87-acb5-e8d11bd1529a HTTP/1.1 Aug 31 15:56:51.604477 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 15:56:51.604477 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 15:56:51.604477 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 15:56:51.604477 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 15:56:51.604477 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 15:56:51.604477 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 15:56:51.604477 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 15:56:51.604477 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 15:56:51.604477 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4SBryFy-qbZNypcrpZJQn7P--qsWMdneHJ7fIuhYrBblreBL5Wui0XnbjJ0jpjRy0UQ09bfPdMsC5apan-70Y2Ppe7QKkmYl72T8OjWNWuCeVG73VMKBXnm8nL3aM1Nr3NRtQ1h2nUBl0Oq-3hss79ya65nP47RRV3eHMUEqMJ2USc Aug 31 15:56:51.604477 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 15:56:51.604477 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 15:56:51.604477 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 15:56:51.604477 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 15:56:51.604477 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 15:56:51.604477 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 15:56:51.604477 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 8904771b5154454896715024aa20bbcd Aug 31 15:56:51.604477 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-AggregatesAdminTestJSON-1609274046 Aug 31 15:56:51.604477 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 15:56:51.604477 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 15:56:51.606041 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8904771b5154454896715024aa20bbcd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/8904771b5154454896715024aa20bbcd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_8904771b5154454896715024aa20bbcd", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8904771b5154454896715024aa20bbcd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 15:56:51.606041 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-AggregatesAdminTestJSON-1609274046 Aug 31 15:56:51.606041 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 8904771b5154454896715024aa20bbcd Aug 31 15:56:51.606041 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1609274046 Aug 31 15:56:51.606041 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-AggregatesAdminTestJSON-1609274046-project Aug 31 15:56:51.606041 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 15:56:51.606041 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 15:56:51.606041 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: dbe750fe96e2444489edce1b2750fa1e Aug 31 15:56:51.606041 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-AggregatesAdminTestJSON-1609274046-project Aug 31 15:56:51.606041 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 15:56:51.606041 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance 94898cf4-0065-4b87-acb5-e8d11bd1529a could not be found. Aug 31 15:56:51.606041 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '94898cf4-0065-4b87-acb5-e8d11bd1529a'} Aug 31 15:56:51.606899 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:56:51.606899 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:56:51.606899 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 15:56:51.606899 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 15:56:51.606899 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 15:56:51.606899 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 15:56:51.606899 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 15:56:51.606899 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 15:56:51.606899 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 15:56:51.606899 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 15:56:51.606899 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94898cf4-0065-4b87-acb5-e8d11bd1529a could not be found. Aug 31 15:56:51.606899 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:56:51.606899 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:56:51.606899 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:56:51.606899 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:56:51.606899 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:56:51.606899 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:56:51.606899 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:56:51.606899 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:56:51.606899 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:56:51.607987 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:56:51.607987 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 15:56:51.607987 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 15:56:51.607987 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 15:56:51.607987 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 15:56:51.607987 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 15:56:51.607987 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:56:51.607987 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94898cf4-0065-4b87-acb5-e8d11bd1529a could not be found. Aug 31 15:56:51.607987 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:56:51.607987 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:56:51.607987 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:56:51.607987 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:56:51.607987 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:56:51.607987 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:56:51.607987 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:56:51.607987 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:56:51.607987 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94898cf4-0065-4b87-acb5-e8d11bd1529a could not be found. Aug 31 15:56:51.607987 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:56:51.608941 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7d099321-6523-46c0-813c-f346e28dba9b tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] Returning 404 to user: Instance 94898cf4-0065-4b87-acb5-e8d11bd1529a could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:56:51.608941 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7d099321-6523-46c0-813c-f346e28dba9b tempest-AggregatesAdminTestJSON-1609274046 tempest-AggregatesAdminTestJSON-1609274046-project] 10.222.0.61 "GET /compute/v2.1/servers/94898cf4-0065-4b87-acb5-e8d11bd1529a" status: 404 len: 111 microversion: 2.1 time: 0.063886 Aug 31 15:56:51.608941 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 143/275] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:51 2022] GET /compute/v2.1/servers/94898cf4-0065-4b87-acb5-e8d11bd1529a => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:56:51.750341 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6d322065-44f5-40a0-931d-e867a4a2fb6c tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:51.750986 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6d322065-44f5-40a0-931d-e867a4a2fb6c tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] [instance: 1b233a49-d4f5-412d-8239-74df4ce63aa5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:51.760983 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6d322065-44f5-40a0-931d-e867a4a2fb6c tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:51.761485 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6d322065-44f5-40a0-931d-e867a4a2fb6c tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:51.761924 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6d322065-44f5-40a0-931d-e867a4a2fb6c tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:51.768542 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6d322065-44f5-40a0-931d-e867a4a2fb6c tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:51.769047 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6d322065-44f5-40a0-931d-e867a4a2fb6c tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:51.769488 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6d322065-44f5-40a0-931d-e867a4a2fb6c tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:52.307255 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-6d322065-44f5-40a0-931d-e867a4a2fb6c tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc04be9f46432fb954d7dbcfe53488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f665e5697c4453c872940b4c0a88772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:52.317047 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6d322065-44f5-40a0-931d-e867a4a2fb6c tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] 10.222.0.61 "GET /compute/v2.1/servers/1b233a49-d4f5-412d-8239-74df4ce63aa5" status: 200 len: 1466 microversion: 2.1 time: 0.571229 Aug 31 15:56:52.320998 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 144/276] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:51 2022] GET /compute/v2.1/servers/1b233a49-d4f5-412d-8239-74df4ce63aa5 => generated 1466 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:56:52.326730 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-853f9a3a-4f9c-4fb1-81ff-18be4f45e879 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:52.334032 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-853f9a3a-4f9c-4fb1-81ff-18be4f45e879 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:52.347981 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-853f9a3a-4f9c-4fb1-81ff-18be4f45e879 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:52.349732 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-853f9a3a-4f9c-4fb1-81ff-18be4f45e879 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:52.354614 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-853f9a3a-4f9c-4fb1-81ff-18be4f45e879 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:52.355695 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-853f9a3a-4f9c-4fb1-81ff-18be4f45e879 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:52.356424 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-853f9a3a-4f9c-4fb1-81ff-18be4f45e879 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:52.357083 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-853f9a3a-4f9c-4fb1-81ff-18be4f45e879 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:52.530503 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-b942ade3-58e0-4d46-b852-e4d48f7f139d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 15:56:52.530957 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-b942ade3-58e0-4d46-b852-e4d48f7f139d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 15:56:52.531388 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-b942ade3-58e0-4d46-b852-e4d48f7f139d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 15:56:52.532509 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-b942ade3-58e0-4d46-b852-e4d48f7f139d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 15:56:52.533094 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-b942ade3-58e0-4d46-b852-e4d48f7f139d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 15:56:52.547255 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b942ade3-58e0-4d46-b852-e4d48f7f139d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:52.552818 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b942ade3-58e0-4d46-b852-e4d48f7f139d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:52.553451 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b942ade3-58e0-4d46-b852-e4d48f7f139d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:52.554399 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b942ade3-58e0-4d46-b852-e4d48f7f139d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:52.556406 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b942ade3-58e0-4d46-b852-e4d48f7f139d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:52.557271 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b942ade3-58e0-4d46-b852-e4d48f7f139d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:52.628759 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-b942ade3-58e0-4d46-b852-e4d48f7f139d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Getting quotas for project 01a9266ba9b14c6a8b6e79aecfe86df6. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:56:52.642161 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-b942ade3-58e0-4d46-b852-e4d48f7f139d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Getting quotas for user bb8e30aa23194f898b07dfbc6fd8d5de and project 01a9266ba9b14c6a8b6e79aecfe86df6. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:56:52.686762 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-853f9a3a-4f9c-4fb1-81ff-18be4f45e879 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:52.697152 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b942ade3-58e0-4d46-b852-e4d48f7f139d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Going to run 1 instances... {{(pid=122257) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 15:56:52.700752 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-853f9a3a-4f9c-4fb1-81ff-18be4f45e879 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56" status: 200 len: 1268 microversion: 2.1 time: 0.378175 Aug 31 15:56:52.701367 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 145/277] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:52 2022] GET /compute/v2.1/servers/bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56 => generated 1268 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:52.702752 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b942ade3-58e0-4d46-b852-e4d48f7f139d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 79ee7e24-93df-450b-9030-b08c00d019eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 15:56:52.721611 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3c376fb2-4879-4a81-ba84-11cd57fc198f tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:52.722523 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3c376fb2-4879-4a81-ba84-11cd57fc198f tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] [instance: f2162319-5635-4c77-920d-9ecb3221d174] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:52.737700 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3c376fb2-4879-4a81-ba84-11cd57fc198f tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:52.739763 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3c376fb2-4879-4a81-ba84-11cd57fc198f tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:52.741237 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3c376fb2-4879-4a81-ba84-11cd57fc198f tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:52.742198 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3c376fb2-4879-4a81-ba84-11cd57fc198f tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:52.744059 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3c376fb2-4879-4a81-ba84-11cd57fc198f tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:52.750405 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3c376fb2-4879-4a81-ba84-11cd57fc198f tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:52.789673 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b942ade3-58e0-4d46-b852-e4d48f7f139d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.437501 Aug 31 15:56:52.810015 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 133/278] 10.222.0.61 () {62 vars in 1188 bytes} [Wed Aug 31 15:56:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1454 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 31 15:56:52.814401 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d9e85530-dc63-4fc8-976d-a76571d9c087 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-1562821419", "metadata": {"image_type": "test"}}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:56:52.829517 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d9e85530-dc63-4fc8-976d-a76571d9c087 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] [instance: 1b233a49-d4f5-412d-8239-74df4ce63aa5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:52.843214 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d9e85530-dc63-4fc8-976d-a76571d9c087 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:52.847492 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d9e85530-dc63-4fc8-976d-a76571d9c087 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:52.848175 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d9e85530-dc63-4fc8-976d-a76571d9c087 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:52.849148 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d9e85530-dc63-4fc8-976d-a76571d9c087 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:52.851090 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d9e85530-dc63-4fc8-976d-a76571d9c087 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:52.851748 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3c376fb2-4879-4a81-ba84-11cd57fc198f tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:52.851906 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d9e85530-dc63-4fc8-976d-a76571d9c087 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:52.865499 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3c376fb2-4879-4a81-ba84-11cd57fc198f tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:52.866100 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3c376fb2-4879-4a81-ba84-11cd57fc198f tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:52.878674 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3c376fb2-4879-4a81-ba84-11cd57fc198f tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] 10.222.0.61 "GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174" status: 200 len: 1447 microversion: 2.75 time: 0.172681 Aug 31 15:56:52.881962 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 146/279] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:56:52 2022] GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174 => generated 1447 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:56:52.894046 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d5090350-dcd4-4807-bfa6-04a5f41f10e0 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:52.894985 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d5090350-dcd4-4807-bfa6-04a5f41f10e0 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 79ee7e24-93df-450b-9030-b08c00d019eb] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:52.933472 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-d9e85530-dc63-4fc8-976d-a76571d9c087 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Getting quotas for project 6f665e5697c4453c872940b4c0a88772. Resources: dict_keys(['metadata_items']) {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:56:52.948245 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-d9e85530-dc63-4fc8-976d-a76571d9c087 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Getting quotas for user fedc04be9f46432fb954d7dbcfe53488 and project 6f665e5697c4453c872940b4c0a88772. Resources: dict_keys(['metadata_items']) {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:56:53.002766 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d5090350-dcd4-4807-bfa6-04a5f41f10e0 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:53.013152 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d5090350-dcd4-4807-bfa6-04a5f41f10e0 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:53.015175 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d5090350-dcd4-4807-bfa6-04a5f41f10e0 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:53.024866 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d5090350-dcd4-4807-bfa6-04a5f41f10e0 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/79ee7e24-93df-450b-9030-b08c00d019eb" status: 200 len: 1261 microversion: 2.25 time: 0.141226 Aug 31 15:56:53.027449 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 147/280] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:56:52 2022] GET /compute/v2.1/servers/79ee7e24-93df-450b-9030-b08c00d019eb => generated 1261 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:56:53.424761 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d9e85530-dc63-4fc8-976d-a76571d9c087 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] 10.222.0.61 "POST /compute/v2.1/servers/1b233a49-d4f5-412d-8239-74df4ce63aa5/action" status: 202 len: 0 microversion: 2.1 time: 0.618990 Aug 31 15:56:53.457693 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 134/281] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 15:56:52 2022] POST /compute/v2.1/servers/1b233a49-d4f5-412d-8239-74df4ce63aa5/action => generated 0 bytes in 649 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 31 15:56:53.463236 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6b3c3168-02b6-45e1-a8a1-7dee7cdd0817 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Calling method '.version_select at 0x7f5ae97cbee0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:53.555626 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6b3c3168-02b6-45e1-a8a1-7dee7cdd0817 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] 10.222.0.61 "GET /compute/v2.1/images/8c7686ef-2791-474b-9a88-1019551ffc49" status: 200 len: 1424 microversion: 2.1 time: 0.095690 Aug 31 15:56:53.557050 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 148/282] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 15:56:53 2022] GET /compute/v2.1/images/8c7686ef-2791-474b-9a88-1019551ffc49 => generated 1424 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:53.723528 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d9e91556-0e30-47c8-9f37-e16f599987ac tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:53.724295 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d9e91556-0e30-47c8-9f37-e16f599987ac tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:53.747572 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d9e91556-0e30-47c8-9f37-e16f599987ac tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:53.748274 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d9e91556-0e30-47c8-9f37-e16f599987ac tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:53.749607 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d9e91556-0e30-47c8-9f37-e16f599987ac tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:53.750384 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d9e91556-0e30-47c8-9f37-e16f599987ac tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:53.750847 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d9e91556-0e30-47c8-9f37-e16f599987ac tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:53.751271 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d9e91556-0e30-47c8-9f37-e16f599987ac tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:53.877606 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d9e91556-0e30-47c8-9f37-e16f599987ac tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:53.891037 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d9e91556-0e30-47c8-9f37-e16f599987ac tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56" status: 200 len: 1268 microversion: 2.1 time: 0.170613 Aug 31 15:56:53.893167 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 135/283] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:53 2022] GET /compute/v2.1/servers/bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56 => generated 1268 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:53.914392 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e934253e-bff3-45c0-af70-818477b4d3b2 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:53.915224 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e934253e-bff3-45c0-af70-818477b4d3b2 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] [instance: f2162319-5635-4c77-920d-9ecb3221d174] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:53.927584 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e934253e-bff3-45c0-af70-818477b4d3b2 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:53.928028 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e934253e-bff3-45c0-af70-818477b4d3b2 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:53.928479 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e934253e-bff3-45c0-af70-818477b4d3b2 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:53.929219 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e934253e-bff3-45c0-af70-818477b4d3b2 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:53.933983 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e934253e-bff3-45c0-af70-818477b4d3b2 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:53.936109 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e934253e-bff3-45c0-af70-818477b4d3b2 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:54.053992 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4b67232b-50e0-439e-bf16-307d9eb57d9e tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:54.054629 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4b67232b-50e0-439e-bf16-307d9eb57d9e tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 79ee7e24-93df-450b-9030-b08c00d019eb] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:54.070070 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4b67232b-50e0-439e-bf16-307d9eb57d9e tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:54.070624 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4b67232b-50e0-439e-bf16-307d9eb57d9e tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:54.071202 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4b67232b-50e0-439e-bf16-307d9eb57d9e tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:54.073586 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4b67232b-50e0-439e-bf16-307d9eb57d9e tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:54.074064 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4b67232b-50e0-439e-bf16-307d9eb57d9e tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:54.074502 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4b67232b-50e0-439e-bf16-307d9eb57d9e tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:54.259389 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e934253e-bff3-45c0-af70-818477b4d3b2 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:54.271805 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e934253e-bff3-45c0-af70-818477b4d3b2 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:54.274982 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e934253e-bff3-45c0-af70-818477b4d3b2 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:54.299859 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e934253e-bff3-45c0-af70-818477b4d3b2 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] 10.222.0.61 "GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174" status: 200 len: 1447 microversion: 2.75 time: 0.389730 Aug 31 15:56:54.318642 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 149/284] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:56:53 2022] GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174 => generated 1447 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:56:54.370815 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-4b67232b-50e0-439e-bf16-307d9eb57d9e tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:54.390281 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-4b67232b-50e0-439e-bf16-307d9eb57d9e tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:54.391841 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-4b67232b-50e0-439e-bf16-307d9eb57d9e tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:54.392990 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4b67232b-50e0-439e-bf16-307d9eb57d9e tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/79ee7e24-93df-450b-9030-b08c00d019eb" status: 200 len: 1257 microversion: 2.25 time: 0.343835 Aug 31 15:56:54.393565 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 136/285] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:56:54 2022] GET /compute/v2.1/servers/79ee7e24-93df-450b-9030-b08c00d019eb => generated 1257 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 15:56:54.571862 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-663c6dc6-6aea-498b-9297-1cc688186136 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Calling method '.version_select at 0x7f5ae9b36a60>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:54.690278 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-663c6dc6-6aea-498b-9297-1cc688186136 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] 10.222.0.61 "GET /compute/v2.1/images/8c7686ef-2791-474b-9a88-1019551ffc49" status: 200 len: 1424 microversion: 2.1 time: 0.122452 Aug 31 15:56:54.691976 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 150/286] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 15:56:54 2022] GET /compute/v2.1/images/8c7686ef-2791-474b-9a88-1019551ffc49 => generated 1424 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:54.918656 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d432973a-5fcf-45ba-99e7-2a23732152ba tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:54.918656 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d432973a-5fcf-45ba-99e7-2a23732152ba tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:54.928605 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d432973a-5fcf-45ba-99e7-2a23732152ba tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:54.929306 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d432973a-5fcf-45ba-99e7-2a23732152ba tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:54.929912 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d432973a-5fcf-45ba-99e7-2a23732152ba tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:54.930787 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d432973a-5fcf-45ba-99e7-2a23732152ba tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:54.931389 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d432973a-5fcf-45ba-99e7-2a23732152ba tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:54.935587 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d432973a-5fcf-45ba-99e7-2a23732152ba tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:55.332868 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4b730e5a-5152-4b4e-a1e2-8cba37207f36 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:55.333560 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4b730e5a-5152-4b4e-a1e2-8cba37207f36 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] [instance: f2162319-5635-4c77-920d-9ecb3221d174] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:55.360070 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4b730e5a-5152-4b4e-a1e2-8cba37207f36 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:55.360679 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4b730e5a-5152-4b4e-a1e2-8cba37207f36 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:55.361136 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4b730e5a-5152-4b4e-a1e2-8cba37207f36 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:55.361888 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4b730e5a-5152-4b4e-a1e2-8cba37207f36 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:55.362356 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4b730e5a-5152-4b4e-a1e2-8cba37207f36 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:55.362792 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4b730e5a-5152-4b4e-a1e2-8cba37207f36 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:56.122556 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-4b730e5a-5152-4b4e-a1e2-8cba37207f36 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:56.142134 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-4b730e5a-5152-4b4e-a1e2-8cba37207f36 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:56.149131 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-4b730e5a-5152-4b4e-a1e2-8cba37207f36 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:56.166321 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4b730e5a-5152-4b4e-a1e2-8cba37207f36 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] 10.222.0.61 "GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174" status: 200 len: 1447 microversion: 2.75 time: 0.839427 Aug 31 15:56:56.170374 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 151/287] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:56:55 2022] GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174 => generated 1447 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:56:56.188022 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-81abbe23-7bb3-4e81-80db-c4967b43123d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:56.197052 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-81abbe23-7bb3-4e81-80db-c4967b43123d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 79ee7e24-93df-450b-9030-b08c00d019eb] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:56.209539 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-81abbe23-7bb3-4e81-80db-c4967b43123d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:56.212664 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-81abbe23-7bb3-4e81-80db-c4967b43123d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:56.214823 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-81abbe23-7bb3-4e81-80db-c4967b43123d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:56.218179 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-81abbe23-7bb3-4e81-80db-c4967b43123d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:56.219551 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-81abbe23-7bb3-4e81-80db-c4967b43123d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:56.220583 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-81abbe23-7bb3-4e81-80db-c4967b43123d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:56.605498 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-81abbe23-7bb3-4e81-80db-c4967b43123d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:56.630504 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-81abbe23-7bb3-4e81-80db-c4967b43123d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:56.632778 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-81abbe23-7bb3-4e81-80db-c4967b43123d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:56.633939 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-81abbe23-7bb3-4e81-80db-c4967b43123d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/79ee7e24-93df-450b-9030-b08c00d019eb" status: 200 len: 1319 microversion: 2.25 time: 0.462342 Aug 31 15:56:56.640344 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 152/288] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:56:56 2022] GET /compute/v2.1/servers/79ee7e24-93df-450b-9030-b08c00d019eb => generated 1319 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:56:56.656004 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6c3c6068-8293-480c-9c91-2a5562793c34 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Calling method '.version_select at 0x7f5ae986c1f0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:56.755150 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6c3c6068-8293-480c-9c91-2a5562793c34 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] 10.222.0.61 "GET /compute/v2.1/images/8c7686ef-2791-474b-9a88-1019551ffc49" status: 200 len: 1424 microversion: 2.1 time: 0.113715 Aug 31 15:56:56.756936 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 153/289] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 15:56:56 2022] GET /compute/v2.1/images/8c7686ef-2791-474b-9a88-1019551ffc49 => generated 1424 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:56.843147 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d432973a-5fcf-45ba-99e7-2a23732152ba tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:56.888134 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d432973a-5fcf-45ba-99e7-2a23732152ba tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56" status: 200 len: 1310 microversion: 2.1 time: 1.973364 Aug 31 15:56:56.890247 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 137/290] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:54 2022] GET /compute/v2.1/servers/bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56 => generated 1310 bytes in 1982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:57.195434 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-491b9d70-b73e-46f6-9530-b3eb5b1346e3 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:57.196098 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-491b9d70-b73e-46f6-9530-b3eb5b1346e3 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] [instance: f2162319-5635-4c77-920d-9ecb3221d174] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:57.212585 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-491b9d70-b73e-46f6-9530-b3eb5b1346e3 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:57.214211 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-491b9d70-b73e-46f6-9530-b3eb5b1346e3 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:57.215151 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-491b9d70-b73e-46f6-9530-b3eb5b1346e3 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:57.219091 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-491b9d70-b73e-46f6-9530-b3eb5b1346e3 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:57.219976 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-491b9d70-b73e-46f6-9530-b3eb5b1346e3 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:57.220445 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-491b9d70-b73e-46f6-9530-b3eb5b1346e3 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:57.380505 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-491b9d70-b73e-46f6-9530-b3eb5b1346e3 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:57.393028 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-491b9d70-b73e-46f6-9530-b3eb5b1346e3 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:57.394769 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-491b9d70-b73e-46f6-9530-b3eb5b1346e3 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:57.404964 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=5,nova_api:DELETE=11 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:56:57.423160 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-491b9d70-b73e-46f6-9530-b3eb5b1346e3 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] 10.222.0.61 "GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174" status: 200 len: 1447 microversion: 2.75 time: 0.231606 Aug 31 15:56:57.427269 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 154/291] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:56:57 2022] GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174 => generated 1447 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:56:57.666418 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2d6bf069-69aa-4dec-910d-3603c651a250 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:57.667717 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2d6bf069-69aa-4dec-910d-3603c651a250 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 79ee7e24-93df-450b-9030-b08c00d019eb] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:57.679325 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2d6bf069-69aa-4dec-910d-3603c651a250 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:57.684163 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2d6bf069-69aa-4dec-910d-3603c651a250 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:57.685143 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2d6bf069-69aa-4dec-910d-3603c651a250 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:57.686005 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2d6bf069-69aa-4dec-910d-3603c651a250 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:57.686551 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2d6bf069-69aa-4dec-910d-3603c651a250 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:57.686979 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2d6bf069-69aa-4dec-910d-3603c651a250 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:57.780405 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a8d0ef98-8680-4115-93b9-a2133974ba91 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Calling method '.version_select at 0x7f5aea80e5e0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:57.867985 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a8d0ef98-8680-4115-93b9-a2133974ba91 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] 10.222.0.61 "GET /compute/v2.1/images/8c7686ef-2791-474b-9a88-1019551ffc49" status: 200 len: 1424 microversion: 2.1 time: 0.099802 Aug 31 15:56:57.868833 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 155/292] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 15:56:57 2022] GET /compute/v2.1/images/8c7686ef-2791-474b-9a88-1019551ffc49 => generated 1424 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:57.913815 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b0bd6c85-5872-4d22-9378-1e6a15318ab5 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:57.914675 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b0bd6c85-5872-4d22-9378-1e6a15318ab5 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:57.930321 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b0bd6c85-5872-4d22-9378-1e6a15318ab5 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:57.930853 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b0bd6c85-5872-4d22-9378-1e6a15318ab5 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:57.931584 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b0bd6c85-5872-4d22-9378-1e6a15318ab5 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:57.932336 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b0bd6c85-5872-4d22-9378-1e6a15318ab5 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:57.932812 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b0bd6c85-5872-4d22-9378-1e6a15318ab5 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:57.933324 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b0bd6c85-5872-4d22-9378-1e6a15318ab5 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:58.241634 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2d6bf069-69aa-4dec-910d-3603c651a250 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:58.257045 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2d6bf069-69aa-4dec-910d-3603c651a250 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:58.263659 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2d6bf069-69aa-4dec-910d-3603c651a250 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:58.265833 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2d6bf069-69aa-4dec-910d-3603c651a250 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/79ee7e24-93df-450b-9030-b08c00d019eb" status: 200 len: 1361 microversion: 2.25 time: 0.604520 Aug 31 15:56:58.289712 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 138/293] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:56:57 2022] GET /compute/v2.1/servers/79ee7e24-93df-450b-9030-b08c00d019eb => generated 1361 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:56:58.362481 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-559889f5-2caf-487c-8ecd-52d9681d16d3 req-dc7e4b5a-d224-4ca4-8f9d-721a4383bd9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56", "tag": "2b648b75-ab1e-4141-bc80-3cbc9b5b261b"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:56:58.377215 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-559889f5-2caf-487c-8ecd-52d9681d16d3 req-dc7e4b5a-d224-4ca4-8f9d-721a4383bd9c service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:58.377699 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-559889f5-2caf-487c-8ecd-52d9681d16d3 req-dc7e4b5a-d224-4ca4-8f9d-721a4383bd9c service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:58.386343 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-559889f5-2caf-487c-8ecd-52d9681d16d3 req-dc7e4b5a-d224-4ca4-8f9d-721a4383bd9c service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:58.403273 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-559889f5-2caf-487c-8ecd-52d9681d16d3 req-dc7e4b5a-d224-4ca4-8f9d-721a4383bd9c service nova] Creating event network-changed:2b648b75-ab1e-4141-bc80-3cbc9b5b261b for instance bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56 on n-h1-850499-9 Aug 31 15:56:58.419748 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b0bd6c85-5872-4d22-9378-1e6a15318ab5 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:58.424071 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-559889f5-2caf-487c-8ecd-52d9681d16d3 req-dc7e4b5a-d224-4ca4-8f9d-721a4383bd9c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064517 Aug 31 15:56:58.424916 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 139/294] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 15:56:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:56:58.430450 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b0bd6c85-5872-4d22-9378-1e6a15318ab5 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56" status: 200 len: 1310 microversion: 2.1 time: 0.520792 Aug 31 15:56:58.431053 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 156/295] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:57 2022] GET /compute/v2.1/servers/bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56 => generated 1310 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:56:58.467105 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a5ffedbd-ad1d-471f-a2d3-9edcb27d249c tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:58.467757 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a5ffedbd-ad1d-471f-a2d3-9edcb27d249c tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] [instance: f2162319-5635-4c77-920d-9ecb3221d174] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:58.476309 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a5ffedbd-ad1d-471f-a2d3-9edcb27d249c tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:58.477016 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a5ffedbd-ad1d-471f-a2d3-9edcb27d249c tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:58.477657 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a5ffedbd-ad1d-471f-a2d3-9edcb27d249c tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:58.478563 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a5ffedbd-ad1d-471f-a2d3-9edcb27d249c tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:58.479218 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a5ffedbd-ad1d-471f-a2d3-9edcb27d249c tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:58.479868 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a5ffedbd-ad1d-471f-a2d3-9edcb27d249c tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:58.507880 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=100 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:56:58.654727 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a5ffedbd-ad1d-471f-a2d3-9edcb27d249c tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:58.665584 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a5ffedbd-ad1d-471f-a2d3-9edcb27d249c tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:58.668182 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a5ffedbd-ad1d-471f-a2d3-9edcb27d249c tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:58.674793 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a5ffedbd-ad1d-471f-a2d3-9edcb27d249c tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] 10.222.0.61 "GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174" status: 200 len: 1447 microversion: 2.75 time: 0.216045 Aug 31 15:56:58.676164 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 157/296] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:56:58 2022] GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174 => generated 1447 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:56:58.884748 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-fe1c98bd-3148-4b3c-8eeb-ecbf25bf0acb tempest-AZAdminV2TestJSON-1516206747 tempest-AZAdminV2TestJSON-1516206747-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:58.888987 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-25999167-f46a-45da-80a8-afd443e975fe tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Calling method '.version_select at 0x7f5ae9a48280>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:58.892492 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fe1c98bd-3148-4b3c-8eeb-ecbf25bf0acb tempest-AZAdminV2TestJSON-1516206747 tempest-AZAdminV2TestJSON-1516206747-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:58.894284 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fe1c98bd-3148-4b3c-8eeb-ecbf25bf0acb tempest-AZAdminV2TestJSON-1516206747 tempest-AZAdminV2TestJSON-1516206747-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:58.894284 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fe1c98bd-3148-4b3c-8eeb-ecbf25bf0acb tempest-AZAdminV2TestJSON-1516206747 tempest-AZAdminV2TestJSON-1516206747-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:58.898797 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fe1c98bd-3148-4b3c-8eeb-ecbf25bf0acb tempest-AZAdminV2TestJSON-1516206747 tempest-AZAdminV2TestJSON-1516206747-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:58.899989 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fe1c98bd-3148-4b3c-8eeb-ecbf25bf0acb tempest-AZAdminV2TestJSON-1516206747 tempest-AZAdminV2TestJSON-1516206747-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:58.901675 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fe1c98bd-3148-4b3c-8eeb-ecbf25bf0acb tempest-AZAdminV2TestJSON-1516206747 tempest-AZAdminV2TestJSON-1516206747-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:58.979385 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-25999167-f46a-45da-80a8-afd443e975fe tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] 10.222.0.61 "GET /compute/v2.1/images/8c7686ef-2791-474b-9a88-1019551ffc49" status: 200 len: 1424 microversion: 2.1 time: 0.100601 Aug 31 15:56:58.983541 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 158/297] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 15:56:58 2022] GET /compute/v2.1/images/8c7686ef-2791-474b-9a88-1019551ffc49 => generated 1424 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:58.993422 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-fe1c98bd-3148-4b3c-8eeb-ecbf25bf0acb tempest-AZAdminV2TestJSON-1516206747 tempest-AZAdminV2TestJSON-1516206747-project-admin] 10.222.0.61 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.546909 Aug 31 15:56:58.994608 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 140/298] 10.222.0.61 () {58 vars in 1164 bytes} [Wed Aug 31 15:56:58 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 15:56:59.009660 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-dd85e658-291f-4aa8-bd6a-7364ad8fee75 tempest-AZAdminV2TestJSON-1516206747 tempest-AZAdminV2TestJSON-1516206747-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:59.015773 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dd85e658-291f-4aa8-bd6a-7364ad8fee75 tempest-AZAdminV2TestJSON-1516206747 tempest-AZAdminV2TestJSON-1516206747-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:59.017361 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dd85e658-291f-4aa8-bd6a-7364ad8fee75 tempest-AZAdminV2TestJSON-1516206747 tempest-AZAdminV2TestJSON-1516206747-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:59.017833 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dd85e658-291f-4aa8-bd6a-7364ad8fee75 tempest-AZAdminV2TestJSON-1516206747 tempest-AZAdminV2TestJSON-1516206747-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:59.018646 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dd85e658-291f-4aa8-bd6a-7364ad8fee75 tempest-AZAdminV2TestJSON-1516206747 tempest-AZAdminV2TestJSON-1516206747-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:59.019118 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dd85e658-291f-4aa8-bd6a-7364ad8fee75 tempest-AZAdminV2TestJSON-1516206747 tempest-AZAdminV2TestJSON-1516206747-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:59.028752 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dd85e658-291f-4aa8-bd6a-7364ad8fee75 tempest-AZAdminV2TestJSON-1516206747 tempest-AZAdminV2TestJSON-1516206747-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:59.056463 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-dd85e658-291f-4aa8-bd6a-7364ad8fee75 tempest-AZAdminV2TestJSON-1516206747 tempest-AZAdminV2TestJSON-1516206747-project-admin] 10.222.0.61 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.053172 Aug 31 15:56:59.057660 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 159/299] 10.222.0.61 () {58 vars in 1185 bytes} [Wed Aug 31 15:56:59 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:56:59.293425 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1040ebbe-e5a6-4177-addd-cab240741261 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:59.295092 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1040ebbe-e5a6-4177-addd-cab240741261 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 79ee7e24-93df-450b-9030-b08c00d019eb] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:59.306397 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1040ebbe-e5a6-4177-addd-cab240741261 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:59.309506 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1040ebbe-e5a6-4177-addd-cab240741261 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:59.310182 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1040ebbe-e5a6-4177-addd-cab240741261 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:59.311422 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1040ebbe-e5a6-4177-addd-cab240741261 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:59.313887 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1040ebbe-e5a6-4177-addd-cab240741261 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:59.314859 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1040ebbe-e5a6-4177-addd-cab240741261 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:59.364868 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:56:59.460665 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-977702b2-9353-4afe-9a2b-dfeaafbf25c6 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:59.461415 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-977702b2-9353-4afe-9a2b-dfeaafbf25c6 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:59.474075 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-977702b2-9353-4afe-9a2b-dfeaafbf25c6 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:59.477909 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-977702b2-9353-4afe-9a2b-dfeaafbf25c6 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:59.486853 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-977702b2-9353-4afe-9a2b-dfeaafbf25c6 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:59.492828 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-977702b2-9353-4afe-9a2b-dfeaafbf25c6 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:59.493571 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-977702b2-9353-4afe-9a2b-dfeaafbf25c6 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:59.494476 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-977702b2-9353-4afe-9a2b-dfeaafbf25c6 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:00.258698 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-1040ebbe-e5a6-4177-addd-cab240741261 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:00.272019 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-1040ebbe-e5a6-4177-addd-cab240741261 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:00.274384 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-1040ebbe-e5a6-4177-addd-cab240741261 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:00.276190 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1040ebbe-e5a6-4177-addd-cab240741261 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/79ee7e24-93df-450b-9030-b08c00d019eb" status: 200 len: 1361 microversion: 2.25 time: 0.989423 Aug 31 15:57:00.277706 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 141/300] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:56:59 2022] GET /compute/v2.1/servers/79ee7e24-93df-450b-9030-b08c00d019eb => generated 1361 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:57:00.301388 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-439db0a7-6399-478c-a885-36973dd585c6 req-3d3477bb-cd4a-4ae0-86e9-9b2f8443cf54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79ee7e24-93df-450b-9030-b08c00d019eb", "tag": "a2a2e771-f0ba-4149-867f-67716bfa9d07"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:57:00.307233 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-977702b2-9353-4afe-9a2b-dfeaafbf25c6 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:00.314537 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-439db0a7-6399-478c-a885-36973dd585c6 req-3d3477bb-cd4a-4ae0-86e9-9b2f8443cf54 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:00.315024 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-439db0a7-6399-478c-a885-36973dd585c6 req-3d3477bb-cd4a-4ae0-86e9-9b2f8443cf54 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:00.315840 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-439db0a7-6399-478c-a885-36973dd585c6 req-3d3477bb-cd4a-4ae0-86e9-9b2f8443cf54 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:00.325238 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-977702b2-9353-4afe-9a2b-dfeaafbf25c6 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56" status: 200 len: 1310 microversion: 2.1 time: 0.869870 Aug 31 15:57:00.328988 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 160/301] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:59 2022] GET /compute/v2.1/servers/bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56 => generated 1310 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:00.342846 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-439db0a7-6399-478c-a885-36973dd585c6 req-3d3477bb-cd4a-4ae0-86e9-9b2f8443cf54 service nova] Creating event network-changed:a2a2e771-f0ba-4149-867f-67716bfa9d07 for instance 79ee7e24-93df-450b-9030-b08c00d019eb on n-h1-850499-9 Aug 31 15:57:00.350382 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-439db0a7-6399-478c-a885-36973dd585c6 req-3d3477bb-cd4a-4ae0-86e9-9b2f8443cf54 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070816 Aug 31 15:57:00.354036 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3e98567f-899a-43fd-86f3-4794325a41ff tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:00.356681 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 142/302] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 15:57:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:57:00.357408 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3e98567f-899a-43fd-86f3-4794325a41ff tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] [instance: f2162319-5635-4c77-920d-9ecb3221d174] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:00.364415 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2e9b238d-bb5d-4163-bd59-4fe2c472c1b0 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Calling method '.version_select at 0x7f5ae974a940>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:00.369991 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3e98567f-899a-43fd-86f3-4794325a41ff tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:00.370491 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3e98567f-899a-43fd-86f3-4794325a41ff tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:00.373444 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3e98567f-899a-43fd-86f3-4794325a41ff tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:00.374164 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3e98567f-899a-43fd-86f3-4794325a41ff tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:00.375348 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3e98567f-899a-43fd-86f3-4794325a41ff tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:00.377506 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3e98567f-899a-43fd-86f3-4794325a41ff tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:00.438334 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2e9b238d-bb5d-4163-bd59-4fe2c472c1b0 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] 10.222.0.61 "GET /compute/v2.1/images/8c7686ef-2791-474b-9a88-1019551ffc49" status: 200 len: 1424 microversion: 2.1 time: 0.078756 Aug 31 15:57:00.439855 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 143/303] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 15:57:00 2022] GET /compute/v2.1/images/8c7686ef-2791-474b-9a88-1019551ffc49 => generated 1424 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:00.481683 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3e98567f-899a-43fd-86f3-4794325a41ff tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:00.490450 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3e98567f-899a-43fd-86f3-4794325a41ff tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:00.491948 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3e98567f-899a-43fd-86f3-4794325a41ff tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:00.498347 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3e98567f-899a-43fd-86f3-4794325a41ff tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] 10.222.0.61 "GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174" status: 200 len: 1447 microversion: 2.75 time: 0.154492 Aug 31 15:57:00.498921 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 161/304] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:00 2022] GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174 => generated 1447 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:57:01.086102 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-54bb99a8-404b-4022-bac4-c215f6805893 req-c34f63be-0d6a-4bb7-8cff-b6a817958f5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b233a49-d4f5-412d-8239-74df4ce63aa5", "name": "network-vif-plugged", "status": "completed", "tag": "f56ba330-3206-4322-9474-e01afa8afef9"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:57:01.141979 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-179ad6a7-a019-44a1-a870-051c0dfa934f tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1003246259", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:57:01.152321 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-54bb99a8-404b-4022-bac4-c215f6805893 req-c34f63be-0d6a-4bb7-8cff-b6a817958f5b service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:01.152845 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-54bb99a8-404b-4022-bac4-c215f6805893 req-c34f63be-0d6a-4bb7-8cff-b6a817958f5b service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:01.153279 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-54bb99a8-404b-4022-bac4-c215f6805893 req-c34f63be-0d6a-4bb7-8cff-b6a817958f5b service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:01.173601 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-54bb99a8-404b-4022-bac4-c215f6805893 req-c34f63be-0d6a-4bb7-8cff-b6a817958f5b service nova] Creating event network-vif-plugged:f56ba330-3206-4322-9474-e01afa8afef9 for instance 1b233a49-d4f5-412d-8239-74df4ce63aa5 on n-h1-850499-9 Aug 31 15:57:01.183262 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-54bb99a8-404b-4022-bac4-c215f6805893 req-c34f63be-0d6a-4bb7-8cff-b6a817958f5b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102194 Aug 31 15:57:01.185398 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 162/305] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 15:57:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:57:01.234334 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-179ad6a7-a019-44a1-a870-051c0dfa934f tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] validate_networks() for None {{(pid=122257) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 15:57:01.308127 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a1715ffb-e8f3-4a34-9fef-62119cc60366 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:01.310081 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a1715ffb-e8f3-4a34-9fef-62119cc60366 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 79ee7e24-93df-450b-9030-b08c00d019eb] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:01.321661 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a1715ffb-e8f3-4a34-9fef-62119cc60366 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:01.322601 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a1715ffb-e8f3-4a34-9fef-62119cc60366 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:01.323142 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a1715ffb-e8f3-4a34-9fef-62119cc60366 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:01.324036 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a1715ffb-e8f3-4a34-9fef-62119cc60366 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:01.324718 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a1715ffb-e8f3-4a34-9fef-62119cc60366 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:01.325357 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a1715ffb-e8f3-4a34-9fef-62119cc60366 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:01.569673 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a1715ffb-e8f3-4a34-9fef-62119cc60366 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:01.579225 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a1715ffb-e8f3-4a34-9fef-62119cc60366 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:01.580977 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a1715ffb-e8f3-4a34-9fef-62119cc60366 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:01.582756 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a1715ffb-e8f3-4a34-9fef-62119cc60366 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/79ee7e24-93df-450b-9030-b08c00d019eb" status: 200 len: 1361 microversion: 2.25 time: 0.281830 Aug 31 15:57:01.596258 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 163/306] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:01 2022] GET /compute/v2.1/servers/79ee7e24-93df-450b-9030-b08c00d019eb => generated 1361 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:57:01.607608 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ee07bd8e-66df-41a6-bdad-eafa14dd5daf tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:01.613000 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ee07bd8e-66df-41a6-bdad-eafa14dd5daf tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:01.619752 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ee07bd8e-66df-41a6-bdad-eafa14dd5daf tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:01.620483 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ee07bd8e-66df-41a6-bdad-eafa14dd5daf tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:01.621078 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ee07bd8e-66df-41a6-bdad-eafa14dd5daf tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:01.621969 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ee07bd8e-66df-41a6-bdad-eafa14dd5daf tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:01.622750 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ee07bd8e-66df-41a6-bdad-eafa14dd5daf tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:01.623538 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ee07bd8e-66df-41a6-bdad-eafa14dd5daf tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:01.657915 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-179ad6a7-a019-44a1-a870-051c0dfa934f tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 15:57:01.658383 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-179ad6a7-a019-44a1-a870-051c0dfa934f tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 15:57:01.659292 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-179ad6a7-a019-44a1-a870-051c0dfa934f tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 15:57:01.659979 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-179ad6a7-a019-44a1-a870-051c0dfa934f tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 15:57:01.660725 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-179ad6a7-a019-44a1-a870-051c0dfa934f tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 15:57:01.693830 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-179ad6a7-a019-44a1-a870-051c0dfa934f tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:01.696654 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-179ad6a7-a019-44a1-a870-051c0dfa934f tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:01.697141 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-179ad6a7-a019-44a1-a870-051c0dfa934f tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:01.697948 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-179ad6a7-a019-44a1-a870-051c0dfa934f tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:01.698424 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-179ad6a7-a019-44a1-a870-051c0dfa934f tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:01.698852 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-179ad6a7-a019-44a1-a870-051c0dfa934f tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:01.724783 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-179ad6a7-a019-44a1-a870-051c0dfa934f tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Getting quotas for project 8dd5a49a78854f22aa3c58d01058e493. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:57:01.730331 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-179ad6a7-a019-44a1-a870-051c0dfa934f tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Getting quotas for user fd1dfe05c037461d8dfb45a6f611ced0 and project 8dd5a49a78854f22aa3c58d01058e493. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:57:01.758052 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-179ad6a7-a019-44a1-a870-051c0dfa934f tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Going to run 1 instances... {{(pid=122257) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 15:57:01.764422 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-179ad6a7-a019-44a1-a870-051c0dfa934f tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] [instance: e1ca7a75-7b25-4465-b3f4-3f4d5269c723] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 15:57:01.779872 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:DELETE=2,nova_api:SELECT=89,nova_api:INSERT=7,nova_api:UPDATE=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:57:01.833753 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-179ad6a7-a019-44a1-a870-051c0dfa934f tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.862839 Aug 31 15:57:01.835010 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 144/307] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 15:57:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 865 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 15:57:01.846231 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-049476ca-a26f-421f-a3c2-2d02ffe1ceb1 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Calling method '.version_select at 0x7f5ae9837e50>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:01.943883 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-049476ca-a26f-421f-a3c2-2d02ffe1ceb1 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] 10.222.0.61 "GET /compute/v2.1/images/8c7686ef-2791-474b-9a88-1019551ffc49" status: 200 len: 1424 microversion: 2.1 time: 0.107195 Aug 31 15:57:01.944592 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 145/308] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 15:57:01 2022] GET /compute/v2.1/images/8c7686ef-2791-474b-9a88-1019551ffc49 => generated 1424 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:01.953190 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9fdc9df4-673d-4fed-8f4e-b579426ceaf0 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:01.953985 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9fdc9df4-673d-4fed-8f4e-b579426ceaf0 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] [instance: f2162319-5635-4c77-920d-9ecb3221d174] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:01.973693 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9fdc9df4-673d-4fed-8f4e-b579426ceaf0 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:01.974369 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9fdc9df4-673d-4fed-8f4e-b579426ceaf0 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:01.974968 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9fdc9df4-673d-4fed-8f4e-b579426ceaf0 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:01.975916 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9fdc9df4-673d-4fed-8f4e-b579426ceaf0 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:01.976710 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9fdc9df4-673d-4fed-8f4e-b579426ceaf0 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:01.978336 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9fdc9df4-673d-4fed-8f4e-b579426ceaf0 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:02.146306 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9fdc9df4-673d-4fed-8f4e-b579426ceaf0 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:02.161711 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9fdc9df4-673d-4fed-8f4e-b579426ceaf0 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:02.166014 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9fdc9df4-673d-4fed-8f4e-b579426ceaf0 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:02.180101 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9fdc9df4-673d-4fed-8f4e-b579426ceaf0 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] 10.222.0.61 "GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174" status: 200 len: 1447 microversion: 2.75 time: 0.233274 Aug 31 15:57:02.186013 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 146/309] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:01 2022] GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174 => generated 1447 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:57:02.214498 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f135af63-30d7-4f28-9698-151cd0b776b6 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:02.219180 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f135af63-30d7-4f28-9698-151cd0b776b6 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] [instance: e1ca7a75-7b25-4465-b3f4-3f4d5269c723] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:02.242521 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ee07bd8e-66df-41a6-bdad-eafa14dd5daf tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:02.251536 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ee07bd8e-66df-41a6-bdad-eafa14dd5daf tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56" status: 200 len: 1310 microversion: 2.1 time: 0.648765 Aug 31 15:57:02.259131 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 164/310] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:01 2022] GET /compute/v2.1/servers/bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56 => generated 1310 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:02.562883 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f135af63-30d7-4f28-9698-151cd0b776b6 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd1dfe05c037461d8dfb45a6f611ced0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd5a49a78854f22aa3c58d01058e493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:02.592979 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f135af63-30d7-4f28-9698-151cd0b776b6 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] 10.222.0.61 "GET /compute/v2.1/servers/e1ca7a75-7b25-4465-b3f4-3f4d5269c723" status: 200 len: 1220 microversion: 2.1 time: 0.402163 Aug 31 15:57:02.598236 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 147/311] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:02 2022] GET /compute/v2.1/servers/e1ca7a75-7b25-4465-b3f4-3f4d5269c723 => generated 1220 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:02.611788 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-55eaf6d0-ef12-4b97-8033-38a022e737fb tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:02.612406 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-55eaf6d0-ef12-4b97-8033-38a022e737fb tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 79ee7e24-93df-450b-9030-b08c00d019eb] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:02.631287 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-55eaf6d0-ef12-4b97-8033-38a022e737fb tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:02.631835 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-55eaf6d0-ef12-4b97-8033-38a022e737fb tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:02.632277 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-55eaf6d0-ef12-4b97-8033-38a022e737fb tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:02.633214 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-55eaf6d0-ef12-4b97-8033-38a022e737fb tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:02.633861 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-55eaf6d0-ef12-4b97-8033-38a022e737fb tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:02.634520 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-55eaf6d0-ef12-4b97-8033-38a022e737fb tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:02.960080 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8ae7a956-d095-4376-a626-9c2a238d3dbb tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Calling method '.version_select at 0x7f5ae9777c10>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:03.007562 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:57:03.081219 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8ae7a956-d095-4376-a626-9c2a238d3dbb tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] 10.222.0.61 "GET /compute/v2.1/images/8c7686ef-2791-474b-9a88-1019551ffc49" status: 200 len: 1424 microversion: 2.1 time: 0.125231 Aug 31 15:57:03.082052 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 148/312] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 15:57:02 2022] GET /compute/v2.1/images/8c7686ef-2791-474b-9a88-1019551ffc49 => generated 1424 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:57:03.220323 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f73a7821-ee1a-4ab7-abb1-05097e08318d tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:03.222001 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f73a7821-ee1a-4ab7-abb1-05097e08318d tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] [instance: f2162319-5635-4c77-920d-9ecb3221d174] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:03.244715 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f73a7821-ee1a-4ab7-abb1-05097e08318d tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:03.245489 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f73a7821-ee1a-4ab7-abb1-05097e08318d tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:03.251773 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f73a7821-ee1a-4ab7-abb1-05097e08318d tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:03.254952 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f73a7821-ee1a-4ab7-abb1-05097e08318d tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:03.255704 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f73a7821-ee1a-4ab7-abb1-05097e08318d tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:03.258459 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f73a7821-ee1a-4ab7-abb1-05097e08318d tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:03.317567 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-55eaf6d0-ef12-4b97-8033-38a022e737fb tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:03.332513 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-55eaf6d0-ef12-4b97-8033-38a022e737fb tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:03.333994 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-55eaf6d0-ef12-4b97-8033-38a022e737fb tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:03.345730 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-55eaf6d0-ef12-4b97-8033-38a022e737fb tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/79ee7e24-93df-450b-9030-b08c00d019eb" status: 200 len: 1361 microversion: 2.25 time: 0.740745 Aug 31 15:57:03.346333 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 165/313] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:02 2022] GET /compute/v2.1/servers/79ee7e24-93df-450b-9030-b08c00d019eb => generated 1361 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:57:03.377464 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-cbf18e36-06f9-4875-956b-266d6f020fbf tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:03.378089 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-cbf18e36-06f9-4875-956b-266d6f020fbf tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:03.418446 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cbf18e36-06f9-4875-956b-266d6f020fbf tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:03.420819 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cbf18e36-06f9-4875-956b-266d6f020fbf tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:03.423031 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cbf18e36-06f9-4875-956b-266d6f020fbf tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:03.424515 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cbf18e36-06f9-4875-956b-266d6f020fbf tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:03.426702 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cbf18e36-06f9-4875-956b-266d6f020fbf tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:03.427378 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cbf18e36-06f9-4875-956b-266d6f020fbf tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:03.615862 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f73a7821-ee1a-4ab7-abb1-05097e08318d tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:03.647236 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f73a7821-ee1a-4ab7-abb1-05097e08318d tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:03.651861 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f73a7821-ee1a-4ab7-abb1-05097e08318d tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:03.665402 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f73a7821-ee1a-4ab7-abb1-05097e08318d tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] 10.222.0.61 "GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174" status: 200 len: 1453 microversion: 2.75 time: 0.450889 Aug 31 15:57:03.667714 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 149/314] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:03 2022] GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174 => generated 1453 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:57:03.683268 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-76ffbba3-bc51-4805-9125-33277ad210c2 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:03.685513 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-76ffbba3-bc51-4805-9125-33277ad210c2 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] [instance: e1ca7a75-7b25-4465-b3f4-3f4d5269c723] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:03.697797 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-76ffbba3-bc51-4805-9125-33277ad210c2 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:03.700309 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-76ffbba3-bc51-4805-9125-33277ad210c2 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:03.701765 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-76ffbba3-bc51-4805-9125-33277ad210c2 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:03.704485 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-76ffbba3-bc51-4805-9125-33277ad210c2 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:03.706956 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-76ffbba3-bc51-4805-9125-33277ad210c2 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:03.708019 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-76ffbba3-bc51-4805-9125-33277ad210c2 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:03.924748 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-76ffbba3-bc51-4805-9125-33277ad210c2 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd1dfe05c037461d8dfb45a6f611ced0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd5a49a78854f22aa3c58d01058e493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:03.944420 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-76ffbba3-bc51-4805-9125-33277ad210c2 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] 10.222.0.61 "GET /compute/v2.1/servers/e1ca7a75-7b25-4465-b3f4-3f4d5269c723" status: 200 len: 1224 microversion: 2.1 time: 0.272992 Aug 31 15:57:03.952253 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 150/315] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:03 2022] GET /compute/v2.1/servers/e1ca7a75-7b25-4465-b3f4-3f4d5269c723 => generated 1224 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:04.021626 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-cbf18e36-06f9-4875-956b-266d6f020fbf tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:04.031948 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-cbf18e36-06f9-4875-956b-266d6f020fbf tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56" status: 200 len: 1310 microversion: 2.1 time: 0.668548 Aug 31 15:57:04.049000 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 166/316] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:03 2022] GET /compute/v2.1/servers/bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56 => generated 1310 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:04.097104 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-dd970680-f530-4cbc-b7ac-7b10e29765e6 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Calling method '.version_select at 0x7f5ae99ac040>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:04.163896 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-dd970680-f530-4cbc-b7ac-7b10e29765e6 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] 10.222.0.61 "GET /compute/v2.1/images/8c7686ef-2791-474b-9a88-1019551ffc49" status: 200 len: 1424 microversion: 2.1 time: 0.070476 Aug 31 15:57:04.165110 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 151/317] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 15:57:04 2022] GET /compute/v2.1/images/8c7686ef-2791-474b-9a88-1019551ffc49 => generated 1424 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:04.377413 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3497863a-8583-4048-9cd1-93924975c612 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:04.378372 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3497863a-8583-4048-9cd1-93924975c612 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 79ee7e24-93df-450b-9030-b08c00d019eb] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:04.390066 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3497863a-8583-4048-9cd1-93924975c612 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:04.390924 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3497863a-8583-4048-9cd1-93924975c612 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:04.391371 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3497863a-8583-4048-9cd1-93924975c612 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:04.392125 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3497863a-8583-4048-9cd1-93924975c612 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:04.392590 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3497863a-8583-4048-9cd1-93924975c612 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:04.393022 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3497863a-8583-4048-9cd1-93924975c612 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:04.741102 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1d8aed82-5e73-40f6-8232-beeab9ef81a1 tempest-AZAdminNegativeTestJSON-1230346278 tempest-AZAdminNegativeTestJSON-1230346278-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:04.744601 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-1d8aed82-5e73-40f6-8232-beeab9ef81a1 tempest-AZAdminNegativeTestJSON-1230346278 tempest-AZAdminNegativeTestJSON-1230346278-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '1dc2c3973b4e4d55948f31bb84bdc97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5346de38d2904a80be0ce02415097c95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:04.748729 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1d8aed82-5e73-40f6-8232-beeab9ef81a1 tempest-AZAdminNegativeTestJSON-1230346278 tempest-AZAdminNegativeTestJSON-1230346278-project] Request method failure captured: Aug 31 15:57:04.748729 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Aug 31 15:57:04.748729 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 15:57:04.748729 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 15:57:04.748729 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 15:57:04.748729 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 15:57:04.748729 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 15:57:04.748729 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 15:57:04.748729 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 15:57:04.748729 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 15:57:04.748729 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4TPcSvuAR2o57hSgxQQawuMJUVlPb9-eTBawXABloZFqE-TugB3U48pMmWkO-ABaFbZdFygr_h7nOr40mPnx_m9f4oZbQCREzhr4DihU8ORmy5Un6GI4M6gZ2kkO9oG58oOxUQV7D6lbMwAFDa0_WvlcSHiM8mo8sHg9X9QdVwmGhk Aug 31 15:57:04.748729 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 15:57:04.748729 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 15:57:04.748729 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 15:57:04.748729 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 15:57:04.748729 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 15:57:04.748729 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 15:57:04.748729 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 5346de38d2904a80be0ce02415097c95 Aug 31 15:57:04.748729 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-AZAdminNegativeTestJSON-1230346278 Aug 31 15:57:04.748729 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 15:57:04.748729 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 15:57:04.750015 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5346de38d2904a80be0ce02415097c95"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5346de38d2904a80be0ce02415097c95"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5346de38d2904a80be0ce02415097c95", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5346de38d2904a80be0ce02415097c95"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 15:57:04.750015 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-AZAdminNegativeTestJSON-1230346278 Aug 31 15:57:04.750015 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 5346de38d2904a80be0ce02415097c95 Aug 31 15:57:04.750015 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-1230346278 Aug 31 15:57:04.750015 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-AZAdminNegativeTestJSON-1230346278-project Aug 31 15:57:04.750015 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 15:57:04.750015 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 15:57:04.750015 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 1dc2c3973b4e4d55948f31bb84bdc97d Aug 31 15:57:04.750015 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-AZAdminNegativeTestJSON-1230346278-project Aug 31 15:57:04.750015 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 15:57:04.750015 n-d-850499-9 devstack@n-api.service[122257]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 31 15:57:04.750015 n-d-850499-9 devstack@n-api.service[122257]: action_args: {} Aug 31 15:57:04.750867 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:57:04.750867 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:57:04.750867 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:57:04.750867 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:57:04.750867 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:57:04.750867 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:57:04.750867 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:57:04.750867 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:57:04.750867 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Aug 31 15:57:04.750867 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Aug 31 15:57:04.750867 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 31 15:57:04.750867 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 31 15:57:04.750867 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 31 15:57:04.750867 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 31 15:57:04.750867 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 15:57:04.750867 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 31 15:57:04.750867 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 15:57:04.750867 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise self.value Aug 31 15:57:04.750867 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 31 15:57:04.752005 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 31 15:57:04.752005 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 31 15:57:04.752005 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 31 15:57:04.752005 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 31 15:57:04.752005 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 31 15:57:04.752005 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 31 15:57:04.752005 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:57:04.752005 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:57:04.752005 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:57:04.752005 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:57:04.752005 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:57:04.752005 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:57:04.752005 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 31 15:57:04.752005 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 31 15:57:04.752005 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 31 15:57:04.752005 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:57:04.755204 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1d8aed82-5e73-40f6-8232-beeab9ef81a1 tempest-AZAdminNegativeTestJSON-1230346278 tempest-AZAdminNegativeTestJSON-1230346278-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:57:04.756379 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1d8aed82-5e73-40f6-8232-beeab9ef81a1 tempest-AZAdminNegativeTestJSON-1230346278 tempest-AZAdminNegativeTestJSON-1230346278-project] 10.222.0.61 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.336709 Aug 31 15:57:04.758503 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 152/318] 10.222.0.61 () {58 vars in 1185 bytes} [Wed Aug 31 15:57:04 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 340 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:57:04.768728 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9a2b6c96-8bb4-4b35-a5c1-11c121ac6be2 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:04.769575 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9a2b6c96-8bb4-4b35-a5c1-11c121ac6be2 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] [instance: f2162319-5635-4c77-920d-9ecb3221d174] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:04.784288 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9a2b6c96-8bb4-4b35-a5c1-11c121ac6be2 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:04.785179 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9a2b6c96-8bb4-4b35-a5c1-11c121ac6be2 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:04.785875 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9a2b6c96-8bb4-4b35-a5c1-11c121ac6be2 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:04.786829 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9a2b6c96-8bb4-4b35-a5c1-11c121ac6be2 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:04.788136 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9a2b6c96-8bb4-4b35-a5c1-11c121ac6be2 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:04.788818 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9a2b6c96-8bb4-4b35-a5c1-11c121ac6be2 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:04.953126 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9a2b6c96-8bb4-4b35-a5c1-11c121ac6be2 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:04.968547 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9a2b6c96-8bb4-4b35-a5c1-11c121ac6be2 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:04.971761 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9a2b6c96-8bb4-4b35-a5c1-11c121ac6be2 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:04.991145 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9a2b6c96-8bb4-4b35-a5c1-11c121ac6be2 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] 10.222.0.61 "GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174" status: 200 len: 1453 microversion: 2.75 time: 0.231194 Aug 31 15:57:04.992268 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 153/319] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:04 2022] GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174 => generated 1453 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:57:05.003150 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9fd407d6-e20b-4067-b746-0981f76939e2 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:05.011363 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9fd407d6-e20b-4067-b746-0981f76939e2 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] [instance: e1ca7a75-7b25-4465-b3f4-3f4d5269c723] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:05.018722 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9fd407d6-e20b-4067-b746-0981f76939e2 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:05.019526 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9fd407d6-e20b-4067-b746-0981f76939e2 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:05.021415 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9fd407d6-e20b-4067-b746-0981f76939e2 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:05.022280 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9fd407d6-e20b-4067-b746-0981f76939e2 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:05.026118 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9fd407d6-e20b-4067-b746-0981f76939e2 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:05.026737 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9fd407d6-e20b-4067-b746-0981f76939e2 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:05.249958 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9fd407d6-e20b-4067-b746-0981f76939e2 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd1dfe05c037461d8dfb45a6f611ced0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd5a49a78854f22aa3c58d01058e493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:05.260469 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9fd407d6-e20b-4067-b746-0981f76939e2 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] 10.222.0.61 "GET /compute/v2.1/servers/e1ca7a75-7b25-4465-b3f4-3f4d5269c723" status: 200 len: 1224 microversion: 2.1 time: 0.266968 Aug 31 15:57:05.268763 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 154/320] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:04 2022] GET /compute/v2.1/servers/e1ca7a75-7b25-4465-b3f4-3f4d5269c723 => generated 1224 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:05.284973 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3a271327-a6b7-4448-8a34-373839e92481 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:05.285681 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3a271327-a6b7-4448-8a34-373839e92481 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:05.299378 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3a271327-a6b7-4448-8a34-373839e92481 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:05.300225 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3a271327-a6b7-4448-8a34-373839e92481 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:05.300993 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3a271327-a6b7-4448-8a34-373839e92481 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:05.301984 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3a271327-a6b7-4448-8a34-373839e92481 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:05.302601 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3a271327-a6b7-4448-8a34-373839e92481 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:05.303187 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3a271327-a6b7-4448-8a34-373839e92481 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:05.351891 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3497863a-8583-4048-9cd1-93924975c612 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:05.374374 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3497863a-8583-4048-9cd1-93924975c612 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:05.385342 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3497863a-8583-4048-9cd1-93924975c612 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:05.398916 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3497863a-8583-4048-9cd1-93924975c612 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/79ee7e24-93df-450b-9030-b08c00d019eb" status: 200 len: 1361 microversion: 2.25 time: 1.029006 Aug 31 15:57:05.404382 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 167/321] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:04 2022] GET /compute/v2.1/servers/79ee7e24-93df-450b-9030-b08c00d019eb => generated 1361 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:57:05.429805 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e7da5714-fd6a-4671-96b6-2109eaa0620c tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Calling method '.version_select at 0x7f5ae986c790>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:05.567035 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e7da5714-fd6a-4671-96b6-2109eaa0620c tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] 10.222.0.61 "GET /compute/v2.1/images/8c7686ef-2791-474b-9a88-1019551ffc49" status: 200 len: 1424 microversion: 2.1 time: 0.157803 Aug 31 15:57:05.574130 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 168/322] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 15:57:05 2022] GET /compute/v2.1/images/8c7686ef-2791-474b-9a88-1019551ffc49 => generated 1424 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:05.756658 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3a271327-a6b7-4448-8a34-373839e92481 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:05.769281 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3a271327-a6b7-4448-8a34-373839e92481 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56" status: 200 len: 1310 microversion: 2.1 time: 0.499083 Aug 31 15:57:05.773157 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 155/323] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:05 2022] GET /compute/v2.1/servers/bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56 => generated 1310 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:06.032566 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c4013f1f-89dc-49b7-a1d9-a1a4beaca80a tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:06.034813 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c4013f1f-89dc-49b7-a1d9-a1a4beaca80a tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] [instance: f2162319-5635-4c77-920d-9ecb3221d174] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:06.064202 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c4013f1f-89dc-49b7-a1d9-a1a4beaca80a tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:06.066486 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c4013f1f-89dc-49b7-a1d9-a1a4beaca80a tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:06.067872 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c4013f1f-89dc-49b7-a1d9-a1a4beaca80a tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:06.073471 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c4013f1f-89dc-49b7-a1d9-a1a4beaca80a tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:06.078600 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c4013f1f-89dc-49b7-a1d9-a1a4beaca80a tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:06.079193 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c4013f1f-89dc-49b7-a1d9-a1a4beaca80a tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:06.294908 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-14a310ba-da90-405d-8888-5c9daeed8d29 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:06.299001 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-14a310ba-da90-405d-8888-5c9daeed8d29 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] [instance: e1ca7a75-7b25-4465-b3f4-3f4d5269c723] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:06.320149 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-14a310ba-da90-405d-8888-5c9daeed8d29 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:06.321023 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-14a310ba-da90-405d-8888-5c9daeed8d29 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:06.322445 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-14a310ba-da90-405d-8888-5c9daeed8d29 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:06.324708 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-14a310ba-da90-405d-8888-5c9daeed8d29 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:06.325431 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-14a310ba-da90-405d-8888-5c9daeed8d29 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:06.328556 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-14a310ba-da90-405d-8888-5c9daeed8d29 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:06.578571 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c4013f1f-89dc-49b7-a1d9-a1a4beaca80a tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:06.592469 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c4013f1f-89dc-49b7-a1d9-a1a4beaca80a tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:06.596726 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c4013f1f-89dc-49b7-a1d9-a1a4beaca80a tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:06.613921 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c4013f1f-89dc-49b7-a1d9-a1a4beaca80a tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] 10.222.0.61 "GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174" status: 200 len: 1453 microversion: 2.75 time: 0.598009 Aug 31 15:57:06.615722 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 169/324] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:06 2022] GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174 => generated 1453 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:57:06.630258 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b496aec3-bd8c-48be-8197-e3df17d87c14 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:06.631044 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b496aec3-bd8c-48be-8197-e3df17d87c14 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 79ee7e24-93df-450b-9030-b08c00d019eb] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:06.648843 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b496aec3-bd8c-48be-8197-e3df17d87c14 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:06.649971 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b496aec3-bd8c-48be-8197-e3df17d87c14 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:06.653266 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b496aec3-bd8c-48be-8197-e3df17d87c14 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:06.655121 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b496aec3-bd8c-48be-8197-e3df17d87c14 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:06.657401 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b496aec3-bd8c-48be-8197-e3df17d87c14 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:06.660722 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b496aec3-bd8c-48be-8197-e3df17d87c14 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:06.771215 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-14a310ba-da90-405d-8888-5c9daeed8d29 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd1dfe05c037461d8dfb45a6f611ced0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd5a49a78854f22aa3c58d01058e493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:06.785673 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-14a310ba-da90-405d-8888-5c9daeed8d29 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] 10.222.0.61 "GET /compute/v2.1/servers/e1ca7a75-7b25-4465-b3f4-3f4d5269c723" status: 200 len: 1272 microversion: 2.1 time: 0.500849 Aug 31 15:57:06.790832 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 156/325] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:06 2022] GET /compute/v2.1/servers/e1ca7a75-7b25-4465-b3f4-3f4d5269c723 => generated 1272 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:06.818965 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d4e1667f-0231-4b71-a0a3-21cf4c2ce751 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Calling method '.version_select at 0x7f5ae974a3a0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:06.897636 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d4e1667f-0231-4b71-a0a3-21cf4c2ce751 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] 10.222.0.61 "GET /compute/v2.1/images/8c7686ef-2791-474b-9a88-1019551ffc49" status: 200 len: 1424 microversion: 2.1 time: 0.105501 Aug 31 15:57:06.899028 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 157/326] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 15:57:06 2022] GET /compute/v2.1/images/8c7686ef-2791-474b-9a88-1019551ffc49 => generated 1424 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:06.910030 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e627ee59-fd29-4d33-865a-b231644063bb tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:06.914626 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e627ee59-fd29-4d33-865a-b231644063bb tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:06.945455 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e627ee59-fd29-4d33-865a-b231644063bb tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:06.950318 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e627ee59-fd29-4d33-865a-b231644063bb tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:06.953709 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e627ee59-fd29-4d33-865a-b231644063bb tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:06.954636 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e627ee59-fd29-4d33-865a-b231644063bb tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:06.956137 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e627ee59-fd29-4d33-865a-b231644063bb tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:06.961393 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e627ee59-fd29-4d33-865a-b231644063bb tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:08.456476 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e627ee59-fd29-4d33-865a-b231644063bb tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:08.470559 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e627ee59-fd29-4d33-865a-b231644063bb tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56" status: 200 len: 1310 microversion: 2.1 time: 1.569075 Aug 31 15:57:08.493174 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 158/327] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:06 2022] GET /compute/v2.1/servers/bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56 => generated 1310 bytes in 1593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:08.507025 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5836857a-b08f-432a-b42a-344d5f05d798 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:08.508967 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5836857a-b08f-432a-b42a-344d5f05d798 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] [instance: f2162319-5635-4c77-920d-9ecb3221d174] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:08.528132 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5836857a-b08f-432a-b42a-344d5f05d798 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:08.529014 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5836857a-b08f-432a-b42a-344d5f05d798 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:08.529629 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5836857a-b08f-432a-b42a-344d5f05d798 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:08.532195 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5836857a-b08f-432a-b42a-344d5f05d798 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:08.539018 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5836857a-b08f-432a-b42a-344d5f05d798 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:08.540364 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5836857a-b08f-432a-b42a-344d5f05d798 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:08.646170 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b496aec3-bd8c-48be-8197-e3df17d87c14 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:08.667051 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b496aec3-bd8c-48be-8197-e3df17d87c14 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:08.672387 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b496aec3-bd8c-48be-8197-e3df17d87c14 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:08.677388 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b496aec3-bd8c-48be-8197-e3df17d87c14 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/79ee7e24-93df-450b-9030-b08c00d019eb" status: 200 len: 1361 microversion: 2.25 time: 2.057908 Aug 31 15:57:08.677984 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 170/328] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:06 2022] GET /compute/v2.1/servers/79ee7e24-93df-450b-9030-b08c00d019eb => generated 1361 bytes in 2061 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:57:08.714420 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0e021b18-4d5a-426e-b68f-7b5b11a967c6 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:08.715089 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0e021b18-4d5a-426e-b68f-7b5b11a967c6 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] [instance: e1ca7a75-7b25-4465-b3f4-3f4d5269c723] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:08.734253 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0e021b18-4d5a-426e-b68f-7b5b11a967c6 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:08.735235 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0e021b18-4d5a-426e-b68f-7b5b11a967c6 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:08.735235 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0e021b18-4d5a-426e-b68f-7b5b11a967c6 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:08.735896 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0e021b18-4d5a-426e-b68f-7b5b11a967c6 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:08.736350 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0e021b18-4d5a-426e-b68f-7b5b11a967c6 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:08.736904 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0e021b18-4d5a-426e-b68f-7b5b11a967c6 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:08.786825 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5836857a-b08f-432a-b42a-344d5f05d798 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:08.805070 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5836857a-b08f-432a-b42a-344d5f05d798 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:08.806537 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5836857a-b08f-432a-b42a-344d5f05d798 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:08.822650 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5836857a-b08f-432a-b42a-344d5f05d798 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] 10.222.0.61 "GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174" status: 200 len: 1438 microversion: 2.75 time: 0.328123 Aug 31 15:57:08.829168 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 159/329] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:08 2022] GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174 => generated 1438 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:57:08.834336 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-945ac9b9-5ba5-4069-8c9f-efb091665760 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Calling method '.version_select at 0x7f5ae9777af0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:08.931435 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-945ac9b9-5ba5-4069-8c9f-efb091665760 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] 10.222.0.61 "GET /compute/v2.1/images/8c7686ef-2791-474b-9a88-1019551ffc49" status: 200 len: 1424 microversion: 2.1 time: 0.100119 Aug 31 15:57:08.932038 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 160/330] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 15:57:08 2022] GET /compute/v2.1/images/8c7686ef-2791-474b-9a88-1019551ffc49 => generated 1424 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:08.983864 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-0e021b18-4d5a-426e-b68f-7b5b11a967c6 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd1dfe05c037461d8dfb45a6f611ced0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd5a49a78854f22aa3c58d01058e493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:08.993586 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0e021b18-4d5a-426e-b68f-7b5b11a967c6 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] 10.222.0.61 "GET /compute/v2.1/servers/e1ca7a75-7b25-4465-b3f4-3f4d5269c723" status: 200 len: 1278 microversion: 2.1 time: 0.304713 Aug 31 15:57:08.994889 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 171/331] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:08 2022] GET /compute/v2.1/servers/e1ca7a75-7b25-4465-b3f4-3f4d5269c723 => generated 1278 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:09.342912 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a13976a1-c1db-4251-b0bc-72b58e8326ec tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:57:09.346318 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a13976a1-c1db-4251-b0bc-72b58e8326ec tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] [instance: f2162319-5635-4c77-920d-9ecb3221d174] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:09.367601 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a13976a1-c1db-4251-b0bc-72b58e8326ec tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:09.370579 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a13976a1-c1db-4251-b0bc-72b58e8326ec tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:09.371917 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a13976a1-c1db-4251-b0bc-72b58e8326ec tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:09.374837 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a13976a1-c1db-4251-b0bc-72b58e8326ec tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:09.377178 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a13976a1-c1db-4251-b0bc-72b58e8326ec tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:09.377830 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a13976a1-c1db-4251-b0bc-72b58e8326ec tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:09.495694 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a03b359b-9e17-4059-b871-16da8133cc6e tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:09.498597 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a03b359b-9e17-4059-b871-16da8133cc6e tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:09.501187 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=4 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:57:09.544125 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a03b359b-9e17-4059-b871-16da8133cc6e tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:09.544980 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a03b359b-9e17-4059-b871-16da8133cc6e tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:09.547736 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a03b359b-9e17-4059-b871-16da8133cc6e tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:09.548702 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a03b359b-9e17-4059-b871-16da8133cc6e tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:09.550503 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a03b359b-9e17-4059-b871-16da8133cc6e tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:09.551517 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a03b359b-9e17-4059-b871-16da8133cc6e tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:09.553073 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-a13976a1-c1db-4251-b0bc-72b58e8326ec tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 15:57:09.553580 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-a13976a1-c1db-4251-b0bc-72b58e8326ec tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 15:57:09.565660 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-a13976a1-c1db-4251-b0bc-72b58e8326ec tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 15:57:09.566210 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-a13976a1-c1db-4251-b0bc-72b58e8326ec tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 15:57:09.566801 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-a13976a1-c1db-4251-b0bc-72b58e8326ec tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 15:57:09.891064 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a13976a1-c1db-4251-b0bc-72b58e8326ec tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] [instance: f2162319-5635-4c77-920d-9ecb3221d174] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:09.913411 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a13976a1-c1db-4251-b0bc-72b58e8326ec tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:09.913931 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a13976a1-c1db-4251-b0bc-72b58e8326ec tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:09.914486 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a13976a1-c1db-4251-b0bc-72b58e8326ec tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:09.915585 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a13976a1-c1db-4251-b0bc-72b58e8326ec tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:09.916070 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a13976a1-c1db-4251-b0bc-72b58e8326ec tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:09.935575 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a13976a1-c1db-4251-b0bc-72b58e8326ec tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:10.831098 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-a13976a1-c1db-4251-b0bc-72b58e8326ec tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lazy-loading 'services' on Instance uuid f2162319-5635-4c77-920d-9ecb3221d174 {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:57:11.005619 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a03b359b-9e17-4059-b871-16da8133cc6e tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:11.023903 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a13976a1-c1db-4251-b0bc-72b58e8326ec tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174/action" status: 202 len: 1942 microversion: 2.75 time: 2.088830 Aug 31 15:57:11.027194 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 161/332] 10.222.0.61 () {62 vars in 1319 bytes} [Wed Aug 31 15:57:08 2022] POST /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174/action => generated 1942 bytes in 2094 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 31 15:57:11.029344 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a03b359b-9e17-4059-b871-16da8133cc6e tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56" status: 200 len: 1310 microversion: 2.1 time: 1.535872 Aug 31 15:57:11.044012 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 172/333] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:09 2022] GET /compute/v2.1/servers/bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56 => generated 1310 bytes in 1554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:11.046136 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-fc2dbe71-b7d7-450f-9fbb-8e4945b0444b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:11.046762 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-fc2dbe71-b7d7-450f-9fbb-8e4945b0444b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 79ee7e24-93df-450b-9030-b08c00d019eb] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:11.061834 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-171f331e-f156-4c7d-98c1-568b8a6902fa tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Calling method '.version_select at 0x7f5ae9992820>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:11.071009 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fc2dbe71-b7d7-450f-9fbb-8e4945b0444b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:11.072489 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fc2dbe71-b7d7-450f-9fbb-8e4945b0444b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:11.075484 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fc2dbe71-b7d7-450f-9fbb-8e4945b0444b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:11.076565 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fc2dbe71-b7d7-450f-9fbb-8e4945b0444b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:11.077973 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fc2dbe71-b7d7-450f-9fbb-8e4945b0444b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:11.080017 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fc2dbe71-b7d7-450f-9fbb-8e4945b0444b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:11.198963 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-171f331e-f156-4c7d-98c1-568b8a6902fa tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] 10.222.0.61 "GET /compute/v2.1/images/8c7686ef-2791-474b-9a88-1019551ffc49" status: 200 len: 1424 microversion: 2.1 time: 0.153393 Aug 31 15:57:11.200806 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 173/334] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 15:57:11 2022] GET /compute/v2.1/images/8c7686ef-2791-474b-9a88-1019551ffc49 => generated 1424 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:11.217750 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-beab9b1a-f8ff-4df2-8add-f0fb72a8d62b tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:11.218603 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-beab9b1a-f8ff-4df2-8add-f0fb72a8d62b tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] [instance: e1ca7a75-7b25-4465-b3f4-3f4d5269c723] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:11.228096 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-beab9b1a-f8ff-4df2-8add-f0fb72a8d62b tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:11.229065 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-beab9b1a-f8ff-4df2-8add-f0fb72a8d62b tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:11.229946 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-beab9b1a-f8ff-4df2-8add-f0fb72a8d62b tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:11.231366 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-beab9b1a-f8ff-4df2-8add-f0fb72a8d62b tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:11.232169 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-beab9b1a-f8ff-4df2-8add-f0fb72a8d62b tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:11.232816 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-beab9b1a-f8ff-4df2-8add-f0fb72a8d62b tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:11.711380 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=8 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:57:11.788831 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-beab9b1a-f8ff-4df2-8add-f0fb72a8d62b tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd1dfe05c037461d8dfb45a6f611ced0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd5a49a78854f22aa3c58d01058e493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:11.797350 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-beab9b1a-f8ff-4df2-8add-f0fb72a8d62b tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] 10.222.0.61 "GET /compute/v2.1/servers/e1ca7a75-7b25-4465-b3f4-3f4d5269c723" status: 200 len: 1320 microversion: 2.1 time: 0.595275 Aug 31 15:57:11.817372 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 174/335] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:11 2022] GET /compute/v2.1/servers/e1ca7a75-7b25-4465-b3f4-3f4d5269c723 => generated 1320 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:11.822256 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-09fd7221-367a-4893-9439-7640fb3c4ccb req-5a2b8f7f-5280-40d8-bb88-c738ab80d37c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56", "name": "network-vif-plugged", "status": "completed", "tag": "2b648b75-ab1e-4141-bc80-3cbc9b5b261b"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:57:11.850752 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-09fd7221-367a-4893-9439-7640fb3c4ccb req-5a2b8f7f-5280-40d8-bb88-c738ab80d37c service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:11.851231 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-09fd7221-367a-4893-9439-7640fb3c4ccb req-5a2b8f7f-5280-40d8-bb88-c738ab80d37c service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:11.851689 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-09fd7221-367a-4893-9439-7640fb3c4ccb req-5a2b8f7f-5280-40d8-bb88-c738ab80d37c service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:11.878635 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-09fd7221-367a-4893-9439-7640fb3c4ccb req-5a2b8f7f-5280-40d8-bb88-c738ab80d37c service nova] Creating event network-vif-plugged:2b648b75-ab1e-4141-bc80-3cbc9b5b261b for instance bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56 on n-h1-850499-9 Aug 31 15:57:11.893226 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-09fd7221-367a-4893-9439-7640fb3c4ccb req-5a2b8f7f-5280-40d8-bb88-c738ab80d37c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074505 Aug 31 15:57:11.894347 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 175/336] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 15:57:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:57:11.899460 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c773b272-d96f-4386-9c0b-e5c67097386f tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:11.904515 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c773b272-d96f-4386-9c0b-e5c67097386f tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] [instance: f2162319-5635-4c77-920d-9ecb3221d174] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:11.922653 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c773b272-d96f-4386-9c0b-e5c67097386f tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:11.923391 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c773b272-d96f-4386-9c0b-e5c67097386f tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:11.923863 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c773b272-d96f-4386-9c0b-e5c67097386f tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:11.924594 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c773b272-d96f-4386-9c0b-e5c67097386f tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:11.925051 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c773b272-d96f-4386-9c0b-e5c67097386f tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:11.925477 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c773b272-d96f-4386-9c0b-e5c67097386f tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:11.983544 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-fc2dbe71-b7d7-450f-9fbb-8e4945b0444b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:12.005750 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-fc2dbe71-b7d7-450f-9fbb-8e4945b0444b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:12.008571 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-fc2dbe71-b7d7-450f-9fbb-8e4945b0444b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:12.016282 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-fc2dbe71-b7d7-450f-9fbb-8e4945b0444b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/79ee7e24-93df-450b-9030-b08c00d019eb" status: 200 len: 1361 microversion: 2.25 time: 0.987357 Aug 31 15:57:12.030404 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 162/337] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:11 2022] GET /compute/v2.1/servers/79ee7e24-93df-450b-9030-b08c00d019eb => generated 1361 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:57:12.041349 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-d4cc0d3a-6401-429d-b181-3b2fad69f440 req-f4790e0d-60cf-4437-9a7c-84977de80699 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1ca7a75-7b25-4465-b3f4-3f4d5269c723", "tag": "fe0826ab-55c5-467e-b7d7-83da41f83da6"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:57:12.053597 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-d4cc0d3a-6401-429d-b181-3b2fad69f440 req-f4790e0d-60cf-4437-9a7c-84977de80699 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:12.054320 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-d4cc0d3a-6401-429d-b181-3b2fad69f440 req-f4790e0d-60cf-4437-9a7c-84977de80699 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:12.054901 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-d4cc0d3a-6401-429d-b181-3b2fad69f440 req-f4790e0d-60cf-4437-9a7c-84977de80699 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:12.068418 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-d4cc0d3a-6401-429d-b181-3b2fad69f440 req-f4790e0d-60cf-4437-9a7c-84977de80699 service nova] Creating event network-changed:fe0826ab-55c5-467e-b7d7-83da41f83da6 for instance e1ca7a75-7b25-4465-b3f4-3f4d5269c723 on n-h2-850499-9 Aug 31 15:57:12.075291 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-d4cc0d3a-6401-429d-b181-3b2fad69f440 req-f4790e0d-60cf-4437-9a7c-84977de80699 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042941 Aug 31 15:57:12.076495 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 163/338] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 15:57:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:57:12.209803 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-c773b272-d96f-4386-9c0b-e5c67097386f tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lazy-loading 'services' on Instance uuid f2162319-5635-4c77-920d-9ecb3221d174 {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:57:12.377790 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-63ae7636-dde8-4323-9ff4-0fc21ba94c66 tempest-FlavorsExtraSpecsTestJSON-261367876 tempest-FlavorsExtraSpecsTestJSON-261367876-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-2094204044", "ram": 512, "vcpus": 1, "disk": 10, "id": 2056572240, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:57:12.396285 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c773b272-d96f-4386-9c0b-e5c67097386f tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174" status: 200 len: 1929 microversion: 2.75 time: 0.500479 Aug 31 15:57:12.397229 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 176/339] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:11 2022] GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174 => generated 1929 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:57:12.433134 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-63ae7636-dde8-4323-9ff4-0fc21ba94c66 tempest-FlavorsExtraSpecsTestJSON-261367876 tempest-FlavorsExtraSpecsTestJSON-261367876-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.352575 Aug 31 15:57:12.435907 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 164/340] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 15:57:12 2022] POST /compute/v2.1/flavors => generated 416 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:57:12.439225 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6ddb0501-0f2d-4cb8-a649-65e10a9f2a93 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:12.440070 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6ddb0501-0f2d-4cb8-a649-65e10a9f2a93 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:12.448986 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-56b6fcd3-3c84-4c18-b160-45e217b54ce7 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Calling method '.version_select at 0x7f5ae96d5820>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:12.454794 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6ddb0501-0f2d-4cb8-a649-65e10a9f2a93 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:12.455539 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6ddb0501-0f2d-4cb8-a649-65e10a9f2a93 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:12.459262 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6ddb0501-0f2d-4cb8-a649-65e10a9f2a93 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:12.460259 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6ddb0501-0f2d-4cb8-a649-65e10a9f2a93 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:12.460743 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6ddb0501-0f2d-4cb8-a649-65e10a9f2a93 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:12.461180 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6ddb0501-0f2d-4cb8-a649-65e10a9f2a93 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:12.526820 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-56b6fcd3-3c84-4c18-b160-45e217b54ce7 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] 10.222.0.61 "GET /compute/v2.1/images/8c7686ef-2791-474b-9a88-1019551ffc49" status: 200 len: 1424 microversion: 2.1 time: 0.089006 Aug 31 15:57:12.529281 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 165/341] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 15:57:12 2022] GET /compute/v2.1/images/8c7686ef-2791-474b-9a88-1019551ffc49 => generated 1424 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:12.552511 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4cabfa20-5939-48e9-8d80-53d75c67fff1 tempest-FlavorsExtraSpecsTestJSON-261367876 tempest-FlavorsExtraSpecsTestJSON-261367876-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:57:12.608571 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=22 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:57:12.630836 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4cabfa20-5939-48e9-8d80-53d75c67fff1 tempest-FlavorsExtraSpecsTestJSON-261367876 tempest-FlavorsExtraSpecsTestJSON-261367876-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors/2056572240/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.097548 Aug 31 15:57:12.631442 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 166/342] 10.222.0.61 () {60 vars in 1224 bytes} [Wed Aug 31 15:57:12 2022] POST /compute/v2.1/flavors/2056572240/os-extra_specs => generated 66 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 15:57:12.800053 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4e4ab2b8-a707-426e-9526-e507f29b0a51 tempest-FlavorsExtraSpecsTestJSON-1625986519 tempest-FlavorsExtraSpecsTestJSON-1625986519-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:12.828670 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4e4ab2b8-a707-426e-9526-e507f29b0a51 tempest-FlavorsExtraSpecsTestJSON-1625986519 tempest-FlavorsExtraSpecsTestJSON-1625986519-project] 10.222.0.61 "GET /compute/v2.1/flavors/2056572240/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.190553 Aug 31 15:57:12.837987 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 167/343] 10.222.0.61 () {58 vars in 1203 bytes} [Wed Aug 31 15:57:12 2022] GET /compute/v2.1/flavors/2056572240/os-extra_specs => generated 66 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 15:57:12.844239 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-95515e3e-df79-446a-ae6f-611d689b6b1e tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:12.845837 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-95515e3e-df79-446a-ae6f-611d689b6b1e tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] [instance: e1ca7a75-7b25-4465-b3f4-3f4d5269c723] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:12.854003 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-95515e3e-df79-446a-ae6f-611d689b6b1e tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:12.854732 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-95515e3e-df79-446a-ae6f-611d689b6b1e tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:12.855444 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-95515e3e-df79-446a-ae6f-611d689b6b1e tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:12.856415 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-95515e3e-df79-446a-ae6f-611d689b6b1e tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:12.857094 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-95515e3e-df79-446a-ae6f-611d689b6b1e tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:12.857326 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-6ddb0501-0f2d-4cb8-a649-65e10a9f2a93 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:12.858301 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-95515e3e-df79-446a-ae6f-611d689b6b1e tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:12.873553 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6ddb0501-0f2d-4cb8-a649-65e10a9f2a93 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56" status: 200 len: 1310 microversion: 2.1 time: 0.455466 Aug 31 15:57:12.889817 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 177/344] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:12 2022] GET /compute/v2.1/servers/bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56 => generated 1310 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:12.895867 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-caa62ce7-621e-4103-b447-e8ee1ea4d7ab tempest-FlavorsExtraSpecsTestJSON-261367876 tempest-FlavorsExtraSpecsTestJSON-261367876-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:57:12.929148 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-caa62ce7-621e-4103-b447-e8ee1ea4d7ab tempest-FlavorsExtraSpecsTestJSON-261367876 tempest-FlavorsExtraSpecsTestJSON-261367876-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors/2056572240/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.037607 Aug 31 15:57:12.931523 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 178/345] 10.222.0.61 () {60 vars in 1224 bytes} [Wed Aug 31 15:57:12 2022] POST /compute/v2.1/flavors/2056572240/os-extra_specs => generated 66 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 15:57:12.941392 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ea406b10-e780-4cf8-8dae-bd3f63d5e649 tempest-FlavorsExtraSpecsTestJSON-1625986519 tempest-FlavorsExtraSpecsTestJSON-1625986519-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:12.953915 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ea406b10-e780-4cf8-8dae-bd3f63d5e649 tempest-FlavorsExtraSpecsTestJSON-1625986519 tempest-FlavorsExtraSpecsTestJSON-1625986519-project] 10.222.0.61 "GET /compute/v2.1/flavors/2056572240/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.016593 Aug 31 15:57:12.955201 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 179/346] 10.222.0.61 () {58 vars in 1245 bytes} [Wed Aug 31 15:57:12 2022] GET /compute/v2.1/flavors/2056572240/os-extra_specs/hw:numa_nodes => generated 22 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 15:57:12.969441 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-818ef52c-2d61-4744-9d0b-ecdfa39121d8 tempest-FlavorsExtraSpecsTestJSON-261367876 tempest-FlavorsExtraSpecsTestJSON-261367876-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:57:12.999336 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-818ef52c-2d61-4744-9d0b-ecdfa39121d8 tempest-FlavorsExtraSpecsTestJSON-261367876 tempest-FlavorsExtraSpecsTestJSON-261367876-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors/2056572240/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.035354 Aug 31 15:57:13.000638 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 180/347] 10.222.0.61 () {60 vars in 1224 bytes} [Wed Aug 31 15:57:12 2022] POST /compute/v2.1/flavors/2056572240/os-extra_specs => generated 66 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 15:57:13.012112 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-468597a9-291b-4ff5-88b8-eddad8a64bae tempest-FlavorsExtraSpecsTestJSON-261367876 tempest-FlavorsExtraSpecsTestJSON-261367876-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:13.047178 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-468597a9-291b-4ff5-88b8-eddad8a64bae tempest-FlavorsExtraSpecsTestJSON-261367876 tempest-FlavorsExtraSpecsTestJSON-261367876-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/2056572240/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.040986 Aug 31 15:57:13.048877 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 181/348] 10.222.0.61 () {58 vars in 1203 bytes} [Wed Aug 31 15:57:13 2022] GET /compute/v2.1/flavors/2056572240/os-extra_specs => generated 66 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 15:57:13.055856 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-eefc89ab-f46e-4c69-9a94-5e8aa528d5f1 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:13.057077 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-eefc89ab-f46e-4c69-9a94-5e8aa528d5f1 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 79ee7e24-93df-450b-9030-b08c00d019eb] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:13.066405 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eefc89ab-f46e-4c69-9a94-5e8aa528d5f1 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:13.068712 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eefc89ab-f46e-4c69-9a94-5e8aa528d5f1 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:13.069514 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eefc89ab-f46e-4c69-9a94-5e8aa528d5f1 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:13.070684 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eefc89ab-f46e-4c69-9a94-5e8aa528d5f1 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:13.071704 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eefc89ab-f46e-4c69-9a94-5e8aa528d5f1 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:13.072640 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eefc89ab-f46e-4c69-9a94-5e8aa528d5f1 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:13.122013 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-95515e3e-df79-446a-ae6f-611d689b6b1e tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd1dfe05c037461d8dfb45a6f611ced0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd5a49a78854f22aa3c58d01058e493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:13.131481 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-95515e3e-df79-446a-ae6f-611d689b6b1e tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] 10.222.0.61 "GET /compute/v2.1/servers/e1ca7a75-7b25-4465-b3f4-3f4d5269c723" status: 200 len: 1320 microversion: 2.1 time: 0.292323 Aug 31 15:57:13.143758 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 168/349] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:12 2022] GET /compute/v2.1/servers/e1ca7a75-7b25-4465-b3f4-3f4d5269c723 => generated 1320 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:13.149134 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-14e1d1da-fa1d-49ef-a94d-59e238f75440 tempest-FlavorsExtraSpecsTestJSON-261367876 tempest-FlavorsExtraSpecsTestJSON-261367876-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:57:13.224274 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-14e1d1da-fa1d-49ef-a94d-59e238f75440 tempest-FlavorsExtraSpecsTestJSON-261367876 tempest-FlavorsExtraSpecsTestJSON-261367876-project-admin] 10.222.0.61 "PUT /compute/v2.1/flavors/2056572240/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.072984 Aug 31 15:57:13.225782 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 169/350] 10.222.0.61 () {60 vars in 1265 bytes} [Wed Aug 31 15:57:13 2022] PUT /compute/v2.1/flavors/2056572240/os-extra_specs/hw:numa_nodes => generated 22 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 15:57:13.241720 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-30b88c84-f7a9-4a1c-b1c5-7afeed251f76 tempest-FlavorsExtraSpecsTestJSON-261367876 tempest-FlavorsExtraSpecsTestJSON-261367876-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:13.252920 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-30b88c84-f7a9-4a1c-b1c5-7afeed251f76 tempest-FlavorsExtraSpecsTestJSON-261367876 tempest-FlavorsExtraSpecsTestJSON-261367876-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/2056572240/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.021503 Aug 31 15:57:13.253993 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 170/351] 10.222.0.61 () {58 vars in 1203 bytes} [Wed Aug 31 15:57:13 2022] GET /compute/v2.1/flavors/2056572240/os-extra_specs => generated 66 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 15:57:13.263621 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-572b7be8-22cc-4cfd-8aa9-19d01ece7e51 tempest-FlavorsExtraSpecsTestJSON-261367876 tempest-FlavorsExtraSpecsTestJSON-261367876-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:13.285548 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-eefc89ab-f46e-4c69-9a94-5e8aa528d5f1 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:13.289733 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=100 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:57:13.300744 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-eefc89ab-f46e-4c69-9a94-5e8aa528d5f1 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:13.302927 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-eefc89ab-f46e-4c69-9a94-5e8aa528d5f1 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:13.313143 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-eefc89ab-f46e-4c69-9a94-5e8aa528d5f1 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/79ee7e24-93df-450b-9030-b08c00d019eb" status: 200 len: 1361 microversion: 2.25 time: 0.262649 Aug 31 15:57:13.315358 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-572b7be8-22cc-4cfd-8aa9-19d01ece7e51 tempest-FlavorsExtraSpecsTestJSON-261367876 tempest-FlavorsExtraSpecsTestJSON-261367876-project-admin] 10.222.0.61 "DELETE /compute/v2.1/flavors/2056572240/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.056110 Aug 31 15:57:13.316048 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 182/352] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:13 2022] GET /compute/v2.1/servers/79ee7e24-93df-450b-9030-b08c00d019eb => generated 1361 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:57:13.316562 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 171/353] 10.222.0.61 () {58 vars in 1248 bytes} [Wed Aug 31 15:57:13 2022] DELETE /compute/v2.1/flavors/2056572240/os-extra_specs/hw:numa_nodes => generated 0 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Aug 31 15:57:13.324890 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1f11d4e8-ad67-4325-8a0f-81a79bf4baac tempest-FlavorsExtraSpecsTestJSON-261367876 tempest-FlavorsExtraSpecsTestJSON-261367876-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:13.351982 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1f11d4e8-ad67-4325-8a0f-81a79bf4baac tempest-FlavorsExtraSpecsTestJSON-261367876 tempest-FlavorsExtraSpecsTestJSON-261367876-project-admin] 10.222.0.61 "DELETE /compute/v2.1/flavors/2056572240/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.030830 Aug 31 15:57:13.356899 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 183/354] 10.222.0.61 () {58 vars in 1248 bytes} [Wed Aug 31 15:57:13 2022] DELETE /compute/v2.1/flavors/2056572240/os-extra_specs/hw:cpu_policy => generated 0 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 31 15:57:13.361580 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-aa996ff4-8dd9-4f94-9957-b51dd6da3b06 tempest-FlavorsExtraSpecsTestJSON-261367876 tempest-FlavorsExtraSpecsTestJSON-261367876-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:13.375283 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-aa996ff4-8dd9-4f94-9957-b51dd6da3b06 tempest-FlavorsExtraSpecsTestJSON-261367876 tempest-FlavorsExtraSpecsTestJSON-261367876-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/2056572240/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.017550 Aug 31 15:57:13.376673 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 172/355] 10.222.0.61 () {58 vars in 1203 bytes} [Wed Aug 31 15:57:13 2022] GET /compute/v2.1/flavors/2056572240/os-extra_specs => generated 19 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 15:57:13.390646 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-cb656442-c46f-4e84-a019-5b7ae81ccb06 tempest-FlavorsExtraSpecsTestJSON-261367876 tempest-FlavorsExtraSpecsTestJSON-261367876-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:13.420234 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-cb656442-c46f-4e84-a019-5b7ae81ccb06 tempest-FlavorsExtraSpecsTestJSON-261367876 tempest-FlavorsExtraSpecsTestJSON-261367876-project-admin] 10.222.0.61 "DELETE /compute/v2.1/flavors/2056572240" status: 202 len: 0 microversion: 2.1 time: 0.035465 Aug 31 15:57:13.421591 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 184/356] 10.222.0.61 () {58 vars in 1161 bytes} [Wed Aug 31 15:57:13 2022] DELETE /compute/v2.1/flavors/2056572240 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 15:57:13.429705 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-bc44b18c-1da7-4c26-933a-093b4af8abe5 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:13.430385 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-bc44b18c-1da7-4c26-933a-093b4af8abe5 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] [instance: f2162319-5635-4c77-920d-9ecb3221d174] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:13.438345 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bc44b18c-1da7-4c26-933a-093b4af8abe5 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:13.438825 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bc44b18c-1da7-4c26-933a-093b4af8abe5 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:13.439371 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bc44b18c-1da7-4c26-933a-093b4af8abe5 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:13.439644 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-db9f4956-0e05-47e2-b392-500b0709e129 tempest-FlavorsExtraSpecsTestJSON-261367876 tempest-FlavorsExtraSpecsTestJSON-261367876-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:13.440190 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bc44b18c-1da7-4c26-933a-093b4af8abe5 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:13.440687 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bc44b18c-1da7-4c26-933a-093b4af8abe5 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:13.441136 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bc44b18c-1da7-4c26-933a-093b4af8abe5 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:13.466787 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:57:13.488292 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-db9f4956-0e05-47e2-b392-500b0709e129 tempest-FlavorsExtraSpecsTestJSON-261367876 tempest-FlavorsExtraSpecsTestJSON-261367876-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.051913 Aug 31 15:57:13.502812 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 185/357] 10.222.0.61 () {58 vars in 1146 bytes} [Wed Aug 31 15:57:13 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:13.544041 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-90fb104f-9689-4233-bd47-5dafc856fec2 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Calling method '.version_select at 0x7f5ae97cb700>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:13.599857 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-bc44b18c-1da7-4c26-933a-093b4af8abe5 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lazy-loading 'services' on Instance uuid f2162319-5635-4c77-920d-9ecb3221d174 {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:57:13.631901 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-90fb104f-9689-4233-bd47-5dafc856fec2 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] 10.222.0.61 "GET /compute/v2.1/images/8c7686ef-2791-474b-9a88-1019551ffc49" status: 200 len: 1424 microversion: 2.1 time: 0.092107 Aug 31 15:57:13.632717 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 186/358] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 15:57:13 2022] GET /compute/v2.1/images/8c7686ef-2791-474b-9a88-1019551ffc49 => generated 1424 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:57:13.648034 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-bc44b18c-1da7-4c26-933a-093b4af8abe5 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174" status: 200 len: 1929 microversion: 2.75 time: 0.224300 Aug 31 15:57:13.663398 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 173/359] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:13 2022] GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174 => generated 1929 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 15:57:13.894769 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d7cbb9b3-5c62-4694-bca9-e0584bdba211 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:13.895457 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d7cbb9b3-5c62-4694-bca9-e0584bdba211 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:13.907156 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d7cbb9b3-5c62-4694-bca9-e0584bdba211 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:13.907156 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d7cbb9b3-5c62-4694-bca9-e0584bdba211 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:13.907156 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d7cbb9b3-5c62-4694-bca9-e0584bdba211 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:13.909194 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d7cbb9b3-5c62-4694-bca9-e0584bdba211 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:13.909731 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d7cbb9b3-5c62-4694-bca9-e0584bdba211 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:13.910210 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d7cbb9b3-5c62-4694-bca9-e0584bdba211 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:14.082252 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d7cbb9b3-5c62-4694-bca9-e0584bdba211 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:14.092100 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d7cbb9b3-5c62-4694-bca9-e0584bdba211 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56" status: 200 len: 1493 microversion: 2.1 time: 0.200638 Aug 31 15:57:14.092914 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 187/360] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:13 2022] GET /compute/v2.1/servers/bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56 => generated 1493 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:14.129674 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-ab849f58-8fef-4653-ab95-83455ec0a306 req-417f0ec2-e7b3-43e1-ba89-13cafbf053cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79ee7e24-93df-450b-9030-b08c00d019eb", "name": "network-vif-plugged", "status": "completed", "tag": "a2a2e771-f0ba-4149-867f-67716bfa9d07"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:57:14.144928 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-ab849f58-8fef-4653-ab95-83455ec0a306 req-417f0ec2-e7b3-43e1-ba89-13cafbf053cb service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:14.145427 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-ab849f58-8fef-4653-ab95-83455ec0a306 req-417f0ec2-e7b3-43e1-ba89-13cafbf053cb service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:14.145860 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-ab849f58-8fef-4653-ab95-83455ec0a306 req-417f0ec2-e7b3-43e1-ba89-13cafbf053cb service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:14.172004 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-ab849f58-8fef-4653-ab95-83455ec0a306 req-417f0ec2-e7b3-43e1-ba89-13cafbf053cb service nova] Creating event network-vif-plugged:a2a2e771-f0ba-4149-867f-67716bfa9d07 for instance 79ee7e24-93df-450b-9030-b08c00d019eb on n-h1-850499-9 Aug 31 15:57:14.186848 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-ab849f58-8fef-4653-ab95-83455ec0a306 req-417f0ec2-e7b3-43e1-ba89-13cafbf053cb service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066034 Aug 31 15:57:14.189335 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 188/361] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 15:57:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:57:14.211141 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b8bb064c-3a4b-4e3c-a151-1045af043044 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:14.212653 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b8bb064c-3a4b-4e3c-a151-1045af043044 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] [instance: e1ca7a75-7b25-4465-b3f4-3f4d5269c723] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:14.226053 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b8bb064c-3a4b-4e3c-a151-1045af043044 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:14.226053 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b8bb064c-3a4b-4e3c-a151-1045af043044 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:14.229454 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b8bb064c-3a4b-4e3c-a151-1045af043044 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:14.231602 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b8bb064c-3a4b-4e3c-a151-1045af043044 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:14.232117 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b8bb064c-3a4b-4e3c-a151-1045af043044 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:14.232572 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b8bb064c-3a4b-4e3c-a151-1045af043044 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:14.535240 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-83a900d3-a809-4cf5-9c17-5b9c876530f0 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:14.535882 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-83a900d3-a809-4cf5-9c17-5b9c876530f0 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] [instance: bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:14.549305 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-83a900d3-a809-4cf5-9c17-5b9c876530f0 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:14.549810 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-83a900d3-a809-4cf5-9c17-5b9c876530f0 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:14.553110 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-83a900d3-a809-4cf5-9c17-5b9c876530f0 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:14.553248 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-83a900d3-a809-4cf5-9c17-5b9c876530f0 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:14.553732 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-83a900d3-a809-4cf5-9c17-5b9c876530f0 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:14.554153 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-83a900d3-a809-4cf5-9c17-5b9c876530f0 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:14.670081 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b8bb064c-3a4b-4e3c-a151-1045af043044 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd1dfe05c037461d8dfb45a6f611ced0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd5a49a78854f22aa3c58d01058e493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:14.682057 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b8bb064c-3a4b-4e3c-a151-1045af043044 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] 10.222.0.61 "GET /compute/v2.1/servers/e1ca7a75-7b25-4465-b3f4-3f4d5269c723" status: 200 len: 1320 microversion: 2.1 time: 0.488062 Aug 31 15:57:14.689704 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 189/362] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:14 2022] GET /compute/v2.1/servers/e1ca7a75-7b25-4465-b3f4-3f4d5269c723 => generated 1320 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:14.697004 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-411a6be0-5dcc-40fd-8ad3-475bf01d7e21 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:14.698847 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-411a6be0-5dcc-40fd-8ad3-475bf01d7e21 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 79ee7e24-93df-450b-9030-b08c00d019eb] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:14.713920 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-411a6be0-5dcc-40fd-8ad3-475bf01d7e21 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:14.717084 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-411a6be0-5dcc-40fd-8ad3-475bf01d7e21 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:14.717634 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-411a6be0-5dcc-40fd-8ad3-475bf01d7e21 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:14.718434 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-411a6be0-5dcc-40fd-8ad3-475bf01d7e21 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:14.721208 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-411a6be0-5dcc-40fd-8ad3-475bf01d7e21 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:14.721729 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-411a6be0-5dcc-40fd-8ad3-475bf01d7e21 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:15.326706 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-411a6be0-5dcc-40fd-8ad3-475bf01d7e21 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:15.343666 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-411a6be0-5dcc-40fd-8ad3-475bf01d7e21 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:15.345139 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-411a6be0-5dcc-40fd-8ad3-475bf01d7e21 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:15.348303 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-411a6be0-5dcc-40fd-8ad3-475bf01d7e21 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/79ee7e24-93df-450b-9030-b08c00d019eb" status: 200 len: 1361 microversion: 2.25 time: 0.657452 Aug 31 15:57:15.348884 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 190/363] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:14 2022] GET /compute/v2.1/servers/79ee7e24-93df-450b-9030-b08c00d019eb => generated 1361 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:57:15.350235 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-83a900d3-a809-4cf5-9c17-5b9c876530f0 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56" status: 200 len: 1644 microversion: 2.1 time: 1.239431 Aug 31 15:57:15.365665 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 174/364] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:14 2022] GET /compute/v2.1/servers/bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56 => generated 1644 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:15.368020 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3b1effa9-5eab-44ea-9e50-95b7011440b3 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Calling method '.version_select at 0x7f5ae986c790>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:15.376575 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9b31ce30-13ce-4dac-85c3-df89debdd9a8 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:15.377529 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9b31ce30-13ce-4dac-85c3-df89debdd9a8 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] [instance: f2162319-5635-4c77-920d-9ecb3221d174] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:15.402828 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9b31ce30-13ce-4dac-85c3-df89debdd9a8 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:15.405206 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9b31ce30-13ce-4dac-85c3-df89debdd9a8 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:15.407912 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9b31ce30-13ce-4dac-85c3-df89debdd9a8 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:15.409097 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9b31ce30-13ce-4dac-85c3-df89debdd9a8 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:15.411861 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9b31ce30-13ce-4dac-85c3-df89debdd9a8 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:15.412529 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9b31ce30-13ce-4dac-85c3-df89debdd9a8 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:15.452956 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3b1effa9-5eab-44ea-9e50-95b7011440b3 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] 10.222.0.61 "GET /compute/v2.1/images/8c7686ef-2791-474b-9a88-1019551ffc49" status: 200 len: 1424 microversion: 2.1 time: 0.098535 Aug 31 15:57:15.464231 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 191/365] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 15:57:15 2022] GET /compute/v2.1/images/8c7686ef-2791-474b-9a88-1019551ffc49 => generated 1424 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:15.471236 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-724b3876-902c-44e6-aebd-7b93fc7669fb tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:15.477616 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-724b3876-902c-44e6-aebd-7b93fc7669fb tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] [instance: bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:15.501393 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-724b3876-902c-44e6-aebd-7b93fc7669fb tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:15.501906 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-724b3876-902c-44e6-aebd-7b93fc7669fb tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:15.502469 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-724b3876-902c-44e6-aebd-7b93fc7669fb tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:15.503334 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-724b3876-902c-44e6-aebd-7b93fc7669fb tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:15.503832 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-724b3876-902c-44e6-aebd-7b93fc7669fb tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:15.504269 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-724b3876-902c-44e6-aebd-7b93fc7669fb tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:15.573031 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-9b31ce30-13ce-4dac-85c3-df89debdd9a8 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lazy-loading 'services' on Instance uuid f2162319-5635-4c77-920d-9ecb3221d174 {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:57:15.618603 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9b31ce30-13ce-4dac-85c3-df89debdd9a8 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174" status: 200 len: 1929 microversion: 2.75 time: 0.251429 Aug 31 15:57:15.621813 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 175/366] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:15 2022] GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174 => generated 1929 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:57:15.716575 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6111efc0-cb8c-45e0-94bd-1e4c579a648c tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:15.717458 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6111efc0-cb8c-45e0-94bd-1e4c579a648c tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] [instance: e1ca7a75-7b25-4465-b3f4-3f4d5269c723] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:15.719619 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=83,nova_api:SAVEPOINT=5,nova_api:RELEASE=5,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:57:15.736047 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6111efc0-cb8c-45e0-94bd-1e4c579a648c tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:15.736714 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6111efc0-cb8c-45e0-94bd-1e4c579a648c tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:15.739079 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6111efc0-cb8c-45e0-94bd-1e4c579a648c tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:15.739904 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6111efc0-cb8c-45e0-94bd-1e4c579a648c tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:15.740386 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6111efc0-cb8c-45e0-94bd-1e4c579a648c tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:15.740822 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6111efc0-cb8c-45e0-94bd-1e4c579a648c tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:16.008415 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-724b3876-902c-44e6-aebd-7b93fc7669fb tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56" status: 200 len: 1644 microversion: 2.1 time: 0.541641 Aug 31 15:57:16.010123 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 192/367] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:15 2022] GET /compute/v2.1/servers/bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56 => generated 1644 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:16.032844 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8b4d2bef-940d-4229-9e4f-e7443494565b tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:16.047169 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8b4d2bef-940d-4229-9e4f-e7443494565b tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:16.048191 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8b4d2bef-940d-4229-9e4f-e7443494565b tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:16.050324 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8b4d2bef-940d-4229-9e4f-e7443494565b tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:16.051559 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8b4d2bef-940d-4229-9e4f-e7443494565b tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:16.055376 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8b4d2bef-940d-4229-9e4f-e7443494565b tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:16.056227 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8b4d2bef-940d-4229-9e4f-e7443494565b tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:16.100294 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=88,nova_api:SAVEPOINT=4,nova_api:RELEASE=4,nova_api:DELETE=4 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:57:16.111515 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-6111efc0-cb8c-45e0-94bd-1e4c579a648c tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd1dfe05c037461d8dfb45a6f611ced0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd5a49a78854f22aa3c58d01058e493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:16.120526 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6111efc0-cb8c-45e0-94bd-1e4c579a648c tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] 10.222.0.61 "GET /compute/v2.1/servers/e1ca7a75-7b25-4465-b3f4-3f4d5269c723" status: 200 len: 1320 microversion: 2.1 time: 0.410014 Aug 31 15:57:16.122035 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 176/368] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:15 2022] GET /compute/v2.1/servers/e1ca7a75-7b25-4465-b3f4-3f4d5269c723 => generated 1320 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:57:16.157846 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8b4d2bef-940d-4229-9e4f-e7443494565b tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] 10.222.0.61 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.130405 Aug 31 15:57:16.159646 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 193/369] 10.222.0.61 () {58 vars in 1176 bytes} [Wed Aug 31 15:57:16 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:57:16.176875 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1a178ac0-33d2-4d80-a489-9f39e6fd2ce8 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-850499-9", "block_migration": true, "disk_over_commit": false}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:57:16.182965 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1a178ac0-33d2-4d80-a489-9f39e6fd2ce8 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] [instance: bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:16.211445 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1a178ac0-33d2-4d80-a489-9f39e6fd2ce8 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:16.215823 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1a178ac0-33d2-4d80-a489-9f39e6fd2ce8 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:16.216419 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1a178ac0-33d2-4d80-a489-9f39e6fd2ce8 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:16.218396 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1a178ac0-33d2-4d80-a489-9f39e6fd2ce8 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:16.219755 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1a178ac0-33d2-4d80-a489-9f39e6fd2ce8 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:16.220700 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1a178ac0-33d2-4d80-a489-9f39e6fd2ce8 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:16.377819 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7ccf6478-14ec-4914-b267-cfe9f5c8f4cd tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:16.378658 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7ccf6478-14ec-4914-b267-cfe9f5c8f4cd tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 79ee7e24-93df-450b-9030-b08c00d019eb] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:16.408981 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7ccf6478-14ec-4914-b267-cfe9f5c8f4cd tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:16.411471 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7ccf6478-14ec-4914-b267-cfe9f5c8f4cd tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:16.412224 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7ccf6478-14ec-4914-b267-cfe9f5c8f4cd tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:16.413167 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7ccf6478-14ec-4914-b267-cfe9f5c8f4cd tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:16.413824 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7ccf6478-14ec-4914-b267-cfe9f5c8f4cd tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:16.414655 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7ccf6478-14ec-4914-b267-cfe9f5c8f4cd tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:16.432281 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-1a178ac0-33d2-4d80-a489-9f39e6fd2ce8 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lazy-loading 'flavor' on Instance uuid bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56 {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:57:16.569148 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1a178ac0-33d2-4d80-a489-9f39e6fd2ce8 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] [instance: bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56] Going to try to live migrate instance to n-h2-850499-9 {{(pid=122257) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 31 15:57:16.696419 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7ccf6478-14ec-4914-b267-cfe9f5c8f4cd tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:16.712536 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7ccf6478-14ec-4914-b267-cfe9f5c8f4cd tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:16.718942 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7ccf6478-14ec-4914-b267-cfe9f5c8f4cd tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:16.721800 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7ccf6478-14ec-4914-b267-cfe9f5c8f4cd tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/79ee7e24-93df-450b-9030-b08c00d019eb" status: 200 len: 1557 microversion: 2.25 time: 0.346540 Aug 31 15:57:16.722689 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 194/370] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:16 2022] GET /compute/v2.1/servers/79ee7e24-93df-450b-9030-b08c00d019eb => generated 1557 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:57:16.738256 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-dd0d928e-8bf9-42a7-9b64-58717fe1974c tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Calling method '.version_select at 0x7f5ae9751670>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:16.848606 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-dd0d928e-8bf9-42a7-9b64-58717fe1974c tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] 10.222.0.61 "GET /compute/v2.1/images/8c7686ef-2791-474b-9a88-1019551ffc49" status: 200 len: 1424 microversion: 2.1 time: 0.121964 Aug 31 15:57:16.850191 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 195/371] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 15:57:16 2022] GET /compute/v2.1/images/8c7686ef-2791-474b-9a88-1019551ffc49 => generated 1424 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:16.857341 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6af29042-8914-4517-9597-ca902c0a5201 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:16.858785 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6af29042-8914-4517-9597-ca902c0a5201 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] [instance: f2162319-5635-4c77-920d-9ecb3221d174] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:16.867216 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6af29042-8914-4517-9597-ca902c0a5201 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:16.868445 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6af29042-8914-4517-9597-ca902c0a5201 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:16.869168 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6af29042-8914-4517-9597-ca902c0a5201 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:16.870291 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6af29042-8914-4517-9597-ca902c0a5201 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:16.872166 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6af29042-8914-4517-9597-ca902c0a5201 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:16.872924 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6af29042-8914-4517-9597-ca902c0a5201 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:17.019083 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-6af29042-8914-4517-9597-ca902c0a5201 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lazy-loading 'services' on Instance uuid f2162319-5635-4c77-920d-9ecb3221d174 {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:57:17.062474 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6af29042-8914-4517-9597-ca902c0a5201 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174" status: 200 len: 1929 microversion: 2.75 time: 0.210038 Aug 31 15:57:17.063396 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 196/372] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:16 2022] GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174 => generated 1929 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:57:17.360685 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9c02858e-62a2-40fa-bbdb-ac13747b27f8 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:17.361327 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9c02858e-62a2-40fa-bbdb-ac13747b27f8 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] [instance: 79ee7e24-93df-450b-9030-b08c00d019eb] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:17.370374 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9c02858e-62a2-40fa-bbdb-ac13747b27f8 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:17.374850 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9c02858e-62a2-40fa-bbdb-ac13747b27f8 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:17.375414 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9c02858e-62a2-40fa-bbdb-ac13747b27f8 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:17.376202 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9c02858e-62a2-40fa-bbdb-ac13747b27f8 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:17.376686 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9c02858e-62a2-40fa-bbdb-ac13747b27f8 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:17.377121 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9c02858e-62a2-40fa-bbdb-ac13747b27f8 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:17.972855 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-9c02858e-62a2-40fa-bbdb-ac13747b27f8 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lazy-loading 'services' on Instance uuid 79ee7e24-93df-450b-9030-b08c00d019eb {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:57:18.022013 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9c02858e-62a2-40fa-bbdb-ac13747b27f8 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/79ee7e24-93df-450b-9030-b08c00d019eb" status: 200 len: 2049 microversion: 2.25 time: 0.957637 Aug 31 15:57:18.022645 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 197/373] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:17 2022] GET /compute/v2.1/servers/79ee7e24-93df-450b-9030-b08c00d019eb => generated 2049 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:57:18.040094 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ace604ec-0df5-4a65-a080-21536e308049 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:18.040716 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ace604ec-0df5-4a65-a080-21536e308049 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] [instance: e1ca7a75-7b25-4465-b3f4-3f4d5269c723] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:18.062546 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ace604ec-0df5-4a65-a080-21536e308049 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:18.063010 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ace604ec-0df5-4a65-a080-21536e308049 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:18.063455 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ace604ec-0df5-4a65-a080-21536e308049 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:18.064203 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ace604ec-0df5-4a65-a080-21536e308049 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:18.064659 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ace604ec-0df5-4a65-a080-21536e308049 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:18.065081 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ace604ec-0df5-4a65-a080-21536e308049 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:18.460412 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ace604ec-0df5-4a65-a080-21536e308049 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd1dfe05c037461d8dfb45a6f611ced0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd5a49a78854f22aa3c58d01058e493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:18.470991 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ace604ec-0df5-4a65-a080-21536e308049 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] 10.222.0.61 "GET /compute/v2.1/servers/e1ca7a75-7b25-4465-b3f4-3f4d5269c723" status: 200 len: 1320 microversion: 2.1 time: 0.435740 Aug 31 15:57:18.491654 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 198/374] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:18 2022] GET /compute/v2.1/servers/e1ca7a75-7b25-4465-b3f4-3f4d5269c723 => generated 1320 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:18.502158 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a933b92b-9c44-43e8-8576-cc62c7722d02 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Calling method '.version_select at 0x7f5ae9751790>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:18.600253 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a933b92b-9c44-43e8-8576-cc62c7722d02 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] 10.222.0.61 "GET /compute/v2.1/images/8c7686ef-2791-474b-9a88-1019551ffc49" status: 200 len: 1424 microversion: 2.1 time: 0.107260 Aug 31 15:57:18.610748 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 199/375] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 15:57:18 2022] GET /compute/v2.1/images/8c7686ef-2791-474b-9a88-1019551ffc49 => generated 1424 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:18.616233 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9724677c-875e-466c-9dee-89da8b3abd4f tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:18.617164 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9724677c-875e-466c-9dee-89da8b3abd4f tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] [instance: 79ee7e24-93df-450b-9030-b08c00d019eb] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:18.624679 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9724677c-875e-466c-9dee-89da8b3abd4f tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:18.625491 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9724677c-875e-466c-9dee-89da8b3abd4f tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:18.626157 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9724677c-875e-466c-9dee-89da8b3abd4f tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:18.627075 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9724677c-875e-466c-9dee-89da8b3abd4f tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:18.627836 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9724677c-875e-466c-9dee-89da8b3abd4f tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:18.628499 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9724677c-875e-466c-9dee-89da8b3abd4f tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:19.138212 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-9724677c-875e-466c-9dee-89da8b3abd4f tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lazy-loading 'services' on Instance uuid 79ee7e24-93df-450b-9030-b08c00d019eb {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:57:19.172630 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9724677c-875e-466c-9dee-89da8b3abd4f tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/79ee7e24-93df-450b-9030-b08c00d019eb" status: 200 len: 2049 microversion: 2.25 time: 0.560318 Aug 31 15:57:19.175277 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 200/376] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:18 2022] GET /compute/v2.1/servers/79ee7e24-93df-450b-9030-b08c00d019eb => generated 2049 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:57:19.181910 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2817e72f-7758-4df7-9af8-6908b5f85e42 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:19.186722 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2817e72f-7758-4df7-9af8-6908b5f85e42 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] [instance: f2162319-5635-4c77-920d-9ecb3221d174] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:19.209579 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2817e72f-7758-4df7-9af8-6908b5f85e42 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:19.211335 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2817e72f-7758-4df7-9af8-6908b5f85e42 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:19.212306 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2817e72f-7758-4df7-9af8-6908b5f85e42 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:19.213626 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2817e72f-7758-4df7-9af8-6908b5f85e42 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:19.214375 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2817e72f-7758-4df7-9af8-6908b5f85e42 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:19.215220 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2817e72f-7758-4df7-9af8-6908b5f85e42 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:19.371830 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-2817e72f-7758-4df7-9af8-6908b5f85e42 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lazy-loading 'services' on Instance uuid f2162319-5635-4c77-920d-9ecb3221d174 {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:57:19.406399 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2817e72f-7758-4df7-9af8-6908b5f85e42 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174" status: 200 len: 1929 microversion: 2.75 time: 0.229795 Aug 31 15:57:19.408216 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 201/377] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:19 2022] GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174 => generated 1929 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:57:19.414210 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-059dc1d1-7a79-4596-b89e-82d3517d57e9 req-2b5c1f45-7c1d-4271-a591-06179272fa5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1ca7a75-7b25-4465-b3f4-3f4d5269c723", "name": "network-vif-plugged", "status": "completed", "tag": "fe0826ab-55c5-467e-b7d7-83da41f83da6"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:57:19.427545 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-059dc1d1-7a79-4596-b89e-82d3517d57e9 req-2b5c1f45-7c1d-4271-a591-06179272fa5b service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:19.428325 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-059dc1d1-7a79-4596-b89e-82d3517d57e9 req-2b5c1f45-7c1d-4271-a591-06179272fa5b service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:19.428952 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-059dc1d1-7a79-4596-b89e-82d3517d57e9 req-2b5c1f45-7c1d-4271-a591-06179272fa5b service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:19.442663 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-059dc1d1-7a79-4596-b89e-82d3517d57e9 req-2b5c1f45-7c1d-4271-a591-06179272fa5b service nova] Creating event network-vif-plugged:fe0826ab-55c5-467e-b7d7-83da41f83da6 for instance e1ca7a75-7b25-4465-b3f4-3f4d5269c723 on n-h2-850499-9 Aug 31 15:57:19.449653 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-059dc1d1-7a79-4596-b89e-82d3517d57e9 req-2b5c1f45-7c1d-4271-a591-06179272fa5b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038903 Aug 31 15:57:19.450924 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 202/378] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 15:57:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:57:19.459359 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9a081add-66f7-44c9-9831-d7b96fbafca6 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:19.463538 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9a081add-66f7-44c9-9831-d7b96fbafca6 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:19.464304 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9a081add-66f7-44c9-9831-d7b96fbafca6 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:19.465656 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9a081add-66f7-44c9-9831-d7b96fbafca6 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:19.466745 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9a081add-66f7-44c9-9831-d7b96fbafca6 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:19.467587 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9a081add-66f7-44c9-9831-d7b96fbafca6 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:19.468902 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9a081add-66f7-44c9-9831-d7b96fbafca6 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:19.514555 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9a081add-66f7-44c9-9831-d7b96fbafca6 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] 10.222.0.61 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.062047 Aug 31 15:57:19.515885 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 203/379] 10.222.0.61 () {60 vars in 1217 bytes} [Wed Aug 31 15:57:19 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 15:57:19.521005 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4241e998-ae6b-4e06-9f9e-5bf93d577ce5 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:19.521960 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4241e998-ae6b-4e06-9f9e-5bf93d577ce5 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] [instance: e1ca7a75-7b25-4465-b3f4-3f4d5269c723] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:19.530984 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4241e998-ae6b-4e06-9f9e-5bf93d577ce5 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:19.531752 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4241e998-ae6b-4e06-9f9e-5bf93d577ce5 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:19.532375 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4241e998-ae6b-4e06-9f9e-5bf93d577ce5 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:19.533288 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4241e998-ae6b-4e06-9f9e-5bf93d577ce5 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:19.534763 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4241e998-ae6b-4e06-9f9e-5bf93d577ce5 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:19.535412 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4241e998-ae6b-4e06-9f9e-5bf93d577ce5 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:20.044628 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-4241e998-ae6b-4e06-9f9e-5bf93d577ce5 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd1dfe05c037461d8dfb45a6f611ced0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd5a49a78854f22aa3c58d01058e493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:20.064331 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4241e998-ae6b-4e06-9f9e-5bf93d577ce5 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] 10.222.0.61 "GET /compute/v2.1/servers/e1ca7a75-7b25-4465-b3f4-3f4d5269c723" status: 200 len: 1320 microversion: 2.1 time: 0.545880 Aug 31 15:57:20.064949 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 204/380] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:19 2022] GET /compute/v2.1/servers/e1ca7a75-7b25-4465-b3f4-3f4d5269c723 => generated 1320 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:20.094402 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f77e8c10-5a84-4851-8e64-b22bdf1efb3b tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-850499-9", "block_migration": "auto"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:57:20.097306 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f77e8c10-5a84-4851-8e64-b22bdf1efb3b tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] [instance: 79ee7e24-93df-450b-9030-b08c00d019eb] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:20.108274 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f77e8c10-5a84-4851-8e64-b22bdf1efb3b tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:20.109343 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f77e8c10-5a84-4851-8e64-b22bdf1efb3b tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:20.109962 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f77e8c10-5a84-4851-8e64-b22bdf1efb3b tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:20.111040 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f77e8c10-5a84-4851-8e64-b22bdf1efb3b tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:20.111712 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f77e8c10-5a84-4851-8e64-b22bdf1efb3b tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:20.112360 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f77e8c10-5a84-4851-8e64-b22bdf1efb3b tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:20.962390 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1a178ac0-33d2-4d80-a489-9f39e6fd2ce8 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56/action" status: 202 len: 0 microversion: 2.1 time: 4.792293 Aug 31 15:57:20.963827 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 177/381] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 15:57:16 2022] POST /compute/v2.1/servers/bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56/action => generated 0 bytes in 4795 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 15:57:20.969676 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-764c6586-162f-4b19-b63a-9442117ef331 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Calling method '.version_select at 0x7f5ae974a1f0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:21.072616 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-764c6586-162f-4b19-b63a-9442117ef331 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] 10.222.0.61 "GET /compute/v2.1/images/8c7686ef-2791-474b-9a88-1019551ffc49" status: 200 len: 1424 microversion: 2.1 time: 0.107400 Aug 31 15:57:21.083939 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 178/382] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 15:57:20 2022] GET /compute/v2.1/images/8c7686ef-2791-474b-9a88-1019551ffc49 => generated 1424 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:21.100880 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ea4722a7-3901-4bbc-bdf7-948145973e19 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:21.104314 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ea4722a7-3901-4bbc-bdf7-948145973e19 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] [instance: f2162319-5635-4c77-920d-9ecb3221d174] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:21.116166 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ea4722a7-3901-4bbc-bdf7-948145973e19 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:21.118524 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ea4722a7-3901-4bbc-bdf7-948145973e19 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:21.119204 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ea4722a7-3901-4bbc-bdf7-948145973e19 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:21.124257 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ea4722a7-3901-4bbc-bdf7-948145973e19 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:21.125036 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ea4722a7-3901-4bbc-bdf7-948145973e19 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:21.125719 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ea4722a7-3901-4bbc-bdf7-948145973e19 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:21.299897 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-f77e8c10-5a84-4851-8e64-b22bdf1efb3b tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lazy-loading 'flavor' on Instance uuid 79ee7e24-93df-450b-9030-b08c00d019eb {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:57:21.401181 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-ea4722a7-3901-4bbc-bdf7-948145973e19 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lazy-loading 'services' on Instance uuid f2162319-5635-4c77-920d-9ecb3221d174 {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:57:21.436718 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f77e8c10-5a84-4851-8e64-b22bdf1efb3b tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] [instance: 79ee7e24-93df-450b-9030-b08c00d019eb] Going to try to live migrate instance to n-h2-850499-9 {{(pid=122256) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 31 15:57:21.464096 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ea4722a7-3901-4bbc-bdf7-948145973e19 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174" status: 200 len: 1929 microversion: 2.75 time: 0.378636 Aug 31 15:57:21.467305 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 179/383] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:21 2022] GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174 => generated 1929 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:57:21.488104 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d659f42a-d002-4196-bc18-b8dc79d0f887 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:21.497315 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d659f42a-d002-4196-bc18-b8dc79d0f887 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:21.507065 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d659f42a-d002-4196-bc18-b8dc79d0f887 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:21.507764 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d659f42a-d002-4196-bc18-b8dc79d0f887 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:21.510148 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d659f42a-d002-4196-bc18-b8dc79d0f887 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:21.512869 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d659f42a-d002-4196-bc18-b8dc79d0f887 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:21.513573 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d659f42a-d002-4196-bc18-b8dc79d0f887 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:21.514307 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d659f42a-d002-4196-bc18-b8dc79d0f887 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:21.906531 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:57:22.233260 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d659f42a-d002-4196-bc18-b8dc79d0f887 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:22.244100 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d659f42a-d002-4196-bc18-b8dc79d0f887 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56" status: 200 len: 1503 microversion: 2.1 time: 0.772219 Aug 31 15:57:22.245033 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 180/384] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:21 2022] GET /compute/v2.1/servers/bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56 => generated 1503 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:22.255113 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b873f207-aa61-4189-a3c6-69b13e4c633b tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:22.266669 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b873f207-aa61-4189-a3c6-69b13e4c633b tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] [instance: e1ca7a75-7b25-4465-b3f4-3f4d5269c723] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:22.272963 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b873f207-aa61-4189-a3c6-69b13e4c633b tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:22.273763 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b873f207-aa61-4189-a3c6-69b13e4c633b tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:22.274394 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b873f207-aa61-4189-a3c6-69b13e4c633b tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:22.280470 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b873f207-aa61-4189-a3c6-69b13e4c633b tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:22.281210 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b873f207-aa61-4189-a3c6-69b13e4c633b tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:22.281833 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b873f207-aa61-4189-a3c6-69b13e4c633b tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:22.535646 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b873f207-aa61-4189-a3c6-69b13e4c633b tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd1dfe05c037461d8dfb45a6f611ced0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd5a49a78854f22aa3c58d01058e493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:22.545981 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b873f207-aa61-4189-a3c6-69b13e4c633b tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] 10.222.0.61 "GET /compute/v2.1/servers/e1ca7a75-7b25-4465-b3f4-3f4d5269c723" status: 200 len: 1470 microversion: 2.1 time: 0.294563 Aug 31 15:57:22.547256 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 181/385] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:22 2022] GET /compute/v2.1/servers/e1ca7a75-7b25-4465-b3f4-3f4d5269c723 => generated 1470 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:22.846191 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f7e33870-2fc8-4f9d-80d2-9ae7ab63233b tempest-FlavorsExtraSpecsNegativeTestJSON-899953835 tempest-FlavorsExtraSpecsNegativeTestJSON-899953835-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-2105943993", "ram": 512, "vcpus": 1, "disk": 10, "id": 930065299, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:57:22.890548 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f7e33870-2fc8-4f9d-80d2-9ae7ab63233b tempest-FlavorsExtraSpecsNegativeTestJSON-899953835 tempest-FlavorsExtraSpecsNegativeTestJSON-899953835-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.341170 Aug 31 15:57:22.891452 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 182/386] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 15:57:22 2022] POST /compute/v2.1/flavors => generated 413 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:57:22.904684 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c2fcaeb8-40c2-49ee-95d1-d527f83ee229 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Calling method '.version_select at 0x7f5ae94e00d0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:22.959721 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c2fcaeb8-40c2-49ee-95d1-d527f83ee229 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] 10.222.0.61 "GET /compute/v2.1/images/8c7686ef-2791-474b-9a88-1019551ffc49" status: 200 len: 1424 microversion: 2.1 time: 0.058966 Aug 31 15:57:22.960989 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 183/387] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 15:57:22 2022] GET /compute/v2.1/images/8c7686ef-2791-474b-9a88-1019551ffc49 => generated 1424 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:22.967445 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-175b2c23-0f38-4307-b3ba-9ca86386b650 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:22.968922 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-175b2c23-0f38-4307-b3ba-9ca86386b650 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] [instance: f2162319-5635-4c77-920d-9ecb3221d174] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:22.976792 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-175b2c23-0f38-4307-b3ba-9ca86386b650 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:22.977556 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-175b2c23-0f38-4307-b3ba-9ca86386b650 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:22.978145 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-175b2c23-0f38-4307-b3ba-9ca86386b650 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:22.979001 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-175b2c23-0f38-4307-b3ba-9ca86386b650 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:22.979640 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-175b2c23-0f38-4307-b3ba-9ca86386b650 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:22.980292 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-175b2c23-0f38-4307-b3ba-9ca86386b650 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:23.085170 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-175b2c23-0f38-4307-b3ba-9ca86386b650 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lazy-loading 'services' on Instance uuid f2162319-5635-4c77-920d-9ecb3221d174 {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:57:23.110675 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-175b2c23-0f38-4307-b3ba-9ca86386b650 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174" status: 200 len: 1929 microversion: 2.75 time: 0.147965 Aug 31 15:57:23.112353 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 184/388] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:22 2022] GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174 => generated 1929 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:57:23.341688 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6aaf80c9-b13d-49a8-8bb8-25207f986ec8 tempest-DeleteServersAdminTestJSON-870258220 tempest-DeleteServersAdminTestJSON-870258220-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:23.342273 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6aaf80c9-b13d-49a8-8bb8-25207f986ec8 tempest-DeleteServersAdminTestJSON-870258220 tempest-DeleteServersAdminTestJSON-870258220-project-admin] [instance: e1ca7a75-7b25-4465-b3f4-3f4d5269c723] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:23.355912 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6aaf80c9-b13d-49a8-8bb8-25207f986ec8 tempest-DeleteServersAdminTestJSON-870258220 tempest-DeleteServersAdminTestJSON-870258220-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:23.356746 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6aaf80c9-b13d-49a8-8bb8-25207f986ec8 tempest-DeleteServersAdminTestJSON-870258220 tempest-DeleteServersAdminTestJSON-870258220-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:23.357374 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6aaf80c9-b13d-49a8-8bb8-25207f986ec8 tempest-DeleteServersAdminTestJSON-870258220 tempest-DeleteServersAdminTestJSON-870258220-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:23.358285 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6aaf80c9-b13d-49a8-8bb8-25207f986ec8 tempest-DeleteServersAdminTestJSON-870258220 tempest-DeleteServersAdminTestJSON-870258220-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:23.358912 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6aaf80c9-b13d-49a8-8bb8-25207f986ec8 tempest-DeleteServersAdminTestJSON-870258220 tempest-DeleteServersAdminTestJSON-870258220-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:23.359513 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6aaf80c9-b13d-49a8-8bb8-25207f986ec8 tempest-DeleteServersAdminTestJSON-870258220 tempest-DeleteServersAdminTestJSON-870258220-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:23.394179 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6aaf80c9-b13d-49a8-8bb8-25207f986ec8 tempest-DeleteServersAdminTestJSON-870258220 tempest-DeleteServersAdminTestJSON-870258220-project-admin] [instance: e1ca7a75-7b25-4465-b3f4-3f4d5269c723] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 15:57:23.513479 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6aaf80c9-b13d-49a8-8bb8-25207f986ec8 tempest-DeleteServersAdminTestJSON-870258220 tempest-DeleteServersAdminTestJSON-870258220-project-admin] 10.222.0.61 "DELETE /compute/v2.1/servers/e1ca7a75-7b25-4465-b3f4-3f4d5269c723" status: 204 len: 0 microversion: 2.1 time: 0.398879 Aug 31 15:57:23.514361 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 185/389] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 15:57:23 2022] DELETE /compute/v2.1/servers/e1ca7a75-7b25-4465-b3f4-3f4d5269c723 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 15:57:23.705868 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-db35578e-f692-444d-b636-72a243721903 tempest-FlavorsExtraSpecsNegativeTestJSON-994677525 tempest-FlavorsExtraSpecsNegativeTestJSON-994677525-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:23.717538 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-db35578e-f692-444d-b636-72a243721903 tempest-FlavorsExtraSpecsNegativeTestJSON-994677525 tempest-FlavorsExtraSpecsNegativeTestJSON-994677525-project] HTTP exception thrown: Flavor 930065299 has no extra specs with key hw:cpu_thread_policy. Aug 31 15:57:23.720286 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-db35578e-f692-444d-b636-72a243721903 tempest-FlavorsExtraSpecsNegativeTestJSON-994677525 tempest-FlavorsExtraSpecsNegativeTestJSON-994677525-project] Request method failure captured: Aug 31 15:57:23.720286 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/flavors/930065299/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Aug 31 15:57:23.720286 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 15:57:23.720286 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 15:57:23.720286 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 15:57:23.720286 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 15:57:23.720286 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 15:57:23.720286 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 15:57:23.720286 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 15:57:23.720286 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 15:57:23.720286 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4TgyIqZLMbIcG01DOrCcZvBwk3o8HPTGo6jQ0XzrEVt3PYoVr7B2zzrYwQxwGF5m9rKfG74BcJtLdt_alWiGIYmMpY5hcdeqOdQizSEN5192vIrG1W9TQf_om596_UlgtLzbnoAgSWhssO6raKQZDcygkuSwaVCLPiZF66lXF71RiY Aug 31 15:57:23.720286 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 15:57:23.720286 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 15:57:23.720286 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 15:57:23.720286 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 15:57:23.720286 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 15:57:23.720286 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 15:57:23.720286 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 653be0311c044603ad3bb6cf2187d824 Aug 31 15:57:23.720286 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-994677525 Aug 31 15:57:23.720286 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 15:57:23.720286 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 15:57:23.721784 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/653be0311c044603ad3bb6cf2187d824"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/653be0311c044603ad3bb6cf2187d824"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_653be0311c044603ad3bb6cf2187d824", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/653be0311c044603ad3bb6cf2187d824"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 15:57:23.721784 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-994677525 Aug 31 15:57:23.721784 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 653be0311c044603ad3bb6cf2187d824 Aug 31 15:57:23.721784 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-994677525 Aug 31 15:57:23.721784 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-994677525-project Aug 31 15:57:23.721784 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 15:57:23.721784 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 15:57:23.721784 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 675bb592dd8d4705be91325faa6ce553 Aug 31 15:57:23.721784 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-994677525-project Aug 31 15:57:23.721784 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 15:57:23.721784 n-d-850499-9 devstack@n-api.service[122257]: exception: Flavor 930065299 has no extra specs with key hw:cpu_thread_policy. Aug 31 15:57:23.722571 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'flavor_id': '930065299', 'id': 'hw:cpu_thread_policy'} Aug 31 15:57:23.722571 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:57:23.722571 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:57:23.722571 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Aug 31 15:57:23.722571 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Aug 31 15:57:23.722571 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Aug 31 15:57:23.722571 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:57:23.722571 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:57:23.722571 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:57:23.722571 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:57:23.722571 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:57:23.722571 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:57:23.722571 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:57:23.722571 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:57:23.722571 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:57:23.722571 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:57:23.722571 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Aug 31 15:57:23.722571 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 31 15:57:23.722571 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 930065299 has no extra specs with key hw:cpu_thread_policy. Aug 31 15:57:23.722571 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:57:23.722571 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:57:23.722571 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:57:23.724112 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:57:23.724112 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:57:23.724112 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:57:23.724112 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:57:23.724112 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:57:23.724112 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 930065299 has no extra specs with key hw:cpu_thread_policy. Aug 31 15:57:23.724112 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:57:23.724112 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-db35578e-f692-444d-b636-72a243721903 tempest-FlavorsExtraSpecsNegativeTestJSON-994677525 tempest-FlavorsExtraSpecsNegativeTestJSON-994677525-project] Returning 404 to user: Flavor 930065299 has no extra specs with key hw:cpu_thread_policy. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:57:23.724804 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-db35578e-f692-444d-b636-72a243721903 tempest-FlavorsExtraSpecsNegativeTestJSON-994677525 tempest-FlavorsExtraSpecsNegativeTestJSON-994677525-project] 10.222.0.61 "GET /compute/v2.1/flavors/930065299/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.208230 Aug 31 15:57:23.731342 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 186/390] 10.222.0.61 () {58 vars in 1263 bytes} [Wed Aug 31 15:57:23 2022] GET /compute/v2.1/flavors/930065299/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 213 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:57:23.736192 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5cab2698-29fc-4307-bb74-fbb5bc44db74 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:23.736935 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5cab2698-29fc-4307-bb74-fbb5bc44db74 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:23.757691 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5cab2698-29fc-4307-bb74-fbb5bc44db74 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:23.758262 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5cab2698-29fc-4307-bb74-fbb5bc44db74 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:23.758721 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5cab2698-29fc-4307-bb74-fbb5bc44db74 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:23.759671 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5cab2698-29fc-4307-bb74-fbb5bc44db74 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:23.760144 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5cab2698-29fc-4307-bb74-fbb5bc44db74 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:23.760587 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5cab2698-29fc-4307-bb74-fbb5bc44db74 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:24.046976 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5cab2698-29fc-4307-bb74-fbb5bc44db74 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:24.063403 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5cab2698-29fc-4307-bb74-fbb5bc44db74 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56" status: 200 len: 1503 microversion: 2.1 time: 0.330744 Aug 31 15:57:24.081503 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 187/391] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:23 2022] GET /compute/v2.1/servers/bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56 => generated 1503 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:24.093989 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-056d9b0d-828d-42e9-8277-4f04ccfd59a8 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:24.094897 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-056d9b0d-828d-42e9-8277-4f04ccfd59a8 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] [instance: e1ca7a75-7b25-4465-b3f4-3f4d5269c723] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:24.105619 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-056d9b0d-828d-42e9-8277-4f04ccfd59a8 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:24.106618 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-056d9b0d-828d-42e9-8277-4f04ccfd59a8 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:24.107355 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-056d9b0d-828d-42e9-8277-4f04ccfd59a8 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:24.108343 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-056d9b0d-828d-42e9-8277-4f04ccfd59a8 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:24.109049 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-056d9b0d-828d-42e9-8277-4f04ccfd59a8 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:24.109791 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-056d9b0d-828d-42e9-8277-4f04ccfd59a8 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:24.220644 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f77e8c10-5a84-4851-8e64-b22bdf1efb3b tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/79ee7e24-93df-450b-9030-b08c00d019eb/action" status: 202 len: 0 microversion: 2.25 time: 4.139731 Aug 31 15:57:24.222238 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 205/392] 10.222.0.61 () {62 vars in 1319 bytes} [Wed Aug 31 15:57:20 2022] POST /compute/v2.1/servers/79ee7e24-93df-450b-9030-b08c00d019eb/action => generated 0 bytes in 4157 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 15:57:24.229828 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a0fd6855-147d-4968-8cd4-5adc14f641f9 tempest-FlavorsExtraSpecsNegativeTestJSON-994677525 tempest-FlavorsExtraSpecsNegativeTestJSON-994677525-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:57:24.251426 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a0fd6855-147d-4968-8cd4-5adc14f641f9 tempest-FlavorsExtraSpecsNegativeTestJSON-994677525 tempest-FlavorsExtraSpecsNegativeTestJSON-994677525-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '675bb592dd8d4705be91325faa6ce553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653be0311c044603ad3bb6cf2187d824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:24.282652 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a0fd6855-147d-4968-8cd4-5adc14f641f9 tempest-FlavorsExtraSpecsNegativeTestJSON-994677525 tempest-FlavorsExtraSpecsNegativeTestJSON-994677525-project] Request method failure captured: Aug 31 15:57:24.282652 n-d-850499-9 devstack@n-api.service[122256]: request: POST /compute/v2.1/flavors/930065299/os-extra_specs HTTP/1.1 Aug 31 15:57:24.282652 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 15:57:24.282652 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 15:57:24.282652 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 15:57:24.282652 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 66 Aug 31 15:57:24.282652 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 15:57:24.282652 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 15:57:24.282652 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 15:57:24.282652 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 15:57:24.282652 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4TgyIqZLMbIcG01DOrCcZvBwk3o8HPTGo6jQ0XzrEVt3PYoVr7B2zzrYwQxwGF5m9rKfG74BcJtLdt_alWiGIYmMpY5hcdeqOdQizSEN5192vIrG1W9TQf_om596_UlgtLzbnoAgSWhssO6raKQZDcygkuSwaVCLPiZF66lXF71RiY Aug 31 15:57:24.282652 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 15:57:24.282652 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 15:57:24.282652 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 15:57:24.282652 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 15:57:24.282652 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 15:57:24.282652 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 15:57:24.282652 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 653be0311c044603ad3bb6cf2187d824 Aug 31 15:57:24.282652 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-994677525 Aug 31 15:57:24.282652 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 15:57:24.282652 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 15:57:24.284167 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/653be0311c044603ad3bb6cf2187d824"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/653be0311c044603ad3bb6cf2187d824"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_653be0311c044603ad3bb6cf2187d824", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/653be0311c044603ad3bb6cf2187d824"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 15:57:24.284167 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-994677525 Aug 31 15:57:24.284167 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 653be0311c044603ad3bb6cf2187d824 Aug 31 15:57:24.284167 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-994677525 Aug 31 15:57:24.284167 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-994677525-project Aug 31 15:57:24.284167 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 15:57:24.284167 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 15:57:24.284167 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 675bb592dd8d4705be91325faa6ce553 Aug 31 15:57:24.284167 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-994677525-project Aug 31 15:57:24.284167 n-d-850499-9 devstack@n-api.service[122256]: Aug 31 15:57:24.284167 n-d-850499-9 devstack@n-api.service[122256]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Aug 31 15:57:24.284167 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 15:57:24.284938 n-d-850499-9 devstack@n-api.service[122256]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 31 15:57:24.284938 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'flavor_id': '930065299', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Aug 31 15:57:24.284938 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:57:24.284938 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:57:24.284938 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:57:24.284938 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:57:24.284938 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:57:24.284938 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:57:24.284938 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:57:24.284938 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:57:24.284938 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:57:24.284938 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:57:24.284938 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Aug 31 15:57:24.284938 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Aug 31 15:57:24.284938 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 31 15:57:24.284938 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 31 15:57:24.284938 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 31 15:57:24.284938 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 31 15:57:24.284938 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 15:57:24.286241 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 31 15:57:24.286241 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 15:57:24.286241 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise self.value Aug 31 15:57:24.286241 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 31 15:57:24.286241 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 31 15:57:24.286241 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 31 15:57:24.286241 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 31 15:57:24.286241 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 31 15:57:24.286241 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 31 15:57:24.286241 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 31 15:57:24.286241 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:57:24.286241 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:57:24.286241 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:57:24.286241 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:57:24.286241 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:57:24.286241 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:57:24.286241 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 31 15:57:24.286241 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 31 15:57:24.286241 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 31 15:57:24.286241 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:57:24.288709 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a0fd6855-147d-4968-8cd4-5adc14f641f9 tempest-FlavorsExtraSpecsNegativeTestJSON-994677525 tempest-FlavorsExtraSpecsNegativeTestJSON-994677525-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:57:24.290319 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a0fd6855-147d-4968-8cd4-5adc14f641f9 tempest-FlavorsExtraSpecsNegativeTestJSON-994677525 tempest-FlavorsExtraSpecsNegativeTestJSON-994677525-project] 10.222.0.61 "POST /compute/v2.1/flavors/930065299/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.066822 Aug 31 15:57:24.295346 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 206/393] 10.222.0.61 () {60 vars in 1221 bytes} [Wed Aug 31 15:57:24 2022] POST /compute/v2.1/flavors/930065299/os-extra_specs => generated 124 bytes in 72 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:57:24.317993 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-57df13db-e75b-4e4a-876b-0766a5d755b4 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Calling method '.version_select at 0x7f5ae9559f70>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:24.329126 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-056d9b0d-828d-42e9-8277-4f04ccfd59a8 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd1dfe05c037461d8dfb45a6f611ced0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd5a49a78854f22aa3c58d01058e493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:24.342996 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-056d9b0d-828d-42e9-8277-4f04ccfd59a8 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] 10.222.0.61 "GET /compute/v2.1/servers/e1ca7a75-7b25-4465-b3f4-3f4d5269c723" status: 200 len: 1476 microversion: 2.1 time: 0.259597 Aug 31 15:57:24.346013 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 188/394] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:24 2022] GET /compute/v2.1/servers/e1ca7a75-7b25-4465-b3f4-3f4d5269c723 => generated 1476 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:24.355860 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-e56208e8-5eb1-45e0-94f1-9fa95dd72020 req-3ccc3add-f376-498c-9cec-d2580448c0af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56", "name": "network-vif-unplugged", "status": "completed", "tag": "2b648b75-ab1e-4141-bc80-3cbc9b5b261b"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:57:24.366488 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-e56208e8-5eb1-45e0-94f1-9fa95dd72020 req-3ccc3add-f376-498c-9cec-d2580448c0af service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:24.367234 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-e56208e8-5eb1-45e0-94f1-9fa95dd72020 req-3ccc3add-f376-498c-9cec-d2580448c0af service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:24.368891 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-e56208e8-5eb1-45e0-94f1-9fa95dd72020 req-3ccc3add-f376-498c-9cec-d2580448c0af service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:24.374035 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:57:24.385804 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-e56208e8-5eb1-45e0-94f1-9fa95dd72020 req-3ccc3add-f376-498c-9cec-d2580448c0af service nova] Creating event network-vif-unplugged:2b648b75-ab1e-4141-bc80-3cbc9b5b261b for instance bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56 on n-h1-850499-9 Aug 31 15:57:24.402505 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-e56208e8-5eb1-45e0-94f1-9fa95dd72020 req-3ccc3add-f376-498c-9cec-d2580448c0af service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054649 Aug 31 15:57:24.403410 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 189/395] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 15:57:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:57:24.409152 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-260fcf65-6d6b-47e4-9972-ce029f29bcdb tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:24.409971 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-260fcf65-6d6b-47e4-9972-ce029f29bcdb tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] [instance: f2162319-5635-4c77-920d-9ecb3221d174] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:24.424988 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-57df13db-e75b-4e4a-876b-0766a5d755b4 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] 10.222.0.61 "GET /compute/v2.1/images/8c7686ef-2791-474b-9a88-1019551ffc49" status: 200 len: 1424 microversion: 2.1 time: 0.128097 Aug 31 15:57:24.425561 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 207/396] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 15:57:24 2022] GET /compute/v2.1/images/8c7686ef-2791-474b-9a88-1019551ffc49 => generated 1424 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:24.432044 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-260fcf65-6d6b-47e4-9972-ce029f29bcdb tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:24.432827 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-260fcf65-6d6b-47e4-9972-ce029f29bcdb tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:24.438597 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5be2ae14-d7f6-4858-8a78-e1b0092c153b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:24.439177 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-260fcf65-6d6b-47e4-9972-ce029f29bcdb tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:24.440130 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-260fcf65-6d6b-47e4-9972-ce029f29bcdb tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:24.440790 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-260fcf65-6d6b-47e4-9972-ce029f29bcdb tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:24.441221 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-260fcf65-6d6b-47e4-9972-ce029f29bcdb tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:24.446542 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5be2ae14-d7f6-4858-8a78-e1b0092c153b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 79ee7e24-93df-450b-9030-b08c00d019eb] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:24.464974 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5be2ae14-d7f6-4858-8a78-e1b0092c153b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:24.465473 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5be2ae14-d7f6-4858-8a78-e1b0092c153b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:24.465909 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5be2ae14-d7f6-4858-8a78-e1b0092c153b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:24.466616 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5be2ae14-d7f6-4858-8a78-e1b0092c153b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:24.467069 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5be2ae14-d7f6-4858-8a78-e1b0092c153b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:24.467487 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5be2ae14-d7f6-4858-8a78-e1b0092c153b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:24.576157 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-260fcf65-6d6b-47e4-9972-ce029f29bcdb tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lazy-loading 'services' on Instance uuid f2162319-5635-4c77-920d-9ecb3221d174 {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:57:24.608628 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-260fcf65-6d6b-47e4-9972-ce029f29bcdb tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174" status: 200 len: 1929 microversion: 2.75 time: 0.203972 Aug 31 15:57:24.623528 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 190/397] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:24 2022] GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174 => generated 1929 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:57:24.632811 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8df0286c-72a1-440b-b014-16a2dcc57c28 tempest-FlavorsExtraSpecsNegativeTestJSON-899953835 tempest-FlavorsExtraSpecsNegativeTestJSON-899953835-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:57:24.694019 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8df0286c-72a1-440b-b014-16a2dcc57c28 tempest-FlavorsExtraSpecsNegativeTestJSON-899953835 tempest-FlavorsExtraSpecsNegativeTestJSON-899953835-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors/930065299/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.083559 Aug 31 15:57:24.694956 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 191/398] 10.222.0.61 () {60 vars in 1221 bytes} [Wed Aug 31 15:57:24 2022] POST /compute/v2.1/flavors/930065299/os-extra_specs => generated 66 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 15:57:24.705604 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-654bac27-96cb-400c-a257-82c875570806 tempest-FlavorsExtraSpecsNegativeTestJSON-994677525 tempest-FlavorsExtraSpecsNegativeTestJSON-994677525-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:24.707477 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-654bac27-96cb-400c-a257-82c875570806 tempest-FlavorsExtraSpecsNegativeTestJSON-994677525 tempest-FlavorsExtraSpecsNegativeTestJSON-994677525-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '675bb592dd8d4705be91325faa6ce553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653be0311c044603ad3bb6cf2187d824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:24.709362 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-654bac27-96cb-400c-a257-82c875570806 tempest-FlavorsExtraSpecsNegativeTestJSON-994677525 tempest-FlavorsExtraSpecsNegativeTestJSON-994677525-project] Request method failure captured: Aug 31 15:57:24.709362 n-d-850499-9 devstack@n-api.service[122257]: request: DELETE /compute/v2.1/flavors/930065299/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 31 15:57:24.709362 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 15:57:24.709362 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 15:57:24.709362 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 15:57:24.709362 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 15:57:24.709362 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 15:57:24.709362 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 15:57:24.709362 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 15:57:24.709362 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 15:57:24.709362 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4TgyIqZLMbIcG01DOrCcZvBwk3o8HPTGo6jQ0XzrEVt3PYoVr7B2zzrYwQxwGF5m9rKfG74BcJtLdt_alWiGIYmMpY5hcdeqOdQizSEN5192vIrG1W9TQf_om596_UlgtLzbnoAgSWhssO6raKQZDcygkuSwaVCLPiZF66lXF71RiY Aug 31 15:57:24.709362 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 15:57:24.709362 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 15:57:24.709362 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 15:57:24.709362 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 15:57:24.709362 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 15:57:24.709362 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 15:57:24.709362 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 653be0311c044603ad3bb6cf2187d824 Aug 31 15:57:24.709362 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-994677525 Aug 31 15:57:24.709362 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 15:57:24.709362 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 15:57:24.710565 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/653be0311c044603ad3bb6cf2187d824"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/653be0311c044603ad3bb6cf2187d824"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_653be0311c044603ad3bb6cf2187d824", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/653be0311c044603ad3bb6cf2187d824"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 15:57:24.710565 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-994677525 Aug 31 15:57:24.710565 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 653be0311c044603ad3bb6cf2187d824 Aug 31 15:57:24.710565 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-994677525 Aug 31 15:57:24.710565 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-994677525-project Aug 31 15:57:24.710565 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 15:57:24.710565 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 15:57:24.710565 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 675bb592dd8d4705be91325faa6ce553 Aug 31 15:57:24.710565 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-994677525-project Aug 31 15:57:24.710565 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 15:57:24.710565 n-d-850499-9 devstack@n-api.service[122257]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 31 15:57:24.711200 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'flavor_id': '930065299', 'id': 'hw:numa_nodes'} Aug 31 15:57:24.711200 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:57:24.711200 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:57:24.711200 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:57:24.711200 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:57:24.711200 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:57:24.711200 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:57:24.711200 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:57:24.711200 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:57:24.711200 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Aug 31 15:57:24.711200 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Aug 31 15:57:24.711200 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 31 15:57:24.711200 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 31 15:57:24.711200 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 31 15:57:24.711200 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 31 15:57:24.711200 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 15:57:24.711200 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 31 15:57:24.711200 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 15:57:24.711200 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise self.value Aug 31 15:57:24.711200 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 31 15:57:24.716341 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 31 15:57:24.716341 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 31 15:57:24.716341 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 31 15:57:24.716341 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 31 15:57:24.716341 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 31 15:57:24.716341 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 31 15:57:24.716341 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:57:24.716341 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:57:24.716341 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:57:24.716341 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:57:24.716341 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:57:24.716341 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:57:24.716341 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 31 15:57:24.716341 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 31 15:57:24.716341 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 31 15:57:24.716341 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:57:24.716341 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-654bac27-96cb-400c-a257-82c875570806 tempest-FlavorsExtraSpecsNegativeTestJSON-994677525 tempest-FlavorsExtraSpecsNegativeTestJSON-994677525-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:57:24.717709 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-654bac27-96cb-400c-a257-82c875570806 tempest-FlavorsExtraSpecsNegativeTestJSON-994677525 tempest-FlavorsExtraSpecsNegativeTestJSON-994677525-project] 10.222.0.61 "DELETE /compute/v2.1/flavors/930065299/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.009475 Aug 31 15:57:24.717709 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 192/399] 10.222.0.61 () {58 vars in 1245 bytes} [Wed Aug 31 15:57:24 2022] DELETE /compute/v2.1/flavors/930065299/os-extra_specs/hw:numa_nodes => generated 124 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:57:24.722662 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7ed2a385-69b8-4039-ade6-843915c19135 tempest-FlavorsExtraSpecsNegativeTestJSON-899953835 tempest-FlavorsExtraSpecsNegativeTestJSON-899953835-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:57:24.734327 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5be2ae14-d7f6-4858-8a78-e1b0092c153b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:24.751643 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7ed2a385-69b8-4039-ade6-843915c19135 tempest-FlavorsExtraSpecsNegativeTestJSON-899953835 tempest-FlavorsExtraSpecsNegativeTestJSON-899953835-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors/930065299/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.032052 Aug 31 15:57:24.760390 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 193/400] 10.222.0.61 () {60 vars in 1221 bytes} [Wed Aug 31 15:57:24 2022] POST /compute/v2.1/flavors/930065299/os-extra_specs => generated 66 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 15:57:24.765266 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4747500c-72ec-49aa-9820-f034cb166eaa tempest-FlavorsExtraSpecsNegativeTestJSON-994677525 tempest-FlavorsExtraSpecsNegativeTestJSON-994677525-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:57:24.769626 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-4747500c-72ec-49aa-9820-f034cb166eaa tempest-FlavorsExtraSpecsNegativeTestJSON-994677525 tempest-FlavorsExtraSpecsNegativeTestJSON-994677525-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '675bb592dd8d4705be91325faa6ce553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653be0311c044603ad3bb6cf2187d824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:24.771564 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4747500c-72ec-49aa-9820-f034cb166eaa tempest-FlavorsExtraSpecsNegativeTestJSON-994677525 tempest-FlavorsExtraSpecsNegativeTestJSON-994677525-project] Request method failure captured: Aug 31 15:57:24.771564 n-d-850499-9 devstack@n-api.service[122257]: request: PUT /compute/v2.1/flavors/930065299/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 31 15:57:24.771564 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 15:57:24.771564 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 15:57:24.771564 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 15:57:24.771564 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 22 Aug 31 15:57:24.771564 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 15:57:24.771564 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 15:57:24.771564 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 15:57:24.771564 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 15:57:24.771564 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4TgyIqZLMbIcG01DOrCcZvBwk3o8HPTGo6jQ0XzrEVt3PYoVr7B2zzrYwQxwGF5m9rKfG74BcJtLdt_alWiGIYmMpY5hcdeqOdQizSEN5192vIrG1W9TQf_om596_UlgtLzbnoAgSWhssO6raKQZDcygkuSwaVCLPiZF66lXF71RiY Aug 31 15:57:24.771564 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 15:57:24.771564 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 15:57:24.771564 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 15:57:24.771564 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 15:57:24.771564 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 15:57:24.771564 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 15:57:24.771564 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 653be0311c044603ad3bb6cf2187d824 Aug 31 15:57:24.771564 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-994677525 Aug 31 15:57:24.771564 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 15:57:24.771564 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 15:57:24.772842 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/653be0311c044603ad3bb6cf2187d824"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/653be0311c044603ad3bb6cf2187d824"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_653be0311c044603ad3bb6cf2187d824", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/653be0311c044603ad3bb6cf2187d824"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 15:57:24.772842 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-994677525 Aug 31 15:57:24.772842 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 653be0311c044603ad3bb6cf2187d824 Aug 31 15:57:24.772842 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-994677525 Aug 31 15:57:24.772842 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-994677525-project Aug 31 15:57:24.772842 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 15:57:24.772842 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 15:57:24.772842 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 675bb592dd8d4705be91325faa6ce553 Aug 31 15:57:24.772842 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-994677525-project Aug 31 15:57:24.772842 n-d-850499-9 devstack@n-api.service[122257]: Aug 31 15:57:24.772842 n-d-850499-9 devstack@n-api.service[122257]: {"hw:numa_nodes": "1"} Aug 31 15:57:24.772842 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 15:57:24.772842 n-d-850499-9 devstack@n-api.service[122257]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 31 15:57:24.773555 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'flavor_id': '930065299', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Aug 31 15:57:24.773555 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:57:24.773555 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:57:24.773555 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:57:24.773555 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:57:24.773555 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:57:24.773555 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:57:24.773555 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:57:24.773555 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:57:24.773555 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:57:24.773555 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:57:24.773555 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Aug 31 15:57:24.773555 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Aug 31 15:57:24.773555 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 31 15:57:24.773555 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 31 15:57:24.773555 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 31 15:57:24.773555 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 31 15:57:24.773555 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 15:57:24.773555 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 31 15:57:24.774588 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 15:57:24.774588 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise self.value Aug 31 15:57:24.774588 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 31 15:57:24.774588 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 31 15:57:24.774588 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 31 15:57:24.774588 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 31 15:57:24.774588 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 31 15:57:24.774588 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 31 15:57:24.774588 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 31 15:57:24.774588 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:57:24.774588 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:57:24.774588 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:57:24.774588 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:57:24.774588 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:57:24.774588 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:57:24.774588 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 31 15:57:24.774588 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 31 15:57:24.774588 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 31 15:57:24.774588 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:57:24.776291 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4747500c-72ec-49aa-9820-f034cb166eaa tempest-FlavorsExtraSpecsNegativeTestJSON-994677525 tempest-FlavorsExtraSpecsNegativeTestJSON-994677525-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:57:24.776291 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4747500c-72ec-49aa-9820-f034cb166eaa tempest-FlavorsExtraSpecsNegativeTestJSON-994677525 tempest-FlavorsExtraSpecsNegativeTestJSON-994677525-project] 10.222.0.61 "PUT /compute/v2.1/flavors/930065299/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.014417 Aug 31 15:57:24.776291 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 194/401] 10.222.0.61 () {60 vars in 1262 bytes} [Wed Aug 31 15:57:24 2022] PUT /compute/v2.1/flavors/930065299/os-extra_specs/hw:numa_nodes => generated 124 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:57:24.779186 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5be2ae14-d7f6-4858-8a78-e1b0092c153b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:24.789082 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-436a9aeb-484b-4ad8-b6fe-d5d3dbebad11 tempest-FlavorsExtraSpecsNegativeTestJSON-899953835 tempest-FlavorsExtraSpecsNegativeTestJSON-899953835-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:24.789639 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5be2ae14-d7f6-4858-8a78-e1b0092c153b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:24.796681 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5be2ae14-d7f6-4858-8a78-e1b0092c153b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/79ee7e24-93df-450b-9030-b08c00d019eb" status: 200 len: 1567 microversion: 2.25 time: 0.366765 Aug 31 15:57:24.799368 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 208/402] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:24 2022] GET /compute/v2.1/servers/79ee7e24-93df-450b-9030-b08c00d019eb => generated 1567 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:57:24.800882 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-436a9aeb-484b-4ad8-b6fe-d5d3dbebad11 tempest-FlavorsExtraSpecsNegativeTestJSON-899953835 tempest-FlavorsExtraSpecsNegativeTestJSON-899953835-project-admin] HTTP exception thrown: Flavor 930065299 has no extra specs with key hw:cpu_thread_policy. Aug 31 15:57:24.802654 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-436a9aeb-484b-4ad8-b6fe-d5d3dbebad11 tempest-FlavorsExtraSpecsNegativeTestJSON-899953835 tempest-FlavorsExtraSpecsNegativeTestJSON-899953835-project-admin] Request method failure captured: Aug 31 15:57:24.802654 n-d-850499-9 devstack@n-api.service[122257]: request: DELETE /compute/v2.1/flavors/930065299/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Aug 31 15:57:24.802654 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 15:57:24.802654 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 15:57:24.802654 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 15:57:24.802654 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 15:57:24.802654 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 15:57:24.802654 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 15:57:24.802654 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 15:57:24.802654 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 15:57:24.802654 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4ThNRIV-jYCDfinvtdXcGo13YAslLuqO3snVHI8CTGqQHWlztLveEk2UrwrNG3_qkKFrmI3dDn84TJwdXtROseNj8JlB0C3V4VaSHkgLggBdKK9PPU8NClesp_nvk11u-liQuEGXmqnY-Z-ZFwyvYcdhmryOuQhrbJgvXKyBRtNqEE Aug 31 15:57:24.802654 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 15:57:24.802654 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 15:57:24.802654 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 15:57:24.802654 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 15:57:24.802654 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 15:57:24.802654 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 15:57:24.802654 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: cb862dcd53034492ae311c8405935157 Aug 31 15:57:24.802654 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-899953835 Aug 31 15:57:24.802654 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,admin,member Aug 31 15:57:24.802654 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,admin,member Aug 31 15:57:24.803923 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/cb862dcd53034492ae311c8405935157"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/cb862dcd53034492ae311c8405935157"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_cb862dcd53034492ae311c8405935157", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/cb862dcd53034492ae311c8405935157"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 15:57:24.803923 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-899953835 Aug 31 15:57:24.803923 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: cb862dcd53034492ae311c8405935157 Aug 31 15:57:24.803923 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-899953835 Aug 31 15:57:24.803923 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-899953835-project-admin Aug 31 15:57:24.803923 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 15:57:24.803923 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 15:57:24.803923 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 833e5047921546688d6159469e953da6 Aug 31 15:57:24.803923 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-899953835-project-admin Aug 31 15:57:24.803923 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 15:57:24.803923 n-d-850499-9 devstack@n-api.service[122257]: exception: Flavor 930065299 has no extra specs with key hw:cpu_thread_policy. Aug 31 15:57:24.804563 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'flavor_id': '930065299', 'id': 'hw:cpu_thread_policy'} Aug 31 15:57:24.804563 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:57:24.804563 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:57:24.804563 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Aug 31 15:57:24.804563 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Aug 31 15:57:24.804563 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Aug 31 15:57:24.804563 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:57:24.804563 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:57:24.804563 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:57:24.804563 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:57:24.804563 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:57:24.804563 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:57:24.804563 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:57:24.804563 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:57:24.804563 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:57:24.804563 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:57:24.804563 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Aug 31 15:57:24.804563 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 31 15:57:24.804563 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 930065299 has no extra specs with key hw:cpu_thread_policy. Aug 31 15:57:24.804563 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:57:24.804563 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:57:24.804563 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:57:24.806145 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:57:24.806145 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:57:24.806145 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:57:24.806145 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:57:24.806145 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:57:24.806145 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 930065299 has no extra specs with key hw:cpu_thread_policy. Aug 31 15:57:24.806145 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:57:24.806145 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-436a9aeb-484b-4ad8-b6fe-d5d3dbebad11 tempest-FlavorsExtraSpecsNegativeTestJSON-899953835 tempest-FlavorsExtraSpecsNegativeTestJSON-899953835-project-admin] Returning 404 to user: Flavor 930065299 has no extra specs with key hw:cpu_thread_policy. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:57:24.806145 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-436a9aeb-484b-4ad8-b6fe-d5d3dbebad11 tempest-FlavorsExtraSpecsNegativeTestJSON-899953835 tempest-FlavorsExtraSpecsNegativeTestJSON-899953835-project-admin] 10.222.0.61 "DELETE /compute/v2.1/flavors/930065299/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.021601 Aug 31 15:57:24.810285 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 195/403] 10.222.0.61 () {58 vars in 1266 bytes} [Wed Aug 31 15:57:24 2022] DELETE /compute/v2.1/flavors/930065299/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:57:24.815630 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0b92058c-af6a-43e4-b90d-9c463ca72a23 tempest-FlavorsExtraSpecsNegativeTestJSON-899953835 tempest-FlavorsExtraSpecsNegativeTestJSON-899953835-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:57:24.828521 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-0b92058c-af6a-43e4-b90d-9c463ca72a23 tempest-FlavorsExtraSpecsNegativeTestJSON-899953835 tempest-FlavorsExtraSpecsNegativeTestJSON-899953835-project-admin] HTTP exception thrown: Request body and URI mismatch Aug 31 15:57:24.829915 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0b92058c-af6a-43e4-b90d-9c463ca72a23 tempest-FlavorsExtraSpecsNegativeTestJSON-899953835 tempest-FlavorsExtraSpecsNegativeTestJSON-899953835-project-admin] Request method failure captured: Aug 31 15:57:24.829915 n-d-850499-9 devstack@n-api.service[122256]: request: PUT /compute/v2.1/flavors/930065299/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 31 15:57:24.829915 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 15:57:24.829915 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 15:57:24.829915 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 15:57:24.829915 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 27 Aug 31 15:57:24.829915 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 15:57:24.829915 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 15:57:24.829915 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 15:57:24.829915 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 15:57:24.829915 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4ThNRIV-jYCDfinvtdXcGo13YAslLuqO3snVHI8CTGqQHWlztLveEk2UrwrNG3_qkKFrmI3dDn84TJwdXtROseNj8JlB0C3V4VaSHkgLggBdKK9PPU8NClesp_nvk11u-liQuEGXmqnY-Z-ZFwyvYcdhmryOuQhrbJgvXKyBRtNqEE Aug 31 15:57:24.829915 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 15:57:24.829915 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 15:57:24.829915 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 15:57:24.829915 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 15:57:24.829915 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 15:57:24.829915 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 15:57:24.829915 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: cb862dcd53034492ae311c8405935157 Aug 31 15:57:24.829915 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-899953835 Aug 31 15:57:24.829915 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,admin,member Aug 31 15:57:24.829915 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,admin,member Aug 31 15:57:24.831222 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/cb862dcd53034492ae311c8405935157"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/cb862dcd53034492ae311c8405935157"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_cb862dcd53034492ae311c8405935157", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/cb862dcd53034492ae311c8405935157"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 15:57:24.831222 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-899953835 Aug 31 15:57:24.831222 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: cb862dcd53034492ae311c8405935157 Aug 31 15:57:24.831222 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-899953835 Aug 31 15:57:24.831222 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-899953835-project-admin Aug 31 15:57:24.831222 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 15:57:24.831222 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 15:57:24.831222 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 833e5047921546688d6159469e953da6 Aug 31 15:57:24.831222 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-899953835-project-admin Aug 31 15:57:24.831222 n-d-850499-9 devstack@n-api.service[122256]: Aug 31 15:57:24.831222 n-d-850499-9 devstack@n-api.service[122256]: {"hw:cpu_policy": "shared"} Aug 31 15:57:24.831222 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 15:57:24.831222 n-d-850499-9 devstack@n-api.service[122256]: exception: Request body and URI mismatch Aug 31 15:57:24.831973 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'flavor_id': '930065299', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Aug 31 15:57:24.831973 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:57:24.831973 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:57:24.831973 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:57:24.831973 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:57:24.831973 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:57:24.831973 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:57:24.831973 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:57:24.831973 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:57:24.831973 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:57:24.831973 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:57:24.831973 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Aug 31 15:57:24.831973 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Aug 31 15:57:24.831973 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Aug 31 15:57:24.831973 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:57:24.831973 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:57:24.831973 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:57:24.831973 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:57:24.831973 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:57:24.831973 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:57:24.833384 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:57:24.833384 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:57:24.833384 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Aug 31 15:57:24.833384 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:57:24.833384 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0b92058c-af6a-43e4-b90d-9c463ca72a23 tempest-FlavorsExtraSpecsNegativeTestJSON-899953835 tempest-FlavorsExtraSpecsNegativeTestJSON-899953835-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:57:24.833384 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0b92058c-af6a-43e4-b90d-9c463ca72a23 tempest-FlavorsExtraSpecsNegativeTestJSON-899953835 tempest-FlavorsExtraSpecsNegativeTestJSON-899953835-project-admin] 10.222.0.61 "PUT /compute/v2.1/flavors/930065299/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.019899 Aug 31 15:57:24.834169 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 209/404] 10.222.0.61 () {60 vars in 1262 bytes} [Wed Aug 31 15:57:24 2022] PUT /compute/v2.1/flavors/930065299/os-extra_specs/hw:numa_nodes => generated 73 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 31 15:57:24.845652 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9b7bdc58-16da-487e-9d3d-96360f50c176 tempest-FlavorsExtraSpecsNegativeTestJSON-899953835 tempest-FlavorsExtraSpecsNegativeTestJSON-899953835-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:57:24.850149 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9b7bdc58-16da-487e-9d3d-96360f50c176 tempest-FlavorsExtraSpecsNegativeTestJSON-899953835 tempest-FlavorsExtraSpecsNegativeTestJSON-899953835-project-admin] Request method failure captured: Aug 31 15:57:24.850149 n-d-850499-9 devstack@n-api.service[122257]: request: PUT /compute/v2.1/flavors/930065299/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 31 15:57:24.850149 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 15:57:24.850149 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 15:57:24.850149 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 15:57:24.850149 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 49 Aug 31 15:57:24.850149 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 15:57:24.850149 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 15:57:24.850149 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 15:57:24.850149 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 15:57:24.850149 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4ThNRIV-jYCDfinvtdXcGo13YAslLuqO3snVHI8CTGqQHWlztLveEk2UrwrNG3_qkKFrmI3dDn84TJwdXtROseNj8JlB0C3V4VaSHkgLggBdKK9PPU8NClesp_nvk11u-liQuEGXmqnY-Z-ZFwyvYcdhmryOuQhrbJgvXKyBRtNqEE Aug 31 15:57:24.850149 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 15:57:24.850149 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 15:57:24.850149 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 15:57:24.850149 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 15:57:24.850149 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 15:57:24.850149 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 15:57:24.850149 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: cb862dcd53034492ae311c8405935157 Aug 31 15:57:24.850149 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-899953835 Aug 31 15:57:24.850149 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,admin,member Aug 31 15:57:24.850149 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,admin,member Aug 31 15:57:24.851631 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/cb862dcd53034492ae311c8405935157"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/cb862dcd53034492ae311c8405935157"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_cb862dcd53034492ae311c8405935157", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/cb862dcd53034492ae311c8405935157"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 15:57:24.851631 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-899953835 Aug 31 15:57:24.851631 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: cb862dcd53034492ae311c8405935157 Aug 31 15:57:24.851631 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-899953835 Aug 31 15:57:24.851631 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-899953835-project-admin Aug 31 15:57:24.851631 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 15:57:24.851631 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 15:57:24.851631 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 833e5047921546688d6159469e953da6 Aug 31 15:57:24.851631 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-899953835-project-admin Aug 31 15:57:24.851631 n-d-850499-9 devstack@n-api.service[122257]: Aug 31 15:57:24.851631 n-d-850499-9 devstack@n-api.service[122257]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Aug 31 15:57:24.851631 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 15:57:24.852482 n-d-850499-9 devstack@n-api.service[122257]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 31 15:57:24.852482 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'flavor_id': '930065299', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Aug 31 15:57:24.852482 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:57:24.852482 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:57:24.852482 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 15:57:24.852482 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 15:57:24.852482 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 15:57:24.852482 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise error Aug 31 15:57:24.852482 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 31 15:57:24.852482 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:57:24.852482 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Aug 31 15:57:24.852482 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 31 15:57:24.852482 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Aug 31 15:57:24.852482 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Aug 31 15:57:24.852482 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 31 15:57:24.852482 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi 'type': ['string', Aug 31 15:57:24.852482 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi 'number']}}, Aug 31 15:57:24.852482 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 31 15:57:24.852482 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:57:24.852482 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi On instance: Aug 31 15:57:24.852482 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Aug 31 15:57:24.852482 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:57:24.853789 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:57:24.853789 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:57:24.853789 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:57:24.853789 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:57:24.853789 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:57:24.853789 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:57:24.853789 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:57:24.853789 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:57:24.853789 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:57:24.853789 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 15:57:24.853789 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 15:57:24.853789 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 15:57:24.853789 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 15:57:24.853789 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 15:57:24.853789 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 15:57:24.853789 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 31 15:57:24.853789 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:57:24.853789 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:57:24.853789 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:57:24.853789 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:57:24.854902 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:57:24.854902 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:57:24.854902 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 15:57:24.854902 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 15:57:24.854902 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 31 15:57:24.854902 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:57:24.854902 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9b7bdc58-16da-487e-9d3d-96360f50c176 tempest-FlavorsExtraSpecsNegativeTestJSON-899953835 tempest-FlavorsExtraSpecsNegativeTestJSON-899953835-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:57:24.854902 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9b7bdc58-16da-487e-9d3d-96360f50c176 tempest-FlavorsExtraSpecsNegativeTestJSON-899953835 tempest-FlavorsExtraSpecsNegativeTestJSON-899953835-project-admin] 10.222.0.61 "PUT /compute/v2.1/flavors/930065299/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.010885 Aug 31 15:57:24.854902 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 196/405] 10.222.0.61 () {60 vars in 1262 bytes} [Wed Aug 31 15:57:24 2022] PUT /compute/v2.1/flavors/930065299/os-extra_specs/hw:numa_nodes => generated 117 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 15:57:24.861665 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a0a72015-312a-4151-8c2b-1c7e3e23e4a4 tempest-FlavorsExtraSpecsNegativeTestJSON-899953835 tempest-FlavorsExtraSpecsNegativeTestJSON-899953835-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:24.916391 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a0a72015-312a-4151-8c2b-1c7e3e23e4a4 tempest-FlavorsExtraSpecsNegativeTestJSON-899953835 tempest-FlavorsExtraSpecsNegativeTestJSON-899953835-project-admin] 10.222.0.61 "DELETE /compute/v2.1/flavors/930065299" status: 202 len: 0 microversion: 2.1 time: 0.048711 Aug 31 15:57:24.925065 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-24688927-1d8e-4f19-980f-88f565d6fcc0 tempest-FlavorsExtraSpecsNegativeTestJSON-899953835 tempest-FlavorsExtraSpecsNegativeTestJSON-899953835-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:24.931596 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 210/406] 10.222.0.61 () {58 vars in 1158 bytes} [Wed Aug 31 15:57:24 2022] DELETE /compute/v2.1/flavors/930065299 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 15:57:24.976011 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-24688927-1d8e-4f19-980f-88f565d6fcc0 tempest-FlavorsExtraSpecsNegativeTestJSON-899953835 tempest-FlavorsExtraSpecsNegativeTestJSON-899953835-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.058001 Aug 31 15:57:24.996851 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 197/407] 10.222.0.61 () {58 vars in 1146 bytes} [Wed Aug 31 15:57:24 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:25.115540 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d71b8f1d-4f22-4e38-9464-1d053e3a4d06 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:25.134360 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d71b8f1d-4f22-4e38-9464-1d053e3a4d06 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:25.134360 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d71b8f1d-4f22-4e38-9464-1d053e3a4d06 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:25.134360 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d71b8f1d-4f22-4e38-9464-1d053e3a4d06 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:25.134360 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d71b8f1d-4f22-4e38-9464-1d053e3a4d06 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:25.134754 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d71b8f1d-4f22-4e38-9464-1d053e3a4d06 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:25.137347 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d71b8f1d-4f22-4e38-9464-1d053e3a4d06 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:25.137808 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d71b8f1d-4f22-4e38-9464-1d053e3a4d06 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:25.381514 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d71b8f1d-4f22-4e38-9464-1d053e3a4d06 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:25.396387 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d71b8f1d-4f22-4e38-9464-1d053e3a4d06 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56" status: 200 len: 1503 microversion: 2.1 time: 0.296537 Aug 31 15:57:25.403604 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8ac505d7-c60d-4400-9fed-7c88a386e11a tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:25.405494 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8ac505d7-c60d-4400-9fed-7c88a386e11a tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] [instance: e1ca7a75-7b25-4465-b3f4-3f4d5269c723] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:25.412769 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 211/408] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:25 2022] GET /compute/v2.1/servers/bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56 => generated 1503 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:25.427368 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8ac505d7-c60d-4400-9fed-7c88a386e11a tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:25.428189 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8ac505d7-c60d-4400-9fed-7c88a386e11a tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:25.429004 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8ac505d7-c60d-4400-9fed-7c88a386e11a tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:25.429860 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8ac505d7-c60d-4400-9fed-7c88a386e11a tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:25.431163 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8ac505d7-c60d-4400-9fed-7c88a386e11a tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:25.431833 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8ac505d7-c60d-4400-9fed-7c88a386e11a tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:25.440217 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-20412991-9f7f-4f3e-83e3-4b1f6268d7f8 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Calling method '.version_select at 0x7f5ae95760d0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:25.534240 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-20412991-9f7f-4f3e-83e3-4b1f6268d7f8 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] 10.222.0.61 "GET /compute/v2.1/images/8c7686ef-2791-474b-9a88-1019551ffc49" status: 200 len: 1424 microversion: 2.1 time: 0.097739 Aug 31 15:57:25.535565 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 212/409] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 15:57:25 2022] GET /compute/v2.1/images/8c7686ef-2791-474b-9a88-1019551ffc49 => generated 1424 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:57:25.641809 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-93dddfbb-0bc8-4749-a3aa-15ad6d8fc339 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:25.642568 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-93dddfbb-0bc8-4749-a3aa-15ad6d8fc339 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] [instance: f2162319-5635-4c77-920d-9ecb3221d174] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:25.649524 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-93dddfbb-0bc8-4749-a3aa-15ad6d8fc339 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:25.650894 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-93dddfbb-0bc8-4749-a3aa-15ad6d8fc339 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:25.652337 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-93dddfbb-0bc8-4749-a3aa-15ad6d8fc339 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:25.653592 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-93dddfbb-0bc8-4749-a3aa-15ad6d8fc339 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:25.654279 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-93dddfbb-0bc8-4749-a3aa-15ad6d8fc339 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:25.654927 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-93dddfbb-0bc8-4749-a3aa-15ad6d8fc339 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:25.678840 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8ac505d7-c60d-4400-9fed-7c88a386e11a tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd1dfe05c037461d8dfb45a6f611ced0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd5a49a78854f22aa3c58d01058e493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:25.690348 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8ac505d7-c60d-4400-9fed-7c88a386e11a tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] 10.222.0.61 "GET /compute/v2.1/servers/e1ca7a75-7b25-4465-b3f4-3f4d5269c723" status: 200 len: 1476 microversion: 2.1 time: 0.319484 Aug 31 15:57:25.706279 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 198/410] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:25 2022] GET /compute/v2.1/servers/e1ca7a75-7b25-4465-b3f4-3f4d5269c723 => generated 1476 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:25.820725 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-93dddfbb-0bc8-4749-a3aa-15ad6d8fc339 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lazy-loading 'services' on Instance uuid f2162319-5635-4c77-920d-9ecb3221d174 {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:57:25.823481 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a7e648cc-89c6-4b7d-ac08-aabe8e6c3182 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:25.823481 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a7e648cc-89c6-4b7d-ac08-aabe8e6c3182 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 79ee7e24-93df-450b-9030-b08c00d019eb] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:25.847478 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a7e648cc-89c6-4b7d-ac08-aabe8e6c3182 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:25.848204 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a7e648cc-89c6-4b7d-ac08-aabe8e6c3182 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:25.850868 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a7e648cc-89c6-4b7d-ac08-aabe8e6c3182 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:25.852244 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a7e648cc-89c6-4b7d-ac08-aabe8e6c3182 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:25.856114 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a7e648cc-89c6-4b7d-ac08-aabe8e6c3182 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:25.858064 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a7e648cc-89c6-4b7d-ac08-aabe8e6c3182 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:25.891989 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-93dddfbb-0bc8-4749-a3aa-15ad6d8fc339 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174" status: 200 len: 1929 microversion: 2.75 time: 0.254933 Aug 31 15:57:25.893048 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 213/411] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:25 2022] GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174 => generated 1929 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:57:26.152587 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a7e648cc-89c6-4b7d-ac08-aabe8e6c3182 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:26.179432 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a7e648cc-89c6-4b7d-ac08-aabe8e6c3182 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:26.184669 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a7e648cc-89c6-4b7d-ac08-aabe8e6c3182 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:26.186031 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a7e648cc-89c6-4b7d-ac08-aabe8e6c3182 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/79ee7e24-93df-450b-9030-b08c00d019eb" status: 200 len: 1567 microversion: 2.25 time: 0.367566 Aug 31 15:57:26.186397 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 199/412] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:25 2022] GET /compute/v2.1/servers/79ee7e24-93df-450b-9030-b08c00d019eb => generated 1567 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 15:57:26.430257 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5f8be6a9-7549-4d03-b061-ddf18fd804dd tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:26.431750 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5f8be6a9-7549-4d03-b061-ddf18fd804dd tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:26.458020 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-ec6dc77a-3aaa-4cdc-9cff-b80d2dcaeecd req-d7b98d25-debf-47c3-807e-6543c7181618 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56", "tag": "2b648b75-ab1e-4141-bc80-3cbc9b5b261b"}, {"server_uuid": "e1ca7a75-7b25-4465-b3f4-3f4d5269c723", "name": "network-vif-deleted", "tag": "fe0826ab-55c5-467e-b7d7-83da41f83da6"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:57:26.472848 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5f8be6a9-7549-4d03-b061-ddf18fd804dd tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:26.481161 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5f8be6a9-7549-4d03-b061-ddf18fd804dd tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:26.481607 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5f8be6a9-7549-4d03-b061-ddf18fd804dd tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:26.484561 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5f8be6a9-7549-4d03-b061-ddf18fd804dd tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:26.487484 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5f8be6a9-7549-4d03-b061-ddf18fd804dd tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:26.489280 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5f8be6a9-7549-4d03-b061-ddf18fd804dd tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:26.494740 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-ec6dc77a-3aaa-4cdc-9cff-b80d2dcaeecd req-d7b98d25-debf-47c3-807e-6543c7181618 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:26.495232 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-ec6dc77a-3aaa-4cdc-9cff-b80d2dcaeecd req-d7b98d25-debf-47c3-807e-6543c7181618 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:26.495730 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-ec6dc77a-3aaa-4cdc-9cff-b80d2dcaeecd req-d7b98d25-debf-47c3-807e-6543c7181618 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:26.530709 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-ec6dc77a-3aaa-4cdc-9cff-b80d2dcaeecd req-d7b98d25-debf-47c3-807e-6543c7181618 service nova] Creating event network-changed:2b648b75-ab1e-4141-bc80-3cbc9b5b261b for instance bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56 on n-h1-850499-9 Aug 31 15:57:26.535033 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-ec6dc77a-3aaa-4cdc-9cff-b80d2dcaeecd req-d7b98d25-debf-47c3-807e-6543c7181618 service nova] Creating event network-vif-deleted:fe0826ab-55c5-467e-b7d7-83da41f83da6 for instance e1ca7a75-7b25-4465-b3f4-3f4d5269c723 on n-h2-850499-9 Aug 31 15:57:26.555158 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-ec6dc77a-3aaa-4cdc-9cff-b80d2dcaeecd req-d7b98d25-debf-47c3-807e-6543c7181618 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.108755 Aug 31 15:57:26.556018 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 200/413] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 15:57:26 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 15:57:26.562762 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8abf3d7c-68fe-472f-ad2e-6501d462be92 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Calling method '.version_select at 0x7f5ae95f51f0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:26.639115 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8abf3d7c-68fe-472f-ad2e-6501d462be92 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] 10.222.0.61 "GET /compute/v2.1/images/8c7686ef-2791-474b-9a88-1019551ffc49" status: 200 len: 1433 microversion: 2.1 time: 0.081483 Aug 31 15:57:26.651730 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 201/414] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 15:57:26 2022] GET /compute/v2.1/images/8c7686ef-2791-474b-9a88-1019551ffc49 => generated 1433 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:26.680882 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3aecf13b-0ec0-4471-8189-f093a40c3659 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Calling method '.version_select at 0x7f5ae94dab80>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:26.754565 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3aecf13b-0ec0-4471-8189-f093a40c3659 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] 10.222.0.61 "GET /compute/v2.1/images/8c7686ef-2791-474b-9a88-1019551ffc49" status: 200 len: 1433 microversion: 2.1 time: 0.100358 Aug 31 15:57:26.776720 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 202/415] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 15:57:26 2022] GET /compute/v2.1/images/8c7686ef-2791-474b-9a88-1019551ffc49 => generated 1433 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:26.784455 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ff0515d8-818e-4467-bef1-a207ef8d426f tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:26.785448 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ff0515d8-818e-4467-bef1-a207ef8d426f tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] [instance: e1ca7a75-7b25-4465-b3f4-3f4d5269c723] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:26.797333 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ff0515d8-818e-4467-bef1-a207ef8d426f tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:26.798568 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ff0515d8-818e-4467-bef1-a207ef8d426f tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:26.799214 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ff0515d8-818e-4467-bef1-a207ef8d426f tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:26.800440 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5f8be6a9-7549-4d03-b061-ddf18fd804dd tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:26.800854 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ff0515d8-818e-4467-bef1-a207ef8d426f tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:26.801395 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ff0515d8-818e-4467-bef1-a207ef8d426f tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:26.801895 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ff0515d8-818e-4467-bef1-a207ef8d426f tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:26.818148 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5f8be6a9-7549-4d03-b061-ddf18fd804dd tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56" status: 200 len: 1503 microversion: 2.1 time: 0.391912 Aug 31 15:57:26.819097 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 214/416] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:26 2022] GET /compute/v2.1/servers/bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56 => generated 1503 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:26.836041 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c40152b1-84bf-43e3-be99-09bd70a133e2 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:26.837255 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c40152b1-84bf-43e3-be99-09bd70a133e2 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] [instance: 1b233a49-d4f5-412d-8239-74df4ce63aa5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:26.849747 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c40152b1-84bf-43e3-be99-09bd70a133e2 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:26.850601 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c40152b1-84bf-43e3-be99-09bd70a133e2 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:26.854214 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c40152b1-84bf-43e3-be99-09bd70a133e2 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:26.856692 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c40152b1-84bf-43e3-be99-09bd70a133e2 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:26.857725 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c40152b1-84bf-43e3-be99-09bd70a133e2 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:26.869050 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c40152b1-84bf-43e3-be99-09bd70a133e2 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:26.899526 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ff0515d8-818e-4467-bef1-a207ef8d426f tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:26.901205 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ff0515d8-818e-4467-bef1-a207ef8d426f tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:26.902471 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ff0515d8-818e-4467-bef1-a207ef8d426f tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:26.902974 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-ff0515d8-818e-4467-bef1-a207ef8d426f tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lazy-loading 'fault' on Instance uuid e1ca7a75-7b25-4465-b3f4-3f4d5269c723 {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:57:27.057700 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ff0515d8-818e-4467-bef1-a207ef8d426f tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd1dfe05c037461d8dfb45a6f611ced0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd5a49a78854f22aa3c58d01058e493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:27.073584 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ff0515d8-818e-4467-bef1-a207ef8d426f tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] 10.222.0.61 "GET /compute/v2.1/servers/e1ca7a75-7b25-4465-b3f4-3f4d5269c723" status: 200 len: 1310 microversion: 2.1 time: 0.295386 Aug 31 15:57:27.074912 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 203/417] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:26 2022] GET /compute/v2.1/servers/e1ca7a75-7b25-4465-b3f4-3f4d5269c723 => generated 1310 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:27.080882 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-06e47c3b-2ebd-4b7c-bf78-37cb9ad9169a tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:27.084638 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-06e47c3b-2ebd-4b7c-bf78-37cb9ad9169a tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] [instance: f2162319-5635-4c77-920d-9ecb3221d174] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:27.102138 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-06e47c3b-2ebd-4b7c-bf78-37cb9ad9169a tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:27.106262 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-06e47c3b-2ebd-4b7c-bf78-37cb9ad9169a tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:27.106770 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-06e47c3b-2ebd-4b7c-bf78-37cb9ad9169a tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:27.114302 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-06e47c3b-2ebd-4b7c-bf78-37cb9ad9169a tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:27.114835 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-06e47c3b-2ebd-4b7c-bf78-37cb9ad9169a tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:27.118707 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-06e47c3b-2ebd-4b7c-bf78-37cb9ad9169a tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:27.492827 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-06e47c3b-2ebd-4b7c-bf78-37cb9ad9169a tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lazy-loading 'services' on Instance uuid f2162319-5635-4c77-920d-9ecb3221d174 {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:57:27.515992 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-06e47c3b-2ebd-4b7c-bf78-37cb9ad9169a tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174" status: 200 len: 1929 microversion: 2.75 time: 0.439982 Aug 31 15:57:27.516955 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 204/418] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:27 2022] GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174 => generated 1929 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:57:27.521278 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c40152b1-84bf-43e3-be99-09bd70a133e2 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc04be9f46432fb954d7dbcfe53488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f665e5697c4453c872940b4c0a88772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:27.523421 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a947d935-a44d-47ce-98cb-f3f380fee7d1 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:27.524664 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a947d935-a44d-47ce-98cb-f3f380fee7d1 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 79ee7e24-93df-450b-9030-b08c00d019eb] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:27.533396 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a947d935-a44d-47ce-98cb-f3f380fee7d1 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:27.534049 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a947d935-a44d-47ce-98cb-f3f380fee7d1 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:27.534762 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a947d935-a44d-47ce-98cb-f3f380fee7d1 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:27.535714 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a947d935-a44d-47ce-98cb-f3f380fee7d1 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:27.536321 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a947d935-a44d-47ce-98cb-f3f380fee7d1 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:27.536919 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a947d935-a44d-47ce-98cb-f3f380fee7d1 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:27.538670 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c40152b1-84bf-43e3-be99-09bd70a133e2 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] 10.222.0.61 "GET /compute/v2.1/servers/1b233a49-d4f5-412d-8239-74df4ce63aa5" status: 200 len: 1479 microversion: 2.1 time: 0.717696 Aug 31 15:57:27.539520 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 215/419] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:26 2022] GET /compute/v2.1/servers/1b233a49-d4f5-412d-8239-74df4ce63aa5 => generated 1479 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:27.763366 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a947d935-a44d-47ce-98cb-f3f380fee7d1 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:27.775452 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a947d935-a44d-47ce-98cb-f3f380fee7d1 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:27.782108 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a947d935-a44d-47ce-98cb-f3f380fee7d1 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:27.784942 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a947d935-a44d-47ce-98cb-f3f380fee7d1 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/79ee7e24-93df-450b-9030-b08c00d019eb" status: 200 len: 1567 microversion: 2.25 time: 0.265241 Aug 31 15:57:27.785707 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 205/420] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:27 2022] GET /compute/v2.1/servers/79ee7e24-93df-450b-9030-b08c00d019eb => generated 1567 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:57:27.842485 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b8622f06-2c87-4972-8f68-1ddb67f2f88f tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:27.844057 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b8622f06-2c87-4972-8f68-1ddb67f2f88f tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:27.851566 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b8622f06-2c87-4972-8f68-1ddb67f2f88f tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:27.852062 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b8622f06-2c87-4972-8f68-1ddb67f2f88f tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:27.852695 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b8622f06-2c87-4972-8f68-1ddb67f2f88f tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:27.853405 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b8622f06-2c87-4972-8f68-1ddb67f2f88f tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:27.853863 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b8622f06-2c87-4972-8f68-1ddb67f2f88f tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:27.854284 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b8622f06-2c87-4972-8f68-1ddb67f2f88f tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:28.060223 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b8622f06-2c87-4972-8f68-1ddb67f2f88f tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:28.068560 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b8622f06-2c87-4972-8f68-1ddb67f2f88f tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56" status: 200 len: 1503 microversion: 2.1 time: 0.229981 Aug 31 15:57:28.069153 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 216/421] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:27 2022] GET /compute/v2.1/servers/bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56 => generated 1503 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:28.094474 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4eeb327a-8165-4511-8e5a-088a448b41a0 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:28.095310 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4eeb327a-8165-4511-8e5a-088a448b41a0 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] [instance: e1ca7a75-7b25-4465-b3f4-3f4d5269c723] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:28.101860 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4eeb327a-8165-4511-8e5a-088a448b41a0 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:28.102630 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4eeb327a-8165-4511-8e5a-088a448b41a0 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:28.103233 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4eeb327a-8165-4511-8e5a-088a448b41a0 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:28.107735 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4eeb327a-8165-4511-8e5a-088a448b41a0 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:28.108257 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4eeb327a-8165-4511-8e5a-088a448b41a0 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:28.108705 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4eeb327a-8165-4511-8e5a-088a448b41a0 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:28.124586 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-4eeb327a-8165-4511-8e5a-088a448b41a0 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] HTTP exception thrown: Instance e1ca7a75-7b25-4465-b3f4-3f4d5269c723 could not be found. Aug 31 15:57:28.126291 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4eeb327a-8165-4511-8e5a-088a448b41a0 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Request method failure captured: Aug 31 15:57:28.126291 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/e1ca7a75-7b25-4465-b3f4-3f4d5269c723 HTTP/1.1 Aug 31 15:57:28.126291 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 15:57:28.126291 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 15:57:28.126291 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 15:57:28.126291 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 15:57:28.126291 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 15:57:28.126291 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 15:57:28.126291 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 15:57:28.126291 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 15:57:28.126291 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4TLVpymZOnvakOemdwpGBTt88XQ6FOU_DUWcqHb02xesGQpV3Ax6krnQbV92xwL-oS941HW0-PRhDxariNfReox8B4BKmg2r3s36v828sapChho_P5lNLTWoUBfIkA4hfPL85ynqdUK8nxO3GYCeYXW8nWjfKBCU4-5G78q2te3WwI Aug 31 15:57:28.126291 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 15:57:28.126291 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 15:57:28.126291 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 15:57:28.126291 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 15:57:28.126291 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 15:57:28.126291 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 15:57:28.126291 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 8dd5a49a78854f22aa3c58d01058e493 Aug 31 15:57:28.126291 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-DeleteServersAdminTestJSON-252145351 Aug 31 15:57:28.126291 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 15:57:28.126291 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 15:57:28.127948 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8dd5a49a78854f22aa3c58d01058e493"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/8dd5a49a78854f22aa3c58d01058e493"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_8dd5a49a78854f22aa3c58d01058e493", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8dd5a49a78854f22aa3c58d01058e493"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 15:57:28.127948 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-DeleteServersAdminTestJSON-252145351 Aug 31 15:57:28.127948 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 8dd5a49a78854f22aa3c58d01058e493 Aug 31 15:57:28.127948 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-252145351 Aug 31 15:57:28.127948 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-DeleteServersAdminTestJSON-252145351-project Aug 31 15:57:28.127948 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 15:57:28.127948 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 15:57:28.127948 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: fd1dfe05c037461d8dfb45a6f611ced0 Aug 31 15:57:28.127948 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-DeleteServersAdminTestJSON-252145351-project Aug 31 15:57:28.127948 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 15:57:28.127948 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance e1ca7a75-7b25-4465-b3f4-3f4d5269c723 could not be found. Aug 31 15:57:28.127948 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': 'e1ca7a75-7b25-4465-b3f4-3f4d5269c723'} Aug 31 15:57:28.128737 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:57:28.128737 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:57:28.128737 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 15:57:28.128737 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 15:57:28.128737 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 15:57:28.128737 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 15:57:28.128737 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 15:57:28.128737 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 15:57:28.128737 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 15:57:28.128737 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 15:57:28.128737 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1ca7a75-7b25-4465-b3f4-3f4d5269c723 could not be found. Aug 31 15:57:28.128737 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:57:28.128737 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:57:28.128737 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:57:28.128737 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:57:28.128737 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:57:28.128737 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:57:28.128737 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:57:28.128737 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:57:28.128737 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:57:28.129869 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:57:28.129869 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 15:57:28.129869 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 15:57:28.129869 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 15:57:28.129869 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 15:57:28.129869 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 15:57:28.129869 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:57:28.129869 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1ca7a75-7b25-4465-b3f4-3f4d5269c723 could not be found. Aug 31 15:57:28.129869 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:57:28.129869 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:57:28.129869 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:57:28.129869 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:57:28.129869 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:57:28.129869 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:57:28.129869 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:57:28.129869 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:57:28.129869 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1ca7a75-7b25-4465-b3f4-3f4d5269c723 could not be found. Aug 31 15:57:28.129869 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:57:28.130866 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4eeb327a-8165-4511-8e5a-088a448b41a0 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Returning 404 to user: Instance e1ca7a75-7b25-4465-b3f4-3f4d5269c723 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:57:28.130866 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4eeb327a-8165-4511-8e5a-088a448b41a0 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] 10.222.0.61 "GET /compute/v2.1/servers/e1ca7a75-7b25-4465-b3f4-3f4d5269c723" status: 404 len: 111 microversion: 2.1 time: 0.037255 Aug 31 15:57:28.139135 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 206/422] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:28 2022] GET /compute/v2.1/servers/e1ca7a75-7b25-4465-b3f4-3f4d5269c723 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 15:57:28.269105 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4214806b-9bb6-466d-a514-1d1f806ddc66 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1705072884", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:57:28.331889 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-4214806b-9bb6-466d-a514-1d1f806ddc66 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] validate_networks() for None {{(pid=122256) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 15:57:28.546778 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e93bae72-c689-468e-a69e-bb9bd64fc0ce tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:28.547371 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e93bae72-c689-468e-a69e-bb9bd64fc0ce tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] [instance: f2162319-5635-4c77-920d-9ecb3221d174] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:28.570766 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e93bae72-c689-468e-a69e-bb9bd64fc0ce tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:28.571335 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e93bae72-c689-468e-a69e-bb9bd64fc0ce tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:28.571769 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e93bae72-c689-468e-a69e-bb9bd64fc0ce tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:28.577881 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e93bae72-c689-468e-a69e-bb9bd64fc0ce tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:28.578370 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e93bae72-c689-468e-a69e-bb9bd64fc0ce tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:28.578815 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e93bae72-c689-468e-a69e-bb9bd64fc0ce tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:28.707765 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-4214806b-9bb6-466d-a514-1d1f806ddc66 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 15:57:28.708250 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-4214806b-9bb6-466d-a514-1d1f806ddc66 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 15:57:28.709302 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-4214806b-9bb6-466d-a514-1d1f806ddc66 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 15:57:28.709996 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-4214806b-9bb6-466d-a514-1d1f806ddc66 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 15:57:28.713069 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-4214806b-9bb6-466d-a514-1d1f806ddc66 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 15:57:28.726080 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4214806b-9bb6-466d-a514-1d1f806ddc66 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:28.727051 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4214806b-9bb6-466d-a514-1d1f806ddc66 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:28.727752 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4214806b-9bb6-466d-a514-1d1f806ddc66 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:28.728733 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4214806b-9bb6-466d-a514-1d1f806ddc66 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:28.729346 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4214806b-9bb6-466d-a514-1d1f806ddc66 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:28.730755 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4214806b-9bb6-466d-a514-1d1f806ddc66 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:28.749009 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-e93bae72-c689-468e-a69e-bb9bd64fc0ce tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lazy-loading 'services' on Instance uuid f2162319-5635-4c77-920d-9ecb3221d174 {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:57:28.755473 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-4214806b-9bb6-466d-a514-1d1f806ddc66 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Getting quotas for project 8dd5a49a78854f22aa3c58d01058e493. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:57:28.761822 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-4214806b-9bb6-466d-a514-1d1f806ddc66 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Getting quotas for user fd1dfe05c037461d8dfb45a6f611ced0 and project 8dd5a49a78854f22aa3c58d01058e493. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:57:28.770140 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e93bae72-c689-468e-a69e-bb9bd64fc0ce tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174" status: 200 len: 1929 microversion: 2.75 time: 0.229383 Aug 31 15:57:28.771228 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 207/423] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:28 2022] GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174 => generated 1929 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 15:57:28.778164 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-27244bc9-5b53-4c1d-87a4-7dd05e0a89d9 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:28.778672 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4214806b-9bb6-466d-a514-1d1f806ddc66 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Going to run 1 instances... {{(pid=122256) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 15:57:28.779159 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-27244bc9-5b53-4c1d-87a4-7dd05e0a89d9 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] [instance: 1b233a49-d4f5-412d-8239-74df4ce63aa5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:28.781029 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4214806b-9bb6-466d-a514-1d1f806ddc66 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] [instance: 4986a6de-1b24-42c5-942b-cd011b543cbc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 15:57:28.786005 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-27244bc9-5b53-4c1d-87a4-7dd05e0a89d9 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:28.786689 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-27244bc9-5b53-4c1d-87a4-7dd05e0a89d9 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:28.787276 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-27244bc9-5b53-4c1d-87a4-7dd05e0a89d9 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:28.788150 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-27244bc9-5b53-4c1d-87a4-7dd05e0a89d9 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:28.788748 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-27244bc9-5b53-4c1d-87a4-7dd05e0a89d9 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:28.789332 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-27244bc9-5b53-4c1d-87a4-7dd05e0a89d9 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:28.845730 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4214806b-9bb6-466d-a514-1d1f806ddc66 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.580053 Aug 31 15:57:28.852639 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 217/424] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 15:57:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 588 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 15:57:28.859356 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-607066ad-9924-4df8-ac95-03102d66adcb tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:28.860364 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-607066ad-9924-4df8-ac95-03102d66adcb tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 79ee7e24-93df-450b-9030-b08c00d019eb] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:28.867886 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-607066ad-9924-4df8-ac95-03102d66adcb tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:28.868617 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-607066ad-9924-4df8-ac95-03102d66adcb tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:28.869207 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-607066ad-9924-4df8-ac95-03102d66adcb tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:28.870091 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-607066ad-9924-4df8-ac95-03102d66adcb tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:28.870723 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-607066ad-9924-4df8-ac95-03102d66adcb tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:28.871311 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-607066ad-9924-4df8-ac95-03102d66adcb tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:29.083054 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-27244bc9-5b53-4c1d-87a4-7dd05e0a89d9 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc04be9f46432fb954d7dbcfe53488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f665e5697c4453c872940b4c0a88772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:29.101328 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-27244bc9-5b53-4c1d-87a4-7dd05e0a89d9 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] 10.222.0.61 "GET /compute/v2.1/servers/1b233a49-d4f5-412d-8239-74df4ce63aa5" status: 200 len: 1466 microversion: 2.1 time: 0.328417 Aug 31 15:57:29.102530 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 208/425] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:28 2022] GET /compute/v2.1/servers/1b233a49-d4f5-412d-8239-74df4ce63aa5 => generated 1466 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:29.111907 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2b442d57-da4b-45b7-88fb-0f7335b5f933 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:29.112801 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2b442d57-da4b-45b7-88fb-0f7335b5f933 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] [instance: 4986a6de-1b24-42c5-942b-cd011b543cbc] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:29.208958 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2b442d57-da4b-45b7-88fb-0f7335b5f933 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd1dfe05c037461d8dfb45a6f611ced0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd5a49a78854f22aa3c58d01058e493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:29.214283 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-607066ad-9924-4df8-ac95-03102d66adcb tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:29.220090 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2b442d57-da4b-45b7-88fb-0f7335b5f933 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] 10.222.0.61 "GET /compute/v2.1/servers/4986a6de-1b24-42c5-942b-cd011b543cbc" status: 200 len: 1220 microversion: 2.1 time: 0.114516 Aug 31 15:57:29.220857 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 209/426] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:29 2022] GET /compute/v2.1/servers/4986a6de-1b24-42c5-942b-cd011b543cbc => generated 1220 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:29.226302 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-607066ad-9924-4df8-ac95-03102d66adcb tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:29.228573 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-607066ad-9924-4df8-ac95-03102d66adcb tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:29.229941 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-607066ad-9924-4df8-ac95-03102d66adcb tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/79ee7e24-93df-450b-9030-b08c00d019eb" status: 200 len: 1567 microversion: 2.25 time: 0.375771 Aug 31 15:57:29.231067 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 218/427] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:28 2022] GET /compute/v2.1/servers/79ee7e24-93df-450b-9030-b08c00d019eb => generated 1567 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:57:29.232488 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-796642c7-e0f6-402c-80b1-bd69ae5faa84 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:29.233328 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-796642c7-e0f6-402c-80b1-bd69ae5faa84 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:29.240102 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-796642c7-e0f6-402c-80b1-bd69ae5faa84 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:29.240817 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-796642c7-e0f6-402c-80b1-bd69ae5faa84 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:29.241444 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-796642c7-e0f6-402c-80b1-bd69ae5faa84 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:29.242366 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-796642c7-e0f6-402c-80b1-bd69ae5faa84 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:29.242888 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-796642c7-e0f6-402c-80b1-bd69ae5faa84 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:29.243522 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-796642c7-e0f6-402c-80b1-bd69ae5faa84 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:29.255299 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9f48bc23-c11b-451c-8755-9592b5adf2ca tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Calling method '.version_select at 0x7f5ae9576310>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:29.347588 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9f48bc23-c11b-451c-8755-9592b5adf2ca tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] 10.222.0.61 "GET /compute/v2.1/images/b9c36d42-ed46-4bf5-ad18-1df45cbd0413" status: 200 len: 784 microversion: 2.1 time: 0.102353 Aug 31 15:57:29.348564 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 219/428] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 15:57:29 2022] GET /compute/v2.1/images/b9c36d42-ed46-4bf5-ad18-1df45cbd0413 => generated 784 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:57:29.363933 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-556df4c3-d437-4a50-a6be-a70fa5c527d9 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:29.373358 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-556df4c3-d437-4a50-a6be-a70fa5c527d9 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] 10.222.0.61 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013045 Aug 31 15:57:29.381084 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 220/429] 10.222.0.61 () {58 vars in 1137 bytes} [Wed Aug 31 15:57:29 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:57:29.386108 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ed73b45f-84b1-49b3-8f74-cd1c58c869ca tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Calling method '.version_select at 0x7f5ae9514ee0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:29.511893 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-796642c7-e0f6-402c-80b1-bd69ae5faa84 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:29.524670 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-796642c7-e0f6-402c-80b1-bd69ae5faa84 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56" status: 200 len: 1503 microversion: 2.1 time: 0.300852 Aug 31 15:57:29.525958 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 210/430] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:29 2022] GET /compute/v2.1/servers/bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56 => generated 1503 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:29.803725 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-da95531f-1802-4322-aa9d-a87e884821fe tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:29.809342 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-da95531f-1802-4322-aa9d-a87e884821fe tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] [instance: f2162319-5635-4c77-920d-9ecb3221d174] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:29.812360 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:57:29.820160 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-da95531f-1802-4322-aa9d-a87e884821fe tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:29.820667 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-da95531f-1802-4322-aa9d-a87e884821fe tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:29.821104 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-da95531f-1802-4322-aa9d-a87e884821fe tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:29.821928 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-da95531f-1802-4322-aa9d-a87e884821fe tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:29.822391 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-da95531f-1802-4322-aa9d-a87e884821fe tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:29.822822 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-da95531f-1802-4322-aa9d-a87e884821fe tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:29.926271 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-da95531f-1802-4322-aa9d-a87e884821fe tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lazy-loading 'services' on Instance uuid f2162319-5635-4c77-920d-9ecb3221d174 {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:57:29.951437 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-da95531f-1802-4322-aa9d-a87e884821fe tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174" status: 200 len: 1929 microversion: 2.75 time: 0.154263 Aug 31 15:57:29.952090 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 211/431] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:29 2022] GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174 => generated 1929 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:57:30.244520 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-466fd76b-85ca-48e8-8b39-f8eb0115b60a tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:30.245152 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-466fd76b-85ca-48e8-8b39-f8eb0115b60a tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] [instance: 4986a6de-1b24-42c5-942b-cd011b543cbc] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:30.253976 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-466fd76b-85ca-48e8-8b39-f8eb0115b60a tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:30.255618 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-466fd76b-85ca-48e8-8b39-f8eb0115b60a tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:30.255964 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-466fd76b-85ca-48e8-8b39-f8eb0115b60a tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:30.256686 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-466fd76b-85ca-48e8-8b39-f8eb0115b60a tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:30.258104 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-466fd76b-85ca-48e8-8b39-f8eb0115b60a tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:30.258613 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-466fd76b-85ca-48e8-8b39-f8eb0115b60a tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:30.384929 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-466fd76b-85ca-48e8-8b39-f8eb0115b60a tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd1dfe05c037461d8dfb45a6f611ced0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd5a49a78854f22aa3c58d01058e493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:30.412749 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-466fd76b-85ca-48e8-8b39-f8eb0115b60a tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] 10.222.0.61 "GET /compute/v2.1/servers/4986a6de-1b24-42c5-942b-cd011b543cbc" status: 200 len: 1272 microversion: 2.1 time: 0.172326 Aug 31 15:57:30.414626 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 212/432] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:30 2022] GET /compute/v2.1/servers/4986a6de-1b24-42c5-942b-cd011b543cbc => generated 1272 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:30.435556 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1cce1d59-53d7-4b0b-bd95-9b4617791afd tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:30.436682 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1cce1d59-53d7-4b0b-bd95-9b4617791afd tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 79ee7e24-93df-450b-9030-b08c00d019eb] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:30.448207 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1cce1d59-53d7-4b0b-bd95-9b4617791afd tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:30.448907 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1cce1d59-53d7-4b0b-bd95-9b4617791afd tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:30.449557 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1cce1d59-53d7-4b0b-bd95-9b4617791afd tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:30.450285 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1cce1d59-53d7-4b0b-bd95-9b4617791afd tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:30.450746 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1cce1d59-53d7-4b0b-bd95-9b4617791afd tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:30.451305 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1cce1d59-53d7-4b0b-bd95-9b4617791afd tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:30.692770 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-1cce1d59-53d7-4b0b-bd95-9b4617791afd tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:30.728395 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-1cce1d59-53d7-4b0b-bd95-9b4617791afd tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:30.736431 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-1cce1d59-53d7-4b0b-bd95-9b4617791afd tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:30.742918 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1cce1d59-53d7-4b0b-bd95-9b4617791afd tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/79ee7e24-93df-450b-9030-b08c00d019eb" status: 200 len: 1567 microversion: 2.25 time: 0.323144 Aug 31 15:57:30.743571 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 213/433] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:30 2022] GET /compute/v2.1/servers/79ee7e24-93df-450b-9030-b08c00d019eb => generated 1567 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:57:30.758156 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b4957996-88b4-40a6-9c62-4bc5118ddd05 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:30.758156 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b4957996-88b4-40a6-9c62-4bc5118ddd05 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:30.771777 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b4957996-88b4-40a6-9c62-4bc5118ddd05 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:30.772162 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b4957996-88b4-40a6-9c62-4bc5118ddd05 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:30.772480 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b4957996-88b4-40a6-9c62-4bc5118ddd05 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:30.773716 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b4957996-88b4-40a6-9c62-4bc5118ddd05 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:30.773716 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b4957996-88b4-40a6-9c62-4bc5118ddd05 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:30.774037 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b4957996-88b4-40a6-9c62-4bc5118ddd05 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:30.852272 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ed73b45f-84b1-49b3-8f74-cd1c58c869ca tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] 10.222.0.61 "DELETE /compute/v2.1/images/8c7686ef-2791-474b-9a88-1019551ffc49" status: 204 len: 0 microversion: 2.1 time: 1.469836 Aug 31 15:57:30.853495 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 221/434] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:29 2022] DELETE /compute/v2.1/images/8c7686ef-2791-474b-9a88-1019551ffc49 => generated 0 bytes in 1472 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 15:57:30.865170 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-77fe6e8b-e525-4633-994f-2682cdfa1490 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Calling method '.version_select at 0x7f5ae9535b80>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:30.918129 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-77fe6e8b-e525-4633-994f-2682cdfa1490 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] HTTP exception thrown: Image not found. Aug 31 15:57:30.935654 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-77fe6e8b-e525-4633-994f-2682cdfa1490 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Request method failure captured: Aug 31 15:57:30.935654 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/images/8c7686ef-2791-474b-9a88-1019551ffc49 HTTP/1.1 Aug 31 15:57:30.935654 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 15:57:30.935654 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 15:57:30.935654 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 15:57:30.935654 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 15:57:30.935654 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 15:57:30.935654 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 15:57:30.935654 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 15:57:30.935654 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 15:57:30.935654 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4Sr48sbSj8zmGnuJDt9FLcFFsMYJsMMN4O9amRh9mh8Gkp1Qor2_uDkL4eOZWlgOyZzvess77h4BzSHGWOidavKgm--Q1ArxbBQKFpoXel6J5wLKnONVEMF0izXf4OK_dlQROBgePWzUsQmETRJOzR4vgLJwa3XBxUTTRrCG_7Rb1Q Aug 31 15:57:30.935654 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 15:57:30.935654 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 15:57:30.935654 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 15:57:30.935654 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 15:57:30.935654 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 15:57:30.935654 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 15:57:30.935654 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 6f665e5697c4453c872940b4c0a88772 Aug 31 15:57:30.935654 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ImagesOneServerTestJSON-1892725018 Aug 31 15:57:30.935654 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 15:57:30.935654 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 15:57:30.936844 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6f665e5697c4453c872940b4c0a88772"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/6f665e5697c4453c872940b4c0a88772"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_6f665e5697c4453c872940b4c0a88772", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6f665e5697c4453c872940b4c0a88772"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 15:57:30.936844 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ImagesOneServerTestJSON-1892725018 Aug 31 15:57:30.936844 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 6f665e5697c4453c872940b4c0a88772 Aug 31 15:57:30.936844 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1892725018 Aug 31 15:57:30.936844 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ImagesOneServerTestJSON-1892725018-project Aug 31 15:57:30.936844 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 15:57:30.936844 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 15:57:30.936844 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: fedc04be9f46432fb954d7dbcfe53488 Aug 31 15:57:30.936844 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ImagesOneServerTestJSON-1892725018-project Aug 31 15:57:30.936844 n-d-850499-9 devstack@n-api.service[122256]: method: Aug 31 15:57:30.936844 n-d-850499-9 devstack@n-api.service[122256]: exception: Image not found. Aug 31 15:57:30.936844 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '8c7686ef-2791-474b-9a88-1019551ffc49'} Aug 31 15:57:30.936844 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:57:30.937693 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:57:30.937693 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 31 15:57:30.937693 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 31 15:57:30.937693 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 31 15:57:30.937693 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 31 15:57:30.937693 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 31 15:57:30.937693 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 31 15:57:30.937693 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 31 15:57:30.937693 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 31 15:57:30.937693 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 31 15:57:30.937693 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 31 15:57:30.937693 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 31 15:57:30.937693 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 31 15:57:30.937693 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 31 15:57:30.937693 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 31 15:57:30.937693 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 31 15:57:30.937693 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 31 15:57:30.937693 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 8c7686ef-2791-474b-9a88-1019551ffc49 Aug 31 15:57:30.938985 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:57:30.938985 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:57:30.938985 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:57:30.938985 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:57:30.938985 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 31 15:57:30.938985 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 31 15:57:30.938985 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 31 15:57:30.938985 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 31 15:57:30.938985 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 31 15:57:30.938985 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 31 15:57:30.938985 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 31 15:57:30.938985 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 31 15:57:30.938985 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 31 15:57:30.938985 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 31 15:57:30.938985 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 31 15:57:30.938985 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 31 15:57:30.938985 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 31 15:57:30.938985 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 31 15:57:30.938985 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 31 15:57:30.938985 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 31 15:57:30.941867 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 31 15:57:30.941867 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 31 15:57:30.941867 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 31 15:57:30.941867 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 31 15:57:30.941867 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 31 15:57:30.941867 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 31 15:57:30.941867 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 31 15:57:30.941867 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 31 15:57:30.941867 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8c7686ef-2791-474b-9a88-1019551ffc49 could not be found. Aug 31 15:57:30.941867 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:57:30.941867 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:57:30.941867 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:57:30.941867 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:57:30.941867 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:57:30.941867 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:57:30.941867 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:57:30.941867 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:57:30.941867 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 15:57:30.941867 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 15:57:30.945254 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:57:30.945254 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:57:30.945254 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 31 15:57:30.945254 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 31 15:57:30.945254 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 31 15:57:30.945254 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:57:30.945254 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:57:30.945254 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:57:30.945254 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:57:30.945254 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:57:30.945254 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:57:30.945254 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:57:30.945254 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:57:30.945254 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 31 15:57:30.945254 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:57:30.945254 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-77fe6e8b-e525-4633-994f-2682cdfa1490 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Returning 404 to user: Image not found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:57:30.945254 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-77fe6e8b-e525-4633-994f-2682cdfa1490 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] 10.222.0.61 "GET /compute/v2.1/images/8c7686ef-2791-474b-9a88-1019551ffc49" status: 404 len: 62 microversion: 2.1 time: 0.075156 Aug 31 15:57:30.947646 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 222/435] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 15:57:30 2022] GET /compute/v2.1/images/8c7686ef-2791-474b-9a88-1019551ffc49 => generated 62 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 31 15:57:31.010323 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b4957996-88b4-40a6-9c62-4bc5118ddd05 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:31.020505 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b4957996-88b4-40a6-9c62-4bc5118ddd05 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56" status: 200 len: 1503 microversion: 2.1 time: 0.274755 Aug 31 15:57:31.021092 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 214/436] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:30 2022] GET /compute/v2.1/servers/bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56 => generated 1503 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:31.025838 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-35c41122-cbba-43b1-9d9d-2d1e1fa96138 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-483334041"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:57:31.029034 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-35c41122-cbba-43b1-9d9d-2d1e1fa96138 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] [instance: 1b233a49-d4f5-412d-8239-74df4ce63aa5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:31.035390 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-35c41122-cbba-43b1-9d9d-2d1e1fa96138 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:31.035916 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-35c41122-cbba-43b1-9d9d-2d1e1fa96138 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:31.036520 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-35c41122-cbba-43b1-9d9d-2d1e1fa96138 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:31.037224 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-35c41122-cbba-43b1-9d9d-2d1e1fa96138 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:31.037675 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-35c41122-cbba-43b1-9d9d-2d1e1fa96138 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:31.038098 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-35c41122-cbba-43b1-9d9d-2d1e1fa96138 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:31.314238 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=100 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:57:31.371852 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-18f0f44f-6a59-44b4-8656-15821ff295f4 tempest-HypervisorAdminTestJSON-1889630499 tempest-HypervisorAdminTestJSON-1889630499-project-admin] Calling method '.version_select at 0x7f5aeaf0ac10>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:31.374538 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-18f0f44f-6a59-44b4-8656-15821ff295f4 tempest-HypervisorAdminTestJSON-1889630499 tempest-HypervisorAdminTestJSON-1889630499-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:31.375033 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-18f0f44f-6a59-44b4-8656-15821ff295f4 tempest-HypervisorAdminTestJSON-1889630499 tempest-HypervisorAdminTestJSON-1889630499-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:31.375473 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-18f0f44f-6a59-44b4-8656-15821ff295f4 tempest-HypervisorAdminTestJSON-1889630499 tempest-HypervisorAdminTestJSON-1889630499-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:31.376170 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-35c41122-cbba-43b1-9d9d-2d1e1fa96138 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] 10.222.0.61 "POST /compute/v2.1/servers/1b233a49-d4f5-412d-8239-74df4ce63aa5/action" status: 202 len: 0 microversion: 2.1 time: 0.353684 Aug 31 15:57:31.388300 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 215/437] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 15:57:31 2022] POST /compute/v2.1/servers/1b233a49-d4f5-412d-8239-74df4ce63aa5/action => generated 0 bytes in 366 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 31 15:57:31.400015 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-739072f9-0b08-436d-bf61-87e6df81f3f1 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:31.400762 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-739072f9-0b08-436d-bf61-87e6df81f3f1 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] [instance: f2162319-5635-4c77-920d-9ecb3221d174] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:31.402027 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-18f0f44f-6a59-44b4-8656-15821ff295f4 tempest-HypervisorAdminTestJSON-1889630499 tempest-HypervisorAdminTestJSON-1889630499-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:31.403128 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-18f0f44f-6a59-44b4-8656-15821ff295f4 tempest-HypervisorAdminTestJSON-1889630499 tempest-HypervisorAdminTestJSON-1889630499-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:31.404146 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-18f0f44f-6a59-44b4-8656-15821ff295f4 tempest-HypervisorAdminTestJSON-1889630499 tempest-HypervisorAdminTestJSON-1889630499-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:31.414112 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-739072f9-0b08-436d-bf61-87e6df81f3f1 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:31.414629 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-739072f9-0b08-436d-bf61-87e6df81f3f1 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:31.415075 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-739072f9-0b08-436d-bf61-87e6df81f3f1 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:31.415980 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-739072f9-0b08-436d-bf61-87e6df81f3f1 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:31.416612 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-739072f9-0b08-436d-bf61-87e6df81f3f1 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:31.417254 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-739072f9-0b08-436d-bf61-87e6df81f3f1 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:31.438523 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-18f0f44f-6a59-44b4-8656-15821ff295f4 tempest-HypervisorAdminTestJSON-1889630499 tempest-HypervisorAdminTestJSON-1889630499-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:31.439060 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-18f0f44f-6a59-44b4-8656-15821ff295f4 tempest-HypervisorAdminTestJSON-1889630499 tempest-HypervisorAdminTestJSON-1889630499-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:31.439589 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-18f0f44f-6a59-44b4-8656-15821ff295f4 tempest-HypervisorAdminTestJSON-1889630499 tempest-HypervisorAdminTestJSON-1889630499-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:31.454472 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-18f0f44f-6a59-44b4-8656-15821ff295f4 tempest-HypervisorAdminTestJSON-1889630499 tempest-HypervisorAdminTestJSON-1889630499-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.507198 Aug 31 15:57:31.455825 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 223/438] 10.222.0.61 () {58 vars in 1146 bytes} [Wed Aug 31 15:57:30 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:57:31.476692 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-0547b007-8dd4-4452-9ae2-cfea30bf822f req-04f1e459-2f5a-4cd0-9a4a-1e5f275d5102 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b233a49-d4f5-412d-8239-74df4ce63aa5", "name": "network-vif-unplugged", "status": "completed", "tag": "f56ba330-3206-4322-9474-e01afa8afef9"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:57:31.508381 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-0547b007-8dd4-4452-9ae2-cfea30bf822f req-04f1e459-2f5a-4cd0-9a4a-1e5f275d5102 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:31.508875 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-0547b007-8dd4-4452-9ae2-cfea30bf822f req-04f1e459-2f5a-4cd0-9a4a-1e5f275d5102 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:31.509314 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-0547b007-8dd4-4452-9ae2-cfea30bf822f req-04f1e459-2f5a-4cd0-9a4a-1e5f275d5102 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:31.520939 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-739072f9-0b08-436d-bf61-87e6df81f3f1 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lazy-loading 'services' on Instance uuid f2162319-5635-4c77-920d-9ecb3221d174 {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:57:31.525598 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-0547b007-8dd4-4452-9ae2-cfea30bf822f req-04f1e459-2f5a-4cd0-9a4a-1e5f275d5102 service nova] Creating event network-vif-unplugged:f56ba330-3206-4322-9474-e01afa8afef9 for instance 1b233a49-d4f5-412d-8239-74df4ce63aa5 on n-h1-850499-9 Aug 31 15:57:31.533003 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-0547b007-8dd4-4452-9ae2-cfea30bf822f req-04f1e459-2f5a-4cd0-9a4a-1e5f275d5102 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.075991 Aug 31 15:57:31.534799 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 224/439] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 15:57:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:57:31.541041 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-739072f9-0b08-436d-bf61-87e6df81f3f1 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174" status: 200 len: 1929 microversion: 2.75 time: 0.151184 Aug 31 15:57:31.555524 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 216/440] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:31 2022] GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174 => generated 1929 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:57:31.555524 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3733dca3-00ba-4af4-a638-16215b501490 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:31.556492 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-cf60080b-69e7-41dc-ade3-ac23918976eb tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Calling method '.version_select at 0x7f5ae9751940>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:31.556585 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3733dca3-00ba-4af4-a638-16215b501490 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] [instance: 4986a6de-1b24-42c5-942b-cd011b543cbc] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:31.574605 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3733dca3-00ba-4af4-a638-16215b501490 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:31.575287 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3733dca3-00ba-4af4-a638-16215b501490 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:31.575765 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3733dca3-00ba-4af4-a638-16215b501490 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:31.576488 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3733dca3-00ba-4af4-a638-16215b501490 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:31.576959 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3733dca3-00ba-4af4-a638-16215b501490 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:31.577562 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3733dca3-00ba-4af4-a638-16215b501490 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:31.612666 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-cf60080b-69e7-41dc-ade3-ac23918976eb tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] 10.222.0.61 "GET /compute/v2.1/images/774b58aa-38b5-446e-b72b-0fab93b7abf3" status: 200 len: 1428 microversion: 2.1 time: 0.071504 Aug 31 15:57:31.614466 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 225/441] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 15:57:31 2022] GET /compute/v2.1/images/774b58aa-38b5-446e-b72b-0fab93b7abf3 => generated 1428 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:31.628672 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-55b2afc2-7371-4d91-957b-98eb8b35cfb8 tempest-HypervisorAdminTestJSON-1889630499 tempest-HypervisorAdminTestJSON-1889630499-project-admin] Calling method '.version_select at 0x7f5ae99c41f0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:31.632171 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-55b2afc2-7371-4d91-957b-98eb8b35cfb8 tempest-HypervisorAdminTestJSON-1889630499 tempest-HypervisorAdminTestJSON-1889630499-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:31.632745 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-55b2afc2-7371-4d91-957b-98eb8b35cfb8 tempest-HypervisorAdminTestJSON-1889630499 tempest-HypervisorAdminTestJSON-1889630499-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:31.633581 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-55b2afc2-7371-4d91-957b-98eb8b35cfb8 tempest-HypervisorAdminTestJSON-1889630499 tempest-HypervisorAdminTestJSON-1889630499-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:31.654060 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3733dca3-00ba-4af4-a638-16215b501490 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd1dfe05c037461d8dfb45a6f611ced0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd5a49a78854f22aa3c58d01058e493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:31.672381 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3733dca3-00ba-4af4-a638-16215b501490 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] 10.222.0.61 "GET /compute/v2.1/servers/4986a6de-1b24-42c5-942b-cd011b543cbc" status: 200 len: 1278 microversion: 2.1 time: 0.128425 Aug 31 15:57:31.679878 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 217/442] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:31 2022] GET /compute/v2.1/servers/4986a6de-1b24-42c5-942b-cd011b543cbc => generated 1278 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:31.691949 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-55b2afc2-7371-4d91-957b-98eb8b35cfb8 tempest-HypervisorAdminTestJSON-1889630499 tempest-HypervisorAdminTestJSON-1889630499-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:31.692520 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-55b2afc2-7371-4d91-957b-98eb8b35cfb8 tempest-HypervisorAdminTestJSON-1889630499 tempest-HypervisorAdminTestJSON-1889630499-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:31.693129 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-55b2afc2-7371-4d91-957b-98eb8b35cfb8 tempest-HypervisorAdminTestJSON-1889630499 tempest-HypervisorAdminTestJSON-1889630499-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:31.703809 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-55b2afc2-7371-4d91-957b-98eb8b35cfb8 tempest-HypervisorAdminTestJSON-1889630499 tempest-HypervisorAdminTestJSON-1889630499-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:31.704428 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-55b2afc2-7371-4d91-957b-98eb8b35cfb8 tempest-HypervisorAdminTestJSON-1889630499 tempest-HypervisorAdminTestJSON-1889630499-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:31.705142 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-55b2afc2-7371-4d91-957b-98eb8b35cfb8 tempest-HypervisorAdminTestJSON-1889630499 tempest-HypervisorAdminTestJSON-1889630499-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:31.713362 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-55b2afc2-7371-4d91-957b-98eb8b35cfb8 tempest-HypervisorAdminTestJSON-1889630499 tempest-HypervisorAdminTestJSON-1889630499-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1505 microversion: 2.1 time: 0.097889 Aug 31 15:57:31.729303 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 226/443] 10.222.0.61 () {58 vars in 1167 bytes} [Wed Aug 31 15:57:31 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1505 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:31.733355 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ecbd4688-633e-4b8c-a30f-2ab4475b85c5 tempest-HypervisorAdminTestJSON-1889630499 tempest-HypervisorAdminTestJSON-1889630499-project-admin] Calling method '.version_select at 0x7f5ae945bb80>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:31.735440 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ecbd4688-633e-4b8c-a30f-2ab4475b85c5 tempest-HypervisorAdminTestJSON-1889630499 tempest-HypervisorAdminTestJSON-1889630499-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:31.735957 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ecbd4688-633e-4b8c-a30f-2ab4475b85c5 tempest-HypervisorAdminTestJSON-1889630499 tempest-HypervisorAdminTestJSON-1889630499-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:31.736590 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ecbd4688-633e-4b8c-a30f-2ab4475b85c5 tempest-HypervisorAdminTestJSON-1889630499 tempest-HypervisorAdminTestJSON-1889630499-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:31.752717 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ecbd4688-633e-4b8c-a30f-2ab4475b85c5 tempest-HypervisorAdminTestJSON-1889630499 tempest-HypervisorAdminTestJSON-1889630499-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:31.753217 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ecbd4688-633e-4b8c-a30f-2ab4475b85c5 tempest-HypervisorAdminTestJSON-1889630499 tempest-HypervisorAdminTestJSON-1889630499-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:31.753668 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ecbd4688-633e-4b8c-a30f-2ab4475b85c5 tempest-HypervisorAdminTestJSON-1889630499 tempest-HypervisorAdminTestJSON-1889630499-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:31.766027 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ecbd4688-633e-4b8c-a30f-2ab4475b85c5 tempest-HypervisorAdminTestJSON-1889630499 tempest-HypervisorAdminTestJSON-1889630499-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:31.766546 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ecbd4688-633e-4b8c-a30f-2ab4475b85c5 tempest-HypervisorAdminTestJSON-1889630499 tempest-HypervisorAdminTestJSON-1889630499-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:31.767051 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ecbd4688-633e-4b8c-a30f-2ab4475b85c5 tempest-HypervisorAdminTestJSON-1889630499 tempest-HypervisorAdminTestJSON-1889630499-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:31.770899 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6dd10e1d-6332-4681-82cf-73ae00c7d419 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:31.772957 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6dd10e1d-6332-4681-82cf-73ae00c7d419 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 79ee7e24-93df-450b-9030-b08c00d019eb] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:31.774266 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ecbd4688-633e-4b8c-a30f-2ab4475b85c5 tempest-HypervisorAdminTestJSON-1889630499 tempest-HypervisorAdminTestJSON-1889630499-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.045320 Aug 31 15:57:31.774948 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 218/444] 10.222.0.61 () {58 vars in 1146 bytes} [Wed Aug 31 15:57:31 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 15:57:31.784140 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6dd10e1d-6332-4681-82cf-73ae00c7d419 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:31.784893 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6dd10e1d-6332-4681-82cf-73ae00c7d419 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:31.785533 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6dd10e1d-6332-4681-82cf-73ae00c7d419 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:31.785979 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-af0d9e45-d2fc-4e59-a2a9-681700d8f367 tempest-HypervisorAdminTestJSON-1889630499 tempest-HypervisorAdminTestJSON-1889630499-project-admin] Calling method '.version_select at 0x7f5ae945ba60>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:31.786767 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6dd10e1d-6332-4681-82cf-73ae00c7d419 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:31.787804 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-af0d9e45-d2fc-4e59-a2a9-681700d8f367 tempest-HypervisorAdminTestJSON-1889630499 tempest-HypervisorAdminTestJSON-1889630499-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:31.788098 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6dd10e1d-6332-4681-82cf-73ae00c7d419 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:31.788290 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-af0d9e45-d2fc-4e59-a2a9-681700d8f367 tempest-HypervisorAdminTestJSON-1889630499 tempest-HypervisorAdminTestJSON-1889630499-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:31.788734 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-af0d9e45-d2fc-4e59-a2a9-681700d8f367 tempest-HypervisorAdminTestJSON-1889630499 tempest-HypervisorAdminTestJSON-1889630499-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:31.789102 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6dd10e1d-6332-4681-82cf-73ae00c7d419 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:31.802461 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-af0d9e45-d2fc-4e59-a2a9-681700d8f367 tempest-HypervisorAdminTestJSON-1889630499 tempest-HypervisorAdminTestJSON-1889630499-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:31.802953 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-af0d9e45-d2fc-4e59-a2a9-681700d8f367 tempest-HypervisorAdminTestJSON-1889630499 tempest-HypervisorAdminTestJSON-1889630499-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:31.803395 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-af0d9e45-d2fc-4e59-a2a9-681700d8f367 tempest-HypervisorAdminTestJSON-1889630499 tempest-HypervisorAdminTestJSON-1889630499-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:31.810456 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-af0d9e45-d2fc-4e59-a2a9-681700d8f367 tempest-HypervisorAdminTestJSON-1889630499 tempest-HypervisorAdminTestJSON-1889630499-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.028118 Aug 31 15:57:31.811388 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 219/445] 10.222.0.61 () {58 vars in 1152 bytes} [Wed Aug 31 15:57:31 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 15:57:31.826344 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-df0e0902-4ebb-44da-b7e9-0d3accfd3ad7 tempest-HypervisorAdminTestJSON-1889630499 tempest-HypervisorAdminTestJSON-1889630499-project-admin] Calling method '.version_select at 0x7f5ae94e0550>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:31.829936 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-df0e0902-4ebb-44da-b7e9-0d3accfd3ad7 tempest-HypervisorAdminTestJSON-1889630499 tempest-HypervisorAdminTestJSON-1889630499-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:31.831062 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-df0e0902-4ebb-44da-b7e9-0d3accfd3ad7 tempest-HypervisorAdminTestJSON-1889630499 tempest-HypervisorAdminTestJSON-1889630499-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:31.831844 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-df0e0902-4ebb-44da-b7e9-0d3accfd3ad7 tempest-HypervisorAdminTestJSON-1889630499 tempest-HypervisorAdminTestJSON-1889630499-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:31.860842 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-df0e0902-4ebb-44da-b7e9-0d3accfd3ad7 tempest-HypervisorAdminTestJSON-1889630499 tempest-HypervisorAdminTestJSON-1889630499-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.038287 Aug 31 15:57:31.861880 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 220/446] 10.222.0.61 () {58 vars in 1179 bytes} [Wed Aug 31 15:57:31 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 15:57:31.874479 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-635cf26e-f167-4b89-885d-c4f6a3bba1b0 tempest-HypervisorAdminTestJSON-1889630499 tempest-HypervisorAdminTestJSON-1889630499-project-admin] Calling method '.version_select at 0x7f5ae945b820>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:31.876851 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-635cf26e-f167-4b89-885d-c4f6a3bba1b0 tempest-HypervisorAdminTestJSON-1889630499 tempest-HypervisorAdminTestJSON-1889630499-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:31.877562 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-635cf26e-f167-4b89-885d-c4f6a3bba1b0 tempest-HypervisorAdminTestJSON-1889630499 tempest-HypervisorAdminTestJSON-1889630499-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:31.878164 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-635cf26e-f167-4b89-885d-c4f6a3bba1b0 tempest-HypervisorAdminTestJSON-1889630499 tempest-HypervisorAdminTestJSON-1889630499-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:31.898095 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-635cf26e-f167-4b89-885d-c4f6a3bba1b0 tempest-HypervisorAdminTestJSON-1889630499 tempest-HypervisorAdminTestJSON-1889630499-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:31.899044 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-635cf26e-f167-4b89-885d-c4f6a3bba1b0 tempest-HypervisorAdminTestJSON-1889630499 tempest-HypervisorAdminTestJSON-1889630499-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:31.899844 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-635cf26e-f167-4b89-885d-c4f6a3bba1b0 tempest-HypervisorAdminTestJSON-1889630499 tempest-HypervisorAdminTestJSON-1889630499-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:31.919945 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-635cf26e-f167-4b89-885d-c4f6a3bba1b0 tempest-HypervisorAdminTestJSON-1889630499 tempest-HypervisorAdminTestJSON-1889630499-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:31.920952 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-635cf26e-f167-4b89-885d-c4f6a3bba1b0 tempest-HypervisorAdminTestJSON-1889630499 tempest-HypervisorAdminTestJSON-1889630499-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:31.922052 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-635cf26e-f167-4b89-885d-c4f6a3bba1b0 tempest-HypervisorAdminTestJSON-1889630499 tempest-HypervisorAdminTestJSON-1889630499-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:31.930103 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-635cf26e-f167-4b89-885d-c4f6a3bba1b0 tempest-HypervisorAdminTestJSON-1889630499 tempest-HypervisorAdminTestJSON-1889630499-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.059623 Aug 31 15:57:31.931460 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 221/447] 10.222.0.61 () {58 vars in 1146 bytes} [Wed Aug 31 15:57:31 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:57:31.943818 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-01c2c905-5fbe-4a07-8f02-ec37b882ce77 tempest-HypervisorAdminTestJSON-1889630499 tempest-HypervisorAdminTestJSON-1889630499-project-admin] Calling method '.version_select at 0x7f5ae945b550>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:31.946133 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-01c2c905-5fbe-4a07-8f02-ec37b882ce77 tempest-HypervisorAdminTestJSON-1889630499 tempest-HypervisorAdminTestJSON-1889630499-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:31.946828 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-01c2c905-5fbe-4a07-8f02-ec37b882ce77 tempest-HypervisorAdminTestJSON-1889630499 tempest-HypervisorAdminTestJSON-1889630499-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:31.947724 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-01c2c905-5fbe-4a07-8f02-ec37b882ce77 tempest-HypervisorAdminTestJSON-1889630499 tempest-HypervisorAdminTestJSON-1889630499-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:31.969396 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-01c2c905-5fbe-4a07-8f02-ec37b882ce77 tempest-HypervisorAdminTestJSON-1889630499 tempest-HypervisorAdminTestJSON-1889630499-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:31.970129 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-01c2c905-5fbe-4a07-8f02-ec37b882ce77 tempest-HypervisorAdminTestJSON-1889630499 tempest-HypervisorAdminTestJSON-1889630499-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:31.970790 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-01c2c905-5fbe-4a07-8f02-ec37b882ce77 tempest-HypervisorAdminTestJSON-1889630499 tempest-HypervisorAdminTestJSON-1889630499-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:31.979396 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-01c2c905-5fbe-4a07-8f02-ec37b882ce77 tempest-HypervisorAdminTestJSON-1889630499 tempest-HypervisorAdminTestJSON-1889630499-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.041156 Aug 31 15:57:31.981341 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 222/448] 10.222.0.61 () {58 vars in 1152 bytes} [Wed Aug 31 15:57:31 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 15:57:31.997552 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6e64dc8d-6c64-42ee-9e34-ce34d9522a44 tempest-HypervisorAdminTestJSON-1889630499 tempest-HypervisorAdminTestJSON-1889630499-project-admin] Calling method '.version_select at 0x7f5ae94e05e0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:31.999718 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6e64dc8d-6c64-42ee-9e34-ce34d9522a44 tempest-HypervisorAdminTestJSON-1889630499 tempest-HypervisorAdminTestJSON-1889630499-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:32.000403 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6e64dc8d-6c64-42ee-9e34-ce34d9522a44 tempest-HypervisorAdminTestJSON-1889630499 tempest-HypervisorAdminTestJSON-1889630499-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:32.001005 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6e64dc8d-6c64-42ee-9e34-ce34d9522a44 tempest-HypervisorAdminTestJSON-1889630499 tempest-HypervisorAdminTestJSON-1889630499-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:32.017518 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6e64dc8d-6c64-42ee-9e34-ce34d9522a44 tempest-HypervisorAdminTestJSON-1889630499 tempest-HypervisorAdminTestJSON-1889630499-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:32.018136 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6e64dc8d-6c64-42ee-9e34-ce34d9522a44 tempest-HypervisorAdminTestJSON-1889630499 tempest-HypervisorAdminTestJSON-1889630499-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:32.018481 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6e64dc8d-6c64-42ee-9e34-ce34d9522a44 tempest-HypervisorAdminTestJSON-1889630499 tempest-HypervisorAdminTestJSON-1889630499-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:32.030190 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6e64dc8d-6c64-42ee-9e34-ce34d9522a44 tempest-HypervisorAdminTestJSON-1889630499 tempest-HypervisorAdminTestJSON-1889630499-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 758 microversion: 2.1 time: 0.038145 Aug 31 15:57:32.030832 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 223/449] 10.222.0.61 () {58 vars in 1152 bytes} [Wed Aug 31 15:57:31 2022] GET /compute/v2.1/os-hypervisors/2 => generated 758 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 15:57:32.041524 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-6dd10e1d-6332-4681-82cf-73ae00c7d419 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:32.050053 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f205371e-1e49-42f3-9786-4891d5fb0f94 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:32.050671 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f205371e-1e49-42f3-9786-4891d5fb0f94 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:32.058753 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f205371e-1e49-42f3-9786-4891d5fb0f94 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:32.059831 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f205371e-1e49-42f3-9786-4891d5fb0f94 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:32.060281 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f205371e-1e49-42f3-9786-4891d5fb0f94 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:32.061010 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f205371e-1e49-42f3-9786-4891d5fb0f94 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:32.061480 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f205371e-1e49-42f3-9786-4891d5fb0f94 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:32.061911 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f205371e-1e49-42f3-9786-4891d5fb0f94 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:32.068301 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-6dd10e1d-6332-4681-82cf-73ae00c7d419 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:32.070643 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-6dd10e1d-6332-4681-82cf-73ae00c7d419 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:32.072451 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6dd10e1d-6332-4681-82cf-73ae00c7d419 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/79ee7e24-93df-450b-9030-b08c00d019eb" status: 200 len: 1567 microversion: 2.25 time: 0.307103 Aug 31 15:57:32.078130 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 227/450] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:31 2022] GET /compute/v2.1/servers/79ee7e24-93df-450b-9030-b08c00d019eb => generated 1567 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:57:32.093006 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-67085644-f89a-4c7c-a4b8-cceabfaf7eba tempest-HypervisorAdminTestJSON-1889630499 tempest-HypervisorAdminTestJSON-1889630499-project-admin] Calling method '.version_select at 0x7f5ae9576ca0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:32.096144 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-67085644-f89a-4c7c-a4b8-cceabfaf7eba tempest-HypervisorAdminTestJSON-1889630499 tempest-HypervisorAdminTestJSON-1889630499-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:32.096701 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-67085644-f89a-4c7c-a4b8-cceabfaf7eba tempest-HypervisorAdminTestJSON-1889630499 tempest-HypervisorAdminTestJSON-1889630499-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:32.097140 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-67085644-f89a-4c7c-a4b8-cceabfaf7eba tempest-HypervisorAdminTestJSON-1889630499 tempest-HypervisorAdminTestJSON-1889630499-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:32.134141 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-67085644-f89a-4c7c-a4b8-cceabfaf7eba tempest-HypervisorAdminTestJSON-1889630499 tempest-HypervisorAdminTestJSON-1889630499-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:32.134790 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-67085644-f89a-4c7c-a4b8-cceabfaf7eba tempest-HypervisorAdminTestJSON-1889630499 tempest-HypervisorAdminTestJSON-1889630499-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:32.135340 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-67085644-f89a-4c7c-a4b8-cceabfaf7eba tempest-HypervisorAdminTestJSON-1889630499 tempest-HypervisorAdminTestJSON-1889630499-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:32.155721 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-67085644-f89a-4c7c-a4b8-cceabfaf7eba tempest-HypervisorAdminTestJSON-1889630499 tempest-HypervisorAdminTestJSON-1889630499-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:32.156885 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-67085644-f89a-4c7c-a4b8-cceabfaf7eba tempest-HypervisorAdminTestJSON-1889630499 tempest-HypervisorAdminTestJSON-1889630499-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:32.157333 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-67085644-f89a-4c7c-a4b8-cceabfaf7eba tempest-HypervisorAdminTestJSON-1889630499 tempest-HypervisorAdminTestJSON-1889630499-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:32.192448 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-67085644-f89a-4c7c-a4b8-cceabfaf7eba tempest-HypervisorAdminTestJSON-1889630499 tempest-HypervisorAdminTestJSON-1889630499-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.112757 Aug 31 15:57:32.193967 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 228/451] 10.222.0.61 () {58 vars in 1173 bytes} [Wed Aug 31 15:57:32 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:57:32.221359 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f205371e-1e49-42f3-9786-4891d5fb0f94 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:32.230507 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f205371e-1e49-42f3-9786-4891d5fb0f94 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56" status: 200 len: 1503 microversion: 2.1 time: 0.184457 Aug 31 15:57:32.232255 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 224/452] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:32 2022] GET /compute/v2.1/servers/bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56 => generated 1503 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:32.570149 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2c5e65fc-c7a3-45f5-8e81-fde40d041677 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:32.571169 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2c5e65fc-c7a3-45f5-8e81-fde40d041677 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] [instance: f2162319-5635-4c77-920d-9ecb3221d174] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:32.583571 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2c5e65fc-c7a3-45f5-8e81-fde40d041677 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:32.584137 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2c5e65fc-c7a3-45f5-8e81-fde40d041677 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:32.584926 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2c5e65fc-c7a3-45f5-8e81-fde40d041677 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:32.585833 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2c5e65fc-c7a3-45f5-8e81-fde40d041677 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:32.586381 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2c5e65fc-c7a3-45f5-8e81-fde40d041677 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:32.587129 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2c5e65fc-c7a3-45f5-8e81-fde40d041677 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:32.627470 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a14ee63c-e571-4957-8a95-f6a12fc1b87e tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Calling method '.version_select at 0x7f5ae94e0d30>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:32.688294 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a14ee63c-e571-4957-8a95-f6a12fc1b87e tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] 10.222.0.61 "GET /compute/v2.1/images/774b58aa-38b5-446e-b72b-0fab93b7abf3" status: 200 len: 1428 microversion: 2.1 time: 0.064643 Aug 31 15:57:32.689151 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 225/453] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 15:57:32 2022] GET /compute/v2.1/images/774b58aa-38b5-446e-b72b-0fab93b7abf3 => generated 1428 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:57:32.706048 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-673510f8-2432-4fda-b919-0a425f0cdfd2 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:32.706272 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-2c5e65fc-c7a3-45f5-8e81-fde40d041677 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lazy-loading 'services' on Instance uuid f2162319-5635-4c77-920d-9ecb3221d174 {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:57:32.706948 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-673510f8-2432-4fda-b919-0a425f0cdfd2 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] [instance: 4986a6de-1b24-42c5-942b-cd011b543cbc] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:32.714900 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-673510f8-2432-4fda-b919-0a425f0cdfd2 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:32.714900 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-673510f8-2432-4fda-b919-0a425f0cdfd2 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:32.715241 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-673510f8-2432-4fda-b919-0a425f0cdfd2 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:32.715984 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-673510f8-2432-4fda-b919-0a425f0cdfd2 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:32.716482 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-673510f8-2432-4fda-b919-0a425f0cdfd2 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:32.716855 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-673510f8-2432-4fda-b919-0a425f0cdfd2 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:32.744661 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2c5e65fc-c7a3-45f5-8e81-fde40d041677 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174" status: 200 len: 1929 microversion: 2.75 time: 0.178748 Aug 31 15:57:32.747924 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 229/454] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:32 2022] GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174 => generated 1929 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:57:32.753394 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-c70bbe43-895f-4562-a35a-19dcc22dd61a req-c9a31055-ef53-4425-8b01-a0692e13cb8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4986a6de-1b24-42c5-942b-cd011b543cbc", "tag": "230c1f66-b502-4442-bef2-05bb93e8a285"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:57:32.789274 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-c70bbe43-895f-4562-a35a-19dcc22dd61a req-c9a31055-ef53-4425-8b01-a0692e13cb8b service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:32.789806 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-c70bbe43-895f-4562-a35a-19dcc22dd61a req-c9a31055-ef53-4425-8b01-a0692e13cb8b service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:32.790263 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-c70bbe43-895f-4562-a35a-19dcc22dd61a req-c9a31055-ef53-4425-8b01-a0692e13cb8b service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:32.813579 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-c70bbe43-895f-4562-a35a-19dcc22dd61a req-c9a31055-ef53-4425-8b01-a0692e13cb8b service nova] Creating event network-changed:230c1f66-b502-4442-bef2-05bb93e8a285 for instance 4986a6de-1b24-42c5-942b-cd011b543cbc on n-h2-850499-9 Aug 31 15:57:32.819842 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-c70bbe43-895f-4562-a35a-19dcc22dd61a req-c9a31055-ef53-4425-8b01-a0692e13cb8b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069472 Aug 31 15:57:32.821128 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 230/455] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 15:57:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:57:32.976181 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-645133be-79b3-4fe6-8dd1-c54550ce848d tempest-QuotaClassesAdminTestJSON-583526877 tempest-QuotaClassesAdminTestJSON-583526877-project-admin] Calling method '.version_select at 0x7f5ae95b7310>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:32.989271 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-645133be-79b3-4fe6-8dd1-c54550ce848d tempest-QuotaClassesAdminTestJSON-583526877 tempest-QuotaClassesAdminTestJSON-583526877-project-admin] 10.222.0.61 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.166490 Aug 31 15:57:32.990146 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 231/456] 10.222.0.61 () {58 vars in 1185 bytes} [Wed Aug 31 15:57:32 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:57:33.003102 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4f86b00a-a343-4c2b-a525-7bc9724a4db6 tempest-QuotaClassesAdminTestJSON-583526877 tempest-QuotaClassesAdminTestJSON-583526877-project-admin] Action: 'update', calling method: .version_select at 0x7f5ae95140d0>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:57:33.006645 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-673510f8-2432-4fda-b919-0a425f0cdfd2 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd1dfe05c037461d8dfb45a6f611ced0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd5a49a78854f22aa3c58d01058e493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:33.013199 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=3,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:57:33.016875 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-673510f8-2432-4fda-b919-0a425f0cdfd2 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] 10.222.0.61 "GET /compute/v2.1/servers/4986a6de-1b24-42c5-942b-cd011b543cbc" status: 200 len: 1320 microversion: 2.1 time: 0.326521 Aug 31 15:57:33.017470 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 226/457] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:32 2022] GET /compute/v2.1/servers/4986a6de-1b24-42c5-942b-cd011b543cbc => generated 1320 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:33.100690 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2ea013d5-1836-4321-b371-4da22b0fb5d8 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:33.102747 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2ea013d5-1836-4321-b371-4da22b0fb5d8 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 79ee7e24-93df-450b-9030-b08c00d019eb] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:33.111168 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2ea013d5-1836-4321-b371-4da22b0fb5d8 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:33.111952 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2ea013d5-1836-4321-b371-4da22b0fb5d8 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:33.112431 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2ea013d5-1836-4321-b371-4da22b0fb5d8 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:33.113356 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2ea013d5-1836-4321-b371-4da22b0fb5d8 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:33.114113 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2ea013d5-1836-4321-b371-4da22b0fb5d8 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:33.114750 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2ea013d5-1836-4321-b371-4da22b0fb5d8 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:33.276914 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4f86b00a-a343-4c2b-a525-7bc9724a4db6 tempest-QuotaClassesAdminTestJSON-583526877 tempest-QuotaClassesAdminTestJSON-583526877-project-admin] 10.222.0.61 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.277897 Aug 31 15:57:33.283722 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 232/458] 10.222.0.61 () {60 vars in 1206 bytes} [Wed Aug 31 15:57:32 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:57:33.288526 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-64b05473-f83e-46e9-879d-ec9ae73e76c0 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:33.289254 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-64b05473-f83e-46e9-879d-ec9ae73e76c0 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:33.315675 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-64b05473-f83e-46e9-879d-ec9ae73e76c0 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:33.317763 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-64b05473-f83e-46e9-879d-ec9ae73e76c0 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:33.318212 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-64b05473-f83e-46e9-879d-ec9ae73e76c0 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:33.318951 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-64b05473-f83e-46e9-879d-ec9ae73e76c0 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:33.320248 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-64b05473-f83e-46e9-879d-ec9ae73e76c0 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:33.320248 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-64b05473-f83e-46e9-879d-ec9ae73e76c0 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:33.429679 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2ea013d5-1836-4321-b371-4da22b0fb5d8 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:33.439950 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2ea013d5-1836-4321-b371-4da22b0fb5d8 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:33.441927 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2ea013d5-1836-4321-b371-4da22b0fb5d8 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:33.443774 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2ea013d5-1836-4321-b371-4da22b0fb5d8 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/79ee7e24-93df-450b-9030-b08c00d019eb" status: 200 len: 1567 microversion: 2.25 time: 0.349882 Aug 31 15:57:33.444839 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 227/459] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:33 2022] GET /compute/v2.1/servers/79ee7e24-93df-450b-9030-b08c00d019eb => generated 1567 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 15:57:33.449822 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-99720334-3ee6-4793-8c53-aea6cf4ac4e0 tempest-QuotaClassesAdminTestJSON-583526877 tempest-QuotaClassesAdminTestJSON-583526877-project-admin] Calling method '.version_select at 0x7f5ae9499820>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:33.468463 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-99720334-3ee6-4793-8c53-aea6cf4ac4e0 tempest-QuotaClassesAdminTestJSON-583526877 tempest-QuotaClassesAdminTestJSON-583526877-project-admin] 10.222.0.61 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.022348 Aug 31 15:57:33.476836 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 228/460] 10.222.0.61 () {58 vars in 1185 bytes} [Wed Aug 31 15:57:33 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:57:33.482761 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-15d61bd5-34b7-4b6c-9bcc-399cc8e7b98a tempest-QuotaClassesAdminTestJSON-583526877 tempest-QuotaClassesAdminTestJSON-583526877-project-admin] Action: 'update', calling method: .version_select at 0x7f5ae96d5a60>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:57:33.582916 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-64b05473-f83e-46e9-879d-ec9ae73e76c0 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:33.593406 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-64b05473-f83e-46e9-879d-ec9ae73e76c0 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56" status: 200 len: 1503 microversion: 2.1 time: 0.308608 Aug 31 15:57:33.597023 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 233/461] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:33 2022] GET /compute/v2.1/servers/bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56 => generated 1503 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:33.627885 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-15d61bd5-34b7-4b6c-9bcc-399cc8e7b98a tempest-QuotaClassesAdminTestJSON-583526877 tempest-QuotaClassesAdminTestJSON-583526877-project-admin] 10.222.0.61 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.149814 Aug 31 15:57:33.629423 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 229/462] 10.222.0.61 () {60 vars in 1206 bytes} [Wed Aug 31 15:57:33 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:57:33.705586 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b2773fcc-dcae-4554-87e7-98b64d82db81 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Calling method '.version_select at 0x7f5ae99c41f0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:33.774832 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4c55fc3e-af95-4d92-a6a8-f254911920a7 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:33.775369 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4c55fc3e-af95-4d92-a6a8-f254911920a7 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] [instance: f2162319-5635-4c77-920d-9ecb3221d174] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:33.782308 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b2773fcc-dcae-4554-87e7-98b64d82db81 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] 10.222.0.61 "GET /compute/v2.1/images/774b58aa-38b5-446e-b72b-0fab93b7abf3" status: 200 len: 1428 microversion: 2.1 time: 0.081547 Aug 31 15:57:33.782913 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 234/463] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 15:57:33 2022] GET /compute/v2.1/images/774b58aa-38b5-446e-b72b-0fab93b7abf3 => generated 1428 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:57:33.786552 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4c55fc3e-af95-4d92-a6a8-f254911920a7 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:33.787065 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4c55fc3e-af95-4d92-a6a8-f254911920a7 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:33.787574 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4c55fc3e-af95-4d92-a6a8-f254911920a7 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:33.788304 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4c55fc3e-af95-4d92-a6a8-f254911920a7 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:33.789125 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4c55fc3e-af95-4d92-a6a8-f254911920a7 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:33.789347 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4c55fc3e-af95-4d92-a6a8-f254911920a7 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:33.872343 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-4c55fc3e-af95-4d92-a6a8-f254911920a7 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lazy-loading 'services' on Instance uuid f2162319-5635-4c77-920d-9ecb3221d174 {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:57:33.892029 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4c55fc3e-af95-4d92-a6a8-f254911920a7 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174" status: 200 len: 1929 microversion: 2.75 time: 0.122807 Aug 31 15:57:33.893065 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 230/464] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:33 2022] GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174 => generated 1929 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 15:57:34.040222 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e500de37-b81e-4026-a337-e0c5256b70cb tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:34.041209 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e500de37-b81e-4026-a337-e0c5256b70cb tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] [instance: 4986a6de-1b24-42c5-942b-cd011b543cbc] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:34.052500 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e500de37-b81e-4026-a337-e0c5256b70cb tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:34.053085 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e500de37-b81e-4026-a337-e0c5256b70cb tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:34.053591 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e500de37-b81e-4026-a337-e0c5256b70cb tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:34.054766 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e500de37-b81e-4026-a337-e0c5256b70cb tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:34.055429 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e500de37-b81e-4026-a337-e0c5256b70cb tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:34.056133 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e500de37-b81e-4026-a337-e0c5256b70cb tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:34.297889 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e500de37-b81e-4026-a337-e0c5256b70cb tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd1dfe05c037461d8dfb45a6f611ced0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd5a49a78854f22aa3c58d01058e493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:34.306489 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e500de37-b81e-4026-a337-e0c5256b70cb tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] 10.222.0.61 "GET /compute/v2.1/servers/4986a6de-1b24-42c5-942b-cd011b543cbc" status: 200 len: 1320 microversion: 2.1 time: 0.271325 Aug 31 15:57:34.307660 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 235/465] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:34 2022] GET /compute/v2.1/servers/4986a6de-1b24-42c5-942b-cd011b543cbc => generated 1320 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:34.467341 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-92cf7386-9fac-4654-aae8-ed876cd38d56 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:34.468613 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-92cf7386-9fac-4654-aae8-ed876cd38d56 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 79ee7e24-93df-450b-9030-b08c00d019eb] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:34.475468 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-92cf7386-9fac-4654-aae8-ed876cd38d56 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:34.476330 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-92cf7386-9fac-4654-aae8-ed876cd38d56 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:34.476926 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-92cf7386-9fac-4654-aae8-ed876cd38d56 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:34.477934 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-92cf7386-9fac-4654-aae8-ed876cd38d56 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:34.478531 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-92cf7386-9fac-4654-aae8-ed876cd38d56 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:34.479263 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-92cf7386-9fac-4654-aae8-ed876cd38d56 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:34.616826 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-cf3fe16f-1183-486a-830e-f2e4b5c1b8a0 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:34.617440 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-cf3fe16f-1183-486a-830e-f2e4b5c1b8a0 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:34.625025 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cf3fe16f-1183-486a-830e-f2e4b5c1b8a0 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:34.625745 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cf3fe16f-1183-486a-830e-f2e4b5c1b8a0 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:34.626373 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cf3fe16f-1183-486a-830e-f2e4b5c1b8a0 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:34.627083 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cf3fe16f-1183-486a-830e-f2e4b5c1b8a0 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:34.627570 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cf3fe16f-1183-486a-830e-f2e4b5c1b8a0 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:34.628166 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cf3fe16f-1183-486a-830e-f2e4b5c1b8a0 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:34.643285 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-92cf7386-9fac-4654-aae8-ed876cd38d56 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:34.654493 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-92cf7386-9fac-4654-aae8-ed876cd38d56 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:34.656205 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-92cf7386-9fac-4654-aae8-ed876cd38d56 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:34.657520 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-92cf7386-9fac-4654-aae8-ed876cd38d56 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/79ee7e24-93df-450b-9030-b08c00d019eb" status: 200 len: 1567 microversion: 2.25 time: 0.194758 Aug 31 15:57:34.658616 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 231/466] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:34 2022] GET /compute/v2.1/servers/79ee7e24-93df-450b-9030-b08c00d019eb => generated 1567 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:57:34.790488 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-cf3fe16f-1183-486a-830e-f2e4b5c1b8a0 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:34.795021 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=100 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:57:34.798882 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-307df534-d7ec-4bd6-bb24-1d51d15c4b4f tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Calling method '.version_select at 0x7f5ae96d54c0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:34.800335 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-cf3fe16f-1183-486a-830e-f2e4b5c1b8a0 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56" status: 200 len: 1503 microversion: 2.1 time: 0.187360 Aug 31 15:57:34.815792 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 236/467] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:34 2022] GET /compute/v2.1/servers/bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56 => generated 1503 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:34.850417 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-307df534-d7ec-4bd6-bb24-1d51d15c4b4f tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] 10.222.0.61 "GET /compute/v2.1/images/774b58aa-38b5-446e-b72b-0fab93b7abf3" status: 200 len: 1428 microversion: 2.1 time: 0.055805 Aug 31 15:57:34.851143 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 232/468] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 15:57:34 2022] GET /compute/v2.1/images/774b58aa-38b5-446e-b72b-0fab93b7abf3 => generated 1428 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:34.920547 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d61920ec-a753-4864-8c5a-59c9882efafd tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:34.921348 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d61920ec-a753-4864-8c5a-59c9882efafd tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] [instance: f2162319-5635-4c77-920d-9ecb3221d174] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:34.928083 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d61920ec-a753-4864-8c5a-59c9882efafd tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:34.928692 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d61920ec-a753-4864-8c5a-59c9882efafd tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:34.929234 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d61920ec-a753-4864-8c5a-59c9882efafd tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:34.929999 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d61920ec-a753-4864-8c5a-59c9882efafd tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:34.930639 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d61920ec-a753-4864-8c5a-59c9882efafd tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:34.931253 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d61920ec-a753-4864-8c5a-59c9882efafd tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:35.027854 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-d61920ec-a753-4864-8c5a-59c9882efafd tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lazy-loading 'services' on Instance uuid f2162319-5635-4c77-920d-9ecb3221d174 {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:57:35.047455 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d61920ec-a753-4864-8c5a-59c9882efafd tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174" status: 200 len: 1929 microversion: 2.75 time: 0.131931 Aug 31 15:57:35.048095 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 237/469] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:34 2022] GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174 => generated 1929 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:57:35.329447 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-47eccdd6-7c19-482e-9473-79d15949c68c tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:35.330040 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-47eccdd6-7c19-482e-9473-79d15949c68c tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] [instance: 4986a6de-1b24-42c5-942b-cd011b543cbc] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:35.338206 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-47eccdd6-7c19-482e-9473-79d15949c68c tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:35.338690 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-47eccdd6-7c19-482e-9473-79d15949c68c tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:35.340140 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-47eccdd6-7c19-482e-9473-79d15949c68c tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:35.340858 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-47eccdd6-7c19-482e-9473-79d15949c68c tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:35.341389 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-47eccdd6-7c19-482e-9473-79d15949c68c tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:35.341743 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-47eccdd6-7c19-482e-9473-79d15949c68c tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:35.494425 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-47eccdd6-7c19-482e-9473-79d15949c68c tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd1dfe05c037461d8dfb45a6f611ced0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd5a49a78854f22aa3c58d01058e493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:35.502357 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-47eccdd6-7c19-482e-9473-79d15949c68c tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] 10.222.0.61 "GET /compute/v2.1/servers/4986a6de-1b24-42c5-942b-cd011b543cbc" status: 200 len: 1320 microversion: 2.1 time: 0.177143 Aug 31 15:57:35.503354 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 233/470] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:35 2022] GET /compute/v2.1/servers/4986a6de-1b24-42c5-942b-cd011b543cbc => generated 1320 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:35.682024 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-aaac97b5-f9ba-4a88-b2e3-9a173667989d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:35.683280 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-aaac97b5-f9ba-4a88-b2e3-9a173667989d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 79ee7e24-93df-450b-9030-b08c00d019eb] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:35.695906 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aaac97b5-f9ba-4a88-b2e3-9a173667989d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:35.696405 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aaac97b5-f9ba-4a88-b2e3-9a173667989d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:35.696858 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aaac97b5-f9ba-4a88-b2e3-9a173667989d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:35.697562 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aaac97b5-f9ba-4a88-b2e3-9a173667989d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:35.698016 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aaac97b5-f9ba-4a88-b2e3-9a173667989d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:35.699003 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aaac97b5-f9ba-4a88-b2e3-9a173667989d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:35.822366 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4a3a2a36-82dd-4a4b-81f0-962ebbec3477 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:35.823772 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4a3a2a36-82dd-4a4b-81f0-962ebbec3477 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:35.830271 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4a3a2a36-82dd-4a4b-81f0-962ebbec3477 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:35.831657 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4a3a2a36-82dd-4a4b-81f0-962ebbec3477 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:35.832335 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4a3a2a36-82dd-4a4b-81f0-962ebbec3477 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:35.833153 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4a3a2a36-82dd-4a4b-81f0-962ebbec3477 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:35.833680 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4a3a2a36-82dd-4a4b-81f0-962ebbec3477 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:35.834184 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4a3a2a36-82dd-4a4b-81f0-962ebbec3477 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:35.875039 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-aaac97b5-f9ba-4a88-b2e3-9a173667989d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:35.893879 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-aaac97b5-f9ba-4a88-b2e3-9a173667989d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:35.895357 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-aaac97b5-f9ba-4a88-b2e3-9a173667989d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:35.896565 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-aaac97b5-f9ba-4a88-b2e3-9a173667989d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/79ee7e24-93df-450b-9030-b08c00d019eb" status: 200 len: 1567 microversion: 2.25 time: 0.218511 Aug 31 15:57:35.897317 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 238/471] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:35 2022] GET /compute/v2.1/servers/79ee7e24-93df-450b-9030-b08c00d019eb => generated 1567 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:57:35.903225 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-65139ab2-69a2-4a0c-9bad-9d25ff15757a tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Calling method '.version_select at 0x7f5ae95b7dc0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:35.968369 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-65139ab2-69a2-4a0c-9bad-9d25ff15757a tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] 10.222.0.61 "GET /compute/v2.1/images/774b58aa-38b5-446e-b72b-0fab93b7abf3" status: 200 len: 1428 microversion: 2.1 time: 0.070194 Aug 31 15:57:35.968942 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 239/472] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 15:57:35 2022] GET /compute/v2.1/images/774b58aa-38b5-446e-b72b-0fab93b7abf3 => generated 1428 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:36.016347 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-4a3a2a36-82dd-4a4b-81f0-962ebbec3477 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:36.026241 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4a3a2a36-82dd-4a4b-81f0-962ebbec3477 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56" status: 200 len: 1503 microversion: 2.1 time: 0.207971 Aug 31 15:57:36.035544 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 234/473] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:35 2022] GET /compute/v2.1/servers/bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56 => generated 1503 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:36.073633 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e4de595c-462f-49ca-93ba-34aa1e335c52 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:36.074170 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e4de595c-462f-49ca-93ba-34aa1e335c52 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] [instance: f2162319-5635-4c77-920d-9ecb3221d174] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:36.080994 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e4de595c-462f-49ca-93ba-34aa1e335c52 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:36.081492 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e4de595c-462f-49ca-93ba-34aa1e335c52 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:36.081936 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e4de595c-462f-49ca-93ba-34aa1e335c52 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:36.082642 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e4de595c-462f-49ca-93ba-34aa1e335c52 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:36.083106 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e4de595c-462f-49ca-93ba-34aa1e335c52 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:36.083556 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e4de595c-462f-49ca-93ba-34aa1e335c52 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:36.173779 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-e4de595c-462f-49ca-93ba-34aa1e335c52 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lazy-loading 'services' on Instance uuid f2162319-5635-4c77-920d-9ecb3221d174 {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:57:36.187685 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e4de595c-462f-49ca-93ba-34aa1e335c52 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174" status: 200 len: 1929 microversion: 2.75 time: 0.118032 Aug 31 15:57:36.188265 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 235/474] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:36 2022] GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174 => generated 1929 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:57:36.274471 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e89318bc-bd2c-4b2e-8770-7bc3bdbc7185 tempest-HypervisorAdminV253TestBase-1897662708 tempest-HypervisorAdminV253TestBase-1897662708-project-admin] Calling method '.version_select at 0x7f5ae9751b80>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:36.279323 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e89318bc-bd2c-4b2e-8770-7bc3bdbc7185 tempest-HypervisorAdminV253TestBase-1897662708 tempest-HypervisorAdminV253TestBase-1897662708-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:36.280471 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e89318bc-bd2c-4b2e-8770-7bc3bdbc7185 tempest-HypervisorAdminV253TestBase-1897662708 tempest-HypervisorAdminV253TestBase-1897662708-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:36.280958 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e89318bc-bd2c-4b2e-8770-7bc3bdbc7185 tempest-HypervisorAdminV253TestBase-1897662708 tempest-HypervisorAdminV253TestBase-1897662708-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:36.294931 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e89318bc-bd2c-4b2e-8770-7bc3bdbc7185 tempest-HypervisorAdminV253TestBase-1897662708 tempest-HypervisorAdminV253TestBase-1897662708-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:36.295416 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e89318bc-bd2c-4b2e-8770-7bc3bdbc7185 tempest-HypervisorAdminV253TestBase-1897662708 tempest-HypervisorAdminV253TestBase-1897662708-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:36.295891 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e89318bc-bd2c-4b2e-8770-7bc3bdbc7185 tempest-HypervisorAdminV253TestBase-1897662708 tempest-HypervisorAdminV253TestBase-1897662708-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:36.323942 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e89318bc-bd2c-4b2e-8770-7bc3bdbc7185 tempest-HypervisorAdminV253TestBase-1897662708 tempest-HypervisorAdminV253TestBase-1897662708-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:36.324360 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e89318bc-bd2c-4b2e-8770-7bc3bdbc7185 tempest-HypervisorAdminV253TestBase-1897662708 tempest-HypervisorAdminV253TestBase-1897662708-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:36.324804 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e89318bc-bd2c-4b2e-8770-7bc3bdbc7185 tempest-HypervisorAdminV253TestBase-1897662708 tempest-HypervisorAdminV253TestBase-1897662708-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:36.335886 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e89318bc-bd2c-4b2e-8770-7bc3bdbc7185 tempest-HypervisorAdminV253TestBase-1897662708 tempest-HypervisorAdminV253TestBase-1897662708-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:36.336367 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e89318bc-bd2c-4b2e-8770-7bc3bdbc7185 tempest-HypervisorAdminV253TestBase-1897662708 tempest-HypervisorAdminV253TestBase-1897662708-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:36.337172 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e89318bc-bd2c-4b2e-8770-7bc3bdbc7185 tempest-HypervisorAdminV253TestBase-1897662708 tempest-HypervisorAdminV253TestBase-1897662708-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:36.361761 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e89318bc-bd2c-4b2e-8770-7bc3bdbc7185 tempest-HypervisorAdminV253TestBase-1897662708 tempest-HypervisorAdminV253TestBase-1897662708-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:36.362258 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e89318bc-bd2c-4b2e-8770-7bc3bdbc7185 tempest-HypervisorAdminV253TestBase-1897662708 tempest-HypervisorAdminV253TestBase-1897662708-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:36.362694 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e89318bc-bd2c-4b2e-8770-7bc3bdbc7185 tempest-HypervisorAdminV253TestBase-1897662708 tempest-HypervisorAdminV253TestBase-1897662708-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:36.371191 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e89318bc-bd2c-4b2e-8770-7bc3bdbc7185 tempest-HypervisorAdminV253TestBase-1897662708 tempest-HypervisorAdminV253TestBase-1897662708-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 2073 microversion: 2.53 time: 0.369330 Aug 31 15:57:36.372052 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 240/475] 10.222.0.61 () {60 vars in 1243 bytes} [Wed Aug 31 15:57:36 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 2073 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 15:57:36.388144 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3f82cf56-b5c7-46c1-b1b2-86bab1ab0d06 tempest-HypervisorAdminV253TestBase-1897662708 tempest-HypervisorAdminV253TestBase-1897662708-project-admin] Calling method '.version_select at 0x7f5ae945bb80>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:36.392136 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3f82cf56-b5c7-46c1-b1b2-86bab1ab0d06 tempest-HypervisorAdminV253TestBase-1897662708 tempest-HypervisorAdminV253TestBase-1897662708-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:36.392703 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3f82cf56-b5c7-46c1-b1b2-86bab1ab0d06 tempest-HypervisorAdminV253TestBase-1897662708 tempest-HypervisorAdminV253TestBase-1897662708-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:36.393197 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3f82cf56-b5c7-46c1-b1b2-86bab1ab0d06 tempest-HypervisorAdminV253TestBase-1897662708 tempest-HypervisorAdminV253TestBase-1897662708-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:36.396847 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:57:36.413993 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3f82cf56-b5c7-46c1-b1b2-86bab1ab0d06 tempest-HypervisorAdminV253TestBase-1897662708 tempest-HypervisorAdminV253TestBase-1897662708-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:36.414473 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3f82cf56-b5c7-46c1-b1b2-86bab1ab0d06 tempest-HypervisorAdminV253TestBase-1897662708 tempest-HypervisorAdminV253TestBase-1897662708-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:36.414903 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3f82cf56-b5c7-46c1-b1b2-86bab1ab0d06 tempest-HypervisorAdminV253TestBase-1897662708 tempest-HypervisorAdminV253TestBase-1897662708-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:36.452245 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3f82cf56-b5c7-46c1-b1b2-86bab1ab0d06 tempest-HypervisorAdminV253TestBase-1897662708 tempest-HypervisorAdminV253TestBase-1897662708-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:36.452732 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3f82cf56-b5c7-46c1-b1b2-86bab1ab0d06 tempest-HypervisorAdminV253TestBase-1897662708 tempest-HypervisorAdminV253TestBase-1897662708-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:36.453182 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3f82cf56-b5c7-46c1-b1b2-86bab1ab0d06 tempest-HypervisorAdminV253TestBase-1897662708 tempest-HypervisorAdminV253TestBase-1897662708-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:36.464218 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3f82cf56-b5c7-46c1-b1b2-86bab1ab0d06 tempest-HypervisorAdminV253TestBase-1897662708 tempest-HypervisorAdminV253TestBase-1897662708-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:36.464708 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3f82cf56-b5c7-46c1-b1b2-86bab1ab0d06 tempest-HypervisorAdminV253TestBase-1897662708 tempest-HypervisorAdminV253TestBase-1897662708-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:36.465139 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3f82cf56-b5c7-46c1-b1b2-86bab1ab0d06 tempest-HypervisorAdminV253TestBase-1897662708 tempest-HypervisorAdminV253TestBase-1897662708-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:36.487812 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3f82cf56-b5c7-46c1-b1b2-86bab1ab0d06 tempest-HypervisorAdminV253TestBase-1897662708 tempest-HypervisorAdminV253TestBase-1897662708-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:36.488288 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3f82cf56-b5c7-46c1-b1b2-86bab1ab0d06 tempest-HypervisorAdminV253TestBase-1897662708 tempest-HypervisorAdminV253TestBase-1897662708-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:36.488718 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3f82cf56-b5c7-46c1-b1b2-86bab1ab0d06 tempest-HypervisorAdminV253TestBase-1897662708 tempest-HypervisorAdminV253TestBase-1897662708-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:36.494567 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3f82cf56-b5c7-46c1-b1b2-86bab1ab0d06 tempest-HypervisorAdminV253TestBase-1897662708 tempest-HypervisorAdminV253TestBase-1897662708-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 765 microversion: 2.53 time: 0.110516 Aug 31 15:57:36.496039 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 236/476] 10.222.0.61 () {60 vars in 1222 bytes} [Wed Aug 31 15:57:36 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 765 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 15:57:36.507669 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f617be32-ba5b-409d-bbda-d7a1c0371072 tempest-HypervisorAdminV253TestBase-1897662708 tempest-HypervisorAdminV253TestBase-1897662708-project-admin] Calling method '.version_select at 0x7f5ae9504790>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:36.512152 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f617be32-ba5b-409d-bbda-d7a1c0371072 tempest-HypervisorAdminV253TestBase-1897662708 tempest-HypervisorAdminV253TestBase-1897662708-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:36.512777 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f617be32-ba5b-409d-bbda-d7a1c0371072 tempest-HypervisorAdminV253TestBase-1897662708 tempest-HypervisorAdminV253TestBase-1897662708-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:36.513461 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f617be32-ba5b-409d-bbda-d7a1c0371072 tempest-HypervisorAdminV253TestBase-1897662708 tempest-HypervisorAdminV253TestBase-1897662708-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:36.525426 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-287ec9f4-4b38-4b42-876f-84615b36a699 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:36.526522 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-287ec9f4-4b38-4b42-876f-84615b36a699 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] [instance: 4986a6de-1b24-42c5-942b-cd011b543cbc] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:36.531570 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f617be32-ba5b-409d-bbda-d7a1c0371072 tempest-HypervisorAdminV253TestBase-1897662708 tempest-HypervisorAdminV253TestBase-1897662708-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:36.532276 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f617be32-ba5b-409d-bbda-d7a1c0371072 tempest-HypervisorAdminV253TestBase-1897662708 tempest-HypervisorAdminV253TestBase-1897662708-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:36.532877 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f617be32-ba5b-409d-bbda-d7a1c0371072 tempest-HypervisorAdminV253TestBase-1897662708 tempest-HypervisorAdminV253TestBase-1897662708-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:36.534669 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-287ec9f4-4b38-4b42-876f-84615b36a699 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:36.535162 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-287ec9f4-4b38-4b42-876f-84615b36a699 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:36.535618 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-287ec9f4-4b38-4b42-876f-84615b36a699 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:36.536434 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-287ec9f4-4b38-4b42-876f-84615b36a699 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:36.536995 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-287ec9f4-4b38-4b42-876f-84615b36a699 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:36.537577 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-287ec9f4-4b38-4b42-876f-84615b36a699 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:36.541023 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f617be32-ba5b-409d-bbda-d7a1c0371072 tempest-HypervisorAdminV253TestBase-1897662708 tempest-HypervisorAdminV253TestBase-1897662708-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hypervisors/c5e314f8-f7a3-4364-bc60-8056a6829ec1" status: 200 len: 792 microversion: 2.53 time: 0.037066 Aug 31 15:57:36.542746 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 241/477] 10.222.0.61 () {60 vars in 1298 bytes} [Wed Aug 31 15:57:36 2022] GET /compute/v2.1/os-hypervisors/c5e314f8-f7a3-4364-bc60-8056a6829ec1 => generated 792 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 15:57:36.765670 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-287ec9f4-4b38-4b42-876f-84615b36a699 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd1dfe05c037461d8dfb45a6f611ced0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd5a49a78854f22aa3c58d01058e493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:36.773665 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-287ec9f4-4b38-4b42-876f-84615b36a699 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] 10.222.0.61 "GET /compute/v2.1/servers/4986a6de-1b24-42c5-942b-cd011b543cbc" status: 200 len: 1320 microversion: 2.1 time: 0.253715 Aug 31 15:57:36.774492 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 237/478] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:36 2022] GET /compute/v2.1/servers/4986a6de-1b24-42c5-942b-cd011b543cbc => generated 1320 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:36.923051 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-09567e3b-1108-40f8-ae48-512895b01637 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:36.923899 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-09567e3b-1108-40f8-ae48-512895b01637 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 79ee7e24-93df-450b-9030-b08c00d019eb] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:36.940861 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-09567e3b-1108-40f8-ae48-512895b01637 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:36.941376 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-09567e3b-1108-40f8-ae48-512895b01637 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:36.941819 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-09567e3b-1108-40f8-ae48-512895b01637 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:36.942620 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-09567e3b-1108-40f8-ae48-512895b01637 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:36.942994 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-09567e3b-1108-40f8-ae48-512895b01637 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:36.943429 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-09567e3b-1108-40f8-ae48-512895b01637 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:36.983539 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-44e0c93a-9c59-4f9a-9f85-676fa273a69e tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Calling method '.version_select at 0x7f5ae9470f70>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:37.044149 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-44e0c93a-9c59-4f9a-9f85-676fa273a69e tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] 10.222.0.61 "GET /compute/v2.1/images/774b58aa-38b5-446e-b72b-0fab93b7abf3" status: 200 len: 1428 microversion: 2.1 time: 0.064485 Aug 31 15:57:37.045297 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 238/479] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 15:57:36 2022] GET /compute/v2.1/images/774b58aa-38b5-446e-b72b-0fab93b7abf3 => generated 1428 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:57:37.051678 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0f7af59e-4970-4805-a822-6cae0bbf3d22 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:37.052943 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0f7af59e-4970-4805-a822-6cae0bbf3d22 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:37.060915 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0f7af59e-4970-4805-a822-6cae0bbf3d22 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:37.061601 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0f7af59e-4970-4805-a822-6cae0bbf3d22 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:37.062197 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0f7af59e-4970-4805-a822-6cae0bbf3d22 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:37.063067 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0f7af59e-4970-4805-a822-6cae0bbf3d22 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:37.063741 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0f7af59e-4970-4805-a822-6cae0bbf3d22 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:37.064349 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0f7af59e-4970-4805-a822-6cae0bbf3d22 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:37.347656 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-09567e3b-1108-40f8-ae48-512895b01637 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:37.359518 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-09567e3b-1108-40f8-ae48-512895b01637 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:37.361698 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-09567e3b-1108-40f8-ae48-512895b01637 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:37.363788 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-09567e3b-1108-40f8-ae48-512895b01637 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/79ee7e24-93df-450b-9030-b08c00d019eb" status: 200 len: 1567 microversion: 2.25 time: 0.446689 Aug 31 15:57:37.364432 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 242/480] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:36 2022] GET /compute/v2.1/servers/79ee7e24-93df-450b-9030-b08c00d019eb => generated 1567 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:57:37.430816 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0f7af59e-4970-4805-a822-6cae0bbf3d22 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:37.440914 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0f7af59e-4970-4805-a822-6cae0bbf3d22 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56" status: 200 len: 1503 microversion: 2.1 time: 0.394153 Aug 31 15:57:37.441505 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 239/481] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:37 2022] GET /compute/v2.1/servers/bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56 => generated 1503 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:37.446151 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-34be97bc-a3cb-4b19-b207-3e2fe6040801 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:37.453964 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-34be97bc-a3cb-4b19-b207-3e2fe6040801 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] [instance: f2162319-5635-4c77-920d-9ecb3221d174] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:37.460980 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-34be97bc-a3cb-4b19-b207-3e2fe6040801 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:37.461941 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-34be97bc-a3cb-4b19-b207-3e2fe6040801 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:37.462531 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-34be97bc-a3cb-4b19-b207-3e2fe6040801 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:37.464635 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-34be97bc-a3cb-4b19-b207-3e2fe6040801 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:37.465293 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-34be97bc-a3cb-4b19-b207-3e2fe6040801 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:37.465462 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-34be97bc-a3cb-4b19-b207-3e2fe6040801 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:37.583848 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-34be97bc-a3cb-4b19-b207-3e2fe6040801 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lazy-loading 'services' on Instance uuid f2162319-5635-4c77-920d-9ecb3221d174 {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:57:37.606322 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-34be97bc-a3cb-4b19-b207-3e2fe6040801 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174" status: 200 len: 1929 microversion: 2.75 time: 0.163112 Aug 31 15:57:37.607749 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 240/482] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:37 2022] GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174 => generated 1929 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:57:37.629727 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-76252dfa-cd37-405f-88b0-b62f6b19833f tempest-QuotasAdminNegativeTest-610268275 tempest-QuotasAdminNegativeTest-610268275-project-admin] Calling method '.version_select at 0x7f5ae9492160>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:37.746800 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-76252dfa-cd37-405f-88b0-b62f6b19833f tempest-QuotasAdminNegativeTest-610268275 tempest-QuotasAdminNegativeTest-610268275-project-admin] 10.222.0.61 "GET /compute/v2.1/os-quota-sets/a28573760605489fbff981606988242c" status: 200 len: 371 microversion: 2.1 time: 0.379145 Aug 31 15:57:37.747417 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 243/483] 10.222.0.61 () {58 vars in 1242 bytes} [Wed Aug 31 15:57:37 2022] GET /compute/v2.1/os-quota-sets/a28573760605489fbff981606988242c => generated 371 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:57:37.764575 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5dc60af1-866e-4940-9afa-a93bb41d5104 tempest-QuotasAdminNegativeTest-610268275 tempest-QuotasAdminNegativeTest-610268275-project-admin] Action: 'update', calling method: .version_select at 0x7f5ae94da0d0>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:57:37.796634 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a58845bc-e6cc-44f6-8bb9-da99b6f82c0f tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:37.797261 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a58845bc-e6cc-44f6-8bb9-da99b6f82c0f tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] [instance: 4986a6de-1b24-42c5-942b-cd011b543cbc] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:37.806367 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a58845bc-e6cc-44f6-8bb9-da99b6f82c0f tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:37.810449 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a58845bc-e6cc-44f6-8bb9-da99b6f82c0f tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:37.811214 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a58845bc-e6cc-44f6-8bb9-da99b6f82c0f tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:37.812474 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a58845bc-e6cc-44f6-8bb9-da99b6f82c0f tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:37.812962 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a58845bc-e6cc-44f6-8bb9-da99b6f82c0f tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:37.813400 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a58845bc-e6cc-44f6-8bb9-da99b6f82c0f tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:37.878617 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5dc60af1-866e-4940-9afa-a93bb41d5104 tempest-QuotasAdminNegativeTest-610268275 tempest-QuotasAdminNegativeTest-610268275-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:37.879118 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5dc60af1-866e-4940-9afa-a93bb41d5104 tempest-QuotasAdminNegativeTest-610268275 tempest-QuotasAdminNegativeTest-610268275-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:37.879690 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5dc60af1-866e-4940-9afa-a93bb41d5104 tempest-QuotasAdminNegativeTest-610268275 tempest-QuotasAdminNegativeTest-610268275-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:37.880487 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5dc60af1-866e-4940-9afa-a93bb41d5104 tempest-QuotasAdminNegativeTest-610268275 tempest-QuotasAdminNegativeTest-610268275-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:37.880940 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5dc60af1-866e-4940-9afa-a93bb41d5104 tempest-QuotasAdminNegativeTest-610268275 tempest-QuotasAdminNegativeTest-610268275-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:37.881360 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5dc60af1-866e-4940-9afa-a93bb41d5104 tempest-QuotasAdminNegativeTest-610268275 tempest-QuotasAdminNegativeTest-610268275-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:37.902434 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=12 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:57:37.952777 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5dc60af1-866e-4940-9afa-a93bb41d5104 tempest-QuotasAdminNegativeTest-610268275 tempest-QuotasAdminNegativeTest-610268275-project-admin] 10.222.0.61 "PUT /compute/v2.1/os-quota-sets/a28573760605489fbff981606988242c" status: 200 len: 328 microversion: 2.1 time: 0.197454 Aug 31 15:57:37.953401 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 241/484] 10.222.0.61 () {60 vars in 1262 bytes} [Wed Aug 31 15:57:37 2022] PUT /compute/v2.1/os-quota-sets/a28573760605489fbff981606988242c => generated 328 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:57:38.002259 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a58845bc-e6cc-44f6-8bb9-da99b6f82c0f tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd1dfe05c037461d8dfb45a6f611ced0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd5a49a78854f22aa3c58d01058e493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:38.012033 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a58845bc-e6cc-44f6-8bb9-da99b6f82c0f tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] 10.222.0.61 "GET /compute/v2.1/servers/4986a6de-1b24-42c5-942b-cd011b543cbc" status: 200 len: 1320 microversion: 2.1 time: 0.220891 Aug 31 15:57:38.013084 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 244/485] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:37 2022] GET /compute/v2.1/servers/4986a6de-1b24-42c5-942b-cd011b543cbc => generated 1320 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:38.060825 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-25ee1e9e-bd26-4581-9a65-cbf24ad13a11 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Calling method '.version_select at 0x7f5ae93cd670>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:38.107912 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-25ee1e9e-bd26-4581-9a65-cbf24ad13a11 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] 10.222.0.61 "GET /compute/v2.1/images/774b58aa-38b5-446e-b72b-0fab93b7abf3" status: 200 len: 1428 microversion: 2.1 time: 0.052255 Aug 31 15:57:38.108490 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 242/486] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 15:57:38 2022] GET /compute/v2.1/images/774b58aa-38b5-446e-b72b-0fab93b7abf3 => generated 1428 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:38.369834 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-57c86c16-35ff-459c-94dd-7a61b82ff5db tempest-QuotasAdminNegativeTest-956917036 tempest-QuotasAdminNegativeTest-956917036-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1293408658", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:57:38.390673 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8c654a46-9e92-4dc8-b61f-208650688cff tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:38.391294 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8c654a46-9e92-4dc8-b61f-208650688cff tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 79ee7e24-93df-450b-9030-b08c00d019eb] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:38.400151 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8c654a46-9e92-4dc8-b61f-208650688cff tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:38.400648 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8c654a46-9e92-4dc8-b61f-208650688cff tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:38.401090 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8c654a46-9e92-4dc8-b61f-208650688cff tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:38.402755 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8c654a46-9e92-4dc8-b61f-208650688cff tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:38.403255 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8c654a46-9e92-4dc8-b61f-208650688cff tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:38.403721 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8c654a46-9e92-4dc8-b61f-208650688cff tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:38.428444 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-57c86c16-35ff-459c-94dd-7a61b82ff5db tempest-QuotasAdminNegativeTest-956917036 tempest-QuotasAdminNegativeTest-956917036-project] validate_networks() for None {{(pid=122256) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 15:57:38.742989 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=6 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:57:38.893230 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8c654a46-9e92-4dc8-b61f-208650688cff tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:38.912584 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8c654a46-9e92-4dc8-b61f-208650688cff tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:38.914222 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8c654a46-9e92-4dc8-b61f-208650688cff tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:38.916120 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8c654a46-9e92-4dc8-b61f-208650688cff tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/79ee7e24-93df-450b-9030-b08c00d019eb" status: 200 len: 1567 microversion: 2.25 time: 0.530555 Aug 31 15:57:38.933223 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 243/487] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:38 2022] GET /compute/v2.1/servers/79ee7e24-93df-450b-9030-b08c00d019eb => generated 1567 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 15:57:38.933223 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4556437d-ea46-4751-a3ca-36c863dea68a tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:38.933223 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4556437d-ea46-4751-a3ca-36c863dea68a tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:38.933223 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4556437d-ea46-4751-a3ca-36c863dea68a tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:38.933223 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4556437d-ea46-4751-a3ca-36c863dea68a tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:38.934487 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4556437d-ea46-4751-a3ca-36c863dea68a tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:38.934487 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4556437d-ea46-4751-a3ca-36c863dea68a tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:38.934487 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4556437d-ea46-4751-a3ca-36c863dea68a tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:38.934487 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4556437d-ea46-4751-a3ca-36c863dea68a tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:38.977849 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-57c86c16-35ff-459c-94dd-7a61b82ff5db tempest-QuotasAdminNegativeTest-956917036 tempest-QuotasAdminNegativeTest-956917036-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 15:57:38.978280 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-57c86c16-35ff-459c-94dd-7a61b82ff5db tempest-QuotasAdminNegativeTest-956917036 tempest-QuotasAdminNegativeTest-956917036-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 15:57:38.978762 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-57c86c16-35ff-459c-94dd-7a61b82ff5db tempest-QuotasAdminNegativeTest-956917036 tempest-QuotasAdminNegativeTest-956917036-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 15:57:38.979557 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-57c86c16-35ff-459c-94dd-7a61b82ff5db tempest-QuotasAdminNegativeTest-956917036 tempest-QuotasAdminNegativeTest-956917036-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 15:57:38.981205 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-57c86c16-35ff-459c-94dd-7a61b82ff5db tempest-QuotasAdminNegativeTest-956917036 tempest-QuotasAdminNegativeTest-956917036-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 15:57:38.990453 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-57c86c16-35ff-459c-94dd-7a61b82ff5db tempest-QuotasAdminNegativeTest-956917036 tempest-QuotasAdminNegativeTest-956917036-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:38.990945 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-57c86c16-35ff-459c-94dd-7a61b82ff5db tempest-QuotasAdminNegativeTest-956917036 tempest-QuotasAdminNegativeTest-956917036-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:38.991386 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-57c86c16-35ff-459c-94dd-7a61b82ff5db tempest-QuotasAdminNegativeTest-956917036 tempest-QuotasAdminNegativeTest-956917036-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:38.992184 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-57c86c16-35ff-459c-94dd-7a61b82ff5db tempest-QuotasAdminNegativeTest-956917036 tempest-QuotasAdminNegativeTest-956917036-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:38.992644 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-57c86c16-35ff-459c-94dd-7a61b82ff5db tempest-QuotasAdminNegativeTest-956917036 tempest-QuotasAdminNegativeTest-956917036-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:38.993076 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-57c86c16-35ff-459c-94dd-7a61b82ff5db tempest-QuotasAdminNegativeTest-956917036 tempest-QuotasAdminNegativeTest-956917036-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:39.012001 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-57c86c16-35ff-459c-94dd-7a61b82ff5db tempest-QuotasAdminNegativeTest-956917036 tempest-QuotasAdminNegativeTest-956917036-project] Getting quotas for project a28573760605489fbff981606988242c. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:57:39.018136 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-57c86c16-35ff-459c-94dd-7a61b82ff5db tempest-QuotasAdminNegativeTest-956917036 tempest-QuotasAdminNegativeTest-956917036-project] Getting quotas for user 749a38d5a9bf4ec29be8d25bad499dd8 and project a28573760605489fbff981606988242c. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:57:39.035634 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.utils [None req-57c86c16-35ff-459c-94dd-7a61b82ff5db tempest-QuotasAdminNegativeTest-956917036 tempest-QuotasAdminNegativeTest-956917036-project] cores quota exceeded for a28573760605489fbff981606988242c, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=122256) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 31 15:57:39.036682 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-57c86c16-35ff-459c-94dd-7a61b82ff5db tempest-QuotasAdminNegativeTest-956917036 tempest-QuotasAdminNegativeTest-956917036-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 31 15:57:39.040476 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-57c86c16-35ff-459c-94dd-7a61b82ff5db tempest-QuotasAdminNegativeTest-956917036 tempest-QuotasAdminNegativeTest-956917036-project] Request method failure captured: Aug 31 15:57:39.040476 n-d-850499-9 devstack@n-api.service[122256]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 31 15:57:39.040476 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 15:57:39.040476 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 15:57:39.040476 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 15:57:39.040476 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 145 Aug 31 15:57:39.040476 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 15:57:39.040476 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 15:57:39.040476 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 15:57:39.040476 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 15:57:39.040476 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4TwIjJeUvb-WrVUFye0BIXBIlOiMxHoRb9hhy63hPfKaEUPmB05ew-CTrB-Qs4DDLXWvHgQVccNY2Hu3qkZCOanlS0AFAHiNoBLL7JUVye78XST4uurXZRBOFQmY_SIrhO8yno9Hsqw_pvVPUxhbnVZNByYvPNbzZSSQ0Zz0NHP9NE Aug 31 15:57:39.040476 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 15:57:39.040476 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 15:57:39.040476 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 15:57:39.040476 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 15:57:39.040476 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 15:57:39.040476 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 15:57:39.040476 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: a28573760605489fbff981606988242c Aug 31 15:57:39.040476 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-QuotasAdminNegativeTest-956917036 Aug 31 15:57:39.040476 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 15:57:39.040476 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 15:57:39.041741 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a28573760605489fbff981606988242c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a28573760605489fbff981606988242c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a28573760605489fbff981606988242c", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a28573760605489fbff981606988242c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 15:57:39.041741 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-QuotasAdminNegativeTest-956917036 Aug 31 15:57:39.041741 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: a28573760605489fbff981606988242c Aug 31 15:57:39.041741 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-956917036 Aug 31 15:57:39.041741 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-QuotasAdminNegativeTest-956917036-project Aug 31 15:57:39.041741 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 15:57:39.041741 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 15:57:39.041741 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 749a38d5a9bf4ec29be8d25bad499dd8 Aug 31 15:57:39.041741 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-QuotasAdminNegativeTest-956917036-project Aug 31 15:57:39.041741 n-d-850499-9 devstack@n-api.service[122256]: Aug 31 15:57:39.041741 n-d-850499-9 devstack@n-api.service[122256]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1293408658", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452"}} Aug 31 15:57:39.041741 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 15:57:39.043111 n-d-850499-9 devstack@n-api.service[122256]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 31 15:57:39.043111 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1293408658', 'imageRef': 'b9c36d42-ed46-4bf5-ad18-1df45cbd0413', 'flavorRef': '452'}}} Aug 31 15:57:39.043111 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:57:39.043111 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:57:39.043111 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 31 15:57:39.043111 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 31 15:57:39.043111 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 15:57:39.043111 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 15:57:39.043111 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 31 15:57:39.043111 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc Aug 31 15:57:39.043111 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 31 15:57:39.043111 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 31 15:57:39.043111 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 15:57:39.043111 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 15:57:39.043111 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 31 15:57:39.043111 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 31 15:57:39.043111 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 31 15:57:39.043111 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 31 15:57:39.044291 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 31 15:57:39.044291 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 31 15:57:39.044291 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Aug 31 15:57:39.044291 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:57:39.044291 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:57:39.044291 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:57:39.044291 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:57:39.044291 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 31 15:57:39.044291 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 31 15:57:39.044291 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 31 15:57:39.044291 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 31 15:57:39.044291 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Aug 31 15:57:39.044291 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 31 15:57:39.044291 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Aug 31 15:57:39.044291 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 31 15:57:39.044291 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 31 15:57:39.044291 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 31 15:57:39.044291 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 31 15:57:39.044291 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:57:39.044291 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:57:39.044291 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:57:39.045460 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:57:39.045460 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:57:39.045460 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:57:39.045460 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:57:39.045460 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:57:39.045460 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:57:39.045460 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:57:39.045460 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:57:39.045460 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:57:39.045460 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:57:39.045460 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:57:39.045460 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:57:39.045460 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:57:39.045460 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 31 15:57:39.045460 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 31 15:57:39.045460 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 31 15:57:39.045460 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 31 15:57:39.045460 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:57:39.045460 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:57:39.045460 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:57:39.045460 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:57:39.046658 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:57:39.046658 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:57:39.046658 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:57:39.046658 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:57:39.046658 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 31 15:57:39.046658 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:57:39.048178 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-57c86c16-35ff-459c-94dd-7a61b82ff5db tempest-QuotasAdminNegativeTest-956917036 tempest-QuotasAdminNegativeTest-956917036-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:57:39.049226 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-57c86c16-35ff-459c-94dd-7a61b82ff5db tempest-QuotasAdminNegativeTest-956917036 tempest-QuotasAdminNegativeTest-956917036-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 0.953135 Aug 31 15:57:39.050273 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 245/488] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 15:57:38 2022] POST /compute/v2.1/servers => generated 111 bytes in 955 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 31 15:57:39.055112 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a36ce023-ab01-4ce7-a6c9-5735f66a3cbd tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:39.055788 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a36ce023-ab01-4ce7-a6c9-5735f66a3cbd tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] [instance: f2162319-5635-4c77-920d-9ecb3221d174] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:39.063587 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a36ce023-ab01-4ce7-a6c9-5735f66a3cbd tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:39.064093 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a36ce023-ab01-4ce7-a6c9-5735f66a3cbd tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:39.064536 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a36ce023-ab01-4ce7-a6c9-5735f66a3cbd tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:39.065462 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a36ce023-ab01-4ce7-a6c9-5735f66a3cbd tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:39.066007 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a36ce023-ab01-4ce7-a6c9-5735f66a3cbd tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:39.066609 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a36ce023-ab01-4ce7-a6c9-5735f66a3cbd tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:39.097401 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-4556437d-ea46-4751-a3ca-36c863dea68a tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:39.110937 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4556437d-ea46-4751-a3ca-36c863dea68a tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56" status: 200 len: 1493 microversion: 2.1 time: 0.192576 Aug 31 15:57:39.127263 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 244/489] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:38 2022] GET /compute/v2.1/servers/bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56 => generated 1493 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:39.140548 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7dcb6048-647c-4309-b4cb-e10a742d7e86 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:39.141227 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7dcb6048-647c-4309-b4cb-e10a742d7e86 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] [instance: 4986a6de-1b24-42c5-942b-cd011b543cbc] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:39.149361 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7dcb6048-647c-4309-b4cb-e10a742d7e86 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:39.150105 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7dcb6048-647c-4309-b4cb-e10a742d7e86 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:39.150733 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7dcb6048-647c-4309-b4cb-e10a742d7e86 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:39.151785 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7dcb6048-647c-4309-b4cb-e10a742d7e86 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:39.155599 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7dcb6048-647c-4309-b4cb-e10a742d7e86 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:39.156146 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7dcb6048-647c-4309-b4cb-e10a742d7e86 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:39.176700 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-a36ce023-ab01-4ce7-a6c9-5735f66a3cbd tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lazy-loading 'services' on Instance uuid f2162319-5635-4c77-920d-9ecb3221d174 {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:57:39.208133 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a36ce023-ab01-4ce7-a6c9-5735f66a3cbd tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174" status: 200 len: 1929 microversion: 2.75 time: 0.156586 Aug 31 15:57:39.209370 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 246/490] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:39 2022] GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174 => generated 1929 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:57:39.235102 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d05a191b-d954-4714-82f9-4f7184198a00 tempest-QuotasAdminNegativeTest-610268275 tempest-QuotasAdminNegativeTest-610268275-project-admin] Action: 'update', calling method: .version_select at 0x7f5ae97cb5e0>, body: {"quota_set": {"cores": 20}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:57:39.353787 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7dcb6048-647c-4309-b4cb-e10a742d7e86 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd1dfe05c037461d8dfb45a6f611ced0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd5a49a78854f22aa3c58d01058e493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:39.365989 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7dcb6048-647c-4309-b4cb-e10a742d7e86 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] 10.222.0.61 "GET /compute/v2.1/servers/4986a6de-1b24-42c5-942b-cd011b543cbc" status: 200 len: 1320 microversion: 2.1 time: 0.235892 Aug 31 15:57:39.368110 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 245/491] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:39 2022] GET /compute/v2.1/servers/4986a6de-1b24-42c5-942b-cd011b543cbc => generated 1320 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:39.378923 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-72f97b15-8ad8-42d9-99a6-a9872156bcfe tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Calling method '.version_select at 0x7f5ae9490940>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:39.460921 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-72f97b15-8ad8-42d9-99a6-a9872156bcfe tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] 10.222.0.61 "GET /compute/v2.1/images/774b58aa-38b5-446e-b72b-0fab93b7abf3" status: 200 len: 1428 microversion: 2.1 time: 0.091014 Aug 31 15:57:39.461905 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 246/492] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 15:57:39 2022] GET /compute/v2.1/images/774b58aa-38b5-446e-b72b-0fab93b7abf3 => generated 1428 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:39.468239 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3449c046-b83c-4ba8-b9eb-75b19776b85a tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Calling method '.version_select at 0x7f5ae937b5e0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:39.472902 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3449c046-b83c-4ba8-b9eb-75b19776b85a tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:39.473606 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3449c046-b83c-4ba8-b9eb-75b19776b85a tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:39.474043 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3449c046-b83c-4ba8-b9eb-75b19776b85a tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:39.494117 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3449c046-b83c-4ba8-b9eb-75b19776b85a tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] 10.222.0.61 "GET /compute/v2.1/os-migrations" status: 200 len: 779 microversion: 2.1 time: 0.030773 Aug 31 15:57:39.495196 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 247/493] 10.222.0.61 () {58 vars in 1143 bytes} [Wed Aug 31 15:57:39 2022] GET /compute/v2.1/os-migrations => generated 779 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:57:39.500227 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-830b045b-c2d1-4034-bd91-f7c39d13b9e2 req-14859534-b23d-48ff-981c-b90434f8a8ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b233a49-d4f5-412d-8239-74df4ce63aa5", "name": "network-vif-plugged", "status": "completed", "tag": "f56ba330-3206-4322-9474-e01afa8afef9"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:57:39.514123 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-830b045b-c2d1-4034-bd91-f7c39d13b9e2 req-14859534-b23d-48ff-981c-b90434f8a8ec service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:39.515540 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-830b045b-c2d1-4034-bd91-f7c39d13b9e2 req-14859534-b23d-48ff-981c-b90434f8a8ec service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:39.516166 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-830b045b-c2d1-4034-bd91-f7c39d13b9e2 req-14859534-b23d-48ff-981c-b90434f8a8ec service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:39.528528 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-830b045b-c2d1-4034-bd91-f7c39d13b9e2 req-14859534-b23d-48ff-981c-b90434f8a8ec service nova] Creating event network-vif-plugged:f56ba330-3206-4322-9474-e01afa8afef9 for instance 1b233a49-d4f5-412d-8239-74df4ce63aa5 on n-h1-850499-9 Aug 31 15:57:39.534061 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-830b045b-c2d1-4034-bd91-f7c39d13b9e2 req-14859534-b23d-48ff-981c-b90434f8a8ec service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037540 Aug 31 15:57:39.538614 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 248/494] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 15:57:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:57:39.544249 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6de95fd9-70d3-4039-8088-2ae19f6e2429 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:39.545360 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6de95fd9-70d3-4039-8088-2ae19f6e2429 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] [instance: bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:39.551594 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6de95fd9-70d3-4039-8088-2ae19f6e2429 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:39.552302 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6de95fd9-70d3-4039-8088-2ae19f6e2429 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:39.552810 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6de95fd9-70d3-4039-8088-2ae19f6e2429 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:39.553567 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6de95fd9-70d3-4039-8088-2ae19f6e2429 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:39.554099 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6de95fd9-70d3-4039-8088-2ae19f6e2429 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:39.554519 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6de95fd9-70d3-4039-8088-2ae19f6e2429 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:39.670186 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d05a191b-d954-4714-82f9-4f7184198a00 tempest-QuotasAdminNegativeTest-610268275 tempest-QuotasAdminNegativeTest-610268275-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:39.670754 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d05a191b-d954-4714-82f9-4f7184198a00 tempest-QuotasAdminNegativeTest-610268275 tempest-QuotasAdminNegativeTest-610268275-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:39.671365 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d05a191b-d954-4714-82f9-4f7184198a00 tempest-QuotasAdminNegativeTest-610268275 tempest-QuotasAdminNegativeTest-610268275-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:39.672116 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d05a191b-d954-4714-82f9-4f7184198a00 tempest-QuotasAdminNegativeTest-610268275 tempest-QuotasAdminNegativeTest-610268275-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:39.672754 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d05a191b-d954-4714-82f9-4f7184198a00 tempest-QuotasAdminNegativeTest-610268275 tempest-QuotasAdminNegativeTest-610268275-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:39.673189 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d05a191b-d954-4714-82f9-4f7184198a00 tempest-QuotasAdminNegativeTest-610268275 tempest-QuotasAdminNegativeTest-610268275-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:39.707085 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6de95fd9-70d3-4039-8088-2ae19f6e2429 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56" status: 200 len: 1644 microversion: 2.1 time: 0.167178 Aug 31 15:57:39.707798 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 249/495] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:39 2022] GET /compute/v2.1/servers/bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56 => generated 1644 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:39.724082 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=11,nova_api:INSERT=7 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:57:39.759060 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d05a191b-d954-4714-82f9-4f7184198a00 tempest-QuotasAdminNegativeTest-610268275 tempest-QuotasAdminNegativeTest-610268275-project-admin] 10.222.0.61 "PUT /compute/v2.1/os-quota-sets/a28573760605489fbff981606988242c" status: 200 len: 329 microversion: 2.1 time: 0.548379 Aug 31 15:57:39.759662 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 247/496] 10.222.0.61 () {60 vars in 1262 bytes} [Wed Aug 31 15:57:39 2022] PUT /compute/v2.1/os-quota-sets/a28573760605489fbff981606988242c => generated 329 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:57:39.772632 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-bb29e68b-c99c-48cc-afcb-1c75b20c1efd tempest-QuotasAdminNegativeTest-610268275 tempest-QuotasAdminNegativeTest-610268275-project-admin] Calling method '.version_select at 0x7f5ae93cdc10>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:39.843363 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9b6a7075-ecbb-4f1f-9db9-b748512eeade tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-49591784", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "networks": [{"uuid": "c780b733-916d-48a3-99f1-727aee35e4fb"}]}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:57:39.904839 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-9b6a7075-ecbb-4f1f-9db9-b748512eeade tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] validate_networks() for [('c780b733-916d-48a3-99f1-727aee35e4fb', None, None, None, None, None)] {{(pid=122256) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 15:57:40.055020 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-bb29e68b-c99c-48cc-afcb-1c75b20c1efd tempest-QuotasAdminNegativeTest-610268275 tempest-QuotasAdminNegativeTest-610268275-project-admin] 10.222.0.61 "GET /compute/v2.1/os-quota-sets/a28573760605489fbff981606988242c" status: 200 len: 371 microversion: 2.1 time: 0.286025 Aug 31 15:57:40.055976 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 250/497] 10.222.0.61 () {58 vars in 1242 bytes} [Wed Aug 31 15:57:39 2022] GET /compute/v2.1/os-quota-sets/a28573760605489fbff981606988242c => generated 371 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:57:40.072378 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d581cb24-bc72-460a-ba88-d6d066e1faf3 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:40.073113 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d581cb24-bc72-460a-ba88-d6d066e1faf3 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 79ee7e24-93df-450b-9030-b08c00d019eb] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:40.082561 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d581cb24-bc72-460a-ba88-d6d066e1faf3 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:40.082864 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d581cb24-bc72-460a-ba88-d6d066e1faf3 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:40.083303 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d581cb24-bc72-460a-ba88-d6d066e1faf3 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:40.084059 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d581cb24-bc72-460a-ba88-d6d066e1faf3 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:40.084822 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d581cb24-bc72-460a-ba88-d6d066e1faf3 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:40.085264 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d581cb24-bc72-460a-ba88-d6d066e1faf3 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:40.328810 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d581cb24-bc72-460a-ba88-d6d066e1faf3 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:40.338528 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d581cb24-bc72-460a-ba88-d6d066e1faf3 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:40.341840 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d581cb24-bc72-460a-ba88-d6d066e1faf3 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:40.343393 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d581cb24-bc72-460a-ba88-d6d066e1faf3 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/79ee7e24-93df-450b-9030-b08c00d019eb" status: 200 len: 1567 microversion: 2.25 time: 0.278324 Aug 31 15:57:40.344564 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 251/498] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:40 2022] GET /compute/v2.1/servers/79ee7e24-93df-450b-9030-b08c00d019eb => generated 1567 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:57:40.351755 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-75a34d47-1edc-4536-883f-764c602af96f tempest-QuotasAdminNegativeTest-610268275 tempest-QuotasAdminNegativeTest-610268275-project-admin] Action: 'update', calling method: .version_select at 0x7f5ae93cd310>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:57:40.613291 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-9b6a7075-ecbb-4f1f-9db9-b748512eeade tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 15:57:40.614329 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-9b6a7075-ecbb-4f1f-9db9-b748512eeade tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 15:57:40.614803 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-9b6a7075-ecbb-4f1f-9db9-b748512eeade tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 15:57:40.615213 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-9b6a7075-ecbb-4f1f-9db9-b748512eeade tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 15:57:40.615675 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-9b6a7075-ecbb-4f1f-9db9-b748512eeade tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 15:57:40.628519 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9b6a7075-ecbb-4f1f-9db9-b748512eeade tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:40.629012 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9b6a7075-ecbb-4f1f-9db9-b748512eeade tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:40.629445 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9b6a7075-ecbb-4f1f-9db9-b748512eeade tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:40.630166 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9b6a7075-ecbb-4f1f-9db9-b748512eeade tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:40.630619 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9b6a7075-ecbb-4f1f-9db9-b748512eeade tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:40.634463 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9b6a7075-ecbb-4f1f-9db9-b748512eeade tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:40.673548 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-9b6a7075-ecbb-4f1f-9db9-b748512eeade tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Getting quotas for project 150e5f8e376a40e089de8ed092e269fd. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:57:40.692851 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-9b6a7075-ecbb-4f1f-9db9-b748512eeade tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Getting quotas for user de0e032fc09b48ada1dfe99e549aa623 and project 150e5f8e376a40e089de8ed092e269fd. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:57:40.707980 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-75a34d47-1edc-4536-883f-764c602af96f tempest-QuotasAdminNegativeTest-610268275 tempest-QuotasAdminNegativeTest-610268275-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:40.709283 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-75a34d47-1edc-4536-883f-764c602af96f tempest-QuotasAdminNegativeTest-610268275 tempest-QuotasAdminNegativeTest-610268275-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:40.709748 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-75a34d47-1edc-4536-883f-764c602af96f tempest-QuotasAdminNegativeTest-610268275 tempest-QuotasAdminNegativeTest-610268275-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:40.710664 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-75a34d47-1edc-4536-883f-764c602af96f tempest-QuotasAdminNegativeTest-610268275 tempest-QuotasAdminNegativeTest-610268275-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:40.715816 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-75a34d47-1edc-4536-883f-764c602af96f tempest-QuotasAdminNegativeTest-610268275 tempest-QuotasAdminNegativeTest-610268275-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:40.716275 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-75a34d47-1edc-4536-883f-764c602af96f tempest-QuotasAdminNegativeTest-610268275 tempest-QuotasAdminNegativeTest-610268275-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:40.724585 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9b6a7075-ecbb-4f1f-9db9-b748512eeade tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Going to run 1 instances... {{(pid=122256) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 15:57:40.727561 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9b6a7075-ecbb-4f1f-9db9-b748512eeade tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: 2ddb0b07-9e31-403c-91d5-a278d632d754] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 15:57:40.833458 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-75a34d47-1edc-4536-883f-764c602af96f tempest-QuotasAdminNegativeTest-610268275 tempest-QuotasAdminNegativeTest-610268275-project-admin] 10.222.0.61 "PUT /compute/v2.1/os-quota-sets/a28573760605489fbff981606988242c" status: 200 len: 328 microversion: 2.1 time: 0.486624 Aug 31 15:57:40.834856 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 252/499] 10.222.0.61 () {60 vars in 1262 bytes} [Wed Aug 31 15:57:40 2022] PUT /compute/v2.1/os-quota-sets/a28573760605489fbff981606988242c => generated 328 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:57:40.846164 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-41b5037a-5e2c-4f49-a3b3-45f41852d451 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:40.847478 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-41b5037a-5e2c-4f49-a3b3-45f41852d451 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] [instance: f2162319-5635-4c77-920d-9ecb3221d174] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:40.848641 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9b6a7075-ecbb-4f1f-9db9-b748512eeade tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.009848 Aug 31 15:57:40.849183 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 248/500] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 15:57:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1011 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 15:57:40.865734 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-41b5037a-5e2c-4f49-a3b3-45f41852d451 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:40.866658 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-41b5037a-5e2c-4f49-a3b3-45f41852d451 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:40.872536 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-41b5037a-5e2c-4f49-a3b3-45f41852d451 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:40.872915 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-41b5037a-5e2c-4f49-a3b3-45f41852d451 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:40.873409 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-41b5037a-5e2c-4f49-a3b3-45f41852d451 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:40.873854 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-41b5037a-5e2c-4f49-a3b3-45f41852d451 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:40.879667 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-fa8e2302-238c-4bd7-b235-68598b07298c tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:40.880296 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-fa8e2302-238c-4bd7-b235-68598b07298c tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] [instance: 4986a6de-1b24-42c5-942b-cd011b543cbc] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:40.914659 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fa8e2302-238c-4bd7-b235-68598b07298c tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:40.915192 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fa8e2302-238c-4bd7-b235-68598b07298c tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:40.915656 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fa8e2302-238c-4bd7-b235-68598b07298c tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:40.916382 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fa8e2302-238c-4bd7-b235-68598b07298c tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:40.917548 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fa8e2302-238c-4bd7-b235-68598b07298c tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:40.918004 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fa8e2302-238c-4bd7-b235-68598b07298c tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:41.070360 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-41b5037a-5e2c-4f49-a3b3-45f41852d451 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lazy-loading 'services' on Instance uuid f2162319-5635-4c77-920d-9ecb3221d174 {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:57:41.145269 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-41b5037a-5e2c-4f49-a3b3-45f41852d451 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174" status: 200 len: 1929 microversion: 2.75 time: 0.306309 Aug 31 15:57:41.145860 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 253/501] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:40 2022] GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174 => generated 1929 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:57:41.171270 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f3780de8-2cb1-4aca-8014-1e5970c902a1 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Calling method '.version_select at 0x7f5ae9401af0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:41.253443 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f3780de8-2cb1-4aca-8014-1e5970c902a1 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] 10.222.0.61 "GET /compute/v2.1/images/774b58aa-38b5-446e-b72b-0fab93b7abf3" status: 200 len: 1428 microversion: 2.1 time: 0.088767 Aug 31 15:57:41.259396 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 254/502] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 15:57:41 2022] GET /compute/v2.1/images/774b58aa-38b5-446e-b72b-0fab93b7abf3 => generated 1428 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:41.267385 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-446d3413-8588-4216-b04c-f0db854126b5 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:41.268413 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-446d3413-8588-4216-b04c-f0db854126b5 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: 2ddb0b07-9e31-403c-91d5-a278d632d754] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:41.371296 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-446d3413-8588-4216-b04c-f0db854126b5 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:41.382917 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-446d3413-8588-4216-b04c-f0db854126b5 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/2ddb0b07-9e31-403c-91d5-a278d632d754" status: 200 len: 1209 microversion: 2.1 time: 0.122021 Aug 31 15:57:41.384958 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 255/503] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:41 2022] GET /compute/v2.1/servers/2ddb0b07-9e31-403c-91d5-a278d632d754 => generated 1209 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:41.395438 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b06a6d5c-1d4b-4cab-8835-0b2e419dfa35 tempest-QuotasAdminNegativeTest-956917036 tempest-QuotasAdminNegativeTest-956917036-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-214433052", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:57:41.415115 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-fa8e2302-238c-4bd7-b235-68598b07298c tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd1dfe05c037461d8dfb45a6f611ced0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd5a49a78854f22aa3c58d01058e493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:41.428578 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-fa8e2302-238c-4bd7-b235-68598b07298c tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] 10.222.0.61 "GET /compute/v2.1/servers/4986a6de-1b24-42c5-942b-cd011b543cbc" status: 200 len: 1320 microversion: 2.1 time: 0.578356 Aug 31 15:57:41.429724 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 249/504] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:40 2022] GET /compute/v2.1/servers/4986a6de-1b24-42c5-942b-cd011b543cbc => generated 1320 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:41.481748 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-b06a6d5c-1d4b-4cab-8835-0b2e419dfa35 tempest-QuotasAdminNegativeTest-956917036 tempest-QuotasAdminNegativeTest-956917036-project] validate_networks() for None {{(pid=122257) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 15:57:41.670566 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5a28d477-7627-4055-9f02-56015f67236a tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1378673497", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:57:41.737726 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-5a28d477-7627-4055-9f02-56015f67236a tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] validate_networks() for None {{(pid=122256) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 15:57:41.798430 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-b06a6d5c-1d4b-4cab-8835-0b2e419dfa35 tempest-QuotasAdminNegativeTest-956917036 tempest-QuotasAdminNegativeTest-956917036-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 15:57:41.799728 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-b06a6d5c-1d4b-4cab-8835-0b2e419dfa35 tempest-QuotasAdminNegativeTest-956917036 tempest-QuotasAdminNegativeTest-956917036-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 15:57:41.800472 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-b06a6d5c-1d4b-4cab-8835-0b2e419dfa35 tempest-QuotasAdminNegativeTest-956917036 tempest-QuotasAdminNegativeTest-956917036-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 15:57:41.803085 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-b06a6d5c-1d4b-4cab-8835-0b2e419dfa35 tempest-QuotasAdminNegativeTest-956917036 tempest-QuotasAdminNegativeTest-956917036-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 15:57:41.803799 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-b06a6d5c-1d4b-4cab-8835-0b2e419dfa35 tempest-QuotasAdminNegativeTest-956917036 tempest-QuotasAdminNegativeTest-956917036-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 15:57:41.815377 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b06a6d5c-1d4b-4cab-8835-0b2e419dfa35 tempest-QuotasAdminNegativeTest-956917036 tempest-QuotasAdminNegativeTest-956917036-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:41.816396 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b06a6d5c-1d4b-4cab-8835-0b2e419dfa35 tempest-QuotasAdminNegativeTest-956917036 tempest-QuotasAdminNegativeTest-956917036-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:41.817058 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b06a6d5c-1d4b-4cab-8835-0b2e419dfa35 tempest-QuotasAdminNegativeTest-956917036 tempest-QuotasAdminNegativeTest-956917036-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:41.818042 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b06a6d5c-1d4b-4cab-8835-0b2e419dfa35 tempest-QuotasAdminNegativeTest-956917036 tempest-QuotasAdminNegativeTest-956917036-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:41.818723 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b06a6d5c-1d4b-4cab-8835-0b2e419dfa35 tempest-QuotasAdminNegativeTest-956917036 tempest-QuotasAdminNegativeTest-956917036-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:41.819352 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b06a6d5c-1d4b-4cab-8835-0b2e419dfa35 tempest-QuotasAdminNegativeTest-956917036 tempest-QuotasAdminNegativeTest-956917036-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:41.844399 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-b06a6d5c-1d4b-4cab-8835-0b2e419dfa35 tempest-QuotasAdminNegativeTest-956917036 tempest-QuotasAdminNegativeTest-956917036-project] Getting quotas for project a28573760605489fbff981606988242c. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:57:41.851650 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-b06a6d5c-1d4b-4cab-8835-0b2e419dfa35 tempest-QuotasAdminNegativeTest-956917036 tempest-QuotasAdminNegativeTest-956917036-project] Getting quotas for user 749a38d5a9bf4ec29be8d25bad499dd8 and project a28573760605489fbff981606988242c. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:57:41.879444 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.utils [None req-b06a6d5c-1d4b-4cab-8835-0b2e419dfa35 tempest-QuotasAdminNegativeTest-956917036 tempest-QuotasAdminNegativeTest-956917036-project] instances quota exceeded for a28573760605489fbff981606988242c, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=122257) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 31 15:57:41.888758 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-b06a6d5c-1d4b-4cab-8835-0b2e419dfa35 tempest-QuotasAdminNegativeTest-956917036 tempest-QuotasAdminNegativeTest-956917036-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 31 15:57:41.895589 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b06a6d5c-1d4b-4cab-8835-0b2e419dfa35 tempest-QuotasAdminNegativeTest-956917036 tempest-QuotasAdminNegativeTest-956917036-project] Request method failure captured: Aug 31 15:57:41.895589 n-d-850499-9 devstack@n-api.service[122257]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 31 15:57:41.895589 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 15:57:41.895589 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 15:57:41.895589 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 15:57:41.895589 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 144 Aug 31 15:57:41.895589 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 15:57:41.895589 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 15:57:41.895589 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 15:57:41.895589 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 15:57:41.895589 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4TwIjJeUvb-WrVUFye0BIXBIlOiMxHoRb9hhy63hPfKaEUPmB05ew-CTrB-Qs4DDLXWvHgQVccNY2Hu3qkZCOanlS0AFAHiNoBLL7JUVye78XST4uurXZRBOFQmY_SIrhO8yno9Hsqw_pvVPUxhbnVZNByYvPNbzZSSQ0Zz0NHP9NE Aug 31 15:57:41.895589 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 15:57:41.895589 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 15:57:41.895589 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 15:57:41.895589 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 15:57:41.895589 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 15:57:41.895589 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 15:57:41.895589 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: a28573760605489fbff981606988242c Aug 31 15:57:41.895589 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-QuotasAdminNegativeTest-956917036 Aug 31 15:57:41.895589 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 15:57:41.895589 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 15:57:41.896917 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a28573760605489fbff981606988242c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a28573760605489fbff981606988242c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a28573760605489fbff981606988242c", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a28573760605489fbff981606988242c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 15:57:41.896917 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-QuotasAdminNegativeTest-956917036 Aug 31 15:57:41.896917 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: a28573760605489fbff981606988242c Aug 31 15:57:41.896917 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-956917036 Aug 31 15:57:41.896917 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-QuotasAdminNegativeTest-956917036-project Aug 31 15:57:41.896917 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 15:57:41.896917 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 15:57:41.896917 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 749a38d5a9bf4ec29be8d25bad499dd8 Aug 31 15:57:41.896917 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-QuotasAdminNegativeTest-956917036-project Aug 31 15:57:41.896917 n-d-850499-9 devstack@n-api.service[122257]: Aug 31 15:57:41.896917 n-d-850499-9 devstack@n-api.service[122257]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-214433052", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452"}} Aug 31 15:57:41.896917 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 15:57:41.897575 n-d-850499-9 devstack@n-api.service[122257]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 31 15:57:41.897575 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-214433052', 'imageRef': 'b9c36d42-ed46-4bf5-ad18-1df45cbd0413', 'flavorRef': '452'}}} Aug 31 15:57:41.897575 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:57:41.897575 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:57:41.897575 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 31 15:57:41.897575 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 31 15:57:41.897575 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 15:57:41.897575 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 15:57:41.897575 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 31 15:57:41.897575 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc Aug 31 15:57:41.897575 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 31 15:57:41.897575 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 31 15:57:41.897575 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 15:57:41.897575 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 15:57:41.897575 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 31 15:57:41.897575 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 31 15:57:41.897575 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 31 15:57:41.897575 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 31 15:57:41.898573 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 31 15:57:41.898573 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 31 15:57:41.898573 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Aug 31 15:57:41.898573 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:57:41.898573 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:57:41.898573 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:57:41.898573 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:57:41.898573 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 31 15:57:41.898573 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 31 15:57:41.898573 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 31 15:57:41.898573 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 31 15:57:41.898573 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Aug 31 15:57:41.898573 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 31 15:57:41.898573 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Aug 31 15:57:41.898573 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 31 15:57:41.898573 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 31 15:57:41.898573 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 31 15:57:41.898573 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 31 15:57:41.898573 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:57:41.898573 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:57:41.898573 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:57:41.899734 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:57:41.899734 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:57:41.899734 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:57:41.899734 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:57:41.899734 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:57:41.899734 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:57:41.899734 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:57:41.899734 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:57:41.899734 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:57:41.899734 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:57:41.899734 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:57:41.899734 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:57:41.899734 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:57:41.899734 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 31 15:57:41.899734 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 31 15:57:41.899734 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 31 15:57:41.899734 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 31 15:57:41.899734 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:57:41.899734 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:57:41.899734 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:57:41.899734 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:57:41.900855 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:57:41.900855 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:57:41.900855 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:57:41.900855 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:57:41.900855 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 31 15:57:41.900855 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:57:41.900855 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b06a6d5c-1d4b-4cab-8835-0b2e419dfa35 tempest-QuotasAdminNegativeTest-956917036 tempest-QuotasAdminNegativeTest-956917036-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:57:41.900855 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b06a6d5c-1d4b-4cab-8835-0b2e419dfa35 tempest-QuotasAdminNegativeTest-956917036 tempest-QuotasAdminNegativeTest-956917036-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.510947 Aug 31 15:57:41.900855 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 256/505] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 15:57:41 2022] POST /compute/v2.1/servers => generated 119 bytes in 513 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:57:41.908379 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-75233f72-e7ae-4045-8826-1946ae8665fb tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:41.909003 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-75233f72-e7ae-4045-8826-1946ae8665fb tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 79ee7e24-93df-450b-9030-b08c00d019eb] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:41.920087 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-75233f72-e7ae-4045-8826-1946ae8665fb tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:41.920642 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-75233f72-e7ae-4045-8826-1946ae8665fb tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:41.921333 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-75233f72-e7ae-4045-8826-1946ae8665fb tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:41.922122 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-75233f72-e7ae-4045-8826-1946ae8665fb tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:41.922857 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-75233f72-e7ae-4045-8826-1946ae8665fb tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:41.923438 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-75233f72-e7ae-4045-8826-1946ae8665fb tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:42.076510 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-5a28d477-7627-4055-9f02-56015f67236a tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 15:57:42.076946 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-5a28d477-7627-4055-9f02-56015f67236a tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 15:57:42.077650 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-5a28d477-7627-4055-9f02-56015f67236a tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 15:57:42.078071 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-5a28d477-7627-4055-9f02-56015f67236a tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 15:57:42.078591 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-5a28d477-7627-4055-9f02-56015f67236a tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 15:57:42.088320 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5a28d477-7627-4055-9f02-56015f67236a tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:42.089641 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5a28d477-7627-4055-9f02-56015f67236a tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:42.090341 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5a28d477-7627-4055-9f02-56015f67236a tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:42.091302 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5a28d477-7627-4055-9f02-56015f67236a tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:42.091856 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5a28d477-7627-4055-9f02-56015f67236a tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:42.092505 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5a28d477-7627-4055-9f02-56015f67236a tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:42.117867 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-5a28d477-7627-4055-9f02-56015f67236a tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Getting quotas for project 4da6682c394444a1a286232fc0c2683d. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:57:42.123645 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-5a28d477-7627-4055-9f02-56015f67236a tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Getting quotas for user ad29bb9427d446ee8c0d237b218ac2f2 and project 4da6682c394444a1a286232fc0c2683d. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:57:42.139081 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-75233f72-e7ae-4045-8826-1946ae8665fb tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:42.144298 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5a28d477-7627-4055-9f02-56015f67236a tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Going to run 1 instances... {{(pid=122256) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 15:57:42.147105 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5a28d477-7627-4055-9f02-56015f67236a tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] [instance: 68edc4cf-5ffe-47e3-89d0-4e4fa7aebca2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 15:57:42.148706 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-75233f72-e7ae-4045-8826-1946ae8665fb tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:42.152664 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-75233f72-e7ae-4045-8826-1946ae8665fb tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:42.153750 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-75233f72-e7ae-4045-8826-1946ae8665fb tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/79ee7e24-93df-450b-9030-b08c00d019eb" status: 200 len: 1567 microversion: 2.25 time: 0.254043 Aug 31 15:57:42.154483 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 257/506] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:41 2022] GET /compute/v2.1/servers/79ee7e24-93df-450b-9030-b08c00d019eb => generated 1567 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:57:42.170794 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-3f21248e-f0f5-48ac-a67e-bb87cfa2f437 req-59948753-c7f7-4253-8674-e59c910803a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4986a6de-1b24-42c5-942b-cd011b543cbc", "name": "network-vif-plugged", "status": "completed", "tag": "230c1f66-b502-4442-bef2-05bb93e8a285"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:57:42.194299 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-3f21248e-f0f5-48ac-a67e-bb87cfa2f437 req-59948753-c7f7-4253-8674-e59c910803a4 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:42.195434 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-3f21248e-f0f5-48ac-a67e-bb87cfa2f437 req-59948753-c7f7-4253-8674-e59c910803a4 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:42.196340 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-3f21248e-f0f5-48ac-a67e-bb87cfa2f437 req-59948753-c7f7-4253-8674-e59c910803a4 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:42.210028 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-3f21248e-f0f5-48ac-a67e-bb87cfa2f437 req-59948753-c7f7-4253-8674-e59c910803a4 service nova] Creating event network-vif-plugged:230c1f66-b502-4442-bef2-05bb93e8a285 for instance 4986a6de-1b24-42c5-942b-cd011b543cbc on n-h2-850499-9 Aug 31 15:57:42.218525 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-3f21248e-f0f5-48ac-a67e-bb87cfa2f437 req-59948753-c7f7-4253-8674-e59c910803a4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057332 Aug 31 15:57:42.218772 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5a28d477-7627-4055-9f02-56015f67236a tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.787654 Aug 31 15:57:42.219492 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 258/507] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 15:57:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:57:42.223857 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 250/508] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 15:57:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 789 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 15:57:42.224767 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e2f52239-9b2f-4183-8ef8-23ee6af0cd65 tempest-QuotasAdminNegativeTest-610268275 tempest-QuotasAdminNegativeTest-610268275-project-admin] Action: 'update', calling method: .version_select at 0x7f5ae9470f70>, body: {"quota_set": {"instances": 10}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:57:42.233470 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-df69e1f2-a4ba-4b3b-934a-ed8f2166fa02 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:42.234378 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-df69e1f2-a4ba-4b3b-934a-ed8f2166fa02 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] [instance: f2162319-5635-4c77-920d-9ecb3221d174] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:42.245140 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-df69e1f2-a4ba-4b3b-934a-ed8f2166fa02 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:42.246129 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-df69e1f2-a4ba-4b3b-934a-ed8f2166fa02 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:42.246731 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-df69e1f2-a4ba-4b3b-934a-ed8f2166fa02 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:42.248005 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-df69e1f2-a4ba-4b3b-934a-ed8f2166fa02 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:42.248945 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-df69e1f2-a4ba-4b3b-934a-ed8f2166fa02 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:42.250108 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-df69e1f2-a4ba-4b3b-934a-ed8f2166fa02 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:42.360097 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-df69e1f2-a4ba-4b3b-934a-ed8f2166fa02 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lazy-loading 'services' on Instance uuid f2162319-5635-4c77-920d-9ecb3221d174 {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:57:42.415963 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-df69e1f2-a4ba-4b3b-934a-ed8f2166fa02 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174" status: 200 len: 1929 microversion: 2.75 time: 0.195166 Aug 31 15:57:42.417879 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 251/509] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:42 2022] GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174 => generated 1929 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:57:42.470587 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9413406e-c56c-4164-bbf6-540a5164fc0b tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:42.471234 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9413406e-c56c-4164-bbf6-540a5164fc0b tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] [instance: 68edc4cf-5ffe-47e3-89d0-4e4fa7aebca2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:42.603491 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e2f52239-9b2f-4183-8ef8-23ee6af0cd65 tempest-QuotasAdminNegativeTest-610268275 tempest-QuotasAdminNegativeTest-610268275-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:42.605794 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e2f52239-9b2f-4183-8ef8-23ee6af0cd65 tempest-QuotasAdminNegativeTest-610268275 tempest-QuotasAdminNegativeTest-610268275-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:42.607684 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e2f52239-9b2f-4183-8ef8-23ee6af0cd65 tempest-QuotasAdminNegativeTest-610268275 tempest-QuotasAdminNegativeTest-610268275-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:42.611349 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e2f52239-9b2f-4183-8ef8-23ee6af0cd65 tempest-QuotasAdminNegativeTest-610268275 tempest-QuotasAdminNegativeTest-610268275-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:42.612651 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e2f52239-9b2f-4183-8ef8-23ee6af0cd65 tempest-QuotasAdminNegativeTest-610268275 tempest-QuotasAdminNegativeTest-610268275-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:42.614195 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e2f52239-9b2f-4183-8ef8-23ee6af0cd65 tempest-QuotasAdminNegativeTest-610268275 tempest-QuotasAdminNegativeTest-610268275-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:42.747377 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-9413406e-c56c-4164-bbf6-540a5164fc0b tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad29bb9427d446ee8c0d237b218ac2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da6682c394444a1a286232fc0c2683d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:42.758481 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9413406e-c56c-4164-bbf6-540a5164fc0b tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] 10.222.0.61 "GET /compute/v2.1/servers/68edc4cf-5ffe-47e3-89d0-4e4fa7aebca2" status: 200 len: 1223 microversion: 2.1 time: 0.337688 Aug 31 15:57:42.762369 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 252/510] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:42 2022] GET /compute/v2.1/servers/68edc4cf-5ffe-47e3-89d0-4e4fa7aebca2 => generated 1223 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:42.781083 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-38fe01bb-b636-4528-a359-a14f15664c57 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Calling method '.version_select at 0x7f5ae93d9670>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:42.846280 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e2f52239-9b2f-4183-8ef8-23ee6af0cd65 tempest-QuotasAdminNegativeTest-610268275 tempest-QuotasAdminNegativeTest-610268275-project-admin] 10.222.0.61 "PUT /compute/v2.1/os-quota-sets/a28573760605489fbff981606988242c" status: 200 len: 329 microversion: 2.1 time: 0.625652 Aug 31 15:57:42.847138 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 259/511] 10.222.0.61 () {60 vars in 1262 bytes} [Wed Aug 31 15:57:42 2022] PUT /compute/v2.1/os-quota-sets/a28573760605489fbff981606988242c => generated 329 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:57:42.853264 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0a82c1d7-9455-4966-8dea-89ff8115ed7d tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:42.853431 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-38fe01bb-b636-4528-a359-a14f15664c57 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] 10.222.0.61 "GET /compute/v2.1/images/774b58aa-38b5-446e-b72b-0fab93b7abf3" status: 200 len: 1428 microversion: 2.1 time: 0.089331 Aug 31 15:57:42.860791 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 253/512] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 15:57:42 2022] GET /compute/v2.1/images/774b58aa-38b5-446e-b72b-0fab93b7abf3 => generated 1428 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:42.862353 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0a82c1d7-9455-4966-8dea-89ff8115ed7d tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: 2ddb0b07-9e31-403c-91d5-a278d632d754] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:42.872208 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-dbed8f39-d392-47f0-b7ef-fd865c69d8e2 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:42.873327 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-dbed8f39-d392-47f0-b7ef-fd865c69d8e2 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] [instance: 4986a6de-1b24-42c5-942b-cd011b543cbc] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:42.874273 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0a82c1d7-9455-4966-8dea-89ff8115ed7d tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:42.874893 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0a82c1d7-9455-4966-8dea-89ff8115ed7d tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:42.875819 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0a82c1d7-9455-4966-8dea-89ff8115ed7d tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:42.876797 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0a82c1d7-9455-4966-8dea-89ff8115ed7d tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:42.877829 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0a82c1d7-9455-4966-8dea-89ff8115ed7d tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:42.878321 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0a82c1d7-9455-4966-8dea-89ff8115ed7d tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:42.890637 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dbed8f39-d392-47f0-b7ef-fd865c69d8e2 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:42.896901 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dbed8f39-d392-47f0-b7ef-fd865c69d8e2 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:42.897381 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dbed8f39-d392-47f0-b7ef-fd865c69d8e2 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:42.898113 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dbed8f39-d392-47f0-b7ef-fd865c69d8e2 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:42.898608 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dbed8f39-d392-47f0-b7ef-fd865c69d8e2 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:42.899041 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dbed8f39-d392-47f0-b7ef-fd865c69d8e2 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:42.978222 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0a82c1d7-9455-4966-8dea-89ff8115ed7d tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:42.998769 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0a82c1d7-9455-4966-8dea-89ff8115ed7d tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/2ddb0b07-9e31-403c-91d5-a278d632d754" status: 200 len: 1279 microversion: 2.1 time: 0.148964 Aug 31 15:57:43.002111 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 260/513] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:42 2022] GET /compute/v2.1/servers/2ddb0b07-9e31-403c-91d5-a278d632d754 => generated 1279 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:43.013879 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1bc03f4d-a4e2-4a6f-b048-860296c90470 tempest-QuotasAdminNegativeTest-610268275 tempest-QuotasAdminNegativeTest-610268275-project-admin] Calling method '.version_select at 0x7f5ae986be50>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:43.127182 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1bc03f4d-a4e2-4a6f-b048-860296c90470 tempest-QuotasAdminNegativeTest-610268275 tempest-QuotasAdminNegativeTest-610268275-project-admin] 10.222.0.61 "GET /compute/v2.1/os-quota-sets/a28573760605489fbff981606988242c" status: 200 len: 371 microversion: 2.1 time: 0.121206 Aug 31 15:57:43.127903 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 261/514] 10.222.0.61 () {58 vars in 1242 bytes} [Wed Aug 31 15:57:43 2022] GET /compute/v2.1/os-quota-sets/a28573760605489fbff981606988242c => generated 371 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:57:43.140575 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2fb810b5-46e2-4f5c-bec3-79e972ba8c13 tempest-QuotasAdminNegativeTest-610268275 tempest-QuotasAdminNegativeTest-610268275-project-admin] Action: 'update', calling method: .version_select at 0x7f5ae937b4c0>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:57:43.241751 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2fb810b5-46e2-4f5c-bec3-79e972ba8c13 tempest-QuotasAdminNegativeTest-610268275 tempest-QuotasAdminNegativeTest-610268275-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:43.243077 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2fb810b5-46e2-4f5c-bec3-79e972ba8c13 tempest-QuotasAdminNegativeTest-610268275 tempest-QuotasAdminNegativeTest-610268275-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:43.243538 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2fb810b5-46e2-4f5c-bec3-79e972ba8c13 tempest-QuotasAdminNegativeTest-610268275 tempest-QuotasAdminNegativeTest-610268275-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:43.244615 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2fb810b5-46e2-4f5c-bec3-79e972ba8c13 tempest-QuotasAdminNegativeTest-610268275 tempest-QuotasAdminNegativeTest-610268275-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:43.244847 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2fb810b5-46e2-4f5c-bec3-79e972ba8c13 tempest-QuotasAdminNegativeTest-610268275 tempest-QuotasAdminNegativeTest-610268275-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:43.245465 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2fb810b5-46e2-4f5c-bec3-79e972ba8c13 tempest-QuotasAdminNegativeTest-610268275 tempest-QuotasAdminNegativeTest-610268275-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:43.306796 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2fb810b5-46e2-4f5c-bec3-79e972ba8c13 tempest-QuotasAdminNegativeTest-610268275 tempest-QuotasAdminNegativeTest-610268275-project-admin] 10.222.0.61 "PUT /compute/v2.1/os-quota-sets/a28573760605489fbff981606988242c" status: 200 len: 325 microversion: 2.1 time: 0.170985 Aug 31 15:57:43.307955 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 262/515] 10.222.0.61 () {60 vars in 1262 bytes} [Wed Aug 31 15:57:43 2022] PUT /compute/v2.1/os-quota-sets/a28573760605489fbff981606988242c => generated 325 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 15:57:43.313481 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2c425797-fd74-4d65-9d32-5a62c1d480c6 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:43.314131 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2c425797-fd74-4d65-9d32-5a62c1d480c6 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 79ee7e24-93df-450b-9030-b08c00d019eb] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:43.317248 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:57:43.323722 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2c425797-fd74-4d65-9d32-5a62c1d480c6 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:43.324998 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2c425797-fd74-4d65-9d32-5a62c1d480c6 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:43.325727 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2c425797-fd74-4d65-9d32-5a62c1d480c6 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:43.326729 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2c425797-fd74-4d65-9d32-5a62c1d480c6 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:43.327201 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2c425797-fd74-4d65-9d32-5a62c1d480c6 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:43.327751 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2c425797-fd74-4d65-9d32-5a62c1d480c6 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:43.338847 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-dbed8f39-d392-47f0-b7ef-fd865c69d8e2 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd1dfe05c037461d8dfb45a6f611ced0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd5a49a78854f22aa3c58d01058e493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:43.344120 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=100 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:57:43.353419 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-dbed8f39-d392-47f0-b7ef-fd865c69d8e2 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] 10.222.0.61 "GET /compute/v2.1/servers/4986a6de-1b24-42c5-942b-cd011b543cbc" status: 200 len: 1320 microversion: 2.1 time: 0.496710 Aug 31 15:57:43.374679 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 254/516] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:42 2022] GET /compute/v2.1/servers/4986a6de-1b24-42c5-942b-cd011b543cbc => generated 1320 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:43.390344 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d4d4205b-9072-4a78-a39d-6c6ce5943597 tempest-QuotasAdminNegativeTest-956917036 tempest-QuotasAdminNegativeTest-956917036-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-716168399", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:57:43.488208 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-d4d4205b-9072-4a78-a39d-6c6ce5943597 tempest-QuotasAdminNegativeTest-956917036 tempest-QuotasAdminNegativeTest-956917036-project] validate_networks() for None {{(pid=122256) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 15:57:44.194263 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2c425797-fd74-4d65-9d32-5a62c1d480c6 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:44.210755 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2c425797-fd74-4d65-9d32-5a62c1d480c6 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:44.213439 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2c425797-fd74-4d65-9d32-5a62c1d480c6 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:44.215565 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2c425797-fd74-4d65-9d32-5a62c1d480c6 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/79ee7e24-93df-450b-9030-b08c00d019eb" status: 200 len: 1567 microversion: 2.25 time: 0.906339 Aug 31 15:57:44.216414 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 263/517] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:43 2022] GET /compute/v2.1/servers/79ee7e24-93df-450b-9030-b08c00d019eb => generated 1567 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:57:44.235537 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-67e75803-ecb9-4f01-aeae-d6ccafcf696b tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:44.236276 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-67e75803-ecb9-4f01-aeae-d6ccafcf696b tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] [instance: f2162319-5635-4c77-920d-9ecb3221d174] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:44.255317 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-67e75803-ecb9-4f01-aeae-d6ccafcf696b tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:44.258444 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-67e75803-ecb9-4f01-aeae-d6ccafcf696b tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:44.258907 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-67e75803-ecb9-4f01-aeae-d6ccafcf696b tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:44.259683 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-67e75803-ecb9-4f01-aeae-d6ccafcf696b tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:44.260601 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-67e75803-ecb9-4f01-aeae-d6ccafcf696b tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:44.260766 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-67e75803-ecb9-4f01-aeae-d6ccafcf696b tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:44.386862 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-d4d4205b-9072-4a78-a39d-6c6ce5943597 tempest-QuotasAdminNegativeTest-956917036 tempest-QuotasAdminNegativeTest-956917036-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 15:57:44.408733 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-d4d4205b-9072-4a78-a39d-6c6ce5943597 tempest-QuotasAdminNegativeTest-956917036 tempest-QuotasAdminNegativeTest-956917036-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 15:57:44.413880 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-d4d4205b-9072-4a78-a39d-6c6ce5943597 tempest-QuotasAdminNegativeTest-956917036 tempest-QuotasAdminNegativeTest-956917036-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 15:57:44.421759 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-d4d4205b-9072-4a78-a39d-6c6ce5943597 tempest-QuotasAdminNegativeTest-956917036 tempest-QuotasAdminNegativeTest-956917036-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 15:57:44.422777 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-d4d4205b-9072-4a78-a39d-6c6ce5943597 tempest-QuotasAdminNegativeTest-956917036 tempest-QuotasAdminNegativeTest-956917036-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 15:57:44.445761 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-67e75803-ecb9-4f01-aeae-d6ccafcf696b tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lazy-loading 'services' on Instance uuid f2162319-5635-4c77-920d-9ecb3221d174 {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:57:44.487453 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d4d4205b-9072-4a78-a39d-6c6ce5943597 tempest-QuotasAdminNegativeTest-956917036 tempest-QuotasAdminNegativeTest-956917036-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:44.490562 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d4d4205b-9072-4a78-a39d-6c6ce5943597 tempest-QuotasAdminNegativeTest-956917036 tempest-QuotasAdminNegativeTest-956917036-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:44.494527 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d4d4205b-9072-4a78-a39d-6c6ce5943597 tempest-QuotasAdminNegativeTest-956917036 tempest-QuotasAdminNegativeTest-956917036-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:44.496893 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d4d4205b-9072-4a78-a39d-6c6ce5943597 tempest-QuotasAdminNegativeTest-956917036 tempest-QuotasAdminNegativeTest-956917036-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:44.498597 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d4d4205b-9072-4a78-a39d-6c6ce5943597 tempest-QuotasAdminNegativeTest-956917036 tempest-QuotasAdminNegativeTest-956917036-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:44.503853 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d4d4205b-9072-4a78-a39d-6c6ce5943597 tempest-QuotasAdminNegativeTest-956917036 tempest-QuotasAdminNegativeTest-956917036-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:44.520484 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-67e75803-ecb9-4f01-aeae-d6ccafcf696b tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174" status: 200 len: 1935 microversion: 2.75 time: 0.302840 Aug 31 15:57:44.521105 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 264/518] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:44 2022] GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174 => generated 1935 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:57:44.534718 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-79ab76f7-deb9-40ac-b18e-347567c790b1 tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:44.535521 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-79ab76f7-deb9-40ac-b18e-347567c790b1 tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] [instance: 68edc4cf-5ffe-47e3-89d0-4e4fa7aebca2] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:44.556818 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-d4d4205b-9072-4a78-a39d-6c6ce5943597 tempest-QuotasAdminNegativeTest-956917036 tempest-QuotasAdminNegativeTest-956917036-project] Getting quotas for project a28573760605489fbff981606988242c. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:57:44.557668 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-79ab76f7-deb9-40ac-b18e-347567c790b1 tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:44.558177 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-79ab76f7-deb9-40ac-b18e-347567c790b1 tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:44.558818 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-79ab76f7-deb9-40ac-b18e-347567c790b1 tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:44.559327 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-79ab76f7-deb9-40ac-b18e-347567c790b1 tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:44.559811 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-79ab76f7-deb9-40ac-b18e-347567c790b1 tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:44.560634 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-79ab76f7-deb9-40ac-b18e-347567c790b1 tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:44.569424 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-d4d4205b-9072-4a78-a39d-6c6ce5943597 tempest-QuotasAdminNegativeTest-956917036 tempest-QuotasAdminNegativeTest-956917036-project] Getting quotas for user 749a38d5a9bf4ec29be8d25bad499dd8 and project a28573760605489fbff981606988242c. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:57:44.616065 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.utils [None req-d4d4205b-9072-4a78-a39d-6c6ce5943597 tempest-QuotasAdminNegativeTest-956917036 tempest-QuotasAdminNegativeTest-956917036-project] ram quota exceeded for a28573760605489fbff981606988242c, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=122256) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 31 15:57:44.616991 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-d4d4205b-9072-4a78-a39d-6c6ce5943597 tempest-QuotasAdminNegativeTest-956917036 tempest-QuotasAdminNegativeTest-956917036-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 31 15:57:44.621733 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d4d4205b-9072-4a78-a39d-6c6ce5943597 tempest-QuotasAdminNegativeTest-956917036 tempest-QuotasAdminNegativeTest-956917036-project] Request method failure captured: Aug 31 15:57:44.621733 n-d-850499-9 devstack@n-api.service[122256]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 31 15:57:44.621733 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 15:57:44.621733 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 15:57:44.621733 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 15:57:44.621733 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 144 Aug 31 15:57:44.621733 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 15:57:44.621733 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 15:57:44.621733 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 15:57:44.621733 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 15:57:44.621733 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4TwIjJeUvb-WrVUFye0BIXBIlOiMxHoRb9hhy63hPfKaEUPmB05ew-CTrB-Qs4DDLXWvHgQVccNY2Hu3qkZCOanlS0AFAHiNoBLL7JUVye78XST4uurXZRBOFQmY_SIrhO8yno9Hsqw_pvVPUxhbnVZNByYvPNbzZSSQ0Zz0NHP9NE Aug 31 15:57:44.621733 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 15:57:44.621733 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 15:57:44.621733 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 15:57:44.621733 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 15:57:44.621733 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 15:57:44.621733 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 15:57:44.621733 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: a28573760605489fbff981606988242c Aug 31 15:57:44.621733 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-QuotasAdminNegativeTest-956917036 Aug 31 15:57:44.621733 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 15:57:44.621733 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 15:57:44.623128 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a28573760605489fbff981606988242c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a28573760605489fbff981606988242c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a28573760605489fbff981606988242c", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a28573760605489fbff981606988242c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 15:57:44.623128 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-QuotasAdminNegativeTest-956917036 Aug 31 15:57:44.623128 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: a28573760605489fbff981606988242c Aug 31 15:57:44.623128 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-956917036 Aug 31 15:57:44.623128 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-QuotasAdminNegativeTest-956917036-project Aug 31 15:57:44.623128 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 15:57:44.623128 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 15:57:44.623128 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 749a38d5a9bf4ec29be8d25bad499dd8 Aug 31 15:57:44.623128 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-QuotasAdminNegativeTest-956917036-project Aug 31 15:57:44.623128 n-d-850499-9 devstack@n-api.service[122256]: Aug 31 15:57:44.623128 n-d-850499-9 devstack@n-api.service[122256]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-716168399", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452"}} Aug 31 15:57:44.623128 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 15:57:44.623870 n-d-850499-9 devstack@n-api.service[122256]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 31 15:57:44.623870 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-716168399', 'imageRef': 'b9c36d42-ed46-4bf5-ad18-1df45cbd0413', 'flavorRef': '452'}}} Aug 31 15:57:44.623870 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:57:44.623870 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:57:44.623870 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 31 15:57:44.623870 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 31 15:57:44.623870 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 15:57:44.623870 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 15:57:44.623870 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 31 15:57:44.623870 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc Aug 31 15:57:44.623870 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 31 15:57:44.623870 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 31 15:57:44.623870 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 15:57:44.623870 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 15:57:44.623870 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 31 15:57:44.623870 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 31 15:57:44.623870 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 31 15:57:44.623870 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 31 15:57:44.625081 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 31 15:57:44.625081 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 31 15:57:44.625081 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Aug 31 15:57:44.625081 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:57:44.625081 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:57:44.625081 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:57:44.625081 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:57:44.625081 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 31 15:57:44.625081 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 31 15:57:44.625081 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 31 15:57:44.625081 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 31 15:57:44.625081 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Aug 31 15:57:44.625081 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 31 15:57:44.625081 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Aug 31 15:57:44.625081 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 31 15:57:44.625081 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 31 15:57:44.625081 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 31 15:57:44.625081 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 31 15:57:44.625081 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:57:44.625081 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:57:44.625081 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:57:44.626374 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:57:44.626374 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:57:44.626374 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:57:44.626374 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:57:44.626374 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:57:44.626374 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:57:44.626374 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:57:44.626374 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:57:44.626374 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:57:44.626374 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:57:44.626374 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:57:44.626374 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:57:44.626374 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:57:44.626374 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 31 15:57:44.626374 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 31 15:57:44.626374 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 31 15:57:44.626374 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 31 15:57:44.626374 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:57:44.626374 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:57:44.626374 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:57:44.626374 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:57:44.628840 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:57:44.628840 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:57:44.628840 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:57:44.628840 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:57:44.628840 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 31 15:57:44.628840 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:57:44.630858 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d4d4205b-9072-4a78-a39d-6c6ce5943597 tempest-QuotasAdminNegativeTest-956917036 tempest-QuotasAdminNegativeTest-956917036-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:57:44.632765 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d4d4205b-9072-4a78-a39d-6c6ce5943597 tempest-QuotasAdminNegativeTest-956917036 tempest-QuotasAdminNegativeTest-956917036-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 1.249639 Aug 31 15:57:44.634094 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 255/519] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 15:57:43 2022] POST /compute/v2.1/servers => generated 110 bytes in 1253 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:57:44.639839 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-40635d45-a172-44f7-91fb-ce164eca122b tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Calling method '.version_select at 0x7f5ae946f040>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:44.729253 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-79ab76f7-deb9-40ac-b18e-347567c790b1 tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad29bb9427d446ee8c0d237b218ac2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da6682c394444a1a286232fc0c2683d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:44.740154 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-40635d45-a172-44f7-91fb-ce164eca122b tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] 10.222.0.61 "GET /compute/v2.1/images/774b58aa-38b5-446e-b72b-0fab93b7abf3" status: 200 len: 1428 microversion: 2.1 time: 0.104564 Aug 31 15:57:44.741482 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 256/520] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 15:57:44 2022] GET /compute/v2.1/images/774b58aa-38b5-446e-b72b-0fab93b7abf3 => generated 1428 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:44.742324 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-79ab76f7-deb9-40ac-b18e-347567c790b1 tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] 10.222.0.61 "GET /compute/v2.1/servers/68edc4cf-5ffe-47e3-89d0-4e4fa7aebca2" status: 200 len: 1283 microversion: 2.1 time: 0.220144 Aug 31 15:57:44.742961 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 265/521] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:44 2022] GET /compute/v2.1/servers/68edc4cf-5ffe-47e3-89d0-4e4fa7aebca2 => generated 1283 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:44.747850 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-42f60b94-bd1c-4243-bb60-0388dd949052 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:44.756095 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e5956585-3e82-4e06-8149-d7e6ad44bc99 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:44.758805 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e5956585-3e82-4e06-8149-d7e6ad44bc99 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: 2ddb0b07-9e31-403c-91d5-a278d632d754] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:44.760168 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-42f60b94-bd1c-4243-bb60-0388dd949052 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] [instance: 4986a6de-1b24-42c5-942b-cd011b543cbc] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:44.768332 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-42f60b94-bd1c-4243-bb60-0388dd949052 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:44.768844 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-42f60b94-bd1c-4243-bb60-0388dd949052 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:44.769292 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-42f60b94-bd1c-4243-bb60-0388dd949052 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:44.770011 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-42f60b94-bd1c-4243-bb60-0388dd949052 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:44.770473 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-42f60b94-bd1c-4243-bb60-0388dd949052 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:44.770902 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-42f60b94-bd1c-4243-bb60-0388dd949052 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:44.794804 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e5956585-3e82-4e06-8149-d7e6ad44bc99 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:44.795293 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e5956585-3e82-4e06-8149-d7e6ad44bc99 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:44.795763 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e5956585-3e82-4e06-8149-d7e6ad44bc99 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:44.796483 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e5956585-3e82-4e06-8149-d7e6ad44bc99 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:44.796951 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e5956585-3e82-4e06-8149-d7e6ad44bc99 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:44.797393 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e5956585-3e82-4e06-8149-d7e6ad44bc99 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:45.122334 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e5956585-3e82-4e06-8149-d7e6ad44bc99 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:45.161444 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e5956585-3e82-4e06-8149-d7e6ad44bc99 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/2ddb0b07-9e31-403c-91d5-a278d632d754" status: 200 len: 1267 microversion: 2.1 time: 0.418503 Aug 31 15:57:45.161926 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 257/522] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:44 2022] GET /compute/v2.1/servers/2ddb0b07-9e31-403c-91d5-a278d632d754 => generated 1267 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:45.177025 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-66833e8e-34fa-4974-85f6-5e1ded3176ed req-5dca5d9a-a70f-430e-88dd-3befa9eea0e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79ee7e24-93df-450b-9030-b08c00d019eb", "name": "network-vif-unplugged", "status": "completed", "tag": "a2a2e771-f0ba-4149-867f-67716bfa9d07"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:57:45.197372 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-66833e8e-34fa-4974-85f6-5e1ded3176ed req-5dca5d9a-a70f-430e-88dd-3befa9eea0e3 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:45.200669 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-66833e8e-34fa-4974-85f6-5e1ded3176ed req-5dca5d9a-a70f-430e-88dd-3befa9eea0e3 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:45.201313 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-66833e8e-34fa-4974-85f6-5e1ded3176ed req-5dca5d9a-a70f-430e-88dd-3befa9eea0e3 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:45.221235 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-66833e8e-34fa-4974-85f6-5e1ded3176ed req-5dca5d9a-a70f-430e-88dd-3befa9eea0e3 service nova] Creating event network-vif-unplugged:a2a2e771-f0ba-4149-867f-67716bfa9d07 for instance 79ee7e24-93df-450b-9030-b08c00d019eb on n-h1-850499-9 Aug 31 15:57:45.231055 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-66833e8e-34fa-4974-85f6-5e1ded3176ed req-5dca5d9a-a70f-430e-88dd-3befa9eea0e3 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064984 Aug 31 15:57:45.233456 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 258/523] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 15:57:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:57:45.242490 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-60dcd40d-b7c7-4370-b552-6f488989f269 tempest-QuotasAdminNegativeTest-610268275 tempest-QuotasAdminNegativeTest-610268275-project-admin] Action: 'update', calling method: .version_select at 0x7f5ae946f430>, body: {"quota_set": {"ram": 51200}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:57:45.393619 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-60dcd40d-b7c7-4370-b552-6f488989f269 tempest-QuotasAdminNegativeTest-610268275 tempest-QuotasAdminNegativeTest-610268275-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:45.395145 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-60dcd40d-b7c7-4370-b552-6f488989f269 tempest-QuotasAdminNegativeTest-610268275 tempest-QuotasAdminNegativeTest-610268275-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:45.398211 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-60dcd40d-b7c7-4370-b552-6f488989f269 tempest-QuotasAdminNegativeTest-610268275 tempest-QuotasAdminNegativeTest-610268275-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:45.399859 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-60dcd40d-b7c7-4370-b552-6f488989f269 tempest-QuotasAdminNegativeTest-610268275 tempest-QuotasAdminNegativeTest-610268275-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:45.400698 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-60dcd40d-b7c7-4370-b552-6f488989f269 tempest-QuotasAdminNegativeTest-610268275 tempest-QuotasAdminNegativeTest-610268275-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:45.402187 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-60dcd40d-b7c7-4370-b552-6f488989f269 tempest-QuotasAdminNegativeTest-610268275 tempest-QuotasAdminNegativeTest-610268275-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:45.421292 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-42f60b94-bd1c-4243-bb60-0388dd949052 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd1dfe05c037461d8dfb45a6f611ced0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd5a49a78854f22aa3c58d01058e493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:45.430938 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-42f60b94-bd1c-4243-bb60-0388dd949052 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] 10.222.0.61 "GET /compute/v2.1/servers/4986a6de-1b24-42c5-942b-cd011b543cbc" status: 200 len: 1470 microversion: 2.1 time: 0.686959 Aug 31 15:57:45.440171 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 266/524] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:44 2022] GET /compute/v2.1/servers/4986a6de-1b24-42c5-942b-cd011b543cbc => generated 1470 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:45.445350 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e03eb0d1-21be-46c7-8f53-22047c1dde4a tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:45.446154 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e03eb0d1-21be-46c7-8f53-22047c1dde4a tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 79ee7e24-93df-450b-9030-b08c00d019eb] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:45.459921 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e03eb0d1-21be-46c7-8f53-22047c1dde4a tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:45.460647 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e03eb0d1-21be-46c7-8f53-22047c1dde4a tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:45.461262 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e03eb0d1-21be-46c7-8f53-22047c1dde4a tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:45.469408 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e03eb0d1-21be-46c7-8f53-22047c1dde4a tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:45.470137 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e03eb0d1-21be-46c7-8f53-22047c1dde4a tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:45.470831 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e03eb0d1-21be-46c7-8f53-22047c1dde4a tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:45.559433 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-60dcd40d-b7c7-4370-b552-6f488989f269 tempest-QuotasAdminNegativeTest-610268275 tempest-QuotasAdminNegativeTest-610268275-project-admin] 10.222.0.61 "PUT /compute/v2.1/os-quota-sets/a28573760605489fbff981606988242c" status: 200 len: 329 microversion: 2.1 time: 0.322369 Aug 31 15:57:45.561213 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 259/525] 10.222.0.61 () {60 vars in 1262 bytes} [Wed Aug 31 15:57:45 2022] PUT /compute/v2.1/os-quota-sets/a28573760605489fbff981606988242c => generated 329 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:57:45.568215 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a773dde6-8d5c-4420-b958-f4b04eab9cc6 tempest-DeleteServersAdminTestJSON-870258220 tempest-DeleteServersAdminTestJSON-870258220-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:57:45.570877 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a773dde6-8d5c-4420-b958-f4b04eab9cc6 tempest-DeleteServersAdminTestJSON-870258220 tempest-DeleteServersAdminTestJSON-870258220-project-admin] [instance: 4986a6de-1b24-42c5-942b-cd011b543cbc] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:45.579084 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a773dde6-8d5c-4420-b958-f4b04eab9cc6 tempest-DeleteServersAdminTestJSON-870258220 tempest-DeleteServersAdminTestJSON-870258220-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:45.579878 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a773dde6-8d5c-4420-b958-f4b04eab9cc6 tempest-DeleteServersAdminTestJSON-870258220 tempest-DeleteServersAdminTestJSON-870258220-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:45.580621 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a773dde6-8d5c-4420-b958-f4b04eab9cc6 tempest-DeleteServersAdminTestJSON-870258220 tempest-DeleteServersAdminTestJSON-870258220-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:45.581489 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a773dde6-8d5c-4420-b958-f4b04eab9cc6 tempest-DeleteServersAdminTestJSON-870258220 tempest-DeleteServersAdminTestJSON-870258220-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:45.582386 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a773dde6-8d5c-4420-b958-f4b04eab9cc6 tempest-DeleteServersAdminTestJSON-870258220 tempest-DeleteServersAdminTestJSON-870258220-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:45.582955 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a773dde6-8d5c-4420-b958-f4b04eab9cc6 tempest-DeleteServersAdminTestJSON-870258220 tempest-DeleteServersAdminTestJSON-870258220-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:45.742457 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:57:45.799012 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a773dde6-8d5c-4420-b958-f4b04eab9cc6 tempest-DeleteServersAdminTestJSON-870258220 tempest-DeleteServersAdminTestJSON-870258220-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/4986a6de-1b24-42c5-942b-cd011b543cbc/action" status: 202 len: 0 microversion: 2.1 time: 0.236260 Aug 31 15:57:45.802786 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 260/526] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 15:57:45 2022] POST /compute/v2.1/servers/4986a6de-1b24-42c5-942b-cd011b543cbc/action => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 15:57:45.807558 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0c84ed8b-a277-408e-84bb-ed9caf1ec65f tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:45.808376 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0c84ed8b-a277-408e-84bb-ed9caf1ec65f tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] [instance: f2162319-5635-4c77-920d-9ecb3221d174] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:45.817092 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0c84ed8b-a277-408e-84bb-ed9caf1ec65f tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:45.818121 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0c84ed8b-a277-408e-84bb-ed9caf1ec65f tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:45.818568 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0c84ed8b-a277-408e-84bb-ed9caf1ec65f tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:45.819285 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0c84ed8b-a277-408e-84bb-ed9caf1ec65f tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:45.820383 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0c84ed8b-a277-408e-84bb-ed9caf1ec65f tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:45.820819 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0c84ed8b-a277-408e-84bb-ed9caf1ec65f tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:45.940590 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-0c84ed8b-a277-408e-84bb-ed9caf1ec65f tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lazy-loading 'services' on Instance uuid f2162319-5635-4c77-920d-9ecb3221d174 {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:57:45.978564 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0c84ed8b-a277-408e-84bb-ed9caf1ec65f tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174" status: 200 len: 1935 microversion: 2.75 time: 0.175909 Aug 31 15:57:45.996782 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 261/527] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:45 2022] GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174 => generated 1935 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:57:45.996782 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-bcb325e2-edf7-4036-a20e-85a50207d880 tempest-QuotasAdminNegativeTest-956917036 tempest-QuotasAdminNegativeTest-956917036-project] Action: 'update', calling method: .version_select at 0x7f5ae93d9dc0>, body: {"quota_set": {"ram": 0}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:57:45.996782 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-bcb325e2-edf7-4036-a20e-85a50207d880 tempest-QuotasAdminNegativeTest-956917036 tempest-QuotasAdminNegativeTest-956917036-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '749a38d5a9bf4ec29be8d25bad499dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28573760605489fbff981606988242c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:46.000154 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-bcb325e2-edf7-4036-a20e-85a50207d880 tempest-QuotasAdminNegativeTest-956917036 tempest-QuotasAdminNegativeTest-956917036-project] Request method failure captured: Aug 31 15:57:46.000154 n-d-850499-9 devstack@n-api.service[122256]: request: PUT /compute/v2.1/os-quota-sets/a28573760605489fbff981606988242c HTTP/1.1 Aug 31 15:57:46.000154 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 15:57:46.000154 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 15:57:46.000154 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 15:57:46.000154 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 25 Aug 31 15:57:46.000154 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 15:57:46.000154 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 15:57:46.000154 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 15:57:46.000154 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 15:57:46.000154 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4TwIjJeUvb-WrVUFye0BIXBIlOiMxHoRb9hhy63hPfKaEUPmB05ew-CTrB-Qs4DDLXWvHgQVccNY2Hu3qkZCOanlS0AFAHiNoBLL7JUVye78XST4uurXZRBOFQmY_SIrhO8yno9Hsqw_pvVPUxhbnVZNByYvPNbzZSSQ0Zz0NHP9NE Aug 31 15:57:46.000154 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 15:57:46.000154 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 15:57:46.000154 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 15:57:46.000154 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 15:57:46.000154 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 15:57:46.000154 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 15:57:46.000154 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: a28573760605489fbff981606988242c Aug 31 15:57:46.000154 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-QuotasAdminNegativeTest-956917036 Aug 31 15:57:46.000154 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 15:57:46.000154 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 15:57:46.001480 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a28573760605489fbff981606988242c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a28573760605489fbff981606988242c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a28573760605489fbff981606988242c", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a28573760605489fbff981606988242c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 15:57:46.001480 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-QuotasAdminNegativeTest-956917036 Aug 31 15:57:46.001480 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: a28573760605489fbff981606988242c Aug 31 15:57:46.001480 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-956917036 Aug 31 15:57:46.001480 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-QuotasAdminNegativeTest-956917036-project Aug 31 15:57:46.001480 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 15:57:46.001480 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 15:57:46.001480 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 749a38d5a9bf4ec29be8d25bad499dd8 Aug 31 15:57:46.001480 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-QuotasAdminNegativeTest-956917036-project Aug 31 15:57:46.001480 n-d-850499-9 devstack@n-api.service[122256]: Aug 31 15:57:46.001480 n-d-850499-9 devstack@n-api.service[122256]: {"quota_set": {"ram": 0}} Aug 31 15:57:46.001480 n-d-850499-9 devstack@n-api.service[122256]: method: Aug 31 15:57:46.001480 n-d-850499-9 devstack@n-api.service[122256]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 31 15:57:46.001480 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': 'a28573760605489fbff981606988242c', 'body': {'quota_set': {'ram': 0}}} Aug 31 15:57:46.002298 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:57:46.002298 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:57:46.002298 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:57:46.002298 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:57:46.002298 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:57:46.002298 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:57:46.002298 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 15:57:46.002298 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 15:57:46.002298 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:57:46.002298 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:57:46.002298 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:57:46.002298 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:57:46.002298 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Aug 31 15:57:46.002298 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Aug 31 15:57:46.002298 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 31 15:57:46.002298 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:57:46.002298 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 31 15:57:46.002298 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:57:46.002298 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Aug 31 15:57:46.006625 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Aug 31 15:57:46.006625 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 31 15:57:46.006625 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 31 15:57:46.006625 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 31 15:57:46.006625 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 31 15:57:46.006625 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 15:57:46.006625 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 31 15:57:46.006625 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 15:57:46.006625 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise self.value Aug 31 15:57:46.006625 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 31 15:57:46.006625 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 31 15:57:46.006625 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 31 15:57:46.006625 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 31 15:57:46.006625 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 31 15:57:46.006625 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 31 15:57:46.006625 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 31 15:57:46.006625 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:57:46.006625 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:57:46.006625 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:57:46.006625 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:57:46.008396 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:57:46.008396 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:57:46.008396 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 31 15:57:46.008396 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 31 15:57:46.008396 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 31 15:57:46.008396 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:57:46.008396 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-bcb325e2-edf7-4036-a20e-85a50207d880 tempest-QuotasAdminNegativeTest-956917036 tempest-QuotasAdminNegativeTest-956917036-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:57:46.008396 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-bcb325e2-edf7-4036-a20e-85a50207d880 tempest-QuotasAdminNegativeTest-956917036 tempest-QuotasAdminNegativeTest-956917036-project] 10.222.0.61 "PUT /compute/v2.1/os-quota-sets/a28573760605489fbff981606988242c" status: 403 len: 116 microversion: 2.1 time: 0.020356 Aug 31 15:57:46.008396 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 262/528] 10.222.0.61 () {60 vars in 1262 bytes} [Wed Aug 31 15:57:45 2022] PUT /compute/v2.1/os-quota-sets/a28573760605489fbff981606988242c => generated 116 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:57:46.015008 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-64e640b4-d76b-469b-8436-c5981657b145 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Calling method '.version_select at 0x7f5ae9382790>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:46.044868 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e03eb0d1-21be-46c7-8f53-22047c1dde4a tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:46.080016 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e03eb0d1-21be-46c7-8f53-22047c1dde4a tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:46.090803 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e03eb0d1-21be-46c7-8f53-22047c1dde4a tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:46.099134 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e03eb0d1-21be-46c7-8f53-22047c1dde4a tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/79ee7e24-93df-450b-9030-b08c00d019eb" status: 200 len: 1567 microversion: 2.25 time: 0.654340 Aug 31 15:57:46.102251 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 267/529] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:45 2022] GET /compute/v2.1/servers/79ee7e24-93df-450b-9030-b08c00d019eb => generated 1567 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:57:46.119297 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-64e640b4-d76b-469b-8436-c5981657b145 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] 10.222.0.61 "GET /compute/v2.1/images/774b58aa-38b5-446e-b72b-0fab93b7abf3" status: 200 len: 1428 microversion: 2.1 time: 0.109688 Aug 31 15:57:46.120343 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 263/530] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 15:57:46 2022] GET /compute/v2.1/images/774b58aa-38b5-446e-b72b-0fab93b7abf3 => generated 1428 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:46.123076 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-04814676-1d10-4f45-9c1e-894f9c831166 tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:46.127530 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-04814676-1d10-4f45-9c1e-894f9c831166 tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] [instance: 68edc4cf-5ffe-47e3-89d0-4e4fa7aebca2] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:46.140705 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-fbceb161-a706-4914-b832-5a54d7c52e03 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:46.141331 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-fbceb161-a706-4914-b832-5a54d7c52e03 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] [instance: 4986a6de-1b24-42c5-942b-cd011b543cbc] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:46.153779 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-04814676-1d10-4f45-9c1e-894f9c831166 tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:46.154659 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-04814676-1d10-4f45-9c1e-894f9c831166 tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:46.157064 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fbceb161-a706-4914-b832-5a54d7c52e03 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:46.157608 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fbceb161-a706-4914-b832-5a54d7c52e03 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:46.157778 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fbceb161-a706-4914-b832-5a54d7c52e03 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:46.158499 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fbceb161-a706-4914-b832-5a54d7c52e03 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:46.158819 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-04814676-1d10-4f45-9c1e-894f9c831166 tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:46.159239 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fbceb161-a706-4914-b832-5a54d7c52e03 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:46.160225 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-04814676-1d10-4f45-9c1e-894f9c831166 tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:46.165679 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-04814676-1d10-4f45-9c1e-894f9c831166 tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:46.165969 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fbceb161-a706-4914-b832-5a54d7c52e03 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:46.169896 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-04814676-1d10-4f45-9c1e-894f9c831166 tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:46.283592 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fbceb161-a706-4914-b832-5a54d7c52e03 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:46.284110 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fbceb161-a706-4914-b832-5a54d7c52e03 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:46.284564 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fbceb161-a706-4914-b832-5a54d7c52e03 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:46.287693 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-fbceb161-a706-4914-b832-5a54d7c52e03 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lazy-loading 'fault' on Instance uuid 4986a6de-1b24-42c5-942b-cd011b543cbc {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:57:46.913390 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-fbceb161-a706-4914-b832-5a54d7c52e03 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd1dfe05c037461d8dfb45a6f611ced0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd5a49a78854f22aa3c58d01058e493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:46.928088 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-fbceb161-a706-4914-b832-5a54d7c52e03 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] 10.222.0.61 "GET /compute/v2.1/servers/4986a6de-1b24-42c5-942b-cd011b543cbc" status: 200 len: 1453 microversion: 2.1 time: 0.797938 Aug 31 15:57:46.929104 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 264/531] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:46 2022] GET /compute/v2.1/servers/4986a6de-1b24-42c5-942b-cd011b543cbc => generated 1453 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:46.934672 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-338b3720-7984-429b-bcbc-682769181152 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:46.936181 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-338b3720-7984-429b-bcbc-682769181152 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: 2ddb0b07-9e31-403c-91d5-a278d632d754] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:46.944634 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-338b3720-7984-429b-bcbc-682769181152 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:46.945376 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-338b3720-7984-429b-bcbc-682769181152 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:46.947338 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-338b3720-7984-429b-bcbc-682769181152 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:46.948283 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-338b3720-7984-429b-bcbc-682769181152 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:46.948957 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-338b3720-7984-429b-bcbc-682769181152 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:46.951252 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-338b3720-7984-429b-bcbc-682769181152 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:47.102730 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-04814676-1d10-4f45-9c1e-894f9c831166 tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad29bb9427d446ee8c0d237b218ac2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da6682c394444a1a286232fc0c2683d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:47.116682 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-04814676-1d10-4f45-9c1e-894f9c831166 tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] 10.222.0.61 "GET /compute/v2.1/servers/68edc4cf-5ffe-47e3-89d0-4e4fa7aebca2" status: 200 len: 1323 microversion: 2.1 time: 1.011477 Aug 31 15:57:47.117871 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 268/532] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:46 2022] GET /compute/v2.1/servers/68edc4cf-5ffe-47e3-89d0-4e4fa7aebca2 => generated 1323 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:47.132843 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-cf8aeefb-9ca1-45d0-8c6b-9f79825f521e tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:47.133715 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-cf8aeefb-9ca1-45d0-8c6b-9f79825f521e tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] [instance: 4986a6de-1b24-42c5-942b-cd011b543cbc] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:47.145650 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cf8aeefb-9ca1-45d0-8c6b-9f79825f521e tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:47.146407 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cf8aeefb-9ca1-45d0-8c6b-9f79825f521e tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:47.151908 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cf8aeefb-9ca1-45d0-8c6b-9f79825f521e tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:47.153073 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cf8aeefb-9ca1-45d0-8c6b-9f79825f521e tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:47.153557 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cf8aeefb-9ca1-45d0-8c6b-9f79825f521e tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:47.153992 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cf8aeefb-9ca1-45d0-8c6b-9f79825f521e tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:47.189654 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-cf8aeefb-9ca1-45d0-8c6b-9f79825f521e tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] [instance: 4986a6de-1b24-42c5-942b-cd011b543cbc] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 15:57:47.322313 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-cf8aeefb-9ca1-45d0-8c6b-9f79825f521e tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] 10.222.0.61 "DELETE /compute/v2.1/servers/4986a6de-1b24-42c5-942b-cd011b543cbc" status: 204 len: 0 microversion: 2.1 time: 0.201421 Aug 31 15:57:47.327048 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 269/533] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 15:57:47 2022] DELETE /compute/v2.1/servers/4986a6de-1b24-42c5-942b-cd011b543cbc => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 15:57:47.349808 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0bd6ac98-e7e9-4c5a-b166-6e2c287b1f7c tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:47.350570 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0bd6ac98-e7e9-4c5a-b166-6e2c287b1f7c tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] [instance: f2162319-5635-4c77-920d-9ecb3221d174] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:47.357599 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0bd6ac98-e7e9-4c5a-b166-6e2c287b1f7c tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:47.358102 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0bd6ac98-e7e9-4c5a-b166-6e2c287b1f7c tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:47.358549 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0bd6ac98-e7e9-4c5a-b166-6e2c287b1f7c tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:47.360274 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0bd6ac98-e7e9-4c5a-b166-6e2c287b1f7c tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:47.360770 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0bd6ac98-e7e9-4c5a-b166-6e2c287b1f7c tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:47.361189 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0bd6ac98-e7e9-4c5a-b166-6e2c287b1f7c tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:47.490180 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-338b3720-7984-429b-bcbc-682769181152 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:47.498656 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-338b3720-7984-429b-bcbc-682769181152 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/2ddb0b07-9e31-403c-91d5-a278d632d754" status: 200 len: 1309 microversion: 2.1 time: 0.568353 Aug 31 15:57:47.499267 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 265/534] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:46 2022] GET /compute/v2.1/servers/2ddb0b07-9e31-403c-91d5-a278d632d754 => generated 1309 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:47.513415 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7bd7386c-76a6-4e77-b4f3-7a2e4633b0c0 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:47.513790 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7bd7386c-76a6-4e77-b4f3-7a2e4633b0c0 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 79ee7e24-93df-450b-9030-b08c00d019eb] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:47.534913 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7bd7386c-76a6-4e77-b4f3-7a2e4633b0c0 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:47.535452 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7bd7386c-76a6-4e77-b4f3-7a2e4633b0c0 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:47.535923 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7bd7386c-76a6-4e77-b4f3-7a2e4633b0c0 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:47.536654 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7bd7386c-76a6-4e77-b4f3-7a2e4633b0c0 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:47.540686 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7bd7386c-76a6-4e77-b4f3-7a2e4633b0c0 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:47.541321 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7bd7386c-76a6-4e77-b4f3-7a2e4633b0c0 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:47.548821 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-0bd6ac98-e7e9-4c5a-b166-6e2c287b1f7c tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lazy-loading 'services' on Instance uuid f2162319-5635-4c77-920d-9ecb3221d174 {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:57:47.587678 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0bd6ac98-e7e9-4c5a-b166-6e2c287b1f7c tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174" status: 200 len: 1935 microversion: 2.75 time: 0.256348 Aug 31 15:57:47.588914 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 270/535] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:47 2022] GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174 => generated 1935 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:57:47.599659 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-bca35521-4a7f-443c-b52b-a30a1f39a8a9 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Calling method '.version_select at 0x7f5ae93a6e50>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:47.665815 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-bca35521-4a7f-443c-b52b-a30a1f39a8a9 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] 10.222.0.61 "GET /compute/v2.1/images/774b58aa-38b5-446e-b72b-0fab93b7abf3" status: 200 len: 1428 microversion: 2.1 time: 0.075638 Aug 31 15:57:47.673755 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 271/536] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 15:57:47 2022] GET /compute/v2.1/images/774b58aa-38b5-446e-b72b-0fab93b7abf3 => generated 1428 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:47.681271 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-bf4246a7-e409-4fea-8dd4-15246f0d9199 req-b4ed4e2d-fee3-42c8-8bbf-9d019ccc6a2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79ee7e24-93df-450b-9030-b08c00d019eb", "tag": "a2a2e771-f0ba-4149-867f-67716bfa9d07"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:57:47.696913 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-bf4246a7-e409-4fea-8dd4-15246f0d9199 req-b4ed4e2d-fee3-42c8-8bbf-9d019ccc6a2e service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:47.698326 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-bf4246a7-e409-4fea-8dd4-15246f0d9199 req-b4ed4e2d-fee3-42c8-8bbf-9d019ccc6a2e service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:47.699011 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-bf4246a7-e409-4fea-8dd4-15246f0d9199 req-b4ed4e2d-fee3-42c8-8bbf-9d019ccc6a2e service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:47.711895 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-bf4246a7-e409-4fea-8dd4-15246f0d9199 req-b4ed4e2d-fee3-42c8-8bbf-9d019ccc6a2e service nova] Creating event network-changed:a2a2e771-f0ba-4149-867f-67716bfa9d07 for instance 79ee7e24-93df-450b-9030-b08c00d019eb on n-h1-850499-9 Aug 31 15:57:47.719602 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-bf4246a7-e409-4fea-8dd4-15246f0d9199 req-b4ed4e2d-fee3-42c8-8bbf-9d019ccc6a2e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044554 Aug 31 15:57:47.720811 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 272/537] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 15:57:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:57:47.726428 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f100aae5-d0c2-442e-ac2d-dc1eb35cfcc7 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:47.727386 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f100aae5-d0c2-442e-ac2d-dc1eb35cfcc7 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] [instance: 4986a6de-1b24-42c5-942b-cd011b543cbc] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:47.737651 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f100aae5-d0c2-442e-ac2d-dc1eb35cfcc7 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:47.738401 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f100aae5-d0c2-442e-ac2d-dc1eb35cfcc7 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:47.738997 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f100aae5-d0c2-442e-ac2d-dc1eb35cfcc7 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:47.739940 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f100aae5-d0c2-442e-ac2d-dc1eb35cfcc7 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:47.740550 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f100aae5-d0c2-442e-ac2d-dc1eb35cfcc7 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:47.741808 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f100aae5-d0c2-442e-ac2d-dc1eb35cfcc7 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:47.789157 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f100aae5-d0c2-442e-ac2d-dc1eb35cfcc7 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:47.789890 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f100aae5-d0c2-442e-ac2d-dc1eb35cfcc7 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:47.790641 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f100aae5-d0c2-442e-ac2d-dc1eb35cfcc7 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:47.791591 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-f100aae5-d0c2-442e-ac2d-dc1eb35cfcc7 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lazy-loading 'fault' on Instance uuid 4986a6de-1b24-42c5-942b-cd011b543cbc {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:57:48.033558 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7bd7386c-76a6-4e77-b4f3-7a2e4633b0c0 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:48.052375 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7bd7386c-76a6-4e77-b4f3-7a2e4633b0c0 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:48.055535 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7bd7386c-76a6-4e77-b4f3-7a2e4633b0c0 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:48.065316 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7bd7386c-76a6-4e77-b4f3-7a2e4633b0c0 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/79ee7e24-93df-450b-9030-b08c00d019eb" status: 200 len: 1567 microversion: 2.25 time: 0.556665 Aug 31 15:57:48.066042 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 266/538] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:47 2022] GET /compute/v2.1/servers/79ee7e24-93df-450b-9030-b08c00d019eb => generated 1567 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:57:48.070631 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-693ef557-c469-41df-9221-e11cfa3f71ca req-241d3564-3803-4718-8f88-c8d8d560d9a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68edc4cf-5ffe-47e3-89d0-4e4fa7aebca2", "tag": "ba8ded58-5868-4341-b926-2dbd9dcb0b3a"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:57:48.093967 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-693ef557-c469-41df-9221-e11cfa3f71ca req-241d3564-3803-4718-8f88-c8d8d560d9a2 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:48.095654 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-693ef557-c469-41df-9221-e11cfa3f71ca req-241d3564-3803-4718-8f88-c8d8d560d9a2 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:48.095654 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-693ef557-c469-41df-9221-e11cfa3f71ca req-241d3564-3803-4718-8f88-c8d8d560d9a2 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:48.114541 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-693ef557-c469-41df-9221-e11cfa3f71ca req-241d3564-3803-4718-8f88-c8d8d560d9a2 service nova] Creating event network-changed:ba8ded58-5868-4341-b926-2dbd9dcb0b3a for instance 68edc4cf-5ffe-47e3-89d0-4e4fa7aebca2 on n-h1-850499-9 Aug 31 15:57:48.122802 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-693ef557-c469-41df-9221-e11cfa3f71ca req-241d3564-3803-4718-8f88-c8d8d560d9a2 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052597 Aug 31 15:57:48.125225 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 267/539] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 15:57:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:57:48.152338 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4151ee79-4d12-4d3c-88b8-2f6848bd39a7 tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:48.153359 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4151ee79-4d12-4d3c-88b8-2f6848bd39a7 tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] [instance: 68edc4cf-5ffe-47e3-89d0-4e4fa7aebca2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:48.159698 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:INSERT=8,nova_api:SELECT=90,nova_api:UPDATE=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:57:48.161474 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4151ee79-4d12-4d3c-88b8-2f6848bd39a7 tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:48.162537 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4151ee79-4d12-4d3c-88b8-2f6848bd39a7 tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:48.162537 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4151ee79-4d12-4d3c-88b8-2f6848bd39a7 tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:48.163450 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4151ee79-4d12-4d3c-88b8-2f6848bd39a7 tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:48.164023 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4151ee79-4d12-4d3c-88b8-2f6848bd39a7 tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:48.164546 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4151ee79-4d12-4d3c-88b8-2f6848bd39a7 tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:48.495816 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f100aae5-d0c2-442e-ac2d-dc1eb35cfcc7 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd1dfe05c037461d8dfb45a6f611ced0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd5a49a78854f22aa3c58d01058e493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:48.525165 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f100aae5-d0c2-442e-ac2d-dc1eb35cfcc7 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] 10.222.0.61 "GET /compute/v2.1/servers/4986a6de-1b24-42c5-942b-cd011b543cbc" status: 200 len: 1459 microversion: 2.1 time: 0.802934 Aug 31 15:57:48.526640 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 273/540] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:47 2022] GET /compute/v2.1/servers/4986a6de-1b24-42c5-942b-cd011b543cbc => generated 1459 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:48.553175 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d8dc7fb6-6611-4270-9b5e-ba06ea03f574 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:48.553802 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d8dc7fb6-6611-4270-9b5e-ba06ea03f574 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: 2ddb0b07-9e31-403c-91d5-a278d632d754] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:48.567656 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d8dc7fb6-6611-4270-9b5e-ba06ea03f574 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:48.571472 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d8dc7fb6-6611-4270-9b5e-ba06ea03f574 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:48.572156 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d8dc7fb6-6611-4270-9b5e-ba06ea03f574 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:48.573696 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d8dc7fb6-6611-4270-9b5e-ba06ea03f574 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:48.575467 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d8dc7fb6-6611-4270-9b5e-ba06ea03f574 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:48.576109 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d8dc7fb6-6611-4270-9b5e-ba06ea03f574 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:48.621577 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-4151ee79-4d12-4d3c-88b8-2f6848bd39a7 tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad29bb9427d446ee8c0d237b218ac2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da6682c394444a1a286232fc0c2683d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:48.634362 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4151ee79-4d12-4d3c-88b8-2f6848bd39a7 tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] 10.222.0.61 "GET /compute/v2.1/servers/68edc4cf-5ffe-47e3-89d0-4e4fa7aebca2" status: 200 len: 1323 microversion: 2.1 time: 0.489936 Aug 31 15:57:48.647529 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 268/541] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:48 2022] GET /compute/v2.1/servers/68edc4cf-5ffe-47e3-89d0-4e4fa7aebca2 => generated 1323 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:48.652275 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e0a49ada-fc34-494f-9f2b-6411b2101aa6 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:48.653256 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e0a49ada-fc34-494f-9f2b-6411b2101aa6 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] [instance: f2162319-5635-4c77-920d-9ecb3221d174] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:48.672820 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e0a49ada-fc34-494f-9f2b-6411b2101aa6 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:48.675457 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e0a49ada-fc34-494f-9f2b-6411b2101aa6 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:48.683240 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e0a49ada-fc34-494f-9f2b-6411b2101aa6 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:48.684166 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e0a49ada-fc34-494f-9f2b-6411b2101aa6 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:48.684740 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e0a49ada-fc34-494f-9f2b-6411b2101aa6 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:48.685282 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e0a49ada-fc34-494f-9f2b-6411b2101aa6 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:48.898122 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-e0a49ada-fc34-494f-9f2b-6411b2101aa6 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lazy-loading 'services' on Instance uuid f2162319-5635-4c77-920d-9ecb3221d174 {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:57:48.951719 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e0a49ada-fc34-494f-9f2b-6411b2101aa6 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174" status: 200 len: 1935 microversion: 2.75 time: 0.308830 Aug 31 15:57:48.955028 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 269/542] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:48 2022] GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174 => generated 1935 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:57:48.969042 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0ce3adb3-252e-46e1-99fa-04a3f578935f tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Calling method '.version_select at 0x7f5ae9357e50>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:49.043108 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0ce3adb3-252e-46e1-99fa-04a3f578935f tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] 10.222.0.61 "GET /compute/v2.1/images/774b58aa-38b5-446e-b72b-0fab93b7abf3" status: 200 len: 1428 microversion: 2.1 time: 0.083260 Aug 31 15:57:49.044185 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 270/543] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 15:57:48 2022] GET /compute/v2.1/images/774b58aa-38b5-446e-b72b-0fab93b7abf3 => generated 1428 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:49.095393 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-31dd4aa4-9d4c-4af0-81d0-55649f38c0f8 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:49.096462 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-31dd4aa4-9d4c-4af0-81d0-55649f38c0f8 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 79ee7e24-93df-450b-9030-b08c00d019eb] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:49.105630 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-31dd4aa4-9d4c-4af0-81d0-55649f38c0f8 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:49.106500 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-31dd4aa4-9d4c-4af0-81d0-55649f38c0f8 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:49.107332 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-31dd4aa4-9d4c-4af0-81d0-55649f38c0f8 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:49.108635 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-31dd4aa4-9d4c-4af0-81d0-55649f38c0f8 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:49.109333 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-31dd4aa4-9d4c-4af0-81d0-55649f38c0f8 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:49.110871 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-31dd4aa4-9d4c-4af0-81d0-55649f38c0f8 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:49.283893 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d8dc7fb6-6611-4270-9b5e-ba06ea03f574 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:49.300389 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d8dc7fb6-6611-4270-9b5e-ba06ea03f574 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/2ddb0b07-9e31-403c-91d5-a278d632d754" status: 200 len: 1309 microversion: 2.1 time: 0.771613 Aug 31 15:57:49.310078 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 274/544] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:48 2022] GET /compute/v2.1/servers/2ddb0b07-9e31-403c-91d5-a278d632d754 => generated 1309 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:49.393233 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-31dd4aa4-9d4c-4af0-81d0-55649f38c0f8 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:49.400019 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-31dd4aa4-9d4c-4af0-81d0-55649f38c0f8 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:49.402385 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-31dd4aa4-9d4c-4af0-81d0-55649f38c0f8 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:49.403899 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-31dd4aa4-9d4c-4af0-81d0-55649f38c0f8 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/79ee7e24-93df-450b-9030-b08c00d019eb" status: 200 len: 1567 microversion: 2.25 time: 0.313393 Aug 31 15:57:49.420805 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 271/545] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:49 2022] GET /compute/v2.1/servers/79ee7e24-93df-450b-9030-b08c00d019eb => generated 1567 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:57:49.547551 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7bceff9c-2c28-46b9-a803-4105608c0640 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:49.548381 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7bceff9c-2c28-46b9-a803-4105608c0640 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] [instance: 4986a6de-1b24-42c5-942b-cd011b543cbc] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:49.555316 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7bceff9c-2c28-46b9-a803-4105608c0640 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:49.555848 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7bceff9c-2c28-46b9-a803-4105608c0640 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:49.556622 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7bceff9c-2c28-46b9-a803-4105608c0640 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:49.558067 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7bceff9c-2c28-46b9-a803-4105608c0640 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:49.558693 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7bceff9c-2c28-46b9-a803-4105608c0640 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:49.559277 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7bceff9c-2c28-46b9-a803-4105608c0640 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:49.598290 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7bceff9c-2c28-46b9-a803-4105608c0640 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:49.598960 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7bceff9c-2c28-46b9-a803-4105608c0640 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:49.599747 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7bceff9c-2c28-46b9-a803-4105608c0640 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:49.601006 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-7bceff9c-2c28-46b9-a803-4105608c0640 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lazy-loading 'fault' on Instance uuid 4986a6de-1b24-42c5-942b-cd011b543cbc {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:57:49.659313 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b9838530-1163-475d-a61b-d9777c15e764 tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:49.659878 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b9838530-1163-475d-a61b-d9777c15e764 tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] [instance: 68edc4cf-5ffe-47e3-89d0-4e4fa7aebca2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:49.667921 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b9838530-1163-475d-a61b-d9777c15e764 tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:49.668422 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b9838530-1163-475d-a61b-d9777c15e764 tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:49.676472 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b9838530-1163-475d-a61b-d9777c15e764 tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:49.677211 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b9838530-1163-475d-a61b-d9777c15e764 tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:49.677696 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b9838530-1163-475d-a61b-d9777c15e764 tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:49.678131 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b9838530-1163-475d-a61b-d9777c15e764 tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:49.801154 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7bceff9c-2c28-46b9-a803-4105608c0640 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd1dfe05c037461d8dfb45a6f611ced0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd5a49a78854f22aa3c58d01058e493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:49.813824 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7bceff9c-2c28-46b9-a803-4105608c0640 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] 10.222.0.61 "GET /compute/v2.1/servers/4986a6de-1b24-42c5-942b-cd011b543cbc" status: 200 len: 1459 microversion: 2.1 time: 0.271014 Aug 31 15:57:49.829022 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 275/546] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:49 2022] GET /compute/v2.1/servers/4986a6de-1b24-42c5-942b-cd011b543cbc => generated 1459 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:49.835936 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-11382c38-7efb-458c-8ced-1ad6418afa97 req-0a46b978-8ea7-4300-8f46-821e9acea9ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ddb0b07-9e31-403c-91d5-a278d632d754", "tag": "e7598456-3858-4c71-8638-c50e65f3fc7a"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:57:49.848623 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-11382c38-7efb-458c-8ced-1ad6418afa97 req-0a46b978-8ea7-4300-8f46-821e9acea9ab service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:49.849697 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-11382c38-7efb-458c-8ced-1ad6418afa97 req-0a46b978-8ea7-4300-8f46-821e9acea9ab service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:49.850270 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-11382c38-7efb-458c-8ced-1ad6418afa97 req-0a46b978-8ea7-4300-8f46-821e9acea9ab service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:49.881161 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-11382c38-7efb-458c-8ced-1ad6418afa97 req-0a46b978-8ea7-4300-8f46-821e9acea9ab service nova] Creating event network-changed:e7598456-3858-4c71-8638-c50e65f3fc7a for instance 2ddb0b07-9e31-403c-91d5-a278d632d754 on n-h1-850499-9 Aug 31 15:57:49.892894 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-11382c38-7efb-458c-8ced-1ad6418afa97 req-0a46b978-8ea7-4300-8f46-821e9acea9ab service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062408 Aug 31 15:57:49.893821 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 276/547] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 15:57:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:57:49.900228 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b9838530-1163-475d-a61b-d9777c15e764 tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad29bb9427d446ee8c0d237b218ac2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da6682c394444a1a286232fc0c2683d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:49.908997 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b9838530-1163-475d-a61b-d9777c15e764 tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] 10.222.0.61 "GET /compute/v2.1/servers/68edc4cf-5ffe-47e3-89d0-4e4fa7aebca2" status: 200 len: 1323 microversion: 2.1 time: 0.253838 Aug 31 15:57:49.917962 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 272/548] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:49 2022] GET /compute/v2.1/servers/68edc4cf-5ffe-47e3-89d0-4e4fa7aebca2 => generated 1323 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:49.987527 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b8ded6a1-55bf-458b-97da-8240f22aa3d7 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:49.988333 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b8ded6a1-55bf-458b-97da-8240f22aa3d7 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] [instance: f2162319-5635-4c77-920d-9ecb3221d174] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:49.995469 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b8ded6a1-55bf-458b-97da-8240f22aa3d7 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:49.996507 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b8ded6a1-55bf-458b-97da-8240f22aa3d7 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:49.997101 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b8ded6a1-55bf-458b-97da-8240f22aa3d7 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:49.997820 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b8ded6a1-55bf-458b-97da-8240f22aa3d7 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:49.998281 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b8ded6a1-55bf-458b-97da-8240f22aa3d7 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:49.998721 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b8ded6a1-55bf-458b-97da-8240f22aa3d7 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:50.059352 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-653aff07-b69d-4b9d-b03c-56393e4accfa tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Calling method '.version_select at 0x7f5ae934c4c0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:50.099695 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-b8ded6a1-55bf-458b-97da-8240f22aa3d7 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lazy-loading 'services' on Instance uuid f2162319-5635-4c77-920d-9ecb3221d174 {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:57:50.130082 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-653aff07-b69d-4b9d-b03c-56393e4accfa tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] 10.222.0.61 "GET /compute/v2.1/images/774b58aa-38b5-446e-b72b-0fab93b7abf3" status: 200 len: 1428 microversion: 2.1 time: 0.076185 Aug 31 15:57:50.133487 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b8ded6a1-55bf-458b-97da-8240f22aa3d7 tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174" status: 200 len: 1935 microversion: 2.75 time: 0.150278 Aug 31 15:57:50.134560 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 277/549] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:49 2022] GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174 => generated 1935 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:57:50.148958 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 273/550] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 15:57:50 2022] GET /compute/v2.1/images/774b58aa-38b5-446e-b72b-0fab93b7abf3 => generated 1428 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:50.328041 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-842f5d1a-3e65-4bed-b4ce-180c103968b3 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:50.329024 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-842f5d1a-3e65-4bed-b4ce-180c103968b3 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: 2ddb0b07-9e31-403c-91d5-a278d632d754] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:50.335370 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-842f5d1a-3e65-4bed-b4ce-180c103968b3 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:50.336224 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-842f5d1a-3e65-4bed-b4ce-180c103968b3 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:50.337152 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-842f5d1a-3e65-4bed-b4ce-180c103968b3 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:50.338901 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-842f5d1a-3e65-4bed-b4ce-180c103968b3 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:50.340032 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-842f5d1a-3e65-4bed-b4ce-180c103968b3 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:50.340780 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-842f5d1a-3e65-4bed-b4ce-180c103968b3 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:50.427473 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f656168f-f46a-4abe-8c0c-bdb3923c10b6 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:50.428472 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f656168f-f46a-4abe-8c0c-bdb3923c10b6 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 79ee7e24-93df-450b-9030-b08c00d019eb] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:50.445044 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f656168f-f46a-4abe-8c0c-bdb3923c10b6 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:50.447021 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f656168f-f46a-4abe-8c0c-bdb3923c10b6 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:50.450163 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f656168f-f46a-4abe-8c0c-bdb3923c10b6 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:50.451011 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f656168f-f46a-4abe-8c0c-bdb3923c10b6 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:50.451606 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f656168f-f46a-4abe-8c0c-bdb3923c10b6 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:50.451958 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f656168f-f46a-4abe-8c0c-bdb3923c10b6 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:50.859843 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f656168f-f46a-4abe-8c0c-bdb3923c10b6 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:50.868128 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-842f5d1a-3e65-4bed-b4ce-180c103968b3 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:50.871240 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:57:50.874511 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f656168f-f46a-4abe-8c0c-bdb3923c10b6 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:50.879851 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f656168f-f46a-4abe-8c0c-bdb3923c10b6 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:50.883826 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f656168f-f46a-4abe-8c0c-bdb3923c10b6 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/79ee7e24-93df-450b-9030-b08c00d019eb" status: 200 len: 1567 microversion: 2.25 time: 0.460149 Aug 31 15:57:50.886373 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-842f5d1a-3e65-4bed-b4ce-180c103968b3 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/2ddb0b07-9e31-403c-91d5-a278d632d754" status: 200 len: 1309 microversion: 2.1 time: 0.562170 Aug 31 15:57:50.900507 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 278/551] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:50 2022] GET /compute/v2.1/servers/2ddb0b07-9e31-403c-91d5-a278d632d754 => generated 1309 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:50.907977 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 274/552] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:50 2022] GET /compute/v2.1/servers/79ee7e24-93df-450b-9030-b08c00d019eb => generated 1567 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 15:57:50.910688 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ad1761be-a6ca-4f98-b45f-55e6d0d1a9b0 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:50.911540 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ad1761be-a6ca-4f98-b45f-55e6d0d1a9b0 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] [instance: 4986a6de-1b24-42c5-942b-cd011b543cbc] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:50.922369 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ad1761be-a6ca-4f98-b45f-55e6d0d1a9b0 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:50.923152 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ad1761be-a6ca-4f98-b45f-55e6d0d1a9b0 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:50.923835 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ad1761be-a6ca-4f98-b45f-55e6d0d1a9b0 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:50.924966 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ad1761be-a6ca-4f98-b45f-55e6d0d1a9b0 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:50.926207 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ad1761be-a6ca-4f98-b45f-55e6d0d1a9b0 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:50.926814 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ad1761be-a6ca-4f98-b45f-55e6d0d1a9b0 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:50.942205 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6af04415-5b60-4714-9f92-73592164d12b tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:50.942821 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6af04415-5b60-4714-9f92-73592164d12b tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] [instance: 68edc4cf-5ffe-47e3-89d0-4e4fa7aebca2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:50.954605 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6af04415-5b60-4714-9f92-73592164d12b tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:50.958013 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6af04415-5b60-4714-9f92-73592164d12b tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:50.958708 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6af04415-5b60-4714-9f92-73592164d12b tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:50.959982 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6af04415-5b60-4714-9f92-73592164d12b tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:50.960811 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6af04415-5b60-4714-9f92-73592164d12b tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:50.961985 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6af04415-5b60-4714-9f92-73592164d12b tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:50.988715 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ad1761be-a6ca-4f98-b45f-55e6d0d1a9b0 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:50.989205 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ad1761be-a6ca-4f98-b45f-55e6d0d1a9b0 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:50.989925 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ad1761be-a6ca-4f98-b45f-55e6d0d1a9b0 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:50.990565 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-ad1761be-a6ca-4f98-b45f-55e6d0d1a9b0 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lazy-loading 'fault' on Instance uuid 4986a6de-1b24-42c5-942b-cd011b543cbc {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:57:51.237504 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ad1761be-a6ca-4f98-b45f-55e6d0d1a9b0 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd1dfe05c037461d8dfb45a6f611ced0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd5a49a78854f22aa3c58d01058e493', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:51.254894 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ad1761be-a6ca-4f98-b45f-55e6d0d1a9b0 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] 10.222.0.61 "GET /compute/v2.1/servers/4986a6de-1b24-42c5-942b-cd011b543cbc" status: 200 len: 1417 microversion: 2.1 time: 0.352549 Aug 31 15:57:51.262483 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 279/553] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:50 2022] GET /compute/v2.1/servers/4986a6de-1b24-42c5-942b-cd011b543cbc => generated 1417 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:51.272914 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-cb5d6687-69d2-4c6b-9f91-dd26d45ff48c tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:51.274857 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-cb5d6687-69d2-4c6b-9f91-dd26d45ff48c tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] [instance: f2162319-5635-4c77-920d-9ecb3221d174] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:51.287309 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cb5d6687-69d2-4c6b-9f91-dd26d45ff48c tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:51.287889 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cb5d6687-69d2-4c6b-9f91-dd26d45ff48c tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:51.288437 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cb5d6687-69d2-4c6b-9f91-dd26d45ff48c tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:51.289814 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cb5d6687-69d2-4c6b-9f91-dd26d45ff48c tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:51.290281 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cb5d6687-69d2-4c6b-9f91-dd26d45ff48c tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:51.290713 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cb5d6687-69d2-4c6b-9f91-dd26d45ff48c tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:51.698051 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-cb5d6687-69d2-4c6b-9f91-dd26d45ff48c tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] Lazy-loading 'services' on Instance uuid f2162319-5635-4c77-920d-9ecb3221d174 {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:57:51.721375 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-cb5d6687-69d2-4c6b-9f91-dd26d45ff48c tempest-ServersAdmin275Test-939018636 tempest-ServersAdmin275Test-939018636-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174" status: 200 len: 1920 microversion: 2.75 time: 0.457326 Aug 31 15:57:51.722741 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 280/554] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:51 2022] GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174 => generated 1920 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:57:51.741252 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-af17022a-f9f2-45f1-9605-514faaf2a808 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Calling method '.version_select at 0x7f5ae93a6670>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:51.814616 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-af17022a-f9f2-45f1-9605-514faaf2a808 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] 10.222.0.61 "GET /compute/v2.1/images/774b58aa-38b5-446e-b72b-0fab93b7abf3" status: 200 len: 1428 microversion: 2.1 time: 0.090216 Aug 31 15:57:51.821870 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 281/555] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 15:57:51 2022] GET /compute/v2.1/images/774b58aa-38b5-446e-b72b-0fab93b7abf3 => generated 1428 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:51.924089 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-6af04415-5b60-4714-9f92-73592164d12b tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad29bb9427d446ee8c0d237b218ac2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da6682c394444a1a286232fc0c2683d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:51.939873 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6af04415-5b60-4714-9f92-73592164d12b tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] 10.222.0.61 "GET /compute/v2.1/servers/68edc4cf-5ffe-47e3-89d0-4e4fa7aebca2" status: 200 len: 1323 microversion: 2.1 time: 1.003498 Aug 31 15:57:51.956762 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 275/556] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:50 2022] GET /compute/v2.1/servers/68edc4cf-5ffe-47e3-89d0-4e4fa7aebca2 => generated 1323 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:57:51.972850 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4f718495-3b70-4999-85c7-15b672de701c tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:51.973550 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4f718495-3b70-4999-85c7-15b672de701c tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] [instance: f2162319-5635-4c77-920d-9ecb3221d174] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:52.001909 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4f718495-3b70-4999-85c7-15b672de701c tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:52.002612 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4f718495-3b70-4999-85c7-15b672de701c tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:52.003236 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4f718495-3b70-4999-85c7-15b672de701c tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:52.004657 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4f718495-3b70-4999-85c7-15b672de701c tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:52.005596 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4f718495-3b70-4999-85c7-15b672de701c tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:52.006186 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4f718495-3b70-4999-85c7-15b672de701c tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:52.023614 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-81138d10-c9ea-4453-ab1a-d5330bce7aca tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-228452086", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:57:52.058978 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4f718495-3b70-4999-85c7-15b672de701c tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] [instance: f2162319-5635-4c77-920d-9ecb3221d174] Going to try to terminate instance {{(pid=122256) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 15:57:52.181200 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-81138d10-c9ea-4453-ab1a-d5330bce7aca tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] validate_networks() for None {{(pid=122257) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 15:57:52.203638 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4f718495-3b70-4999-85c7-15b672de701c tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] 10.222.0.61 "DELETE /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174" status: 204 len: 0 microversion: 2.75 time: 0.245089 Aug 31 15:57:52.204237 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 276/557] 10.222.0.61 () {60 vars in 1280 bytes} [Wed Aug 31 15:57:51 2022] DELETE /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 15:57:52.211740 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-06f1e0dd-7396-47e7-81d6-3c7b003dc3da tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:52.212512 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-06f1e0dd-7396-47e7-81d6-3c7b003dc3da tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: 2ddb0b07-9e31-403c-91d5-a278d632d754] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:52.222826 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-06f1e0dd-7396-47e7-81d6-3c7b003dc3da tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:52.223379 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-06f1e0dd-7396-47e7-81d6-3c7b003dc3da tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:52.224284 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-06f1e0dd-7396-47e7-81d6-3c7b003dc3da tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:52.225102 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-06f1e0dd-7396-47e7-81d6-3c7b003dc3da tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:52.225860 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-06f1e0dd-7396-47e7-81d6-3c7b003dc3da tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:52.226765 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-06f1e0dd-7396-47e7-81d6-3c7b003dc3da tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:52.548215 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-06f1e0dd-7396-47e7-81d6-3c7b003dc3da tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:52.556310 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-06f1e0dd-7396-47e7-81d6-3c7b003dc3da tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/2ddb0b07-9e31-403c-91d5-a278d632d754" status: 200 len: 1309 microversion: 2.1 time: 0.350422 Aug 31 15:57:52.558676 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 277/558] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:52 2022] GET /compute/v2.1/servers/2ddb0b07-9e31-403c-91d5-a278d632d754 => generated 1309 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:52.567713 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b71ae22e-2846-4218-8ddd-89b6799a540b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:52.568542 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b71ae22e-2846-4218-8ddd-89b6799a540b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 79ee7e24-93df-450b-9030-b08c00d019eb] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:52.577240 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b71ae22e-2846-4218-8ddd-89b6799a540b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:52.578039 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b71ae22e-2846-4218-8ddd-89b6799a540b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:52.578662 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b71ae22e-2846-4218-8ddd-89b6799a540b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:52.579558 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b71ae22e-2846-4218-8ddd-89b6799a540b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:52.580175 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b71ae22e-2846-4218-8ddd-89b6799a540b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:52.580762 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b71ae22e-2846-4218-8ddd-89b6799a540b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:52.612983 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:57:52.654878 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-81138d10-c9ea-4453-ab1a-d5330bce7aca tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 15:57:52.656694 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-81138d10-c9ea-4453-ab1a-d5330bce7aca tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 15:57:52.657434 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-81138d10-c9ea-4453-ab1a-d5330bce7aca tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 15:57:52.658059 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-81138d10-c9ea-4453-ab1a-d5330bce7aca tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 15:57:52.658755 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-81138d10-c9ea-4453-ab1a-d5330bce7aca tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 15:57:52.670293 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=51 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:57:52.681106 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-81138d10-c9ea-4453-ab1a-d5330bce7aca tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:52.683231 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-81138d10-c9ea-4453-ab1a-d5330bce7aca tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:52.683949 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-81138d10-c9ea-4453-ab1a-d5330bce7aca tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:52.698328 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-81138d10-c9ea-4453-ab1a-d5330bce7aca tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:52.700124 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-81138d10-c9ea-4453-ab1a-d5330bce7aca tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:52.700821 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-81138d10-c9ea-4453-ab1a-d5330bce7aca tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:52.725581 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-81138d10-c9ea-4453-ab1a-d5330bce7aca tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Getting quotas for project 8ad48220bc634a6186547269011ec49b. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:57:52.733994 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-81138d10-c9ea-4453-ab1a-d5330bce7aca tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Getting quotas for user cba336e5ac684606b5e0123e454f9a60 and project 8ad48220bc634a6186547269011ec49b. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:57:52.774317 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-81138d10-c9ea-4453-ab1a-d5330bce7aca tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Going to run 1 instances... {{(pid=122257) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 15:57:52.779529 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-81138d10-c9ea-4453-ab1a-d5330bce7aca tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] [instance: f977bd90-3cd4-4b07-87f9-42e26b8a530a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 15:57:52.912508 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-81138d10-c9ea-4453-ab1a-d5330bce7aca tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.095287 Aug 31 15:57:52.914127 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 282/559] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 15:57:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1098 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 15:57:52.924785 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-2f281d31-02a4-4261-811d-08734c6d3674 req-88c8f0aa-924e-4452-8d59-522a93b4da0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4986a6de-1b24-42c5-942b-cd011b543cbc", "name": "network-vif-deleted", "tag": "230c1f66-b502-4442-bef2-05bb93e8a285"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:57:52.949117 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-2f281d31-02a4-4261-811d-08734c6d3674 req-88c8f0aa-924e-4452-8d59-522a93b4da0a service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:52.950774 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-2f281d31-02a4-4261-811d-08734c6d3674 req-88c8f0aa-924e-4452-8d59-522a93b4da0a service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:52.951816 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-2f281d31-02a4-4261-811d-08734c6d3674 req-88c8f0aa-924e-4452-8d59-522a93b4da0a service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:52.988959 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-2f281d31-02a4-4261-811d-08734c6d3674 req-88c8f0aa-924e-4452-8d59-522a93b4da0a service nova] Creating event network-vif-deleted:230c1f66-b502-4442-bef2-05bb93e8a285 for instance 4986a6de-1b24-42c5-942b-cd011b543cbc on n-h2-850499-9 Aug 31 15:57:53.014163 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-2f281d31-02a4-4261-811d-08734c6d3674 req-88c8f0aa-924e-4452-8d59-522a93b4da0a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097538 Aug 31 15:57:53.018348 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 283/560] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 15:57:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:57:53.050527 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5ff4b5d8-d45d-4646-a363-7a9613bd354e tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:53.051328 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5ff4b5d8-d45d-4646-a363-7a9613bd354e tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] [instance: f2162319-5635-4c77-920d-9ecb3221d174] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:53.078032 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5ff4b5d8-d45d-4646-a363-7a9613bd354e tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:53.078778 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5ff4b5d8-d45d-4646-a363-7a9613bd354e tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:53.078981 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5ff4b5d8-d45d-4646-a363-7a9613bd354e tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:53.079743 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5ff4b5d8-d45d-4646-a363-7a9613bd354e tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:53.080227 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5ff4b5d8-d45d-4646-a363-7a9613bd354e tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:53.080660 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5ff4b5d8-d45d-4646-a363-7a9613bd354e tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:53.424240 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5ff4b5d8-d45d-4646-a363-7a9613bd354e tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:53.433341 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5ff4b5d8-d45d-4646-a363-7a9613bd354e tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:53.434834 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5ff4b5d8-d45d-4646-a363-7a9613bd354e tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:53.455314 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5ff4b5d8-d45d-4646-a363-7a9613bd354e tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] 10.222.0.61 "GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174" status: 200 len: 1444 microversion: 2.75 time: 0.433651 Aug 31 15:57:53.472585 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 284/561] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:53 2022] GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174 => generated 1444 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:57:53.492387 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-323b5da3-728f-4192-b71c-0bb10ff5ac19 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:53.493023 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-323b5da3-728f-4192-b71c-0bb10ff5ac19 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] [instance: 4986a6de-1b24-42c5-942b-cd011b543cbc] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:53.503722 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-323b5da3-728f-4192-b71c-0bb10ff5ac19 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:53.503722 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-323b5da3-728f-4192-b71c-0bb10ff5ac19 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:53.512125 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-323b5da3-728f-4192-b71c-0bb10ff5ac19 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:53.512917 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-323b5da3-728f-4192-b71c-0bb10ff5ac19 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:53.513408 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-323b5da3-728f-4192-b71c-0bb10ff5ac19 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:53.513851 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-323b5da3-728f-4192-b71c-0bb10ff5ac19 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:53.550455 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-323b5da3-728f-4192-b71c-0bb10ff5ac19 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] HTTP exception thrown: Instance 4986a6de-1b24-42c5-942b-cd011b543cbc could not be found. Aug 31 15:57:53.553831 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-323b5da3-728f-4192-b71c-0bb10ff5ac19 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Request method failure captured: Aug 31 15:57:53.553831 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/4986a6de-1b24-42c5-942b-cd011b543cbc HTTP/1.1 Aug 31 15:57:53.553831 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 15:57:53.553831 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 15:57:53.553831 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 15:57:53.553831 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 15:57:53.553831 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 15:57:53.553831 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 15:57:53.553831 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 15:57:53.553831 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 15:57:53.553831 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4TLVpymZOnvakOemdwpGBTt88XQ6FOU_DUWcqHb02xesGQpV3Ax6krnQbV92xwL-oS941HW0-PRhDxariNfReox8B4BKmg2r3s36v828sapChho_P5lNLTWoUBfIkA4hfPL85ynqdUK8nxO3GYCeYXW8nWjfKBCU4-5G78q2te3WwI Aug 31 15:57:53.553831 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 15:57:53.553831 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 15:57:53.553831 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 15:57:53.553831 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 15:57:53.553831 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 15:57:53.553831 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 15:57:53.553831 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 8dd5a49a78854f22aa3c58d01058e493 Aug 31 15:57:53.553831 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-DeleteServersAdminTestJSON-252145351 Aug 31 15:57:53.553831 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 15:57:53.553831 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 15:57:53.555340 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8dd5a49a78854f22aa3c58d01058e493"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/8dd5a49a78854f22aa3c58d01058e493"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_8dd5a49a78854f22aa3c58d01058e493", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8dd5a49a78854f22aa3c58d01058e493"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 15:57:53.555340 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-DeleteServersAdminTestJSON-252145351 Aug 31 15:57:53.555340 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 8dd5a49a78854f22aa3c58d01058e493 Aug 31 15:57:53.555340 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-252145351 Aug 31 15:57:53.555340 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-DeleteServersAdminTestJSON-252145351-project Aug 31 15:57:53.555340 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 15:57:53.555340 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 15:57:53.555340 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: fd1dfe05c037461d8dfb45a6f611ced0 Aug 31 15:57:53.555340 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-DeleteServersAdminTestJSON-252145351-project Aug 31 15:57:53.555340 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 15:57:53.555340 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance 4986a6de-1b24-42c5-942b-cd011b543cbc could not be found. Aug 31 15:57:53.555340 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '4986a6de-1b24-42c5-942b-cd011b543cbc'} Aug 31 15:57:53.556196 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:57:53.556196 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:57:53.556196 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 15:57:53.556196 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 15:57:53.556196 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 15:57:53.556196 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 15:57:53.556196 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 15:57:53.556196 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 15:57:53.556196 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 15:57:53.556196 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 15:57:53.556196 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4986a6de-1b24-42c5-942b-cd011b543cbc could not be found. Aug 31 15:57:53.556196 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:57:53.556196 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:57:53.556196 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:57:53.556196 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:57:53.556196 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:57:53.556196 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:57:53.556196 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:57:53.556196 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:57:53.556196 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:57:53.558250 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:57:53.558250 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 15:57:53.558250 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 15:57:53.558250 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 15:57:53.558250 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 15:57:53.558250 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 15:57:53.558250 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:57:53.558250 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4986a6de-1b24-42c5-942b-cd011b543cbc could not be found. Aug 31 15:57:53.558250 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:57:53.558250 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:57:53.558250 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:57:53.558250 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:57:53.558250 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:57:53.558250 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:57:53.558250 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:57:53.558250 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:57:53.558250 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4986a6de-1b24-42c5-942b-cd011b543cbc could not be found. Aug 31 15:57:53.558250 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:57:53.566617 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-323b5da3-728f-4192-b71c-0bb10ff5ac19 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Returning 404 to user: Instance 4986a6de-1b24-42c5-942b-cd011b543cbc could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:57:53.567781 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-323b5da3-728f-4192-b71c-0bb10ff5ac19 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] 10.222.0.61 "GET /compute/v2.1/servers/4986a6de-1b24-42c5-942b-cd011b543cbc" status: 404 len: 111 microversion: 2.1 time: 0.093901 Aug 31 15:57:53.568565 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 285/562] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:53 2022] GET /compute/v2.1/servers/4986a6de-1b24-42c5-942b-cd011b543cbc => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:57:53.581786 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d4345caa-9935-4d5d-9e31-275ab4de0790 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Calling method '.version_select at 0x7f5ae93a68b0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:53.665159 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d4345caa-9935-4d5d-9e31-275ab4de0790 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] 10.222.0.61 "GET /compute/v2.1/images/774b58aa-38b5-446e-b72b-0fab93b7abf3" status: 200 len: 1428 microversion: 2.1 time: 0.095370 Aug 31 15:57:53.667862 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 286/563] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 15:57:53 2022] GET /compute/v2.1/images/774b58aa-38b5-446e-b72b-0fab93b7abf3 => generated 1428 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:53.677182 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-53ab53e8-f4d6-46ba-9161-ad8425925da9 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:53.678528 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-53ab53e8-f4d6-46ba-9161-ad8425925da9 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] [instance: f977bd90-3cd4-4b07-87f9-42e26b8a530a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:53.683305 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b71ae22e-2846-4218-8ddd-89b6799a540b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:53.696938 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b71ae22e-2846-4218-8ddd-89b6799a540b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:53.703692 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b71ae22e-2846-4218-8ddd-89b6799a540b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:53.706458 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b71ae22e-2846-4218-8ddd-89b6799a540b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/79ee7e24-93df-450b-9030-b08c00d019eb" status: 200 len: 1567 microversion: 2.25 time: 1.146608 Aug 31 15:57:53.707052 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 278/564] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:52 2022] GET /compute/v2.1/servers/79ee7e24-93df-450b-9030-b08c00d019eb => generated 1567 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:57:53.724068 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f0c858b3-9b44-40b3-b837-b66ce0d737dd tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:53.725257 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f0c858b3-9b44-40b3-b837-b66ce0d737dd tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] [instance: 68edc4cf-5ffe-47e3-89d0-4e4fa7aebca2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:53.735204 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f0c858b3-9b44-40b3-b837-b66ce0d737dd tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:53.735745 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f0c858b3-9b44-40b3-b837-b66ce0d737dd tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:53.736193 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f0c858b3-9b44-40b3-b837-b66ce0d737dd tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:53.736915 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f0c858b3-9b44-40b3-b837-b66ce0d737dd tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:53.737379 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f0c858b3-9b44-40b3-b837-b66ce0d737dd tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:53.737813 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f0c858b3-9b44-40b3-b837-b66ce0d737dd tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:53.889645 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-53ab53e8-f4d6-46ba-9161-ad8425925da9 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba336e5ac684606b5e0123e454f9a60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad48220bc634a6186547269011ec49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:53.918101 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-53ab53e8-f4d6-46ba-9161-ad8425925da9 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] 10.222.0.61 "GET /compute/v2.1/servers/f977bd90-3cd4-4b07-87f9-42e26b8a530a" status: 200 len: 1213 microversion: 2.1 time: 0.246150 Aug 31 15:57:53.925594 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 287/565] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:53 2022] GET /compute/v2.1/servers/f977bd90-3cd4-4b07-87f9-42e26b8a530a => generated 1213 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:53.966414 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5858c1c0-10bd-41c1-8feb-c39fd136b82f tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:53.967336 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5858c1c0-10bd-41c1-8feb-c39fd136b82f tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: 2ddb0b07-9e31-403c-91d5-a278d632d754] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:53.992748 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5858c1c0-10bd-41c1-8feb-c39fd136b82f tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:53.993662 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5858c1c0-10bd-41c1-8feb-c39fd136b82f tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:53.994254 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5858c1c0-10bd-41c1-8feb-c39fd136b82f tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:53.995818 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5858c1c0-10bd-41c1-8feb-c39fd136b82f tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:53.997072 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5858c1c0-10bd-41c1-8feb-c39fd136b82f tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:53.998216 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5858c1c0-10bd-41c1-8feb-c39fd136b82f tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:54.045900 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f0c858b3-9b44-40b3-b837-b66ce0d737dd tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad29bb9427d446ee8c0d237b218ac2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da6682c394444a1a286232fc0c2683d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:54.053972 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f0c858b3-9b44-40b3-b837-b66ce0d737dd tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] 10.222.0.61 "GET /compute/v2.1/servers/68edc4cf-5ffe-47e3-89d0-4e4fa7aebca2" status: 200 len: 1323 microversion: 2.1 time: 0.342566 Aug 31 15:57:54.072491 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 279/566] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:53 2022] GET /compute/v2.1/servers/68edc4cf-5ffe-47e3-89d0-4e4fa7aebca2 => generated 1323 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:54.078788 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a942349f-3a92-4284-a979-f590c7904f6d tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:54.079487 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a942349f-3a92-4284-a979-f590c7904f6d tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] [instance: 4986a6de-1b24-42c5-942b-cd011b543cbc] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:54.085715 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a942349f-3a92-4284-a979-f590c7904f6d tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:54.086686 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a942349f-3a92-4284-a979-f590c7904f6d tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:54.087322 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a942349f-3a92-4284-a979-f590c7904f6d tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:54.088050 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a942349f-3a92-4284-a979-f590c7904f6d tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:54.089429 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a942349f-3a92-4284-a979-f590c7904f6d tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:54.090027 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a942349f-3a92-4284-a979-f590c7904f6d tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:54.107416 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-a942349f-3a92-4284-a979-f590c7904f6d tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] HTTP exception thrown: Instance 4986a6de-1b24-42c5-942b-cd011b543cbc could not be found. Aug 31 15:57:54.109560 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a942349f-3a92-4284-a979-f590c7904f6d tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Request method failure captured: Aug 31 15:57:54.109560 n-d-850499-9 devstack@n-api.service[122256]: request: DELETE /compute/v2.1/servers/4986a6de-1b24-42c5-942b-cd011b543cbc HTTP/1.1 Aug 31 15:57:54.109560 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 15:57:54.109560 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 15:57:54.109560 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 15:57:54.109560 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 15:57:54.109560 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 15:57:54.109560 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 15:57:54.109560 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 15:57:54.109560 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 15:57:54.109560 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4TLVpymZOnvakOemdwpGBTt88XQ6FOU_DUWcqHb02xesGQpV3Ax6krnQbV92xwL-oS941HW0-PRhDxariNfReox8B4BKmg2r3s36v828sapChho_P5lNLTWoUBfIkA4hfPL85ynqdUK8nxO3GYCeYXW8nWjfKBCU4-5G78q2te3WwI Aug 31 15:57:54.109560 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 15:57:54.109560 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 15:57:54.109560 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 15:57:54.109560 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 15:57:54.109560 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 15:57:54.109560 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 15:57:54.109560 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 8dd5a49a78854f22aa3c58d01058e493 Aug 31 15:57:54.109560 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-DeleteServersAdminTestJSON-252145351 Aug 31 15:57:54.109560 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 15:57:54.109560 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 15:57:54.111057 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8dd5a49a78854f22aa3c58d01058e493"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/8dd5a49a78854f22aa3c58d01058e493"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_8dd5a49a78854f22aa3c58d01058e493", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8dd5a49a78854f22aa3c58d01058e493"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 15:57:54.111057 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-DeleteServersAdminTestJSON-252145351 Aug 31 15:57:54.111057 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 8dd5a49a78854f22aa3c58d01058e493 Aug 31 15:57:54.111057 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-252145351 Aug 31 15:57:54.111057 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-DeleteServersAdminTestJSON-252145351-project Aug 31 15:57:54.111057 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 15:57:54.111057 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 15:57:54.111057 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: fd1dfe05c037461d8dfb45a6f611ced0 Aug 31 15:57:54.111057 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-DeleteServersAdminTestJSON-252145351-project Aug 31 15:57:54.111057 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 15:57:54.111057 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance 4986a6de-1b24-42c5-942b-cd011b543cbc could not be found. Aug 31 15:57:54.111057 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '4986a6de-1b24-42c5-942b-cd011b543cbc'} Aug 31 15:57:54.111871 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:57:54.111871 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:57:54.111871 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 15:57:54.111871 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 15:57:54.111871 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 15:57:54.111871 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 15:57:54.111871 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 15:57:54.111871 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 15:57:54.111871 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 15:57:54.111871 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 15:57:54.111871 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4986a6de-1b24-42c5-942b-cd011b543cbc could not be found. Aug 31 15:57:54.111871 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:57:54.111871 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:57:54.111871 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:57:54.111871 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:57:54.111871 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:57:54.111871 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:57:54.111871 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:57:54.111871 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:57:54.111871 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:57:54.113148 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:57:54.113148 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 15:57:54.113148 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 15:57:54.113148 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 15:57:54.113148 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 15:57:54.113148 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 15:57:54.113148 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 15:57:54.113148 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 15:57:54.113148 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:57:54.113148 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4986a6de-1b24-42c5-942b-cd011b543cbc could not be found. Aug 31 15:57:54.113148 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:57:54.113148 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:57:54.113148 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:57:54.113148 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:57:54.113148 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:57:54.113148 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:57:54.113148 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:57:54.113148 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:57:54.113148 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4986a6de-1b24-42c5-942b-cd011b543cbc could not be found. Aug 31 15:57:54.113148 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:57:54.114934 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a942349f-3a92-4284-a979-f590c7904f6d tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Returning 404 to user: Instance 4986a6de-1b24-42c5-942b-cd011b543cbc could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:57:54.115834 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a942349f-3a92-4284-a979-f590c7904f6d tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] 10.222.0.61 "DELETE /compute/v2.1/servers/4986a6de-1b24-42c5-942b-cd011b543cbc" status: 404 len: 111 microversion: 2.1 time: 0.040853 Aug 31 15:57:54.116400 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 280/567] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 15:57:54 2022] DELETE /compute/v2.1/servers/4986a6de-1b24-42c5-942b-cd011b543cbc => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:57:54.125343 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d3b22338-b48c-4ba9-ab35-c3b8c953b829 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:54.125960 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d3b22338-b48c-4ba9-ab35-c3b8c953b829 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] [instance: 4986a6de-1b24-42c5-942b-cd011b543cbc] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:54.132390 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d3b22338-b48c-4ba9-ab35-c3b8c953b829 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:54.133350 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d3b22338-b48c-4ba9-ab35-c3b8c953b829 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:54.133980 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d3b22338-b48c-4ba9-ab35-c3b8c953b829 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:54.134869 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d3b22338-b48c-4ba9-ab35-c3b8c953b829 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:54.136427 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d3b22338-b48c-4ba9-ab35-c3b8c953b829 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:54.137318 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d3b22338-b48c-4ba9-ab35-c3b8c953b829 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:54.160458 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-d3b22338-b48c-4ba9-ab35-c3b8c953b829 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] HTTP exception thrown: Instance 4986a6de-1b24-42c5-942b-cd011b543cbc could not be found. Aug 31 15:57:54.162014 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d3b22338-b48c-4ba9-ab35-c3b8c953b829 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Request method failure captured: Aug 31 15:57:54.162014 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/4986a6de-1b24-42c5-942b-cd011b543cbc HTTP/1.1 Aug 31 15:57:54.162014 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 15:57:54.162014 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 15:57:54.162014 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 15:57:54.162014 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 15:57:54.162014 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 15:57:54.162014 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 15:57:54.162014 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 15:57:54.162014 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 15:57:54.162014 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4TLVpymZOnvakOemdwpGBTt88XQ6FOU_DUWcqHb02xesGQpV3Ax6krnQbV92xwL-oS941HW0-PRhDxariNfReox8B4BKmg2r3s36v828sapChho_P5lNLTWoUBfIkA4hfPL85ynqdUK8nxO3GYCeYXW8nWjfKBCU4-5G78q2te3WwI Aug 31 15:57:54.162014 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 15:57:54.162014 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 15:57:54.162014 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 15:57:54.162014 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 15:57:54.162014 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 15:57:54.162014 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 15:57:54.162014 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 8dd5a49a78854f22aa3c58d01058e493 Aug 31 15:57:54.162014 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-DeleteServersAdminTestJSON-252145351 Aug 31 15:57:54.162014 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 15:57:54.162014 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 15:57:54.163258 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8dd5a49a78854f22aa3c58d01058e493"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/8dd5a49a78854f22aa3c58d01058e493"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_8dd5a49a78854f22aa3c58d01058e493", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8dd5a49a78854f22aa3c58d01058e493"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 15:57:54.163258 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-DeleteServersAdminTestJSON-252145351 Aug 31 15:57:54.163258 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 8dd5a49a78854f22aa3c58d01058e493 Aug 31 15:57:54.163258 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-252145351 Aug 31 15:57:54.163258 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-DeleteServersAdminTestJSON-252145351-project Aug 31 15:57:54.163258 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 15:57:54.163258 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 15:57:54.163258 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: fd1dfe05c037461d8dfb45a6f611ced0 Aug 31 15:57:54.163258 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-DeleteServersAdminTestJSON-252145351-project Aug 31 15:57:54.163258 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 15:57:54.163258 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance 4986a6de-1b24-42c5-942b-cd011b543cbc could not be found. Aug 31 15:57:54.163258 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '4986a6de-1b24-42c5-942b-cd011b543cbc'} Aug 31 15:57:54.163990 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:57:54.163990 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:57:54.163990 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 15:57:54.163990 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 15:57:54.163990 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 15:57:54.163990 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 15:57:54.163990 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 15:57:54.163990 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 15:57:54.163990 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 15:57:54.163990 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 15:57:54.163990 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4986a6de-1b24-42c5-942b-cd011b543cbc could not be found. Aug 31 15:57:54.163990 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:57:54.163990 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:57:54.163990 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:57:54.163990 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:57:54.163990 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:57:54.163990 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:57:54.163990 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:57:54.163990 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:57:54.163990 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:57:54.165149 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:57:54.165149 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 15:57:54.165149 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 15:57:54.165149 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 15:57:54.165149 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 15:57:54.165149 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 15:57:54.165149 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:57:54.165149 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4986a6de-1b24-42c5-942b-cd011b543cbc could not be found. Aug 31 15:57:54.165149 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:57:54.165149 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:57:54.165149 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:57:54.165149 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:57:54.165149 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:57:54.165149 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:57:54.165149 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:57:54.165149 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:57:54.165149 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4986a6de-1b24-42c5-942b-cd011b543cbc could not be found. Aug 31 15:57:54.165149 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:57:54.166130 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d3b22338-b48c-4ba9-ab35-c3b8c953b829 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Returning 404 to user: Instance 4986a6de-1b24-42c5-942b-cd011b543cbc could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:57:54.166130 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d3b22338-b48c-4ba9-ab35-c3b8c953b829 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] 10.222.0.61 "GET /compute/v2.1/servers/4986a6de-1b24-42c5-942b-cd011b543cbc" status: 404 len: 111 microversion: 2.1 time: 0.042316 Aug 31 15:57:54.166130 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 281/568] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:54 2022] GET /compute/v2.1/servers/4986a6de-1b24-42c5-942b-cd011b543cbc => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:57:54.172717 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d775de46-0903-4c10-9ec2-647539e09a45 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:54.173424 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d775de46-0903-4c10-9ec2-647539e09a45 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] [instance: e1ca7a75-7b25-4465-b3f4-3f4d5269c723] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:54.180407 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d775de46-0903-4c10-9ec2-647539e09a45 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:54.180923 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d775de46-0903-4c10-9ec2-647539e09a45 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:54.181322 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d775de46-0903-4c10-9ec2-647539e09a45 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:54.182546 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d775de46-0903-4c10-9ec2-647539e09a45 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:54.183004 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d775de46-0903-4c10-9ec2-647539e09a45 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:54.183551 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d775de46-0903-4c10-9ec2-647539e09a45 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:54.190563 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5858c1c0-10bd-41c1-8feb-c39fd136b82f tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:54.204487 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5858c1c0-10bd-41c1-8feb-c39fd136b82f tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/2ddb0b07-9e31-403c-91d5-a278d632d754" status: 200 len: 1309 microversion: 2.1 time: 0.274496 Aug 31 15:57:54.206122 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 288/569] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:53 2022] GET /compute/v2.1/servers/2ddb0b07-9e31-403c-91d5-a278d632d754 => generated 1309 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:54.208222 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-d775de46-0903-4c10-9ec2-647539e09a45 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] HTTP exception thrown: Instance e1ca7a75-7b25-4465-b3f4-3f4d5269c723 could not be found. Aug 31 15:57:54.210236 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d775de46-0903-4c10-9ec2-647539e09a45 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Request method failure captured: Aug 31 15:57:54.210236 n-d-850499-9 devstack@n-api.service[122256]: request: DELETE /compute/v2.1/servers/e1ca7a75-7b25-4465-b3f4-3f4d5269c723 HTTP/1.1 Aug 31 15:57:54.210236 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 15:57:54.210236 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 15:57:54.210236 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 15:57:54.210236 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 15:57:54.210236 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 15:57:54.210236 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 15:57:54.210236 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 15:57:54.210236 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 15:57:54.210236 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4TLVpymZOnvakOemdwpGBTt88XQ6FOU_DUWcqHb02xesGQpV3Ax6krnQbV92xwL-oS941HW0-PRhDxariNfReox8B4BKmg2r3s36v828sapChho_P5lNLTWoUBfIkA4hfPL85ynqdUK8nxO3GYCeYXW8nWjfKBCU4-5G78q2te3WwI Aug 31 15:57:54.210236 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 15:57:54.210236 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 15:57:54.210236 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 15:57:54.210236 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 15:57:54.210236 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 15:57:54.210236 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 15:57:54.210236 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 8dd5a49a78854f22aa3c58d01058e493 Aug 31 15:57:54.210236 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-DeleteServersAdminTestJSON-252145351 Aug 31 15:57:54.210236 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 15:57:54.210236 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 15:57:54.211848 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8dd5a49a78854f22aa3c58d01058e493"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/8dd5a49a78854f22aa3c58d01058e493"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_8dd5a49a78854f22aa3c58d01058e493", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8dd5a49a78854f22aa3c58d01058e493"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 15:57:54.211848 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-DeleteServersAdminTestJSON-252145351 Aug 31 15:57:54.211848 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 8dd5a49a78854f22aa3c58d01058e493 Aug 31 15:57:54.211848 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-252145351 Aug 31 15:57:54.211848 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-DeleteServersAdminTestJSON-252145351-project Aug 31 15:57:54.211848 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 15:57:54.211848 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 15:57:54.211848 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: fd1dfe05c037461d8dfb45a6f611ced0 Aug 31 15:57:54.211848 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-DeleteServersAdminTestJSON-252145351-project Aug 31 15:57:54.211848 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 15:57:54.211848 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance e1ca7a75-7b25-4465-b3f4-3f4d5269c723 could not be found. Aug 31 15:57:54.211848 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': 'e1ca7a75-7b25-4465-b3f4-3f4d5269c723'} Aug 31 15:57:54.212669 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:57:54.212669 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:57:54.212669 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 15:57:54.212669 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 15:57:54.212669 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 15:57:54.212669 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 15:57:54.212669 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 15:57:54.212669 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 15:57:54.212669 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 15:57:54.212669 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 15:57:54.212669 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1ca7a75-7b25-4465-b3f4-3f4d5269c723 could not be found. Aug 31 15:57:54.212669 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:57:54.212669 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:57:54.212669 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:57:54.212669 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:57:54.212669 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:57:54.212669 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:57:54.212669 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:57:54.212669 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:57:54.212669 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:57:54.214169 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:57:54.214169 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 15:57:54.214169 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 15:57:54.214169 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 15:57:54.214169 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 15:57:54.214169 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 15:57:54.214169 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 15:57:54.214169 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 15:57:54.214169 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:57:54.214169 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1ca7a75-7b25-4465-b3f4-3f4d5269c723 could not be found. Aug 31 15:57:54.214169 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:57:54.214169 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:57:54.214169 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:57:54.214169 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:57:54.214169 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:57:54.214169 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:57:54.214169 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:57:54.214169 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:57:54.214169 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1ca7a75-7b25-4465-b3f4-3f4d5269c723 could not be found. Aug 31 15:57:54.214169 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:57:54.217293 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d775de46-0903-4c10-9ec2-647539e09a45 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Returning 404 to user: Instance e1ca7a75-7b25-4465-b3f4-3f4d5269c723 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:57:54.218150 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d775de46-0903-4c10-9ec2-647539e09a45 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] 10.222.0.61 "DELETE /compute/v2.1/servers/e1ca7a75-7b25-4465-b3f4-3f4d5269c723" status: 404 len: 111 microversion: 2.1 time: 0.049264 Aug 31 15:57:54.218705 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 282/570] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 15:57:54 2022] DELETE /compute/v2.1/servers/e1ca7a75-7b25-4465-b3f4-3f4d5269c723 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 15:57:54.226930 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-01bab07b-124c-4cd3-9471-cd5d4d1626c0 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:54.227895 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-01bab07b-124c-4cd3-9471-cd5d4d1626c0 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] [instance: e1ca7a75-7b25-4465-b3f4-3f4d5269c723] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:54.235611 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-01bab07b-124c-4cd3-9471-cd5d4d1626c0 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:54.236634 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-01bab07b-124c-4cd3-9471-cd5d4d1626c0 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:54.237073 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-01bab07b-124c-4cd3-9471-cd5d4d1626c0 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:54.237742 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-01bab07b-124c-4cd3-9471-cd5d4d1626c0 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:54.238221 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-01bab07b-124c-4cd3-9471-cd5d4d1626c0 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:54.238672 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-01bab07b-124c-4cd3-9471-cd5d4d1626c0 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:54.254740 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-01bab07b-124c-4cd3-9471-cd5d4d1626c0 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] HTTP exception thrown: Instance e1ca7a75-7b25-4465-b3f4-3f4d5269c723 could not be found. Aug 31 15:57:54.255965 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-01bab07b-124c-4cd3-9471-cd5d4d1626c0 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Request method failure captured: Aug 31 15:57:54.255965 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/e1ca7a75-7b25-4465-b3f4-3f4d5269c723 HTTP/1.1 Aug 31 15:57:54.255965 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 15:57:54.255965 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 15:57:54.255965 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 15:57:54.255965 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 15:57:54.255965 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 15:57:54.255965 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 15:57:54.255965 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 15:57:54.255965 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 15:57:54.255965 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4TLVpymZOnvakOemdwpGBTt88XQ6FOU_DUWcqHb02xesGQpV3Ax6krnQbV92xwL-oS941HW0-PRhDxariNfReox8B4BKmg2r3s36v828sapChho_P5lNLTWoUBfIkA4hfPL85ynqdUK8nxO3GYCeYXW8nWjfKBCU4-5G78q2te3WwI Aug 31 15:57:54.255965 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 15:57:54.255965 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 15:57:54.255965 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 15:57:54.255965 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 15:57:54.255965 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 15:57:54.255965 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 15:57:54.255965 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 8dd5a49a78854f22aa3c58d01058e493 Aug 31 15:57:54.255965 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-DeleteServersAdminTestJSON-252145351 Aug 31 15:57:54.255965 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 15:57:54.255965 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 15:57:54.257443 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8dd5a49a78854f22aa3c58d01058e493"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/8dd5a49a78854f22aa3c58d01058e493"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_8dd5a49a78854f22aa3c58d01058e493", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8dd5a49a78854f22aa3c58d01058e493"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 15:57:54.257443 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-DeleteServersAdminTestJSON-252145351 Aug 31 15:57:54.257443 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 8dd5a49a78854f22aa3c58d01058e493 Aug 31 15:57:54.257443 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-252145351 Aug 31 15:57:54.257443 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-DeleteServersAdminTestJSON-252145351-project Aug 31 15:57:54.257443 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 15:57:54.257443 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 15:57:54.257443 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: fd1dfe05c037461d8dfb45a6f611ced0 Aug 31 15:57:54.257443 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-DeleteServersAdminTestJSON-252145351-project Aug 31 15:57:54.257443 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 15:57:54.257443 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance e1ca7a75-7b25-4465-b3f4-3f4d5269c723 could not be found. Aug 31 15:57:54.257443 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': 'e1ca7a75-7b25-4465-b3f4-3f4d5269c723'} Aug 31 15:57:54.258213 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:57:54.258213 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:57:54.258213 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 15:57:54.258213 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 15:57:54.258213 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 15:57:54.258213 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 15:57:54.258213 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 15:57:54.258213 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 15:57:54.258213 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 15:57:54.258213 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 15:57:54.258213 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1ca7a75-7b25-4465-b3f4-3f4d5269c723 could not be found. Aug 31 15:57:54.258213 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:57:54.258213 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:57:54.258213 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:57:54.258213 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:57:54.258213 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:57:54.258213 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:57:54.258213 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:57:54.258213 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:57:54.258213 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:57:54.259283 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:57:54.259283 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 15:57:54.259283 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 15:57:54.259283 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 15:57:54.259283 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 15:57:54.259283 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 15:57:54.259283 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:57:54.259283 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1ca7a75-7b25-4465-b3f4-3f4d5269c723 could not be found. Aug 31 15:57:54.259283 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:57:54.259283 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:57:54.259283 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:57:54.259283 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:57:54.259283 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:57:54.259283 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:57:54.259283 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:57:54.259283 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:57:54.259283 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1ca7a75-7b25-4465-b3f4-3f4d5269c723 could not be found. Aug 31 15:57:54.259283 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:57:54.260350 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-01bab07b-124c-4cd3-9471-cd5d4d1626c0 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] Returning 404 to user: Instance e1ca7a75-7b25-4465-b3f4-3f4d5269c723 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:57:54.260350 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-01bab07b-124c-4cd3-9471-cd5d4d1626c0 tempest-DeleteServersAdminTestJSON-252145351 tempest-DeleteServersAdminTestJSON-252145351-project] 10.222.0.61 "GET /compute/v2.1/servers/e1ca7a75-7b25-4465-b3f4-3f4d5269c723" status: 404 len: 111 microversion: 2.1 time: 0.034375 Aug 31 15:57:54.260350 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 289/571] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:54 2022] GET /compute/v2.1/servers/e1ca7a75-7b25-4465-b3f4-3f4d5269c723 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 15:57:54.486485 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1b06a4d6-c90c-4b44-acc0-7a29eb8d1b8c tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:54.487406 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1b06a4d6-c90c-4b44-acc0-7a29eb8d1b8c tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] [instance: f2162319-5635-4c77-920d-9ecb3221d174] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:54.493514 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1b06a4d6-c90c-4b44-acc0-7a29eb8d1b8c tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:54.494249 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1b06a4d6-c90c-4b44-acc0-7a29eb8d1b8c tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:54.495437 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1b06a4d6-c90c-4b44-acc0-7a29eb8d1b8c tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:54.496369 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1b06a4d6-c90c-4b44-acc0-7a29eb8d1b8c tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:54.497029 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1b06a4d6-c90c-4b44-acc0-7a29eb8d1b8c tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:54.497648 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1b06a4d6-c90c-4b44-acc0-7a29eb8d1b8c tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:54.566341 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1b06a4d6-c90c-4b44-acc0-7a29eb8d1b8c tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:54.577611 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1b06a4d6-c90c-4b44-acc0-7a29eb8d1b8c tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:54.579431 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1b06a4d6-c90c-4b44-acc0-7a29eb8d1b8c tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:54.584844 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1b06a4d6-c90c-4b44-acc0-7a29eb8d1b8c tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] 10.222.0.61 "GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174" status: 200 len: 1444 microversion: 2.75 time: 0.102392 Aug 31 15:57:54.585687 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 283/572] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:54 2022] GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174 => generated 1444 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:57:54.680770 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-762e56de-af5d-400d-aa63-db29e83589ee tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Calling method '.version_select at 0x7f5ae93330d0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:54.735220 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-15f7a46b-753c-4740-bb5a-9c9483835a1d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:54.736491 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-15f7a46b-753c-4740-bb5a-9c9483835a1d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 79ee7e24-93df-450b-9030-b08c00d019eb] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:54.743782 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-15f7a46b-753c-4740-bb5a-9c9483835a1d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:54.744861 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-15f7a46b-753c-4740-bb5a-9c9483835a1d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:54.745494 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-15f7a46b-753c-4740-bb5a-9c9483835a1d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:54.746405 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-15f7a46b-753c-4740-bb5a-9c9483835a1d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:54.747016 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-15f7a46b-753c-4740-bb5a-9c9483835a1d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:54.747625 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-15f7a46b-753c-4740-bb5a-9c9483835a1d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:54.783444 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-762e56de-af5d-400d-aa63-db29e83589ee tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] 10.222.0.61 "GET /compute/v2.1/images/774b58aa-38b5-446e-b72b-0fab93b7abf3" status: 200 len: 1428 microversion: 2.1 time: 0.106573 Aug 31 15:57:54.792528 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 290/573] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 15:57:54 2022] GET /compute/v2.1/images/774b58aa-38b5-446e-b72b-0fab93b7abf3 => generated 1428 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:54.941787 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2f771f0d-6d0d-413b-9476-af10f61ef638 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:54.942342 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2f771f0d-6d0d-413b-9476-af10f61ef638 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] [instance: f977bd90-3cd4-4b07-87f9-42e26b8a530a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:54.949953 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2f771f0d-6d0d-413b-9476-af10f61ef638 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:54.950689 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2f771f0d-6d0d-413b-9476-af10f61ef638 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:54.951343 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2f771f0d-6d0d-413b-9476-af10f61ef638 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:54.952081 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2f771f0d-6d0d-413b-9476-af10f61ef638 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:54.952621 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2f771f0d-6d0d-413b-9476-af10f61ef638 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:54.953041 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2f771f0d-6d0d-413b-9476-af10f61ef638 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:54.968840 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-15f7a46b-753c-4740-bb5a-9c9483835a1d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:54.983595 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-15f7a46b-753c-4740-bb5a-9c9483835a1d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:54.985141 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-15f7a46b-753c-4740-bb5a-9c9483835a1d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:54.986368 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-15f7a46b-753c-4740-bb5a-9c9483835a1d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/79ee7e24-93df-450b-9030-b08c00d019eb" status: 200 len: 1567 microversion: 2.25 time: 0.258741 Aug 31 15:57:55.003527 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 284/574] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:54 2022] GET /compute/v2.1/servers/79ee7e24-93df-450b-9030-b08c00d019eb => generated 1567 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:57:55.035197 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2f771f0d-6d0d-413b-9476-af10f61ef638 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba336e5ac684606b5e0123e454f9a60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad48220bc634a6186547269011ec49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:55.048129 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2f771f0d-6d0d-413b-9476-af10f61ef638 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] 10.222.0.61 "GET /compute/v2.1/servers/f977bd90-3cd4-4b07-87f9-42e26b8a530a" status: 200 len: 1209 microversion: 2.1 time: 0.111316 Aug 31 15:57:55.048801 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 291/575] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:54 2022] GET /compute/v2.1/servers/f977bd90-3cd4-4b07-87f9-42e26b8a530a => generated 1209 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:57:55.079457 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2fd1f42f-b2f2-48ba-a1c9-20e6f21a1d1c tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:55.080254 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2fd1f42f-b2f2-48ba-a1c9-20e6f21a1d1c tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] [instance: 68edc4cf-5ffe-47e3-89d0-4e4fa7aebca2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:55.121326 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2fd1f42f-b2f2-48ba-a1c9-20e6f21a1d1c tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:55.121924 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2fd1f42f-b2f2-48ba-a1c9-20e6f21a1d1c tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:55.122919 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2fd1f42f-b2f2-48ba-a1c9-20e6f21a1d1c tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:55.124126 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2fd1f42f-b2f2-48ba-a1c9-20e6f21a1d1c tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:55.131491 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2fd1f42f-b2f2-48ba-a1c9-20e6f21a1d1c tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:55.133020 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2fd1f42f-b2f2-48ba-a1c9-20e6f21a1d1c tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:55.236538 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-60560444-fd83-4481-abc6-f229c9e64558 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:55.237205 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-60560444-fd83-4481-abc6-f229c9e64558 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: 2ddb0b07-9e31-403c-91d5-a278d632d754] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:55.258150 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-60560444-fd83-4481-abc6-f229c9e64558 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:55.262345 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-60560444-fd83-4481-abc6-f229c9e64558 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:55.264955 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-60560444-fd83-4481-abc6-f229c9e64558 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:55.266899 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-60560444-fd83-4481-abc6-f229c9e64558 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:55.268255 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-60560444-fd83-4481-abc6-f229c9e64558 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:55.269091 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-60560444-fd83-4481-abc6-f229c9e64558 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:55.387930 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-2fd1f42f-b2f2-48ba-a1c9-20e6f21a1d1c tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad29bb9427d446ee8c0d237b218ac2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da6682c394444a1a286232fc0c2683d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:55.401512 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2fd1f42f-b2f2-48ba-a1c9-20e6f21a1d1c tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] 10.222.0.61 "GET /compute/v2.1/servers/68edc4cf-5ffe-47e3-89d0-4e4fa7aebca2" status: 200 len: 1323 microversion: 2.1 time: 0.325309 Aug 31 15:57:55.402598 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 285/576] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:55 2022] GET /compute/v2.1/servers/68edc4cf-5ffe-47e3-89d0-4e4fa7aebca2 => generated 1323 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:55.522091 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-60c50f58-3e9d-43ea-a75c-1b8b352e2e8e req-27cf4ddc-49b0-44fa-9ca8-656cb033067b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68edc4cf-5ffe-47e3-89d0-4e4fa7aebca2", "name": "network-vif-plugged", "status": "completed", "tag": "ba8ded58-5868-4341-b926-2dbd9dcb0b3a"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:57:55.537128 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=12 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:57:55.540715 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=75,nova_cell0:UPDATE=7 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:57:55.555102 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-60c50f58-3e9d-43ea-a75c-1b8b352e2e8e req-27cf4ddc-49b0-44fa-9ca8-656cb033067b service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:55.559973 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-60c50f58-3e9d-43ea-a75c-1b8b352e2e8e req-27cf4ddc-49b0-44fa-9ca8-656cb033067b service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:55.561673 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-60c50f58-3e9d-43ea-a75c-1b8b352e2e8e req-27cf4ddc-49b0-44fa-9ca8-656cb033067b service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:55.579047 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-60560444-fd83-4481-abc6-f229c9e64558 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:55.593345 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-60c50f58-3e9d-43ea-a75c-1b8b352e2e8e req-27cf4ddc-49b0-44fa-9ca8-656cb033067b service nova] Creating event network-vif-plugged:ba8ded58-5868-4341-b926-2dbd9dcb0b3a for instance 68edc4cf-5ffe-47e3-89d0-4e4fa7aebca2 on n-h1-850499-9 Aug 31 15:57:55.595589 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-60560444-fd83-4481-abc6-f229c9e64558 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/2ddb0b07-9e31-403c-91d5-a278d632d754" status: 200 len: 1309 microversion: 2.1 time: 0.372589 Aug 31 15:57:55.597431 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 292/577] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:55 2022] GET /compute/v2.1/servers/2ddb0b07-9e31-403c-91d5-a278d632d754 => generated 1309 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:55.602980 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-60c50f58-3e9d-43ea-a75c-1b8b352e2e8e req-27cf4ddc-49b0-44fa-9ca8-656cb033067b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084905 Aug 31 15:57:55.604231 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 286/578] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 15:57:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:57:55.612313 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-543af546-5af0-43f2-a453-c29a2fc52632 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:55.613220 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-543af546-5af0-43f2-a453-c29a2fc52632 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] [instance: f2162319-5635-4c77-920d-9ecb3221d174] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:55.623017 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-543af546-5af0-43f2-a453-c29a2fc52632 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:55.623538 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-543af546-5af0-43f2-a453-c29a2fc52632 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:55.623978 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-543af546-5af0-43f2-a453-c29a2fc52632 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:55.624689 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-543af546-5af0-43f2-a453-c29a2fc52632 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:55.625146 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-543af546-5af0-43f2-a453-c29a2fc52632 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:55.625552 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-543af546-5af0-43f2-a453-c29a2fc52632 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:55.728194 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-543af546-5af0-43f2-a453-c29a2fc52632 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:55.738680 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-543af546-5af0-43f2-a453-c29a2fc52632 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:55.740170 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-543af546-5af0-43f2-a453-c29a2fc52632 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:55.746041 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-543af546-5af0-43f2-a453-c29a2fc52632 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] 10.222.0.61 "GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174" status: 200 len: 1444 microversion: 2.75 time: 0.137955 Aug 31 15:57:55.746619 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 293/579] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:55 2022] GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174 => generated 1444 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:57:55.798725 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9a059cbb-1d7e-4bdf-b2e8-275e40c9e9fd tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Calling method '.version_select at 0x7f5ae9367670>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:55.859372 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9a059cbb-1d7e-4bdf-b2e8-275e40c9e9fd tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] 10.222.0.61 "GET /compute/v2.1/images/774b58aa-38b5-446e-b72b-0fab93b7abf3" status: 200 len: 1428 microversion: 2.1 time: 0.064737 Aug 31 15:57:55.859982 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 287/580] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 15:57:55 2022] GET /compute/v2.1/images/774b58aa-38b5-446e-b72b-0fab93b7abf3 => generated 1428 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:56.015367 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-64757b5b-cab2-4154-aba9-d10fcf25fad9 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:56.016464 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-64757b5b-cab2-4154-aba9-d10fcf25fad9 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 79ee7e24-93df-450b-9030-b08c00d019eb] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:56.030649 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-64757b5b-cab2-4154-aba9-d10fcf25fad9 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:56.031158 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-64757b5b-cab2-4154-aba9-d10fcf25fad9 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:56.031623 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-64757b5b-cab2-4154-aba9-d10fcf25fad9 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:56.034030 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-64757b5b-cab2-4154-aba9-d10fcf25fad9 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:56.036202 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-64757b5b-cab2-4154-aba9-d10fcf25fad9 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:56.036827 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-64757b5b-cab2-4154-aba9-d10fcf25fad9 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:56.071362 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ad854f96-a1dc-45c7-ad78-ec141463da80 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:56.072456 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ad854f96-a1dc-45c7-ad78-ec141463da80 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] [instance: f977bd90-3cd4-4b07-87f9-42e26b8a530a] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:56.083662 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ad854f96-a1dc-45c7-ad78-ec141463da80 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:56.084789 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ad854f96-a1dc-45c7-ad78-ec141463da80 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:56.085568 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ad854f96-a1dc-45c7-ad78-ec141463da80 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:56.087792 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ad854f96-a1dc-45c7-ad78-ec141463da80 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:56.089175 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ad854f96-a1dc-45c7-ad78-ec141463da80 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:56.091727 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ad854f96-a1dc-45c7-ad78-ec141463da80 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:56.241317 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ad854f96-a1dc-45c7-ad78-ec141463da80 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba336e5ac684606b5e0123e454f9a60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad48220bc634a6186547269011ec49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:56.252528 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ad854f96-a1dc-45c7-ad78-ec141463da80 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] 10.222.0.61 "GET /compute/v2.1/servers/f977bd90-3cd4-4b07-87f9-42e26b8a530a" status: 200 len: 1265 microversion: 2.1 time: 0.186124 Aug 31 15:57:56.273693 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 288/581] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:56 2022] GET /compute/v2.1/servers/f977bd90-3cd4-4b07-87f9-42e26b8a530a => generated 1265 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:56.349681 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-64757b5b-cab2-4154-aba9-d10fcf25fad9 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:56.360826 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-64757b5b-cab2-4154-aba9-d10fcf25fad9 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:56.363733 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-64757b5b-cab2-4154-aba9-d10fcf25fad9 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:56.365859 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-64757b5b-cab2-4154-aba9-d10fcf25fad9 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/79ee7e24-93df-450b-9030-b08c00d019eb" status: 200 len: 1567 microversion: 2.25 time: 0.356752 Aug 31 15:57:56.371060 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 294/582] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:56 2022] GET /compute/v2.1/servers/79ee7e24-93df-450b-9030-b08c00d019eb => generated 1567 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 15:57:56.423209 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-41e67e61-1d91-48ca-961f-8121a3dfb17c tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:56.424181 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-41e67e61-1d91-48ca-961f-8121a3dfb17c tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] [instance: 68edc4cf-5ffe-47e3-89d0-4e4fa7aebca2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:56.437307 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-41e67e61-1d91-48ca-961f-8121a3dfb17c tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:56.438480 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-41e67e61-1d91-48ca-961f-8121a3dfb17c tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:56.440065 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-41e67e61-1d91-48ca-961f-8121a3dfb17c tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:56.442996 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-41e67e61-1d91-48ca-961f-8121a3dfb17c tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:56.443905 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-41e67e61-1d91-48ca-961f-8121a3dfb17c tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:56.444515 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-41e67e61-1d91-48ca-961f-8121a3dfb17c tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:56.621043 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0915310c-45b6-4339-9d5c-3976f8d6f5ce tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:56.621667 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0915310c-45b6-4339-9d5c-3976f8d6f5ce tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: 2ddb0b07-9e31-403c-91d5-a278d632d754] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:56.651445 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0915310c-45b6-4339-9d5c-3976f8d6f5ce tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:56.652120 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0915310c-45b6-4339-9d5c-3976f8d6f5ce tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:56.652571 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0915310c-45b6-4339-9d5c-3976f8d6f5ce tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:56.653311 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0915310c-45b6-4339-9d5c-3976f8d6f5ce tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:56.653764 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0915310c-45b6-4339-9d5c-3976f8d6f5ce tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:56.660859 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0915310c-45b6-4339-9d5c-3976f8d6f5ce tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:56.949538 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-41e67e61-1d91-48ca-961f-8121a3dfb17c tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad29bb9427d446ee8c0d237b218ac2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da6682c394444a1a286232fc0c2683d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:56.967375 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-41e67e61-1d91-48ca-961f-8121a3dfb17c tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] 10.222.0.61 "GET /compute/v2.1/servers/68edc4cf-5ffe-47e3-89d0-4e4fa7aebca2" status: 200 len: 1323 microversion: 2.1 time: 0.547726 Aug 31 15:57:56.968306 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 289/583] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:56 2022] GET /compute/v2.1/servers/68edc4cf-5ffe-47e3-89d0-4e4fa7aebca2 => generated 1323 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:56.977500 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3cf29783-7314-4c61-bc13-1160b9989428 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:56.978249 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3cf29783-7314-4c61-bc13-1160b9989428 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] [instance: f2162319-5635-4c77-920d-9ecb3221d174] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:56.985249 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3cf29783-7314-4c61-bc13-1160b9989428 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:56.985824 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3cf29783-7314-4c61-bc13-1160b9989428 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:56.986336 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3cf29783-7314-4c61-bc13-1160b9989428 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:56.987108 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3cf29783-7314-4c61-bc13-1160b9989428 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:56.987942 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3cf29783-7314-4c61-bc13-1160b9989428 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:56.988524 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3cf29783-7314-4c61-bc13-1160b9989428 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:57.038005 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3cf29783-7314-4c61-bc13-1160b9989428 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:57.038706 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3cf29783-7314-4c61-bc13-1160b9989428 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:57.039791 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3cf29783-7314-4c61-bc13-1160b9989428 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:57.040471 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-3cf29783-7314-4c61-bc13-1160b9989428 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lazy-loading 'fault' on Instance uuid f2162319-5635-4c77-920d-9ecb3221d174 {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:57:57.174428 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3cf29783-7314-4c61-bc13-1160b9989428 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:57.184907 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3cf29783-7314-4c61-bc13-1160b9989428 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:57.187465 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3cf29783-7314-4c61-bc13-1160b9989428 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '887c3d4e70ed4a8192eff4beecb58db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7215005b204d402fa6d443359e7d1ba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:57.193690 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3cf29783-7314-4c61-bc13-1160b9989428 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] 10.222.0.61 "GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174" status: 200 len: 1449 microversion: 2.75 time: 0.224420 Aug 31 15:57:57.194560 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 290/584] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:56 2022] GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174 => generated 1449 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:57:57.206994 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-456446a6-6660-4078-802e-0c09bd3d2d72 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Calling method '.version_select at 0x7f5ae9378b80>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:57.230765 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0915310c-45b6-4339-9d5c-3976f8d6f5ce tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:57.242322 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0915310c-45b6-4339-9d5c-3976f8d6f5ce tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/2ddb0b07-9e31-403c-91d5-a278d632d754" status: 200 len: 1309 microversion: 2.1 time: 0.627477 Aug 31 15:57:57.256987 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 295/585] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:56 2022] GET /compute/v2.1/servers/2ddb0b07-9e31-403c-91d5-a278d632d754 => generated 1309 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:57.278575 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-be091e8a-7c32-4324-b6ea-c0a6a675d3d1 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:57.290118 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-456446a6-6660-4078-802e-0c09bd3d2d72 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] 10.222.0.61 "GET /compute/v2.1/images/774b58aa-38b5-446e-b72b-0fab93b7abf3" status: 200 len: 1437 microversion: 2.1 time: 0.092616 Aug 31 15:57:57.290625 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 291/586] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 15:57:57 2022] GET /compute/v2.1/images/774b58aa-38b5-446e-b72b-0fab93b7abf3 => generated 1437 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:57.292254 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-be091e8a-7c32-4324-b6ea-c0a6a675d3d1 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] [instance: f977bd90-3cd4-4b07-87f9-42e26b8a530a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:57.303104 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-be091e8a-7c32-4324-b6ea-c0a6a675d3d1 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:57.304103 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-be091e8a-7c32-4324-b6ea-c0a6a675d3d1 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:57.304734 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-be091e8a-7c32-4324-b6ea-c0a6a675d3d1 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:57.305656 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-be091e8a-7c32-4324-b6ea-c0a6a675d3d1 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:57.306304 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-be091e8a-7c32-4324-b6ea-c0a6a675d3d1 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:57.306987 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-be091e8a-7c32-4324-b6ea-c0a6a675d3d1 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:57.309606 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d08da11a-48a3-4b73-993c-89228251dfc1 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Calling method '.version_select at 0x7f5ae9382550>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:57.408194 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d08da11a-48a3-4b73-993c-89228251dfc1 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] 10.222.0.61 "GET /compute/v2.1/images/774b58aa-38b5-446e-b72b-0fab93b7abf3" status: 200 len: 1437 microversion: 2.1 time: 0.106942 Aug 31 15:57:57.411781 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 292/587] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 15:57:57 2022] GET /compute/v2.1/images/774b58aa-38b5-446e-b72b-0fab93b7abf3 => generated 1437 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:57.419656 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-cd77617c-705c-4937-ae48-5520e4a808b7 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:57.423095 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-cd77617c-705c-4937-ae48-5520e4a808b7 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 79ee7e24-93df-450b-9030-b08c00d019eb] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:57.437949 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cd77617c-705c-4937-ae48-5520e4a808b7 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:57.438464 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cd77617c-705c-4937-ae48-5520e4a808b7 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:57.438907 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cd77617c-705c-4937-ae48-5520e4a808b7 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:57.439654 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cd77617c-705c-4937-ae48-5520e4a808b7 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:57.440121 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cd77617c-705c-4937-ae48-5520e4a808b7 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:57.440555 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cd77617c-705c-4937-ae48-5520e4a808b7 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:57.665533 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-be091e8a-7c32-4324-b6ea-c0a6a675d3d1 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba336e5ac684606b5e0123e454f9a60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad48220bc634a6186547269011ec49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:57.675458 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-be091e8a-7c32-4324-b6ea-c0a6a675d3d1 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] 10.222.0.61 "GET /compute/v2.1/servers/f977bd90-3cd4-4b07-87f9-42e26b8a530a" status: 200 len: 1271 microversion: 2.1 time: 0.404273 Aug 31 15:57:57.676104 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 296/588] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:57 2022] GET /compute/v2.1/servers/f977bd90-3cd4-4b07-87f9-42e26b8a530a => generated 1271 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:57.688990 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9612390a-da90-4e14-b29a-2c5f2aa4a0f7 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:57.690287 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9612390a-da90-4e14-b29a-2c5f2aa4a0f7 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] [instance: 1b233a49-d4f5-412d-8239-74df4ce63aa5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:57.693848 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:57:57.701299 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9612390a-da90-4e14-b29a-2c5f2aa4a0f7 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:57.701904 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9612390a-da90-4e14-b29a-2c5f2aa4a0f7 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:57.702459 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9612390a-da90-4e14-b29a-2c5f2aa4a0f7 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:57.703434 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9612390a-da90-4e14-b29a-2c5f2aa4a0f7 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:57.704022 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9612390a-da90-4e14-b29a-2c5f2aa4a0f7 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:57.704925 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9612390a-da90-4e14-b29a-2c5f2aa4a0f7 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:57.921621 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-cd77617c-705c-4937-ae48-5520e4a808b7 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:57.933720 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-cd77617c-705c-4937-ae48-5520e4a808b7 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:57.935293 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-cd77617c-705c-4937-ae48-5520e4a808b7 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:57.936595 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-cd77617c-705c-4937-ae48-5520e4a808b7 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/79ee7e24-93df-450b-9030-b08c00d019eb" status: 200 len: 1567 microversion: 2.25 time: 0.523509 Aug 31 15:57:57.937390 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 293/589] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:57 2022] GET /compute/v2.1/servers/79ee7e24-93df-450b-9030-b08c00d019eb => generated 1567 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:57:57.989222 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-21b16651-051f-4532-9d20-6cea7a56c92f tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:57.990003 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-21b16651-051f-4532-9d20-6cea7a56c92f tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] [instance: 68edc4cf-5ffe-47e3-89d0-4e4fa7aebca2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:57.997801 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-21b16651-051f-4532-9d20-6cea7a56c92f tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:57.998712 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-21b16651-051f-4532-9d20-6cea7a56c92f tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:57.999407 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-21b16651-051f-4532-9d20-6cea7a56c92f tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:58.000391 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-21b16651-051f-4532-9d20-6cea7a56c92f tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:58.000861 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-21b16651-051f-4532-9d20-6cea7a56c92f tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:58.001296 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-21b16651-051f-4532-9d20-6cea7a56c92f tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:58.184671 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9612390a-da90-4e14-b29a-2c5f2aa4a0f7 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc04be9f46432fb954d7dbcfe53488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f665e5697c4453c872940b4c0a88772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:58.193425 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9612390a-da90-4e14-b29a-2c5f2aa4a0f7 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] 10.222.0.61 "GET /compute/v2.1/servers/1b233a49-d4f5-412d-8239-74df4ce63aa5" status: 200 len: 1466 microversion: 2.1 time: 0.516017 Aug 31 15:57:58.194821 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 297/590] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:57 2022] GET /compute/v2.1/servers/1b233a49-d4f5-412d-8239-74df4ce63aa5 => generated 1466 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:58.386339 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b1eabf8e-9714-42b0-a252-aadf8c9a80be tempest-FlavorsAdminTestJSON-1959651762 tempest-FlavorsAdminTestJSON-1959651762-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-2001707920", "id": 1217521507, "os-flavor-access:is_public": "True"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:57:58.409235 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b1eabf8e-9714-42b0-a252-aadf8c9a80be tempest-FlavorsAdminTestJSON-1959651762 tempest-FlavorsAdminTestJSON-1959651762-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.213187 Aug 31 15:57:58.410091 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 298/591] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 15:57:58 2022] POST /compute/v2.1/flavors => generated 430 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:57:58.414920 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-eef4036c-bf2b-42e6-8a45-1674178017a2 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:58.415806 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-eef4036c-bf2b-42e6-8a45-1674178017a2 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] [instance: f2162319-5635-4c77-920d-9ecb3221d174] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:58.422631 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eef4036c-bf2b-42e6-8a45-1674178017a2 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:58.423339 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eef4036c-bf2b-42e6-8a45-1674178017a2 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:58.424950 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eef4036c-bf2b-42e6-8a45-1674178017a2 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:58.426022 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eef4036c-bf2b-42e6-8a45-1674178017a2 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:58.426595 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eef4036c-bf2b-42e6-8a45-1674178017a2 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:58.427024 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eef4036c-bf2b-42e6-8a45-1674178017a2 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:58.445102 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-eef4036c-bf2b-42e6-8a45-1674178017a2 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] HTTP exception thrown: Instance f2162319-5635-4c77-920d-9ecb3221d174 could not be found. Aug 31 15:57:58.447842 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-eef4036c-bf2b-42e6-8a45-1674178017a2 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Request method failure captured: Aug 31 15:57:58.447842 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174 HTTP/1.1 Aug 31 15:57:58.447842 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 15:57:58.447842 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 15:57:58.447842 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 15:57:58.447842 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 15:57:58.447842 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 15:57:58.447842 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 15:57:58.447842 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 15:57:58.447842 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 15:57:58.447842 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4SRb8AK9lfIsQAVuF0XTu3LOYHNxcHm-XuGavXz8ymNS-hyGyryTT776bUIOV0fFvmbIya-4n8XlG3wKUc8x1liax7c_ZOiSvmc88AHrQ9j-Mz9T-JVQpTM70646-_1yy2MIBhbp9vWBLVutEa1IsKch4S01nHMu1BhOBFhr55e4xs Aug 31 15:57:58.447842 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 15:57:58.447842 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 15:57:58.447842 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 15:57:58.447842 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 15:57:58.447842 n-d-850499-9 devstack@n-api.service[122257]: X-Openstack-Nova-Api-Version: 2.75 Aug 31 15:57:58.447842 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 15:57:58.447842 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 15:57:58.447842 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 7215005b204d402fa6d443359e7d1ba6 Aug 31 15:57:58.447842 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ServersAdmin275Test-1074406651 Aug 31 15:57:58.447842 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 15:57:58.447842 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 15:57:58.449672 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7215005b204d402fa6d443359e7d1ba6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7215005b204d402fa6d443359e7d1ba6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7215005b204d402fa6d443359e7d1ba6", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7215005b204d402fa6d443359e7d1ba6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 15:57:58.449672 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ServersAdmin275Test-1074406651 Aug 31 15:57:58.449672 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 7215005b204d402fa6d443359e7d1ba6 Aug 31 15:57:58.449672 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ServersAdmin275Test-1074406651 Aug 31 15:57:58.449672 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ServersAdmin275Test-1074406651-project Aug 31 15:57:58.449672 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 15:57:58.449672 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 15:57:58.449672 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 887c3d4e70ed4a8192eff4beecb58db5 Aug 31 15:57:58.449672 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ServersAdmin275Test-1074406651-project Aug 31 15:57:58.449672 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 15:57:58.449672 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance f2162319-5635-4c77-920d-9ecb3221d174 could not be found. Aug 31 15:57:58.449672 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': 'f2162319-5635-4c77-920d-9ecb3221d174'} Aug 31 15:57:58.450429 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:57:58.450429 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:57:58.450429 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 15:57:58.450429 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 15:57:58.450429 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 15:57:58.450429 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 15:57:58.450429 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 15:57:58.450429 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 15:57:58.450429 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 15:57:58.450429 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 15:57:58.450429 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2162319-5635-4c77-920d-9ecb3221d174 could not be found. Aug 31 15:57:58.450429 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:57:58.450429 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:57:58.450429 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:57:58.450429 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:57:58.450429 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:57:58.450429 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:57:58.450429 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:57:58.450429 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:57:58.450429 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:57:58.451617 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:57:58.451617 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 15:57:58.451617 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 15:57:58.451617 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 15:57:58.451617 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 15:57:58.451617 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 15:57:58.451617 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:57:58.451617 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2162319-5635-4c77-920d-9ecb3221d174 could not be found. Aug 31 15:57:58.451617 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:57:58.451617 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:57:58.451617 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:57:58.451617 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:57:58.451617 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:57:58.451617 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:57:58.451617 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:57:58.451617 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:57:58.451617 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2162319-5635-4c77-920d-9ecb3221d174 could not be found. Aug 31 15:57:58.451617 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:57:58.454526 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-eef4036c-bf2b-42e6-8a45-1674178017a2 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] Returning 404 to user: Instance f2162319-5635-4c77-920d-9ecb3221d174 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:57:58.456991 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-eef4036c-bf2b-42e6-8a45-1674178017a2 tempest-ServersAdmin275Test-1074406651 tempest-ServersAdmin275Test-1074406651-project] 10.222.0.61 "GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174" status: 404 len: 111 microversion: 2.75 time: 0.045522 Aug 31 15:57:58.458152 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 299/592] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:58 2022] GET /compute/v2.1/servers/f2162319-5635-4c77-920d-9ecb3221d174 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 15:57:58.465210 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5771479b-bb74-4486-9ace-70d488642c8c tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Calling method '.version_select at 0x7f5ae93ee3a0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:58.664193 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-21b16651-051f-4532-9d20-6cea7a56c92f tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad29bb9427d446ee8c0d237b218ac2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da6682c394444a1a286232fc0c2683d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:58.691967 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-21b16651-051f-4532-9d20-6cea7a56c92f tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] 10.222.0.61 "GET /compute/v2.1/servers/68edc4cf-5ffe-47e3-89d0-4e4fa7aebca2" status: 200 len: 1323 microversion: 2.1 time: 0.704357 Aug 31 15:57:58.692794 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 294/593] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:57 2022] GET /compute/v2.1/servers/68edc4cf-5ffe-47e3-89d0-4e4fa7aebca2 => generated 1323 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:57:58.718766 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4675c7d7-f5ab-4249-b300-32e6bd3fdd49 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:58.720518 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4675c7d7-f5ab-4249-b300-32e6bd3fdd49 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: 2ddb0b07-9e31-403c-91d5-a278d632d754] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:58.732160 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4675c7d7-f5ab-4249-b300-32e6bd3fdd49 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:58.732675 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4675c7d7-f5ab-4249-b300-32e6bd3fdd49 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:58.733351 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4675c7d7-f5ab-4249-b300-32e6bd3fdd49 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:58.734077 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4675c7d7-f5ab-4249-b300-32e6bd3fdd49 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:58.734547 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4675c7d7-f5ab-4249-b300-32e6bd3fdd49 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:58.735101 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4675c7d7-f5ab-4249-b300-32e6bd3fdd49 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:59.041563 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-4675c7d7-f5ab-4249-b300-32e6bd3fdd49 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:59.056093 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4675c7d7-f5ab-4249-b300-32e6bd3fdd49 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/2ddb0b07-9e31-403c-91d5-a278d632d754" status: 200 len: 1309 microversion: 2.1 time: 0.361908 Aug 31 15:57:59.057617 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 295/594] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:58 2022] GET /compute/v2.1/servers/2ddb0b07-9e31-403c-91d5-a278d632d754 => generated 1309 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:59.072003 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ab4ca958-2513-4145-b20b-f195d56efd9d tempest-FlavorsAdminTestJSON-1959651762 tempest-FlavorsAdminTestJSON-1959651762-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:59.115918 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ab4ca958-2513-4145-b20b-f195d56efd9d tempest-FlavorsAdminTestJSON-1959651762 tempest-FlavorsAdminTestJSON-1959651762-project-admin] 10.222.0.61 "DELETE /compute/v2.1/flavors/1217521507" status: 202 len: 0 microversion: 2.1 time: 0.056896 Aug 31 15:57:59.117348 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 296/595] 10.222.0.61 () {58 vars in 1161 bytes} [Wed Aug 31 15:57:59 2022] DELETE /compute/v2.1/flavors/1217521507 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 15:57:59.128764 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-517c025f-c690-4bdc-a4a3-def6f7ba0938 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:59.129385 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-517c025f-c690-4bdc-a4a3-def6f7ba0938 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] [instance: f977bd90-3cd4-4b07-87f9-42e26b8a530a] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:59.142914 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-517c025f-c690-4bdc-a4a3-def6f7ba0938 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:59.144242 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-517c025f-c690-4bdc-a4a3-def6f7ba0938 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:59.145049 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-517c025f-c690-4bdc-a4a3-def6f7ba0938 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:59.146554 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-517c025f-c690-4bdc-a4a3-def6f7ba0938 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:59.147254 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-517c025f-c690-4bdc-a4a3-def6f7ba0938 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:59.147951 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-517c025f-c690-4bdc-a4a3-def6f7ba0938 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:59.249282 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-517c025f-c690-4bdc-a4a3-def6f7ba0938 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba336e5ac684606b5e0123e454f9a60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad48220bc634a6186547269011ec49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:59.270530 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-517c025f-c690-4bdc-a4a3-def6f7ba0938 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] 10.222.0.61 "GET /compute/v2.1/servers/f977bd90-3cd4-4b07-87f9-42e26b8a530a" status: 200 len: 1271 microversion: 2.1 time: 0.151469 Aug 31 15:57:59.271818 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 297/596] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:59 2022] GET /compute/v2.1/servers/f977bd90-3cd4-4b07-87f9-42e26b8a530a => generated 1271 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:59.280883 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-743f07b9-e28e-4927-8b2d-92346b163c1f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:59.281961 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-743f07b9-e28e-4927-8b2d-92346b163c1f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 79ee7e24-93df-450b-9030-b08c00d019eb] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:59.296304 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-743f07b9-e28e-4927-8b2d-92346b163c1f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:59.297316 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-743f07b9-e28e-4927-8b2d-92346b163c1f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:59.303907 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-743f07b9-e28e-4927-8b2d-92346b163c1f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:59.306768 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-743f07b9-e28e-4927-8b2d-92346b163c1f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:59.308553 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-743f07b9-e28e-4927-8b2d-92346b163c1f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:59.309848 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-743f07b9-e28e-4927-8b2d-92346b163c1f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:59.573711 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5771479b-bb74-4486-9ace-70d488642c8c tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] 10.222.0.61 "DELETE /compute/v2.1/images/774b58aa-38b5-446e-b72b-0fab93b7abf3" status: 204 len: 0 microversion: 2.1 time: 1.112417 Aug 31 15:57:59.575851 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 300/597] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:58 2022] DELETE /compute/v2.1/images/774b58aa-38b5-446e-b72b-0fab93b7abf3 => generated 0 bytes in 1116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 15:57:59.582630 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f7832d1d-dfa9-41a4-b2f4-3df24f031cee tempest-FlavorsAdminTestJSON-1959651762 tempest-FlavorsAdminTestJSON-1959651762-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:59.613846 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f7832d1d-dfa9-41a4-b2f4-3df24f031cee tempest-FlavorsAdminTestJSON-1959651762 tempest-FlavorsAdminTestJSON-1959651762-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.036633 Aug 31 15:57:59.614447 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 301/598] 10.222.0.61 () {58 vars in 1146 bytes} [Wed Aug 31 15:57:59 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:59.624716 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-e02b56ae-2756-44f5-8d03-28337aff0349 req-41edd9d5-2af3-4174-b586-f5853b286b77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ddb0b07-9e31-403c-91d5-a278d632d754", "name": "network-vif-plugged", "status": "completed", "tag": "e7598456-3858-4c71-8638-c50e65f3fc7a"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:57:59.641701 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-e02b56ae-2756-44f5-8d03-28337aff0349 req-41edd9d5-2af3-4174-b586-f5853b286b77 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:59.642436 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-e02b56ae-2756-44f5-8d03-28337aff0349 req-41edd9d5-2af3-4174-b586-f5853b286b77 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:59.643020 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-e02b56ae-2756-44f5-8d03-28337aff0349 req-41edd9d5-2af3-4174-b586-f5853b286b77 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:59.678754 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-e02b56ae-2756-44f5-8d03-28337aff0349 req-41edd9d5-2af3-4174-b586-f5853b286b77 service nova] Creating event network-vif-plugged:e7598456-3858-4c71-8638-c50e65f3fc7a for instance 2ddb0b07-9e31-403c-91d5-a278d632d754 on n-h1-850499-9 Aug 31 15:57:59.697681 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-e02b56ae-2756-44f5-8d03-28337aff0349 req-41edd9d5-2af3-4174-b586-f5853b286b77 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081767 Aug 31 15:57:59.698683 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 302/599] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 15:57:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:57:59.705363 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7b765718-3294-46b0-a6b7-92a2bf6a6e8e tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Calling method '.version_select at 0x7f5ae937b0d0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:59.765811 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-7b765718-3294-46b0-a6b7-92a2bf6a6e8e tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] HTTP exception thrown: Image not found. Aug 31 15:57:59.769953 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7b765718-3294-46b0-a6b7-92a2bf6a6e8e tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Request method failure captured: Aug 31 15:57:59.769953 n-d-850499-9 devstack@n-api.service[122257]: request: DELETE /compute/v2.1/images/8c7686ef-2791-474b-9a88-1019551ffc49 HTTP/1.1 Aug 31 15:57:59.769953 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 15:57:59.769953 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 15:57:59.769953 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 15:57:59.769953 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 15:57:59.769953 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 15:57:59.769953 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 15:57:59.769953 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 15:57:59.769953 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 15:57:59.769953 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4Sr48sbSj8zmGnuJDt9FLcFFsMYJsMMN4O9amRh9mh8Gkp1Qor2_uDkL4eOZWlgOyZzvess77h4BzSHGWOidavKgm--Q1ArxbBQKFpoXel6J5wLKnONVEMF0izXf4OK_dlQROBgePWzUsQmETRJOzR4vgLJwa3XBxUTTRrCG_7Rb1Q Aug 31 15:57:59.769953 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 15:57:59.769953 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 15:57:59.769953 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 15:57:59.769953 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 15:57:59.769953 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 15:57:59.769953 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 15:57:59.769953 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 6f665e5697c4453c872940b4c0a88772 Aug 31 15:57:59.769953 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ImagesOneServerTestJSON-1892725018 Aug 31 15:57:59.769953 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 15:57:59.769953 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 15:57:59.771604 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6f665e5697c4453c872940b4c0a88772"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/6f665e5697c4453c872940b4c0a88772"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_6f665e5697c4453c872940b4c0a88772", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6f665e5697c4453c872940b4c0a88772"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 15:57:59.771604 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ImagesOneServerTestJSON-1892725018 Aug 31 15:57:59.771604 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 6f665e5697c4453c872940b4c0a88772 Aug 31 15:57:59.771604 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1892725018 Aug 31 15:57:59.771604 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ImagesOneServerTestJSON-1892725018-project Aug 31 15:57:59.771604 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 15:57:59.771604 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 15:57:59.771604 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: fedc04be9f46432fb954d7dbcfe53488 Aug 31 15:57:59.771604 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ImagesOneServerTestJSON-1892725018-project Aug 31 15:57:59.771604 n-d-850499-9 devstack@n-api.service[122257]: method: Aug 31 15:57:59.771604 n-d-850499-9 devstack@n-api.service[122257]: exception: Image not found. Aug 31 15:57:59.771604 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '8c7686ef-2791-474b-9a88-1019551ffc49'} Aug 31 15:57:59.771604 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:57:59.772539 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:57:59.772539 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 31 15:57:59.772539 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 31 15:57:59.772539 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 31 15:57:59.772539 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 31 15:57:59.772539 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 31 15:57:59.772539 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 31 15:57:59.772539 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 31 15:57:59.772539 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 31 15:57:59.772539 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 31 15:57:59.772539 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 31 15:57:59.772539 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 31 15:57:59.772539 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 31 15:57:59.772539 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 31 15:57:59.772539 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 31 15:57:59.772539 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 8c7686ef-2791-474b-9a88-1019551ffc49 to delete Aug 31 15:57:59.772539 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:57:59.772539 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:57:59.772539 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:57:59.773849 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:57:59.773849 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 31 15:57:59.773849 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 31 15:57:59.773849 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 31 15:57:59.773849 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 31 15:57:59.773849 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 31 15:57:59.773849 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 31 15:57:59.773849 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8c7686ef-2791-474b-9a88-1019551ffc49 could not be found. Aug 31 15:57:59.773849 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:57:59.773849 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:57:59.773849 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:57:59.773849 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:57:59.773849 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:57:59.773849 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:57:59.773849 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:57:59.773849 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:57:59.773849 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 15:57:59.773849 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 15:57:59.773849 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:57:59.773849 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:57:59.775224 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 31 15:57:59.775224 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 31 15:57:59.775224 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 31 15:57:59.775224 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:57:59.775224 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:57:59.775224 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:57:59.775224 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:57:59.775224 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:57:59.775224 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:57:59.775224 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:57:59.775224 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:57:59.775224 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 31 15:57:59.775224 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:57:59.775224 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7b765718-3294-46b0-a6b7-92a2bf6a6e8e tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Returning 404 to user: Image not found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:57:59.775224 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7b765718-3294-46b0-a6b7-92a2bf6a6e8e tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] 10.222.0.61 "DELETE /compute/v2.1/images/8c7686ef-2791-474b-9a88-1019551ffc49" status: 404 len: 62 microversion: 2.1 time: 0.071400 Aug 31 15:57:59.781717 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 303/600] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:59 2022] DELETE /compute/v2.1/images/8c7686ef-2791-474b-9a88-1019551ffc49 => generated 62 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 31 15:57:59.781906 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-743f07b9-e28e-4927-8b2d-92346b163c1f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:59.790175 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4abe0983-8197-45ea-ab55-695f87a632db tempest-FlavorsAdminTestJSON-1959651762 tempest-FlavorsAdminTestJSON-1959651762-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-599876889", "id": 37617652, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:57:59.791699 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-743f07b9-e28e-4927-8b2d-92346b163c1f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:59.793240 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-743f07b9-e28e-4927-8b2d-92346b163c1f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:59.794445 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-743f07b9-e28e-4927-8b2d-92346b163c1f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/79ee7e24-93df-450b-9030-b08c00d019eb" status: 200 len: 1567 microversion: 2.25 time: 0.520578 Aug 31 15:57:59.795018 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 298/601] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:59 2022] GET /compute/v2.1/servers/79ee7e24-93df-450b-9030-b08c00d019eb => generated 1567 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:57:59.802400 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4569abbf-750f-4ec0-96df-d24ef6bb45df tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:59.803021 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4569abbf-750f-4ec0-96df-d24ef6bb45df tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] [instance: 68edc4cf-5ffe-47e3-89d0-4e4fa7aebca2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:59.810235 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4569abbf-750f-4ec0-96df-d24ef6bb45df tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:59.810962 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4569abbf-750f-4ec0-96df-d24ef6bb45df tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:59.811628 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4569abbf-750f-4ec0-96df-d24ef6bb45df tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:59.812505 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4569abbf-750f-4ec0-96df-d24ef6bb45df tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:59.813182 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4569abbf-750f-4ec0-96df-d24ef6bb45df tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:59.813805 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4569abbf-750f-4ec0-96df-d24ef6bb45df tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:59.826882 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4abe0983-8197-45ea-ab55-695f87a632db tempest-FlavorsAdminTestJSON-1959651762 tempest-FlavorsAdminTestJSON-1959651762-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.048796 Aug 31 15:57:59.828096 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 304/602] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 15:57:59 2022] POST /compute/v2.1/flavors => generated 410 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:57:59.833404 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f7116d28-6310-4763-8ec8-776e325bb0d7 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:59.834238 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f7116d28-6310-4763-8ec8-776e325bb0d7 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] [instance: 1b233a49-d4f5-412d-8239-74df4ce63aa5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:59.842091 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f7116d28-6310-4763-8ec8-776e325bb0d7 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:59.842790 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f7116d28-6310-4763-8ec8-776e325bb0d7 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:59.843249 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f7116d28-6310-4763-8ec8-776e325bb0d7 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:59.843971 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f7116d28-6310-4763-8ec8-776e325bb0d7 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:59.844648 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f7116d28-6310-4763-8ec8-776e325bb0d7 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:59.845435 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f7116d28-6310-4763-8ec8-776e325bb0d7 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:59.873196 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f7116d28-6310-4763-8ec8-776e325bb0d7 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] [instance: 1b233a49-d4f5-412d-8239-74df4ce63aa5] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 15:57:59.998939 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f7116d28-6310-4763-8ec8-776e325bb0d7 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] 10.222.0.61 "DELETE /compute/v2.1/servers/1b233a49-d4f5-412d-8239-74df4ce63aa5" status: 204 len: 0 microversion: 2.1 time: 0.168447 Aug 31 15:58:00.000553 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 305/603] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 15:57:59 2022] DELETE /compute/v2.1/servers/1b233a49-d4f5-412d-8239-74df4ce63aa5 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 15:58:00.014483 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7e3884be-8233-4ebd-b2f8-afd4bacbf6b9 tempest-FlavorsAdminTestJSON-1959651762 tempest-FlavorsAdminTestJSON-1959651762-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:00.046003 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7e3884be-8233-4ebd-b2f8-afd4bacbf6b9 tempest-FlavorsAdminTestJSON-1959651762 tempest-FlavorsAdminTestJSON-1959651762-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 6217 microversion: 2.1 time: 0.043631 Aug 31 15:58:00.047370 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 306/604] 10.222.0.61 () {58 vars in 1146 bytes} [Wed Aug 31 15:58:00 2022] GET /compute/v2.1/flavors/detail => generated 6217 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:00.053889 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-992aa191-ffa0-4122-9d9f-bb249d08c259 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:00.054998 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-992aa191-ffa0-4122-9d9f-bb249d08c259 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] [instance: 1b233a49-d4f5-412d-8239-74df4ce63aa5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:00.063308 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-992aa191-ffa0-4122-9d9f-bb249d08c259 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:00.064807 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-992aa191-ffa0-4122-9d9f-bb249d08c259 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:00.065584 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-992aa191-ffa0-4122-9d9f-bb249d08c259 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:00.066477 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-992aa191-ffa0-4122-9d9f-bb249d08c259 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:00.066948 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-992aa191-ffa0-4122-9d9f-bb249d08c259 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:00.067380 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-992aa191-ffa0-4122-9d9f-bb249d08c259 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:00.083998 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:58:00.334732 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-4569abbf-750f-4ec0-96df-d24ef6bb45df tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad29bb9427d446ee8c0d237b218ac2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da6682c394444a1a286232fc0c2683d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:00.346238 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4569abbf-750f-4ec0-96df-d24ef6bb45df tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] 10.222.0.61 "GET /compute/v2.1/servers/68edc4cf-5ffe-47e3-89d0-4e4fa7aebca2" status: 200 len: 1473 microversion: 2.1 time: 0.547546 Aug 31 15:58:00.348804 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 299/605] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:59 2022] GET /compute/v2.1/servers/68edc4cf-5ffe-47e3-89d0-4e4fa7aebca2 => generated 1473 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:00.355802 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ca58384b-e878-4d4e-a8ac-e69feae839c7 tempest-FlavorsAdminTestJSON-1959651762 tempest-FlavorsAdminTestJSON-1959651762-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:00.378532 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ca58384b-e878-4d4e-a8ac-e69feae839c7 tempest-FlavorsAdminTestJSON-1959651762 tempest-FlavorsAdminTestJSON-1959651762-project-admin] 10.222.0.61 "DELETE /compute/v2.1/flavors/37617652" status: 202 len: 0 microversion: 2.1 time: 0.027968 Aug 31 15:58:00.379438 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 300/606] 10.222.0.61 () {58 vars in 1155 bytes} [Wed Aug 31 15:58:00 2022] DELETE /compute/v2.1/flavors/37617652 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 15:58:00.384549 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6c6ab2d6-9489-420a-aac1-f83cd06ca1fe tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:00.385657 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6c6ab2d6-9489-420a-aac1-f83cd06ca1fe tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: 2ddb0b07-9e31-403c-91d5-a278d632d754] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:00.398952 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6c6ab2d6-9489-420a-aac1-f83cd06ca1fe tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:00.399776 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6c6ab2d6-9489-420a-aac1-f83cd06ca1fe tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:00.400995 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6c6ab2d6-9489-420a-aac1-f83cd06ca1fe tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:00.402533 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6c6ab2d6-9489-420a-aac1-f83cd06ca1fe tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:00.403012 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6c6ab2d6-9489-420a-aac1-f83cd06ca1fe tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:00.403481 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6c6ab2d6-9489-420a-aac1-f83cd06ca1fe tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:00.426410 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-992aa191-ffa0-4122-9d9f-bb249d08c259 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc04be9f46432fb954d7dbcfe53488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f665e5697c4453c872940b4c0a88772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:00.434656 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-992aa191-ffa0-4122-9d9f-bb249d08c259 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] 10.222.0.61 "GET /compute/v2.1/servers/1b233a49-d4f5-412d-8239-74df4ce63aa5" status: 200 len: 1472 microversion: 2.1 time: 0.385183 Aug 31 15:58:00.435723 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 307/607] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:00 2022] GET /compute/v2.1/servers/1b233a49-d4f5-412d-8239-74df4ce63aa5 => generated 1472 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:00.455383 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-76357181-3e56-4d5b-8b12-abd3f33a57fc tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:00.456878 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-76357181-3e56-4d5b-8b12-abd3f33a57fc tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] [instance: f977bd90-3cd4-4b07-87f9-42e26b8a530a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:00.464487 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-76357181-3e56-4d5b-8b12-abd3f33a57fc tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:00.465064 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-76357181-3e56-4d5b-8b12-abd3f33a57fc tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:00.465818 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-76357181-3e56-4d5b-8b12-abd3f33a57fc tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:00.466738 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-76357181-3e56-4d5b-8b12-abd3f33a57fc tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:00.467530 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-76357181-3e56-4d5b-8b12-abd3f33a57fc tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:00.468222 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-76357181-3e56-4d5b-8b12-abd3f33a57fc tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:00.722618 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-6c6ab2d6-9489-420a-aac1-f83cd06ca1fe tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:00.732262 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6c6ab2d6-9489-420a-aac1-f83cd06ca1fe tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/2ddb0b07-9e31-403c-91d5-a278d632d754" status: 200 len: 1309 microversion: 2.1 time: 0.351619 Aug 31 15:58:00.732930 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 301/608] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:00 2022] GET /compute/v2.1/servers/2ddb0b07-9e31-403c-91d5-a278d632d754 => generated 1309 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:00.737536 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-fc332a3f-0327-4bca-945f-dc432fb32ada tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:00.738133 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-fc332a3f-0327-4bca-945f-dc432fb32ada tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] [instance: 68edc4cf-5ffe-47e3-89d0-4e4fa7aebca2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:00.744799 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fc332a3f-0327-4bca-945f-dc432fb32ada tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:00.745548 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fc332a3f-0327-4bca-945f-dc432fb32ada tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:00.746210 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fc332a3f-0327-4bca-945f-dc432fb32ada tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:00.746973 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fc332a3f-0327-4bca-945f-dc432fb32ada tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:00.747600 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fc332a3f-0327-4bca-945f-dc432fb32ada tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:00.748531 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fc332a3f-0327-4bca-945f-dc432fb32ada tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:00.755215 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-76357181-3e56-4d5b-8b12-abd3f33a57fc tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba336e5ac684606b5e0123e454f9a60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad48220bc634a6186547269011ec49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:00.763727 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-76357181-3e56-4d5b-8b12-abd3f33a57fc tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] 10.222.0.61 "GET /compute/v2.1/servers/f977bd90-3cd4-4b07-87f9-42e26b8a530a" status: 200 len: 1313 microversion: 2.1 time: 0.314284 Aug 31 15:58:00.767119 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 308/609] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:00 2022] GET /compute/v2.1/servers/f977bd90-3cd4-4b07-87f9-42e26b8a530a => generated 1313 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:00.772073 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-034e26e5-f2a0-4440-a724-f84747274a8a tempest-FlavorsAdminTestJSON-1959651762 tempest-FlavorsAdminTestJSON-1959651762-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:00.789968 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=100 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:58:00.809747 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-fc332a3f-0327-4bca-945f-dc432fb32ada tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': 'ad29bb9427d446ee8c0d237b218ac2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da6682c394444a1a286232fc0c2683d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:00.811650 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-fc332a3f-0327-4bca-945f-dc432fb32ada tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Request method failure captured: Aug 31 15:58:00.811650 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/68edc4cf-5ffe-47e3-89d0-4e4fa7aebca2/diagnostics HTTP/1.1 Aug 31 15:58:00.811650 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 15:58:00.811650 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 15:58:00.811650 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 15:58:00.811650 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 15:58:00.811650 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 15:58:00.811650 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 15:58:00.811650 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 15:58:00.811650 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 15:58:00.811650 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4TzcSVLmuErnyhPtmsP4wykIRafmz2HBBPJmyG4k-eG7ZeGwM8kIN_LvWacJbattOGcpWz0uZ5bayjTahSSnRf6to742RtAHn7O595BjRy6y_uJ2BpnF7qmZHfhWakW6XgjXfq8if5G_arrkuQHVevdtqSn-iqL0s6edii-g-vdaj0 Aug 31 15:58:00.811650 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 15:58:00.811650 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 15:58:00.811650 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 15:58:00.811650 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 15:58:00.811650 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 15:58:00.811650 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 15:58:00.811650 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 4da6682c394444a1a286232fc0c2683d Aug 31 15:58:00.811650 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1031522993 Aug 31 15:58:00.811650 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 15:58:00.811650 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 15:58:00.814790 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4da6682c394444a1a286232fc0c2683d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/4da6682c394444a1a286232fc0c2683d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_4da6682c394444a1a286232fc0c2683d", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4da6682c394444a1a286232fc0c2683d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 15:58:00.814790 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1031522993 Aug 31 15:58:00.814790 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 4da6682c394444a1a286232fc0c2683d Aug 31 15:58:00.814790 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1031522993 Aug 31 15:58:00.814790 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ServerDiagnosticsNegativeTest-1031522993-project Aug 31 15:58:00.814790 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 15:58:00.814790 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 15:58:00.814790 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: ad29bb9427d446ee8c0d237b218ac2f2 Aug 31 15:58:00.814790 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1031522993-project Aug 31 15:58:00.814790 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 15:58:00.814790 n-d-850499-9 devstack@n-api.service[122256]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 31 15:58:00.815487 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'server_id': '68edc4cf-5ffe-47e3-89d0-4e4fa7aebca2'} Aug 31 15:58:00.815487 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:58:00.815487 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:58:00.815487 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:58:00.815487 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:58:00.815487 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:58:00.815487 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:58:00.815487 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:58:00.815487 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:58:00.815487 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Aug 31 15:58:00.815487 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Aug 31 15:58:00.815487 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 31 15:58:00.815487 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 31 15:58:00.815487 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 31 15:58:00.815487 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 31 15:58:00.815487 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 15:58:00.815487 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 31 15:58:00.815487 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 15:58:00.815487 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise self.value Aug 31 15:58:00.815487 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 31 15:58:00.817183 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 31 15:58:00.817183 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 31 15:58:00.817183 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 31 15:58:00.817183 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 31 15:58:00.817183 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 31 15:58:00.817183 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 31 15:58:00.817183 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:58:00.817183 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:58:00.817183 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:58:00.817183 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:58:00.817183 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:58:00.817183 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:58:00.817183 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 31 15:58:00.817183 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 31 15:58:00.817183 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 31 15:58:00.817183 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:58:00.817183 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-fc332a3f-0327-4bca-945f-dc432fb32ada tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:58:00.818236 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-fc332a3f-0327-4bca-945f-dc432fb32ada tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] 10.222.0.61 "GET /compute/v2.1/servers/68edc4cf-5ffe-47e3-89d0-4e4fa7aebca2/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.079118 Aug 31 15:58:00.819975 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 302/610] 10.222.0.61 () {58 vars in 1272 bytes} [Wed Aug 31 15:58:00 2022] GET /compute/v2.1/servers/68edc4cf-5ffe-47e3-89d0-4e4fa7aebca2/diagnostics => generated 117 bytes in 86 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:58:00.822128 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-034e26e5-f2a0-4440-a724-f84747274a8a tempest-FlavorsAdminTestJSON-1959651762 tempest-FlavorsAdminTestJSON-1959651762-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.053360 Aug 31 15:58:00.829292 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-fb38b73d-c277-4eb2-8a09-c3055e97a82b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:00.830298 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-fb38b73d-c277-4eb2-8a09-c3055e97a82b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 79ee7e24-93df-450b-9030-b08c00d019eb] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:00.838843 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 309/611] 10.222.0.61 () {58 vars in 1146 bytes} [Wed Aug 31 15:58:00 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:00.840934 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fb38b73d-c277-4eb2-8a09-c3055e97a82b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:00.841939 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fb38b73d-c277-4eb2-8a09-c3055e97a82b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:00.842731 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fb38b73d-c277-4eb2-8a09-c3055e97a82b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:00.843626 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fb38b73d-c277-4eb2-8a09-c3055e97a82b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:00.844580 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4c891ad2-eed0-43e1-9775-8cdc21b6a33c tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:00.844818 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fb38b73d-c277-4eb2-8a09-c3055e97a82b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:00.845068 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4c891ad2-eed0-43e1-9775-8cdc21b6a33c tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] [instance: 68edc4cf-5ffe-47e3-89d0-4e4fa7aebca2] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:00.846253 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fb38b73d-c277-4eb2-8a09-c3055e97a82b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:00.850956 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4c891ad2-eed0-43e1-9775-8cdc21b6a33c tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:00.851440 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4c891ad2-eed0-43e1-9775-8cdc21b6a33c tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:00.851911 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4c891ad2-eed0-43e1-9775-8cdc21b6a33c tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:00.852607 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4c891ad2-eed0-43e1-9775-8cdc21b6a33c tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:00.853054 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4c891ad2-eed0-43e1-9775-8cdc21b6a33c tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:00.853699 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4c891ad2-eed0-43e1-9775-8cdc21b6a33c tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:00.883312 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4c891ad2-eed0-43e1-9775-8cdc21b6a33c tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] [instance: 68edc4cf-5ffe-47e3-89d0-4e4fa7aebca2] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 15:58:00.974105 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4c891ad2-eed0-43e1-9775-8cdc21b6a33c tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] 10.222.0.61 "DELETE /compute/v2.1/servers/68edc4cf-5ffe-47e3-89d0-4e4fa7aebca2" status: 204 len: 0 microversion: 2.1 time: 0.133824 Aug 31 15:58:00.975524 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 310/612] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 15:58:00 2022] DELETE /compute/v2.1/servers/68edc4cf-5ffe-47e3-89d0-4e4fa7aebca2 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 15:58:00.981835 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-be32f969-272c-4d91-b33b-249723fdca64 tempest-FlavorsAdminTestJSON-1959651762 tempest-FlavorsAdminTestJSON-1959651762-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1721290125", "id": 1970576332, "os-flavor-access:is_public": "True"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:58:01.001495 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-be32f969-272c-4d91-b33b-249723fdca64 tempest-FlavorsAdminTestJSON-1959651762 tempest-FlavorsAdminTestJSON-1959651762-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.024573 Aug 31 15:58:01.008546 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 311/613] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 15:58:00 2022] POST /compute/v2.1/flavors => generated 429 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:58:01.014387 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-59c704aa-9294-4d65-b4af-29893fa508ef tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:01.015107 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-59c704aa-9294-4d65-b4af-29893fa508ef tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] [instance: 68edc4cf-5ffe-47e3-89d0-4e4fa7aebca2] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:01.021304 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-59c704aa-9294-4d65-b4af-29893fa508ef tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:01.021795 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-59c704aa-9294-4d65-b4af-29893fa508ef tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:01.022228 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-59c704aa-9294-4d65-b4af-29893fa508ef tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:01.022923 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-59c704aa-9294-4d65-b4af-29893fa508ef tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:01.023375 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-59c704aa-9294-4d65-b4af-29893fa508ef tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:01.023823 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-59c704aa-9294-4d65-b4af-29893fa508ef tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:01.066140 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-fb38b73d-c277-4eb2-8a09-c3055e97a82b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:01.076093 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-fb38b73d-c277-4eb2-8a09-c3055e97a82b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:01.078627 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-fb38b73d-c277-4eb2-8a09-c3055e97a82b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:01.080432 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-fb38b73d-c277-4eb2-8a09-c3055e97a82b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/79ee7e24-93df-450b-9030-b08c00d019eb" status: 200 len: 1557 microversion: 2.25 time: 0.258475 Aug 31 15:58:01.080885 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 303/614] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:58:00 2022] GET /compute/v2.1/servers/79ee7e24-93df-450b-9030-b08c00d019eb => generated 1557 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:01.085272 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1f3c0f8f-cbbd-4027-bfc0-c84ae43f59f9 tempest-FlavorsAdminTestJSON-1959651762 tempest-FlavorsAdminTestJSON-1959651762-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:01.120280 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1f3c0f8f-cbbd-4027-bfc0-c84ae43f59f9 tempest-FlavorsAdminTestJSON-1959651762 tempest-FlavorsAdminTestJSON-1959651762-project-admin] 10.222.0.61 "DELETE /compute/v2.1/flavors/1970576332" status: 202 len: 0 microversion: 2.1 time: 0.037278 Aug 31 15:58:01.120533 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 304/615] 10.222.0.61 () {58 vars in 1161 bytes} [Wed Aug 31 15:58:01 2022] DELETE /compute/v2.1/flavors/1970576332 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 15:58:01.129423 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2f1f13e0-356c-40d5-afcf-e0d36b7541f4 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Calling method '.version_select at 0x7f5ae93788b0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:01.133068 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2f1f13e0-356c-40d5-afcf-e0d36b7541f4 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:01.133612 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2f1f13e0-356c-40d5-afcf-e0d36b7541f4 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:01.134398 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2f1f13e0-356c-40d5-afcf-e0d36b7541f4 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:01.154236 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2f1f13e0-356c-40d5-afcf-e0d36b7541f4 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] 10.222.0.61 "GET /compute/v2.1/os-migrations" status: 200 len: 1100 microversion: 2.25 time: 0.028904 Aug 31 15:58:01.155282 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 305/616] 10.222.0.61 () {60 vars in 1184 bytes} [Wed Aug 31 15:58:01 2022] GET /compute/v2.1/os-migrations => generated 1100 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:01.159800 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9eeb5a50-1f57-481e-b7e0-0e043f71d922 tempest-FlavorsAdminTestJSON-1959651762 tempest-FlavorsAdminTestJSON-1959651762-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:01.188361 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9eeb5a50-1f57-481e-b7e0-0e043f71d922 tempest-FlavorsAdminTestJSON-1959651762 tempest-FlavorsAdminTestJSON-1959651762-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.031745 Aug 31 15:58:01.199962 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 306/617] 10.222.0.61 () {58 vars in 1146 bytes} [Wed Aug 31 15:58:01 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:01.209118 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-3f2b7646-3d1f-4138-ade4-2f20b89aff74 req-27bc8c93-95e8-4bfc-817e-7b8866b1fa15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f977bd90-3cd4-4b07-87f9-42e26b8a530a", "tag": "a9441445-ce6b-4242-a4d0-c5a2444ed50a"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:58:01.219404 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-3f2b7646-3d1f-4138-ade4-2f20b89aff74 req-27bc8c93-95e8-4bfc-817e-7b8866b1fa15 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:01.220009 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-3f2b7646-3d1f-4138-ade4-2f20b89aff74 req-27bc8c93-95e8-4bfc-817e-7b8866b1fa15 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:01.220493 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-3f2b7646-3d1f-4138-ade4-2f20b89aff74 req-27bc8c93-95e8-4bfc-817e-7b8866b1fa15 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:01.231971 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-3f2b7646-3d1f-4138-ade4-2f20b89aff74 req-27bc8c93-95e8-4bfc-817e-7b8866b1fa15 service nova] Creating event network-changed:a9441445-ce6b-4242-a4d0-c5a2444ed50a for instance f977bd90-3cd4-4b07-87f9-42e26b8a530a on n-h2-850499-9 Aug 31 15:58:01.237035 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-3f2b7646-3d1f-4138-ade4-2f20b89aff74 req-27bc8c93-95e8-4bfc-817e-7b8866b1fa15 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035875 Aug 31 15:58:01.238059 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 307/618] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 15:58:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:58:01.243179 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-96bfe622-53c1-400d-aebf-f1e67a71f79a tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:01.244912 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-96bfe622-53c1-400d-aebf-f1e67a71f79a tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] [instance: 79ee7e24-93df-450b-9030-b08c00d019eb] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:01.251509 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-96bfe622-53c1-400d-aebf-f1e67a71f79a tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:01.252014 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-96bfe622-53c1-400d-aebf-f1e67a71f79a tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:01.252448 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-96bfe622-53c1-400d-aebf-f1e67a71f79a tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:01.253143 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-96bfe622-53c1-400d-aebf-f1e67a71f79a tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:01.253592 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-96bfe622-53c1-400d-aebf-f1e67a71f79a tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:01.254185 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-96bfe622-53c1-400d-aebf-f1e67a71f79a tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:01.348612 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-59c704aa-9294-4d65-b4af-29893fa508ef tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad29bb9427d446ee8c0d237b218ac2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da6682c394444a1a286232fc0c2683d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:01.357062 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-59c704aa-9294-4d65-b4af-29893fa508ef tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] 10.222.0.61 "GET /compute/v2.1/servers/68edc4cf-5ffe-47e3-89d0-4e4fa7aebca2" status: 200 len: 1479 microversion: 2.1 time: 0.347281 Aug 31 15:58:01.357642 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 312/619] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:01 2022] GET /compute/v2.1/servers/68edc4cf-5ffe-47e3-89d0-4e4fa7aebca2 => generated 1479 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:01.362217 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2fc4a916-32cf-4f4b-9551-a774cfbf4a3d tempest-FlavorsAdminTestJSON-1959651762 tempest-FlavorsAdminTestJSON-1959651762-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1396866013", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:58:01.385409 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2fc4a916-32cf-4f4b-9551-a774cfbf4a3d tempest-FlavorsAdminTestJSON-1959651762 tempest-FlavorsAdminTestJSON-1959651762-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.025903 Aug 31 15:58:01.386084 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 313/620] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 15:58:01 2022] POST /compute/v2.1/flavors => generated 507 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:58:01.398882 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-56eb0164-e600-455f-a71c-7f60730bbadf tempest-FlavorsAdminTestJSON-1959651762 tempest-FlavorsAdminTestJSON-1959651762-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:01.424678 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-56eb0164-e600-455f-a71c-7f60730bbadf tempest-FlavorsAdminTestJSON-1959651762 tempest-FlavorsAdminTestJSON-1959651762-project-admin] 10.222.0.61 "DELETE /compute/v2.1/flavors/32cf8ddb-c095-4fb9-ab41-2b8a07539d53" status: 202 len: 0 microversion: 2.1 time: 0.030715 Aug 31 15:58:01.425335 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 314/621] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 15:58:01 2022] DELETE /compute/v2.1/flavors/32cf8ddb-c095-4fb9-ab41-2b8a07539d53 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 15:58:01.432909 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4e81168a-815d-47e8-822b-d6edb6553f8a tempest-FlavorsAdminTestJSON-1959651762 tempest-FlavorsAdminTestJSON-1959651762-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:01.460166 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4e81168a-815d-47e8-822b-d6edb6553f8a tempest-FlavorsAdminTestJSON-1959651762 tempest-FlavorsAdminTestJSON-1959651762-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.030420 Aug 31 15:58:01.461150 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 315/622] 10.222.0.61 () {58 vars in 1146 bytes} [Wed Aug 31 15:58:01 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:58:01.471801 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-068d3334-578e-4d17-934a-638dfe8579ca tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:01.475304 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-068d3334-578e-4d17-934a-638dfe8579ca tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] [instance: 1b233a49-d4f5-412d-8239-74df4ce63aa5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:01.479973 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-068d3334-578e-4d17-934a-638dfe8579ca tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:01.480212 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-068d3334-578e-4d17-934a-638dfe8579ca tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:01.480706 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-068d3334-578e-4d17-934a-638dfe8579ca tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:01.481804 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-068d3334-578e-4d17-934a-638dfe8579ca tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:01.481922 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-068d3334-578e-4d17-934a-638dfe8579ca tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:01.482300 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-068d3334-578e-4d17-934a-638dfe8579ca tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:01.526850 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-96bfe622-53c1-400d-aebf-f1e67a71f79a tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lazy-loading 'services' on Instance uuid 79ee7e24-93df-450b-9030-b08c00d019eb {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:58:01.541791 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-96bfe622-53c1-400d-aebf-f1e67a71f79a tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/79ee7e24-93df-450b-9030-b08c00d019eb" status: 200 len: 2049 microversion: 2.25 time: 0.301733 Aug 31 15:58:01.542530 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 308/623] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:58:01 2022] GET /compute/v2.1/servers/79ee7e24-93df-450b-9030-b08c00d019eb => generated 2049 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:01.547488 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-eb731805-c247-4323-938a-83a4de30f74f tempest-FlavorsAdminTestJSON-1959651762 tempest-FlavorsAdminTestJSON-1959651762-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1314093578", "id": "e4d2e45a-5f03-4963-94fa-a84bb5304df9", "os-flavor-access:is_public": "True"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:58:01.555011 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1,nova_api:DELETE=9,nova_api:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:58:01.584443 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-eb731805-c247-4323-938a-83a4de30f74f tempest-FlavorsAdminTestJSON-1959651762 tempest-FlavorsAdminTestJSON-1959651762-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.040317 Aug 31 15:58:01.586557 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 309/624] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 15:58:01 2022] POST /compute/v2.1/flavors => generated 507 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:58:01.599776 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c4628cc5-d4e9-4bb4-baf5-97c391ddad7a tempest-FlavorsAdminTestJSON-1959651762 tempest-FlavorsAdminTestJSON-1959651762-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:01.625546 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c4628cc5-d4e9-4bb4-baf5-97c391ddad7a tempest-FlavorsAdminTestJSON-1959651762 tempest-FlavorsAdminTestJSON-1959651762-project-admin] 10.222.0.61 "DELETE /compute/v2.1/flavors/e4d2e45a-5f03-4963-94fa-a84bb5304df9" status: 202 len: 0 microversion: 2.1 time: 0.031439 Aug 31 15:58:01.629632 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 310/625] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 15:58:01 2022] DELETE /compute/v2.1/flavors/e4d2e45a-5f03-4963-94fa-a84bb5304df9 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 15:58:01.635106 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f0969b56-8dd7-4824-8238-e72e0f2e56f3 tempest-FlavorsAdminTestJSON-1959651762 tempest-FlavorsAdminTestJSON-1959651762-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:01.660145 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f0969b56-8dd7-4824-8238-e72e0f2e56f3 tempest-FlavorsAdminTestJSON-1959651762 tempest-FlavorsAdminTestJSON-1959651762-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.028667 Aug 31 15:58:01.661497 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 311/626] 10.222.0.61 () {58 vars in 1146 bytes} [Wed Aug 31 15:58:01 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:01.683981 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-bc6dda87-6d03-4ad2-bac0-c13ec091dff8 tempest-FlavorsAdminTestJSON-1959651762 tempest-FlavorsAdminTestJSON-1959651762-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-291362718", "id": 688551396, "os-flavor-access:is_public": "True"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:58:01.705788 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-bc6dda87-6d03-4ad2-bac0-c13ec091dff8 tempest-FlavorsAdminTestJSON-1959651762 tempest-FlavorsAdminTestJSON-1959651762-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.027898 Aug 31 15:58:01.707270 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 312/627] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 15:58:01 2022] POST /compute/v2.1/flavors => generated 410 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 15:58:01.725768 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f0eaf236-1021-4b8e-96a6-669e9279c531 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-517640217", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "networks": [{"uuid": "46991353-f00e-44c7-9ba5-793d81b25791"}]}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:58:01.787189 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-f0eaf236-1021-4b8e-96a6-669e9279c531 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] validate_networks() for [('46991353-f00e-44c7-9ba5-793d81b25791', None, None, None, None, None)] {{(pid=122256) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 15:58:01.863033 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-068d3334-578e-4d17-934a-638dfe8579ca tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc04be9f46432fb954d7dbcfe53488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f665e5697c4453c872940b4c0a88772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:01.872077 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-068d3334-578e-4d17-934a-638dfe8579ca tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] 10.222.0.61 "GET /compute/v2.1/servers/1b233a49-d4f5-412d-8239-74df4ce63aa5" status: 200 len: 1472 microversion: 2.1 time: 0.406734 Aug 31 15:58:01.872933 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 316/628] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:01 2022] GET /compute/v2.1/servers/1b233a49-d4f5-412d-8239-74df4ce63aa5 => generated 1472 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:01.883052 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c6553ae9-0cde-4fc4-8fee-103eb0546fe0 tempest-FlavorsAdminTestJSON-1959651762 tempest-FlavorsAdminTestJSON-1959651762-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:01.891790 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c6553ae9-0cde-4fc4-8fee-103eb0546fe0 tempest-FlavorsAdminTestJSON-1959651762 tempest-FlavorsAdminTestJSON-1959651762-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/688551396" status: 200 len: 410 microversion: 2.1 time: 0.016369 Aug 31 15:58:01.895922 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 317/629] 10.222.0.61 () {58 vars in 1155 bytes} [Wed Aug 31 15:58:01 2022] GET /compute/v2.1/flavors/688551396 => generated 410 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:58:01.904218 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-f5be041f-b14e-4fdf-9a76-56991f654aa0 req-cbf40654-78ae-4466-a10e-547c4d2fde21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b233a49-d4f5-412d-8239-74df4ce63aa5", "name": "network-vif-unplugged", "status": "completed", "tag": "f56ba330-3206-4322-9474-e01afa8afef9"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:58:01.917550 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-f5be041f-b14e-4fdf-9a76-56991f654aa0 req-cbf40654-78ae-4466-a10e-547c4d2fde21 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:01.918183 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-f5be041f-b14e-4fdf-9a76-56991f654aa0 req-cbf40654-78ae-4466-a10e-547c4d2fde21 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:01.918880 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-f5be041f-b14e-4fdf-9a76-56991f654aa0 req-cbf40654-78ae-4466-a10e-547c4d2fde21 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:01.931076 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-f5be041f-b14e-4fdf-9a76-56991f654aa0 req-cbf40654-78ae-4466-a10e-547c4d2fde21 service nova] Creating event network-vif-unplugged:f56ba330-3206-4322-9474-e01afa8afef9 for instance 1b233a49-d4f5-412d-8239-74df4ce63aa5 on n-h1-850499-9 Aug 31 15:58:01.937285 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-f5be041f-b14e-4fdf-9a76-56991f654aa0 req-cbf40654-78ae-4466-a10e-547c4d2fde21 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038845 Aug 31 15:58:01.938195 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 318/630] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 15:58:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:58:01.945513 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-af57b480-fe80-475a-8a10-3d303aa05f67 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:01.946505 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-af57b480-fe80-475a-8a10-3d303aa05f67 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: 2ddb0b07-9e31-403c-91d5-a278d632d754] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:01.953724 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-af57b480-fe80-475a-8a10-3d303aa05f67 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:01.954439 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-af57b480-fe80-475a-8a10-3d303aa05f67 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:01.954880 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-af57b480-fe80-475a-8a10-3d303aa05f67 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:01.955639 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-af57b480-fe80-475a-8a10-3d303aa05f67 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:01.956256 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-af57b480-fe80-475a-8a10-3d303aa05f67 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:01.956847 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-af57b480-fe80-475a-8a10-3d303aa05f67 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:02.390307 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-af57b480-fe80-475a-8a10-3d303aa05f67 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:02.398276 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-af57b480-fe80-475a-8a10-3d303aa05f67 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/2ddb0b07-9e31-403c-91d5-a278d632d754" status: 200 len: 1309 microversion: 2.1 time: 0.458651 Aug 31 15:58:02.398851 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 319/631] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:01 2022] GET /compute/v2.1/servers/2ddb0b07-9e31-403c-91d5-a278d632d754 => generated 1309 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:02.403613 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0775c0dc-7075-4764-9098-4f6d7bf81409 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:02.404394 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0775c0dc-7075-4764-9098-4f6d7bf81409 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] [instance: f977bd90-3cd4-4b07-87f9-42e26b8a530a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:02.410297 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0775c0dc-7075-4764-9098-4f6d7bf81409 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:02.411012 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0775c0dc-7075-4764-9098-4f6d7bf81409 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:02.411672 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0775c0dc-7075-4764-9098-4f6d7bf81409 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:02.412561 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0775c0dc-7075-4764-9098-4f6d7bf81409 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:02.413017 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0775c0dc-7075-4764-9098-4f6d7bf81409 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:02.413443 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0775c0dc-7075-4764-9098-4f6d7bf81409 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:02.594367 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-f0eaf236-1021-4b8e-96a6-669e9279c531 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 15:58:02.594832 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-f0eaf236-1021-4b8e-96a6-669e9279c531 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 15:58:02.595340 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-f0eaf236-1021-4b8e-96a6-669e9279c531 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 15:58:02.595784 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-f0eaf236-1021-4b8e-96a6-669e9279c531 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 15:58:02.596190 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-f0eaf236-1021-4b8e-96a6-669e9279c531 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 15:58:02.605577 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f0eaf236-1021-4b8e-96a6-669e9279c531 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:02.606065 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f0eaf236-1021-4b8e-96a6-669e9279c531 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:02.606495 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f0eaf236-1021-4b8e-96a6-669e9279c531 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:02.607247 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f0eaf236-1021-4b8e-96a6-669e9279c531 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:02.607724 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f0eaf236-1021-4b8e-96a6-669e9279c531 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:02.608147 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f0eaf236-1021-4b8e-96a6-669e9279c531 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:02.622170 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0775c0dc-7075-4764-9098-4f6d7bf81409 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba336e5ac684606b5e0123e454f9a60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad48220bc634a6186547269011ec49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:02.625433 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-f0eaf236-1021-4b8e-96a6-669e9279c531 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Getting quotas for project 01a9266ba9b14c6a8b6e79aecfe86df6. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:58:02.629919 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0775c0dc-7075-4764-9098-4f6d7bf81409 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] 10.222.0.61 "GET /compute/v2.1/servers/f977bd90-3cd4-4b07-87f9-42e26b8a530a" status: 200 len: 1313 microversion: 2.1 time: 0.229920 Aug 31 15:58:02.630603 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 320/632] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:02 2022] GET /compute/v2.1/servers/f977bd90-3cd4-4b07-87f9-42e26b8a530a => generated 1313 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:02.630737 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-f0eaf236-1021-4b8e-96a6-669e9279c531 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Getting quotas for user bb8e30aa23194f898b07dfbc6fd8d5de and project 01a9266ba9b14c6a8b6e79aecfe86df6. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:58:02.645232 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f0eaf236-1021-4b8e-96a6-669e9279c531 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Going to run 1 instances... {{(pid=122256) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 15:58:02.647718 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f0eaf236-1021-4b8e-96a6-669e9279c531 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 8555b294-db38-4246-ac58-035cb2acc70e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 15:58:02.695469 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f0eaf236-1021-4b8e-96a6-669e9279c531 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 0.980156 Aug 31 15:58:02.702745 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 313/633] 10.222.0.61 () {62 vars in 1188 bytes} [Wed Aug 31 15:58:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 983 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 31 15:58:02.707485 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-14bfd007-2a46-4730-a0cc-115054573bea tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:02.708129 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-14bfd007-2a46-4730-a0cc-115054573bea tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] [instance: 68edc4cf-5ffe-47e3-89d0-4e4fa7aebca2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:02.712218 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=12 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:58:02.722158 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-14bfd007-2a46-4730-a0cc-115054573bea tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:02.722780 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-14bfd007-2a46-4730-a0cc-115054573bea tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:02.723306 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-14bfd007-2a46-4730-a0cc-115054573bea tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:02.724987 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-14bfd007-2a46-4730-a0cc-115054573bea tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:02.725432 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-14bfd007-2a46-4730-a0cc-115054573bea tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:02.726094 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-14bfd007-2a46-4730-a0cc-115054573bea tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:02.830853 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-642e9b07-8049-4b4d-ac88-94cb11cbad7f tempest-FlavorsAdminTestJSON-957775020 tempest-FlavorsAdminTestJSON-957775020-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:02.855551 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-642e9b07-8049-4b4d-ac88-94cb11cbad7f tempest-FlavorsAdminTestJSON-957775020 tempest-FlavorsAdminTestJSON-957775020-project] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 6217 microversion: 2.1 time: 0.223868 Aug 31 15:58:02.856148 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 321/634] 10.222.0.61 () {58 vars in 1146 bytes} [Wed Aug 31 15:58:02 2022] GET /compute/v2.1/flavors/detail => generated 6217 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:02.885317 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-14bfd007-2a46-4730-a0cc-115054573bea tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad29bb9427d446ee8c0d237b218ac2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da6682c394444a1a286232fc0c2683d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:02.895902 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-14bfd007-2a46-4730-a0cc-115054573bea tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] 10.222.0.61 "GET /compute/v2.1/servers/68edc4cf-5ffe-47e3-89d0-4e4fa7aebca2" status: 200 len: 1479 microversion: 2.1 time: 0.198178 Aug 31 15:58:02.899623 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 314/635] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:02 2022] GET /compute/v2.1/servers/68edc4cf-5ffe-47e3-89d0-4e4fa7aebca2 => generated 1479 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:02.901468 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6bb949a0-2571-400b-8440-4597b5c8b5a6 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:02.902075 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6bb949a0-2571-400b-8440-4597b5c8b5a6 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 8555b294-db38-4246-ac58-035cb2acc70e] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:02.933841 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c5caa5f4-e5ee-47a0-8d1b-79d3c537be11 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1975160115", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:58:02.960880 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-6bb949a0-2571-400b-8440-4597b5c8b5a6 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:02.969602 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-6bb949a0-2571-400b-8440-4597b5c8b5a6 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:02.971581 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-6bb949a0-2571-400b-8440-4597b5c8b5a6 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:02.973107 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6bb949a0-2571-400b-8440-4597b5c8b5a6 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/8555b294-db38-4246-ac58-035cb2acc70e" status: 200 len: 1261 microversion: 2.25 time: 0.075448 Aug 31 15:58:02.973931 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 315/636] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:58:02 2022] GET /compute/v2.1/servers/8555b294-db38-4246-ac58-035cb2acc70e => generated 1261 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:02.980530 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7297b9a0-0f81-4d4e-b5b2-686937ad8b10 tempest-FlavorsAdminTestJSON-1959651762 tempest-FlavorsAdminTestJSON-1959651762-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:02.991936 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-c5caa5f4-e5ee-47a0-8d1b-79d3c537be11 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] validate_networks() for None {{(pid=122257) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 15:58:03.002674 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7297b9a0-0f81-4d4e-b5b2-686937ad8b10 tempest-FlavorsAdminTestJSON-1959651762 tempest-FlavorsAdminTestJSON-1959651762-project-admin] 10.222.0.61 "DELETE /compute/v2.1/flavors/688551396" status: 202 len: 0 microversion: 2.1 time: 0.027228 Aug 31 15:58:03.003329 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 316/637] 10.222.0.61 () {58 vars in 1158 bytes} [Wed Aug 31 15:58:02 2022] DELETE /compute/v2.1/flavors/688551396 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 15:58:03.008356 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b1b8e0f1-6aef-4e88-8c5a-8a9f637dbcfb tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:03.009065 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b1b8e0f1-6aef-4e88-8c5a-8a9f637dbcfb tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] [instance: 1b233a49-d4f5-412d-8239-74df4ce63aa5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:03.016672 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b1b8e0f1-6aef-4e88-8c5a-8a9f637dbcfb tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:03.017170 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b1b8e0f1-6aef-4e88-8c5a-8a9f637dbcfb tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:03.017605 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b1b8e0f1-6aef-4e88-8c5a-8a9f637dbcfb tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:03.018304 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b1b8e0f1-6aef-4e88-8c5a-8a9f637dbcfb tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:03.018753 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b1b8e0f1-6aef-4e88-8c5a-8a9f637dbcfb tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:03.019349 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b1b8e0f1-6aef-4e88-8c5a-8a9f637dbcfb tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:03.241287 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b1b8e0f1-6aef-4e88-8c5a-8a9f637dbcfb tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc04be9f46432fb954d7dbcfe53488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f665e5697c4453c872940b4c0a88772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:03.250011 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b1b8e0f1-6aef-4e88-8c5a-8a9f637dbcfb tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] 10.222.0.61 "GET /compute/v2.1/servers/1b233a49-d4f5-412d-8239-74df4ce63aa5" status: 200 len: 1472 microversion: 2.1 time: 0.245599 Aug 31 15:58:03.250595 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 317/638] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:03 2022] GET /compute/v2.1/servers/1b233a49-d4f5-412d-8239-74df4ce63aa5 => generated 1472 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:03.255090 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-dc2b407d-179f-47e5-93af-5bb2b40f0432 tempest-FlavorsAdminTestJSON-1959651762 tempest-FlavorsAdminTestJSON-1959651762-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:03.270511 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-c5caa5f4-e5ee-47a0-8d1b-79d3c537be11 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 15:58:03.270925 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-c5caa5f4-e5ee-47a0-8d1b-79d3c537be11 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 15:58:03.271388 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-c5caa5f4-e5ee-47a0-8d1b-79d3c537be11 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 15:58:03.271819 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-c5caa5f4-e5ee-47a0-8d1b-79d3c537be11 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 15:58:03.272231 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-c5caa5f4-e5ee-47a0-8d1b-79d3c537be11 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 15:58:03.277439 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-dc2b407d-179f-47e5-93af-5bb2b40f0432 tempest-FlavorsAdminTestJSON-1959651762 tempest-FlavorsAdminTestJSON-1959651762-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.025792 Aug 31 15:58:03.278017 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 318/639] 10.222.0.61 () {58 vars in 1146 bytes} [Wed Aug 31 15:58:03 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:03.282014 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c5caa5f4-e5ee-47a0-8d1b-79d3c537be11 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:03.282491 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c5caa5f4-e5ee-47a0-8d1b-79d3c537be11 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:03.282951 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c5caa5f4-e5ee-47a0-8d1b-79d3c537be11 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:03.283714 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c5caa5f4-e5ee-47a0-8d1b-79d3c537be11 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:03.284165 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c5caa5f4-e5ee-47a0-8d1b-79d3c537be11 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:03.284605 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c5caa5f4-e5ee-47a0-8d1b-79d3c537be11 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:03.296923 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-931ba737-d1e6-4a18-b4b9-50ca3681bd21 tempest-FlavorsAdminTestJSON-1959651762 tempest-FlavorsAdminTestJSON-1959651762-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-505406176", "id": 542735581, "os-flavor-access:is_public": "False"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:58:03.302457 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-c5caa5f4-e5ee-47a0-8d1b-79d3c537be11 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Getting quotas for project 1ea45d1b678342ed812f9912e9f07503. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:58:03.308646 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-c5caa5f4-e5ee-47a0-8d1b-79d3c537be11 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Getting quotas for user 9a03cc5956ca477abacbe0c26bf18750 and project 1ea45d1b678342ed812f9912e9f07503. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:58:03.314919 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-931ba737-d1e6-4a18-b4b9-50ca3681bd21 tempest-FlavorsAdminTestJSON-1959651762 tempest-FlavorsAdminTestJSON-1959651762-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.021467 Aug 31 15:58:03.315537 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 319/640] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 15:58:03 2022] POST /compute/v2.1/flavors => generated 426 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:58:03.321083 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c5caa5f4-e5ee-47a0-8d1b-79d3c537be11 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Going to run 1 instances... {{(pid=122257) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 15:58:03.323578 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c5caa5f4-e5ee-47a0-8d1b-79d3c537be11 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] [instance: e45fa8b9-1545-4bd5-aa5f-402c71ec19c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 15:58:03.327350 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4afa1b62-6306-4415-8eb3-41930ed2aeea tempest-FlavorsAdminTestJSON-957775020 tempest-FlavorsAdminTestJSON-957775020-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "542735581"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:58:03.338902 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-4afa1b62-6306-4415-8eb3-41930ed2aeea tempest-FlavorsAdminTestJSON-957775020 tempest-FlavorsAdminTestJSON-957775020-project] HTTP exception thrown: Flavor 542735581 could not be found. Aug 31 15:58:03.341164 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4afa1b62-6306-4415-8eb3-41930ed2aeea tempest-FlavorsAdminTestJSON-957775020 tempest-FlavorsAdminTestJSON-957775020-project] Request method failure captured: Aug 31 15:58:03.341164 n-d-850499-9 devstack@n-api.service[122256]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 31 15:58:03.341164 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 15:58:03.341164 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 15:58:03.341164 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 15:58:03.341164 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 106 Aug 31 15:58:03.341164 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 15:58:03.341164 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 15:58:03.341164 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 15:58:03.341164 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 15:58:03.341164 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4UFcIrHBrJX2qAej6VYJRr_fng4TrARAsSpMaPTYhpEDlHXW9JMcWJFjzBBmuKh0Kd2ZdmQ89jSK_bdk45IUW7glgIlWLA4gQd8yYtMP3p32Sso6eLNCgvIka2bOEAsTtyRUEFxgRlj8lrhZXlWw1QYVYlLceH2N8MCRiu-QRVNiy4 Aug 31 15:58:03.341164 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 15:58:03.341164 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 15:58:03.341164 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 15:58:03.341164 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 15:58:03.341164 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 15:58:03.341164 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 15:58:03.341164 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 950866bf5f4e48d69b9fb2d2d477820f Aug 31 15:58:03.341164 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-FlavorsAdminTestJSON-957775020 Aug 31 15:58:03.341164 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 15:58:03.341164 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 15:58:03.342575 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/950866bf5f4e48d69b9fb2d2d477820f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/950866bf5f4e48d69b9fb2d2d477820f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_950866bf5f4e48d69b9fb2d2d477820f", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/950866bf5f4e48d69b9fb2d2d477820f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 15:58:03.342575 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-FlavorsAdminTestJSON-957775020 Aug 31 15:58:03.342575 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 950866bf5f4e48d69b9fb2d2d477820f Aug 31 15:58:03.342575 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-957775020 Aug 31 15:58:03.342575 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-FlavorsAdminTestJSON-957775020-project Aug 31 15:58:03.342575 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 15:58:03.342575 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 15:58:03.342575 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 0651cee772d3438085c275b45a8d4a06 Aug 31 15:58:03.342575 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-FlavorsAdminTestJSON-957775020-project Aug 31 15:58:03.342575 n-d-850499-9 devstack@n-api.service[122256]: Aug 31 15:58:03.342575 n-d-850499-9 devstack@n-api.service[122256]: {"server": {"name": "test", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "542735581"}} Aug 31 15:58:03.342575 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 15:58:03.342575 n-d-850499-9 devstack@n-api.service[122256]: exception: Flavor 542735581 could not be found. Aug 31 15:58:03.343795 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'body': {'server': {'name': 'test', 'imageRef': 'b9c36d42-ed46-4bf5-ad18-1df45cbd0413', 'flavorRef': '542735581'}}} Aug 31 15:58:03.343795 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:58:03.343795 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:58:03.343795 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Aug 31 15:58:03.343795 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Aug 31 15:58:03.343795 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 15:58:03.343795 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 15:58:03.343795 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 15:58:03.343795 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 15:58:03.343795 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 15:58:03.343795 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 15:58:03.343795 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 15:58:03.343795 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:58:03.343795 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 15:58:03.343795 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 15:58:03.343795 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 542735581 could not be found. Aug 31 15:58:03.343795 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:58:03.343795 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:58:03.343795 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:58:03.343795 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:58:03.345301 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:58:03.345301 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:58:03.345301 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:58:03.345301 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:58:03.345301 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:58:03.345301 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:58:03.345301 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:58:03.345301 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:58:03.345301 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:58:03.345301 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:58:03.345301 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:58:03.345301 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:58:03.345301 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 31 15:58:03.345301 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 31 15:58:03.345301 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 31 15:58:03.345301 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 542735581 could not be found. Aug 31 15:58:03.345301 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:58:03.345301 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:58:03.345301 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:58:03.345301 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:58:03.345301 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:58:03.347963 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:58:03.347963 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:58:03.347963 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:58:03.347963 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 542735581 could not be found. Aug 31 15:58:03.347963 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:58:03.347963 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4afa1b62-6306-4415-8eb3-41930ed2aeea tempest-FlavorsAdminTestJSON-957775020 tempest-FlavorsAdminTestJSON-957775020-project] Returning 400 to user: Flavor 542735581 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:58:03.347963 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4afa1b62-6306-4415-8eb3-41930ed2aeea tempest-FlavorsAdminTestJSON-957775020 tempest-FlavorsAdminTestJSON-957775020-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 400 len: 80 microversion: 2.1 time: 0.019096 Aug 31 15:58:03.347963 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 320/641] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 15:58:03 2022] POST /compute/v2.1/servers => generated 80 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 31 15:58:03.353020 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a0228961-28f7-416e-85b8-56bf6c088ee4 tempest-FlavorsAdminTestJSON-1959651762 tempest-FlavorsAdminTestJSON-1959651762-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:03.371594 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c5caa5f4-e5ee-47a0-8d1b-79d3c537be11 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.498487 Aug 31 15:58:03.372451 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 322/642] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 15:58:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 500 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 15:58:03.372628 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a0228961-28f7-416e-85b8-56bf6c088ee4 tempest-FlavorsAdminTestJSON-1959651762 tempest-FlavorsAdminTestJSON-1959651762-project-admin] 10.222.0.61 "DELETE /compute/v2.1/flavors/542735581" status: 202 len: 0 microversion: 2.1 time: 0.024975 Aug 31 15:58:03.373710 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 321/643] 10.222.0.61 () {58 vars in 1158 bytes} [Wed Aug 31 15:58:03 2022] DELETE /compute/v2.1/flavors/542735581 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 15:58:03.388265 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-28679e4e-73aa-4303-90df-04750ac74ec7 tempest-FlavorsAdminTestJSON-1959651762 tempest-FlavorsAdminTestJSON-1959651762-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:03.413675 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-28679e4e-73aa-4303-90df-04750ac74ec7 tempest-FlavorsAdminTestJSON-1959651762 tempest-FlavorsAdminTestJSON-1959651762-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.028585 Aug 31 15:58:03.413675 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 323/644] 10.222.0.61 () {58 vars in 1146 bytes} [Wed Aug 31 15:58:03 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:03.419061 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3e055a0f-25d0-43d2-8620-abfdab348f41 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:03.419719 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3e055a0f-25d0-43d2-8620-abfdab348f41 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: 2ddb0b07-9e31-403c-91d5-a278d632d754] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:03.432773 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5799803b-7ef4-4b4b-a08f-ef61d7c3c1e2 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1670394206", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:58:03.437387 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3e055a0f-25d0-43d2-8620-abfdab348f41 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:03.437971 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3e055a0f-25d0-43d2-8620-abfdab348f41 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:03.438650 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3e055a0f-25d0-43d2-8620-abfdab348f41 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:03.440369 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3e055a0f-25d0-43d2-8620-abfdab348f41 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:03.441011 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3e055a0f-25d0-43d2-8620-abfdab348f41 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:03.441454 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3e055a0f-25d0-43d2-8620-abfdab348f41 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:03.490527 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-5799803b-7ef4-4b4b-a08f-ef61d7c3c1e2 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] validate_networks() for None {{(pid=122257) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 15:58:03.670860 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3e055a0f-25d0-43d2-8620-abfdab348f41 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:03.681218 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3e055a0f-25d0-43d2-8620-abfdab348f41 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/2ddb0b07-9e31-403c-91d5-a278d632d754" status: 200 len: 1309 microversion: 2.1 time: 0.265506 Aug 31 15:58:03.694413 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 322/645] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:03 2022] GET /compute/v2.1/servers/2ddb0b07-9e31-403c-91d5-a278d632d754 => generated 1309 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:03.699947 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4807515c-4600-4735-95a1-ca06bf884d70 tempest-FlavorsAdminTestJSON-1959651762 tempest-FlavorsAdminTestJSON-1959651762-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1491869771", "id": 2124367967, "os-flavor-access:is_public": "False"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:58:03.720716 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4807515c-4600-4735-95a1-ca06bf884d70 tempest-FlavorsAdminTestJSON-1959651762 tempest-FlavorsAdminTestJSON-1959651762-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.024770 Aug 31 15:58:03.727821 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 323/646] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 15:58:03 2022] POST /compute/v2.1/flavors => generated 415 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:58:03.733152 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ac48d8d3-908c-4e22-ab4c-742db1d604cb tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:03.733887 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ac48d8d3-908c-4e22-ab4c-742db1d604cb tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] [instance: f977bd90-3cd4-4b07-87f9-42e26b8a530a] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:03.740277 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ac48d8d3-908c-4e22-ab4c-742db1d604cb tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:03.740708 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ac48d8d3-908c-4e22-ab4c-742db1d604cb tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:03.741146 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ac48d8d3-908c-4e22-ab4c-742db1d604cb tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:03.741999 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ac48d8d3-908c-4e22-ab4c-742db1d604cb tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:03.742450 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ac48d8d3-908c-4e22-ab4c-742db1d604cb tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:03.742868 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ac48d8d3-908c-4e22-ab4c-742db1d604cb tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:03.760237 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-5799803b-7ef4-4b4b-a08f-ef61d7c3c1e2 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 15:58:03.760719 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-5799803b-7ef4-4b4b-a08f-ef61d7c3c1e2 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 15:58:03.761195 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-5799803b-7ef4-4b4b-a08f-ef61d7c3c1e2 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 15:58:03.761604 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-5799803b-7ef4-4b4b-a08f-ef61d7c3c1e2 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 15:58:03.762792 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-5799803b-7ef4-4b4b-a08f-ef61d7c3c1e2 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 15:58:03.771775 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5799803b-7ef4-4b4b-a08f-ef61d7c3c1e2 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:03.772636 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5799803b-7ef4-4b4b-a08f-ef61d7c3c1e2 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:03.773133 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5799803b-7ef4-4b4b-a08f-ef61d7c3c1e2 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:03.773960 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5799803b-7ef4-4b4b-a08f-ef61d7c3c1e2 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:03.774417 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5799803b-7ef4-4b4b-a08f-ef61d7c3c1e2 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:03.774834 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5799803b-7ef4-4b4b-a08f-ef61d7c3c1e2 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:03.788668 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=7,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:58:03.797018 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-5799803b-7ef4-4b4b-a08f-ef61d7c3c1e2 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Getting quotas for project 1ea45d1b678342ed812f9912e9f07503. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:58:03.803992 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-5799803b-7ef4-4b4b-a08f-ef61d7c3c1e2 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Getting quotas for user 9a03cc5956ca477abacbe0c26bf18750 and project 1ea45d1b678342ed812f9912e9f07503. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:58:03.820204 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5799803b-7ef4-4b4b-a08f-ef61d7c3c1e2 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Going to run 1 instances... {{(pid=122257) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 15:58:03.823411 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5799803b-7ef4-4b4b-a08f-ef61d7c3c1e2 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] [instance: 1dd3a7d9-7ff6-4b6f-b279-ca90c9ddb14b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 15:58:03.878157 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5799803b-7ef4-4b4b-a08f-ef61d7c3c1e2 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.449228 Aug 31 15:58:03.879437 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 324/647] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 15:58:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 451 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 15:58:03.885129 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ac48d8d3-908c-4e22-ab4c-742db1d604cb tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba336e5ac684606b5e0123e454f9a60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad48220bc634a6186547269011ec49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:03.893036 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-aba1b372-3bbf-49a3-9b22-8cd4e8ee3659 tempest-FlavorsAdminTestJSON-1959651762 tempest-FlavorsAdminTestJSON-1959651762-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-869116728", "id": 649302401, "os-flavor-access:is_public": "True"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:58:03.894010 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ac48d8d3-908c-4e22-ab4c-742db1d604cb tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] 10.222.0.61 "GET /compute/v2.1/servers/f977bd90-3cd4-4b07-87f9-42e26b8a530a" status: 200 len: 1313 microversion: 2.1 time: 0.171624 Aug 31 15:58:03.899219 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 324/648] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:03 2022] GET /compute/v2.1/servers/f977bd90-3cd4-4b07-87f9-42e26b8a530a => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:03.899572 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c6567a03-c20d-4108-9f87-35e78f3304a3 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:03.900407 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c6567a03-c20d-4108-9f87-35e78f3304a3 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] [instance: 1dd3a7d9-7ff6-4b6f-b279-ca90c9ddb14b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:03.918650 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-aba1b372-3bbf-49a3-9b22-8cd4e8ee3659 tempest-FlavorsAdminTestJSON-1959651762 tempest-FlavorsAdminTestJSON-1959651762-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.037799 Aug 31 15:58:03.925679 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 325/649] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 15:58:03 2022] POST /compute/v2.1/flavors => generated 410 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:58:03.931099 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-de6e45b0-5e9d-4d6f-91ae-ea36e82e34bf tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:03.932467 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-de6e45b0-5e9d-4d6f-91ae-ea36e82e34bf tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] [instance: 68edc4cf-5ffe-47e3-89d0-4e4fa7aebca2] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:03.938598 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-de6e45b0-5e9d-4d6f-91ae-ea36e82e34bf tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:03.939177 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-de6e45b0-5e9d-4d6f-91ae-ea36e82e34bf tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:03.939640 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-de6e45b0-5e9d-4d6f-91ae-ea36e82e34bf tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:03.940411 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-de6e45b0-5e9d-4d6f-91ae-ea36e82e34bf tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:03.940927 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-de6e45b0-5e9d-4d6f-91ae-ea36e82e34bf tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:03.941415 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-de6e45b0-5e9d-4d6f-91ae-ea36e82e34bf tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:03.961037 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c6567a03-c20d-4108-9f87-35e78f3304a3 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a03cc5956ca477abacbe0c26bf18750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea45d1b678342ed812f9912e9f07503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:03.970083 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c6567a03-c20d-4108-9f87-35e78f3304a3 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] 10.222.0.61 "GET /compute/v2.1/servers/1dd3a7d9-7ff6-4b6f-b279-ca90c9ddb14b" status: 200 len: 1214 microversion: 2.1 time: 0.074277 Aug 31 15:58:03.971224 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 325/650] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:03 2022] GET /compute/v2.1/servers/1dd3a7d9-7ff6-4b6f-b279-ca90c9ddb14b => generated 1214 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:03.981485 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-eed06009-ff26-48ca-9339-c9f8f281a2a2 tempest-FlavorsAdminTestJSON-1959651762 tempest-FlavorsAdminTestJSON-1959651762-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:04.000122 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-eed06009-ff26-48ca-9339-c9f8f281a2a2 tempest-FlavorsAdminTestJSON-1959651762 tempest-FlavorsAdminTestJSON-1959651762-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 418 microversion: 2.1 time: 0.023270 Aug 31 15:58:04.000856 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 326/651] 10.222.0.61 () {58 vars in 1169 bytes} [Wed Aug 31 15:58:03 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 418 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:58:04.005465 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-fce237a4-7851-4e68-86e4-cb1b3368adc1 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:04.006065 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-fce237a4-7851-4e68-86e4-cb1b3368adc1 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 8555b294-db38-4246-ac58-035cb2acc70e] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:04.012530 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fce237a4-7851-4e68-86e4-cb1b3368adc1 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:04.013014 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fce237a4-7851-4e68-86e4-cb1b3368adc1 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:04.013445 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fce237a4-7851-4e68-86e4-cb1b3368adc1 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:04.014142 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fce237a4-7851-4e68-86e4-cb1b3368adc1 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:04.014593 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fce237a4-7851-4e68-86e4-cb1b3368adc1 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:04.015218 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fce237a4-7851-4e68-86e4-cb1b3368adc1 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:04.101714 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-fce237a4-7851-4e68-86e4-cb1b3368adc1 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:04.112571 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-fce237a4-7851-4e68-86e4-cb1b3368adc1 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:04.113213 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-de6e45b0-5e9d-4d6f-91ae-ea36e82e34bf tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad29bb9427d446ee8c0d237b218ac2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da6682c394444a1a286232fc0c2683d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:04.114221 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-fce237a4-7851-4e68-86e4-cb1b3368adc1 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:04.115737 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-fce237a4-7851-4e68-86e4-cb1b3368adc1 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/8555b294-db38-4246-ac58-035cb2acc70e" status: 200 len: 1265 microversion: 2.25 time: 0.113693 Aug 31 15:58:04.116555 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 327/652] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:58:04 2022] GET /compute/v2.1/servers/8555b294-db38-4246-ac58-035cb2acc70e => generated 1265 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:04.121646 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b082754d-35ec-499c-bcd3-9362778b3e11 tempest-FlavorsAdminTestJSON-1959651762 tempest-FlavorsAdminTestJSON-1959651762-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:04.121783 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-de6e45b0-5e9d-4d6f-91ae-ea36e82e34bf tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] 10.222.0.61 "GET /compute/v2.1/servers/68edc4cf-5ffe-47e3-89d0-4e4fa7aebca2" status: 200 len: 1479 microversion: 2.1 time: 0.200009 Aug 31 15:58:04.122243 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 326/653] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:03 2022] GET /compute/v2.1/servers/68edc4cf-5ffe-47e3-89d0-4e4fa7aebca2 => generated 1479 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:04.132030 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b082754d-35ec-499c-bcd3-9362778b3e11 tempest-FlavorsAdminTestJSON-1959651762 tempest-FlavorsAdminTestJSON-1959651762-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 418 microversion: 2.1 time: 0.014146 Aug 31 15:58:04.132776 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 328/654] 10.222.0.61 () {58 vars in 1177 bytes} [Wed Aug 31 15:58:04 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 418 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:58:04.146354 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-be5549e0-2ca2-4e89-880c-cf54f5b28a16 tempest-FlavorsAdminTestJSON-1959651762 tempest-FlavorsAdminTestJSON-1959651762-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:04.165427 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-be5549e0-2ca2-4e89-880c-cf54f5b28a16 tempest-FlavorsAdminTestJSON-1959651762 tempest-FlavorsAdminTestJSON-1959651762-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 418 microversion: 2.1 time: 0.022742 Aug 31 15:58:04.166068 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 327/655] 10.222.0.61 () {58 vars in 1171 bytes} [Wed Aug 31 15:58:04 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 418 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:58:04.178398 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ab207888-569f-488c-9509-a686db43b4f0 tempest-FlavorsAdminTestJSON-1959651762 tempest-FlavorsAdminTestJSON-1959651762-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:04.189990 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ab207888-569f-488c-9509-a686db43b4f0 tempest-FlavorsAdminTestJSON-1959651762 tempest-FlavorsAdminTestJSON-1959651762-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 418 microversion: 2.1 time: 0.015443 Aug 31 15:58:04.190552 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 329/656] 10.222.0.61 () {58 vars in 1169 bytes} [Wed Aug 31 15:58:04 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 418 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:58:04.202873 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-66b9b2e2-c862-4061-9723-525d32b06448 tempest-FlavorsAdminTestJSON-1959651762 tempest-FlavorsAdminTestJSON-1959651762-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:04.224207 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-66b9b2e2-c862-4061-9723-525d32b06448 tempest-FlavorsAdminTestJSON-1959651762 tempest-FlavorsAdminTestJSON-1959651762-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 6217 microversion: 2.1 time: 0.024732 Aug 31 15:58:04.224726 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 328/657] 10.222.0.61 () {58 vars in 1169 bytes} [Wed Aug 31 15:58:04 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 6217 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:04.242181 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-599d679d-3309-4b2a-a4d5-2993f6b371f0 tempest-FlavorsAdminTestJSON-1959651762 tempest-FlavorsAdminTestJSON-1959651762-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:04.266307 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-599d679d-3309-4b2a-a4d5-2993f6b371f0 tempest-FlavorsAdminTestJSON-1959651762 tempest-FlavorsAdminTestJSON-1959651762-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 6217 microversion: 2.1 time: 0.027648 Aug 31 15:58:04.267046 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 330/658] 10.222.0.61 () {58 vars in 1175 bytes} [Wed Aug 31 15:58:04 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 6217 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:04.270663 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5124fdad-2c2c-4aec-84a0-1e8f77e277c6 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:04.271084 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5124fdad-2c2c-4aec-84a0-1e8f77e277c6 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] [instance: 1b233a49-d4f5-412d-8239-74df4ce63aa5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:04.278138 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5124fdad-2c2c-4aec-84a0-1e8f77e277c6 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:04.278714 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5124fdad-2c2c-4aec-84a0-1e8f77e277c6 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:04.279328 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5124fdad-2c2c-4aec-84a0-1e8f77e277c6 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:04.280307 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5124fdad-2c2c-4aec-84a0-1e8f77e277c6 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:04.280982 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5124fdad-2c2c-4aec-84a0-1e8f77e277c6 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:04.281614 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5124fdad-2c2c-4aec-84a0-1e8f77e277c6 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:04.286717 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1c609f54-063d-4b93-b037-f2498fb57404 tempest-FlavorsAdminTestJSON-1959651762 tempest-FlavorsAdminTestJSON-1959651762-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:04.308896 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1c609f54-063d-4b93-b037-f2498fb57404 tempest-FlavorsAdminTestJSON-1959651762 tempest-FlavorsAdminTestJSON-1959651762-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 6217 microversion: 2.1 time: 0.025689 Aug 31 15:58:04.309851 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 331/659] 10.222.0.61 () {58 vars in 1173 bytes} [Wed Aug 31 15:58:04 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 6217 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:58:04.331400 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-70aa73be-9c20-4d29-aaed-d8c27dd74aca tempest-FlavorsAdminTestJSON-1959651762 tempest-FlavorsAdminTestJSON-1959651762-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:04.362752 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-70aa73be-9c20-4d29-aaed-d8c27dd74aca tempest-FlavorsAdminTestJSON-1959651762 tempest-FlavorsAdminTestJSON-1959651762-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 6217 microversion: 2.1 time: 0.037019 Aug 31 15:58:04.376136 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 332/660] 10.222.0.61 () {58 vars in 1169 bytes} [Wed Aug 31 15:58:04 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 6217 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:04.383184 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-699c4c58-6c5d-47ae-adec-76f301f0a895 tempest-FlavorsAdminTestJSON-1959651762 tempest-FlavorsAdminTestJSON-1959651762-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:04.407087 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-699c4c58-6c5d-47ae-adec-76f301f0a895 tempest-FlavorsAdminTestJSON-1959651762 tempest-FlavorsAdminTestJSON-1959651762-project-admin] 10.222.0.61 "DELETE /compute/v2.1/flavors/649302401" status: 202 len: 0 microversion: 2.1 time: 0.028070 Aug 31 15:58:04.409002 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 333/661] 10.222.0.61 () {58 vars in 1158 bytes} [Wed Aug 31 15:58:04 2022] DELETE /compute/v2.1/flavors/649302401 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 15:58:04.419429 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7c7d73e7-42de-46ad-a270-a6ac9feb32ca tempest-FlavorsAdminTestJSON-1959651762 tempest-FlavorsAdminTestJSON-1959651762-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:04.441034 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7c7d73e7-42de-46ad-a270-a6ac9feb32ca tempest-FlavorsAdminTestJSON-1959651762 tempest-FlavorsAdminTestJSON-1959651762-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.028404 Aug 31 15:58:04.441793 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 334/662] 10.222.0.61 () {58 vars in 1146 bytes} [Wed Aug 31 15:58:04 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:04.471591 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f3458ecf-2288-4452-8ebf-cd3761566ad6 tempest-FlavorsAdminTestJSON-1959651762 tempest-FlavorsAdminTestJSON-1959651762-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:04.476154 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=12,nova_api:INSERT=6 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:58:04.500489 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f3458ecf-2288-4452-8ebf-cd3761566ad6 tempest-FlavorsAdminTestJSON-1959651762 tempest-FlavorsAdminTestJSON-1959651762-project-admin] 10.222.0.61 "DELETE /compute/v2.1/flavors/2124367967" status: 202 len: 0 microversion: 2.1 time: 0.035174 Aug 31 15:58:04.501067 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 335/663] 10.222.0.61 () {58 vars in 1161 bytes} [Wed Aug 31 15:58:04 2022] DELETE /compute/v2.1/flavors/2124367967 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 15:58:04.513388 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5ef24105-c550-433a-8f46-3eb529f4432f tempest-FlavorsAdminTestJSON-1959651762 tempest-FlavorsAdminTestJSON-1959651762-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:04.537468 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5ef24105-c550-433a-8f46-3eb529f4432f tempest-FlavorsAdminTestJSON-1959651762 tempest-FlavorsAdminTestJSON-1959651762-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.031678 Aug 31 15:58:04.538190 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 336/664] 10.222.0.61 () {58 vars in 1146 bytes} [Wed Aug 31 15:58:04 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:04.559173 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-114fc750-e726-4f9d-b6cc-ac03e3d66e92 tempest-FlavorsAdminTestJSON-1959651762 tempest-FlavorsAdminTestJSON-1959651762-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1792231608", "id": 2024921151, "os-flavor-access:is_public": "False"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:58:04.580373 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-114fc750-e726-4f9d-b6cc-ac03e3d66e92 tempest-FlavorsAdminTestJSON-1959651762 tempest-FlavorsAdminTestJSON-1959651762-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.026099 Aug 31 15:58:04.581338 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 337/665] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 15:58:04 2022] POST /compute/v2.1/flavors => generated 415 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 15:58:04.593579 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-bb8d545c-30df-47ff-af3a-b5e9e3ac9003 tempest-FlavorsAdminTestJSON-1959651762 tempest-FlavorsAdminTestJSON-1959651762-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:04.600541 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5124fdad-2c2c-4aec-84a0-1e8f77e277c6 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc04be9f46432fb954d7dbcfe53488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f665e5697c4453c872940b4c0a88772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:04.611046 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5124fdad-2c2c-4aec-84a0-1e8f77e277c6 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] 10.222.0.61 "GET /compute/v2.1/servers/1b233a49-d4f5-412d-8239-74df4ce63aa5" status: 200 len: 1472 microversion: 2.1 time: 0.344747 Aug 31 15:58:04.612308 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 329/666] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:04 2022] GET /compute/v2.1/servers/1b233a49-d4f5-412d-8239-74df4ce63aa5 => generated 1472 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:58:04.622809 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-bb8d545c-30df-47ff-af3a-b5e9e3ac9003 tempest-FlavorsAdminTestJSON-1959651762 tempest-FlavorsAdminTestJSON-1959651762-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.032798 Aug 31 15:58:04.623708 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 338/667] 10.222.0.61 () {58 vars in 1146 bytes} [Wed Aug 31 15:58:04 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:04.643667 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c06f56f4-50ad-4c43-9939-a404d92967ba tempest-FlavorsAdminTestJSON-957775020 tempest-FlavorsAdminTestJSON-957775020-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:04.667651 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c06f56f4-50ad-4c43-9939-a404d92967ba tempest-FlavorsAdminTestJSON-957775020 tempest-FlavorsAdminTestJSON-957775020-project] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.029419 Aug 31 15:58:04.669091 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 330/668] 10.222.0.61 () {58 vars in 1146 bytes} [Wed Aug 31 15:58:04 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:58:04.686807 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c2be85dd-a998-4378-83e6-5d9e2a34c1db tempest-FlavorsAdminTestJSON-1959651762 tempest-FlavorsAdminTestJSON-1959651762-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:04.701508 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-deaff920-dc97-4187-affb-ad19ab81d904 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:04.702174 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-deaff920-dc97-4187-affb-ad19ab81d904 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: 2ddb0b07-9e31-403c-91d5-a278d632d754] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:04.708159 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c2be85dd-a998-4378-83e6-5d9e2a34c1db tempest-FlavorsAdminTestJSON-1959651762 tempest-FlavorsAdminTestJSON-1959651762-project-admin] 10.222.0.61 "DELETE /compute/v2.1/flavors/2024921151" status: 202 len: 0 microversion: 2.1 time: 0.024621 Aug 31 15:58:04.709152 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 339/669] 10.222.0.61 () {58 vars in 1161 bytes} [Wed Aug 31 15:58:04 2022] DELETE /compute/v2.1/flavors/2024921151 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 15:58:04.713829 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-deaff920-dc97-4187-affb-ad19ab81d904 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:04.715232 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-deaff920-dc97-4187-affb-ad19ab81d904 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:04.715915 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-deaff920-dc97-4187-affb-ad19ab81d904 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:04.716703 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-deaff920-dc97-4187-affb-ad19ab81d904 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:04.717165 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-deaff920-dc97-4187-affb-ad19ab81d904 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:04.718487 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-deaff920-dc97-4187-affb-ad19ab81d904 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:04.720111 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4313b8b9-8056-4c4e-95d0-25872f7997df tempest-FlavorsAdminTestJSON-1959651762 tempest-FlavorsAdminTestJSON-1959651762-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:04.749450 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4313b8b9-8056-4c4e-95d0-25872f7997df tempest-FlavorsAdminTestJSON-1959651762 tempest-FlavorsAdminTestJSON-1959651762-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.035599 Aug 31 15:58:04.750186 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 340/670] 10.222.0.61 () {58 vars in 1146 bytes} [Wed Aug 31 15:58:04 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:58:04.769299 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3cb5dc08-b17c-4cb1-8478-b28e935999ec tempest-FlavorsAdminTestJSON-1959651762 tempest-FlavorsAdminTestJSON-1959651762-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1736056329", "id": 2058111039, "os-flavor-access:is_public": "True"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:58:04.787979 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3cb5dc08-b17c-4cb1-8478-b28e935999ec tempest-FlavorsAdminTestJSON-1959651762 tempest-FlavorsAdminTestJSON-1959651762-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.022220 Aug 31 15:58:04.789392 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 341/671] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 15:58:04 2022] POST /compute/v2.1/flavors => generated 414 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 15:58:04.801583 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1f7c3255-71d9-4956-8b16-4e4dfd0d9d9d tempest-FlavorsAdminTestJSON-957775020 tempest-FlavorsAdminTestJSON-957775020-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:04.827642 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1f7c3255-71d9-4956-8b16-4e4dfd0d9d9d tempest-FlavorsAdminTestJSON-957775020 tempest-FlavorsAdminTestJSON-957775020-project] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 6221 microversion: 2.1 time: 0.029029 Aug 31 15:58:04.828958 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 342/672] 10.222.0.61 () {58 vars in 1146 bytes} [Wed Aug 31 15:58:04 2022] GET /compute/v2.1/flavors/detail => generated 6221 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:04.848024 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a5ff2477-579c-4a0e-80fb-488da79cc1f0 tempest-FlavorsAdminTestJSON-1959651762 tempest-FlavorsAdminTestJSON-1959651762-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:04.868685 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a5ff2477-579c-4a0e-80fb-488da79cc1f0 tempest-FlavorsAdminTestJSON-1959651762 tempest-FlavorsAdminTestJSON-1959651762-project-admin] 10.222.0.61 "DELETE /compute/v2.1/flavors/2058111039" status: 202 len: 0 microversion: 2.1 time: 0.024065 Aug 31 15:58:04.869918 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 343/673] 10.222.0.61 () {58 vars in 1161 bytes} [Wed Aug 31 15:58:04 2022] DELETE /compute/v2.1/flavors/2058111039 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 15:58:04.881919 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f37a98f8-6e2b-42c1-9e73-df15c2479b5f tempest-FlavorsAdminTestJSON-1959651762 tempest-FlavorsAdminTestJSON-1959651762-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:04.914592 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f37a98f8-6e2b-42c1-9e73-df15c2479b5f tempest-FlavorsAdminTestJSON-1959651762 tempest-FlavorsAdminTestJSON-1959651762-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.040073 Aug 31 15:58:04.915560 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 344/674] 10.222.0.61 () {58 vars in 1146 bytes} [Wed Aug 31 15:58:04 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:58:04.933431 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a34d379f-62cf-44d2-b9bd-426041db7508 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:04.934375 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a34d379f-62cf-44d2-b9bd-426041db7508 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] [instance: f977bd90-3cd4-4b07-87f9-42e26b8a530a] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:04.946232 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a34d379f-62cf-44d2-b9bd-426041db7508 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:04.946232 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a34d379f-62cf-44d2-b9bd-426041db7508 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:04.946669 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a34d379f-62cf-44d2-b9bd-426041db7508 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:04.953388 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a34d379f-62cf-44d2-b9bd-426041db7508 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:04.953920 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a34d379f-62cf-44d2-b9bd-426041db7508 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:04.954380 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a34d379f-62cf-44d2-b9bd-426041db7508 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:05.119713 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-deaff920-dc97-4187-affb-ad19ab81d904 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:05.131862 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-deaff920-dc97-4187-affb-ad19ab81d904 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/2ddb0b07-9e31-403c-91d5-a278d632d754" status: 200 len: 1493 microversion: 2.1 time: 0.434004 Aug 31 15:58:05.136254 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 331/675] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:04 2022] GET /compute/v2.1/servers/2ddb0b07-9e31-403c-91d5-a278d632d754 => generated 1493 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:05.145362 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-49bc0a67-3c8e-4a05-876d-cd7729cef42b tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:05.146671 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-49bc0a67-3c8e-4a05-876d-cd7729cef42b tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] [instance: 1dd3a7d9-7ff6-4b6f-b279-ca90c9ddb14b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:05.162053 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-49bc0a67-3c8e-4a05-876d-cd7729cef42b tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:05.162824 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-49bc0a67-3c8e-4a05-876d-cd7729cef42b tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:05.163923 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-49bc0a67-3c8e-4a05-876d-cd7729cef42b tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:05.165607 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-49bc0a67-3c8e-4a05-876d-cd7729cef42b tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:05.167257 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-49bc0a67-3c8e-4a05-876d-cd7729cef42b tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:05.168263 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-49bc0a67-3c8e-4a05-876d-cd7729cef42b tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:05.343737 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-49bc0a67-3c8e-4a05-876d-cd7729cef42b tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a03cc5956ca477abacbe0c26bf18750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea45d1b678342ed812f9912e9f07503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:05.351296 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-49bc0a67-3c8e-4a05-876d-cd7729cef42b tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] 10.222.0.61 "GET /compute/v2.1/servers/1dd3a7d9-7ff6-4b6f-b279-ca90c9ddb14b" status: 200 len: 1266 microversion: 2.1 time: 0.210650 Aug 31 15:58:05.364178 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 332/676] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:05 2022] GET /compute/v2.1/servers/1dd3a7d9-7ff6-4b6f-b279-ca90c9ddb14b => generated 1266 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:05.369590 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a5d38576-f559-4c6b-9dc0-f2ae23d78559 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:05.370287 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a5d38576-f559-4c6b-9dc0-f2ae23d78559 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 8555b294-db38-4246-ac58-035cb2acc70e] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:05.382977 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a5d38576-f559-4c6b-9dc0-f2ae23d78559 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:05.383475 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a5d38576-f559-4c6b-9dc0-f2ae23d78559 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:05.383939 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a5d38576-f559-4c6b-9dc0-f2ae23d78559 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:05.384845 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a5d38576-f559-4c6b-9dc0-f2ae23d78559 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:05.385185 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a5d38576-f559-4c6b-9dc0-f2ae23d78559 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:05.385796 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a5d38576-f559-4c6b-9dc0-f2ae23d78559 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:05.457433 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a34d379f-62cf-44d2-b9bd-426041db7508 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba336e5ac684606b5e0123e454f9a60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad48220bc634a6186547269011ec49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:05.471112 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a34d379f-62cf-44d2-b9bd-426041db7508 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] 10.222.0.61 "GET /compute/v2.1/servers/f977bd90-3cd4-4b07-87f9-42e26b8a530a" status: 200 len: 1313 microversion: 2.1 time: 0.553667 Aug 31 15:58:05.473871 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 345/677] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:04 2022] GET /compute/v2.1/servers/f977bd90-3cd4-4b07-87f9-42e26b8a530a => generated 1313 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:05.483543 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-447f1be2-2886-4c1d-8a50-0a8f25f9efce tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:05.487798 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-447f1be2-2886-4c1d-8a50-0a8f25f9efce tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] [instance: 68edc4cf-5ffe-47e3-89d0-4e4fa7aebca2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:05.498565 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-447f1be2-2886-4c1d-8a50-0a8f25f9efce tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:05.499713 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-447f1be2-2886-4c1d-8a50-0a8f25f9efce tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:05.500316 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-447f1be2-2886-4c1d-8a50-0a8f25f9efce tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:05.501042 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-447f1be2-2886-4c1d-8a50-0a8f25f9efce tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:05.503181 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-447f1be2-2886-4c1d-8a50-0a8f25f9efce tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:05.504024 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-447f1be2-2886-4c1d-8a50-0a8f25f9efce tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:05.576913 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a5d38576-f559-4c6b-9dc0-f2ae23d78559 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:05.586960 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a5d38576-f559-4c6b-9dc0-f2ae23d78559 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:05.596990 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a5d38576-f559-4c6b-9dc0-f2ae23d78559 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:05.598322 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a5d38576-f559-4c6b-9dc0-f2ae23d78559 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/8555b294-db38-4246-ac58-035cb2acc70e" status: 200 len: 1313 microversion: 2.25 time: 0.233289 Aug 31 15:58:05.612297 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 333/678] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:58:05 2022] GET /compute/v2.1/servers/8555b294-db38-4246-ac58-035cb2acc70e => generated 1313 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:05.629026 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-401ed2f6-01e5-4d58-ba1c-0b981746495a tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:05.629582 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-401ed2f6-01e5-4d58-ba1c-0b981746495a tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] [instance: 2ddb0b07-9e31-403c-91d5-a278d632d754] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:05.643859 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-401ed2f6-01e5-4d58-ba1c-0b981746495a tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:05.644372 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-401ed2f6-01e5-4d58-ba1c-0b981746495a tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:05.645646 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-401ed2f6-01e5-4d58-ba1c-0b981746495a tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:05.646520 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-401ed2f6-01e5-4d58-ba1c-0b981746495a tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:05.647658 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-401ed2f6-01e5-4d58-ba1c-0b981746495a tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:05.648306 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-401ed2f6-01e5-4d58-ba1c-0b981746495a tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:06.233561 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-447f1be2-2886-4c1d-8a50-0a8f25f9efce tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad29bb9427d446ee8c0d237b218ac2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da6682c394444a1a286232fc0c2683d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:06.246371 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-447f1be2-2886-4c1d-8a50-0a8f25f9efce tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] 10.222.0.61 "GET /compute/v2.1/servers/68edc4cf-5ffe-47e3-89d0-4e4fa7aebca2" status: 200 len: 1479 microversion: 2.1 time: 0.771370 Aug 31 15:58:06.247632 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 346/679] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:05 2022] GET /compute/v2.1/servers/68edc4cf-5ffe-47e3-89d0-4e4fa7aebca2 => generated 1479 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:06.257495 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1df2099b-3d05-416c-9576-9ae720b47625 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:06.258350 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1df2099b-3d05-416c-9576-9ae720b47625 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] [instance: 1b233a49-d4f5-412d-8239-74df4ce63aa5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:06.268143 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1df2099b-3d05-416c-9576-9ae720b47625 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:06.268652 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1df2099b-3d05-416c-9576-9ae720b47625 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:06.269151 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1df2099b-3d05-416c-9576-9ae720b47625 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:06.269923 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1df2099b-3d05-416c-9576-9ae720b47625 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:06.270443 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1df2099b-3d05-416c-9576-9ae720b47625 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:06.270875 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1df2099b-3d05-416c-9576-9ae720b47625 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:06.342404 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-401ed2f6-01e5-4d58-ba1c-0b981746495a tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/2ddb0b07-9e31-403c-91d5-a278d632d754" status: 200 len: 1644 microversion: 2.1 time: 0.726088 Aug 31 15:58:06.346447 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 334/680] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:05 2022] GET /compute/v2.1/servers/2ddb0b07-9e31-403c-91d5-a278d632d754 => generated 1644 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:06.362921 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-efe19092-f525-46fc-89e5-5221a4974cc7 req-887ac583-9e11-4ca2-83c9-3f5d49024210 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b233a49-d4f5-412d-8239-74df4ce63aa5", "name": "network-vif-deleted", "tag": "f56ba330-3206-4322-9474-e01afa8afef9"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:58:06.397303 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-efe19092-f525-46fc-89e5-5221a4974cc7 req-887ac583-9e11-4ca2-83c9-3f5d49024210 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:06.398141 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-efe19092-f525-46fc-89e5-5221a4974cc7 req-887ac583-9e11-4ca2-83c9-3f5d49024210 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:06.398996 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-efe19092-f525-46fc-89e5-5221a4974cc7 req-887ac583-9e11-4ca2-83c9-3f5d49024210 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:06.418347 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1df2099b-3d05-416c-9576-9ae720b47625 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc04be9f46432fb954d7dbcfe53488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f665e5697c4453c872940b4c0a88772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:06.429653 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1df2099b-3d05-416c-9576-9ae720b47625 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] 10.222.0.61 "GET /compute/v2.1/servers/1b233a49-d4f5-412d-8239-74df4ce63aa5" status: 200 len: 1430 microversion: 2.1 time: 0.180717 Aug 31 15:58:06.430845 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 347/681] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:06 2022] GET /compute/v2.1/servers/1b233a49-d4f5-412d-8239-74df4ce63aa5 => generated 1430 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:06.445266 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-efe19092-f525-46fc-89e5-5221a4974cc7 req-887ac583-9e11-4ca2-83c9-3f5d49024210 service nova] Creating event network-vif-deleted:f56ba330-3206-4322-9474-e01afa8afef9 for instance 1b233a49-d4f5-412d-8239-74df4ce63aa5 on n-h1-850499-9 Aug 31 15:58:06.449062 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-07664024-dd54-4fae-b31d-feb76ccd1c82 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:06.449916 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-07664024-dd54-4fae-b31d-feb76ccd1c82 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] [instance: 2ddb0b07-9e31-403c-91d5-a278d632d754] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:06.458860 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-07664024-dd54-4fae-b31d-feb76ccd1c82 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:06.460504 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-efe19092-f525-46fc-89e5-5221a4974cc7 req-887ac583-9e11-4ca2-83c9-3f5d49024210 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110905 Aug 31 15:58:06.461108 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-07664024-dd54-4fae-b31d-feb76ccd1c82 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:06.461226 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 335/682] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 15:58:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:58:06.463714 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-07664024-dd54-4fae-b31d-feb76ccd1c82 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:06.466295 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-07664024-dd54-4fae-b31d-feb76ccd1c82 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:06.466813 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-07664024-dd54-4fae-b31d-feb76ccd1c82 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:06.468057 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-07664024-dd54-4fae-b31d-feb76ccd1c82 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:06.481129 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3b3427bd-8256-4c66-80f3-d86d7be80e95 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:06.482031 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3b3427bd-8256-4c66-80f3-d86d7be80e95 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] [instance: 1dd3a7d9-7ff6-4b6f-b279-ca90c9ddb14b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:06.489046 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3b3427bd-8256-4c66-80f3-d86d7be80e95 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:06.489624 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3b3427bd-8256-4c66-80f3-d86d7be80e95 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:06.490149 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3b3427bd-8256-4c66-80f3-d86d7be80e95 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:06.490933 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3b3427bd-8256-4c66-80f3-d86d7be80e95 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:06.492344 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3b3427bd-8256-4c66-80f3-d86d7be80e95 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:06.493604 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3b3427bd-8256-4c66-80f3-d86d7be80e95 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:06.729677 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3b3427bd-8256-4c66-80f3-d86d7be80e95 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a03cc5956ca477abacbe0c26bf18750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea45d1b678342ed812f9912e9f07503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:06.732402 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:58:06.745158 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3b3427bd-8256-4c66-80f3-d86d7be80e95 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] 10.222.0.61 "GET /compute/v2.1/servers/1dd3a7d9-7ff6-4b6f-b279-ca90c9ddb14b" status: 200 len: 1274 microversion: 2.1 time: 0.278886 Aug 31 15:58:06.763525 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 336/683] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:06 2022] GET /compute/v2.1/servers/1dd3a7d9-7ff6-4b6f-b279-ca90c9ddb14b => generated 1274 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:06.763525 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1643ff10-d8bb-451d-addd-d8789c88ae32 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:06.763525 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1643ff10-d8bb-451d-addd-d8789c88ae32 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] [instance: f977bd90-3cd4-4b07-87f9-42e26b8a530a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:06.781875 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1643ff10-d8bb-451d-addd-d8789c88ae32 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:06.782380 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1643ff10-d8bb-451d-addd-d8789c88ae32 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:06.782822 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1643ff10-d8bb-451d-addd-d8789c88ae32 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:06.783560 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1643ff10-d8bb-451d-addd-d8789c88ae32 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:06.784831 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1643ff10-d8bb-451d-addd-d8789c88ae32 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:06.784831 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1643ff10-d8bb-451d-addd-d8789c88ae32 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:07.113752 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-07664024-dd54-4fae-b31d-feb76ccd1c82 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/2ddb0b07-9e31-403c-91d5-a278d632d754" status: 200 len: 1644 microversion: 2.1 time: 0.679889 Aug 31 15:58:07.120273 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 348/684] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:06 2022] GET /compute/v2.1/servers/2ddb0b07-9e31-403c-91d5-a278d632d754 => generated 1644 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:07.125294 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e5c1e152-46c6-4e52-81c0-cf151e6410bf tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:07.125933 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e5c1e152-46c6-4e52-81c0-cf151e6410bf tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 8555b294-db38-4246-ac58-035cb2acc70e] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:07.144200 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e5c1e152-46c6-4e52-81c0-cf151e6410bf tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:07.144953 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e5c1e152-46c6-4e52-81c0-cf151e6410bf tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:07.145559 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e5c1e152-46c6-4e52-81c0-cf151e6410bf tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:07.146456 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e5c1e152-46c6-4e52-81c0-cf151e6410bf tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:07.147142 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e5c1e152-46c6-4e52-81c0-cf151e6410bf tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:07.147807 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e5c1e152-46c6-4e52-81c0-cf151e6410bf tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:07.386044 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e5c1e152-46c6-4e52-81c0-cf151e6410bf tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:07.396669 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e5c1e152-46c6-4e52-81c0-cf151e6410bf tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:07.399365 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-1643ff10-d8bb-451d-addd-d8789c88ae32 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba336e5ac684606b5e0123e454f9a60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad48220bc634a6186547269011ec49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:07.402330 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e5c1e152-46c6-4e52-81c0-cf151e6410bf tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:07.405845 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e5c1e152-46c6-4e52-81c0-cf151e6410bf tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/8555b294-db38-4246-ac58-035cb2acc70e" status: 200 len: 1319 microversion: 2.25 time: 0.284284 Aug 31 15:58:07.416380 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 349/685] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:58:07 2022] GET /compute/v2.1/servers/8555b294-db38-4246-ac58-035cb2acc70e => generated 1319 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:07.419745 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1643ff10-d8bb-451d-addd-d8789c88ae32 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] 10.222.0.61 "GET /compute/v2.1/servers/f977bd90-3cd4-4b07-87f9-42e26b8a530a" status: 200 len: 1313 microversion: 2.1 time: 0.667497 Aug 31 15:58:07.424494 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 337/686] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:06 2022] GET /compute/v2.1/servers/f977bd90-3cd4-4b07-87f9-42e26b8a530a => generated 1313 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:07.432700 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7dcbc75c-5e8c-4852-abb1-80d269db607e tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:07.436729 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7dcbc75c-5e8c-4852-abb1-80d269db607e tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:07.437728 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7dcbc75c-5e8c-4852-abb1-80d269db607e tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:07.437910 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7dcbc75c-5e8c-4852-abb1-80d269db607e tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:07.438747 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7dcbc75c-5e8c-4852-abb1-80d269db607e tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:07.444140 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7dcbc75c-5e8c-4852-abb1-80d269db607e tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:07.444702 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7dcbc75c-5e8c-4852-abb1-80d269db607e tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:07.452884 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8b533d75-10d4-4d9c-b9d2-9c5bd86cbc23 tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:07.458407 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8b533d75-10d4-4d9c-b9d2-9c5bd86cbc23 tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] [instance: 68edc4cf-5ffe-47e3-89d0-4e4fa7aebca2] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:07.473631 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b533d75-10d4-4d9c-b9d2-9c5bd86cbc23 tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:07.480766 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b533d75-10d4-4d9c-b9d2-9c5bd86cbc23 tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:07.481522 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b533d75-10d4-4d9c-b9d2-9c5bd86cbc23 tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:07.482325 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b533d75-10d4-4d9c-b9d2-9c5bd86cbc23 tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:07.482813 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b533d75-10d4-4d9c-b9d2-9c5bd86cbc23 tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:07.483546 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b533d75-10d4-4d9c-b9d2-9c5bd86cbc23 tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:07.501278 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7dcbc75c-5e8c-4852-abb1-80d269db607e tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] 10.222.0.61 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.083626 Aug 31 15:58:07.502216 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 350/687] 10.222.0.61 () {58 vars in 1176 bytes} [Wed Aug 31 15:58:07 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:58:07.513088 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d56b76da-c8ef-416e-aaac-3abfcadb862b tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:07.516217 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d56b76da-c8ef-416e-aaac-3abfcadb862b tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] [instance: 1b233a49-d4f5-412d-8239-74df4ce63aa5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:07.532945 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d56b76da-c8ef-416e-aaac-3abfcadb862b tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:07.533730 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d56b76da-c8ef-416e-aaac-3abfcadb862b tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:07.534564 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d56b76da-c8ef-416e-aaac-3abfcadb862b tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:07.535386 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d56b76da-c8ef-416e-aaac-3abfcadb862b tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:07.536896 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d56b76da-c8ef-416e-aaac-3abfcadb862b tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:07.539974 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d56b76da-c8ef-416e-aaac-3abfcadb862b tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:07.564601 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b533d75-10d4-4d9c-b9d2-9c5bd86cbc23 tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:07.566200 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b533d75-10d4-4d9c-b9d2-9c5bd86cbc23 tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:07.567912 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b533d75-10d4-4d9c-b9d2-9c5bd86cbc23 tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:07.568604 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-8b533d75-10d4-4d9c-b9d2-9c5bd86cbc23 tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Lazy-loading 'fault' on Instance uuid 68edc4cf-5ffe-47e3-89d0-4e4fa7aebca2 {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:58:07.620421 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d56b76da-c8ef-416e-aaac-3abfcadb862b tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:07.620914 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d56b76da-c8ef-416e-aaac-3abfcadb862b tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:07.623217 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d56b76da-c8ef-416e-aaac-3abfcadb862b tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:07.624738 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-d56b76da-c8ef-416e-aaac-3abfcadb862b tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lazy-loading 'fault' on Instance uuid 1b233a49-d4f5-412d-8239-74df4ce63aa5 {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:58:07.693003 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8b533d75-10d4-4d9c-b9d2-9c5bd86cbc23 tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad29bb9427d446ee8c0d237b218ac2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da6682c394444a1a286232fc0c2683d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:07.701121 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8b533d75-10d4-4d9c-b9d2-9c5bd86cbc23 tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] 10.222.0.61 "GET /compute/v2.1/servers/68edc4cf-5ffe-47e3-89d0-4e4fa7aebca2" status: 200 len: 1313 microversion: 2.1 time: 0.270801 Aug 31 15:58:07.701475 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 338/688] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:07 2022] GET /compute/v2.1/servers/68edc4cf-5ffe-47e3-89d0-4e4fa7aebca2 => generated 1313 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:07.713636 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e760b701-92b1-4ba6-9b57-9f2f5be76d6c tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:58:07.717464 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e760b701-92b1-4ba6-9b57-9f2f5be76d6c tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] [instance: 2ddb0b07-9e31-403c-91d5-a278d632d754] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:07.732417 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e760b701-92b1-4ba6-9b57-9f2f5be76d6c tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:07.733094 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e760b701-92b1-4ba6-9b57-9f2f5be76d6c tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:07.733608 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e760b701-92b1-4ba6-9b57-9f2f5be76d6c tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:07.734436 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e760b701-92b1-4ba6-9b57-9f2f5be76d6c tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:07.735046 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e760b701-92b1-4ba6-9b57-9f2f5be76d6c tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:07.735570 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e760b701-92b1-4ba6-9b57-9f2f5be76d6c tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:07.761069 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d56b76da-c8ef-416e-aaac-3abfcadb862b tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc04be9f46432fb954d7dbcfe53488', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f665e5697c4453c872940b4c0a88772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:07.784072 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d56b76da-c8ef-416e-aaac-3abfcadb862b tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] 10.222.0.61 "GET /compute/v2.1/servers/1b233a49-d4f5-412d-8239-74df4ce63aa5" status: 200 len: 1306 microversion: 2.1 time: 0.270198 Aug 31 15:58:07.785605 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 351/689] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:07 2022] GET /compute/v2.1/servers/1b233a49-d4f5-412d-8239-74df4ce63aa5 => generated 1306 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:07.797706 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2afaa84b-92dc-40b0-a6ee-ec52592bac6e tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:07.798721 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2afaa84b-92dc-40b0-a6ee-ec52592bac6e tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] [instance: 1dd3a7d9-7ff6-4b6f-b279-ca90c9ddb14b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:07.819910 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2afaa84b-92dc-40b0-a6ee-ec52592bac6e tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:07.824324 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2afaa84b-92dc-40b0-a6ee-ec52592bac6e tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:07.824977 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2afaa84b-92dc-40b0-a6ee-ec52592bac6e tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:07.825904 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2afaa84b-92dc-40b0-a6ee-ec52592bac6e tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:07.829239 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2afaa84b-92dc-40b0-a6ee-ec52592bac6e tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:07.829692 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2afaa84b-92dc-40b0-a6ee-ec52592bac6e tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:07.839895 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e760b701-92b1-4ba6-9b57-9f2f5be76d6c tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/2ddb0b07-9e31-403c-91d5-a278d632d754/action" status: 202 len: 0 microversion: 2.1 time: 0.137043 Aug 31 15:58:07.841451 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 339/690] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 15:58:07 2022] POST /compute/v2.1/servers/2ddb0b07-9e31-403c-91d5-a278d632d754/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 15:58:07.889908 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-55523108-c206-416a-a071-1f55a860879f tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:07.895379 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-55523108-c206-416a-a071-1f55a860879f tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] [instance: 2ddb0b07-9e31-403c-91d5-a278d632d754] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:07.921474 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-55523108-c206-416a-a071-1f55a860879f tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:07.922902 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-55523108-c206-416a-a071-1f55a860879f tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:07.924699 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-55523108-c206-416a-a071-1f55a860879f tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:07.928596 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-55523108-c206-416a-a071-1f55a860879f tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:07.930054 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-55523108-c206-416a-a071-1f55a860879f tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:07.933439 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-55523108-c206-416a-a071-1f55a860879f tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:08.011748 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-2afaa84b-92dc-40b0-a6ee-ec52592bac6e tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a03cc5956ca477abacbe0c26bf18750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea45d1b678342ed812f9912e9f07503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:08.021733 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2afaa84b-92dc-40b0-a6ee-ec52592bac6e tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] 10.222.0.61 "GET /compute/v2.1/servers/1dd3a7d9-7ff6-4b6f-b279-ca90c9ddb14b" status: 200 len: 1272 microversion: 2.1 time: 0.232453 Aug 31 15:58:08.023659 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 352/691] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:07 2022] GET /compute/v2.1/servers/1dd3a7d9-7ff6-4b6f-b279-ca90c9ddb14b => generated 1272 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:08.243719 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-55523108-c206-416a-a071-1f55a860879f tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/2ddb0b07-9e31-403c-91d5-a278d632d754" status: 200 len: 1649 microversion: 2.1 time: 0.378387 Aug 31 15:58:08.260946 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 340/692] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:07 2022] GET /compute/v2.1/servers/2ddb0b07-9e31-403c-91d5-a278d632d754 => generated 1649 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:08.441315 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-cd618bff-7e7a-4115-b4a7-464566a56776 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:08.441946 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-cd618bff-7e7a-4115-b4a7-464566a56776 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 8555b294-db38-4246-ac58-035cb2acc70e] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:08.451749 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cd618bff-7e7a-4115-b4a7-464566a56776 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:08.452363 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cd618bff-7e7a-4115-b4a7-464566a56776 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:08.453147 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cd618bff-7e7a-4115-b4a7-464566a56776 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:08.456195 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cd618bff-7e7a-4115-b4a7-464566a56776 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:08.456711 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cd618bff-7e7a-4115-b4a7-464566a56776 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:08.457700 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4404eabf-042a-47d5-be44-f1f7ecf0a97e tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:08.458415 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4404eabf-042a-47d5-be44-f1f7ecf0a97e tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] [instance: f977bd90-3cd4-4b07-87f9-42e26b8a530a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:08.459981 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cd618bff-7e7a-4115-b4a7-464566a56776 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:08.468153 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4404eabf-042a-47d5-be44-f1f7ecf0a97e tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:08.468680 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4404eabf-042a-47d5-be44-f1f7ecf0a97e tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:08.469195 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4404eabf-042a-47d5-be44-f1f7ecf0a97e tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:08.472568 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4404eabf-042a-47d5-be44-f1f7ecf0a97e tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:08.473113 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4404eabf-042a-47d5-be44-f1f7ecf0a97e tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:08.473615 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4404eabf-042a-47d5-be44-f1f7ecf0a97e tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:08.510550 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=100 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:58:08.589952 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-cd618bff-7e7a-4115-b4a7-464566a56776 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:08.600053 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-cd618bff-7e7a-4115-b4a7-464566a56776 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:08.601514 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-cd618bff-7e7a-4115-b4a7-464566a56776 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:08.602820 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-cd618bff-7e7a-4115-b4a7-464566a56776 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/8555b294-db38-4246-ac58-035cb2acc70e" status: 200 len: 1319 microversion: 2.25 time: 0.166120 Aug 31 15:58:08.605280 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 353/693] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:58:08 2022] GET /compute/v2.1/servers/8555b294-db38-4246-ac58-035cb2acc70e => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:08.622418 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-01df9ba2-a956-4a9f-ac11-911881606f33 req-54de9645-6f5c-44c5-b1b8-afe83081abbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68edc4cf-5ffe-47e3-89d0-4e4fa7aebca2", "name": "network-vif-deleted", "tag": "ba8ded58-5868-4341-b926-2dbd9dcb0b3a"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:58:08.637151 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-01df9ba2-a956-4a9f-ac11-911881606f33 req-54de9645-6f5c-44c5-b1b8-afe83081abbf service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:08.638285 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-01df9ba2-a956-4a9f-ac11-911881606f33 req-54de9645-6f5c-44c5-b1b8-afe83081abbf service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:08.638737 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-01df9ba2-a956-4a9f-ac11-911881606f33 req-54de9645-6f5c-44c5-b1b8-afe83081abbf service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:08.654622 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-01df9ba2-a956-4a9f-ac11-911881606f33 req-54de9645-6f5c-44c5-b1b8-afe83081abbf service nova] Creating event network-vif-deleted:ba8ded58-5868-4341-b926-2dbd9dcb0b3a for instance 68edc4cf-5ffe-47e3-89d0-4e4fa7aebca2 on n-h1-850499-9 Aug 31 15:58:08.662929 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-01df9ba2-a956-4a9f-ac11-911881606f33 req-54de9645-6f5c-44c5-b1b8-afe83081abbf service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055965 Aug 31 15:58:08.663923 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 354/694] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 15:58:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:58:08.729821 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-178ba471-4be3-42c3-aee2-8aa8d411b592 tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:08.732343 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-178ba471-4be3-42c3-aee2-8aa8d411b592 tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] [instance: 68edc4cf-5ffe-47e3-89d0-4e4fa7aebca2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:08.743482 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-178ba471-4be3-42c3-aee2-8aa8d411b592 tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:08.744132 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-178ba471-4be3-42c3-aee2-8aa8d411b592 tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:08.745663 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-178ba471-4be3-42c3-aee2-8aa8d411b592 tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:08.749243 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-178ba471-4be3-42c3-aee2-8aa8d411b592 tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:08.749911 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-178ba471-4be3-42c3-aee2-8aa8d411b592 tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:08.753225 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-178ba471-4be3-42c3-aee2-8aa8d411b592 tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:08.803358 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-178ba471-4be3-42c3-aee2-8aa8d411b592 tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] HTTP exception thrown: Instance 68edc4cf-5ffe-47e3-89d0-4e4fa7aebca2 could not be found. Aug 31 15:58:08.810552 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-178ba471-4be3-42c3-aee2-8aa8d411b592 tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Request method failure captured: Aug 31 15:58:08.810552 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/68edc4cf-5ffe-47e3-89d0-4e4fa7aebca2 HTTP/1.1 Aug 31 15:58:08.810552 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 15:58:08.810552 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 15:58:08.810552 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 15:58:08.810552 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 15:58:08.810552 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 15:58:08.810552 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 15:58:08.810552 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 15:58:08.810552 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 15:58:08.810552 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4TzcSVLmuErnyhPtmsP4wykIRafmz2HBBPJmyG4k-eG7ZeGwM8kIN_LvWacJbattOGcpWz0uZ5bayjTahSSnRf6to742RtAHn7O595BjRy6y_uJ2BpnF7qmZHfhWakW6XgjXfq8if5G_arrkuQHVevdtqSn-iqL0s6edii-g-vdaj0 Aug 31 15:58:08.810552 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 15:58:08.810552 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 15:58:08.810552 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 15:58:08.810552 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 15:58:08.810552 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 15:58:08.810552 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 15:58:08.810552 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 4da6682c394444a1a286232fc0c2683d Aug 31 15:58:08.810552 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1031522993 Aug 31 15:58:08.810552 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 15:58:08.810552 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 15:58:08.812205 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4da6682c394444a1a286232fc0c2683d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/4da6682c394444a1a286232fc0c2683d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_4da6682c394444a1a286232fc0c2683d", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4da6682c394444a1a286232fc0c2683d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 15:58:08.812205 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1031522993 Aug 31 15:58:08.812205 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 4da6682c394444a1a286232fc0c2683d Aug 31 15:58:08.812205 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1031522993 Aug 31 15:58:08.812205 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ServerDiagnosticsNegativeTest-1031522993-project Aug 31 15:58:08.812205 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 15:58:08.812205 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 15:58:08.812205 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: ad29bb9427d446ee8c0d237b218ac2f2 Aug 31 15:58:08.812205 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1031522993-project Aug 31 15:58:08.812205 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 15:58:08.812205 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance 68edc4cf-5ffe-47e3-89d0-4e4fa7aebca2 could not be found. Aug 31 15:58:08.812205 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '68edc4cf-5ffe-47e3-89d0-4e4fa7aebca2'} Aug 31 15:58:08.813072 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:58:08.813072 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:58:08.813072 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 15:58:08.813072 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 15:58:08.813072 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 15:58:08.813072 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 15:58:08.813072 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 15:58:08.813072 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 15:58:08.813072 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 15:58:08.813072 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 15:58:08.813072 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68edc4cf-5ffe-47e3-89d0-4e4fa7aebca2 could not be found. Aug 31 15:58:08.813072 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:58:08.813072 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:58:08.813072 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:58:08.813072 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:58:08.813072 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:58:08.813072 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:58:08.813072 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:58:08.813072 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:58:08.813072 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:58:08.814454 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:58:08.814454 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 15:58:08.814454 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 15:58:08.814454 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 15:58:08.814454 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 15:58:08.814454 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 15:58:08.814454 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:58:08.814454 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68edc4cf-5ffe-47e3-89d0-4e4fa7aebca2 could not be found. Aug 31 15:58:08.814454 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:58:08.814454 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:58:08.814454 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:58:08.814454 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:58:08.814454 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:58:08.814454 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:58:08.814454 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:58:08.814454 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:58:08.814454 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68edc4cf-5ffe-47e3-89d0-4e4fa7aebca2 could not be found. Aug 31 15:58:08.814454 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:58:08.816678 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-178ba471-4be3-42c3-aee2-8aa8d411b592 tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] Returning 404 to user: Instance 68edc4cf-5ffe-47e3-89d0-4e4fa7aebca2 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:58:08.817510 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-178ba471-4be3-42c3-aee2-8aa8d411b592 tempest-ServerDiagnosticsNegativeTest-1031522993 tempest-ServerDiagnosticsNegativeTest-1031522993-project] 10.222.0.61 "GET /compute/v2.1/servers/68edc4cf-5ffe-47e3-89d0-4e4fa7aebca2" status: 404 len: 111 microversion: 2.1 time: 0.095783 Aug 31 15:58:08.819680 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 355/695] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:08 2022] GET /compute/v2.1/servers/68edc4cf-5ffe-47e3-89d0-4e4fa7aebca2 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 15:58:08.834426 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-4404eabf-042a-47d5-be44-f1f7ecf0a97e tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba336e5ac684606b5e0123e454f9a60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad48220bc634a6186547269011ec49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:08.842149 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8d819290-54e4-415c-b733-4eb929a51a24 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:08.842847 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8d819290-54e4-415c-b733-4eb929a51a24 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] [instance: 1b233a49-d4f5-412d-8239-74df4ce63aa5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:08.846725 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4404eabf-042a-47d5-be44-f1f7ecf0a97e tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] 10.222.0.61 "GET /compute/v2.1/servers/f977bd90-3cd4-4b07-87f9-42e26b8a530a" status: 200 len: 1313 microversion: 2.1 time: 0.393106 Aug 31 15:58:08.847407 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 341/696] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:08 2022] GET /compute/v2.1/servers/f977bd90-3cd4-4b07-87f9-42e26b8a530a => generated 1313 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:58:08.861018 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8d819290-54e4-415c-b733-4eb929a51a24 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:08.861747 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8d819290-54e4-415c-b733-4eb929a51a24 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:08.862364 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8d819290-54e4-415c-b733-4eb929a51a24 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:08.863348 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8d819290-54e4-415c-b733-4eb929a51a24 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:08.864043 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8d819290-54e4-415c-b733-4eb929a51a24 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:08.864630 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8d819290-54e4-415c-b733-4eb929a51a24 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:08.881612 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-8d819290-54e4-415c-b733-4eb929a51a24 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] HTTP exception thrown: Instance 1b233a49-d4f5-412d-8239-74df4ce63aa5 could not be found. Aug 31 15:58:08.883650 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8d819290-54e4-415c-b733-4eb929a51a24 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Request method failure captured: Aug 31 15:58:08.883650 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/1b233a49-d4f5-412d-8239-74df4ce63aa5 HTTP/1.1 Aug 31 15:58:08.883650 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 15:58:08.883650 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 15:58:08.883650 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 15:58:08.883650 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 15:58:08.883650 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 15:58:08.883650 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 15:58:08.883650 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 15:58:08.883650 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 15:58:08.883650 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4Sr48sbSj8zmGnuJDt9FLcFFsMYJsMMN4O9amRh9mh8Gkp1Qor2_uDkL4eOZWlgOyZzvess77h4BzSHGWOidavKgm--Q1ArxbBQKFpoXel6J5wLKnONVEMF0izXf4OK_dlQROBgePWzUsQmETRJOzR4vgLJwa3XBxUTTRrCG_7Rb1Q Aug 31 15:58:08.883650 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 15:58:08.883650 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 15:58:08.883650 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 15:58:08.883650 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 15:58:08.883650 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 15:58:08.883650 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 15:58:08.883650 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 6f665e5697c4453c872940b4c0a88772 Aug 31 15:58:08.883650 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ImagesOneServerTestJSON-1892725018 Aug 31 15:58:08.883650 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 15:58:08.883650 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 15:58:08.885489 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6f665e5697c4453c872940b4c0a88772"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/6f665e5697c4453c872940b4c0a88772"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_6f665e5697c4453c872940b4c0a88772", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6f665e5697c4453c872940b4c0a88772"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 15:58:08.885489 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ImagesOneServerTestJSON-1892725018 Aug 31 15:58:08.885489 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 6f665e5697c4453c872940b4c0a88772 Aug 31 15:58:08.885489 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1892725018 Aug 31 15:58:08.885489 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ImagesOneServerTestJSON-1892725018-project Aug 31 15:58:08.885489 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 15:58:08.885489 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 15:58:08.885489 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: fedc04be9f46432fb954d7dbcfe53488 Aug 31 15:58:08.885489 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ImagesOneServerTestJSON-1892725018-project Aug 31 15:58:08.885489 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 15:58:08.885489 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance 1b233a49-d4f5-412d-8239-74df4ce63aa5 could not be found. Aug 31 15:58:08.885489 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '1b233a49-d4f5-412d-8239-74df4ce63aa5'} Aug 31 15:58:08.886193 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:58:08.886193 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:58:08.886193 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 15:58:08.886193 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 15:58:08.886193 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 15:58:08.886193 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 15:58:08.886193 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 15:58:08.886193 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 15:58:08.886193 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 15:58:08.886193 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 15:58:08.886193 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b233a49-d4f5-412d-8239-74df4ce63aa5 could not be found. Aug 31 15:58:08.886193 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:58:08.886193 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:58:08.886193 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:58:08.886193 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:58:08.886193 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:58:08.886193 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:58:08.886193 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:58:08.886193 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:58:08.886193 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:58:08.887329 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:58:08.887329 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 15:58:08.887329 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 15:58:08.887329 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 15:58:08.887329 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 15:58:08.887329 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 15:58:08.887329 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:58:08.887329 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b233a49-d4f5-412d-8239-74df4ce63aa5 could not be found. Aug 31 15:58:08.887329 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:58:08.887329 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:58:08.887329 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:58:08.887329 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:58:08.887329 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:58:08.887329 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:58:08.887329 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:58:08.887329 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:58:08.887329 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b233a49-d4f5-412d-8239-74df4ce63aa5 could not be found. Aug 31 15:58:08.887329 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:58:08.889810 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8d819290-54e4-415c-b733-4eb929a51a24 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] Returning 404 to user: Instance 1b233a49-d4f5-412d-8239-74df4ce63aa5 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:58:08.891999 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8d819290-54e4-415c-b733-4eb929a51a24 tempest-ImagesOneServerTestJSON-1892725018 tempest-ImagesOneServerTestJSON-1892725018-project] 10.222.0.61 "GET /compute/v2.1/servers/1b233a49-d4f5-412d-8239-74df4ce63aa5" status: 404 len: 111 microversion: 2.1 time: 0.070143 Aug 31 15:58:08.892869 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 356/697] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:08 2022] GET /compute/v2.1/servers/1b233a49-d4f5-412d-8239-74df4ce63aa5 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:58:09.045934 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4dee894d-f25b-476e-80a4-7163be84d98f tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:09.046565 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4dee894d-f25b-476e-80a4-7163be84d98f tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] [instance: 1dd3a7d9-7ff6-4b6f-b279-ca90c9ddb14b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:09.054031 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4dee894d-f25b-476e-80a4-7163be84d98f tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:09.064309 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4dee894d-f25b-476e-80a4-7163be84d98f tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:09.065033 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4dee894d-f25b-476e-80a4-7163be84d98f tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:09.065949 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4dee894d-f25b-476e-80a4-7163be84d98f tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:09.066591 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4dee894d-f25b-476e-80a4-7163be84d98f tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:09.068046 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4dee894d-f25b-476e-80a4-7163be84d98f tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:09.265943 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e3f7ed57-6c41-4d9c-a11e-99b7d587ef7b tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:09.267204 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e3f7ed57-6c41-4d9c-a11e-99b7d587ef7b tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] [instance: 2ddb0b07-9e31-403c-91d5-a278d632d754] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:09.275770 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e3f7ed57-6c41-4d9c-a11e-99b7d587ef7b tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:09.288380 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e3f7ed57-6c41-4d9c-a11e-99b7d587ef7b tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:09.291606 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e3f7ed57-6c41-4d9c-a11e-99b7d587ef7b tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:09.293533 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e3f7ed57-6c41-4d9c-a11e-99b7d587ef7b tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:09.299849 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e3f7ed57-6c41-4d9c-a11e-99b7d587ef7b tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:09.300666 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e3f7ed57-6c41-4d9c-a11e-99b7d587ef7b tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:09.783828 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-4dee894d-f25b-476e-80a4-7163be84d98f tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a03cc5956ca477abacbe0c26bf18750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea45d1b678342ed812f9912e9f07503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:09.794580 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4dee894d-f25b-476e-80a4-7163be84d98f tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] 10.222.0.61 "GET /compute/v2.1/servers/1dd3a7d9-7ff6-4b6f-b279-ca90c9ddb14b" status: 200 len: 1314 microversion: 2.1 time: 0.753783 Aug 31 15:58:09.819535 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 342/698] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:09 2022] GET /compute/v2.1/servers/1dd3a7d9-7ff6-4b6f-b279-ca90c9ddb14b => generated 1314 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:09.819535 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5a6d2b44-6199-4d2e-946b-87881add47e5 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:09.832570 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5a6d2b44-6199-4d2e-946b-87881add47e5 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] [instance: 3a0126e3-2324-4892-8908-2b6d2d5e2158] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:09.848473 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5a6d2b44-6199-4d2e-946b-87881add47e5 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:09.849731 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5a6d2b44-6199-4d2e-946b-87881add47e5 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:09.856287 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5a6d2b44-6199-4d2e-946b-87881add47e5 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:09.857468 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5a6d2b44-6199-4d2e-946b-87881add47e5 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:09.858159 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5a6d2b44-6199-4d2e-946b-87881add47e5 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:09.858842 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5a6d2b44-6199-4d2e-946b-87881add47e5 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:09.907936 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5a6d2b44-6199-4d2e-946b-87881add47e5 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] [instance: 3a0126e3-2324-4892-8908-2b6d2d5e2158] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 15:58:10.104538 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5a6d2b44-6199-4d2e-946b-87881add47e5 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] 10.222.0.61 "DELETE /compute/v2.1/servers/3a0126e3-2324-4892-8908-2b6d2d5e2158" status: 204 len: 0 microversion: 2.1 time: 0.291629 Aug 31 15:58:10.112971 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 343/699] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 15:58:09 2022] DELETE /compute/v2.1/servers/3a0126e3-2324-4892-8908-2b6d2d5e2158 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 15:58:10.159789 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-2a75c622-d896-4fb6-89b6-698804db07d1 req-794d42f7-80c7-4d43-a31e-63681885477f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f977bd90-3cd4-4b07-87f9-42e26b8a530a", "name": "network-vif-plugged", "status": "completed", "tag": "a9441445-ce6b-4242-a4d0-c5a2444ed50a"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:58:10.178797 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e3f7ed57-6c41-4d9c-a11e-99b7d587ef7b tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/2ddb0b07-9e31-403c-91d5-a278d632d754" status: 200 len: 1629 microversion: 2.1 time: 0.914586 Aug 31 15:58:10.187270 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-2a75c622-d896-4fb6-89b6-698804db07d1 req-794d42f7-80c7-4d43-a31e-63681885477f service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:10.188801 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-2a75c622-d896-4fb6-89b6-698804db07d1 req-794d42f7-80c7-4d43-a31e-63681885477f service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:10.189497 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-2a75c622-d896-4fb6-89b6-698804db07d1 req-794d42f7-80c7-4d43-a31e-63681885477f service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:10.192995 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 357/700] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:09 2022] GET /compute/v2.1/servers/2ddb0b07-9e31-403c-91d5-a278d632d754 => generated 1629 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:58:10.212158 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-2a75c622-d896-4fb6-89b6-698804db07d1 req-794d42f7-80c7-4d43-a31e-63681885477f service nova] Creating event network-vif-plugged:a9441445-ce6b-4242-a4d0-c5a2444ed50a for instance f977bd90-3cd4-4b07-87f9-42e26b8a530a on n-h2-850499-9 Aug 31 15:58:10.213306 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-33e5f728-e182-4c66-8f8f-e03ec1a1ece2 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:10.216561 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-33e5f728-e182-4c66-8f8f-e03ec1a1ece2 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 8555b294-db38-4246-ac58-035cb2acc70e] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:10.219967 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-2a75c622-d896-4fb6-89b6-698804db07d1 req-794d42f7-80c7-4d43-a31e-63681885477f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103906 Aug 31 15:58:10.220831 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 344/701] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 15:58:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:58:10.229423 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-33e5f728-e182-4c66-8f8f-e03ec1a1ece2 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:10.229929 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-33e5f728-e182-4c66-8f8f-e03ec1a1ece2 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:10.231954 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-33e5f728-e182-4c66-8f8f-e03ec1a1ece2 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:10.234236 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9e4b2e54-9337-4cee-9dcc-c9de0ca36a85 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:10.234365 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-33e5f728-e182-4c66-8f8f-e03ec1a1ece2 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:10.234766 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-33e5f728-e182-4c66-8f8f-e03ec1a1ece2 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:10.235204 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-33e5f728-e182-4c66-8f8f-e03ec1a1ece2 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:10.236022 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9e4b2e54-9337-4cee-9dcc-c9de0ca36a85 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] [instance: f977bd90-3cd4-4b07-87f9-42e26b8a530a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:10.255827 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9e4b2e54-9337-4cee-9dcc-c9de0ca36a85 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:10.256698 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9e4b2e54-9337-4cee-9dcc-c9de0ca36a85 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:10.258744 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9e4b2e54-9337-4cee-9dcc-c9de0ca36a85 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:10.262736 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9e4b2e54-9337-4cee-9dcc-c9de0ca36a85 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:10.263527 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9e4b2e54-9337-4cee-9dcc-c9de0ca36a85 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:10.264184 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9e4b2e54-9337-4cee-9dcc-c9de0ca36a85 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:10.679002 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-33e5f728-e182-4c66-8f8f-e03ec1a1ece2 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:10.693783 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-33e5f728-e182-4c66-8f8f-e03ec1a1ece2 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:10.697648 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-33e5f728-e182-4c66-8f8f-e03ec1a1ece2 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:10.701826 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-33e5f728-e182-4c66-8f8f-e03ec1a1ece2 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/8555b294-db38-4246-ac58-035cb2acc70e" status: 200 len: 1361 microversion: 2.25 time: 0.507552 Aug 31 15:58:10.703078 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 358/702] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:58:10 2022] GET /compute/v2.1/servers/8555b294-db38-4246-ac58-035cb2acc70e => generated 1361 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:10.727299 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-93ac9268-a3e8-4665-85d1-b9f43d2cb8b3 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-850499-9", "block_migration": true, "disk_over_commit": false}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:58:10.730890 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-93ac9268-a3e8-4665-85d1-b9f43d2cb8b3 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] [instance: 2ddb0b07-9e31-403c-91d5-a278d632d754] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:10.740742 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-93ac9268-a3e8-4665-85d1-b9f43d2cb8b3 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:10.741647 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-93ac9268-a3e8-4665-85d1-b9f43d2cb8b3 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:10.742208 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-93ac9268-a3e8-4665-85d1-b9f43d2cb8b3 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:10.745245 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-93ac9268-a3e8-4665-85d1-b9f43d2cb8b3 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:10.745769 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-93ac9268-a3e8-4665-85d1-b9f43d2cb8b3 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:10.746343 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-93ac9268-a3e8-4665-85d1-b9f43d2cb8b3 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:10.766674 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9e4b2e54-9337-4cee-9dcc-c9de0ca36a85 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba336e5ac684606b5e0123e454f9a60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad48220bc634a6186547269011ec49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:10.779108 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9e4b2e54-9337-4cee-9dcc-c9de0ca36a85 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] 10.222.0.61 "GET /compute/v2.1/servers/f977bd90-3cd4-4b07-87f9-42e26b8a530a" status: 200 len: 1313 microversion: 2.1 time: 0.548435 Aug 31 15:58:10.780101 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 345/703] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:10 2022] GET /compute/v2.1/servers/f977bd90-3cd4-4b07-87f9-42e26b8a530a => generated 1313 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:10.788054 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d7e5502b-baaa-4bd6-9e74-766f48036f11 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1648257456", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "1461368607", "adminPass": "***", "networks": [{"uuid": "a1f95b9f-d175-4a95-ba3a-5b211dcce0fe"}], "security_groups": [{"name": "tempest-securitygroup--1505251891"}], "key_name": "tempest-keypair-1481695302", "user_data": "}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:58:10.795189 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-93ac9268-a3e8-4665-85d1-b9f43d2cb8b3 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lazy-loading 'flavor' on Instance uuid 2ddb0b07-9e31-403c-91d5-a278d632d754 {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:58:10.819694 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-93ac9268-a3e8-4665-85d1-b9f43d2cb8b3 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] [instance: 2ddb0b07-9e31-403c-91d5-a278d632d754] Going to try to live migrate instance to n-h2-850499-9 {{(pid=122256) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 31 15:58:11.099775 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-d7e5502b-baaa-4bd6-9e74-766f48036f11 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] validate_networks() for [('a1f95b9f-d175-4a95-ba3a-5b211dcce0fe', None, None, None, None, None)] {{(pid=122257) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 15:58:12.264990 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-d7e5502b-baaa-4bd6-9e74-766f48036f11 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 15:58:12.265563 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-d7e5502b-baaa-4bd6-9e74-766f48036f11 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 15:58:12.265938 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-d7e5502b-baaa-4bd6-9e74-766f48036f11 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 15:58:12.266406 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-d7e5502b-baaa-4bd6-9e74-766f48036f11 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 15:58:12.266865 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-d7e5502b-baaa-4bd6-9e74-766f48036f11 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 15:58:12.276034 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d7e5502b-baaa-4bd6-9e74-766f48036f11 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:12.276570 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d7e5502b-baaa-4bd6-9e74-766f48036f11 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:12.277007 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d7e5502b-baaa-4bd6-9e74-766f48036f11 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:12.277872 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d7e5502b-baaa-4bd6-9e74-766f48036f11 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:12.278327 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d7e5502b-baaa-4bd6-9e74-766f48036f11 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:12.278747 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d7e5502b-baaa-4bd6-9e74-766f48036f11 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:12.296731 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-d7e5502b-baaa-4bd6-9e74-766f48036f11 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Getting quotas for project f6e5507d53224d19804717493d60bb71. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:58:12.302657 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-d7e5502b-baaa-4bd6-9e74-766f48036f11 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Getting quotas for user fa377b1dedae45d2a804919e5ea69a00 and project f6e5507d53224d19804717493d60bb71. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:58:12.322514 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d7e5502b-baaa-4bd6-9e74-766f48036f11 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Going to run 1 instances... {{(pid=122257) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 15:58:12.325381 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d7e5502b-baaa-4bd6-9e74-766f48036f11 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] [instance: d5e69723-2d0e-46ef-8f76-82d64aad4772] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 15:58:12.394509 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d7e5502b-baaa-4bd6-9e74-766f48036f11 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.613177 Aug 31 15:58:12.395717 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 346/704] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 15:58:10 2022] POST /compute/v2.1/servers => generated 402 bytes in 1615 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 15:58:12.401048 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-57c28a82-b1df-4f35-a3d4-14a4ac4f2b4b req-9b6216f0-02f9-4b45-970e-de3c8175b3bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8555b294-db38-4246-ac58-035cb2acc70e", "tag": "a4e66017-bbca-4435-8809-d986a9a6cbd2"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:58:12.413395 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-57c28a82-b1df-4f35-a3d4-14a4ac4f2b4b req-9b6216f0-02f9-4b45-970e-de3c8175b3bc service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:12.414027 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-57c28a82-b1df-4f35-a3d4-14a4ac4f2b4b req-9b6216f0-02f9-4b45-970e-de3c8175b3bc service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:12.414456 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-57c28a82-b1df-4f35-a3d4-14a4ac4f2b4b req-9b6216f0-02f9-4b45-970e-de3c8175b3bc service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:12.442441 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-57c28a82-b1df-4f35-a3d4-14a4ac4f2b4b req-9b6216f0-02f9-4b45-970e-de3c8175b3bc service nova] Creating event network-changed:a4e66017-bbca-4435-8809-d986a9a6cbd2 for instance 8555b294-db38-4246-ac58-035cb2acc70e on n-h2-850499-9 Aug 31 15:58:12.449968 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-57c28a82-b1df-4f35-a3d4-14a4ac4f2b4b req-9b6216f0-02f9-4b45-970e-de3c8175b3bc service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052775 Aug 31 15:58:12.450865 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 347/705] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 15:58:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:58:12.467631 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5fe1f66a-ccda-424d-922f-3a08e1d7df35 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:12.468816 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5fe1f66a-ccda-424d-922f-3a08e1d7df35 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] [instance: 1dd3a7d9-7ff6-4b6f-b279-ca90c9ddb14b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:12.485820 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5fe1f66a-ccda-424d-922f-3a08e1d7df35 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:12.488711 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5fe1f66a-ccda-424d-922f-3a08e1d7df35 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:12.489508 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5fe1f66a-ccda-424d-922f-3a08e1d7df35 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:12.500074 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5fe1f66a-ccda-424d-922f-3a08e1d7df35 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:12.503659 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5fe1f66a-ccda-424d-922f-3a08e1d7df35 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:12.505579 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5fe1f66a-ccda-424d-922f-3a08e1d7df35 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:12.928925 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5fe1f66a-ccda-424d-922f-3a08e1d7df35 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a03cc5956ca477abacbe0c26bf18750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea45d1b678342ed812f9912e9f07503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:12.940159 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5fe1f66a-ccda-424d-922f-3a08e1d7df35 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] 10.222.0.61 "GET /compute/v2.1/servers/1dd3a7d9-7ff6-4b6f-b279-ca90c9ddb14b" status: 200 len: 1314 microversion: 2.1 time: 0.487628 Aug 31 15:58:12.941751 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 348/706] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:12 2022] GET /compute/v2.1/servers/1dd3a7d9-7ff6-4b6f-b279-ca90c9ddb14b => generated 1314 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:13.206701 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8df001a8-d39c-4f3e-ad1b-ab7b4abfcd02 tempest-FlavorsV261TestJSON-2057795525 tempest-FlavorsV261TestJSON-2057795525-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-1798725479", "id": 1668825137, "os-flavor-access:is_public": "True"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:58:13.243018 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8df001a8-d39c-4f3e-ad1b-ab7b4abfcd02 tempest-FlavorsV261TestJSON-2057795525 tempest-FlavorsV261TestJSON-2057795525-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 468 microversion: 2.61 time: 0.299735 Aug 31 15:58:13.244824 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 349/707] 10.222.0.61 () {62 vars in 1188 bytes} [Wed Aug 31 15:58:12 2022] POST /compute/v2.1/flavors => generated 468 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 15:58:13.251471 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-1cf8fc7e-204b-48bd-be86-0995d09b1893 req-303f7fd2-daef-4c4e-8a36-bc83a6236a12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1dd3a7d9-7ff6-4b6f-b279-ca90c9ddb14b", "tag": "e68da150-24be-4678-ae6d-b32e1c8fd505"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:58:13.264230 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-1cf8fc7e-204b-48bd-be86-0995d09b1893 req-303f7fd2-daef-4c4e-8a36-bc83a6236a12 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:13.265156 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-1cf8fc7e-204b-48bd-be86-0995d09b1893 req-303f7fd2-daef-4c4e-8a36-bc83a6236a12 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:13.266564 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-1cf8fc7e-204b-48bd-be86-0995d09b1893 req-303f7fd2-daef-4c4e-8a36-bc83a6236a12 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:13.278807 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-1cf8fc7e-204b-48bd-be86-0995d09b1893 req-303f7fd2-daef-4c4e-8a36-bc83a6236a12 service nova] Creating event network-changed:e68da150-24be-4678-ae6d-b32e1c8fd505 for instance 1dd3a7d9-7ff6-4b6f-b279-ca90c9ddb14b on n-h2-850499-9 Aug 31 15:58:13.285678 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-1cf8fc7e-204b-48bd-be86-0995d09b1893 req-303f7fd2-daef-4c4e-8a36-bc83a6236a12 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038941 Aug 31 15:58:13.286327 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 350/708] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 15:58:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:58:13.291656 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-59035422-87ff-4f76-9786-d0a8fe78c401 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:13.293040 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-59035422-87ff-4f76-9786-d0a8fe78c401 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 8555b294-db38-4246-ac58-035cb2acc70e] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:13.300608 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-59035422-87ff-4f76-9786-d0a8fe78c401 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:13.302240 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-59035422-87ff-4f76-9786-d0a8fe78c401 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:13.303284 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-59035422-87ff-4f76-9786-d0a8fe78c401 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:13.304204 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-59035422-87ff-4f76-9786-d0a8fe78c401 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:13.305182 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-59035422-87ff-4f76-9786-d0a8fe78c401 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:13.305920 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-59035422-87ff-4f76-9786-d0a8fe78c401 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:13.376420 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-93ac9268-a3e8-4665-85d1-b9f43d2cb8b3 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/2ddb0b07-9e31-403c-91d5-a278d632d754/action" status: 202 len: 0 microversion: 2.1 time: 2.671582 Aug 31 15:58:13.377351 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 359/709] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 15:58:10 2022] POST /compute/v2.1/servers/2ddb0b07-9e31-403c-91d5-a278d632d754/action => generated 0 bytes in 2673 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 15:58:13.382257 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a9c50cae-ff9b-4cd0-b21e-79fd3db72ac9 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:13.382881 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a9c50cae-ff9b-4cd0-b21e-79fd3db72ac9 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] [instance: f977bd90-3cd4-4b07-87f9-42e26b8a530a] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:13.399315 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a9c50cae-ff9b-4cd0-b21e-79fd3db72ac9 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:13.399899 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a9c50cae-ff9b-4cd0-b21e-79fd3db72ac9 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:13.400655 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a9c50cae-ff9b-4cd0-b21e-79fd3db72ac9 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:13.401577 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a9c50cae-ff9b-4cd0-b21e-79fd3db72ac9 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:13.402232 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a9c50cae-ff9b-4cd0-b21e-79fd3db72ac9 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:13.402964 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a9c50cae-ff9b-4cd0-b21e-79fd3db72ac9 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:13.792226 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-59035422-87ff-4f76-9786-d0a8fe78c401 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:13.803700 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-59035422-87ff-4f76-9786-d0a8fe78c401 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:13.807440 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-59035422-87ff-4f76-9786-d0a8fe78c401 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:13.809066 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-59035422-87ff-4f76-9786-d0a8fe78c401 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/8555b294-db38-4246-ac58-035cb2acc70e" status: 200 len: 1361 microversion: 2.25 time: 0.521092 Aug 31 15:58:13.809770 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 351/710] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:58:13 2022] GET /compute/v2.1/servers/8555b294-db38-4246-ac58-035cb2acc70e => generated 1361 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:13.817210 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b3da43a3-6af2-42f7-b6b5-b9a16a97a96e tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:13.818018 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b3da43a3-6af2-42f7-b6b5-b9a16a97a96e tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] [instance: d5e69723-2d0e-46ef-8f76-82d64aad4772] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:13.827354 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b3da43a3-6af2-42f7-b6b5-b9a16a97a96e tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:13.828207 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b3da43a3-6af2-42f7-b6b5-b9a16a97a96e tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:13.828842 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b3da43a3-6af2-42f7-b6b5-b9a16a97a96e tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:13.829518 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b3da43a3-6af2-42f7-b6b5-b9a16a97a96e tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:13.829827 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b3da43a3-6af2-42f7-b6b5-b9a16a97a96e tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:13.830388 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b3da43a3-6af2-42f7-b6b5-b9a16a97a96e tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:13.855945 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a9c50cae-ff9b-4cd0-b21e-79fd3db72ac9 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba336e5ac684606b5e0123e454f9a60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad48220bc634a6186547269011ec49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:13.868666 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a9c50cae-ff9b-4cd0-b21e-79fd3db72ac9 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] 10.222.0.61 "GET /compute/v2.1/servers/f977bd90-3cd4-4b07-87f9-42e26b8a530a" status: 200 len: 1313 microversion: 2.1 time: 0.489137 Aug 31 15:58:13.869267 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 360/711] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:13 2022] GET /compute/v2.1/servers/f977bd90-3cd4-4b07-87f9-42e26b8a530a => generated 1313 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:13.967715 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=10 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:58:14.037937 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b3da43a3-6af2-42f7-b6b5-b9a16a97a96e tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377b1dedae45d2a804919e5ea69a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e5507d53224d19804717493d60bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:14.053018 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b3da43a3-6af2-42f7-b6b5-b9a16a97a96e tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] 10.222.0.61 "GET /compute/v2.1/servers/d5e69723-2d0e-46ef-8f76-82d64aad4772" status: 200 len: 1317 microversion: 2.1 time: 0.239838 Aug 31 15:58:14.053893 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 352/712] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:13 2022] GET /compute/v2.1/servers/d5e69723-2d0e-46ef-8f76-82d64aad4772 => generated 1317 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:14.072378 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-77513732-4c7c-443d-88c8-e4e8928a6076 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:14.073202 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-77513732-4c7c-443d-88c8-e4e8928a6076 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: 2ddb0b07-9e31-403c-91d5-a278d632d754] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:14.082419 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-77513732-4c7c-443d-88c8-e4e8928a6076 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:14.084849 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-77513732-4c7c-443d-88c8-e4e8928a6076 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:14.085314 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-77513732-4c7c-443d-88c8-e4e8928a6076 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:14.086046 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-77513732-4c7c-443d-88c8-e4e8928a6076 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:14.086784 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-77513732-4c7c-443d-88c8-e4e8928a6076 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:14.087213 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-77513732-4c7c-443d-88c8-e4e8928a6076 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:14.184077 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-75025149-3a9e-415d-bc6c-57b9d313095c tempest-FlavorsV261TestJSON-679497558 tempest-FlavorsV261TestJSON-679497558-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:14.198651 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-75025149-3a9e-415d-bc6c-57b9d313095c tempest-FlavorsV261TestJSON-679497558 tempest-FlavorsV261TestJSON-679497558-project] 10.222.0.61 "GET /compute/v2.1/flavors/1668825137" status: 200 len: 468 microversion: 2.61 time: 0.323046 Aug 31 15:58:14.200073 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 361/713] 10.222.0.61 () {60 vars in 1199 bytes} [Wed Aug 31 15:58:13 2022] GET /compute/v2.1/flavors/1668825137 => generated 468 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 15:58:14.205964 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0132f931-35b2-4651-9bcb-3244848aa272 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:14.206895 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0132f931-35b2-4651-9bcb-3244848aa272 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] [instance: 1dd3a7d9-7ff6-4b6f-b279-ca90c9ddb14b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:14.220503 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0132f931-35b2-4651-9bcb-3244848aa272 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:14.221499 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0132f931-35b2-4651-9bcb-3244848aa272 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:14.222226 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0132f931-35b2-4651-9bcb-3244848aa272 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:14.223437 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0132f931-35b2-4651-9bcb-3244848aa272 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:14.224130 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0132f931-35b2-4651-9bcb-3244848aa272 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:14.224751 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0132f931-35b2-4651-9bcb-3244848aa272 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:14.961616 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-0132f931-35b2-4651-9bcb-3244848aa272 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a03cc5956ca477abacbe0c26bf18750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea45d1b678342ed812f9912e9f07503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:14.973901 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0132f931-35b2-4651-9bcb-3244848aa272 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] 10.222.0.61 "GET /compute/v2.1/servers/1dd3a7d9-7ff6-4b6f-b279-ca90c9ddb14b" status: 200 len: 1314 microversion: 2.1 time: 0.771932 Aug 31 15:58:14.976052 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 362/714] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:14 2022] GET /compute/v2.1/servers/1dd3a7d9-7ff6-4b6f-b279-ca90c9ddb14b => generated 1314 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:14.980028 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-77513732-4c7c-443d-88c8-e4e8928a6076 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:14.990237 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3c239224-9915-42be-bf9e-942886767be2 tempest-FlavorsV261TestJSON-2057795525 tempest-FlavorsV261TestJSON-2057795525-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:58:14.998340 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-77513732-4c7c-443d-88c8-e4e8928a6076 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/2ddb0b07-9e31-403c-91d5-a278d632d754" status: 200 len: 1503 microversion: 2.1 time: 0.943631 Aug 31 15:58:14.999838 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 353/715] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:14 2022] GET /compute/v2.1/servers/2ddb0b07-9e31-403c-91d5-a278d632d754 => generated 1503 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:15.050023 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3c239224-9915-42be-bf9e-942886767be2 tempest-FlavorsV261TestJSON-2057795525 tempest-FlavorsV261TestJSON-2057795525-project-admin] 10.222.0.61 "PUT /compute/v2.1/flavors/1668825137" status: 200 len: 469 microversion: 2.61 time: 0.072835 Aug 31 15:58:15.052709 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 363/716] 10.222.0.61 () {62 vars in 1219 bytes} [Wed Aug 31 15:58:14 2022] PUT /compute/v2.1/flavors/1668825137 => generated 469 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 15:58:15.076848 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-aefdaa51-2994-4225-ac1d-cb8815cab72c tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:15.077467 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-aefdaa51-2994-4225-ac1d-cb8815cab72c tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 8555b294-db38-4246-ac58-035cb2acc70e] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:15.089471 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aefdaa51-2994-4225-ac1d-cb8815cab72c tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:15.093646 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aefdaa51-2994-4225-ac1d-cb8815cab72c tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:15.096499 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aefdaa51-2994-4225-ac1d-cb8815cab72c tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:15.097438 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aefdaa51-2994-4225-ac1d-cb8815cab72c tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:15.101600 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aefdaa51-2994-4225-ac1d-cb8815cab72c tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:15.102295 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aefdaa51-2994-4225-ac1d-cb8815cab72c tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:15.156849 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-38662af6-292f-44dd-ab6c-4a67e5969d26 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-1854402043", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "networks": "none"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:58:15.170737 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=8,nova_api:UPDATE=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:58:15.228905 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-38662af6-292f-44dd-ab6c-4a67e5969d26 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 15:58:15.229533 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-38662af6-292f-44dd-ab6c-4a67e5969d26 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 15:58:15.230403 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-38662af6-292f-44dd-ab6c-4a67e5969d26 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 15:58:15.231326 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-38662af6-292f-44dd-ab6c-4a67e5969d26 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 15:58:15.232055 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-38662af6-292f-44dd-ab6c-4a67e5969d26 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 15:58:15.243311 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-38662af6-292f-44dd-ab6c-4a67e5969d26 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:15.244658 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-38662af6-292f-44dd-ab6c-4a67e5969d26 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:15.245970 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-38662af6-292f-44dd-ab6c-4a67e5969d26 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:15.247120 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-38662af6-292f-44dd-ab6c-4a67e5969d26 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:15.247882 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-38662af6-292f-44dd-ab6c-4a67e5969d26 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:15.248542 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-38662af6-292f-44dd-ab6c-4a67e5969d26 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:15.258785 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:58:15.274540 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-38662af6-292f-44dd-ab6c-4a67e5969d26 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Getting quotas for project 27b7b1a3ebd74953ade59c2ced703592. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:58:15.283424 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-38662af6-292f-44dd-ab6c-4a67e5969d26 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Getting quotas for user 7d70744565b448e8b96296d805399870 and project 27b7b1a3ebd74953ade59c2ced703592. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:58:15.300064 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-38662af6-292f-44dd-ab6c-4a67e5969d26 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Going to run 1 instances... {{(pid=122257) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 15:58:15.303706 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-38662af6-292f-44dd-ab6c-4a67e5969d26 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 15:58:15.379665 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-38662af6-292f-44dd-ab6c-4a67e5969d26 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 0.378027 Aug 31 15:58:15.380670 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 354/717] 10.222.0.61 () {62 vars in 1188 bytes} [Wed Aug 31 15:58:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 380 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 31 15:58:15.386724 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9f88d25e-d181-43c3-b9a4-bcd92692db50 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:15.387637 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9f88d25e-d181-43c3-b9a4-bcd92692db50 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] [instance: f977bd90-3cd4-4b07-87f9-42e26b8a530a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:15.404770 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9f88d25e-d181-43c3-b9a4-bcd92692db50 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:15.409987 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9f88d25e-d181-43c3-b9a4-bcd92692db50 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:15.410797 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9f88d25e-d181-43c3-b9a4-bcd92692db50 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:15.413266 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9f88d25e-d181-43c3-b9a4-bcd92692db50 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:15.419435 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9f88d25e-d181-43c3-b9a4-bcd92692db50 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:15.420613 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9f88d25e-d181-43c3-b9a4-bcd92692db50 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:15.539751 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-aefdaa51-2994-4225-ac1d-cb8815cab72c tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:15.550066 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-aefdaa51-2994-4225-ac1d-cb8815cab72c tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:15.551552 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-aefdaa51-2994-4225-ac1d-cb8815cab72c tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:15.552939 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-aefdaa51-2994-4225-ac1d-cb8815cab72c tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/8555b294-db38-4246-ac58-035cb2acc70e" status: 200 len: 1361 microversion: 2.25 time: 0.488532 Aug 31 15:58:15.553645 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 364/718] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:58:15 2022] GET /compute/v2.1/servers/8555b294-db38-4246-ac58-035cb2acc70e => generated 1361 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:15.559184 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-20a85893-b174-43dd-bc39-88104b2742d9 tempest-FlavorsV261TestJSON-679497558 tempest-FlavorsV261TestJSON-679497558-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:15.597343 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-20a85893-b174-43dd-bc39-88104b2742d9 tempest-FlavorsV261TestJSON-679497558 tempest-FlavorsV261TestJSON-679497558-project] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 7156 microversion: 2.61 time: 0.042172 Aug 31 15:58:15.598202 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 365/719] 10.222.0.61 () {60 vars in 1187 bytes} [Wed Aug 31 15:58:15 2022] GET /compute/v2.1/flavors/detail => generated 7156 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:15.620922 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c4c85310-075d-4c5e-97b6-3c96488c7be0 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:15.621823 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c4c85310-075d-4c5e-97b6-3c96488c7be0 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] [instance: d5e69723-2d0e-46ef-8f76-82d64aad4772] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:15.629294 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c4c85310-075d-4c5e-97b6-3c96488c7be0 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:15.629986 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c4c85310-075d-4c5e-97b6-3c96488c7be0 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:15.630497 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c4c85310-075d-4c5e-97b6-3c96488c7be0 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:15.631335 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c4c85310-075d-4c5e-97b6-3c96488c7be0 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:15.631933 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c4c85310-075d-4c5e-97b6-3c96488c7be0 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:15.632421 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c4c85310-075d-4c5e-97b6-3c96488c7be0 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:15.865449 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c4c85310-075d-4c5e-97b6-3c96488c7be0 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377b1dedae45d2a804919e5ea69a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e5507d53224d19804717493d60bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:15.875533 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c4c85310-075d-4c5e-97b6-3c96488c7be0 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] 10.222.0.61 "GET /compute/v2.1/servers/d5e69723-2d0e-46ef-8f76-82d64aad4772" status: 200 len: 1323 microversion: 2.1 time: 0.259217 Aug 31 15:58:15.892314 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 366/720] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:15 2022] GET /compute/v2.1/servers/d5e69723-2d0e-46ef-8f76-82d64aad4772 => generated 1323 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:15.910272 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-a067eb56-9ad1-47f3-844d-8074602cbfa8 req-e746951d-2f2e-419e-aa65-4a5fef027636 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e45fa8b9-1545-4bd5-aa5f-402c71ec19c6", "tag": "935e822d-4171-4348-8a87-c6e76ab1ea4f"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:58:15.933365 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-a067eb56-9ad1-47f3-844d-8074602cbfa8 req-e746951d-2f2e-419e-aa65-4a5fef027636 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:15.934161 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-a067eb56-9ad1-47f3-844d-8074602cbfa8 req-e746951d-2f2e-419e-aa65-4a5fef027636 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:15.935154 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-a067eb56-9ad1-47f3-844d-8074602cbfa8 req-e746951d-2f2e-419e-aa65-4a5fef027636 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:15.965074 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-a067eb56-9ad1-47f3-844d-8074602cbfa8 req-e746951d-2f2e-419e-aa65-4a5fef027636 service nova] Creating event network-changed:935e822d-4171-4348-8a87-c6e76ab1ea4f for instance e45fa8b9-1545-4bd5-aa5f-402c71ec19c6 on n-h2-850499-9 Aug 31 15:58:15.972939 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-a067eb56-9ad1-47f3-844d-8074602cbfa8 req-e746951d-2f2e-419e-aa65-4a5fef027636 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077410 Aug 31 15:58:15.973963 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 367/721] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 15:58:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:58:15.980678 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-59606cb7-7a2c-4925-b148-c79f11a7ea28 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:15.981834 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-59606cb7-7a2c-4925-b148-c79f11a7ea28 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:15.986489 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:DELETE=9,nova_api:SELECT=88,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:58:16.061863 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9f88d25e-d181-43c3-b9a4-bcd92692db50 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba336e5ac684606b5e0123e454f9a60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad48220bc634a6186547269011ec49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:16.072186 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9f88d25e-d181-43c3-b9a4-bcd92692db50 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] 10.222.0.61 "GET /compute/v2.1/servers/f977bd90-3cd4-4b07-87f9-42e26b8a530a" status: 200 len: 1313 microversion: 2.1 time: 0.689643 Aug 31 15:58:16.073784 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 355/722] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:15 2022] GET /compute/v2.1/servers/f977bd90-3cd4-4b07-87f9-42e26b8a530a => generated 1313 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:16.078856 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-87d4d34a-2601-4a9a-9eb2-7a0cd4bb2337 tempest-FlavorsV261TestJSON-679497558 tempest-FlavorsV261TestJSON-679497558-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:16.116976 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-87d4d34a-2601-4a9a-9eb2-7a0cd4bb2337 tempest-FlavorsV261TestJSON-679497558 tempest-FlavorsV261TestJSON-679497558-project] 10.222.0.61 "GET /compute/v2.1/flavors" status: 200 len: 3683 microversion: 2.61 time: 0.041894 Aug 31 15:58:16.118146 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 356/723] 10.222.0.61 () {60 vars in 1166 bytes} [Wed Aug 31 15:58:16 2022] GET /compute/v2.1/flavors => generated 3683 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:16.124542 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-44474444-144a-4c4a-9380-62466ac22f0b tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:16.125474 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-44474444-144a-4c4a-9380-62466ac22f0b tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] [instance: 1dd3a7d9-7ff6-4b6f-b279-ca90c9ddb14b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:16.132755 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-44474444-144a-4c4a-9380-62466ac22f0b tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:16.133501 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-44474444-144a-4c4a-9380-62466ac22f0b tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:16.134107 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-44474444-144a-4c4a-9380-62466ac22f0b tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:16.135192 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-44474444-144a-4c4a-9380-62466ac22f0b tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:16.135845 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-44474444-144a-4c4a-9380-62466ac22f0b tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:16.136268 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-44474444-144a-4c4a-9380-62466ac22f0b tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:16.143954 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-59606cb7-7a2c-4925-b148-c79f11a7ea28 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:16.155966 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-59606cb7-7a2c-4925-b148-c79f11a7ea28 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:16.160137 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-59606cb7-7a2c-4925-b148-c79f11a7ea28 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:16.168289 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-59606cb7-7a2c-4925-b148-c79f11a7ea28 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1454 microversion: 2.91 time: 0.192204 Aug 31 15:58:16.169188 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 368/724] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:58:15 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1454 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:16.191882 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-64b397f9-4bc7-4522-a41b-5c707621d3c9 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:16.192992 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-64b397f9-4bc7-4522-a41b-5c707621d3c9 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: 2ddb0b07-9e31-403c-91d5-a278d632d754] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:16.203031 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-64b397f9-4bc7-4522-a41b-5c707621d3c9 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:16.203855 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-64b397f9-4bc7-4522-a41b-5c707621d3c9 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:16.204516 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-64b397f9-4bc7-4522-a41b-5c707621d3c9 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:16.207156 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-64b397f9-4bc7-4522-a41b-5c707621d3c9 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:16.208025 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-64b397f9-4bc7-4522-a41b-5c707621d3c9 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:16.208616 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-64b397f9-4bc7-4522-a41b-5c707621d3c9 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:16.870827 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-44474444-144a-4c4a-9380-62466ac22f0b tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a03cc5956ca477abacbe0c26bf18750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea45d1b678342ed812f9912e9f07503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:16.885320 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-44474444-144a-4c4a-9380-62466ac22f0b tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] 10.222.0.61 "GET /compute/v2.1/servers/1dd3a7d9-7ff6-4b6f-b279-ca90c9ddb14b" status: 200 len: 1314 microversion: 2.1 time: 0.765056 Aug 31 15:58:16.887143 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 357/725] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:16 2022] GET /compute/v2.1/servers/1dd3a7d9-7ff6-4b6f-b279-ca90c9ddb14b => generated 1314 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:16.905137 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2a0b6037-188f-4034-ada4-adfa5712a11c tempest-FlavorsV261TestJSON-2057795525 tempest-FlavorsV261TestJSON-2057795525-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:16.950695 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2a0b6037-188f-4034-ada4-adfa5712a11c tempest-FlavorsV261TestJSON-2057795525 tempest-FlavorsV261TestJSON-2057795525-project-admin] 10.222.0.61 "DELETE /compute/v2.1/flavors/1668825137" status: 202 len: 0 microversion: 2.61 time: 0.057535 Aug 31 15:58:16.955681 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 358/726] 10.222.0.61 () {60 vars in 1202 bytes} [Wed Aug 31 15:58:16 2022] DELETE /compute/v2.1/flavors/1668825137 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 15:58:16.964400 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-077fc434-fdd3-4c6c-ad92-e407b1e684ad req-ace23a9b-62d7-43f5-aab2-386daf85b648 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a0126e3-2324-4892-8908-2b6d2d5e2158", "name": "network-vif-deleted", "tag": "6968d1bb-5c27-4bac-b8bf-3218d05fdca9"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:58:16.975852 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-077fc434-fdd3-4c6c-ad92-e407b1e684ad req-ace23a9b-62d7-43f5-aab2-386daf85b648 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:16.977171 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-077fc434-fdd3-4c6c-ad92-e407b1e684ad req-ace23a9b-62d7-43f5-aab2-386daf85b648 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:16.977760 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-077fc434-fdd3-4c6c-ad92-e407b1e684ad req-ace23a9b-62d7-43f5-aab2-386daf85b648 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:16.989950 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-077fc434-fdd3-4c6c-ad92-e407b1e684ad req-ace23a9b-62d7-43f5-aab2-386daf85b648 service nova] Creating event network-vif-deleted:6968d1bb-5c27-4bac-b8bf-3218d05fdca9 for instance 3a0126e3-2324-4892-8908-2b6d2d5e2158 on n-h2-850499-9 Aug 31 15:58:16.996588 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-077fc434-fdd3-4c6c-ad92-e407b1e684ad req-ace23a9b-62d7-43f5-aab2-386daf85b648 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039653 Aug 31 15:58:16.997443 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 359/727] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 15:58:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:58:17.002999 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-96c67b05-cc3a-4c57-b3c7-335783e1a798 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:17.003937 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-96c67b05-cc3a-4c57-b3c7-335783e1a798 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 8555b294-db38-4246-ac58-035cb2acc70e] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:17.012201 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-96c67b05-cc3a-4c57-b3c7-335783e1a798 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:17.013115 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-96c67b05-cc3a-4c57-b3c7-335783e1a798 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:17.013769 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-96c67b05-cc3a-4c57-b3c7-335783e1a798 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:17.014649 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-96c67b05-cc3a-4c57-b3c7-335783e1a798 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:17.015257 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-96c67b05-cc3a-4c57-b3c7-335783e1a798 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:17.015868 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-96c67b05-cc3a-4c57-b3c7-335783e1a798 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:17.016009 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-64b397f9-4bc7-4522-a41b-5c707621d3c9 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:17.032901 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-64b397f9-4bc7-4522-a41b-5c707621d3c9 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/2ddb0b07-9e31-403c-91d5-a278d632d754" status: 200 len: 1503 microversion: 2.1 time: 0.853966 Aug 31 15:58:17.034979 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 369/728] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:16 2022] GET /compute/v2.1/servers/2ddb0b07-9e31-403c-91d5-a278d632d754 => generated 1503 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:17.055544 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c073988b-7590-45ba-94a4-0c6f9294fef4 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:17.056400 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c073988b-7590-45ba-94a4-0c6f9294fef4 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] [instance: d5e69723-2d0e-46ef-8f76-82d64aad4772] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:17.082648 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c073988b-7590-45ba-94a4-0c6f9294fef4 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:17.083167 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c073988b-7590-45ba-94a4-0c6f9294fef4 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:17.083648 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c073988b-7590-45ba-94a4-0c6f9294fef4 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:17.089992 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c073988b-7590-45ba-94a4-0c6f9294fef4 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:17.098039 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c073988b-7590-45ba-94a4-0c6f9294fef4 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:17.098428 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c073988b-7590-45ba-94a4-0c6f9294fef4 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:17.465742 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=4 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:58:17.490862 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-96c67b05-cc3a-4c57-b3c7-335783e1a798 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:17.499745 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-96c67b05-cc3a-4c57-b3c7-335783e1a798 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:17.501201 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-96c67b05-cc3a-4c57-b3c7-335783e1a798 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:17.502322 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-96c67b05-cc3a-4c57-b3c7-335783e1a798 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/8555b294-db38-4246-ac58-035cb2acc70e" status: 200 len: 1361 microversion: 2.25 time: 0.503600 Aug 31 15:58:17.502888 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 360/729] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:58:16 2022] GET /compute/v2.1/servers/8555b294-db38-4246-ac58-035cb2acc70e => generated 1361 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:17.528720 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ea0d5301-08f7-4c42-8b28-d98c90effeac tempest-FlavorsV261TestJSON-2057795525 tempest-FlavorsV261TestJSON-2057795525-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:17.557139 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c073988b-7590-45ba-94a4-0c6f9294fef4 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377b1dedae45d2a804919e5ea69a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e5507d53224d19804717493d60bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:17.585661 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c073988b-7590-45ba-94a4-0c6f9294fef4 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] 10.222.0.61 "GET /compute/v2.1/servers/d5e69723-2d0e-46ef-8f76-82d64aad4772" status: 200 len: 1391 microversion: 2.1 time: 0.538517 Aug 31 15:58:17.603706 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 370/730] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:17 2022] GET /compute/v2.1/servers/d5e69723-2d0e-46ef-8f76-82d64aad4772 => generated 1391 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:17.633240 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-28e7cf33-027b-4d58-a544-514399a93fe4 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:17.634165 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-28e7cf33-027b-4d58-a544-514399a93fe4 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] [instance: f977bd90-3cd4-4b07-87f9-42e26b8a530a] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:17.651136 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-28e7cf33-027b-4d58-a544-514399a93fe4 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:17.654700 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-28e7cf33-027b-4d58-a544-514399a93fe4 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:17.655163 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-28e7cf33-027b-4d58-a544-514399a93fe4 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:17.658363 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-28e7cf33-027b-4d58-a544-514399a93fe4 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:17.659230 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-28e7cf33-027b-4d58-a544-514399a93fe4 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:17.661338 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-28e7cf33-027b-4d58-a544-514399a93fe4 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:17.961632 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ea0d5301-08f7-4c42-8b28-d98c90effeac tempest-FlavorsV261TestJSON-2057795525 tempest-FlavorsV261TestJSON-2057795525-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 6697 microversion: 2.61 time: 0.457386 Aug 31 15:58:17.962644 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 361/731] 10.222.0.61 () {60 vars in 1187 bytes} [Wed Aug 31 15:58:17 2022] GET /compute/v2.1/flavors/detail => generated 6697 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:17.967702 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4b100f1c-c4b2-4cc6-b63d-ae66e1b6de73 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:17.968529 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4b100f1c-c4b2-4cc6-b63d-ae66e1b6de73 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:17.990615 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4b100f1c-c4b2-4cc6-b63d-ae66e1b6de73 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:17.991425 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4b100f1c-c4b2-4cc6-b63d-ae66e1b6de73 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:17.992376 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4b100f1c-c4b2-4cc6-b63d-ae66e1b6de73 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:17.993127 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4b100f1c-c4b2-4cc6-b63d-ae66e1b6de73 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:17.993656 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4b100f1c-c4b2-4cc6-b63d-ae66e1b6de73 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:17.994180 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4b100f1c-c4b2-4cc6-b63d-ae66e1b6de73 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:18.293357 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-4b100f1c-c4b2-4cc6-b63d-ae66e1b6de73 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:18.309024 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-4b100f1c-c4b2-4cc6-b63d-ae66e1b6de73 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:18.310742 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-4b100f1c-c4b2-4cc6-b63d-ae66e1b6de73 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:18.321989 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4b100f1c-c4b2-4cc6-b63d-ae66e1b6de73 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1512 microversion: 2.91 time: 0.358049 Aug 31 15:58:18.323959 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 362/732] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:58:17 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1512 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:18.340727 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d1e32202-3d71-4f6d-82c8-4659d3e8712d tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:18.341774 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d1e32202-3d71-4f6d-82c8-4659d3e8712d tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] [instance: 1dd3a7d9-7ff6-4b6f-b279-ca90c9ddb14b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:18.352216 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d1e32202-3d71-4f6d-82c8-4659d3e8712d tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:18.352715 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d1e32202-3d71-4f6d-82c8-4659d3e8712d tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:18.353220 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d1e32202-3d71-4f6d-82c8-4659d3e8712d tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:18.353991 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d1e32202-3d71-4f6d-82c8-4659d3e8712d tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:18.354519 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d1e32202-3d71-4f6d-82c8-4659d3e8712d tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:18.354951 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d1e32202-3d71-4f6d-82c8-4659d3e8712d tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:18.537762 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-28e7cf33-027b-4d58-a544-514399a93fe4 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba336e5ac684606b5e0123e454f9a60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad48220bc634a6186547269011ec49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:18.563937 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-28e7cf33-027b-4d58-a544-514399a93fe4 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] 10.222.0.61 "GET /compute/v2.1/servers/f977bd90-3cd4-4b07-87f9-42e26b8a530a" status: 200 len: 1463 microversion: 2.1 time: 0.953517 Aug 31 15:58:18.565235 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 371/733] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:17 2022] GET /compute/v2.1/servers/f977bd90-3cd4-4b07-87f9-42e26b8a530a => generated 1463 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:18.572790 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7a7f52c0-c7f9-4b46-a498-6b0643432f2d tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:18.574293 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7a7f52c0-c7f9-4b46-a498-6b0643432f2d tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: 2ddb0b07-9e31-403c-91d5-a278d632d754] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:18.581777 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7a7f52c0-c7f9-4b46-a498-6b0643432f2d tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:18.582653 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7a7f52c0-c7f9-4b46-a498-6b0643432f2d tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:18.583856 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7a7f52c0-c7f9-4b46-a498-6b0643432f2d tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:18.585393 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7a7f52c0-c7f9-4b46-a498-6b0643432f2d tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:18.586818 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7a7f52c0-c7f9-4b46-a498-6b0643432f2d tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:18.588135 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7a7f52c0-c7f9-4b46-a498-6b0643432f2d tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:18.679710 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d1e32202-3d71-4f6d-82c8-4659d3e8712d tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a03cc5956ca477abacbe0c26bf18750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea45d1b678342ed812f9912e9f07503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:18.691464 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d1e32202-3d71-4f6d-82c8-4659d3e8712d tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] 10.222.0.61 "GET /compute/v2.1/servers/1dd3a7d9-7ff6-4b6f-b279-ca90c9ddb14b" status: 200 len: 1314 microversion: 2.1 time: 0.365623 Aug 31 15:58:18.692099 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 363/734] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:18 2022] GET /compute/v2.1/servers/1dd3a7d9-7ff6-4b6f-b279-ca90c9ddb14b => generated 1314 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:18.709051 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5fac70b3-eb61-4b88-94c2-34682aeac786 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:18.710114 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5fac70b3-eb61-4b88-94c2-34682aeac786 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 8555b294-db38-4246-ac58-035cb2acc70e] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:18.719240 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5fac70b3-eb61-4b88-94c2-34682aeac786 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:18.722126 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5fac70b3-eb61-4b88-94c2-34682aeac786 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:18.722952 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5fac70b3-eb61-4b88-94c2-34682aeac786 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:18.725296 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5fac70b3-eb61-4b88-94c2-34682aeac786 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:18.726869 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5fac70b3-eb61-4b88-94c2-34682aeac786 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:18.727662 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5fac70b3-eb61-4b88-94c2-34682aeac786 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:18.859021 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7a7f52c0-c7f9-4b46-a498-6b0643432f2d tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:18.883975 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7a7f52c0-c7f9-4b46-a498-6b0643432f2d tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/2ddb0b07-9e31-403c-91d5-a278d632d754" status: 200 len: 1503 microversion: 2.1 time: 0.316084 Aug 31 15:58:18.885230 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 372/735] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:18 2022] GET /compute/v2.1/servers/2ddb0b07-9e31-403c-91d5-a278d632d754 => generated 1503 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:18.983332 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5fac70b3-eb61-4b88-94c2-34682aeac786 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:19.000520 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5fac70b3-eb61-4b88-94c2-34682aeac786 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:19.001995 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5fac70b3-eb61-4b88-94c2-34682aeac786 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:19.003129 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5fac70b3-eb61-4b88-94c2-34682aeac786 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/8555b294-db38-4246-ac58-035cb2acc70e" status: 200 len: 1361 microversion: 2.25 time: 0.309559 Aug 31 15:58:19.003706 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 364/736] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:58:18 2022] GET /compute/v2.1/servers/8555b294-db38-4246-ac58-035cb2acc70e => generated 1361 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:19.035449 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6092a1f7-2f5e-4b71-a301-0e8793a8add2 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:19.038766 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6092a1f7-2f5e-4b71-a301-0e8793a8add2 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] [instance: d5e69723-2d0e-46ef-8f76-82d64aad4772] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:19.053760 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6092a1f7-2f5e-4b71-a301-0e8793a8add2 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:19.054267 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6092a1f7-2f5e-4b71-a301-0e8793a8add2 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:19.054712 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6092a1f7-2f5e-4b71-a301-0e8793a8add2 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:19.055427 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6092a1f7-2f5e-4b71-a301-0e8793a8add2 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:19.055987 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6092a1f7-2f5e-4b71-a301-0e8793a8add2 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:19.056670 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6092a1f7-2f5e-4b71-a301-0e8793a8add2 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:19.193872 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-78434d5d-6a55-4d7d-a8db-a7e84ed86f42 tempest-TenantUsagesTestJSON-1723171093 tempest-TenantUsagesTestJSON-1723171093-project-admin] Calling method '.version_select at 0x7f5ae934c4c0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:19.218413 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-78434d5d-6a55-4d7d-a8db-a7e84ed86f42 tempest-TenantUsagesTestJSON-1723171093 tempest-TenantUsagesTestJSON-1723171093-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:19.218912 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-78434d5d-6a55-4d7d-a8db-a7e84ed86f42 tempest-TenantUsagesTestJSON-1723171093 tempest-TenantUsagesTestJSON-1723171093-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:19.219355 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-78434d5d-6a55-4d7d-a8db-a7e84ed86f42 tempest-TenantUsagesTestJSON-1723171093 tempest-TenantUsagesTestJSON-1723171093-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:19.256323 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-78434d5d-6a55-4d7d-a8db-a7e84ed86f42 tempest-TenantUsagesTestJSON-1723171093 tempest-TenantUsagesTestJSON-1723171093-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:19.257081 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-78434d5d-6a55-4d7d-a8db-a7e84ed86f42 tempest-TenantUsagesTestJSON-1723171093 tempest-TenantUsagesTestJSON-1723171093-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:19.257705 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-78434d5d-6a55-4d7d-a8db-a7e84ed86f42 tempest-TenantUsagesTestJSON-1723171093 tempest-TenantUsagesTestJSON-1723171093-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:19.271350 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-6092a1f7-2f5e-4b71-a301-0e8793a8add2 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377b1dedae45d2a804919e5ea69a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e5507d53224d19804717493d60bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:19.280477 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-78434d5d-6a55-4d7d-a8db-a7e84ed86f42 tempest-TenantUsagesTestJSON-1723171093 tempest-TenantUsagesTestJSON-1723171093-project-admin] 10.222.0.61 "GET /compute/v2.1/os-simple-tenant-usage/8ad48220bc634a6186547269011ec49b?start=2022-08-30T15%3A58%3A18.578390&end=2022-09-01T15%3A58%3A18.578390" status: 200 len: 694 microversion: 2.1 time: 0.394037 Aug 31 15:58:19.280958 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6092a1f7-2f5e-4b71-a301-0e8793a8add2 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] 10.222.0.61 "GET /compute/v2.1/servers/d5e69723-2d0e-46ef-8f76-82d64aad4772" status: 200 len: 1391 microversion: 2.1 time: 0.260160 Aug 31 15:58:19.294684 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 365/737] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:19 2022] GET /compute/v2.1/servers/d5e69723-2d0e-46ef-8f76-82d64aad4772 => generated 1391 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:19.296878 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 373/738] 10.222.0.61 () {58 vars in 1412 bytes} [Wed Aug 31 15:58:18 2022] GET /compute/v2.1/os-simple-tenant-usage/8ad48220bc634a6186547269011ec49b?start=2022-08-30T15%3A58%3A18.578390&end=2022-09-01T15%3A58%3A18.578390 => generated 694 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:58:19.312801 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1661479b-583b-456d-862a-ffec0353bb48 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Calling method '.version_select at 0x7f5ae929fb80>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:19.321032 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-153a686a-ba27-4d59-bf9b-8f2ae35e1f2f req-daa68eea-64ad-4a87-ac06-fa147836f2e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5e69723-2d0e-46ef-8f76-82d64aad4772", "tag": "9c09b5b7-41ed-490a-80a2-32e8b4ce1304"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:58:19.323097 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1661479b-583b-456d-862a-ffec0353bb48 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:19.323945 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1661479b-583b-456d-862a-ffec0353bb48 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:19.324549 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1661479b-583b-456d-862a-ffec0353bb48 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:19.338767 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1661479b-583b-456d-862a-ffec0353bb48 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:19.339517 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1661479b-583b-456d-862a-ffec0353bb48 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:19.340173 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1661479b-583b-456d-862a-ffec0353bb48 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:19.350311 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-153a686a-ba27-4d59-bf9b-8f2ae35e1f2f req-daa68eea-64ad-4a87-ac06-fa147836f2e4 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:19.355363 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-153a686a-ba27-4d59-bf9b-8f2ae35e1f2f req-daa68eea-64ad-4a87-ac06-fa147836f2e4 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:19.356305 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1661479b-583b-456d-862a-ffec0353bb48 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] 10.222.0.61 "GET /compute/v2.1/os-simple-tenant-usage/8ad48220bc634a6186547269011ec49b?start=2022-08-30T15%3A58%3A18.578390&end=2022-09-01T15%3A58%3A18.578390" status: 200 len: 694 microversion: 2.1 time: 0.046635 Aug 31 15:58:19.358239 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-153a686a-ba27-4d59-bf9b-8f2ae35e1f2f req-daa68eea-64ad-4a87-ac06-fa147836f2e4 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:19.367348 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 374/739] 10.222.0.61 () {58 vars in 1412 bytes} [Wed Aug 31 15:58:19 2022] GET /compute/v2.1/os-simple-tenant-usage/8ad48220bc634a6186547269011ec49b?start=2022-08-30T15%3A58%3A18.578390&end=2022-09-01T15%3A58%3A18.578390 => generated 694 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:58:19.373417 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e93fc083-caf4-4b60-9c34-baa6658dcf65 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:19.374298 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e93fc083-caf4-4b60-9c34-baa6658dcf65 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:19.383235 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e93fc083-caf4-4b60-9c34-baa6658dcf65 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:19.383938 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e93fc083-caf4-4b60-9c34-baa6658dcf65 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:19.385268 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e93fc083-caf4-4b60-9c34-baa6658dcf65 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:19.386233 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e93fc083-caf4-4b60-9c34-baa6658dcf65 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:19.387036 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e93fc083-caf4-4b60-9c34-baa6658dcf65 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:19.387951 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e93fc083-caf4-4b60-9c34-baa6658dcf65 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:19.389120 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-153a686a-ba27-4d59-bf9b-8f2ae35e1f2f req-daa68eea-64ad-4a87-ac06-fa147836f2e4 service nova] Creating event network-changed:9c09b5b7-41ed-490a-80a2-32e8b4ce1304 for instance d5e69723-2d0e-46ef-8f76-82d64aad4772 on n-h1-850499-9 Aug 31 15:58:19.394727 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-153a686a-ba27-4d59-bf9b-8f2ae35e1f2f req-daa68eea-64ad-4a87-ac06-fa147836f2e4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108563 Aug 31 15:58:19.396515 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 366/740] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 15:58:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:58:19.407301 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4373f9d7-017f-434e-b414-0b086d088324 tempest-TenantUsagesTestJSON-1723171093 tempest-TenantUsagesTestJSON-1723171093-project-admin] Calling method '.version_select at 0x7f5ae9239820>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:19.420496 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4373f9d7-017f-434e-b414-0b086d088324 tempest-TenantUsagesTestJSON-1723171093 tempest-TenantUsagesTestJSON-1723171093-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:19.421233 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4373f9d7-017f-434e-b414-0b086d088324 tempest-TenantUsagesTestJSON-1723171093 tempest-TenantUsagesTestJSON-1723171093-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:19.421864 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4373f9d7-017f-434e-b414-0b086d088324 tempest-TenantUsagesTestJSON-1723171093 tempest-TenantUsagesTestJSON-1723171093-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:19.450368 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4373f9d7-017f-434e-b414-0b086d088324 tempest-TenantUsagesTestJSON-1723171093 tempest-TenantUsagesTestJSON-1723171093-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:19.451192 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4373f9d7-017f-434e-b414-0b086d088324 tempest-TenantUsagesTestJSON-1723171093 tempest-TenantUsagesTestJSON-1723171093-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:19.451885 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4373f9d7-017f-434e-b414-0b086d088324 tempest-TenantUsagesTestJSON-1723171093 tempest-TenantUsagesTestJSON-1723171093-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:19.498783 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4373f9d7-017f-434e-b414-0b086d088324 tempest-TenantUsagesTestJSON-1723171093 tempest-TenantUsagesTestJSON-1723171093-project-admin] 10.222.0.61 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-30T15%3A58%3A18.578390&end=2022-09-01T15%3A58%3A18.578390&detailed=1" status: 200 len: 7085 microversion: 2.1 time: 0.100723 Aug 31 15:58:19.500166 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 367/741] 10.222.0.61 () {58 vars in 1335 bytes} [Wed Aug 31 15:58:19 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-30T15%3A58%3A18.578390&end=2022-09-01T15%3A58%3A18.578390&detailed=1 => generated 7085 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:19.503145 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e93fc083-caf4-4b60-9c34-baa6658dcf65 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:19.516385 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e93fc083-caf4-4b60-9c34-baa6658dcf65 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:19.518079 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e93fc083-caf4-4b60-9c34-baa6658dcf65 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:19.529530 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e369dd45-23ef-491f-a90d-d143f89569d5 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:19.530542 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e369dd45-23ef-491f-a90d-d143f89569d5 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] [instance: f977bd90-3cd4-4b07-87f9-42e26b8a530a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:19.532442 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e93fc083-caf4-4b60-9c34-baa6658dcf65 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1512 microversion: 2.91 time: 0.163414 Aug 31 15:58:19.533038 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 375/742] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:58:19 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1512 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:19.546063 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e369dd45-23ef-491f-a90d-d143f89569d5 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:19.546825 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e369dd45-23ef-491f-a90d-d143f89569d5 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:19.547266 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e369dd45-23ef-491f-a90d-d143f89569d5 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:19.548838 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e369dd45-23ef-491f-a90d-d143f89569d5 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:19.549311 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e369dd45-23ef-491f-a90d-d143f89569d5 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:19.549752 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e369dd45-23ef-491f-a90d-d143f89569d5 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:19.584591 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e369dd45-23ef-491f-a90d-d143f89569d5 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] [instance: f977bd90-3cd4-4b07-87f9-42e26b8a530a] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 15:58:19.700563 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e369dd45-23ef-491f-a90d-d143f89569d5 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] 10.222.0.61 "DELETE /compute/v2.1/servers/f977bd90-3cd4-4b07-87f9-42e26b8a530a" status: 204 len: 0 microversion: 2.1 time: 0.177709 Aug 31 15:58:19.701447 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 368/743] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 15:58:19 2022] DELETE /compute/v2.1/servers/f977bd90-3cd4-4b07-87f9-42e26b8a530a => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 15:58:19.709198 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3bf1bdf9-8e34-4cf9-b626-debfe7dd7e25 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:19.709817 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3bf1bdf9-8e34-4cf9-b626-debfe7dd7e25 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] [instance: f977bd90-3cd4-4b07-87f9-42e26b8a530a] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:19.731563 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-05ed053a-31aa-4349-8ed6-ff2686e8f9bc tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:19.732281 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-05ed053a-31aa-4349-8ed6-ff2686e8f9bc tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] [instance: 1dd3a7d9-7ff6-4b6f-b279-ca90c9ddb14b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:19.741678 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3bf1bdf9-8e34-4cf9-b626-debfe7dd7e25 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:19.742618 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3bf1bdf9-8e34-4cf9-b626-debfe7dd7e25 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:19.743276 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3bf1bdf9-8e34-4cf9-b626-debfe7dd7e25 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:19.744380 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3bf1bdf9-8e34-4cf9-b626-debfe7dd7e25 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:19.747343 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3bf1bdf9-8e34-4cf9-b626-debfe7dd7e25 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:19.748398 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3bf1bdf9-8e34-4cf9-b626-debfe7dd7e25 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:19.751606 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-05ed053a-31aa-4349-8ed6-ff2686e8f9bc tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:19.752114 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-05ed053a-31aa-4349-8ed6-ff2686e8f9bc tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:19.752557 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-05ed053a-31aa-4349-8ed6-ff2686e8f9bc tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:19.753271 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-05ed053a-31aa-4349-8ed6-ff2686e8f9bc tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:19.753729 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-05ed053a-31aa-4349-8ed6-ff2686e8f9bc tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:19.754157 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-05ed053a-31aa-4349-8ed6-ff2686e8f9bc tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:19.767922 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:58:20.038598 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-05ed053a-31aa-4349-8ed6-ff2686e8f9bc tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a03cc5956ca477abacbe0c26bf18750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea45d1b678342ed812f9912e9f07503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:20.052190 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-05ed053a-31aa-4349-8ed6-ff2686e8f9bc tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] 10.222.0.61 "GET /compute/v2.1/servers/1dd3a7d9-7ff6-4b6f-b279-ca90c9ddb14b" status: 200 len: 1314 microversion: 2.1 time: 0.339149 Aug 31 15:58:20.055564 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 369/744] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:19 2022] GET /compute/v2.1/servers/1dd3a7d9-7ff6-4b6f-b279-ca90c9ddb14b => generated 1314 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:20.070151 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-734a287d-47d9-4c6b-9e4c-e3744bbbb048 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:20.070807 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-734a287d-47d9-4c6b-9e4c-e3744bbbb048 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: 2ddb0b07-9e31-403c-91d5-a278d632d754] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:20.108263 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-734a287d-47d9-4c6b-9e4c-e3744bbbb048 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:20.108861 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-734a287d-47d9-4c6b-9e4c-e3744bbbb048 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:20.109269 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-734a287d-47d9-4c6b-9e4c-e3744bbbb048 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:20.109988 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-734a287d-47d9-4c6b-9e4c-e3744bbbb048 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:20.110449 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-734a287d-47d9-4c6b-9e4c-e3744bbbb048 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:20.110877 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-734a287d-47d9-4c6b-9e4c-e3744bbbb048 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:21.032289 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-734a287d-47d9-4c6b-9e4c-e3744bbbb048 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:21.035422 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3bf1bdf9-8e34-4cf9-b626-debfe7dd7e25 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba336e5ac684606b5e0123e454f9a60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad48220bc634a6186547269011ec49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:21.045302 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-734a287d-47d9-4c6b-9e4c-e3744bbbb048 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/2ddb0b07-9e31-403c-91d5-a278d632d754" status: 200 len: 1503 microversion: 2.1 time: 0.988920 Aug 31 15:58:21.045655 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3bf1bdf9-8e34-4cf9-b626-debfe7dd7e25 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] 10.222.0.61 "GET /compute/v2.1/servers/f977bd90-3cd4-4b07-87f9-42e26b8a530a" status: 200 len: 1469 microversion: 2.1 time: 1.339823 Aug 31 15:58:21.047039 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 376/745] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:19 2022] GET /compute/v2.1/servers/f977bd90-3cd4-4b07-87f9-42e26b8a530a => generated 1469 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:21.048498 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 370/746] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:20 2022] GET /compute/v2.1/servers/2ddb0b07-9e31-403c-91d5-a278d632d754 => generated 1503 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:21.065983 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1e14d60b-5252-447e-8cb6-6cb1814800df tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:21.066612 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1e14d60b-5252-447e-8cb6-6cb1814800df tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 8555b294-db38-4246-ac58-035cb2acc70e] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:21.067631 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3d680367-5b2c-4f73-9290-1b9dfc5fac92 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:21.068599 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3d680367-5b2c-4f73-9290-1b9dfc5fac92 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] [instance: d5e69723-2d0e-46ef-8f76-82d64aad4772] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:21.074667 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1e14d60b-5252-447e-8cb6-6cb1814800df tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:21.075170 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1e14d60b-5252-447e-8cb6-6cb1814800df tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:21.075631 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1e14d60b-5252-447e-8cb6-6cb1814800df tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:21.076386 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1e14d60b-5252-447e-8cb6-6cb1814800df tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:21.076845 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1e14d60b-5252-447e-8cb6-6cb1814800df tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:21.079018 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3d680367-5b2c-4f73-9290-1b9dfc5fac92 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:21.082654 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1e14d60b-5252-447e-8cb6-6cb1814800df tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:21.083460 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3d680367-5b2c-4f73-9290-1b9dfc5fac92 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:21.084241 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3d680367-5b2c-4f73-9290-1b9dfc5fac92 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:21.085097 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3d680367-5b2c-4f73-9290-1b9dfc5fac92 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:21.085666 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3d680367-5b2c-4f73-9290-1b9dfc5fac92 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:21.086448 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3d680367-5b2c-4f73-9290-1b9dfc5fac92 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:21.640062 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3d680367-5b2c-4f73-9290-1b9dfc5fac92 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377b1dedae45d2a804919e5ea69a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e5507d53224d19804717493d60bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:21.650525 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3d680367-5b2c-4f73-9290-1b9dfc5fac92 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] 10.222.0.61 "GET /compute/v2.1/servers/d5e69723-2d0e-46ef-8f76-82d64aad4772" status: 200 len: 1391 microversion: 2.1 time: 0.595883 Aug 31 15:58:21.651573 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 371/747] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:21 2022] GET /compute/v2.1/servers/d5e69723-2d0e-46ef-8f76-82d64aad4772 => generated 1391 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:21.656437 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-76dbeaa3-3efa-44bd-855a-e951a66cce14 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:21.657038 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-76dbeaa3-3efa-44bd-855a-e951a66cce14 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:21.663159 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-76dbeaa3-3efa-44bd-855a-e951a66cce14 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:21.664917 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-76dbeaa3-3efa-44bd-855a-e951a66cce14 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:21.665903 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-76dbeaa3-3efa-44bd-855a-e951a66cce14 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:21.666693 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-76dbeaa3-3efa-44bd-855a-e951a66cce14 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:21.667226 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-76dbeaa3-3efa-44bd-855a-e951a66cce14 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:21.684767 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-76dbeaa3-3efa-44bd-855a-e951a66cce14 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:21.714391 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1e14d60b-5252-447e-8cb6-6cb1814800df tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:21.726389 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1e14d60b-5252-447e-8cb6-6cb1814800df tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:21.728998 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1e14d60b-5252-447e-8cb6-6cb1814800df tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:21.730454 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1e14d60b-5252-447e-8cb6-6cb1814800df tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/8555b294-db38-4246-ac58-035cb2acc70e" status: 200 len: 1361 microversion: 2.25 time: 0.682070 Aug 31 15:58:21.731357 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 377/748] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:58:21 2022] GET /compute/v2.1/servers/8555b294-db38-4246-ac58-035cb2acc70e => generated 1361 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:21.889310 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-76dbeaa3-3efa-44bd-855a-e951a66cce14 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:21.901269 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-76dbeaa3-3efa-44bd-855a-e951a66cce14 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:21.905480 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-76dbeaa3-3efa-44bd-855a-e951a66cce14 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:21.916498 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-76dbeaa3-3efa-44bd-855a-e951a66cce14 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1512 microversion: 2.91 time: 0.262431 Aug 31 15:58:21.943678 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 372/749] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:58:21 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1512 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:21.950427 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4ed163ef-c813-44dc-89cf-e687d9dbdffe tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:21.951413 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4ed163ef-c813-44dc-89cf-e687d9dbdffe tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] [instance: 1dd3a7d9-7ff6-4b6f-b279-ca90c9ddb14b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:21.960050 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4ed163ef-c813-44dc-89cf-e687d9dbdffe tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:21.960639 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4ed163ef-c813-44dc-89cf-e687d9dbdffe tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:21.961858 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4ed163ef-c813-44dc-89cf-e687d9dbdffe tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:21.962705 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4ed163ef-c813-44dc-89cf-e687d9dbdffe tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:21.963236 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4ed163ef-c813-44dc-89cf-e687d9dbdffe tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:21.963929 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4ed163ef-c813-44dc-89cf-e687d9dbdffe tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:22.240365 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-4ed163ef-c813-44dc-89cf-e687d9dbdffe tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a03cc5956ca477abacbe0c26bf18750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea45d1b678342ed812f9912e9f07503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:22.250154 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4ed163ef-c813-44dc-89cf-e687d9dbdffe tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] 10.222.0.61 "GET /compute/v2.1/servers/1dd3a7d9-7ff6-4b6f-b279-ca90c9ddb14b" status: 200 len: 1314 microversion: 2.1 time: 0.304783 Aug 31 15:58:22.251012 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 373/750] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:21 2022] GET /compute/v2.1/servers/1dd3a7d9-7ff6-4b6f-b279-ca90c9ddb14b => generated 1314 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:22.280367 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-41a5d7e2-3133-413a-a20e-3828b92e036b tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:22.281432 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-41a5d7e2-3133-413a-a20e-3828b92e036b tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: 2ddb0b07-9e31-403c-91d5-a278d632d754] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:22.281714 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-56327648-63f9-4baf-8199-0b1f4bbb874e tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-623689713", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "networks": [{"uuid": "d974b675-118c-4df8-9a7d-474c1e34f49f"}]}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:58:22.297995 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-41a5d7e2-3133-413a-a20e-3828b92e036b tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:22.300668 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-41a5d7e2-3133-413a-a20e-3828b92e036b tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:22.301424 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-41a5d7e2-3133-413a-a20e-3828b92e036b tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:22.302712 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-41a5d7e2-3133-413a-a20e-3828b92e036b tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:22.303416 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-41a5d7e2-3133-413a-a20e-3828b92e036b tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:22.304408 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-41a5d7e2-3133-413a-a20e-3828b92e036b tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:22.389290 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-56327648-63f9-4baf-8199-0b1f4bbb874e tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] validate_networks() for [('d974b675-118c-4df8-9a7d-474c1e34f49f', None, None, None, None, None)] {{(pid=122256) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 15:58:22.742161 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-41a5d7e2-3133-413a-a20e-3828b92e036b tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:22.745413 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:58:22.754272 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-41a5d7e2-3133-413a-a20e-3828b92e036b tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/2ddb0b07-9e31-403c-91d5-a278d632d754" status: 200 len: 1503 microversion: 2.1 time: 0.489956 Aug 31 15:58:22.755684 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 374/751] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:22 2022] GET /compute/v2.1/servers/2ddb0b07-9e31-403c-91d5-a278d632d754 => generated 1503 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:22.761117 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1f01688f-d4d0-4e1f-aadc-f4866158a77c tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:22.762290 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1f01688f-d4d0-4e1f-aadc-f4866158a77c tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] [instance: f977bd90-3cd4-4b07-87f9-42e26b8a530a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:22.771766 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1f01688f-d4d0-4e1f-aadc-f4866158a77c tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:22.772276 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1f01688f-d4d0-4e1f-aadc-f4866158a77c tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:22.772725 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1f01688f-d4d0-4e1f-aadc-f4866158a77c tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:22.773447 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1f01688f-d4d0-4e1f-aadc-f4866158a77c tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:22.774292 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1f01688f-d4d0-4e1f-aadc-f4866158a77c tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:22.774430 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1f01688f-d4d0-4e1f-aadc-f4866158a77c tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:23.083994 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-1f01688f-d4d0-4e1f-aadc-f4866158a77c tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba336e5ac684606b5e0123e454f9a60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad48220bc634a6186547269011ec49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:23.097449 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1f01688f-d4d0-4e1f-aadc-f4866158a77c tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] 10.222.0.61 "GET /compute/v2.1/servers/f977bd90-3cd4-4b07-87f9-42e26b8a530a" status: 200 len: 1469 microversion: 2.1 time: 0.340751 Aug 31 15:58:23.098037 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 375/752] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:22 2022] GET /compute/v2.1/servers/f977bd90-3cd4-4b07-87f9-42e26b8a530a => generated 1469 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:23.104437 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-0c95a873-4ec5-4d17-bba6-96c6cc1bbee9 req-3ded3e3e-e5d2-4da3-bea3-af5f727daac3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dd3a7d9-7ff6-4b6f-b279-ca90c9ddb14b", "name": "network-vif-plugged", "status": "completed", "tag": "e68da150-24be-4678-ae6d-b32e1c8fd505"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:58:23.125099 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-0c95a873-4ec5-4d17-bba6-96c6cc1bbee9 req-3ded3e3e-e5d2-4da3-bea3-af5f727daac3 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:23.128476 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-0c95a873-4ec5-4d17-bba6-96c6cc1bbee9 req-3ded3e3e-e5d2-4da3-bea3-af5f727daac3 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:23.128889 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-0c95a873-4ec5-4d17-bba6-96c6cc1bbee9 req-3ded3e3e-e5d2-4da3-bea3-af5f727daac3 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:23.145803 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-0c95a873-4ec5-4d17-bba6-96c6cc1bbee9 req-3ded3e3e-e5d2-4da3-bea3-af5f727daac3 service nova] Creating event network-vif-plugged:e68da150-24be-4678-ae6d-b32e1c8fd505 for instance 1dd3a7d9-7ff6-4b6f-b279-ca90c9ddb14b on n-h2-850499-9 Aug 31 15:58:23.151437 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-0c95a873-4ec5-4d17-bba6-96c6cc1bbee9 req-3ded3e3e-e5d2-4da3-bea3-af5f727daac3 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050411 Aug 31 15:58:23.152636 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 376/753] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 15:58:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:58:23.159147 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a4c20fcb-60e1-4b8d-8a5a-29b121abb628 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:23.160059 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a4c20fcb-60e1-4b8d-8a5a-29b121abb628 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] [instance: d5e69723-2d0e-46ef-8f76-82d64aad4772] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:23.173614 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a4c20fcb-60e1-4b8d-8a5a-29b121abb628 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:23.174364 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a4c20fcb-60e1-4b8d-8a5a-29b121abb628 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:23.174973 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a4c20fcb-60e1-4b8d-8a5a-29b121abb628 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:23.175899 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a4c20fcb-60e1-4b8d-8a5a-29b121abb628 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:23.176638 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a4c20fcb-60e1-4b8d-8a5a-29b121abb628 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:23.177228 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a4c20fcb-60e1-4b8d-8a5a-29b121abb628 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:23.216650 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-56327648-63f9-4baf-8199-0b1f4bbb874e tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 15:58:23.216650 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-56327648-63f9-4baf-8199-0b1f4bbb874e tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 15:58:23.217054 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-56327648-63f9-4baf-8199-0b1f4bbb874e tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 15:58:23.217438 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-56327648-63f9-4baf-8199-0b1f4bbb874e tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 15:58:23.217860 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-56327648-63f9-4baf-8199-0b1f4bbb874e tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 15:58:23.230605 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-56327648-63f9-4baf-8199-0b1f4bbb874e tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:23.231374 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-56327648-63f9-4baf-8199-0b1f4bbb874e tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:23.232229 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-56327648-63f9-4baf-8199-0b1f4bbb874e tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:23.233009 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-56327648-63f9-4baf-8199-0b1f4bbb874e tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:23.233470 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-56327648-63f9-4baf-8199-0b1f4bbb874e tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:23.233897 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-56327648-63f9-4baf-8199-0b1f4bbb874e tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:23.252869 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-56327648-63f9-4baf-8199-0b1f4bbb874e tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Getting quotas for project 7ed252ebf7c741bbb36b553ac1767579. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:58:23.260053 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-56327648-63f9-4baf-8199-0b1f4bbb874e tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Getting quotas for user 3ccce16c7fda401ea68fb31ea8099d78 and project 7ed252ebf7c741bbb36b553ac1767579. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:58:23.276340 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-56327648-63f9-4baf-8199-0b1f4bbb874e tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Going to run 1 instances... {{(pid=122256) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 15:58:23.279148 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-56327648-63f9-4baf-8199-0b1f4bbb874e tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] [instance: aa95066b-b1b8-43d8-8c5a-024e3890aa27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 15:58:23.351659 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-56327648-63f9-4baf-8199-0b1f4bbb874e tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.619123 Aug 31 15:58:23.355846 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 378/754] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 15:58:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1624 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 15:58:23.366610 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e1d2d76f-7b10-4b01-b2d0-0cecc4de1480 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:23.367363 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e1d2d76f-7b10-4b01-b2d0-0cecc4de1480 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 8555b294-db38-4246-ac58-035cb2acc70e] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:23.375222 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e1d2d76f-7b10-4b01-b2d0-0cecc4de1480 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:23.376017 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e1d2d76f-7b10-4b01-b2d0-0cecc4de1480 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:23.376454 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e1d2d76f-7b10-4b01-b2d0-0cecc4de1480 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:23.377166 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e1d2d76f-7b10-4b01-b2d0-0cecc4de1480 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:23.377629 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e1d2d76f-7b10-4b01-b2d0-0cecc4de1480 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:23.378063 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e1d2d76f-7b10-4b01-b2d0-0cecc4de1480 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:23.417484 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a4c20fcb-60e1-4b8d-8a5a-29b121abb628 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377b1dedae45d2a804919e5ea69a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e5507d53224d19804717493d60bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:23.427343 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a4c20fcb-60e1-4b8d-8a5a-29b121abb628 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] 10.222.0.61 "GET /compute/v2.1/servers/d5e69723-2d0e-46ef-8f76-82d64aad4772" status: 200 len: 1391 microversion: 2.1 time: 0.273266 Aug 31 15:58:23.439535 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 377/755] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:23 2022] GET /compute/v2.1/servers/d5e69723-2d0e-46ef-8f76-82d64aad4772 => generated 1391 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:23.447793 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5b04cb1b-ea58-422f-a344-fe2904509833 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:23.448682 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5b04cb1b-ea58-422f-a344-fe2904509833 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:23.456357 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b04cb1b-ea58-422f-a344-fe2904509833 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:23.457124 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b04cb1b-ea58-422f-a344-fe2904509833 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:23.457753 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b04cb1b-ea58-422f-a344-fe2904509833 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:23.458462 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b04cb1b-ea58-422f-a344-fe2904509833 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:23.458923 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b04cb1b-ea58-422f-a344-fe2904509833 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:23.459354 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b04cb1b-ea58-422f-a344-fe2904509833 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:23.542926 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5b04cb1b-ea58-422f-a344-fe2904509833 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:23.551386 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5b04cb1b-ea58-422f-a344-fe2904509833 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:23.553025 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5b04cb1b-ea58-422f-a344-fe2904509833 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:23.558415 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5b04cb1b-ea58-422f-a344-fe2904509833 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1533 microversion: 2.91 time: 0.120790 Aug 31 15:58:23.558987 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 378/756] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:58:23 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1533 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:23.565797 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e1d2d76f-7b10-4b01-b2d0-0cecc4de1480 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:23.575245 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e1d2d76f-7b10-4b01-b2d0-0cecc4de1480 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:23.576849 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e1d2d76f-7b10-4b01-b2d0-0cecc4de1480 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:23.577921 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e1d2d76f-7b10-4b01-b2d0-0cecc4de1480 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/8555b294-db38-4246-ac58-035cb2acc70e" status: 200 len: 1361 microversion: 2.25 time: 0.221058 Aug 31 15:58:23.579883 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 379/757] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:58:23 2022] GET /compute/v2.1/servers/8555b294-db38-4246-ac58-035cb2acc70e => generated 1361 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:23.581656 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7968044c-7156-4204-a4be-b3c4ad1bfebf tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:23.582232 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7968044c-7156-4204-a4be-b3c4ad1bfebf tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] [instance: 1dd3a7d9-7ff6-4b6f-b279-ca90c9ddb14b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:23.598381 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7968044c-7156-4204-a4be-b3c4ad1bfebf tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:23.598739 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7968044c-7156-4204-a4be-b3c4ad1bfebf tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:23.599192 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7968044c-7156-4204-a4be-b3c4ad1bfebf tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:23.599942 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7968044c-7156-4204-a4be-b3c4ad1bfebf tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:23.600514 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7968044c-7156-4204-a4be-b3c4ad1bfebf tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:23.600840 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7968044c-7156-4204-a4be-b3c4ad1bfebf tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:23.772574 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f2501b27-618c-44a9-8f9a-4857573613a4 tempest-HostsAdminTestJSON-408985037 tempest-HostsAdminTestJSON-408985037-project-admin] Calling method '.version_select at 0x7f5ae93781f0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:23.783735 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f2501b27-618c-44a9-8f9a-4857573613a4 tempest-HostsAdminTestJSON-408985037 tempest-HostsAdminTestJSON-408985037-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:23.784237 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f2501b27-618c-44a9-8f9a-4857573613a4 tempest-HostsAdminTestJSON-408985037 tempest-HostsAdminTestJSON-408985037-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:23.784684 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f2501b27-618c-44a9-8f9a-4857573613a4 tempest-HostsAdminTestJSON-408985037 tempest-HostsAdminTestJSON-408985037-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:23.785431 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f2501b27-618c-44a9-8f9a-4857573613a4 tempest-HostsAdminTestJSON-408985037 tempest-HostsAdminTestJSON-408985037-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:23.788722 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7968044c-7156-4204-a4be-b3c4ad1bfebf tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a03cc5956ca477abacbe0c26bf18750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea45d1b678342ed812f9912e9f07503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:23.792356 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f2501b27-618c-44a9-8f9a-4857573613a4 tempest-HostsAdminTestJSON-408985037 tempest-HostsAdminTestJSON-408985037-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:23.792895 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f2501b27-618c-44a9-8f9a-4857573613a4 tempest-HostsAdminTestJSON-408985037 tempest-HostsAdminTestJSON-408985037-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:23.799101 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7968044c-7156-4204-a4be-b3c4ad1bfebf tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] 10.222.0.61 "GET /compute/v2.1/servers/1dd3a7d9-7ff6-4b6f-b279-ca90c9ddb14b" status: 200 len: 1314 microversion: 2.1 time: 0.238863 Aug 31 15:58:23.799841 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 379/758] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:23 2022] GET /compute/v2.1/servers/1dd3a7d9-7ff6-4b6f-b279-ca90c9ddb14b => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:23.808015 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6e7c5630-378b-40f4-831d-f24242abcc97 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:23.808632 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6e7c5630-378b-40f4-831d-f24242abcc97 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] [instance: aa95066b-b1b8-43d8-8c5a-024e3890aa27] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:23.840238 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f2501b27-618c-44a9-8f9a-4857573613a4 tempest-HostsAdminTestJSON-408985037 tempest-HostsAdminTestJSON-408985037-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.258854 Aug 31 15:58:23.841052 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 380/759] 10.222.0.61 () {58 vars in 1128 bytes} [Wed Aug 31 15:58:23 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:58:23.891930 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-6e7c5630-378b-40f4-831d-f24242abcc97 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccce16c7fda401ea68fb31ea8099d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed252ebf7c741bbb36b553ac1767579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:23.894483 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=32 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:58:23.902178 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6e7c5630-378b-40f4-831d-f24242abcc97 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "GET /compute/v2.1/servers/aa95066b-b1b8-43d8-8c5a-024e3890aa27" status: 200 len: 1224 microversion: 2.1 time: 0.098364 Aug 31 15:58:23.902782 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 380/760] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:23 2022] GET /compute/v2.1/servers/aa95066b-b1b8-43d8-8c5a-024e3890aa27 => generated 1224 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:23.920758 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-af871c8c-23da-4148-a8c8-d607a8dd141f tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:23.921380 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-af871c8c-23da-4148-a8c8-d607a8dd141f tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: 2ddb0b07-9e31-403c-91d5-a278d632d754] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:23.927848 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-af871c8c-23da-4148-a8c8-d607a8dd141f tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:23.928302 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-af871c8c-23da-4148-a8c8-d607a8dd141f tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:23.929351 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-af871c8c-23da-4148-a8c8-d607a8dd141f tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:23.930218 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-af871c8c-23da-4148-a8c8-d607a8dd141f tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:23.930962 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-af871c8c-23da-4148-a8c8-d607a8dd141f tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:23.931711 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-af871c8c-23da-4148-a8c8-d607a8dd141f tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:23.999743 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e1997d74-47f8-4e34-a21b-d31822792e62 tempest-UnshelveToHostMultiNodesTest-1598069161 tempest-UnshelveToHostMultiNodesTest-1598069161-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:24.000361 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e1997d74-47f8-4e34-a21b-d31822792e62 tempest-UnshelveToHostMultiNodesTest-1598069161 tempest-UnshelveToHostMultiNodesTest-1598069161-project-admin] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:24.010594 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e1997d74-47f8-4e34-a21b-d31822792e62 tempest-UnshelveToHostMultiNodesTest-1598069161 tempest-UnshelveToHostMultiNodesTest-1598069161-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:24.011368 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e1997d74-47f8-4e34-a21b-d31822792e62 tempest-UnshelveToHostMultiNodesTest-1598069161 tempest-UnshelveToHostMultiNodesTest-1598069161-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:24.012454 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e1997d74-47f8-4e34-a21b-d31822792e62 tempest-UnshelveToHostMultiNodesTest-1598069161 tempest-UnshelveToHostMultiNodesTest-1598069161-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:24.013524 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e1997d74-47f8-4e34-a21b-d31822792e62 tempest-UnshelveToHostMultiNodesTest-1598069161 tempest-UnshelveToHostMultiNodesTest-1598069161-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:24.013992 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e1997d74-47f8-4e34-a21b-d31822792e62 tempest-UnshelveToHostMultiNodesTest-1598069161 tempest-UnshelveToHostMultiNodesTest-1598069161-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:24.014423 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e1997d74-47f8-4e34-a21b-d31822792e62 tempest-UnshelveToHostMultiNodesTest-1598069161 tempest-UnshelveToHostMultiNodesTest-1598069161-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:24.105965 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-e1997d74-47f8-4e34-a21b-d31822792e62 tempest-UnshelveToHostMultiNodesTest-1598069161 tempest-UnshelveToHostMultiNodesTest-1598069161-project-admin] Lazy-loading 'services' on Instance uuid 2b02272a-f8ed-45be-9d84-b9c143718689 {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:58:24.116110 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-af871c8c-23da-4148-a8c8-d607a8dd141f tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:24.125537 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-af871c8c-23da-4148-a8c8-d607a8dd141f tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/2ddb0b07-9e31-403c-91d5-a278d632d754" status: 200 len: 1503 microversion: 2.1 time: 0.208824 Aug 31 15:58:24.126126 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 381/761] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:23 2022] GET /compute/v2.1/servers/2ddb0b07-9e31-403c-91d5-a278d632d754 => generated 1503 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:24.130913 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-afe7a355-205f-430e-af53-42939aab447d tempest-HostsAdminTestJSON-408985037 tempest-HostsAdminTestJSON-408985037-project-admin] Calling method '.version_select at 0x7f5ae930f700>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:24.132762 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e1997d74-47f8-4e34-a21b-d31822792e62 tempest-UnshelveToHostMultiNodesTest-1598069161 tempest-UnshelveToHostMultiNodesTest-1598069161-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1938 microversion: 2.91 time: 0.290421 Aug 31 15:58:24.133409 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 381/762] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:58:23 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1938 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:24.147725 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-afe7a355-205f-430e-af53-42939aab447d tempest-HostsAdminTestJSON-408985037 tempest-HostsAdminTestJSON-408985037-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:24.147725 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-afe7a355-205f-430e-af53-42939aab447d tempest-HostsAdminTestJSON-408985037 tempest-HostsAdminTestJSON-408985037-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:24.147725 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-afe7a355-205f-430e-af53-42939aab447d tempest-HostsAdminTestJSON-408985037 tempest-HostsAdminTestJSON-408985037-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:24.147725 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-afe7a355-205f-430e-af53-42939aab447d tempest-HostsAdminTestJSON-408985037 tempest-HostsAdminTestJSON-408985037-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:24.148130 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-afe7a355-205f-430e-af53-42939aab447d tempest-HostsAdminTestJSON-408985037 tempest-HostsAdminTestJSON-408985037-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:24.148130 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-afe7a355-205f-430e-af53-42939aab447d tempest-HostsAdminTestJSON-408985037 tempest-HostsAdminTestJSON-408985037-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:24.148301 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d1e7fb3d-1637-4233-a762-2431966dfbe8 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:24.148758 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d1e7fb3d-1637-4233-a762-2431966dfbe8 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] [instance: f977bd90-3cd4-4b07-87f9-42e26b8a530a] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:24.157469 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d1e7fb3d-1637-4233-a762-2431966dfbe8 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:24.158012 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d1e7fb3d-1637-4233-a762-2431966dfbe8 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:24.158682 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d1e7fb3d-1637-4233-a762-2431966dfbe8 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:24.160509 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d1e7fb3d-1637-4233-a762-2431966dfbe8 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:24.160509 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d1e7fb3d-1637-4233-a762-2431966dfbe8 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:24.160509 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d1e7fb3d-1637-4233-a762-2431966dfbe8 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:24.168025 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-afe7a355-205f-430e-af53-42939aab447d tempest-HostsAdminTestJSON-408985037 tempest-HostsAdminTestJSON-408985037-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 376 microversion: 2.1 time: 0.040514 Aug 31 15:58:24.174234 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 382/763] 10.222.0.61 () {58 vars in 1139 bytes} [Wed Aug 31 15:58:24 2022] GET /compute/v2.1/os-hosts?zone= => generated 376 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:58:24.178144 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-56136e3b-1cab-47e9-ba1f-752b8ec2fbee tempest-UnshelveToHostMultiNodesTest-1598069161 tempest-UnshelveToHostMultiNodesTest-1598069161-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:24.178759 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-56136e3b-1cab-47e9-ba1f-752b8ec2fbee tempest-UnshelveToHostMultiNodesTest-1598069161 tempest-UnshelveToHostMultiNodesTest-1598069161-project-admin] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:24.186299 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-56136e3b-1cab-47e9-ba1f-752b8ec2fbee tempest-UnshelveToHostMultiNodesTest-1598069161 tempest-UnshelveToHostMultiNodesTest-1598069161-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:24.186616 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-56136e3b-1cab-47e9-ba1f-752b8ec2fbee tempest-UnshelveToHostMultiNodesTest-1598069161 tempest-UnshelveToHostMultiNodesTest-1598069161-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:24.187057 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-56136e3b-1cab-47e9-ba1f-752b8ec2fbee tempest-UnshelveToHostMultiNodesTest-1598069161 tempest-UnshelveToHostMultiNodesTest-1598069161-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:24.188002 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-56136e3b-1cab-47e9-ba1f-752b8ec2fbee tempest-UnshelveToHostMultiNodesTest-1598069161 tempest-UnshelveToHostMultiNodesTest-1598069161-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:24.188430 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-56136e3b-1cab-47e9-ba1f-752b8ec2fbee tempest-UnshelveToHostMultiNodesTest-1598069161 tempest-UnshelveToHostMultiNodesTest-1598069161-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:24.188864 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-56136e3b-1cab-47e9-ba1f-752b8ec2fbee tempest-UnshelveToHostMultiNodesTest-1598069161 tempest-UnshelveToHostMultiNodesTest-1598069161-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:24.275844 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-56136e3b-1cab-47e9-ba1f-752b8ec2fbee tempest-UnshelveToHostMultiNodesTest-1598069161 tempest-UnshelveToHostMultiNodesTest-1598069161-project-admin] Lazy-loading 'services' on Instance uuid 2b02272a-f8ed-45be-9d84-b9c143718689 {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:58:24.294470 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-56136e3b-1cab-47e9-ba1f-752b8ec2fbee tempest-UnshelveToHostMultiNodesTest-1598069161 tempest-UnshelveToHostMultiNodesTest-1598069161-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1938 microversion: 2.91 time: 0.124768 Aug 31 15:58:24.304490 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 383/764] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:58:24 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1938 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:24.304490 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-76e89b7f-6bec-4768-adeb-2b2040562b8d tempest-HostsAdminTestJSON-408985037 tempest-HostsAdminTestJSON-408985037-project-admin] Calling method '.version_select at 0x7f5ae929bdc0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:24.304791 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-76e89b7f-6bec-4768-adeb-2b2040562b8d tempest-HostsAdminTestJSON-408985037 tempest-HostsAdminTestJSON-408985037-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:24.305351 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-76e89b7f-6bec-4768-adeb-2b2040562b8d tempest-HostsAdminTestJSON-408985037 tempest-HostsAdminTestJSON-408985037-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:24.306526 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-76e89b7f-6bec-4768-adeb-2b2040562b8d tempest-HostsAdminTestJSON-408985037 tempest-HostsAdminTestJSON-408985037-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:24.307385 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-76e89b7f-6bec-4768-adeb-2b2040562b8d tempest-HostsAdminTestJSON-408985037 tempest-HostsAdminTestJSON-408985037-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:24.307998 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-76e89b7f-6bec-4768-adeb-2b2040562b8d tempest-HostsAdminTestJSON-408985037 tempest-HostsAdminTestJSON-408985037-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:24.308526 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-76e89b7f-6bec-4768-adeb-2b2040562b8d tempest-HostsAdminTestJSON-408985037 tempest-HostsAdminTestJSON-408985037-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:24.334040 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-76e89b7f-6bec-4768-adeb-2b2040562b8d tempest-HostsAdminTestJSON-408985037 tempest-HostsAdminTestJSON-408985037-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.037142 Aug 31 15:58:24.335122 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 384/765] 10.222.0.61 () {58 vars in 1145 bytes} [Wed Aug 31 15:58:24 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 15:58:24.346543 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ca100e0f-178c-4251-af2d-005dbf648ffe tempest-UnshelveToHostMultiNodesTest-1598069161 tempest-UnshelveToHostMultiNodesTest-1598069161-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:24.350406 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ca100e0f-178c-4251-af2d-005dbf648ffe tempest-UnshelveToHostMultiNodesTest-1598069161 tempest-UnshelveToHostMultiNodesTest-1598069161-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:24.351018 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ca100e0f-178c-4251-af2d-005dbf648ffe tempest-UnshelveToHostMultiNodesTest-1598069161 tempest-UnshelveToHostMultiNodesTest-1598069161-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:24.351164 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d1e7fb3d-1637-4233-a762-2431966dfbe8 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba336e5ac684606b5e0123e454f9a60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad48220bc634a6186547269011ec49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:24.351713 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ca100e0f-178c-4251-af2d-005dbf648ffe tempest-UnshelveToHostMultiNodesTest-1598069161 tempest-UnshelveToHostMultiNodesTest-1598069161-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:24.352581 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ca100e0f-178c-4251-af2d-005dbf648ffe tempest-UnshelveToHostMultiNodesTest-1598069161 tempest-UnshelveToHostMultiNodesTest-1598069161-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:24.353273 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ca100e0f-178c-4251-af2d-005dbf648ffe tempest-UnshelveToHostMultiNodesTest-1598069161 tempest-UnshelveToHostMultiNodesTest-1598069161-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:24.353800 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ca100e0f-178c-4251-af2d-005dbf648ffe tempest-UnshelveToHostMultiNodesTest-1598069161 tempest-UnshelveToHostMultiNodesTest-1598069161-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:24.360220 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d1e7fb3d-1637-4233-a762-2431966dfbe8 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] 10.222.0.61 "GET /compute/v2.1/servers/f977bd90-3cd4-4b07-87f9-42e26b8a530a" status: 200 len: 1469 microversion: 2.1 time: 0.223383 Aug 31 15:58:24.361188 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 382/766] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:24 2022] GET /compute/v2.1/servers/f977bd90-3cd4-4b07-87f9-42e26b8a530a => generated 1469 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:24.365670 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b5b4f1cf-99ea-4f79-891d-3858e7829573 tempest-HostsAdminTestJSON-408985037 tempest-HostsAdminTestJSON-408985037-project-admin] Calling method '.version_select at 0x7f5ae9367550>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:24.366247 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:58:24.370769 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b5b4f1cf-99ea-4f79-891d-3858e7829573 tempest-HostsAdminTestJSON-408985037 tempest-HostsAdminTestJSON-408985037-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:24.371445 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b5b4f1cf-99ea-4f79-891d-3858e7829573 tempest-HostsAdminTestJSON-408985037 tempest-HostsAdminTestJSON-408985037-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:24.372115 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b5b4f1cf-99ea-4f79-891d-3858e7829573 tempest-HostsAdminTestJSON-408985037 tempest-HostsAdminTestJSON-408985037-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:24.373234 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b5b4f1cf-99ea-4f79-891d-3858e7829573 tempest-HostsAdminTestJSON-408985037 tempest-HostsAdminTestJSON-408985037-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:24.373856 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b5b4f1cf-99ea-4f79-891d-3858e7829573 tempest-HostsAdminTestJSON-408985037 tempest-HostsAdminTestJSON-408985037-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:24.374978 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b5b4f1cf-99ea-4f79-891d-3858e7829573 tempest-HostsAdminTestJSON-408985037 tempest-HostsAdminTestJSON-408985037-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:24.382674 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ca100e0f-178c-4251-af2d-005dbf648ffe tempest-UnshelveToHostMultiNodesTest-1598069161 tempest-UnshelveToHostMultiNodesTest-1598069161-project-admin] 10.222.0.61 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 498 microversion: 2.91 time: 0.045450 Aug 31 15:58:24.383667 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 385/767] 10.222.0.61 () {60 vars in 1217 bytes} [Wed Aug 31 15:58:24 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 498 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 15:58:24.398633 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5d02f9bd-009d-47d6-85a7-be00e9103c4f tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:58:24.399385 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5d02f9bd-009d-47d6-85a7-be00e9103c4f tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:24.407330 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5d02f9bd-009d-47d6-85a7-be00e9103c4f tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:24.407944 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5d02f9bd-009d-47d6-85a7-be00e9103c4f tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:24.408456 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5d02f9bd-009d-47d6-85a7-be00e9103c4f tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:24.408737 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b5b4f1cf-99ea-4f79-891d-3858e7829573 tempest-HostsAdminTestJSON-408985037 tempest-HostsAdminTestJSON-408985037-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.046353 Aug 31 15:58:24.409525 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5d02f9bd-009d-47d6-85a7-be00e9103c4f tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:24.409646 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 383/768] 10.222.0.61 () {58 vars in 1128 bytes} [Wed Aug 31 15:58:24 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:58:24.410587 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5d02f9bd-009d-47d6-85a7-be00e9103c4f tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:24.411098 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5d02f9bd-009d-47d6-85a7-be00e9103c4f tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:24.419925 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-512c1103-af51-451d-ad2d-e6c84c2e29bd tempest-HostsAdminTestJSON-408985037 tempest-HostsAdminTestJSON-408985037-project-admin] Calling method '.version_select at 0x7f5ae93c5550>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:24.423471 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-512c1103-af51-451d-ad2d-e6c84c2e29bd tempest-HostsAdminTestJSON-408985037 tempest-HostsAdminTestJSON-408985037-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:24.424001 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-512c1103-af51-451d-ad2d-e6c84c2e29bd tempest-HostsAdminTestJSON-408985037 tempest-HostsAdminTestJSON-408985037-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:24.424436 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-512c1103-af51-451d-ad2d-e6c84c2e29bd tempest-HostsAdminTestJSON-408985037 tempest-HostsAdminTestJSON-408985037-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:24.425179 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-512c1103-af51-451d-ad2d-e6c84c2e29bd tempest-HostsAdminTestJSON-408985037 tempest-HostsAdminTestJSON-408985037-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:24.425642 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-512c1103-af51-451d-ad2d-e6c84c2e29bd tempest-HostsAdminTestJSON-408985037 tempest-HostsAdminTestJSON-408985037-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:24.426075 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-512c1103-af51-451d-ad2d-e6c84c2e29bd tempest-HostsAdminTestJSON-408985037 tempest-HostsAdminTestJSON-408985037-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:24.438345 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-5d02f9bd-009d-47d6-85a7-be00e9103c4f tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lazy-loading 'flavor' on Instance uuid 2b02272a-f8ed-45be-9d84-b9c143718689 {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:58:24.457375 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-512c1103-af51-451d-ad2d-e6c84c2e29bd tempest-HostsAdminTestJSON-408985037 tempest-HostsAdminTestJSON-408985037-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.041292 Aug 31 15:58:24.457908 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 384/769] 10.222.0.61 () {58 vars in 1155 bytes} [Wed Aug 31 15:58:24 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 15:58:24.465362 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-adc193c9-a7c7-4556-a09c-d4a109963dc7 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:24.466070 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-adc193c9-a7c7-4556-a09c-d4a109963dc7 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] [instance: d5e69723-2d0e-46ef-8f76-82d64aad4772] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:24.472744 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-adc193c9-a7c7-4556-a09c-d4a109963dc7 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:24.473240 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-adc193c9-a7c7-4556-a09c-d4a109963dc7 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:24.473679 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-adc193c9-a7c7-4556-a09c-d4a109963dc7 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:24.474564 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-adc193c9-a7c7-4556-a09c-d4a109963dc7 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:24.475029 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-adc193c9-a7c7-4556-a09c-d4a109963dc7 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:24.476980 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-adc193c9-a7c7-4556-a09c-d4a109963dc7 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:24.632635 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-adc193c9-a7c7-4556-a09c-d4a109963dc7 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377b1dedae45d2a804919e5ea69a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e5507d53224d19804717493d60bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:24.648008 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-adc193c9-a7c7-4556-a09c-d4a109963dc7 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] 10.222.0.61 "GET /compute/v2.1/servers/d5e69723-2d0e-46ef-8f76-82d64aad4772" status: 200 len: 1391 microversion: 2.1 time: 0.187303 Aug 31 15:58:24.649128 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 385/770] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:24 2022] GET /compute/v2.1/servers/d5e69723-2d0e-46ef-8f76-82d64aad4772 => generated 1391 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:24.655279 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0e69f8b9-560d-4100-8873-fedf546837b3 tempest-HostsAdminTestJSON-408985037 tempest-HostsAdminTestJSON-408985037-project-admin] Calling method '.version_select at 0x7f5ae92e8040>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:24.659273 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0e69f8b9-560d-4100-8873-fedf546837b3 tempest-HostsAdminTestJSON-408985037 tempest-HostsAdminTestJSON-408985037-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:24.660124 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0e69f8b9-560d-4100-8873-fedf546837b3 tempest-HostsAdminTestJSON-408985037 tempest-HostsAdminTestJSON-408985037-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:24.660993 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0e69f8b9-560d-4100-8873-fedf546837b3 tempest-HostsAdminTestJSON-408985037 tempest-HostsAdminTestJSON-408985037-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:24.662068 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0e69f8b9-560d-4100-8873-fedf546837b3 tempest-HostsAdminTestJSON-408985037 tempest-HostsAdminTestJSON-408985037-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:24.662744 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0e69f8b9-560d-4100-8873-fedf546837b3 tempest-HostsAdminTestJSON-408985037 tempest-HostsAdminTestJSON-408985037-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:24.663415 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0e69f8b9-560d-4100-8873-fedf546837b3 tempest-HostsAdminTestJSON-408985037 tempest-HostsAdminTestJSON-408985037-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:24.682123 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5d02f9bd-009d-47d6-85a7-be00e9103c4f tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "POST /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689/action" status: 202 len: 0 microversion: 2.91 time: 0.289164 Aug 31 15:58:24.683562 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 386/771] 10.222.0.61 () {62 vars in 1319 bytes} [Wed Aug 31 15:58:24 2022] POST /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689/action => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 15:58:24.689190 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0e69f8b9-560d-4100-8873-fedf546837b3 tempest-HostsAdminTestJSON-408985037 tempest-HostsAdminTestJSON-408985037-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.037921 Aug 31 15:58:24.694726 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 386/772] 10.222.0.61 () {58 vars in 1128 bytes} [Wed Aug 31 15:58:24 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:58:24.694877 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b7f0a83c-2407-4309-aba5-a66fecaa7cc3 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:24.694877 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b7f0a83c-2407-4309-aba5-a66fecaa7cc3 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 8555b294-db38-4246-ac58-035cb2acc70e] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:24.695049 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-81b6db9c-47ba-4835-82aa-e9cf7e76fe4b tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:24.695124 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-81b6db9c-47ba-4835-82aa-e9cf7e76fe4b tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:24.701475 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b7f0a83c-2407-4309-aba5-a66fecaa7cc3 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:24.702071 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b7f0a83c-2407-4309-aba5-a66fecaa7cc3 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:24.702186 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-81b6db9c-47ba-4835-82aa-e9cf7e76fe4b tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:24.702568 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-81b6db9c-47ba-4835-82aa-e9cf7e76fe4b tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:24.702695 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b7f0a83c-2407-4309-aba5-a66fecaa7cc3 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:24.703005 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-81b6db9c-47ba-4835-82aa-e9cf7e76fe4b tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:24.703483 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b7f0a83c-2407-4309-aba5-a66fecaa7cc3 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:24.703736 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-81b6db9c-47ba-4835-82aa-e9cf7e76fe4b tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:24.704099 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b7f0a83c-2407-4309-aba5-a66fecaa7cc3 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:24.704207 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-81b6db9c-47ba-4835-82aa-e9cf7e76fe4b tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:24.704743 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-81b6db9c-47ba-4835-82aa-e9cf7e76fe4b tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:24.705193 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b7f0a83c-2407-4309-aba5-a66fecaa7cc3 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:24.785542 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-81b6db9c-47ba-4835-82aa-e9cf7e76fe4b tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:24.796056 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-81b6db9c-47ba-4835-82aa-e9cf7e76fe4b tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:24.797521 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-81b6db9c-47ba-4835-82aa-e9cf7e76fe4b tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:24.803828 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-81b6db9c-47ba-4835-82aa-e9cf7e76fe4b tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1539 microversion: 2.91 time: 0.113014 Aug 31 15:58:24.804414 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 387/773] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:58:24 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1539 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:24.810177 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-134907a7-f147-45ac-8d13-64f60f6bb76e tempest-HostsAdminTestJSON-408985037 tempest-HostsAdminTestJSON-408985037-project-admin] Calling method '.version_select at 0x7f5ae9367a60>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:24.820597 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-134907a7-f147-45ac-8d13-64f60f6bb76e tempest-HostsAdminTestJSON-408985037 tempest-HostsAdminTestJSON-408985037-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:24.821130 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-134907a7-f147-45ac-8d13-64f60f6bb76e tempest-HostsAdminTestJSON-408985037 tempest-HostsAdminTestJSON-408985037-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:24.822060 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-134907a7-f147-45ac-8d13-64f60f6bb76e tempest-HostsAdminTestJSON-408985037 tempest-HostsAdminTestJSON-408985037-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:24.842703 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-134907a7-f147-45ac-8d13-64f60f6bb76e tempest-HostsAdminTestJSON-408985037 tempest-HostsAdminTestJSON-408985037-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:24.843205 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-134907a7-f147-45ac-8d13-64f60f6bb76e tempest-HostsAdminTestJSON-408985037 tempest-HostsAdminTestJSON-408985037-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:24.843694 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-134907a7-f147-45ac-8d13-64f60f6bb76e tempest-HostsAdminTestJSON-408985037 tempest-HostsAdminTestJSON-408985037-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:24.865703 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-134907a7-f147-45ac-8d13-64f60f6bb76e tempest-HostsAdminTestJSON-408985037 tempest-HostsAdminTestJSON-408985037-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hosts/n-h1-850499-9" status: 200 len: 729 microversion: 2.1 time: 0.059651 Aug 31 15:58:24.867620 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 388/774] 10.222.0.61 () {58 vars in 1170 bytes} [Wed Aug 31 15:58:24 2022] GET /compute/v2.1/os-hosts/n-h1-850499-9 => generated 729 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:58:24.875754 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-05244a3b-7e72-4fa4-b13f-6e99496a36bf tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:24.876381 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-05244a3b-7e72-4fa4-b13f-6e99496a36bf tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] [instance: 1dd3a7d9-7ff6-4b6f-b279-ca90c9ddb14b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:24.883048 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-05244a3b-7e72-4fa4-b13f-6e99496a36bf tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:24.883575 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-05244a3b-7e72-4fa4-b13f-6e99496a36bf tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:24.884912 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-05244a3b-7e72-4fa4-b13f-6e99496a36bf tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:24.885645 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-05244a3b-7e72-4fa4-b13f-6e99496a36bf tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:24.886113 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-05244a3b-7e72-4fa4-b13f-6e99496a36bf tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:24.886551 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-05244a3b-7e72-4fa4-b13f-6e99496a36bf tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:24.898146 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b7f0a83c-2407-4309-aba5-a66fecaa7cc3 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:24.909248 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b7f0a83c-2407-4309-aba5-a66fecaa7cc3 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:24.911807 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b7f0a83c-2407-4309-aba5-a66fecaa7cc3 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:24.913659 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b7f0a83c-2407-4309-aba5-a66fecaa7cc3 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/8555b294-db38-4246-ac58-035cb2acc70e" status: 200 len: 1361 microversion: 2.25 time: 0.225519 Aug 31 15:58:24.914375 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 387/775] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:58:24 2022] GET /compute/v2.1/servers/8555b294-db38-4246-ac58-035cb2acc70e => generated 1361 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:24.922027 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-99dbd056-9536-435f-8f17-eea6c8666f34 tempest-HostsAdminTestJSON-408985037 tempest-HostsAdminTestJSON-408985037-project-admin] Calling method '.version_select at 0x7f5ae9470280>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:24.929370 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-99dbd056-9536-435f-8f17-eea6c8666f34 tempest-HostsAdminTestJSON-408985037 tempest-HostsAdminTestJSON-408985037-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:24.929870 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-99dbd056-9536-435f-8f17-eea6c8666f34 tempest-HostsAdminTestJSON-408985037 tempest-HostsAdminTestJSON-408985037-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:24.930315 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-99dbd056-9536-435f-8f17-eea6c8666f34 tempest-HostsAdminTestJSON-408985037 tempest-HostsAdminTestJSON-408985037-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:24.944786 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-99dbd056-9536-435f-8f17-eea6c8666f34 tempest-HostsAdminTestJSON-408985037 tempest-HostsAdminTestJSON-408985037-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:24.945285 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-99dbd056-9536-435f-8f17-eea6c8666f34 tempest-HostsAdminTestJSON-408985037 tempest-HostsAdminTestJSON-408985037-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:24.945728 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-99dbd056-9536-435f-8f17-eea6c8666f34 tempest-HostsAdminTestJSON-408985037 tempest-HostsAdminTestJSON-408985037-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:24.975294 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-99dbd056-9536-435f-8f17-eea6c8666f34 tempest-HostsAdminTestJSON-408985037 tempest-HostsAdminTestJSON-408985037-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hosts/n-h2-850499-9" status: 200 len: 991 microversion: 2.1 time: 0.059117 Aug 31 15:58:24.979674 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 388/776] 10.222.0.61 () {58 vars in 1170 bytes} [Wed Aug 31 15:58:24 2022] GET /compute/v2.1/os-hosts/n-h2-850499-9 => generated 991 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:58:24.986309 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-18bba6e2-2e9b-413e-9c06-d1ac625eb25a tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:24.987158 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-18bba6e2-2e9b-413e-9c06-d1ac625eb25a tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] [instance: aa95066b-b1b8-43d8-8c5a-024e3890aa27] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:25.000124 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-18bba6e2-2e9b-413e-9c06-d1ac625eb25a tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:25.000956 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-18bba6e2-2e9b-413e-9c06-d1ac625eb25a tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:25.001418 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-18bba6e2-2e9b-413e-9c06-d1ac625eb25a tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:25.003513 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-18bba6e2-2e9b-413e-9c06-d1ac625eb25a tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:25.004192 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-18bba6e2-2e9b-413e-9c06-d1ac625eb25a tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:25.004644 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-18bba6e2-2e9b-413e-9c06-d1ac625eb25a tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:25.116760 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-05244a3b-7e72-4fa4-b13f-6e99496a36bf tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a03cc5956ca477abacbe0c26bf18750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea45d1b678342ed812f9912e9f07503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:25.128068 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-05244a3b-7e72-4fa4-b13f-6e99496a36bf tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] 10.222.0.61 "GET /compute/v2.1/servers/1dd3a7d9-7ff6-4b6f-b279-ca90c9ddb14b" status: 200 len: 1314 microversion: 2.1 time: 0.258950 Aug 31 15:58:25.146800 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 389/777] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:24 2022] GET /compute/v2.1/servers/1dd3a7d9-7ff6-4b6f-b279-ca90c9ddb14b => generated 1314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:25.155670 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e8b9283f-d083-4cb1-aeeb-54b96be788c7 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:25.156876 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e8b9283f-d083-4cb1-aeeb-54b96be788c7 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: 2ddb0b07-9e31-403c-91d5-a278d632d754] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:25.164874 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e8b9283f-d083-4cb1-aeeb-54b96be788c7 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:25.165844 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e8b9283f-d083-4cb1-aeeb-54b96be788c7 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:25.166697 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e8b9283f-d083-4cb1-aeeb-54b96be788c7 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:25.167640 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e8b9283f-d083-4cb1-aeeb-54b96be788c7 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:25.168596 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e8b9283f-d083-4cb1-aeeb-54b96be788c7 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:25.169417 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e8b9283f-d083-4cb1-aeeb-54b96be788c7 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:25.298404 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-18bba6e2-2e9b-413e-9c06-d1ac625eb25a tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccce16c7fda401ea68fb31ea8099d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed252ebf7c741bbb36b553ac1767579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:25.311637 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-18bba6e2-2e9b-413e-9c06-d1ac625eb25a tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "GET /compute/v2.1/servers/aa95066b-b1b8-43d8-8c5a-024e3890aa27" status: 200 len: 1228 microversion: 2.1 time: 0.327529 Aug 31 15:58:25.328548 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 389/778] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:24 2022] GET /compute/v2.1/servers/aa95066b-b1b8-43d8-8c5a-024e3890aa27 => generated 1228 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:25.333786 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-1437ed0e-fbdf-4a50-b17b-a9e0b9de338d req-5515cc06-e040-4df5-b725-4ac24531303f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e45fa8b9-1545-4bd5-aa5f-402c71ec19c6", "name": "network-vif-plugged", "status": "completed", "tag": "935e822d-4171-4348-8a87-c6e76ab1ea4f"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:58:25.358042 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-1437ed0e-fbdf-4a50-b17b-a9e0b9de338d req-5515cc06-e040-4df5-b725-4ac24531303f service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:25.358531 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-1437ed0e-fbdf-4a50-b17b-a9e0b9de338d req-5515cc06-e040-4df5-b725-4ac24531303f service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:25.358970 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-1437ed0e-fbdf-4a50-b17b-a9e0b9de338d req-5515cc06-e040-4df5-b725-4ac24531303f service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:25.391704 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-1437ed0e-fbdf-4a50-b17b-a9e0b9de338d req-5515cc06-e040-4df5-b725-4ac24531303f service nova] Creating event network-vif-plugged:935e822d-4171-4348-8a87-c6e76ab1ea4f for instance e45fa8b9-1545-4bd5-aa5f-402c71ec19c6 on n-h2-850499-9 Aug 31 15:58:25.407878 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-1437ed0e-fbdf-4a50-b17b-a9e0b9de338d req-5515cc06-e040-4df5-b725-4ac24531303f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074640 Aug 31 15:58:25.409475 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 390/779] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 15:58:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:58:25.422984 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5838fb8c-6cbc-41d2-a209-4e453ac3da13 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:25.430235 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5838fb8c-6cbc-41d2-a209-4e453ac3da13 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] [instance: f977bd90-3cd4-4b07-87f9-42e26b8a530a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:25.439037 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5838fb8c-6cbc-41d2-a209-4e453ac3da13 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:25.440321 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5838fb8c-6cbc-41d2-a209-4e453ac3da13 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:25.440926 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5838fb8c-6cbc-41d2-a209-4e453ac3da13 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:25.441808 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5838fb8c-6cbc-41d2-a209-4e453ac3da13 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:25.442457 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5838fb8c-6cbc-41d2-a209-4e453ac3da13 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:25.443187 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5838fb8c-6cbc-41d2-a209-4e453ac3da13 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:26.216242 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e8b9283f-d083-4cb1-aeeb-54b96be788c7 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:26.228775 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e8b9283f-d083-4cb1-aeeb-54b96be788c7 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/2ddb0b07-9e31-403c-91d5-a278d632d754" status: 200 len: 1503 microversion: 2.1 time: 1.076039 Aug 31 15:58:26.229404 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 390/780] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:25 2022] GET /compute/v2.1/servers/2ddb0b07-9e31-403c-91d5-a278d632d754 => generated 1503 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:26.234833 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5838fb8c-6cbc-41d2-a209-4e453ac3da13 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba336e5ac684606b5e0123e454f9a60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad48220bc634a6186547269011ec49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:26.245005 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5838fb8c-6cbc-41d2-a209-4e453ac3da13 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] 10.222.0.61 "GET /compute/v2.1/servers/f977bd90-3cd4-4b07-87f9-42e26b8a530a" status: 200 len: 1469 microversion: 2.1 time: 0.833154 Aug 31 15:58:26.246063 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 391/781] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:25 2022] GET /compute/v2.1/servers/f977bd90-3cd4-4b07-87f9-42e26b8a530a => generated 1469 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:26.260604 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e9eb831f-9a5e-4b1d-bd97-b254037d16a0 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:26.261546 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e9eb831f-9a5e-4b1d-bd97-b254037d16a0 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:26.268476 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-55339770-bf4e-4286-927a-3a18796b727f tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:26.271049 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-55339770-bf4e-4286-927a-3a18796b727f tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] [instance: d5e69723-2d0e-46ef-8f76-82d64aad4772] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:26.277654 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e9eb831f-9a5e-4b1d-bd97-b254037d16a0 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:26.278097 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e9eb831f-9a5e-4b1d-bd97-b254037d16a0 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:26.279946 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e9eb831f-9a5e-4b1d-bd97-b254037d16a0 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:26.280698 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e9eb831f-9a5e-4b1d-bd97-b254037d16a0 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:26.283751 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e9eb831f-9a5e-4b1d-bd97-b254037d16a0 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:26.284254 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e9eb831f-9a5e-4b1d-bd97-b254037d16a0 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:26.286256 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-55339770-bf4e-4286-927a-3a18796b727f tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:26.286767 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-55339770-bf4e-4286-927a-3a18796b727f tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:26.287211 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-55339770-bf4e-4286-927a-3a18796b727f tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:26.287962 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-55339770-bf4e-4286-927a-3a18796b727f tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:26.288494 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-55339770-bf4e-4286-927a-3a18796b727f tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:26.289615 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-55339770-bf4e-4286-927a-3a18796b727f tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:26.532556 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e9eb831f-9a5e-4b1d-bd97-b254037d16a0 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:26.542683 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e9eb831f-9a5e-4b1d-bd97-b254037d16a0 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:26.544193 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e9eb831f-9a5e-4b1d-bd97-b254037d16a0 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:26.549326 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e9eb831f-9a5e-4b1d-bd97-b254037d16a0 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1539 microversion: 2.91 time: 0.294097 Aug 31 15:58:26.563910 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 392/782] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:58:26 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1539 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:26.573500 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-22b754e2-46de-4e74-ad09-e944c6da8d71 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:26.574390 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-22b754e2-46de-4e74-ad09-e944c6da8d71 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 8555b294-db38-4246-ac58-035cb2acc70e] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:26.580569 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-22b754e2-46de-4e74-ad09-e944c6da8d71 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:26.581301 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-22b754e2-46de-4e74-ad09-e944c6da8d71 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:26.581896 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-22b754e2-46de-4e74-ad09-e944c6da8d71 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:26.582851 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-22b754e2-46de-4e74-ad09-e944c6da8d71 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:26.583483 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-22b754e2-46de-4e74-ad09-e944c6da8d71 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:26.584082 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-22b754e2-46de-4e74-ad09-e944c6da8d71 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:26.601943 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:58:26.925953 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-55339770-bf4e-4286-927a-3a18796b727f tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377b1dedae45d2a804919e5ea69a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e5507d53224d19804717493d60bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:26.940063 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-55339770-bf4e-4286-927a-3a18796b727f tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] 10.222.0.61 "GET /compute/v2.1/servers/d5e69723-2d0e-46ef-8f76-82d64aad4772" status: 200 len: 1391 microversion: 2.1 time: 0.708336 Aug 31 15:58:26.943987 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 391/783] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:26 2022] GET /compute/v2.1/servers/d5e69723-2d0e-46ef-8f76-82d64aad4772 => generated 1391 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:26.952543 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d6ae46f5-f17a-4584-8401-5469d079fb83 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:26.953970 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d6ae46f5-f17a-4584-8401-5469d079fb83 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] [instance: 1dd3a7d9-7ff6-4b6f-b279-ca90c9ddb14b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:26.964646 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d6ae46f5-f17a-4584-8401-5469d079fb83 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:26.965537 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d6ae46f5-f17a-4584-8401-5469d079fb83 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:26.966142 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d6ae46f5-f17a-4584-8401-5469d079fb83 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:26.967653 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d6ae46f5-f17a-4584-8401-5469d079fb83 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:26.968289 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d6ae46f5-f17a-4584-8401-5469d079fb83 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:26.969121 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d6ae46f5-f17a-4584-8401-5469d079fb83 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:27.258769 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-22b754e2-46de-4e74-ad09-e944c6da8d71 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:27.274987 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-22b754e2-46de-4e74-ad09-e944c6da8d71 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:27.278079 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-22b754e2-46de-4e74-ad09-e944c6da8d71 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:27.282544 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-22b754e2-46de-4e74-ad09-e944c6da8d71 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/8555b294-db38-4246-ac58-035cb2acc70e" status: 200 len: 1361 microversion: 2.25 time: 0.716316 Aug 31 15:58:27.286112 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 393/784] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:58:26 2022] GET /compute/v2.1/servers/8555b294-db38-4246-ac58-035cb2acc70e => generated 1361 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:27.295955 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-67d148d8-6989-40cf-aa79-bf7d0202da1e tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:27.296600 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-67d148d8-6989-40cf-aa79-bf7d0202da1e tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] [instance: aa95066b-b1b8-43d8-8c5a-024e3890aa27] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:27.305841 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-67d148d8-6989-40cf-aa79-bf7d0202da1e tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:27.306429 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-67d148d8-6989-40cf-aa79-bf7d0202da1e tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:27.306868 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-67d148d8-6989-40cf-aa79-bf7d0202da1e tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:27.307603 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-67d148d8-6989-40cf-aa79-bf7d0202da1e tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:27.308062 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-67d148d8-6989-40cf-aa79-bf7d0202da1e tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:27.308562 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-67d148d8-6989-40cf-aa79-bf7d0202da1e tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:27.475200 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-67d148d8-6989-40cf-aa79-bf7d0202da1e tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccce16c7fda401ea68fb31ea8099d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed252ebf7c741bbb36b553ac1767579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:27.483833 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d6ae46f5-f17a-4584-8401-5469d079fb83 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a03cc5956ca477abacbe0c26bf18750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea45d1b678342ed812f9912e9f07503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:27.490161 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-67d148d8-6989-40cf-aa79-bf7d0202da1e tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "GET /compute/v2.1/servers/aa95066b-b1b8-43d8-8c5a-024e3890aa27" status: 200 len: 1282 microversion: 2.1 time: 0.201272 Aug 31 15:58:27.492973 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 394/785] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:27 2022] GET /compute/v2.1/servers/aa95066b-b1b8-43d8-8c5a-024e3890aa27 => generated 1282 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:27.509420 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-89b43ea0-d9ea-4749-b9e8-f823174441dd tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:27.511798 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-89b43ea0-d9ea-4749-b9e8-f823174441dd tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: 2ddb0b07-9e31-403c-91d5-a278d632d754] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:27.517832 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d6ae46f5-f17a-4584-8401-5469d079fb83 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] 10.222.0.61 "GET /compute/v2.1/servers/1dd3a7d9-7ff6-4b6f-b279-ca90c9ddb14b" status: 200 len: 1314 microversion: 2.1 time: 0.571757 Aug 31 15:58:27.528603 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 392/786] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:26 2022] GET /compute/v2.1/servers/1dd3a7d9-7ff6-4b6f-b279-ca90c9ddb14b => generated 1314 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:27.529858 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-89b43ea0-d9ea-4749-b9e8-f823174441dd tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:27.530743 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-89b43ea0-d9ea-4749-b9e8-f823174441dd tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:27.531397 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-89b43ea0-d9ea-4749-b9e8-f823174441dd tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:27.534280 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-89b43ea0-d9ea-4749-b9e8-f823174441dd tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:27.537124 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-89b43ea0-d9ea-4749-b9e8-f823174441dd tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:27.538866 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-89b43ea0-d9ea-4749-b9e8-f823174441dd tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:27.539396 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-be6591f2-67ff-485b-bcc9-17495b9c6818 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:27.540076 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-be6591f2-67ff-485b-bcc9-17495b9c6818 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] [instance: f977bd90-3cd4-4b07-87f9-42e26b8a530a] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:27.561104 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-be6591f2-67ff-485b-bcc9-17495b9c6818 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:27.561856 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-be6591f2-67ff-485b-bcc9-17495b9c6818 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:27.562437 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-be6591f2-67ff-485b-bcc9-17495b9c6818 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:27.563306 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-be6591f2-67ff-485b-bcc9-17495b9c6818 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:27.563793 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-be6591f2-67ff-485b-bcc9-17495b9c6818 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:27.564219 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-be6591f2-67ff-485b-bcc9-17495b9c6818 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:27.994311 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-be6591f2-67ff-485b-bcc9-17495b9c6818 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba336e5ac684606b5e0123e454f9a60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad48220bc634a6186547269011ec49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:28.004783 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-be6591f2-67ff-485b-bcc9-17495b9c6818 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] 10.222.0.61 "GET /compute/v2.1/servers/f977bd90-3cd4-4b07-87f9-42e26b8a530a" status: 200 len: 1469 microversion: 2.1 time: 0.474878 Aug 31 15:58:28.005875 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 393/787] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:27 2022] GET /compute/v2.1/servers/f977bd90-3cd4-4b07-87f9-42e26b8a530a => generated 1469 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:28.011918 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5c3a1c26-e230-406f-8c77-cb73d0d59ee4 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:28.012515 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5c3a1c26-e230-406f-8c77-cb73d0d59ee4 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:28.018921 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5c3a1c26-e230-406f-8c77-cb73d0d59ee4 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:28.019409 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5c3a1c26-e230-406f-8c77-cb73d0d59ee4 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:28.019903 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5c3a1c26-e230-406f-8c77-cb73d0d59ee4 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:28.020767 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5c3a1c26-e230-406f-8c77-cb73d0d59ee4 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:28.021377 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5c3a1c26-e230-406f-8c77-cb73d0d59ee4 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:28.022060 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5c3a1c26-e230-406f-8c77-cb73d0d59ee4 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:28.056672 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-89b43ea0-d9ea-4749-b9e8-f823174441dd tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:28.080819 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-89b43ea0-d9ea-4749-b9e8-f823174441dd tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/2ddb0b07-9e31-403c-91d5-a278d632d754" status: 200 len: 1503 microversion: 2.1 time: 0.585924 Aug 31 15:58:28.081325 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 395/788] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:27 2022] GET /compute/v2.1/servers/2ddb0b07-9e31-403c-91d5-a278d632d754 => generated 1503 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:28.092735 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5fcd5ae2-ad59-493f-9659-cfd5629054ea tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:28.093367 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5fcd5ae2-ad59-493f-9659-cfd5629054ea tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] [instance: d5e69723-2d0e-46ef-8f76-82d64aad4772] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:28.103680 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5fcd5ae2-ad59-493f-9659-cfd5629054ea tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:28.103863 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5fcd5ae2-ad59-493f-9659-cfd5629054ea tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:28.104370 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5fcd5ae2-ad59-493f-9659-cfd5629054ea tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:28.104996 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5fcd5ae2-ad59-493f-9659-cfd5629054ea tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:28.105960 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5fcd5ae2-ad59-493f-9659-cfd5629054ea tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:28.108231 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5fcd5ae2-ad59-493f-9659-cfd5629054ea tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:28.181507 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5c3a1c26-e230-406f-8c77-cb73d0d59ee4 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:28.198440 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5c3a1c26-e230-406f-8c77-cb73d0d59ee4 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:28.200343 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5c3a1c26-e230-406f-8c77-cb73d0d59ee4 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:28.207056 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5c3a1c26-e230-406f-8c77-cb73d0d59ee4 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1539 microversion: 2.91 time: 0.199871 Aug 31 15:58:28.208502 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 394/789] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:58:28 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1539 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:28.263100 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-7c1f43e3-7d73-4a68-929d-48a96f8c6372 req-ced309a5-c569-4666-bf38-61b03f19296c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f977bd90-3cd4-4b07-87f9-42e26b8a530a", "name": "network-vif-deleted", "tag": "a9441445-ce6b-4242-a4d0-c5a2444ed50a"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:58:28.276626 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-7c1f43e3-7d73-4a68-929d-48a96f8c6372 req-ced309a5-c569-4666-bf38-61b03f19296c service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:28.277501 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-7c1f43e3-7d73-4a68-929d-48a96f8c6372 req-ced309a5-c569-4666-bf38-61b03f19296c service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:28.278382 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-7c1f43e3-7d73-4a68-929d-48a96f8c6372 req-ced309a5-c569-4666-bf38-61b03f19296c service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:28.294084 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-7c1f43e3-7d73-4a68-929d-48a96f8c6372 req-ced309a5-c569-4666-bf38-61b03f19296c service nova] Creating event network-vif-deleted:a9441445-ce6b-4242-a4d0-c5a2444ed50a for instance f977bd90-3cd4-4b07-87f9-42e26b8a530a on n-h2-850499-9 Aug 31 15:58:28.300548 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-7c1f43e3-7d73-4a68-929d-48a96f8c6372 req-ced309a5-c569-4666-bf38-61b03f19296c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041347 Aug 31 15:58:28.302069 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 395/790] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 15:58:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:58:28.313413 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8f4b280a-64cd-4633-9e0a-df30eaed1066 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:28.314487 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8f4b280a-64cd-4633-9e0a-df30eaed1066 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 8555b294-db38-4246-ac58-035cb2acc70e] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:28.322483 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8f4b280a-64cd-4633-9e0a-df30eaed1066 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:28.323283 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8f4b280a-64cd-4633-9e0a-df30eaed1066 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:28.324124 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8f4b280a-64cd-4633-9e0a-df30eaed1066 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:28.325045 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8f4b280a-64cd-4633-9e0a-df30eaed1066 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:28.325711 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8f4b280a-64cd-4633-9e0a-df30eaed1066 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:28.326332 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8f4b280a-64cd-4633-9e0a-df30eaed1066 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:28.352271 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=100 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:58:28.551585 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5fcd5ae2-ad59-493f-9659-cfd5629054ea tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377b1dedae45d2a804919e5ea69a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e5507d53224d19804717493d60bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:28.562960 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5fcd5ae2-ad59-493f-9659-cfd5629054ea tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] 10.222.0.61 "GET /compute/v2.1/servers/d5e69723-2d0e-46ef-8f76-82d64aad4772" status: 200 len: 1391 microversion: 2.1 time: 0.477472 Aug 31 15:58:28.564051 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 396/791] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:28 2022] GET /compute/v2.1/servers/d5e69723-2d0e-46ef-8f76-82d64aad4772 => generated 1391 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:28.571893 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f262a1cb-b72c-409e-8c54-e43ffd74dc8d tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:28.572514 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f262a1cb-b72c-409e-8c54-e43ffd74dc8d tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] [instance: aa95066b-b1b8-43d8-8c5a-024e3890aa27] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:28.580992 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f262a1cb-b72c-409e-8c54-e43ffd74dc8d tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:28.581491 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f262a1cb-b72c-409e-8c54-e43ffd74dc8d tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:28.582066 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f262a1cb-b72c-409e-8c54-e43ffd74dc8d tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:28.582782 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f262a1cb-b72c-409e-8c54-e43ffd74dc8d tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:28.583244 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f262a1cb-b72c-409e-8c54-e43ffd74dc8d tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:28.583718 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f262a1cb-b72c-409e-8c54-e43ffd74dc8d tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:28.974898 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f262a1cb-b72c-409e-8c54-e43ffd74dc8d tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccce16c7fda401ea68fb31ea8099d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed252ebf7c741bbb36b553ac1767579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:28.987060 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f262a1cb-b72c-409e-8c54-e43ffd74dc8d tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "GET /compute/v2.1/servers/aa95066b-b1b8-43d8-8c5a-024e3890aa27" status: 200 len: 1282 microversion: 2.1 time: 0.421221 Aug 31 15:58:29.001563 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 397/792] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:28 2022] GET /compute/v2.1/servers/aa95066b-b1b8-43d8-8c5a-024e3890aa27 => generated 1282 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:29.005730 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8f4b280a-64cd-4633-9e0a-df30eaed1066 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:29.010734 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-12ec413c-a44b-439e-9712-eb5600c76e11 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:29.012374 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-12ec413c-a44b-439e-9712-eb5600c76e11 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] [instance: 1dd3a7d9-7ff6-4b6f-b279-ca90c9ddb14b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:29.015337 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8f4b280a-64cd-4633-9e0a-df30eaed1066 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:29.017103 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8f4b280a-64cd-4633-9e0a-df30eaed1066 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:29.019201 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8f4b280a-64cd-4633-9e0a-df30eaed1066 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/8555b294-db38-4246-ac58-035cb2acc70e" status: 200 len: 1361 microversion: 2.25 time: 0.710618 Aug 31 15:58:29.020373 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 396/793] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:58:28 2022] GET /compute/v2.1/servers/8555b294-db38-4246-ac58-035cb2acc70e => generated 1361 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 15:58:29.024091 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-12ec413c-a44b-439e-9712-eb5600c76e11 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:29.025491 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-12ec413c-a44b-439e-9712-eb5600c76e11 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:29.026303 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-12ec413c-a44b-439e-9712-eb5600c76e11 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:29.027312 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-12ec413c-a44b-439e-9712-eb5600c76e11 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:29.028657 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-12ec413c-a44b-439e-9712-eb5600c76e11 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:29.029426 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-12ec413c-a44b-439e-9712-eb5600c76e11 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:29.032827 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7da73271-0a65-40ea-af21-2fbe3a01ce71 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:29.034274 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7da73271-0a65-40ea-af21-2fbe3a01ce71 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] [instance: f977bd90-3cd4-4b07-87f9-42e26b8a530a] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:29.043631 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7da73271-0a65-40ea-af21-2fbe3a01ce71 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:29.045291 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7da73271-0a65-40ea-af21-2fbe3a01ce71 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:29.046445 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7da73271-0a65-40ea-af21-2fbe3a01ce71 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:29.048626 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7da73271-0a65-40ea-af21-2fbe3a01ce71 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:29.050883 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7da73271-0a65-40ea-af21-2fbe3a01ce71 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:29.051889 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7da73271-0a65-40ea-af21-2fbe3a01ce71 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:29.098504 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7da73271-0a65-40ea-af21-2fbe3a01ce71 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:29.099109 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7da73271-0a65-40ea-af21-2fbe3a01ce71 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:29.099856 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7da73271-0a65-40ea-af21-2fbe3a01ce71 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:29.100461 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-7da73271-0a65-40ea-af21-2fbe3a01ce71 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Lazy-loading 'fault' on Instance uuid f977bd90-3cd4-4b07-87f9-42e26b8a530a {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:58:29.253593 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7da73271-0a65-40ea-af21-2fbe3a01ce71 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba336e5ac684606b5e0123e454f9a60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad48220bc634a6186547269011ec49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:29.262610 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7da73271-0a65-40ea-af21-2fbe3a01ce71 tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] 10.222.0.61 "GET /compute/v2.1/servers/f977bd90-3cd4-4b07-87f9-42e26b8a530a" status: 200 len: 1303 microversion: 2.1 time: 0.240106 Aug 31 15:58:29.277001 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 397/794] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:29 2022] GET /compute/v2.1/servers/f977bd90-3cd4-4b07-87f9-42e26b8a530a => generated 1303 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:58:29.282230 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8632c7d9-1ecc-42f3-ae1d-a3578c8d0911 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:29.283120 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8632c7d9-1ecc-42f3-ae1d-a3578c8d0911 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: 2ddb0b07-9e31-403c-91d5-a278d632d754] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:29.290734 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8632c7d9-1ecc-42f3-ae1d-a3578c8d0911 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:29.291554 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8632c7d9-1ecc-42f3-ae1d-a3578c8d0911 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:29.292209 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8632c7d9-1ecc-42f3-ae1d-a3578c8d0911 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:29.293158 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8632c7d9-1ecc-42f3-ae1d-a3578c8d0911 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:29.293992 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8632c7d9-1ecc-42f3-ae1d-a3578c8d0911 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:29.294659 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8632c7d9-1ecc-42f3-ae1d-a3578c8d0911 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:29.674820 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-12ec413c-a44b-439e-9712-eb5600c76e11 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a03cc5956ca477abacbe0c26bf18750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea45d1b678342ed812f9912e9f07503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:29.687774 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-12ec413c-a44b-439e-9712-eb5600c76e11 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] 10.222.0.61 "GET /compute/v2.1/servers/1dd3a7d9-7ff6-4b6f-b279-ca90c9ddb14b" status: 200 len: 1463 microversion: 2.1 time: 0.682805 Aug 31 15:58:29.688402 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 398/795] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:29 2022] GET /compute/v2.1/servers/1dd3a7d9-7ff6-4b6f-b279-ca90c9ddb14b => generated 1463 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:29.710033 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-2363c259-eceb-4605-a09c-de1c26d2c631 req-2b7ba5e8-057c-42eb-a94b-4a380ab94193 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8555b294-db38-4246-ac58-035cb2acc70e", "name": "network-vif-plugged", "status": "completed", "tag": "a4e66017-bbca-4435-8809-d986a9a6cbd2"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:58:29.725689 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-2363c259-eceb-4605-a09c-de1c26d2c631 req-2b7ba5e8-057c-42eb-a94b-4a380ab94193 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:29.726244 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-2363c259-eceb-4605-a09c-de1c26d2c631 req-2b7ba5e8-057c-42eb-a94b-4a380ab94193 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:29.726740 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-2363c259-eceb-4605-a09c-de1c26d2c631 req-2b7ba5e8-057c-42eb-a94b-4a380ab94193 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:29.758151 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-2363c259-eceb-4605-a09c-de1c26d2c631 req-2b7ba5e8-057c-42eb-a94b-4a380ab94193 service nova] Creating event network-vif-plugged:a4e66017-bbca-4435-8809-d986a9a6cbd2 for instance 8555b294-db38-4246-ac58-035cb2acc70e on n-h2-850499-9 Aug 31 15:58:29.764773 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-2363c259-eceb-4605-a09c-de1c26d2c631 req-2b7ba5e8-057c-42eb-a94b-4a380ab94193 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066946 Aug 31 15:58:29.765726 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 399/796] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 15:58:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:58:29.772147 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-417bd1a5-d4de-488a-a960-5322beab9714 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:29.772864 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-417bd1a5-d4de-488a-a960-5322beab9714 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:29.780421 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-417bd1a5-d4de-488a-a960-5322beab9714 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:29.780999 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-417bd1a5-d4de-488a-a960-5322beab9714 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:29.781524 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-417bd1a5-d4de-488a-a960-5322beab9714 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:29.782436 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-417bd1a5-d4de-488a-a960-5322beab9714 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:29.782886 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-417bd1a5-d4de-488a-a960-5322beab9714 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:29.783308 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-417bd1a5-d4de-488a-a960-5322beab9714 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:29.872673 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8632c7d9-1ecc-42f3-ae1d-a3578c8d0911 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:29.881803 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8632c7d9-1ecc-42f3-ae1d-a3578c8d0911 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/2ddb0b07-9e31-403c-91d5-a278d632d754" status: 200 len: 1503 microversion: 2.1 time: 0.603516 Aug 31 15:58:29.896446 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 398/797] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:29 2022] GET /compute/v2.1/servers/2ddb0b07-9e31-403c-91d5-a278d632d754 => generated 1503 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:29.902513 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-40a4676b-5159-4cb2-8383-e56667c2d304 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:29.903444 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-40a4676b-5159-4cb2-8383-e56667c2d304 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] [instance: d5e69723-2d0e-46ef-8f76-82d64aad4772] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:29.906408 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:58:29.910323 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-40a4676b-5159-4cb2-8383-e56667c2d304 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:29.910934 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-40a4676b-5159-4cb2-8383-e56667c2d304 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:29.911429 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-40a4676b-5159-4cb2-8383-e56667c2d304 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:29.912557 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-40a4676b-5159-4cb2-8383-e56667c2d304 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:29.913202 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-40a4676b-5159-4cb2-8383-e56667c2d304 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:29.913791 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-40a4676b-5159-4cb2-8383-e56667c2d304 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:29.973640 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-417bd1a5-d4de-488a-a960-5322beab9714 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:29.989255 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-417bd1a5-d4de-488a-a960-5322beab9714 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:29.990713 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-417bd1a5-d4de-488a-a960-5322beab9714 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:30.004959 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-417bd1a5-d4de-488a-a960-5322beab9714 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1539 microversion: 2.91 time: 0.237733 Aug 31 15:58:30.005622 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 400/798] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:58:29 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1539 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:30.012447 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ea4483b1-ef0f-40b6-ae0e-3d3978e1f689 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:30.013203 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ea4483b1-ef0f-40b6-ae0e-3d3978e1f689 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] [instance: e45fa8b9-1545-4bd5-aa5f-402c71ec19c6] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:30.020335 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ea4483b1-ef0f-40b6-ae0e-3d3978e1f689 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:30.021091 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ea4483b1-ef0f-40b6-ae0e-3d3978e1f689 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:30.021762 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ea4483b1-ef0f-40b6-ae0e-3d3978e1f689 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:30.022695 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ea4483b1-ef0f-40b6-ae0e-3d3978e1f689 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:30.023390 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ea4483b1-ef0f-40b6-ae0e-3d3978e1f689 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:30.023907 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ea4483b1-ef0f-40b6-ae0e-3d3978e1f689 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:30.465218 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-40a4676b-5159-4cb2-8383-e56667c2d304 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377b1dedae45d2a804919e5ea69a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e5507d53224d19804717493d60bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:30.473158 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-40a4676b-5159-4cb2-8383-e56667c2d304 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] 10.222.0.61 "GET /compute/v2.1/servers/d5e69723-2d0e-46ef-8f76-82d64aad4772" status: 200 len: 1391 microversion: 2.1 time: 0.575319 Aug 31 15:58:30.473729 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 399/799] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:29 2022] GET /compute/v2.1/servers/d5e69723-2d0e-46ef-8f76-82d64aad4772 => generated 1391 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:30.477792 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ea4483b1-ef0f-40b6-ae0e-3d3978e1f689 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a03cc5956ca477abacbe0c26bf18750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea45d1b678342ed812f9912e9f07503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:30.485748 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ea4483b1-ef0f-40b6-ae0e-3d3978e1f689 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] 10.222.0.61 "GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6" status: 200 len: 1464 microversion: 2.1 time: 0.478905 Aug 31 15:58:30.486484 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 401/800] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:30 2022] GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6 => generated 1464 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:30.491756 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-43897d15-4945-4ce2-82eb-d0a2e981faf1 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:30.492665 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-43897d15-4945-4ce2-82eb-d0a2e981faf1 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] [instance: aa95066b-b1b8-43d8-8c5a-024e3890aa27] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:30.501476 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-43897d15-4945-4ce2-82eb-d0a2e981faf1 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:30.502207 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-43897d15-4945-4ce2-82eb-d0a2e981faf1 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:30.502828 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-43897d15-4945-4ce2-82eb-d0a2e981faf1 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:30.503742 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-43897d15-4945-4ce2-82eb-d0a2e981faf1 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:30.504980 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-43897d15-4945-4ce2-82eb-d0a2e981faf1 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:30.507861 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-43897d15-4945-4ce2-82eb-d0a2e981faf1 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:30.656950 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-21d51459-ea59-4486-841d-33b1267a0984 tempest-NetworksTest-1858975067 tempest-NetworksTest-1858975067-project-admin] Calling method '.version_select at 0x7f5ae93679d0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:30.824323 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-43897d15-4945-4ce2-82eb-d0a2e981faf1 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccce16c7fda401ea68fb31ea8099d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed252ebf7c741bbb36b553ac1767579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:30.832128 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-43897d15-4945-4ce2-82eb-d0a2e981faf1 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "GET /compute/v2.1/servers/aa95066b-b1b8-43d8-8c5a-024e3890aa27" status: 200 len: 1324 microversion: 2.1 time: 0.343994 Aug 31 15:58:30.832827 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 402/801] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:30 2022] GET /compute/v2.1/servers/aa95066b-b1b8-43d8-8c5a-024e3890aa27 => generated 1324 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:30.838024 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6ecf9f16-62af-47dc-ac0c-ae414c5fc0a4 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:30.839003 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6ecf9f16-62af-47dc-ac0c-ae414c5fc0a4 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 8555b294-db38-4246-ac58-035cb2acc70e] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:30.850660 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6ecf9f16-62af-47dc-ac0c-ae414c5fc0a4 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:30.851451 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6ecf9f16-62af-47dc-ac0c-ae414c5fc0a4 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:30.852112 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6ecf9f16-62af-47dc-ac0c-ae414c5fc0a4 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:30.853418 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6ecf9f16-62af-47dc-ac0c-ae414c5fc0a4 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:30.853959 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6ecf9f16-62af-47dc-ac0c-ae414c5fc0a4 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:30.854776 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6ecf9f16-62af-47dc-ac0c-ae414c5fc0a4 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:30.991543 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-21d51459-ea59-4486-841d-33b1267a0984 tempest-NetworksTest-1858975067 tempest-NetworksTest-1858975067-project-admin] 10.222.0.61 "GET /compute/v2.1/os-networks" status: 200 len: 6761 microversion: 2.1 time: 0.516714 Aug 31 15:58:30.992133 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 400/802] 10.222.0.61 () {58 vars in 1137 bytes} [Wed Aug 31 15:58:30 2022] GET /compute/v2.1/os-networks => generated 6761 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:30.997553 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-98700324-e706-4768-bcce-c466e1b3696e tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:30.998165 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-98700324-e706-4768-bcce-c466e1b3696e tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] [instance: f977bd90-3cd4-4b07-87f9-42e26b8a530a] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:31.004303 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-98700324-e706-4768-bcce-c466e1b3696e tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:31.004789 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-98700324-e706-4768-bcce-c466e1b3696e tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:31.005229 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-98700324-e706-4768-bcce-c466e1b3696e tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:31.005934 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-98700324-e706-4768-bcce-c466e1b3696e tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:31.006390 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-98700324-e706-4768-bcce-c466e1b3696e tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:31.006817 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-98700324-e706-4768-bcce-c466e1b3696e tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:31.020485 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-98700324-e706-4768-bcce-c466e1b3696e tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] HTTP exception thrown: Instance f977bd90-3cd4-4b07-87f9-42e26b8a530a could not be found. Aug 31 15:58:31.022155 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-98700324-e706-4768-bcce-c466e1b3696e tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Request method failure captured: Aug 31 15:58:31.022155 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/f977bd90-3cd4-4b07-87f9-42e26b8a530a HTTP/1.1 Aug 31 15:58:31.022155 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 15:58:31.022155 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 15:58:31.022155 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 15:58:31.022155 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 15:58:31.022155 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 15:58:31.022155 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 15:58:31.022155 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 15:58:31.022155 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 15:58:31.022155 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4T-_iD9rGMgrQfV7dHpLrM09M87Nvi3L0s6dODE5GOpEuUZkumtHGCdpOW6KrSYeik6FsXOVMpM6Pa9ogwoY5r1GbNnTUz7UHFrx1jqYw5kkkM5o7ThMmSJ-MmreLw3qfHUx9cSHf7m5tH6H2_ggnoVjouhWHOhsOfDAfmdF1nF3WI Aug 31 15:58:31.022155 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 15:58:31.022155 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 15:58:31.022155 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 15:58:31.022155 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 15:58:31.022155 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 15:58:31.022155 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 15:58:31.022155 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 8ad48220bc634a6186547269011ec49b Aug 31 15:58:31.022155 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-TenantUsagesTestJSON-1192385910 Aug 31 15:58:31.022155 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 15:58:31.022155 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 15:58:31.023763 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8ad48220bc634a6186547269011ec49b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/8ad48220bc634a6186547269011ec49b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_8ad48220bc634a6186547269011ec49b", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8ad48220bc634a6186547269011ec49b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 15:58:31.023763 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-TenantUsagesTestJSON-1192385910 Aug 31 15:58:31.023763 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 8ad48220bc634a6186547269011ec49b Aug 31 15:58:31.023763 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-TenantUsagesTestJSON-1192385910 Aug 31 15:58:31.023763 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-TenantUsagesTestJSON-1192385910-project Aug 31 15:58:31.023763 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 15:58:31.023763 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 15:58:31.023763 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: cba336e5ac684606b5e0123e454f9a60 Aug 31 15:58:31.023763 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-TenantUsagesTestJSON-1192385910-project Aug 31 15:58:31.023763 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 15:58:31.023763 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance f977bd90-3cd4-4b07-87f9-42e26b8a530a could not be found. Aug 31 15:58:31.023763 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': 'f977bd90-3cd4-4b07-87f9-42e26b8a530a'} Aug 31 15:58:31.025482 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:58:31.025482 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:58:31.025482 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 15:58:31.025482 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 15:58:31.025482 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 15:58:31.025482 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 15:58:31.025482 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 15:58:31.025482 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 15:58:31.025482 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 15:58:31.025482 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 15:58:31.025482 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f977bd90-3cd4-4b07-87f9-42e26b8a530a could not be found. Aug 31 15:58:31.025482 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:58:31.025482 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:58:31.025482 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:58:31.025482 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:58:31.025482 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:58:31.025482 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:58:31.025482 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:58:31.025482 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:58:31.025482 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:58:31.027002 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:58:31.027002 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 15:58:31.027002 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 15:58:31.027002 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 15:58:31.027002 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 15:58:31.027002 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 15:58:31.027002 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:58:31.027002 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f977bd90-3cd4-4b07-87f9-42e26b8a530a could not be found. Aug 31 15:58:31.027002 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:58:31.027002 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:58:31.027002 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:58:31.027002 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:58:31.027002 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:58:31.027002 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:58:31.027002 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:58:31.027002 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:58:31.027002 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f977bd90-3cd4-4b07-87f9-42e26b8a530a could not be found. Aug 31 15:58:31.027002 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:58:31.028466 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-98700324-e706-4768-bcce-c466e1b3696e tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] Returning 404 to user: Instance f977bd90-3cd4-4b07-87f9-42e26b8a530a could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:58:31.028466 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-98700324-e706-4768-bcce-c466e1b3696e tempest-TenantUsagesTestJSON-1192385910 tempest-TenantUsagesTestJSON-1192385910-project] 10.222.0.61 "GET /compute/v2.1/servers/f977bd90-3cd4-4b07-87f9-42e26b8a530a" status: 404 len: 111 microversion: 2.1 time: 0.030557 Aug 31 15:58:31.028466 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 401/803] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:30 2022] GET /compute/v2.1/servers/f977bd90-3cd4-4b07-87f9-42e26b8a530a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:58:31.030114 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-01a513ba-eaf1-4216-8d0b-5c96f4482093 req-6be61a9b-0fb9-45c0-9da4-8df302ba92f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ddb0b07-9e31-403c-91d5-a278d632d754", "name": "network-vif-unplugged", "status": "completed", "tag": "e7598456-3858-4c71-8638-c50e65f3fc7a"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:58:31.046230 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-01a513ba-eaf1-4216-8d0b-5c96f4482093 req-6be61a9b-0fb9-45c0-9da4-8df302ba92f4 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:31.046722 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-01a513ba-eaf1-4216-8d0b-5c96f4482093 req-6be61a9b-0fb9-45c0-9da4-8df302ba92f4 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:31.047191 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-01a513ba-eaf1-4216-8d0b-5c96f4482093 req-6be61a9b-0fb9-45c0-9da4-8df302ba92f4 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:31.059755 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-01a513ba-eaf1-4216-8d0b-5c96f4482093 req-6be61a9b-0fb9-45c0-9da4-8df302ba92f4 service nova] Creating event network-vif-unplugged:e7598456-3858-4c71-8638-c50e65f3fc7a for instance 2ddb0b07-9e31-403c-91d5-a278d632d754 on n-h1-850499-9 Aug 31 15:58:31.064963 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-01a513ba-eaf1-4216-8d0b-5c96f4482093 req-6be61a9b-0fb9-45c0-9da4-8df302ba92f4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038358 Aug 31 15:58:31.065482 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 402/804] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 15:58:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:58:31.070964 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e2e7b5a3-d00a-4d49-b2ae-0b8793f2eb75 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-2000945708", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "e45fa8b9-1545-4bd5-aa5f-402c71ec19c6"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:58:31.138134 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-6ecf9f16-62af-47dc-ac0c-ae414c5fc0a4 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:31.150859 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-6ecf9f16-62af-47dc-ac0c-ae414c5fc0a4 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:31.151018 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-e2e7b5a3-d00a-4d49-b2ae-0b8793f2eb75 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] validate_networks() for None {{(pid=122256) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 15:58:31.153188 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-6ecf9f16-62af-47dc-ac0c-ae414c5fc0a4 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:31.154816 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6ecf9f16-62af-47dc-ac0c-ae414c5fc0a4 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/8555b294-db38-4246-ac58-035cb2acc70e" status: 200 len: 1361 microversion: 2.25 time: 0.320931 Aug 31 15:58:31.156157 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 403/805] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:58:30 2022] GET /compute/v2.1/servers/8555b294-db38-4246-ac58-035cb2acc70e => generated 1361 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:31.166287 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d9d1b6e3-aff7-40d1-b411-85cb6769e6dc tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:31.167198 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d9d1b6e3-aff7-40d1-b411-85cb6769e6dc tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: 2ddb0b07-9e31-403c-91d5-a278d632d754] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:31.173660 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d9d1b6e3-aff7-40d1-b411-85cb6769e6dc tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:31.174254 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d9d1b6e3-aff7-40d1-b411-85cb6769e6dc tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:31.175371 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d9d1b6e3-aff7-40d1-b411-85cb6769e6dc tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:31.176857 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d9d1b6e3-aff7-40d1-b411-85cb6769e6dc tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:31.177397 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d9d1b6e3-aff7-40d1-b411-85cb6769e6dc tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:31.177906 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d9d1b6e3-aff7-40d1-b411-85cb6769e6dc tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:31.846699 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d9d1b6e3-aff7-40d1-b411-85cb6769e6dc tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:31.857142 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d9d1b6e3-aff7-40d1-b411-85cb6769e6dc tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/2ddb0b07-9e31-403c-91d5-a278d632d754" status: 200 len: 1503 microversion: 2.1 time: 0.699657 Aug 31 15:58:31.858710 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 404/806] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:31 2022] GET /compute/v2.1/servers/2ddb0b07-9e31-403c-91d5-a278d632d754 => generated 1503 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:31.876857 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-89f7cb3f-3a6e-45cf-bd22-3d68f7b4e1e1 tempest-NetworksTest-1858975067 tempest-NetworksTest-1858975067-project-admin] Calling method '.version_select at 0x7f5ae94e0160>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:32.045939 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-e2e7b5a3-d00a-4d49-b2ae-0b8793f2eb75 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 15:58:32.047030 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-e2e7b5a3-d00a-4d49-b2ae-0b8793f2eb75 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 15:58:32.047534 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-e2e7b5a3-d00a-4d49-b2ae-0b8793f2eb75 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 15:58:32.047965 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-e2e7b5a3-d00a-4d49-b2ae-0b8793f2eb75 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 15:58:32.048698 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-e2e7b5a3-d00a-4d49-b2ae-0b8793f2eb75 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 15:58:32.060929 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e2e7b5a3-d00a-4d49-b2ae-0b8793f2eb75 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:32.061415 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e2e7b5a3-d00a-4d49-b2ae-0b8793f2eb75 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:32.062068 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e2e7b5a3-d00a-4d49-b2ae-0b8793f2eb75 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:32.062813 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e2e7b5a3-d00a-4d49-b2ae-0b8793f2eb75 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:32.063472 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e2e7b5a3-d00a-4d49-b2ae-0b8793f2eb75 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:32.063923 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e2e7b5a3-d00a-4d49-b2ae-0b8793f2eb75 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:32.084955 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-e2e7b5a3-d00a-4d49-b2ae-0b8793f2eb75 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Getting quotas for project 1ea45d1b678342ed812f9912e9f07503. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:58:32.093675 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-e2e7b5a3-d00a-4d49-b2ae-0b8793f2eb75 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Getting quotas for user 9a03cc5956ca477abacbe0c26bf18750 and project 1ea45d1b678342ed812f9912e9f07503. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:58:32.113538 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e2e7b5a3-d00a-4d49-b2ae-0b8793f2eb75 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Going to run 1 instances... {{(pid=122256) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 15:58:32.116067 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e2e7b5a3-d00a-4d49-b2ae-0b8793f2eb75 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] [instance: 6c5b2996-bce3-4a39-88c7-2e300d06473e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 15:58:32.137774 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-89f7cb3f-3a6e-45cf-bd22-3d68f7b4e1e1 tempest-NetworksTest-1858975067 tempest-NetworksTest-1858975067-project-admin] 10.222.0.61 "GET /compute/v2.1/os-networks/edca2db6-2c46-4009-a3d6-11849a8e2dfd" status: 200 len: 652 microversion: 2.1 time: 0.268602 Aug 31 15:58:32.138559 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 405/807] 10.222.0.61 () {58 vars in 1248 bytes} [Wed Aug 31 15:58:31 2022] GET /compute/v2.1/os-networks/edca2db6-2c46-4009-a3d6-11849a8e2dfd => generated 652 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:58:32.145856 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f6353294-ce64-4685-a2a5-1ad277131ee3 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:32.146485 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f6353294-ce64-4685-a2a5-1ad277131ee3 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:32.154405 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f6353294-ce64-4685-a2a5-1ad277131ee3 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:32.155402 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f6353294-ce64-4685-a2a5-1ad277131ee3 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:32.156340 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f6353294-ce64-4685-a2a5-1ad277131ee3 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:32.157426 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f6353294-ce64-4685-a2a5-1ad277131ee3 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:32.158123 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f6353294-ce64-4685-a2a5-1ad277131ee3 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:32.158767 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f6353294-ce64-4685-a2a5-1ad277131ee3 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:32.209444 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e2e7b5a3-d00a-4d49-b2ae-0b8793f2eb75 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.137562 Aug 31 15:58:32.213159 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 403/808] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 15:58:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1147 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 15:58:32.224753 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0622d943-b328-4cc1-ae57-20bb00a6c6da tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:32.226797 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0622d943-b328-4cc1-ae57-20bb00a6c6da tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] [instance: d5e69723-2d0e-46ef-8f76-82d64aad4772] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:32.240178 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0622d943-b328-4cc1-ae57-20bb00a6c6da tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:32.241562 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0622d943-b328-4cc1-ae57-20bb00a6c6da tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:32.244356 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0622d943-b328-4cc1-ae57-20bb00a6c6da tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:32.245696 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0622d943-b328-4cc1-ae57-20bb00a6c6da tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:32.246190 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0622d943-b328-4cc1-ae57-20bb00a6c6da tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:32.246640 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0622d943-b328-4cc1-ae57-20bb00a6c6da tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:32.300735 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f6353294-ce64-4685-a2a5-1ad277131ee3 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:32.319907 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f6353294-ce64-4685-a2a5-1ad277131ee3 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:32.322941 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f6353294-ce64-4685-a2a5-1ad277131ee3 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:32.330362 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f6353294-ce64-4685-a2a5-1ad277131ee3 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1539 microversion: 2.91 time: 0.190742 Aug 31 15:58:32.344163 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 406/809] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:58:32 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1539 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:32.387126 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-bc875fa1-cd97-492d-b1c0-7a8f6b612e1d req-0caa2eaf-9810-4cbd-a7cc-20b2a39f3033 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5e69723-2d0e-46ef-8f76-82d64aad4772", "name": "network-vif-plugged", "status": "completed", "tag": "9c09b5b7-41ed-490a-80a2-32e8b4ce1304"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:58:32.416187 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-bc875fa1-cd97-492d-b1c0-7a8f6b612e1d req-0caa2eaf-9810-4cbd-a7cc-20b2a39f3033 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:32.416723 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-bc875fa1-cd97-492d-b1c0-7a8f6b612e1d req-0caa2eaf-9810-4cbd-a7cc-20b2a39f3033 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:32.417202 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-bc875fa1-cd97-492d-b1c0-7a8f6b612e1d req-0caa2eaf-9810-4cbd-a7cc-20b2a39f3033 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:32.431817 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-bc875fa1-cd97-492d-b1c0-7a8f6b612e1d req-0caa2eaf-9810-4cbd-a7cc-20b2a39f3033 service nova] Creating event network-vif-plugged:9c09b5b7-41ed-490a-80a2-32e8b4ce1304 for instance d5e69723-2d0e-46ef-8f76-82d64aad4772 on n-h1-850499-9 Aug 31 15:58:32.437018 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-bc875fa1-cd97-492d-b1c0-7a8f6b612e1d req-0caa2eaf-9810-4cbd-a7cc-20b2a39f3033 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091387 Aug 31 15:58:32.438405 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 407/810] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 15:58:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:58:32.446614 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-54b3a2bc-9e45-4c31-8bbd-e684ad9c6100 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:32.448419 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-54b3a2bc-9e45-4c31-8bbd-e684ad9c6100 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] [instance: aa95066b-b1b8-43d8-8c5a-024e3890aa27] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:32.459144 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-54b3a2bc-9e45-4c31-8bbd-e684ad9c6100 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:32.461465 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-54b3a2bc-9e45-4c31-8bbd-e684ad9c6100 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:32.462677 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-54b3a2bc-9e45-4c31-8bbd-e684ad9c6100 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:32.463767 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-54b3a2bc-9e45-4c31-8bbd-e684ad9c6100 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:32.465349 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-54b3a2bc-9e45-4c31-8bbd-e684ad9c6100 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:32.465798 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-54b3a2bc-9e45-4c31-8bbd-e684ad9c6100 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:32.740328 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-0622d943-b328-4cc1-ae57-20bb00a6c6da tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377b1dedae45d2a804919e5ea69a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e5507d53224d19804717493d60bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:32.756596 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0622d943-b328-4cc1-ae57-20bb00a6c6da tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] 10.222.0.61 "GET /compute/v2.1/servers/d5e69723-2d0e-46ef-8f76-82d64aad4772" status: 200 len: 1391 microversion: 2.1 time: 0.535924 Aug 31 15:58:32.757190 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 404/811] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:32 2022] GET /compute/v2.1/servers/d5e69723-2d0e-46ef-8f76-82d64aad4772 => generated 1391 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:32.761762 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-28312098-e8de-4de6-ab87-cfc2398d3ea9 tempest-NetworksTest-1858975067 tempest-NetworksTest-1858975067-project-admin] Calling method '.version_select at 0x7f5ae92e8280>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:32.923252 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-54b3a2bc-9e45-4c31-8bbd-e684ad9c6100 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccce16c7fda401ea68fb31ea8099d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed252ebf7c741bbb36b553ac1767579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:32.941095 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-54b3a2bc-9e45-4c31-8bbd-e684ad9c6100 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "GET /compute/v2.1/servers/aa95066b-b1b8-43d8-8c5a-024e3890aa27" status: 200 len: 1324 microversion: 2.1 time: 0.500265 Aug 31 15:58:32.954572 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 408/812] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:32 2022] GET /compute/v2.1/servers/aa95066b-b1b8-43d8-8c5a-024e3890aa27 => generated 1324 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:32.960829 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-10511fa8-9ac7-40c1-aa6b-90b6bb0f46d6 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:32.963119 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-10511fa8-9ac7-40c1-aa6b-90b6bb0f46d6 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 8555b294-db38-4246-ac58-035cb2acc70e] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:32.970057 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-10511fa8-9ac7-40c1-aa6b-90b6bb0f46d6 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:32.970906 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-10511fa8-9ac7-40c1-aa6b-90b6bb0f46d6 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:32.971756 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-10511fa8-9ac7-40c1-aa6b-90b6bb0f46d6 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:32.972565 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-10511fa8-9ac7-40c1-aa6b-90b6bb0f46d6 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:32.973121 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-10511fa8-9ac7-40c1-aa6b-90b6bb0f46d6 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:32.973613 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-10511fa8-9ac7-40c1-aa6b-90b6bb0f46d6 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:33.064732 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-28312098-e8de-4de6-ab87-cfc2398d3ea9 tempest-NetworksTest-1858975067 tempest-NetworksTest-1858975067-project-admin] 10.222.0.61 "GET /compute/v2.1/os-networks" status: 200 len: 6761 microversion: 2.1 time: 0.306489 Aug 31 15:58:33.066024 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 405/813] 10.222.0.61 () {58 vars in 1137 bytes} [Wed Aug 31 15:58:32 2022] GET /compute/v2.1/os-networks => generated 6761 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:33.075640 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9f5610ce-da1a-4d2c-950e-2fe2274c8ad4 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:33.076592 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9f5610ce-da1a-4d2c-950e-2fe2274c8ad4 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] [instance: 6c5b2996-bce3-4a39-88c7-2e300d06473e] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:33.090779 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9f5610ce-da1a-4d2c-950e-2fe2274c8ad4 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:33.092355 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9f5610ce-da1a-4d2c-950e-2fe2274c8ad4 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:33.093041 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9f5610ce-da1a-4d2c-950e-2fe2274c8ad4 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:33.094349 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9f5610ce-da1a-4d2c-950e-2fe2274c8ad4 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:33.094979 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9f5610ce-da1a-4d2c-950e-2fe2274c8ad4 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:33.095938 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9f5610ce-da1a-4d2c-950e-2fe2274c8ad4 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:33.153967 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-10511fa8-9ac7-40c1-aa6b-90b6bb0f46d6 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:33.163051 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-10511fa8-9ac7-40c1-aa6b-90b6bb0f46d6 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:33.166030 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-10511fa8-9ac7-40c1-aa6b-90b6bb0f46d6 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:33.167462 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-10511fa8-9ac7-40c1-aa6b-90b6bb0f46d6 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/8555b294-db38-4246-ac58-035cb2acc70e" status: 200 len: 1557 microversion: 2.25 time: 0.211600 Aug 31 15:58:33.169373 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 409/814] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:58:32 2022] GET /compute/v2.1/servers/8555b294-db38-4246-ac58-035cb2acc70e => generated 1557 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:33.174573 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-fabdaebf-2c60-4eb0-90b9-204a5be22cbe tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:33.175425 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-fabdaebf-2c60-4eb0-90b9-204a5be22cbe tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: 2ddb0b07-9e31-403c-91d5-a278d632d754] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:33.183445 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fabdaebf-2c60-4eb0-90b9-204a5be22cbe tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:33.185265 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fabdaebf-2c60-4eb0-90b9-204a5be22cbe tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:33.186014 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fabdaebf-2c60-4eb0-90b9-204a5be22cbe tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:33.187012 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fabdaebf-2c60-4eb0-90b9-204a5be22cbe tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:33.187745 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fabdaebf-2c60-4eb0-90b9-204a5be22cbe tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:33.188507 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fabdaebf-2c60-4eb0-90b9-204a5be22cbe tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:33.195763 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-9f5610ce-da1a-4d2c-950e-2fe2274c8ad4 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a03cc5956ca477abacbe0c26bf18750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea45d1b678342ed812f9912e9f07503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:33.205917 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9f5610ce-da1a-4d2c-950e-2fe2274c8ad4 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] 10.222.0.61 "GET /compute/v2.1/servers/6c5b2996-bce3-4a39-88c7-2e300d06473e" status: 200 len: 1266 microversion: 2.1 time: 0.134617 Aug 31 15:58:33.208216 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 406/815] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:33 2022] GET /compute/v2.1/servers/6c5b2996-bce3-4a39-88c7-2e300d06473e => generated 1266 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:33.217009 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-9a34d510-f227-4c9b-916b-02df4a096932 req-b7b9ac23-5cb6-4be3-a44b-6c3c35753814 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ddb0b07-9e31-403c-91d5-a278d632d754", "tag": "e7598456-3858-4c71-8638-c50e65f3fc7a"}, {"name": "network-changed", "server_uuid": "aa95066b-b1b8-43d8-8c5a-024e3890aa27", "tag": "382402ff-e21a-4c70-b0ca-69cef0f74488"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:58:33.232486 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-9a34d510-f227-4c9b-916b-02df4a096932 req-b7b9ac23-5cb6-4be3-a44b-6c3c35753814 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:33.233332 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-9a34d510-f227-4c9b-916b-02df4a096932 req-b7b9ac23-5cb6-4be3-a44b-6c3c35753814 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:33.234007 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-9a34d510-f227-4c9b-916b-02df4a096932 req-b7b9ac23-5cb6-4be3-a44b-6c3c35753814 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:33.253236 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-9a34d510-f227-4c9b-916b-02df4a096932 req-b7b9ac23-5cb6-4be3-a44b-6c3c35753814 service nova] Creating event network-changed:e7598456-3858-4c71-8638-c50e65f3fc7a for instance 2ddb0b07-9e31-403c-91d5-a278d632d754 on n-h1-850499-9 Aug 31 15:58:33.253997 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-9a34d510-f227-4c9b-916b-02df4a096932 req-b7b9ac23-5cb6-4be3-a44b-6c3c35753814 service nova] Creating event network-changed:382402ff-e21a-4c70-b0ca-69cef0f74488 for instance aa95066b-b1b8-43d8-8c5a-024e3890aa27 on n-h1-850499-9 Aug 31 15:58:33.266955 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-9a34d510-f227-4c9b-916b-02df4a096932 req-b7b9ac23-5cb6-4be3-a44b-6c3c35753814 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.055479 Aug 31 15:58:33.267781 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 407/816] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 15:58:33 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:58:33.279780 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e741702c-5af3-41b2-9dbd-266f8ff89038 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:33.280544 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e741702c-5af3-41b2-9dbd-266f8ff89038 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] [instance: 8555b294-db38-4246-ac58-035cb2acc70e] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:33.288412 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e741702c-5af3-41b2-9dbd-266f8ff89038 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:33.289262 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e741702c-5af3-41b2-9dbd-266f8ff89038 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:33.290773 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e741702c-5af3-41b2-9dbd-266f8ff89038 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:33.291707 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e741702c-5af3-41b2-9dbd-266f8ff89038 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:33.292447 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e741702c-5af3-41b2-9dbd-266f8ff89038 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:33.293234 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e741702c-5af3-41b2-9dbd-266f8ff89038 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:33.416583 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-fabdaebf-2c60-4eb0-90b9-204a5be22cbe tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:33.431240 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-fabdaebf-2c60-4eb0-90b9-204a5be22cbe tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/2ddb0b07-9e31-403c-91d5-a278d632d754" status: 200 len: 1503 microversion: 2.1 time: 0.259092 Aug 31 15:58:33.432287 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 410/817] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:33 2022] GET /compute/v2.1/servers/2ddb0b07-9e31-403c-91d5-a278d632d754 => generated 1503 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:33.441709 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d9aee91c-a6f2-49d7-a683-0e22e68cbc7c tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:33.444508 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d9aee91c-a6f2-49d7-a683-0e22e68cbc7c tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:33.463446 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d9aee91c-a6f2-49d7-a683-0e22e68cbc7c tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:33.463997 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d9aee91c-a6f2-49d7-a683-0e22e68cbc7c tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:33.464437 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d9aee91c-a6f2-49d7-a683-0e22e68cbc7c tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:33.465149 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d9aee91c-a6f2-49d7-a683-0e22e68cbc7c tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:33.465608 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d9aee91c-a6f2-49d7-a683-0e22e68cbc7c tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:33.466068 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d9aee91c-a6f2-49d7-a683-0e22e68cbc7c tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:33.499981 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-e741702c-5af3-41b2-9dbd-266f8ff89038 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lazy-loading 'services' on Instance uuid 8555b294-db38-4246-ac58-035cb2acc70e {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:58:33.516727 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e741702c-5af3-41b2-9dbd-266f8ff89038 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/8555b294-db38-4246-ac58-035cb2acc70e" status: 200 len: 2049 microversion: 2.25 time: 0.243847 Aug 31 15:58:33.517471 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 408/818] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:58:33 2022] GET /compute/v2.1/servers/8555b294-db38-4246-ac58-035cb2acc70e => generated 2049 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:33.541829 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d6dff365-e8ea-487b-8535-96edc28ba40e tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:33.542453 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d6dff365-e8ea-487b-8535-96edc28ba40e tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] [instance: 8555b294-db38-4246-ac58-035cb2acc70e] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:33.549695 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d6dff365-e8ea-487b-8535-96edc28ba40e tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:33.550531 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d6dff365-e8ea-487b-8535-96edc28ba40e tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:33.551185 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d6dff365-e8ea-487b-8535-96edc28ba40e tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:33.552514 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d6dff365-e8ea-487b-8535-96edc28ba40e tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:33.553378 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d6dff365-e8ea-487b-8535-96edc28ba40e tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:33.553812 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d6dff365-e8ea-487b-8535-96edc28ba40e tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:33.554922 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d9aee91c-a6f2-49d7-a683-0e22e68cbc7c tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:33.563654 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d9aee91c-a6f2-49d7-a683-0e22e68cbc7c tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:33.565120 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d9aee91c-a6f2-49d7-a683-0e22e68cbc7c tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:33.570306 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d9aee91c-a6f2-49d7-a683-0e22e68cbc7c tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1539 microversion: 2.91 time: 0.136212 Aug 31 15:58:33.570878 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 411/819] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:58:33 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1539 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:33.717592 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-d6dff365-e8ea-487b-8535-96edc28ba40e tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lazy-loading 'services' on Instance uuid 8555b294-db38-4246-ac58-035cb2acc70e {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:58:33.730694 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d6dff365-e8ea-487b-8535-96edc28ba40e tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/8555b294-db38-4246-ac58-035cb2acc70e" status: 200 len: 2049 microversion: 2.25 time: 0.194523 Aug 31 15:58:33.731740 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 409/820] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:58:33 2022] GET /compute/v2.1/servers/8555b294-db38-4246-ac58-035cb2acc70e => generated 2049 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 15:58:33.753942 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6d1e2566-2def-4a2b-8e6b-d773b20a40eb tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:33.757752 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6d1e2566-2def-4a2b-8e6b-d773b20a40eb tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:33.758271 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6d1e2566-2def-4a2b-8e6b-d773b20a40eb tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:33.759783 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6d1e2566-2def-4a2b-8e6b-d773b20a40eb tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:33.760910 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6d1e2566-2def-4a2b-8e6b-d773b20a40eb tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:33.761384 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6d1e2566-2def-4a2b-8e6b-d773b20a40eb tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:33.761819 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6d1e2566-2def-4a2b-8e6b-d773b20a40eb tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:33.767609 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=17 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:58:33.784052 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-59873c2e-fadb-4d78-9a41-ed221de25656 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:33.785738 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-59873c2e-fadb-4d78-9a41-ed221de25656 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] [instance: d5e69723-2d0e-46ef-8f76-82d64aad4772] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:33.793874 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6d1e2566-2def-4a2b-8e6b-d773b20a40eb tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] 10.222.0.61 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.043637 Aug 31 15:58:33.796407 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-59873c2e-fadb-4d78-9a41-ed221de25656 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:33.797463 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-59873c2e-fadb-4d78-9a41-ed221de25656 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:33.798339 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-59873c2e-fadb-4d78-9a41-ed221de25656 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:33.800036 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-59873c2e-fadb-4d78-9a41-ed221de25656 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:33.801566 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-59873c2e-fadb-4d78-9a41-ed221de25656 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:33.802561 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 412/821] 10.222.0.61 () {60 vars in 1217 bytes} [Wed Aug 31 15:58:33 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 15:58:33.803052 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-59873c2e-fadb-4d78-9a41-ed221de25656 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:33.809288 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-20cef1ea-8dc3-4fb9-a2cc-5e90693a6022 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:58:33.810090 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-20cef1ea-8dc3-4fb9-a2cc-5e90693a6022 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] [instance: 8555b294-db38-4246-ac58-035cb2acc70e] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:33.816631 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-20cef1ea-8dc3-4fb9-a2cc-5e90693a6022 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:33.817130 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-20cef1ea-8dc3-4fb9-a2cc-5e90693a6022 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:33.817575 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-20cef1ea-8dc3-4fb9-a2cc-5e90693a6022 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:33.818283 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-20cef1ea-8dc3-4fb9-a2cc-5e90693a6022 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:33.818928 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-20cef1ea-8dc3-4fb9-a2cc-5e90693a6022 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:33.819489 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-20cef1ea-8dc3-4fb9-a2cc-5e90693a6022 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:33.825419 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=100 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:58:33.911584 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:58:33.924738 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-20cef1ea-8dc3-4fb9-a2cc-5e90693a6022 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/8555b294-db38-4246-ac58-035cb2acc70e/action" status: 202 len: 0 microversion: 2.25 time: 0.120040 Aug 31 15:58:33.929618 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 413/822] 10.222.0.61 () {62 vars in 1319 bytes} [Wed Aug 31 15:58:33 2022] POST /compute/v2.1/servers/8555b294-db38-4246-ac58-035cb2acc70e/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 15:58:33.944614 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d118a799-af01-4ebc-a9c4-6602d86ed753 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:33.946184 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d118a799-af01-4ebc-a9c4-6602d86ed753 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] [instance: 8555b294-db38-4246-ac58-035cb2acc70e] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:33.958878 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d118a799-af01-4ebc-a9c4-6602d86ed753 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:33.960707 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d118a799-af01-4ebc-a9c4-6602d86ed753 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:33.962499 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d118a799-af01-4ebc-a9c4-6602d86ed753 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:33.964294 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d118a799-af01-4ebc-a9c4-6602d86ed753 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:33.966006 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d118a799-af01-4ebc-a9c4-6602d86ed753 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:33.966786 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d118a799-af01-4ebc-a9c4-6602d86ed753 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:34.136974 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-59873c2e-fadb-4d78-9a41-ed221de25656 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377b1dedae45d2a804919e5ea69a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e5507d53224d19804717493d60bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:34.146603 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-59873c2e-fadb-4d78-9a41-ed221de25656 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] 10.222.0.61 "GET /compute/v2.1/servers/d5e69723-2d0e-46ef-8f76-82d64aad4772" status: 200 len: 1391 microversion: 2.1 time: 0.369753 Aug 31 15:58:34.147409 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 410/823] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:33 2022] GET /compute/v2.1/servers/d5e69723-2d0e-46ef-8f76-82d64aad4772 => generated 1391 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:34.165456 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6788d98b-0563-4383-9357-266e08f4576a tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:34.166425 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6788d98b-0563-4383-9357-266e08f4576a tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] [instance: aa95066b-b1b8-43d8-8c5a-024e3890aa27] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:34.173220 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6788d98b-0563-4383-9357-266e08f4576a tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:34.173782 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6788d98b-0563-4383-9357-266e08f4576a tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:34.174365 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6788d98b-0563-4383-9357-266e08f4576a tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:34.175093 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6788d98b-0563-4383-9357-266e08f4576a tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:34.175641 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6788d98b-0563-4383-9357-266e08f4576a tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:34.176283 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6788d98b-0563-4383-9357-266e08f4576a tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:34.201742 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-d118a799-af01-4ebc-a9c4-6602d86ed753 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lazy-loading 'services' on Instance uuid 8555b294-db38-4246-ac58-035cb2acc70e {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:58:34.221985 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d118a799-af01-4ebc-a9c4-6602d86ed753 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/8555b294-db38-4246-ac58-035cb2acc70e" status: 200 len: 2054 microversion: 2.25 time: 0.290960 Aug 31 15:58:34.222573 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 414/824] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:58:33 2022] GET /compute/v2.1/servers/8555b294-db38-4246-ac58-035cb2acc70e => generated 2054 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:34.242722 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3d5e6a03-00d2-494d-8906-01168aea6d55 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:34.244404 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3d5e6a03-00d2-494d-8906-01168aea6d55 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] [instance: 6c5b2996-bce3-4a39-88c7-2e300d06473e] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:34.253420 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3d5e6a03-00d2-494d-8906-01168aea6d55 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:34.254481 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3d5e6a03-00d2-494d-8906-01168aea6d55 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:34.254925 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3d5e6a03-00d2-494d-8906-01168aea6d55 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:34.255918 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3d5e6a03-00d2-494d-8906-01168aea6d55 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:34.256387 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3d5e6a03-00d2-494d-8906-01168aea6d55 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:34.256868 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3d5e6a03-00d2-494d-8906-01168aea6d55 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:34.366999 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3d5e6a03-00d2-494d-8906-01168aea6d55 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a03cc5956ca477abacbe0c26bf18750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea45d1b678342ed812f9912e9f07503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:34.376050 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3d5e6a03-00d2-494d-8906-01168aea6d55 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] 10.222.0.61 "GET /compute/v2.1/servers/6c5b2996-bce3-4a39-88c7-2e300d06473e" status: 200 len: 1272 microversion: 2.1 time: 0.150571 Aug 31 15:58:34.376630 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 415/825] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:34 2022] GET /compute/v2.1/servers/6c5b2996-bce3-4a39-88c7-2e300d06473e => generated 1272 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:58:34.457793 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-804b3878-53b3-4d08-b7f1-4e437c72c22b tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:34.458647 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-804b3878-53b3-4d08-b7f1-4e437c72c22b tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: 2ddb0b07-9e31-403c-91d5-a278d632d754] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:34.467377 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-804b3878-53b3-4d08-b7f1-4e437c72c22b tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:34.468184 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-804b3878-53b3-4d08-b7f1-4e437c72c22b tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:34.468966 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-804b3878-53b3-4d08-b7f1-4e437c72c22b tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:34.470011 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-804b3878-53b3-4d08-b7f1-4e437c72c22b tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:34.470842 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-804b3878-53b3-4d08-b7f1-4e437c72c22b tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:34.471508 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-804b3878-53b3-4d08-b7f1-4e437c72c22b tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:34.474390 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-6788d98b-0563-4383-9357-266e08f4576a tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccce16c7fda401ea68fb31ea8099d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed252ebf7c741bbb36b553ac1767579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:34.498782 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6788d98b-0563-4383-9357-266e08f4576a tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "GET /compute/v2.1/servers/aa95066b-b1b8-43d8-8c5a-024e3890aa27" status: 200 len: 1324 microversion: 2.1 time: 0.337399 Aug 31 15:58:34.507612 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 411/826] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:34 2022] GET /compute/v2.1/servers/aa95066b-b1b8-43d8-8c5a-024e3890aa27 => generated 1324 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:34.597289 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e990f7ae-bda6-4a37-a2b4-58463b1121b8 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:34.598028 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e990f7ae-bda6-4a37-a2b4-58463b1121b8 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:34.605084 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e990f7ae-bda6-4a37-a2b4-58463b1121b8 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:34.605981 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e990f7ae-bda6-4a37-a2b4-58463b1121b8 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:34.606540 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e990f7ae-bda6-4a37-a2b4-58463b1121b8 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:34.607524 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e990f7ae-bda6-4a37-a2b4-58463b1121b8 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:34.608052 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e990f7ae-bda6-4a37-a2b4-58463b1121b8 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:34.608598 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e990f7ae-bda6-4a37-a2b4-58463b1121b8 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:34.748198 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e990f7ae-bda6-4a37-a2b4-58463b1121b8 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:34.760918 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e990f7ae-bda6-4a37-a2b4-58463b1121b8 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:34.762858 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e990f7ae-bda6-4a37-a2b4-58463b1121b8 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:34.769905 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e990f7ae-bda6-4a37-a2b4-58463b1121b8 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1539 microversion: 2.91 time: 0.176636 Aug 31 15:58:34.771815 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 412/827] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:58:34 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1539 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:34.825606 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-804b3878-53b3-4d08-b7f1-4e437c72c22b tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:34.833386 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-804b3878-53b3-4d08-b7f1-4e437c72c22b tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/2ddb0b07-9e31-403c-91d5-a278d632d754" status: 200 len: 1503 microversion: 2.1 time: 0.380987 Aug 31 15:58:34.834163 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 416/828] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:34 2022] GET /compute/v2.1/servers/2ddb0b07-9e31-403c-91d5-a278d632d754 => generated 1503 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:58:35.172391 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-138ea82e-5698-4049-9593-8e1b16e34f49 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:35.173723 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-138ea82e-5698-4049-9593-8e1b16e34f49 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] [instance: d5e69723-2d0e-46ef-8f76-82d64aad4772] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:35.188575 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-138ea82e-5698-4049-9593-8e1b16e34f49 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:35.189163 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-138ea82e-5698-4049-9593-8e1b16e34f49 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:35.189514 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-138ea82e-5698-4049-9593-8e1b16e34f49 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:35.190230 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-138ea82e-5698-4049-9593-8e1b16e34f49 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:35.190876 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-138ea82e-5698-4049-9593-8e1b16e34f49 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:35.192181 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-138ea82e-5698-4049-9593-8e1b16e34f49 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:35.246559 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6a087ca8-ec34-40b1-874c-ae96f9edcb88 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:35.247210 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6a087ca8-ec34-40b1-874c-ae96f9edcb88 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] [instance: 8555b294-db38-4246-ac58-035cb2acc70e] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:35.262139 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6a087ca8-ec34-40b1-874c-ae96f9edcb88 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:35.262674 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6a087ca8-ec34-40b1-874c-ae96f9edcb88 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:35.263114 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6a087ca8-ec34-40b1-874c-ae96f9edcb88 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:35.263858 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6a087ca8-ec34-40b1-874c-ae96f9edcb88 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:35.264324 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6a087ca8-ec34-40b1-874c-ae96f9edcb88 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:35.264799 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6a087ca8-ec34-40b1-874c-ae96f9edcb88 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:35.565531 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-138ea82e-5698-4049-9593-8e1b16e34f49 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377b1dedae45d2a804919e5ea69a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e5507d53224d19804717493d60bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:35.580803 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-138ea82e-5698-4049-9593-8e1b16e34f49 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] 10.222.0.61 "GET /compute/v2.1/servers/d5e69723-2d0e-46ef-8f76-82d64aad4772" status: 200 len: 1391 microversion: 2.1 time: 0.412264 Aug 31 15:58:35.583904 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 413/829] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:35 2022] GET /compute/v2.1/servers/d5e69723-2d0e-46ef-8f76-82d64aad4772 => generated 1391 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:35.591353 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f0bacb8c-c3c0-48da-b5ce-866b8ac3af8d tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:35.597120 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f0bacb8c-c3c0-48da-b5ce-866b8ac3af8d tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] [instance: 6c5b2996-bce3-4a39-88c7-2e300d06473e] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:35.611816 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f0bacb8c-c3c0-48da-b5ce-866b8ac3af8d tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:35.612384 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f0bacb8c-c3c0-48da-b5ce-866b8ac3af8d tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:35.612844 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f0bacb8c-c3c0-48da-b5ce-866b8ac3af8d tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:35.617612 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f0bacb8c-c3c0-48da-b5ce-866b8ac3af8d tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:35.618966 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f0bacb8c-c3c0-48da-b5ce-866b8ac3af8d tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:35.619794 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f0bacb8c-c3c0-48da-b5ce-866b8ac3af8d tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:35.675024 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-6a087ca8-ec34-40b1-874c-ae96f9edcb88 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lazy-loading 'services' on Instance uuid 8555b294-db38-4246-ac58-035cb2acc70e {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:58:35.719696 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6a087ca8-ec34-40b1-874c-ae96f9edcb88 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/8555b294-db38-4246-ac58-035cb2acc70e" status: 200 len: 2034 microversion: 2.25 time: 0.473544 Aug 31 15:58:35.721249 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 417/830] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:58:35 2022] GET /compute/v2.1/servers/8555b294-db38-4246-ac58-035cb2acc70e => generated 2034 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 15:58:35.760537 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a8115b5c-4c3a-4407-80a6-0be31efec48c tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:35.761472 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a8115b5c-4c3a-4407-80a6-0be31efec48c tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] [instance: aa95066b-b1b8-43d8-8c5a-024e3890aa27] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:35.779233 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a8115b5c-4c3a-4407-80a6-0be31efec48c tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:35.783606 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a8115b5c-4c3a-4407-80a6-0be31efec48c tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:35.784067 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a8115b5c-4c3a-4407-80a6-0be31efec48c tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:35.784828 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a8115b5c-4c3a-4407-80a6-0be31efec48c tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:35.785296 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a8115b5c-4c3a-4407-80a6-0be31efec48c tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:35.790301 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a8115b5c-4c3a-4407-80a6-0be31efec48c tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:36.000608 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f0bacb8c-c3c0-48da-b5ce-866b8ac3af8d tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a03cc5956ca477abacbe0c26bf18750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea45d1b678342ed812f9912e9f07503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:36.014706 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f0bacb8c-c3c0-48da-b5ce-866b8ac3af8d tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] 10.222.0.61 "GET /compute/v2.1/servers/6c5b2996-bce3-4a39-88c7-2e300d06473e" status: 200 len: 1314 microversion: 2.1 time: 0.429475 Aug 31 15:58:36.020390 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 414/831] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:35 2022] GET /compute/v2.1/servers/6c5b2996-bce3-4a39-88c7-2e300d06473e => generated 1314 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:36.032077 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b6202385-275a-4b55-938c-aa200d50b83e tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-850499-9", "block_migration": "auto"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:58:36.036553 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b6202385-275a-4b55-938c-aa200d50b83e tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] [instance: 8555b294-db38-4246-ac58-035cb2acc70e] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:36.056906 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b6202385-275a-4b55-938c-aa200d50b83e tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:36.059124 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b6202385-275a-4b55-938c-aa200d50b83e tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:36.061211 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b6202385-275a-4b55-938c-aa200d50b83e tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:36.067408 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b6202385-275a-4b55-938c-aa200d50b83e tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:36.068016 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b6202385-275a-4b55-938c-aa200d50b83e tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:36.073959 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b6202385-275a-4b55-938c-aa200d50b83e tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:36.122573 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-b6202385-275a-4b55-938c-aa200d50b83e tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lazy-loading 'flavor' on Instance uuid 8555b294-db38-4246-ac58-035cb2acc70e {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:58:36.140993 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a8115b5c-4c3a-4407-80a6-0be31efec48c tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccce16c7fda401ea68fb31ea8099d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed252ebf7c741bbb36b553ac1767579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:36.146164 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b6202385-275a-4b55-938c-aa200d50b83e tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] [instance: 8555b294-db38-4246-ac58-035cb2acc70e] Going to try to live migrate instance to n-h1-850499-9 {{(pid=122256) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 31 15:58:36.151489 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a8115b5c-4c3a-4407-80a6-0be31efec48c tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "GET /compute/v2.1/servers/aa95066b-b1b8-43d8-8c5a-024e3890aa27" status: 200 len: 1324 microversion: 2.1 time: 0.428384 Aug 31 15:58:36.152107 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 418/832] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:35 2022] GET /compute/v2.1/servers/aa95066b-b1b8-43d8-8c5a-024e3890aa27 => generated 1324 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:36.174846 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d88de037-fd16-407a-859e-dd77ff6aedd8 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:36.175630 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d88de037-fd16-407a-859e-dd77ff6aedd8 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:36.182784 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d88de037-fd16-407a-859e-dd77ff6aedd8 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:36.183369 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d88de037-fd16-407a-859e-dd77ff6aedd8 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:36.184338 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d88de037-fd16-407a-859e-dd77ff6aedd8 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:36.185135 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d88de037-fd16-407a-859e-dd77ff6aedd8 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:36.186379 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d88de037-fd16-407a-859e-dd77ff6aedd8 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:36.186379 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d88de037-fd16-407a-859e-dd77ff6aedd8 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:36.193969 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:58:36.438666 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d88de037-fd16-407a-859e-dd77ff6aedd8 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:36.472012 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d88de037-fd16-407a-859e-dd77ff6aedd8 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:36.478565 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d88de037-fd16-407a-859e-dd77ff6aedd8 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:36.506213 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d88de037-fd16-407a-859e-dd77ff6aedd8 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1539 microversion: 2.91 time: 0.337119 Aug 31 15:58:36.520927 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 419/833] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:58:36 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1539 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:36.560290 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-eed0bdc9-aa77-4956-a7b1-128607f2061e tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:36.576556 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-eed0bdc9-aa77-4956-a7b1-128607f2061e tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: 2ddb0b07-9e31-403c-91d5-a278d632d754] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:36.595569 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eed0bdc9-aa77-4956-a7b1-128607f2061e tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:36.596303 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eed0bdc9-aa77-4956-a7b1-128607f2061e tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:36.612118 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eed0bdc9-aa77-4956-a7b1-128607f2061e tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:36.613904 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eed0bdc9-aa77-4956-a7b1-128607f2061e tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:36.615905 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eed0bdc9-aa77-4956-a7b1-128607f2061e tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:36.616813 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eed0bdc9-aa77-4956-a7b1-128607f2061e tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:37.500193 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-eed0bdc9-aa77-4956-a7b1-128607f2061e tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:37.513525 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-eed0bdc9-aa77-4956-a7b1-128607f2061e tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/2ddb0b07-9e31-403c-91d5-a278d632d754" status: 200 len: 1503 microversion: 2.1 time: 0.972241 Aug 31 15:58:37.515567 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 420/834] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:36 2022] GET /compute/v2.1/servers/2ddb0b07-9e31-403c-91d5-a278d632d754 => generated 1503 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:37.521895 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-45ee5465-b062-4004-83c8-3f58ea8dbd72 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:37.522815 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-45ee5465-b062-4004-83c8-3f58ea8dbd72 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] [instance: d5e69723-2d0e-46ef-8f76-82d64aad4772] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:37.532901 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-45ee5465-b062-4004-83c8-3f58ea8dbd72 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:37.533603 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-45ee5465-b062-4004-83c8-3f58ea8dbd72 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:37.534206 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-45ee5465-b062-4004-83c8-3f58ea8dbd72 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:37.537754 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-45ee5465-b062-4004-83c8-3f58ea8dbd72 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:37.538444 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-45ee5465-b062-4004-83c8-3f58ea8dbd72 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:37.539121 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-45ee5465-b062-4004-83c8-3f58ea8dbd72 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:38.294412 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-45ee5465-b062-4004-83c8-3f58ea8dbd72 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377b1dedae45d2a804919e5ea69a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e5507d53224d19804717493d60bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:38.307277 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-45ee5465-b062-4004-83c8-3f58ea8dbd72 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] 10.222.0.61 "GET /compute/v2.1/servers/d5e69723-2d0e-46ef-8f76-82d64aad4772" status: 200 len: 1590 microversion: 2.1 time: 0.790153 Aug 31 15:58:38.307907 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 421/835] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:37 2022] GET /compute/v2.1/servers/d5e69723-2d0e-46ef-8f76-82d64aad4772 => generated 1590 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:38.329459 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-25ddc1d9-30b8-4bb9-b83d-0a62e337a4e4 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:38.330254 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-25ddc1d9-30b8-4bb9-b83d-0a62e337a4e4 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] [instance: 6c5b2996-bce3-4a39-88c7-2e300d06473e] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:38.336717 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-25ddc1d9-30b8-4bb9-b83d-0a62e337a4e4 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:38.337763 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-25ddc1d9-30b8-4bb9-b83d-0a62e337a4e4 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:38.338365 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-25ddc1d9-30b8-4bb9-b83d-0a62e337a4e4 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:38.339257 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-25ddc1d9-30b8-4bb9-b83d-0a62e337a4e4 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:38.339899 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-25ddc1d9-30b8-4bb9-b83d-0a62e337a4e4 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:38.340481 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-25ddc1d9-30b8-4bb9-b83d-0a62e337a4e4 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:38.947983 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-25ddc1d9-30b8-4bb9-b83d-0a62e337a4e4 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a03cc5956ca477abacbe0c26bf18750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea45d1b678342ed812f9912e9f07503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:38.976386 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-25ddc1d9-30b8-4bb9-b83d-0a62e337a4e4 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] 10.222.0.61 "GET /compute/v2.1/servers/6c5b2996-bce3-4a39-88c7-2e300d06473e" status: 200 len: 1314 microversion: 2.1 time: 0.654921 Aug 31 15:58:38.979557 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 422/836] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:38 2022] GET /compute/v2.1/servers/6c5b2996-bce3-4a39-88c7-2e300d06473e => generated 1314 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:39.021795 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e5ee7020-4501-4043-a326-8bafd0119a96 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:39.022456 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e5ee7020-4501-4043-a326-8bafd0119a96 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] [instance: aa95066b-b1b8-43d8-8c5a-024e3890aa27] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:39.032693 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e5ee7020-4501-4043-a326-8bafd0119a96 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:39.033479 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e5ee7020-4501-4043-a326-8bafd0119a96 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:39.034116 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e5ee7020-4501-4043-a326-8bafd0119a96 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:39.035038 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e5ee7020-4501-4043-a326-8bafd0119a96 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:39.043070 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e5ee7020-4501-4043-a326-8bafd0119a96 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:39.044868 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e5ee7020-4501-4043-a326-8bafd0119a96 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:39.136002 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b6202385-275a-4b55-938c-aa200d50b83e tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/8555b294-db38-4246-ac58-035cb2acc70e/action" status: 202 len: 0 microversion: 2.25 time: 3.113509 Aug 31 15:58:39.136612 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 415/837] 10.222.0.61 () {62 vars in 1319 bytes} [Wed Aug 31 15:58:36 2022] POST /compute/v2.1/servers/8555b294-db38-4246-ac58-035cb2acc70e/action => generated 0 bytes in 3115 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 15:58:39.147465 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f6297254-b114-4d07-a0ae-8ef09d6bbe11 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:39.148638 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f6297254-b114-4d07-a0ae-8ef09d6bbe11 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:39.167948 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f6297254-b114-4d07-a0ae-8ef09d6bbe11 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:39.168846 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f6297254-b114-4d07-a0ae-8ef09d6bbe11 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:39.169551 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f6297254-b114-4d07-a0ae-8ef09d6bbe11 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:39.170518 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f6297254-b114-4d07-a0ae-8ef09d6bbe11 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:39.171657 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f6297254-b114-4d07-a0ae-8ef09d6bbe11 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:39.172661 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f6297254-b114-4d07-a0ae-8ef09d6bbe11 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:39.418999 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f6297254-b114-4d07-a0ae-8ef09d6bbe11 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:39.435830 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f6297254-b114-4d07-a0ae-8ef09d6bbe11 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:39.442421 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f6297254-b114-4d07-a0ae-8ef09d6bbe11 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:39.450637 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f6297254-b114-4d07-a0ae-8ef09d6bbe11 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1539 microversion: 2.91 time: 0.312682 Aug 31 15:58:39.451558 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 416/838] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:58:39 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1539 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:39.766379 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1b00a721-d6e4-446d-a6df-af55acf299cf tempest-QuotasAdminTestV236-1234682956 tempest-QuotasAdminTestV236-1234682956-project-admin] Action: 'update', calling method: .version_select at 0x7f5ae93d9c10>, body: {"quota_set": {"ram": "5120"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:58:39.897527 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1b00a721-d6e4-446d-a6df-af55acf299cf tempest-QuotasAdminTestV236-1234682956 tempest-QuotasAdminTestV236-1234682956-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:39.898338 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1b00a721-d6e4-446d-a6df-af55acf299cf tempest-QuotasAdminTestV236-1234682956 tempest-QuotasAdminTestV236-1234682956-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:39.899357 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1b00a721-d6e4-446d-a6df-af55acf299cf tempest-QuotasAdminTestV236-1234682956 tempest-QuotasAdminTestV236-1234682956-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:39.900542 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1b00a721-d6e4-446d-a6df-af55acf299cf tempest-QuotasAdminTestV236-1234682956 tempest-QuotasAdminTestV236-1234682956-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:39.906705 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1b00a721-d6e4-446d-a6df-af55acf299cf tempest-QuotasAdminTestV236-1234682956 tempest-QuotasAdminTestV236-1234682956-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:39.907789 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1b00a721-d6e4-446d-a6df-af55acf299cf tempest-QuotasAdminTestV236-1234682956 tempest-QuotasAdminTestV236-1234682956-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:40.025992 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1b00a721-d6e4-446d-a6df-af55acf299cf tempest-QuotasAdminTestV236-1234682956 tempest-QuotasAdminTestV236-1234682956-project-admin] 10.222.0.61 "PUT /compute/v2.1/os-quota-sets/19b3a7b345b04f2a8a4773fc71ee29ff" status: 200 len: 240 microversion: 2.36 time: 0.554268 Aug 31 15:58:40.027130 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 417/839] 10.222.0.61 () {62 vars in 1303 bytes} [Wed Aug 31 15:58:39 2022] PUT /compute/v2.1/os-quota-sets/19b3a7b345b04f2a8a4773fc71ee29ff => generated 240 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 15:58:40.033024 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d9882bcd-0fb0-4049-acaf-fab7bc8712d7 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:40.033539 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d9882bcd-0fb0-4049-acaf-fab7bc8712d7 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] [instance: d5e69723-2d0e-46ef-8f76-82d64aad4772] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:40.042193 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d9882bcd-0fb0-4049-acaf-fab7bc8712d7 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:40.042731 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d9882bcd-0fb0-4049-acaf-fab7bc8712d7 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:40.043148 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d9882bcd-0fb0-4049-acaf-fab7bc8712d7 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:40.043906 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d9882bcd-0fb0-4049-acaf-fab7bc8712d7 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:40.044364 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d9882bcd-0fb0-4049-acaf-fab7bc8712d7 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:40.044861 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d9882bcd-0fb0-4049-acaf-fab7bc8712d7 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:40.273356 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e5ee7020-4501-4043-a326-8bafd0119a96 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccce16c7fda401ea68fb31ea8099d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed252ebf7c741bbb36b553ac1767579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:40.291297 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e5ee7020-4501-4043-a326-8bafd0119a96 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "GET /compute/v2.1/servers/aa95066b-b1b8-43d8-8c5a-024e3890aa27" status: 200 len: 1324 microversion: 2.1 time: 1.310045 Aug 31 15:58:40.291918 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 423/840] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:38 2022] GET /compute/v2.1/servers/aa95066b-b1b8-43d8-8c5a-024e3890aa27 => generated 1324 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:40.308203 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7915d003-8b3a-4107-aa91-4101ddc3a273 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:40.311907 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7915d003-8b3a-4107-aa91-4101ddc3a273 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: 2ddb0b07-9e31-403c-91d5-a278d632d754] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:40.318223 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7915d003-8b3a-4107-aa91-4101ddc3a273 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:40.318727 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7915d003-8b3a-4107-aa91-4101ddc3a273 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:40.319170 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7915d003-8b3a-4107-aa91-4101ddc3a273 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:40.320216 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7915d003-8b3a-4107-aa91-4101ddc3a273 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:40.320708 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7915d003-8b3a-4107-aa91-4101ddc3a273 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:40.321155 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7915d003-8b3a-4107-aa91-4101ddc3a273 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:40.450892 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d9882bcd-0fb0-4049-acaf-fab7bc8712d7 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] 10.222.0.61 "GET /compute/v2.1/servers/d5e69723-2d0e-46ef-8f76-82d64aad4772/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.422547 Aug 31 15:58:40.452785 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 418/841] 10.222.0.61 () {58 vars in 1275 bytes} [Wed Aug 31 15:58:40 2022] GET /compute/v2.1/servers/d5e69723-2d0e-46ef-8f76-82d64aad4772/os-interface => generated 284 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:58:40.462726 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-4aaaddd7-d50c-4335-bbe7-cbdde623b5ac req-b8ec2321-58a5-4b5d-a365-e10c5e57f580 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c5b2996-bce3-4a39-88c7-2e300d06473e", "tag": "6a2a769e-d172-4084-aaf0-690c1eac47e7"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:58:40.479559 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-4aaaddd7-d50c-4335-bbe7-cbdde623b5ac req-b8ec2321-58a5-4b5d-a365-e10c5e57f580 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:40.480498 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-4aaaddd7-d50c-4335-bbe7-cbdde623b5ac req-b8ec2321-58a5-4b5d-a365-e10c5e57f580 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:40.481813 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-4aaaddd7-d50c-4335-bbe7-cbdde623b5ac req-b8ec2321-58a5-4b5d-a365-e10c5e57f580 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:40.502312 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-4aaaddd7-d50c-4335-bbe7-cbdde623b5ac req-b8ec2321-58a5-4b5d-a365-e10c5e57f580 service nova] Creating event network-changed:6a2a769e-d172-4084-aaf0-690c1eac47e7 for instance 6c5b2996-bce3-4a39-88c7-2e300d06473e on n-h2-850499-9 Aug 31 15:58:40.510978 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-4aaaddd7-d50c-4335-bbe7-cbdde623b5ac req-b8ec2321-58a5-4b5d-a365-e10c5e57f580 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056268 Aug 31 15:58:40.512905 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 419/842] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 15:58:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:58:40.520212 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e4abaf57-7f9e-4abc-822b-b98b39d6925d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:40.521420 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e4abaf57-7f9e-4abc-822b-b98b39d6925d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 8555b294-db38-4246-ac58-035cb2acc70e] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:40.543888 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e4abaf57-7f9e-4abc-822b-b98b39d6925d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:40.544638 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e4abaf57-7f9e-4abc-822b-b98b39d6925d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:40.545182 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e4abaf57-7f9e-4abc-822b-b98b39d6925d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:40.546020 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e4abaf57-7f9e-4abc-822b-b98b39d6925d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:40.546810 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e4abaf57-7f9e-4abc-822b-b98b39d6925d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:40.547347 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e4abaf57-7f9e-4abc-822b-b98b39d6925d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:41.136679 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7915d003-8b3a-4107-aa91-4101ddc3a273 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:41.148268 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7915d003-8b3a-4107-aa91-4101ddc3a273 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/2ddb0b07-9e31-403c-91d5-a278d632d754" status: 200 len: 1503 microversion: 2.1 time: 0.851426 Aug 31 15:58:41.162803 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 424/843] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:40 2022] GET /compute/v2.1/servers/2ddb0b07-9e31-403c-91d5-a278d632d754 => generated 1503 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:41.169541 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-8b8dc5c4-0e04-42ce-b854-5efdc05119e6 req-99e569f8-7696-4c0f-9bcc-d1530ad1fa4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa95066b-b1b8-43d8-8c5a-024e3890aa27", "name": "network-vif-plugged", "status": "completed", "tag": "382402ff-e21a-4c70-b0ca-69cef0f74488"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:58:41.184348 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-8b8dc5c4-0e04-42ce-b854-5efdc05119e6 req-99e569f8-7696-4c0f-9bcc-d1530ad1fa4f service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:41.185188 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-8b8dc5c4-0e04-42ce-b854-5efdc05119e6 req-99e569f8-7696-4c0f-9bcc-d1530ad1fa4f service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:41.185836 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-8b8dc5c4-0e04-42ce-b854-5efdc05119e6 req-99e569f8-7696-4c0f-9bcc-d1530ad1fa4f service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:41.200177 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-8b8dc5c4-0e04-42ce-b854-5efdc05119e6 req-99e569f8-7696-4c0f-9bcc-d1530ad1fa4f service nova] Creating event network-vif-plugged:382402ff-e21a-4c70-b0ca-69cef0f74488 for instance aa95066b-b1b8-43d8-8c5a-024e3890aa27 on n-h1-850499-9 Aug 31 15:58:41.205440 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-8b8dc5c4-0e04-42ce-b854-5efdc05119e6 req-99e569f8-7696-4c0f-9bcc-d1530ad1fa4f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041007 Aug 31 15:58:41.206281 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 425/844] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 15:58:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:58:41.215133 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-bd1052da-abc1-4793-acc5-79eaa2906b28 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:41.216209 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-bd1052da-abc1-4793-acc5-79eaa2906b28 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] [instance: 6c5b2996-bce3-4a39-88c7-2e300d06473e] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:41.222586 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bd1052da-abc1-4793-acc5-79eaa2906b28 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:41.223264 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bd1052da-abc1-4793-acc5-79eaa2906b28 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:41.223894 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bd1052da-abc1-4793-acc5-79eaa2906b28 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:41.225414 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bd1052da-abc1-4793-acc5-79eaa2906b28 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:41.226051 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bd1052da-abc1-4793-acc5-79eaa2906b28 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:41.226638 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bd1052da-abc1-4793-acc5-79eaa2906b28 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:41.238781 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e4abaf57-7f9e-4abc-822b-b98b39d6925d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:41.248114 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e4abaf57-7f9e-4abc-822b-b98b39d6925d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:41.249792 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e4abaf57-7f9e-4abc-822b-b98b39d6925d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:41.251150 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e4abaf57-7f9e-4abc-822b-b98b39d6925d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/8555b294-db38-4246-ac58-035cb2acc70e" status: 200 len: 1567 microversion: 2.25 time: 0.736946 Aug 31 15:58:41.252081 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 420/845] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:58:40 2022] GET /compute/v2.1/servers/8555b294-db38-4246-ac58-035cb2acc70e => generated 1567 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:41.264460 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-38e0a693-e89a-42b1-b364-4543f04796db tempest-QuotasAdminTestV236-1234682956 tempest-QuotasAdminTestV236-1234682956-project-admin] Calling method '.version_select at 0x7f5ae93935e0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:41.369044 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-38e0a693-e89a-42b1-b364-4543f04796db tempest-QuotasAdminTestV236-1234682956 tempest-QuotasAdminTestV236-1234682956-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:41.369776 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-38e0a693-e89a-42b1-b364-4543f04796db tempest-QuotasAdminTestV236-1234682956 tempest-QuotasAdminTestV236-1234682956-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:41.370530 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-38e0a693-e89a-42b1-b364-4543f04796db tempest-QuotasAdminTestV236-1234682956 tempest-QuotasAdminTestV236-1234682956-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:41.371414 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-38e0a693-e89a-42b1-b364-4543f04796db tempest-QuotasAdminTestV236-1234682956 tempest-QuotasAdminTestV236-1234682956-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:41.372078 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-38e0a693-e89a-42b1-b364-4543f04796db tempest-QuotasAdminTestV236-1234682956 tempest-QuotasAdminTestV236-1234682956-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:41.372658 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-38e0a693-e89a-42b1-b364-4543f04796db tempest-QuotasAdminTestV236-1234682956 tempest-QuotasAdminTestV236-1234682956-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:41.394457 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-38e0a693-e89a-42b1-b364-4543f04796db tempest-QuotasAdminTestV236-1234682956 tempest-QuotasAdminTestV236-1234682956-project-admin] 10.222.0.61 "GET /compute/v2.1/os-quota-sets/19b3a7b345b04f2a8a4773fc71ee29ff/detail" status: 200 len: 672 microversion: 2.36 time: 0.134612 Aug 31 15:58:41.395687 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 421/846] 10.222.0.61 () {60 vars in 1304 bytes} [Wed Aug 31 15:58:41 2022] GET /compute/v2.1/os-quota-sets/19b3a7b345b04f2a8a4773fc71ee29ff/detail => generated 672 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 15:58:41.400501 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b15637fd-26e5-4914-ab4f-2126987cfd75 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:41.401326 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b15637fd-26e5-4914-ab4f-2126987cfd75 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:41.407575 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b15637fd-26e5-4914-ab4f-2126987cfd75 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:41.408077 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b15637fd-26e5-4914-ab4f-2126987cfd75 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:41.408516 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b15637fd-26e5-4914-ab4f-2126987cfd75 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:41.409220 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b15637fd-26e5-4914-ab4f-2126987cfd75 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:41.409674 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b15637fd-26e5-4914-ab4f-2126987cfd75 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:41.410103 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b15637fd-26e5-4914-ab4f-2126987cfd75 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:41.637100 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b15637fd-26e5-4914-ab4f-2126987cfd75 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:41.648578 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b15637fd-26e5-4914-ab4f-2126987cfd75 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:41.651174 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b15637fd-26e5-4914-ab4f-2126987cfd75 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:41.658424 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b15637fd-26e5-4914-ab4f-2126987cfd75 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1539 microversion: 2.91 time: 0.261376 Aug 31 15:58:41.668860 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 422/847] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:58:41 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1539 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:41.719059 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-bd1052da-abc1-4793-acc5-79eaa2906b28 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a03cc5956ca477abacbe0c26bf18750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea45d1b678342ed812f9912e9f07503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:41.730173 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-bd1052da-abc1-4793-acc5-79eaa2906b28 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] 10.222.0.61 "GET /compute/v2.1/servers/6c5b2996-bce3-4a39-88c7-2e300d06473e" status: 200 len: 1314 microversion: 2.1 time: 0.519462 Aug 31 15:58:41.734758 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 426/848] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:41 2022] GET /compute/v2.1/servers/6c5b2996-bce3-4a39-88c7-2e300d06473e => generated 1314 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:41.747590 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f9dc1772-ac82-4029-a5ec-03b45b3eb155 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:41.748574 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f9dc1772-ac82-4029-a5ec-03b45b3eb155 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] [instance: aa95066b-b1b8-43d8-8c5a-024e3890aa27] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:41.755655 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f9dc1772-ac82-4029-a5ec-03b45b3eb155 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:41.756151 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f9dc1772-ac82-4029-a5ec-03b45b3eb155 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:41.756590 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f9dc1772-ac82-4029-a5ec-03b45b3eb155 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:41.757397 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f9dc1772-ac82-4029-a5ec-03b45b3eb155 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:41.757860 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f9dc1772-ac82-4029-a5ec-03b45b3eb155 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:41.758323 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f9dc1772-ac82-4029-a5ec-03b45b3eb155 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:41.759275 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-40339994-5329-49b1-a5ec-3083da26f912 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-1555227581", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "networks": [{"uuid": "05c79ad7-21d0-4e49-a22e-297e68a6eb17"}]}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:58:41.853645 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-40339994-5329-49b1-a5ec-3083da26f912 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] validate_networks() for [('05c79ad7-21d0-4e49-a22e-297e68a6eb17', None, None, None, None, None)] {{(pid=122256) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 15:58:42.124218 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f9dc1772-ac82-4029-a5ec-03b45b3eb155 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccce16c7fda401ea68fb31ea8099d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed252ebf7c741bbb36b553ac1767579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:42.138107 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f9dc1772-ac82-4029-a5ec-03b45b3eb155 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "GET /compute/v2.1/servers/aa95066b-b1b8-43d8-8c5a-024e3890aa27" status: 200 len: 1324 microversion: 2.1 time: 0.402037 Aug 31 15:58:42.139088 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 427/849] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:41 2022] GET /compute/v2.1/servers/aa95066b-b1b8-43d8-8c5a-024e3890aa27 => generated 1324 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:42.144724 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-dcd04a68-2165-4afe-80a1-f6466c393425 tempest-QuotasAdminTestV236-1234682956 tempest-QuotasAdminTestV236-1234682956-project-admin] Action: 'update', calling method: .version_select at 0x7f5ae9470f70>, body: {"quota_set": {"ram": "2048"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:58:42.232003 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=100 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:58:42.242911 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dcd04a68-2165-4afe-80a1-f6466c393425 tempest-QuotasAdminTestV236-1234682956 tempest-QuotasAdminTestV236-1234682956-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:42.244185 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dcd04a68-2165-4afe-80a1-f6466c393425 tempest-QuotasAdminTestV236-1234682956 tempest-QuotasAdminTestV236-1234682956-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:42.244827 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dcd04a68-2165-4afe-80a1-f6466c393425 tempest-QuotasAdminTestV236-1234682956 tempest-QuotasAdminTestV236-1234682956-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:42.245737 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dcd04a68-2165-4afe-80a1-f6466c393425 tempest-QuotasAdminTestV236-1234682956 tempest-QuotasAdminTestV236-1234682956-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:42.246338 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dcd04a68-2165-4afe-80a1-f6466c393425 tempest-QuotasAdminTestV236-1234682956 tempest-QuotasAdminTestV236-1234682956-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:42.246912 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dcd04a68-2165-4afe-80a1-f6466c393425 tempest-QuotasAdminTestV236-1234682956 tempest-QuotasAdminTestV236-1234682956-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:42.291057 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dcd04a68-2165-4afe-80a1-f6466c393425 tempest-QuotasAdminTestV236-1234682956 tempest-QuotasAdminTestV236-1234682956-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:42.292390 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dcd04a68-2165-4afe-80a1-f6466c393425 tempest-QuotasAdminTestV236-1234682956 tempest-QuotasAdminTestV236-1234682956-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:42.292986 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dcd04a68-2165-4afe-80a1-f6466c393425 tempest-QuotasAdminTestV236-1234682956 tempest-QuotasAdminTestV236-1234682956-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:42.293880 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dcd04a68-2165-4afe-80a1-f6466c393425 tempest-QuotasAdminTestV236-1234682956 tempest-QuotasAdminTestV236-1234682956-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:42.295351 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dcd04a68-2165-4afe-80a1-f6466c393425 tempest-QuotasAdminTestV236-1234682956 tempest-QuotasAdminTestV236-1234682956-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:42.295990 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dcd04a68-2165-4afe-80a1-f6466c393425 tempest-QuotasAdminTestV236-1234682956 tempest-QuotasAdminTestV236-1234682956-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:42.313946 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:58:42.392792 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-dcd04a68-2165-4afe-80a1-f6466c393425 tempest-QuotasAdminTestV236-1234682956 tempest-QuotasAdminTestV236-1234682956-project-admin] 10.222.0.61 "PUT /compute/v2.1/os-quota-sets/19b3a7b345b04f2a8a4773fc71ee29ff?user_id=d6f0012777ed4908888ed7b712360f35" status: 200 len: 240 microversion: 2.36 time: 0.251398 Aug 31 15:58:42.394069 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 428/850] 10.222.0.61 () {62 vars in 1384 bytes} [Wed Aug 31 15:58:42 2022] PUT /compute/v2.1/os-quota-sets/19b3a7b345b04f2a8a4773fc71ee29ff?user_id=d6f0012777ed4908888ed7b712360f35 => generated 240 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 15:58:42.405122 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-63d8be4a-d6e4-4090-8b83-baaf6266a1b9 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:42.406011 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-63d8be4a-d6e4-4090-8b83-baaf6266a1b9 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] [instance: d5e69723-2d0e-46ef-8f76-82d64aad4772] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:42.418988 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-63d8be4a-d6e4-4090-8b83-baaf6266a1b9 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:42.419887 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-63d8be4a-d6e4-4090-8b83-baaf6266a1b9 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:42.420495 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-63d8be4a-d6e4-4090-8b83-baaf6266a1b9 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:42.421454 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-63d8be4a-d6e4-4090-8b83-baaf6266a1b9 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:42.422077 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-63d8be4a-d6e4-4090-8b83-baaf6266a1b9 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:42.422657 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-63d8be4a-d6e4-4090-8b83-baaf6266a1b9 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:42.880652 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-63d8be4a-d6e4-4090-8b83-baaf6266a1b9 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377b1dedae45d2a804919e5ea69a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e5507d53224d19804717493d60bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:42.889140 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-63d8be4a-d6e4-4090-8b83-baaf6266a1b9 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] 10.222.0.61 "GET /compute/v2.1/servers/d5e69723-2d0e-46ef-8f76-82d64aad4772" status: 200 len: 1590 microversion: 2.1 time: 0.493869 Aug 31 15:58:42.900190 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 429/851] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:42 2022] GET /compute/v2.1/servers/d5e69723-2d0e-46ef-8f76-82d64aad4772 => generated 1590 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:42.909988 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-74dcb2b4-8a21-49c4-a418-b2be68173b6b req-f36699ca-d394-479d-bfa3-617cc0c31819 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5e69723-2d0e-46ef-8f76-82d64aad4772", "tag": "9c09b5b7-41ed-490a-80a2-32e8b4ce1304"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:58:42.920520 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-74dcb2b4-8a21-49c4-a418-b2be68173b6b req-f36699ca-d394-479d-bfa3-617cc0c31819 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:42.921007 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-74dcb2b4-8a21-49c4-a418-b2be68173b6b req-f36699ca-d394-479d-bfa3-617cc0c31819 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:42.921435 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-74dcb2b4-8a21-49c4-a418-b2be68173b6b req-f36699ca-d394-479d-bfa3-617cc0c31819 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:42.934608 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-74dcb2b4-8a21-49c4-a418-b2be68173b6b req-f36699ca-d394-479d-bfa3-617cc0c31819 service nova] Creating event network-changed:9c09b5b7-41ed-490a-80a2-32e8b4ce1304 for instance d5e69723-2d0e-46ef-8f76-82d64aad4772 on n-h1-850499-9 Aug 31 15:58:42.939764 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-74dcb2b4-8a21-49c4-a418-b2be68173b6b req-f36699ca-d394-479d-bfa3-617cc0c31819 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033657 Aug 31 15:58:42.940474 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 430/852] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 15:58:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:58:42.941082 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-40339994-5329-49b1-a5ec-3083da26f912 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 15:58:42.942783 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-40339994-5329-49b1-a5ec-3083da26f912 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 15:58:42.944023 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-40339994-5329-49b1-a5ec-3083da26f912 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 15:58:42.945225 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-40339994-5329-49b1-a5ec-3083da26f912 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 15:58:42.946303 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-40339994-5329-49b1-a5ec-3083da26f912 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 15:58:42.949572 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c07e648d-68f8-4a45-b92c-07e155488446 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:42.950283 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c07e648d-68f8-4a45-b92c-07e155488446 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: 2ddb0b07-9e31-403c-91d5-a278d632d754] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:42.959119 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c07e648d-68f8-4a45-b92c-07e155488446 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:42.959119 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c07e648d-68f8-4a45-b92c-07e155488446 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:42.962494 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c07e648d-68f8-4a45-b92c-07e155488446 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:42.963230 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c07e648d-68f8-4a45-b92c-07e155488446 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:42.963726 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c07e648d-68f8-4a45-b92c-07e155488446 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:42.964160 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c07e648d-68f8-4a45-b92c-07e155488446 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:42.968051 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-40339994-5329-49b1-a5ec-3083da26f912 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:42.968630 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-40339994-5329-49b1-a5ec-3083da26f912 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:42.969145 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-40339994-5329-49b1-a5ec-3083da26f912 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:42.970125 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-40339994-5329-49b1-a5ec-3083da26f912 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:42.970770 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-40339994-5329-49b1-a5ec-3083da26f912 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:42.971369 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-40339994-5329-49b1-a5ec-3083da26f912 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:43.005812 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-40339994-5329-49b1-a5ec-3083da26f912 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Getting quotas for project 0d5746b9f74e4fecbf2da098436f2ce4. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:58:43.025129 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-40339994-5329-49b1-a5ec-3083da26f912 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Getting quotas for user 1a5652ccb7b54cf7a56f25b91c30c904 and project 0d5746b9f74e4fecbf2da098436f2ce4. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:58:43.049340 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-40339994-5329-49b1-a5ec-3083da26f912 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Going to run 1 instances... {{(pid=122256) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 15:58:43.052831 n-d-850499-9 devstack@n-api.service[122256]: WARNING nova.utils [None req-40339994-5329-49b1-a5ec-3083da26f912 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-1555227581 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-155522758 Aug 31 15:58:43.053848 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-40339994-5329-49b1-a5ec-3083da26f912 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] [instance: 5de5737d-bcc8-4357-85f0-f4468ac84bc7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 15:58:43.116385 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-40339994-5329-49b1-a5ec-3083da26f912 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.445623 Aug 31 15:58:43.118441 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 423/853] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 15:58:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1448 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 15:58:43.124920 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d81dc0bb-3a46-4077-8f20-9be58081f357 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:43.125893 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d81dc0bb-3a46-4077-8f20-9be58081f357 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 8555b294-db38-4246-ac58-035cb2acc70e] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:43.134443 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d81dc0bb-3a46-4077-8f20-9be58081f357 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:43.135098 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d81dc0bb-3a46-4077-8f20-9be58081f357 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:43.135668 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d81dc0bb-3a46-4077-8f20-9be58081f357 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:43.136639 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d81dc0bb-3a46-4077-8f20-9be58081f357 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:43.137312 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d81dc0bb-3a46-4077-8f20-9be58081f357 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:43.137957 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d81dc0bb-3a46-4077-8f20-9be58081f357 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:43.546035 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c07e648d-68f8-4a45-b92c-07e155488446 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:43.555724 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c07e648d-68f8-4a45-b92c-07e155488446 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/2ddb0b07-9e31-403c-91d5-a278d632d754" status: 200 len: 1503 microversion: 2.1 time: 0.610547 Aug 31 15:58:43.557208 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 431/854] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:42 2022] GET /compute/v2.1/servers/2ddb0b07-9e31-403c-91d5-a278d632d754 => generated 1503 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:43.562077 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7b812684-29b3-45d8-b565-9bb6a73a7ce7 tempest-QuotasAdminTestV236-1234682956 tempest-QuotasAdminTestV236-1234682956-project-admin] Calling method '.version_select at 0x7f5ae959ba60>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:43.652812 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d81dc0bb-3a46-4077-8f20-9be58081f357 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:43.665706 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d81dc0bb-3a46-4077-8f20-9be58081f357 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:43.667082 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d81dc0bb-3a46-4077-8f20-9be58081f357 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:43.672535 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d81dc0bb-3a46-4077-8f20-9be58081f357 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/8555b294-db38-4246-ac58-035cb2acc70e" status: 200 len: 1567 microversion: 2.25 time: 0.552919 Aug 31 15:58:43.674536 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 424/855] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:58:43 2022] GET /compute/v2.1/servers/8555b294-db38-4246-ac58-035cb2acc70e => generated 1567 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:43.689987 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c40ac3b0-8915-4737-9cba-e7f8be410804 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:43.690735 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c40ac3b0-8915-4737-9cba-e7f8be410804 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:43.693853 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:58:43.708684 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c40ac3b0-8915-4737-9cba-e7f8be410804 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:43.710935 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c40ac3b0-8915-4737-9cba-e7f8be410804 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:43.713534 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c40ac3b0-8915-4737-9cba-e7f8be410804 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:43.717577 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c40ac3b0-8915-4737-9cba-e7f8be410804 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:43.718647 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c40ac3b0-8915-4737-9cba-e7f8be410804 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:43.718647 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c40ac3b0-8915-4737-9cba-e7f8be410804 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:43.729112 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7b812684-29b3-45d8-b565-9bb6a73a7ce7 tempest-QuotasAdminTestV236-1234682956 tempest-QuotasAdminTestV236-1234682956-project-admin] 10.222.0.61 "GET /compute/v2.1/os-quota-sets/19b3a7b345b04f2a8a4773fc71ee29ff?user_id=d6f0012777ed4908888ed7b712360f35" status: 200 len: 282 microversion: 2.36 time: 0.170090 Aug 31 15:58:43.730357 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 432/856] 10.222.0.61 () {60 vars in 1364 bytes} [Wed Aug 31 15:58:43 2022] GET /compute/v2.1/os-quota-sets/19b3a7b345b04f2a8a4773fc71ee29ff?user_id=d6f0012777ed4908888ed7b712360f35 => generated 282 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 15:58:43.751081 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b18e1c74-f924-4e54-9276-7ca202d9729f tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:43.752027 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b18e1c74-f924-4e54-9276-7ca202d9729f tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] [instance: 6c5b2996-bce3-4a39-88c7-2e300d06473e] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:43.763373 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b18e1c74-f924-4e54-9276-7ca202d9729f tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:43.764388 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b18e1c74-f924-4e54-9276-7ca202d9729f tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:43.765461 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b18e1c74-f924-4e54-9276-7ca202d9729f tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:43.766389 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b18e1c74-f924-4e54-9276-7ca202d9729f tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:43.767099 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b18e1c74-f924-4e54-9276-7ca202d9729f tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:43.767780 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b18e1c74-f924-4e54-9276-7ca202d9729f tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:44.063218 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c40ac3b0-8915-4737-9cba-e7f8be410804 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:44.083537 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c40ac3b0-8915-4737-9cba-e7f8be410804 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:44.085728 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c40ac3b0-8915-4737-9cba-e7f8be410804 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:44.093156 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c40ac3b0-8915-4737-9cba-e7f8be410804 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1539 microversion: 2.91 time: 0.417550 Aug 31 15:58:44.094031 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 425/857] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:58:43 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1539 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:44.131529 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7044d962-3693-451d-9147-446f0a14b8e0 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:44.131916 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7044d962-3693-451d-9147-446f0a14b8e0 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] [instance: 5de5737d-bcc8-4357-85f0-f4468ac84bc7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:44.147026 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7044d962-3693-451d-9147-446f0a14b8e0 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:44.147552 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7044d962-3693-451d-9147-446f0a14b8e0 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:44.148006 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7044d962-3693-451d-9147-446f0a14b8e0 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:44.148806 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7044d962-3693-451d-9147-446f0a14b8e0 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:44.149268 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7044d962-3693-451d-9147-446f0a14b8e0 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:44.149855 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7044d962-3693-451d-9147-446f0a14b8e0 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:44.320123 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7044d962-3693-451d-9147-446f0a14b8e0 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a5652ccb7b54cf7a56f25b91c30c904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5746b9f74e4fecbf2da098436f2ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:44.331738 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7044d962-3693-451d-9147-446f0a14b8e0 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] 10.222.0.61 "GET /compute/v2.1/servers/5de5737d-bcc8-4357-85f0-f4468ac84bc7" status: 200 len: 1228 microversion: 2.1 time: 0.229661 Aug 31 15:58:44.332822 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 426/858] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:44 2022] GET /compute/v2.1/servers/5de5737d-bcc8-4357-85f0-f4468ac84bc7 => generated 1228 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:44.338759 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5e5378be-0d96-480f-89a2-1b45c6dcbce0 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:44.339373 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5e5378be-0d96-480f-89a2-1b45c6dcbce0 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] [instance: aa95066b-b1b8-43d8-8c5a-024e3890aa27] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:44.362596 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5e5378be-0d96-480f-89a2-1b45c6dcbce0 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:44.364319 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5e5378be-0d96-480f-89a2-1b45c6dcbce0 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:44.365008 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5e5378be-0d96-480f-89a2-1b45c6dcbce0 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:44.365859 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5e5378be-0d96-480f-89a2-1b45c6dcbce0 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:44.367208 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5e5378be-0d96-480f-89a2-1b45c6dcbce0 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:44.368673 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5e5378be-0d96-480f-89a2-1b45c6dcbce0 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:44.473076 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b18e1c74-f924-4e54-9276-7ca202d9729f tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a03cc5956ca477abacbe0c26bf18750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea45d1b678342ed812f9912e9f07503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:44.484819 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b18e1c74-f924-4e54-9276-7ca202d9729f tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] 10.222.0.61 "GET /compute/v2.1/servers/6c5b2996-bce3-4a39-88c7-2e300d06473e" status: 200 len: 1314 microversion: 2.1 time: 0.748670 Aug 31 15:58:44.485731 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 433/859] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:43 2022] GET /compute/v2.1/servers/6c5b2996-bce3-4a39-88c7-2e300d06473e => generated 1314 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:44.491161 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-a20d307d-8b6d-4a0a-bfb4-ed2eb4ed385c req-e598cbe7-eab2-4ad4-b7c2-b02c1780cba6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8555b294-db38-4246-ac58-035cb2acc70e", "name": "network-vif-unplugged", "status": "completed", "tag": "a4e66017-bbca-4435-8809-d986a9a6cbd2"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:58:44.510137 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-a20d307d-8b6d-4a0a-bfb4-ed2eb4ed385c req-e598cbe7-eab2-4ad4-b7c2-b02c1780cba6 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:44.510645 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-a20d307d-8b6d-4a0a-bfb4-ed2eb4ed385c req-e598cbe7-eab2-4ad4-b7c2-b02c1780cba6 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:44.511082 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-a20d307d-8b6d-4a0a-bfb4-ed2eb4ed385c req-e598cbe7-eab2-4ad4-b7c2-b02c1780cba6 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:44.527402 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-a20d307d-8b6d-4a0a-bfb4-ed2eb4ed385c req-e598cbe7-eab2-4ad4-b7c2-b02c1780cba6 service nova] Creating event network-vif-unplugged:a4e66017-bbca-4435-8809-d986a9a6cbd2 for instance 8555b294-db38-4246-ac58-035cb2acc70e on n-h2-850499-9 Aug 31 15:58:44.535037 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-a20d307d-8b6d-4a0a-bfb4-ed2eb4ed385c req-e598cbe7-eab2-4ad4-b7c2-b02c1780cba6 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047974 Aug 31 15:58:44.535999 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 434/860] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 15:58:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:58:44.581062 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7135e832-41fe-4f77-b395-dad0b9db4964 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:44.582744 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7135e832-41fe-4f77-b395-dad0b9db4964 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: 2ddb0b07-9e31-403c-91d5-a278d632d754] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:44.594434 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7135e832-41fe-4f77-b395-dad0b9db4964 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:44.595399 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7135e832-41fe-4f77-b395-dad0b9db4964 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:44.596095 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7135e832-41fe-4f77-b395-dad0b9db4964 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:44.597148 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7135e832-41fe-4f77-b395-dad0b9db4964 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:44.597927 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7135e832-41fe-4f77-b395-dad0b9db4964 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:44.598657 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7135e832-41fe-4f77-b395-dad0b9db4964 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:44.851684 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5e5378be-0d96-480f-89a2-1b45c6dcbce0 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccce16c7fda401ea68fb31ea8099d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed252ebf7c741bbb36b553ac1767579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:44.872984 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5e5378be-0d96-480f-89a2-1b45c6dcbce0 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "GET /compute/v2.1/servers/aa95066b-b1b8-43d8-8c5a-024e3890aa27" status: 200 len: 1520 microversion: 2.1 time: 0.538711 Aug 31 15:58:44.889729 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 427/861] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:44 2022] GET /compute/v2.1/servers/aa95066b-b1b8-43d8-8c5a-024e3890aa27 => generated 1520 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:44.916738 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1f11a896-4b62-467b-b4af-b5ce9b6ffb8e tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:44.924957 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1f11a896-4b62-467b-b4af-b5ce9b6ffb8e tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 8555b294-db38-4246-ac58-035cb2acc70e] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:44.942106 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1f11a896-4b62-467b-b4af-b5ce9b6ffb8e tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:44.943002 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1f11a896-4b62-467b-b4af-b5ce9b6ffb8e tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:44.943659 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1f11a896-4b62-467b-b4af-b5ce9b6ffb8e tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:44.945424 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1f11a896-4b62-467b-b4af-b5ce9b6ffb8e tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:44.946640 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1f11a896-4b62-467b-b4af-b5ce9b6ffb8e tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:44.947431 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1f11a896-4b62-467b-b4af-b5ce9b6ffb8e tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:45.331262 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7135e832-41fe-4f77-b395-dad0b9db4964 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:45.344660 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7135e832-41fe-4f77-b395-dad0b9db4964 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/2ddb0b07-9e31-403c-91d5-a278d632d754" status: 200 len: 1503 microversion: 2.1 time: 0.770241 Aug 31 15:58:45.345535 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 435/862] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:44 2022] GET /compute/v2.1/servers/2ddb0b07-9e31-403c-91d5-a278d632d754 => generated 1503 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:58:45.363451 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b95c1f82-a1ec-4658-a768-cc79ba616db6 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:45.365341 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b95c1f82-a1ec-4658-a768-cc79ba616db6 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] [instance: aa95066b-b1b8-43d8-8c5a-024e3890aa27] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:45.375073 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b95c1f82-a1ec-4658-a768-cc79ba616db6 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:45.376020 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b95c1f82-a1ec-4658-a768-cc79ba616db6 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:45.376646 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b95c1f82-a1ec-4658-a768-cc79ba616db6 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:45.377648 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b95c1f82-a1ec-4658-a768-cc79ba616db6 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:45.378302 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b95c1f82-a1ec-4658-a768-cc79ba616db6 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:45.378895 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b95c1f82-a1ec-4658-a768-cc79ba616db6 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:46.066095 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1f11a896-4b62-467b-b4af-b5ce9b6ffb8e tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:46.075525 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1f11a896-4b62-467b-b4af-b5ce9b6ffb8e tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:46.076964 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1f11a896-4b62-467b-b4af-b5ce9b6ffb8e tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:46.078153 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1f11a896-4b62-467b-b4af-b5ce9b6ffb8e tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/8555b294-db38-4246-ac58-035cb2acc70e" status: 200 len: 1567 microversion: 2.25 time: 1.175495 Aug 31 15:58:46.078714 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 428/863] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:58:44 2022] GET /compute/v2.1/servers/8555b294-db38-4246-ac58-035cb2acc70e => generated 1567 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:46.089979 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b1fc5743-a888-4e12-848f-23d80c63737e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:46.090590 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b1fc5743-a888-4e12-848f-23d80c63737e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:46.097773 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b1fc5743-a888-4e12-848f-23d80c63737e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:46.098446 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b1fc5743-a888-4e12-848f-23d80c63737e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:46.098993 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b1fc5743-a888-4e12-848f-23d80c63737e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:46.099720 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b1fc5743-a888-4e12-848f-23d80c63737e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:46.100189 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b1fc5743-a888-4e12-848f-23d80c63737e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:46.100655 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b1fc5743-a888-4e12-848f-23d80c63737e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:46.350699 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b1fc5743-a888-4e12-848f-23d80c63737e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:46.353054 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b95c1f82-a1ec-4658-a768-cc79ba616db6 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccce16c7fda401ea68fb31ea8099d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed252ebf7c741bbb36b553ac1767579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:46.365980 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b95c1f82-a1ec-4658-a768-cc79ba616db6 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "GET /compute/v2.1/servers/aa95066b-b1b8-43d8-8c5a-024e3890aa27" status: 200 len: 1520 microversion: 2.1 time: 1.019199 Aug 31 15:58:46.369845 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 436/864] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:45 2022] GET /compute/v2.1/servers/aa95066b-b1b8-43d8-8c5a-024e3890aa27 => generated 1520 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:46.370228 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b1fc5743-a888-4e12-848f-23d80c63737e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:46.373016 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b1fc5743-a888-4e12-848f-23d80c63737e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:46.382072 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b1fc5743-a888-4e12-848f-23d80c63737e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1539 microversion: 2.91 time: 0.296993 Aug 31 15:58:46.384193 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 429/865] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:58:46 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1539 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:46.388310 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7735f55f-a5ac-4c02-b5af-13ef2d8d1a3e tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:46.389172 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7735f55f-a5ac-4c02-b5af-13ef2d8d1a3e tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] [instance: 5de5737d-bcc8-4357-85f0-f4468ac84bc7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:46.405710 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7735f55f-a5ac-4c02-b5af-13ef2d8d1a3e tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:46.417521 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b45831b6-7b35-4042-a3f8-7dd1dbad2d21 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:46.418544 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7735f55f-a5ac-4c02-b5af-13ef2d8d1a3e tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:46.418791 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b45831b6-7b35-4042-a3f8-7dd1dbad2d21 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] [instance: 6c5b2996-bce3-4a39-88c7-2e300d06473e] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:46.420019 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7735f55f-a5ac-4c02-b5af-13ef2d8d1a3e tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:46.421996 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7735f55f-a5ac-4c02-b5af-13ef2d8d1a3e tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:46.428862 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b45831b6-7b35-4042-a3f8-7dd1dbad2d21 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:46.429272 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7735f55f-a5ac-4c02-b5af-13ef2d8d1a3e tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:46.429738 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7735f55f-a5ac-4c02-b5af-13ef2d8d1a3e tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:46.430145 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b45831b6-7b35-4042-a3f8-7dd1dbad2d21 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:46.431163 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b45831b6-7b35-4042-a3f8-7dd1dbad2d21 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:46.432211 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b45831b6-7b35-4042-a3f8-7dd1dbad2d21 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:46.432932 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b45831b6-7b35-4042-a3f8-7dd1dbad2d21 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:46.434542 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b45831b6-7b35-4042-a3f8-7dd1dbad2d21 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:46.782363 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7735f55f-a5ac-4c02-b5af-13ef2d8d1a3e tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a5652ccb7b54cf7a56f25b91c30c904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5746b9f74e4fecbf2da098436f2ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:46.785604 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b45831b6-7b35-4042-a3f8-7dd1dbad2d21 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a03cc5956ca477abacbe0c26bf18750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea45d1b678342ed812f9912e9f07503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:46.790889 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7735f55f-a5ac-4c02-b5af-13ef2d8d1a3e tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] 10.222.0.61 "GET /compute/v2.1/servers/5de5737d-bcc8-4357-85f0-f4468ac84bc7" status: 200 len: 1332 microversion: 2.1 time: 0.419735 Aug 31 15:58:46.791621 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 437/866] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:46 2022] GET /compute/v2.1/servers/5de5737d-bcc8-4357-85f0-f4468ac84bc7 => generated 1332 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:46.796486 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3a27ef38-fe59-4b35-9818-37f44f08928f tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:46.797226 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3a27ef38-fe59-4b35-9818-37f44f08928f tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: 2ddb0b07-9e31-403c-91d5-a278d632d754] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:46.802316 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b45831b6-7b35-4042-a3f8-7dd1dbad2d21 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] 10.222.0.61 "GET /compute/v2.1/servers/6c5b2996-bce3-4a39-88c7-2e300d06473e" status: 200 len: 1314 microversion: 2.1 time: 0.416675 Aug 31 15:58:46.803106 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 430/867] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:46 2022] GET /compute/v2.1/servers/6c5b2996-bce3-4a39-88c7-2e300d06473e => generated 1314 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:46.803591 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3a27ef38-fe59-4b35-9818-37f44f08928f tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:46.804467 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3a27ef38-fe59-4b35-9818-37f44f08928f tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:46.806467 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3a27ef38-fe59-4b35-9818-37f44f08928f tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:46.807427 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3a27ef38-fe59-4b35-9818-37f44f08928f tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:46.808151 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3a27ef38-fe59-4b35-9818-37f44f08928f tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:46.808898 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3a27ef38-fe59-4b35-9818-37f44f08928f tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:46.829116 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-de644ac0-0d11-4d8e-8830-83b235bac7bc tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1834146423", "metadata": {"": ""}}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:58:46.849829 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-de644ac0-0d11-4d8e-8830-83b235bac7bc tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Request method failure captured: Aug 31 15:58:46.849829 n-d-850499-9 devstack@n-api.service[122256]: request: POST /compute/v2.1/servers/aa95066b-b1b8-43d8-8c5a-024e3890aa27/action HTTP/1.1 Aug 31 15:58:46.849829 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 15:58:46.849829 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 15:58:46.849829 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 15:58:46.849829 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 107 Aug 31 15:58:46.849829 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 15:58:46.849829 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 15:58:46.849829 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 15:58:46.849829 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 15:58:46.849829 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4UcGHO9gatUvWJBB907oWawoQP70h6HsJbsny_eFggCHTOgqUkoCg1AvAVcAHjORdEbkXL7xp_g0w0MdWTsQsxdtQLftyhBkZlCr9g7XUi02ZEumxE15kVflv1oC3aQIZmyWr_qGIamtOyoWvoJnlxnc8ckdznU53DKuHgbDBtijYA Aug 31 15:58:46.849829 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 15:58:46.849829 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 15:58:46.849829 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 15:58:46.849829 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 15:58:46.849829 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 15:58:46.849829 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 15:58:46.849829 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 7ed252ebf7c741bbb36b553ac1767579 Aug 31 15:58:46.849829 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-977175069 Aug 31 15:58:46.849829 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 15:58:46.849829 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 15:58:46.851890 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7ed252ebf7c741bbb36b553ac1767579"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7ed252ebf7c741bbb36b553ac1767579"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7ed252ebf7c741bbb36b553ac1767579", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7ed252ebf7c741bbb36b553ac1767579"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 15:58:46.851890 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-977175069 Aug 31 15:58:46.851890 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 7ed252ebf7c741bbb36b553ac1767579 Aug 31 15:58:46.851890 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-977175069 Aug 31 15:58:46.851890 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ImagesOneServerNegativeTestJSON-977175069-project Aug 31 15:58:46.851890 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 15:58:46.851890 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 15:58:46.851890 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 3ccce16c7fda401ea68fb31ea8099d78 Aug 31 15:58:46.851890 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-977175069-project Aug 31 15:58:46.851890 n-d-850499-9 devstack@n-api.service[122256]: Aug 31 15:58:46.851890 n-d-850499-9 devstack@n-api.service[122256]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1834146423", "metadata": {"": ""}}} Aug 31 15:58:46.851890 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 15:58:46.852760 n-d-850499-9 devstack@n-api.service[122256]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 31 15:58:46.852760 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': 'aa95066b-b1b8-43d8-8c5a-024e3890aa27', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1834146423', 'metadata': {'': ''}}}} Aug 31 15:58:46.852760 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:58:46.852760 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:58:46.852760 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 15:58:46.852760 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 15:58:46.852760 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 15:58:46.852760 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise error Aug 31 15:58:46.852760 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 31 15:58:46.852760 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:58:46.852760 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Aug 31 15:58:46.852760 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 31 15:58:46.852760 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 31 15:58:46.852760 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 31 15:58:46.852760 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 31 15:58:46.852760 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:58:46.852760 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 31 15:58:46.852760 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi {'': ''} Aug 31 15:58:46.852760 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:58:46.852760 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:58:46.852760 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:58:46.854231 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:58:46.854231 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:58:46.854231 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:58:46.854231 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:58:46.854231 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:58:46.854231 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:58:46.854231 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:58:46.854231 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:58:46.854231 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:58:46.854231 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 15:58:46.854231 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 15:58:46.854231 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 15:58:46.854231 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 15:58:46.854231 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 15:58:46.854231 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 15:58:46.854231 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 31 15:58:46.854231 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:58:46.854231 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:58:46.854231 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:58:46.854231 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:58:46.855679 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:58:46.855679 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:58:46.855679 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 15:58:46.855679 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 15:58:46.855679 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 31 15:58:46.855679 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:58:46.858082 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-de644ac0-0d11-4d8e-8830-83b235bac7bc tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:58:46.858989 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-de644ac0-0d11-4d8e-8830-83b235bac7bc tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "POST /compute/v2.1/servers/aa95066b-b1b8-43d8-8c5a-024e3890aa27/action" status: 400 len: 170 microversion: 2.1 time: 0.054689 Aug 31 15:58:46.859605 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 431/868] 10.222.0.61 () {60 vars in 1279 bytes} [Wed Aug 31 15:58:46 2022] POST /compute/v2.1/servers/aa95066b-b1b8-43d8-8c5a-024e3890aa27/action => generated 170 bytes in 56 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 15:58:46.864548 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-85347f64-10a7-443f-9b6f-2de63d87af40 req-31ded8b0-85d6-4418-97ca-f4ef58cadd76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8555b294-db38-4246-ac58-035cb2acc70e", "tag": "a4e66017-bbca-4435-8809-d986a9a6cbd2"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:58:46.878354 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-85347f64-10a7-443f-9b6f-2de63d87af40 req-31ded8b0-85d6-4418-97ca-f4ef58cadd76 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:46.879130 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-85347f64-10a7-443f-9b6f-2de63d87af40 req-31ded8b0-85d6-4418-97ca-f4ef58cadd76 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:46.879769 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-85347f64-10a7-443f-9b6f-2de63d87af40 req-31ded8b0-85d6-4418-97ca-f4ef58cadd76 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:46.894106 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-85347f64-10a7-443f-9b6f-2de63d87af40 req-31ded8b0-85d6-4418-97ca-f4ef58cadd76 service nova] Creating event network-changed:a4e66017-bbca-4435-8809-d986a9a6cbd2 for instance 8555b294-db38-4246-ac58-035cb2acc70e on n-h2-850499-9 Aug 31 15:58:46.901885 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-85347f64-10a7-443f-9b6f-2de63d87af40 req-31ded8b0-85d6-4418-97ca-f4ef58cadd76 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040752 Aug 31 15:58:46.902743 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 432/869] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 15:58:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:58:46.919486 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0bca607e-bdfd-41c4-9019-20f6b40cd048 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:46.920232 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0bca607e-bdfd-41c4-9019-20f6b40cd048 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] [instance: aa95066b-b1b8-43d8-8c5a-024e3890aa27] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:46.926879 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0bca607e-bdfd-41c4-9019-20f6b40cd048 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:46.927377 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0bca607e-bdfd-41c4-9019-20f6b40cd048 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:46.927848 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0bca607e-bdfd-41c4-9019-20f6b40cd048 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:46.928576 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0bca607e-bdfd-41c4-9019-20f6b40cd048 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:46.929015 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0bca607e-bdfd-41c4-9019-20f6b40cd048 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:46.929450 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0bca607e-bdfd-41c4-9019-20f6b40cd048 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:47.169636 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3a27ef38-fe59-4b35-9818-37f44f08928f tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:47.183648 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3a27ef38-fe59-4b35-9818-37f44f08928f tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/2ddb0b07-9e31-403c-91d5-a278d632d754" status: 200 len: 1503 microversion: 2.1 time: 0.390363 Aug 31 15:58:47.184268 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 438/870] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:46 2022] GET /compute/v2.1/servers/2ddb0b07-9e31-403c-91d5-a278d632d754 => generated 1503 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:47.189250 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-78ed7ce7-cf20-4440-ad82-338e919adb0b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:47.193256 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-78ed7ce7-cf20-4440-ad82-338e919adb0b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 8555b294-db38-4246-ac58-035cb2acc70e] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:47.203527 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-78ed7ce7-cf20-4440-ad82-338e919adb0b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:47.214216 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-78ed7ce7-cf20-4440-ad82-338e919adb0b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:47.214678 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-78ed7ce7-cf20-4440-ad82-338e919adb0b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:47.215427 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-78ed7ce7-cf20-4440-ad82-338e919adb0b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:47.215915 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-78ed7ce7-cf20-4440-ad82-338e919adb0b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:47.216343 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-78ed7ce7-cf20-4440-ad82-338e919adb0b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:47.369714 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-0bca607e-bdfd-41c4-9019-20f6b40cd048 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccce16c7fda401ea68fb31ea8099d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed252ebf7c741bbb36b553ac1767579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:47.385159 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0bca607e-bdfd-41c4-9019-20f6b40cd048 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "GET /compute/v2.1/servers/aa95066b-b1b8-43d8-8c5a-024e3890aa27" status: 200 len: 1520 microversion: 2.1 time: 0.480377 Aug 31 15:58:47.390461 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 433/871] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:46 2022] GET /compute/v2.1/servers/aa95066b-b1b8-43d8-8c5a-024e3890aa27 => generated 1520 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:47.399831 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-e948b373-f11b-4eab-a9c8-9489377b1d34 req-ee8529c7-7db7-40bc-b181-9a2c559f06d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5de5737d-bcc8-4357-85f0-f4468ac84bc7", "tag": "860bd128-aaa5-4d35-b493-f0871fc78fdb"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:58:47.421276 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-e948b373-f11b-4eab-a9c8-9489377b1d34 req-ee8529c7-7db7-40bc-b181-9a2c559f06d7 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:47.422154 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-e948b373-f11b-4eab-a9c8-9489377b1d34 req-ee8529c7-7db7-40bc-b181-9a2c559f06d7 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:47.422873 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-e948b373-f11b-4eab-a9c8-9489377b1d34 req-ee8529c7-7db7-40bc-b181-9a2c559f06d7 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:47.441112 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-e948b373-f11b-4eab-a9c8-9489377b1d34 req-ee8529c7-7db7-40bc-b181-9a2c559f06d7 service nova] Creating event network-changed:860bd128-aaa5-4d35-b493-f0871fc78fdb for instance 5de5737d-bcc8-4357-85f0-f4468ac84bc7 on n-h1-850499-9 Aug 31 15:58:47.447224 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-e948b373-f11b-4eab-a9c8-9489377b1d34 req-ee8529c7-7db7-40bc-b181-9a2c559f06d7 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054176 Aug 31 15:58:47.448405 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 434/872] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 15:58:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:58:47.453687 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c59f63c1-c778-4b35-9eae-b68a7b6949ca tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:47.455059 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c59f63c1-c778-4b35-9eae-b68a7b6949ca tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] [instance: aa95066b-b1b8-43d8-8c5a-024e3890aa27] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:47.465104 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c59f63c1-c778-4b35-9eae-b68a7b6949ca tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:47.465775 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c59f63c1-c778-4b35-9eae-b68a7b6949ca tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:47.466704 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c59f63c1-c778-4b35-9eae-b68a7b6949ca tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:47.467708 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c59f63c1-c778-4b35-9eae-b68a7b6949ca tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:47.468579 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c59f63c1-c778-4b35-9eae-b68a7b6949ca tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:47.469154 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c59f63c1-c778-4b35-9eae-b68a7b6949ca tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:47.570565 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-78ed7ce7-cf20-4440-ad82-338e919adb0b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:47.580453 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-78ed7ce7-cf20-4440-ad82-338e919adb0b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:47.581903 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-78ed7ce7-cf20-4440-ad82-338e919adb0b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:47.583050 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-78ed7ce7-cf20-4440-ad82-338e919adb0b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/8555b294-db38-4246-ac58-035cb2acc70e" status: 200 len: 1567 microversion: 2.25 time: 0.397562 Aug 31 15:58:47.584521 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 439/873] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:58:47 2022] GET /compute/v2.1/servers/8555b294-db38-4246-ac58-035cb2acc70e => generated 1567 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:47.593117 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f169b2b8-e2c7-42de-8860-6c71a99b8842 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:47.594430 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f169b2b8-e2c7-42de-8860-6c71a99b8842 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:47.604793 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f169b2b8-e2c7-42de-8860-6c71a99b8842 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:47.606203 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f169b2b8-e2c7-42de-8860-6c71a99b8842 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:47.606806 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f169b2b8-e2c7-42de-8860-6c71a99b8842 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:47.607934 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f169b2b8-e2c7-42de-8860-6c71a99b8842 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:47.608703 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f169b2b8-e2c7-42de-8860-6c71a99b8842 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:47.609953 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f169b2b8-e2c7-42de-8860-6c71a99b8842 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:47.755451 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f169b2b8-e2c7-42de-8860-6c71a99b8842 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:47.767311 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f169b2b8-e2c7-42de-8860-6c71a99b8842 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:47.770264 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f169b2b8-e2c7-42de-8860-6c71a99b8842 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:47.776802 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f169b2b8-e2c7-42de-8860-6c71a99b8842 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1539 microversion: 2.91 time: 0.190865 Aug 31 15:58:47.777634 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 440/874] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:58:47 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1539 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:47.815857 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-99c50a2f-e295-4481-a5ab-9bf5cec6a460 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:47.817990 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-99c50a2f-e295-4481-a5ab-9bf5cec6a460 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] [instance: 5de5737d-bcc8-4357-85f0-f4468ac84bc7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:47.825930 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-99c50a2f-e295-4481-a5ab-9bf5cec6a460 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:47.826768 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-99c50a2f-e295-4481-a5ab-9bf5cec6a460 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:47.827460 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-99c50a2f-e295-4481-a5ab-9bf5cec6a460 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:47.828642 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-99c50a2f-e295-4481-a5ab-9bf5cec6a460 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:47.829331 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-99c50a2f-e295-4481-a5ab-9bf5cec6a460 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:47.829975 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-99c50a2f-e295-4481-a5ab-9bf5cec6a460 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:47.898182 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c59f63c1-c778-4b35-9eae-b68a7b6949ca tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccce16c7fda401ea68fb31ea8099d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed252ebf7c741bbb36b553ac1767579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:47.912742 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c59f63c1-c778-4b35-9eae-b68a7b6949ca tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "GET /compute/v2.1/servers/aa95066b-b1b8-43d8-8c5a-024e3890aa27" status: 200 len: 1520 microversion: 2.1 time: 0.462886 Aug 31 15:58:47.915692 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 435/875] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:47 2022] GET /compute/v2.1/servers/aa95066b-b1b8-43d8-8c5a-024e3890aa27 => generated 1520 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:47.921154 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1fa68c4c-b4a3-4359-ac31-4b4ee248fe7b tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:47.922125 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1fa68c4c-b4a3-4359-ac31-4b4ee248fe7b tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] [instance: 6c5b2996-bce3-4a39-88c7-2e300d06473e] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:47.929231 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1fa68c4c-b4a3-4359-ac31-4b4ee248fe7b tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:47.930090 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1fa68c4c-b4a3-4359-ac31-4b4ee248fe7b tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:47.930622 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1fa68c4c-b4a3-4359-ac31-4b4ee248fe7b tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:47.931420 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1fa68c4c-b4a3-4359-ac31-4b4ee248fe7b tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:47.931979 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1fa68c4c-b4a3-4359-ac31-4b4ee248fe7b tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:47.932579 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1fa68c4c-b4a3-4359-ac31-4b4ee248fe7b tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:48.135727 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-99c50a2f-e295-4481-a5ab-9bf5cec6a460 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a5652ccb7b54cf7a56f25b91c30c904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5746b9f74e4fecbf2da098436f2ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:48.146964 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-99c50a2f-e295-4481-a5ab-9bf5cec6a460 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] 10.222.0.61 "GET /compute/v2.1/servers/5de5737d-bcc8-4357-85f0-f4468ac84bc7" status: 200 len: 1332 microversion: 2.1 time: 0.336150 Aug 31 15:58:48.149118 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 441/876] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:47 2022] GET /compute/v2.1/servers/5de5737d-bcc8-4357-85f0-f4468ac84bc7 => generated 1332 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:58:48.162475 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-dd87301c-698c-44c2-8afa-c943c9fcdc5e tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-333888877", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:58:48.167850 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-dd87301c-698c-44c2-8afa-c943c9fcdc5e tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Request method failure captured: Aug 31 15:58:48.167850 n-d-850499-9 devstack@n-api.service[122257]: request: POST /compute/v2.1/servers/aa95066b-b1b8-43d8-8c5a-024e3890aa27/action HTTP/1.1 Aug 31 15:58:48.167850 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 15:58:48.167850 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 15:58:48.167850 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 15:58:48.167850 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 618 Aug 31 15:58:48.167850 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 15:58:48.167850 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 15:58:48.167850 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 15:58:48.167850 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 15:58:48.167850 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4UcGHO9gatUvWJBB907oWawoQP70h6HsJbsny_eFggCHTOgqUkoCg1AvAVcAHjORdEbkXL7xp_g0w0MdWTsQsxdtQLftyhBkZlCr9g7XUi02ZEumxE15kVflv1oC3aQIZmyWr_qGIamtOyoWvoJnlxnc8ckdznU53DKuHgbDBtijYA Aug 31 15:58:48.167850 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 15:58:48.167850 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 15:58:48.167850 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 15:58:48.167850 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 15:58:48.167850 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 15:58:48.167850 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 15:58:48.167850 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 7ed252ebf7c741bbb36b553ac1767579 Aug 31 15:58:48.167850 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-977175069 Aug 31 15:58:48.167850 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 15:58:48.167850 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 15:58:48.169295 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7ed252ebf7c741bbb36b553ac1767579"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7ed252ebf7c741bbb36b553ac1767579"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7ed252ebf7c741bbb36b553ac1767579", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7ed252ebf7c741bbb36b553ac1767579"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 15:58:48.169295 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-977175069 Aug 31 15:58:48.169295 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 7ed252ebf7c741bbb36b553ac1767579 Aug 31 15:58:48.169295 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-977175069 Aug 31 15:58:48.169295 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ImagesOneServerNegativeTestJSON-977175069-project Aug 31 15:58:48.169295 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 15:58:48.169295 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 15:58:48.169295 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 3ccce16c7fda401ea68fb31ea8099d78 Aug 31 15:58:48.169295 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-977175069-project Aug 31 15:58:48.169295 n-d-850499-9 devstack@n-api.service[122257]: Aug 31 15:58:48.169871 n-d-850499-9 devstack@n-api.service[122257]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-333888877", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Aug 31 15:58:48.169871 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 15:58:48.169871 n-d-850499-9 devstack@n-api.service[122257]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 31 15:58:48.170087 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': 'aa95066b-b1b8-43d8-8c5a-024e3890aa27', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-333888877', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Aug 31 15:58:48.170087 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:58:48.170087 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:58:48.170087 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 15:58:48.170087 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 15:58:48.170087 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 15:58:48.170087 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise error Aug 31 15:58:48.170087 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 31 15:58:48.170087 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:58:48.170087 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Aug 31 15:58:48.170087 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 31 15:58:48.170747 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 31 15:58:48.170747 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 31 15:58:48.170747 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 31 15:58:48.170747 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:58:48.170747 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 31 15:58:48.170747 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Aug 31 15:58:48.170747 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:58:48.170747 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:58:48.170747 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:58:48.170747 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:58:48.170747 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:58:48.170747 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:58:48.170747 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:58:48.170747 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:58:48.170747 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:58:48.170747 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:58:48.170747 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:58:48.171752 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:58:48.171752 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 15:58:48.171752 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 15:58:48.171752 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 15:58:48.171752 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 15:58:48.171752 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 15:58:48.171752 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 15:58:48.171752 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 31 15:58:48.171752 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:58:48.171752 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:58:48.171752 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:58:48.171752 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:58:48.173255 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:58:48.173255 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:58:48.173255 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 15:58:48.173255 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 15:58:48.173255 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 31 15:58:48.173255 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:58:48.174163 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-dd87301c-698c-44c2-8afa-c943c9fcdc5e tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:58:48.174421 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-dd87301c-698c-44c2-8afa-c943c9fcdc5e tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "POST /compute/v2.1/servers/aa95066b-b1b8-43d8-8c5a-024e3890aa27/action" status: 400 len: 938 microversion: 2.1 time: 0.023908 Aug 31 15:58:48.175231 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 442/877] 10.222.0.61 () {60 vars in 1279 bytes} [Wed Aug 31 15:58:48 2022] POST /compute/v2.1/servers/aa95066b-b1b8-43d8-8c5a-024e3890aa27/action => generated 938 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 15:58:48.187062 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c92a2187-4ba5-4ddb-a003-fd3aff82eaff tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:48.187965 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c92a2187-4ba5-4ddb-a003-fd3aff82eaff tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] [instance: aa95066b-b1b8-43d8-8c5a-024e3890aa27] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:48.196059 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c92a2187-4ba5-4ddb-a003-fd3aff82eaff tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:48.197078 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c92a2187-4ba5-4ddb-a003-fd3aff82eaff tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:48.197686 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c92a2187-4ba5-4ddb-a003-fd3aff82eaff tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:48.198399 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c92a2187-4ba5-4ddb-a003-fd3aff82eaff tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:48.198862 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c92a2187-4ba5-4ddb-a003-fd3aff82eaff tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:48.199288 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c92a2187-4ba5-4ddb-a003-fd3aff82eaff tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:48.294546 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1fa68c4c-b4a3-4359-ac31-4b4ee248fe7b tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a03cc5956ca477abacbe0c26bf18750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea45d1b678342ed812f9912e9f07503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:48.299030 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:58:48.307182 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1fa68c4c-b4a3-4359-ac31-4b4ee248fe7b tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] 10.222.0.61 "GET /compute/v2.1/servers/6c5b2996-bce3-4a39-88c7-2e300d06473e" status: 200 len: 1314 microversion: 2.1 time: 0.390055 Aug 31 15:58:48.321434 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 436/878] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:47 2022] GET /compute/v2.1/servers/6c5b2996-bce3-4a39-88c7-2e300d06473e => generated 1314 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:48.328554 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9cc7537c-4a72-4b13-a9f8-085d397fb320 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:48.329484 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9cc7537c-4a72-4b13-a9f8-085d397fb320 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: 2ddb0b07-9e31-403c-91d5-a278d632d754] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:48.338622 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9cc7537c-4a72-4b13-a9f8-085d397fb320 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:48.339156 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9cc7537c-4a72-4b13-a9f8-085d397fb320 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:48.339894 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9cc7537c-4a72-4b13-a9f8-085d397fb320 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:48.340615 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9cc7537c-4a72-4b13-a9f8-085d397fb320 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:48.341138 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9cc7537c-4a72-4b13-a9f8-085d397fb320 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:48.341594 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9cc7537c-4a72-4b13-a9f8-085d397fb320 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:48.450915 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c92a2187-4ba5-4ddb-a003-fd3aff82eaff tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccce16c7fda401ea68fb31ea8099d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed252ebf7c741bbb36b553ac1767579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:48.460051 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c92a2187-4ba5-4ddb-a003-fd3aff82eaff tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "GET /compute/v2.1/servers/aa95066b-b1b8-43d8-8c5a-024e3890aa27" status: 200 len: 1520 microversion: 2.1 time: 0.277988 Aug 31 15:58:48.460647 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 443/879] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:48 2022] GET /compute/v2.1/servers/aa95066b-b1b8-43d8-8c5a-024e3890aa27 => generated 1520 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:48.480340 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-41fd56d8-004d-45f6-8dfb-62a38a018719 req-7cdc0363-746b-4a81-87b5-ba2176ea2132 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c5b2996-bce3-4a39-88c7-2e300d06473e", "name": "network-vif-plugged", "status": "completed", "tag": "6a2a769e-d172-4084-aaf0-690c1eac47e7"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:58:48.498202 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-41fd56d8-004d-45f6-8dfb-62a38a018719 req-7cdc0363-746b-4a81-87b5-ba2176ea2132 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:48.498688 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-41fd56d8-004d-45f6-8dfb-62a38a018719 req-7cdc0363-746b-4a81-87b5-ba2176ea2132 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:48.499218 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-41fd56d8-004d-45f6-8dfb-62a38a018719 req-7cdc0363-746b-4a81-87b5-ba2176ea2132 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:48.514133 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-41fd56d8-004d-45f6-8dfb-62a38a018719 req-7cdc0363-746b-4a81-87b5-ba2176ea2132 service nova] Creating event network-vif-plugged:6a2a769e-d172-4084-aaf0-690c1eac47e7 for instance 6c5b2996-bce3-4a39-88c7-2e300d06473e on n-h2-850499-9 Aug 31 15:58:48.517314 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-41fd56d8-004d-45f6-8dfb-62a38a018719 req-7cdc0363-746b-4a81-87b5-ba2176ea2132 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043641 Aug 31 15:58:48.518239 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 444/880] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 15:58:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:58:48.523681 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-eb1608e0-b6bb-44ec-b572-874e9734059b tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:48.524418 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-eb1608e0-b6bb-44ec-b572-874e9734059b tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] [instance: aa95066b-b1b8-43d8-8c5a-024e3890aa27] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:48.531539 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eb1608e0-b6bb-44ec-b572-874e9734059b tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:48.532040 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eb1608e0-b6bb-44ec-b572-874e9734059b tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:48.532478 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eb1608e0-b6bb-44ec-b572-874e9734059b tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:48.533175 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eb1608e0-b6bb-44ec-b572-874e9734059b tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:48.533632 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eb1608e0-b6bb-44ec-b572-874e9734059b tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:48.534057 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eb1608e0-b6bb-44ec-b572-874e9734059b tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:48.534433 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-9cc7537c-4a72-4b13-a9f8-085d397fb320 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:48.543398 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9cc7537c-4a72-4b13-a9f8-085d397fb320 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/2ddb0b07-9e31-403c-91d5-a278d632d754" status: 200 len: 1478 microversion: 2.1 time: 0.220404 Aug 31 15:58:48.544019 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 437/881] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:48 2022] GET /compute/v2.1/servers/2ddb0b07-9e31-403c-91d5-a278d632d754 => generated 1478 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:48.564285 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9426963b-2104-4f3f-889f-4e03c75c82a9 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Calling method '.version_select at 0x7f5ae944eca0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:48.568289 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9426963b-2104-4f3f-889f-4e03c75c82a9 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:48.568853 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9426963b-2104-4f3f-889f-4e03c75c82a9 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:48.569482 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9426963b-2104-4f3f-889f-4e03c75c82a9 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:48.580036 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9426963b-2104-4f3f-889f-4e03c75c82a9 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] 10.222.0.61 "GET /compute/v2.1/os-migrations" status: 200 len: 1548 microversion: 2.1 time: 0.018876 Aug 31 15:58:48.580635 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 438/882] 10.222.0.61 () {58 vars in 1143 bytes} [Wed Aug 31 15:58:48 2022] GET /compute/v2.1/os-migrations => generated 1548 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:58:48.607010 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b3185135-f310-4cde-99ba-9aac9984dc18 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:48.608006 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b3185135-f310-4cde-99ba-9aac9984dc18 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] [instance: 2ddb0b07-9e31-403c-91d5-a278d632d754] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:48.614726 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b3185135-f310-4cde-99ba-9aac9984dc18 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:48.616050 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b3185135-f310-4cde-99ba-9aac9984dc18 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:48.616959 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b3185135-f310-4cde-99ba-9aac9984dc18 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:48.618024 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b3185135-f310-4cde-99ba-9aac9984dc18 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:48.618570 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b3185135-f310-4cde-99ba-9aac9984dc18 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:48.619376 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b3185135-f310-4cde-99ba-9aac9984dc18 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:48.769122 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-eb1608e0-b6bb-44ec-b572-874e9734059b tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccce16c7fda401ea68fb31ea8099d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed252ebf7c741bbb36b553ac1767579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:48.780011 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-eb1608e0-b6bb-44ec-b572-874e9734059b tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "GET /compute/v2.1/servers/aa95066b-b1b8-43d8-8c5a-024e3890aa27" status: 200 len: 1520 microversion: 2.1 time: 0.260448 Aug 31 15:58:48.780646 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 445/883] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:48 2022] GET /compute/v2.1/servers/aa95066b-b1b8-43d8-8c5a-024e3890aa27 => generated 1520 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:48.788419 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3102669b-3f4b-4278-9b55-9b17ae5857b7 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:48.789768 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3102669b-3f4b-4278-9b55-9b17ae5857b7 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 8555b294-db38-4246-ac58-035cb2acc70e] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:48.797710 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3102669b-3f4b-4278-9b55-9b17ae5857b7 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:48.798326 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3102669b-3f4b-4278-9b55-9b17ae5857b7 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:48.799033 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3102669b-3f4b-4278-9b55-9b17ae5857b7 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:48.799842 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3102669b-3f4b-4278-9b55-9b17ae5857b7 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:48.800308 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3102669b-3f4b-4278-9b55-9b17ae5857b7 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:48.800743 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3102669b-3f4b-4278-9b55-9b17ae5857b7 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:48.842429 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b3185135-f310-4cde-99ba-9aac9984dc18 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/2ddb0b07-9e31-403c-91d5-a278d632d754" status: 200 len: 1629 microversion: 2.1 time: 0.241642 Aug 31 15:58:48.843015 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 439/884] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:48 2022] GET /compute/v2.1/servers/2ddb0b07-9e31-403c-91d5-a278d632d754 => generated 1629 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:48.856318 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-edd37f53-1041-4996-96c5-456ab31e6ca9 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:58:48.863616 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-edd37f53-1041-4996-96c5-456ab31e6ca9 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Request method failure captured: Aug 31 15:58:48.863616 n-d-850499-9 devstack@n-api.service[122256]: request: POST /compute/v2.1/servers/aa95066b-b1b8-43d8-8c5a-024e3890aa27/action HTTP/1.1 Aug 31 15:58:48.863616 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 15:58:48.863616 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 15:58:48.863616 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 15:58:48.863616 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 285 Aug 31 15:58:48.863616 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 15:58:48.863616 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 15:58:48.863616 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 15:58:48.863616 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 15:58:48.863616 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4UcGHO9gatUvWJBB907oWawoQP70h6HsJbsny_eFggCHTOgqUkoCg1AvAVcAHjORdEbkXL7xp_g0w0MdWTsQsxdtQLftyhBkZlCr9g7XUi02ZEumxE15kVflv1oC3aQIZmyWr_qGIamtOyoWvoJnlxnc8ckdznU53DKuHgbDBtijYA Aug 31 15:58:48.863616 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 15:58:48.863616 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 15:58:48.863616 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 15:58:48.863616 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 15:58:48.863616 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 15:58:48.863616 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 15:58:48.863616 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 7ed252ebf7c741bbb36b553ac1767579 Aug 31 15:58:48.863616 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-977175069 Aug 31 15:58:48.863616 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 15:58:48.863616 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 15:58:48.865285 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7ed252ebf7c741bbb36b553ac1767579"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7ed252ebf7c741bbb36b553ac1767579"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7ed252ebf7c741bbb36b553ac1767579", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7ed252ebf7c741bbb36b553ac1767579"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 15:58:48.865285 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-977175069 Aug 31 15:58:48.865285 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 7ed252ebf7c741bbb36b553ac1767579 Aug 31 15:58:48.865285 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-977175069 Aug 31 15:58:48.865285 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ImagesOneServerNegativeTestJSON-977175069-project Aug 31 15:58:48.865285 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 15:58:48.865285 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 15:58:48.865285 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 3ccce16c7fda401ea68fb31ea8099d78 Aug 31 15:58:48.865285 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-977175069-project Aug 31 15:58:48.865285 n-d-850499-9 devstack@n-api.service[122256]: Aug 31 15:58:48.865285 n-d-850499-9 devstack@n-api.service[122256]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 31 15:58:48.866087 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 15:58:48.866087 n-d-850499-9 devstack@n-api.service[122256]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 31 15:58:48.866087 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': 'aa95066b-b1b8-43d8-8c5a-024e3890aa27', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 31 15:58:48.866087 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:58:48.866087 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:58:48.866087 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 15:58:48.866087 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 15:58:48.866087 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 15:58:48.866087 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise error Aug 31 15:58:48.866087 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 31 15:58:48.866926 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:58:48.866926 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Aug 31 15:58:48.866926 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 31 15:58:48.866926 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:58:48.866926 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 31 15:58:48.866926 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 31 15:58:48.866926 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:58:48.866926 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:58:48.866926 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:58:48.866926 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:58:48.866926 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:58:48.866926 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:58:48.866926 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:58:48.866926 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:58:48.866926 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:58:48.866926 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:58:48.866926 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:58:48.866926 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:58:48.866926 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 15:58:48.866926 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 15:58:48.868425 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 15:58:48.868425 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 15:58:48.868425 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 15:58:48.868425 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 15:58:48.868425 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 31 15:58:48.868425 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:58:48.868425 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:58:48.868425 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:58:48.868425 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:58:48.868425 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:58:48.868425 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:58:48.868425 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 15:58:48.868425 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 15:58:48.869342 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 31 15:58:48.869342 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:58:48.872781 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-edd37f53-1041-4996-96c5-456ab31e6ca9 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:58:48.874172 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-edd37f53-1041-4996-96c5-456ab31e6ca9 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "POST /compute/v2.1/servers/aa95066b-b1b8-43d8-8c5a-024e3890aa27/action" status: 400 len: 619 microversion: 2.1 time: 0.029718 Aug 31 15:58:48.878270 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 440/885] 10.222.0.61 () {60 vars in 1279 bytes} [Wed Aug 31 15:58:48 2022] POST /compute/v2.1/servers/aa95066b-b1b8-43d8-8c5a-024e3890aa27/action => generated 619 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 15:58:48.884714 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ae9d2406-48dc-4c22-b248-59e8b70477c6 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:48.885327 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ae9d2406-48dc-4c22-b248-59e8b70477c6 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:48.892190 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ae9d2406-48dc-4c22-b248-59e8b70477c6 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:48.892687 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ae9d2406-48dc-4c22-b248-59e8b70477c6 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:48.893130 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ae9d2406-48dc-4c22-b248-59e8b70477c6 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:48.893842 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ae9d2406-48dc-4c22-b248-59e8b70477c6 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:48.894306 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ae9d2406-48dc-4c22-b248-59e8b70477c6 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:48.894739 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ae9d2406-48dc-4c22-b248-59e8b70477c6 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:48.966944 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ae9d2406-48dc-4c22-b248-59e8b70477c6 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:48.974236 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3102669b-3f4b-4278-9b55-9b17ae5857b7 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:48.975833 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ae9d2406-48dc-4c22-b248-59e8b70477c6 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:48.977539 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ae9d2406-48dc-4c22-b248-59e8b70477c6 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:48.982436 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ae9d2406-48dc-4c22-b248-59e8b70477c6 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1539 microversion: 2.91 time: 0.102999 Aug 31 15:58:48.982914 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3102669b-3f4b-4278-9b55-9b17ae5857b7 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:48.983042 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 441/886] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:58:48 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1539 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:48.984671 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3102669b-3f4b-4278-9b55-9b17ae5857b7 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:48.985936 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3102669b-3f4b-4278-9b55-9b17ae5857b7 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/8555b294-db38-4246-ac58-035cb2acc70e" status: 200 len: 1567 microversion: 2.25 time: 0.204191 Aug 31 15:58:48.986567 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 446/887] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:58:48 2022] GET /compute/v2.1/servers/8555b294-db38-4246-ac58-035cb2acc70e => generated 1567 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:48.987409 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4aacde24-6526-4e1f-869e-231630c87d73 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Action: 'create', calling method: .version_select at 0x7f5ae937a280>, body: {"keypair": {"name": "tempest-keypair-1523154201", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpgjXKNMjcj/CAaw/XrHy0xCrMfR6XoGsT3cr5e9braO1xhee0PNCU1mvAZg7OnIzY6/BZhzguO/KduWVuyiGJxTDe/KRuLlqjZiclvh7l4bfTfYXznDQ7VxjzyLPCKtw=="}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:58:48.997566 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-56ffa57f-8642-4fd8-9e7b-2187dce68bd7 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:48.999525 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-56ffa57f-8642-4fd8-9e7b-2187dce68bd7 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] [instance: aa95066b-b1b8-43d8-8c5a-024e3890aa27] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:49.005173 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=31 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:58:49.006165 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-56ffa57f-8642-4fd8-9e7b-2187dce68bd7 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:49.006702 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-56ffa57f-8642-4fd8-9e7b-2187dce68bd7 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:49.007124 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-56ffa57f-8642-4fd8-9e7b-2187dce68bd7 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:49.007993 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-56ffa57f-8642-4fd8-9e7b-2187dce68bd7 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:49.009042 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-56ffa57f-8642-4fd8-9e7b-2187dce68bd7 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:49.009708 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-56ffa57f-8642-4fd8-9e7b-2187dce68bd7 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:49.010103 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-4aacde24-6526-4e1f-869e-231630c87d73 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Getting quotas for project 150e5f8e376a40e089de8ed092e269fd. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:58:49.015453 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-4aacde24-6526-4e1f-869e-231630c87d73 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Getting quotas for user de0e032fc09b48ada1dfe99e549aa623 and project 150e5f8e376a40e089de8ed092e269fd. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:58:49.042920 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4aacde24-6526-4e1f-869e-231630c87d73 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.058487 Aug 31 15:58:49.047544 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 442/888] 10.222.0.61 () {60 vars in 1159 bytes} [Wed Aug 31 15:58:48 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:58:49.170714 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-56ffa57f-8642-4fd8-9e7b-2187dce68bd7 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccce16c7fda401ea68fb31ea8099d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed252ebf7c741bbb36b553ac1767579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:49.179550 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-56ffa57f-8642-4fd8-9e7b-2187dce68bd7 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "GET /compute/v2.1/servers/aa95066b-b1b8-43d8-8c5a-024e3890aa27" status: 200 len: 1520 microversion: 2.1 time: 0.191768 Aug 31 15:58:49.181118 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 447/889] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:48 2022] GET /compute/v2.1/servers/aa95066b-b1b8-43d8-8c5a-024e3890aa27 => generated 1520 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:49.185942 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3559e635-afe5-46b5-9127-8c8cde21eb64 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:49.186563 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3559e635-afe5-46b5-9127-8c8cde21eb64 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] [instance: 5de5737d-bcc8-4357-85f0-f4468ac84bc7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:49.193033 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3559e635-afe5-46b5-9127-8c8cde21eb64 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:49.193700 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3559e635-afe5-46b5-9127-8c8cde21eb64 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:49.194336 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3559e635-afe5-46b5-9127-8c8cde21eb64 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:49.195208 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3559e635-afe5-46b5-9127-8c8cde21eb64 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:49.196788 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3559e635-afe5-46b5-9127-8c8cde21eb64 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:49.197478 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3559e635-afe5-46b5-9127-8c8cde21eb64 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:49.221003 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ae754189-b546-4276-960c-9406f50eced3 tempest-ServicesAdminTestJSON-1806532774 tempest-ServicesAdminTestJSON-1806532774-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:49.228710 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ae754189-b546-4276-960c-9406f50eced3 tempest-ServicesAdminTestJSON-1806532774 tempest-ServicesAdminTestJSON-1806532774-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:49.229218 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ae754189-b546-4276-960c-9406f50eced3 tempest-ServicesAdminTestJSON-1806532774 tempest-ServicesAdminTestJSON-1806532774-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:49.229847 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ae754189-b546-4276-960c-9406f50eced3 tempest-ServicesAdminTestJSON-1806532774 tempest-ServicesAdminTestJSON-1806532774-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:49.230609 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ae754189-b546-4276-960c-9406f50eced3 tempest-ServicesAdminTestJSON-1806532774 tempest-ServicesAdminTestJSON-1806532774-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:49.231074 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ae754189-b546-4276-960c-9406f50eced3 tempest-ServicesAdminTestJSON-1806532774 tempest-ServicesAdminTestJSON-1806532774-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:49.231521 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ae754189-b546-4276-960c-9406f50eced3 tempest-ServicesAdminTestJSON-1806532774 tempest-ServicesAdminTestJSON-1806532774-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:49.239264 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=23 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:58:49.259685 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ae754189-b546-4276-960c-9406f50eced3 tempest-ServicesAdminTestJSON-1806532774 tempest-ServicesAdminTestJSON-1806532774-project-admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.214124 Aug 31 15:58:49.260456 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 443/890] 10.222.0.61 () {58 vars in 1137 bytes} [Wed Aug 31 15:58:49 2022] GET /compute/v2.1/os-services => generated 944 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:58:49.272942 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e4f02580-0f12-45ea-bc31-6d551383813f tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:49.272942 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e4f02580-0f12-45ea-bc31-6d551383813f tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] [instance: aa95066b-b1b8-43d8-8c5a-024e3890aa27] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:49.279244 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e4f02580-0f12-45ea-bc31-6d551383813f tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:49.279787 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e4f02580-0f12-45ea-bc31-6d551383813f tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:49.280275 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e4f02580-0f12-45ea-bc31-6d551383813f tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:49.280930 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e4f02580-0f12-45ea-bc31-6d551383813f tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:49.281397 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e4f02580-0f12-45ea-bc31-6d551383813f tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:49.281873 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e4f02580-0f12-45ea-bc31-6d551383813f tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:49.391140 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3559e635-afe5-46b5-9127-8c8cde21eb64 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a5652ccb7b54cf7a56f25b91c30c904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5746b9f74e4fecbf2da098436f2ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:49.401733 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3559e635-afe5-46b5-9127-8c8cde21eb64 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] 10.222.0.61 "GET /compute/v2.1/servers/5de5737d-bcc8-4357-85f0-f4468ac84bc7" status: 200 len: 1332 microversion: 2.1 time: 0.219404 Aug 31 15:58:49.402322 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 448/891] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:49 2022] GET /compute/v2.1/servers/5de5737d-bcc8-4357-85f0-f4468ac84bc7 => generated 1332 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:49.407049 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3c8a5825-75a5-49d7-8471-bf44bd12d80e tempest-ServicesAdminTestJSON-1806532774 tempest-ServicesAdminTestJSON-1806532774-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:49.411163 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3c8a5825-75a5-49d7-8471-bf44bd12d80e tempest-ServicesAdminTestJSON-1806532774 tempest-ServicesAdminTestJSON-1806532774-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:49.412011 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3c8a5825-75a5-49d7-8471-bf44bd12d80e tempest-ServicesAdminTestJSON-1806532774 tempest-ServicesAdminTestJSON-1806532774-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:49.412637 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3c8a5825-75a5-49d7-8471-bf44bd12d80e tempest-ServicesAdminTestJSON-1806532774 tempest-ServicesAdminTestJSON-1806532774-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:49.413533 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3c8a5825-75a5-49d7-8471-bf44bd12d80e tempest-ServicesAdminTestJSON-1806532774 tempest-ServicesAdminTestJSON-1806532774-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:49.414263 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3c8a5825-75a5-49d7-8471-bf44bd12d80e tempest-ServicesAdminTestJSON-1806532774 tempest-ServicesAdminTestJSON-1806532774-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:49.415339 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3c8a5825-75a5-49d7-8471-bf44bd12d80e tempest-ServicesAdminTestJSON-1806532774 tempest-ServicesAdminTestJSON-1806532774-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:49.445039 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3c8a5825-75a5-49d7-8471-bf44bd12d80e tempest-ServicesAdminTestJSON-1806532774 tempest-ServicesAdminTestJSON-1806532774-project-admin] 10.222.0.61 "GET /compute/v2.1/os-services?host=n-d-850499-9" status: 200 len: 578 microversion: 2.1 time: 0.041529 Aug 31 15:58:49.446228 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 449/892] 10.222.0.61 () {58 vars in 1172 bytes} [Wed Aug 31 15:58:49 2022] GET /compute/v2.1/os-services?host=n-d-850499-9 => generated 578 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:58:49.451142 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2d606c05-6d00-435b-8c6b-4cfa76d23cf1 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:49.451973 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2d606c05-6d00-435b-8c6b-4cfa76d23cf1 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] [instance: 6c5b2996-bce3-4a39-88c7-2e300d06473e] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:49.460429 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2d606c05-6d00-435b-8c6b-4cfa76d23cf1 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:49.462060 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2d606c05-6d00-435b-8c6b-4cfa76d23cf1 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:49.462678 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2d606c05-6d00-435b-8c6b-4cfa76d23cf1 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:49.464177 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2d606c05-6d00-435b-8c6b-4cfa76d23cf1 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:49.464283 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2d606c05-6d00-435b-8c6b-4cfa76d23cf1 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:49.464852 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2d606c05-6d00-435b-8c6b-4cfa76d23cf1 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:49.469674 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=100 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:58:49.474883 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e4f02580-0f12-45ea-bc31-6d551383813f tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccce16c7fda401ea68fb31ea8099d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed252ebf7c741bbb36b553ac1767579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:49.483800 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e4f02580-0f12-45ea-bc31-6d551383813f tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "GET /compute/v2.1/servers/aa95066b-b1b8-43d8-8c5a-024e3890aa27" status: 200 len: 1520 microversion: 2.1 time: 0.215178 Aug 31 15:58:49.484802 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 444/893] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:49 2022] GET /compute/v2.1/servers/aa95066b-b1b8-43d8-8c5a-024e3890aa27 => generated 1520 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:49.490979 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d148a391-04fe-4ab9-903c-141c19f1319a tempest-ServicesAdminTestJSON-1806532774 tempest-ServicesAdminTestJSON-1806532774-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:49.495261 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d148a391-04fe-4ab9-903c-141c19f1319a tempest-ServicesAdminTestJSON-1806532774 tempest-ServicesAdminTestJSON-1806532774-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:49.495934 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d148a391-04fe-4ab9-903c-141c19f1319a tempest-ServicesAdminTestJSON-1806532774 tempest-ServicesAdminTestJSON-1806532774-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:49.497348 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d148a391-04fe-4ab9-903c-141c19f1319a tempest-ServicesAdminTestJSON-1806532774 tempest-ServicesAdminTestJSON-1806532774-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:49.498806 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d148a391-04fe-4ab9-903c-141c19f1319a tempest-ServicesAdminTestJSON-1806532774 tempest-ServicesAdminTestJSON-1806532774-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:49.499537 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d148a391-04fe-4ab9-903c-141c19f1319a tempest-ServicesAdminTestJSON-1806532774 tempest-ServicesAdminTestJSON-1806532774-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:49.500641 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d148a391-04fe-4ab9-903c-141c19f1319a tempest-ServicesAdminTestJSON-1806532774 tempest-ServicesAdminTestJSON-1806532774-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:49.530570 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d148a391-04fe-4ab9-903c-141c19f1319a tempest-ServicesAdminTestJSON-1806532774 tempest-ServicesAdminTestJSON-1806532774-project-admin] 10.222.0.61 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.043378 Aug 31 15:58:49.531474 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 445/894] 10.222.0.61 () {58 vars in 1176 bytes} [Wed Aug 31 15:58:49 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:58:49.536678 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8cf19ff0-9884-4715-90e4-6021aad3d332 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2093950984"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:58:49.541688 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8cf19ff0-9884-4715-90e4-6021aad3d332 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] [instance: aa95066b-b1b8-43d8-8c5a-024e3890aa27] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:49.548473 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8cf19ff0-9884-4715-90e4-6021aad3d332 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:49.549862 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8cf19ff0-9884-4715-90e4-6021aad3d332 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:49.550522 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8cf19ff0-9884-4715-90e4-6021aad3d332 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:49.551468 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8cf19ff0-9884-4715-90e4-6021aad3d332 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:49.552168 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8cf19ff0-9884-4715-90e4-6021aad3d332 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:49.552806 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8cf19ff0-9884-4715-90e4-6021aad3d332 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:49.658323 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2d606c05-6d00-435b-8c6b-4cfa76d23cf1 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a03cc5956ca477abacbe0c26bf18750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea45d1b678342ed812f9912e9f07503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:49.668085 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2d606c05-6d00-435b-8c6b-4cfa76d23cf1 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] 10.222.0.61 "GET /compute/v2.1/servers/6c5b2996-bce3-4a39-88c7-2e300d06473e" status: 200 len: 1314 microversion: 2.1 time: 0.220639 Aug 31 15:58:49.668668 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 450/895] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:49 2022] GET /compute/v2.1/servers/6c5b2996-bce3-4a39-88c7-2e300d06473e => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:49.677545 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6396fa45-8495-40ca-922a-c923bdcfc9d4 tempest-ServicesAdminTestJSON-1806532774 tempest-ServicesAdminTestJSON-1806532774-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:49.682215 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6396fa45-8495-40ca-922a-c923bdcfc9d4 tempest-ServicesAdminTestJSON-1806532774 tempest-ServicesAdminTestJSON-1806532774-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:49.682914 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6396fa45-8495-40ca-922a-c923bdcfc9d4 tempest-ServicesAdminTestJSON-1806532774 tempest-ServicesAdminTestJSON-1806532774-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:49.683675 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6396fa45-8495-40ca-922a-c923bdcfc9d4 tempest-ServicesAdminTestJSON-1806532774 tempest-ServicesAdminTestJSON-1806532774-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:49.684304 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6396fa45-8495-40ca-922a-c923bdcfc9d4 tempest-ServicesAdminTestJSON-1806532774 tempest-ServicesAdminTestJSON-1806532774-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:49.684769 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6396fa45-8495-40ca-922a-c923bdcfc9d4 tempest-ServicesAdminTestJSON-1806532774 tempest-ServicesAdminTestJSON-1806532774-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:49.685256 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6396fa45-8495-40ca-922a-c923bdcfc9d4 tempest-ServicesAdminTestJSON-1806532774 tempest-ServicesAdminTestJSON-1806532774-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:49.709745 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6396fa45-8495-40ca-922a-c923bdcfc9d4 tempest-ServicesAdminTestJSON-1806532774 tempest-ServicesAdminTestJSON-1806532774-project-admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.039831 Aug 31 15:58:49.710617 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 451/896] 10.222.0.61 () {58 vars in 1137 bytes} [Wed Aug 31 15:58:49 2022] GET /compute/v2.1/os-services => generated 944 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:58:49.793844 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8cf19ff0-9884-4715-90e4-6021aad3d332 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "POST /compute/v2.1/servers/aa95066b-b1b8-43d8-8c5a-024e3890aa27/action" status: 202 len: 0 microversion: 2.1 time: 0.260789 Aug 31 15:58:49.794782 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 446/897] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 15:58:49 2022] POST /compute/v2.1/servers/aa95066b-b1b8-43d8-8c5a-024e3890aa27/action => generated 0 bytes in 263 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 31 15:58:49.811365 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0349eae1-b808-4b12-9998-b6f1122a8660 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-24120835"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:58:49.813836 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0349eae1-b808-4b12-9998-b6f1122a8660 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] [instance: aa95066b-b1b8-43d8-8c5a-024e3890aa27] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:49.820708 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0349eae1-b808-4b12-9998-b6f1122a8660 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:49.821264 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0349eae1-b808-4b12-9998-b6f1122a8660 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:49.822165 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0349eae1-b808-4b12-9998-b6f1122a8660 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:49.822867 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0349eae1-b808-4b12-9998-b6f1122a8660 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:49.823328 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0349eae1-b808-4b12-9998-b6f1122a8660 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:49.824075 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0349eae1-b808-4b12-9998-b6f1122a8660 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:49.857536 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-0349eae1-b808-4b12-9998-b6f1122a8660 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] HTTP exception thrown: Cannot 'createImage' instance aa95066b-b1b8-43d8-8c5a-024e3890aa27 while it is in task_state image_snapshot_pending Aug 31 15:58:49.859265 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0349eae1-b808-4b12-9998-b6f1122a8660 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Request method failure captured: Aug 31 15:58:49.859265 n-d-850499-9 devstack@n-api.service[122257]: request: POST /compute/v2.1/servers/aa95066b-b1b8-43d8-8c5a-024e3890aa27/action HTTP/1.1 Aug 31 15:58:49.859265 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 15:58:49.859265 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 15:58:49.859265 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 15:58:49.859265 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 83 Aug 31 15:58:49.859265 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 15:58:49.859265 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 15:58:49.859265 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 15:58:49.859265 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 15:58:49.859265 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4UcGHO9gatUvWJBB907oWawoQP70h6HsJbsny_eFggCHTOgqUkoCg1AvAVcAHjORdEbkXL7xp_g0w0MdWTsQsxdtQLftyhBkZlCr9g7XUi02ZEumxE15kVflv1oC3aQIZmyWr_qGIamtOyoWvoJnlxnc8ckdznU53DKuHgbDBtijYA Aug 31 15:58:49.859265 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 15:58:49.859265 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 15:58:49.859265 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 15:58:49.859265 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 15:58:49.859265 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 15:58:49.859265 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 15:58:49.859265 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 7ed252ebf7c741bbb36b553ac1767579 Aug 31 15:58:49.859265 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-977175069 Aug 31 15:58:49.859265 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 15:58:49.859265 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 15:58:49.860944 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7ed252ebf7c741bbb36b553ac1767579"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7ed252ebf7c741bbb36b553ac1767579"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7ed252ebf7c741bbb36b553ac1767579", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7ed252ebf7c741bbb36b553ac1767579"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 15:58:49.860944 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-977175069 Aug 31 15:58:49.860944 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 7ed252ebf7c741bbb36b553ac1767579 Aug 31 15:58:49.860944 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-977175069 Aug 31 15:58:49.860944 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ImagesOneServerNegativeTestJSON-977175069-project Aug 31 15:58:49.860944 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 15:58:49.860944 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 15:58:49.860944 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 3ccce16c7fda401ea68fb31ea8099d78 Aug 31 15:58:49.860944 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-977175069-project Aug 31 15:58:49.860944 n-d-850499-9 devstack@n-api.service[122257]: Aug 31 15:58:49.860944 n-d-850499-9 devstack@n-api.service[122257]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-24120835"}} Aug 31 15:58:49.860944 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 15:58:49.864076 n-d-850499-9 devstack@n-api.service[122257]: exception: Cannot 'createImage' instance aa95066b-b1b8-43d8-8c5a-024e3890aa27 while it is in task_state image_snapshot_pending Aug 31 15:58:49.864076 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': 'aa95066b-b1b8-43d8-8c5a-024e3890aa27', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-24120835'}}} Aug 31 15:58:49.864076 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:58:49.864076 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:58:49.864076 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1346, in _action_create_image Aug 31 15:58:49.864076 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Aug 31 15:58:49.864076 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Aug 31 15:58:49.864076 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 31 15:58:49.864076 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance aa95066b-b1b8-43d8-8c5a-024e3890aa27 in task_state image_snapshot_pending. Cannot snapshot while the instance is in this state. Aug 31 15:58:49.864076 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:58:49.864076 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:58:49.864076 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:58:49.864076 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:58:49.864076 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:58:49.864076 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:58:49.864076 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:58:49.864076 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:58:49.864076 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:58:49.864076 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:58:49.865483 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:58:49.865483 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:58:49.865483 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:58:49.865483 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:58:49.865483 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1351, in _action_create_image Aug 31 15:58:49.865483 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 31 15:58:49.865483 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 31 15:58:49.865483 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 31 15:58:49.865483 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance aa95066b-b1b8-43d8-8c5a-024e3890aa27 while it is in task_state image_snapshot_pending Aug 31 15:58:49.865483 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:58:49.865483 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:58:49.865483 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:58:49.865483 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:58:49.865483 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:58:49.865483 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:58:49.865483 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:58:49.865483 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:58:49.865483 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance aa95066b-b1b8-43d8-8c5a-024e3890aa27 while it is in task_state image_snapshot_pending Aug 31 15:58:49.865483 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:58:49.866901 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0349eae1-b808-4b12-9998-b6f1122a8660 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Returning 409 to user: Cannot 'createImage' instance aa95066b-b1b8-43d8-8c5a-024e3890aa27 while it is in task_state image_snapshot_pending {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:58:49.866901 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0349eae1-b808-4b12-9998-b6f1122a8660 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "POST /compute/v2.1/servers/aa95066b-b1b8-43d8-8c5a-024e3890aa27/action" status: 409 len: 167 microversion: 2.1 time: 0.054378 Aug 31 15:58:49.866901 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 452/898] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 15:58:49 2022] POST /compute/v2.1/servers/aa95066b-b1b8-43d8-8c5a-024e3890aa27/action => generated 167 bytes in 56 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 31 15:58:49.871595 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e44cc520-8d9b-473e-9140-5493c0ec5b54 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Calling method '.version_select at 0x7f5ae92bb4c0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:50.014228 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-858643ef-aefb-4774-9e39-d1ebcec483bf tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:50.015046 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-858643ef-aefb-4774-9e39-d1ebcec483bf tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:50.015374 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e44cc520-8d9b-473e-9140-5493c0ec5b54 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "DELETE /compute/v2.1/images/cb50edd6-bef0-4d08-a365-0022bfcca565" status: 204 len: 0 microversion: 2.1 time: 0.149274 Aug 31 15:58:50.016281 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 447/899] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:49 2022] DELETE /compute/v2.1/images/cb50edd6-bef0-4d08-a365-0022bfcca565 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 15:58:50.022814 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-25513513-8cdd-4f49-a653-03074876228a tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:50.024250 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-25513513-8cdd-4f49-a653-03074876228a tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 8555b294-db38-4246-ac58-035cb2acc70e] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:50.026399 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-858643ef-aefb-4774-9e39-d1ebcec483bf tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:50.027099 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-858643ef-aefb-4774-9e39-d1ebcec483bf tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:50.027748 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-858643ef-aefb-4774-9e39-d1ebcec483bf tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:50.028768 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-858643ef-aefb-4774-9e39-d1ebcec483bf tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:50.029456 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-858643ef-aefb-4774-9e39-d1ebcec483bf tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:50.030111 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-858643ef-aefb-4774-9e39-d1ebcec483bf tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:50.031235 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-25513513-8cdd-4f49-a653-03074876228a tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:50.031828 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-25513513-8cdd-4f49-a653-03074876228a tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:50.032277 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-25513513-8cdd-4f49-a653-03074876228a tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:50.033157 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-25513513-8cdd-4f49-a653-03074876228a tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:50.033624 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-25513513-8cdd-4f49-a653-03074876228a tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:50.034059 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-25513513-8cdd-4f49-a653-03074876228a tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:50.125826 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-858643ef-aefb-4774-9e39-d1ebcec483bf tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:50.140449 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-858643ef-aefb-4774-9e39-d1ebcec483bf tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:50.143921 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-858643ef-aefb-4774-9e39-d1ebcec483bf tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:50.153365 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-858643ef-aefb-4774-9e39-d1ebcec483bf tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1539 microversion: 2.91 time: 0.146869 Aug 31 15:58:50.160911 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 453/900] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:58:50 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1539 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:50.175839 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6107c924-1ca0-4bd8-83bd-50e08c077a4e tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:50.177831 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6107c924-1ca0-4bd8-83bd-50e08c077a4e tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] [instance: aa95066b-b1b8-43d8-8c5a-024e3890aa27] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:50.186608 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6107c924-1ca0-4bd8-83bd-50e08c077a4e tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:50.187450 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6107c924-1ca0-4bd8-83bd-50e08c077a4e tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:50.187911 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6107c924-1ca0-4bd8-83bd-50e08c077a4e tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:50.188613 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6107c924-1ca0-4bd8-83bd-50e08c077a4e tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:50.189312 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6107c924-1ca0-4bd8-83bd-50e08c077a4e tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:50.189679 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6107c924-1ca0-4bd8-83bd-50e08c077a4e tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:50.355074 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-25513513-8cdd-4f49-a653-03074876228a tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:50.364504 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-25513513-8cdd-4f49-a653-03074876228a tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:50.366140 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-25513513-8cdd-4f49-a653-03074876228a tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:50.367606 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-25513513-8cdd-4f49-a653-03074876228a tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/8555b294-db38-4246-ac58-035cb2acc70e" status: 200 len: 1567 microversion: 2.25 time: 0.350236 Aug 31 15:58:50.371780 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 448/901] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:58:50 2022] GET /compute/v2.1/servers/8555b294-db38-4246-ac58-035cb2acc70e => generated 1567 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:50.413850 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-6107c924-1ca0-4bd8-83bd-50e08c077a4e tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccce16c7fda401ea68fb31ea8099d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed252ebf7c741bbb36b553ac1767579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:50.423402 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6107c924-1ca0-4bd8-83bd-50e08c077a4e tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "GET /compute/v2.1/servers/aa95066b-b1b8-43d8-8c5a-024e3890aa27" status: 200 len: 1540 microversion: 2.1 time: 0.260948 Aug 31 15:58:50.427693 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 454/902] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:50 2022] GET /compute/v2.1/servers/aa95066b-b1b8-43d8-8c5a-024e3890aa27 => generated 1540 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:50.441383 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6d9ce8f0-eafe-4a0f-a99b-25e2a6c56548 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:50.442861 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6d9ce8f0-eafe-4a0f-a99b-25e2a6c56548 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] [instance: 5de5737d-bcc8-4357-85f0-f4468ac84bc7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:50.452702 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6d9ce8f0-eafe-4a0f-a99b-25e2a6c56548 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:50.453946 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6d9ce8f0-eafe-4a0f-a99b-25e2a6c56548 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:50.454702 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6d9ce8f0-eafe-4a0f-a99b-25e2a6c56548 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:50.455690 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6d9ce8f0-eafe-4a0f-a99b-25e2a6c56548 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:50.457000 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6d9ce8f0-eafe-4a0f-a99b-25e2a6c56548 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:50.457433 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6d9ce8f0-eafe-4a0f-a99b-25e2a6c56548 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:50.676379 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-00d8ce4a-9c39-4b01-be84-eb056aed66f0 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-948005621", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "networks": [{"uuid": "c780b733-916d-48a3-99f1-727aee35e4fb"}], "security_groups": [{"name": "tempest-securitygroup--2128622841"}], "key_name": "tempest-keypair-1523154201", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:58:50.700707 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-6d9ce8f0-eafe-4a0f-a99b-25e2a6c56548 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a5652ccb7b54cf7a56f25b91c30c904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5746b9f74e4fecbf2da098436f2ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:50.732198 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6d9ce8f0-eafe-4a0f-a99b-25e2a6c56548 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] 10.222.0.61 "GET /compute/v2.1/servers/5de5737d-bcc8-4357-85f0-f4468ac84bc7" status: 200 len: 1332 microversion: 2.1 time: 0.302752 Aug 31 15:58:50.738556 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 449/903] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:50 2022] GET /compute/v2.1/servers/5de5737d-bcc8-4357-85f0-f4468ac84bc7 => generated 1332 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:58:50.749309 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1df1ed51-7fcd-43d5-aae9-7e957bbff643 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:50.749865 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1df1ed51-7fcd-43d5-aae9-7e957bbff643 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] [instance: 6c5b2996-bce3-4a39-88c7-2e300d06473e] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:50.769268 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1df1ed51-7fcd-43d5-aae9-7e957bbff643 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:50.770138 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1df1ed51-7fcd-43d5-aae9-7e957bbff643 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:50.771081 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1df1ed51-7fcd-43d5-aae9-7e957bbff643 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:50.772537 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1df1ed51-7fcd-43d5-aae9-7e957bbff643 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:50.775932 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1df1ed51-7fcd-43d5-aae9-7e957bbff643 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:50.778763 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1df1ed51-7fcd-43d5-aae9-7e957bbff643 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:50.944174 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-00d8ce4a-9c39-4b01-be84-eb056aed66f0 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] validate_networks() for [('c780b733-916d-48a3-99f1-727aee35e4fb', None, None, None, None, None)] {{(pid=122257) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 15:58:51.064022 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1df1ed51-7fcd-43d5-aae9-7e957bbff643 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a03cc5956ca477abacbe0c26bf18750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea45d1b678342ed812f9912e9f07503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:51.073443 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1df1ed51-7fcd-43d5-aae9-7e957bbff643 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] 10.222.0.61 "GET /compute/v2.1/servers/6c5b2996-bce3-4a39-88c7-2e300d06473e" status: 200 len: 1463 microversion: 2.1 time: 0.333421 Aug 31 15:58:51.074544 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 450/904] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:50 2022] GET /compute/v2.1/servers/6c5b2996-bce3-4a39-88c7-2e300d06473e => generated 1463 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:51.517343 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a6a62fd9-fc6e-4020-83c7-a9235837d9e3 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:51.524118 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a6a62fd9-fc6e-4020-83c7-a9235837d9e3 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Searching by: {'deleted': False, 'project_id': '8b41ce40942c401f9a33634873dbfc99'} {{(pid=122256) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 15:58:51.532320 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a6a62fd9-fc6e-4020-83c7-a9235837d9e3 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:51.533073 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a6a62fd9-fc6e-4020-83c7-a9235837d9e3 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:51.533756 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a6a62fd9-fc6e-4020-83c7-a9235837d9e3 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:51.534754 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a6a62fd9-fc6e-4020-83c7-a9235837d9e3 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:51.535725 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a6a62fd9-fc6e-4020-83c7-a9235837d9e3 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:51.536680 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a6a62fd9-fc6e-4020-83c7-a9235837d9e3 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:51.547047 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-00d8ce4a-9c39-4b01-be84-eb056aed66f0 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 15:58:51.547691 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-00d8ce4a-9c39-4b01-be84-eb056aed66f0 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 15:58:51.548342 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-00d8ce4a-9c39-4b01-be84-eb056aed66f0 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 15:58:51.549991 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-00d8ce4a-9c39-4b01-be84-eb056aed66f0 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 15:58:51.551037 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-00d8ce4a-9c39-4b01-be84-eb056aed66f0 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 15:58:51.562673 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-00d8ce4a-9c39-4b01-be84-eb056aed66f0 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:51.563423 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-00d8ce4a-9c39-4b01-be84-eb056aed66f0 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:51.564761 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-00d8ce4a-9c39-4b01-be84-eb056aed66f0 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:51.565734 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-00d8ce4a-9c39-4b01-be84-eb056aed66f0 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:51.566383 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-00d8ce4a-9c39-4b01-be84-eb056aed66f0 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:51.567052 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-00d8ce4a-9c39-4b01-be84-eb056aed66f0 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:51.610950 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-00d8ce4a-9c39-4b01-be84-eb056aed66f0 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Getting quotas for project 150e5f8e376a40e089de8ed092e269fd. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:58:51.628497 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-00d8ce4a-9c39-4b01-be84-eb056aed66f0 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Getting quotas for user de0e032fc09b48ada1dfe99e549aa623 and project 150e5f8e376a40e089de8ed092e269fd. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:58:51.696064 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a6a62fd9-fc6e-4020-83c7-a9235837d9e3 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.594614 Aug 31 15:58:51.701876 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-00d8ce4a-9c39-4b01-be84-eb056aed66f0 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Going to run 1 instances... {{(pid=122257) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 15:58:51.708982 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-00d8ce4a-9c39-4b01-be84-eb056aed66f0 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: cc085aaa-21b2-48a6-b69c-de4e261dfe7f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 15:58:51.713623 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 451/905] 10.222.0.61 () {58 vars in 1146 bytes} [Wed Aug 31 15:58:51 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 15:58:51.726331 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-59b741e4-8d70-40de-adc9-69acf4598ce6 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:51.728509 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-59b741e4-8d70-40de-adc9-69acf4598ce6 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:51.736755 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-59b741e4-8d70-40de-adc9-69acf4598ce6 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:51.737551 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-59b741e4-8d70-40de-adc9-69acf4598ce6 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:51.738196 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-59b741e4-8d70-40de-adc9-69acf4598ce6 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:51.739155 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-59b741e4-8d70-40de-adc9-69acf4598ce6 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:51.739807 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-59b741e4-8d70-40de-adc9-69acf4598ce6 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:51.740405 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-59b741e4-8d70-40de-adc9-69acf4598ce6 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:51.752010 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:58:51.810398 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-00d8ce4a-9c39-4b01-be84-eb056aed66f0 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.139354 Aug 31 15:58:51.817398 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 455/906] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 15:58:50 2022] POST /compute/v2.1/servers => generated 406 bytes in 1147 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 15:58:51.823839 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2f10cc1c-2958-44f0-8362-850b54a4865c tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:51.824723 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2f10cc1c-2958-44f0-8362-850b54a4865c tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 8555b294-db38-4246-ac58-035cb2acc70e] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:51.832262 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2f10cc1c-2958-44f0-8362-850b54a4865c tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:51.833055 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2f10cc1c-2958-44f0-8362-850b54a4865c tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:51.833657 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2f10cc1c-2958-44f0-8362-850b54a4865c tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:51.834567 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2f10cc1c-2958-44f0-8362-850b54a4865c tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:51.835183 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2f10cc1c-2958-44f0-8362-850b54a4865c tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:51.835809 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2f10cc1c-2958-44f0-8362-850b54a4865c tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:51.874125 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-59b741e4-8d70-40de-adc9-69acf4598ce6 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:51.888608 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-59b741e4-8d70-40de-adc9-69acf4598ce6 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:51.890988 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-59b741e4-8d70-40de-adc9-69acf4598ce6 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:51.900076 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-59b741e4-8d70-40de-adc9-69acf4598ce6 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1539 microversion: 2.91 time: 0.183763 Aug 31 15:58:51.901138 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 452/907] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:58:51 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1539 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:51.908812 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4bcd361f-8559-4079-87d6-032e16a67439 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:51.909946 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4bcd361f-8559-4079-87d6-032e16a67439 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] [instance: aa95066b-b1b8-43d8-8c5a-024e3890aa27] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:51.922279 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4bcd361f-8559-4079-87d6-032e16a67439 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:51.923740 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4bcd361f-8559-4079-87d6-032e16a67439 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:51.924391 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4bcd361f-8559-4079-87d6-032e16a67439 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:51.926033 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4bcd361f-8559-4079-87d6-032e16a67439 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:51.927235 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4bcd361f-8559-4079-87d6-032e16a67439 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:51.928150 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4bcd361f-8559-4079-87d6-032e16a67439 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:52.341169 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2f10cc1c-2958-44f0-8362-850b54a4865c tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:52.350750 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2f10cc1c-2958-44f0-8362-850b54a4865c tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:52.358021 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2f10cc1c-2958-44f0-8362-850b54a4865c tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:52.359686 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2f10cc1c-2958-44f0-8362-850b54a4865c tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/8555b294-db38-4246-ac58-035cb2acc70e" status: 200 len: 1567 microversion: 2.25 time: 0.540987 Aug 31 15:58:52.360390 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 456/908] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:58:51 2022] GET /compute/v2.1/servers/8555b294-db38-4246-ac58-035cb2acc70e => generated 1567 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:52.371878 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b3711054-fbf4-4958-a483-f8f4b5c16887 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:52.380190 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b3711054-fbf4-4958-a483-f8f4b5c16887 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Searching by: {'deleted': False} {{(pid=122257) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 15:58:52.395164 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b3711054-fbf4-4958-a483-f8f4b5c16887 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:52.396416 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b3711054-fbf4-4958-a483-f8f4b5c16887 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:52.397647 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b3711054-fbf4-4958-a483-f8f4b5c16887 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:52.397847 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-4bcd361f-8559-4079-87d6-032e16a67439 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccce16c7fda401ea68fb31ea8099d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed252ebf7c741bbb36b553ac1767579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:52.398869 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b3711054-fbf4-4958-a483-f8f4b5c16887 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:52.399719 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b3711054-fbf4-4958-a483-f8f4b5c16887 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:52.400345 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b3711054-fbf4-4958-a483-f8f4b5c16887 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:52.408660 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4bcd361f-8559-4079-87d6-032e16a67439 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "GET /compute/v2.1/servers/aa95066b-b1b8-43d8-8c5a-024e3890aa27" status: 200 len: 1532 microversion: 2.1 time: 0.505815 Aug 31 15:58:52.409281 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 453/909] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:51 2022] GET /compute/v2.1/servers/aa95066b-b1b8-43d8-8c5a-024e3890aa27 => generated 1532 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:52.418271 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-529762d1-70ab-46fa-ae6d-9dafeaba5e43 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:52.418909 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-529762d1-70ab-46fa-ae6d-9dafeaba5e43 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] [instance: 5de5737d-bcc8-4357-85f0-f4468ac84bc7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:52.440678 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-529762d1-70ab-46fa-ae6d-9dafeaba5e43 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:52.441193 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-529762d1-70ab-46fa-ae6d-9dafeaba5e43 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:52.441744 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-529762d1-70ab-46fa-ae6d-9dafeaba5e43 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:52.443189 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-529762d1-70ab-46fa-ae6d-9dafeaba5e43 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:52.443189 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-529762d1-70ab-46fa-ae6d-9dafeaba5e43 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:52.443446 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-529762d1-70ab-46fa-ae6d-9dafeaba5e43 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:52.575065 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.multi_cell_list [None req-b3711054-fbf4-4958-a483-f8f4b5c16887 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Listed batch of 11 results from cell out of 999 limit. Returned 11 total so far. {{(pid=122257) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 31 15:58:52.733273 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b3711054-fbf4-4958-a483-f8f4b5c16887 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:52.733698 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b3711054-fbf4-4958-a483-f8f4b5c16887 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:52.734317 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b3711054-fbf4-4958-a483-f8f4b5c16887 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:52.952771 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-529762d1-70ab-46fa-ae6d-9dafeaba5e43 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a5652ccb7b54cf7a56f25b91c30c904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5746b9f74e4fecbf2da098436f2ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:52.963407 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-529762d1-70ab-46fa-ae6d-9dafeaba5e43 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] 10.222.0.61 "GET /compute/v2.1/servers/5de5737d-bcc8-4357-85f0-f4468ac84bc7" status: 200 len: 1332 microversion: 2.1 time: 0.553082 Aug 31 15:58:52.978452 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 454/910] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:52 2022] GET /compute/v2.1/servers/5de5737d-bcc8-4357-85f0-f4468ac84bc7 => generated 1332 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:52.985454 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-eae724ba-1f8b-4658-b3d9-f07c95cf4e50 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:52.986509 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-eae724ba-1f8b-4658-b3d9-f07c95cf4e50 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: cc085aaa-21b2-48a6-b69c-de4e261dfe7f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:52.993761 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eae724ba-1f8b-4658-b3d9-f07c95cf4e50 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:52.994499 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eae724ba-1f8b-4658-b3d9-f07c95cf4e50 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:52.995194 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eae724ba-1f8b-4658-b3d9-f07c95cf4e50 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:52.996155 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eae724ba-1f8b-4658-b3d9-f07c95cf4e50 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:52.996821 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eae724ba-1f8b-4658-b3d9-f07c95cf4e50 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:52.997470 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eae724ba-1f8b-4658-b3d9-f07c95cf4e50 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:53.126488 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-eae724ba-1f8b-4658-b3d9-f07c95cf4e50 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:53.137588 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-eae724ba-1f8b-4658-b3d9-f07c95cf4e50 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f" status: 200 len: 1238 microversion: 2.1 time: 0.157747 Aug 31 15:58:53.142470 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 455/911] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:52 2022] GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f => generated 1238 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:53.151316 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8cc4803d-6ab6-4414-8411-3096a09ea7dc tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:53.152005 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8cc4803d-6ab6-4414-8411-3096a09ea7dc tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:53.158980 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8cc4803d-6ab6-4414-8411-3096a09ea7dc tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:53.159473 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8cc4803d-6ab6-4414-8411-3096a09ea7dc tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:53.159939 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8cc4803d-6ab6-4414-8411-3096a09ea7dc tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:53.160652 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8cc4803d-6ab6-4414-8411-3096a09ea7dc tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:53.161096 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8cc4803d-6ab6-4414-8411-3096a09ea7dc tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:53.161522 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8cc4803d-6ab6-4414-8411-3096a09ea7dc tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:53.496817 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8cc4803d-6ab6-4414-8411-3096a09ea7dc tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:53.510743 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8cc4803d-6ab6-4414-8411-3096a09ea7dc tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:53.513474 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8cc4803d-6ab6-4414-8411-3096a09ea7dc tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:53.521022 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8cc4803d-6ab6-4414-8411-3096a09ea7dc tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1539 microversion: 2.91 time: 0.377480 Aug 31 15:58:53.522567 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 456/912] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:58:53 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1539 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:53.529046 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5285c2b7-3b3f-4b6a-9845-61f998ed14ed tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:53.529794 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5285c2b7-3b3f-4b6a-9845-61f998ed14ed tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 8555b294-db38-4246-ac58-035cb2acc70e] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:53.535706 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5285c2b7-3b3f-4b6a-9845-61f998ed14ed tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:53.536201 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5285c2b7-3b3f-4b6a-9845-61f998ed14ed tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:53.536629 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5285c2b7-3b3f-4b6a-9845-61f998ed14ed tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:53.537505 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5285c2b7-3b3f-4b6a-9845-61f998ed14ed tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:53.538108 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5285c2b7-3b3f-4b6a-9845-61f998ed14ed tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:53.538679 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5285c2b7-3b3f-4b6a-9845-61f998ed14ed tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:53.965194 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b3711054-fbf4-4958-a483-f8f4b5c16887 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 19189 microversion: 2.1 time: 1.599834 Aug 31 15:58:53.966015 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 457/913] 10.222.0.61 () {58 vars in 1171 bytes} [Wed Aug 31 15:58:52 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 19189 bytes in 1605 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 15:58:53.972960 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-142c26f8-525e-49b6-ae7d-6644f9750e8c tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:53.974040 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-142c26f8-525e-49b6-ae7d-6644f9750e8c tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] [instance: aa95066b-b1b8-43d8-8c5a-024e3890aa27] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:53.983299 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-142c26f8-525e-49b6-ae7d-6644f9750e8c tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:53.984219 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-142c26f8-525e-49b6-ae7d-6644f9750e8c tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:53.984812 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-142c26f8-525e-49b6-ae7d-6644f9750e8c tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:53.985833 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-142c26f8-525e-49b6-ae7d-6644f9750e8c tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:53.986440 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-142c26f8-525e-49b6-ae7d-6644f9750e8c tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:53.987013 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-142c26f8-525e-49b6-ae7d-6644f9750e8c tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:54.002693 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5285c2b7-3b3f-4b6a-9845-61f998ed14ed tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:54.013521 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:58:54.021583 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5285c2b7-3b3f-4b6a-9845-61f998ed14ed tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:54.024112 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5285c2b7-3b3f-4b6a-9845-61f998ed14ed tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:54.025338 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5285c2b7-3b3f-4b6a-9845-61f998ed14ed tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/8555b294-db38-4246-ac58-035cb2acc70e" status: 200 len: 1567 microversion: 2.25 time: 0.501362 Aug 31 15:58:54.025908 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 457/914] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:58:53 2022] GET /compute/v2.1/servers/8555b294-db38-4246-ac58-035cb2acc70e => generated 1567 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:54.050809 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2534e417-11a7-41fd-b275-bd92549747c6 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:54.057618 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2534e417-11a7-41fd-b275-bd92549747c6 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] [instance: 5de5737d-bcc8-4357-85f0-f4468ac84bc7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:54.075678 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2534e417-11a7-41fd-b275-bd92549747c6 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:54.076270 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2534e417-11a7-41fd-b275-bd92549747c6 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:54.077359 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2534e417-11a7-41fd-b275-bd92549747c6 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:54.078102 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2534e417-11a7-41fd-b275-bd92549747c6 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:54.078579 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2534e417-11a7-41fd-b275-bd92549747c6 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:54.079020 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2534e417-11a7-41fd-b275-bd92549747c6 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:54.216595 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-142c26f8-525e-49b6-ae7d-6644f9750e8c tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccce16c7fda401ea68fb31ea8099d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed252ebf7c741bbb36b553ac1767579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:54.225329 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-142c26f8-525e-49b6-ae7d-6644f9750e8c tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "GET /compute/v2.1/servers/aa95066b-b1b8-43d8-8c5a-024e3890aa27" status: 200 len: 1538 microversion: 2.1 time: 0.257612 Aug 31 15:58:54.241167 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 458/915] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:53 2022] GET /compute/v2.1/servers/aa95066b-b1b8-43d8-8c5a-024e3890aa27 => generated 1538 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:54.247542 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-942506a3-d723-4def-a05f-3c4db728964e tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:54.252778 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-942506a3-d723-4def-a05f-3c4db728964e tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Searching by: {'deleted': False, 'project_id': '8b41ce40942c401f9a33634873dbfc99'} {{(pid=122257) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 15:58:54.258595 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-942506a3-d723-4def-a05f-3c4db728964e tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:54.259321 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-942506a3-d723-4def-a05f-3c4db728964e tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:54.259983 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-942506a3-d723-4def-a05f-3c4db728964e tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:54.260918 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-942506a3-d723-4def-a05f-3c4db728964e tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:54.261639 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-942506a3-d723-4def-a05f-3c4db728964e tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:54.262078 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-942506a3-d723-4def-a05f-3c4db728964e tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:54.276575 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-2534e417-11a7-41fd-b275-bd92549747c6 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a5652ccb7b54cf7a56f25b91c30c904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5746b9f74e4fecbf2da098436f2ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:54.286280 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2534e417-11a7-41fd-b275-bd92549747c6 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] 10.222.0.61 "GET /compute/v2.1/servers/5de5737d-bcc8-4357-85f0-f4468ac84bc7" status: 200 len: 1332 microversion: 2.1 time: 0.259293 Aug 31 15:58:54.286938 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 458/916] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:54 2022] GET /compute/v2.1/servers/5de5737d-bcc8-4357-85f0-f4468ac84bc7 => generated 1332 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:54.304319 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d55c8af6-4f7a-402e-9cfe-97c3e0c2d170 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:54.305326 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d55c8af6-4f7a-402e-9cfe-97c3e0c2d170 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: cc085aaa-21b2-48a6-b69c-de4e261dfe7f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:54.314106 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d55c8af6-4f7a-402e-9cfe-97c3e0c2d170 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:54.314602 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d55c8af6-4f7a-402e-9cfe-97c3e0c2d170 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:54.319973 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d55c8af6-4f7a-402e-9cfe-97c3e0c2d170 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:54.323821 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d55c8af6-4f7a-402e-9cfe-97c3e0c2d170 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:54.325587 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d55c8af6-4f7a-402e-9cfe-97c3e0c2d170 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:54.326047 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d55c8af6-4f7a-402e-9cfe-97c3e0c2d170 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:54.404977 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-942506a3-d723-4def-a05f-3c4db728964e tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/detail?tenant_id=1ea45d1b678342ed812f9912e9f07503" status: 200 len: 15 microversion: 2.1 time: 0.161578 Aug 31 15:58:54.406551 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 459/917] 10.222.0.61 () {58 vars in 1231 bytes} [Wed Aug 31 15:58:54 2022] GET /compute/v2.1/servers/detail?tenant_id=1ea45d1b678342ed812f9912e9f07503 => generated 15 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 15:58:54.421739 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d55c8af6-4f7a-402e-9cfe-97c3e0c2d170 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:54.434577 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-75cc4592-34c7-4b53-9198-fd733f9d8ec2 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:54.435439 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d55c8af6-4f7a-402e-9cfe-97c3e0c2d170 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f" status: 200 len: 1286 microversion: 2.1 time: 0.147441 Aug 31 15:58:54.436915 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 459/918] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:54 2022] GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f => generated 1286 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:54.441955 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-75cc4592-34c7-4b53-9198-fd733f9d8ec2 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Searching by: {'tenant_id': '1ea45d1b678342ed812f9912e9f07503', 'deleted': False} {{(pid=122257) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 15:58:54.449333 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-75cc4592-34c7-4b53-9198-fd733f9d8ec2 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:54.450049 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-75cc4592-34c7-4b53-9198-fd733f9d8ec2 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:54.450647 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-75cc4592-34c7-4b53-9198-fd733f9d8ec2 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:54.451453 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-75cc4592-34c7-4b53-9198-fd733f9d8ec2 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:54.451938 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-75cc4592-34c7-4b53-9198-fd733f9d8ec2 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:54.452368 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-75cc4592-34c7-4b53-9198-fd733f9d8ec2 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:54.503779 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.multi_cell_list [None req-75cc4592-34c7-4b53-9198-fd733f9d8ec2 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122257) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 31 15:58:54.521679 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-1469c6e5-c3c9-40ef-a24d-4a8bcbe81ec8 req-ca8c43c5-adc3-4401-8c8b-7a7b2e9a4b8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5de5737d-bcc8-4357-85f0-f4468ac84bc7", "name": "network-vif-plugged", "status": "completed", "tag": "860bd128-aaa5-4d35-b493-f0871fc78fdb"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:58:54.533692 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-1469c6e5-c3c9-40ef-a24d-4a8bcbe81ec8 req-ca8c43c5-adc3-4401-8c8b-7a7b2e9a4b8c service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:54.534541 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-1469c6e5-c3c9-40ef-a24d-4a8bcbe81ec8 req-ca8c43c5-adc3-4401-8c8b-7a7b2e9a4b8c service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:54.535558 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-1469c6e5-c3c9-40ef-a24d-4a8bcbe81ec8 req-ca8c43c5-adc3-4401-8c8b-7a7b2e9a4b8c service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:54.549856 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-1469c6e5-c3c9-40ef-a24d-4a8bcbe81ec8 req-ca8c43c5-adc3-4401-8c8b-7a7b2e9a4b8c service nova] Creating event network-vif-plugged:860bd128-aaa5-4d35-b493-f0871fc78fdb for instance 5de5737d-bcc8-4357-85f0-f4468ac84bc7 on n-h1-850499-9 Aug 31 15:58:54.556813 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-1469c6e5-c3c9-40ef-a24d-4a8bcbe81ec8 req-ca8c43c5-adc3-4401-8c8b-7a7b2e9a4b8c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038666 Aug 31 15:58:54.559817 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 460/919] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 15:58:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:58:54.565616 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-486465f5-c220-4713-a140-158f79310fa1 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:54.566745 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-486465f5-c220-4713-a140-158f79310fa1 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:54.574298 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-486465f5-c220-4713-a140-158f79310fa1 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:54.575308 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-486465f5-c220-4713-a140-158f79310fa1 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:54.576073 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-486465f5-c220-4713-a140-158f79310fa1 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:54.577183 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-486465f5-c220-4713-a140-158f79310fa1 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:54.577867 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-486465f5-c220-4713-a140-158f79310fa1 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:54.578532 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-486465f5-c220-4713-a140-158f79310fa1 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:54.722705 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-75cc4592-34c7-4b53-9198-fd733f9d8ec2 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:54.723204 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-75cc4592-34c7-4b53-9198-fd733f9d8ec2 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:54.723687 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-75cc4592-34c7-4b53-9198-fd733f9d8ec2 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:54.779675 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-486465f5-c220-4713-a140-158f79310fa1 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:54.794978 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-486465f5-c220-4713-a140-158f79310fa1 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:54.799401 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-486465f5-c220-4713-a140-158f79310fa1 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:54.807364 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-486465f5-c220-4713-a140-158f79310fa1 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1539 microversion: 2.91 time: 0.245934 Aug 31 15:58:54.826138 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 461/920] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:58:54 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1539 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:55.025054 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-75cc4592-34c7-4b53-9198-fd733f9d8ec2 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=1ea45d1b678342ed812f9912e9f07503" status: 200 len: 4826 microversion: 2.1 time: 0.597638 Aug 31 15:58:55.026131 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 460/921] 10.222.0.61 () {58 vars in 1257 bytes} [Wed Aug 31 15:58:54 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=1ea45d1b678342ed812f9912e9f07503 => generated 4826 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:55.050421 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6c58349b-1e4c-4d86-b781-2b45eb0c3ee5 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:55.052999 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3d249226-ed84-41bf-b5b3-df9a25c315f6 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:55.055193 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3d249226-ed84-41bf-b5b3-df9a25c315f6 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 8555b294-db38-4246-ac58-035cb2acc70e] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:55.060585 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6c58349b-1e4c-4d86-b781-2b45eb0c3ee5 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Searching by: {'tenant_id': '8b41ce40942c401f9a33634873dbfc99', 'deleted': False} {{(pid=122257) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 15:58:55.063852 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3d249226-ed84-41bf-b5b3-df9a25c315f6 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:55.066075 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3d249226-ed84-41bf-b5b3-df9a25c315f6 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:55.067874 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3d249226-ed84-41bf-b5b3-df9a25c315f6 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:55.072406 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3d249226-ed84-41bf-b5b3-df9a25c315f6 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:55.073276 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3d249226-ed84-41bf-b5b3-df9a25c315f6 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:55.074588 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3d249226-ed84-41bf-b5b3-df9a25c315f6 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:55.082181 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6c58349b-1e4c-4d86-b781-2b45eb0c3ee5 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:55.082444 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6c58349b-1e4c-4d86-b781-2b45eb0c3ee5 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:55.083061 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6c58349b-1e4c-4d86-b781-2b45eb0c3ee5 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:55.084213 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6c58349b-1e4c-4d86-b781-2b45eb0c3ee5 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:55.084887 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6c58349b-1e4c-4d86-b781-2b45eb0c3ee5 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:55.085500 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6c58349b-1e4c-4d86-b781-2b45eb0c3ee5 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:55.154227 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6c58349b-1e4c-4d86-b781-2b45eb0c3ee5 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=8b41ce40942c401f9a33634873dbfc99" status: 200 len: 15 microversion: 2.1 time: 0.107759 Aug 31 15:58:55.158213 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 461/922] 10.222.0.61 () {58 vars in 1257 bytes} [Wed Aug 31 15:58:55 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=8b41ce40942c401f9a33634873dbfc99 => generated 15 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 31 15:58:55.177672 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-227bdf3f-474c-4bd4-846a-eabecb9127c9 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:55.184075 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-227bdf3f-474c-4bd4-846a-eabecb9127c9 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.010092 Aug 31 15:58:55.184630 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 462/923] 10.222.0.61 () {58 vars in 1189 bytes} [Wed Aug 31 15:58:55 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 31 15:58:55.210179 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5a52cad6-62d1-4f66-a98d-1f3e3ed9c5a2 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:58:55.213125 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5a52cad6-62d1-4f66-a98d-1f3e3ed9c5a2 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] [instance: e45fa8b9-1545-4bd5-aa5f-402c71ec19c6] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:55.219935 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5a52cad6-62d1-4f66-a98d-1f3e3ed9c5a2 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:55.220436 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5a52cad6-62d1-4f66-a98d-1f3e3ed9c5a2 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:55.220876 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5a52cad6-62d1-4f66-a98d-1f3e3ed9c5a2 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:55.221578 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5a52cad6-62d1-4f66-a98d-1f3e3ed9c5a2 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:55.222041 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5a52cad6-62d1-4f66-a98d-1f3e3ed9c5a2 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:55.222472 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5a52cad6-62d1-4f66-a98d-1f3e3ed9c5a2 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:55.373047 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5a52cad6-62d1-4f66-a98d-1f3e3ed9c5a2 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6/action" status: 202 len: 0 microversion: 2.1 time: 0.166613 Aug 31 15:58:55.376153 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 463/924] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 15:58:55 2022] POST /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6/action => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 15:58:55.378408 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c6e0dac5-67dd-4620-bc56-68f5c6bb6c84 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:55.379037 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c6e0dac5-67dd-4620-bc56-68f5c6bb6c84 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] [instance: aa95066b-b1b8-43d8-8c5a-024e3890aa27] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:55.391675 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c6e0dac5-67dd-4620-bc56-68f5c6bb6c84 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:55.391675 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c6e0dac5-67dd-4620-bc56-68f5c6bb6c84 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:55.391675 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c6e0dac5-67dd-4620-bc56-68f5c6bb6c84 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:55.391675 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c6e0dac5-67dd-4620-bc56-68f5c6bb6c84 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:55.392161 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c6e0dac5-67dd-4620-bc56-68f5c6bb6c84 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:55.392161 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c6e0dac5-67dd-4620-bc56-68f5c6bb6c84 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:55.951062 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3d249226-ed84-41bf-b5b3-df9a25c315f6 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:55.968391 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3d249226-ed84-41bf-b5b3-df9a25c315f6 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:55.971366 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3d249226-ed84-41bf-b5b3-df9a25c315f6 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:55.973796 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3d249226-ed84-41bf-b5b3-df9a25c315f6 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/8555b294-db38-4246-ac58-035cb2acc70e" status: 200 len: 1567 microversion: 2.25 time: 0.928522 Aug 31 15:58:55.974596 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 462/925] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:58:55 2022] GET /compute/v2.1/servers/8555b294-db38-4246-ac58-035cb2acc70e => generated 1567 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:55.995939 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8fdd1592-0e9e-47ab-80fa-3f055b755b5d tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:55.996955 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8fdd1592-0e9e-47ab-80fa-3f055b755b5d tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] [instance: 5de5737d-bcc8-4357-85f0-f4468ac84bc7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:56.005106 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8fdd1592-0e9e-47ab-80fa-3f055b755b5d tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:56.006089 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8fdd1592-0e9e-47ab-80fa-3f055b755b5d tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:56.006700 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8fdd1592-0e9e-47ab-80fa-3f055b755b5d tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:56.007709 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8fdd1592-0e9e-47ab-80fa-3f055b755b5d tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:56.008338 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8fdd1592-0e9e-47ab-80fa-3f055b755b5d tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:56.009043 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8fdd1592-0e9e-47ab-80fa-3f055b755b5d tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:56.114670 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c6e0dac5-67dd-4620-bc56-68f5c6bb6c84 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccce16c7fda401ea68fb31ea8099d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed252ebf7c741bbb36b553ac1767579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:56.137294 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c6e0dac5-67dd-4620-bc56-68f5c6bb6c84 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "GET /compute/v2.1/servers/aa95066b-b1b8-43d8-8c5a-024e3890aa27" status: 200 len: 1538 microversion: 2.1 time: 0.762591 Aug 31 15:58:56.138705 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 464/926] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:55 2022] GET /compute/v2.1/servers/aa95066b-b1b8-43d8-8c5a-024e3890aa27 => generated 1538 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:56.146296 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a69598ff-c627-48d6-ac84-93e6be14fc00 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:56.161272 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a69598ff-c627-48d6-ac84-93e6be14fc00 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9a03cc5956ca477abacbe0c26bf18750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea45d1b678342ed812f9912e9f07503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:56.165552 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a69598ff-c627-48d6-ac84-93e6be14fc00 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '1ea45d1b678342ed812f9912e9f07503'} {{(pid=122257) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 15:58:56.191769 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a69598ff-c627-48d6-ac84-93e6be14fc00 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:56.193000 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a69598ff-c627-48d6-ac84-93e6be14fc00 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:56.193751 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a69598ff-c627-48d6-ac84-93e6be14fc00 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:56.194578 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a69598ff-c627-48d6-ac84-93e6be14fc00 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:56.195692 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a69598ff-c627-48d6-ac84-93e6be14fc00 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:56.196808 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a69598ff-c627-48d6-ac84-93e6be14fc00 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:56.366737 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8fdd1592-0e9e-47ab-80fa-3f055b755b5d tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a5652ccb7b54cf7a56f25b91c30c904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5746b9f74e4fecbf2da098436f2ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:56.381627 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8fdd1592-0e9e-47ab-80fa-3f055b755b5d tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] 10.222.0.61 "GET /compute/v2.1/servers/5de5737d-bcc8-4357-85f0-f4468ac84bc7" status: 200 len: 1332 microversion: 2.1 time: 0.395602 Aug 31 15:58:56.394693 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.multi_cell_list [None req-a69598ff-c627-48d6-ac84-93e6be14fc00 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122257) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 31 15:58:56.412262 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 463/927] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:55 2022] GET /compute/v2.1/servers/5de5737d-bcc8-4357-85f0-f4468ac84bc7 => generated 1332 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:56.418648 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c8571514-abd2-4176-8e98-e86c0bd761b0 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:56.425055 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c8571514-abd2-4176-8e98-e86c0bd761b0 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: cc085aaa-21b2-48a6-b69c-de4e261dfe7f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:56.433026 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c8571514-abd2-4176-8e98-e86c0bd761b0 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:56.433559 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c8571514-abd2-4176-8e98-e86c0bd761b0 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:56.434008 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c8571514-abd2-4176-8e98-e86c0bd761b0 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:56.434778 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c8571514-abd2-4176-8e98-e86c0bd761b0 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:56.435357 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c8571514-abd2-4176-8e98-e86c0bd761b0 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:56.435828 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c8571514-abd2-4176-8e98-e86c0bd761b0 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:56.525150 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a69598ff-c627-48d6-ac84-93e6be14fc00 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] 10.222.0.61 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.385082 Aug 31 15:58:56.532285 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 465/928] 10.222.0.61 () {58 vars in 1150 bytes} [Wed Aug 31 15:58:56 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:58:56.538230 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4561a30f-af03-42ee-b1b0-6933c27d9e16 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:56.539015 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4561a30f-af03-42ee-b1b0-6933c27d9e16 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:56.546174 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4561a30f-af03-42ee-b1b0-6933c27d9e16 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:56.546764 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4561a30f-af03-42ee-b1b0-6933c27d9e16 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:56.547268 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4561a30f-af03-42ee-b1b0-6933c27d9e16 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:56.548082 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4561a30f-af03-42ee-b1b0-6933c27d9e16 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:56.548608 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4561a30f-af03-42ee-b1b0-6933c27d9e16 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:56.549100 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4561a30f-af03-42ee-b1b0-6933c27d9e16 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:56.587710 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c8571514-abd2-4176-8e98-e86c0bd761b0 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:56.599762 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c8571514-abd2-4176-8e98-e86c0bd761b0 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f" status: 200 len: 1292 microversion: 2.1 time: 0.185962 Aug 31 15:58:56.600375 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 464/929] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:56 2022] GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f => generated 1292 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:56.611703 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c5805520-bb9a-44b2-a637-bc2a260ea955 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:58:56.619657 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c5805520-bb9a-44b2-a637-bc2a260ea955 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] [instance: e45fa8b9-1545-4bd5-aa5f-402c71ec19c6] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:56.632399 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:58:56.642015 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c5805520-bb9a-44b2-a637-bc2a260ea955 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:56.642795 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c5805520-bb9a-44b2-a637-bc2a260ea955 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:56.643254 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c5805520-bb9a-44b2-a637-bc2a260ea955 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:56.644249 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c5805520-bb9a-44b2-a637-bc2a260ea955 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:56.647967 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c5805520-bb9a-44b2-a637-bc2a260ea955 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:56.648832 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c5805520-bb9a-44b2-a637-bc2a260ea955 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:56.719324 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-4561a30f-af03-42ee-b1b0-6933c27d9e16 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:56.745117 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-4561a30f-af03-42ee-b1b0-6933c27d9e16 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:56.746959 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-4561a30f-af03-42ee-b1b0-6933c27d9e16 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:56.753939 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4561a30f-af03-42ee-b1b0-6933c27d9e16 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1539 microversion: 2.91 time: 0.220392 Aug 31 15:58:56.754858 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 466/930] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:58:56 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1539 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:56.879691 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c5805520-bb9a-44b2-a637-bc2a260ea955 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6/action" status: 202 len: 0 microversion: 2.1 time: 0.277678 Aug 31 15:58:56.881718 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 465/931] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 15:58:56 2022] POST /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6/action => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 15:58:56.913134 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8eec1baf-2509-4d18-b034-241784bea9c1 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:56.915597 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8eec1baf-2509-4d18-b034-241784bea9c1 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] [instance: e45fa8b9-1545-4bd5-aa5f-402c71ec19c6] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:56.941862 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8eec1baf-2509-4d18-b034-241784bea9c1 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:56.942147 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8eec1baf-2509-4d18-b034-241784bea9c1 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:56.942574 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8eec1baf-2509-4d18-b034-241784bea9c1 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:56.943300 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8eec1baf-2509-4d18-b034-241784bea9c1 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:56.943791 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8eec1baf-2509-4d18-b034-241784bea9c1 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:56.947676 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8eec1baf-2509-4d18-b034-241784bea9c1 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:57.005151 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-700d3709-98d1-49a5-9e40-266af859b605 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:57.005944 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-700d3709-98d1-49a5-9e40-266af859b605 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 8555b294-db38-4246-ac58-035cb2acc70e] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:57.025731 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-700d3709-98d1-49a5-9e40-266af859b605 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:57.026131 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:58:57.033193 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-700d3709-98d1-49a5-9e40-266af859b605 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:57.034042 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-700d3709-98d1-49a5-9e40-266af859b605 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:57.035529 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-700d3709-98d1-49a5-9e40-266af859b605 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:57.036176 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-700d3709-98d1-49a5-9e40-266af859b605 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:57.036803 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-700d3709-98d1-49a5-9e40-266af859b605 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:57.519979 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-700d3709-98d1-49a5-9e40-266af859b605 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:57.537170 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-700d3709-98d1-49a5-9e40-266af859b605 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:57.540439 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-700d3709-98d1-49a5-9e40-266af859b605 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:57.545948 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-700d3709-98d1-49a5-9e40-266af859b605 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/8555b294-db38-4246-ac58-035cb2acc70e" status: 200 len: 1567 microversion: 2.25 time: 0.543209 Aug 31 15:58:57.549173 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8eec1baf-2509-4d18-b034-241784bea9c1 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6" status: 200 len: 1615 microversion: 2.1 time: 0.656831 Aug 31 15:58:57.563532 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 467/932] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:56 2022] GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6 => generated 1615 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:57.563532 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c94f7de0-8236-45dc-aac2-e5de0a29efd3 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:57.563532 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c94f7de0-8236-45dc-aac2-e5de0a29efd3 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] [instance: aa95066b-b1b8-43d8-8c5a-024e3890aa27] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:57.576411 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 466/933] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:58:56 2022] GET /compute/v2.1/servers/8555b294-db38-4246-ac58-035cb2acc70e => generated 1567 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:57.583227 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-fb7d3a9d-3dd2-48a3-a479-7f66a6fb3fbd tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:57.584787 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-fb7d3a9d-3dd2-48a3-a479-7f66a6fb3fbd tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] [instance: 5de5737d-bcc8-4357-85f0-f4468ac84bc7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:57.593825 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fb7d3a9d-3dd2-48a3-a479-7f66a6fb3fbd tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:57.595182 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fb7d3a9d-3dd2-48a3-a479-7f66a6fb3fbd tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:57.596053 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fb7d3a9d-3dd2-48a3-a479-7f66a6fb3fbd tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:57.597359 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fb7d3a9d-3dd2-48a3-a479-7f66a6fb3fbd tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:57.598188 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fb7d3a9d-3dd2-48a3-a479-7f66a6fb3fbd tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:57.598811 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fb7d3a9d-3dd2-48a3-a479-7f66a6fb3fbd tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:57.606529 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c94f7de0-8236-45dc-aac2-e5de0a29efd3 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:57.607340 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c94f7de0-8236-45dc-aac2-e5de0a29efd3 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:57.611270 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c94f7de0-8236-45dc-aac2-e5de0a29efd3 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:57.612483 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c94f7de0-8236-45dc-aac2-e5de0a29efd3 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:57.613123 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c94f7de0-8236-45dc-aac2-e5de0a29efd3 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:57.613724 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c94f7de0-8236-45dc-aac2-e5de0a29efd3 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:58.036511 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-fb7d3a9d-3dd2-48a3-a479-7f66a6fb3fbd tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a5652ccb7b54cf7a56f25b91c30c904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5746b9f74e4fecbf2da098436f2ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:58.048424 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c94f7de0-8236-45dc-aac2-e5de0a29efd3 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccce16c7fda401ea68fb31ea8099d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed252ebf7c741bbb36b553ac1767579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:58.059747 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-fb7d3a9d-3dd2-48a3-a479-7f66a6fb3fbd tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] 10.222.0.61 "GET /compute/v2.1/servers/5de5737d-bcc8-4357-85f0-f4468ac84bc7" status: 200 len: 1332 microversion: 2.1 time: 0.480898 Aug 31 15:58:58.060334 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 467/934] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:57 2022] GET /compute/v2.1/servers/5de5737d-bcc8-4357-85f0-f4468ac84bc7 => generated 1332 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:58.063023 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c94f7de0-8236-45dc-aac2-e5de0a29efd3 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "GET /compute/v2.1/servers/aa95066b-b1b8-43d8-8c5a-024e3890aa27" status: 200 len: 1538 microversion: 2.1 time: 0.511168 Aug 31 15:58:58.064149 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 468/935] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:57 2022] GET /compute/v2.1/servers/aa95066b-b1b8-43d8-8c5a-024e3890aa27 => generated 1538 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:58.068855 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8b02fd1a-1f64-4cea-b996-574d3d7de623 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:58.074640 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5bd1448f-b523-4b79-97a4-28ad31c8b10b tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:58.078417 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8b02fd1a-1f64-4cea-b996-574d3d7de623 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] [instance: e45fa8b9-1545-4bd5-aa5f-402c71ec19c6] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:58.083845 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5bd1448f-b523-4b79-97a4-28ad31c8b10b tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: cc085aaa-21b2-48a6-b69c-de4e261dfe7f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:58.094037 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b02fd1a-1f64-4cea-b996-574d3d7de623 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:58.101042 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5bd1448f-b523-4b79-97a4-28ad31c8b10b tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:58.101605 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5bd1448f-b523-4b79-97a4-28ad31c8b10b tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:58.102456 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b02fd1a-1f64-4cea-b996-574d3d7de623 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:58.102904 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b02fd1a-1f64-4cea-b996-574d3d7de623 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:58.103700 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b02fd1a-1f64-4cea-b996-574d3d7de623 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:58.104150 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b02fd1a-1f64-4cea-b996-574d3d7de623 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:58.106081 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5bd1448f-b523-4b79-97a4-28ad31c8b10b tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:58.112278 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b02fd1a-1f64-4cea-b996-574d3d7de623 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:58.112879 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5bd1448f-b523-4b79-97a4-28ad31c8b10b tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:58.116152 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5bd1448f-b523-4b79-97a4-28ad31c8b10b tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:58.116815 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5bd1448f-b523-4b79-97a4-28ad31c8b10b tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:58.530394 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5bd1448f-b523-4b79-97a4-28ad31c8b10b tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:58.541614 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5bd1448f-b523-4b79-97a4-28ad31c8b10b tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f" status: 200 len: 1360 microversion: 2.1 time: 0.471348 Aug 31 15:58:58.542205 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 468/936] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:58 2022] GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f => generated 1360 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:58.553324 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-85e92e96-9d4e-410d-be1b-e0eb39d38acc tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:58.564163 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-85e92e96-9d4e-410d-be1b-e0eb39d38acc tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:58.566770 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8b02fd1a-1f64-4cea-b996-574d3d7de623 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6" status: 200 len: 1615 microversion: 2.1 time: 0.501397 Aug 31 15:58:58.568068 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 469/937] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:58 2022] GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6 => generated 1615 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:58.573859 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-0c1cb13f-7e76-40b3-a538-0ac96639ada8 req-cd65c82b-352b-40e3-805a-1e0e3dd94fca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa95066b-b1b8-43d8-8c5a-024e3890aa27", "name": "network-vif-plugged", "status": "completed", "tag": "382402ff-e21a-4c70-b0ca-69cef0f74488"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:58:58.580917 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-85e92e96-9d4e-410d-be1b-e0eb39d38acc tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:58.581427 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-85e92e96-9d4e-410d-be1b-e0eb39d38acc tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:58.581870 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-85e92e96-9d4e-410d-be1b-e0eb39d38acc tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:58.582586 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-85e92e96-9d4e-410d-be1b-e0eb39d38acc tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:58.585101 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-85e92e96-9d4e-410d-be1b-e0eb39d38acc tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:58.585579 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-85e92e96-9d4e-410d-be1b-e0eb39d38acc tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:58.602701 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-0c1cb13f-7e76-40b3-a538-0ac96639ada8 req-cd65c82b-352b-40e3-805a-1e0e3dd94fca service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:58.603434 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-0c1cb13f-7e76-40b3-a538-0ac96639ada8 req-cd65c82b-352b-40e3-805a-1e0e3dd94fca service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:58.604877 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-0c1cb13f-7e76-40b3-a538-0ac96639ada8 req-cd65c82b-352b-40e3-805a-1e0e3dd94fca service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:58.623187 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-0c1cb13f-7e76-40b3-a538-0ac96639ada8 req-cd65c82b-352b-40e3-805a-1e0e3dd94fca service nova] Creating event network-vif-plugged:382402ff-e21a-4c70-b0ca-69cef0f74488 for instance aa95066b-b1b8-43d8-8c5a-024e3890aa27 on n-h1-850499-9 Aug 31 15:58:58.638700 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-0c1cb13f-7e76-40b3-a538-0ac96639ada8 req-cd65c82b-352b-40e3-805a-1e0e3dd94fca service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069232 Aug 31 15:58:58.639628 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 470/938] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 15:58:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:58:58.648078 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ca8bb8f4-728c-4b38-9848-a5a26d968b64 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:58.657243 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ca8bb8f4-728c-4b38-9848-a5a26d968b64 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Searching by: {'host': 'n-h2-850499-9', 'deleted': False} {{(pid=122257) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 15:58:58.664455 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ca8bb8f4-728c-4b38-9848-a5a26d968b64 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:58.665326 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ca8bb8f4-728c-4b38-9848-a5a26d968b64 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:58.665951 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ca8bb8f4-728c-4b38-9848-a5a26d968b64 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:58.667425 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ca8bb8f4-728c-4b38-9848-a5a26d968b64 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:58.668207 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ca8bb8f4-728c-4b38-9848-a5a26d968b64 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:58.668798 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ca8bb8f4-728c-4b38-9848-a5a26d968b64 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:58.720897 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-85e92e96-9d4e-410d-be1b-e0eb39d38acc tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:58.735697 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-85e92e96-9d4e-410d-be1b-e0eb39d38acc tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:58.737298 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-85e92e96-9d4e-410d-be1b-e0eb39d38acc tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:58.745344 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-85e92e96-9d4e-410d-be1b-e0eb39d38acc tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1560 microversion: 2.91 time: 0.197711 Aug 31 15:58:58.746339 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 469/939] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:58:58 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1560 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:58.751377 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ccc9a097-4d50-45dc-a42f-5785b5e744b4 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:58.752078 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ccc9a097-4d50-45dc-a42f-5785b5e744b4 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 8555b294-db38-4246-ac58-035cb2acc70e] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:58.758684 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ccc9a097-4d50-45dc-a42f-5785b5e744b4 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:58.759182 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ccc9a097-4d50-45dc-a42f-5785b5e744b4 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:58.764591 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ccc9a097-4d50-45dc-a42f-5785b5e744b4 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:58.774128 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ccc9a097-4d50-45dc-a42f-5785b5e744b4 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:58.776256 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ccc9a097-4d50-45dc-a42f-5785b5e744b4 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:58.776708 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ccc9a097-4d50-45dc-a42f-5785b5e744b4 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:58.784897 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.multi_cell_list [None req-ca8bb8f4-728c-4b38-9848-a5a26d968b64 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Listed batch of 7 results from cell out of 1000 limit. Returned 7 total so far. {{(pid=122257) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 31 15:58:58.890299 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ca8bb8f4-728c-4b38-9848-a5a26d968b64 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] 10.222.0.61 "GET /compute/v2.1/servers?host=n-h2-850499-9&all_tenants=1" status: 200 len: 2304 microversion: 2.1 time: 0.248464 Aug 31 15:58:58.891187 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 471/940] 10.222.0.61 () {58 vars in 1190 bytes} [Wed Aug 31 15:58:58 2022] GET /compute/v2.1/servers?host=n-h2-850499-9&all_tenants=1 => generated 2304 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:58.906733 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-33aa0956-1397-418f-9f8d-c70d111f125d tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:58.921792 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-33aa0956-1397-418f-9f8d-c70d111f125d tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=122257) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 15:58:58.935987 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-33aa0956-1397-418f-9f8d-c70d111f125d tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:58.936884 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-33aa0956-1397-418f-9f8d-c70d111f125d tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:58.937574 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-33aa0956-1397-418f-9f8d-c70d111f125d tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:58.938935 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-33aa0956-1397-418f-9f8d-c70d111f125d tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:58.939672 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-33aa0956-1397-418f-9f8d-c70d111f125d tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:58.940373 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-33aa0956-1397-418f-9f8d-c70d111f125d tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:58.988545 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-33aa0956-1397-418f-9f8d-c70d111f125d tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] 10.222.0.61 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.087303 Aug 31 15:58:58.989652 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 472/941] 10.222.0.61 () {58 vars in 1196 bytes} [Wed Aug 31 15:58:58 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 31 15:58:59.003281 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3644f439-4e47-42d4-94f1-def09cf3dfad tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:58:59.012825 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3644f439-4e47-42d4-94f1-def09cf3dfad tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] [instance: e45fa8b9-1545-4bd5-aa5f-402c71ec19c6] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:59.021027 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3644f439-4e47-42d4-94f1-def09cf3dfad tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:59.021923 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3644f439-4e47-42d4-94f1-def09cf3dfad tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:59.022174 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=3 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:58:59.022745 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3644f439-4e47-42d4-94f1-def09cf3dfad tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:59.024994 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3644f439-4e47-42d4-94f1-def09cf3dfad tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:59.025908 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3644f439-4e47-42d4-94f1-def09cf3dfad tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:59.027384 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3644f439-4e47-42d4-94f1-def09cf3dfad tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:59.169887 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ccc9a097-4d50-45dc-a42f-5785b5e744b4 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:59.182107 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ccc9a097-4d50-45dc-a42f-5785b5e744b4 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:59.189232 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ccc9a097-4d50-45dc-a42f-5785b5e744b4 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:59.190497 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ccc9a097-4d50-45dc-a42f-5785b5e744b4 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/8555b294-db38-4246-ac58-035cb2acc70e" status: 200 len: 1567 microversion: 2.25 time: 0.443105 Aug 31 15:58:59.191085 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 470/942] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:58:58 2022] GET /compute/v2.1/servers/8555b294-db38-4246-ac58-035cb2acc70e => generated 1567 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:59.207164 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3644f439-4e47-42d4-94f1-def09cf3dfad tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6/action" status: 202 len: 0 microversion: 2.1 time: 0.195473 Aug 31 15:58:59.207164 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 473/943] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 15:58:58 2022] POST /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6/action => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 15:58:59.207340 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-12c8f70d-bd3e-4c9c-820b-57a78d771a10 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:59.209024 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-12c8f70d-bd3e-4c9c-820b-57a78d771a10 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] [instance: 5de5737d-bcc8-4357-85f0-f4468ac84bc7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:59.209767 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-59ecd542-a071-4206-85b6-27ae4d906f51 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:59.210790 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-59ecd542-a071-4206-85b6-27ae4d906f51 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] [instance: aa95066b-b1b8-43d8-8c5a-024e3890aa27] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:59.226169 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-12c8f70d-bd3e-4c9c-820b-57a78d771a10 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:59.226169 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-12c8f70d-bd3e-4c9c-820b-57a78d771a10 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:59.227186 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-12c8f70d-bd3e-4c9c-820b-57a78d771a10 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:59.227974 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-12c8f70d-bd3e-4c9c-820b-57a78d771a10 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:59.228363 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-12c8f70d-bd3e-4c9c-820b-57a78d771a10 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:59.228967 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-12c8f70d-bd3e-4c9c-820b-57a78d771a10 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:59.229780 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-59ecd542-a071-4206-85b6-27ae4d906f51 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:59.230281 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-59ecd542-a071-4206-85b6-27ae4d906f51 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:59.230878 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-59ecd542-a071-4206-85b6-27ae4d906f51 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:59.231680 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-59ecd542-a071-4206-85b6-27ae4d906f51 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:59.232178 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-59ecd542-a071-4206-85b6-27ae4d906f51 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:59.232595 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-59ecd542-a071-4206-85b6-27ae4d906f51 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:59.966215 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-12c8f70d-bd3e-4c9c-820b-57a78d771a10 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a5652ccb7b54cf7a56f25b91c30c904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5746b9f74e4fecbf2da098436f2ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:59.980674 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-12c8f70d-bd3e-4c9c-820b-57a78d771a10 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] 10.222.0.61 "GET /compute/v2.1/servers/5de5737d-bcc8-4357-85f0-f4468ac84bc7" status: 200 len: 1537 microversion: 2.1 time: 0.788372 Aug 31 15:58:59.989482 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 471/944] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:59 2022] GET /compute/v2.1/servers/5de5737d-bcc8-4357-85f0-f4468ac84bc7 => generated 1537 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:00.025157 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1ec34912-ad87-48db-b2cb-3a3938bb59ef tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:59:00.032275 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1ec34912-ad87-48db-b2cb-3a3938bb59ef tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] [instance: e45fa8b9-1545-4bd5-aa5f-402c71ec19c6] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:00.035566 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-59ecd542-a071-4206-85b6-27ae4d906f51 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccce16c7fda401ea68fb31ea8099d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed252ebf7c741bbb36b553ac1767579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:00.047102 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-59ecd542-a071-4206-85b6-27ae4d906f51 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "GET /compute/v2.1/servers/aa95066b-b1b8-43d8-8c5a-024e3890aa27" status: 200 len: 1533 microversion: 2.1 time: 0.844229 Aug 31 15:59:00.059554 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 474/945] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:59 2022] GET /compute/v2.1/servers/aa95066b-b1b8-43d8-8c5a-024e3890aa27 => generated 1533 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:00.061226 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1ec34912-ad87-48db-b2cb-3a3938bb59ef tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:00.061226 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1ec34912-ad87-48db-b2cb-3a3938bb59ef tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:00.061226 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1ec34912-ad87-48db-b2cb-3a3938bb59ef tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:00.061226 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1ec34912-ad87-48db-b2cb-3a3938bb59ef tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:00.061558 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1ec34912-ad87-48db-b2cb-3a3938bb59ef tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:00.061558 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1ec34912-ad87-48db-b2cb-3a3938bb59ef tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:00.071146 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-029d4173-6bf1-4b44-8013-319c728cdf74 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:00.079430 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-029d4173-6bf1-4b44-8013-319c728cdf74 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: cc085aaa-21b2-48a6-b69c-de4e261dfe7f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:00.092074 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-029d4173-6bf1-4b44-8013-319c728cdf74 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:00.092582 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-029d4173-6bf1-4b44-8013-319c728cdf74 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:00.093030 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-029d4173-6bf1-4b44-8013-319c728cdf74 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:00.093754 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-029d4173-6bf1-4b44-8013-319c728cdf74 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:00.094221 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-029d4173-6bf1-4b44-8013-319c728cdf74 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:00.094654 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-029d4173-6bf1-4b44-8013-319c728cdf74 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:00.297004 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-1ec34912-ad87-48db-b2cb-3a3938bb59ef tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 15:59:00.298074 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-1ec34912-ad87-48db-b2cb-3a3938bb59ef tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 15:59:00.298563 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-1ec34912-ad87-48db-b2cb-3a3938bb59ef tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 15:59:00.303767 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-1ec34912-ad87-48db-b2cb-3a3938bb59ef tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 15:59:00.305241 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-1ec34912-ad87-48db-b2cb-3a3938bb59ef tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 15:59:00.332710 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:59:00.402795 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-029d4173-6bf1-4b44-8013-319c728cdf74 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:00.408264 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1ec34912-ad87-48db-b2cb-3a3938bb59ef tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] [instance: e45fa8b9-1545-4bd5-aa5f-402c71ec19c6] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:00.410606 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-029d4173-6bf1-4b44-8013-319c728cdf74 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f" status: 200 len: 1360 microversion: 2.1 time: 0.359238 Aug 31 15:59:00.411201 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 475/946] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:00 2022] GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f => generated 1360 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:00.416296 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b4111474-5207-42f5-9564-04588990d845 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:00.421194 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1ec34912-ad87-48db-b2cb-3a3938bb59ef tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:00.421936 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1ec34912-ad87-48db-b2cb-3a3938bb59ef tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:00.422603 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1ec34912-ad87-48db-b2cb-3a3938bb59ef tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:00.423991 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1ec34912-ad87-48db-b2cb-3a3938bb59ef tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:00.424688 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1ec34912-ad87-48db-b2cb-3a3938bb59ef tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:00.425326 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1ec34912-ad87-48db-b2cb-3a3938bb59ef tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:00.428392 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b4111474-5207-42f5-9564-04588990d845 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:00.439024 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b4111474-5207-42f5-9564-04588990d845 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:00.439446 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b4111474-5207-42f5-9564-04588990d845 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:00.444147 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b4111474-5207-42f5-9564-04588990d845 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:00.444938 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b4111474-5207-42f5-9564-04588990d845 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:00.446904 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b4111474-5207-42f5-9564-04588990d845 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:00.447450 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b4111474-5207-42f5-9564-04588990d845 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:00.489327 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1ec34912-ad87-48db-b2cb-3a3938bb59ef tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] 10.222.0.61 "POST /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6/action" status: 202 len: 1068 microversion: 2.1 time: 0.498465 Aug 31 15:59:00.489972 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 472/947] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 15:58:59 2022] POST /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6/action => generated 1068 bytes in 500 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 31 15:59:00.508185 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-eb2a58aa-63cc-4606-96e8-631c6857483c tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Action: 'create', calling method: .version_select at 0x7f5ae99c4d30>, body: {"pool": "edca2db6-2c46-4009-a3d6-11849a8e2dfd"} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:59:00.690617 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b4111474-5207-42f5-9564-04588990d845 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:00.699734 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b4111474-5207-42f5-9564-04588990d845 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:00.707957 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b4111474-5207-42f5-9564-04588990d845 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:00.714506 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b4111474-5207-42f5-9564-04588990d845 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1560 microversion: 2.91 time: 0.302292 Aug 31 15:59:00.715079 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 476/948] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:59:00 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1560 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:59:00.719816 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1f692d85-5007-4701-9398-173fcfc5e6ec tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:00.720593 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1f692d85-5007-4701-9398-173fcfc5e6ec tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 8555b294-db38-4246-ac58-035cb2acc70e] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:00.727555 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1f692d85-5007-4701-9398-173fcfc5e6ec tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:00.728288 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1f692d85-5007-4701-9398-173fcfc5e6ec tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:00.728931 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1f692d85-5007-4701-9398-173fcfc5e6ec tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:00.729845 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1f692d85-5007-4701-9398-173fcfc5e6ec tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:00.747323 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1f692d85-5007-4701-9398-173fcfc5e6ec tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:00.748169 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1f692d85-5007-4701-9398-173fcfc5e6ec tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:01.135981 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-1f692d85-5007-4701-9398-173fcfc5e6ec tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:01.145401 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-1f692d85-5007-4701-9398-173fcfc5e6ec tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:01.146837 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-1f692d85-5007-4701-9398-173fcfc5e6ec tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:01.148614 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1f692d85-5007-4701-9398-173fcfc5e6ec tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/8555b294-db38-4246-ac58-035cb2acc70e" status: 200 len: 1542 microversion: 2.25 time: 0.431820 Aug 31 15:59:01.159869 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 477/949] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:59:00 2022] GET /compute/v2.1/servers/8555b294-db38-4246-ac58-035cb2acc70e => generated 1542 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:59:01.165628 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-439229e4-a0bb-4fc0-83ca-77cf26c16bbf tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:01.173509 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-439229e4-a0bb-4fc0-83ca-77cf26c16bbf tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] [instance: e45fa8b9-1545-4bd5-aa5f-402c71ec19c6] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:01.187074 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-439229e4-a0bb-4fc0-83ca-77cf26c16bbf tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:01.187602 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-439229e4-a0bb-4fc0-83ca-77cf26c16bbf tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:01.188268 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-439229e4-a0bb-4fc0-83ca-77cf26c16bbf tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:01.189160 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-439229e4-a0bb-4fc0-83ca-77cf26c16bbf tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:01.189965 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-439229e4-a0bb-4fc0-83ca-77cf26c16bbf tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:01.190721 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-439229e4-a0bb-4fc0-83ca-77cf26c16bbf tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:01.565104 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-439229e4-a0bb-4fc0-83ca-77cf26c16bbf tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a03cc5956ca477abacbe0c26bf18750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea45d1b678342ed812f9912e9f07503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:01.576061 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-439229e4-a0bb-4fc0-83ca-77cf26c16bbf tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] 10.222.0.61 "GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6" status: 200 len: 1472 microversion: 2.1 time: 0.414971 Aug 31 15:59:01.594524 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 478/950] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:01 2022] GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6 => generated 1472 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:01.599417 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-08207bb1-cc6a-4ad5-a686-906d5bf23c8e tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:01.607992 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-08207bb1-cc6a-4ad5-a686-906d5bf23c8e tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] [instance: aa95066b-b1b8-43d8-8c5a-024e3890aa27] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:01.617760 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-08207bb1-cc6a-4ad5-a686-906d5bf23c8e tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:01.618318 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-08207bb1-cc6a-4ad5-a686-906d5bf23c8e tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:01.618764 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-08207bb1-cc6a-4ad5-a686-906d5bf23c8e tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:01.619478 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-08207bb1-cc6a-4ad5-a686-906d5bf23c8e tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:01.619967 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-08207bb1-cc6a-4ad5-a686-906d5bf23c8e tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:01.620395 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-08207bb1-cc6a-4ad5-a686-906d5bf23c8e tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:01.622464 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=5 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:59:02.091106 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-08207bb1-cc6a-4ad5-a686-906d5bf23c8e tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccce16c7fda401ea68fb31ea8099d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed252ebf7c741bbb36b553ac1767579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:02.105700 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-08207bb1-cc6a-4ad5-a686-906d5bf23c8e tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "GET /compute/v2.1/servers/aa95066b-b1b8-43d8-8c5a-024e3890aa27" status: 200 len: 1520 microversion: 2.1 time: 0.509968 Aug 31 15:59:02.107061 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 479/951] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:01 2022] GET /compute/v2.1/servers/aa95066b-b1b8-43d8-8c5a-024e3890aa27 => generated 1520 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:02.114703 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-43fcad2f-f925-463c-a989-b6a99269131b req-7fa0de8b-8d6a-4cac-b3b0-471e80acc0a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc085aaa-21b2-48a6-b69c-de4e261dfe7f", "tag": "c4a89a46-30ca-4df0-bd23-f2ae8050bb54"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:59:02.133920 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-43fcad2f-f925-463c-a989-b6a99269131b req-7fa0de8b-8d6a-4cac-b3b0-471e80acc0a7 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:02.134894 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-43fcad2f-f925-463c-a989-b6a99269131b req-7fa0de8b-8d6a-4cac-b3b0-471e80acc0a7 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:02.135576 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-43fcad2f-f925-463c-a989-b6a99269131b req-7fa0de8b-8d6a-4cac-b3b0-471e80acc0a7 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:02.150628 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-43fcad2f-f925-463c-a989-b6a99269131b req-7fa0de8b-8d6a-4cac-b3b0-471e80acc0a7 service nova] Creating event network-changed:c4a89a46-30ca-4df0-bd23-f2ae8050bb54 for instance cc085aaa-21b2-48a6-b69c-de4e261dfe7f on n-h1-850499-9 Aug 31 15:59:02.158183 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-43fcad2f-f925-463c-a989-b6a99269131b req-7fa0de8b-8d6a-4cac-b3b0-471e80acc0a7 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047759 Aug 31 15:59:02.164497 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 480/952] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 15:59:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:59:02.172393 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3cca2b07-6de8-49da-8e01-3b2934f70018 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Calling method '.version_select at 0x7f5ae901e9d0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:02.179263 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3cca2b07-6de8-49da-8e01-3b2934f70018 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:02.180674 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3cca2b07-6de8-49da-8e01-3b2934f70018 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:02.181241 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3cca2b07-6de8-49da-8e01-3b2934f70018 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:02.209234 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3cca2b07-6de8-49da-8e01-3b2934f70018 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] 10.222.0.61 "GET /compute/v2.1/os-migrations" status: 200 len: 1696 microversion: 2.25 time: 0.042801 Aug 31 15:59:02.223102 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 481/953] 10.222.0.61 () {60 vars in 1184 bytes} [Wed Aug 31 15:59:02 2022] GET /compute/v2.1/os-migrations => generated 1696 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:59:02.230483 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b4f54ffd-6502-475e-badb-1690810e75ed tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:02.232120 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b4f54ffd-6502-475e-badb-1690810e75ed tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: cc085aaa-21b2-48a6-b69c-de4e261dfe7f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:02.241575 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b4f54ffd-6502-475e-badb-1690810e75ed tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:02.242412 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b4f54ffd-6502-475e-badb-1690810e75ed tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:02.243608 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b4f54ffd-6502-475e-badb-1690810e75ed tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:02.244723 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b4f54ffd-6502-475e-badb-1690810e75ed tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:02.245357 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b4f54ffd-6502-475e-badb-1690810e75ed tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:02.245946 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b4f54ffd-6502-475e-badb-1690810e75ed tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:02.561446 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b4f54ffd-6502-475e-badb-1690810e75ed tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:02.571682 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b4f54ffd-6502-475e-badb-1690810e75ed tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f" status: 200 len: 1360 microversion: 2.1 time: 0.347272 Aug 31 15:59:02.572770 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 482/954] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:02 2022] GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f => generated 1360 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:02.578166 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-68dbde0f-faed-4206-8f9e-ad9599083b04 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:02.579114 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-68dbde0f-faed-4206-8f9e-ad9599083b04 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:02.592164 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-68dbde0f-faed-4206-8f9e-ad9599083b04 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:02.594172 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-68dbde0f-faed-4206-8f9e-ad9599083b04 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:02.595078 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-68dbde0f-faed-4206-8f9e-ad9599083b04 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:02.596132 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-68dbde0f-faed-4206-8f9e-ad9599083b04 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:02.597087 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-68dbde0f-faed-4206-8f9e-ad9599083b04 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:02.598671 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-68dbde0f-faed-4206-8f9e-ad9599083b04 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:02.692521 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-68dbde0f-faed-4206-8f9e-ad9599083b04 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:02.703845 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-68dbde0f-faed-4206-8f9e-ad9599083b04 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:02.705632 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-68dbde0f-faed-4206-8f9e-ad9599083b04 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:02.711792 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-68dbde0f-faed-4206-8f9e-ad9599083b04 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1560 microversion: 2.91 time: 0.137731 Aug 31 15:59:02.713367 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 483/955] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:59:02 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1560 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:59:02.718238 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4ab2757f-ed41-47a7-9f60-3025b15c6769 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:02.718936 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4ab2757f-ed41-47a7-9f60-3025b15c6769 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] [instance: aa95066b-b1b8-43d8-8c5a-024e3890aa27] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:02.726178 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4ab2757f-ed41-47a7-9f60-3025b15c6769 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:02.727999 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4ab2757f-ed41-47a7-9f60-3025b15c6769 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:02.728662 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4ab2757f-ed41-47a7-9f60-3025b15c6769 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:02.729634 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4ab2757f-ed41-47a7-9f60-3025b15c6769 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:02.730459 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4ab2757f-ed41-47a7-9f60-3025b15c6769 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:02.731067 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4ab2757f-ed41-47a7-9f60-3025b15c6769 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:02.762298 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4ab2757f-ed41-47a7-9f60-3025b15c6769 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] [instance: aa95066b-b1b8-43d8-8c5a-024e3890aa27] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 15:59:02.766583 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:59:02.885917 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4ab2757f-ed41-47a7-9f60-3025b15c6769 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "DELETE /compute/v2.1/servers/aa95066b-b1b8-43d8-8c5a-024e3890aa27" status: 204 len: 0 microversion: 2.1 time: 0.170812 Aug 31 15:59:02.891451 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 484/956] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 15:59:02 2022] DELETE /compute/v2.1/servers/aa95066b-b1b8-43d8-8c5a-024e3890aa27 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 15:59:02.898656 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-19ef2a6f-3c83-49b9-a161-1d0a024f835b tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:02.899851 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-19ef2a6f-3c83-49b9-a161-1d0a024f835b tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] [instance: 8555b294-db38-4246-ac58-035cb2acc70e] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:02.907721 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-19ef2a6f-3c83-49b9-a161-1d0a024f835b tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:02.908484 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-19ef2a6f-3c83-49b9-a161-1d0a024f835b tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:02.909157 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-19ef2a6f-3c83-49b9-a161-1d0a024f835b tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:02.910138 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-19ef2a6f-3c83-49b9-a161-1d0a024f835b tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:02.910828 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-19ef2a6f-3c83-49b9-a161-1d0a024f835b tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:02.911415 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-19ef2a6f-3c83-49b9-a161-1d0a024f835b tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:03.427362 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-eb2a58aa-63cc-4606-96e8-631c6857483c tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] 10.222.0.61 "POST /compute/v2.1/os-floating-ips" status: 200 len: 140 microversion: 2.1 time: 2.922176 Aug 31 15:59:03.428078 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 473/957] 10.222.0.61 () {60 vars in 1170 bytes} [Wed Aug 31 15:59:00 2022] POST /compute/v2.1/os-floating-ips => generated 140 bytes in 2938 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:59:03.432635 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-19ef2a6f-3c83-49b9-a161-1d0a024f835b tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lazy-loading 'services' on Instance uuid 8555b294-db38-4246-ac58-035cb2acc70e {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:59:03.441333 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b07a68dd-6d1b-4748-90aa-a17e84e3726e tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:03.441955 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b07a68dd-6d1b-4748-90aa-a17e84e3726e tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] [instance: e45fa8b9-1545-4bd5-aa5f-402c71ec19c6] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:03.470019 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b07a68dd-6d1b-4748-90aa-a17e84e3726e tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:03.470984 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b07a68dd-6d1b-4748-90aa-a17e84e3726e tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:03.471912 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b07a68dd-6d1b-4748-90aa-a17e84e3726e tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:03.473292 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b07a68dd-6d1b-4748-90aa-a17e84e3726e tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:03.473754 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b07a68dd-6d1b-4748-90aa-a17e84e3726e tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:03.475679 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-19ef2a6f-3c83-49b9-a161-1d0a024f835b tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/8555b294-db38-4246-ac58-035cb2acc70e" status: 200 len: 2034 microversion: 2.25 time: 0.581794 Aug 31 15:59:03.476147 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b07a68dd-6d1b-4748-90aa-a17e84e3726e tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:03.492924 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 485/958] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:59:02 2022] GET /compute/v2.1/servers/8555b294-db38-4246-ac58-035cb2acc70e => generated 2034 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:59:03.492924 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ba4d0c53-717b-44ce-b585-7c643ac8eb36 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:03.492924 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ba4d0c53-717b-44ce-b585-7c643ac8eb36 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] [instance: aa95066b-b1b8-43d8-8c5a-024e3890aa27] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:03.497988 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ba4d0c53-717b-44ce-b585-7c643ac8eb36 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:03.497988 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ba4d0c53-717b-44ce-b585-7c643ac8eb36 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:03.499076 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ba4d0c53-717b-44ce-b585-7c643ac8eb36 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:03.499076 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ba4d0c53-717b-44ce-b585-7c643ac8eb36 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:03.504996 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ba4d0c53-717b-44ce-b585-7c643ac8eb36 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:03.504996 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ba4d0c53-717b-44ce-b585-7c643ac8eb36 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:03.796940 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ba4d0c53-717b-44ce-b585-7c643ac8eb36 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccce16c7fda401ea68fb31ea8099d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed252ebf7c741bbb36b553ac1767579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:03.805676 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ba4d0c53-717b-44ce-b585-7c643ac8eb36 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "GET /compute/v2.1/servers/aa95066b-b1b8-43d8-8c5a-024e3890aa27" status: 200 len: 1526 microversion: 2.1 time: 0.326675 Aug 31 15:59:03.806579 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 486/959] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:03 2022] GET /compute/v2.1/servers/aa95066b-b1b8-43d8-8c5a-024e3890aa27 => generated 1526 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:03.811259 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9788fa4d-d5fd-403c-9bb0-d7663bfc69c6 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Action: 'action', calling method: .version_select at 0x7f5aeac728b0>, body: {"addFloatingIp": {"address": "172.25.6.6"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:59:03.813705 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9788fa4d-d5fd-403c-9bb0-d7663bfc69c6 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] [instance: 5de5737d-bcc8-4357-85f0-f4468ac84bc7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:03.823398 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9788fa4d-d5fd-403c-9bb0-d7663bfc69c6 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:03.823934 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9788fa4d-d5fd-403c-9bb0-d7663bfc69c6 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:03.824371 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9788fa4d-d5fd-403c-9bb0-d7663bfc69c6 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:03.825083 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9788fa4d-d5fd-403c-9bb0-d7663bfc69c6 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:03.825540 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9788fa4d-d5fd-403c-9bb0-d7663bfc69c6 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:03.825966 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9788fa4d-d5fd-403c-9bb0-d7663bfc69c6 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:03.832517 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b07a68dd-6d1b-4748-90aa-a17e84e3726e tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a03cc5956ca477abacbe0c26bf18750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea45d1b678342ed812f9912e9f07503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:03.849039 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b07a68dd-6d1b-4748-90aa-a17e84e3726e tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] 10.222.0.61 "GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6" status: 200 len: 1472 microversion: 2.1 time: 0.419890 Aug 31 15:59:03.849815 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 474/960] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:03 2022] GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6 => generated 1472 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:03.857226 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9e482f2b-7e7b-434f-974f-447defbc8d6d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Action: 'create', calling method: .version_select at 0x7f5ae9504550>, body: {"keypair": {"name": "tempest-keypair-1943951676", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIy6mwyx6TxBAC0nEfAXydy8WL+N6LVDZKl+DCVkOPfjIds/AJlFYOnzPLp6exL3Tdigp8UAhXMv1Fo+UTAv1FAwYEaHY7CmYhcgxCBXp57nmR6DReH7UD0gN4h4VAJcNQ=="}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:59:03.877188 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-9e482f2b-7e7b-434f-974f-447defbc8d6d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Getting quotas for project 01a9266ba9b14c6a8b6e79aecfe86df6. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:59:03.888625 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-9e482f2b-7e7b-434f-974f-447defbc8d6d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Getting quotas for user bb8e30aa23194f898b07dfbc6fd8d5de and project 01a9266ba9b14c6a8b6e79aecfe86df6. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:59:03.911976 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9788fa4d-d5fd-403c-9bb0-d7663bfc69c6 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Acquiring lock "refresh_cache-5de5737d-bcc8-4357-85f0-f4468ac84bc7" {{(pid=122257) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 31 15:59:03.912506 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9788fa4d-d5fd-403c-9bb0-d7663bfc69c6 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Acquired lock "refresh_cache-5de5737d-bcc8-4357-85f0-f4468ac84bc7" {{(pid=122257) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 31 15:59:03.924565 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9e482f2b-7e7b-434f-974f-447defbc8d6d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.073208 Aug 31 15:59:03.925346 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 475/961] 10.222.0.61 () {62 vars in 1200 bytes} [Wed Aug 31 15:59:03 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 75 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 31 15:59:03.932911 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2de24969-0f0a-4915-af78-9a4febb31762 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:03.934836 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2de24969-0f0a-4915-af78-9a4febb31762 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: cc085aaa-21b2-48a6-b69c-de4e261dfe7f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:03.942497 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2de24969-0f0a-4915-af78-9a4febb31762 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:03.943242 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2de24969-0f0a-4915-af78-9a4febb31762 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:03.943950 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2de24969-0f0a-4915-af78-9a4febb31762 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:03.945267 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2de24969-0f0a-4915-af78-9a4febb31762 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:03.945974 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2de24969-0f0a-4915-af78-9a4febb31762 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:03.946501 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2de24969-0f0a-4915-af78-9a4febb31762 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:04.317991 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-2de24969-0f0a-4915-af78-9a4febb31762 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:04.330749 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2de24969-0f0a-4915-af78-9a4febb31762 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f" status: 200 len: 1360 microversion: 2.1 time: 0.402952 Aug 31 15:59:04.331711 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 476/962] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:03 2022] GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f => generated 1360 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:04.338819 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d5836ab0-2e38-4222-9bcd-9e89c53cc01c tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:04.342487 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d5836ab0-2e38-4222-9bcd-9e89c53cc01c tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:04.357868 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d5836ab0-2e38-4222-9bcd-9e89c53cc01c tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:04.357868 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d5836ab0-2e38-4222-9bcd-9e89c53cc01c tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:04.361305 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d5836ab0-2e38-4222-9bcd-9e89c53cc01c tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:04.362270 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d5836ab0-2e38-4222-9bcd-9e89c53cc01c tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:04.363982 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d5836ab0-2e38-4222-9bcd-9e89c53cc01c tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:04.364668 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d5836ab0-2e38-4222-9bcd-9e89c53cc01c tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:04.538403 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d5836ab0-2e38-4222-9bcd-9e89c53cc01c tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:04.557026 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d5836ab0-2e38-4222-9bcd-9e89c53cc01c tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:04.558764 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d5836ab0-2e38-4222-9bcd-9e89c53cc01c tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:04.565729 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d5836ab0-2e38-4222-9bcd-9e89c53cc01c tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1560 microversion: 2.91 time: 0.232728 Aug 31 15:59:04.567095 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 477/963] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:59:04 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1560 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:59:04.572668 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-8f621aab-9b92-4bb4-8bb3-b8837dbf9b74 req-5e2bab67-e059-4177-83f2-1ec814c7f990 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa95066b-b1b8-43d8-8c5a-024e3890aa27", "name": "network-vif-unplugged", "status": "completed", "tag": "382402ff-e21a-4c70-b0ca-69cef0f74488"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:59:04.589864 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-8f621aab-9b92-4bb4-8bb3-b8837dbf9b74 req-5e2bab67-e059-4177-83f2-1ec814c7f990 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:04.590534 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-8f621aab-9b92-4bb4-8bb3-b8837dbf9b74 req-5e2bab67-e059-4177-83f2-1ec814c7f990 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:04.594479 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-8f621aab-9b92-4bb4-8bb3-b8837dbf9b74 req-5e2bab67-e059-4177-83f2-1ec814c7f990 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:04.612274 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-8f621aab-9b92-4bb4-8bb3-b8837dbf9b74 req-5e2bab67-e059-4177-83f2-1ec814c7f990 service nova] Creating event network-vif-unplugged:382402ff-e21a-4c70-b0ca-69cef0f74488 for instance aa95066b-b1b8-43d8-8c5a-024e3890aa27 on n-h1-850499-9 Aug 31 15:59:04.629600 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-8f621aab-9b92-4bb4-8bb3-b8837dbf9b74 req-5e2bab67-e059-4177-83f2-1ec814c7f990 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060904 Aug 31 15:59:04.633815 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 478/964] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 15:59:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:59:04.713799 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=26 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:59:04.833506 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-88af548a-0da1-4bbc-bd14-9010524de0e5 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:04.834225 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-88af548a-0da1-4bbc-bd14-9010524de0e5 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] [instance: aa95066b-b1b8-43d8-8c5a-024e3890aa27] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:04.844199 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-88af548a-0da1-4bbc-bd14-9010524de0e5 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:04.844696 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-88af548a-0da1-4bbc-bd14-9010524de0e5 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:04.845137 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-88af548a-0da1-4bbc-bd14-9010524de0e5 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:04.845842 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-88af548a-0da1-4bbc-bd14-9010524de0e5 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:04.846295 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-88af548a-0da1-4bbc-bd14-9010524de0e5 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:04.846811 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-88af548a-0da1-4bbc-bd14-9010524de0e5 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:05.576670 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-88af548a-0da1-4bbc-bd14-9010524de0e5 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccce16c7fda401ea68fb31ea8099d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed252ebf7c741bbb36b553ac1767579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:05.592298 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-88af548a-0da1-4bbc-bd14-9010524de0e5 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "GET /compute/v2.1/servers/aa95066b-b1b8-43d8-8c5a-024e3890aa27" status: 200 len: 1526 microversion: 2.1 time: 0.764926 Aug 31 15:59:05.592880 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 479/965] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:04 2022] GET /compute/v2.1/servers/aa95066b-b1b8-43d8-8c5a-024e3890aa27 => generated 1526 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:05.597819 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-75f3e70d-df11-40a8-9d78-010124bd2654 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:05.598429 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-75f3e70d-df11-40a8-9d78-010124bd2654 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] [instance: e45fa8b9-1545-4bd5-aa5f-402c71ec19c6] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:05.612605 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-75f3e70d-df11-40a8-9d78-010124bd2654 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:05.613108 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-75f3e70d-df11-40a8-9d78-010124bd2654 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:05.613550 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-75f3e70d-df11-40a8-9d78-010124bd2654 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:05.614265 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-75f3e70d-df11-40a8-9d78-010124bd2654 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:05.614727 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-75f3e70d-df11-40a8-9d78-010124bd2654 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:05.627995 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-75f3e70d-df11-40a8-9d78-010124bd2654 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:06.423645 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-75f3e70d-df11-40a8-9d78-010124bd2654 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a03cc5956ca477abacbe0c26bf18750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea45d1b678342ed812f9912e9f07503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:06.437067 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-75f3e70d-df11-40a8-9d78-010124bd2654 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] 10.222.0.61 "GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6" status: 200 len: 1472 microversion: 2.1 time: 0.842951 Aug 31 15:59:06.453410 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 480/966] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:05 2022] GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6 => generated 1472 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:06.466840 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-82f746c5-d683-459e-b6a3-834edb2bb36c tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:06.467531 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-82f746c5-d683-459e-b6a3-834edb2bb36c tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: cc085aaa-21b2-48a6-b69c-de4e261dfe7f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:06.482325 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-82f746c5-d683-459e-b6a3-834edb2bb36c tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:06.484857 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-82f746c5-d683-459e-b6a3-834edb2bb36c tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:06.485716 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-82f746c5-d683-459e-b6a3-834edb2bb36c tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:06.486805 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-82f746c5-d683-459e-b6a3-834edb2bb36c tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:06.487532 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-82f746c5-d683-459e-b6a3-834edb2bb36c tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:06.488575 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-82f746c5-d683-459e-b6a3-834edb2bb36c tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:07.069540 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-82f746c5-d683-459e-b6a3-834edb2bb36c tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:07.080975 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-82f746c5-d683-459e-b6a3-834edb2bb36c tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f" status: 200 len: 1360 microversion: 2.1 time: 0.626354 Aug 31 15:59:07.081561 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 481/967] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:06 2022] GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f => generated 1360 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:07.088498 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1272a3df-2395-4637-a1a1-6df83e47b54f tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:07.089110 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1272a3df-2395-4637-a1a1-6df83e47b54f tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:07.095754 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1272a3df-2395-4637-a1a1-6df83e47b54f tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:07.096537 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1272a3df-2395-4637-a1a1-6df83e47b54f tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:07.097194 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1272a3df-2395-4637-a1a1-6df83e47b54f tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:07.098341 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1272a3df-2395-4637-a1a1-6df83e47b54f tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:07.098966 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1272a3df-2395-4637-a1a1-6df83e47b54f tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:07.099744 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1272a3df-2395-4637-a1a1-6df83e47b54f tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:07.237062 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1272a3df-2395-4637-a1a1-6df83e47b54f tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:07.252459 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1272a3df-2395-4637-a1a1-6df83e47b54f tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:07.259312 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1272a3df-2395-4637-a1a1-6df83e47b54f tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:07.272569 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1272a3df-2395-4637-a1a1-6df83e47b54f tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1555 microversion: 2.91 time: 0.189378 Aug 31 15:59:07.273785 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 482/968] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:59:07 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1555 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:59:07.289625 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e36ff69e-1b88-4586-a979-25884914941b tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:07.291097 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e36ff69e-1b88-4586-a979-25884914941b tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] [instance: aa95066b-b1b8-43d8-8c5a-024e3890aa27] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:07.309416 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e36ff69e-1b88-4586-a979-25884914941b tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:07.310605 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e36ff69e-1b88-4586-a979-25884914941b tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:07.313294 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e36ff69e-1b88-4586-a979-25884914941b tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:07.314168 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e36ff69e-1b88-4586-a979-25884914941b tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:07.314893 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e36ff69e-1b88-4586-a979-25884914941b tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:07.315436 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e36ff69e-1b88-4586-a979-25884914941b tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:07.797739 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e36ff69e-1b88-4586-a979-25884914941b tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccce16c7fda401ea68fb31ea8099d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed252ebf7c741bbb36b553ac1767579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:07.812096 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e36ff69e-1b88-4586-a979-25884914941b tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "GET /compute/v2.1/servers/aa95066b-b1b8-43d8-8c5a-024e3890aa27" status: 200 len: 1526 microversion: 2.1 time: 0.533754 Aug 31 15:59:07.813891 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 483/969] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:07 2022] GET /compute/v2.1/servers/aa95066b-b1b8-43d8-8c5a-024e3890aa27 => generated 1526 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:07.820834 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ca44d961-28cb-4462-89bc-90ac328b4c92 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-289646784", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "networks": [{"uuid": "46991353-f00e-44c7-9ba5-793d81b25791"}], "security_groups": [{"name": "tempest-securitygroup--1945271864"}], "key_name": "tempest-keypair-1943951676", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:59:08.325393 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-ca44d961-28cb-4462-89bc-90ac328b4c92 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] validate_networks() for [('46991353-f00e-44c7-9ba5-793d81b25791', None, None, None, None, None)] {{(pid=122256) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 15:59:08.950563 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=26 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:59:08.969807 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-9788fa4d-d5fd-403c-9bb0-d7663bfc69c6 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] [instance: 5de5737d-bcc8-4357-85f0-f4468ac84bc7] Building network info cache for instance {{(pid=122257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 31 15:59:09.921499 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-ca44d961-28cb-4462-89bc-90ac328b4c92 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 15:59:09.924286 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-ca44d961-28cb-4462-89bc-90ac328b4c92 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 15:59:09.925038 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-ca44d961-28cb-4462-89bc-90ac328b4c92 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 15:59:09.925779 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-ca44d961-28cb-4462-89bc-90ac328b4c92 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 15:59:09.926367 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-ca44d961-28cb-4462-89bc-90ac328b4c92 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 15:59:09.943824 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ca44d961-28cb-4462-89bc-90ac328b4c92 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:09.944327 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ca44d961-28cb-4462-89bc-90ac328b4c92 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:09.946904 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ca44d961-28cb-4462-89bc-90ac328b4c92 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:09.947910 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ca44d961-28cb-4462-89bc-90ac328b4c92 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:09.950254 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ca44d961-28cb-4462-89bc-90ac328b4c92 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:09.950893 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ca44d961-28cb-4462-89bc-90ac328b4c92 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:10.001447 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-ca44d961-28cb-4462-89bc-90ac328b4c92 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Getting quotas for project 01a9266ba9b14c6a8b6e79aecfe86df6. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:59:10.022076 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-ca44d961-28cb-4462-89bc-90ac328b4c92 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Getting quotas for user bb8e30aa23194f898b07dfbc6fd8d5de and project 01a9266ba9b14c6a8b6e79aecfe86df6. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:59:10.072683 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ca44d961-28cb-4462-89bc-90ac328b4c92 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Going to run 1 instances... {{(pid=122256) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 15:59:10.082745 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ca44d961-28cb-4462-89bc-90ac328b4c92 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 35b89015-3888-493a-b521-49a5e3769b00] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 15:59:10.191447 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ca44d961-28cb-4462-89bc-90ac328b4c92 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.25 time: 2.375801 Aug 31 15:59:10.192439 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 484/970] 10.222.0.61 () {62 vars in 1188 bytes} [Wed Aug 31 15:59:07 2022] POST /compute/v2.1/servers => generated 406 bytes in 2378 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 31 15:59:10.198033 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-da8d8526-891e-44d6-aa8e-758abb3c4a7c tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:10.199029 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-da8d8526-891e-44d6-aa8e-758abb3c4a7c tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] [instance: e45fa8b9-1545-4bd5-aa5f-402c71ec19c6] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:10.205933 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-da8d8526-891e-44d6-aa8e-758abb3c4a7c tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:10.208067 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-da8d8526-891e-44d6-aa8e-758abb3c4a7c tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:10.208697 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-da8d8526-891e-44d6-aa8e-758abb3c4a7c tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:10.209807 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-da8d8526-891e-44d6-aa8e-758abb3c4a7c tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:10.211654 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-da8d8526-891e-44d6-aa8e-758abb3c4a7c tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:10.213014 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-da8d8526-891e-44d6-aa8e-758abb3c4a7c tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:10.745373 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-da8d8526-891e-44d6-aa8e-758abb3c4a7c tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a03cc5956ca477abacbe0c26bf18750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea45d1b678342ed812f9912e9f07503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:10.777661 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-da8d8526-891e-44d6-aa8e-758abb3c4a7c tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] 10.222.0.61 "GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6" status: 200 len: 1472 microversion: 2.1 time: 0.583318 Aug 31 15:59:10.780403 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 485/971] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:10 2022] GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6 => generated 1472 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:10.796478 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-b6bcf5c8-5f44-4bb0-804f-7ee9f062c0ac req-a2dae22d-5f79-4aa7-9291-69f5d011f282 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa95066b-b1b8-43d8-8c5a-024e3890aa27", "name": "network-vif-deleted", "tag": "382402ff-e21a-4c70-b0ca-69cef0f74488"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:59:10.830008 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-b6bcf5c8-5f44-4bb0-804f-7ee9f062c0ac req-a2dae22d-5f79-4aa7-9291-69f5d011f282 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:10.831165 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-b6bcf5c8-5f44-4bb0-804f-7ee9f062c0ac req-a2dae22d-5f79-4aa7-9291-69f5d011f282 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:10.831921 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-b6bcf5c8-5f44-4bb0-804f-7ee9f062c0ac req-a2dae22d-5f79-4aa7-9291-69f5d011f282 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:10.859144 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-b6bcf5c8-5f44-4bb0-804f-7ee9f062c0ac req-a2dae22d-5f79-4aa7-9291-69f5d011f282 service nova] Creating event network-vif-deleted:382402ff-e21a-4c70-b0ca-69cef0f74488 for instance aa95066b-b1b8-43d8-8c5a-024e3890aa27 on n-h1-850499-9 Aug 31 15:59:10.871933 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-b6bcf5c8-5f44-4bb0-804f-7ee9f062c0ac req-a2dae22d-5f79-4aa7-9291-69f5d011f282 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087139 Aug 31 15:59:10.882267 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 486/972] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 15:59:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:59:10.888922 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-109420ab-8db9-434b-99d1-59ecdf0c4778 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:10.892580 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-109420ab-8db9-434b-99d1-59ecdf0c4778 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: cc085aaa-21b2-48a6-b69c-de4e261dfe7f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:10.904660 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-109420ab-8db9-434b-99d1-59ecdf0c4778 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:10.906738 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-109420ab-8db9-434b-99d1-59ecdf0c4778 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:10.909453 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-109420ab-8db9-434b-99d1-59ecdf0c4778 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:10.910684 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-109420ab-8db9-434b-99d1-59ecdf0c4778 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:10.913708 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-109420ab-8db9-434b-99d1-59ecdf0c4778 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:10.914886 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-109420ab-8db9-434b-99d1-59ecdf0c4778 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:11.105609 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-9788fa4d-d5fd-403c-9bb0-d7663bfc69c6 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] [instance: 5de5737d-bcc8-4357-85f0-f4468ac84bc7] Updating instance_info_cache with network_info: [{"id": "860bd128-aaa5-4d35-b493-f0871fc78fdb", "address": "fa:16:3e:59:22:82", "network": {"id": "05c79ad7-21d0-4e49-a22e-297e68a6eb17", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1953907254-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.6.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "0d5746b9f74e4fecbf2da098436f2ce4", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap860bd128-aa", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 31 15:59:11.130863 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9788fa4d-d5fd-403c-9bb0-d7663bfc69c6 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Releasing lock "refresh_cache-5de5737d-bcc8-4357-85f0-f4468ac84bc7" {{(pid=122257) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 31 15:59:11.133304 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9788fa4d-d5fd-403c-9bb0-d7663bfc69c6 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] 10.222.0.61 "POST /compute/v2.1/servers/5de5737d-bcc8-4357-85f0-f4468ac84bc7/action" status: 202 len: 0 microversion: 2.1 time: 7.325709 Aug 31 15:59:11.134451 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 487/973] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 15:59:03 2022] POST /compute/v2.1/servers/5de5737d-bcc8-4357-85f0-f4468ac84bc7/action => generated 0 bytes in 7327 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 31 15:59:11.141486 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c524a874-9d69-4178-807a-c9473e8f1dd2 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:11.142393 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c524a874-9d69-4178-807a-c9473e8f1dd2 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:11.156982 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c524a874-9d69-4178-807a-c9473e8f1dd2 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:11.160079 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c524a874-9d69-4178-807a-c9473e8f1dd2 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:11.160728 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c524a874-9d69-4178-807a-c9473e8f1dd2 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:11.161618 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c524a874-9d69-4178-807a-c9473e8f1dd2 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:11.162248 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c524a874-9d69-4178-807a-c9473e8f1dd2 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:11.164044 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c524a874-9d69-4178-807a-c9473e8f1dd2 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:11.243553 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-109420ab-8db9-434b-99d1-59ecdf0c4778 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:11.265994 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-109420ab-8db9-434b-99d1-59ecdf0c4778 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f" status: 200 len: 1360 microversion: 2.1 time: 0.381734 Aug 31 15:59:11.321004 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 487/974] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:10 2022] GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f => generated 1360 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:11.331178 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-25b22a2b-caed-4761-81f8-9c08653027f2 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:11.341167 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-25b22a2b-caed-4761-81f8-9c08653027f2 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] [instance: aa95066b-b1b8-43d8-8c5a-024e3890aa27] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:11.360769 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-25b22a2b-caed-4761-81f8-9c08653027f2 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:11.361532 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-25b22a2b-caed-4761-81f8-9c08653027f2 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:11.363313 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-25b22a2b-caed-4761-81f8-9c08653027f2 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:11.364266 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-25b22a2b-caed-4761-81f8-9c08653027f2 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:11.369078 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-25b22a2b-caed-4761-81f8-9c08653027f2 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:11.369766 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-25b22a2b-caed-4761-81f8-9c08653027f2 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:11.403442 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-25b22a2b-caed-4761-81f8-9c08653027f2 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] HTTP exception thrown: Instance aa95066b-b1b8-43d8-8c5a-024e3890aa27 could not be found. Aug 31 15:59:11.405265 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c524a874-9d69-4178-807a-c9473e8f1dd2 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:11.406099 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-25b22a2b-caed-4761-81f8-9c08653027f2 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Request method failure captured: Aug 31 15:59:11.406099 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/aa95066b-b1b8-43d8-8c5a-024e3890aa27 HTTP/1.1 Aug 31 15:59:11.406099 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 15:59:11.406099 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 15:59:11.406099 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 15:59:11.406099 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 15:59:11.406099 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 15:59:11.406099 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 15:59:11.406099 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 15:59:11.406099 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 15:59:11.406099 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4UcGHO9gatUvWJBB907oWawoQP70h6HsJbsny_eFggCHTOgqUkoCg1AvAVcAHjORdEbkXL7xp_g0w0MdWTsQsxdtQLftyhBkZlCr9g7XUi02ZEumxE15kVflv1oC3aQIZmyWr_qGIamtOyoWvoJnlxnc8ckdznU53DKuHgbDBtijYA Aug 31 15:59:11.406099 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 15:59:11.406099 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 15:59:11.406099 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 15:59:11.406099 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 15:59:11.406099 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 15:59:11.406099 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 15:59:11.406099 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 7ed252ebf7c741bbb36b553ac1767579 Aug 31 15:59:11.406099 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-977175069 Aug 31 15:59:11.406099 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 15:59:11.406099 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 15:59:11.407890 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7ed252ebf7c741bbb36b553ac1767579"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7ed252ebf7c741bbb36b553ac1767579"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7ed252ebf7c741bbb36b553ac1767579", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7ed252ebf7c741bbb36b553ac1767579"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 15:59:11.407890 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-977175069 Aug 31 15:59:11.407890 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 7ed252ebf7c741bbb36b553ac1767579 Aug 31 15:59:11.407890 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-977175069 Aug 31 15:59:11.407890 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ImagesOneServerNegativeTestJSON-977175069-project Aug 31 15:59:11.407890 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 15:59:11.407890 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 15:59:11.407890 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 3ccce16c7fda401ea68fb31ea8099d78 Aug 31 15:59:11.407890 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-977175069-project Aug 31 15:59:11.407890 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 15:59:11.407890 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance aa95066b-b1b8-43d8-8c5a-024e3890aa27 could not be found. Aug 31 15:59:11.407890 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': 'aa95066b-b1b8-43d8-8c5a-024e3890aa27'} Aug 31 15:59:11.408912 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:59:11.408912 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:11.408912 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 15:59:11.408912 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 15:59:11.408912 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 15:59:11.408912 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 15:59:11.408912 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 15:59:11.408912 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 15:59:11.408912 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 15:59:11.408912 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 15:59:11.408912 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa95066b-b1b8-43d8-8c5a-024e3890aa27 could not be found. Aug 31 15:59:11.408912 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:59:11.408912 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:59:11.408912 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:59:11.408912 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:11.408912 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:59:11.408912 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:59:11.408912 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:59:11.408912 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:59:11.408912 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:59:11.411539 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:59:11.411539 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 15:59:11.411539 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 15:59:11.411539 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 15:59:11.411539 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 15:59:11.411539 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 15:59:11.411539 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:59:11.411539 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa95066b-b1b8-43d8-8c5a-024e3890aa27 could not be found. Aug 31 15:59:11.411539 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:59:11.411539 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:59:11.411539 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:59:11.411539 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:11.411539 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:59:11.411539 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:59:11.411539 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:59:11.411539 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:59:11.411539 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa95066b-b1b8-43d8-8c5a-024e3890aa27 could not be found. Aug 31 15:59:11.411539 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:59:11.414652 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-25b22a2b-caed-4761-81f8-9c08653027f2 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Returning 404 to user: Instance aa95066b-b1b8-43d8-8c5a-024e3890aa27 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:59:11.415843 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-25b22a2b-caed-4761-81f8-9c08653027f2 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "GET /compute/v2.1/servers/aa95066b-b1b8-43d8-8c5a-024e3890aa27" status: 404 len: 111 microversion: 2.1 time: 0.093721 Aug 31 15:59:11.416879 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 488/975] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:11 2022] GET /compute/v2.1/servers/aa95066b-b1b8-43d8-8c5a-024e3890aa27 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:59:11.422604 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-2d2a9397-9540-4334-9364-09e498eb74b6 req-c93d9c5e-08b6-4bb5-8c45-ea4680cc219b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5de5737d-bcc8-4357-85f0-f4468ac84bc7", "tag": "860bd128-aaa5-4d35-b493-f0871fc78fdb"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:59:11.431004 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c524a874-9d69-4178-807a-c9473e8f1dd2 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:11.434284 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-2d2a9397-9540-4334-9364-09e498eb74b6 req-c93d9c5e-08b6-4bb5-8c45-ea4680cc219b service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:11.435211 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-2d2a9397-9540-4334-9364-09e498eb74b6 req-c93d9c5e-08b6-4bb5-8c45-ea4680cc219b service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:11.435859 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-2d2a9397-9540-4334-9364-09e498eb74b6 req-c93d9c5e-08b6-4bb5-8c45-ea4680cc219b service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:11.441735 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c524a874-9d69-4178-807a-c9473e8f1dd2 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:11.450290 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-2d2a9397-9540-4334-9364-09e498eb74b6 req-c93d9c5e-08b6-4bb5-8c45-ea4680cc219b service nova] Creating event network-changed:860bd128-aaa5-4d35-b493-f0871fc78fdb for instance 5de5737d-bcc8-4357-85f0-f4468ac84bc7 on n-h1-850499-9 Aug 31 15:59:11.456221 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-2d2a9397-9540-4334-9364-09e498eb74b6 req-c93d9c5e-08b6-4bb5-8c45-ea4680cc219b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037905 Aug 31 15:59:11.461504 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 489/976] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 15:59:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:59:11.467585 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-4b9e78e8-bfa2-4319-951f-132e6764bd4a req-eba11528-76af-4b43-84d2-7efe55d9fa98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc085aaa-21b2-48a6-b69c-de4e261dfe7f", "name": "network-vif-plugged", "status": "completed", "tag": "c4a89a46-30ca-4df0-bd23-f2ae8050bb54"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:59:11.481530 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c524a874-9d69-4178-807a-c9473e8f1dd2 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1555 microversion: 2.91 time: 0.340075 Aug 31 15:59:11.482174 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 488/977] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:59:11 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1555 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:59:11.484045 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-4b9e78e8-bfa2-4319-951f-132e6764bd4a req-eba11528-76af-4b43-84d2-7efe55d9fa98 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:11.484932 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-4b9e78e8-bfa2-4319-951f-132e6764bd4a req-eba11528-76af-4b43-84d2-7efe55d9fa98 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:11.485604 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-4b9e78e8-bfa2-4319-951f-132e6764bd4a req-eba11528-76af-4b43-84d2-7efe55d9fa98 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:11.502503 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-22f62fe4-0b27-4274-88b9-8ebe07f69d38 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:11.503146 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-22f62fe4-0b27-4274-88b9-8ebe07f69d38 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 35b89015-3888-493a-b521-49a5e3769b00] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:11.530143 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-4b9e78e8-bfa2-4319-951f-132e6764bd4a req-eba11528-76af-4b43-84d2-7efe55d9fa98 service nova] Creating event network-vif-plugged:c4a89a46-30ca-4df0-bd23-f2ae8050bb54 for instance cc085aaa-21b2-48a6-b69c-de4e261dfe7f on n-h1-850499-9 Aug 31 15:59:11.531587 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-22f62fe4-0b27-4274-88b9-8ebe07f69d38 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:11.532902 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-22f62fe4-0b27-4274-88b9-8ebe07f69d38 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:11.541679 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-22f62fe4-0b27-4274-88b9-8ebe07f69d38 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:11.545731 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-4b9e78e8-bfa2-4319-951f-132e6764bd4a req-eba11528-76af-4b43-84d2-7efe55d9fa98 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082366 Aug 31 15:59:11.546397 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-22f62fe4-0b27-4274-88b9-8ebe07f69d38 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:11.547122 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 490/978] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 15:59:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:59:11.551413 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-22f62fe4-0b27-4274-88b9-8ebe07f69d38 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:11.552203 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-22f62fe4-0b27-4274-88b9-8ebe07f69d38 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:11.568067 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a17a2c5b-c84b-4757-95b1-c9618c7341ba tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Action: 'create', calling method: .version_select at 0x7f5ae9326dc0>, body: {"pool": "edca2db6-2c46-4009-a3d6-11849a8e2dfd"} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:59:11.925979 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-22f62fe4-0b27-4274-88b9-8ebe07f69d38 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:11.949693 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-22f62fe4-0b27-4274-88b9-8ebe07f69d38 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:11.960574 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-22f62fe4-0b27-4274-88b9-8ebe07f69d38 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:11.963011 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-22f62fe4-0b27-4274-88b9-8ebe07f69d38 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00" status: 200 len: 1281 microversion: 2.25 time: 0.474682 Aug 31 15:59:11.969574 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 489/979] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:59:11 2022] GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00 => generated 1281 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:59:11.975136 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-71211507-3cab-438f-9a6a-26c4a6b3369c tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Action: 'create', calling method: .version_select at 0x7f5ae8ea5280>, body: {"keypair": {"name": "tempest-keypair-433566045", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBOgDeb6w4rfRkzZh0zhp+5ulLmTGPO/n+nIMnXMzIJEJGirxzrJSo40QEtiLpq3B2rp/e03VVt4JxyX+r3dk+sY7wVXYdBgMLIUZxuNqFEf3IGq9z9MsRTs3Ci+skWrSQ=="}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:59:11.995612 n-d-850499-9 devstack@n-api.service[122257]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 15:59:11.996044 n-d-850499-9 devstack@n-api.service[122257]: Wed Aug 31 15:59:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.61) !!! Aug 31 15:59:12.049770 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-71211507-3cab-438f-9a6a-26c4a6b3369c tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Getting quotas for project 7ed252ebf7c741bbb36b553ac1767579. Resources: {'key_pairs'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:59:12.065920 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-71211507-3cab-438f-9a6a-26c4a6b3369c tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Getting quotas for user 3ccce16c7fda401ea68fb31ea8099d78 and project 7ed252ebf7c741bbb36b553ac1767579. Resources: {'key_pairs'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:59:12.135624 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=96,nova_api:UPDATE=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:59:12.152207 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-71211507-3cab-438f-9a6a-26c4a6b3369c tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.179855 Aug 31 15:59:12.178281 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 490/980] 10.222.0.61 () {60 vars in 1159 bytes} [Wed Aug 31 15:59:11 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:59:12.215174 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d07768b0-6e6a-4a44-87b4-3373d0bf0f05 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:12.217078 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d07768b0-6e6a-4a44-87b4-3373d0bf0f05 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] [instance: e45fa8b9-1545-4bd5-aa5f-402c71ec19c6] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:12.280997 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d07768b0-6e6a-4a44-87b4-3373d0bf0f05 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:12.285519 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d07768b0-6e6a-4a44-87b4-3373d0bf0f05 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:12.291157 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d07768b0-6e6a-4a44-87b4-3373d0bf0f05 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:12.294944 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d07768b0-6e6a-4a44-87b4-3373d0bf0f05 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:12.299296 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d07768b0-6e6a-4a44-87b4-3373d0bf0f05 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:12.308602 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d07768b0-6e6a-4a44-87b4-3373d0bf0f05 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:13.015743 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d07768b0-6e6a-4a44-87b4-3373d0bf0f05 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a03cc5956ca477abacbe0c26bf18750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea45d1b678342ed812f9912e9f07503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:13.031550 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d07768b0-6e6a-4a44-87b4-3373d0bf0f05 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] 10.222.0.61 "GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6" status: 200 len: 1472 microversion: 2.1 time: 0.833641 Aug 31 15:59:13.045221 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 491/981] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:12 2022] GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6 => generated 1472 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:13.070205 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-159e2a21-4c15-4fe0-86ed-eb1f5ff0f87d tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:13.070878 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-159e2a21-4c15-4fe0-86ed-eb1f5ff0f87d tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: cc085aaa-21b2-48a6-b69c-de4e261dfe7f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:13.109562 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-159e2a21-4c15-4fe0-86ed-eb1f5ff0f87d tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:13.110397 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-159e2a21-4c15-4fe0-86ed-eb1f5ff0f87d tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:13.111033 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-159e2a21-4c15-4fe0-86ed-eb1f5ff0f87d tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:13.112085 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-159e2a21-4c15-4fe0-86ed-eb1f5ff0f87d tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:13.112753 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-159e2a21-4c15-4fe0-86ed-eb1f5ff0f87d tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:13.113443 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-159e2a21-4c15-4fe0-86ed-eb1f5ff0f87d tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:14.055666 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-159e2a21-4c15-4fe0-86ed-eb1f5ff0f87d tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:14.079957 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-159e2a21-4c15-4fe0-86ed-eb1f5ff0f87d tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f" status: 200 len: 1360 microversion: 2.1 time: 1.030946 Aug 31 15:59:14.081416 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 492/982] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:13 2022] GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f => generated 1360 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:14.089946 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a10cbbbd-e7d1-4093-bfe6-33aa8a3a872c tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:14.091330 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a10cbbbd-e7d1-4093-bfe6-33aa8a3a872c tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:14.099690 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a10cbbbd-e7d1-4093-bfe6-33aa8a3a872c tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:14.101095 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a10cbbbd-e7d1-4093-bfe6-33aa8a3a872c tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:14.103646 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a10cbbbd-e7d1-4093-bfe6-33aa8a3a872c tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:14.104894 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a10cbbbd-e7d1-4093-bfe6-33aa8a3a872c tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:14.105605 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a10cbbbd-e7d1-4093-bfe6-33aa8a3a872c tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:14.106264 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a10cbbbd-e7d1-4093-bfe6-33aa8a3a872c tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:14.258350 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a10cbbbd-e7d1-4093-bfe6-33aa8a3a872c tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:14.271001 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a10cbbbd-e7d1-4093-bfe6-33aa8a3a872c tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:14.275124 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a10cbbbd-e7d1-4093-bfe6-33aa8a3a872c tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:14.291358 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a10cbbbd-e7d1-4093-bfe6-33aa8a3a872c tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1555 microversion: 2.91 time: 0.206820 Aug 31 15:59:14.294087 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 493/983] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:59:14 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1555 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:59:14.325111 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5bba2e27-bc08-4401-b46a-cdd8c48ac130 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:14.325954 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5bba2e27-bc08-4401-b46a-cdd8c48ac130 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 35b89015-3888-493a-b521-49a5e3769b00] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:14.341862 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5bba2e27-bc08-4401-b46a-cdd8c48ac130 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:14.342520 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5bba2e27-bc08-4401-b46a-cdd8c48ac130 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:14.343052 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5bba2e27-bc08-4401-b46a-cdd8c48ac130 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:14.343922 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5bba2e27-bc08-4401-b46a-cdd8c48ac130 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:14.349304 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5bba2e27-bc08-4401-b46a-cdd8c48ac130 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:14.349910 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5bba2e27-bc08-4401-b46a-cdd8c48ac130 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:14.486085 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5bba2e27-bc08-4401-b46a-cdd8c48ac130 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:14.501444 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5bba2e27-bc08-4401-b46a-cdd8c48ac130 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:14.506335 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5bba2e27-bc08-4401-b46a-cdd8c48ac130 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:14.513696 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5bba2e27-bc08-4401-b46a-cdd8c48ac130 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00" status: 200 len: 1345 microversion: 2.25 time: 0.204360 Aug 31 15:59:14.528754 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 494/984] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:59:14 2022] GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00 => generated 1345 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:59:14.540629 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a9ef9c58-92ed-456e-9451-b55cf37c4f0c tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:14.544853 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a9ef9c58-92ed-456e-9451-b55cf37c4f0c tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] [instance: e45fa8b9-1545-4bd5-aa5f-402c71ec19c6] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:14.564258 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a9ef9c58-92ed-456e-9451-b55cf37c4f0c tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:14.564941 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a9ef9c58-92ed-456e-9451-b55cf37c4f0c tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:14.565566 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a9ef9c58-92ed-456e-9451-b55cf37c4f0c tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:14.566650 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a9ef9c58-92ed-456e-9451-b55cf37c4f0c tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:14.567427 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a9ef9c58-92ed-456e-9451-b55cf37c4f0c tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:14.567871 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a9ef9c58-92ed-456e-9451-b55cf37c4f0c tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:16.074344 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a9ef9c58-92ed-456e-9451-b55cf37c4f0c tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a03cc5956ca477abacbe0c26bf18750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea45d1b678342ed812f9912e9f07503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:16.086439 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a9ef9c58-92ed-456e-9451-b55cf37c4f0c tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] 10.222.0.61 "GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6" status: 200 len: 1478 microversion: 2.1 time: 1.556114 Aug 31 15:59:16.101990 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 495/985] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:14 2022] GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6 => generated 1478 bytes in 1572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:16.108938 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2ae37429-dd40-455c-af90-938a5d20d58d tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:16.109986 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2ae37429-dd40-455c-af90-938a5d20d58d tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: cc085aaa-21b2-48a6-b69c-de4e261dfe7f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:16.117273 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2ae37429-dd40-455c-af90-938a5d20d58d tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:16.118133 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2ae37429-dd40-455c-af90-938a5d20d58d tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:16.118817 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2ae37429-dd40-455c-af90-938a5d20d58d tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:16.119863 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2ae37429-dd40-455c-af90-938a5d20d58d tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:16.120555 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2ae37429-dd40-455c-af90-938a5d20d58d tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:16.121189 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2ae37429-dd40-455c-af90-938a5d20d58d tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:16.714937 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2ae37429-dd40-455c-af90-938a5d20d58d tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:16.733694 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2ae37429-dd40-455c-af90-938a5d20d58d tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f" status: 200 len: 1544 microversion: 2.1 time: 0.621924 Aug 31 15:59:16.736810 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 496/986] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:16 2022] GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f => generated 1544 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:16.759459 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9d3b61fb-88a1-422a-ba40-bc3f2439d0fd tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:16.764272 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9d3b61fb-88a1-422a-ba40-bc3f2439d0fd tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:16.802481 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9d3b61fb-88a1-422a-ba40-bc3f2439d0fd tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:16.804187 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9d3b61fb-88a1-422a-ba40-bc3f2439d0fd tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:16.805015 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9d3b61fb-88a1-422a-ba40-bc3f2439d0fd tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:16.806997 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9d3b61fb-88a1-422a-ba40-bc3f2439d0fd tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:16.808003 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9d3b61fb-88a1-422a-ba40-bc3f2439d0fd tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:16.811911 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9d3b61fb-88a1-422a-ba40-bc3f2439d0fd tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:17.035064 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9d3b61fb-88a1-422a-ba40-bc3f2439d0fd tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:17.051884 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9d3b61fb-88a1-422a-ba40-bc3f2439d0fd tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:17.068443 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9d3b61fb-88a1-422a-ba40-bc3f2439d0fd tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:17.089476 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9d3b61fb-88a1-422a-ba40-bc3f2439d0fd tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1555 microversion: 2.91 time: 0.344760 Aug 31 15:59:17.094692 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 497/987] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:59:16 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1555 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:59:17.119167 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b1dadec9-8481-43e6-9c35-7374421853b1 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:17.120146 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b1dadec9-8481-43e6-9c35-7374421853b1 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 35b89015-3888-493a-b521-49a5e3769b00] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:17.127187 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b1dadec9-8481-43e6-9c35-7374421853b1 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:17.127944 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b1dadec9-8481-43e6-9c35-7374421853b1 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:17.128545 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b1dadec9-8481-43e6-9c35-7374421853b1 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:17.129449 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b1dadec9-8481-43e6-9c35-7374421853b1 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:17.130061 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b1dadec9-8481-43e6-9c35-7374421853b1 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:17.130648 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b1dadec9-8481-43e6-9c35-7374421853b1 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:17.212087 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b1dadec9-8481-43e6-9c35-7374421853b1 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:17.247036 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b1dadec9-8481-43e6-9c35-7374421853b1 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:17.253298 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b1dadec9-8481-43e6-9c35-7374421853b1 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:17.256616 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b1dadec9-8481-43e6-9c35-7374421853b1 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00" status: 200 len: 1345 microversion: 2.25 time: 0.158574 Aug 31 15:59:17.261759 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 498/988] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:59:17 2022] GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00 => generated 1345 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:59:17.269598 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ebf4668c-43b7-4ebd-b42f-4ec1431191ea tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:17.270922 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ebf4668c-43b7-4ebd-b42f-4ec1431191ea tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: cc085aaa-21b2-48a6-b69c-de4e261dfe7f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:17.297860 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ebf4668c-43b7-4ebd-b42f-4ec1431191ea tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:17.298608 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ebf4668c-43b7-4ebd-b42f-4ec1431191ea tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:17.300544 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ebf4668c-43b7-4ebd-b42f-4ec1431191ea tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:17.308651 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ebf4668c-43b7-4ebd-b42f-4ec1431191ea tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:17.309430 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ebf4668c-43b7-4ebd-b42f-4ec1431191ea tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:17.310158 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ebf4668c-43b7-4ebd-b42f-4ec1431191ea tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:17.442572 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a17a2c5b-c84b-4757-95b1-c9618c7341ba tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] 10.222.0.61 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.893983 Aug 31 15:59:17.443288 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 491/989] 10.222.0.61 () {60 vars in 1170 bytes} [Wed Aug 31 15:59:11 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5896 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:59:17.458690 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f5bbde3b-3bd9-4ec0-b148-416051b621ec tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-516990405", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:59:17.588908 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-f5bbde3b-3bd9-4ec0-b148-416051b621ec tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] validate_networks() for [('d974b675-118c-4df8-9a7d-474c1e34f49f', None, None, None, None, None)] {{(pid=122256) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 15:59:17.657903 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ebf4668c-43b7-4ebd-b42f-4ec1431191ea tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.394795 Aug 31 15:59:17.659089 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 499/990] 10.222.0.61 () {58 vars in 1275 bytes} [Wed Aug 31 15:59:17 2022] GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f/os-interface => generated 285 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:59:17.668356 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-aa4e6ad6-398e-4b21-8e5f-6fb9fd8575f5 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:17.683322 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-aa4e6ad6-398e-4b21-8e5f-6fb9fd8575f5 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] [instance: e45fa8b9-1545-4bd5-aa5f-402c71ec19c6] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:17.714516 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-aa4e6ad6-398e-4b21-8e5f-6fb9fd8575f5 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:17.717817 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-aa4e6ad6-398e-4b21-8e5f-6fb9fd8575f5 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:17.718524 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-aa4e6ad6-398e-4b21-8e5f-6fb9fd8575f5 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:17.719541 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-aa4e6ad6-398e-4b21-8e5f-6fb9fd8575f5 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:17.722436 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-aa4e6ad6-398e-4b21-8e5f-6fb9fd8575f5 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:17.723691 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-aa4e6ad6-398e-4b21-8e5f-6fb9fd8575f5 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:17.734004 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:59:18.264656 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-aa4e6ad6-398e-4b21-8e5f-6fb9fd8575f5 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a03cc5956ca477abacbe0c26bf18750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea45d1b678342ed812f9912e9f07503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:18.284072 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-aa4e6ad6-398e-4b21-8e5f-6fb9fd8575f5 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] 10.222.0.61 "GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6" status: 200 len: 1478 microversion: 2.1 time: 0.614042 Aug 31 15:59:18.285302 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 500/991] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:17 2022] GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6 => generated 1478 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:18.292481 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-15583337-3f6a-445d-85bd-b16278ba9b9f tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.6.187"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:59:18.297625 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-15583337-3f6a-445d-85bd-b16278ba9b9f tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] [instance: 5de5737d-bcc8-4357-85f0-f4468ac84bc7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:18.314831 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-15583337-3f6a-445d-85bd-b16278ba9b9f tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:18.320436 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-15583337-3f6a-445d-85bd-b16278ba9b9f tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:18.321244 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-15583337-3f6a-445d-85bd-b16278ba9b9f tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:18.322154 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-15583337-3f6a-445d-85bd-b16278ba9b9f tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:18.322807 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-15583337-3f6a-445d-85bd-b16278ba9b9f tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:18.323418 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-15583337-3f6a-445d-85bd-b16278ba9b9f tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:18.383444 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-15583337-3f6a-445d-85bd-b16278ba9b9f tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Acquiring lock "refresh_cache-5de5737d-bcc8-4357-85f0-f4468ac84bc7" {{(pid=122257) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 31 15:59:18.384117 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-15583337-3f6a-445d-85bd-b16278ba9b9f tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Acquired lock "refresh_cache-5de5737d-bcc8-4357-85f0-f4468ac84bc7" {{(pid=122257) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 31 15:59:19.524775 n-d-850499-9 devstack@n-api.service[122257]: DEBUG neutronclient.v2_0.client [None req-15583337-3f6a-445d-85bd-b16278ba9b9f tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.6.187 (01586388-277e-43f2-87af-f8b4c430a2a8) with port 860bd128-aaa5-4d35-b493-f0871fc78fdb using fixed IP 172.20.0.13, as that fixed IP already has a floating IP on external network edca2db6-2c46-4009-a3d6-11849a8e2dfd.", "detail": ""}} {{(pid=122257) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 31 15:59:19.526096 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-15583337-3f6a-445d-85bd-b16278ba9b9f tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Releasing lock "refresh_cache-5de5737d-bcc8-4357-85f0-f4468ac84bc7" {{(pid=122257) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 31 15:59:19.527006 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-15583337-3f6a-445d-85bd-b16278ba9b9f tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] HTTP exception thrown: Cannot associate floating IP 172.25.6.187 (01586388-277e-43f2-87af-f8b4c430a2a8) with port 860bd128-aaa5-4d35-b493-f0871fc78fdb using fixed IP 172.20.0.13, as that fixed IP already has a floating IP on external network edca2db6-2c46-4009-a3d6-11849a8e2dfd. Aug 31 15:59:19.527006 n-d-850499-9 devstack@n-api.service[122257]: Neutron server returns request_ids: ['req-f4ce72a2-58fb-449a-8b4b-d30cbc2ab45b'] Aug 31 15:59:19.536731 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-15583337-3f6a-445d-85bd-b16278ba9b9f tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Request method failure captured: Aug 31 15:59:19.536731 n-d-850499-9 devstack@n-api.service[122257]: request: POST /compute/v2.1/servers/5de5737d-bcc8-4357-85f0-f4468ac84bc7/action HTTP/1.1 Aug 31 15:59:19.536731 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 15:59:19.536731 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 15:59:19.536731 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 15:59:19.536731 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 46 Aug 31 15:59:19.536731 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 15:59:19.536731 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 15:59:19.536731 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 15:59:19.536731 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 15:59:19.536731 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4UwPpoSdZA9uxW3WFL7_35hH44k_Rm1LHX7YzA8CPavMf_yK9gcDBXaQiX3qmdjO0k3V6fiHzSoEdqd4J2LEBtfbz-LvhySlEZZQQZud-oGXxloRxlgDCrurecLuwDL_XkMfJ6_4u6k-LTUscNwKpGuyDQBkM1q0NpdEnTayWAerT0 Aug 31 15:59:19.536731 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 15:59:19.536731 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 15:59:19.536731 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 15:59:19.536731 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 15:59:19.536731 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 15:59:19.536731 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 15:59:19.536731 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 0d5746b9f74e4fecbf2da098436f2ce4 Aug 31 15:59:19.536731 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 Aug 31 15:59:19.536731 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 15:59:19.536731 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 15:59:19.538564 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0d5746b9f74e4fecbf2da098436f2ce4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/0d5746b9f74e4fecbf2da098436f2ce4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_0d5746b9f74e4fecbf2da098436f2ce4", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0d5746b9f74e4fecbf2da098436f2ce4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 15:59:19.538564 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 Aug 31 15:59:19.538564 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 0d5746b9f74e4fecbf2da098436f2ce4 Aug 31 15:59:19.538564 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 Aug 31 15:59:19.538564 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project Aug 31 15:59:19.538564 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 15:59:19.538564 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 15:59:19.538564 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 1a5652ccb7b54cf7a56f25b91c30c904 Aug 31 15:59:19.538564 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project Aug 31 15:59:19.538564 n-d-850499-9 devstack@n-api.service[122257]: Aug 31 15:59:19.538564 n-d-850499-9 devstack@n-api.service[122257]: {"addFloatingIp": {"address": "172.25.6.187"}} Aug 31 15:59:19.538564 n-d-850499-9 devstack@n-api.service[122257]: method: Aug 31 15:59:19.539833 n-d-850499-9 devstack@n-api.service[122257]: exception: Cannot associate floating IP 172.25.6.187 (01586388-277e-43f2-87af-f8b4c430a2a8) with port 860bd128-aaa5-4d35-b493-f0871fc78fdb using fixed IP 172.20.0.13, as that fixed IP already has a floating IP on external network edca2db6-2c46-4009-a3d6-11849a8e2dfd. Aug 31 15:59:19.539833 n-d-850499-9 devstack@n-api.service[122257]: Neutron server returns request_ids: ['req-f4ce72a2-58fb-449a-8b4b-d30cbc2ab45b'] Aug 31 15:59:19.539833 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '5de5737d-bcc8-4357-85f0-f4468ac84bc7', 'body': {'addFloatingIp': {'address': '172.25.6.187'}}} Aug 31 15:59:19.539833 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:59:19.539833 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:19.539833 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2706, in associate_floating_ip Aug 31 15:59:19.539833 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Aug 31 15:59:19.539833 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 15:59:19.539833 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 15:59:19.539833 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1014, in update_floatingip Aug 31 15:59:19.539833 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Aug 31 15:59:19.539833 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 15:59:19.539833 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 15:59:19.539833 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2520, in _update_resource Aug 31 15:59:19.539833 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Aug 31 15:59:19.539833 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 15:59:19.539833 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 15:59:19.540903 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Aug 31 15:59:19.540903 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Aug 31 15:59:19.540903 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 15:59:19.540903 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 15:59:19.540903 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 31 15:59:19.540903 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 31 15:59:19.540903 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 15:59:19.540903 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 15:59:19.540903 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 31 15:59:19.540903 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 31 15:59:19.540903 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 15:59:19.540903 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 15:59:19.540903 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 31 15:59:19.540903 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 31 15:59:19.540903 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 31 15:59:19.540903 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 31 15:59:19.541878 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.6.187 (01586388-277e-43f2-87af-f8b4c430a2a8) with port 860bd128-aaa5-4d35-b493-f0871fc78fdb using fixed IP 172.20.0.13, as that fixed IP already has a floating IP on external network edca2db6-2c46-4009-a3d6-11849a8e2dfd. Aug 31 15:59:19.541878 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f4ce72a2-58fb-449a-8b4b-d30cbc2ab45b'] Aug 31 15:59:19.541878 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:59:19.541878 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:59:19.541878 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:59:19.541878 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:19.541878 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Aug 31 15:59:19.541878 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Aug 31 15:59:19.541878 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Aug 31 15:59:19.541878 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Aug 31 15:59:19.541878 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2708, in associate_floating_ip Aug 31 15:59:19.541878 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Aug 31 15:59:19.541878 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.6.187 (01586388-277e-43f2-87af-f8b4c430a2a8) with port 860bd128-aaa5-4d35-b493-f0871fc78fdb using fixed IP 172.20.0.13, as that fixed IP already has a floating IP on external network edca2db6-2c46-4009-a3d6-11849a8e2dfd. Aug 31 15:59:19.541878 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f4ce72a2-58fb-449a-8b4b-d30cbc2ab45b'] Aug 31 15:59:19.541878 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:59:19.541878 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:59:19.542895 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:59:19.542895 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:19.542895 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:59:19.542895 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:59:19.542895 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:59:19.542895 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:59:19.542895 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 15:59:19.542895 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 15:59:19.542895 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:59:19.542895 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:59:19.542895 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:59:19.542895 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:59:19.542895 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Aug 31 15:59:19.542895 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Aug 31 15:59:19.542895 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.6.187 (01586388-277e-43f2-87af-f8b4c430a2a8) with port 860bd128-aaa5-4d35-b493-f0871fc78fdb using fixed IP 172.20.0.13, as that fixed IP already has a floating IP on external network edca2db6-2c46-4009-a3d6-11849a8e2dfd. Aug 31 15:59:19.542895 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f4ce72a2-58fb-449a-8b4b-d30cbc2ab45b'] Aug 31 15:59:19.542895 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:59:19.542895 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:59:19.548151 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:59:19.548151 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:19.548151 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:59:19.548151 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:59:19.548151 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:59:19.548151 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:59:19.548151 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.6.187 (01586388-277e-43f2-87af-f8b4c430a2a8) with port 860bd128-aaa5-4d35-b493-f0871fc78fdb using fixed IP 172.20.0.13, as that fixed IP already has a floating IP on external network edca2db6-2c46-4009-a3d6-11849a8e2dfd. Aug 31 15:59:19.548151 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f4ce72a2-58fb-449a-8b4b-d30cbc2ab45b'] Aug 31 15:59:19.548151 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:59:19.548151 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-15583337-3f6a-445d-85bd-b16278ba9b9f tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Returning 400 to user: Cannot associate floating IP 172.25.6.187 (01586388-277e-43f2-87af-f8b4c430a2a8) with port 860bd128-aaa5-4d35-b493-f0871fc78fdb using fixed IP 172.20.0.13, as that fixed IP already has a floating IP on external network edca2db6-2c46-4009-a3d6-11849a8e2dfd. Aug 31 15:59:19.548151 n-d-850499-9 devstack@n-api.service[122257]: Neutron server returns request_ids: ['req-f4ce72a2-58fb-449a-8b4b-d30cbc2ab45b'] {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:59:19.551681 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-15583337-3f6a-445d-85bd-b16278ba9b9f tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] 10.222.0.61 "POST /compute/v2.1/servers/5de5737d-bcc8-4357-85f0-f4468ac84bc7/action" status: 400 len: 382 microversion: 2.1 time: 1.251802 Aug 31 15:59:19.551681 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 501/992] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 15:59:18 2022] POST /compute/v2.1/servers/5de5737d-bcc8-4357-85f0-f4468ac84bc7/action => generated 382 bytes in 1253 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 15:59:19.551681 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-708e5f73-fc15-40fe-82ed-1f746757b027 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:19.551681 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-708e5f73-fc15-40fe-82ed-1f746757b027 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:19.577434 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-708e5f73-fc15-40fe-82ed-1f746757b027 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:19.577978 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-708e5f73-fc15-40fe-82ed-1f746757b027 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:19.583724 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-f5bbde3b-3bd9-4ec0-b148-416051b621ec tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 15:59:19.584269 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-f5bbde3b-3bd9-4ec0-b148-416051b621ec tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 15:59:19.584619 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-f5bbde3b-3bd9-4ec0-b148-416051b621ec tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 15:59:19.586310 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-f5bbde3b-3bd9-4ec0-b148-416051b621ec tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 15:59:19.586310 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-f5bbde3b-3bd9-4ec0-b148-416051b621ec tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 15:59:19.596834 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-708e5f73-fc15-40fe-82ed-1f746757b027 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:19.597727 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-708e5f73-fc15-40fe-82ed-1f746757b027 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:19.598218 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-708e5f73-fc15-40fe-82ed-1f746757b027 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:19.598660 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-708e5f73-fc15-40fe-82ed-1f746757b027 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:19.619011 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f5bbde3b-3bd9-4ec0-b148-416051b621ec tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:19.619528 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f5bbde3b-3bd9-4ec0-b148-416051b621ec tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:19.619973 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f5bbde3b-3bd9-4ec0-b148-416051b621ec tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:19.620746 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f5bbde3b-3bd9-4ec0-b148-416051b621ec tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:19.621213 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f5bbde3b-3bd9-4ec0-b148-416051b621ec tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:19.621651 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f5bbde3b-3bd9-4ec0-b148-416051b621ec tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:19.704980 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-f5bbde3b-3bd9-4ec0-b148-416051b621ec tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Getting quotas for project 7ed252ebf7c741bbb36b553ac1767579. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:59:19.723832 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-f5bbde3b-3bd9-4ec0-b148-416051b621ec tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Getting quotas for user 3ccce16c7fda401ea68fb31ea8099d78 and project 7ed252ebf7c741bbb36b553ac1767579. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:59:19.803053 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f5bbde3b-3bd9-4ec0-b148-416051b621ec tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Going to run 1 instances... {{(pid=122256) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 15:59:19.824396 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f5bbde3b-3bd9-4ec0-b148-416051b621ec tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] [instance: aade3ca2-9ecc-48db-988a-1ddbc286024a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 15:59:19.930452 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-708e5f73-fc15-40fe-82ed-1f746757b027 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:19.954178 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-708e5f73-fc15-40fe-82ed-1f746757b027 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:19.971664 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-708e5f73-fc15-40fe-82ed-1f746757b027 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:19.977971 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:59:19.998410 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-708e5f73-fc15-40fe-82ed-1f746757b027 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1555 microversion: 2.91 time: 0.458338 Aug 31 15:59:20.000218 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 502/993] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:59:19 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1555 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:59:20.023017 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-800dc135-0951-4939-9158-20842d3263c1 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:20.024071 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-800dc135-0951-4939-9158-20842d3263c1 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 35b89015-3888-493a-b521-49a5e3769b00] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:20.040818 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f5bbde3b-3bd9-4ec0-b148-416051b621ec tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.596156 Aug 31 15:59:20.050642 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-800dc135-0951-4939-9158-20842d3263c1 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:20.051822 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-800dc135-0951-4939-9158-20842d3263c1 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:20.052666 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 492/994] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 15:59:17 2022] POST /compute/v2.1/servers => generated 383 bytes in 2608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 15:59:20.054949 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-800dc135-0951-4939-9158-20842d3263c1 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:20.057231 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-800dc135-0951-4939-9158-20842d3263c1 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:20.060177 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-800dc135-0951-4939-9158-20842d3263c1 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:20.061366 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-800dc135-0951-4939-9158-20842d3263c1 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:20.065983 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-365d444c-fdd2-4f7c-aec9-c49229f68045 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:20.068479 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-365d444c-fdd2-4f7c-aec9-c49229f68045 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] [instance: e45fa8b9-1545-4bd5-aa5f-402c71ec19c6] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:20.094556 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-365d444c-fdd2-4f7c-aec9-c49229f68045 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:20.095685 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-365d444c-fdd2-4f7c-aec9-c49229f68045 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:20.096421 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-365d444c-fdd2-4f7c-aec9-c49229f68045 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:20.097759 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-365d444c-fdd2-4f7c-aec9-c49229f68045 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:20.102269 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-365d444c-fdd2-4f7c-aec9-c49229f68045 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:20.103105 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-365d444c-fdd2-4f7c-aec9-c49229f68045 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:20.479564 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-800dc135-0951-4939-9158-20842d3263c1 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:20.492487 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-800dc135-0951-4939-9158-20842d3263c1 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:20.496828 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-800dc135-0951-4939-9158-20842d3263c1 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:20.502182 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-800dc135-0951-4939-9158-20842d3263c1 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00" status: 200 len: 1343 microversion: 2.25 time: 0.494099 Aug 31 15:59:20.512422 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 503/995] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:59:20 2022] GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00 => generated 1343 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:59:20.533146 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8cec7398-2eb5-41b5-8e58-b7b0b858fd8b tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Calling method '.version_select at 0x7f5ae8d16a60>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:22.087049 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=4 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:59:22.492640 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-365d444c-fdd2-4f7c-aec9-c49229f68045 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a03cc5956ca477abacbe0c26bf18750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea45d1b678342ed812f9912e9f07503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:22.507932 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-365d444c-fdd2-4f7c-aec9-c49229f68045 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] 10.222.0.61 "GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6" status: 200 len: 1478 microversion: 2.1 time: 2.450216 Aug 31 15:59:22.510279 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 493/996] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:20 2022] GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6 => generated 1478 bytes in 2456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:22.521432 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-fb93ea62-68a1-4aad-877b-4cc561358c0d tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:22.523928 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-fb93ea62-68a1-4aad-877b-4cc561358c0d tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] [instance: aade3ca2-9ecc-48db-988a-1ddbc286024a] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:22.534332 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fb93ea62-68a1-4aad-877b-4cc561358c0d tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:22.537273 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fb93ea62-68a1-4aad-877b-4cc561358c0d tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:22.538484 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fb93ea62-68a1-4aad-877b-4cc561358c0d tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:22.539715 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fb93ea62-68a1-4aad-877b-4cc561358c0d tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:22.540414 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fb93ea62-68a1-4aad-877b-4cc561358c0d tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:22.541212 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fb93ea62-68a1-4aad-877b-4cc561358c0d tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:22.884459 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-fb93ea62-68a1-4aad-877b-4cc561358c0d tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccce16c7fda401ea68fb31ea8099d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed252ebf7c741bbb36b553ac1767579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:22.897689 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-fb93ea62-68a1-4aad-877b-4cc561358c0d tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "GET /compute/v2.1/servers/aade3ca2-9ecc-48db-988a-1ddbc286024a" status: 200 len: 1276 microversion: 2.1 time: 0.384889 Aug 31 15:59:22.898935 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 494/997] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:22 2022] GET /compute/v2.1/servers/aade3ca2-9ecc-48db-988a-1ddbc286024a => generated 1276 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:22.904515 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-cd49a4e5-66de-445a-94a9-dd97ee6584a0 req-bea53b88-deda-4e7c-b5bc-a9014cea366a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc085aaa-21b2-48a6-b69c-de4e261dfe7f", "tag": "c4a89a46-30ca-4df0-bd23-f2ae8050bb54"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:59:22.937354 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-cd49a4e5-66de-445a-94a9-dd97ee6584a0 req-bea53b88-deda-4e7c-b5bc-a9014cea366a service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:22.939973 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-cd49a4e5-66de-445a-94a9-dd97ee6584a0 req-bea53b88-deda-4e7c-b5bc-a9014cea366a service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:22.942961 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-cd49a4e5-66de-445a-94a9-dd97ee6584a0 req-bea53b88-deda-4e7c-b5bc-a9014cea366a service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:22.996268 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-cd49a4e5-66de-445a-94a9-dd97ee6584a0 req-bea53b88-deda-4e7c-b5bc-a9014cea366a service nova] Creating event network-changed:c4a89a46-30ca-4df0-bd23-f2ae8050bb54 for instance cc085aaa-21b2-48a6-b69c-de4e261dfe7f on n-h1-850499-9 Aug 31 15:59:23.024110 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-cd49a4e5-66de-445a-94a9-dd97ee6584a0 req-bea53b88-deda-4e7c-b5bc-a9014cea366a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123410 Aug 31 15:59:23.030796 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 495/998] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 15:59:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:59:23.046585 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-54ca694f-10f1-4dc3-819a-fdf284d6a628 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:23.056481 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-54ca694f-10f1-4dc3-819a-fdf284d6a628 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:23.096188 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-54ca694f-10f1-4dc3-819a-fdf284d6a628 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:23.099162 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-54ca694f-10f1-4dc3-819a-fdf284d6a628 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:23.100060 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-54ca694f-10f1-4dc3-819a-fdf284d6a628 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:23.101564 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-54ca694f-10f1-4dc3-819a-fdf284d6a628 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:23.109804 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-54ca694f-10f1-4dc3-819a-fdf284d6a628 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:23.112523 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-54ca694f-10f1-4dc3-819a-fdf284d6a628 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:23.204872 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:59:23.881144 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-54ca694f-10f1-4dc3-819a-fdf284d6a628 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:23.904963 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-54ca694f-10f1-4dc3-819a-fdf284d6a628 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:23.913407 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-54ca694f-10f1-4dc3-819a-fdf284d6a628 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:23.926211 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-54ca694f-10f1-4dc3-819a-fdf284d6a628 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1555 microversion: 2.91 time: 0.890923 Aug 31 15:59:23.927248 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 496/999] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:59:23 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1555 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:59:23.939778 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9863525b-5397-4a01-bd7e-be4a48285d6f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:23.947998 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9863525b-5397-4a01-bd7e-be4a48285d6f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 35b89015-3888-493a-b521-49a5e3769b00] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:23.958241 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9863525b-5397-4a01-bd7e-be4a48285d6f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:23.962872 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9863525b-5397-4a01-bd7e-be4a48285d6f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:23.965175 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9863525b-5397-4a01-bd7e-be4a48285d6f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:23.966519 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9863525b-5397-4a01-bd7e-be4a48285d6f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:23.968721 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9863525b-5397-4a01-bd7e-be4a48285d6f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:23.977791 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9863525b-5397-4a01-bd7e-be4a48285d6f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:24.644518 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-9863525b-5397-4a01-bd7e-be4a48285d6f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:24.658993 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-9863525b-5397-4a01-bd7e-be4a48285d6f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:24.661369 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-9863525b-5397-4a01-bd7e-be4a48285d6f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:24.664131 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9863525b-5397-4a01-bd7e-be4a48285d6f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00" status: 200 len: 1411 microversion: 2.25 time: 0.729730 Aug 31 15:59:24.688142 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 497/1000] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:59:23 2022] GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00 => generated 1411 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:59:24.698697 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-c7762df5-16a7-4105-9ae9-fe6668eb0aa1 req-82b0237a-b33a-46e9-a887-2c746ba524db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e45fa8b9-1545-4bd5-aa5f-402c71ec19c6", "name": "network-vif-plugged", "status": "completed", "tag": "935e822d-4171-4348-8a87-c6e76ab1ea4f"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:59:24.710186 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-c7762df5-16a7-4105-9ae9-fe6668eb0aa1 req-82b0237a-b33a-46e9-a887-2c746ba524db service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:24.710998 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-c7762df5-16a7-4105-9ae9-fe6668eb0aa1 req-82b0237a-b33a-46e9-a887-2c746ba524db service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:24.711433 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-c7762df5-16a7-4105-9ae9-fe6668eb0aa1 req-82b0237a-b33a-46e9-a887-2c746ba524db service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:24.739643 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-c7762df5-16a7-4105-9ae9-fe6668eb0aa1 req-82b0237a-b33a-46e9-a887-2c746ba524db service nova] Creating event network-vif-plugged:935e822d-4171-4348-8a87-c6e76ab1ea4f for instance e45fa8b9-1545-4bd5-aa5f-402c71ec19c6 on n-h2-850499-9 Aug 31 15:59:24.747475 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-c7762df5-16a7-4105-9ae9-fe6668eb0aa1 req-82b0237a-b33a-46e9-a887-2c746ba524db service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057765 Aug 31 15:59:24.748432 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 498/1001] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 15:59:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:59:24.753580 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e5925f5c-5722-45a9-99e6-d1f36b79f26f tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:24.754522 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e5925f5c-5722-45a9-99e6-d1f36b79f26f tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] [instance: e45fa8b9-1545-4bd5-aa5f-402c71ec19c6] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:24.765394 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e5925f5c-5722-45a9-99e6-d1f36b79f26f tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:24.766307 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e5925f5c-5722-45a9-99e6-d1f36b79f26f tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:24.766934 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e5925f5c-5722-45a9-99e6-d1f36b79f26f tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:24.767865 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e5925f5c-5722-45a9-99e6-d1f36b79f26f tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:24.768498 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e5925f5c-5722-45a9-99e6-d1f36b79f26f tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:24.779694 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e5925f5c-5722-45a9-99e6-d1f36b79f26f tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:25.510843 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e5925f5c-5722-45a9-99e6-d1f36b79f26f tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a03cc5956ca477abacbe0c26bf18750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea45d1b678342ed812f9912e9f07503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:25.528214 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e5925f5c-5722-45a9-99e6-d1f36b79f26f tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] 10.222.0.61 "GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6" status: 200 len: 1478 microversion: 2.1 time: 0.778469 Aug 31 15:59:25.531650 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 499/1002] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:24 2022] GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6 => generated 1478 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:25.542051 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9bde477a-17d7-489c-8597-eb201450159d tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:25.542971 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9bde477a-17d7-489c-8597-eb201450159d tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] [instance: aade3ca2-9ecc-48db-988a-1ddbc286024a] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:25.564919 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9bde477a-17d7-489c-8597-eb201450159d tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:25.566107 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9bde477a-17d7-489c-8597-eb201450159d tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:25.566607 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9bde477a-17d7-489c-8597-eb201450159d tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:25.568089 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9bde477a-17d7-489c-8597-eb201450159d tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:25.568609 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9bde477a-17d7-489c-8597-eb201450159d tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:25.569915 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9bde477a-17d7-489c-8597-eb201450159d tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:25.804205 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-9bde477a-17d7-489c-8597-eb201450159d tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccce16c7fda401ea68fb31ea8099d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed252ebf7c741bbb36b553ac1767579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:25.824352 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9bde477a-17d7-489c-8597-eb201450159d tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "GET /compute/v2.1/servers/aade3ca2-9ecc-48db-988a-1ddbc286024a" status: 200 len: 1282 microversion: 2.1 time: 0.291183 Aug 31 15:59:25.837948 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 500/1003] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:25 2022] GET /compute/v2.1/servers/aade3ca2-9ecc-48db-988a-1ddbc286024a => generated 1282 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:25.851031 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-13f4d2b3-b555-496f-bae7-bc732ef9a63d tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:25.851834 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-13f4d2b3-b555-496f-bae7-bc732ef9a63d tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:25.854753 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8cec7398-2eb5-41b5-8e58-b7b0b858fd8b tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] 10.222.0.61 "DELETE /compute/v2.1/os-floating-ips/01586388-277e-43f2-87af-f8b4c430a2a8" status: 202 len: 0 microversion: 2.1 time: 5.341115 Aug 31 15:59:25.857439 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 504/1004] 10.222.0.61 () {58 vars in 1263 bytes} [Wed Aug 31 15:59:20 2022] DELETE /compute/v2.1/os-floating-ips/01586388-277e-43f2-87af-f8b4c430a2a8 => generated 0 bytes in 5344 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 15:59:25.864905 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-cb2be253-f3e1-442e-8618-0921243e82a7 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:25.865521 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-cb2be253-f3e1-442e-8618-0921243e82a7 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 35b89015-3888-493a-b521-49a5e3769b00] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:25.879811 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cb2be253-f3e1-442e-8618-0921243e82a7 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:25.880316 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cb2be253-f3e1-442e-8618-0921243e82a7 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:25.880754 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cb2be253-f3e1-442e-8618-0921243e82a7 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:25.882000 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cb2be253-f3e1-442e-8618-0921243e82a7 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:25.882458 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-13f4d2b3-b555-496f-bae7-bc732ef9a63d tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:25.883394 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-13f4d2b3-b555-496f-bae7-bc732ef9a63d tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:25.884048 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-13f4d2b3-b555-496f-bae7-bc732ef9a63d tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:25.884951 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-13f4d2b3-b555-496f-bae7-bc732ef9a63d tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:25.885564 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-13f4d2b3-b555-496f-bae7-bc732ef9a63d tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:25.886157 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-13f4d2b3-b555-496f-bae7-bc732ef9a63d tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:25.888595 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cb2be253-f3e1-442e-8618-0921243e82a7 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:25.889239 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cb2be253-f3e1-442e-8618-0921243e82a7 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:26.207026 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-13f4d2b3-b555-496f-bae7-bc732ef9a63d tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:26.225644 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-13f4d2b3-b555-496f-bae7-bc732ef9a63d tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:26.227159 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-13f4d2b3-b555-496f-bae7-bc732ef9a63d tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:26.233295 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-13f4d2b3-b555-496f-bae7-bc732ef9a63d tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1555 microversion: 2.91 time: 0.394652 Aug 31 15:59:26.234491 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 501/1005] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:59:25 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1555 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:59:26.239781 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-546b140a-01e6-41db-901d-1929c75bb41c tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Action: 'action', calling method: .version_select at 0x7f5aeac72940>, body: {"removeFloatingIp": {"address": "172.25.6.6"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:59:26.547730 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-cb2be253-f3e1-442e-8618-0921243e82a7 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:26.556674 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-cb2be253-f3e1-442e-8618-0921243e82a7 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:26.558615 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-cb2be253-f3e1-442e-8618-0921243e82a7 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:26.560008 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-cb2be253-f3e1-442e-8618-0921243e82a7 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00" status: 200 len: 1411 microversion: 2.25 time: 0.699646 Aug 31 15:59:26.590543 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 505/1006] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:59:25 2022] GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00 => generated 1411 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:59:26.590543 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8217350a-acfc-4509-9330-a20917186af8 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:26.590543 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8217350a-acfc-4509-9330-a20917186af8 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] [instance: e45fa8b9-1545-4bd5-aa5f-402c71ec19c6] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:26.590543 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8217350a-acfc-4509-9330-a20917186af8 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:26.590543 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8217350a-acfc-4509-9330-a20917186af8 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:26.591221 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8217350a-acfc-4509-9330-a20917186af8 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:26.591221 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8217350a-acfc-4509-9330-a20917186af8 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:26.591221 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8217350a-acfc-4509-9330-a20917186af8 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:26.593176 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8217350a-acfc-4509-9330-a20917186af8 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:26.916468 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-546b140a-01e6-41db-901d-1929c75bb41c tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] [instance: 5de5737d-bcc8-4357-85f0-f4468ac84bc7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:26.926100 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-546b140a-01e6-41db-901d-1929c75bb41c tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:26.928336 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-546b140a-01e6-41db-901d-1929c75bb41c tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:26.934465 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-546b140a-01e6-41db-901d-1929c75bb41c tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:26.942496 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-546b140a-01e6-41db-901d-1929c75bb41c tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:26.944931 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-546b140a-01e6-41db-901d-1929c75bb41c tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:26.945576 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-546b140a-01e6-41db-901d-1929c75bb41c tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:27.078144 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8217350a-acfc-4509-9330-a20917186af8 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a03cc5956ca477abacbe0c26bf18750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea45d1b678342ed812f9912e9f07503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:27.112586 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8217350a-acfc-4509-9330-a20917186af8 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] 10.222.0.61 "GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6" status: 200 len: 1478 microversion: 2.1 time: 0.535537 Aug 31 15:59:27.113750 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 506/1007] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:26 2022] GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6 => generated 1478 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:27.124838 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-e79404b4-87e6-48a3-bbff-c7a70ca1ebd4 req-1a97a073-3838-4b86-a75d-dd3f120e201c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35b89015-3888-493a-b521-49a5e3769b00", "tag": "fdce032a-0b32-49de-acd3-1c9df93ae828"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:59:27.146871 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-e79404b4-87e6-48a3-bbff-c7a70ca1ebd4 req-1a97a073-3838-4b86-a75d-dd3f120e201c service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:27.149695 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-e79404b4-87e6-48a3-bbff-c7a70ca1ebd4 req-1a97a073-3838-4b86-a75d-dd3f120e201c service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:27.150682 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-e79404b4-87e6-48a3-bbff-c7a70ca1ebd4 req-1a97a073-3838-4b86-a75d-dd3f120e201c service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:27.182633 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-e79404b4-87e6-48a3-bbff-c7a70ca1ebd4 req-1a97a073-3838-4b86-a75d-dd3f120e201c service nova] Creating event network-changed:fdce032a-0b32-49de-acd3-1c9df93ae828 for instance 35b89015-3888-493a-b521-49a5e3769b00 on n-h2-850499-9 Aug 31 15:59:27.192485 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-e79404b4-87e6-48a3-bbff-c7a70ca1ebd4 req-1a97a073-3838-4b86-a75d-dd3f120e201c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071422 Aug 31 15:59:27.199411 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 507/1008] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 15:59:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:59:27.211807 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ab67295e-35e1-4c74-aa9d-23ea3355bb45 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:27.212865 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ab67295e-35e1-4c74-aa9d-23ea3355bb45 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] [instance: aade3ca2-9ecc-48db-988a-1ddbc286024a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:27.224947 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ab67295e-35e1-4c74-aa9d-23ea3355bb45 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:27.228840 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ab67295e-35e1-4c74-aa9d-23ea3355bb45 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:27.229506 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ab67295e-35e1-4c74-aa9d-23ea3355bb45 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:27.230416 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ab67295e-35e1-4c74-aa9d-23ea3355bb45 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:27.231049 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ab67295e-35e1-4c74-aa9d-23ea3355bb45 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:27.236514 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ab67295e-35e1-4c74-aa9d-23ea3355bb45 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:27.405517 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ab67295e-35e1-4c74-aa9d-23ea3355bb45 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccce16c7fda401ea68fb31ea8099d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed252ebf7c741bbb36b553ac1767579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:27.435733 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ab67295e-35e1-4c74-aa9d-23ea3355bb45 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "GET /compute/v2.1/servers/aade3ca2-9ecc-48db-988a-1ddbc286024a" status: 200 len: 1282 microversion: 2.1 time: 0.226480 Aug 31 15:59:27.477409 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 508/1009] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:27 2022] GET /compute/v2.1/servers/aade3ca2-9ecc-48db-988a-1ddbc286024a => generated 1282 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:27.486116 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0647ad07-156e-48af-8048-9c63a4a6a3c2 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:27.487598 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0647ad07-156e-48af-8048-9c63a4a6a3c2 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:27.500745 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0647ad07-156e-48af-8048-9c63a4a6a3c2 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:27.502059 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0647ad07-156e-48af-8048-9c63a4a6a3c2 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:27.503144 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0647ad07-156e-48af-8048-9c63a4a6a3c2 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:27.504704 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0647ad07-156e-48af-8048-9c63a4a6a3c2 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:27.505957 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0647ad07-156e-48af-8048-9c63a4a6a3c2 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:27.506988 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0647ad07-156e-48af-8048-9c63a4a6a3c2 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:28.209008 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0647ad07-156e-48af-8048-9c63a4a6a3c2 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:28.219405 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0647ad07-156e-48af-8048-9c63a4a6a3c2 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:28.220907 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0647ad07-156e-48af-8048-9c63a4a6a3c2 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:28.239883 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0647ad07-156e-48af-8048-9c63a4a6a3c2 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1555 microversion: 2.91 time: 0.760614 Aug 31 15:59:28.255903 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 509/1010] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:59:27 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1555 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:59:28.264578 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b07001b5-4925-4b65-a542-813b2d958639 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:28.266471 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b07001b5-4925-4b65-a542-813b2d958639 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 35b89015-3888-493a-b521-49a5e3769b00] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:28.274040 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b07001b5-4925-4b65-a542-813b2d958639 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:28.274784 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b07001b5-4925-4b65-a542-813b2d958639 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:28.275408 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b07001b5-4925-4b65-a542-813b2d958639 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:28.276348 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b07001b5-4925-4b65-a542-813b2d958639 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:28.277137 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b07001b5-4925-4b65-a542-813b2d958639 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:28.277745 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b07001b5-4925-4b65-a542-813b2d958639 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:28.291753 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-546b140a-01e6-41db-901d-1929c75bb41c tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Acquiring lock "refresh_cache-5de5737d-bcc8-4357-85f0-f4468ac84bc7" {{(pid=122256) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 31 15:59:28.292257 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-546b140a-01e6-41db-901d-1929c75bb41c tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Acquired lock "refresh_cache-5de5737d-bcc8-4357-85f0-f4468ac84bc7" {{(pid=122256) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 31 15:59:28.830494 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b07001b5-4925-4b65-a542-813b2d958639 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:28.847520 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b07001b5-4925-4b65-a542-813b2d958639 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:28.849537 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b07001b5-4925-4b65-a542-813b2d958639 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:28.851865 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b07001b5-4925-4b65-a542-813b2d958639 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00" status: 200 len: 1411 microversion: 2.25 time: 0.594767 Aug 31 15:59:28.863917 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 510/1011] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:59:28 2022] GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00 => generated 1411 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:59:28.870408 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8ab033ce-841b-4839-9c17-d10e43eecc3b tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:28.871259 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8ab033ce-841b-4839-9c17-d10e43eecc3b tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] [instance: e45fa8b9-1545-4bd5-aa5f-402c71ec19c6] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:28.886106 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8ab033ce-841b-4839-9c17-d10e43eecc3b tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:28.886885 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8ab033ce-841b-4839-9c17-d10e43eecc3b tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:28.887521 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8ab033ce-841b-4839-9c17-d10e43eecc3b tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:28.888424 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8ab033ce-841b-4839-9c17-d10e43eecc3b tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:28.889133 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8ab033ce-841b-4839-9c17-d10e43eecc3b tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:28.889800 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8ab033ce-841b-4839-9c17-d10e43eecc3b tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:29.365364 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8ab033ce-841b-4839-9c17-d10e43eecc3b tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a03cc5956ca477abacbe0c26bf18750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea45d1b678342ed812f9912e9f07503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:29.378528 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8ab033ce-841b-4839-9c17-d10e43eecc3b tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] 10.222.0.61 "GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6" status: 200 len: 1464 microversion: 2.1 time: 0.512959 Aug 31 15:59:29.398926 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 511/1012] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:28 2022] GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6 => generated 1464 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:29.407404 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2b5c05a9-39a8-4db0-adf6-4f27d94034b2 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:29.409103 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2b5c05a9-39a8-4db0-adf6-4f27d94034b2 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] [instance: aade3ca2-9ecc-48db-988a-1ddbc286024a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:29.418941 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2b5c05a9-39a8-4db0-adf6-4f27d94034b2 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:29.419724 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2b5c05a9-39a8-4db0-adf6-4f27d94034b2 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:29.420432 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2b5c05a9-39a8-4db0-adf6-4f27d94034b2 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:29.421416 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2b5c05a9-39a8-4db0-adf6-4f27d94034b2 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:29.422112 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2b5c05a9-39a8-4db0-adf6-4f27d94034b2 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:29.422839 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2b5c05a9-39a8-4db0-adf6-4f27d94034b2 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:29.668333 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=4 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:59:29.758920 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2b5c05a9-39a8-4db0-adf6-4f27d94034b2 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccce16c7fda401ea68fb31ea8099d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed252ebf7c741bbb36b553ac1767579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:29.764705 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=16 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:59:29.772056 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2b5c05a9-39a8-4db0-adf6-4f27d94034b2 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "GET /compute/v2.1/servers/aade3ca2-9ecc-48db-988a-1ddbc286024a" status: 200 len: 1324 microversion: 2.1 time: 0.371355 Aug 31 15:59:29.773474 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 512/1013] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:29 2022] GET /compute/v2.1/servers/aade3ca2-9ecc-48db-988a-1ddbc286024a => generated 1324 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:29.785050 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c9c6a4e5-18dd-4a84-95b9-5f497c48ce6e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:29.786603 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c9c6a4e5-18dd-4a84-95b9-5f497c48ce6e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:29.804246 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c9c6a4e5-18dd-4a84-95b9-5f497c48ce6e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:29.804907 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c9c6a4e5-18dd-4a84-95b9-5f497c48ce6e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:29.805612 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c9c6a4e5-18dd-4a84-95b9-5f497c48ce6e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:29.806518 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c9c6a4e5-18dd-4a84-95b9-5f497c48ce6e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:29.807185 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c9c6a4e5-18dd-4a84-95b9-5f497c48ce6e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:29.808247 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c9c6a4e5-18dd-4a84-95b9-5f497c48ce6e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:29.920607 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c9c6a4e5-18dd-4a84-95b9-5f497c48ce6e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:29.930031 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c9c6a4e5-18dd-4a84-95b9-5f497c48ce6e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:29.931796 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c9c6a4e5-18dd-4a84-95b9-5f497c48ce6e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:29.940578 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c9c6a4e5-18dd-4a84-95b9-5f497c48ce6e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1555 microversion: 2.91 time: 0.165641 Aug 31 15:59:29.941306 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 513/1014] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:59:29 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1555 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:59:29.984153 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c83b934e-bf22-4da0-89aa-fda265355c61 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:29.985070 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c83b934e-bf22-4da0-89aa-fda265355c61 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] [instance: e45fa8b9-1545-4bd5-aa5f-402c71ec19c6] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:29.998944 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c83b934e-bf22-4da0-89aa-fda265355c61 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:29.999374 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c83b934e-bf22-4da0-89aa-fda265355c61 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:29.999864 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c83b934e-bf22-4da0-89aa-fda265355c61 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:30.000677 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c83b934e-bf22-4da0-89aa-fda265355c61 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:30.001023 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c83b934e-bf22-4da0-89aa-fda265355c61 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:30.001459 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c83b934e-bf22-4da0-89aa-fda265355c61 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:30.358819 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c83b934e-bf22-4da0-89aa-fda265355c61 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a03cc5956ca477abacbe0c26bf18750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea45d1b678342ed812f9912e9f07503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:30.360102 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-546b140a-01e6-41db-901d-1929c75bb41c tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] [instance: 5de5737d-bcc8-4357-85f0-f4468ac84bc7] Building network info cache for instance {{(pid=122256) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 31 15:59:30.370429 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c83b934e-bf22-4da0-89aa-fda265355c61 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] 10.222.0.61 "GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6" status: 200 len: 1464 microversion: 2.1 time: 0.400152 Aug 31 15:59:30.373087 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 514/1015] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:29 2022] GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6 => generated 1464 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:30.378189 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7df216a2-e514-490e-b5f6-e71cac749a4f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:30.380738 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7df216a2-e514-490e-b5f6-e71cac749a4f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 35b89015-3888-493a-b521-49a5e3769b00] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:30.388882 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7df216a2-e514-490e-b5f6-e71cac749a4f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:30.389741 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7df216a2-e514-490e-b5f6-e71cac749a4f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:30.390435 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7df216a2-e514-490e-b5f6-e71cac749a4f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:30.391426 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7df216a2-e514-490e-b5f6-e71cac749a4f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:30.392188 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7df216a2-e514-490e-b5f6-e71cac749a4f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:30.392863 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7df216a2-e514-490e-b5f6-e71cac749a4f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:31.188296 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7df216a2-e514-490e-b5f6-e71cac749a4f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:31.198318 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7df216a2-e514-490e-b5f6-e71cac749a4f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:31.199839 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7df216a2-e514-490e-b5f6-e71cac749a4f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:31.200982 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7df216a2-e514-490e-b5f6-e71cac749a4f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00" status: 200 len: 1411 microversion: 2.25 time: 0.826596 Aug 31 15:59:31.211874 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 515/1016] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:59:30 2022] GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00 => generated 1411 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:59:31.217458 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f8d2d6a9-af15-4367-98c6-f74e5284b6cd tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:59:31.233011 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f8d2d6a9-af15-4367-98c6-f74e5284b6cd tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] [instance: e45fa8b9-1545-4bd5-aa5f-402c71ec19c6] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:31.243633 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f8d2d6a9-af15-4367-98c6-f74e5284b6cd tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:31.246745 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f8d2d6a9-af15-4367-98c6-f74e5284b6cd tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:31.252946 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f8d2d6a9-af15-4367-98c6-f74e5284b6cd tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:31.254071 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f8d2d6a9-af15-4367-98c6-f74e5284b6cd tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:31.254743 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f8d2d6a9-af15-4367-98c6-f74e5284b6cd tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:31.255267 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f8d2d6a9-af15-4367-98c6-f74e5284b6cd tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:31.377599 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-f8d2d6a9-af15-4367-98c6-f74e5284b6cd tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 15:59:31.378240 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-f8d2d6a9-af15-4367-98c6-f74e5284b6cd tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 15:59:31.378479 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-f8d2d6a9-af15-4367-98c6-f74e5284b6cd tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 15:59:31.378904 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-f8d2d6a9-af15-4367-98c6-f74e5284b6cd tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 15:59:31.379303 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-f8d2d6a9-af15-4367-98c6-f74e5284b6cd tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 15:59:31.499264 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f8d2d6a9-af15-4367-98c6-f74e5284b6cd tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] [instance: e45fa8b9-1545-4bd5-aa5f-402c71ec19c6] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:31.521597 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f8d2d6a9-af15-4367-98c6-f74e5284b6cd tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:31.522723 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f8d2d6a9-af15-4367-98c6-f74e5284b6cd tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:31.523186 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f8d2d6a9-af15-4367-98c6-f74e5284b6cd tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:31.523974 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f8d2d6a9-af15-4367-98c6-f74e5284b6cd tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:31.524440 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f8d2d6a9-af15-4367-98c6-f74e5284b6cd tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:31.532614 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f8d2d6a9-af15-4367-98c6-f74e5284b6cd tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:31.576344 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:59:31.597565 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f8d2d6a9-af15-4367-98c6-f74e5284b6cd tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] 10.222.0.61 "POST /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6/action" status: 202 len: 1068 microversion: 2.1 time: 0.383767 Aug 31 15:59:31.598515 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 516/1017] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 15:59:31 2022] POST /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6/action => generated 1068 bytes in 386 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 31 15:59:31.609917 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-f8e1d748-acc3-4ae4-82cf-48050e30a832 req-1e842502-171a-47be-b5ea-6e7eebdafaf6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5de5737d-bcc8-4357-85f0-f4468ac84bc7", "tag": "860bd128-aaa5-4d35-b493-f0871fc78fdb"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:59:31.621648 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-f8e1d748-acc3-4ae4-82cf-48050e30a832 req-1e842502-171a-47be-b5ea-6e7eebdafaf6 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:31.622378 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-f8e1d748-acc3-4ae4-82cf-48050e30a832 req-1e842502-171a-47be-b5ea-6e7eebdafaf6 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:31.622985 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-f8e1d748-acc3-4ae4-82cf-48050e30a832 req-1e842502-171a-47be-b5ea-6e7eebdafaf6 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:31.667099 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-f8e1d748-acc3-4ae4-82cf-48050e30a832 req-1e842502-171a-47be-b5ea-6e7eebdafaf6 service nova] Creating event network-changed:860bd128-aaa5-4d35-b493-f0871fc78fdb for instance 5de5737d-bcc8-4357-85f0-f4468ac84bc7 on n-h1-850499-9 Aug 31 15:59:31.675460 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-f8e1d748-acc3-4ae4-82cf-48050e30a832 req-1e842502-171a-47be-b5ea-6e7eebdafaf6 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074862 Aug 31 15:59:31.679763 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 517/1018] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 15:59:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:59:31.690422 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0825fee3-2fe5-4f3a-84a4-102f0facee77 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:31.691521 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0825fee3-2fe5-4f3a-84a4-102f0facee77 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] [instance: aade3ca2-9ecc-48db-988a-1ddbc286024a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:31.701141 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0825fee3-2fe5-4f3a-84a4-102f0facee77 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:31.701929 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0825fee3-2fe5-4f3a-84a4-102f0facee77 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:31.702669 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0825fee3-2fe5-4f3a-84a4-102f0facee77 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:31.703654 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0825fee3-2fe5-4f3a-84a4-102f0facee77 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:31.704339 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0825fee3-2fe5-4f3a-84a4-102f0facee77 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:31.705009 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0825fee3-2fe5-4f3a-84a4-102f0facee77 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:32.079153 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0825fee3-2fe5-4f3a-84a4-102f0facee77 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccce16c7fda401ea68fb31ea8099d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed252ebf7c741bbb36b553ac1767579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:32.107448 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0825fee3-2fe5-4f3a-84a4-102f0facee77 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "GET /compute/v2.1/servers/aade3ca2-9ecc-48db-988a-1ddbc286024a" status: 200 len: 1324 microversion: 2.1 time: 0.421983 Aug 31 15:59:32.110088 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 518/1019] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:31 2022] GET /compute/v2.1/servers/aade3ca2-9ecc-48db-988a-1ddbc286024a => generated 1324 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:32.120874 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8e60dd96-b13a-48d8-8ad9-6ade0141006b tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:32.122164 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8e60dd96-b13a-48d8-8ad9-6ade0141006b tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:32.134319 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8e60dd96-b13a-48d8-8ad9-6ade0141006b tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:32.134863 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-546b140a-01e6-41db-901d-1929c75bb41c tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] [instance: 5de5737d-bcc8-4357-85f0-f4468ac84bc7] Updating instance_info_cache with network_info: [{"id": "860bd128-aaa5-4d35-b493-f0871fc78fdb", "address": "fa:16:3e:59:22:82", "network": {"id": "05c79ad7-21d0-4e49-a22e-297e68a6eb17", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1953907254-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "0d5746b9f74e4fecbf2da098436f2ce4", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap860bd128-aa", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122256) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 31 15:59:32.135414 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8e60dd96-b13a-48d8-8ad9-6ade0141006b tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:32.136433 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8e60dd96-b13a-48d8-8ad9-6ade0141006b tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:32.137963 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8e60dd96-b13a-48d8-8ad9-6ade0141006b tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:32.138921 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8e60dd96-b13a-48d8-8ad9-6ade0141006b tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:32.139851 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8e60dd96-b13a-48d8-8ad9-6ade0141006b tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:32.167585 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-546b140a-01e6-41db-901d-1929c75bb41c tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Releasing lock "refresh_cache-5de5737d-bcc8-4357-85f0-f4468ac84bc7" {{(pid=122256) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 31 15:59:32.168900 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-546b140a-01e6-41db-901d-1929c75bb41c tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] 10.222.0.61 "POST /compute/v2.1/servers/5de5737d-bcc8-4357-85f0-f4468ac84bc7/action" status: 202 len: 0 microversion: 2.1 time: 5.933132 Aug 31 15:59:32.173384 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 502/1020] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 15:59:26 2022] POST /compute/v2.1/servers/5de5737d-bcc8-4357-85f0-f4468ac84bc7/action => generated 0 bytes in 5938 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 31 15:59:32.182616 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-12b67554-6b9e-485f-923e-e16ea596e6dd tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:32.187243 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-12b67554-6b9e-485f-923e-e16ea596e6dd tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] [instance: e45fa8b9-1545-4bd5-aa5f-402c71ec19c6] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:32.207266 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-12b67554-6b9e-485f-923e-e16ea596e6dd tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:32.208003 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-12b67554-6b9e-485f-923e-e16ea596e6dd tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:32.208672 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-12b67554-6b9e-485f-923e-e16ea596e6dd tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:32.210140 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-12b67554-6b9e-485f-923e-e16ea596e6dd tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:32.211671 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-12b67554-6b9e-485f-923e-e16ea596e6dd tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:32.212518 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-12b67554-6b9e-485f-923e-e16ea596e6dd tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:32.227274 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8e60dd96-b13a-48d8-8ad9-6ade0141006b tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:32.237686 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8e60dd96-b13a-48d8-8ad9-6ade0141006b tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:32.244050 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8e60dd96-b13a-48d8-8ad9-6ade0141006b tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:32.250636 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8e60dd96-b13a-48d8-8ad9-6ade0141006b tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1537 microversion: 2.91 time: 0.138872 Aug 31 15:59:32.251568 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 519/1021] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:59:32 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1537 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:59:32.257950 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ab6b9b1e-af0b-4315-a4fe-d0542157b299 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Calling method '.version_select at 0x7f5ae8eab8b0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:32.528399 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-12b67554-6b9e-485f-923e-e16ea596e6dd tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a03cc5956ca477abacbe0c26bf18750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea45d1b678342ed812f9912e9f07503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:32.566492 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-12b67554-6b9e-485f-923e-e16ea596e6dd tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] 10.222.0.61 "GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6" status: 200 len: 1473 microversion: 2.1 time: 0.388568 Aug 31 15:59:32.569527 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 503/1022] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:32 2022] GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6 => generated 1473 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:32.589821 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b6617b93-738c-47de-af5c-1867d20400b7 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:32.591010 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b6617b93-738c-47de-af5c-1867d20400b7 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 35b89015-3888-493a-b521-49a5e3769b00] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:32.602037 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b6617b93-738c-47de-af5c-1867d20400b7 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:32.602892 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b6617b93-738c-47de-af5c-1867d20400b7 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:32.603335 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b6617b93-738c-47de-af5c-1867d20400b7 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:32.604105 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b6617b93-738c-47de-af5c-1867d20400b7 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:32.604761 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b6617b93-738c-47de-af5c-1867d20400b7 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:32.605367 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b6617b93-738c-47de-af5c-1867d20400b7 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:33.344435 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b6617b93-738c-47de-af5c-1867d20400b7 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:33.363106 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b6617b93-738c-47de-af5c-1867d20400b7 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:33.366835 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b6617b93-738c-47de-af5c-1867d20400b7 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:33.386056 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b6617b93-738c-47de-af5c-1867d20400b7 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00" status: 200 len: 1411 microversion: 2.25 time: 0.804978 Aug 31 15:59:33.387994 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 504/1023] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:59:32 2022] GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00 => generated 1411 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:59:33.399405 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ed02fa50-c7dc-4571-849f-800ba5a59200 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:33.403323 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ed02fa50-c7dc-4571-849f-800ba5a59200 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] [instance: aade3ca2-9ecc-48db-988a-1ddbc286024a] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:33.419405 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ed02fa50-c7dc-4571-849f-800ba5a59200 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:33.419955 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ed02fa50-c7dc-4571-849f-800ba5a59200 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:33.420403 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ed02fa50-c7dc-4571-849f-800ba5a59200 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:33.422197 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ed02fa50-c7dc-4571-849f-800ba5a59200 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:33.422861 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ed02fa50-c7dc-4571-849f-800ba5a59200 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:33.423559 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ed02fa50-c7dc-4571-849f-800ba5a59200 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:33.991009 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ed02fa50-c7dc-4571-849f-800ba5a59200 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccce16c7fda401ea68fb31ea8099d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed252ebf7c741bbb36b553ac1767579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:34.000261 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ed02fa50-c7dc-4571-849f-800ba5a59200 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "GET /compute/v2.1/servers/aade3ca2-9ecc-48db-988a-1ddbc286024a" status: 200 len: 1324 microversion: 2.1 time: 0.610736 Aug 31 15:59:34.001079 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 505/1024] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:33 2022] GET /compute/v2.1/servers/aade3ca2-9ecc-48db-988a-1ddbc286024a => generated 1324 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:34.007487 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5dbf5dd9-b830-4b3f-802e-57ce120fd220 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:34.008217 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5dbf5dd9-b830-4b3f-802e-57ce120fd220 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:34.014814 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5dbf5dd9-b830-4b3f-802e-57ce120fd220 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:34.016240 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5dbf5dd9-b830-4b3f-802e-57ce120fd220 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:34.016935 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5dbf5dd9-b830-4b3f-802e-57ce120fd220 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:34.017743 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5dbf5dd9-b830-4b3f-802e-57ce120fd220 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:34.018597 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5dbf5dd9-b830-4b3f-802e-57ce120fd220 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:34.018981 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5dbf5dd9-b830-4b3f-802e-57ce120fd220 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:34.235136 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5dbf5dd9-b830-4b3f-802e-57ce120fd220 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:34.254327 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5dbf5dd9-b830-4b3f-802e-57ce120fd220 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:34.257558 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5dbf5dd9-b830-4b3f-802e-57ce120fd220 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:34.264530 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5dbf5dd9-b830-4b3f-802e-57ce120fd220 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1480 microversion: 2.91 time: 0.262296 Aug 31 15:59:34.279757 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 506/1025] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:59:34 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1480 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:59:34.290614 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-60eb5883-6e57-4c06-b6bc-ea70f4f5a3f9 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:34.291223 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-60eb5883-6e57-4c06-b6bc-ea70f4f5a3f9 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] [instance: e45fa8b9-1545-4bd5-aa5f-402c71ec19c6] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:34.297570 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-60eb5883-6e57-4c06-b6bc-ea70f4f5a3f9 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:34.298066 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-60eb5883-6e57-4c06-b6bc-ea70f4f5a3f9 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:34.298501 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-60eb5883-6e57-4c06-b6bc-ea70f4f5a3f9 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:34.299202 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-60eb5883-6e57-4c06-b6bc-ea70f4f5a3f9 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:34.299696 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-60eb5883-6e57-4c06-b6bc-ea70f4f5a3f9 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:34.300121 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-60eb5883-6e57-4c06-b6bc-ea70f4f5a3f9 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:35.041228 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-60eb5883-6e57-4c06-b6bc-ea70f4f5a3f9 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a03cc5956ca477abacbe0c26bf18750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea45d1b678342ed812f9912e9f07503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:35.056828 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-60eb5883-6e57-4c06-b6bc-ea70f4f5a3f9 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] 10.222.0.61 "GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6" status: 200 len: 1473 microversion: 2.1 time: 0.775845 Aug 31 15:59:35.071934 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 507/1026] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:34 2022] GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6 => generated 1473 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:35.071934 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-5839668a-d970-4b22-9355-234cde846246 req-a8b46981-6e52-4518-97f5-a88adc15b1a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aade3ca2-9ecc-48db-988a-1ddbc286024a", "tag": "271136ce-1765-4d62-aae2-4b28988d27c0"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:59:35.089857 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-5839668a-d970-4b22-9355-234cde846246 req-a8b46981-6e52-4518-97f5-a88adc15b1a3 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:35.090785 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-5839668a-d970-4b22-9355-234cde846246 req-a8b46981-6e52-4518-97f5-a88adc15b1a3 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:35.091874 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-5839668a-d970-4b22-9355-234cde846246 req-a8b46981-6e52-4518-97f5-a88adc15b1a3 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:35.109334 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-5839668a-d970-4b22-9355-234cde846246 req-a8b46981-6e52-4518-97f5-a88adc15b1a3 service nova] Creating event network-changed:271136ce-1765-4d62-aae2-4b28988d27c0 for instance aade3ca2-9ecc-48db-988a-1ddbc286024a on n-h2-850499-9 Aug 31 15:59:35.128939 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-5839668a-d970-4b22-9355-234cde846246 req-a8b46981-6e52-4518-97f5-a88adc15b1a3 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062873 Aug 31 15:59:35.133425 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 508/1027] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 15:59:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:59:35.143393 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-22f379f9-8fc4-44fb-8666-e41980c26cab tempest-UnshelveToHostMultiNodesTest-1598069161 tempest-UnshelveToHostMultiNodesTest-1598069161-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h1-850499-9"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:59:35.147466 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-22f379f9-8fc4-44fb-8666-e41980c26cab tempest-UnshelveToHostMultiNodesTest-1598069161 tempest-UnshelveToHostMultiNodesTest-1598069161-project-admin] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:35.156787 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-22f379f9-8fc4-44fb-8666-e41980c26cab tempest-UnshelveToHostMultiNodesTest-1598069161 tempest-UnshelveToHostMultiNodesTest-1598069161-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:35.157154 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-22f379f9-8fc4-44fb-8666-e41980c26cab tempest-UnshelveToHostMultiNodesTest-1598069161 tempest-UnshelveToHostMultiNodesTest-1598069161-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:35.159165 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-22f379f9-8fc4-44fb-8666-e41980c26cab tempest-UnshelveToHostMultiNodesTest-1598069161 tempest-UnshelveToHostMultiNodesTest-1598069161-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:35.159165 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-22f379f9-8fc4-44fb-8666-e41980c26cab tempest-UnshelveToHostMultiNodesTest-1598069161 tempest-UnshelveToHostMultiNodesTest-1598069161-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:35.159165 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-22f379f9-8fc4-44fb-8666-e41980c26cab tempest-UnshelveToHostMultiNodesTest-1598069161 tempest-UnshelveToHostMultiNodesTest-1598069161-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:35.159576 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-22f379f9-8fc4-44fb-8666-e41980c26cab tempest-UnshelveToHostMultiNodesTest-1598069161 tempest-UnshelveToHostMultiNodesTest-1598069161-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:35.230634 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ab6b9b1e-af0b-4315-a4fe-d0542157b299 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] 10.222.0.61 "DELETE /compute/v2.1/os-floating-ips/9e0f6d74-e595-4d6a-aeb5-bcd691bafc06" status: 202 len: 0 microversion: 2.1 time: 2.977911 Aug 31 15:59:35.231714 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 520/1028] 10.222.0.61 () {58 vars in 1263 bytes} [Wed Aug 31 15:59:32 2022] DELETE /compute/v2.1/os-floating-ips/9e0f6d74-e595-4d6a-aeb5-bcd691bafc06 => generated 0 bytes in 2979 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 15:59:35.237258 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-22f379f9-8fc4-44fb-8666-e41980c26cab tempest-UnshelveToHostMultiNodesTest-1598069161 tempest-UnshelveToHostMultiNodesTest-1598069161-project-admin] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h1-850499-9". {{(pid=122256) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 31 15:59:35.239321 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-db2adddb-c4fd-47b6-9090-818f7ad66c8f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:35.239960 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-db2adddb-c4fd-47b6-9090-818f7ad66c8f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 35b89015-3888-493a-b521-49a5e3769b00] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:35.258450 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-db2adddb-c4fd-47b6-9090-818f7ad66c8f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:35.258960 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-db2adddb-c4fd-47b6-9090-818f7ad66c8f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:35.260414 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-db2adddb-c4fd-47b6-9090-818f7ad66c8f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:35.261382 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-db2adddb-c4fd-47b6-9090-818f7ad66c8f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:35.262608 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-db2adddb-c4fd-47b6-9090-818f7ad66c8f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:35.265156 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-db2adddb-c4fd-47b6-9090-818f7ad66c8f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:35.365528 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-22f379f9-8fc4-44fb-8666-e41980c26cab tempest-UnshelveToHostMultiNodesTest-1598069161 tempest-UnshelveToHostMultiNodesTest-1598069161-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689/action" status: 202 len: 0 microversion: 2.91 time: 0.229366 Aug 31 15:59:35.369380 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 509/1029] 10.222.0.61 () {62 vars in 1319 bytes} [Wed Aug 31 15:59:35 2022] POST /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689/action => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 15:59:35.374118 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ecc5be58-4232-4281-ae4e-b16ef071fc45 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:35.374733 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ecc5be58-4232-4281-ae4e-b16ef071fc45 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] [instance: aade3ca2-9ecc-48db-988a-1ddbc286024a] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:35.381062 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ecc5be58-4232-4281-ae4e-b16ef071fc45 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:35.381680 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ecc5be58-4232-4281-ae4e-b16ef071fc45 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:35.382156 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ecc5be58-4232-4281-ae4e-b16ef071fc45 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:35.382862 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ecc5be58-4232-4281-ae4e-b16ef071fc45 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:35.383316 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ecc5be58-4232-4281-ae4e-b16ef071fc45 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:35.383793 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ecc5be58-4232-4281-ae4e-b16ef071fc45 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:35.533917 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-db2adddb-c4fd-47b6-9090-818f7ad66c8f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:35.544392 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-db2adddb-c4fd-47b6-9090-818f7ad66c8f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:35.546709 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-db2adddb-c4fd-47b6-9090-818f7ad66c8f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:35.548056 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-db2adddb-c4fd-47b6-9090-818f7ad66c8f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00" status: 200 len: 1411 microversion: 2.25 time: 0.315289 Aug 31 15:59:35.548772 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 521/1030] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:59:35 2022] GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00 => generated 1411 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:59:35.554507 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-062f16de-befb-4109-9c55-ad55744a0c75 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:59:35.559411 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-062f16de-befb-4109-9c55-ad55744a0c75 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Request method failure captured: Aug 31 15:59:35.559411 n-d-850499-9 devstack@n-api.service[122257]: request: POST /compute/v2.1/servers/5de5737d-bcc8-4357-85f0-f4468ac84bc7/action HTTP/1.1 Aug 31 15:59:35.559411 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 15:59:35.559411 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 15:59:35.559411 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 15:59:35.559411 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 34 Aug 31 15:59:35.559411 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 15:59:35.559411 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 15:59:35.559411 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 15:59:35.559411 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 15:59:35.559411 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4UwPpoSdZA9uxW3WFL7_35hH44k_Rm1LHX7YzA8CPavMf_yK9gcDBXaQiX3qmdjO0k3V6fiHzSoEdqd4J2LEBtfbz-LvhySlEZZQQZud-oGXxloRxlgDCrurecLuwDL_XkMfJ6_4u6k-LTUscNwKpGuyDQBkM1q0NpdEnTayWAerT0 Aug 31 15:59:35.559411 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 15:59:35.559411 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 15:59:35.559411 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 15:59:35.559411 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 15:59:35.559411 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 15:59:35.559411 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 15:59:35.559411 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 0d5746b9f74e4fecbf2da098436f2ce4 Aug 31 15:59:35.559411 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 Aug 31 15:59:35.559411 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 15:59:35.559411 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 15:59:35.561035 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0d5746b9f74e4fecbf2da098436f2ce4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/0d5746b9f74e4fecbf2da098436f2ce4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_0d5746b9f74e4fecbf2da098436f2ce4", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0d5746b9f74e4fecbf2da098436f2ce4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 15:59:35.561035 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 Aug 31 15:59:35.561035 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 0d5746b9f74e4fecbf2da098436f2ce4 Aug 31 15:59:35.561035 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 Aug 31 15:59:35.561035 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project Aug 31 15:59:35.561035 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 15:59:35.561035 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 15:59:35.561035 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 1a5652ccb7b54cf7a56f25b91c30c904 Aug 31 15:59:35.561035 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project Aug 31 15:59:35.561035 n-d-850499-9 devstack@n-api.service[122257]: Aug 31 15:59:35.561035 n-d-850499-9 devstack@n-api.service[122257]: {"addFloatingIp": {"address": ""}} Aug 31 15:59:35.561035 n-d-850499-9 devstack@n-api.service[122257]: method: Aug 31 15:59:35.561035 n-d-850499-9 devstack@n-api.service[122257]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 31 15:59:35.561990 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '5de5737d-bcc8-4357-85f0-f4468ac84bc7', 'body': {'addFloatingIp': {'address': ''}}} Aug 31 15:59:35.561990 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:59:35.561990 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:35.561990 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 15:59:35.561990 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 15:59:35.561990 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 15:59:35.561990 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise error Aug 31 15:59:35.561990 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Aug 31 15:59:35.561990 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:59:35.561990 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Aug 31 15:59:35.561990 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Aug 31 15:59:35.561990 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:59:35.561990 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Aug 31 15:59:35.561990 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi '' Aug 31 15:59:35.561990 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:59:35.561990 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:59:35.561990 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:59:35.561990 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:35.561990 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:59:35.561990 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:59:35.561990 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:59:35.561990 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:59:35.563678 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 15:59:35.563678 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 15:59:35.563678 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:59:35.563678 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:59:35.563678 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 15:59:35.563678 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 15:59:35.563678 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 15:59:35.563678 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 15:59:35.563678 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 15:59:35.563678 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 15:59:35.563678 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 31 15:59:35.563678 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:59:35.563678 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:59:35.563678 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:59:35.563678 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:35.563678 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:59:35.563678 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:59:35.563678 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 15:59:35.563678 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 15:59:35.565325 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 31 15:59:35.565325 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:59:35.566254 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-062f16de-befb-4109-9c55-ad55744a0c75 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:59:35.567554 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-062f16de-befb-4109-9c55-ad55744a0c75 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] 10.222.0.61 "POST /compute/v2.1/servers/5de5737d-bcc8-4357-85f0-f4468ac84bc7/action" status: 400 len: 142 microversion: 2.1 time: 0.017441 Aug 31 15:59:35.569254 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 522/1031] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 15:59:35 2022] POST /compute/v2.1/servers/5de5737d-bcc8-4357-85f0-f4468ac84bc7/action => generated 142 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 15:59:35.574450 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-97b8bfad-eca5-4388-ab33-ca3c39188115 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:35.575309 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-97b8bfad-eca5-4388-ab33-ca3c39188115 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:35.586153 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-97b8bfad-eca5-4388-ab33-ca3c39188115 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:35.587248 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-97b8bfad-eca5-4388-ab33-ca3c39188115 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:35.588777 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-97b8bfad-eca5-4388-ab33-ca3c39188115 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:35.590356 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-97b8bfad-eca5-4388-ab33-ca3c39188115 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:35.590994 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-97b8bfad-eca5-4388-ab33-ca3c39188115 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:35.592118 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-97b8bfad-eca5-4388-ab33-ca3c39188115 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:35.616214 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ecc5be58-4232-4281-ae4e-b16ef071fc45 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccce16c7fda401ea68fb31ea8099d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed252ebf7c741bbb36b553ac1767579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:35.628164 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ecc5be58-4232-4281-ae4e-b16ef071fc45 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "GET /compute/v2.1/servers/aade3ca2-9ecc-48db-988a-1ddbc286024a" status: 200 len: 1324 microversion: 2.1 time: 0.257520 Aug 31 15:59:35.629537 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 510/1032] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:35 2022] GET /compute/v2.1/servers/aade3ca2-9ecc-48db-988a-1ddbc286024a => generated 1324 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:35.636027 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-58b229f6-1d34-4c4b-9c5a-037c1a381b70 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Action: 'action', calling method: .version_select at 0x7f5aeac728b0>, body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:59:35.639965 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-58b229f6-1d34-4c4b-9c5a-037c1a381b70 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] [instance: 5de5737d-bcc8-4357-85f0-f4468ac84bc7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:35.656787 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-58b229f6-1d34-4c4b-9c5a-037c1a381b70 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:35.657580 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-58b229f6-1d34-4c4b-9c5a-037c1a381b70 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:35.658159 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-58b229f6-1d34-4c4b-9c5a-037c1a381b70 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:35.659039 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-58b229f6-1d34-4c4b-9c5a-037c1a381b70 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:35.660075 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-58b229f6-1d34-4c4b-9c5a-037c1a381b70 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:35.660806 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-58b229f6-1d34-4c4b-9c5a-037c1a381b70 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:35.725787 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-97b8bfad-eca5-4388-ab33-ca3c39188115 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:35.730787 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-58b229f6-1d34-4c4b-9c5a-037c1a381b70 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Acquiring lock "refresh_cache-5de5737d-bcc8-4357-85f0-f4468ac84bc7" {{(pid=122256) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 31 15:59:35.742342 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-58b229f6-1d34-4c4b-9c5a-037c1a381b70 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Acquired lock "refresh_cache-5de5737d-bcc8-4357-85f0-f4468ac84bc7" {{(pid=122256) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 31 15:59:35.744185 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-97b8bfad-eca5-4388-ab33-ca3c39188115 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:35.747128 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-97b8bfad-eca5-4388-ab33-ca3c39188115 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:35.765763 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-97b8bfad-eca5-4388-ab33-ca3c39188115 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1488 microversion: 2.91 time: 0.194867 Aug 31 15:59:35.766359 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 523/1033] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:59:35 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1488 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:59:35.871975 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-58b229f6-1d34-4c4b-9c5a-037c1a381b70 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Releasing lock "refresh_cache-5de5737d-bcc8-4357-85f0-f4468ac84bc7" {{(pid=122256) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 31 15:59:35.872822 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-58b229f6-1d34-4c4b-9c5a-037c1a381b70 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] HTTP exception thrown: floating IP not found Aug 31 15:59:35.889818 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-58b229f6-1d34-4c4b-9c5a-037c1a381b70 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Request method failure captured: Aug 31 15:59:35.889818 n-d-850499-9 devstack@n-api.service[122256]: request: POST /compute/v2.1/servers/5de5737d-bcc8-4357-85f0-f4468ac84bc7/action HTTP/1.1 Aug 31 15:59:35.889818 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 15:59:35.889818 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 15:59:35.889818 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 15:59:35.889818 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 41 Aug 31 15:59:35.889818 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 15:59:35.889818 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 15:59:35.889818 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 15:59:35.889818 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 15:59:35.889818 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4UwPpoSdZA9uxW3WFL7_35hH44k_Rm1LHX7YzA8CPavMf_yK9gcDBXaQiX3qmdjO0k3V6fiHzSoEdqd4J2LEBtfbz-LvhySlEZZQQZud-oGXxloRxlgDCrurecLuwDL_XkMfJ6_4u6k-LTUscNwKpGuyDQBkM1q0NpdEnTayWAerT0 Aug 31 15:59:35.889818 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 15:59:35.889818 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 15:59:35.889818 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 15:59:35.889818 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 15:59:35.889818 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 15:59:35.889818 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 15:59:35.889818 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 0d5746b9f74e4fecbf2da098436f2ce4 Aug 31 15:59:35.889818 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 Aug 31 15:59:35.889818 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 15:59:35.889818 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 15:59:35.891382 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0d5746b9f74e4fecbf2da098436f2ce4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/0d5746b9f74e4fecbf2da098436f2ce4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_0d5746b9f74e4fecbf2da098436f2ce4", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0d5746b9f74e4fecbf2da098436f2ce4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 15:59:35.891382 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 Aug 31 15:59:35.891382 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 0d5746b9f74e4fecbf2da098436f2ce4 Aug 31 15:59:35.891382 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 Aug 31 15:59:35.891382 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project Aug 31 15:59:35.891382 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 15:59:35.891382 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 15:59:35.891382 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 1a5652ccb7b54cf7a56f25b91c30c904 Aug 31 15:59:35.891382 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project Aug 31 15:59:35.891382 n-d-850499-9 devstack@n-api.service[122256]: Aug 31 15:59:35.891382 n-d-850499-9 devstack@n-api.service[122256]: {"addFloatingIp": {"address": "0.0.0.0"}} Aug 31 15:59:35.891382 n-d-850499-9 devstack@n-api.service[122256]: method: Aug 31 15:59:35.891382 n-d-850499-9 devstack@n-api.service[122256]: exception: floating IP not found Aug 31 15:59:35.892362 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '5de5737d-bcc8-4357-85f0-f4468ac84bc7', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Aug 31 15:59:35.892362 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:59:35.892362 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:35.892362 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Aug 31 15:59:35.892362 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Aug 31 15:59:35.892362 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Aug 31 15:59:35.892362 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Aug 31 15:59:35.892362 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2702, in associate_floating_ip Aug 31 15:59:35.892362 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Aug 31 15:59:35.892362 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Aug 31 15:59:35.892362 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Aug 31 15:59:35.892362 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Aug 31 15:59:35.892362 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:59:35.892362 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:59:35.892362 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:59:35.892362 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:35.892362 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:59:35.892362 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:59:35.892362 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:59:35.893583 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:59:35.893583 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 15:59:35.893583 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 15:59:35.893583 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:59:35.893583 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:59:35.893583 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:59:35.893583 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:59:35.893583 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Aug 31 15:59:35.893583 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 31 15:59:35.893583 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Aug 31 15:59:35.893583 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:59:35.893583 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:59:35.893583 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:59:35.893583 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:35.893583 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:59:35.893583 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:59:35.893583 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:59:35.893583 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:59:35.893583 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Aug 31 15:59:35.893583 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:59:35.895165 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-58b229f6-1d34-4c4b-9c5a-037c1a381b70 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Returning 404 to user: floating IP not found {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:59:35.895909 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-58b229f6-1d34-4c4b-9c5a-037c1a381b70 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] 10.222.0.61 "POST /compute/v2.1/servers/5de5737d-bcc8-4357-85f0-f4468ac84bc7/action" status: 404 len: 67 microversion: 2.1 time: 0.265153 Aug 31 15:59:35.896639 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 511/1034] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 15:59:35 2022] POST /compute/v2.1/servers/5de5737d-bcc8-4357-85f0-f4468ac84bc7/action => generated 67 bytes in 266 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 31 15:59:35.906657 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-af61b987-d90f-4d42-9be1-bc136beb240e tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Action: 'action', calling method: .version_select at 0x7f5aeac72940>, body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:59:35.968643 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-af61b987-d90f-4d42-9be1-bc136beb240e tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Aug 31 15:59:35.971002 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-af61b987-d90f-4d42-9be1-bc136beb240e tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Request method failure captured: Aug 31 15:59:35.971002 n-d-850499-9 devstack@n-api.service[122257]: request: POST /compute/v2.1/servers/5de5737d-bcc8-4357-85f0-f4468ac84bc7/action HTTP/1.1 Aug 31 15:59:35.971002 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 15:59:35.971002 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 15:59:35.971002 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 15:59:35.971002 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 44 Aug 31 15:59:35.971002 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 15:59:35.971002 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 15:59:35.971002 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 15:59:35.971002 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 15:59:35.971002 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4UwPpoSdZA9uxW3WFL7_35hH44k_Rm1LHX7YzA8CPavMf_yK9gcDBXaQiX3qmdjO0k3V6fiHzSoEdqd4J2LEBtfbz-LvhySlEZZQQZud-oGXxloRxlgDCrurecLuwDL_XkMfJ6_4u6k-LTUscNwKpGuyDQBkM1q0NpdEnTayWAerT0 Aug 31 15:59:35.971002 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 15:59:35.971002 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 15:59:35.971002 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 15:59:35.971002 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 15:59:35.971002 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 15:59:35.971002 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 15:59:35.971002 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 0d5746b9f74e4fecbf2da098436f2ce4 Aug 31 15:59:35.971002 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 Aug 31 15:59:35.971002 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 15:59:35.971002 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 15:59:35.972612 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0d5746b9f74e4fecbf2da098436f2ce4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/0d5746b9f74e4fecbf2da098436f2ce4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_0d5746b9f74e4fecbf2da098436f2ce4", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0d5746b9f74e4fecbf2da098436f2ce4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 15:59:35.972612 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 Aug 31 15:59:35.972612 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 0d5746b9f74e4fecbf2da098436f2ce4 Aug 31 15:59:35.972612 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 Aug 31 15:59:35.972612 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project Aug 31 15:59:35.972612 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 15:59:35.972612 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 15:59:35.972612 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 1a5652ccb7b54cf7a56f25b91c30c904 Aug 31 15:59:35.972612 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project Aug 31 15:59:35.972612 n-d-850499-9 devstack@n-api.service[122257]: Aug 31 15:59:35.972612 n-d-850499-9 devstack@n-api.service[122257]: {"removeFloatingIp": {"address": "0.0.0.0"}} Aug 31 15:59:35.972612 n-d-850499-9 devstack@n-api.service[122257]: method: Aug 31 15:59:35.972612 n-d-850499-9 devstack@n-api.service[122257]: exception: Floating IP not found for address 0.0.0.0. Aug 31 15:59:35.973561 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '5de5737d-bcc8-4357-85f0-f4468ac84bc7', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Aug 31 15:59:35.973561 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:59:35.973561 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:35.973561 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Aug 31 15:59:35.973561 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Aug 31 15:59:35.973561 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2930, in get_instance_id_by_floating_address Aug 31 15:59:35.973561 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Aug 31 15:59:35.973561 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Aug 31 15:59:35.973561 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Aug 31 15:59:35.973561 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Aug 31 15:59:35.973561 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:59:35.973561 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:59:35.973561 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:59:35.973561 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:35.973561 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:59:35.973561 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:59:35.973561 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:59:35.973561 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:59:35.973561 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 15:59:35.974670 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 15:59:35.974670 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:59:35.974670 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:59:35.974670 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:59:35.974670 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:59:35.974670 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Aug 31 15:59:35.974670 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Aug 31 15:59:35.974670 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Aug 31 15:59:35.974670 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Aug 31 15:59:35.974670 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Aug 31 15:59:35.974670 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:59:35.974670 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:59:35.974670 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:59:35.974670 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:35.974670 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:59:35.974670 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:59:35.974670 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:59:35.974670 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:59:35.974670 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Aug 31 15:59:35.974670 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:59:35.980325 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-af61b987-d90f-4d42-9be1-bc136beb240e tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:59:35.980325 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-af61b987-d90f-4d42-9be1-bc136beb240e tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] 10.222.0.61 "POST /compute/v2.1/servers/5de5737d-bcc8-4357-85f0-f4468ac84bc7/action" status: 404 len: 88 microversion: 2.1 time: 0.070068 Aug 31 15:59:35.980325 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 524/1035] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 15:59:35 2022] POST /compute/v2.1/servers/5de5737d-bcc8-4357-85f0-f4468ac84bc7/action => generated 88 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 31 15:59:35.982793 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-03203c02-e106-4426-9f8e-4ce0b62e9303 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:35.983306 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-03203c02-e106-4426-9f8e-4ce0b62e9303 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] [instance: 5de5737d-bcc8-4357-85f0-f4468ac84bc7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:35.990088 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-03203c02-e106-4426-9f8e-4ce0b62e9303 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:35.991198 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-03203c02-e106-4426-9f8e-4ce0b62e9303 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:35.992011 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-03203c02-e106-4426-9f8e-4ce0b62e9303 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:35.992966 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-03203c02-e106-4426-9f8e-4ce0b62e9303 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:35.993909 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-03203c02-e106-4426-9f8e-4ce0b62e9303 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:35.994783 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-03203c02-e106-4426-9f8e-4ce0b62e9303 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:36.027844 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-03203c02-e106-4426-9f8e-4ce0b62e9303 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] [instance: 5de5737d-bcc8-4357-85f0-f4468ac84bc7] Going to try to terminate instance {{(pid=122256) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 15:59:36.036748 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:59:36.082882 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-530a021e-347a-40e5-b25e-d5ca59da73b6 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:36.083830 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-530a021e-347a-40e5-b25e-d5ca59da73b6 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] [instance: e45fa8b9-1545-4bd5-aa5f-402c71ec19c6] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:36.103775 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-530a021e-347a-40e5-b25e-d5ca59da73b6 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:36.104683 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-530a021e-347a-40e5-b25e-d5ca59da73b6 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:36.105308 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-530a021e-347a-40e5-b25e-d5ca59da73b6 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:36.106227 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-530a021e-347a-40e5-b25e-d5ca59da73b6 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:36.106887 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-530a021e-347a-40e5-b25e-d5ca59da73b6 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:36.107338 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-530a021e-347a-40e5-b25e-d5ca59da73b6 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:36.168557 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-03203c02-e106-4426-9f8e-4ce0b62e9303 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] 10.222.0.61 "DELETE /compute/v2.1/servers/5de5737d-bcc8-4357-85f0-f4468ac84bc7" status: 204 len: 0 microversion: 2.1 time: 0.189492 Aug 31 15:59:36.179962 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 512/1036] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 15:59:35 2022] DELETE /compute/v2.1/servers/5de5737d-bcc8-4357-85f0-f4468ac84bc7 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 15:59:36.207787 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d0085e92-ab56-42d9-acd5-786fd8fdd3af tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:36.208767 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d0085e92-ab56-42d9-acd5-786fd8fdd3af tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] [instance: 5de5737d-bcc8-4357-85f0-f4468ac84bc7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:36.216487 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d0085e92-ab56-42d9-acd5-786fd8fdd3af tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:36.216982 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d0085e92-ab56-42d9-acd5-786fd8fdd3af tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:36.217420 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d0085e92-ab56-42d9-acd5-786fd8fdd3af tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:36.218121 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d0085e92-ab56-42d9-acd5-786fd8fdd3af tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:36.218579 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d0085e92-ab56-42d9-acd5-786fd8fdd3af tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:36.219001 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d0085e92-ab56-42d9-acd5-786fd8fdd3af tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:36.400943 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-530a021e-347a-40e5-b25e-d5ca59da73b6 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a03cc5956ca477abacbe0c26bf18750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea45d1b678342ed812f9912e9f07503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:36.418937 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-530a021e-347a-40e5-b25e-d5ca59da73b6 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] 10.222.0.61 "GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6" status: 200 len: 1473 microversion: 2.1 time: 0.339934 Aug 31 15:59:36.420634 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 525/1037] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:36 2022] GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6 => generated 1473 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:36.426671 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d0085e92-ab56-42d9-acd5-786fd8fdd3af tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a5652ccb7b54cf7a56f25b91c30c904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5746b9f74e4fecbf2da098436f2ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:36.440884 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d0085e92-ab56-42d9-acd5-786fd8fdd3af tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] 10.222.0.61 "GET /compute/v2.1/servers/5de5737d-bcc8-4357-85f0-f4468ac84bc7" status: 200 len: 1543 microversion: 2.1 time: 0.259244 Aug 31 15:59:36.442470 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 513/1038] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:36 2022] GET /compute/v2.1/servers/5de5737d-bcc8-4357-85f0-f4468ac84bc7 => generated 1543 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:36.576063 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b2e8b382-03e7-47d4-8517-b03e3f061d13 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:36.577067 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b2e8b382-03e7-47d4-8517-b03e3f061d13 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 35b89015-3888-493a-b521-49a5e3769b00] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:36.583821 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b2e8b382-03e7-47d4-8517-b03e3f061d13 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:36.584696 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b2e8b382-03e7-47d4-8517-b03e3f061d13 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:36.585391 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b2e8b382-03e7-47d4-8517-b03e3f061d13 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:36.586755 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b2e8b382-03e7-47d4-8517-b03e3f061d13 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:36.587277 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b2e8b382-03e7-47d4-8517-b03e3f061d13 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:36.587801 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b2e8b382-03e7-47d4-8517-b03e3f061d13 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:36.656795 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7f6b0317-25d9-4739-bb4c-9d3e8b570bd2 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:36.658370 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7f6b0317-25d9-4739-bb4c-9d3e8b570bd2 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] [instance: aade3ca2-9ecc-48db-988a-1ddbc286024a] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:36.665992 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7f6b0317-25d9-4739-bb4c-9d3e8b570bd2 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:36.667053 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7f6b0317-25d9-4739-bb4c-9d3e8b570bd2 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:36.667747 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7f6b0317-25d9-4739-bb4c-9d3e8b570bd2 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:36.670463 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7f6b0317-25d9-4739-bb4c-9d3e8b570bd2 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:36.671562 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7f6b0317-25d9-4739-bb4c-9d3e8b570bd2 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:36.672247 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7f6b0317-25d9-4739-bb4c-9d3e8b570bd2 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:36.750612 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b2e8b382-03e7-47d4-8517-b03e3f061d13 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:36.761889 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b2e8b382-03e7-47d4-8517-b03e3f061d13 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:36.773703 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b2e8b382-03e7-47d4-8517-b03e3f061d13 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:36.775181 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b2e8b382-03e7-47d4-8517-b03e3f061d13 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00" status: 200 len: 1411 microversion: 2.25 time: 0.203272 Aug 31 15:59:36.775952 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 526/1039] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:59:36 2022] GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00 => generated 1411 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:59:36.817077 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2f0e2d63-430a-405e-ab08-f6e5386dc7b7 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:36.821518 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2f0e2d63-430a-405e-ab08-f6e5386dc7b7 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:36.836949 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2f0e2d63-430a-405e-ab08-f6e5386dc7b7 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:36.837447 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2f0e2d63-430a-405e-ab08-f6e5386dc7b7 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:36.838061 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2f0e2d63-430a-405e-ab08-f6e5386dc7b7 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:36.839605 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2f0e2d63-430a-405e-ab08-f6e5386dc7b7 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:36.840076 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2f0e2d63-430a-405e-ab08-f6e5386dc7b7 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:36.840506 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2f0e2d63-430a-405e-ab08-f6e5386dc7b7 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:36.934382 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2f0e2d63-430a-405e-ab08-f6e5386dc7b7 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:36.951909 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2f0e2d63-430a-405e-ab08-f6e5386dc7b7 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:36.954100 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2f0e2d63-430a-405e-ab08-f6e5386dc7b7 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:36.965930 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2f0e2d63-430a-405e-ab08-f6e5386dc7b7 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1488 microversion: 2.91 time: 0.162794 Aug 31 15:59:36.968014 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 527/1040] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:59:36 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1488 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:59:36.986896 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7f6b0317-25d9-4739-bb4c-9d3e8b570bd2 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccce16c7fda401ea68fb31ea8099d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed252ebf7c741bbb36b553ac1767579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:37.001463 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7f6b0317-25d9-4739-bb4c-9d3e8b570bd2 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "GET /compute/v2.1/servers/aade3ca2-9ecc-48db-988a-1ddbc286024a" status: 200 len: 1324 microversion: 2.1 time: 0.348729 Aug 31 15:59:37.002147 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 514/1041] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:36 2022] GET /compute/v2.1/servers/aade3ca2-9ecc-48db-988a-1ddbc286024a => generated 1324 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:37.079632 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-73948d1c-6557-44b9-b24d-f0bca34d4ca6 req-3931d696-4c27-4295-b743-3699b5260288 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35b89015-3888-493a-b521-49a5e3769b00", "name": "network-vif-plugged", "status": "completed", "tag": "fdce032a-0b32-49de-acd3-1c9df93ae828"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:59:37.097525 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-73948d1c-6557-44b9-b24d-f0bca34d4ca6 req-3931d696-4c27-4295-b743-3699b5260288 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:37.100253 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-73948d1c-6557-44b9-b24d-f0bca34d4ca6 req-3931d696-4c27-4295-b743-3699b5260288 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:37.100985 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-73948d1c-6557-44b9-b24d-f0bca34d4ca6 req-3931d696-4c27-4295-b743-3699b5260288 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:37.114442 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-73948d1c-6557-44b9-b24d-f0bca34d4ca6 req-3931d696-4c27-4295-b743-3699b5260288 service nova] Creating event network-vif-plugged:fdce032a-0b32-49de-acd3-1c9df93ae828 for instance 35b89015-3888-493a-b521-49a5e3769b00 on n-h2-850499-9 Aug 31 15:59:37.120360 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-73948d1c-6557-44b9-b24d-f0bca34d4ca6 req-3931d696-4c27-4295-b743-3699b5260288 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047182 Aug 31 15:59:37.121343 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 528/1042] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 15:59:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:59:37.442268 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-57c25db8-3b8e-4858-a5a2-27e5887da0fa tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:37.442802 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-57c25db8-3b8e-4858-a5a2-27e5887da0fa tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] [instance: e45fa8b9-1545-4bd5-aa5f-402c71ec19c6] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:37.451195 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-57c25db8-3b8e-4858-a5a2-27e5887da0fa tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:37.452864 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-57c25db8-3b8e-4858-a5a2-27e5887da0fa tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:37.452864 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-57c25db8-3b8e-4858-a5a2-27e5887da0fa tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:37.453111 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-57c25db8-3b8e-4858-a5a2-27e5887da0fa tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:37.453386 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-57c25db8-3b8e-4858-a5a2-27e5887da0fa tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:37.454690 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-57c25db8-3b8e-4858-a5a2-27e5887da0fa tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:37.467686 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-926b36e2-a947-45e3-a32b-2b0955c420c0 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:37.469205 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-926b36e2-a947-45e3-a32b-2b0955c420c0 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] [instance: 5de5737d-bcc8-4357-85f0-f4468ac84bc7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:37.483292 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-926b36e2-a947-45e3-a32b-2b0955c420c0 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:37.483831 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-926b36e2-a947-45e3-a32b-2b0955c420c0 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:37.484330 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-926b36e2-a947-45e3-a32b-2b0955c420c0 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:37.485435 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-926b36e2-a947-45e3-a32b-2b0955c420c0 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:37.485976 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-926b36e2-a947-45e3-a32b-2b0955c420c0 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:37.486419 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-926b36e2-a947-45e3-a32b-2b0955c420c0 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:37.917486 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-57c25db8-3b8e-4858-a5a2-27e5887da0fa tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a03cc5956ca477abacbe0c26bf18750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea45d1b678342ed812f9912e9f07503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:37.926592 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-57c25db8-3b8e-4858-a5a2-27e5887da0fa tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] 10.222.0.61 "GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6" status: 200 len: 1473 microversion: 2.1 time: 0.488558 Aug 31 15:59:37.943261 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 515/1043] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:37 2022] GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6 => generated 1473 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:37.949892 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7a1e64d0-820a-4b6b-a5d4-3b2797c6ea5f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:37.950804 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7a1e64d0-820a-4b6b-a5d4-3b2797c6ea5f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 35b89015-3888-493a-b521-49a5e3769b00] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:37.957970 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7a1e64d0-820a-4b6b-a5d4-3b2797c6ea5f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:37.958769 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7a1e64d0-820a-4b6b-a5d4-3b2797c6ea5f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:37.959571 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7a1e64d0-820a-4b6b-a5d4-3b2797c6ea5f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:37.961228 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7a1e64d0-820a-4b6b-a5d4-3b2797c6ea5f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:37.962773 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7a1e64d0-820a-4b6b-a5d4-3b2797c6ea5f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:37.963442 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7a1e64d0-820a-4b6b-a5d4-3b2797c6ea5f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:38.039481 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-926b36e2-a947-45e3-a32b-2b0955c420c0 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a5652ccb7b54cf7a56f25b91c30c904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5746b9f74e4fecbf2da098436f2ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:38.048369 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-926b36e2-a947-45e3-a32b-2b0955c420c0 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] 10.222.0.61 "GET /compute/v2.1/servers/5de5737d-bcc8-4357-85f0-f4468ac84bc7" status: 200 len: 1543 microversion: 2.1 time: 0.585495 Aug 31 15:59:38.060024 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 529/1044] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:37 2022] GET /compute/v2.1/servers/5de5737d-bcc8-4357-85f0-f4468ac84bc7 => generated 1543 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:38.070438 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6fcb8720-f5b2-4173-b4f5-6ea33d4c25dd tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:38.071350 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6fcb8720-f5b2-4173-b4f5-6ea33d4c25dd tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:38.078567 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6fcb8720-f5b2-4173-b4f5-6ea33d4c25dd tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:38.079435 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6fcb8720-f5b2-4173-b4f5-6ea33d4c25dd tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:38.080217 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6fcb8720-f5b2-4173-b4f5-6ea33d4c25dd tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:38.081174 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6fcb8720-f5b2-4173-b4f5-6ea33d4c25dd tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:38.082104 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6fcb8720-f5b2-4173-b4f5-6ea33d4c25dd tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:38.082777 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6fcb8720-f5b2-4173-b4f5-6ea33d4c25dd tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:38.235738 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-6fcb8720-f5b2-4173-b4f5-6ea33d4c25dd tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:38.246457 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-6fcb8720-f5b2-4173-b4f5-6ea33d4c25dd tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:38.249280 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-6fcb8720-f5b2-4173-b4f5-6ea33d4c25dd tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:38.258603 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6fcb8720-f5b2-4173-b4f5-6ea33d4c25dd tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1546 microversion: 2.91 time: 0.196053 Aug 31 15:59:38.276159 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 530/1045] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:59:38 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1546 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:59:38.282475 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-91ffdfe9-64d5-46ed-893f-20f324a4da95 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:38.283820 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-91ffdfe9-64d5-46ed-893f-20f324a4da95 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] [instance: aade3ca2-9ecc-48db-988a-1ddbc286024a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:38.292031 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-91ffdfe9-64d5-46ed-893f-20f324a4da95 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:38.293802 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-91ffdfe9-64d5-46ed-893f-20f324a4da95 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:38.294432 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-91ffdfe9-64d5-46ed-893f-20f324a4da95 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:38.295790 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-91ffdfe9-64d5-46ed-893f-20f324a4da95 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:38.297233 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-91ffdfe9-64d5-46ed-893f-20f324a4da95 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:38.297887 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-91ffdfe9-64d5-46ed-893f-20f324a4da95 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:38.346363 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7a1e64d0-820a-4b6b-a5d4-3b2797c6ea5f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:38.355856 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7a1e64d0-820a-4b6b-a5d4-3b2797c6ea5f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:38.357319 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7a1e64d0-820a-4b6b-a5d4-3b2797c6ea5f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:38.358450 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7a1e64d0-820a-4b6b-a5d4-3b2797c6ea5f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00" status: 200 len: 1411 microversion: 2.25 time: 0.412746 Aug 31 15:59:38.360331 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 516/1046] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:59:37 2022] GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00 => generated 1411 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:59:38.568652 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-91ffdfe9-64d5-46ed-893f-20f324a4da95 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccce16c7fda401ea68fb31ea8099d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed252ebf7c741bbb36b553ac1767579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:38.580356 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-91ffdfe9-64d5-46ed-893f-20f324a4da95 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "GET /compute/v2.1/servers/aade3ca2-9ecc-48db-988a-1ddbc286024a" status: 200 len: 1324 microversion: 2.1 time: 0.302845 Aug 31 15:59:38.581135 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 531/1047] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:38 2022] GET /compute/v2.1/servers/aade3ca2-9ecc-48db-988a-1ddbc286024a => generated 1324 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:38.897689 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-3c9dc66e-2590-450a-9be6-0dca13e85a6c req-90a19f1b-b100-4720-8968-35343e6dd91b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5de5737d-bcc8-4357-85f0-f4468ac84bc7", "name": "network-vif-deleted", "tag": "860bd128-aaa5-4d35-b493-f0871fc78fdb"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:59:38.899668 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f6a173f0-f025-4b99-b0aa-beff6768ebd9 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Action: 'create', calling method: .version_select at 0x7f5ae9140430>, body: {"keypair": {"name": "tempest-keypair-1228205880", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJB31frRh2/tzu6EOe2ELsEbvEKast4aRLZLVaiYHjQfuJaPOOSSbDIi8yjgD/6cfRe4ReE2FvcOgUk4kJnBX/rFCzsMvdV3UCGCUPJbhilFIa0cUJ+t0h4L9nAM72zDDg=="}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:59:38.928575 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-3c9dc66e-2590-450a-9be6-0dca13e85a6c req-90a19f1b-b100-4720-8968-35343e6dd91b service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:38.929175 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-3c9dc66e-2590-450a-9be6-0dca13e85a6c req-90a19f1b-b100-4720-8968-35343e6dd91b service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:38.929731 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-3c9dc66e-2590-450a-9be6-0dca13e85a6c req-90a19f1b-b100-4720-8968-35343e6dd91b service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:38.947639 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-f6a173f0-f025-4b99-b0aa-beff6768ebd9 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Getting quotas for project a9f780d0079345519eea40fe8a3fd813. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:59:38.948090 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-3c9dc66e-2590-450a-9be6-0dca13e85a6c req-90a19f1b-b100-4720-8968-35343e6dd91b service nova] Creating event network-vif-deleted:860bd128-aaa5-4d35-b493-f0871fc78fdb for instance 5de5737d-bcc8-4357-85f0-f4468ac84bc7 on n-h1-850499-9 Aug 31 15:59:38.955886 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-f6a173f0-f025-4b99-b0aa-beff6768ebd9 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Getting quotas for user eb054cb62b9945a78e6bb60cd613acae and project a9f780d0079345519eea40fe8a3fd813. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:59:38.957606 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-3c9dc66e-2590-450a-9be6-0dca13e85a6c req-90a19f1b-b100-4720-8968-35343e6dd91b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070149 Aug 31 15:59:38.965756 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 532/1048] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 15:59:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:59:38.975156 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-96796487-e0a6-4091-b601-0caee10a76c9 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:38.976337 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-96796487-e0a6-4091-b601-0caee10a76c9 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] [instance: e45fa8b9-1545-4bd5-aa5f-402c71ec19c6] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:38.981778 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=100 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:59:38.987844 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-96796487-e0a6-4091-b601-0caee10a76c9 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:38.989269 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-96796487-e0a6-4091-b601-0caee10a76c9 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:38.991277 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-96796487-e0a6-4091-b601-0caee10a76c9 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:38.993347 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-96796487-e0a6-4091-b601-0caee10a76c9 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:38.994082 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-96796487-e0a6-4091-b601-0caee10a76c9 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:38.994966 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-96796487-e0a6-4091-b601-0caee10a76c9 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:39.016083 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f6a173f0-f025-4b99-b0aa-beff6768ebd9 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.370961 Aug 31 15:59:39.024048 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 517/1049] 10.222.0.61 () {60 vars in 1159 bytes} [Wed Aug 31 15:59:38 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:59:39.075331 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a0e2c8a8-49f8-4bb9-b26c-3771fed032b1 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:39.077669 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a0e2c8a8-49f8-4bb9-b26c-3771fed032b1 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] [instance: 5de5737d-bcc8-4357-85f0-f4468ac84bc7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:39.087384 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a0e2c8a8-49f8-4bb9-b26c-3771fed032b1 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:39.088092 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a0e2c8a8-49f8-4bb9-b26c-3771fed032b1 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:39.089221 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a0e2c8a8-49f8-4bb9-b26c-3771fed032b1 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:39.090122 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a0e2c8a8-49f8-4bb9-b26c-3771fed032b1 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:39.090742 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a0e2c8a8-49f8-4bb9-b26c-3771fed032b1 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:39.091880 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a0e2c8a8-49f8-4bb9-b26c-3771fed032b1 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:39.160876 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a0e2c8a8-49f8-4bb9-b26c-3771fed032b1 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:39.161504 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a0e2c8a8-49f8-4bb9-b26c-3771fed032b1 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:39.164945 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a0e2c8a8-49f8-4bb9-b26c-3771fed032b1 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:39.165603 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-a0e2c8a8-49f8-4bb9-b26c-3771fed032b1 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lazy-loading 'fault' on Instance uuid 5de5737d-bcc8-4357-85f0-f4468ac84bc7 {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:59:39.241088 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a0e2c8a8-49f8-4bb9-b26c-3771fed032b1 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a5652ccb7b54cf7a56f25b91c30c904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5746b9f74e4fecbf2da098436f2ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:39.253362 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a0e2c8a8-49f8-4bb9-b26c-3771fed032b1 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] 10.222.0.61 "GET /compute/v2.1/servers/5de5737d-bcc8-4357-85f0-f4468ac84bc7" status: 200 len: 1322 microversion: 2.1 time: 0.182434 Aug 31 15:59:39.270242 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 518/1050] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:39 2022] GET /compute/v2.1/servers/5de5737d-bcc8-4357-85f0-f4468ac84bc7 => generated 1322 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:59:39.298037 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c96eec40-ada4-4459-95c1-11a89544373d tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:39.302495 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-96796487-e0a6-4091-b601-0caee10a76c9 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a03cc5956ca477abacbe0c26bf18750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea45d1b678342ed812f9912e9f07503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:39.303812 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c96eec40-ada4-4459-95c1-11a89544373d tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:39.312390 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-96796487-e0a6-4091-b601-0caee10a76c9 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] 10.222.0.61 "GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6" status: 200 len: 1473 microversion: 2.1 time: 0.344667 Aug 31 15:59:39.313023 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 533/1051] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:38 2022] GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6 => generated 1473 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:39.320034 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c96eec40-ada4-4459-95c1-11a89544373d tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:39.322039 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c96eec40-ada4-4459-95c1-11a89544373d tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:39.322813 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c96eec40-ada4-4459-95c1-11a89544373d tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:39.323734 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c96eec40-ada4-4459-95c1-11a89544373d tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:39.328879 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c96eec40-ada4-4459-95c1-11a89544373d tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:39.329751 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c96eec40-ada4-4459-95c1-11a89544373d tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:39.384401 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-72357050-cc54-48bd-af88-a849736d3a06 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:39.385049 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-72357050-cc54-48bd-af88-a849736d3a06 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 35b89015-3888-493a-b521-49a5e3769b00] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:39.402080 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-72357050-cc54-48bd-af88-a849736d3a06 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:39.414688 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-72357050-cc54-48bd-af88-a849736d3a06 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:39.415493 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-72357050-cc54-48bd-af88-a849736d3a06 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:39.416432 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-72357050-cc54-48bd-af88-a849736d3a06 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:39.417296 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-72357050-cc54-48bd-af88-a849736d3a06 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:39.418011 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-72357050-cc54-48bd-af88-a849736d3a06 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:39.579629 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c96eec40-ada4-4459-95c1-11a89544373d tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:39.593544 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c96eec40-ada4-4459-95c1-11a89544373d tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:39.600546 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c96eec40-ada4-4459-95c1-11a89544373d tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:39.622584 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c96eec40-ada4-4459-95c1-11a89544373d tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1546 microversion: 2.91 time: 0.338373 Aug 31 15:59:39.624804 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 519/1052] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:59:39 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1546 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 15:59:39.633502 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-56b0252b-acad-4ab5-bdf5-35f4c9c84ce8 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:39.650036 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-56b0252b-acad-4ab5-bdf5-35f4c9c84ce8 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] [instance: aade3ca2-9ecc-48db-988a-1ddbc286024a] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:39.661488 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-56b0252b-acad-4ab5-bdf5-35f4c9c84ce8 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:39.662669 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-56b0252b-acad-4ab5-bdf5-35f4c9c84ce8 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:39.663309 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-56b0252b-acad-4ab5-bdf5-35f4c9c84ce8 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:39.664149 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-56b0252b-acad-4ab5-bdf5-35f4c9c84ce8 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:39.664874 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-56b0252b-acad-4ab5-bdf5-35f4c9c84ce8 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:39.665554 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-56b0252b-acad-4ab5-bdf5-35f4c9c84ce8 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:39.805805 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-72357050-cc54-48bd-af88-a849736d3a06 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:39.824072 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-72357050-cc54-48bd-af88-a849736d3a06 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:39.825818 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-72357050-cc54-48bd-af88-a849736d3a06 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:39.827310 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-72357050-cc54-48bd-af88-a849736d3a06 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00" status: 200 len: 1411 microversion: 2.25 time: 0.447662 Aug 31 15:59:39.840414 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 534/1053] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:59:39 2022] GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00 => generated 1411 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:59:40.067463 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-56b0252b-acad-4ab5-bdf5-35f4c9c84ce8 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccce16c7fda401ea68fb31ea8099d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed252ebf7c741bbb36b553ac1767579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:40.087677 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-56b0252b-acad-4ab5-bdf5-35f4c9c84ce8 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "GET /compute/v2.1/servers/aade3ca2-9ecc-48db-988a-1ddbc286024a" status: 200 len: 1324 microversion: 2.1 time: 0.460079 Aug 31 15:59:40.088549 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 520/1054] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:39 2022] GET /compute/v2.1/servers/aade3ca2-9ecc-48db-988a-1ddbc286024a => generated 1324 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:40.277137 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-335beedd-b47d-4987-9e26-cbc20eb82fb9 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:40.277904 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-335beedd-b47d-4987-9e26-cbc20eb82fb9 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] [instance: 5de5737d-bcc8-4357-85f0-f4468ac84bc7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:40.293143 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-335beedd-b47d-4987-9e26-cbc20eb82fb9 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:40.293650 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-335beedd-b47d-4987-9e26-cbc20eb82fb9 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:40.294138 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-335beedd-b47d-4987-9e26-cbc20eb82fb9 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:40.296345 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-335beedd-b47d-4987-9e26-cbc20eb82fb9 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:40.297083 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-335beedd-b47d-4987-9e26-cbc20eb82fb9 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:40.297490 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-335beedd-b47d-4987-9e26-cbc20eb82fb9 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:40.333695 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ba8c5f9a-f17f-4079-a391-861972778996 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:40.335051 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ba8c5f9a-f17f-4079-a391-861972778996 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] [instance: e45fa8b9-1545-4bd5-aa5f-402c71ec19c6] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:40.347744 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ba8c5f9a-f17f-4079-a391-861972778996 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:40.347855 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ba8c5f9a-f17f-4079-a391-861972778996 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:40.349217 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ba8c5f9a-f17f-4079-a391-861972778996 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:40.356884 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ba8c5f9a-f17f-4079-a391-861972778996 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:40.357498 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ba8c5f9a-f17f-4079-a391-861972778996 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:40.358029 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ba8c5f9a-f17f-4079-a391-861972778996 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:40.378444 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-335beedd-b47d-4987-9e26-cbc20eb82fb9 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:40.379256 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-335beedd-b47d-4987-9e26-cbc20eb82fb9 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:40.379905 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-335beedd-b47d-4987-9e26-cbc20eb82fb9 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:40.380545 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-335beedd-b47d-4987-9e26-cbc20eb82fb9 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lazy-loading 'fault' on Instance uuid 5de5737d-bcc8-4357-85f0-f4468ac84bc7 {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:59:40.463274 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-335beedd-b47d-4987-9e26-cbc20eb82fb9 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a5652ccb7b54cf7a56f25b91c30c904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5746b9f74e4fecbf2da098436f2ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:40.471953 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-335beedd-b47d-4987-9e26-cbc20eb82fb9 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] 10.222.0.61 "GET /compute/v2.1/servers/5de5737d-bcc8-4357-85f0-f4468ac84bc7" status: 200 len: 1322 microversion: 2.1 time: 0.199175 Aug 31 15:59:40.493272 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 535/1055] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:40 2022] GET /compute/v2.1/servers/5de5737d-bcc8-4357-85f0-f4468ac84bc7 => generated 1322 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:40.614250 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ba8c5f9a-f17f-4079-a391-861972778996 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a03cc5956ca477abacbe0c26bf18750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea45d1b678342ed812f9912e9f07503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:40.634910 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ba8c5f9a-f17f-4079-a391-861972778996 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] 10.222.0.61 "GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6" status: 200 len: 1473 microversion: 2.1 time: 0.305599 Aug 31 15:59:40.647913 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 521/1056] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:40 2022] GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6 => generated 1473 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:59:40.662639 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-409f2ce9-33ba-49e1-820c-5ac180018f35 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:40.664657 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-409f2ce9-33ba-49e1-820c-5ac180018f35 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:40.672380 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-409f2ce9-33ba-49e1-820c-5ac180018f35 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:40.672875 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-409f2ce9-33ba-49e1-820c-5ac180018f35 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:40.673570 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-409f2ce9-33ba-49e1-820c-5ac180018f35 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:40.674750 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-409f2ce9-33ba-49e1-820c-5ac180018f35 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:40.675288 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-409f2ce9-33ba-49e1-820c-5ac180018f35 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:40.675974 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-409f2ce9-33ba-49e1-820c-5ac180018f35 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:40.768349 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-409f2ce9-33ba-49e1-820c-5ac180018f35 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:40.778839 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-409f2ce9-33ba-49e1-820c-5ac180018f35 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:40.780737 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-409f2ce9-33ba-49e1-820c-5ac180018f35 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:40.786492 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-409f2ce9-33ba-49e1-820c-5ac180018f35 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1546 microversion: 2.91 time: 0.131819 Aug 31 15:59:40.787121 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 536/1057] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:59:40 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1546 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:59:40.854375 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2f5a9ea3-81bf-4625-9baf-a8f8df1e7ebc tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:40.855086 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2f5a9ea3-81bf-4625-9baf-a8f8df1e7ebc tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 35b89015-3888-493a-b521-49a5e3769b00] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:40.862478 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2f5a9ea3-81bf-4625-9baf-a8f8df1e7ebc tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:40.863201 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2f5a9ea3-81bf-4625-9baf-a8f8df1e7ebc tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:40.863856 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2f5a9ea3-81bf-4625-9baf-a8f8df1e7ebc tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:40.864866 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2f5a9ea3-81bf-4625-9baf-a8f8df1e7ebc tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:40.865944 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2f5a9ea3-81bf-4625-9baf-a8f8df1e7ebc tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:40.866571 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2f5a9ea3-81bf-4625-9baf-a8f8df1e7ebc tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:41.076226 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-2f5a9ea3-81bf-4625-9baf-a8f8df1e7ebc tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:41.088484 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-2f5a9ea3-81bf-4625-9baf-a8f8df1e7ebc tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:41.090256 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-2f5a9ea3-81bf-4625-9baf-a8f8df1e7ebc tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:41.094197 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2f5a9ea3-81bf-4625-9baf-a8f8df1e7ebc tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00" status: 200 len: 1608 microversion: 2.25 time: 0.242547 Aug 31 15:59:41.096039 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 522/1058] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:59:40 2022] GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00 => generated 1608 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:59:41.110481 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c2c488e6-9c86-46ec-af66-cf416b65fbad tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:41.112007 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c2c488e6-9c86-46ec-af66-cf416b65fbad tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] [instance: aade3ca2-9ecc-48db-988a-1ddbc286024a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:41.124190 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-bcc95e00-2843-44c7-a6b0-9e9854b6abdc tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:41.124692 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-bcc95e00-2843-44c7-a6b0-9e9854b6abdc tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 35b89015-3888-493a-b521-49a5e3769b00] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:41.125572 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c2c488e6-9c86-46ec-af66-cf416b65fbad tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:41.126399 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c2c488e6-9c86-46ec-af66-cf416b65fbad tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:41.126573 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c2c488e6-9c86-46ec-af66-cf416b65fbad tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:41.131052 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c2c488e6-9c86-46ec-af66-cf416b65fbad tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:41.133250 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c2c488e6-9c86-46ec-af66-cf416b65fbad tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:41.133757 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c2c488e6-9c86-46ec-af66-cf416b65fbad tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:41.140030 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bcc95e00-2843-44c7-a6b0-9e9854b6abdc tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:41.140600 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bcc95e00-2843-44c7-a6b0-9e9854b6abdc tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:41.142287 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bcc95e00-2843-44c7-a6b0-9e9854b6abdc tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:41.145200 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bcc95e00-2843-44c7-a6b0-9e9854b6abdc tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:41.145815 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bcc95e00-2843-44c7-a6b0-9e9854b6abdc tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:41.146339 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bcc95e00-2843-44c7-a6b0-9e9854b6abdc tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:41.340032 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-bcc95e00-2843-44c7-a6b0-9e9854b6abdc tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00/os-interface" status: 200 len: 285 microversion: 2.25 time: 0.220492 Aug 31 15:59:41.340649 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 523/1059] 10.222.0.61 () {60 vars in 1316 bytes} [Wed Aug 31 15:59:41 2022] GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00/os-interface => generated 285 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 15:59:41.399429 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-088fd8a9-683d-49f7-824f-8ee43e8d9c79 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-554221875", "imageRef": "82f5a6ff-74b2-477e-b772-2ec73c6e85c0", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "2df923bd-e588-441a-afe2-636f5cb86ec9"}], "security_groups": [{"name": "tempest-securitygroup--1043065525"}], "key_name": "tempest-keypair-1228205880", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:59:41.462059 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c2c488e6-9c86-46ec-af66-cf416b65fbad tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccce16c7fda401ea68fb31ea8099d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed252ebf7c741bbb36b553ac1767579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:41.472237 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c2c488e6-9c86-46ec-af66-cf416b65fbad tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "GET /compute/v2.1/servers/aade3ca2-9ecc-48db-988a-1ddbc286024a" status: 200 len: 1324 microversion: 2.1 time: 0.366497 Aug 31 15:59:41.475610 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 537/1060] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:41 2022] GET /compute/v2.1/servers/aade3ca2-9ecc-48db-988a-1ddbc286024a => generated 1324 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:41.500781 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b2a73f64-fea4-48cd-bb36-7281dcae5e61 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:41.501407 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b2a73f64-fea4-48cd-bb36-7281dcae5e61 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] [instance: 5de5737d-bcc8-4357-85f0-f4468ac84bc7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:41.511629 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b2a73f64-fea4-48cd-bb36-7281dcae5e61 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:41.512393 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b2a73f64-fea4-48cd-bb36-7281dcae5e61 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:41.520743 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b2a73f64-fea4-48cd-bb36-7281dcae5e61 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:41.523146 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b2a73f64-fea4-48cd-bb36-7281dcae5e61 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:41.524099 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b2a73f64-fea4-48cd-bb36-7281dcae5e61 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:41.524548 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b2a73f64-fea4-48cd-bb36-7281dcae5e61 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:41.527580 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=100 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:59:41.600652 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b2a73f64-fea4-48cd-bb36-7281dcae5e61 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:41.602281 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b2a73f64-fea4-48cd-bb36-7281dcae5e61 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:41.602937 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b2a73f64-fea4-48cd-bb36-7281dcae5e61 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:41.603635 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-b2a73f64-fea4-48cd-bb36-7281dcae5e61 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lazy-loading 'fault' on Instance uuid 5de5737d-bcc8-4357-85f0-f4468ac84bc7 {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:59:41.694799 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b2a73f64-fea4-48cd-bb36-7281dcae5e61 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a5652ccb7b54cf7a56f25b91c30c904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5746b9f74e4fecbf2da098436f2ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:41.704879 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b2a73f64-fea4-48cd-bb36-7281dcae5e61 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] 10.222.0.61 "GET /compute/v2.1/servers/5de5737d-bcc8-4357-85f0-f4468ac84bc7" status: 200 len: 1322 microversion: 2.1 time: 0.208079 Aug 31 15:59:41.720358 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 538/1061] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:41 2022] GET /compute/v2.1/servers/5de5737d-bcc8-4357-85f0-f4468ac84bc7 => generated 1322 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:41.721584 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-a612c131-4857-431f-b384-54ceb98f52cd req-215210a9-4795-48a8-93e5-79c82f34a7ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aade3ca2-9ecc-48db-988a-1ddbc286024a", "name": "network-vif-plugged", "status": "completed", "tag": "271136ce-1765-4d62-aae2-4b28988d27c0"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:59:41.738678 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-a612c131-4857-431f-b384-54ceb98f52cd req-215210a9-4795-48a8-93e5-79c82f34a7ab service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:41.739201 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-a612c131-4857-431f-b384-54ceb98f52cd req-215210a9-4795-48a8-93e5-79c82f34a7ab service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:41.739774 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-a612c131-4857-431f-b384-54ceb98f52cd req-215210a9-4795-48a8-93e5-79c82f34a7ab service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:41.760821 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-a612c131-4857-431f-b384-54ceb98f52cd req-215210a9-4795-48a8-93e5-79c82f34a7ab service nova] Creating event network-vif-plugged:271136ce-1765-4d62-aae2-4b28988d27c0 for instance aade3ca2-9ecc-48db-988a-1ddbc286024a on n-h2-850499-9 Aug 31 15:59:41.767221 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-a612c131-4857-431f-b384-54ceb98f52cd req-215210a9-4795-48a8-93e5-79c82f34a7ab service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050973 Aug 31 15:59:41.768181 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 539/1062] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 15:59:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:59:41.776162 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-be315769-8ad0-46ee-9473-8942b077edce tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:41.776861 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-be315769-8ad0-46ee-9473-8942b077edce tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] [instance: e45fa8b9-1545-4bd5-aa5f-402c71ec19c6] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:41.785104 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-be315769-8ad0-46ee-9473-8942b077edce tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:41.785576 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-be315769-8ad0-46ee-9473-8942b077edce tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:41.786012 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-be315769-8ad0-46ee-9473-8942b077edce tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:41.787667 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-be315769-8ad0-46ee-9473-8942b077edce tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:41.788409 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-be315769-8ad0-46ee-9473-8942b077edce tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:41.789171 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-be315769-8ad0-46ee-9473-8942b077edce tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:41.792844 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-088fd8a9-683d-49f7-824f-8ee43e8d9c79 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] validate_networks() for [('2df923bd-e588-441a-afe2-636f5cb86ec9', None, None, None, None, None)] {{(pid=122256) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 15:59:42.287217 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-be315769-8ad0-46ee-9473-8942b077edce tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a03cc5956ca477abacbe0c26bf18750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea45d1b678342ed812f9912e9f07503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:42.295361 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-be315769-8ad0-46ee-9473-8942b077edce tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] 10.222.0.61 "GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6" status: 200 len: 1473 microversion: 2.1 time: 0.524442 Aug 31 15:59:42.295979 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 540/1063] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:41 2022] GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6 => generated 1473 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:42.303321 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-66da709b-6608-433e-ae79-93ebad33052d tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:42.305616 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-66da709b-6608-433e-ae79-93ebad33052d tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:42.317462 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-66da709b-6608-433e-ae79-93ebad33052d tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:42.319425 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-66da709b-6608-433e-ae79-93ebad33052d tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:42.320270 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-66da709b-6608-433e-ae79-93ebad33052d tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:42.321039 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-66da709b-6608-433e-ae79-93ebad33052d tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:42.321511 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-66da709b-6608-433e-ae79-93ebad33052d tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:42.322342 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-66da709b-6608-433e-ae79-93ebad33052d tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:42.702113 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-66da709b-6608-433e-ae79-93ebad33052d tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:42.726573 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-66da709b-6608-433e-ae79-93ebad33052d tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:42.728066 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-66da709b-6608-433e-ae79-93ebad33052d tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:42.733665 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-66da709b-6608-433e-ae79-93ebad33052d tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1546 microversion: 2.91 time: 0.436724 Aug 31 15:59:42.734239 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 541/1064] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:59:42 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1546 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:59:42.738649 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7d48ce34-29aa-416f-80de-f64cd24bd79e tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:42.739243 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7d48ce34-29aa-416f-80de-f64cd24bd79e tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] [instance: aade3ca2-9ecc-48db-988a-1ddbc286024a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:42.746097 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7d48ce34-29aa-416f-80de-f64cd24bd79e tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:42.746724 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7d48ce34-29aa-416f-80de-f64cd24bd79e tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:42.747333 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7d48ce34-29aa-416f-80de-f64cd24bd79e tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:42.748064 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7d48ce34-29aa-416f-80de-f64cd24bd79e tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:42.748522 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7d48ce34-29aa-416f-80de-f64cd24bd79e tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:42.748943 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7d48ce34-29aa-416f-80de-f64cd24bd79e tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:43.113376 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7d48ce34-29aa-416f-80de-f64cd24bd79e tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccce16c7fda401ea68fb31ea8099d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed252ebf7c741bbb36b553ac1767579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:43.121853 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7d48ce34-29aa-416f-80de-f64cd24bd79e tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "GET /compute/v2.1/servers/aade3ca2-9ecc-48db-988a-1ddbc286024a" status: 200 len: 1324 microversion: 2.1 time: 0.386608 Aug 31 15:59:43.122670 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 542/1065] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:42 2022] GET /compute/v2.1/servers/aade3ca2-9ecc-48db-988a-1ddbc286024a => generated 1324 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:43.135626 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-15f25063-b6f7-4dbf-9d92-a04df1fd29ac tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:43.136531 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-15f25063-b6f7-4dbf-9d92-a04df1fd29ac tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] [instance: 5de5737d-bcc8-4357-85f0-f4468ac84bc7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:43.148535 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-15f25063-b6f7-4dbf-9d92-a04df1fd29ac tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:43.149217 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-15f25063-b6f7-4dbf-9d92-a04df1fd29ac tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:43.149677 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-15f25063-b6f7-4dbf-9d92-a04df1fd29ac tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:43.150861 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-15f25063-b6f7-4dbf-9d92-a04df1fd29ac tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:43.153207 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-15f25063-b6f7-4dbf-9d92-a04df1fd29ac tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:43.153673 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-15f25063-b6f7-4dbf-9d92-a04df1fd29ac tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:43.210494 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-15f25063-b6f7-4dbf-9d92-a04df1fd29ac tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:43.211123 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-088fd8a9-683d-49f7-824f-8ee43e8d9c79 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 15:59:43.211755 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-15f25063-b6f7-4dbf-9d92-a04df1fd29ac tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:43.211856 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-088fd8a9-683d-49f7-824f-8ee43e8d9c79 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 15:59:43.211947 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-15f25063-b6f7-4dbf-9d92-a04df1fd29ac tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:43.212105 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-088fd8a9-683d-49f7-824f-8ee43e8d9c79 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 15:59:43.212550 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-15f25063-b6f7-4dbf-9d92-a04df1fd29ac tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lazy-loading 'fault' on Instance uuid 5de5737d-bcc8-4357-85f0-f4468ac84bc7 {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:59:43.212755 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-088fd8a9-683d-49f7-824f-8ee43e8d9c79 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 15:59:43.213196 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-088fd8a9-683d-49f7-824f-8ee43e8d9c79 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 15:59:43.225650 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-088fd8a9-683d-49f7-824f-8ee43e8d9c79 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:43.226036 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-088fd8a9-683d-49f7-824f-8ee43e8d9c79 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:43.226494 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-088fd8a9-683d-49f7-824f-8ee43e8d9c79 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:43.227204 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-088fd8a9-683d-49f7-824f-8ee43e8d9c79 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:43.227983 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-088fd8a9-683d-49f7-824f-8ee43e8d9c79 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:43.228417 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-088fd8a9-683d-49f7-824f-8ee43e8d9c79 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:43.259400 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:59:43.274608 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-088fd8a9-683d-49f7-824f-8ee43e8d9c79 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Getting quotas for project a9f780d0079345519eea40fe8a3fd813. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:59:43.288955 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-088fd8a9-683d-49f7-824f-8ee43e8d9c79 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Getting quotas for user eb054cb62b9945a78e6bb60cd613acae and project a9f780d0079345519eea40fe8a3fd813. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:59:43.295305 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-15f25063-b6f7-4dbf-9d92-a04df1fd29ac tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a5652ccb7b54cf7a56f25b91c30c904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5746b9f74e4fecbf2da098436f2ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:43.314808 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-15f25063-b6f7-4dbf-9d92-a04df1fd29ac tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] 10.222.0.61 "GET /compute/v2.1/servers/5de5737d-bcc8-4357-85f0-f4468ac84bc7" status: 200 len: 1322 microversion: 2.1 time: 0.191070 Aug 31 15:59:43.316627 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-088fd8a9-683d-49f7-824f-8ee43e8d9c79 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Going to run 1 instances... {{(pid=122256) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 15:59:43.319295 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-088fd8a9-683d-49f7-824f-8ee43e8d9c79 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] [instance: 39a531e3-b13b-412f-a200-5141c32650be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='82f5a6ff-74b2-477e-b772-2ec73c6e85c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 15:59:43.347929 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 543/1066] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:43 2022] GET /compute/v2.1/servers/5de5737d-bcc8-4357-85f0-f4468ac84bc7 => generated 1322 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:43.359855 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b413bbcb-495d-47db-a4c1-7ba1949e84ff tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:43.360627 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b413bbcb-495d-47db-a4c1-7ba1949e84ff tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] [instance: e45fa8b9-1545-4bd5-aa5f-402c71ec19c6] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:43.374875 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b413bbcb-495d-47db-a4c1-7ba1949e84ff tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:43.375470 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b413bbcb-495d-47db-a4c1-7ba1949e84ff tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:43.377673 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-088fd8a9-683d-49f7-824f-8ee43e8d9c79 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.982624 Aug 31 15:59:43.379383 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 524/1067] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 15:59:41 2022] POST /compute/v2.1/servers => generated 406 bytes in 1985 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 15:59:43.386498 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b413bbcb-495d-47db-a4c1-7ba1949e84ff tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:43.387302 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b413bbcb-495d-47db-a4c1-7ba1949e84ff tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:43.387931 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b413bbcb-495d-47db-a4c1-7ba1949e84ff tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:43.388469 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b413bbcb-495d-47db-a4c1-7ba1949e84ff tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:43.404097 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-495a55b6-fe6c-4939-a1f4-ae75f4579309 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:43.405536 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-495a55b6-fe6c-4939-a1f4-ae75f4579309 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] [instance: 39a531e3-b13b-412f-a200-5141c32650be] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:43.563546 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-495a55b6-fe6c-4939-a1f4-ae75f4579309 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb054cb62b9945a78e6bb60cd613acae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f780d0079345519eea40fe8a3fd813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:43.590408 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-495a55b6-fe6c-4939-a1f4-ae75f4579309 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] 10.222.0.61 "GET /compute/v2.1/servers/39a531e3-b13b-412f-a200-5141c32650be" status: 200 len: 1245 microversion: 2.1 time: 0.194754 Aug 31 15:59:43.605829 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 525/1068] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:43 2022] GET /compute/v2.1/servers/39a531e3-b13b-412f-a200-5141c32650be => generated 1245 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:59:43.760589 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ead91788-e6b3-4fbd-bf24-e2caf3d6aaca tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:43.762376 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ead91788-e6b3-4fbd-bf24-e2caf3d6aaca tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:43.772737 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b413bbcb-495d-47db-a4c1-7ba1949e84ff tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a03cc5956ca477abacbe0c26bf18750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea45d1b678342ed812f9912e9f07503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:43.776408 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ead91788-e6b3-4fbd-bf24-e2caf3d6aaca tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:43.778072 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ead91788-e6b3-4fbd-bf24-e2caf3d6aaca tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:43.779160 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ead91788-e6b3-4fbd-bf24-e2caf3d6aaca tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:43.781451 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ead91788-e6b3-4fbd-bf24-e2caf3d6aaca tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:43.781993 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ead91788-e6b3-4fbd-bf24-e2caf3d6aaca tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:43.784047 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b413bbcb-495d-47db-a4c1-7ba1949e84ff tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] 10.222.0.61 "GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6" status: 200 len: 1473 microversion: 2.1 time: 0.434793 Aug 31 15:59:43.784630 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ead91788-e6b3-4fbd-bf24-e2caf3d6aaca tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:43.814028 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 544/1069] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:43 2022] GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6 => generated 1473 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:43.896943 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ead91788-e6b3-4fbd-bf24-e2caf3d6aaca tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:43.906126 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ead91788-e6b3-4fbd-bf24-e2caf3d6aaca tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:43.908040 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ead91788-e6b3-4fbd-bf24-e2caf3d6aaca tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:43.914766 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ead91788-e6b3-4fbd-bf24-e2caf3d6aaca tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1546 microversion: 2.91 time: 0.158148 Aug 31 15:59:43.936137 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 526/1070] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:59:43 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1546 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 15:59:44.033013 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-8e3137c2-5169-4995-b8e7-d46c145283d8 req-431b430c-2471-40cc-b5b1-edd494e1d31a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35b89015-3888-493a-b521-49a5e3769b00", "tag": "fdce032a-0b32-49de-acd3-1c9df93ae828"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:59:44.051066 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-8e3137c2-5169-4995-b8e7-d46c145283d8 req-431b430c-2471-40cc-b5b1-edd494e1d31a service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:44.051585 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-8e3137c2-5169-4995-b8e7-d46c145283d8 req-431b430c-2471-40cc-b5b1-edd494e1d31a service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:44.052025 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-8e3137c2-5169-4995-b8e7-d46c145283d8 req-431b430c-2471-40cc-b5b1-edd494e1d31a service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:44.104599 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-8e3137c2-5169-4995-b8e7-d46c145283d8 req-431b430c-2471-40cc-b5b1-edd494e1d31a service nova] Creating event network-changed:fdce032a-0b32-49de-acd3-1c9df93ae828 for instance 35b89015-3888-493a-b521-49a5e3769b00 on n-h2-850499-9 Aug 31 15:59:44.119088 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-8e3137c2-5169-4995-b8e7-d46c145283d8 req-431b430c-2471-40cc-b5b1-edd494e1d31a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090194 Aug 31 15:59:44.120357 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 545/1071] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 15:59:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 15:59:44.155588 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-38ea6568-7279-4228-9b44-d9ebe432f524 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:44.156255 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-38ea6568-7279-4228-9b44-d9ebe432f524 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] [instance: aade3ca2-9ecc-48db-988a-1ddbc286024a] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:44.164476 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-38ea6568-7279-4228-9b44-d9ebe432f524 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:44.165242 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-38ea6568-7279-4228-9b44-d9ebe432f524 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:44.165678 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-38ea6568-7279-4228-9b44-d9ebe432f524 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:44.166435 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-38ea6568-7279-4228-9b44-d9ebe432f524 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:44.167086 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-38ea6568-7279-4228-9b44-d9ebe432f524 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:44.167941 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-38ea6568-7279-4228-9b44-d9ebe432f524 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:44.336555 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8719b5ab-929f-4fe1-b3af-72db4028d655 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:44.337347 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8719b5ab-929f-4fe1-b3af-72db4028d655 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] [instance: 5de5737d-bcc8-4357-85f0-f4468ac84bc7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:44.369692 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8719b5ab-929f-4fe1-b3af-72db4028d655 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:44.370199 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8719b5ab-929f-4fe1-b3af-72db4028d655 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:44.370807 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8719b5ab-929f-4fe1-b3af-72db4028d655 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:44.371585 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8719b5ab-929f-4fe1-b3af-72db4028d655 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:44.372025 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8719b5ab-929f-4fe1-b3af-72db4028d655 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:44.372456 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8719b5ab-929f-4fe1-b3af-72db4028d655 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:44.458748 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8719b5ab-929f-4fe1-b3af-72db4028d655 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:44.465514 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8719b5ab-929f-4fe1-b3af-72db4028d655 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:44.466408 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8719b5ab-929f-4fe1-b3af-72db4028d655 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:44.467102 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-8719b5ab-929f-4fe1-b3af-72db4028d655 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lazy-loading 'fault' on Instance uuid 5de5737d-bcc8-4357-85f0-f4468ac84bc7 {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:59:44.543436 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8719b5ab-929f-4fe1-b3af-72db4028d655 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a5652ccb7b54cf7a56f25b91c30c904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5746b9f74e4fecbf2da098436f2ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:44.560720 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8719b5ab-929f-4fe1-b3af-72db4028d655 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] 10.222.0.61 "GET /compute/v2.1/servers/5de5737d-bcc8-4357-85f0-f4468ac84bc7" status: 200 len: 1322 microversion: 2.1 time: 0.229216 Aug 31 15:59:44.562860 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 546/1072] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:44 2022] GET /compute/v2.1/servers/5de5737d-bcc8-4357-85f0-f4468ac84bc7 => generated 1322 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:59:44.614867 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-28a441be-7bea-4a79-b6ba-5b991ce94e45 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:44.616278 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-28a441be-7bea-4a79-b6ba-5b991ce94e45 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] [instance: 39a531e3-b13b-412f-a200-5141c32650be] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:44.623003 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-28a441be-7bea-4a79-b6ba-5b991ce94e45 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:44.624130 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-28a441be-7bea-4a79-b6ba-5b991ce94e45 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:44.625061 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-28a441be-7bea-4a79-b6ba-5b991ce94e45 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:44.626093 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-28a441be-7bea-4a79-b6ba-5b991ce94e45 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:44.626773 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-28a441be-7bea-4a79-b6ba-5b991ce94e45 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:44.627872 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-28a441be-7bea-4a79-b6ba-5b991ce94e45 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:44.636469 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-38ea6568-7279-4228-9b44-d9ebe432f524 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccce16c7fda401ea68fb31ea8099d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed252ebf7c741bbb36b553ac1767579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:44.649146 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-38ea6568-7279-4228-9b44-d9ebe432f524 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "GET /compute/v2.1/servers/aade3ca2-9ecc-48db-988a-1ddbc286024a" status: 200 len: 1521 microversion: 2.1 time: 0.505922 Aug 31 15:59:44.655809 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 527/1073] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:44 2022] GET /compute/v2.1/servers/aade3ca2-9ecc-48db-988a-1ddbc286024a => generated 1521 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:44.685145 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0b33fda6-d940-451f-942c-554b93374eff tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:44.686142 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0b33fda6-d940-451f-942c-554b93374eff tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] [instance: aade3ca2-9ecc-48db-988a-1ddbc286024a] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:44.696459 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0b33fda6-d940-451f-942c-554b93374eff tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:44.697964 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0b33fda6-d940-451f-942c-554b93374eff tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:44.698668 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0b33fda6-d940-451f-942c-554b93374eff tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:44.699942 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0b33fda6-d940-451f-942c-554b93374eff tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:44.703754 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0b33fda6-d940-451f-942c-554b93374eff tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:44.705209 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0b33fda6-d940-451f-942c-554b93374eff tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:44.812549 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-28a441be-7bea-4a79-b6ba-5b991ce94e45 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb054cb62b9945a78e6bb60cd613acae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f780d0079345519eea40fe8a3fd813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:44.822469 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-28a441be-7bea-4a79-b6ba-5b991ce94e45 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] 10.222.0.61 "GET /compute/v2.1/servers/39a531e3-b13b-412f-a200-5141c32650be" status: 200 len: 1249 microversion: 2.1 time: 0.211344 Aug 31 15:59:44.825064 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 547/1074] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:44 2022] GET /compute/v2.1/servers/39a531e3-b13b-412f-a200-5141c32650be => generated 1249 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:59:44.837076 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-acf52c9c-e8e4-49e8-b41f-f2261fc29ae3 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:44.840393 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-acf52c9c-e8e4-49e8-b41f-f2261fc29ae3 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] [instance: e45fa8b9-1545-4bd5-aa5f-402c71ec19c6] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:44.858473 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-acf52c9c-e8e4-49e8-b41f-f2261fc29ae3 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:44.859094 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-acf52c9c-e8e4-49e8-b41f-f2261fc29ae3 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:44.859586 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-acf52c9c-e8e4-49e8-b41f-f2261fc29ae3 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:44.860417 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-acf52c9c-e8e4-49e8-b41f-f2261fc29ae3 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:44.860892 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-acf52c9c-e8e4-49e8-b41f-f2261fc29ae3 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:44.861326 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-acf52c9c-e8e4-49e8-b41f-f2261fc29ae3 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:45.277249 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-0b33fda6-d940-451f-942c-554b93374eff tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccce16c7fda401ea68fb31ea8099d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed252ebf7c741bbb36b553ac1767579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:45.304763 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-acf52c9c-e8e4-49e8-b41f-f2261fc29ae3 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a03cc5956ca477abacbe0c26bf18750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea45d1b678342ed812f9912e9f07503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:45.319603 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0b33fda6-d940-451f-942c-554b93374eff tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "GET /compute/v2.1/servers/aade3ca2-9ecc-48db-988a-1ddbc286024a" status: 200 len: 1521 microversion: 2.1 time: 0.638999 Aug 31 15:59:45.330903 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-acf52c9c-e8e4-49e8-b41f-f2261fc29ae3 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] 10.222.0.61 "GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6" status: 200 len: 1473 microversion: 2.1 time: 0.498960 Aug 31 15:59:45.332145 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 528/1075] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:44 2022] GET /compute/v2.1/servers/aade3ca2-9ecc-48db-988a-1ddbc286024a => generated 1521 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:59:45.338490 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 548/1076] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:44 2022] GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6 => generated 1473 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:45.364928 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-df317d15-c524-4298-b04c-7510caa8e11d tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1890521438"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:59:45.374487 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-df317d15-c524-4298-b04c-7510caa8e11d tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] [instance: aade3ca2-9ecc-48db-988a-1ddbc286024a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:45.378111 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5d794f0f-e0c5-4e7c-93f2-d6e8b2371cc6 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:45.379385 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5d794f0f-e0c5-4e7c-93f2-d6e8b2371cc6 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:45.393904 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-df317d15-c524-4298-b04c-7510caa8e11d tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:45.395170 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-df317d15-c524-4298-b04c-7510caa8e11d tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:45.396665 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-df317d15-c524-4298-b04c-7510caa8e11d tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:45.398444 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-df317d15-c524-4298-b04c-7510caa8e11d tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:45.399595 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-df317d15-c524-4298-b04c-7510caa8e11d tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:45.400655 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-df317d15-c524-4298-b04c-7510caa8e11d tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:45.421182 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5d794f0f-e0c5-4e7c-93f2-d6e8b2371cc6 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:45.422014 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5d794f0f-e0c5-4e7c-93f2-d6e8b2371cc6 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:45.422742 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5d794f0f-e0c5-4e7c-93f2-d6e8b2371cc6 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:45.424018 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5d794f0f-e0c5-4e7c-93f2-d6e8b2371cc6 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:45.424808 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5d794f0f-e0c5-4e7c-93f2-d6e8b2371cc6 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:45.425554 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5d794f0f-e0c5-4e7c-93f2-d6e8b2371cc6 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:45.640852 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5d794f0f-e0c5-4e7c-93f2-d6e8b2371cc6 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:45.652603 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5d794f0f-e0c5-4e7c-93f2-d6e8b2371cc6 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:45.654233 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5d794f0f-e0c5-4e7c-93f2-d6e8b2371cc6 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:45.668154 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5d794f0f-e0c5-4e7c-93f2-d6e8b2371cc6 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1546 microversion: 2.91 time: 0.334249 Aug 31 15:59:45.668995 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 529/1077] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:59:45 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1546 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:59:45.680615 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-49b39f67-1230-4b54-9d80-f2821eb09eb8 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:45.685751 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-49b39f67-1230-4b54-9d80-f2821eb09eb8 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] [instance: 5de5737d-bcc8-4357-85f0-f4468ac84bc7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:45.714416 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-49b39f67-1230-4b54-9d80-f2821eb09eb8 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:45.716760 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-49b39f67-1230-4b54-9d80-f2821eb09eb8 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:45.722197 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-49b39f67-1230-4b54-9d80-f2821eb09eb8 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:45.723318 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-49b39f67-1230-4b54-9d80-f2821eb09eb8 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:45.724264 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-49b39f67-1230-4b54-9d80-f2821eb09eb8 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:45.725515 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-49b39f67-1230-4b54-9d80-f2821eb09eb8 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:45.774341 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:59:45.828199 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-49b39f67-1230-4b54-9d80-f2821eb09eb8 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:45.829460 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-49b39f67-1230-4b54-9d80-f2821eb09eb8 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:45.830390 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-49b39f67-1230-4b54-9d80-f2821eb09eb8 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:45.831322 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-49b39f67-1230-4b54-9d80-f2821eb09eb8 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lazy-loading 'fault' on Instance uuid 5de5737d-bcc8-4357-85f0-f4468ac84bc7 {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:59:45.951456 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-49b39f67-1230-4b54-9d80-f2821eb09eb8 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a5652ccb7b54cf7a56f25b91c30c904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5746b9f74e4fecbf2da098436f2ce4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:45.971082 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-49b39f67-1230-4b54-9d80-f2821eb09eb8 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] 10.222.0.61 "GET /compute/v2.1/servers/5de5737d-bcc8-4357-85f0-f4468ac84bc7" status: 200 len: 1322 microversion: 2.1 time: 0.297817 Aug 31 15:59:45.972767 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 530/1078] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:45 2022] GET /compute/v2.1/servers/5de5737d-bcc8-4357-85f0-f4468ac84bc7 => generated 1322 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:45.984214 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-98c9d7a6-c153-45e4-8911-e39031337e85 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:45.985548 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-98c9d7a6-c153-45e4-8911-e39031337e85 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] [instance: 39a531e3-b13b-412f-a200-5141c32650be] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:45.997989 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-98c9d7a6-c153-45e4-8911-e39031337e85 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:45.999289 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-98c9d7a6-c153-45e4-8911-e39031337e85 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:46.000539 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-98c9d7a6-c153-45e4-8911-e39031337e85 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:46.002407 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-98c9d7a6-c153-45e4-8911-e39031337e85 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:46.003285 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-98c9d7a6-c153-45e4-8911-e39031337e85 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:46.004269 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-98c9d7a6-c153-45e4-8911-e39031337e85 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:46.056509 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-df317d15-c524-4298-b04c-7510caa8e11d tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "POST /compute/v2.1/servers/aade3ca2-9ecc-48db-988a-1ddbc286024a/action" status: 202 len: 0 microversion: 2.1 time: 0.687724 Aug 31 15:59:46.062553 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 549/1079] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 15:59:45 2022] POST /compute/v2.1/servers/aade3ca2-9ecc-48db-988a-1ddbc286024a/action => generated 0 bytes in 707 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 31 15:59:46.086351 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-34ddafc6-00c5-4fcc-9937-c0e6be3214d5 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Calling method '.version_select at 0x7f5ae8e2b310>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:46.243181 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-98c9d7a6-c153-45e4-8911-e39031337e85 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb054cb62b9945a78e6bb60cd613acae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f780d0079345519eea40fe8a3fd813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:46.259688 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-98c9d7a6-c153-45e4-8911-e39031337e85 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] 10.222.0.61 "GET /compute/v2.1/servers/39a531e3-b13b-412f-a200-5141c32650be" status: 200 len: 1249 microversion: 2.1 time: 0.285384 Aug 31 15:59:46.260483 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 531/1080] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:45 2022] GET /compute/v2.1/servers/39a531e3-b13b-412f-a200-5141c32650be => generated 1249 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:46.391591 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-694e6a59-6ff9-4e81-9bc0-e77a1cf4486e tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:46.392212 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-694e6a59-6ff9-4e81-9bc0-e77a1cf4486e tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] [instance: e45fa8b9-1545-4bd5-aa5f-402c71ec19c6] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:46.401849 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-694e6a59-6ff9-4e81-9bc0-e77a1cf4486e tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:46.402179 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-34ddafc6-00c5-4fcc-9937-c0e6be3214d5 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "DELETE /compute/v2.1/images/6ae898ff-c116-4291-b133-ab80a8becab5" status: 204 len: 0 microversion: 2.1 time: 0.331015 Aug 31 15:59:46.402658 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-694e6a59-6ff9-4e81-9bc0-e77a1cf4486e tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:46.402896 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-694e6a59-6ff9-4e81-9bc0-e77a1cf4486e tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:46.403789 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-694e6a59-6ff9-4e81-9bc0-e77a1cf4486e tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:46.404285 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 550/1081] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:46 2022] DELETE /compute/v2.1/images/6ae898ff-c116-4291-b133-ab80a8becab5 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 15:59:46.404417 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-694e6a59-6ff9-4e81-9bc0-e77a1cf4486e tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:46.404759 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-694e6a59-6ff9-4e81-9bc0-e77a1cf4486e tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:46.415006 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c470f309-15d5-4a07-89e5-e6deaca932c6 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Calling method '.version_select at 0x7f5ae8d2aa60>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:46.445966 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-c470f309-15d5-4a07-89e5-e6deaca932c6 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] HTTP exception thrown: Image not found. Aug 31 15:59:46.449186 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c470f309-15d5-4a07-89e5-e6deaca932c6 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Request method failure captured: Aug 31 15:59:46.449186 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/images/6ae898ff-c116-4291-b133-ab80a8becab5 HTTP/1.1 Aug 31 15:59:46.449186 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 15:59:46.449186 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 15:59:46.449186 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 15:59:46.449186 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 15:59:46.449186 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 15:59:46.449186 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 15:59:46.449186 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 15:59:46.449186 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 15:59:46.449186 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4UcGHO9gatUvWJBB907oWawoQP70h6HsJbsny_eFggCHTOgqUkoCg1AvAVcAHjORdEbkXL7xp_g0w0MdWTsQsxdtQLftyhBkZlCr9g7XUi02ZEumxE15kVflv1oC3aQIZmyWr_qGIamtOyoWvoJnlxnc8ckdznU53DKuHgbDBtijYA Aug 31 15:59:46.449186 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 15:59:46.449186 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 15:59:46.449186 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 15:59:46.449186 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 15:59:46.449186 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 15:59:46.449186 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 15:59:46.449186 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 7ed252ebf7c741bbb36b553ac1767579 Aug 31 15:59:46.449186 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-977175069 Aug 31 15:59:46.449186 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 15:59:46.449186 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 15:59:46.450701 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7ed252ebf7c741bbb36b553ac1767579"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7ed252ebf7c741bbb36b553ac1767579"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7ed252ebf7c741bbb36b553ac1767579", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7ed252ebf7c741bbb36b553ac1767579"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 15:59:46.450701 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-977175069 Aug 31 15:59:46.450701 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 7ed252ebf7c741bbb36b553ac1767579 Aug 31 15:59:46.450701 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-977175069 Aug 31 15:59:46.450701 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ImagesOneServerNegativeTestJSON-977175069-project Aug 31 15:59:46.450701 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 15:59:46.450701 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 15:59:46.450701 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 3ccce16c7fda401ea68fb31ea8099d78 Aug 31 15:59:46.450701 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-977175069-project Aug 31 15:59:46.450701 n-d-850499-9 devstack@n-api.service[122257]: method: Aug 31 15:59:46.450701 n-d-850499-9 devstack@n-api.service[122257]: exception: Image not found. Aug 31 15:59:46.450701 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '6ae898ff-c116-4291-b133-ab80a8becab5'} Aug 31 15:59:46.450701 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:59:46.451610 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:46.451610 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 31 15:59:46.451610 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 31 15:59:46.451610 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 31 15:59:46.451610 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 31 15:59:46.451610 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 31 15:59:46.451610 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 31 15:59:46.451610 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 31 15:59:46.451610 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 31 15:59:46.451610 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 31 15:59:46.451610 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 31 15:59:46.451610 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 31 15:59:46.451610 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 31 15:59:46.451610 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 31 15:59:46.451610 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 31 15:59:46.451610 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 31 15:59:46.451610 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 31 15:59:46.451610 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 6ae898ff-c116-4291-b133-ab80a8becab5 Aug 31 15:59:46.452719 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:59:46.452719 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:59:46.452719 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:59:46.452719 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:46.452719 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 31 15:59:46.452719 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 31 15:59:46.452719 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 31 15:59:46.452719 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 31 15:59:46.452719 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 31 15:59:46.452719 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 31 15:59:46.452719 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 31 15:59:46.452719 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 31 15:59:46.452719 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 31 15:59:46.452719 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 31 15:59:46.452719 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 31 15:59:46.452719 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 31 15:59:46.452719 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 31 15:59:46.452719 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 31 15:59:46.452719 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 31 15:59:46.452719 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 31 15:59:46.454227 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 31 15:59:46.454227 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 31 15:59:46.454227 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 31 15:59:46.454227 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 31 15:59:46.454227 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 31 15:59:46.454227 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 31 15:59:46.454227 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 31 15:59:46.454227 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 31 15:59:46.454227 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6ae898ff-c116-4291-b133-ab80a8becab5 could not be found. Aug 31 15:59:46.454227 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:59:46.454227 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:59:46.454227 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:59:46.454227 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:46.454227 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:59:46.454227 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:59:46.454227 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:59:46.454227 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:59:46.454227 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 15:59:46.454227 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 15:59:46.455623 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:59:46.455623 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:59:46.455623 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 31 15:59:46.455623 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 31 15:59:46.455623 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 31 15:59:46.455623 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:59:46.455623 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:59:46.455623 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:59:46.455623 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:46.455623 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:59:46.455623 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:59:46.455623 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:59:46.455623 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:59:46.455623 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 31 15:59:46.455623 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:59:46.455623 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c470f309-15d5-4a07-89e5-e6deaca932c6 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Returning 404 to user: Image not found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:59:46.457145 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c470f309-15d5-4a07-89e5-e6deaca932c6 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "GET /compute/v2.1/images/6ae898ff-c116-4291-b133-ab80a8becab5" status: 404 len: 62 microversion: 2.1 time: 0.041627 Aug 31 15:59:46.457145 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 551/1082] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 15:59:46 2022] GET /compute/v2.1/images/6ae898ff-c116-4291-b133-ab80a8becab5 => generated 62 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 31 15:59:46.462728 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ac85b30e-4746-4e99-849c-842ade1258f9 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:46.463943 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ac85b30e-4746-4e99-849c-842ade1258f9 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] [instance: aade3ca2-9ecc-48db-988a-1ddbc286024a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:46.471271 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ac85b30e-4746-4e99-849c-842ade1258f9 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:46.472427 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ac85b30e-4746-4e99-849c-842ade1258f9 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:46.473082 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ac85b30e-4746-4e99-849c-842ade1258f9 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:46.475621 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ac85b30e-4746-4e99-849c-842ade1258f9 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:46.476133 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ac85b30e-4746-4e99-849c-842ade1258f9 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:46.476831 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ac85b30e-4746-4e99-849c-842ade1258f9 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:46.648345 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-694e6a59-6ff9-4e81-9bc0-e77a1cf4486e tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a03cc5956ca477abacbe0c26bf18750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea45d1b678342ed812f9912e9f07503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:46.656846 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-694e6a59-6ff9-4e81-9bc0-e77a1cf4486e tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] 10.222.0.61 "GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6" status: 200 len: 1473 microversion: 2.1 time: 0.269769 Aug 31 15:59:46.663358 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 532/1083] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:46 2022] GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6 => generated 1473 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:46.725021 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f84eca99-859f-4f0c-8772-3ad529393945 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:46.726948 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f84eca99-859f-4f0c-8772-3ad529393945 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:46.734581 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f84eca99-859f-4f0c-8772-3ad529393945 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:46.735478 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f84eca99-859f-4f0c-8772-3ad529393945 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:46.736668 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f84eca99-859f-4f0c-8772-3ad529393945 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:46.737596 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f84eca99-859f-4f0c-8772-3ad529393945 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:46.738405 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f84eca99-859f-4f0c-8772-3ad529393945 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:46.739303 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f84eca99-859f-4f0c-8772-3ad529393945 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:46.783832 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ac85b30e-4746-4e99-849c-842ade1258f9 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccce16c7fda401ea68fb31ea8099d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed252ebf7c741bbb36b553ac1767579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:46.792812 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ac85b30e-4746-4e99-849c-842ade1258f9 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "GET /compute/v2.1/servers/aade3ca2-9ecc-48db-988a-1ddbc286024a" status: 200 len: 1533 microversion: 2.1 time: 0.336055 Aug 31 15:59:46.793557 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 552/1084] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:46 2022] GET /compute/v2.1/servers/aade3ca2-9ecc-48db-988a-1ddbc286024a => generated 1533 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:46.840115 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f84eca99-859f-4f0c-8772-3ad529393945 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:46.851161 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f84eca99-859f-4f0c-8772-3ad529393945 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:46.853397 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f84eca99-859f-4f0c-8772-3ad529393945 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:46.861183 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f84eca99-859f-4f0c-8772-3ad529393945 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1546 microversion: 2.91 time: 0.142321 Aug 31 15:59:46.871542 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 533/1085] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:59:46 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1546 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:59:46.996878 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1176c926-912c-42ed-afdb-a9f6914db17a tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:46.997491 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1176c926-912c-42ed-afdb-a9f6914db17a tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] [instance: 5de5737d-bcc8-4357-85f0-f4468ac84bc7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:47.004204 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1176c926-912c-42ed-afdb-a9f6914db17a tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:47.004698 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1176c926-912c-42ed-afdb-a9f6914db17a tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:47.005135 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1176c926-912c-42ed-afdb-a9f6914db17a tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:47.005928 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1176c926-912c-42ed-afdb-a9f6914db17a tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:47.006386 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1176c926-912c-42ed-afdb-a9f6914db17a tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:47.006803 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1176c926-912c-42ed-afdb-a9f6914db17a tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:47.020427 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-1176c926-912c-42ed-afdb-a9f6914db17a tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] HTTP exception thrown: Instance 5de5737d-bcc8-4357-85f0-f4468ac84bc7 could not be found. Aug 31 15:59:47.021981 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1176c926-912c-42ed-afdb-a9f6914db17a tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Request method failure captured: Aug 31 15:59:47.021981 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/5de5737d-bcc8-4357-85f0-f4468ac84bc7 HTTP/1.1 Aug 31 15:59:47.021981 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 15:59:47.021981 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 15:59:47.021981 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 15:59:47.021981 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 15:59:47.021981 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 15:59:47.021981 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 15:59:47.021981 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 15:59:47.021981 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 15:59:47.021981 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4UwPpoSdZA9uxW3WFL7_35hH44k_Rm1LHX7YzA8CPavMf_yK9gcDBXaQiX3qmdjO0k3V6fiHzSoEdqd4J2LEBtfbz-LvhySlEZZQQZud-oGXxloRxlgDCrurecLuwDL_XkMfJ6_4u6k-LTUscNwKpGuyDQBkM1q0NpdEnTayWAerT0 Aug 31 15:59:47.021981 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 15:59:47.021981 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 15:59:47.021981 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 15:59:47.021981 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 15:59:47.021981 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 15:59:47.021981 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 15:59:47.021981 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 0d5746b9f74e4fecbf2da098436f2ce4 Aug 31 15:59:47.021981 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 Aug 31 15:59:47.021981 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 15:59:47.021981 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 15:59:47.023651 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0d5746b9f74e4fecbf2da098436f2ce4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/0d5746b9f74e4fecbf2da098436f2ce4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_0d5746b9f74e4fecbf2da098436f2ce4", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0d5746b9f74e4fecbf2da098436f2ce4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 15:59:47.023651 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 Aug 31 15:59:47.023651 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 0d5746b9f74e4fecbf2da098436f2ce4 Aug 31 15:59:47.023651 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 Aug 31 15:59:47.023651 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project Aug 31 15:59:47.023651 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 15:59:47.023651 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 15:59:47.023651 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 1a5652ccb7b54cf7a56f25b91c30c904 Aug 31 15:59:47.023651 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project Aug 31 15:59:47.023651 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 15:59:47.023651 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance 5de5737d-bcc8-4357-85f0-f4468ac84bc7 could not be found. Aug 31 15:59:47.024534 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '5de5737d-bcc8-4357-85f0-f4468ac84bc7'} Aug 31 15:59:47.024534 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:59:47.024534 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:47.024534 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 15:59:47.024534 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 15:59:47.024534 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 15:59:47.024534 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 15:59:47.024534 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 15:59:47.024534 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 15:59:47.024534 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 15:59:47.024534 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 15:59:47.024534 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5de5737d-bcc8-4357-85f0-f4468ac84bc7 could not be found. Aug 31 15:59:47.024534 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:59:47.024534 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:59:47.024534 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:59:47.024534 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:47.024534 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:59:47.024534 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:59:47.024534 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:59:47.024534 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:59:47.026006 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:59:47.026006 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:59:47.026006 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 15:59:47.026006 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 15:59:47.026006 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 15:59:47.026006 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 15:59:47.026006 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 15:59:47.026006 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:59:47.026006 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5de5737d-bcc8-4357-85f0-f4468ac84bc7 could not be found. Aug 31 15:59:47.026006 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:59:47.026006 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:59:47.026006 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:59:47.026006 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:47.026006 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:59:47.026006 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:59:47.026006 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:59:47.026006 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:59:47.026006 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5de5737d-bcc8-4357-85f0-f4468ac84bc7 could not be found. Aug 31 15:59:47.026006 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:59:47.027407 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1176c926-912c-42ed-afdb-a9f6914db17a tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] Returning 404 to user: Instance 5de5737d-bcc8-4357-85f0-f4468ac84bc7 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:59:47.027407 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1176c926-912c-42ed-afdb-a9f6914db17a tempest-FloatingIPsAssociationNegativeTestJSON-1038433536 tempest-FloatingIPsAssociationNegativeTestJSON-1038433536-project] 10.222.0.61 "GET /compute/v2.1/servers/5de5737d-bcc8-4357-85f0-f4468ac84bc7" status: 404 len: 111 microversion: 2.1 time: 0.031458 Aug 31 15:59:47.027407 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 553/1086] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:46 2022] GET /compute/v2.1/servers/5de5737d-bcc8-4357-85f0-f4468ac84bc7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:59:47.289587 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e4818f47-879d-48bb-a67a-bdbf726754e4 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:47.290157 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e4818f47-879d-48bb-a67a-bdbf726754e4 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] [instance: 39a531e3-b13b-412f-a200-5141c32650be] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:47.297262 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e4818f47-879d-48bb-a67a-bdbf726754e4 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:47.297785 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e4818f47-879d-48bb-a67a-bdbf726754e4 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:47.298227 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e4818f47-879d-48bb-a67a-bdbf726754e4 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:47.298934 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e4818f47-879d-48bb-a67a-bdbf726754e4 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:47.299393 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e4818f47-879d-48bb-a67a-bdbf726754e4 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:47.299847 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e4818f47-879d-48bb-a67a-bdbf726754e4 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:47.394151 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e4818f47-879d-48bb-a67a-bdbf726754e4 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb054cb62b9945a78e6bb60cd613acae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f780d0079345519eea40fe8a3fd813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:47.402935 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e4818f47-879d-48bb-a67a-bdbf726754e4 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] 10.222.0.61 "GET /compute/v2.1/servers/39a531e3-b13b-412f-a200-5141c32650be" status: 200 len: 1297 microversion: 2.1 time: 0.118802 Aug 31 15:59:47.415521 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 534/1087] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:47 2022] GET /compute/v2.1/servers/39a531e3-b13b-412f-a200-5141c32650be => generated 1297 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:47.691817 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-fc2dbb3b-f654-4df0-9472-b577cb579498 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:47.692830 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-fc2dbb3b-f654-4df0-9472-b577cb579498 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] [instance: e45fa8b9-1545-4bd5-aa5f-402c71ec19c6] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:47.706231 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fc2dbb3b-f654-4df0-9472-b577cb579498 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:47.706231 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fc2dbb3b-f654-4df0-9472-b577cb579498 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:47.706583 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fc2dbb3b-f654-4df0-9472-b577cb579498 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:47.707529 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fc2dbb3b-f654-4df0-9472-b577cb579498 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:47.708161 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fc2dbb3b-f654-4df0-9472-b577cb579498 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:47.709411 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fc2dbb3b-f654-4df0-9472-b577cb579498 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:47.815325 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-03e0c2de-9626-406a-a95e-1092daea425b tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:47.815916 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-03e0c2de-9626-406a-a95e-1092daea425b tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] [instance: aade3ca2-9ecc-48db-988a-1ddbc286024a] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:47.824185 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-03e0c2de-9626-406a-a95e-1092daea425b tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:47.824862 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-03e0c2de-9626-406a-a95e-1092daea425b tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:47.825406 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-03e0c2de-9626-406a-a95e-1092daea425b tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:47.826153 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-03e0c2de-9626-406a-a95e-1092daea425b tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:47.826619 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-03e0c2de-9626-406a-a95e-1092daea425b tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:47.827052 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-03e0c2de-9626-406a-a95e-1092daea425b tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:48.236809 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-03e0c2de-9626-406a-a95e-1092daea425b tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccce16c7fda401ea68fb31ea8099d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed252ebf7c741bbb36b553ac1767579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:48.241815 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-fc2dbb3b-f654-4df0-9472-b577cb579498 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a03cc5956ca477abacbe0c26bf18750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea45d1b678342ed812f9912e9f07503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:48.245726 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-03e0c2de-9626-406a-a95e-1092daea425b tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "GET /compute/v2.1/servers/aade3ca2-9ecc-48db-988a-1ddbc286024a" status: 200 len: 1533 microversion: 2.1 time: 0.435084 Aug 31 15:59:48.246313 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 535/1088] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:47 2022] GET /compute/v2.1/servers/aade3ca2-9ecc-48db-988a-1ddbc286024a => generated 1533 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:59:48.259215 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-fc2dbb3b-f654-4df0-9472-b577cb579498 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] 10.222.0.61 "GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6" status: 200 len: 1473 microversion: 2.1 time: 0.562877 Aug 31 15:59:48.264580 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5c044a05-6208-438d-ba3c-87dfd4381cde tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:48.265140 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 554/1089] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:47 2022] GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6 => generated 1473 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:48.265264 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5c044a05-6208-438d-ba3c-87dfd4381cde tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:48.271073 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5c044a05-6208-438d-ba3c-87dfd4381cde tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:48.272113 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5c044a05-6208-438d-ba3c-87dfd4381cde tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:48.272552 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5c044a05-6208-438d-ba3c-87dfd4381cde tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:48.273258 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5c044a05-6208-438d-ba3c-87dfd4381cde tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:48.273714 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5c044a05-6208-438d-ba3c-87dfd4381cde tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:48.274143 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5c044a05-6208-438d-ba3c-87dfd4381cde tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:48.351845 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5c044a05-6208-438d-ba3c-87dfd4381cde tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:48.360659 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5c044a05-6208-438d-ba3c-87dfd4381cde tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:48.362125 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5c044a05-6208-438d-ba3c-87dfd4381cde tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:48.367839 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5c044a05-6208-438d-ba3c-87dfd4381cde tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1546 microversion: 2.91 time: 0.106974 Aug 31 15:59:48.368434 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 536/1090] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:59:48 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1546 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:59:48.424752 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e8be129f-c2c2-45c2-ac56-8b06dd5a2b42 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:48.425456 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e8be129f-c2c2-45c2-ac56-8b06dd5a2b42 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] [instance: 39a531e3-b13b-412f-a200-5141c32650be] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:48.431848 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e8be129f-c2c2-45c2-ac56-8b06dd5a2b42 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:48.432428 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e8be129f-c2c2-45c2-ac56-8b06dd5a2b42 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:48.432877 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e8be129f-c2c2-45c2-ac56-8b06dd5a2b42 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:48.433585 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e8be129f-c2c2-45c2-ac56-8b06dd5a2b42 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:48.434045 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e8be129f-c2c2-45c2-ac56-8b06dd5a2b42 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:48.434478 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e8be129f-c2c2-45c2-ac56-8b06dd5a2b42 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:48.512759 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e8be129f-c2c2-45c2-ac56-8b06dd5a2b42 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb054cb62b9945a78e6bb60cd613acae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f780d0079345519eea40fe8a3fd813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:48.523489 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e8be129f-c2c2-45c2-ac56-8b06dd5a2b42 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] 10.222.0.61 "GET /compute/v2.1/servers/39a531e3-b13b-412f-a200-5141c32650be" status: 200 len: 1297 microversion: 2.1 time: 0.102594 Aug 31 15:59:48.525295 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 555/1091] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:48 2022] GET /compute/v2.1/servers/39a531e3-b13b-412f-a200-5141c32650be => generated 1297 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:49.266265 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-edf3c6cb-7109-4d5b-8111-a50a0b9df5d3 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:49.266872 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-edf3c6cb-7109-4d5b-8111-a50a0b9df5d3 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] [instance: aade3ca2-9ecc-48db-988a-1ddbc286024a] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:49.273806 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-edf3c6cb-7109-4d5b-8111-a50a0b9df5d3 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:49.274119 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0c0bd81a-5d2f-4649-90e6-4b9e49a17d8c tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:49.274754 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0c0bd81a-5d2f-4649-90e6-4b9e49a17d8c tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] [instance: e45fa8b9-1545-4bd5-aa5f-402c71ec19c6] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:49.275262 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-edf3c6cb-7109-4d5b-8111-a50a0b9df5d3 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:49.276062 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-edf3c6cb-7109-4d5b-8111-a50a0b9df5d3 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:49.277194 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-edf3c6cb-7109-4d5b-8111-a50a0b9df5d3 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:49.278454 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-edf3c6cb-7109-4d5b-8111-a50a0b9df5d3 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:49.279086 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-edf3c6cb-7109-4d5b-8111-a50a0b9df5d3 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:49.281548 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0c0bd81a-5d2f-4649-90e6-4b9e49a17d8c tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:49.282231 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0c0bd81a-5d2f-4649-90e6-4b9e49a17d8c tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:49.282870 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0c0bd81a-5d2f-4649-90e6-4b9e49a17d8c tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:49.283834 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0c0bd81a-5d2f-4649-90e6-4b9e49a17d8c tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:49.284302 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0c0bd81a-5d2f-4649-90e6-4b9e49a17d8c tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:49.286222 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0c0bd81a-5d2f-4649-90e6-4b9e49a17d8c tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:49.308902 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:59:49.580707 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0c0bd81a-5d2f-4649-90e6-4b9e49a17d8c tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a03cc5956ca477abacbe0c26bf18750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea45d1b678342ed812f9912e9f07503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:49.590960 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0c0bd81a-5d2f-4649-90e6-4b9e49a17d8c tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] 10.222.0.61 "GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6" status: 200 len: 1473 microversion: 2.1 time: 0.320971 Aug 31 15:59:49.603528 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 556/1092] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:49 2022] GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6 => generated 1473 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:59:49.603528 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3486a4ea-4095-468e-9364-8c263d5c8d5d tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:49.603528 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3486a4ea-4095-468e-9364-8c263d5c8d5d tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:49.604039 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-edf3c6cb-7109-4d5b-8111-a50a0b9df5d3 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccce16c7fda401ea68fb31ea8099d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed252ebf7c741bbb36b553ac1767579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:49.607734 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3486a4ea-4095-468e-9364-8c263d5c8d5d tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:49.608338 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3486a4ea-4095-468e-9364-8c263d5c8d5d tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:49.608865 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3486a4ea-4095-468e-9364-8c263d5c8d5d tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:49.609705 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3486a4ea-4095-468e-9364-8c263d5c8d5d tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:49.610260 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3486a4ea-4095-468e-9364-8c263d5c8d5d tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:49.610785 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3486a4ea-4095-468e-9364-8c263d5c8d5d tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:49.611543 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-edf3c6cb-7109-4d5b-8111-a50a0b9df5d3 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "GET /compute/v2.1/servers/aade3ca2-9ecc-48db-988a-1ddbc286024a" status: 200 len: 1539 microversion: 2.1 time: 0.349127 Aug 31 15:59:49.616003 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 537/1093] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:49 2022] GET /compute/v2.1/servers/aade3ca2-9ecc-48db-988a-1ddbc286024a => generated 1539 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:49.621025 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c52f9c1f-4698-4a35-99ea-d61dba617917 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:49.621843 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c52f9c1f-4698-4a35-99ea-d61dba617917 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] [instance: 39a531e3-b13b-412f-a200-5141c32650be] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:49.628777 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c52f9c1f-4698-4a35-99ea-d61dba617917 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:49.629267 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c52f9c1f-4698-4a35-99ea-d61dba617917 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:49.629702 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c52f9c1f-4698-4a35-99ea-d61dba617917 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:49.630400 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c52f9c1f-4698-4a35-99ea-d61dba617917 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:49.630933 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c52f9c1f-4698-4a35-99ea-d61dba617917 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:49.631359 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c52f9c1f-4698-4a35-99ea-d61dba617917 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:49.732735 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3486a4ea-4095-468e-9364-8c263d5c8d5d tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:49.743430 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3486a4ea-4095-468e-9364-8c263d5c8d5d tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:49.745364 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3486a4ea-4095-468e-9364-8c263d5c8d5d tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:49.750834 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3486a4ea-4095-468e-9364-8c263d5c8d5d tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1546 microversion: 2.91 time: 0.157635 Aug 31 15:59:49.751979 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 557/1094] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:59:49 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1546 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:59:49.758514 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c52f9c1f-4698-4a35-99ea-d61dba617917 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb054cb62b9945a78e6bb60cd613acae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f780d0079345519eea40fe8a3fd813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:49.767703 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c52f9c1f-4698-4a35-99ea-d61dba617917 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] 10.222.0.61 "GET /compute/v2.1/servers/39a531e3-b13b-412f-a200-5141c32650be" status: 200 len: 1297 microversion: 2.1 time: 0.150182 Aug 31 15:59:49.769601 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 538/1095] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:49 2022] GET /compute/v2.1/servers/39a531e3-b13b-412f-a200-5141c32650be => generated 1297 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:50.615831 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f6a48bbf-23f5-4adf-9029-6ce55e5d8501 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:50.616528 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f6a48bbf-23f5-4adf-9029-6ce55e5d8501 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] [instance: e45fa8b9-1545-4bd5-aa5f-402c71ec19c6] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:50.627201 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f6a48bbf-23f5-4adf-9029-6ce55e5d8501 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:50.627987 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f6a48bbf-23f5-4adf-9029-6ce55e5d8501 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:50.628618 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f6a48bbf-23f5-4adf-9029-6ce55e5d8501 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:50.630313 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f6a48bbf-23f5-4adf-9029-6ce55e5d8501 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:50.630313 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f6a48bbf-23f5-4adf-9029-6ce55e5d8501 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:50.632084 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f6a48bbf-23f5-4adf-9029-6ce55e5d8501 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:50.642045 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-93a470f7-6598-4319-986b-e7bd7de2eddc tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:50.643948 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-93a470f7-6598-4319-986b-e7bd7de2eddc tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] [instance: aade3ca2-9ecc-48db-988a-1ddbc286024a] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:50.652808 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-93a470f7-6598-4319-986b-e7bd7de2eddc tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:50.653868 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-93a470f7-6598-4319-986b-e7bd7de2eddc tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:50.654418 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-93a470f7-6598-4319-986b-e7bd7de2eddc tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:50.655591 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-93a470f7-6598-4319-986b-e7bd7de2eddc tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:50.656153 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-93a470f7-6598-4319-986b-e7bd7de2eddc tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:50.656756 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-93a470f7-6598-4319-986b-e7bd7de2eddc tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:50.981523 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f6a48bbf-23f5-4adf-9029-6ce55e5d8501 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a03cc5956ca477abacbe0c26bf18750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea45d1b678342ed812f9912e9f07503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:50.985903 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-93a470f7-6598-4319-986b-e7bd7de2eddc tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccce16c7fda401ea68fb31ea8099d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed252ebf7c741bbb36b553ac1767579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:50.994177 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f6a48bbf-23f5-4adf-9029-6ce55e5d8501 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] 10.222.0.61 "GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6" status: 200 len: 1473 microversion: 2.1 time: 0.382708 Aug 31 15:59:50.995620 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-93a470f7-6598-4319-986b-e7bd7de2eddc tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "GET /compute/v2.1/servers/aade3ca2-9ecc-48db-988a-1ddbc286024a" status: 200 len: 1539 microversion: 2.1 time: 0.361883 Aug 31 15:59:51.008576 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 558/1096] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:50 2022] GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6 => generated 1473 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:51.009853 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 539/1097] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:50 2022] GET /compute/v2.1/servers/aade3ca2-9ecc-48db-988a-1ddbc286024a => generated 1539 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:51.013926 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9f7a85f8-74e3-49d0-8ec9-dad6c77aa367 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:51.014551 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9f7a85f8-74e3-49d0-8ec9-dad6c77aa367 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] [instance: 39a531e3-b13b-412f-a200-5141c32650be] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:51.015294 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d2038824-1e23-4270-a514-bab1f6891ddc tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:51.016098 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d2038824-1e23-4270-a514-bab1f6891ddc tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:51.020904 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9f7a85f8-74e3-49d0-8ec9-dad6c77aa367 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:51.022104 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9f7a85f8-74e3-49d0-8ec9-dad6c77aa367 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:51.022471 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9f7a85f8-74e3-49d0-8ec9-dad6c77aa367 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:51.023366 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9f7a85f8-74e3-49d0-8ec9-dad6c77aa367 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:51.023884 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d2038824-1e23-4270-a514-bab1f6891ddc tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:51.024033 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9f7a85f8-74e3-49d0-8ec9-dad6c77aa367 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:51.024430 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9f7a85f8-74e3-49d0-8ec9-dad6c77aa367 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:51.024863 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d2038824-1e23-4270-a514-bab1f6891ddc tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:51.025489 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d2038824-1e23-4270-a514-bab1f6891ddc tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:51.026367 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d2038824-1e23-4270-a514-bab1f6891ddc tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:51.026990 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d2038824-1e23-4270-a514-bab1f6891ddc tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:51.027627 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d2038824-1e23-4270-a514-bab1f6891ddc tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:51.165712 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9f7a85f8-74e3-49d0-8ec9-dad6c77aa367 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb054cb62b9945a78e6bb60cd613acae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f780d0079345519eea40fe8a3fd813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:51.169611 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d2038824-1e23-4270-a514-bab1f6891ddc tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:51.175662 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9f7a85f8-74e3-49d0-8ec9-dad6c77aa367 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] 10.222.0.61 "GET /compute/v2.1/servers/39a531e3-b13b-412f-a200-5141c32650be" status: 200 len: 1297 microversion: 2.1 time: 0.165660 Aug 31 15:59:51.176567 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 559/1098] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:51 2022] GET /compute/v2.1/servers/39a531e3-b13b-412f-a200-5141c32650be => generated 1297 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:51.182945 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d2038824-1e23-4270-a514-bab1f6891ddc tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:51.184827 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d2038824-1e23-4270-a514-bab1f6891ddc tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:51.190359 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d2038824-1e23-4270-a514-bab1f6891ddc tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1546 microversion: 2.91 time: 0.179251 Aug 31 15:59:51.191129 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 540/1099] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:59:51 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1546 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:59:52.016909 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-77301a9e-bc9a-49b1-90d1-d6b4ab9a5017 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:52.017639 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-77301a9e-bc9a-49b1-90d1-d6b4ab9a5017 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] [instance: e45fa8b9-1545-4bd5-aa5f-402c71ec19c6] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:52.019641 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-023f0e25-0699-436d-8c88-afb8ec1c3c1a tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:52.020348 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-023f0e25-0699-436d-8c88-afb8ec1c3c1a tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] [instance: aade3ca2-9ecc-48db-988a-1ddbc286024a] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:52.024748 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-77301a9e-bc9a-49b1-90d1-d6b4ab9a5017 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:52.025506 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-77301a9e-bc9a-49b1-90d1-d6b4ab9a5017 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:52.026129 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-77301a9e-bc9a-49b1-90d1-d6b4ab9a5017 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:52.026844 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-77301a9e-bc9a-49b1-90d1-d6b4ab9a5017 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:52.027307 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-77301a9e-bc9a-49b1-90d1-d6b4ab9a5017 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:52.027770 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-77301a9e-bc9a-49b1-90d1-d6b4ab9a5017 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:52.027986 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-023f0e25-0699-436d-8c88-afb8ec1c3c1a tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:52.028705 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-023f0e25-0699-436d-8c88-afb8ec1c3c1a tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:52.029148 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-023f0e25-0699-436d-8c88-afb8ec1c3c1a tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:52.030033 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-023f0e25-0699-436d-8c88-afb8ec1c3c1a tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:52.030578 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-023f0e25-0699-436d-8c88-afb8ec1c3c1a tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:52.031181 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-023f0e25-0699-436d-8c88-afb8ec1c3c1a tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:52.259467 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-77301a9e-bc9a-49b1-90d1-d6b4ab9a5017 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a03cc5956ca477abacbe0c26bf18750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea45d1b678342ed812f9912e9f07503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:52.270825 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-023f0e25-0699-436d-8c88-afb8ec1c3c1a tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccce16c7fda401ea68fb31ea8099d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed252ebf7c741bbb36b553ac1767579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:52.273461 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-77301a9e-bc9a-49b1-90d1-d6b4ab9a5017 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] 10.222.0.61 "GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6" status: 200 len: 1473 microversion: 2.1 time: 0.260113 Aug 31 15:59:52.274074 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 560/1100] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:52 2022] GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6 => generated 1473 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:52.278728 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b833f728-58fc-4264-a75b-69d341a637ed tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:52.279278 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b833f728-58fc-4264-a75b-69d341a637ed tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] [instance: 39a531e3-b13b-412f-a200-5141c32650be] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:52.283224 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-023f0e25-0699-436d-8c88-afb8ec1c3c1a tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "GET /compute/v2.1/servers/aade3ca2-9ecc-48db-988a-1ddbc286024a" status: 200 len: 1539 microversion: 2.1 time: 0.269695 Aug 31 15:59:52.283884 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 541/1101] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:52 2022] GET /compute/v2.1/servers/aade3ca2-9ecc-48db-988a-1ddbc286024a => generated 1539 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:52.295805 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f8f3189a-d3ae-402f-b4e2-f9189332e033 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:52.295805 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f8f3189a-d3ae-402f-b4e2-f9189332e033 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:52.295997 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b833f728-58fc-4264-a75b-69d341a637ed tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:52.296080 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b833f728-58fc-4264-a75b-69d341a637ed tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:52.299434 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b833f728-58fc-4264-a75b-69d341a637ed tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:52.299434 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b833f728-58fc-4264-a75b-69d341a637ed tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:52.299434 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b833f728-58fc-4264-a75b-69d341a637ed tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:52.299434 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b833f728-58fc-4264-a75b-69d341a637ed tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:52.300146 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f8f3189a-d3ae-402f-b4e2-f9189332e033 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:52.300669 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f8f3189a-d3ae-402f-b4e2-f9189332e033 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:52.301158 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f8f3189a-d3ae-402f-b4e2-f9189332e033 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:52.302512 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f8f3189a-d3ae-402f-b4e2-f9189332e033 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:52.303144 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f8f3189a-d3ae-402f-b4e2-f9189332e033 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:52.303783 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f8f3189a-d3ae-402f-b4e2-f9189332e033 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:52.394800 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b833f728-58fc-4264-a75b-69d341a637ed tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb054cb62b9945a78e6bb60cd613acae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f780d0079345519eea40fe8a3fd813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:52.404432 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b833f728-58fc-4264-a75b-69d341a637ed tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] 10.222.0.61 "GET /compute/v2.1/servers/39a531e3-b13b-412f-a200-5141c32650be" status: 200 len: 1297 microversion: 2.1 time: 0.129261 Aug 31 15:59:52.405091 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 561/1102] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:52 2022] GET /compute/v2.1/servers/39a531e3-b13b-412f-a200-5141c32650be => generated 1297 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:52.406648 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f8f3189a-d3ae-402f-b4e2-f9189332e033 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:52.415671 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f8f3189a-d3ae-402f-b4e2-f9189332e033 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:52.417300 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f8f3189a-d3ae-402f-b4e2-f9189332e033 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:52.422639 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f8f3189a-d3ae-402f-b4e2-f9189332e033 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1546 microversion: 2.91 time: 0.137068 Aug 31 15:59:52.423235 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 542/1103] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:59:52 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1546 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:59:52.988691 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6fa05d25-d966-418e-a452-cfdf91411cac tempest-ImagesMetadataNegativeTestJSON-1123498463 tempest-ImagesMetadataNegativeTestJSON-1123498463-project] Calling method '.version_select at 0x7f5ae8d2ae50>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:53.009285 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-6fa05d25-d966-418e-a452-cfdf91411cac tempest-ImagesMetadataNegativeTestJSON-1123498463 tempest-ImagesMetadataNegativeTestJSON-1123498463-project] HTTP exception thrown: Image not found. Aug 31 15:59:53.013714 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6fa05d25-d966-418e-a452-cfdf91411cac tempest-ImagesMetadataNegativeTestJSON-1123498463 tempest-ImagesMetadataNegativeTestJSON-1123498463-project] Request method failure captured: Aug 31 15:59:53.013714 n-d-850499-9 devstack@n-api.service[122257]: request: DELETE /compute/v2.1/images/7f128f78-9637-4751-8148-7909a48fa2f3/metadata/os_distro HTTP/1.1 Aug 31 15:59:53.013714 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 15:59:53.013714 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 15:59:53.013714 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 15:59:53.013714 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 15:59:53.013714 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 15:59:53.013714 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 15:59:53.013714 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 15:59:53.013714 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 15:59:53.013714 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4V40HebXmKQiRIgJ9L_0K1qMe8LicDxUKCgz1559i0Cm7lDdbVbxFhvMQXkCBjbnTCHdqL-6qmTlf3JK32FZXYIkhyxzz0O2pKuhe0DTKUBXk6gK20IvUMVASZHQFw_ARKzYztkY-Q2rU2MdaJmuwVBasnmW1ObuS3nm_Jdw3KXf5M Aug 31 15:59:53.013714 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 15:59:53.013714 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 15:59:53.013714 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 15:59:53.013714 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 15:59:53.013714 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 15:59:53.013714 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 15:59:53.013714 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 27ea685765e24c3a931deaa86ce14b27 Aug 31 15:59:53.013714 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1123498463 Aug 31 15:59:53.013714 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 15:59:53.013714 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 15:59:53.015409 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/27ea685765e24c3a931deaa86ce14b27"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/27ea685765e24c3a931deaa86ce14b27"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_27ea685765e24c3a931deaa86ce14b27", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/27ea685765e24c3a931deaa86ce14b27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 15:59:53.015409 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1123498463 Aug 31 15:59:53.015409 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 27ea685765e24c3a931deaa86ce14b27 Aug 31 15:59:53.015409 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1123498463 Aug 31 15:59:53.015409 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ImagesMetadataNegativeTestJSON-1123498463-project Aug 31 15:59:53.015409 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 15:59:53.015409 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 15:59:53.015409 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: f9b140250cac437d9511355952da7b32 Aug 31 15:59:53.015409 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1123498463-project Aug 31 15:59:53.015409 n-d-850499-9 devstack@n-api.service[122257]: method: Aug 31 15:59:53.015409 n-d-850499-9 devstack@n-api.service[122257]: exception: Image not found. Aug 31 15:59:53.015409 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'image_id': '7f128f78-9637-4751-8148-7909a48fa2f3', 'id': 'os_distro'} Aug 31 15:59:53.015409 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:59:53.016449 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:53.016449 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 31 15:59:53.016449 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 31 15:59:53.016449 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 31 15:59:53.016449 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 31 15:59:53.016449 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 31 15:59:53.016449 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 31 15:59:53.016449 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 31 15:59:53.016449 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 31 15:59:53.016449 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 31 15:59:53.016449 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 31 15:59:53.016449 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 31 15:59:53.016449 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 31 15:59:53.016449 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 31 15:59:53.016449 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 31 15:59:53.016449 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 31 15:59:53.016449 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 31 15:59:53.016449 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 7f128f78-9637-4751-8148-7909a48fa2f3 Aug 31 15:59:53.018227 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:59:53.018227 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:59:53.018227 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:59:53.018227 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:53.018227 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 31 15:59:53.018227 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 31 15:59:53.018227 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 31 15:59:53.018227 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 31 15:59:53.018227 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 31 15:59:53.018227 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 31 15:59:53.018227 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 31 15:59:53.018227 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 31 15:59:53.018227 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 31 15:59:53.018227 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 31 15:59:53.018227 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 31 15:59:53.018227 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 31 15:59:53.018227 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 31 15:59:53.018227 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 31 15:59:53.018227 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 31 15:59:53.018227 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 31 15:59:53.019705 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 31 15:59:53.019705 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 31 15:59:53.019705 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 31 15:59:53.019705 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 31 15:59:53.019705 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 31 15:59:53.019705 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 31 15:59:53.019705 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 31 15:59:53.019705 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 31 15:59:53.019705 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7f128f78-9637-4751-8148-7909a48fa2f3 could not be found. Aug 31 15:59:53.019705 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:59:53.019705 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:59:53.019705 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:59:53.019705 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:53.019705 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:59:53.019705 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:59:53.019705 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:59:53.019705 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:59:53.019705 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 15:59:53.019705 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 15:59:53.021133 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:59:53.021133 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:59:53.021133 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Aug 31 15:59:53.021133 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 31 15:59:53.021133 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 31 15:59:53.021133 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 31 15:59:53.021133 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 31 15:59:53.021133 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:59:53.021133 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:59:53.021133 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:59:53.021133 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:53.021133 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:59:53.021133 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:59:53.021133 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:59:53.021133 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:59:53.021133 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 31 15:59:53.021133 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:59:53.021133 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6fa05d25-d966-418e-a452-cfdf91411cac tempest-ImagesMetadataNegativeTestJSON-1123498463 tempest-ImagesMetadataNegativeTestJSON-1123498463-project] Returning 404 to user: Image not found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:59:53.023082 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6fa05d25-d966-418e-a452-cfdf91411cac tempest-ImagesMetadataNegativeTestJSON-1123498463 tempest-ImagesMetadataNegativeTestJSON-1123498463-project] 10.222.0.61 "DELETE /compute/v2.1/images/7f128f78-9637-4751-8148-7909a48fa2f3/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.150876 Aug 31 15:59:53.023082 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 562/1104] 10.222.0.61 () {58 vars in 1293 bytes} [Wed Aug 31 15:59:52 2022] DELETE /compute/v2.1/images/7f128f78-9637-4751-8148-7909a48fa2f3/metadata/os_distro => generated 62 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 31 15:59:53.027291 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2d56f85d-7365-4693-8ec8-8e4e6411cacd tempest-ImagesMetadataNegativeTestJSON-1123498463 tempest-ImagesMetadataNegativeTestJSON-1123498463-project] Calling method '.version_select at 0x7f5ae90f7f70>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:53.048331 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-2d56f85d-7365-4693-8ec8-8e4e6411cacd tempest-ImagesMetadataNegativeTestJSON-1123498463 tempest-ImagesMetadataNegativeTestJSON-1123498463-project] HTTP exception thrown: Image not found. Aug 31 15:59:53.050789 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2d56f85d-7365-4693-8ec8-8e4e6411cacd tempest-ImagesMetadataNegativeTestJSON-1123498463 tempest-ImagesMetadataNegativeTestJSON-1123498463-project] Request method failure captured: Aug 31 15:59:53.050789 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/images/35e1a2cf-86ee-441d-9e6c-4099bb2d8f60/metadata/os_version HTTP/1.1 Aug 31 15:59:53.050789 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 15:59:53.050789 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 15:59:53.050789 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 15:59:53.050789 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 15:59:53.050789 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 15:59:53.050789 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 15:59:53.050789 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 15:59:53.050789 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 15:59:53.050789 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4V40HebXmKQiRIgJ9L_0K1qMe8LicDxUKCgz1559i0Cm7lDdbVbxFhvMQXkCBjbnTCHdqL-6qmTlf3JK32FZXYIkhyxzz0O2pKuhe0DTKUBXk6gK20IvUMVASZHQFw_ARKzYztkY-Q2rU2MdaJmuwVBasnmW1ObuS3nm_Jdw3KXf5M Aug 31 15:59:53.050789 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 15:59:53.050789 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 15:59:53.050789 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 15:59:53.050789 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 15:59:53.050789 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 15:59:53.050789 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 15:59:53.050789 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 27ea685765e24c3a931deaa86ce14b27 Aug 31 15:59:53.050789 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1123498463 Aug 31 15:59:53.050789 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 15:59:53.050789 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 15:59:53.052466 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/27ea685765e24c3a931deaa86ce14b27"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/27ea685765e24c3a931deaa86ce14b27"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_27ea685765e24c3a931deaa86ce14b27", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/27ea685765e24c3a931deaa86ce14b27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 15:59:53.052466 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1123498463 Aug 31 15:59:53.052466 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 27ea685765e24c3a931deaa86ce14b27 Aug 31 15:59:53.052466 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1123498463 Aug 31 15:59:53.052466 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ImagesMetadataNegativeTestJSON-1123498463-project Aug 31 15:59:53.052466 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 15:59:53.052466 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 15:59:53.052466 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: f9b140250cac437d9511355952da7b32 Aug 31 15:59:53.052466 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1123498463-project Aug 31 15:59:53.052466 n-d-850499-9 devstack@n-api.service[122256]: method: Aug 31 15:59:53.052466 n-d-850499-9 devstack@n-api.service[122256]: exception: Image not found. Aug 31 15:59:53.052466 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'image_id': '35e1a2cf-86ee-441d-9e6c-4099bb2d8f60', 'id': 'os_version'} Aug 31 15:59:53.052466 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:59:53.053551 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:53.053551 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 31 15:59:53.053551 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 31 15:59:53.053551 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 31 15:59:53.053551 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 31 15:59:53.053551 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 31 15:59:53.053551 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 31 15:59:53.053551 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 31 15:59:53.053551 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 31 15:59:53.053551 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 31 15:59:53.053551 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 31 15:59:53.053551 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 31 15:59:53.053551 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 31 15:59:53.053551 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 31 15:59:53.053551 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 31 15:59:53.053551 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 31 15:59:53.053551 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 31 15:59:53.053551 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 35e1a2cf-86ee-441d-9e6c-4099bb2d8f60 Aug 31 15:59:53.054581 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:59:53.054581 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:59:53.054581 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:59:53.054581 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:53.054581 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 31 15:59:53.054581 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 31 15:59:53.054581 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 31 15:59:53.054581 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 31 15:59:53.054581 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 31 15:59:53.054581 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 31 15:59:53.054581 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 31 15:59:53.054581 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 31 15:59:53.054581 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 31 15:59:53.054581 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 31 15:59:53.054581 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 31 15:59:53.054581 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 31 15:59:53.054581 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 31 15:59:53.054581 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 31 15:59:53.054581 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 31 15:59:53.054581 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 31 15:59:53.055845 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 31 15:59:53.055845 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 31 15:59:53.055845 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 31 15:59:53.055845 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 31 15:59:53.055845 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 31 15:59:53.055845 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 31 15:59:53.055845 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 31 15:59:53.055845 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 31 15:59:53.055845 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 35e1a2cf-86ee-441d-9e6c-4099bb2d8f60 could not be found. Aug 31 15:59:53.055845 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:59:53.055845 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:59:53.055845 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:59:53.055845 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:53.055845 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:59:53.055845 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:59:53.055845 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:59:53.055845 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:59:53.055845 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 15:59:53.055845 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 15:59:53.057205 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:59:53.057205 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:59:53.057205 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Aug 31 15:59:53.057205 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Aug 31 15:59:53.057205 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 31 15:59:53.057205 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 31 15:59:53.057205 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 31 15:59:53.057205 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:59:53.057205 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:59:53.057205 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:59:53.057205 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:53.057205 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:59:53.057205 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:59:53.057205 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:59:53.057205 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:59:53.057205 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 31 15:59:53.057205 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:59:53.057205 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2d56f85d-7365-4693-8ec8-8e4e6411cacd tempest-ImagesMetadataNegativeTestJSON-1123498463 tempest-ImagesMetadataNegativeTestJSON-1123498463-project] Returning 404 to user: Image not found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:59:53.058471 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2d56f85d-7365-4693-8ec8-8e4e6411cacd tempest-ImagesMetadataNegativeTestJSON-1123498463 tempest-ImagesMetadataNegativeTestJSON-1123498463-project] 10.222.0.61 "GET /compute/v2.1/images/35e1a2cf-86ee-441d-9e6c-4099bb2d8f60/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.029419 Aug 31 15:59:53.058471 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 543/1105] 10.222.0.61 () {58 vars in 1293 bytes} [Wed Aug 31 15:59:53 2022] GET /compute/v2.1/images/35e1a2cf-86ee-441d-9e6c-4099bb2d8f60/metadata/os_version => generated 62 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 31 15:59:53.064019 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a8a4e622-cc04-456a-a153-3d46974da6e3 tempest-ImagesMetadataNegativeTestJSON-1123498463 tempest-ImagesMetadataNegativeTestJSON-1123498463-project] Calling method '.version_select at 0x7f5ae8cecaf0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:53.091576 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-a8a4e622-cc04-456a-a153-3d46974da6e3 tempest-ImagesMetadataNegativeTestJSON-1123498463 tempest-ImagesMetadataNegativeTestJSON-1123498463-project] HTTP exception thrown: Image not found. Aug 31 15:59:53.093631 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a8a4e622-cc04-456a-a153-3d46974da6e3 tempest-ImagesMetadataNegativeTestJSON-1123498463 tempest-ImagesMetadataNegativeTestJSON-1123498463-project] Request method failure captured: Aug 31 15:59:53.093631 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/images/d89ad805-53d1-4286-8cee-b93b14d2c6a2/metadata HTTP/1.1 Aug 31 15:59:53.093631 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 15:59:53.093631 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 15:59:53.093631 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 15:59:53.093631 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 15:59:53.093631 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 15:59:53.093631 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 15:59:53.093631 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 15:59:53.093631 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 15:59:53.093631 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4V40HebXmKQiRIgJ9L_0K1qMe8LicDxUKCgz1559i0Cm7lDdbVbxFhvMQXkCBjbnTCHdqL-6qmTlf3JK32FZXYIkhyxzz0O2pKuhe0DTKUBXk6gK20IvUMVASZHQFw_ARKzYztkY-Q2rU2MdaJmuwVBasnmW1ObuS3nm_Jdw3KXf5M Aug 31 15:59:53.093631 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 15:59:53.093631 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 15:59:53.093631 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 15:59:53.093631 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 15:59:53.093631 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 15:59:53.093631 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 15:59:53.093631 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 27ea685765e24c3a931deaa86ce14b27 Aug 31 15:59:53.093631 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1123498463 Aug 31 15:59:53.093631 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 15:59:53.093631 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 15:59:53.095216 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/27ea685765e24c3a931deaa86ce14b27"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/27ea685765e24c3a931deaa86ce14b27"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_27ea685765e24c3a931deaa86ce14b27", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/27ea685765e24c3a931deaa86ce14b27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 15:59:53.095216 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1123498463 Aug 31 15:59:53.095216 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 27ea685765e24c3a931deaa86ce14b27 Aug 31 15:59:53.095216 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1123498463 Aug 31 15:59:53.095216 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ImagesMetadataNegativeTestJSON-1123498463-project Aug 31 15:59:53.095216 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 15:59:53.095216 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 15:59:53.095216 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: f9b140250cac437d9511355952da7b32 Aug 31 15:59:53.095216 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1123498463-project Aug 31 15:59:53.095216 n-d-850499-9 devstack@n-api.service[122257]: method: Aug 31 15:59:53.095216 n-d-850499-9 devstack@n-api.service[122257]: exception: Image not found. Aug 31 15:59:53.095216 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'image_id': 'd89ad805-53d1-4286-8cee-b93b14d2c6a2'} Aug 31 15:59:53.095216 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:59:53.096194 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:53.096194 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 31 15:59:53.096194 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 31 15:59:53.096194 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 31 15:59:53.096194 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 31 15:59:53.096194 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 31 15:59:53.096194 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 31 15:59:53.096194 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 31 15:59:53.096194 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 31 15:59:53.096194 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 31 15:59:53.096194 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 31 15:59:53.096194 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 31 15:59:53.096194 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 31 15:59:53.096194 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 31 15:59:53.096194 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 31 15:59:53.096194 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 31 15:59:53.096194 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 31 15:59:53.096194 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID d89ad805-53d1-4286-8cee-b93b14d2c6a2 Aug 31 15:59:53.097430 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:59:53.097430 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:59:53.097430 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:59:53.097430 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:53.097430 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 31 15:59:53.097430 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 31 15:59:53.097430 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 31 15:59:53.097430 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 31 15:59:53.097430 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 31 15:59:53.097430 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 31 15:59:53.097430 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 31 15:59:53.097430 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 31 15:59:53.097430 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 31 15:59:53.097430 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 31 15:59:53.097430 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 31 15:59:53.097430 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 31 15:59:53.097430 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 31 15:59:53.097430 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 31 15:59:53.097430 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 31 15:59:53.097430 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 31 15:59:53.098780 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 31 15:59:53.098780 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 31 15:59:53.098780 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 31 15:59:53.098780 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 31 15:59:53.098780 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 31 15:59:53.098780 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 31 15:59:53.098780 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 31 15:59:53.098780 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 31 15:59:53.098780 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d89ad805-53d1-4286-8cee-b93b14d2c6a2 could not be found. Aug 31 15:59:53.098780 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:59:53.098780 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:59:53.098780 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:59:53.098780 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:53.098780 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:59:53.098780 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:59:53.098780 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:59:53.098780 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:59:53.098780 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 15:59:53.098780 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 15:59:53.100190 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:59:53.100190 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:59:53.100190 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Aug 31 15:59:53.100190 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Aug 31 15:59:53.100190 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 31 15:59:53.100190 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 31 15:59:53.100190 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 31 15:59:53.100190 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:59:53.100190 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:59:53.100190 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:59:53.100190 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:53.100190 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:59:53.100190 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:59:53.100190 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:59:53.100190 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:59:53.100190 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 31 15:59:53.100190 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:59:53.100190 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a8a4e622-cc04-456a-a153-3d46974da6e3 tempest-ImagesMetadataNegativeTestJSON-1123498463 tempest-ImagesMetadataNegativeTestJSON-1123498463-project] Returning 404 to user: Image not found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:59:53.101462 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a8a4e622-cc04-456a-a153-3d46974da6e3 tempest-ImagesMetadataNegativeTestJSON-1123498463 tempest-ImagesMetadataNegativeTestJSON-1123498463-project] 10.222.0.61 "GET /compute/v2.1/images/d89ad805-53d1-4286-8cee-b93b14d2c6a2/metadata" status: 404 len: 62 microversion: 2.1 time: 0.035303 Aug 31 15:59:53.101462 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 563/1106] 10.222.0.61 () {58 vars in 1260 bytes} [Wed Aug 31 15:59:53 2022] GET /compute/v2.1/images/d89ad805-53d1-4286-8cee-b93b14d2c6a2/metadata => generated 62 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 31 15:59:53.106834 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ff919a72-e3d0-41eb-8845-ec1f275b1bc5 tempest-ImagesMetadataNegativeTestJSON-1123498463 tempest-ImagesMetadataNegativeTestJSON-1123498463-project] Action: 'update_all', calling method: .version_select at 0x7f5ae90d7af0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:59:53.129615 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-ff919a72-e3d0-41eb-8845-ec1f275b1bc5 tempest-ImagesMetadataNegativeTestJSON-1123498463 tempest-ImagesMetadataNegativeTestJSON-1123498463-project] HTTP exception thrown: Image not found. Aug 31 15:59:53.132808 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ff919a72-e3d0-41eb-8845-ec1f275b1bc5 tempest-ImagesMetadataNegativeTestJSON-1123498463 tempest-ImagesMetadataNegativeTestJSON-1123498463-project] Request method failure captured: Aug 31 15:59:53.132808 n-d-850499-9 devstack@n-api.service[122256]: request: PUT /compute/v2.1/images/63095e9c-4ed7-40ce-b8bf-b05d08156b8d/metadata HTTP/1.1 Aug 31 15:59:53.132808 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 15:59:53.132808 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 15:59:53.132808 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 15:59:53.132808 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 57 Aug 31 15:59:53.132808 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 15:59:53.132808 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 15:59:53.132808 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 15:59:53.132808 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 15:59:53.132808 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4V40HebXmKQiRIgJ9L_0K1qMe8LicDxUKCgz1559i0Cm7lDdbVbxFhvMQXkCBjbnTCHdqL-6qmTlf3JK32FZXYIkhyxzz0O2pKuhe0DTKUBXk6gK20IvUMVASZHQFw_ARKzYztkY-Q2rU2MdaJmuwVBasnmW1ObuS3nm_Jdw3KXf5M Aug 31 15:59:53.132808 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 15:59:53.132808 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 15:59:53.132808 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 15:59:53.132808 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 15:59:53.132808 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 15:59:53.132808 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 15:59:53.132808 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 27ea685765e24c3a931deaa86ce14b27 Aug 31 15:59:53.132808 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1123498463 Aug 31 15:59:53.132808 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 15:59:53.132808 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 15:59:53.134352 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/27ea685765e24c3a931deaa86ce14b27"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/27ea685765e24c3a931deaa86ce14b27"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_27ea685765e24c3a931deaa86ce14b27", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/27ea685765e24c3a931deaa86ce14b27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 15:59:53.134352 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1123498463 Aug 31 15:59:53.134352 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 27ea685765e24c3a931deaa86ce14b27 Aug 31 15:59:53.134352 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1123498463 Aug 31 15:59:53.134352 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ImagesMetadataNegativeTestJSON-1123498463-project Aug 31 15:59:53.134352 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 15:59:53.134352 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 15:59:53.134352 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: f9b140250cac437d9511355952da7b32 Aug 31 15:59:53.134352 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1123498463-project Aug 31 15:59:53.134352 n-d-850499-9 devstack@n-api.service[122256]: Aug 31 15:59:53.134352 n-d-850499-9 devstack@n-api.service[122256]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Aug 31 15:59:53.134352 n-d-850499-9 devstack@n-api.service[122256]: method: Aug 31 15:59:53.134352 n-d-850499-9 devstack@n-api.service[122256]: exception: Image not found. Aug 31 15:59:53.135293 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'image_id': '63095e9c-4ed7-40ce-b8bf-b05d08156b8d', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Aug 31 15:59:53.135293 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:59:53.135293 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:53.135293 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 31 15:59:53.135293 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 31 15:59:53.135293 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 31 15:59:53.135293 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 31 15:59:53.135293 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 31 15:59:53.135293 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 31 15:59:53.135293 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 31 15:59:53.135293 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 31 15:59:53.135293 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 31 15:59:53.135293 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 31 15:59:53.135293 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 31 15:59:53.135293 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 31 15:59:53.135293 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 31 15:59:53.135293 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 31 15:59:53.135293 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 31 15:59:53.136572 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 31 15:59:53.136572 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 63095e9c-4ed7-40ce-b8bf-b05d08156b8d Aug 31 15:59:53.136572 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:59:53.136572 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:59:53.136572 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:59:53.136572 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:53.136572 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 31 15:59:53.136572 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 31 15:59:53.136572 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 31 15:59:53.136572 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 31 15:59:53.136572 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 31 15:59:53.136572 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 31 15:59:53.136572 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 31 15:59:53.136572 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 31 15:59:53.136572 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 31 15:59:53.136572 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 31 15:59:53.136572 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 31 15:59:53.136572 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 31 15:59:53.136572 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 31 15:59:53.136572 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 31 15:59:53.137953 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 31 15:59:53.137953 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 31 15:59:53.137953 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 31 15:59:53.137953 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 31 15:59:53.137953 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 31 15:59:53.137953 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 31 15:59:53.137953 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 31 15:59:53.137953 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 31 15:59:53.137953 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 31 15:59:53.137953 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 31 15:59:53.137953 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 63095e9c-4ed7-40ce-b8bf-b05d08156b8d could not be found. Aug 31 15:59:53.137953 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:59:53.137953 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:59:53.137953 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:59:53.137953 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:53.137953 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:59:53.137953 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:59:53.137953 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:59:53.137953 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:59:53.139332 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 15:59:53.139332 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 15:59:53.139332 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:59:53.139332 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:59:53.139332 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:59:53.139332 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:59:53.139332 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Aug 31 15:59:53.139332 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 31 15:59:53.139332 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 31 15:59:53.139332 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 31 15:59:53.139332 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 31 15:59:53.139332 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:59:53.139332 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:59:53.139332 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:59:53.139332 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:53.139332 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:59:53.139332 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:59:53.139332 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:59:53.139332 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:59:53.139332 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 31 15:59:53.139332 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:59:53.141180 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ff919a72-e3d0-41eb-8845-ec1f275b1bc5 tempest-ImagesMetadataNegativeTestJSON-1123498463 tempest-ImagesMetadataNegativeTestJSON-1123498463-project] Returning 404 to user: Image not found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:59:53.141180 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ff919a72-e3d0-41eb-8845-ec1f275b1bc5 tempest-ImagesMetadataNegativeTestJSON-1123498463 tempest-ImagesMetadataNegativeTestJSON-1123498463-project] 10.222.0.61 "PUT /compute/v2.1/images/63095e9c-4ed7-40ce-b8bf-b05d08156b8d/metadata" status: 404 len: 62 microversion: 2.1 time: 0.031295 Aug 31 15:59:53.141180 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 544/1107] 10.222.0.61 () {60 vars in 1280 bytes} [Wed Aug 31 15:59:53 2022] PUT /compute/v2.1/images/63095e9c-4ed7-40ce-b8bf-b05d08156b8d/metadata => generated 62 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 31 15:59:53.145145 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-94576985-59a5-41fa-ba31-10f65f404c49 tempest-ImagesMetadataNegativeTestJSON-1123498463 tempest-ImagesMetadataNegativeTestJSON-1123498463-project] Action: 'update', calling method: .version_select at 0x7f5ae93cd670>, body: {"meta": {"os_distro": "alt"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:59:53.180141 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-94576985-59a5-41fa-ba31-10f65f404c49 tempest-ImagesMetadataNegativeTestJSON-1123498463 tempest-ImagesMetadataNegativeTestJSON-1123498463-project] HTTP exception thrown: Image not found. Aug 31 15:59:53.184394 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-94576985-59a5-41fa-ba31-10f65f404c49 tempest-ImagesMetadataNegativeTestJSON-1123498463 tempest-ImagesMetadataNegativeTestJSON-1123498463-project] Request method failure captured: Aug 31 15:59:53.184394 n-d-850499-9 devstack@n-api.service[122257]: request: PUT /compute/v2.1/images/b41d70b3-0372-44e3-a55e-7664bff52891/metadata/os_distro HTTP/1.1 Aug 31 15:59:53.184394 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 15:59:53.184394 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 15:59:53.184394 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 15:59:53.184394 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 30 Aug 31 15:59:53.184394 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 15:59:53.184394 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 15:59:53.184394 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 15:59:53.184394 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 15:59:53.184394 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4V40HebXmKQiRIgJ9L_0K1qMe8LicDxUKCgz1559i0Cm7lDdbVbxFhvMQXkCBjbnTCHdqL-6qmTlf3JK32FZXYIkhyxzz0O2pKuhe0DTKUBXk6gK20IvUMVASZHQFw_ARKzYztkY-Q2rU2MdaJmuwVBasnmW1ObuS3nm_Jdw3KXf5M Aug 31 15:59:53.184394 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 15:59:53.184394 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 15:59:53.184394 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 15:59:53.184394 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 15:59:53.184394 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 15:59:53.184394 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 15:59:53.184394 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 27ea685765e24c3a931deaa86ce14b27 Aug 31 15:59:53.184394 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1123498463 Aug 31 15:59:53.184394 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 15:59:53.184394 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 15:59:53.185930 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/27ea685765e24c3a931deaa86ce14b27"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/27ea685765e24c3a931deaa86ce14b27"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_27ea685765e24c3a931deaa86ce14b27", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/27ea685765e24c3a931deaa86ce14b27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 15:59:53.185930 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1123498463 Aug 31 15:59:53.185930 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 27ea685765e24c3a931deaa86ce14b27 Aug 31 15:59:53.185930 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1123498463 Aug 31 15:59:53.185930 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ImagesMetadataNegativeTestJSON-1123498463-project Aug 31 15:59:53.185930 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 15:59:53.185930 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 15:59:53.185930 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: f9b140250cac437d9511355952da7b32 Aug 31 15:59:53.185930 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1123498463-project Aug 31 15:59:53.185930 n-d-850499-9 devstack@n-api.service[122257]: Aug 31 15:59:53.185930 n-d-850499-9 devstack@n-api.service[122257]: {"meta": {"os_distro": "alt"}} Aug 31 15:59:53.185930 n-d-850499-9 devstack@n-api.service[122257]: method: Aug 31 15:59:53.185930 n-d-850499-9 devstack@n-api.service[122257]: exception: Image not found. Aug 31 15:59:53.185930 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'image_id': 'b41d70b3-0372-44e3-a55e-7664bff52891', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Aug 31 15:59:53.186911 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:59:53.186911 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:53.186911 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 31 15:59:53.186911 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 31 15:59:53.186911 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 31 15:59:53.186911 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 31 15:59:53.186911 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 31 15:59:53.186911 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 31 15:59:53.186911 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 31 15:59:53.186911 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 31 15:59:53.186911 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 31 15:59:53.186911 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 31 15:59:53.186911 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 31 15:59:53.186911 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 31 15:59:53.186911 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 31 15:59:53.186911 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 31 15:59:53.186911 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 31 15:59:53.186911 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 31 15:59:53.189040 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID b41d70b3-0372-44e3-a55e-7664bff52891 Aug 31 15:59:53.189040 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:59:53.189040 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:59:53.189040 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:59:53.189040 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:53.189040 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 31 15:59:53.189040 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 31 15:59:53.189040 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 31 15:59:53.189040 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 31 15:59:53.189040 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 31 15:59:53.189040 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 31 15:59:53.189040 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 31 15:59:53.189040 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 31 15:59:53.189040 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 31 15:59:53.189040 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 31 15:59:53.189040 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 31 15:59:53.189040 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 31 15:59:53.189040 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 31 15:59:53.189040 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 31 15:59:53.190434 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 31 15:59:53.190434 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 31 15:59:53.190434 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 31 15:59:53.190434 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 31 15:59:53.190434 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 31 15:59:53.190434 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 31 15:59:53.190434 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 31 15:59:53.190434 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 31 15:59:53.190434 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 31 15:59:53.190434 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 31 15:59:53.190434 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b41d70b3-0372-44e3-a55e-7664bff52891 could not be found. Aug 31 15:59:53.190434 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:59:53.190434 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:59:53.190434 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:59:53.190434 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:53.190434 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:59:53.190434 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:59:53.190434 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:59:53.190434 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:59:53.191998 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 15:59:53.191998 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 15:59:53.191998 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:59:53.191998 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:59:53.191998 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:59:53.191998 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:59:53.191998 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Aug 31 15:59:53.191998 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 31 15:59:53.191998 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 31 15:59:53.191998 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 31 15:59:53.191998 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 31 15:59:53.191998 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:59:53.191998 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:59:53.191998 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:59:53.191998 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:53.191998 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:59:53.191998 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:59:53.191998 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:59:53.191998 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:59:53.191998 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 31 15:59:53.191998 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 15:59:53.194029 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-94576985-59a5-41fa-ba31-10f65f404c49 tempest-ImagesMetadataNegativeTestJSON-1123498463 tempest-ImagesMetadataNegativeTestJSON-1123498463-project] Returning 404 to user: Image not found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:59:53.194029 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-94576985-59a5-41fa-ba31-10f65f404c49 tempest-ImagesMetadataNegativeTestJSON-1123498463 tempest-ImagesMetadataNegativeTestJSON-1123498463-project] 10.222.0.61 "PUT /compute/v2.1/images/b41d70b3-0372-44e3-a55e-7664bff52891/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.046070 Aug 31 15:59:53.194029 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 564/1108] 10.222.0.61 () {60 vars in 1310 bytes} [Wed Aug 31 15:59:53 2022] PUT /compute/v2.1/images/b41d70b3-0372-44e3-a55e-7664bff52891/metadata/os_distro => generated 62 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 31 15:59:53.203034 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-41d816ef-cd97-467e-87ff-f054d35016b2 tempest-ImagesMetadataNegativeTestJSON-1123498463 tempest-ImagesMetadataNegativeTestJSON-1123498463-project] Action: 'create', calling method: .version_select at 0x7f5ae919f040>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:59:53.233639 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-41d816ef-cd97-467e-87ff-f054d35016b2 tempest-ImagesMetadataNegativeTestJSON-1123498463 tempest-ImagesMetadataNegativeTestJSON-1123498463-project] HTTP exception thrown: Image not found. Aug 31 15:59:53.236758 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-41d816ef-cd97-467e-87ff-f054d35016b2 tempest-ImagesMetadataNegativeTestJSON-1123498463 tempest-ImagesMetadataNegativeTestJSON-1123498463-project] Request method failure captured: Aug 31 15:59:53.236758 n-d-850499-9 devstack@n-api.service[122256]: request: POST /compute/v2.1/images/06507a77-8c74-4cc3-b51b-1e19c9ade53e/metadata HTTP/1.1 Aug 31 15:59:53.236758 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 15:59:53.236758 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 15:59:53.236758 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 15:59:53.236758 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 57 Aug 31 15:59:53.236758 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 15:59:53.236758 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 15:59:53.236758 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 15:59:53.236758 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 15:59:53.236758 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4V40HebXmKQiRIgJ9L_0K1qMe8LicDxUKCgz1559i0Cm7lDdbVbxFhvMQXkCBjbnTCHdqL-6qmTlf3JK32FZXYIkhyxzz0O2pKuhe0DTKUBXk6gK20IvUMVASZHQFw_ARKzYztkY-Q2rU2MdaJmuwVBasnmW1ObuS3nm_Jdw3KXf5M Aug 31 15:59:53.236758 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 15:59:53.236758 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 15:59:53.236758 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 15:59:53.236758 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 15:59:53.236758 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 15:59:53.236758 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 15:59:53.236758 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 27ea685765e24c3a931deaa86ce14b27 Aug 31 15:59:53.236758 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1123498463 Aug 31 15:59:53.236758 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 15:59:53.236758 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 15:59:53.243627 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/27ea685765e24c3a931deaa86ce14b27"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/27ea685765e24c3a931deaa86ce14b27"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_27ea685765e24c3a931deaa86ce14b27", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/27ea685765e24c3a931deaa86ce14b27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 15:59:53.243627 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1123498463 Aug 31 15:59:53.243627 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 27ea685765e24c3a931deaa86ce14b27 Aug 31 15:59:53.243627 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1123498463 Aug 31 15:59:53.243627 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ImagesMetadataNegativeTestJSON-1123498463-project Aug 31 15:59:53.243627 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 15:59:53.243627 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 15:59:53.243627 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: f9b140250cac437d9511355952da7b32 Aug 31 15:59:53.243627 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1123498463-project Aug 31 15:59:53.243627 n-d-850499-9 devstack@n-api.service[122256]: Aug 31 15:59:53.243627 n-d-850499-9 devstack@n-api.service[122256]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Aug 31 15:59:53.243627 n-d-850499-9 devstack@n-api.service[122256]: method: Aug 31 15:59:53.243627 n-d-850499-9 devstack@n-api.service[122256]: exception: Image not found. Aug 31 15:59:53.243627 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'image_id': '06507a77-8c74-4cc3-b51b-1e19c9ade53e', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Aug 31 15:59:53.246477 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:59:53.246477 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:53.246477 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 31 15:59:53.246477 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 31 15:59:53.246477 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 31 15:59:53.246477 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 31 15:59:53.246477 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 31 15:59:53.246477 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 31 15:59:53.246477 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 31 15:59:53.246477 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 31 15:59:53.246477 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 31 15:59:53.246477 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 31 15:59:53.246477 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 31 15:59:53.246477 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 31 15:59:53.246477 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 31 15:59:53.246477 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 31 15:59:53.246477 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 31 15:59:53.246477 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 31 15:59:53.249897 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 06507a77-8c74-4cc3-b51b-1e19c9ade53e Aug 31 15:59:53.249897 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:59:53.249897 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:59:53.249897 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:59:53.249897 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:53.249897 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 31 15:59:53.249897 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 31 15:59:53.249897 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 31 15:59:53.249897 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 31 15:59:53.249897 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 31 15:59:53.249897 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 31 15:59:53.249897 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 31 15:59:53.249897 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 31 15:59:53.249897 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 31 15:59:53.249897 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 31 15:59:53.249897 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 31 15:59:53.249897 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 31 15:59:53.249897 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 31 15:59:53.249897 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 31 15:59:53.251090 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 31 15:59:53.251090 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 31 15:59:53.251090 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 31 15:59:53.251090 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 31 15:59:53.251090 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 31 15:59:53.251090 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 31 15:59:53.251090 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 31 15:59:53.251090 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 31 15:59:53.251090 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 31 15:59:53.251090 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 31 15:59:53.251090 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 06507a77-8c74-4cc3-b51b-1e19c9ade53e could not be found. Aug 31 15:59:53.251090 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:59:53.251090 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:59:53.251090 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:59:53.251090 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:53.251090 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:59:53.251090 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:59:53.251090 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:59:53.251090 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:59:53.252406 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 15:59:53.252406 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 15:59:53.252406 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:59:53.252406 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:59:53.252406 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:59:53.252406 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:59:53.252406 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Aug 31 15:59:53.252406 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 31 15:59:53.252406 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 31 15:59:53.252406 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 31 15:59:53.252406 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 31 15:59:53.252406 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:59:53.252406 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:59:53.252406 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:59:53.252406 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:53.252406 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:59:53.252406 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:59:53.252406 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:59:53.252406 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:59:53.252406 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 31 15:59:53.252406 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 15:59:53.253929 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-41d816ef-cd97-467e-87ff-f054d35016b2 tempest-ImagesMetadataNegativeTestJSON-1123498463 tempest-ImagesMetadataNegativeTestJSON-1123498463-project] Returning 404 to user: Image not found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:59:53.253929 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-41d816ef-cd97-467e-87ff-f054d35016b2 tempest-ImagesMetadataNegativeTestJSON-1123498463 tempest-ImagesMetadataNegativeTestJSON-1123498463-project] 10.222.0.61 "POST /compute/v2.1/images/06507a77-8c74-4cc3-b51b-1e19c9ade53e/metadata" status: 404 len: 62 microversion: 2.1 time: 0.039547 Aug 31 15:59:53.253929 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 545/1109] 10.222.0.61 () {60 vars in 1281 bytes} [Wed Aug 31 15:59:53 2022] POST /compute/v2.1/images/06507a77-8c74-4cc3-b51b-1e19c9ade53e/metadata => generated 62 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 31 15:59:53.295763 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-72e202ae-595d-4a50-a20d-ea7e58965b29 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:53.296288 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-72e202ae-595d-4a50-a20d-ea7e58965b29 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] [instance: e45fa8b9-1545-4bd5-aa5f-402c71ec19c6] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:53.303424 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-72e202ae-595d-4a50-a20d-ea7e58965b29 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:53.304137 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-72e202ae-595d-4a50-a20d-ea7e58965b29 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:53.304264 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:59:53.304855 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-72e202ae-595d-4a50-a20d-ea7e58965b29 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:53.305827 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-72e202ae-595d-4a50-a20d-ea7e58965b29 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:53.306270 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-72e202ae-595d-4a50-a20d-ea7e58965b29 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:53.306737 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-72e202ae-595d-4a50-a20d-ea7e58965b29 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:53.310560 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e8b1be8c-9fff-4595-b1ef-7107340475db tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:53.312838 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e8b1be8c-9fff-4595-b1ef-7107340475db tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] [instance: aade3ca2-9ecc-48db-988a-1ddbc286024a] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:53.319790 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e8b1be8c-9fff-4595-b1ef-7107340475db tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:53.321030 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e8b1be8c-9fff-4595-b1ef-7107340475db tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:53.321693 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e8b1be8c-9fff-4595-b1ef-7107340475db tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:53.323477 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e8b1be8c-9fff-4595-b1ef-7107340475db tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:53.324199 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e8b1be8c-9fff-4595-b1ef-7107340475db tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:53.324695 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e8b1be8c-9fff-4595-b1ef-7107340475db tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:53.524470 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-72e202ae-595d-4a50-a20d-ea7e58965b29 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a03cc5956ca477abacbe0c26bf18750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea45d1b678342ed812f9912e9f07503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:53.535796 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-72e202ae-595d-4a50-a20d-ea7e58965b29 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] 10.222.0.61 "GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6" status: 200 len: 1473 microversion: 2.1 time: 0.244658 Aug 31 15:59:53.537508 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e8b1be8c-9fff-4595-b1ef-7107340475db tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccce16c7fda401ea68fb31ea8099d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed252ebf7c741bbb36b553ac1767579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:53.542413 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 565/1110] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:53 2022] GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6 => generated 1473 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:53.547397 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9dadca95-a043-4a85-9c6c-a03ea013a1a2 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:53.547976 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9dadca95-a043-4a85-9c6c-a03ea013a1a2 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] [instance: 39a531e3-b13b-412f-a200-5141c32650be] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:53.548533 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e8b1be8c-9fff-4595-b1ef-7107340475db tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "GET /compute/v2.1/servers/aade3ca2-9ecc-48db-988a-1ddbc286024a" status: 200 len: 1539 microversion: 2.1 time: 0.245008 Aug 31 15:59:53.549312 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 546/1111] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:53 2022] GET /compute/v2.1/servers/aade3ca2-9ecc-48db-988a-1ddbc286024a => generated 1539 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:53.556270 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9dadca95-a043-4a85-9c6c-a03ea013a1a2 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:53.556854 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9dadca95-a043-4a85-9c6c-a03ea013a1a2 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:53.557486 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9dadca95-a043-4a85-9c6c-a03ea013a1a2 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:53.558231 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9dadca95-a043-4a85-9c6c-a03ea013a1a2 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:53.558693 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9dadca95-a043-4a85-9c6c-a03ea013a1a2 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:53.559179 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9dadca95-a043-4a85-9c6c-a03ea013a1a2 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:53.567150 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9169923c-279c-45f2-921d-95846c391c9e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:53.567820 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9169923c-279c-45f2-921d-95846c391c9e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:53.570821 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=12 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:59:53.574649 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9169923c-279c-45f2-921d-95846c391c9e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:53.575139 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9169923c-279c-45f2-921d-95846c391c9e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:53.575786 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9169923c-279c-45f2-921d-95846c391c9e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:53.576661 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9169923c-279c-45f2-921d-95846c391c9e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:53.577124 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9169923c-279c-45f2-921d-95846c391c9e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:53.577556 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9169923c-279c-45f2-921d-95846c391c9e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:53.628718 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9dadca95-a043-4a85-9c6c-a03ea013a1a2 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb054cb62b9945a78e6bb60cd613acae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f780d0079345519eea40fe8a3fd813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:53.639686 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9dadca95-a043-4a85-9c6c-a03ea013a1a2 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] 10.222.0.61 "GET /compute/v2.1/servers/39a531e3-b13b-412f-a200-5141c32650be" status: 200 len: 1305 microversion: 2.1 time: 0.095938 Aug 31 15:59:53.641301 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 566/1112] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:53 2022] GET /compute/v2.1/servers/39a531e3-b13b-412f-a200-5141c32650be => generated 1305 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:53.648022 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-7c14c999-8a27-4ecd-a7b5-9b0c8a01ebae req-19e798d6-b6c3-4f8e-b962-c3dc0bc3e074 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aade3ca2-9ecc-48db-988a-1ddbc286024a", "name": "network-vif-plugged", "status": "completed", "tag": "271136ce-1765-4d62-aae2-4b28988d27c0"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:59:53.657337 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-9169923c-279c-45f2-921d-95846c391c9e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:53.658324 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-7c14c999-8a27-4ecd-a7b5-9b0c8a01ebae req-19e798d6-b6c3-4f8e-b962-c3dc0bc3e074 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:53.658828 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-7c14c999-8a27-4ecd-a7b5-9b0c8a01ebae req-19e798d6-b6c3-4f8e-b962-c3dc0bc3e074 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:53.659265 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-7c14c999-8a27-4ecd-a7b5-9b0c8a01ebae req-19e798d6-b6c3-4f8e-b962-c3dc0bc3e074 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:53.669681 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-9169923c-279c-45f2-921d-95846c391c9e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:53.672009 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-9169923c-279c-45f2-921d-95846c391c9e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:53.673705 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-7c14c999-8a27-4ecd-a7b5-9b0c8a01ebae req-19e798d6-b6c3-4f8e-b962-c3dc0bc3e074 service nova] Creating event network-vif-plugged:271136ce-1765-4d62-aae2-4b28988d27c0 for instance aade3ca2-9ecc-48db-988a-1ddbc286024a on n-h2-850499-9 Aug 31 15:59:53.679452 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9169923c-279c-45f2-921d-95846c391c9e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1546 microversion: 2.91 time: 0.116142 Aug 31 15:59:53.680083 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 547/1113] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:59:53 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1546 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:59:53.682703 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-7c14c999-8a27-4ecd-a7b5-9b0c8a01ebae req-19e798d6-b6c3-4f8e-b962-c3dc0bc3e074 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040070 Aug 31 15:59:53.683573 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 567/1114] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 15:59:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:59:54.557801 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-20b7e8f9-a40b-4331-bd8d-290ea1ecba94 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:54.558413 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-20b7e8f9-a40b-4331-bd8d-290ea1ecba94 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] [instance: e45fa8b9-1545-4bd5-aa5f-402c71ec19c6] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:54.566406 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-20b7e8f9-a40b-4331-bd8d-290ea1ecba94 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:54.566905 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-20b7e8f9-a40b-4331-bd8d-290ea1ecba94 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:54.567337 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-20b7e8f9-a40b-4331-bd8d-290ea1ecba94 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:54.568125 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-20b7e8f9-a40b-4331-bd8d-290ea1ecba94 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:54.568583 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-20b7e8f9-a40b-4331-bd8d-290ea1ecba94 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:54.568999 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-20b7e8f9-a40b-4331-bd8d-290ea1ecba94 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:54.572135 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-630bb205-1b9f-4eb8-9fae-06a26e350eec tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:54.572928 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-630bb205-1b9f-4eb8-9fae-06a26e350eec tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] [instance: aade3ca2-9ecc-48db-988a-1ddbc286024a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:54.579322 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-630bb205-1b9f-4eb8-9fae-06a26e350eec tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:54.579974 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-630bb205-1b9f-4eb8-9fae-06a26e350eec tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:54.580487 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-630bb205-1b9f-4eb8-9fae-06a26e350eec tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:54.581265 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-630bb205-1b9f-4eb8-9fae-06a26e350eec tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:54.581905 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-630bb205-1b9f-4eb8-9fae-06a26e350eec tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:54.582406 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-630bb205-1b9f-4eb8-9fae-06a26e350eec tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:54.826782 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-20b7e8f9-a40b-4331-bd8d-290ea1ecba94 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a03cc5956ca477abacbe0c26bf18750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea45d1b678342ed812f9912e9f07503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:54.831818 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-630bb205-1b9f-4eb8-9fae-06a26e350eec tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccce16c7fda401ea68fb31ea8099d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed252ebf7c741bbb36b553ac1767579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:54.843659 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-20b7e8f9-a40b-4331-bd8d-290ea1ecba94 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] 10.222.0.61 "GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6" status: 200 len: 1473 microversion: 2.1 time: 0.289515 Aug 31 15:59:54.844749 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 548/1115] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:54 2022] GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6 => generated 1473 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:54.850402 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7653cd14-fdf6-4ab0-9648-a0c770b7a76f tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:54.851404 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7653cd14-fdf6-4ab0-9648-a0c770b7a76f tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] [instance: 39a531e3-b13b-412f-a200-5141c32650be] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:54.857491 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7653cd14-fdf6-4ab0-9648-a0c770b7a76f tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:54.857993 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7653cd14-fdf6-4ab0-9648-a0c770b7a76f tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:54.858415 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7653cd14-fdf6-4ab0-9648-a0c770b7a76f tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:54.859132 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7653cd14-fdf6-4ab0-9648-a0c770b7a76f tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:54.859634 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7653cd14-fdf6-4ab0-9648-a0c770b7a76f tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:54.860531 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7653cd14-fdf6-4ab0-9648-a0c770b7a76f tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:54.861212 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-630bb205-1b9f-4eb8-9fae-06a26e350eec tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "GET /compute/v2.1/servers/aade3ca2-9ecc-48db-988a-1ddbc286024a" status: 200 len: 1539 microversion: 2.1 time: 0.294405 Aug 31 15:59:54.861900 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 568/1116] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:54 2022] GET /compute/v2.1/servers/aade3ca2-9ecc-48db-988a-1ddbc286024a => generated 1539 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:59:54.867451 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5519dd32-c653-4b7a-9bf2-d1409dad2173 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:54.868091 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5519dd32-c653-4b7a-9bf2-d1409dad2173 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:54.876162 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5519dd32-c653-4b7a-9bf2-d1409dad2173 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:54.876736 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5519dd32-c653-4b7a-9bf2-d1409dad2173 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:54.877175 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5519dd32-c653-4b7a-9bf2-d1409dad2173 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:54.878252 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5519dd32-c653-4b7a-9bf2-d1409dad2173 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:54.879023 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5519dd32-c653-4b7a-9bf2-d1409dad2173 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:54.879718 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5519dd32-c653-4b7a-9bf2-d1409dad2173 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:55.071901 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5519dd32-c653-4b7a-9bf2-d1409dad2173 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:55.087485 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5519dd32-c653-4b7a-9bf2-d1409dad2173 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:55.090755 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5519dd32-c653-4b7a-9bf2-d1409dad2173 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:55.098320 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5519dd32-c653-4b7a-9bf2-d1409dad2173 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1546 microversion: 2.91 time: 0.235081 Aug 31 15:59:55.112229 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 569/1117] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:59:54 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1546 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:59:55.140412 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7653cd14-fdf6-4ab0-9648-a0c770b7a76f tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb054cb62b9945a78e6bb60cd613acae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f780d0079345519eea40fe8a3fd813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:55.142635 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=100 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:59:55.160873 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7653cd14-fdf6-4ab0-9648-a0c770b7a76f tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] 10.222.0.61 "GET /compute/v2.1/servers/39a531e3-b13b-412f-a200-5141c32650be" status: 200 len: 1305 microversion: 2.1 time: 0.314961 Aug 31 15:59:55.162358 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 549/1118] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:54 2022] GET /compute/v2.1/servers/39a531e3-b13b-412f-a200-5141c32650be => generated 1305 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:55.867358 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9a95748f-983f-4164-bf23-1b8a799979be tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:55.868200 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9a95748f-983f-4164-bf23-1b8a799979be tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] [instance: e45fa8b9-1545-4bd5-aa5f-402c71ec19c6] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:55.877765 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9a95748f-983f-4164-bf23-1b8a799979be tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:55.879117 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9a95748f-983f-4164-bf23-1b8a799979be tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:55.880014 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9a95748f-983f-4164-bf23-1b8a799979be tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:55.881733 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9a95748f-983f-4164-bf23-1b8a799979be tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:55.882476 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9a95748f-983f-4164-bf23-1b8a799979be tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:55.883526 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9a95748f-983f-4164-bf23-1b8a799979be tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:55.888730 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-299b253f-8d85-411c-b034-2ec9a0d76774 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:55.889504 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-299b253f-8d85-411c-b034-2ec9a0d76774 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] [instance: aade3ca2-9ecc-48db-988a-1ddbc286024a] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:55.904786 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-299b253f-8d85-411c-b034-2ec9a0d76774 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:55.905314 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-299b253f-8d85-411c-b034-2ec9a0d76774 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:55.905764 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-299b253f-8d85-411c-b034-2ec9a0d76774 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:55.906523 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-299b253f-8d85-411c-b034-2ec9a0d76774 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:55.907000 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-299b253f-8d85-411c-b034-2ec9a0d76774 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:55.907443 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-299b253f-8d85-411c-b034-2ec9a0d76774 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:56.387719 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9a95748f-983f-4164-bf23-1b8a799979be tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a03cc5956ca477abacbe0c26bf18750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea45d1b678342ed812f9912e9f07503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:56.399767 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9a95748f-983f-4164-bf23-1b8a799979be tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] 10.222.0.61 "GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6" status: 200 len: 1473 microversion: 2.1 time: 0.535172 Aug 31 15:59:56.401035 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 570/1119] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:55 2022] GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6 => generated 1473 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:56.407132 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f3d1aab1-8d7d-467b-bda8-091cc5b02229 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:56.408732 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f3d1aab1-8d7d-467b-bda8-091cc5b02229 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:56.418177 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f3d1aab1-8d7d-467b-bda8-091cc5b02229 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:56.418982 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f3d1aab1-8d7d-467b-bda8-091cc5b02229 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:56.419661 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f3d1aab1-8d7d-467b-bda8-091cc5b02229 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:56.421403 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f3d1aab1-8d7d-467b-bda8-091cc5b02229 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:56.422281 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f3d1aab1-8d7d-467b-bda8-091cc5b02229 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:56.423295 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f3d1aab1-8d7d-467b-bda8-091cc5b02229 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:56.444728 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-299b253f-8d85-411c-b034-2ec9a0d76774 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccce16c7fda401ea68fb31ea8099d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed252ebf7c741bbb36b553ac1767579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:56.459054 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-299b253f-8d85-411c-b034-2ec9a0d76774 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "GET /compute/v2.1/servers/aade3ca2-9ecc-48db-988a-1ddbc286024a" status: 200 len: 1539 microversion: 2.1 time: 0.573608 Aug 31 15:59:56.461478 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 550/1120] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:55 2022] GET /compute/v2.1/servers/aade3ca2-9ecc-48db-988a-1ddbc286024a => generated 1539 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:59:56.473277 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-11c2d112-801a-4a32-ac39-8a959f6584a8 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:56.474268 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-11c2d112-801a-4a32-ac39-8a959f6584a8 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] [instance: 39a531e3-b13b-412f-a200-5141c32650be] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:56.486348 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-11c2d112-801a-4a32-ac39-8a959f6584a8 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:56.487211 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-11c2d112-801a-4a32-ac39-8a959f6584a8 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:56.487927 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-11c2d112-801a-4a32-ac39-8a959f6584a8 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:56.488739 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-11c2d112-801a-4a32-ac39-8a959f6584a8 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:56.489556 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-11c2d112-801a-4a32-ac39-8a959f6584a8 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:56.491014 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-11c2d112-801a-4a32-ac39-8a959f6584a8 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:56.568028 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f3d1aab1-8d7d-467b-bda8-091cc5b02229 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:56.615049 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f3d1aab1-8d7d-467b-bda8-091cc5b02229 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:56.622923 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f3d1aab1-8d7d-467b-bda8-091cc5b02229 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:56.647232 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f3d1aab1-8d7d-467b-bda8-091cc5b02229 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1546 microversion: 2.91 time: 0.244088 Aug 31 15:59:56.648314 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 571/1121] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:59:56 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1546 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:59:56.708409 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-11c2d112-801a-4a32-ac39-8a959f6584a8 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb054cb62b9945a78e6bb60cd613acae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f780d0079345519eea40fe8a3fd813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:56.725387 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-11c2d112-801a-4a32-ac39-8a959f6584a8 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] 10.222.0.61 "GET /compute/v2.1/servers/39a531e3-b13b-412f-a200-5141c32650be" status: 200 len: 1303 microversion: 2.1 time: 0.261511 Aug 31 15:59:56.729699 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 551/1122] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:56 2022] GET /compute/v2.1/servers/39a531e3-b13b-412f-a200-5141c32650be => generated 1303 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:57.441425 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-35cc8fa6-3711-4a9e-95af-27da010342e2 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:57.444615 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-35cc8fa6-3711-4a9e-95af-27da010342e2 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] [instance: e45fa8b9-1545-4bd5-aa5f-402c71ec19c6] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:57.505094 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-35cc8fa6-3711-4a9e-95af-27da010342e2 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:57.506449 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-35cc8fa6-3711-4a9e-95af-27da010342e2 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:57.507622 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ff8a3d81-5058-4844-9f78-f54c439cc26d tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:57.508622 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ff8a3d81-5058-4844-9f78-f54c439cc26d tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] [instance: aade3ca2-9ecc-48db-988a-1ddbc286024a] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:57.522910 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-35cc8fa6-3711-4a9e-95af-27da010342e2 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:57.524974 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-35cc8fa6-3711-4a9e-95af-27da010342e2 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:57.531760 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-35cc8fa6-3711-4a9e-95af-27da010342e2 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:57.532701 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-35cc8fa6-3711-4a9e-95af-27da010342e2 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:57.584028 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ff8a3d81-5058-4844-9f78-f54c439cc26d tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:57.618219 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ff8a3d81-5058-4844-9f78-f54c439cc26d tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.033s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:57.621296 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ff8a3d81-5058-4844-9f78-f54c439cc26d tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:57.649275 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ff8a3d81-5058-4844-9f78-f54c439cc26d tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:57.650118 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ff8a3d81-5058-4844-9f78-f54c439cc26d tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:57.650836 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ff8a3d81-5058-4844-9f78-f54c439cc26d tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:58.294327 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-35cc8fa6-3711-4a9e-95af-27da010342e2 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a03cc5956ca477abacbe0c26bf18750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea45d1b678342ed812f9912e9f07503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:58.338359 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-35cc8fa6-3711-4a9e-95af-27da010342e2 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] 10.222.0.61 "GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6" status: 200 len: 1473 microversion: 2.1 time: 0.907211 Aug 31 15:59:58.342061 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 572/1123] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:57 2022] GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6 => generated 1473 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:58.372194 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-18657416-e0e0-44cb-b557-a876999e8814 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:58.373434 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-18657416-e0e0-44cb-b557-a876999e8814 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:58.392646 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-18657416-e0e0-44cb-b557-a876999e8814 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:58.402018 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-18657416-e0e0-44cb-b557-a876999e8814 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:58.403319 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-18657416-e0e0-44cb-b557-a876999e8814 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:58.404985 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-18657416-e0e0-44cb-b557-a876999e8814 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:58.406811 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-18657416-e0e0-44cb-b557-a876999e8814 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:58.408243 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-18657416-e0e0-44cb-b557-a876999e8814 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:58.596742 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ff8a3d81-5058-4844-9f78-f54c439cc26d tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccce16c7fda401ea68fb31ea8099d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed252ebf7c741bbb36b553ac1767579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:58.600152 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-18657416-e0e0-44cb-b557-a876999e8814 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:58.610306 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ff8a3d81-5058-4844-9f78-f54c439cc26d tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "GET /compute/v2.1/servers/aade3ca2-9ecc-48db-988a-1ddbc286024a" status: 200 len: 1521 microversion: 2.1 time: 1.122602 Aug 31 15:59:58.610898 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 552/1124] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:57 2022] GET /compute/v2.1/servers/aade3ca2-9ecc-48db-988a-1ddbc286024a => generated 1521 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:58.617234 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3a478a29-75e3-4f19-9709-b65651fd1235 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:58.623228 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3a478a29-75e3-4f19-9709-b65651fd1235 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] [instance: 39a531e3-b13b-412f-a200-5141c32650be] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:58.643948 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3a478a29-75e3-4f19-9709-b65651fd1235 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:58.648285 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3a478a29-75e3-4f19-9709-b65651fd1235 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:58.654447 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3a478a29-75e3-4f19-9709-b65651fd1235 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:58.655531 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3a478a29-75e3-4f19-9709-b65651fd1235 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:58.656412 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-18657416-e0e0-44cb-b557-a876999e8814 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:58.657199 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3a478a29-75e3-4f19-9709-b65651fd1235 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:58.659222 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-18657416-e0e0-44cb-b557-a876999e8814 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:58.659973 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3a478a29-75e3-4f19-9709-b65651fd1235 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:58.681744 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-18657416-e0e0-44cb-b557-a876999e8814 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1546 microversion: 2.91 time: 0.338124 Aug 31 15:59:58.690393 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 573/1125] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 15:59:58 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1546 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:59:58.711147 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-cc359568-aa0e-44a2-a57b-28e4e37e066a tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:58.717365 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-cc359568-aa0e-44a2-a57b-28e4e37e066a tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] [instance: aade3ca2-9ecc-48db-988a-1ddbc286024a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:58.753895 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cc359568-aa0e-44a2-a57b-28e4e37e066a tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:58.758704 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cc359568-aa0e-44a2-a57b-28e4e37e066a tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:58.759623 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cc359568-aa0e-44a2-a57b-28e4e37e066a tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:58.760725 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cc359568-aa0e-44a2-a57b-28e4e37e066a tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:58.761412 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cc359568-aa0e-44a2-a57b-28e4e37e066a tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:58.762653 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cc359568-aa0e-44a2-a57b-28e4e37e066a tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:58.813641 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-cc359568-aa0e-44a2-a57b-28e4e37e066a tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] [instance: aade3ca2-9ecc-48db-988a-1ddbc286024a] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 15:59:58.964990 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3a478a29-75e3-4f19-9709-b65651fd1235 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb054cb62b9945a78e6bb60cd613acae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f780d0079345519eea40fe8a3fd813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:59.011345 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3a478a29-75e3-4f19-9709-b65651fd1235 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] 10.222.0.61 "GET /compute/v2.1/servers/39a531e3-b13b-412f-a200-5141c32650be" status: 200 len: 1303 microversion: 2.1 time: 0.396158 Aug 31 15:59:59.016487 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 553/1126] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:58 2022] GET /compute/v2.1/servers/39a531e3-b13b-412f-a200-5141c32650be => generated 1303 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:59.060997 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-cc359568-aa0e-44a2-a57b-28e4e37e066a tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "DELETE /compute/v2.1/servers/aade3ca2-9ecc-48db-988a-1ddbc286024a" status: 204 len: 0 microversion: 2.1 time: 0.369011 Aug 31 15:59:59.068635 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 574/1127] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 15:59:58 2022] DELETE /compute/v2.1/servers/aade3ca2-9ecc-48db-988a-1ddbc286024a => generated 0 bytes in 373 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 15:59:59.079764 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d11f0f52-90e1-407f-b780-1e547e594635 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:59.080852 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d11f0f52-90e1-407f-b780-1e547e594635 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] [instance: aade3ca2-9ecc-48db-988a-1ddbc286024a] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:59.131312 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d11f0f52-90e1-407f-b780-1e547e594635 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:59.142837 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d11f0f52-90e1-407f-b780-1e547e594635 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:59.143735 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d11f0f52-90e1-407f-b780-1e547e594635 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:59.145048 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d11f0f52-90e1-407f-b780-1e547e594635 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:59.145952 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d11f0f52-90e1-407f-b780-1e547e594635 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:59.146734 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d11f0f52-90e1-407f-b780-1e547e594635 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:59.370471 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-578c33cf-8089-49d0-830d-877a9dff01a0 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:59.378140 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-578c33cf-8089-49d0-830d-877a9dff01a0 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] [instance: e45fa8b9-1545-4bd5-aa5f-402c71ec19c6] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:59.424420 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:59:59.448030 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-578c33cf-8089-49d0-830d-877a9dff01a0 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:59.450866 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-578c33cf-8089-49d0-830d-877a9dff01a0 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:59.453220 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-578c33cf-8089-49d0-830d-877a9dff01a0 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:59.456816 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-578c33cf-8089-49d0-830d-877a9dff01a0 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:59.462829 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-578c33cf-8089-49d0-830d-877a9dff01a0 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:59.464001 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-578c33cf-8089-49d0-830d-877a9dff01a0 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:59.515371 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:00:00.163986 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d11f0f52-90e1-407f-b780-1e547e594635 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccce16c7fda401ea68fb31ea8099d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed252ebf7c741bbb36b553ac1767579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:00.210286 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d11f0f52-90e1-407f-b780-1e547e594635 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "GET /compute/v2.1/servers/aade3ca2-9ecc-48db-988a-1ddbc286024a" status: 200 len: 1527 microversion: 2.1 time: 1.137033 Aug 31 16:00:00.231481 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 554/1128] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:59 2022] GET /compute/v2.1/servers/aade3ca2-9ecc-48db-988a-1ddbc286024a => generated 1527 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:00.256734 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3ca1bf2f-85cb-4c37-b6f9-60909ea5b527 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:00.258285 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3ca1bf2f-85cb-4c37-b6f9-60909ea5b527 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:00.295905 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3ca1bf2f-85cb-4c37-b6f9-60909ea5b527 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:00.297321 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3ca1bf2f-85cb-4c37-b6f9-60909ea5b527 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:00.297981 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3ca1bf2f-85cb-4c37-b6f9-60909ea5b527 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:00.299778 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3ca1bf2f-85cb-4c37-b6f9-60909ea5b527 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:00.301006 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3ca1bf2f-85cb-4c37-b6f9-60909ea5b527 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:00.301790 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3ca1bf2f-85cb-4c37-b6f9-60909ea5b527 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:00.576910 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3ca1bf2f-85cb-4c37-b6f9-60909ea5b527 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:00.597752 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3ca1bf2f-85cb-4c37-b6f9-60909ea5b527 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:00.606322 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3ca1bf2f-85cb-4c37-b6f9-60909ea5b527 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:00.618331 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3ca1bf2f-85cb-4c37-b6f9-60909ea5b527 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1533 microversion: 2.91 time: 0.384971 Aug 31 16:00:00.625601 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 555/1129] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:00:00 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1533 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:00:00.627841 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-578c33cf-8089-49d0-830d-877a9dff01a0 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a03cc5956ca477abacbe0c26bf18750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea45d1b678342ed812f9912e9f07503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:00.632665 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-28a0559e-8278-4f74-ba87-a28d9ce5c5bd req-16ba7d75-5193-4b5a-8fdf-fa70d2e4f3a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aade3ca2-9ecc-48db-988a-1ddbc286024a", "name": "network-vif-unplugged", "status": "completed", "tag": "271136ce-1765-4d62-aae2-4b28988d27c0"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:00:00.645374 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-578c33cf-8089-49d0-830d-877a9dff01a0 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] 10.222.0.61 "GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6" status: 200 len: 1473 microversion: 2.1 time: 1.279531 Aug 31 16:00:00.648055 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 575/1130] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:59 2022] GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6 => generated 1473 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:00.650771 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-28a0559e-8278-4f74-ba87-a28d9ce5c5bd req-16ba7d75-5193-4b5a-8fdf-fa70d2e4f3a4 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:00.660943 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-62b8c8c0-938f-4963-b56b-f9f03e6dcca2 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:00.664092 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-28a0559e-8278-4f74-ba87-a28d9ce5c5bd req-16ba7d75-5193-4b5a-8fdf-fa70d2e4f3a4 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:00.665260 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-28a0559e-8278-4f74-ba87-a28d9ce5c5bd req-16ba7d75-5193-4b5a-8fdf-fa70d2e4f3a4 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:00.666782 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-62b8c8c0-938f-4963-b56b-f9f03e6dcca2 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] [instance: 39a531e3-b13b-412f-a200-5141c32650be] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:00.691641 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-62b8c8c0-938f-4963-b56b-f9f03e6dcca2 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:00.692236 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-62b8c8c0-938f-4963-b56b-f9f03e6dcca2 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:00.695273 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-62b8c8c0-938f-4963-b56b-f9f03e6dcca2 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:00.696141 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-62b8c8c0-938f-4963-b56b-f9f03e6dcca2 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:00.700395 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-62b8c8c0-938f-4963-b56b-f9f03e6dcca2 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:00.702577 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-62b8c8c0-938f-4963-b56b-f9f03e6dcca2 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:00.706329 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-28a0559e-8278-4f74-ba87-a28d9ce5c5bd req-16ba7d75-5193-4b5a-8fdf-fa70d2e4f3a4 service nova] Creating event network-vif-unplugged:271136ce-1765-4d62-aae2-4b28988d27c0 for instance aade3ca2-9ecc-48db-988a-1ddbc286024a on n-h2-850499-9 Aug 31 16:00:00.724572 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-28a0559e-8278-4f74-ba87-a28d9ce5c5bd req-16ba7d75-5193-4b5a-8fdf-fa70d2e4f3a4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092384 Aug 31 16:00:00.727802 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 556/1131] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:00:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:00:00.738507 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0af9669a-64c2-43b9-98de-bdabf63b1853 tempest-UnshelveToHostMultiNodesTest-1598069161 tempest-UnshelveToHostMultiNodesTest-1598069161-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:00.745346 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0af9669a-64c2-43b9-98de-bdabf63b1853 tempest-UnshelveToHostMultiNodesTest-1598069161 tempest-UnshelveToHostMultiNodesTest-1598069161-project-admin] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:00.762797 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0af9669a-64c2-43b9-98de-bdabf63b1853 tempest-UnshelveToHostMultiNodesTest-1598069161 tempest-UnshelveToHostMultiNodesTest-1598069161-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:00.768062 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0af9669a-64c2-43b9-98de-bdabf63b1853 tempest-UnshelveToHostMultiNodesTest-1598069161 tempest-UnshelveToHostMultiNodesTest-1598069161-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:00.768938 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0af9669a-64c2-43b9-98de-bdabf63b1853 tempest-UnshelveToHostMultiNodesTest-1598069161 tempest-UnshelveToHostMultiNodesTest-1598069161-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:00.769974 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0af9669a-64c2-43b9-98de-bdabf63b1853 tempest-UnshelveToHostMultiNodesTest-1598069161 tempest-UnshelveToHostMultiNodesTest-1598069161-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:00.770681 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0af9669a-64c2-43b9-98de-bdabf63b1853 tempest-UnshelveToHostMultiNodesTest-1598069161 tempest-UnshelveToHostMultiNodesTest-1598069161-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:00.772695 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0af9669a-64c2-43b9-98de-bdabf63b1853 tempest-UnshelveToHostMultiNodesTest-1598069161 tempest-UnshelveToHostMultiNodesTest-1598069161-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:01.022034 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-0af9669a-64c2-43b9-98de-bdabf63b1853 tempest-UnshelveToHostMultiNodesTest-1598069161 tempest-UnshelveToHostMultiNodesTest-1598069161-project-admin] Lazy-loading 'services' on Instance uuid 2b02272a-f8ed-45be-9d84-b9c143718689 {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:00:01.073654 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0af9669a-64c2-43b9-98de-bdabf63b1853 tempest-UnshelveToHostMultiNodesTest-1598069161 tempest-UnshelveToHostMultiNodesTest-1598069161-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1938 microversion: 2.91 time: 0.343932 Aug 31 16:00:01.079853 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 557/1132] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:00:00 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1938 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:00:01.127083 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4718ed6a-6eb1-47b5-878b-3f3afb9faac7 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:00:01.130744 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4718ed6a-6eb1-47b5-878b-3f3afb9faac7 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:01.142569 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4718ed6a-6eb1-47b5-878b-3f3afb9faac7 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:01.143420 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4718ed6a-6eb1-47b5-878b-3f3afb9faac7 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:01.144113 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4718ed6a-6eb1-47b5-878b-3f3afb9faac7 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:01.145044 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4718ed6a-6eb1-47b5-878b-3f3afb9faac7 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:01.145732 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4718ed6a-6eb1-47b5-878b-3f3afb9faac7 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:01.146357 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4718ed6a-6eb1-47b5-878b-3f3afb9faac7 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:01.197810 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-4718ed6a-6eb1-47b5-878b-3f3afb9faac7 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lazy-loading 'flavor' on Instance uuid 2b02272a-f8ed-45be-9d84-b9c143718689 {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:00:01.242380 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-62b8c8c0-938f-4963-b56b-f9f03e6dcca2 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb054cb62b9945a78e6bb60cd613acae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f780d0079345519eea40fe8a3fd813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:01.257920 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-62b8c8c0-938f-4963-b56b-f9f03e6dcca2 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] 10.222.0.61 "GET /compute/v2.1/servers/39a531e3-b13b-412f-a200-5141c32650be" status: 200 len: 1371 microversion: 2.1 time: 0.607381 Aug 31 16:00:01.258676 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 576/1133] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:00 2022] GET /compute/v2.1/servers/39a531e3-b13b-412f-a200-5141c32650be => generated 1371 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:01.278034 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-758e89fa-ac56-48d9-befa-8cebdf2d7169 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:01.282875 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-758e89fa-ac56-48d9-befa-8cebdf2d7169 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] [instance: aade3ca2-9ecc-48db-988a-1ddbc286024a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:01.325117 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-758e89fa-ac56-48d9-befa-8cebdf2d7169 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:01.329746 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-758e89fa-ac56-48d9-befa-8cebdf2d7169 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:01.331540 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-758e89fa-ac56-48d9-befa-8cebdf2d7169 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:01.338524 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-758e89fa-ac56-48d9-befa-8cebdf2d7169 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:01.354281 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-758e89fa-ac56-48d9-befa-8cebdf2d7169 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:01.360482 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-758e89fa-ac56-48d9-befa-8cebdf2d7169 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:01.746632 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-758e89fa-ac56-48d9-befa-8cebdf2d7169 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccce16c7fda401ea68fb31ea8099d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed252ebf7c741bbb36b553ac1767579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:01.759938 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-758e89fa-ac56-48d9-befa-8cebdf2d7169 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "GET /compute/v2.1/servers/aade3ca2-9ecc-48db-988a-1ddbc286024a" status: 200 len: 1527 microversion: 2.1 time: 0.491367 Aug 31 16:00:01.765084 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 577/1134] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:01 2022] GET /compute/v2.1/servers/aade3ca2-9ecc-48db-988a-1ddbc286024a => generated 1527 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:01.770346 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-76c400ce-e2e1-4ede-aac8-b73aaecbdc74 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:01.772651 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-76c400ce-e2e1-4ede-aac8-b73aaecbdc74 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] [instance: e45fa8b9-1545-4bd5-aa5f-402c71ec19c6] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:01.784497 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4718ed6a-6eb1-47b5-878b-3f3afb9faac7 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "POST /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689/action" status: 202 len: 0 microversion: 2.91 time: 0.661437 Aug 31 16:00:01.789810 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 558/1135] 10.222.0.61 () {62 vars in 1319 bytes} [Wed Aug 31 16:00:01 2022] POST /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689/action => generated 0 bytes in 668 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:00:01.803910 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-76c400ce-e2e1-4ede-aac8-b73aaecbdc74 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:01.804419 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-76c400ce-e2e1-4ede-aac8-b73aaecbdc74 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:01.805418 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-76c400ce-e2e1-4ede-aac8-b73aaecbdc74 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:01.816029 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-76c400ce-e2e1-4ede-aac8-b73aaecbdc74 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:01.816624 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-76c400ce-e2e1-4ede-aac8-b73aaecbdc74 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:01.817117 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-76c400ce-e2e1-4ede-aac8-b73aaecbdc74 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:01.829605 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7cc4405c-9e36-4667-a577-2e5f397f4f73 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:01.830399 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7cc4405c-9e36-4667-a577-2e5f397f4f73 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:01.860351 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7cc4405c-9e36-4667-a577-2e5f397f4f73 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:01.860953 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7cc4405c-9e36-4667-a577-2e5f397f4f73 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:01.861693 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7cc4405c-9e36-4667-a577-2e5f397f4f73 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:01.862655 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7cc4405c-9e36-4667-a577-2e5f397f4f73 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:01.863326 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7cc4405c-9e36-4667-a577-2e5f397f4f73 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:01.863970 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7cc4405c-9e36-4667-a577-2e5f397f4f73 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:02.119438 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7cc4405c-9e36-4667-a577-2e5f397f4f73 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:02.135863 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7cc4405c-9e36-4667-a577-2e5f397f4f73 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:02.137692 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7cc4405c-9e36-4667-a577-2e5f397f4f73 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:02.153170 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7cc4405c-9e36-4667-a577-2e5f397f4f73 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1539 microversion: 2.91 time: 0.346004 Aug 31 16:00:02.168469 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 559/1136] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:00:01 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1539 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:00:02.284657 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-96c9a749-f362-4d81-a728-6d61557f8458 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:02.285558 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-96c9a749-f362-4d81-a728-6d61557f8458 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] [instance: 39a531e3-b13b-412f-a200-5141c32650be] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:02.294998 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:00:02.303625 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-96c9a749-f362-4d81-a728-6d61557f8458 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:02.305170 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-96c9a749-f362-4d81-a728-6d61557f8458 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:02.305170 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-96c9a749-f362-4d81-a728-6d61557f8458 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:02.309364 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-96c9a749-f362-4d81-a728-6d61557f8458 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:02.310862 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-96c9a749-f362-4d81-a728-6d61557f8458 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:02.312216 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-96c9a749-f362-4d81-a728-6d61557f8458 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:02.780582 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-76c400ce-e2e1-4ede-aac8-b73aaecbdc74 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a03cc5956ca477abacbe0c26bf18750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea45d1b678342ed812f9912e9f07503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:02.794330 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-76c400ce-e2e1-4ede-aac8-b73aaecbdc74 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] 10.222.0.61 "GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6" status: 200 len: 1473 microversion: 2.1 time: 1.027948 Aug 31 16:00:02.795978 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 578/1137] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:01 2022] GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6 => generated 1473 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:02.815144 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-96c9a749-f362-4d81-a728-6d61557f8458 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb054cb62b9945a78e6bb60cd613acae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f780d0079345519eea40fe8a3fd813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:02.828122 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-37cbeaf5-ad4c-486b-94e4-9b6379e54575 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:02.829838 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-96c9a749-f362-4d81-a728-6d61557f8458 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] 10.222.0.61 "GET /compute/v2.1/servers/39a531e3-b13b-412f-a200-5141c32650be" status: 200 len: 1371 microversion: 2.1 time: 0.547743 Aug 31 16:00:02.833640 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-37cbeaf5-ad4c-486b-94e4-9b6379e54575 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] [instance: aade3ca2-9ecc-48db-988a-1ddbc286024a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:02.847776 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 560/1138] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:02 2022] GET /compute/v2.1/servers/39a531e3-b13b-412f-a200-5141c32650be => generated 1371 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:02.856176 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-37cbeaf5-ad4c-486b-94e4-9b6379e54575 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:02.856699 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-37cbeaf5-ad4c-486b-94e4-9b6379e54575 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:02.857154 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-37cbeaf5-ad4c-486b-94e4-9b6379e54575 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:02.857899 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-37cbeaf5-ad4c-486b-94e4-9b6379e54575 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:02.865890 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-37cbeaf5-ad4c-486b-94e4-9b6379e54575 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:02.866347 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-37cbeaf5-ad4c-486b-94e4-9b6379e54575 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:03.181218 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-502e5a29-b05c-4299-aecf-b439c6feb0f4 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:03.182262 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-502e5a29-b05c-4299-aecf-b439c6feb0f4 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:03.193602 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-502e5a29-b05c-4299-aecf-b439c6feb0f4 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:03.204399 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-502e5a29-b05c-4299-aecf-b439c6feb0f4 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:03.206761 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-502e5a29-b05c-4299-aecf-b439c6feb0f4 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:03.220800 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-502e5a29-b05c-4299-aecf-b439c6feb0f4 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:03.221957 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-502e5a29-b05c-4299-aecf-b439c6feb0f4 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:03.222650 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-502e5a29-b05c-4299-aecf-b439c6feb0f4 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:03.429139 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-502e5a29-b05c-4299-aecf-b439c6feb0f4 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:03.454221 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-502e5a29-b05c-4299-aecf-b439c6feb0f4 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:03.463003 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-502e5a29-b05c-4299-aecf-b439c6feb0f4 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:03.481488 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-502e5a29-b05c-4299-aecf-b439c6feb0f4 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1539 microversion: 2.91 time: 0.305517 Aug 31 16:00:03.482098 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 561/1139] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:00:03 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1539 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:00:03.560198 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-ba9ac5bf-d853-440d-9b47-1f2f061b820d req-98d79111-c5ff-4b9c-83d7-4acbc2c2157a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39a531e3-b13b-412f-a200-5141c32650be", "tag": "d0c9a73e-dff5-4b26-80b7-1f09c0c3efcc"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:00:03.592762 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-ba9ac5bf-d853-440d-9b47-1f2f061b820d req-98d79111-c5ff-4b9c-83d7-4acbc2c2157a service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:03.593419 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-ba9ac5bf-d853-440d-9b47-1f2f061b820d req-98d79111-c5ff-4b9c-83d7-4acbc2c2157a service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:03.593951 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-ba9ac5bf-d853-440d-9b47-1f2f061b820d req-98d79111-c5ff-4b9c-83d7-4acbc2c2157a service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:03.618355 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-ba9ac5bf-d853-440d-9b47-1f2f061b820d req-98d79111-c5ff-4b9c-83d7-4acbc2c2157a service nova] Creating event network-changed:d0c9a73e-dff5-4b26-80b7-1f09c0c3efcc for instance 39a531e3-b13b-412f-a200-5141c32650be on n-h1-850499-9 Aug 31 16:00:03.641590 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-ba9ac5bf-d853-440d-9b47-1f2f061b820d req-98d79111-c5ff-4b9c-83d7-4acbc2c2157a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085390 Aug 31 16:00:03.643872 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 562/1140] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:00:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:00:03.837040 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2d86286f-a441-4c9c-b451-ca4849b02a6a tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:03.841059 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2d86286f-a441-4c9c-b451-ca4849b02a6a tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] [instance: e45fa8b9-1545-4bd5-aa5f-402c71ec19c6] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:03.865181 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2d86286f-a441-4c9c-b451-ca4849b02a6a tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:03.866067 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2d86286f-a441-4c9c-b451-ca4849b02a6a tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:03.866354 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2d86286f-a441-4c9c-b451-ca4849b02a6a tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:03.868059 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2d86286f-a441-4c9c-b451-ca4849b02a6a tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:03.871250 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2d86286f-a441-4c9c-b451-ca4849b02a6a tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:03.872088 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2d86286f-a441-4c9c-b451-ca4849b02a6a tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:03.929947 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-37cbeaf5-ad4c-486b-94e4-9b6379e54575 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccce16c7fda401ea68fb31ea8099d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed252ebf7c741bbb36b553ac1767579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:03.957790 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-37cbeaf5-ad4c-486b-94e4-9b6379e54575 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "GET /compute/v2.1/servers/aade3ca2-9ecc-48db-988a-1ddbc286024a" status: 200 len: 1527 microversion: 2.1 time: 1.161647 Aug 31 16:00:03.977470 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 579/1141] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:02 2022] GET /compute/v2.1/servers/aade3ca2-9ecc-48db-988a-1ddbc286024a => generated 1527 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:03.984254 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a164077d-c0e7-474b-b567-af7db2e5a9a5 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:03.985156 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a164077d-c0e7-474b-b567-af7db2e5a9a5 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] [instance: 39a531e3-b13b-412f-a200-5141c32650be] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:03.993411 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a164077d-c0e7-474b-b567-af7db2e5a9a5 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:03.994298 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a164077d-c0e7-474b-b567-af7db2e5a9a5 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:03.995458 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a164077d-c0e7-474b-b567-af7db2e5a9a5 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:03.996827 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a164077d-c0e7-474b-b567-af7db2e5a9a5 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:03.997592 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a164077d-c0e7-474b-b567-af7db2e5a9a5 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:03.998285 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a164077d-c0e7-474b-b567-af7db2e5a9a5 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:05.359019 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-2d86286f-a441-4c9c-b451-ca4849b02a6a tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a03cc5956ca477abacbe0c26bf18750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea45d1b678342ed812f9912e9f07503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:05.373877 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2d86286f-a441-4c9c-b451-ca4849b02a6a tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] 10.222.0.61 "GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6" status: 200 len: 1473 microversion: 2.1 time: 1.560000 Aug 31 16:00:05.386353 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 563/1142] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:03 2022] GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6 => generated 1473 bytes in 1573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:05.434084 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4232d481-21c9-48d1-801e-f11ae93919ac tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:05.438245 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4232d481-21c9-48d1-801e-f11ae93919ac tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:05.480356 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4232d481-21c9-48d1-801e-f11ae93919ac tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:05.481928 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a164077d-c0e7-474b-b567-af7db2e5a9a5 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb054cb62b9945a78e6bb60cd613acae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f780d0079345519eea40fe8a3fd813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:05.486746 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4232d481-21c9-48d1-801e-f11ae93919ac tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:05.487953 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4232d481-21c9-48d1-801e-f11ae93919ac tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:05.491523 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a164077d-c0e7-474b-b567-af7db2e5a9a5 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] 10.222.0.61 "GET /compute/v2.1/servers/39a531e3-b13b-412f-a200-5141c32650be" status: 200 len: 1371 microversion: 2.1 time: 1.512608 Aug 31 16:00:05.494646 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4232d481-21c9-48d1-801e-f11ae93919ac tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:05.495673 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4232d481-21c9-48d1-801e-f11ae93919ac tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:05.498849 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4232d481-21c9-48d1-801e-f11ae93919ac tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:05.512043 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 580/1143] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:03 2022] GET /compute/v2.1/servers/39a531e3-b13b-412f-a200-5141c32650be => generated 1371 bytes in 1533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:05.520089 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ef8de2ea-91f4-42cf-8b2d-48175bf76fda tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:05.521251 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ef8de2ea-91f4-42cf-8b2d-48175bf76fda tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] [instance: aade3ca2-9ecc-48db-988a-1ddbc286024a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:05.557266 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ef8de2ea-91f4-42cf-8b2d-48175bf76fda tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:05.557779 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ef8de2ea-91f4-42cf-8b2d-48175bf76fda tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:05.558224 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ef8de2ea-91f4-42cf-8b2d-48175bf76fda tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:05.558951 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ef8de2ea-91f4-42cf-8b2d-48175bf76fda tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:05.559415 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ef8de2ea-91f4-42cf-8b2d-48175bf76fda tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:05.559916 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ef8de2ea-91f4-42cf-8b2d-48175bf76fda tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:05.674373 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ef8de2ea-91f4-42cf-8b2d-48175bf76fda tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:05.678359 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ef8de2ea-91f4-42cf-8b2d-48175bf76fda tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:05.679052 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ef8de2ea-91f4-42cf-8b2d-48175bf76fda tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:05.681854 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-ef8de2ea-91f4-42cf-8b2d-48175bf76fda tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lazy-loading 'fault' on Instance uuid aade3ca2-9ecc-48db-988a-1ddbc286024a {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:00:05.742981 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-4232d481-21c9-48d1-801e-f11ae93919ac tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:05.757411 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-4232d481-21c9-48d1-801e-f11ae93919ac tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:05.758969 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-4232d481-21c9-48d1-801e-f11ae93919ac tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:05.775296 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4232d481-21c9-48d1-801e-f11ae93919ac tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1539 microversion: 2.91 time: 0.386917 Aug 31 16:00:05.780989 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 564/1144] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:00:05 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1539 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:00:05.802710 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-3fe5daac-7cd8-4e7a-84e6-2ba16ad76099 req-f7c0a4ca-d751-484b-aefe-4b5f156c7d23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aade3ca2-9ecc-48db-988a-1ddbc286024a", "name": "network-vif-deleted", "tag": "271136ce-1765-4d62-aae2-4b28988d27c0"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:00:05.821655 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ef8de2ea-91f4-42cf-8b2d-48175bf76fda tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccce16c7fda401ea68fb31ea8099d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed252ebf7c741bbb36b553ac1767579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:05.822966 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-3fe5daac-7cd8-4e7a-84e6-2ba16ad76099 req-f7c0a4ca-d751-484b-aefe-4b5f156c7d23 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:05.823466 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-3fe5daac-7cd8-4e7a-84e6-2ba16ad76099 req-f7c0a4ca-d751-484b-aefe-4b5f156c7d23 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:05.827955 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-3fe5daac-7cd8-4e7a-84e6-2ba16ad76099 req-f7c0a4ca-d751-484b-aefe-4b5f156c7d23 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:05.832183 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ef8de2ea-91f4-42cf-8b2d-48175bf76fda tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "GET /compute/v2.1/servers/aade3ca2-9ecc-48db-988a-1ddbc286024a" status: 200 len: 1314 microversion: 2.1 time: 0.318928 Aug 31 16:00:05.834836 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 581/1145] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:05 2022] GET /compute/v2.1/servers/aade3ca2-9ecc-48db-988a-1ddbc286024a => generated 1314 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:05.920985 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-3fe5daac-7cd8-4e7a-84e6-2ba16ad76099 req-f7c0a4ca-d751-484b-aefe-4b5f156c7d23 service nova] Creating event network-vif-deleted:271136ce-1765-4d62-aae2-4b28988d27c0 for instance aade3ca2-9ecc-48db-988a-1ddbc286024a on n-h2-850499-9 Aug 31 16:00:05.938142 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-3fe5daac-7cd8-4e7a-84e6-2ba16ad76099 req-f7c0a4ca-d751-484b-aefe-4b5f156c7d23 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139495 Aug 31 16:00:05.944378 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 565/1146] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:00:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:00:05.946274 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-84628586-3ddd-4d49-be28-5e3e819359ec req-b0a03677-d693-4fa2-9f3a-69297cd0fb98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e45fa8b9-1545-4bd5-aa5f-402c71ec19c6", "name": "network-vif-unplugged", "status": "completed", "tag": "935e822d-4171-4348-8a87-c6e76ab1ea4f"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:00:05.961015 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-84628586-3ddd-4d49-be28-5e3e819359ec req-b0a03677-d693-4fa2-9f3a-69297cd0fb98 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:05.961887 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-84628586-3ddd-4d49-be28-5e3e819359ec req-b0a03677-d693-4fa2-9f3a-69297cd0fb98 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:05.962331 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-84628586-3ddd-4d49-be28-5e3e819359ec req-b0a03677-d693-4fa2-9f3a-69297cd0fb98 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:06.010776 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-84628586-3ddd-4d49-be28-5e3e819359ec req-b0a03677-d693-4fa2-9f3a-69297cd0fb98 service nova] Creating event network-vif-unplugged:935e822d-4171-4348-8a87-c6e76ab1ea4f for instance e45fa8b9-1545-4bd5-aa5f-402c71ec19c6 on n-h2-850499-9 Aug 31 16:00:06.024291 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-84628586-3ddd-4d49-be28-5e3e819359ec req-b0a03677-d693-4fa2-9f3a-69297cd0fb98 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.101145 Aug 31 16:00:06.027961 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 582/1147] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:00:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:00:06.405053 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1809df83-b8b5-4cc5-8de2-cc59ec995081 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:06.406483 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1809df83-b8b5-4cc5-8de2-cc59ec995081 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] [instance: e45fa8b9-1545-4bd5-aa5f-402c71ec19c6] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:06.431880 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1809df83-b8b5-4cc5-8de2-cc59ec995081 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:06.437201 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1809df83-b8b5-4cc5-8de2-cc59ec995081 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:06.438124 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1809df83-b8b5-4cc5-8de2-cc59ec995081 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:06.442211 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1809df83-b8b5-4cc5-8de2-cc59ec995081 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:06.445629 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1809df83-b8b5-4cc5-8de2-cc59ec995081 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:06.447139 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1809df83-b8b5-4cc5-8de2-cc59ec995081 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:06.497043 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:00:06.533159 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-871157ae-6e14-4e0b-a0ea-5e8e0520a1bc tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:06.533973 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-871157ae-6e14-4e0b-a0ea-5e8e0520a1bc tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] [instance: 39a531e3-b13b-412f-a200-5141c32650be] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:06.555173 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-871157ae-6e14-4e0b-a0ea-5e8e0520a1bc tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:06.556834 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-871157ae-6e14-4e0b-a0ea-5e8e0520a1bc tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:06.557964 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-871157ae-6e14-4e0b-a0ea-5e8e0520a1bc tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:06.559800 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-871157ae-6e14-4e0b-a0ea-5e8e0520a1bc tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:06.562673 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-871157ae-6e14-4e0b-a0ea-5e8e0520a1bc tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:06.563975 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-871157ae-6e14-4e0b-a0ea-5e8e0520a1bc tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:06.918899 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-871157ae-6e14-4e0b-a0ea-5e8e0520a1bc tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb054cb62b9945a78e6bb60cd613acae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f780d0079345519eea40fe8a3fd813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:06.932854 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-871157ae-6e14-4e0b-a0ea-5e8e0520a1bc tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] 10.222.0.61 "GET /compute/v2.1/servers/39a531e3-b13b-412f-a200-5141c32650be" status: 200 len: 1371 microversion: 2.1 time: 0.406871 Aug 31 16:00:06.933783 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 583/1148] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:06 2022] GET /compute/v2.1/servers/39a531e3-b13b-412f-a200-5141c32650be => generated 1371 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:06.938706 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-78c331de-278a-4cc6-9861-bcdcd6f644f1 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:06.946380 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-78c331de-278a-4cc6-9861-bcdcd6f644f1 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:06.951890 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1809df83-b8b5-4cc5-8de2-cc59ec995081 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a03cc5956ca477abacbe0c26bf18750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea45d1b678342ed812f9912e9f07503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:06.965813 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1809df83-b8b5-4cc5-8de2-cc59ec995081 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] 10.222.0.61 "GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6" status: 200 len: 1479 microversion: 2.1 time: 0.567435 Aug 31 16:00:06.969722 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 566/1149] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:06 2022] GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6 => generated 1479 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:06.975918 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5fd64d65-2ec7-4066-b536-4374efaceaf2 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:06.978687 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-78c331de-278a-4cc6-9861-bcdcd6f644f1 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:06.979476 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-78c331de-278a-4cc6-9861-bcdcd6f644f1 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:06.980235 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-78c331de-278a-4cc6-9861-bcdcd6f644f1 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:06.981162 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-78c331de-278a-4cc6-9861-bcdcd6f644f1 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:06.981476 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5fd64d65-2ec7-4066-b536-4374efaceaf2 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] [instance: aade3ca2-9ecc-48db-988a-1ddbc286024a] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:06.982029 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-78c331de-278a-4cc6-9861-bcdcd6f644f1 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:06.982648 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-78c331de-278a-4cc6-9861-bcdcd6f644f1 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:06.992407 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5fd64d65-2ec7-4066-b536-4374efaceaf2 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:06.996248 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5fd64d65-2ec7-4066-b536-4374efaceaf2 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:06.997051 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5fd64d65-2ec7-4066-b536-4374efaceaf2 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:06.998111 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5fd64d65-2ec7-4066-b536-4374efaceaf2 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:06.998735 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5fd64d65-2ec7-4066-b536-4374efaceaf2 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:07.004639 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5fd64d65-2ec7-4066-b536-4374efaceaf2 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:07.093518 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5fd64d65-2ec7-4066-b536-4374efaceaf2 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:07.094671 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5fd64d65-2ec7-4066-b536-4374efaceaf2 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:07.095853 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5fd64d65-2ec7-4066-b536-4374efaceaf2 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:07.096874 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-5fd64d65-2ec7-4066-b536-4374efaceaf2 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lazy-loading 'fault' on Instance uuid aade3ca2-9ecc-48db-988a-1ddbc286024a {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:00:07.188823 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5fd64d65-2ec7-4066-b536-4374efaceaf2 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccce16c7fda401ea68fb31ea8099d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed252ebf7c741bbb36b553ac1767579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:07.202731 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5fd64d65-2ec7-4066-b536-4374efaceaf2 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "GET /compute/v2.1/servers/aade3ca2-9ecc-48db-988a-1ddbc286024a" status: 200 len: 1314 microversion: 2.1 time: 0.231172 Aug 31 16:00:07.205672 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 567/1150] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:06 2022] GET /compute/v2.1/servers/aade3ca2-9ecc-48db-988a-1ddbc286024a => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:07.216016 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-78c331de-278a-4cc6-9861-bcdcd6f644f1 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:07.237181 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-78c331de-278a-4cc6-9861-bcdcd6f644f1 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:07.247680 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-78c331de-278a-4cc6-9861-bcdcd6f644f1 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:07.255992 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-78c331de-278a-4cc6-9861-bcdcd6f644f1 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1539 microversion: 2.91 time: 0.320849 Aug 31 16:00:07.260548 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 584/1151] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:00:06 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1539 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:00:07.438316 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c9f63a06-ef15-4d6b-b190-9c2fcdf62008 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1900184788", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "networks": [{"uuid": "1815935f-c9a0-4f0c-9c89-45f534415ab2"}]}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:00:07.528491 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-c9f63a06-ef15-4d6b-b190-9c2fcdf62008 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] validate_networks() for [('1815935f-c9a0-4f0c-9c89-45f534415ab2', None, None, None, None, None)] {{(pid=122256) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:00:07.961154 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0d53e7aa-9a52-4925-859e-5876f9b81d04 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:07.961952 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0d53e7aa-9a52-4925-859e-5876f9b81d04 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] [instance: 39a531e3-b13b-412f-a200-5141c32650be] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:07.977903 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0d53e7aa-9a52-4925-859e-5876f9b81d04 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:07.978412 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0d53e7aa-9a52-4925-859e-5876f9b81d04 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:07.978861 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0d53e7aa-9a52-4925-859e-5876f9b81d04 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:07.979617 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0d53e7aa-9a52-4925-859e-5876f9b81d04 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:07.980078 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0d53e7aa-9a52-4925-859e-5876f9b81d04 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:07.980519 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0d53e7aa-9a52-4925-859e-5876f9b81d04 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:08.119816 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-c9f63a06-ef15-4d6b-b190-9c2fcdf62008 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:00:08.120536 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-c9f63a06-ef15-4d6b-b190-9c2fcdf62008 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:00:08.121183 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-c9f63a06-ef15-4d6b-b190-9c2fcdf62008 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:00:08.121765 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-c9f63a06-ef15-4d6b-b190-9c2fcdf62008 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:00:08.123096 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-c9f63a06-ef15-4d6b-b190-9c2fcdf62008 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:00:08.145034 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c9f63a06-ef15-4d6b-b190-9c2fcdf62008 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:08.147855 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c9f63a06-ef15-4d6b-b190-9c2fcdf62008 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:08.150249 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c9f63a06-ef15-4d6b-b190-9c2fcdf62008 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:08.151278 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c9f63a06-ef15-4d6b-b190-9c2fcdf62008 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:08.152153 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c9f63a06-ef15-4d6b-b190-9c2fcdf62008 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:08.153462 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c9f63a06-ef15-4d6b-b190-9c2fcdf62008 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:08.197423 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-c9f63a06-ef15-4d6b-b190-9c2fcdf62008 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Getting quotas for project 61a9f3fcc4b445349e5c66ff712e8598. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:00:08.203734 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-c9f63a06-ef15-4d6b-b190-9c2fcdf62008 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Getting quotas for user f1ccd03a4aa84f93bc26b438e1468f46 and project 61a9f3fcc4b445349e5c66ff712e8598. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:00:08.222810 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c9f63a06-ef15-4d6b-b190-9c2fcdf62008 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Going to run 1 instances... {{(pid=122256) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:00:08.231158 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c9f63a06-ef15-4d6b-b190-9c2fcdf62008 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: 5f29cff7-a675-40c2-a0e5-2a62994be45a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:00:08.284635 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0d53e7aa-9a52-4925-859e-5876f9b81d04 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb054cb62b9945a78e6bb60cd613acae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f780d0079345519eea40fe8a3fd813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:08.294316 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0d53e7aa-9a52-4925-859e-5876f9b81d04 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] 10.222.0.61 "GET /compute/v2.1/servers/39a531e3-b13b-412f-a200-5141c32650be" status: 200 len: 1371 microversion: 2.1 time: 0.337563 Aug 31 16:00:08.294913 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 585/1152] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:07 2022] GET /compute/v2.1/servers/39a531e3-b13b-412f-a200-5141c32650be => generated 1371 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:00:08.303811 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c9f63a06-ef15-4d6b-b190-9c2fcdf62008 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.096806 Aug 31 16:00:08.311729 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 568/1153] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:00:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1105 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:00:08.318389 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e910c0d3-6d69-41e3-8e9d-7c101f95cd26 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:08.320487 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-da89a905-75ef-4933-a75d-7985e5c10f22 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:08.321699 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-da89a905-75ef-4933-a75d-7985e5c10f22 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] [instance: aade3ca2-9ecc-48db-988a-1ddbc286024a] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:08.324733 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e910c0d3-6d69-41e3-8e9d-7c101f95cd26 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] [instance: e45fa8b9-1545-4bd5-aa5f-402c71ec19c6] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:08.331464 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e910c0d3-6d69-41e3-8e9d-7c101f95cd26 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:08.332241 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e910c0d3-6d69-41e3-8e9d-7c101f95cd26 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:08.332700 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e910c0d3-6d69-41e3-8e9d-7c101f95cd26 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:08.333556 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e910c0d3-6d69-41e3-8e9d-7c101f95cd26 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:08.334309 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e910c0d3-6d69-41e3-8e9d-7c101f95cd26 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:08.334741 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e910c0d3-6d69-41e3-8e9d-7c101f95cd26 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:08.335816 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-da89a905-75ef-4933-a75d-7985e5c10f22 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:08.336519 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-da89a905-75ef-4933-a75d-7985e5c10f22 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:08.337265 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-da89a905-75ef-4933-a75d-7985e5c10f22 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:08.338223 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-da89a905-75ef-4933-a75d-7985e5c10f22 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:08.339733 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-da89a905-75ef-4933-a75d-7985e5c10f22 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:08.340613 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-da89a905-75ef-4933-a75d-7985e5c10f22 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:08.417590 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-da89a905-75ef-4933-a75d-7985e5c10f22 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:08.418644 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-da89a905-75ef-4933-a75d-7985e5c10f22 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:08.419634 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-da89a905-75ef-4933-a75d-7985e5c10f22 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:08.420101 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-da89a905-75ef-4933-a75d-7985e5c10f22 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lazy-loading 'fault' on Instance uuid aade3ca2-9ecc-48db-988a-1ddbc286024a {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:00:08.497295 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-da89a905-75ef-4933-a75d-7985e5c10f22 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccce16c7fda401ea68fb31ea8099d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed252ebf7c741bbb36b553ac1767579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:08.510780 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-da89a905-75ef-4933-a75d-7985e5c10f22 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "GET /compute/v2.1/servers/aade3ca2-9ecc-48db-988a-1ddbc286024a" status: 200 len: 1314 microversion: 2.1 time: 0.197107 Aug 31 16:00:08.512366 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 569/1154] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:08 2022] GET /compute/v2.1/servers/aade3ca2-9ecc-48db-988a-1ddbc286024a => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:08.528253 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b895b390-322a-4231-890d-822dcd0a931e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:08.529172 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b895b390-322a-4231-890d-822dcd0a931e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:08.538053 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b895b390-322a-4231-890d-822dcd0a931e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:08.538561 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b895b390-322a-4231-890d-822dcd0a931e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:08.539106 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b895b390-322a-4231-890d-822dcd0a931e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:08.540042 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b895b390-322a-4231-890d-822dcd0a931e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:08.540455 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b895b390-322a-4231-890d-822dcd0a931e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:08.541365 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b895b390-322a-4231-890d-822dcd0a931e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:08.603675 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e910c0d3-6d69-41e3-8e9d-7c101f95cd26 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a03cc5956ca477abacbe0c26bf18750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea45d1b678342ed812f9912e9f07503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:08.613582 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e910c0d3-6d69-41e3-8e9d-7c101f95cd26 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] 10.222.0.61 "GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6" status: 200 len: 1479 microversion: 2.1 time: 0.317626 Aug 31 16:00:08.616188 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 586/1155] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:08 2022] GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6 => generated 1479 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:08.622528 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3176e332-c723-40a4-acec-2410880b0865 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:08.623656 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3176e332-c723-40a4-acec-2410880b0865 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: 5f29cff7-a675-40c2-a0e5-2a62994be45a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:08.630727 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b895b390-322a-4231-890d-822dcd0a931e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:08.642396 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b895b390-322a-4231-890d-822dcd0a931e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:08.644236 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b895b390-322a-4231-890d-822dcd0a931e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:08.652750 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b895b390-322a-4231-890d-822dcd0a931e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1539 microversion: 2.91 time: 0.138955 Aug 31 16:00:08.653738 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 570/1156] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:00:08 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1539 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:00:08.706642 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3176e332-c723-40a4-acec-2410880b0865 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ccd03a4aa84f93bc26b438e1468f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a9f3fcc4b445349e5c66ff712e8598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:08.715560 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3176e332-c723-40a4-acec-2410880b0865 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/servers/5f29cff7-a675-40c2-a0e5-2a62994be45a" status: 200 len: 1208 microversion: 2.1 time: 0.097303 Aug 31 16:00:08.716353 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 587/1157] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:08 2022] GET /compute/v2.1/servers/5f29cff7-a675-40c2-a0e5-2a62994be45a => generated 1208 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:09.320689 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c20ae81c-a609-4c16-8583-8d981fa5eea6 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:09.321588 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c20ae81c-a609-4c16-8583-8d981fa5eea6 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] [instance: 39a531e3-b13b-412f-a200-5141c32650be] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:09.328119 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c20ae81c-a609-4c16-8583-8d981fa5eea6 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:09.328678 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c20ae81c-a609-4c16-8583-8d981fa5eea6 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:09.329041 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c20ae81c-a609-4c16-8583-8d981fa5eea6 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:09.329889 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c20ae81c-a609-4c16-8583-8d981fa5eea6 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:09.330202 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c20ae81c-a609-4c16-8583-8d981fa5eea6 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:09.330720 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c20ae81c-a609-4c16-8583-8d981fa5eea6 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:09.491976 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c20ae81c-a609-4c16-8583-8d981fa5eea6 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb054cb62b9945a78e6bb60cd613acae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f780d0079345519eea40fe8a3fd813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:09.502037 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c20ae81c-a609-4c16-8583-8d981fa5eea6 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] 10.222.0.61 "GET /compute/v2.1/servers/39a531e3-b13b-412f-a200-5141c32650be" status: 200 len: 1371 microversion: 2.1 time: 0.185454 Aug 31 16:00:09.502846 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 571/1158] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:09 2022] GET /compute/v2.1/servers/39a531e3-b13b-412f-a200-5141c32650be => generated 1371 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:09.536972 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-89389040-a8c5-450e-9edf-92c1732b1035 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:09.538540 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-89389040-a8c5-450e-9edf-92c1732b1035 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] [instance: aade3ca2-9ecc-48db-988a-1ddbc286024a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:09.546248 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-89389040-a8c5-450e-9edf-92c1732b1035 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:09.546836 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-89389040-a8c5-450e-9edf-92c1732b1035 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:09.547921 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-89389040-a8c5-450e-9edf-92c1732b1035 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:09.548139 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-89389040-a8c5-450e-9edf-92c1732b1035 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:09.548661 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-89389040-a8c5-450e-9edf-92c1732b1035 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:09.549153 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-89389040-a8c5-450e-9edf-92c1732b1035 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:09.586389 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-89389040-a8c5-450e-9edf-92c1732b1035 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:09.586881 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-89389040-a8c5-450e-9edf-92c1732b1035 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:09.587312 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-89389040-a8c5-450e-9edf-92c1732b1035 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:09.587787 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-89389040-a8c5-450e-9edf-92c1732b1035 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lazy-loading 'fault' on Instance uuid aade3ca2-9ecc-48db-988a-1ddbc286024a {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:00:09.636319 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-89389040-a8c5-450e-9edf-92c1732b1035 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccce16c7fda401ea68fb31ea8099d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed252ebf7c741bbb36b553ac1767579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:09.642225 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b40a3edc-212c-433e-a6d1-f75b2e63fc0a tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:09.643681 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b40a3edc-212c-433e-a6d1-f75b2e63fc0a tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] [instance: e45fa8b9-1545-4bd5-aa5f-402c71ec19c6] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:09.648748 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-89389040-a8c5-450e-9edf-92c1732b1035 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "GET /compute/v2.1/servers/aade3ca2-9ecc-48db-988a-1ddbc286024a" status: 200 len: 1314 microversion: 2.1 time: 0.116190 Aug 31 16:00:09.649345 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 588/1159] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:09 2022] GET /compute/v2.1/servers/aade3ca2-9ecc-48db-988a-1ddbc286024a => generated 1314 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:09.651969 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b40a3edc-212c-433e-a6d1-f75b2e63fc0a tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:09.652475 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b40a3edc-212c-433e-a6d1-f75b2e63fc0a tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:09.653112 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b40a3edc-212c-433e-a6d1-f75b2e63fc0a tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:09.653831 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b40a3edc-212c-433e-a6d1-f75b2e63fc0a tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:09.654293 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b40a3edc-212c-433e-a6d1-f75b2e63fc0a tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:09.654922 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b40a3edc-212c-433e-a6d1-f75b2e63fc0a tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:09.689655 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7cbc93c0-af69-44a5-8baf-9a68472399d8 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:09.690270 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7cbc93c0-af69-44a5-8baf-9a68472399d8 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:09.699793 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7cbc93c0-af69-44a5-8baf-9a68472399d8 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:09.700309 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7cbc93c0-af69-44a5-8baf-9a68472399d8 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:09.700758 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7cbc93c0-af69-44a5-8baf-9a68472399d8 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:09.701806 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7cbc93c0-af69-44a5-8baf-9a68472399d8 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:09.702278 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7cbc93c0-af69-44a5-8baf-9a68472399d8 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:09.702724 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7cbc93c0-af69-44a5-8baf-9a68472399d8 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:09.808918 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7cbc93c0-af69-44a5-8baf-9a68472399d8 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:09.823232 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7cbc93c0-af69-44a5-8baf-9a68472399d8 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:09.825772 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7cbc93c0-af69-44a5-8baf-9a68472399d8 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:09.831529 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7cbc93c0-af69-44a5-8baf-9a68472399d8 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1539 microversion: 2.91 time: 0.146600 Aug 31 16:00:09.849133 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 589/1160] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:00:09 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1539 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:00:09.850455 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b40a3edc-212c-433e-a6d1-f75b2e63fc0a tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a03cc5956ca477abacbe0c26bf18750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea45d1b678342ed812f9912e9f07503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:09.857798 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2853968b-15e5-4a5a-a733-ec584d486dc9 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:09.858440 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b40a3edc-212c-433e-a6d1-f75b2e63fc0a tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] 10.222.0.61 "GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6" status: 200 len: 1479 microversion: 2.1 time: 0.223188 Aug 31 16:00:09.859159 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2853968b-15e5-4a5a-a733-ec584d486dc9 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: 5f29cff7-a675-40c2-a0e5-2a62994be45a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:09.865200 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 572/1161] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:09 2022] GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6 => generated 1479 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:00:09.868481 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2853968b-15e5-4a5a-a733-ec584d486dc9 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:09.869072 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2853968b-15e5-4a5a-a733-ec584d486dc9 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:09.869608 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2853968b-15e5-4a5a-a733-ec584d486dc9 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:09.870568 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2853968b-15e5-4a5a-a733-ec584d486dc9 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:09.871155 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2853968b-15e5-4a5a-a733-ec584d486dc9 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:09.871709 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2853968b-15e5-4a5a-a733-ec584d486dc9 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:09.966120 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2853968b-15e5-4a5a-a733-ec584d486dc9 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ccd03a4aa84f93bc26b438e1468f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a9f3fcc4b445349e5c66ff712e8598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:09.977041 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2853968b-15e5-4a5a-a733-ec584d486dc9 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/servers/5f29cff7-a675-40c2-a0e5-2a62994be45a" status: 200 len: 1212 microversion: 2.1 time: 0.125612 Aug 31 16:00:09.991969 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 590/1162] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:09 2022] GET /compute/v2.1/servers/5f29cff7-a675-40c2-a0e5-2a62994be45a => generated 1212 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:10.131029 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-dcf9c28b-9481-4b4e-b109-4c33d1dfb0f7 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:10.131915 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-dcf9c28b-9481-4b4e-b109-4c33d1dfb0f7 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] [instance: d5e69723-2d0e-46ef-8f76-82d64aad4772] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:10.138567 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dcf9c28b-9481-4b4e-b109-4c33d1dfb0f7 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:10.139106 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dcf9c28b-9481-4b4e-b109-4c33d1dfb0f7 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:10.139771 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dcf9c28b-9481-4b4e-b109-4c33d1dfb0f7 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:10.140713 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dcf9c28b-9481-4b4e-b109-4c33d1dfb0f7 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:10.141175 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dcf9c28b-9481-4b4e-b109-4c33d1dfb0f7 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:10.141605 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dcf9c28b-9481-4b4e-b109-4c33d1dfb0f7 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:10.176688 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-dcf9c28b-9481-4b4e-b109-4c33d1dfb0f7 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] [instance: d5e69723-2d0e-46ef-8f76-82d64aad4772] Going to try to terminate instance {{(pid=122256) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:00:10.270895 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-dcf9c28b-9481-4b4e-b109-4c33d1dfb0f7 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] 10.222.0.61 "DELETE /compute/v2.1/servers/d5e69723-2d0e-46ef-8f76-82d64aad4772" status: 204 len: 0 microversion: 2.1 time: 0.143789 Aug 31 16:00:10.271860 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 573/1163] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:00:10 2022] DELETE /compute/v2.1/servers/d5e69723-2d0e-46ef-8f76-82d64aad4772 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:00:10.284624 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-83e3708a-23b8-4a0e-8e69-b83516b7ceb8 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:10.285357 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-83e3708a-23b8-4a0e-8e69-b83516b7ceb8 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] [instance: d5e69723-2d0e-46ef-8f76-82d64aad4772] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:10.293647 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-83e3708a-23b8-4a0e-8e69-b83516b7ceb8 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:10.294303 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-83e3708a-23b8-4a0e-8e69-b83516b7ceb8 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:10.294819 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-83e3708a-23b8-4a0e-8e69-b83516b7ceb8 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:10.295573 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-83e3708a-23b8-4a0e-8e69-b83516b7ceb8 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:10.296041 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-83e3708a-23b8-4a0e-8e69-b83516b7ceb8 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:10.296476 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-83e3708a-23b8-4a0e-8e69-b83516b7ceb8 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:10.452077 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-83e3708a-23b8-4a0e-8e69-b83516b7ceb8 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377b1dedae45d2a804919e5ea69a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e5507d53224d19804717493d60bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:10.464239 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-83e3708a-23b8-4a0e-8e69-b83516b7ceb8 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] 10.222.0.61 "GET /compute/v2.1/servers/d5e69723-2d0e-46ef-8f76-82d64aad4772" status: 200 len: 1715 microversion: 2.1 time: 0.183766 Aug 31 16:00:10.464845 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 591/1164] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:10 2022] GET /compute/v2.1/servers/d5e69723-2d0e-46ef-8f76-82d64aad4772 => generated 1715 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:10.532121 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-eba88052-d2b8-48e4-b4f4-5d60f77cb46d tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:10.532669 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-eba88052-d2b8-48e4-b4f4-5d60f77cb46d tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] [instance: 39a531e3-b13b-412f-a200-5141c32650be] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:10.540890 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eba88052-d2b8-48e4-b4f4-5d60f77cb46d tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:10.541386 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eba88052-d2b8-48e4-b4f4-5d60f77cb46d tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:10.542248 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eba88052-d2b8-48e4-b4f4-5d60f77cb46d tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:10.542788 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eba88052-d2b8-48e4-b4f4-5d60f77cb46d tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:10.543265 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eba88052-d2b8-48e4-b4f4-5d60f77cb46d tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:10.543751 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eba88052-d2b8-48e4-b4f4-5d60f77cb46d tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:10.674897 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-eb174f59-564f-4c6a-a4a7-48ed94bc2387 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:10.676378 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-eb174f59-564f-4c6a-a4a7-48ed94bc2387 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] [instance: aade3ca2-9ecc-48db-988a-1ddbc286024a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:10.684932 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eb174f59-564f-4c6a-a4a7-48ed94bc2387 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:10.685438 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eb174f59-564f-4c6a-a4a7-48ed94bc2387 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:10.685882 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eb174f59-564f-4c6a-a4a7-48ed94bc2387 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:10.686615 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eb174f59-564f-4c6a-a4a7-48ed94bc2387 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:10.687084 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eb174f59-564f-4c6a-a4a7-48ed94bc2387 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:10.687543 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eb174f59-564f-4c6a-a4a7-48ed94bc2387 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:10.704977 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-eb174f59-564f-4c6a-a4a7-48ed94bc2387 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] HTTP exception thrown: Instance aade3ca2-9ecc-48db-988a-1ddbc286024a could not be found. Aug 31 16:00:10.706936 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-eba88052-d2b8-48e4-b4f4-5d60f77cb46d tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb054cb62b9945a78e6bb60cd613acae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f780d0079345519eea40fe8a3fd813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:10.709829 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-eb174f59-564f-4c6a-a4a7-48ed94bc2387 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Request method failure captured: Aug 31 16:00:10.709829 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/aade3ca2-9ecc-48db-988a-1ddbc286024a HTTP/1.1 Aug 31 16:00:10.709829 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:00:10.709829 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:00:10.709829 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:00:10.709829 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:00:10.709829 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:00:10.709829 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:00:10.709829 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:00:10.709829 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:00:10.709829 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4UcGHO9gatUvWJBB907oWawoQP70h6HsJbsny_eFggCHTOgqUkoCg1AvAVcAHjORdEbkXL7xp_g0w0MdWTsQsxdtQLftyhBkZlCr9g7XUi02ZEumxE15kVflv1oC3aQIZmyWr_qGIamtOyoWvoJnlxnc8ckdznU53DKuHgbDBtijYA Aug 31 16:00:10.709829 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:00:10.709829 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:00:10.709829 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:00:10.709829 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:00:10.709829 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:00:10.709829 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:00:10.709829 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 7ed252ebf7c741bbb36b553ac1767579 Aug 31 16:00:10.709829 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-977175069 Aug 31 16:00:10.709829 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:00:10.709829 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:00:10.712753 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7ed252ebf7c741bbb36b553ac1767579"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7ed252ebf7c741bbb36b553ac1767579"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7ed252ebf7c741bbb36b553ac1767579", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7ed252ebf7c741bbb36b553ac1767579"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:00:10.712753 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-977175069 Aug 31 16:00:10.712753 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 7ed252ebf7c741bbb36b553ac1767579 Aug 31 16:00:10.712753 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-977175069 Aug 31 16:00:10.712753 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ImagesOneServerNegativeTestJSON-977175069-project Aug 31 16:00:10.712753 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:00:10.712753 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:00:10.712753 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 3ccce16c7fda401ea68fb31ea8099d78 Aug 31 16:00:10.712753 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-977175069-project Aug 31 16:00:10.712753 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:00:10.712753 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance aade3ca2-9ecc-48db-988a-1ddbc286024a could not be found. Aug 31 16:00:10.712753 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': 'aade3ca2-9ecc-48db-988a-1ddbc286024a'} Aug 31 16:00:10.713658 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:00:10.713658 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:10.713658 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:00:10.713658 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:00:10.713658 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:00:10.713658 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:00:10.713658 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:00:10.713658 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:00:10.713658 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:00:10.713658 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:00:10.713658 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aade3ca2-9ecc-48db-988a-1ddbc286024a could not be found. Aug 31 16:00:10.713658 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:00:10.713658 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:10.713658 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:00:10.713658 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:10.713658 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:10.713658 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:10.713658 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:00:10.713658 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:00:10.713658 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:00:10.716207 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:00:10.716207 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:00:10.716207 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:00:10.716207 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:00:10.716207 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:00:10.716207 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:00:10.716207 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:00:10.716207 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aade3ca2-9ecc-48db-988a-1ddbc286024a could not be found. Aug 31 16:00:10.716207 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:00:10.716207 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:10.716207 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:00:10.716207 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:10.716207 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:10.716207 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:10.716207 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:00:10.716207 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:00:10.716207 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aade3ca2-9ecc-48db-988a-1ddbc286024a could not be found. Aug 31 16:00:10.716207 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:00:10.718992 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-eb174f59-564f-4c6a-a4a7-48ed94bc2387 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Returning 404 to user: Instance aade3ca2-9ecc-48db-988a-1ddbc286024a could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:00:10.718992 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-eb174f59-564f-4c6a-a4a7-48ed94bc2387 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "GET /compute/v2.1/servers/aade3ca2-9ecc-48db-988a-1ddbc286024a" status: 404 len: 111 microversion: 2.1 time: 0.038878 Aug 31 16:00:10.718992 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 592/1165] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:10 2022] GET /compute/v2.1/servers/aade3ca2-9ecc-48db-988a-1ddbc286024a => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:00:10.726533 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-eba88052-d2b8-48e4-b4f4-5d60f77cb46d tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] 10.222.0.61 "GET /compute/v2.1/servers/39a531e3-b13b-412f-a200-5141c32650be" status: 200 len: 1371 microversion: 2.1 time: 0.199067 Aug 31 16:00:10.727184 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 574/1166] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:10 2022] GET /compute/v2.1/servers/39a531e3-b13b-412f-a200-5141c32650be => generated 1371 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:10.839144 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-727878f3-831f-4de9-8cea-b885ed894c0f tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1859737748", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:00:10.858533 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-229841bb-f9b5-4374-88a8-b1a33465aaa7 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:10.859131 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-229841bb-f9b5-4374-88a8-b1a33465aaa7 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:10.867168 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-229841bb-f9b5-4374-88a8-b1a33465aaa7 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:10.867734 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-229841bb-f9b5-4374-88a8-b1a33465aaa7 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:10.868178 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-229841bb-f9b5-4374-88a8-b1a33465aaa7 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:10.868886 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-229841bb-f9b5-4374-88a8-b1a33465aaa7 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:10.869339 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-229841bb-f9b5-4374-88a8-b1a33465aaa7 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:10.869762 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-229841bb-f9b5-4374-88a8-b1a33465aaa7 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:10.906532 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-727878f3-831f-4de9-8cea-b885ed894c0f tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] validate_networks() for [('d974b675-118c-4df8-9a7d-474c1e34f49f', None, None, None, None, None)] {{(pid=122257) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:00:10.959853 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-229841bb-f9b5-4374-88a8-b1a33465aaa7 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:10.969393 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-229841bb-f9b5-4374-88a8-b1a33465aaa7 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:10.971132 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-229841bb-f9b5-4374-88a8-b1a33465aaa7 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:10.980452 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-229841bb-f9b5-4374-88a8-b1a33465aaa7 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1539 microversion: 2.91 time: 0.125961 Aug 31 16:00:10.981140 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 575/1167] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:00:10 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1539 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:00:10.985651 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-adc719f0-b0f9-44d8-a468-b930acb83ced tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:10.986264 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-adc719f0-b0f9-44d8-a468-b930acb83ced tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] [instance: e45fa8b9-1545-4bd5-aa5f-402c71ec19c6] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:10.993470 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-adc719f0-b0f9-44d8-a468-b930acb83ced tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:10.994237 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-adc719f0-b0f9-44d8-a468-b930acb83ced tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:10.994847 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-adc719f0-b0f9-44d8-a468-b930acb83ced tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:10.995778 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-adc719f0-b0f9-44d8-a468-b930acb83ced tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:10.996406 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-adc719f0-b0f9-44d8-a468-b930acb83ced tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:10.996995 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-adc719f0-b0f9-44d8-a468-b930acb83ced tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:11.211520 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-adc719f0-b0f9-44d8-a468-b930acb83ced tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a03cc5956ca477abacbe0c26bf18750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea45d1b678342ed812f9912e9f07503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:11.219790 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-adc719f0-b0f9-44d8-a468-b930acb83ced tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] 10.222.0.61 "GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6" status: 200 len: 1479 microversion: 2.1 time: 0.237453 Aug 31 16:00:11.220535 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 576/1168] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:10 2022] GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6 => generated 1479 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:11.225364 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6f6f8b22-9917-4d38-9e9d-138418df1616 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:11.225978 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6f6f8b22-9917-4d38-9e9d-138418df1616 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: 5f29cff7-a675-40c2-a0e5-2a62994be45a] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:11.233065 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6f6f8b22-9917-4d38-9e9d-138418df1616 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:11.233065 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6f6f8b22-9917-4d38-9e9d-138418df1616 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:11.233328 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6f6f8b22-9917-4d38-9e9d-138418df1616 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:11.233988 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6f6f8b22-9917-4d38-9e9d-138418df1616 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:11.234462 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6f6f8b22-9917-4d38-9e9d-138418df1616 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:11.234854 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6f6f8b22-9917-4d38-9e9d-138418df1616 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:11.305319 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-6f6f8b22-9917-4d38-9e9d-138418df1616 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ccd03a4aa84f93bc26b438e1468f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a9f3fcc4b445349e5c66ff712e8598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:11.317549 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6f6f8b22-9917-4d38-9e9d-138418df1616 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/servers/5f29cff7-a675-40c2-a0e5-2a62994be45a" status: 200 len: 1212 microversion: 2.1 time: 0.095916 Aug 31 16:00:11.318091 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 577/1169] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:11 2022] GET /compute/v2.1/servers/5f29cff7-a675-40c2-a0e5-2a62994be45a => generated 1212 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:11.444063 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-727878f3-831f-4de9-8cea-b885ed894c0f tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:00:11.444503 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-727878f3-831f-4de9-8cea-b885ed894c0f tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:00:11.445222 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-727878f3-831f-4de9-8cea-b885ed894c0f tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:00:11.445642 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-727878f3-831f-4de9-8cea-b885ed894c0f tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:00:11.446052 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-727878f3-831f-4de9-8cea-b885ed894c0f tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:00:11.457526 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-727878f3-831f-4de9-8cea-b885ed894c0f tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:11.458061 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-727878f3-831f-4de9-8cea-b885ed894c0f tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:11.458502 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-727878f3-831f-4de9-8cea-b885ed894c0f tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:11.459267 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-727878f3-831f-4de9-8cea-b885ed894c0f tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:11.459790 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-727878f3-831f-4de9-8cea-b885ed894c0f tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:11.461631 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-727878f3-831f-4de9-8cea-b885ed894c0f tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:11.478798 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-727878f3-831f-4de9-8cea-b885ed894c0f tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Getting quotas for project 7ed252ebf7c741bbb36b553ac1767579. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:00:11.484674 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-727878f3-831f-4de9-8cea-b885ed894c0f tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Getting quotas for user 3ccce16c7fda401ea68fb31ea8099d78 and project 7ed252ebf7c741bbb36b553ac1767579. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:00:11.490049 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b332b518-3ae3-416a-93d9-d00921315ad9 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:11.490899 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b332b518-3ae3-416a-93d9-d00921315ad9 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] [instance: d5e69723-2d0e-46ef-8f76-82d64aad4772] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:11.498746 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b332b518-3ae3-416a-93d9-d00921315ad9 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:11.499306 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b332b518-3ae3-416a-93d9-d00921315ad9 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:11.499990 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b332b518-3ae3-416a-93d9-d00921315ad9 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:11.500913 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b332b518-3ae3-416a-93d9-d00921315ad9 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:11.501366 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b332b518-3ae3-416a-93d9-d00921315ad9 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:11.501621 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-727878f3-831f-4de9-8cea-b885ed894c0f tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Going to run 1 instances... {{(pid=122257) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:00:11.501817 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b332b518-3ae3-416a-93d9-d00921315ad9 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:11.503995 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-727878f3-831f-4de9-8cea-b885ed894c0f tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] [instance: 7e37d5ca-7dc4-476e-803f-f61c6adfaeb4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:00:11.557786 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-727878f3-831f-4de9-8cea-b885ed894c0f tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.723311 Aug 31 16:00:11.558508 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 593/1170] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:00:10 2022] POST /compute/v2.1/servers => generated 383 bytes in 725 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 16:00:11.571835 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7ba24fed-0373-4fd3-840c-ef596216a013 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:11.572353 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7ba24fed-0373-4fd3-840c-ef596216a013 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] [instance: 7e37d5ca-7dc4-476e-803f-f61c6adfaeb4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:11.648875 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7ba24fed-0373-4fd3-840c-ef596216a013 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccce16c7fda401ea68fb31ea8099d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed252ebf7c741bbb36b553ac1767579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:11.658143 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7ba24fed-0373-4fd3-840c-ef596216a013 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "GET /compute/v2.1/servers/7e37d5ca-7dc4-476e-803f-f61c6adfaeb4" status: 200 len: 1225 microversion: 2.1 time: 0.092281 Aug 31 16:00:11.658993 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 594/1171] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:11 2022] GET /compute/v2.1/servers/7e37d5ca-7dc4-476e-803f-f61c6adfaeb4 => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:00:11.683215 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b332b518-3ae3-416a-93d9-d00921315ad9 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377b1dedae45d2a804919e5ea69a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e5507d53224d19804717493d60bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:11.691640 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b332b518-3ae3-416a-93d9-d00921315ad9 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] 10.222.0.61 "GET /compute/v2.1/servers/d5e69723-2d0e-46ef-8f76-82d64aad4772" status: 200 len: 1715 microversion: 2.1 time: 0.208633 Aug 31 16:00:11.692819 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 578/1172] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:11 2022] GET /compute/v2.1/servers/d5e69723-2d0e-46ef-8f76-82d64aad4772 => generated 1715 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:11.748043 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4520e133-e81f-4873-9f18-10fc09504a8f tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:11.748667 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4520e133-e81f-4873-9f18-10fc09504a8f tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] [instance: 39a531e3-b13b-412f-a200-5141c32650be] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:11.756902 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4520e133-e81f-4873-9f18-10fc09504a8f tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:11.757418 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4520e133-e81f-4873-9f18-10fc09504a8f tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:11.757857 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4520e133-e81f-4873-9f18-10fc09504a8f tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:11.758565 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4520e133-e81f-4873-9f18-10fc09504a8f tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:11.759027 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4520e133-e81f-4873-9f18-10fc09504a8f tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:11.759448 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4520e133-e81f-4873-9f18-10fc09504a8f tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:11.762947 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=100 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:00:11.921343 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-4520e133-e81f-4873-9f18-10fc09504a8f tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb054cb62b9945a78e6bb60cd613acae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f780d0079345519eea40fe8a3fd813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:11.931309 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4520e133-e81f-4873-9f18-10fc09504a8f tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] 10.222.0.61 "GET /compute/v2.1/servers/39a531e3-b13b-412f-a200-5141c32650be" status: 200 len: 1371 microversion: 2.1 time: 0.186939 Aug 31 16:00:11.932601 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 595/1173] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:11 2022] GET /compute/v2.1/servers/39a531e3-b13b-412f-a200-5141c32650be => generated 1371 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:12.009550 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c514a378-403a-424c-a68e-80e893d7815d tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:12.010375 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c514a378-403a-424c-a68e-80e893d7815d tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:12.017697 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c514a378-403a-424c-a68e-80e893d7815d tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:12.018642 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c514a378-403a-424c-a68e-80e893d7815d tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:12.020313 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c514a378-403a-424c-a68e-80e893d7815d tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:12.021894 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c514a378-403a-424c-a68e-80e893d7815d tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:12.022620 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c514a378-403a-424c-a68e-80e893d7815d tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:12.023126 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c514a378-403a-424c-a68e-80e893d7815d tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:12.104768 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c514a378-403a-424c-a68e-80e893d7815d tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:12.114544 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c514a378-403a-424c-a68e-80e893d7815d tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:12.116135 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c514a378-403a-424c-a68e-80e893d7815d tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:12.121866 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c514a378-403a-424c-a68e-80e893d7815d tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1539 microversion: 2.91 time: 0.118339 Aug 31 16:00:12.127954 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 579/1174] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:00:12 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1539 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:00:12.242124 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f65171de-4c8d-4a74-a055-241ca32fcddb tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:12.242770 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f65171de-4c8d-4a74-a055-241ca32fcddb tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] [instance: e45fa8b9-1545-4bd5-aa5f-402c71ec19c6] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:12.250102 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f65171de-4c8d-4a74-a055-241ca32fcddb tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:12.250588 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f65171de-4c8d-4a74-a055-241ca32fcddb tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:12.251032 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f65171de-4c8d-4a74-a055-241ca32fcddb tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:12.251788 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f65171de-4c8d-4a74-a055-241ca32fcddb tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:12.252452 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f65171de-4c8d-4a74-a055-241ca32fcddb tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:12.252879 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f65171de-4c8d-4a74-a055-241ca32fcddb tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:12.339519 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ced52930-058f-4ccb-b475-1187625b6abc tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:12.340318 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ced52930-058f-4ccb-b475-1187625b6abc tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: 5f29cff7-a675-40c2-a0e5-2a62994be45a] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:12.346436 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ced52930-058f-4ccb-b475-1187625b6abc tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:12.346935 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ced52930-058f-4ccb-b475-1187625b6abc tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:12.347376 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ced52930-058f-4ccb-b475-1187625b6abc tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:12.348132 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ced52930-058f-4ccb-b475-1187625b6abc tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:12.348592 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ced52930-058f-4ccb-b475-1187625b6abc tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:12.350231 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ced52930-058f-4ccb-b475-1187625b6abc tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:12.398351 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f65171de-4c8d-4a74-a055-241ca32fcddb tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a03cc5956ca477abacbe0c26bf18750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea45d1b678342ed812f9912e9f07503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:12.406556 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f65171de-4c8d-4a74-a055-241ca32fcddb tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] 10.222.0.61 "GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6" status: 200 len: 1479 microversion: 2.1 time: 0.168954 Aug 31 16:00:12.407149 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 596/1175] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:12 2022] GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6 => generated 1479 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:12.429580 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ced52930-058f-4ccb-b475-1187625b6abc tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ccd03a4aa84f93bc26b438e1468f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a9f3fcc4b445349e5c66ff712e8598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:12.442869 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ced52930-058f-4ccb-b475-1187625b6abc tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/servers/5f29cff7-a675-40c2-a0e5-2a62994be45a" status: 200 len: 1212 microversion: 2.1 time: 0.106999 Aug 31 16:00:12.445605 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 580/1176] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:12 2022] GET /compute/v2.1/servers/5f29cff7-a675-40c2-a0e5-2a62994be45a => generated 1212 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:12.679599 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-187246e4-912d-4101-8bc0-f5ac8d2eef75 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:12.680126 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-187246e4-912d-4101-8bc0-f5ac8d2eef75 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] [instance: 7e37d5ca-7dc4-476e-803f-f61c6adfaeb4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:12.686164 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-187246e4-912d-4101-8bc0-f5ac8d2eef75 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:12.686644 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-187246e4-912d-4101-8bc0-f5ac8d2eef75 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:12.687073 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-187246e4-912d-4101-8bc0-f5ac8d2eef75 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:12.687823 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-187246e4-912d-4101-8bc0-f5ac8d2eef75 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:12.688242 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-187246e4-912d-4101-8bc0-f5ac8d2eef75 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:12.688665 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-187246e4-912d-4101-8bc0-f5ac8d2eef75 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:12.713854 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d50252ed-834d-49a2-8fc9-9effa435ff2c tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:12.714463 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d50252ed-834d-49a2-8fc9-9effa435ff2c tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] [instance: d5e69723-2d0e-46ef-8f76-82d64aad4772] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:12.721547 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d50252ed-834d-49a2-8fc9-9effa435ff2c tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:12.722037 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d50252ed-834d-49a2-8fc9-9effa435ff2c tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:12.722465 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d50252ed-834d-49a2-8fc9-9effa435ff2c tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:12.723931 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d50252ed-834d-49a2-8fc9-9effa435ff2c tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:12.724741 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d50252ed-834d-49a2-8fc9-9effa435ff2c tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:12.725165 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d50252ed-834d-49a2-8fc9-9effa435ff2c tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:12.728524 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:00:12.755711 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-187246e4-912d-4101-8bc0-f5ac8d2eef75 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccce16c7fda401ea68fb31ea8099d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed252ebf7c741bbb36b553ac1767579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:12.763660 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-187246e4-912d-4101-8bc0-f5ac8d2eef75 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "GET /compute/v2.1/servers/7e37d5ca-7dc4-476e-803f-f61c6adfaeb4" status: 200 len: 1221 microversion: 2.1 time: 0.088587 Aug 31 16:00:12.764235 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 597/1177] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:12 2022] GET /compute/v2.1/servers/7e37d5ca-7dc4-476e-803f-f61c6adfaeb4 => generated 1221 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:12.870914 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d50252ed-834d-49a2-8fc9-9effa435ff2c tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377b1dedae45d2a804919e5ea69a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e5507d53224d19804717493d60bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:12.879625 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d50252ed-834d-49a2-8fc9-9effa435ff2c tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] 10.222.0.61 "GET /compute/v2.1/servers/d5e69723-2d0e-46ef-8f76-82d64aad4772" status: 200 len: 1715 microversion: 2.1 time: 0.169732 Aug 31 16:00:12.880220 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 581/1178] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:12 2022] GET /compute/v2.1/servers/d5e69723-2d0e-46ef-8f76-82d64aad4772 => generated 1715 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:12.956177 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-64d218da-a06d-452a-b224-dd1a4ad08193 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:12.956708 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-64d218da-a06d-452a-b224-dd1a4ad08193 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] [instance: 39a531e3-b13b-412f-a200-5141c32650be] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:12.964141 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-64d218da-a06d-452a-b224-dd1a4ad08193 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:12.964719 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-64d218da-a06d-452a-b224-dd1a4ad08193 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:12.965212 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-64d218da-a06d-452a-b224-dd1a4ad08193 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:12.965983 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-64d218da-a06d-452a-b224-dd1a4ad08193 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:12.966467 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-64d218da-a06d-452a-b224-dd1a4ad08193 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:12.966951 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-64d218da-a06d-452a-b224-dd1a4ad08193 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:13.101116 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-64d218da-a06d-452a-b224-dd1a4ad08193 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb054cb62b9945a78e6bb60cd613acae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f780d0079345519eea40fe8a3fd813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:13.108778 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-64d218da-a06d-452a-b224-dd1a4ad08193 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] 10.222.0.61 "GET /compute/v2.1/servers/39a531e3-b13b-412f-a200-5141c32650be" status: 200 len: 1371 microversion: 2.1 time: 0.156637 Aug 31 16:00:13.109368 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 598/1179] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:12 2022] GET /compute/v2.1/servers/39a531e3-b13b-412f-a200-5141c32650be => generated 1371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:13.146888 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c6f65f28-15ec-4288-bd5e-536b602a9733 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:13.147615 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c6f65f28-15ec-4288-bd5e-536b602a9733 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:13.153498 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c6f65f28-15ec-4288-bd5e-536b602a9733 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:13.153987 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c6f65f28-15ec-4288-bd5e-536b602a9733 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:13.154424 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c6f65f28-15ec-4288-bd5e-536b602a9733 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:13.155146 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c6f65f28-15ec-4288-bd5e-536b602a9733 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:13.155629 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c6f65f28-15ec-4288-bd5e-536b602a9733 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:13.156052 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c6f65f28-15ec-4288-bd5e-536b602a9733 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:13.222890 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c6f65f28-15ec-4288-bd5e-536b602a9733 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:13.231669 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c6f65f28-15ec-4288-bd5e-536b602a9733 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:13.233132 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c6f65f28-15ec-4288-bd5e-536b602a9733 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:13.237872 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c6f65f28-15ec-4288-bd5e-536b602a9733 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1539 microversion: 2.91 time: 0.095625 Aug 31 16:00:13.238444 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 582/1180] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:00:13 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1539 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:00:13.429855 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-10f5acbe-2ca3-4712-aa07-285784f5038a tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:13.430471 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-10f5acbe-2ca3-4712-aa07-285784f5038a tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] [instance: e45fa8b9-1545-4bd5-aa5f-402c71ec19c6] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:13.436658 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-10f5acbe-2ca3-4712-aa07-285784f5038a tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:13.437156 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-10f5acbe-2ca3-4712-aa07-285784f5038a tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:13.437628 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-10f5acbe-2ca3-4712-aa07-285784f5038a tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:13.438332 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-10f5acbe-2ca3-4712-aa07-285784f5038a tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:13.438794 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-10f5acbe-2ca3-4712-aa07-285784f5038a tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:13.439278 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-10f5acbe-2ca3-4712-aa07-285784f5038a tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:13.486440 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9da1a17b-e289-4a4b-bdd5-e99a9efec2d5 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:13.487072 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9da1a17b-e289-4a4b-bdd5-e99a9efec2d5 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: 5f29cff7-a675-40c2-a0e5-2a62994be45a] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:13.497005 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9da1a17b-e289-4a4b-bdd5-e99a9efec2d5 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:13.497538 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9da1a17b-e289-4a4b-bdd5-e99a9efec2d5 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:13.497982 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9da1a17b-e289-4a4b-bdd5-e99a9efec2d5 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:13.498852 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9da1a17b-e289-4a4b-bdd5-e99a9efec2d5 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:13.499170 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9da1a17b-e289-4a4b-bdd5-e99a9efec2d5 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:13.499629 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9da1a17b-e289-4a4b-bdd5-e99a9efec2d5 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:13.577634 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-9da1a17b-e289-4a4b-bdd5-e99a9efec2d5 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ccd03a4aa84f93bc26b438e1468f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a9f3fcc4b445349e5c66ff712e8598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:13.587287 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9da1a17b-e289-4a4b-bdd5-e99a9efec2d5 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/servers/5f29cff7-a675-40c2-a0e5-2a62994be45a" status: 200 len: 1204 microversion: 2.1 time: 0.110752 Aug 31 16:00:13.590922 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 583/1181] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:13 2022] GET /compute/v2.1/servers/5f29cff7-a675-40c2-a0e5-2a62994be45a => generated 1204 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:13.595800 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-0aa5f547-96a3-4ae6-8e57-d936412c7c8f req-9cb35366-4682-4be2-a33d-1921922484bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e45fa8b9-1545-4bd5-aa5f-402c71ec19c6", "name": "network-vif-plugged", "status": "completed", "tag": "935e822d-4171-4348-8a87-c6e76ab1ea4f"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:00:13.607157 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-0aa5f547-96a3-4ae6-8e57-d936412c7c8f req-9cb35366-4682-4be2-a33d-1921922484bf service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:13.607669 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-0aa5f547-96a3-4ae6-8e57-d936412c7c8f req-9cb35366-4682-4be2-a33d-1921922484bf service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:13.608100 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-0aa5f547-96a3-4ae6-8e57-d936412c7c8f req-9cb35366-4682-4be2-a33d-1921922484bf service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:13.615266 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-10f5acbe-2ca3-4712-aa07-285784f5038a tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a03cc5956ca477abacbe0c26bf18750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea45d1b678342ed812f9912e9f07503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:13.620436 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-0aa5f547-96a3-4ae6-8e57-d936412c7c8f req-9cb35366-4682-4be2-a33d-1921922484bf service nova] Creating event network-vif-plugged:935e822d-4171-4348-8a87-c6e76ab1ea4f for instance e45fa8b9-1545-4bd5-aa5f-402c71ec19c6 on n-h2-850499-9 Aug 31 16:00:13.622927 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-10f5acbe-2ca3-4712-aa07-285784f5038a tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] 10.222.0.61 "GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6" status: 200 len: 1479 microversion: 2.1 time: 0.196995 Aug 31 16:00:13.624239 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 599/1182] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:13 2022] GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6 => generated 1479 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:13.625385 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-0aa5f547-96a3-4ae6-8e57-d936412c7c8f req-9cb35366-4682-4be2-a33d-1921922484bf service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033179 Aug 31 16:00:13.626041 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 584/1183] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:00:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:00:13.805627 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1b46c983-531f-4b51-a379-3fa0a5529025 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:13.806253 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1b46c983-531f-4b51-a379-3fa0a5529025 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] [instance: 7e37d5ca-7dc4-476e-803f-f61c6adfaeb4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:13.815997 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1b46c983-531f-4b51-a379-3fa0a5529025 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:13.816687 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1b46c983-531f-4b51-a379-3fa0a5529025 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:13.819738 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1b46c983-531f-4b51-a379-3fa0a5529025 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:13.820845 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1b46c983-531f-4b51-a379-3fa0a5529025 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:13.821641 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1b46c983-531f-4b51-a379-3fa0a5529025 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:13.822242 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1b46c983-531f-4b51-a379-3fa0a5529025 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:13.902933 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7864e7b6-d74d-49d1-8fef-7b3229e29d1f tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:13.904124 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7864e7b6-d74d-49d1-8fef-7b3229e29d1f tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] [instance: d5e69723-2d0e-46ef-8f76-82d64aad4772] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:13.913368 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7864e7b6-d74d-49d1-8fef-7b3229e29d1f tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:13.915176 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7864e7b6-d74d-49d1-8fef-7b3229e29d1f tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:13.915855 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7864e7b6-d74d-49d1-8fef-7b3229e29d1f tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:13.918666 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7864e7b6-d74d-49d1-8fef-7b3229e29d1f tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:13.919421 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7864e7b6-d74d-49d1-8fef-7b3229e29d1f tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:13.920798 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7864e7b6-d74d-49d1-8fef-7b3229e29d1f tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:13.999050 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-1b46c983-531f-4b51-a379-3fa0a5529025 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccce16c7fda401ea68fb31ea8099d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed252ebf7c741bbb36b553ac1767579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:14.009091 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1b46c983-531f-4b51-a379-3fa0a5529025 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "GET /compute/v2.1/servers/7e37d5ca-7dc4-476e-803f-f61c6adfaeb4" status: 200 len: 1221 microversion: 2.1 time: 0.212285 Aug 31 16:00:14.027653 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 600/1184] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:13 2022] GET /compute/v2.1/servers/7e37d5ca-7dc4-476e-803f-f61c6adfaeb4 => generated 1221 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:14.129583 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9e5b8da9-7994-4f9c-b7ea-d8adf03b71e5 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:14.130305 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9e5b8da9-7994-4f9c-b7ea-d8adf03b71e5 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] [instance: 39a531e3-b13b-412f-a200-5141c32650be] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:14.136336 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9e5b8da9-7994-4f9c-b7ea-d8adf03b71e5 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:14.136974 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9e5b8da9-7994-4f9c-b7ea-d8adf03b71e5 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:14.137498 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9e5b8da9-7994-4f9c-b7ea-d8adf03b71e5 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:14.138266 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9e5b8da9-7994-4f9c-b7ea-d8adf03b71e5 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:14.138793 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9e5b8da9-7994-4f9c-b7ea-d8adf03b71e5 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:14.139451 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9e5b8da9-7994-4f9c-b7ea-d8adf03b71e5 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:14.266448 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7864e7b6-d74d-49d1-8fef-7b3229e29d1f tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377b1dedae45d2a804919e5ea69a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e5507d53224d19804717493d60bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:14.275353 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7864e7b6-d74d-49d1-8fef-7b3229e29d1f tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] 10.222.0.61 "GET /compute/v2.1/servers/d5e69723-2d0e-46ef-8f76-82d64aad4772" status: 200 len: 1715 microversion: 2.1 time: 0.377687 Aug 31 16:00:14.275972 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 585/1185] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:13 2022] GET /compute/v2.1/servers/d5e69723-2d0e-46ef-8f76-82d64aad4772 => generated 1715 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:00:14.294154 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-88cf75ac-3f0c-4bdd-ba3b-fb03b82da5c2 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:14.294770 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-88cf75ac-3f0c-4bdd-ba3b-fb03b82da5c2 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:14.300829 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-88cf75ac-3f0c-4bdd-ba3b-fb03b82da5c2 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:14.301323 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-88cf75ac-3f0c-4bdd-ba3b-fb03b82da5c2 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:14.302540 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-88cf75ac-3f0c-4bdd-ba3b-fb03b82da5c2 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:14.303255 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-88cf75ac-3f0c-4bdd-ba3b-fb03b82da5c2 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:14.303746 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-88cf75ac-3f0c-4bdd-ba3b-fb03b82da5c2 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:14.304177 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-88cf75ac-3f0c-4bdd-ba3b-fb03b82da5c2 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:14.325690 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9e5b8da9-7994-4f9c-b7ea-d8adf03b71e5 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb054cb62b9945a78e6bb60cd613acae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f780d0079345519eea40fe8a3fd813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:14.333581 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9e5b8da9-7994-4f9c-b7ea-d8adf03b71e5 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] 10.222.0.61 "GET /compute/v2.1/servers/39a531e3-b13b-412f-a200-5141c32650be" status: 200 len: 1371 microversion: 2.1 time: 0.208061 Aug 31 16:00:14.334357 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 601/1186] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:14 2022] GET /compute/v2.1/servers/39a531e3-b13b-412f-a200-5141c32650be => generated 1371 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:00:14.369301 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-88cf75ac-3f0c-4bdd-ba3b-fb03b82da5c2 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:14.377481 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-88cf75ac-3f0c-4bdd-ba3b-fb03b82da5c2 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:14.378932 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-88cf75ac-3f0c-4bdd-ba3b-fb03b82da5c2 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:14.384434 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-88cf75ac-3f0c-4bdd-ba3b-fb03b82da5c2 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1539 microversion: 2.91 time: 0.094401 Aug 31 16:00:14.385009 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 586/1187] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:00:14 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1539 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:00:14.609068 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-fa7c7311-6d85-43ed-a203-5f5b084eb780 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:14.609674 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-fa7c7311-6d85-43ed-a203-5f5b084eb780 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: 5f29cff7-a675-40c2-a0e5-2a62994be45a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:14.615980 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fa7c7311-6d85-43ed-a203-5f5b084eb780 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:14.616465 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fa7c7311-6d85-43ed-a203-5f5b084eb780 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:14.616899 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fa7c7311-6d85-43ed-a203-5f5b084eb780 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:14.617587 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fa7c7311-6d85-43ed-a203-5f5b084eb780 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:14.618033 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fa7c7311-6d85-43ed-a203-5f5b084eb780 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:14.618453 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fa7c7311-6d85-43ed-a203-5f5b084eb780 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:14.646768 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f0b3f87c-a3de-4348-822b-bdebaee89851 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:14.647386 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f0b3f87c-a3de-4348-822b-bdebaee89851 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] [instance: e45fa8b9-1545-4bd5-aa5f-402c71ec19c6] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:14.653637 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f0b3f87c-a3de-4348-822b-bdebaee89851 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:14.654137 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f0b3f87c-a3de-4348-822b-bdebaee89851 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:14.654611 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f0b3f87c-a3de-4348-822b-bdebaee89851 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:14.655349 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f0b3f87c-a3de-4348-822b-bdebaee89851 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:14.655856 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f0b3f87c-a3de-4348-822b-bdebaee89851 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:14.656290 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f0b3f87c-a3de-4348-822b-bdebaee89851 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:14.682213 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-fa7c7311-6d85-43ed-a203-5f5b084eb780 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ccd03a4aa84f93bc26b438e1468f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a9f3fcc4b445349e5c66ff712e8598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:14.689961 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-fa7c7311-6d85-43ed-a203-5f5b084eb780 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/servers/5f29cff7-a675-40c2-a0e5-2a62994be45a" status: 200 len: 1260 microversion: 2.1 time: 0.084733 Aug 31 16:00:14.690543 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 602/1188] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:14 2022] GET /compute/v2.1/servers/5f29cff7-a675-40c2-a0e5-2a62994be45a => generated 1260 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:14.789507 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f0b3f87c-a3de-4348-822b-bdebaee89851 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a03cc5956ca477abacbe0c26bf18750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea45d1b678342ed812f9912e9f07503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:14.797571 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f0b3f87c-a3de-4348-822b-bdebaee89851 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] 10.222.0.61 "GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6" status: 200 len: 1479 microversion: 2.1 time: 0.155281 Aug 31 16:00:14.799329 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 587/1189] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:14 2022] GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6 => generated 1479 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:00:15.042134 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-57c79d9b-8d3f-4c80-b583-720f10833d92 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:15.042745 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-57c79d9b-8d3f-4c80-b583-720f10833d92 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] [instance: 7e37d5ca-7dc4-476e-803f-f61c6adfaeb4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:15.049250 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-57c79d9b-8d3f-4c80-b583-720f10833d92 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:15.049726 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-57c79d9b-8d3f-4c80-b583-720f10833d92 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:15.050170 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-57c79d9b-8d3f-4c80-b583-720f10833d92 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:15.050868 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-57c79d9b-8d3f-4c80-b583-720f10833d92 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:15.052128 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-57c79d9b-8d3f-4c80-b583-720f10833d92 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:15.052903 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-57c79d9b-8d3f-4c80-b583-720f10833d92 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:15.117608 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-57c79d9b-8d3f-4c80-b583-720f10833d92 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccce16c7fda401ea68fb31ea8099d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed252ebf7c741bbb36b553ac1767579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:15.125404 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-57c79d9b-8d3f-4c80-b583-720f10833d92 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "GET /compute/v2.1/servers/7e37d5ca-7dc4-476e-803f-f61c6adfaeb4" status: 200 len: 1277 microversion: 2.1 time: 0.087174 Aug 31 16:00:15.125990 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 603/1190] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:15 2022] GET /compute/v2.1/servers/7e37d5ca-7dc4-476e-803f-f61c6adfaeb4 => generated 1277 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:15.296929 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8e9bf937-abc4-45b9-8aa1-2fdee469cb30 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:15.297472 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8e9bf937-abc4-45b9-8aa1-2fdee469cb30 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] [instance: d5e69723-2d0e-46ef-8f76-82d64aad4772] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:15.305606 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8e9bf937-abc4-45b9-8aa1-2fdee469cb30 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:15.306100 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8e9bf937-abc4-45b9-8aa1-2fdee469cb30 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:15.306543 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8e9bf937-abc4-45b9-8aa1-2fdee469cb30 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:15.307245 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8e9bf937-abc4-45b9-8aa1-2fdee469cb30 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:15.307737 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8e9bf937-abc4-45b9-8aa1-2fdee469cb30 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:15.308170 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8e9bf937-abc4-45b9-8aa1-2fdee469cb30 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:15.354372 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2953ab54-cd97-4e6c-a30e-72a1b5fbb242 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:15.355116 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2953ab54-cd97-4e6c-a30e-72a1b5fbb242 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] [instance: 39a531e3-b13b-412f-a200-5141c32650be] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:15.361138 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2953ab54-cd97-4e6c-a30e-72a1b5fbb242 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:15.361623 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2953ab54-cd97-4e6c-a30e-72a1b5fbb242 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:15.362059 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2953ab54-cd97-4e6c-a30e-72a1b5fbb242 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:15.362754 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2953ab54-cd97-4e6c-a30e-72a1b5fbb242 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:15.363211 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2953ab54-cd97-4e6c-a30e-72a1b5fbb242 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:15.363682 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2953ab54-cd97-4e6c-a30e-72a1b5fbb242 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:15.481061 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8e9bf937-abc4-45b9-8aa1-2fdee469cb30 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377b1dedae45d2a804919e5ea69a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e5507d53224d19804717493d60bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:15.490803 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8e9bf937-abc4-45b9-8aa1-2fdee469cb30 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] 10.222.0.61 "GET /compute/v2.1/servers/d5e69723-2d0e-46ef-8f76-82d64aad4772" status: 200 len: 1715 microversion: 2.1 time: 0.197584 Aug 31 16:00:15.491619 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 588/1191] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:15 2022] GET /compute/v2.1/servers/d5e69723-2d0e-46ef-8f76-82d64aad4772 => generated 1715 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:15.496315 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-07b76b9d-c259-46ff-9b26-7a3112ef56f5 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:15.496993 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-07b76b9d-c259-46ff-9b26-7a3112ef56f5 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:15.503210 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-07b76b9d-c259-46ff-9b26-7a3112ef56f5 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:15.503805 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-07b76b9d-c259-46ff-9b26-7a3112ef56f5 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:15.504320 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-07b76b9d-c259-46ff-9b26-7a3112ef56f5 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:15.505333 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-07b76b9d-c259-46ff-9b26-7a3112ef56f5 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:15.505802 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-07b76b9d-c259-46ff-9b26-7a3112ef56f5 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:15.506233 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-07b76b9d-c259-46ff-9b26-7a3112ef56f5 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:15.532078 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2953ab54-cd97-4e6c-a30e-72a1b5fbb242 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb054cb62b9945a78e6bb60cd613acae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f780d0079345519eea40fe8a3fd813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:15.540385 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2953ab54-cd97-4e6c-a30e-72a1b5fbb242 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] 10.222.0.61 "GET /compute/v2.1/servers/39a531e3-b13b-412f-a200-5141c32650be" status: 200 len: 1371 microversion: 2.1 time: 0.190062 Aug 31 16:00:15.541172 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 604/1192] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:15 2022] GET /compute/v2.1/servers/39a531e3-b13b-412f-a200-5141c32650be => generated 1371 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:15.573689 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-07b76b9d-c259-46ff-9b26-7a3112ef56f5 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:15.582112 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-07b76b9d-c259-46ff-9b26-7a3112ef56f5 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:15.583734 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-07b76b9d-c259-46ff-9b26-7a3112ef56f5 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:15.588874 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-07b76b9d-c259-46ff-9b26-7a3112ef56f5 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1539 microversion: 2.91 time: 0.096211 Aug 31 16:00:15.589442 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 589/1193] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:00:15 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1539 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:00:15.710717 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f9639adf-866f-4c54-a7cb-d7238455d460 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:15.711357 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f9639adf-866f-4c54-a7cb-d7238455d460 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: 5f29cff7-a675-40c2-a0e5-2a62994be45a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:15.717688 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f9639adf-866f-4c54-a7cb-d7238455d460 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:15.718190 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f9639adf-866f-4c54-a7cb-d7238455d460 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:15.718633 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f9639adf-866f-4c54-a7cb-d7238455d460 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:15.719338 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f9639adf-866f-4c54-a7cb-d7238455d460 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:15.719829 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f9639adf-866f-4c54-a7cb-d7238455d460 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:15.720411 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f9639adf-866f-4c54-a7cb-d7238455d460 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:15.784552 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f9639adf-866f-4c54-a7cb-d7238455d460 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ccd03a4aa84f93bc26b438e1468f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a9f3fcc4b445349e5c66ff712e8598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:15.792940 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f9639adf-866f-4c54-a7cb-d7238455d460 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/servers/5f29cff7-a675-40c2-a0e5-2a62994be45a" status: 200 len: 1260 microversion: 2.1 time: 0.086629 Aug 31 16:00:15.793514 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 605/1194] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:15 2022] GET /compute/v2.1/servers/5f29cff7-a675-40c2-a0e5-2a62994be45a => generated 1260 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:15.820579 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b2868bc7-d704-44be-a442-4654f579d1c8 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:15.821511 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b2868bc7-d704-44be-a442-4654f579d1c8 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] [instance: e45fa8b9-1545-4bd5-aa5f-402c71ec19c6] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:15.823623 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:00:15.830637 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b2868bc7-d704-44be-a442-4654f579d1c8 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:15.831134 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b2868bc7-d704-44be-a442-4654f579d1c8 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:15.831606 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b2868bc7-d704-44be-a442-4654f579d1c8 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:15.832314 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b2868bc7-d704-44be-a442-4654f579d1c8 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:15.833473 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b2868bc7-d704-44be-a442-4654f579d1c8 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:15.833913 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b2868bc7-d704-44be-a442-4654f579d1c8 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:15.978714 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b2868bc7-d704-44be-a442-4654f579d1c8 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a03cc5956ca477abacbe0c26bf18750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea45d1b678342ed812f9912e9f07503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:15.988250 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b2868bc7-d704-44be-a442-4654f579d1c8 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] 10.222.0.61 "GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6" status: 200 len: 1479 microversion: 2.1 time: 0.171727 Aug 31 16:00:15.990202 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 590/1195] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:15 2022] GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6 => generated 1479 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:16.151787 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c926378a-321f-48e1-b280-787357acf0d8 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:16.152408 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c926378a-321f-48e1-b280-787357acf0d8 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] [instance: 7e37d5ca-7dc4-476e-803f-f61c6adfaeb4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:16.159158 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c926378a-321f-48e1-b280-787357acf0d8 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:16.159781 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c926378a-321f-48e1-b280-787357acf0d8 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:16.160223 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c926378a-321f-48e1-b280-787357acf0d8 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:16.161494 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c926378a-321f-48e1-b280-787357acf0d8 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:16.162465 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c926378a-321f-48e1-b280-787357acf0d8 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:16.162891 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c926378a-321f-48e1-b280-787357acf0d8 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:16.233986 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c926378a-321f-48e1-b280-787357acf0d8 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccce16c7fda401ea68fb31ea8099d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed252ebf7c741bbb36b553ac1767579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:16.243181 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c926378a-321f-48e1-b280-787357acf0d8 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "GET /compute/v2.1/servers/7e37d5ca-7dc4-476e-803f-f61c6adfaeb4" status: 200 len: 1277 microversion: 2.1 time: 0.096385 Aug 31 16:00:16.243926 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 606/1196] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:16 2022] GET /compute/v2.1/servers/7e37d5ca-7dc4-476e-803f-f61c6adfaeb4 => generated 1277 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:16.511698 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-494e1d9b-2d1f-4477-bcd7-eff17858ad80 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:16.512355 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-494e1d9b-2d1f-4477-bcd7-eff17858ad80 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] [instance: d5e69723-2d0e-46ef-8f76-82d64aad4772] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:16.519532 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-494e1d9b-2d1f-4477-bcd7-eff17858ad80 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:16.520653 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-494e1d9b-2d1f-4477-bcd7-eff17858ad80 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:16.521288 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-494e1d9b-2d1f-4477-bcd7-eff17858ad80 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:16.522195 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-494e1d9b-2d1f-4477-bcd7-eff17858ad80 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:16.522661 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-494e1d9b-2d1f-4477-bcd7-eff17858ad80 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:16.523092 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-494e1d9b-2d1f-4477-bcd7-eff17858ad80 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:16.561422 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-932ccdc8-c6a1-4445-878a-e0a1fd074227 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:16.562073 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-932ccdc8-c6a1-4445-878a-e0a1fd074227 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] [instance: 39a531e3-b13b-412f-a200-5141c32650be] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:16.568332 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-932ccdc8-c6a1-4445-878a-e0a1fd074227 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:16.569033 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-932ccdc8-c6a1-4445-878a-e0a1fd074227 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:16.569255 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-932ccdc8-c6a1-4445-878a-e0a1fd074227 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:16.570065 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-932ccdc8-c6a1-4445-878a-e0a1fd074227 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:16.570569 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-932ccdc8-c6a1-4445-878a-e0a1fd074227 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:16.571202 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-932ccdc8-c6a1-4445-878a-e0a1fd074227 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:16.668436 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-494e1d9b-2d1f-4477-bcd7-eff17858ad80 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377b1dedae45d2a804919e5ea69a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e5507d53224d19804717493d60bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:16.679410 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-494e1d9b-2d1f-4477-bcd7-eff17858ad80 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] 10.222.0.61 "GET /compute/v2.1/servers/d5e69723-2d0e-46ef-8f76-82d64aad4772" status: 200 len: 1715 microversion: 2.1 time: 0.171502 Aug 31 16:00:16.692165 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 591/1197] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:16 2022] GET /compute/v2.1/servers/d5e69723-2d0e-46ef-8f76-82d64aad4772 => generated 1715 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:16.699999 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b96eb627-9798-41ca-8b40-244bc9a3c3a1 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:16.700656 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b96eb627-9798-41ca-8b40-244bc9a3c3a1 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:16.707156 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b96eb627-9798-41ca-8b40-244bc9a3c3a1 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:16.708174 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b96eb627-9798-41ca-8b40-244bc9a3c3a1 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:16.709314 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b96eb627-9798-41ca-8b40-244bc9a3c3a1 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:16.710052 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b96eb627-9798-41ca-8b40-244bc9a3c3a1 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:16.710778 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b96eb627-9798-41ca-8b40-244bc9a3c3a1 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:16.711217 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b96eb627-9798-41ca-8b40-244bc9a3c3a1 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:16.794246 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b96eb627-9798-41ca-8b40-244bc9a3c3a1 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:16.805171 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b96eb627-9798-41ca-8b40-244bc9a3c3a1 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:16.806947 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b96eb627-9798-41ca-8b40-244bc9a3c3a1 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:16.813135 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b96eb627-9798-41ca-8b40-244bc9a3c3a1 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1539 microversion: 2.91 time: 0.119305 Aug 31 16:00:16.814365 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 592/1198] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:00:16 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1539 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:00:16.830445 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-22cf8176-3776-447f-90fe-3ee7380154a6 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:16.831385 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-22cf8176-3776-447f-90fe-3ee7380154a6 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: 5f29cff7-a675-40c2-a0e5-2a62994be45a] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:16.850582 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-22cf8176-3776-447f-90fe-3ee7380154a6 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:16.851100 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-22cf8176-3776-447f-90fe-3ee7380154a6 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:16.851731 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-22cf8176-3776-447f-90fe-3ee7380154a6 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:16.852468 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-22cf8176-3776-447f-90fe-3ee7380154a6 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:16.852937 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-22cf8176-3776-447f-90fe-3ee7380154a6 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:16.853376 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-22cf8176-3776-447f-90fe-3ee7380154a6 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:16.987395 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-22cf8176-3776-447f-90fe-3ee7380154a6 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ccd03a4aa84f93bc26b438e1468f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a9f3fcc4b445349e5c66ff712e8598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:16.999075 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-22cf8176-3776-447f-90fe-3ee7380154a6 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/servers/5f29cff7-a675-40c2-a0e5-2a62994be45a" status: 200 len: 1260 microversion: 2.1 time: 0.182549 Aug 31 16:00:16.999690 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 593/1199] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:16 2022] GET /compute/v2.1/servers/5f29cff7-a675-40c2-a0e5-2a62994be45a => generated 1260 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:17.014041 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-517708e9-d0e4-4591-ae92-347127de748c tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:17.014660 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-517708e9-d0e4-4591-ae92-347127de748c tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] [instance: e45fa8b9-1545-4bd5-aa5f-402c71ec19c6] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:17.023088 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-517708e9-d0e4-4591-ae92-347127de748c tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:17.024079 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-517708e9-d0e4-4591-ae92-347127de748c tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:17.024767 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-517708e9-d0e4-4591-ae92-347127de748c tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:17.025980 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-517708e9-d0e4-4591-ae92-347127de748c tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:17.026812 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-517708e9-d0e4-4591-ae92-347127de748c tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:17.027597 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-517708e9-d0e4-4591-ae92-347127de748c tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:17.049429 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-932ccdc8-c6a1-4445-878a-e0a1fd074227 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb054cb62b9945a78e6bb60cd613acae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f780d0079345519eea40fe8a3fd813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:17.064124 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-932ccdc8-c6a1-4445-878a-e0a1fd074227 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] 10.222.0.61 "GET /compute/v2.1/servers/39a531e3-b13b-412f-a200-5141c32650be" status: 200 len: 1371 microversion: 2.1 time: 0.506001 Aug 31 16:00:17.065325 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 607/1200] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:16 2022] GET /compute/v2.1/servers/39a531e3-b13b-412f-a200-5141c32650be => generated 1371 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:00:17.174564 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-517708e9-d0e4-4591-ae92-347127de748c tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a03cc5956ca477abacbe0c26bf18750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea45d1b678342ed812f9912e9f07503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:17.183380 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-517708e9-d0e4-4591-ae92-347127de748c tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] 10.222.0.61 "GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6" status: 200 len: 1464 microversion: 2.1 time: 0.173158 Aug 31 16:00:17.184328 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 594/1201] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:17 2022] GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6 => generated 1464 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:17.214993 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7e6210aa-e912-496d-946b-c8d3c17871db tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:00:17.217256 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7e6210aa-e912-496d-946b-c8d3c17871db tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] [instance: e45fa8b9-1545-4bd5-aa5f-402c71ec19c6] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:17.228516 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7e6210aa-e912-496d-946b-c8d3c17871db tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:17.229103 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7e6210aa-e912-496d-946b-c8d3c17871db tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:17.229547 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7e6210aa-e912-496d-946b-c8d3c17871db tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:17.230270 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7e6210aa-e912-496d-946b-c8d3c17871db tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:17.230738 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7e6210aa-e912-496d-946b-c8d3c17871db tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:17.231167 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7e6210aa-e912-496d-946b-c8d3c17871db tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:17.264832 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-30b2e474-801c-483b-83eb-1ef3a4847555 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:17.265519 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-30b2e474-801c-483b-83eb-1ef3a4847555 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] [instance: 7e37d5ca-7dc4-476e-803f-f61c6adfaeb4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:17.275599 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-30b2e474-801c-483b-83eb-1ef3a4847555 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:17.276369 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-30b2e474-801c-483b-83eb-1ef3a4847555 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:17.276867 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-30b2e474-801c-483b-83eb-1ef3a4847555 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:17.277936 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-30b2e474-801c-483b-83eb-1ef3a4847555 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:17.278171 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-30b2e474-801c-483b-83eb-1ef3a4847555 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:17.278673 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-30b2e474-801c-483b-83eb-1ef3a4847555 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:17.360139 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7e6210aa-e912-496d-946b-c8d3c17871db tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6/action" status: 202 len: 0 microversion: 2.1 time: 0.148860 Aug 31 16:00:17.364862 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 608/1202] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:00:17 2022] POST /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6/action => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:00:17.370497 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-bfb421ca-cc9c-4f0b-a041-7958ebdbc0ed tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:17.371112 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-bfb421ca-cc9c-4f0b-a041-7958ebdbc0ed tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] [instance: e45fa8b9-1545-4bd5-aa5f-402c71ec19c6] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:17.383236 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bfb421ca-cc9c-4f0b-a041-7958ebdbc0ed tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:17.383772 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bfb421ca-cc9c-4f0b-a041-7958ebdbc0ed tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:17.384409 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bfb421ca-cc9c-4f0b-a041-7958ebdbc0ed tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:17.384992 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-30b2e474-801c-483b-83eb-1ef3a4847555 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccce16c7fda401ea68fb31ea8099d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed252ebf7c741bbb36b553ac1767579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:17.385510 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bfb421ca-cc9c-4f0b-a041-7958ebdbc0ed tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:17.386121 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bfb421ca-cc9c-4f0b-a041-7958ebdbc0ed tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:17.386709 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bfb421ca-cc9c-4f0b-a041-7958ebdbc0ed tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:17.393538 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-30b2e474-801c-483b-83eb-1ef3a4847555 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "GET /compute/v2.1/servers/7e37d5ca-7dc4-476e-803f-f61c6adfaeb4" status: 200 len: 1277 microversion: 2.1 time: 0.132974 Aug 31 16:00:17.396477 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 595/1203] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:17 2022] GET /compute/v2.1/servers/7e37d5ca-7dc4-476e-803f-f61c6adfaeb4 => generated 1277 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:00:17.436076 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bfb421ca-cc9c-4f0b-a041-7958ebdbc0ed tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:17.437261 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bfb421ca-cc9c-4f0b-a041-7958ebdbc0ed tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:17.438856 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bfb421ca-cc9c-4f0b-a041-7958ebdbc0ed tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:17.439312 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-bfb421ca-cc9c-4f0b-a041-7958ebdbc0ed tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Lazy-loading 'fault' on Instance uuid e45fa8b9-1545-4bd5-aa5f-402c71ec19c6 {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:00:17.576953 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:00:17.583799 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-bfb421ca-cc9c-4f0b-a041-7958ebdbc0ed tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6" status: 200 len: 1598 microversion: 2.1 time: 0.216933 Aug 31 16:00:17.584759 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 609/1204] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:17 2022] GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6 => generated 1598 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:17.605944 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-95e462ef-fea6-4b32-9c98-301773ae26b2 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:00:17.608406 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-95e462ef-fea6-4b32-9c98-301773ae26b2 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] [instance: e45fa8b9-1545-4bd5-aa5f-402c71ec19c6] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:17.616327 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-95e462ef-fea6-4b32-9c98-301773ae26b2 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:17.616826 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-95e462ef-fea6-4b32-9c98-301773ae26b2 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:17.617276 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-95e462ef-fea6-4b32-9c98-301773ae26b2 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:17.617995 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-95e462ef-fea6-4b32-9c98-301773ae26b2 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:17.618509 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-95e462ef-fea6-4b32-9c98-301773ae26b2 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:17.618965 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-95e462ef-fea6-4b32-9c98-301773ae26b2 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:17.706610 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-37744539-511c-4249-bb17-13938af75b42 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:17.707224 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-37744539-511c-4249-bb17-13938af75b42 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] [instance: d5e69723-2d0e-46ef-8f76-82d64aad4772] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:17.717354 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-37744539-511c-4249-bb17-13938af75b42 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:17.724823 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-37744539-511c-4249-bb17-13938af75b42 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:17.725510 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-37744539-511c-4249-bb17-13938af75b42 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:17.726426 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-37744539-511c-4249-bb17-13938af75b42 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:17.727071 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-37744539-511c-4249-bb17-13938af75b42 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:17.727707 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-37744539-511c-4249-bb17-13938af75b42 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:17.768416 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:00:17.772353 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-95e462ef-fea6-4b32-9c98-301773ae26b2 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6/action" status: 202 len: 0 microversion: 2.1 time: 0.170173 Aug 31 16:00:17.773530 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 596/1205] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:00:17 2022] POST /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6/action => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 16:00:17.802185 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-453bd085-006e-4961-95cc-90de194a9fb6 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:17.803476 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-453bd085-006e-4961-95cc-90de194a9fb6 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] [instance: e45fa8b9-1545-4bd5-aa5f-402c71ec19c6] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:17.813739 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-453bd085-006e-4961-95cc-90de194a9fb6 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:17.814522 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-453bd085-006e-4961-95cc-90de194a9fb6 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:17.815172 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-453bd085-006e-4961-95cc-90de194a9fb6 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:17.816218 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-453bd085-006e-4961-95cc-90de194a9fb6 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:17.817466 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-453bd085-006e-4961-95cc-90de194a9fb6 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:17.818514 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-453bd085-006e-4961-95cc-90de194a9fb6 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:17.866170 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-37744539-511c-4249-bb17-13938af75b42 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377b1dedae45d2a804919e5ea69a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e5507d53224d19804717493d60bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:17.878340 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-37744539-511c-4249-bb17-13938af75b42 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] 10.222.0.61 "GET /compute/v2.1/servers/d5e69723-2d0e-46ef-8f76-82d64aad4772" status: 200 len: 1647 microversion: 2.1 time: 0.177343 Aug 31 16:00:17.880033 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 610/1206] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:17 2022] GET /compute/v2.1/servers/d5e69723-2d0e-46ef-8f76-82d64aad4772 => generated 1647 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:00:17.885894 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-bef023a7-7293-4be3-a500-fd3cf3324394 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:17.886649 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-bef023a7-7293-4be3-a500-fd3cf3324394 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:17.893104 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:00:17.896198 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bef023a7-7293-4be3-a500-fd3cf3324394 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:17.896944 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bef023a7-7293-4be3-a500-fd3cf3324394 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:17.897527 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bef023a7-7293-4be3-a500-fd3cf3324394 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:17.898247 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bef023a7-7293-4be3-a500-fd3cf3324394 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:17.898711 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bef023a7-7293-4be3-a500-fd3cf3324394 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:17.899149 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bef023a7-7293-4be3-a500-fd3cf3324394 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:18.187224 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:00:18.213963 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=6 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:00:18.371107 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-bef023a7-7293-4be3-a500-fd3cf3324394 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:18.393861 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-bef023a7-7293-4be3-a500-fd3cf3324394 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:18.397582 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-bef023a7-7293-4be3-a500-fd3cf3324394 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:18.408701 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-bef023a7-7293-4be3-a500-fd3cf3324394 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1539 microversion: 2.91 time: 0.526819 Aug 31 16:00:18.410770 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 611/1207] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:00:17 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1539 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:00:18.417090 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-cbd53721-1ecd-42b4-893f-c55c0684eeba tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:18.417907 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-cbd53721-1ecd-42b4-893f-c55c0684eeba tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: 5f29cff7-a675-40c2-a0e5-2a62994be45a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:18.427474 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cbd53721-1ecd-42b4-893f-c55c0684eeba tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:18.428182 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cbd53721-1ecd-42b4-893f-c55c0684eeba tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:18.428623 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cbd53721-1ecd-42b4-893f-c55c0684eeba tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:18.429358 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cbd53721-1ecd-42b4-893f-c55c0684eeba tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:18.429818 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cbd53721-1ecd-42b4-893f-c55c0684eeba tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:18.430419 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cbd53721-1ecd-42b4-893f-c55c0684eeba tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:18.525365 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-cbd53721-1ecd-42b4-893f-c55c0684eeba tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ccd03a4aa84f93bc26b438e1468f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a9f3fcc4b445349e5c66ff712e8598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:18.533993 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-cbd53721-1ecd-42b4-893f-c55c0684eeba tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/servers/5f29cff7-a675-40c2-a0e5-2a62994be45a" status: 200 len: 1266 microversion: 2.1 time: 0.121159 Aug 31 16:00:18.534898 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-453bd085-006e-4961-95cc-90de194a9fb6 tempest-ServersAdminTestJSON-503954359 tempest-ServersAdminTestJSON-503954359-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6" status: 200 len: 1615 microversion: 2.1 time: 0.747474 Aug 31 16:00:18.536460 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 597/1208] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:17 2022] GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6 => generated 1615 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:18.545919 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 612/1209] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:18 2022] GET /compute/v2.1/servers/5f29cff7-a675-40c2-a0e5-2a62994be45a => generated 1266 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:18.554733 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-156660da-df52-465d-9ae7-1d9284039c3b req-8bfcf2a3-9f73-435a-a6dc-43cae30028b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5e69723-2d0e-46ef-8f76-82d64aad4772", "name": "network-vif-deleted", "tag": "9c09b5b7-41ed-490a-80a2-32e8b4ce1304"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:00:18.558920 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-84f9fec1-0e71-46b1-bdef-850ba07dad78 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:18.559581 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-84f9fec1-0e71-46b1-bdef-850ba07dad78 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] [instance: 39a531e3-b13b-412f-a200-5141c32650be] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:18.567677 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-84f9fec1-0e71-46b1-bdef-850ba07dad78 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:18.568424 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-156660da-df52-465d-9ae7-1d9284039c3b req-8bfcf2a3-9f73-435a-a6dc-43cae30028b8 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:18.568668 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-84f9fec1-0e71-46b1-bdef-850ba07dad78 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:18.568902 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-156660da-df52-465d-9ae7-1d9284039c3b req-8bfcf2a3-9f73-435a-a6dc-43cae30028b8 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:18.569337 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-156660da-df52-465d-9ae7-1d9284039c3b req-8bfcf2a3-9f73-435a-a6dc-43cae30028b8 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:18.569682 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-84f9fec1-0e71-46b1-bdef-850ba07dad78 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:18.570559 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-84f9fec1-0e71-46b1-bdef-850ba07dad78 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:18.571262 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-84f9fec1-0e71-46b1-bdef-850ba07dad78 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:18.571887 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-84f9fec1-0e71-46b1-bdef-850ba07dad78 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:18.589513 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-156660da-df52-465d-9ae7-1d9284039c3b req-8bfcf2a3-9f73-435a-a6dc-43cae30028b8 service nova] Creating event network-vif-deleted:9c09b5b7-41ed-490a-80a2-32e8b4ce1304 for instance d5e69723-2d0e-46ef-8f76-82d64aad4772 on n-h1-850499-9 Aug 31 16:00:18.594612 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-156660da-df52-465d-9ae7-1d9284039c3b req-8bfcf2a3-9f73-435a-a6dc-43cae30028b8 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056738 Aug 31 16:00:18.595819 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 598/1210] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:00:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:00:18.603557 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b98f4d59-3ce2-443f-a6cc-9f02ab2f0e56 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:18.604459 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b98f4d59-3ce2-443f-a6cc-9f02ab2f0e56 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] [instance: 7e37d5ca-7dc4-476e-803f-f61c6adfaeb4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:18.617065 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b98f4d59-3ce2-443f-a6cc-9f02ab2f0e56 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:18.618394 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b98f4d59-3ce2-443f-a6cc-9f02ab2f0e56 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:18.620954 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b98f4d59-3ce2-443f-a6cc-9f02ab2f0e56 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:18.624109 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b98f4d59-3ce2-443f-a6cc-9f02ab2f0e56 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:18.624777 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b98f4d59-3ce2-443f-a6cc-9f02ab2f0e56 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:18.625398 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b98f4d59-3ce2-443f-a6cc-9f02ab2f0e56 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:18.780943 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b98f4d59-3ce2-443f-a6cc-9f02ab2f0e56 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccce16c7fda401ea68fb31ea8099d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed252ebf7c741bbb36b553ac1767579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:18.789299 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b98f4d59-3ce2-443f-a6cc-9f02ab2f0e56 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "GET /compute/v2.1/servers/7e37d5ca-7dc4-476e-803f-f61c6adfaeb4" status: 200 len: 1283 microversion: 2.1 time: 0.192134 Aug 31 16:00:18.789883 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 599/1211] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:18 2022] GET /compute/v2.1/servers/7e37d5ca-7dc4-476e-803f-f61c6adfaeb4 => generated 1283 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:18.813712 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-aa796172-94cb-417f-97d3-7cf1c2517468 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:18.814810 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-aa796172-94cb-417f-97d3-7cf1c2517468 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] [instance: 6c5b2996-bce3-4a39-88c7-2e300d06473e] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:18.821828 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aa796172-94cb-417f-97d3-7cf1c2517468 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:18.822337 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aa796172-94cb-417f-97d3-7cf1c2517468 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:18.822774 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aa796172-94cb-417f-97d3-7cf1c2517468 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:18.823484 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aa796172-94cb-417f-97d3-7cf1c2517468 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:18.823993 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aa796172-94cb-417f-97d3-7cf1c2517468 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:18.824598 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aa796172-94cb-417f-97d3-7cf1c2517468 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:18.851116 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-aa796172-94cb-417f-97d3-7cf1c2517468 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] [instance: 6c5b2996-bce3-4a39-88c7-2e300d06473e] Going to try to terminate instance {{(pid=122256) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:00:18.962134 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-84f9fec1-0e71-46b1-bdef-850ba07dad78 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb054cb62b9945a78e6bb60cd613acae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f780d0079345519eea40fe8a3fd813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:18.980502 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-84f9fec1-0e71-46b1-bdef-850ba07dad78 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] 10.222.0.61 "GET /compute/v2.1/servers/39a531e3-b13b-412f-a200-5141c32650be" status: 200 len: 1371 microversion: 2.1 time: 0.433311 Aug 31 16:00:18.995885 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 613/1212] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:18 2022] GET /compute/v2.1/servers/39a531e3-b13b-412f-a200-5141c32650be => generated 1371 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:19.001539 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-aa796172-94cb-417f-97d3-7cf1c2517468 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] 10.222.0.61 "DELETE /compute/v2.1/servers/6c5b2996-bce3-4a39-88c7-2e300d06473e" status: 204 len: 0 microversion: 2.1 time: 0.210113 Aug 31 16:00:19.002152 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 600/1213] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:00:18 2022] DELETE /compute/v2.1/servers/6c5b2996-bce3-4a39-88c7-2e300d06473e => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:00:19.008633 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c3314651-87c7-48f1-9aef-52691e48173a tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:19.009343 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c3314651-87c7-48f1-9aef-52691e48173a tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] [instance: d5e69723-2d0e-46ef-8f76-82d64aad4772] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:19.012887 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b917b9f6-7a95-4871-8a04-efda4a900c74 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:19.013602 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b917b9f6-7a95-4871-8a04-efda4a900c74 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] [instance: 6c5b2996-bce3-4a39-88c7-2e300d06473e] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:19.015606 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c3314651-87c7-48f1-9aef-52691e48173a tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:19.016115 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c3314651-87c7-48f1-9aef-52691e48173a tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:19.016554 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c3314651-87c7-48f1-9aef-52691e48173a tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:19.017925 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c3314651-87c7-48f1-9aef-52691e48173a tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:19.018410 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c3314651-87c7-48f1-9aef-52691e48173a tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:19.018842 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c3314651-87c7-48f1-9aef-52691e48173a tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:19.019753 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b917b9f6-7a95-4871-8a04-efda4a900c74 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:19.020894 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b917b9f6-7a95-4871-8a04-efda4a900c74 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:19.021340 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b917b9f6-7a95-4871-8a04-efda4a900c74 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:19.022194 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b917b9f6-7a95-4871-8a04-efda4a900c74 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:19.022651 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b917b9f6-7a95-4871-8a04-efda4a900c74 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:19.023082 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b917b9f6-7a95-4871-8a04-efda4a900c74 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:19.061569 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c3314651-87c7-48f1-9aef-52691e48173a tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:19.062611 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c3314651-87c7-48f1-9aef-52691e48173a tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:19.062611 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c3314651-87c7-48f1-9aef-52691e48173a tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:19.062935 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-c3314651-87c7-48f1-9aef-52691e48173a tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lazy-loading 'fault' on Instance uuid d5e69723-2d0e-46ef-8f76-82d64aad4772 {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:00:19.157343 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c3314651-87c7-48f1-9aef-52691e48173a tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa377b1dedae45d2a804919e5ea69a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6e5507d53224d19804717493d60bb71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:19.170195 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c3314651-87c7-48f1-9aef-52691e48173a tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] 10.222.0.61 "GET /compute/v2.1/servers/d5e69723-2d0e-46ef-8f76-82d64aad4772" status: 200 len: 1355 microversion: 2.1 time: 0.171072 Aug 31 16:00:19.183668 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 614/1214] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:18 2022] GET /compute/v2.1/servers/d5e69723-2d0e-46ef-8f76-82d64aad4772 => generated 1355 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:19.420603 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b917b9f6-7a95-4871-8a04-efda4a900c74 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a03cc5956ca477abacbe0c26bf18750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea45d1b678342ed812f9912e9f07503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:19.430084 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b917b9f6-7a95-4871-8a04-efda4a900c74 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] 10.222.0.61 "GET /compute/v2.1/servers/6c5b2996-bce3-4a39-88c7-2e300d06473e" status: 200 len: 1469 microversion: 2.1 time: 0.421323 Aug 31 16:00:19.430920 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 601/1215] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:19 2022] GET /compute/v2.1/servers/6c5b2996-bce3-4a39-88c7-2e300d06473e => generated 1469 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:19.439083 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a2fcc433-897e-421d-abfc-fcdc13b08722 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:19.439805 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a2fcc433-897e-421d-abfc-fcdc13b08722 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:19.449908 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a2fcc433-897e-421d-abfc-fcdc13b08722 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:19.450925 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a2fcc433-897e-421d-abfc-fcdc13b08722 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:19.451378 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a2fcc433-897e-421d-abfc-fcdc13b08722 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:19.454100 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a2fcc433-897e-421d-abfc-fcdc13b08722 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:19.454804 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a2fcc433-897e-421d-abfc-fcdc13b08722 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:19.455447 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a2fcc433-897e-421d-abfc-fcdc13b08722 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:19.558547 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a2fcc433-897e-421d-abfc-fcdc13b08722 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:19.563251 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5c358a74-9646-49c7-b1c6-208c2a9c7e7b tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:19.564216 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5c358a74-9646-49c7-b1c6-208c2a9c7e7b tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: 5f29cff7-a675-40c2-a0e5-2a62994be45a] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:19.571425 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5c358a74-9646-49c7-b1c6-208c2a9c7e7b tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:19.572159 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a2fcc433-897e-421d-abfc-fcdc13b08722 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:19.572348 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5c358a74-9646-49c7-b1c6-208c2a9c7e7b tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:19.573631 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a2fcc433-897e-421d-abfc-fcdc13b08722 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:19.573767 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5c358a74-9646-49c7-b1c6-208c2a9c7e7b tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:19.574600 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5c358a74-9646-49c7-b1c6-208c2a9c7e7b tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:19.576013 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5c358a74-9646-49c7-b1c6-208c2a9c7e7b tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:19.576717 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5c358a74-9646-49c7-b1c6-208c2a9c7e7b tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:19.579324 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a2fcc433-897e-421d-abfc-fcdc13b08722 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1539 microversion: 2.91 time: 0.144840 Aug 31 16:00:19.579944 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 615/1216] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:00:19 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1539 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:00:19.708176 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5c358a74-9646-49c7-b1c6-208c2a9c7e7b tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ccd03a4aa84f93bc26b438e1468f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a9f3fcc4b445349e5c66ff712e8598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:19.717018 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5c358a74-9646-49c7-b1c6-208c2a9c7e7b tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/servers/5f29cff7-a675-40c2-a0e5-2a62994be45a" status: 200 len: 1266 microversion: 2.1 time: 0.160666 Aug 31 16:00:19.717956 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 602/1217] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:19 2022] GET /compute/v2.1/servers/5f29cff7-a675-40c2-a0e5-2a62994be45a => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:00:19.812904 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e7fa38f4-8174-4eb8-8ac4-3ebb003f4f2e tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:19.813887 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e7fa38f4-8174-4eb8-8ac4-3ebb003f4f2e tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] [instance: 7e37d5ca-7dc4-476e-803f-f61c6adfaeb4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:19.823755 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e7fa38f4-8174-4eb8-8ac4-3ebb003f4f2e tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:19.824468 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e7fa38f4-8174-4eb8-8ac4-3ebb003f4f2e tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:19.825099 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e7fa38f4-8174-4eb8-8ac4-3ebb003f4f2e tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:19.826002 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e7fa38f4-8174-4eb8-8ac4-3ebb003f4f2e tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:19.826739 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e7fa38f4-8174-4eb8-8ac4-3ebb003f4f2e tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:19.827378 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e7fa38f4-8174-4eb8-8ac4-3ebb003f4f2e tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:20.011694 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4f5f2124-c9f6-4d67-9143-63a048ca7ea2 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:20.012321 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4f5f2124-c9f6-4d67-9143-63a048ca7ea2 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] [instance: 39a531e3-b13b-412f-a200-5141c32650be] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:20.020204 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4f5f2124-c9f6-4d67-9143-63a048ca7ea2 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:20.022439 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4f5f2124-c9f6-4d67-9143-63a048ca7ea2 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:20.022705 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4f5f2124-c9f6-4d67-9143-63a048ca7ea2 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:20.023449 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4f5f2124-c9f6-4d67-9143-63a048ca7ea2 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:20.023935 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4f5f2124-c9f6-4d67-9143-63a048ca7ea2 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:20.025639 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4f5f2124-c9f6-4d67-9143-63a048ca7ea2 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:20.199701 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e7fa38f4-8174-4eb8-8ac4-3ebb003f4f2e tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccce16c7fda401ea68fb31ea8099d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed252ebf7c741bbb36b553ac1767579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:20.208504 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e7fa38f4-8174-4eb8-8ac4-3ebb003f4f2e tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "GET /compute/v2.1/servers/7e37d5ca-7dc4-476e-803f-f61c6adfaeb4" status: 200 len: 1325 microversion: 2.1 time: 0.399410 Aug 31 16:00:20.222210 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 616/1218] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:19 2022] GET /compute/v2.1/servers/7e37d5ca-7dc4-476e-803f-f61c6adfaeb4 => generated 1325 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:20.231763 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8e1aefcf-8a6e-4e99-b9e8-9d8ccf98b946 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:20.232405 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8e1aefcf-8a6e-4e99-b9e8-9d8ccf98b946 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] [instance: d5e69723-2d0e-46ef-8f76-82d64aad4772] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:20.241186 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8e1aefcf-8a6e-4e99-b9e8-9d8ccf98b946 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:20.242006 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8e1aefcf-8a6e-4e99-b9e8-9d8ccf98b946 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:20.245553 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8e1aefcf-8a6e-4e99-b9e8-9d8ccf98b946 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:20.246543 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8e1aefcf-8a6e-4e99-b9e8-9d8ccf98b946 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:20.247465 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8e1aefcf-8a6e-4e99-b9e8-9d8ccf98b946 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:20.248130 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8e1aefcf-8a6e-4e99-b9e8-9d8ccf98b946 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:20.265773 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-8e1aefcf-8a6e-4e99-b9e8-9d8ccf98b946 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] HTTP exception thrown: Instance d5e69723-2d0e-46ef-8f76-82d64aad4772 could not be found. Aug 31 16:00:20.267724 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8e1aefcf-8a6e-4e99-b9e8-9d8ccf98b946 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Request method failure captured: Aug 31 16:00:20.267724 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/d5e69723-2d0e-46ef-8f76-82d64aad4772 HTTP/1.1 Aug 31 16:00:20.267724 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:00:20.267724 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:00:20.267724 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:00:20.267724 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:00:20.267724 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:00:20.267724 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:00:20.267724 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:00:20.267724 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:00:20.267724 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4SGAKMtvO8_n5d3BpzudxLSLw_koEApBHE4XBXYfJzgqUgn1vq2Dg0jiZsTgOO8SkRFB_Yv7AEMrBQtyv4E8fd1Rvtb8tqm0Jn47lt4OUsg4WuSYU_qqCdwySsdW48kOJXziEQbPhg3-gdZiIKxyr0NjqaPND8wy52vdljk2iA2Z0Y Aug 31 16:00:20.267724 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:00:20.267724 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:00:20.267724 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:00:20.267724 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:00:20.267724 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:00:20.267724 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:00:20.267724 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: f6e5507d53224d19804717493d60bb71 Aug 31 16:00:20.267724 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-499642415 Aug 31 16:00:20.267724 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:00:20.267724 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:00:20.269123 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f6e5507d53224d19804717493d60bb71"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f6e5507d53224d19804717493d60bb71"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f6e5507d53224d19804717493d60bb71", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f6e5507d53224d19804717493d60bb71"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:00:20.269123 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-499642415 Aug 31 16:00:20.269123 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: f6e5507d53224d19804717493d60bb71 Aug 31 16:00:20.269123 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-499642415 Aug 31 16:00:20.269123 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ServersWithSpecificFlavorTestJSON-499642415-project Aug 31 16:00:20.269123 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:00:20.269123 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:00:20.269123 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: fa377b1dedae45d2a804919e5ea69a00 Aug 31 16:00:20.269123 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-499642415-project Aug 31 16:00:20.269123 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:00:20.269123 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance d5e69723-2d0e-46ef-8f76-82d64aad4772 could not be found. Aug 31 16:00:20.269123 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': 'd5e69723-2d0e-46ef-8f76-82d64aad4772'} Aug 31 16:00:20.269984 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:00:20.269984 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:20.269984 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:00:20.269984 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:00:20.269984 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:00:20.269984 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:00:20.269984 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:00:20.269984 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:00:20.269984 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:00:20.269984 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:00:20.269984 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5e69723-2d0e-46ef-8f76-82d64aad4772 could not be found. Aug 31 16:00:20.269984 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:00:20.269984 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:20.269984 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:00:20.269984 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:20.269984 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:20.269984 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:20.269984 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:00:20.269984 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:00:20.269984 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:00:20.271177 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:00:20.271177 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:00:20.271177 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:00:20.271177 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:00:20.271177 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:00:20.271177 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:00:20.271177 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:00:20.271177 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5e69723-2d0e-46ef-8f76-82d64aad4772 could not be found. Aug 31 16:00:20.271177 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:00:20.271177 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:20.271177 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:00:20.271177 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:20.271177 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:20.271177 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:20.271177 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:00:20.271177 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:00:20.271177 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5e69723-2d0e-46ef-8f76-82d64aad4772 could not be found. Aug 31 16:00:20.271177 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:00:20.273791 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8e1aefcf-8a6e-4e99-b9e8-9d8ccf98b946 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Returning 404 to user: Instance d5e69723-2d0e-46ef-8f76-82d64aad4772 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:00:20.274861 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8e1aefcf-8a6e-4e99-b9e8-9d8ccf98b946 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] 10.222.0.61 "GET /compute/v2.1/servers/d5e69723-2d0e-46ef-8f76-82d64aad4772" status: 404 len: 111 microversion: 2.1 time: 0.051229 Aug 31 16:00:20.276023 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 617/1219] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:20 2022] GET /compute/v2.1/servers/d5e69723-2d0e-46ef-8f76-82d64aad4772 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:00:20.283730 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4218fec9-46f1-4c0e-addd-c0134cc4c411 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:20.284526 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4218fec9-46f1-4c0e-addd-c0134cc4c411 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] [instance: 3a0126e3-2324-4892-8908-2b6d2d5e2158] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:20.291985 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4218fec9-46f1-4c0e-addd-c0134cc4c411 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:20.292489 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4218fec9-46f1-4c0e-addd-c0134cc4c411 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:20.292935 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4218fec9-46f1-4c0e-addd-c0134cc4c411 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:20.293677 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4218fec9-46f1-4c0e-addd-c0134cc4c411 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:20.294145 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4218fec9-46f1-4c0e-addd-c0134cc4c411 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:20.294581 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4218fec9-46f1-4c0e-addd-c0134cc4c411 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:20.310179 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-4218fec9-46f1-4c0e-addd-c0134cc4c411 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] HTTP exception thrown: Instance 3a0126e3-2324-4892-8908-2b6d2d5e2158 could not be found. Aug 31 16:00:20.311795 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4218fec9-46f1-4c0e-addd-c0134cc4c411 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Request method failure captured: Aug 31 16:00:20.311795 n-d-850499-9 devstack@n-api.service[122257]: request: DELETE /compute/v2.1/servers/3a0126e3-2324-4892-8908-2b6d2d5e2158 HTTP/1.1 Aug 31 16:00:20.311795 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:00:20.311795 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:00:20.311795 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:00:20.311795 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:00:20.311795 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:00:20.311795 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:00:20.311795 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:00:20.311795 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:00:20.311795 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4SGAKMtvO8_n5d3BpzudxLSLw_koEApBHE4XBXYfJzgqUgn1vq2Dg0jiZsTgOO8SkRFB_Yv7AEMrBQtyv4E8fd1Rvtb8tqm0Jn47lt4OUsg4WuSYU_qqCdwySsdW48kOJXziEQbPhg3-gdZiIKxyr0NjqaPND8wy52vdljk2iA2Z0Y Aug 31 16:00:20.311795 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:00:20.311795 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:00:20.311795 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:00:20.311795 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:00:20.311795 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:00:20.311795 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:00:20.311795 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: f6e5507d53224d19804717493d60bb71 Aug 31 16:00:20.311795 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-499642415 Aug 31 16:00:20.311795 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:00:20.311795 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:00:20.313121 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f6e5507d53224d19804717493d60bb71"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f6e5507d53224d19804717493d60bb71"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f6e5507d53224d19804717493d60bb71", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f6e5507d53224d19804717493d60bb71"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:00:20.313121 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-499642415 Aug 31 16:00:20.313121 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: f6e5507d53224d19804717493d60bb71 Aug 31 16:00:20.313121 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-499642415 Aug 31 16:00:20.313121 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ServersWithSpecificFlavorTestJSON-499642415-project Aug 31 16:00:20.313121 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:00:20.313121 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:00:20.313121 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: fa377b1dedae45d2a804919e5ea69a00 Aug 31 16:00:20.313121 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-499642415-project Aug 31 16:00:20.313121 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:00:20.313121 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance 3a0126e3-2324-4892-8908-2b6d2d5e2158 could not be found. Aug 31 16:00:20.313121 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '3a0126e3-2324-4892-8908-2b6d2d5e2158'} Aug 31 16:00:20.313825 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:00:20.313825 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:20.313825 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:00:20.313825 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:00:20.313825 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:00:20.313825 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:00:20.313825 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:00:20.313825 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:00:20.313825 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:00:20.313825 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:00:20.313825 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a0126e3-2324-4892-8908-2b6d2d5e2158 could not be found. Aug 31 16:00:20.313825 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:00:20.313825 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:20.313825 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:00:20.313825 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:20.313825 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:20.313825 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:20.313825 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:00:20.313825 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:00:20.313825 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:00:20.315035 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:00:20.315035 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:00:20.315035 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:00:20.315035 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:00:20.315035 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:00:20.315035 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:00:20.315035 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:00:20.315035 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:00:20.315035 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:00:20.315035 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a0126e3-2324-4892-8908-2b6d2d5e2158 could not be found. Aug 31 16:00:20.315035 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:00:20.315035 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:20.315035 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:00:20.315035 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:20.315035 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:20.315035 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:20.315035 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:00:20.315035 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:00:20.315035 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a0126e3-2324-4892-8908-2b6d2d5e2158 could not be found. Aug 31 16:00:20.315035 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:00:20.316359 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4218fec9-46f1-4c0e-addd-c0134cc4c411 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Returning 404 to user: Instance 3a0126e3-2324-4892-8908-2b6d2d5e2158 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:00:20.316359 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4218fec9-46f1-4c0e-addd-c0134cc4c411 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] 10.222.0.61 "DELETE /compute/v2.1/servers/3a0126e3-2324-4892-8908-2b6d2d5e2158" status: 404 len: 111 microversion: 2.1 time: 0.033219 Aug 31 16:00:20.317976 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 618/1220] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:00:20 2022] DELETE /compute/v2.1/servers/3a0126e3-2324-4892-8908-2b6d2d5e2158 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:00:20.322985 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a2961f5f-3ddc-48c1-b115-ff46c4238f9a tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:20.323839 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a2961f5f-3ddc-48c1-b115-ff46c4238f9a tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] [instance: 3a0126e3-2324-4892-8908-2b6d2d5e2158] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:20.330393 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a2961f5f-3ddc-48c1-b115-ff46c4238f9a tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:20.331130 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a2961f5f-3ddc-48c1-b115-ff46c4238f9a tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:20.331786 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a2961f5f-3ddc-48c1-b115-ff46c4238f9a tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:20.332910 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a2961f5f-3ddc-48c1-b115-ff46c4238f9a tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:20.333543 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a2961f5f-3ddc-48c1-b115-ff46c4238f9a tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:20.334170 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a2961f5f-3ddc-48c1-b115-ff46c4238f9a tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:20.357777 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-a2961f5f-3ddc-48c1-b115-ff46c4238f9a tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] HTTP exception thrown: Instance 3a0126e3-2324-4892-8908-2b6d2d5e2158 could not be found. Aug 31 16:00:20.359938 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a2961f5f-3ddc-48c1-b115-ff46c4238f9a tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Request method failure captured: Aug 31 16:00:20.359938 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/3a0126e3-2324-4892-8908-2b6d2d5e2158 HTTP/1.1 Aug 31 16:00:20.359938 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:00:20.359938 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:00:20.359938 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:00:20.359938 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:00:20.359938 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:00:20.359938 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:00:20.359938 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:00:20.359938 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:00:20.359938 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4SGAKMtvO8_n5d3BpzudxLSLw_koEApBHE4XBXYfJzgqUgn1vq2Dg0jiZsTgOO8SkRFB_Yv7AEMrBQtyv4E8fd1Rvtb8tqm0Jn47lt4OUsg4WuSYU_qqCdwySsdW48kOJXziEQbPhg3-gdZiIKxyr0NjqaPND8wy52vdljk2iA2Z0Y Aug 31 16:00:20.359938 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:00:20.359938 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:00:20.359938 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:00:20.359938 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:00:20.359938 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:00:20.359938 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:00:20.359938 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: f6e5507d53224d19804717493d60bb71 Aug 31 16:00:20.359938 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-499642415 Aug 31 16:00:20.359938 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:00:20.359938 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:00:20.361354 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f6e5507d53224d19804717493d60bb71"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f6e5507d53224d19804717493d60bb71"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f6e5507d53224d19804717493d60bb71", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f6e5507d53224d19804717493d60bb71"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:00:20.361354 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-499642415 Aug 31 16:00:20.361354 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: f6e5507d53224d19804717493d60bb71 Aug 31 16:00:20.361354 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-499642415 Aug 31 16:00:20.361354 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ServersWithSpecificFlavorTestJSON-499642415-project Aug 31 16:00:20.361354 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:00:20.361354 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:00:20.361354 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: fa377b1dedae45d2a804919e5ea69a00 Aug 31 16:00:20.361354 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-499642415-project Aug 31 16:00:20.361354 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:00:20.361354 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance 3a0126e3-2324-4892-8908-2b6d2d5e2158 could not be found. Aug 31 16:00:20.361354 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '3a0126e3-2324-4892-8908-2b6d2d5e2158'} Aug 31 16:00:20.362059 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:00:20.362059 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:20.362059 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:00:20.362059 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:00:20.362059 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:00:20.362059 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:00:20.362059 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:00:20.362059 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:00:20.362059 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:00:20.362059 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:00:20.362059 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a0126e3-2324-4892-8908-2b6d2d5e2158 could not be found. Aug 31 16:00:20.362059 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:00:20.362059 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:20.362059 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:00:20.362059 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:20.362059 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:20.362059 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:20.362059 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:00:20.362059 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:00:20.362059 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:00:20.363210 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:00:20.363210 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:00:20.363210 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:00:20.363210 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:00:20.363210 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:00:20.363210 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:00:20.363210 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:00:20.363210 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a0126e3-2324-4892-8908-2b6d2d5e2158 could not be found. Aug 31 16:00:20.363210 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:00:20.363210 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:20.363210 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:00:20.363210 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:20.363210 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:20.363210 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:20.363210 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:00:20.363210 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:00:20.363210 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a0126e3-2324-4892-8908-2b6d2d5e2158 could not be found. Aug 31 16:00:20.363210 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:00:20.365567 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a2961f5f-3ddc-48c1-b115-ff46c4238f9a tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Returning 404 to user: Instance 3a0126e3-2324-4892-8908-2b6d2d5e2158 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:00:20.366770 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a2961f5f-3ddc-48c1-b115-ff46c4238f9a tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] 10.222.0.61 "GET /compute/v2.1/servers/3a0126e3-2324-4892-8908-2b6d2d5e2158" status: 404 len: 111 microversion: 2.1 time: 0.047373 Aug 31 16:00:20.372367 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 619/1221] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:20 2022] GET /compute/v2.1/servers/3a0126e3-2324-4892-8908-2b6d2d5e2158 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:00:20.377523 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-955eb765-bcc4-4d72-8da7-8b4a79a49356 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Calling method '.version_select at 0x7f5ae8cecdc0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:20.400558 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-955eb765-bcc4-4d72-8da7-8b4a79a49356 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1481695302" status: 202 len: 0 microversion: 2.1 time: 0.026901 Aug 31 16:00:20.402480 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 620/1222] 10.222.0.61 () {58 vars in 1221 bytes} [Wed Aug 31 16:00:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1481695302 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 16:00:20.452434 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-16b4b2f2-d0be-4b79-96a9-b82869229939 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:20.453081 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-16b4b2f2-d0be-4b79-96a9-b82869229939 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] [instance: 6c5b2996-bce3-4a39-88c7-2e300d06473e] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:20.462777 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-16b4b2f2-d0be-4b79-96a9-b82869229939 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:20.463647 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-16b4b2f2-d0be-4b79-96a9-b82869229939 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:20.464371 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-16b4b2f2-d0be-4b79-96a9-b82869229939 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:20.465326 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-16b4b2f2-d0be-4b79-96a9-b82869229939 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:20.466009 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-16b4b2f2-d0be-4b79-96a9-b82869229939 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:20.466759 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-16b4b2f2-d0be-4b79-96a9-b82869229939 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:20.484657 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-4f5f2124-c9f6-4d67-9143-63a048ca7ea2 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb054cb62b9945a78e6bb60cd613acae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f780d0079345519eea40fe8a3fd813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:20.493428 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4f5f2124-c9f6-4d67-9143-63a048ca7ea2 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] 10.222.0.61 "GET /compute/v2.1/servers/39a531e3-b13b-412f-a200-5141c32650be" status: 200 len: 1371 microversion: 2.1 time: 0.486145 Aug 31 16:00:20.506891 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 603/1223] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:20 2022] GET /compute/v2.1/servers/39a531e3-b13b-412f-a200-5141c32650be => generated 1371 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:00:20.611564 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3fda29dd-9f11-4cba-8bba-bce7b0d33ae9 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:20.613126 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3fda29dd-9f11-4cba-8bba-bce7b0d33ae9 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:20.622776 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3fda29dd-9f11-4cba-8bba-bce7b0d33ae9 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:20.623806 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3fda29dd-9f11-4cba-8bba-bce7b0d33ae9 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:20.624571 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3fda29dd-9f11-4cba-8bba-bce7b0d33ae9 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:20.630200 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3fda29dd-9f11-4cba-8bba-bce7b0d33ae9 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:20.631309 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3fda29dd-9f11-4cba-8bba-bce7b0d33ae9 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:20.632022 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3fda29dd-9f11-4cba-8bba-bce7b0d33ae9 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:20.759339 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3fda29dd-9f11-4cba-8bba-bce7b0d33ae9 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:20.771700 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3fda29dd-9f11-4cba-8bba-bce7b0d33ae9 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:20.773907 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3fda29dd-9f11-4cba-8bba-bce7b0d33ae9 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:20.795255 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3fda29dd-9f11-4cba-8bba-bce7b0d33ae9 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1539 microversion: 2.91 time: 0.191112 Aug 31 16:00:20.808503 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 604/1224] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:00:20 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1539 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:00:20.825624 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f380913a-928b-4538-9e8b-3beb0dea1ed1 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:20.826564 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f380913a-928b-4538-9e8b-3beb0dea1ed1 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: 5f29cff7-a675-40c2-a0e5-2a62994be45a] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:20.836300 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f380913a-928b-4538-9e8b-3beb0dea1ed1 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:20.837101 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f380913a-928b-4538-9e8b-3beb0dea1ed1 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:20.837717 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f380913a-928b-4538-9e8b-3beb0dea1ed1 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:20.839177 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f380913a-928b-4538-9e8b-3beb0dea1ed1 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:20.839832 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f380913a-928b-4538-9e8b-3beb0dea1ed1 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:20.840422 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f380913a-928b-4538-9e8b-3beb0dea1ed1 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:20.881840 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-16b4b2f2-d0be-4b79-96a9-b82869229939 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a03cc5956ca477abacbe0c26bf18750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea45d1b678342ed812f9912e9f07503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:20.894750 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-16b4b2f2-d0be-4b79-96a9-b82869229939 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] 10.222.0.61 "GET /compute/v2.1/servers/6c5b2996-bce3-4a39-88c7-2e300d06473e" status: 200 len: 1469 microversion: 2.1 time: 0.446530 Aug 31 16:00:20.897106 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 621/1225] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:20 2022] GET /compute/v2.1/servers/6c5b2996-bce3-4a39-88c7-2e300d06473e => generated 1469 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:21.229557 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-736068e5-76f9-491a-86dc-085b9a9d92a2 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:21.230809 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-736068e5-76f9-491a-86dc-085b9a9d92a2 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] [instance: 7e37d5ca-7dc4-476e-803f-f61c6adfaeb4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:21.242924 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-736068e5-76f9-491a-86dc-085b9a9d92a2 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:21.243716 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-736068e5-76f9-491a-86dc-085b9a9d92a2 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:21.244365 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-736068e5-76f9-491a-86dc-085b9a9d92a2 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:21.245271 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-736068e5-76f9-491a-86dc-085b9a9d92a2 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:21.245906 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-736068e5-76f9-491a-86dc-085b9a9d92a2 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:21.251579 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-736068e5-76f9-491a-86dc-085b9a9d92a2 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:21.340491 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f380913a-928b-4538-9e8b-3beb0dea1ed1 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ccd03a4aa84f93bc26b438e1468f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a9f3fcc4b445349e5c66ff712e8598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:21.362707 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f380913a-928b-4538-9e8b-3beb0dea1ed1 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/servers/5f29cff7-a675-40c2-a0e5-2a62994be45a" status: 200 len: 1308 microversion: 2.1 time: 0.550926 Aug 31 16:00:21.365653 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 605/1226] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:20 2022] GET /compute/v2.1/servers/5f29cff7-a675-40c2-a0e5-2a62994be45a => generated 1308 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:21.393265 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-ff1aff6e-3a31-473f-8793-c186f0f7f819 req-477a0c28-eb55-4275-a3e1-eae0030740a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39a531e3-b13b-412f-a200-5141c32650be", "name": "network-vif-plugged", "status": "completed", "tag": "d0c9a73e-dff5-4b26-80b7-1f09c0c3efcc"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:00:21.420531 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-ff1aff6e-3a31-473f-8793-c186f0f7f819 req-477a0c28-eb55-4275-a3e1-eae0030740a2 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:21.420901 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-ff1aff6e-3a31-473f-8793-c186f0f7f819 req-477a0c28-eb55-4275-a3e1-eae0030740a2 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:21.421339 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-ff1aff6e-3a31-473f-8793-c186f0f7f819 req-477a0c28-eb55-4275-a3e1-eae0030740a2 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:21.438636 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-ff1aff6e-3a31-473f-8793-c186f0f7f819 req-477a0c28-eb55-4275-a3e1-eae0030740a2 service nova] Creating event network-vif-plugged:d0c9a73e-dff5-4b26-80b7-1f09c0c3efcc for instance 39a531e3-b13b-412f-a200-5141c32650be on n-h1-850499-9 Aug 31 16:00:21.447175 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-ff1aff6e-3a31-473f-8793-c186f0f7f819 req-477a0c28-eb55-4275-a3e1-eae0030740a2 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056412 Aug 31 16:00:21.448326 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 606/1227] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:00:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:00:21.468603 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:00:21.532704 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e258b47a-fb57-4228-8ecd-328a26a7f0ed tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:21.533827 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e258b47a-fb57-4228-8ecd-328a26a7f0ed tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] [instance: 39a531e3-b13b-412f-a200-5141c32650be] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:21.559473 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e258b47a-fb57-4228-8ecd-328a26a7f0ed tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:21.559473 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e258b47a-fb57-4228-8ecd-328a26a7f0ed tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:21.559473 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e258b47a-fb57-4228-8ecd-328a26a7f0ed tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:21.561320 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e258b47a-fb57-4228-8ecd-328a26a7f0ed tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:21.562290 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e258b47a-fb57-4228-8ecd-328a26a7f0ed tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:21.562799 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e258b47a-fb57-4228-8ecd-328a26a7f0ed tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:21.654839 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=10 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:00:21.845749 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-736068e5-76f9-491a-86dc-085b9a9d92a2 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccce16c7fda401ea68fb31ea8099d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed252ebf7c741bbb36b553ac1767579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:21.853788 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-736068e5-76f9-491a-86dc-085b9a9d92a2 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "GET /compute/v2.1/servers/7e37d5ca-7dc4-476e-803f-f61c6adfaeb4" status: 200 len: 1325 microversion: 2.1 time: 0.628047 Aug 31 16:00:21.854374 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 622/1228] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:21 2022] GET /compute/v2.1/servers/7e37d5ca-7dc4-476e-803f-f61c6adfaeb4 => generated 1325 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:00:21.858788 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e9b350ec-06b1-4922-b6c6-df8bf1a0e264 tempest-ServersWithSpecificFlavorTestJSON-1517669509 tempest-ServersWithSpecificFlavorTestJSON-1517669509-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:21.878680 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e9b350ec-06b1-4922-b6c6-df8bf1a0e264 tempest-ServersWithSpecificFlavorTestJSON-1517669509 tempest-ServersWithSpecificFlavorTestJSON-1517669509-project-admin] 10.222.0.61 "DELETE /compute/v2.1/flavors/212044327" status: 202 len: 0 microversion: 2.1 time: 0.023114 Aug 31 16:00:21.879195 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 623/1229] 10.222.0.61 () {58 vars in 1158 bytes} [Wed Aug 31 16:00:21 2022] DELETE /compute/v2.1/flavors/212044327 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:00:21.885114 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-23255adf-ca50-4895-b038-7d03e45d7e0f tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:21.885738 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-23255adf-ca50-4895-b038-7d03e45d7e0f tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:21.891743 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-23255adf-ca50-4895-b038-7d03e45d7e0f tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:21.892243 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-23255adf-ca50-4895-b038-7d03e45d7e0f tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:21.892715 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-23255adf-ca50-4895-b038-7d03e45d7e0f tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:21.893430 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-23255adf-ca50-4895-b038-7d03e45d7e0f tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:21.893894 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-23255adf-ca50-4895-b038-7d03e45d7e0f tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:21.894328 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-23255adf-ca50-4895-b038-7d03e45d7e0f tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:22.051868 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-23255adf-ca50-4895-b038-7d03e45d7e0f tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:22.060980 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-23255adf-ca50-4895-b038-7d03e45d7e0f tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:22.062506 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-23255adf-ca50-4895-b038-7d03e45d7e0f tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:22.068856 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-23255adf-ca50-4895-b038-7d03e45d7e0f tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1539 microversion: 2.91 time: 0.187866 Aug 31 16:00:22.069455 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 624/1230] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:00:21 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1539 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:00:22.073980 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6eb841fc-f88d-48d3-9821-2f2c59f1bddc tempest-ServersWithSpecificFlavorTestJSON-1517669509 tempest-ServersWithSpecificFlavorTestJSON-1517669509-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:22.090767 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e258b47a-fb57-4228-8ecd-328a26a7f0ed tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb054cb62b9945a78e6bb60cd613acae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f780d0079345519eea40fe8a3fd813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:22.095791 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6eb841fc-f88d-48d3-9821-2f2c59f1bddc tempest-ServersWithSpecificFlavorTestJSON-1517669509 tempest-ServersWithSpecificFlavorTestJSON-1517669509-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 5406 microversion: 2.1 time: 0.025239 Aug 31 16:00:22.096620 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 625/1231] 10.222.0.61 () {58 vars in 1146 bytes} [Wed Aug 31 16:00:22 2022] GET /compute/v2.1/flavors/detail => generated 5406 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:22.100648 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e258b47a-fb57-4228-8ecd-328a26a7f0ed tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] 10.222.0.61 "GET /compute/v2.1/servers/39a531e3-b13b-412f-a200-5141c32650be" status: 200 len: 1371 microversion: 2.1 time: 0.584338 Aug 31 16:00:22.102027 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-07b36f2b-f943-463b-8c34-2d451de904b9 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:22.102803 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-07b36f2b-f943-463b-8c34-2d451de904b9 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] [instance: 6c5b2996-bce3-4a39-88c7-2e300d06473e] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:22.112624 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 607/1232] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:21 2022] GET /compute/v2.1/servers/39a531e3-b13b-412f-a200-5141c32650be => generated 1371 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:22.119806 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-07b36f2b-f943-463b-8c34-2d451de904b9 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:22.120554 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-07b36f2b-f943-463b-8c34-2d451de904b9 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:22.121013 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-07b36f2b-f943-463b-8c34-2d451de904b9 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:22.121730 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-07b36f2b-f943-463b-8c34-2d451de904b9 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:22.121863 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c5d6011e-3af5-4786-b20c-16ab0c1ef675 tempest-ServersWithSpecificFlavorTestJSON-1517669509 tempest-ServersWithSpecificFlavorTestJSON-1517669509-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:22.122606 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-07b36f2b-f943-463b-8c34-2d451de904b9 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:22.123050 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-07b36f2b-f943-463b-8c34-2d451de904b9 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:22.146855 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c5d6011e-3af5-4786-b20c-16ab0c1ef675 tempest-ServersWithSpecificFlavorTestJSON-1517669509 tempest-ServersWithSpecificFlavorTestJSON-1517669509-project-admin] 10.222.0.61 "DELETE /compute/v2.1/flavors/1461368607" status: 202 len: 0 microversion: 2.1 time: 0.031849 Aug 31 16:00:22.147914 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 608/1233] 10.222.0.61 () {58 vars in 1161 bytes} [Wed Aug 31 16:00:22 2022] DELETE /compute/v2.1/flavors/1461368607 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:00:22.156856 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c7c7a1bd-46b1-4a44-a6d3-eed71972436b tempest-ServersWithSpecificFlavorTestJSON-1517669509 tempest-ServersWithSpecificFlavorTestJSON-1517669509-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:22.179013 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c7c7a1bd-46b1-4a44-a6d3-eed71972436b tempest-ServersWithSpecificFlavorTestJSON-1517669509 tempest-ServersWithSpecificFlavorTestJSON-1517669509-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026117 Aug 31 16:00:22.179932 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 609/1234] 10.222.0.61 () {58 vars in 1146 bytes} [Wed Aug 31 16:00:22 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:22.184461 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-e4d0bb0b-7e56-4b86-98b8-91be607c5ce9 req-67a2a750-c1c4-4b12-9baf-ff48c489d940 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e37d5ca-7dc4-476e-803f-f61c6adfaeb4", "tag": "30a1007c-35f7-458a-b3da-48354c0485f4"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:00:22.198958 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-e4d0bb0b-7e56-4b86-98b8-91be607c5ce9 req-67a2a750-c1c4-4b12-9baf-ff48c489d940 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:22.200016 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-e4d0bb0b-7e56-4b86-98b8-91be607c5ce9 req-67a2a750-c1c4-4b12-9baf-ff48c489d940 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:22.200624 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-e4d0bb0b-7e56-4b86-98b8-91be607c5ce9 req-67a2a750-c1c4-4b12-9baf-ff48c489d940 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:22.212820 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-e4d0bb0b-7e56-4b86-98b8-91be607c5ce9 req-67a2a750-c1c4-4b12-9baf-ff48c489d940 service nova] Creating event network-changed:30a1007c-35f7-458a-b3da-48354c0485f4 for instance 7e37d5ca-7dc4-476e-803f-f61c6adfaeb4 on n-h1-850499-9 Aug 31 16:00:22.218044 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-e4d0bb0b-7e56-4b86-98b8-91be607c5ce9 req-67a2a750-c1c4-4b12-9baf-ff48c489d940 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037048 Aug 31 16:00:22.218698 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 610/1235] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:00:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:00:22.224487 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7a7a48b9-9af1-4c63-9a16-690e7c62469b tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:22.225070 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7a7a48b9-9af1-4c63-9a16-690e7c62469b tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] [instance: d5e69723-2d0e-46ef-8f76-82d64aad4772] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:22.231660 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7a7a48b9-9af1-4c63-9a16-690e7c62469b tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:22.232152 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7a7a48b9-9af1-4c63-9a16-690e7c62469b tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:22.232595 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7a7a48b9-9af1-4c63-9a16-690e7c62469b tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:22.233298 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7a7a48b9-9af1-4c63-9a16-690e7c62469b tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:22.233756 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7a7a48b9-9af1-4c63-9a16-690e7c62469b tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:22.234184 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7a7a48b9-9af1-4c63-9a16-690e7c62469b tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:22.248679 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-7a7a48b9-9af1-4c63-9a16-690e7c62469b tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] HTTP exception thrown: Instance d5e69723-2d0e-46ef-8f76-82d64aad4772 could not be found. Aug 31 16:00:22.250378 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7a7a48b9-9af1-4c63-9a16-690e7c62469b tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Request method failure captured: Aug 31 16:00:22.250378 n-d-850499-9 devstack@n-api.service[122256]: request: DELETE /compute/v2.1/servers/d5e69723-2d0e-46ef-8f76-82d64aad4772 HTTP/1.1 Aug 31 16:00:22.250378 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:00:22.250378 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:00:22.250378 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:00:22.250378 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:00:22.250378 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:00:22.250378 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:00:22.250378 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:00:22.250378 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:00:22.250378 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4SGAKMtvO8_n5d3BpzudxLSLw_koEApBHE4XBXYfJzgqUgn1vq2Dg0jiZsTgOO8SkRFB_Yv7AEMrBQtyv4E8fd1Rvtb8tqm0Jn47lt4OUsg4WuSYU_qqCdwySsdW48kOJXziEQbPhg3-gdZiIKxyr0NjqaPND8wy52vdljk2iA2Z0Y Aug 31 16:00:22.250378 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:00:22.250378 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:00:22.250378 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:00:22.250378 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:00:22.250378 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:00:22.250378 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:00:22.250378 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: f6e5507d53224d19804717493d60bb71 Aug 31 16:00:22.250378 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-499642415 Aug 31 16:00:22.250378 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:00:22.250378 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:00:22.252005 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f6e5507d53224d19804717493d60bb71"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f6e5507d53224d19804717493d60bb71"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f6e5507d53224d19804717493d60bb71", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f6e5507d53224d19804717493d60bb71"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:00:22.252005 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-499642415 Aug 31 16:00:22.252005 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: f6e5507d53224d19804717493d60bb71 Aug 31 16:00:22.252005 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-499642415 Aug 31 16:00:22.252005 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ServersWithSpecificFlavorTestJSON-499642415-project Aug 31 16:00:22.252005 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:00:22.252005 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:00:22.252005 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: fa377b1dedae45d2a804919e5ea69a00 Aug 31 16:00:22.252005 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-499642415-project Aug 31 16:00:22.252005 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:00:22.252005 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance d5e69723-2d0e-46ef-8f76-82d64aad4772 could not be found. Aug 31 16:00:22.252005 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': 'd5e69723-2d0e-46ef-8f76-82d64aad4772'} Aug 31 16:00:22.253175 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:00:22.253175 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:22.253175 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:00:22.253175 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:00:22.253175 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:00:22.253175 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:00:22.253175 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:00:22.253175 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:00:22.253175 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:00:22.253175 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:00:22.253175 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5e69723-2d0e-46ef-8f76-82d64aad4772 could not be found. Aug 31 16:00:22.253175 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:22.253175 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:22.253175 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:22.253175 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:22.253175 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:22.253175 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:22.253175 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:00:22.253175 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:00:22.253175 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:00:22.255561 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:00:22.255561 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:00:22.255561 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:00:22.255561 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:00:22.255561 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:00:22.255561 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:00:22.255561 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:00:22.255561 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:00:22.255561 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:00:22.255561 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5e69723-2d0e-46ef-8f76-82d64aad4772 could not be found. Aug 31 16:00:22.255561 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:22.255561 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:22.255561 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:22.255561 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:22.255561 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:22.255561 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:22.255561 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:00:22.255561 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:00:22.255561 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5e69723-2d0e-46ef-8f76-82d64aad4772 could not be found. Aug 31 16:00:22.255561 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:22.256992 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7a7a48b9-9af1-4c63-9a16-690e7c62469b tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Returning 404 to user: Instance d5e69723-2d0e-46ef-8f76-82d64aad4772 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:00:22.256992 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7a7a48b9-9af1-4c63-9a16-690e7c62469b tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] 10.222.0.61 "DELETE /compute/v2.1/servers/d5e69723-2d0e-46ef-8f76-82d64aad4772" status: 404 len: 111 microversion: 2.1 time: 0.032001 Aug 31 16:00:22.256992 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 611/1236] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:00:22 2022] DELETE /compute/v2.1/servers/d5e69723-2d0e-46ef-8f76-82d64aad4772 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:00:22.260061 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c7f31885-ca0d-430c-88d5-f9be5cc14f39 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:22.260678 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c7f31885-ca0d-430c-88d5-f9be5cc14f39 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] [instance: d5e69723-2d0e-46ef-8f76-82d64aad4772] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:22.266597 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c7f31885-ca0d-430c-88d5-f9be5cc14f39 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:22.267096 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c7f31885-ca0d-430c-88d5-f9be5cc14f39 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:22.267554 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c7f31885-ca0d-430c-88d5-f9be5cc14f39 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:22.268247 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c7f31885-ca0d-430c-88d5-f9be5cc14f39 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:22.268703 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c7f31885-ca0d-430c-88d5-f9be5cc14f39 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:22.269129 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c7f31885-ca0d-430c-88d5-f9be5cc14f39 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:22.283399 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-c7f31885-ca0d-430c-88d5-f9be5cc14f39 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] HTTP exception thrown: Instance d5e69723-2d0e-46ef-8f76-82d64aad4772 could not be found. Aug 31 16:00:22.284977 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c7f31885-ca0d-430c-88d5-f9be5cc14f39 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Request method failure captured: Aug 31 16:00:22.284977 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/d5e69723-2d0e-46ef-8f76-82d64aad4772 HTTP/1.1 Aug 31 16:00:22.284977 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:00:22.284977 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:00:22.284977 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:00:22.284977 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:00:22.284977 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:00:22.284977 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:00:22.284977 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:00:22.284977 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:00:22.284977 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4SGAKMtvO8_n5d3BpzudxLSLw_koEApBHE4XBXYfJzgqUgn1vq2Dg0jiZsTgOO8SkRFB_Yv7AEMrBQtyv4E8fd1Rvtb8tqm0Jn47lt4OUsg4WuSYU_qqCdwySsdW48kOJXziEQbPhg3-gdZiIKxyr0NjqaPND8wy52vdljk2iA2Z0Y Aug 31 16:00:22.284977 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:00:22.284977 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:00:22.284977 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:00:22.284977 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:00:22.284977 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:00:22.284977 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:00:22.284977 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: f6e5507d53224d19804717493d60bb71 Aug 31 16:00:22.284977 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-499642415 Aug 31 16:00:22.284977 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:00:22.284977 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:00:22.287163 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f6e5507d53224d19804717493d60bb71"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f6e5507d53224d19804717493d60bb71"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f6e5507d53224d19804717493d60bb71", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f6e5507d53224d19804717493d60bb71"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:00:22.287163 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-499642415 Aug 31 16:00:22.287163 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: f6e5507d53224d19804717493d60bb71 Aug 31 16:00:22.287163 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-499642415 Aug 31 16:00:22.287163 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ServersWithSpecificFlavorTestJSON-499642415-project Aug 31 16:00:22.287163 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:00:22.287163 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:00:22.287163 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: fa377b1dedae45d2a804919e5ea69a00 Aug 31 16:00:22.287163 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-499642415-project Aug 31 16:00:22.287163 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:00:22.287163 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance d5e69723-2d0e-46ef-8f76-82d64aad4772 could not be found. Aug 31 16:00:22.287163 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': 'd5e69723-2d0e-46ef-8f76-82d64aad4772'} Aug 31 16:00:22.288591 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:00:22.288591 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:22.288591 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:00:22.288591 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:00:22.288591 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:00:22.288591 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:00:22.288591 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:00:22.288591 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:00:22.288591 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:00:22.288591 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:00:22.288591 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5e69723-2d0e-46ef-8f76-82d64aad4772 could not be found. Aug 31 16:00:22.288591 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:22.288591 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:22.288591 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:22.288591 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:22.288591 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:22.288591 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:22.288591 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:00:22.288591 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:00:22.288591 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:00:22.289941 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:00:22.289941 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:00:22.289941 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:00:22.289941 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:00:22.289941 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:00:22.289941 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:00:22.289941 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:00:22.289941 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5e69723-2d0e-46ef-8f76-82d64aad4772 could not be found. Aug 31 16:00:22.289941 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:22.289941 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:22.289941 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:22.289941 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:22.289941 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:22.289941 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:22.289941 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:00:22.289941 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:00:22.289941 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5e69723-2d0e-46ef-8f76-82d64aad4772 could not be found. Aug 31 16:00:22.289941 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:22.291819 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c7f31885-ca0d-430c-88d5-f9be5cc14f39 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Returning 404 to user: Instance d5e69723-2d0e-46ef-8f76-82d64aad4772 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:00:22.291819 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c7f31885-ca0d-430c-88d5-f9be5cc14f39 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] 10.222.0.61 "GET /compute/v2.1/servers/d5e69723-2d0e-46ef-8f76-82d64aad4772" status: 404 len: 111 microversion: 2.1 time: 0.030504 Aug 31 16:00:22.291819 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 612/1237] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:22 2022] GET /compute/v2.1/servers/d5e69723-2d0e-46ef-8f76-82d64aad4772 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 16:00:22.296104 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-03049e1d-286c-4a06-8233-e65da7892523 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:22.296609 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-03049e1d-286c-4a06-8233-e65da7892523 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] [instance: 3a0126e3-2324-4892-8908-2b6d2d5e2158] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:22.303357 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-03049e1d-286c-4a06-8233-e65da7892523 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:22.304029 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-03049e1d-286c-4a06-8233-e65da7892523 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:22.304332 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-03049e1d-286c-4a06-8233-e65da7892523 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:22.305041 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-03049e1d-286c-4a06-8233-e65da7892523 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:22.305499 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-03049e1d-286c-4a06-8233-e65da7892523 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:22.305926 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-03049e1d-286c-4a06-8233-e65da7892523 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:22.320980 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-03049e1d-286c-4a06-8233-e65da7892523 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] HTTP exception thrown: Instance 3a0126e3-2324-4892-8908-2b6d2d5e2158 could not be found. Aug 31 16:00:22.322553 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-03049e1d-286c-4a06-8233-e65da7892523 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Request method failure captured: Aug 31 16:00:22.322553 n-d-850499-9 devstack@n-api.service[122256]: request: DELETE /compute/v2.1/servers/3a0126e3-2324-4892-8908-2b6d2d5e2158 HTTP/1.1 Aug 31 16:00:22.322553 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:00:22.322553 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:00:22.322553 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:00:22.322553 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:00:22.322553 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:00:22.322553 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:00:22.322553 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:00:22.322553 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:00:22.322553 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4SGAKMtvO8_n5d3BpzudxLSLw_koEApBHE4XBXYfJzgqUgn1vq2Dg0jiZsTgOO8SkRFB_Yv7AEMrBQtyv4E8fd1Rvtb8tqm0Jn47lt4OUsg4WuSYU_qqCdwySsdW48kOJXziEQbPhg3-gdZiIKxyr0NjqaPND8wy52vdljk2iA2Z0Y Aug 31 16:00:22.322553 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:00:22.322553 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:00:22.322553 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:00:22.322553 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:00:22.322553 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:00:22.322553 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:00:22.322553 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: f6e5507d53224d19804717493d60bb71 Aug 31 16:00:22.322553 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-499642415 Aug 31 16:00:22.322553 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:00:22.322553 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:00:22.323987 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f6e5507d53224d19804717493d60bb71"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f6e5507d53224d19804717493d60bb71"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f6e5507d53224d19804717493d60bb71", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f6e5507d53224d19804717493d60bb71"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:00:22.323987 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-499642415 Aug 31 16:00:22.323987 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: f6e5507d53224d19804717493d60bb71 Aug 31 16:00:22.323987 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-499642415 Aug 31 16:00:22.323987 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ServersWithSpecificFlavorTestJSON-499642415-project Aug 31 16:00:22.323987 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:00:22.323987 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:00:22.323987 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: fa377b1dedae45d2a804919e5ea69a00 Aug 31 16:00:22.323987 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-499642415-project Aug 31 16:00:22.323987 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:00:22.323987 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance 3a0126e3-2324-4892-8908-2b6d2d5e2158 could not be found. Aug 31 16:00:22.323987 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '3a0126e3-2324-4892-8908-2b6d2d5e2158'} Aug 31 16:00:22.324717 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:00:22.324717 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:22.324717 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:00:22.324717 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:00:22.324717 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:00:22.324717 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:00:22.324717 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:00:22.324717 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:00:22.324717 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:00:22.324717 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:00:22.324717 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a0126e3-2324-4892-8908-2b6d2d5e2158 could not be found. Aug 31 16:00:22.324717 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:22.324717 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:22.324717 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:22.324717 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:22.324717 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:22.324717 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:22.324717 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:00:22.324717 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:00:22.324717 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:00:22.326107 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:00:22.326107 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:00:22.326107 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:00:22.326107 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:00:22.326107 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:00:22.326107 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:00:22.326107 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:00:22.326107 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:00:22.326107 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:00:22.326107 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a0126e3-2324-4892-8908-2b6d2d5e2158 could not be found. Aug 31 16:00:22.326107 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:22.326107 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:22.326107 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:22.326107 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:22.326107 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:22.326107 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:22.326107 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:00:22.326107 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:00:22.326107 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a0126e3-2324-4892-8908-2b6d2d5e2158 could not be found. Aug 31 16:00:22.326107 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:22.327657 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-03049e1d-286c-4a06-8233-e65da7892523 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Returning 404 to user: Instance 3a0126e3-2324-4892-8908-2b6d2d5e2158 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:00:22.327657 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-03049e1d-286c-4a06-8233-e65da7892523 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] 10.222.0.61 "DELETE /compute/v2.1/servers/3a0126e3-2324-4892-8908-2b6d2d5e2158" status: 404 len: 111 microversion: 2.1 time: 0.031957 Aug 31 16:00:22.327889 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 613/1238] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:00:22 2022] DELETE /compute/v2.1/servers/3a0126e3-2324-4892-8908-2b6d2d5e2158 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 16:00:22.333184 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-150f29a6-3631-4f53-a025-777bcd61d677 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:22.333848 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-150f29a6-3631-4f53-a025-777bcd61d677 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] [instance: 3a0126e3-2324-4892-8908-2b6d2d5e2158] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:22.340135 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-150f29a6-3631-4f53-a025-777bcd61d677 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:22.340628 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-150f29a6-3631-4f53-a025-777bcd61d677 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:22.341068 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-150f29a6-3631-4f53-a025-777bcd61d677 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:22.341769 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-150f29a6-3631-4f53-a025-777bcd61d677 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:22.342229 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-150f29a6-3631-4f53-a025-777bcd61d677 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:22.342657 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-150f29a6-3631-4f53-a025-777bcd61d677 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:22.357643 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-150f29a6-3631-4f53-a025-777bcd61d677 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] HTTP exception thrown: Instance 3a0126e3-2324-4892-8908-2b6d2d5e2158 could not be found. Aug 31 16:00:22.359192 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-150f29a6-3631-4f53-a025-777bcd61d677 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Request method failure captured: Aug 31 16:00:22.359192 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/3a0126e3-2324-4892-8908-2b6d2d5e2158 HTTP/1.1 Aug 31 16:00:22.359192 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:00:22.359192 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:00:22.359192 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:00:22.359192 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:00:22.359192 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:00:22.359192 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:00:22.359192 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:00:22.359192 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:00:22.359192 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4SGAKMtvO8_n5d3BpzudxLSLw_koEApBHE4XBXYfJzgqUgn1vq2Dg0jiZsTgOO8SkRFB_Yv7AEMrBQtyv4E8fd1Rvtb8tqm0Jn47lt4OUsg4WuSYU_qqCdwySsdW48kOJXziEQbPhg3-gdZiIKxyr0NjqaPND8wy52vdljk2iA2Z0Y Aug 31 16:00:22.359192 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:00:22.359192 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:00:22.359192 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:00:22.359192 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:00:22.359192 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:00:22.359192 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:00:22.359192 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: f6e5507d53224d19804717493d60bb71 Aug 31 16:00:22.359192 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-499642415 Aug 31 16:00:22.359192 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:00:22.359192 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:00:22.360980 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f6e5507d53224d19804717493d60bb71"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f6e5507d53224d19804717493d60bb71"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f6e5507d53224d19804717493d60bb71", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f6e5507d53224d19804717493d60bb71"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:00:22.360980 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-499642415 Aug 31 16:00:22.360980 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: f6e5507d53224d19804717493d60bb71 Aug 31 16:00:22.360980 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-499642415 Aug 31 16:00:22.360980 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ServersWithSpecificFlavorTestJSON-499642415-project Aug 31 16:00:22.360980 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:00:22.360980 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:00:22.360980 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: fa377b1dedae45d2a804919e5ea69a00 Aug 31 16:00:22.360980 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-499642415-project Aug 31 16:00:22.360980 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:00:22.360980 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance 3a0126e3-2324-4892-8908-2b6d2d5e2158 could not be found. Aug 31 16:00:22.360980 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '3a0126e3-2324-4892-8908-2b6d2d5e2158'} Aug 31 16:00:22.361813 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:00:22.361813 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:22.361813 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:00:22.361813 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:00:22.361813 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:00:22.361813 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:00:22.361813 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:00:22.361813 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:00:22.361813 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:00:22.361813 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:00:22.361813 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a0126e3-2324-4892-8908-2b6d2d5e2158 could not be found. Aug 31 16:00:22.361813 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:22.361813 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:22.361813 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:22.361813 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:22.361813 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:22.361813 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:22.361813 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:00:22.361813 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:00:22.361813 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:00:22.363399 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:00:22.363399 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:00:22.363399 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:00:22.363399 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:00:22.363399 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:00:22.363399 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:00:22.363399 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:00:22.363399 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a0126e3-2324-4892-8908-2b6d2d5e2158 could not be found. Aug 31 16:00:22.363399 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:22.363399 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:22.363399 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:22.363399 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:22.363399 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:22.363399 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:22.363399 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:00:22.363399 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:00:22.363399 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a0126e3-2324-4892-8908-2b6d2d5e2158 could not be found. Aug 31 16:00:22.363399 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:22.365256 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-150f29a6-3631-4f53-a025-777bcd61d677 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] Returning 404 to user: Instance 3a0126e3-2324-4892-8908-2b6d2d5e2158 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:00:22.365256 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-150f29a6-3631-4f53-a025-777bcd61d677 tempest-ServersWithSpecificFlavorTestJSON-499642415 tempest-ServersWithSpecificFlavorTestJSON-499642415-project] 10.222.0.61 "GET /compute/v2.1/servers/3a0126e3-2324-4892-8908-2b6d2d5e2158" status: 404 len: 111 microversion: 2.1 time: 0.031817 Aug 31 16:00:22.365480 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 614/1239] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:22 2022] GET /compute/v2.1/servers/3a0126e3-2324-4892-8908-2b6d2d5e2158 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:00:22.385113 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4d1510c2-932a-40ce-b176-3281c855f941 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:22.385794 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4d1510c2-932a-40ce-b176-3281c855f941 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: 5f29cff7-a675-40c2-a0e5-2a62994be45a] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:22.395729 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4d1510c2-932a-40ce-b176-3281c855f941 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:22.397166 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4d1510c2-932a-40ce-b176-3281c855f941 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:22.397166 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4d1510c2-932a-40ce-b176-3281c855f941 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:22.398515 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4d1510c2-932a-40ce-b176-3281c855f941 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:22.399212 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4d1510c2-932a-40ce-b176-3281c855f941 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:22.399708 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4d1510c2-932a-40ce-b176-3281c855f941 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:22.859714 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-07b36f2b-f943-463b-8c34-2d451de904b9 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a03cc5956ca477abacbe0c26bf18750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea45d1b678342ed812f9912e9f07503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:22.874703 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-07b36f2b-f943-463b-8c34-2d451de904b9 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] 10.222.0.61 "GET /compute/v2.1/servers/6c5b2996-bce3-4a39-88c7-2e300d06473e" status: 200 len: 1469 microversion: 2.1 time: 0.776572 Aug 31 16:00:22.875521 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 626/1240] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:22 2022] GET /compute/v2.1/servers/6c5b2996-bce3-4a39-88c7-2e300d06473e => generated 1469 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:22.889812 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c2858bdf-664a-4c82-80c5-3dfac049a664 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:22.889812 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c2858bdf-664a-4c82-80c5-3dfac049a664 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] [instance: 7e37d5ca-7dc4-476e-803f-f61c6adfaeb4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:22.892069 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c2858bdf-664a-4c82-80c5-3dfac049a664 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:22.892870 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c2858bdf-664a-4c82-80c5-3dfac049a664 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:22.894044 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c2858bdf-664a-4c82-80c5-3dfac049a664 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:22.895892 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c2858bdf-664a-4c82-80c5-3dfac049a664 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:22.896660 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c2858bdf-664a-4c82-80c5-3dfac049a664 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:22.897344 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c2858bdf-664a-4c82-80c5-3dfac049a664 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:23.139436 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-4d1510c2-932a-40ce-b176-3281c855f941 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ccd03a4aa84f93bc26b438e1468f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a9f3fcc4b445349e5c66ff712e8598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:23.150768 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4d1510c2-932a-40ce-b176-3281c855f941 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/servers/5f29cff7-a675-40c2-a0e5-2a62994be45a" status: 200 len: 1308 microversion: 2.1 time: 0.769577 Aug 31 16:00:23.153172 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 615/1241] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:22 2022] GET /compute/v2.1/servers/5f29cff7-a675-40c2-a0e5-2a62994be45a => generated 1308 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:00:23.158782 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-69cf41e5-6404-46a2-9a16-bc531c1037d7 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:23.160292 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-69cf41e5-6404-46a2-9a16-bc531c1037d7 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:23.184923 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-69cf41e5-6404-46a2-9a16-bc531c1037d7 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:23.184923 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-69cf41e5-6404-46a2-9a16-bc531c1037d7 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:23.185233 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-69cf41e5-6404-46a2-9a16-bc531c1037d7 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:23.186076 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-69cf41e5-6404-46a2-9a16-bc531c1037d7 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:23.186543 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-69cf41e5-6404-46a2-9a16-bc531c1037d7 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:23.186982 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-69cf41e5-6404-46a2-9a16-bc531c1037d7 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:23.324120 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c2858bdf-664a-4c82-80c5-3dfac049a664 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccce16c7fda401ea68fb31ea8099d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed252ebf7c741bbb36b553ac1767579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:23.341299 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c2858bdf-664a-4c82-80c5-3dfac049a664 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "GET /compute/v2.1/servers/7e37d5ca-7dc4-476e-803f-f61c6adfaeb4" status: 200 len: 1325 microversion: 2.1 time: 0.464447 Aug 31 16:00:23.359361 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 627/1242] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:22 2022] GET /compute/v2.1/servers/7e37d5ca-7dc4-476e-803f-f61c6adfaeb4 => generated 1325 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:23.365642 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5b375359-39c5-4bb6-996f-e3ffdf0f0190 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:23.366619 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5b375359-39c5-4bb6-996f-e3ffdf0f0190 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] [instance: 39a531e3-b13b-412f-a200-5141c32650be] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:23.373284 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b375359-39c5-4bb6-996f-e3ffdf0f0190 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:23.373871 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b375359-39c5-4bb6-996f-e3ffdf0f0190 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:23.374490 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b375359-39c5-4bb6-996f-e3ffdf0f0190 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:23.375276 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b375359-39c5-4bb6-996f-e3ffdf0f0190 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:23.375852 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b375359-39c5-4bb6-996f-e3ffdf0f0190 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:23.376349 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b375359-39c5-4bb6-996f-e3ffdf0f0190 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:23.428170 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-69cf41e5-6404-46a2-9a16-bc531c1037d7 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:23.437116 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-69cf41e5-6404-46a2-9a16-bc531c1037d7 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:23.438572 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-69cf41e5-6404-46a2-9a16-bc531c1037d7 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:23.455555 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-69cf41e5-6404-46a2-9a16-bc531c1037d7 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1539 microversion: 2.91 time: 0.301066 Aug 31 16:00:23.468563 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 616/1243] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:00:23 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1539 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:00:23.773198 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5b375359-39c5-4bb6-996f-e3ffdf0f0190 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb054cb62b9945a78e6bb60cd613acae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f780d0079345519eea40fe8a3fd813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:23.785954 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5b375359-39c5-4bb6-996f-e3ffdf0f0190 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] 10.222.0.61 "GET /compute/v2.1/servers/39a531e3-b13b-412f-a200-5141c32650be" status: 200 len: 1557 microversion: 2.1 time: 0.423033 Aug 31 16:00:23.801349 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 628/1244] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:23 2022] GET /compute/v2.1/servers/39a531e3-b13b-412f-a200-5141c32650be => generated 1557 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:23.809346 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ea617707-1a8d-493d-949c-a368c15e911d tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:23.809841 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ea617707-1a8d-493d-949c-a368c15e911d tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] [instance: 39a531e3-b13b-412f-a200-5141c32650be] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:23.816599 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ea617707-1a8d-493d-949c-a368c15e911d tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:23.817595 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ea617707-1a8d-493d-949c-a368c15e911d tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:23.818475 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ea617707-1a8d-493d-949c-a368c15e911d tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:23.819189 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ea617707-1a8d-493d-949c-a368c15e911d tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:23.819688 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ea617707-1a8d-493d-949c-a368c15e911d tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:23.820119 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ea617707-1a8d-493d-949c-a368c15e911d tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:23.902901 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-72e8121b-4b7f-4175-85c0-50b651b56059 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:23.903539 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-72e8121b-4b7f-4175-85c0-50b651b56059 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] [instance: 6c5b2996-bce3-4a39-88c7-2e300d06473e] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:23.909793 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-72e8121b-4b7f-4175-85c0-50b651b56059 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:23.911098 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-72e8121b-4b7f-4175-85c0-50b651b56059 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:23.911940 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-72e8121b-4b7f-4175-85c0-50b651b56059 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:23.912974 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-72e8121b-4b7f-4175-85c0-50b651b56059 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:23.913362 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-72e8121b-4b7f-4175-85c0-50b651b56059 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:23.913794 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-72e8121b-4b7f-4175-85c0-50b651b56059 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:23.931991 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ea617707-1a8d-493d-949c-a368c15e911d tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] 10.222.0.61 "GET /compute/v2.1/servers/39a531e3-b13b-412f-a200-5141c32650be/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.126705 Aug 31 16:00:23.939232 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 617/1245] 10.222.0.61 () {58 vars in 1275 bytes} [Wed Aug 31 16:00:23 2022] GET /compute/v2.1/servers/39a531e3-b13b-412f-a200-5141c32650be/os-interface => generated 284 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:00:23.948328 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-72e8121b-4b7f-4175-85c0-50b651b56059 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:23.949016 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-72e8121b-4b7f-4175-85c0-50b651b56059 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:23.949608 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-72e8121b-4b7f-4175-85c0-50b651b56059 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:23.950220 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-72e8121b-4b7f-4175-85c0-50b651b56059 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lazy-loading 'fault' on Instance uuid 6c5b2996-bce3-4a39-88c7-2e300d06473e {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:00:24.044769 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-72e8121b-4b7f-4175-85c0-50b651b56059 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a03cc5956ca477abacbe0c26bf18750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea45d1b678342ed812f9912e9f07503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:24.058898 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-72e8121b-4b7f-4175-85c0-50b651b56059 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] 10.222.0.61 "GET /compute/v2.1/servers/6c5b2996-bce3-4a39-88c7-2e300d06473e" status: 200 len: 1304 microversion: 2.1 time: 0.159313 Aug 31 16:00:24.064189 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 629/1246] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:23 2022] GET /compute/v2.1/servers/6c5b2996-bce3-4a39-88c7-2e300d06473e => generated 1304 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:24.174192 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-723de190-afe1-41c1-bbbe-c1a002d6d8eb tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:24.175358 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-723de190-afe1-41c1-bbbe-c1a002d6d8eb tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: 5f29cff7-a675-40c2-a0e5-2a62994be45a] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:24.183489 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-723de190-afe1-41c1-bbbe-c1a002d6d8eb tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:24.184348 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-723de190-afe1-41c1-bbbe-c1a002d6d8eb tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:24.184972 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-723de190-afe1-41c1-bbbe-c1a002d6d8eb tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:24.186041 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-723de190-afe1-41c1-bbbe-c1a002d6d8eb tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:24.186686 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-723de190-afe1-41c1-bbbe-c1a002d6d8eb tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:24.187554 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-723de190-afe1-41c1-bbbe-c1a002d6d8eb tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:24.279097 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-d3b830a4-dd8e-4bde-bfb3-636e4df69047 req-1b3fca87-e036-4e4c-9117-5810af7d0bfb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f29cff7-a675-40c2-a0e5-2a62994be45a", "tag": "5aedd1b8-fd73-4d4f-8c6e-c030265971d4"}, {"server_uuid": "6c5b2996-bce3-4a39-88c7-2e300d06473e", "name": "network-vif-deleted", "tag": "6a2a769e-d172-4084-aaf0-690c1eac47e7"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:00:24.298574 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-d3b830a4-dd8e-4bde-bfb3-636e4df69047 req-1b3fca87-e036-4e4c-9117-5810af7d0bfb service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:24.299536 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-d3b830a4-dd8e-4bde-bfb3-636e4df69047 req-1b3fca87-e036-4e4c-9117-5810af7d0bfb service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:24.300275 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-d3b830a4-dd8e-4bde-bfb3-636e4df69047 req-1b3fca87-e036-4e4c-9117-5810af7d0bfb service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:24.325781 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-d3b830a4-dd8e-4bde-bfb3-636e4df69047 req-1b3fca87-e036-4e4c-9117-5810af7d0bfb service nova] Creating event network-changed:5aedd1b8-fd73-4d4f-8c6e-c030265971d4 for instance 5f29cff7-a675-40c2-a0e5-2a62994be45a on n-h1-850499-9 Aug 31 16:00:24.326761 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-d3b830a4-dd8e-4bde-bfb3-636e4df69047 req-1b3fca87-e036-4e4c-9117-5810af7d0bfb service nova] Creating event network-vif-deleted:6a2a769e-d172-4084-aaf0-690c1eac47e7 for instance 6c5b2996-bce3-4a39-88c7-2e300d06473e on n-h2-850499-9 Aug 31 16:00:24.340242 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-d3b830a4-dd8e-4bde-bfb3-636e4df69047 req-1b3fca87-e036-4e4c-9117-5810af7d0bfb service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.069009 Aug 31 16:00:24.341645 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 630/1247] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:00:24 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:00:24.370289 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6b2befc4-1ed8-423d-9709-745796179db5 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:24.373269 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6b2befc4-1ed8-423d-9709-745796179db5 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] [instance: 7e37d5ca-7dc4-476e-803f-f61c6adfaeb4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:24.384220 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6b2befc4-1ed8-423d-9709-745796179db5 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:24.385936 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6b2befc4-1ed8-423d-9709-745796179db5 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:24.386674 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6b2befc4-1ed8-423d-9709-745796179db5 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:24.394984 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6b2befc4-1ed8-423d-9709-745796179db5 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:24.396353 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6b2befc4-1ed8-423d-9709-745796179db5 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:24.397067 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6b2befc4-1ed8-423d-9709-745796179db5 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:24.425690 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-723de190-afe1-41c1-bbbe-c1a002d6d8eb tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ccd03a4aa84f93bc26b438e1468f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a9f3fcc4b445349e5c66ff712e8598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:24.431177 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:00:24.432289 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=100 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:00:24.439373 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-723de190-afe1-41c1-bbbe-c1a002d6d8eb tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/servers/5f29cff7-a675-40c2-a0e5-2a62994be45a" status: 200 len: 1308 microversion: 2.1 time: 0.269422 Aug 31 16:00:24.442434 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 618/1248] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:24 2022] GET /compute/v2.1/servers/5f29cff7-a675-40c2-a0e5-2a62994be45a => generated 1308 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:24.491617 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-bb862b62-c3c2-40c3-8920-c1fd84f63398 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:24.493812 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-bb862b62-c3c2-40c3-8920-c1fd84f63398 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:24.508361 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bb862b62-c3c2-40c3-8920-c1fd84f63398 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:24.510482 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bb862b62-c3c2-40c3-8920-c1fd84f63398 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:24.511346 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bb862b62-c3c2-40c3-8920-c1fd84f63398 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:24.512704 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bb862b62-c3c2-40c3-8920-c1fd84f63398 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:24.513460 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bb862b62-c3c2-40c3-8920-c1fd84f63398 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:24.514095 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bb862b62-c3c2-40c3-8920-c1fd84f63398 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:24.618484 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-bb862b62-c3c2-40c3-8920-c1fd84f63398 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:24.636231 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-bb862b62-c3c2-40c3-8920-c1fd84f63398 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:24.637706 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-bb862b62-c3c2-40c3-8920-c1fd84f63398 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:24.648587 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-bb862b62-c3c2-40c3-8920-c1fd84f63398 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1539 microversion: 2.91 time: 0.162849 Aug 31 16:00:24.648587 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 619/1249] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:00:24 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1539 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:00:24.673675 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-6b2befc4-1ed8-423d-9709-745796179db5 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccce16c7fda401ea68fb31ea8099d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed252ebf7c741bbb36b553ac1767579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:24.684054 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6b2befc4-1ed8-423d-9709-745796179db5 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "GET /compute/v2.1/servers/7e37d5ca-7dc4-476e-803f-f61c6adfaeb4" status: 200 len: 1325 microversion: 2.1 time: 0.320555 Aug 31 16:00:24.685047 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 631/1250] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:24 2022] GET /compute/v2.1/servers/7e37d5ca-7dc4-476e-803f-f61c6adfaeb4 => generated 1325 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:25.083370 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-25e077c3-5c2e-4f15-bb81-e56eee967251 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:25.083985 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-25e077c3-5c2e-4f15-bb81-e56eee967251 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] [instance: 6c5b2996-bce3-4a39-88c7-2e300d06473e] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:25.090653 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-25e077c3-5c2e-4f15-bb81-e56eee967251 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:25.091150 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-25e077c3-5c2e-4f15-bb81-e56eee967251 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:25.091670 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-25e077c3-5c2e-4f15-bb81-e56eee967251 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:25.092379 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-25e077c3-5c2e-4f15-bb81-e56eee967251 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:25.092838 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-25e077c3-5c2e-4f15-bb81-e56eee967251 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:25.093270 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-25e077c3-5c2e-4f15-bb81-e56eee967251 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:25.109031 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-25e077c3-5c2e-4f15-bb81-e56eee967251 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] HTTP exception thrown: Instance 6c5b2996-bce3-4a39-88c7-2e300d06473e could not be found. Aug 31 16:00:25.110796 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-25e077c3-5c2e-4f15-bb81-e56eee967251 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Request method failure captured: Aug 31 16:00:25.110796 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/6c5b2996-bce3-4a39-88c7-2e300d06473e HTTP/1.1 Aug 31 16:00:25.110796 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:00:25.110796 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:00:25.110796 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:00:25.110796 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:00:25.110796 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:00:25.110796 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:00:25.110796 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:00:25.110796 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:00:25.110796 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4UJA3WPepVwarZS0sSIE46Nziy9LlBy2vW05COgmKCRU0RKUloP0WsXkrjXKBvbN3vzXwnwt-7K0QVbTwPTTTLBiIgxWGHfmVQsdWf3p5eVuFcn_ZZjszf8SxoabHZQfkvfWOhRB6d5WKqyubNiekLkefcBwSwPFWl6XkpOPtU5Rqk Aug 31 16:00:25.110796 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:00:25.110796 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:00:25.110796 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:00:25.110796 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:00:25.110796 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:00:25.110796 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:00:25.110796 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 1ea45d1b678342ed812f9912e9f07503 Aug 31 16:00:25.110796 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ServersAdminTestJSON-2071688862 Aug 31 16:00:25.110796 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:00:25.110796 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:00:25.112522 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1ea45d1b678342ed812f9912e9f07503"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1ea45d1b678342ed812f9912e9f07503"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1ea45d1b678342ed812f9912e9f07503", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1ea45d1b678342ed812f9912e9f07503"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:00:25.112522 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ServersAdminTestJSON-2071688862 Aug 31 16:00:25.112522 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 1ea45d1b678342ed812f9912e9f07503 Aug 31 16:00:25.112522 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ServersAdminTestJSON-2071688862 Aug 31 16:00:25.112522 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ServersAdminTestJSON-2071688862-project Aug 31 16:00:25.112522 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:00:25.112522 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:00:25.112522 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 9a03cc5956ca477abacbe0c26bf18750 Aug 31 16:00:25.112522 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ServersAdminTestJSON-2071688862-project Aug 31 16:00:25.112522 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:00:25.112522 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance 6c5b2996-bce3-4a39-88c7-2e300d06473e could not be found. Aug 31 16:00:25.112522 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '6c5b2996-bce3-4a39-88c7-2e300d06473e'} Aug 31 16:00:25.113264 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:00:25.113264 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:25.113264 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:00:25.113264 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:00:25.113264 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:00:25.113264 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:00:25.113264 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:00:25.113264 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:00:25.113264 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:00:25.113264 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:00:25.113264 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c5b2996-bce3-4a39-88c7-2e300d06473e could not be found. Aug 31 16:00:25.113264 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:25.113264 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:25.113264 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:25.113264 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:25.113264 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:25.113264 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:25.113264 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:00:25.113264 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:00:25.113264 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:00:25.114501 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:00:25.114501 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:00:25.114501 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:00:25.114501 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:00:25.114501 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:00:25.114501 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:00:25.114501 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:00:25.114501 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c5b2996-bce3-4a39-88c7-2e300d06473e could not be found. Aug 31 16:00:25.114501 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:25.114501 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:25.114501 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:25.114501 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:25.114501 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:25.114501 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:25.114501 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:00:25.114501 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:00:25.114501 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c5b2996-bce3-4a39-88c7-2e300d06473e could not be found. Aug 31 16:00:25.114501 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:25.115633 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-25e077c3-5c2e-4f15-bb81-e56eee967251 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Returning 404 to user: Instance 6c5b2996-bce3-4a39-88c7-2e300d06473e could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:00:25.115633 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-25e077c3-5c2e-4f15-bb81-e56eee967251 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] 10.222.0.61 "GET /compute/v2.1/servers/6c5b2996-bce3-4a39-88c7-2e300d06473e" status: 404 len: 111 microversion: 2.1 time: 0.033948 Aug 31 16:00:25.115633 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 620/1251] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:25 2022] GET /compute/v2.1/servers/6c5b2996-bce3-4a39-88c7-2e300d06473e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:00:25.122382 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-420fda82-f33b-4d42-a32e-4cbb02918899 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:25.122926 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-420fda82-f33b-4d42-a32e-4cbb02918899 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] [instance: 1dd3a7d9-7ff6-4b6f-b279-ca90c9ddb14b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:25.131232 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-420fda82-f33b-4d42-a32e-4cbb02918899 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:25.131762 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-420fda82-f33b-4d42-a32e-4cbb02918899 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:25.132204 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-420fda82-f33b-4d42-a32e-4cbb02918899 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:25.132918 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-420fda82-f33b-4d42-a32e-4cbb02918899 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:25.133381 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-420fda82-f33b-4d42-a32e-4cbb02918899 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:25.133811 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-420fda82-f33b-4d42-a32e-4cbb02918899 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:25.163875 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-420fda82-f33b-4d42-a32e-4cbb02918899 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] [instance: 1dd3a7d9-7ff6-4b6f-b279-ca90c9ddb14b] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:00:25.258555 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-420fda82-f33b-4d42-a32e-4cbb02918899 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] 10.222.0.61 "DELETE /compute/v2.1/servers/1dd3a7d9-7ff6-4b6f-b279-ca90c9ddb14b" status: 204 len: 0 microversion: 2.1 time: 0.140271 Aug 31 16:00:25.259984 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 632/1252] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:00:25 2022] DELETE /compute/v2.1/servers/1dd3a7d9-7ff6-4b6f-b279-ca90c9ddb14b => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:00:25.268291 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d9bb98c1-1e56-4135-984e-db9f0e3e1367 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:25.269678 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d9bb98c1-1e56-4135-984e-db9f0e3e1367 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] [instance: 1dd3a7d9-7ff6-4b6f-b279-ca90c9ddb14b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:25.277457 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d9bb98c1-1e56-4135-984e-db9f0e3e1367 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:25.278218 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d9bb98c1-1e56-4135-984e-db9f0e3e1367 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:25.278825 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d9bb98c1-1e56-4135-984e-db9f0e3e1367 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:25.279535 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d9bb98c1-1e56-4135-984e-db9f0e3e1367 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:25.280433 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d9bb98c1-1e56-4135-984e-db9f0e3e1367 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:25.280791 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d9bb98c1-1e56-4135-984e-db9f0e3e1367 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:25.426697 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d9bb98c1-1e56-4135-984e-db9f0e3e1367 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a03cc5956ca477abacbe0c26bf18750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea45d1b678342ed812f9912e9f07503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:25.435200 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d9bb98c1-1e56-4135-984e-db9f0e3e1367 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] 10.222.0.61 "GET /compute/v2.1/servers/1dd3a7d9-7ff6-4b6f-b279-ca90c9ddb14b" status: 200 len: 1469 microversion: 2.1 time: 0.170847 Aug 31 16:00:25.435875 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 621/1253] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:25 2022] GET /compute/v2.1/servers/1dd3a7d9-7ff6-4b6f-b279-ca90c9ddb14b => generated 1469 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:25.464483 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-bc956ac7-7fd5-41f6-a6ef-e4c5d118baf8 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:25.465328 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-bc956ac7-7fd5-41f6-a6ef-e4c5d118baf8 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: 5f29cff7-a675-40c2-a0e5-2a62994be45a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:25.472587 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bc956ac7-7fd5-41f6-a6ef-e4c5d118baf8 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:25.473318 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bc956ac7-7fd5-41f6-a6ef-e4c5d118baf8 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:25.473873 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bc956ac7-7fd5-41f6-a6ef-e4c5d118baf8 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:25.474590 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bc956ac7-7fd5-41f6-a6ef-e4c5d118baf8 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:25.475062 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bc956ac7-7fd5-41f6-a6ef-e4c5d118baf8 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:25.475469 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bc956ac7-7fd5-41f6-a6ef-e4c5d118baf8 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:25.616286 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-bc956ac7-7fd5-41f6-a6ef-e4c5d118baf8 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ccd03a4aa84f93bc26b438e1468f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a9f3fcc4b445349e5c66ff712e8598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:25.628649 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-bc956ac7-7fd5-41f6-a6ef-e4c5d118baf8 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/servers/5f29cff7-a675-40c2-a0e5-2a62994be45a" status: 200 len: 1308 microversion: 2.1 time: 0.168584 Aug 31 16:00:25.629999 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 633/1254] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:25 2022] GET /compute/v2.1/servers/5f29cff7-a675-40c2-a0e5-2a62994be45a => generated 1308 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:00:25.673712 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a5bfb5a9-7eb1-405b-810f-856444e2cc7d tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:25.674940 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a5bfb5a9-7eb1-405b-810f-856444e2cc7d tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:25.681631 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a5bfb5a9-7eb1-405b-810f-856444e2cc7d tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:25.682701 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a5bfb5a9-7eb1-405b-810f-856444e2cc7d tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:25.682701 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a5bfb5a9-7eb1-405b-810f-856444e2cc7d tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:25.683275 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a5bfb5a9-7eb1-405b-810f-856444e2cc7d tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:25.683757 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a5bfb5a9-7eb1-405b-810f-856444e2cc7d tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:25.684183 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a5bfb5a9-7eb1-405b-810f-856444e2cc7d tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:25.709254 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-191d3862-6f31-457f-a4ba-f48b3136022e tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:25.710056 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-191d3862-6f31-457f-a4ba-f48b3136022e tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] [instance: 7e37d5ca-7dc4-476e-803f-f61c6adfaeb4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:25.717299 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-191d3862-6f31-457f-a4ba-f48b3136022e tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:25.718646 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-191d3862-6f31-457f-a4ba-f48b3136022e tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:25.719203 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-191d3862-6f31-457f-a4ba-f48b3136022e tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:25.720685 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-191d3862-6f31-457f-a4ba-f48b3136022e tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:25.721360 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-191d3862-6f31-457f-a4ba-f48b3136022e tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:25.722067 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-191d3862-6f31-457f-a4ba-f48b3136022e tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:25.783272 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a5bfb5a9-7eb1-405b-810f-856444e2cc7d tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:25.796012 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a5bfb5a9-7eb1-405b-810f-856444e2cc7d tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:25.796012 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a5bfb5a9-7eb1-405b-810f-856444e2cc7d tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:25.813907 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a5bfb5a9-7eb1-405b-810f-856444e2cc7d tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1539 microversion: 2.91 time: 0.141521 Aug 31 16:00:25.819954 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 622/1255] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:00:25 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1539 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:00:25.914194 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-191d3862-6f31-457f-a4ba-f48b3136022e tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccce16c7fda401ea68fb31ea8099d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed252ebf7c741bbb36b553ac1767579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:25.935658 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-191d3862-6f31-457f-a4ba-f48b3136022e tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "GET /compute/v2.1/servers/7e37d5ca-7dc4-476e-803f-f61c6adfaeb4" status: 200 len: 1325 microversion: 2.1 time: 0.231340 Aug 31 16:00:25.936666 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 634/1256] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:25 2022] GET /compute/v2.1/servers/7e37d5ca-7dc4-476e-803f-f61c6adfaeb4 => generated 1325 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:25.999802 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-bef8b0ce-2fde-44a3-923e-db6738ff41e6 req-75b9ad30-18cb-459c-aecf-319d48989c5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39a531e3-b13b-412f-a200-5141c32650be", "tag": "d0c9a73e-dff5-4b26-80b7-1f09c0c3efcc"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:00:26.010570 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-bef8b0ce-2fde-44a3-923e-db6738ff41e6 req-75b9ad30-18cb-459c-aecf-319d48989c5f service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:26.011319 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-bef8b0ce-2fde-44a3-923e-db6738ff41e6 req-75b9ad30-18cb-459c-aecf-319d48989c5f service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:26.011935 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-bef8b0ce-2fde-44a3-923e-db6738ff41e6 req-75b9ad30-18cb-459c-aecf-319d48989c5f service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:26.025293 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-bef8b0ce-2fde-44a3-923e-db6738ff41e6 req-75b9ad30-18cb-459c-aecf-319d48989c5f service nova] Creating event network-changed:d0c9a73e-dff5-4b26-80b7-1f09c0c3efcc for instance 39a531e3-b13b-412f-a200-5141c32650be on n-h1-850499-9 Aug 31 16:00:26.033639 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-bef8b0ce-2fde-44a3-923e-db6738ff41e6 req-75b9ad30-18cb-459c-aecf-319d48989c5f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037248 Aug 31 16:00:26.038703 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 623/1257] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:00:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:00:26.462669 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-533e65f8-d946-4c2c-836b-f13e420e45da tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:26.465580 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-533e65f8-d946-4c2c-836b-f13e420e45da tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] [instance: 1dd3a7d9-7ff6-4b6f-b279-ca90c9ddb14b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:26.491800 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-533e65f8-d946-4c2c-836b-f13e420e45da tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:26.492724 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-533e65f8-d946-4c2c-836b-f13e420e45da tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:26.493315 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-533e65f8-d946-4c2c-836b-f13e420e45da tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:26.494208 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-533e65f8-d946-4c2c-836b-f13e420e45da tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:26.494817 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-533e65f8-d946-4c2c-836b-f13e420e45da tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:26.495394 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-533e65f8-d946-4c2c-836b-f13e420e45da tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:26.651792 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-fe1a72e9-03e3-4d52-abfe-d59711f15afb tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:26.653139 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-fe1a72e9-03e3-4d52-abfe-d59711f15afb tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: 5f29cff7-a675-40c2-a0e5-2a62994be45a] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:26.659927 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fe1a72e9-03e3-4d52-abfe-d59711f15afb tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:26.661472 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fe1a72e9-03e3-4d52-abfe-d59711f15afb tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:26.662892 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fe1a72e9-03e3-4d52-abfe-d59711f15afb tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:26.663830 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fe1a72e9-03e3-4d52-abfe-d59711f15afb tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:26.664487 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fe1a72e9-03e3-4d52-abfe-d59711f15afb tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:26.665077 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fe1a72e9-03e3-4d52-abfe-d59711f15afb tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:26.818347 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-533e65f8-d946-4c2c-836b-f13e420e45da tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a03cc5956ca477abacbe0c26bf18750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea45d1b678342ed812f9912e9f07503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:26.840913 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-533e65f8-d946-4c2c-836b-f13e420e45da tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] 10.222.0.61 "GET /compute/v2.1/servers/1dd3a7d9-7ff6-4b6f-b279-ca90c9ddb14b" status: 200 len: 1469 microversion: 2.1 time: 0.384619 Aug 31 16:00:26.843666 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 635/1258] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:26 2022] GET /compute/v2.1/servers/1dd3a7d9-7ff6-4b6f-b279-ca90c9ddb14b => generated 1469 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:26.865813 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0abef779-cc7c-4608-b66f-af2fc5af014e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:26.867616 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0abef779-cc7c-4608-b66f-af2fc5af014e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:26.881792 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0abef779-cc7c-4608-b66f-af2fc5af014e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:26.882438 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0abef779-cc7c-4608-b66f-af2fc5af014e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:26.882916 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0abef779-cc7c-4608-b66f-af2fc5af014e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:26.884033 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0abef779-cc7c-4608-b66f-af2fc5af014e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:26.884677 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0abef779-cc7c-4608-b66f-af2fc5af014e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:26.885261 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0abef779-cc7c-4608-b66f-af2fc5af014e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:26.985010 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0abef779-cc7c-4608-b66f-af2fc5af014e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:26.994450 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0abef779-cc7c-4608-b66f-af2fc5af014e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:26.996301 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0abef779-cc7c-4608-b66f-af2fc5af014e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:27.002729 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0abef779-cc7c-4608-b66f-af2fc5af014e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1539 microversion: 2.91 time: 0.157637 Aug 31 16:00:27.003324 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 636/1259] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:00:26 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1539 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:00:27.027040 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d139e5fe-5458-45b8-beaf-a4211df2d60b tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:27.028647 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d139e5fe-5458-45b8-beaf-a4211df2d60b tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] [instance: 7e37d5ca-7dc4-476e-803f-f61c6adfaeb4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:27.040181 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d139e5fe-5458-45b8-beaf-a4211df2d60b tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:27.041176 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d139e5fe-5458-45b8-beaf-a4211df2d60b tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:27.042070 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d139e5fe-5458-45b8-beaf-a4211df2d60b tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:27.043090 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d139e5fe-5458-45b8-beaf-a4211df2d60b tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:27.044137 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d139e5fe-5458-45b8-beaf-a4211df2d60b tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:27.045644 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d139e5fe-5458-45b8-beaf-a4211df2d60b tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:27.085502 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-fe1a72e9-03e3-4d52-abfe-d59711f15afb tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ccd03a4aa84f93bc26b438e1468f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a9f3fcc4b445349e5c66ff712e8598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:27.098896 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-fe1a72e9-03e3-4d52-abfe-d59711f15afb tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/servers/5f29cff7-a675-40c2-a0e5-2a62994be45a" status: 200 len: 1308 microversion: 2.1 time: 0.452182 Aug 31 16:00:27.104854 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 624/1260] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:26 2022] GET /compute/v2.1/servers/5f29cff7-a675-40c2-a0e5-2a62994be45a => generated 1308 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:27.409812 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d139e5fe-5458-45b8-beaf-a4211df2d60b tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccce16c7fda401ea68fb31ea8099d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed252ebf7c741bbb36b553ac1767579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:27.419872 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d139e5fe-5458-45b8-beaf-a4211df2d60b tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "GET /compute/v2.1/servers/7e37d5ca-7dc4-476e-803f-f61c6adfaeb4" status: 200 len: 1325 microversion: 2.1 time: 0.414591 Aug 31 16:00:27.420782 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 637/1261] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:27 2022] GET /compute/v2.1/servers/7e37d5ca-7dc4-476e-803f-f61c6adfaeb4 => generated 1325 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:27.869524 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-72c17b36-4c15-4c74-9b75-588bee69fa0a tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:27.870394 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-72c17b36-4c15-4c74-9b75-588bee69fa0a tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] [instance: 1dd3a7d9-7ff6-4b6f-b279-ca90c9ddb14b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:27.884210 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-72c17b36-4c15-4c74-9b75-588bee69fa0a tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:27.884722 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-72c17b36-4c15-4c74-9b75-588bee69fa0a tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:27.885163 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-72c17b36-4c15-4c74-9b75-588bee69fa0a tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:27.885882 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-72c17b36-4c15-4c74-9b75-588bee69fa0a tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:27.886349 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-72c17b36-4c15-4c74-9b75-588bee69fa0a tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:27.886781 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-72c17b36-4c15-4c74-9b75-588bee69fa0a tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:28.033842 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-11388087-60a8-473b-bd11-414a6cbb7bf5 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:28.034716 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-11388087-60a8-473b-bd11-414a6cbb7bf5 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:28.043514 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-11388087-60a8-473b-bd11-414a6cbb7bf5 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:28.044027 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-11388087-60a8-473b-bd11-414a6cbb7bf5 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:28.044473 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-11388087-60a8-473b-bd11-414a6cbb7bf5 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:28.045227 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-11388087-60a8-473b-bd11-414a6cbb7bf5 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:28.045695 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-11388087-60a8-473b-bd11-414a6cbb7bf5 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:28.046130 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-11388087-60a8-473b-bd11-414a6cbb7bf5 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:28.276822 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-11388087-60a8-473b-bd11-414a6cbb7bf5 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:28.286159 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-11388087-60a8-473b-bd11-414a6cbb7bf5 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:28.287659 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-11388087-60a8-473b-bd11-414a6cbb7bf5 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:28.292749 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-11388087-60a8-473b-bd11-414a6cbb7bf5 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1539 microversion: 2.91 time: 0.263179 Aug 31 16:00:28.293328 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 638/1262] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:00:28 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1539 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:00:28.298452 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-693330b2-ce34-4c27-b88b-f8432274bf16 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:28.299296 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-693330b2-ce34-4c27-b88b-f8432274bf16 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: 5f29cff7-a675-40c2-a0e5-2a62994be45a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:28.305183 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-693330b2-ce34-4c27-b88b-f8432274bf16 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:28.305662 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-693330b2-ce34-4c27-b88b-f8432274bf16 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:28.306093 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-693330b2-ce34-4c27-b88b-f8432274bf16 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:28.306776 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-693330b2-ce34-4c27-b88b-f8432274bf16 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:28.307377 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-693330b2-ce34-4c27-b88b-f8432274bf16 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:28.307972 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-693330b2-ce34-4c27-b88b-f8432274bf16 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:28.622544 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-72c17b36-4c15-4c74-9b75-588bee69fa0a tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a03cc5956ca477abacbe0c26bf18750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea45d1b678342ed812f9912e9f07503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:28.630343 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-72c17b36-4c15-4c74-9b75-588bee69fa0a tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] 10.222.0.61 "GET /compute/v2.1/servers/1dd3a7d9-7ff6-4b6f-b279-ca90c9ddb14b" status: 200 len: 1469 microversion: 2.1 time: 0.767463 Aug 31 16:00:28.630918 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 625/1263] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:27 2022] GET /compute/v2.1/servers/1dd3a7d9-7ff6-4b6f-b279-ca90c9ddb14b => generated 1469 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:28.635995 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ca6e0840-fc99-48f1-82da-0e10e406c8fd tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:28.636929 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ca6e0840-fc99-48f1-82da-0e10e406c8fd tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] [instance: 7e37d5ca-7dc4-476e-803f-f61c6adfaeb4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:28.643028 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ca6e0840-fc99-48f1-82da-0e10e406c8fd tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:28.643531 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ca6e0840-fc99-48f1-82da-0e10e406c8fd tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:28.643977 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ca6e0840-fc99-48f1-82da-0e10e406c8fd tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:28.645202 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ca6e0840-fc99-48f1-82da-0e10e406c8fd tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:28.645856 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ca6e0840-fc99-48f1-82da-0e10e406c8fd tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:28.646268 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ca6e0840-fc99-48f1-82da-0e10e406c8fd tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:28.674772 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-693330b2-ce34-4c27-b88b-f8432274bf16 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ccd03a4aa84f93bc26b438e1468f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a9f3fcc4b445349e5c66ff712e8598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:28.684787 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-693330b2-ce34-4c27-b88b-f8432274bf16 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/servers/5f29cff7-a675-40c2-a0e5-2a62994be45a" status: 200 len: 1308 microversion: 2.1 time: 0.390255 Aug 31 16:00:28.685595 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 639/1264] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:28 2022] GET /compute/v2.1/servers/5f29cff7-a675-40c2-a0e5-2a62994be45a => generated 1308 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:28.971208 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ca6e0840-fc99-48f1-82da-0e10e406c8fd tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccce16c7fda401ea68fb31ea8099d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed252ebf7c741bbb36b553ac1767579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:28.979218 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ca6e0840-fc99-48f1-82da-0e10e406c8fd tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "GET /compute/v2.1/servers/7e37d5ca-7dc4-476e-803f-f61c6adfaeb4" status: 200 len: 1325 microversion: 2.1 time: 0.347094 Aug 31 16:00:28.979837 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 626/1265] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:28 2022] GET /compute/v2.1/servers/7e37d5ca-7dc4-476e-803f-f61c6adfaeb4 => generated 1325 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:29.191067 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-e8e9c54a-6773-4cf4-b500-2a22bdb60ce5 req-0a6a4fa3-3806-4448-857a-6b326a2462b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dd3a7d9-7ff6-4b6f-b279-ca90c9ddb14b", "name": "network-vif-deleted", "tag": "e68da150-24be-4678-ae6d-b32e1c8fd505"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:00:29.204211 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-e8e9c54a-6773-4cf4-b500-2a22bdb60ce5 req-0a6a4fa3-3806-4448-857a-6b326a2462b5 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:29.204863 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-e8e9c54a-6773-4cf4-b500-2a22bdb60ce5 req-0a6a4fa3-3806-4448-857a-6b326a2462b5 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:29.205405 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-e8e9c54a-6773-4cf4-b500-2a22bdb60ce5 req-0a6a4fa3-3806-4448-857a-6b326a2462b5 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:29.234199 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-e8e9c54a-6773-4cf4-b500-2a22bdb60ce5 req-0a6a4fa3-3806-4448-857a-6b326a2462b5 service nova] Creating event network-vif-deleted:e68da150-24be-4678-ae6d-b32e1c8fd505 for instance 1dd3a7d9-7ff6-4b6f-b279-ca90c9ddb14b on n-h2-850499-9 Aug 31 16:00:29.244421 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-e8e9c54a-6773-4cf4-b500-2a22bdb60ce5 req-0a6a4fa3-3806-4448-857a-6b326a2462b5 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057510 Aug 31 16:00:29.245574 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 640/1266] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:00:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:00:29.327025 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c975c36c-9809-47dd-b87a-56a59288aafd tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:29.327937 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c975c36c-9809-47dd-b87a-56a59288aafd tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:29.340715 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c975c36c-9809-47dd-b87a-56a59288aafd tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:29.342435 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c975c36c-9809-47dd-b87a-56a59288aafd tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:29.343087 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c975c36c-9809-47dd-b87a-56a59288aafd tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:29.344051 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c975c36c-9809-47dd-b87a-56a59288aafd tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:29.344518 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c975c36c-9809-47dd-b87a-56a59288aafd tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:29.344946 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c975c36c-9809-47dd-b87a-56a59288aafd tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:29.476511 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c975c36c-9809-47dd-b87a-56a59288aafd tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:29.497292 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c975c36c-9809-47dd-b87a-56a59288aafd tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:29.498762 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c975c36c-9809-47dd-b87a-56a59288aafd tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:29.529708 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c975c36c-9809-47dd-b87a-56a59288aafd tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1539 microversion: 2.91 time: 0.213268 Aug 31 16:00:29.532254 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 627/1267] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:00:29 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1539 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:00:29.658372 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a7b2b788-28b0-4053-9885-9052b485f6b7 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:29.659369 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a7b2b788-28b0-4053-9885-9052b485f6b7 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] [instance: 1dd3a7d9-7ff6-4b6f-b279-ca90c9ddb14b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:29.668164 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a7b2b788-28b0-4053-9885-9052b485f6b7 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:29.668897 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a7b2b788-28b0-4053-9885-9052b485f6b7 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:29.669891 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a7b2b788-28b0-4053-9885-9052b485f6b7 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:29.670585 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a7b2b788-28b0-4053-9885-9052b485f6b7 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:29.671698 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a7b2b788-28b0-4053-9885-9052b485f6b7 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:29.672203 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a7b2b788-28b0-4053-9885-9052b485f6b7 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:29.707478 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6bab9319-44d6-4f04-8d1a-e016b36060ba tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:29.708184 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6bab9319-44d6-4f04-8d1a-e016b36060ba tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: 5f29cff7-a675-40c2-a0e5-2a62994be45a] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:29.711859 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:00:29.720395 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6bab9319-44d6-4f04-8d1a-e016b36060ba tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:29.721009 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6bab9319-44d6-4f04-8d1a-e016b36060ba tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:29.721678 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6bab9319-44d6-4f04-8d1a-e016b36060ba tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:29.722525 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6bab9319-44d6-4f04-8d1a-e016b36060ba tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:29.724673 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a7b2b788-28b0-4053-9885-9052b485f6b7 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:29.725178 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a7b2b788-28b0-4053-9885-9052b485f6b7 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:29.725345 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6bab9319-44d6-4f04-8d1a-e016b36060ba tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:29.725916 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6bab9319-44d6-4f04-8d1a-e016b36060ba tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:29.726062 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a7b2b788-28b0-4053-9885-9052b485f6b7 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:29.726694 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-a7b2b788-28b0-4053-9885-9052b485f6b7 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lazy-loading 'fault' on Instance uuid 1dd3a7d9-7ff6-4b6f-b279-ca90c9ddb14b {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:00:29.812166 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a7b2b788-28b0-4053-9885-9052b485f6b7 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a03cc5956ca477abacbe0c26bf18750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea45d1b678342ed812f9912e9f07503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:29.823282 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a7b2b788-28b0-4053-9885-9052b485f6b7 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] 10.222.0.61 "GET /compute/v2.1/servers/1dd3a7d9-7ff6-4b6f-b279-ca90c9ddb14b" status: 200 len: 1304 microversion: 2.1 time: 0.172951 Aug 31 16:00:29.824930 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 641/1268] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:29 2022] GET /compute/v2.1/servers/1dd3a7d9-7ff6-4b6f-b279-ca90c9ddb14b => generated 1304 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:30.004303 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-6bab9319-44d6-4f04-8d1a-e016b36060ba tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ccd03a4aa84f93bc26b438e1468f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a9f3fcc4b445349e5c66ff712e8598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:30.004811 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-36b4f52e-ea14-4066-bf35-1de544e26ce2 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:30.005327 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-36b4f52e-ea14-4066-bf35-1de544e26ce2 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] [instance: 7e37d5ca-7dc4-476e-803f-f61c6adfaeb4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:30.019174 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6bab9319-44d6-4f04-8d1a-e016b36060ba tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/servers/5f29cff7-a675-40c2-a0e5-2a62994be45a" status: 200 len: 1308 microversion: 2.1 time: 0.316840 Aug 31 16:00:30.031522 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 628/1269] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:29 2022] GET /compute/v2.1/servers/5f29cff7-a675-40c2-a0e5-2a62994be45a => generated 1308 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:30.039939 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-36b4f52e-ea14-4066-bf35-1de544e26ce2 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:30.040441 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-36b4f52e-ea14-4066-bf35-1de544e26ce2 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:30.041179 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-36b4f52e-ea14-4066-bf35-1de544e26ce2 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:30.041991 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-36b4f52e-ea14-4066-bf35-1de544e26ce2 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:30.042484 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-36b4f52e-ea14-4066-bf35-1de544e26ce2 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:30.043177 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-36b4f52e-ea14-4066-bf35-1de544e26ce2 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:30.308922 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-36b4f52e-ea14-4066-bf35-1de544e26ce2 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccce16c7fda401ea68fb31ea8099d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed252ebf7c741bbb36b553ac1767579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:30.316744 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-36b4f52e-ea14-4066-bf35-1de544e26ce2 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "GET /compute/v2.1/servers/7e37d5ca-7dc4-476e-803f-f61c6adfaeb4" status: 200 len: 1325 microversion: 2.1 time: 0.319706 Aug 31 16:00:30.317431 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 642/1270] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:29 2022] GET /compute/v2.1/servers/7e37d5ca-7dc4-476e-803f-f61c6adfaeb4 => generated 1325 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:30.558527 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d8352c6e-ffc2-4907-929e-a37d0cf718cd tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:30.559047 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d8352c6e-ffc2-4907-929e-a37d0cf718cd tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:30.565663 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d8352c6e-ffc2-4907-929e-a37d0cf718cd tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:30.566546 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d8352c6e-ffc2-4907-929e-a37d0cf718cd tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:30.567316 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d8352c6e-ffc2-4907-929e-a37d0cf718cd tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:30.567801 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d8352c6e-ffc2-4907-929e-a37d0cf718cd tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:30.568267 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d8352c6e-ffc2-4907-929e-a37d0cf718cd tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:30.568696 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d8352c6e-ffc2-4907-929e-a37d0cf718cd tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:30.647311 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d8352c6e-ffc2-4907-929e-a37d0cf718cd tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:30.658354 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d8352c6e-ffc2-4907-929e-a37d0cf718cd tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:30.659996 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d8352c6e-ffc2-4907-929e-a37d0cf718cd tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:30.666543 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d8352c6e-ffc2-4907-929e-a37d0cf718cd tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1539 microversion: 2.91 time: 0.112034 Aug 31 16:00:30.668127 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 629/1271] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:00:30 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1539 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:00:30.847557 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9dce1626-ab56-4a37-a547-7ba0116b539e tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:30.849379 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9dce1626-ab56-4a37-a547-7ba0116b539e tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] [instance: 1dd3a7d9-7ff6-4b6f-b279-ca90c9ddb14b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:30.857596 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9dce1626-ab56-4a37-a547-7ba0116b539e tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:30.858463 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9dce1626-ab56-4a37-a547-7ba0116b539e tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:30.859762 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9dce1626-ab56-4a37-a547-7ba0116b539e tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:30.860687 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9dce1626-ab56-4a37-a547-7ba0116b539e tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:30.861721 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9dce1626-ab56-4a37-a547-7ba0116b539e tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:30.862412 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9dce1626-ab56-4a37-a547-7ba0116b539e tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:30.886349 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-9dce1626-ab56-4a37-a547-7ba0116b539e tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] HTTP exception thrown: Instance 1dd3a7d9-7ff6-4b6f-b279-ca90c9ddb14b could not be found. Aug 31 16:00:30.888882 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9dce1626-ab56-4a37-a547-7ba0116b539e tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Request method failure captured: Aug 31 16:00:30.888882 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/1dd3a7d9-7ff6-4b6f-b279-ca90c9ddb14b HTTP/1.1 Aug 31 16:00:30.888882 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:00:30.888882 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:00:30.888882 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:00:30.888882 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:00:30.888882 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:00:30.888882 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:00:30.888882 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:00:30.888882 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:00:30.888882 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4UJA3WPepVwarZS0sSIE46Nziy9LlBy2vW05COgmKCRU0RKUloP0WsXkrjXKBvbN3vzXwnwt-7K0QVbTwPTTTLBiIgxWGHfmVQsdWf3p5eVuFcn_ZZjszf8SxoabHZQfkvfWOhRB6d5WKqyubNiekLkefcBwSwPFWl6XkpOPtU5Rqk Aug 31 16:00:30.888882 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:00:30.888882 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:00:30.888882 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:00:30.888882 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:00:30.888882 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:00:30.888882 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:00:30.888882 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 1ea45d1b678342ed812f9912e9f07503 Aug 31 16:00:30.888882 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ServersAdminTestJSON-2071688862 Aug 31 16:00:30.888882 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:00:30.888882 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:00:30.890280 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1ea45d1b678342ed812f9912e9f07503"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1ea45d1b678342ed812f9912e9f07503"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1ea45d1b678342ed812f9912e9f07503", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1ea45d1b678342ed812f9912e9f07503"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:00:30.890280 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ServersAdminTestJSON-2071688862 Aug 31 16:00:30.890280 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 1ea45d1b678342ed812f9912e9f07503 Aug 31 16:00:30.890280 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ServersAdminTestJSON-2071688862 Aug 31 16:00:30.890280 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ServersAdminTestJSON-2071688862-project Aug 31 16:00:30.890280 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:00:30.890280 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:00:30.890280 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 9a03cc5956ca477abacbe0c26bf18750 Aug 31 16:00:30.890280 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ServersAdminTestJSON-2071688862-project Aug 31 16:00:30.890280 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:00:30.890280 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance 1dd3a7d9-7ff6-4b6f-b279-ca90c9ddb14b could not be found. Aug 31 16:00:30.890280 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '1dd3a7d9-7ff6-4b6f-b279-ca90c9ddb14b'} Aug 31 16:00:30.891197 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:00:30.891197 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:30.891197 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:00:30.891197 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:00:30.891197 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:00:30.891197 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:00:30.891197 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:00:30.891197 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:00:30.891197 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:00:30.891197 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:00:30.891197 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1dd3a7d9-7ff6-4b6f-b279-ca90c9ddb14b could not be found. Aug 31 16:00:30.891197 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:00:30.891197 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:30.891197 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:00:30.891197 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:30.891197 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:30.891197 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:30.891197 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:00:30.891197 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:00:30.891197 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:00:30.893454 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:00:30.893454 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:00:30.893454 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:00:30.893454 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:00:30.893454 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:00:30.893454 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:00:30.893454 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:00:30.893454 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1dd3a7d9-7ff6-4b6f-b279-ca90c9ddb14b could not be found. Aug 31 16:00:30.893454 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:00:30.893454 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:30.893454 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:00:30.893454 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:30.893454 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:30.893454 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:30.893454 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:00:30.893454 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:00:30.893454 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1dd3a7d9-7ff6-4b6f-b279-ca90c9ddb14b could not be found. Aug 31 16:00:30.893454 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:00:30.897077 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9dce1626-ab56-4a37-a547-7ba0116b539e tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Returning 404 to user: Instance 1dd3a7d9-7ff6-4b6f-b279-ca90c9ddb14b could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:00:30.898194 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9dce1626-ab56-4a37-a547-7ba0116b539e tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] 10.222.0.61 "GET /compute/v2.1/servers/1dd3a7d9-7ff6-4b6f-b279-ca90c9ddb14b" status: 404 len: 111 microversion: 2.1 time: 0.056221 Aug 31 16:00:30.901928 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 643/1272] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:30 2022] GET /compute/v2.1/servers/1dd3a7d9-7ff6-4b6f-b279-ca90c9ddb14b => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:00:30.912297 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-80f44dce-47aa-4fe1-995d-6ef2eebff72d tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:30.913198 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-80f44dce-47aa-4fe1-995d-6ef2eebff72d tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] [instance: e45fa8b9-1545-4bd5-aa5f-402c71ec19c6] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:30.921100 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-80f44dce-47aa-4fe1-995d-6ef2eebff72d tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:30.921739 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-80f44dce-47aa-4fe1-995d-6ef2eebff72d tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:30.922271 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-80f44dce-47aa-4fe1-995d-6ef2eebff72d tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:30.923079 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-80f44dce-47aa-4fe1-995d-6ef2eebff72d tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:30.923694 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-80f44dce-47aa-4fe1-995d-6ef2eebff72d tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:30.924340 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-80f44dce-47aa-4fe1-995d-6ef2eebff72d tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:30.961061 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-80f44dce-47aa-4fe1-995d-6ef2eebff72d tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] [instance: e45fa8b9-1545-4bd5-aa5f-402c71ec19c6] Going to try to terminate instance {{(pid=122256) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:00:31.046347 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-12ed86e1-a25e-429e-9bfd-d9cb1ac3e12a tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:31.047412 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-12ed86e1-a25e-429e-9bfd-d9cb1ac3e12a tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: 5f29cff7-a675-40c2-a0e5-2a62994be45a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:31.056999 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-12ed86e1-a25e-429e-9bfd-d9cb1ac3e12a tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:31.057638 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-12ed86e1-a25e-429e-9bfd-d9cb1ac3e12a tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:31.058313 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-12ed86e1-a25e-429e-9bfd-d9cb1ac3e12a tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:31.059677 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-12ed86e1-a25e-429e-9bfd-d9cb1ac3e12a tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:31.060358 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-12ed86e1-a25e-429e-9bfd-d9cb1ac3e12a tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:31.061028 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-12ed86e1-a25e-429e-9bfd-d9cb1ac3e12a tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:31.102112 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-80f44dce-47aa-4fe1-995d-6ef2eebff72d tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] 10.222.0.61 "DELETE /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6" status: 204 len: 0 microversion: 2.1 time: 0.197371 Aug 31 16:00:31.106068 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 630/1273] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:00:30 2022] DELETE /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:00:31.115390 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9febee82-427d-4419-93fb-aaff117d6b66 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:31.116506 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9febee82-427d-4419-93fb-aaff117d6b66 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] [instance: e45fa8b9-1545-4bd5-aa5f-402c71ec19c6] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:31.124535 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9febee82-427d-4419-93fb-aaff117d6b66 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:31.125269 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9febee82-427d-4419-93fb-aaff117d6b66 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:31.125727 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9febee82-427d-4419-93fb-aaff117d6b66 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:31.126623 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9febee82-427d-4419-93fb-aaff117d6b66 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:31.127322 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9febee82-427d-4419-93fb-aaff117d6b66 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:31.128155 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9febee82-427d-4419-93fb-aaff117d6b66 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:31.362632 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-12ed86e1-a25e-429e-9bfd-d9cb1ac3e12a tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ccd03a4aa84f93bc26b438e1468f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a9f3fcc4b445349e5c66ff712e8598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:31.370904 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-12ed86e1-a25e-429e-9bfd-d9cb1ac3e12a tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/servers/5f29cff7-a675-40c2-a0e5-2a62994be45a" status: 200 len: 1308 microversion: 2.1 time: 0.330493 Aug 31 16:00:31.383526 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-9febee82-427d-4419-93fb-aaff117d6b66 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a03cc5956ca477abacbe0c26bf18750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea45d1b678342ed812f9912e9f07503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:31.384198 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 644/1274] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:31 2022] GET /compute/v2.1/servers/5f29cff7-a675-40c2-a0e5-2a62994be45a => generated 1308 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:31.392073 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-a97f82aa-f817-4613-a55b-98fa71e315cf req-5de777ad-1839-4774-bea3-01e4f696a231 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f29cff7-a675-40c2-a0e5-2a62994be45a", "name": "network-vif-plugged", "status": "completed", "tag": "5aedd1b8-fd73-4d4f-8c6e-c030265971d4"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:00:31.398657 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9febee82-427d-4419-93fb-aaff117d6b66 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] 10.222.0.61 "GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6" status: 200 len: 1470 microversion: 2.1 time: 0.291157 Aug 31 16:00:31.399400 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 631/1275] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:31 2022] GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6 => generated 1470 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:00:31.403782 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-a97f82aa-f817-4613-a55b-98fa71e315cf req-5de777ad-1839-4774-bea3-01e4f696a231 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:31.403950 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-537d2af1-6e62-4387-80d3-c0b1a4ecde8a tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:31.404523 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-537d2af1-6e62-4387-80d3-c0b1a4ecde8a tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] [instance: 7e37d5ca-7dc4-476e-803f-f61c6adfaeb4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:31.404911 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-a97f82aa-f817-4613-a55b-98fa71e315cf req-5de777ad-1839-4774-bea3-01e4f696a231 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:31.405419 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-a97f82aa-f817-4613-a55b-98fa71e315cf req-5de777ad-1839-4774-bea3-01e4f696a231 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:31.411680 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-537d2af1-6e62-4387-80d3-c0b1a4ecde8a tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:31.412170 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-537d2af1-6e62-4387-80d3-c0b1a4ecde8a tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:31.412606 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-537d2af1-6e62-4387-80d3-c0b1a4ecde8a tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:31.413344 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-537d2af1-6e62-4387-80d3-c0b1a4ecde8a tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:31.413870 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-537d2af1-6e62-4387-80d3-c0b1a4ecde8a tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:31.414304 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-537d2af1-6e62-4387-80d3-c0b1a4ecde8a tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:31.418593 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-a97f82aa-f817-4613-a55b-98fa71e315cf req-5de777ad-1839-4774-bea3-01e4f696a231 service nova] Creating event network-vif-plugged:5aedd1b8-fd73-4d4f-8c6e-c030265971d4 for instance 5f29cff7-a675-40c2-a0e5-2a62994be45a on n-h1-850499-9 Aug 31 16:00:31.424158 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-a97f82aa-f817-4613-a55b-98fa71e315cf req-5de777ad-1839-4774-bea3-01e4f696a231 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038455 Aug 31 16:00:31.424864 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 645/1276] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:00:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:00:31.694969 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e459fabd-8f2a-4640-ade6-f30ef92b4836 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:31.695715 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e459fabd-8f2a-4640-ade6-f30ef92b4836 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:31.702084 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e459fabd-8f2a-4640-ade6-f30ef92b4836 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:31.702567 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e459fabd-8f2a-4640-ade6-f30ef92b4836 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:31.703001 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e459fabd-8f2a-4640-ade6-f30ef92b4836 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:31.703729 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e459fabd-8f2a-4640-ade6-f30ef92b4836 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:31.704182 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e459fabd-8f2a-4640-ade6-f30ef92b4836 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:31.704601 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e459fabd-8f2a-4640-ade6-f30ef92b4836 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:31.713913 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-537d2af1-6e62-4387-80d3-c0b1a4ecde8a tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccce16c7fda401ea68fb31ea8099d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed252ebf7c741bbb36b553ac1767579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:31.724176 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-537d2af1-6e62-4387-80d3-c0b1a4ecde8a tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "GET /compute/v2.1/servers/7e37d5ca-7dc4-476e-803f-f61c6adfaeb4" status: 200 len: 1325 microversion: 2.1 time: 0.322577 Aug 31 16:00:31.724964 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 632/1277] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:31 2022] GET /compute/v2.1/servers/7e37d5ca-7dc4-476e-803f-f61c6adfaeb4 => generated 1325 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:31.798583 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e459fabd-8f2a-4640-ade6-f30ef92b4836 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:31.807830 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e459fabd-8f2a-4640-ade6-f30ef92b4836 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:31.809296 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e459fabd-8f2a-4640-ade6-f30ef92b4836 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:31.812325 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=4,nova_api:UPDATE=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:00:31.815412 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e459fabd-8f2a-4640-ade6-f30ef92b4836 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1560 microversion: 2.91 time: 0.124885 Aug 31 16:00:31.816123 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 646/1278] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:00:31 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1560 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:00:32.407680 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-59944305-273d-41b0-a8d9-2ab09a35362f tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:32.408316 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-59944305-273d-41b0-a8d9-2ab09a35362f tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: 5f29cff7-a675-40c2-a0e5-2a62994be45a] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:32.416696 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-59944305-273d-41b0-a8d9-2ab09a35362f tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:32.417434 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-59944305-273d-41b0-a8d9-2ab09a35362f tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:32.418156 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-59944305-273d-41b0-a8d9-2ab09a35362f tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:32.419089 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-59944305-273d-41b0-a8d9-2ab09a35362f tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:32.419666 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-59944305-273d-41b0-a8d9-2ab09a35362f tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:32.420224 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-59944305-273d-41b0-a8d9-2ab09a35362f tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:32.421317 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-989e3681-5534-4ea3-8021-19325927cd85 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:32.421808 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-989e3681-5534-4ea3-8021-19325927cd85 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] [instance: e45fa8b9-1545-4bd5-aa5f-402c71ec19c6] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:32.430601 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-989e3681-5534-4ea3-8021-19325927cd85 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:32.444401 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-989e3681-5534-4ea3-8021-19325927cd85 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:32.445009 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-989e3681-5534-4ea3-8021-19325927cd85 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:32.445776 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-989e3681-5534-4ea3-8021-19325927cd85 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:32.446261 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-989e3681-5534-4ea3-8021-19325927cd85 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:32.446777 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-989e3681-5534-4ea3-8021-19325927cd85 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:32.648702 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-59944305-273d-41b0-a8d9-2ab09a35362f tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ccd03a4aa84f93bc26b438e1468f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a9f3fcc4b445349e5c66ff712e8598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:32.657235 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-59944305-273d-41b0-a8d9-2ab09a35362f tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/servers/5f29cff7-a675-40c2-a0e5-2a62994be45a" status: 200 len: 1308 microversion: 2.1 time: 0.263703 Aug 31 16:00:32.657829 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 633/1279] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:32 2022] GET /compute/v2.1/servers/5f29cff7-a675-40c2-a0e5-2a62994be45a => generated 1308 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:32.660538 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-989e3681-5534-4ea3-8021-19325927cd85 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a03cc5956ca477abacbe0c26bf18750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea45d1b678342ed812f9912e9f07503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:32.668939 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-989e3681-5534-4ea3-8021-19325927cd85 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] 10.222.0.61 "GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6" status: 200 len: 1470 microversion: 2.1 time: 0.251820 Aug 31 16:00:32.670353 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 647/1280] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:32 2022] GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6 => generated 1470 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:32.751587 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0e482aa6-62a4-4825-84c9-49fd02d200fd tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:32.752228 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0e482aa6-62a4-4825-84c9-49fd02d200fd tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] [instance: 7e37d5ca-7dc4-476e-803f-f61c6adfaeb4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:32.760351 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0e482aa6-62a4-4825-84c9-49fd02d200fd tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:32.760869 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0e482aa6-62a4-4825-84c9-49fd02d200fd tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:32.761310 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0e482aa6-62a4-4825-84c9-49fd02d200fd tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:32.762050 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0e482aa6-62a4-4825-84c9-49fd02d200fd tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:32.762622 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0e482aa6-62a4-4825-84c9-49fd02d200fd tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:32.763073 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0e482aa6-62a4-4825-84c9-49fd02d200fd tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:32.842551 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-91fa98a1-e725-4061-86ae-d897858ac6d1 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:32.843293 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-91fa98a1-e725-4061-86ae-d897858ac6d1 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:32.849936 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-91fa98a1-e725-4061-86ae-d897858ac6d1 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:32.850534 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-91fa98a1-e725-4061-86ae-d897858ac6d1 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:32.851075 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-91fa98a1-e725-4061-86ae-d897858ac6d1 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:32.851912 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-91fa98a1-e725-4061-86ae-d897858ac6d1 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:32.852619 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-91fa98a1-e725-4061-86ae-d897858ac6d1 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:32.853117 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-91fa98a1-e725-4061-86ae-d897858ac6d1 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:32.858007 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:00:32.943588 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-91fa98a1-e725-4061-86ae-d897858ac6d1 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:32.952110 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-91fa98a1-e725-4061-86ae-d897858ac6d1 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:32.953577 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-91fa98a1-e725-4061-86ae-d897858ac6d1 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:32.959262 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-91fa98a1-e725-4061-86ae-d897858ac6d1 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1560 microversion: 2.91 time: 0.120693 Aug 31 16:00:32.959757 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 648/1281] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:00:32 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1560 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:00:32.991813 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-0e482aa6-62a4-4825-84c9-49fd02d200fd tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccce16c7fda401ea68fb31ea8099d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed252ebf7c741bbb36b553ac1767579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:32.999766 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0e482aa6-62a4-4825-84c9-49fd02d200fd tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "GET /compute/v2.1/servers/7e37d5ca-7dc4-476e-803f-f61c6adfaeb4" status: 200 len: 1325 microversion: 2.1 time: 0.252052 Aug 31 16:00:33.000527 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 634/1282] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:32 2022] GET /compute/v2.1/servers/7e37d5ca-7dc4-476e-803f-f61c6adfaeb4 => generated 1325 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:33.550333 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-65704b03-3b59-4b84-8c40-754755dd3b73 req-7997b655-fb1e-4c9f-80a7-5f9a8314c1aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e45fa8b9-1545-4bd5-aa5f-402c71ec19c6", "name": "network-vif-deleted", "tag": "935e822d-4171-4348-8a87-c6e76ab1ea4f"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:00:33.568506 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-65704b03-3b59-4b84-8c40-754755dd3b73 req-7997b655-fb1e-4c9f-80a7-5f9a8314c1aa service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:33.569747 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-65704b03-3b59-4b84-8c40-754755dd3b73 req-7997b655-fb1e-4c9f-80a7-5f9a8314c1aa service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:33.570508 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-65704b03-3b59-4b84-8c40-754755dd3b73 req-7997b655-fb1e-4c9f-80a7-5f9a8314c1aa service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:33.591840 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-65704b03-3b59-4b84-8c40-754755dd3b73 req-7997b655-fb1e-4c9f-80a7-5f9a8314c1aa service nova] Creating event network-vif-deleted:935e822d-4171-4348-8a87-c6e76ab1ea4f for instance e45fa8b9-1545-4bd5-aa5f-402c71ec19c6 on n-h2-850499-9 Aug 31 16:00:33.607046 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-65704b03-3b59-4b84-8c40-754755dd3b73 req-7997b655-fb1e-4c9f-80a7-5f9a8314c1aa service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061840 Aug 31 16:00:33.609803 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 649/1283] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:00:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:00:33.681060 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9bd8505a-3e6c-4105-98d1-733a3b0de7ec tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:33.682962 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9bd8505a-3e6c-4105-98d1-733a3b0de7ec tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: 5f29cff7-a675-40c2-a0e5-2a62994be45a] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:33.693072 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1e4940bc-067e-48d8-8786-5c182d0e3ea5 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:33.693882 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1e4940bc-067e-48d8-8786-5c182d0e3ea5 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] [instance: e45fa8b9-1545-4bd5-aa5f-402c71ec19c6] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:33.703405 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1e4940bc-067e-48d8-8786-5c182d0e3ea5 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:33.703892 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9bd8505a-3e6c-4105-98d1-733a3b0de7ec tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:33.704386 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1e4940bc-067e-48d8-8786-5c182d0e3ea5 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:33.704515 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9bd8505a-3e6c-4105-98d1-733a3b0de7ec tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:33.704837 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1e4940bc-067e-48d8-8786-5c182d0e3ea5 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:33.705211 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9bd8505a-3e6c-4105-98d1-733a3b0de7ec tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:33.706087 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1e4940bc-067e-48d8-8786-5c182d0e3ea5 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:33.706449 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9bd8505a-3e6c-4105-98d1-733a3b0de7ec tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:33.706565 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1e4940bc-067e-48d8-8786-5c182d0e3ea5 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:33.707293 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9bd8505a-3e6c-4105-98d1-733a3b0de7ec tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:33.707542 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1e4940bc-067e-48d8-8786-5c182d0e3ea5 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:33.708041 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9bd8505a-3e6c-4105-98d1-733a3b0de7ec tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:33.715019 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:00:33.801268 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1e4940bc-067e-48d8-8786-5c182d0e3ea5 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:33.802040 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1e4940bc-067e-48d8-8786-5c182d0e3ea5 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:33.803942 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1e4940bc-067e-48d8-8786-5c182d0e3ea5 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:33.805570 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-1e4940bc-067e-48d8-8786-5c182d0e3ea5 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lazy-loading 'fault' on Instance uuid e45fa8b9-1545-4bd5-aa5f-402c71ec19c6 {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:00:33.881886 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-1e4940bc-067e-48d8-8786-5c182d0e3ea5 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a03cc5956ca477abacbe0c26bf18750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea45d1b678342ed812f9912e9f07503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:33.890706 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1e4940bc-067e-48d8-8786-5c182d0e3ea5 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] 10.222.0.61 "GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6" status: 200 len: 1304 microversion: 2.1 time: 0.203835 Aug 31 16:00:33.891819 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 650/1284] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:33 2022] GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6 => generated 1304 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:00:33.980229 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-9bd8505a-3e6c-4105-98d1-733a3b0de7ec tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ccd03a4aa84f93bc26b438e1468f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a9f3fcc4b445349e5c66ff712e8598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:33.987579 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d5e3263a-4c95-4605-a88a-e52bb24b54d1 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:33.988707 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d5e3263a-4c95-4605-a88a-e52bb24b54d1 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:33.992420 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9bd8505a-3e6c-4105-98d1-733a3b0de7ec tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/servers/5f29cff7-a675-40c2-a0e5-2a62994be45a" status: 200 len: 1308 microversion: 2.1 time: 0.318154 Aug 31 16:00:34.007557 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d5e3263a-4c95-4605-a88a-e52bb24b54d1 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:34.007557 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d5e3263a-4c95-4605-a88a-e52bb24b54d1 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:34.008077 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 635/1285] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:33 2022] GET /compute/v2.1/servers/5f29cff7-a675-40c2-a0e5-2a62994be45a => generated 1308 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:34.008161 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d5e3263a-4c95-4605-a88a-e52bb24b54d1 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:34.008161 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d5e3263a-4c95-4605-a88a-e52bb24b54d1 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:34.008161 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d5e3263a-4c95-4605-a88a-e52bb24b54d1 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:34.008161 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d5e3263a-4c95-4605-a88a-e52bb24b54d1 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:34.021348 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f6facdd2-090d-4265-b08c-1ea618af5300 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:34.022623 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f6facdd2-090d-4265-b08c-1ea618af5300 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] [instance: 7e37d5ca-7dc4-476e-803f-f61c6adfaeb4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:34.033205 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f6facdd2-090d-4265-b08c-1ea618af5300 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:34.033720 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f6facdd2-090d-4265-b08c-1ea618af5300 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:34.034157 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f6facdd2-090d-4265-b08c-1ea618af5300 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:34.040042 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f6facdd2-090d-4265-b08c-1ea618af5300 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:34.042277 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f6facdd2-090d-4265-b08c-1ea618af5300 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:34.043464 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f6facdd2-090d-4265-b08c-1ea618af5300 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:34.140136 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d5e3263a-4c95-4605-a88a-e52bb24b54d1 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:34.152874 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d5e3263a-4c95-4605-a88a-e52bb24b54d1 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:34.155021 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d5e3263a-4c95-4605-a88a-e52bb24b54d1 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:34.165376 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d5e3263a-4c95-4605-a88a-e52bb24b54d1 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1560 microversion: 2.91 time: 0.182283 Aug 31 16:00:34.165894 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 651/1286] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:00:33 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1560 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:00:34.265354 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f6facdd2-090d-4265-b08c-1ea618af5300 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccce16c7fda401ea68fb31ea8099d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed252ebf7c741bbb36b553ac1767579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:34.276594 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f6facdd2-090d-4265-b08c-1ea618af5300 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "GET /compute/v2.1/servers/7e37d5ca-7dc4-476e-803f-f61c6adfaeb4" status: 200 len: 1325 microversion: 2.1 time: 0.259971 Aug 31 16:00:34.277187 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 636/1287] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:34 2022] GET /compute/v2.1/servers/7e37d5ca-7dc4-476e-803f-f61c6adfaeb4 => generated 1325 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:00:34.915131 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5d945cba-178b-40a6-89ea-7e29b0ee0344 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:34.915877 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5d945cba-178b-40a6-89ea-7e29b0ee0344 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] [instance: e45fa8b9-1545-4bd5-aa5f-402c71ec19c6] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:34.921975 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5d945cba-178b-40a6-89ea-7e29b0ee0344 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:34.922382 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5d945cba-178b-40a6-89ea-7e29b0ee0344 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:34.922822 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5d945cba-178b-40a6-89ea-7e29b0ee0344 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:34.923884 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5d945cba-178b-40a6-89ea-7e29b0ee0344 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:34.924353 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5d945cba-178b-40a6-89ea-7e29b0ee0344 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:34.924781 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5d945cba-178b-40a6-89ea-7e29b0ee0344 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:34.940171 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-5d945cba-178b-40a6-89ea-7e29b0ee0344 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] HTTP exception thrown: Instance e45fa8b9-1545-4bd5-aa5f-402c71ec19c6 could not be found. Aug 31 16:00:34.942365 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5d945cba-178b-40a6-89ea-7e29b0ee0344 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Request method failure captured: Aug 31 16:00:34.942365 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6 HTTP/1.1 Aug 31 16:00:34.942365 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:00:34.942365 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:00:34.942365 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:00:34.942365 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:00:34.942365 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:00:34.942365 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:00:34.942365 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:00:34.942365 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:00:34.942365 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4UJA3WPepVwarZS0sSIE46Nziy9LlBy2vW05COgmKCRU0RKUloP0WsXkrjXKBvbN3vzXwnwt-7K0QVbTwPTTTLBiIgxWGHfmVQsdWf3p5eVuFcn_ZZjszf8SxoabHZQfkvfWOhRB6d5WKqyubNiekLkefcBwSwPFWl6XkpOPtU5Rqk Aug 31 16:00:34.942365 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:00:34.942365 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:00:34.942365 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:00:34.942365 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:00:34.942365 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:00:34.942365 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:00:34.942365 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 1ea45d1b678342ed812f9912e9f07503 Aug 31 16:00:34.942365 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ServersAdminTestJSON-2071688862 Aug 31 16:00:34.942365 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:00:34.942365 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:00:34.944034 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1ea45d1b678342ed812f9912e9f07503"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1ea45d1b678342ed812f9912e9f07503"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1ea45d1b678342ed812f9912e9f07503", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1ea45d1b678342ed812f9912e9f07503"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:00:34.944034 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ServersAdminTestJSON-2071688862 Aug 31 16:00:34.944034 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 1ea45d1b678342ed812f9912e9f07503 Aug 31 16:00:34.944034 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ServersAdminTestJSON-2071688862 Aug 31 16:00:34.944034 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ServersAdminTestJSON-2071688862-project Aug 31 16:00:34.944034 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:00:34.944034 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:00:34.944034 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 9a03cc5956ca477abacbe0c26bf18750 Aug 31 16:00:34.944034 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ServersAdminTestJSON-2071688862-project Aug 31 16:00:34.944034 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:00:34.944034 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance e45fa8b9-1545-4bd5-aa5f-402c71ec19c6 could not be found. Aug 31 16:00:34.944034 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': 'e45fa8b9-1545-4bd5-aa5f-402c71ec19c6'} Aug 31 16:00:34.945245 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:00:34.945245 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:34.945245 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:00:34.945245 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:00:34.945245 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:00:34.945245 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:00:34.945245 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:00:34.945245 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:00:34.945245 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:00:34.945245 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:00:34.945245 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e45fa8b9-1545-4bd5-aa5f-402c71ec19c6 could not be found. Aug 31 16:00:34.945245 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:00:34.945245 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:34.945245 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:00:34.945245 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:34.945245 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:34.945245 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:34.945245 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:00:34.945245 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:00:34.945245 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:00:34.947031 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:00:34.947031 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:00:34.947031 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:00:34.947031 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:00:34.947031 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:00:34.947031 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:00:34.947031 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:00:34.947031 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e45fa8b9-1545-4bd5-aa5f-402c71ec19c6 could not be found. Aug 31 16:00:34.947031 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:00:34.947031 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:34.947031 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:00:34.947031 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:34.947031 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:34.947031 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:34.947031 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:00:34.947031 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:00:34.947031 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e45fa8b9-1545-4bd5-aa5f-402c71ec19c6 could not be found. Aug 31 16:00:34.947031 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:00:34.948943 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5d945cba-178b-40a6-89ea-7e29b0ee0344 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] Returning 404 to user: Instance e45fa8b9-1545-4bd5-aa5f-402c71ec19c6 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:00:34.948943 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5d945cba-178b-40a6-89ea-7e29b0ee0344 tempest-ServersAdminTestJSON-2071688862 tempest-ServersAdminTestJSON-2071688862-project] 10.222.0.61 "GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6" status: 404 len: 111 microversion: 2.1 time: 0.033745 Aug 31 16:00:34.948943 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 652/1288] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:34 2022] GET /compute/v2.1/servers/e45fa8b9-1545-4bd5-aa5f-402c71ec19c6 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 16:00:35.025218 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-fdd6b02f-6242-4727-9ad8-a3b4b586b777 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:35.025835 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-fdd6b02f-6242-4727-9ad8-a3b4b586b777 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: 5f29cff7-a675-40c2-a0e5-2a62994be45a] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:35.033586 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fdd6b02f-6242-4727-9ad8-a3b4b586b777 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:35.034094 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fdd6b02f-6242-4727-9ad8-a3b4b586b777 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:35.034529 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fdd6b02f-6242-4727-9ad8-a3b4b586b777 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:35.035326 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fdd6b02f-6242-4727-9ad8-a3b4b586b777 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:35.035907 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fdd6b02f-6242-4727-9ad8-a3b4b586b777 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:35.036335 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fdd6b02f-6242-4727-9ad8-a3b4b586b777 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:35.227385 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-fdd6b02f-6242-4727-9ad8-a3b4b586b777 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ccd03a4aa84f93bc26b438e1468f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a9f3fcc4b445349e5c66ff712e8598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:35.241156 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-fdd6b02f-6242-4727-9ad8-a3b4b586b777 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/servers/5f29cff7-a675-40c2-a0e5-2a62994be45a" status: 200 len: 1489 microversion: 2.1 time: 0.220590 Aug 31 16:00:35.241757 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 637/1289] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:35 2022] GET /compute/v2.1/servers/5f29cff7-a675-40c2-a0e5-2a62994be45a => generated 1489 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:35.246833 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-05e60f57-32ad-401f-b9ba-5f87f47fe71e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:35.247821 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-05e60f57-32ad-401f-b9ba-5f87f47fe71e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:35.255415 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-05e60f57-32ad-401f-b9ba-5f87f47fe71e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:35.256489 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-05e60f57-32ad-401f-b9ba-5f87f47fe71e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:35.257176 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-05e60f57-32ad-401f-b9ba-5f87f47fe71e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:35.258456 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-05e60f57-32ad-401f-b9ba-5f87f47fe71e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:35.259014 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-05e60f57-32ad-401f-b9ba-5f87f47fe71e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:35.259678 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-05e60f57-32ad-401f-b9ba-5f87f47fe71e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:35.341807 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-05e60f57-32ad-401f-b9ba-5f87f47fe71e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:35.354949 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-05e60f57-32ad-401f-b9ba-5f87f47fe71e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:35.358417 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-05e60f57-32ad-401f-b9ba-5f87f47fe71e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:35.385486 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-05e60f57-32ad-401f-b9ba-5f87f47fe71e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1560 microversion: 2.91 time: 0.135711 Aug 31 16:00:35.386168 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 638/1290] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:00:35 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1560 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:00:35.399721 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7c36f0c5-00d4-4593-8be7-7221beda80b2 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:00:35.400614 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7c36f0c5-00d4-4593-8be7-7221beda80b2 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: 5f29cff7-a675-40c2-a0e5-2a62994be45a] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:35.416727 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7c36f0c5-00d4-4593-8be7-7221beda80b2 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:35.417648 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7c36f0c5-00d4-4593-8be7-7221beda80b2 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:35.418425 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7c36f0c5-00d4-4593-8be7-7221beda80b2 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:35.419329 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7c36f0c5-00d4-4593-8be7-7221beda80b2 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:35.419985 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7c36f0c5-00d4-4593-8be7-7221beda80b2 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:35.420581 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7c36f0c5-00d4-4593-8be7-7221beda80b2 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:35.540183 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7c36f0c5-00d4-4593-8be7-7221beda80b2 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "POST /compute/v2.1/servers/5f29cff7-a675-40c2-a0e5-2a62994be45a/action" status: 202 len: 0 microversion: 2.1 time: 0.152416 Aug 31 16:00:35.541116 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 639/1291] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:00:35 2022] POST /compute/v2.1/servers/5f29cff7-a675-40c2-a0e5-2a62994be45a/action => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:00:35.557666 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-53a5429b-ba94-4782-8bd8-9da00cf4face tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:35.558632 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-53a5429b-ba94-4782-8bd8-9da00cf4face tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] [instance: 7e37d5ca-7dc4-476e-803f-f61c6adfaeb4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:35.569647 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-53a5429b-ba94-4782-8bd8-9da00cf4face tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:35.573213 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-53a5429b-ba94-4782-8bd8-9da00cf4face tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:35.573872 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-53a5429b-ba94-4782-8bd8-9da00cf4face tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:35.574815 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-53a5429b-ba94-4782-8bd8-9da00cf4face tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:35.575677 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-53a5429b-ba94-4782-8bd8-9da00cf4face tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:35.576377 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-53a5429b-ba94-4782-8bd8-9da00cf4face tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:35.578343 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-42c7eb31-fce6-405c-b3ac-c09dceef599b tempest-FlavorMetadataValidation-1253609019 tempest-FlavorMetadataValidation-1253609019-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-349369031", "id": 502977300, "os-flavor-access:is_public": "True"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:00:35.643731 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-42c7eb31-fce6-405c-b3ac-c09dceef599b tempest-FlavorMetadataValidation-1253609019 tempest-FlavorMetadataValidation-1253609019-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 467 microversion: 2.86 time: 0.456262 Aug 31 16:00:35.644413 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 653/1292] 10.222.0.61 () {62 vars in 1188 bytes} [Wed Aug 31 16:00:35 2022] POST /compute/v2.1/flavors => generated 467 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 16:00:35.672571 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d0d2ccee-5fa8-483e-a8b4-e526b14b8f12 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:35.674272 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d0d2ccee-5fa8-483e-a8b4-e526b14b8f12 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: 5f29cff7-a675-40c2-a0e5-2a62994be45a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:35.682322 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d0d2ccee-5fa8-483e-a8b4-e526b14b8f12 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:35.683109 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d0d2ccee-5fa8-483e-a8b4-e526b14b8f12 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:35.683739 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d0d2ccee-5fa8-483e-a8b4-e526b14b8f12 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:35.684777 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d0d2ccee-5fa8-483e-a8b4-e526b14b8f12 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:35.685812 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d0d2ccee-5fa8-483e-a8b4-e526b14b8f12 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:35.687301 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d0d2ccee-5fa8-483e-a8b4-e526b14b8f12 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:35.904148 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d0d2ccee-5fa8-483e-a8b4-e526b14b8f12 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ccd03a4aa84f93bc26b438e1468f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a9f3fcc4b445349e5c66ff712e8598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:35.917793 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d0d2ccee-5fa8-483e-a8b4-e526b14b8f12 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/servers/5f29cff7-a675-40c2-a0e5-2a62994be45a" status: 200 len: 1494 microversion: 2.1 time: 0.260170 Aug 31 16:00:35.919975 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-53a5429b-ba94-4782-8bd8-9da00cf4face tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccce16c7fda401ea68fb31ea8099d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed252ebf7c741bbb36b553ac1767579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:35.921298 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 654/1293] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:35 2022] GET /compute/v2.1/servers/5f29cff7-a675-40c2-a0e5-2a62994be45a => generated 1494 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:35.930092 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-6df78b9b-63c5-47c7-a9f2-54afbbbd6fa2 req-99b6f08d-b64c-42b3-aba1-dd2018a208bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e37d5ca-7dc4-476e-803f-f61c6adfaeb4", "name": "network-vif-plugged", "status": "completed", "tag": "30a1007c-35f7-458a-b3da-48354c0485f4"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:00:35.943567 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-6df78b9b-63c5-47c7-a9f2-54afbbbd6fa2 req-99b6f08d-b64c-42b3-aba1-dd2018a208bd service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:35.944321 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-6df78b9b-63c5-47c7-a9f2-54afbbbd6fa2 req-99b6f08d-b64c-42b3-aba1-dd2018a208bd service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:35.945404 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-6df78b9b-63c5-47c7-a9f2-54afbbbd6fa2 req-99b6f08d-b64c-42b3-aba1-dd2018a208bd service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:35.962077 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-6df78b9b-63c5-47c7-a9f2-54afbbbd6fa2 req-99b6f08d-b64c-42b3-aba1-dd2018a208bd service nova] Creating event network-vif-plugged:30a1007c-35f7-458a-b3da-48354c0485f4 for instance 7e37d5ca-7dc4-476e-803f-f61c6adfaeb4 on n-h1-850499-9 Aug 31 16:00:35.966024 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-53a5429b-ba94-4782-8bd8-9da00cf4face tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "GET /compute/v2.1/servers/7e37d5ca-7dc4-476e-803f-f61c6adfaeb4" status: 200 len: 1325 microversion: 2.1 time: 0.419699 Aug 31 16:00:35.968209 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 640/1294] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:35 2022] GET /compute/v2.1/servers/7e37d5ca-7dc4-476e-803f-f61c6adfaeb4 => generated 1325 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:35.978082 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-6df78b9b-63c5-47c7-a9f2-54afbbbd6fa2 req-99b6f08d-b64c-42b3-aba1-dd2018a208bd service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055015 Aug 31 16:00:35.979271 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 655/1295] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:00:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:00:35.986907 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-fbefb5be-f367-4050-a7e0-6903da5bacb7 tempest-FlavorMetadataValidation-1253609019 tempest-FlavorMetadataValidation-1253609019-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:00:36.195926 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-fbefb5be-f367-4050-a7e0-6903da5bacb7 tempest-FlavorMetadataValidation-1253609019 tempest-FlavorMetadataValidation-1253609019-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors/502977300/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.225024 Aug 31 16:00:36.202823 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 641/1296] 10.222.0.61 () {62 vars in 1262 bytes} [Wed Aug 31 16:00:35 2022] POST /compute/v2.1/flavors/502977300/os-extra_specs => generated 62 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:36.208682 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-112b7f8c-df1b-4c5a-a8c9-9ae982dd94d3 tempest-FlavorMetadataValidation-1253609019 tempest-FlavorMetadataValidation-1253609019-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:36.232468 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-112b7f8c-df1b-4c5a-a8c9-9ae982dd94d3 tempest-FlavorMetadataValidation-1253609019 tempest-FlavorMetadataValidation-1253609019-project-admin] 10.222.0.61 "DELETE /compute/v2.1/flavors/502977300" status: 202 len: 0 microversion: 2.86 time: 0.029111 Aug 31 16:00:36.233063 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 656/1297] 10.222.0.61 () {60 vars in 1199 bytes} [Wed Aug 31 16:00:36 2022] DELETE /compute/v2.1/flavors/502977300 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 31 16:00:36.245322 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-08bdc352-b69b-4ada-8cd3-42140e809dfc tempest-FlavorMetadataValidation-1253609019 tempest-FlavorMetadataValidation-1253609019-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:36.270929 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-08bdc352-b69b-4ada-8cd3-42140e809dfc tempest-FlavorMetadataValidation-1253609019 tempest-FlavorMetadataValidation-1253609019-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.032833 Aug 31 16:00:36.271600 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 642/1298] 10.222.0.61 () {60 vars in 1187 bytes} [Wed Aug 31 16:00:36 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:00:36.440651 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5428b930-d103-4435-a272-0cbe0054ca3e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:36.442149 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5428b930-d103-4435-a272-0cbe0054ca3e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:36.458102 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5428b930-d103-4435-a272-0cbe0054ca3e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:36.459661 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5428b930-d103-4435-a272-0cbe0054ca3e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:36.460608 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5428b930-d103-4435-a272-0cbe0054ca3e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:36.461630 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5428b930-d103-4435-a272-0cbe0054ca3e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:36.462354 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5428b930-d103-4435-a272-0cbe0054ca3e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:36.463006 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5428b930-d103-4435-a272-0cbe0054ca3e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:36.578856 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5428b930-d103-4435-a272-0cbe0054ca3e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:36.592569 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5428b930-d103-4435-a272-0cbe0054ca3e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:36.595316 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5428b930-d103-4435-a272-0cbe0054ca3e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:36.607037 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5428b930-d103-4435-a272-0cbe0054ca3e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1555 microversion: 2.91 time: 0.193347 Aug 31 16:00:36.608697 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 657/1299] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:00:36 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1555 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:00:36.942581 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3a524034-72c4-4c6b-884b-9e964d907d13 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:36.943230 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3a524034-72c4-4c6b-884b-9e964d907d13 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: 5f29cff7-a675-40c2-a0e5-2a62994be45a] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:36.950215 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3a524034-72c4-4c6b-884b-9e964d907d13 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:36.951002 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3a524034-72c4-4c6b-884b-9e964d907d13 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:36.951441 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3a524034-72c4-4c6b-884b-9e964d907d13 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:36.952342 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3a524034-72c4-4c6b-884b-9e964d907d13 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:36.953067 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3a524034-72c4-4c6b-884b-9e964d907d13 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:36.953430 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3a524034-72c4-4c6b-884b-9e964d907d13 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:36.994904 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-da5c5ae0-30c9-47ab-85e4-dbc6767faf89 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:36.996209 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-da5c5ae0-30c9-47ab-85e4-dbc6767faf89 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] [instance: 7e37d5ca-7dc4-476e-803f-f61c6adfaeb4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:37.010429 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-da5c5ae0-30c9-47ab-85e4-dbc6767faf89 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:37.012265 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-da5c5ae0-30c9-47ab-85e4-dbc6767faf89 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:37.012997 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-da5c5ae0-30c9-47ab-85e4-dbc6767faf89 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:37.024596 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-da5c5ae0-30c9-47ab-85e4-dbc6767faf89 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:37.025340 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-da5c5ae0-30c9-47ab-85e4-dbc6767faf89 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:37.025950 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-da5c5ae0-30c9-47ab-85e4-dbc6767faf89 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:37.292300 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3a524034-72c4-4c6b-884b-9e964d907d13 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ccd03a4aa84f93bc26b438e1468f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a9f3fcc4b445349e5c66ff712e8598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:37.308850 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3a524034-72c4-4c6b-884b-9e964d907d13 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/servers/5f29cff7-a675-40c2-a0e5-2a62994be45a" status: 200 len: 1474 microversion: 2.1 time: 0.370239 Aug 31 16:00:37.309765 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 643/1300] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:36 2022] GET /compute/v2.1/servers/5f29cff7-a675-40c2-a0e5-2a62994be45a => generated 1474 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:37.336797 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-77957892-9963-43f6-8412-37929b041cc5 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1672836075"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:00:37.383230 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-da5c5ae0-30c9-47ab-85e4-dbc6767faf89 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccce16c7fda401ea68fb31ea8099d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed252ebf7c741bbb36b553ac1767579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:37.383428 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-77957892-9963-43f6-8412-37929b041cc5 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: 5f29cff7-a675-40c2-a0e5-2a62994be45a] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:37.389964 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-77957892-9963-43f6-8412-37929b041cc5 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:37.391339 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-77957892-9963-43f6-8412-37929b041cc5 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:37.391991 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-77957892-9963-43f6-8412-37929b041cc5 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:37.392872 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-77957892-9963-43f6-8412-37929b041cc5 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:37.393519 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-77957892-9963-43f6-8412-37929b041cc5 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:37.394110 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-77957892-9963-43f6-8412-37929b041cc5 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:37.405276 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-da5c5ae0-30c9-47ab-85e4-dbc6767faf89 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "GET /compute/v2.1/servers/7e37d5ca-7dc4-476e-803f-f61c6adfaeb4" status: 200 len: 1325 microversion: 2.1 time: 0.414168 Aug 31 16:00:37.406709 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 658/1301] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:36 2022] GET /compute/v2.1/servers/7e37d5ca-7dc4-476e-803f-f61c6adfaeb4 => generated 1325 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:37.640606 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2879f1d8-7f54-4c27-866f-c82a218d8243 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:37.641227 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2879f1d8-7f54-4c27-866f-c82a218d8243 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:37.656908 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2879f1d8-7f54-4c27-866f-c82a218d8243 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:37.659123 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2879f1d8-7f54-4c27-866f-c82a218d8243 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:37.659613 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2879f1d8-7f54-4c27-866f-c82a218d8243 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:37.660761 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2879f1d8-7f54-4c27-866f-c82a218d8243 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:37.661235 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2879f1d8-7f54-4c27-866f-c82a218d8243 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:37.661674 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2879f1d8-7f54-4c27-866f-c82a218d8243 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:37.770049 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-77957892-9963-43f6-8412-37929b041cc5 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "POST /compute/v2.1/servers/5f29cff7-a675-40c2-a0e5-2a62994be45a/action" status: 202 len: 0 microversion: 2.1 time: 0.442388 Aug 31 16:00:37.771365 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 644/1302] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:00:37 2022] POST /compute/v2.1/servers/5f29cff7-a675-40c2-a0e5-2a62994be45a/action => generated 0 bytes in 445 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Aug 31 16:00:37.782214 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2879f1d8-7f54-4c27-866f-c82a218d8243 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:37.794370 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2879f1d8-7f54-4c27-866f-c82a218d8243 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:37.796244 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2879f1d8-7f54-4c27-866f-c82a218d8243 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:37.797422 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ae72ccf4-7ab8-4382-b1f0-22ccc6917b4a tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '.version_select at 0x7f5ae8fde550>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:37.805363 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2879f1d8-7f54-4c27-866f-c82a218d8243 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1555 microversion: 2.91 time: 0.172583 Aug 31 16:00:37.806624 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 659/1303] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:00:37 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1555 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:00:37.870411 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ae72ccf4-7ab8-4382-b1f0-22ccc6917b4a tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/images/91f26408-c009-455c-b26c-f5cfe4ba8d54" status: 200 len: 1414 microversion: 2.1 time: 0.092153 Aug 31 16:00:37.871092 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 645/1304] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:00:37 2022] GET /compute/v2.1/images/91f26408-c009-455c-b26c-f5cfe4ba8d54 => generated 1414 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:38.431511 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-97e54c3c-4a98-4adb-a430-213ab5d05b01 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:38.432212 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-97e54c3c-4a98-4adb-a430-213ab5d05b01 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] [instance: 7e37d5ca-7dc4-476e-803f-f61c6adfaeb4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:38.457190 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-97e54c3c-4a98-4adb-a430-213ab5d05b01 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:38.458364 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-97e54c3c-4a98-4adb-a430-213ab5d05b01 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:38.459008 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-97e54c3c-4a98-4adb-a430-213ab5d05b01 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:38.460568 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-97e54c3c-4a98-4adb-a430-213ab5d05b01 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:38.461566 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-97e54c3c-4a98-4adb-a430-213ab5d05b01 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:38.462281 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-97e54c3c-4a98-4adb-a430-213ab5d05b01 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:38.807355 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-97e54c3c-4a98-4adb-a430-213ab5d05b01 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccce16c7fda401ea68fb31ea8099d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed252ebf7c741bbb36b553ac1767579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:38.824840 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-97e54c3c-4a98-4adb-a430-213ab5d05b01 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "GET /compute/v2.1/servers/7e37d5ca-7dc4-476e-803f-f61c6adfaeb4" status: 200 len: 1521 microversion: 2.1 time: 0.397337 Aug 31 16:00:38.826503 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 660/1305] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:38 2022] GET /compute/v2.1/servers/7e37d5ca-7dc4-476e-803f-f61c6adfaeb4 => generated 1521 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:38.845978 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-889bb774-bba7-47a9-8e00-6f575aa3c0bd tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:38.847381 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-889bb774-bba7-47a9-8e00-6f575aa3c0bd tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:38.865926 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-889bb774-bba7-47a9-8e00-6f575aa3c0bd tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:38.868349 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-fa81a246-a73f-485b-8f39-bd3f3e4baeb1 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:38.869035 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-889bb774-bba7-47a9-8e00-6f575aa3c0bd tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:38.869519 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-889bb774-bba7-47a9-8e00-6f575aa3c0bd tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:38.870270 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-889bb774-bba7-47a9-8e00-6f575aa3c0bd tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:38.870745 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-889bb774-bba7-47a9-8e00-6f575aa3c0bd tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:38.873635 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-fa81a246-a73f-485b-8f39-bd3f3e4baeb1 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] [instance: 7e37d5ca-7dc4-476e-803f-f61c6adfaeb4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:38.874233 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-889bb774-bba7-47a9-8e00-6f575aa3c0bd tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:38.897528 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fa81a246-a73f-485b-8f39-bd3f3e4baeb1 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:38.900640 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fa81a246-a73f-485b-8f39-bd3f3e4baeb1 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:38.901443 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fa81a246-a73f-485b-8f39-bd3f3e4baeb1 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:38.903105 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fa81a246-a73f-485b-8f39-bd3f3e4baeb1 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:38.906653 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fa81a246-a73f-485b-8f39-bd3f3e4baeb1 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:38.908717 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fa81a246-a73f-485b-8f39-bd3f3e4baeb1 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:38.969238 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-fa81a246-a73f-485b-8f39-bd3f3e4baeb1 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] [instance: 7e37d5ca-7dc4-476e-803f-f61c6adfaeb4] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:00:38.998333 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-889bb774-bba7-47a9-8e00-6f575aa3c0bd tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:39.012283 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-889bb774-bba7-47a9-8e00-6f575aa3c0bd tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:39.020555 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-889bb774-bba7-47a9-8e00-6f575aa3c0bd tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:39.033186 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-889bb774-bba7-47a9-8e00-6f575aa3c0bd tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1555 microversion: 2.91 time: 0.192037 Aug 31 16:00:39.048456 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 646/1306] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:00:38 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1555 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:00:39.061928 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6f94424a-ec37-4544-a4cb-e2c2e86c63c5 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '.version_select at 0x7f5ae8fea3a0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:39.111849 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-fa81a246-a73f-485b-8f39-bd3f3e4baeb1 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "DELETE /compute/v2.1/servers/7e37d5ca-7dc4-476e-803f-f61c6adfaeb4" status: 204 len: 0 microversion: 2.1 time: 0.257123 Aug 31 16:00:39.113197 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 661/1307] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:00:38 2022] DELETE /compute/v2.1/servers/7e37d5ca-7dc4-476e-803f-f61c6adfaeb4 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:00:39.126135 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6f94424a-ec37-4544-a4cb-e2c2e86c63c5 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/images/91f26408-c009-455c-b26c-f5cfe4ba8d54" status: 200 len: 1414 microversion: 2.1 time: 0.074363 Aug 31 16:00:39.127762 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 647/1308] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:00:39 2022] GET /compute/v2.1/images/91f26408-c009-455c-b26c-f5cfe4ba8d54 => generated 1414 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:39.134359 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-73be582f-10e2-45e0-ba30-9dd9c5f55ca6 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:39.136491 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-73be582f-10e2-45e0-ba30-9dd9c5f55ca6 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] [instance: 7e37d5ca-7dc4-476e-803f-f61c6adfaeb4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:39.146569 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-73be582f-10e2-45e0-ba30-9dd9c5f55ca6 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:39.147442 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-73be582f-10e2-45e0-ba30-9dd9c5f55ca6 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:39.148375 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-73be582f-10e2-45e0-ba30-9dd9c5f55ca6 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:39.149505 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-73be582f-10e2-45e0-ba30-9dd9c5f55ca6 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:39.150365 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-73be582f-10e2-45e0-ba30-9dd9c5f55ca6 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:39.151120 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-73be582f-10e2-45e0-ba30-9dd9c5f55ca6 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:39.365175 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-73be582f-10e2-45e0-ba30-9dd9c5f55ca6 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccce16c7fda401ea68fb31ea8099d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed252ebf7c741bbb36b553ac1767579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:39.375493 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-73be582f-10e2-45e0-ba30-9dd9c5f55ca6 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "GET /compute/v2.1/servers/7e37d5ca-7dc4-476e-803f-f61c6adfaeb4" status: 200 len: 1527 microversion: 2.1 time: 0.254477 Aug 31 16:00:39.376926 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 662/1309] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:39 2022] GET /compute/v2.1/servers/7e37d5ca-7dc4-476e-803f-f61c6adfaeb4 => generated 1527 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:39.489500 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-42ef2e1f-bea9-445f-b268-fa2b40d2d185 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-603280792", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:00:39.565600 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-42ef2e1f-bea9-445f-b268-fa2b40d2d185 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] validate_networks() for None {{(pid=122256) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:00:40.069811 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c9cf5133-17a2-49b1-9fb6-b6faed7e30ad tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:40.072079 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c9cf5133-17a2-49b1-9fb6-b6faed7e30ad tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:40.105832 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c9cf5133-17a2-49b1-9fb6-b6faed7e30ad tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:40.106706 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c9cf5133-17a2-49b1-9fb6-b6faed7e30ad tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:40.108133 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c9cf5133-17a2-49b1-9fb6-b6faed7e30ad tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:40.112200 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c9cf5133-17a2-49b1-9fb6-b6faed7e30ad tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:40.113116 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c9cf5133-17a2-49b1-9fb6-b6faed7e30ad tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:40.113764 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c9cf5133-17a2-49b1-9fb6-b6faed7e30ad tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:40.171381 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-42ef2e1f-bea9-445f-b268-fa2b40d2d185 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:00:40.172461 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-42ef2e1f-bea9-445f-b268-fa2b40d2d185 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:00:40.173109 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-42ef2e1f-bea9-445f-b268-fa2b40d2d185 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:00:40.173729 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-42ef2e1f-bea9-445f-b268-fa2b40d2d185 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:00:40.174333 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-42ef2e1f-bea9-445f-b268-fa2b40d2d185 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:00:40.184489 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42ef2e1f-bea9-445f-b268-fa2b40d2d185 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:40.185188 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42ef2e1f-bea9-445f-b268-fa2b40d2d185 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:40.185792 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42ef2e1f-bea9-445f-b268-fa2b40d2d185 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:40.186887 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42ef2e1f-bea9-445f-b268-fa2b40d2d185 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:40.187532 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42ef2e1f-bea9-445f-b268-fa2b40d2d185 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:40.188125 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42ef2e1f-bea9-445f-b268-fa2b40d2d185 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:40.225299 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-42ef2e1f-bea9-445f-b268-fa2b40d2d185 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Getting quotas for project 2b7fb4ddb0e649edbe96d046cde6b1a6. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:00:40.228202 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c9cf5133-17a2-49b1-9fb6-b6faed7e30ad tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:40.236339 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-42ef2e1f-bea9-445f-b268-fa2b40d2d185 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Getting quotas for user 7d6382b576b5404eb90214c00b62299b and project 2b7fb4ddb0e649edbe96d046cde6b1a6. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:00:40.237113 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c9cf5133-17a2-49b1-9fb6-b6faed7e30ad tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:40.238628 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c9cf5133-17a2-49b1-9fb6-b6faed7e30ad tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:40.249541 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c9cf5133-17a2-49b1-9fb6-b6faed7e30ad tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1555 microversion: 2.91 time: 0.187186 Aug 31 16:00:40.254718 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-42ef2e1f-bea9-445f-b268-fa2b40d2d185 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Going to run 1 instances... {{(pid=122256) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:00:40.258029 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-42ef2e1f-bea9-445f-b268-fa2b40d2d185 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] [instance: a50acb4f-16d0-4c72-b603-f795220ea866] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:00:40.264517 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 663/1310] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:00:40 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1555 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:00:40.277631 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-dd99fcdc-4749-4f4c-85ca-49ccfe232c12 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '.version_select at 0x7f5ae8cec3a0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:40.319171 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-42ef2e1f-bea9-445f-b268-fa2b40d2d185 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.018155 Aug 31 16:00:40.327635 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 648/1311] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:00:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1024 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:00:40.358318 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3c936aaa-5f9e-4bdf-80cc-6483036e0284 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:40.359054 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3c936aaa-5f9e-4bdf-80cc-6483036e0284 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] [instance: a50acb4f-16d0-4c72-b603-f795220ea866] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:40.381688 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-dd99fcdc-4749-4f4c-85ca-49ccfe232c12 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/images/91f26408-c009-455c-b26c-f5cfe4ba8d54" status: 200 len: 1414 microversion: 2.1 time: 0.115535 Aug 31 16:00:40.383297 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 664/1312] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:00:40 2022] GET /compute/v2.1/images/91f26408-c009-455c-b26c-f5cfe4ba8d54 => generated 1414 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:40.404469 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-32ca0115-f5fd-4ef6-88cc-cf964adb4d55 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:40.405082 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-32ca0115-f5fd-4ef6-88cc-cf964adb4d55 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] [instance: 7e37d5ca-7dc4-476e-803f-f61c6adfaeb4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:40.414370 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-32ca0115-f5fd-4ef6-88cc-cf964adb4d55 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:40.414879 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-32ca0115-f5fd-4ef6-88cc-cf964adb4d55 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:40.415331 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-32ca0115-f5fd-4ef6-88cc-cf964adb4d55 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:40.416086 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-32ca0115-f5fd-4ef6-88cc-cf964adb4d55 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:40.416551 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-32ca0115-f5fd-4ef6-88cc-cf964adb4d55 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:40.416985 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-32ca0115-f5fd-4ef6-88cc-cf964adb4d55 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:40.490985 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3c936aaa-5f9e-4bdf-80cc-6483036e0284 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6382b576b5404eb90214c00b62299b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7fb4ddb0e649edbe96d046cde6b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:40.500166 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3c936aaa-5f9e-4bdf-80cc-6483036e0284 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] 10.222.0.61 "GET /compute/v2.1/servers/a50acb4f-16d0-4c72-b603-f795220ea866" status: 200 len: 1221 microversion: 2.1 time: 0.165722 Aug 31 16:00:40.515162 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 649/1313] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:40 2022] GET /compute/v2.1/servers/a50acb4f-16d0-4c72-b603-f795220ea866 => generated 1221 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:40.733915 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-32ca0115-f5fd-4ef6-88cc-cf964adb4d55 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccce16c7fda401ea68fb31ea8099d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed252ebf7c741bbb36b553ac1767579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:40.733915 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-32ca0115-f5fd-4ef6-88cc-cf964adb4d55 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "GET /compute/v2.1/servers/7e37d5ca-7dc4-476e-803f-f61c6adfaeb4" status: 200 len: 1527 microversion: 2.1 time: 0.305531 Aug 31 16:00:40.733915 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 665/1314] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:40 2022] GET /compute/v2.1/servers/7e37d5ca-7dc4-476e-803f-f61c6adfaeb4 => generated 1527 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:00:41.185204 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3c936aaa-5f9e-4bdf-80cc-6483036e0284 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:41.187015 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3c936aaa-5f9e-4bdf-80cc-6483036e0284 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] 10.222.0.61 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002305 Aug 31 16:00:41.188059 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 650/1315] 10.222.0.61 () {56 vars in 886 bytes} [Wed Aug 31 16:00:41 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 31 16:00:41.296438 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7ee4ad1a-bb9d-42d2-819d-b6658c5da7f1 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:41.298968 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7ee4ad1a-bb9d-42d2-819d-b6658c5da7f1 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:41.314553 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7ee4ad1a-bb9d-42d2-819d-b6658c5da7f1 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:41.320409 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7ee4ad1a-bb9d-42d2-819d-b6658c5da7f1 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:41.322827 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7ee4ad1a-bb9d-42d2-819d-b6658c5da7f1 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:41.324750 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7ee4ad1a-bb9d-42d2-819d-b6658c5da7f1 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:41.326681 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7ee4ad1a-bb9d-42d2-819d-b6658c5da7f1 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:41.327786 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7ee4ad1a-bb9d-42d2-819d-b6658c5da7f1 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:41.397675 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0f36ca47-3be5-45d2-a70f-8247b803e6a9 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '.version_select at 0x7f5ae8f89280>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:41.469292 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0f36ca47-3be5-45d2-a70f-8247b803e6a9 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/images/91f26408-c009-455c-b26c-f5cfe4ba8d54" status: 200 len: 1414 microversion: 2.1 time: 0.076139 Aug 31 16:00:41.473787 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7ee4ad1a-bb9d-42d2-819d-b6658c5da7f1 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:41.476739 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 651/1316] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:00:41 2022] GET /compute/v2.1/images/91f26408-c009-455c-b26c-f5cfe4ba8d54 => generated 1414 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:00:41.494447 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7ee4ad1a-bb9d-42d2-819d-b6658c5da7f1 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:41.496856 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7ee4ad1a-bb9d-42d2-819d-b6658c5da7f1 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:41.504918 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7ee4ad1a-bb9d-42d2-819d-b6658c5da7f1 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1555 microversion: 2.91 time: 0.212297 Aug 31 16:00:41.506216 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 666/1317] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:00:41 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1555 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:00:41.523863 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-306d46e3-b181-46d2-b83a-4b9626923019 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:41.524849 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-306d46e3-b181-46d2-b83a-4b9626923019 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] [instance: a50acb4f-16d0-4c72-b603-f795220ea866] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:41.546689 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-306d46e3-b181-46d2-b83a-4b9626923019 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:41.548408 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-306d46e3-b181-46d2-b83a-4b9626923019 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:41.549078 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-306d46e3-b181-46d2-b83a-4b9626923019 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:41.550042 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-306d46e3-b181-46d2-b83a-4b9626923019 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:41.551299 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-306d46e3-b181-46d2-b83a-4b9626923019 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:41.552227 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-306d46e3-b181-46d2-b83a-4b9626923019 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:41.669506 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-306d46e3-b181-46d2-b83a-4b9626923019 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6382b576b5404eb90214c00b62299b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7fb4ddb0e649edbe96d046cde6b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:41.683535 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-306d46e3-b181-46d2-b83a-4b9626923019 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] 10.222.0.61 "GET /compute/v2.1/servers/a50acb4f-16d0-4c72-b603-f795220ea866" status: 200 len: 1273 microversion: 2.1 time: 0.165222 Aug 31 16:00:41.686424 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 652/1318] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:41 2022] GET /compute/v2.1/servers/a50acb4f-16d0-4c72-b603-f795220ea866 => generated 1273 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:41.752655 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4a5be87b-e9cb-4068-b09b-bf62e734a5c3 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:41.754237 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4a5be87b-e9cb-4068-b09b-bf62e734a5c3 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] [instance: 7e37d5ca-7dc4-476e-803f-f61c6adfaeb4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:41.763261 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4a5be87b-e9cb-4068-b09b-bf62e734a5c3 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:41.764276 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4a5be87b-e9cb-4068-b09b-bf62e734a5c3 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:41.765036 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4a5be87b-e9cb-4068-b09b-bf62e734a5c3 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:41.765995 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4a5be87b-e9cb-4068-b09b-bf62e734a5c3 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:41.766688 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4a5be87b-e9cb-4068-b09b-bf62e734a5c3 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:41.767337 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4a5be87b-e9cb-4068-b09b-bf62e734a5c3 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:41.893215 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-4a5be87b-e9cb-4068-b09b-bf62e734a5c3 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccce16c7fda401ea68fb31ea8099d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed252ebf7c741bbb36b553ac1767579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:41.899021 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:00:41.918564 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-ce6640c7-05e2-4820-aa2e-c701c8a82ff0 req-1d145e32-29ee-4798-8ab9-386b7178f48d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e37d5ca-7dc4-476e-803f-f61c6adfaeb4", "name": "network-vif-deleted", "tag": "30a1007c-35f7-458a-b3da-48354c0485f4"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:00:41.923423 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4a5be87b-e9cb-4068-b09b-bf62e734a5c3 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "GET /compute/v2.1/servers/7e37d5ca-7dc4-476e-803f-f61c6adfaeb4" status: 200 len: 1485 microversion: 2.1 time: 0.160658 Aug 31 16:00:41.927557 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 667/1319] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:41 2022] GET /compute/v2.1/servers/7e37d5ca-7dc4-476e-803f-f61c6adfaeb4 => generated 1485 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:41.936480 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-ce6640c7-05e2-4820-aa2e-c701c8a82ff0 req-1d145e32-29ee-4798-8ab9-386b7178f48d service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:41.937356 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-ce6640c7-05e2-4820-aa2e-c701c8a82ff0 req-1d145e32-29ee-4798-8ab9-386b7178f48d service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:41.938055 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-ce6640c7-05e2-4820-aa2e-c701c8a82ff0 req-1d145e32-29ee-4798-8ab9-386b7178f48d service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:41.954534 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-ce6640c7-05e2-4820-aa2e-c701c8a82ff0 req-1d145e32-29ee-4798-8ab9-386b7178f48d service nova] Creating event network-vif-deleted:30a1007c-35f7-458a-b3da-48354c0485f4 for instance 7e37d5ca-7dc4-476e-803f-f61c6adfaeb4 on n-h1-850499-9 Aug 31 16:00:41.963153 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-ce6640c7-05e2-4820-aa2e-c701c8a82ff0 req-1d145e32-29ee-4798-8ab9-386b7178f48d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051178 Aug 31 16:00:41.964708 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 653/1320] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:00:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:00:42.486686 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d03b99bf-a115-4c8e-9a5b-5abadb65fc47 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '.version_select at 0x7f5ae8ec5820>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:42.534167 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-414d82d2-7893-4f79-8d0f-5bf6c01859d2 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:42.536537 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-414d82d2-7893-4f79-8d0f-5bf6c01859d2 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:42.547197 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-414d82d2-7893-4f79-8d0f-5bf6c01859d2 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:42.548448 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-414d82d2-7893-4f79-8d0f-5bf6c01859d2 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:42.549163 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-414d82d2-7893-4f79-8d0f-5bf6c01859d2 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:42.550100 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-414d82d2-7893-4f79-8d0f-5bf6c01859d2 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:42.551191 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-414d82d2-7893-4f79-8d0f-5bf6c01859d2 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:42.551986 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-414d82d2-7893-4f79-8d0f-5bf6c01859d2 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:42.565465 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d03b99bf-a115-4c8e-9a5b-5abadb65fc47 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/images/91f26408-c009-455c-b26c-f5cfe4ba8d54" status: 200 len: 1414 microversion: 2.1 time: 0.082466 Aug 31 16:00:42.572780 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 668/1321] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:00:42 2022] GET /compute/v2.1/images/91f26408-c009-455c-b26c-f5cfe4ba8d54 => generated 1414 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:42.702873 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-414d82d2-7893-4f79-8d0f-5bf6c01859d2 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:42.715748 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2491eef1-a64d-4d63-b1a9-1fc088734a7e tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:42.718229 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2491eef1-a64d-4d63-b1a9-1fc088734a7e tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] [instance: a50acb4f-16d0-4c72-b603-f795220ea866] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:42.721975 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-414d82d2-7893-4f79-8d0f-5bf6c01859d2 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:42.736473 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-414d82d2-7893-4f79-8d0f-5bf6c01859d2 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:42.748144 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2491eef1-a64d-4d63-b1a9-1fc088734a7e tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:42.748492 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2491eef1-a64d-4d63-b1a9-1fc088734a7e tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:42.748937 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2491eef1-a64d-4d63-b1a9-1fc088734a7e tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:42.749667 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2491eef1-a64d-4d63-b1a9-1fc088734a7e tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:42.750204 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2491eef1-a64d-4d63-b1a9-1fc088734a7e tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:42.756479 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-414d82d2-7893-4f79-8d0f-5bf6c01859d2 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1555 microversion: 2.91 time: 0.226982 Aug 31 16:00:42.783720 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2491eef1-a64d-4d63-b1a9-1fc088734a7e tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:42.792287 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 654/1322] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:00:42 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1555 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:00:42.941728 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2491eef1-a64d-4d63-b1a9-1fc088734a7e tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6382b576b5404eb90214c00b62299b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7fb4ddb0e649edbe96d046cde6b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:42.948406 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8a5cc65f-b6ca-43fe-943d-52b7fd4cc086 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:42.949377 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8a5cc65f-b6ca-43fe-943d-52b7fd4cc086 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] [instance: 7e37d5ca-7dc4-476e-803f-f61c6adfaeb4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:42.961189 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2491eef1-a64d-4d63-b1a9-1fc088734a7e tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] 10.222.0.61 "GET /compute/v2.1/servers/a50acb4f-16d0-4c72-b603-f795220ea866" status: 200 len: 1279 microversion: 2.1 time: 0.255236 Aug 31 16:00:42.967461 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8a5cc65f-b6ca-43fe-943d-52b7fd4cc086 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:42.968391 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8a5cc65f-b6ca-43fe-943d-52b7fd4cc086 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:42.969062 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8a5cc65f-b6ca-43fe-943d-52b7fd4cc086 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:42.969982 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 669/1323] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:42 2022] GET /compute/v2.1/servers/a50acb4f-16d0-4c72-b603-f795220ea866 => generated 1279 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:42.972392 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8a5cc65f-b6ca-43fe-943d-52b7fd4cc086 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:42.973119 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8a5cc65f-b6ca-43fe-943d-52b7fd4cc086 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:42.975057 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8a5cc65f-b6ca-43fe-943d-52b7fd4cc086 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:43.038406 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8a5cc65f-b6ca-43fe-943d-52b7fd4cc086 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:43.040832 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8a5cc65f-b6ca-43fe-943d-52b7fd4cc086 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:43.041556 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8a5cc65f-b6ca-43fe-943d-52b7fd4cc086 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:43.043301 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-8a5cc65f-b6ca-43fe-943d-52b7fd4cc086 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lazy-loading 'fault' on Instance uuid 7e37d5ca-7dc4-476e-803f-f61c6adfaeb4 {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:00:43.119275 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8a5cc65f-b6ca-43fe-943d-52b7fd4cc086 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccce16c7fda401ea68fb31ea8099d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed252ebf7c741bbb36b553ac1767579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:43.134421 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8a5cc65f-b6ca-43fe-943d-52b7fd4cc086 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "GET /compute/v2.1/servers/7e37d5ca-7dc4-476e-803f-f61c6adfaeb4" status: 200 len: 1315 microversion: 2.1 time: 0.188303 Aug 31 16:00:43.139648 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 655/1324] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:42 2022] GET /compute/v2.1/servers/7e37d5ca-7dc4-476e-803f-f61c6adfaeb4 => generated 1315 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:00:43.580472 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2b4d8a62-0d6e-4d17-86dd-041d854c80cd tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '.version_select at 0x7f5ae8ec58b0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:43.678697 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2b4d8a62-0d6e-4d17-86dd-041d854c80cd tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/images/91f26408-c009-455c-b26c-f5cfe4ba8d54" status: 200 len: 1414 microversion: 2.1 time: 0.101818 Aug 31 16:00:43.685886 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 670/1325] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:00:43 2022] GET /compute/v2.1/images/91f26408-c009-455c-b26c-f5cfe4ba8d54 => generated 1414 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:43.792840 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e908bb01-6ee7-4c89-a675-1007b137f137 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:43.793495 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e908bb01-6ee7-4c89-a675-1007b137f137 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:43.812950 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e908bb01-6ee7-4c89-a675-1007b137f137 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:43.813466 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e908bb01-6ee7-4c89-a675-1007b137f137 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:43.813921 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e908bb01-6ee7-4c89-a675-1007b137f137 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:43.814646 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e908bb01-6ee7-4c89-a675-1007b137f137 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:43.825899 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e908bb01-6ee7-4c89-a675-1007b137f137 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:43.828481 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e908bb01-6ee7-4c89-a675-1007b137f137 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:43.991215 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f8cda06a-8c47-4435-b835-7cc6c394e19a tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:43.992116 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f8cda06a-8c47-4435-b835-7cc6c394e19a tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] [instance: a50acb4f-16d0-4c72-b603-f795220ea866] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:44.004521 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f8cda06a-8c47-4435-b835-7cc6c394e19a tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:44.016039 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f8cda06a-8c47-4435-b835-7cc6c394e19a tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:44.016865 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f8cda06a-8c47-4435-b835-7cc6c394e19a tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:44.017799 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f8cda06a-8c47-4435-b835-7cc6c394e19a tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:44.018355 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f8cda06a-8c47-4435-b835-7cc6c394e19a tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:44.018896 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f8cda06a-8c47-4435-b835-7cc6c394e19a tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:44.201702 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e908bb01-6ee7-4c89-a675-1007b137f137 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:44.213976 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e908bb01-6ee7-4c89-a675-1007b137f137 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:44.216226 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e908bb01-6ee7-4c89-a675-1007b137f137 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:44.224161 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e908bb01-6ee7-4c89-a675-1007b137f137 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1555 microversion: 2.91 time: 0.437006 Aug 31 16:00:44.251336 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 656/1326] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:00:43 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1555 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:00:44.258268 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ad705f44-e048-4e99-8f6f-8c964342497a tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:44.259218 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ad705f44-e048-4e99-8f6f-8c964342497a tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] [instance: 7e37d5ca-7dc4-476e-803f-f61c6adfaeb4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:44.268301 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ad705f44-e048-4e99-8f6f-8c964342497a tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:44.269429 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ad705f44-e048-4e99-8f6f-8c964342497a tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:44.270097 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ad705f44-e048-4e99-8f6f-8c964342497a tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:44.270907 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ad705f44-e048-4e99-8f6f-8c964342497a tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:44.271448 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ad705f44-e048-4e99-8f6f-8c964342497a tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:44.272053 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ad705f44-e048-4e99-8f6f-8c964342497a tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:44.294252 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-ad705f44-e048-4e99-8f6f-8c964342497a tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] HTTP exception thrown: Instance 7e37d5ca-7dc4-476e-803f-f61c6adfaeb4 could not be found. Aug 31 16:00:44.296071 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ad705f44-e048-4e99-8f6f-8c964342497a tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Request method failure captured: Aug 31 16:00:44.296071 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/7e37d5ca-7dc4-476e-803f-f61c6adfaeb4 HTTP/1.1 Aug 31 16:00:44.296071 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:00:44.296071 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:00:44.296071 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:00:44.296071 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:00:44.296071 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:00:44.296071 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:00:44.296071 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:00:44.296071 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:00:44.296071 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4UcGHO9gatUvWJBB907oWawoQP70h6HsJbsny_eFggCHTOgqUkoCg1AvAVcAHjORdEbkXL7xp_g0w0MdWTsQsxdtQLftyhBkZlCr9g7XUi02ZEumxE15kVflv1oC3aQIZmyWr_qGIamtOyoWvoJnlxnc8ckdznU53DKuHgbDBtijYA Aug 31 16:00:44.296071 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:00:44.296071 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:00:44.296071 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:00:44.296071 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:00:44.296071 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:00:44.296071 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:00:44.296071 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 7ed252ebf7c741bbb36b553ac1767579 Aug 31 16:00:44.296071 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-977175069 Aug 31 16:00:44.296071 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:00:44.296071 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:00:44.297665 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7ed252ebf7c741bbb36b553ac1767579"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7ed252ebf7c741bbb36b553ac1767579"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7ed252ebf7c741bbb36b553ac1767579", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7ed252ebf7c741bbb36b553ac1767579"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:00:44.297665 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-977175069 Aug 31 16:00:44.297665 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 7ed252ebf7c741bbb36b553ac1767579 Aug 31 16:00:44.297665 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-977175069 Aug 31 16:00:44.297665 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ImagesOneServerNegativeTestJSON-977175069-project Aug 31 16:00:44.297665 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:00:44.297665 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:00:44.297665 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 3ccce16c7fda401ea68fb31ea8099d78 Aug 31 16:00:44.297665 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-977175069-project Aug 31 16:00:44.297665 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:00:44.297665 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance 7e37d5ca-7dc4-476e-803f-f61c6adfaeb4 could not be found. Aug 31 16:00:44.297665 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '7e37d5ca-7dc4-476e-803f-f61c6adfaeb4'} Aug 31 16:00:44.298501 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:00:44.298501 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:44.298501 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:00:44.298501 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:00:44.298501 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:00:44.298501 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:00:44.298501 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:00:44.298501 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:00:44.298501 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:00:44.298501 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:00:44.298501 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e37d5ca-7dc4-476e-803f-f61c6adfaeb4 could not be found. Aug 31 16:00:44.298501 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:44.298501 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:44.298501 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:44.298501 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:44.298501 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:44.298501 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:44.298501 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:00:44.298501 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:00:44.298501 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:00:44.299876 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:00:44.299876 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:00:44.299876 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:00:44.299876 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:00:44.299876 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:00:44.299876 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:00:44.299876 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:00:44.299876 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e37d5ca-7dc4-476e-803f-f61c6adfaeb4 could not be found. Aug 31 16:00:44.299876 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:44.299876 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:44.299876 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:44.299876 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:44.299876 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:44.299876 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:44.299876 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:00:44.299876 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:00:44.299876 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e37d5ca-7dc4-476e-803f-f61c6adfaeb4 could not be found. Aug 31 16:00:44.299876 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:44.301288 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ad705f44-e048-4e99-8f6f-8c964342497a tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Returning 404 to user: Instance 7e37d5ca-7dc4-476e-803f-f61c6adfaeb4 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:00:44.301288 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ad705f44-e048-4e99-8f6f-8c964342497a tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "GET /compute/v2.1/servers/7e37d5ca-7dc4-476e-803f-f61c6adfaeb4" status: 404 len: 111 microversion: 2.1 time: 0.045965 Aug 31 16:00:44.304356 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 657/1327] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:44 2022] GET /compute/v2.1/servers/7e37d5ca-7dc4-476e-803f-f61c6adfaeb4 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:00:44.311194 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9662ef0f-1c3b-44e7-9755-de151457fa53 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Calling method '.version_select at 0x7f5ae8f31040>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:44.342681 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-9662ef0f-1c3b-44e7-9755-de151457fa53 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] HTTP exception thrown: Image not found. Aug 31 16:00:44.344820 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9662ef0f-1c3b-44e7-9755-de151457fa53 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Request method failure captured: Aug 31 16:00:44.344820 n-d-850499-9 devstack@n-api.service[122256]: request: DELETE /compute/v2.1/images/6ae898ff-c116-4291-b133-ab80a8becab5 HTTP/1.1 Aug 31 16:00:44.344820 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:00:44.344820 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:00:44.344820 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:00:44.344820 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:00:44.344820 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:00:44.344820 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:00:44.344820 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:00:44.344820 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:00:44.344820 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4UcGHO9gatUvWJBB907oWawoQP70h6HsJbsny_eFggCHTOgqUkoCg1AvAVcAHjORdEbkXL7xp_g0w0MdWTsQsxdtQLftyhBkZlCr9g7XUi02ZEumxE15kVflv1oC3aQIZmyWr_qGIamtOyoWvoJnlxnc8ckdznU53DKuHgbDBtijYA Aug 31 16:00:44.344820 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:00:44.344820 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:00:44.344820 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:00:44.344820 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:00:44.344820 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:00:44.344820 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:00:44.344820 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 7ed252ebf7c741bbb36b553ac1767579 Aug 31 16:00:44.344820 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-977175069 Aug 31 16:00:44.344820 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:00:44.344820 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:00:44.346390 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7ed252ebf7c741bbb36b553ac1767579"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7ed252ebf7c741bbb36b553ac1767579"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7ed252ebf7c741bbb36b553ac1767579", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7ed252ebf7c741bbb36b553ac1767579"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:00:44.346390 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-977175069 Aug 31 16:00:44.346390 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 7ed252ebf7c741bbb36b553ac1767579 Aug 31 16:00:44.346390 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-977175069 Aug 31 16:00:44.346390 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ImagesOneServerNegativeTestJSON-977175069-project Aug 31 16:00:44.346390 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:00:44.346390 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:00:44.346390 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 3ccce16c7fda401ea68fb31ea8099d78 Aug 31 16:00:44.346390 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-977175069-project Aug 31 16:00:44.346390 n-d-850499-9 devstack@n-api.service[122256]: method: Aug 31 16:00:44.346390 n-d-850499-9 devstack@n-api.service[122256]: exception: Image not found. Aug 31 16:00:44.346390 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '6ae898ff-c116-4291-b133-ab80a8becab5'} Aug 31 16:00:44.346390 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:00:44.348980 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:44.348980 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 31 16:00:44.348980 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 31 16:00:44.348980 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 31 16:00:44.348980 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 31 16:00:44.348980 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 31 16:00:44.348980 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 31 16:00:44.348980 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 31 16:00:44.348980 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 31 16:00:44.348980 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 31 16:00:44.348980 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 31 16:00:44.348980 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 31 16:00:44.348980 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 31 16:00:44.348980 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 31 16:00:44.348980 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 31 16:00:44.348980 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 6ae898ff-c116-4291-b133-ab80a8becab5 to delete Aug 31 16:00:44.348980 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:44.348980 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:44.348980 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:44.350779 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:44.350779 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 31 16:00:44.350779 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 31 16:00:44.350779 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 31 16:00:44.350779 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 31 16:00:44.350779 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 31 16:00:44.350779 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 31 16:00:44.350779 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6ae898ff-c116-4291-b133-ab80a8becab5 could not be found. Aug 31 16:00:44.350779 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:44.350779 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:44.350779 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:44.350779 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:44.350779 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:44.350779 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:44.350779 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:00:44.350779 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:00:44.350779 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:00:44.350779 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:00:44.350779 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:00:44.350779 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:00:44.353216 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 31 16:00:44.353216 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 31 16:00:44.353216 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 31 16:00:44.353216 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:44.353216 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:44.353216 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:44.353216 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:44.353216 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:44.353216 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:44.353216 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:00:44.353216 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:00:44.353216 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 31 16:00:44.353216 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:44.361281 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9662ef0f-1c3b-44e7-9755-de151457fa53 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Returning 404 to user: Image not found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:00:44.361281 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9662ef0f-1c3b-44e7-9755-de151457fa53 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "DELETE /compute/v2.1/images/6ae898ff-c116-4291-b133-ab80a8becab5" status: 404 len: 62 microversion: 2.1 time: 0.050721 Aug 31 16:00:44.361281 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 658/1328] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:44 2022] DELETE /compute/v2.1/images/6ae898ff-c116-4291-b133-ab80a8becab5 => generated 62 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 31 16:00:44.369087 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a4f745f7-6fd0-4b0b-a5cd-88cab6525e44 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:44.369942 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a4f745f7-6fd0-4b0b-a5cd-88cab6525e44 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] [instance: aade3ca2-9ecc-48db-988a-1ddbc286024a] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:44.382835 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a4f745f7-6fd0-4b0b-a5cd-88cab6525e44 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:44.390289 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a4f745f7-6fd0-4b0b-a5cd-88cab6525e44 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:44.390289 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a4f745f7-6fd0-4b0b-a5cd-88cab6525e44 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:44.390289 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a4f745f7-6fd0-4b0b-a5cd-88cab6525e44 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:44.390289 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a4f745f7-6fd0-4b0b-a5cd-88cab6525e44 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:44.396296 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a4f745f7-6fd0-4b0b-a5cd-88cab6525e44 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:44.410221 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:00:44.428230 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-a4f745f7-6fd0-4b0b-a5cd-88cab6525e44 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] HTTP exception thrown: Instance aade3ca2-9ecc-48db-988a-1ddbc286024a could not be found. Aug 31 16:00:44.430388 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a4f745f7-6fd0-4b0b-a5cd-88cab6525e44 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Request method failure captured: Aug 31 16:00:44.430388 n-d-850499-9 devstack@n-api.service[122256]: request: DELETE /compute/v2.1/servers/aade3ca2-9ecc-48db-988a-1ddbc286024a HTTP/1.1 Aug 31 16:00:44.430388 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:00:44.430388 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:00:44.430388 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:00:44.430388 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:00:44.430388 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:00:44.430388 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:00:44.430388 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:00:44.430388 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:00:44.430388 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4UcGHO9gatUvWJBB907oWawoQP70h6HsJbsny_eFggCHTOgqUkoCg1AvAVcAHjORdEbkXL7xp_g0w0MdWTsQsxdtQLftyhBkZlCr9g7XUi02ZEumxE15kVflv1oC3aQIZmyWr_qGIamtOyoWvoJnlxnc8ckdznU53DKuHgbDBtijYA Aug 31 16:00:44.430388 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:00:44.430388 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:00:44.430388 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:00:44.430388 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:00:44.430388 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:00:44.430388 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:00:44.430388 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 7ed252ebf7c741bbb36b553ac1767579 Aug 31 16:00:44.430388 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-977175069 Aug 31 16:00:44.430388 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:00:44.430388 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:00:44.432018 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7ed252ebf7c741bbb36b553ac1767579"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7ed252ebf7c741bbb36b553ac1767579"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7ed252ebf7c741bbb36b553ac1767579", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7ed252ebf7c741bbb36b553ac1767579"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:00:44.432018 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-977175069 Aug 31 16:00:44.432018 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 7ed252ebf7c741bbb36b553ac1767579 Aug 31 16:00:44.432018 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-977175069 Aug 31 16:00:44.432018 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ImagesOneServerNegativeTestJSON-977175069-project Aug 31 16:00:44.432018 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:00:44.432018 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:00:44.432018 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 3ccce16c7fda401ea68fb31ea8099d78 Aug 31 16:00:44.432018 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-977175069-project Aug 31 16:00:44.432018 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:00:44.432018 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance aade3ca2-9ecc-48db-988a-1ddbc286024a could not be found. Aug 31 16:00:44.432018 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': 'aade3ca2-9ecc-48db-988a-1ddbc286024a'} Aug 31 16:00:44.432816 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:00:44.432816 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:44.432816 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:00:44.432816 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:00:44.432816 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:00:44.432816 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:00:44.432816 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:00:44.432816 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:00:44.432816 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:00:44.432816 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:00:44.432816 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aade3ca2-9ecc-48db-988a-1ddbc286024a could not be found. Aug 31 16:00:44.432816 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:44.432816 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:44.432816 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:44.432816 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:44.432816 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:44.432816 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:44.432816 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:00:44.432816 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:00:44.432816 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:00:44.434039 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:00:44.434039 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:00:44.434039 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:00:44.434039 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:00:44.434039 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:00:44.434039 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:00:44.434039 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:00:44.434039 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:00:44.434039 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:00:44.434039 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aade3ca2-9ecc-48db-988a-1ddbc286024a could not be found. Aug 31 16:00:44.434039 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:44.434039 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:44.434039 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:44.434039 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:44.434039 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:44.434039 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:44.434039 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:00:44.434039 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:00:44.434039 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aade3ca2-9ecc-48db-988a-1ddbc286024a could not be found. Aug 31 16:00:44.434039 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:44.437780 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a4f745f7-6fd0-4b0b-a5cd-88cab6525e44 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Returning 404 to user: Instance aade3ca2-9ecc-48db-988a-1ddbc286024a could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:00:44.439307 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a4f745f7-6fd0-4b0b-a5cd-88cab6525e44 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "DELETE /compute/v2.1/servers/aade3ca2-9ecc-48db-988a-1ddbc286024a" status: 404 len: 111 microversion: 2.1 time: 0.075184 Aug 31 16:00:44.443812 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 659/1329] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:00:44 2022] DELETE /compute/v2.1/servers/aade3ca2-9ecc-48db-988a-1ddbc286024a => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:00:44.451612 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d039ccc3-56e2-4327-bdc7-40b37bf245b9 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:44.456065 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d039ccc3-56e2-4327-bdc7-40b37bf245b9 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] [instance: aade3ca2-9ecc-48db-988a-1ddbc286024a] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:44.467529 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d039ccc3-56e2-4327-bdc7-40b37bf245b9 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:44.468155 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d039ccc3-56e2-4327-bdc7-40b37bf245b9 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:44.471799 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d039ccc3-56e2-4327-bdc7-40b37bf245b9 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:44.482900 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d039ccc3-56e2-4327-bdc7-40b37bf245b9 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:44.482900 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d039ccc3-56e2-4327-bdc7-40b37bf245b9 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:44.482900 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d039ccc3-56e2-4327-bdc7-40b37bf245b9 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:44.512443 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-d039ccc3-56e2-4327-bdc7-40b37bf245b9 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] HTTP exception thrown: Instance aade3ca2-9ecc-48db-988a-1ddbc286024a could not be found. Aug 31 16:00:44.516035 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d039ccc3-56e2-4327-bdc7-40b37bf245b9 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Request method failure captured: Aug 31 16:00:44.516035 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/aade3ca2-9ecc-48db-988a-1ddbc286024a HTTP/1.1 Aug 31 16:00:44.516035 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:00:44.516035 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:00:44.516035 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:00:44.516035 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:00:44.516035 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:00:44.516035 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:00:44.516035 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:00:44.516035 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:00:44.516035 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4UcGHO9gatUvWJBB907oWawoQP70h6HsJbsny_eFggCHTOgqUkoCg1AvAVcAHjORdEbkXL7xp_g0w0MdWTsQsxdtQLftyhBkZlCr9g7XUi02ZEumxE15kVflv1oC3aQIZmyWr_qGIamtOyoWvoJnlxnc8ckdznU53DKuHgbDBtijYA Aug 31 16:00:44.516035 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:00:44.516035 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:00:44.516035 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:00:44.516035 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:00:44.516035 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:00:44.516035 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:00:44.516035 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 7ed252ebf7c741bbb36b553ac1767579 Aug 31 16:00:44.516035 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-977175069 Aug 31 16:00:44.516035 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:00:44.516035 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:00:44.517666 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7ed252ebf7c741bbb36b553ac1767579"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7ed252ebf7c741bbb36b553ac1767579"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7ed252ebf7c741bbb36b553ac1767579", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7ed252ebf7c741bbb36b553ac1767579"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:00:44.517666 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-977175069 Aug 31 16:00:44.517666 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 7ed252ebf7c741bbb36b553ac1767579 Aug 31 16:00:44.517666 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-977175069 Aug 31 16:00:44.517666 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ImagesOneServerNegativeTestJSON-977175069-project Aug 31 16:00:44.517666 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:00:44.517666 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:00:44.517666 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 3ccce16c7fda401ea68fb31ea8099d78 Aug 31 16:00:44.517666 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-977175069-project Aug 31 16:00:44.517666 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:00:44.517666 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance aade3ca2-9ecc-48db-988a-1ddbc286024a could not be found. Aug 31 16:00:44.517666 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': 'aade3ca2-9ecc-48db-988a-1ddbc286024a'} Aug 31 16:00:44.519614 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:00:44.519614 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:44.519614 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:00:44.519614 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:00:44.519614 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:00:44.519614 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:00:44.519614 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:00:44.519614 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:00:44.519614 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:00:44.519614 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:00:44.519614 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aade3ca2-9ecc-48db-988a-1ddbc286024a could not be found. Aug 31 16:00:44.519614 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:44.519614 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:44.519614 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:44.519614 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:44.519614 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:44.519614 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:44.519614 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:00:44.519614 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:00:44.519614 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:00:44.521862 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:00:44.521862 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:00:44.521862 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:00:44.521862 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:00:44.521862 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:00:44.521862 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:00:44.521862 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:00:44.521862 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aade3ca2-9ecc-48db-988a-1ddbc286024a could not be found. Aug 31 16:00:44.521862 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:44.521862 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:44.521862 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:44.521862 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:44.521862 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:44.521862 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:44.521862 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:00:44.521862 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:00:44.521862 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aade3ca2-9ecc-48db-988a-1ddbc286024a could not be found. Aug 31 16:00:44.521862 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:44.527716 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d039ccc3-56e2-4327-bdc7-40b37bf245b9 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Returning 404 to user: Instance aade3ca2-9ecc-48db-988a-1ddbc286024a could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:00:44.528794 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d039ccc3-56e2-4327-bdc7-40b37bf245b9 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "GET /compute/v2.1/servers/aade3ca2-9ecc-48db-988a-1ddbc286024a" status: 404 len: 111 microversion: 2.1 time: 0.083014 Aug 31 16:00:44.533161 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 660/1330] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:44 2022] GET /compute/v2.1/servers/aade3ca2-9ecc-48db-988a-1ddbc286024a => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:00:44.551824 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ea232cfd-7704-4868-b592-df762cf8a0f3 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Calling method '.version_select at 0x7f5ae8f1c8b0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:44.577154 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:SAVEPOINT=2,nova_api:INSERT=5,nova_api:RELEASE=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:00:44.582415 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f8cda06a-8c47-4435-b835-7cc6c394e19a tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6382b576b5404eb90214c00b62299b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7fb4ddb0e649edbe96d046cde6b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:44.603038 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f8cda06a-8c47-4435-b835-7cc6c394e19a tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] 10.222.0.61 "GET /compute/v2.1/servers/a50acb4f-16d0-4c72-b603-f795220ea866" status: 200 len: 1321 microversion: 2.1 time: 0.616282 Aug 31 16:00:44.604936 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 671/1331] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:43 2022] GET /compute/v2.1/servers/a50acb4f-16d0-4c72-b603-f795220ea866 => generated 1321 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:00:44.615659 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ea232cfd-7704-4868-b592-df762cf8a0f3 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-433566045" status: 202 len: 0 microversion: 2.1 time: 0.075476 Aug 31 16:00:44.619886 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 661/1332] 10.222.0.61 () {58 vars in 1218 bytes} [Wed Aug 31 16:00:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-433566045 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:00:44.710777 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c390714a-cfb1-4190-891b-b0cc83d1bf9d tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '.version_select at 0x7f5ae98c4a60>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:44.814988 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c390714a-cfb1-4190-891b-b0cc83d1bf9d tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/images/91f26408-c009-455c-b26c-f5cfe4ba8d54" status: 200 len: 1414 microversion: 2.1 time: 0.117462 Aug 31 16:00:44.824512 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 672/1333] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:00:44 2022] GET /compute/v2.1/images/91f26408-c009-455c-b26c-f5cfe4ba8d54 => generated 1414 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:45.265463 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-85508315-744f-4854-b6a0-262fe7e0a366 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:45.266844 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-85508315-744f-4854-b6a0-262fe7e0a366 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:45.285842 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-85508315-744f-4854-b6a0-262fe7e0a366 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:45.286900 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-85508315-744f-4854-b6a0-262fe7e0a366 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:45.288143 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-85508315-744f-4854-b6a0-262fe7e0a366 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:45.289623 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-85508315-744f-4854-b6a0-262fe7e0a366 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:45.290256 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-85508315-744f-4854-b6a0-262fe7e0a366 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:45.290847 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-85508315-744f-4854-b6a0-262fe7e0a366 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:45.309184 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c28df867-0b41-4d3c-8797-f9c4095b7b55 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:45.310119 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c28df867-0b41-4d3c-8797-f9c4095b7b55 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] [instance: cc085aaa-21b2-48a6-b69c-de4e261dfe7f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:45.323423 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c28df867-0b41-4d3c-8797-f9c4095b7b55 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:45.324313 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c28df867-0b41-4d3c-8797-f9c4095b7b55 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:45.325201 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c28df867-0b41-4d3c-8797-f9c4095b7b55 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:45.326134 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c28df867-0b41-4d3c-8797-f9c4095b7b55 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:45.326964 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c28df867-0b41-4d3c-8797-f9c4095b7b55 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:45.327591 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c28df867-0b41-4d3c-8797-f9c4095b7b55 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:45.483621 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-85508315-744f-4854-b6a0-262fe7e0a366 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:45.502933 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-85508315-744f-4854-b6a0-262fe7e0a366 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:45.507063 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-85508315-744f-4854-b6a0-262fe7e0a366 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:45.514451 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-85508315-744f-4854-b6a0-262fe7e0a366 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1555 microversion: 2.91 time: 0.256196 Aug 31 16:00:45.529448 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 662/1334] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:00:45 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1555 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:00:45.626268 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c150ed48-437b-4c0f-9992-14ae58e95316 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:45.627226 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c150ed48-437b-4c0f-9992-14ae58e95316 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] [instance: a50acb4f-16d0-4c72-b603-f795220ea866] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:45.634687 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c150ed48-437b-4c0f-9992-14ae58e95316 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:45.636057 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c150ed48-437b-4c0f-9992-14ae58e95316 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:45.636821 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c150ed48-437b-4c0f-9992-14ae58e95316 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:45.638147 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c150ed48-437b-4c0f-9992-14ae58e95316 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:45.638762 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c150ed48-437b-4c0f-9992-14ae58e95316 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:45.639405 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c150ed48-437b-4c0f-9992-14ae58e95316 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:46.038167 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c28df867-0b41-4d3c-8797-f9c4095b7b55 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f" status: 200 len: 1814 microversion: 2.1 time: 0.722849 Aug 31 16:00:46.040233 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 673/1335] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:45 2022] GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f => generated 1814 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:46.066783 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-498828de-a45c-43ae-9226-ed6446505d6f req-6384e06d-7c6b-4ed9-972d-36caaf9339ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a50acb4f-16d0-4c72-b603-f795220ea866", "tag": "5c9b6454-8f5a-469a-a445-424975c95bcd"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:00:46.091682 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-498828de-a45c-43ae-9226-ed6446505d6f req-6384e06d-7c6b-4ed9-972d-36caaf9339ec service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:46.095051 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-498828de-a45c-43ae-9226-ed6446505d6f req-6384e06d-7c6b-4ed9-972d-36caaf9339ec service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:46.099394 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-498828de-a45c-43ae-9226-ed6446505d6f req-6384e06d-7c6b-4ed9-972d-36caaf9339ec service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:46.127247 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-498828de-a45c-43ae-9226-ed6446505d6f req-6384e06d-7c6b-4ed9-972d-36caaf9339ec service nova] Creating event network-changed:5c9b6454-8f5a-469a-a445-424975c95bcd for instance a50acb4f-16d0-4c72-b603-f795220ea866 on n-h2-850499-9 Aug 31 16:00:46.143361 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-498828de-a45c-43ae-9226-ed6446505d6f req-6384e06d-7c6b-4ed9-972d-36caaf9339ec service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098706 Aug 31 16:00:46.150774 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 674/1336] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:00:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:00:46.157704 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-b0aa3543-7e75-4fc8-b037-a165cd395f0a req-246c9084-e39e-446f-92bc-ac721939fe64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f29cff7-a675-40c2-a0e5-2a62994be45a", "name": "network-vif-plugged", "status": "completed", "tag": "5aedd1b8-fd73-4d4f-8c6e-c030265971d4"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:00:46.186868 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-b0aa3543-7e75-4fc8-b037-a165cd395f0a req-246c9084-e39e-446f-92bc-ac721939fe64 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:46.187365 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-b0aa3543-7e75-4fc8-b037-a165cd395f0a req-246c9084-e39e-446f-92bc-ac721939fe64 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:46.187862 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-b0aa3543-7e75-4fc8-b037-a165cd395f0a req-246c9084-e39e-446f-92bc-ac721939fe64 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:46.219542 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-b0aa3543-7e75-4fc8-b037-a165cd395f0a req-246c9084-e39e-446f-92bc-ac721939fe64 service nova] Creating event network-vif-plugged:5aedd1b8-fd73-4d4f-8c6e-c030265971d4 for instance 5f29cff7-a675-40c2-a0e5-2a62994be45a on n-h1-850499-9 Aug 31 16:00:46.225275 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-b0aa3543-7e75-4fc8-b037-a165cd395f0a req-246c9084-e39e-446f-92bc-ac721939fe64 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072237 Aug 31 16:00:46.226225 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 675/1337] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:00:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:00:46.232470 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8ae15ef8-57df-4dd7-a74c-3b67f99e81f2 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '.version_select at 0x7f5ae8d023a0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:46.267837 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c150ed48-437b-4c0f-9992-14ae58e95316 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6382b576b5404eb90214c00b62299b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7fb4ddb0e649edbe96d046cde6b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:46.278173 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c150ed48-437b-4c0f-9992-14ae58e95316 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] 10.222.0.61 "GET /compute/v2.1/servers/a50acb4f-16d0-4c72-b603-f795220ea866" status: 200 len: 1321 microversion: 2.1 time: 0.656654 Aug 31 16:00:46.302763 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 663/1338] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:45 2022] GET /compute/v2.1/servers/a50acb4f-16d0-4c72-b603-f795220ea866 => generated 1321 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:46.309506 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f93ced6b-c294-4d03-8dd2-b33500292ca9 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:46.326426 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f93ced6b-c294-4d03-8dd2-b33500292ca9 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:46.327473 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f93ced6b-c294-4d03-8dd2-b33500292ca9 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:46.328767 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f93ced6b-c294-4d03-8dd2-b33500292ca9 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:46.333441 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f93ced6b-c294-4d03-8dd2-b33500292ca9 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:46.334510 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f93ced6b-c294-4d03-8dd2-b33500292ca9 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:46.335786 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f93ced6b-c294-4d03-8dd2-b33500292ca9 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:46.408126 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f93ced6b-c294-4d03-8dd2-b33500292ca9 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] 10.222.0.61 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.102432 Aug 31 16:00:46.410420 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 664/1339] 10.222.0.61 () {58 vars in 1176 bytes} [Wed Aug 31 16:00:46 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:00:46.423245 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-fd530b84-a620-4eeb-968a-4264f4515cc2 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Calling method '.version_select at 0x7f5ae8fb6670>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:50.499485 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=8 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:00:50.798942 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-fd530b84-a620-4eeb-968a-4264f4515cc2 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] HTTP exception thrown: Image not found. Aug 31 16:00:50.801017 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-fd530b84-a620-4eeb-968a-4264f4515cc2 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Request method failure captured: Aug 31 16:00:50.801017 n-d-850499-9 devstack@n-api.service[122256]: request: DELETE /compute/v2.1/images/cb50edd6-bef0-4d08-a365-0022bfcca565 HTTP/1.1 Aug 31 16:00:50.801017 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:00:50.801017 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:00:50.801017 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:00:50.801017 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:00:50.801017 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:00:50.801017 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:00:50.801017 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:00:50.801017 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:00:50.801017 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4UcGHO9gatUvWJBB907oWawoQP70h6HsJbsny_eFggCHTOgqUkoCg1AvAVcAHjORdEbkXL7xp_g0w0MdWTsQsxdtQLftyhBkZlCr9g7XUi02ZEumxE15kVflv1oC3aQIZmyWr_qGIamtOyoWvoJnlxnc8ckdznU53DKuHgbDBtijYA Aug 31 16:00:50.801017 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:00:50.801017 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:00:50.801017 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:00:50.801017 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:00:50.801017 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:00:50.801017 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:00:50.801017 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 7ed252ebf7c741bbb36b553ac1767579 Aug 31 16:00:50.801017 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-977175069 Aug 31 16:00:50.801017 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:00:50.801017 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:00:50.802388 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7ed252ebf7c741bbb36b553ac1767579"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7ed252ebf7c741bbb36b553ac1767579"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7ed252ebf7c741bbb36b553ac1767579", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7ed252ebf7c741bbb36b553ac1767579"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:00:50.802388 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-977175069 Aug 31 16:00:50.802388 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 7ed252ebf7c741bbb36b553ac1767579 Aug 31 16:00:50.802388 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-977175069 Aug 31 16:00:50.802388 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ImagesOneServerNegativeTestJSON-977175069-project Aug 31 16:00:50.802388 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:00:50.802388 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:00:50.802388 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 3ccce16c7fda401ea68fb31ea8099d78 Aug 31 16:00:50.802388 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-977175069-project Aug 31 16:00:50.802388 n-d-850499-9 devstack@n-api.service[122256]: method: Aug 31 16:00:50.802388 n-d-850499-9 devstack@n-api.service[122256]: exception: Image not found. Aug 31 16:00:50.802388 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': 'cb50edd6-bef0-4d08-a365-0022bfcca565'} Aug 31 16:00:50.802388 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:00:50.803252 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:50.803252 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 31 16:00:50.803252 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 31 16:00:50.803252 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 31 16:00:50.803252 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 31 16:00:50.803252 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 31 16:00:50.803252 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 31 16:00:50.803252 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 31 16:00:50.803252 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 31 16:00:50.803252 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 31 16:00:50.803252 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 31 16:00:50.803252 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 31 16:00:50.803252 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 31 16:00:50.803252 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 31 16:00:50.803252 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 31 16:00:50.803252 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image cb50edd6-bef0-4d08-a365-0022bfcca565 to delete Aug 31 16:00:50.803252 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:50.803252 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:50.803252 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:50.804459 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:50.804459 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 31 16:00:50.804459 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 31 16:00:50.804459 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 31 16:00:50.804459 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 31 16:00:50.804459 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 31 16:00:50.804459 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 31 16:00:50.804459 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image cb50edd6-bef0-4d08-a365-0022bfcca565 could not be found. Aug 31 16:00:50.804459 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:50.804459 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:50.804459 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:50.804459 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:50.804459 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:50.804459 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:50.804459 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:00:50.804459 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:00:50.804459 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:00:50.804459 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:00:50.804459 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:00:50.804459 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:00:50.805873 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 31 16:00:50.805873 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 31 16:00:50.805873 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 31 16:00:50.805873 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:50.805873 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:50.805873 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:50.805873 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:50.805873 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:50.805873 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:50.805873 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:00:50.805873 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:00:50.805873 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 31 16:00:50.805873 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:50.808768 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-fd530b84-a620-4eeb-968a-4264f4515cc2 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Returning 404 to user: Image not found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:00:50.810135 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-fd530b84-a620-4eeb-968a-4264f4515cc2 tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "DELETE /compute/v2.1/images/cb50edd6-bef0-4d08-a365-0022bfcca565" status: 404 len: 62 microversion: 2.1 time: 4.398259 Aug 31 16:00:50.811136 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 665/1340] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:46 2022] DELETE /compute/v2.1/images/cb50edd6-bef0-4d08-a365-0022bfcca565 => generated 62 bytes in 4400 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 31 16:00:50.820017 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c71bb6cd-3b9c-4399-80dd-85890251e2a8 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:50.822600 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c71bb6cd-3b9c-4399-80dd-85890251e2a8 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:50.840951 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8ae15ef8-57df-4dd7-a74c-3b67f99e81f2 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/images/91f26408-c009-455c-b26c-f5cfe4ba8d54" status: 200 len: 1414 microversion: 2.1 time: 4.613025 Aug 31 16:00:50.842492 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c71bb6cd-3b9c-4399-80dd-85890251e2a8 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:50.843001 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c71bb6cd-3b9c-4399-80dd-85890251e2a8 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:50.843443 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c71bb6cd-3b9c-4399-80dd-85890251e2a8 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:50.844193 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c71bb6cd-3b9c-4399-80dd-85890251e2a8 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:50.844649 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c71bb6cd-3b9c-4399-80dd-85890251e2a8 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:50.845242 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 676/1341] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:00:46 2022] GET /compute/v2.1/images/91f26408-c009-455c-b26c-f5cfe4ba8d54 => generated 1414 bytes in 4618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:50.851828 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c71bb6cd-3b9c-4399-80dd-85890251e2a8 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:50.925005 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c71bb6cd-3b9c-4399-80dd-85890251e2a8 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:50.936291 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c71bb6cd-3b9c-4399-80dd-85890251e2a8 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:50.938391 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c71bb6cd-3b9c-4399-80dd-85890251e2a8 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:50.948176 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c71bb6cd-3b9c-4399-80dd-85890251e2a8 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1555 microversion: 2.91 time: 0.135826 Aug 31 16:00:50.965433 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 666/1342] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:00:50 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1555 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:00:50.973686 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d92b3fd3-3b92-490e-9443-590d9d86f38d tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:50.974916 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d92b3fd3-3b92-490e-9443-590d9d86f38d tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] [instance: a50acb4f-16d0-4c72-b603-f795220ea866] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:50.983153 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d92b3fd3-3b92-490e-9443-590d9d86f38d tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:50.984085 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d92b3fd3-3b92-490e-9443-590d9d86f38d tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:50.984910 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d92b3fd3-3b92-490e-9443-590d9d86f38d tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:50.986039 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d92b3fd3-3b92-490e-9443-590d9d86f38d tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:50.987112 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d92b3fd3-3b92-490e-9443-590d9d86f38d tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:50.988966 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d92b3fd3-3b92-490e-9443-590d9d86f38d tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:50.995137 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5ea093d1-4e62-42c3-a72e-3794d55aa988 tempest-HostsAdminNegativeTestJSON-336688701 tempest-HostsAdminNegativeTestJSON-336688701-project-admin] Calling method '.version_select at 0x7f5ae9054c10>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:50.999312 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5ea093d1-4e62-42c3-a72e-3794d55aa988 tempest-HostsAdminNegativeTestJSON-336688701 tempest-HostsAdminNegativeTestJSON-336688701-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:51.000128 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5ea093d1-4e62-42c3-a72e-3794d55aa988 tempest-HostsAdminNegativeTestJSON-336688701 tempest-HostsAdminNegativeTestJSON-336688701-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:51.002943 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5ea093d1-4e62-42c3-a72e-3794d55aa988 tempest-HostsAdminNegativeTestJSON-336688701 tempest-HostsAdminNegativeTestJSON-336688701-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:51.004256 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5ea093d1-4e62-42c3-a72e-3794d55aa988 tempest-HostsAdminNegativeTestJSON-336688701 tempest-HostsAdminNegativeTestJSON-336688701-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:51.007116 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5ea093d1-4e62-42c3-a72e-3794d55aa988 tempest-HostsAdminNegativeTestJSON-336688701 tempest-HostsAdminNegativeTestJSON-336688701-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:51.007890 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5ea093d1-4e62-42c3-a72e-3794d55aa988 tempest-HostsAdminNegativeTestJSON-336688701 tempest-HostsAdminNegativeTestJSON-336688701-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:51.071198 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5ea093d1-4e62-42c3-a72e-3794d55aa988 tempest-HostsAdminNegativeTestJSON-336688701 tempest-HostsAdminNegativeTestJSON-336688701-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.224888 Aug 31 16:00:51.072240 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 677/1343] 10.222.0.61 () {58 vars in 1128 bytes} [Wed Aug 31 16:00:50 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:00:51.077315 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6f791ceb-ec0d-467f-a299-2fce11dbbbcf tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1b00b304-a205-4dd7-a4a8-a48d9036b176", "device": "/dev/xvdb"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:00:51.080844 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6f791ceb-ec0d-467f-a299-2fce11dbbbcf tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: cc085aaa-21b2-48a6-b69c-de4e261dfe7f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:51.088716 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6f791ceb-ec0d-467f-a299-2fce11dbbbcf tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:51.092810 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6f791ceb-ec0d-467f-a299-2fce11dbbbcf tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:51.093670 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6f791ceb-ec0d-467f-a299-2fce11dbbbcf tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:51.094664 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6f791ceb-ec0d-467f-a299-2fce11dbbbcf tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:51.095392 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6f791ceb-ec0d-467f-a299-2fce11dbbbcf tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:51.096039 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6f791ceb-ec0d-467f-a299-2fce11dbbbcf tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:51.242368 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d92b3fd3-3b92-490e-9443-590d9d86f38d tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6382b576b5404eb90214c00b62299b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7fb4ddb0e649edbe96d046cde6b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:51.251200 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d92b3fd3-3b92-490e-9443-590d9d86f38d tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] 10.222.0.61 "GET /compute/v2.1/servers/a50acb4f-16d0-4c72-b603-f795220ea866" status: 200 len: 1321 microversion: 2.1 time: 0.284464 Aug 31 16:00:51.251886 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 667/1344] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:50 2022] GET /compute/v2.1/servers/a50acb4f-16d0-4c72-b603-f795220ea866 => generated 1321 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:51.260742 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8fcd26b5-1cc6-43c4-8b2b-0cfec68378ae tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:51.261907 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8fcd26b5-1cc6-43c4-8b2b-0cfec68378ae tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] [instance: aa95066b-b1b8-43d8-8c5a-024e3890aa27] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:51.272021 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8fcd26b5-1cc6-43c4-8b2b-0cfec68378ae tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:51.274244 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8fcd26b5-1cc6-43c4-8b2b-0cfec68378ae tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:51.275030 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8fcd26b5-1cc6-43c4-8b2b-0cfec68378ae tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:51.276211 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8fcd26b5-1cc6-43c4-8b2b-0cfec68378ae tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:51.277174 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8fcd26b5-1cc6-43c4-8b2b-0cfec68378ae tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:51.277828 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8fcd26b5-1cc6-43c4-8b2b-0cfec68378ae tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:51.294803 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-8fcd26b5-1cc6-43c4-8b2b-0cfec68378ae tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] HTTP exception thrown: Instance aa95066b-b1b8-43d8-8c5a-024e3890aa27 could not be found. Aug 31 16:00:51.297091 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8fcd26b5-1cc6-43c4-8b2b-0cfec68378ae tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Request method failure captured: Aug 31 16:00:51.297091 n-d-850499-9 devstack@n-api.service[122256]: request: DELETE /compute/v2.1/servers/aa95066b-b1b8-43d8-8c5a-024e3890aa27 HTTP/1.1 Aug 31 16:00:51.297091 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:00:51.297091 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:00:51.297091 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:00:51.297091 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:00:51.297091 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:00:51.297091 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:00:51.297091 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:00:51.297091 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:00:51.297091 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4UcGHO9gatUvWJBB907oWawoQP70h6HsJbsny_eFggCHTOgqUkoCg1AvAVcAHjORdEbkXL7xp_g0w0MdWTsQsxdtQLftyhBkZlCr9g7XUi02ZEumxE15kVflv1oC3aQIZmyWr_qGIamtOyoWvoJnlxnc8ckdznU53DKuHgbDBtijYA Aug 31 16:00:51.297091 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:00:51.297091 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:00:51.297091 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:00:51.297091 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:00:51.297091 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:00:51.297091 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:00:51.297091 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 7ed252ebf7c741bbb36b553ac1767579 Aug 31 16:00:51.297091 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-977175069 Aug 31 16:00:51.297091 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:00:51.297091 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:00:51.298545 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7ed252ebf7c741bbb36b553ac1767579"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7ed252ebf7c741bbb36b553ac1767579"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7ed252ebf7c741bbb36b553ac1767579", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7ed252ebf7c741bbb36b553ac1767579"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:00:51.298545 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-977175069 Aug 31 16:00:51.298545 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 7ed252ebf7c741bbb36b553ac1767579 Aug 31 16:00:51.298545 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-977175069 Aug 31 16:00:51.298545 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ImagesOneServerNegativeTestJSON-977175069-project Aug 31 16:00:51.298545 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:00:51.298545 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:00:51.298545 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 3ccce16c7fda401ea68fb31ea8099d78 Aug 31 16:00:51.298545 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-977175069-project Aug 31 16:00:51.298545 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:00:51.298545 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance aa95066b-b1b8-43d8-8c5a-024e3890aa27 could not be found. Aug 31 16:00:51.298545 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': 'aa95066b-b1b8-43d8-8c5a-024e3890aa27'} Aug 31 16:00:51.299266 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:00:51.299266 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:51.299266 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:00:51.299266 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:00:51.299266 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:00:51.299266 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:00:51.299266 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:00:51.299266 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:00:51.299266 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:00:51.299266 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:00:51.299266 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa95066b-b1b8-43d8-8c5a-024e3890aa27 could not be found. Aug 31 16:00:51.299266 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:51.299266 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:51.299266 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:51.299266 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:51.299266 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:51.299266 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:51.299266 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:00:51.299266 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:00:51.299266 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:00:51.300527 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:00:51.300527 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:00:51.300527 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:00:51.300527 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:00:51.300527 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:00:51.300527 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:00:51.300527 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:00:51.300527 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:00:51.300527 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:00:51.300527 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa95066b-b1b8-43d8-8c5a-024e3890aa27 could not be found. Aug 31 16:00:51.300527 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:51.300527 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:51.300527 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:51.300527 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:51.300527 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:51.300527 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:51.300527 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:00:51.300527 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:00:51.300527 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa95066b-b1b8-43d8-8c5a-024e3890aa27 could not be found. Aug 31 16:00:51.300527 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:51.303340 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8fcd26b5-1cc6-43c4-8b2b-0cfec68378ae tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Returning 404 to user: Instance aa95066b-b1b8-43d8-8c5a-024e3890aa27 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:00:51.304344 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8fcd26b5-1cc6-43c4-8b2b-0cfec68378ae tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "DELETE /compute/v2.1/servers/aa95066b-b1b8-43d8-8c5a-024e3890aa27" status: 404 len: 111 microversion: 2.1 time: 0.051272 Aug 31 16:00:51.304994 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 668/1345] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:00:51 2022] DELETE /compute/v2.1/servers/aa95066b-b1b8-43d8-8c5a-024e3890aa27 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:00:51.444448 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-be0a75cd-4559-417e-8d92-ce940fbbb4ca tempest-HostsAdminNegativeTestJSON-2537876 tempest-HostsAdminNegativeTestJSON-2537876-project] Calling method '.version_select at 0x7f5ae8fe1430>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:51.448804 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-be0a75cd-4559-417e-8d92-ce940fbbb4ca tempest-HostsAdminNegativeTestJSON-2537876 tempest-HostsAdminNegativeTestJSON-2537876-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '083a03f4bf7d460d8b6634d83ef28019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3d8679dcd04dab8359e54b5e76fe80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:51.457847 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-be0a75cd-4559-417e-8d92-ce940fbbb4ca tempest-HostsAdminNegativeTestJSON-2537876 tempest-HostsAdminNegativeTestJSON-2537876-project] Request method failure captured: Aug 31 16:00:51.457847 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Aug 31 16:00:51.457847 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:00:51.457847 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:00:51.457847 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:00:51.457847 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:00:51.457847 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:00:51.457847 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:00:51.457847 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:00:51.457847 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:00:51.457847 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4Wtr5STs6QXwOphCvo-shikPCqMdzWCM17dbm2D2nSx_THPTGU3D10eRhgNnhUjRL4ujF7Q1ZFKf6uX8XP8He9Sb0OVcfxyGalV01Thm6B7Nx_RrGT9AtR9ojRTW1ZiajqcwkcFDXGpv31bYKW6XguGdwLwyCubiGM9SYAq_C2VLnk Aug 31 16:00:51.457847 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:00:51.457847 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:00:51.457847 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:00:51.457847 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:00:51.457847 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:00:51.457847 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:00:51.457847 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 1e3d8679dcd04dab8359e54b5e76fe80 Aug 31 16:00:51.457847 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2537876 Aug 31 16:00:51.457847 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:00:51.457847 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:00:51.459286 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1e3d8679dcd04dab8359e54b5e76fe80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1e3d8679dcd04dab8359e54b5e76fe80"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1e3d8679dcd04dab8359e54b5e76fe80", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1e3d8679dcd04dab8359e54b5e76fe80"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:00:51.459286 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2537876 Aug 31 16:00:51.459286 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 1e3d8679dcd04dab8359e54b5e76fe80 Aug 31 16:00:51.459286 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2537876 Aug 31 16:00:51.459286 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-HostsAdminNegativeTestJSON-2537876-project Aug 31 16:00:51.459286 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:00:51.459286 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:00:51.459286 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 083a03f4bf7d460d8b6634d83ef28019 Aug 31 16:00:51.459286 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2537876-project Aug 31 16:00:51.459286 n-d-850499-9 devstack@n-api.service[122256]: method: Aug 31 16:00:51.459286 n-d-850499-9 devstack@n-api.service[122256]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 31 16:00:51.459286 n-d-850499-9 devstack@n-api.service[122256]: action_args: {} Aug 31 16:00:51.459286 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:00:51.460763 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:51.460763 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:51.460763 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:51.460763 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:00:51.460763 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:00:51.460763 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:00:51.460763 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:00:51.460763 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 31 16:00:51.460763 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:00:51.460763 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:00:51.460763 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:00:51.460763 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Aug 31 16:00:51.460763 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Aug 31 16:00:51.460763 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 31 16:00:51.460763 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 31 16:00:51.460763 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 31 16:00:51.460763 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 31 16:00:51.460763 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 16:00:51.460763 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 31 16:00:51.462107 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 16:00:51.462107 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise self.value Aug 31 16:00:51.462107 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 31 16:00:51.462107 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 31 16:00:51.462107 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 31 16:00:51.462107 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 31 16:00:51.462107 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 31 16:00:51.462107 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 31 16:00:51.462107 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 31 16:00:51.462107 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:51.462107 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:51.462107 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:51.462107 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:51.462107 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:51.462107 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:51.462107 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 31 16:00:51.462107 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 31 16:00:51.462107 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 31 16:00:51.462107 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:51.471259 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-be0a75cd-4559-417e-8d92-ce940fbbb4ca tempest-HostsAdminNegativeTestJSON-2537876 tempest-HostsAdminNegativeTestJSON-2537876-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:00:51.471259 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-be0a75cd-4559-417e-8d92-ce940fbbb4ca tempest-HostsAdminNegativeTestJSON-2537876 tempest-HostsAdminNegativeTestJSON-2537876-project] 10.222.0.61 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.155654 Aug 31 16:00:51.471259 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 669/1346] 10.222.0.61 () {58 vars in 1128 bytes} [Wed Aug 31 16:00:51 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 157 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:00:51.475036 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-525d374c-000f-4bb0-bf5c-ae7ee04d22fb tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:51.476791 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-525d374c-000f-4bb0-bf5c-ae7ee04d22fb tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] [instance: aa95066b-b1b8-43d8-8c5a-024e3890aa27] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:51.485872 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-525d374c-000f-4bb0-bf5c-ae7ee04d22fb tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:51.486185 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-525d374c-000f-4bb0-bf5c-ae7ee04d22fb tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:51.486447 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-525d374c-000f-4bb0-bf5c-ae7ee04d22fb tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:51.487196 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-525d374c-000f-4bb0-bf5c-ae7ee04d22fb tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:51.501003 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-525d374c-000f-4bb0-bf5c-ae7ee04d22fb tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:51.501003 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-525d374c-000f-4bb0-bf5c-ae7ee04d22fb tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:51.509718 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-525d374c-000f-4bb0-bf5c-ae7ee04d22fb tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] HTTP exception thrown: Instance aa95066b-b1b8-43d8-8c5a-024e3890aa27 could not be found. Aug 31 16:00:51.511738 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-525d374c-000f-4bb0-bf5c-ae7ee04d22fb tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Request method failure captured: Aug 31 16:00:51.511738 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/aa95066b-b1b8-43d8-8c5a-024e3890aa27 HTTP/1.1 Aug 31 16:00:51.511738 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:00:51.511738 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:00:51.511738 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:00:51.511738 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:00:51.511738 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:00:51.511738 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:00:51.511738 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:00:51.511738 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:00:51.511738 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4UcGHO9gatUvWJBB907oWawoQP70h6HsJbsny_eFggCHTOgqUkoCg1AvAVcAHjORdEbkXL7xp_g0w0MdWTsQsxdtQLftyhBkZlCr9g7XUi02ZEumxE15kVflv1oC3aQIZmyWr_qGIamtOyoWvoJnlxnc8ckdznU53DKuHgbDBtijYA Aug 31 16:00:51.511738 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:00:51.511738 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:00:51.511738 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:00:51.511738 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:00:51.511738 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:00:51.511738 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:00:51.511738 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 7ed252ebf7c741bbb36b553ac1767579 Aug 31 16:00:51.511738 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-977175069 Aug 31 16:00:51.511738 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:00:51.511738 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:00:51.513740 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7ed252ebf7c741bbb36b553ac1767579"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7ed252ebf7c741bbb36b553ac1767579"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7ed252ebf7c741bbb36b553ac1767579", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7ed252ebf7c741bbb36b553ac1767579"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:00:51.513740 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-977175069 Aug 31 16:00:51.513740 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 7ed252ebf7c741bbb36b553ac1767579 Aug 31 16:00:51.513740 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-977175069 Aug 31 16:00:51.513740 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ImagesOneServerNegativeTestJSON-977175069-project Aug 31 16:00:51.513740 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:00:51.513740 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:00:51.513740 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 3ccce16c7fda401ea68fb31ea8099d78 Aug 31 16:00:51.513740 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-977175069-project Aug 31 16:00:51.513740 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:00:51.513740 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance aa95066b-b1b8-43d8-8c5a-024e3890aa27 could not be found. Aug 31 16:00:51.513740 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': 'aa95066b-b1b8-43d8-8c5a-024e3890aa27'} Aug 31 16:00:51.514810 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:00:51.514810 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:51.514810 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:00:51.514810 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:00:51.514810 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:00:51.514810 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:00:51.514810 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:00:51.514810 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:00:51.514810 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:00:51.514810 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:00:51.514810 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa95066b-b1b8-43d8-8c5a-024e3890aa27 could not be found. Aug 31 16:00:51.514810 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:51.514810 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:51.514810 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:51.514810 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:51.514810 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:51.514810 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:51.514810 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:00:51.514810 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:00:51.514810 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:00:51.516062 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:00:51.516062 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:00:51.516062 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:00:51.516062 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:00:51.516062 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:00:51.516062 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:00:51.516062 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:00:51.516062 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa95066b-b1b8-43d8-8c5a-024e3890aa27 could not be found. Aug 31 16:00:51.516062 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:51.516062 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:51.516062 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:51.516062 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:51.516062 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:51.516062 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:51.516062 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:00:51.516062 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:00:51.516062 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa95066b-b1b8-43d8-8c5a-024e3890aa27 could not be found. Aug 31 16:00:51.516062 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:51.519617 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-525d374c-000f-4bb0-bf5c-ae7ee04d22fb tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] Returning 404 to user: Instance aa95066b-b1b8-43d8-8c5a-024e3890aa27 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:00:51.519617 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-525d374c-000f-4bb0-bf5c-ae7ee04d22fb tempest-ImagesOneServerNegativeTestJSON-977175069 tempest-ImagesOneServerNegativeTestJSON-977175069-project] 10.222.0.61 "GET /compute/v2.1/servers/aa95066b-b1b8-43d8-8c5a-024e3890aa27" status: 404 len: 111 microversion: 2.1 time: 0.048472 Aug 31 16:00:51.519617 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 670/1347] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:51 2022] GET /compute/v2.1/servers/aa95066b-b1b8-43d8-8c5a-024e3890aa27 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:00:51.522048 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-686d8da6-0e17-45be-b174-34acbe33b596 tempest-HostsAdminNegativeTestJSON-2537876 tempest-HostsAdminNegativeTestJSON-2537876-project] Calling method '.version_select at 0x7f5ae8fe1a60>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:51.523732 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-686d8da6-0e17-45be-b174-34acbe33b596 tempest-HostsAdminNegativeTestJSON-2537876 tempest-HostsAdminNegativeTestJSON-2537876-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '083a03f4bf7d460d8b6634d83ef28019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3d8679dcd04dab8359e54b5e76fe80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:51.525794 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-686d8da6-0e17-45be-b174-34acbe33b596 tempest-HostsAdminNegativeTestJSON-2537876 tempest-HostsAdminNegativeTestJSON-2537876-project] Request method failure captured: Aug 31 16:00:51.525794 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/os-hosts/n-d-850499-9/reboot HTTP/1.1 Aug 31 16:00:51.525794 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:00:51.525794 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:00:51.525794 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:00:51.525794 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:00:51.525794 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:00:51.525794 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:00:51.525794 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:00:51.525794 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:00:51.525794 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4Wtr5STs6QXwOphCvo-shikPCqMdzWCM17dbm2D2nSx_THPTGU3D10eRhgNnhUjRL4ujF7Q1ZFKf6uX8XP8He9Sb0OVcfxyGalV01Thm6B7Nx_RrGT9AtR9ojRTW1ZiajqcwkcFDXGpv31bYKW6XguGdwLwyCubiGM9SYAq_C2VLnk Aug 31 16:00:51.525794 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:00:51.525794 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:00:51.525794 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:00:51.525794 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:00:51.525794 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:00:51.525794 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:00:51.525794 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 1e3d8679dcd04dab8359e54b5e76fe80 Aug 31 16:00:51.525794 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2537876 Aug 31 16:00:51.525794 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:00:51.525794 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:00:51.527094 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1e3d8679dcd04dab8359e54b5e76fe80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1e3d8679dcd04dab8359e54b5e76fe80"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1e3d8679dcd04dab8359e54b5e76fe80", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1e3d8679dcd04dab8359e54b5e76fe80"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:00:51.527094 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2537876 Aug 31 16:00:51.527094 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 1e3d8679dcd04dab8359e54b5e76fe80 Aug 31 16:00:51.527094 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2537876 Aug 31 16:00:51.527094 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-HostsAdminNegativeTestJSON-2537876-project Aug 31 16:00:51.527094 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:00:51.527094 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:00:51.527094 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 083a03f4bf7d460d8b6634d83ef28019 Aug 31 16:00:51.527094 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2537876-project Aug 31 16:00:51.527094 n-d-850499-9 devstack@n-api.service[122256]: method: Aug 31 16:00:51.527094 n-d-850499-9 devstack@n-api.service[122256]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 31 16:00:51.527094 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': 'n-d-850499-9'} Aug 31 16:00:51.527094 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:00:51.528181 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:51.528181 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:51.528181 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:51.528181 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:00:51.528181 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:00:51.528181 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:00:51.528181 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:00:51.528181 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:00:51.528181 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:00:51.528181 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Aug 31 16:00:51.528181 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Aug 31 16:00:51.528181 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 31 16:00:51.528181 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 31 16:00:51.528181 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 31 16:00:51.528181 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 31 16:00:51.528181 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 16:00:51.528181 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 31 16:00:51.528181 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 16:00:51.528181 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise self.value Aug 31 16:00:51.529635 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 31 16:00:51.529635 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 31 16:00:51.529635 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 31 16:00:51.529635 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 31 16:00:51.529635 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 31 16:00:51.529635 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 31 16:00:51.529635 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 31 16:00:51.529635 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:51.529635 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:51.529635 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:51.529635 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:51.529635 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:51.529635 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:51.529635 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 31 16:00:51.529635 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 31 16:00:51.529635 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 31 16:00:51.529635 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:51.532743 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-686d8da6-0e17-45be-b174-34acbe33b596 tempest-HostsAdminNegativeTestJSON-2537876 tempest-HostsAdminNegativeTestJSON-2537876-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:00:51.532743 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-686d8da6-0e17-45be-b174-34acbe33b596 tempest-HostsAdminNegativeTestJSON-2537876 tempest-HostsAdminNegativeTestJSON-2537876-project] 10.222.0.61 "GET /compute/v2.1/os-hosts/n-d-850499-9/reboot" status: 403 len: 111 microversion: 2.1 time: 0.012977 Aug 31 16:00:51.532743 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 671/1348] 10.222.0.61 () {58 vars in 1188 bytes} [Wed Aug 31 16:00:51 2022] GET /compute/v2.1/os-hosts/n-d-850499-9/reboot => generated 111 bytes in 14 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:00:51.539594 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a46b00f0-a195-4724-a361-acc3093d92cf tempest-HostsAdminNegativeTestJSON-336688701 tempest-HostsAdminNegativeTestJSON-336688701-project-admin] Calling method '.version_select at 0x7f5ae8f1c160>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:51.552490 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-a46b00f0-a195-4724-a361-acc3093d92cf tempest-HostsAdminNegativeTestJSON-336688701 tempest-HostsAdminNegativeTestJSON-336688701-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 31 16:00:51.554527 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a46b00f0-a195-4724-a361-acc3093d92cf tempest-HostsAdminNegativeTestJSON-336688701 tempest-HostsAdminNegativeTestJSON-336688701-project-admin] Request method failure captured: Aug 31 16:00:51.554527 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Aug 31 16:00:51.554527 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:00:51.554527 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:00:51.554527 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:00:51.554527 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:00:51.554527 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:00:51.554527 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:00:51.554527 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:00:51.554527 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:00:51.554527 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4Wu1INNhXGJmQdcvE65QE9GdAAdIUbZIi81ym4_zKCWvfWEPaedkaOiChdvA_A1mxMMwfDHYHKWpNpfCaNhOYjyviNBWuJLc4noHTXiwfv6EP8F-bAds851XH7wbMAZpi9NAfAk7b5no3FtHQRrRu29iUtd--D3gO46i6g3kMMCqMg Aug 31 16:00:51.554527 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:00:51.554527 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:00:51.554527 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:00:51.554527 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:00:51.554527 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:00:51.554527 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:00:51.554527 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: b91796a440d343eb84d3dd8dfe7c9171 Aug 31 16:00:51.554527 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-336688701 Aug 31 16:00:51.554527 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,admin,member Aug 31 16:00:51.554527 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,admin,member Aug 31 16:00:51.556216 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b91796a440d343eb84d3dd8dfe7c9171"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/b91796a440d343eb84d3dd8dfe7c9171"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_b91796a440d343eb84d3dd8dfe7c9171", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b91796a440d343eb84d3dd8dfe7c9171"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:00:51.556216 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-HostsAdminNegativeTestJSON-336688701 Aug 31 16:00:51.556216 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: b91796a440d343eb84d3dd8dfe7c9171 Aug 31 16:00:51.556216 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-336688701 Aug 31 16:00:51.556216 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-HostsAdminNegativeTestJSON-336688701-project-admin Aug 31 16:00:51.556216 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:00:51.556216 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:00:51.556216 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 853defa637b74920b1d688b9522247ff Aug 31 16:00:51.556216 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-HostsAdminNegativeTestJSON-336688701-project-admin Aug 31 16:00:51.556216 n-d-850499-9 devstack@n-api.service[122256]: method: Aug 31 16:00:51.556216 n-d-850499-9 devstack@n-api.service[122256]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 31 16:00:51.556216 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': 'nonexistent_hostname'} Aug 31 16:00:51.556216 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:00:51.557244 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:51.557244 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 31 16:00:51.557244 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 31 16:00:51.557244 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 31 16:00:51.557244 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 31 16:00:51.557244 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 16:00:51.557244 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 31 16:00:51.557244 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 16:00:51.557244 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise self.value Aug 31 16:00:51.557244 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 31 16:00:51.557244 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 31 16:00:51.557244 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5988, in targeted Aug 31 16:00:51.557244 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 31 16:00:51.557244 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 16:00:51.557244 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 16:00:51.557244 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 31 16:00:51.557244 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 31 16:00:51.557244 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 31 16:00:51.557244 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 31 16:00:51.558664 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 31 16:00:51.558664 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 31 16:00:51.558664 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 31 16:00:51.558664 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:51.558664 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:51.558664 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:51.558664 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:51.558664 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:51.558664 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:51.558664 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:00:51.558664 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:00:51.558664 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:00:51.558664 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:00:51.558664 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:00:51.558664 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:00:51.558664 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Aug 31 16:00:51.558664 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Aug 31 16:00:51.558664 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 31 16:00:51.558664 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:00:51.560129 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 31 16:00:51.560129 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:51.560129 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:51.560129 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:51.560129 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:51.560129 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:51.560129 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:51.560129 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:00:51.560129 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:00:51.560129 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 31 16:00:51.560129 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:51.560129 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a46b00f0-a195-4724-a361-acc3093d92cf tempest-HostsAdminNegativeTestJSON-336688701 tempest-HostsAdminNegativeTestJSON-336688701-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:00:51.560129 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a46b00f0-a195-4724-a361-acc3093d92cf tempest-HostsAdminNegativeTestJSON-336688701 tempest-HostsAdminNegativeTestJSON-336688701-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.022719 Aug 31 16:00:51.566517 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 672/1349] 10.222.0.61 () {58 vars in 1212 bytes} [Wed Aug 31 16:00:51 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 31 16:00:51.571928 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6860b27c-25ed-4e1d-aef0-6d73e11f49b1 tempest-HostsAdminNegativeTestJSON-2537876 tempest-HostsAdminNegativeTestJSON-2537876-project] Calling method '.version_select at 0x7f5ae8fe11f0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:51.573984 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-6860b27c-25ed-4e1d-aef0-6d73e11f49b1 tempest-HostsAdminNegativeTestJSON-2537876 tempest-HostsAdminNegativeTestJSON-2537876-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '083a03f4bf7d460d8b6634d83ef28019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3d8679dcd04dab8359e54b5e76fe80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:51.575984 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6860b27c-25ed-4e1d-aef0-6d73e11f49b1 tempest-HostsAdminNegativeTestJSON-2537876 tempest-HostsAdminNegativeTestJSON-2537876-project] Request method failure captured: Aug 31 16:00:51.575984 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/os-hosts/n-d-850499-9 HTTP/1.1 Aug 31 16:00:51.575984 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:00:51.575984 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:00:51.575984 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:00:51.575984 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:00:51.575984 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:00:51.575984 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:00:51.575984 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:00:51.575984 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:00:51.575984 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4Wtr5STs6QXwOphCvo-shikPCqMdzWCM17dbm2D2nSx_THPTGU3D10eRhgNnhUjRL4ujF7Q1ZFKf6uX8XP8He9Sb0OVcfxyGalV01Thm6B7Nx_RrGT9AtR9ojRTW1ZiajqcwkcFDXGpv31bYKW6XguGdwLwyCubiGM9SYAq_C2VLnk Aug 31 16:00:51.575984 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:00:51.575984 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:00:51.575984 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:00:51.575984 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:00:51.575984 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:00:51.575984 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:00:51.575984 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 1e3d8679dcd04dab8359e54b5e76fe80 Aug 31 16:00:51.575984 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2537876 Aug 31 16:00:51.575984 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:00:51.575984 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:00:51.577631 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1e3d8679dcd04dab8359e54b5e76fe80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1e3d8679dcd04dab8359e54b5e76fe80"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1e3d8679dcd04dab8359e54b5e76fe80", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1e3d8679dcd04dab8359e54b5e76fe80"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:00:51.577631 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2537876 Aug 31 16:00:51.577631 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 1e3d8679dcd04dab8359e54b5e76fe80 Aug 31 16:00:51.577631 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2537876 Aug 31 16:00:51.577631 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-HostsAdminNegativeTestJSON-2537876-project Aug 31 16:00:51.577631 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:00:51.577631 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:00:51.577631 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 083a03f4bf7d460d8b6634d83ef28019 Aug 31 16:00:51.577631 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2537876-project Aug 31 16:00:51.577631 n-d-850499-9 devstack@n-api.service[122256]: method: Aug 31 16:00:51.577631 n-d-850499-9 devstack@n-api.service[122256]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 31 16:00:51.577631 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': 'n-d-850499-9'} Aug 31 16:00:51.577631 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:00:51.578589 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:51.578589 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:51.578589 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:51.578589 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:00:51.578589 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:00:51.578589 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:00:51.578589 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:00:51.578589 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:00:51.578589 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:00:51.578589 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Aug 31 16:00:51.578589 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Aug 31 16:00:51.578589 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 31 16:00:51.578589 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 31 16:00:51.578589 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 31 16:00:51.578589 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 31 16:00:51.578589 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 16:00:51.578589 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 31 16:00:51.578589 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 16:00:51.578589 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise self.value Aug 31 16:00:51.579997 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 31 16:00:51.579997 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 31 16:00:51.579997 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 31 16:00:51.579997 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 31 16:00:51.579997 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 31 16:00:51.579997 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 31 16:00:51.579997 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 31 16:00:51.579997 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:51.579997 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:51.579997 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:51.579997 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:51.579997 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:51.579997 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:51.579997 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 31 16:00:51.579997 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 31 16:00:51.579997 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 31 16:00:51.579997 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:51.581525 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6860b27c-25ed-4e1d-aef0-6d73e11f49b1 tempest-HostsAdminNegativeTestJSON-2537876 tempest-HostsAdminNegativeTestJSON-2537876-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:00:51.582564 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6860b27c-25ed-4e1d-aef0-6d73e11f49b1 tempest-HostsAdminNegativeTestJSON-2537876 tempest-HostsAdminNegativeTestJSON-2537876-project] 10.222.0.61 "GET /compute/v2.1/os-hosts/n-d-850499-9" status: 403 len: 109 microversion: 2.1 time: 0.014724 Aug 31 16:00:51.583336 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 673/1350] 10.222.0.61 () {58 vars in 1167 bytes} [Wed Aug 31 16:00:51 2022] GET /compute/v2.1/os-hosts/n-d-850499-9 => generated 109 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:00:51.597450 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0762702f-e80f-4cd2-ac64-fb601fa4a15b tempest-HostsAdminNegativeTestJSON-336688701 tempest-HostsAdminNegativeTestJSON-336688701-project-admin] Calling method '.version_select at 0x7f5ae8fea3a0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:51.609300 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-0762702f-e80f-4cd2-ac64-fb601fa4a15b tempest-HostsAdminNegativeTestJSON-336688701 tempest-HostsAdminNegativeTestJSON-336688701-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 31 16:00:51.611589 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0762702f-e80f-4cd2-ac64-fb601fa4a15b tempest-HostsAdminNegativeTestJSON-336688701 tempest-HostsAdminNegativeTestJSON-336688701-project-admin] Request method failure captured: Aug 31 16:00:51.611589 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Aug 31 16:00:51.611589 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:00:51.611589 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:00:51.611589 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:00:51.611589 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:00:51.611589 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:00:51.611589 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:00:51.611589 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:00:51.611589 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:00:51.611589 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4Wu1INNhXGJmQdcvE65QE9GdAAdIUbZIi81ym4_zKCWvfWEPaedkaOiChdvA_A1mxMMwfDHYHKWpNpfCaNhOYjyviNBWuJLc4noHTXiwfv6EP8F-bAds851XH7wbMAZpi9NAfAk7b5no3FtHQRrRu29iUtd--D3gO46i6g3kMMCqMg Aug 31 16:00:51.611589 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:00:51.611589 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:00:51.611589 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:00:51.611589 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:00:51.611589 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:00:51.611589 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:00:51.611589 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: b91796a440d343eb84d3dd8dfe7c9171 Aug 31 16:00:51.611589 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-336688701 Aug 31 16:00:51.611589 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,admin,member Aug 31 16:00:51.611589 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,admin,member Aug 31 16:00:51.614313 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b91796a440d343eb84d3dd8dfe7c9171"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/b91796a440d343eb84d3dd8dfe7c9171"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_b91796a440d343eb84d3dd8dfe7c9171", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b91796a440d343eb84d3dd8dfe7c9171"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:00:51.614313 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-HostsAdminNegativeTestJSON-336688701 Aug 31 16:00:51.614313 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: b91796a440d343eb84d3dd8dfe7c9171 Aug 31 16:00:51.614313 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-336688701 Aug 31 16:00:51.614313 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-HostsAdminNegativeTestJSON-336688701-project-admin Aug 31 16:00:51.614313 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:00:51.614313 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:00:51.614313 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 853defa637b74920b1d688b9522247ff Aug 31 16:00:51.614313 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-HostsAdminNegativeTestJSON-336688701-project-admin Aug 31 16:00:51.614313 n-d-850499-9 devstack@n-api.service[122256]: method: Aug 31 16:00:51.614313 n-d-850499-9 devstack@n-api.service[122256]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 31 16:00:51.614313 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': 'nonexistent_hostname'} Aug 31 16:00:51.614313 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:00:51.615102 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:51.615102 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Aug 31 16:00:51.615102 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 31 16:00:51.615102 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 16:00:51.615102 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 16:00:51.615102 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 31 16:00:51.615102 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 31 16:00:51.615102 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 31 16:00:51.615102 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 31 16:00:51.615102 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 31 16:00:51.615102 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 31 16:00:51.615102 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 31 16:00:51.615102 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:51.615102 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:51.615102 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:51.615102 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:51.615102 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:51.615102 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:51.615102 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:00:51.618559 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:00:51.618559 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:00:51.618559 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:00:51.618559 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:00:51.618559 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:00:51.618559 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Aug 31 16:00:51.618559 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:00:51.618559 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 31 16:00:51.618559 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:51.618559 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:51.618559 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:51.618559 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:51.618559 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:51.618559 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:51.618559 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:00:51.618559 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:00:51.618559 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 31 16:00:51.618559 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:51.620158 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0762702f-e80f-4cd2-ac64-fb601fa4a15b tempest-HostsAdminNegativeTestJSON-336688701 tempest-HostsAdminNegativeTestJSON-336688701-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:00:51.620158 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0762702f-e80f-4cd2-ac64-fb601fa4a15b tempest-HostsAdminNegativeTestJSON-336688701 tempest-HostsAdminNegativeTestJSON-336688701-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.022710 Aug 31 16:00:51.620612 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 674/1351] 10.222.0.61 () {58 vars in 1191 bytes} [Wed Aug 31 16:00:51 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 31 16:00:51.628587 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-335cae61-e1a2-4fd0-9b88-7bccfd71a0ec tempest-HostsAdminNegativeTestJSON-2537876 tempest-HostsAdminNegativeTestJSON-2537876-project] Calling method '.version_select at 0x7f5ae8fe1940>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:51.630957 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-335cae61-e1a2-4fd0-9b88-7bccfd71a0ec tempest-HostsAdminNegativeTestJSON-2537876 tempest-HostsAdminNegativeTestJSON-2537876-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '083a03f4bf7d460d8b6634d83ef28019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3d8679dcd04dab8359e54b5e76fe80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:51.632982 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-335cae61-e1a2-4fd0-9b88-7bccfd71a0ec tempest-HostsAdminNegativeTestJSON-2537876 tempest-HostsAdminNegativeTestJSON-2537876-project] Request method failure captured: Aug 31 16:00:51.632982 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/os-hosts/n-d-850499-9/shutdown HTTP/1.1 Aug 31 16:00:51.632982 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:00:51.632982 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:00:51.632982 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:00:51.632982 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:00:51.632982 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:00:51.632982 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:00:51.632982 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:00:51.632982 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:00:51.632982 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4Wtr5STs6QXwOphCvo-shikPCqMdzWCM17dbm2D2nSx_THPTGU3D10eRhgNnhUjRL4ujF7Q1ZFKf6uX8XP8He9Sb0OVcfxyGalV01Thm6B7Nx_RrGT9AtR9ojRTW1ZiajqcwkcFDXGpv31bYKW6XguGdwLwyCubiGM9SYAq_C2VLnk Aug 31 16:00:51.632982 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:00:51.632982 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:00:51.632982 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:00:51.632982 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:00:51.632982 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:00:51.632982 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:00:51.632982 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 1e3d8679dcd04dab8359e54b5e76fe80 Aug 31 16:00:51.632982 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2537876 Aug 31 16:00:51.632982 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:00:51.632982 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:00:51.634507 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1e3d8679dcd04dab8359e54b5e76fe80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1e3d8679dcd04dab8359e54b5e76fe80"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1e3d8679dcd04dab8359e54b5e76fe80", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1e3d8679dcd04dab8359e54b5e76fe80"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:00:51.634507 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2537876 Aug 31 16:00:51.634507 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 1e3d8679dcd04dab8359e54b5e76fe80 Aug 31 16:00:51.634507 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2537876 Aug 31 16:00:51.634507 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-HostsAdminNegativeTestJSON-2537876-project Aug 31 16:00:51.634507 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:00:51.634507 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:00:51.634507 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 083a03f4bf7d460d8b6634d83ef28019 Aug 31 16:00:51.634507 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2537876-project Aug 31 16:00:51.634507 n-d-850499-9 devstack@n-api.service[122256]: method: Aug 31 16:00:51.634507 n-d-850499-9 devstack@n-api.service[122256]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 31 16:00:51.634507 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': 'n-d-850499-9'} Aug 31 16:00:51.634507 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:00:51.635304 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:51.635304 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:51.635304 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:51.635304 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:00:51.635304 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:00:51.635304 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:00:51.635304 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:00:51.635304 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:00:51.635304 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:00:51.635304 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Aug 31 16:00:51.635304 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Aug 31 16:00:51.635304 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 31 16:00:51.635304 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 31 16:00:51.635304 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 31 16:00:51.635304 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 31 16:00:51.635304 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 16:00:51.635304 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 31 16:00:51.635304 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 16:00:51.635304 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise self.value Aug 31 16:00:51.636480 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 31 16:00:51.636480 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 31 16:00:51.636480 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 31 16:00:51.636480 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 31 16:00:51.636480 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 31 16:00:51.636480 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 31 16:00:51.636480 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 31 16:00:51.636480 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:51.636480 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:51.636480 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:51.636480 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:51.636480 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:51.636480 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:51.636480 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 31 16:00:51.636480 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 31 16:00:51.636480 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 31 16:00:51.636480 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:51.638061 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-335cae61-e1a2-4fd0-9b88-7bccfd71a0ec tempest-HostsAdminNegativeTestJSON-2537876 tempest-HostsAdminNegativeTestJSON-2537876-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:00:51.638061 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-335cae61-e1a2-4fd0-9b88-7bccfd71a0ec tempest-HostsAdminNegativeTestJSON-2537876 tempest-HostsAdminNegativeTestJSON-2537876-project] 10.222.0.61 "GET /compute/v2.1/os-hosts/n-d-850499-9/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.013381 Aug 31 16:00:51.642484 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 675/1352] 10.222.0.61 () {58 vars in 1194 bytes} [Wed Aug 31 16:00:51 2022] GET /compute/v2.1/os-hosts/n-d-850499-9/shutdown => generated 113 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:00:51.650812 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-faf30b72-b88f-4a3f-8765-3e6837b32015 tempest-HostsAdminNegativeTestJSON-336688701 tempest-HostsAdminNegativeTestJSON-336688701-project-admin] Calling method '.version_select at 0x7f5ae8f1ca60>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:51.666289 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-faf30b72-b88f-4a3f-8765-3e6837b32015 tempest-HostsAdminNegativeTestJSON-336688701 tempest-HostsAdminNegativeTestJSON-336688701-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 31 16:00:51.668502 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-faf30b72-b88f-4a3f-8765-3e6837b32015 tempest-HostsAdminNegativeTestJSON-336688701 tempest-HostsAdminNegativeTestJSON-336688701-project-admin] Request method failure captured: Aug 31 16:00:51.668502 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Aug 31 16:00:51.668502 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:00:51.668502 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:00:51.668502 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:00:51.668502 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:00:51.668502 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:00:51.668502 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:00:51.668502 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:00:51.668502 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:00:51.668502 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4Wu1INNhXGJmQdcvE65QE9GdAAdIUbZIi81ym4_zKCWvfWEPaedkaOiChdvA_A1mxMMwfDHYHKWpNpfCaNhOYjyviNBWuJLc4noHTXiwfv6EP8F-bAds851XH7wbMAZpi9NAfAk7b5no3FtHQRrRu29iUtd--D3gO46i6g3kMMCqMg Aug 31 16:00:51.668502 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:00:51.668502 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:00:51.668502 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:00:51.668502 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:00:51.668502 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:00:51.668502 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:00:51.668502 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: b91796a440d343eb84d3dd8dfe7c9171 Aug 31 16:00:51.668502 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-336688701 Aug 31 16:00:51.668502 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,admin,member Aug 31 16:00:51.668502 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,admin,member Aug 31 16:00:51.669940 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b91796a440d343eb84d3dd8dfe7c9171"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/b91796a440d343eb84d3dd8dfe7c9171"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_b91796a440d343eb84d3dd8dfe7c9171", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b91796a440d343eb84d3dd8dfe7c9171"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:00:51.669940 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-HostsAdminNegativeTestJSON-336688701 Aug 31 16:00:51.669940 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: b91796a440d343eb84d3dd8dfe7c9171 Aug 31 16:00:51.669940 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-336688701 Aug 31 16:00:51.669940 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-HostsAdminNegativeTestJSON-336688701-project-admin Aug 31 16:00:51.669940 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:00:51.669940 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:00:51.669940 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 853defa637b74920b1d688b9522247ff Aug 31 16:00:51.669940 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-HostsAdminNegativeTestJSON-336688701-project-admin Aug 31 16:00:51.669940 n-d-850499-9 devstack@n-api.service[122256]: method: Aug 31 16:00:51.669940 n-d-850499-9 devstack@n-api.service[122256]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 31 16:00:51.669940 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': 'nonexistent_hostname'} Aug 31 16:00:51.669940 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:00:51.670750 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:51.670750 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 31 16:00:51.670750 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 31 16:00:51.670750 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 31 16:00:51.670750 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 31 16:00:51.670750 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 16:00:51.670750 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 31 16:00:51.670750 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 16:00:51.670750 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise self.value Aug 31 16:00:51.670750 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 31 16:00:51.670750 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 31 16:00:51.670750 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5988, in targeted Aug 31 16:00:51.670750 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 31 16:00:51.670750 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 16:00:51.670750 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 16:00:51.670750 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 31 16:00:51.670750 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 31 16:00:51.670750 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 31 16:00:51.670750 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 31 16:00:51.679129 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 31 16:00:51.679129 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 31 16:00:51.679129 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 31 16:00:51.679129 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:51.679129 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:51.679129 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:51.679129 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:51.679129 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:51.679129 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:51.679129 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:00:51.679129 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:00:51.679129 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:00:51.679129 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:00:51.679129 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:00:51.679129 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:00:51.679129 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Aug 31 16:00:51.679129 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Aug 31 16:00:51.679129 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 31 16:00:51.679129 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:00:51.680621 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 31 16:00:51.680621 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:51.680621 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:51.680621 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:51.680621 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:51.680621 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:51.680621 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:51.680621 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:00:51.680621 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:00:51.680621 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 31 16:00:51.680621 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:51.680621 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-faf30b72-b88f-4a3f-8765-3e6837b32015 tempest-HostsAdminNegativeTestJSON-336688701 tempest-HostsAdminNegativeTestJSON-336688701-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:00:51.680621 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-faf30b72-b88f-4a3f-8765-3e6837b32015 tempest-HostsAdminNegativeTestJSON-336688701 tempest-HostsAdminNegativeTestJSON-336688701-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.027009 Aug 31 16:00:51.680621 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 676/1353] 10.222.0.61 () {58 vars in 1218 bytes} [Wed Aug 31 16:00:51 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 31 16:00:51.683369 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-acb4ad39-7631-411b-ab2f-84a466ec705d tempest-HostsAdminNegativeTestJSON-2537876 tempest-HostsAdminNegativeTestJSON-2537876-project] Calling method '.version_select at 0x7f5ae8fe1ca0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:51.685701 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-acb4ad39-7631-411b-ab2f-84a466ec705d tempest-HostsAdminNegativeTestJSON-2537876 tempest-HostsAdminNegativeTestJSON-2537876-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '083a03f4bf7d460d8b6634d83ef28019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3d8679dcd04dab8359e54b5e76fe80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:51.688990 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-acb4ad39-7631-411b-ab2f-84a466ec705d tempest-HostsAdminNegativeTestJSON-2537876 tempest-HostsAdminNegativeTestJSON-2537876-project] Request method failure captured: Aug 31 16:00:51.688990 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/os-hosts/n-d-850499-9/startup HTTP/1.1 Aug 31 16:00:51.688990 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:00:51.688990 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:00:51.688990 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:00:51.688990 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:00:51.688990 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:00:51.688990 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:00:51.688990 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:00:51.688990 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:00:51.688990 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4Wtr5STs6QXwOphCvo-shikPCqMdzWCM17dbm2D2nSx_THPTGU3D10eRhgNnhUjRL4ujF7Q1ZFKf6uX8XP8He9Sb0OVcfxyGalV01Thm6B7Nx_RrGT9AtR9ojRTW1ZiajqcwkcFDXGpv31bYKW6XguGdwLwyCubiGM9SYAq_C2VLnk Aug 31 16:00:51.688990 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:00:51.688990 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:00:51.688990 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:00:51.688990 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:00:51.688990 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:00:51.688990 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:00:51.688990 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 1e3d8679dcd04dab8359e54b5e76fe80 Aug 31 16:00:51.688990 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2537876 Aug 31 16:00:51.688990 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:00:51.688990 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:00:51.690355 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1e3d8679dcd04dab8359e54b5e76fe80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1e3d8679dcd04dab8359e54b5e76fe80"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1e3d8679dcd04dab8359e54b5e76fe80", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1e3d8679dcd04dab8359e54b5e76fe80"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:00:51.690355 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2537876 Aug 31 16:00:51.690355 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 1e3d8679dcd04dab8359e54b5e76fe80 Aug 31 16:00:51.690355 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2537876 Aug 31 16:00:51.690355 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-HostsAdminNegativeTestJSON-2537876-project Aug 31 16:00:51.690355 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:00:51.690355 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:00:51.690355 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 083a03f4bf7d460d8b6634d83ef28019 Aug 31 16:00:51.690355 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2537876-project Aug 31 16:00:51.690355 n-d-850499-9 devstack@n-api.service[122256]: method: Aug 31 16:00:51.690355 n-d-850499-9 devstack@n-api.service[122256]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 31 16:00:51.690355 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': 'n-d-850499-9'} Aug 31 16:00:51.690355 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:00:51.692439 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:51.692439 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:51.692439 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:51.692439 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:00:51.692439 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:00:51.692439 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:00:51.692439 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:00:51.692439 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:00:51.692439 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:00:51.692439 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Aug 31 16:00:51.692439 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Aug 31 16:00:51.692439 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 31 16:00:51.692439 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 31 16:00:51.692439 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 31 16:00:51.692439 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 31 16:00:51.692439 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 16:00:51.692439 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 31 16:00:51.692439 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 16:00:51.692439 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise self.value Aug 31 16:00:51.694536 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 31 16:00:51.694536 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 31 16:00:51.694536 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 31 16:00:51.694536 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 31 16:00:51.694536 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 31 16:00:51.694536 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 31 16:00:51.694536 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 31 16:00:51.694536 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:51.694536 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:51.694536 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:51.694536 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:51.694536 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:51.694536 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:51.694536 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 31 16:00:51.694536 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 31 16:00:51.694536 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 31 16:00:51.694536 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:51.695623 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-acb4ad39-7631-411b-ab2f-84a466ec705d tempest-HostsAdminNegativeTestJSON-2537876 tempest-HostsAdminNegativeTestJSON-2537876-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:00:51.695623 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-acb4ad39-7631-411b-ab2f-84a466ec705d tempest-HostsAdminNegativeTestJSON-2537876 tempest-HostsAdminNegativeTestJSON-2537876-project] 10.222.0.61 "GET /compute/v2.1/os-hosts/n-d-850499-9/startup" status: 403 len: 110 microversion: 2.1 time: 0.012792 Aug 31 16:00:51.697050 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 677/1354] 10.222.0.61 () {58 vars in 1191 bytes} [Wed Aug 31 16:00:51 2022] GET /compute/v2.1/os-hosts/n-d-850499-9/startup => generated 110 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:00:51.703042 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1a9e6bb4-34af-4981-8cbb-d0a6a4ff347f tempest-HostsAdminNegativeTestJSON-336688701 tempest-HostsAdminNegativeTestJSON-336688701-project-admin] Calling method '.version_select at 0x7f5ae8fea5e0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:51.714844 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-1a9e6bb4-34af-4981-8cbb-d0a6a4ff347f tempest-HostsAdminNegativeTestJSON-336688701 tempest-HostsAdminNegativeTestJSON-336688701-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 31 16:00:51.716720 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1a9e6bb4-34af-4981-8cbb-d0a6a4ff347f tempest-HostsAdminNegativeTestJSON-336688701 tempest-HostsAdminNegativeTestJSON-336688701-project-admin] Request method failure captured: Aug 31 16:00:51.716720 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Aug 31 16:00:51.716720 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:00:51.716720 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:00:51.716720 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:00:51.716720 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:00:51.716720 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:00:51.716720 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:00:51.716720 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:00:51.716720 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:00:51.716720 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4Wu1INNhXGJmQdcvE65QE9GdAAdIUbZIi81ym4_zKCWvfWEPaedkaOiChdvA_A1mxMMwfDHYHKWpNpfCaNhOYjyviNBWuJLc4noHTXiwfv6EP8F-bAds851XH7wbMAZpi9NAfAk7b5no3FtHQRrRu29iUtd--D3gO46i6g3kMMCqMg Aug 31 16:00:51.716720 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:00:51.716720 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:00:51.716720 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:00:51.716720 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:00:51.716720 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:00:51.716720 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:00:51.716720 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: b91796a440d343eb84d3dd8dfe7c9171 Aug 31 16:00:51.716720 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-336688701 Aug 31 16:00:51.716720 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,admin,member Aug 31 16:00:51.716720 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,admin,member Aug 31 16:00:51.718143 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b91796a440d343eb84d3dd8dfe7c9171"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/b91796a440d343eb84d3dd8dfe7c9171"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_b91796a440d343eb84d3dd8dfe7c9171", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b91796a440d343eb84d3dd8dfe7c9171"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:00:51.718143 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-HostsAdminNegativeTestJSON-336688701 Aug 31 16:00:51.718143 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: b91796a440d343eb84d3dd8dfe7c9171 Aug 31 16:00:51.718143 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-336688701 Aug 31 16:00:51.718143 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-HostsAdminNegativeTestJSON-336688701-project-admin Aug 31 16:00:51.718143 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:00:51.718143 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:00:51.718143 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 853defa637b74920b1d688b9522247ff Aug 31 16:00:51.718143 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-HostsAdminNegativeTestJSON-336688701-project-admin Aug 31 16:00:51.718143 n-d-850499-9 devstack@n-api.service[122256]: method: Aug 31 16:00:51.718143 n-d-850499-9 devstack@n-api.service[122256]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 31 16:00:51.718143 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': 'nonexistent_hostname'} Aug 31 16:00:51.718143 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:00:51.718999 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:51.718999 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 31 16:00:51.718999 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 31 16:00:51.718999 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 31 16:00:51.718999 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 31 16:00:51.718999 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 16:00:51.718999 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 31 16:00:51.718999 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 16:00:51.718999 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise self.value Aug 31 16:00:51.718999 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 31 16:00:51.718999 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 31 16:00:51.718999 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5988, in targeted Aug 31 16:00:51.718999 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 31 16:00:51.718999 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 16:00:51.718999 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 16:00:51.718999 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 31 16:00:51.718999 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 31 16:00:51.718999 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 31 16:00:51.718999 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 31 16:00:51.720264 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 31 16:00:51.720264 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 31 16:00:51.720264 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 31 16:00:51.720264 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:51.720264 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:51.720264 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:51.720264 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:51.720264 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:51.720264 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:51.720264 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:00:51.720264 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:00:51.720264 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:00:51.720264 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:00:51.720264 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:00:51.720264 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:00:51.720264 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Aug 31 16:00:51.720264 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Aug 31 16:00:51.720264 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 31 16:00:51.720264 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:00:51.721421 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 31 16:00:51.721421 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:51.721421 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:51.721421 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:51.721421 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:51.721421 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:51.721421 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:51.721421 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:00:51.721421 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:00:51.721421 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 31 16:00:51.721421 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:51.721421 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1a9e6bb4-34af-4981-8cbb-d0a6a4ff347f tempest-HostsAdminNegativeTestJSON-336688701 tempest-HostsAdminNegativeTestJSON-336688701-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:00:51.721421 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1a9e6bb4-34af-4981-8cbb-d0a6a4ff347f tempest-HostsAdminNegativeTestJSON-336688701 tempest-HostsAdminNegativeTestJSON-336688701-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.020097 Aug 31 16:00:51.721421 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 678/1355] 10.222.0.61 () {58 vars in 1215 bytes} [Wed Aug 31 16:00:51 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 31 16:00:51.729011 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-30a1d44c-af2f-4d00-bc58-27674f630eb7 tempest-HostsAdminNegativeTestJSON-336688701 tempest-HostsAdminNegativeTestJSON-336688701-project-admin] Action: 'update', calling method: .version_select at 0x7f5ae8fe1430>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:00:51.733277 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-30a1d44c-af2f-4d00-bc58-27674f630eb7 tempest-HostsAdminNegativeTestJSON-336688701 tempest-HostsAdminNegativeTestJSON-336688701-project-admin] Request method failure captured: Aug 31 16:00:51.733277 n-d-850499-9 devstack@n-api.service[122256]: request: PUT /compute/v2.1/os-hosts/n-d-850499-9 HTTP/1.1 Aug 31 16:00:51.733277 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:00:51.733277 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:00:51.733277 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:00:51.733277 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 51 Aug 31 16:00:51.733277 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:00:51.733277 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:00:51.733277 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:00:51.733277 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:00:51.733277 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4Wu1INNhXGJmQdcvE65QE9GdAAdIUbZIi81ym4_zKCWvfWEPaedkaOiChdvA_A1mxMMwfDHYHKWpNpfCaNhOYjyviNBWuJLc4noHTXiwfv6EP8F-bAds851XH7wbMAZpi9NAfAk7b5no3FtHQRrRu29iUtd--D3gO46i6g3kMMCqMg Aug 31 16:00:51.733277 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:00:51.733277 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:00:51.733277 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:00:51.733277 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:00:51.733277 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:00:51.733277 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:00:51.733277 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: b91796a440d343eb84d3dd8dfe7c9171 Aug 31 16:00:51.733277 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-336688701 Aug 31 16:00:51.733277 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,admin,member Aug 31 16:00:51.733277 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,admin,member Aug 31 16:00:51.734716 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b91796a440d343eb84d3dd8dfe7c9171"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/b91796a440d343eb84d3dd8dfe7c9171"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_b91796a440d343eb84d3dd8dfe7c9171", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b91796a440d343eb84d3dd8dfe7c9171"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:00:51.734716 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-HostsAdminNegativeTestJSON-336688701 Aug 31 16:00:51.734716 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: b91796a440d343eb84d3dd8dfe7c9171 Aug 31 16:00:51.734716 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-336688701 Aug 31 16:00:51.734716 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-HostsAdminNegativeTestJSON-336688701-project-admin Aug 31 16:00:51.734716 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:00:51.734716 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:00:51.734716 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 853defa637b74920b1d688b9522247ff Aug 31 16:00:51.734716 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-HostsAdminNegativeTestJSON-336688701-project-admin Aug 31 16:00:51.734716 n-d-850499-9 devstack@n-api.service[122256]: Aug 31 16:00:51.734716 n-d-850499-9 devstack@n-api.service[122256]: {"status": "enable", "maintenance_mode": "invalid"} Aug 31 16:00:51.734716 n-d-850499-9 devstack@n-api.service[122256]: method: Aug 31 16:00:51.734716 n-d-850499-9 devstack@n-api.service[122256]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 31 16:00:51.735916 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': 'n-d-850499-9', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Aug 31 16:00:51.735916 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:00:51.735916 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:51.735916 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 16:00:51.735916 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 16:00:51.735916 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 16:00:51.735916 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise error Aug 31 16:00:51.735916 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 31 16:00:51.735916 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:51.735916 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Aug 31 16:00:51.735916 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 31 16:00:51.735916 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi 'disable', Aug 31 16:00:51.735916 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi 'Enable', Aug 31 16:00:51.735916 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi 'Disable', Aug 31 16:00:51.735916 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 31 16:00:51.735916 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 31 16:00:51.735916 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 31 16:00:51.735916 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:51.735916 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi On instance: Aug 31 16:00:51.735916 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi 'invalid' Aug 31 16:00:51.735916 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:51.735916 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:51.735916 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:51.735916 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:51.735916 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:51.737632 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:51.737632 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:00:51.737632 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:00:51.737632 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:00:51.737632 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:00:51.737632 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:00:51.737632 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:00:51.737632 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 16:00:51.737632 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 16:00:51.737632 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 16:00:51.737632 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 16:00:51.737632 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 16:00:51.737632 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 16:00:51.737632 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 31 16:00:51.737632 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:51.737632 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:51.737632 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:51.737632 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:51.737632 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:51.739908 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:51.739908 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 16:00:51.739908 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 16:00:51.739908 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 31 16:00:51.739908 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:51.739908 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-30a1d44c-af2f-4d00-bc58-27674f630eb7 tempest-HostsAdminNegativeTestJSON-336688701 tempest-HostsAdminNegativeTestJSON-336688701-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:00:51.739908 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-30a1d44c-af2f-4d00-bc58-27674f630eb7 tempest-HostsAdminNegativeTestJSON-336688701 tempest-HostsAdminNegativeTestJSON-336688701-project-admin] 10.222.0.61 "PUT /compute/v2.1/os-hosts/n-d-850499-9" status: 400 len: 199 microversion: 2.1 time: 0.010057 Aug 31 16:00:51.739908 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 679/1356] 10.222.0.61 () {60 vars in 1187 bytes} [Wed Aug 31 16:00:51 2022] PUT /compute/v2.1/os-hosts/n-d-850499-9 => generated 199 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 31 16:00:51.745060 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3173174a-aa81-4487-90ce-1e9135033f22 tempest-HostsAdminNegativeTestJSON-336688701 tempest-HostsAdminNegativeTestJSON-336688701-project-admin] Action: 'update', calling method: .version_select at 0x7f5ae8f1c4c0>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:00:51.749651 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3173174a-aa81-4487-90ce-1e9135033f22 tempest-HostsAdminNegativeTestJSON-336688701 tempest-HostsAdminNegativeTestJSON-336688701-project-admin] Request method failure captured: Aug 31 16:00:51.749651 n-d-850499-9 devstack@n-api.service[122256]: request: PUT /compute/v2.1/os-hosts/n-d-850499-9 HTTP/1.1 Aug 31 16:00:51.749651 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:00:51.749651 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:00:51.749651 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:00:51.749651 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 51 Aug 31 16:00:51.749651 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:00:51.749651 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:00:51.749651 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:00:51.749651 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:00:51.749651 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4Wu1INNhXGJmQdcvE65QE9GdAAdIUbZIi81ym4_zKCWvfWEPaedkaOiChdvA_A1mxMMwfDHYHKWpNpfCaNhOYjyviNBWuJLc4noHTXiwfv6EP8F-bAds851XH7wbMAZpi9NAfAk7b5no3FtHQRrRu29iUtd--D3gO46i6g3kMMCqMg Aug 31 16:00:51.749651 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:00:51.749651 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:00:51.749651 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:00:51.749651 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:00:51.749651 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:00:51.749651 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:00:51.749651 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: b91796a440d343eb84d3dd8dfe7c9171 Aug 31 16:00:51.749651 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-336688701 Aug 31 16:00:51.749651 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,admin,member Aug 31 16:00:51.749651 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,admin,member Aug 31 16:00:51.751319 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b91796a440d343eb84d3dd8dfe7c9171"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/b91796a440d343eb84d3dd8dfe7c9171"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_b91796a440d343eb84d3dd8dfe7c9171", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b91796a440d343eb84d3dd8dfe7c9171"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:00:51.751319 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-HostsAdminNegativeTestJSON-336688701 Aug 31 16:00:51.751319 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: b91796a440d343eb84d3dd8dfe7c9171 Aug 31 16:00:51.751319 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-336688701 Aug 31 16:00:51.751319 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-HostsAdminNegativeTestJSON-336688701-project-admin Aug 31 16:00:51.751319 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:00:51.751319 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:00:51.751319 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 853defa637b74920b1d688b9522247ff Aug 31 16:00:51.751319 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-HostsAdminNegativeTestJSON-336688701-project-admin Aug 31 16:00:51.751319 n-d-850499-9 devstack@n-api.service[122256]: Aug 31 16:00:51.751319 n-d-850499-9 devstack@n-api.service[122256]: {"status": "invalid", "maintenance_mode": "enable"} Aug 31 16:00:51.751319 n-d-850499-9 devstack@n-api.service[122256]: method: Aug 31 16:00:51.751319 n-d-850499-9 devstack@n-api.service[122256]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 31 16:00:51.752373 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': 'n-d-850499-9', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Aug 31 16:00:51.752373 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:00:51.752373 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:51.752373 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 16:00:51.752373 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 16:00:51.752373 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 16:00:51.752373 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise error Aug 31 16:00:51.752373 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 31 16:00:51.752373 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:51.752373 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Aug 31 16:00:51.752373 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 31 16:00:51.752373 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi 'disable', Aug 31 16:00:51.752373 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi 'Enable', Aug 31 16:00:51.752373 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi 'Disable', Aug 31 16:00:51.752373 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 31 16:00:51.752373 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 31 16:00:51.752373 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 31 16:00:51.752373 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:51.752373 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi On instance: Aug 31 16:00:51.752373 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi 'invalid' Aug 31 16:00:51.752373 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:51.752373 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:51.752373 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:51.752373 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:51.752373 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:51.754461 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:51.754461 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:00:51.754461 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:00:51.754461 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:00:51.754461 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:00:51.754461 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:00:51.754461 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:00:51.754461 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 16:00:51.754461 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 16:00:51.754461 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 16:00:51.754461 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 16:00:51.754461 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 16:00:51.754461 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 16:00:51.754461 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 31 16:00:51.754461 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:51.754461 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:51.754461 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:51.754461 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:51.754461 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:51.755697 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:51.755697 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 16:00:51.755697 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 16:00:51.755697 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 31 16:00:51.755697 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:51.755697 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3173174a-aa81-4487-90ce-1e9135033f22 tempest-HostsAdminNegativeTestJSON-336688701 tempest-HostsAdminNegativeTestJSON-336688701-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:00:51.755697 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3173174a-aa81-4487-90ce-1e9135033f22 tempest-HostsAdminNegativeTestJSON-336688701 tempest-HostsAdminNegativeTestJSON-336688701-project-admin] 10.222.0.61 "PUT /compute/v2.1/os-hosts/n-d-850499-9" status: 400 len: 189 microversion: 2.1 time: 0.010352 Aug 31 16:00:51.756477 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 680/1357] 10.222.0.61 () {60 vars in 1187 bytes} [Wed Aug 31 16:00:51 2022] PUT /compute/v2.1/os-hosts/n-d-850499-9 => generated 189 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:00:51.939453 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6f791ceb-ec0d-467f-a299-2fce11dbbbcf tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "POST /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.865821 Aug 31 16:00:51.940835 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 678/1358] 10.222.0.61 () {60 vars in 1323 bytes} [Wed Aug 31 16:00:51 2022] POST /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f/os-volume_attachments => generated 194 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:00:51.973499 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-330a54fd-530d-4c83-9d33-ee49d2a7f3b6 tempest-HostsAdminNegativeTestJSON-2537876 tempest-HostsAdminNegativeTestJSON-2537876-project] Action: 'update', calling method: .version_select at 0x7f5ae8f1cc10>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:00:51.977739 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-330a54fd-530d-4c83-9d33-ee49d2a7f3b6 tempest-HostsAdminNegativeTestJSON-2537876 tempest-HostsAdminNegativeTestJSON-2537876-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '083a03f4bf7d460d8b6634d83ef28019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e3d8679dcd04dab8359e54b5e76fe80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:51.980003 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-330a54fd-530d-4c83-9d33-ee49d2a7f3b6 tempest-HostsAdminNegativeTestJSON-2537876 tempest-HostsAdminNegativeTestJSON-2537876-project] Request method failure captured: Aug 31 16:00:51.980003 n-d-850499-9 devstack@n-api.service[122256]: request: PUT /compute/v2.1/os-hosts/n-d-850499-9 HTTP/1.1 Aug 31 16:00:51.980003 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:00:51.980003 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:00:51.980003 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:00:51.980003 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 50 Aug 31 16:00:51.980003 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:00:51.980003 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:00:51.980003 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:00:51.980003 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:00:51.980003 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4Wtr5STs6QXwOphCvo-shikPCqMdzWCM17dbm2D2nSx_THPTGU3D10eRhgNnhUjRL4ujF7Q1ZFKf6uX8XP8He9Sb0OVcfxyGalV01Thm6B7Nx_RrGT9AtR9ojRTW1ZiajqcwkcFDXGpv31bYKW6XguGdwLwyCubiGM9SYAq_C2VLnk Aug 31 16:00:51.980003 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:00:51.980003 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:00:51.980003 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:00:51.980003 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:00:51.980003 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:00:51.980003 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:00:51.980003 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 1e3d8679dcd04dab8359e54b5e76fe80 Aug 31 16:00:51.980003 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2537876 Aug 31 16:00:51.980003 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:00:51.980003 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:00:51.981597 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1e3d8679dcd04dab8359e54b5e76fe80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1e3d8679dcd04dab8359e54b5e76fe80"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1e3d8679dcd04dab8359e54b5e76fe80", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1e3d8679dcd04dab8359e54b5e76fe80"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:00:51.981597 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2537876 Aug 31 16:00:51.981597 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 1e3d8679dcd04dab8359e54b5e76fe80 Aug 31 16:00:51.981597 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2537876 Aug 31 16:00:51.981597 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-HostsAdminNegativeTestJSON-2537876-project Aug 31 16:00:51.981597 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:00:51.981597 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:00:51.981597 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 083a03f4bf7d460d8b6634d83ef28019 Aug 31 16:00:51.981597 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2537876-project Aug 31 16:00:51.981597 n-d-850499-9 devstack@n-api.service[122256]: Aug 31 16:00:51.981597 n-d-850499-9 devstack@n-api.service[122256]: {"status": "enable", "maintenance_mode": "enable"} Aug 31 16:00:51.981597 n-d-850499-9 devstack@n-api.service[122256]: method: Aug 31 16:00:51.981597 n-d-850499-9 devstack@n-api.service[122256]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 31 16:00:51.981597 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': 'n-d-850499-9', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Aug 31 16:00:51.982681 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:00:51.982681 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:51.982681 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:51.982681 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:51.982681 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:00:51.982681 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:00:51.982681 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:00:51.982681 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:00:51.982681 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:00:51.982681 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:00:51.982681 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:00:51.982681 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:00:51.982681 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Aug 31 16:00:51.982681 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Aug 31 16:00:51.982681 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 31 16:00:51.982681 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 31 16:00:51.982681 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 31 16:00:51.982681 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 31 16:00:51.982681 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 16:00:51.982681 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 31 16:00:51.984583 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 16:00:51.984583 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise self.value Aug 31 16:00:51.984583 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 31 16:00:51.984583 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 31 16:00:51.984583 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 31 16:00:51.984583 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 31 16:00:51.984583 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 31 16:00:51.984583 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 31 16:00:51.984583 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 31 16:00:51.984583 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:51.984583 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:51.984583 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:51.984583 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:51.984583 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:51.984583 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:51.984583 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 31 16:00:51.984583 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 31 16:00:51.984583 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 31 16:00:51.984583 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:51.986844 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a8b77c39-7d85-4a13-a2f1-889735c4739c tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '.version_select at 0x7f5ae8d11f70>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:51.988395 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-330a54fd-530d-4c83-9d33-ee49d2a7f3b6 tempest-HostsAdminNegativeTestJSON-2537876 tempest-HostsAdminNegativeTestJSON-2537876-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:00:51.989863 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-330a54fd-530d-4c83-9d33-ee49d2a7f3b6 tempest-HostsAdminNegativeTestJSON-2537876 tempest-HostsAdminNegativeTestJSON-2537876-project] 10.222.0.61 "PUT /compute/v2.1/os-hosts/n-d-850499-9" status: 403 len: 111 microversion: 2.1 time: 0.021385 Aug 31 16:00:51.995700 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 681/1359] 10.222.0.61 () {60 vars in 1187 bytes} [Wed Aug 31 16:00:51 2022] PUT /compute/v2.1/os-hosts/n-d-850499-9 => generated 111 bytes in 239 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:00:52.006921 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-bc111a94-36a4-42dc-bb3e-35364fe238af tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:52.007619 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-bc111a94-36a4-42dc-bb3e-35364fe238af tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:52.034462 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bc111a94-36a4-42dc-bb3e-35364fe238af tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:52.035000 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bc111a94-36a4-42dc-bb3e-35364fe238af tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:52.040737 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bc111a94-36a4-42dc-bb3e-35364fe238af tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:52.041739 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bc111a94-36a4-42dc-bb3e-35364fe238af tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:52.042242 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bc111a94-36a4-42dc-bb3e-35364fe238af tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:52.042696 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bc111a94-36a4-42dc-bb3e-35364fe238af tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:52.075968 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a8b77c39-7d85-4a13-a2f1-889735c4739c tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/images/91f26408-c009-455c-b26c-f5cfe4ba8d54" status: 200 len: 1414 microversion: 2.1 time: 0.132567 Aug 31 16:00:52.076531 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 679/1360] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:00:51 2022] GET /compute/v2.1/images/91f26408-c009-455c-b26c-f5cfe4ba8d54 => generated 1414 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:52.090176 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6823d0fb-3821-4a15-a476-db2a4a86ec1f tempest-HostsAdminNegativeTestJSON-336688701 tempest-HostsAdminNegativeTestJSON-336688701-project-admin] Action: 'update', calling method: .version_select at 0x7f5ae8d11820>, body: {"status": null, "maintenance_mode": null} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:00:52.098636 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6823d0fb-3821-4a15-a476-db2a4a86ec1f tempest-HostsAdminNegativeTestJSON-336688701 tempest-HostsAdminNegativeTestJSON-336688701-project-admin] Request method failure captured: Aug 31 16:00:52.098636 n-d-850499-9 devstack@n-api.service[122257]: request: PUT /compute/v2.1/os-hosts/n-d-850499-9 HTTP/1.1 Aug 31 16:00:52.098636 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:00:52.098636 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:00:52.098636 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:00:52.098636 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 42 Aug 31 16:00:52.098636 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:00:52.098636 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:00:52.098636 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:00:52.098636 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:00:52.098636 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4Wu1INNhXGJmQdcvE65QE9GdAAdIUbZIi81ym4_zKCWvfWEPaedkaOiChdvA_A1mxMMwfDHYHKWpNpfCaNhOYjyviNBWuJLc4noHTXiwfv6EP8F-bAds851XH7wbMAZpi9NAfAk7b5no3FtHQRrRu29iUtd--D3gO46i6g3kMMCqMg Aug 31 16:00:52.098636 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:00:52.098636 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:00:52.098636 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:00:52.098636 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:00:52.098636 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:00:52.098636 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:00:52.098636 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: b91796a440d343eb84d3dd8dfe7c9171 Aug 31 16:00:52.098636 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-336688701 Aug 31 16:00:52.098636 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,admin,member Aug 31 16:00:52.098636 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,admin,member Aug 31 16:00:52.100088 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b91796a440d343eb84d3dd8dfe7c9171"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/b91796a440d343eb84d3dd8dfe7c9171"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_b91796a440d343eb84d3dd8dfe7c9171", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b91796a440d343eb84d3dd8dfe7c9171"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:00:52.100088 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-HostsAdminNegativeTestJSON-336688701 Aug 31 16:00:52.100088 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: b91796a440d343eb84d3dd8dfe7c9171 Aug 31 16:00:52.100088 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-336688701 Aug 31 16:00:52.100088 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-HostsAdminNegativeTestJSON-336688701-project-admin Aug 31 16:00:52.100088 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:00:52.100088 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:00:52.100088 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 853defa637b74920b1d688b9522247ff Aug 31 16:00:52.100088 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-HostsAdminNegativeTestJSON-336688701-project-admin Aug 31 16:00:52.100088 n-d-850499-9 devstack@n-api.service[122257]: Aug 31 16:00:52.100088 n-d-850499-9 devstack@n-api.service[122257]: {"status": null, "maintenance_mode": null} Aug 31 16:00:52.100088 n-d-850499-9 devstack@n-api.service[122257]: method: Aug 31 16:00:52.100088 n-d-850499-9 devstack@n-api.service[122257]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 31 16:00:52.100088 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': 'n-d-850499-9', 'body': {'status': None, 'maintenance_mode': None}} Aug 31 16:00:52.100941 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:00:52.100941 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:52.100941 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 16:00:52.100941 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 16:00:52.100941 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 16:00:52.100941 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise error Aug 31 16:00:52.100941 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Aug 31 16:00:52.100941 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:00:52.100941 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Aug 31 16:00:52.100941 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 31 16:00:52.100941 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi 'disable', Aug 31 16:00:52.100941 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi 'Enable', Aug 31 16:00:52.100941 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi 'Disable', Aug 31 16:00:52.100941 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 31 16:00:52.100941 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 31 16:00:52.100941 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 31 16:00:52.100941 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:00:52.100941 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi On instance: Aug 31 16:00:52.100941 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi None Aug 31 16:00:52.100941 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:00:52.100941 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:52.100941 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:00:52.100941 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:52.100941 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:52.100941 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:52.102408 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:00:52.102408 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:00:52.102408 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:00:52.102408 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:00:52.102408 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:00:52.102408 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:00:52.102408 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 16:00:52.102408 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 16:00:52.102408 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 16:00:52.102408 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 16:00:52.102408 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 16:00:52.102408 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 16:00:52.102408 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 31 16:00:52.102408 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:00:52.102408 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:52.102408 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:00:52.102408 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:52.102408 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:52.102408 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:52.103539 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 16:00:52.103539 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 16:00:52.103539 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 31 16:00:52.103539 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:00:52.105654 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6823d0fb-3821-4a15-a476-db2a4a86ec1f tempest-HostsAdminNegativeTestJSON-336688701 tempest-HostsAdminNegativeTestJSON-336688701-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:00:52.106894 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6823d0fb-3821-4a15-a476-db2a4a86ec1f tempest-HostsAdminNegativeTestJSON-336688701 tempest-HostsAdminNegativeTestJSON-336688701-project-admin] 10.222.0.61 "PUT /compute/v2.1/os-hosts/n-d-850499-9" status: 400 len: 127 microversion: 2.1 time: 0.029095 Aug 31 16:00:52.108039 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 680/1361] 10.222.0.61 () {60 vars in 1187 bytes} [Wed Aug 31 16:00:52 2022] PUT /compute/v2.1/os-hosts/n-d-850499-9 => generated 127 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:00:52.118863 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5db279ac-9bf0-4dea-af52-0b76ef949897 tempest-HostsAdminNegativeTestJSON-336688701 tempest-HostsAdminNegativeTestJSON-336688701-project-admin] Action: 'update', calling method: .version_select at 0x7f5ae8d160d0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:00:52.124169 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.hosts [None req-5db279ac-9bf0-4dea-af52-0b76ef949897 tempest-HostsAdminNegativeTestJSON-336688701 tempest-HostsAdminNegativeTestJSON-336688701-project-admin] Enabling host nonexistent_hostname. Aug 31 16:00:52.158730 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-5db279ac-9bf0-4dea-af52-0b76ef949897 tempest-HostsAdminNegativeTestJSON-336688701 tempest-HostsAdminNegativeTestJSON-336688701-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 31 16:00:52.165235 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5db279ac-9bf0-4dea-af52-0b76ef949897 tempest-HostsAdminNegativeTestJSON-336688701 tempest-HostsAdminNegativeTestJSON-336688701-project-admin] Request method failure captured: Aug 31 16:00:52.165235 n-d-850499-9 devstack@n-api.service[122257]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Aug 31 16:00:52.165235 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:00:52.165235 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:00:52.165235 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:00:52.165235 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 50 Aug 31 16:00:52.165235 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:00:52.165235 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:00:52.165235 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:00:52.165235 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:00:52.165235 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4Wu1INNhXGJmQdcvE65QE9GdAAdIUbZIi81ym4_zKCWvfWEPaedkaOiChdvA_A1mxMMwfDHYHKWpNpfCaNhOYjyviNBWuJLc4noHTXiwfv6EP8F-bAds851XH7wbMAZpi9NAfAk7b5no3FtHQRrRu29iUtd--D3gO46i6g3kMMCqMg Aug 31 16:00:52.165235 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:00:52.165235 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:00:52.165235 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:00:52.165235 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:00:52.165235 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:00:52.165235 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:00:52.165235 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: b91796a440d343eb84d3dd8dfe7c9171 Aug 31 16:00:52.165235 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-336688701 Aug 31 16:00:52.165235 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,admin,member Aug 31 16:00:52.165235 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,admin,member Aug 31 16:00:52.166897 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b91796a440d343eb84d3dd8dfe7c9171"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/b91796a440d343eb84d3dd8dfe7c9171"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_b91796a440d343eb84d3dd8dfe7c9171", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b91796a440d343eb84d3dd8dfe7c9171"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:00:52.166897 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-HostsAdminNegativeTestJSON-336688701 Aug 31 16:00:52.166897 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: b91796a440d343eb84d3dd8dfe7c9171 Aug 31 16:00:52.166897 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-336688701 Aug 31 16:00:52.166897 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-HostsAdminNegativeTestJSON-336688701-project-admin Aug 31 16:00:52.166897 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:00:52.166897 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:00:52.166897 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 853defa637b74920b1d688b9522247ff Aug 31 16:00:52.166897 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-HostsAdminNegativeTestJSON-336688701-project-admin Aug 31 16:00:52.166897 n-d-850499-9 devstack@n-api.service[122257]: Aug 31 16:00:52.166897 n-d-850499-9 devstack@n-api.service[122257]: {"status": "enable", "maintenance_mode": "enable"} Aug 31 16:00:52.166897 n-d-850499-9 devstack@n-api.service[122257]: method: Aug 31 16:00:52.166897 n-d-850499-9 devstack@n-api.service[122257]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 31 16:00:52.166897 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Aug 31 16:00:52.167956 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:00:52.167956 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:52.167956 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Aug 31 16:00:52.167956 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Aug 31 16:00:52.167956 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 31 16:00:52.167956 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 31 16:00:52.167956 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 16:00:52.167956 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 31 16:00:52.167956 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 16:00:52.167956 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise self.value Aug 31 16:00:52.167956 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 31 16:00:52.167956 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 31 16:00:52.167956 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5988, in targeted Aug 31 16:00:52.167956 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 31 16:00:52.167956 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 16:00:52.167956 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 16:00:52.167956 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 31 16:00:52.167956 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 31 16:00:52.169061 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 31 16:00:52.169061 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 31 16:00:52.169061 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 31 16:00:52.169061 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 31 16:00:52.169061 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 31 16:00:52.169061 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:00:52.169061 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:52.169061 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:00:52.169061 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:52.169061 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:52.169061 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:52.169061 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:00:52.169061 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:00:52.169061 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:00:52.169061 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:00:52.169061 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:00:52.169061 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:00:52.169061 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:00:52.169061 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:00:52.169061 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Aug 31 16:00:52.171524 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Aug 31 16:00:52.171524 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Aug 31 16:00:52.171524 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:00:52.171524 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 31 16:00:52.171524 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:00:52.171524 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:52.171524 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:00:52.171524 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:52.171524 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:52.171524 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:52.171524 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:00:52.171524 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:00:52.171524 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 31 16:00:52.171524 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:00:52.171524 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5db279ac-9bf0-4dea-af52-0b76ef949897 tempest-HostsAdminNegativeTestJSON-336688701 tempest-HostsAdminNegativeTestJSON-336688701-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:00:52.173999 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5db279ac-9bf0-4dea-af52-0b76ef949897 tempest-HostsAdminNegativeTestJSON-336688701 tempest-HostsAdminNegativeTestJSON-336688701-project-admin] 10.222.0.61 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.057297 Aug 31 16:00:52.176268 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 681/1362] 10.222.0.61 () {60 vars in 1211 bytes} [Wed Aug 31 16:00:52 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 31 16:00:52.207352 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-bc111a94-36a4-42dc-bb3e-35364fe238af tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:52.229053 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-bc111a94-36a4-42dc-bb3e-35364fe238af tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:52.230901 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-bc111a94-36a4-42dc-bb3e-35364fe238af tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:52.239685 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-bc111a94-36a4-42dc-bb3e-35364fe238af tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1537 microversion: 2.91 time: 0.242464 Aug 31 16:00:52.259458 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 682/1363] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:00:51 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1537 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:00:52.276100 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-afd18403-4b7f-4090-924b-7c98ea95b943 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:52.276943 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-afd18403-4b7f-4090-924b-7c98ea95b943 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] [instance: a50acb4f-16d0-4c72-b603-f795220ea866] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:52.291812 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-afd18403-4b7f-4090-924b-7c98ea95b943 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:52.292376 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-afd18403-4b7f-4090-924b-7c98ea95b943 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:52.295359 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-afd18403-4b7f-4090-924b-7c98ea95b943 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:52.297544 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-afd18403-4b7f-4090-924b-7c98ea95b943 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:52.301250 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-afd18403-4b7f-4090-924b-7c98ea95b943 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:52.301938 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-afd18403-4b7f-4090-924b-7c98ea95b943 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:52.521512 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-d96e5e2a-1e1d-4812-962f-3061462252e4 req-121127fd-86a7-4c16-bae1-a4571cc05141 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a50acb4f-16d0-4c72-b603-f795220ea866", "name": "network-vif-plugged", "status": "completed", "tag": "5c9b6454-8f5a-469a-a445-424975c95bcd"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:00:52.548200 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-d96e5e2a-1e1d-4812-962f-3061462252e4 req-121127fd-86a7-4c16-bae1-a4571cc05141 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:52.549726 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-d96e5e2a-1e1d-4812-962f-3061462252e4 req-121127fd-86a7-4c16-bae1-a4571cc05141 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:52.552119 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-d96e5e2a-1e1d-4812-962f-3061462252e4 req-121127fd-86a7-4c16-bae1-a4571cc05141 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:52.575149 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-d96e5e2a-1e1d-4812-962f-3061462252e4 req-121127fd-86a7-4c16-bae1-a4571cc05141 service nova] Creating event network-vif-plugged:5c9b6454-8f5a-469a-a445-424975c95bcd for instance a50acb4f-16d0-4c72-b603-f795220ea866 on n-h2-850499-9 Aug 31 16:00:52.590603 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-d96e5e2a-1e1d-4812-962f-3061462252e4 req-121127fd-86a7-4c16-bae1-a4571cc05141 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074232 Aug 31 16:00:52.591289 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 683/1364] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:00:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:00:52.665819 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-afd18403-4b7f-4090-924b-7c98ea95b943 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6382b576b5404eb90214c00b62299b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7fb4ddb0e649edbe96d046cde6b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:52.677607 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-afd18403-4b7f-4090-924b-7c98ea95b943 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] 10.222.0.61 "GET /compute/v2.1/servers/a50acb4f-16d0-4c72-b603-f795220ea866" status: 200 len: 1321 microversion: 2.1 time: 0.407238 Aug 31 16:00:52.679563 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 682/1365] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:52 2022] GET /compute/v2.1/servers/a50acb4f-16d0-4c72-b603-f795220ea866 => generated 1321 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:53.093502 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7ff3a2fb-991a-4c63-b843-04e8888169ec tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '.version_select at 0x7f5ae8f9ca60>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:53.184009 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7ff3a2fb-991a-4c63-b843-04e8888169ec tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/images/91f26408-c009-455c-b26c-f5cfe4ba8d54" status: 200 len: 1414 microversion: 2.1 time: 0.095466 Aug 31 16:00:53.185688 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 684/1366] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:00:53 2022] GET /compute/v2.1/images/91f26408-c009-455c-b26c-f5cfe4ba8d54 => generated 1414 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:53.266440 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8489f902-aae3-4166-a79b-d9923a54fe31 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:53.267861 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8489f902-aae3-4166-a79b-d9923a54fe31 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:53.283303 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8489f902-aae3-4166-a79b-d9923a54fe31 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:53.285945 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8489f902-aae3-4166-a79b-d9923a54fe31 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:53.286657 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8489f902-aae3-4166-a79b-d9923a54fe31 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:53.301782 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8489f902-aae3-4166-a79b-d9923a54fe31 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:53.302667 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8489f902-aae3-4166-a79b-d9923a54fe31 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:53.304861 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8489f902-aae3-4166-a79b-d9923a54fe31 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:53.432620 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8489f902-aae3-4166-a79b-d9923a54fe31 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:53.460920 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8489f902-aae3-4166-a79b-d9923a54fe31 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:53.463295 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8489f902-aae3-4166-a79b-d9923a54fe31 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:53.475449 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8489f902-aae3-4166-a79b-d9923a54fe31 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1537 microversion: 2.91 time: 0.213604 Aug 31 16:00:53.477279 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 683/1367] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:00:53 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1537 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:00:53.705909 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-33d466fd-fab4-4f53-b3e0-4db844956fd5 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:53.706886 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-33d466fd-fab4-4f53-b3e0-4db844956fd5 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] [instance: a50acb4f-16d0-4c72-b603-f795220ea866] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:53.716427 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-33d466fd-fab4-4f53-b3e0-4db844956fd5 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:53.716932 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-33d466fd-fab4-4f53-b3e0-4db844956fd5 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:53.717366 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-33d466fd-fab4-4f53-b3e0-4db844956fd5 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:53.728608 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-33d466fd-fab4-4f53-b3e0-4db844956fd5 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:53.729593 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-33d466fd-fab4-4f53-b3e0-4db844956fd5 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:53.731213 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-33d466fd-fab4-4f53-b3e0-4db844956fd5 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:53.954447 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-33d466fd-fab4-4f53-b3e0-4db844956fd5 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6382b576b5404eb90214c00b62299b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7fb4ddb0e649edbe96d046cde6b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:53.970132 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-33d466fd-fab4-4f53-b3e0-4db844956fd5 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] 10.222.0.61 "GET /compute/v2.1/servers/a50acb4f-16d0-4c72-b603-f795220ea866" status: 200 len: 1321 microversion: 2.1 time: 0.269307 Aug 31 16:00:53.970635 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 685/1368] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:53 2022] GET /compute/v2.1/servers/a50acb4f-16d0-4c72-b603-f795220ea866 => generated 1321 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:54.208915 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-fa186cd9-0860-4f1a-9cea-044e2528cbc1 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '.version_select at 0x7f5ae8d169d0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:54.376610 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-fa186cd9-0860-4f1a-9cea-044e2528cbc1 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/images/91f26408-c009-455c-b26c-f5cfe4ba8d54" status: 200 len: 1414 microversion: 2.1 time: 0.177338 Aug 31 16:00:54.385583 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 684/1369] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:00:54 2022] GET /compute/v2.1/images/91f26408-c009-455c-b26c-f5cfe4ba8d54 => generated 1414 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:54.502704 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7dd433a8-64d3-44cf-8bd7-f8a25c05e692 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:54.503962 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7dd433a8-64d3-44cf-8bd7-f8a25c05e692 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:54.512714 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7dd433a8-64d3-44cf-8bd7-f8a25c05e692 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:54.513266 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7dd433a8-64d3-44cf-8bd7-f8a25c05e692 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:54.513714 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7dd433a8-64d3-44cf-8bd7-f8a25c05e692 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:54.514436 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7dd433a8-64d3-44cf-8bd7-f8a25c05e692 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:54.514899 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7dd433a8-64d3-44cf-8bd7-f8a25c05e692 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:54.515332 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7dd433a8-64d3-44cf-8bd7-f8a25c05e692 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:54.693633 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7dd433a8-64d3-44cf-8bd7-f8a25c05e692 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:54.710312 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7dd433a8-64d3-44cf-8bd7-f8a25c05e692 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:54.711887 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7dd433a8-64d3-44cf-8bd7-f8a25c05e692 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:54.727410 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7dd433a8-64d3-44cf-8bd7-f8a25c05e692 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1480 microversion: 2.91 time: 0.228751 Aug 31 16:00:54.728049 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 686/1370] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:00:54 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1480 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:00:54.756933 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4270a79e-836f-4587-bca7-ddb1e487a8e7 tempest-UnshelveToHostMultiNodesTest-1598069161 tempest-UnshelveToHostMultiNodesTest-1598069161-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h2-850499-9"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:00:54.760463 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4270a79e-836f-4587-bca7-ddb1e487a8e7 tempest-UnshelveToHostMultiNodesTest-1598069161 tempest-UnshelveToHostMultiNodesTest-1598069161-project-admin] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:54.781436 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4270a79e-836f-4587-bca7-ddb1e487a8e7 tempest-UnshelveToHostMultiNodesTest-1598069161 tempest-UnshelveToHostMultiNodesTest-1598069161-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:54.785743 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4270a79e-836f-4587-bca7-ddb1e487a8e7 tempest-UnshelveToHostMultiNodesTest-1598069161 tempest-UnshelveToHostMultiNodesTest-1598069161-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:54.786617 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4270a79e-836f-4587-bca7-ddb1e487a8e7 tempest-UnshelveToHostMultiNodesTest-1598069161 tempest-UnshelveToHostMultiNodesTest-1598069161-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:54.789478 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4270a79e-836f-4587-bca7-ddb1e487a8e7 tempest-UnshelveToHostMultiNodesTest-1598069161 tempest-UnshelveToHostMultiNodesTest-1598069161-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:54.790216 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4270a79e-836f-4587-bca7-ddb1e487a8e7 tempest-UnshelveToHostMultiNodesTest-1598069161 tempest-UnshelveToHostMultiNodesTest-1598069161-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:54.795838 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4270a79e-836f-4587-bca7-ddb1e487a8e7 tempest-UnshelveToHostMultiNodesTest-1598069161 tempest-UnshelveToHostMultiNodesTest-1598069161-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:54.904289 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4270a79e-836f-4587-bca7-ddb1e487a8e7 tempest-UnshelveToHostMultiNodesTest-1598069161 tempest-UnshelveToHostMultiNodesTest-1598069161-project-admin] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h2-850499-9". {{(pid=122257) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 31 16:00:54.991666 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5915802a-54a5-4f5d-bf5b-9022e8329ab3 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:54.992488 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5915802a-54a5-4f5d-bf5b-9022e8329ab3 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] [instance: a50acb4f-16d0-4c72-b603-f795220ea866] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:55.009715 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5915802a-54a5-4f5d-bf5b-9022e8329ab3 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:55.010375 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5915802a-54a5-4f5d-bf5b-9022e8329ab3 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:55.010949 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5915802a-54a5-4f5d-bf5b-9022e8329ab3 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:55.012023 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5915802a-54a5-4f5d-bf5b-9022e8329ab3 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:55.013626 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5915802a-54a5-4f5d-bf5b-9022e8329ab3 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:55.015071 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5915802a-54a5-4f5d-bf5b-9022e8329ab3 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:55.074733 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4270a79e-836f-4587-bca7-ddb1e487a8e7 tempest-UnshelveToHostMultiNodesTest-1598069161 tempest-UnshelveToHostMultiNodesTest-1598069161-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689/action" status: 202 len: 0 microversion: 2.91 time: 0.324785 Aug 31 16:00:55.075366 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 685/1371] 10.222.0.61 () {62 vars in 1319 bytes} [Wed Aug 31 16:00:54 2022] POST /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689/action => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:00:55.096192 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b8b32129-a6bc-4cf4-be38-e8221bb31149 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:55.097833 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b8b32129-a6bc-4cf4-be38-e8221bb31149 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:55.117364 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=1,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:00:55.119747 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b8b32129-a6bc-4cf4-be38-e8221bb31149 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:55.120488 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b8b32129-a6bc-4cf4-be38-e8221bb31149 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:55.121150 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b8b32129-a6bc-4cf4-be38-e8221bb31149 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:55.129131 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b8b32129-a6bc-4cf4-be38-e8221bb31149 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:55.130227 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b8b32129-a6bc-4cf4-be38-e8221bb31149 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:55.130903 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b8b32129-a6bc-4cf4-be38-e8221bb31149 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:55.371829 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b8b32129-a6bc-4cf4-be38-e8221bb31149 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:55.411885 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b8b32129-a6bc-4cf4-be38-e8221bb31149 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:55.413494 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b8b32129-a6bc-4cf4-be38-e8221bb31149 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:55.449032 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b8b32129-a6bc-4cf4-be38-e8221bb31149 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1488 microversion: 2.91 time: 0.369417 Aug 31 16:00:55.464288 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 686/1372] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:00:55 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1488 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:00:55.485245 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-412b1bbd-6438-4fc9-915d-10ca0c5b4180 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '.version_select at 0x7f5ae8cd59d0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:55.512890 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5915802a-54a5-4f5d-bf5b-9022e8329ab3 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6382b576b5404eb90214c00b62299b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7fb4ddb0e649edbe96d046cde6b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:55.524253 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5915802a-54a5-4f5d-bf5b-9022e8329ab3 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] 10.222.0.61 "GET /compute/v2.1/servers/a50acb4f-16d0-4c72-b603-f795220ea866" status: 200 len: 1471 microversion: 2.1 time: 0.536928 Aug 31 16:00:55.539896 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 687/1373] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:54 2022] GET /compute/v2.1/servers/a50acb4f-16d0-4c72-b603-f795220ea866 => generated 1471 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:55.590378 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-412b1bbd-6438-4fc9-915d-10ca0c5b4180 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/images/91f26408-c009-455c-b26c-f5cfe4ba8d54" status: 200 len: 1414 microversion: 2.1 time: 0.128432 Aug 31 16:00:55.601266 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 687/1374] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:00:55 2022] GET /compute/v2.1/images/91f26408-c009-455c-b26c-f5cfe4ba8d54 => generated 1414 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:56.130370 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1142f954-a331-4d38-b92e-5ecc6cefdd76 tempest-ServersAdminNegativeTestJSON-2114695108 tempest-ServersAdminNegativeTestJSON-2114695108-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:00:56.132384 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1142f954-a331-4d38-b92e-5ecc6cefdd76 tempest-ServersAdminNegativeTestJSON-2114695108 tempest-ServersAdminNegativeTestJSON-2114695108-project-admin] [instance: a049ffec-8ea0-4568-985e-bbacbde5b5ff] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:56.154750 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-1142f954-a331-4d38-b92e-5ecc6cefdd76 tempest-ServersAdminNegativeTestJSON-2114695108 tempest-ServersAdminNegativeTestJSON-2114695108-project-admin] HTTP exception thrown: Instance a049ffec-8ea0-4568-985e-bbacbde5b5ff could not be found. Aug 31 16:00:56.169164 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1142f954-a331-4d38-b92e-5ecc6cefdd76 tempest-ServersAdminNegativeTestJSON-2114695108 tempest-ServersAdminNegativeTestJSON-2114695108-project-admin] Request method failure captured: Aug 31 16:00:56.169164 n-d-850499-9 devstack@n-api.service[122256]: request: POST /compute/v2.1/servers/a049ffec-8ea0-4568-985e-bbacbde5b5ff/action HTTP/1.1 Aug 31 16:00:56.169164 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:00:56.169164 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:00:56.169164 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:00:56.169164 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 15 Aug 31 16:00:56.169164 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:00:56.169164 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:00:56.169164 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:00:56.169164 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:00:56.169164 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4WmttTKXgfXdytT2MSXw82W6_rYGER7QTtDOFW9BVZLaJgc8B-Kf83lSydNyCmATrb3tIaFY_i6AKxJ9DRibCDZCDjvfb7vabWn6pY80JznAcFGeiL7hd03gBQ_EK1T6uzUP6sHnyHjPz-fSpZ-Nk-2Ok_3jOaSn1lxRURh0D72N-8 Aug 31 16:00:56.169164 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:00:56.169164 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:00:56.169164 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:00:56.169164 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:00:56.169164 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:00:56.169164 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:00:56.169164 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 1ef27c92668d45c486212b31611361fe Aug 31 16:00:56.169164 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2114695108 Aug 31 16:00:56.169164 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,admin,member Aug 31 16:00:56.169164 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,admin,member Aug 31 16:00:56.171688 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1ef27c92668d45c486212b31611361fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1ef27c92668d45c486212b31611361fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1ef27c92668d45c486212b31611361fe", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1ef27c92668d45c486212b31611361fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:00:56.171688 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2114695108 Aug 31 16:00:56.171688 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 1ef27c92668d45c486212b31611361fe Aug 31 16:00:56.171688 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2114695108 Aug 31 16:00:56.171688 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ServersAdminNegativeTestJSON-2114695108-project-admin Aug 31 16:00:56.171688 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:00:56.171688 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:00:56.171688 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 9d31f46fc1914f30bf64465b2e4d35f3 Aug 31 16:00:56.171688 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2114695108-project-admin Aug 31 16:00:56.171688 n-d-850499-9 devstack@n-api.service[122256]: Aug 31 16:00:56.171688 n-d-850499-9 devstack@n-api.service[122256]: {"migrate": {}} Aug 31 16:00:56.171688 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:00:56.171688 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance a049ffec-8ea0-4568-985e-bbacbde5b5ff could not be found. Aug 31 16:00:56.173485 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': 'a049ffec-8ea0-4568-985e-bbacbde5b5ff', 'body': {'migrate': {}}} Aug 31 16:00:56.173485 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:00:56.173485 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:56.173485 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:00:56.173485 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:00:56.173485 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:00:56.173485 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:00:56.173485 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 31 16:00:56.173485 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 31 16:00:56.173485 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a049ffec-8ea0-4568-985e-bbacbde5b5ff could not be found. Aug 31 16:00:56.173485 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:56.173485 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:56.173485 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:56.173485 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:56.173485 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:56.173485 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:56.173485 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:00:56.173485 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:00:56.173485 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:00:56.173485 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:00:56.175287 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:00:56.175287 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:00:56.175287 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Aug 31 16:00:56.175287 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Aug 31 16:00:56.175287 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:00:56.175287 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:00:56.175287 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a049ffec-8ea0-4568-985e-bbacbde5b5ff could not be found. Aug 31 16:00:56.175287 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:56.175287 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:56.175287 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:56.175287 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:56.175287 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:56.175287 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:56.175287 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:00:56.175287 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:00:56.175287 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a049ffec-8ea0-4568-985e-bbacbde5b5ff could not be found. Aug 31 16:00:56.175287 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:56.177534 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1142f954-a331-4d38-b92e-5ecc6cefdd76 tempest-ServersAdminNegativeTestJSON-2114695108 tempest-ServersAdminNegativeTestJSON-2114695108-project-admin] Returning 404 to user: Instance a049ffec-8ea0-4568-985e-bbacbde5b5ff could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:00:56.185161 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1142f954-a331-4d38-b92e-5ecc6cefdd76 tempest-ServersAdminNegativeTestJSON-2114695108 tempest-ServersAdminNegativeTestJSON-2114695108-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/a049ffec-8ea0-4568-985e-bbacbde5b5ff/action" status: 404 len: 111 microversion: 2.1 time: 0.637918 Aug 31 16:00:56.221755 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 688/1375] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:00:55 2022] POST /compute/v2.1/servers/a049ffec-8ea0-4568-985e-bbacbde5b5ff/action => generated 111 bytes in 676 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:00:56.468355 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-71c0ed0b-d7a2-4f60-a041-2546e186168c tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1001403358", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:00:56.489646 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f66c0003-4627-426d-af09-35448a06f291 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:56.500650 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f66c0003-4627-426d-af09-35448a06f291 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:56.516577 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=4 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:00:56.535638 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f66c0003-4627-426d-af09-35448a06f291 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:56.537465 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f66c0003-4627-426d-af09-35448a06f291 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:56.538673 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f66c0003-4627-426d-af09-35448a06f291 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:56.540094 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f66c0003-4627-426d-af09-35448a06f291 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:56.541160 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f66c0003-4627-426d-af09-35448a06f291 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:56.542761 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f66c0003-4627-426d-af09-35448a06f291 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:56.622639 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-71c0ed0b-d7a2-4f60-a041-2546e186168c tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] validate_networks() for None {{(pid=122257) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:00:56.749355 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f66c0003-4627-426d-af09-35448a06f291 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:56.795168 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f66c0003-4627-426d-af09-35448a06f291 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:56.806246 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f66c0003-4627-426d-af09-35448a06f291 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:56.843251 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f66c0003-4627-426d-af09-35448a06f291 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1488 microversion: 2.91 time: 0.354896 Aug 31 16:00:56.843251 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 689/1376] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:00:56 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1488 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:00:56.865345 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3cccdfbb-140f-4451-bbcd-4c867d0f1aa7 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '.version_select at 0x7f5ae90070d0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:57.041204 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3cccdfbb-140f-4451-bbcd-4c867d0f1aa7 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/images/91f26408-c009-455c-b26c-f5cfe4ba8d54" status: 200 len: 1414 microversion: 2.1 time: 0.191153 Aug 31 16:00:57.058098 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 690/1377] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:00:56 2022] GET /compute/v2.1/images/91f26408-c009-455c-b26c-f5cfe4ba8d54 => generated 1414 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:57.363951 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-71c0ed0b-d7a2-4f60-a041-2546e186168c tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:00:57.364377 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-71c0ed0b-d7a2-4f60-a041-2546e186168c tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:00:57.364928 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-71c0ed0b-d7a2-4f60-a041-2546e186168c tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:00:57.365348 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-71c0ed0b-d7a2-4f60-a041-2546e186168c tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:00:57.365779 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-71c0ed0b-d7a2-4f60-a041-2546e186168c tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:00:57.399740 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-71c0ed0b-d7a2-4f60-a041-2546e186168c tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:57.400248 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-71c0ed0b-d7a2-4f60-a041-2546e186168c tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:57.400701 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-71c0ed0b-d7a2-4f60-a041-2546e186168c tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:57.401551 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-71c0ed0b-d7a2-4f60-a041-2546e186168c tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:57.401889 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-71c0ed0b-d7a2-4f60-a041-2546e186168c tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:57.402404 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-71c0ed0b-d7a2-4f60-a041-2546e186168c tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:57.486721 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-71c0ed0b-d7a2-4f60-a041-2546e186168c tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Getting quotas for project 2b7fb4ddb0e649edbe96d046cde6b1a6. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:00:57.501969 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-71c0ed0b-d7a2-4f60-a041-2546e186168c tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Getting quotas for user 7d6382b576b5404eb90214c00b62299b and project 2b7fb4ddb0e649edbe96d046cde6b1a6. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:00:57.528017 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-71c0ed0b-d7a2-4f60-a041-2546e186168c tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Going to run 1 instances... {{(pid=122257) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:00:57.530699 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-71c0ed0b-d7a2-4f60-a041-2546e186168c tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] [instance: b82bda5d-2f6d-41e2-b9a4-180ba1d05652] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:00:57.620534 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-71c0ed0b-d7a2-4f60-a041-2546e186168c tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.162156 Aug 31 16:00:57.624189 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 688/1378] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:00:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1166 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:00:57.635992 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-af8fff64-9191-41c9-9ec0-4842da18c7c8 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:57.636624 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-af8fff64-9191-41c9-9ec0-4842da18c7c8 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] [instance: b82bda5d-2f6d-41e2-b9a4-180ba1d05652] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:57.852627 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-af8fff64-9191-41c9-9ec0-4842da18c7c8 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6382b576b5404eb90214c00b62299b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7fb4ddb0e649edbe96d046cde6b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:57.878932 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-af8fff64-9191-41c9-9ec0-4842da18c7c8 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] 10.222.0.61 "GET /compute/v2.1/servers/b82bda5d-2f6d-41e2-b9a4-180ba1d05652" status: 200 len: 1222 microversion: 2.1 time: 0.242926 Aug 31 16:00:57.885725 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 691/1379] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:57 2022] GET /compute/v2.1/servers/b82bda5d-2f6d-41e2-b9a4-180ba1d05652 => generated 1222 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:57.889636 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-51d6656c-667d-4901-94ad-da32d750a4b3 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:57.890676 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-51d6656c-667d-4901-94ad-da32d750a4b3 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:57.908513 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-51d6656c-667d-4901-94ad-da32d750a4b3 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:57.909674 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-51d6656c-667d-4901-94ad-da32d750a4b3 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:57.916922 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-51d6656c-667d-4901-94ad-da32d750a4b3 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:57.918940 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-51d6656c-667d-4901-94ad-da32d750a4b3 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:57.920240 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-51d6656c-667d-4901-94ad-da32d750a4b3 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:57.922788 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-51d6656c-667d-4901-94ad-da32d750a4b3 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:58.065074 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2b876788-bf00-4551-94ab-e6e7a71e3c6d tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '.version_select at 0x7f5ae8fea430>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:58.171241 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2b876788-bf00-4551-94ab-e6e7a71e3c6d tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/images/91f26408-c009-455c-b26c-f5cfe4ba8d54" status: 200 len: 1414 microversion: 2.1 time: 0.110479 Aug 31 16:00:58.204049 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 692/1380] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:00:58 2022] GET /compute/v2.1/images/91f26408-c009-455c-b26c-f5cfe4ba8d54 => generated 1414 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:58.302456 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-51d6656c-667d-4901-94ad-da32d750a4b3 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:58.341170 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-51d6656c-667d-4901-94ad-da32d750a4b3 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:58.353602 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-51d6656c-667d-4901-94ad-da32d750a4b3 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:58.383952 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-51d6656c-667d-4901-94ad-da32d750a4b3 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1546 microversion: 2.91 time: 0.499599 Aug 31 16:00:58.397423 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 689/1381] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:00:57 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1546 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:00:58.905626 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-820a0cfe-1451-4b09-b1b2-93b0ba922265 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:58.907019 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-820a0cfe-1451-4b09-b1b2-93b0ba922265 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] [instance: b82bda5d-2f6d-41e2-b9a4-180ba1d05652] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:58.921873 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-820a0cfe-1451-4b09-b1b2-93b0ba922265 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:58.926567 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-820a0cfe-1451-4b09-b1b2-93b0ba922265 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:58.932469 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-820a0cfe-1451-4b09-b1b2-93b0ba922265 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:58.933259 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-820a0cfe-1451-4b09-b1b2-93b0ba922265 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:58.933743 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-820a0cfe-1451-4b09-b1b2-93b0ba922265 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:58.934176 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-820a0cfe-1451-4b09-b1b2-93b0ba922265 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:59.069794 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-64dbf85f-5dc7-423b-8eac-b2df9ffabd0e tempest-HypervisorAdminNegativeTestJSON-720812280 tempest-HypervisorAdminNegativeTestJSON-720812280-project] Calling method '.version_select at 0x7f5ae8f9c820>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:59.072011 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-64dbf85f-5dc7-423b-8eac-b2df9ffabd0e tempest-HypervisorAdminNegativeTestJSON-720812280 tempest-HypervisorAdminNegativeTestJSON-720812280-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '4274593f16ad4682ae2a398049137132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c1e46bd67c4b2fb280a840d5bfb049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:59.073790 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-64dbf85f-5dc7-423b-8eac-b2df9ffabd0e tempest-HypervisorAdminNegativeTestJSON-720812280 tempest-HypervisorAdminNegativeTestJSON-720812280-project] Request method failure captured: Aug 31 16:00:59.073790 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Aug 31 16:00:59.073790 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:00:59.073790 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:00:59.073790 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:00:59.073790 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:00:59.073790 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:00:59.073790 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:00:59.073790 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:00:59.073790 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:00:59.073790 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4W4Bsi5O8F6trcHm1A805_JT_ZFgJpqFCMOeeYXjpTLMsaMT8KdPwP5opctUolXHzdbURORjEhE6wEbP2eJvpAlq8UgVN1Vq8ae5F6Jyg6ufg8j6Tck_sRWe8RlPsshL_dgEzHsGoFBfi4R6212k2cujPOo-UeIRv7EXMFz-ueZX4Q Aug 31 16:00:59.073790 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:00:59.073790 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:00:59.073790 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:00:59.073790 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:00:59.073790 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:00:59.073790 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:00:59.073790 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 08c1e46bd67c4b2fb280a840d5bfb049 Aug 31 16:00:59.073790 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-720812280 Aug 31 16:00:59.073790 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:00:59.073790 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:00:59.076677 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/08c1e46bd67c4b2fb280a840d5bfb049"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/08c1e46bd67c4b2fb280a840d5bfb049"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_08c1e46bd67c4b2fb280a840d5bfb049", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/08c1e46bd67c4b2fb280a840d5bfb049"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:00:59.076677 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-720812280 Aug 31 16:00:59.076677 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 08c1e46bd67c4b2fb280a840d5bfb049 Aug 31 16:00:59.076677 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-720812280 Aug 31 16:00:59.076677 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-HypervisorAdminNegativeTestJSON-720812280-project Aug 31 16:00:59.076677 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:00:59.076677 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:00:59.076677 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 4274593f16ad4682ae2a398049137132 Aug 31 16:00:59.076677 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-720812280-project Aug 31 16:00:59.076677 n-d-850499-9 devstack@n-api.service[122256]: method: Aug 31 16:00:59.076677 n-d-850499-9 devstack@n-api.service[122256]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 31 16:00:59.076677 n-d-850499-9 devstack@n-api.service[122256]: action_args: {} Aug 31 16:00:59.076677 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:00:59.079203 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:59.079203 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:59.079203 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:59.079203 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:00:59.079203 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:00:59.079203 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:00:59.079203 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:00:59.079203 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:00:59.079203 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:00:59.079203 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Aug 31 16:00:59.079203 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self._detail(req) Aug 31 16:00:59.079203 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Aug 31 16:00:59.079203 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Aug 31 16:00:59.079203 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 31 16:00:59.079203 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 31 16:00:59.079203 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 31 16:00:59.079203 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 31 16:00:59.079203 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 16:00:59.079203 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 31 16:00:59.083256 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 16:00:59.083256 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise self.value Aug 31 16:00:59.083256 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 31 16:00:59.083256 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 31 16:00:59.083256 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 31 16:00:59.083256 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 31 16:00:59.083256 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 31 16:00:59.083256 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 31 16:00:59.083256 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 31 16:00:59.083256 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:59.083256 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:59.083256 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:59.083256 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:59.083256 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:59.083256 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:59.083256 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 31 16:00:59.083256 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 31 16:00:59.083256 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 31 16:00:59.083256 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:59.088212 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-64dbf85f-5dc7-423b-8eac-b2df9ffabd0e tempest-HypervisorAdminNegativeTestJSON-720812280 tempest-HypervisorAdminNegativeTestJSON-720812280-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:00:59.088212 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-64dbf85f-5dc7-423b-8eac-b2df9ffabd0e tempest-HypervisorAdminNegativeTestJSON-720812280 tempest-HypervisorAdminNegativeTestJSON-720812280-project] 10.222.0.61 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.398318 Aug 31 16:00:59.088212 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 693/1382] 10.222.0.61 () {58 vars in 1167 bytes} [Wed Aug 31 16:00:58 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 408 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:00:59.102483 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5dc33487-a3c0-4992-8902-78f1298c1ba5 tempest-HypervisorAdminNegativeTestJSON-720812280 tempest-HypervisorAdminNegativeTestJSON-720812280-project] Calling method '.version_select at 0x7f5ae8f9c0d0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:59.107455 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5dc33487-a3c0-4992-8902-78f1298c1ba5 tempest-HypervisorAdminNegativeTestJSON-720812280 tempest-HypervisorAdminNegativeTestJSON-720812280-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '4274593f16ad4682ae2a398049137132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c1e46bd67c4b2fb280a840d5bfb049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:59.110162 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5dc33487-a3c0-4992-8902-78f1298c1ba5 tempest-HypervisorAdminNegativeTestJSON-720812280 tempest-HypervisorAdminNegativeTestJSON-720812280-project] Request method failure captured: Aug 31 16:00:59.110162 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Aug 31 16:00:59.110162 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:00:59.110162 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:00:59.110162 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:00:59.110162 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:00:59.110162 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:00:59.110162 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:00:59.110162 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:00:59.110162 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:00:59.110162 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4W4Bsi5O8F6trcHm1A805_JT_ZFgJpqFCMOeeYXjpTLMsaMT8KdPwP5opctUolXHzdbURORjEhE6wEbP2eJvpAlq8UgVN1Vq8ae5F6Jyg6ufg8j6Tck_sRWe8RlPsshL_dgEzHsGoFBfi4R6212k2cujPOo-UeIRv7EXMFz-ueZX4Q Aug 31 16:00:59.110162 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:00:59.110162 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:00:59.110162 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:00:59.110162 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:00:59.110162 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:00:59.110162 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:00:59.110162 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 08c1e46bd67c4b2fb280a840d5bfb049 Aug 31 16:00:59.110162 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-720812280 Aug 31 16:00:59.110162 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:00:59.110162 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:00:59.111473 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/08c1e46bd67c4b2fb280a840d5bfb049"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/08c1e46bd67c4b2fb280a840d5bfb049"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_08c1e46bd67c4b2fb280a840d5bfb049", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/08c1e46bd67c4b2fb280a840d5bfb049"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:00:59.111473 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-720812280 Aug 31 16:00:59.111473 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 08c1e46bd67c4b2fb280a840d5bfb049 Aug 31 16:00:59.111473 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-720812280 Aug 31 16:00:59.111473 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-HypervisorAdminNegativeTestJSON-720812280-project Aug 31 16:00:59.111473 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:00:59.111473 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:00:59.111473 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 4274593f16ad4682ae2a398049137132 Aug 31 16:00:59.111473 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-720812280-project Aug 31 16:00:59.111473 n-d-850499-9 devstack@n-api.service[122256]: method: Aug 31 16:00:59.111473 n-d-850499-9 devstack@n-api.service[122256]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 31 16:00:59.111473 n-d-850499-9 devstack@n-api.service[122256]: action_args: {} Aug 31 16:00:59.111473 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:00:59.112564 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:59.112564 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:59.112564 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:59.112564 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:00:59.112564 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:00:59.112564 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:00:59.112564 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:00:59.112564 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:00:59.112564 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:00:59.112564 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Aug 31 16:00:59.112564 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self._index(req) Aug 31 16:00:59.112564 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Aug 31 16:00:59.112564 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Aug 31 16:00:59.112564 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 31 16:00:59.112564 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 31 16:00:59.112564 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 31 16:00:59.112564 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 31 16:00:59.112564 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 16:00:59.112564 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 31 16:00:59.113739 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 16:00:59.113739 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise self.value Aug 31 16:00:59.113739 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 31 16:00:59.113739 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 31 16:00:59.113739 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 31 16:00:59.113739 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 31 16:00:59.113739 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 31 16:00:59.113739 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 31 16:00:59.113739 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 31 16:00:59.113739 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:59.113739 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:59.113739 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:59.113739 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:59.113739 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:59.113739 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:59.113739 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 31 16:00:59.113739 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 31 16:00:59.113739 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 31 16:00:59.113739 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:59.114916 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5dc33487-a3c0-4992-8902-78f1298c1ba5 tempest-HypervisorAdminNegativeTestJSON-720812280 tempest-HypervisorAdminNegativeTestJSON-720812280-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:00:59.116813 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5dc33487-a3c0-4992-8902-78f1298c1ba5 tempest-HypervisorAdminNegativeTestJSON-720812280 tempest-HypervisorAdminNegativeTestJSON-720812280-project] 10.222.0.61 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.027472 Aug 31 16:00:59.116969 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-820a0cfe-1451-4b09-b1b2-93b0ba922265 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6382b576b5404eb90214c00b62299b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7fb4ddb0e649edbe96d046cde6b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:59.117507 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 694/1383] 10.222.0.61 () {58 vars in 1146 bytes} [Wed Aug 31 16:00:59 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 29 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:00:59.125578 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-820a0cfe-1451-4b09-b1b2-93b0ba922265 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] 10.222.0.61 "GET /compute/v2.1/servers/b82bda5d-2f6d-41e2-b9a4-180ba1d05652" status: 200 len: 1226 microversion: 2.1 time: 0.224247 Aug 31 16:00:59.126837 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b5916ead-66d3-462b-b83d-5affc31c897e tempest-HypervisorAdminNegativeTestJSON-720812280 tempest-HypervisorAdminNegativeTestJSON-720812280-project] Calling method '.version_select at 0x7f5ae8feae50>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:59.131779 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b5916ead-66d3-462b-b83d-5affc31c897e tempest-HypervisorAdminNegativeTestJSON-720812280 tempest-HypervisorAdminNegativeTestJSON-720812280-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '4274593f16ad4682ae2a398049137132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c1e46bd67c4b2fb280a840d5bfb049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:59.133505 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 690/1384] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:58 2022] GET /compute/v2.1/servers/b82bda5d-2f6d-41e2-b9a4-180ba1d05652 => generated 1226 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:59.135136 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b5916ead-66d3-462b-b83d-5affc31c897e tempest-HypervisorAdminNegativeTestJSON-720812280 tempest-HypervisorAdminNegativeTestJSON-720812280-project] Request method failure captured: Aug 31 16:00:59.135136 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Aug 31 16:00:59.135136 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:00:59.135136 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:00:59.135136 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:00:59.135136 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:00:59.135136 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:00:59.135136 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:00:59.135136 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:00:59.135136 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:00:59.135136 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4W4Bsi5O8F6trcHm1A805_JT_ZFgJpqFCMOeeYXjpTLMsaMT8KdPwP5opctUolXHzdbURORjEhE6wEbP2eJvpAlq8UgVN1Vq8ae5F6Jyg6ufg8j6Tck_sRWe8RlPsshL_dgEzHsGoFBfi4R6212k2cujPOo-UeIRv7EXMFz-ueZX4Q Aug 31 16:00:59.135136 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:00:59.135136 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:00:59.135136 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:00:59.135136 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:00:59.135136 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:00:59.135136 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:00:59.135136 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 08c1e46bd67c4b2fb280a840d5bfb049 Aug 31 16:00:59.135136 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-720812280 Aug 31 16:00:59.135136 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:00:59.135136 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:00:59.136540 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/08c1e46bd67c4b2fb280a840d5bfb049"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/08c1e46bd67c4b2fb280a840d5bfb049"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_08c1e46bd67c4b2fb280a840d5bfb049", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/08c1e46bd67c4b2fb280a840d5bfb049"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:00:59.136540 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-720812280 Aug 31 16:00:59.136540 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 08c1e46bd67c4b2fb280a840d5bfb049 Aug 31 16:00:59.136540 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-720812280 Aug 31 16:00:59.136540 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-HypervisorAdminNegativeTestJSON-720812280-project Aug 31 16:00:59.136540 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:00:59.136540 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:00:59.136540 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 4274593f16ad4682ae2a398049137132 Aug 31 16:00:59.136540 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-720812280-project Aug 31 16:00:59.136540 n-d-850499-9 devstack@n-api.service[122256]: method: Aug 31 16:00:59.136540 n-d-850499-9 devstack@n-api.service[122256]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 31 16:00:59.136540 n-d-850499-9 devstack@n-api.service[122256]: action_args: {} Aug 31 16:00:59.136540 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:00:59.137367 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:59.137367 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:59.137367 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:59.137367 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:00:59.137367 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:00:59.137367 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:00:59.137367 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:00:59.137367 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:00:59.137367 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:00:59.137367 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Aug 31 16:00:59.137367 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Aug 31 16:00:59.137367 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 31 16:00:59.137367 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 31 16:00:59.137367 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 31 16:00:59.137367 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 31 16:00:59.137367 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 16:00:59.137367 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 31 16:00:59.137367 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 16:00:59.137367 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise self.value Aug 31 16:00:59.138572 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 31 16:00:59.138572 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 31 16:00:59.138572 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 31 16:00:59.138572 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 31 16:00:59.138572 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 31 16:00:59.138572 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 31 16:00:59.138572 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 31 16:00:59.138572 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:59.138572 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:59.138572 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:59.138572 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:59.138572 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:59.138572 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:59.138572 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 31 16:00:59.138572 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 31 16:00:59.138572 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 31 16:00:59.138572 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:00:59.142972 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b5916ead-66d3-462b-b83d-5affc31c897e tempest-HypervisorAdminNegativeTestJSON-720812280 tempest-HypervisorAdminNegativeTestJSON-720812280-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:00:59.146102 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b5916ead-66d3-462b-b83d-5affc31c897e tempest-HypervisorAdminNegativeTestJSON-720812280 tempest-HypervisorAdminNegativeTestJSON-720812280-project] 10.222.0.61 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.023334 Aug 31 16:00:59.159986 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 695/1385] 10.222.0.61 () {58 vars in 1179 bytes} [Wed Aug 31 16:00:59 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 38 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:00:59.218360 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4d2fca36-adaf-451e-9c20-8886f39da642 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '.version_select at 0x7f5ae8f1cc10>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:59.297665 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a37525fb-272a-4620-a35c-60de43539187 tempest-HypervisorAdminNegativeTestJSON-558587570 tempest-HypervisorAdminNegativeTestJSON-558587570-project-admin] Calling method '.version_select at 0x7f5ae8d11940>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:59.302069 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a37525fb-272a-4620-a35c-60de43539187 tempest-HypervisorAdminNegativeTestJSON-558587570 tempest-HypervisorAdminNegativeTestJSON-558587570-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:59.302578 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a37525fb-272a-4620-a35c-60de43539187 tempest-HypervisorAdminNegativeTestJSON-558587570 tempest-HypervisorAdminNegativeTestJSON-558587570-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:59.305232 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a37525fb-272a-4620-a35c-60de43539187 tempest-HypervisorAdminNegativeTestJSON-558587570 tempest-HypervisorAdminNegativeTestJSON-558587570-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:59.374119 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a37525fb-272a-4620-a35c-60de43539187 tempest-HypervisorAdminNegativeTestJSON-558587570 tempest-HypervisorAdminNegativeTestJSON-558587570-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:59.380906 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a37525fb-272a-4620-a35c-60de43539187 tempest-HypervisorAdminNegativeTestJSON-558587570 tempest-HypervisorAdminNegativeTestJSON-558587570-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:59.382250 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a37525fb-272a-4620-a35c-60de43539187 tempest-HypervisorAdminNegativeTestJSON-558587570 tempest-HypervisorAdminNegativeTestJSON-558587570-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:59.447219 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a37525fb-272a-4620-a35c-60de43539187 tempest-HypervisorAdminNegativeTestJSON-558587570 tempest-HypervisorAdminNegativeTestJSON-558587570-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:59.454926 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a37525fb-272a-4620-a35c-60de43539187 tempest-HypervisorAdminNegativeTestJSON-558587570 tempest-HypervisorAdminNegativeTestJSON-558587570-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:59.456888 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a37525fb-272a-4620-a35c-60de43539187 tempest-HypervisorAdminNegativeTestJSON-558587570 tempest-HypervisorAdminNegativeTestJSON-558587570-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:59.465851 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a37525fb-272a-4620-a35c-60de43539187 tempest-HypervisorAdminNegativeTestJSON-558587570 tempest-HypervisorAdminNegativeTestJSON-558587570-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.299949 Aug 31 16:00:59.467666 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 691/1386] 10.222.0.61 () {58 vars in 1146 bytes} [Wed Aug 31 16:00:59 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:00:59.477549 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ba78e734-fcb7-47a4-911a-9d419ba2b421 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:59.478434 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ba78e734-fcb7-47a4-911a-9d419ba2b421 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:59.486981 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ba78e734-fcb7-47a4-911a-9d419ba2b421 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:59.488356 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ba78e734-fcb7-47a4-911a-9d419ba2b421 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:59.489206 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ba78e734-fcb7-47a4-911a-9d419ba2b421 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:59.490119 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ba78e734-fcb7-47a4-911a-9d419ba2b421 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:59.490761 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ba78e734-fcb7-47a4-911a-9d419ba2b421 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:59.491456 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ba78e734-fcb7-47a4-911a-9d419ba2b421 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:59.643415 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ba78e734-fcb7-47a4-911a-9d419ba2b421 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:59.661720 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ba78e734-fcb7-47a4-911a-9d419ba2b421 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:59.665328 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ba78e734-fcb7-47a4-911a-9d419ba2b421 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:59.681655 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ba78e734-fcb7-47a4-911a-9d419ba2b421 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1546 microversion: 2.91 time: 0.212634 Aug 31 16:00:59.682935 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 692/1387] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:00:59 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1546 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:00:59.688694 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-59b92cf5-2ebe-4aa2-9611-0fd5faba8a63 tempest-HypervisorAdminNegativeTestJSON-720812280 tempest-HypervisorAdminNegativeTestJSON-720812280-project] Calling method '.version_select at 0x7f5ae8f12d30>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:59.692167 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-59b92cf5-2ebe-4aa2-9611-0fd5faba8a63 tempest-HypervisorAdminNegativeTestJSON-720812280 tempest-HypervisorAdminNegativeTestJSON-720812280-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '4274593f16ad4682ae2a398049137132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c1e46bd67c4b2fb280a840d5bfb049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:59.695442 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-59b92cf5-2ebe-4aa2-9611-0fd5faba8a63 tempest-HypervisorAdminNegativeTestJSON-720812280 tempest-HypervisorAdminNegativeTestJSON-720812280-project] Request method failure captured: Aug 31 16:00:59.695442 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Aug 31 16:00:59.695442 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:00:59.695442 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:00:59.695442 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:00:59.695442 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:00:59.695442 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:00:59.695442 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:00:59.695442 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:00:59.695442 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:00:59.695442 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4W4Bsi5O8F6trcHm1A805_JT_ZFgJpqFCMOeeYXjpTLMsaMT8KdPwP5opctUolXHzdbURORjEhE6wEbP2eJvpAlq8UgVN1Vq8ae5F6Jyg6ufg8j6Tck_sRWe8RlPsshL_dgEzHsGoFBfi4R6212k2cujPOo-UeIRv7EXMFz-ueZX4Q Aug 31 16:00:59.695442 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:00:59.695442 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:00:59.695442 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:00:59.695442 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:00:59.695442 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:00:59.695442 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:00:59.695442 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 08c1e46bd67c4b2fb280a840d5bfb049 Aug 31 16:00:59.695442 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-720812280 Aug 31 16:00:59.695442 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:00:59.695442 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:00:59.697154 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/08c1e46bd67c4b2fb280a840d5bfb049"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/08c1e46bd67c4b2fb280a840d5bfb049"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_08c1e46bd67c4b2fb280a840d5bfb049", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/08c1e46bd67c4b2fb280a840d5bfb049"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:00:59.697154 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-720812280 Aug 31 16:00:59.697154 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 08c1e46bd67c4b2fb280a840d5bfb049 Aug 31 16:00:59.697154 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-720812280 Aug 31 16:00:59.697154 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-HypervisorAdminNegativeTestJSON-720812280-project Aug 31 16:00:59.697154 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:00:59.697154 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:00:59.697154 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 4274593f16ad4682ae2a398049137132 Aug 31 16:00:59.697154 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-720812280-project Aug 31 16:00:59.697154 n-d-850499-9 devstack@n-api.service[122257]: method: Aug 31 16:00:59.697154 n-d-850499-9 devstack@n-api.service[122257]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 31 16:00:59.697154 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '1'} Aug 31 16:00:59.697154 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:00:59.698070 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:59.698070 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:59.698070 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:59.698070 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:00:59.698070 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:00:59.698070 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:00:59.698070 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:00:59.698070 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:00:59.698070 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:00:59.698070 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Aug 31 16:00:59.698070 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Aug 31 16:00:59.698070 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 31 16:00:59.698070 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 31 16:00:59.698070 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 31 16:00:59.698070 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 31 16:00:59.698070 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 16:00:59.698070 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 31 16:00:59.698070 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 16:00:59.698070 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise self.value Aug 31 16:00:59.699530 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 31 16:00:59.699530 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 31 16:00:59.699530 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 31 16:00:59.699530 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 31 16:00:59.699530 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 31 16:00:59.699530 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 31 16:00:59.699530 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 31 16:00:59.699530 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:00:59.699530 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:59.699530 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:00:59.699530 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:59.699530 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:59.699530 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:59.699530 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 31 16:00:59.699530 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 31 16:00:59.699530 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 31 16:00:59.699530 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:00:59.701771 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-59b92cf5-2ebe-4aa2-9611-0fd5faba8a63 tempest-HypervisorAdminNegativeTestJSON-720812280 tempest-HypervisorAdminNegativeTestJSON-720812280-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:00:59.702807 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-59b92cf5-2ebe-4aa2-9611-0fd5faba8a63 tempest-HypervisorAdminNegativeTestJSON-720812280 tempest-HypervisorAdminNegativeTestJSON-720812280-project] 10.222.0.61 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.018106 Aug 31 16:00:59.703610 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 693/1388] 10.222.0.61 () {58 vars in 1173 bytes} [Wed Aug 31 16:00:59 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:00:59.721069 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1ca01b8c-7610-42b0-bf56-db62e2a1e953 tempest-HypervisorAdminNegativeTestJSON-558587570 tempest-HypervisorAdminNegativeTestJSON-558587570-project-admin] Calling method '.version_select at 0x7f5ae8d110d0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:59.728573 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-1ca01b8c-7610-42b0-bf56-db62e2a1e953 tempest-HypervisorAdminNegativeTestJSON-558587570 tempest-HypervisorAdminNegativeTestJSON-558587570-project-admin] HTTP exception thrown: Hypervisor with ID 'b9c1fff7-2b52-453f-9216-f2d52dbff0f0' could not be found. Aug 31 16:00:59.749486 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1ca01b8c-7610-42b0-bf56-db62e2a1e953 tempest-HypervisorAdminNegativeTestJSON-558587570 tempest-HypervisorAdminNegativeTestJSON-558587570-project-admin] Request method failure captured: Aug 31 16:00:59.749486 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/os-hypervisors/b9c1fff7-2b52-453f-9216-f2d52dbff0f0/uptime HTTP/1.1 Aug 31 16:00:59.749486 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:00:59.749486 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:00:59.749486 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:00:59.749486 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:00:59.749486 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:00:59.749486 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:00:59.749486 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:00:59.749486 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:00:59.749486 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4W6uVm5bokg0Pgxslzw9nm2DdHVAZkqivErmqn-W0jJGe8coOrFF3FgXl-EkuPFBI30VQxj-_0o2RQ678lpwbpJu0mhBd1xZH7CiXbC5824ZozGSDaJclkP0YHij1xnpMImrX59OXXS2alq-jUZSlmRJdoNaLE0fBmdrQtZfmqEUZY Aug 31 16:00:59.749486 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:00:59.749486 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:00:59.749486 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:00:59.749486 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:00:59.749486 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:00:59.749486 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:00:59.749486 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 5f7e69dc62444a979184519e58857597 Aug 31 16:00:59.749486 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-558587570 Aug 31 16:00:59.749486 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,admin,member Aug 31 16:00:59.749486 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,admin,member Aug 31 16:00:59.751230 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5f7e69dc62444a979184519e58857597"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5f7e69dc62444a979184519e58857597"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5f7e69dc62444a979184519e58857597", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5f7e69dc62444a979184519e58857597"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:00:59.751230 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-558587570 Aug 31 16:00:59.751230 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 5f7e69dc62444a979184519e58857597 Aug 31 16:00:59.751230 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-558587570 Aug 31 16:00:59.751230 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-HypervisorAdminNegativeTestJSON-558587570-project-admin Aug 31 16:00:59.751230 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:00:59.751230 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:00:59.751230 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 917a30f51d1e494a84325002e60278e7 Aug 31 16:00:59.751230 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-558587570-project-admin Aug 31 16:00:59.751230 n-d-850499-9 devstack@n-api.service[122257]: method: Aug 31 16:00:59.751230 n-d-850499-9 devstack@n-api.service[122257]: exception: Hypervisor with ID 'b9c1fff7-2b52-453f-9216-f2d52dbff0f0' could not be found. Aug 31 16:00:59.751230 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': 'b9c1fff7-2b52-453f-9216-f2d52dbff0f0'} Aug 31 16:00:59.752484 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:00:59.752484 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:59.752484 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Aug 31 16:00:59.752484 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi value = int(str(value)) Aug 31 16:00:59.752484 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'b9c1fff7-2b52-453f-9216-f2d52dbff0f0' Aug 31 16:00:59.752484 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:00:59.752484 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:59.752484 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:00:59.752484 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:59.752484 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Aug 31 16:00:59.752484 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Aug 31 16:00:59.752484 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Aug 31 16:00:59.752484 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Aug 31 16:00:59.752484 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Aug 31 16:00:59.752484 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:00:59.752484 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:59.752484 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:00:59.752484 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:59.752484 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Aug 31 16:00:59.752484 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Aug 31 16:00:59.752484 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Aug 31 16:00:59.752484 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Aug 31 16:00:59.754659 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Aug 31 16:00:59.754659 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:00:59.754659 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:59.754659 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:00:59.754659 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:59.754659 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:59.754659 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:59.754659 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:00:59.754659 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:00:59.754659 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:00:59.754659 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:00:59.754659 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:00:59.754659 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:00:59.754659 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Aug 31 16:00:59.754659 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Aug 31 16:00:59.754659 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Aug 31 16:00:59.754659 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 31 16:00:59.754659 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'b9c1fff7-2b52-453f-9216-f2d52dbff0f0' could not be found. Aug 31 16:00:59.754659 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:00:59.754659 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:59.754659 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:00:59.755975 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:59.755975 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:59.755975 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:59.755975 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:00:59.755975 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:00:59.755975 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'b9c1fff7-2b52-453f-9216-f2d52dbff0f0' could not be found. Aug 31 16:00:59.755975 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:00:59.755975 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1ca01b8c-7610-42b0-bf56-db62e2a1e953 tempest-HypervisorAdminNegativeTestJSON-558587570 tempest-HypervisorAdminNegativeTestJSON-558587570-project-admin] Returning 404 to user: Hypervisor with ID 'b9c1fff7-2b52-453f-9216-f2d52dbff0f0' could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:00:59.755975 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1ca01b8c-7610-42b0-bf56-db62e2a1e953 tempest-HypervisorAdminNegativeTestJSON-558587570 tempest-HypervisorAdminNegativeTestJSON-558587570-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hypervisors/b9c1fff7-2b52-453f-9216-f2d52dbff0f0/uptime" status: 404 len: 123 microversion: 2.1 time: 0.038001 Aug 31 16:00:59.755975 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 694/1389] 10.222.0.61 () {58 vars in 1278 bytes} [Wed Aug 31 16:00:59 2022] GET /compute/v2.1/os-hypervisors/b9c1fff7-2b52-453f-9216-f2d52dbff0f0/uptime => generated 123 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:00:59.766017 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-52299a06-f97a-4810-a619-49226214f299 tempest-HypervisorAdminNegativeTestJSON-558587570 tempest-HypervisorAdminNegativeTestJSON-558587570-project-admin] Calling method '.version_select at 0x7f5ae8cf6b80>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:59.769873 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-52299a06-f97a-4810-a619-49226214f299 tempest-HypervisorAdminNegativeTestJSON-558587570 tempest-HypervisorAdminNegativeTestJSON-558587570-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:59.770619 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-52299a06-f97a-4810-a619-49226214f299 tempest-HypervisorAdminNegativeTestJSON-558587570 tempest-HypervisorAdminNegativeTestJSON-558587570-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:59.771263 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-52299a06-f97a-4810-a619-49226214f299 tempest-HypervisorAdminNegativeTestJSON-558587570 tempest-HypervisorAdminNegativeTestJSON-558587570-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:59.788572 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-52299a06-f97a-4810-a619-49226214f299 tempest-HypervisorAdminNegativeTestJSON-558587570 tempest-HypervisorAdminNegativeTestJSON-558587570-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:59.789311 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-52299a06-f97a-4810-a619-49226214f299 tempest-HypervisorAdminNegativeTestJSON-558587570 tempest-HypervisorAdminNegativeTestJSON-558587570-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:59.789920 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-52299a06-f97a-4810-a619-49226214f299 tempest-HypervisorAdminNegativeTestJSON-558587570 tempest-HypervisorAdminNegativeTestJSON-558587570-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:59.799732 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:00:59.808567 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-52299a06-f97a-4810-a619-49226214f299 tempest-HypervisorAdminNegativeTestJSON-558587570 tempest-HypervisorAdminNegativeTestJSON-558587570-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:59.810018 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-52299a06-f97a-4810-a619-49226214f299 tempest-HypervisorAdminNegativeTestJSON-558587570 tempest-HypervisorAdminNegativeTestJSON-558587570-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:59.811197 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-52299a06-f97a-4810-a619-49226214f299 tempest-HypervisorAdminNegativeTestJSON-558587570 tempest-HypervisorAdminNegativeTestJSON-558587570-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:59.829442 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-52299a06-f97a-4810-a619-49226214f299 tempest-HypervisorAdminNegativeTestJSON-558587570 tempest-HypervisorAdminNegativeTestJSON-558587570-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.069333 Aug 31 16:00:59.830875 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 695/1390] 10.222.0.61 () {58 vars in 1146 bytes} [Wed Aug 31 16:00:59 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:00:59.852808 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1006f816-3f27-45a1-abd6-eff2e832a5b9 tempest-HypervisorAdminNegativeTestJSON-720812280 tempest-HypervisorAdminNegativeTestJSON-720812280-project] Calling method '.version_select at 0x7f5ae8f12dc0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:59.852808 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-1006f816-3f27-45a1-abd6-eff2e832a5b9 tempest-HypervisorAdminNegativeTestJSON-720812280 tempest-HypervisorAdminNegativeTestJSON-720812280-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '4274593f16ad4682ae2a398049137132', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08c1e46bd67c4b2fb280a840d5bfb049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:59.854525 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1006f816-3f27-45a1-abd6-eff2e832a5b9 tempest-HypervisorAdminNegativeTestJSON-720812280 tempest-HypervisorAdminNegativeTestJSON-720812280-project] Request method failure captured: Aug 31 16:00:59.854525 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Aug 31 16:00:59.854525 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:00:59.854525 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:00:59.854525 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:00:59.854525 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:00:59.854525 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:00:59.854525 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:00:59.854525 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:00:59.854525 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:00:59.854525 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4W4Bsi5O8F6trcHm1A805_JT_ZFgJpqFCMOeeYXjpTLMsaMT8KdPwP5opctUolXHzdbURORjEhE6wEbP2eJvpAlq8UgVN1Vq8ae5F6Jyg6ufg8j6Tck_sRWe8RlPsshL_dgEzHsGoFBfi4R6212k2cujPOo-UeIRv7EXMFz-ueZX4Q Aug 31 16:00:59.854525 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:00:59.854525 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:00:59.854525 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:00:59.854525 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:00:59.854525 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:00:59.854525 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:00:59.854525 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 08c1e46bd67c4b2fb280a840d5bfb049 Aug 31 16:00:59.854525 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-720812280 Aug 31 16:00:59.854525 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:00:59.854525 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:00:59.856113 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/08c1e46bd67c4b2fb280a840d5bfb049"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/08c1e46bd67c4b2fb280a840d5bfb049"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_08c1e46bd67c4b2fb280a840d5bfb049", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/08c1e46bd67c4b2fb280a840d5bfb049"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:00:59.856113 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-720812280 Aug 31 16:00:59.856113 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 08c1e46bd67c4b2fb280a840d5bfb049 Aug 31 16:00:59.856113 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-720812280 Aug 31 16:00:59.856113 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-HypervisorAdminNegativeTestJSON-720812280-project Aug 31 16:00:59.856113 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:00:59.856113 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:00:59.856113 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 4274593f16ad4682ae2a398049137132 Aug 31 16:00:59.856113 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-720812280-project Aug 31 16:00:59.856113 n-d-850499-9 devstack@n-api.service[122257]: method: Aug 31 16:00:59.856113 n-d-850499-9 devstack@n-api.service[122257]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 31 16:00:59.856113 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '1'} Aug 31 16:00:59.856113 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:00:59.857097 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:59.857097 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:59.857097 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:59.857097 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:00:59.857097 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:00:59.857097 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:00:59.857097 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:00:59.857097 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:00:59.857097 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:00:59.857097 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Aug 31 16:00:59.857097 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 31 16:00:59.857097 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Aug 31 16:00:59.857097 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Aug 31 16:00:59.857097 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 31 16:00:59.857097 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 31 16:00:59.857097 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 31 16:00:59.857097 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 31 16:00:59.857097 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 16:00:59.857097 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 31 16:00:59.858452 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 16:00:59.858452 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise self.value Aug 31 16:00:59.858452 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 31 16:00:59.858452 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 31 16:00:59.858452 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 31 16:00:59.858452 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 31 16:00:59.858452 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 31 16:00:59.858452 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 31 16:00:59.858452 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 31 16:00:59.858452 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:00:59.858452 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:59.858452 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:00:59.858452 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:59.858452 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:59.858452 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:59.858452 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 31 16:00:59.858452 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 31 16:00:59.858452 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 31 16:00:59.858452 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:00:59.862613 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1006f816-3f27-45a1-abd6-eff2e832a5b9 tempest-HypervisorAdminNegativeTestJSON-720812280 tempest-HypervisorAdminNegativeTestJSON-720812280-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:00:59.866156 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1006f816-3f27-45a1-abd6-eff2e832a5b9 tempest-HypervisorAdminNegativeTestJSON-720812280 tempest-HypervisorAdminNegativeTestJSON-720812280-project] 10.222.0.61 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.022513 Aug 31 16:00:59.871359 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 696/1391] 10.222.0.61 () {58 vars in 1152 bytes} [Wed Aug 31 16:00:59 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 31 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:00:59.880592 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-db671ebc-4fab-4e5c-8355-b8fd88f3119a tempest-HypervisorAdminNegativeTestJSON-558587570 tempest-HypervisorAdminNegativeTestJSON-558587570-project-admin] Calling method '.version_select at 0x7f5ae8c9aa60>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:59.890235 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-db671ebc-4fab-4e5c-8355-b8fd88f3119a tempest-HypervisorAdminNegativeTestJSON-558587570 tempest-HypervisorAdminNegativeTestJSON-558587570-project-admin] HTTP exception thrown: Hypervisor with ID '9c04d684-de76-49b4-98bf-8bb44ea8d3cb' could not be found. Aug 31 16:00:59.893111 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-db671ebc-4fab-4e5c-8355-b8fd88f3119a tempest-HypervisorAdminNegativeTestJSON-558587570 tempest-HypervisorAdminNegativeTestJSON-558587570-project-admin] Request method failure captured: Aug 31 16:00:59.893111 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/os-hypervisors/9c04d684-de76-49b4-98bf-8bb44ea8d3cb HTTP/1.1 Aug 31 16:00:59.893111 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:00:59.893111 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:00:59.893111 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:00:59.893111 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:00:59.893111 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:00:59.893111 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:00:59.893111 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:00:59.893111 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:00:59.893111 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4W6uVm5bokg0Pgxslzw9nm2DdHVAZkqivErmqn-W0jJGe8coOrFF3FgXl-EkuPFBI30VQxj-_0o2RQ678lpwbpJu0mhBd1xZH7CiXbC5824ZozGSDaJclkP0YHij1xnpMImrX59OXXS2alq-jUZSlmRJdoNaLE0fBmdrQtZfmqEUZY Aug 31 16:00:59.893111 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:00:59.893111 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:00:59.893111 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:00:59.893111 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:00:59.893111 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:00:59.893111 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:00:59.893111 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 5f7e69dc62444a979184519e58857597 Aug 31 16:00:59.893111 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-558587570 Aug 31 16:00:59.893111 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,admin,member Aug 31 16:00:59.893111 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,admin,member Aug 31 16:00:59.894775 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5f7e69dc62444a979184519e58857597"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5f7e69dc62444a979184519e58857597"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5f7e69dc62444a979184519e58857597", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5f7e69dc62444a979184519e58857597"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:00:59.894775 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-558587570 Aug 31 16:00:59.894775 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 5f7e69dc62444a979184519e58857597 Aug 31 16:00:59.894775 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-558587570 Aug 31 16:00:59.894775 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-HypervisorAdminNegativeTestJSON-558587570-project-admin Aug 31 16:00:59.894775 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:00:59.894775 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:00:59.894775 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 917a30f51d1e494a84325002e60278e7 Aug 31 16:00:59.894775 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-558587570-project-admin Aug 31 16:00:59.894775 n-d-850499-9 devstack@n-api.service[122257]: method: Aug 31 16:00:59.894775 n-d-850499-9 devstack@n-api.service[122257]: exception: Hypervisor with ID '9c04d684-de76-49b4-98bf-8bb44ea8d3cb' could not be found. Aug 31 16:00:59.894775 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '9c04d684-de76-49b4-98bf-8bb44ea8d3cb'} Aug 31 16:00:59.895544 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:00:59.895544 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:59.895544 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Aug 31 16:00:59.895544 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi value = int(str(value)) Aug 31 16:00:59.895544 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '9c04d684-de76-49b4-98bf-8bb44ea8d3cb' Aug 31 16:00:59.895544 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:00:59.895544 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:59.895544 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:00:59.895544 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:59.895544 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Aug 31 16:00:59.895544 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Aug 31 16:00:59.895544 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Aug 31 16:00:59.895544 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Aug 31 16:00:59.895544 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Aug 31 16:00:59.895544 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:00:59.895544 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:59.895544 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:00:59.895544 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:59.895544 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Aug 31 16:00:59.895544 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Aug 31 16:00:59.895544 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Aug 31 16:00:59.895544 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Aug 31 16:00:59.896838 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Aug 31 16:00:59.896838 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:00:59.896838 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:59.896838 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:00:59.896838 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:59.896838 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:59.896838 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:59.896838 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:00:59.896838 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:00:59.896838 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:00:59.896838 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:00:59.896838 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:00:59.896838 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:00:59.896838 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Aug 31 16:00:59.896838 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 31 16:00:59.896838 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Aug 31 16:00:59.896838 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Aug 31 16:00:59.896838 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Aug 31 16:00:59.896838 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 31 16:00:59.896838 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '9c04d684-de76-49b4-98bf-8bb44ea8d3cb' could not be found. Aug 31 16:00:59.898510 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:00:59.898510 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:59.898510 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:00:59.898510 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:59.898510 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:59.898510 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:59.898510 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:00:59.898510 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:00:59.898510 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '9c04d684-de76-49b4-98bf-8bb44ea8d3cb' could not be found. Aug 31 16:00:59.898510 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:00:59.898510 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-db671ebc-4fab-4e5c-8355-b8fd88f3119a tempest-HypervisorAdminNegativeTestJSON-558587570 tempest-HypervisorAdminNegativeTestJSON-558587570-project-admin] Returning 404 to user: Hypervisor with ID '9c04d684-de76-49b4-98bf-8bb44ea8d3cb' could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:00:59.898510 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-db671ebc-4fab-4e5c-8355-b8fd88f3119a tempest-HypervisorAdminNegativeTestJSON-558587570 tempest-HypervisorAdminNegativeTestJSON-558587570-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hypervisors/9c04d684-de76-49b4-98bf-8bb44ea8d3cb" status: 404 len: 123 microversion: 2.1 time: 0.022386 Aug 31 16:00:59.903115 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 697/1392] 10.222.0.61 () {58 vars in 1257 bytes} [Wed Aug 31 16:00:59 2022] GET /compute/v2.1/os-hypervisors/9c04d684-de76-49b4-98bf-8bb44ea8d3cb => generated 123 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:01:00.168457 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3bed8d34-4953-4f28-9836-4ce8a63ad703 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:00.183087 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3bed8d34-4953-4f28-9836-4ce8a63ad703 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] [instance: b82bda5d-2f6d-41e2-b9a4-180ba1d05652] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:00.222004 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3bed8d34-4953-4f28-9836-4ce8a63ad703 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:00.231556 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3bed8d34-4953-4f28-9836-4ce8a63ad703 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:00.232158 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3bed8d34-4953-4f28-9836-4ce8a63ad703 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:00.232940 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3bed8d34-4953-4f28-9836-4ce8a63ad703 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:00.239782 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3bed8d34-4953-4f28-9836-4ce8a63ad703 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:00.240422 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3bed8d34-4953-4f28-9836-4ce8a63ad703 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:00.634806 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3bed8d34-4953-4f28-9836-4ce8a63ad703 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6382b576b5404eb90214c00b62299b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7fb4ddb0e649edbe96d046cde6b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:00.649265 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3bed8d34-4953-4f28-9836-4ce8a63ad703 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] 10.222.0.61 "GET /compute/v2.1/servers/b82bda5d-2f6d-41e2-b9a4-180ba1d05652" status: 200 len: 1282 microversion: 2.1 time: 0.497494 Aug 31 16:01:00.660384 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 698/1393] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:00 2022] GET /compute/v2.1/servers/b82bda5d-2f6d-41e2-b9a4-180ba1d05652 => generated 1282 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:00.723206 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-889e0165-a927-4efd-a736-6efb7c5f3942 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:00.723860 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-889e0165-a927-4efd-a736-6efb7c5f3942 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:00.746777 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-889e0165-a927-4efd-a736-6efb7c5f3942 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:00.747277 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-889e0165-a927-4efd-a736-6efb7c5f3942 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:00.747742 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-889e0165-a927-4efd-a736-6efb7c5f3942 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:00.748465 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-889e0165-a927-4efd-a736-6efb7c5f3942 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:00.748922 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-889e0165-a927-4efd-a736-6efb7c5f3942 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:00.749352 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-889e0165-a927-4efd-a736-6efb7c5f3942 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:02.148129 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-889e0165-a927-4efd-a736-6efb7c5f3942 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:02.165339 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-889e0165-a927-4efd-a736-6efb7c5f3942 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:02.174678 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-889e0165-a927-4efd-a736-6efb7c5f3942 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:02.185218 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-889e0165-a927-4efd-a736-6efb7c5f3942 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1546 microversion: 2.91 time: 1.476255 Aug 31 16:01:02.194672 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 699/1394] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:01:00 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1546 bytes in 1486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:01:02.222689 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1e96daca-eca9-45a8-b31c-846031ee48f4 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:02.224204 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1e96daca-eca9-45a8-b31c-846031ee48f4 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] [instance: b82bda5d-2f6d-41e2-b9a4-180ba1d05652] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:02.236504 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1e96daca-eca9-45a8-b31c-846031ee48f4 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:02.237086 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1e96daca-eca9-45a8-b31c-846031ee48f4 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:02.237526 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1e96daca-eca9-45a8-b31c-846031ee48f4 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:02.238257 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1e96daca-eca9-45a8-b31c-846031ee48f4 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:02.238718 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1e96daca-eca9-45a8-b31c-846031ee48f4 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:02.239214 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1e96daca-eca9-45a8-b31c-846031ee48f4 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:03.142613 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-1e96daca-eca9-45a8-b31c-846031ee48f4 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6382b576b5404eb90214c00b62299b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7fb4ddb0e649edbe96d046cde6b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:03.178487 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1e96daca-eca9-45a8-b31c-846031ee48f4 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] 10.222.0.61 "GET /compute/v2.1/servers/b82bda5d-2f6d-41e2-b9a4-180ba1d05652" status: 200 len: 1280 microversion: 2.1 time: 0.981880 Aug 31 16:01:03.208065 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 700/1395] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:02 2022] GET /compute/v2.1/servers/b82bda5d-2f6d-41e2-b9a4-180ba1d05652 => generated 1280 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:03.262056 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-db0f2b4f-54d2-41a7-bb6a-0a87d5e585cf tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:03.265286 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-db0f2b4f-54d2-41a7-bb6a-0a87d5e585cf tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:03.294313 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-db0f2b4f-54d2-41a7-bb6a-0a87d5e585cf tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:03.298072 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-db0f2b4f-54d2-41a7-bb6a-0a87d5e585cf tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:03.298893 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-db0f2b4f-54d2-41a7-bb6a-0a87d5e585cf tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:03.300754 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-db0f2b4f-54d2-41a7-bb6a-0a87d5e585cf tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:03.304212 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-db0f2b4f-54d2-41a7-bb6a-0a87d5e585cf tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:03.308274 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-db0f2b4f-54d2-41a7-bb6a-0a87d5e585cf tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:03.822296 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-db0f2b4f-54d2-41a7-bb6a-0a87d5e585cf tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:03.839689 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-db0f2b4f-54d2-41a7-bb6a-0a87d5e585cf tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:03.845383 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-db0f2b4f-54d2-41a7-bb6a-0a87d5e585cf tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:03.860686 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-db0f2b4f-54d2-41a7-bb6a-0a87d5e585cf tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1546 microversion: 2.91 time: 0.628021 Aug 31 16:01:03.879926 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 701/1396] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:01:03 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1546 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:01:04.225214 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1b5e3da5-4712-4b87-b831-b61f4c4933c7 tempest-AZV2TestJSON-587263565 tempest-AZV2TestJSON-587263565-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:04.227120 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1b5e3da5-4712-4b87-b831-b61f4c4933c7 tempest-AZV2TestJSON-587263565 tempest-AZV2TestJSON-587263565-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:04.227840 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1b5e3da5-4712-4b87-b831-b61f4c4933c7 tempest-AZV2TestJSON-587263565 tempest-AZV2TestJSON-587263565-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:04.228566 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1b5e3da5-4712-4b87-b831-b61f4c4933c7 tempest-AZV2TestJSON-587263565 tempest-AZV2TestJSON-587263565-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:04.230338 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1b5e3da5-4712-4b87-b831-b61f4c4933c7 tempest-AZV2TestJSON-587263565 tempest-AZV2TestJSON-587263565-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:04.232327 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1b5e3da5-4712-4b87-b831-b61f4c4933c7 tempest-AZV2TestJSON-587263565 tempest-AZV2TestJSON-587263565-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:04.234660 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1b5e3da5-4712-4b87-b831-b61f4c4933c7 tempest-AZV2TestJSON-587263565 tempest-AZV2TestJSON-587263565-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:04.322524 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1b5e3da5-4712-4b87-b831-b61f4c4933c7 tempest-AZV2TestJSON-587263565 tempest-AZV2TestJSON-587263565-project] 10.222.0.61 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.439266 Aug 31 16:01:04.338653 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 702/1397] 10.222.0.61 () {58 vars in 1164 bytes} [Wed Aug 31 16:01:03 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 16:01:04.344734 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-91f93a25-0190-4e6e-bf99-5e9994d86e1a tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:04.345617 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-91f93a25-0190-4e6e-bf99-5e9994d86e1a tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] [instance: b82bda5d-2f6d-41e2-b9a4-180ba1d05652] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:04.353737 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-91f93a25-0190-4e6e-bf99-5e9994d86e1a tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:04.354822 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-91f93a25-0190-4e6e-bf99-5e9994d86e1a tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:04.355792 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-91f93a25-0190-4e6e-bf99-5e9994d86e1a tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:04.356989 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-91f93a25-0190-4e6e-bf99-5e9994d86e1a tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:04.357979 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-91f93a25-0190-4e6e-bf99-5e9994d86e1a tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:04.359235 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-91f93a25-0190-4e6e-bf99-5e9994d86e1a tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:05.366268 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-91f93a25-0190-4e6e-bf99-5e9994d86e1a tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6382b576b5404eb90214c00b62299b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7fb4ddb0e649edbe96d046cde6b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:05.411180 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-91f93a25-0190-4e6e-bf99-5e9994d86e1a tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] 10.222.0.61 "GET /compute/v2.1/servers/b82bda5d-2f6d-41e2-b9a4-180ba1d05652" status: 200 len: 1322 microversion: 2.1 time: 1.070691 Aug 31 16:01:05.411894 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 703/1398] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:04 2022] GET /compute/v2.1/servers/b82bda5d-2f6d-41e2-b9a4-180ba1d05652 => generated 1322 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:05.417444 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e425f75a-9a6b-4735-afc0-63bb8c7cdc1a tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:05.418406 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e425f75a-9a6b-4735-afc0-63bb8c7cdc1a tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:05.426081 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e425f75a-9a6b-4735-afc0-63bb8c7cdc1a tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:05.426468 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e425f75a-9a6b-4735-afc0-63bb8c7cdc1a tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:05.427206 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e425f75a-9a6b-4735-afc0-63bb8c7cdc1a tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:05.427958 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e425f75a-9a6b-4735-afc0-63bb8c7cdc1a tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:05.428573 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e425f75a-9a6b-4735-afc0-63bb8c7cdc1a tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:05.429176 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e425f75a-9a6b-4735-afc0-63bb8c7cdc1a tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:05.666888 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e425f75a-9a6b-4735-afc0-63bb8c7cdc1a tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:05.685080 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e425f75a-9a6b-4735-afc0-63bb8c7cdc1a tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:05.689255 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e425f75a-9a6b-4735-afc0-63bb8c7cdc1a tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:05.719864 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e425f75a-9a6b-4735-afc0-63bb8c7cdc1a tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1546 microversion: 2.91 time: 0.302994 Aug 31 16:01:05.722279 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 704/1399] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:01:05 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1546 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:01:06.482146 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1da46f49-bd4e-457b-97b2-0c4ff1ef0b09 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:06.517266 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1da46f49-bd4e-457b-97b2-0c4ff1ef0b09 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] [instance: b82bda5d-2f6d-41e2-b9a4-180ba1d05652] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:06.557069 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1da46f49-bd4e-457b-97b2-0c4ff1ef0b09 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:06.557578 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1da46f49-bd4e-457b-97b2-0c4ff1ef0b09 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:06.559676 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1da46f49-bd4e-457b-97b2-0c4ff1ef0b09 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:06.561768 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1da46f49-bd4e-457b-97b2-0c4ff1ef0b09 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:06.562286 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1da46f49-bd4e-457b-97b2-0c4ff1ef0b09 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:06.562735 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1da46f49-bd4e-457b-97b2-0c4ff1ef0b09 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:06.775745 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=64 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:01:07.096446 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-1da46f49-bd4e-457b-97b2-0c4ff1ef0b09 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6382b576b5404eb90214c00b62299b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7fb4ddb0e649edbe96d046cde6b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:07.108599 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1da46f49-bd4e-457b-97b2-0c4ff1ef0b09 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] 10.222.0.61 "GET /compute/v2.1/servers/b82bda5d-2f6d-41e2-b9a4-180ba1d05652" status: 200 len: 1322 microversion: 2.1 time: 0.668267 Aug 31 16:01:07.109210 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 705/1400] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:06 2022] GET /compute/v2.1/servers/b82bda5d-2f6d-41e2-b9a4-180ba1d05652 => generated 1322 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:07.177183 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b9d553df-acf4-4534-b886-559785404737 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:07.179236 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b9d553df-acf4-4534-b886-559785404737 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:07.201343 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b9d553df-acf4-4534-b886-559785404737 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:07.203358 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b9d553df-acf4-4534-b886-559785404737 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:07.206526 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b9d553df-acf4-4534-b886-559785404737 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:07.208653 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b9d553df-acf4-4534-b886-559785404737 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:07.210443 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b9d553df-acf4-4534-b886-559785404737 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:07.215425 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b9d553df-acf4-4534-b886-559785404737 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:07.523406 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=6 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:01:07.664956 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b9d553df-acf4-4534-b886-559785404737 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:07.683743 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=53,nova_api:DELETE=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:01:07.711618 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b9d553df-acf4-4534-b886-559785404737 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:07.724364 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b9d553df-acf4-4534-b886-559785404737 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:07.744143 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b9d553df-acf4-4534-b886-559785404737 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1546 microversion: 2.91 time: 0.603437 Aug 31 16:01:07.747217 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 706/1401] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:01:07 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1546 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:01:07.856151 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-06dd731a-f467-4a6d-8942-df55b1a4d2e0 req-21310926-69f7-4a02-80cf-e63d808bf662 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b82bda5d-2f6d-41e2-b9a4-180ba1d05652", "tag": "eed0bb35-bf3a-4d7f-a9f5-6c29c4e94d6a"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:01:07.862716 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:01:07.873223 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-06dd731a-f467-4a6d-8942-df55b1a4d2e0 req-21310926-69f7-4a02-80cf-e63d808bf662 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:07.874374 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-06dd731a-f467-4a6d-8942-df55b1a4d2e0 req-21310926-69f7-4a02-80cf-e63d808bf662 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:07.875104 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-06dd731a-f467-4a6d-8942-df55b1a4d2e0 req-21310926-69f7-4a02-80cf-e63d808bf662 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:07.913695 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-06dd731a-f467-4a6d-8942-df55b1a4d2e0 req-21310926-69f7-4a02-80cf-e63d808bf662 service nova] Creating event network-changed:eed0bb35-bf3a-4d7f-a9f5-6c29c4e94d6a for instance b82bda5d-2f6d-41e2-b9a4-180ba1d05652 on n-h1-850499-9 Aug 31 16:01:07.921052 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-06dd731a-f467-4a6d-8942-df55b1a4d2e0 req-21310926-69f7-4a02-80cf-e63d808bf662 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068851 Aug 31 16:01:07.922302 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 707/1402] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:01:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:01:07.980812 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4d2fca36-adaf-451e-9c20-8886f39da642 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/images/91f26408-c009-455c-b26c-f5cfe4ba8d54" status: 200 len: 1423 microversion: 2.1 time: 8.766430 Aug 31 16:01:07.983145 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 696/1403] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:00:59 2022] GET /compute/v2.1/images/91f26408-c009-455c-b26c-f5cfe4ba8d54 => generated 1423 bytes in 8769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:01:07.997019 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-dc233f84-94bb-4c19-90f1-b10590a9976f tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '.version_select at 0x7f5ae8c9a5e0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:08.077641 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-dc233f84-94bb-4c19-90f1-b10590a9976f tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/images/91f26408-c009-455c-b26c-f5cfe4ba8d54" status: 200 len: 1423 microversion: 2.1 time: 0.085577 Aug 31 16:01:08.078656 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 708/1404] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:01:07 2022] GET /compute/v2.1/images/91f26408-c009-455c-b26c-f5cfe4ba8d54 => generated 1423 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:08.095042 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f2618a88-1cc2-4f34-bbad-0637f728ce20 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '.version_select at 0x7f5ae8fea8b0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:08.131419 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a17fe9f3-5e4e-4409-96e9-7a8ce8520040 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:08.132371 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a17fe9f3-5e4e-4409-96e9-7a8ce8520040 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] [instance: b82bda5d-2f6d-41e2-b9a4-180ba1d05652] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:08.147267 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a17fe9f3-5e4e-4409-96e9-7a8ce8520040 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:08.152421 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a17fe9f3-5e4e-4409-96e9-7a8ce8520040 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:08.153772 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a17fe9f3-5e4e-4409-96e9-7a8ce8520040 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:08.154789 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a17fe9f3-5e4e-4409-96e9-7a8ce8520040 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:08.155519 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a17fe9f3-5e4e-4409-96e9-7a8ce8520040 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:08.156839 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a17fe9f3-5e4e-4409-96e9-7a8ce8520040 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:08.845094 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a17fe9f3-5e4e-4409-96e9-7a8ce8520040 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6382b576b5404eb90214c00b62299b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7fb4ddb0e649edbe96d046cde6b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:08.857336 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a17fe9f3-5e4e-4409-96e9-7a8ce8520040 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] 10.222.0.61 "GET /compute/v2.1/servers/b82bda5d-2f6d-41e2-b9a4-180ba1d05652" status: 200 len: 1322 microversion: 2.1 time: 0.730468 Aug 31 16:01:08.857939 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 709/1405] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:08 2022] GET /compute/v2.1/servers/b82bda5d-2f6d-41e2-b9a4-180ba1d05652 => generated 1322 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:08.878100 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3f505687-1cb2-487b-81bc-393edae8da1d tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:08.879668 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3f505687-1cb2-487b-81bc-393edae8da1d tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:08.900697 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3f505687-1cb2-487b-81bc-393edae8da1d tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:08.901996 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3f505687-1cb2-487b-81bc-393edae8da1d tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:08.904505 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3f505687-1cb2-487b-81bc-393edae8da1d tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:08.905507 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3f505687-1cb2-487b-81bc-393edae8da1d tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:08.908174 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3f505687-1cb2-487b-81bc-393edae8da1d tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:08.909960 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3f505687-1cb2-487b-81bc-393edae8da1d tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:09.052572 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3f505687-1cb2-487b-81bc-393edae8da1d tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:09.086600 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3f505687-1cb2-487b-81bc-393edae8da1d tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:09.088381 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3f505687-1cb2-487b-81bc-393edae8da1d tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:09.122516 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3f505687-1cb2-487b-81bc-393edae8da1d tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1546 microversion: 2.91 time: 0.258876 Aug 31 16:01:09.124009 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 710/1406] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:01:08 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1546 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:01:09.961423 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f2618a88-1cc2-4f34-bbad-0637f728ce20 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "DELETE /compute/v2.1/images/91f26408-c009-455c-b26c-f5cfe4ba8d54" status: 204 len: 0 microversion: 2.1 time: 1.870683 Aug 31 16:01:09.961423 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 697/1407] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:08 2022] DELETE /compute/v2.1/images/91f26408-c009-455c-b26c-f5cfe4ba8d54 => generated 0 bytes in 1873 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:01:09.965981 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-683879a1-d56e-4d86-8f56-32fa02318e36 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:09.966558 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-683879a1-d56e-4d86-8f56-32fa02318e36 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] [instance: b82bda5d-2f6d-41e2-b9a4-180ba1d05652] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:09.973851 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-683879a1-d56e-4d86-8f56-32fa02318e36 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:09.974938 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-683879a1-d56e-4d86-8f56-32fa02318e36 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:09.975584 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-683879a1-d56e-4d86-8f56-32fa02318e36 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:09.976476 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-683879a1-d56e-4d86-8f56-32fa02318e36 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:09.977098 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-683879a1-d56e-4d86-8f56-32fa02318e36 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:09.986434 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-29485c20-d6d4-4aec-bf96-137418595768 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1206473152", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:01:09.993201 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-683879a1-d56e-4d86-8f56-32fa02318e36 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:10.099973 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-29485c20-d6d4-4aec-bf96-137418595768 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] validate_networks() for None {{(pid=122257) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:01:10.257871 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-683879a1-d56e-4d86-8f56-32fa02318e36 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6382b576b5404eb90214c00b62299b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7fb4ddb0e649edbe96d046cde6b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:10.271716 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-683879a1-d56e-4d86-8f56-32fa02318e36 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] 10.222.0.61 "GET /compute/v2.1/servers/b82bda5d-2f6d-41e2-b9a4-180ba1d05652" status: 200 len: 1322 microversion: 2.1 time: 0.309863 Aug 31 16:01:10.273055 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 698/1408] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:09 2022] GET /compute/v2.1/servers/b82bda5d-2f6d-41e2-b9a4-180ba1d05652 => generated 1322 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:10.279534 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ac57c604-4ec6-4301-8f9d-c89cc54a0d61 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:10.280365 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ac57c604-4ec6-4301-8f9d-c89cc54a0d61 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: 5f29cff7-a675-40c2-a0e5-2a62994be45a] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:10.291491 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ac57c604-4ec6-4301-8f9d-c89cc54a0d61 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:10.292430 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ac57c604-4ec6-4301-8f9d-c89cc54a0d61 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:10.294170 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ac57c604-4ec6-4301-8f9d-c89cc54a0d61 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:10.297307 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ac57c604-4ec6-4301-8f9d-c89cc54a0d61 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:10.298221 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ac57c604-4ec6-4301-8f9d-c89cc54a0d61 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:10.298929 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ac57c604-4ec6-4301-8f9d-c89cc54a0d61 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:10.340651 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ac57c604-4ec6-4301-8f9d-c89cc54a0d61 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: 5f29cff7-a675-40c2-a0e5-2a62994be45a] Going to try to terminate instance {{(pid=122256) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:01:10.437066 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-29485c20-d6d4-4aec-bf96-137418595768 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:01:10.437930 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-29485c20-d6d4-4aec-bf96-137418595768 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:01:10.438693 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-29485c20-d6d4-4aec-bf96-137418595768 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:01:10.439362 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-29485c20-d6d4-4aec-bf96-137418595768 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:01:10.440953 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-29485c20-d6d4-4aec-bf96-137418595768 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:01:10.452996 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-29485c20-d6d4-4aec-bf96-137418595768 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:10.454016 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-29485c20-d6d4-4aec-bf96-137418595768 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:10.454744 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-29485c20-d6d4-4aec-bf96-137418595768 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:10.456023 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-29485c20-d6d4-4aec-bf96-137418595768 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:10.456657 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-29485c20-d6d4-4aec-bf96-137418595768 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:10.457355 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-29485c20-d6d4-4aec-bf96-137418595768 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:10.507012 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-29485c20-d6d4-4aec-bf96-137418595768 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Getting quotas for project 55ea476c41904e458bae79e7dad5d654. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:01:10.511455 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ac57c604-4ec6-4301-8f9d-c89cc54a0d61 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "DELETE /compute/v2.1/servers/5f29cff7-a675-40c2-a0e5-2a62994be45a" status: 204 len: 0 microversion: 2.1 time: 0.236822 Aug 31 16:01:10.512176 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 699/1409] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:01:10 2022] DELETE /compute/v2.1/servers/5f29cff7-a675-40c2-a0e5-2a62994be45a => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:01:10.519578 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e227e65b-5813-46f5-95fc-f1bb98022f55 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:10.520324 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e227e65b-5813-46f5-95fc-f1bb98022f55 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:10.521677 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-29485c20-d6d4-4aec-bf96-137418595768 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Getting quotas for user 0a552442b7e94406b1689baf7a23fa52 and project 55ea476c41904e458bae79e7dad5d654. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:01:10.558392 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e227e65b-5813-46f5-95fc-f1bb98022f55 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:10.559542 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e227e65b-5813-46f5-95fc-f1bb98022f55 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:10.560288 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e227e65b-5813-46f5-95fc-f1bb98022f55 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:10.561478 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e227e65b-5813-46f5-95fc-f1bb98022f55 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:10.562282 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e227e65b-5813-46f5-95fc-f1bb98022f55 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:10.563021 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e227e65b-5813-46f5-95fc-f1bb98022f55 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:10.567449 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-29485c20-d6d4-4aec-bf96-137418595768 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Going to run 1 instances... {{(pid=122257) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:01:10.572455 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-29485c20-d6d4-4aec-bf96-137418595768 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6c7489e2-1ba0-4689-b2d7-e37886757266] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:01:10.758864 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-29485c20-d6d4-4aec-bf96-137418595768 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.497699 Aug 31 16:01:10.760010 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 711/1410] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:01:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1500 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:01:10.764962 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e10c3724-3f92-4821-a6e0-7581a09c2643 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-663413550", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "networks": [{"uuid": "1815935f-c9a0-4f0c-9c89-45f534415ab2"}]}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:01:10.853477 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e227e65b-5813-46f5-95fc-f1bb98022f55 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:10.871553 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e227e65b-5813-46f5-95fc-f1bb98022f55 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:10.875734 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e227e65b-5813-46f5-95fc-f1bb98022f55 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:10.890492 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e227e65b-5813-46f5-95fc-f1bb98022f55 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1546 microversion: 2.91 time: 0.376698 Aug 31 16:01:10.904873 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 700/1411] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:01:10 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1546 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:01:10.939321 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-28eb96d0-3577-4351-87c3-ad42938b4a8c tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:10.941645 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-28eb96d0-3577-4351-87c3-ad42938b4a8c tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6c7489e2-1ba0-4689-b2d7-e37886757266] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:10.968118 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-e10c3724-3f92-4821-a6e0-7581a09c2643 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] validate_networks() for [('1815935f-c9a0-4f0c-9c89-45f534415ab2', None, None, None, None, None)] {{(pid=122257) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:01:11.112753 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-28eb96d0-3577-4351-87c3-ad42938b4a8c tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:11.132379 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-28eb96d0-3577-4351-87c3-ad42938b4a8c tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266" status: 200 len: 1213 microversion: 2.1 time: 0.213088 Aug 31 16:01:11.133028 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 701/1412] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:10 2022] GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266 => generated 1213 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:11.306220 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-318fae77-d430-45c8-a6d0-b0a0187e28b1 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:11.307197 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-318fae77-d430-45c8-a6d0-b0a0187e28b1 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] [instance: b82bda5d-2f6d-41e2-b9a4-180ba1d05652] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:11.323022 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-318fae77-d430-45c8-a6d0-b0a0187e28b1 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:11.323539 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-318fae77-d430-45c8-a6d0-b0a0187e28b1 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:11.334570 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-318fae77-d430-45c8-a6d0-b0a0187e28b1 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:11.335656 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-318fae77-d430-45c8-a6d0-b0a0187e28b1 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:11.336147 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-318fae77-d430-45c8-a6d0-b0a0187e28b1 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:11.336780 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-318fae77-d430-45c8-a6d0-b0a0187e28b1 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:12.140385 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-318fae77-d430-45c8-a6d0-b0a0187e28b1 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6382b576b5404eb90214c00b62299b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7fb4ddb0e649edbe96d046cde6b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:12.158773 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-318fae77-d430-45c8-a6d0-b0a0187e28b1 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] 10.222.0.61 "GET /compute/v2.1/servers/b82bda5d-2f6d-41e2-b9a4-180ba1d05652" status: 200 len: 1322 microversion: 2.1 time: 0.858887 Aug 31 16:01:12.160872 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 702/1413] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:11 2022] GET /compute/v2.1/servers/b82bda5d-2f6d-41e2-b9a4-180ba1d05652 => generated 1322 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:12.167251 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-ccfeedd4-a309-4bc6-a20c-5c500ca353ba req-b2a7f8d6-1cdf-40cf-b7f6-45bb08aba654 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f29cff7-a675-40c2-a0e5-2a62994be45a", "name": "network-vif-unplugged", "status": "completed", "tag": "5aedd1b8-fd73-4d4f-8c6e-c030265971d4"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:01:12.196980 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-ccfeedd4-a309-4bc6-a20c-5c500ca353ba req-b2a7f8d6-1cdf-40cf-b7f6-45bb08aba654 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:12.198141 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-ccfeedd4-a309-4bc6-a20c-5c500ca353ba req-b2a7f8d6-1cdf-40cf-b7f6-45bb08aba654 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:12.199056 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-ccfeedd4-a309-4bc6-a20c-5c500ca353ba req-b2a7f8d6-1cdf-40cf-b7f6-45bb08aba654 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:12.225494 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-ccfeedd4-a309-4bc6-a20c-5c500ca353ba req-b2a7f8d6-1cdf-40cf-b7f6-45bb08aba654 service nova] Creating event network-vif-unplugged:5aedd1b8-fd73-4d4f-8c6e-c030265971d4 for instance 5f29cff7-a675-40c2-a0e5-2a62994be45a on n-h1-850499-9 Aug 31 16:01:12.234770 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-ccfeedd4-a309-4bc6-a20c-5c500ca353ba req-b2a7f8d6-1cdf-40cf-b7f6-45bb08aba654 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071580 Aug 31 16:01:12.237767 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 703/1414] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:01:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:01:12.247835 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-19189136-ba72-4c4e-8d60-19cbecfac441 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:12.250132 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-19189136-ba72-4c4e-8d60-19cbecfac441 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:12.259077 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-19189136-ba72-4c4e-8d60-19cbecfac441 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:12.260105 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-19189136-ba72-4c4e-8d60-19cbecfac441 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:12.260804 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-19189136-ba72-4c4e-8d60-19cbecfac441 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:12.261945 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-19189136-ba72-4c4e-8d60-19cbecfac441 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:12.266452 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-19189136-ba72-4c4e-8d60-19cbecfac441 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:12.266816 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-19189136-ba72-4c4e-8d60-19cbecfac441 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:12.478813 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-19189136-ba72-4c4e-8d60-19cbecfac441 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:12.501653 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-19189136-ba72-4c4e-8d60-19cbecfac441 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:12.507336 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-19189136-ba72-4c4e-8d60-19cbecfac441 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:12.518495 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-19189136-ba72-4c4e-8d60-19cbecfac441 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1546 microversion: 2.91 time: 0.277752 Aug 31 16:01:12.522070 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 704/1415] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:01:12 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1546 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:01:12.537307 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1c825692-efce-4740-a96e-74b1bf5bed8e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:12.538274 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1c825692-efce-4740-a96e-74b1bf5bed8e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6c7489e2-1ba0-4689-b2d7-e37886757266] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:12.549794 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1c825692-efce-4740-a96e-74b1bf5bed8e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:12.550748 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1c825692-efce-4740-a96e-74b1bf5bed8e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:12.556157 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1c825692-efce-4740-a96e-74b1bf5bed8e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:12.557349 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1c825692-efce-4740-a96e-74b1bf5bed8e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:12.558773 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1c825692-efce-4740-a96e-74b1bf5bed8e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:12.559392 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1c825692-efce-4740-a96e-74b1bf5bed8e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:12.623127 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-e10c3724-3f92-4821-a6e0-7581a09c2643 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:01:12.623719 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-e10c3724-3f92-4821-a6e0-7581a09c2643 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:01:12.624070 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-e10c3724-3f92-4821-a6e0-7581a09c2643 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:01:12.624489 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-e10c3724-3f92-4821-a6e0-7581a09c2643 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:01:12.624905 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-e10c3724-3f92-4821-a6e0-7581a09c2643 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:01:12.660716 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e10c3724-3f92-4821-a6e0-7581a09c2643 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:12.664888 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e10c3724-3f92-4821-a6e0-7581a09c2643 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:12.665152 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e10c3724-3f92-4821-a6e0-7581a09c2643 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:12.667830 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e10c3724-3f92-4821-a6e0-7581a09c2643 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:12.667830 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e10c3724-3f92-4821-a6e0-7581a09c2643 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:12.668188 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e10c3724-3f92-4821-a6e0-7581a09c2643 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:12.697868 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1c825692-efce-4740-a96e-74b1bf5bed8e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:12.727398 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1c825692-efce-4740-a96e-74b1bf5bed8e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266" status: 200 len: 1217 microversion: 2.1 time: 0.201576 Aug 31 16:01:12.728049 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 705/1416] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:12 2022] GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266 => generated 1217 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:12.736058 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=9 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:01:12.777088 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-e10c3724-3f92-4821-a6e0-7581a09c2643 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Getting quotas for project 61a9f3fcc4b445349e5c66ff712e8598. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:01:12.795897 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-e10c3724-3f92-4821-a6e0-7581a09c2643 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Getting quotas for user f1ccd03a4aa84f93bc26b438e1468f46 and project 61a9f3fcc4b445349e5c66ff712e8598. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:01:12.848576 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:01:12.854119 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e10c3724-3f92-4821-a6e0-7581a09c2643 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Going to run 1 instances... {{(pid=122257) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:01:12.861380 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e10c3724-3f92-4821-a6e0-7581a09c2643 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: 3f785545-d532-4487-b780-8a9be107a209] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:01:13.033696 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e10c3724-3f92-4821-a6e0-7581a09c2643 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.272321 Aug 31 16:01:13.035046 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 712/1417] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:01:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 2274 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:01:13.055111 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0c2f88a0-aafa-4f66-ad2a-662fd7027f70 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:13.055897 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0c2f88a0-aafa-4f66-ad2a-662fd7027f70 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: 3f785545-d532-4487-b780-8a9be107a209] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:13.188381 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1db8924d-ad1e-43de-9608-5edfdeb84ddb tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:13.189152 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1db8924d-ad1e-43de-9608-5edfdeb84ddb tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] [instance: b82bda5d-2f6d-41e2-b9a4-180ba1d05652] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:13.212454 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1db8924d-ad1e-43de-9608-5edfdeb84ddb tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:13.213300 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1db8924d-ad1e-43de-9608-5edfdeb84ddb tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:13.214956 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1db8924d-ad1e-43de-9608-5edfdeb84ddb tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:13.218758 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1db8924d-ad1e-43de-9608-5edfdeb84ddb tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:13.219693 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1db8924d-ad1e-43de-9608-5edfdeb84ddb tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:13.220355 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1db8924d-ad1e-43de-9608-5edfdeb84ddb tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:13.356752 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-0c2f88a0-aafa-4f66-ad2a-662fd7027f70 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ccd03a4aa84f93bc26b438e1468f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a9f3fcc4b445349e5c66ff712e8598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:13.373271 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0c2f88a0-aafa-4f66-ad2a-662fd7027f70 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/servers/3f785545-d532-4487-b780-8a9be107a209" status: 200 len: 1207 microversion: 2.1 time: 0.326051 Aug 31 16:01:13.374080 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 706/1418] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:13 2022] GET /compute/v2.1/servers/3f785545-d532-4487-b780-8a9be107a209 => generated 1207 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:13.570583 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6d5b6bde-d2de-468b-834d-424d0e95d15a tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:13.571713 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6d5b6bde-d2de-468b-834d-424d0e95d15a tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:13.587235 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6d5b6bde-d2de-468b-834d-424d0e95d15a tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:13.594003 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6d5b6bde-d2de-468b-834d-424d0e95d15a tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:13.601374 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6d5b6bde-d2de-468b-834d-424d0e95d15a tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:13.604029 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6d5b6bde-d2de-468b-834d-424d0e95d15a tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:13.606270 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6d5b6bde-d2de-468b-834d-424d0e95d15a tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:13.607932 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6d5b6bde-d2de-468b-834d-424d0e95d15a tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:14.056706 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-1db8924d-ad1e-43de-9608-5edfdeb84ddb tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6382b576b5404eb90214c00b62299b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7fb4ddb0e649edbe96d046cde6b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:14.074201 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1db8924d-ad1e-43de-9608-5edfdeb84ddb tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] 10.222.0.61 "GET /compute/v2.1/servers/b82bda5d-2f6d-41e2-b9a4-180ba1d05652" status: 200 len: 1322 microversion: 2.1 time: 0.892288 Aug 31 16:01:14.076660 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 713/1419] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:13 2022] GET /compute/v2.1/servers/b82bda5d-2f6d-41e2-b9a4-180ba1d05652 => generated 1322 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:01:14.088282 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9abc86ac-60ef-4c72-b37f-cd25a5402726 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:14.094269 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9abc86ac-60ef-4c72-b37f-cd25a5402726 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6c7489e2-1ba0-4689-b2d7-e37886757266] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:14.115697 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9abc86ac-60ef-4c72-b37f-cd25a5402726 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:14.116592 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9abc86ac-60ef-4c72-b37f-cd25a5402726 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:14.117296 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9abc86ac-60ef-4c72-b37f-cd25a5402726 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:14.118279 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9abc86ac-60ef-4c72-b37f-cd25a5402726 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:14.119006 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9abc86ac-60ef-4c72-b37f-cd25a5402726 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:14.119709 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9abc86ac-60ef-4c72-b37f-cd25a5402726 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:14.170283 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-6d5b6bde-d2de-468b-834d-424d0e95d15a tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:14.189717 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-6d5b6bde-d2de-468b-834d-424d0e95d15a tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:14.192953 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-6d5b6bde-d2de-468b-834d-424d0e95d15a tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:14.235687 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6d5b6bde-d2de-468b-834d-424d0e95d15a tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1546 microversion: 2.91 time: 0.668962 Aug 31 16:01:14.236821 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 707/1420] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:01:13 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1546 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:01:14.420717 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-20e03837-08c6-48d4-bda4-d85a7c8b2d97 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:14.421700 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-20e03837-08c6-48d4-bda4-d85a7c8b2d97 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: 3f785545-d532-4487-b780-8a9be107a209] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:14.577790 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9abc86ac-60ef-4c72-b37f-cd25a5402726 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:14.588065 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9abc86ac-60ef-4c72-b37f-cd25a5402726 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266" status: 200 len: 1265 microversion: 2.1 time: 0.509397 Aug 31 16:01:14.596631 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 714/1421] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:14 2022] GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266 => generated 1265 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:14.647069 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-20e03837-08c6-48d4-bda4-d85a7c8b2d97 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ccd03a4aa84f93bc26b438e1468f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a9f3fcc4b445349e5c66ff712e8598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:14.655925 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-20e03837-08c6-48d4-bda4-d85a7c8b2d97 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/servers/3f785545-d532-4487-b780-8a9be107a209" status: 200 len: 1207 microversion: 2.1 time: 0.252010 Aug 31 16:01:14.660270 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 708/1422] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:14 2022] GET /compute/v2.1/servers/3f785545-d532-4487-b780-8a9be107a209 => generated 1207 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:15.113275 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b2a010ad-d8a5-4f60-9c50-b278c3e1d54c tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:15.117328 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b2a010ad-d8a5-4f60-9c50-b278c3e1d54c tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] [instance: b82bda5d-2f6d-41e2-b9a4-180ba1d05652] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:15.136841 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b2a010ad-d8a5-4f60-9c50-b278c3e1d54c tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:15.138989 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b2a010ad-d8a5-4f60-9c50-b278c3e1d54c tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:15.139549 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b2a010ad-d8a5-4f60-9c50-b278c3e1d54c tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:15.140313 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b2a010ad-d8a5-4f60-9c50-b278c3e1d54c tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:15.140807 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b2a010ad-d8a5-4f60-9c50-b278c3e1d54c tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:15.141229 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b2a010ad-d8a5-4f60-9c50-b278c3e1d54c tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:15.270306 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5b04be8c-a7db-43d7-836a-f06e0ce9756b tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:15.271701 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5b04be8c-a7db-43d7-836a-f06e0ce9756b tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:15.308671 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5b04be8c-a7db-43d7-836a-f06e0ce9756b tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:15.309344 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5b04be8c-a7db-43d7-836a-f06e0ce9756b tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:15.310060 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5b04be8c-a7db-43d7-836a-f06e0ce9756b tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:15.311012 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5b04be8c-a7db-43d7-836a-f06e0ce9756b tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:15.326245 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5b04be8c-a7db-43d7-836a-f06e0ce9756b tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:15.327856 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5b04be8c-a7db-43d7-836a-f06e0ce9756b tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:15.438963 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5b04be8c-a7db-43d7-836a-f06e0ce9756b tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:15.459548 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5b04be8c-a7db-43d7-836a-f06e0ce9756b tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:15.463639 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5b04be8c-a7db-43d7-836a-f06e0ce9756b tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:15.480829 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5b04be8c-a7db-43d7-836a-f06e0ce9756b tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1546 microversion: 2.91 time: 0.217939 Aug 31 16:01:15.482059 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 709/1423] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:01:15 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1546 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:01:15.504357 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b2a010ad-d8a5-4f60-9c50-b278c3e1d54c tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6382b576b5404eb90214c00b62299b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7fb4ddb0e649edbe96d046cde6b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:15.525180 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b2a010ad-d8a5-4f60-9c50-b278c3e1d54c tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] 10.222.0.61 "GET /compute/v2.1/servers/b82bda5d-2f6d-41e2-b9a4-180ba1d05652" status: 200 len: 1322 microversion: 2.1 time: 0.430733 Aug 31 16:01:15.526085 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 715/1424] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:15 2022] GET /compute/v2.1/servers/b82bda5d-2f6d-41e2-b9a4-180ba1d05652 => generated 1322 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:15.633006 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3857c04a-6063-4c78-b949-3ba29c6c3768 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:15.633921 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3857c04a-6063-4c78-b949-3ba29c6c3768 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6c7489e2-1ba0-4689-b2d7-e37886757266] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:15.655689 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3857c04a-6063-4c78-b949-3ba29c6c3768 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:15.659099 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3857c04a-6063-4c78-b949-3ba29c6c3768 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:15.660955 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3857c04a-6063-4c78-b949-3ba29c6c3768 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:15.662931 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3857c04a-6063-4c78-b949-3ba29c6c3768 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:15.666764 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3857c04a-6063-4c78-b949-3ba29c6c3768 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:15.667733 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3857c04a-6063-4c78-b949-3ba29c6c3768 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:15.684646 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-6f251198-1781-4f98-b6b4-e256d93de9e4 req-0ac9a556-c9fa-4f7e-99cb-d83dba7fbbb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f29cff7-a675-40c2-a0e5-2a62994be45a", "name": "network-vif-deleted", "tag": "5aedd1b8-fd73-4d4f-8c6e-c030265971d4"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:01:15.716594 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-6f251198-1781-4f98-b6b4-e256d93de9e4 req-0ac9a556-c9fa-4f7e-99cb-d83dba7fbbb1 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:15.718014 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-6f251198-1781-4f98-b6b4-e256d93de9e4 req-0ac9a556-c9fa-4f7e-99cb-d83dba7fbbb1 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:15.719219 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-6f251198-1781-4f98-b6b4-e256d93de9e4 req-0ac9a556-c9fa-4f7e-99cb-d83dba7fbbb1 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:15.743901 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-6f251198-1781-4f98-b6b4-e256d93de9e4 req-0ac9a556-c9fa-4f7e-99cb-d83dba7fbbb1 service nova] Creating event network-vif-deleted:5aedd1b8-fd73-4d4f-8c6e-c030265971d4 for instance 5f29cff7-a675-40c2-a0e5-2a62994be45a on n-h1-850499-9 Aug 31 16:01:15.753237 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-6f251198-1781-4f98-b6b4-e256d93de9e4 req-0ac9a556-c9fa-4f7e-99cb-d83dba7fbbb1 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.269419 Aug 31 16:01:15.759256 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 710/1425] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:01:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:01:15.766340 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-cf9669a3-4656-4dfc-9d7b-7ee108be4140 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:15.767362 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-cf9669a3-4656-4dfc-9d7b-7ee108be4140 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: 3f785545-d532-4487-b780-8a9be107a209] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:15.787735 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cf9669a3-4656-4dfc-9d7b-7ee108be4140 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:15.788309 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cf9669a3-4656-4dfc-9d7b-7ee108be4140 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:15.788779 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cf9669a3-4656-4dfc-9d7b-7ee108be4140 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:15.789532 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cf9669a3-4656-4dfc-9d7b-7ee108be4140 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:15.790180 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cf9669a3-4656-4dfc-9d7b-7ee108be4140 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:15.790580 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cf9669a3-4656-4dfc-9d7b-7ee108be4140 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:15.925077 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3857c04a-6063-4c78-b949-3ba29c6c3768 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:15.937571 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3857c04a-6063-4c78-b949-3ba29c6c3768 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266" status: 200 len: 1265 microversion: 2.1 time: 0.312135 Aug 31 16:01:15.938981 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 716/1426] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:15 2022] GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266 => generated 1265 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:16.007889 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-cf9669a3-4656-4dfc-9d7b-7ee108be4140 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ccd03a4aa84f93bc26b438e1468f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a9f3fcc4b445349e5c66ff712e8598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:16.024844 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-cf9669a3-4656-4dfc-9d7b-7ee108be4140 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/servers/3f785545-d532-4487-b780-8a9be107a209" status: 200 len: 1267 microversion: 2.1 time: 0.260191 Aug 31 16:01:16.027635 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 711/1427] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:15 2022] GET /compute/v2.1/servers/3f785545-d532-4487-b780-8a9be107a209 => generated 1267 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:16.511276 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7778f788-2068-4310-85a0-f3de19da3b04 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:16.512855 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7778f788-2068-4310-85a0-f3de19da3b04 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:16.528007 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7778f788-2068-4310-85a0-f3de19da3b04 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:16.531374 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7778f788-2068-4310-85a0-f3de19da3b04 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:16.532498 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7778f788-2068-4310-85a0-f3de19da3b04 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:16.535041 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7778f788-2068-4310-85a0-f3de19da3b04 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:16.541528 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7778f788-2068-4310-85a0-f3de19da3b04 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:16.542377 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7778f788-2068-4310-85a0-f3de19da3b04 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:16.547413 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ff0e3591-ba19-4879-9e31-9c9970da86cb tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:16.548091 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ff0e3591-ba19-4879-9e31-9c9970da86cb tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] [instance: b82bda5d-2f6d-41e2-b9a4-180ba1d05652] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:16.584636 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ff0e3591-ba19-4879-9e31-9c9970da86cb tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:16.587708 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ff0e3591-ba19-4879-9e31-9c9970da86cb tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:16.590726 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ff0e3591-ba19-4879-9e31-9c9970da86cb tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:16.608205 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ff0e3591-ba19-4879-9e31-9c9970da86cb tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:16.611231 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ff0e3591-ba19-4879-9e31-9c9970da86cb tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:16.616938 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ff0e3591-ba19-4879-9e31-9c9970da86cb tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:17.071668 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7778f788-2068-4310-85a0-f3de19da3b04 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:17.082054 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=100 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:01:17.087300 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7778f788-2068-4310-85a0-f3de19da3b04 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:17.089453 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7778f788-2068-4310-85a0-f3de19da3b04 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:17.107314 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7778f788-2068-4310-85a0-f3de19da3b04 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1546 microversion: 2.91 time: 0.600522 Aug 31 16:01:17.108742 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 717/1428] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:01:16 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1546 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:01:17.114965 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3d606680-79d1-4fc7-8588-2e2d54ceb707 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:17.115917 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3d606680-79d1-4fc7-8588-2e2d54ceb707 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6c7489e2-1ba0-4689-b2d7-e37886757266] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:17.125514 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3d606680-79d1-4fc7-8588-2e2d54ceb707 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:17.128141 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3d606680-79d1-4fc7-8588-2e2d54ceb707 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:17.129190 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3d606680-79d1-4fc7-8588-2e2d54ceb707 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:17.131348 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3d606680-79d1-4fc7-8588-2e2d54ceb707 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:17.132042 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3d606680-79d1-4fc7-8588-2e2d54ceb707 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:17.132665 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3d606680-79d1-4fc7-8588-2e2d54ceb707 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:17.243962 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3d606680-79d1-4fc7-8588-2e2d54ceb707 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:17.248570 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ff0e3591-ba19-4879-9e31-9c9970da86cb tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6382b576b5404eb90214c00b62299b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7fb4ddb0e649edbe96d046cde6b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:17.262459 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3d606680-79d1-4fc7-8588-2e2d54ceb707 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266" status: 200 len: 1265 microversion: 2.1 time: 0.151641 Aug 31 16:01:17.263424 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 718/1429] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:17 2022] GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:17.276296 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ff0e3591-ba19-4879-9e31-9c9970da86cb tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] 10.222.0.61 "GET /compute/v2.1/servers/b82bda5d-2f6d-41e2-b9a4-180ba1d05652" status: 200 len: 1322 microversion: 2.1 time: 0.720994 Aug 31 16:01:17.281164 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2053841e-42ff-413d-87b7-fe727afbac5d tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:17.282725 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2053841e-42ff-413d-87b7-fe727afbac5d tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: 3f785545-d532-4487-b780-8a9be107a209] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:17.285233 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 712/1430] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:16 2022] GET /compute/v2.1/servers/b82bda5d-2f6d-41e2-b9a4-180ba1d05652 => generated 1322 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:01:17.293513 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2053841e-42ff-413d-87b7-fe727afbac5d tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:17.295525 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2053841e-42ff-413d-87b7-fe727afbac5d tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:17.296559 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2053841e-42ff-413d-87b7-fe727afbac5d tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:17.297791 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2053841e-42ff-413d-87b7-fe727afbac5d tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:17.298420 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2053841e-42ff-413d-87b7-fe727afbac5d tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:17.300051 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2053841e-42ff-413d-87b7-fe727afbac5d tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:17.434896 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2053841e-42ff-413d-87b7-fe727afbac5d tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ccd03a4aa84f93bc26b438e1468f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a9f3fcc4b445349e5c66ff712e8598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:17.444312 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2053841e-42ff-413d-87b7-fe727afbac5d tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/servers/3f785545-d532-4487-b780-8a9be107a209" status: 200 len: 1265 microversion: 2.1 time: 0.177309 Aug 31 16:01:17.444917 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 719/1431] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:17 2022] GET /compute/v2.1/servers/3f785545-d532-4487-b780-8a9be107a209 => generated 1265 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:18.091917 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-e2af6377-96f6-43df-b79a-b42a7845b4f3 req-9d817fca-18ab-4abd-93c3-03826108596a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b82bda5d-2f6d-41e2-b9a4-180ba1d05652", "name": "network-vif-plugged", "status": "completed", "tag": "eed0bb35-bf3a-4d7f-a9f5-6c29c4e94d6a"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:01:18.134433 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-e2af6377-96f6-43df-b79a-b42a7845b4f3 req-9d817fca-18ab-4abd-93c3-03826108596a service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:18.138388 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-e2af6377-96f6-43df-b79a-b42a7845b4f3 req-9d817fca-18ab-4abd-93c3-03826108596a service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:18.140273 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-e2af6377-96f6-43df-b79a-b42a7845b4f3 req-9d817fca-18ab-4abd-93c3-03826108596a service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:18.141579 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9106c734-58ee-4c7a-8656-92fb0dd032c7 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:18.142664 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9106c734-58ee-4c7a-8656-92fb0dd032c7 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:18.171763 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9106c734-58ee-4c7a-8656-92fb0dd032c7 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:18.176285 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9106c734-58ee-4c7a-8656-92fb0dd032c7 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:18.180073 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9106c734-58ee-4c7a-8656-92fb0dd032c7 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:18.181101 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9106c734-58ee-4c7a-8656-92fb0dd032c7 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:18.181764 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9106c734-58ee-4c7a-8656-92fb0dd032c7 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:18.182364 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9106c734-58ee-4c7a-8656-92fb0dd032c7 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:18.196128 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-e2af6377-96f6-43df-b79a-b42a7845b4f3 req-9d817fca-18ab-4abd-93c3-03826108596a service nova] Creating event network-vif-plugged:eed0bb35-bf3a-4d7f-a9f5-6c29c4e94d6a for instance b82bda5d-2f6d-41e2-b9a4-180ba1d05652 on n-h1-850499-9 Aug 31 16:01:18.202418 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-e2af6377-96f6-43df-b79a-b42a7845b4f3 req-9d817fca-18ab-4abd-93c3-03826108596a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114044 Aug 31 16:01:18.203424 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 713/1432] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:01:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:01:18.303021 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-68a82b73-4ec7-4759-8995-85d0bc0cc7a1 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:18.314266 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-68a82b73-4ec7-4759-8995-85d0bc0cc7a1 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6c7489e2-1ba0-4689-b2d7-e37886757266] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:18.342455 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-68a82b73-4ec7-4759-8995-85d0bc0cc7a1 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:18.343690 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-68a82b73-4ec7-4759-8995-85d0bc0cc7a1 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:18.344727 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-68a82b73-4ec7-4759-8995-85d0bc0cc7a1 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:18.347208 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-68a82b73-4ec7-4759-8995-85d0bc0cc7a1 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:18.349355 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-68a82b73-4ec7-4759-8995-85d0bc0cc7a1 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:18.353518 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-68a82b73-4ec7-4759-8995-85d0bc0cc7a1 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:18.386997 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9106c734-58ee-4c7a-8656-92fb0dd032c7 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:18.416869 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9106c734-58ee-4c7a-8656-92fb0dd032c7 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:18.419754 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9106c734-58ee-4c7a-8656-92fb0dd032c7 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:18.433767 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9106c734-58ee-4c7a-8656-92fb0dd032c7 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1546 microversion: 2.91 time: 0.297323 Aug 31 16:01:18.436692 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 720/1433] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:01:18 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1546 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:01:18.454481 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-98ae652a-2155-41e2-99ae-c202338daf05 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:18.456492 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-98ae652a-2155-41e2-99ae-c202338daf05 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] [instance: b82bda5d-2f6d-41e2-b9a4-180ba1d05652] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:18.464372 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-98ae652a-2155-41e2-99ae-c202338daf05 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:18.465158 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-98ae652a-2155-41e2-99ae-c202338daf05 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:18.465957 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-98ae652a-2155-41e2-99ae-c202338daf05 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:18.466877 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-98ae652a-2155-41e2-99ae-c202338daf05 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:18.482264 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-98ae652a-2155-41e2-99ae-c202338daf05 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:18.483115 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-98ae652a-2155-41e2-99ae-c202338daf05 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:18.637489 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-68a82b73-4ec7-4759-8995-85d0bc0cc7a1 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:18.653132 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-68a82b73-4ec7-4759-8995-85d0bc0cc7a1 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266" status: 200 len: 1265 microversion: 2.1 time: 0.361363 Aug 31 16:01:18.670636 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 714/1434] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:18 2022] GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266 => generated 1265 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:18.677429 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a0b151ae-2d02-487f-97c7-ca0f40c60033 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:18.678360 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a0b151ae-2d02-487f-97c7-ca0f40c60033 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: 3f785545-d532-4487-b780-8a9be107a209] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:18.699317 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a0b151ae-2d02-487f-97c7-ca0f40c60033 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:18.700513 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a0b151ae-2d02-487f-97c7-ca0f40c60033 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:18.703040 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a0b151ae-2d02-487f-97c7-ca0f40c60033 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:18.704574 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a0b151ae-2d02-487f-97c7-ca0f40c60033 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:18.706587 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a0b151ae-2d02-487f-97c7-ca0f40c60033 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:18.709488 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a0b151ae-2d02-487f-97c7-ca0f40c60033 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:19.225771 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-98ae652a-2155-41e2-99ae-c202338daf05 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6382b576b5404eb90214c00b62299b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7fb4ddb0e649edbe96d046cde6b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:19.234462 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-98ae652a-2155-41e2-99ae-c202338daf05 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] 10.222.0.61 "GET /compute/v2.1/servers/b82bda5d-2f6d-41e2-b9a4-180ba1d05652" status: 200 len: 1322 microversion: 2.1 time: 0.795748 Aug 31 16:01:19.237938 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 721/1435] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:18 2022] GET /compute/v2.1/servers/b82bda5d-2f6d-41e2-b9a4-180ba1d05652 => generated 1322 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:19.372154 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a0b151ae-2d02-487f-97c7-ca0f40c60033 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ccd03a4aa84f93bc26b438e1468f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a9f3fcc4b445349e5c66ff712e8598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:19.385127 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a0b151ae-2d02-487f-97c7-ca0f40c60033 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/servers/3f785545-d532-4487-b780-8a9be107a209" status: 200 len: 1307 microversion: 2.1 time: 0.711276 Aug 31 16:01:19.396409 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 715/1436] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:18 2022] GET /compute/v2.1/servers/3f785545-d532-4487-b780-8a9be107a209 => generated 1307 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:19.479191 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d8a132b6-c2c8-4c14-8035-0bea626babbe tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:19.482974 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d8a132b6-c2c8-4c14-8035-0bea626babbe tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:19.490563 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d8a132b6-c2c8-4c14-8035-0bea626babbe tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:19.491080 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d8a132b6-c2c8-4c14-8035-0bea626babbe tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:19.491548 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d8a132b6-c2c8-4c14-8035-0bea626babbe tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:19.492489 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d8a132b6-c2c8-4c14-8035-0bea626babbe tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:19.493179 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d8a132b6-c2c8-4c14-8035-0bea626babbe tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:19.493566 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d8a132b6-c2c8-4c14-8035-0bea626babbe tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:19.522375 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c407fe56-ad9d-4a13-b2ae-3569dff2d848 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Action: 'create', calling method: .version_select at 0x7f5ae8cd59d0>, body: {"keypair": {"name": "tempest-keypair-909265129", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCKkhzYMzrFMfz/U4JNrF6km3Zh+Wp5mh2TR+y3s74vSNV994Ao4L5TxCJOpY6QZXcg3+6w1mPd6aMlEpfn7c9N0SV3WgOl3qyPwYuJNXeBIg1uKZRzkf+bhTnfv3Z8s/g=="}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:01:19.550500 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-c407fe56-ad9d-4a13-b2ae-3569dff2d848 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Getting quotas for project ab675eb7ef3e45e68d74d737484c6e6c. Resources: {'key_pairs'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:01:19.558254 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-c407fe56-ad9d-4a13-b2ae-3569dff2d848 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Getting quotas for user 90770e7e060c4ded869851dea068189c and project ab675eb7ef3e45e68d74d737484c6e6c. Resources: {'key_pairs'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:01:19.595447 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c407fe56-ad9d-4a13-b2ae-3569dff2d848 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.157221 Aug 31 16:01:19.596596 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 722/1437] 10.222.0.61 () {60 vars in 1159 bytes} [Wed Aug 31 16:01:19 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:01:19.609355 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-3168b0bc-83e9-49c6-b80c-f7a6507c2c26 req-cbb370cb-1dcb-4f57-97a3-8090a91a9551 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f785545-d532-4487-b780-8a9be107a209", "tag": "52b6863f-3e1f-464d-9a16-40e07fe4f7c7"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:01:19.613764 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d8a132b6-c2c8-4c14-8035-0bea626babbe tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:19.622392 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-3168b0bc-83e9-49c6-b80c-f7a6507c2c26 req-cbb370cb-1dcb-4f57-97a3-8090a91a9551 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:19.623042 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-3168b0bc-83e9-49c6-b80c-f7a6507c2c26 req-cbb370cb-1dcb-4f57-97a3-8090a91a9551 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:19.623616 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-3168b0bc-83e9-49c6-b80c-f7a6507c2c26 req-cbb370cb-1dcb-4f57-97a3-8090a91a9551 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:19.639754 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d8a132b6-c2c8-4c14-8035-0bea626babbe tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:19.639997 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-3168b0bc-83e9-49c6-b80c-f7a6507c2c26 req-cbb370cb-1dcb-4f57-97a3-8090a91a9551 service nova] Creating event network-changed:52b6863f-3e1f-464d-9a16-40e07fe4f7c7 for instance 3f785545-d532-4487-b780-8a9be107a209 on n-h1-850499-9 Aug 31 16:01:19.640137 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d8a132b6-c2c8-4c14-8035-0bea626babbe tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:19.645494 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-3168b0bc-83e9-49c6-b80c-f7a6507c2c26 req-cbb370cb-1dcb-4f57-97a3-8090a91a9551 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040381 Aug 31 16:01:19.648028 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 723/1438] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:01:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:01:19.649841 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d8a132b6-c2c8-4c14-8035-0bea626babbe tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1546 microversion: 2.91 time: 0.174844 Aug 31 16:01:19.650429 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 716/1439] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:01:19 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1546 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:01:19.681512 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6fc5b009-9082-43fe-9faa-7bb2897dc625 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:19.682448 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6fc5b009-9082-43fe-9faa-7bb2897dc625 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6c7489e2-1ba0-4689-b2d7-e37886757266] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:19.692873 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6fc5b009-9082-43fe-9faa-7bb2897dc625 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:19.693546 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6fc5b009-9082-43fe-9faa-7bb2897dc625 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:19.694108 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6fc5b009-9082-43fe-9faa-7bb2897dc625 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:19.694981 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6fc5b009-9082-43fe-9faa-7bb2897dc625 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:19.695549 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6fc5b009-9082-43fe-9faa-7bb2897dc625 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:19.696175 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6fc5b009-9082-43fe-9faa-7bb2897dc625 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:19.788527 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-6fc5b009-9082-43fe-9faa-7bb2897dc625 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:19.804339 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6fc5b009-9082-43fe-9faa-7bb2897dc625 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266" status: 200 len: 1271 microversion: 2.1 time: 0.128673 Aug 31 16:01:19.806328 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 724/1440] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:19 2022] GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266 => generated 1271 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:20.269150 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0ce46a65-16f9-4d0f-97fa-2f81f6e05dc9 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:20.280671 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0ce46a65-16f9-4d0f-97fa-2f81f6e05dc9 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] [instance: b82bda5d-2f6d-41e2-b9a4-180ba1d05652] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:20.304848 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0ce46a65-16f9-4d0f-97fa-2f81f6e05dc9 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:20.308038 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0ce46a65-16f9-4d0f-97fa-2f81f6e05dc9 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:20.309256 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0ce46a65-16f9-4d0f-97fa-2f81f6e05dc9 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:20.311654 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0ce46a65-16f9-4d0f-97fa-2f81f6e05dc9 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:20.314756 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-07d51b7c-5160-417f-a7cd-0e3e61d15025 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:20.315669 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-07d51b7c-5160-417f-a7cd-0e3e61d15025 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] [instance: cc085aaa-21b2-48a6-b69c-de4e261dfe7f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:20.319796 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0ce46a65-16f9-4d0f-97fa-2f81f6e05dc9 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:20.320982 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0ce46a65-16f9-4d0f-97fa-2f81f6e05dc9 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:20.338964 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-07d51b7c-5160-417f-a7cd-0e3e61d15025 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:20.340628 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-07d51b7c-5160-417f-a7cd-0e3e61d15025 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:20.341608 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-07d51b7c-5160-417f-a7cd-0e3e61d15025 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:20.343270 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-07d51b7c-5160-417f-a7cd-0e3e61d15025 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:20.344123 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-07d51b7c-5160-417f-a7cd-0e3e61d15025 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:20.344863 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-07d51b7c-5160-417f-a7cd-0e3e61d15025 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:20.583581 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-07d51b7c-5160-417f-a7cd-0e3e61d15025 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f" status: 200 len: 1860 microversion: 2.1 time: 0.273827 Aug 31 16:01:20.599630 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 725/1441] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:20 2022] GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f => generated 1860 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:20.610271 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a34ae5d4-e120-4c69-9df7-e426b3cced94 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:20.614561 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a34ae5d4-e120-4c69-9df7-e426b3cced94 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: 3f785545-d532-4487-b780-8a9be107a209] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:20.624655 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a34ae5d4-e120-4c69-9df7-e426b3cced94 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:20.625156 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a34ae5d4-e120-4c69-9df7-e426b3cced94 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:20.625591 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a34ae5d4-e120-4c69-9df7-e426b3cced94 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:20.627492 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a34ae5d4-e120-4c69-9df7-e426b3cced94 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:20.628154 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a34ae5d4-e120-4c69-9df7-e426b3cced94 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:20.628775 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a34ae5d4-e120-4c69-9df7-e426b3cced94 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:20.635463 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-0ce46a65-16f9-4d0f-97fa-2f81f6e05dc9 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6382b576b5404eb90214c00b62299b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7fb4ddb0e649edbe96d046cde6b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:20.640995 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:01:20.649351 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0ce46a65-16f9-4d0f-97fa-2f81f6e05dc9 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] 10.222.0.61 "GET /compute/v2.1/servers/b82bda5d-2f6d-41e2-b9a4-180ba1d05652" status: 200 len: 1322 microversion: 2.1 time: 0.388066 Aug 31 16:01:20.656842 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 717/1442] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:20 2022] GET /compute/v2.1/servers/b82bda5d-2f6d-41e2-b9a4-180ba1d05652 => generated 1322 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:20.661941 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7bd827d4-998e-4f1e-9ebd-03ac24c5d827 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-850499-9", "block_migration": true, "disk_over_commit": false}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:01:20.664770 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7bd827d4-998e-4f1e-9ebd-03ac24c5d827 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] [instance: cc085aaa-21b2-48a6-b69c-de4e261dfe7f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:20.691586 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7bd827d4-998e-4f1e-9ebd-03ac24c5d827 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:20.696923 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7bd827d4-998e-4f1e-9ebd-03ac24c5d827 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:20.698139 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7bd827d4-998e-4f1e-9ebd-03ac24c5d827 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:20.700091 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7bd827d4-998e-4f1e-9ebd-03ac24c5d827 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:20.700789 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7bd827d4-998e-4f1e-9ebd-03ac24c5d827 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:20.701474 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7bd827d4-998e-4f1e-9ebd-03ac24c5d827 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:20.760464 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-7bd827d4-998e-4f1e-9ebd-03ac24c5d827 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lazy-loading 'flavor' on Instance uuid cc085aaa-21b2-48a6-b69c-de4e261dfe7f {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:01:20.777210 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7bd827d4-998e-4f1e-9ebd-03ac24c5d827 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] [instance: cc085aaa-21b2-48a6-b69c-de4e261dfe7f] Going to try to live migrate instance to n-h2-850499-9 {{(pid=122256) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 31 16:01:21.042904 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a34ae5d4-e120-4c69-9df7-e426b3cced94 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ccd03a4aa84f93bc26b438e1468f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a9f3fcc4b445349e5c66ff712e8598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:21.059947 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a34ae5d4-e120-4c69-9df7-e426b3cced94 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/servers/3f785545-d532-4487-b780-8a9be107a209" status: 200 len: 1307 microversion: 2.1 time: 0.458276 Aug 31 16:01:21.061331 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 726/1443] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:20 2022] GET /compute/v2.1/servers/3f785545-d532-4487-b780-8a9be107a209 => generated 1307 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:21.070431 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-16e2f162-c1c0-46f1-9ed0-3d66899c79b2 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:21.071946 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-16e2f162-c1c0-46f1-9ed0-3d66899c79b2 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:21.084188 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-16e2f162-c1c0-46f1-9ed0-3d66899c79b2 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:21.085117 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-16e2f162-c1c0-46f1-9ed0-3d66899c79b2 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:21.085666 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-16e2f162-c1c0-46f1-9ed0-3d66899c79b2 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:21.087192 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-16e2f162-c1c0-46f1-9ed0-3d66899c79b2 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:21.087941 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-16e2f162-c1c0-46f1-9ed0-3d66899c79b2 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:21.088509 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-16e2f162-c1c0-46f1-9ed0-3d66899c79b2 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:21.178711 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-16e2f162-c1c0-46f1-9ed0-3d66899c79b2 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:21.191078 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-16e2f162-c1c0-46f1-9ed0-3d66899c79b2 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:21.192946 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-16e2f162-c1c0-46f1-9ed0-3d66899c79b2 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:21.200112 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-16e2f162-c1c0-46f1-9ed0-3d66899c79b2 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1546 microversion: 2.91 time: 0.136897 Aug 31 16:01:21.201660 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 727/1444] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:01:21 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1546 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:01:21.211392 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-98d41b21-d155-47b0-90df-c5f1c35da175 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:21.212410 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-98d41b21-d155-47b0-90df-c5f1c35da175 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6c7489e2-1ba0-4689-b2d7-e37886757266] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:21.221480 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-98d41b21-d155-47b0-90df-c5f1c35da175 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:21.222323 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-98d41b21-d155-47b0-90df-c5f1c35da175 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:21.224346 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-98d41b21-d155-47b0-90df-c5f1c35da175 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:21.225795 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-98d41b21-d155-47b0-90df-c5f1c35da175 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:21.226355 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-98d41b21-d155-47b0-90df-c5f1c35da175 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:21.226872 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-98d41b21-d155-47b0-90df-c5f1c35da175 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:21.412317 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-98d41b21-d155-47b0-90df-c5f1c35da175 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:21.425786 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-98d41b21-d155-47b0-90df-c5f1c35da175 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266" status: 200 len: 1271 microversion: 2.1 time: 0.221373 Aug 31 16:01:21.427867 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 728/1445] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:21 2022] GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266 => generated 1271 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:21.678177 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e8fb11bd-292f-41db-9f92-47b3fac381c5 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:21.678808 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e8fb11bd-292f-41db-9f92-47b3fac381c5 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] [instance: b82bda5d-2f6d-41e2-b9a4-180ba1d05652] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:21.690153 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e8fb11bd-292f-41db-9f92-47b3fac381c5 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:21.691181 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e8fb11bd-292f-41db-9f92-47b3fac381c5 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:21.693016 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e8fb11bd-292f-41db-9f92-47b3fac381c5 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:21.694022 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e8fb11bd-292f-41db-9f92-47b3fac381c5 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:21.696139 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e8fb11bd-292f-41db-9f92-47b3fac381c5 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:21.696763 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e8fb11bd-292f-41db-9f92-47b3fac381c5 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:22.303887 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e8fb11bd-292f-41db-9f92-47b3fac381c5 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6382b576b5404eb90214c00b62299b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7fb4ddb0e649edbe96d046cde6b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:22.314136 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e8fb11bd-292f-41db-9f92-47b3fac381c5 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] 10.222.0.61 "GET /compute/v2.1/servers/b82bda5d-2f6d-41e2-b9a4-180ba1d05652" status: 200 len: 1322 microversion: 2.1 time: 0.640007 Aug 31 16:01:22.315795 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 729/1446] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:21 2022] GET /compute/v2.1/servers/b82bda5d-2f6d-41e2-b9a4-180ba1d05652 => generated 1322 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:01:22.320791 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3e724395-3d5f-4256-8a60-35303d489b6b tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:22.321406 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3e724395-3d5f-4256-8a60-35303d489b6b tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: 3f785545-d532-4487-b780-8a9be107a209] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:22.335011 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3e724395-3d5f-4256-8a60-35303d489b6b tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:22.335785 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3e724395-3d5f-4256-8a60-35303d489b6b tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:22.336544 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3e724395-3d5f-4256-8a60-35303d489b6b tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:22.338029 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3e724395-3d5f-4256-8a60-35303d489b6b tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:22.338738 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3e724395-3d5f-4256-8a60-35303d489b6b tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:22.339274 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3e724395-3d5f-4256-8a60-35303d489b6b tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:22.659165 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3e724395-3d5f-4256-8a60-35303d489b6b tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ccd03a4aa84f93bc26b438e1468f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a9f3fcc4b445349e5c66ff712e8598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:22.668688 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3e724395-3d5f-4256-8a60-35303d489b6b tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/servers/3f785545-d532-4487-b780-8a9be107a209" status: 200 len: 1307 microversion: 2.1 time: 0.351560 Aug 31 16:01:22.669640 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 730/1447] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:22 2022] GET /compute/v2.1/servers/3f785545-d532-4487-b780-8a9be107a209 => generated 1307 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:22.675857 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4a3b82ce-b368-4343-a4be-e94c093c0978 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-537213574", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "1980dbf7-3d92-4437-9357-cc0f838bb8d5"}], "security_groups": [{"name": "tempest-securitygroup--779293829"}], "key_name": "tempest-keypair-909265129", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:01:22.754568 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:01:23.269038 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-4a3b82ce-b368-4343-a4be-e94c093c0978 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] validate_networks() for [('1980dbf7-3d92-4437-9357-cc0f838bb8d5', None, None, None, None, None)] {{(pid=122257) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:01:23.323465 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7bd827d4-998e-4f1e-9ebd-03ac24c5d827 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f/action" status: 202 len: 0 microversion: 2.1 time: 2.664941 Aug 31 16:01:23.328110 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 718/1448] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:01:20 2022] POST /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f/action => generated 0 bytes in 2667 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:01:23.332112 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1afcdad0-a318-4a7a-b665-ac7eeb701091 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:23.333533 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1afcdad0-a318-4a7a-b665-ac7eeb701091 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:23.342299 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1afcdad0-a318-4a7a-b665-ac7eeb701091 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:23.342804 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1afcdad0-a318-4a7a-b665-ac7eeb701091 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:23.343258 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1afcdad0-a318-4a7a-b665-ac7eeb701091 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:23.344014 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1afcdad0-a318-4a7a-b665-ac7eeb701091 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:23.344486 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1afcdad0-a318-4a7a-b665-ac7eeb701091 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:23.344921 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1afcdad0-a318-4a7a-b665-ac7eeb701091 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:23.471117 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1afcdad0-a318-4a7a-b665-ac7eeb701091 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:23.486730 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1afcdad0-a318-4a7a-b665-ac7eeb701091 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:23.488474 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1afcdad0-a318-4a7a-b665-ac7eeb701091 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:23.495036 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1afcdad0-a318-4a7a-b665-ac7eeb701091 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1546 microversion: 2.91 time: 0.168944 Aug 31 16:01:23.495659 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 719/1449] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:01:23 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1546 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:01:23.502844 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4843aac0-b8a4-4f14-9c29-00c80f2c2099 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:23.503491 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4843aac0-b8a4-4f14-9c29-00c80f2c2099 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6c7489e2-1ba0-4689-b2d7-e37886757266] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:23.514358 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4843aac0-b8a4-4f14-9c29-00c80f2c2099 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:23.515135 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4843aac0-b8a4-4f14-9c29-00c80f2c2099 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:23.515760 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4843aac0-b8a4-4f14-9c29-00c80f2c2099 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:23.516755 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4843aac0-b8a4-4f14-9c29-00c80f2c2099 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:23.518088 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4843aac0-b8a4-4f14-9c29-00c80f2c2099 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:23.518697 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4843aac0-b8a4-4f14-9c29-00c80f2c2099 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:23.632861 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-4843aac0-b8a4-4f14-9c29-00c80f2c2099 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:23.641722 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4843aac0-b8a4-4f14-9c29-00c80f2c2099 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266" status: 200 len: 1271 microversion: 2.1 time: 0.144746 Aug 31 16:01:23.642787 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 720/1450] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:23 2022] GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266 => generated 1271 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:23.647475 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-68943693-fa97-4258-9c7b-64c68ad332b0 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:23.648684 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-68943693-fa97-4258-9c7b-64c68ad332b0 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: cc085aaa-21b2-48a6-b69c-de4e261dfe7f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:23.656077 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-68943693-fa97-4258-9c7b-64c68ad332b0 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:23.656815 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-68943693-fa97-4258-9c7b-64c68ad332b0 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:23.657434 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-68943693-fa97-4258-9c7b-64c68ad332b0 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:23.659075 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-68943693-fa97-4258-9c7b-64c68ad332b0 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:23.659567 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-68943693-fa97-4258-9c7b-64c68ad332b0 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:23.660198 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-68943693-fa97-4258-9c7b-64c68ad332b0 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:24.092356 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-68943693-fa97-4258-9c7b-64c68ad332b0 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:24.105604 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-68943693-fa97-4258-9c7b-64c68ad332b0 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f" status: 200 len: 1719 microversion: 2.1 time: 0.461569 Aug 31 16:01:24.106781 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 721/1451] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:23 2022] GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f => generated 1719 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:24.114246 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b9524db4-39cc-429b-aec3-ae333f6229a9 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:24.115592 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b9524db4-39cc-429b-aec3-ae333f6229a9 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] [instance: b82bda5d-2f6d-41e2-b9a4-180ba1d05652] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:24.125464 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b9524db4-39cc-429b-aec3-ae333f6229a9 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:24.126407 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b9524db4-39cc-429b-aec3-ae333f6229a9 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:24.128652 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b9524db4-39cc-429b-aec3-ae333f6229a9 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:24.130475 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b9524db4-39cc-429b-aec3-ae333f6229a9 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:24.131136 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b9524db4-39cc-429b-aec3-ae333f6229a9 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:24.131774 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b9524db4-39cc-429b-aec3-ae333f6229a9 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:24.214191 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-4a3b82ce-b368-4343-a4be-e94c093c0978 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Getting quotas for project ab675eb7ef3e45e68d74d737484c6e6c. Resources: dict_keys(['metadata_items']) {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:01:24.226719 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-4a3b82ce-b368-4343-a4be-e94c093c0978 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Getting quotas for user 90770e7e060c4ded869851dea068189c and project ab675eb7ef3e45e68d74d737484c6e6c. Resources: dict_keys(['metadata_items']) {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:01:24.259456 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-4a3b82ce-b368-4343-a4be-e94c093c0978 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:01:24.260826 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-4a3b82ce-b368-4343-a4be-e94c093c0978 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:01:24.261608 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-4a3b82ce-b368-4343-a4be-e94c093c0978 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:01:24.262414 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-4a3b82ce-b368-4343-a4be-e94c093c0978 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:01:24.263058 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-4a3b82ce-b368-4343-a4be-e94c093c0978 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:01:24.283746 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4a3b82ce-b368-4343-a4be-e94c093c0978 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:24.285302 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4a3b82ce-b368-4343-a4be-e94c093c0978 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:24.286535 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4a3b82ce-b368-4343-a4be-e94c093c0978 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:24.287909 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4a3b82ce-b368-4343-a4be-e94c093c0978 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:24.288919 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4a3b82ce-b368-4343-a4be-e94c093c0978 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:24.289521 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4a3b82ce-b368-4343-a4be-e94c093c0978 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:24.319106 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-4a3b82ce-b368-4343-a4be-e94c093c0978 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Getting quotas for project ab675eb7ef3e45e68d74d737484c6e6c. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:01:24.325262 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-4a3b82ce-b368-4343-a4be-e94c093c0978 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Getting quotas for user 90770e7e060c4ded869851dea068189c and project ab675eb7ef3e45e68d74d737484c6e6c. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:01:24.347806 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4a3b82ce-b368-4343-a4be-e94c093c0978 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Going to run 1 instances... {{(pid=122257) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:01:24.350798 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4a3b82ce-b368-4343-a4be-e94c093c0978 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] [instance: 7523e0a9-60e8-42ba-b271-d63251e373b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:01:24.453682 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4a3b82ce-b368-4343-a4be-e94c093c0978 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.782665 Aug 31 16:01:24.454922 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 731/1452] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:01:22 2022] POST /compute/v2.1/servers => generated 408 bytes in 1784 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:01:24.461513 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-488122d6-07fe-4711-ac0e-fb5caa47a60a tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:24.462568 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-488122d6-07fe-4711-ac0e-fb5caa47a60a tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: 3f785545-d532-4487-b780-8a9be107a209] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:24.471257 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-488122d6-07fe-4711-ac0e-fb5caa47a60a tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:24.471908 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-488122d6-07fe-4711-ac0e-fb5caa47a60a tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:24.472513 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-488122d6-07fe-4711-ac0e-fb5caa47a60a tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:24.473260 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-488122d6-07fe-4711-ac0e-fb5caa47a60a tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:24.473901 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-488122d6-07fe-4711-ac0e-fb5caa47a60a tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:24.474536 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-488122d6-07fe-4711-ac0e-fb5caa47a60a tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:24.492106 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b9524db4-39cc-429b-aec3-ae333f6229a9 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6382b576b5404eb90214c00b62299b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7fb4ddb0e649edbe96d046cde6b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:24.532402 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b9524db4-39cc-429b-aec3-ae333f6229a9 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] 10.222.0.61 "GET /compute/v2.1/servers/b82bda5d-2f6d-41e2-b9a4-180ba1d05652" status: 200 len: 1472 microversion: 2.1 time: 0.408969 Aug 31 16:01:24.533159 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 722/1453] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:24 2022] GET /compute/v2.1/servers/b82bda5d-2f6d-41e2-b9a4-180ba1d05652 => generated 1472 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:24.547989 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9c582a36-ede5-40b5-a412-a3531e8bdf84 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:24.548689 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9c582a36-ede5-40b5-a412-a3531e8bdf84 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] [instance: 7523e0a9-60e8-42ba-b271-d63251e373b7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:24.655011 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=6 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:01:24.716723 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-9c582a36-ede5-40b5-a412-a3531e8bdf84 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90770e7e060c4ded869851dea068189c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab675eb7ef3e45e68d74d737484c6e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:24.728435 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9c582a36-ede5-40b5-a412-a3531e8bdf84 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] 10.222.0.61 "GET /compute/v2.1/servers/7523e0a9-60e8-42ba-b271-d63251e373b7" status: 200 len: 1276 microversion: 2.1 time: 0.191705 Aug 31 16:01:24.729070 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 723/1454] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:24 2022] GET /compute/v2.1/servers/7523e0a9-60e8-42ba-b271-d63251e373b7 => generated 1276 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:24.748754 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-681f2486-1496-493b-9800-7be421dd658e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:24.749394 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-681f2486-1496-493b-9800-7be421dd658e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:24.761731 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-681f2486-1496-493b-9800-7be421dd658e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:24.762274 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-681f2486-1496-493b-9800-7be421dd658e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:24.762727 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-681f2486-1496-493b-9800-7be421dd658e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:24.763640 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-681f2486-1496-493b-9800-7be421dd658e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:24.764117 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-681f2486-1496-493b-9800-7be421dd658e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:24.764568 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-681f2486-1496-493b-9800-7be421dd658e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:24.902483 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-681f2486-1496-493b-9800-7be421dd658e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:24.916623 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-681f2486-1496-493b-9800-7be421dd658e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:24.918089 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-681f2486-1496-493b-9800-7be421dd658e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:24.925851 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-488122d6-07fe-4711-ac0e-fb5caa47a60a tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ccd03a4aa84f93bc26b438e1468f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a9f3fcc4b445349e5c66ff712e8598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:24.929937 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-681f2486-1496-493b-9800-7be421dd658e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1546 microversion: 2.91 time: 0.199128 Aug 31 16:01:24.930794 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 724/1455] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:01:24 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1546 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:01:24.936609 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-80f423e1-6c81-4532-9a7a-c6c2c40c810c tempest-ServersAdminNegativeTestJSON-2114695108 tempest-ServersAdminNegativeTestJSON-2114695108-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:01:24.937573 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-80f423e1-6c81-4532-9a7a-c6c2c40c810c tempest-ServersAdminNegativeTestJSON-2114695108 tempest-ServersAdminNegativeTestJSON-2114695108-project-admin] [instance: b82bda5d-2f6d-41e2-b9a4-180ba1d05652] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:24.945714 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-80f423e1-6c81-4532-9a7a-c6c2c40c810c tempest-ServersAdminNegativeTestJSON-2114695108 tempest-ServersAdminNegativeTestJSON-2114695108-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:24.946470 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-80f423e1-6c81-4532-9a7a-c6c2c40c810c tempest-ServersAdminNegativeTestJSON-2114695108 tempest-ServersAdminNegativeTestJSON-2114695108-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:24.946633 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-488122d6-07fe-4711-ac0e-fb5caa47a60a tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/servers/3f785545-d532-4487-b780-8a9be107a209" status: 200 len: 1307 microversion: 2.1 time: 0.490396 Aug 31 16:01:24.947176 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 732/1456] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:24 2022] GET /compute/v2.1/servers/3f785545-d532-4487-b780-8a9be107a209 => generated 1307 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:24.952567 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-390d8229-f376-4865-8112-39fe698cb8b9 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:24.953379 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-390d8229-f376-4865-8112-39fe698cb8b9 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6c7489e2-1ba0-4689-b2d7-e37886757266] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:24.965266 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-390d8229-f376-4865-8112-39fe698cb8b9 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:24.965629 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-390d8229-f376-4865-8112-39fe698cb8b9 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:24.966070 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-390d8229-f376-4865-8112-39fe698cb8b9 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:24.966758 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-390d8229-f376-4865-8112-39fe698cb8b9 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:24.967227 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-390d8229-f376-4865-8112-39fe698cb8b9 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:24.967688 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-390d8229-f376-4865-8112-39fe698cb8b9 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:24.969438 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-80f423e1-6c81-4532-9a7a-c6c2c40c810c tempest-ServersAdminNegativeTestJSON-2114695108 tempest-ServersAdminNegativeTestJSON-2114695108-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:24.973239 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-80f423e1-6c81-4532-9a7a-c6c2c40c810c tempest-ServersAdminNegativeTestJSON-2114695108 tempest-ServersAdminNegativeTestJSON-2114695108-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:24.973958 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-80f423e1-6c81-4532-9a7a-c6c2c40c810c tempest-ServersAdminNegativeTestJSON-2114695108 tempest-ServersAdminNegativeTestJSON-2114695108-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:24.976073 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-80f423e1-6c81-4532-9a7a-c6c2c40c810c tempest-ServersAdminNegativeTestJSON-2114695108 tempest-ServersAdminNegativeTestJSON-2114695108-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:25.008117 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-80f423e1-6c81-4532-9a7a-c6c2c40c810c tempest-ServersAdminNegativeTestJSON-2114695108 tempest-ServersAdminNegativeTestJSON-2114695108-project-admin] Lazy-loading 'flavor' on Instance uuid b82bda5d-2f6d-41e2-b9a4-180ba1d05652 {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:01:25.119605 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-80f423e1-6c81-4532-9a7a-c6c2c40c810c tempest-ServersAdminNegativeTestJSON-2114695108 tempest-ServersAdminNegativeTestJSON-2114695108-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/b82bda5d-2f6d-41e2-b9a4-180ba1d05652/action" status: 202 len: 0 microversion: 2.1 time: 0.187307 Aug 31 16:01:25.120253 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 725/1457] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:01:24 2022] POST /compute/v2.1/servers/b82bda5d-2f6d-41e2-b9a4-180ba1d05652/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:01:25.137737 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8e8f21d2-0524-44f1-a2de-011f0b40bbe8 tempest-ServersAdminNegativeTestJSON-2114695108 tempest-ServersAdminNegativeTestJSON-2114695108-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:25.138747 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8e8f21d2-0524-44f1-a2de-011f0b40bbe8 tempest-ServersAdminNegativeTestJSON-2114695108 tempest-ServersAdminNegativeTestJSON-2114695108-project-admin] [instance: b82bda5d-2f6d-41e2-b9a4-180ba1d05652] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:25.147966 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8e8f21d2-0524-44f1-a2de-011f0b40bbe8 tempest-ServersAdminNegativeTestJSON-2114695108 tempest-ServersAdminNegativeTestJSON-2114695108-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:25.148868 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8e8f21d2-0524-44f1-a2de-011f0b40bbe8 tempest-ServersAdminNegativeTestJSON-2114695108 tempest-ServersAdminNegativeTestJSON-2114695108-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:25.149879 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8e8f21d2-0524-44f1-a2de-011f0b40bbe8 tempest-ServersAdminNegativeTestJSON-2114695108 tempest-ServersAdminNegativeTestJSON-2114695108-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:25.150864 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8e8f21d2-0524-44f1-a2de-011f0b40bbe8 tempest-ServersAdminNegativeTestJSON-2114695108 tempest-ServersAdminNegativeTestJSON-2114695108-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:25.151643 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8e8f21d2-0524-44f1-a2de-011f0b40bbe8 tempest-ServersAdminNegativeTestJSON-2114695108 tempest-ServersAdminNegativeTestJSON-2114695108-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:25.152375 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8e8f21d2-0524-44f1-a2de-011f0b40bbe8 tempest-ServersAdminNegativeTestJSON-2114695108 tempest-ServersAdminNegativeTestJSON-2114695108-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:25.539386 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-390d8229-f376-4865-8112-39fe698cb8b9 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:25.550613 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-390d8229-f376-4865-8112-39fe698cb8b9 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266" status: 200 len: 1313 microversion: 2.1 time: 0.602056 Aug 31 16:01:25.551313 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 733/1458] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:24 2022] GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266 => generated 1313 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:25.558952 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-32416833-1fb1-4246-8ed7-2d0d370760cd tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:25.560760 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-32416833-1fb1-4246-8ed7-2d0d370760cd tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: cc085aaa-21b2-48a6-b69c-de4e261dfe7f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:25.569614 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-32416833-1fb1-4246-8ed7-2d0d370760cd tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:25.570118 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-32416833-1fb1-4246-8ed7-2d0d370760cd tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:25.570712 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-32416833-1fb1-4246-8ed7-2d0d370760cd tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:25.571432 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-32416833-1fb1-4246-8ed7-2d0d370760cd tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:25.571919 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-32416833-1fb1-4246-8ed7-2d0d370760cd tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:25.572351 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-32416833-1fb1-4246-8ed7-2d0d370760cd tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:25.949137 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-32416833-1fb1-4246-8ed7-2d0d370760cd tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:25.966208 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-32416833-1fb1-4246-8ed7-2d0d370760cd tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f" status: 200 len: 1719 microversion: 2.1 time: 0.413327 Aug 31 16:01:25.967263 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 734/1459] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:25 2022] GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f => generated 1719 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:25.973447 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-987c4c95-c744-4a03-8102-7ac45351c95c tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:25.974434 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-987c4c95-c744-4a03-8102-7ac45351c95c tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] [instance: 7523e0a9-60e8-42ba-b271-d63251e373b7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:25.982901 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-987c4c95-c744-4a03-8102-7ac45351c95c tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:25.985599 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-987c4c95-c744-4a03-8102-7ac45351c95c tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:25.987138 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-987c4c95-c744-4a03-8102-7ac45351c95c tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:26.000143 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-987c4c95-c744-4a03-8102-7ac45351c95c tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:26.002737 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-987c4c95-c744-4a03-8102-7ac45351c95c tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:26.004806 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-987c4c95-c744-4a03-8102-7ac45351c95c tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:26.010624 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8e8f21d2-0524-44f1-a2de-011f0b40bbe8 tempest-ServersAdminNegativeTestJSON-2114695108 tempest-ServersAdminNegativeTestJSON-2114695108-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/b82bda5d-2f6d-41e2-b9a4-180ba1d05652" status: 200 len: 1631 microversion: 2.1 time: 0.876539 Aug 31 16:01:26.012906 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 726/1460] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:25 2022] GET /compute/v2.1/servers/b82bda5d-2f6d-41e2-b9a4-180ba1d05652 => generated 1631 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:26.026042 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-370715e8-4e70-423c-aca8-6bf08a1e99e8 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:26.027833 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-370715e8-4e70-423c-aca8-6bf08a1e99e8 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: 3f785545-d532-4487-b780-8a9be107a209] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:26.054087 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-370715e8-4e70-423c-aca8-6bf08a1e99e8 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:26.054087 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-370715e8-4e70-423c-aca8-6bf08a1e99e8 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:26.054087 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-370715e8-4e70-423c-aca8-6bf08a1e99e8 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:26.054820 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-370715e8-4e70-423c-aca8-6bf08a1e99e8 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:26.055255 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-370715e8-4e70-423c-aca8-6bf08a1e99e8 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:26.055760 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-370715e8-4e70-423c-aca8-6bf08a1e99e8 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:26.098126 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-987c4c95-c744-4a03-8102-7ac45351c95c tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90770e7e060c4ded869851dea068189c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab675eb7ef3e45e68d74d737484c6e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:26.114336 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-987c4c95-c744-4a03-8102-7ac45351c95c tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] 10.222.0.61 "GET /compute/v2.1/servers/7523e0a9-60e8-42ba-b271-d63251e373b7" status: 200 len: 1328 microversion: 2.1 time: 0.145718 Aug 31 16:01:26.115127 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 735/1461] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:25 2022] GET /compute/v2.1/servers/7523e0a9-60e8-42ba-b271-d63251e373b7 => generated 1328 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:26.122124 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b89de1b0-5f93-4981-84f7-70ffabc0668e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:26.122933 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b89de1b0-5f93-4981-84f7-70ffabc0668e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:26.130110 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b89de1b0-5f93-4981-84f7-70ffabc0668e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:26.130730 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b89de1b0-5f93-4981-84f7-70ffabc0668e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:26.131248 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b89de1b0-5f93-4981-84f7-70ffabc0668e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:26.132082 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b89de1b0-5f93-4981-84f7-70ffabc0668e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:26.132618 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b89de1b0-5f93-4981-84f7-70ffabc0668e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:26.133136 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b89de1b0-5f93-4981-84f7-70ffabc0668e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:26.300608 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b89de1b0-5f93-4981-84f7-70ffabc0668e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:26.304960 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=100 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:01:26.311923 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b89de1b0-5f93-4981-84f7-70ffabc0668e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:26.314536 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b89de1b0-5f93-4981-84f7-70ffabc0668e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:26.325599 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b89de1b0-5f93-4981-84f7-70ffabc0668e tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1533 microversion: 2.91 time: 0.209254 Aug 31 16:01:26.326775 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 736/1462] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:01:26 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1533 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:01:26.336776 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-e41bbb1e-4c69-45a7-82a2-ee3e3b58f203 req-f09d2437-bb1b-42f9-9b73-083758133550 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c7489e2-1ba0-4689-b2d7-e37886757266", "tag": "e136c42f-9bc1-433f-8e80-0837c9be0717"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:01:26.350813 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-e41bbb1e-4c69-45a7-82a2-ee3e3b58f203 req-f09d2437-bb1b-42f9-9b73-083758133550 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:26.351967 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-e41bbb1e-4c69-45a7-82a2-ee3e3b58f203 req-f09d2437-bb1b-42f9-9b73-083758133550 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:26.352628 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-e41bbb1e-4c69-45a7-82a2-ee3e3b58f203 req-f09d2437-bb1b-42f9-9b73-083758133550 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:26.366869 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-e41bbb1e-4c69-45a7-82a2-ee3e3b58f203 req-f09d2437-bb1b-42f9-9b73-083758133550 service nova] Creating event network-changed:e136c42f-9bc1-433f-8e80-0837c9be0717 for instance 6c7489e2-1ba0-4689-b2d7-e37886757266 on n-h2-850499-9 Aug 31 16:01:26.372712 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-e41bbb1e-4c69-45a7-82a2-ee3e3b58f203 req-f09d2437-bb1b-42f9-9b73-083758133550 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043904 Aug 31 16:01:26.373091 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 737/1463] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:01:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:01:26.379012 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-21421d8d-98c3-4057-9833-002d756693cd tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:26.380141 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-21421d8d-98c3-4057-9833-002d756693cd tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] [instance: 35b89015-3888-493a-b521-49a5e3769b00] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:26.394159 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-21421d8d-98c3-4057-9833-002d756693cd tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:26.394159 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-21421d8d-98c3-4057-9833-002d756693cd tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:26.394159 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-21421d8d-98c3-4057-9833-002d756693cd tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:26.394159 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-21421d8d-98c3-4057-9833-002d756693cd tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:26.394645 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-21421d8d-98c3-4057-9833-002d756693cd tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:26.394645 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-21421d8d-98c3-4057-9833-002d756693cd tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:26.554785 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-370715e8-4e70-423c-aca8-6bf08a1e99e8 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ccd03a4aa84f93bc26b438e1468f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a9f3fcc4b445349e5c66ff712e8598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:26.563280 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-370715e8-4e70-423c-aca8-6bf08a1e99e8 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/servers/3f785545-d532-4487-b780-8a9be107a209" status: 200 len: 1307 microversion: 2.1 time: 0.547004 Aug 31 16:01:26.563892 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 727/1464] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:26 2022] GET /compute/v2.1/servers/3f785545-d532-4487-b780-8a9be107a209 => generated 1307 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:26.569445 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-dd34b940-7270-49cd-aa32-139015f4cf85 tempest-UnshelveToHostMultiNodesTest-1598069161 tempest-UnshelveToHostMultiNodesTest-1598069161-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:26.570066 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-dd34b940-7270-49cd-aa32-139015f4cf85 tempest-UnshelveToHostMultiNodesTest-1598069161 tempest-UnshelveToHostMultiNodesTest-1598069161-project-admin] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:26.575973 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dd34b940-7270-49cd-aa32-139015f4cf85 tempest-UnshelveToHostMultiNodesTest-1598069161 tempest-UnshelveToHostMultiNodesTest-1598069161-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:26.577059 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dd34b940-7270-49cd-aa32-139015f4cf85 tempest-UnshelveToHostMultiNodesTest-1598069161 tempest-UnshelveToHostMultiNodesTest-1598069161-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:26.577966 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dd34b940-7270-49cd-aa32-139015f4cf85 tempest-UnshelveToHostMultiNodesTest-1598069161 tempest-UnshelveToHostMultiNodesTest-1598069161-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:26.578264 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dd34b940-7270-49cd-aa32-139015f4cf85 tempest-UnshelveToHostMultiNodesTest-1598069161 tempest-UnshelveToHostMultiNodesTest-1598069161-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:26.579329 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dd34b940-7270-49cd-aa32-139015f4cf85 tempest-UnshelveToHostMultiNodesTest-1598069161 tempest-UnshelveToHostMultiNodesTest-1598069161-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:26.579867 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dd34b940-7270-49cd-aa32-139015f4cf85 tempest-UnshelveToHostMultiNodesTest-1598069161 tempest-UnshelveToHostMultiNodesTest-1598069161-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:26.711846 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-dd34b940-7270-49cd-aa32-139015f4cf85 tempest-UnshelveToHostMultiNodesTest-1598069161 tempest-UnshelveToHostMultiNodesTest-1598069161-project-admin] Lazy-loading 'services' on Instance uuid 2b02272a-f8ed-45be-9d84-b9c143718689 {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:01:26.732000 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-dd34b940-7270-49cd-aa32-139015f4cf85 tempest-UnshelveToHostMultiNodesTest-1598069161 tempest-UnshelveToHostMultiNodesTest-1598069161-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1938 microversion: 2.91 time: 0.166363 Aug 31 16:01:26.732866 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 728/1465] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:01:26 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1938 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:01:26.737784 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f49d63bf-a905-4c2e-aa75-6f602631c679 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:26.738397 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f49d63bf-a905-4c2e-aa75-6f602631c679 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6c7489e2-1ba0-4689-b2d7-e37886757266] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:26.751632 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f49d63bf-a905-4c2e-aa75-6f602631c679 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:26.752502 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f49d63bf-a905-4c2e-aa75-6f602631c679 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:26.752949 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f49d63bf-a905-4c2e-aa75-6f602631c679 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:26.753740 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f49d63bf-a905-4c2e-aa75-6f602631c679 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:26.754238 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f49d63bf-a905-4c2e-aa75-6f602631c679 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:26.754531 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f49d63bf-a905-4c2e-aa75-6f602631c679 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:27.117390 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-21421d8d-98c3-4057-9833-002d756693cd tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lazy-loading 'services' on Instance uuid 35b89015-3888-493a-b521-49a5e3769b00 {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:01:27.132512 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-21421d8d-98c3-4057-9833-002d756693cd tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00" status: 200 len: 2345 microversion: 2.25 time: 0.757670 Aug 31 16:01:27.132827 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 738/1466] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:01:26 2022] GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00 => generated 2345 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:01:27.152323 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7cbbfcc4-4f28-40ad-bc95-1b64b355da9f tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:27.152827 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7cbbfcc4-4f28-40ad-bc95-1b64b355da9f tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:27.156502 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:01:27.162063 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7cbbfcc4-4f28-40ad-bc95-1b64b355da9f tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:27.162564 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7cbbfcc4-4f28-40ad-bc95-1b64b355da9f tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:27.163596 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7cbbfcc4-4f28-40ad-bc95-1b64b355da9f tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:27.164319 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7cbbfcc4-4f28-40ad-bc95-1b64b355da9f tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:27.164787 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7cbbfcc4-4f28-40ad-bc95-1b64b355da9f tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:27.165224 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7cbbfcc4-4f28-40ad-bc95-1b64b355da9f tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:27.192852 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7cbbfcc4-4f28-40ad-bc95-1b64b355da9f tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:01:27.262126 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f49d63bf-a905-4c2e-aa75-6f602631c679 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:27.272852 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f49d63bf-a905-4c2e-aa75-6f602631c679 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266" status: 200 len: 1313 microversion: 2.1 time: 0.539187 Aug 31 16:01:27.273832 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 729/1467] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:26 2022] GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266 => generated 1313 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:27.278504 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c8e47da4-e512-4598-8c9e-abdcd6dce685 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:27.279285 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c8e47da4-e512-4598-8c9e-abdcd6dce685 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: cc085aaa-21b2-48a6-b69c-de4e261dfe7f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:27.279547 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7cbbfcc4-4f28-40ad-bc95-1b64b355da9f tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "DELETE /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 204 len: 0 microversion: 2.91 time: 0.145229 Aug 31 16:01:27.280271 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 739/1468] 10.222.0.61 () {60 vars in 1280 bytes} [Wed Aug 31 16:01:27 2022] DELETE /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 16:01:27.286557 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c8e47da4-e512-4598-8c9e-abdcd6dce685 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:27.287136 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c8e47da4-e512-4598-8c9e-abdcd6dce685 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:27.287680 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c8e47da4-e512-4598-8c9e-abdcd6dce685 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:27.288455 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c8e47da4-e512-4598-8c9e-abdcd6dce685 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:27.288984 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c8e47da4-e512-4598-8c9e-abdcd6dce685 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:27.289560 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c8e47da4-e512-4598-8c9e-abdcd6dce685 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:27.293446 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a9d7b815-e678-4e0a-b7bc-ba25a562419a tempest-ServersAdminNegativeTestJSON-2114695108 tempest-ServersAdminNegativeTestJSON-2114695108-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:27.294162 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a9d7b815-e678-4e0a-b7bc-ba25a562419a tempest-ServersAdminNegativeTestJSON-2114695108 tempest-ServersAdminNegativeTestJSON-2114695108-project-admin] [instance: b82bda5d-2f6d-41e2-b9a4-180ba1d05652] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:27.300797 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a9d7b815-e678-4e0a-b7bc-ba25a562419a tempest-ServersAdminNegativeTestJSON-2114695108 tempest-ServersAdminNegativeTestJSON-2114695108-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:27.301298 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a9d7b815-e678-4e0a-b7bc-ba25a562419a tempest-ServersAdminNegativeTestJSON-2114695108 tempest-ServersAdminNegativeTestJSON-2114695108-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:27.301740 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a9d7b815-e678-4e0a-b7bc-ba25a562419a tempest-ServersAdminNegativeTestJSON-2114695108 tempest-ServersAdminNegativeTestJSON-2114695108-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:27.302454 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a9d7b815-e678-4e0a-b7bc-ba25a562419a tempest-ServersAdminNegativeTestJSON-2114695108 tempest-ServersAdminNegativeTestJSON-2114695108-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:27.302912 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a9d7b815-e678-4e0a-b7bc-ba25a562419a tempest-ServersAdminNegativeTestJSON-2114695108 tempest-ServersAdminNegativeTestJSON-2114695108-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:27.303436 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a9d7b815-e678-4e0a-b7bc-ba25a562419a tempest-ServersAdminNegativeTestJSON-2114695108 tempest-ServersAdminNegativeTestJSON-2114695108-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:27.684365 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c8e47da4-e512-4598-8c9e-abdcd6dce685 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:27.695116 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c8e47da4-e512-4598-8c9e-abdcd6dce685 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f" status: 200 len: 1719 microversion: 2.1 time: 0.420156 Aug 31 16:01:27.696203 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 730/1469] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:27 2022] GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f => generated 1719 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:27.701915 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a6e0e1f9-2dac-48a9-92fa-467c0f3a0fd9 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:27.702736 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a6e0e1f9-2dac-48a9-92fa-467c0f3a0fd9 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] [instance: 7523e0a9-60e8-42ba-b271-d63251e373b7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:27.706095 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:01:27.710655 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a6e0e1f9-2dac-48a9-92fa-467c0f3a0fd9 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:27.711485 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a6e0e1f9-2dac-48a9-92fa-467c0f3a0fd9 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:27.712775 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a6e0e1f9-2dac-48a9-92fa-467c0f3a0fd9 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:27.713659 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a6e0e1f9-2dac-48a9-92fa-467c0f3a0fd9 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:27.714148 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a6e0e1f9-2dac-48a9-92fa-467c0f3a0fd9 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:27.714754 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a6e0e1f9-2dac-48a9-92fa-467c0f3a0fd9 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:27.716437 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a9d7b815-e678-4e0a-b7bc-ba25a562419a tempest-ServersAdminNegativeTestJSON-2114695108 tempest-ServersAdminNegativeTestJSON-2114695108-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/b82bda5d-2f6d-41e2-b9a4-180ba1d05652" status: 200 len: 1614 microversion: 2.1 time: 0.434859 Aug 31 16:01:27.717376 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 740/1470] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:27 2022] GET /compute/v2.1/servers/b82bda5d-2f6d-41e2-b9a4-180ba1d05652 => generated 1614 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:27.723761 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-50a065a1-aace-42f2-920e-8c45f2295cbb tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:27.728082 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-50a065a1-aace-42f2-920e-8c45f2295cbb tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:27.728755 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-50a065a1-aace-42f2-920e-8c45f2295cbb tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:27.729378 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-50a065a1-aace-42f2-920e-8c45f2295cbb tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:27.730320 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-50a065a1-aace-42f2-920e-8c45f2295cbb tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:27.730945 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-50a065a1-aace-42f2-920e-8c45f2295cbb tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:27.731567 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-50a065a1-aace-42f2-920e-8c45f2295cbb tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:27.742589 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:01:27.762755 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-50a065a1-aace-42f2-920e-8c45f2295cbb tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] 10.222.0.61 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.043894 Aug 31 16:01:27.763969 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 741/1471] 10.222.0.61 () {60 vars in 1217 bytes} [Wed Aug 31 16:01:27 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 16:01:27.770208 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6b3fe4cd-0e12-4bdc-9303-a4ce3fe91dcb tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:27.771086 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6b3fe4cd-0e12-4bdc-9303-a4ce3fe91dcb tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:27.777891 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6b3fe4cd-0e12-4bdc-9303-a4ce3fe91dcb tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:27.778887 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6b3fe4cd-0e12-4bdc-9303-a4ce3fe91dcb tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:27.779532 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6b3fe4cd-0e12-4bdc-9303-a4ce3fe91dcb tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:27.780420 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6b3fe4cd-0e12-4bdc-9303-a4ce3fe91dcb tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:27.781245 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6b3fe4cd-0e12-4bdc-9303-a4ce3fe91dcb tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:27.781828 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6b3fe4cd-0e12-4bdc-9303-a4ce3fe91dcb tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:27.927781 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a6e0e1f9-2dac-48a9-92fa-467c0f3a0fd9 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90770e7e060c4ded869851dea068189c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab675eb7ef3e45e68d74d737484c6e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:27.939973 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a6e0e1f9-2dac-48a9-92fa-467c0f3a0fd9 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] 10.222.0.61 "GET /compute/v2.1/servers/7523e0a9-60e8-42ba-b271-d63251e373b7" status: 200 len: 1334 microversion: 2.1 time: 0.241927 Aug 31 16:01:27.943790 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 731/1472] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:27 2022] GET /compute/v2.1/servers/7523e0a9-60e8-42ba-b271-d63251e373b7 => generated 1334 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:27.952419 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-def02185-f607-4262-a92f-1588fd40206a tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:27.953309 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-def02185-f607-4262-a92f-1588fd40206a tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: 3f785545-d532-4487-b780-8a9be107a209] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:27.956751 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-6b3fe4cd-0e12-4bdc-9303-a4ce3fe91dcb tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:27.966684 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-def02185-f607-4262-a92f-1588fd40206a tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:27.967658 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-def02185-f607-4262-a92f-1588fd40206a tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:27.968255 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-def02185-f607-4262-a92f-1588fd40206a tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:27.969695 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-def02185-f607-4262-a92f-1588fd40206a tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:27.970461 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-def02185-f607-4262-a92f-1588fd40206a tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:27.971301 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-def02185-f607-4262-a92f-1588fd40206a tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:27.973416 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-6b3fe4cd-0e12-4bdc-9303-a4ce3fe91dcb tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:27.979375 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-6b3fe4cd-0e12-4bdc-9303-a4ce3fe91dcb tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:27.993785 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6b3fe4cd-0e12-4bdc-9303-a4ce3fe91dcb tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1539 microversion: 2.91 time: 0.228472 Aug 31 16:01:27.999912 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 742/1473] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:01:27 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1539 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:01:28.007135 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d853978e-5af2-4d26-848f-08be7d1df174 tempest-ServersAdminNegativeTestJSON-2114695108 tempest-ServersAdminNegativeTestJSON-2114695108-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:01:28.007817 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d853978e-5af2-4d26-848f-08be7d1df174 tempest-ServersAdminNegativeTestJSON-2114695108 tempest-ServersAdminNegativeTestJSON-2114695108-project-admin] [instance: b82bda5d-2f6d-41e2-b9a4-180ba1d05652] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:28.019755 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d853978e-5af2-4d26-848f-08be7d1df174 tempest-ServersAdminNegativeTestJSON-2114695108 tempest-ServersAdminNegativeTestJSON-2114695108-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:28.020264 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d853978e-5af2-4d26-848f-08be7d1df174 tempest-ServersAdminNegativeTestJSON-2114695108 tempest-ServersAdminNegativeTestJSON-2114695108-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:28.020927 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d853978e-5af2-4d26-848f-08be7d1df174 tempest-ServersAdminNegativeTestJSON-2114695108 tempest-ServersAdminNegativeTestJSON-2114695108-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:28.021985 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d853978e-5af2-4d26-848f-08be7d1df174 tempest-ServersAdminNegativeTestJSON-2114695108 tempest-ServersAdminNegativeTestJSON-2114695108-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:28.022628 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d853978e-5af2-4d26-848f-08be7d1df174 tempest-ServersAdminNegativeTestJSON-2114695108 tempest-ServersAdminNegativeTestJSON-2114695108-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:28.023284 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d853978e-5af2-4d26-848f-08be7d1df174 tempest-ServersAdminNegativeTestJSON-2114695108 tempest-ServersAdminNegativeTestJSON-2114695108-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:28.107459 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-d853978e-5af2-4d26-848f-08be7d1df174 tempest-ServersAdminNegativeTestJSON-2114695108 tempest-ServersAdminNegativeTestJSON-2114695108-project-admin] HTTP exception thrown: Cannot 'migrate' instance b82bda5d-2f6d-41e2-b9a4-180ba1d05652 while it is in vm_state suspended Aug 31 16:01:28.109435 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d853978e-5af2-4d26-848f-08be7d1df174 tempest-ServersAdminNegativeTestJSON-2114695108 tempest-ServersAdminNegativeTestJSON-2114695108-project-admin] Request method failure captured: Aug 31 16:01:28.109435 n-d-850499-9 devstack@n-api.service[122257]: request: POST /compute/v2.1/servers/b82bda5d-2f6d-41e2-b9a4-180ba1d05652/action HTTP/1.1 Aug 31 16:01:28.109435 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:01:28.109435 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:01:28.109435 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:01:28.109435 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 15 Aug 31 16:01:28.109435 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:01:28.109435 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:01:28.109435 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:01:28.109435 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:01:28.109435 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4WmttTKXgfXdytT2MSXw82W6_rYGER7QTtDOFW9BVZLaJgc8B-Kf83lSydNyCmATrb3tIaFY_i6AKxJ9DRibCDZCDjvfb7vabWn6pY80JznAcFGeiL7hd03gBQ_EK1T6uzUP6sHnyHjPz-fSpZ-Nk-2Ok_3jOaSn1lxRURh0D72N-8 Aug 31 16:01:28.109435 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:01:28.109435 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:01:28.109435 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:01:28.109435 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:01:28.109435 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:01:28.109435 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:01:28.109435 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 1ef27c92668d45c486212b31611361fe Aug 31 16:01:28.109435 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2114695108 Aug 31 16:01:28.109435 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,admin,member Aug 31 16:01:28.109435 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,admin,member Aug 31 16:01:28.111603 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1ef27c92668d45c486212b31611361fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1ef27c92668d45c486212b31611361fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1ef27c92668d45c486212b31611361fe", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1ef27c92668d45c486212b31611361fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:01:28.111603 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2114695108 Aug 31 16:01:28.111603 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 1ef27c92668d45c486212b31611361fe Aug 31 16:01:28.111603 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2114695108 Aug 31 16:01:28.111603 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ServersAdminNegativeTestJSON-2114695108-project-admin Aug 31 16:01:28.111603 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:01:28.111603 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:01:28.111603 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 9d31f46fc1914f30bf64465b2e4d35f3 Aug 31 16:01:28.111603 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2114695108-project-admin Aug 31 16:01:28.111603 n-d-850499-9 devstack@n-api.service[122257]: Aug 31 16:01:28.111603 n-d-850499-9 devstack@n-api.service[122257]: {"migrate": {}} Aug 31 16:01:28.111603 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:01:28.111603 n-d-850499-9 devstack@n-api.service[122257]: exception: Cannot 'migrate' instance b82bda5d-2f6d-41e2-b9a4-180ba1d05652 while it is in vm_state suspended Aug 31 16:01:28.112459 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': 'b82bda5d-2f6d-41e2-b9a4-180ba1d05652', 'body': {'migrate': {}}} Aug 31 16:01:28.112459 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:01:28.112459 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:01:28.112459 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Aug 31 16:01:28.112459 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Aug 31 16:01:28.112459 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 31 16:01:28.112459 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 16:01:28.112459 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 31 16:01:28.112459 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 31 16:01:28.112459 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 31 16:01:28.112459 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 31 16:01:28.112459 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 16:01:28.112459 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 16:01:28.112459 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 31 16:01:28.112459 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 31 16:01:28.112459 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b82bda5d-2f6d-41e2-b9a4-180ba1d05652 in vm_state suspended. Cannot resize while the instance is in this state. Aug 31 16:01:28.112459 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:01:28.112459 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:01:28.112459 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:01:28.112459 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:01:28.116649 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:01:28.116649 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:01:28.116649 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:01:28.116649 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:01:28.116649 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:01:28.116649 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:01:28.116649 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:01:28.116649 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:01:28.116649 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Aug 31 16:01:28.116649 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 31 16:01:28.116649 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 31 16:01:28.116649 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 31 16:01:28.116649 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance b82bda5d-2f6d-41e2-b9a4-180ba1d05652 while it is in vm_state suspended Aug 31 16:01:28.116649 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:01:28.116649 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:01:28.116649 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:01:28.116649 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:01:28.116649 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:01:28.116649 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:01:28.120188 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:01:28.120188 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:01:28.120188 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance b82bda5d-2f6d-41e2-b9a4-180ba1d05652 while it is in vm_state suspended Aug 31 16:01:28.120188 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:01:28.120188 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d853978e-5af2-4d26-848f-08be7d1df174 tempest-ServersAdminNegativeTestJSON-2114695108 tempest-ServersAdminNegativeTestJSON-2114695108-project-admin] Returning 409 to user: Cannot 'migrate' instance b82bda5d-2f6d-41e2-b9a4-180ba1d05652 while it is in vm_state suspended {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:01:28.120188 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d853978e-5af2-4d26-848f-08be7d1df174 tempest-ServersAdminNegativeTestJSON-2114695108 tempest-ServersAdminNegativeTestJSON-2114695108-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/b82bda5d-2f6d-41e2-b9a4-180ba1d05652/action" status: 409 len: 148 microversion: 2.1 time: 0.109242 Aug 31 16:01:28.120188 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 743/1474] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:01:27 2022] POST /compute/v2.1/servers/b82bda5d-2f6d-41e2-b9a4-180ba1d05652/action => generated 148 bytes in 114 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 31 16:01:28.134631 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-429d1919-7a89-4f25-9475-ba272ff11ce3 tempest-ServersAdminNegativeTestJSON-2114695108 tempest-ServersAdminNegativeTestJSON-2114695108-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:01:28.138681 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-429d1919-7a89-4f25-9475-ba272ff11ce3 tempest-ServersAdminNegativeTestJSON-2114695108 tempest-ServersAdminNegativeTestJSON-2114695108-project-admin] Request method failure captured: Aug 31 16:01:28.138681 n-d-850499-9 devstack@n-api.service[122257]: request: POST /compute/v2.1/servers/a50acb4f-16d0-4c72-b603-f795220ea866/action HTTP/1.1 Aug 31 16:01:28.138681 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:01:28.138681 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:01:28.138681 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:01:28.138681 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 39 Aug 31 16:01:28.138681 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:01:28.138681 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:01:28.138681 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:01:28.138681 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:01:28.138681 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4WmttTKXgfXdytT2MSXw82W6_rYGER7QTtDOFW9BVZLaJgc8B-Kf83lSydNyCmATrb3tIaFY_i6AKxJ9DRibCDZCDjvfb7vabWn6pY80JznAcFGeiL7hd03gBQ_EK1T6uzUP6sHnyHjPz-fSpZ-Nk-2Ok_3jOaSn1lxRURh0D72N-8 Aug 31 16:01:28.138681 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:01:28.138681 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:01:28.138681 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:01:28.138681 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:01:28.138681 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:01:28.138681 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:01:28.138681 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 1ef27c92668d45c486212b31611361fe Aug 31 16:01:28.138681 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2114695108 Aug 31 16:01:28.138681 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,admin,member Aug 31 16:01:28.138681 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,admin,member Aug 31 16:01:28.140316 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1ef27c92668d45c486212b31611361fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1ef27c92668d45c486212b31611361fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1ef27c92668d45c486212b31611361fe", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1ef27c92668d45c486212b31611361fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:01:28.140316 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2114695108 Aug 31 16:01:28.140316 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 1ef27c92668d45c486212b31611361fe Aug 31 16:01:28.140316 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2114695108 Aug 31 16:01:28.140316 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ServersAdminNegativeTestJSON-2114695108-project-admin Aug 31 16:01:28.140316 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:01:28.140316 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:01:28.140316 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 9d31f46fc1914f30bf64465b2e4d35f3 Aug 31 16:01:28.140316 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2114695108-project-admin Aug 31 16:01:28.140316 n-d-850499-9 devstack@n-api.service[122257]: Aug 31 16:01:28.140316 n-d-850499-9 devstack@n-api.service[122257]: {"os-resetState": {"state": "invalid"}} Aug 31 16:01:28.140316 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:01:28.146861 n-d-850499-9 devstack@n-api.service[122257]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 31 16:01:28.146861 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': 'a50acb4f-16d0-4c72-b603-f795220ea866', 'body': {'os-resetState': {'state': 'invalid'}}} Aug 31 16:01:28.146861 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:01:28.146861 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:01:28.146861 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 16:01:28.146861 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 16:01:28.146861 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 16:01:28.146861 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise error Aug 31 16:01:28.146861 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Aug 31 16:01:28.146861 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:01:28.146861 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Aug 31 16:01:28.146861 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Aug 31 16:01:28.146861 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:01:28.146861 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Aug 31 16:01:28.146861 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi 'invalid' Aug 31 16:01:28.146861 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:01:28.146861 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:01:28.146861 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:01:28.146861 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:01:28.146861 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:01:28.146861 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:01:28.146861 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:01:28.148650 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:01:28.148650 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:01:28.148650 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:01:28.148650 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 16:01:28.148650 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 16:01:28.148650 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 16:01:28.148650 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 16:01:28.148650 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 16:01:28.148650 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 16:01:28.148650 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 31 16:01:28.148650 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:01:28.148650 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:01:28.148650 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:01:28.148650 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:01:28.148650 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:01:28.148650 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:01:28.148650 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 16:01:28.148650 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 16:01:28.148650 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 31 16:01:28.150063 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:01:28.150063 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-429d1919-7a89-4f25-9475-ba272ff11ce3 tempest-ServersAdminNegativeTestJSON-2114695108 tempest-ServersAdminNegativeTestJSON-2114695108-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:01:28.150063 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-429d1919-7a89-4f25-9475-ba272ff11ce3 tempest-ServersAdminNegativeTestJSON-2114695108 tempest-ServersAdminNegativeTestJSON-2114695108-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/a50acb4f-16d0-4c72-b603-f795220ea866/action" status: 400 len: 144 microversion: 2.1 time: 0.008880 Aug 31 16:01:28.150063 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 744/1475] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:01:28 2022] POST /compute/v2.1/servers/a50acb4f-16d0-4c72-b603-f795220ea866/action => generated 144 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:01:28.151741 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-adc71398-5c28-4190-9292-78031eefadab tempest-ServersAdminNegativeTestJSON-2114695108 tempest-ServersAdminNegativeTestJSON-2114695108-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:01:28.156534 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-adc71398-5c28-4190-9292-78031eefadab tempest-ServersAdminNegativeTestJSON-2114695108 tempest-ServersAdminNegativeTestJSON-2114695108-project-admin] Request method failure captured: Aug 31 16:01:28.156534 n-d-850499-9 devstack@n-api.service[122257]: request: POST /compute/v2.1/servers/a50acb4f-16d0-4c72-b603-f795220ea866/action HTTP/1.1 Aug 31 16:01:28.156534 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:01:28.156534 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:01:28.156534 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:01:28.156534 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 31 Aug 31 16:01:28.156534 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:01:28.156534 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:01:28.156534 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:01:28.156534 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:01:28.156534 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4WmttTKXgfXdytT2MSXw82W6_rYGER7QTtDOFW9BVZLaJgc8B-Kf83lSydNyCmATrb3tIaFY_i6AKxJ9DRibCDZCDjvfb7vabWn6pY80JznAcFGeiL7hd03gBQ_EK1T6uzUP6sHnyHjPz-fSpZ-Nk-2Ok_3jOaSn1lxRURh0D72N-8 Aug 31 16:01:28.156534 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:01:28.156534 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:01:28.156534 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:01:28.156534 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:01:28.156534 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:01:28.156534 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:01:28.156534 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 1ef27c92668d45c486212b31611361fe Aug 31 16:01:28.156534 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2114695108 Aug 31 16:01:28.156534 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,admin,member Aug 31 16:01:28.156534 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,admin,member Aug 31 16:01:28.158538 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1ef27c92668d45c486212b31611361fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1ef27c92668d45c486212b31611361fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1ef27c92668d45c486212b31611361fe", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1ef27c92668d45c486212b31611361fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:01:28.158538 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2114695108 Aug 31 16:01:28.158538 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 1ef27c92668d45c486212b31611361fe Aug 31 16:01:28.158538 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2114695108 Aug 31 16:01:28.158538 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ServersAdminNegativeTestJSON-2114695108-project-admin Aug 31 16:01:28.158538 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:01:28.158538 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:01:28.158538 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 9d31f46fc1914f30bf64465b2e4d35f3 Aug 31 16:01:28.158538 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2114695108-project-admin Aug 31 16:01:28.158538 n-d-850499-9 devstack@n-api.service[122257]: Aug 31 16:01:28.158538 n-d-850499-9 devstack@n-api.service[122257]: {"os-resetState": {"state": 1}} Aug 31 16:01:28.158538 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:01:28.158538 n-d-850499-9 devstack@n-api.service[122257]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 31 16:01:28.159366 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': 'a50acb4f-16d0-4c72-b603-f795220ea866', 'body': {'os-resetState': {'state': 1}}} Aug 31 16:01:28.159366 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:01:28.159366 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:01:28.159366 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 16:01:28.159366 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 16:01:28.159366 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 16:01:28.159366 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise error Aug 31 16:01:28.159366 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Aug 31 16:01:28.159366 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:01:28.159366 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Aug 31 16:01:28.159366 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Aug 31 16:01:28.159366 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:01:28.159366 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Aug 31 16:01:28.159366 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi 1 Aug 31 16:01:28.159366 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:01:28.159366 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:01:28.159366 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:01:28.159366 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:01:28.159366 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:01:28.159366 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:01:28.159366 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:01:28.159366 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:01:28.167293 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:01:28.167293 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:01:28.167293 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 16:01:28.167293 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 16:01:28.167293 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 16:01:28.167293 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 16:01:28.167293 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 16:01:28.167293 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 16:01:28.167293 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 31 16:01:28.167293 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:01:28.167293 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:01:28.167293 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:01:28.167293 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:01:28.167293 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:01:28.167293 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:01:28.167293 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 16:01:28.167293 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 16:01:28.167293 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 31 16:01:28.167293 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:01:28.171011 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-adc71398-5c28-4190-9292-78031eefadab tempest-ServersAdminNegativeTestJSON-2114695108 tempest-ServersAdminNegativeTestJSON-2114695108-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:01:28.171011 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-adc71398-5c28-4190-9292-78031eefadab tempest-ServersAdminNegativeTestJSON-2114695108 tempest-ServersAdminNegativeTestJSON-2114695108-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/a50acb4f-16d0-4c72-b603-f795220ea866/action" status: 400 len: 120 microversion: 2.1 time: 0.012690 Aug 31 16:01:28.171011 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 745/1476] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:01:28 2022] POST /compute/v2.1/servers/a50acb4f-16d0-4c72-b603-f795220ea866/action => generated 120 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:01:28.171011 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8e2f6d4b-5e13-4e06-9f82-a4f547c53d99 tempest-ServersAdminNegativeTestJSON-2114695108 tempest-ServersAdminNegativeTestJSON-2114695108-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:01:28.183989 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8e2f6d4b-5e13-4e06-9f82-a4f547c53d99 tempest-ServersAdminNegativeTestJSON-2114695108 tempest-ServersAdminNegativeTestJSON-2114695108-project-admin] Failed to fetch instance by id 999 {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 31 16:01:28.186461 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-8e2f6d4b-5e13-4e06-9f82-a4f547c53d99 tempest-ServersAdminNegativeTestJSON-2114695108 tempest-ServersAdminNegativeTestJSON-2114695108-project-admin] HTTP exception thrown: Instance 999 could not be found. Aug 31 16:01:28.194907 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8e2f6d4b-5e13-4e06-9f82-a4f547c53d99 tempest-ServersAdminNegativeTestJSON-2114695108 tempest-ServersAdminNegativeTestJSON-2114695108-project-admin] Request method failure captured: Aug 31 16:01:28.194907 n-d-850499-9 devstack@n-api.service[122257]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Aug 31 16:01:28.194907 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:01:28.194907 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:01:28.194907 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:01:28.194907 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 37 Aug 31 16:01:28.194907 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:01:28.194907 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:01:28.194907 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:01:28.194907 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:01:28.194907 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4WmttTKXgfXdytT2MSXw82W6_rYGER7QTtDOFW9BVZLaJgc8B-Kf83lSydNyCmATrb3tIaFY_i6AKxJ9DRibCDZCDjvfb7vabWn6pY80JznAcFGeiL7hd03gBQ_EK1T6uzUP6sHnyHjPz-fSpZ-Nk-2Ok_3jOaSn1lxRURh0D72N-8 Aug 31 16:01:28.194907 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:01:28.194907 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:01:28.194907 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:01:28.194907 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:01:28.194907 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:01:28.194907 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:01:28.194907 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 1ef27c92668d45c486212b31611361fe Aug 31 16:01:28.194907 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2114695108 Aug 31 16:01:28.194907 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,admin,member Aug 31 16:01:28.194907 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,admin,member Aug 31 16:01:28.196627 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1ef27c92668d45c486212b31611361fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1ef27c92668d45c486212b31611361fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1ef27c92668d45c486212b31611361fe", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1ef27c92668d45c486212b31611361fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:01:28.196627 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2114695108 Aug 31 16:01:28.196627 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 1ef27c92668d45c486212b31611361fe Aug 31 16:01:28.196627 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2114695108 Aug 31 16:01:28.196627 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ServersAdminNegativeTestJSON-2114695108-project-admin Aug 31 16:01:28.196627 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:01:28.196627 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:01:28.196627 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 9d31f46fc1914f30bf64465b2e4d35f3 Aug 31 16:01:28.196627 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2114695108-project-admin Aug 31 16:01:28.196627 n-d-850499-9 devstack@n-api.service[122257]: Aug 31 16:01:28.196627 n-d-850499-9 devstack@n-api.service[122257]: {"os-resetState": {"state": "error"}} Aug 31 16:01:28.196627 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:01:28.196627 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance 999 could not be found. Aug 31 16:01:28.197579 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Aug 31 16:01:28.197579 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:01:28.197579 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:01:28.197579 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:01:28.197579 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:01:28.197579 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 31 16:01:28.197579 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 31 16:01:28.197579 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Aug 31 16:01:28.197579 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:01:28.197579 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:01:28.197579 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:01:28.197579 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:01:28.197579 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:01:28.197579 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:01:28.197579 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:01:28.197579 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:01:28.197579 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:01:28.197579 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:01:28.197579 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:01:28.197579 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:01:28.197579 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Aug 31 16:01:28.199111 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 31 16:01:28.199111 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:01:28.199111 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:01:28.199111 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Aug 31 16:01:28.199111 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:01:28.199111 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:01:28.199111 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:01:28.199111 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:01:28.199111 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:01:28.199111 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:01:28.199111 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:01:28.199111 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:01:28.199111 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Aug 31 16:01:28.199111 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:01:28.200286 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8e2f6d4b-5e13-4e06-9f82-a4f547c53d99 tempest-ServersAdminNegativeTestJSON-2114695108 tempest-ServersAdminNegativeTestJSON-2114695108-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:01:28.200579 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8e2f6d4b-5e13-4e06-9f82-a4f547c53d99 tempest-ServersAdminNegativeTestJSON-2114695108 tempest-ServersAdminNegativeTestJSON-2114695108-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.034540 Aug 31 16:01:28.203817 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 746/1477] 10.222.0.61 () {60 vars in 1179 bytes} [Wed Aug 31 16:01:28 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 31 16:01:28.214511 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-532ba2b8-ddf0-4726-9b29-3cfba589aa86 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:28.215111 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-532ba2b8-ddf0-4726-9b29-3cfba589aa86 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] [instance: b82bda5d-2f6d-41e2-b9a4-180ba1d05652] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:28.222490 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-532ba2b8-ddf0-4726-9b29-3cfba589aa86 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:28.224426 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-532ba2b8-ddf0-4726-9b29-3cfba589aa86 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:28.224974 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-532ba2b8-ddf0-4726-9b29-3cfba589aa86 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:28.226354 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-532ba2b8-ddf0-4726-9b29-3cfba589aa86 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:28.226903 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-532ba2b8-ddf0-4726-9b29-3cfba589aa86 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:28.227557 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-532ba2b8-ddf0-4726-9b29-3cfba589aa86 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:28.262517 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-532ba2b8-ddf0-4726-9b29-3cfba589aa86 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] [instance: b82bda5d-2f6d-41e2-b9a4-180ba1d05652] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:01:28.377754 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-def02185-f607-4262-a92f-1588fd40206a tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ccd03a4aa84f93bc26b438e1468f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a9f3fcc4b445349e5c66ff712e8598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:28.386977 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-def02185-f607-4262-a92f-1588fd40206a tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/servers/3f785545-d532-4487-b780-8a9be107a209" status: 200 len: 1307 microversion: 2.1 time: 0.441586 Aug 31 16:01:28.408692 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 732/1478] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:27 2022] GET /compute/v2.1/servers/3f785545-d532-4487-b780-8a9be107a209 => generated 1307 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:28.420068 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e576cc4f-b436-4779-9677-a5afb0e4a061 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:28.420917 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e576cc4f-b436-4779-9677-a5afb0e4a061 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6c7489e2-1ba0-4689-b2d7-e37886757266] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:28.428798 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e576cc4f-b436-4779-9677-a5afb0e4a061 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:28.429444 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e576cc4f-b436-4779-9677-a5afb0e4a061 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:28.430262 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e576cc4f-b436-4779-9677-a5afb0e4a061 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:28.431203 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e576cc4f-b436-4779-9677-a5afb0e4a061 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:28.431907 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e576cc4f-b436-4779-9677-a5afb0e4a061 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:28.432550 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e576cc4f-b436-4779-9677-a5afb0e4a061 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:28.555896 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-532ba2b8-ddf0-4726-9b29-3cfba589aa86 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] 10.222.0.61 "DELETE /compute/v2.1/servers/b82bda5d-2f6d-41e2-b9a4-180ba1d05652" status: 204 len: 0 microversion: 2.1 time: 0.345784 Aug 31 16:01:28.556281 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 747/1479] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:01:28 2022] DELETE /compute/v2.1/servers/b82bda5d-2f6d-41e2-b9a4-180ba1d05652 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:01:28.566156 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-62584508-3c8b-42d8-a214-8aaa4ffeb824 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:28.567014 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-62584508-3c8b-42d8-a214-8aaa4ffeb824 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] [instance: b82bda5d-2f6d-41e2-b9a4-180ba1d05652] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:28.575648 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-62584508-3c8b-42d8-a214-8aaa4ffeb824 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:28.576084 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-62584508-3c8b-42d8-a214-8aaa4ffeb824 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:28.576486 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-62584508-3c8b-42d8-a214-8aaa4ffeb824 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:28.577357 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-62584508-3c8b-42d8-a214-8aaa4ffeb824 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:28.577774 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-62584508-3c8b-42d8-a214-8aaa4ffeb824 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:28.578470 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-62584508-3c8b-42d8-a214-8aaa4ffeb824 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:28.669419 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e576cc4f-b436-4779-9677-a5afb0e4a061 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:28.686348 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e576cc4f-b436-4779-9677-a5afb0e4a061 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266" status: 200 len: 1313 microversion: 2.1 time: 0.275658 Aug 31 16:01:28.692071 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 733/1480] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:28 2022] GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266 => generated 1313 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:28.718877 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b0500101-f763-4a69-9964-d0d2011537f6 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:28.719818 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b0500101-f763-4a69-9964-d0d2011537f6 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: cc085aaa-21b2-48a6-b69c-de4e261dfe7f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:28.727225 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b0500101-f763-4a69-9964-d0d2011537f6 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:28.728177 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b0500101-f763-4a69-9964-d0d2011537f6 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:28.728953 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b0500101-f763-4a69-9964-d0d2011537f6 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:28.729999 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b0500101-f763-4a69-9964-d0d2011537f6 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:28.730721 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b0500101-f763-4a69-9964-d0d2011537f6 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:28.731365 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b0500101-f763-4a69-9964-d0d2011537f6 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:28.941797 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-62584508-3c8b-42d8-a214-8aaa4ffeb824 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6382b576b5404eb90214c00b62299b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7fb4ddb0e649edbe96d046cde6b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:28.954523 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-62584508-3c8b-42d8-a214-8aaa4ffeb824 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] 10.222.0.61 "GET /compute/v2.1/servers/b82bda5d-2f6d-41e2-b9a4-180ba1d05652" status: 200 len: 1469 microversion: 2.1 time: 0.391667 Aug 31 16:01:28.968113 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 748/1481] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:28 2022] GET /compute/v2.1/servers/b82bda5d-2f6d-41e2-b9a4-180ba1d05652 => generated 1469 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:28.979005 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ed5c730e-59c9-4e65-90e0-22ed9f4a27a0 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:28.979867 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ed5c730e-59c9-4e65-90e0-22ed9f4a27a0 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] [instance: 7523e0a9-60e8-42ba-b271-d63251e373b7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:28.986659 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ed5c730e-59c9-4e65-90e0-22ed9f4a27a0 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:28.995477 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ed5c730e-59c9-4e65-90e0-22ed9f4a27a0 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:28.995966 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ed5c730e-59c9-4e65-90e0-22ed9f4a27a0 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:28.996802 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ed5c730e-59c9-4e65-90e0-22ed9f4a27a0 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:28.997279 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ed5c730e-59c9-4e65-90e0-22ed9f4a27a0 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:28.997705 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ed5c730e-59c9-4e65-90e0-22ed9f4a27a0 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:29.113125 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b0500101-f763-4a69-9964-d0d2011537f6 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:29.129108 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b0500101-f763-4a69-9964-d0d2011537f6 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f" status: 200 len: 1719 microversion: 2.1 time: 0.411807 Aug 31 16:01:29.129881 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 734/1482] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:28 2022] GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f => generated 1719 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:01:29.146657 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f1ee4913-0b5f-46a5-bdb4-a0da5550deb6 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:29.146657 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f1ee4913-0b5f-46a5-bdb4-a0da5550deb6 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:29.164046 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f1ee4913-0b5f-46a5-bdb4-a0da5550deb6 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:29.164046 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f1ee4913-0b5f-46a5-bdb4-a0da5550deb6 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:29.164046 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f1ee4913-0b5f-46a5-bdb4-a0da5550deb6 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:29.169583 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f1ee4913-0b5f-46a5-bdb4-a0da5550deb6 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:29.170397 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f1ee4913-0b5f-46a5-bdb4-a0da5550deb6 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:29.171014 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f1ee4913-0b5f-46a5-bdb4-a0da5550deb6 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:29.285827 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f1ee4913-0b5f-46a5-bdb4-a0da5550deb6 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:29.297259 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f1ee4913-0b5f-46a5-bdb4-a0da5550deb6 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:29.300847 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f1ee4913-0b5f-46a5-bdb4-a0da5550deb6 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:29.308605 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f1ee4913-0b5f-46a5-bdb4-a0da5550deb6 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1539 microversion: 2.91 time: 0.174447 Aug 31 16:01:29.325066 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 735/1483] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:01:29 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1539 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:01:29.326794 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ed5c730e-59c9-4e65-90e0-22ed9f4a27a0 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90770e7e060c4ded869851dea068189c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab675eb7ef3e45e68d74d737484c6e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:29.336061 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ed5c730e-59c9-4e65-90e0-22ed9f4a27a0 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] 10.222.0.61 "GET /compute/v2.1/servers/7523e0a9-60e8-42ba-b271-d63251e373b7" status: 200 len: 1401 microversion: 2.1 time: 0.366666 Aug 31 16:01:29.339617 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 749/1484] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:28 2022] GET /compute/v2.1/servers/7523e0a9-60e8-42ba-b271-d63251e373b7 => generated 1401 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:29.416031 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-38484cde-9b11-4ddf-9a40-f82d5b57bf67 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:29.416974 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-38484cde-9b11-4ddf-9a40-f82d5b57bf67 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: 3f785545-d532-4487-b780-8a9be107a209] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:29.424953 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-38484cde-9b11-4ddf-9a40-f82d5b57bf67 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:29.425855 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-38484cde-9b11-4ddf-9a40-f82d5b57bf67 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:29.426413 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-38484cde-9b11-4ddf-9a40-f82d5b57bf67 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:29.427199 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-38484cde-9b11-4ddf-9a40-f82d5b57bf67 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:29.427755 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-38484cde-9b11-4ddf-9a40-f82d5b57bf67 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:29.428417 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-38484cde-9b11-4ddf-9a40-f82d5b57bf67 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:29.712609 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-03ff9a06-efe3-4e6b-b7a2-5d7fcaea10a4 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:29.713396 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-03ff9a06-efe3-4e6b-b7a2-5d7fcaea10a4 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6c7489e2-1ba0-4689-b2d7-e37886757266] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:29.731670 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-03ff9a06-efe3-4e6b-b7a2-5d7fcaea10a4 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:29.732374 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-03ff9a06-efe3-4e6b-b7a2-5d7fcaea10a4 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:29.732922 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-03ff9a06-efe3-4e6b-b7a2-5d7fcaea10a4 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:29.733917 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-03ff9a06-efe3-4e6b-b7a2-5d7fcaea10a4 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:29.734504 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-03ff9a06-efe3-4e6b-b7a2-5d7fcaea10a4 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:29.735029 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-03ff9a06-efe3-4e6b-b7a2-5d7fcaea10a4 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:29.741401 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-38484cde-9b11-4ddf-9a40-f82d5b57bf67 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ccd03a4aa84f93bc26b438e1468f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a9f3fcc4b445349e5c66ff712e8598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:29.753124 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-38484cde-9b11-4ddf-9a40-f82d5b57bf67 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/servers/3f785545-d532-4487-b780-8a9be107a209" status: 200 len: 1307 microversion: 2.1 time: 0.341290 Aug 31 16:01:29.767777 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 736/1485] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:29 2022] GET /compute/v2.1/servers/3f785545-d532-4487-b780-8a9be107a209 => generated 1307 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:29.859815 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-81df05c1-c335-4501-88e8-51d0c41bc167 req-2a395d84-c22d-4280-9511-9dc3033056f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f785545-d532-4487-b780-8a9be107a209", "name": "network-vif-plugged", "status": "completed", "tag": "52b6863f-3e1f-464d-9a16-40e07fe4f7c7"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:01:29.870560 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-81df05c1-c335-4501-88e8-51d0c41bc167 req-2a395d84-c22d-4280-9511-9dc3033056f6 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:29.871242 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-81df05c1-c335-4501-88e8-51d0c41bc167 req-2a395d84-c22d-4280-9511-9dc3033056f6 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:29.871811 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-81df05c1-c335-4501-88e8-51d0c41bc167 req-2a395d84-c22d-4280-9511-9dc3033056f6 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:29.890229 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-81df05c1-c335-4501-88e8-51d0c41bc167 req-2a395d84-c22d-4280-9511-9dc3033056f6 service nova] Creating event network-vif-plugged:52b6863f-3e1f-464d-9a16-40e07fe4f7c7 for instance 3f785545-d532-4487-b780-8a9be107a209 on n-h1-850499-9 Aug 31 16:01:29.896866 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-81df05c1-c335-4501-88e8-51d0c41bc167 req-2a395d84-c22d-4280-9511-9dc3033056f6 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040404 Aug 31 16:01:29.897800 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 737/1486] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:01:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:01:29.984082 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3ec69396-a131-4b65-b06a-8ca1b8a0d007 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:29.988574 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3ec69396-a131-4b65-b06a-8ca1b8a0d007 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] [instance: b82bda5d-2f6d-41e2-b9a4-180ba1d05652] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:30.001836 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3ec69396-a131-4b65-b06a-8ca1b8a0d007 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:30.003322 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3ec69396-a131-4b65-b06a-8ca1b8a0d007 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:30.004034 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3ec69396-a131-4b65-b06a-8ca1b8a0d007 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:30.004217 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-03ff9a06-efe3-4e6b-b7a2-5d7fcaea10a4 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:30.005239 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3ec69396-a131-4b65-b06a-8ca1b8a0d007 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:30.006115 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3ec69396-a131-4b65-b06a-8ca1b8a0d007 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:30.007910 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3ec69396-a131-4b65-b06a-8ca1b8a0d007 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:30.013221 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-03ff9a06-efe3-4e6b-b7a2-5d7fcaea10a4 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266" status: 200 len: 1313 microversion: 2.1 time: 0.304628 Aug 31 16:01:30.015554 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 750/1487] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:29 2022] GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266 => generated 1313 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:30.154441 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-837fb70d-7062-4543-8f03-bb3de18b3d9a tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:30.155310 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-837fb70d-7062-4543-8f03-bb3de18b3d9a tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: cc085aaa-21b2-48a6-b69c-de4e261dfe7f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:30.162545 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-837fb70d-7062-4543-8f03-bb3de18b3d9a tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:30.163258 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-837fb70d-7062-4543-8f03-bb3de18b3d9a tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:30.163730 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-837fb70d-7062-4543-8f03-bb3de18b3d9a tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:30.164442 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-837fb70d-7062-4543-8f03-bb3de18b3d9a tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:30.164909 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-837fb70d-7062-4543-8f03-bb3de18b3d9a tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:30.165531 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-837fb70d-7062-4543-8f03-bb3de18b3d9a tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:30.231416 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3ec69396-a131-4b65-b06a-8ca1b8a0d007 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6382b576b5404eb90214c00b62299b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7fb4ddb0e649edbe96d046cde6b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:30.240944 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3ec69396-a131-4b65-b06a-8ca1b8a0d007 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] 10.222.0.61 "GET /compute/v2.1/servers/b82bda5d-2f6d-41e2-b9a4-180ba1d05652" status: 200 len: 1469 microversion: 2.1 time: 0.262382 Aug 31 16:01:30.241735 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 738/1488] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:29 2022] GET /compute/v2.1/servers/b82bda5d-2f6d-41e2-b9a4-180ba1d05652 => generated 1469 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:01:30.337808 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d375bc75-3d97-47c6-ac89-c9a648528d3f tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:30.338646 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d375bc75-3d97-47c6-ac89-c9a648528d3f tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:30.345023 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d375bc75-3d97-47c6-ac89-c9a648528d3f tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:30.346812 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d375bc75-3d97-47c6-ac89-c9a648528d3f tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:30.347456 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d375bc75-3d97-47c6-ac89-c9a648528d3f tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:30.348308 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d375bc75-3d97-47c6-ac89-c9a648528d3f tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:30.348894 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d375bc75-3d97-47c6-ac89-c9a648528d3f tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:30.349570 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d375bc75-3d97-47c6-ac89-c9a648528d3f tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:30.489730 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d375bc75-3d97-47c6-ac89-c9a648528d3f tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:30.499069 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d375bc75-3d97-47c6-ac89-c9a648528d3f tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:30.500633 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d375bc75-3d97-47c6-ac89-c9a648528d3f tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:30.507025 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d375bc75-3d97-47c6-ac89-c9a648528d3f tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1539 microversion: 2.91 time: 0.173488 Aug 31 16:01:30.507818 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 739/1489] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:01:30 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1539 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:01:30.512724 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-45760923-d682-45d1-9b4c-7fe5cf6711be tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:30.513527 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-45760923-d682-45d1-9b4c-7fe5cf6711be tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] [instance: 7523e0a9-60e8-42ba-b271-d63251e373b7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:30.515010 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-837fb70d-7062-4543-8f03-bb3de18b3d9a tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:30.521262 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-45760923-d682-45d1-9b4c-7fe5cf6711be tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:30.521973 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-45760923-d682-45d1-9b4c-7fe5cf6711be tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:30.522414 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-45760923-d682-45d1-9b4c-7fe5cf6711be tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:30.523282 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-45760923-d682-45d1-9b4c-7fe5cf6711be tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:30.523947 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-45760923-d682-45d1-9b4c-7fe5cf6711be tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:30.524558 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-45760923-d682-45d1-9b4c-7fe5cf6711be tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:30.532480 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-837fb70d-7062-4543-8f03-bb3de18b3d9a tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f" status: 200 len: 1719 microversion: 2.1 time: 0.381955 Aug 31 16:01:30.545148 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 751/1490] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:30 2022] GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f => generated 1719 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:30.613907 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5b7b1ccd-45d3-45e8-ab7d-897b213797d9 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f9102430-f6a5-491b-a623-35d1d655660c", "device": "/dev/xvdb"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:01:30.616528 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5b7b1ccd-45d3-45e8-ab7d-897b213797d9 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 35b89015-3888-493a-b521-49a5e3769b00] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:30.623071 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b7b1ccd-45d3-45e8-ab7d-897b213797d9 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:30.623589 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b7b1ccd-45d3-45e8-ab7d-897b213797d9 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:30.624030 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b7b1ccd-45d3-45e8-ab7d-897b213797d9 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:30.625570 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b7b1ccd-45d3-45e8-ab7d-897b213797d9 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:30.626211 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b7b1ccd-45d3-45e8-ab7d-897b213797d9 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:30.627477 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b7b1ccd-45d3-45e8-ab7d-897b213797d9 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:30.793378 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-45760923-d682-45d1-9b4c-7fe5cf6711be tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90770e7e060c4ded869851dea068189c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab675eb7ef3e45e68d74d737484c6e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:30.802497 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-45760923-d682-45d1-9b4c-7fe5cf6711be tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] 10.222.0.61 "GET /compute/v2.1/servers/7523e0a9-60e8-42ba-b271-d63251e373b7" status: 200 len: 1401 microversion: 2.1 time: 0.293464 Aug 31 16:01:30.803526 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 740/1491] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:30 2022] GET /compute/v2.1/servers/7523e0a9-60e8-42ba-b271-d63251e373b7 => generated 1401 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:30.808496 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-400ee5b5-8a46-486d-92c6-826a6ab4065e req-b79a73d9-44bd-4a04-9875-6cad71181085 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7523e0a9-60e8-42ba-b271-d63251e373b7", "tag": "75f9e894-839c-40d9-9d82-24b08eceeda4"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:01:30.820162 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-400ee5b5-8a46-486d-92c6-826a6ab4065e req-b79a73d9-44bd-4a04-9875-6cad71181085 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:30.820769 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-400ee5b5-8a46-486d-92c6-826a6ab4065e req-b79a73d9-44bd-4a04-9875-6cad71181085 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:30.821301 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-400ee5b5-8a46-486d-92c6-826a6ab4065e req-b79a73d9-44bd-4a04-9875-6cad71181085 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:30.833052 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-400ee5b5-8a46-486d-92c6-826a6ab4065e req-b79a73d9-44bd-4a04-9875-6cad71181085 service nova] Creating event network-changed:75f9e894-839c-40d9-9d82-24b08eceeda4 for instance 7523e0a9-60e8-42ba-b271-d63251e373b7 on n-h2-850499-9 Aug 31 16:01:30.838814 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-400ee5b5-8a46-486d-92c6-826a6ab4065e req-b79a73d9-44bd-4a04-9875-6cad71181085 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033785 Aug 31 16:01:30.840168 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 741/1492] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:01:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:01:30.846840 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a1944a7f-0bc3-4ca3-a97f-4855e9e20f85 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:30.847642 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a1944a7f-0bc3-4ca3-a97f-4855e9e20f85 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: 3f785545-d532-4487-b780-8a9be107a209] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:30.853819 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a1944a7f-0bc3-4ca3-a97f-4855e9e20f85 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:30.854447 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a1944a7f-0bc3-4ca3-a97f-4855e9e20f85 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:30.855100 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a1944a7f-0bc3-4ca3-a97f-4855e9e20f85 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:30.855843 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a1944a7f-0bc3-4ca3-a97f-4855e9e20f85 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:30.856480 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a1944a7f-0bc3-4ca3-a97f-4855e9e20f85 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:30.856920 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a1944a7f-0bc3-4ca3-a97f-4855e9e20f85 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:31.085540 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a1944a7f-0bc3-4ca3-a97f-4855e9e20f85 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ccd03a4aa84f93bc26b438e1468f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a9f3fcc4b445349e5c66ff712e8598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:31.093724 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a1944a7f-0bc3-4ca3-a97f-4855e9e20f85 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/servers/3f785545-d532-4487-b780-8a9be107a209" status: 200 len: 1307 microversion: 2.1 time: 0.252225 Aug 31 16:01:31.094304 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 742/1493] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:30 2022] GET /compute/v2.1/servers/3f785545-d532-4487-b780-8a9be107a209 => generated 1307 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:31.099645 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-75a24dd0-0246-4f84-bd84-861d73e8e345 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:31.100331 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-75a24dd0-0246-4f84-bd84-861d73e8e345 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6c7489e2-1ba0-4689-b2d7-e37886757266] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:31.106620 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-75a24dd0-0246-4f84-bd84-861d73e8e345 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:31.107101 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-75a24dd0-0246-4f84-bd84-861d73e8e345 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:31.107557 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-75a24dd0-0246-4f84-bd84-861d73e8e345 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:31.108253 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-75a24dd0-0246-4f84-bd84-861d73e8e345 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:31.108708 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-75a24dd0-0246-4f84-bd84-861d73e8e345 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:31.109131 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-75a24dd0-0246-4f84-bd84-861d73e8e345 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:31.293473 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-75a24dd0-0246-4f84-bd84-861d73e8e345 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:31.303649 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-75a24dd0-0246-4f84-bd84-861d73e8e345 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266" status: 200 len: 1313 microversion: 2.1 time: 0.207720 Aug 31 16:01:31.304413 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 743/1494] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:31 2022] GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266 => generated 1313 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:31.326337 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-22d820d6-ae5e-42c4-be47-7a3e46ffc4c3 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:31.327095 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-22d820d6-ae5e-42c4-be47-7a3e46ffc4c3 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] [instance: b82bda5d-2f6d-41e2-b9a4-180ba1d05652] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:31.333880 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-22d820d6-ae5e-42c4-be47-7a3e46ffc4c3 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:31.334463 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-22d820d6-ae5e-42c4-be47-7a3e46ffc4c3 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:31.335225 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-22d820d6-ae5e-42c4-be47-7a3e46ffc4c3 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:31.336074 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-22d820d6-ae5e-42c4-be47-7a3e46ffc4c3 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:31.336618 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-22d820d6-ae5e-42c4-be47-7a3e46ffc4c3 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:31.337109 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-22d820d6-ae5e-42c4-be47-7a3e46ffc4c3 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:31.446800 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-22d820d6-ae5e-42c4-be47-7a3e46ffc4c3 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6382b576b5404eb90214c00b62299b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7fb4ddb0e649edbe96d046cde6b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:31.488657 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-22d820d6-ae5e-42c4-be47-7a3e46ffc4c3 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] 10.222.0.61 "GET /compute/v2.1/servers/b82bda5d-2f6d-41e2-b9a4-180ba1d05652" status: 200 len: 1427 microversion: 2.1 time: 0.172836 Aug 31 16:01:31.508786 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 744/1495] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:31 2022] GET /compute/v2.1/servers/b82bda5d-2f6d-41e2-b9a4-180ba1d05652 => generated 1427 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:31.538099 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5ee986e7-5638-4e25-89da-c235c6855079 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:31.539018 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5ee986e7-5638-4e25-89da-c235c6855079 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:31.545888 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5ee986e7-5638-4e25-89da-c235c6855079 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:31.546684 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5ee986e7-5638-4e25-89da-c235c6855079 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:31.547319 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5ee986e7-5638-4e25-89da-c235c6855079 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:31.548767 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5ee986e7-5638-4e25-89da-c235c6855079 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:31.550119 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5ee986e7-5638-4e25-89da-c235c6855079 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:31.550864 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5ee986e7-5638-4e25-89da-c235c6855079 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:31.647060 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5ee986e7-5638-4e25-89da-c235c6855079 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:31.657442 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5ee986e7-5638-4e25-89da-c235c6855079 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:31.659644 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5ee986e7-5638-4e25-89da-c235c6855079 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:31.665866 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5ee986e7-5638-4e25-89da-c235c6855079 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1539 microversion: 2.91 time: 0.131843 Aug 31 16:01:31.666521 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 745/1496] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:01:31 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1539 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:01:31.671344 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-58c825fc-d9ca-4de1-bc05-fa171872945b tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:31.672178 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-58c825fc-d9ca-4de1-bc05-fa171872945b tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: cc085aaa-21b2-48a6-b69c-de4e261dfe7f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:31.679111 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-58c825fc-d9ca-4de1-bc05-fa171872945b tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:31.680006 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-58c825fc-d9ca-4de1-bc05-fa171872945b tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:31.680601 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-58c825fc-d9ca-4de1-bc05-fa171872945b tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:31.681927 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-58c825fc-d9ca-4de1-bc05-fa171872945b tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:31.682546 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-58c825fc-d9ca-4de1-bc05-fa171872945b tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:31.683130 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-58c825fc-d9ca-4de1-bc05-fa171872945b tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:31.834976 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-58c825fc-d9ca-4de1-bc05-fa171872945b tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:31.845331 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-58c825fc-d9ca-4de1-bc05-fa171872945b tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f" status: 200 len: 1719 microversion: 2.1 time: 0.177539 Aug 31 16:01:31.856521 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 746/1497] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:31 2022] GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f => generated 1719 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:31.856521 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-597109e6-3d40-4080-ae7e-5020f66ddcda tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:31.856521 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-597109e6-3d40-4080-ae7e-5020f66ddcda tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] [instance: 7523e0a9-60e8-42ba-b271-d63251e373b7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:31.858242 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-597109e6-3d40-4080-ae7e-5020f66ddcda tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:31.858847 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-597109e6-3d40-4080-ae7e-5020f66ddcda tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:31.859396 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-597109e6-3d40-4080-ae7e-5020f66ddcda tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:31.860388 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-597109e6-3d40-4080-ae7e-5020f66ddcda tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:31.861475 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-597109e6-3d40-4080-ae7e-5020f66ddcda tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:31.861980 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-597109e6-3d40-4080-ae7e-5020f66ddcda tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:32.007790 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-597109e6-3d40-4080-ae7e-5020f66ddcda tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90770e7e060c4ded869851dea068189c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab675eb7ef3e45e68d74d737484c6e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:32.016707 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-597109e6-3d40-4080-ae7e-5020f66ddcda tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] 10.222.0.61 "GET /compute/v2.1/servers/7523e0a9-60e8-42ba-b271-d63251e373b7" status: 200 len: 1401 microversion: 2.1 time: 0.169347 Aug 31 16:01:32.017586 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 747/1498] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:31 2022] GET /compute/v2.1/servers/7523e0a9-60e8-42ba-b271-d63251e373b7 => generated 1401 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:32.115547 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9f646eef-fc91-4c47-88bc-8e048d3cfa40 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:32.116287 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9f646eef-fc91-4c47-88bc-8e048d3cfa40 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: 3f785545-d532-4487-b780-8a9be107a209] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:32.122636 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9f646eef-fc91-4c47-88bc-8e048d3cfa40 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:32.123215 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9f646eef-fc91-4c47-88bc-8e048d3cfa40 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:32.123758 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9f646eef-fc91-4c47-88bc-8e048d3cfa40 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:32.124556 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9f646eef-fc91-4c47-88bc-8e048d3cfa40 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:32.125080 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9f646eef-fc91-4c47-88bc-8e048d3cfa40 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:32.125574 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9f646eef-fc91-4c47-88bc-8e048d3cfa40 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:32.258465 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-9f646eef-fc91-4c47-88bc-8e048d3cfa40 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ccd03a4aa84f93bc26b438e1468f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a9f3fcc4b445349e5c66ff712e8598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:32.266561 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9f646eef-fc91-4c47-88bc-8e048d3cfa40 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/servers/3f785545-d532-4487-b780-8a9be107a209" status: 200 len: 1487 microversion: 2.1 time: 0.155930 Aug 31 16:01:32.267859 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 748/1499] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:32 2022] GET /compute/v2.1/servers/3f785545-d532-4487-b780-8a9be107a209 => generated 1487 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:01:32.287978 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-fa79de78-0640-43cd-95b9-6c34195a3c69 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:01:32.294029 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fa79de78-0640-43cd-95b9-6c34195a3c69 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:32.294522 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fa79de78-0640-43cd-95b9-6c34195a3c69 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:32.294965 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fa79de78-0640-43cd-95b9-6c34195a3c69 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:32.356812 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=100 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:01:32.365143 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-fa79de78-0640-43cd-95b9-6c34195a3c69 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: 3f785545-d532-4487-b780-8a9be107a209] Going to try to stop instance {{(pid=122256) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 31 16:01:32.427852 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-fa79de78-0640-43cd-95b9-6c34195a3c69 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "POST /compute/v2.1/servers/3f785545-d532-4487-b780-8a9be107a209/action" status: 202 len: 0 microversion: 2.1 time: 0.143683 Aug 31 16:01:32.430717 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 749/1500] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:01:32 2022] POST /compute/v2.1/servers/3f785545-d532-4487-b780-8a9be107a209/action => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 16:01:32.438591 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3347ae57-6578-4a98-8ac7-b704ef32ada8 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:32.440085 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3347ae57-6578-4a98-8ac7-b704ef32ada8 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6c7489e2-1ba0-4689-b2d7-e37886757266] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:32.452007 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3347ae57-6578-4a98-8ac7-b704ef32ada8 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:32.452628 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3347ae57-6578-4a98-8ac7-b704ef32ada8 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:32.453086 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3347ae57-6578-4a98-8ac7-b704ef32ada8 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:32.457180 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3347ae57-6578-4a98-8ac7-b704ef32ada8 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:32.458281 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3347ae57-6578-4a98-8ac7-b704ef32ada8 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:32.462928 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3347ae57-6578-4a98-8ac7-b704ef32ada8 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:32.625691 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3347ae57-6578-4a98-8ac7-b704ef32ada8 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:32.635094 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3347ae57-6578-4a98-8ac7-b704ef32ada8 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266" status: 200 len: 1313 microversion: 2.1 time: 0.202857 Aug 31 16:01:32.635988 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 750/1501] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:32 2022] GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266 => generated 1313 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:32.650448 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-21c2e0a8-1b1e-4d9a-bd2f-11b77da52ffb tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:32.651202 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-21c2e0a8-1b1e-4d9a-bd2f-11b77da52ffb tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: 3f785545-d532-4487-b780-8a9be107a209] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:32.657430 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-21c2e0a8-1b1e-4d9a-bd2f-11b77da52ffb tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:32.658735 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-21c2e0a8-1b1e-4d9a-bd2f-11b77da52ffb tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:32.659932 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-21c2e0a8-1b1e-4d9a-bd2f-11b77da52ffb tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:32.661112 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-21c2e0a8-1b1e-4d9a-bd2f-11b77da52ffb tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:32.661931 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-21c2e0a8-1b1e-4d9a-bd2f-11b77da52ffb tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:32.662580 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-21c2e0a8-1b1e-4d9a-bd2f-11b77da52ffb tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:32.811962 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-21c2e0a8-1b1e-4d9a-bd2f-11b77da52ffb tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ccd03a4aa84f93bc26b438e1468f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a9f3fcc4b445349e5c66ff712e8598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:32.820767 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-21c2e0a8-1b1e-4d9a-bd2f-11b77da52ffb tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/servers/3f785545-d532-4487-b780-8a9be107a209" status: 200 len: 1497 microversion: 2.1 time: 0.175082 Aug 31 16:01:32.821337 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 751/1502] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:32 2022] GET /compute/v2.1/servers/3f785545-d532-4487-b780-8a9be107a209 => generated 1497 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:32.839633 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6b04432e-db1a-4311-b255-082ffba937fd tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:32.840250 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6b04432e-db1a-4311-b255-082ffba937fd tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] [instance: b82bda5d-2f6d-41e2-b9a4-180ba1d05652] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:32.846516 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6b04432e-db1a-4311-b255-082ffba937fd tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:32.847013 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6b04432e-db1a-4311-b255-082ffba937fd tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:32.847459 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6b04432e-db1a-4311-b255-082ffba937fd tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:32.848223 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6b04432e-db1a-4311-b255-082ffba937fd tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:32.848686 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6b04432e-db1a-4311-b255-082ffba937fd tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:32.849116 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6b04432e-db1a-4311-b255-082ffba937fd tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:32.864346 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-6b04432e-db1a-4311-b255-082ffba937fd tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] HTTP exception thrown: Instance b82bda5d-2f6d-41e2-b9a4-180ba1d05652 could not be found. Aug 31 16:01:32.866017 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6b04432e-db1a-4311-b255-082ffba937fd tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Request method failure captured: Aug 31 16:01:32.866017 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/b82bda5d-2f6d-41e2-b9a4-180ba1d05652 HTTP/1.1 Aug 31 16:01:32.866017 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:01:32.866017 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:01:32.866017 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:01:32.866017 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:01:32.866017 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:01:32.866017 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:01:32.866017 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:01:32.866017 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:01:32.866017 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4WlPps4ijbscj4lLSsLUY9ib__6pR4jyelLr9Eni503WTypWsjadRjCxHsY-gn9tlqMc4-GtwzAB78PIDoZWWbv9hfjleTPnoSKJo9WyE8TS3_irLCDnQFBB9GjbJOlpOpejNZ1KQntcI44uRsnmLMQYuCNY5nQlq4qg26Dk9n_rxo Aug 31 16:01:32.866017 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:01:32.866017 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:01:32.866017 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:01:32.866017 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:01:32.866017 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:01:32.866017 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:01:32.866017 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 2b7fb4ddb0e649edbe96d046cde6b1a6 Aug 31 16:01:32.866017 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1786123842 Aug 31 16:01:32.866017 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:01:32.866017 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:01:32.867774 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2b7fb4ddb0e649edbe96d046cde6b1a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/2b7fb4ddb0e649edbe96d046cde6b1a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_2b7fb4ddb0e649edbe96d046cde6b1a6", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2b7fb4ddb0e649edbe96d046cde6b1a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:01:32.867774 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1786123842 Aug 31 16:01:32.867774 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 2b7fb4ddb0e649edbe96d046cde6b1a6 Aug 31 16:01:32.867774 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1786123842 Aug 31 16:01:32.867774 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ServersAdminNegativeTestJSON-1786123842-project Aug 31 16:01:32.867774 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:01:32.867774 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:01:32.867774 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 7d6382b576b5404eb90214c00b62299b Aug 31 16:01:32.867774 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1786123842-project Aug 31 16:01:32.867774 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:01:32.867774 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance b82bda5d-2f6d-41e2-b9a4-180ba1d05652 could not be found. Aug 31 16:01:32.867774 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': 'b82bda5d-2f6d-41e2-b9a4-180ba1d05652'} Aug 31 16:01:32.868725 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:01:32.868725 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:01:32.868725 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:01:32.868725 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:01:32.868725 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:01:32.868725 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:01:32.868725 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:01:32.868725 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:01:32.868725 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:01:32.868725 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:01:32.868725 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b82bda5d-2f6d-41e2-b9a4-180ba1d05652 could not be found. Aug 31 16:01:32.868725 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:01:32.868725 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:01:32.868725 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:01:32.868725 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:01:32.868725 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:01:32.868725 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:01:32.868725 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:01:32.868725 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:01:32.868725 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:01:32.870320 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:01:32.870320 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:01:32.870320 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:01:32.870320 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:01:32.870320 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:01:32.870320 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:01:32.870320 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:01:32.870320 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b82bda5d-2f6d-41e2-b9a4-180ba1d05652 could not be found. Aug 31 16:01:32.870320 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:01:32.870320 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:01:32.870320 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:01:32.870320 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:01:32.870320 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:01:32.870320 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:01:32.870320 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:01:32.870320 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:01:32.870320 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b82bda5d-2f6d-41e2-b9a4-180ba1d05652 could not be found. Aug 31 16:01:32.870320 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:01:32.872681 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6b04432e-db1a-4311-b255-082ffba937fd tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Returning 404 to user: Instance b82bda5d-2f6d-41e2-b9a4-180ba1d05652 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:01:32.872681 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6b04432e-db1a-4311-b255-082ffba937fd tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] 10.222.0.61 "GET /compute/v2.1/servers/b82bda5d-2f6d-41e2-b9a4-180ba1d05652" status: 404 len: 111 microversion: 2.1 time: 0.031616 Aug 31 16:01:32.872681 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 752/1503] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:32 2022] GET /compute/v2.1/servers/b82bda5d-2f6d-41e2-b9a4-180ba1d05652 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:01:32.872681 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c91f3bf1-60ea-4d01-9c22-e4cf4404fcf7 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:32.873724 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c91f3bf1-60ea-4d01-9c22-e4cf4404fcf7 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:32.880365 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c91f3bf1-60ea-4d01-9c22-e4cf4404fcf7 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:32.880898 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c91f3bf1-60ea-4d01-9c22-e4cf4404fcf7 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:32.881368 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c91f3bf1-60ea-4d01-9c22-e4cf4404fcf7 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:32.882079 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c91f3bf1-60ea-4d01-9c22-e4cf4404fcf7 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:32.882546 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c91f3bf1-60ea-4d01-9c22-e4cf4404fcf7 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:32.882981 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c91f3bf1-60ea-4d01-9c22-e4cf4404fcf7 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:32.949384 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c91f3bf1-60ea-4d01-9c22-e4cf4404fcf7 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:32.958639 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c91f3bf1-60ea-4d01-9c22-e4cf4404fcf7 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:32.960598 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c91f3bf1-60ea-4d01-9c22-e4cf4404fcf7 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d70744565b448e8b96296d805399870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b7b1a3ebd74953ade59c2ced703592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:32.965924 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c91f3bf1-60ea-4d01-9c22-e4cf4404fcf7 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 200 len: 1539 microversion: 2.91 time: 0.096722 Aug 31 16:01:32.977162 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 753/1504] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:01:32 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 1539 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:01:32.977162 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-28a55a12-df19-476f-8696-06b80ad81292 req-72db4715-2346-4543-a3a6-f8193b473a5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b82bda5d-2f6d-41e2-b9a4-180ba1d05652", "name": "network-vif-deleted", "tag": "eed0bb35-bf3a-4d7f-a9f5-6c29c4e94d6a"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:01:32.981899 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-28a55a12-df19-476f-8696-06b80ad81292 req-72db4715-2346-4543-a3a6-f8193b473a5c service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:32.982565 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-28a55a12-df19-476f-8696-06b80ad81292 req-72db4715-2346-4543-a3a6-f8193b473a5c service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:32.983168 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-28a55a12-df19-476f-8696-06b80ad81292 req-72db4715-2346-4543-a3a6-f8193b473a5c service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:32.995608 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-28a55a12-df19-476f-8696-06b80ad81292 req-72db4715-2346-4543-a3a6-f8193b473a5c service nova] Creating event network-vif-deleted:eed0bb35-bf3a-4d7f-a9f5-6c29c4e94d6a for instance b82bda5d-2f6d-41e2-b9a4-180ba1d05652 on n-h1-850499-9 Aug 31 16:01:33.002288 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-28a55a12-df19-476f-8696-06b80ad81292 req-72db4715-2346-4543-a3a6-f8193b473a5c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033359 Aug 31 16:01:33.003392 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 754/1505] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:01:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:01:33.010450 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-173961a3-eb94-4f4e-a753-8d9bdc998a77 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:33.011167 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-173961a3-eb94-4f4e-a753-8d9bdc998a77 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: cc085aaa-21b2-48a6-b69c-de4e261dfe7f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:33.017964 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-173961a3-eb94-4f4e-a753-8d9bdc998a77 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:33.018324 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-173961a3-eb94-4f4e-a753-8d9bdc998a77 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:33.018985 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-173961a3-eb94-4f4e-a753-8d9bdc998a77 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:33.019736 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-173961a3-eb94-4f4e-a753-8d9bdc998a77 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:33.020285 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-173961a3-eb94-4f4e-a753-8d9bdc998a77 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:33.020725 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-173961a3-eb94-4f4e-a753-8d9bdc998a77 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:33.211343 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5b7b1ccd-45d3-45e8-ab7d-897b213797d9 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "POST /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 2.601913 Aug 31 16:01:33.213163 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 752/1506] 10.222.0.61 () {62 vars in 1364 bytes} [Wed Aug 31 16:01:30 2022] POST /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00/os-volume_attachments => generated 194 bytes in 2605 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 16:01:33.219490 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3105da21-aa9f-45bb-b425-c6bb6fd51fd5 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:33.220734 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3105da21-aa9f-45bb-b425-c6bb6fd51fd5 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] [instance: a50acb4f-16d0-4c72-b603-f795220ea866] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:33.230127 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3105da21-aa9f-45bb-b425-c6bb6fd51fd5 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:33.231010 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3105da21-aa9f-45bb-b425-c6bb6fd51fd5 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:33.231472 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3105da21-aa9f-45bb-b425-c6bb6fd51fd5 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:33.232417 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3105da21-aa9f-45bb-b425-c6bb6fd51fd5 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:33.233311 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3105da21-aa9f-45bb-b425-c6bb6fd51fd5 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:33.234043 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3105da21-aa9f-45bb-b425-c6bb6fd51fd5 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:33.257904 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:01:33.268925 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3105da21-aa9f-45bb-b425-c6bb6fd51fd5 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] [instance: a50acb4f-16d0-4c72-b603-f795220ea866] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:01:33.388018 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3105da21-aa9f-45bb-b425-c6bb6fd51fd5 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] 10.222.0.61 "DELETE /compute/v2.1/servers/a50acb4f-16d0-4c72-b603-f795220ea866" status: 204 len: 0 microversion: 2.1 time: 0.172975 Aug 31 16:01:33.388927 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 753/1507] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:01:33 2022] DELETE /compute/v2.1/servers/a50acb4f-16d0-4c72-b603-f795220ea866 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:01:33.394831 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b8d2ce54-c665-4567-9245-cb0a47bca34d tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:33.395629 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b8d2ce54-c665-4567-9245-cb0a47bca34d tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] [instance: 7523e0a9-60e8-42ba-b271-d63251e373b7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:33.402015 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b8d2ce54-c665-4567-9245-cb0a47bca34d tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:33.402506 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b8d2ce54-c665-4567-9245-cb0a47bca34d tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:33.402945 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b8d2ce54-c665-4567-9245-cb0a47bca34d tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:33.403691 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b8d2ce54-c665-4567-9245-cb0a47bca34d tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:33.404152 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b8d2ce54-c665-4567-9245-cb0a47bca34d tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:33.404581 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b8d2ce54-c665-4567-9245-cb0a47bca34d tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:33.769576 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-173961a3-eb94-4f4e-a753-8d9bdc998a77 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:33.777771 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-173961a3-eb94-4f4e-a753-8d9bdc998a77 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f" status: 200 len: 1719 microversion: 2.1 time: 0.772488 Aug 31 16:01:33.778351 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 755/1508] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:33 2022] GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f => generated 1719 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:33.782222 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b8d2ce54-c665-4567-9245-cb0a47bca34d tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90770e7e060c4ded869851dea068189c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab675eb7ef3e45e68d74d737484c6e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:33.784075 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-462c1df2-158f-4cfb-8f4d-2ba807b4f25f tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:33.784714 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-462c1df2-158f-4cfb-8f4d-2ba807b4f25f tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] [instance: a50acb4f-16d0-4c72-b603-f795220ea866] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:33.792157 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b8d2ce54-c665-4567-9245-cb0a47bca34d tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] 10.222.0.61 "GET /compute/v2.1/servers/7523e0a9-60e8-42ba-b271-d63251e373b7" status: 200 len: 1401 microversion: 2.1 time: 0.402201 Aug 31 16:01:33.792743 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 754/1509] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:33 2022] GET /compute/v2.1/servers/7523e0a9-60e8-42ba-b271-d63251e373b7 => generated 1401 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:33.794622 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-462c1df2-158f-4cfb-8f4d-2ba807b4f25f tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:33.795126 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-462c1df2-158f-4cfb-8f4d-2ba807b4f25f tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:33.795761 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-462c1df2-158f-4cfb-8f4d-2ba807b4f25f tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:33.796481 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-462c1df2-158f-4cfb-8f4d-2ba807b4f25f tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:33.796951 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-462c1df2-158f-4cfb-8f4d-2ba807b4f25f tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:33.797142 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c200d0b6-1b09-4365-8fe7-433be3586e55 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:33.797388 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-462c1df2-158f-4cfb-8f4d-2ba807b4f25f tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:33.797762 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c200d0b6-1b09-4365-8fe7-433be3586e55 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6c7489e2-1ba0-4689-b2d7-e37886757266] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:33.803656 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c200d0b6-1b09-4365-8fe7-433be3586e55 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:33.804141 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c200d0b6-1b09-4365-8fe7-433be3586e55 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:33.804571 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c200d0b6-1b09-4365-8fe7-433be3586e55 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:33.805258 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c200d0b6-1b09-4365-8fe7-433be3586e55 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:33.805707 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c200d0b6-1b09-4365-8fe7-433be3586e55 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:33.806128 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c200d0b6-1b09-4365-8fe7-433be3586e55 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:34.002040 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-462c1df2-158f-4cfb-8f4d-2ba807b4f25f tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6382b576b5404eb90214c00b62299b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7fb4ddb0e649edbe96d046cde6b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:34.006816 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c200d0b6-1b09-4365-8fe7-433be3586e55 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:34.009887 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-462c1df2-158f-4cfb-8f4d-2ba807b4f25f tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] 10.222.0.61 "GET /compute/v2.1/servers/a50acb4f-16d0-4c72-b603-f795220ea866" status: 200 len: 1477 microversion: 2.1 time: 0.230564 Aug 31 16:01:34.010468 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 756/1510] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:33 2022] GET /compute/v2.1/servers/a50acb4f-16d0-4c72-b603-f795220ea866 => generated 1477 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:34.014668 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c200d0b6-1b09-4365-8fe7-433be3586e55 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266" status: 200 len: 1313 microversion: 2.1 time: 0.220938 Aug 31 16:01:34.015131 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5031d47a-c474-407e-a5f2-8fad4ec0faab tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:34.015252 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 755/1511] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:33 2022] GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266 => generated 1313 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:34.019234 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5031d47a-c474-407e-a5f2-8fad4ec0faab tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: 3f785545-d532-4487-b780-8a9be107a209] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:34.020543 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0dc142a3-2b77-4ac9-a50f-8864220723d8 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:34.021145 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0dc142a3-2b77-4ac9-a50f-8864220723d8 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] [instance: 2b02272a-f8ed-45be-9d84-b9c143718689] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:34.027027 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5031d47a-c474-407e-a5f2-8fad4ec0faab tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:34.027644 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0dc142a3-2b77-4ac9-a50f-8864220723d8 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:34.027772 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5031d47a-c474-407e-a5f2-8fad4ec0faab tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:34.028130 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0dc142a3-2b77-4ac9-a50f-8864220723d8 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:34.028463 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5031d47a-c474-407e-a5f2-8fad4ec0faab tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:34.029368 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0dc142a3-2b77-4ac9-a50f-8864220723d8 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:34.029520 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5031d47a-c474-407e-a5f2-8fad4ec0faab tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:34.029908 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5031d47a-c474-407e-a5f2-8fad4ec0faab tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:34.030288 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0dc142a3-2b77-4ac9-a50f-8864220723d8 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:34.030415 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5031d47a-c474-407e-a5f2-8fad4ec0faab tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:34.030566 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0dc142a3-2b77-4ac9-a50f-8864220723d8 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:34.031086 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0dc142a3-2b77-4ac9-a50f-8864220723d8 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:34.045843 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-0dc142a3-2b77-4ac9-a50f-8864220723d8 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] HTTP exception thrown: Instance 2b02272a-f8ed-45be-9d84-b9c143718689 could not be found. Aug 31 16:01:34.047668 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0dc142a3-2b77-4ac9-a50f-8864220723d8 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Request method failure captured: Aug 31 16:01:34.047668 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 HTTP/1.1 Aug 31 16:01:34.047668 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:01:34.047668 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:01:34.047668 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:01:34.047668 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:01:34.047668 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:01:34.047668 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:01:34.047668 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:01:34.047668 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:01:34.047668 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4UV-HhQzHITm0WInrYnM3QPVGp2Jn7lMA29LwpglBAaxBs4cFYv8ZeJv2H6lcT83U-rHkpU3Ju7T2MOM8LMRhhiWepRHTMgJhh3c3TnSmaqTX-V1PL95vFwrbEZZ0jGz9mDqdxHzZ8ZmHXF6uY1_osw8lsnKNZUIG7-mQ4s-HxsUz8 Aug 31 16:01:34.047668 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:01:34.047668 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:01:34.047668 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:01:34.047668 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:01:34.047668 n-d-850499-9 devstack@n-api.service[122257]: X-Openstack-Nova-Api-Version: 2.91 Aug 31 16:01:34.047668 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:01:34.047668 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:01:34.047668 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 27b7b1a3ebd74953ade59c2ced703592 Aug 31 16:01:34.047668 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-1583586919 Aug 31 16:01:34.047668 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:01:34.047668 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:01:34.049446 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/27b7b1a3ebd74953ade59c2ced703592"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/27b7b1a3ebd74953ade59c2ced703592"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_27b7b1a3ebd74953ade59c2ced703592", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/27b7b1a3ebd74953ade59c2ced703592"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:01:34.049446 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-1583586919 Aug 31 16:01:34.049446 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 27b7b1a3ebd74953ade59c2ced703592 Aug 31 16:01:34.049446 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-1583586919 Aug 31 16:01:34.049446 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-UnshelveToHostMultiNodesTest-1583586919-project Aug 31 16:01:34.049446 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:01:34.049446 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:01:34.049446 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 7d70744565b448e8b96296d805399870 Aug 31 16:01:34.049446 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-1583586919-project Aug 31 16:01:34.049446 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:01:34.049446 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance 2b02272a-f8ed-45be-9d84-b9c143718689 could not be found. Aug 31 16:01:34.049446 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '2b02272a-f8ed-45be-9d84-b9c143718689'} Aug 31 16:01:34.050315 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:01:34.050315 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:01:34.050315 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:01:34.050315 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:01:34.050315 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:01:34.050315 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:01:34.050315 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:01:34.050315 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:01:34.050315 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:01:34.050315 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:01:34.050315 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b02272a-f8ed-45be-9d84-b9c143718689 could not be found. Aug 31 16:01:34.050315 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:01:34.050315 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:01:34.050315 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:01:34.050315 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:01:34.050315 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:01:34.050315 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:01:34.050315 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:01:34.050315 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:01:34.050315 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:01:34.051587 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:01:34.051587 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:01:34.051587 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:01:34.051587 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:01:34.051587 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:01:34.051587 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:01:34.051587 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:01:34.051587 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b02272a-f8ed-45be-9d84-b9c143718689 could not be found. Aug 31 16:01:34.051587 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:01:34.051587 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:01:34.051587 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:01:34.051587 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:01:34.051587 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:01:34.051587 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:01:34.051587 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:01:34.051587 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:01:34.051587 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b02272a-f8ed-45be-9d84-b9c143718689 could not be found. Aug 31 16:01:34.051587 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:01:34.052731 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0dc142a3-2b77-4ac9-a50f-8864220723d8 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] Returning 404 to user: Instance 2b02272a-f8ed-45be-9d84-b9c143718689 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:01:34.052731 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0dc142a3-2b77-4ac9-a50f-8864220723d8 tempest-UnshelveToHostMultiNodesTest-1583586919 tempest-UnshelveToHostMultiNodesTest-1583586919-project] 10.222.0.61 "GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689" status: 404 len: 111 microversion: 2.91 time: 0.033051 Aug 31 16:01:34.052731 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 756/1512] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:01:34 2022] GET /compute/v2.1/servers/2b02272a-f8ed-45be-9d84-b9c143718689 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:01:34.168724 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5031d47a-c474-407e-a5f2-8fad4ec0faab tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ccd03a4aa84f93bc26b438e1468f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a9f3fcc4b445349e5c66ff712e8598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:34.176624 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5031d47a-c474-407e-a5f2-8fad4ec0faab tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/servers/3f785545-d532-4487-b780-8a9be107a209" status: 200 len: 1497 microversion: 2.1 time: 0.164970 Aug 31 16:01:34.177199 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 757/1513] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:34 2022] GET /compute/v2.1/servers/3f785545-d532-4487-b780-8a9be107a209 => generated 1497 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:34.801682 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ebd1e614-440d-4f54-9a1d-a1994350b803 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:34.802374 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ebd1e614-440d-4f54-9a1d-a1994350b803 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: cc085aaa-21b2-48a6-b69c-de4e261dfe7f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:34.805812 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=26 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:01:34.817477 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a7208b5b-644d-4d5a-b8ed-e6ef8f2e723d tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:34.818245 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a7208b5b-644d-4d5a-b8ed-e6ef8f2e723d tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] [instance: 7523e0a9-60e8-42ba-b271-d63251e373b7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:34.823246 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:01:34.828416 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ebd1e614-440d-4f54-9a1d-a1994350b803 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:34.829128 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ebd1e614-440d-4f54-9a1d-a1994350b803 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:34.830036 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ebd1e614-440d-4f54-9a1d-a1994350b803 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:34.830341 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a7208b5b-644d-4d5a-b8ed-e6ef8f2e723d tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:34.831092 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ebd1e614-440d-4f54-9a1d-a1994350b803 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:34.831230 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a7208b5b-644d-4d5a-b8ed-e6ef8f2e723d tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:34.831714 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ebd1e614-440d-4f54-9a1d-a1994350b803 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:34.832386 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ebd1e614-440d-4f54-9a1d-a1994350b803 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:34.832554 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a7208b5b-644d-4d5a-b8ed-e6ef8f2e723d tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:34.833470 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a7208b5b-644d-4d5a-b8ed-e6ef8f2e723d tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:34.834164 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a7208b5b-644d-4d5a-b8ed-e6ef8f2e723d tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:34.835088 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a7208b5b-644d-4d5a-b8ed-e6ef8f2e723d tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:35.196447 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a7208b5b-644d-4d5a-b8ed-e6ef8f2e723d tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90770e7e060c4ded869851dea068189c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab675eb7ef3e45e68d74d737484c6e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:35.207960 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a7208b5b-644d-4d5a-b8ed-e6ef8f2e723d tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] 10.222.0.61 "GET /compute/v2.1/servers/7523e0a9-60e8-42ba-b271-d63251e373b7" status: 200 len: 1401 microversion: 2.1 time: 0.395223 Aug 31 16:01:35.226191 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 758/1514] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:34 2022] GET /compute/v2.1/servers/7523e0a9-60e8-42ba-b271-d63251e373b7 => generated 1401 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:35.231940 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f2fb9f10-57d8-4003-bc9c-c3049a1db674 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:35.232788 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f2fb9f10-57d8-4003-bc9c-c3049a1db674 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] [instance: a50acb4f-16d0-4c72-b603-f795220ea866] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:35.234562 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ebd1e614-440d-4f54-9a1d-a1994350b803 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:35.248100 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ebd1e614-440d-4f54-9a1d-a1994350b803 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f" status: 200 len: 1719 microversion: 2.1 time: 0.451341 Aug 31 16:01:35.249379 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 757/1515] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:34 2022] GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f => generated 1719 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:35.269861 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f2fb9f10-57d8-4003-bc9c-c3049a1db674 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:35.274261 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f2fb9f10-57d8-4003-bc9c-c3049a1db674 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:35.275027 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f2fb9f10-57d8-4003-bc9c-c3049a1db674 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:35.276006 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f2fb9f10-57d8-4003-bc9c-c3049a1db674 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:35.277287 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f2fb9f10-57d8-4003-bc9c-c3049a1db674 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:35.278270 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f2fb9f10-57d8-4003-bc9c-c3049a1db674 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:35.287360 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-92540a77-02c6-495b-ad5d-ba620dfe1f08 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:35.289124 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-92540a77-02c6-495b-ad5d-ba620dfe1f08 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6c7489e2-1ba0-4689-b2d7-e37886757266] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:35.302431 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-92540a77-02c6-495b-ad5d-ba620dfe1f08 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:35.305820 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-92540a77-02c6-495b-ad5d-ba620dfe1f08 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:35.306377 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-92540a77-02c6-495b-ad5d-ba620dfe1f08 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:35.326498 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-92540a77-02c6-495b-ad5d-ba620dfe1f08 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:35.327146 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-92540a77-02c6-495b-ad5d-ba620dfe1f08 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:35.327716 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-92540a77-02c6-495b-ad5d-ba620dfe1f08 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:35.871260 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-92540a77-02c6-495b-ad5d-ba620dfe1f08 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:35.891618 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-92540a77-02c6-495b-ad5d-ba620dfe1f08 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266" status: 200 len: 1313 microversion: 2.1 time: 0.640561 Aug 31 16:01:35.894149 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 758/1516] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:35 2022] GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266 => generated 1313 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:35.904180 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f2fb9f10-57d8-4003-bc9c-c3049a1db674 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6382b576b5404eb90214c00b62299b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7fb4ddb0e649edbe96d046cde6b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:35.907379 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8ddd5e34-633b-4abc-aff7-2403afffbe0b tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:35.909999 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8ddd5e34-633b-4abc-aff7-2403afffbe0b tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: 3f785545-d532-4487-b780-8a9be107a209] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:35.918703 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f2fb9f10-57d8-4003-bc9c-c3049a1db674 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] 10.222.0.61 "GET /compute/v2.1/servers/a50acb4f-16d0-4c72-b603-f795220ea866" status: 200 len: 1477 microversion: 2.1 time: 0.690820 Aug 31 16:01:35.919319 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8ddd5e34-633b-4abc-aff7-2403afffbe0b tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:35.920094 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8ddd5e34-633b-4abc-aff7-2403afffbe0b tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:35.920222 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 759/1517] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:35 2022] GET /compute/v2.1/servers/a50acb4f-16d0-4c72-b603-f795220ea866 => generated 1477 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:35.920941 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8ddd5e34-633b-4abc-aff7-2403afffbe0b tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:35.922042 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8ddd5e34-633b-4abc-aff7-2403afffbe0b tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:35.924394 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8ddd5e34-633b-4abc-aff7-2403afffbe0b tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:35.926140 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8ddd5e34-633b-4abc-aff7-2403afffbe0b tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:36.237728 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b6112bfc-430f-4785-a4be-ef695750de56 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:36.239050 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b6112bfc-430f-4785-a4be-ef695750de56 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] [instance: 7523e0a9-60e8-42ba-b271-d63251e373b7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:36.249976 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b6112bfc-430f-4785-a4be-ef695750de56 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:36.251144 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b6112bfc-430f-4785-a4be-ef695750de56 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:36.252543 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b6112bfc-430f-4785-a4be-ef695750de56 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:36.253884 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b6112bfc-430f-4785-a4be-ef695750de56 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:36.254600 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b6112bfc-430f-4785-a4be-ef695750de56 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:36.256076 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b6112bfc-430f-4785-a4be-ef695750de56 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:36.284618 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8ddd5e34-633b-4abc-aff7-2403afffbe0b tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ccd03a4aa84f93bc26b438e1468f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a9f3fcc4b445349e5c66ff712e8598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:36.300593 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8ddd5e34-633b-4abc-aff7-2403afffbe0b tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/servers/3f785545-d532-4487-b780-8a9be107a209" status: 200 len: 1497 microversion: 2.1 time: 0.402755 Aug 31 16:01:36.301450 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 759/1518] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:35 2022] GET /compute/v2.1/servers/3f785545-d532-4487-b780-8a9be107a209 => generated 1497 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:36.307459 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-25fa81ff-1bec-4421-84b7-b1b0146a9071 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:36.308108 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-25fa81ff-1bec-4421-84b7-b1b0146a9071 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: cc085aaa-21b2-48a6-b69c-de4e261dfe7f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:36.320666 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-25fa81ff-1bec-4421-84b7-b1b0146a9071 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:36.321213 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-25fa81ff-1bec-4421-84b7-b1b0146a9071 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:36.321669 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-25fa81ff-1bec-4421-84b7-b1b0146a9071 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:36.322748 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-25fa81ff-1bec-4421-84b7-b1b0146a9071 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:36.323211 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-25fa81ff-1bec-4421-84b7-b1b0146a9071 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:36.323754 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-25fa81ff-1bec-4421-84b7-b1b0146a9071 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:36.715659 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-25fa81ff-1bec-4421-84b7-b1b0146a9071 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:36.734765 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-25fa81ff-1bec-4421-84b7-b1b0146a9071 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f" status: 200 len: 1719 microversion: 2.1 time: 0.430384 Aug 31 16:01:36.734765 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 760/1519] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:36 2022] GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f => generated 1719 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:36.737757 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b6112bfc-430f-4785-a4be-ef695750de56 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90770e7e060c4ded869851dea068189c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab675eb7ef3e45e68d74d737484c6e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:36.757648 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b6112bfc-430f-4785-a4be-ef695750de56 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] 10.222.0.61 "GET /compute/v2.1/servers/7523e0a9-60e8-42ba-b271-d63251e373b7" status: 200 len: 1401 microversion: 2.1 time: 0.529971 Aug 31 16:01:36.759719 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 760/1520] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:36 2022] GET /compute/v2.1/servers/7523e0a9-60e8-42ba-b271-d63251e373b7 => generated 1401 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:36.921860 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-92733431-a77c-47b4-a48f-73bb5a5166c5 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:36.923759 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-92733431-a77c-47b4-a48f-73bb5a5166c5 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6c7489e2-1ba0-4689-b2d7-e37886757266] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:36.949481 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-92733431-a77c-47b4-a48f-73bb5a5166c5 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:36.950239 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-92733431-a77c-47b4-a48f-73bb5a5166c5 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:36.951618 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-92733431-a77c-47b4-a48f-73bb5a5166c5 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:36.952570 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-92733431-a77c-47b4-a48f-73bb5a5166c5 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:36.953188 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-92733431-a77c-47b4-a48f-73bb5a5166c5 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:36.953766 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-92733431-a77c-47b4-a48f-73bb5a5166c5 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:37.190024 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-92733431-a77c-47b4-a48f-73bb5a5166c5 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:37.199339 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-92733431-a77c-47b4-a48f-73bb5a5166c5 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266" status: 200 len: 1313 microversion: 2.1 time: 0.285695 Aug 31 16:01:37.211679 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 761/1521] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:36 2022] GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266 => generated 1313 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:37.222708 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-491af52a-780a-457c-bc4a-eb29dd7ec73d tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:37.224664 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-491af52a-780a-457c-bc4a-eb29dd7ec73d tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] [instance: a50acb4f-16d0-4c72-b603-f795220ea866] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:37.225975 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-c1918708-a6c2-4582-86d0-64e5f6a75bee req-22e10e62-c332-4d69-bcfd-95d0d120882b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c7489e2-1ba0-4689-b2d7-e37886757266", "name": "network-vif-plugged", "status": "completed", "tag": "e136c42f-9bc1-433f-8e80-0837c9be0717"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:01:37.232304 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-491af52a-780a-457c-bc4a-eb29dd7ec73d tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:37.233932 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-491af52a-780a-457c-bc4a-eb29dd7ec73d tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:37.234464 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-491af52a-780a-457c-bc4a-eb29dd7ec73d tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:37.235404 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-491af52a-780a-457c-bc4a-eb29dd7ec73d tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:37.236199 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-491af52a-780a-457c-bc4a-eb29dd7ec73d tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:37.237147 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-491af52a-780a-457c-bc4a-eb29dd7ec73d tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:37.238141 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-c1918708-a6c2-4582-86d0-64e5f6a75bee req-22e10e62-c332-4d69-bcfd-95d0d120882b service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:37.239429 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-c1918708-a6c2-4582-86d0-64e5f6a75bee req-22e10e62-c332-4d69-bcfd-95d0d120882b service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:37.239962 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-c1918708-a6c2-4582-86d0-64e5f6a75bee req-22e10e62-c332-4d69-bcfd-95d0d120882b service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:37.255489 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-c1918708-a6c2-4582-86d0-64e5f6a75bee req-22e10e62-c332-4d69-bcfd-95d0d120882b service nova] Creating event network-vif-plugged:e136c42f-9bc1-433f-8e80-0837c9be0717 for instance 6c7489e2-1ba0-4689-b2d7-e37886757266 on n-h2-850499-9 Aug 31 16:01:37.263328 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-c1918708-a6c2-4582-86d0-64e5f6a75bee req-22e10e62-c332-4d69-bcfd-95d0d120882b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.473625 Aug 31 16:01:37.264316 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 761/1522] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:01:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:01:37.273840 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-6f647167-8687-42a7-a361-8712174b7edc req-39a5652d-9b9b-4b6b-a913-858266830b51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a50acb4f-16d0-4c72-b603-f795220ea866", "name": "network-vif-deleted", "tag": "5c9b6454-8f5a-469a-a445-424975c95bcd"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:01:37.285855 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-6f647167-8687-42a7-a361-8712174b7edc req-39a5652d-9b9b-4b6b-a913-858266830b51 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:37.286489 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-6f647167-8687-42a7-a361-8712174b7edc req-39a5652d-9b9b-4b6b-a913-858266830b51 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:37.286926 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-6f647167-8687-42a7-a361-8712174b7edc req-39a5652d-9b9b-4b6b-a913-858266830b51 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:37.303426 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-6f647167-8687-42a7-a361-8712174b7edc req-39a5652d-9b9b-4b6b-a913-858266830b51 service nova] Creating event network-vif-deleted:5c9b6454-8f5a-469a-a445-424975c95bcd for instance a50acb4f-16d0-4c72-b603-f795220ea866 on n-h2-850499-9 Aug 31 16:01:37.308411 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-6f647167-8687-42a7-a361-8712174b7edc req-39a5652d-9b9b-4b6b-a913-858266830b51 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038901 Aug 31 16:01:37.309491 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 762/1523] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:01:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:01:37.319389 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-491af52a-780a-457c-bc4a-eb29dd7ec73d tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6382b576b5404eb90214c00b62299b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7fb4ddb0e649edbe96d046cde6b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:37.324642 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4c7091c8-aca9-4427-9d6d-859836a03603 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:37.325544 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4c7091c8-aca9-4427-9d6d-859836a03603 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: 3f785545-d532-4487-b780-8a9be107a209] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:37.327897 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-491af52a-780a-457c-bc4a-eb29dd7ec73d tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] 10.222.0.61 "GET /compute/v2.1/servers/a50acb4f-16d0-4c72-b603-f795220ea866" status: 200 len: 1435 microversion: 2.1 time: 0.126381 Aug 31 16:01:37.328483 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 762/1524] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:37 2022] GET /compute/v2.1/servers/a50acb4f-16d0-4c72-b603-f795220ea866 => generated 1435 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:37.337394 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4c7091c8-aca9-4427-9d6d-859836a03603 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:37.338172 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4c7091c8-aca9-4427-9d6d-859836a03603 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:37.338962 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4c7091c8-aca9-4427-9d6d-859836a03603 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:37.339952 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4c7091c8-aca9-4427-9d6d-859836a03603 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:37.340873 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4c7091c8-aca9-4427-9d6d-859836a03603 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:37.341645 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4c7091c8-aca9-4427-9d6d-859836a03603 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:37.518837 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-4c7091c8-aca9-4427-9d6d-859836a03603 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ccd03a4aa84f93bc26b438e1468f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a9f3fcc4b445349e5c66ff712e8598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:37.528006 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4c7091c8-aca9-4427-9d6d-859836a03603 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/servers/3f785545-d532-4487-b780-8a9be107a209" status: 200 len: 1497 microversion: 2.1 time: 0.208106 Aug 31 16:01:37.528994 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 763/1525] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:37 2022] GET /compute/v2.1/servers/3f785545-d532-4487-b780-8a9be107a209 => generated 1497 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:37.754964 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a81beb10-c746-486b-8ac4-58a77eb05866 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:37.755670 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a81beb10-c746-486b-8ac4-58a77eb05866 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: cc085aaa-21b2-48a6-b69c-de4e261dfe7f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:37.761914 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a81beb10-c746-486b-8ac4-58a77eb05866 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:37.762480 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a81beb10-c746-486b-8ac4-58a77eb05866 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:37.763606 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a81beb10-c746-486b-8ac4-58a77eb05866 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:37.764389 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a81beb10-c746-486b-8ac4-58a77eb05866 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:37.764855 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a81beb10-c746-486b-8ac4-58a77eb05866 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:37.765289 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a81beb10-c746-486b-8ac4-58a77eb05866 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:37.785826 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c640a783-0c1f-40ee-953a-5bc9ad64b3c9 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:37.787613 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c640a783-0c1f-40ee-953a-5bc9ad64b3c9 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] [instance: 7523e0a9-60e8-42ba-b271-d63251e373b7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:37.790122 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=4 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:01:37.796185 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c640a783-0c1f-40ee-953a-5bc9ad64b3c9 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:37.797161 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c640a783-0c1f-40ee-953a-5bc9ad64b3c9 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:37.798436 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c640a783-0c1f-40ee-953a-5bc9ad64b3c9 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:37.800340 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c640a783-0c1f-40ee-953a-5bc9ad64b3c9 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:37.801114 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c640a783-0c1f-40ee-953a-5bc9ad64b3c9 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:37.801756 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c640a783-0c1f-40ee-953a-5bc9ad64b3c9 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:38.036591 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a81beb10-c746-486b-8ac4-58a77eb05866 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:38.050306 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a81beb10-c746-486b-8ac4-58a77eb05866 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f" status: 200 len: 1719 microversion: 2.1 time: 0.299818 Aug 31 16:01:38.050905 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 763/1526] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:37 2022] GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f => generated 1719 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:38.051878 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c640a783-0c1f-40ee-953a-5bc9ad64b3c9 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90770e7e060c4ded869851dea068189c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab675eb7ef3e45e68d74d737484c6e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:38.062936 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c640a783-0c1f-40ee-953a-5bc9ad64b3c9 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] 10.222.0.61 "GET /compute/v2.1/servers/7523e0a9-60e8-42ba-b271-d63251e373b7" status: 200 len: 1401 microversion: 2.1 time: 0.284143 Aug 31 16:01:38.064206 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 764/1527] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:37 2022] GET /compute/v2.1/servers/7523e0a9-60e8-42ba-b271-d63251e373b7 => generated 1401 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:01:38.221917 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-806b62fd-9af0-4a71-8ff8-cf4120ce8592 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:38.222891 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-806b62fd-9af0-4a71-8ff8-cf4120ce8592 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6c7489e2-1ba0-4689-b2d7-e37886757266] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:38.231127 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-806b62fd-9af0-4a71-8ff8-cf4120ce8592 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:38.232029 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-806b62fd-9af0-4a71-8ff8-cf4120ce8592 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:38.232683 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-806b62fd-9af0-4a71-8ff8-cf4120ce8592 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:38.233634 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-806b62fd-9af0-4a71-8ff8-cf4120ce8592 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:38.234322 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-806b62fd-9af0-4a71-8ff8-cf4120ce8592 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:38.235395 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-806b62fd-9af0-4a71-8ff8-cf4120ce8592 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:38.351161 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d3c9eb2a-df79-46aa-9198-6e971cfbaa73 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:38.352343 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d3c9eb2a-df79-46aa-9198-6e971cfbaa73 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] [instance: a50acb4f-16d0-4c72-b603-f795220ea866] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:38.365075 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d3c9eb2a-df79-46aa-9198-6e971cfbaa73 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:38.366153 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d3c9eb2a-df79-46aa-9198-6e971cfbaa73 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:38.366806 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d3c9eb2a-df79-46aa-9198-6e971cfbaa73 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:38.368388 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d3c9eb2a-df79-46aa-9198-6e971cfbaa73 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:38.370672 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d3c9eb2a-df79-46aa-9198-6e971cfbaa73 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:38.371298 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d3c9eb2a-df79-46aa-9198-6e971cfbaa73 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:38.407475 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-806b62fd-9af0-4a71-8ff8-cf4120ce8592 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:38.420829 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-806b62fd-9af0-4a71-8ff8-cf4120ce8592 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266" status: 200 len: 1313 microversion: 2.1 time: 0.203844 Aug 31 16:01:38.423472 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 764/1528] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:38 2022] GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266 => generated 1313 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:38.489353 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d3c9eb2a-df79-46aa-9198-6e971cfbaa73 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6382b576b5404eb90214c00b62299b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7fb4ddb0e649edbe96d046cde6b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:38.500936 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d3c9eb2a-df79-46aa-9198-6e971cfbaa73 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] 10.222.0.61 "GET /compute/v2.1/servers/a50acb4f-16d0-4c72-b603-f795220ea866" status: 200 len: 1435 microversion: 2.1 time: 0.153905 Aug 31 16:01:38.502114 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 765/1529] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:38 2022] GET /compute/v2.1/servers/a50acb4f-16d0-4c72-b603-f795220ea866 => generated 1435 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:01:38.551096 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-89030b7a-b46b-4021-94c7-836049b7449e tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:38.552053 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-89030b7a-b46b-4021-94c7-836049b7449e tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: 3f785545-d532-4487-b780-8a9be107a209] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:38.569737 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-89030b7a-b46b-4021-94c7-836049b7449e tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:38.570481 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-89030b7a-b46b-4021-94c7-836049b7449e tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:38.570928 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-89030b7a-b46b-4021-94c7-836049b7449e tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:38.571689 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-89030b7a-b46b-4021-94c7-836049b7449e tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:38.572151 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-89030b7a-b46b-4021-94c7-836049b7449e tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:38.572581 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-89030b7a-b46b-4021-94c7-836049b7449e tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:38.742630 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-89030b7a-b46b-4021-94c7-836049b7449e tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ccd03a4aa84f93bc26b438e1468f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a9f3fcc4b445349e5c66ff712e8598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:38.753795 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-89030b7a-b46b-4021-94c7-836049b7449e tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/servers/3f785545-d532-4487-b780-8a9be107a209" status: 200 len: 1497 microversion: 2.1 time: 0.207216 Aug 31 16:01:38.754709 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 765/1530] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:38 2022] GET /compute/v2.1/servers/3f785545-d532-4487-b780-8a9be107a209 => generated 1497 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:39.072783 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0c88c1d6-155d-498e-8bd4-3f025b6a614d tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:39.073327 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0c88c1d6-155d-498e-8bd4-3f025b6a614d tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: cc085aaa-21b2-48a6-b69c-de4e261dfe7f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:39.085638 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-de4fdb55-c6a7-4412-95c3-357929f54d09 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:39.086848 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-de4fdb55-c6a7-4412-95c3-357929f54d09 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] [instance: 7523e0a9-60e8-42ba-b271-d63251e373b7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:39.103972 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-de4fdb55-c6a7-4412-95c3-357929f54d09 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:39.104815 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0c88c1d6-155d-498e-8bd4-3f025b6a614d tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:39.105931 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-de4fdb55-c6a7-4412-95c3-357929f54d09 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:39.106279 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0c88c1d6-155d-498e-8bd4-3f025b6a614d tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:39.106875 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0c88c1d6-155d-498e-8bd4-3f025b6a614d tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:39.107467 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-de4fdb55-c6a7-4412-95c3-357929f54d09 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:39.108386 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0c88c1d6-155d-498e-8bd4-3f025b6a614d tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:39.109265 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-de4fdb55-c6a7-4412-95c3-357929f54d09 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:39.109884 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0c88c1d6-155d-498e-8bd4-3f025b6a614d tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:39.111106 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-de4fdb55-c6a7-4412-95c3-357929f54d09 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:39.111791 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0c88c1d6-155d-498e-8bd4-3f025b6a614d tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:39.115396 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-de4fdb55-c6a7-4412-95c3-357929f54d09 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:39.151061 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:01:39.361492 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-de4fdb55-c6a7-4412-95c3-357929f54d09 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90770e7e060c4ded869851dea068189c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab675eb7ef3e45e68d74d737484c6e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:39.371526 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-de4fdb55-c6a7-4412-95c3-357929f54d09 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] 10.222.0.61 "GET /compute/v2.1/servers/7523e0a9-60e8-42ba-b271-d63251e373b7" status: 200 len: 1401 microversion: 2.1 time: 0.291150 Aug 31 16:01:39.372476 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 766/1531] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:39 2022] GET /compute/v2.1/servers/7523e0a9-60e8-42ba-b271-d63251e373b7 => generated 1401 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:01:39.428494 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0c88c1d6-155d-498e-8bd4-3f025b6a614d tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:39.437244 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0c88c1d6-155d-498e-8bd4-3f025b6a614d tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f" status: 200 len: 1719 microversion: 2.1 time: 0.369385 Aug 31 16:01:39.438028 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 766/1532] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:39 2022] GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f => generated 1719 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:01:39.449218 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-790ae19d-d753-4a15-a8d3-565119e172fd tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:39.451071 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-790ae19d-d753-4a15-a8d3-565119e172fd tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6c7489e2-1ba0-4689-b2d7-e37886757266] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:39.476350 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-790ae19d-d753-4a15-a8d3-565119e172fd tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:39.477224 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-790ae19d-d753-4a15-a8d3-565119e172fd tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:39.477939 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-790ae19d-d753-4a15-a8d3-565119e172fd tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:39.479654 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-790ae19d-d753-4a15-a8d3-565119e172fd tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:39.480330 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-790ae19d-d753-4a15-a8d3-565119e172fd tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:39.481132 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-790ae19d-d753-4a15-a8d3-565119e172fd tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:39.523349 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a8287b74-8eb3-4c11-b288-42e0bca8e461 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:39.524533 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a8287b74-8eb3-4c11-b288-42e0bca8e461 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] [instance: a50acb4f-16d0-4c72-b603-f795220ea866] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:39.541289 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a8287b74-8eb3-4c11-b288-42e0bca8e461 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:39.542253 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a8287b74-8eb3-4c11-b288-42e0bca8e461 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:39.542868 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a8287b74-8eb3-4c11-b288-42e0bca8e461 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:39.543957 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a8287b74-8eb3-4c11-b288-42e0bca8e461 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:39.544683 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a8287b74-8eb3-4c11-b288-42e0bca8e461 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:39.545175 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a8287b74-8eb3-4c11-b288-42e0bca8e461 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:39.658856 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a8287b74-8eb3-4c11-b288-42e0bca8e461 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6382b576b5404eb90214c00b62299b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7fb4ddb0e649edbe96d046cde6b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:39.673467 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a8287b74-8eb3-4c11-b288-42e0bca8e461 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] 10.222.0.61 "GET /compute/v2.1/servers/a50acb4f-16d0-4c72-b603-f795220ea866" status: 200 len: 1306 microversion: 2.1 time: 0.153803 Aug 31 16:01:39.675354 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 767/1533] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:39 2022] GET /compute/v2.1/servers/a50acb4f-16d0-4c72-b603-f795220ea866 => generated 1306 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:39.768463 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-790ae19d-d753-4a15-a8d3-565119e172fd tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:39.774193 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-50c15408-3ada-4736-966f-c6d1e3584f61 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:39.776996 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-50c15408-3ada-4736-966f-c6d1e3584f61 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: 3f785545-d532-4487-b780-8a9be107a209] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:39.791258 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-50c15408-3ada-4736-966f-c6d1e3584f61 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:39.792712 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-790ae19d-d753-4a15-a8d3-565119e172fd tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266" status: 200 len: 1313 microversion: 2.1 time: 0.349210 Aug 31 16:01:39.793310 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-50c15408-3ada-4736-966f-c6d1e3584f61 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:39.794516 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-50c15408-3ada-4736-966f-c6d1e3584f61 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:39.794909 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 767/1534] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:39 2022] GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266 => generated 1313 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:39.796386 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-50c15408-3ada-4736-966f-c6d1e3584f61 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:39.797113 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-50c15408-3ada-4736-966f-c6d1e3584f61 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:39.798764 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-50c15408-3ada-4736-966f-c6d1e3584f61 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:40.399867 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-787e8fea-f270-4842-89c7-7fda62f40e7f tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:40.401127 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-787e8fea-f270-4842-89c7-7fda62f40e7f tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] [instance: 7523e0a9-60e8-42ba-b271-d63251e373b7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:40.416120 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-787e8fea-f270-4842-89c7-7fda62f40e7f tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:40.417094 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-787e8fea-f270-4842-89c7-7fda62f40e7f tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:40.417739 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-787e8fea-f270-4842-89c7-7fda62f40e7f tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:40.418652 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-787e8fea-f270-4842-89c7-7fda62f40e7f tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:40.420093 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-787e8fea-f270-4842-89c7-7fda62f40e7f tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:40.422411 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-787e8fea-f270-4842-89c7-7fda62f40e7f tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:40.530396 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-50c15408-3ada-4736-966f-c6d1e3584f61 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ccd03a4aa84f93bc26b438e1468f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a9f3fcc4b445349e5c66ff712e8598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:40.540374 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-50c15408-3ada-4736-966f-c6d1e3584f61 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/servers/3f785545-d532-4487-b780-8a9be107a209" status: 200 len: 1497 microversion: 2.1 time: 0.770128 Aug 31 16:01:40.560194 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 768/1535] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:39 2022] GET /compute/v2.1/servers/3f785545-d532-4487-b780-8a9be107a209 => generated 1497 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:01:40.567923 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-685b4468-d587-4a65-9787-b68e7c0f6997 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:40.568792 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-685b4468-d587-4a65-9787-b68e7c0f6997 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: cc085aaa-21b2-48a6-b69c-de4e261dfe7f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:40.575359 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-685b4468-d587-4a65-9787-b68e7c0f6997 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:40.576118 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-685b4468-d587-4a65-9787-b68e7c0f6997 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:40.576875 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-685b4468-d587-4a65-9787-b68e7c0f6997 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:40.578369 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-685b4468-d587-4a65-9787-b68e7c0f6997 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:40.578996 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-685b4468-d587-4a65-9787-b68e7c0f6997 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:40.581486 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-685b4468-d587-4a65-9787-b68e7c0f6997 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:40.863152 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-787e8fea-f270-4842-89c7-7fda62f40e7f tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90770e7e060c4ded869851dea068189c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab675eb7ef3e45e68d74d737484c6e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:40.881282 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-787e8fea-f270-4842-89c7-7fda62f40e7f tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] 10.222.0.61 "GET /compute/v2.1/servers/7523e0a9-60e8-42ba-b271-d63251e373b7" status: 200 len: 1401 microversion: 2.1 time: 0.487846 Aug 31 16:01:40.896620 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 768/1536] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:40 2022] GET /compute/v2.1/servers/7523e0a9-60e8-42ba-b271-d63251e373b7 => generated 1401 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:40.926078 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c7b6b66c-30bc-47f4-b72d-86e6690257b5 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:40.927210 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-685b4468-d587-4a65-9787-b68e7c0f6997 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:40.927778 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c7b6b66c-30bc-47f4-b72d-86e6690257b5 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] [instance: a50acb4f-16d0-4c72-b603-f795220ea866] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:40.935157 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c7b6b66c-30bc-47f4-b72d-86e6690257b5 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:40.936021 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c7b6b66c-30bc-47f4-b72d-86e6690257b5 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:40.937179 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c7b6b66c-30bc-47f4-b72d-86e6690257b5 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:40.938590 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-685b4468-d587-4a65-9787-b68e7c0f6997 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f" status: 200 len: 1719 microversion: 2.1 time: 0.376915 Aug 31 16:01:40.939476 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c7b6b66c-30bc-47f4-b72d-86e6690257b5 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:40.940656 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c7b6b66c-30bc-47f4-b72d-86e6690257b5 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:40.941348 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c7b6b66c-30bc-47f4-b72d-86e6690257b5 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:40.943190 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 769/1537] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:40 2022] GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f => generated 1719 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:40.951740 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0b67a20e-ce65-412e-99c5-6dd0eda25548 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:40.952767 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0b67a20e-ce65-412e-99c5-6dd0eda25548 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6c7489e2-1ba0-4689-b2d7-e37886757266] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:40.973862 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0b67a20e-ce65-412e-99c5-6dd0eda25548 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:40.974436 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0b67a20e-ce65-412e-99c5-6dd0eda25548 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:40.974886 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0b67a20e-ce65-412e-99c5-6dd0eda25548 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:40.979791 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0b67a20e-ce65-412e-99c5-6dd0eda25548 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:40.980360 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0b67a20e-ce65-412e-99c5-6dd0eda25548 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:40.980804 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0b67a20e-ce65-412e-99c5-6dd0eda25548 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:40.990140 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c7b6b66c-30bc-47f4-b72d-86e6690257b5 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:40.990638 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c7b6b66c-30bc-47f4-b72d-86e6690257b5 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:40.991264 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c7b6b66c-30bc-47f4-b72d-86e6690257b5 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:40.991904 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-c7b6b66c-30bc-47f4-b72d-86e6690257b5 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lazy-loading 'fault' on Instance uuid a50acb4f-16d0-4c72-b603-f795220ea866 {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:01:41.003401 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:01:41.056867 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c7b6b66c-30bc-47f4-b72d-86e6690257b5 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6382b576b5404eb90214c00b62299b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7fb4ddb0e649edbe96d046cde6b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:41.066188 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c7b6b66c-30bc-47f4-b72d-86e6690257b5 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] 10.222.0.61 "GET /compute/v2.1/servers/a50acb4f-16d0-4c72-b603-f795220ea866" status: 200 len: 1311 microversion: 2.1 time: 0.151982 Aug 31 16:01:41.066988 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 769/1538] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:40 2022] GET /compute/v2.1/servers/a50acb4f-16d0-4c72-b603-f795220ea866 => generated 1311 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:41.263917 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0b67a20e-ce65-412e-99c5-6dd0eda25548 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:41.273611 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0b67a20e-ce65-412e-99c5-6dd0eda25548 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266" status: 200 len: 1313 microversion: 2.1 time: 0.329242 Aug 31 16:01:41.274623 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 770/1539] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:40 2022] GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266 => generated 1313 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:41.573771 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-97920e2e-36e2-4dc4-bbd3-884d911e22d9 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:41.574422 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-97920e2e-36e2-4dc4-bbd3-884d911e22d9 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: 3f785545-d532-4487-b780-8a9be107a209] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:41.582284 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-97920e2e-36e2-4dc4-bbd3-884d911e22d9 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:41.582785 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-97920e2e-36e2-4dc4-bbd3-884d911e22d9 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:41.583224 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-97920e2e-36e2-4dc4-bbd3-884d911e22d9 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:41.584160 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-97920e2e-36e2-4dc4-bbd3-884d911e22d9 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:41.585756 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-97920e2e-36e2-4dc4-bbd3-884d911e22d9 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:41.586385 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-97920e2e-36e2-4dc4-bbd3-884d911e22d9 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:41.845602 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-97920e2e-36e2-4dc4-bbd3-884d911e22d9 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ccd03a4aa84f93bc26b438e1468f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a9f3fcc4b445349e5c66ff712e8598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:41.856477 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-97920e2e-36e2-4dc4-bbd3-884d911e22d9 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/servers/3f785545-d532-4487-b780-8a9be107a209" status: 200 len: 1497 microversion: 2.1 time: 0.286618 Aug 31 16:01:41.857072 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 770/1540] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:41 2022] GET /compute/v2.1/servers/3f785545-d532-4487-b780-8a9be107a209 => generated 1497 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:01:41.908143 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-912240be-a58c-45cc-a7b2-3be252e96fb5 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:41.909528 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-912240be-a58c-45cc-a7b2-3be252e96fb5 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] [instance: 7523e0a9-60e8-42ba-b271-d63251e373b7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:41.916382 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-912240be-a58c-45cc-a7b2-3be252e96fb5 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:41.916876 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-912240be-a58c-45cc-a7b2-3be252e96fb5 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:41.917313 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-912240be-a58c-45cc-a7b2-3be252e96fb5 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:41.918017 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-912240be-a58c-45cc-a7b2-3be252e96fb5 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:41.918472 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-912240be-a58c-45cc-a7b2-3be252e96fb5 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:41.918904 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-912240be-a58c-45cc-a7b2-3be252e96fb5 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:41.964425 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3bd327d2-cd88-4341-b92a-fb390977d212 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:41.965423 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3bd327d2-cd88-4341-b92a-fb390977d212 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: cc085aaa-21b2-48a6-b69c-de4e261dfe7f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:41.974299 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3bd327d2-cd88-4341-b92a-fb390977d212 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:41.978387 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3bd327d2-cd88-4341-b92a-fb390977d212 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:41.980888 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3bd327d2-cd88-4341-b92a-fb390977d212 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:41.981827 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3bd327d2-cd88-4341-b92a-fb390977d212 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:41.982460 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3bd327d2-cd88-4341-b92a-fb390977d212 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:41.983041 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3bd327d2-cd88-4341-b92a-fb390977d212 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:42.328576 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-912240be-a58c-45cc-a7b2-3be252e96fb5 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90770e7e060c4ded869851dea068189c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab675eb7ef3e45e68d74d737484c6e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:42.338783 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-912240be-a58c-45cc-a7b2-3be252e96fb5 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] 10.222.0.61 "GET /compute/v2.1/servers/7523e0a9-60e8-42ba-b271-d63251e373b7" status: 200 len: 1401 microversion: 2.1 time: 0.435492 Aug 31 16:01:42.339750 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 771/1541] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:41 2022] GET /compute/v2.1/servers/7523e0a9-60e8-42ba-b271-d63251e373b7 => generated 1401 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:42.341510 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3bd327d2-cd88-4341-b92a-fb390977d212 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:42.345695 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c8796a80-3c65-4e09-8593-b5d0840db86d tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:42.346558 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c8796a80-3c65-4e09-8593-b5d0840db86d tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] [instance: a50acb4f-16d0-4c72-b603-f795220ea866] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:42.352163 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3bd327d2-cd88-4341-b92a-fb390977d212 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f" status: 200 len: 1719 microversion: 2.1 time: 0.391722 Aug 31 16:01:42.361762 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 771/1542] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:41 2022] GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f => generated 1719 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:01:42.371136 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-830a0dba-a954-4a2a-8da4-21b8e5853b1f tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:42.372125 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-830a0dba-a954-4a2a-8da4-21b8e5853b1f tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6c7489e2-1ba0-4689-b2d7-e37886757266] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:42.401465 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-830a0dba-a954-4a2a-8da4-21b8e5853b1f tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:42.404932 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-830a0dba-a954-4a2a-8da4-21b8e5853b1f tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:42.406238 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-830a0dba-a954-4a2a-8da4-21b8e5853b1f tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:42.406954 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c8796a80-3c65-4e09-8593-b5d0840db86d tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:42.410477 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c8796a80-3c65-4e09-8593-b5d0840db86d tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:42.412341 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-830a0dba-a954-4a2a-8da4-21b8e5853b1f tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:42.413887 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-830a0dba-a954-4a2a-8da4-21b8e5853b1f tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:42.414346 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-830a0dba-a954-4a2a-8da4-21b8e5853b1f tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:42.414887 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c8796a80-3c65-4e09-8593-b5d0840db86d tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:42.417007 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c8796a80-3c65-4e09-8593-b5d0840db86d tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:42.419422 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c8796a80-3c65-4e09-8593-b5d0840db86d tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:42.419958 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c8796a80-3c65-4e09-8593-b5d0840db86d tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:42.480846 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c8796a80-3c65-4e09-8593-b5d0840db86d tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:42.481472 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c8796a80-3c65-4e09-8593-b5d0840db86d tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:42.481925 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c8796a80-3c65-4e09-8593-b5d0840db86d tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:42.482389 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-c8796a80-3c65-4e09-8593-b5d0840db86d tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lazy-loading 'fault' on Instance uuid a50acb4f-16d0-4c72-b603-f795220ea866 {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:01:42.583676 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c8796a80-3c65-4e09-8593-b5d0840db86d tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6382b576b5404eb90214c00b62299b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7fb4ddb0e649edbe96d046cde6b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:42.595287 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c8796a80-3c65-4e09-8593-b5d0840db86d tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] 10.222.0.61 "GET /compute/v2.1/servers/a50acb4f-16d0-4c72-b603-f795220ea866" status: 200 len: 1311 microversion: 2.1 time: 0.253681 Aug 31 16:01:42.599811 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 772/1543] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:42 2022] GET /compute/v2.1/servers/a50acb4f-16d0-4c72-b603-f795220ea866 => generated 1311 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:42.737335 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-830a0dba-a954-4a2a-8da4-21b8e5853b1f tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:42.749202 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-830a0dba-a954-4a2a-8da4-21b8e5853b1f tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266" status: 200 len: 1462 microversion: 2.1 time: 0.384459 Aug 31 16:01:42.759647 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 772/1544] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:42 2022] GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266 => generated 1462 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:42.878878 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8c10ed0c-8d33-4a9c-96c8-f5f71d01bfad tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:42.879537 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8c10ed0c-8d33-4a9c-96c8-f5f71d01bfad tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: 3f785545-d532-4487-b780-8a9be107a209] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:42.900606 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8c10ed0c-8d33-4a9c-96c8-f5f71d01bfad tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:42.901119 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8c10ed0c-8d33-4a9c-96c8-f5f71d01bfad tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:42.901566 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8c10ed0c-8d33-4a9c-96c8-f5f71d01bfad tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:42.902606 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8c10ed0c-8d33-4a9c-96c8-f5f71d01bfad tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:42.903074 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8c10ed0c-8d33-4a9c-96c8-f5f71d01bfad tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:42.907022 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8c10ed0c-8d33-4a9c-96c8-f5f71d01bfad tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:42.965434 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7e17c98e-ea85-4eca-9ee2-2d3ff4bbb8d1 tempest-MigrationsAdminTest-62329235 tempest-MigrationsAdminTest-62329235-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:42.965991 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7e17c98e-ea85-4eca-9ee2-2d3ff4bbb8d1 tempest-MigrationsAdminTest-62329235 tempest-MigrationsAdminTest-62329235-project-admin] [instance: 6c7489e2-1ba0-4689-b2d7-e37886757266] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:42.978164 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7e17c98e-ea85-4eca-9ee2-2d3ff4bbb8d1 tempest-MigrationsAdminTest-62329235 tempest-MigrationsAdminTest-62329235-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:42.978663 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7e17c98e-ea85-4eca-9ee2-2d3ff4bbb8d1 tempest-MigrationsAdminTest-62329235 tempest-MigrationsAdminTest-62329235-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:42.982631 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7e17c98e-ea85-4eca-9ee2-2d3ff4bbb8d1 tempest-MigrationsAdminTest-62329235 tempest-MigrationsAdminTest-62329235-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:42.983539 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7e17c98e-ea85-4eca-9ee2-2d3ff4bbb8d1 tempest-MigrationsAdminTest-62329235 tempest-MigrationsAdminTest-62329235-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:42.984178 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7e17c98e-ea85-4eca-9ee2-2d3ff4bbb8d1 tempest-MigrationsAdminTest-62329235 tempest-MigrationsAdminTest-62329235-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:42.984951 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7e17c98e-ea85-4eca-9ee2-2d3ff4bbb8d1 tempest-MigrationsAdminTest-62329235 tempest-MigrationsAdminTest-62329235-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:43.273112 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8c10ed0c-8d33-4a9c-96c8-f5f71d01bfad tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ccd03a4aa84f93bc26b438e1468f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a9f3fcc4b445349e5c66ff712e8598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:43.284618 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8c10ed0c-8d33-4a9c-96c8-f5f71d01bfad tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/servers/3f785545-d532-4487-b780-8a9be107a209" status: 200 len: 1497 microversion: 2.1 time: 0.410861 Aug 31 16:01:43.285772 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 773/1545] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:42 2022] GET /compute/v2.1/servers/3f785545-d532-4487-b780-8a9be107a209 => generated 1497 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:43.362794 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7289d994-07f7-4398-bc5f-9cae76621b4d tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:43.363837 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7289d994-07f7-4398-bc5f-9cae76621b4d tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] [instance: 7523e0a9-60e8-42ba-b271-d63251e373b7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:43.375222 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7289d994-07f7-4398-bc5f-9cae76621b4d tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:43.376571 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7289d994-07f7-4398-bc5f-9cae76621b4d tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:43.381445 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7289d994-07f7-4398-bc5f-9cae76621b4d tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:43.382536 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7289d994-07f7-4398-bc5f-9cae76621b4d tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:43.384188 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7289d994-07f7-4398-bc5f-9cae76621b4d tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:43.386039 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7289d994-07f7-4398-bc5f-9cae76621b4d tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:43.450414 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7e17c98e-ea85-4eca-9ee2-2d3ff4bbb8d1 tempest-MigrationsAdminTest-62329235 tempest-MigrationsAdminTest-62329235-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266" status: 200 len: 1613 microversion: 2.1 time: 0.683658 Aug 31 16:01:43.454627 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 773/1546] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:42 2022] GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266 => generated 1613 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:43.464516 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1ca9fa77-c21a-4fa5-ba0e-1681b31b26c1 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:43.465157 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1ca9fa77-c21a-4fa5-ba0e-1681b31b26c1 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: cc085aaa-21b2-48a6-b69c-de4e261dfe7f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:43.485085 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1ca9fa77-c21a-4fa5-ba0e-1681b31b26c1 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:43.489200 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1ca9fa77-c21a-4fa5-ba0e-1681b31b26c1 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:43.489684 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1ca9fa77-c21a-4fa5-ba0e-1681b31b26c1 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:43.490436 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1ca9fa77-c21a-4fa5-ba0e-1681b31b26c1 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:43.490964 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1ca9fa77-c21a-4fa5-ba0e-1681b31b26c1 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:43.491406 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1ca9fa77-c21a-4fa5-ba0e-1681b31b26c1 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:43.650007 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7289d994-07f7-4398-bc5f-9cae76621b4d tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90770e7e060c4ded869851dea068189c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab675eb7ef3e45e68d74d737484c6e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:43.660416 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7289d994-07f7-4398-bc5f-9cae76621b4d tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] 10.222.0.61 "GET /compute/v2.1/servers/7523e0a9-60e8-42ba-b271-d63251e373b7" status: 200 len: 1401 microversion: 2.1 time: 0.303224 Aug 31 16:01:43.661513 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 774/1547] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:43 2022] GET /compute/v2.1/servers/7523e0a9-60e8-42ba-b271-d63251e373b7 => generated 1401 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:43.667086 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a1aaf015-7d20-4c26-ab65-635c240d5c66 tempest-MigrationsAdminTest-62329235 tempest-MigrationsAdminTest-62329235-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:01:43.674129 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a1aaf015-7d20-4c26-ab65-635c240d5c66 tempest-MigrationsAdminTest-62329235 tempest-MigrationsAdminTest-62329235-project-admin] [instance: 6c7489e2-1ba0-4689-b2d7-e37886757266] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:43.680456 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a1aaf015-7d20-4c26-ab65-635c240d5c66 tempest-MigrationsAdminTest-62329235 tempest-MigrationsAdminTest-62329235-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:43.681284 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a1aaf015-7d20-4c26-ab65-635c240d5c66 tempest-MigrationsAdminTest-62329235 tempest-MigrationsAdminTest-62329235-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:43.681957 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a1aaf015-7d20-4c26-ab65-635c240d5c66 tempest-MigrationsAdminTest-62329235 tempest-MigrationsAdminTest-62329235-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:43.682913 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a1aaf015-7d20-4c26-ab65-635c240d5c66 tempest-MigrationsAdminTest-62329235 tempest-MigrationsAdminTest-62329235-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:43.683458 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a1aaf015-7d20-4c26-ab65-635c240d5c66 tempest-MigrationsAdminTest-62329235 tempest-MigrationsAdminTest-62329235-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:43.684149 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a1aaf015-7d20-4c26-ab65-635c240d5c66 tempest-MigrationsAdminTest-62329235 tempest-MigrationsAdminTest-62329235-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:43.729620 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-1ca9fa77-c21a-4fa5-ba0e-1681b31b26c1 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:43.743039 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1ca9fa77-c21a-4fa5-ba0e-1681b31b26c1 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f" status: 200 len: 1719 microversion: 2.1 time: 0.287292 Aug 31 16:01:43.744303 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 774/1548] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:43 2022] GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f => generated 1719 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:43.822697 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a1aaf015-7d20-4c26-ab65-635c240d5c66 tempest-MigrationsAdminTest-62329235 tempest-MigrationsAdminTest-62329235-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'dc86cb60a19744a9b7124dff4e1f025b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7fba32c4f24ac5ab8c5ce5fc340022', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:43.823935 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a1aaf015-7d20-4c26-ab65-635c240d5c66 tempest-MigrationsAdminTest-62329235 tempest-MigrationsAdminTest-62329235-project-admin] [instance: 6c7489e2-1ba0-4689-b2d7-e37886757266] flavor_id is None. Assuming migration. {{(pid=122256) resize /opt/stack/nova/nova/compute/api.py:4194}} Aug 31 16:01:43.825030 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a1aaf015-7d20-4c26-ab65-635c240d5c66 tempest-MigrationsAdminTest-62329235 tempest-MigrationsAdminTest-62329235-project-admin] [instance: 6c7489e2-1ba0-4689-b2d7-e37886757266] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122256) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 31 16:01:43.827042 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7fb47f7f-a573-4525-a057-c00407a1da74 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-1618286935", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "networks": [{"uuid": "f64979cf-62ce-4be3-9443-2120ec32347f"}]}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:01:43.931786 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-7fb47f7f-a573-4525-a057-c00407a1da74 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] validate_networks() for [('f64979cf-62ce-4be3-9443-2120ec32347f', None, None, None, None, None)] {{(pid=122257) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:01:44.141988 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=100 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:01:44.276664 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a1aaf015-7d20-4c26-ab65-635c240d5c66 tempest-MigrationsAdminTest-62329235 tempest-MigrationsAdminTest-62329235-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266/action" status: 202 len: 0 microversion: 2.1 time: 0.613106 Aug 31 16:01:44.277750 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 775/1549] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:01:43 2022] POST /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266/action => generated 0 bytes in 615 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:01:44.283475 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1cb0cf95-c2cd-433c-908f-dc87e5d6f2af tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:44.284431 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1cb0cf95-c2cd-433c-908f-dc87e5d6f2af tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] [instance: a50acb4f-16d0-4c72-b603-f795220ea866] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:44.291098 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1cb0cf95-c2cd-433c-908f-dc87e5d6f2af tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:44.291843 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1cb0cf95-c2cd-433c-908f-dc87e5d6f2af tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:44.292282 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1cb0cf95-c2cd-433c-908f-dc87e5d6f2af tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:44.292981 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1cb0cf95-c2cd-433c-908f-dc87e5d6f2af tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:44.293588 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1cb0cf95-c2cd-433c-908f-dc87e5d6f2af tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:44.294180 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1cb0cf95-c2cd-433c-908f-dc87e5d6f2af tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:44.337391 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1cb0cf95-c2cd-433c-908f-dc87e5d6f2af tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:44.337887 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1cb0cf95-c2cd-433c-908f-dc87e5d6f2af tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:44.338479 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1cb0cf95-c2cd-433c-908f-dc87e5d6f2af tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:44.339284 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-1cb0cf95-c2cd-433c-908f-dc87e5d6f2af tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lazy-loading 'fault' on Instance uuid a50acb4f-16d0-4c72-b603-f795220ea866 {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:01:44.453917 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1cb0cf95-c2cd-433c-908f-dc87e5d6f2af tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6382b576b5404eb90214c00b62299b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7fb4ddb0e649edbe96d046cde6b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:44.474681 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1cb0cf95-c2cd-433c-908f-dc87e5d6f2af tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] 10.222.0.61 "GET /compute/v2.1/servers/a50acb4f-16d0-4c72-b603-f795220ea866" status: 200 len: 1311 microversion: 2.1 time: 0.195550 Aug 31 16:01:44.491563 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 776/1550] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:44 2022] GET /compute/v2.1/servers/a50acb4f-16d0-4c72-b603-f795220ea866 => generated 1311 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:44.498490 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5e4c0464-2bbd-4606-99c2-0862e30ca608 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:44.499146 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5e4c0464-2bbd-4606-99c2-0862e30ca608 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6c7489e2-1ba0-4689-b2d7-e37886757266] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:44.506946 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5e4c0464-2bbd-4606-99c2-0862e30ca608 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:44.511961 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5e4c0464-2bbd-4606-99c2-0862e30ca608 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:44.513003 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5e4c0464-2bbd-4606-99c2-0862e30ca608 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:44.513945 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5e4c0464-2bbd-4606-99c2-0862e30ca608 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:44.514996 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5e4c0464-2bbd-4606-99c2-0862e30ca608 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:44.515454 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5e4c0464-2bbd-4606-99c2-0862e30ca608 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:44.541184 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-7fb47f7f-a573-4525-a057-c00407a1da74 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:01:44.541827 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-7fb47f7f-a573-4525-a057-c00407a1da74 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:01:44.542201 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-7fb47f7f-a573-4525-a057-c00407a1da74 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:01:44.543063 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-7fb47f7f-a573-4525-a057-c00407a1da74 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:01:44.543584 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-7fb47f7f-a573-4525-a057-c00407a1da74 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:01:44.560781 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7fb47f7f-a573-4525-a057-c00407a1da74 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:44.561605 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7fb47f7f-a573-4525-a057-c00407a1da74 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:44.562230 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7fb47f7f-a573-4525-a057-c00407a1da74 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:44.565135 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7fb47f7f-a573-4525-a057-c00407a1da74 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:44.567661 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7fb47f7f-a573-4525-a057-c00407a1da74 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:44.568340 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7fb47f7f-a573-4525-a057-c00407a1da74 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:44.607812 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-7fb47f7f-a573-4525-a057-c00407a1da74 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Getting quotas for project 4e459294501d4024a9deb6eb078ca808. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:01:44.637197 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-7fb47f7f-a573-4525-a057-c00407a1da74 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Getting quotas for user 2bdd11cffedf44e6b2959058ab88b6db and project 4e459294501d4024a9deb6eb078ca808. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:01:44.686066 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:01:44.688582 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7fb47f7f-a573-4525-a057-c00407a1da74 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Going to run 1 instances... {{(pid=122257) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:01:44.706431 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7fb47f7f-a573-4525-a057-c00407a1da74 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] [instance: fe57e6c6-2844-4ab5-ab13-c8d9ee25004d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:01:44.774150 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5e4c0464-2bbd-4606-99c2-0862e30ca608 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:44.786991 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5e4c0464-2bbd-4606-99c2-0862e30ca608 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266" status: 200 len: 1471 microversion: 2.1 time: 0.294163 Aug 31 16:01:44.787789 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 777/1551] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:44 2022] GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266 => generated 1471 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:44.794846 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f1cb4652-433e-4855-95bb-1e05bc8ad822 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:44.800008 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f1cb4652-433e-4855-95bb-1e05bc8ad822 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: 3f785545-d532-4487-b780-8a9be107a209] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:44.808616 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f1cb4652-433e-4855-95bb-1e05bc8ad822 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:44.809393 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f1cb4652-433e-4855-95bb-1e05bc8ad822 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:44.810012 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f1cb4652-433e-4855-95bb-1e05bc8ad822 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:44.810912 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f1cb4652-433e-4855-95bb-1e05bc8ad822 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:44.811566 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f1cb4652-433e-4855-95bb-1e05bc8ad822 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:44.812202 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f1cb4652-433e-4855-95bb-1e05bc8ad822 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:44.862150 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7fb47f7f-a573-4525-a057-c00407a1da74 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.116402 Aug 31 16:01:44.871583 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 775/1552] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:01:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1126 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:01:44.880250 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6ff33081-2e4b-498a-9c56-5a1914636d6a tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:44.885509 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6ff33081-2e4b-498a-9c56-5a1914636d6a tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] [instance: 7523e0a9-60e8-42ba-b271-d63251e373b7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:44.896728 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6ff33081-2e4b-498a-9c56-5a1914636d6a tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:44.897353 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6ff33081-2e4b-498a-9c56-5a1914636d6a tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:44.897865 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6ff33081-2e4b-498a-9c56-5a1914636d6a tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:44.898630 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6ff33081-2e4b-498a-9c56-5a1914636d6a tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:44.899475 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6ff33081-2e4b-498a-9c56-5a1914636d6a tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:44.900416 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6ff33081-2e4b-498a-9c56-5a1914636d6a tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:45.171587 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f1cb4652-433e-4855-95bb-1e05bc8ad822 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ccd03a4aa84f93bc26b438e1468f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a9f3fcc4b445349e5c66ff712e8598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:45.181545 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f1cb4652-433e-4855-95bb-1e05bc8ad822 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/servers/3f785545-d532-4487-b780-8a9be107a209" status: 200 len: 1497 microversion: 2.1 time: 0.392488 Aug 31 16:01:45.187666 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 778/1553] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:44 2022] GET /compute/v2.1/servers/3f785545-d532-4487-b780-8a9be107a209 => generated 1497 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:45.201941 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c728756e-8d7e-4fe6-82b6-e9a93c98042d tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:45.202663 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c728756e-8d7e-4fe6-82b6-e9a93c98042d tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: cc085aaa-21b2-48a6-b69c-de4e261dfe7f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:45.231644 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c728756e-8d7e-4fe6-82b6-e9a93c98042d tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:45.232920 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c728756e-8d7e-4fe6-82b6-e9a93c98042d tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:45.233564 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c728756e-8d7e-4fe6-82b6-e9a93c98042d tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:45.235092 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c728756e-8d7e-4fe6-82b6-e9a93c98042d tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:45.236445 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c728756e-8d7e-4fe6-82b6-e9a93c98042d tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:45.237048 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c728756e-8d7e-4fe6-82b6-e9a93c98042d tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:45.375889 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-6ff33081-2e4b-498a-9c56-5a1914636d6a tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90770e7e060c4ded869851dea068189c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab675eb7ef3e45e68d74d737484c6e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:45.387231 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6ff33081-2e4b-498a-9c56-5a1914636d6a tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] 10.222.0.61 "GET /compute/v2.1/servers/7523e0a9-60e8-42ba-b271-d63251e373b7" status: 200 len: 1401 microversion: 2.1 time: 0.511313 Aug 31 16:01:45.393636 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 776/1554] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:44 2022] GET /compute/v2.1/servers/7523e0a9-60e8-42ba-b271-d63251e373b7 => generated 1401 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:45.404625 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f78c24f8-4bac-4959-a50b-366f64c8e3f1 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:45.405355 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f78c24f8-4bac-4959-a50b-366f64c8e3f1 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] [instance: fe57e6c6-2844-4ab5-ab13-c8d9ee25004d] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:45.527160 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f78c24f8-4bac-4959-a50b-366f64c8e3f1 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bdd11cffedf44e6b2959058ab88b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e459294501d4024a9deb6eb078ca808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:45.539877 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f78c24f8-4bac-4959-a50b-366f64c8e3f1 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] 10.222.0.61 "GET /compute/v2.1/servers/fe57e6c6-2844-4ab5-ab13-c8d9ee25004d" status: 200 len: 1216 microversion: 2.1 time: 0.144353 Aug 31 16:01:45.541017 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 777/1555] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:45 2022] GET /compute/v2.1/servers/fe57e6c6-2844-4ab5-ab13-c8d9ee25004d => generated 1216 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:45.558034 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c3802fc1-4c01-4359-a510-30d334e70692 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e8d74c70-ddc7-4480-8480-691025b1c2c8"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:01:45.560647 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c3802fc1-4c01-4359-a510-30d334e70692 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] [instance: 39a531e3-b13b-412f-a200-5141c32650be] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:45.569376 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c3802fc1-4c01-4359-a510-30d334e70692 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:45.570064 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c3802fc1-4c01-4359-a510-30d334e70692 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:45.572377 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c3802fc1-4c01-4359-a510-30d334e70692 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:45.573542 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c3802fc1-4c01-4359-a510-30d334e70692 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:45.574227 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c3802fc1-4c01-4359-a510-30d334e70692 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:45.574913 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c3802fc1-4c01-4359-a510-30d334e70692 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:45.597301 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c728756e-8d7e-4fe6-82b6-e9a93c98042d tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:45.617344 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c728756e-8d7e-4fe6-82b6-e9a93c98042d tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f" status: 200 len: 1719 microversion: 2.1 time: 0.428321 Aug 31 16:01:45.620856 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 779/1556] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:45 2022] GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f => generated 1719 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:45.652062 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-914f79d6-59bb-4525-aed1-f3d706909e88 req-d5947fd0-872c-454c-83e7-e6b9f0a29ad1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7523e0a9-60e8-42ba-b271-d63251e373b7", "name": "network-vif-plugged", "status": "completed", "tag": "75f9e894-839c-40d9-9d82-24b08eceeda4"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:01:45.682411 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-914f79d6-59bb-4525-aed1-f3d706909e88 req-d5947fd0-872c-454c-83e7-e6b9f0a29ad1 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:45.686275 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-914f79d6-59bb-4525-aed1-f3d706909e88 req-d5947fd0-872c-454c-83e7-e6b9f0a29ad1 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:45.687106 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-914f79d6-59bb-4525-aed1-f3d706909e88 req-d5947fd0-872c-454c-83e7-e6b9f0a29ad1 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:45.715535 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-914f79d6-59bb-4525-aed1-f3d706909e88 req-d5947fd0-872c-454c-83e7-e6b9f0a29ad1 service nova] Creating event network-vif-plugged:75f9e894-839c-40d9-9d82-24b08eceeda4 for instance 7523e0a9-60e8-42ba-b271-d63251e373b7 on n-h2-850499-9 Aug 31 16:01:45.723367 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-914f79d6-59bb-4525-aed1-f3d706909e88 req-d5947fd0-872c-454c-83e7-e6b9f0a29ad1 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101029 Aug 31 16:01:45.724878 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 780/1557] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:01:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:01:45.730424 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-880d95ea-6e6d-4264-9f35-253cca834345 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:45.731371 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-880d95ea-6e6d-4264-9f35-253cca834345 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] [instance: 35b89015-3888-493a-b521-49a5e3769b00] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:45.745441 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-880d95ea-6e6d-4264-9f35-253cca834345 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:45.746284 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-880d95ea-6e6d-4264-9f35-253cca834345 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:45.747983 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-880d95ea-6e6d-4264-9f35-253cca834345 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:45.750123 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-880d95ea-6e6d-4264-9f35-253cca834345 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:45.753401 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-880d95ea-6e6d-4264-9f35-253cca834345 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:45.754797 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-880d95ea-6e6d-4264-9f35-253cca834345 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:45.819433 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:01:46.091015 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c3802fc1-4c01-4359-a510-30d334e70692 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] 10.222.0.61 "POST /compute/v2.1/servers/39a531e3-b13b-412f-a200-5141c32650be/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.548440 Aug 31 16:01:46.123035 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 778/1558] 10.222.0.61 () {60 vars in 1323 bytes} [Wed Aug 31 16:01:45 2022] POST /compute/v2.1/servers/39a531e3-b13b-412f-a200-5141c32650be/os-volume_attachments => generated 194 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:01:46.130494 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7e07f290-367f-4470-af9b-cc38567bade4 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:46.132730 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7e07f290-367f-4470-af9b-cc38567bade4 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] [instance: a50acb4f-16d0-4c72-b603-f795220ea866] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:46.140718 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7e07f290-367f-4470-af9b-cc38567bade4 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:46.141823 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7e07f290-367f-4470-af9b-cc38567bade4 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:46.142513 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7e07f290-367f-4470-af9b-cc38567bade4 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:46.143850 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7e07f290-367f-4470-af9b-cc38567bade4 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:46.144578 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7e07f290-367f-4470-af9b-cc38567bade4 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:46.145246 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7e07f290-367f-4470-af9b-cc38567bade4 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:46.164283 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-7e07f290-367f-4470-af9b-cc38567bade4 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] HTTP exception thrown: Instance a50acb4f-16d0-4c72-b603-f795220ea866 could not be found. Aug 31 16:01:46.166741 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7e07f290-367f-4470-af9b-cc38567bade4 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Request method failure captured: Aug 31 16:01:46.166741 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/a50acb4f-16d0-4c72-b603-f795220ea866 HTTP/1.1 Aug 31 16:01:46.166741 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:01:46.166741 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:01:46.166741 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:01:46.166741 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:01:46.166741 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:01:46.166741 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:01:46.166741 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:01:46.166741 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:01:46.166741 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4WlPps4ijbscj4lLSsLUY9ib__6pR4jyelLr9Eni503WTypWsjadRjCxHsY-gn9tlqMc4-GtwzAB78PIDoZWWbv9hfjleTPnoSKJo9WyE8TS3_irLCDnQFBB9GjbJOlpOpejNZ1KQntcI44uRsnmLMQYuCNY5nQlq4qg26Dk9n_rxo Aug 31 16:01:46.166741 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:01:46.166741 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:01:46.166741 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:01:46.166741 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:01:46.166741 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:01:46.166741 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:01:46.166741 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 2b7fb4ddb0e649edbe96d046cde6b1a6 Aug 31 16:01:46.166741 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1786123842 Aug 31 16:01:46.166741 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:01:46.166741 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:01:46.168278 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2b7fb4ddb0e649edbe96d046cde6b1a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/2b7fb4ddb0e649edbe96d046cde6b1a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_2b7fb4ddb0e649edbe96d046cde6b1a6", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2b7fb4ddb0e649edbe96d046cde6b1a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:01:46.168278 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1786123842 Aug 31 16:01:46.168278 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 2b7fb4ddb0e649edbe96d046cde6b1a6 Aug 31 16:01:46.168278 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1786123842 Aug 31 16:01:46.168278 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ServersAdminNegativeTestJSON-1786123842-project Aug 31 16:01:46.168278 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:01:46.168278 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:01:46.168278 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 7d6382b576b5404eb90214c00b62299b Aug 31 16:01:46.168278 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1786123842-project Aug 31 16:01:46.168278 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:01:46.168278 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance a50acb4f-16d0-4c72-b603-f795220ea866 could not be found. Aug 31 16:01:46.168278 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': 'a50acb4f-16d0-4c72-b603-f795220ea866'} Aug 31 16:01:46.169117 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:01:46.169117 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:01:46.169117 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:01:46.169117 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:01:46.169117 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:01:46.169117 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:01:46.169117 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:01:46.169117 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:01:46.169117 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:01:46.169117 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:01:46.169117 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a50acb4f-16d0-4c72-b603-f795220ea866 could not be found. Aug 31 16:01:46.169117 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:01:46.169117 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:01:46.169117 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:01:46.169117 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:01:46.169117 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:01:46.169117 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:01:46.169117 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:01:46.169117 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:01:46.169117 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:01:46.170452 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:01:46.170452 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:01:46.170452 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:01:46.170452 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:01:46.170452 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:01:46.170452 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:01:46.170452 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:01:46.170452 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a50acb4f-16d0-4c72-b603-f795220ea866 could not be found. Aug 31 16:01:46.170452 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:01:46.170452 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:01:46.170452 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:01:46.170452 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:01:46.170452 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:01:46.170452 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:01:46.170452 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:01:46.170452 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:01:46.170452 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a50acb4f-16d0-4c72-b603-f795220ea866 could not be found. Aug 31 16:01:46.170452 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:01:46.173736 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7e07f290-367f-4470-af9b-cc38567bade4 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] Returning 404 to user: Instance a50acb4f-16d0-4c72-b603-f795220ea866 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:01:46.175303 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7e07f290-367f-4470-af9b-cc38567bade4 tempest-ServersAdminNegativeTestJSON-1786123842 tempest-ServersAdminNegativeTestJSON-1786123842-project] 10.222.0.61 "GET /compute/v2.1/servers/a50acb4f-16d0-4c72-b603-f795220ea866" status: 404 len: 111 microversion: 2.1 time: 0.050590 Aug 31 16:01:46.176016 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 779/1559] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:46 2022] GET /compute/v2.1/servers/a50acb4f-16d0-4c72-b603-f795220ea866 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:01:46.182077 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-249e39d6-06a1-4355-a8ce-a5b03d1f0760 req-4fef4011-f161-4cc4-9d1c-bb8791db51da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc085aaa-21b2-48a6-b69c-de4e261dfe7f", "name": "network-vif-unplugged", "status": "completed", "tag": "c4a89a46-30ca-4df0-bd23-f2ae8050bb54"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:01:46.194354 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-249e39d6-06a1-4355-a8ce-a5b03d1f0760 req-4fef4011-f161-4cc4-9d1c-bb8791db51da service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:46.195373 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-249e39d6-06a1-4355-a8ce-a5b03d1f0760 req-4fef4011-f161-4cc4-9d1c-bb8791db51da service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:46.196146 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-249e39d6-06a1-4355-a8ce-a5b03d1f0760 req-4fef4011-f161-4cc4-9d1c-bb8791db51da service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:46.244730 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-249e39d6-06a1-4355-a8ce-a5b03d1f0760 req-4fef4011-f161-4cc4-9d1c-bb8791db51da service nova] Creating event network-vif-unplugged:c4a89a46-30ca-4df0-bd23-f2ae8050bb54 for instance cc085aaa-21b2-48a6-b69c-de4e261dfe7f on n-h1-850499-9 Aug 31 16:01:46.259176 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-249e39d6-06a1-4355-a8ce-a5b03d1f0760 req-4fef4011-f161-4cc4-9d1c-bb8791db51da service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.081525 Aug 31 16:01:46.262539 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 780/1560] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:01:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:01:46.272425 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2e15ec20-bc19-48a7-b616-8400f50af2f7 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:46.274130 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2e15ec20-bc19-48a7-b616-8400f50af2f7 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6c7489e2-1ba0-4689-b2d7-e37886757266] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:46.283052 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2e15ec20-bc19-48a7-b616-8400f50af2f7 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:46.284318 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2e15ec20-bc19-48a7-b616-8400f50af2f7 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:46.285008 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2e15ec20-bc19-48a7-b616-8400f50af2f7 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:46.286015 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2e15ec20-bc19-48a7-b616-8400f50af2f7 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:46.286709 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2e15ec20-bc19-48a7-b616-8400f50af2f7 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:46.287362 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2e15ec20-bc19-48a7-b616-8400f50af2f7 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:46.603088 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-880d95ea-6e6d-4264-9f35-253cca834345 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lazy-loading 'services' on Instance uuid 35b89015-3888-493a-b521-49a5e3769b00 {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:01:46.659492 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-880d95ea-6e6d-4264-9f35-253cca834345 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00" status: 200 len: 2423 microversion: 2.25 time: 0.933167 Aug 31 16:01:46.678542 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 781/1561] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:01:45 2022] GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00 => generated 2423 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:01:46.678542 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8555019a-1ebd-4cce-8df7-424245104a3d tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:46.678542 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8555019a-1ebd-4cce-8df7-424245104a3d tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: 3f785545-d532-4487-b780-8a9be107a209] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:46.695846 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8555019a-1ebd-4cce-8df7-424245104a3d tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:46.696977 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8555019a-1ebd-4cce-8df7-424245104a3d tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:46.698520 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8555019a-1ebd-4cce-8df7-424245104a3d tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:46.699704 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8555019a-1ebd-4cce-8df7-424245104a3d tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:46.700447 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8555019a-1ebd-4cce-8df7-424245104a3d tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:46.701621 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8555019a-1ebd-4cce-8df7-424245104a3d tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:47.035813 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2e15ec20-bc19-48a7-b616-8400f50af2f7 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:47.046907 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2e15ec20-bc19-48a7-b616-8400f50af2f7 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266" status: 200 len: 1471 microversion: 2.1 time: 0.782080 Aug 31 16:01:47.049838 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 781/1562] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:46 2022] GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266 => generated 1471 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:47.061633 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-27b443c6-b04b-40e2-b0af-e172ff2d225d tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:47.062529 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-27b443c6-b04b-40e2-b0af-e172ff2d225d tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] [instance: 7523e0a9-60e8-42ba-b271-d63251e373b7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:47.079969 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-27b443c6-b04b-40e2-b0af-e172ff2d225d tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:47.081101 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-27b443c6-b04b-40e2-b0af-e172ff2d225d tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:47.081735 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-27b443c6-b04b-40e2-b0af-e172ff2d225d tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:47.082677 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-27b443c6-b04b-40e2-b0af-e172ff2d225d tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:47.083291 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-27b443c6-b04b-40e2-b0af-e172ff2d225d tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:47.083956 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-27b443c6-b04b-40e2-b0af-e172ff2d225d tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:47.221160 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8555019a-1ebd-4cce-8df7-424245104a3d tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ccd03a4aa84f93bc26b438e1468f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a9f3fcc4b445349e5c66ff712e8598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:47.234867 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8555019a-1ebd-4cce-8df7-424245104a3d tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/servers/3f785545-d532-4487-b780-8a9be107a209" status: 200 len: 1497 microversion: 2.1 time: 0.568726 Aug 31 16:01:47.251800 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 782/1563] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:46 2022] GET /compute/v2.1/servers/3f785545-d532-4487-b780-8a9be107a209 => generated 1497 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:47.259974 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-40100823-ee6c-4942-a9a7-e6ed613c8a77 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:47.260676 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-40100823-ee6c-4942-a9a7-e6ed613c8a77 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] [instance: fe57e6c6-2844-4ab5-ab13-c8d9ee25004d] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:47.274328 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-40100823-ee6c-4942-a9a7-e6ed613c8a77 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:47.277631 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-40100823-ee6c-4942-a9a7-e6ed613c8a77 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:47.278516 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-40100823-ee6c-4942-a9a7-e6ed613c8a77 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:47.279185 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-40100823-ee6c-4942-a9a7-e6ed613c8a77 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:47.279790 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-40100823-ee6c-4942-a9a7-e6ed613c8a77 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:47.280651 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-40100823-ee6c-4942-a9a7-e6ed613c8a77 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:47.444767 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-40100823-ee6c-4942-a9a7-e6ed613c8a77 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bdd11cffedf44e6b2959058ab88b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e459294501d4024a9deb6eb078ca808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:47.454468 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-40100823-ee6c-4942-a9a7-e6ed613c8a77 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] 10.222.0.61 "GET /compute/v2.1/servers/fe57e6c6-2844-4ab5-ab13-c8d9ee25004d" status: 200 len: 1276 microversion: 2.1 time: 0.209660 Aug 31 16:01:47.455058 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 783/1564] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:47 2022] GET /compute/v2.1/servers/fe57e6c6-2844-4ab5-ab13-c8d9ee25004d => generated 1276 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:47.484562 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-27b443c6-b04b-40e2-b0af-e172ff2d225d tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90770e7e060c4ded869851dea068189c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab675eb7ef3e45e68d74d737484c6e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:47.499307 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-27b443c6-b04b-40e2-b0af-e172ff2d225d tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] 10.222.0.61 "GET /compute/v2.1/servers/7523e0a9-60e8-42ba-b271-d63251e373b7" status: 200 len: 1401 microversion: 2.1 time: 0.447169 Aug 31 16:01:47.499987 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 782/1565] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:47 2022] GET /compute/v2.1/servers/7523e0a9-60e8-42ba-b271-d63251e373b7 => generated 1401 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:47.531762 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9547ae50-604d-4db7-9824-683856c3eae5 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-850499-9", "block_migration": "auto"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:01:47.539898 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9547ae50-604d-4db7-9824-683856c3eae5 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] [instance: 35b89015-3888-493a-b521-49a5e3769b00] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:47.561655 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9547ae50-604d-4db7-9824-683856c3eae5 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:47.562472 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9547ae50-604d-4db7-9824-683856c3eae5 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:47.565924 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9547ae50-604d-4db7-9824-683856c3eae5 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:47.571663 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9547ae50-604d-4db7-9824-683856c3eae5 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:47.572194 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9547ae50-604d-4db7-9824-683856c3eae5 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:47.572650 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9547ae50-604d-4db7-9824-683856c3eae5 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:47.665797 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-9547ae50-604d-4db7-9824-683856c3eae5 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lazy-loading 'flavor' on Instance uuid 35b89015-3888-493a-b521-49a5e3769b00 {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:01:47.696509 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9547ae50-604d-4db7-9824-683856c3eae5 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] [instance: 35b89015-3888-493a-b521-49a5e3769b00] Going to try to live migrate instance to n-h1-850499-9 {{(pid=122257) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 31 16:01:48.176505 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-02d8abd2-ed0c-4857-a981-b1dda1dcae70 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:48.178028 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-02d8abd2-ed0c-4857-a981-b1dda1dcae70 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: cc085aaa-21b2-48a6-b69c-de4e261dfe7f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:48.189983 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-02d8abd2-ed0c-4857-a981-b1dda1dcae70 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:48.192407 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-02d8abd2-ed0c-4857-a981-b1dda1dcae70 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:48.194071 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-02d8abd2-ed0c-4857-a981-b1dda1dcae70 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:48.197043 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-02d8abd2-ed0c-4857-a981-b1dda1dcae70 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:48.197797 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-02d8abd2-ed0c-4857-a981-b1dda1dcae70 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:48.199648 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-02d8abd2-ed0c-4857-a981-b1dda1dcae70 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:48.977959 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-02d8abd2-ed0c-4857-a981-b1dda1dcae70 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:48.991931 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-02d8abd2-ed0c-4857-a981-b1dda1dcae70 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f" status: 200 len: 1719 microversion: 2.1 time: 1.535350 Aug 31 16:01:48.992487 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 784/1566] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:47 2022] GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f => generated 1719 bytes in 1537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:49.012544 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a878bc06-e18c-480c-9787-f865faeadc8a tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:49.013434 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a878bc06-e18c-480c-9787-f865faeadc8a tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6c7489e2-1ba0-4689-b2d7-e37886757266] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:49.020901 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a878bc06-e18c-480c-9787-f865faeadc8a tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:49.033063 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a878bc06-e18c-480c-9787-f865faeadc8a tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:49.033540 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a878bc06-e18c-480c-9787-f865faeadc8a tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:49.034302 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a878bc06-e18c-480c-9787-f865faeadc8a tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:49.034947 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a878bc06-e18c-480c-9787-f865faeadc8a tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:49.035922 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a878bc06-e18c-480c-9787-f865faeadc8a tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:49.558877 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a878bc06-e18c-480c-9787-f865faeadc8a tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:49.573238 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a878bc06-e18c-480c-9787-f865faeadc8a tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266" status: 200 len: 1471 microversion: 2.1 time: 0.575575 Aug 31 16:01:49.580345 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 785/1567] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:48 2022] GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266 => generated 1471 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:49.585754 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-141786fb-11eb-4c79-88fb-6646e60a2fbf tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:49.586377 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-141786fb-11eb-4c79-88fb-6646e60a2fbf tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: 3f785545-d532-4487-b780-8a9be107a209] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:49.604816 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-141786fb-11eb-4c79-88fb-6646e60a2fbf tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:49.607115 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-141786fb-11eb-4c79-88fb-6646e60a2fbf tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:49.607800 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-141786fb-11eb-4c79-88fb-6646e60a2fbf tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:49.611879 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-141786fb-11eb-4c79-88fb-6646e60a2fbf tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:49.612373 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-141786fb-11eb-4c79-88fb-6646e60a2fbf tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:49.613392 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-141786fb-11eb-4c79-88fb-6646e60a2fbf tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:50.125046 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-141786fb-11eb-4c79-88fb-6646e60a2fbf tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ccd03a4aa84f93bc26b438e1468f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a9f3fcc4b445349e5c66ff712e8598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:50.133701 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-141786fb-11eb-4c79-88fb-6646e60a2fbf tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/servers/3f785545-d532-4487-b780-8a9be107a209" status: 200 len: 1497 microversion: 2.1 time: 0.552065 Aug 31 16:01:50.134287 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 786/1568] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:49 2022] GET /compute/v2.1/servers/3f785545-d532-4487-b780-8a9be107a209 => generated 1497 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:50.152927 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4976491d-65d0-47d5-938e-0d0aa8f09c92 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:50.153645 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4976491d-65d0-47d5-938e-0d0aa8f09c92 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] [instance: fe57e6c6-2844-4ab5-ab13-c8d9ee25004d] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:50.161609 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4976491d-65d0-47d5-938e-0d0aa8f09c92 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:50.162431 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4976491d-65d0-47d5-938e-0d0aa8f09c92 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:50.163208 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4976491d-65d0-47d5-938e-0d0aa8f09c92 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:50.164446 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4976491d-65d0-47d5-938e-0d0aa8f09c92 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:50.165823 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4976491d-65d0-47d5-938e-0d0aa8f09c92 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:50.166447 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4976491d-65d0-47d5-938e-0d0aa8f09c92 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:50.508275 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-4976491d-65d0-47d5-938e-0d0aa8f09c92 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bdd11cffedf44e6b2959058ab88b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e459294501d4024a9deb6eb078ca808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:50.526455 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4976491d-65d0-47d5-938e-0d0aa8f09c92 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] 10.222.0.61 "GET /compute/v2.1/servers/fe57e6c6-2844-4ab5-ab13-c8d9ee25004d" status: 200 len: 1316 microversion: 2.1 time: 0.379739 Aug 31 16:01:50.527087 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 787/1569] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:50 2022] GET /compute/v2.1/servers/fe57e6c6-2844-4ab5-ab13-c8d9ee25004d => generated 1316 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:50.532161 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-77d2a870-0285-437c-a556-cf127f3c0f42 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:50.532887 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-77d2a870-0285-437c-a556-cf127f3c0f42 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] [instance: 7523e0a9-60e8-42ba-b271-d63251e373b7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:50.544032 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9547ae50-604d-4db7-9824-683856c3eae5 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00/action" status: 202 len: 0 microversion: 2.25 time: 3.033980 Aug 31 16:01:50.545054 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 783/1570] 10.222.0.61 () {62 vars in 1319 bytes} [Wed Aug 31 16:01:47 2022] POST /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00/action => generated 0 bytes in 3042 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:01:50.554574 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-1ed91393-e276-42b8-8331-6471b0d82ee5 req-45e04cb2-5363-48c6-9d4f-1786d6f69225 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc085aaa-21b2-48a6-b69c-de4e261dfe7f", "tag": "c4a89a46-30ca-4df0-bd23-f2ae8050bb54"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:01:50.564844 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-77d2a870-0285-437c-a556-cf127f3c0f42 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:50.565401 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-77d2a870-0285-437c-a556-cf127f3c0f42 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:50.565779 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-77d2a870-0285-437c-a556-cf127f3c0f42 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:50.566736 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-77d2a870-0285-437c-a556-cf127f3c0f42 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:50.567364 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-77d2a870-0285-437c-a556-cf127f3c0f42 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:50.567991 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-77d2a870-0285-437c-a556-cf127f3c0f42 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:50.603647 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-1ed91393-e276-42b8-8331-6471b0d82ee5 req-45e04cb2-5363-48c6-9d4f-1786d6f69225 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:50.604127 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-1ed91393-e276-42b8-8331-6471b0d82ee5 req-45e04cb2-5363-48c6-9d4f-1786d6f69225 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:50.604590 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-1ed91393-e276-42b8-8331-6471b0d82ee5 req-45e04cb2-5363-48c6-9d4f-1786d6f69225 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:50.637880 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-1ed91393-e276-42b8-8331-6471b0d82ee5 req-45e04cb2-5363-48c6-9d4f-1786d6f69225 service nova] Creating event network-changed:c4a89a46-30ca-4df0-bd23-f2ae8050bb54 for instance cc085aaa-21b2-48a6-b69c-de4e261dfe7f on n-h1-850499-9 Aug 31 16:01:50.644388 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-1ed91393-e276-42b8-8331-6471b0d82ee5 req-45e04cb2-5363-48c6-9d4f-1786d6f69225 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098033 Aug 31 16:01:50.645148 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 784/1571] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:01:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:01:50.651152 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f5845e35-8b54-487b-b70e-2362d1051e1b tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:50.652131 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f5845e35-8b54-487b-b70e-2362d1051e1b tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: cc085aaa-21b2-48a6-b69c-de4e261dfe7f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:50.660120 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f5845e35-8b54-487b-b70e-2362d1051e1b tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:50.660622 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f5845e35-8b54-487b-b70e-2362d1051e1b tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:50.661258 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f5845e35-8b54-487b-b70e-2362d1051e1b tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:50.662304 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f5845e35-8b54-487b-b70e-2362d1051e1b tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:50.662721 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f5845e35-8b54-487b-b70e-2362d1051e1b tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:50.663154 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f5845e35-8b54-487b-b70e-2362d1051e1b tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:51.035331 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-77d2a870-0285-437c-a556-cf127f3c0f42 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90770e7e060c4ded869851dea068189c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab675eb7ef3e45e68d74d737484c6e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:51.043318 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-77d2a870-0285-437c-a556-cf127f3c0f42 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] 10.222.0.61 "GET /compute/v2.1/servers/7523e0a9-60e8-42ba-b271-d63251e373b7" status: 200 len: 1589 microversion: 2.1 time: 0.515184 Aug 31 16:01:51.044365 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 788/1572] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:50 2022] GET /compute/v2.1/servers/7523e0a9-60e8-42ba-b271-d63251e373b7 => generated 1589 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:51.094188 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f5845e35-8b54-487b-b70e-2362d1051e1b tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:51.107667 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f5845e35-8b54-487b-b70e-2362d1051e1b tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f" status: 200 len: 1719 microversion: 2.1 time: 0.461033 Aug 31 16:01:51.109075 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 785/1573] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:50 2022] GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f => generated 1719 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:51.349261 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e4e02a47-256a-4d86-ae2b-7d2ca63096e3 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1585927801", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:01:51.415205 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-99a46f0c-bac7-472d-86cd-ed37a1809e82 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:51.418135 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-99a46f0c-bac7-472d-86cd-ed37a1809e82 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 35b89015-3888-493a-b521-49a5e3769b00] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:51.424295 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-e4e02a47-256a-4d86-ae2b-7d2ca63096e3 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] validate_networks() for None {{(pid=122257) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:01:51.433115 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-99a46f0c-bac7-472d-86cd-ed37a1809e82 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:51.433979 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-99a46f0c-bac7-472d-86cd-ed37a1809e82 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:51.434670 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-99a46f0c-bac7-472d-86cd-ed37a1809e82 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:51.436383 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-99a46f0c-bac7-472d-86cd-ed37a1809e82 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:51.437085 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-99a46f0c-bac7-472d-86cd-ed37a1809e82 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:51.438560 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-99a46f0c-bac7-472d-86cd-ed37a1809e82 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:52.210986 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-99a46f0c-bac7-472d-86cd-ed37a1809e82 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:52.223623 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-99a46f0c-bac7-472d-86cd-ed37a1809e82 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:52.225729 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-99a46f0c-bac7-472d-86cd-ed37a1809e82 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:52.227277 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-99a46f0c-bac7-472d-86cd-ed37a1809e82 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00" status: 200 len: 1815 microversion: 2.25 time: 1.181782 Aug 31 16:01:52.228389 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 789/1574] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:01:51 2022] GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00 => generated 1815 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:01:52.244446 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ab96abce-75d2-4c12-ba93-4b92f75ccd55 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:52.245722 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ab96abce-75d2-4c12-ba93-4b92f75ccd55 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6c7489e2-1ba0-4689-b2d7-e37886757266] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:52.253069 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ab96abce-75d2-4c12-ba93-4b92f75ccd55 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:52.254319 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ab96abce-75d2-4c12-ba93-4b92f75ccd55 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:52.255350 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ab96abce-75d2-4c12-ba93-4b92f75ccd55 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:52.256267 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ab96abce-75d2-4c12-ba93-4b92f75ccd55 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:52.256891 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ab96abce-75d2-4c12-ba93-4b92f75ccd55 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:52.257500 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ab96abce-75d2-4c12-ba93-4b92f75ccd55 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:52.421696 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-e4e02a47-256a-4d86-ae2b-7d2ca63096e3 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:01:52.422904 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-e4e02a47-256a-4d86-ae2b-7d2ca63096e3 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:01:52.423582 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-e4e02a47-256a-4d86-ae2b-7d2ca63096e3 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:01:52.424115 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-e4e02a47-256a-4d86-ae2b-7d2ca63096e3 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:01:52.424542 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-e4e02a47-256a-4d86-ae2b-7d2ca63096e3 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:01:52.444202 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e4e02a47-256a-4d86-ae2b-7d2ca63096e3 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:52.445060 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e4e02a47-256a-4d86-ae2b-7d2ca63096e3 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:52.445712 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e4e02a47-256a-4d86-ae2b-7d2ca63096e3 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:52.446744 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e4e02a47-256a-4d86-ae2b-7d2ca63096e3 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:52.457720 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e4e02a47-256a-4d86-ae2b-7d2ca63096e3 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:52.458409 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e4e02a47-256a-4d86-ae2b-7d2ca63096e3 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:52.481314 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-e4e02a47-256a-4d86-ae2b-7d2ca63096e3 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Getting quotas for project 7fa2effd15e440598752264e49d2457d. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:01:52.490678 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-e4e02a47-256a-4d86-ae2b-7d2ca63096e3 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Getting quotas for user 547d88df13034daaad50c3582c7cc3b3 and project 7fa2effd15e440598752264e49d2457d. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:01:52.508282 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e4e02a47-256a-4d86-ae2b-7d2ca63096e3 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Going to run 1 instances... {{(pid=122257) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:01:52.510874 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e4e02a47-256a-4d86-ae2b-7d2ca63096e3 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 44f1ab8f-3a6c-41f3-b9fd-7f8aa243bcfa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:01:52.577946 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e4e02a47-256a-4d86-ae2b-7d2ca63096e3 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.461913 Aug 31 16:01:52.580955 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 786/1575] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:01:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1469 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:01:52.588170 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-696f128e-ab29-4330-a3f4-7f39d90e04c8 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:52.589805 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-696f128e-ab29-4330-a3f4-7f39d90e04c8 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] [instance: 7523e0a9-60e8-42ba-b271-d63251e373b7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:52.594933 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ab96abce-75d2-4c12-ba93-4b92f75ccd55 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:52.599208 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-696f128e-ab29-4330-a3f4-7f39d90e04c8 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:52.600116 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-696f128e-ab29-4330-a3f4-7f39d90e04c8 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:52.601314 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-696f128e-ab29-4330-a3f4-7f39d90e04c8 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:52.603017 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-696f128e-ab29-4330-a3f4-7f39d90e04c8 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:52.603662 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-696f128e-ab29-4330-a3f4-7f39d90e04c8 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:52.604038 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-696f128e-ab29-4330-a3f4-7f39d90e04c8 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:52.611939 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ab96abce-75d2-4c12-ba93-4b92f75ccd55 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266" status: 200 len: 1476 microversion: 2.1 time: 0.382121 Aug 31 16:01:52.613407 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 790/1576] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:52 2022] GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266 => generated 1476 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:52.618567 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0f45ca81-28d9-433d-9b22-84033282f84c tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:52.619536 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0f45ca81-28d9-433d-9b22-84033282f84c tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: 3f785545-d532-4487-b780-8a9be107a209] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:52.627901 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0f45ca81-28d9-433d-9b22-84033282f84c tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:52.628741 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0f45ca81-28d9-433d-9b22-84033282f84c tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:52.629418 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0f45ca81-28d9-433d-9b22-84033282f84c tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:52.630221 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0f45ca81-28d9-433d-9b22-84033282f84c tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:52.630754 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0f45ca81-28d9-433d-9b22-84033282f84c tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:52.631261 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0f45ca81-28d9-433d-9b22-84033282f84c tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:52.643838 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:01:52.856513 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-696f128e-ab29-4330-a3f4-7f39d90e04c8 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] 10.222.0.61 "GET /compute/v2.1/servers/7523e0a9-60e8-42ba-b271-d63251e373b7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.274159 Aug 31 16:01:52.858279 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 787/1577] 10.222.0.61 () {58 vars in 1275 bytes} [Wed Aug 31 16:01:52 2022] GET /compute/v2.1/servers/7523e0a9-60e8-42ba-b271-d63251e373b7/os-interface => generated 285 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:01:52.864066 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-48e1fc2f-b617-4b92-bba7-463bce4e429e tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:52.865787 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-48e1fc2f-b617-4b92-bba7-463bce4e429e tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] [instance: fe57e6c6-2844-4ab5-ab13-c8d9ee25004d] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:52.873093 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-48e1fc2f-b617-4b92-bba7-463bce4e429e tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:52.874327 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-48e1fc2f-b617-4b92-bba7-463bce4e429e tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:52.875011 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-48e1fc2f-b617-4b92-bba7-463bce4e429e tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:52.876612 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-48e1fc2f-b617-4b92-bba7-463bce4e429e tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:52.877493 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-48e1fc2f-b617-4b92-bba7-463bce4e429e tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:52.878139 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-48e1fc2f-b617-4b92-bba7-463bce4e429e tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:53.057925 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-0f45ca81-28d9-433d-9b22-84033282f84c tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ccd03a4aa84f93bc26b438e1468f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a9f3fcc4b445349e5c66ff712e8598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:53.073525 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0f45ca81-28d9-433d-9b22-84033282f84c tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/servers/3f785545-d532-4487-b780-8a9be107a209" status: 200 len: 1497 microversion: 2.1 time: 0.458510 Aug 31 16:01:53.075329 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 791/1578] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:52 2022] GET /compute/v2.1/servers/3f785545-d532-4487-b780-8a9be107a209 => generated 1497 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:53.080535 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4e82bf1d-ed46-4355-a6a8-e8e82e548f4c tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:53.085337 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4e82bf1d-ed46-4355-a6a8-e8e82e548f4c tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: cc085aaa-21b2-48a6-b69c-de4e261dfe7f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:53.103301 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4e82bf1d-ed46-4355-a6a8-e8e82e548f4c tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:53.103923 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4e82bf1d-ed46-4355-a6a8-e8e82e548f4c tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:53.104372 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4e82bf1d-ed46-4355-a6a8-e8e82e548f4c tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:53.105097 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4e82bf1d-ed46-4355-a6a8-e8e82e548f4c tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:53.105564 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4e82bf1d-ed46-4355-a6a8-e8e82e548f4c tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:53.105985 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4e82bf1d-ed46-4355-a6a8-e8e82e548f4c tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:53.145762 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-48e1fc2f-b617-4b92-bba7-463bce4e429e tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bdd11cffedf44e6b2959058ab88b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e459294501d4024a9deb6eb078ca808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:53.188746 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-48e1fc2f-b617-4b92-bba7-463bce4e429e tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] 10.222.0.61 "GET /compute/v2.1/servers/fe57e6c6-2844-4ab5-ab13-c8d9ee25004d" status: 200 len: 1316 microversion: 2.1 time: 0.325744 Aug 31 16:01:53.193165 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 788/1579] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:52 2022] GET /compute/v2.1/servers/fe57e6c6-2844-4ab5-ab13-c8d9ee25004d => generated 1316 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:53.212366 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-02da577c-b06a-42a0-a036-656b4bde5e97 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:53.219285 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-02da577c-b06a-42a0-a036-656b4bde5e97 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 44f1ab8f-3a6c-41f3-b9fd-7f8aa243bcfa] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:53.312371 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-02da577c-b06a-42a0-a036-656b4bde5e97 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:53.328361 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-02da577c-b06a-42a0-a036-656b4bde5e97 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/44f1ab8f-3a6c-41f3-b9fd-7f8aa243bcfa" status: 200 len: 1217 microversion: 2.1 time: 0.132414 Aug 31 16:01:53.330608 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 789/1580] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:53 2022] GET /compute/v2.1/servers/44f1ab8f-3a6c-41f3-b9fd-7f8aa243bcfa => generated 1217 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:53.347537 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-f5f29629-3553-4ae8-a87a-f04d52ee0406 req-c8c2efa6-1789-45e6-ae6d-841c1fa2a386 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe57e6c6-2844-4ab5-ab13-c8d9ee25004d", "tag": "511a0371-3789-48d6-9ab1-15c27ffc57f1"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:01:53.357478 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-f5f29629-3553-4ae8-a87a-f04d52ee0406 req-c8c2efa6-1789-45e6-ae6d-841c1fa2a386 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:53.357958 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-f5f29629-3553-4ae8-a87a-f04d52ee0406 req-c8c2efa6-1789-45e6-ae6d-841c1fa2a386 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:53.358386 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-f5f29629-3553-4ae8-a87a-f04d52ee0406 req-c8c2efa6-1789-45e6-ae6d-841c1fa2a386 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:53.370269 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-4e82bf1d-ed46-4355-a6a8-e8e82e548f4c tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:53.374099 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-f5f29629-3553-4ae8-a87a-f04d52ee0406 req-c8c2efa6-1789-45e6-ae6d-841c1fa2a386 service nova] Creating event network-changed:511a0371-3789-48d6-9ab1-15c27ffc57f1 for instance fe57e6c6-2844-4ab5-ab13-c8d9ee25004d on n-h1-850499-9 Aug 31 16:01:53.379410 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-f5f29629-3553-4ae8-a87a-f04d52ee0406 req-c8c2efa6-1789-45e6-ae6d-841c1fa2a386 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035961 Aug 31 16:01:53.383026 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 790/1581] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:01:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:01:53.388591 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-466b1e56-d969-45d5-86c9-849afe3655f1 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:53.389297 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-466b1e56-d969-45d5-86c9-849afe3655f1 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 35b89015-3888-493a-b521-49a5e3769b00] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:53.393657 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4e82bf1d-ed46-4355-a6a8-e8e82e548f4c tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f" status: 200 len: 1719 microversion: 2.1 time: 0.316700 Aug 31 16:01:53.394600 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 792/1582] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:53 2022] GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f => generated 1719 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:53.409910 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-466b1e56-d969-45d5-86c9-849afe3655f1 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:53.410805 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-466b1e56-d969-45d5-86c9-849afe3655f1 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:53.411627 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-466b1e56-d969-45d5-86c9-849afe3655f1 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:53.413189 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-466b1e56-d969-45d5-86c9-849afe3655f1 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:53.414085 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-466b1e56-d969-45d5-86c9-849afe3655f1 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:53.414881 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-466b1e56-d969-45d5-86c9-849afe3655f1 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:53.640946 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1d03ccd5-7747-42a9-860c-757091c7d90f tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:53.641296 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1d03ccd5-7747-42a9-860c-757091c7d90f tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6c7489e2-1ba0-4689-b2d7-e37886757266] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:53.657760 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1d03ccd5-7747-42a9-860c-757091c7d90f tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:53.661992 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-466b1e56-d969-45d5-86c9-849afe3655f1 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:53.662945 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1d03ccd5-7747-42a9-860c-757091c7d90f tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:53.663602 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1d03ccd5-7747-42a9-860c-757091c7d90f tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:53.664885 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1d03ccd5-7747-42a9-860c-757091c7d90f tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:53.666303 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1d03ccd5-7747-42a9-860c-757091c7d90f tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:53.666975 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1d03ccd5-7747-42a9-860c-757091c7d90f tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:53.671469 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-466b1e56-d969-45d5-86c9-849afe3655f1 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:53.673975 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-466b1e56-d969-45d5-86c9-849afe3655f1 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:53.675285 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-466b1e56-d969-45d5-86c9-849afe3655f1 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00" status: 200 len: 1815 microversion: 2.25 time: 0.290975 Aug 31 16:01:53.676291 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 791/1583] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:01:53 2022] GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00 => generated 1815 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:01:53.875042 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1d03ccd5-7747-42a9-860c-757091c7d90f tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:53.884471 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1d03ccd5-7747-42a9-860c-757091c7d90f tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266" status: 200 len: 1476 microversion: 2.1 time: 0.251764 Aug 31 16:01:53.885851 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 793/1584] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:53 2022] GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266 => generated 1476 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:54.110932 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-94dbc7ee-898f-42a9-bb5c-8f094e027b78 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:54.112944 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-94dbc7ee-898f-42a9-bb5c-8f094e027b78 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: 3f785545-d532-4487-b780-8a9be107a209] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:54.122963 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-94dbc7ee-898f-42a9-bb5c-8f094e027b78 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:54.123460 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-94dbc7ee-898f-42a9-bb5c-8f094e027b78 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:54.124122 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-94dbc7ee-898f-42a9-bb5c-8f094e027b78 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:54.128577 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-94dbc7ee-898f-42a9-bb5c-8f094e027b78 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:54.128577 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-94dbc7ee-898f-42a9-bb5c-8f094e027b78 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:54.128577 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-94dbc7ee-898f-42a9-bb5c-8f094e027b78 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:54.236390 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f53e8a29-6439-48d8-91d1-807fcf9cc841 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:54.240582 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f53e8a29-6439-48d8-91d1-807fcf9cc841 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] [instance: fe57e6c6-2844-4ab5-ab13-c8d9ee25004d] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:54.250095 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f53e8a29-6439-48d8-91d1-807fcf9cc841 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:54.261543 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f53e8a29-6439-48d8-91d1-807fcf9cc841 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:54.262761 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f53e8a29-6439-48d8-91d1-807fcf9cc841 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:54.263558 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f53e8a29-6439-48d8-91d1-807fcf9cc841 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:54.264201 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f53e8a29-6439-48d8-91d1-807fcf9cc841 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:54.264793 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f53e8a29-6439-48d8-91d1-807fcf9cc841 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:54.375561 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-94dbc7ee-898f-42a9-bb5c-8f094e027b78 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ccd03a4aa84f93bc26b438e1468f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a9f3fcc4b445349e5c66ff712e8598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:54.384624 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-94dbc7ee-898f-42a9-bb5c-8f094e027b78 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/servers/3f785545-d532-4487-b780-8a9be107a209" status: 200 len: 1497 microversion: 2.1 time: 0.278061 Aug 31 16:01:54.385710 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 792/1585] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:54 2022] GET /compute/v2.1/servers/3f785545-d532-4487-b780-8a9be107a209 => generated 1497 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:54.400488 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6e82bdfa-de5e-4bf2-8d02-7274539b6a50 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:54.401824 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6e82bdfa-de5e-4bf2-8d02-7274539b6a50 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] [instance: 7523e0a9-60e8-42ba-b271-d63251e373b7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:54.409840 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6e82bdfa-de5e-4bf2-8d02-7274539b6a50 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:54.410534 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6e82bdfa-de5e-4bf2-8d02-7274539b6a50 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:54.411136 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6e82bdfa-de5e-4bf2-8d02-7274539b6a50 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:54.412124 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6e82bdfa-de5e-4bf2-8d02-7274539b6a50 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:54.412756 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6e82bdfa-de5e-4bf2-8d02-7274539b6a50 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:54.413507 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6e82bdfa-de5e-4bf2-8d02-7274539b6a50 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:54.536524 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f53e8a29-6439-48d8-91d1-807fcf9cc841 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bdd11cffedf44e6b2959058ab88b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e459294501d4024a9deb6eb078ca808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:54.546650 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f53e8a29-6439-48d8-91d1-807fcf9cc841 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] 10.222.0.61 "GET /compute/v2.1/servers/fe57e6c6-2844-4ab5-ab13-c8d9ee25004d" status: 200 len: 1316 microversion: 2.1 time: 0.314721 Aug 31 16:01:54.548493 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 794/1586] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:54 2022] GET /compute/v2.1/servers/fe57e6c6-2844-4ab5-ab13-c8d9ee25004d => generated 1316 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:54.595354 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-6e82bdfa-de5e-4bf2-8d02-7274539b6a50 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90770e7e060c4ded869851dea068189c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab675eb7ef3e45e68d74d737484c6e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:54.606040 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6e82bdfa-de5e-4bf2-8d02-7274539b6a50 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] 10.222.0.61 "GET /compute/v2.1/servers/7523e0a9-60e8-42ba-b271-d63251e373b7" status: 200 len: 1589 microversion: 2.1 time: 0.219109 Aug 31 16:01:54.611997 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 793/1587] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:54 2022] GET /compute/v2.1/servers/7523e0a9-60e8-42ba-b271-d63251e373b7 => generated 1589 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:54.619853 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1429efee-79a4-486c-b9a8-fd4ad13261c3 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:54.624737 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1429efee-79a4-486c-b9a8-fd4ad13261c3 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 44f1ab8f-3a6c-41f3-b9fd-7f8aa243bcfa] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:54.630992 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-13c404dd-3160-4b97-b9dc-22b37effb298 req-96e88b31-fe4c-43ab-9e59-f3b2fae58f1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7523e0a9-60e8-42ba-b271-d63251e373b7", "tag": "75f9e894-839c-40d9-9d82-24b08eceeda4"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:01:54.632750 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1429efee-79a4-486c-b9a8-fd4ad13261c3 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:54.633252 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1429efee-79a4-486c-b9a8-fd4ad13261c3 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:54.633688 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1429efee-79a4-486c-b9a8-fd4ad13261c3 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:54.634737 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1429efee-79a4-486c-b9a8-fd4ad13261c3 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:54.635197 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1429efee-79a4-486c-b9a8-fd4ad13261c3 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:54.635648 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1429efee-79a4-486c-b9a8-fd4ad13261c3 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:54.644880 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-13c404dd-3160-4b97-b9dc-22b37effb298 req-96e88b31-fe4c-43ab-9e59-f3b2fae58f1d service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:54.645727 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-13c404dd-3160-4b97-b9dc-22b37effb298 req-96e88b31-fe4c-43ab-9e59-f3b2fae58f1d service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:54.646409 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-13c404dd-3160-4b97-b9dc-22b37effb298 req-96e88b31-fe4c-43ab-9e59-f3b2fae58f1d service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:54.660690 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-13c404dd-3160-4b97-b9dc-22b37effb298 req-96e88b31-fe4c-43ab-9e59-f3b2fae58f1d service nova] Creating event network-changed:75f9e894-839c-40d9-9d82-24b08eceeda4 for instance 7523e0a9-60e8-42ba-b271-d63251e373b7 on n-h2-850499-9 Aug 31 16:01:54.665712 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-13c404dd-3160-4b97-b9dc-22b37effb298 req-96e88b31-fe4c-43ab-9e59-f3b2fae58f1d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115619 Aug 31 16:01:54.666650 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 795/1588] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:01:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:01:54.675260 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5d5b7a72-0b6a-44f0-a5cb-240500f63ebf tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:54.679759 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5d5b7a72-0b6a-44f0-a5cb-240500f63ebf tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: cc085aaa-21b2-48a6-b69c-de4e261dfe7f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:54.687823 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5d5b7a72-0b6a-44f0-a5cb-240500f63ebf tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:54.689296 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5d5b7a72-0b6a-44f0-a5cb-240500f63ebf tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:54.689954 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5d5b7a72-0b6a-44f0-a5cb-240500f63ebf tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:54.690715 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5d5b7a72-0b6a-44f0-a5cb-240500f63ebf tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:54.691850 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5d5b7a72-0b6a-44f0-a5cb-240500f63ebf tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:54.692297 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5d5b7a72-0b6a-44f0-a5cb-240500f63ebf tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:54.716654 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-1429efee-79a4-486c-b9a8-fd4ad13261c3 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:54.726124 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1429efee-79a4-486c-b9a8-fd4ad13261c3 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/44f1ab8f-3a6c-41f3-b9fd-7f8aa243bcfa" status: 200 len: 1269 microversion: 2.1 time: 0.112795 Aug 31 16:01:54.739841 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 794/1589] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:54 2022] GET /compute/v2.1/servers/44f1ab8f-3a6c-41f3-b9fd-7f8aa243bcfa => generated 1269 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:54.739841 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-fe2bf385-5aa0-478a-8b79-5370ea9de3ac tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:54.739841 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-fe2bf385-5aa0-478a-8b79-5370ea9de3ac tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 35b89015-3888-493a-b521-49a5e3769b00] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:54.759058 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fe2bf385-5aa0-478a-8b79-5370ea9de3ac tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:54.762748 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fe2bf385-5aa0-478a-8b79-5370ea9de3ac tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:54.762748 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fe2bf385-5aa0-478a-8b79-5370ea9de3ac tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:54.762748 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fe2bf385-5aa0-478a-8b79-5370ea9de3ac tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:54.763614 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fe2bf385-5aa0-478a-8b79-5370ea9de3ac tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:54.763614 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fe2bf385-5aa0-478a-8b79-5370ea9de3ac tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:54.979692 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5d5b7a72-0b6a-44f0-a5cb-240500f63ebf tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:54.995294 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5d5b7a72-0b6a-44f0-a5cb-240500f63ebf tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f" status: 200 len: 1719 microversion: 2.1 time: 0.327390 Aug 31 16:01:54.996230 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 796/1590] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:54 2022] GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f => generated 1719 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:55.027686 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-80109079-6a1e-48dc-acc9-ef93c72e3bf2 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:55.027686 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-80109079-6a1e-48dc-acc9-ef93c72e3bf2 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6c7489e2-1ba0-4689-b2d7-e37886757266] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:55.034971 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-80109079-6a1e-48dc-acc9-ef93c72e3bf2 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:55.035661 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-80109079-6a1e-48dc-acc9-ef93c72e3bf2 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:55.036131 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-80109079-6a1e-48dc-acc9-ef93c72e3bf2 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:55.037025 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-80109079-6a1e-48dc-acc9-ef93c72e3bf2 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:55.037490 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-80109079-6a1e-48dc-acc9-ef93c72e3bf2 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:55.037919 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-80109079-6a1e-48dc-acc9-ef93c72e3bf2 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:55.051956 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-fe2bf385-5aa0-478a-8b79-5370ea9de3ac tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:55.065040 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-fe2bf385-5aa0-478a-8b79-5370ea9de3ac tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:55.067293 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-fe2bf385-5aa0-478a-8b79-5370ea9de3ac tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:55.069095 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-fe2bf385-5aa0-478a-8b79-5370ea9de3ac tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00" status: 200 len: 1815 microversion: 2.25 time: 0.340976 Aug 31 16:01:55.070046 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 795/1591] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:01:54 2022] GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00 => generated 1815 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:01:55.408738 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-db7fae53-c245-4afa-bf6e-bb739396f849 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:55.409365 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-db7fae53-c245-4afa-bf6e-bb739396f849 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: 3f785545-d532-4487-b780-8a9be107a209] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:55.421215 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-80109079-6a1e-48dc-acc9-ef93c72e3bf2 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:55.434682 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-80109079-6a1e-48dc-acc9-ef93c72e3bf2 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266" status: 200 len: 1476 microversion: 2.1 time: 0.423651 Aug 31 16:01:55.435284 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 797/1592] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:54 2022] GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266 => generated 1476 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:55.437713 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-db7fae53-c245-4afa-bf6e-bb739396f849 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:55.438307 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-db7fae53-c245-4afa-bf6e-bb739396f849 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:55.439092 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-db7fae53-c245-4afa-bf6e-bb739396f849 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:55.439860 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-db7fae53-c245-4afa-bf6e-bb739396f849 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:55.440328 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-db7fae53-c245-4afa-bf6e-bb739396f849 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:55.440763 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-db7fae53-c245-4afa-bf6e-bb739396f849 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:55.571875 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5f9b8e8e-2c3c-4cbe-9e9d-f3881193540b tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:55.573147 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5f9b8e8e-2c3c-4cbe-9e9d-f3881193540b tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] [instance: fe57e6c6-2844-4ab5-ab13-c8d9ee25004d] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:55.582310 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5f9b8e8e-2c3c-4cbe-9e9d-f3881193540b tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:55.583107 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5f9b8e8e-2c3c-4cbe-9e9d-f3881193540b tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:55.583886 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5f9b8e8e-2c3c-4cbe-9e9d-f3881193540b tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:55.585058 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5f9b8e8e-2c3c-4cbe-9e9d-f3881193540b tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:55.585686 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5f9b8e8e-2c3c-4cbe-9e9d-f3881193540b tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:55.586284 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5f9b8e8e-2c3c-4cbe-9e9d-f3881193540b tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:55.630485 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=100 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:01:55.814823 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-db7fae53-c245-4afa-bf6e-bb739396f849 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ccd03a4aa84f93bc26b438e1468f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a9f3fcc4b445349e5c66ff712e8598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:55.827620 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-db7fae53-c245-4afa-bf6e-bb739396f849 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/servers/3f785545-d532-4487-b780-8a9be107a209" status: 200 len: 1497 microversion: 2.1 time: 0.423594 Aug 31 16:01:55.832113 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 796/1593] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:55 2022] GET /compute/v2.1/servers/3f785545-d532-4487-b780-8a9be107a209 => generated 1497 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:55.835381 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f6f19400-168a-47b8-92b3-d7e365b15fc9 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:55.836827 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f6f19400-168a-47b8-92b3-d7e365b15fc9 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 44f1ab8f-3a6c-41f3-b9fd-7f8aa243bcfa] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:55.843583 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f6f19400-168a-47b8-92b3-d7e365b15fc9 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:55.845547 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f6f19400-168a-47b8-92b3-d7e365b15fc9 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:55.846468 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f6f19400-168a-47b8-92b3-d7e365b15fc9 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:55.847765 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f6f19400-168a-47b8-92b3-d7e365b15fc9 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:55.848459 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f6f19400-168a-47b8-92b3-d7e365b15fc9 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:55.849159 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f6f19400-168a-47b8-92b3-d7e365b15fc9 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:56.017001 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f6f19400-168a-47b8-92b3-d7e365b15fc9 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:56.024998 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f6f19400-168a-47b8-92b3-d7e365b15fc9 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/44f1ab8f-3a6c-41f3-b9fd-7f8aa243bcfa" status: 200 len: 1275 microversion: 2.1 time: 0.194659 Aug 31 16:01:56.025872 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 797/1594] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:55 2022] GET /compute/v2.1/servers/44f1ab8f-3a6c-41f3-b9fd-7f8aa243bcfa => generated 1275 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:56.036061 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-60e79cdd-1e75-4b07-a8a6-609bd3cb2fd7 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:56.040173 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-60e79cdd-1e75-4b07-a8a6-609bd3cb2fd7 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: cc085aaa-21b2-48a6-b69c-de4e261dfe7f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:56.042112 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5f9b8e8e-2c3c-4cbe-9e9d-f3881193540b tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bdd11cffedf44e6b2959058ab88b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e459294501d4024a9deb6eb078ca808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:56.046929 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-60e79cdd-1e75-4b07-a8a6-609bd3cb2fd7 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:56.048616 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-60e79cdd-1e75-4b07-a8a6-609bd3cb2fd7 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:56.049329 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-60e79cdd-1e75-4b07-a8a6-609bd3cb2fd7 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:56.050107 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-60e79cdd-1e75-4b07-a8a6-609bd3cb2fd7 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:56.050735 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-60e79cdd-1e75-4b07-a8a6-609bd3cb2fd7 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:56.051347 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-60e79cdd-1e75-4b07-a8a6-609bd3cb2fd7 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:56.056244 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5f9b8e8e-2c3c-4cbe-9e9d-f3881193540b tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] 10.222.0.61 "GET /compute/v2.1/servers/fe57e6c6-2844-4ab5-ab13-c8d9ee25004d" status: 200 len: 1316 microversion: 2.1 time: 0.490806 Aug 31 16:01:56.058369 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 798/1595] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:55 2022] GET /compute/v2.1/servers/fe57e6c6-2844-4ab5-ab13-c8d9ee25004d => generated 1316 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:56.092834 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-42caffd4-0d97-4469-a0e1-e30dd147fdc9 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:56.094517 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-42caffd4-0d97-4469-a0e1-e30dd147fdc9 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 35b89015-3888-493a-b521-49a5e3769b00] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:56.102454 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42caffd4-0d97-4469-a0e1-e30dd147fdc9 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:56.103437 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42caffd4-0d97-4469-a0e1-e30dd147fdc9 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:56.104158 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42caffd4-0d97-4469-a0e1-e30dd147fdc9 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:56.105137 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42caffd4-0d97-4469-a0e1-e30dd147fdc9 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:56.105701 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42caffd4-0d97-4469-a0e1-e30dd147fdc9 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:56.106383 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42caffd4-0d97-4469-a0e1-e30dd147fdc9 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:56.586107 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-60e79cdd-1e75-4b07-a8a6-609bd3cb2fd7 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:56.606974 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-60e79cdd-1e75-4b07-a8a6-609bd3cb2fd7 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f" status: 200 len: 1719 microversion: 2.1 time: 0.571895 Aug 31 16:01:56.619821 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-42caffd4-0d97-4469-a0e1-e30dd147fdc9 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:56.620352 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 798/1596] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:56 2022] GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f => generated 1719 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:56.636063 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-829cb920-13c7-43d2-9e0d-61003e0bbba6 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:56.637081 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-829cb920-13c7-43d2-9e0d-61003e0bbba6 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6c7489e2-1ba0-4689-b2d7-e37886757266] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:56.644735 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-829cb920-13c7-43d2-9e0d-61003e0bbba6 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:56.645493 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-829cb920-13c7-43d2-9e0d-61003e0bbba6 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:56.646207 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-829cb920-13c7-43d2-9e0d-61003e0bbba6 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:56.647077 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-829cb920-13c7-43d2-9e0d-61003e0bbba6 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:56.651742 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-829cb920-13c7-43d2-9e0d-61003e0bbba6 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:56.652813 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-829cb920-13c7-43d2-9e0d-61003e0bbba6 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:56.658504 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-42caffd4-0d97-4469-a0e1-e30dd147fdc9 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:56.681303 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-42caffd4-0d97-4469-a0e1-e30dd147fdc9 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:56.688781 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-42caffd4-0d97-4469-a0e1-e30dd147fdc9 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00" status: 200 len: 1815 microversion: 2.25 time: 0.598896 Aug 31 16:01:56.689846 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 799/1597] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:01:56 2022] GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00 => generated 1815 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:01:56.851128 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a147a73e-a1f5-493a-a238-8e180da09ca2 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:56.852060 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a147a73e-a1f5-493a-a238-8e180da09ca2 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: 3f785545-d532-4487-b780-8a9be107a209] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:56.859952 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a147a73e-a1f5-493a-a238-8e180da09ca2 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:56.861246 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a147a73e-a1f5-493a-a238-8e180da09ca2 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:56.861925 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a147a73e-a1f5-493a-a238-8e180da09ca2 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:56.863368 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a147a73e-a1f5-493a-a238-8e180da09ca2 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:56.864307 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a147a73e-a1f5-493a-a238-8e180da09ca2 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:56.865723 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a147a73e-a1f5-493a-a238-8e180da09ca2 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:57.318632 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a147a73e-a1f5-493a-a238-8e180da09ca2 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ccd03a4aa84f93bc26b438e1468f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a9f3fcc4b445349e5c66ff712e8598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:57.328152 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a147a73e-a1f5-493a-a238-8e180da09ca2 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/servers/3f785545-d532-4487-b780-8a9be107a209" status: 200 len: 1497 microversion: 2.1 time: 0.481169 Aug 31 16:01:57.328974 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 800/1598] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:56 2022] GET /compute/v2.1/servers/3f785545-d532-4487-b780-8a9be107a209 => generated 1497 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:01:57.333803 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-cc1f4c08-242d-4a1f-b9d0-3b07fde550c2 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:57.335038 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-cc1f4c08-242d-4a1f-b9d0-3b07fde550c2 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 44f1ab8f-3a6c-41f3-b9fd-7f8aa243bcfa] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:57.342496 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cc1f4c08-242d-4a1f-b9d0-3b07fde550c2 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:57.343403 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cc1f4c08-242d-4a1f-b9d0-3b07fde550c2 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:57.345421 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cc1f4c08-242d-4a1f-b9d0-3b07fde550c2 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:57.346389 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cc1f4c08-242d-4a1f-b9d0-3b07fde550c2 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:57.347033 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cc1f4c08-242d-4a1f-b9d0-3b07fde550c2 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:57.347479 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cc1f4c08-242d-4a1f-b9d0-3b07fde550c2 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:57.354039 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-829cb920-13c7-43d2-9e0d-61003e0bbba6 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:57.367732 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-829cb920-13c7-43d2-9e0d-61003e0bbba6 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266" status: 200 len: 1476 microversion: 2.1 time: 0.746419 Aug 31 16:01:57.368334 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 799/1599] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:56 2022] GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266 => generated 1476 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:57.376343 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8b961b05-fde3-463d-9f46-b52ac258025b tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:57.376953 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8b961b05-fde3-463d-9f46-b52ac258025b tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] [instance: fe57e6c6-2844-4ab5-ab13-c8d9ee25004d] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:57.388654 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b961b05-fde3-463d-9f46-b52ac258025b tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:57.392178 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b961b05-fde3-463d-9f46-b52ac258025b tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:57.394417 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b961b05-fde3-463d-9f46-b52ac258025b tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:57.397307 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b961b05-fde3-463d-9f46-b52ac258025b tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:57.398090 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b961b05-fde3-463d-9f46-b52ac258025b tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:57.398756 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b961b05-fde3-463d-9f46-b52ac258025b tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:57.490629 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-cc1f4c08-242d-4a1f-b9d0-3b07fde550c2 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:57.498959 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-cc1f4c08-242d-4a1f-b9d0-3b07fde550c2 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/44f1ab8f-3a6c-41f3-b9fd-7f8aa243bcfa" status: 200 len: 1275 microversion: 2.1 time: 0.168717 Aug 31 16:01:57.499811 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 801/1600] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:57 2022] GET /compute/v2.1/servers/44f1ab8f-3a6c-41f3-b9fd-7f8aa243bcfa => generated 1275 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:57.635342 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3e3f8eb7-0640-4627-8158-868bc0dd5633 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:57.636709 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3e3f8eb7-0640-4627-8158-868bc0dd5633 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: cc085aaa-21b2-48a6-b69c-de4e261dfe7f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:57.646418 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3e3f8eb7-0640-4627-8158-868bc0dd5633 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:57.646930 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3e3f8eb7-0640-4627-8158-868bc0dd5633 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:57.647382 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3e3f8eb7-0640-4627-8158-868bc0dd5633 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:57.648120 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3e3f8eb7-0640-4627-8158-868bc0dd5633 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:57.648588 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3e3f8eb7-0640-4627-8158-868bc0dd5633 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:57.649016 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3e3f8eb7-0640-4627-8158-868bc0dd5633 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:57.709161 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8b961b05-fde3-463d-9f46-b52ac258025b tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bdd11cffedf44e6b2959058ab88b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e459294501d4024a9deb6eb078ca808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:57.718201 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8b961b05-fde3-463d-9f46-b52ac258025b tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] 10.222.0.61 "GET /compute/v2.1/servers/fe57e6c6-2844-4ab5-ab13-c8d9ee25004d" status: 200 len: 1316 microversion: 2.1 time: 0.348088 Aug 31 16:01:57.733604 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 800/1601] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:57 2022] GET /compute/v2.1/servers/fe57e6c6-2844-4ab5-ab13-c8d9ee25004d => generated 1316 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:57.739034 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2a567070-7882-4e46-adc1-532f41855215 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:57.739910 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2a567070-7882-4e46-adc1-532f41855215 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 35b89015-3888-493a-b521-49a5e3769b00] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:57.745785 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2a567070-7882-4e46-adc1-532f41855215 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:57.746293 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2a567070-7882-4e46-adc1-532f41855215 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:57.746720 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2a567070-7882-4e46-adc1-532f41855215 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:57.747425 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2a567070-7882-4e46-adc1-532f41855215 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:57.749106 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2a567070-7882-4e46-adc1-532f41855215 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:57.749547 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2a567070-7882-4e46-adc1-532f41855215 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:58.091254 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3e3f8eb7-0640-4627-8158-868bc0dd5633 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:58.104788 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3e3f8eb7-0640-4627-8158-868bc0dd5633 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f" status: 200 len: 1719 microversion: 2.1 time: 0.474808 Aug 31 16:01:58.105289 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 802/1602] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:57 2022] GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f => generated 1719 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:01:58.136540 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2a567070-7882-4e46-adc1-532f41855215 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:58.147671 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2a567070-7882-4e46-adc1-532f41855215 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:58.151328 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2a567070-7882-4e46-adc1-532f41855215 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:58.152562 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2a567070-7882-4e46-adc1-532f41855215 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00" status: 200 len: 1815 microversion: 2.25 time: 0.417665 Aug 31 16:01:58.153123 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 801/1603] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:01:57 2022] GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00 => generated 1815 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:01:58.353822 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8ba374f7-179f-41b2-9305-e1b11dbd3382 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:58.354436 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8ba374f7-179f-41b2-9305-e1b11dbd3382 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: 3f785545-d532-4487-b780-8a9be107a209] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:58.370669 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8ba374f7-179f-41b2-9305-e1b11dbd3382 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:58.370669 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8ba374f7-179f-41b2-9305-e1b11dbd3382 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:58.370669 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8ba374f7-179f-41b2-9305-e1b11dbd3382 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:58.371855 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8ba374f7-179f-41b2-9305-e1b11dbd3382 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:58.372516 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8ba374f7-179f-41b2-9305-e1b11dbd3382 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:58.373112 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8ba374f7-179f-41b2-9305-e1b11dbd3382 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:58.393093 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-16e79aa0-ef6a-43fa-aee9-e9b6c1176eb4 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:58.393093 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-16e79aa0-ef6a-43fa-aee9-e9b6c1176eb4 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6c7489e2-1ba0-4689-b2d7-e37886757266] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:58.399311 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-16e79aa0-ef6a-43fa-aee9-e9b6c1176eb4 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:58.411153 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-16e79aa0-ef6a-43fa-aee9-e9b6c1176eb4 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:58.411909 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-16e79aa0-ef6a-43fa-aee9-e9b6c1176eb4 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:58.412850 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-16e79aa0-ef6a-43fa-aee9-e9b6c1176eb4 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:58.413473 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-16e79aa0-ef6a-43fa-aee9-e9b6c1176eb4 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:58.414065 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-16e79aa0-ef6a-43fa-aee9-e9b6c1176eb4 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:58.726897 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8ba374f7-179f-41b2-9305-e1b11dbd3382 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ccd03a4aa84f93bc26b438e1468f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a9f3fcc4b445349e5c66ff712e8598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:58.744748 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8ba374f7-179f-41b2-9305-e1b11dbd3382 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/servers/3f785545-d532-4487-b780-8a9be107a209" status: 200 len: 1497 microversion: 2.1 time: 0.394758 Aug 31 16:01:58.745656 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 803/1604] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:58 2022] GET /compute/v2.1/servers/3f785545-d532-4487-b780-8a9be107a209 => generated 1497 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:58.751599 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0460186c-3467-4d05-9454-7d469730e029 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:58.760649 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0460186c-3467-4d05-9454-7d469730e029 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 44f1ab8f-3a6c-41f3-b9fd-7f8aa243bcfa] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:58.777213 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0460186c-3467-4d05-9454-7d469730e029 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:58.777454 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-16e79aa0-ef6a-43fa-aee9-e9b6c1176eb4 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:58.777902 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0460186c-3467-4d05-9454-7d469730e029 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:58.778340 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0460186c-3467-4d05-9454-7d469730e029 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:58.779365 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0460186c-3467-4d05-9454-7d469730e029 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:58.780103 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0460186c-3467-4d05-9454-7d469730e029 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:58.780810 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0460186c-3467-4d05-9454-7d469730e029 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:58.815877 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-16e79aa0-ef6a-43fa-aee9-e9b6c1176eb4 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266" status: 200 len: 1476 microversion: 2.1 time: 0.429320 Aug 31 16:01:58.831297 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 802/1605] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:58 2022] GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266 => generated 1476 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:01:58.838308 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6eaa864d-6930-41e3-95da-9a44f5568e6f tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:58.841436 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6eaa864d-6930-41e3-95da-9a44f5568e6f tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] [instance: fe57e6c6-2844-4ab5-ab13-c8d9ee25004d] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:58.863216 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6eaa864d-6930-41e3-95da-9a44f5568e6f tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:58.864050 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6eaa864d-6930-41e3-95da-9a44f5568e6f tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:58.866138 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6eaa864d-6930-41e3-95da-9a44f5568e6f tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:58.868901 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6eaa864d-6930-41e3-95da-9a44f5568e6f tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:58.873385 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6eaa864d-6930-41e3-95da-9a44f5568e6f tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:58.874577 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6eaa864d-6930-41e3-95da-9a44f5568e6f tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:59.139383 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-0460186c-3467-4d05-9454-7d469730e029 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:59.143684 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-6eaa864d-6930-41e3-95da-9a44f5568e6f tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bdd11cffedf44e6b2959058ab88b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e459294501d4024a9deb6eb078ca808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:59.149349 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0460186c-3467-4d05-9454-7d469730e029 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/44f1ab8f-3a6c-41f3-b9fd-7f8aa243bcfa" status: 200 len: 1317 microversion: 2.1 time: 0.402410 Aug 31 16:01:59.159432 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 804/1606] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:58 2022] GET /compute/v2.1/servers/44f1ab8f-3a6c-41f3-b9fd-7f8aa243bcfa => generated 1317 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:59.159432 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b48bcb75-fb5e-4515-8030-64cc71239c13 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:59.159432 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b48bcb75-fb5e-4515-8030-64cc71239c13 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: cc085aaa-21b2-48a6-b69c-de4e261dfe7f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:59.163334 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b48bcb75-fb5e-4515-8030-64cc71239c13 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:59.164053 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b48bcb75-fb5e-4515-8030-64cc71239c13 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:59.164672 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b48bcb75-fb5e-4515-8030-64cc71239c13 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:59.165553 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b48bcb75-fb5e-4515-8030-64cc71239c13 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:59.165974 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6eaa864d-6930-41e3-95da-9a44f5568e6f tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] 10.222.0.61 "GET /compute/v2.1/servers/fe57e6c6-2844-4ab5-ab13-c8d9ee25004d" status: 200 len: 1316 microversion: 2.1 time: 0.345432 Aug 31 16:01:59.166341 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b48bcb75-fb5e-4515-8030-64cc71239c13 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:59.166920 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b48bcb75-fb5e-4515-8030-64cc71239c13 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:59.167125 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 803/1607] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:58 2022] GET /compute/v2.1/servers/fe57e6c6-2844-4ab5-ab13-c8d9ee25004d => generated 1316 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:59.185559 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-fab85d5e-f3fc-4c4e-9e3c-538bf7ddf7c2 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:59.186179 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-fab85d5e-f3fc-4c4e-9e3c-538bf7ddf7c2 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 35b89015-3888-493a-b521-49a5e3769b00] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:59.193744 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fab85d5e-f3fc-4c4e-9e3c-538bf7ddf7c2 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:59.194310 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fab85d5e-f3fc-4c4e-9e3c-538bf7ddf7c2 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:59.194667 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fab85d5e-f3fc-4c4e-9e3c-538bf7ddf7c2 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:59.195388 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fab85d5e-f3fc-4c4e-9e3c-538bf7ddf7c2 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:59.195871 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fab85d5e-f3fc-4c4e-9e3c-538bf7ddf7c2 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:59.196303 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fab85d5e-f3fc-4c4e-9e3c-538bf7ddf7c2 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:59.526583 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b48bcb75-fb5e-4515-8030-64cc71239c13 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:59.538051 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b48bcb75-fb5e-4515-8030-64cc71239c13 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f" status: 200 len: 1719 microversion: 2.1 time: 0.386647 Aug 31 16:01:59.539214 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 805/1608] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:59 2022] GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f => generated 1719 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:59.556939 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-7a9c1d30-6fbb-4686-a3bc-fcf0dfb580ab req-5842d92f-13a3-4ce9-a3ac-5bd8cdbabe4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44f1ab8f-3a6c-41f3-b9fd-7f8aa243bcfa", "tag": "0a145e45-a983-4c65-8958-474ffc10da86"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:01:59.572196 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-7a9c1d30-6fbb-4686-a3bc-fcf0dfb580ab req-5842d92f-13a3-4ce9-a3ac-5bd8cdbabe4f service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:59.572725 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-7a9c1d30-6fbb-4686-a3bc-fcf0dfb580ab req-5842d92f-13a3-4ce9-a3ac-5bd8cdbabe4f service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:59.573176 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-7a9c1d30-6fbb-4686-a3bc-fcf0dfb580ab req-5842d92f-13a3-4ce9-a3ac-5bd8cdbabe4f service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:59.574195 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-fab85d5e-f3fc-4c4e-9e3c-538bf7ddf7c2 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:59.588799 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-fab85d5e-f3fc-4c4e-9e3c-538bf7ddf7c2 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:59.590948 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-fab85d5e-f3fc-4c4e-9e3c-538bf7ddf7c2 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:59.593108 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-fab85d5e-f3fc-4c4e-9e3c-538bf7ddf7c2 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00" status: 200 len: 1815 microversion: 2.25 time: 0.411331 Aug 31 16:01:59.607526 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-7a9c1d30-6fbb-4686-a3bc-fcf0dfb580ab req-5842d92f-13a3-4ce9-a3ac-5bd8cdbabe4f service nova] Creating event network-changed:0a145e45-a983-4c65-8958-474ffc10da86 for instance 44f1ab8f-3a6c-41f3-b9fd-7f8aa243bcfa on n-h2-850499-9 Aug 31 16:01:59.608257 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 804/1609] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:01:59 2022] GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00 => generated 1815 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:01:59.617403 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-7a9c1d30-6fbb-4686-a3bc-fcf0dfb580ab req-5842d92f-13a3-4ce9-a3ac-5bd8cdbabe4f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076600 Aug 31 16:01:59.623739 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 806/1610] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:01:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:01:59.774032 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-35d99284-9aa9-45d1-b7e4-4c3b4f59a23a tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:59.774881 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-35d99284-9aa9-45d1-b7e4-4c3b4f59a23a tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: 3f785545-d532-4487-b780-8a9be107a209] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:59.783745 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-35d99284-9aa9-45d1-b7e4-4c3b4f59a23a tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:59.784252 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-35d99284-9aa9-45d1-b7e4-4c3b4f59a23a tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:59.784808 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-35d99284-9aa9-45d1-b7e4-4c3b4f59a23a tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:59.785565 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-35d99284-9aa9-45d1-b7e4-4c3b4f59a23a tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:59.786023 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-35d99284-9aa9-45d1-b7e4-4c3b4f59a23a tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:59.786633 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-35d99284-9aa9-45d1-b7e4-4c3b4f59a23a tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:59.857563 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3a067b57-3f68-4754-b28f-b7ede65edbe3 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:59.858271 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3a067b57-3f68-4754-b28f-b7ede65edbe3 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6c7489e2-1ba0-4689-b2d7-e37886757266] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:59.866014 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3a067b57-3f68-4754-b28f-b7ede65edbe3 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:59.866501 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3a067b57-3f68-4754-b28f-b7ede65edbe3 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:59.866937 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3a067b57-3f68-4754-b28f-b7ede65edbe3 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:59.867802 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3a067b57-3f68-4754-b28f-b7ede65edbe3 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:59.868260 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3a067b57-3f68-4754-b28f-b7ede65edbe3 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:59.868815 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3a067b57-3f68-4754-b28f-b7ede65edbe3 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:00.066765 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-35d99284-9aa9-45d1-b7e4-4c3b4f59a23a tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ccd03a4aa84f93bc26b438e1468f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a9f3fcc4b445349e5c66ff712e8598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:00.081129 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-35d99284-9aa9-45d1-b7e4-4c3b4f59a23a tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/servers/3f785545-d532-4487-b780-8a9be107a209" status: 200 len: 1497 microversion: 2.1 time: 0.313514 Aug 31 16:02:00.081582 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 805/1611] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:59 2022] GET /compute/v2.1/servers/3f785545-d532-4487-b780-8a9be107a209 => generated 1497 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:02:00.088353 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-a5b427ab-92a1-498f-bc8b-77124fb77f00 req-2623c37a-cb57-47f4-aa24-f4d6a8becabb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe57e6c6-2844-4ab5-ab13-c8d9ee25004d", "name": "network-vif-plugged", "status": "completed", "tag": "511a0371-3789-48d6-9ab1-15c27ffc57f1"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:02:00.109661 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-a5b427ab-92a1-498f-bc8b-77124fb77f00 req-2623c37a-cb57-47f4-aa24-f4d6a8becabb service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:00.113175 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-a5b427ab-92a1-498f-bc8b-77124fb77f00 req-2623c37a-cb57-47f4-aa24-f4d6a8becabb service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:00.113847 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-a5b427ab-92a1-498f-bc8b-77124fb77f00 req-2623c37a-cb57-47f4-aa24-f4d6a8becabb service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:00.118832 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=100 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:02:00.129317 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3a067b57-3f68-4754-b28f-b7ede65edbe3 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:00.133979 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-a5b427ab-92a1-498f-bc8b-77124fb77f00 req-2623c37a-cb57-47f4-aa24-f4d6a8becabb service nova] Creating event network-vif-plugged:511a0371-3789-48d6-9ab1-15c27ffc57f1 for instance fe57e6c6-2844-4ab5-ab13-c8d9ee25004d on n-h1-850499-9 Aug 31 16:02:00.138374 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3a067b57-3f68-4754-b28f-b7ede65edbe3 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266" status: 200 len: 1476 microversion: 2.1 time: 0.286015 Aug 31 16:02:00.140083 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 807/1612] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:59 2022] GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266 => generated 1476 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:02:00.140234 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-a5b427ab-92a1-498f-bc8b-77124fb77f00 req-2623c37a-cb57-47f4-aa24-f4d6a8becabb service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056138 Aug 31 16:02:00.141536 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 806/1613] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:02:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:02:00.170379 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4a51853b-a4da-4d53-91b5-947b57899b35 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:00.171001 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4a51853b-a4da-4d53-91b5-947b57899b35 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 44f1ab8f-3a6c-41f3-b9fd-7f8aa243bcfa] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:00.178275 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4a51853b-a4da-4d53-91b5-947b57899b35 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:00.178777 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4a51853b-a4da-4d53-91b5-947b57899b35 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:00.179409 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4a51853b-a4da-4d53-91b5-947b57899b35 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:00.180167 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4a51853b-a4da-4d53-91b5-947b57899b35 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:00.180632 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4a51853b-a4da-4d53-91b5-947b57899b35 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:00.181070 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4a51853b-a4da-4d53-91b5-947b57899b35 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:00.191825 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-649ec635-bf83-4f61-88e5-f68171e2ae15 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:00.193159 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-649ec635-bf83-4f61-88e5-f68171e2ae15 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] [instance: fe57e6c6-2844-4ab5-ab13-c8d9ee25004d] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:00.200669 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-649ec635-bf83-4f61-88e5-f68171e2ae15 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:00.201537 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-649ec635-bf83-4f61-88e5-f68171e2ae15 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:00.202214 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-649ec635-bf83-4f61-88e5-f68171e2ae15 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:00.203044 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-649ec635-bf83-4f61-88e5-f68171e2ae15 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:00.204216 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-649ec635-bf83-4f61-88e5-f68171e2ae15 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:00.204900 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-649ec635-bf83-4f61-88e5-f68171e2ae15 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:00.499950 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-4a51853b-a4da-4d53-91b5-947b57899b35 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:00.504544 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-649ec635-bf83-4f61-88e5-f68171e2ae15 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bdd11cffedf44e6b2959058ab88b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e459294501d4024a9deb6eb078ca808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:00.510113 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4a51853b-a4da-4d53-91b5-947b57899b35 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/44f1ab8f-3a6c-41f3-b9fd-7f8aa243bcfa" status: 200 len: 1317 microversion: 2.1 time: 0.343538 Aug 31 16:02:00.511363 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 808/1614] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:00 2022] GET /compute/v2.1/servers/44f1ab8f-3a6c-41f3-b9fd-7f8aa243bcfa => generated 1317 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:00.513211 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-649ec635-bf83-4f61-88e5-f68171e2ae15 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] 10.222.0.61 "GET /compute/v2.1/servers/fe57e6c6-2844-4ab5-ab13-c8d9ee25004d" status: 200 len: 1316 microversion: 2.1 time: 0.327419 Aug 31 16:02:00.513782 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 807/1615] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:00 2022] GET /compute/v2.1/servers/fe57e6c6-2844-4ab5-ab13-c8d9ee25004d => generated 1316 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:00.561426 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0dfba904-6046-4bef-81dd-67dc0f864c59 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:00.562451 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0dfba904-6046-4bef-81dd-67dc0f864c59 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: cc085aaa-21b2-48a6-b69c-de4e261dfe7f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:00.569749 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0dfba904-6046-4bef-81dd-67dc0f864c59 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:00.570246 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0dfba904-6046-4bef-81dd-67dc0f864c59 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:00.570685 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0dfba904-6046-4bef-81dd-67dc0f864c59 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:00.571619 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0dfba904-6046-4bef-81dd-67dc0f864c59 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:00.572116 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0dfba904-6046-4bef-81dd-67dc0f864c59 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:00.572549 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0dfba904-6046-4bef-81dd-67dc0f864c59 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:00.620263 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c49e3850-a8c6-43d7-a619-9558776ac84c tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:00.621194 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c49e3850-a8c6-43d7-a619-9558776ac84c tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 35b89015-3888-493a-b521-49a5e3769b00] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:00.631612 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c49e3850-a8c6-43d7-a619-9558776ac84c tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:00.632317 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c49e3850-a8c6-43d7-a619-9558776ac84c tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:00.632950 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c49e3850-a8c6-43d7-a619-9558776ac84c tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:00.633846 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c49e3850-a8c6-43d7-a619-9558776ac84c tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:00.634467 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c49e3850-a8c6-43d7-a619-9558776ac84c tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:00.635166 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c49e3850-a8c6-43d7-a619-9558776ac84c tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:00.760773 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-0dfba904-6046-4bef-81dd-67dc0f864c59 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:00.770094 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0dfba904-6046-4bef-81dd-67dc0f864c59 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f" status: 200 len: 1719 microversion: 2.1 time: 0.213566 Aug 31 16:02:00.771005 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 809/1616] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:00 2022] GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f => generated 1719 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:00.818383 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c49e3850-a8c6-43d7-a619-9558776ac84c tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:00.827259 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c49e3850-a8c6-43d7-a619-9558776ac84c tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:00.829626 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c49e3850-a8c6-43d7-a619-9558776ac84c tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:00.830936 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c49e3850-a8c6-43d7-a619-9558776ac84c tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00" status: 200 len: 1815 microversion: 2.25 time: 0.214737 Aug 31 16:02:00.831490 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 808/1617] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:02:00 2022] GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00 => generated 1815 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:02:01.112404 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2da2041d-6c58-4fd6-8a81-c8b2c6313a5d tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:01.113109 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2da2041d-6c58-4fd6-8a81-c8b2c6313a5d tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: 3f785545-d532-4487-b780-8a9be107a209] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:01.120021 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2da2041d-6c58-4fd6-8a81-c8b2c6313a5d tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:01.120580 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2da2041d-6c58-4fd6-8a81-c8b2c6313a5d tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:01.121081 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2da2041d-6c58-4fd6-8a81-c8b2c6313a5d tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:01.121843 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2da2041d-6c58-4fd6-8a81-c8b2c6313a5d tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:01.122365 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2da2041d-6c58-4fd6-8a81-c8b2c6313a5d tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:01.122796 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2da2041d-6c58-4fd6-8a81-c8b2c6313a5d tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:01.162198 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-602e6ba4-a7b1-44f8-ac8d-63a24af7ac26 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:01.162816 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-602e6ba4-a7b1-44f8-ac8d-63a24af7ac26 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6c7489e2-1ba0-4689-b2d7-e37886757266] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:01.169451 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-602e6ba4-a7b1-44f8-ac8d-63a24af7ac26 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:01.170198 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-602e6ba4-a7b1-44f8-ac8d-63a24af7ac26 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:01.170638 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-602e6ba4-a7b1-44f8-ac8d-63a24af7ac26 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:01.171351 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-602e6ba4-a7b1-44f8-ac8d-63a24af7ac26 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:01.171830 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-602e6ba4-a7b1-44f8-ac8d-63a24af7ac26 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:01.173307 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-602e6ba4-a7b1-44f8-ac8d-63a24af7ac26 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:01.314796 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-2da2041d-6c58-4fd6-8a81-c8b2c6313a5d tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ccd03a4aa84f93bc26b438e1468f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a9f3fcc4b445349e5c66ff712e8598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:01.324337 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2da2041d-6c58-4fd6-8a81-c8b2c6313a5d tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/servers/3f785545-d532-4487-b780-8a9be107a209" status: 200 len: 1497 microversion: 2.1 time: 0.215838 Aug 31 16:02:01.324965 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 810/1618] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:01 2022] GET /compute/v2.1/servers/3f785545-d532-4487-b780-8a9be107a209 => generated 1497 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:01.346737 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-602e6ba4-a7b1-44f8-ac8d-63a24af7ac26 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:01.354488 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-602e6ba4-a7b1-44f8-ac8d-63a24af7ac26 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266" status: 200 len: 1476 microversion: 2.1 time: 0.196529 Aug 31 16:02:01.355060 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 809/1619] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:01 2022] GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266 => generated 1476 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:01.531572 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-20fc25de-ea6b-44ec-b640-e44e40384522 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:01.532929 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-20fc25de-ea6b-44ec-b640-e44e40384522 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 44f1ab8f-3a6c-41f3-b9fd-7f8aa243bcfa] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:01.534850 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ef58aab4-04a4-4f00-bc57-77bfbcbe0375 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:01.535471 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ef58aab4-04a4-4f00-bc57-77bfbcbe0375 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] [instance: fe57e6c6-2844-4ab5-ab13-c8d9ee25004d] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:01.539280 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-20fc25de-ea6b-44ec-b640-e44e40384522 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:01.539806 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-20fc25de-ea6b-44ec-b640-e44e40384522 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:01.540251 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-20fc25de-ea6b-44ec-b640-e44e40384522 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:01.540965 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-20fc25de-ea6b-44ec-b640-e44e40384522 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:01.541466 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-20fc25de-ea6b-44ec-b640-e44e40384522 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:01.541899 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-20fc25de-ea6b-44ec-b640-e44e40384522 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:01.542328 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ef58aab4-04a4-4f00-bc57-77bfbcbe0375 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:01.542829 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ef58aab4-04a4-4f00-bc57-77bfbcbe0375 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:01.543265 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ef58aab4-04a4-4f00-bc57-77bfbcbe0375 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:01.543995 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ef58aab4-04a4-4f00-bc57-77bfbcbe0375 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:01.544454 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ef58aab4-04a4-4f00-bc57-77bfbcbe0375 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:01.544888 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ef58aab4-04a4-4f00-bc57-77bfbcbe0375 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:01.753017 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-20fc25de-ea6b-44ec-b640-e44e40384522 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:01.757259 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ef58aab4-04a4-4f00-bc57-77bfbcbe0375 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bdd11cffedf44e6b2959058ab88b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e459294501d4024a9deb6eb078ca808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:01.761318 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-20fc25de-ea6b-44ec-b640-e44e40384522 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/44f1ab8f-3a6c-41f3-b9fd-7f8aa243bcfa" status: 200 len: 1317 microversion: 2.1 time: 0.233741 Aug 31 16:02:01.761891 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 811/1620] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:01 2022] GET /compute/v2.1/servers/44f1ab8f-3a6c-41f3-b9fd-7f8aa243bcfa => generated 1317 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:01.764990 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ef58aab4-04a4-4f00-bc57-77bfbcbe0375 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] 10.222.0.61 "GET /compute/v2.1/servers/fe57e6c6-2844-4ab5-ab13-c8d9ee25004d" status: 200 len: 1316 microversion: 2.1 time: 0.234859 Aug 31 16:02:01.765712 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 810/1621] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:01 2022] GET /compute/v2.1/servers/fe57e6c6-2844-4ab5-ab13-c8d9ee25004d => generated 1316 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:02:01.792667 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0c0bbbe4-c97f-44fe-8e2b-cd95e452db68 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:01.793381 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0c0bbbe4-c97f-44fe-8e2b-cd95e452db68 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: cc085aaa-21b2-48a6-b69c-de4e261dfe7f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:01.799511 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0c0bbbe4-c97f-44fe-8e2b-cd95e452db68 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:01.800016 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0c0bbbe4-c97f-44fe-8e2b-cd95e452db68 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:01.800458 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0c0bbbe4-c97f-44fe-8e2b-cd95e452db68 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:01.801149 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0c0bbbe4-c97f-44fe-8e2b-cd95e452db68 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:01.801607 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0c0bbbe4-c97f-44fe-8e2b-cd95e452db68 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:01.802036 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0c0bbbe4-c97f-44fe-8e2b-cd95e452db68 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:01.854298 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0d2b5105-9024-4463-af08-9850f475f07f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:01.854915 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0d2b5105-9024-4463-af08-9850f475f07f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 35b89015-3888-493a-b521-49a5e3769b00] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:01.861001 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0d2b5105-9024-4463-af08-9850f475f07f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:01.861484 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0d2b5105-9024-4463-af08-9850f475f07f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:01.861949 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0d2b5105-9024-4463-af08-9850f475f07f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:01.862646 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0d2b5105-9024-4463-af08-9850f475f07f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:01.863097 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0d2b5105-9024-4463-af08-9850f475f07f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:01.863577 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0d2b5105-9024-4463-af08-9850f475f07f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:01.975455 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-0c0bbbe4-c97f-44fe-8e2b-cd95e452db68 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:01.983968 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0c0bbbe4-c97f-44fe-8e2b-cd95e452db68 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f" status: 200 len: 1719 microversion: 2.1 time: 0.194955 Aug 31 16:02:01.985606 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 812/1622] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:01 2022] GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f => generated 1719 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:02:02.022828 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0d2b5105-9024-4463-af08-9850f475f07f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:02.031469 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0d2b5105-9024-4463-af08-9850f475f07f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:02.033881 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0d2b5105-9024-4463-af08-9850f475f07f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:02.034085 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0d2b5105-9024-4463-af08-9850f475f07f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00" status: 200 len: 1815 microversion: 2.25 time: 0.183761 Aug 31 16:02:02.034641 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 811/1623] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:02:01 2022] GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00 => generated 1815 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:02:02.346665 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-de7037da-37d1-4fd9-ab6c-697ddefd981d tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:02.347437 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-de7037da-37d1-4fd9-ab6c-697ddefd981d tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: 3f785545-d532-4487-b780-8a9be107a209] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:02.353940 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-de7037da-37d1-4fd9-ab6c-697ddefd981d tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:02.354525 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-de7037da-37d1-4fd9-ab6c-697ddefd981d tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:02.355034 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-de7037da-37d1-4fd9-ab6c-697ddefd981d tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:02.355834 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-de7037da-37d1-4fd9-ab6c-697ddefd981d tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:02.356376 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-de7037da-37d1-4fd9-ab6c-697ddefd981d tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:02.356870 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-de7037da-37d1-4fd9-ab6c-697ddefd981d tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:02.377663 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-951b2b11-05a7-4dde-ad90-ca9940985894 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:02.378582 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-951b2b11-05a7-4dde-ad90-ca9940985894 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6c7489e2-1ba0-4689-b2d7-e37886757266] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:02.384911 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-951b2b11-05a7-4dde-ad90-ca9940985894 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:02.385524 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-951b2b11-05a7-4dde-ad90-ca9940985894 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:02.385969 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-951b2b11-05a7-4dde-ad90-ca9940985894 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:02.386676 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-951b2b11-05a7-4dde-ad90-ca9940985894 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:02.387320 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-951b2b11-05a7-4dde-ad90-ca9940985894 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:02.388184 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-951b2b11-05a7-4dde-ad90-ca9940985894 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:02.471616 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=4 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:02:02.553032 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-de7037da-37d1-4fd9-ab6c-697ddefd981d tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ccd03a4aa84f93bc26b438e1468f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a9f3fcc4b445349e5c66ff712e8598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:02.562009 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-de7037da-37d1-4fd9-ab6c-697ddefd981d tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/servers/3f785545-d532-4487-b780-8a9be107a209" status: 200 len: 1497 microversion: 2.1 time: 0.219179 Aug 31 16:02:02.563231 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 813/1624] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:02 2022] GET /compute/v2.1/servers/3f785545-d532-4487-b780-8a9be107a209 => generated 1497 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:02.575870 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-951b2b11-05a7-4dde-ad90-ca9940985894 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:02.588121 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-951b2b11-05a7-4dde-ad90-ca9940985894 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266" status: 200 len: 1476 microversion: 2.1 time: 0.213781 Aug 31 16:02:02.588718 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 812/1625] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:02 2022] GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266 => generated 1476 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:02.782884 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2c606215-56a6-44ab-a3e6-26702db67d23 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:02.783771 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2c606215-56a6-44ab-a3e6-26702db67d23 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 44f1ab8f-3a6c-41f3-b9fd-7f8aa243bcfa] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:02.786849 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5f41ac7d-66ab-4da2-a98e-34e17cee12e8 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:02.787591 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5f41ac7d-66ab-4da2-a98e-34e17cee12e8 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] [instance: fe57e6c6-2844-4ab5-ab13-c8d9ee25004d] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:02.790792 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:02:02.791699 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2c606215-56a6-44ab-a3e6-26702db67d23 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:02.792287 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2c606215-56a6-44ab-a3e6-26702db67d23 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:02.792803 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2c606215-56a6-44ab-a3e6-26702db67d23 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:02.793721 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2c606215-56a6-44ab-a3e6-26702db67d23 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:02.794295 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2c606215-56a6-44ab-a3e6-26702db67d23 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:02.794782 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2c606215-56a6-44ab-a3e6-26702db67d23 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:02.794926 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5f41ac7d-66ab-4da2-a98e-34e17cee12e8 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:02.795508 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5f41ac7d-66ab-4da2-a98e-34e17cee12e8 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:02.796043 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5f41ac7d-66ab-4da2-a98e-34e17cee12e8 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:02.796818 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5f41ac7d-66ab-4da2-a98e-34e17cee12e8 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:02.798127 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5f41ac7d-66ab-4da2-a98e-34e17cee12e8 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:02.798762 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5f41ac7d-66ab-4da2-a98e-34e17cee12e8 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:03.003455 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-2c606215-56a6-44ab-a3e6-26702db67d23 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:03.008568 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5f41ac7d-66ab-4da2-a98e-34e17cee12e8 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bdd11cffedf44e6b2959058ab88b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e459294501d4024a9deb6eb078ca808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:03.012746 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2c606215-56a6-44ab-a3e6-26702db67d23 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/44f1ab8f-3a6c-41f3-b9fd-7f8aa243bcfa" status: 200 len: 1317 microversion: 2.1 time: 0.234248 Aug 31 16:02:03.013287 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 814/1626] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:02 2022] GET /compute/v2.1/servers/44f1ab8f-3a6c-41f3-b9fd-7f8aa243bcfa => generated 1317 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:03.018621 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7564be00-9f97-4106-93ee-c7be4e3390d2 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:03.020893 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7564be00-9f97-4106-93ee-c7be4e3390d2 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] [instance: 39a531e3-b13b-412f-a200-5141c32650be] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:03.023443 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5f41ac7d-66ab-4da2-a98e-34e17cee12e8 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] 10.222.0.61 "GET /compute/v2.1/servers/fe57e6c6-2844-4ab5-ab13-c8d9ee25004d" status: 200 len: 1505 microversion: 2.1 time: 0.240493 Aug 31 16:02:03.024870 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 813/1627] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:02 2022] GET /compute/v2.1/servers/fe57e6c6-2844-4ab5-ab13-c8d9ee25004d => generated 1505 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:02:03.026742 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7564be00-9f97-4106-93ee-c7be4e3390d2 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:03.027237 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7564be00-9f97-4106-93ee-c7be4e3390d2 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:03.027827 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7564be00-9f97-4106-93ee-c7be4e3390d2 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:03.028481 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7564be00-9f97-4106-93ee-c7be4e3390d2 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:03.028939 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7564be00-9f97-4106-93ee-c7be4e3390d2 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:03.029369 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7564be00-9f97-4106-93ee-c7be4e3390d2 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:03.030434 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d6cf016a-a1e6-4c26-b3f2-f76158b63523 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:03.031137 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d6cf016a-a1e6-4c26-b3f2-f76158b63523 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: cc085aaa-21b2-48a6-b69c-de4e261dfe7f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:03.040025 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d6cf016a-a1e6-4c26-b3f2-f76158b63523 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:03.040523 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d6cf016a-a1e6-4c26-b3f2-f76158b63523 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:03.040962 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d6cf016a-a1e6-4c26-b3f2-f76158b63523 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:03.041674 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d6cf016a-a1e6-4c26-b3f2-f76158b63523 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:03.042154 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d6cf016a-a1e6-4c26-b3f2-f76158b63523 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:03.042588 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d6cf016a-a1e6-4c26-b3f2-f76158b63523 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:03.057448 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=100 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:02:03.063321 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7564be00-9f97-4106-93ee-c7be4e3390d2 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] 10.222.0.61 "GET /compute/v2.1/servers/39a531e3-b13b-412f-a200-5141c32650be/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048882 Aug 31 16:02:03.064234 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 815/1628] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 16:02:03 2022] GET /compute/v2.1/servers/39a531e3-b13b-412f-a200-5141c32650be/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:02:03.068984 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-70065a33-2af2-48f0-b6ae-3a35214f4969 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:03.069902 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-70065a33-2af2-48f0-b6ae-3a35214f4969 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] [instance: fe57e6c6-2844-4ab5-ab13-c8d9ee25004d] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:03.075821 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-70065a33-2af2-48f0-b6ae-3a35214f4969 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:03.076315 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-70065a33-2af2-48f0-b6ae-3a35214f4969 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:03.076754 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-70065a33-2af2-48f0-b6ae-3a35214f4969 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:03.077535 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-70065a33-2af2-48f0-b6ae-3a35214f4969 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:03.077997 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-70065a33-2af2-48f0-b6ae-3a35214f4969 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:03.078946 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-70065a33-2af2-48f0-b6ae-3a35214f4969 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:03.104643 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-70065a33-2af2-48f0-b6ae-3a35214f4969 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] [instance: fe57e6c6-2844-4ab5-ab13-c8d9ee25004d] Going to try to terminate instance {{(pid=122256) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:02:03.180044 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d6cf016a-a1e6-4c26-b3f2-f76158b63523 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:03.185027 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-70065a33-2af2-48f0-b6ae-3a35214f4969 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] 10.222.0.61 "DELETE /compute/v2.1/servers/fe57e6c6-2844-4ab5-ab13-c8d9ee25004d" status: 204 len: 0 microversion: 2.1 time: 0.119231 Aug 31 16:02:03.185757 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 816/1629] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:02:03 2022] DELETE /compute/v2.1/servers/fe57e6c6-2844-4ab5-ab13-c8d9ee25004d => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:02:03.189165 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d6cf016a-a1e6-4c26-b3f2-f76158b63523 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f" status: 200 len: 1719 microversion: 2.1 time: 0.162994 Aug 31 16:02:03.189927 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 814/1630] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:03 2022] GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f => generated 1719 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:03.193309 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-dce48bc7-05c8-4627-9f34-f4816a31f7ab tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:03.194014 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-dce48bc7-05c8-4627-9f34-f4816a31f7ab tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 35b89015-3888-493a-b521-49a5e3769b00] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:03.194663 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b5fa5ecb-7b26-4370-b09c-4ff3f5e172d4 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:03.195152 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b5fa5ecb-7b26-4370-b09c-4ff3f5e172d4 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] [instance: 39a531e3-b13b-412f-a200-5141c32650be] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:03.200828 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dce48bc7-05c8-4627-9f34-f4816a31f7ab tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:03.200983 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b5fa5ecb-7b26-4370-b09c-4ff3f5e172d4 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:03.201315 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dce48bc7-05c8-4627-9f34-f4816a31f7ab tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:03.201460 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b5fa5ecb-7b26-4370-b09c-4ff3f5e172d4 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:03.201754 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dce48bc7-05c8-4627-9f34-f4816a31f7ab tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:03.202080 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b5fa5ecb-7b26-4370-b09c-4ff3f5e172d4 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:03.202454 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dce48bc7-05c8-4627-9f34-f4816a31f7ab tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:03.202778 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b5fa5ecb-7b26-4370-b09c-4ff3f5e172d4 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:03.202907 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dce48bc7-05c8-4627-9f34-f4816a31f7ab tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:03.203806 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b5fa5ecb-7b26-4370-b09c-4ff3f5e172d4 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:03.204236 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b5fa5ecb-7b26-4370-b09c-4ff3f5e172d4 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:03.204401 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dce48bc7-05c8-4627-9f34-f4816a31f7ab tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:03.319147 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=16 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:02:03.335164 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-b5fa5ecb-7b26-4370-b09c-4ff3f5e172d4 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lazy-loading 'services' on Instance uuid 39a531e3-b13b-412f-a200-5141c32650be {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:02:03.350848 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-dce48bc7-05c8-4627-9f34-f4816a31f7ab tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:03.361211 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-dce48bc7-05c8-4627-9f34-f4816a31f7ab tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:03.362742 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-dce48bc7-05c8-4627-9f34-f4816a31f7ab tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:03.363975 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-dce48bc7-05c8-4627-9f34-f4816a31f7ab tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00" status: 200 len: 1815 microversion: 2.25 time: 0.177029 Aug 31 16:02:03.364541 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 817/1631] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:02:03 2022] GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00 => generated 1815 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:02:03.368880 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ef6ade4b-0c7f-4fda-8834-79e6bc347ce6 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:03.369485 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ef6ade4b-0c7f-4fda-8834-79e6bc347ce6 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] [instance: fe57e6c6-2844-4ab5-ab13-c8d9ee25004d] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:03.376058 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ef6ade4b-0c7f-4fda-8834-79e6bc347ce6 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:03.376855 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ef6ade4b-0c7f-4fda-8834-79e6bc347ce6 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:03.377298 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ef6ade4b-0c7f-4fda-8834-79e6bc347ce6 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:03.378037 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ef6ade4b-0c7f-4fda-8834-79e6bc347ce6 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:03.378505 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ef6ade4b-0c7f-4fda-8834-79e6bc347ce6 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:03.378936 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ef6ade4b-0c7f-4fda-8834-79e6bc347ce6 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:03.451254 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b5fa5ecb-7b26-4370-b09c-4ff3f5e172d4 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] 10.222.0.61 "DELETE /compute/v2.1/servers/39a531e3-b13b-412f-a200-5141c32650be/os-volume_attachments/e8d74c70-ddc7-4480-8480-691025b1c2c8" status: 202 len: 0 microversion: 2.1 time: 0.259967 Aug 31 16:02:03.452309 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 815/1632] 10.222.0.61 () {58 vars in 1416 bytes} [Wed Aug 31 16:02:03 2022] DELETE /compute/v2.1/servers/39a531e3-b13b-412f-a200-5141c32650be/os-volume_attachments/e8d74c70-ddc7-4480-8480-691025b1c2c8 => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:02:03.515326 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ef6ade4b-0c7f-4fda-8834-79e6bc347ce6 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bdd11cffedf44e6b2959058ab88b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e459294501d4024a9deb6eb078ca808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:03.524115 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ef6ade4b-0c7f-4fda-8834-79e6bc347ce6 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] 10.222.0.61 "GET /compute/v2.1/servers/fe57e6c6-2844-4ab5-ab13-c8d9ee25004d" status: 200 len: 1511 microversion: 2.1 time: 0.158361 Aug 31 16:02:03.524620 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 818/1633] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:03 2022] GET /compute/v2.1/servers/fe57e6c6-2844-4ab5-ab13-c8d9ee25004d => generated 1511 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:03.586303 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-241e7e09-99d2-4516-a48d-6ae3d99e04ee tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:03.586993 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-241e7e09-99d2-4516-a48d-6ae3d99e04ee tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: 3f785545-d532-4487-b780-8a9be107a209] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:03.593586 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-241e7e09-99d2-4516-a48d-6ae3d99e04ee tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:03.594615 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-241e7e09-99d2-4516-a48d-6ae3d99e04ee tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:03.595073 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-241e7e09-99d2-4516-a48d-6ae3d99e04ee tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:03.595812 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-241e7e09-99d2-4516-a48d-6ae3d99e04ee tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:03.596265 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-241e7e09-99d2-4516-a48d-6ae3d99e04ee tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:03.596693 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-241e7e09-99d2-4516-a48d-6ae3d99e04ee tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:03.611044 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c8d03ed0-28bc-4e2d-a355-e516432d8a1e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:03.611697 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c8d03ed0-28bc-4e2d-a355-e516432d8a1e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6c7489e2-1ba0-4689-b2d7-e37886757266] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:03.617735 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c8d03ed0-28bc-4e2d-a355-e516432d8a1e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:03.618231 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c8d03ed0-28bc-4e2d-a355-e516432d8a1e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:03.618673 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c8d03ed0-28bc-4e2d-a355-e516432d8a1e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:03.619375 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c8d03ed0-28bc-4e2d-a355-e516432d8a1e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:03.619864 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c8d03ed0-28bc-4e2d-a355-e516432d8a1e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:03.620297 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c8d03ed0-28bc-4e2d-a355-e516432d8a1e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:03.800643 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c8d03ed0-28bc-4e2d-a355-e516432d8a1e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:03.803792 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-241e7e09-99d2-4516-a48d-6ae3d99e04ee tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ccd03a4aa84f93bc26b438e1468f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a9f3fcc4b445349e5c66ff712e8598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:03.808543 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c8d03ed0-28bc-4e2d-a355-e516432d8a1e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266" status: 200 len: 1476 microversion: 2.1 time: 0.202207 Aug 31 16:02:03.809206 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 819/1634] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:03 2022] GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266 => generated 1476 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:02:03.811425 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-241e7e09-99d2-4516-a48d-6ae3d99e04ee tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/servers/3f785545-d532-4487-b780-8a9be107a209" status: 200 len: 1474 microversion: 2.1 time: 0.230546 Aug 31 16:02:03.812022 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 816/1635] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:03 2022] GET /compute/v2.1/servers/3f785545-d532-4487-b780-8a9be107a209 => generated 1474 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:03.836719 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9e2d15ec-250f-4245-b064-df45ca669fb5 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-316279077"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:02:03.839792 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9e2d15ec-250f-4245-b064-df45ca669fb5 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: 3f785545-d532-4487-b780-8a9be107a209] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:03.848759 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9e2d15ec-250f-4245-b064-df45ca669fb5 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:03.849262 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9e2d15ec-250f-4245-b064-df45ca669fb5 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:03.849712 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9e2d15ec-250f-4245-b064-df45ca669fb5 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:03.850429 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9e2d15ec-250f-4245-b064-df45ca669fb5 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:03.850901 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9e2d15ec-250f-4245-b064-df45ca669fb5 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:03.851335 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9e2d15ec-250f-4245-b064-df45ca669fb5 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:04.036629 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f0e3775d-7cac-4eaf-8dd9-55f479498897 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:04.037161 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f0e3775d-7cac-4eaf-8dd9-55f479498897 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 44f1ab8f-3a6c-41f3-b9fd-7f8aa243bcfa] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:04.043414 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f0e3775d-7cac-4eaf-8dd9-55f479498897 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:04.043839 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f0e3775d-7cac-4eaf-8dd9-55f479498897 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:04.044258 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f0e3775d-7cac-4eaf-8dd9-55f479498897 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:04.044952 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f0e3775d-7cac-4eaf-8dd9-55f479498897 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:04.045402 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f0e3775d-7cac-4eaf-8dd9-55f479498897 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:04.045820 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f0e3775d-7cac-4eaf-8dd9-55f479498897 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:04.048741 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9e2d15ec-250f-4245-b064-df45ca669fb5 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "POST /compute/v2.1/servers/3f785545-d532-4487-b780-8a9be107a209/action" status: 202 len: 0 microversion: 2.1 time: 0.218789 Aug 31 16:02:04.049545 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 820/1636] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:02:03 2022] POST /compute/v2.1/servers/3f785545-d532-4487-b780-8a9be107a209/action => generated 0 bytes in 222 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 31 16:02:04.060485 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-72a43f01-1a0d-442d-96a4-291a7f93d2e6 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '.version_select at 0x7f5ae98eb0d0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:04.113067 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-72a43f01-1a0d-442d-96a4-291a7f93d2e6 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/images/34d69a63-c14a-4d91-9d9f-38bc5d717b66" status: 200 len: 1413 microversion: 2.1 time: 0.056736 Aug 31 16:02:04.113948 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 821/1637] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:02:04 2022] GET /compute/v2.1/images/34d69a63-c14a-4d91-9d9f-38bc5d717b66 => generated 1413 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:02:04.197278 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f0e3775d-7cac-4eaf-8dd9-55f479498897 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:04.205782 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f0e3775d-7cac-4eaf-8dd9-55f479498897 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/44f1ab8f-3a6c-41f3-b9fd-7f8aa243bcfa" status: 200 len: 1317 microversion: 2.1 time: 0.175763 Aug 31 16:02:04.206372 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 817/1638] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:04 2022] GET /compute/v2.1/servers/44f1ab8f-3a6c-41f3-b9fd-7f8aa243bcfa => generated 1317 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:02:04.210916 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e00a4d15-3f15-4279-9433-e9a6c484cfc1 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:04.211676 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e00a4d15-3f15-4279-9433-e9a6c484cfc1 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: cc085aaa-21b2-48a6-b69c-de4e261dfe7f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:04.214875 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:02:04.219464 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e00a4d15-3f15-4279-9433-e9a6c484cfc1 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:04.220002 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e00a4d15-3f15-4279-9433-e9a6c484cfc1 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:04.220445 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e00a4d15-3f15-4279-9433-e9a6c484cfc1 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:04.221162 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e00a4d15-3f15-4279-9433-e9a6c484cfc1 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:04.221624 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e00a4d15-3f15-4279-9433-e9a6c484cfc1 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:04.222088 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e00a4d15-3f15-4279-9433-e9a6c484cfc1 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:04.362670 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e00a4d15-3f15-4279-9433-e9a6c484cfc1 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:04.371114 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e00a4d15-3f15-4279-9433-e9a6c484cfc1 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f" status: 200 len: 1719 microversion: 2.1 time: 0.164473 Aug 31 16:02:04.371862 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 822/1639] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:04 2022] GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f => generated 1719 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:02:04.389822 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-943ea3b8-f572-4a29-8a1f-8e28f212adac tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:04.391456 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-943ea3b8-f572-4a29-8a1f-8e28f212adac tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 35b89015-3888-493a-b521-49a5e3769b00] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:04.401011 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-943ea3b8-f572-4a29-8a1f-8e28f212adac tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:04.401541 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-943ea3b8-f572-4a29-8a1f-8e28f212adac tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:04.401987 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-943ea3b8-f572-4a29-8a1f-8e28f212adac tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:04.402698 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-943ea3b8-f572-4a29-8a1f-8e28f212adac tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:04.403338 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-943ea3b8-f572-4a29-8a1f-8e28f212adac tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:04.403864 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-943ea3b8-f572-4a29-8a1f-8e28f212adac tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:04.545401 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-15d169ca-cc33-4c51-a0fe-aad61f9b58ea tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:04.546088 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-15d169ca-cc33-4c51-a0fe-aad61f9b58ea tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] [instance: fe57e6c6-2844-4ab5-ab13-c8d9ee25004d] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:04.553297 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-15d169ca-cc33-4c51-a0fe-aad61f9b58ea tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:04.553928 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-15d169ca-cc33-4c51-a0fe-aad61f9b58ea tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:04.554684 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-15d169ca-cc33-4c51-a0fe-aad61f9b58ea tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:04.555561 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-15d169ca-cc33-4c51-a0fe-aad61f9b58ea tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:04.556296 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-15d169ca-cc33-4c51-a0fe-aad61f9b58ea tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:04.556741 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-15d169ca-cc33-4c51-a0fe-aad61f9b58ea tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:04.695145 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-943ea3b8-f572-4a29-8a1f-8e28f212adac tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:04.705801 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-943ea3b8-f572-4a29-8a1f-8e28f212adac tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:04.707262 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-943ea3b8-f572-4a29-8a1f-8e28f212adac tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:04.709609 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-943ea3b8-f572-4a29-8a1f-8e28f212adac tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00" status: 200 len: 1815 microversion: 2.25 time: 0.325531 Aug 31 16:02:04.710200 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 818/1640] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:02:04 2022] GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00 => generated 1815 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:02:04.793844 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-15d169ca-cc33-4c51-a0fe-aad61f9b58ea tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bdd11cffedf44e6b2959058ab88b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e459294501d4024a9deb6eb078ca808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:04.801922 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-15d169ca-cc33-4c51-a0fe-aad61f9b58ea tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] 10.222.0.61 "GET /compute/v2.1/servers/fe57e6c6-2844-4ab5-ab13-c8d9ee25004d" status: 200 len: 1511 microversion: 2.1 time: 0.260356 Aug 31 16:02:04.802505 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 823/1641] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:04 2022] GET /compute/v2.1/servers/fe57e6c6-2844-4ab5-ab13-c8d9ee25004d => generated 1511 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:02:04.832431 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-de1e817f-0cc4-40a3-9c61-843791ab3999 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:04.833056 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-de1e817f-0cc4-40a3-9c61-843791ab3999 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6c7489e2-1ba0-4689-b2d7-e37886757266] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:04.841387 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-de1e817f-0cc4-40a3-9c61-843791ab3999 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:04.841893 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-de1e817f-0cc4-40a3-9c61-843791ab3999 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:04.842336 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-de1e817f-0cc4-40a3-9c61-843791ab3999 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:04.843048 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-de1e817f-0cc4-40a3-9c61-843791ab3999 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:04.843529 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-de1e817f-0cc4-40a3-9c61-843791ab3999 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:04.845611 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-de1e817f-0cc4-40a3-9c61-843791ab3999 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:05.129096 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-bba14063-4b68-41d0-8b8a-bbb1118e132e tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '.version_select at 0x7f5ae92e8790>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:05.176504 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-bba14063-4b68-41d0-8b8a-bbb1118e132e tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/images/34d69a63-c14a-4d91-9d9f-38bc5d717b66" status: 200 len: 1413 microversion: 2.1 time: 0.052239 Aug 31 16:02:05.177236 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 824/1642] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:02:05 2022] GET /compute/v2.1/images/34d69a63-c14a-4d91-9d9f-38bc5d717b66 => generated 1413 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:05.226261 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4b264211-acab-4c0c-a8c1-38f726e3031e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:05.226883 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4b264211-acab-4c0c-a8c1-38f726e3031e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 44f1ab8f-3a6c-41f3-b9fd-7f8aa243bcfa] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:05.233111 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4b264211-acab-4c0c-a8c1-38f726e3031e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:05.233605 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4b264211-acab-4c0c-a8c1-38f726e3031e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:05.234057 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4b264211-acab-4c0c-a8c1-38f726e3031e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:05.236001 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4b264211-acab-4c0c-a8c1-38f726e3031e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:05.236476 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4b264211-acab-4c0c-a8c1-38f726e3031e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:05.236915 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4b264211-acab-4c0c-a8c1-38f726e3031e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:05.472624 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-de1e817f-0cc4-40a3-9c61-843791ab3999 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:05.480897 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-de1e817f-0cc4-40a3-9c61-843791ab3999 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266" status: 200 len: 1476 microversion: 2.1 time: 0.654397 Aug 31 16:02:05.482244 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 819/1643] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:04 2022] GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266 => generated 1476 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:05.488367 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5078c964-7b22-46d1-a760-02e2dea37e34 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:05.489219 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5078c964-7b22-46d1-a760-02e2dea37e34 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: cc085aaa-21b2-48a6-b69c-de4e261dfe7f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:05.495244 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5078c964-7b22-46d1-a760-02e2dea37e34 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:05.495777 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5078c964-7b22-46d1-a760-02e2dea37e34 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:05.496219 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5078c964-7b22-46d1-a760-02e2dea37e34 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:05.496963 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5078c964-7b22-46d1-a760-02e2dea37e34 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:05.497431 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5078c964-7b22-46d1-a760-02e2dea37e34 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:05.497859 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5078c964-7b22-46d1-a760-02e2dea37e34 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:05.500148 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-4b264211-acab-4c0c-a8c1-38f726e3031e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:05.511444 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4b264211-acab-4c0c-a8c1-38f726e3031e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/44f1ab8f-3a6c-41f3-b9fd-7f8aa243bcfa" status: 200 len: 1317 microversion: 2.1 time: 0.288999 Aug 31 16:02:05.512245 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 825/1644] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:05 2022] GET /compute/v2.1/servers/44f1ab8f-3a6c-41f3-b9fd-7f8aa243bcfa => generated 1317 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:02:05.733583 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1c68fe43-9de0-45c4-b347-5abca5191029 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:05.734232 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1c68fe43-9de0-45c4-b347-5abca5191029 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 35b89015-3888-493a-b521-49a5e3769b00] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:05.742275 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1c68fe43-9de0-45c4-b347-5abca5191029 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:05.742783 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1c68fe43-9de0-45c4-b347-5abca5191029 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:05.743231 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1c68fe43-9de0-45c4-b347-5abca5191029 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:05.743989 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1c68fe43-9de0-45c4-b347-5abca5191029 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:05.744456 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1c68fe43-9de0-45c4-b347-5abca5191029 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:05.744915 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1c68fe43-9de0-45c4-b347-5abca5191029 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:05.759741 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5078c964-7b22-46d1-a760-02e2dea37e34 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:05.769421 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5078c964-7b22-46d1-a760-02e2dea37e34 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f" status: 200 len: 1719 microversion: 2.1 time: 0.285931 Aug 31 16:02:05.770422 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 820/1645] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:05 2022] GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f => generated 1719 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:05.823818 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e51288db-b528-4c8d-b211-7fc665ff5020 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:05.824555 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e51288db-b528-4c8d-b211-7fc665ff5020 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] [instance: fe57e6c6-2844-4ab5-ab13-c8d9ee25004d] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:05.831045 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e51288db-b528-4c8d-b211-7fc665ff5020 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:05.831639 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e51288db-b528-4c8d-b211-7fc665ff5020 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:05.832141 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e51288db-b528-4c8d-b211-7fc665ff5020 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:05.832959 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e51288db-b528-4c8d-b211-7fc665ff5020 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:05.833504 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e51288db-b528-4c8d-b211-7fc665ff5020 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:05.833929 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e51288db-b528-4c8d-b211-7fc665ff5020 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:06.006056 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1c68fe43-9de0-45c4-b347-5abca5191029 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:06.015417 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1c68fe43-9de0-45c4-b347-5abca5191029 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:06.017666 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1c68fe43-9de0-45c4-b347-5abca5191029 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:06.018928 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1c68fe43-9de0-45c4-b347-5abca5191029 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00" status: 200 len: 1815 microversion: 2.25 time: 0.289430 Aug 31 16:02:06.019598 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 826/1646] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:02:05 2022] GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00 => generated 1815 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:02:06.100912 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e51288db-b528-4c8d-b211-7fc665ff5020 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bdd11cffedf44e6b2959058ab88b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e459294501d4024a9deb6eb078ca808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:06.108637 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e51288db-b528-4c8d-b211-7fc665ff5020 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] 10.222.0.61 "GET /compute/v2.1/servers/fe57e6c6-2844-4ab5-ab13-c8d9ee25004d" status: 200 len: 1511 microversion: 2.1 time: 0.288691 Aug 31 16:02:06.109217 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 821/1647] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:05 2022] GET /compute/v2.1/servers/fe57e6c6-2844-4ab5-ab13-c8d9ee25004d => generated 1511 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:02:06.193385 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-bd3bce57-0af3-4f58-b891-f95fd1a8bfe6 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '.version_select at 0x7f5ae8fb6670>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:06.240374 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-bd3bce57-0af3-4f58-b891-f95fd1a8bfe6 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/images/34d69a63-c14a-4d91-9d9f-38bc5d717b66" status: 200 len: 1413 microversion: 2.1 time: 0.051275 Aug 31 16:02:06.240959 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 827/1648] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:02:06 2022] GET /compute/v2.1/images/34d69a63-c14a-4d91-9d9f-38bc5d717b66 => generated 1413 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:06.510600 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9f6e65f3-27bd-4e96-9578-a5a4e92cc448 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:06.511219 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9f6e65f3-27bd-4e96-9578-a5a4e92cc448 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6c7489e2-1ba0-4689-b2d7-e37886757266] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:06.519037 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9f6e65f3-27bd-4e96-9578-a5a4e92cc448 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:06.519562 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9f6e65f3-27bd-4e96-9578-a5a4e92cc448 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:06.520074 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9f6e65f3-27bd-4e96-9578-a5a4e92cc448 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:06.520910 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9f6e65f3-27bd-4e96-9578-a5a4e92cc448 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:06.521459 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9f6e65f3-27bd-4e96-9578-a5a4e92cc448 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:06.522022 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9f6e65f3-27bd-4e96-9578-a5a4e92cc448 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:06.534304 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-27f69dea-65f0-4422-8ea5-18ecf64254d0 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:06.534985 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-27f69dea-65f0-4422-8ea5-18ecf64254d0 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 44f1ab8f-3a6c-41f3-b9fd-7f8aa243bcfa] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:06.543800 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-27f69dea-65f0-4422-8ea5-18ecf64254d0 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:06.544192 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-27f69dea-65f0-4422-8ea5-18ecf64254d0 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:06.544638 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-27f69dea-65f0-4422-8ea5-18ecf64254d0 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:06.545352 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-27f69dea-65f0-4422-8ea5-18ecf64254d0 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:06.545811 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-27f69dea-65f0-4422-8ea5-18ecf64254d0 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:06.546238 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-27f69dea-65f0-4422-8ea5-18ecf64254d0 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:06.829593 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-27f69dea-65f0-4422-8ea5-18ecf64254d0 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:06.837646 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-27f69dea-65f0-4422-8ea5-18ecf64254d0 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/44f1ab8f-3a6c-41f3-b9fd-7f8aa243bcfa" status: 200 len: 1317 microversion: 2.1 time: 0.308714 Aug 31 16:02:06.838246 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 828/1649] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:06 2022] GET /compute/v2.1/servers/44f1ab8f-3a6c-41f3-b9fd-7f8aa243bcfa => generated 1317 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:06.842894 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6631300f-7ca2-4b67-8aa7-ba63223435d1 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:06.843523 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6631300f-7ca2-4b67-8aa7-ba63223435d1 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: cc085aaa-21b2-48a6-b69c-de4e261dfe7f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:06.850147 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6631300f-7ca2-4b67-8aa7-ba63223435d1 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:06.850643 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6631300f-7ca2-4b67-8aa7-ba63223435d1 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:06.851082 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6631300f-7ca2-4b67-8aa7-ba63223435d1 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:06.851899 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6631300f-7ca2-4b67-8aa7-ba63223435d1 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:06.852363 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6631300f-7ca2-4b67-8aa7-ba63223435d1 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:06.852796 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6631300f-7ca2-4b67-8aa7-ba63223435d1 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:06.868778 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9f6e65f3-27bd-4e96-9578-a5a4e92cc448 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:06.872958 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:02:06.878701 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9f6e65f3-27bd-4e96-9578-a5a4e92cc448 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266" status: 200 len: 1476 microversion: 2.1 time: 0.372271 Aug 31 16:02:06.888236 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 822/1650] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:06 2022] GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266 => generated 1476 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:07.045047 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4dc47389-d62e-4723-8514-9e4c378f3934 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:07.045977 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4dc47389-d62e-4723-8514-9e4c378f3934 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 35b89015-3888-493a-b521-49a5e3769b00] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:07.060850 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4dc47389-d62e-4723-8514-9e4c378f3934 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:07.062978 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4dc47389-d62e-4723-8514-9e4c378f3934 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:07.065286 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4dc47389-d62e-4723-8514-9e4c378f3934 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:07.066851 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4dc47389-d62e-4723-8514-9e4c378f3934 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:07.067714 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4dc47389-d62e-4723-8514-9e4c378f3934 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:07.068335 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4dc47389-d62e-4723-8514-9e4c378f3934 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:07.129050 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-6631300f-7ca2-4b67-8aa7-ba63223435d1 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:07.143212 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6631300f-7ca2-4b67-8aa7-ba63223435d1 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f" status: 200 len: 1709 microversion: 2.1 time: 0.303730 Aug 31 16:02:07.147551 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 829/1651] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:06 2022] GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f => generated 1709 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:07.149648 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0578f380-6649-45b0-ad72-1d19d690d048 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:07.150256 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0578f380-6649-45b0-ad72-1d19d690d048 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] [instance: fe57e6c6-2844-4ab5-ab13-c8d9ee25004d] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:07.158622 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0578f380-6649-45b0-ad72-1d19d690d048 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:07.159116 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0578f380-6649-45b0-ad72-1d19d690d048 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:07.159574 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0578f380-6649-45b0-ad72-1d19d690d048 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:07.160290 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0578f380-6649-45b0-ad72-1d19d690d048 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:07.160745 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0578f380-6649-45b0-ad72-1d19d690d048 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:07.162263 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0578f380-6649-45b0-ad72-1d19d690d048 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:07.393711 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-4dc47389-d62e-4723-8514-9e4c378f3934 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:07.410387 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-4dc47389-d62e-4723-8514-9e4c378f3934 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:07.411939 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-4dc47389-d62e-4723-8514-9e4c378f3934 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:07.413595 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4dc47389-d62e-4723-8514-9e4c378f3934 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00" status: 200 len: 1815 microversion: 2.25 time: 0.373697 Aug 31 16:02:07.414821 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 823/1652] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:02:07 2022] GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00 => generated 1815 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:02:07.419870 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-cfe51cf9-c60f-473b-8e7c-79df2475d7b0 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Calling method '.version_select at 0x7f5ae8cb2e50>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:07.424385 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cfe51cf9-c60f-473b-8e7c-79df2475d7b0 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:07.425072 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cfe51cf9-c60f-473b-8e7c-79df2475d7b0 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:07.425699 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cfe51cf9-c60f-473b-8e7c-79df2475d7b0 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:07.437361 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-cfe51cf9-c60f-473b-8e7c-79df2475d7b0 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] 10.222.0.61 "GET /compute/v2.1/os-migrations" status: 200 len: 2711 microversion: 2.1 time: 0.021193 Aug 31 16:02:07.438867 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 824/1653] 10.222.0.61 () {58 vars in 1143 bytes} [Wed Aug 31 16:02:07 2022] GET /compute/v2.1/os-migrations => generated 2711 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:07.446544 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-83c02978-bac0-469a-a311-1b1f0460e579 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '.version_select at 0x7f5aed1e6700>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:07.461760 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-0578f380-6649-45b0-ad72-1d19d690d048 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bdd11cffedf44e6b2959058ab88b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e459294501d4024a9deb6eb078ca808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:07.472459 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0578f380-6649-45b0-ad72-1d19d690d048 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] 10.222.0.61 "GET /compute/v2.1/servers/fe57e6c6-2844-4ab5-ab13-c8d9ee25004d" status: 200 len: 1511 microversion: 2.1 time: 0.326864 Aug 31 16:02:07.479702 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 830/1654] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:07 2022] GET /compute/v2.1/servers/fe57e6c6-2844-4ab5-ab13-c8d9ee25004d => generated 1511 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:07.486156 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-8315c4e7-050c-46e9-afe5-795e4f908f71 req-f87d93e1-0863-4ce5-bd9c-34d439f03586 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe57e6c6-2844-4ab5-ab13-c8d9ee25004d", "name": "network-vif-deleted", "tag": "511a0371-3789-48d6-9ab1-15c27ffc57f1"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:02:07.520520 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-83c02978-bac0-469a-a311-1b1f0460e579 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/images/34d69a63-c14a-4d91-9d9f-38bc5d717b66" status: 200 len: 1413 microversion: 2.1 time: 0.077663 Aug 31 16:02:07.521100 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 825/1655] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:02:07 2022] GET /compute/v2.1/images/34d69a63-c14a-4d91-9d9f-38bc5d717b66 => generated 1413 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:07.527418 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-8315c4e7-050c-46e9-afe5-795e4f908f71 req-f87d93e1-0863-4ce5-bd9c-34d439f03586 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:07.528319 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-8315c4e7-050c-46e9-afe5-795e4f908f71 req-f87d93e1-0863-4ce5-bd9c-34d439f03586 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:07.529279 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-8315c4e7-050c-46e9-afe5-795e4f908f71 req-f87d93e1-0863-4ce5-bd9c-34d439f03586 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:07.532791 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5a32bebf-42b0-427b-87c8-fd9f7e507102 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:07.533659 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5a32bebf-42b0-427b-87c8-fd9f7e507102 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] [instance: cc085aaa-21b2-48a6-b69c-de4e261dfe7f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:07.547435 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5a32bebf-42b0-427b-87c8-fd9f7e507102 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:07.548617 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5a32bebf-42b0-427b-87c8-fd9f7e507102 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:07.550579 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5a32bebf-42b0-427b-87c8-fd9f7e507102 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:07.552168 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5a32bebf-42b0-427b-87c8-fd9f7e507102 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:07.553060 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5a32bebf-42b0-427b-87c8-fd9f7e507102 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:07.554031 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5a32bebf-42b0-427b-87c8-fd9f7e507102 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:07.571886 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-8315c4e7-050c-46e9-afe5-795e4f908f71 req-f87d93e1-0863-4ce5-bd9c-34d439f03586 service nova] Creating event network-vif-deleted:511a0371-3789-48d6-9ab1-15c27ffc57f1 for instance fe57e6c6-2844-4ab5-ab13-c8d9ee25004d on n-h1-850499-9 Aug 31 16:02:07.588767 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-8315c4e7-050c-46e9-afe5-795e4f908f71 req-f87d93e1-0863-4ce5-bd9c-34d439f03586 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111154 Aug 31 16:02:07.589911 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 831/1656] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:02:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:02:07.732809 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-26701b35-c46d-424f-8cdf-b68d13a4455f req-98f46edf-196b-4959-8145-792ca9d1150a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35b89015-3888-493a-b521-49a5e3769b00", "name": "network-vif-unplugged", "status": "completed", "tag": "fdce032a-0b32-49de-acd3-1c9df93ae828"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:02:07.752558 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-26701b35-c46d-424f-8cdf-b68d13a4455f req-98f46edf-196b-4959-8145-792ca9d1150a service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:07.753914 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-26701b35-c46d-424f-8cdf-b68d13a4455f req-98f46edf-196b-4959-8145-792ca9d1150a service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:07.754531 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-26701b35-c46d-424f-8cdf-b68d13a4455f req-98f46edf-196b-4959-8145-792ca9d1150a service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:07.769808 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-26701b35-c46d-424f-8cdf-b68d13a4455f req-98f46edf-196b-4959-8145-792ca9d1150a service nova] Creating event network-vif-unplugged:fdce032a-0b32-49de-acd3-1c9df93ae828 for instance 35b89015-3888-493a-b521-49a5e3769b00 on n-h2-850499-9 Aug 31 16:02:07.774812 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-26701b35-c46d-424f-8cdf-b68d13a4455f req-98f46edf-196b-4959-8145-792ca9d1150a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046482 Aug 31 16:02:07.775419 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 832/1657] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:02:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:02:07.867313 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-14224a89-3610-48b4-81dd-0d33dc58ed28 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:07.869097 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-14224a89-3610-48b4-81dd-0d33dc58ed28 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 44f1ab8f-3a6c-41f3-b9fd-7f8aa243bcfa] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:07.883293 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-14224a89-3610-48b4-81dd-0d33dc58ed28 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:07.893787 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-14224a89-3610-48b4-81dd-0d33dc58ed28 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:07.894248 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-14224a89-3610-48b4-81dd-0d33dc58ed28 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:07.901231 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-14224a89-3610-48b4-81dd-0d33dc58ed28 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:07.902163 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-14224a89-3610-48b4-81dd-0d33dc58ed28 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:07.908672 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-14224a89-3610-48b4-81dd-0d33dc58ed28 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:08.057412 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5a32bebf-42b0-427b-87c8-fd9f7e507102 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f" status: 200 len: 1860 microversion: 2.1 time: 0.535115 Aug 31 16:02:08.065934 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 826/1658] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:07 2022] GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f => generated 1860 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:08.077506 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e4016456-5952-4f5b-99a3-badfc1541198 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:08.078617 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e4016456-5952-4f5b-99a3-badfc1541198 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6c7489e2-1ba0-4689-b2d7-e37886757266] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:08.098270 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e4016456-5952-4f5b-99a3-badfc1541198 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:08.100468 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e4016456-5952-4f5b-99a3-badfc1541198 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:08.101298 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e4016456-5952-4f5b-99a3-badfc1541198 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:08.103194 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e4016456-5952-4f5b-99a3-badfc1541198 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:08.103993 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e4016456-5952-4f5b-99a3-badfc1541198 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:08.105537 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e4016456-5952-4f5b-99a3-badfc1541198 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:08.301307 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-14224a89-3610-48b4-81dd-0d33dc58ed28 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:08.304803 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:02:08.311832 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-14224a89-3610-48b4-81dd-0d33dc58ed28 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/44f1ab8f-3a6c-41f3-b9fd-7f8aa243bcfa" status: 200 len: 1317 microversion: 2.1 time: 0.454114 Aug 31 16:02:08.314232 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 833/1659] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:07 2022] GET /compute/v2.1/servers/44f1ab8f-3a6c-41f3-b9fd-7f8aa243bcfa => generated 1317 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:08.330612 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-30a11a92-bbd8-489b-a4aa-4c1edec985d0 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:08.331526 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-30a11a92-bbd8-489b-a4aa-4c1edec985d0 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] [instance: cc085aaa-21b2-48a6-b69c-de4e261dfe7f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:08.340594 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-30a11a92-bbd8-489b-a4aa-4c1edec985d0 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:08.342959 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-30a11a92-bbd8-489b-a4aa-4c1edec985d0 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:08.344328 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-30a11a92-bbd8-489b-a4aa-4c1edec985d0 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:08.345466 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-30a11a92-bbd8-489b-a4aa-4c1edec985d0 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:08.346153 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-30a11a92-bbd8-489b-a4aa-4c1edec985d0 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:08.346785 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-30a11a92-bbd8-489b-a4aa-4c1edec985d0 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:08.412210 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e4016456-5952-4f5b-99a3-badfc1541198 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:08.421564 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e4016456-5952-4f5b-99a3-badfc1541198 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266" status: 200 len: 1476 microversion: 2.1 time: 0.354256 Aug 31 16:02:08.423212 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 827/1660] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:08 2022] GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266 => generated 1476 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:08.440685 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-579cdfc8-ba70-4c26-8c1f-b90763235eb0 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:08.442206 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-579cdfc8-ba70-4c26-8c1f-b90763235eb0 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 35b89015-3888-493a-b521-49a5e3769b00] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:08.460079 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-579cdfc8-ba70-4c26-8c1f-b90763235eb0 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:08.460587 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-579cdfc8-ba70-4c26-8c1f-b90763235eb0 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:08.461031 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-579cdfc8-ba70-4c26-8c1f-b90763235eb0 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:08.461742 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-579cdfc8-ba70-4c26-8c1f-b90763235eb0 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:08.467984 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-579cdfc8-ba70-4c26-8c1f-b90763235eb0 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:08.469139 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-579cdfc8-ba70-4c26-8c1f-b90763235eb0 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:08.581968 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-30a11a92-bbd8-489b-a4aa-4c1edec985d0 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f" status: 200 len: 1860 microversion: 2.1 time: 0.265818 Aug 31 16:02:08.584788 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 834/1661] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:08 2022] GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f => generated 1860 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:08.596592 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-0aa2aae0-eccf-4e02-a39d-8ecfeefb3b2d req-534fa52a-2c08-4c9f-82f7-8b826ebd132a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44f1ab8f-3a6c-41f3-b9fd-7f8aa243bcfa", "name": "network-vif-plugged", "status": "completed", "tag": "0a145e45-a983-4c65-8958-474ffc10da86"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:02:08.619559 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-0aa2aae0-eccf-4e02-a39d-8ecfeefb3b2d req-534fa52a-2c08-4c9f-82f7-8b826ebd132a service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:08.620805 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-0aa2aae0-eccf-4e02-a39d-8ecfeefb3b2d req-534fa52a-2c08-4c9f-82f7-8b826ebd132a service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:08.622276 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-0aa2aae0-eccf-4e02-a39d-8ecfeefb3b2d req-534fa52a-2c08-4c9f-82f7-8b826ebd132a service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:08.663191 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-0aa2aae0-eccf-4e02-a39d-8ecfeefb3b2d req-534fa52a-2c08-4c9f-82f7-8b826ebd132a service nova] Creating event network-vif-plugged:0a145e45-a983-4c65-8958-474ffc10da86 for instance 44f1ab8f-3a6c-41f3-b9fd-7f8aa243bcfa on n-h2-850499-9 Aug 31 16:02:08.677372 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-0aa2aae0-eccf-4e02-a39d-8ecfeefb3b2d req-534fa52a-2c08-4c9f-82f7-8b826ebd132a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089411 Aug 31 16:02:08.680028 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 835/1662] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:02:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:02:08.695316 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-037c8ee5-87a8-4f07-93f9-265c0de72599 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:08.696208 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-037c8ee5-87a8-4f07-93f9-265c0de72599 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] [instance: fe57e6c6-2844-4ab5-ab13-c8d9ee25004d] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:08.709038 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-037c8ee5-87a8-4f07-93f9-265c0de72599 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:08.709952 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-037c8ee5-87a8-4f07-93f9-265c0de72599 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:08.710444 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-037c8ee5-87a8-4f07-93f9-265c0de72599 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:08.711514 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-037c8ee5-87a8-4f07-93f9-265c0de72599 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:08.712139 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-037c8ee5-87a8-4f07-93f9-265c0de72599 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:08.712789 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-037c8ee5-87a8-4f07-93f9-265c0de72599 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:08.760134 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-579cdfc8-ba70-4c26-8c1f-b90763235eb0 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:08.767613 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-037c8ee5-87a8-4f07-93f9-265c0de72599 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:08.768517 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-037c8ee5-87a8-4f07-93f9-265c0de72599 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:08.769222 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-037c8ee5-87a8-4f07-93f9-265c0de72599 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:08.769975 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-037c8ee5-87a8-4f07-93f9-265c0de72599 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Lazy-loading 'fault' on Instance uuid fe57e6c6-2844-4ab5-ab13-c8d9ee25004d {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:02:08.771535 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-579cdfc8-ba70-4c26-8c1f-b90763235eb0 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:08.774130 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-579cdfc8-ba70-4c26-8c1f-b90763235eb0 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:08.776542 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-579cdfc8-ba70-4c26-8c1f-b90763235eb0 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00" status: 200 len: 1815 microversion: 2.25 time: 0.341896 Aug 31 16:02:08.791543 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 828/1663] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:02:08 2022] GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00 => generated 1815 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:02:08.813202 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7fb7e00a-2f98-44c8-9b58-5e09391057ed tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '.version_select at 0x7f5aed2149d0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:08.839669 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-037c8ee5-87a8-4f07-93f9-265c0de72599 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bdd11cffedf44e6b2959058ab88b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e459294501d4024a9deb6eb078ca808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:08.861836 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-037c8ee5-87a8-4f07-93f9-265c0de72599 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] 10.222.0.61 "GET /compute/v2.1/servers/fe57e6c6-2844-4ab5-ab13-c8d9ee25004d" status: 200 len: 1306 microversion: 2.1 time: 0.169748 Aug 31 16:02:08.862884 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 836/1664] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:08 2022] GET /compute/v2.1/servers/fe57e6c6-2844-4ab5-ab13-c8d9ee25004d => generated 1306 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:08.865072 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7fb7e00a-2f98-44c8-9b58-5e09391057ed tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/images/34d69a63-c14a-4d91-9d9f-38bc5d717b66" status: 200 len: 1413 microversion: 2.1 time: 0.056186 Aug 31 16:02:08.866414 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 829/1665] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:02:08 2022] GET /compute/v2.1/images/34d69a63-c14a-4d91-9d9f-38bc5d717b66 => generated 1413 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:08.872548 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ff03e3c9-ec62-48ad-a9f5-2cbb7ba8e8b1 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:08.873154 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ff03e3c9-ec62-48ad-a9f5-2cbb7ba8e8b1 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: cc085aaa-21b2-48a6-b69c-de4e261dfe7f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:08.880063 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ff03e3c9-ec62-48ad-a9f5-2cbb7ba8e8b1 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:08.880570 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ff03e3c9-ec62-48ad-a9f5-2cbb7ba8e8b1 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:08.881111 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ff03e3c9-ec62-48ad-a9f5-2cbb7ba8e8b1 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:08.882058 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ff03e3c9-ec62-48ad-a9f5-2cbb7ba8e8b1 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:08.882526 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ff03e3c9-ec62-48ad-a9f5-2cbb7ba8e8b1 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:08.882958 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ff03e3c9-ec62-48ad-a9f5-2cbb7ba8e8b1 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:09.088162 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-ff03e3c9-ec62-48ad-a9f5-2cbb7ba8e8b1 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lazy-loading 'services' on Instance uuid cc085aaa-21b2-48a6-b69c-de4e261dfe7f {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:02:09.230751 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ff03e3c9-ec62-48ad-a9f5-2cbb7ba8e8b1 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "DELETE /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f/os-volume_attachments/1b00b304-a205-4dd7-a4a8-a48d9036b176" status: 202 len: 0 microversion: 2.1 time: 0.366324 Aug 31 16:02:09.232464 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 837/1666] 10.222.0.61 () {58 vars in 1416 bytes} [Wed Aug 31 16:02:08 2022] DELETE /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f/os-volume_attachments/1b00b304-a205-4dd7-a4a8-a48d9036b176 => generated 0 bytes in 369 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:02:09.240567 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-bc73f1c1-cdc5-4e72-aaa4-9a02277b6eb4 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:09.243421 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-bc73f1c1-cdc5-4e72-aaa4-9a02277b6eb4 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: cc085aaa-21b2-48a6-b69c-de4e261dfe7f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:09.252052 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bc73f1c1-cdc5-4e72-aaa4-9a02277b6eb4 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:09.252920 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bc73f1c1-cdc5-4e72-aaa4-9a02277b6eb4 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:09.253549 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bc73f1c1-cdc5-4e72-aaa4-9a02277b6eb4 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:09.254478 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bc73f1c1-cdc5-4e72-aaa4-9a02277b6eb4 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:09.255160 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bc73f1c1-cdc5-4e72-aaa4-9a02277b6eb4 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:09.255813 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bc73f1c1-cdc5-4e72-aaa4-9a02277b6eb4 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:09.311229 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-bc73f1c1-cdc5-4e72-aaa4-9a02277b6eb4 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074631 Aug 31 16:02:09.311869 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 830/1667] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 16:02:09 2022] GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:02:09.336346 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-afacb2a0-3e6c-4921-bb8a-e9cfd1069022 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:09.337187 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-afacb2a0-3e6c-4921-bb8a-e9cfd1069022 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 44f1ab8f-3a6c-41f3-b9fd-7f8aa243bcfa] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:09.345111 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-afacb2a0-3e6c-4921-bb8a-e9cfd1069022 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:09.345726 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-afacb2a0-3e6c-4921-bb8a-e9cfd1069022 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:09.346310 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-afacb2a0-3e6c-4921-bb8a-e9cfd1069022 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:09.347012 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-afacb2a0-3e6c-4921-bb8a-e9cfd1069022 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:09.347575 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-afacb2a0-3e6c-4921-bb8a-e9cfd1069022 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:09.347947 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-afacb2a0-3e6c-4921-bb8a-e9cfd1069022 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:09.443276 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-708c4e9c-48e9-4b7a-9f85-1f20fb31de9a tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:09.443966 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-708c4e9c-48e9-4b7a-9f85-1f20fb31de9a tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6c7489e2-1ba0-4689-b2d7-e37886757266] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:09.453535 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-708c4e9c-48e9-4b7a-9f85-1f20fb31de9a tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:09.458686 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-708c4e9c-48e9-4b7a-9f85-1f20fb31de9a tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:09.459613 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-708c4e9c-48e9-4b7a-9f85-1f20fb31de9a tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:09.460371 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-708c4e9c-48e9-4b7a-9f85-1f20fb31de9a tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:09.460835 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-708c4e9c-48e9-4b7a-9f85-1f20fb31de9a tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:09.461267 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-708c4e9c-48e9-4b7a-9f85-1f20fb31de9a tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:09.511260 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-afacb2a0-3e6c-4921-bb8a-e9cfd1069022 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:09.519988 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-afacb2a0-3e6c-4921-bb8a-e9cfd1069022 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/44f1ab8f-3a6c-41f3-b9fd-7f8aa243bcfa" status: 200 len: 1317 microversion: 2.1 time: 0.188760 Aug 31 16:02:09.530654 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 838/1668] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:09 2022] GET /compute/v2.1/servers/44f1ab8f-3a6c-41f3-b9fd-7f8aa243bcfa => generated 1317 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:09.638063 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-708c4e9c-48e9-4b7a-9f85-1f20fb31de9a tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:09.652213 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-708c4e9c-48e9-4b7a-9f85-1f20fb31de9a tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266" status: 200 len: 1476 microversion: 2.1 time: 0.212667 Aug 31 16:02:09.653275 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 831/1669] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:09 2022] GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266 => generated 1476 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:02:09.795199 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-63c88e42-14f1-4968-bd5a-08f922fe8364 req-6517f784-3d77-4fe0-96c9-78a38fb60969 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35b89015-3888-493a-b521-49a5e3769b00", "tag": "fdce032a-0b32-49de-acd3-1c9df93ae828"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:02:09.804435 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8d478ca4-60fe-465a-8d4c-5a1f12d0a775 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:09.805090 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8d478ca4-60fe-465a-8d4c-5a1f12d0a775 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 35b89015-3888-493a-b521-49a5e3769b00] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:09.807383 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-63c88e42-14f1-4968-bd5a-08f922fe8364 req-6517f784-3d77-4fe0-96c9-78a38fb60969 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:09.808016 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-63c88e42-14f1-4968-bd5a-08f922fe8364 req-6517f784-3d77-4fe0-96c9-78a38fb60969 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:09.808539 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-63c88e42-14f1-4968-bd5a-08f922fe8364 req-6517f784-3d77-4fe0-96c9-78a38fb60969 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:09.811685 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8d478ca4-60fe-465a-8d4c-5a1f12d0a775 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:09.812182 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8d478ca4-60fe-465a-8d4c-5a1f12d0a775 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:09.813218 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8d478ca4-60fe-465a-8d4c-5a1f12d0a775 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:09.814315 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8d478ca4-60fe-465a-8d4c-5a1f12d0a775 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:09.814779 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8d478ca4-60fe-465a-8d4c-5a1f12d0a775 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:09.815214 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8d478ca4-60fe-465a-8d4c-5a1f12d0a775 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:09.822908 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-63c88e42-14f1-4968-bd5a-08f922fe8364 req-6517f784-3d77-4fe0-96c9-78a38fb60969 service nova] Creating event network-changed:fdce032a-0b32-49de-acd3-1c9df93ae828 for instance 35b89015-3888-493a-b521-49a5e3769b00 on n-h2-850499-9 Aug 31 16:02:09.828643 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-63c88e42-14f1-4968-bd5a-08f922fe8364 req-6517f784-3d77-4fe0-96c9-78a38fb60969 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036525 Aug 31 16:02:09.829370 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 839/1670] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:02:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:02:09.882853 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f71ec5da-1b2f-4c5f-aa00-113de7ab750e tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '.version_select at 0x7f5ae8e21af0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:09.933243 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f71ec5da-1b2f-4c5f-aa00-113de7ab750e tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/images/34d69a63-c14a-4d91-9d9f-38bc5d717b66" status: 200 len: 1413 microversion: 2.1 time: 0.054363 Aug 31 16:02:09.934157 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 840/1671] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:02:09 2022] GET /compute/v2.1/images/34d69a63-c14a-4d91-9d9f-38bc5d717b66 => generated 1413 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:09.938699 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1e936c18-7005-4a8f-bb9b-ddf4f432211d tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:09.939526 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1e936c18-7005-4a8f-bb9b-ddf4f432211d tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] [instance: fe57e6c6-2844-4ab5-ab13-c8d9ee25004d] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:09.946063 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1e936c18-7005-4a8f-bb9b-ddf4f432211d tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:09.946635 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1e936c18-7005-4a8f-bb9b-ddf4f432211d tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:09.947140 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1e936c18-7005-4a8f-bb9b-ddf4f432211d tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:09.947969 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1e936c18-7005-4a8f-bb9b-ddf4f432211d tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:09.949026 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1e936c18-7005-4a8f-bb9b-ddf4f432211d tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:09.949026 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1e936c18-7005-4a8f-bb9b-ddf4f432211d tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:09.963225 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-1e936c18-7005-4a8f-bb9b-ddf4f432211d tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] HTTP exception thrown: Instance fe57e6c6-2844-4ab5-ab13-c8d9ee25004d could not be found. Aug 31 16:02:09.965159 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1e936c18-7005-4a8f-bb9b-ddf4f432211d tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Request method failure captured: Aug 31 16:02:09.965159 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/fe57e6c6-2844-4ab5-ab13-c8d9ee25004d HTTP/1.1 Aug 31 16:02:09.965159 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:02:09.965159 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:02:09.965159 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:02:09.965159 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:02:09.965159 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:02:09.965159 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:02:09.965159 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:02:09.965159 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:02:09.965159 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4XnWHFKtO0TmjKt-UqPbw9Aus9Q8VtUrZtuYgnVU63FLDgQy4iNvrOUSdlGg73gDVmmWdYM2RW9EiWA3WhJIeNRln7mGk13tFnXUvUFS1OucosX9unYG8i_dWC-pVAKdjaU03HET1ivR22c5P9GLftL4_IHex6U3UtGgs7oTq5NxMw Aug 31 16:02:09.965159 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:02:09.965159 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:02:09.965159 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:02:09.965159 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:02:09.965159 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:02:09.965159 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:02:09.965159 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 4e459294501d4024a9deb6eb078ca808 Aug 31 16:02:09.965159 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ImagesNegativeTestJSON-1405263161 Aug 31 16:02:09.965159 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:02:09.965159 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:02:09.966888 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4e459294501d4024a9deb6eb078ca808"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/4e459294501d4024a9deb6eb078ca808"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_4e459294501d4024a9deb6eb078ca808", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4e459294501d4024a9deb6eb078ca808"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:02:09.966888 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ImagesNegativeTestJSON-1405263161 Aug 31 16:02:09.966888 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 4e459294501d4024a9deb6eb078ca808 Aug 31 16:02:09.966888 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1405263161 Aug 31 16:02:09.966888 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ImagesNegativeTestJSON-1405263161-project Aug 31 16:02:09.966888 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:02:09.966888 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:02:09.966888 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 2bdd11cffedf44e6b2959058ab88b6db Aug 31 16:02:09.966888 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ImagesNegativeTestJSON-1405263161-project Aug 31 16:02:09.966888 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:02:09.966888 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance fe57e6c6-2844-4ab5-ab13-c8d9ee25004d could not be found. Aug 31 16:02:09.966888 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': 'fe57e6c6-2844-4ab5-ab13-c8d9ee25004d'} Aug 31 16:02:09.967931 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:02:09.967931 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:02:09.967931 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:02:09.967931 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:02:09.967931 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:02:09.967931 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:02:09.967931 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:02:09.967931 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:02:09.967931 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:02:09.967931 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:02:09.967931 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe57e6c6-2844-4ab5-ab13-c8d9ee25004d could not be found. Aug 31 16:02:09.967931 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:02:09.967931 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:02:09.967931 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:02:09.967931 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:02:09.967931 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:02:09.967931 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:02:09.967931 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:02:09.967931 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:02:09.967931 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:02:09.970303 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:02:09.970303 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:02:09.970303 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:02:09.970303 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:02:09.970303 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:02:09.970303 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:02:09.970303 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:02:09.970303 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe57e6c6-2844-4ab5-ab13-c8d9ee25004d could not be found. Aug 31 16:02:09.970303 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:02:09.970303 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:02:09.970303 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:02:09.970303 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:02:09.970303 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:02:09.970303 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:02:09.970303 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:02:09.970303 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:02:09.970303 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe57e6c6-2844-4ab5-ab13-c8d9ee25004d could not be found. Aug 31 16:02:09.970303 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:02:09.971727 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1e936c18-7005-4a8f-bb9b-ddf4f432211d tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Returning 404 to user: Instance fe57e6c6-2844-4ab5-ab13-c8d9ee25004d could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:02:09.971727 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1e936c18-7005-4a8f-bb9b-ddf4f432211d tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] 10.222.0.61 "GET /compute/v2.1/servers/fe57e6c6-2844-4ab5-ab13-c8d9ee25004d" status: 404 len: 111 microversion: 2.1 time: 0.031679 Aug 31 16:02:09.971917 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8d478ca4-60fe-465a-8d4c-5a1f12d0a775 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:09.972028 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 841/1672] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:09 2022] GET /compute/v2.1/servers/fe57e6c6-2844-4ab5-ab13-c8d9ee25004d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:02:09.978132 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-842bae6b-5d58-48e5-a494-635de5bfb4ba tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-538113542", "metadata": {"image_type": "test"}}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:02:09.980891 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-842bae6b-5d58-48e5-a494-635de5bfb4ba tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] [instance: fe57e6c6-2844-4ab5-ab13-c8d9ee25004d] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:09.984762 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8d478ca4-60fe-465a-8d4c-5a1f12d0a775 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:09.987050 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8d478ca4-60fe-465a-8d4c-5a1f12d0a775 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:09.988215 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8d478ca4-60fe-465a-8d4c-5a1f12d0a775 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00" status: 200 len: 1815 microversion: 2.25 time: 0.187704 Aug 31 16:02:09.988478 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-842bae6b-5d58-48e5-a494-635de5bfb4ba tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:09.989075 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-842bae6b-5d58-48e5-a494-635de5bfb4ba tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:09.989617 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-842bae6b-5d58-48e5-a494-635de5bfb4ba tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:09.990436 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-842bae6b-5d58-48e5-a494-635de5bfb4ba tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:09.991001 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-842bae6b-5d58-48e5-a494-635de5bfb4ba tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:09.991546 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-842bae6b-5d58-48e5-a494-635de5bfb4ba tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:10.003246 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 832/1673] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:02:09 2022] GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00 => generated 1815 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:02:10.020181 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-842bae6b-5d58-48e5-a494-635de5bfb4ba tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] HTTP exception thrown: Instance fe57e6c6-2844-4ab5-ab13-c8d9ee25004d could not be found. Aug 31 16:02:10.021680 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-842bae6b-5d58-48e5-a494-635de5bfb4ba tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Request method failure captured: Aug 31 16:02:10.021680 n-d-850499-9 devstack@n-api.service[122256]: request: POST /compute/v2.1/servers/fe57e6c6-2844-4ab5-ab13-c8d9ee25004d/action HTTP/1.1 Aug 31 16:02:10.021680 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:02:10.021680 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:02:10.021680 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:02:10.021680 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 111 Aug 31 16:02:10.021680 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:02:10.021680 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:02:10.021680 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:02:10.021680 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:02:10.021680 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4XnWHFKtO0TmjKt-UqPbw9Aus9Q8VtUrZtuYgnVU63FLDgQy4iNvrOUSdlGg73gDVmmWdYM2RW9EiWA3WhJIeNRln7mGk13tFnXUvUFS1OucosX9unYG8i_dWC-pVAKdjaU03HET1ivR22c5P9GLftL4_IHex6U3UtGgs7oTq5NxMw Aug 31 16:02:10.021680 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:02:10.021680 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:02:10.021680 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:02:10.021680 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:02:10.021680 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:02:10.021680 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:02:10.021680 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 4e459294501d4024a9deb6eb078ca808 Aug 31 16:02:10.021680 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ImagesNegativeTestJSON-1405263161 Aug 31 16:02:10.021680 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:02:10.021680 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:02:10.023727 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4e459294501d4024a9deb6eb078ca808"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/4e459294501d4024a9deb6eb078ca808"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_4e459294501d4024a9deb6eb078ca808", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4e459294501d4024a9deb6eb078ca808"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:02:10.023727 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ImagesNegativeTestJSON-1405263161 Aug 31 16:02:10.023727 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 4e459294501d4024a9deb6eb078ca808 Aug 31 16:02:10.023727 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1405263161 Aug 31 16:02:10.023727 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ImagesNegativeTestJSON-1405263161-project Aug 31 16:02:10.023727 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:02:10.023727 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:02:10.023727 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 2bdd11cffedf44e6b2959058ab88b6db Aug 31 16:02:10.023727 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ImagesNegativeTestJSON-1405263161-project Aug 31 16:02:10.023727 n-d-850499-9 devstack@n-api.service[122256]: Aug 31 16:02:10.023727 n-d-850499-9 devstack@n-api.service[122256]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-538113542", "metadata": {"image_type": "test"}}} Aug 31 16:02:10.023727 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:02:10.024635 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance fe57e6c6-2844-4ab5-ab13-c8d9ee25004d could not be found. Aug 31 16:02:10.024635 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': 'fe57e6c6-2844-4ab5-ab13-c8d9ee25004d', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-538113542', 'metadata': {'image_type': 'test'}}}} Aug 31 16:02:10.024635 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:02:10.024635 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:02:10.024635 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:02:10.024635 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:02:10.024635 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:02:10.024635 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:02:10.024635 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:02:10.024635 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:02:10.024635 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:02:10.024635 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:02:10.024635 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe57e6c6-2844-4ab5-ab13-c8d9ee25004d could not be found. Aug 31 16:02:10.024635 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:02:10.024635 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:02:10.024635 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:02:10.024635 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:02:10.024635 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:02:10.024635 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:02:10.026058 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:02:10.026058 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:02:10.026058 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:02:10.026058 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:02:10.026058 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:02:10.026058 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:02:10.026058 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:02:10.026058 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:02:10.026058 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 31 16:02:10.026058 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 31 16:02:10.026058 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:02:10.026058 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:02:10.026058 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:02:10.026058 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:02:10.026058 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe57e6c6-2844-4ab5-ab13-c8d9ee25004d could not be found. Aug 31 16:02:10.026058 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:02:10.026058 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:02:10.026058 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:02:10.026058 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:02:10.026058 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:02:10.027615 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:02:10.027615 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:02:10.027615 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:02:10.027615 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe57e6c6-2844-4ab5-ab13-c8d9ee25004d could not be found. Aug 31 16:02:10.027615 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:02:10.027615 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-842bae6b-5d58-48e5-a494-635de5bfb4ba tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Returning 404 to user: Instance fe57e6c6-2844-4ab5-ab13-c8d9ee25004d could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:02:10.027615 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-842bae6b-5d58-48e5-a494-635de5bfb4ba tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] 10.222.0.61 "POST /compute/v2.1/servers/fe57e6c6-2844-4ab5-ab13-c8d9ee25004d/action" status: 404 len: 111 microversion: 2.1 time: 0.049077 Aug 31 16:02:10.027615 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 842/1674] 10.222.0.61 () {60 vars in 1279 bytes} [Wed Aug 31 16:02:09 2022] POST /compute/v2.1/servers/fe57e6c6-2844-4ab5-ab13-c8d9ee25004d/action => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:02:10.042776 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-849aa5a0-44a3-44db-a8ee-241ced0b584f tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1846790083", "metadata": {"image_type": "test"}}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:02:10.045957 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-849aa5a0-44a3-44db-a8ee-241ced0b584f tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Failed to fetch instance by id tempest-invalid-661991280 {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 31 16:02:10.045957 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-849aa5a0-44a3-44db-a8ee-241ced0b584f tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] HTTP exception thrown: Instance tempest-invalid-661991280 could not be found. Aug 31 16:02:10.048983 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-849aa5a0-44a3-44db-a8ee-241ced0b584f tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Request method failure captured: Aug 31 16:02:10.048983 n-d-850499-9 devstack@n-api.service[122257]: request: POST /compute/v2.1/servers/tempest-invalid-661991280/action HTTP/1.1 Aug 31 16:02:10.048983 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:02:10.048983 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:02:10.048983 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:02:10.048983 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 112 Aug 31 16:02:10.048983 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:02:10.048983 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:02:10.048983 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:02:10.048983 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:02:10.048983 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4XnWHFKtO0TmjKt-UqPbw9Aus9Q8VtUrZtuYgnVU63FLDgQy4iNvrOUSdlGg73gDVmmWdYM2RW9EiWA3WhJIeNRln7mGk13tFnXUvUFS1OucosX9unYG8i_dWC-pVAKdjaU03HET1ivR22c5P9GLftL4_IHex6U3UtGgs7oTq5NxMw Aug 31 16:02:10.048983 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:02:10.048983 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:02:10.048983 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:02:10.048983 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:02:10.048983 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:02:10.048983 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:02:10.048983 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 4e459294501d4024a9deb6eb078ca808 Aug 31 16:02:10.048983 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ImagesNegativeTestJSON-1405263161 Aug 31 16:02:10.048983 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:02:10.048983 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:02:10.050439 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4e459294501d4024a9deb6eb078ca808"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/4e459294501d4024a9deb6eb078ca808"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_4e459294501d4024a9deb6eb078ca808", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4e459294501d4024a9deb6eb078ca808"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:02:10.050439 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ImagesNegativeTestJSON-1405263161 Aug 31 16:02:10.050439 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 4e459294501d4024a9deb6eb078ca808 Aug 31 16:02:10.050439 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1405263161 Aug 31 16:02:10.050439 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ImagesNegativeTestJSON-1405263161-project Aug 31 16:02:10.050439 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:02:10.050439 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:02:10.050439 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 2bdd11cffedf44e6b2959058ab88b6db Aug 31 16:02:10.050439 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ImagesNegativeTestJSON-1405263161-project Aug 31 16:02:10.050439 n-d-850499-9 devstack@n-api.service[122257]: Aug 31 16:02:10.050439 n-d-850499-9 devstack@n-api.service[122257]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1846790083", "metadata": {"image_type": "test"}}} Aug 31 16:02:10.050439 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:02:10.051245 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance tempest-invalid-661991280 could not be found. Aug 31 16:02:10.051245 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': 'tempest-invalid-661991280', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1846790083', 'metadata': {'image_type': 'test'}}}} Aug 31 16:02:10.051245 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:02:10.051245 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:02:10.051245 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:02:10.051245 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:02:10.051245 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 31 16:02:10.051245 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 31 16:02:10.051245 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-661991280 could not be found. Aug 31 16:02:10.051245 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:02:10.051245 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:02:10.051245 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:02:10.051245 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:02:10.051245 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:02:10.051245 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:02:10.051245 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:02:10.051245 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:02:10.051245 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:02:10.051245 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:02:10.051245 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:02:10.052902 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:02:10.052902 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:02:10.052902 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:02:10.052902 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 31 16:02:10.052902 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 31 16:02:10.052902 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:02:10.052902 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:02:10.052902 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:02:10.052902 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:02:10.052902 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-661991280 could not be found. Aug 31 16:02:10.052902 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:02:10.052902 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:02:10.052902 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:02:10.052902 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:02:10.052902 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:02:10.052902 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:02:10.052902 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:02:10.052902 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:02:10.052902 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-661991280 could not be found. Aug 31 16:02:10.052902 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:02:10.054121 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-849aa5a0-44a3-44db-a8ee-241ced0b584f tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Returning 404 to user: Instance tempest-invalid-661991280 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:02:10.054121 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-849aa5a0-44a3-44db-a8ee-241ced0b584f tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] 10.222.0.61 "POST /compute/v2.1/servers/tempest-invalid-661991280/action" status: 404 len: 100 microversion: 2.1 time: 0.011593 Aug 31 16:02:10.055765 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 833/1675] 10.222.0.61 () {60 vars in 1246 bytes} [Wed Aug 31 16:02:10 2022] POST /compute/v2.1/servers/tempest-invalid-661991280/action => generated 100 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:02:10.065236 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6860397f-3246-4a9f-8928-28ef4b73355e tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-740205866"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:02:10.067628 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6860397f-3246-4a9f-8928-28ef4b73355e tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 31 16:02:10.068223 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-6860397f-3246-4a9f-8928-28ef4b73355e tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 31 16:02:10.070040 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6860397f-3246-4a9f-8928-28ef4b73355e tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Request method failure captured: Aug 31 16:02:10.070040 n-d-850499-9 devstack@n-api.service[122256]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Aug 31 16:02:10.070040 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:02:10.070040 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:02:10.070040 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:02:10.070040 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 56 Aug 31 16:02:10.070040 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:02:10.070040 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:02:10.070040 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:02:10.070040 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:02:10.070040 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4XnWHFKtO0TmjKt-UqPbw9Aus9Q8VtUrZtuYgnVU63FLDgQy4iNvrOUSdlGg73gDVmmWdYM2RW9EiWA3WhJIeNRln7mGk13tFnXUvUFS1OucosX9unYG8i_dWC-pVAKdjaU03HET1ivR22c5P9GLftL4_IHex6U3UtGgs7oTq5NxMw Aug 31 16:02:10.070040 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:02:10.070040 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:02:10.070040 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:02:10.070040 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:02:10.070040 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:02:10.070040 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:02:10.070040 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 4e459294501d4024a9deb6eb078ca808 Aug 31 16:02:10.070040 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ImagesNegativeTestJSON-1405263161 Aug 31 16:02:10.070040 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:02:10.070040 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:02:10.072017 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4e459294501d4024a9deb6eb078ca808"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/4e459294501d4024a9deb6eb078ca808"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_4e459294501d4024a9deb6eb078ca808", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4e459294501d4024a9deb6eb078ca808"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:02:10.072017 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ImagesNegativeTestJSON-1405263161 Aug 31 16:02:10.072017 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 4e459294501d4024a9deb6eb078ca808 Aug 31 16:02:10.072017 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1405263161 Aug 31 16:02:10.072017 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ImagesNegativeTestJSON-1405263161-project Aug 31 16:02:10.072017 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:02:10.072017 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:02:10.072017 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 2bdd11cffedf44e6b2959058ab88b6db Aug 31 16:02:10.072017 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ImagesNegativeTestJSON-1405263161-project Aug 31 16:02:10.072017 n-d-850499-9 devstack@n-api.service[122256]: Aug 31 16:02:10.072017 n-d-850499-9 devstack@n-api.service[122256]: {"createImage": {"name": "tempest-test-snap-740205866"}} Aug 31 16:02:10.072017 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:02:10.072017 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 31 16:02:10.073075 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-740205866'}}} Aug 31 16:02:10.073075 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:02:10.073075 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:02:10.073075 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:02:10.073075 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:02:10.073075 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 31 16:02:10.073075 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 31 16:02:10.073075 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 31 16:02:10.073075 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:02:10.073075 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:02:10.073075 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:02:10.073075 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:02:10.073075 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:02:10.073075 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:02:10.073075 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:02:10.073075 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:02:10.073075 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:02:10.073075 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:02:10.073075 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:02:10.073075 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:02:10.074553 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:02:10.074553 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:02:10.074553 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 31 16:02:10.074553 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 31 16:02:10.074553 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:02:10.074553 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:02:10.074553 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:02:10.074553 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:02:10.074553 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 31 16:02:10.074553 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:02:10.074553 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:02:10.074553 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:02:10.074553 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:02:10.074553 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:02:10.074553 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:02:10.074553 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:02:10.074553 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:02:10.074553 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 31 16:02:10.074553 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:02:10.075946 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6860397f-3246-4a9f-8928-28ef4b73355e tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:02:10.075946 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6860397f-3246-4a9f-8928-28ef4b73355e tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] 10.222.0.61 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.011236 Aug 31 16:02:10.077173 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 843/1676] 10.222.0.61 () {60 vars in 1275 bytes} [Wed Aug 31 16:02:10 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:02:10.082542 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7c353b05-a665-45c4-b7fc-15216e2301e4 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-2111577218"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:02:10.085072 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7c353b05-a665-45c4-b7fc-15216e2301e4 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 31 16:02:10.085589 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-7c353b05-a665-45c4-b7fc-15216e2301e4 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 31 16:02:10.087121 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7c353b05-a665-45c4-b7fc-15216e2301e4 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Request method failure captured: Aug 31 16:02:10.087121 n-d-850499-9 devstack@n-api.service[122257]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Aug 31 16:02:10.087121 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:02:10.087121 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:02:10.087121 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:02:10.087121 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 57 Aug 31 16:02:10.087121 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:02:10.087121 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:02:10.087121 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:02:10.087121 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:02:10.087121 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4XnWHFKtO0TmjKt-UqPbw9Aus9Q8VtUrZtuYgnVU63FLDgQy4iNvrOUSdlGg73gDVmmWdYM2RW9EiWA3WhJIeNRln7mGk13tFnXUvUFS1OucosX9unYG8i_dWC-pVAKdjaU03HET1ivR22c5P9GLftL4_IHex6U3UtGgs7oTq5NxMw Aug 31 16:02:10.087121 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:02:10.087121 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:02:10.087121 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:02:10.087121 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:02:10.087121 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:02:10.087121 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:02:10.087121 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 4e459294501d4024a9deb6eb078ca808 Aug 31 16:02:10.087121 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ImagesNegativeTestJSON-1405263161 Aug 31 16:02:10.087121 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:02:10.087121 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:02:10.088776 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4e459294501d4024a9deb6eb078ca808"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/4e459294501d4024a9deb6eb078ca808"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_4e459294501d4024a9deb6eb078ca808", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4e459294501d4024a9deb6eb078ca808"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:02:10.088776 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ImagesNegativeTestJSON-1405263161 Aug 31 16:02:10.088776 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 4e459294501d4024a9deb6eb078ca808 Aug 31 16:02:10.088776 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1405263161 Aug 31 16:02:10.088776 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ImagesNegativeTestJSON-1405263161-project Aug 31 16:02:10.088776 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:02:10.088776 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:02:10.088776 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 2bdd11cffedf44e6b2959058ab88b6db Aug 31 16:02:10.088776 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ImagesNegativeTestJSON-1405263161-project Aug 31 16:02:10.088776 n-d-850499-9 devstack@n-api.service[122257]: Aug 31 16:02:10.088776 n-d-850499-9 devstack@n-api.service[122257]: {"createImage": {"name": "tempest-test-snap-2111577218"}} Aug 31 16:02:10.088776 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:02:10.088776 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 31 16:02:10.092241 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-2111577218'}}} Aug 31 16:02:10.092241 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:02:10.092241 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:02:10.092241 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:02:10.092241 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:02:10.092241 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 31 16:02:10.092241 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 31 16:02:10.092241 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 31 16:02:10.092241 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:02:10.092241 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:02:10.092241 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:02:10.092241 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:02:10.092241 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:02:10.092241 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:02:10.092241 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:02:10.092241 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:02:10.092241 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:02:10.092241 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:02:10.092241 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:02:10.092241 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:02:10.094365 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:02:10.094365 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:02:10.094365 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 31 16:02:10.094365 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 31 16:02:10.094365 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:02:10.094365 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:02:10.094365 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:02:10.094365 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:02:10.094365 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 31 16:02:10.094365 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:02:10.094365 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:02:10.094365 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:02:10.094365 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:02:10.094365 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:02:10.094365 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:02:10.094365 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:02:10.094365 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:02:10.094365 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 31 16:02:10.094365 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:02:10.095863 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7c353b05-a665-45c4-b7fc-15216e2301e4 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:02:10.095863 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7c353b05-a665-45c4-b7fc-15216e2301e4 tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] 10.222.0.61 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.010440 Aug 31 16:02:10.095863 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 834/1677] 10.222.0.61 () {60 vars in 1281 bytes} [Wed Aug 31 16:02:10 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:02:10.101348 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c0db6539-2cd0-438c-b927-a62849874e1f tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:10.101967 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c0db6539-2cd0-438c-b927-a62849874e1f tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] [instance: fe57e6c6-2844-4ab5-ab13-c8d9ee25004d] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:10.109039 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c0db6539-2cd0-438c-b927-a62849874e1f tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:10.110548 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c0db6539-2cd0-438c-b927-a62849874e1f tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:10.111270 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c0db6539-2cd0-438c-b927-a62849874e1f tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:10.112243 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c0db6539-2cd0-438c-b927-a62849874e1f tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:10.112817 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c0db6539-2cd0-438c-b927-a62849874e1f tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:10.113354 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c0db6539-2cd0-438c-b927-a62849874e1f tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:10.128705 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-c0db6539-2cd0-438c-b927-a62849874e1f tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] HTTP exception thrown: Instance fe57e6c6-2844-4ab5-ab13-c8d9ee25004d could not be found. Aug 31 16:02:10.130416 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c0db6539-2cd0-438c-b927-a62849874e1f tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Request method failure captured: Aug 31 16:02:10.130416 n-d-850499-9 devstack@n-api.service[122256]: request: DELETE /compute/v2.1/servers/fe57e6c6-2844-4ab5-ab13-c8d9ee25004d HTTP/1.1 Aug 31 16:02:10.130416 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:02:10.130416 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:02:10.130416 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:02:10.130416 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:02:10.130416 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:02:10.130416 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:02:10.130416 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:02:10.130416 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:02:10.130416 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4XnWHFKtO0TmjKt-UqPbw9Aus9Q8VtUrZtuYgnVU63FLDgQy4iNvrOUSdlGg73gDVmmWdYM2RW9EiWA3WhJIeNRln7mGk13tFnXUvUFS1OucosX9unYG8i_dWC-pVAKdjaU03HET1ivR22c5P9GLftL4_IHex6U3UtGgs7oTq5NxMw Aug 31 16:02:10.130416 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:02:10.130416 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:02:10.130416 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:02:10.130416 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:02:10.130416 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:02:10.130416 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:02:10.130416 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 4e459294501d4024a9deb6eb078ca808 Aug 31 16:02:10.130416 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ImagesNegativeTestJSON-1405263161 Aug 31 16:02:10.130416 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:02:10.130416 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:02:10.132616 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4e459294501d4024a9deb6eb078ca808"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/4e459294501d4024a9deb6eb078ca808"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_4e459294501d4024a9deb6eb078ca808", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4e459294501d4024a9deb6eb078ca808"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:02:10.132616 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ImagesNegativeTestJSON-1405263161 Aug 31 16:02:10.132616 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 4e459294501d4024a9deb6eb078ca808 Aug 31 16:02:10.132616 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1405263161 Aug 31 16:02:10.132616 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ImagesNegativeTestJSON-1405263161-project Aug 31 16:02:10.132616 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:02:10.132616 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:02:10.132616 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 2bdd11cffedf44e6b2959058ab88b6db Aug 31 16:02:10.132616 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ImagesNegativeTestJSON-1405263161-project Aug 31 16:02:10.132616 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:02:10.132616 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance fe57e6c6-2844-4ab5-ab13-c8d9ee25004d could not be found. Aug 31 16:02:10.132616 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': 'fe57e6c6-2844-4ab5-ab13-c8d9ee25004d'} Aug 31 16:02:10.133531 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:02:10.133531 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:02:10.133531 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:02:10.133531 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:02:10.133531 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:02:10.133531 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:02:10.133531 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:02:10.133531 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:02:10.133531 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:02:10.133531 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:02:10.133531 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe57e6c6-2844-4ab5-ab13-c8d9ee25004d could not be found. Aug 31 16:02:10.133531 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:02:10.133531 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:02:10.133531 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:02:10.133531 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:02:10.133531 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:02:10.133531 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:02:10.133531 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:02:10.133531 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:02:10.133531 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:02:10.135075 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:02:10.135075 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:02:10.135075 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:02:10.135075 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:02:10.135075 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:02:10.135075 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:02:10.135075 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:02:10.135075 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:02:10.135075 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:02:10.135075 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe57e6c6-2844-4ab5-ab13-c8d9ee25004d could not be found. Aug 31 16:02:10.135075 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:02:10.135075 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:02:10.135075 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:02:10.135075 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:02:10.135075 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:02:10.135075 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:02:10.135075 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:02:10.135075 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:02:10.135075 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe57e6c6-2844-4ab5-ab13-c8d9ee25004d could not be found. Aug 31 16:02:10.135075 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:02:10.136850 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c0db6539-2cd0-438c-b927-a62849874e1f tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Returning 404 to user: Instance fe57e6c6-2844-4ab5-ab13-c8d9ee25004d could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:02:10.136850 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c0db6539-2cd0-438c-b927-a62849874e1f tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] 10.222.0.61 "DELETE /compute/v2.1/servers/fe57e6c6-2844-4ab5-ab13-c8d9ee25004d" status: 404 len: 111 microversion: 2.1 time: 0.035572 Aug 31 16:02:10.136850 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 844/1678] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:02:10 2022] DELETE /compute/v2.1/servers/fe57e6c6-2844-4ab5-ab13-c8d9ee25004d => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:02:10.143081 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-faf3ab7c-411d-4dcb-b6a1-542b0e4632cb tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:10.143655 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-faf3ab7c-411d-4dcb-b6a1-542b0e4632cb tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] [instance: fe57e6c6-2844-4ab5-ab13-c8d9ee25004d] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:10.150375 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-faf3ab7c-411d-4dcb-b6a1-542b0e4632cb tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:10.150879 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-faf3ab7c-411d-4dcb-b6a1-542b0e4632cb tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:10.151321 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-faf3ab7c-411d-4dcb-b6a1-542b0e4632cb tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:10.152071 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-faf3ab7c-411d-4dcb-b6a1-542b0e4632cb tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:10.152537 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-faf3ab7c-411d-4dcb-b6a1-542b0e4632cb tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:10.152972 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-faf3ab7c-411d-4dcb-b6a1-542b0e4632cb tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:10.168558 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-faf3ab7c-411d-4dcb-b6a1-542b0e4632cb tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] HTTP exception thrown: Instance fe57e6c6-2844-4ab5-ab13-c8d9ee25004d could not be found. Aug 31 16:02:10.170137 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-faf3ab7c-411d-4dcb-b6a1-542b0e4632cb tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Request method failure captured: Aug 31 16:02:10.170137 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/fe57e6c6-2844-4ab5-ab13-c8d9ee25004d HTTP/1.1 Aug 31 16:02:10.170137 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:02:10.170137 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:02:10.170137 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:02:10.170137 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:02:10.170137 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:02:10.170137 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:02:10.170137 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:02:10.170137 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:02:10.170137 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4XnWHFKtO0TmjKt-UqPbw9Aus9Q8VtUrZtuYgnVU63FLDgQy4iNvrOUSdlGg73gDVmmWdYM2RW9EiWA3WhJIeNRln7mGk13tFnXUvUFS1OucosX9unYG8i_dWC-pVAKdjaU03HET1ivR22c5P9GLftL4_IHex6U3UtGgs7oTq5NxMw Aug 31 16:02:10.170137 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:02:10.170137 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:02:10.170137 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:02:10.170137 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:02:10.170137 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:02:10.170137 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:02:10.170137 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 4e459294501d4024a9deb6eb078ca808 Aug 31 16:02:10.170137 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ImagesNegativeTestJSON-1405263161 Aug 31 16:02:10.170137 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:02:10.170137 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:02:10.172514 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4e459294501d4024a9deb6eb078ca808"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/4e459294501d4024a9deb6eb078ca808"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_4e459294501d4024a9deb6eb078ca808", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4e459294501d4024a9deb6eb078ca808"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:02:10.172514 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ImagesNegativeTestJSON-1405263161 Aug 31 16:02:10.172514 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 4e459294501d4024a9deb6eb078ca808 Aug 31 16:02:10.172514 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1405263161 Aug 31 16:02:10.172514 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ImagesNegativeTestJSON-1405263161-project Aug 31 16:02:10.172514 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:02:10.172514 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:02:10.172514 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 2bdd11cffedf44e6b2959058ab88b6db Aug 31 16:02:10.172514 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ImagesNegativeTestJSON-1405263161-project Aug 31 16:02:10.172514 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:02:10.172514 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance fe57e6c6-2844-4ab5-ab13-c8d9ee25004d could not be found. Aug 31 16:02:10.172514 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': 'fe57e6c6-2844-4ab5-ab13-c8d9ee25004d'} Aug 31 16:02:10.174109 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:02:10.174109 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:02:10.174109 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:02:10.174109 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:02:10.174109 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:02:10.174109 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:02:10.174109 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:02:10.174109 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:02:10.174109 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:02:10.174109 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:02:10.174109 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe57e6c6-2844-4ab5-ab13-c8d9ee25004d could not be found. Aug 31 16:02:10.174109 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:02:10.174109 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:02:10.174109 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:02:10.174109 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:02:10.174109 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:02:10.174109 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:02:10.174109 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:02:10.174109 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:02:10.174109 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:02:10.176332 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:02:10.176332 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:02:10.176332 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:02:10.176332 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:02:10.176332 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:02:10.176332 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:02:10.176332 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:02:10.176332 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe57e6c6-2844-4ab5-ab13-c8d9ee25004d could not be found. Aug 31 16:02:10.176332 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:02:10.176332 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:02:10.176332 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:02:10.176332 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:02:10.176332 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:02:10.176332 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:02:10.176332 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:02:10.176332 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:02:10.176332 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe57e6c6-2844-4ab5-ab13-c8d9ee25004d could not be found. Aug 31 16:02:10.176332 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:02:10.178628 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-faf3ab7c-411d-4dcb-b6a1-542b0e4632cb tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] Returning 404 to user: Instance fe57e6c6-2844-4ab5-ab13-c8d9ee25004d could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:02:10.178628 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-faf3ab7c-411d-4dcb-b6a1-542b0e4632cb tempest-ImagesNegativeTestJSON-1405263161 tempest-ImagesNegativeTestJSON-1405263161-project] 10.222.0.61 "GET /compute/v2.1/servers/fe57e6c6-2844-4ab5-ab13-c8d9ee25004d" status: 404 len: 111 microversion: 2.1 time: 0.034324 Aug 31 16:02:10.178628 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 835/1679] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:10 2022] GET /compute/v2.1/servers/fe57e6c6-2844-4ab5-ab13-c8d9ee25004d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:02:10.324797 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-236e0f80-6427-4c46-9256-850eb53d6c2d tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:10.327356 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-236e0f80-6427-4c46-9256-850eb53d6c2d tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: cc085aaa-21b2-48a6-b69c-de4e261dfe7f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:10.334844 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-236e0f80-6427-4c46-9256-850eb53d6c2d tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:10.335953 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-236e0f80-6427-4c46-9256-850eb53d6c2d tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:10.336848 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-236e0f80-6427-4c46-9256-850eb53d6c2d tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:10.338104 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-236e0f80-6427-4c46-9256-850eb53d6c2d tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:10.338788 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-236e0f80-6427-4c46-9256-850eb53d6c2d tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:10.339960 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-236e0f80-6427-4c46-9256-850eb53d6c2d tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:10.380996 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-236e0f80-6427-4c46-9256-850eb53d6c2d tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059540 Aug 31 16:02:10.382363 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 845/1680] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 16:02:10 2022] GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:02:10.544526 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-141fd15f-f378-4f5b-b502-417d68081f90 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:10.546564 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-141fd15f-f378-4f5b-b502-417d68081f90 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 44f1ab8f-3a6c-41f3-b9fd-7f8aa243bcfa] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:10.556402 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-141fd15f-f378-4f5b-b502-417d68081f90 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:10.557171 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-141fd15f-f378-4f5b-b502-417d68081f90 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:10.557902 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-141fd15f-f378-4f5b-b502-417d68081f90 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:10.560167 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-141fd15f-f378-4f5b-b502-417d68081f90 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:10.560856 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-141fd15f-f378-4f5b-b502-417d68081f90 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:10.561511 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-141fd15f-f378-4f5b-b502-417d68081f90 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:10.674159 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-29554b7f-c13f-4d36-82a2-c372d643a29b tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:10.674870 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-29554b7f-c13f-4d36-82a2-c372d643a29b tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6c7489e2-1ba0-4689-b2d7-e37886757266] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:10.693470 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-29554b7f-c13f-4d36-82a2-c372d643a29b tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:10.693982 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-29554b7f-c13f-4d36-82a2-c372d643a29b tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:10.694608 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-29554b7f-c13f-4d36-82a2-c372d643a29b tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:10.695546 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-29554b7f-c13f-4d36-82a2-c372d643a29b tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:10.696176 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-29554b7f-c13f-4d36-82a2-c372d643a29b tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:10.696773 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-29554b7f-c13f-4d36-82a2-c372d643a29b tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:10.723924 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-141fd15f-f378-4f5b-b502-417d68081f90 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:10.734231 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-141fd15f-f378-4f5b-b502-417d68081f90 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/44f1ab8f-3a6c-41f3-b9fd-7f8aa243bcfa" status: 200 len: 1317 microversion: 2.1 time: 0.195937 Aug 31 16:02:10.751678 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 836/1681] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:10 2022] GET /compute/v2.1/servers/44f1ab8f-3a6c-41f3-b9fd-7f8aa243bcfa => generated 1317 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:10.767103 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-f54b45db-01f1-4f27-971d-5744948942a7 req-35ac4884-4695-474f-bfa4-c972aea18c9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f785545-d532-4487-b780-8a9be107a209", "name": "network-vif-plugged", "status": "completed", "tag": "52b6863f-3e1f-464d-9a16-40e07fe4f7c7"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:02:10.790877 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-f54b45db-01f1-4f27-971d-5744948942a7 req-35ac4884-4695-474f-bfa4-c972aea18c9a service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:10.791373 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-f54b45db-01f1-4f27-971d-5744948942a7 req-35ac4884-4695-474f-bfa4-c972aea18c9a service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:10.791852 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-f54b45db-01f1-4f27-971d-5744948942a7 req-35ac4884-4695-474f-bfa4-c972aea18c9a service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:10.817501 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-f54b45db-01f1-4f27-971d-5744948942a7 req-35ac4884-4695-474f-bfa4-c972aea18c9a service nova] Creating event network-vif-plugged:52b6863f-3e1f-464d-9a16-40e07fe4f7c7 for instance 3f785545-d532-4487-b780-8a9be107a209 on n-h1-850499-9 Aug 31 16:02:10.822991 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-f54b45db-01f1-4f27-971d-5744948942a7 req-35ac4884-4695-474f-bfa4-c972aea18c9a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068450 Aug 31 16:02:10.823732 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 837/1682] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:02:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:02:10.883043 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-29554b7f-c13f-4d36-82a2-c372d643a29b tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:10.897311 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-29554b7f-c13f-4d36-82a2-c372d643a29b tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266" status: 200 len: 1476 microversion: 2.1 time: 0.226964 Aug 31 16:02:10.897912 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 846/1683] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:10 2022] GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266 => generated 1476 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:02:10.949688 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-08eb1d27-4e99-41da-a6d0-d153789329cb tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '.version_select at 0x7f5aed314790>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:11.012722 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9cc8c904-f4c3-46a0-94d3-15325ded5e81 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:11.013336 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9cc8c904-f4c3-46a0-94d3-15325ded5e81 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 35b89015-3888-493a-b521-49a5e3769b00] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:11.021070 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9cc8c904-f4c3-46a0-94d3-15325ded5e81 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:11.021942 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-08eb1d27-4e99-41da-a6d0-d153789329cb tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/images/34d69a63-c14a-4d91-9d9f-38bc5d717b66" status: 200 len: 1413 microversion: 2.1 time: 0.076705 Aug 31 16:02:11.022411 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9cc8c904-f4c3-46a0-94d3-15325ded5e81 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:11.022540 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 838/1684] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:02:10 2022] GET /compute/v2.1/images/34d69a63-c14a-4d91-9d9f-38bc5d717b66 => generated 1413 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:11.023141 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9cc8c904-f4c3-46a0-94d3-15325ded5e81 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:11.024180 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9cc8c904-f4c3-46a0-94d3-15325ded5e81 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:11.024636 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9cc8c904-f4c3-46a0-94d3-15325ded5e81 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:11.025092 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9cc8c904-f4c3-46a0-94d3-15325ded5e81 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:11.213248 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-9cc8c904-f4c3-46a0-94d3-15325ded5e81 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:11.223985 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-9cc8c904-f4c3-46a0-94d3-15325ded5e81 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:11.224881 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-9cc8c904-f4c3-46a0-94d3-15325ded5e81 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:11.226008 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9cc8c904-f4c3-46a0-94d3-15325ded5e81 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00" status: 200 len: 1815 microversion: 2.25 time: 0.217509 Aug 31 16:02:11.228159 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 847/1685] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:02:11 2022] GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00 => generated 1815 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:02:11.395256 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-68f9bdee-81fc-4ce8-8ab7-1bc018cbddec tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:11.402214 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-68f9bdee-81fc-4ce8-8ab7-1bc018cbddec tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: cc085aaa-21b2-48a6-b69c-de4e261dfe7f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:11.424339 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-68f9bdee-81fc-4ce8-8ab7-1bc018cbddec tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:11.424851 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-68f9bdee-81fc-4ce8-8ab7-1bc018cbddec tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:11.425300 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-68f9bdee-81fc-4ce8-8ab7-1bc018cbddec tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:11.426037 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-68f9bdee-81fc-4ce8-8ab7-1bc018cbddec tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:11.426507 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-68f9bdee-81fc-4ce8-8ab7-1bc018cbddec tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:11.426948 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-68f9bdee-81fc-4ce8-8ab7-1bc018cbddec tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:11.508916 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-68f9bdee-81fc-4ce8-8ab7-1bc018cbddec tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.118271 Aug 31 16:02:11.509532 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 839/1686] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 16:02:11 2022] GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:02:11.756175 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-fe19d8ac-0865-4c2d-8ff5-a3cc9a7f2c6a tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:11.757200 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-fe19d8ac-0865-4c2d-8ff5-a3cc9a7f2c6a tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 44f1ab8f-3a6c-41f3-b9fd-7f8aa243bcfa] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:11.773173 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fe19d8ac-0865-4c2d-8ff5-a3cc9a7f2c6a tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:11.774062 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fe19d8ac-0865-4c2d-8ff5-a3cc9a7f2c6a tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:11.774729 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fe19d8ac-0865-4c2d-8ff5-a3cc9a7f2c6a tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:11.775778 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fe19d8ac-0865-4c2d-8ff5-a3cc9a7f2c6a tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:11.776481 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fe19d8ac-0865-4c2d-8ff5-a3cc9a7f2c6a tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:11.777329 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fe19d8ac-0865-4c2d-8ff5-a3cc9a7f2c6a tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:11.921487 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1d17450f-4c50-4850-a2ec-7eb5033cb787 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:11.924022 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1d17450f-4c50-4850-a2ec-7eb5033cb787 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6c7489e2-1ba0-4689-b2d7-e37886757266] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:11.939089 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1d17450f-4c50-4850-a2ec-7eb5033cb787 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:11.950465 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1d17450f-4c50-4850-a2ec-7eb5033cb787 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:11.951065 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1d17450f-4c50-4850-a2ec-7eb5033cb787 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:11.952056 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1d17450f-4c50-4850-a2ec-7eb5033cb787 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:11.952618 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1d17450f-4c50-4850-a2ec-7eb5033cb787 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:11.955700 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1d17450f-4c50-4850-a2ec-7eb5033cb787 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:12.054683 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-fe19d8ac-0865-4c2d-8ff5-a3cc9a7f2c6a tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:12.078002 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-fe19d8ac-0865-4c2d-8ff5-a3cc9a7f2c6a tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/44f1ab8f-3a6c-41f3-b9fd-7f8aa243bcfa" status: 200 len: 1466 microversion: 2.1 time: 0.325551 Aug 31 16:02:12.103632 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 848/1687] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:11 2022] GET /compute/v2.1/servers/44f1ab8f-3a6c-41f3-b9fd-7f8aa243bcfa => generated 1466 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:02:12.108841 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-bb8a3ccd-d2dd-48ff-bb64-aad33a7b7ce1 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '.version_select at 0x7f5ae8e290d0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:12.174914 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-bb8a3ccd-d2dd-48ff-bb64-aad33a7b7ce1 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/images/34d69a63-c14a-4d91-9d9f-38bc5d717b66" status: 200 len: 1413 microversion: 2.1 time: 0.069810 Aug 31 16:02:12.175520 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 849/1688] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:02:12 2022] GET /compute/v2.1/images/34d69a63-c14a-4d91-9d9f-38bc5d717b66 => generated 1413 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:12.270090 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-de37fd2d-fc3b-4637-99ae-e476fed2dd53 tempest-ServersOnMultiNodesTest-1555970217 tempest-ServersOnMultiNodesTest-1555970217-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:12.270641 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-de37fd2d-fc3b-4637-99ae-e476fed2dd53 tempest-ServersOnMultiNodesTest-1555970217 tempest-ServersOnMultiNodesTest-1555970217-project-admin] [instance: 44f1ab8f-3a6c-41f3-b9fd-7f8aa243bcfa] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:12.293703 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-de37fd2d-fc3b-4637-99ae-e476fed2dd53 tempest-ServersOnMultiNodesTest-1555970217 tempest-ServersOnMultiNodesTest-1555970217-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:12.294226 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-de37fd2d-fc3b-4637-99ae-e476fed2dd53 tempest-ServersOnMultiNodesTest-1555970217 tempest-ServersOnMultiNodesTest-1555970217-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:12.294672 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-de37fd2d-fc3b-4637-99ae-e476fed2dd53 tempest-ServersOnMultiNodesTest-1555970217 tempest-ServersOnMultiNodesTest-1555970217-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:12.295396 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-de37fd2d-fc3b-4637-99ae-e476fed2dd53 tempest-ServersOnMultiNodesTest-1555970217 tempest-ServersOnMultiNodesTest-1555970217-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:12.296063 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-de37fd2d-fc3b-4637-99ae-e476fed2dd53 tempest-ServersOnMultiNodesTest-1555970217 tempest-ServersOnMultiNodesTest-1555970217-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:12.296790 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-de37fd2d-fc3b-4637-99ae-e476fed2dd53 tempest-ServersOnMultiNodesTest-1555970217 tempest-ServersOnMultiNodesTest-1555970217-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:12.311922 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-1d17450f-4c50-4850-a2ec-7eb5033cb787 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:12.323940 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1d17450f-4c50-4850-a2ec-7eb5033cb787 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266" status: 200 len: 1476 microversion: 2.1 time: 0.407838 Aug 31 16:02:12.338248 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 840/1689] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:11 2022] GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266 => generated 1476 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:12.345148 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-87f0d3f8-8aa5-4887-9e10-9354bd766766 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:12.345781 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-87f0d3f8-8aa5-4887-9e10-9354bd766766 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 35b89015-3888-493a-b521-49a5e3769b00] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:12.352074 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-87f0d3f8-8aa5-4887-9e10-9354bd766766 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:12.353265 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-87f0d3f8-8aa5-4887-9e10-9354bd766766 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:12.353716 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-87f0d3f8-8aa5-4887-9e10-9354bd766766 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:12.354440 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-87f0d3f8-8aa5-4887-9e10-9354bd766766 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:12.354910 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-87f0d3f8-8aa5-4887-9e10-9354bd766766 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:12.355342 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-87f0d3f8-8aa5-4887-9e10-9354bd766766 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:12.638893 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-87f0d3f8-8aa5-4887-9e10-9354bd766766 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:12.651438 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-87f0d3f8-8aa5-4887-9e10-9354bd766766 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:12.655908 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-87f0d3f8-8aa5-4887-9e10-9354bd766766 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:12.662005 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-87f0d3f8-8aa5-4887-9e10-9354bd766766 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00" status: 200 len: 1815 microversion: 2.25 time: 0.324817 Aug 31 16:02:12.662953 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 841/1690] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:02:12 2022] GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00 => generated 1815 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:02:12.676002 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-760b205b-71e0-4477-8afe-1bf76f68a031 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:12.680510 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-760b205b-71e0-4477-8afe-1bf76f68a031 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: cc085aaa-21b2-48a6-b69c-de4e261dfe7f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:12.694216 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-760b205b-71e0-4477-8afe-1bf76f68a031 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:12.696124 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-760b205b-71e0-4477-8afe-1bf76f68a031 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:12.698746 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-760b205b-71e0-4477-8afe-1bf76f68a031 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:12.700050 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-760b205b-71e0-4477-8afe-1bf76f68a031 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:12.703601 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-760b205b-71e0-4477-8afe-1bf76f68a031 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:12.706461 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-760b205b-71e0-4477-8afe-1bf76f68a031 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:12.788909 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-760b205b-71e0-4477-8afe-1bf76f68a031 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.123931 Aug 31 16:02:12.799937 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 842/1691] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 16:02:12 2022] GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f/os-volume_attachments => generated 197 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:02:13.136895 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-de37fd2d-fc3b-4637-99ae-e476fed2dd53 tempest-ServersOnMultiNodesTest-1555970217 tempest-ServersOnMultiNodesTest-1555970217-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/44f1ab8f-3a6c-41f3-b9fd-7f8aa243bcfa" status: 200 len: 1617 microversion: 2.1 time: 0.951409 Aug 31 16:02:13.143194 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 850/1692] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:12 2022] GET /compute/v2.1/servers/44f1ab8f-3a6c-41f3-b9fd-7f8aa243bcfa => generated 1617 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:13.171202 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-73835707-a19f-4ef6-a72f-7d445b7f9653 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Action: 'create', calling method: .version_select at 0x7f5ae8c539d0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1350919916", "policies": ["affinity"]}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:02:13.190408 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-63f689e7-190f-4545-99b5-f2c0cfb6d7db tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '.version_select at 0x7f5ae8e29ee0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:13.237424 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-73835707-a19f-4ef6-a72f-7d445b7f9653 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Getting quotas for project 7fa2effd15e440598752264e49d2457d. Resources: {'server_groups'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:02:13.250400 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-73835707-a19f-4ef6-a72f-7d445b7f9653 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Getting quotas for user 547d88df13034daaad50c3582c7cc3b3 and project 7fa2effd15e440598752264e49d2457d. Resources: {'server_groups'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:02:13.279723 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-63f689e7-190f-4545-99b5-f2c0cfb6d7db tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/images/34d69a63-c14a-4d91-9d9f-38bc5d717b66" status: 200 len: 1413 microversion: 2.1 time: 0.093678 Aug 31 16:02:13.280929 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 851/1693] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:02:13 2022] GET /compute/v2.1/images/34d69a63-c14a-4d91-9d9f-38bc5d717b66 => generated 1413 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:02:13.349809 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0de15039-0e91-4280-914e-e16d147af4b4 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:13.350733 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0de15039-0e91-4280-914e-e16d147af4b4 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6c7489e2-1ba0-4689-b2d7-e37886757266] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:13.363466 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0de15039-0e91-4280-914e-e16d147af4b4 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:13.364013 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0de15039-0e91-4280-914e-e16d147af4b4 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:13.364464 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0de15039-0e91-4280-914e-e16d147af4b4 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:13.365215 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0de15039-0e91-4280-914e-e16d147af4b4 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:13.365685 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0de15039-0e91-4280-914e-e16d147af4b4 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:13.366122 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0de15039-0e91-4280-914e-e16d147af4b4 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:13.402127 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-73835707-a19f-4ef6-a72f-7d445b7f9653 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Getting quotas for project 7fa2effd15e440598752264e49d2457d. Resources: {'server_groups'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:02:13.408787 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-73835707-a19f-4ef6-a72f-7d445b7f9653 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Getting quotas for user 547d88df13034daaad50c3582c7cc3b3 and project 7fa2effd15e440598752264e49d2457d. Resources: {'server_groups'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:02:13.423620 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-73835707-a19f-4ef6-a72f-7d445b7f9653 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "POST /compute/v2.1/os-server-groups" status: 200 len: 188 microversion: 2.1 time: 0.258978 Aug 31 16:02:13.424705 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 843/1694] 10.222.0.61 () {60 vars in 1174 bytes} [Wed Aug 31 16:02:13 2022] POST /compute/v2.1/os-server-groups => generated 188 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:02:13.429863 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-445e7100-4d77-4429-aec4-4a1ba369c15b tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:13.432032 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-445e7100-4d77-4429-aec4-4a1ba369c15b tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] [instance: 39a531e3-b13b-412f-a200-5141c32650be] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:13.459066 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-445e7100-4d77-4429-aec4-4a1ba369c15b tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:13.460103 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-445e7100-4d77-4429-aec4-4a1ba369c15b tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:13.460722 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-445e7100-4d77-4429-aec4-4a1ba369c15b tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:13.461623 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-445e7100-4d77-4429-aec4-4a1ba369c15b tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:13.462241 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-445e7100-4d77-4429-aec4-4a1ba369c15b tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:13.462841 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-445e7100-4d77-4429-aec4-4a1ba369c15b tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:13.507538 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-445e7100-4d77-4429-aec4-4a1ba369c15b tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] 10.222.0.61 "GET /compute/v2.1/servers/39a531e3-b13b-412f-a200-5141c32650be/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.080695 Aug 31 16:02:13.508904 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 844/1695] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 16:02:13 2022] GET /compute/v2.1/servers/39a531e3-b13b-412f-a200-5141c32650be/os-volume_attachments => generated 25 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 16:02:13.526734 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-04198197-42ed-448d-a9ed-02555c7b02ee tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-329091988", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "94c2e967-fbb5-4f0a-b5ce-f169fbd5b499"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:02:13.644376 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-04198197-42ed-448d-a9ed-02555c7b02ee tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] validate_networks() for None {{(pid=122257) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:02:13.774614 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-0de15039-0e91-4280-914e-e16d147af4b4 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:13.792696 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0de15039-0e91-4280-914e-e16d147af4b4 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266" status: 200 len: 1476 microversion: 2.1 time: 0.448058 Aug 31 16:02:13.794592 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 852/1696] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:13 2022] GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266 => generated 1476 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:13.809303 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e1bded6e-9b96-4632-8014-cb1c8687ff94 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:13.813870 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e1bded6e-9b96-4632-8014-cb1c8687ff94 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] [instance: 39a531e3-b13b-412f-a200-5141c32650be] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:13.822389 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e1bded6e-9b96-4632-8014-cb1c8687ff94 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:13.823156 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e1bded6e-9b96-4632-8014-cb1c8687ff94 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:13.823800 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e1bded6e-9b96-4632-8014-cb1c8687ff94 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:13.824689 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e1bded6e-9b96-4632-8014-cb1c8687ff94 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:13.825304 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e1bded6e-9b96-4632-8014-cb1c8687ff94 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:13.825887 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e1bded6e-9b96-4632-8014-cb1c8687ff94 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:13.881668 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e1bded6e-9b96-4632-8014-cb1c8687ff94 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] 10.222.0.61 "GET /compute/v2.1/servers/39a531e3-b13b-412f-a200-5141c32650be/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.084718 Aug 31 16:02:13.883254 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 853/1697] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 16:02:13 2022] GET /compute/v2.1/servers/39a531e3-b13b-412f-a200-5141c32650be/os-volume_attachments => generated 25 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 16:02:13.903802 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-618cda3d-f8a7-4e94-8c07-de436ac66b6b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:13.905601 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-618cda3d-f8a7-4e94-8c07-de436ac66b6b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 35b89015-3888-493a-b521-49a5e3769b00] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:13.925941 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-618cda3d-f8a7-4e94-8c07-de436ac66b6b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:13.927708 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-618cda3d-f8a7-4e94-8c07-de436ac66b6b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:13.929003 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-618cda3d-f8a7-4e94-8c07-de436ac66b6b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:13.930531 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-618cda3d-f8a7-4e94-8c07-de436ac66b6b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:13.932036 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-618cda3d-f8a7-4e94-8c07-de436ac66b6b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:13.933062 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-618cda3d-f8a7-4e94-8c07-de436ac66b6b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:14.322849 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-04198197-42ed-448d-a9ed-02555c7b02ee tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:02:14.323377 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-04198197-42ed-448d-a9ed-02555c7b02ee tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:02:14.323772 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-04198197-42ed-448d-a9ed-02555c7b02ee tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:02:14.324392 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-04198197-42ed-448d-a9ed-02555c7b02ee tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:02:14.324818 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-04198197-42ed-448d-a9ed-02555c7b02ee tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:02:14.360837 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-618cda3d-f8a7-4e94-8c07-de436ac66b6b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:14.375811 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-04198197-42ed-448d-a9ed-02555c7b02ee tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:14.376514 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-04198197-42ed-448d-a9ed-02555c7b02ee tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:14.377116 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-04198197-42ed-448d-a9ed-02555c7b02ee tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:14.377777 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-618cda3d-f8a7-4e94-8c07-de436ac66b6b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:14.378238 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-04198197-42ed-448d-a9ed-02555c7b02ee tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:14.378855 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-04198197-42ed-448d-a9ed-02555c7b02ee tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:14.379358 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-618cda3d-f8a7-4e94-8c07-de436ac66b6b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:14.380054 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-04198197-42ed-448d-a9ed-02555c7b02ee tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:14.381412 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-618cda3d-f8a7-4e94-8c07-de436ac66b6b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00" status: 200 len: 1815 microversion: 2.25 time: 0.496847 Aug 31 16:02:14.395296 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 854/1698] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:02:13 2022] GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00 => generated 1815 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:02:14.395296 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-982a120c-d010-45aa-bee4-8c7b3ded75cc tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:14.395296 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-982a120c-d010-45aa-bee4-8c7b3ded75cc tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: cc085aaa-21b2-48a6-b69c-de4e261dfe7f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:14.398449 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-982a120c-d010-45aa-bee4-8c7b3ded75cc tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:14.398960 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-982a120c-d010-45aa-bee4-8c7b3ded75cc tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:14.403070 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-982a120c-d010-45aa-bee4-8c7b3ded75cc tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:14.403070 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-982a120c-d010-45aa-bee4-8c7b3ded75cc tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:14.403070 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-982a120c-d010-45aa-bee4-8c7b3ded75cc tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:14.403070 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-982a120c-d010-45aa-bee4-8c7b3ded75cc tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:14.423212 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-04198197-42ed-448d-a9ed-02555c7b02ee tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Getting quotas for project 7fa2effd15e440598752264e49d2457d. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:02:14.429601 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-04198197-42ed-448d-a9ed-02555c7b02ee tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Getting quotas for user 547d88df13034daaad50c3582c7cc3b3 and project 7fa2effd15e440598752264e49d2457d. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:02:14.444782 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-04198197-42ed-448d-a9ed-02555c7b02ee tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Going to run 2 instances... {{(pid=122257) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:02:14.455951 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-04198197-42ed-448d-a9ed-02555c7b02ee tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 65eb7e79-83ec-41c9-80f3-b8cac7369261] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:02:14.476056 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-982a120c-d010-45aa-bee4-8c7b3ded75cc tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091651 Aug 31 16:02:14.479218 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 855/1699] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 16:02:14 2022] GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:02:14.492699 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5d98c34e-d48e-42f8-8eee-459de1956b76 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:14.497547 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5d98c34e-d48e-42f8-8eee-459de1956b76 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] [instance: 39a531e3-b13b-412f-a200-5141c32650be] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:14.520087 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-04198197-42ed-448d-a9ed-02555c7b02ee tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=122257) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Aug 31 16:02:14.520909 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5d98c34e-d48e-42f8-8eee-459de1956b76 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:14.521483 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5d98c34e-d48e-42f8-8eee-459de1956b76 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:14.521998 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5d98c34e-d48e-42f8-8eee-459de1956b76 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:14.522795 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5d98c34e-d48e-42f8-8eee-459de1956b76 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:14.523328 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5d98c34e-d48e-42f8-8eee-459de1956b76 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:14.524115 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5d98c34e-d48e-42f8-8eee-459de1956b76 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:14.545038 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:02:14.556774 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-04198197-42ed-448d-a9ed-02555c7b02ee tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Getting quotas for project 7fa2effd15e440598752264e49d2457d. Resources: {'server_group_members'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:02:14.565051 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-04198197-42ed-448d-a9ed-02555c7b02ee tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Getting quotas for user 547d88df13034daaad50c3582c7cc3b3 and project 7fa2effd15e440598752264e49d2457d. Resources: {'server_group_members'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:02:14.583814 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5d98c34e-d48e-42f8-8eee-459de1956b76 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] [instance: 39a531e3-b13b-412f-a200-5141c32650be] Going to try to terminate instance {{(pid=122256) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:02:14.599664 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:02:14.654286 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-04198197-42ed-448d-a9ed-02555c7b02ee tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Getting quotas for project 7fa2effd15e440598752264e49d2457d. Resources: {'server_group_members'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:02:14.667051 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-04198197-42ed-448d-a9ed-02555c7b02ee tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Getting quotas for user 547d88df13034daaad50c3582c7cc3b3 and project 7fa2effd15e440598752264e49d2457d. Resources: {'server_group_members'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:02:14.705954 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-04198197-42ed-448d-a9ed-02555c7b02ee tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: efbe58d1-9726-4fa7-a7fb-f3cdc1b70ca4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=65eb7e79-83ec-41c9-80f3-b8cac7369261,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:02:14.738683 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5d98c34e-d48e-42f8-8eee-459de1956b76 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] 10.222.0.61 "DELETE /compute/v2.1/servers/39a531e3-b13b-412f-a200-5141c32650be" status: 204 len: 0 microversion: 2.1 time: 0.256942 Aug 31 16:02:14.744065 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 856/1700] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:02:14 2022] DELETE /compute/v2.1/servers/39a531e3-b13b-412f-a200-5141c32650be => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:02:14.752112 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-76d118ff-69c8-4b54-8d07-339b6efda721 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '.version_select at 0x7f5ae8e37280>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:14.822148 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-76d118ff-69c8-4b54-8d07-339b6efda721 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/images/34d69a63-c14a-4d91-9d9f-38bc5d717b66" status: 200 len: 1413 microversion: 2.1 time: 0.075969 Aug 31 16:02:14.832619 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 857/1701] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:02:14 2022] GET /compute/v2.1/images/34d69a63-c14a-4d91-9d9f-38bc5d717b66 => generated 1413 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:14.839446 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-30e55de6-bf7a-46d2-bbf6-fcd99979f232 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:14.848890 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-04198197-42ed-448d-a9ed-02555c7b02ee tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Getting quotas for project 7fa2effd15e440598752264e49d2457d. Resources: {'server_group_members'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:02:14.850241 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-30e55de6-bf7a-46d2-bbf6-fcd99979f232 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] [instance: 39a531e3-b13b-412f-a200-5141c32650be] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:14.863262 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-04198197-42ed-448d-a9ed-02555c7b02ee tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Getting quotas for user 547d88df13034daaad50c3582c7cc3b3 and project 7fa2effd15e440598752264e49d2457d. Resources: {'server_group_members'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:02:14.867799 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-30e55de6-bf7a-46d2-bbf6-fcd99979f232 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:14.868647 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-30e55de6-bf7a-46d2-bbf6-fcd99979f232 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:14.869321 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-30e55de6-bf7a-46d2-bbf6-fcd99979f232 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:14.870328 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-30e55de6-bf7a-46d2-bbf6-fcd99979f232 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:14.870990 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-30e55de6-bf7a-46d2-bbf6-fcd99979f232 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:14.871675 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-30e55de6-bf7a-46d2-bbf6-fcd99979f232 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:14.985126 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-04198197-42ed-448d-a9ed-02555c7b02ee tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Getting quotas for project 7fa2effd15e440598752264e49d2457d. Resources: {'server_group_members'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:02:15.002652 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-04198197-42ed-448d-a9ed-02555c7b02ee tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Getting quotas for user 547d88df13034daaad50c3582c7cc3b3 and project 7fa2effd15e440598752264e49d2457d. Resources: {'server_group_members'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:02:15.083878 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-04198197-42ed-448d-a9ed-02555c7b02ee tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.573020 Aug 31 16:02:15.089207 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 845/1702] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:02:13 2022] POST /compute/v2.1/servers => generated 32 bytes in 1579 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 31 16:02:15.101731 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ad5a6f1e-5f4c-4e16-bb35-d395e9a734f3 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:15.102372 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ad5a6f1e-5f4c-4e16-bb35-d395e9a734f3 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6c7489e2-1ba0-4689-b2d7-e37886757266] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:15.111110 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ad5a6f1e-5f4c-4e16-bb35-d395e9a734f3 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:15.111642 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ad5a6f1e-5f4c-4e16-bb35-d395e9a734f3 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:15.112198 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ad5a6f1e-5f4c-4e16-bb35-d395e9a734f3 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:15.114956 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ad5a6f1e-5f4c-4e16-bb35-d395e9a734f3 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:15.115444 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ad5a6f1e-5f4c-4e16-bb35-d395e9a734f3 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:15.116052 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ad5a6f1e-5f4c-4e16-bb35-d395e9a734f3 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:15.909643 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-30e55de6-bf7a-46d2-bbf6-fcd99979f232 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb054cb62b9945a78e6bb60cd613acae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f780d0079345519eea40fe8a3fd813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:15.920314 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-30e55de6-bf7a-46d2-bbf6-fcd99979f232 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] 10.222.0.61 "GET /compute/v2.1/servers/39a531e3-b13b-412f-a200-5141c32650be" status: 200 len: 1681 microversion: 2.1 time: 1.084570 Aug 31 16:02:15.922147 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 858/1703] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:14 2022] GET /compute/v2.1/servers/39a531e3-b13b-412f-a200-5141c32650be => generated 1681 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:15.935848 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-bbc4a0be-8292-47bd-9910-bf8f0555023e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:15.942013 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-bbc4a0be-8292-47bd-9910-bf8f0555023e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:15.942791 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-bbc4a0be-8292-47bd-9910-bf8f0555023e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Searching by: {'deleted': False, 'project_id': '7fa2effd15e440598752264e49d2457d'} {{(pid=122256) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 16:02:15.985954 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bbc4a0be-8292-47bd-9910-bf8f0555023e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:15.986450 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bbc4a0be-8292-47bd-9910-bf8f0555023e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:15.986895 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bbc4a0be-8292-47bd-9910-bf8f0555023e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:15.991750 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bbc4a0be-8292-47bd-9910-bf8f0555023e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:15.992314 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bbc4a0be-8292-47bd-9910-bf8f0555023e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:15.992769 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bbc4a0be-8292-47bd-9910-bf8f0555023e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:16.221550 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ad5a6f1e-5f4c-4e16-bb35-d395e9a734f3 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:16.241096 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ad5a6f1e-5f4c-4e16-bb35-d395e9a734f3 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266" status: 200 len: 1476 microversion: 2.1 time: 1.150725 Aug 31 16:02:16.243790 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 846/1704] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:15 2022] GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266 => generated 1476 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:16.251522 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d3723029-5ae5-46c8-80e7-be53b182fbdc tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:16.262067 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d3723029-5ae5-46c8-80e7-be53b182fbdc tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 35b89015-3888-493a-b521-49a5e3769b00] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:16.274992 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.multi_cell_list [None req-bbc4a0be-8292-47bd-9910-bf8f0555023e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=122256) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 31 16:02:16.284949 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d3723029-5ae5-46c8-80e7-be53b182fbdc tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:16.287849 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d3723029-5ae5-46c8-80e7-be53b182fbdc tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:16.288504 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d3723029-5ae5-46c8-80e7-be53b182fbdc tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:16.289433 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d3723029-5ae5-46c8-80e7-be53b182fbdc tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:16.292102 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d3723029-5ae5-46c8-80e7-be53b182fbdc tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:16.292720 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d3723029-5ae5-46c8-80e7-be53b182fbdc tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:16.534597 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-bbc4a0be-8292-47bd-9910-bf8f0555023e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers" status: 200 len: 1002 microversion: 2.1 time: 0.611291 Aug 31 16:02:16.535646 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 859/1705] 10.222.0.61 () {58 vars in 1125 bytes} [Wed Aug 31 16:02:15 2022] GET /compute/v2.1/servers => generated 1002 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:16.565738 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-46e5ea89-0a7e-48d7-a888-4cf22feb19e1 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:16.570656 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-46e5ea89-0a7e-48d7-a888-4cf22feb19e1 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: cc085aaa-21b2-48a6-b69c-de4e261dfe7f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:16.589173 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-46e5ea89-0a7e-48d7-a888-4cf22feb19e1 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:16.591602 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-46e5ea89-0a7e-48d7-a888-4cf22feb19e1 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:16.592213 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-46e5ea89-0a7e-48d7-a888-4cf22feb19e1 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:16.600304 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-46e5ea89-0a7e-48d7-a888-4cf22feb19e1 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:16.602192 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-46e5ea89-0a7e-48d7-a888-4cf22feb19e1 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:16.602848 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-46e5ea89-0a7e-48d7-a888-4cf22feb19e1 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:16.700370 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-46e5ea89-0a7e-48d7-a888-4cf22feb19e1 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.163374 Aug 31 16:02:16.701304 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 860/1706] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 16:02:16 2022] GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f/os-volume_attachments => generated 197 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:02:16.726179 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-22ba56f3-d763-4a90-8fb1-98db35b09b48 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '.version_select at 0x7f5ae8df58b0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:16.831927 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-22ba56f3-d763-4a90-8fb1-98db35b09b48 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/images/34d69a63-c14a-4d91-9d9f-38bc5d717b66" status: 200 len: 1413 microversion: 2.1 time: 0.112085 Aug 31 16:02:16.832863 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 861/1707] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:02:16 2022] GET /compute/v2.1/images/34d69a63-c14a-4d91-9d9f-38bc5d717b66 => generated 1413 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:16.838936 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-fad24f8f-4d03-4713-9f3e-d4ab3b1e193a tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:16.840254 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-fad24f8f-4d03-4713-9f3e-d4ab3b1e193a tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: efbe58d1-9726-4fa7-a7fb-f3cdc1b70ca4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:16.847627 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fad24f8f-4d03-4713-9f3e-d4ab3b1e193a tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:16.851782 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fad24f8f-4d03-4713-9f3e-d4ab3b1e193a tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:16.853015 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fad24f8f-4d03-4713-9f3e-d4ab3b1e193a tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:16.854021 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fad24f8f-4d03-4713-9f3e-d4ab3b1e193a tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:16.854714 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fad24f8f-4d03-4713-9f3e-d4ab3b1e193a tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:16.861228 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d3723029-5ae5-46c8-80e7-be53b182fbdc tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:16.862146 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fad24f8f-4d03-4713-9f3e-d4ab3b1e193a tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:16.882329 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d3723029-5ae5-46c8-80e7-be53b182fbdc tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:16.884643 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d3723029-5ae5-46c8-80e7-be53b182fbdc tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:16.891992 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d3723029-5ae5-46c8-80e7-be53b182fbdc tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00" status: 200 len: 1815 microversion: 2.25 time: 0.644307 Aug 31 16:02:16.894278 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 847/1708] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:02:16 2022] GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00 => generated 1815 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:02:16.944876 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6643b466-4a14-4b3d-909b-fe2dd73eb204 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:16.945747 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6643b466-4a14-4b3d-909b-fe2dd73eb204 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] [instance: 39a531e3-b13b-412f-a200-5141c32650be] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:16.960632 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6643b466-4a14-4b3d-909b-fe2dd73eb204 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:16.961831 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6643b466-4a14-4b3d-909b-fe2dd73eb204 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:16.964253 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6643b466-4a14-4b3d-909b-fe2dd73eb204 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:16.965949 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6643b466-4a14-4b3d-909b-fe2dd73eb204 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:16.968562 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6643b466-4a14-4b3d-909b-fe2dd73eb204 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:16.970192 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6643b466-4a14-4b3d-909b-fe2dd73eb204 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:16.981442 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=100 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:02:17.126456 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-fad24f8f-4d03-4713-9f3e-d4ab3b1e193a tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:17.146522 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-fad24f8f-4d03-4713-9f3e-d4ab3b1e193a tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/efbe58d1-9726-4fa7-a7fb-f3cdc1b70ca4" status: 200 len: 1222 microversion: 2.1 time: 0.312295 Aug 31 16:02:17.158154 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 862/1709] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:16 2022] GET /compute/v2.1/servers/efbe58d1-9726-4fa7-a7fb-f3cdc1b70ca4 => generated 1222 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:17.270632 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8c4cb9d2-e0d2-40df-b624-54689d9b385b tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:17.273091 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8c4cb9d2-e0d2-40df-b624-54689d9b385b tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6c7489e2-1ba0-4689-b2d7-e37886757266] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:17.281599 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8c4cb9d2-e0d2-40df-b624-54689d9b385b tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:17.287212 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8c4cb9d2-e0d2-40df-b624-54689d9b385b tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:17.287981 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8c4cb9d2-e0d2-40df-b624-54689d9b385b tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:17.288991 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8c4cb9d2-e0d2-40df-b624-54689d9b385b tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:17.289736 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8c4cb9d2-e0d2-40df-b624-54689d9b385b tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:17.290416 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8c4cb9d2-e0d2-40df-b624-54689d9b385b tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:17.744907 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-6643b466-4a14-4b3d-909b-fe2dd73eb204 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb054cb62b9945a78e6bb60cd613acae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f780d0079345519eea40fe8a3fd813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:17.764990 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6643b466-4a14-4b3d-909b-fe2dd73eb204 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] 10.222.0.61 "GET /compute/v2.1/servers/39a531e3-b13b-412f-a200-5141c32650be" status: 200 len: 1681 microversion: 2.1 time: 0.824521 Aug 31 16:02:17.771421 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 848/1710] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:16 2022] GET /compute/v2.1/servers/39a531e3-b13b-412f-a200-5141c32650be => generated 1681 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:17.785411 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d524fbb2-250a-47ed-aa66-ef5f4f878468 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:17.792417 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d524fbb2-250a-47ed-aa66-ef5f4f878468 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: cc085aaa-21b2-48a6-b69c-de4e261dfe7f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:17.805636 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d524fbb2-250a-47ed-aa66-ef5f4f878468 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:17.806446 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d524fbb2-250a-47ed-aa66-ef5f4f878468 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:17.807053 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d524fbb2-250a-47ed-aa66-ef5f4f878468 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:17.809400 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d524fbb2-250a-47ed-aa66-ef5f4f878468 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:17.810192 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d524fbb2-250a-47ed-aa66-ef5f4f878468 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:17.810797 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d524fbb2-250a-47ed-aa66-ef5f4f878468 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:17.896633 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d524fbb2-250a-47ed-aa66-ef5f4f878468 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.124023 Aug 31 16:02:17.898712 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 849/1711] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 16:02:17 2022] GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f/os-volume_attachments => generated 197 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:02:17.912760 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ec7a6709-f010-459b-8fa1-a682f8299e68 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '.version_select at 0x7f5aed1e60d0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:18.002405 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ec7a6709-f010-459b-8fa1-a682f8299e68 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/images/34d69a63-c14a-4d91-9d9f-38bc5d717b66" status: 200 len: 1413 microversion: 2.1 time: 0.101567 Aug 31 16:02:18.006959 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 850/1712] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:02:17 2022] GET /compute/v2.1/images/34d69a63-c14a-4d91-9d9f-38bc5d717b66 => generated 1413 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:18.022514 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-357a5f08-231c-402d-adca-f1716df5d554 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:18.023369 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-357a5f08-231c-402d-adca-f1716df5d554 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 35b89015-3888-493a-b521-49a5e3769b00] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:18.039210 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-357a5f08-231c-402d-adca-f1716df5d554 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:18.042274 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-357a5f08-231c-402d-adca-f1716df5d554 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:18.044022 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-357a5f08-231c-402d-adca-f1716df5d554 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:18.046784 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-357a5f08-231c-402d-adca-f1716df5d554 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:18.047961 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-357a5f08-231c-402d-adca-f1716df5d554 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:18.053508 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-357a5f08-231c-402d-adca-f1716df5d554 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:18.159381 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8c4cb9d2-e0d2-40df-b624-54689d9b385b tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:18.173386 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8c4cb9d2-e0d2-40df-b624-54689d9b385b tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266" status: 200 len: 1476 microversion: 2.1 time: 0.907578 Aug 31 16:02:18.187790 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 863/1713] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:17 2022] GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266 => generated 1476 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:02:18.215682 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7693f7ea-ea29-44b4-ad5b-c76392c2292c tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:18.217525 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7693f7ea-ea29-44b4-ad5b-c76392c2292c tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: efbe58d1-9726-4fa7-a7fb-f3cdc1b70ca4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:18.239780 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7693f7ea-ea29-44b4-ad5b-c76392c2292c tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:18.242207 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7693f7ea-ea29-44b4-ad5b-c76392c2292c tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:18.244407 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7693f7ea-ea29-44b4-ad5b-c76392c2292c tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:18.261179 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7693f7ea-ea29-44b4-ad5b-c76392c2292c tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:18.262268 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7693f7ea-ea29-44b4-ad5b-c76392c2292c tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:18.272602 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7693f7ea-ea29-44b4-ad5b-c76392c2292c tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:18.782724 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7693f7ea-ea29-44b4-ad5b-c76392c2292c tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:18.799777 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7693f7ea-ea29-44b4-ad5b-c76392c2292c tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/efbe58d1-9726-4fa7-a7fb-f3cdc1b70ca4" status: 200 len: 1270 microversion: 2.1 time: 0.610363 Aug 31 16:02:18.800555 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 864/1714] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:18 2022] GET /compute/v2.1/servers/efbe58d1-9726-4fa7-a7fb-f3cdc1b70ca4 => generated 1270 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:18.819351 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0957066e-152f-45b4-b281-ce6cbcd92a51 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:18.821434 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0957066e-152f-45b4-b281-ce6cbcd92a51 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] [instance: 39a531e3-b13b-412f-a200-5141c32650be] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:18.830376 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0957066e-152f-45b4-b281-ce6cbcd92a51 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:18.831244 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0957066e-152f-45b4-b281-ce6cbcd92a51 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:18.832077 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0957066e-152f-45b4-b281-ce6cbcd92a51 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:18.833291 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0957066e-152f-45b4-b281-ce6cbcd92a51 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:18.834057 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0957066e-152f-45b4-b281-ce6cbcd92a51 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:18.835015 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0957066e-152f-45b4-b281-ce6cbcd92a51 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:18.972183 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-357a5f08-231c-402d-adca-f1716df5d554 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:18.990732 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-357a5f08-231c-402d-adca-f1716df5d554 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:18.992912 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-357a5f08-231c-402d-adca-f1716df5d554 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:18.999245 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-357a5f08-231c-402d-adca-f1716df5d554 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00" status: 200 len: 1815 microversion: 2.25 time: 0.986688 Aug 31 16:02:19.018228 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 851/1715] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:02:18 2022] GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00 => generated 1815 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:02:19.024498 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9b7a5830-aa6a-4ca9-8874-37fe7d5cbce3 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:19.029795 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9b7a5830-aa6a-4ca9-8874-37fe7d5cbce3 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: cc085aaa-21b2-48a6-b69c-de4e261dfe7f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:19.037637 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9b7a5830-aa6a-4ca9-8874-37fe7d5cbce3 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:19.038420 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9b7a5830-aa6a-4ca9-8874-37fe7d5cbce3 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:19.039035 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9b7a5830-aa6a-4ca9-8874-37fe7d5cbce3 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:19.039960 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9b7a5830-aa6a-4ca9-8874-37fe7d5cbce3 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:19.040581 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9b7a5830-aa6a-4ca9-8874-37fe7d5cbce3 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:19.041168 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9b7a5830-aa6a-4ca9-8874-37fe7d5cbce3 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:19.080717 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9b7a5830-aa6a-4ca9-8874-37fe7d5cbce3 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061004 Aug 31 16:02:19.082082 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 852/1716] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 16:02:19 2022] GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:02:19.090486 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1046a4de-8598-4ddc-9f1b-b9ef8cac21b4 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '.version_select at 0x7f5aed2a0310>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:19.147115 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1046a4de-8598-4ddc-9f1b-b9ef8cac21b4 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/images/34d69a63-c14a-4d91-9d9f-38bc5d717b66" status: 200 len: 1413 microversion: 2.1 time: 0.063134 Aug 31 16:02:19.148047 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 853/1717] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:02:19 2022] GET /compute/v2.1/images/34d69a63-c14a-4d91-9d9f-38bc5d717b66 => generated 1413 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:19.200339 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-56b17804-4d88-4460-bb42-c0b71f0ac090 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:19.200962 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-56b17804-4d88-4460-bb42-c0b71f0ac090 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6c7489e2-1ba0-4689-b2d7-e37886757266] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:19.215045 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-56b17804-4d88-4460-bb42-c0b71f0ac090 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:19.218527 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-56b17804-4d88-4460-bb42-c0b71f0ac090 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:19.218989 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-56b17804-4d88-4460-bb42-c0b71f0ac090 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:19.219778 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-56b17804-4d88-4460-bb42-c0b71f0ac090 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:19.220283 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-56b17804-4d88-4460-bb42-c0b71f0ac090 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:19.220663 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-56b17804-4d88-4460-bb42-c0b71f0ac090 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:19.784566 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-0957066e-152f-45b4-b281-ce6cbcd92a51 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb054cb62b9945a78e6bb60cd613acae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f780d0079345519eea40fe8a3fd813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:19.796160 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0957066e-152f-45b4-b281-ce6cbcd92a51 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] 10.222.0.61 "GET /compute/v2.1/servers/39a531e3-b13b-412f-a200-5141c32650be" status: 200 len: 1681 microversion: 2.1 time: 0.994326 Aug 31 16:02:19.797120 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 865/1718] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:18 2022] GET /compute/v2.1/servers/39a531e3-b13b-412f-a200-5141c32650be => generated 1681 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:20.115364 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-56b17804-4d88-4460-bb42-c0b71f0ac090 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:20.138002 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-56b17804-4d88-4460-bb42-c0b71f0ac090 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266" status: 200 len: 1476 microversion: 2.1 time: 0.943280 Aug 31 16:02:20.146360 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 854/1719] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:19 2022] GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266 => generated 1476 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:02:20.187773 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-fc90d6e6-6e64-4b88-9488-fcc86f138852 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:20.188702 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-fc90d6e6-6e64-4b88-9488-fcc86f138852 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: efbe58d1-9726-4fa7-a7fb-f3cdc1b70ca4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:20.224485 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fc90d6e6-6e64-4b88-9488-fcc86f138852 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:20.227337 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fc90d6e6-6e64-4b88-9488-fcc86f138852 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:20.227825 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fc90d6e6-6e64-4b88-9488-fcc86f138852 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:20.228589 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fc90d6e6-6e64-4b88-9488-fcc86f138852 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:20.229061 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fc90d6e6-6e64-4b88-9488-fcc86f138852 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:20.229492 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fc90d6e6-6e64-4b88-9488-fcc86f138852 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:20.299823 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5c27df9b-5353-413f-bc0f-4cb3a95c9bf2 tempest-KeyPairsV22TestJSON-855101179 tempest-KeyPairsV22TestJSON-855101179-project] Action: 'create', calling method: .version_select at 0x7f5ae8d5c4c0>, body: {"keypair": {"name": "tempest-keypair-800420811", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDWBI3rPGqaDcVII2P38CvOFVHup+x3BYRIxF8S9mVyLKNIq/d2tkcMHdBMENb89f5u1YMOrbJtP+rMLVI3lbBz+675+Qwc60mis82hD+BLZwEs9OXfQu/UqFzQkfq6m8A=="}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:02:20.393304 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-5c27df9b-5353-413f-bc0f-4cb3a95c9bf2 tempest-KeyPairsV22TestJSON-855101179 tempest-KeyPairsV22TestJSON-855101179-project] Getting quotas for project 03d82aa31c8746b39739750cebb405df. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:02:20.418639 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-5c27df9b-5353-413f-bc0f-4cb3a95c9bf2 tempest-KeyPairsV22TestJSON-855101179 tempest-KeyPairsV22TestJSON-855101179-project] Getting quotas for user 191671bbc81b43888313c7a416a5f8f2 and project 03d82aa31c8746b39739750cebb405df. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:02:20.524044 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5c27df9b-5353-413f-bc0f-4cb3a95c9bf2 tempest-KeyPairsV22TestJSON-855101179 tempest-KeyPairsV22TestJSON-855101179-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.725416 Aug 31 16:02:20.535011 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 866/1720] 10.222.0.61 () {62 vars in 1199 bytes} [Wed Aug 31 16:02:19 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 737 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 31 16:02:20.548810 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-46a469cb-d991-4809-bd21-37321fe41f85 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:20.567891 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-46a469cb-d991-4809-bd21-37321fe41f85 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 35b89015-3888-493a-b521-49a5e3769b00] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:20.581586 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-46a469cb-d991-4809-bd21-37321fe41f85 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:20.582213 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-46a469cb-d991-4809-bd21-37321fe41f85 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:20.582624 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-46a469cb-d991-4809-bd21-37321fe41f85 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:20.583353 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-46a469cb-d991-4809-bd21-37321fe41f85 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:20.583852 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-46a469cb-d991-4809-bd21-37321fe41f85 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:20.584839 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-46a469cb-d991-4809-bd21-37321fe41f85 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:20.670568 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-fc90d6e6-6e64-4b88-9488-fcc86f138852 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:20.681407 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-fc90d6e6-6e64-4b88-9488-fcc86f138852 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/efbe58d1-9726-4fa7-a7fb-f3cdc1b70ca4" status: 200 len: 1276 microversion: 2.1 time: 0.526615 Aug 31 16:02:20.684768 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 855/1721] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:20 2022] GET /compute/v2.1/servers/efbe58d1-9726-4fa7-a7fb-f3cdc1b70ca4 => generated 1276 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:20.700809 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5b1e6fba-6e9a-454b-b739-8cff34c8657f tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:20.709133 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5b1e6fba-6e9a-454b-b739-8cff34c8657f tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: cc085aaa-21b2-48a6-b69c-de4e261dfe7f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:20.725654 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b1e6fba-6e9a-454b-b739-8cff34c8657f tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:20.726349 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b1e6fba-6e9a-454b-b739-8cff34c8657f tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:20.726954 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b1e6fba-6e9a-454b-b739-8cff34c8657f tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:20.729696 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b1e6fba-6e9a-454b-b739-8cff34c8657f tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:20.730408 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b1e6fba-6e9a-454b-b739-8cff34c8657f tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:20.731059 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b1e6fba-6e9a-454b-b739-8cff34c8657f tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:20.814206 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5b1e6fba-6e9a-454b-b739-8cff34c8657f tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.128076 Aug 31 16:02:20.815224 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 856/1722] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 16:02:20 2022] GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f/os-volume_attachments => generated 197 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:02:20.830495 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1e02b0c9-8057-459d-8631-4b95e304ca92 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '.version_select at 0x7f5aed138790>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:20.918706 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1e02b0c9-8057-459d-8631-4b95e304ca92 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/images/34d69a63-c14a-4d91-9d9f-38bc5d717b66" status: 200 len: 1413 microversion: 2.1 time: 0.101143 Aug 31 16:02:20.927827 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 857/1723] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:02:20 2022] GET /compute/v2.1/images/34d69a63-c14a-4d91-9d9f-38bc5d717b66 => generated 1413 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:20.939138 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f13c9e9c-ac83-4f9f-912f-da3ae4940337 tempest-KeyPairsV22TestJSON-855101179 tempest-KeyPairsV22TestJSON-855101179-project] Calling method '.version_select at 0x7f5ae8c533a0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:20.960062 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f13c9e9c-ac83-4f9f-912f-da3ae4940337 tempest-KeyPairsV22TestJSON-855101179 tempest-KeyPairsV22TestJSON-855101179-project] 10.222.0.61 "GET /compute/v2.1/os-keypairs/tempest-keypair-800420811" status: 200 len: 512 microversion: 2.2 time: 0.030637 Aug 31 16:02:20.961766 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 858/1724] 10.222.0.61 () {60 vars in 1255 bytes} [Wed Aug 31 16:02:20 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-800420811 => generated 512 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:02:20.972050 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8b82fd2b-f0fb-4e57-932a-cb3318873d75 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:20.973647 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8b82fd2b-f0fb-4e57-932a-cb3318873d75 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] [instance: 39a531e3-b13b-412f-a200-5141c32650be] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:20.990190 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b82fd2b-f0fb-4e57-932a-cb3318873d75 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:20.991052 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b82fd2b-f0fb-4e57-932a-cb3318873d75 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:21.000086 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b82fd2b-f0fb-4e57-932a-cb3318873d75 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:21.001143 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b82fd2b-f0fb-4e57-932a-cb3318873d75 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:21.001844 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b82fd2b-f0fb-4e57-932a-cb3318873d75 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:21.002447 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b82fd2b-f0fb-4e57-932a-cb3318873d75 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:21.346769 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8b82fd2b-f0fb-4e57-932a-cb3318873d75 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb054cb62b9945a78e6bb60cd613acae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f780d0079345519eea40fe8a3fd813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:21.359951 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8b82fd2b-f0fb-4e57-932a-cb3318873d75 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] 10.222.0.61 "GET /compute/v2.1/servers/39a531e3-b13b-412f-a200-5141c32650be" status: 200 len: 1613 microversion: 2.1 time: 0.395363 Aug 31 16:02:21.383063 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 859/1725] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:20 2022] GET /compute/v2.1/servers/39a531e3-b13b-412f-a200-5141c32650be => generated 1613 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:21.404605 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d832c28b-b8f0-4f86-8009-db3f400d13e2 tempest-KeyPairsV22TestJSON-855101179 tempest-KeyPairsV22TestJSON-855101179-project] Calling method '.version_select at 0x7f5aed1c2430>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:21.499050 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d832c28b-b8f0-4f86-8009-db3f400d13e2 tempest-KeyPairsV22TestJSON-855101179 tempest-KeyPairsV22TestJSON-855101179-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-800420811" status: 204 len: 0 microversion: 2.2 time: 0.113974 Aug 31 16:02:21.514774 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 860/1726] 10.222.0.61 () {60 vars in 1258 bytes} [Wed Aug 31 16:02:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-800420811 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:02:21.522368 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ca04020a-a7a9-4639-aee5-fae668fbd6bc tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:21.523063 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ca04020a-a7a9-4639-aee5-fae668fbd6bc tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6c7489e2-1ba0-4689-b2d7-e37886757266] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:21.560614 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ca04020a-a7a9-4639-aee5-fae668fbd6bc tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:21.561874 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ca04020a-a7a9-4639-aee5-fae668fbd6bc tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:21.562678 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ca04020a-a7a9-4639-aee5-fae668fbd6bc tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:21.568601 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ca04020a-a7a9-4639-aee5-fae668fbd6bc tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:21.569486 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ca04020a-a7a9-4639-aee5-fae668fbd6bc tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:21.571865 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ca04020a-a7a9-4639-aee5-fae668fbd6bc tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:21.624054 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-46a469cb-d991-4809-bd21-37321fe41f85 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:21.647269 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-46a469cb-d991-4809-bd21-37321fe41f85 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:21.649434 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-46a469cb-d991-4809-bd21-37321fe41f85 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:21.653927 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-46a469cb-d991-4809-bd21-37321fe41f85 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00" status: 200 len: 1815 microversion: 2.25 time: 1.117342 Aug 31 16:02:21.680196 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 867/1727] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:02:20 2022] GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00 => generated 1815 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:02:21.699388 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0550dc99-ed17-46b5-814c-0ae56a91b950 tempest-KeyPairsV22TestJSON-855101179 tempest-KeyPairsV22TestJSON-855101179-project] Action: 'create', calling method: .version_select at 0x7f5ae8d5c940>, body: {"keypair": {"name": "tempest-keypair-2084415299", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFnHYFjdDKRvbHYq04UrlioH5WS+2hLaTZYgXFz9rIPn/MUzFQyZV5MfIm1zA+DUI1/eg4jX6o3Lf+LF2bp64utlATxRYVEpCcWGakT5V/Ry8Vi+VuIO9D7J8GqTDOzWzA=="}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:02:21.763981 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-0550dc99-ed17-46b5-814c-0ae56a91b950 tempest-KeyPairsV22TestJSON-855101179 tempest-KeyPairsV22TestJSON-855101179-project] Getting quotas for project 03d82aa31c8746b39739750cebb405df. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:02:21.784741 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-0550dc99-ed17-46b5-814c-0ae56a91b950 tempest-KeyPairsV22TestJSON-855101179 tempest-KeyPairsV22TestJSON-855101179-project] Getting quotas for user 191671bbc81b43888313c7a416a5f8f2 and project 03d82aa31c8746b39739750cebb405df. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:02:21.792993 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:02:21.852480 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0550dc99-ed17-46b5-814c-0ae56a91b950 tempest-KeyPairsV22TestJSON-855101179 tempest-KeyPairsV22TestJSON-855101179-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.169633 Aug 31 16:02:21.853817 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 868/1728] 10.222.0.61 () {62 vars in 1199 bytes} [Wed Aug 31 16:02:21 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 173 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 31 16:02:21.864471 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-40661282-1740-435c-b963-1d94afa3bf79 req-6999d854-f55c-46ec-9c60-57d254faa81c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65eb7e79-83ec-41c9-80f3-b8cac7369261", "tag": "05d541ce-2ca3-4539-b544-f59c6a407ca6"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:02:21.927447 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-40661282-1740-435c-b963-1d94afa3bf79 req-6999d854-f55c-46ec-9c60-57d254faa81c service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:21.931242 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-40661282-1740-435c-b963-1d94afa3bf79 req-6999d854-f55c-46ec-9c60-57d254faa81c service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:21.932182 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-40661282-1740-435c-b963-1d94afa3bf79 req-6999d854-f55c-46ec-9c60-57d254faa81c service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:21.952187 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-40661282-1740-435c-b963-1d94afa3bf79 req-6999d854-f55c-46ec-9c60-57d254faa81c service nova] Creating event network-changed:05d541ce-2ca3-4539-b544-f59c6a407ca6 for instance 65eb7e79-83ec-41c9-80f3-b8cac7369261 on n-h1-850499-9 Aug 31 16:02:21.961228 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-40661282-1740-435c-b963-1d94afa3bf79 req-6999d854-f55c-46ec-9c60-57d254faa81c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105094 Aug 31 16:02:21.962207 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 869/1729] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:02:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:02:21.971083 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-00ec70bd-7d7a-47f9-988e-e3afc069dd49 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:21.972216 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-00ec70bd-7d7a-47f9-988e-e3afc069dd49 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: efbe58d1-9726-4fa7-a7fb-f3cdc1b70ca4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:21.979756 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-00ec70bd-7d7a-47f9-988e-e3afc069dd49 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:21.981049 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-00ec70bd-7d7a-47f9-988e-e3afc069dd49 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:21.981818 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-00ec70bd-7d7a-47f9-988e-e3afc069dd49 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:21.982799 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-00ec70bd-7d7a-47f9-988e-e3afc069dd49 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:21.983731 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-00ec70bd-7d7a-47f9-988e-e3afc069dd49 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:21.984684 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-00ec70bd-7d7a-47f9-988e-e3afc069dd49 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:22.315644 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-00ec70bd-7d7a-47f9-988e-e3afc069dd49 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:22.324958 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-00ec70bd-7d7a-47f9-988e-e3afc069dd49 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/efbe58d1-9726-4fa7-a7fb-f3cdc1b70ca4" status: 200 len: 1276 microversion: 2.1 time: 0.361305 Aug 31 16:02:22.339589 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 870/1730] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:21 2022] GET /compute/v2.1/servers/efbe58d1-9726-4fa7-a7fb-f3cdc1b70ca4 => generated 1276 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:22.348974 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-daf2218a-5bf4-4465-8e50-d2989d8b0b1e req-f91be77f-e2af-4a02-ad11-e0b9c3f39e29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39a531e3-b13b-412f-a200-5141c32650be", "name": "network-vif-deleted", "tag": "d0c9a73e-dff5-4b26-80b7-1f09c0c3efcc"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:02:22.377271 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-daf2218a-5bf4-4465-8e50-d2989d8b0b1e req-f91be77f-e2af-4a02-ad11-e0b9c3f39e29 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:22.377798 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-daf2218a-5bf4-4465-8e50-d2989d8b0b1e req-f91be77f-e2af-4a02-ad11-e0b9c3f39e29 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:22.378603 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-daf2218a-5bf4-4465-8e50-d2989d8b0b1e req-f91be77f-e2af-4a02-ad11-e0b9c3f39e29 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:22.410906 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-daf2218a-5bf4-4465-8e50-d2989d8b0b1e req-f91be77f-e2af-4a02-ad11-e0b9c3f39e29 service nova] Creating event network-vif-deleted:d0c9a73e-dff5-4b26-80b7-1f09c0c3efcc for instance 39a531e3-b13b-412f-a200-5141c32650be on n-h1-850499-9 Aug 31 16:02:22.430492 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-daf2218a-5bf4-4465-8e50-d2989d8b0b1e req-f91be77f-e2af-4a02-ad11-e0b9c3f39e29 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091164 Aug 31 16:02:22.431102 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 871/1731] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:02:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:02:22.438588 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0eb3bb51-b5c3-410a-9f4f-e514cd8a2cf0 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:22.441098 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0eb3bb51-b5c3-410a-9f4f-e514cd8a2cf0 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: cc085aaa-21b2-48a6-b69c-de4e261dfe7f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:22.462835 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0eb3bb51-b5c3-410a-9f4f-e514cd8a2cf0 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:22.463280 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0eb3bb51-b5c3-410a-9f4f-e514cd8a2cf0 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:22.464055 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0eb3bb51-b5c3-410a-9f4f-e514cd8a2cf0 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:22.465000 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0eb3bb51-b5c3-410a-9f4f-e514cd8a2cf0 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:22.465476 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0eb3bb51-b5c3-410a-9f4f-e514cd8a2cf0 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:22.465955 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0eb3bb51-b5c3-410a-9f4f-e514cd8a2cf0 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:22.509176 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0eb3bb51-b5c3-410a-9f4f-e514cd8a2cf0 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.076250 Aug 31 16:02:22.515310 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 872/1732] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 16:02:22 2022] GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f/os-volume_attachments => generated 25 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 16:02:22.540957 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-cf927c34-6bc5-4218-867b-8b40252e43b8 tempest-KeyPairsV22TestJSON-855101179 tempest-KeyPairsV22TestJSON-855101179-project] Calling method '.version_select at 0x7f5ae8cde550>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:22.543255 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ca04020a-a7a9-4639-aee5-fae668fbd6bc tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:22.554439 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ca04020a-a7a9-4639-aee5-fae668fbd6bc tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266" status: 200 len: 1476 microversion: 2.1 time: 1.036820 Aug 31 16:02:22.559817 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 861/1733] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:21 2022] GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266 => generated 1476 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:22.578327 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8ec0f893-03fa-4c29-877e-a81e68c84538 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '.version_select at 0x7f5aed1e6670>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:22.585139 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-cf927c34-6bc5-4218-867b-8b40252e43b8 tempest-KeyPairsV22TestJSON-855101179 tempest-KeyPairsV22TestJSON-855101179-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2084415299" status: 204 len: 0 microversion: 2.2 time: 0.067686 Aug 31 16:02:22.592694 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 873/1734] 10.222.0.61 () {60 vars in 1261 bytes} [Wed Aug 31 16:02:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2084415299 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:02:22.603519 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c2e38596-b694-48ab-93df-87366dbc63d5 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:22.605583 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c2e38596-b694-48ab-93df-87366dbc63d5 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] [instance: 39a531e3-b13b-412f-a200-5141c32650be] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:22.625103 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c2e38596-b694-48ab-93df-87366dbc63d5 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:22.626116 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c2e38596-b694-48ab-93df-87366dbc63d5 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:22.626116 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c2e38596-b694-48ab-93df-87366dbc63d5 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:22.630337 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c2e38596-b694-48ab-93df-87366dbc63d5 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:22.632518 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c2e38596-b694-48ab-93df-87366dbc63d5 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:22.633016 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c2e38596-b694-48ab-93df-87366dbc63d5 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:22.729167 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c2e38596-b694-48ab-93df-87366dbc63d5 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:22.730233 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8ec0f893-03fa-4c29-877e-a81e68c84538 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/images/34d69a63-c14a-4d91-9d9f-38bc5d717b66" status: 200 len: 1413 microversion: 2.1 time: 0.160755 Aug 31 16:02:22.730756 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c2e38596-b694-48ab-93df-87366dbc63d5 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:22.731256 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 862/1735] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:02:22 2022] GET /compute/v2.1/images/34d69a63-c14a-4d91-9d9f-38bc5d717b66 => generated 1413 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:22.739581 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c2e38596-b694-48ab-93df-87366dbc63d5 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:22.744302 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-c2e38596-b694-48ab-93df-87366dbc63d5 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lazy-loading 'fault' on Instance uuid 39a531e3-b13b-412f-a200-5141c32650be {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:02:22.763411 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-091a1d29-b8d5-4f26-92af-a116f24a33ab tempest-KeyPairsV22TestJSON-855101179 tempest-KeyPairsV22TestJSON-855101179-project] Action: 'create', calling method: .version_select at 0x7f5aed138940>, body: {"keypair": {"name": "tempest-keypair-1779344110", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:02:22.822754 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-091a1d29-b8d5-4f26-92af-a116f24a33ab tempest-KeyPairsV22TestJSON-855101179 tempest-KeyPairsV22TestJSON-855101179-project] Getting quotas for project 03d82aa31c8746b39739750cebb405df. Resources: {'key_pairs'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:02:22.839109 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-091a1d29-b8d5-4f26-92af-a116f24a33ab tempest-KeyPairsV22TestJSON-855101179 tempest-KeyPairsV22TestJSON-855101179-project] Getting quotas for user 191671bbc81b43888313c7a416a5f8f2 and project 03d82aa31c8746b39739750cebb405df. Resources: {'key_pairs'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:02:22.930961 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-091a1d29-b8d5-4f26-92af-a116f24a33ab tempest-KeyPairsV22TestJSON-855101179 tempest-KeyPairsV22TestJSON-855101179-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.198501 Aug 31 16:02:22.932194 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 863/1736] 10.222.0.61 () {62 vars in 1199 bytes} [Wed Aug 31 16:02:22 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 200 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 31 16:02:22.945662 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e9c2948a-844c-4abd-a2c3-6c93e571a61a tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:22.956455 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e9c2948a-844c-4abd-a2c3-6c93e571a61a tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 35b89015-3888-493a-b521-49a5e3769b00] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:22.966461 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c2e38596-b694-48ab-93df-87366dbc63d5 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb054cb62b9945a78e6bb60cd613acae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f780d0079345519eea40fe8a3fd813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:22.974128 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e9c2948a-844c-4abd-a2c3-6c93e571a61a tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:22.986161 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e9c2948a-844c-4abd-a2c3-6c93e571a61a tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:22.987036 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e9c2948a-844c-4abd-a2c3-6c93e571a61a tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:22.987851 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e9c2948a-844c-4abd-a2c3-6c93e571a61a tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:22.988332 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e9c2948a-844c-4abd-a2c3-6c93e571a61a tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:22.988757 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e9c2948a-844c-4abd-a2c3-6c93e571a61a tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:23.007259 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c2e38596-b694-48ab-93df-87366dbc63d5 tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] 10.222.0.61 "GET /compute/v2.1/servers/39a531e3-b13b-412f-a200-5141c32650be" status: 200 len: 1331 microversion: 2.1 time: 0.416155 Aug 31 16:02:23.034153 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 874/1737] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:22 2022] GET /compute/v2.1/servers/39a531e3-b13b-412f-a200-5141c32650be => generated 1331 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:23.053816 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-139bf78b-e15f-466b-86e0-646fc1c3d71c tempest-KeyPairsV22TestJSON-855101179 tempest-KeyPairsV22TestJSON-855101179-project] Calling method '.version_select at 0x7f5ae8cde670>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:23.133984 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-139bf78b-e15f-466b-86e0-646fc1c3d71c tempest-KeyPairsV22TestJSON-855101179 tempest-KeyPairsV22TestJSON-855101179-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1779344110" status: 204 len: 0 microversion: 2.2 time: 0.089695 Aug 31 16:02:23.138608 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 875/1738] 10.222.0.61 () {60 vars in 1261 bytes} [Wed Aug 31 16:02:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1779344110 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:02:23.147959 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3fecc184-b3f1-432f-88ae-19192688b4a8 tempest-KeyPairsV22TestJSON-855101179 tempest-KeyPairsV22TestJSON-855101179-project] Action: 'create', calling method: .version_select at 0x7f5ae8d5c3a0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-245468921", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFg1/MpvWbsO6Dd+6aX/sc6WJP+SUFSK9e1Xk8DnbJjrgIPesIqmKwmztWVuxk5ImfCpxIEyzqtC1fPMiqfaDmV6zlsFX9MJXPTHMmb5uCQqJTXnuCqIsGRLV/Oeq5oSQA=="}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:02:23.206248 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-3fecc184-b3f1-432f-88ae-19192688b4a8 tempest-KeyPairsV22TestJSON-855101179 tempest-KeyPairsV22TestJSON-855101179-project] Getting quotas for project 03d82aa31c8746b39739750cebb405df. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:02:23.221845 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-3fecc184-b3f1-432f-88ae-19192688b4a8 tempest-KeyPairsV22TestJSON-855101179 tempest-KeyPairsV22TestJSON-855101179-project] Getting quotas for user 191671bbc81b43888313c7a416a5f8f2 and project 03d82aa31c8746b39739750cebb405df. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:02:23.300688 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3fecc184-b3f1-432f-88ae-19192688b4a8 tempest-KeyPairsV22TestJSON-855101179 tempest-KeyPairsV22TestJSON-855101179-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.156513 Aug 31 16:02:23.301690 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 876/1739] 10.222.0.61 () {62 vars in 1199 bytes} [Wed Aug 31 16:02:23 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 158 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 31 16:02:23.320352 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a56798e3-a8db-4016-ba9e-6b940154d6d5 tempest-KeyPairsV22TestJSON-855101179 tempest-KeyPairsV22TestJSON-855101179-project] Action: 'create', calling method: .version_select at 0x7f5ae8cf8e50>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-147701822", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBZzn36mLt+wvsTcIGA8Ir8ueJBDGvYEjL4YVj+D8ZUs/YD54h/W+o7Z34vXCMo3Uv8T9Ib/b+EW21TiIRDJFPKmtmvqBhweJa1h2EdW2bLJvNtzKyqimQpblmGD7mIukg=="}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:02:23.356589 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-a56798e3-a8db-4016-ba9e-6b940154d6d5 tempest-KeyPairsV22TestJSON-855101179 tempest-KeyPairsV22TestJSON-855101179-project] Getting quotas for project 03d82aa31c8746b39739750cebb405df. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:02:23.373123 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-a56798e3-a8db-4016-ba9e-6b940154d6d5 tempest-KeyPairsV22TestJSON-855101179 tempest-KeyPairsV22TestJSON-855101179-project] Getting quotas for user 191671bbc81b43888313c7a416a5f8f2 and project 03d82aa31c8746b39739750cebb405df. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:02:23.441229 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a56798e3-a8db-4016-ba9e-6b940154d6d5 tempest-KeyPairsV22TestJSON-855101179 tempest-KeyPairsV22TestJSON-855101179-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.130476 Aug 31 16:02:23.467938 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 877/1740] 10.222.0.61 () {62 vars in 1199 bytes} [Wed Aug 31 16:02:23 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 144 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Aug 31 16:02:23.491516 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b0dc61d9-ac40-40ef-8075-1cbb389cbb99 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:23.493482 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b0dc61d9-ac40-40ef-8075-1cbb389cbb99 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: efbe58d1-9726-4fa7-a7fb-f3cdc1b70ca4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:23.514390 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b0dc61d9-ac40-40ef-8075-1cbb389cbb99 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:23.516756 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b0dc61d9-ac40-40ef-8075-1cbb389cbb99 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:23.516756 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b0dc61d9-ac40-40ef-8075-1cbb389cbb99 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:23.519180 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b0dc61d9-ac40-40ef-8075-1cbb389cbb99 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:23.519640 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b0dc61d9-ac40-40ef-8075-1cbb389cbb99 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:23.520085 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b0dc61d9-ac40-40ef-8075-1cbb389cbb99 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:23.537776 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e9c2948a-844c-4abd-a2c3-6c93e571a61a tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:23.562754 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e9c2948a-844c-4abd-a2c3-6c93e571a61a tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:23.576945 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e9c2948a-844c-4abd-a2c3-6c93e571a61a tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:23.578893 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e9c2948a-844c-4abd-a2c3-6c93e571a61a tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00" status: 200 len: 1815 microversion: 2.25 time: 0.645501 Aug 31 16:02:23.583361 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 864/1741] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:02:22 2022] GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00 => generated 1815 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:02:23.596411 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-fdab4039-7df2-405f-81d5-def1f81e8560 tempest-KeyPairsV22TestJSON-855101179 tempest-KeyPairsV22TestJSON-855101179-project] Action: 'create', calling method: .version_select at 0x7f5aed138820>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1659523230", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBxGaR+5wAUGZbAVBiwHF1pm9XwBakdQcKPk2FvdDy5QiNuZFB15yLdGdyWYwzTBXmsriRw/Gj0RQcAl21zahof+fYC35kmvcpIpyeH3uOjuKHee2v2RhDM3xiBHo3HFIQ=="}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:02:23.660359 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-fdab4039-7df2-405f-81d5-def1f81e8560 tempest-KeyPairsV22TestJSON-855101179 tempest-KeyPairsV22TestJSON-855101179-project] Getting quotas for project 03d82aa31c8746b39739750cebb405df. Resources: {'key_pairs'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:02:23.668419 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-fdab4039-7df2-405f-81d5-def1f81e8560 tempest-KeyPairsV22TestJSON-855101179 tempest-KeyPairsV22TestJSON-855101179-project] Getting quotas for user 191671bbc81b43888313c7a416a5f8f2 and project 03d82aa31c8746b39739750cebb405df. Resources: {'key_pairs'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:02:23.720831 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:02:23.740350 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-fdab4039-7df2-405f-81d5-def1f81e8560 tempest-KeyPairsV22TestJSON-855101179 tempest-KeyPairsV22TestJSON-855101179-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.155179 Aug 31 16:02:23.749477 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 865/1742] 10.222.0.61 () {62 vars in 1199 bytes} [Wed Aug 31 16:02:23 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 165 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 31 16:02:23.762042 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-fd54297e-9635-44fe-8cd4-6bb1c2f7e274 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:23.762806 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-fd54297e-9635-44fe-8cd4-6bb1c2f7e274 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6c7489e2-1ba0-4689-b2d7-e37886757266] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:23.786738 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fd54297e-9635-44fe-8cd4-6bb1c2f7e274 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:23.788544 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fd54297e-9635-44fe-8cd4-6bb1c2f7e274 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:23.794805 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fd54297e-9635-44fe-8cd4-6bb1c2f7e274 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:23.797845 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fd54297e-9635-44fe-8cd4-6bb1c2f7e274 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:23.798501 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fd54297e-9635-44fe-8cd4-6bb1c2f7e274 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:23.799057 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fd54297e-9635-44fe-8cd4-6bb1c2f7e274 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:23.877492 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b0dc61d9-ac40-40ef-8075-1cbb389cbb99 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:23.893630 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b0dc61d9-ac40-40ef-8075-1cbb389cbb99 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/efbe58d1-9726-4fa7-a7fb-f3cdc1b70ca4" status: 200 len: 1318 microversion: 2.1 time: 0.416868 Aug 31 16:02:23.910211 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 878/1743] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:23 2022] GET /compute/v2.1/servers/efbe58d1-9726-4fa7-a7fb-f3cdc1b70ca4 => generated 1318 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:23.917602 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9983bae3-4f47-4b59-87e1-dab020054f47 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '.version_select at 0x7f5ae8d8b040>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:24.039940 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9983bae3-4f47-4b59-87e1-dab020054f47 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/images/34d69a63-c14a-4d91-9d9f-38bc5d717b66" status: 200 len: 1413 microversion: 2.1 time: 0.127682 Aug 31 16:02:24.040818 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 879/1744] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:02:23 2022] GET /compute/v2.1/images/34d69a63-c14a-4d91-9d9f-38bc5d717b66 => generated 1413 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:24.057093 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2e6a05ac-5fb6-48b8-828a-3bef8c80f860 tempest-KeyPairsV22TestJSON-855101179 tempest-KeyPairsV22TestJSON-855101179-project] Calling method '.version_select at 0x7f5ae8df58b0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:24.066981 n-d-850499-9 devstack@n-api.service[122256]: WARNING oslo_db.sqlalchemy.utils [None req-2e6a05ac-5fb6-48b8-828a-3bef8c80f860 tempest-KeyPairsV22TestJSON-855101179 tempest-KeyPairsV22TestJSON-855101179-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 31 16:02:24.085455 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2e6a05ac-5fb6-48b8-828a-3bef8c80f860 tempest-KeyPairsV22TestJSON-855101179 tempest-KeyPairsV22TestJSON-855101179-project] 10.222.0.61 "GET /compute/v2.1/os-keypairs" status: 200 len: 1140 microversion: 2.2 time: 0.042053 Aug 31 16:02:24.089166 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 880/1745] 10.222.0.61 () {60 vars in 1177 bytes} [Wed Aug 31 16:02:24 2022] GET /compute/v2.1/os-keypairs => generated 1140 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:24.123105 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-976be0b2-8f37-4e76-8b10-5b76a22b835b tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:24.127789 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-976be0b2-8f37-4e76-8b10-5b76a22b835b tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] [instance: 39a531e3-b13b-412f-a200-5141c32650be] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:24.161884 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-976be0b2-8f37-4e76-8b10-5b76a22b835b tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:24.162404 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-976be0b2-8f37-4e76-8b10-5b76a22b835b tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:24.162855 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-976be0b2-8f37-4e76-8b10-5b76a22b835b tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:24.163616 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-976be0b2-8f37-4e76-8b10-5b76a22b835b tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:24.164088 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-976be0b2-8f37-4e76-8b10-5b76a22b835b tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:24.164525 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-976be0b2-8f37-4e76-8b10-5b76a22b835b tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:24.216971 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-976be0b2-8f37-4e76-8b10-5b76a22b835b tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] HTTP exception thrown: Instance 39a531e3-b13b-412f-a200-5141c32650be could not be found. Aug 31 16:02:24.220487 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-976be0b2-8f37-4e76-8b10-5b76a22b835b tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Request method failure captured: Aug 31 16:02:24.220487 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/39a531e3-b13b-412f-a200-5141c32650be HTTP/1.1 Aug 31 16:02:24.220487 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:02:24.220487 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:02:24.220487 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:02:24.220487 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:02:24.220487 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:02:24.220487 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:02:24.220487 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:02:24.220487 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:02:24.220487 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4VECBuIp2sfdQFtldzAEOen6Gq8K8B_W6_IIKegH03Rjx2QgX7NM3EKZIg77Un9mdj2XL_3xJgjG5v923JVA5QCK3lRlGREmMqg12aw_AG3WhDxbeciU3GpFNMvwKFjEFpIhkyqQ5bOu1K4Q0SYPzThB2qHw9KwSiqFqQlqs_E2fA8 Aug 31 16:02:24.220487 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:02:24.220487 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:02:24.220487 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:02:24.220487 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:02:24.220487 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:02:24.220487 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:02:24.220487 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: a9f780d0079345519eea40fe8a3fd813 Aug 31 16:02:24.220487 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-361172188 Aug 31 16:02:24.220487 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:02:24.220487 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:02:24.222331 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a9f780d0079345519eea40fe8a3fd813"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a9f780d0079345519eea40fe8a3fd813"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a9f780d0079345519eea40fe8a3fd813", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a9f780d0079345519eea40fe8a3fd813"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:02:24.222331 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-361172188 Aug 31 16:02:24.222331 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: a9f780d0079345519eea40fe8a3fd813 Aug 31 16:02:24.222331 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-361172188 Aug 31 16:02:24.222331 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-AttachSCSIVolumeTestJSON-361172188-project Aug 31 16:02:24.222331 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:02:24.222331 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:02:24.222331 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: eb054cb62b9945a78e6bb60cd613acae Aug 31 16:02:24.222331 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-361172188-project Aug 31 16:02:24.222331 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:02:24.222331 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance 39a531e3-b13b-412f-a200-5141c32650be could not be found. Aug 31 16:02:24.222331 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '39a531e3-b13b-412f-a200-5141c32650be'} Aug 31 16:02:24.223387 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:02:24.223387 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:02:24.223387 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:02:24.223387 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:02:24.223387 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:02:24.223387 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:02:24.223387 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:02:24.223387 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:02:24.223387 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:02:24.223387 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:02:24.223387 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39a531e3-b13b-412f-a200-5141c32650be could not be found. Aug 31 16:02:24.223387 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:02:24.223387 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:02:24.223387 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:02:24.223387 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:02:24.223387 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:02:24.223387 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:02:24.223387 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:02:24.223387 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:02:24.223387 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:02:24.227031 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:02:24.227031 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:02:24.227031 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:02:24.227031 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:02:24.227031 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:02:24.227031 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:02:24.227031 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:02:24.227031 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39a531e3-b13b-412f-a200-5141c32650be could not be found. Aug 31 16:02:24.227031 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:02:24.227031 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:02:24.227031 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:02:24.227031 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:02:24.227031 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:02:24.227031 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:02:24.227031 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:02:24.227031 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:02:24.227031 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39a531e3-b13b-412f-a200-5141c32650be could not be found. Aug 31 16:02:24.227031 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:02:24.231872 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-976be0b2-8f37-4e76-8b10-5b76a22b835b tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Returning 404 to user: Instance 39a531e3-b13b-412f-a200-5141c32650be could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:02:24.235309 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-976be0b2-8f37-4e76-8b10-5b76a22b835b tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] 10.222.0.61 "GET /compute/v2.1/servers/39a531e3-b13b-412f-a200-5141c32650be" status: 404 len: 111 microversion: 2.1 time: 0.120286 Aug 31 16:02:24.241431 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 881/1746] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:24 2022] GET /compute/v2.1/servers/39a531e3-b13b-412f-a200-5141c32650be => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:02:24.251292 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7f5ac591-386e-433a-b940-05c90709df81 tempest-KeyPairsV22TestJSON-855101179 tempest-KeyPairsV22TestJSON-855101179-project] Calling method '.version_select at 0x7f5aed319430>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:24.292497 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7f5ac591-386e-433a-b940-05c90709df81 tempest-KeyPairsV22TestJSON-855101179 tempest-KeyPairsV22TestJSON-855101179-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1659523230" status: 204 len: 0 microversion: 2.2 time: 0.054546 Aug 31 16:02:24.293985 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 882/1747] 10.222.0.61 () {60 vars in 1321 bytes} [Wed Aug 31 16:02:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1659523230 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:02:24.295414 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-fd54297e-9635-44fe-8cd4-6bb1c2f7e274 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:24.304298 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-836ad67e-509b-46b9-bf74-1f710ee9968f tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Calling method '.version_select at 0x7f5ae8cf8160>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:24.306360 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-fd54297e-9635-44fe-8cd4-6bb1c2f7e274 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266" status: 200 len: 1476 microversion: 2.1 time: 0.554437 Aug 31 16:02:24.307083 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 866/1748] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:23 2022] GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266 => generated 1476 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:24.333201 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ac878d09-b8fe-4335-9f37-18a11aee87ec tempest-KeyPairsV22TestJSON-855101179 tempest-KeyPairsV22TestJSON-855101179-project] Calling method '.version_select at 0x7f5aed11bdc0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:24.348081 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-836ad67e-509b-46b9-bf74-1f710ee9968f tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1228205880" status: 202 len: 0 microversion: 2.1 time: 0.052498 Aug 31 16:02:24.349991 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 883/1749] 10.222.0.61 () {58 vars in 1221 bytes} [Wed Aug 31 16:02:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1228205880 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:02:24.381953 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ac878d09-b8fe-4335-9f37-18a11aee87ec tempest-KeyPairsV22TestJSON-855101179 tempest-KeyPairsV22TestJSON-855101179-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-147701822" status: 204 len: 0 microversion: 2.2 time: 0.059484 Aug 31 16:02:24.382731 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 867/1750] 10.222.0.61 () {60 vars in 1318 bytes} [Wed Aug 31 16:02:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-147701822 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:02:24.397965 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-986dee91-5b75-48c5-a45b-b4af5b97ffa6 tempest-KeyPairsV22TestJSON-855101179 tempest-KeyPairsV22TestJSON-855101179-project] Calling method '.version_select at 0x7f5ae8e21940>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:24.435398 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-986dee91-5b75-48c5-a45b-b4af5b97ffa6 tempest-KeyPairsV22TestJSON-855101179 tempest-KeyPairsV22TestJSON-855101179-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-245468921" status: 204 len: 0 microversion: 2.2 time: 0.047648 Aug 31 16:02:24.436593 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 884/1751] 10.222.0.61 () {60 vars in 1318 bytes} [Wed Aug 31 16:02:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-245468921 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 16:02:24.445235 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:02:24.450976 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f016f734-f619-418d-abfa-0b4699a41f48 tempest-KeyPairsV22TestJSON-855101179 tempest-KeyPairsV22TestJSON-855101179-project] Action: 'create', calling method: .version_select at 0x7f5aed314040>, body: {"keypair": {"name": "tempest-keypair-1102081736", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHo0rTi6DLlBbIcuDo31wQZKHd5Ec5u45/5MwTftXQIg3y/pUB/bCQm6rpM84xnce5UbKCPYvsj29Cleokk+cqDzZBTFWHz88bEVC3JBbpdsgIDkAXlNw13uTi+HoihGjw=="}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:02:24.482860 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-f016f734-f619-418d-abfa-0b4699a41f48 tempest-KeyPairsV22TestJSON-855101179 tempest-KeyPairsV22TestJSON-855101179-project] Getting quotas for project 03d82aa31c8746b39739750cebb405df. Resources: {'key_pairs'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:02:24.497974 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-f016f734-f619-418d-abfa-0b4699a41f48 tempest-KeyPairsV22TestJSON-855101179 tempest-KeyPairsV22TestJSON-855101179-project] Getting quotas for user 191671bbc81b43888313c7a416a5f8f2 and project 03d82aa31c8746b39739750cebb405df. Resources: {'key_pairs'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:02:24.548454 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f016f734-f619-418d-abfa-0b4699a41f48 tempest-KeyPairsV22TestJSON-855101179 tempest-KeyPairsV22TestJSON-855101179-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.101859 Aug 31 16:02:24.550148 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 868/1752] 10.222.0.61 () {62 vars in 1199 bytes} [Wed Aug 31 16:02:24 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 106 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 31 16:02:24.574357 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6ca5c394-044f-472c-83ff-b4166893a885 tempest-KeyPairsV22TestJSON-855101179 tempest-KeyPairsV22TestJSON-855101179-project] Calling method '.version_select at 0x7f5ae8d5c550>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:24.591339 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6ca5c394-044f-472c-83ff-b4166893a885 tempest-KeyPairsV22TestJSON-855101179 tempest-KeyPairsV22TestJSON-855101179-project] 10.222.0.61 "GET /compute/v2.1/os-keypairs/tempest-keypair-1102081736" status: 200 len: 513 microversion: 2.2 time: 0.034268 Aug 31 16:02:24.594424 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 885/1753] 10.222.0.61 () {60 vars in 1258 bytes} [Wed Aug 31 16:02:24 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1102081736 => generated 513 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:02:24.607420 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3120f07e-dba4-4604-894d-988556536f8b tempest-KeyPairsV22TestJSON-855101179 tempest-KeyPairsV22TestJSON-855101179-project] Calling method '.version_select at 0x7f5aed152790>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:24.614155 n-d-850499-9 devstack@n-api.service[122257]: WARNING oslo_db.sqlalchemy.utils [None req-3120f07e-dba4-4604-894d-988556536f8b tempest-KeyPairsV22TestJSON-855101179 tempest-KeyPairsV22TestJSON-855101179-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 31 16:02:24.617292 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-fb6cf6aa-0dce-44c6-a61e-2e6e07e0f0e0 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:24.618054 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-fb6cf6aa-0dce-44c6-a61e-2e6e07e0f0e0 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 35b89015-3888-493a-b521-49a5e3769b00] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:24.626845 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3120f07e-dba4-4604-894d-988556536f8b tempest-KeyPairsV22TestJSON-855101179 tempest-KeyPairsV22TestJSON-855101179-project] 10.222.0.61 "GET /compute/v2.1/os-keypairs" status: 200 len: 370 microversion: 2.2 time: 0.026434 Aug 31 16:02:24.635097 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 869/1754] 10.222.0.61 () {60 vars in 1177 bytes} [Wed Aug 31 16:02:24 2022] GET /compute/v2.1/os-keypairs => generated 370 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:02:24.638020 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fb6cf6aa-0dce-44c6-a61e-2e6e07e0f0e0 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:24.638597 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fb6cf6aa-0dce-44c6-a61e-2e6e07e0f0e0 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:24.640631 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fb6cf6aa-0dce-44c6-a61e-2e6e07e0f0e0 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:24.646618 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fb6cf6aa-0dce-44c6-a61e-2e6e07e0f0e0 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:24.647281 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fb6cf6aa-0dce-44c6-a61e-2e6e07e0f0e0 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:24.648473 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fb6cf6aa-0dce-44c6-a61e-2e6e07e0f0e0 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:24.650643 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-cb8cc29f-9f4b-488a-b8b3-7d72effa8284 tempest-KeyPairsV22TestJSON-855101179 tempest-KeyPairsV22TestJSON-855101179-project] Calling method '.version_select at 0x7f5aed121430>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:24.714583 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-cb8cc29f-9f4b-488a-b8b3-7d72effa8284 tempest-KeyPairsV22TestJSON-855101179 tempest-KeyPairsV22TestJSON-855101179-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1102081736" status: 204 len: 0 microversion: 2.2 time: 0.077195 Aug 31 16:02:24.724443 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 870/1755] 10.222.0.61 () {60 vars in 1261 bytes} [Wed Aug 31 16:02:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1102081736 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:02:24.737492 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1dd353f3-a624-4430-883e-08a740c84344 tempest-KeyPairsV22TestJSON-855101179 tempest-KeyPairsV22TestJSON-855101179-project] Action: 'create', calling method: .version_select at 0x7f5aed11b4c0>, body: {"keypair": {"name": "tempest-keypair-241421818", "type": "x509"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:02:24.783531 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-1dd353f3-a624-4430-883e-08a740c84344 tempest-KeyPairsV22TestJSON-855101179 tempest-KeyPairsV22TestJSON-855101179-project] Getting quotas for project 03d82aa31c8746b39739750cebb405df. Resources: {'key_pairs'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:02:24.803203 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-1dd353f3-a624-4430-883e-08a740c84344 tempest-KeyPairsV22TestJSON-855101179 tempest-KeyPairsV22TestJSON-855101179-project] Getting quotas for user 191671bbc81b43888313c7a416a5f8f2 and project 03d82aa31c8746b39739750cebb405df. Resources: {'key_pairs'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:02:24.832992 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.processutils [None req-1dd353f3-a624-4430-883e-08a740c84344 tempest-KeyPairsV22TestJSON-855101179 tempest-KeyPairsV22TestJSON-855101179-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpldj1f1_b/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpldj1f1_b/temp.key -subj /CN=191671bbc81b43888313c7a416a5f8f2 -extensions v3_req_client {{(pid=122257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Aug 31 16:02:25.246031 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.processutils [None req-1dd353f3-a624-4430-883e-08a740c84344 tempest-KeyPairsV22TestJSON-855101179 tempest-KeyPairsV22TestJSON-855101179-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpldj1f1_b/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpldj1f1_b/temp.key -subj /CN=191671bbc81b43888313c7a416a5f8f2 -extensions v3_req_client" returned: 0 in 0.413s {{(pid=122257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Aug 31 16:02:25.247689 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.processutils [None req-1dd353f3-a624-4430-883e-08a740c84344 tempest-KeyPairsV22TestJSON-855101179 tempest-KeyPairsV22TestJSON-855101179-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpldj1f1_b/temp.key -password pass: {{(pid=122257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Aug 31 16:02:25.324999 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.processutils [None req-1dd353f3-a624-4430-883e-08a740c84344 tempest-KeyPairsV22TestJSON-855101179 tempest-KeyPairsV22TestJSON-855101179-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpldj1f1_b/temp.key -password pass:" returned: 0 in 0.077s {{(pid=122257) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Aug 31 16:02:25.372433 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-fb6cf6aa-0dce-44c6-a61e-2e6e07e0f0e0 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:25.399277 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-1dd353f3-a624-4430-883e-08a740c84344 tempest-KeyPairsV22TestJSON-855101179 tempest-KeyPairsV22TestJSON-855101179-project] Getting quotas for project 03d82aa31c8746b39739750cebb405df. Resources: {'key_pairs'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:02:25.403782 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-fb6cf6aa-0dce-44c6-a61e-2e6e07e0f0e0 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:25.409891 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-fb6cf6aa-0dce-44c6-a61e-2e6e07e0f0e0 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:25.411166 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-1dd353f3-a624-4430-883e-08a740c84344 tempest-KeyPairsV22TestJSON-855101179 tempest-KeyPairsV22TestJSON-855101179-project] Getting quotas for user 191671bbc81b43888313c7a416a5f8f2 and project 03d82aa31c8746b39739750cebb405df. Resources: {'key_pairs'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:02:25.411733 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-fb6cf6aa-0dce-44c6-a61e-2e6e07e0f0e0 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00" status: 200 len: 1815 microversion: 2.25 time: 0.803221 Aug 31 16:02:25.414274 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 886/1756] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:02:24 2022] GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00 => generated 1815 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:02:25.420627 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e164d3ba-ecca-407b-8e8f-2e475777ff4b tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:25.422131 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e164d3ba-ecca-407b-8e8f-2e475777ff4b tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: efbe58d1-9726-4fa7-a7fb-f3cdc1b70ca4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:25.432992 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e164d3ba-ecca-407b-8e8f-2e475777ff4b tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:25.433817 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e164d3ba-ecca-407b-8e8f-2e475777ff4b tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:25.434433 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e164d3ba-ecca-407b-8e8f-2e475777ff4b tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:25.435898 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e164d3ba-ecca-407b-8e8f-2e475777ff4b tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:25.436708 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e164d3ba-ecca-407b-8e8f-2e475777ff4b tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:25.437942 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e164d3ba-ecca-407b-8e8f-2e475777ff4b tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:25.457732 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1dd353f3-a624-4430-883e-08a740c84344 tempest-KeyPairsV22TestJSON-855101179 tempest-KeyPairsV22TestJSON-855101179-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 201 len: 4692 microversion: 2.2 time: 0.725968 Aug 31 16:02:25.459613 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 871/1757] 10.222.0.61 () {62 vars in 1198 bytes} [Wed Aug 31 16:02:24 2022] POST /compute/v2.1/os-keypairs => generated 4692 bytes in 728 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:02:25.469210 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-43d5a159-1bac-4b30-82fd-921f09350e9d tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '.version_select at 0x7f5aed13b9d0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:25.521955 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:02:26.052094 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e164d3ba-ecca-407b-8e8f-2e475777ff4b tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:26.063311 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e164d3ba-ecca-407b-8e8f-2e475777ff4b tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/efbe58d1-9726-4fa7-a7fb-f3cdc1b70ca4" status: 200 len: 1318 microversion: 2.1 time: 0.647029 Aug 31 16:02:26.082000 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 887/1758] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:25 2022] GET /compute/v2.1/servers/efbe58d1-9726-4fa7-a7fb-f3cdc1b70ca4 => generated 1318 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:26.088310 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ae2728df-9b72-4f9c-9833-60f6b21ad63d tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:26.089192 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ae2728df-9b72-4f9c-9833-60f6b21ad63d tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6c7489e2-1ba0-4689-b2d7-e37886757266] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:26.100813 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ae2728df-9b72-4f9c-9833-60f6b21ad63d tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:26.101616 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ae2728df-9b72-4f9c-9833-60f6b21ad63d tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:26.103421 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ae2728df-9b72-4f9c-9833-60f6b21ad63d tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:26.104384 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ae2728df-9b72-4f9c-9833-60f6b21ad63d tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:26.105021 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ae2728df-9b72-4f9c-9833-60f6b21ad63d tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:26.105621 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ae2728df-9b72-4f9c-9833-60f6b21ad63d tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:26.128660 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:02:26.615463 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ae2728df-9b72-4f9c-9833-60f6b21ad63d tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:26.629678 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ae2728df-9b72-4f9c-9833-60f6b21ad63d tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266" status: 200 len: 1476 microversion: 2.1 time: 0.545568 Aug 31 16:02:26.643523 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 888/1759] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:26 2022] GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266 => generated 1476 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:26.643523 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-64711ec2-4e61-428d-97de-7733e9234da4 tempest-KeyPairsV22TestJSON-855101179 tempest-KeyPairsV22TestJSON-855101179-project] Calling method '.version_select at 0x7f5aed353dc0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:26.652378 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-64711ec2-4e61-428d-97de-7733e9234da4 tempest-KeyPairsV22TestJSON-855101179 tempest-KeyPairsV22TestJSON-855101179-project] 10.222.0.61 "GET /compute/v2.1/os-keypairs/tempest-keypair-241421818" status: 200 len: 1533 microversion: 2.2 time: 0.018283 Aug 31 16:02:26.653487 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 889/1760] 10.222.0.61 () {60 vars in 1255 bytes} [Wed Aug 31 16:02:26 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-241421818 => generated 1533 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:26.675863 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-51e9d321-1157-47b9-b142-5b5b9a796bd8 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:26.676781 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-51e9d321-1157-47b9-b142-5b5b9a796bd8 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 35b89015-3888-493a-b521-49a5e3769b00] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:26.684714 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-51e9d321-1157-47b9-b142-5b5b9a796bd8 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:26.685370 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-51e9d321-1157-47b9-b142-5b5b9a796bd8 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:26.685982 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-51e9d321-1157-47b9-b142-5b5b9a796bd8 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:26.687009 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-51e9d321-1157-47b9-b142-5b5b9a796bd8 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:26.688328 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-51e9d321-1157-47b9-b142-5b5b9a796bd8 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:26.689063 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-51e9d321-1157-47b9-b142-5b5b9a796bd8 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:27.724650 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-51e9d321-1157-47b9-b142-5b5b9a796bd8 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:27.734771 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-51e9d321-1157-47b9-b142-5b5b9a796bd8 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:27.736602 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-51e9d321-1157-47b9-b142-5b5b9a796bd8 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:27.737804 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-51e9d321-1157-47b9-b142-5b5b9a796bd8 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00" status: 200 len: 1815 microversion: 2.25 time: 1.080066 Aug 31 16:02:27.738375 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 890/1761] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:02:26 2022] GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00 => generated 1815 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:02:27.760249 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-aacc90a6-3a98-46b6-8647-751315d2e728 tempest-KeyPairsV22TestJSON-855101179 tempest-KeyPairsV22TestJSON-855101179-project] Calling method '.version_select at 0x7f5aed353280>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:27.765578 n-d-850499-9 devstack@n-api.service[122256]: WARNING oslo_db.sqlalchemy.utils [None req-aacc90a6-3a98-46b6-8647-751315d2e728 tempest-KeyPairsV22TestJSON-855101179 tempest-KeyPairsV22TestJSON-855101179-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 31 16:02:27.780185 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-aacc90a6-3a98-46b6-8647-751315d2e728 tempest-KeyPairsV22TestJSON-855101179 tempest-KeyPairsV22TestJSON-855101179-project] 10.222.0.61 "GET /compute/v2.1/os-keypairs" status: 200 len: 1390 microversion: 2.2 time: 0.039207 Aug 31 16:02:27.784363 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 891/1762] 10.222.0.61 () {60 vars in 1177 bytes} [Wed Aug 31 16:02:27 2022] GET /compute/v2.1/os-keypairs => generated 1390 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:27.798425 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-dbecde9f-473e-40f8-aae3-912cabbcb407 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:27.798425 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-dbecde9f-473e-40f8-aae3-912cabbcb407 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: efbe58d1-9726-4fa7-a7fb-f3cdc1b70ca4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:27.814131 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dbecde9f-473e-40f8-aae3-912cabbcb407 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:27.815408 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dbecde9f-473e-40f8-aae3-912cabbcb407 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:27.816935 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dbecde9f-473e-40f8-aae3-912cabbcb407 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:27.818219 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dbecde9f-473e-40f8-aae3-912cabbcb407 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:27.820398 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dbecde9f-473e-40f8-aae3-912cabbcb407 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:27.821577 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dbecde9f-473e-40f8-aae3-912cabbcb407 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:28.185377 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-dbecde9f-473e-40f8-aae3-912cabbcb407 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:28.208032 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-dbecde9f-473e-40f8-aae3-912cabbcb407 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/efbe58d1-9726-4fa7-a7fb-f3cdc1b70ca4" status: 200 len: 1318 microversion: 2.1 time: 0.422971 Aug 31 16:02:28.208843 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 892/1763] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:27 2022] GET /compute/v2.1/servers/efbe58d1-9726-4fa7-a7fb-f3cdc1b70ca4 => generated 1318 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:28.221658 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-85723164-d41f-4e70-82e0-31a13db8aada tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:28.228713 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-85723164-d41f-4e70-82e0-31a13db8aada tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6c7489e2-1ba0-4689-b2d7-e37886757266] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:28.246943 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-85723164-d41f-4e70-82e0-31a13db8aada tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:28.250773 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-85723164-d41f-4e70-82e0-31a13db8aada tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:28.254296 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-85723164-d41f-4e70-82e0-31a13db8aada tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:28.259079 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-85723164-d41f-4e70-82e0-31a13db8aada tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:28.259737 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-85723164-d41f-4e70-82e0-31a13db8aada tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:28.260197 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-85723164-d41f-4e70-82e0-31a13db8aada tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:28.925549 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-85723164-d41f-4e70-82e0-31a13db8aada tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:28.935048 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-85723164-d41f-4e70-82e0-31a13db8aada tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266" status: 200 len: 1475 microversion: 2.1 time: 0.724746 Aug 31 16:02:28.940630 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 893/1764] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:28 2022] GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266 => generated 1475 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:28.945899 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-575a5972-2c14-464d-a3be-56bec6c20871 tempest-KeyPairsV22TestJSON-855101179 tempest-KeyPairsV22TestJSON-855101179-project] Calling method '.version_select at 0x7f5aed3194c0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:29.014567 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-575a5972-2c14-464d-a3be-56bec6c20871 tempest-KeyPairsV22TestJSON-855101179 tempest-KeyPairsV22TestJSON-855101179-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-241421818" status: 204 len: 0 microversion: 2.2 time: 0.072288 Aug 31 16:02:29.020679 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 894/1765] 10.222.0.61 () {60 vars in 1258 bytes} [Wed Aug 31 16:02:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-241421818 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:02:29.038039 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-8457d91c-7d2c-45b6-b484-c6e02b0eab54 req-de49dc8c-5271-49a1-af7c-3546ad0042eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c7489e2-1ba0-4689-b2d7-e37886757266", "name": "network-vif-unplugged", "status": "completed", "tag": "e136c42f-9bc1-433f-8e80-0837c9be0717"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:02:29.059706 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-8457d91c-7d2c-45b6-b484-c6e02b0eab54 req-de49dc8c-5271-49a1-af7c-3546ad0042eb service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:29.062463 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-8457d91c-7d2c-45b6-b484-c6e02b0eab54 req-de49dc8c-5271-49a1-af7c-3546ad0042eb service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:29.067809 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-8457d91c-7d2c-45b6-b484-c6e02b0eab54 req-de49dc8c-5271-49a1-af7c-3546ad0042eb service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:29.094711 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-8457d91c-7d2c-45b6-b484-c6e02b0eab54 req-de49dc8c-5271-49a1-af7c-3546ad0042eb service nova] Creating event network-vif-unplugged:e136c42f-9bc1-433f-8e80-0837c9be0717 for instance 6c7489e2-1ba0-4689-b2d7-e37886757266 on n-h1-850499-9 Aug 31 16:02:29.126182 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [req-8457d91c-7d2c-45b6-b484-c6e02b0eab54 req-de49dc8c-5271-49a1-af7c-3546ad0042eb service nova] Instance 6c7489e2-1ba0-4689-b2d7-e37886757266 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850499-9', 'n-h2-850499-9'} {{(pid=122256) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 31 16:02:29.169501 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-8457d91c-7d2c-45b6-b484-c6e02b0eab54 req-de49dc8c-5271-49a1-af7c-3546ad0042eb service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.142336 Aug 31 16:02:29.172628 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 895/1766] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:02:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:02:29.194981 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f2bd771b-167c-4722-a1e1-9f884a99e2f9 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:29.196279 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f2bd771b-167c-4722-a1e1-9f884a99e2f9 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 35b89015-3888-493a-b521-49a5e3769b00] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:29.216267 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f2bd771b-167c-4722-a1e1-9f884a99e2f9 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:29.217064 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f2bd771b-167c-4722-a1e1-9f884a99e2f9 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:29.217754 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f2bd771b-167c-4722-a1e1-9f884a99e2f9 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:29.218775 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f2bd771b-167c-4722-a1e1-9f884a99e2f9 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:29.219439 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f2bd771b-167c-4722-a1e1-9f884a99e2f9 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:29.220102 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f2bd771b-167c-4722-a1e1-9f884a99e2f9 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:29.823334 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f2bd771b-167c-4722-a1e1-9f884a99e2f9 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:29.837559 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f2bd771b-167c-4722-a1e1-9f884a99e2f9 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:29.850292 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f2bd771b-167c-4722-a1e1-9f884a99e2f9 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:29.852141 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f2bd771b-167c-4722-a1e1-9f884a99e2f9 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00" status: 200 len: 1815 microversion: 2.25 time: 0.676438 Aug 31 16:02:29.855170 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 896/1767] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:02:29 2022] GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00 => generated 1815 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:02:29.866695 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-d05990a8-9b42-4171-9269-8f8e5a1eefea req-2533629f-3e9b-4c0a-8fd9-694bc37efe27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efbe58d1-9726-4fa7-a7fb-f3cdc1b70ca4", "tag": "79a220dd-5cdb-47b6-bea1-c9cad9dc263f"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:02:29.898298 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-d05990a8-9b42-4171-9269-8f8e5a1eefea req-2533629f-3e9b-4c0a-8fd9-694bc37efe27 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:29.898799 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-d05990a8-9b42-4171-9269-8f8e5a1eefea req-2533629f-3e9b-4c0a-8fd9-694bc37efe27 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:29.900744 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-d05990a8-9b42-4171-9269-8f8e5a1eefea req-2533629f-3e9b-4c0a-8fd9-694bc37efe27 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:29.915651 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-d05990a8-9b42-4171-9269-8f8e5a1eefea req-2533629f-3e9b-4c0a-8fd9-694bc37efe27 service nova] Creating event network-changed:79a220dd-5cdb-47b6-bea1-c9cad9dc263f for instance efbe58d1-9726-4fa7-a7fb-f3cdc1b70ca4 on n-h1-850499-9 Aug 31 16:02:29.922901 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-d05990a8-9b42-4171-9269-8f8e5a1eefea req-2533629f-3e9b-4c0a-8fd9-694bc37efe27 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062029 Aug 31 16:02:29.923572 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 897/1768] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:02:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:02:29.930879 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-00786365-7d96-4830-bafc-3f23d4fd893e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:29.931646 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-00786365-7d96-4830-bafc-3f23d4fd893e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: efbe58d1-9726-4fa7-a7fb-f3cdc1b70ca4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:29.939805 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-00786365-7d96-4830-bafc-3f23d4fd893e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:29.940237 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-00786365-7d96-4830-bafc-3f23d4fd893e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:29.940669 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-00786365-7d96-4830-bafc-3f23d4fd893e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:29.941921 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-00786365-7d96-4830-bafc-3f23d4fd893e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:29.942388 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-00786365-7d96-4830-bafc-3f23d4fd893e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:29.942821 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-00786365-7d96-4830-bafc-3f23d4fd893e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:30.151833 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-00786365-7d96-4830-bafc-3f23d4fd893e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:30.176000 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-00786365-7d96-4830-bafc-3f23d4fd893e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/efbe58d1-9726-4fa7-a7fb-f3cdc1b70ca4" status: 200 len: 1318 microversion: 2.1 time: 0.250723 Aug 31 16:02:30.179175 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 898/1769] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:29 2022] GET /compute/v2.1/servers/efbe58d1-9726-4fa7-a7fb-f3cdc1b70ca4 => generated 1318 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:30.192921 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-30df9ce6-b04c-4037-936a-585c1c470a93 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:30.194868 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-30df9ce6-b04c-4037-936a-585c1c470a93 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6c7489e2-1ba0-4689-b2d7-e37886757266] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:30.246875 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-30df9ce6-b04c-4037-936a-585c1c470a93 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:30.248000 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-30df9ce6-b04c-4037-936a-585c1c470a93 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:30.248806 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-30df9ce6-b04c-4037-936a-585c1c470a93 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:30.255940 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-30df9ce6-b04c-4037-936a-585c1c470a93 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:30.256824 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-30df9ce6-b04c-4037-936a-585c1c470a93 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:30.263691 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-30df9ce6-b04c-4037-936a-585c1c470a93 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:30.571564 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-30df9ce6-b04c-4037-936a-585c1c470a93 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:30.591272 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-30df9ce6-b04c-4037-936a-585c1c470a93 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266" status: 200 len: 1473 microversion: 2.1 time: 0.407035 Aug 31 16:02:30.593465 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 899/1770] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:30 2022] GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266 => generated 1473 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:30.884425 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e824f88e-d7f0-474e-93a4-25bf54a31c11 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:30.885605 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e824f88e-d7f0-474e-93a4-25bf54a31c11 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 35b89015-3888-493a-b521-49a5e3769b00] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:30.891713 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3,nova_api:DELETE=6 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:02:30.910228 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e824f88e-d7f0-474e-93a4-25bf54a31c11 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:30.914548 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e824f88e-d7f0-474e-93a4-25bf54a31c11 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:30.915666 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e824f88e-d7f0-474e-93a4-25bf54a31c11 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:30.918418 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e824f88e-d7f0-474e-93a4-25bf54a31c11 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:30.919171 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e824f88e-d7f0-474e-93a4-25bf54a31c11 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:30.921929 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e824f88e-d7f0-474e-93a4-25bf54a31c11 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:31.370606 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e824f88e-d7f0-474e-93a4-25bf54a31c11 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:31.382735 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e824f88e-d7f0-474e-93a4-25bf54a31c11 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:31.397513 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e824f88e-d7f0-474e-93a4-25bf54a31c11 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:31.399468 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e824f88e-d7f0-474e-93a4-25bf54a31c11 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00" status: 200 len: 1815 microversion: 2.25 time: 0.519933 Aug 31 16:02:31.415417 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 900/1771] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:02:30 2022] GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00 => generated 1815 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:02:31.445096 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-564e4bfd-8bb7-4053-ad03-946c490fc945 req-ad11d617-1789-44e1-93ae-b2b3ca9a47c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65eb7e79-83ec-41c9-80f3-b8cac7369261", "name": "network-vif-plugged", "status": "completed", "tag": "05d541ce-2ca3-4539-b544-f59c6a407ca6"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:02:31.474725 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-564e4bfd-8bb7-4053-ad03-946c490fc945 req-ad11d617-1789-44e1-93ae-b2b3ca9a47c0 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:31.476085 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-564e4bfd-8bb7-4053-ad03-946c490fc945 req-ad11d617-1789-44e1-93ae-b2b3ca9a47c0 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:31.478515 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-564e4bfd-8bb7-4053-ad03-946c490fc945 req-ad11d617-1789-44e1-93ae-b2b3ca9a47c0 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:31.504014 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-564e4bfd-8bb7-4053-ad03-946c490fc945 req-ad11d617-1789-44e1-93ae-b2b3ca9a47c0 service nova] Creating event network-vif-plugged:05d541ce-2ca3-4539-b544-f59c6a407ca6 for instance 65eb7e79-83ec-41c9-80f3-b8cac7369261 on n-h1-850499-9 Aug 31 16:02:31.510306 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-564e4bfd-8bb7-4053-ad03-946c490fc945 req-ad11d617-1789-44e1-93ae-b2b3ca9a47c0 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091106 Aug 31 16:02:31.511419 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 901/1772] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:02:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:02:31.521073 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3aa0e7bd-3433-44e4-8d80-5bb233f56299 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:31.522052 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3aa0e7bd-3433-44e4-8d80-5bb233f56299 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: efbe58d1-9726-4fa7-a7fb-f3cdc1b70ca4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:31.529397 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3aa0e7bd-3433-44e4-8d80-5bb233f56299 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:31.530695 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3aa0e7bd-3433-44e4-8d80-5bb233f56299 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:31.531485 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3aa0e7bd-3433-44e4-8d80-5bb233f56299 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:31.532567 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3aa0e7bd-3433-44e4-8d80-5bb233f56299 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:31.533221 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3aa0e7bd-3433-44e4-8d80-5bb233f56299 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:31.534021 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3aa0e7bd-3433-44e4-8d80-5bb233f56299 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:31.796292 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3aa0e7bd-3433-44e4-8d80-5bb233f56299 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:31.813190 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3aa0e7bd-3433-44e4-8d80-5bb233f56299 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/efbe58d1-9726-4fa7-a7fb-f3cdc1b70ca4" status: 200 len: 1318 microversion: 2.1 time: 0.296294 Aug 31 16:02:31.817934 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 902/1773] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:31 2022] GET /compute/v2.1/servers/efbe58d1-9726-4fa7-a7fb-f3cdc1b70ca4 => generated 1318 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:31.831300 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-9ec3e9df-ee59-4e2d-9939-42cd4c642cf3 req-55082f98-d155-46e8-862e-51ca114a2fac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c7489e2-1ba0-4689-b2d7-e37886757266", "tag": "e136c42f-9bc1-433f-8e80-0837c9be0717"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:02:31.850924 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-9ec3e9df-ee59-4e2d-9939-42cd4c642cf3 req-55082f98-d155-46e8-862e-51ca114a2fac service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:31.851728 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-9ec3e9df-ee59-4e2d-9939-42cd4c642cf3 req-55082f98-d155-46e8-862e-51ca114a2fac service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:31.852340 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-9ec3e9df-ee59-4e2d-9939-42cd4c642cf3 req-55082f98-d155-46e8-862e-51ca114a2fac service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:31.865396 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-9ec3e9df-ee59-4e2d-9939-42cd4c642cf3 req-55082f98-d155-46e8-862e-51ca114a2fac service nova] Creating event network-changed:e136c42f-9bc1-433f-8e80-0837c9be0717 for instance 6c7489e2-1ba0-4689-b2d7-e37886757266 on n-h1-850499-9 Aug 31 16:02:31.872471 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [req-9ec3e9df-ee59-4e2d-9939-42cd4c642cf3 req-55082f98-d155-46e8-862e-51ca114a2fac service nova] Instance 6c7489e2-1ba0-4689-b2d7-e37886757266 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850499-9', 'n-h2-850499-9'} {{(pid=122256) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 31 16:02:31.886233 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-9ec3e9df-ee59-4e2d-9939-42cd4c642cf3 req-55082f98-d155-46e8-862e-51ca114a2fac service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065569 Aug 31 16:02:31.887406 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 903/1774] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:02:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:02:31.898210 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7a091b9e-7f1c-43bb-9b39-3f5a84f117e4 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:31.898649 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7a091b9e-7f1c-43bb-9b39-3f5a84f117e4 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6c7489e2-1ba0-4689-b2d7-e37886757266] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:31.905996 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7a091b9e-7f1c-43bb-9b39-3f5a84f117e4 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:31.906754 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7a091b9e-7f1c-43bb-9b39-3f5a84f117e4 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:31.907373 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7a091b9e-7f1c-43bb-9b39-3f5a84f117e4 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:31.908712 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7a091b9e-7f1c-43bb-9b39-3f5a84f117e4 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:31.909349 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7a091b9e-7f1c-43bb-9b39-3f5a84f117e4 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:31.909960 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7a091b9e-7f1c-43bb-9b39-3f5a84f117e4 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:32.299858 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7a091b9e-7f1c-43bb-9b39-3f5a84f117e4 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:32.324863 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7a091b9e-7f1c-43bb-9b39-3f5a84f117e4 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266" status: 200 len: 1473 microversion: 2.1 time: 0.432034 Aug 31 16:02:32.331349 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 904/1775] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:31 2022] GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266 => generated 1473 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:32.427873 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-64e70960-3c64-4557-a465-b6f38e166556 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:32.428612 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-64e70960-3c64-4557-a465-b6f38e166556 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 35b89015-3888-493a-b521-49a5e3769b00] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:32.440193 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-64e70960-3c64-4557-a465-b6f38e166556 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:32.442644 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-64e70960-3c64-4557-a465-b6f38e166556 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:32.444922 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-64e70960-3c64-4557-a465-b6f38e166556 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:32.446028 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-64e70960-3c64-4557-a465-b6f38e166556 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:32.456342 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-64e70960-3c64-4557-a465-b6f38e166556 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:32.459748 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-64e70960-3c64-4557-a465-b6f38e166556 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:32.955110 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-64e70960-3c64-4557-a465-b6f38e166556 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:32.970065 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-64e70960-3c64-4557-a465-b6f38e166556 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:32.973162 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-64e70960-3c64-4557-a465-b6f38e166556 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:32.980856 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-64e70960-3c64-4557-a465-b6f38e166556 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00" status: 200 len: 1815 microversion: 2.25 time: 0.557139 Aug 31 16:02:32.991970 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 905/1776] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:02:32 2022] GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00 => generated 1815 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:02:33.009691 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7c8b47e8-e67c-444b-8add-e82e06384ddb tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:33.010629 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7c8b47e8-e67c-444b-8add-e82e06384ddb tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: efbe58d1-9726-4fa7-a7fb-f3cdc1b70ca4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:33.021632 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7c8b47e8-e67c-444b-8add-e82e06384ddb tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:33.022443 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7c8b47e8-e67c-444b-8add-e82e06384ddb tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:33.023489 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7c8b47e8-e67c-444b-8add-e82e06384ddb tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:33.024469 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7c8b47e8-e67c-444b-8add-e82e06384ddb tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:33.025564 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7c8b47e8-e67c-444b-8add-e82e06384ddb tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:33.026206 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7c8b47e8-e67c-444b-8add-e82e06384ddb tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:33.397648 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=16 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:02:33.717559 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7c8b47e8-e67c-444b-8add-e82e06384ddb tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:33.740995 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7c8b47e8-e67c-444b-8add-e82e06384ddb tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/efbe58d1-9726-4fa7-a7fb-f3cdc1b70ca4" status: 200 len: 1318 microversion: 2.1 time: 0.727846 Aug 31 16:02:33.742379 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 906/1777] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:32 2022] GET /compute/v2.1/servers/efbe58d1-9726-4fa7-a7fb-f3cdc1b70ca4 => generated 1318 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:33.756013 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9ce56a96-bdc3-459d-8669-3b30afeb09ca tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:33.756926 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9ce56a96-bdc3-459d-8669-3b30afeb09ca tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6c7489e2-1ba0-4689-b2d7-e37886757266] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:33.770259 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9ce56a96-bdc3-459d-8669-3b30afeb09ca tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:33.771544 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9ce56a96-bdc3-459d-8669-3b30afeb09ca tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:33.772212 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9ce56a96-bdc3-459d-8669-3b30afeb09ca tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:33.773148 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9ce56a96-bdc3-459d-8669-3b30afeb09ca tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:33.773915 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9ce56a96-bdc3-459d-8669-3b30afeb09ca tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:33.774514 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9ce56a96-bdc3-459d-8669-3b30afeb09ca tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:33.954422 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-9ce56a96-bdc3-459d-8669-3b30afeb09ca tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:33.966337 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9ce56a96-bdc3-459d-8669-3b30afeb09ca tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266" status: 200 len: 1470 microversion: 2.1 time: 0.222616 Aug 31 16:02:33.966997 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 907/1778] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:33 2022] GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266 => generated 1470 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:33.988936 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-af8819af-3285-4f70-b3db-54d78e7c2adb tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:02:33.989727 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-af8819af-3285-4f70-b3db-54d78e7c2adb tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6c7489e2-1ba0-4689-b2d7-e37886757266] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:33.997011 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-af8819af-3285-4f70-b3db-54d78e7c2adb tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:33.997584 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-af8819af-3285-4f70-b3db-54d78e7c2adb tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:33.998271 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-af8819af-3285-4f70-b3db-54d78e7c2adb tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:33.999069 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-af8819af-3285-4f70-b3db-54d78e7c2adb tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:33.999991 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-af8819af-3285-4f70-b3db-54d78e7c2adb tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:34.000902 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-af8819af-3285-4f70-b3db-54d78e7c2adb tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:34.042368 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=100 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:02:34.094443 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-af8819af-3285-4f70-b3db-54d78e7c2adb tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "POST /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266/action" status: 204 len: 0 microversion: 2.1 time: 0.109011 Aug 31 16:02:34.098854 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 908/1779] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:02:33 2022] POST /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266/action => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:02:34.124853 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-73b2f141-558d-45ac-a728-99833d2ead68 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:34.125978 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-73b2f141-558d-45ac-a728-99833d2ead68 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 35b89015-3888-493a-b521-49a5e3769b00] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:34.157764 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-73b2f141-558d-45ac-a728-99833d2ead68 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:34.158384 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-73b2f141-558d-45ac-a728-99833d2ead68 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:34.160485 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-73b2f141-558d-45ac-a728-99833d2ead68 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:34.161297 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-73b2f141-558d-45ac-a728-99833d2ead68 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:34.162596 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-73b2f141-558d-45ac-a728-99833d2ead68 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:34.164271 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-73b2f141-558d-45ac-a728-99833d2ead68 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:34.300545 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=64 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:02:34.607732 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-73b2f141-558d-45ac-a728-99833d2ead68 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:34.629928 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-73b2f141-558d-45ac-a728-99833d2ead68 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:34.637010 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-73b2f141-558d-45ac-a728-99833d2ead68 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:34.638850 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-73b2f141-558d-45ac-a728-99833d2ead68 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00" status: 200 len: 1815 microversion: 2.25 time: 0.538553 Aug 31 16:02:34.640639 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 909/1780] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:02:34 2022] GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00 => generated 1815 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:02:34.647604 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e32818c0-2e39-43cd-af66-8f1f74b424b5 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:34.648738 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e32818c0-2e39-43cd-af66-8f1f74b424b5 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6c7489e2-1ba0-4689-b2d7-e37886757266] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:34.667835 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e32818c0-2e39-43cd-af66-8f1f74b424b5 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:34.675517 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e32818c0-2e39-43cd-af66-8f1f74b424b5 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:34.676768 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e32818c0-2e39-43cd-af66-8f1f74b424b5 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:34.679306 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e32818c0-2e39-43cd-af66-8f1f74b424b5 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:34.679991 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e32818c0-2e39-43cd-af66-8f1f74b424b5 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:34.680598 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e32818c0-2e39-43cd-af66-8f1f74b424b5 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:34.946623 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e32818c0-2e39-43cd-af66-8f1f74b424b5 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:34.959375 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e32818c0-2e39-43cd-af66-8f1f74b424b5 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266" status: 200 len: 1470 microversion: 2.1 time: 0.317183 Aug 31 16:02:34.961136 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 910/1781] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:34 2022] GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266 => generated 1470 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:34.971142 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-660a631b-8448-45d1-8e34-085877ab2ab8 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:34.971804 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-660a631b-8448-45d1-8e34-085877ab2ab8 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: efbe58d1-9726-4fa7-a7fb-f3cdc1b70ca4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:34.993272 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-660a631b-8448-45d1-8e34-085877ab2ab8 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:34.993912 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-660a631b-8448-45d1-8e34-085877ab2ab8 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:34.994401 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-660a631b-8448-45d1-8e34-085877ab2ab8 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:34.995214 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-660a631b-8448-45d1-8e34-085877ab2ab8 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:34.995776 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-660a631b-8448-45d1-8e34-085877ab2ab8 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:34.996299 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-660a631b-8448-45d1-8e34-085877ab2ab8 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:35.245757 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-43d5a159-1bac-4b30-82fd-921f09350e9d tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/images/34d69a63-c14a-4d91-9d9f-38bc5d717b66" status: 200 len: 1422 microversion: 2.1 time: 9.784048 Aug 31 16:02:35.249000 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 872/1782] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:02:25 2022] GET /compute/v2.1/images/34d69a63-c14a-4d91-9d9f-38bc5d717b66 => generated 1422 bytes in 9787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:35.269421 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-468107da-4584-47f4-89eb-f0a008dca6e2 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '.version_select at 0x7f5aed121160>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:35.392061 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-468107da-4584-47f4-89eb-f0a008dca6e2 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/images/34d69a63-c14a-4d91-9d9f-38bc5d717b66" status: 200 len: 1422 microversion: 2.1 time: 0.134493 Aug 31 16:02:35.401038 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 873/1783] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:02:35 2022] GET /compute/v2.1/images/34d69a63-c14a-4d91-9d9f-38bc5d717b66 => generated 1422 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:35.413856 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-fb014caf-bc9c-4ccc-8858-bec43eaa4a0f tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '.version_select at 0x7f5aed0f13a0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:35.428990 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=50 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:02:35.449933 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=42,nova_api:DELETE=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:02:35.743900 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-660a631b-8448-45d1-8e34-085877ab2ab8 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:35.755192 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-660a631b-8448-45d1-8e34-085877ab2ab8 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/efbe58d1-9726-4fa7-a7fb-f3cdc1b70ca4" status: 200 len: 1318 microversion: 2.1 time: 0.792892 Aug 31 16:02:35.758996 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 911/1784] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:34 2022] GET /compute/v2.1/servers/efbe58d1-9726-4fa7-a7fb-f3cdc1b70ca4 => generated 1318 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:35.766838 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e49fbbad-4af9-4e8b-bf1f-7c7bd76d64c1 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:35.767811 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e49fbbad-4af9-4e8b-bf1f-7c7bd76d64c1 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 35b89015-3888-493a-b521-49a5e3769b00] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:35.792325 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e49fbbad-4af9-4e8b-bf1f-7c7bd76d64c1 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:35.794081 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e49fbbad-4af9-4e8b-bf1f-7c7bd76d64c1 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:35.796221 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e49fbbad-4af9-4e8b-bf1f-7c7bd76d64c1 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:35.797624 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e49fbbad-4af9-4e8b-bf1f-7c7bd76d64c1 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:35.798282 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e49fbbad-4af9-4e8b-bf1f-7c7bd76d64c1 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:35.799614 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e49fbbad-4af9-4e8b-bf1f-7c7bd76d64c1 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:36.303428 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e49fbbad-4af9-4e8b-bf1f-7c7bd76d64c1 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:36.325731 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-fb014caf-bc9c-4ccc-8858-bec43eaa4a0f tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "DELETE /compute/v2.1/images/34d69a63-c14a-4d91-9d9f-38bc5d717b66" status: 204 len: 0 microversion: 2.1 time: 0.916373 Aug 31 16:02:36.326858 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 874/1785] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:35 2022] DELETE /compute/v2.1/images/34d69a63-c14a-4d91-9d9f-38bc5d717b66 => generated 0 bytes in 918 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:02:36.337243 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3a7d797f-ee24-42a1-9f70-01ef73893368 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:36.337928 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3a7d797f-ee24-42a1-9f70-01ef73893368 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6c7489e2-1ba0-4689-b2d7-e37886757266] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:36.343714 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e49fbbad-4af9-4e8b-bf1f-7c7bd76d64c1 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:36.345201 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e49fbbad-4af9-4e8b-bf1f-7c7bd76d64c1 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:36.346419 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e49fbbad-4af9-4e8b-bf1f-7c7bd76d64c1 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00" status: 200 len: 1815 microversion: 2.25 time: 0.584721 Aug 31 16:02:36.346992 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 912/1786] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:02:35 2022] GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00 => generated 1815 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:02:36.369002 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3a7d797f-ee24-42a1-9f70-01ef73893368 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:36.369549 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3a7d797f-ee24-42a1-9f70-01ef73893368 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:36.369997 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3a7d797f-ee24-42a1-9f70-01ef73893368 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:36.378398 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3a7d797f-ee24-42a1-9f70-01ef73893368 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:36.384757 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3a7d797f-ee24-42a1-9f70-01ef73893368 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:36.391767 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3a7d797f-ee24-42a1-9f70-01ef73893368 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:36.394385 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-77a15b4a-66c0-4e3f-93ee-3483af6f612c tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:36.394902 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-77a15b4a-66c0-4e3f-93ee-3483af6f612c tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: 3f785545-d532-4487-b780-8a9be107a209] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:36.421839 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-77a15b4a-66c0-4e3f-93ee-3483af6f612c tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:36.421839 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-77a15b4a-66c0-4e3f-93ee-3483af6f612c tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:36.421839 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-77a15b4a-66c0-4e3f-93ee-3483af6f612c tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:36.429590 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-77a15b4a-66c0-4e3f-93ee-3483af6f612c tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:36.430061 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-77a15b4a-66c0-4e3f-93ee-3483af6f612c tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:36.430498 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-77a15b4a-66c0-4e3f-93ee-3483af6f612c tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:36.522113 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-77a15b4a-66c0-4e3f-93ee-3483af6f612c tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: 3f785545-d532-4487-b780-8a9be107a209] Going to try to terminate instance {{(pid=122256) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:02:36.727200 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-77a15b4a-66c0-4e3f-93ee-3483af6f612c tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "DELETE /compute/v2.1/servers/3f785545-d532-4487-b780-8a9be107a209" status: 204 len: 0 microversion: 2.1 time: 0.378935 Aug 31 16:02:36.736115 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 913/1787] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:02:36 2022] DELETE /compute/v2.1/servers/3f785545-d532-4487-b780-8a9be107a209 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:02:36.761104 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3a7d797f-ee24-42a1-9f70-01ef73893368 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:36.774485 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3a7d797f-ee24-42a1-9f70-01ef73893368 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266" status: 200 len: 1470 microversion: 2.1 time: 0.445679 Aug 31 16:02:36.776558 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 875/1788] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:36 2022] GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266 => generated 1470 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:36.789727 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7beebecd-ef2b-434a-a400-8205f33e0af3 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:36.790437 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7beebecd-ef2b-434a-a400-8205f33e0af3 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: efbe58d1-9726-4fa7-a7fb-f3cdc1b70ca4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:36.800527 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7beebecd-ef2b-434a-a400-8205f33e0af3 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:36.801456 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7beebecd-ef2b-434a-a400-8205f33e0af3 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:36.802091 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7beebecd-ef2b-434a-a400-8205f33e0af3 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:36.803029 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7beebecd-ef2b-434a-a400-8205f33e0af3 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:36.803741 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7beebecd-ef2b-434a-a400-8205f33e0af3 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:36.804389 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7beebecd-ef2b-434a-a400-8205f33e0af3 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:37.018264 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9af0464b-c8c5-4230-a21e-61ab32a10a54 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-885841919", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "networks": [{"uuid": "1815935f-c9a0-4f0c-9c89-45f534415ab2"}]}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:02:37.048090 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7beebecd-ef2b-434a-a400-8205f33e0af3 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:37.068098 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7beebecd-ef2b-434a-a400-8205f33e0af3 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/efbe58d1-9726-4fa7-a7fb-f3cdc1b70ca4" status: 200 len: 1318 microversion: 2.1 time: 0.286977 Aug 31 16:02:37.073477 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 914/1789] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:36 2022] GET /compute/v2.1/servers/efbe58d1-9726-4fa7-a7fb-f3cdc1b70ca4 => generated 1318 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:37.129488 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-9af0464b-c8c5-4230-a21e-61ab32a10a54 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] validate_networks() for [('1815935f-c9a0-4f0c-9c89-45f534415ab2', None, None, None, None, None)] {{(pid=122257) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:02:37.382048 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9dc6f80f-0689-4f14-93cc-7cd75a00796f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:37.383323 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9dc6f80f-0689-4f14-93cc-7cd75a00796f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 35b89015-3888-493a-b521-49a5e3769b00] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:37.417014 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9dc6f80f-0689-4f14-93cc-7cd75a00796f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:37.420056 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9dc6f80f-0689-4f14-93cc-7cd75a00796f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:37.421670 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9dc6f80f-0689-4f14-93cc-7cd75a00796f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:37.423720 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9dc6f80f-0689-4f14-93cc-7cd75a00796f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:37.425221 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9dc6f80f-0689-4f14-93cc-7cd75a00796f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:37.426069 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9dc6f80f-0689-4f14-93cc-7cd75a00796f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:38.052405 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-9af0464b-c8c5-4230-a21e-61ab32a10a54 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:02:38.053399 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-9af0464b-c8c5-4230-a21e-61ab32a10a54 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:02:38.055297 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-9af0464b-c8c5-4230-a21e-61ab32a10a54 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:02:38.056047 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-9af0464b-c8c5-4230-a21e-61ab32a10a54 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:02:38.056653 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-9af0464b-c8c5-4230-a21e-61ab32a10a54 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:02:38.076711 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9af0464b-c8c5-4230-a21e-61ab32a10a54 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:38.080332 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9af0464b-c8c5-4230-a21e-61ab32a10a54 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:38.081607 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9af0464b-c8c5-4230-a21e-61ab32a10a54 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:38.083373 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9af0464b-c8c5-4230-a21e-61ab32a10a54 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:38.084981 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9af0464b-c8c5-4230-a21e-61ab32a10a54 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:38.087217 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9af0464b-c8c5-4230-a21e-61ab32a10a54 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:38.094882 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-9dc6f80f-0689-4f14-93cc-7cd75a00796f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:38.112720 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-9dc6f80f-0689-4f14-93cc-7cd75a00796f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:38.114983 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-9dc6f80f-0689-4f14-93cc-7cd75a00796f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:38.116448 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9dc6f80f-0689-4f14-93cc-7cd75a00796f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00" status: 200 len: 1815 microversion: 2.25 time: 0.741208 Aug 31 16:02:38.123332 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 915/1790] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:02:37 2022] GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00 => generated 1815 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:02:38.145594 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d3de277b-ce85-4ca6-a51b-301e6b4f3550 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:38.146674 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d3de277b-ce85-4ca6-a51b-301e6b4f3550 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6c7489e2-1ba0-4689-b2d7-e37886757266] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:38.164557 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-9af0464b-c8c5-4230-a21e-61ab32a10a54 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Getting quotas for project 61a9f3fcc4b445349e5c66ff712e8598. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:02:38.165295 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d3de277b-ce85-4ca6-a51b-301e6b4f3550 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:38.167325 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d3de277b-ce85-4ca6-a51b-301e6b4f3550 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:38.167855 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d3de277b-ce85-4ca6-a51b-301e6b4f3550 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:38.169460 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d3de277b-ce85-4ca6-a51b-301e6b4f3550 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:38.183933 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-9af0464b-c8c5-4230-a21e-61ab32a10a54 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Getting quotas for user f1ccd03a4aa84f93bc26b438e1468f46 and project 61a9f3fcc4b445349e5c66ff712e8598. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:02:38.184476 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d3de277b-ce85-4ca6-a51b-301e6b4f3550 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:38.184946 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d3de277b-ce85-4ca6-a51b-301e6b4f3550 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:38.216726 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9af0464b-c8c5-4230-a21e-61ab32a10a54 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Going to run 1 instances... {{(pid=122257) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:02:38.225687 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9af0464b-c8c5-4230-a21e-61ab32a10a54 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: cafdad7c-e670-48df-8c07-a2405d19f357] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:02:38.397564 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9af0464b-c8c5-4230-a21e-61ab32a10a54 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.384215 Aug 31 16:02:38.408840 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 876/1791] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:02:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1396 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 16:02:38.425673 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-77bf7a5c-236a-4e26-a459-f266cbe17852 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:38.426722 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-77bf7a5c-236a-4e26-a459-f266cbe17852 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: efbe58d1-9726-4fa7-a7fb-f3cdc1b70ca4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:38.435999 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-77bf7a5c-236a-4e26-a459-f266cbe17852 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:38.441780 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-77bf7a5c-236a-4e26-a459-f266cbe17852 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:38.444331 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-77bf7a5c-236a-4e26-a459-f266cbe17852 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:38.445327 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-77bf7a5c-236a-4e26-a459-f266cbe17852 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:38.446754 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-77bf7a5c-236a-4e26-a459-f266cbe17852 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:38.473153 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-77bf7a5c-236a-4e26-a459-f266cbe17852 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:38.599668 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d3de277b-ce85-4ca6-a51b-301e6b4f3550 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:38.619730 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d3de277b-ce85-4ca6-a51b-301e6b4f3550 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266" status: 200 len: 1462 microversion: 2.1 time: 0.492149 Aug 31 16:02:38.620540 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 916/1792] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:38 2022] GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266 => generated 1462 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:38.640883 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a921b025-e63f-4458-af24-91881cacd736 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:38.649379 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a921b025-e63f-4458-af24-91881cacd736 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: cafdad7c-e670-48df-8c07-a2405d19f357] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:38.893138 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a921b025-e63f-4458-af24-91881cacd736 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ccd03a4aa84f93bc26b438e1468f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a9f3fcc4b445349e5c66ff712e8598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:38.906266 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a921b025-e63f-4458-af24-91881cacd736 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/servers/cafdad7c-e670-48df-8c07-a2405d19f357" status: 200 len: 1207 microversion: 2.1 time: 0.280840 Aug 31 16:02:38.906874 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 917/1793] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:38 2022] GET /compute/v2.1/servers/cafdad7c-e670-48df-8c07-a2405d19f357 => generated 1207 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:38.916310 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-96086c30-fc7e-4af1-8670-375cf075fafa req-4a2d49e3-546b-4cca-8da5-3d8793a41cfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c7489e2-1ba0-4689-b2d7-e37886757266", "name": "network-vif-plugged", "status": "completed", "tag": "e136c42f-9bc1-433f-8e80-0837c9be0717"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:02:38.953920 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-96086c30-fc7e-4af1-8670-375cf075fafa req-4a2d49e3-546b-4cca-8da5-3d8793a41cfe service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:38.955309 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-96086c30-fc7e-4af1-8670-375cf075fafa req-4a2d49e3-546b-4cca-8da5-3d8793a41cfe service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:38.956805 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-96086c30-fc7e-4af1-8670-375cf075fafa req-4a2d49e3-546b-4cca-8da5-3d8793a41cfe service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:38.980133 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-96086c30-fc7e-4af1-8670-375cf075fafa req-4a2d49e3-546b-4cca-8da5-3d8793a41cfe service nova] Creating event network-vif-plugged:e136c42f-9bc1-433f-8e80-0837c9be0717 for instance 6c7489e2-1ba0-4689-b2d7-e37886757266 on n-h1-850499-9 Aug 31 16:02:38.992529 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-96086c30-fc7e-4af1-8670-375cf075fafa req-4a2d49e3-546b-4cca-8da5-3d8793a41cfe service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084396 Aug 31 16:02:39.009244 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 918/1794] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:02:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:02:39.032161 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-fa1f420c-fe83-4751-a911-02cdead70765 tempest-MigrationsAdminTest-62329235 tempest-MigrationsAdminTest-62329235-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:39.039174 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-fa1f420c-fe83-4751-a911-02cdead70765 tempest-MigrationsAdminTest-62329235 tempest-MigrationsAdminTest-62329235-project-admin] [instance: 6c7489e2-1ba0-4689-b2d7-e37886757266] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:39.058309 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fa1f420c-fe83-4751-a911-02cdead70765 tempest-MigrationsAdminTest-62329235 tempest-MigrationsAdminTest-62329235-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:39.059147 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fa1f420c-fe83-4751-a911-02cdead70765 tempest-MigrationsAdminTest-62329235 tempest-MigrationsAdminTest-62329235-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:39.059811 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fa1f420c-fe83-4751-a911-02cdead70765 tempest-MigrationsAdminTest-62329235 tempest-MigrationsAdminTest-62329235-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:39.061237 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fa1f420c-fe83-4751-a911-02cdead70765 tempest-MigrationsAdminTest-62329235 tempest-MigrationsAdminTest-62329235-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:39.062780 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fa1f420c-fe83-4751-a911-02cdead70765 tempest-MigrationsAdminTest-62329235 tempest-MigrationsAdminTest-62329235-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:39.064200 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fa1f420c-fe83-4751-a911-02cdead70765 tempest-MigrationsAdminTest-62329235 tempest-MigrationsAdminTest-62329235-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:39.496627 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-77bf7a5c-236a-4e26-a459-f266cbe17852 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:39.506410 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-77bf7a5c-236a-4e26-a459-f266cbe17852 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/efbe58d1-9726-4fa7-a7fb-f3cdc1b70ca4" status: 200 len: 1318 microversion: 2.1 time: 1.095760 Aug 31 16:02:39.507011 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 877/1795] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:38 2022] GET /compute/v2.1/servers/efbe58d1-9726-4fa7-a7fb-f3cdc1b70ca4 => generated 1318 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:39.528396 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5273239d-a978-4f86-b211-a1161e1ea942 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:39.529012 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5273239d-a978-4f86-b211-a1161e1ea942 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 35b89015-3888-493a-b521-49a5e3769b00] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:39.551311 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5273239d-a978-4f86-b211-a1161e1ea942 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:39.552119 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5273239d-a978-4f86-b211-a1161e1ea942 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:39.552732 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5273239d-a978-4f86-b211-a1161e1ea942 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:39.560795 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5273239d-a978-4f86-b211-a1161e1ea942 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:39.561606 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5273239d-a978-4f86-b211-a1161e1ea942 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:39.562218 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5273239d-a978-4f86-b211-a1161e1ea942 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:39.838999 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-fa1f420c-fe83-4751-a911-02cdead70765 tempest-MigrationsAdminTest-62329235 tempest-MigrationsAdminTest-62329235-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266" status: 200 len: 1613 microversion: 2.1 time: 0.828186 Aug 31 16:02:39.849713 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 919/1796] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:39 2022] GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266 => generated 1613 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:39.869053 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a0f3b03e-8587-4412-aad1-3c8bab7ee188 tempest-MigrationsAdminTest-62329235 tempest-MigrationsAdminTest-62329235-project-admin] Calling method '.version_select at 0x7f5aed2ecee0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:39.872864 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a0f3b03e-8587-4412-aad1-3c8bab7ee188 tempest-MigrationsAdminTest-62329235 tempest-MigrationsAdminTest-62329235-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:39.891141 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a0f3b03e-8587-4412-aad1-3c8bab7ee188 tempest-MigrationsAdminTest-62329235 tempest-MigrationsAdminTest-62329235-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:39.896700 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a0f3b03e-8587-4412-aad1-3c8bab7ee188 tempest-MigrationsAdminTest-62329235 tempest-MigrationsAdminTest-62329235-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:39.928910 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a0f3b03e-8587-4412-aad1-3c8bab7ee188 tempest-MigrationsAdminTest-62329235 tempest-MigrationsAdminTest-62329235-project-admin] 10.222.0.61 "GET /compute/v2.1/os-migrations" status: 200 len: 2711 microversion: 2.1 time: 0.063775 Aug 31 16:02:39.931772 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 920/1797] 10.222.0.61 () {58 vars in 1143 bytes} [Wed Aug 31 16:02:39 2022] GET /compute/v2.1/os-migrations => generated 2711 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:39.937506 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-31525d56-3d65-4736-9470-6f8a2b970ef7 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:39.944465 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-31525d56-3d65-4736-9470-6f8a2b970ef7 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: cafdad7c-e670-48df-8c07-a2405d19f357] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:39.972384 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-31525d56-3d65-4736-9470-6f8a2b970ef7 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:39.973201 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-31525d56-3d65-4736-9470-6f8a2b970ef7 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:39.973919 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-31525d56-3d65-4736-9470-6f8a2b970ef7 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:39.974874 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-31525d56-3d65-4736-9470-6f8a2b970ef7 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:39.975793 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-31525d56-3d65-4736-9470-6f8a2b970ef7 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:39.976245 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-31525d56-3d65-4736-9470-6f8a2b970ef7 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:40.051834 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5273239d-a978-4f86-b211-a1161e1ea942 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:40.062053 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5273239d-a978-4f86-b211-a1161e1ea942 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:40.063492 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5273239d-a978-4f86-b211-a1161e1ea942 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:40.079470 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5273239d-a978-4f86-b211-a1161e1ea942 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00" status: 200 len: 1815 microversion: 2.25 time: 0.555120 Aug 31 16:02:40.115479 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 878/1798] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:02:39 2022] GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00 => generated 1815 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:02:40.240677 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f68d1cd5-eead-407c-9f62-709dc218544e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-657989466", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:02:40.264880 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-31525d56-3d65-4736-9470-6f8a2b970ef7 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ccd03a4aa84f93bc26b438e1468f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a9f3fcc4b445349e5c66ff712e8598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:40.274425 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-31525d56-3d65-4736-9470-6f8a2b970ef7 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/servers/cafdad7c-e670-48df-8c07-a2405d19f357" status: 200 len: 1203 microversion: 2.1 time: 0.341315 Aug 31 16:02:40.275001 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 921/1799] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:39 2022] GET /compute/v2.1/servers/cafdad7c-e670-48df-8c07-a2405d19f357 => generated 1203 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:40.343862 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-f68d1cd5-eead-407c-9f62-709dc218544e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] validate_networks() for None {{(pid=122257) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:02:40.533178 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b5007e74-84aa-4fd5-8dc3-a1b1e0429bd1 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:40.533640 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b5007e74-84aa-4fd5-8dc3-a1b1e0429bd1 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: efbe58d1-9726-4fa7-a7fb-f3cdc1b70ca4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:40.543053 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b5007e74-84aa-4fd5-8dc3-a1b1e0429bd1 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:40.556264 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b5007e74-84aa-4fd5-8dc3-a1b1e0429bd1 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:40.556893 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b5007e74-84aa-4fd5-8dc3-a1b1e0429bd1 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:40.557656 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b5007e74-84aa-4fd5-8dc3-a1b1e0429bd1 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:40.558120 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b5007e74-84aa-4fd5-8dc3-a1b1e0429bd1 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:40.566768 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b5007e74-84aa-4fd5-8dc3-a1b1e0429bd1 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:41.392521 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b5007e74-84aa-4fd5-8dc3-a1b1e0429bd1 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:41.404287 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b5007e74-84aa-4fd5-8dc3-a1b1e0429bd1 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/efbe58d1-9726-4fa7-a7fb-f3cdc1b70ca4" status: 200 len: 1318 microversion: 2.1 time: 0.875633 Aug 31 16:02:41.408352 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 922/1800] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:40 2022] GET /compute/v2.1/servers/efbe58d1-9726-4fa7-a7fb-f3cdc1b70ca4 => generated 1318 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:41.417119 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ab68a4ea-2cb1-4760-83f4-d4be2e0a664c tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:41.419082 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ab68a4ea-2cb1-4760-83f4-d4be2e0a664c tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 35b89015-3888-493a-b521-49a5e3769b00] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:41.438408 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ab68a4ea-2cb1-4760-83f4-d4be2e0a664c tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:41.439193 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ab68a4ea-2cb1-4760-83f4-d4be2e0a664c tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:41.439871 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ab68a4ea-2cb1-4760-83f4-d4be2e0a664c tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:41.440787 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ab68a4ea-2cb1-4760-83f4-d4be2e0a664c tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:41.444199 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ab68a4ea-2cb1-4760-83f4-d4be2e0a664c tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:41.445250 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ab68a4ea-2cb1-4760-83f4-d4be2e0a664c tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:41.505525 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-f68d1cd5-eead-407c-9f62-709dc218544e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:02:41.505999 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-f68d1cd5-eead-407c-9f62-709dc218544e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:02:41.506400 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-f68d1cd5-eead-407c-9f62-709dc218544e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:02:41.507004 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-f68d1cd5-eead-407c-9f62-709dc218544e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:02:41.507636 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-f68d1cd5-eead-407c-9f62-709dc218544e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:02:41.537536 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f68d1cd5-eead-407c-9f62-709dc218544e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:41.544493 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f68d1cd5-eead-407c-9f62-709dc218544e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:41.545290 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f68d1cd5-eead-407c-9f62-709dc218544e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:41.546941 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f68d1cd5-eead-407c-9f62-709dc218544e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:41.547815 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f68d1cd5-eead-407c-9f62-709dc218544e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:41.548483 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f68d1cd5-eead-407c-9f62-709dc218544e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:41.586097 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-f68d1cd5-eead-407c-9f62-709dc218544e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Getting quotas for project 55ea476c41904e458bae79e7dad5d654. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:02:41.599112 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-f68d1cd5-eead-407c-9f62-709dc218544e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Getting quotas for user 0a552442b7e94406b1689baf7a23fa52 and project 55ea476c41904e458bae79e7dad5d654. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:02:41.629341 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f68d1cd5-eead-407c-9f62-709dc218544e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Going to run 1 instances... {{(pid=122257) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:02:41.646361 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f68d1cd5-eead-407c-9f62-709dc218544e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6e82c98f-d644-4464-aca0-13901e551aa4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:02:41.745798 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f68d1cd5-eead-407c-9f62-709dc218544e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.507325 Aug 31 16:02:41.752587 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 879/1801] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:02:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1517 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 16:02:41.763745 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0254dcd4-0dcb-4fb8-98bb-a291920c6831 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:41.767350 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0254dcd4-0dcb-4fb8-98bb-a291920c6831 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: cafdad7c-e670-48df-8c07-a2405d19f357] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:41.785047 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0254dcd4-0dcb-4fb8-98bb-a291920c6831 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:41.785550 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0254dcd4-0dcb-4fb8-98bb-a291920c6831 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:41.785991 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0254dcd4-0dcb-4fb8-98bb-a291920c6831 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:41.786702 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0254dcd4-0dcb-4fb8-98bb-a291920c6831 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:41.787866 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0254dcd4-0dcb-4fb8-98bb-a291920c6831 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:41.788346 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0254dcd4-0dcb-4fb8-98bb-a291920c6831 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:41.811034 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ab68a4ea-2cb1-4760-83f4-d4be2e0a664c tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:41.822482 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ab68a4ea-2cb1-4760-83f4-d4be2e0a664c tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:41.824430 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ab68a4ea-2cb1-4760-83f4-d4be2e0a664c tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:41.826163 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ab68a4ea-2cb1-4760-83f4-d4be2e0a664c tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00" status: 200 len: 1805 microversion: 2.25 time: 0.416609 Aug 31 16:02:41.840599 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 923/1802] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:02:41 2022] GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00 => generated 1805 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:02:41.853870 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-8c07b642-0d95-4a87-b6a9-266dcf8b0f6e req-a93f6987-9497-4d43-a914-a14da1532f33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f785545-d532-4487-b780-8a9be107a209", "name": "network-vif-deleted", "tag": "52b6863f-3e1f-464d-9a16-40e07fe4f7c7"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:02:41.867616 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-8c07b642-0d95-4a87-b6a9-266dcf8b0f6e req-a93f6987-9497-4d43-a914-a14da1532f33 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:41.868319 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-8c07b642-0d95-4a87-b6a9-266dcf8b0f6e req-a93f6987-9497-4d43-a914-a14da1532f33 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:41.868978 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-8c07b642-0d95-4a87-b6a9-266dcf8b0f6e req-a93f6987-9497-4d43-a914-a14da1532f33 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:41.913461 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-8c07b642-0d95-4a87-b6a9-266dcf8b0f6e req-a93f6987-9497-4d43-a914-a14da1532f33 service nova] Creating event network-vif-deleted:52b6863f-3e1f-464d-9a16-40e07fe4f7c7 for instance 3f785545-d532-4487-b780-8a9be107a209 on n-h1-850499-9 Aug 31 16:02:41.930300 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-8c07b642-0d95-4a87-b6a9-266dcf8b0f6e req-a93f6987-9497-4d43-a914-a14da1532f33 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084758 Aug 31 16:02:41.934184 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 924/1803] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:02:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:02:41.958864 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-05e2442f-3cb6-49f6-9e97-d236b30ed5f9 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:41.960210 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-05e2442f-3cb6-49f6-9e97-d236b30ed5f9 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6e82c98f-d644-4464-aca0-13901e551aa4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:41.970246 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0254dcd4-0dcb-4fb8-98bb-a291920c6831 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ccd03a4aa84f93bc26b438e1468f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a9f3fcc4b445349e5c66ff712e8598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:41.986350 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0254dcd4-0dcb-4fb8-98bb-a291920c6831 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/servers/cafdad7c-e670-48df-8c07-a2405d19f357" status: 200 len: 1265 microversion: 2.1 time: 0.232528 Aug 31 16:02:41.986948 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 880/1804] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:41 2022] GET /compute/v2.1/servers/cafdad7c-e670-48df-8c07-a2405d19f357 => generated 1265 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:41.999862 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6404129e-6c9d-4d50-b8b4-e7c77cba82fd tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Calling method '.version_select at 0x7f5aed2c7d30>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:42.005882 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6404129e-6c9d-4d50-b8b4-e7c77cba82fd tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:42.006381 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6404129e-6c9d-4d50-b8b4-e7c77cba82fd tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:42.006829 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6404129e-6c9d-4d50-b8b4-e7c77cba82fd tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:42.026682 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6404129e-6c9d-4d50-b8b4-e7c77cba82fd tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] 10.222.0.61 "GET /compute/v2.1/os-migrations" status: 200 len: 3204 microversion: 2.25 time: 0.038600 Aug 31 16:02:42.027303 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 881/1805] 10.222.0.61 () {60 vars in 1184 bytes} [Wed Aug 31 16:02:41 2022] GET /compute/v2.1/os-migrations => generated 3204 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:02:42.047023 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-72ccfda8-6773-4c24-ac59-1121ee9acbfb tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:42.049707 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-72ccfda8-6773-4c24-ac59-1121ee9acbfb tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] [instance: 35b89015-3888-493a-b521-49a5e3769b00] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:42.066676 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-72ccfda8-6773-4c24-ac59-1121ee9acbfb tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:42.067392 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-72ccfda8-6773-4c24-ac59-1121ee9acbfb tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:42.068040 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-72ccfda8-6773-4c24-ac59-1121ee9acbfb tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:42.071274 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-72ccfda8-6773-4c24-ac59-1121ee9acbfb tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:42.085370 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-72ccfda8-6773-4c24-ac59-1121ee9acbfb tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:42.096142 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-05e2442f-3cb6-49f6-9e97-d236b30ed5f9 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:42.097421 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-72ccfda8-6773-4c24-ac59-1121ee9acbfb tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:42.111100 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-05e2442f-3cb6-49f6-9e97-d236b30ed5f9 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4" status: 200 len: 1212 microversion: 2.1 time: 0.165981 Aug 31 16:02:42.113243 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 925/1806] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:41 2022] GET /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4 => generated 1212 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:42.353585 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a379d86a-814d-4f21-8913-60e784c84e3f tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:42.354764 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a379d86a-814d-4f21-8913-60e784c84e3f tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] [instance: 39a531e3-b13b-412f-a200-5141c32650be] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:42.371646 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a379d86a-814d-4f21-8913-60e784c84e3f tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:42.374013 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a379d86a-814d-4f21-8913-60e784c84e3f tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:42.376565 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a379d86a-814d-4f21-8913-60e784c84e3f tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:42.378259 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a379d86a-814d-4f21-8913-60e784c84e3f tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:42.379486 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a379d86a-814d-4f21-8913-60e784c84e3f tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:42.381849 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a379d86a-814d-4f21-8913-60e784c84e3f tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:42.393905 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-72ccfda8-6773-4c24-ac59-1121ee9acbfb tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lazy-loading 'services' on Instance uuid 35b89015-3888-493a-b521-49a5e3769b00 {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:02:42.441929 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-72ccfda8-6773-4c24-ac59-1121ee9acbfb tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00" status: 200 len: 2423 microversion: 2.25 time: 0.399620 Aug 31 16:02:42.443556 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 882/1807] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:02:42 2022] GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00 => generated 2423 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:02:42.473796 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-cb3024a6-7647-4024-82c8-bb6b8987f3e3 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:42.474803 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-cb3024a6-7647-4024-82c8-bb6b8987f3e3 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: efbe58d1-9726-4fa7-a7fb-f3cdc1b70ca4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:42.484107 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-a379d86a-814d-4f21-8913-60e784c84e3f tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] HTTP exception thrown: Instance 39a531e3-b13b-412f-a200-5141c32650be could not be found. Aug 31 16:02:42.490192 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a379d86a-814d-4f21-8913-60e784c84e3f tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Request method failure captured: Aug 31 16:02:42.490192 n-d-850499-9 devstack@n-api.service[122256]: request: DELETE /compute/v2.1/servers/39a531e3-b13b-412f-a200-5141c32650be HTTP/1.1 Aug 31 16:02:42.490192 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:02:42.490192 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:02:42.490192 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:02:42.490192 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:02:42.490192 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:02:42.490192 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:02:42.490192 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:02:42.490192 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:02:42.490192 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4VECBuIp2sfdQFtldzAEOen6Gq8K8B_W6_IIKegH03Rjx2QgX7NM3EKZIg77Un9mdj2XL_3xJgjG5v923JVA5QCK3lRlGREmMqg12aw_AG3WhDxbeciU3GpFNMvwKFjEFpIhkyqQ5bOu1K4Q0SYPzThB2qHw9KwSiqFqQlqs_E2fA8 Aug 31 16:02:42.490192 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:02:42.490192 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:02:42.490192 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:02:42.490192 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:02:42.490192 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:02:42.490192 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:02:42.490192 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: a9f780d0079345519eea40fe8a3fd813 Aug 31 16:02:42.490192 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-361172188 Aug 31 16:02:42.490192 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:02:42.490192 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:02:42.492126 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a9f780d0079345519eea40fe8a3fd813"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a9f780d0079345519eea40fe8a3fd813"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a9f780d0079345519eea40fe8a3fd813", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a9f780d0079345519eea40fe8a3fd813"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:02:42.492126 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-361172188 Aug 31 16:02:42.492126 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: a9f780d0079345519eea40fe8a3fd813 Aug 31 16:02:42.492126 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-361172188 Aug 31 16:02:42.492126 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-AttachSCSIVolumeTestJSON-361172188-project Aug 31 16:02:42.492126 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:02:42.492126 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:02:42.492126 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: eb054cb62b9945a78e6bb60cd613acae Aug 31 16:02:42.492126 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-361172188-project Aug 31 16:02:42.492126 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:02:42.492126 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance 39a531e3-b13b-412f-a200-5141c32650be could not be found. Aug 31 16:02:42.492126 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '39a531e3-b13b-412f-a200-5141c32650be'} Aug 31 16:02:42.493149 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:02:42.493149 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:02:42.493149 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:02:42.493149 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:02:42.493149 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:02:42.493149 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:02:42.493149 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:02:42.493149 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:02:42.493149 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:02:42.493149 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:02:42.493149 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39a531e3-b13b-412f-a200-5141c32650be could not be found. Aug 31 16:02:42.493149 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:02:42.493149 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:02:42.493149 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:02:42.493149 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:02:42.493149 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:02:42.493149 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:02:42.493149 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:02:42.493149 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:02:42.493149 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:02:42.494887 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:02:42.494887 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:02:42.494887 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:02:42.494887 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:02:42.494887 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:02:42.494887 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:02:42.494887 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:02:42.494887 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:02:42.494887 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:02:42.494887 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39a531e3-b13b-412f-a200-5141c32650be could not be found. Aug 31 16:02:42.494887 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:02:42.494887 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:02:42.494887 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:02:42.494887 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:02:42.494887 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:02:42.494887 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:02:42.494887 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:02:42.494887 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:02:42.494887 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39a531e3-b13b-412f-a200-5141c32650be could not be found. Aug 31 16:02:42.494887 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:02:42.499426 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cb3024a6-7647-4024-82c8-bb6b8987f3e3 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:42.501647 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cb3024a6-7647-4024-82c8-bb6b8987f3e3 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:42.502885 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a379d86a-814d-4f21-8913-60e784c84e3f tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Returning 404 to user: Instance 39a531e3-b13b-412f-a200-5141c32650be could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:02:42.505160 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cb3024a6-7647-4024-82c8-bb6b8987f3e3 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:42.507937 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cb3024a6-7647-4024-82c8-bb6b8987f3e3 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:42.508618 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a379d86a-814d-4f21-8913-60e784c84e3f tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] 10.222.0.61 "DELETE /compute/v2.1/servers/39a531e3-b13b-412f-a200-5141c32650be" status: 404 len: 111 microversion: 2.1 time: 0.155663 Aug 31 16:02:42.512369 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 926/1808] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:02:42 2022] DELETE /compute/v2.1/servers/39a531e3-b13b-412f-a200-5141c32650be => generated 111 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 16:02:42.514860 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cb3024a6-7647-4024-82c8-bb6b8987f3e3 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:42.517599 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cb3024a6-7647-4024-82c8-bb6b8987f3e3 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:42.531321 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e55aec11-f8c5-44f1-a7a2-92e5e24f8996 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:42.535805 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e55aec11-f8c5-44f1-a7a2-92e5e24f8996 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] [instance: 35b89015-3888-493a-b521-49a5e3769b00] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:42.554124 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e55aec11-f8c5-44f1-a7a2-92e5e24f8996 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:42.554956 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e55aec11-f8c5-44f1-a7a2-92e5e24f8996 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:42.555551 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e55aec11-f8c5-44f1-a7a2-92e5e24f8996 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:42.556626 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e55aec11-f8c5-44f1-a7a2-92e5e24f8996 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:42.557198 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e55aec11-f8c5-44f1-a7a2-92e5e24f8996 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:42.558795 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e55aec11-f8c5-44f1-a7a2-92e5e24f8996 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:42.625500 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:02:43.111104 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-cb3024a6-7647-4024-82c8-bb6b8987f3e3 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:43.138574 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-cb3024a6-7647-4024-82c8-bb6b8987f3e3 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/efbe58d1-9726-4fa7-a7fb-f3cdc1b70ca4" status: 200 len: 1318 microversion: 2.1 time: 0.672740 Aug 31 16:02:43.139750 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 883/1809] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:42 2022] GET /compute/v2.1/servers/efbe58d1-9726-4fa7-a7fb-f3cdc1b70ca4 => generated 1318 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:43.157737 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6ed88a07-2301-4cc0-a3d4-efd01e33b79f tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:43.158422 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6ed88a07-2301-4cc0-a3d4-efd01e33b79f tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] [instance: 39a531e3-b13b-412f-a200-5141c32650be] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:43.177334 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6ed88a07-2301-4cc0-a3d4-efd01e33b79f tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:43.177843 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6ed88a07-2301-4cc0-a3d4-efd01e33b79f tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:43.178320 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6ed88a07-2301-4cc0-a3d4-efd01e33b79f tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:43.179206 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6ed88a07-2301-4cc0-a3d4-efd01e33b79f tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:43.179797 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6ed88a07-2301-4cc0-a3d4-efd01e33b79f tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:43.180488 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6ed88a07-2301-4cc0-a3d4-efd01e33b79f tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:43.244056 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-6ed88a07-2301-4cc0-a3d4-efd01e33b79f tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] HTTP exception thrown: Instance 39a531e3-b13b-412f-a200-5141c32650be could not be found. Aug 31 16:02:43.245873 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6ed88a07-2301-4cc0-a3d4-efd01e33b79f tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Request method failure captured: Aug 31 16:02:43.245873 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/39a531e3-b13b-412f-a200-5141c32650be HTTP/1.1 Aug 31 16:02:43.245873 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:02:43.245873 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:02:43.245873 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:02:43.245873 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:02:43.245873 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:02:43.245873 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:02:43.245873 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:02:43.245873 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:02:43.245873 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4VECBuIp2sfdQFtldzAEOen6Gq8K8B_W6_IIKegH03Rjx2QgX7NM3EKZIg77Un9mdj2XL_3xJgjG5v923JVA5QCK3lRlGREmMqg12aw_AG3WhDxbeciU3GpFNMvwKFjEFpIhkyqQ5bOu1K4Q0SYPzThB2qHw9KwSiqFqQlqs_E2fA8 Aug 31 16:02:43.245873 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:02:43.245873 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:02:43.245873 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:02:43.245873 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:02:43.245873 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:02:43.245873 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:02:43.245873 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: a9f780d0079345519eea40fe8a3fd813 Aug 31 16:02:43.245873 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-361172188 Aug 31 16:02:43.245873 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:02:43.245873 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:02:43.247613 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a9f780d0079345519eea40fe8a3fd813"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a9f780d0079345519eea40fe8a3fd813"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a9f780d0079345519eea40fe8a3fd813", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a9f780d0079345519eea40fe8a3fd813"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:02:43.247613 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-361172188 Aug 31 16:02:43.247613 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: a9f780d0079345519eea40fe8a3fd813 Aug 31 16:02:43.247613 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-361172188 Aug 31 16:02:43.247613 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-AttachSCSIVolumeTestJSON-361172188-project Aug 31 16:02:43.247613 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:02:43.247613 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:02:43.247613 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: eb054cb62b9945a78e6bb60cd613acae Aug 31 16:02:43.247613 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-361172188-project Aug 31 16:02:43.247613 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:02:43.247613 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance 39a531e3-b13b-412f-a200-5141c32650be could not be found. Aug 31 16:02:43.247613 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '39a531e3-b13b-412f-a200-5141c32650be'} Aug 31 16:02:43.249205 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:02:43.249205 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:02:43.249205 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:02:43.249205 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:02:43.249205 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:02:43.249205 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:02:43.249205 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:02:43.249205 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:02:43.249205 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:02:43.249205 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:02:43.249205 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39a531e3-b13b-412f-a200-5141c32650be could not be found. Aug 31 16:02:43.249205 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:02:43.249205 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:02:43.249205 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:02:43.249205 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:02:43.249205 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:02:43.249205 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:02:43.249205 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:02:43.249205 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:02:43.249205 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:02:43.251432 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:02:43.251432 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:02:43.251432 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:02:43.251432 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:02:43.251432 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:02:43.251432 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:02:43.251432 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:02:43.251432 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39a531e3-b13b-412f-a200-5141c32650be could not be found. Aug 31 16:02:43.251432 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:02:43.251432 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:02:43.251432 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:02:43.251432 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:02:43.251432 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:02:43.251432 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:02:43.251432 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:02:43.251432 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:02:43.251432 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39a531e3-b13b-412f-a200-5141c32650be could not be found. Aug 31 16:02:43.251432 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:02:43.253289 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6ed88a07-2301-4cc0-a3d4-efd01e33b79f tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] Returning 404 to user: Instance 39a531e3-b13b-412f-a200-5141c32650be could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:02:43.256910 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6ed88a07-2301-4cc0-a3d4-efd01e33b79f tempest-AttachSCSIVolumeTestJSON-361172188 tempest-AttachSCSIVolumeTestJSON-361172188-project] 10.222.0.61 "GET /compute/v2.1/servers/39a531e3-b13b-412f-a200-5141c32650be" status: 404 len: 111 microversion: 2.1 time: 0.112253 Aug 31 16:02:43.260181 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 884/1810] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:43 2022] GET /compute/v2.1/servers/39a531e3-b13b-412f-a200-5141c32650be => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:02:43.266682 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-e55aec11-f8c5-44f1-a7a2-92e5e24f8996 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lazy-loading 'services' on Instance uuid 35b89015-3888-493a-b521-49a5e3769b00 {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:02:43.267528 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d4f25b1e-89b3-413b-ad33-52e7724d49f5 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:43.268168 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d4f25b1e-89b3-413b-ad33-52e7724d49f5 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: cafdad7c-e670-48df-8c07-a2405d19f357] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:43.306143 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d4f25b1e-89b3-413b-ad33-52e7724d49f5 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:43.306830 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d4f25b1e-89b3-413b-ad33-52e7724d49f5 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:43.307444 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d4f25b1e-89b3-413b-ad33-52e7724d49f5 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:43.308352 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d4f25b1e-89b3-413b-ad33-52e7724d49f5 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:43.309000 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d4f25b1e-89b3-413b-ad33-52e7724d49f5 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:43.321701 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e55aec11-f8c5-44f1-a7a2-92e5e24f8996 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00" status: 200 len: 2423 microversion: 2.25 time: 0.801194 Aug 31 16:02:43.322732 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d4f25b1e-89b3-413b-ad33-52e7724d49f5 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:43.333244 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 927/1811] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:02:42 2022] GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00 => generated 2423 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:02:43.363628 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9f5062b0-2c98-48db-a32f-f07e7cd55816 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:43.371119 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9f5062b0-2c98-48db-a32f-f07e7cd55816 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6e82c98f-d644-4464-aca0-13901e551aa4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:43.404749 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9f5062b0-2c98-48db-a32f-f07e7cd55816 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:43.423546 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9f5062b0-2c98-48db-a32f-f07e7cd55816 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:43.427729 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9f5062b0-2c98-48db-a32f-f07e7cd55816 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:43.430366 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9f5062b0-2c98-48db-a32f-f07e7cd55816 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:43.430891 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9f5062b0-2c98-48db-a32f-f07e7cd55816 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:43.431347 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9f5062b0-2c98-48db-a32f-f07e7cd55816 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:43.484104 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d4f25b1e-89b3-413b-ad33-52e7724d49f5 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ccd03a4aa84f93bc26b438e1468f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a9f3fcc4b445349e5c66ff712e8598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:43.507715 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d4f25b1e-89b3-413b-ad33-52e7724d49f5 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/servers/cafdad7c-e670-48df-8c07-a2405d19f357" status: 200 len: 1265 microversion: 2.1 time: 0.246322 Aug 31 16:02:43.508320 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 885/1812] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:43 2022] GET /compute/v2.1/servers/cafdad7c-e670-48df-8c07-a2405d19f357 => generated 1265 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:43.522624 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7a72384e-d9dd-46c2-9a0f-803c8f4b6a98 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:43.526691 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7a72384e-d9dd-46c2-9a0f-803c8f4b6a98 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 35b89015-3888-493a-b521-49a5e3769b00] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:43.540972 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7a72384e-d9dd-46c2-9a0f-803c8f4b6a98 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:43.541502 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7a72384e-d9dd-46c2-9a0f-803c8f4b6a98 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:43.541950 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7a72384e-d9dd-46c2-9a0f-803c8f4b6a98 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:43.542668 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7a72384e-d9dd-46c2-9a0f-803c8f4b6a98 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:43.543128 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7a72384e-d9dd-46c2-9a0f-803c8f4b6a98 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:43.547058 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7a72384e-d9dd-46c2-9a0f-803c8f4b6a98 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:43.658751 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-9f5062b0-2c98-48db-a32f-f07e7cd55816 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:43.698047 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9f5062b0-2c98-48db-a32f-f07e7cd55816 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4" status: 200 len: 1264 microversion: 2.1 time: 0.358264 Aug 31 16:02:43.714717 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 928/1813] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:43 2022] GET /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4 => generated 1264 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:43.812035 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-7a72384e-d9dd-46c2-9a0f-803c8f4b6a98 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lazy-loading 'services' on Instance uuid 35b89015-3888-493a-b521-49a5e3769b00 {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:02:44.090344 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7a72384e-d9dd-46c2-9a0f-803c8f4b6a98 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "DELETE /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00/os-volume_attachments/f9102430-f6a5-491b-a623-35d1d655660c" status: 202 len: 0 microversion: 2.25 time: 0.580644 Aug 31 16:02:44.090935 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 886/1814] 10.222.0.61 () {60 vars in 1457 bytes} [Wed Aug 31 16:02:43 2022] DELETE /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00/os-volume_attachments/f9102430-f6a5-491b-a623-35d1d655660c => generated 0 bytes in 582 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:02:44.103173 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e6bd76f7-ea57-4773-9386-e8c799564e1b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:44.122638 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e6bd76f7-ea57-4773-9386-e8c799564e1b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 35b89015-3888-493a-b521-49a5e3769b00] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:44.162504 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e6bd76f7-ea57-4773-9386-e8c799564e1b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:44.163136 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-14a843a7-1c53-4bb8-a54a-efab23a59091 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:44.163879 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-14a843a7-1c53-4bb8-a54a-efab23a59091 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: efbe58d1-9726-4fa7-a7fb-f3cdc1b70ca4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:44.165963 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e6bd76f7-ea57-4773-9386-e8c799564e1b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:44.167779 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e6bd76f7-ea57-4773-9386-e8c799564e1b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:44.169968 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e6bd76f7-ea57-4773-9386-e8c799564e1b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:44.187132 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e6bd76f7-ea57-4773-9386-e8c799564e1b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:44.188807 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e6bd76f7-ea57-4773-9386-e8c799564e1b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:44.194573 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-14a843a7-1c53-4bb8-a54a-efab23a59091 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:44.195082 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-14a843a7-1c53-4bb8-a54a-efab23a59091 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:44.200539 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-14a843a7-1c53-4bb8-a54a-efab23a59091 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:44.201354 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-14a843a7-1c53-4bb8-a54a-efab23a59091 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:44.202414 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-14a843a7-1c53-4bb8-a54a-efab23a59091 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:44.202855 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-14a843a7-1c53-4bb8-a54a-efab23a59091 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:44.321899 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e6bd76f7-ea57-4773-9386-e8c799564e1b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.224599 Aug 31 16:02:44.323948 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 929/1815] 10.222.0.61 () {60 vars in 1343 bytes} [Wed Aug 31 16:02:44 2022] GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00/os-volume_attachments => generated 197 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 16:02:44.535066 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a4f96e26-a762-4ef6-967f-e4b2c2df67ab tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:44.535972 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a4f96e26-a762-4ef6-967f-e4b2c2df67ab tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: cafdad7c-e670-48df-8c07-a2405d19f357] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:44.545564 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a4f96e26-a762-4ef6-967f-e4b2c2df67ab tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:44.548137 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a4f96e26-a762-4ef6-967f-e4b2c2df67ab tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:44.551601 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a4f96e26-a762-4ef6-967f-e4b2c2df67ab tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:44.554656 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a4f96e26-a762-4ef6-967f-e4b2c2df67ab tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:44.556208 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a4f96e26-a762-4ef6-967f-e4b2c2df67ab tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:44.557167 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a4f96e26-a762-4ef6-967f-e4b2c2df67ab tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:45.838993 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a4f96e26-a762-4ef6-967f-e4b2c2df67ab tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ccd03a4aa84f93bc26b438e1468f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a9f3fcc4b445349e5c66ff712e8598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:45.854287 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a4f96e26-a762-4ef6-967f-e4b2c2df67ab tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/servers/cafdad7c-e670-48df-8c07-a2405d19f357" status: 200 len: 1307 microversion: 2.1 time: 1.324608 Aug 31 16:02:45.857493 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 930/1816] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:44 2022] GET /compute/v2.1/servers/cafdad7c-e670-48df-8c07-a2405d19f357 => generated 1307 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:02:45.865197 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-14a843a7-1c53-4bb8-a54a-efab23a59091 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:45.868046 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a2e479ef-d706-45ec-a5ac-81a2e992867a tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:45.868583 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a2e479ef-d706-45ec-a5ac-81a2e992867a tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6e82c98f-d644-4464-aca0-13901e551aa4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:45.875714 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-14a843a7-1c53-4bb8-a54a-efab23a59091 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/efbe58d1-9726-4fa7-a7fb-f3cdc1b70ca4" status: 200 len: 1318 microversion: 2.1 time: 1.718395 Aug 31 16:02:45.884396 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 887/1817] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:44 2022] GET /compute/v2.1/servers/efbe58d1-9726-4fa7-a7fb-f3cdc1b70ca4 => generated 1318 bytes in 1728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:45.898181 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a2e479ef-d706-45ec-a5ac-81a2e992867a tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:45.898696 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a2e479ef-d706-45ec-a5ac-81a2e992867a tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:45.899142 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a2e479ef-d706-45ec-a5ac-81a2e992867a tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:45.899603 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0e33c8f4-5037-46c6-8f4b-d7d700ac2144 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:45.900899 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a2e479ef-d706-45ec-a5ac-81a2e992867a tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:45.901384 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a2e479ef-d706-45ec-a5ac-81a2e992867a tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:45.901825 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a2e479ef-d706-45ec-a5ac-81a2e992867a tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:45.906028 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0e33c8f4-5037-46c6-8f4b-d7d700ac2144 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 35b89015-3888-493a-b521-49a5e3769b00] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:45.935388 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0e33c8f4-5037-46c6-8f4b-d7d700ac2144 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:45.941777 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0e33c8f4-5037-46c6-8f4b-d7d700ac2144 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:45.942659 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0e33c8f4-5037-46c6-8f4b-d7d700ac2144 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:45.947405 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0e33c8f4-5037-46c6-8f4b-d7d700ac2144 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:45.950040 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0e33c8f4-5037-46c6-8f4b-d7d700ac2144 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:45.950819 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0e33c8f4-5037-46c6-8f4b-d7d700ac2144 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:46.025921 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0e33c8f4-5037-46c6-8f4b-d7d700ac2144 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.137678 Aug 31 16:02:46.027097 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 888/1818] 10.222.0.61 () {60 vars in 1343 bytes} [Wed Aug 31 16:02:45 2022] GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00/os-volume_attachments => generated 197 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 16:02:46.032799 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-65eb41f9-9024-4afe-ad77-d1fe5d5a3aab req-6ead9464-5a49-4354-9bdd-906e6d1d4892 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efbe58d1-9726-4fa7-a7fb-f3cdc1b70ca4", "name": "network-vif-plugged", "status": "completed", "tag": "79a220dd-5cdb-47b6-bea1-c9cad9dc263f"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:02:46.068598 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a2e479ef-d706-45ec-a5ac-81a2e992867a tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:46.082698 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a2e479ef-d706-45ec-a5ac-81a2e992867a tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4" status: 200 len: 1270 microversion: 2.1 time: 0.223564 Aug 31 16:02:46.083555 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 931/1819] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:45 2022] GET /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4 => generated 1270 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:46.091122 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-65eb41f9-9024-4afe-ad77-d1fe5d5a3aab req-6ead9464-5a49-4354-9bdd-906e6d1d4892 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:46.091918 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-65eb41f9-9024-4afe-ad77-d1fe5d5a3aab req-6ead9464-5a49-4354-9bdd-906e6d1d4892 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:46.093094 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-65eb41f9-9024-4afe-ad77-d1fe5d5a3aab req-6ead9464-5a49-4354-9bdd-906e6d1d4892 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:46.124959 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-65eb41f9-9024-4afe-ad77-d1fe5d5a3aab req-6ead9464-5a49-4354-9bdd-906e6d1d4892 service nova] Creating event network-vif-plugged:79a220dd-5cdb-47b6-bea1-c9cad9dc263f for instance efbe58d1-9726-4fa7-a7fb-f3cdc1b70ca4 on n-h1-850499-9 Aug 31 16:02:46.132277 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-65eb41f9-9024-4afe-ad77-d1fe5d5a3aab req-6ead9464-5a49-4354-9bdd-906e6d1d4892 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103710 Aug 31 16:02:46.133444 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 889/1820] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:02:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:02:46.881333 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4342afa2-fd16-4065-bd7c-4dc38d97d0bc tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:46.882565 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4342afa2-fd16-4065-bd7c-4dc38d97d0bc tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: cafdad7c-e670-48df-8c07-a2405d19f357] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:46.916859 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-03a7fc34-0c50-48d2-8c9e-008b0f1186a3 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:46.918785 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-03a7fc34-0c50-48d2-8c9e-008b0f1186a3 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: efbe58d1-9726-4fa7-a7fb-f3cdc1b70ca4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:46.923433 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4342afa2-fd16-4065-bd7c-4dc38d97d0bc tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:46.924823 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4342afa2-fd16-4065-bd7c-4dc38d97d0bc tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:46.925808 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4342afa2-fd16-4065-bd7c-4dc38d97d0bc tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:46.928202 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4342afa2-fd16-4065-bd7c-4dc38d97d0bc tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:46.930002 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4342afa2-fd16-4065-bd7c-4dc38d97d0bc tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:46.932075 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4342afa2-fd16-4065-bd7c-4dc38d97d0bc tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:46.939430 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-03a7fc34-0c50-48d2-8c9e-008b0f1186a3 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:46.942402 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-03a7fc34-0c50-48d2-8c9e-008b0f1186a3 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:46.943081 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-03a7fc34-0c50-48d2-8c9e-008b0f1186a3 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:46.946487 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-03a7fc34-0c50-48d2-8c9e-008b0f1186a3 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:46.947481 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-03a7fc34-0c50-48d2-8c9e-008b0f1186a3 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:46.949524 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-03a7fc34-0c50-48d2-8c9e-008b0f1186a3 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:47.457945 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-4342afa2-fd16-4065-bd7c-4dc38d97d0bc tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ccd03a4aa84f93bc26b438e1468f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a9f3fcc4b445349e5c66ff712e8598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:47.480961 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4342afa2-fd16-4065-bd7c-4dc38d97d0bc tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/servers/cafdad7c-e670-48df-8c07-a2405d19f357" status: 200 len: 1307 microversion: 2.1 time: 0.604147 Aug 31 16:02:47.482554 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 932/1821] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:46 2022] GET /compute/v2.1/servers/cafdad7c-e670-48df-8c07-a2405d19f357 => generated 1307 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:47.491248 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-afb8c48b-e192-41ca-9c8b-2918e961902a tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:47.494045 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-afb8c48b-e192-41ca-9c8b-2918e961902a tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 35b89015-3888-493a-b521-49a5e3769b00] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:47.502128 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-afb8c48b-e192-41ca-9c8b-2918e961902a tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:47.502919 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-afb8c48b-e192-41ca-9c8b-2918e961902a tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:47.503571 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-afb8c48b-e192-41ca-9c8b-2918e961902a tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:47.504500 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-afb8c48b-e192-41ca-9c8b-2918e961902a tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:47.505144 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-afb8c48b-e192-41ca-9c8b-2918e961902a tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:47.505749 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-afb8c48b-e192-41ca-9c8b-2918e961902a tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:47.591044 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-afb8c48b-e192-41ca-9c8b-2918e961902a tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.106388 Aug 31 16:02:47.612463 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 933/1822] 10.222.0.61 () {60 vars in 1343 bytes} [Wed Aug 31 16:02:47 2022] GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00/os-volume_attachments => generated 197 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 16:02:47.623860 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7247434d-35cf-404a-a535-60e85492b572 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:47.625284 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7247434d-35cf-404a-a535-60e85492b572 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6e82c98f-d644-4464-aca0-13901e551aa4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:47.645261 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7247434d-35cf-404a-a535-60e85492b572 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:47.648931 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7247434d-35cf-404a-a535-60e85492b572 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:47.650023 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7247434d-35cf-404a-a535-60e85492b572 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:47.651198 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7247434d-35cf-404a-a535-60e85492b572 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:47.651972 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7247434d-35cf-404a-a535-60e85492b572 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:47.653855 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7247434d-35cf-404a-a535-60e85492b572 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:47.719090 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-03a7fc34-0c50-48d2-8c9e-008b0f1186a3 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:47.740958 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-03a7fc34-0c50-48d2-8c9e-008b0f1186a3 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/efbe58d1-9726-4fa7-a7fb-f3cdc1b70ca4" status: 200 len: 1318 microversion: 2.1 time: 0.834455 Aug 31 16:02:47.741799 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 890/1823] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:46 2022] GET /compute/v2.1/servers/efbe58d1-9726-4fa7-a7fb-f3cdc1b70ca4 => generated 1318 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:47.979692 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7247434d-35cf-404a-a535-60e85492b572 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:47.996189 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7247434d-35cf-404a-a535-60e85492b572 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4" status: 200 len: 1270 microversion: 2.1 time: 0.385969 Aug 31 16:02:48.001506 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 934/1824] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:47 2022] GET /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4 => generated 1270 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:48.151992 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-301a5e49-1552-485f-8621-9183732ba038 req-156b80b1-33b1-41f8-a90b-834258317660 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cafdad7c-e670-48df-8c07-a2405d19f357", "tag": "8b9d6092-352b-4fc5-a622-919e58ed2dea"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:02:48.168115 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-301a5e49-1552-485f-8621-9183732ba038 req-156b80b1-33b1-41f8-a90b-834258317660 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:48.176819 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-301a5e49-1552-485f-8621-9183732ba038 req-156b80b1-33b1-41f8-a90b-834258317660 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:48.177965 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-301a5e49-1552-485f-8621-9183732ba038 req-156b80b1-33b1-41f8-a90b-834258317660 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:48.214591 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-301a5e49-1552-485f-8621-9183732ba038 req-156b80b1-33b1-41f8-a90b-834258317660 service nova] Creating event network-changed:8b9d6092-352b-4fc5-a622-919e58ed2dea for instance cafdad7c-e670-48df-8c07-a2405d19f357 on n-h1-850499-9 Aug 31 16:02:48.228793 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-301a5e49-1552-485f-8621-9183732ba038 req-156b80b1-33b1-41f8-a90b-834258317660 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080747 Aug 31 16:02:48.230544 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 891/1825] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:02:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:02:48.533943 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-fb02e112-7a86-47f8-8a02-a832ce45799d tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:48.534968 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-fb02e112-7a86-47f8-8a02-a832ce45799d tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: cafdad7c-e670-48df-8c07-a2405d19f357] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:48.557580 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fb02e112-7a86-47f8-8a02-a832ce45799d tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:48.559046 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fb02e112-7a86-47f8-8a02-a832ce45799d tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:48.562648 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fb02e112-7a86-47f8-8a02-a832ce45799d tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:48.571311 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fb02e112-7a86-47f8-8a02-a832ce45799d tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:48.575166 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fb02e112-7a86-47f8-8a02-a832ce45799d tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:48.575935 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fb02e112-7a86-47f8-8a02-a832ce45799d tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:48.622811 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8d676289-7528-4602-a696-2cc773106426 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:48.627145 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8d676289-7528-4602-a696-2cc773106426 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 35b89015-3888-493a-b521-49a5e3769b00] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:48.649768 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8d676289-7528-4602-a696-2cc773106426 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:48.654798 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8d676289-7528-4602-a696-2cc773106426 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:48.657174 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8d676289-7528-4602-a696-2cc773106426 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:48.658236 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8d676289-7528-4602-a696-2cc773106426 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:48.665021 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8d676289-7528-4602-a696-2cc773106426 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:48.665714 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8d676289-7528-4602-a696-2cc773106426 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:48.769315 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8d676289-7528-4602-a696-2cc773106426 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.151364 Aug 31 16:02:48.770675 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 892/1826] 10.222.0.61 () {60 vars in 1343 bytes} [Wed Aug 31 16:02:48 2022] GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00/os-volume_attachments => generated 197 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 16:02:49.155474 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-eec663c9-0cc3-405c-968a-0e9ebca8495e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1782338256", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "networks": [{"uuid": "b472c169-a645-4811-858d-fe4088611ce7"}]}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:02:49.309684 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-eec663c9-0cc3-405c-968a-0e9ebca8495e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] validate_networks() for [('b472c169-a645-4811-858d-fe4088611ce7', None, None, None, None, None)] {{(pid=122257) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:02:49.350972 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-fb02e112-7a86-47f8-8a02-a832ce45799d tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ccd03a4aa84f93bc26b438e1468f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a9f3fcc4b445349e5c66ff712e8598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:49.362660 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-fb02e112-7a86-47f8-8a02-a832ce45799d tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/servers/cafdad7c-e670-48df-8c07-a2405d19f357" status: 200 len: 1307 microversion: 2.1 time: 0.850026 Aug 31 16:02:49.368040 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 935/1827] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:48 2022] GET /compute/v2.1/servers/cafdad7c-e670-48df-8c07-a2405d19f357 => generated 1307 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:49.381209 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-11542e6b-79e6-4f56-8893-6fea45550fc7 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:49.397565 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-11542e6b-79e6-4f56-8893-6fea45550fc7 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: efbe58d1-9726-4fa7-a7fb-f3cdc1b70ca4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:49.425180 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-11542e6b-79e6-4f56-8893-6fea45550fc7 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:49.430251 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-11542e6b-79e6-4f56-8893-6fea45550fc7 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:49.433783 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-11542e6b-79e6-4f56-8893-6fea45550fc7 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:49.438104 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-11542e6b-79e6-4f56-8893-6fea45550fc7 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:49.438834 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-11542e6b-79e6-4f56-8893-6fea45550fc7 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:49.440761 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-11542e6b-79e6-4f56-8893-6fea45550fc7 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:50.487868 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-11542e6b-79e6-4f56-8893-6fea45550fc7 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:50.497692 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-11542e6b-79e6-4f56-8893-6fea45550fc7 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/efbe58d1-9726-4fa7-a7fb-f3cdc1b70ca4" status: 200 len: 1468 microversion: 2.1 time: 1.128443 Aug 31 16:02:50.504878 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 936/1828] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:49 2022] GET /compute/v2.1/servers/efbe58d1-9726-4fa7-a7fb-f3cdc1b70ca4 => generated 1468 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:50.517783 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e70b6a55-fe74-45d6-bcc8-6c4093c666b3 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:50.519076 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e70b6a55-fe74-45d6-bcc8-6c4093c666b3 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6e82c98f-d644-4464-aca0-13901e551aa4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:50.535540 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e70b6a55-fe74-45d6-bcc8-6c4093c666b3 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:50.539084 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e70b6a55-fe74-45d6-bcc8-6c4093c666b3 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:50.539877 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e70b6a55-fe74-45d6-bcc8-6c4093c666b3 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:50.541059 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e70b6a55-fe74-45d6-bcc8-6c4093c666b3 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:50.544916 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e70b6a55-fe74-45d6-bcc8-6c4093c666b3 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:50.545850 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e70b6a55-fe74-45d6-bcc8-6c4093c666b3 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:50.777286 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-eec663c9-0cc3-405c-968a-0e9ebca8495e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:02:50.778631 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-eec663c9-0cc3-405c-968a-0e9ebca8495e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:02:50.779309 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-eec663c9-0cc3-405c-968a-0e9ebca8495e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:02:50.780040 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-eec663c9-0cc3-405c-968a-0e9ebca8495e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:02:50.782125 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-eec663c9-0cc3-405c-968a-0e9ebca8495e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:02:50.814428 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eec663c9-0cc3-405c-968a-0e9ebca8495e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:50.816730 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eec663c9-0cc3-405c-968a-0e9ebca8495e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:50.818268 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eec663c9-0cc3-405c-968a-0e9ebca8495e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:50.827385 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eec663c9-0cc3-405c-968a-0e9ebca8495e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:50.829743 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eec663c9-0cc3-405c-968a-0e9ebca8495e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:50.831257 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eec663c9-0cc3-405c-968a-0e9ebca8495e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:50.904598 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-eec663c9-0cc3-405c-968a-0e9ebca8495e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Getting quotas for project af5a8bccbcb14afd9c6bcd6f4d4f8047. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:02:50.917005 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-eec663c9-0cc3-405c-968a-0e9ebca8495e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Getting quotas for user 4ee58e6a7c284cc9a9c87d0a5c1239aa and project af5a8bccbcb14afd9c6bcd6f4d4f8047. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:02:50.967025 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-eec663c9-0cc3-405c-968a-0e9ebca8495e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Going to run 1 instances... {{(pid=122257) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:02:50.974433 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-eec663c9-0cc3-405c-968a-0e9ebca8495e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: b1c1e611-4be6-4a43-aaf0-d02bfd87875c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:02:51.081864 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e70b6a55-fe74-45d6-bcc8-6c4093c666b3 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:51.098739 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e70b6a55-fe74-45d6-bcc8-6c4093c666b3 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4" status: 200 len: 1312 microversion: 2.1 time: 0.590497 Aug 31 16:02:51.102080 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 937/1829] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:50 2022] GET /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4 => generated 1312 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:51.116269 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7a561c77-a4ca-4937-866f-635125026ba8 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:51.120894 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7a561c77-a4ca-4937-866f-635125026ba8 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 35b89015-3888-493a-b521-49a5e3769b00] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:51.137379 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-eec663c9-0cc3-405c-968a-0e9ebca8495e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.364786 Aug 31 16:02:51.143969 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7a561c77-a4ca-4937-866f-635125026ba8 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:51.145627 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7a561c77-a4ca-4937-866f-635125026ba8 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:51.146850 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7a561c77-a4ca-4937-866f-635125026ba8 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:51.147290 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 893/1830] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:02:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 2376 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:02:51.149818 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7a561c77-a4ca-4937-866f-635125026ba8 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:51.154065 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7a561c77-a4ca-4937-866f-635125026ba8 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:51.156902 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7a561c77-a4ca-4937-866f-635125026ba8 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:51.164316 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-11c46d99-a4d0-4585-be4d-232edf204732 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:51.164981 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-11c46d99-a4d0-4585-be4d-232edf204732 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: cafdad7c-e670-48df-8c07-a2405d19f357] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:51.191039 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-11c46d99-a4d0-4585-be4d-232edf204732 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:51.191883 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-11c46d99-a4d0-4585-be4d-232edf204732 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:51.192532 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-11c46d99-a4d0-4585-be4d-232edf204732 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:51.193491 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-11c46d99-a4d0-4585-be4d-232edf204732 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:51.194182 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-11c46d99-a4d0-4585-be4d-232edf204732 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:51.194780 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-11c46d99-a4d0-4585-be4d-232edf204732 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:51.243014 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7a561c77-a4ca-4937-866f-635125026ba8 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.139511 Aug 31 16:02:51.251689 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 938/1831] 10.222.0.61 () {60 vars in 1343 bytes} [Wed Aug 31 16:02:51 2022] GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00/os-volume_attachments => generated 197 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 16:02:51.260584 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6e8e9b90-5278-46ed-be23-4932c898c646 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:51.263588 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6e8e9b90-5278-46ed-be23-4932c898c646 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 65eb7e79-83ec-41c9-80f3-b8cac7369261] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:51.284144 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6e8e9b90-5278-46ed-be23-4932c898c646 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:51.285324 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6e8e9b90-5278-46ed-be23-4932c898c646 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:51.286006 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6e8e9b90-5278-46ed-be23-4932c898c646 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:51.287111 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6e8e9b90-5278-46ed-be23-4932c898c646 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:51.287886 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6e8e9b90-5278-46ed-be23-4932c898c646 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:51.288542 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6e8e9b90-5278-46ed-be23-4932c898c646 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:52.008860 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-11c46d99-a4d0-4585-be4d-232edf204732 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ccd03a4aa84f93bc26b438e1468f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a9f3fcc4b445349e5c66ff712e8598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:52.017761 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-11c46d99-a4d0-4585-be4d-232edf204732 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/servers/cafdad7c-e670-48df-8c07-a2405d19f357" status: 200 len: 1307 microversion: 2.1 time: 0.868722 Aug 31 16:02:52.018345 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 894/1832] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:51 2022] GET /compute/v2.1/servers/cafdad7c-e670-48df-8c07-a2405d19f357 => generated 1307 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:52.063716 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b98f6678-2020-4c53-afed-e1db5e4d741c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:52.064521 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b98f6678-2020-4c53-afed-e1db5e4d741c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: b1c1e611-4be6-4a43-aaf0-d02bfd87875c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:52.088059 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b98f6678-2020-4c53-afed-e1db5e4d741c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:52.090557 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b98f6678-2020-4c53-afed-e1db5e4d741c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:52.091582 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b98f6678-2020-4c53-afed-e1db5e4d741c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:52.096477 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b98f6678-2020-4c53-afed-e1db5e4d741c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:52.097090 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-6e8e9b90-5278-46ed-be23-4932c898c646 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:52.099683 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b98f6678-2020-4c53-afed-e1db5e4d741c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:52.100366 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b98f6678-2020-4c53-afed-e1db5e4d741c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:52.111229 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=4 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:02:52.117001 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6e8e9b90-5278-46ed-be23-4932c898c646 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/65eb7e79-83ec-41c9-80f3-b8cac7369261" status: 200 len: 1467 microversion: 2.1 time: 0.864110 Aug 31 16:02:52.117740 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 939/1833] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:51 2022] GET /compute/v2.1/servers/65eb7e79-83ec-41c9-80f3-b8cac7369261 => generated 1467 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:52.125590 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:02:52.159808 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-ffeb144c-b7d2-4c6a-918f-b8431c0254e7 req-68a8f570-ec64-4477-812f-c481b32832b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e82c98f-d644-4464-aca0-13901e551aa4", "tag": "0dddc681-0580-40ec-b2fe-b4af40412267"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:02:52.193997 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-ffeb144c-b7d2-4c6a-918f-b8431c0254e7 req-68a8f570-ec64-4477-812f-c481b32832b7 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:52.194927 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-ffeb144c-b7d2-4c6a-918f-b8431c0254e7 req-68a8f570-ec64-4477-812f-c481b32832b7 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:52.195554 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-ffeb144c-b7d2-4c6a-918f-b8431c0254e7 req-68a8f570-ec64-4477-812f-c481b32832b7 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:52.219969 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-ffeb144c-b7d2-4c6a-918f-b8431c0254e7 req-68a8f570-ec64-4477-812f-c481b32832b7 service nova] Creating event network-changed:0dddc681-0580-40ec-b2fe-b4af40412267 for instance 6e82c98f-d644-4464-aca0-13901e551aa4 on n-h1-850499-9 Aug 31 16:02:52.235141 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-ffeb144c-b7d2-4c6a-918f-b8431c0254e7 req-68a8f570-ec64-4477-812f-c481b32832b7 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086816 Aug 31 16:02:52.237786 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 940/1834] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:02:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:02:52.253874 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-482d11db-2bbc-4ded-b5da-fecf6c5842cb tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:52.258904 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-482d11db-2bbc-4ded-b5da-fecf6c5842cb tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6e82c98f-d644-4464-aca0-13901e551aa4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:52.293981 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-482d11db-2bbc-4ded-b5da-fecf6c5842cb tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:52.294483 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-482d11db-2bbc-4ded-b5da-fecf6c5842cb tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:52.295491 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-482d11db-2bbc-4ded-b5da-fecf6c5842cb tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:52.296776 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-482d11db-2bbc-4ded-b5da-fecf6c5842cb tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:52.297258 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-482d11db-2bbc-4ded-b5da-fecf6c5842cb tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:52.299761 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-482d11db-2bbc-4ded-b5da-fecf6c5842cb tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:52.313534 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b98f6678-2020-4c53-afed-e1db5e4d741c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:52.323737 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b98f6678-2020-4c53-afed-e1db5e4d741c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/b1c1e611-4be6-4a43-aaf0-d02bfd87875c" status: 200 len: 1219 microversion: 2.1 time: 0.287380 Aug 31 16:02:52.325972 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 895/1835] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:52 2022] GET /compute/v2.1/servers/b1c1e611-4be6-4a43-aaf0-d02bfd87875c => generated 1219 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:52.338876 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0dbded52-e189-4b62-8e75-07d8ded967fb tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:52.354120 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0dbded52-e189-4b62-8e75-07d8ded967fb tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:52.355634 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0dbded52-e189-4b62-8e75-07d8ded967fb tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Searching by: {'reservation_id': 'r-h9s0f33a', 'deleted': False, 'project_id': '7fa2effd15e440598752264e49d2457d'} {{(pid=122257) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 16:02:52.373838 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0dbded52-e189-4b62-8e75-07d8ded967fb tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:52.374573 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0dbded52-e189-4b62-8e75-07d8ded967fb tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:52.375402 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0dbded52-e189-4b62-8e75-07d8ded967fb tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:52.377070 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0dbded52-e189-4b62-8e75-07d8ded967fb tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:52.377874 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0dbded52-e189-4b62-8e75-07d8ded967fb tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:52.378544 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0dbded52-e189-4b62-8e75-07d8ded967fb tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:52.680502 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-482d11db-2bbc-4ded-b5da-fecf6c5842cb tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:52.687229 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.multi_cell_list [None req-0dbded52-e189-4b62-8e75-07d8ded967fb tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122257) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 31 16:02:52.714845 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-482d11db-2bbc-4ded-b5da-fecf6c5842cb tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4" status: 200 len: 1312 microversion: 2.1 time: 0.475332 Aug 31 16:02:52.733633 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 941/1836] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:52 2022] GET /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4 => generated 1312 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:52.750325 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9afe6786-41b2-468f-938a-f123c2c80f0d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:52.760995 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9afe6786-41b2-468f-938a-f123c2c80f0d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 35b89015-3888-493a-b521-49a5e3769b00] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:52.781507 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9afe6786-41b2-468f-938a-f123c2c80f0d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:52.783563 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9afe6786-41b2-468f-938a-f123c2c80f0d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:52.784590 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9afe6786-41b2-468f-938a-f123c2c80f0d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:52.785712 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9afe6786-41b2-468f-938a-f123c2c80f0d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:52.786355 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9afe6786-41b2-468f-938a-f123c2c80f0d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:52.787014 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9afe6786-41b2-468f-938a-f123c2c80f0d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:52.800565 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0dbded52-e189-4b62-8e75-07d8ded967fb tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:52.808234 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0dbded52-e189-4b62-8e75-07d8ded967fb tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:52.809111 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0dbded52-e189-4b62-8e75-07d8ded967fb tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:52.809897 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0dbded52-e189-4b62-8e75-07d8ded967fb tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:52.894105 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9afe6786-41b2-468f-938a-f123c2c80f0d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.159250 Aug 31 16:02:52.897332 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 942/1837] 10.222.0.61 () {60 vars in 1343 bytes} [Wed Aug 31 16:02:52 2022] GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00/os-volume_attachments => generated 197 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 16:02:52.997346 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0dbded52-e189-4b62-8e75-07d8ded967fb tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/detail?reservation_id=r-h9s0f33a" status: 200 len: 2928 microversion: 2.1 time: 0.669680 Aug 31 16:02:52.999263 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 896/1838] 10.222.0.61 () {58 vars in 1197 bytes} [Wed Aug 31 16:02:52 2022] GET /compute/v2.1/servers/detail?reservation_id=r-h9s0f33a => generated 2928 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:53.025409 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a0f4035c-ec73-4eb0-9209-df133b813514 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:53.041515 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-27dc7581-c51e-4aa5-af3f-5013bd666153 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:53.043220 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-27dc7581-c51e-4aa5-af3f-5013bd666153 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: cafdad7c-e670-48df-8c07-a2405d19f357] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:53.054460 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-27dc7581-c51e-4aa5-af3f-5013bd666153 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:53.057199 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-27dc7581-c51e-4aa5-af3f-5013bd666153 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:53.058113 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-27dc7581-c51e-4aa5-af3f-5013bd666153 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:53.060284 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-27dc7581-c51e-4aa5-af3f-5013bd666153 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:53.065042 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-27dc7581-c51e-4aa5-af3f-5013bd666153 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:53.065662 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-27dc7581-c51e-4aa5-af3f-5013bd666153 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:53.117730 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.compute.server_groups [None req-a0f4035c-ec73-4eb0-9209-df133b813514 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Querying cell 9f6d6683-96bf-42a7-a78d-78a22f1453ed(cell1) for 2 instances {{(pid=122256) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 31 16:02:53.123766 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a0f4035c-ec73-4eb0-9209-df133b813514 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:53.124452 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a0f4035c-ec73-4eb0-9209-df133b813514 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:53.124987 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a0f4035c-ec73-4eb0-9209-df133b813514 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:53.226486 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a0f4035c-ec73-4eb0-9209-df133b813514 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/os-server-groups/94c2e967-fbb5-4f0a-b5ce-f169fbd5b499" status: 200 len: 266 microversion: 2.1 time: 0.202628 Aug 31 16:02:53.232278 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 943/1839] 10.222.0.61 () {58 vars in 1263 bytes} [Wed Aug 31 16:02:53 2022] GET /compute/v2.1/os-server-groups/94c2e967-fbb5-4f0a-b5ce-f169fbd5b499 => generated 266 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:02:53.239181 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3c0b790d-a48e-45f2-bd6e-11e80bbe07ea tempest-ServersOnMultiNodesTest-1555970217 tempest-ServersOnMultiNodesTest-1555970217-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:53.241243 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3c0b790d-a48e-45f2-bd6e-11e80bbe07ea tempest-ServersOnMultiNodesTest-1555970217 tempest-ServersOnMultiNodesTest-1555970217-project-admin] [instance: 65eb7e79-83ec-41c9-80f3-b8cac7369261] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:53.256845 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3c0b790d-a48e-45f2-bd6e-11e80bbe07ea tempest-ServersOnMultiNodesTest-1555970217 tempest-ServersOnMultiNodesTest-1555970217-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:53.257358 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3c0b790d-a48e-45f2-bd6e-11e80bbe07ea tempest-ServersOnMultiNodesTest-1555970217 tempest-ServersOnMultiNodesTest-1555970217-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:53.257801 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3c0b790d-a48e-45f2-bd6e-11e80bbe07ea tempest-ServersOnMultiNodesTest-1555970217 tempest-ServersOnMultiNodesTest-1555970217-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:53.258516 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3c0b790d-a48e-45f2-bd6e-11e80bbe07ea tempest-ServersOnMultiNodesTest-1555970217 tempest-ServersOnMultiNodesTest-1555970217-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:53.258976 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3c0b790d-a48e-45f2-bd6e-11e80bbe07ea tempest-ServersOnMultiNodesTest-1555970217 tempest-ServersOnMultiNodesTest-1555970217-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:53.264355 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3c0b790d-a48e-45f2-bd6e-11e80bbe07ea tempest-ServersOnMultiNodesTest-1555970217 tempest-ServersOnMultiNodesTest-1555970217-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:53.345801 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-27dc7581-c51e-4aa5-af3f-5013bd666153 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ccd03a4aa84f93bc26b438e1468f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a9f3fcc4b445349e5c66ff712e8598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:53.364482 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-27dc7581-c51e-4aa5-af3f-5013bd666153 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/servers/cafdad7c-e670-48df-8c07-a2405d19f357" status: 200 len: 1307 microversion: 2.1 time: 0.326166 Aug 31 16:02:53.376338 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 897/1840] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:53 2022] GET /compute/v2.1/servers/cafdad7c-e670-48df-8c07-a2405d19f357 => generated 1307 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:53.400876 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0a7724f5-0865-4af0-a3a0-9bcc0a9469b8 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:53.407004 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0a7724f5-0865-4af0-a3a0-9bcc0a9469b8 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: b1c1e611-4be6-4a43-aaf0-d02bfd87875c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:53.439621 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0a7724f5-0865-4af0-a3a0-9bcc0a9469b8 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:53.440165 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0a7724f5-0865-4af0-a3a0-9bcc0a9469b8 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:53.440628 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0a7724f5-0865-4af0-a3a0-9bcc0a9469b8 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:53.441406 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0a7724f5-0865-4af0-a3a0-9bcc0a9469b8 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:53.441877 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0a7724f5-0865-4af0-a3a0-9bcc0a9469b8 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:53.442312 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0a7724f5-0865-4af0-a3a0-9bcc0a9469b8 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:53.579040 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0a7724f5-0865-4af0-a3a0-9bcc0a9469b8 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:53.589809 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0a7724f5-0865-4af0-a3a0-9bcc0a9469b8 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/b1c1e611-4be6-4a43-aaf0-d02bfd87875c" status: 200 len: 1267 microversion: 2.1 time: 0.210347 Aug 31 16:02:53.594987 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 898/1841] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:53 2022] GET /compute/v2.1/servers/b1c1e611-4be6-4a43-aaf0-d02bfd87875c => generated 1267 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:53.621279 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=100 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:02:53.634312 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3c0b790d-a48e-45f2-bd6e-11e80bbe07ea tempest-ServersOnMultiNodesTest-1555970217 tempest-ServersOnMultiNodesTest-1555970217-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/65eb7e79-83ec-41c9-80f3-b8cac7369261" status: 200 len: 1618 microversion: 2.1 time: 0.399422 Aug 31 16:02:53.636834 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 944/1842] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:53 2022] GET /compute/v2.1/servers/65eb7e79-83ec-41c9-80f3-b8cac7369261 => generated 1618 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:53.659120 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-dec8942c-67a1-431d-b9db-49c8585575d5 tempest-ServersOnMultiNodesTest-1555970217 tempest-ServersOnMultiNodesTest-1555970217-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:53.660170 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-dec8942c-67a1-431d-b9db-49c8585575d5 tempest-ServersOnMultiNodesTest-1555970217 tempest-ServersOnMultiNodesTest-1555970217-project-admin] [instance: efbe58d1-9726-4fa7-a7fb-f3cdc1b70ca4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:53.669022 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dec8942c-67a1-431d-b9db-49c8585575d5 tempest-ServersOnMultiNodesTest-1555970217 tempest-ServersOnMultiNodesTest-1555970217-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:53.671813 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dec8942c-67a1-431d-b9db-49c8585575d5 tempest-ServersOnMultiNodesTest-1555970217 tempest-ServersOnMultiNodesTest-1555970217-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:53.674580 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dec8942c-67a1-431d-b9db-49c8585575d5 tempest-ServersOnMultiNodesTest-1555970217 tempest-ServersOnMultiNodesTest-1555970217-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:53.675758 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dec8942c-67a1-431d-b9db-49c8585575d5 tempest-ServersOnMultiNodesTest-1555970217 tempest-ServersOnMultiNodesTest-1555970217-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:53.678095 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dec8942c-67a1-431d-b9db-49c8585575d5 tempest-ServersOnMultiNodesTest-1555970217 tempest-ServersOnMultiNodesTest-1555970217-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:53.678774 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dec8942c-67a1-431d-b9db-49c8585575d5 tempest-ServersOnMultiNodesTest-1555970217 tempest-ServersOnMultiNodesTest-1555970217-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:53.744323 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2c606179-ae5c-4b9a-98b9-5f810997fa5c tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:53.745092 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2c606179-ae5c-4b9a-98b9-5f810997fa5c tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6e82c98f-d644-4464-aca0-13901e551aa4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:53.755479 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:02:53.758433 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2c606179-ae5c-4b9a-98b9-5f810997fa5c tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:53.760207 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2c606179-ae5c-4b9a-98b9-5f810997fa5c tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:53.762488 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2c606179-ae5c-4b9a-98b9-5f810997fa5c tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:53.765407 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2c606179-ae5c-4b9a-98b9-5f810997fa5c tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:53.767275 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2c606179-ae5c-4b9a-98b9-5f810997fa5c tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:53.771130 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2c606179-ae5c-4b9a-98b9-5f810997fa5c tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:54.272974 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-dec8942c-67a1-431d-b9db-49c8585575d5 tempest-ServersOnMultiNodesTest-1555970217 tempest-ServersOnMultiNodesTest-1555970217-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/efbe58d1-9726-4fa7-a7fb-f3cdc1b70ca4" status: 200 len: 1619 microversion: 2.1 time: 0.618342 Aug 31 16:02:54.274958 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 899/1843] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:53 2022] GET /compute/v2.1/servers/efbe58d1-9726-4fa7-a7fb-f3cdc1b70ca4 => generated 1619 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:54.281075 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c728bde9-89de-40c8-beb8-c85f9eed64ea tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:54.284224 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c728bde9-89de-40c8-beb8-c85f9eed64ea tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 35b89015-3888-493a-b521-49a5e3769b00] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:54.291075 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c728bde9-89de-40c8-beb8-c85f9eed64ea tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:54.291870 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c728bde9-89de-40c8-beb8-c85f9eed64ea tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:54.292598 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c728bde9-89de-40c8-beb8-c85f9eed64ea tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:54.293520 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c728bde9-89de-40c8-beb8-c85f9eed64ea tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:54.294166 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c728bde9-89de-40c8-beb8-c85f9eed64ea tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:54.294767 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c728bde9-89de-40c8-beb8-c85f9eed64ea tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:54.373636 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c728bde9-89de-40c8-beb8-c85f9eed64ea tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.096675 Aug 31 16:02:54.381190 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 900/1844] 10.222.0.61 () {60 vars in 1343 bytes} [Wed Aug 31 16:02:54 2022] GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 16:02:54.399173 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8f41b172-c591-419b-8cdf-6c3e03b9a64f tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Action: 'create', calling method: .version_select at 0x7f5aed13bb80>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-366549882", "policies": ["anti-affinity"]}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:02:54.434383 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-8f41b172-c591-419b-8cdf-6c3e03b9a64f tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Getting quotas for project 7fa2effd15e440598752264e49d2457d. Resources: {'server_groups'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:02:54.437540 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:02:54.445130 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-8f41b172-c591-419b-8cdf-6c3e03b9a64f tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Getting quotas for user 547d88df13034daaad50c3582c7cc3b3 and project 7fa2effd15e440598752264e49d2457d. Resources: {'server_groups'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:02:54.513411 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-8f41b172-c591-419b-8cdf-6c3e03b9a64f tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Getting quotas for project 7fa2effd15e440598752264e49d2457d. Resources: {'server_groups'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:02:54.520300 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-8f41b172-c591-419b-8cdf-6c3e03b9a64f tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Getting quotas for user 547d88df13034daaad50c3582c7cc3b3 and project 7fa2effd15e440598752264e49d2457d. Resources: {'server_groups'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:02:54.539968 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8f41b172-c591-419b-8cdf-6c3e03b9a64f tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "POST /compute/v2.1/os-server-groups" status: 200 len: 192 microversion: 2.1 time: 0.154798 Aug 31 16:02:54.542830 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 901/1845] 10.222.0.61 () {60 vars in 1174 bytes} [Wed Aug 31 16:02:54 2022] POST /compute/v2.1/os-server-groups => generated 192 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:02:54.548844 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-63467099-526b-46ce-85b3-e9839e41efd2 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:54.549748 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-63467099-526b-46ce-85b3-e9839e41efd2 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: cafdad7c-e670-48df-8c07-a2405d19f357] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:54.556856 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-63467099-526b-46ce-85b3-e9839e41efd2 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:54.557897 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-63467099-526b-46ce-85b3-e9839e41efd2 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:54.558653 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-63467099-526b-46ce-85b3-e9839e41efd2 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:54.559463 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-63467099-526b-46ce-85b3-e9839e41efd2 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:54.560300 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-63467099-526b-46ce-85b3-e9839e41efd2 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:54.560622 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-63467099-526b-46ce-85b3-e9839e41efd2 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:54.847806 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-2c606179-ae5c-4b9a-98b9-5f810997fa5c tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:54.861763 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2c606179-ae5c-4b9a-98b9-5f810997fa5c tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4" status: 200 len: 1312 microversion: 2.1 time: 1.125491 Aug 31 16:02:54.863747 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 945/1846] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:53 2022] GET /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4 => generated 1312 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:54.872760 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1b8ce5bb-cff1-41a1-97af-76ae95086544 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:54.874442 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1b8ce5bb-cff1-41a1-97af-76ae95086544 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: b1c1e611-4be6-4a43-aaf0-d02bfd87875c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:54.881470 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1b8ce5bb-cff1-41a1-97af-76ae95086544 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:54.882132 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1b8ce5bb-cff1-41a1-97af-76ae95086544 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:54.882667 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1b8ce5bb-cff1-41a1-97af-76ae95086544 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:54.883704 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1b8ce5bb-cff1-41a1-97af-76ae95086544 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:54.884264 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1b8ce5bb-cff1-41a1-97af-76ae95086544 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:54.884789 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1b8ce5bb-cff1-41a1-97af-76ae95086544 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:55.002204 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1b8ce5bb-cff1-41a1-97af-76ae95086544 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:55.017832 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1b8ce5bb-cff1-41a1-97af-76ae95086544 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/b1c1e611-4be6-4a43-aaf0-d02bfd87875c" status: 200 len: 1273 microversion: 2.1 time: 0.152444 Aug 31 16:02:55.018592 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 946/1847] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:54 2022] GET /compute/v2.1/servers/b1c1e611-4be6-4a43-aaf0-d02bfd87875c => generated 1273 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:55.023550 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-59ead78a-33bd-4307-9d14-c53f40beb2b5 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-957106069", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "35f33a95-96b8-42b6-b807-0bcb84d43121"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:02:55.042767 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-63467099-526b-46ce-85b3-e9839e41efd2 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ccd03a4aa84f93bc26b438e1468f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a9f3fcc4b445349e5c66ff712e8598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:55.053866 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-63467099-526b-46ce-85b3-e9839e41efd2 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/servers/cafdad7c-e670-48df-8c07-a2405d19f357" status: 200 len: 1307 microversion: 2.1 time: 0.509539 Aug 31 16:02:55.055816 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 902/1848] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:54 2022] GET /compute/v2.1/servers/cafdad7c-e670-48df-8c07-a2405d19f357 => generated 1307 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:55.088030 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-59ead78a-33bd-4307-9d14-c53f40beb2b5 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] validate_networks() for None {{(pid=122256) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:02:55.394210 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5bf4d256-58ca-47a9-ad07-1c0f9c093bca tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:55.396612 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5bf4d256-58ca-47a9-ad07-1c0f9c093bca tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 35b89015-3888-493a-b521-49a5e3769b00] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:55.404912 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5bf4d256-58ca-47a9-ad07-1c0f9c093bca tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:55.405814 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5bf4d256-58ca-47a9-ad07-1c0f9c093bca tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:55.406272 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5bf4d256-58ca-47a9-ad07-1c0f9c093bca tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:55.407021 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5bf4d256-58ca-47a9-ad07-1c0f9c093bca tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:55.407530 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5bf4d256-58ca-47a9-ad07-1c0f9c093bca tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:55.408355 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5bf4d256-58ca-47a9-ad07-1c0f9c093bca tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:55.446336 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5bf4d256-58ca-47a9-ad07-1c0f9c093bca tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.056170 Aug 31 16:02:55.455554 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 903/1849] 10.222.0.61 () {60 vars in 1343 bytes} [Wed Aug 31 16:02:55 2022] GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00/os-volume_attachments => generated 25 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:02:55.769734 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-59ead78a-33bd-4307-9d14-c53f40beb2b5 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:02:55.770097 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-59ead78a-33bd-4307-9d14-c53f40beb2b5 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:02:55.771694 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-59ead78a-33bd-4307-9d14-c53f40beb2b5 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:02:55.772208 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-59ead78a-33bd-4307-9d14-c53f40beb2b5 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:02:55.772790 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-59ead78a-33bd-4307-9d14-c53f40beb2b5 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:02:55.790848 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-59ead78a-33bd-4307-9d14-c53f40beb2b5 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:55.791346 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-59ead78a-33bd-4307-9d14-c53f40beb2b5 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:55.791808 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-59ead78a-33bd-4307-9d14-c53f40beb2b5 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:55.792960 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-59ead78a-33bd-4307-9d14-c53f40beb2b5 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:55.794498 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-59ead78a-33bd-4307-9d14-c53f40beb2b5 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:55.796522 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-59ead78a-33bd-4307-9d14-c53f40beb2b5 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:55.827464 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-59ead78a-33bd-4307-9d14-c53f40beb2b5 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Getting quotas for project 7fa2effd15e440598752264e49d2457d. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:02:55.837641 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-59ead78a-33bd-4307-9d14-c53f40beb2b5 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Getting quotas for user 547d88df13034daaad50c3582c7cc3b3 and project 7fa2effd15e440598752264e49d2457d. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:02:55.863957 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-59ead78a-33bd-4307-9d14-c53f40beb2b5 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Going to run 2 instances... {{(pid=122256) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:02:55.867357 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-59ead78a-33bd-4307-9d14-c53f40beb2b5 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: bf253a58-f38a-42d9-90b6-f3a80141cad2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:02:55.887679 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2622569b-4346-41cb-b3fc-58cabd65d8e0 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:55.888670 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2622569b-4346-41cb-b3fc-58cabd65d8e0 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6e82c98f-d644-4464-aca0-13901e551aa4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:55.899969 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2622569b-4346-41cb-b3fc-58cabd65d8e0 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:55.901984 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2622569b-4346-41cb-b3fc-58cabd65d8e0 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:55.902677 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2622569b-4346-41cb-b3fc-58cabd65d8e0 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:55.903708 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2622569b-4346-41cb-b3fc-58cabd65d8e0 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:55.904546 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2622569b-4346-41cb-b3fc-58cabd65d8e0 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:55.905436 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2622569b-4346-41cb-b3fc-58cabd65d8e0 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:55.929594 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-59ead78a-33bd-4307-9d14-c53f40beb2b5 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=122256) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Aug 31 16:02:55.964304 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-59ead78a-33bd-4307-9d14-c53f40beb2b5 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Getting quotas for project 7fa2effd15e440598752264e49d2457d. Resources: {'server_group_members'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:02:55.977991 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-59ead78a-33bd-4307-9d14-c53f40beb2b5 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Getting quotas for user 547d88df13034daaad50c3582c7cc3b3 and project 7fa2effd15e440598752264e49d2457d. Resources: {'server_group_members'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:02:56.070620 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-59ead78a-33bd-4307-9d14-c53f40beb2b5 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Getting quotas for project 7fa2effd15e440598752264e49d2457d. Resources: {'server_group_members'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:02:56.079539 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-59ead78a-33bd-4307-9d14-c53f40beb2b5 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Getting quotas for user 547d88df13034daaad50c3582c7cc3b3 and project 7fa2effd15e440598752264e49d2457d. Resources: {'server_group_members'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:02:56.112744 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-59ead78a-33bd-4307-9d14-c53f40beb2b5 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 646d0250-a626-4bd1-821b-2117fde78cc8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=bf253a58-f38a-42d9-90b6-f3a80141cad2,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:02:56.226916 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-59ead78a-33bd-4307-9d14-c53f40beb2b5 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Getting quotas for project 7fa2effd15e440598752264e49d2457d. Resources: {'server_group_members'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:02:56.242211 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-59ead78a-33bd-4307-9d14-c53f40beb2b5 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Getting quotas for user 547d88df13034daaad50c3582c7cc3b3 and project 7fa2effd15e440598752264e49d2457d. Resources: {'server_group_members'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:02:56.311303 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-59ead78a-33bd-4307-9d14-c53f40beb2b5 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Getting quotas for project 7fa2effd15e440598752264e49d2457d. Resources: {'server_group_members'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:02:56.319107 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-59ead78a-33bd-4307-9d14-c53f40beb2b5 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Getting quotas for user 547d88df13034daaad50c3582c7cc3b3 and project 7fa2effd15e440598752264e49d2457d. Resources: {'server_group_members'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:02:56.359664 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2622569b-4346-41cb-b3fc-58cabd65d8e0 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:56.372602 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2622569b-4346-41cb-b3fc-58cabd65d8e0 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4" status: 200 len: 1312 microversion: 2.1 time: 0.491835 Aug 31 16:02:56.374641 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 904/1850] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:55 2022] GET /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4 => generated 1312 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:56.379421 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c54d4ba2-0065-4f4d-9abe-a16eb4404990 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:56.381861 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-59ead78a-33bd-4307-9d14-c53f40beb2b5 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.361935 Aug 31 16:02:56.384236 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c54d4ba2-0065-4f4d-9abe-a16eb4404990 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: b1c1e611-4be6-4a43-aaf0-d02bfd87875c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:56.390596 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 947/1851] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:02:55 2022] POST /compute/v2.1/servers => generated 32 bytes in 1371 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 31 16:02:56.405989 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1592bd73-eb29-4468-a3e4-c13d6567d1b9 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:56.406608 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c54d4ba2-0065-4f4d-9abe-a16eb4404990 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:56.407683 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c54d4ba2-0065-4f4d-9abe-a16eb4404990 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:56.408482 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c54d4ba2-0065-4f4d-9abe-a16eb4404990 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:56.409471 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c54d4ba2-0065-4f4d-9abe-a16eb4404990 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:56.409960 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1592bd73-eb29-4468-a3e4-c13d6567d1b9 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: cafdad7c-e670-48df-8c07-a2405d19f357] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:56.410401 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c54d4ba2-0065-4f4d-9abe-a16eb4404990 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:56.411063 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c54d4ba2-0065-4f4d-9abe-a16eb4404990 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:56.442746 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1592bd73-eb29-4468-a3e4-c13d6567d1b9 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:56.445525 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1592bd73-eb29-4468-a3e4-c13d6567d1b9 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:56.449062 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1592bd73-eb29-4468-a3e4-c13d6567d1b9 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:56.452698 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1592bd73-eb29-4468-a3e4-c13d6567d1b9 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:56.455600 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1592bd73-eb29-4468-a3e4-c13d6567d1b9 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:56.457762 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1592bd73-eb29-4468-a3e4-c13d6567d1b9 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:57.050097 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c54d4ba2-0065-4f4d-9abe-a16eb4404990 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:57.066939 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c54d4ba2-0065-4f4d-9abe-a16eb4404990 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/b1c1e611-4be6-4a43-aaf0-d02bfd87875c" status: 200 len: 1315 microversion: 2.1 time: 0.690983 Aug 31 16:02:57.082447 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 905/1852] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:56 2022] GET /compute/v2.1/servers/b1c1e611-4be6-4a43-aaf0-d02bfd87875c => generated 1315 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:57.088981 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-897ee40b-414a-4d90-bdb5-6d19076133c5 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:57.090148 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1592bd73-eb29-4468-a3e4-c13d6567d1b9 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ccd03a4aa84f93bc26b438e1468f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a9f3fcc4b445349e5c66ff712e8598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:57.097752 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-897ee40b-414a-4d90-bdb5-6d19076133c5 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:57.099183 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-897ee40b-414a-4d90-bdb5-6d19076133c5 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Searching by: {'deleted': False, 'project_id': '7fa2effd15e440598752264e49d2457d'} {{(pid=122257) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 16:02:57.112955 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1592bd73-eb29-4468-a3e4-c13d6567d1b9 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/servers/cafdad7c-e670-48df-8c07-a2405d19f357" status: 200 len: 1307 microversion: 2.1 time: 0.720967 Aug 31 16:02:57.115979 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 948/1853] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:56 2022] GET /compute/v2.1/servers/cafdad7c-e670-48df-8c07-a2405d19f357 => generated 1307 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:57.122360 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-897ee40b-414a-4d90-bdb5-6d19076133c5 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:57.123927 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-897ee40b-414a-4d90-bdb5-6d19076133c5 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:57.124813 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-897ee40b-414a-4d90-bdb5-6d19076133c5 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:57.125836 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-897ee40b-414a-4d90-bdb5-6d19076133c5 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:57.126891 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-897ee40b-414a-4d90-bdb5-6d19076133c5 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:57.128055 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-897ee40b-414a-4d90-bdb5-6d19076133c5 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:57.260942 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.multi_cell_list [None req-897ee40b-414a-4d90-bdb5-6d19076133c5 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=122257) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 31 16:02:57.396647 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2c002ffe-0669-4aca-9c18-1130caf85794 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:57.401104 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2c002ffe-0669-4aca-9c18-1130caf85794 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6e82c98f-d644-4464-aca0-13901e551aa4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:57.406333 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-897ee40b-414a-4d90-bdb5-6d19076133c5 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers" status: 200 len: 1662 microversion: 2.1 time: 0.322217 Aug 31 16:02:57.406967 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 906/1854] 10.222.0.61 () {58 vars in 1125 bytes} [Wed Aug 31 16:02:57 2022] GET /compute/v2.1/servers => generated 1662 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:57.422130 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2c002ffe-0669-4aca-9c18-1130caf85794 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:57.423483 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2c002ffe-0669-4aca-9c18-1130caf85794 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:57.425257 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-dae71d0c-e0d7-4bde-828c-4a18932fc0b5 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:57.426831 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2c002ffe-0669-4aca-9c18-1130caf85794 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:57.427647 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2c002ffe-0669-4aca-9c18-1130caf85794 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:57.428122 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2c002ffe-0669-4aca-9c18-1130caf85794 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:57.428749 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-dae71d0c-e0d7-4bde-828c-4a18932fc0b5 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 646d0250-a626-4bd1-821b-2117fde78cc8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:57.431447 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2c002ffe-0669-4aca-9c18-1130caf85794 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:57.648244 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-dae71d0c-e0d7-4bde-828c-4a18932fc0b5 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:57.665825 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-dae71d0c-e0d7-4bde-828c-4a18932fc0b5 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/646d0250-a626-4bd1-821b-2117fde78cc8" status: 200 len: 1218 microversion: 2.1 time: 0.247420 Aug 31 16:02:57.668223 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 907/1855] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:57 2022] GET /compute/v2.1/servers/646d0250-a626-4bd1-821b-2117fde78cc8 => generated 1218 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:57.897217 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-2c002ffe-0669-4aca-9c18-1130caf85794 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:57.909752 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2c002ffe-0669-4aca-9c18-1130caf85794 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4" status: 200 len: 1312 microversion: 2.1 time: 0.517041 Aug 31 16:02:57.923675 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 949/1856] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:57 2022] GET /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4 => generated 1312 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:02:58.092935 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-97256698-ad32-4534-b433-86f73f250673 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:58.095321 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-97256698-ad32-4534-b433-86f73f250673 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: b1c1e611-4be6-4a43-aaf0-d02bfd87875c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:58.105539 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-97256698-ad32-4534-b433-86f73f250673 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:58.105539 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-97256698-ad32-4534-b433-86f73f250673 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:58.105539 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-97256698-ad32-4534-b433-86f73f250673 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:58.109682 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-97256698-ad32-4534-b433-86f73f250673 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:58.109682 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-97256698-ad32-4534-b433-86f73f250673 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:58.109682 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-97256698-ad32-4534-b433-86f73f250673 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:58.134564 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-979ae761-ab1e-4252-b769-6f689cc82e19 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:58.135178 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-979ae761-ab1e-4252-b769-6f689cc82e19 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: cafdad7c-e670-48df-8c07-a2405d19f357] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:58.150372 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-979ae761-ab1e-4252-b769-6f689cc82e19 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:58.151132 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-979ae761-ab1e-4252-b769-6f689cc82e19 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:58.153877 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-979ae761-ab1e-4252-b769-6f689cc82e19 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:58.154691 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-979ae761-ab1e-4252-b769-6f689cc82e19 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:58.155368 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-979ae761-ab1e-4252-b769-6f689cc82e19 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:58.155857 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-979ae761-ab1e-4252-b769-6f689cc82e19 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:58.528669 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-97256698-ad32-4534-b433-86f73f250673 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:58.541978 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-97256698-ad32-4534-b433-86f73f250673 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/b1c1e611-4be6-4a43-aaf0-d02bfd87875c" status: 200 len: 1315 microversion: 2.1 time: 0.453882 Aug 31 16:02:58.557066 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 908/1857] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:58 2022] GET /compute/v2.1/servers/b1c1e611-4be6-4a43-aaf0-d02bfd87875c => generated 1315 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:58.587618 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-3dd1740c-892e-4a88-80a2-182b75527214 req-c827b125-6bc1-43f5-91c6-01b9e980dbc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1c1e611-4be6-4a43-aaf0-d02bfd87875c", "tag": "0813979d-a0cf-4abc-98d9-f2c74265aef9"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:02:58.598969 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-3dd1740c-892e-4a88-80a2-182b75527214 req-c827b125-6bc1-43f5-91c6-01b9e980dbc4 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:58.599858 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-3dd1740c-892e-4a88-80a2-182b75527214 req-c827b125-6bc1-43f5-91c6-01b9e980dbc4 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:58.600898 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-3dd1740c-892e-4a88-80a2-182b75527214 req-c827b125-6bc1-43f5-91c6-01b9e980dbc4 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:58.603099 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-979ae761-ab1e-4252-b769-6f689cc82e19 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ccd03a4aa84f93bc26b438e1468f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a9f3fcc4b445349e5c66ff712e8598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:58.617125 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-3dd1740c-892e-4a88-80a2-182b75527214 req-c827b125-6bc1-43f5-91c6-01b9e980dbc4 service nova] Creating event network-changed:0813979d-a0cf-4abc-98d9-f2c74265aef9 for instance b1c1e611-4be6-4a43-aaf0-d02bfd87875c on n-h2-850499-9 Aug 31 16:02:58.618661 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-979ae761-ab1e-4252-b769-6f689cc82e19 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/servers/cafdad7c-e670-48df-8c07-a2405d19f357" status: 200 len: 1307 microversion: 2.1 time: 0.487821 Aug 31 16:02:58.631460 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 950/1858] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:58 2022] GET /compute/v2.1/servers/cafdad7c-e670-48df-8c07-a2405d19f357 => generated 1307 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:58.632019 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-3dd1740c-892e-4a88-80a2-182b75527214 req-c827b125-6bc1-43f5-91c6-01b9e980dbc4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046576 Aug 31 16:02:58.632019 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 909/1859] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:02:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:02:58.690667 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8cac46f9-4a54-44a2-a67d-333973319d32 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:58.691642 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8cac46f9-4a54-44a2-a67d-333973319d32 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 646d0250-a626-4bd1-821b-2117fde78cc8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:58.701230 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8cac46f9-4a54-44a2-a67d-333973319d32 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:58.702140 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8cac46f9-4a54-44a2-a67d-333973319d32 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:58.702786 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8cac46f9-4a54-44a2-a67d-333973319d32 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:58.703985 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8cac46f9-4a54-44a2-a67d-333973319d32 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:58.704794 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8cac46f9-4a54-44a2-a67d-333973319d32 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:58.705328 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8cac46f9-4a54-44a2-a67d-333973319d32 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:58.777354 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8cac46f9-4a54-44a2-a67d-333973319d32 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:58.805429 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8cac46f9-4a54-44a2-a67d-333973319d32 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/646d0250-a626-4bd1-821b-2117fde78cc8" status: 200 len: 1214 microversion: 2.1 time: 0.118737 Aug 31 16:02:58.824212 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 951/1860] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:58 2022] GET /compute/v2.1/servers/646d0250-a626-4bd1-821b-2117fde78cc8 => generated 1214 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:58.937395 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f338dacb-9f49-4093-aa99-9b2232fe3393 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:58.938794 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f338dacb-9f49-4093-aa99-9b2232fe3393 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6e82c98f-d644-4464-aca0-13901e551aa4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:58.959895 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-22f0dcb8-acad-4854-b099-f3778b7431e8 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1674882916", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "c780b733-916d-48a3-99f1-727aee35e4fb"}], "block_device_mapping_v2": [{"uuid": "ba1fafc0-a0a5-4ab2-ad70-115ecb2c60cf", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:02:58.975789 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f338dacb-9f49-4093-aa99-9b2232fe3393 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:58.993791 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f338dacb-9f49-4093-aa99-9b2232fe3393 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:58.999071 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f338dacb-9f49-4093-aa99-9b2232fe3393 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:59.006602 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f338dacb-9f49-4093-aa99-9b2232fe3393 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:59.014968 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f338dacb-9f49-4093-aa99-9b2232fe3393 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:59.017363 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f338dacb-9f49-4093-aa99-9b2232fe3393 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:59.088881 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-22f0dcb8-acad-4854-b099-f3778b7431e8 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] validate_networks() for [('c780b733-916d-48a3-99f1-727aee35e4fb', None, None, None, None, None)] {{(pid=122256) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:02:59.782068 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f338dacb-9f49-4093-aa99-9b2232fe3393 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:59.801942 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f338dacb-9f49-4093-aa99-9b2232fe3393 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4" status: 200 len: 1312 microversion: 2.1 time: 0.873615 Aug 31 16:02:59.819004 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 910/1861] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:58 2022] GET /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4 => generated 1312 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:59.830337 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-de2f76ad-db1e-4b31-878e-ba978f6334e9 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:59.831173 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-de2f76ad-db1e-4b31-878e-ba978f6334e9 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: b1c1e611-4be6-4a43-aaf0-d02bfd87875c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:59.846112 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-de2f76ad-db1e-4b31-878e-ba978f6334e9 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:59.846797 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-de2f76ad-db1e-4b31-878e-ba978f6334e9 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:59.847367 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-de2f76ad-db1e-4b31-878e-ba978f6334e9 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:59.848290 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-de2f76ad-db1e-4b31-878e-ba978f6334e9 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:59.849753 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-de2f76ad-db1e-4b31-878e-ba978f6334e9 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:59.854887 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-de2f76ad-db1e-4b31-878e-ba978f6334e9 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:00.943146 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-de2f76ad-db1e-4b31-878e-ba978f6334e9 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:00.953893 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-de2f76ad-db1e-4b31-878e-ba978f6334e9 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/b1c1e611-4be6-4a43-aaf0-d02bfd87875c" status: 200 len: 1315 microversion: 2.1 time: 1.133298 Aug 31 16:03:00.955436 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 911/1862] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:59 2022] GET /compute/v2.1/servers/b1c1e611-4be6-4a43-aaf0-d02bfd87875c => generated 1315 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:00.961386 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-926411bb-693e-47ec-90e6-eccfd3a41081 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:00.962265 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-926411bb-693e-47ec-90e6-eccfd3a41081 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: cafdad7c-e670-48df-8c07-a2405d19f357] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:00.971185 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-926411bb-693e-47ec-90e6-eccfd3a41081 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:00.974139 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-926411bb-693e-47ec-90e6-eccfd3a41081 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:00.974959 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-926411bb-693e-47ec-90e6-eccfd3a41081 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:00.975968 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-926411bb-693e-47ec-90e6-eccfd3a41081 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:00.977520 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-926411bb-693e-47ec-90e6-eccfd3a41081 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:00.978178 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-926411bb-693e-47ec-90e6-eccfd3a41081 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:01.315192 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-22f0dcb8-acad-4854-b099-f3778b7431e8 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:03:01.315735 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-22f0dcb8-acad-4854-b099-f3778b7431e8 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:03:01.316281 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-22f0dcb8-acad-4854-b099-f3778b7431e8 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:03:01.317080 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-22f0dcb8-acad-4854-b099-f3778b7431e8 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:03:01.317568 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-22f0dcb8-acad-4854-b099-f3778b7431e8 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:03:01.328886 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-22f0dcb8-acad-4854-b099-f3778b7431e8 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:01.329608 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-22f0dcb8-acad-4854-b099-f3778b7431e8 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:01.330143 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-22f0dcb8-acad-4854-b099-f3778b7431e8 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:01.331009 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-22f0dcb8-acad-4854-b099-f3778b7431e8 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:01.331561 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-22f0dcb8-acad-4854-b099-f3778b7431e8 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:01.332089 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-22f0dcb8-acad-4854-b099-f3778b7431e8 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:01.365839 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-22f0dcb8-acad-4854-b099-f3778b7431e8 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Getting quotas for project 150e5f8e376a40e089de8ed092e269fd. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:03:01.376913 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-22f0dcb8-acad-4854-b099-f3778b7431e8 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Getting quotas for user de0e032fc09b48ada1dfe99e549aa623 and project 150e5f8e376a40e089de8ed092e269fd. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:03:01.496036 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-22f0dcb8-acad-4854-b099-f3778b7431e8 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Going to run 1 instances... {{(pid=122256) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:03:01.499764 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-22f0dcb8-acad-4854-b099-f3778b7431e8 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: dd702273-095b-4d44-8d1b-3d90f7833d5f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ba1fafc0-a0a5-4ab2-ad70-115ecb2c60cf',volume_size=None,volume_type=None)] {{(pid=122256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:03:01.530182 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-926411bb-693e-47ec-90e6-eccfd3a41081 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ccd03a4aa84f93bc26b438e1468f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a9f3fcc4b445349e5c66ff712e8598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:01.552055 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-926411bb-693e-47ec-90e6-eccfd3a41081 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/servers/cafdad7c-e670-48df-8c07-a2405d19f357" status: 200 len: 1307 microversion: 2.1 time: 0.594289 Aug 31 16:03:01.553133 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 912/1863] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:00 2022] GET /compute/v2.1/servers/cafdad7c-e670-48df-8c07-a2405d19f357 => generated 1307 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:01.559760 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7122c54c-6be3-4f1d-b44c-3f11214ca932 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:01.562361 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7122c54c-6be3-4f1d-b44c-3f11214ca932 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 646d0250-a626-4bd1-821b-2117fde78cc8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:01.578763 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7122c54c-6be3-4f1d-b44c-3f11214ca932 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:01.582513 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7122c54c-6be3-4f1d-b44c-3f11214ca932 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:01.585289 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7122c54c-6be3-4f1d-b44c-3f11214ca932 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:01.595026 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7122c54c-6be3-4f1d-b44c-3f11214ca932 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:01.597256 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7122c54c-6be3-4f1d-b44c-3f11214ca932 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:01.598156 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7122c54c-6be3-4f1d-b44c-3f11214ca932 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:01.659781 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=100 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:03:01.822774 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-22f0dcb8-acad-4854-b099-f3778b7431e8 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.867280 Aug 31 16:03:01.833004 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7122c54c-6be3-4f1d-b44c-3f11214ca932 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:01.845708 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 952/1864] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:02:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 2891 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 16:03:01.858671 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7122c54c-6be3-4f1d-b44c-3f11214ca932 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/646d0250-a626-4bd1-821b-2117fde78cc8" status: 200 len: 1276 microversion: 2.1 time: 0.300395 Aug 31 16:03:01.878532 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 913/1865] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:01 2022] GET /compute/v2.1/servers/646d0250-a626-4bd1-821b-2117fde78cc8 => generated 1276 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:01.910849 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-0e444095-aa0f-4ded-bd27-e077f98a41b7 req-14318e50-eaf6-46e4-835c-57a6975856f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cafdad7c-e670-48df-8c07-a2405d19f357", "name": "network-vif-plugged", "status": "completed", "tag": "8b9d6092-352b-4fc5-a622-919e58ed2dea"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:03:01.929634 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6dec9ff1-80a0-4053-bfc4-91831ddf75eb tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:01.930430 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6dec9ff1-80a0-4053-bfc4-91831ddf75eb tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6e82c98f-d644-4464-aca0-13901e551aa4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:01.975900 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:03:01.982729 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6dec9ff1-80a0-4053-bfc4-91831ddf75eb tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:01.983365 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6dec9ff1-80a0-4053-bfc4-91831ddf75eb tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:01.986574 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6dec9ff1-80a0-4053-bfc4-91831ddf75eb tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:01.993547 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6dec9ff1-80a0-4053-bfc4-91831ddf75eb tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:01.999164 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6dec9ff1-80a0-4053-bfc4-91831ddf75eb tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:02.000075 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6dec9ff1-80a0-4053-bfc4-91831ddf75eb tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:02.003659 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-0e444095-aa0f-4ded-bd27-e077f98a41b7 req-14318e50-eaf6-46e4-835c-57a6975856f0 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:02.004833 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-0e444095-aa0f-4ded-bd27-e077f98a41b7 req-14318e50-eaf6-46e4-835c-57a6975856f0 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:02.008075 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-0e444095-aa0f-4ded-bd27-e077f98a41b7 req-14318e50-eaf6-46e4-835c-57a6975856f0 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:02.063917 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-0e444095-aa0f-4ded-bd27-e077f98a41b7 req-14318e50-eaf6-46e4-835c-57a6975856f0 service nova] Creating event network-vif-plugged:8b9d6092-352b-4fc5-a622-919e58ed2dea for instance cafdad7c-e670-48df-8c07-a2405d19f357 on n-h1-850499-9 Aug 31 16:03:02.080671 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-0e444095-aa0f-4ded-bd27-e077f98a41b7 req-14318e50-eaf6-46e4-835c-57a6975856f0 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.225278 Aug 31 16:03:02.099021 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 953/1866] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:03:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:03:02.115111 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ceae238a-db73-4263-b39f-2a920baff878 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:02.116727 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ceae238a-db73-4263-b39f-2a920baff878 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: dd702273-095b-4d44-8d1b-3d90f7833d5f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:02.894610 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ceae238a-db73-4263-b39f-2a920baff878 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:02.914923 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ceae238a-db73-4263-b39f-2a920baff878 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f" status: 200 len: 1053 microversion: 2.1 time: 0.814486 Aug 31 16:03:02.917462 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 954/1867] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:02 2022] GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f => generated 1053 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:02.954833 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-91cf8a71-fe22-418f-b8ed-99f72b38f1ac tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:02.957313 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-91cf8a71-fe22-418f-b8ed-99f72b38f1ac tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: b1c1e611-4be6-4a43-aaf0-d02bfd87875c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:02.974206 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-91cf8a71-fe22-418f-b8ed-99f72b38f1ac tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:02.974898 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-91cf8a71-fe22-418f-b8ed-99f72b38f1ac tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:02.975541 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-91cf8a71-fe22-418f-b8ed-99f72b38f1ac tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:02.976417 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-91cf8a71-fe22-418f-b8ed-99f72b38f1ac tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:02.976975 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-91cf8a71-fe22-418f-b8ed-99f72b38f1ac tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:02.977894 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-91cf8a71-fe22-418f-b8ed-99f72b38f1ac tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:03.316003 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-6dec9ff1-80a0-4053-bfc4-91831ddf75eb tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:03.332207 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6dec9ff1-80a0-4053-bfc4-91831ddf75eb tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4" status: 200 len: 1312 microversion: 2.1 time: 1.450956 Aug 31 16:03:03.333669 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 914/1868] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:01 2022] GET /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4 => generated 1312 bytes in 1454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:03.342627 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-856600d4-df6c-4028-8720-d9217088ff2c tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:03.343737 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-856600d4-df6c-4028-8720-d9217088ff2c tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: cafdad7c-e670-48df-8c07-a2405d19f357] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:03.351327 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-856600d4-df6c-4028-8720-d9217088ff2c tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:03.352066 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-856600d4-df6c-4028-8720-d9217088ff2c tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:03.352710 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-856600d4-df6c-4028-8720-d9217088ff2c tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:03.355584 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-856600d4-df6c-4028-8720-d9217088ff2c tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:03.356395 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-856600d4-df6c-4028-8720-d9217088ff2c tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:03.357758 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-856600d4-df6c-4028-8720-d9217088ff2c tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:03.741806 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-91cf8a71-fe22-418f-b8ed-99f72b38f1ac tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:03.760237 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-91cf8a71-fe22-418f-b8ed-99f72b38f1ac tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/b1c1e611-4be6-4a43-aaf0-d02bfd87875c" status: 200 len: 1315 microversion: 2.1 time: 0.839300 Aug 31 16:03:03.763094 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 955/1869] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:02 2022] GET /compute/v2.1/servers/b1c1e611-4be6-4a43-aaf0-d02bfd87875c => generated 1315 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:03.776107 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9d36e1b9-3d52-4bab-8af1-b44f96e49088 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:03.777762 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9d36e1b9-3d52-4bab-8af1-b44f96e49088 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 646d0250-a626-4bd1-821b-2117fde78cc8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:03.793950 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9d36e1b9-3d52-4bab-8af1-b44f96e49088 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:03.794430 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9d36e1b9-3d52-4bab-8af1-b44f96e49088 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:03.795052 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9d36e1b9-3d52-4bab-8af1-b44f96e49088 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:03.797480 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9d36e1b9-3d52-4bab-8af1-b44f96e49088 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:03.798796 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9d36e1b9-3d52-4bab-8af1-b44f96e49088 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:03.799546 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9d36e1b9-3d52-4bab-8af1-b44f96e49088 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:04.396317 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-856600d4-df6c-4028-8720-d9217088ff2c tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ccd03a4aa84f93bc26b438e1468f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a9f3fcc4b445349e5c66ff712e8598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:04.404772 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-856600d4-df6c-4028-8720-d9217088ff2c tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/servers/cafdad7c-e670-48df-8c07-a2405d19f357" status: 200 len: 1307 microversion: 2.1 time: 1.069433 Aug 31 16:03:04.405644 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 915/1870] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:03 2022] GET /compute/v2.1/servers/cafdad7c-e670-48df-8c07-a2405d19f357 => generated 1307 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:04.411103 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-889c6e57-99c0-495a-924e-c8045c20f5ca req-f57cd89f-32fc-44d0-9225-41e149d864ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "646d0250-a626-4bd1-821b-2117fde78cc8", "tag": "747c0501-222d-4eee-84f7-1e23b1a1f270"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:03:04.427188 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-889c6e57-99c0-495a-924e-c8045c20f5ca req-f57cd89f-32fc-44d0-9225-41e149d864ca service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:04.428105 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-889c6e57-99c0-495a-924e-c8045c20f5ca req-f57cd89f-32fc-44d0-9225-41e149d864ca service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:04.428721 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-889c6e57-99c0-495a-924e-c8045c20f5ca req-f57cd89f-32fc-44d0-9225-41e149d864ca service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:04.445769 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-889c6e57-99c0-495a-924e-c8045c20f5ca req-f57cd89f-32fc-44d0-9225-41e149d864ca service nova] Creating event network-changed:747c0501-222d-4eee-84f7-1e23b1a1f270 for instance 646d0250-a626-4bd1-821b-2117fde78cc8 on n-h1-850499-9 Aug 31 16:03:04.466040 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-889c6e57-99c0-495a-924e-c8045c20f5ca req-f57cd89f-32fc-44d0-9225-41e149d864ca service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059014 Aug 31 16:03:04.468148 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 916/1871] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:03:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:03:04.475263 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e61264c4-98f8-49c2-83db-776fb2121f9a tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:04.476228 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e61264c4-98f8-49c2-83db-776fb2121f9a tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: dd702273-095b-4d44-8d1b-3d90f7833d5f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:04.483865 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e61264c4-98f8-49c2-83db-776fb2121f9a tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:04.485094 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e61264c4-98f8-49c2-83db-776fb2121f9a tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:04.485646 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e61264c4-98f8-49c2-83db-776fb2121f9a tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:04.487209 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e61264c4-98f8-49c2-83db-776fb2121f9a tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:04.487982 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e61264c4-98f8-49c2-83db-776fb2121f9a tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:04.488544 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e61264c4-98f8-49c2-83db-776fb2121f9a tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:04.686659 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e61264c4-98f8-49c2-83db-776fb2121f9a tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:04.697511 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e61264c4-98f8-49c2-83db-776fb2121f9a tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f" status: 200 len: 1151 microversion: 2.1 time: 0.227649 Aug 31 16:03:04.699078 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 917/1872] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:04 2022] GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f => generated 1151 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:04.705175 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-f6b0fd7a-3764-4698-bcd0-6010339e444c req-e67e4e59-9a5d-469b-b738-f08833f60228 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e82c98f-d644-4464-aca0-13901e551aa4", "name": "network-vif-plugged", "status": "completed", "tag": "0dddc681-0580-40ec-b2fe-b4af40412267"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:03:04.709669 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-9d36e1b9-3d52-4bab-8af1-b44f96e49088 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:04.718319 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9d36e1b9-3d52-4bab-8af1-b44f96e49088 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/646d0250-a626-4bd1-821b-2117fde78cc8" status: 200 len: 1318 microversion: 2.1 time: 0.953194 Aug 31 16:03:04.719200 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 956/1873] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:03 2022] GET /compute/v2.1/servers/646d0250-a626-4bd1-821b-2117fde78cc8 => generated 1318 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:04.723397 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f20d8974-9dbd-4117-9dc6-ba77dddbeee5 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:04.732785 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-f6b0fd7a-3764-4698-bcd0-6010339e444c req-e67e4e59-9a5d-469b-b738-f08833f60228 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:04.733464 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f20d8974-9dbd-4117-9dc6-ba77dddbeee5 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6e82c98f-d644-4464-aca0-13901e551aa4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:04.733933 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-f6b0fd7a-3764-4698-bcd0-6010339e444c req-e67e4e59-9a5d-469b-b738-f08833f60228 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:04.734589 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-f6b0fd7a-3764-4698-bcd0-6010339e444c req-e67e4e59-9a5d-469b-b738-f08833f60228 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:04.749205 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-f6b0fd7a-3764-4698-bcd0-6010339e444c req-e67e4e59-9a5d-469b-b738-f08833f60228 service nova] Creating event network-vif-plugged:0dddc681-0580-40ec-b2fe-b4af40412267 for instance 6e82c98f-d644-4464-aca0-13901e551aa4 on n-h1-850499-9 Aug 31 16:03:04.756032 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-f6b0fd7a-3764-4698-bcd0-6010339e444c req-e67e4e59-9a5d-469b-b738-f08833f60228 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055436 Aug 31 16:03:04.757297 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 918/1874] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:03:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:03:04.771050 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f20d8974-9dbd-4117-9dc6-ba77dddbeee5 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:04.771617 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f20d8974-9dbd-4117-9dc6-ba77dddbeee5 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:04.772056 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f20d8974-9dbd-4117-9dc6-ba77dddbeee5 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:04.775341 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f20d8974-9dbd-4117-9dc6-ba77dddbeee5 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:04.775894 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f20d8974-9dbd-4117-9dc6-ba77dddbeee5 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:04.776345 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f20d8974-9dbd-4117-9dc6-ba77dddbeee5 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:04.787320 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3492a47b-3059-46c6-81dc-b4061e58c116 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:04.788053 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3492a47b-3059-46c6-81dc-b4061e58c116 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: b1c1e611-4be6-4a43-aaf0-d02bfd87875c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:04.798670 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3492a47b-3059-46c6-81dc-b4061e58c116 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:04.800295 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3492a47b-3059-46c6-81dc-b4061e58c116 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:04.800931 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3492a47b-3059-46c6-81dc-b4061e58c116 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:04.802013 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3492a47b-3059-46c6-81dc-b4061e58c116 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:04.802655 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3492a47b-3059-46c6-81dc-b4061e58c116 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:04.803775 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3492a47b-3059-46c6-81dc-b4061e58c116 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:05.180000 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f20d8974-9dbd-4117-9dc6-ba77dddbeee5 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:05.189968 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3492a47b-3059-46c6-81dc-b4061e58c116 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:05.199754 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f20d8974-9dbd-4117-9dc6-ba77dddbeee5 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4" status: 200 len: 1312 microversion: 2.1 time: 0.479497 Aug 31 16:03:05.200054 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3492a47b-3059-46c6-81dc-b4061e58c116 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/b1c1e611-4be6-4a43-aaf0-d02bfd87875c" status: 200 len: 1315 microversion: 2.1 time: 0.418022 Aug 31 16:03:05.200898 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 919/1875] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:04 2022] GET /compute/v2.1/servers/b1c1e611-4be6-4a43-aaf0-d02bfd87875c => generated 1315 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:05.214005 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 957/1876] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:04 2022] GET /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4 => generated 1312 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:05.433641 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-fc6cdeb5-8d3e-4532-8106-fc4dc91532be tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:05.434204 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-fc6cdeb5-8d3e-4532-8106-fc4dc91532be tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: cafdad7c-e670-48df-8c07-a2405d19f357] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:05.441835 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fc6cdeb5-8d3e-4532-8106-fc4dc91532be tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:05.442836 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fc6cdeb5-8d3e-4532-8106-fc4dc91532be tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:05.443461 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fc6cdeb5-8d3e-4532-8106-fc4dc91532be tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:05.444637 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fc6cdeb5-8d3e-4532-8106-fc4dc91532be tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:05.445313 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fc6cdeb5-8d3e-4532-8106-fc4dc91532be tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:05.445889 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fc6cdeb5-8d3e-4532-8106-fc4dc91532be tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:05.574279 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-be090fa2-2541-4d78-848c-6a4a7fa14189 req-97c2d6fb-230b-4408-9ab3-97560af9f736 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf253a58-f38a-42d9-90b6-f3a80141cad2", "tag": "c9f01bdb-2d61-4e28-bce8-39dd0d48b820"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:03:05.585313 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-be090fa2-2541-4d78-848c-6a4a7fa14189 req-97c2d6fb-230b-4408-9ab3-97560af9f736 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:05.586201 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-be090fa2-2541-4d78-848c-6a4a7fa14189 req-97c2d6fb-230b-4408-9ab3-97560af9f736 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:05.586853 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-be090fa2-2541-4d78-848c-6a4a7fa14189 req-97c2d6fb-230b-4408-9ab3-97560af9f736 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:05.602050 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-be090fa2-2541-4d78-848c-6a4a7fa14189 req-97c2d6fb-230b-4408-9ab3-97560af9f736 service nova] Creating event network-changed:c9f01bdb-2d61-4e28-bce8-39dd0d48b820 for instance bf253a58-f38a-42d9-90b6-f3a80141cad2 on n-h2-850499-9 Aug 31 16:03:05.608689 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-be090fa2-2541-4d78-848c-6a4a7fa14189 req-97c2d6fb-230b-4408-9ab3-97560af9f736 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038229 Aug 31 16:03:05.609905 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 958/1877] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:03:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:03:05.680190 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-fc6cdeb5-8d3e-4532-8106-fc4dc91532be tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ccd03a4aa84f93bc26b438e1468f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a9f3fcc4b445349e5c66ff712e8598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:05.691443 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-fc6cdeb5-8d3e-4532-8106-fc4dc91532be tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/servers/cafdad7c-e670-48df-8c07-a2405d19f357" status: 200 len: 1488 microversion: 2.1 time: 0.265095 Aug 31 16:03:05.692067 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 920/1878] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:05 2022] GET /compute/v2.1/servers/cafdad7c-e670-48df-8c07-a2405d19f357 => generated 1488 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:05.716613 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-bb31d224-ff07-497e-8640-c1c93e0b30a6 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:03:05.717297 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-bb31d224-ff07-497e-8640-c1c93e0b30a6 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: cafdad7c-e670-48df-8c07-a2405d19f357] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:05.721853 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f89d9106-0329-4295-8a9e-dbbccc429ecc tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:05.722591 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f89d9106-0329-4295-8a9e-dbbccc429ecc tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: dd702273-095b-4d44-8d1b-3d90f7833d5f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:05.726475 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bb31d224-ff07-497e-8640-c1c93e0b30a6 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:05.727290 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bb31d224-ff07-497e-8640-c1c93e0b30a6 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:05.727755 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bb31d224-ff07-497e-8640-c1c93e0b30a6 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:05.728663 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bb31d224-ff07-497e-8640-c1c93e0b30a6 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:05.731466 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bb31d224-ff07-497e-8640-c1c93e0b30a6 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:05.731648 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f89d9106-0329-4295-8a9e-dbbccc429ecc tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:05.731648 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f89d9106-0329-4295-8a9e-dbbccc429ecc tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:05.733684 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bb31d224-ff07-497e-8640-c1c93e0b30a6 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:05.734556 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f89d9106-0329-4295-8a9e-dbbccc429ecc tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:05.735471 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f89d9106-0329-4295-8a9e-dbbccc429ecc tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:05.736038 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f89d9106-0329-4295-8a9e-dbbccc429ecc tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:05.736716 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f89d9106-0329-4295-8a9e-dbbccc429ecc tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:05.761248 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-bb31d224-ff07-497e-8640-c1c93e0b30a6 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lazy-loading 'flavor' on Instance uuid cafdad7c-e670-48df-8c07-a2405d19f357 {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:03:05.809179 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f89d9106-0329-4295-8a9e-dbbccc429ecc tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:05.822574 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f89d9106-0329-4295-8a9e-dbbccc429ecc tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f" status: 200 len: 1159 microversion: 2.1 time: 0.106704 Aug 31 16:03:05.823770 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 921/1879] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:05 2022] GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f => generated 1159 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:03:05.837028 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8923273c-9767-4171-afb9-27f436ea3000 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:05.837982 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8923273c-9767-4171-afb9-27f436ea3000 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 646d0250-a626-4bd1-821b-2117fde78cc8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:05.845972 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-bb31d224-ff07-497e-8640-c1c93e0b30a6 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "POST /compute/v2.1/servers/cafdad7c-e670-48df-8c07-a2405d19f357/action" status: 202 len: 0 microversion: 2.1 time: 0.134000 Aug 31 16:03:05.846236 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8923273c-9767-4171-afb9-27f436ea3000 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:05.846650 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8923273c-9767-4171-afb9-27f436ea3000 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:05.849748 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 959/1880] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:03:05 2022] POST /compute/v2.1/servers/cafdad7c-e670-48df-8c07-a2405d19f357/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:03:05.850506 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8923273c-9767-4171-afb9-27f436ea3000 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:05.851436 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8923273c-9767-4171-afb9-27f436ea3000 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:05.851972 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8923273c-9767-4171-afb9-27f436ea3000 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:05.852411 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8923273c-9767-4171-afb9-27f436ea3000 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:05.856586 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b34de63d-acdd-49ae-b17a-ea27a0054270 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:05.857870 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b34de63d-acdd-49ae-b17a-ea27a0054270 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: cafdad7c-e670-48df-8c07-a2405d19f357] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:05.864563 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b34de63d-acdd-49ae-b17a-ea27a0054270 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:05.865493 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b34de63d-acdd-49ae-b17a-ea27a0054270 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:05.866720 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b34de63d-acdd-49ae-b17a-ea27a0054270 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:05.867685 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b34de63d-acdd-49ae-b17a-ea27a0054270 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:05.868318 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b34de63d-acdd-49ae-b17a-ea27a0054270 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:05.869452 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b34de63d-acdd-49ae-b17a-ea27a0054270 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:06.085110 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8923273c-9767-4171-afb9-27f436ea3000 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:06.093192 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8923273c-9767-4171-afb9-27f436ea3000 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/646d0250-a626-4bd1-821b-2117fde78cc8" status: 200 len: 1318 microversion: 2.1 time: 0.268051 Aug 31 16:03:06.105008 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b34de63d-acdd-49ae-b17a-ea27a0054270 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ccd03a4aa84f93bc26b438e1468f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a9f3fcc4b445349e5c66ff712e8598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:06.107626 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 922/1881] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:05 2022] GET /compute/v2.1/servers/646d0250-a626-4bd1-821b-2117fde78cc8 => generated 1318 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:06.118435 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b34de63d-acdd-49ae-b17a-ea27a0054270 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/servers/cafdad7c-e670-48df-8c07-a2405d19f357" status: 200 len: 1496 microversion: 2.1 time: 0.267103 Aug 31 16:03:06.120333 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 960/1882] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:05 2022] GET /compute/v2.1/servers/cafdad7c-e670-48df-8c07-a2405d19f357 => generated 1496 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:03:06.221603 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ae72db8a-778d-483b-ade9-9890da513c66 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:06.222472 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ae72db8a-778d-483b-ade9-9890da513c66 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: b1c1e611-4be6-4a43-aaf0-d02bfd87875c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:06.222809 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b05b757b-30f9-48fe-af57-edb6fa93c8f6 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:06.224706 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b05b757b-30f9-48fe-af57-edb6fa93c8f6 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6e82c98f-d644-4464-aca0-13901e551aa4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:06.228706 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ae72db8a-778d-483b-ade9-9890da513c66 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:06.229437 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ae72db8a-778d-483b-ade9-9890da513c66 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:06.230050 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ae72db8a-778d-483b-ade9-9890da513c66 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:06.230939 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ae72db8a-778d-483b-ade9-9890da513c66 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:06.231583 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ae72db8a-778d-483b-ade9-9890da513c66 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:06.232829 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ae72db8a-778d-483b-ade9-9890da513c66 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:06.234941 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b05b757b-30f9-48fe-af57-edb6fa93c8f6 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:06.235434 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b05b757b-30f9-48fe-af57-edb6fa93c8f6 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:06.235907 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b05b757b-30f9-48fe-af57-edb6fa93c8f6 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:06.236617 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b05b757b-30f9-48fe-af57-edb6fa93c8f6 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:06.237101 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b05b757b-30f9-48fe-af57-edb6fa93c8f6 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:06.237526 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b05b757b-30f9-48fe-af57-edb6fa93c8f6 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:06.446512 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b05b757b-30f9-48fe-af57-edb6fa93c8f6 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:06.463923 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ae72db8a-778d-483b-ade9-9890da513c66 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:06.466665 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b05b757b-30f9-48fe-af57-edb6fa93c8f6 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4" status: 200 len: 1312 microversion: 2.1 time: 0.248220 Aug 31 16:03:06.467260 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 961/1883] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:06 2022] GET /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4 => generated 1312 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:06.472952 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ae72db8a-778d-483b-ade9-9890da513c66 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/b1c1e611-4be6-4a43-aaf0-d02bfd87875c" status: 200 len: 1315 microversion: 2.1 time: 0.255167 Aug 31 16:03:06.474114 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 923/1884] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:06 2022] GET /compute/v2.1/servers/b1c1e611-4be6-4a43-aaf0-d02bfd87875c => generated 1315 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:06.847036 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-82c7b162-9978-46e5-a84e-ce907ba33b72 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:06.848861 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-82c7b162-9978-46e5-a84e-ce907ba33b72 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: dd702273-095b-4d44-8d1b-3d90f7833d5f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:06.855707 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-82c7b162-9978-46e5-a84e-ce907ba33b72 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:06.856199 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-82c7b162-9978-46e5-a84e-ce907ba33b72 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:06.857447 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-82c7b162-9978-46e5-a84e-ce907ba33b72 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:06.858794 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-82c7b162-9978-46e5-a84e-ce907ba33b72 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:06.859470 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-82c7b162-9978-46e5-a84e-ce907ba33b72 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:06.860128 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-82c7b162-9978-46e5-a84e-ce907ba33b72 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:06.938254 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-82c7b162-9978-46e5-a84e-ce907ba33b72 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:06.946882 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-82c7b162-9978-46e5-a84e-ce907ba33b72 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f" status: 200 len: 1159 microversion: 2.1 time: 0.104012 Aug 31 16:03:06.947459 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 962/1885] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:06 2022] GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f => generated 1159 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:07.114474 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c2c76c5f-6bc1-4965-8a48-1a13e6231422 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:07.115097 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c2c76c5f-6bc1-4965-8a48-1a13e6231422 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 646d0250-a626-4bd1-821b-2117fde78cc8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:07.125740 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c2c76c5f-6bc1-4965-8a48-1a13e6231422 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:07.126670 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c2c76c5f-6bc1-4965-8a48-1a13e6231422 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:07.127538 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c2c76c5f-6bc1-4965-8a48-1a13e6231422 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:07.128906 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c2c76c5f-6bc1-4965-8a48-1a13e6231422 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:07.129546 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c2c76c5f-6bc1-4965-8a48-1a13e6231422 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:07.130355 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c2c76c5f-6bc1-4965-8a48-1a13e6231422 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:07.143201 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-18a6737c-6834-4ecc-bd33-6de113841fa3 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:07.144635 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-18a6737c-6834-4ecc-bd33-6de113841fa3 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: cafdad7c-e670-48df-8c07-a2405d19f357] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:07.157203 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-18a6737c-6834-4ecc-bd33-6de113841fa3 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:07.162004 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-18a6737c-6834-4ecc-bd33-6de113841fa3 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:07.162666 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-18a6737c-6834-4ecc-bd33-6de113841fa3 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:07.163592 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-18a6737c-6834-4ecc-bd33-6de113841fa3 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:07.164213 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-18a6737c-6834-4ecc-bd33-6de113841fa3 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:07.164810 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-18a6737c-6834-4ecc-bd33-6de113841fa3 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:07.190221 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=10 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:03:07.205850 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:03:07.408182 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c2c76c5f-6bc1-4965-8a48-1a13e6231422 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:07.411484 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-18a6737c-6834-4ecc-bd33-6de113841fa3 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ccd03a4aa84f93bc26b438e1468f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a9f3fcc4b445349e5c66ff712e8598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:07.422311 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-18a6737c-6834-4ecc-bd33-6de113841fa3 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/servers/cafdad7c-e670-48df-8c07-a2405d19f357" status: 200 len: 1496 microversion: 2.1 time: 0.284738 Aug 31 16:03:07.423134 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 963/1886] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:07 2022] GET /compute/v2.1/servers/cafdad7c-e670-48df-8c07-a2405d19f357 => generated 1496 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:07.446587 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c2c76c5f-6bc1-4965-8a48-1a13e6231422 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/646d0250-a626-4bd1-821b-2117fde78cc8" status: 200 len: 1318 microversion: 2.1 time: 0.336020 Aug 31 16:03:07.448477 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 924/1887] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:07 2022] GET /compute/v2.1/servers/646d0250-a626-4bd1-821b-2117fde78cc8 => generated 1318 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:07.488231 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-40ba98e7-4115-40f9-9e10-36368077d016 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:07.489045 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-40ba98e7-4115-40f9-9e10-36368077d016 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6e82c98f-d644-4464-aca0-13901e551aa4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:07.495589 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c7aab953-d4d1-4a39-b7dd-8344c50f9542 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:07.496217 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c7aab953-d4d1-4a39-b7dd-8344c50f9542 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: b1c1e611-4be6-4a43-aaf0-d02bfd87875c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:07.502583 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-40ba98e7-4115-40f9-9e10-36368077d016 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:07.504788 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-40ba98e7-4115-40f9-9e10-36368077d016 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:07.507882 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-40ba98e7-4115-40f9-9e10-36368077d016 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:07.512238 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-40ba98e7-4115-40f9-9e10-36368077d016 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:07.513052 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-40ba98e7-4115-40f9-9e10-36368077d016 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:07.516101 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-40ba98e7-4115-40f9-9e10-36368077d016 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:07.517595 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c7aab953-d4d1-4a39-b7dd-8344c50f9542 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:07.519525 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c7aab953-d4d1-4a39-b7dd-8344c50f9542 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:07.520465 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c7aab953-d4d1-4a39-b7dd-8344c50f9542 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:07.522153 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c7aab953-d4d1-4a39-b7dd-8344c50f9542 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:07.522917 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c7aab953-d4d1-4a39-b7dd-8344c50f9542 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:07.526732 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c7aab953-d4d1-4a39-b7dd-8344c50f9542 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:07.654771 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=30 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:03:07.851080 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-40ba98e7-4115-40f9-9e10-36368077d016 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:07.860762 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-40ba98e7-4115-40f9-9e10-36368077d016 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4" status: 200 len: 1312 microversion: 2.1 time: 0.376531 Aug 31 16:03:07.861595 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 964/1888] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:07 2022] GET /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4 => generated 1312 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:07.901569 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c7aab953-d4d1-4a39-b7dd-8344c50f9542 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:07.917274 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c7aab953-d4d1-4a39-b7dd-8344c50f9542 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/b1c1e611-4be6-4a43-aaf0-d02bfd87875c" status: 200 len: 1315 microversion: 2.1 time: 0.426184 Aug 31 16:03:07.930653 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 925/1889] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:07 2022] GET /compute/v2.1/servers/b1c1e611-4be6-4a43-aaf0-d02bfd87875c => generated 1315 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:07.968933 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-cde20efd-e09b-45d0-b48a-0fbcc77ebb57 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:07.969556 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-cde20efd-e09b-45d0-b48a-0fbcc77ebb57 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: dd702273-095b-4d44-8d1b-3d90f7833d5f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:07.975573 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cde20efd-e09b-45d0-b48a-0fbcc77ebb57 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:07.976292 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cde20efd-e09b-45d0-b48a-0fbcc77ebb57 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:07.976935 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cde20efd-e09b-45d0-b48a-0fbcc77ebb57 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:07.977808 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cde20efd-e09b-45d0-b48a-0fbcc77ebb57 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:07.978451 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cde20efd-e09b-45d0-b48a-0fbcc77ebb57 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:07.979069 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cde20efd-e09b-45d0-b48a-0fbcc77ebb57 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:08.445352 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a6af35a6-a428-4ec7-8484-fb7ab939301c tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:08.445966 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a6af35a6-a428-4ec7-8484-fb7ab939301c tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: cafdad7c-e670-48df-8c07-a2405d19f357] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:08.462435 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a6af35a6-a428-4ec7-8484-fb7ab939301c tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:08.463121 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a6af35a6-a428-4ec7-8484-fb7ab939301c tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:08.463584 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a6af35a6-a428-4ec7-8484-fb7ab939301c tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:08.464297 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a6af35a6-a428-4ec7-8484-fb7ab939301c tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:08.464751 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a6af35a6-a428-4ec7-8484-fb7ab939301c tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:08.465177 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a6af35a6-a428-4ec7-8484-fb7ab939301c tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:08.519058 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-cde20efd-e09b-45d0-b48a-0fbcc77ebb57 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:08.545450 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-cde20efd-e09b-45d0-b48a-0fbcc77ebb57 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f" status: 200 len: 1159 microversion: 2.1 time: 0.576022 Aug 31 16:03:08.547207 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 965/1890] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:07 2022] GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f => generated 1159 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:08.572129 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0d37cfcb-bd04-4add-ba10-5faaffce4210 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:08.572129 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0d37cfcb-bd04-4add-ba10-5faaffce4210 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 646d0250-a626-4bd1-821b-2117fde78cc8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:08.592254 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0d37cfcb-bd04-4add-ba10-5faaffce4210 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:08.598404 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0d37cfcb-bd04-4add-ba10-5faaffce4210 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:08.604069 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0d37cfcb-bd04-4add-ba10-5faaffce4210 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:08.605183 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0d37cfcb-bd04-4add-ba10-5faaffce4210 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:08.606853 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0d37cfcb-bd04-4add-ba10-5faaffce4210 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:08.611974 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0d37cfcb-bd04-4add-ba10-5faaffce4210 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:08.867101 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a6af35a6-a428-4ec7-8484-fb7ab939301c tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ccd03a4aa84f93bc26b438e1468f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a9f3fcc4b445349e5c66ff712e8598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:08.879950 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a6af35a6-a428-4ec7-8484-fb7ab939301c tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/servers/cafdad7c-e670-48df-8c07-a2405d19f357" status: 200 len: 1496 microversion: 2.1 time: 0.438577 Aug 31 16:03:08.880944 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 926/1891] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:08 2022] GET /compute/v2.1/servers/cafdad7c-e670-48df-8c07-a2405d19f357 => generated 1496 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:08.885804 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7cc02e9a-b2d5-4836-af58-d3519ed155ee tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:08.886411 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7cc02e9a-b2d5-4836-af58-d3519ed155ee tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6e82c98f-d644-4464-aca0-13901e551aa4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:08.907041 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7cc02e9a-b2d5-4836-af58-d3519ed155ee tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:08.907638 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7cc02e9a-b2d5-4836-af58-d3519ed155ee tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:08.908078 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7cc02e9a-b2d5-4836-af58-d3519ed155ee tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:08.908789 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7cc02e9a-b2d5-4836-af58-d3519ed155ee tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:08.909245 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7cc02e9a-b2d5-4836-af58-d3519ed155ee tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:08.909670 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7cc02e9a-b2d5-4836-af58-d3519ed155ee tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:09.454370 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-0d37cfcb-bd04-4add-ba10-5faaffce4210 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:09.465428 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0d37cfcb-bd04-4add-ba10-5faaffce4210 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/646d0250-a626-4bd1-821b-2117fde78cc8" status: 200 len: 1318 microversion: 2.1 time: 0.913896 Aug 31 16:03:09.484193 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 966/1892] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:08 2022] GET /compute/v2.1/servers/646d0250-a626-4bd1-821b-2117fde78cc8 => generated 1318 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:09.495424 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-db724169-5e3e-4a24-9267-a4de6db85e23 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:09.500467 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-db724169-5e3e-4a24-9267-a4de6db85e23 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: b1c1e611-4be6-4a43-aaf0-d02bfd87875c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:09.507434 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-db724169-5e3e-4a24-9267-a4de6db85e23 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:09.515178 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-db724169-5e3e-4a24-9267-a4de6db85e23 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:09.516071 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-db724169-5e3e-4a24-9267-a4de6db85e23 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:09.517065 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-db724169-5e3e-4a24-9267-a4de6db85e23 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:09.517516 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-db724169-5e3e-4a24-9267-a4de6db85e23 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:09.518079 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-db724169-5e3e-4a24-9267-a4de6db85e23 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:09.883432 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7cc02e9a-b2d5-4836-af58-d3519ed155ee tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:09.898538 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7cc02e9a-b2d5-4836-af58-d3519ed155ee tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4" status: 200 len: 1312 microversion: 2.1 time: 1.016195 Aug 31 16:03:09.899492 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 927/1893] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:08 2022] GET /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4 => generated 1312 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:09.917861 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ff9ae8e6-603b-4835-bd66-266beb7639f0 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:09.918770 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ff9ae8e6-603b-4835-bd66-266beb7639f0 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: dd702273-095b-4d44-8d1b-3d90f7833d5f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:09.928651 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ff9ae8e6-603b-4835-bd66-266beb7639f0 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:09.932245 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ff9ae8e6-603b-4835-bd66-266beb7639f0 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:09.933045 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ff9ae8e6-603b-4835-bd66-266beb7639f0 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:09.934060 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ff9ae8e6-603b-4835-bd66-266beb7639f0 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:09.935297 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ff9ae8e6-603b-4835-bd66-266beb7639f0 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:09.939272 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ff9ae8e6-603b-4835-bd66-266beb7639f0 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:10.094227 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ff9ae8e6-603b-4835-bd66-266beb7639f0 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:10.110306 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-db724169-5e3e-4a24-9267-a4de6db85e23 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:10.116550 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ff9ae8e6-603b-4835-bd66-266beb7639f0 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f" status: 200 len: 1169 microversion: 2.1 time: 0.215592 Aug 31 16:03:10.121518 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-db724169-5e3e-4a24-9267-a4de6db85e23 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/b1c1e611-4be6-4a43-aaf0-d02bfd87875c" status: 200 len: 1315 microversion: 2.1 time: 0.635909 Aug 31 16:03:10.137175 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 967/1894] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:09 2022] GET /compute/v2.1/servers/b1c1e611-4be6-4a43-aaf0-d02bfd87875c => generated 1315 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:10.153709 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 928/1895] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:09 2022] GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f => generated 1169 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:10.173521 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-76a88f79-524f-4fe1-9ff7-683191158b25 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:10.175964 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-76a88f79-524f-4fe1-9ff7-683191158b25 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: cafdad7c-e670-48df-8c07-a2405d19f357] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:10.190088 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-76a88f79-524f-4fe1-9ff7-683191158b25 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:10.190603 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-76a88f79-524f-4fe1-9ff7-683191158b25 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:10.191045 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-76a88f79-524f-4fe1-9ff7-683191158b25 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:10.193882 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-76a88f79-524f-4fe1-9ff7-683191158b25 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:10.194386 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-76a88f79-524f-4fe1-9ff7-683191158b25 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:10.198544 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-76a88f79-524f-4fe1-9ff7-683191158b25 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:10.491373 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3d94f798-f08f-4532-aace-ca12667a55ac tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:10.493006 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3d94f798-f08f-4532-aace-ca12667a55ac tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 646d0250-a626-4bd1-821b-2117fde78cc8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:10.515246 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3d94f798-f08f-4532-aace-ca12667a55ac tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:10.516482 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3d94f798-f08f-4532-aace-ca12667a55ac tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:10.519390 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3d94f798-f08f-4532-aace-ca12667a55ac tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:10.520644 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3d94f798-f08f-4532-aace-ca12667a55ac tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:10.523084 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3d94f798-f08f-4532-aace-ca12667a55ac tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:10.523803 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3d94f798-f08f-4532-aace-ca12667a55ac tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:10.649743 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-76a88f79-524f-4fe1-9ff7-683191158b25 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ccd03a4aa84f93bc26b438e1468f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a9f3fcc4b445349e5c66ff712e8598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:10.666272 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-76a88f79-524f-4fe1-9ff7-683191158b25 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/servers/cafdad7c-e670-48df-8c07-a2405d19f357" status: 200 len: 1479 microversion: 2.1 time: 0.526157 Aug 31 16:03:10.666855 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 968/1896] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:10 2022] GET /compute/v2.1/servers/cafdad7c-e670-48df-8c07-a2405d19f357 => generated 1479 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:10.690808 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a9bcbf1e-b4a4-4970-9ce0-871f5e1320e4 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-142736332"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:03:10.693707 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a9bcbf1e-b4a4-4970-9ce0-871f5e1320e4 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: cafdad7c-e670-48df-8c07-a2405d19f357] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:10.720467 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a9bcbf1e-b4a4-4970-9ce0-871f5e1320e4 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:10.721174 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a9bcbf1e-b4a4-4970-9ce0-871f5e1320e4 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:10.721413 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a9bcbf1e-b4a4-4970-9ce0-871f5e1320e4 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:10.726835 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a9bcbf1e-b4a4-4970-9ce0-871f5e1320e4 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:10.730375 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a9bcbf1e-b4a4-4970-9ce0-871f5e1320e4 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:10.730873 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a9bcbf1e-b4a4-4970-9ce0-871f5e1320e4 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:11.292550 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a9bcbf1e-b4a4-4970-9ce0-871f5e1320e4 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "POST /compute/v2.1/servers/cafdad7c-e670-48df-8c07-a2405d19f357/action" status: 202 len: 0 microversion: 2.1 time: 0.605439 Aug 31 16:03:11.293400 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 969/1897] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:03:10 2022] POST /compute/v2.1/servers/cafdad7c-e670-48df-8c07-a2405d19f357/action => generated 0 bytes in 607 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 31 16:03:11.325476 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a167c4c3-5159-496b-b851-62c047db93f8 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:11.327533 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a167c4c3-5159-496b-b851-62c047db93f8 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6e82c98f-d644-4464-aca0-13901e551aa4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:11.361782 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=4 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:03:11.367485 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a167c4c3-5159-496b-b851-62c047db93f8 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:11.369320 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a167c4c3-5159-496b-b851-62c047db93f8 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:11.371105 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a167c4c3-5159-496b-b851-62c047db93f8 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:11.371999 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a167c4c3-5159-496b-b851-62c047db93f8 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:11.373211 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a167c4c3-5159-496b-b851-62c047db93f8 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:11.373718 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a167c4c3-5159-496b-b851-62c047db93f8 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:11.861091 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a167c4c3-5159-496b-b851-62c047db93f8 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:11.877781 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a167c4c3-5159-496b-b851-62c047db93f8 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4" status: 200 len: 1461 microversion: 2.1 time: 0.571236 Aug 31 16:03:11.884915 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 970/1898] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:11 2022] GET /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4 => generated 1461 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:11.899581 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3d94f798-f08f-4532-aace-ca12667a55ac tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:11.920459 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3d94f798-f08f-4532-aace-ca12667a55ac tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/646d0250-a626-4bd1-821b-2117fde78cc8" status: 200 len: 1318 microversion: 2.1 time: 1.430226 Aug 31 16:03:11.923770 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 929/1899] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:10 2022] GET /compute/v2.1/servers/646d0250-a626-4bd1-821b-2117fde78cc8 => generated 1318 bytes in 1438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:11.932725 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a2fcedbe-d499-4dd0-978c-67b7b9fb2026 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:11.933332 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a2fcedbe-d499-4dd0-978c-67b7b9fb2026 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: dd702273-095b-4d44-8d1b-3d90f7833d5f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:11.934339 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-037ad3ce-186e-416e-b6bc-ed360bee445d tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:11.938188 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-037ad3ce-186e-416e-b6bc-ed360bee445d tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: b1c1e611-4be6-4a43-aaf0-d02bfd87875c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:11.948366 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-037ad3ce-186e-416e-b6bc-ed360bee445d tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:11.948875 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-037ad3ce-186e-416e-b6bc-ed360bee445d tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:11.949311 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-037ad3ce-186e-416e-b6bc-ed360bee445d tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:11.950029 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-037ad3ce-186e-416e-b6bc-ed360bee445d tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:11.951042 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-037ad3ce-186e-416e-b6bc-ed360bee445d tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:11.951480 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-037ad3ce-186e-416e-b6bc-ed360bee445d tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:11.956011 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a2fcedbe-d499-4dd0-978c-67b7b9fb2026 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:11.956508 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a2fcedbe-d499-4dd0-978c-67b7b9fb2026 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:11.963892 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a2fcedbe-d499-4dd0-978c-67b7b9fb2026 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:11.964651 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a2fcedbe-d499-4dd0-978c-67b7b9fb2026 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:11.965131 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a2fcedbe-d499-4dd0-978c-67b7b9fb2026 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:11.965560 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a2fcedbe-d499-4dd0-978c-67b7b9fb2026 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:12.492691 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a2fcedbe-d499-4dd0-978c-67b7b9fb2026 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:12.522697 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a2fcedbe-d499-4dd0-978c-67b7b9fb2026 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f" status: 200 len: 1211 microversion: 2.1 time: 0.591278 Aug 31 16:03:12.523443 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 930/1900] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:11 2022] GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f => generated 1211 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:12.536454 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-60670d82-55ba-4368-b672-e60a99794e78 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '.version_select at 0x7f5ae8dfe280>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:12.561315 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-037ad3ce-186e-416e-b6bc-ed360bee445d tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:12.584198 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-037ad3ce-186e-416e-b6bc-ed360bee445d tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/b1c1e611-4be6-4a43-aaf0-d02bfd87875c" status: 200 len: 1315 microversion: 2.1 time: 0.683805 Aug 31 16:03:12.585544 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 971/1901] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:11 2022] GET /compute/v2.1/servers/b1c1e611-4be6-4a43-aaf0-d02bfd87875c => generated 1315 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:12.599077 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-bb268bc0-24f8-414a-a9de-eb998a518aa4 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:03:12.609944 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-bb268bc0-24f8-414a-a9de-eb998a518aa4 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6e82c98f-d644-4464-aca0-13901e551aa4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:12.621345 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bb268bc0-24f8-414a-a9de-eb998a518aa4 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:12.624009 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bb268bc0-24f8-414a-a9de-eb998a518aa4 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:12.625046 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bb268bc0-24f8-414a-a9de-eb998a518aa4 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:12.626344 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bb268bc0-24f8-414a-a9de-eb998a518aa4 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:12.627649 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bb268bc0-24f8-414a-a9de-eb998a518aa4 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:12.629702 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bb268bc0-24f8-414a-a9de-eb998a518aa4 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:12.677470 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-60670d82-55ba-4368-b672-e60a99794e78 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/images/f505c75e-a15d-44cb-980b-62f98132dcb9" status: 200 len: 1439 microversion: 2.1 time: 0.151081 Aug 31 16:03:12.678501 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 931/1902] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:03:12 2022] GET /compute/v2.1/images/f505c75e-a15d-44cb-980b-62f98132dcb9 => generated 1439 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:12.912406 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=30 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:03:12.946641 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-38881612-00f9-4562-8777-da973f7e5571 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:12.947283 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-38881612-00f9-4562-8777-da973f7e5571 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 646d0250-a626-4bd1-821b-2117fde78cc8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:12.965274 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-38881612-00f9-4562-8777-da973f7e5571 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:12.968263 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-38881612-00f9-4562-8777-da973f7e5571 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:12.968969 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-38881612-00f9-4562-8777-da973f7e5571 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:12.969959 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-38881612-00f9-4562-8777-da973f7e5571 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:12.972957 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-38881612-00f9-4562-8777-da973f7e5571 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:12.973682 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-38881612-00f9-4562-8777-da973f7e5571 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:13.027056 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=100 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:03:13.233176 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-bb268bc0-24f8-414a-a9de-eb998a518aa4 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:13.242575 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-bb268bc0-24f8-414a-a9de-eb998a518aa4 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6e82c98f-d644-4464-aca0-13901e551aa4] Old instance type m1.heat2, new instance type m1.heat {{(pid=122256) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 31 16:03:13.266697 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-bb268bc0-24f8-414a-a9de-eb998a518aa4 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:03:13.272309 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-bb268bc0-24f8-414a-a9de-eb998a518aa4 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:03:13.275377 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-bb268bc0-24f8-414a-a9de-eb998a518aa4 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:03:13.277103 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-bb268bc0-24f8-414a-a9de-eb998a518aa4 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:03:13.279730 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-bb268bc0-24f8-414a-a9de-eb998a518aa4 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:03:13.597124 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-bb268bc0-24f8-414a-a9de-eb998a518aa4 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "POST /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4/action" status: 202 len: 0 microversion: 2.1 time: 1.010025 Aug 31 16:03:13.598114 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 972/1903] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:03:12 2022] POST /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4/action => generated 0 bytes in 1012 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:03:13.605314 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3c3d196f-9774-4054-8a7d-920e3a0447c8 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:13.605521 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3c3d196f-9774-4054-8a7d-920e3a0447c8 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: dd702273-095b-4d44-8d1b-3d90f7833d5f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:13.620876 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3c3d196f-9774-4054-8a7d-920e3a0447c8 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:13.621386 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3c3d196f-9774-4054-8a7d-920e3a0447c8 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:13.621837 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3c3d196f-9774-4054-8a7d-920e3a0447c8 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:13.622595 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3c3d196f-9774-4054-8a7d-920e3a0447c8 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:13.623064 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3c3d196f-9774-4054-8a7d-920e3a0447c8 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:13.623514 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3c3d196f-9774-4054-8a7d-920e3a0447c8 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:13.688442 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-38881612-00f9-4562-8777-da973f7e5571 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:13.703786 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-38881612-00f9-4562-8777-da973f7e5571 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/646d0250-a626-4bd1-821b-2117fde78cc8" status: 200 len: 1318 microversion: 2.1 time: 0.757096 Aug 31 16:03:13.706668 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 932/1904] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:12 2022] GET /compute/v2.1/servers/646d0250-a626-4bd1-821b-2117fde78cc8 => generated 1318 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:13.724183 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-04c35bea-3583-49f0-91d2-777deaaeab8f tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:13.726326 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-04c35bea-3583-49f0-91d2-777deaaeab8f tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6e82c98f-d644-4464-aca0-13901e551aa4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:13.749189 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-04c35bea-3583-49f0-91d2-777deaaeab8f tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:13.750002 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-04c35bea-3583-49f0-91d2-777deaaeab8f tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:13.750940 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-04c35bea-3583-49f0-91d2-777deaaeab8f tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:13.754739 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-04c35bea-3583-49f0-91d2-777deaaeab8f tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:13.757247 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-04c35bea-3583-49f0-91d2-777deaaeab8f tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:13.757959 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-04c35bea-3583-49f0-91d2-777deaaeab8f tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:14.135622 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3c3d196f-9774-4054-8a7d-920e3a0447c8 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:14.149658 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3c3d196f-9774-4054-8a7d-920e3a0447c8 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f" status: 200 len: 1211 microversion: 2.1 time: 0.550352 Aug 31 16:03:14.168465 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 973/1905] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:13 2022] GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f => generated 1211 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:14.181301 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-54e723fa-aa47-4018-b541-0b635453ff60 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:14.182238 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-54e723fa-aa47-4018-b541-0b635453ff60 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: b1c1e611-4be6-4a43-aaf0-d02bfd87875c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:14.205413 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-54e723fa-aa47-4018-b541-0b635453ff60 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:14.206121 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-54e723fa-aa47-4018-b541-0b635453ff60 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:14.206723 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-54e723fa-aa47-4018-b541-0b635453ff60 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:14.207760 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-54e723fa-aa47-4018-b541-0b635453ff60 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:14.208389 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-54e723fa-aa47-4018-b541-0b635453ff60 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:14.209789 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-54e723fa-aa47-4018-b541-0b635453ff60 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:14.534144 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-04c35bea-3583-49f0-91d2-777deaaeab8f tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:14.546437 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-04c35bea-3583-49f0-91d2-777deaaeab8f tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4" status: 200 len: 1470 microversion: 2.1 time: 0.838234 Aug 31 16:03:14.549334 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 933/1906] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:13 2022] GET /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4 => generated 1470 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:14.554817 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-fc9c2458-3a50-4cfd-9f53-9180a3bfc140 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '.version_select at 0x7f5aed0d5820>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:14.625869 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-54e723fa-aa47-4018-b541-0b635453ff60 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:14.638950 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-54e723fa-aa47-4018-b541-0b635453ff60 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/b1c1e611-4be6-4a43-aaf0-d02bfd87875c" status: 200 len: 1315 microversion: 2.1 time: 0.469223 Aug 31 16:03:14.655949 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-fc9c2458-3a50-4cfd-9f53-9180a3bfc140 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/images/f505c75e-a15d-44cb-980b-62f98132dcb9" status: 200 len: 1439 microversion: 2.1 time: 0.104293 Aug 31 16:03:14.656929 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 934/1907] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:03:14 2022] GET /compute/v2.1/images/f505c75e-a15d-44cb-980b-62f98132dcb9 => generated 1439 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:14.662859 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 974/1908] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:14 2022] GET /compute/v2.1/servers/b1c1e611-4be6-4a43-aaf0-d02bfd87875c => generated 1315 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:14.670933 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-3f27aa0f-67ea-4f30-a854-d0e9119d39ae req-08c7dbd7-3e8f-404d-a0c4-1f6b67f4f6cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1c1e611-4be6-4a43-aaf0-d02bfd87875c", "name": "network-vif-plugged", "status": "completed", "tag": "0813979d-a0cf-4abc-98d9-f2c74265aef9"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:03:14.676065 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-4bd197a2-7d42-481c-b416-e93567e6735b req-5f33f0d6-918a-4620-8510-fb6a54b81d96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd702273-095b-4d44-8d1b-3d90f7833d5f", "tag": "64253c19-8d47-46b3-808b-0eed0e37d942"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:03:14.703593 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-3f27aa0f-67ea-4f30-a854-d0e9119d39ae req-08c7dbd7-3e8f-404d-a0c4-1f6b67f4f6cb service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:14.707170 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-3f27aa0f-67ea-4f30-a854-d0e9119d39ae req-08c7dbd7-3e8f-404d-a0c4-1f6b67f4f6cb service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:14.710551 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-3f27aa0f-67ea-4f30-a854-d0e9119d39ae req-08c7dbd7-3e8f-404d-a0c4-1f6b67f4f6cb service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:14.720314 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-4bd197a2-7d42-481c-b416-e93567e6735b req-5f33f0d6-918a-4620-8510-fb6a54b81d96 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:14.725267 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-4bd197a2-7d42-481c-b416-e93567e6735b req-5f33f0d6-918a-4620-8510-fb6a54b81d96 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:14.727418 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-4bd197a2-7d42-481c-b416-e93567e6735b req-5f33f0d6-918a-4620-8510-fb6a54b81d96 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:14.775295 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-3f27aa0f-67ea-4f30-a854-d0e9119d39ae req-08c7dbd7-3e8f-404d-a0c4-1f6b67f4f6cb service nova] Creating event network-vif-plugged:0813979d-a0cf-4abc-98d9-f2c74265aef9 for instance b1c1e611-4be6-4a43-aaf0-d02bfd87875c on n-h2-850499-9 Aug 31 16:03:14.776435 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-4bd197a2-7d42-481c-b416-e93567e6735b req-5f33f0d6-918a-4620-8510-fb6a54b81d96 service nova] Creating event network-changed:64253c19-8d47-46b3-808b-0eed0e37d942 for instance dd702273-095b-4d44-8d1b-3d90f7833d5f on n-h2-850499-9 Aug 31 16:03:14.785138 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-3f27aa0f-67ea-4f30-a854-d0e9119d39ae req-08c7dbd7-3e8f-404d-a0c4-1f6b67f4f6cb service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126250 Aug 31 16:03:14.785489 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-4bd197a2-7d42-481c-b416-e93567e6735b req-5f33f0d6-918a-4620-8510-fb6a54b81d96 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118845 Aug 31 16:03:14.787580 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 935/1909] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:03:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:03:14.787817 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 975/1910] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:03:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:03:14.795990 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-657face2-8b94-4deb-82fe-019c66643a56 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:14.796920 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-657face2-8b94-4deb-82fe-019c66643a56 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 646d0250-a626-4bd1-821b-2117fde78cc8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:14.805819 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-657face2-8b94-4deb-82fe-019c66643a56 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:14.806470 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-657face2-8b94-4deb-82fe-019c66643a56 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:14.807037 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-657face2-8b94-4deb-82fe-019c66643a56 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:14.808118 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-657face2-8b94-4deb-82fe-019c66643a56 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:14.808934 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-657face2-8b94-4deb-82fe-019c66643a56 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:14.835210 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-657face2-8b94-4deb-82fe-019c66643a56 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:15.177185 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-84a93e32-33d8-44ed-8266-0453f605a4fc tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:15.177623 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-84a93e32-33d8-44ed-8266-0453f605a4fc tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: dd702273-095b-4d44-8d1b-3d90f7833d5f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:15.189914 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-84a93e32-33d8-44ed-8266-0453f605a4fc tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:15.190685 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-84a93e32-33d8-44ed-8266-0453f605a4fc tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:15.191309 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-84a93e32-33d8-44ed-8266-0453f605a4fc tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:15.191554 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-657face2-8b94-4deb-82fe-019c66643a56 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:15.192435 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-84a93e32-33d8-44ed-8266-0453f605a4fc tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:15.193068 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-84a93e32-33d8-44ed-8266-0453f605a4fc tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:15.198166 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-84a93e32-33d8-44ed-8266-0453f605a4fc tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:15.206777 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-657face2-8b94-4deb-82fe-019c66643a56 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/646d0250-a626-4bd1-821b-2117fde78cc8" status: 200 len: 1318 microversion: 2.1 time: 0.414344 Aug 31 16:03:15.223886 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 936/1911] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:14 2022] GET /compute/v2.1/servers/646d0250-a626-4bd1-821b-2117fde78cc8 => generated 1318 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:15.577129 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-966fc344-3c52-4de6-bca2-0b7bbd635e6e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:15.578788 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-966fc344-3c52-4de6-bca2-0b7bbd635e6e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6e82c98f-d644-4464-aca0-13901e551aa4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:15.618007 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-966fc344-3c52-4de6-bca2-0b7bbd635e6e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:15.621340 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-966fc344-3c52-4de6-bca2-0b7bbd635e6e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:15.633178 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-966fc344-3c52-4de6-bca2-0b7bbd635e6e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:15.634090 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-966fc344-3c52-4de6-bca2-0b7bbd635e6e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:15.634586 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-966fc344-3c52-4de6-bca2-0b7bbd635e6e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:15.638254 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-966fc344-3c52-4de6-bca2-0b7bbd635e6e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:16.062754 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-966fc344-3c52-4de6-bca2-0b7bbd635e6e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:16.074530 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-966fc344-3c52-4de6-bca2-0b7bbd635e6e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4" status: 200 len: 1470 microversion: 2.1 time: 0.507895 Aug 31 16:03:16.076411 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 937/1912] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:15 2022] GET /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4 => generated 1470 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:16.080297 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-84a93e32-33d8-44ed-8266-0453f605a4fc tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:16.085203 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c8f4886b-ebb1-4013-8c93-73562303276e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:16.086091 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c8f4886b-ebb1-4013-8c93-73562303276e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: b1c1e611-4be6-4a43-aaf0-d02bfd87875c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:16.096082 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c8f4886b-ebb1-4013-8c93-73562303276e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:16.096916 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c8f4886b-ebb1-4013-8c93-73562303276e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:16.097579 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c8f4886b-ebb1-4013-8c93-73562303276e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:16.098547 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c8f4886b-ebb1-4013-8c93-73562303276e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:16.099676 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c8f4886b-ebb1-4013-8c93-73562303276e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:16.100287 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c8f4886b-ebb1-4013-8c93-73562303276e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:16.106830 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-84a93e32-33d8-44ed-8266-0453f605a4fc tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f" status: 200 len: 1211 microversion: 2.1 time: 0.927586 Aug 31 16:03:16.113137 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 976/1913] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:15 2022] GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f => generated 1211 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:03:16.149291 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e5028844-a228-48c0-97c4-e903adb97344 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '.version_select at 0x7f5aed301af0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:16.228626 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e5028844-a228-48c0-97c4-e903adb97344 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/images/f505c75e-a15d-44cb-980b-62f98132dcb9" status: 200 len: 1439 microversion: 2.1 time: 0.102215 Aug 31 16:03:16.233079 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 977/1914] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:03:16 2022] GET /compute/v2.1/images/f505c75e-a15d-44cb-980b-62f98132dcb9 => generated 1439 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:16.252745 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-52079b76-99cc-422d-9f2b-36938082438e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:16.255180 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-52079b76-99cc-422d-9f2b-36938082438e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 646d0250-a626-4bd1-821b-2117fde78cc8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:16.273538 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-52079b76-99cc-422d-9f2b-36938082438e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:16.275539 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-52079b76-99cc-422d-9f2b-36938082438e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:16.277462 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-52079b76-99cc-422d-9f2b-36938082438e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:16.279829 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-52079b76-99cc-422d-9f2b-36938082438e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:16.281085 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-52079b76-99cc-422d-9f2b-36938082438e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:16.281783 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-52079b76-99cc-422d-9f2b-36938082438e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:16.468159 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c8f4886b-ebb1-4013-8c93-73562303276e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:16.489847 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c8f4886b-ebb1-4013-8c93-73562303276e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/b1c1e611-4be6-4a43-aaf0-d02bfd87875c" status: 200 len: 1315 microversion: 2.1 time: 0.406802 Aug 31 16:03:16.491726 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 938/1915] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:16 2022] GET /compute/v2.1/servers/b1c1e611-4be6-4a43-aaf0-d02bfd87875c => generated 1315 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:16.636099 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-52079b76-99cc-422d-9f2b-36938082438e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:16.645155 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-52079b76-99cc-422d-9f2b-36938082438e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/646d0250-a626-4bd1-821b-2117fde78cc8" status: 200 len: 1318 microversion: 2.1 time: 0.410885 Aug 31 16:03:16.646091 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 978/1916] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:16 2022] GET /compute/v2.1/servers/646d0250-a626-4bd1-821b-2117fde78cc8 => generated 1318 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:16.801696 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7078b450-0b71-4954-855b-35a8b4ae0a61 tempest-FloatingIPsTestJSON-529162035 tempest-FloatingIPsTestJSON-529162035-project] Action: 'create', calling method: .version_select at 0x7f5aed1e6040>, body: {"pool": null} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:03:16.930820 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-2b07f12a-82ff-4248-b32a-07ddae4548ca req-d67225bb-c891-4def-b040-c85b7089d7c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "646d0250-a626-4bd1-821b-2117fde78cc8", "name": "network-vif-plugged", "status": "completed", "tag": "747c0501-222d-4eee-84f7-1e23b1a1f270"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:03:16.969152 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-2b07f12a-82ff-4248-b32a-07ddae4548ca req-d67225bb-c891-4def-b040-c85b7089d7c1 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:16.969699 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-2b07f12a-82ff-4248-b32a-07ddae4548ca req-d67225bb-c891-4def-b040-c85b7089d7c1 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:16.970144 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-2b07f12a-82ff-4248-b32a-07ddae4548ca req-d67225bb-c891-4def-b040-c85b7089d7c1 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:16.981926 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:03:17.008604 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-2b07f12a-82ff-4248-b32a-07ddae4548ca req-d67225bb-c891-4def-b040-c85b7089d7c1 service nova] Creating event network-vif-plugged:747c0501-222d-4eee-84f7-1e23b1a1f270 for instance 646d0250-a626-4bd1-821b-2117fde78cc8 on n-h1-850499-9 Aug 31 16:03:17.019693 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-2b07f12a-82ff-4248-b32a-07ddae4548ca req-d67225bb-c891-4def-b040-c85b7089d7c1 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099366 Aug 31 16:03:17.024138 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 979/1917] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:03:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:03:17.104651 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-185d5c93-2739-460a-bb8d-437ea8c21752 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:17.105395 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-185d5c93-2739-460a-bb8d-437ea8c21752 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6e82c98f-d644-4464-aca0-13901e551aa4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:17.133487 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-185d5c93-2739-460a-bb8d-437ea8c21752 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:17.134458 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-185d5c93-2739-460a-bb8d-437ea8c21752 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:17.135141 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-185d5c93-2739-460a-bb8d-437ea8c21752 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:17.137152 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-185d5c93-2739-460a-bb8d-437ea8c21752 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:17.139172 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-185d5c93-2739-460a-bb8d-437ea8c21752 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:17.139926 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-185d5c93-2739-460a-bb8d-437ea8c21752 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:17.595387 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-185d5c93-2739-460a-bb8d-437ea8c21752 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:17.608207 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-185d5c93-2739-460a-bb8d-437ea8c21752 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4" status: 200 len: 1470 microversion: 2.1 time: 0.509339 Aug 31 16:03:17.608581 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 980/1918] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:17 2022] GET /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4 => generated 1470 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:03:17.648960 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2052f0e9-8478-44cb-87ce-bc8189fa9fc5 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:17.651151 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2052f0e9-8478-44cb-87ce-bc8189fa9fc5 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: dd702273-095b-4d44-8d1b-3d90f7833d5f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:17.659362 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2052f0e9-8478-44cb-87ce-bc8189fa9fc5 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:17.660166 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2052f0e9-8478-44cb-87ce-bc8189fa9fc5 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:17.660846 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2052f0e9-8478-44cb-87ce-bc8189fa9fc5 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:17.661751 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2052f0e9-8478-44cb-87ce-bc8189fa9fc5 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:17.662401 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2052f0e9-8478-44cb-87ce-bc8189fa9fc5 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:17.663081 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2052f0e9-8478-44cb-87ce-bc8189fa9fc5 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:18.338621 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-2052f0e9-8478-44cb-87ce-bc8189fa9fc5 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:18.353628 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2052f0e9-8478-44cb-87ce-bc8189fa9fc5 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f" status: 200 len: 1211 microversion: 2.1 time: 0.728576 Aug 31 16:03:18.367995 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 981/1919] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:17 2022] GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f => generated 1211 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:18.382917 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-58c36957-1634-4dfc-9e5a-ec6209e7b38c tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '.version_select at 0x7f5ae8d79040>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:18.485872 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-58c36957-1634-4dfc-9e5a-ec6209e7b38c tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/images/f505c75e-a15d-44cb-980b-62f98132dcb9" status: 200 len: 1439 microversion: 2.1 time: 0.115404 Aug 31 16:03:18.486586 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 982/1920] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:03:18 2022] GET /compute/v2.1/images/f505c75e-a15d-44cb-980b-62f98132dcb9 => generated 1439 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:18.498741 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0ca8d21b-02c9-48f5-a0b1-c9f4ea878f3d tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:18.502158 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0ca8d21b-02c9-48f5-a0b1-c9f4ea878f3d tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: b1c1e611-4be6-4a43-aaf0-d02bfd87875c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:18.511625 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0ca8d21b-02c9-48f5-a0b1-c9f4ea878f3d tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:18.512158 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0ca8d21b-02c9-48f5-a0b1-c9f4ea878f3d tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:18.513184 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0ca8d21b-02c9-48f5-a0b1-c9f4ea878f3d tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:18.514142 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0ca8d21b-02c9-48f5-a0b1-c9f4ea878f3d tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:18.514823 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0ca8d21b-02c9-48f5-a0b1-c9f4ea878f3d tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:18.516112 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0ca8d21b-02c9-48f5-a0b1-c9f4ea878f3d tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:18.979844 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-0ca8d21b-02c9-48f5-a0b1-c9f4ea878f3d tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:18.993014 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0ca8d21b-02c9-48f5-a0b1-c9f4ea878f3d tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/b1c1e611-4be6-4a43-aaf0-d02bfd87875c" status: 200 len: 1502 microversion: 2.1 time: 0.502146 Aug 31 16:03:18.994862 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 983/1921] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:18 2022] GET /compute/v2.1/servers/b1c1e611-4be6-4a43-aaf0-d02bfd87875c => generated 1502 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:19.017814 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9bc6fab3-a091-4040-8e24-592681dcff80 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:19.021544 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9bc6fab3-a091-4040-8e24-592681dcff80 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 646d0250-a626-4bd1-821b-2117fde78cc8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:19.037841 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9bc6fab3-a091-4040-8e24-592681dcff80 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:19.038732 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9bc6fab3-a091-4040-8e24-592681dcff80 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:19.040020 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9bc6fab3-a091-4040-8e24-592681dcff80 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:19.043836 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9bc6fab3-a091-4040-8e24-592681dcff80 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:19.045153 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9bc6fab3-a091-4040-8e24-592681dcff80 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:19.047836 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9bc6fab3-a091-4040-8e24-592681dcff80 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:19.573135 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-9bc6fab3-a091-4040-8e24-592681dcff80 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:19.582759 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9bc6fab3-a091-4040-8e24-592681dcff80 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/646d0250-a626-4bd1-821b-2117fde78cc8" status: 200 len: 1318 microversion: 2.1 time: 0.585425 Aug 31 16:03:19.585729 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 984/1922] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:18 2022] GET /compute/v2.1/servers/646d0250-a626-4bd1-821b-2117fde78cc8 => generated 1318 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:19.596931 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4f1c7b85-63c3-4a32-8958-6722790b7b13 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:19.600288 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4f1c7b85-63c3-4a32-8958-6722790b7b13 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6e82c98f-d644-4464-aca0-13901e551aa4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:19.612403 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4f1c7b85-63c3-4a32-8958-6722790b7b13 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:19.612925 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4f1c7b85-63c3-4a32-8958-6722790b7b13 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:19.613383 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4f1c7b85-63c3-4a32-8958-6722790b7b13 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:19.614118 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4f1c7b85-63c3-4a32-8958-6722790b7b13 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:19.614595 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4f1c7b85-63c3-4a32-8958-6722790b7b13 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:19.615068 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4f1c7b85-63c3-4a32-8958-6722790b7b13 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:19.928331 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7078b450-0b71-4954-855b-35a8b4ae0a61 tempest-FloatingIPsTestJSON-529162035 tempest-FloatingIPsTestJSON-529162035-project] 10.222.0.61 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.428304 Aug 31 16:03:19.937875 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 939/1923] 10.222.0.61 () {60 vars in 1170 bytes} [Wed Aug 31 16:03:16 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:03:19.942843 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-bcb970c2-8e85-4ddf-9aa1-6d155eff0f3a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:19.943349 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-bcb970c2-8e85-4ddf-9aa1-6d155eff0f3a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: b1c1e611-4be6-4a43-aaf0-d02bfd87875c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:19.957042 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-4f1c7b85-63c3-4a32-8958-6722790b7b13 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:19.961625 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bcb970c2-8e85-4ddf-9aa1-6d155eff0f3a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:19.963733 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bcb970c2-8e85-4ddf-9aa1-6d155eff0f3a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:19.964194 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bcb970c2-8e85-4ddf-9aa1-6d155eff0f3a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:19.964933 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bcb970c2-8e85-4ddf-9aa1-6d155eff0f3a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:19.969296 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4f1c7b85-63c3-4a32-8958-6722790b7b13 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4" status: 200 len: 1470 microversion: 2.1 time: 0.381604 Aug 31 16:03:19.970359 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 985/1924] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:19 2022] GET /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4 => generated 1470 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:19.971993 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bcb970c2-8e85-4ddf-9aa1-6d155eff0f3a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:19.972669 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bcb970c2-8e85-4ddf-9aa1-6d155eff0f3a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:19.987656 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-9edae3ac-af04-4719-8b22-a25eb6ba5891 req-ff90a7d7-b965-4fd7-ba89-2d68c024d461 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cafdad7c-e670-48df-8c07-a2405d19f357", "name": "network-vif-plugged", "status": "completed", "tag": "8b9d6092-352b-4fc5-a622-919e58ed2dea"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:03:20.006632 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-9edae3ac-af04-4719-8b22-a25eb6ba5891 req-ff90a7d7-b965-4fd7-ba89-2d68c024d461 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:20.007296 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-9edae3ac-af04-4719-8b22-a25eb6ba5891 req-ff90a7d7-b965-4fd7-ba89-2d68c024d461 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:20.007776 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-9edae3ac-af04-4719-8b22-a25eb6ba5891 req-ff90a7d7-b965-4fd7-ba89-2d68c024d461 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:20.022363 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-9edae3ac-af04-4719-8b22-a25eb6ba5891 req-ff90a7d7-b965-4fd7-ba89-2d68c024d461 service nova] Creating event network-vif-plugged:8b9d6092-352b-4fc5-a622-919e58ed2dea for instance cafdad7c-e670-48df-8c07-a2405d19f357 on n-h1-850499-9 Aug 31 16:03:20.031348 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-9edae3ac-af04-4719-8b22-a25eb6ba5891 req-ff90a7d7-b965-4fd7-ba89-2d68c024d461 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050408 Aug 31 16:03:20.032536 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 986/1925] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:03:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:03:20.039187 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4ea872a2-5148-4551-9506-efc8d32e49ee tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:20.040282 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4ea872a2-5148-4551-9506-efc8d32e49ee tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: dd702273-095b-4d44-8d1b-3d90f7833d5f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:20.049803 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4ea872a2-5148-4551-9506-efc8d32e49ee tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:20.050529 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4ea872a2-5148-4551-9506-efc8d32e49ee tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:20.051301 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4ea872a2-5148-4551-9506-efc8d32e49ee tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:20.053453 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4ea872a2-5148-4551-9506-efc8d32e49ee tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:20.054165 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4ea872a2-5148-4551-9506-efc8d32e49ee tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:20.054940 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4ea872a2-5148-4551-9506-efc8d32e49ee tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:20.060293 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-bcb970c2-8e85-4ddf-9aa1-6d155eff0f3a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: b1c1e611-4be6-4a43-aaf0-d02bfd87875c] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:03:20.252687 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:03:20.267983 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-bcb970c2-8e85-4ddf-9aa1-6d155eff0f3a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "DELETE /compute/v2.1/servers/b1c1e611-4be6-4a43-aaf0-d02bfd87875c" status: 204 len: 0 microversion: 2.1 time: 0.328616 Aug 31 16:03:20.271054 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 940/1926] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:03:19 2022] DELETE /compute/v2.1/servers/b1c1e611-4be6-4a43-aaf0-d02bfd87875c => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:03:20.282973 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a4e770b9-6059-45d0-8751-cf8fe715cc1d tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '.version_select at 0x7f5aed1e6ca0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:20.359642 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a4e770b9-6059-45d0-8751-cf8fe715cc1d tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/images/f505c75e-a15d-44cb-980b-62f98132dcb9" status: 200 len: 1439 microversion: 2.1 time: 0.083646 Aug 31 16:03:20.362194 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 941/1927] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:03:20 2022] GET /compute/v2.1/images/f505c75e-a15d-44cb-980b-62f98132dcb9 => generated 1439 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:20.373279 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-12b13882-46d3-403e-ac34-639148852ef6 tempest-FloatingIPsTestJSON-529162035 tempest-FloatingIPsTestJSON-529162035-project] Calling method '.version_select at 0x7f5aed153ca0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:20.388355 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-4ea872a2-5148-4551-9506-efc8d32e49ee tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:20.399896 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4ea872a2-5148-4551-9506-efc8d32e49ee tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f" status: 200 len: 1199 microversion: 2.1 time: 0.364964 Aug 31 16:03:20.411706 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 987/1928] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:20 2022] GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f => generated 1199 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:20.417370 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-cd486227-8f6a-4927-96c5-1848325f451f tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:20.417370 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-cd486227-8f6a-4927-96c5-1848325f451f tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: b1c1e611-4be6-4a43-aaf0-d02bfd87875c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:20.428946 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cd486227-8f6a-4927-96c5-1848325f451f tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:20.432131 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cd486227-8f6a-4927-96c5-1848325f451f tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:20.432658 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cd486227-8f6a-4927-96c5-1848325f451f tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:20.433434 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cd486227-8f6a-4927-96c5-1848325f451f tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:20.433917 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cd486227-8f6a-4927-96c5-1848325f451f tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:20.434383 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cd486227-8f6a-4927-96c5-1848325f451f tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:20.889097 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-12b13882-46d3-403e-ac34-639148852ef6 tempest-FloatingIPsTestJSON-529162035 tempest-FloatingIPsTestJSON-529162035-project] 10.222.0.61 "GET /compute/v2.1/os-floating-ips/b4890d42-dbab-4b26-b564-192249e63d43" status: 200 len: 142 microversion: 2.1 time: 0.525799 Aug 31 16:03:20.889803 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 942/1929] 10.222.0.61 () {58 vars in 1260 bytes} [Wed Aug 31 16:03:20 2022] GET /compute/v2.1/os-floating-ips/b4890d42-dbab-4b26-b564-192249e63d43 => generated 142 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:03:20.895388 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-39b603a1-1f75-4f6a-b61f-9716d650499d tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:20.896702 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-39b603a1-1f75-4f6a-b61f-9716d650499d tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 646d0250-a626-4bd1-821b-2117fde78cc8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:20.904652 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-39b603a1-1f75-4f6a-b61f-9716d650499d tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:20.905511 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-39b603a1-1f75-4f6a-b61f-9716d650499d tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:20.906762 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-39b603a1-1f75-4f6a-b61f-9716d650499d tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:20.907892 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-39b603a1-1f75-4f6a-b61f-9716d650499d tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:20.908559 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-39b603a1-1f75-4f6a-b61f-9716d650499d tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:20.909179 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-39b603a1-1f75-4f6a-b61f-9716d650499d tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:20.945625 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-cd486227-8f6a-4927-96c5-1848325f451f tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:20.956702 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-cd486227-8f6a-4927-96c5-1848325f451f tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/b1c1e611-4be6-4a43-aaf0-d02bfd87875c" status: 200 len: 1508 microversion: 2.1 time: 0.551471 Aug 31 16:03:20.958097 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 988/1930] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:20 2022] GET /compute/v2.1/servers/b1c1e611-4be6-4a43-aaf0-d02bfd87875c => generated 1508 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:20.964261 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-91567645-8ce4-43ba-8746-c7d1e7a543e2 tempest-FloatingIPsTestJSON-529162035 tempest-FloatingIPsTestJSON-529162035-project] Calling method '.version_select at 0x7f5ae8d8b670>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:21.626009 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-91567645-8ce4-43ba-8746-c7d1e7a543e2 tempest-FloatingIPsTestJSON-529162035 tempest-FloatingIPsTestJSON-529162035-project] 10.222.0.61 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.665869 Aug 31 16:03:21.627373 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 989/1931] 10.222.0.61 () {58 vars in 1149 bytes} [Wed Aug 31 16:03:20 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:03:21.632515 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-694318bc-4e7e-41c4-916d-002d7e5b7a87 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:21.633397 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-694318bc-4e7e-41c4-916d-002d7e5b7a87 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6e82c98f-d644-4464-aca0-13901e551aa4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:21.648786 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-694318bc-4e7e-41c4-916d-002d7e5b7a87 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:21.649803 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-694318bc-4e7e-41c4-916d-002d7e5b7a87 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:21.657587 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-694318bc-4e7e-41c4-916d-002d7e5b7a87 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:21.658726 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-694318bc-4e7e-41c4-916d-002d7e5b7a87 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:21.659616 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-694318bc-4e7e-41c4-916d-002d7e5b7a87 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:21.660265 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-694318bc-4e7e-41c4-916d-002d7e5b7a87 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:21.676463 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-39b603a1-1f75-4f6a-b61f-9716d650499d tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:21.685364 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-39b603a1-1f75-4f6a-b61f-9716d650499d tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/646d0250-a626-4bd1-821b-2117fde78cc8" status: 200 len: 1467 microversion: 2.1 time: 0.793979 Aug 31 16:03:21.701238 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 943/1932] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:20 2022] GET /compute/v2.1/servers/646d0250-a626-4bd1-821b-2117fde78cc8 => generated 1467 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:21.709645 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-08f519f7-0a09-46ec-ac07-9be4811e2ab3 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '.version_select at 0x7f5aed1389d0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:21.781283 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-08f519f7-0a09-46ec-ac07-9be4811e2ab3 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/images/f505c75e-a15d-44cb-980b-62f98132dcb9" status: 200 len: 1439 microversion: 2.1 time: 0.078215 Aug 31 16:03:21.782275 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 944/1933] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:03:21 2022] GET /compute/v2.1/images/f505c75e-a15d-44cb-980b-62f98132dcb9 => generated 1439 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:21.800440 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8987a4d3-3537-4260-bcfe-84d9cc74fe88 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:21.801353 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8987a4d3-3537-4260-bcfe-84d9cc74fe88 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: dd702273-095b-4d44-8d1b-3d90f7833d5f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:21.824903 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8987a4d3-3537-4260-bcfe-84d9cc74fe88 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:21.831264 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8987a4d3-3537-4260-bcfe-84d9cc74fe88 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:21.834944 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8987a4d3-3537-4260-bcfe-84d9cc74fe88 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:21.835939 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8987a4d3-3537-4260-bcfe-84d9cc74fe88 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:21.839004 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8987a4d3-3537-4260-bcfe-84d9cc74fe88 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:21.840069 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8987a4d3-3537-4260-bcfe-84d9cc74fe88 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:22.065998 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-694318bc-4e7e-41c4-916d-002d7e5b7a87 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:22.076800 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-694318bc-4e7e-41c4-916d-002d7e5b7a87 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4" status: 200 len: 1475 microversion: 2.1 time: 0.448021 Aug 31 16:03:22.077381 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 990/1934] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:21 2022] GET /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4 => generated 1475 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:22.092589 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ff11ae56-cd14-44c6-95ab-47072c70fbf3 tempest-FloatingIPsTestJSON-529162035 tempest-FloatingIPsTestJSON-529162035-project] Calling method '.version_select at 0x7f5ae8d8bb80>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:22.242338 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8987a4d3-3537-4260-bcfe-84d9cc74fe88 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:22.264453 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8987a4d3-3537-4260-bcfe-84d9cc74fe88 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f" status: 200 len: 1199 microversion: 2.1 time: 0.476971 Aug 31 16:03:22.268688 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 945/1935] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:21 2022] GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f => generated 1199 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:22.279464 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-73e0668c-32f4-496a-b421-5af0478f9396 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:22.280428 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-73e0668c-32f4-496a-b421-5af0478f9396 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: bf253a58-f38a-42d9-90b6-f3a80141cad2] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:22.294344 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-73e0668c-32f4-496a-b421-5af0478f9396 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:22.295079 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-73e0668c-32f4-496a-b421-5af0478f9396 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:22.295764 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-73e0668c-32f4-496a-b421-5af0478f9396 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:22.298089 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-73e0668c-32f4-496a-b421-5af0478f9396 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:22.300567 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-73e0668c-32f4-496a-b421-5af0478f9396 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:22.301282 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-73e0668c-32f4-496a-b421-5af0478f9396 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:22.619701 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-73e0668c-32f4-496a-b421-5af0478f9396 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:22.629641 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-73e0668c-32f4-496a-b421-5af0478f9396 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/bf253a58-f38a-42d9-90b6-f3a80141cad2" status: 200 len: 1318 microversion: 2.1 time: 0.359488 Aug 31 16:03:22.634780 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 946/1936] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:22 2022] GET /compute/v2.1/servers/bf253a58-f38a-42d9-90b6-f3a80141cad2 => generated 1318 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:22.651283 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-037b5765-3ee7-499d-a39a-63b2a78d3a13 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:22.652526 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-037b5765-3ee7-499d-a39a-63b2a78d3a13 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: b1c1e611-4be6-4a43-aaf0-d02bfd87875c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:22.667896 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-037b5765-3ee7-499d-a39a-63b2a78d3a13 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:22.669051 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-037b5765-3ee7-499d-a39a-63b2a78d3a13 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:22.669947 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-037b5765-3ee7-499d-a39a-63b2a78d3a13 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:22.670921 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-037b5765-3ee7-499d-a39a-63b2a78d3a13 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:22.671647 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-037b5765-3ee7-499d-a39a-63b2a78d3a13 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:22.672469 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-037b5765-3ee7-499d-a39a-63b2a78d3a13 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:23.191036 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-037b5765-3ee7-499d-a39a-63b2a78d3a13 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:23.261512 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-037b5765-3ee7-499d-a39a-63b2a78d3a13 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/b1c1e611-4be6-4a43-aaf0-d02bfd87875c" status: 200 len: 1508 microversion: 2.1 time: 0.622992 Aug 31 16:03:23.275353 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 947/1937] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:22 2022] GET /compute/v2.1/servers/b1c1e611-4be6-4a43-aaf0-d02bfd87875c => generated 1508 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:23.300608 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-04eac20d-19d0-4732-991e-98897bb32804 req-726b9f28-f520-4330-8da6-04efcb385c37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf253a58-f38a-42d9-90b6-f3a80141cad2", "name": "network-vif-plugged", "status": "completed", "tag": "c9f01bdb-2d61-4e28-bce8-39dd0d48b820"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:03:23.332534 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-04eac20d-19d0-4732-991e-98897bb32804 req-726b9f28-f520-4330-8da6-04efcb385c37 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:23.334061 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-04eac20d-19d0-4732-991e-98897bb32804 req-726b9f28-f520-4330-8da6-04efcb385c37 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:23.334614 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-04eac20d-19d0-4732-991e-98897bb32804 req-726b9f28-f520-4330-8da6-04efcb385c37 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:23.376238 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-04eac20d-19d0-4732-991e-98897bb32804 req-726b9f28-f520-4330-8da6-04efcb385c37 service nova] Creating event network-vif-plugged:c9f01bdb-2d61-4e28-bce8-39dd0d48b820 for instance bf253a58-f38a-42d9-90b6-f3a80141cad2 on n-h2-850499-9 Aug 31 16:03:23.396366 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-04eac20d-19d0-4732-991e-98897bb32804 req-726b9f28-f520-4330-8da6-04efcb385c37 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123729 Aug 31 16:03:23.397423 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 948/1938] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:03:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:03:23.405209 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6929fb8c-326c-4b50-833e-0b0650b4dd9d tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '.version_select at 0x7f5ae85d83a0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:23.571635 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6929fb8c-326c-4b50-833e-0b0650b4dd9d tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/images/f505c75e-a15d-44cb-980b-62f98132dcb9" status: 200 len: 1439 microversion: 2.1 time: 0.172773 Aug 31 16:03:23.579166 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 949/1939] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:03:23 2022] GET /compute/v2.1/images/f505c75e-a15d-44cb-980b-62f98132dcb9 => generated 1439 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:23.579166 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9d50283c-3927-4ea9-8453-e5ccd650f262 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:23.579166 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9d50283c-3927-4ea9-8453-e5ccd650f262 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6e82c98f-d644-4464-aca0-13901e551aa4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:23.588169 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9d50283c-3927-4ea9-8453-e5ccd650f262 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:23.588593 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9d50283c-3927-4ea9-8453-e5ccd650f262 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:23.589040 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9d50283c-3927-4ea9-8453-e5ccd650f262 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:23.589766 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9d50283c-3927-4ea9-8453-e5ccd650f262 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:23.590230 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9d50283c-3927-4ea9-8453-e5ccd650f262 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:23.591284 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9d50283c-3927-4ea9-8453-e5ccd650f262 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:23.976759 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9d50283c-3927-4ea9-8453-e5ccd650f262 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:23.985806 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9d50283c-3927-4ea9-8453-e5ccd650f262 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4" status: 200 len: 1475 microversion: 2.1 time: 0.412066 Aug 31 16:03:23.986321 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 950/1940] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:23 2022] GET /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4 => generated 1475 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:23.992219 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ed574a11-6d4a-44ce-b363-f1b70b5ab55a tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:23.992866 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ed574a11-6d4a-44ce-b363-f1b70b5ab55a tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: dd702273-095b-4d44-8d1b-3d90f7833d5f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:24.002492 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ed574a11-6d4a-44ce-b363-f1b70b5ab55a tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:24.003001 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ed574a11-6d4a-44ce-b363-f1b70b5ab55a tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:24.003447 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ed574a11-6d4a-44ce-b363-f1b70b5ab55a tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:24.009291 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ed574a11-6d4a-44ce-b363-f1b70b5ab55a tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:24.009825 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ed574a11-6d4a-44ce-b363-f1b70b5ab55a tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:24.010284 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ed574a11-6d4a-44ce-b363-f1b70b5ab55a tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:24.326608 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ed574a11-6d4a-44ce-b363-f1b70b5ab55a tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:24.339167 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ed574a11-6d4a-44ce-b363-f1b70b5ab55a tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f" status: 200 len: 1199 microversion: 2.1 time: 0.347611 Aug 31 16:03:24.341072 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 951/1941] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:23 2022] GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f => generated 1199 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:24.357284 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-cf84545c-f68b-48ed-8e6b-063984b098c5 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:24.358249 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-cf84545c-f68b-48ed-8e6b-063984b098c5 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: bf253a58-f38a-42d9-90b6-f3a80141cad2] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:24.370674 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cf84545c-f68b-48ed-8e6b-063984b098c5 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:24.371292 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cf84545c-f68b-48ed-8e6b-063984b098c5 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:24.372724 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cf84545c-f68b-48ed-8e6b-063984b098c5 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:24.375815 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cf84545c-f68b-48ed-8e6b-063984b098c5 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:24.376546 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cf84545c-f68b-48ed-8e6b-063984b098c5 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:24.380710 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cf84545c-f68b-48ed-8e6b-063984b098c5 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:24.599614 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ff11ae56-cd14-44c6-95ab-47072c70fbf3 tempest-FloatingIPsTestJSON-529162035 tempest-FloatingIPsTestJSON-529162035-project] 10.222.0.61 "DELETE /compute/v2.1/os-floating-ips/b4890d42-dbab-4b26-b564-192249e63d43" status: 202 len: 0 microversion: 2.1 time: 2.521108 Aug 31 16:03:24.600932 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 991/1942] 10.222.0.61 () {58 vars in 1263 bytes} [Wed Aug 31 16:03:22 2022] DELETE /compute/v2.1/os-floating-ips/b4890d42-dbab-4b26-b564-192249e63d43 => generated 0 bytes in 2523 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:03:24.607082 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1a9257e1-40f2-4372-a82e-2bc2d72b29fe tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:24.608312 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1a9257e1-40f2-4372-a82e-2bc2d72b29fe tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: b1c1e611-4be6-4a43-aaf0-d02bfd87875c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:24.625466 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1a9257e1-40f2-4372-a82e-2bc2d72b29fe tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:24.626416 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1a9257e1-40f2-4372-a82e-2bc2d72b29fe tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:24.627139 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1a9257e1-40f2-4372-a82e-2bc2d72b29fe tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:24.628176 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1a9257e1-40f2-4372-a82e-2bc2d72b29fe tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:24.628963 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1a9257e1-40f2-4372-a82e-2bc2d72b29fe tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:24.629694 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1a9257e1-40f2-4372-a82e-2bc2d72b29fe tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:24.789888 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-cf84545c-f68b-48ed-8e6b-063984b098c5 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:24.794606 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1a9257e1-40f2-4372-a82e-2bc2d72b29fe tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:24.810301 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-cf84545c-f68b-48ed-8e6b-063984b098c5 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/bf253a58-f38a-42d9-90b6-f3a80141cad2" status: 200 len: 1318 microversion: 2.1 time: 0.467820 Aug 31 16:03:24.811552 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 952/1943] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:24 2022] GET /compute/v2.1/servers/bf253a58-f38a-42d9-90b6-f3a80141cad2 => generated 1318 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:24.820529 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1a9257e1-40f2-4372-a82e-2bc2d72b29fe tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/b1c1e611-4be6-4a43-aaf0-d02bfd87875c" status: 200 len: 1466 microversion: 2.1 time: 0.217643 Aug 31 16:03:24.821374 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4c575915-36b6-484b-9e8f-eddebfd6f933 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '.version_select at 0x7f5ae85df550>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:24.822192 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 992/1944] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:24 2022] GET /compute/v2.1/servers/b1c1e611-4be6-4a43-aaf0-d02bfd87875c => generated 1466 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:24.830730 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-bc50eb2b-28d1-4a2a-8d65-65478251ab70 tempest-FloatingIPsTestJSON-529162035 tempest-FloatingIPsTestJSON-529162035-project] Action: 'create', calling method: .version_select at 0x7f5ae8df5040>, body: {"pool": null} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:03:24.885133 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4c575915-36b6-484b-9e8f-eddebfd6f933 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/images/f505c75e-a15d-44cb-980b-62f98132dcb9" status: 200 len: 1439 microversion: 2.1 time: 0.071539 Aug 31 16:03:24.885746 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 953/1945] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:03:24 2022] GET /compute/v2.1/images/f505c75e-a15d-44cb-980b-62f98132dcb9 => generated 1439 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:24.894810 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-95443aae-8cb0-4265-86b2-9c96d80fd6dc req-806261a4-3417-411a-8ce4-e7cfed7c0ff8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1c1e611-4be6-4a43-aaf0-d02bfd87875c", "name": "network-vif-deleted", "tag": "0813979d-a0cf-4abc-98d9-f2c74265aef9"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:03:24.922089 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-95443aae-8cb0-4265-86b2-9c96d80fd6dc req-806261a4-3417-411a-8ce4-e7cfed7c0ff8 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:24.922597 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-95443aae-8cb0-4265-86b2-9c96d80fd6dc req-806261a4-3417-411a-8ce4-e7cfed7c0ff8 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:24.925289 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-95443aae-8cb0-4265-86b2-9c96d80fd6dc req-806261a4-3417-411a-8ce4-e7cfed7c0ff8 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:24.956260 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-95443aae-8cb0-4265-86b2-9c96d80fd6dc req-806261a4-3417-411a-8ce4-e7cfed7c0ff8 service nova] Creating event network-vif-deleted:0813979d-a0cf-4abc-98d9-f2c74265aef9 for instance b1c1e611-4be6-4a43-aaf0-d02bfd87875c on n-h2-850499-9 Aug 31 16:03:24.965055 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-95443aae-8cb0-4265-86b2-9c96d80fd6dc req-806261a4-3417-411a-8ce4-e7cfed7c0ff8 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077308 Aug 31 16:03:24.967572 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 954/1946] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:03:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:03:25.089231 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-801726ac-1358-4a62-9e2a-554675ac9e12 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:25.091578 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-801726ac-1358-4a62-9e2a-554675ac9e12 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6e82c98f-d644-4464-aca0-13901e551aa4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:25.104334 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-801726ac-1358-4a62-9e2a-554675ac9e12 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:25.104836 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-801726ac-1358-4a62-9e2a-554675ac9e12 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:25.111031 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-801726ac-1358-4a62-9e2a-554675ac9e12 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:25.115459 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-801726ac-1358-4a62-9e2a-554675ac9e12 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:25.121005 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-801726ac-1358-4a62-9e2a-554675ac9e12 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:25.122272 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-801726ac-1358-4a62-9e2a-554675ac9e12 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:25.437973 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-801726ac-1358-4a62-9e2a-554675ac9e12 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:25.449467 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-801726ac-1358-4a62-9e2a-554675ac9e12 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4" status: 200 len: 1475 microversion: 2.1 time: 0.370708 Aug 31 16:03:25.453050 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 955/1947] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:25 2022] GET /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4 => generated 1475 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:25.459925 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-82144c8d-9757-432f-a7a2-bb02f0bb6c93 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:25.461247 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-82144c8d-9757-432f-a7a2-bb02f0bb6c93 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: dd702273-095b-4d44-8d1b-3d90f7833d5f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:25.472000 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-82144c8d-9757-432f-a7a2-bb02f0bb6c93 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:25.473109 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-82144c8d-9757-432f-a7a2-bb02f0bb6c93 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:25.474121 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-82144c8d-9757-432f-a7a2-bb02f0bb6c93 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:25.475355 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-82144c8d-9757-432f-a7a2-bb02f0bb6c93 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:25.476057 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-82144c8d-9757-432f-a7a2-bb02f0bb6c93 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:25.476556 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-82144c8d-9757-432f-a7a2-bb02f0bb6c93 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:25.499227 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:03:25.724342 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-82144c8d-9757-432f-a7a2-bb02f0bb6c93 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:25.734137 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-82144c8d-9757-432f-a7a2-bb02f0bb6c93 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f" status: 200 len: 1199 microversion: 2.1 time: 0.279600 Aug 31 16:03:25.736477 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 956/1948] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:25 2022] GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f => generated 1199 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:25.744004 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-952e7830-da90-4aed-89e2-67baaa26d99f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-468682117", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "46991353-f00e-44c7-9ba5-793d81b25791"}], "block_device_mapping_v2": [{"uuid": "ce25cbb7-eb65-43d1-a8f7-938f55fcb915", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:03:25.851873 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-952e7830-da90-4aed-89e2-67baaa26d99f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] validate_networks() for [('46991353-f00e-44c7-9ba5-793d81b25791', None, None, None, None, None)] {{(pid=122257) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:03:26.679330 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-952e7830-da90-4aed-89e2-67baaa26d99f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:03:26.680111 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-952e7830-da90-4aed-89e2-67baaa26d99f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:03:26.680463 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-952e7830-da90-4aed-89e2-67baaa26d99f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:03:26.680989 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-952e7830-da90-4aed-89e2-67baaa26d99f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:03:26.681514 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-952e7830-da90-4aed-89e2-67baaa26d99f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:03:26.702041 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-952e7830-da90-4aed-89e2-67baaa26d99f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:26.709374 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-952e7830-da90-4aed-89e2-67baaa26d99f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:26.710243 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-952e7830-da90-4aed-89e2-67baaa26d99f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:26.713457 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-952e7830-da90-4aed-89e2-67baaa26d99f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:26.714362 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-952e7830-da90-4aed-89e2-67baaa26d99f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:26.715127 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-952e7830-da90-4aed-89e2-67baaa26d99f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:26.771577 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-952e7830-da90-4aed-89e2-67baaa26d99f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Getting quotas for project 01a9266ba9b14c6a8b6e79aecfe86df6. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:03:26.787398 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-952e7830-da90-4aed-89e2-67baaa26d99f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Getting quotas for user bb8e30aa23194f898b07dfbc6fd8d5de and project 01a9266ba9b14c6a8b6e79aecfe86df6. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:03:26.900465 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-952e7830-da90-4aed-89e2-67baaa26d99f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Going to run 1 instances... {{(pid=122257) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:03:26.906520 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-952e7830-da90-4aed-89e2-67baaa26d99f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 006771fc-9da9-4b78-9fad-f4b72c311fd5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ce25cbb7-eb65-43d1-a8f7-938f55fcb915',volume_size=None,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:03:27.078444 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-bc50eb2b-28d1-4a2a-8d65-65478251ab70 tempest-FloatingIPsTestJSON-529162035 tempest-FloatingIPsTestJSON-529162035-project] 10.222.0.61 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.254863 Aug 31 16:03:27.079049 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 993/1949] 10.222.0.61 () {60 vars in 1170 bytes} [Wed Aug 31 16:03:24 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:03:27.102176 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b659f536-222a-4fd1-b1bc-830aa8dda0c1 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:27.103152 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b659f536-222a-4fd1-b1bc-830aa8dda0c1 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: bf253a58-f38a-42d9-90b6-f3a80141cad2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:27.118954 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b659f536-222a-4fd1-b1bc-830aa8dda0c1 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:27.119616 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b659f536-222a-4fd1-b1bc-830aa8dda0c1 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:27.120062 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b659f536-222a-4fd1-b1bc-830aa8dda0c1 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:27.120777 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b659f536-222a-4fd1-b1bc-830aa8dda0c1 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:27.121260 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b659f536-222a-4fd1-b1bc-830aa8dda0c1 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:27.122225 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b659f536-222a-4fd1-b1bc-830aa8dda0c1 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:27.136383 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-952e7830-da90-4aed-89e2-67baaa26d99f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.398507 Aug 31 16:03:27.138279 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 957/1950] 10.222.0.61 () {62 vars in 1188 bytes} [Wed Aug 31 16:03:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1401 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 31 16:03:27.146472 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1df19c1d-0d62-46c1-aa85-5b7684fa21ea tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:27.147387 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1df19c1d-0d62-46c1-aa85-5b7684fa21ea tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: b1c1e611-4be6-4a43-aaf0-d02bfd87875c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:27.159032 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1df19c1d-0d62-46c1-aa85-5b7684fa21ea tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:27.159951 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1df19c1d-0d62-46c1-aa85-5b7684fa21ea tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:27.161005 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1df19c1d-0d62-46c1-aa85-5b7684fa21ea tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:27.163087 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1df19c1d-0d62-46c1-aa85-5b7684fa21ea tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:27.164070 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1df19c1d-0d62-46c1-aa85-5b7684fa21ea tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:27.165179 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1df19c1d-0d62-46c1-aa85-5b7684fa21ea tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:27.225568 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1df19c1d-0d62-46c1-aa85-5b7684fa21ea tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:27.226420 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1df19c1d-0d62-46c1-aa85-5b7684fa21ea tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:27.227137 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1df19c1d-0d62-46c1-aa85-5b7684fa21ea tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:27.228765 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-1df19c1d-0d62-46c1-aa85-5b7684fa21ea tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lazy-loading 'fault' on Instance uuid b1c1e611-4be6-4a43-aaf0-d02bfd87875c {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:03:27.302821 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-1df19c1d-0d62-46c1-aa85-5b7684fa21ea tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:27.318001 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1df19c1d-0d62-46c1-aa85-5b7684fa21ea tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/b1c1e611-4be6-4a43-aaf0-d02bfd87875c" status: 200 len: 1305 microversion: 2.1 time: 0.176884 Aug 31 16:03:27.319174 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 958/1951] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:27 2022] GET /compute/v2.1/servers/b1c1e611-4be6-4a43-aaf0-d02bfd87875c => generated 1305 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:27.325688 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8bda6f8b-9bde-4dc5-915f-09135799b9c9 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '.version_select at 0x7f5ae85d8ee0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:27.374260 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b659f536-222a-4fd1-b1bc-830aa8dda0c1 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:27.390668 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b659f536-222a-4fd1-b1bc-830aa8dda0c1 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/bf253a58-f38a-42d9-90b6-f3a80141cad2" status: 200 len: 1467 microversion: 2.1 time: 0.296605 Aug 31 16:03:27.391325 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 994/1952] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:27 2022] GET /compute/v2.1/servers/bf253a58-f38a-42d9-90b6-f3a80141cad2 => generated 1467 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:27.400221 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-cde2098c-901a-4cae-9a0f-a2005e75b7cd tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:27.401791 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8bda6f8b-9bde-4dc5-915f-09135799b9c9 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/images/f505c75e-a15d-44cb-980b-62f98132dcb9" status: 200 len: 1439 microversion: 2.1 time: 0.081247 Aug 31 16:03:27.402277 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 959/1953] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:03:27 2022] GET /compute/v2.1/images/f505c75e-a15d-44cb-980b-62f98132dcb9 => generated 1439 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:27.403571 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-cde2098c-901a-4cae-9a0f-a2005e75b7cd tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6e82c98f-d644-4464-aca0-13901e551aa4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:27.412697 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-20ed3d04-f606-47e4-9a97-f1f32549c94a tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:27.413316 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-20ed3d04-f606-47e4-9a97-f1f32549c94a tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: dd702273-095b-4d44-8d1b-3d90f7833d5f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:27.418171 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cde2098c-901a-4cae-9a0f-a2005e75b7cd tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:27.419229 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cde2098c-901a-4cae-9a0f-a2005e75b7cd tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:27.422333 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cde2098c-901a-4cae-9a0f-a2005e75b7cd tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:27.423326 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cde2098c-901a-4cae-9a0f-a2005e75b7cd tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:27.425880 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cde2098c-901a-4cae-9a0f-a2005e75b7cd tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:27.428916 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cde2098c-901a-4cae-9a0f-a2005e75b7cd tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:27.436098 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-20ed3d04-f606-47e4-9a97-f1f32549c94a tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:27.437159 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-20ed3d04-f606-47e4-9a97-f1f32549c94a tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:27.437785 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-20ed3d04-f606-47e4-9a97-f1f32549c94a tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:27.441848 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-20ed3d04-f606-47e4-9a97-f1f32549c94a tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:27.443231 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-20ed3d04-f606-47e4-9a97-f1f32549c94a tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:27.443748 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-20ed3d04-f606-47e4-9a97-f1f32549c94a tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:27.687634 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-20ed3d04-f606-47e4-9a97-f1f32549c94a tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:27.699125 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-20ed3d04-f606-47e4-9a97-f1f32549c94a tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f" status: 200 len: 1199 microversion: 2.1 time: 0.292506 Aug 31 16:03:27.700461 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 960/1954] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:27 2022] GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f => generated 1199 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:27.718345 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6683e222-d0ab-4afb-a18e-932c39c950f4 tempest-FloatingIPsTestJSON-529162035 tempest-FloatingIPsTestJSON-529162035-project] Calling method '.version_select at 0x7f5ae85dfa60>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:27.734987 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-cde2098c-901a-4cae-9a0f-a2005e75b7cd tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:27.746217 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-cde2098c-901a-4cae-9a0f-a2005e75b7cd tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4" status: 200 len: 1475 microversion: 2.1 time: 0.353577 Aug 31 16:03:27.747484 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 995/1955] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:27 2022] GET /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4 => generated 1475 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:27.753135 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6d07e16b-2915-45b8-b361-7c0045002766 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:27.754021 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6d07e16b-2915-45b8-b361-7c0045002766 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 006771fc-9da9-4b78-9fad-f4b72c311fd5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:27.864564 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-6d07e16b-2915-45b8-b361-7c0045002766 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:27.873607 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-6d07e16b-2915-45b8-b361-7c0045002766 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:27.875984 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-6d07e16b-2915-45b8-b361-7c0045002766 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:27.877354 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6d07e16b-2915-45b8-b361-7c0045002766 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5" status: 200 len: 1103 microversion: 2.25 time: 0.128652 Aug 31 16:03:27.878471 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 996/1956] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:03:27 2022] GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5 => generated 1103 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:03:27.884275 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-964e11f1-72da-4fee-90a3-4d1bea30cb1e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:27.890438 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-964e11f1-72da-4fee-90a3-4d1bea30cb1e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:27.892155 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-964e11f1-72da-4fee-90a3-4d1bea30cb1e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Searching by: {'reservation_id': 'r-tt7j22aa', 'deleted': False, 'project_id': '7fa2effd15e440598752264e49d2457d'} {{(pid=122256) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 16:03:27.898355 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-964e11f1-72da-4fee-90a3-4d1bea30cb1e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:27.899190 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-964e11f1-72da-4fee-90a3-4d1bea30cb1e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:27.900132 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-964e11f1-72da-4fee-90a3-4d1bea30cb1e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:27.901107 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-964e11f1-72da-4fee-90a3-4d1bea30cb1e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:27.901793 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-964e11f1-72da-4fee-90a3-4d1bea30cb1e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:27.902457 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-964e11f1-72da-4fee-90a3-4d1bea30cb1e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:28.025705 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.multi_cell_list [None req-964e11f1-72da-4fee-90a3-4d1bea30cb1e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122256) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 31 16:03:28.119804 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-964e11f1-72da-4fee-90a3-4d1bea30cb1e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:28.130063 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-964e11f1-72da-4fee-90a3-4d1bea30cb1e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:28.130836 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-964e11f1-72da-4fee-90a3-4d1bea30cb1e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:28.132073 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-964e11f1-72da-4fee-90a3-4d1bea30cb1e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:28.452749 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-964e11f1-72da-4fee-90a3-4d1bea30cb1e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/detail?reservation_id=r-tt7j22aa" status: 200 len: 2927 microversion: 2.1 time: 0.572399 Aug 31 16:03:28.454125 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 997/1957] 10.222.0.61 () {58 vars in 1197 bytes} [Wed Aug 31 16:03:27 2022] GET /compute/v2.1/servers/detail?reservation_id=r-tt7j22aa => generated 2927 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:28.460987 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4f90aed7-0ef0-486f-8e46-4a40ab5d5a18 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:28.461601 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4f90aed7-0ef0-486f-8e46-4a40ab5d5a18 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: b1c1e611-4be6-4a43-aaf0-d02bfd87875c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:28.477516 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4f90aed7-0ef0-486f-8e46-4a40ab5d5a18 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:28.478286 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4f90aed7-0ef0-486f-8e46-4a40ab5d5a18 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:28.478890 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4f90aed7-0ef0-486f-8e46-4a40ab5d5a18 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:28.479843 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4f90aed7-0ef0-486f-8e46-4a40ab5d5a18 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:28.480472 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4f90aed7-0ef0-486f-8e46-4a40ab5d5a18 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:28.481432 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4f90aed7-0ef0-486f-8e46-4a40ab5d5a18 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:28.505959 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-4f90aed7-0ef0-486f-8e46-4a40ab5d5a18 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] HTTP exception thrown: Instance b1c1e611-4be6-4a43-aaf0-d02bfd87875c could not be found. Aug 31 16:03:28.510664 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4f90aed7-0ef0-486f-8e46-4a40ab5d5a18 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Request method failure captured: Aug 31 16:03:28.510664 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/b1c1e611-4be6-4a43-aaf0-d02bfd87875c HTTP/1.1 Aug 31 16:03:28.510664 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:03:28.510664 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:03:28.510664 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:03:28.510664 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:03:28.510664 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:03:28.510664 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:03:28.510664 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:03:28.510664 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:03:28.510664 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4Yo5dNOTiRoHOXx-UM5Sn8Jbzoi0Z4yz9YBk3W8_DEhZnVZu-DDO0QOzNoQHJ1nNP8QtjbDsJSdq3n7hK4ZXI2LEyeWPrk9aNaREtGRbElEfeP-G76pg20KjiuDCyp0gfSMP_cw21bhq2fJbey8HuCI0lmGBIAsUVWfxqkVQu-gwfg Aug 31 16:03:28.510664 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:03:28.510664 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:03:28.510664 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:03:28.510664 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:03:28.510664 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:03:28.510664 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:03:28.510664 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: af5a8bccbcb14afd9c6bcd6f4d4f8047 Aug 31 16:03:28.510664 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-DeleteServersTestJSON-1125268000 Aug 31 16:03:28.510664 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:03:28.510664 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:03:28.514276 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/af5a8bccbcb14afd9c6bcd6f4d4f8047"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/af5a8bccbcb14afd9c6bcd6f4d4f8047"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_af5a8bccbcb14afd9c6bcd6f4d4f8047", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/af5a8bccbcb14afd9c6bcd6f4d4f8047"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:03:28.514276 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-DeleteServersTestJSON-1125268000 Aug 31 16:03:28.514276 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: af5a8bccbcb14afd9c6bcd6f4d4f8047 Aug 31 16:03:28.514276 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-DeleteServersTestJSON-1125268000 Aug 31 16:03:28.514276 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-DeleteServersTestJSON-1125268000-project Aug 31 16:03:28.514276 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:03:28.514276 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:03:28.514276 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 4ee58e6a7c284cc9a9c87d0a5c1239aa Aug 31 16:03:28.514276 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-DeleteServersTestJSON-1125268000-project Aug 31 16:03:28.514276 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:03:28.514276 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance b1c1e611-4be6-4a43-aaf0-d02bfd87875c could not be found. Aug 31 16:03:28.514276 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': 'b1c1e611-4be6-4a43-aaf0-d02bfd87875c'} Aug 31 16:03:28.515350 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:03:28.515350 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:03:28.515350 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:03:28.515350 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:03:28.515350 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:03:28.515350 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:03:28.515350 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:03:28.515350 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:03:28.515350 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:03:28.515350 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:03:28.515350 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1c1e611-4be6-4a43-aaf0-d02bfd87875c could not be found. Aug 31 16:03:28.515350 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:03:28.515350 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:03:28.515350 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:03:28.515350 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:03:28.515350 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:03:28.515350 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:03:28.515350 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:03:28.515350 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:03:28.515350 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:03:28.517521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:03:28.517521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:03:28.517521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:03:28.517521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:03:28.517521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:03:28.517521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:03:28.517521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:03:28.517521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1c1e611-4be6-4a43-aaf0-d02bfd87875c could not be found. Aug 31 16:03:28.517521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:03:28.517521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:03:28.517521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:03:28.517521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:03:28.517521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:03:28.517521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:03:28.517521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:03:28.517521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:03:28.517521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1c1e611-4be6-4a43-aaf0-d02bfd87875c could not be found. Aug 31 16:03:28.517521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:03:28.522900 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4f90aed7-0ef0-486f-8e46-4a40ab5d5a18 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Returning 404 to user: Instance b1c1e611-4be6-4a43-aaf0-d02bfd87875c could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:03:28.523978 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4f90aed7-0ef0-486f-8e46-4a40ab5d5a18 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/b1c1e611-4be6-4a43-aaf0-d02bfd87875c" status: 404 len: 111 microversion: 2.1 time: 0.067928 Aug 31 16:03:28.524725 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 998/1958] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:28 2022] GET /compute/v2.1/servers/b1c1e611-4be6-4a43-aaf0-d02bfd87875c => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:03:28.540250 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-094f356e-bf65-4d72-b8eb-f889a1c29c2e tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '.version_select at 0x7f5ae8e29310>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:28.619013 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-094f356e-bf65-4d72-b8eb-f889a1c29c2e tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/images/f505c75e-a15d-44cb-980b-62f98132dcb9" status: 200 len: 1439 microversion: 2.1 time: 0.086005 Aug 31 16:03:28.627571 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 999/1959] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:03:28 2022] GET /compute/v2.1/images/f505c75e-a15d-44cb-980b-62f98132dcb9 => generated 1439 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:28.632706 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c75643de-a61c-40b7-82fa-ff4d3401b168 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:28.650357 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.compute.server_groups [None req-c75643de-a61c-40b7-82fa-ff4d3401b168 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Querying cell 9f6d6683-96bf-42a7-a78d-78a22f1453ed(cell1) for 2 instances {{(pid=122256) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 31 16:03:28.651372 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c75643de-a61c-40b7-82fa-ff4d3401b168 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:28.651929 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c75643de-a61c-40b7-82fa-ff4d3401b168 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:28.652343 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c75643de-a61c-40b7-82fa-ff4d3401b168 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:28.678842 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c75643de-a61c-40b7-82fa-ff4d3401b168 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/os-server-groups/35f33a95-96b8-42b6-b807-0bcb84d43121" status: 200 len: 270 microversion: 2.1 time: 0.049839 Aug 31 16:03:28.680051 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1000/1960] 10.222.0.61 () {58 vars in 1263 bytes} [Wed Aug 31 16:03:28 2022] GET /compute/v2.1/os-server-groups/35f33a95-96b8-42b6-b807-0bcb84d43121 => generated 270 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:03:28.691440 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4f3436c4-f770-400c-b3c8-1d1110a3cd0f tempest-ServersOnMultiNodesTest-1555970217 tempest-ServersOnMultiNodesTest-1555970217-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:28.692162 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4f3436c4-f770-400c-b3c8-1d1110a3cd0f tempest-ServersOnMultiNodesTest-1555970217 tempest-ServersOnMultiNodesTest-1555970217-project-admin] [instance: 646d0250-a626-4bd1-821b-2117fde78cc8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:28.704923 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4f3436c4-f770-400c-b3c8-1d1110a3cd0f tempest-ServersOnMultiNodesTest-1555970217 tempest-ServersOnMultiNodesTest-1555970217-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:28.707319 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4f3436c4-f770-400c-b3c8-1d1110a3cd0f tempest-ServersOnMultiNodesTest-1555970217 tempest-ServersOnMultiNodesTest-1555970217-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:28.707908 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4f3436c4-f770-400c-b3c8-1d1110a3cd0f tempest-ServersOnMultiNodesTest-1555970217 tempest-ServersOnMultiNodesTest-1555970217-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:28.709762 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4f3436c4-f770-400c-b3c8-1d1110a3cd0f tempest-ServersOnMultiNodesTest-1555970217 tempest-ServersOnMultiNodesTest-1555970217-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:28.710242 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4f3436c4-f770-400c-b3c8-1d1110a3cd0f tempest-ServersOnMultiNodesTest-1555970217 tempest-ServersOnMultiNodesTest-1555970217-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:28.710777 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4f3436c4-f770-400c-b3c8-1d1110a3cd0f tempest-ServersOnMultiNodesTest-1555970217 tempest-ServersOnMultiNodesTest-1555970217-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:28.899538 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6683e222-d0ab-4afb-a18e-932c39c950f4 tempest-FloatingIPsTestJSON-529162035 tempest-FloatingIPsTestJSON-529162035-project] 10.222.0.61 "DELETE /compute/v2.1/os-floating-ips/219189d0-5843-4715-96e5-7234edba2668" status: 202 len: 0 microversion: 2.1 time: 1.194438 Aug 31 16:03:28.901064 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 961/1961] 10.222.0.61 () {58 vars in 1263 bytes} [Wed Aug 31 16:03:27 2022] DELETE /compute/v2.1/os-floating-ips/219189d0-5843-4715-96e5-7234edba2668 => generated 0 bytes in 1196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:03:28.909414 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-96931472-583a-4376-8f08-0dcd66cdd070 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-227710284", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "networks": [{"uuid": "b472c169-a645-4811-858d-fe4088611ce7"}]}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:03:28.931616 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4f3436c4-f770-400c-b3c8-1d1110a3cd0f tempest-ServersOnMultiNodesTest-1555970217 tempest-ServersOnMultiNodesTest-1555970217-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/646d0250-a626-4bd1-821b-2117fde78cc8" status: 200 len: 1618 microversion: 2.1 time: 0.244173 Aug 31 16:03:28.944079 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1001/1962] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:28 2022] GET /compute/v2.1/servers/646d0250-a626-4bd1-821b-2117fde78cc8 => generated 1618 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:28.959480 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b8e60747-8fcc-42de-9c8a-dbeeceee9f92 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:28.960586 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b8e60747-8fcc-42de-9c8a-dbeeceee9f92 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: dd702273-095b-4d44-8d1b-3d90f7833d5f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:28.971755 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b8e60747-8fcc-42de-9c8a-dbeeceee9f92 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:28.972479 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b8e60747-8fcc-42de-9c8a-dbeeceee9f92 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:28.973099 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b8e60747-8fcc-42de-9c8a-dbeeceee9f92 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:28.974269 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b8e60747-8fcc-42de-9c8a-dbeeceee9f92 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:28.975716 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b8e60747-8fcc-42de-9c8a-dbeeceee9f92 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:28.976803 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b8e60747-8fcc-42de-9c8a-dbeeceee9f92 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:28.990293 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-96931472-583a-4376-8f08-0dcd66cdd070 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] validate_networks() for [('b472c169-a645-4811-858d-fe4088611ce7', None, None, None, None, None)] {{(pid=122257) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:03:29.634554 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b8e60747-8fcc-42de-9c8a-dbeeceee9f92 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:29.644540 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b8e60747-8fcc-42de-9c8a-dbeeceee9f92 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f" status: 200 len: 1199 microversion: 2.1 time: 0.695821 Aug 31 16:03:29.651116 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1002/1963] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:28 2022] GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f => generated 1199 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:29.669691 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-27ed1970-6847-4571-bfe7-22cd94fe4596 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:29.669954 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-27ed1970-6847-4571-bfe7-22cd94fe4596 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6e82c98f-d644-4464-aca0-13901e551aa4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:29.673072 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=100 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:03:29.678795 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-27ed1970-6847-4571-bfe7-22cd94fe4596 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:29.679301 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-27ed1970-6847-4571-bfe7-22cd94fe4596 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:29.692944 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-27ed1970-6847-4571-bfe7-22cd94fe4596 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:29.692944 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-27ed1970-6847-4571-bfe7-22cd94fe4596 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:29.692944 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-27ed1970-6847-4571-bfe7-22cd94fe4596 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:29.692944 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-27ed1970-6847-4571-bfe7-22cd94fe4596 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:29.701096 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=100 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:03:29.973463 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-27ed1970-6847-4571-bfe7-22cd94fe4596 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:29.996192 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-27ed1970-6847-4571-bfe7-22cd94fe4596 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4" status: 200 len: 1475 microversion: 2.1 time: 0.343417 Aug 31 16:03:29.999064 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1003/1964] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:29 2022] GET /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4 => generated 1475 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:30.024080 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-58e0b26e-2853-4132-87be-3f88bbcd628f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:30.025668 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-58e0b26e-2853-4132-87be-3f88bbcd628f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 006771fc-9da9-4b78-9fad-f4b72c311fd5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:30.034203 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-58e0b26e-2853-4132-87be-3f88bbcd628f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:30.034992 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-58e0b26e-2853-4132-87be-3f88bbcd628f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:30.035626 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-58e0b26e-2853-4132-87be-3f88bbcd628f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:30.042374 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-96931472-583a-4376-8f08-0dcd66cdd070 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:03:30.044138 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-96931472-583a-4376-8f08-0dcd66cdd070 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:03:30.044849 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-96931472-583a-4376-8f08-0dcd66cdd070 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:03:30.045489 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-96931472-583a-4376-8f08-0dcd66cdd070 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:03:30.047198 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-96931472-583a-4376-8f08-0dcd66cdd070 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:03:30.052369 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-58e0b26e-2853-4132-87be-3f88bbcd628f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:30.053836 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-58e0b26e-2853-4132-87be-3f88bbcd628f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:30.054730 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-58e0b26e-2853-4132-87be-3f88bbcd628f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:30.082207 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-96931472-583a-4376-8f08-0dcd66cdd070 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:30.082721 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-96931472-583a-4376-8f08-0dcd66cdd070 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:30.083356 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-96931472-583a-4376-8f08-0dcd66cdd070 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:30.088670 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-96931472-583a-4376-8f08-0dcd66cdd070 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:30.089298 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-96931472-583a-4376-8f08-0dcd66cdd070 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:30.090019 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-96931472-583a-4376-8f08-0dcd66cdd070 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:30.114705 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-96931472-583a-4376-8f08-0dcd66cdd070 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Getting quotas for project af5a8bccbcb14afd9c6bcd6f4d4f8047. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:03:30.120405 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-96931472-583a-4376-8f08-0dcd66cdd070 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Getting quotas for user 4ee58e6a7c284cc9a9c87d0a5c1239aa and project af5a8bccbcb14afd9c6bcd6f4d4f8047. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:03:30.134491 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-96931472-583a-4376-8f08-0dcd66cdd070 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Going to run 1 instances... {{(pid=122257) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:03:30.136978 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-96931472-583a-4376-8f08-0dcd66cdd070 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: d8590729-e3da-4e04-9daa-7e04a3d88068] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:03:30.145551 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-58e0b26e-2853-4132-87be-3f88bbcd628f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:30.158823 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-58e0b26e-2853-4132-87be-3f88bbcd628f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:30.160913 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-58e0b26e-2853-4132-87be-3f88bbcd628f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:30.163171 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-58e0b26e-2853-4132-87be-3f88bbcd628f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5" status: 200 len: 1232 microversion: 2.25 time: 0.162551 Aug 31 16:03:30.178180 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1004/1965] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:03:29 2022] GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5 => generated 1232 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:03:30.184712 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f8d1cf82-9c33-4c61-90c3-1b4a58101a59 tempest-FloatingIPsTestJSON-529162035 tempest-FloatingIPsTestJSON-529162035-project] Calling method '.version_select at 0x7f5ae8dd2a60>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:30.213935 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-96931472-583a-4376-8f08-0dcd66cdd070 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.311561 Aug 31 16:03:30.215134 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 962/1966] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:03:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1313 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:03:30.221626 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-75347270-813f-4f74-a9ef-f0ae70808d93 tempest-ServersOnMultiNodesTest-1555970217 tempest-ServersOnMultiNodesTest-1555970217-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:30.222872 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-75347270-813f-4f74-a9ef-f0ae70808d93 tempest-ServersOnMultiNodesTest-1555970217 tempest-ServersOnMultiNodesTest-1555970217-project-admin] [instance: bf253a58-f38a-42d9-90b6-f3a80141cad2] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:30.230357 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-75347270-813f-4f74-a9ef-f0ae70808d93 tempest-ServersOnMultiNodesTest-1555970217 tempest-ServersOnMultiNodesTest-1555970217-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:30.231228 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-75347270-813f-4f74-a9ef-f0ae70808d93 tempest-ServersOnMultiNodesTest-1555970217 tempest-ServersOnMultiNodesTest-1555970217-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:30.231794 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-75347270-813f-4f74-a9ef-f0ae70808d93 tempest-ServersOnMultiNodesTest-1555970217 tempest-ServersOnMultiNodesTest-1555970217-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:30.233480 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-75347270-813f-4f74-a9ef-f0ae70808d93 tempest-ServersOnMultiNodesTest-1555970217 tempest-ServersOnMultiNodesTest-1555970217-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:30.234392 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-75347270-813f-4f74-a9ef-f0ae70808d93 tempest-ServersOnMultiNodesTest-1555970217 tempest-ServersOnMultiNodesTest-1555970217-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:30.235051 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-75347270-813f-4f74-a9ef-f0ae70808d93 tempest-ServersOnMultiNodesTest-1555970217 tempest-ServersOnMultiNodesTest-1555970217-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:30.249451 n-d-850499-9 devstack@n-api.service[122256]: DEBUG neutronclient.v2_0.client [None req-f8d1cf82-9c33-4c61-90c3-1b4a58101a59 tempest-FloatingIPsTestJSON-529162035 tempest-FloatingIPsTestJSON-529162035-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 219189d0-5843-4715-96e5-7234edba2668 could not be found", "detail": ""}} {{(pid=122256) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 31 16:03:30.250557 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-f8d1cf82-9c33-4c61-90c3-1b4a58101a59 tempest-FloatingIPsTestJSON-529162035 tempest-FloatingIPsTestJSON-529162035-project] HTTP exception thrown: Floating IP not found for ID 219189d0-5843-4715-96e5-7234edba2668 Aug 31 16:03:30.263803 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f8d1cf82-9c33-4c61-90c3-1b4a58101a59 tempest-FloatingIPsTestJSON-529162035 tempest-FloatingIPsTestJSON-529162035-project] Request method failure captured: Aug 31 16:03:30.263803 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/os-floating-ips/219189d0-5843-4715-96e5-7234edba2668 HTTP/1.1 Aug 31 16:03:30.263803 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:03:30.263803 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:03:30.263803 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:03:30.263803 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:03:30.263803 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:03:30.263803 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:03:30.263803 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:03:30.263803 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:03:30.263803 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4ZEkNEfNKNvgsIHQ2XoD7N_CVJvnXVjJW2vAvKzhyBuq_EVATYEJ0RxF5iyNoBnP936xMzZi-6hvZc7TdhOeFML_BSKbAhsSGBlhDnIij-s5bN-yi-pzfCK8Cn6iwZ9kFSKyZwXKHs05mm1QiLxrjo15suJXtdomOcM7Rz8i08INbQ Aug 31 16:03:30.263803 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:03:30.263803 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:03:30.263803 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:03:30.263803 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:03:30.263803 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:03:30.263803 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:03:30.263803 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: d8ed0ac186e842898352983681b1ab04 Aug 31 16:03:30.263803 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-FloatingIPsTestJSON-529162035 Aug 31 16:03:30.263803 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:03:30.263803 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:03:30.267298 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d8ed0ac186e842898352983681b1ab04"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/d8ed0ac186e842898352983681b1ab04"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_d8ed0ac186e842898352983681b1ab04", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d8ed0ac186e842898352983681b1ab04"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:03:30.267298 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-FloatingIPsTestJSON-529162035 Aug 31 16:03:30.267298 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: d8ed0ac186e842898352983681b1ab04 Aug 31 16:03:30.267298 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-FloatingIPsTestJSON-529162035 Aug 31 16:03:30.267298 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-FloatingIPsTestJSON-529162035-project Aug 31 16:03:30.267298 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:03:30.267298 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:03:30.267298 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 89541974e77e4404ad6d7389e5abc33c Aug 31 16:03:30.267298 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-FloatingIPsTestJSON-529162035-project Aug 31 16:03:30.267298 n-d-850499-9 devstack@n-api.service[122256]: method: Aug 31 16:03:30.267298 n-d-850499-9 devstack@n-api.service[122256]: exception: Floating IP not found for ID 219189d0-5843-4715-96e5-7234edba2668 Aug 31 16:03:30.267298 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '219189d0-5843-4715-96e5-7234edba2668'} Aug 31 16:03:30.267298 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:03:30.268429 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:03:30.268429 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 31 16:03:30.268429 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 31 16:03:30.268429 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:03:30.268429 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:03:30.268429 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 31 16:03:30.268429 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 31 16:03:30.268429 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:03:30.268429 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:03:30.268429 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 31 16:03:30.268429 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 31 16:03:30.268429 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:03:30.268429 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:03:30.268429 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 31 16:03:30.268429 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 31 16:03:30.268429 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:03:30.268429 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:03:30.268429 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 31 16:03:30.268429 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 31 16:03:30.271154 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:03:30.271154 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:03:30.271154 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 31 16:03:30.271154 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 31 16:03:30.271154 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 31 16:03:30.271154 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 31 16:03:30.271154 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 219189d0-5843-4715-96e5-7234edba2668 could not be found Aug 31 16:03:30.271154 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9448d9f1-2c8a-4532-b81b-d241a0dbb2ed'] Aug 31 16:03:30.271154 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:03:30.271154 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:03:30.271154 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:03:30.271154 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:03:30.271154 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Aug 31 16:03:30.271154 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 31 16:03:30.271154 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 31 16:03:30.271154 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 31 16:03:30.271154 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 219189d0-5843-4715-96e5-7234edba2668. Aug 31 16:03:30.271154 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:03:30.271154 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:03:30.271154 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:03:30.273955 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:03:30.273955 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:03:30.273955 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:03:30.273955 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:03:30.273955 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:03:30.273955 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:03:30.273955 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:03:30.273955 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:03:30.273955 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:03:30.273955 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Aug 31 16:03:30.273955 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 31 16:03:30.273955 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 219189d0-5843-4715-96e5-7234edba2668 Aug 31 16:03:30.273955 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:03:30.273955 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:03:30.273955 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:03:30.273955 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:03:30.273955 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:03:30.273955 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:03:30.273955 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:03:30.273955 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:03:30.275993 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 219189d0-5843-4715-96e5-7234edba2668 Aug 31 16:03:30.275993 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:03:30.275993 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f8d1cf82-9c33-4c61-90c3-1b4a58101a59 tempest-FloatingIPsTestJSON-529162035 tempest-FloatingIPsTestJSON-529162035-project] Returning 404 to user: Floating IP not found for ID 219189d0-5843-4715-96e5-7234edba2668 {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:03:30.275993 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f8d1cf82-9c33-4c61-90c3-1b4a58101a59 tempest-FloatingIPsTestJSON-529162035 tempest-FloatingIPsTestJSON-529162035-project] 10.222.0.61 "GET /compute/v2.1/os-floating-ips/219189d0-5843-4715-96e5-7234edba2668" status: 404 len: 111 microversion: 2.1 time: 0.085186 Aug 31 16:03:30.275993 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1005/1967] 10.222.0.61 () {58 vars in 1260 bytes} [Wed Aug 31 16:03:30 2022] GET /compute/v2.1/os-floating-ips/219189d0-5843-4715-96e5-7234edba2668 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:03:30.275993 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8cf89bcd-40cf-4754-9afb-a58e6501a4d8 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '.version_select at 0x7f5ae8e21280>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:30.348922 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8cf89bcd-40cf-4754-9afb-a58e6501a4d8 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/images/f505c75e-a15d-44cb-980b-62f98132dcb9" status: 200 len: 1439 microversion: 2.1 time: 0.080935 Aug 31 16:03:30.349599 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1006/1968] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:03:30 2022] GET /compute/v2.1/images/f505c75e-a15d-44cb-980b-62f98132dcb9 => generated 1439 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:30.361317 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b7820070-a4b6-4cfa-afb9-c8953bc147af tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:30.362078 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b7820070-a4b6-4cfa-afb9-c8953bc147af tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: d8590729-e3da-4e04-9daa-7e04a3d88068] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:30.487461 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b7820070-a4b6-4cfa-afb9-c8953bc147af tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:30.516397 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b7820070-a4b6-4cfa-afb9-c8953bc147af tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/d8590729-e3da-4e04-9daa-7e04a3d88068" status: 200 len: 1214 microversion: 2.1 time: 0.165815 Aug 31 16:03:30.517625 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1007/1969] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:30 2022] GET /compute/v2.1/servers/d8590729-e3da-4e04-9daa-7e04a3d88068 => generated 1214 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:30.527053 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-75347270-813f-4f74-a9ef-f0ae70808d93 tempest-ServersOnMultiNodesTest-1555970217 tempest-ServersOnMultiNodesTest-1555970217-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/bf253a58-f38a-42d9-90b6-f3a80141cad2" status: 200 len: 1618 microversion: 2.1 time: 0.306643 Aug 31 16:03:30.534539 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 963/1970] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:30 2022] GET /compute/v2.1/servers/bf253a58-f38a-42d9-90b6-f3a80141cad2 => generated 1618 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:30.535825 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1722d31a-4544-40f5-be98-bd1a3b2f68fe tempest-FloatingIPsTestJSON-529162035 tempest-FloatingIPsTestJSON-529162035-project] Calling method '.version_select at 0x7f5aed306f70>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:30.673504 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-913087b1-5027-43cf-bc94-87593f6a1956 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:30.674115 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-913087b1-5027-43cf-bc94-87593f6a1956 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: dd702273-095b-4d44-8d1b-3d90f7833d5f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:30.690401 n-d-850499-9 devstack@n-api.service[122256]: DEBUG neutronclient.v2_0.client [None req-1722d31a-4544-40f5-be98-bd1a3b2f68fe tempest-FloatingIPsTestJSON-529162035 tempest-FloatingIPsTestJSON-529162035-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 219189d0-5843-4715-96e5-7234edba2668 could not be found", "detail": ""}} {{(pid=122256) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 31 16:03:30.691096 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-1722d31a-4544-40f5-be98-bd1a3b2f68fe tempest-FloatingIPsTestJSON-529162035 tempest-FloatingIPsTestJSON-529162035-project] HTTP exception thrown: Floating IP not found for ID 219189d0-5843-4715-96e5-7234edba2668 Aug 31 16:03:30.693131 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1722d31a-4544-40f5-be98-bd1a3b2f68fe tempest-FloatingIPsTestJSON-529162035 tempest-FloatingIPsTestJSON-529162035-project] Request method failure captured: Aug 31 16:03:30.693131 n-d-850499-9 devstack@n-api.service[122256]: request: DELETE /compute/v2.1/os-floating-ips/219189d0-5843-4715-96e5-7234edba2668 HTTP/1.1 Aug 31 16:03:30.693131 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:03:30.693131 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:03:30.693131 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:03:30.693131 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:03:30.693131 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:03:30.693131 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:03:30.693131 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:03:30.693131 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:03:30.693131 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4ZEkNEfNKNvgsIHQ2XoD7N_CVJvnXVjJW2vAvKzhyBuq_EVATYEJ0RxF5iyNoBnP936xMzZi-6hvZc7TdhOeFML_BSKbAhsSGBlhDnIij-s5bN-yi-pzfCK8Cn6iwZ9kFSKyZwXKHs05mm1QiLxrjo15suJXtdomOcM7Rz8i08INbQ Aug 31 16:03:30.693131 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:03:30.693131 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:03:30.693131 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:03:30.693131 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:03:30.693131 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:03:30.693131 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:03:30.693131 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: d8ed0ac186e842898352983681b1ab04 Aug 31 16:03:30.693131 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-FloatingIPsTestJSON-529162035 Aug 31 16:03:30.693131 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:03:30.693131 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:03:30.694895 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d8ed0ac186e842898352983681b1ab04"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/d8ed0ac186e842898352983681b1ab04"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_d8ed0ac186e842898352983681b1ab04", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d8ed0ac186e842898352983681b1ab04"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:03:30.694895 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-FloatingIPsTestJSON-529162035 Aug 31 16:03:30.694895 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: d8ed0ac186e842898352983681b1ab04 Aug 31 16:03:30.694895 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-FloatingIPsTestJSON-529162035 Aug 31 16:03:30.694895 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-FloatingIPsTestJSON-529162035-project Aug 31 16:03:30.694895 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:03:30.694895 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:03:30.694895 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 89541974e77e4404ad6d7389e5abc33c Aug 31 16:03:30.694895 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-FloatingIPsTestJSON-529162035-project Aug 31 16:03:30.694895 n-d-850499-9 devstack@n-api.service[122256]: method: Aug 31 16:03:30.694895 n-d-850499-9 devstack@n-api.service[122256]: exception: Floating IP not found for ID 219189d0-5843-4715-96e5-7234edba2668 Aug 31 16:03:30.694895 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '219189d0-5843-4715-96e5-7234edba2668'} Aug 31 16:03:30.694895 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:03:30.701532 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:03:30.701532 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 31 16:03:30.701532 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 31 16:03:30.701532 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:03:30.701532 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:03:30.701532 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 31 16:03:30.701532 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 31 16:03:30.701532 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:03:30.701532 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:03:30.701532 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 31 16:03:30.701532 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 31 16:03:30.701532 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:03:30.701532 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:03:30.701532 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 31 16:03:30.701532 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 31 16:03:30.701532 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:03:30.701532 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:03:30.701532 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 31 16:03:30.701532 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 31 16:03:30.704561 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:03:30.704561 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:03:30.704561 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 31 16:03:30.704561 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 31 16:03:30.704561 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 31 16:03:30.704561 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 31 16:03:30.704561 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 219189d0-5843-4715-96e5-7234edba2668 could not be found Aug 31 16:03:30.704561 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9d211ca0-69a9-4f1a-9e9b-bd25d5ee99db'] Aug 31 16:03:30.704561 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:03:30.704561 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:03:30.704561 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:03:30.704561 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:03:30.704561 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Aug 31 16:03:30.704561 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 31 16:03:30.704561 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 31 16:03:30.704561 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 31 16:03:30.704561 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 219189d0-5843-4715-96e5-7234edba2668. Aug 31 16:03:30.704561 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:03:30.704561 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:03:30.704561 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:03:30.709175 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:03:30.709175 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:03:30.709175 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:03:30.709175 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:03:30.709175 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:03:30.709175 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:03:30.709175 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:03:30.709175 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:03:30.709175 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:03:30.709175 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Aug 31 16:03:30.709175 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 31 16:03:30.709175 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 219189d0-5843-4715-96e5-7234edba2668 Aug 31 16:03:30.709175 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:03:30.709175 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:03:30.709175 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:03:30.709175 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:03:30.709175 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:03:30.709175 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:03:30.709175 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:03:30.709175 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:03:30.712730 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 219189d0-5843-4715-96e5-7234edba2668 Aug 31 16:03:30.712730 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:03:30.712730 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1722d31a-4544-40f5-be98-bd1a3b2f68fe tempest-FloatingIPsTestJSON-529162035 tempest-FloatingIPsTestJSON-529162035-project] Returning 404 to user: Floating IP not found for ID 219189d0-5843-4715-96e5-7234edba2668 {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:03:30.712730 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1722d31a-4544-40f5-be98-bd1a3b2f68fe tempest-FloatingIPsTestJSON-529162035 tempest-FloatingIPsTestJSON-529162035-project] 10.222.0.61 "DELETE /compute/v2.1/os-floating-ips/219189d0-5843-4715-96e5-7234edba2668" status: 404 len: 111 microversion: 2.1 time: 0.175600 Aug 31 16:03:30.712730 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1008/1971] 10.222.0.61 () {58 vars in 1263 bytes} [Wed Aug 31 16:03:30 2022] DELETE /compute/v2.1/os-floating-ips/219189d0-5843-4715-96e5-7234edba2668 => generated 111 bytes in 177 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:03:30.715319 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-913087b1-5027-43cf-bc94-87593f6a1956 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:30.715319 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-913087b1-5027-43cf-bc94-87593f6a1956 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:30.715319 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-913087b1-5027-43cf-bc94-87593f6a1956 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:30.715319 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-913087b1-5027-43cf-bc94-87593f6a1956 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:30.716218 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-913087b1-5027-43cf-bc94-87593f6a1956 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:30.716218 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-913087b1-5027-43cf-bc94-87593f6a1956 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:30.786149 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-385caaee-9212-4230-87e2-7eef7dfccc3d tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1328970109", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "44f1ab8f-3a6c-41f3-b9fd-7f8aa243bcfa"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:03:30.928749 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-385caaee-9212-4230-87e2-7eef7dfccc3d tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] validate_networks() for None {{(pid=122256) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:03:31.217430 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-913087b1-5027-43cf-bc94-87593f6a1956 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:31.236093 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-913087b1-5027-43cf-bc94-87593f6a1956 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f" status: 200 len: 1199 microversion: 2.1 time: 0.567168 Aug 31 16:03:31.239969 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 964/1972] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:30 2022] GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f => generated 1199 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:31.250445 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ada174af-ccae-4e1f-acc6-b5498a50760b tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:31.251046 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ada174af-ccae-4e1f-acc6-b5498a50760b tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6e82c98f-d644-4464-aca0-13901e551aa4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:31.270900 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ada174af-ccae-4e1f-acc6-b5498a50760b tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:31.271422 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ada174af-ccae-4e1f-acc6-b5498a50760b tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:31.271891 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ada174af-ccae-4e1f-acc6-b5498a50760b tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:31.272610 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ada174af-ccae-4e1f-acc6-b5498a50760b tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:31.273067 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ada174af-ccae-4e1f-acc6-b5498a50760b tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:31.273494 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ada174af-ccae-4e1f-acc6-b5498a50760b tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:31.741618 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ada174af-ccae-4e1f-acc6-b5498a50760b tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:31.755447 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ada174af-ccae-4e1f-acc6-b5498a50760b tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4" status: 200 len: 1475 microversion: 2.1 time: 0.510576 Aug 31 16:03:31.757716 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 965/1973] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:31 2022] GET /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4 => generated 1475 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:31.768542 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4e8fe08d-b189-4f44-aaab-841eb477e4c7 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:31.771247 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4e8fe08d-b189-4f44-aaab-841eb477e4c7 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 006771fc-9da9-4b78-9fad-f4b72c311fd5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:31.788340 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4e8fe08d-b189-4f44-aaab-841eb477e4c7 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:31.789009 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4e8fe08d-b189-4f44-aaab-841eb477e4c7 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:31.789466 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4e8fe08d-b189-4f44-aaab-841eb477e4c7 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:31.790195 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4e8fe08d-b189-4f44-aaab-841eb477e4c7 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:31.790663 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4e8fe08d-b189-4f44-aaab-841eb477e4c7 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:31.791101 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4e8fe08d-b189-4f44-aaab-841eb477e4c7 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:31.814682 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-385caaee-9212-4230-87e2-7eef7dfccc3d tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:03:31.815249 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-385caaee-9212-4230-87e2-7eef7dfccc3d tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:03:31.815607 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-385caaee-9212-4230-87e2-7eef7dfccc3d tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:03:31.816027 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-385caaee-9212-4230-87e2-7eef7dfccc3d tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:03:31.816483 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-385caaee-9212-4230-87e2-7eef7dfccc3d tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:03:31.843279 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-385caaee-9212-4230-87e2-7eef7dfccc3d tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:31.843819 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-385caaee-9212-4230-87e2-7eef7dfccc3d tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:31.844276 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-385caaee-9212-4230-87e2-7eef7dfccc3d tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:31.845028 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-385caaee-9212-4230-87e2-7eef7dfccc3d tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:31.845491 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-385caaee-9212-4230-87e2-7eef7dfccc3d tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:31.845926 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-385caaee-9212-4230-87e2-7eef7dfccc3d tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:31.937544 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-385caaee-9212-4230-87e2-7eef7dfccc3d tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Getting quotas for project 7fa2effd15e440598752264e49d2457d. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:03:31.952109 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-385caaee-9212-4230-87e2-7eef7dfccc3d tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Getting quotas for user 547d88df13034daaad50c3582c7cc3b3 and project 7fa2effd15e440598752264e49d2457d. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:03:31.982398 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-385caaee-9212-4230-87e2-7eef7dfccc3d tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Going to run 1 instances... {{(pid=122256) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:03:31.993044 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-385caaee-9212-4230-87e2-7eef7dfccc3d tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 9d6a4c52-02e5-491b-ac04-917b710c332c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:03:32.088141 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-4e8fe08d-b189-4f44-aaab-841eb477e4c7 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:32.097136 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-4e8fe08d-b189-4f44-aaab-841eb477e4c7 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:32.098633 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-4e8fe08d-b189-4f44-aaab-841eb477e4c7 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:32.099806 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4e8fe08d-b189-4f44-aaab-841eb477e4c7 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5" status: 200 len: 1250 microversion: 2.25 time: 0.340931 Aug 31 16:03:32.100384 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 966/1974] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:03:31 2022] GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5 => generated 1250 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:03:32.121826 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-385caaee-9212-4230-87e2-7eef7dfccc3d tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.341031 Aug 31 16:03:32.122601 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1009/1975] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:03:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1343 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:03:32.140473 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-568d117d-3db7-4248-8944-d5c27fbfac25 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:32.146619 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1f270543-64ad-46a3-8e30-dedd9c517d14 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '.version_select at 0x7f5aed0f2d30>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:32.176484 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-568d117d-3db7-4248-8944-d5c27fbfac25 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: d8590729-e3da-4e04-9daa-7e04a3d88068] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:32.203413 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-568d117d-3db7-4248-8944-d5c27fbfac25 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:32.203967 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-568d117d-3db7-4248-8944-d5c27fbfac25 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:32.204746 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-568d117d-3db7-4248-8944-d5c27fbfac25 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:32.205129 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-568d117d-3db7-4248-8944-d5c27fbfac25 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:32.205596 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-568d117d-3db7-4248-8944-d5c27fbfac25 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:32.206032 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-568d117d-3db7-4248-8944-d5c27fbfac25 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:32.244626 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1f270543-64ad-46a3-8e30-dedd9c517d14 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/images/f505c75e-a15d-44cb-980b-62f98132dcb9" status: 200 len: 1439 microversion: 2.1 time: 0.143174 Aug 31 16:03:32.247695 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 967/1976] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:03:32 2022] GET /compute/v2.1/images/f505c75e-a15d-44cb-980b-62f98132dcb9 => generated 1439 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:32.261636 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7b82e1d3-71c1-4996-a4aa-5e65958f862a tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:32.272162 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7b82e1d3-71c1-4996-a4aa-5e65958f862a tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 9d6a4c52-02e5-491b-ac04-917b710c332c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:32.482975 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7b82e1d3-71c1-4996-a4aa-5e65958f862a tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:32.501352 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-568d117d-3db7-4248-8944-d5c27fbfac25 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:32.509349 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7b82e1d3-71c1-4996-a4aa-5e65958f862a tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/9d6a4c52-02e5-491b-ac04-917b710c332c" status: 200 len: 1217 microversion: 2.1 time: 0.251481 Aug 31 16:03:32.510631 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 968/1977] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:32 2022] GET /compute/v2.1/servers/9d6a4c52-02e5-491b-ac04-917b710c332c => generated 1217 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:32.514545 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-568d117d-3db7-4248-8944-d5c27fbfac25 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/d8590729-e3da-4e04-9daa-7e04a3d88068" status: 200 len: 1266 microversion: 2.1 time: 0.377004 Aug 31 16:03:32.516059 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-efa86079-a3f6-4b65-8eda-ebaf75cd8d9b tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:32.516676 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-efa86079-a3f6-4b65-8eda-ebaf75cd8d9b tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: dd702273-095b-4d44-8d1b-3d90f7833d5f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:32.517029 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1010/1978] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:32 2022] GET /compute/v2.1/servers/d8590729-e3da-4e04-9daa-7e04a3d88068 => generated 1266 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:32.549434 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-efa86079-a3f6-4b65-8eda-ebaf75cd8d9b tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:32.558082 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-efa86079-a3f6-4b65-8eda-ebaf75cd8d9b tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:32.560693 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-efa86079-a3f6-4b65-8eda-ebaf75cd8d9b tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:32.561689 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-efa86079-a3f6-4b65-8eda-ebaf75cd8d9b tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:32.562348 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-efa86079-a3f6-4b65-8eda-ebaf75cd8d9b tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:32.570804 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-efa86079-a3f6-4b65-8eda-ebaf75cd8d9b tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:32.782359 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9dfcb135-a426-4036-8c8d-dfff4f0aadc3 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:32.783402 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9dfcb135-a426-4036-8c8d-dfff4f0aadc3 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6e82c98f-d644-4464-aca0-13901e551aa4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:32.802488 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9dfcb135-a426-4036-8c8d-dfff4f0aadc3 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:32.803286 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9dfcb135-a426-4036-8c8d-dfff4f0aadc3 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:32.803938 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9dfcb135-a426-4036-8c8d-dfff4f0aadc3 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:32.804839 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9dfcb135-a426-4036-8c8d-dfff4f0aadc3 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:32.805649 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9dfcb135-a426-4036-8c8d-dfff4f0aadc3 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:32.806241 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9dfcb135-a426-4036-8c8d-dfff4f0aadc3 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:33.147150 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-efa86079-a3f6-4b65-8eda-ebaf75cd8d9b tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:33.169135 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-efa86079-a3f6-4b65-8eda-ebaf75cd8d9b tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f" status: 200 len: 1199 microversion: 2.1 time: 0.656543 Aug 31 16:03:33.173954 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 969/1979] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:32 2022] GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f => generated 1199 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:33.179840 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-82ad7ce2-ef01-4eba-98aa-d9e67345e024 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:33.180471 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-82ad7ce2-ef01-4eba-98aa-d9e67345e024 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 006771fc-9da9-4b78-9fad-f4b72c311fd5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:33.208810 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-82ad7ce2-ef01-4eba-98aa-d9e67345e024 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:33.209592 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-82ad7ce2-ef01-4eba-98aa-d9e67345e024 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:33.210097 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-82ad7ce2-ef01-4eba-98aa-d9e67345e024 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:33.210917 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-82ad7ce2-ef01-4eba-98aa-d9e67345e024 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:33.211415 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-82ad7ce2-ef01-4eba-98aa-d9e67345e024 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:33.212068 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-82ad7ce2-ef01-4eba-98aa-d9e67345e024 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:33.481643 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-9dfcb135-a426-4036-8c8d-dfff4f0aadc3 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:33.524180 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9dfcb135-a426-4036-8c8d-dfff4f0aadc3 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4" status: 200 len: 1475 microversion: 2.1 time: 0.746147 Aug 31 16:03:33.531582 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1011/1980] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:32 2022] GET /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4 => generated 1475 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:33.559969 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a8674d7a-6701-41fc-99f8-b481695a7e47 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '.version_select at 0x7f5aed301550>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:33.709826 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a8674d7a-6701-41fc-99f8-b481695a7e47 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/images/f505c75e-a15d-44cb-980b-62f98132dcb9" status: 200 len: 1439 microversion: 2.1 time: 0.176661 Aug 31 16:03:33.713368 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1012/1981] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:03:33 2022] GET /compute/v2.1/images/f505c75e-a15d-44cb-980b-62f98132dcb9 => generated 1439 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:33.720990 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-152a7248-bb30-4704-82f8-284b58623cd9 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:33.737353 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-152a7248-bb30-4704-82f8-284b58623cd9 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: d8590729-e3da-4e04-9daa-7e04a3d88068] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:33.759187 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-152a7248-bb30-4704-82f8-284b58623cd9 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:33.760023 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-152a7248-bb30-4704-82f8-284b58623cd9 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:33.760631 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-152a7248-bb30-4704-82f8-284b58623cd9 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:33.766973 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-152a7248-bb30-4704-82f8-284b58623cd9 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:33.767814 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-152a7248-bb30-4704-82f8-284b58623cd9 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:33.776582 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-152a7248-bb30-4704-82f8-284b58623cd9 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:33.791766 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-82ad7ce2-ef01-4eba-98aa-d9e67345e024 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:33.821240 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-82ad7ce2-ef01-4eba-98aa-d9e67345e024 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:33.824000 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-82ad7ce2-ef01-4eba-98aa-d9e67345e024 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:33.829689 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-82ad7ce2-ef01-4eba-98aa-d9e67345e024 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5" status: 200 len: 1292 microversion: 2.25 time: 0.654252 Aug 31 16:03:33.851376 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 970/1982] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:03:33 2022] GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5 => generated 1292 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:03:33.866258 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f34f821c-9c2f-4e27-bf38-f382b2b330ae tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:33.866893 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f34f821c-9c2f-4e27-bf38-f382b2b330ae tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 9d6a4c52-02e5-491b-ac04-917b710c332c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:33.890239 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f34f821c-9c2f-4e27-bf38-f382b2b330ae tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:33.896269 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f34f821c-9c2f-4e27-bf38-f382b2b330ae tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:33.904371 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f34f821c-9c2f-4e27-bf38-f382b2b330ae tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:33.905419 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f34f821c-9c2f-4e27-bf38-f382b2b330ae tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:33.906072 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f34f821c-9c2f-4e27-bf38-f382b2b330ae tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:33.906688 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f34f821c-9c2f-4e27-bf38-f382b2b330ae tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:34.116905 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f34f821c-9c2f-4e27-bf38-f382b2b330ae tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:34.127717 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f34f821c-9c2f-4e27-bf38-f382b2b330ae tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/9d6a4c52-02e5-491b-ac04-917b710c332c" status: 200 len: 1213 microversion: 2.1 time: 0.274805 Aug 31 16:03:34.142436 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 971/1983] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:33 2022] GET /compute/v2.1/servers/9d6a4c52-02e5-491b-ac04-917b710c332c => generated 1213 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:34.179006 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-152a7248-bb30-4704-82f8-284b58623cd9 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:34.188903 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-152a7248-bb30-4704-82f8-284b58623cd9 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/d8590729-e3da-4e04-9daa-7e04a3d88068" status: 200 len: 1272 microversion: 2.1 time: 0.473611 Aug 31 16:03:34.193048 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-aaabd3ab-de4a-4e4e-ac65-5ac32e84d806 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:34.193679 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-aaabd3ab-de4a-4e4e-ac65-5ac32e84d806 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: dd702273-095b-4d44-8d1b-3d90f7833d5f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:34.194047 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1013/1984] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:33 2022] GET /compute/v2.1/servers/d8590729-e3da-4e04-9daa-7e04a3d88068 => generated 1272 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:34.227984 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-aaabd3ab-de4a-4e4e-ac65-5ac32e84d806 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:34.228512 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-aaabd3ab-de4a-4e4e-ac65-5ac32e84d806 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:34.228969 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-aaabd3ab-de4a-4e4e-ac65-5ac32e84d806 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:34.237449 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-aaabd3ab-de4a-4e4e-ac65-5ac32e84d806 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:34.240746 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-aaabd3ab-de4a-4e4e-ac65-5ac32e84d806 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:34.241682 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-aaabd3ab-de4a-4e4e-ac65-5ac32e84d806 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:34.547200 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5cd067f3-5924-4704-ae5d-2108a0f0cf62 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:34.547957 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5cd067f3-5924-4704-ae5d-2108a0f0cf62 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6e82c98f-d644-4464-aca0-13901e551aa4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:34.561841 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5cd067f3-5924-4704-ae5d-2108a0f0cf62 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:34.562866 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5cd067f3-5924-4704-ae5d-2108a0f0cf62 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:34.565680 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5cd067f3-5924-4704-ae5d-2108a0f0cf62 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:34.567619 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5cd067f3-5924-4704-ae5d-2108a0f0cf62 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:34.568328 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5cd067f3-5924-4704-ae5d-2108a0f0cf62 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:34.569841 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5cd067f3-5924-4704-ae5d-2108a0f0cf62 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:34.655098 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-aaabd3ab-de4a-4e4e-ac65-5ac32e84d806 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:34.670227 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-aaabd3ab-de4a-4e4e-ac65-5ac32e84d806 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f" status: 200 len: 1199 microversion: 2.1 time: 0.481078 Aug 31 16:03:34.670834 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 972/1985] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:34 2022] GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f => generated 1199 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:34.727158 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-889d8912-7f15-4ce0-8541-745612aa61d8 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '.version_select at 0x7f5aed1e6160>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:34.803325 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-889d8912-7f15-4ce0-8541-745612aa61d8 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/images/f505c75e-a15d-44cb-980b-62f98132dcb9" status: 200 len: 1439 microversion: 2.1 time: 0.081243 Aug 31 16:03:34.805335 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 973/1986] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:03:34 2022] GET /compute/v2.1/images/f505c75e-a15d-44cb-980b-62f98132dcb9 => generated 1439 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:34.860399 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-922fbaf2-b7dd-40fc-9b35-d410b7ee0752 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:34.862053 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-922fbaf2-b7dd-40fc-9b35-d410b7ee0752 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 006771fc-9da9-4b78-9fad-f4b72c311fd5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:34.877332 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-922fbaf2-b7dd-40fc-9b35-d410b7ee0752 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:34.880245 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-922fbaf2-b7dd-40fc-9b35-d410b7ee0752 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:34.880975 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-922fbaf2-b7dd-40fc-9b35-d410b7ee0752 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:34.882088 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-922fbaf2-b7dd-40fc-9b35-d410b7ee0752 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:34.885556 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-922fbaf2-b7dd-40fc-9b35-d410b7ee0752 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:34.888861 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-922fbaf2-b7dd-40fc-9b35-d410b7ee0752 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:34.943005 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5cd067f3-5924-4704-ae5d-2108a0f0cf62 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:34.952857 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5cd067f3-5924-4704-ae5d-2108a0f0cf62 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4" status: 200 len: 1475 microversion: 2.1 time: 0.410642 Aug 31 16:03:34.961373 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1014/1987] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:34 2022] GET /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4 => generated 1475 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:03:35.159411 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c899e281-4799-4ca9-8c9a-9d5fb6214f0d tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:35.160752 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c899e281-4799-4ca9-8c9a-9d5fb6214f0d tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 9d6a4c52-02e5-491b-ac04-917b710c332c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:35.174500 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c899e281-4799-4ca9-8c9a-9d5fb6214f0d tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:35.175906 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c899e281-4799-4ca9-8c9a-9d5fb6214f0d tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:35.179029 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c899e281-4799-4ca9-8c9a-9d5fb6214f0d tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:35.179959 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c899e281-4799-4ca9-8c9a-9d5fb6214f0d tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:35.182933 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c899e281-4799-4ca9-8c9a-9d5fb6214f0d tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:35.183857 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c899e281-4799-4ca9-8c9a-9d5fb6214f0d tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:35.349843 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c899e281-4799-4ca9-8c9a-9d5fb6214f0d tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:35.363377 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c899e281-4799-4ca9-8c9a-9d5fb6214f0d tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/9d6a4c52-02e5-491b-ac04-917b710c332c" status: 200 len: 1277 microversion: 2.1 time: 0.214221 Aug 31 16:03:35.365176 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1015/1988] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:35 2022] GET /compute/v2.1/servers/9d6a4c52-02e5-491b-ac04-917b710c332c => generated 1277 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:03:35.379450 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c210f074-3cf7-4935-bf9f-3b3231adb600 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:35.380509 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c210f074-3cf7-4935-bf9f-3b3231adb600 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: d8590729-e3da-4e04-9daa-7e04a3d88068] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:35.397941 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c210f074-3cf7-4935-bf9f-3b3231adb600 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:35.398846 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c210f074-3cf7-4935-bf9f-3b3231adb600 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:35.403582 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c210f074-3cf7-4935-bf9f-3b3231adb600 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:35.404903 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c210f074-3cf7-4935-bf9f-3b3231adb600 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:35.405621 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c210f074-3cf7-4935-bf9f-3b3231adb600 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:35.406859 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c210f074-3cf7-4935-bf9f-3b3231adb600 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:35.474819 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-922fbaf2-b7dd-40fc-9b35-d410b7ee0752 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:35.506920 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-922fbaf2-b7dd-40fc-9b35-d410b7ee0752 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:35.535636 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-922fbaf2-b7dd-40fc-9b35-d410b7ee0752 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:35.535636 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-922fbaf2-b7dd-40fc-9b35-d410b7ee0752 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5" status: 200 len: 1292 microversion: 2.25 time: 0.666846 Aug 31 16:03:35.545522 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 974/1989] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:03:34 2022] GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5 => generated 1292 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:03:35.606454 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c210f074-3cf7-4935-bf9f-3b3231adb600 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:35.632578 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c210f074-3cf7-4935-bf9f-3b3231adb600 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/d8590729-e3da-4e04-9daa-7e04a3d88068" status: 200 len: 1272 microversion: 2.1 time: 0.263847 Aug 31 16:03:35.634101 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1016/1990] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:35 2022] GET /compute/v2.1/servers/d8590729-e3da-4e04-9daa-7e04a3d88068 => generated 1272 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:35.692870 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6a54b16f-a710-4999-bccf-4eb70611f028 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:35.696076 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6a54b16f-a710-4999-bccf-4eb70611f028 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: dd702273-095b-4d44-8d1b-3d90f7833d5f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:35.710936 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6a54b16f-a710-4999-bccf-4eb70611f028 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:35.713207 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6a54b16f-a710-4999-bccf-4eb70611f028 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:35.719367 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6a54b16f-a710-4999-bccf-4eb70611f028 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:35.720701 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6a54b16f-a710-4999-bccf-4eb70611f028 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:35.721806 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6a54b16f-a710-4999-bccf-4eb70611f028 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:35.722901 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6a54b16f-a710-4999-bccf-4eb70611f028 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:35.826747 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-baffc729-10ae-42da-b403-c5a1deedbe01 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '.version_select at 0x7f5ae928e0d0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:35.954875 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-baffc729-10ae-42da-b403-c5a1deedbe01 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/images/f505c75e-a15d-44cb-980b-62f98132dcb9" status: 200 len: 1439 microversion: 2.1 time: 0.134844 Aug 31 16:03:35.964139 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1017/1991] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:03:35 2022] GET /compute/v2.1/images/f505c75e-a15d-44cb-980b-62f98132dcb9 => generated 1439 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:03:35.989417 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-42c0e360-02ef-4903-b8dc-11f4217db40f tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:35.990546 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-42c0e360-02ef-4903-b8dc-11f4217db40f tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6e82c98f-d644-4464-aca0-13901e551aa4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:36.013562 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42c0e360-02ef-4903-b8dc-11f4217db40f tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:36.016078 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42c0e360-02ef-4903-b8dc-11f4217db40f tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:36.017505 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42c0e360-02ef-4903-b8dc-11f4217db40f tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:36.023255 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42c0e360-02ef-4903-b8dc-11f4217db40f tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:36.024188 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42c0e360-02ef-4903-b8dc-11f4217db40f tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:36.026230 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42c0e360-02ef-4903-b8dc-11f4217db40f tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:36.136466 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-6a54b16f-a710-4999-bccf-4eb70611f028 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:36.154653 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6a54b16f-a710-4999-bccf-4eb70611f028 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f" status: 200 len: 1199 microversion: 2.1 time: 0.467843 Aug 31 16:03:36.161696 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 975/1992] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:35 2022] GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f => generated 1199 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:36.388090 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e6073861-7493-4748-aff2-c230a01eb8bf tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:36.390704 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e6073861-7493-4748-aff2-c230a01eb8bf tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 9d6a4c52-02e5-491b-ac04-917b710c332c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:36.403240 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e6073861-7493-4748-aff2-c230a01eb8bf tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:36.406289 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e6073861-7493-4748-aff2-c230a01eb8bf tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:36.406977 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e6073861-7493-4748-aff2-c230a01eb8bf tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:36.408696 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e6073861-7493-4748-aff2-c230a01eb8bf tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:36.410500 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e6073861-7493-4748-aff2-c230a01eb8bf tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:36.412463 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e6073861-7493-4748-aff2-c230a01eb8bf tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:36.423266 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-42c0e360-02ef-4903-b8dc-11f4217db40f tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:36.457743 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-42c0e360-02ef-4903-b8dc-11f4217db40f tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4" status: 200 len: 1475 microversion: 2.1 time: 0.480949 Aug 31 16:03:36.462002 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1018/1993] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:35 2022] GET /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4 => generated 1475 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:36.562989 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-230f172a-ef0a-41c8-9a95-00870e164251 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:36.563652 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-230f172a-ef0a-41c8-9a95-00870e164251 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 006771fc-9da9-4b78-9fad-f4b72c311fd5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:36.590088 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-230f172a-ef0a-41c8-9a95-00870e164251 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:36.590729 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-230f172a-ef0a-41c8-9a95-00870e164251 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:36.591180 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-230f172a-ef0a-41c8-9a95-00870e164251 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:36.594421 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-230f172a-ef0a-41c8-9a95-00870e164251 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:36.596697 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-230f172a-ef0a-41c8-9a95-00870e164251 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:36.598482 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-230f172a-ef0a-41c8-9a95-00870e164251 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:36.720536 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e6073861-7493-4748-aff2-c230a01eb8bf tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:36.745094 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e6073861-7493-4748-aff2-c230a01eb8bf tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/9d6a4c52-02e5-491b-ac04-917b710c332c" status: 200 len: 1275 microversion: 2.1 time: 0.362415 Aug 31 16:03:36.746149 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 976/1994] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:36 2022] GET /compute/v2.1/servers/9d6a4c52-02e5-491b-ac04-917b710c332c => generated 1275 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:36.755474 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-444e8587-9f4b-46f2-b52c-4c95d413e0cb req-f52366b9-b66a-4276-ae9f-734db440c704 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "006771fc-9da9-4b78-9fad-f4b72c311fd5", "tag": "a0210474-72a8-4f79-a241-42969b6b4b66"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:03:36.775831 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-444e8587-9f4b-46f2-b52c-4c95d413e0cb req-f52366b9-b66a-4276-ae9f-734db440c704 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:36.776792 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-444e8587-9f4b-46f2-b52c-4c95d413e0cb req-f52366b9-b66a-4276-ae9f-734db440c704 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:36.780111 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-444e8587-9f4b-46f2-b52c-4c95d413e0cb req-f52366b9-b66a-4276-ae9f-734db440c704 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:36.803216 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-444e8587-9f4b-46f2-b52c-4c95d413e0cb req-f52366b9-b66a-4276-ae9f-734db440c704 service nova] Creating event network-changed:a0210474-72a8-4f79-a241-42969b6b4b66 for instance 006771fc-9da9-4b78-9fad-f4b72c311fd5 on n-h2-850499-9 Aug 31 16:03:36.817179 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-444e8587-9f4b-46f2-b52c-4c95d413e0cb req-f52366b9-b66a-4276-ae9f-734db440c704 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069165 Aug 31 16:03:36.818135 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 977/1995] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:03:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:03:36.829943 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9cbd9fd7-18a2-4104-b1d2-acad63c158a0 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:36.833351 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9cbd9fd7-18a2-4104-b1d2-acad63c158a0 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: d8590729-e3da-4e04-9daa-7e04a3d88068] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:36.846592 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9cbd9fd7-18a2-4104-b1d2-acad63c158a0 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:36.848197 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9cbd9fd7-18a2-4104-b1d2-acad63c158a0 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:36.849332 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9cbd9fd7-18a2-4104-b1d2-acad63c158a0 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:36.851744 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9cbd9fd7-18a2-4104-b1d2-acad63c158a0 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:36.852437 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9cbd9fd7-18a2-4104-b1d2-acad63c158a0 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:36.857472 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9cbd9fd7-18a2-4104-b1d2-acad63c158a0 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:37.257533 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-230f172a-ef0a-41c8-9a95-00870e164251 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:37.266278 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-230f172a-ef0a-41c8-9a95-00870e164251 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:37.275822 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-230f172a-ef0a-41c8-9a95-00870e164251 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:37.280477 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-230f172a-ef0a-41c8-9a95-00870e164251 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5" status: 200 len: 1292 microversion: 2.25 time: 0.731855 Aug 31 16:03:37.281170 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1019/1996] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:03:36 2022] GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5 => generated 1292 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:03:37.294604 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6169eadd-240e-41c0-aa13-28b5adec124b tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '.version_select at 0x7f5ae9282a60>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:37.336410 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9cbd9fd7-18a2-4104-b1d2-acad63c158a0 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:37.353783 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9cbd9fd7-18a2-4104-b1d2-acad63c158a0 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/d8590729-e3da-4e04-9daa-7e04a3d88068" status: 200 len: 1314 microversion: 2.1 time: 0.532829 Aug 31 16:03:37.354921 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 978/1997] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:36 2022] GET /compute/v2.1/servers/d8590729-e3da-4e04-9daa-7e04a3d88068 => generated 1314 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:37.368897 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-c8c77dae-ccb4-427e-b1a7-15208268b229 req-dfe475ae-137d-4413-8e28-a5e6f9ca2809 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd702273-095b-4d44-8d1b-3d90f7833d5f", "name": "network-vif-plugged", "status": "completed", "tag": "64253c19-8d47-46b3-808b-0eed0e37d942"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:03:37.371729 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6169eadd-240e-41c0-aa13-28b5adec124b tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/images/f505c75e-a15d-44cb-980b-62f98132dcb9" status: 200 len: 1439 microversion: 2.1 time: 0.086936 Aug 31 16:03:37.378052 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1020/1998] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:03:37 2022] GET /compute/v2.1/images/f505c75e-a15d-44cb-980b-62f98132dcb9 => generated 1439 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:37.383801 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2f4a61a8-7f2f-48dd-bc63-68359ae04778 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:37.388669 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2f4a61a8-7f2f-48dd-bc63-68359ae04778 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: dd702273-095b-4d44-8d1b-3d90f7833d5f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:37.406984 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-c8c77dae-ccb4-427e-b1a7-15208268b229 req-dfe475ae-137d-4413-8e28-a5e6f9ca2809 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:37.407474 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-c8c77dae-ccb4-427e-b1a7-15208268b229 req-dfe475ae-137d-4413-8e28-a5e6f9ca2809 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:37.409430 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2f4a61a8-7f2f-48dd-bc63-68359ae04778 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:37.409796 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-c8c77dae-ccb4-427e-b1a7-15208268b229 req-dfe475ae-137d-4413-8e28-a5e6f9ca2809 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:37.410316 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2f4a61a8-7f2f-48dd-bc63-68359ae04778 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:37.410926 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2f4a61a8-7f2f-48dd-bc63-68359ae04778 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:37.411867 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2f4a61a8-7f2f-48dd-bc63-68359ae04778 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:37.412496 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2f4a61a8-7f2f-48dd-bc63-68359ae04778 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:37.413095 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2f4a61a8-7f2f-48dd-bc63-68359ae04778 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:37.452977 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-c8c77dae-ccb4-427e-b1a7-15208268b229 req-dfe475ae-137d-4413-8e28-a5e6f9ca2809 service nova] Creating event network-vif-plugged:64253c19-8d47-46b3-808b-0eed0e37d942 for instance dd702273-095b-4d44-8d1b-3d90f7833d5f on n-h2-850499-9 Aug 31 16:03:37.466985 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-c8c77dae-ccb4-427e-b1a7-15208268b229 req-dfe475ae-137d-4413-8e28-a5e6f9ca2809 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109708 Aug 31 16:03:37.469608 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 979/1999] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:03:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:03:37.477597 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-cb4f78d5-4a0c-4581-b698-55433e0867c3 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:37.503629 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-cb4f78d5-4a0c-4581-b698-55433e0867c3 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '90770e7e060c4ded869851dea068189c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab675eb7ef3e45e68d74d737484c6e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:37.504697 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-cb4f78d5-4a0c-4581-b698-55433e0867c3 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Searching by: {'deleted': False, 'project_id': 'ab675eb7ef3e45e68d74d737484c6e6c'} {{(pid=122257) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 16:03:37.518476 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cb4f78d5-4a0c-4581-b698-55433e0867c3 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:37.519326 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cb4f78d5-4a0c-4581-b698-55433e0867c3 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:37.520007 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cb4f78d5-4a0c-4581-b698-55433e0867c3 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:37.521277 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cb4f78d5-4a0c-4581-b698-55433e0867c3 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:37.524246 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cb4f78d5-4a0c-4581-b698-55433e0867c3 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:37.524902 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cb4f78d5-4a0c-4581-b698-55433e0867c3 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:37.598724 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.multi_cell_list [None req-cb4f78d5-4a0c-4581-b698-55433e0867c3 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122257) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 31 16:03:37.617442 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=100 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:03:37.710682 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-cb4f78d5-4a0c-4581-b698-55433e0867c3 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] 10.222.0.61 "GET /compute/v2.1/servers" status: 200 len: 339 microversion: 2.1 time: 0.239120 Aug 31 16:03:37.712529 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 980/2000] 10.222.0.61 () {58 vars in 1125 bytes} [Wed Aug 31 16:03:37 2022] GET /compute/v2.1/servers => generated 339 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:03:37.735345 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-23ec317c-8bca-4889-879a-278946d7ea47 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:37.739306 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-23ec317c-8bca-4889-879a-278946d7ea47 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6e82c98f-d644-4464-aca0-13901e551aa4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:37.759659 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-2f4a61a8-7f2f-48dd-bc63-68359ae04778 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:37.771873 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2f4a61a8-7f2f-48dd-bc63-68359ae04778 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f" status: 200 len: 1199 microversion: 2.1 time: 0.392310 Aug 31 16:03:37.775333 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1021/2001] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:37 2022] GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f => generated 1199 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:37.779876 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-23ec317c-8bca-4889-879a-278946d7ea47 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:37.780401 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-23ec317c-8bca-4889-879a-278946d7ea47 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:37.780845 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-23ec317c-8bca-4889-879a-278946d7ea47 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:37.781632 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-23ec317c-8bca-4889-879a-278946d7ea47 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:37.782097 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-23ec317c-8bca-4889-879a-278946d7ea47 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:37.782528 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-23ec317c-8bca-4889-879a-278946d7ea47 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:37.784944 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f1839bbd-9b9a-468c-a39d-be090c47d2cb tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:37.801158 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f1839bbd-9b9a-468c-a39d-be090c47d2cb tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '90770e7e060c4ded869851dea068189c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab675eb7ef3e45e68d74d737484c6e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:37.802164 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f1839bbd-9b9a-468c-a39d-be090c47d2cb tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Searching by: {'deleted': False, 'project_id': 'ab675eb7ef3e45e68d74d737484c6e6c'} {{(pid=122256) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 16:03:37.814180 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f1839bbd-9b9a-468c-a39d-be090c47d2cb tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:37.814673 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f1839bbd-9b9a-468c-a39d-be090c47d2cb tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:37.815113 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f1839bbd-9b9a-468c-a39d-be090c47d2cb tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:37.815882 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f1839bbd-9b9a-468c-a39d-be090c47d2cb tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:37.816345 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f1839bbd-9b9a-468c-a39d-be090c47d2cb tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:37.816775 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f1839bbd-9b9a-468c-a39d-be090c47d2cb tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:37.897534 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.multi_cell_list [None req-f1839bbd-9b9a-468c-a39d-be090c47d2cb tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122256) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 31 16:03:38.120366 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f1839bbd-9b9a-468c-a39d-be090c47d2cb tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90770e7e060c4ded869851dea068189c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab675eb7ef3e45e68d74d737484c6e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:38.141851 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f1839bbd-9b9a-468c-a39d-be090c47d2cb tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:38.145851 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f1839bbd-9b9a-468c-a39d-be090c47d2cb tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:38.146341 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f1839bbd-9b9a-468c-a39d-be090c47d2cb tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:38.538580 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f1839bbd-9b9a-468c-a39d-be090c47d2cb tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] 10.222.0.61 "GET /compute/v2.1/servers/detail" status: 200 len: 1710 microversion: 2.1 time: 0.762048 Aug 31 16:03:38.539287 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1022/2002] 10.222.0.61 () {58 vars in 1146 bytes} [Wed Aug 31 16:03:37 2022] GET /compute/v2.1/servers/detail => generated 1710 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:38.562167 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-79060935-1d42-448d-869d-ea6c1b8dd566 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:38.563230 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-79060935-1d42-448d-869d-ea6c1b8dd566 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 9d6a4c52-02e5-491b-ac04-917b710c332c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:38.580001 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-79060935-1d42-448d-869d-ea6c1b8dd566 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:38.580772 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-79060935-1d42-448d-869d-ea6c1b8dd566 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:38.581381 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-79060935-1d42-448d-869d-ea6c1b8dd566 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:38.582611 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-79060935-1d42-448d-869d-ea6c1b8dd566 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:38.584917 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-79060935-1d42-448d-869d-ea6c1b8dd566 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:38.585538 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-79060935-1d42-448d-869d-ea6c1b8dd566 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:38.618106 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-23ec317c-8bca-4889-879a-278946d7ea47 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:38.628306 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-23ec317c-8bca-4889-879a-278946d7ea47 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4" status: 200 len: 1475 microversion: 2.1 time: 0.913032 Aug 31 16:03:38.632294 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 981/2003] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:37 2022] GET /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4 => generated 1475 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:38.642601 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5594ee7c-790f-4e72-9f98-4ceedc8f5845 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:38.644215 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5594ee7c-790f-4e72-9f98-4ceedc8f5845 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 006771fc-9da9-4b78-9fad-f4b72c311fd5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:38.659563 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5594ee7c-790f-4e72-9f98-4ceedc8f5845 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:38.660283 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5594ee7c-790f-4e72-9f98-4ceedc8f5845 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:38.664340 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5594ee7c-790f-4e72-9f98-4ceedc8f5845 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:38.665526 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5594ee7c-790f-4e72-9f98-4ceedc8f5845 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:38.666202 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5594ee7c-790f-4e72-9f98-4ceedc8f5845 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:38.666809 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5594ee7c-790f-4e72-9f98-4ceedc8f5845 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:39.059918 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-79060935-1d42-448d-869d-ea6c1b8dd566 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:39.068712 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-79060935-1d42-448d-869d-ea6c1b8dd566 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/9d6a4c52-02e5-491b-ac04-917b710c332c" status: 200 len: 1317 microversion: 2.1 time: 0.516007 Aug 31 16:03:39.089651 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1023/2004] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:38 2022] GET /compute/v2.1/servers/9d6a4c52-02e5-491b-ac04-917b710c332c => generated 1317 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:39.098219 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4e867e03-cb60-452c-8d70-f8da8623ae9e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:39.099816 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4e867e03-cb60-452c-8d70-f8da8623ae9e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: d8590729-e3da-4e04-9daa-7e04a3d88068] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:39.116919 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4e867e03-cb60-452c-8d70-f8da8623ae9e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:39.117741 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4e867e03-cb60-452c-8d70-f8da8623ae9e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:39.118748 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4e867e03-cb60-452c-8d70-f8da8623ae9e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:39.119676 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4e867e03-cb60-452c-8d70-f8da8623ae9e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:39.120308 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4e867e03-cb60-452c-8d70-f8da8623ae9e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:39.120925 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4e867e03-cb60-452c-8d70-f8da8623ae9e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:39.129087 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5594ee7c-790f-4e72-9f98-4ceedc8f5845 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:39.140020 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5594ee7c-790f-4e72-9f98-4ceedc8f5845 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:39.141959 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5594ee7c-790f-4e72-9f98-4ceedc8f5845 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:39.143444 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5594ee7c-790f-4e72-9f98-4ceedc8f5845 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5" status: 200 len: 1292 microversion: 2.25 time: 0.510146 Aug 31 16:03:39.144843 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 982/2005] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:03:38 2022] GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5 => generated 1292 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:03:39.150659 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-20a750ce-866a-4163-8cae-1e6c3c8bcf3b tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '.version_select at 0x7f5aed1caa60>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:39.206087 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-20a750ce-866a-4163-8cae-1e6c3c8bcf3b tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/images/f505c75e-a15d-44cb-980b-62f98132dcb9" status: 200 len: 1448 microversion: 2.1 time: 0.059972 Aug 31 16:03:39.206673 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 983/2006] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:03:39 2022] GET /compute/v2.1/images/f505c75e-a15d-44cb-980b-62f98132dcb9 => generated 1448 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:39.221309 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ec172207-c1ab-4b6a-8892-10b6d5bb26be tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:39.228646 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:03:39.231788 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ec172207-c1ab-4b6a-8892-10b6d5bb26be tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] 10.222.0.61 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014154 Aug 31 16:03:39.232750 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 984/2007] 10.222.0.61 () {58 vars in 1137 bytes} [Wed Aug 31 16:03:39 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:03:39.237876 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0a56a093-bef0-431c-a522-c93d4a9a7275 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:39.238761 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0a56a093-bef0-431c-a522-c93d4a9a7275 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: dd702273-095b-4d44-8d1b-3d90f7833d5f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:39.247568 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0a56a093-bef0-431c-a522-c93d4a9a7275 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:39.248301 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0a56a093-bef0-431c-a522-c93d4a9a7275 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:39.248906 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0a56a093-bef0-431c-a522-c93d4a9a7275 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:39.249786 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0a56a093-bef0-431c-a522-c93d4a9a7275 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:39.250247 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0a56a093-bef0-431c-a522-c93d4a9a7275 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:39.250671 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0a56a093-bef0-431c-a522-c93d4a9a7275 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:39.328536 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-4e867e03-cb60-452c-8d70-f8da8623ae9e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:39.338630 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4e867e03-cb60-452c-8d70-f8da8623ae9e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/d8590729-e3da-4e04-9daa-7e04a3d88068" status: 200 len: 1314 microversion: 2.1 time: 0.247236 Aug 31 16:03:39.341432 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1024/2008] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:39 2022] GET /compute/v2.1/servers/d8590729-e3da-4e04-9daa-7e04a3d88068 => generated 1314 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:39.348200 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-46611090-e33b-4510-baf4-a7a9e4cc5307 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '.version_select at 0x7f5ae9282d30>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:39.415217 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-46611090-e33b-4510-baf4-a7a9e4cc5307 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/images/f505c75e-a15d-44cb-980b-62f98132dcb9" status: 200 len: 1448 microversion: 2.1 time: 0.072115 Aug 31 16:03:39.416551 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1025/2009] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:03:39 2022] GET /compute/v2.1/images/f505c75e-a15d-44cb-980b-62f98132dcb9 => generated 1448 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:39.435840 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0a56a093-bef0-431c-a522-c93d4a9a7275 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:39.440316 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-501bdad9-e9b9-4500-834f-fb2e66b4b82c tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '.version_select at 0x7f5ae9367ca0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:39.449831 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0a56a093-bef0-431c-a522-c93d4a9a7275 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f" status: 200 len: 1199 microversion: 2.1 time: 0.215241 Aug 31 16:03:39.454235 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 985/2010] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:39 2022] GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f => generated 1199 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:39.617815 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0845b335-f54e-4a3d-b028-ead3d94e99a3 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:39.618710 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0845b335-f54e-4a3d-b028-ead3d94e99a3 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] [instance: 7523e0a9-60e8-42ba-b271-d63251e373b7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:39.626632 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0845b335-f54e-4a3d-b028-ead3d94e99a3 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:39.627737 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0845b335-f54e-4a3d-b028-ead3d94e99a3 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:39.628448 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0845b335-f54e-4a3d-b028-ead3d94e99a3 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:39.629414 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0845b335-f54e-4a3d-b028-ead3d94e99a3 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:39.630119 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0845b335-f54e-4a3d-b028-ead3d94e99a3 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:39.631720 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0845b335-f54e-4a3d-b028-ead3d94e99a3 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:39.684107 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0845b335-f54e-4a3d-b028-ead3d94e99a3 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] [instance: 7523e0a9-60e8-42ba-b271-d63251e373b7] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:03:39.834702 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0845b335-f54e-4a3d-b028-ead3d94e99a3 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] 10.222.0.61 "DELETE /compute/v2.1/servers/7523e0a9-60e8-42ba-b271-d63251e373b7" status: 204 len: 0 microversion: 2.1 time: 0.220983 Aug 31 16:03:39.836071 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 986/2011] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:03:39 2022] DELETE /compute/v2.1/servers/7523e0a9-60e8-42ba-b271-d63251e373b7 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:03:39.845192 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ac779108-a0c9-40e0-a3c9-bc656379c845 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:39.846178 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ac779108-a0c9-40e0-a3c9-bc656379c845 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6e82c98f-d644-4464-aca0-13901e551aa4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:39.854951 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ac779108-a0c9-40e0-a3c9-bc656379c845 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:39.855625 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ac779108-a0c9-40e0-a3c9-bc656379c845 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:39.856074 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ac779108-a0c9-40e0-a3c9-bc656379c845 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:39.857370 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ac779108-a0c9-40e0-a3c9-bc656379c845 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:39.858088 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ac779108-a0c9-40e0-a3c9-bc656379c845 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:39.858491 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ac779108-a0c9-40e0-a3c9-bc656379c845 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:40.157409 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ac779108-a0c9-40e0-a3c9-bc656379c845 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:40.168884 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ac779108-a0c9-40e0-a3c9-bc656379c845 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4" status: 200 len: 1475 microversion: 2.1 time: 0.330239 Aug 31 16:03:40.187903 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 987/2012] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:39 2022] GET /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4 => generated 1475 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:40.193323 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1dd3b0e9-5c56-4b29-848c-b6a8b80c2d83 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:40.193944 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1dd3b0e9-5c56-4b29-848c-b6a8b80c2d83 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] [instance: 7523e0a9-60e8-42ba-b271-d63251e373b7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:40.201158 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1dd3b0e9-5c56-4b29-848c-b6a8b80c2d83 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:40.201741 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1dd3b0e9-5c56-4b29-848c-b6a8b80c2d83 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:40.202192 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1dd3b0e9-5c56-4b29-848c-b6a8b80c2d83 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:40.202901 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1dd3b0e9-5c56-4b29-848c-b6a8b80c2d83 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:40.203692 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1dd3b0e9-5c56-4b29-848c-b6a8b80c2d83 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:40.204123 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1dd3b0e9-5c56-4b29-848c-b6a8b80c2d83 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:40.272297 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-501bdad9-e9b9-4500-834f-fb2e66b4b82c tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "DELETE /compute/v2.1/images/f505c75e-a15d-44cb-980b-62f98132dcb9" status: 204 len: 0 microversion: 2.1 time: 0.843387 Aug 31 16:03:40.273363 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1026/2013] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:39 2022] DELETE /compute/v2.1/images/f505c75e-a15d-44cb-980b-62f98132dcb9 => generated 0 bytes in 845 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:03:40.279971 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-1923f725-9a27-44c2-a400-f960980e4ff6 req-b02d52b0-87d3-4ad2-b3f7-71891ff1e926 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8590729-e3da-4e04-9daa-7e04a3d88068", "tag": "ad3a95e6-8a22-4c56-abd4-a82f6b1e06b0"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:03:40.296675 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-1923f725-9a27-44c2-a400-f960980e4ff6 req-b02d52b0-87d3-4ad2-b3f7-71891ff1e926 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:40.297484 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-1923f725-9a27-44c2-a400-f960980e4ff6 req-b02d52b0-87d3-4ad2-b3f7-71891ff1e926 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:40.298221 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-1923f725-9a27-44c2-a400-f960980e4ff6 req-b02d52b0-87d3-4ad2-b3f7-71891ff1e926 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:40.332731 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-1923f725-9a27-44c2-a400-f960980e4ff6 req-b02d52b0-87d3-4ad2-b3f7-71891ff1e926 service nova] Creating event network-changed:ad3a95e6-8a22-4c56-abd4-a82f6b1e06b0 for instance d8590729-e3da-4e04-9daa-7e04a3d88068 on n-h1-850499-9 Aug 31 16:03:40.344653 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-1923f725-9a27-44c2-a400-f960980e4ff6 req-b02d52b0-87d3-4ad2-b3f7-71891ff1e926 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069294 Aug 31 16:03:40.346088 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1027/2014] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:03:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:03:40.356248 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d51b3ddd-5e9a-406a-9d61-f0ac38c8fc6a tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:40.358333 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d51b3ddd-5e9a-406a-9d61-f0ac38c8fc6a tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 9d6a4c52-02e5-491b-ac04-917b710c332c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:40.367461 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d51b3ddd-5e9a-406a-9d61-f0ac38c8fc6a tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:40.368404 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d51b3ddd-5e9a-406a-9d61-f0ac38c8fc6a tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:40.369249 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d51b3ddd-5e9a-406a-9d61-f0ac38c8fc6a tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:40.370167 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d51b3ddd-5e9a-406a-9d61-f0ac38c8fc6a tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:40.371343 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d51b3ddd-5e9a-406a-9d61-f0ac38c8fc6a tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:40.372286 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d51b3ddd-5e9a-406a-9d61-f0ac38c8fc6a tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:40.656880 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-1dd3b0e9-5c56-4b29-848c-b6a8b80c2d83 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90770e7e060c4ded869851dea068189c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab675eb7ef3e45e68d74d737484c6e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:40.678767 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1dd3b0e9-5c56-4b29-848c-b6a8b80c2d83 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] 10.222.0.61 "GET /compute/v2.1/servers/7523e0a9-60e8-42ba-b271-d63251e373b7" status: 200 len: 1713 microversion: 2.1 time: 0.489828 Aug 31 16:03:40.680161 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 988/2015] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:40 2022] GET /compute/v2.1/servers/7523e0a9-60e8-42ba-b271-d63251e373b7 => generated 1713 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:40.686227 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-232ead78-b303-4f96-9811-b8c1e23b90b5 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:40.690076 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-232ead78-b303-4f96-9811-b8c1e23b90b5 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 006771fc-9da9-4b78-9fad-f4b72c311fd5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:40.703330 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-232ead78-b303-4f96-9811-b8c1e23b90b5 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:40.708417 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-232ead78-b303-4f96-9811-b8c1e23b90b5 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:40.709401 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-232ead78-b303-4f96-9811-b8c1e23b90b5 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:40.710609 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-232ead78-b303-4f96-9811-b8c1e23b90b5 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:40.720789 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-232ead78-b303-4f96-9811-b8c1e23b90b5 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:40.721530 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-232ead78-b303-4f96-9811-b8c1e23b90b5 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:40.841114 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d51b3ddd-5e9a-406a-9d61-f0ac38c8fc6a tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:40.850963 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d51b3ddd-5e9a-406a-9d61-f0ac38c8fc6a tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/9d6a4c52-02e5-491b-ac04-917b710c332c" status: 200 len: 1317 microversion: 2.1 time: 0.503328 Aug 31 16:03:40.857464 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1028/2016] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:40 2022] GET /compute/v2.1/servers/9d6a4c52-02e5-491b-ac04-917b710c332c => generated 1317 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:40.869620 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8c519216-4486-4c5c-af86-aebc66698500 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:40.871175 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8c519216-4486-4c5c-af86-aebc66698500 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: cafdad7c-e670-48df-8c07-a2405d19f357] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:40.878242 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8c519216-4486-4c5c-af86-aebc66698500 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:40.879100 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8c519216-4486-4c5c-af86-aebc66698500 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:40.879918 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8c519216-4486-4c5c-af86-aebc66698500 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:40.880859 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8c519216-4486-4c5c-af86-aebc66698500 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:40.881836 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8c519216-4486-4c5c-af86-aebc66698500 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:40.882489 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8c519216-4486-4c5c-af86-aebc66698500 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:40.923994 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8c519216-4486-4c5c-af86-aebc66698500 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: cafdad7c-e670-48df-8c07-a2405d19f357] Going to try to terminate instance {{(pid=122256) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:03:40.927680 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=100 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:03:41.044287 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8c519216-4486-4c5c-af86-aebc66698500 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "DELETE /compute/v2.1/servers/cafdad7c-e670-48df-8c07-a2405d19f357" status: 204 len: 0 microversion: 2.1 time: 0.177478 Aug 31 16:03:41.045231 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1029/2017] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:03:40 2022] DELETE /compute/v2.1/servers/cafdad7c-e670-48df-8c07-a2405d19f357 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:03:41.062463 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-232ead78-b303-4f96-9811-b8c1e23b90b5 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:41.073187 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5057800e-d108-4020-94b9-1d231d9ad2f1 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:41.075620 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5057800e-d108-4020-94b9-1d231d9ad2f1 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: d8590729-e3da-4e04-9daa-7e04a3d88068] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:41.084558 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5057800e-d108-4020-94b9-1d231d9ad2f1 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:41.085020 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-232ead78-b303-4f96-9811-b8c1e23b90b5 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:41.085511 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5057800e-d108-4020-94b9-1d231d9ad2f1 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:41.086633 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5057800e-d108-4020-94b9-1d231d9ad2f1 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:41.090864 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5057800e-d108-4020-94b9-1d231d9ad2f1 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:41.091621 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-232ead78-b303-4f96-9811-b8c1e23b90b5 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:41.091934 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5057800e-d108-4020-94b9-1d231d9ad2f1 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:41.092536 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5057800e-d108-4020-94b9-1d231d9ad2f1 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:41.094366 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-232ead78-b303-4f96-9811-b8c1e23b90b5 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5" status: 200 len: 1292 microversion: 2.25 time: 0.413016 Aug 31 16:03:41.095781 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 989/2018] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:03:40 2022] GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5 => generated 1292 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:03:41.110600 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8936e23b-b6f8-47bd-93d4-006ed2e51222 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:41.111702 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8936e23b-b6f8-47bd-93d4-006ed2e51222 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: dd702273-095b-4d44-8d1b-3d90f7833d5f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:41.127010 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8936e23b-b6f8-47bd-93d4-006ed2e51222 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:41.127010 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8936e23b-b6f8-47bd-93d4-006ed2e51222 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:41.131061 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8936e23b-b6f8-47bd-93d4-006ed2e51222 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:41.132218 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8936e23b-b6f8-47bd-93d4-006ed2e51222 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:41.140321 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8936e23b-b6f8-47bd-93d4-006ed2e51222 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:41.141113 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8936e23b-b6f8-47bd-93d4-006ed2e51222 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:41.742270 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5057800e-d108-4020-94b9-1d231d9ad2f1 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:41.751165 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5057800e-d108-4020-94b9-1d231d9ad2f1 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/d8590729-e3da-4e04-9daa-7e04a3d88068" status: 200 len: 1314 microversion: 2.1 time: 0.704323 Aug 31 16:03:41.752402 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1030/2019] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:41 2022] GET /compute/v2.1/servers/d8590729-e3da-4e04-9daa-7e04a3d88068 => generated 1314 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:41.757493 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-bb0ef971-311a-4ed5-b2b1-73ebd61742f3 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:41.758236 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-bb0ef971-311a-4ed5-b2b1-73ebd61742f3 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6e82c98f-d644-4464-aca0-13901e551aa4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:41.765481 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bb0ef971-311a-4ed5-b2b1-73ebd61742f3 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:41.766070 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bb0ef971-311a-4ed5-b2b1-73ebd61742f3 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:41.766746 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bb0ef971-311a-4ed5-b2b1-73ebd61742f3 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:41.767542 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bb0ef971-311a-4ed5-b2b1-73ebd61742f3 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:41.768086 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bb0ef971-311a-4ed5-b2b1-73ebd61742f3 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:41.768574 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bb0ef971-311a-4ed5-b2b1-73ebd61742f3 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:41.848616 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8936e23b-b6f8-47bd-93d4-006ed2e51222 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:41.856957 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8936e23b-b6f8-47bd-93d4-006ed2e51222 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f" status: 200 len: 1199 microversion: 2.1 time: 0.759888 Aug 31 16:03:41.857534 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 990/2020] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:41 2022] GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f => generated 1199 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:41.862153 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-fcde775b-0a21-4c86-b568-323c0ca376e0 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1027894648", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "networks": [{"uuid": "1815935f-c9a0-4f0c-9c89-45f534415ab2"}]}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:03:41.940448 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-fcde775b-0a21-4c86-b568-323c0ca376e0 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] validate_networks() for [('1815935f-c9a0-4f0c-9c89-45f534415ab2', None, None, None, None, None)] {{(pid=122257) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:03:42.069728 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-bb0ef971-311a-4ed5-b2b1-73ebd61742f3 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:42.080360 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-bb0ef971-311a-4ed5-b2b1-73ebd61742f3 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4" status: 200 len: 1475 microversion: 2.1 time: 0.326143 Aug 31 16:03:42.081229 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1031/2021] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:41 2022] GET /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4 => generated 1475 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:42.086191 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7294539f-a4e6-4808-9f75-08a7aaa2ea40 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:42.086792 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7294539f-a4e6-4808-9f75-08a7aaa2ea40 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] [instance: 7523e0a9-60e8-42ba-b271-d63251e373b7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:42.093871 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7294539f-a4e6-4808-9f75-08a7aaa2ea40 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:42.094664 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7294539f-a4e6-4808-9f75-08a7aaa2ea40 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:42.095245 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7294539f-a4e6-4808-9f75-08a7aaa2ea40 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:42.096207 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7294539f-a4e6-4808-9f75-08a7aaa2ea40 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:42.096756 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7294539f-a4e6-4808-9f75-08a7aaa2ea40 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:42.097366 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7294539f-a4e6-4808-9f75-08a7aaa2ea40 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:42.357408 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7294539f-a4e6-4808-9f75-08a7aaa2ea40 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90770e7e060c4ded869851dea068189c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab675eb7ef3e45e68d74d737484c6e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:42.365981 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7294539f-a4e6-4808-9f75-08a7aaa2ea40 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] 10.222.0.61 "GET /compute/v2.1/servers/7523e0a9-60e8-42ba-b271-d63251e373b7" status: 200 len: 1713 microversion: 2.1 time: 0.283586 Aug 31 16:03:42.366569 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1032/2022] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:42 2022] GET /compute/v2.1/servers/7523e0a9-60e8-42ba-b271-d63251e373b7 => generated 1713 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:42.373186 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-12083833-06d7-48f4-b2e4-7e11e628eb22 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:42.373950 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-12083833-06d7-48f4-b2e4-7e11e628eb22 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 9d6a4c52-02e5-491b-ac04-917b710c332c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:42.381124 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-12083833-06d7-48f4-b2e4-7e11e628eb22 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:42.381553 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-12083833-06d7-48f4-b2e4-7e11e628eb22 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:42.382002 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-12083833-06d7-48f4-b2e4-7e11e628eb22 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:42.382981 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-12083833-06d7-48f4-b2e4-7e11e628eb22 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:42.383467 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-12083833-06d7-48f4-b2e4-7e11e628eb22 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:42.383933 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-12083833-06d7-48f4-b2e4-7e11e628eb22 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:42.487336 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=14 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:03:42.616718 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-12083833-06d7-48f4-b2e4-7e11e628eb22 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:42.627725 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-12083833-06d7-48f4-b2e4-7e11e628eb22 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/9d6a4c52-02e5-491b-ac04-917b710c332c" status: 200 len: 1317 microversion: 2.1 time: 0.259867 Aug 31 16:03:42.629942 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-fcde775b-0a21-4c86-b568-323c0ca376e0 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:03:42.630606 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-fcde775b-0a21-4c86-b568-323c0ca376e0 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:03:42.631241 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-fcde775b-0a21-4c86-b568-323c0ca376e0 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:03:42.632012 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-fcde775b-0a21-4c86-b568-323c0ca376e0 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:03:42.632589 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-fcde775b-0a21-4c86-b568-323c0ca376e0 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:03:42.642886 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1033/2023] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:42 2022] GET /compute/v2.1/servers/9d6a4c52-02e5-491b-ac04-917b710c332c => generated 1317 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:42.650403 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-86d4ef3a-dd64-46fa-b72e-43fbce7579d9 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:42.651334 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-86d4ef3a-dd64-46fa-b72e-43fbce7579d9 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 006771fc-9da9-4b78-9fad-f4b72c311fd5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:42.659532 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fcde775b-0a21-4c86-b568-323c0ca376e0 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:42.660152 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fcde775b-0a21-4c86-b568-323c0ca376e0 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:42.661613 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-86d4ef3a-dd64-46fa-b72e-43fbce7579d9 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:42.662348 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fcde775b-0a21-4c86-b568-323c0ca376e0 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:42.662645 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-86d4ef3a-dd64-46fa-b72e-43fbce7579d9 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:42.663465 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-86d4ef3a-dd64-46fa-b72e-43fbce7579d9 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:42.663649 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fcde775b-0a21-4c86-b568-323c0ca376e0 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:42.664058 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fcde775b-0a21-4c86-b568-323c0ca376e0 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:42.664498 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fcde775b-0a21-4c86-b568-323c0ca376e0 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:42.664998 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-86d4ef3a-dd64-46fa-b72e-43fbce7579d9 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:42.666071 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-86d4ef3a-dd64-46fa-b72e-43fbce7579d9 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:42.666833 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-86d4ef3a-dd64-46fa-b72e-43fbce7579d9 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:42.712423 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-fcde775b-0a21-4c86-b568-323c0ca376e0 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Getting quotas for project 61a9f3fcc4b445349e5c66ff712e8598. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:03:42.728022 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-fcde775b-0a21-4c86-b568-323c0ca376e0 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Getting quotas for user f1ccd03a4aa84f93bc26b438e1468f46 and project 61a9f3fcc4b445349e5c66ff712e8598. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:03:42.766798 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-fcde775b-0a21-4c86-b568-323c0ca376e0 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Going to run 1 instances... {{(pid=122257) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:03:42.769984 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-fcde775b-0a21-4c86-b568-323c0ca376e0 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: 007aba90-0e41-45d6-97f2-2d20b29d4296] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:03:42.832024 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-fcde775b-0a21-4c86-b568-323c0ca376e0 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.971062 Aug 31 16:03:42.838475 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 991/2024] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:03:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 975 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:03:42.844025 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-25774725-80ae-4998-bece-9faea0835fdf req-af1b7c2e-b1df-4bee-b209-da35b5f9524a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d6a4c52-02e5-491b-ac04-917b710c332c", "tag": "ecf300a4-940b-4328-9b57-bd2c3a0ae844"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:03:42.856064 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-25774725-80ae-4998-bece-9faea0835fdf req-af1b7c2e-b1df-4bee-b209-da35b5f9524a service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:42.856864 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-25774725-80ae-4998-bece-9faea0835fdf req-af1b7c2e-b1df-4bee-b209-da35b5f9524a service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:42.857002 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-25774725-80ae-4998-bece-9faea0835fdf req-af1b7c2e-b1df-4bee-b209-da35b5f9524a service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:42.869782 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-25774725-80ae-4998-bece-9faea0835fdf req-af1b7c2e-b1df-4bee-b209-da35b5f9524a service nova] Creating event network-changed:ecf300a4-940b-4328-9b57-bd2c3a0ae844 for instance 9d6a4c52-02e5-491b-ac04-917b710c332c on n-h1-850499-9 Aug 31 16:03:42.877182 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-25774725-80ae-4998-bece-9faea0835fdf req-af1b7c2e-b1df-4bee-b209-da35b5f9524a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043276 Aug 31 16:03:42.878702 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 992/2025] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:03:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:03:42.886141 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-6409327d-8fb0-4763-8796-468c0d4b4fd2 req-a973f63b-df1d-4cfc-9322-e068cfbd82c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cafdad7c-e670-48df-8c07-a2405d19f357", "name": "network-vif-unplugged", "status": "completed", "tag": "8b9d6092-352b-4fc5-a622-919e58ed2dea"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:03:42.898663 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-6409327d-8fb0-4763-8796-468c0d4b4fd2 req-a973f63b-df1d-4cfc-9322-e068cfbd82c8 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:42.899537 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-6409327d-8fb0-4763-8796-468c0d4b4fd2 req-a973f63b-df1d-4cfc-9322-e068cfbd82c8 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:42.900785 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-6409327d-8fb0-4763-8796-468c0d4b4fd2 req-a973f63b-df1d-4cfc-9322-e068cfbd82c8 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:42.919731 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-6409327d-8fb0-4763-8796-468c0d4b4fd2 req-a973f63b-df1d-4cfc-9322-e068cfbd82c8 service nova] Creating event network-vif-unplugged:8b9d6092-352b-4fc5-a622-919e58ed2dea for instance cafdad7c-e670-48df-8c07-a2405d19f357 on n-h1-850499-9 Aug 31 16:03:42.935079 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-6409327d-8fb0-4763-8796-468c0d4b4fd2 req-a973f63b-df1d-4cfc-9322-e068cfbd82c8 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054599 Aug 31 16:03:42.937680 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 993/2026] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:03:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:03:42.945326 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1c8750bf-a8a8-4b02-a67a-6d767194c3b9 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:42.946541 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1c8750bf-a8a8-4b02-a67a-6d767194c3b9 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: d8590729-e3da-4e04-9daa-7e04a3d88068] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:42.954783 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1c8750bf-a8a8-4b02-a67a-6d767194c3b9 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:42.955781 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1c8750bf-a8a8-4b02-a67a-6d767194c3b9 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:42.956665 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1c8750bf-a8a8-4b02-a67a-6d767194c3b9 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:42.957745 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1c8750bf-a8a8-4b02-a67a-6d767194c3b9 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:42.958362 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1c8750bf-a8a8-4b02-a67a-6d767194c3b9 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:42.959225 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1c8750bf-a8a8-4b02-a67a-6d767194c3b9 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:43.098169 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-86d4ef3a-dd64-46fa-b72e-43fbce7579d9 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:43.114809 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-86d4ef3a-dd64-46fa-b72e-43fbce7579d9 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:43.116302 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-86d4ef3a-dd64-46fa-b72e-43fbce7579d9 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:43.117871 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-86d4ef3a-dd64-46fa-b72e-43fbce7579d9 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5" status: 200 len: 1292 microversion: 2.25 time: 0.473177 Aug 31 16:03:43.119151 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1034/2027] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:03:42 2022] GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5 => generated 1292 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:03:43.124442 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-857a6a75-af40-40d3-9291-1a43d20b5a30 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:43.125249 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-857a6a75-af40-40d3-9291-1a43d20b5a30 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: 007aba90-0e41-45d6-97f2-2d20b29d4296] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:43.186637 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-1c8750bf-a8a8-4b02-a67a-6d767194c3b9 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:43.194482 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1c8750bf-a8a8-4b02-a67a-6d767194c3b9 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/d8590729-e3da-4e04-9daa-7e04a3d88068" status: 200 len: 1314 microversion: 2.1 time: 0.255290 Aug 31 16:03:43.204259 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-857a6a75-af40-40d3-9291-1a43d20b5a30 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ccd03a4aa84f93bc26b438e1468f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a9f3fcc4b445349e5c66ff712e8598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:43.212266 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 994/2028] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:42 2022] GET /compute/v2.1/servers/d8590729-e3da-4e04-9daa-7e04a3d88068 => generated 1314 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:43.213295 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-857a6a75-af40-40d3-9291-1a43d20b5a30 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/servers/007aba90-0e41-45d6-97f2-2d20b29d4296" status: 200 len: 1208 microversion: 2.1 time: 0.092830 Aug 31 16:03:43.213912 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1035/2029] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:43 2022] GET /compute/v2.1/servers/007aba90-0e41-45d6-97f2-2d20b29d4296 => generated 1208 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:43.218931 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-85c11974-f399-4b51-bd2d-8e4f6301bcb2 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:43.220921 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-cff437ad-c5b7-496d-afb9-f25001674f78 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:43.222024 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-85c11974-f399-4b51-bd2d-8e4f6301bcb2 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6e82c98f-d644-4464-aca0-13901e551aa4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:43.223009 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-cff437ad-c5b7-496d-afb9-f25001674f78 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: dd702273-095b-4d44-8d1b-3d90f7833d5f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:43.232419 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-85c11974-f399-4b51-bd2d-8e4f6301bcb2 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:43.232926 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-85c11974-f399-4b51-bd2d-8e4f6301bcb2 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:43.233370 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-85c11974-f399-4b51-bd2d-8e4f6301bcb2 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:43.234127 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-85c11974-f399-4b51-bd2d-8e4f6301bcb2 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:43.234764 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-85c11974-f399-4b51-bd2d-8e4f6301bcb2 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:43.235365 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-85c11974-f399-4b51-bd2d-8e4f6301bcb2 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:43.240270 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cff437ad-c5b7-496d-afb9-f25001674f78 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:43.241626 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cff437ad-c5b7-496d-afb9-f25001674f78 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:43.245713 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cff437ad-c5b7-496d-afb9-f25001674f78 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:43.247200 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cff437ad-c5b7-496d-afb9-f25001674f78 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:43.247778 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cff437ad-c5b7-496d-afb9-f25001674f78 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:43.248287 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cff437ad-c5b7-496d-afb9-f25001674f78 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:43.468265 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-85c11974-f399-4b51-bd2d-8e4f6301bcb2 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:43.470898 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-cff437ad-c5b7-496d-afb9-f25001674f78 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:43.478743 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-cff437ad-c5b7-496d-afb9-f25001674f78 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f" status: 200 len: 1382 microversion: 2.1 time: 0.265219 Aug 31 16:03:43.480695 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 995/2030] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:43 2022] GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f => generated 1382 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:43.482156 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-85c11974-f399-4b51-bd2d-8e4f6301bcb2 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4" status: 200 len: 1475 microversion: 2.1 time: 0.267153 Aug 31 16:03:43.482930 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1036/2031] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:43 2022] GET /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4 => generated 1475 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:43.488318 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-53474eb6-19b7-466a-b312-5e8db2b9efc8 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:43.489312 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-53474eb6-19b7-466a-b312-5e8db2b9efc8 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] [instance: 7523e0a9-60e8-42ba-b271-d63251e373b7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:43.497684 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-53474eb6-19b7-466a-b312-5e8db2b9efc8 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:43.498577 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-53474eb6-19b7-466a-b312-5e8db2b9efc8 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:43.499456 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-53474eb6-19b7-466a-b312-5e8db2b9efc8 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:43.500691 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-53474eb6-19b7-466a-b312-5e8db2b9efc8 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:43.501400 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-53474eb6-19b7-466a-b312-5e8db2b9efc8 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:43.501992 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-53474eb6-19b7-466a-b312-5e8db2b9efc8 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:43.640651 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6fb5fadc-8b78-4aee-8bf5-0c4c43d7cd5d tempest-ImagesDeleteNegativeTestJSON-530808558 tempest-ImagesDeleteNegativeTestJSON-530808558-project] 10.222.0.61 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.152995 Aug 31 16:03:43.641207 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 996/2032] 10.222.0.61 () {58 vars in 1128 bytes} [Wed Aug 31 16:03:43 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 31 16:03:43.663734 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-53474eb6-19b7-466a-b312-5e8db2b9efc8 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90770e7e060c4ded869851dea068189c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab675eb7ef3e45e68d74d737484c6e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:43.671814 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-53474eb6-19b7-466a-b312-5e8db2b9efc8 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] 10.222.0.61 "GET /compute/v2.1/servers/7523e0a9-60e8-42ba-b271-d63251e373b7" status: 200 len: 1713 microversion: 2.1 time: 0.187864 Aug 31 16:03:43.672560 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1037/2033] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:43 2022] GET /compute/v2.1/servers/7523e0a9-60e8-42ba-b271-d63251e373b7 => generated 1713 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:43.677485 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7b0930b7-ce2a-46fe-b8db-84bc9f338a9c tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:43.678105 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7b0930b7-ce2a-46fe-b8db-84bc9f338a9c tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 9d6a4c52-02e5-491b-ac04-917b710c332c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:43.685764 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7b0930b7-ce2a-46fe-b8db-84bc9f338a9c tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:43.686549 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7b0930b7-ce2a-46fe-b8db-84bc9f338a9c tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:43.687200 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7b0930b7-ce2a-46fe-b8db-84bc9f338a9c tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:43.687946 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7b0930b7-ce2a-46fe-b8db-84bc9f338a9c tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:43.688404 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7b0930b7-ce2a-46fe-b8db-84bc9f338a9c tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:43.688835 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7b0930b7-ce2a-46fe-b8db-84bc9f338a9c tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:43.777823 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ad7742ea-d952-4503-bfaa-67404c6cdacc tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:43.778445 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ad7742ea-d952-4503-bfaa-67404c6cdacc tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] [instance: dd702273-095b-4d44-8d1b-3d90f7833d5f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:43.785195 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ad7742ea-d952-4503-bfaa-67404c6cdacc tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:43.785687 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ad7742ea-d952-4503-bfaa-67404c6cdacc tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:43.786332 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ad7742ea-d952-4503-bfaa-67404c6cdacc tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:43.787326 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ad7742ea-d952-4503-bfaa-67404c6cdacc tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:43.788589 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ad7742ea-d952-4503-bfaa-67404c6cdacc tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:43.789023 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ad7742ea-d952-4503-bfaa-67404c6cdacc tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:43.848425 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7b0930b7-ce2a-46fe-b8db-84bc9f338a9c tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:43.857166 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7b0930b7-ce2a-46fe-b8db-84bc9f338a9c tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/9d6a4c52-02e5-491b-ac04-917b710c332c" status: 200 len: 1317 microversion: 2.1 time: 0.183148 Aug 31 16:03:43.857750 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1038/2034] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:43 2022] GET /compute/v2.1/servers/9d6a4c52-02e5-491b-ac04-917b710c332c => generated 1317 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:43.875242 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a159685d-c7ce-4e5b-bc67-c8688abe7727 tempest-ImagesDeleteNegativeTestJSON-530808558 tempest-ImagesDeleteNegativeTestJSON-530808558-project] Calling method '.version_select at 0x7f5ae93cd4c0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:43.899277 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-a159685d-c7ce-4e5b-bc67-c8688abe7727 tempest-ImagesDeleteNegativeTestJSON-530808558 tempest-ImagesDeleteNegativeTestJSON-530808558-project] HTTP exception thrown: Image not found. Aug 31 16:03:43.901369 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a159685d-c7ce-4e5b-bc67-c8688abe7727 tempest-ImagesDeleteNegativeTestJSON-530808558 tempest-ImagesDeleteNegativeTestJSON-530808558-project] Request method failure captured: Aug 31 16:03:43.901369 n-d-850499-9 devstack@n-api.service[122256]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Aug 31 16:03:43.901369 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:03:43.901369 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:03:43.901369 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:03:43.901369 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:03:43.901369 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:03:43.901369 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:03:43.901369 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:03:43.901369 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:03:43.901369 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4ZfL__Z4rQXQNH9k_HWvczo_eQ3KaDVDtVuweXaXqLlJh4yQdcDeDTMjKfubiMQ4nJ9D0sP80RWf_0VWZoq2Kvf91KGapQtHZiy8mS4P5mh4_Rt1LMJDyerPChMiMzV5Q-ofzJw0lYoj-0RA7RDAy_bQpoHJFPsijtzqNS2oHpFY4A Aug 31 16:03:43.901369 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:03:43.901369 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:03:43.901369 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:03:43.901369 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:03:43.901369 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:03:43.901369 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:03:43.901369 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 7def6c58321f4f0ca3b1e7c4b7e87828 Aug 31 16:03:43.901369 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-530808558 Aug 31 16:03:43.901369 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:03:43.901369 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:03:43.903116 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7def6c58321f4f0ca3b1e7c4b7e87828"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7def6c58321f4f0ca3b1e7c4b7e87828"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7def6c58321f4f0ca3b1e7c4b7e87828", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7def6c58321f4f0ca3b1e7c4b7e87828"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:03:43.903116 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-530808558 Aug 31 16:03:43.903116 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 7def6c58321f4f0ca3b1e7c4b7e87828 Aug 31 16:03:43.903116 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-530808558 Aug 31 16:03:43.903116 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ImagesDeleteNegativeTestJSON-530808558-project Aug 31 16:03:43.903116 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:03:43.903116 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:03:43.903116 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 1376677103774541b60986b1b7158a61 Aug 31 16:03:43.903116 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-530808558-project Aug 31 16:03:43.903116 n-d-850499-9 devstack@n-api.service[122256]: method: Aug 31 16:03:43.903116 n-d-850499-9 devstack@n-api.service[122256]: exception: Image not found. Aug 31 16:03:43.903116 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '-1'} Aug 31 16:03:43.903116 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:03:43.903116 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:03:43.904764 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 31 16:03:43.904764 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 31 16:03:43.904764 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 31 16:03:43.904764 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 31 16:03:43.904764 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 31 16:03:43.904764 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 31 16:03:43.904764 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 31 16:03:43.904764 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 31 16:03:43.904764 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 31 16:03:43.904764 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 31 16:03:43.904764 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 31 16:03:43.904764 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 31 16:03:43.904764 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 31 16:03:43.904764 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 31 16:03:43.904764 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Aug 31 16:03:43.904764 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:03:43.904764 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:03:43.904764 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:03:43.904764 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:03:43.906290 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 31 16:03:43.906290 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 31 16:03:43.906290 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 31 16:03:43.906290 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 31 16:03:43.906290 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 31 16:03:43.906290 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 31 16:03:43.906290 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Aug 31 16:03:43.906290 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:03:43.906290 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:03:43.906290 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:03:43.906290 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:03:43.906290 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:03:43.906290 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:03:43.906290 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:03:43.906290 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:03:43.906290 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:03:43.906290 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:03:43.906290 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:03:43.906290 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:03:43.906290 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 31 16:03:43.907909 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 31 16:03:43.907909 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 31 16:03:43.907909 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:03:43.907909 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:03:43.907909 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:03:43.907909 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:03:43.907909 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:03:43.907909 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:03:43.907909 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:03:43.907909 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:03:43.907909 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 31 16:03:43.907909 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:03:43.907909 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a159685d-c7ce-4e5b-bc67-c8688abe7727 tempest-ImagesDeleteNegativeTestJSON-530808558 tempest-ImagesDeleteNegativeTestJSON-530808558-project] Returning 404 to user: Image not found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:03:43.907909 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a159685d-c7ce-4e5b-bc67-c8688abe7727 tempest-ImagesDeleteNegativeTestJSON-530808558 tempest-ImagesDeleteNegativeTestJSON-530808558-project] 10.222.0.61 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.044109 Aug 31 16:03:43.907909 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1039/2035] 10.222.0.61 () {58 vars in 1134 bytes} [Wed Aug 31 16:03:43 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 31 16:03:43.913548 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-bb5bd7d7-52b7-493e-a67e-509470cd55c6 tempest-ImagesDeleteNegativeTestJSON-530808558 tempest-ImagesDeleteNegativeTestJSON-530808558-project] Calling method '.version_select at 0x7f5ae947fee0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:43.935821 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ad7742ea-d952-4503-bfaa-67404c6cdacc tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f" status: 200 len: 1533 microversion: 2.1 time: 0.293341 Aug 31 16:03:43.936414 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 997/2036] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:43 2022] GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f => generated 1533 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:43.936532 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-bb5bd7d7-52b7-493e-a67e-509470cd55c6 tempest-ImagesDeleteNegativeTestJSON-530808558 tempest-ImagesDeleteNegativeTestJSON-530808558-project] HTTP exception thrown: Image not found. Aug 31 16:03:43.938288 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-bb5bd7d7-52b7-493e-a67e-509470cd55c6 tempest-ImagesDeleteNegativeTestJSON-530808558 tempest-ImagesDeleteNegativeTestJSON-530808558-project] Request method failure captured: Aug 31 16:03:43.938288 n-d-850499-9 devstack@n-api.service[122256]: request: DELETE /compute/v2.1/images/16144056-7ce2-49f7-8c01-d6507fd43c0j HTTP/1.1 Aug 31 16:03:43.938288 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:03:43.938288 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:03:43.938288 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:03:43.938288 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:03:43.938288 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:03:43.938288 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:03:43.938288 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:03:43.938288 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:03:43.938288 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4ZfL__Z4rQXQNH9k_HWvczo_eQ3KaDVDtVuweXaXqLlJh4yQdcDeDTMjKfubiMQ4nJ9D0sP80RWf_0VWZoq2Kvf91KGapQtHZiy8mS4P5mh4_Rt1LMJDyerPChMiMzV5Q-ofzJw0lYoj-0RA7RDAy_bQpoHJFPsijtzqNS2oHpFY4A Aug 31 16:03:43.938288 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:03:43.938288 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:03:43.938288 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:03:43.938288 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:03:43.938288 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:03:43.938288 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:03:43.938288 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 7def6c58321f4f0ca3b1e7c4b7e87828 Aug 31 16:03:43.938288 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-530808558 Aug 31 16:03:43.938288 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:03:43.938288 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:03:43.940067 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7def6c58321f4f0ca3b1e7c4b7e87828"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7def6c58321f4f0ca3b1e7c4b7e87828"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7def6c58321f4f0ca3b1e7c4b7e87828", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7def6c58321f4f0ca3b1e7c4b7e87828"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:03:43.940067 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-530808558 Aug 31 16:03:43.940067 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 7def6c58321f4f0ca3b1e7c4b7e87828 Aug 31 16:03:43.940067 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-530808558 Aug 31 16:03:43.940067 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ImagesDeleteNegativeTestJSON-530808558-project Aug 31 16:03:43.940067 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:03:43.940067 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:03:43.940067 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 1376677103774541b60986b1b7158a61 Aug 31 16:03:43.940067 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-530808558-project Aug 31 16:03:43.940067 n-d-850499-9 devstack@n-api.service[122256]: method: Aug 31 16:03:43.940067 n-d-850499-9 devstack@n-api.service[122256]: exception: Image not found. Aug 31 16:03:43.940067 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '16144056-7ce2-49f7-8c01-d6507fd43c0j'} Aug 31 16:03:43.940067 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:03:43.941155 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:03:43.941155 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 31 16:03:43.941155 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 31 16:03:43.941155 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 31 16:03:43.941155 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 31 16:03:43.941155 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 31 16:03:43.941155 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 31 16:03:43.941155 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 31 16:03:43.941155 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 31 16:03:43.941155 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 31 16:03:43.941155 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 31 16:03:43.941155 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 31 16:03:43.941155 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 31 16:03:43.941155 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 31 16:03:43.941155 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 31 16:03:43.941155 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 16144056-7ce2-49f7-8c01-d6507fd43c0j to delete Aug 31 16:03:43.941155 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:03:43.941155 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:03:43.941155 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:03:43.942681 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:03:43.942681 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 31 16:03:43.942681 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 31 16:03:43.942681 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 31 16:03:43.942681 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 31 16:03:43.942681 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 31 16:03:43.942681 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 31 16:03:43.942681 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 16144056-7ce2-49f7-8c01-d6507fd43c0j could not be found. Aug 31 16:03:43.942681 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:03:43.942681 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:03:43.942681 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:03:43.942681 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:03:43.942681 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:03:43.942681 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:03:43.942681 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:03:43.942681 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:03:43.942681 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:03:43.942681 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:03:43.942681 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:03:43.942681 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:03:43.944338 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 31 16:03:43.944338 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 31 16:03:43.944338 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 31 16:03:43.944338 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:03:43.944338 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:03:43.944338 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:03:43.944338 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:03:43.944338 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:03:43.944338 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:03:43.944338 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:03:43.944338 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:03:43.944338 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 31 16:03:43.944338 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:03:43.944338 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-bb5bd7d7-52b7-493e-a67e-509470cd55c6 tempest-ImagesDeleteNegativeTestJSON-530808558 tempest-ImagesDeleteNegativeTestJSON-530808558-project] Returning 404 to user: Image not found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:03:43.944338 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-bb5bd7d7-52b7-493e-a67e-509470cd55c6 tempest-ImagesDeleteNegativeTestJSON-530808558 tempest-ImagesDeleteNegativeTestJSON-530808558-project] 10.222.0.61 "DELETE /compute/v2.1/images/16144056-7ce2-49f7-8c01-d6507fd43c0j" status: 404 len: 62 microversion: 2.1 time: 0.030086 Aug 31 16:03:43.945531 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1040/2037] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:43 2022] DELETE /compute/v2.1/images/16144056-7ce2-49f7-8c01-d6507fd43c0j => generated 62 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 31 16:03:43.958197 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-86664fb6-4c1a-431a-bb31-0e1d53016339 tempest-ImagesDeleteNegativeTestJSON-530808558 tempest-ImagesDeleteNegativeTestJSON-530808558-project] Calling method '.version_select at 0x7f5aed2ad4c0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:43.962125 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-eaf83c91-14a7-4a64-9134-498a86628ae3 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:43.963272 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-eaf83c91-14a7-4a64-9134-498a86628ae3 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] [instance: dd702273-095b-4d44-8d1b-3d90f7833d5f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:43.971035 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eaf83c91-14a7-4a64-9134-498a86628ae3 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:43.971556 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eaf83c91-14a7-4a64-9134-498a86628ae3 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:43.971990 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eaf83c91-14a7-4a64-9134-498a86628ae3 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:43.972696 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eaf83c91-14a7-4a64-9134-498a86628ae3 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:43.973164 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eaf83c91-14a7-4a64-9134-498a86628ae3 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:43.973568 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eaf83c91-14a7-4a64-9134-498a86628ae3 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:43.975125 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-86664fb6-4c1a-431a-bb31-0e1d53016339 tempest-ImagesDeleteNegativeTestJSON-530808558 tempest-ImagesDeleteNegativeTestJSON-530808558-project] HTTP exception thrown: Image not found. Aug 31 16:03:43.977096 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-86664fb6-4c1a-431a-bb31-0e1d53016339 tempest-ImagesDeleteNegativeTestJSON-530808558 tempest-ImagesDeleteNegativeTestJSON-530808558-project] Request method failure captured: Aug 31 16:03:43.977096 n-d-850499-9 devstack@n-api.service[122257]: request: DELETE /compute/v2.1/images/c4ab4ced-736f-4b2b-94bb-a7e72ded5ded1 HTTP/1.1 Aug 31 16:03:43.977096 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:03:43.977096 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:03:43.977096 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:03:43.977096 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:03:43.977096 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:03:43.977096 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:03:43.977096 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:03:43.977096 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:03:43.977096 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4ZfL__Z4rQXQNH9k_HWvczo_eQ3KaDVDtVuweXaXqLlJh4yQdcDeDTMjKfubiMQ4nJ9D0sP80RWf_0VWZoq2Kvf91KGapQtHZiy8mS4P5mh4_Rt1LMJDyerPChMiMzV5Q-ofzJw0lYoj-0RA7RDAy_bQpoHJFPsijtzqNS2oHpFY4A Aug 31 16:03:43.977096 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:03:43.977096 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:03:43.977096 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:03:43.977096 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:03:43.977096 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:03:43.977096 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:03:43.977096 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 7def6c58321f4f0ca3b1e7c4b7e87828 Aug 31 16:03:43.977096 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-530808558 Aug 31 16:03:43.977096 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:03:43.977096 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:03:43.978683 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7def6c58321f4f0ca3b1e7c4b7e87828"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7def6c58321f4f0ca3b1e7c4b7e87828"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7def6c58321f4f0ca3b1e7c4b7e87828", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7def6c58321f4f0ca3b1e7c4b7e87828"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:03:43.978683 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-530808558 Aug 31 16:03:43.978683 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 7def6c58321f4f0ca3b1e7c4b7e87828 Aug 31 16:03:43.978683 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-530808558 Aug 31 16:03:43.978683 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ImagesDeleteNegativeTestJSON-530808558-project Aug 31 16:03:43.978683 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:03:43.978683 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:03:43.978683 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 1376677103774541b60986b1b7158a61 Aug 31 16:03:43.978683 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-530808558-project Aug 31 16:03:43.978683 n-d-850499-9 devstack@n-api.service[122257]: method: Aug 31 16:03:43.978683 n-d-850499-9 devstack@n-api.service[122257]: exception: Image not found. Aug 31 16:03:43.978683 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': 'c4ab4ced-736f-4b2b-94bb-a7e72ded5ded1'} Aug 31 16:03:43.978683 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:03:43.979761 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:03:43.979761 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 31 16:03:43.979761 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 31 16:03:43.979761 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 31 16:03:43.979761 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 31 16:03:43.979761 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 31 16:03:43.979761 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 31 16:03:43.979761 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 31 16:03:43.979761 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 31 16:03:43.979761 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 31 16:03:43.979761 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 31 16:03:43.979761 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 31 16:03:43.979761 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 31 16:03:43.979761 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 31 16:03:43.979761 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 31 16:03:43.979761 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image c4ab4ced-736f-4b2b-94bb-a7e72ded5ded1 to delete Aug 31 16:03:43.979761 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:03:43.979761 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:03:43.979761 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:03:43.982040 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:03:43.982040 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 31 16:03:43.982040 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 31 16:03:43.982040 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 31 16:03:43.982040 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 31 16:03:43.982040 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 31 16:03:43.982040 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 31 16:03:43.982040 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c4ab4ced-736f-4b2b-94bb-a7e72ded5ded1 could not be found. Aug 31 16:03:43.982040 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:03:43.982040 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:03:43.982040 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:03:43.982040 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:03:43.982040 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:03:43.982040 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:03:43.982040 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:03:43.982040 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:03:43.982040 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:03:43.982040 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:03:43.982040 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:03:43.982040 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:03:43.984788 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 31 16:03:43.984788 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 31 16:03:43.984788 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 31 16:03:43.984788 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:03:43.984788 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:03:43.984788 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:03:43.984788 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:03:43.984788 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:03:43.984788 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:03:43.984788 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:03:43.984788 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:03:43.984788 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 31 16:03:43.984788 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:03:43.984788 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-86664fb6-4c1a-431a-bb31-0e1d53016339 tempest-ImagesDeleteNegativeTestJSON-530808558 tempest-ImagesDeleteNegativeTestJSON-530808558-project] Returning 404 to user: Image not found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:03:43.984788 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-86664fb6-4c1a-431a-bb31-0e1d53016339 tempest-ImagesDeleteNegativeTestJSON-530808558 tempest-ImagesDeleteNegativeTestJSON-530808558-project] 10.222.0.61 "DELETE /compute/v2.1/images/c4ab4ced-736f-4b2b-94bb-a7e72ded5ded1" status: 404 len: 62 microversion: 2.1 time: 0.024808 Aug 31 16:03:43.986043 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 998/2038] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:03:43 2022] DELETE /compute/v2.1/images/c4ab4ced-736f-4b2b-94bb-a7e72ded5ded1 => generated 62 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 31 16:03:43.990296 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-be997e99-775d-493c-a42c-933abc17a14d tempest-ImagesDeleteNegativeTestJSON-530808558 tempest-ImagesDeleteNegativeTestJSON-530808558-project] Calling method '.version_select at 0x7f5aed2b7700>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:44.013853 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-be997e99-775d-493c-a42c-933abc17a14d tempest-ImagesDeleteNegativeTestJSON-530808558 tempest-ImagesDeleteNegativeTestJSON-530808558-project] HTTP exception thrown: Image not found. Aug 31 16:03:44.015790 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-be997e99-775d-493c-a42c-933abc17a14d tempest-ImagesDeleteNegativeTestJSON-530808558 tempest-ImagesDeleteNegativeTestJSON-530808558-project] Request method failure captured: Aug 31 16:03:44.015790 n-d-850499-9 devstack@n-api.service[122257]: request: DELETE /compute/v2.1/images/tempest-invalid-2073397016 HTTP/1.1 Aug 31 16:03:44.015790 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:03:44.015790 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:03:44.015790 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:03:44.015790 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:03:44.015790 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:03:44.015790 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:03:44.015790 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:03:44.015790 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:03:44.015790 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4ZfL__Z4rQXQNH9k_HWvczo_eQ3KaDVDtVuweXaXqLlJh4yQdcDeDTMjKfubiMQ4nJ9D0sP80RWf_0VWZoq2Kvf91KGapQtHZiy8mS4P5mh4_Rt1LMJDyerPChMiMzV5Q-ofzJw0lYoj-0RA7RDAy_bQpoHJFPsijtzqNS2oHpFY4A Aug 31 16:03:44.015790 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:03:44.015790 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:03:44.015790 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:03:44.015790 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:03:44.015790 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:03:44.015790 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:03:44.015790 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 7def6c58321f4f0ca3b1e7c4b7e87828 Aug 31 16:03:44.015790 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-530808558 Aug 31 16:03:44.015790 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:03:44.015790 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:03:44.018913 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7def6c58321f4f0ca3b1e7c4b7e87828"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7def6c58321f4f0ca3b1e7c4b7e87828"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7def6c58321f4f0ca3b1e7c4b7e87828", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7def6c58321f4f0ca3b1e7c4b7e87828"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:03:44.018913 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-530808558 Aug 31 16:03:44.018913 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 7def6c58321f4f0ca3b1e7c4b7e87828 Aug 31 16:03:44.018913 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-530808558 Aug 31 16:03:44.018913 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ImagesDeleteNegativeTestJSON-530808558-project Aug 31 16:03:44.018913 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:03:44.018913 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:03:44.018913 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 1376677103774541b60986b1b7158a61 Aug 31 16:03:44.018913 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-530808558-project Aug 31 16:03:44.018913 n-d-850499-9 devstack@n-api.service[122257]: method: Aug 31 16:03:44.018913 n-d-850499-9 devstack@n-api.service[122257]: exception: Image not found. Aug 31 16:03:44.018913 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': 'tempest-invalid-2073397016'} Aug 31 16:03:44.018913 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:03:44.020276 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:03:44.020276 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 31 16:03:44.020276 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 31 16:03:44.020276 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 31 16:03:44.020276 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 31 16:03:44.020276 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 31 16:03:44.020276 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 31 16:03:44.020276 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 31 16:03:44.020276 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 31 16:03:44.020276 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 31 16:03:44.020276 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 31 16:03:44.020276 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 31 16:03:44.020276 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 31 16:03:44.020276 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 31 16:03:44.020276 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 31 16:03:44.020276 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-2073397016 to delete Aug 31 16:03:44.020276 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:03:44.020276 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:03:44.020276 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:03:44.021806 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:03:44.021806 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 31 16:03:44.021806 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 31 16:03:44.021806 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 31 16:03:44.021806 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 31 16:03:44.021806 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 31 16:03:44.021806 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 31 16:03:44.021806 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-2073397016 could not be found. Aug 31 16:03:44.021806 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:03:44.021806 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:03:44.021806 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:03:44.021806 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:03:44.021806 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:03:44.021806 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:03:44.021806 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:03:44.021806 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:03:44.021806 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:03:44.021806 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:03:44.021806 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:03:44.021806 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:03:44.023350 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 31 16:03:44.023350 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 31 16:03:44.023350 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 31 16:03:44.023350 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:03:44.023350 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:03:44.023350 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:03:44.023350 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:03:44.023350 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:03:44.023350 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:03:44.023350 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:03:44.023350 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:03:44.023350 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 31 16:03:44.023350 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:03:44.023350 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-be997e99-775d-493c-a42c-933abc17a14d tempest-ImagesDeleteNegativeTestJSON-530808558 tempest-ImagesDeleteNegativeTestJSON-530808558-project] Returning 404 to user: Image not found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:03:44.023350 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-be997e99-775d-493c-a42c-933abc17a14d tempest-ImagesDeleteNegativeTestJSON-530808558 tempest-ImagesDeleteNegativeTestJSON-530808558-project] 10.222.0.61 "DELETE /compute/v2.1/images/tempest-invalid-2073397016" status: 404 len: 62 microversion: 2.1 time: 0.030951 Aug 31 16:03:44.024630 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 999/2039] 10.222.0.61 () {58 vars in 1206 bytes} [Wed Aug 31 16:03:43 2022] DELETE /compute/v2.1/images/tempest-invalid-2073397016 => generated 62 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 31 16:03:44.029257 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7bd11407-307f-4cd4-8f32-f88f9271966f tempest-ImagesDeleteNegativeTestJSON-530808558 tempest-ImagesDeleteNegativeTestJSON-530808558-project] Calling method '.version_select at 0x7f5aed2ad4c0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:44.050228 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-7bd11407-307f-4cd4-8f32-f88f9271966f tempest-ImagesDeleteNegativeTestJSON-530808558 tempest-ImagesDeleteNegativeTestJSON-530808558-project] HTTP exception thrown: Image not found. Aug 31 16:03:44.052071 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7bd11407-307f-4cd4-8f32-f88f9271966f tempest-ImagesDeleteNegativeTestJSON-530808558 tempest-ImagesDeleteNegativeTestJSON-530808558-project] Request method failure captured: Aug 31 16:03:44.052071 n-d-850499-9 devstack@n-api.service[122257]: request: DELETE /compute/v2.1/images/8851db49-485b-45f4-a362-e7d41d7a3abd HTTP/1.1 Aug 31 16:03:44.052071 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:03:44.052071 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:03:44.052071 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:03:44.052071 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:03:44.052071 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:03:44.052071 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:03:44.052071 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:03:44.052071 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:03:44.052071 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4ZfL__Z4rQXQNH9k_HWvczo_eQ3KaDVDtVuweXaXqLlJh4yQdcDeDTMjKfubiMQ4nJ9D0sP80RWf_0VWZoq2Kvf91KGapQtHZiy8mS4P5mh4_Rt1LMJDyerPChMiMzV5Q-ofzJw0lYoj-0RA7RDAy_bQpoHJFPsijtzqNS2oHpFY4A Aug 31 16:03:44.052071 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:03:44.052071 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:03:44.052071 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:03:44.052071 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:03:44.052071 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:03:44.052071 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:03:44.052071 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 7def6c58321f4f0ca3b1e7c4b7e87828 Aug 31 16:03:44.052071 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-530808558 Aug 31 16:03:44.052071 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:03:44.052071 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:03:44.053824 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7def6c58321f4f0ca3b1e7c4b7e87828"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7def6c58321f4f0ca3b1e7c4b7e87828"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7def6c58321f4f0ca3b1e7c4b7e87828", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7def6c58321f4f0ca3b1e7c4b7e87828"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:03:44.053824 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-530808558 Aug 31 16:03:44.053824 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 7def6c58321f4f0ca3b1e7c4b7e87828 Aug 31 16:03:44.053824 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-530808558 Aug 31 16:03:44.053824 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ImagesDeleteNegativeTestJSON-530808558-project Aug 31 16:03:44.053824 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:03:44.053824 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:03:44.053824 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 1376677103774541b60986b1b7158a61 Aug 31 16:03:44.053824 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-530808558-project Aug 31 16:03:44.053824 n-d-850499-9 devstack@n-api.service[122257]: method: Aug 31 16:03:44.053824 n-d-850499-9 devstack@n-api.service[122257]: exception: Image not found. Aug 31 16:03:44.053824 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '8851db49-485b-45f4-a362-e7d41d7a3abd'} Aug 31 16:03:44.053824 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:03:44.055003 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:03:44.055003 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 31 16:03:44.055003 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 31 16:03:44.055003 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 31 16:03:44.055003 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 31 16:03:44.055003 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 31 16:03:44.055003 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 31 16:03:44.055003 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 31 16:03:44.055003 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 31 16:03:44.055003 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 31 16:03:44.055003 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 31 16:03:44.055003 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 31 16:03:44.055003 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 31 16:03:44.055003 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 31 16:03:44.055003 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 31 16:03:44.055003 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 8851db49-485b-45f4-a362-e7d41d7a3abd to delete Aug 31 16:03:44.055003 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:03:44.055003 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:03:44.055003 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:03:44.056618 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:03:44.056618 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 31 16:03:44.056618 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 31 16:03:44.056618 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 31 16:03:44.056618 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 31 16:03:44.056618 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 31 16:03:44.056618 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 31 16:03:44.056618 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8851db49-485b-45f4-a362-e7d41d7a3abd could not be found. Aug 31 16:03:44.056618 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:03:44.056618 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:03:44.056618 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:03:44.056618 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:03:44.056618 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:03:44.056618 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:03:44.056618 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:03:44.056618 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:03:44.056618 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:03:44.056618 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:03:44.056618 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:03:44.056618 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:03:44.058208 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 31 16:03:44.058208 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 31 16:03:44.058208 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 31 16:03:44.058208 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:03:44.058208 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:03:44.058208 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:03:44.058208 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:03:44.058208 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:03:44.058208 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:03:44.058208 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:03:44.058208 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:03:44.058208 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 31 16:03:44.058208 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:03:44.058208 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7bd11407-307f-4cd4-8f32-f88f9271966f tempest-ImagesDeleteNegativeTestJSON-530808558 tempest-ImagesDeleteNegativeTestJSON-530808558-project] Returning 404 to user: Image not found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:03:44.058208 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7bd11407-307f-4cd4-8f32-f88f9271966f tempest-ImagesDeleteNegativeTestJSON-530808558 tempest-ImagesDeleteNegativeTestJSON-530808558-project] 10.222.0.61 "DELETE /compute/v2.1/images/8851db49-485b-45f4-a362-e7d41d7a3abd" status: 404 len: 62 microversion: 2.1 time: 0.028157 Aug 31 16:03:44.060084 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1000/2040] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:44 2022] DELETE /compute/v2.1/images/8851db49-485b-45f4-a362-e7d41d7a3abd => generated 62 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 31 16:03:44.124418 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-eaf83c91-14a7-4a64-9134-498a86628ae3 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f" status: 200 len: 1533 microversion: 2.1 time: 0.169426 Aug 31 16:03:44.125000 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1041/2041] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:43 2022] GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f => generated 1533 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:44.142301 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-41a633cd-9701-4670-a2c7-d13531d236a8 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:44.144193 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-41a633cd-9701-4670-a2c7-d13531d236a8 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 006771fc-9da9-4b78-9fad-f4b72c311fd5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:44.149558 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-aebf6600-5fb6-4939-b8a8-8e66ad47609e tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:44.151754 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-41a633cd-9701-4670-a2c7-d13531d236a8 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:44.153214 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-41a633cd-9701-4670-a2c7-d13531d236a8 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:44.153650 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aebf6600-5fb6-4939-b8a8-8e66ad47609e tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:44.154150 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aebf6600-5fb6-4939-b8a8-8e66ad47609e tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:44.154599 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aebf6600-5fb6-4939-b8a8-8e66ad47609e tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:44.154971 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-41a633cd-9701-4670-a2c7-d13531d236a8 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:44.155342 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aebf6600-5fb6-4939-b8a8-8e66ad47609e tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:44.155831 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aebf6600-5fb6-4939-b8a8-8e66ad47609e tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:44.156271 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aebf6600-5fb6-4939-b8a8-8e66ad47609e tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:44.157346 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-41a633cd-9701-4670-a2c7-d13531d236a8 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:44.158528 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-41a633cd-9701-4670-a2c7-d13531d236a8 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:44.159834 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-41a633cd-9701-4670-a2c7-d13531d236a8 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:44.184649 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-aebf6600-5fb6-4939-b8a8-8e66ad47609e tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] 10.222.0.61 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.038827 Aug 31 16:03:44.185469 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1042/2042] 10.222.0.61 () {58 vars in 1176 bytes} [Wed Aug 31 16:03:44 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:03:44.197582 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b7ae7cc7-0844-48cf-af95-0baf5577e331 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-850499-9", "block_migration": false, "disk_over_commit": false}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:03:44.200383 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b7ae7cc7-0844-48cf-af95-0baf5577e331 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] [instance: dd702273-095b-4d44-8d1b-3d90f7833d5f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:44.206973 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b7ae7cc7-0844-48cf-af95-0baf5577e331 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:44.207846 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b7ae7cc7-0844-48cf-af95-0baf5577e331 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:44.208732 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b7ae7cc7-0844-48cf-af95-0baf5577e331 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:44.209453 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b7ae7cc7-0844-48cf-af95-0baf5577e331 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:44.209916 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b7ae7cc7-0844-48cf-af95-0baf5577e331 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:44.210348 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b7ae7cc7-0844-48cf-af95-0baf5577e331 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:44.240708 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-b7ae7cc7-0844-48cf-af95-0baf5577e331 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lazy-loading 'flavor' on Instance uuid dd702273-095b-4d44-8d1b-3d90f7833d5f {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:03:44.255281 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b7ae7cc7-0844-48cf-af95-0baf5577e331 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] [instance: dd702273-095b-4d44-8d1b-3d90f7833d5f] Going to try to live migrate instance to n-h1-850499-9 {{(pid=122256) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 31 16:03:44.333942 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-41a633cd-9701-4670-a2c7-d13531d236a8 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:44.344599 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-41a633cd-9701-4670-a2c7-d13531d236a8 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:44.346083 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-41a633cd-9701-4670-a2c7-d13531d236a8 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:44.347228 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-41a633cd-9701-4670-a2c7-d13531d236a8 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5" status: 200 len: 1280 microversion: 2.25 time: 0.209068 Aug 31 16:03:44.348036 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1001/2043] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:03:44 2022] GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5 => generated 1280 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:03:44.352758 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7f46033e-12dd-4cf7-a2d2-d24e05a6b27f tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:44.353368 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7f46033e-12dd-4cf7-a2d2-d24e05a6b27f tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: d8590729-e3da-4e04-9daa-7e04a3d88068] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:44.361446 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7f46033e-12dd-4cf7-a2d2-d24e05a6b27f tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:44.362514 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7f46033e-12dd-4cf7-a2d2-d24e05a6b27f tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:44.363120 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7f46033e-12dd-4cf7-a2d2-d24e05a6b27f tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:44.364107 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7f46033e-12dd-4cf7-a2d2-d24e05a6b27f tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:44.364740 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7f46033e-12dd-4cf7-a2d2-d24e05a6b27f tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:44.365343 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7f46033e-12dd-4cf7-a2d2-d24e05a6b27f tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:44.538416 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7f46033e-12dd-4cf7-a2d2-d24e05a6b27f tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:44.549174 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7f46033e-12dd-4cf7-a2d2-d24e05a6b27f tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/d8590729-e3da-4e04-9daa-7e04a3d88068" status: 200 len: 1314 microversion: 2.1 time: 0.199824 Aug 31 16:03:44.561315 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1002/2044] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:44 2022] GET /compute/v2.1/servers/d8590729-e3da-4e04-9daa-7e04a3d88068 => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:44.567819 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d0c427cf-f3dd-4141-be9b-09a241c75ca6 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:44.568450 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d0c427cf-f3dd-4141-be9b-09a241c75ca6 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: 007aba90-0e41-45d6-97f2-2d20b29d4296] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:44.576112 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d0c427cf-f3dd-4141-be9b-09a241c75ca6 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:44.576636 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d0c427cf-f3dd-4141-be9b-09a241c75ca6 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:44.577237 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d0c427cf-f3dd-4141-be9b-09a241c75ca6 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:44.578189 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d0c427cf-f3dd-4141-be9b-09a241c75ca6 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:44.578640 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d0c427cf-f3dd-4141-be9b-09a241c75ca6 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:44.579433 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d0c427cf-f3dd-4141-be9b-09a241c75ca6 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:44.585841 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:03:44.675035 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d0c427cf-f3dd-4141-be9b-09a241c75ca6 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ccd03a4aa84f93bc26b438e1468f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a9f3fcc4b445349e5c66ff712e8598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:44.683817 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d0c427cf-f3dd-4141-be9b-09a241c75ca6 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/servers/007aba90-0e41-45d6-97f2-2d20b29d4296" status: 200 len: 1212 microversion: 2.1 time: 0.121045 Aug 31 16:03:44.699798 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1003/2045] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:44 2022] GET /compute/v2.1/servers/007aba90-0e41-45d6-97f2-2d20b29d4296 => generated 1212 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:44.699798 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b1efe44e-909c-446e-bfa5-1dc94392bbd5 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:44.699798 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b1efe44e-909c-446e-bfa5-1dc94392bbd5 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6e82c98f-d644-4464-aca0-13901e551aa4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:44.708014 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b1efe44e-909c-446e-bfa5-1dc94392bbd5 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:44.709064 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b1efe44e-909c-446e-bfa5-1dc94392bbd5 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:44.709248 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b1efe44e-909c-446e-bfa5-1dc94392bbd5 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:44.709966 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b1efe44e-909c-446e-bfa5-1dc94392bbd5 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:44.710401 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b1efe44e-909c-446e-bfa5-1dc94392bbd5 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:44.710831 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b1efe44e-909c-446e-bfa5-1dc94392bbd5 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:45.005589 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b1efe44e-909c-446e-bfa5-1dc94392bbd5 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:45.016428 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b1efe44e-909c-446e-bfa5-1dc94392bbd5 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4" status: 200 len: 1475 microversion: 2.1 time: 0.330956 Aug 31 16:03:45.017490 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1004/2046] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:44 2022] GET /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4 => generated 1475 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:45.023289 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-eafa6114-d54b-43e6-82de-278961b52e84 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:45.024077 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-eafa6114-d54b-43e6-82de-278961b52e84 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] [instance: 7523e0a9-60e8-42ba-b271-d63251e373b7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:45.032021 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eafa6114-d54b-43e6-82de-278961b52e84 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:45.033476 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eafa6114-d54b-43e6-82de-278961b52e84 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:45.033996 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eafa6114-d54b-43e6-82de-278961b52e84 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:45.034778 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eafa6114-d54b-43e6-82de-278961b52e84 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:45.035245 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eafa6114-d54b-43e6-82de-278961b52e84 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:45.035714 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eafa6114-d54b-43e6-82de-278961b52e84 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:45.302036 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-eafa6114-d54b-43e6-82de-278961b52e84 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90770e7e060c4ded869851dea068189c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab675eb7ef3e45e68d74d737484c6e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:45.310355 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-eafa6114-d54b-43e6-82de-278961b52e84 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] 10.222.0.61 "GET /compute/v2.1/servers/7523e0a9-60e8-42ba-b271-d63251e373b7" status: 200 len: 1713 microversion: 2.1 time: 0.291836 Aug 31 16:03:45.311553 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1005/2047] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:45 2022] GET /compute/v2.1/servers/7523e0a9-60e8-42ba-b271-d63251e373b7 => generated 1713 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:45.317412 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-396dacac-cfd5-43c7-943a-69326c46edc4 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:45.318315 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-396dacac-cfd5-43c7-943a-69326c46edc4 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 9d6a4c52-02e5-491b-ac04-917b710c332c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:45.324937 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-396dacac-cfd5-43c7-943a-69326c46edc4 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:45.325682 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-396dacac-cfd5-43c7-943a-69326c46edc4 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:45.326314 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-396dacac-cfd5-43c7-943a-69326c46edc4 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:45.327435 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-396dacac-cfd5-43c7-943a-69326c46edc4 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:45.328136 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-396dacac-cfd5-43c7-943a-69326c46edc4 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:45.328735 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-396dacac-cfd5-43c7-943a-69326c46edc4 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:45.594259 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-396dacac-cfd5-43c7-943a-69326c46edc4 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:45.606030 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-396dacac-cfd5-43c7-943a-69326c46edc4 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/9d6a4c52-02e5-491b-ac04-917b710c332c" status: 200 len: 1317 microversion: 2.1 time: 0.292672 Aug 31 16:03:45.607269 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1006/2048] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:45 2022] GET /compute/v2.1/servers/9d6a4c52-02e5-491b-ac04-917b710c332c => generated 1317 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:45.632255 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-15d25d74-4f5c-4bed-8866-f094cd9cbd44 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:45.633249 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-15d25d74-4f5c-4bed-8866-f094cd9cbd44 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 006771fc-9da9-4b78-9fad-f4b72c311fd5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:45.640914 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-15d25d74-4f5c-4bed-8866-f094cd9cbd44 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:45.641905 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-15d25d74-4f5c-4bed-8866-f094cd9cbd44 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:45.642587 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-15d25d74-4f5c-4bed-8866-f094cd9cbd44 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:45.643559 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-15d25d74-4f5c-4bed-8866-f094cd9cbd44 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:45.644250 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-15d25d74-4f5c-4bed-8866-f094cd9cbd44 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:45.644909 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-15d25d74-4f5c-4bed-8866-f094cd9cbd44 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:45.893123 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-15d25d74-4f5c-4bed-8866-f094cd9cbd44 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:45.901409 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-15d25d74-4f5c-4bed-8866-f094cd9cbd44 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:45.903613 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-15d25d74-4f5c-4bed-8866-f094cd9cbd44 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:45.904644 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-15d25d74-4f5c-4bed-8866-f094cd9cbd44 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5" status: 200 len: 1280 microversion: 2.25 time: 0.291663 Aug 31 16:03:45.905352 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1007/2049] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:03:45 2022] GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5 => generated 1280 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:03:45.909806 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b4f2eb95-a4e1-4480-84cf-2f00dd64985c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:45.910518 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b4f2eb95-a4e1-4480-84cf-2f00dd64985c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: d8590729-e3da-4e04-9daa-7e04a3d88068] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:45.918325 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b4f2eb95-a4e1-4480-84cf-2f00dd64985c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:45.919706 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b4f2eb95-a4e1-4480-84cf-2f00dd64985c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:45.920989 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b4f2eb95-a4e1-4480-84cf-2f00dd64985c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:45.921729 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b4f2eb95-a4e1-4480-84cf-2f00dd64985c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:45.922202 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b4f2eb95-a4e1-4480-84cf-2f00dd64985c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:45.922643 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b4f2eb95-a4e1-4480-84cf-2f00dd64985c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:46.262449 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b4f2eb95-a4e1-4480-84cf-2f00dd64985c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:46.276871 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b4f2eb95-a4e1-4480-84cf-2f00dd64985c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/d8590729-e3da-4e04-9daa-7e04a3d88068" status: 200 len: 1314 microversion: 2.1 time: 0.370452 Aug 31 16:03:46.278206 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1008/2050] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:45 2022] GET /compute/v2.1/servers/d8590729-e3da-4e04-9daa-7e04a3d88068 => generated 1314 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:46.428435 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3d220d4a-1e01-4273-9633-346210ab5826 tempest-AbsoluteLimitsNegativeTestJSON-1582965400 tempest-AbsoluteLimitsNegativeTestJSON-1582965400-project] Calling method '.version_select at 0x7f5aed2a0af0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:46.441970 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3d220d4a-1e01-4273-9633-346210ab5826 tempest-AbsoluteLimitsNegativeTestJSON-1582965400 tempest-AbsoluteLimitsNegativeTestJSON-1582965400-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:46.442468 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3d220d4a-1e01-4273-9633-346210ab5826 tempest-AbsoluteLimitsNegativeTestJSON-1582965400 tempest-AbsoluteLimitsNegativeTestJSON-1582965400-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:46.442988 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3d220d4a-1e01-4273-9633-346210ab5826 tempest-AbsoluteLimitsNegativeTestJSON-1582965400 tempest-AbsoluteLimitsNegativeTestJSON-1582965400-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:46.443835 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3d220d4a-1e01-4273-9633-346210ab5826 tempest-AbsoluteLimitsNegativeTestJSON-1582965400 tempest-AbsoluteLimitsNegativeTestJSON-1582965400-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:46.444450 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3d220d4a-1e01-4273-9633-346210ab5826 tempest-AbsoluteLimitsNegativeTestJSON-1582965400 tempest-AbsoluteLimitsNegativeTestJSON-1582965400-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:46.444896 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3d220d4a-1e01-4273-9633-346210ab5826 tempest-AbsoluteLimitsNegativeTestJSON-1582965400 tempest-AbsoluteLimitsNegativeTestJSON-1582965400-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:46.471529 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3d220d4a-1e01-4273-9633-346210ab5826 tempest-AbsoluteLimitsNegativeTestJSON-1582965400 tempest-AbsoluteLimitsNegativeTestJSON-1582965400-project] 10.222.0.61 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.192034 Aug 31 16:03:46.472143 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1009/2051] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 31 16:03:46 2022] GET /compute/v2.1/limits => generated 511 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:03:46.477099 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0eac591b-2f8e-4fc3-ba46-91ba10153610 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:46.477722 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0eac591b-2f8e-4fc3-ba46-91ba10153610 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: 007aba90-0e41-45d6-97f2-2d20b29d4296] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:46.484710 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0eac591b-2f8e-4fc3-ba46-91ba10153610 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:46.485461 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0eac591b-2f8e-4fc3-ba46-91ba10153610 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:46.486078 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0eac591b-2f8e-4fc3-ba46-91ba10153610 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:46.486974 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0eac591b-2f8e-4fc3-ba46-91ba10153610 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:46.487654 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0eac591b-2f8e-4fc3-ba46-91ba10153610 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:46.489001 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0eac591b-2f8e-4fc3-ba46-91ba10153610 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:46.570720 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0eac591b-2f8e-4fc3-ba46-91ba10153610 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ccd03a4aa84f93bc26b438e1468f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a9f3fcc4b445349e5c66ff712e8598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:46.584112 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0eac591b-2f8e-4fc3-ba46-91ba10153610 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/servers/007aba90-0e41-45d6-97f2-2d20b29d4296" status: 200 len: 1266 microversion: 2.1 time: 0.108396 Aug 31 16:03:46.585041 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1010/2052] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:46 2022] GET /compute/v2.1/servers/007aba90-0e41-45d6-97f2-2d20b29d4296 => generated 1266 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:46.589682 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-30c92487-24b8-4aaf-aaed-48b038ff406f tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:46.590515 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-30c92487-24b8-4aaf-aaed-48b038ff406f tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6e82c98f-d644-4464-aca0-13901e551aa4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:46.603343 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-30c92487-24b8-4aaf-aaed-48b038ff406f tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:46.604104 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-30c92487-24b8-4aaf-aaed-48b038ff406f tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:46.604623 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-30c92487-24b8-4aaf-aaed-48b038ff406f tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:46.606429 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-30c92487-24b8-4aaf-aaed-48b038ff406f tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:46.606978 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-30c92487-24b8-4aaf-aaed-48b038ff406f tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:46.607730 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-30c92487-24b8-4aaf-aaed-48b038ff406f tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:46.882406 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-30c92487-24b8-4aaf-aaed-48b038ff406f tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:46.899296 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-30c92487-24b8-4aaf-aaed-48b038ff406f tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4" status: 200 len: 1475 microversion: 2.1 time: 0.313305 Aug 31 16:03:46.900068 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1011/2053] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:46 2022] GET /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4 => generated 1475 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:46.912237 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-7d256f70-79d3-4cbc-85d5-ed0d8afcb147 req-df7bfa2e-beaf-4084-98dd-fafc8f0d5364 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7523e0a9-60e8-42ba-b271-d63251e373b7", "name": "network-vif-deleted", "tag": "75f9e894-839c-40d9-9d82-24b08eceeda4"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:03:46.931975 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-7d256f70-79d3-4cbc-85d5-ed0d8afcb147 req-df7bfa2e-beaf-4084-98dd-fafc8f0d5364 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:46.938718 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-7d256f70-79d3-4cbc-85d5-ed0d8afcb147 req-df7bfa2e-beaf-4084-98dd-fafc8f0d5364 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:46.939377 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-7d256f70-79d3-4cbc-85d5-ed0d8afcb147 req-df7bfa2e-beaf-4084-98dd-fafc8f0d5364 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:46.955940 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-7d256f70-79d3-4cbc-85d5-ed0d8afcb147 req-df7bfa2e-beaf-4084-98dd-fafc8f0d5364 service nova] Creating event network-vif-deleted:75f9e894-839c-40d9-9d82-24b08eceeda4 for instance 7523e0a9-60e8-42ba-b271-d63251e373b7 on n-h2-850499-9 Aug 31 16:03:46.965460 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-7d256f70-79d3-4cbc-85d5-ed0d8afcb147 req-df7bfa2e-beaf-4084-98dd-fafc8f0d5364 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063856 Aug 31 16:03:46.967060 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1012/2054] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:03:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:03:46.973806 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-cbe18c41-5f58-4bd2-be79-8d59896534f0 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:46.974779 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-cbe18c41-5f58-4bd2-be79-8d59896534f0 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] [instance: 7523e0a9-60e8-42ba-b271-d63251e373b7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:46.985594 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cbe18c41-5f58-4bd2-be79-8d59896534f0 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:46.986515 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cbe18c41-5f58-4bd2-be79-8d59896534f0 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:46.988233 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cbe18c41-5f58-4bd2-be79-8d59896534f0 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:46.990135 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cbe18c41-5f58-4bd2-be79-8d59896534f0 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:46.990812 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cbe18c41-5f58-4bd2-be79-8d59896534f0 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:46.992422 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cbe18c41-5f58-4bd2-be79-8d59896534f0 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:47.059026 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cbe18c41-5f58-4bd2-be79-8d59896534f0 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:47.060185 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cbe18c41-5f58-4bd2-be79-8d59896534f0 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:47.060848 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cbe18c41-5f58-4bd2-be79-8d59896534f0 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:47.061641 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-cbe18c41-5f58-4bd2-be79-8d59896534f0 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lazy-loading 'fault' on Instance uuid 7523e0a9-60e8-42ba-b271-d63251e373b7 {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:03:47.151415 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-cbe18c41-5f58-4bd2-be79-8d59896534f0 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90770e7e060c4ded869851dea068189c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab675eb7ef3e45e68d74d737484c6e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:47.160610 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-cbe18c41-5f58-4bd2-be79-8d59896534f0 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] 10.222.0.61 "GET /compute/v2.1/servers/7523e0a9-60e8-42ba-b271-d63251e373b7" status: 200 len: 1366 microversion: 2.1 time: 0.191831 Aug 31 16:03:47.161767 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1013/2055] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:46 2022] GET /compute/v2.1/servers/7523e0a9-60e8-42ba-b271-d63251e373b7 => generated 1366 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:47.168906 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-bc1f8f9b-47c4-4043-8b3f-009d1507421e tempest-AbsoluteLimitsNegativeTestJSON-1582965400 tempest-AbsoluteLimitsNegativeTestJSON-1582965400-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-977185863", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:03:47.251284 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-bc1f8f9b-47c4-4043-8b3f-009d1507421e tempest-AbsoluteLimitsNegativeTestJSON-1582965400 tempest-AbsoluteLimitsNegativeTestJSON-1582965400-project] validate_networks() for None {{(pid=122257) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:03:47.947564 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-bc1f8f9b-47c4-4043-8b3f-009d1507421e tempest-AbsoluteLimitsNegativeTestJSON-1582965400 tempest-AbsoluteLimitsNegativeTestJSON-1582965400-project] Getting quotas for project 0d22dbc3712a45d1b661fb30de585469. Resources: dict_keys(['metadata_items']) {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:03:47.955286 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-bc1f8f9b-47c4-4043-8b3f-009d1507421e tempest-AbsoluteLimitsNegativeTestJSON-1582965400 tempest-AbsoluteLimitsNegativeTestJSON-1582965400-project] Getting quotas for user 78395eb13ef6462daad40f7e044de602 and project 0d22dbc3712a45d1b661fb30de585469. Resources: dict_keys(['metadata_items']) {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:03:47.977035 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-bc1f8f9b-47c4-4043-8b3f-009d1507421e tempest-AbsoluteLimitsNegativeTestJSON-1582965400 tempest-AbsoluteLimitsNegativeTestJSON-1582965400-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Aug 31 16:03:47.979703 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-bc1f8f9b-47c4-4043-8b3f-009d1507421e tempest-AbsoluteLimitsNegativeTestJSON-1582965400 tempest-AbsoluteLimitsNegativeTestJSON-1582965400-project] Request method failure captured: Aug 31 16:03:47.979703 n-d-850499-9 devstack@n-api.service[122257]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 31 16:03:47.979703 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:03:47.979703 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:03:47.979703 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:03:47.979703 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 1751 Aug 31 16:03:47.979703 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:03:47.979703 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:03:47.979703 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:03:47.979703 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:03:47.979703 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4ZhSg6kiIsy9fEcjBcvPh3YaK0jNEKXPXfsg2utx8DS5yDMBm0xhEW0Ooj8blDucN2GgGxlhcVX3_3xuMfZw_aR3-DAvQZS_3crCYJwDS5fUL1lQ0bobGlkZ1F0r6vEfRbdD0C2_noXdf6_K9OctSn3sQSmIJuzTiZW5kV3V4HH-Bw Aug 31 16:03:47.979703 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:03:47.979703 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:03:47.979703 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:03:47.979703 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:03:47.979703 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:03:47.979703 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:03:47.979703 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 0d22dbc3712a45d1b661fb30de585469 Aug 31 16:03:47.979703 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-1582965400 Aug 31 16:03:47.979703 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:03:47.979703 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:03:47.979703 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0d22dbc3712a45d1b661fb30de585469"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/0d22dbc3712a45d1b661fb30de585469"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_0d22dbc3712a45d1b661fb30de585469", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0d22dbc3712a45d1b661fb30de585469"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:03:47.979703 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-1582965400 Aug 31 16:03:47.979703 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 0d22dbc3712a45d1b661fb30de585469 Aug 31 16:03:47.979703 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-1582965400 Aug 31 16:03:47.979703 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-1582965400-project Aug 31 16:03:47.979703 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:03:47.979703 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:03:47.979703 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 78395eb13ef6462daad40f7e044de602 Aug 31 16:03:47.979703 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-1582965400-project Aug 31 16:03:47.979703 n-d-850499-9 devstack@n-api.service[122257]: Aug 31 16:03:47.979703 n-d-850499-9 devstack@n-api.service[122257]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-977185863", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Aug 31 16:03:47.979703 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:03:47.979703 n-d-850499-9 devstack@n-api.service[122257]: exception: Maximum number of metadata items exceeds 128 Aug 31 16:03:47.982876 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-977185863', 'imageRef': 'b9c36d42-ed46-4bf5-ad18-1df45cbd0413', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Aug 31 16:03:47.982876 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:03:47.982876 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:03:47.982876 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Aug 31 16:03:47.982876 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Aug 31 16:03:47.982876 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 16:03:47.982876 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 16:03:47.982876 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Aug 31 16:03:47.982876 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Aug 31 16:03:47.982876 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Aug 31 16:03:47.982876 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Aug 31 16:03:47.982876 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Aug 31 16:03:47.982876 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Aug 31 16:03:47.982876 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Aug 31 16:03:47.982876 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:03:47.982876 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:03:47.982876 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:03:47.982876 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:03:47.982876 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 31 16:03:47.982876 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 31 16:03:47.982876 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 31 16:03:47.982876 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 31 16:03:47.982876 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Aug 31 16:03:47.982876 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Aug 31 16:03:47.982876 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Aug 31 16:03:47.982876 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Aug 31 16:03:47.982876 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Aug 31 16:03:47.982876 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Aug 31 16:03:47.982876 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Aug 31 16:03:47.982876 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:03:47.982876 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:03:47.982876 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:03:47.982876 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:03:47.982876 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:03:47.982876 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:03:47.982876 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:03:47.982876 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:03:47.982876 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:03:47.982876 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:03:47.982876 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:03:47.982876 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:03:47.982876 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:03:47.982876 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:03:47.982876 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:03:47.988068 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:03:47.988068 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 31 16:03:47.988068 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 31 16:03:47.988068 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 31 16:03:47.988068 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Aug 31 16:03:47.988068 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:03:47.988068 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:03:47.988068 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:03:47.988068 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:03:47.988068 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:03:47.988068 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:03:47.988068 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:03:47.988068 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:03:47.988068 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Aug 31 16:03:47.988068 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:03:47.988068 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-bc1f8f9b-47c4-4043-8b3f-009d1507421e tempest-AbsoluteLimitsNegativeTestJSON-1582965400 tempest-AbsoluteLimitsNegativeTestJSON-1582965400-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:03:47.988068 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-bc1f8f9b-47c4-4043-8b3f-009d1507421e tempest-AbsoluteLimitsNegativeTestJSON-1582965400 tempest-AbsoluteLimitsNegativeTestJSON-1582965400-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.819705 Aug 31 16:03:47.988068 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1014/2056] 10.222.0.61 () {60 vars in 1148 bytes} [Wed Aug 31 16:03:47 2022] POST /compute/v2.1/servers => generated 87 bytes in 822 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Aug 31 16:03:47.993969 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b93e3a6b-5c23-49c8-939d-1c55ef6efd8a tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:47.994719 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b93e3a6b-5c23-49c8-939d-1c55ef6efd8a tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 9d6a4c52-02e5-491b-ac04-917b710c332c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:48.003187 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b93e3a6b-5c23-49c8-939d-1c55ef6efd8a tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:48.003633 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b93e3a6b-5c23-49c8-939d-1c55ef6efd8a tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:48.004077 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b93e3a6b-5c23-49c8-939d-1c55ef6efd8a tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:48.004803 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b93e3a6b-5c23-49c8-939d-1c55ef6efd8a tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:48.005261 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b93e3a6b-5c23-49c8-939d-1c55ef6efd8a tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:48.005912 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b93e3a6b-5c23-49c8-939d-1c55ef6efd8a tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:48.655783 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b93e3a6b-5c23-49c8-939d-1c55ef6efd8a tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:48.667146 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b93e3a6b-5c23-49c8-939d-1c55ef6efd8a tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/9d6a4c52-02e5-491b-ac04-917b710c332c" status: 200 len: 1317 microversion: 2.1 time: 0.680607 Aug 31 16:03:48.669747 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1015/2057] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:47 2022] GET /compute/v2.1/servers/9d6a4c52-02e5-491b-ac04-917b710c332c => generated 1317 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:48.681789 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-c01a020d-fa4d-4bdf-9e05-d29c2058cba3 req-a73bf9b4-12d5-4ae8-884e-10524e1e8d38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e82c98f-d644-4464-aca0-13901e551aa4", "name": "network-vif-unplugged", "status": "completed", "tag": "0dddc681-0580-40ec-b2fe-b4af40412267"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:03:48.706724 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-c01a020d-fa4d-4bdf-9e05-d29c2058cba3 req-a73bf9b4-12d5-4ae8-884e-10524e1e8d38 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:48.708372 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-c01a020d-fa4d-4bdf-9e05-d29c2058cba3 req-a73bf9b4-12d5-4ae8-884e-10524e1e8d38 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:48.709198 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-c01a020d-fa4d-4bdf-9e05-d29c2058cba3 req-a73bf9b4-12d5-4ae8-884e-10524e1e8d38 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:48.731727 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-c01a020d-fa4d-4bdf-9e05-d29c2058cba3 req-a73bf9b4-12d5-4ae8-884e-10524e1e8d38 service nova] Creating event network-vif-unplugged:0dddc681-0580-40ec-b2fe-b4af40412267 for instance 6e82c98f-d644-4464-aca0-13901e551aa4 on n-h1-850499-9 Aug 31 16:03:48.741463 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [req-c01a020d-fa4d-4bdf-9e05-d29c2058cba3 req-a73bf9b4-12d5-4ae8-884e-10524e1e8d38 service nova] Instance 6e82c98f-d644-4464-aca0-13901e551aa4 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850499-9'} {{(pid=122257) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 31 16:03:48.749139 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-c01a020d-fa4d-4bdf-9e05-d29c2058cba3 req-a73bf9b4-12d5-4ae8-884e-10524e1e8d38 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070959 Aug 31 16:03:48.750121 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1016/2058] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:03:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:03:48.755908 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2691b692-7bf3-4ba7-9aa0-7cffa736117a tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:48.756624 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2691b692-7bf3-4ba7-9aa0-7cffa736117a tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 006771fc-9da9-4b78-9fad-f4b72c311fd5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:48.764111 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2691b692-7bf3-4ba7-9aa0-7cffa736117a tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:48.764623 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2691b692-7bf3-4ba7-9aa0-7cffa736117a tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:48.765230 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2691b692-7bf3-4ba7-9aa0-7cffa736117a tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:48.769579 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2691b692-7bf3-4ba7-9aa0-7cffa736117a tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:48.770500 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2691b692-7bf3-4ba7-9aa0-7cffa736117a tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:48.771369 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2691b692-7bf3-4ba7-9aa0-7cffa736117a tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:49.045969 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2691b692-7bf3-4ba7-9aa0-7cffa736117a tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:49.062760 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2691b692-7bf3-4ba7-9aa0-7cffa736117a tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:49.065267 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2691b692-7bf3-4ba7-9aa0-7cffa736117a tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:49.066459 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2691b692-7bf3-4ba7-9aa0-7cffa736117a tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5" status: 200 len: 1280 microversion: 2.25 time: 0.315135 Aug 31 16:03:49.072904 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1017/2059] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:03:48 2022] GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5 => generated 1280 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:03:49.104729 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-01c96c5c-0bd8-40a1-9e68-ee60b5de0b91 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:49.105675 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-01c96c5c-0bd8-40a1-9e68-ee60b5de0b91 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: d8590729-e3da-4e04-9daa-7e04a3d88068] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:49.114089 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-01c96c5c-0bd8-40a1-9e68-ee60b5de0b91 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:49.114833 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-01c96c5c-0bd8-40a1-9e68-ee60b5de0b91 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:49.115645 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-01c96c5c-0bd8-40a1-9e68-ee60b5de0b91 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:49.116743 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-01c96c5c-0bd8-40a1-9e68-ee60b5de0b91 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:49.117208 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-01c96c5c-0bd8-40a1-9e68-ee60b5de0b91 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:49.117640 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-01c96c5c-0bd8-40a1-9e68-ee60b5de0b91 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:49.360231 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-01c96c5c-0bd8-40a1-9e68-ee60b5de0b91 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:49.368732 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-01c96c5c-0bd8-40a1-9e68-ee60b5de0b91 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/d8590729-e3da-4e04-9daa-7e04a3d88068" status: 200 len: 1314 microversion: 2.1 time: 0.294639 Aug 31 16:03:49.369613 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1018/2060] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:49 2022] GET /compute/v2.1/servers/d8590729-e3da-4e04-9daa-7e04a3d88068 => generated 1314 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:49.375482 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9440edcc-0b30-4526-aa25-b8795733643f tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:49.376129 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9440edcc-0b30-4526-aa25-b8795733643f tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: 007aba90-0e41-45d6-97f2-2d20b29d4296] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:49.382686 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9440edcc-0b30-4526-aa25-b8795733643f tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:49.383454 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9440edcc-0b30-4526-aa25-b8795733643f tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:49.383937 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9440edcc-0b30-4526-aa25-b8795733643f tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:49.384746 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9440edcc-0b30-4526-aa25-b8795733643f tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:49.385125 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9440edcc-0b30-4526-aa25-b8795733643f tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:49.385563 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9440edcc-0b30-4526-aa25-b8795733643f tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:49.596816 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9440edcc-0b30-4526-aa25-b8795733643f tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ccd03a4aa84f93bc26b438e1468f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a9f3fcc4b445349e5c66ff712e8598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:49.620752 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9440edcc-0b30-4526-aa25-b8795733643f tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/servers/007aba90-0e41-45d6-97f2-2d20b29d4296" status: 200 len: 1308 microversion: 2.1 time: 0.248961 Aug 31 16:03:49.621663 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1019/2061] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:49 2022] GET /compute/v2.1/servers/007aba90-0e41-45d6-97f2-2d20b29d4296 => generated 1308 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:49.627482 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-adaa44b9-592c-4b34-9c1d-b9806ddcfd5c tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:49.628526 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-adaa44b9-592c-4b34-9c1d-b9806ddcfd5c tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6e82c98f-d644-4464-aca0-13901e551aa4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:49.635549 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-adaa44b9-592c-4b34-9c1d-b9806ddcfd5c tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:49.636374 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-adaa44b9-592c-4b34-9c1d-b9806ddcfd5c tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:49.637012 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-adaa44b9-592c-4b34-9c1d-b9806ddcfd5c tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:49.637727 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-adaa44b9-592c-4b34-9c1d-b9806ddcfd5c tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:49.638366 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-adaa44b9-592c-4b34-9c1d-b9806ddcfd5c tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:49.638972 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-adaa44b9-592c-4b34-9c1d-b9806ddcfd5c tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:49.908256 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-adaa44b9-592c-4b34-9c1d-b9806ddcfd5c tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:49.916673 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-adaa44b9-592c-4b34-9c1d-b9806ddcfd5c tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4" status: 200 len: 1474 microversion: 2.1 time: 0.293641 Aug 31 16:03:49.931227 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1020/2062] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:49 2022] GET /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4 => generated 1474 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:49.937106 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f9094011-db64-413b-b730-274a210bb245 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:49.937736 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f9094011-db64-413b-b730-274a210bb245 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] [instance: 7523e0a9-60e8-42ba-b271-d63251e373b7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:49.939762 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:03:49.945306 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f9094011-db64-413b-b730-274a210bb245 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:49.945810 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f9094011-db64-413b-b730-274a210bb245 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:49.946267 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f9094011-db64-413b-b730-274a210bb245 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:49.946994 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f9094011-db64-413b-b730-274a210bb245 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:49.947454 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f9094011-db64-413b-b730-274a210bb245 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:49.947980 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f9094011-db64-413b-b730-274a210bb245 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:49.967297 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-f9094011-db64-413b-b730-274a210bb245 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] HTTP exception thrown: Instance 7523e0a9-60e8-42ba-b271-d63251e373b7 could not be found. Aug 31 16:03:49.969036 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f9094011-db64-413b-b730-274a210bb245 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Request method failure captured: Aug 31 16:03:49.969036 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/7523e0a9-60e8-42ba-b271-d63251e373b7 HTTP/1.1 Aug 31 16:03:49.969036 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:03:49.969036 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:03:49.969036 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:03:49.969036 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:03:49.969036 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:03:49.969036 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:03:49.969036 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:03:49.969036 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:03:49.969036 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4XPlAekejmndZlXbw_62t9RHkVDUliII7SgyNNELpJa9xsf7i-0KnmdG2iv40SsfrVbwYiRRdy08bmGoujuRfoHeWgGeuAJnMls19D_v_FlHQf4OG9vY5Ofop3Bynas8vthMKEagZXs5p3QgMh_WYlby_JBwefNuTB5pQDJ0PblOSs Aug 31 16:03:49.969036 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:03:49.969036 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:03:49.969036 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:03:49.969036 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:03:49.969036 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:03:49.969036 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:03:49.969036 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: ab675eb7ef3e45e68d74d737484c6e6c Aug 31 16:03:49.969036 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ServersTestManualDisk-1230271696 Aug 31 16:03:49.969036 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:03:49.969036 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:03:49.969036 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ab675eb7ef3e45e68d74d737484c6e6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ab675eb7ef3e45e68d74d737484c6e6c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ab675eb7ef3e45e68d74d737484c6e6c", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ab675eb7ef3e45e68d74d737484c6e6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:03:49.969036 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ServersTestManualDisk-1230271696 Aug 31 16:03:49.969036 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: ab675eb7ef3e45e68d74d737484c6e6c Aug 31 16:03:49.969036 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ServersTestManualDisk-1230271696 Aug 31 16:03:49.969036 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ServersTestManualDisk-1230271696-project Aug 31 16:03:49.969036 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:03:49.969036 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:03:49.969036 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 90770e7e060c4ded869851dea068189c Aug 31 16:03:49.969036 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ServersTestManualDisk-1230271696-project Aug 31 16:03:49.969036 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:03:49.969036 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance 7523e0a9-60e8-42ba-b271-d63251e373b7 could not be found. Aug 31 16:03:49.969036 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '7523e0a9-60e8-42ba-b271-d63251e373b7'} Aug 31 16:03:49.969036 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:03:49.969036 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:03:49.969036 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:03:49.969036 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:03:49.969036 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:03:49.969036 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:03:49.969036 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:03:49.969036 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:03:49.969036 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:03:49.969036 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:03:49.969036 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7523e0a9-60e8-42ba-b271-d63251e373b7 could not be found. Aug 31 16:03:49.969036 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:03:49.969036 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:03:49.969036 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:03:49.969036 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:03:49.969036 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:03:49.969036 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:03:49.969036 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:03:49.969036 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:03:49.969036 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:03:49.969036 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:03:49.969036 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:03:49.969036 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:03:49.969036 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:03:49.969036 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:03:49.969036 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:03:49.969036 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:03:49.969036 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7523e0a9-60e8-42ba-b271-d63251e373b7 could not be found. Aug 31 16:03:49.969036 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:03:49.969036 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:03:49.969036 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:03:49.974978 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:03:49.974978 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:03:49.974978 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:03:49.974978 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:03:49.974978 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:03:49.974978 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7523e0a9-60e8-42ba-b271-d63251e373b7 could not be found. Aug 31 16:03:49.974978 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:03:49.974978 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f9094011-db64-413b-b730-274a210bb245 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Returning 404 to user: Instance 7523e0a9-60e8-42ba-b271-d63251e373b7 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:03:49.974978 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f9094011-db64-413b-b730-274a210bb245 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] 10.222.0.61 "GET /compute/v2.1/servers/7523e0a9-60e8-42ba-b271-d63251e373b7" status: 404 len: 111 microversion: 2.1 time: 0.038145 Aug 31 16:03:49.974978 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1021/2063] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:49 2022] GET /compute/v2.1/servers/7523e0a9-60e8-42ba-b271-d63251e373b7 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:03:49.978136 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-415e9069-4f8b-4e01-ae67-7058db029ccc req-5b23b97d-7fb7-4c57-8103-a6b04fa941e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cafdad7c-e670-48df-8c07-a2405d19f357", "name": "network-vif-deleted", "tag": "8b9d6092-352b-4fc5-a622-919e58ed2dea"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:03:49.989915 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-415e9069-4f8b-4e01-ae67-7058db029ccc req-5b23b97d-7fb7-4c57-8103-a6b04fa941e3 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:49.990444 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-415e9069-4f8b-4e01-ae67-7058db029ccc req-5b23b97d-7fb7-4c57-8103-a6b04fa941e3 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:49.990889 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-415e9069-4f8b-4e01-ae67-7058db029ccc req-5b23b97d-7fb7-4c57-8103-a6b04fa941e3 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:50.005175 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-415e9069-4f8b-4e01-ae67-7058db029ccc req-5b23b97d-7fb7-4c57-8103-a6b04fa941e3 service nova] Creating event network-vif-deleted:8b9d6092-352b-4fc5-a622-919e58ed2dea for instance cafdad7c-e670-48df-8c07-a2405d19f357 on n-h1-850499-9 Aug 31 16:03:50.010304 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-415e9069-4f8b-4e01-ae67-7058db029ccc req-5b23b97d-7fb7-4c57-8103-a6b04fa941e3 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037676 Aug 31 16:03:50.010928 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1022/2064] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:03:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:03:50.017529 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-fa4b7d9f-442c-4efc-9d6d-3a59153902dc tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:50.018312 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-fa4b7d9f-442c-4efc-9d6d-3a59153902dc tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 9d6a4c52-02e5-491b-ac04-917b710c332c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:50.025750 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fa4b7d9f-442c-4efc-9d6d-3a59153902dc tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:50.025951 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fa4b7d9f-442c-4efc-9d6d-3a59153902dc tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:50.026708 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fa4b7d9f-442c-4efc-9d6d-3a59153902dc tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:50.029349 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fa4b7d9f-442c-4efc-9d6d-3a59153902dc tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:50.029829 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fa4b7d9f-442c-4efc-9d6d-3a59153902dc tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:50.030275 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fa4b7d9f-442c-4efc-9d6d-3a59153902dc tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:50.056266 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=100 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:03:50.207303 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-fa4b7d9f-442c-4efc-9d6d-3a59153902dc tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:50.218146 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-fa4b7d9f-442c-4efc-9d6d-3a59153902dc tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/9d6a4c52-02e5-491b-ac04-917b710c332c" status: 200 len: 1317 microversion: 2.1 time: 0.204603 Aug 31 16:03:50.219023 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1023/2065] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:50 2022] GET /compute/v2.1/servers/9d6a4c52-02e5-491b-ac04-917b710c332c => generated 1317 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:50.240605 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e37e9ad8-0cf1-4b53-b5e4-9141fa24d039 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] Calling method '.version_select at 0x7f5aed2f4820>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:50.263132 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e37e9ad8-0cf1-4b53-b5e4-9141fa24d039 tempest-ServersTestManualDisk-1230271696 tempest-ServersTestManualDisk-1230271696-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-909265129" status: 202 len: 0 microversion: 2.1 time: 0.028829 Aug 31 16:03:50.263794 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1024/2066] 10.222.0.61 () {58 vars in 1218 bytes} [Wed Aug 31 16:03:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-909265129 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:03:50.269380 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3c53040f-d7d8-4112-a524-6f354278db0e tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:50.270008 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3c53040f-d7d8-4112-a524-6f354278db0e tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 006771fc-9da9-4b78-9fad-f4b72c311fd5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:50.276942 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3c53040f-d7d8-4112-a524-6f354278db0e tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:50.277446 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3c53040f-d7d8-4112-a524-6f354278db0e tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:50.277897 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3c53040f-d7d8-4112-a524-6f354278db0e tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:50.278805 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3c53040f-d7d8-4112-a524-6f354278db0e tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:50.279272 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3c53040f-d7d8-4112-a524-6f354278db0e tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:50.279738 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3c53040f-d7d8-4112-a524-6f354278db0e tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:50.554573 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3c53040f-d7d8-4112-a524-6f354278db0e tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:50.588544 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3c53040f-d7d8-4112-a524-6f354278db0e tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:50.591367 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3c53040f-d7d8-4112-a524-6f354278db0e tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:50.592853 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3c53040f-d7d8-4112-a524-6f354278db0e tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5" status: 200 len: 1280 microversion: 2.25 time: 0.328112 Aug 31 16:03:50.594479 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1025/2067] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:03:50 2022] GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5 => generated 1280 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:03:50.600736 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9063cfcd-4037-4880-8ba5-f0b93651cb6f tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:50.601629 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9063cfcd-4037-4880-8ba5-f0b93651cb6f tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: d8590729-e3da-4e04-9daa-7e04a3d88068] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:50.612630 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9063cfcd-4037-4880-8ba5-f0b93651cb6f tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:50.613448 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9063cfcd-4037-4880-8ba5-f0b93651cb6f tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:50.613875 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9063cfcd-4037-4880-8ba5-f0b93651cb6f tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:50.615018 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9063cfcd-4037-4880-8ba5-f0b93651cb6f tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:50.615931 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9063cfcd-4037-4880-8ba5-f0b93651cb6f tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:50.616754 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9063cfcd-4037-4880-8ba5-f0b93651cb6f tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:51.171059 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9063cfcd-4037-4880-8ba5-f0b93651cb6f tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:51.183593 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9063cfcd-4037-4880-8ba5-f0b93651cb6f tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/d8590729-e3da-4e04-9daa-7e04a3d88068" status: 200 len: 1314 microversion: 2.1 time: 0.587615 Aug 31 16:03:51.196009 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1026/2068] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:50 2022] GET /compute/v2.1/servers/d8590729-e3da-4e04-9daa-7e04a3d88068 => generated 1314 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:51.203446 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-22d30c8f-c536-4192-83fb-a5ac40819a35 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:51.212551 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-22d30c8f-c536-4192-83fb-a5ac40819a35 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: 007aba90-0e41-45d6-97f2-2d20b29d4296] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:51.225758 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-22d30c8f-c536-4192-83fb-a5ac40819a35 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:51.226276 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-22d30c8f-c536-4192-83fb-a5ac40819a35 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:51.231978 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-22d30c8f-c536-4192-83fb-a5ac40819a35 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:51.233463 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-22d30c8f-c536-4192-83fb-a5ac40819a35 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:51.234326 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-22d30c8f-c536-4192-83fb-a5ac40819a35 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:51.234982 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-22d30c8f-c536-4192-83fb-a5ac40819a35 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:51.886197 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-22d30c8f-c536-4192-83fb-a5ac40819a35 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ccd03a4aa84f93bc26b438e1468f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a9f3fcc4b445349e5c66ff712e8598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:51.905343 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-22d30c8f-c536-4192-83fb-a5ac40819a35 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/servers/007aba90-0e41-45d6-97f2-2d20b29d4296" status: 200 len: 1308 microversion: 2.1 time: 0.707774 Aug 31 16:03:51.906601 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1027/2069] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:51 2022] GET /compute/v2.1/servers/007aba90-0e41-45d6-97f2-2d20b29d4296 => generated 1308 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:51.917371 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-db4178c0-1b55-4bb0-b494-5814707f2af8 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:51.918387 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-db4178c0-1b55-4bb0-b494-5814707f2af8 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6e82c98f-d644-4464-aca0-13901e551aa4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:51.936080 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-db4178c0-1b55-4bb0-b494-5814707f2af8 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:51.936916 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-db4178c0-1b55-4bb0-b494-5814707f2af8 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:51.937570 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-db4178c0-1b55-4bb0-b494-5814707f2af8 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:51.938508 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-db4178c0-1b55-4bb0-b494-5814707f2af8 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:51.939165 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-db4178c0-1b55-4bb0-b494-5814707f2af8 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:51.939800 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-db4178c0-1b55-4bb0-b494-5814707f2af8 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:52.236017 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-db4178c0-1b55-4bb0-b494-5814707f2af8 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:52.247221 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-db4178c0-1b55-4bb0-b494-5814707f2af8 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4" status: 200 len: 1474 microversion: 2.1 time: 0.338797 Aug 31 16:03:52.263913 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1028/2070] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:51 2022] GET /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4 => generated 1474 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:52.270057 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-922afaf7-52d9-4511-888c-f27210fa1747 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:52.270958 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-922afaf7-52d9-4511-888c-f27210fa1747 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 9d6a4c52-02e5-491b-ac04-917b710c332c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:52.283784 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-922afaf7-52d9-4511-888c-f27210fa1747 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:52.287575 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-922afaf7-52d9-4511-888c-f27210fa1747 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:52.288272 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-922afaf7-52d9-4511-888c-f27210fa1747 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:52.289337 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-922afaf7-52d9-4511-888c-f27210fa1747 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:52.289984 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-922afaf7-52d9-4511-888c-f27210fa1747 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:52.295014 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-922afaf7-52d9-4511-888c-f27210fa1747 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:52.488031 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b7ae7cc7-0844-48cf-af95-0baf5577e331 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f/action" status: 202 len: 0 microversion: 2.1 time: 8.294310 Aug 31 16:03:52.488604 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1043/2071] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:03:44 2022] POST /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f/action => generated 0 bytes in 8296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 16:03:52.504112 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-e9c88e30-09a6-4660-a6c0-692b2562c001 req-a2eeddb0-4bb3-4ecb-98c8-a02f7bf4d0ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8590729-e3da-4e04-9daa-7e04a3d88068", "name": "network-vif-plugged", "status": "completed", "tag": "ad3a95e6-8a22-4c56-abd4-a82f6b1e06b0"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:03:52.520241 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-e9c88e30-09a6-4660-a6c0-692b2562c001 req-a2eeddb0-4bb3-4ecb-98c8-a02f7bf4d0ed service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:52.521019 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-e9c88e30-09a6-4660-a6c0-692b2562c001 req-a2eeddb0-4bb3-4ecb-98c8-a02f7bf4d0ed service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:52.521637 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-e9c88e30-09a6-4660-a6c0-692b2562c001 req-a2eeddb0-4bb3-4ecb-98c8-a02f7bf4d0ed service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:52.539068 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-e9c88e30-09a6-4660-a6c0-692b2562c001 req-a2eeddb0-4bb3-4ecb-98c8-a02f7bf4d0ed service nova] Creating event network-vif-plugged:ad3a95e6-8a22-4c56-abd4-a82f6b1e06b0 for instance d8590729-e3da-4e04-9daa-7e04a3d88068 on n-h1-850499-9 Aug 31 16:03:52.546187 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-e9c88e30-09a6-4660-a6c0-692b2562c001 req-a2eeddb0-4bb3-4ecb-98c8-a02f7bf4d0ed service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050291 Aug 31 16:03:52.546791 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1044/2072] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:03:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:03:52.553915 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-969ea249-ba1a-4d72-90d1-80e68b451004 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:52.555173 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-969ea249-ba1a-4d72-90d1-80e68b451004 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 006771fc-9da9-4b78-9fad-f4b72c311fd5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:52.568861 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-969ea249-ba1a-4d72-90d1-80e68b451004 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:52.569702 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-969ea249-ba1a-4d72-90d1-80e68b451004 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:52.570340 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-969ea249-ba1a-4d72-90d1-80e68b451004 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:52.571047 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-922afaf7-52d9-4511-888c-f27210fa1747 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:52.571446 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-969ea249-ba1a-4d72-90d1-80e68b451004 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:52.572191 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-969ea249-ba1a-4d72-90d1-80e68b451004 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:52.572808 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-969ea249-ba1a-4d72-90d1-80e68b451004 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:52.580260 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-922afaf7-52d9-4511-888c-f27210fa1747 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/9d6a4c52-02e5-491b-ac04-917b710c332c" status: 200 len: 1317 microversion: 2.1 time: 0.314823 Aug 31 16:03:52.581175 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1029/2073] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:52 2022] GET /compute/v2.1/servers/9d6a4c52-02e5-491b-ac04-917b710c332c => generated 1317 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:52.586015 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-9adef372-80b2-4b1e-8096-dc3b367372e3 req-43db12ae-bb38-4f44-8cce-1ff9c8d638d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "007aba90-0e41-45d6-97f2-2d20b29d4296", "tag": "884c2568-ad01-48ba-ac30-4fc6751c3295"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:03:52.596849 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-9adef372-80b2-4b1e-8096-dc3b367372e3 req-43db12ae-bb38-4f44-8cce-1ff9c8d638d1 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:52.597342 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-9adef372-80b2-4b1e-8096-dc3b367372e3 req-43db12ae-bb38-4f44-8cce-1ff9c8d638d1 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:52.597781 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-9adef372-80b2-4b1e-8096-dc3b367372e3 req-43db12ae-bb38-4f44-8cce-1ff9c8d638d1 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:52.610846 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-9adef372-80b2-4b1e-8096-dc3b367372e3 req-43db12ae-bb38-4f44-8cce-1ff9c8d638d1 service nova] Creating event network-changed:884c2568-ad01-48ba-ac30-4fc6751c3295 for instance 007aba90-0e41-45d6-97f2-2d20b29d4296 on n-h2-850499-9 Aug 31 16:03:52.615825 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-9adef372-80b2-4b1e-8096-dc3b367372e3 req-43db12ae-bb38-4f44-8cce-1ff9c8d638d1 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033432 Aug 31 16:03:52.619422 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1030/2074] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:03:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:03:52.626126 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-863016ca-6d58-4248-8826-aa72f9b661f9 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:52.627137 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-863016ca-6d58-4248-8826-aa72f9b661f9 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: d8590729-e3da-4e04-9daa-7e04a3d88068] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:52.646286 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-863016ca-6d58-4248-8826-aa72f9b661f9 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:52.646804 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-863016ca-6d58-4248-8826-aa72f9b661f9 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:52.647245 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-863016ca-6d58-4248-8826-aa72f9b661f9 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:52.647999 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-863016ca-6d58-4248-8826-aa72f9b661f9 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:52.648456 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-863016ca-6d58-4248-8826-aa72f9b661f9 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:52.648883 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-863016ca-6d58-4248-8826-aa72f9b661f9 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:52.818554 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-969ea249-ba1a-4d72-90d1-80e68b451004 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:52.832249 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-969ea249-ba1a-4d72-90d1-80e68b451004 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:52.836018 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-969ea249-ba1a-4d72-90d1-80e68b451004 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:52.837519 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-969ea249-ba1a-4d72-90d1-80e68b451004 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5" status: 200 len: 1280 microversion: 2.25 time: 0.289162 Aug 31 16:03:52.846296 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1045/2075] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:03:52 2022] GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5 => generated 1280 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:03:52.853644 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ac82c079-0781-45b3-ac7f-d6a03c7c80cf tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:52.858408 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ac82c079-0781-45b3-ac7f-d6a03c7c80cf tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: dd702273-095b-4d44-8d1b-3d90f7833d5f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:52.878395 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ac82c079-0781-45b3-ac7f-d6a03c7c80cf tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:52.879420 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ac82c079-0781-45b3-ac7f-d6a03c7c80cf tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:52.880149 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ac82c079-0781-45b3-ac7f-d6a03c7c80cf tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:52.881293 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ac82c079-0781-45b3-ac7f-d6a03c7c80cf tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:52.881845 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ac82c079-0781-45b3-ac7f-d6a03c7c80cf tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:52.882466 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ac82c079-0781-45b3-ac7f-d6a03c7c80cf tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:52.926514 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-863016ca-6d58-4248-8826-aa72f9b661f9 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:52.944458 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-863016ca-6d58-4248-8826-aa72f9b661f9 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/d8590729-e3da-4e04-9daa-7e04a3d88068" status: 200 len: 1314 microversion: 2.1 time: 0.323020 Aug 31 16:03:52.947821 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1031/2076] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:52 2022] GET /compute/v2.1/servers/d8590729-e3da-4e04-9daa-7e04a3d88068 => generated 1314 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:52.956375 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0de6f7d0-ef19-485e-88e3-b0382c088e79 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:52.957356 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0de6f7d0-ef19-485e-88e3-b0382c088e79 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: 007aba90-0e41-45d6-97f2-2d20b29d4296] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:52.965046 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0de6f7d0-ef19-485e-88e3-b0382c088e79 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:52.965798 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0de6f7d0-ef19-485e-88e3-b0382c088e79 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:52.966474 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0de6f7d0-ef19-485e-88e3-b0382c088e79 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:52.967358 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0de6f7d0-ef19-485e-88e3-b0382c088e79 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:52.969474 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0de6f7d0-ef19-485e-88e3-b0382c088e79 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:52.970092 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0de6f7d0-ef19-485e-88e3-b0382c088e79 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:53.093944 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ac82c079-0781-45b3-ac7f-d6a03c7c80cf tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:53.101860 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ac82c079-0781-45b3-ac7f-d6a03c7c80cf tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f" status: 200 len: 1392 microversion: 2.1 time: 0.253985 Aug 31 16:03:53.115890 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1046/2077] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:52 2022] GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f => generated 1392 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:53.185756 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0de6f7d0-ef19-485e-88e3-b0382c088e79 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ccd03a4aa84f93bc26b438e1468f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a9f3fcc4b445349e5c66ff712e8598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:53.194378 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0de6f7d0-ef19-485e-88e3-b0382c088e79 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/servers/007aba90-0e41-45d6-97f2-2d20b29d4296" status: 200 len: 1308 microversion: 2.1 time: 0.244478 Aug 31 16:03:53.194964 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1032/2078] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:52 2022] GET /compute/v2.1/servers/007aba90-0e41-45d6-97f2-2d20b29d4296 => generated 1308 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:53.271269 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-86c0a5db-6199-4384-8297-a25e2a9d43ec tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:53.272125 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-86c0a5db-6199-4384-8297-a25e2a9d43ec tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6e82c98f-d644-4464-aca0-13901e551aa4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:53.274682 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=16 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:03:53.282239 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-86c0a5db-6199-4384-8297-a25e2a9d43ec tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:53.282964 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-86c0a5db-6199-4384-8297-a25e2a9d43ec tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:53.283630 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-86c0a5db-6199-4384-8297-a25e2a9d43ec tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:53.284364 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-86c0a5db-6199-4384-8297-a25e2a9d43ec tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:53.284948 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-86c0a5db-6199-4384-8297-a25e2a9d43ec tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:53.285374 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-86c0a5db-6199-4384-8297-a25e2a9d43ec tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:53.292186 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:03:53.465508 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-86c0a5db-6199-4384-8297-a25e2a9d43ec tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:53.477136 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-86c0a5db-6199-4384-8297-a25e2a9d43ec tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4" status: 200 len: 1472 microversion: 2.1 time: 0.210521 Aug 31 16:03:53.477746 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1047/2079] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:53 2022] GET /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4 => generated 1472 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:53.601288 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8ab00a1d-b346-43d3-b491-08a23ed14ca3 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:53.601926 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8ab00a1d-b346-43d3-b491-08a23ed14ca3 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 9d6a4c52-02e5-491b-ac04-917b710c332c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:53.609687 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8ab00a1d-b346-43d3-b491-08a23ed14ca3 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:53.610210 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8ab00a1d-b346-43d3-b491-08a23ed14ca3 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:53.610664 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8ab00a1d-b346-43d3-b491-08a23ed14ca3 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:53.611399 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8ab00a1d-b346-43d3-b491-08a23ed14ca3 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:53.611894 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8ab00a1d-b346-43d3-b491-08a23ed14ca3 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:53.612333 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8ab00a1d-b346-43d3-b491-08a23ed14ca3 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:53.788510 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8ab00a1d-b346-43d3-b491-08a23ed14ca3 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:53.799681 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8ab00a1d-b346-43d3-b491-08a23ed14ca3 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/9d6a4c52-02e5-491b-ac04-917b710c332c" status: 200 len: 1317 microversion: 2.1 time: 0.202105 Aug 31 16:03:53.800611 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1033/2080] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:53 2022] GET /compute/v2.1/servers/9d6a4c52-02e5-491b-ac04-917b710c332c => generated 1317 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:53.868322 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ac06cce3-7083-450c-8070-56681dea022b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:53.869191 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ac06cce3-7083-450c-8070-56681dea022b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 006771fc-9da9-4b78-9fad-f4b72c311fd5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:53.873956 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:03:53.878079 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ac06cce3-7083-450c-8070-56681dea022b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:53.878944 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ac06cce3-7083-450c-8070-56681dea022b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:53.879683 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ac06cce3-7083-450c-8070-56681dea022b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:53.880562 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ac06cce3-7083-450c-8070-56681dea022b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:53.881127 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ac06cce3-7083-450c-8070-56681dea022b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:53.881664 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ac06cce3-7083-450c-8070-56681dea022b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:53.968505 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e640f569-e7bb-47ee-8de2-199dbf13cb43 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:53.969350 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e640f569-e7bb-47ee-8de2-199dbf13cb43 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: d8590729-e3da-4e04-9daa-7e04a3d88068] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:53.983225 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e640f569-e7bb-47ee-8de2-199dbf13cb43 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:53.983775 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e640f569-e7bb-47ee-8de2-199dbf13cb43 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:53.984230 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e640f569-e7bb-47ee-8de2-199dbf13cb43 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:53.984975 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e640f569-e7bb-47ee-8de2-199dbf13cb43 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:53.985443 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e640f569-e7bb-47ee-8de2-199dbf13cb43 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:53.985879 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e640f569-e7bb-47ee-8de2-199dbf13cb43 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:54.131369 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ac06cce3-7083-450c-8070-56681dea022b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:54.150542 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ac06cce3-7083-450c-8070-56681dea022b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:54.157048 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ac06cce3-7083-450c-8070-56681dea022b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:54.158525 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ac06cce3-7083-450c-8070-56681dea022b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5" status: 200 len: 1280 microversion: 2.25 time: 0.298666 Aug 31 16:03:54.172010 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1048/2081] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:03:53 2022] GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5 => generated 1280 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:03:54.182453 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-016a4396-5318-4f18-8698-6a7f97849b2c tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:54.183949 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-016a4396-5318-4f18-8698-6a7f97849b2c tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: dd702273-095b-4d44-8d1b-3d90f7833d5f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:54.187939 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=8 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:03:54.200581 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-016a4396-5318-4f18-8698-6a7f97849b2c tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:54.201077 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-016a4396-5318-4f18-8698-6a7f97849b2c tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:54.202752 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-016a4396-5318-4f18-8698-6a7f97849b2c tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:54.204307 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-016a4396-5318-4f18-8698-6a7f97849b2c tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:54.212873 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-016a4396-5318-4f18-8698-6a7f97849b2c tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:54.213586 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-016a4396-5318-4f18-8698-6a7f97849b2c tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:54.332996 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e640f569-e7bb-47ee-8de2-199dbf13cb43 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:54.352734 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e640f569-e7bb-47ee-8de2-199dbf13cb43 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/d8590729-e3da-4e04-9daa-7e04a3d88068" status: 200 len: 1314 microversion: 2.1 time: 0.388016 Aug 31 16:03:54.365087 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1034/2082] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:53 2022] GET /compute/v2.1/servers/d8590729-e3da-4e04-9daa-7e04a3d88068 => generated 1314 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:03:54.370817 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-696e9392-689d-4d93-bde1-7fdc0cf6efb3 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:54.372085 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-696e9392-689d-4d93-bde1-7fdc0cf6efb3 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: 007aba90-0e41-45d6-97f2-2d20b29d4296] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:54.379862 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-696e9392-689d-4d93-bde1-7fdc0cf6efb3 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:54.380708 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-696e9392-689d-4d93-bde1-7fdc0cf6efb3 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:54.381397 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-696e9392-689d-4d93-bde1-7fdc0cf6efb3 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:54.382972 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-696e9392-689d-4d93-bde1-7fdc0cf6efb3 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:54.384374 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-696e9392-689d-4d93-bde1-7fdc0cf6efb3 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:54.385051 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-696e9392-689d-4d93-bde1-7fdc0cf6efb3 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:54.436064 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-016a4396-5318-4f18-8698-6a7f97849b2c tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:54.444743 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-016a4396-5318-4f18-8698-6a7f97849b2c tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f" status: 200 len: 1392 microversion: 2.1 time: 0.271306 Aug 31 16:03:54.446377 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1049/2083] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:54 2022] GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f => generated 1392 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:54.505765 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1f5a64c2-ad95-48cc-8fe5-1c858a080350 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:54.506824 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1f5a64c2-ad95-48cc-8fe5-1c858a080350 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6e82c98f-d644-4464-aca0-13901e551aa4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:54.517433 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1f5a64c2-ad95-48cc-8fe5-1c858a080350 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:54.518408 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1f5a64c2-ad95-48cc-8fe5-1c858a080350 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:54.519009 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1f5a64c2-ad95-48cc-8fe5-1c858a080350 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:54.524710 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1f5a64c2-ad95-48cc-8fe5-1c858a080350 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:54.525206 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1f5a64c2-ad95-48cc-8fe5-1c858a080350 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:54.525650 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1f5a64c2-ad95-48cc-8fe5-1c858a080350 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:54.580165 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-696e9392-689d-4d93-bde1-7fdc0cf6efb3 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ccd03a4aa84f93bc26b438e1468f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a9f3fcc4b445349e5c66ff712e8598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:54.594290 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-696e9392-689d-4d93-bde1-7fdc0cf6efb3 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/servers/007aba90-0e41-45d6-97f2-2d20b29d4296" status: 200 len: 1308 microversion: 2.1 time: 0.227467 Aug 31 16:03:54.613634 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1035/2084] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:54 2022] GET /compute/v2.1/servers/007aba90-0e41-45d6-97f2-2d20b29d4296 => generated 1308 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:54.734672 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1f5a64c2-ad95-48cc-8fe5-1c858a080350 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:54.744741 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1f5a64c2-ad95-48cc-8fe5-1c858a080350 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4" status: 200 len: 1472 microversion: 2.1 time: 0.244299 Aug 31 16:03:54.747695 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1050/2085] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:54 2022] GET /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4 => generated 1472 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:03:54.822895 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5addedac-056f-4793-a448-2bc57107aaeb tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:54.824261 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5addedac-056f-4793-a448-2bc57107aaeb tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 9d6a4c52-02e5-491b-ac04-917b710c332c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:54.834735 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5addedac-056f-4793-a448-2bc57107aaeb tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:54.835372 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5addedac-056f-4793-a448-2bc57107aaeb tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:54.836081 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5addedac-056f-4793-a448-2bc57107aaeb tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:54.836992 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5addedac-056f-4793-a448-2bc57107aaeb tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:54.837552 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5addedac-056f-4793-a448-2bc57107aaeb tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:54.838206 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5addedac-056f-4793-a448-2bc57107aaeb tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:55.041506 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5addedac-056f-4793-a448-2bc57107aaeb tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:55.053020 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5addedac-056f-4793-a448-2bc57107aaeb tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/9d6a4c52-02e5-491b-ac04-917b710c332c" status: 200 len: 1317 microversion: 2.1 time: 0.234654 Aug 31 16:03:55.054324 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1036/2086] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:54 2022] GET /compute/v2.1/servers/9d6a4c52-02e5-491b-ac04-917b710c332c => generated 1317 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:55.190036 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-dba67853-7642-4800-946f-b59453337e51 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:55.191594 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-dba67853-7642-4800-946f-b59453337e51 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 006771fc-9da9-4b78-9fad-f4b72c311fd5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:55.202022 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dba67853-7642-4800-946f-b59453337e51 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:55.203284 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dba67853-7642-4800-946f-b59453337e51 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:55.204375 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dba67853-7642-4800-946f-b59453337e51 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:55.205771 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dba67853-7642-4800-946f-b59453337e51 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:55.206514 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dba67853-7642-4800-946f-b59453337e51 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:55.207582 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dba67853-7642-4800-946f-b59453337e51 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:55.379732 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7852040f-3054-4ec6-9542-6f9bb6839e0f tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:55.380417 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7852040f-3054-4ec6-9542-6f9bb6839e0f tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: d8590729-e3da-4e04-9daa-7e04a3d88068] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:55.397734 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7852040f-3054-4ec6-9542-6f9bb6839e0f tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:55.398466 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7852040f-3054-4ec6-9542-6f9bb6839e0f tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:55.398900 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7852040f-3054-4ec6-9542-6f9bb6839e0f tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:55.399714 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7852040f-3054-4ec6-9542-6f9bb6839e0f tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:55.400184 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7852040f-3054-4ec6-9542-6f9bb6839e0f tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:55.400666 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7852040f-3054-4ec6-9542-6f9bb6839e0f tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:55.401133 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-dba67853-7642-4800-946f-b59453337e51 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:55.414288 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-dba67853-7642-4800-946f-b59453337e51 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:55.419530 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-dba67853-7642-4800-946f-b59453337e51 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:55.421102 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-dba67853-7642-4800-946f-b59453337e51 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5" status: 200 len: 1280 microversion: 2.25 time: 0.237660 Aug 31 16:03:55.439565 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1051/2087] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:03:55 2022] GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5 => generated 1280 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:03:55.469189 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ecd4923b-89df-4e8f-ae73-a95f71989773 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:55.470368 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ecd4923b-89df-4e8f-ae73-a95f71989773 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: dd702273-095b-4d44-8d1b-3d90f7833d5f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:55.478845 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ecd4923b-89df-4e8f-ae73-a95f71989773 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:55.479759 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ecd4923b-89df-4e8f-ae73-a95f71989773 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:55.481761 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ecd4923b-89df-4e8f-ae73-a95f71989773 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:55.483023 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ecd4923b-89df-4e8f-ae73-a95f71989773 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:55.483717 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ecd4923b-89df-4e8f-ae73-a95f71989773 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:55.484330 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ecd4923b-89df-4e8f-ae73-a95f71989773 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:55.681712 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7852040f-3054-4ec6-9542-6f9bb6839e0f tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:55.697955 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7852040f-3054-4ec6-9542-6f9bb6839e0f tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/d8590729-e3da-4e04-9daa-7e04a3d88068" status: 200 len: 1314 microversion: 2.1 time: 0.322378 Aug 31 16:03:55.711725 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1037/2088] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:55 2022] GET /compute/v2.1/servers/d8590729-e3da-4e04-9daa-7e04a3d88068 => generated 1314 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:55.718459 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ecd4923b-89df-4e8f-ae73-a95f71989773 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:55.718846 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-24b66272-6b2f-408e-828e-a8b65d773f9c req-0a9d9cb8-7d18-4f5b-bfdb-bcfd4ea0acc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d6a4c52-02e5-491b-ac04-917b710c332c", "name": "network-vif-plugged", "status": "completed", "tag": "ecf300a4-940b-4328-9b57-bd2c3a0ae844"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:03:55.731596 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-24b66272-6b2f-408e-828e-a8b65d773f9c req-0a9d9cb8-7d18-4f5b-bfdb-bcfd4ea0acc6 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:55.732654 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-24b66272-6b2f-408e-828e-a8b65d773f9c req-0a9d9cb8-7d18-4f5b-bfdb-bcfd4ea0acc6 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:55.733010 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ecd4923b-89df-4e8f-ae73-a95f71989773 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f" status: 200 len: 1392 microversion: 2.1 time: 0.269584 Aug 31 16:03:55.733452 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-24b66272-6b2f-408e-828e-a8b65d773f9c req-0a9d9cb8-7d18-4f5b-bfdb-bcfd4ea0acc6 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:55.734616 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1052/2089] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:55 2022] GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f => generated 1392 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:03:55.749604 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0881d13e-b518-4302-ac6e-997ea2c8ee47 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:55.750726 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0881d13e-b518-4302-ac6e-997ea2c8ee47 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: 007aba90-0e41-45d6-97f2-2d20b29d4296] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:55.761178 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-24b66272-6b2f-408e-828e-a8b65d773f9c req-0a9d9cb8-7d18-4f5b-bfdb-bcfd4ea0acc6 service nova] Creating event network-vif-plugged:ecf300a4-940b-4328-9b57-bd2c3a0ae844 for instance 9d6a4c52-02e5-491b-ac04-917b710c332c on n-h1-850499-9 Aug 31 16:03:55.764447 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0881d13e-b518-4302-ac6e-997ea2c8ee47 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:55.767575 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0881d13e-b518-4302-ac6e-997ea2c8ee47 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:55.768115 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0881d13e-b518-4302-ac6e-997ea2c8ee47 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:55.768417 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-24b66272-6b2f-408e-828e-a8b65d773f9c req-0a9d9cb8-7d18-4f5b-bfdb-bcfd4ea0acc6 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054664 Aug 31 16:03:55.768993 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0881d13e-b518-4302-ac6e-997ea2c8ee47 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:55.769988 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1038/2090] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:03:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:03:55.770497 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0881d13e-b518-4302-ac6e-997ea2c8ee47 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:55.770949 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0881d13e-b518-4302-ac6e-997ea2c8ee47 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:55.777447 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3f141e3d-6bbf-40e3-84c9-489e70c31c53 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:55.778509 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3f141e3d-6bbf-40e3-84c9-489e70c31c53 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6e82c98f-d644-4464-aca0-13901e551aa4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:55.787787 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3f141e3d-6bbf-40e3-84c9-489e70c31c53 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:55.788747 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3f141e3d-6bbf-40e3-84c9-489e70c31c53 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:55.789972 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3f141e3d-6bbf-40e3-84c9-489e70c31c53 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:55.791350 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3f141e3d-6bbf-40e3-84c9-489e70c31c53 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:55.792217 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3f141e3d-6bbf-40e3-84c9-489e70c31c53 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:55.793040 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3f141e3d-6bbf-40e3-84c9-489e70c31c53 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:56.457768 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=10 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:03:56.760105 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3f141e3d-6bbf-40e3-84c9-489e70c31c53 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:56.774415 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3f141e3d-6bbf-40e3-84c9-489e70c31c53 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4" status: 200 len: 1472 microversion: 2.1 time: 1.001876 Aug 31 16:03:56.777735 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1039/2091] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:55 2022] GET /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4 => generated 1472 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:56.786524 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-0881d13e-b518-4302-ac6e-997ea2c8ee47 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ccd03a4aa84f93bc26b438e1468f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a9f3fcc4b445349e5c66ff712e8598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:56.797633 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0881d13e-b518-4302-ac6e-997ea2c8ee47 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/servers/007aba90-0e41-45d6-97f2-2d20b29d4296" status: 200 len: 1308 microversion: 2.1 time: 1.061168 Aug 31 16:03:56.797988 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f598ee83-c076-434b-ab6f-dcd5dc5d281e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:56.798955 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f598ee83-c076-434b-ab6f-dcd5dc5d281e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 9d6a4c52-02e5-491b-ac04-917b710c332c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:56.813452 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1053/2092] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:55 2022] GET /compute/v2.1/servers/007aba90-0e41-45d6-97f2-2d20b29d4296 => generated 1308 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:56.817861 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f598ee83-c076-434b-ab6f-dcd5dc5d281e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:56.818660 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f598ee83-c076-434b-ab6f-dcd5dc5d281e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:56.821722 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-bafadb3f-54ea-464c-9811-772c52503034 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:56.822566 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-bafadb3f-54ea-464c-9811-772c52503034 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 006771fc-9da9-4b78-9fad-f4b72c311fd5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:56.824231 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f598ee83-c076-434b-ab6f-dcd5dc5d281e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:56.825154 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f598ee83-c076-434b-ab6f-dcd5dc5d281e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:56.825720 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f598ee83-c076-434b-ab6f-dcd5dc5d281e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:56.826157 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f598ee83-c076-434b-ab6f-dcd5dc5d281e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:56.830734 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bafadb3f-54ea-464c-9811-772c52503034 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:56.833168 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bafadb3f-54ea-464c-9811-772c52503034 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:56.834160 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bafadb3f-54ea-464c-9811-772c52503034 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:56.836175 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bafadb3f-54ea-464c-9811-772c52503034 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:56.837239 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bafadb3f-54ea-464c-9811-772c52503034 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:56.838186 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bafadb3f-54ea-464c-9811-772c52503034 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:57.601229 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f598ee83-c076-434b-ab6f-dcd5dc5d281e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:57.610453 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f598ee83-c076-434b-ab6f-dcd5dc5d281e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/9d6a4c52-02e5-491b-ac04-917b710c332c" status: 200 len: 1317 microversion: 2.1 time: 0.831372 Aug 31 16:03:57.611968 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1040/2093] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:56 2022] GET /compute/v2.1/servers/9d6a4c52-02e5-491b-ac04-917b710c332c => generated 1317 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:57.622286 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9cc741ce-62c6-446f-b6cd-0305ee9afc04 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:57.624234 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9cc741ce-62c6-446f-b6cd-0305ee9afc04 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: d8590729-e3da-4e04-9daa-7e04a3d88068] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:57.637607 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9cc741ce-62c6-446f-b6cd-0305ee9afc04 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:57.643413 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9cc741ce-62c6-446f-b6cd-0305ee9afc04 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:57.644187 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9cc741ce-62c6-446f-b6cd-0305ee9afc04 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:57.645644 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9cc741ce-62c6-446f-b6cd-0305ee9afc04 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:57.647127 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9cc741ce-62c6-446f-b6cd-0305ee9afc04 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:57.647786 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9cc741ce-62c6-446f-b6cd-0305ee9afc04 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:57.680957 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-bafadb3f-54ea-464c-9811-772c52503034 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:57.695988 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-bafadb3f-54ea-464c-9811-772c52503034 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:57.697306 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-bafadb3f-54ea-464c-9811-772c52503034 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:57.698590 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-bafadb3f-54ea-464c-9811-772c52503034 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5" status: 200 len: 1280 microversion: 2.25 time: 0.883247 Aug 31 16:03:57.702231 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1054/2094] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:03:56 2022] GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5 => generated 1280 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:03:57.719145 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4c0dca62-e2d0-43cf-a2c1-033e39cea261 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:57.720291 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4c0dca62-e2d0-43cf-a2c1-033e39cea261 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: dd702273-095b-4d44-8d1b-3d90f7833d5f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:57.734527 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4c0dca62-e2d0-43cf-a2c1-033e39cea261 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:57.736611 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4c0dca62-e2d0-43cf-a2c1-033e39cea261 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:57.738057 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4c0dca62-e2d0-43cf-a2c1-033e39cea261 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:57.740706 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4c0dca62-e2d0-43cf-a2c1-033e39cea261 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:57.741362 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4c0dca62-e2d0-43cf-a2c1-033e39cea261 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:57.741988 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4c0dca62-e2d0-43cf-a2c1-033e39cea261 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:57.969629 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=12 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:03:58.312043 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9cc741ce-62c6-446f-b6cd-0305ee9afc04 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:58.322075 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9cc741ce-62c6-446f-b6cd-0305ee9afc04 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/d8590729-e3da-4e04-9daa-7e04a3d88068" status: 200 len: 1314 microversion: 2.1 time: 0.708332 Aug 31 16:03:58.322938 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1041/2095] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:57 2022] GET /compute/v2.1/servers/d8590729-e3da-4e04-9daa-7e04a3d88068 => generated 1314 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:58.333359 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-4aff751a-7e71-4127-b386-52f9d1715c54 req-bfebc6f2-2ea1-49f1-96b5-7c58f07e2f50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "006771fc-9da9-4b78-9fad-f4b72c311fd5", "name": "network-vif-plugged", "status": "completed", "tag": "a0210474-72a8-4f79-a241-42969b6b4b66"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:03:58.340212 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-4c0dca62-e2d0-43cf-a2c1-033e39cea261 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:58.349252 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-4aff751a-7e71-4127-b386-52f9d1715c54 req-bfebc6f2-2ea1-49f1-96b5-7c58f07e2f50 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:58.350825 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-4aff751a-7e71-4127-b386-52f9d1715c54 req-bfebc6f2-2ea1-49f1-96b5-7c58f07e2f50 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:58.351477 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-4aff751a-7e71-4127-b386-52f9d1715c54 req-bfebc6f2-2ea1-49f1-96b5-7c58f07e2f50 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:58.354861 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4c0dca62-e2d0-43cf-a2c1-033e39cea261 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f" status: 200 len: 1392 microversion: 2.1 time: 0.646247 Aug 31 16:03:58.360575 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1055/2096] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:57 2022] GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f => generated 1392 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:58.369624 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-4aff751a-7e71-4127-b386-52f9d1715c54 req-bfebc6f2-2ea1-49f1-96b5-7c58f07e2f50 service nova] Creating event network-vif-plugged:a0210474-72a8-4f79-a241-42969b6b4b66 for instance 006771fc-9da9-4b78-9fad-f4b72c311fd5 on n-h2-850499-9 Aug 31 16:03:58.376957 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-4aff751a-7e71-4127-b386-52f9d1715c54 req-bfebc6f2-2ea1-49f1-96b5-7c58f07e2f50 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052482 Aug 31 16:03:58.378319 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1042/2097] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:03:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:03:58.380460 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8d3e610b-cf28-4ecc-9c2c-a4e93cbbb6cc tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:58.385551 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8d3e610b-cf28-4ecc-9c2c-a4e93cbbb6cc tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6e82c98f-d644-4464-aca0-13901e551aa4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:58.394977 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2c3fc992-6fd4-4855-89b4-4403ca696067 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:58.395743 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2c3fc992-6fd4-4855-89b4-4403ca696067 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: 007aba90-0e41-45d6-97f2-2d20b29d4296] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:58.408371 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8d3e610b-cf28-4ecc-9c2c-a4e93cbbb6cc tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:58.409288 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8d3e610b-cf28-4ecc-9c2c-a4e93cbbb6cc tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:58.416073 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8d3e610b-cf28-4ecc-9c2c-a4e93cbbb6cc tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:58.416208 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2c3fc992-6fd4-4855-89b4-4403ca696067 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:58.416327 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2c3fc992-6fd4-4855-89b4-4403ca696067 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:58.416787 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2c3fc992-6fd4-4855-89b4-4403ca696067 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:58.418116 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2c3fc992-6fd4-4855-89b4-4403ca696067 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:58.418466 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8d3e610b-cf28-4ecc-9c2c-a4e93cbbb6cc tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:58.419060 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8d3e610b-cf28-4ecc-9c2c-a4e93cbbb6cc tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:58.419761 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8d3e610b-cf28-4ecc-9c2c-a4e93cbbb6cc tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:58.424552 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2c3fc992-6fd4-4855-89b4-4403ca696067 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:58.425448 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2c3fc992-6fd4-4855-89b4-4403ca696067 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:58.461051 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=100 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:03:58.884952 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8d3e610b-cf28-4ecc-9c2c-a4e93cbbb6cc tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:58.891193 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2c3fc992-6fd4-4855-89b4-4403ca696067 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ccd03a4aa84f93bc26b438e1468f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a9f3fcc4b445349e5c66ff712e8598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:58.903870 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8d3e610b-cf28-4ecc-9c2c-a4e93cbbb6cc tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4" status: 200 len: 1469 microversion: 2.1 time: 0.539744 Aug 31 16:03:58.905746 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1056/2098] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:58 2022] GET /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4 => generated 1469 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:58.911974 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-af1b6a3d-17c6-4c13-91d2-3aeeb8186e17 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:58.913126 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-af1b6a3d-17c6-4c13-91d2-3aeeb8186e17 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 9d6a4c52-02e5-491b-ac04-917b710c332c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:58.938716 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2c3fc992-6fd4-4855-89b4-4403ca696067 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/servers/007aba90-0e41-45d6-97f2-2d20b29d4296" status: 200 len: 1308 microversion: 2.1 time: 0.558670 Aug 31 16:03:58.940313 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-af1b6a3d-17c6-4c13-91d2-3aeeb8186e17 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:58.941289 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-af1b6a3d-17c6-4c13-91d2-3aeeb8186e17 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:58.942016 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-af1b6a3d-17c6-4c13-91d2-3aeeb8186e17 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:58.943052 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-af1b6a3d-17c6-4c13-91d2-3aeeb8186e17 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:58.943907 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-af1b6a3d-17c6-4c13-91d2-3aeeb8186e17 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:58.945775 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-af1b6a3d-17c6-4c13-91d2-3aeeb8186e17 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:58.953365 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1043/2099] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:58 2022] GET /compute/v2.1/servers/007aba90-0e41-45d6-97f2-2d20b29d4296 => generated 1308 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:59.077528 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c9f07efa-8a48-4549-92ea-258c744fb5ef tempest-SecurityGroupRulesTestJSON-1778299432 tempest-SecurityGroupRulesTestJSON-1778299432-project] Action: 'create', calling method: .version_select at 0x7f5aed2f4ca0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1465480141", "description": "tempest-description-1781241715"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:03:59.455059 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-af1b6a3d-17c6-4c13-91d2-3aeeb8186e17 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:59.465128 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-af1b6a3d-17c6-4c13-91d2-3aeeb8186e17 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/9d6a4c52-02e5-491b-ac04-917b710c332c" status: 200 len: 1467 microversion: 2.1 time: 0.557612 Aug 31 16:03:59.471347 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1057/2100] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:58 2022] GET /compute/v2.1/servers/9d6a4c52-02e5-491b-ac04-917b710c332c => generated 1467 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:59.489206 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8551c9ea-2164-428e-a276-468e38b3e53f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:59.489979 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8551c9ea-2164-428e-a276-468e38b3e53f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 006771fc-9da9-4b78-9fad-f4b72c311fd5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:59.512257 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8551c9ea-2164-428e-a276-468e38b3e53f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:59.514750 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8551c9ea-2164-428e-a276-468e38b3e53f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:59.515943 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8551c9ea-2164-428e-a276-468e38b3e53f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:59.517355 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8551c9ea-2164-428e-a276-468e38b3e53f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:59.521999 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8551c9ea-2164-428e-a276-468e38b3e53f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:59.526176 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8551c9ea-2164-428e-a276-468e38b3e53f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:59.697746 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c9f07efa-8a48-4549-92ea-258c744fb5ef tempest-SecurityGroupRulesTestJSON-1778299432 tempest-SecurityGroupRulesTestJSON-1778299432-project] 10.222.0.61 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.742321 Aug 31 16:03:59.702949 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1044/2101] 10.222.0.61 () {60 vars in 1180 bytes} [Wed Aug 31 16:03:58 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:03:59.714887 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0357eaca-1785-444c-8387-4602ec0efec9 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:03:59.729483 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0357eaca-1785-444c-8387-4602ec0efec9 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6e82c98f-d644-4464-aca0-13901e551aa4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:59.754453 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0357eaca-1785-444c-8387-4602ec0efec9 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:59.765116 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0357eaca-1785-444c-8387-4602ec0efec9 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:59.770021 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0357eaca-1785-444c-8387-4602ec0efec9 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:59.770955 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0357eaca-1785-444c-8387-4602ec0efec9 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:59.771667 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0357eaca-1785-444c-8387-4602ec0efec9 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:59.773233 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0357eaca-1785-444c-8387-4602ec0efec9 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:59.955437 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0357eaca-1785-444c-8387-4602ec0efec9 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "POST /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4/action" status: 204 len: 0 microversion: 2.1 time: 0.250664 Aug 31 16:03:59.958144 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1045/2102] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:03:59 2022] POST /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4/action => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:03:59.963962 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8551c9ea-2164-428e-a276-468e38b3e53f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:59.968823 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d67167cf-4a93-4226-b34b-c6cee0be77b8 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:59.972425 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d67167cf-4a93-4226-b34b-c6cee0be77b8 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: d8590729-e3da-4e04-9daa-7e04a3d88068] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:59.975281 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8551c9ea-2164-428e-a276-468e38b3e53f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:59.976991 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8551c9ea-2164-428e-a276-468e38b3e53f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:59.981592 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8551c9ea-2164-428e-a276-468e38b3e53f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5" status: 200 len: 1280 microversion: 2.25 time: 0.508474 Aug 31 16:03:59.983277 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1058/2103] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:03:59 2022] GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5 => generated 1280 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:03:59.992566 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-708b50f6-884a-46ae-9d53-787df3f5dcff tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:59.993951 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-708b50f6-884a-46ae-9d53-787df3f5dcff tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: dd702273-095b-4d44-8d1b-3d90f7833d5f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:00.005023 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d67167cf-4a93-4226-b34b-c6cee0be77b8 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:00.006128 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d67167cf-4a93-4226-b34b-c6cee0be77b8 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:00.006851 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d67167cf-4a93-4226-b34b-c6cee0be77b8 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:00.008036 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d67167cf-4a93-4226-b34b-c6cee0be77b8 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:00.008769 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d67167cf-4a93-4226-b34b-c6cee0be77b8 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:00.009864 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d67167cf-4a93-4226-b34b-c6cee0be77b8 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:00.042074 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-708b50f6-884a-46ae-9d53-787df3f5dcff tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:00.043924 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-708b50f6-884a-46ae-9d53-787df3f5dcff tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:00.048352 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-708b50f6-884a-46ae-9d53-787df3f5dcff tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:00.051739 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-708b50f6-884a-46ae-9d53-787df3f5dcff tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:00.052921 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-708b50f6-884a-46ae-9d53-787df3f5dcff tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:00.054182 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-708b50f6-884a-46ae-9d53-787df3f5dcff tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:00.878255 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-708b50f6-884a-46ae-9d53-787df3f5dcff tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:00.887589 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d67167cf-4a93-4226-b34b-c6cee0be77b8 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:00.896289 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-708b50f6-884a-46ae-9d53-787df3f5dcff tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f" status: 200 len: 1392 microversion: 2.1 time: 0.911103 Aug 31 16:04:00.896891 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1059/2104] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:59 2022] GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f => generated 1392 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:00.900141 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d67167cf-4a93-4226-b34b-c6cee0be77b8 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/d8590729-e3da-4e04-9daa-7e04a3d88068" status: 200 len: 1501 microversion: 2.1 time: 0.939537 Aug 31 16:04:00.904475 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1046/2105] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:59 2022] GET /compute/v2.1/servers/d8590729-e3da-4e04-9daa-7e04a3d88068 => generated 1501 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:00.913187 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c5b0e15d-8c0c-4ef8-aaca-1cbde4176b23 tempest-SecurityGroupRulesTestJSON-1778299432 tempest-SecurityGroupRulesTestJSON-1778299432-project] Action: 'create', calling method: .version_select at 0x7f5aed3448b0>, body: {"security_group_rule": {"parent_group_id": "e076abb9-170b-4c8f-a85f-81cf74f78bbc", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:04:00.923820 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4b29cdd2-aaea-49c4-bcdc-af5485dc5247 tempest-ServersOnMultiNodesTest-1555970217 tempest-ServersOnMultiNodesTest-1555970217-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:00.924782 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4b29cdd2-aaea-49c4-bcdc-af5485dc5247 tempest-ServersOnMultiNodesTest-1555970217 tempest-ServersOnMultiNodesTest-1555970217-project-admin] [instance: 9d6a4c52-02e5-491b-ac04-917b710c332c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:00.942237 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4b29cdd2-aaea-49c4-bcdc-af5485dc5247 tempest-ServersOnMultiNodesTest-1555970217 tempest-ServersOnMultiNodesTest-1555970217-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:00.942757 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4b29cdd2-aaea-49c4-bcdc-af5485dc5247 tempest-ServersOnMultiNodesTest-1555970217 tempest-ServersOnMultiNodesTest-1555970217-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:00.943203 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4b29cdd2-aaea-49c4-bcdc-af5485dc5247 tempest-ServersOnMultiNodesTest-1555970217 tempest-ServersOnMultiNodesTest-1555970217-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:00.943956 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4b29cdd2-aaea-49c4-bcdc-af5485dc5247 tempest-ServersOnMultiNodesTest-1555970217 tempest-ServersOnMultiNodesTest-1555970217-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:00.944420 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4b29cdd2-aaea-49c4-bcdc-af5485dc5247 tempest-ServersOnMultiNodesTest-1555970217 tempest-ServersOnMultiNodesTest-1555970217-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:00.944850 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4b29cdd2-aaea-49c4-bcdc-af5485dc5247 tempest-ServersOnMultiNodesTest-1555970217 tempest-ServersOnMultiNodesTest-1555970217-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:02.078693 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4b29cdd2-aaea-49c4-bcdc-af5485dc5247 tempest-ServersOnMultiNodesTest-1555970217 tempest-ServersOnMultiNodesTest-1555970217-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/9d6a4c52-02e5-491b-ac04-917b710c332c" status: 200 len: 1618 microversion: 2.1 time: 1.180725 Aug 31 16:04:02.082892 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1060/2106] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:00 2022] GET /compute/v2.1/servers/9d6a4c52-02e5-491b-ac04-917b710c332c => generated 1618 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:02.100001 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-dc2320ad-44b4-4845-944c-18c1a21af5e9 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:02.100909 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-dc2320ad-44b4-4845-944c-18c1a21af5e9 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: 007aba90-0e41-45d6-97f2-2d20b29d4296] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:02.110527 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dc2320ad-44b4-4845-944c-18c1a21af5e9 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:02.115900 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dc2320ad-44b4-4845-944c-18c1a21af5e9 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:02.116657 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dc2320ad-44b4-4845-944c-18c1a21af5e9 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:02.117617 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dc2320ad-44b4-4845-944c-18c1a21af5e9 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:02.118259 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dc2320ad-44b4-4845-944c-18c1a21af5e9 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:02.118858 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dc2320ad-44b4-4845-944c-18c1a21af5e9 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:02.809926 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c5b0e15d-8c0c-4ef8-aaca-1cbde4176b23 tempest-SecurityGroupRulesTestJSON-1778299432 tempest-SecurityGroupRulesTestJSON-1778299432-project] 10.222.0.61 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.903643 Aug 31 16:04:02.820397 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1047/2107] 10.222.0.61 () {60 vars in 1195 bytes} [Wed Aug 31 16:04:00 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1915 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:04:02.826284 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2a693f8e-9f59-4491-b324-69fe050a39dc tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:02.826615 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2a693f8e-9f59-4491-b324-69fe050a39dc tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6e82c98f-d644-4464-aca0-13901e551aa4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:02.857053 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2a693f8e-9f59-4491-b324-69fe050a39dc tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:02.857426 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2a693f8e-9f59-4491-b324-69fe050a39dc tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:02.857870 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2a693f8e-9f59-4491-b324-69fe050a39dc tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:02.884204 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2a693f8e-9f59-4491-b324-69fe050a39dc tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:02.885901 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2a693f8e-9f59-4491-b324-69fe050a39dc tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:02.888247 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2a693f8e-9f59-4491-b324-69fe050a39dc tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:03.316830 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-dc2320ad-44b4-4845-944c-18c1a21af5e9 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ccd03a4aa84f93bc26b438e1468f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a9f3fcc4b445349e5c66ff712e8598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:03.331138 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-dc2320ad-44b4-4845-944c-18c1a21af5e9 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/servers/007aba90-0e41-45d6-97f2-2d20b29d4296" status: 200 len: 1308 microversion: 2.1 time: 1.245450 Aug 31 16:04:03.334185 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1061/2108] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:02 2022] GET /compute/v2.1/servers/007aba90-0e41-45d6-97f2-2d20b29d4296 => generated 1308 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:03.366500 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a1ba3021-8947-4cc9-b59c-f97487df2645 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:03.367333 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a1ba3021-8947-4cc9-b59c-f97487df2645 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 006771fc-9da9-4b78-9fad-f4b72c311fd5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:03.389298 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a1ba3021-8947-4cc9-b59c-f97487df2645 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:03.391791 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a1ba3021-8947-4cc9-b59c-f97487df2645 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:03.393398 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a1ba3021-8947-4cc9-b59c-f97487df2645 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:03.395122 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a1ba3021-8947-4cc9-b59c-f97487df2645 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:03.397967 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a1ba3021-8947-4cc9-b59c-f97487df2645 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:03.400822 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a1ba3021-8947-4cc9-b59c-f97487df2645 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:03.538916 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2a693f8e-9f59-4491-b324-69fe050a39dc tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:03.558156 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2a693f8e-9f59-4491-b324-69fe050a39dc tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4" status: 200 len: 1469 microversion: 2.1 time: 0.726687 Aug 31 16:04:03.560737 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1048/2109] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:02 2022] GET /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4 => generated 1469 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:03.576589 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-532c3def-3b6b-4796-a5b2-62193c15c5bc tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:03.577711 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-532c3def-3b6b-4796-a5b2-62193c15c5bc tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: dd702273-095b-4d44-8d1b-3d90f7833d5f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:03.588228 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-532c3def-3b6b-4796-a5b2-62193c15c5bc tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:03.595659 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-532c3def-3b6b-4796-a5b2-62193c15c5bc tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:03.596403 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-532c3def-3b6b-4796-a5b2-62193c15c5bc tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:03.597427 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-532c3def-3b6b-4796-a5b2-62193c15c5bc tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:03.598071 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-532c3def-3b6b-4796-a5b2-62193c15c5bc tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:03.598675 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-532c3def-3b6b-4796-a5b2-62193c15c5bc tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:04.343457 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-532c3def-3b6b-4796-a5b2-62193c15c5bc tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:04.353378 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-532c3def-3b6b-4796-a5b2-62193c15c5bc tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f" status: 200 len: 1392 microversion: 2.1 time: 0.791328 Aug 31 16:04:04.371532 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1049/2110] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:03 2022] GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f => generated 1392 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:04.377983 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-8328e973-282f-474f-9a99-e4f91636aa99 req-ca21f169-5019-4466-9796-d3b3cbeda90c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e82c98f-d644-4464-aca0-13901e551aa4", "name": "network-vif-plugged", "status": "completed", "tag": "0dddc681-0580-40ec-b2fe-b4af40412267"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:04:04.406497 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-8328e973-282f-474f-9a99-e4f91636aa99 req-ca21f169-5019-4466-9796-d3b3cbeda90c service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:04.408133 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-8328e973-282f-474f-9a99-e4f91636aa99 req-ca21f169-5019-4466-9796-d3b3cbeda90c service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:04.409789 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-8328e973-282f-474f-9a99-e4f91636aa99 req-ca21f169-5019-4466-9796-d3b3cbeda90c service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:04.459990 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-8328e973-282f-474f-9a99-e4f91636aa99 req-ca21f169-5019-4466-9796-d3b3cbeda90c service nova] Creating event network-vif-plugged:0dddc681-0580-40ec-b2fe-b4af40412267 for instance 6e82c98f-d644-4464-aca0-13901e551aa4 on n-h1-850499-9 Aug 31 16:04:04.474866 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [req-8328e973-282f-474f-9a99-e4f91636aa99 req-ca21f169-5019-4466-9796-d3b3cbeda90c service nova] Instance 6e82c98f-d644-4464-aca0-13901e551aa4 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850499-9'} {{(pid=122257) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 31 16:04:04.489158 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-8328e973-282f-474f-9a99-e4f91636aa99 req-ca21f169-5019-4466-9796-d3b3cbeda90c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115620 Aug 31 16:04:04.494888 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1050/2111] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:04:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:04:04.501666 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-387ddf82-a4cc-45cf-bcd4-947711782b35 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1952429629", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["44f1ab8f-3a6c-41f3-b9fd-7f8aa243bcfa"]}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:04:04.591968 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-387ddf82-a4cc-45cf-bcd4-947711782b35 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] validate_networks() for None {{(pid=122257) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:04:04.660714 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a1ba3021-8947-4cc9-b59c-f97487df2645 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:04.677597 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a1ba3021-8947-4cc9-b59c-f97487df2645 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:04.679302 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a1ba3021-8947-4cc9-b59c-f97487df2645 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:04.680829 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a1ba3021-8947-4cc9-b59c-f97487df2645 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5" status: 200 len: 1477 microversion: 2.25 time: 1.345532 Aug 31 16:04:04.696029 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1062/2112] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:04:03 2022] GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5 => generated 1477 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:04:04.706473 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d140ebee-1596-4bed-adcc-f097028072d5 tempest-SecurityGroupRulesTestJSON-1778299432 tempest-SecurityGroupRulesTestJSON-1778299432-project] Action: 'create', calling method: .version_select at 0x7f5ae9282c10>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-534659414", "description": "tempest-description-1981740734"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:04:05.441652 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-387ddf82-a4cc-45cf-bcd4-947711782b35 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:04:05.443347 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-387ddf82-a4cc-45cf-bcd4-947711782b35 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:04:05.460282 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-387ddf82-a4cc-45cf-bcd4-947711782b35 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:04:05.461359 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-387ddf82-a4cc-45cf-bcd4-947711782b35 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:04:05.462238 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-387ddf82-a4cc-45cf-bcd4-947711782b35 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:04:05.520998 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-387ddf82-a4cc-45cf-bcd4-947711782b35 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:05.523108 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-387ddf82-a4cc-45cf-bcd4-947711782b35 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:05.524161 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-387ddf82-a4cc-45cf-bcd4-947711782b35 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:05.534365 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-387ddf82-a4cc-45cf-bcd4-947711782b35 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:05.535905 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-387ddf82-a4cc-45cf-bcd4-947711782b35 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:05.538280 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-387ddf82-a4cc-45cf-bcd4-947711782b35 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:05.616734 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-387ddf82-a4cc-45cf-bcd4-947711782b35 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Getting quotas for project 7fa2effd15e440598752264e49d2457d. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:04:05.638938 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-387ddf82-a4cc-45cf-bcd4-947711782b35 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Getting quotas for user 547d88df13034daaad50c3582c7cc3b3 and project 7fa2effd15e440598752264e49d2457d. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:04:05.679066 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-387ddf82-a4cc-45cf-bcd4-947711782b35 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Going to run 1 instances... {{(pid=122257) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:04:05.682666 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-387ddf82-a4cc-45cf-bcd4-947711782b35 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 9e504a13-2fea-4da7-880d-b1782f9c5053] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:04:05.737339 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d140ebee-1596-4bed-adcc-f097028072d5 tempest-SecurityGroupRulesTestJSON-1778299432 tempest-SecurityGroupRulesTestJSON-1778299432-project] 10.222.0.61 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.039161 Aug 31 16:04:05.740316 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1063/2113] 10.222.0.61 () {60 vars in 1180 bytes} [Wed Aug 31 16:04:04 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:04:05.757890 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6fd1fe28-841e-4d44-9e19-59b78c2ddbe0 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:05.763917 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6fd1fe28-841e-4d44-9e19-59b78c2ddbe0 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: 007aba90-0e41-45d6-97f2-2d20b29d4296] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:05.795918 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6fd1fe28-841e-4d44-9e19-59b78c2ddbe0 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:05.797215 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6fd1fe28-841e-4d44-9e19-59b78c2ddbe0 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:05.800195 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6fd1fe28-841e-4d44-9e19-59b78c2ddbe0 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:05.801871 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6fd1fe28-841e-4d44-9e19-59b78c2ddbe0 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:05.805103 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6fd1fe28-841e-4d44-9e19-59b78c2ddbe0 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:05.809987 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6fd1fe28-841e-4d44-9e19-59b78c2ddbe0 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:05.850691 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-387ddf82-a4cc-45cf-bcd4-947711782b35 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.345438 Aug 31 16:04:05.851727 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1051/2114] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:04:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1356 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:04:05.866858 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7a4bf595-3b72-4388-8076-bb3672a264d5 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:05.869350 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7a4bf595-3b72-4388-8076-bb3672a264d5 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6e82c98f-d644-4464-aca0-13901e551aa4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:05.904981 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7a4bf595-3b72-4388-8076-bb3672a264d5 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:05.908794 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7a4bf595-3b72-4388-8076-bb3672a264d5 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:05.911601 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7a4bf595-3b72-4388-8076-bb3672a264d5 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:05.914581 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7a4bf595-3b72-4388-8076-bb3672a264d5 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:05.916239 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7a4bf595-3b72-4388-8076-bb3672a264d5 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:05.918200 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7a4bf595-3b72-4388-8076-bb3672a264d5 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:06.289804 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-6fd1fe28-841e-4d44-9e19-59b78c2ddbe0 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ccd03a4aa84f93bc26b438e1468f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a9f3fcc4b445349e5c66ff712e8598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:06.292170 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=100 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:04:06.312070 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7a4bf595-3b72-4388-8076-bb3672a264d5 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:06.316821 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6fd1fe28-841e-4d44-9e19-59b78c2ddbe0 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/servers/007aba90-0e41-45d6-97f2-2d20b29d4296" status: 200 len: 1308 microversion: 2.1 time: 0.574933 Aug 31 16:04:06.317650 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1064/2115] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:05 2022] GET /compute/v2.1/servers/007aba90-0e41-45d6-97f2-2d20b29d4296 => generated 1308 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:06.331447 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-226cf06a-5090-4cf0-9d55-0464b4e3b47f tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:06.332572 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-226cf06a-5090-4cf0-9d55-0464b4e3b47f tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] [instance: 006771fc-9da9-4b78-9fad-f4b72c311fd5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:06.337018 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7a4bf595-3b72-4388-8076-bb3672a264d5 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4" status: 200 len: 1461 microversion: 2.1 time: 0.482750 Aug 31 16:04:06.344025 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-226cf06a-5090-4cf0-9d55-0464b4e3b47f tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:06.344792 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-226cf06a-5090-4cf0-9d55-0464b4e3b47f tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:06.345408 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-226cf06a-5090-4cf0-9d55-0464b4e3b47f tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:06.347037 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-226cf06a-5090-4cf0-9d55-0464b4e3b47f tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:06.351923 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1052/2116] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:05 2022] GET /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4 => generated 1461 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:06.353799 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-226cf06a-5090-4cf0-9d55-0464b4e3b47f tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:06.354463 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-226cf06a-5090-4cf0-9d55-0464b4e3b47f tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:06.357800 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4cf38246-4055-405a-a19e-2e9c11905ff3 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "55cf8a8b-0468-43a7-9c28-dcf5921a6af5"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:04:06.366322 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4cf38246-4055-405a-a19e-2e9c11905ff3 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: d8590729-e3da-4e04-9daa-7e04a3d88068] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:06.383135 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4cf38246-4055-405a-a19e-2e9c11905ff3 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:06.383669 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4cf38246-4055-405a-a19e-2e9c11905ff3 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:06.384119 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4cf38246-4055-405a-a19e-2e9c11905ff3 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:06.384853 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4cf38246-4055-405a-a19e-2e9c11905ff3 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:06.385324 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4cf38246-4055-405a-a19e-2e9c11905ff3 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:06.385761 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4cf38246-4055-405a-a19e-2e9c11905ff3 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:06.738382 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-226cf06a-5090-4cf0-9d55-0464b4e3b47f tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lazy-loading 'services' on Instance uuid 006771fc-9da9-4b78-9fad-f4b72c311fd5 {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:04:06.773516 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-226cf06a-5090-4cf0-9d55-0464b4e3b47f tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5" status: 200 len: 1969 microversion: 2.25 time: 0.454010 Aug 31 16:04:06.777946 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1065/2117] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:04:06 2022] GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5 => generated 1969 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:04:06.792297 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-40b73d8b-0d53-45e6-87c8-31559e33991d tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:06.794676 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-40b73d8b-0d53-45e6-87c8-31559e33991d tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: dd702273-095b-4d44-8d1b-3d90f7833d5f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:06.813433 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-40b73d8b-0d53-45e6-87c8-31559e33991d tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:06.817720 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-40b73d8b-0d53-45e6-87c8-31559e33991d tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:06.818466 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-40b73d8b-0d53-45e6-87c8-31559e33991d tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:06.820720 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-40b73d8b-0d53-45e6-87c8-31559e33991d tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:06.822942 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-40b73d8b-0d53-45e6-87c8-31559e33991d tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:06.824644 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-40b73d8b-0d53-45e6-87c8-31559e33991d tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:06.911986 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4cf38246-4055-405a-a19e-2e9c11905ff3 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "POST /compute/v2.1/servers/d8590729-e3da-4e04-9daa-7e04a3d88068/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.557996 Aug 31 16:04:06.918005 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1053/2118] 10.222.0.61 () {60 vars in 1323 bytes} [Wed Aug 31 16:04:06 2022] POST /compute/v2.1/servers/d8590729-e3da-4e04-9daa-7e04a3d88068/os-volume_attachments => generated 194 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:04:06.932278 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4dd4611b-7bce-446a-9e8b-b5cdffd5866b tempest-SecurityGroupRulesTestJSON-1778299432 tempest-SecurityGroupRulesTestJSON-1778299432-project] Action: 'create', calling method: .version_select at 0x7f5ae8cb2d30>, body: {"security_group_rule": {"parent_group_id": "4967e459-06f8-4953-b4ea-aee42792f350", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:04:07.226169 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-40b73d8b-0d53-45e6-87c8-31559e33991d tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:07.259662 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-40b73d8b-0d53-45e6-87c8-31559e33991d tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f" status: 200 len: 1392 microversion: 2.1 time: 0.468787 Aug 31 16:04:07.274376 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1066/2119] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:06 2022] GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f => generated 1392 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:07.284866 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4a304325-e034-4789-b07d-217d64f169ab tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:07.285499 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4a304325-e034-4789-b07d-217d64f169ab tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 9e504a13-2fea-4da7-880d-b1782f9c5053] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:07.314520 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4a304325-e034-4789-b07d-217d64f169ab tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:07.322111 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4a304325-e034-4789-b07d-217d64f169ab tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:07.322669 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4a304325-e034-4789-b07d-217d64f169ab tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:07.323433 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4a304325-e034-4789-b07d-217d64f169ab tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:07.326017 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4a304325-e034-4789-b07d-217d64f169ab tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:07.326491 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4a304325-e034-4789-b07d-217d64f169ab tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:07.585820 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-4a304325-e034-4789-b07d-217d64f169ab tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:07.631632 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4a304325-e034-4789-b07d-217d64f169ab tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/9e504a13-2fea-4da7-880d-b1782f9c5053" status: 200 len: 1213 microversion: 2.1 time: 0.366087 Aug 31 16:04:07.646851 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1067/2120] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:07 2022] GET /compute/v2.1/servers/9e504a13-2fea-4da7-880d-b1782f9c5053 => generated 1213 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:07.686490 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-709c9dae-17f8-402a-b33e-441efd581dd8 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:07.697891 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-709c9dae-17f8-402a-b33e-441efd581dd8 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6e82c98f-d644-4464-aca0-13901e551aa4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:07.718539 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-709c9dae-17f8-402a-b33e-441efd581dd8 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:07.720559 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-709c9dae-17f8-402a-b33e-441efd581dd8 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:07.722315 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-709c9dae-17f8-402a-b33e-441efd581dd8 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:07.724968 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-709c9dae-17f8-402a-b33e-441efd581dd8 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:07.726501 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-709c9dae-17f8-402a-b33e-441efd581dd8 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:07.727699 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-709c9dae-17f8-402a-b33e-441efd581dd8 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:07.981783 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4dd4611b-7bce-446a-9e8b-b5cdffd5866b tempest-SecurityGroupRulesTestJSON-1778299432 tempest-SecurityGroupRulesTestJSON-1778299432-project] 10.222.0.61 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 1.067437 Aug 31 16:04:07.982832 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1054/2121] 10.222.0.61 () {60 vars in 1195 bytes} [Wed Aug 31 16:04:06 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:04:07.988420 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-1aeb530a-3f79-4f9b-9fe0-f88966e39006 req-888062a4-bda7-43d4-9774-fa01a5a0dd62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "007aba90-0e41-45d6-97f2-2d20b29d4296", "name": "network-vif-plugged", "status": "completed", "tag": "884c2568-ad01-48ba-ac30-4fc6751c3295"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:04:08.018784 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-1aeb530a-3f79-4f9b-9fe0-f88966e39006 req-888062a4-bda7-43d4-9774-fa01a5a0dd62 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:08.019713 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-1aeb530a-3f79-4f9b-9fe0-f88966e39006 req-888062a4-bda7-43d4-9774-fa01a5a0dd62 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:08.020956 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-1aeb530a-3f79-4f9b-9fe0-f88966e39006 req-888062a4-bda7-43d4-9774-fa01a5a0dd62 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:08.034288 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-1aeb530a-3f79-4f9b-9fe0-f88966e39006 req-888062a4-bda7-43d4-9774-fa01a5a0dd62 service nova] Creating event network-vif-plugged:884c2568-ad01-48ba-ac30-4fc6751c3295 for instance 007aba90-0e41-45d6-97f2-2d20b29d4296 on n-h2-850499-9 Aug 31 16:04:08.040275 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-1aeb530a-3f79-4f9b-9fe0-f88966e39006 req-888062a4-bda7-43d4-9774-fa01a5a0dd62 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055954 Aug 31 16:04:08.045679 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1055/2122] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:04:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:04:08.052021 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-01bf1000-67da-467b-a5b0-88d0314e45b0 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:08.053131 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-01bf1000-67da-467b-a5b0-88d0314e45b0 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] [instance: 006771fc-9da9-4b78-9fad-f4b72c311fd5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:08.061261 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-01bf1000-67da-467b-a5b0-88d0314e45b0 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:08.062330 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-01bf1000-67da-467b-a5b0-88d0314e45b0 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:08.063074 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-01bf1000-67da-467b-a5b0-88d0314e45b0 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:08.064172 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-01bf1000-67da-467b-a5b0-88d0314e45b0 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:08.064889 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-01bf1000-67da-467b-a5b0-88d0314e45b0 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:08.065564 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-01bf1000-67da-467b-a5b0-88d0314e45b0 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:08.100221 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-709c9dae-17f8-402a-b33e-441efd581dd8 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:08.134287 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-709c9dae-17f8-402a-b33e-441efd581dd8 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4" status: 200 len: 1461 microversion: 2.1 time: 0.483214 Aug 31 16:04:08.137273 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1068/2123] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:07 2022] GET /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4 => generated 1461 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:08.149346 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c0e3d99f-1851-47f2-94fc-13c1c7826a7f tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:08.150608 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c0e3d99f-1851-47f2-94fc-13c1c7826a7f tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: 007aba90-0e41-45d6-97f2-2d20b29d4296] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:08.168698 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c0e3d99f-1851-47f2-94fc-13c1c7826a7f tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:08.174503 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c0e3d99f-1851-47f2-94fc-13c1c7826a7f tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:08.175274 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c0e3d99f-1851-47f2-94fc-13c1c7826a7f tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:08.176223 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c0e3d99f-1851-47f2-94fc-13c1c7826a7f tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:08.177986 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c0e3d99f-1851-47f2-94fc-13c1c7826a7f tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:08.178725 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c0e3d99f-1851-47f2-94fc-13c1c7826a7f tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:08.299462 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-01bf1000-67da-467b-a5b0-88d0314e45b0 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lazy-loading 'services' on Instance uuid 006771fc-9da9-4b78-9fad-f4b72c311fd5 {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:04:08.335682 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-01bf1000-67da-467b-a5b0-88d0314e45b0 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5" status: 200 len: 1969 microversion: 2.25 time: 0.287868 Aug 31 16:04:08.336748 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1056/2124] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:04:08 2022] GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5 => generated 1969 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:04:08.360643 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8fd475c8-8ecc-4ef9-8ac3-8462255acb84 tempest-SecurityGroupRulesTestJSON-1778299432 tempest-SecurityGroupRulesTestJSON-1778299432-project] Action: 'create', calling method: .version_select at 0x7f5ae8c39160>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-710246971", "description": "tempest-description-1110644981"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:04:08.591835 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c0e3d99f-1851-47f2-94fc-13c1c7826a7f tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ccd03a4aa84f93bc26b438e1468f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a9f3fcc4b445349e5c66ff712e8598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:08.600131 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c0e3d99f-1851-47f2-94fc-13c1c7826a7f tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/servers/007aba90-0e41-45d6-97f2-2d20b29d4296" status: 200 len: 1308 microversion: 2.1 time: 0.461493 Aug 31 16:04:08.600736 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1069/2125] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:08 2022] GET /compute/v2.1/servers/007aba90-0e41-45d6-97f2-2d20b29d4296 => generated 1308 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:08.616429 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2c9f3e5a-f04a-4efc-aa15-4061b5b64e80 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Action: 'create', calling method: .version_select at 0x7f5aea80e700>, body: {"keypair": {"name": "tempest-keypair-364087997", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLlqVQcwig+7d5/hEOKqkYzgbx6q+WT7p/ic4dJSPSHDZI2KsIVMhjKbU9ryJgHMj5tuZXH2FUTNVSwfKk7Kd2s1qVXUcrRigcyK3451YK95fvXt5yyLBKTfMGtvx8bcNw=="}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:04:08.672822 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-2c9f3e5a-f04a-4efc-aa15-4061b5b64e80 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Getting quotas for project 55ea476c41904e458bae79e7dad5d654. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:04:08.688178 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-2c9f3e5a-f04a-4efc-aa15-4061b5b64e80 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Getting quotas for user 0a552442b7e94406b1689baf7a23fa52 and project 55ea476c41904e458bae79e7dad5d654. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:04:08.749158 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2c9f3e5a-f04a-4efc-aa15-4061b5b64e80 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.147316 Aug 31 16:04:08.755482 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1070/2126] 10.222.0.61 () {60 vars in 1159 bytes} [Wed Aug 31 16:04:08 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:04:08.766282 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-42f5fbab-3cc4-4f67-8915-33caea487f89 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:08.773130 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-42f5fbab-3cc4-4f67-8915-33caea487f89 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: dd702273-095b-4d44-8d1b-3d90f7833d5f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:08.794181 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42f5fbab-3cc4-4f67-8915-33caea487f89 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:08.796674 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42f5fbab-3cc4-4f67-8915-33caea487f89 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:08.798210 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42f5fbab-3cc4-4f67-8915-33caea487f89 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:08.799376 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42f5fbab-3cc4-4f67-8915-33caea487f89 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:08.800298 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42f5fbab-3cc4-4f67-8915-33caea487f89 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:08.801021 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42f5fbab-3cc4-4f67-8915-33caea487f89 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:09.142196 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8fd475c8-8ecc-4ef9-8ac3-8462255acb84 tempest-SecurityGroupRulesTestJSON-1778299432 tempest-SecurityGroupRulesTestJSON-1778299432-project] 10.222.0.61 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.796190 Aug 31 16:04:09.143244 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1057/2127] 10.222.0.61 () {60 vars in 1180 bytes} [Wed Aug 31 16:04:08 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:04:09.154813 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6c9949fb-dd91-4df6-afaa-937622d0d163 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:09.162829 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6c9949fb-dd91-4df6-afaa-937622d0d163 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:09.165076 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6c9949fb-dd91-4df6-afaa-937622d0d163 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:09.166862 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6c9949fb-dd91-4df6-afaa-937622d0d163 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:09.169427 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6c9949fb-dd91-4df6-afaa-937622d0d163 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:09.171256 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6c9949fb-dd91-4df6-afaa-937622d0d163 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:09.172488 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6c9949fb-dd91-4df6-afaa-937622d0d163 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:09.248081 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6c9949fb-dd91-4df6-afaa-937622d0d163 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] 10.222.0.61 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.100487 Aug 31 16:04:09.249718 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1058/2128] 10.222.0.61 () {60 vars in 1217 bytes} [Wed Aug 31 16:04:09 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 16:04:09.273188 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-88531426-7f52-45e4-9391-92ee31b5de53 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:09.275113 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-88531426-7f52-45e4-9391-92ee31b5de53 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 9e504a13-2fea-4da7-880d-b1782f9c5053] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:09.292832 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-88531426-7f52-45e4-9391-92ee31b5de53 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:09.294009 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-88531426-7f52-45e4-9391-92ee31b5de53 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:09.294485 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-88531426-7f52-45e4-9391-92ee31b5de53 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:09.295234 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-88531426-7f52-45e4-9391-92ee31b5de53 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:09.298564 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-88531426-7f52-45e4-9391-92ee31b5de53 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:09.299037 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-88531426-7f52-45e4-9391-92ee31b5de53 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:09.472110 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-42f5fbab-3cc4-4f67-8915-33caea487f89 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:09.492257 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-42f5fbab-3cc4-4f67-8915-33caea487f89 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f" status: 200 len: 1392 microversion: 2.1 time: 0.730112 Aug 31 16:04:09.492858 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-88531426-7f52-45e4-9391-92ee31b5de53 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:09.507004 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-88531426-7f52-45e4-9391-92ee31b5de53 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/9e504a13-2fea-4da7-880d-b1782f9c5053" status: 200 len: 1275 microversion: 2.1 time: 0.243937 Aug 31 16:04:09.508832 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1059/2129] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:09 2022] GET /compute/v2.1/servers/9e504a13-2fea-4da7-880d-b1782f9c5053 => generated 1275 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:09.515053 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-616f20ac-1c47-46bb-bfd9-62fcc960d209 tempest-SecurityGroupRulesTestJSON-1778299432 tempest-SecurityGroupRulesTestJSON-1778299432-project] Action: 'create', calling method: .version_select at 0x7f5ae8c4a8b0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-657959452", "description": "tempest-description-2006132118"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:04:09.518350 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1071/2130] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:08 2022] GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f => generated 1392 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:09.525707 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7dfdc92d-a25f-4cd0-8b4c-693d25287e09 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-850499-9", "block_migration": "auto"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:04:09.538540 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7dfdc92d-a25f-4cd0-8b4c-693d25287e09 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] [instance: 006771fc-9da9-4b78-9fad-f4b72c311fd5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:09.549584 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7dfdc92d-a25f-4cd0-8b4c-693d25287e09 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:09.550531 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7dfdc92d-a25f-4cd0-8b4c-693d25287e09 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:09.551207 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7dfdc92d-a25f-4cd0-8b4c-693d25287e09 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:09.552246 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7dfdc92d-a25f-4cd0-8b4c-693d25287e09 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:09.552926 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7dfdc92d-a25f-4cd0-8b4c-693d25287e09 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:09.553619 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7dfdc92d-a25f-4cd0-8b4c-693d25287e09 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:09.598087 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-7dfdc92d-a25f-4cd0-8b4c-693d25287e09 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lazy-loading 'flavor' on Instance uuid 006771fc-9da9-4b78-9fad-f4b72c311fd5 {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:04:09.634743 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7dfdc92d-a25f-4cd0-8b4c-693d25287e09 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] [instance: 006771fc-9da9-4b78-9fad-f4b72c311fd5] Going to try to live migrate instance to n-h1-850499-9 {{(pid=122256) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 31 16:04:10.200079 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-616f20ac-1c47-46bb-bfd9-62fcc960d209 tempest-SecurityGroupRulesTestJSON-1778299432 tempest-SecurityGroupRulesTestJSON-1778299432-project] 10.222.0.61 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.687958 Aug 31 16:04:10.201247 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1060/2131] 10.222.0.61 () {60 vars in 1180 bytes} [Wed Aug 31 16:04:09 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:04:10.213261 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8d3faef9-0c80-43db-9d1d-b6729d660402 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:10.213905 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8d3faef9-0c80-43db-9d1d-b6729d660402 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: 007aba90-0e41-45d6-97f2-2d20b29d4296] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:10.224811 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8d3faef9-0c80-43db-9d1d-b6729d660402 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:10.225332 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8d3faef9-0c80-43db-9d1d-b6729d660402 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:10.232006 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8d3faef9-0c80-43db-9d1d-b6729d660402 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:10.233011 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8d3faef9-0c80-43db-9d1d-b6729d660402 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:10.233672 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8d3faef9-0c80-43db-9d1d-b6729d660402 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:10.234312 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8d3faef9-0c80-43db-9d1d-b6729d660402 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:10.863035 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8d3faef9-0c80-43db-9d1d-b6729d660402 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ccd03a4aa84f93bc26b438e1468f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a9f3fcc4b445349e5c66ff712e8598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:10.877356 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8d3faef9-0c80-43db-9d1d-b6729d660402 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/servers/007aba90-0e41-45d6-97f2-2d20b29d4296" status: 200 len: 1308 microversion: 2.1 time: 0.671621 Aug 31 16:04:10.878820 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1061/2132] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:10 2022] GET /compute/v2.1/servers/007aba90-0e41-45d6-97f2-2d20b29d4296 => generated 1308 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:10.892802 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a17a48ea-4936-4ac1-a817-6501862f8a70 tempest-SecurityGroupRulesTestJSON-1778299432 tempest-SecurityGroupRulesTestJSON-1778299432-project] Action: 'create', calling method: .version_select at 0x7f5ae8c3cca0>, body: {"security_group_rule": {"parent_group_id": "4744aa8a-76c6-43f0-be5c-37418fd8e90c", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "8e4bc086-7d34-4eae-b5e1-0c7504c0f1b9"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:04:13.009517 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7dfdc92d-a25f-4cd0-8b4c-693d25287e09 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5/action" status: 202 len: 0 microversion: 2.25 time: 3.489469 Aug 31 16:04:13.010171 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1072/2133] 10.222.0.61 () {62 vars in 1319 bytes} [Wed Aug 31 16:04:09 2022] POST /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5/action => generated 0 bytes in 3491 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:04:13.021342 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2a1ef306-ee50-4ec9-9b8b-447384ae2551 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:13.022053 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2a1ef306-ee50-4ec9-9b8b-447384ae2551 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: dd702273-095b-4d44-8d1b-3d90f7833d5f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:13.076835 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2a1ef306-ee50-4ec9-9b8b-447384ae2551 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:13.078173 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2a1ef306-ee50-4ec9-9b8b-447384ae2551 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:13.078864 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2a1ef306-ee50-4ec9-9b8b-447384ae2551 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:13.080268 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2a1ef306-ee50-4ec9-9b8b-447384ae2551 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:13.081155 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2a1ef306-ee50-4ec9-9b8b-447384ae2551 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:13.081890 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2a1ef306-ee50-4ec9-9b8b-447384ae2551 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:13.451053 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-2a1ef306-ee50-4ec9-9b8b-447384ae2551 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:13.478850 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2a1ef306-ee50-4ec9-9b8b-447384ae2551 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f" status: 200 len: 1392 microversion: 2.1 time: 0.462841 Aug 31 16:04:13.498060 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a17a48ea-4936-4ac1-a817-6501862f8a70 tempest-SecurityGroupRulesTestJSON-1778299432 tempest-SecurityGroupRulesTestJSON-1778299432-project] 10.222.0.61 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 2.616756 Aug 31 16:04:13.499424 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1062/2135] 10.222.0.61 () {60 vars in 1195 bytes} [Wed Aug 31 16:04:10 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 2619 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:04:13.506195 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1073/2135] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:13 2022] GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f => generated 1392 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:13.515793 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-048117f0-4839-4a77-b47b-43024cf2b524 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:13.517916 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-048117f0-4839-4a77-b47b-43024cf2b524 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 9e504a13-2fea-4da7-880d-b1782f9c5053] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:13.530717 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-99ba0b70-238a-488f-9001-07313704a1df tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:13.531456 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-99ba0b70-238a-488f-9001-07313704a1df tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: 007aba90-0e41-45d6-97f2-2d20b29d4296] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:13.555427 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-99ba0b70-238a-488f-9001-07313704a1df tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:13.556486 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-99ba0b70-238a-488f-9001-07313704a1df tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:13.557031 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-99ba0b70-238a-488f-9001-07313704a1df tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:13.560311 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-99ba0b70-238a-488f-9001-07313704a1df tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:13.560813 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-99ba0b70-238a-488f-9001-07313704a1df tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:13.561258 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-99ba0b70-238a-488f-9001-07313704a1df tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:13.569855 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-048117f0-4839-4a77-b47b-43024cf2b524 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:13.574210 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-048117f0-4839-4a77-b47b-43024cf2b524 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:13.592844 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-048117f0-4839-4a77-b47b-43024cf2b524 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:13.596179 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-048117f0-4839-4a77-b47b-43024cf2b524 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:13.600196 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-048117f0-4839-4a77-b47b-43024cf2b524 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:13.602711 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-048117f0-4839-4a77-b47b-43024cf2b524 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:14.483984 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-048117f0-4839-4a77-b47b-43024cf2b524 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:14.507160 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-048117f0-4839-4a77-b47b-43024cf2b524 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/9e504a13-2fea-4da7-880d-b1782f9c5053" status: 200 len: 1317 microversion: 2.1 time: 1.003808 Aug 31 16:04:14.511008 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1063/2136] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:13 2022] GET /compute/v2.1/servers/9e504a13-2fea-4da7-880d-b1782f9c5053 => generated 1317 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:14.524446 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b7f7a75d-73cb-41bd-877b-49f232e5fa7d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:14.525494 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b7f7a75d-73cb-41bd-877b-49f232e5fa7d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 006771fc-9da9-4b78-9fad-f4b72c311fd5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:14.534337 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b7f7a75d-73cb-41bd-877b-49f232e5fa7d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:14.535409 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b7f7a75d-73cb-41bd-877b-49f232e5fa7d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:14.537115 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b7f7a75d-73cb-41bd-877b-49f232e5fa7d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:14.538392 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b7f7a75d-73cb-41bd-877b-49f232e5fa7d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:14.539255 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b7f7a75d-73cb-41bd-877b-49f232e5fa7d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:14.540636 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b7f7a75d-73cb-41bd-877b-49f232e5fa7d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:14.552402 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-99ba0b70-238a-488f-9001-07313704a1df tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ccd03a4aa84f93bc26b438e1468f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a9f3fcc4b445349e5c66ff712e8598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:14.571835 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-99ba0b70-238a-488f-9001-07313704a1df tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/servers/007aba90-0e41-45d6-97f2-2d20b29d4296" status: 200 len: 1488 microversion: 2.1 time: 1.053625 Aug 31 16:04:14.574308 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1074/2137] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:13 2022] GET /compute/v2.1/servers/007aba90-0e41-45d6-97f2-2d20b29d4296 => generated 1488 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:14.599721 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8c91438f-44af-4b5a-9807-9df1a868cb40 tempest-SecurityGroupRulesTestJSON-1778299432 tempest-SecurityGroupRulesTestJSON-1778299432-project] Action: 'create', calling method: .version_select at 0x7f5ae9751a60>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1004578577", "description": "tempest-description-1698699015"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:04:14.974272 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b7f7a75d-73cb-41bd-877b-49f232e5fa7d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:15.001199 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b7f7a75d-73cb-41bd-877b-49f232e5fa7d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:15.015617 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b7f7a75d-73cb-41bd-877b-49f232e5fa7d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:15.017064 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b7f7a75d-73cb-41bd-877b-49f232e5fa7d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5" status: 200 len: 1487 microversion: 2.25 time: 0.503598 Aug 31 16:04:15.021431 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1064/2138] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:04:14 2022] GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5 => generated 1487 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:04:15.037555 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f39ce37c-c026-4c10-8997-d5cdaca3fbb5 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:15.038674 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f39ce37c-c026-4c10-8997-d5cdaca3fbb5 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: dd702273-095b-4d44-8d1b-3d90f7833d5f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:15.057394 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f39ce37c-c026-4c10-8997-d5cdaca3fbb5 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:15.057909 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f39ce37c-c026-4c10-8997-d5cdaca3fbb5 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:15.058881 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f39ce37c-c026-4c10-8997-d5cdaca3fbb5 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:15.065003 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f39ce37c-c026-4c10-8997-d5cdaca3fbb5 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:15.065684 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f39ce37c-c026-4c10-8997-d5cdaca3fbb5 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:15.066156 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f39ce37c-c026-4c10-8997-d5cdaca3fbb5 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:15.141786 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:04:15.510340 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8c91438f-44af-4b5a-9807-9df1a868cb40 tempest-SecurityGroupRulesTestJSON-1778299432 tempest-SecurityGroupRulesTestJSON-1778299432-project] 10.222.0.61 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.934164 Aug 31 16:04:15.511608 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1075/2139] 10.222.0.61 () {60 vars in 1180 bytes} [Wed Aug 31 16:04:14 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:04:15.518565 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c32899d7-2be0-4f55-807b-d80ab635c03f tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1950740942"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:04:15.525250 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c32899d7-2be0-4f55-807b-d80ab635c03f tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: 007aba90-0e41-45d6-97f2-2d20b29d4296] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:15.545773 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c32899d7-2be0-4f55-807b-d80ab635c03f tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:15.546799 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c32899d7-2be0-4f55-807b-d80ab635c03f tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:15.547447 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c32899d7-2be0-4f55-807b-d80ab635c03f tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:15.548399 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c32899d7-2be0-4f55-807b-d80ab635c03f tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:15.549213 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c32899d7-2be0-4f55-807b-d80ab635c03f tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:15.549823 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c32899d7-2be0-4f55-807b-d80ab635c03f tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:15.660618 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=6 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:04:16.097432 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c32899d7-2be0-4f55-807b-d80ab635c03f tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "POST /compute/v2.1/servers/007aba90-0e41-45d6-97f2-2d20b29d4296/action" status: 202 len: 0 microversion: 2.1 time: 0.582400 Aug 31 16:04:16.100637 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1076/2140] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:04:15 2022] POST /compute/v2.1/servers/007aba90-0e41-45d6-97f2-2d20b29d4296/action => generated 0 bytes in 588 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 31 16:04:16.120393 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0b115b52-360f-454d-a236-903acabdeac1 tempest-SecurityGroupRulesTestJSON-1778299432 tempest-SecurityGroupRulesTestJSON-1778299432-project] Action: 'create', calling method: .version_select at 0x7f5ae986c430>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1858388838", "description": "tempest-description-26541273"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:04:16.493683 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f39ce37c-c026-4c10-8997-d5cdaca3fbb5 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:16.515648 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f39ce37c-c026-4c10-8997-d5cdaca3fbb5 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f" status: 200 len: 1392 microversion: 2.1 time: 1.490981 Aug 31 16:04:16.520951 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1065/2141] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:15 2022] GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f => generated 1392 bytes in 1495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:16.554481 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4f7c6a39-d53c-43fe-aa76-16597a75c6d4 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:16.558715 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4f7c6a39-d53c-43fe-aa76-16597a75c6d4 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 9e504a13-2fea-4da7-880d-b1782f9c5053] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:16.587269 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4f7c6a39-d53c-43fe-aa76-16597a75c6d4 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:16.589719 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4f7c6a39-d53c-43fe-aa76-16597a75c6d4 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:16.591778 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4f7c6a39-d53c-43fe-aa76-16597a75c6d4 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:16.609217 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4f7c6a39-d53c-43fe-aa76-16597a75c6d4 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:16.611102 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4f7c6a39-d53c-43fe-aa76-16597a75c6d4 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:16.614192 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4f7c6a39-d53c-43fe-aa76-16597a75c6d4 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:16.817889 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0b115b52-360f-454d-a236-903acabdeac1 tempest-SecurityGroupRulesTestJSON-1778299432 tempest-SecurityGroupRulesTestJSON-1778299432-project] 10.222.0.61 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.714417 Aug 31 16:04:16.818877 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1077/2142] 10.222.0.61 () {60 vars in 1180 bytes} [Wed Aug 31 16:04:16 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:04:16.825624 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-55d52216-22c0-4ab1-8df2-44fbf4a43f44 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:16.827894 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-55d52216-22c0-4ab1-8df2-44fbf4a43f44 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 006771fc-9da9-4b78-9fad-f4b72c311fd5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:16.850686 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-55d52216-22c0-4ab1-8df2-44fbf4a43f44 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:16.854439 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-55d52216-22c0-4ab1-8df2-44fbf4a43f44 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:16.857261 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-55d52216-22c0-4ab1-8df2-44fbf4a43f44 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:16.858172 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-55d52216-22c0-4ab1-8df2-44fbf4a43f44 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:16.859196 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-55d52216-22c0-4ab1-8df2-44fbf4a43f44 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:16.864370 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-55d52216-22c0-4ab1-8df2-44fbf4a43f44 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:16.957881 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-4f7c6a39-d53c-43fe-aa76-16597a75c6d4 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:16.970357 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4f7c6a39-d53c-43fe-aa76-16597a75c6d4 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/9e504a13-2fea-4da7-880d-b1782f9c5053" status: 200 len: 1317 microversion: 2.1 time: 0.446321 Aug 31 16:04:16.975879 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1066/2143] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:16 2022] GET /compute/v2.1/servers/9e504a13-2fea-4da7-880d-b1782f9c5053 => generated 1317 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:16.985042 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a52d9666-4eee-4581-bd43-c6ff57257740 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '.version_select at 0x7f5ae8c4aee0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:17.068338 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a52d9666-4eee-4581-bd43-c6ff57257740 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/images/cc5491e8-7a29-4de4-8ca1-76f2ed80aed9" status: 200 len: 1414 microversion: 2.1 time: 0.090691 Aug 31 16:04:17.083931 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1067/2144] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:04:16 2022] GET /compute/v2.1/images/cc5491e8-7a29-4de4-8ca1-76f2ed80aed9 => generated 1414 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:17.095982 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-32413ca4-f02f-4dbe-95c6-9622766c0b21 tempest-MigrationsAdminTest-62329235 tempest-MigrationsAdminTest-62329235-project-admin] Calling method '.version_select at 0x7f5ae8c53e50>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:17.110874 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-32413ca4-f02f-4dbe-95c6-9622766c0b21 tempest-MigrationsAdminTest-62329235 tempest-MigrationsAdminTest-62329235-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:17.112021 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-32413ca4-f02f-4dbe-95c6-9622766c0b21 tempest-MigrationsAdminTest-62329235 tempest-MigrationsAdminTest-62329235-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:17.112565 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-32413ca4-f02f-4dbe-95c6-9622766c0b21 tempest-MigrationsAdminTest-62329235 tempest-MigrationsAdminTest-62329235-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:17.169772 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-32413ca4-f02f-4dbe-95c6-9622766c0b21 tempest-MigrationsAdminTest-62329235 tempest-MigrationsAdminTest-62329235-project-admin] 10.222.0.61 "GET /compute/v2.1/os-migrations" status: 200 len: 3872 microversion: 2.1 time: 0.084149 Aug 31 16:04:17.189532 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1068/2145] 10.222.0.61 () {58 vars in 1143 bytes} [Wed Aug 31 16:04:17 2022] GET /compute/v2.1/os-migrations => generated 3872 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:17.189532 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3becd115-4a27-447c-b168-d71441c71dbe tempest-SecurityGroupRulesTestJSON-1778299432 tempest-SecurityGroupRulesTestJSON-1778299432-project] Action: 'create', calling method: .version_select at 0x7f5ae8f12940>, body: {"security_group_rule": {"parent_group_id": "9e13a03d-e32a-43ce-a006-3795b8b1893c", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "2e96bd89-f112-45b4-8e74-e5710ec4aa56"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:04:17.493403 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-55d52216-22c0-4ab1-8df2-44fbf4a43f44 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:17.519368 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-55d52216-22c0-4ab1-8df2-44fbf4a43f44 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:17.522274 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-55d52216-22c0-4ab1-8df2-44fbf4a43f44 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:17.528630 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-55d52216-22c0-4ab1-8df2-44fbf4a43f44 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5" status: 200 len: 1487 microversion: 2.25 time: 0.707649 Aug 31 16:04:17.531976 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1078/2146] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:04:16 2022] GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5 => generated 1487 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:04:17.559005 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9fc5e23b-b51f-4432-b1d6-d5997dcf5397 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '.version_select at 0x7f5ae9357790>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:17.692474 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9fc5e23b-b51f-4432-b1d6-d5997dcf5397 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/images/cc5491e8-7a29-4de4-8ca1-76f2ed80aed9" status: 200 len: 1414 microversion: 2.1 time: 0.159182 Aug 31 16:04:17.693054 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1079/2147] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:04:17 2022] GET /compute/v2.1/images/cc5491e8-7a29-4de4-8ca1-76f2ed80aed9 => generated 1414 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:17.702726 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4b3883a2-a1da-4e05-afb0-560b00f59293 tempest-MigrationsAdminTest-62329235 tempest-MigrationsAdminTest-62329235-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:17.724297 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4b3883a2-a1da-4e05-afb0-560b00f59293 tempest-MigrationsAdminTest-62329235 tempest-MigrationsAdminTest-62329235-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.030169 Aug 31 16:04:17.725483 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1080/2148] 10.222.0.61 () {58 vars in 1137 bytes} [Wed Aug 31 16:04:17 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:04:17.731356 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4ed35aed-b59e-40f1-b772-aa333c83b1cf tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:17.736829 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4ed35aed-b59e-40f1-b772-aa333c83b1cf tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: dd702273-095b-4d44-8d1b-3d90f7833d5f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:17.762280 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4ed35aed-b59e-40f1-b772-aa333c83b1cf tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:17.764039 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4ed35aed-b59e-40f1-b772-aa333c83b1cf tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:17.764777 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4ed35aed-b59e-40f1-b772-aa333c83b1cf tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:17.765922 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4ed35aed-b59e-40f1-b772-aa333c83b1cf tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:17.766678 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4ed35aed-b59e-40f1-b772-aa333c83b1cf tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:17.767387 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4ed35aed-b59e-40f1-b772-aa333c83b1cf tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:18.257403 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-4ed35aed-b59e-40f1-b772-aa333c83b1cf tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:18.267337 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3becd115-4a27-447c-b168-d71441c71dbe tempest-SecurityGroupRulesTestJSON-1778299432 tempest-SecurityGroupRulesTestJSON-1778299432-project] 10.222.0.61 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 1.087016 Aug 31 16:04:18.267887 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4ed35aed-b59e-40f1-b772-aa333c83b1cf tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f" status: 200 len: 1392 microversion: 2.1 time: 0.540810 Aug 31 16:04:18.268186 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1081/2149] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:17 2022] GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f => generated 1392 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:18.282186 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1069/2150] 10.222.0.61 () {60 vars in 1195 bytes} [Wed Aug 31 16:04:17 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:04:18.286417 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-f17687e7-25f9-4df5-ae04-51b40a95b6a4 req-93481825-5326-4752-a413-2d1f1a17fd46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e504a13-2fea-4da7-880d-b1782f9c5053", "tag": "826d1d70-21bd-4629-a5dc-f0d355e78b2b"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:04:18.296345 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ff100d8d-a8e5-4e54-a544-6a87c8345ebd tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '.version_select at 0x7f5ae8c4aca0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:18.298527 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-f17687e7-25f9-4df5-ae04-51b40a95b6a4 req-93481825-5326-4752-a413-2d1f1a17fd46 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:18.299209 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-f17687e7-25f9-4df5-ae04-51b40a95b6a4 req-93481825-5326-4752-a413-2d1f1a17fd46 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:18.299851 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-f17687e7-25f9-4df5-ae04-51b40a95b6a4 req-93481825-5326-4752-a413-2d1f1a17fd46 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:18.322305 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-f17687e7-25f9-4df5-ae04-51b40a95b6a4 req-93481825-5326-4752-a413-2d1f1a17fd46 service nova] Creating event network-changed:826d1d70-21bd-4629-a5dc-f0d355e78b2b for instance 9e504a13-2fea-4da7-880d-b1782f9c5053 on n-h1-850499-9 Aug 31 16:04:18.334052 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-f17687e7-25f9-4df5-ae04-51b40a95b6a4 req-93481825-5326-4752-a413-2d1f1a17fd46 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051035 Aug 31 16:04:18.344322 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1082/2151] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:04:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:04:18.352536 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0b79e3e8-a1e2-45a4-b7ee-6cfa757cce6c tempest-MigrationsAdminTest-62329235 tempest-MigrationsAdminTest-62329235-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-254454518", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:04:18.387466 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0b79e3e8-a1e2-45a4-b7ee-6cfa757cce6c tempest-MigrationsAdminTest-62329235 tempest-MigrationsAdminTest-62329235-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 498 microversion: 2.1 time: 0.040740 Aug 31 16:04:18.394562 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1083/2152] 10.222.0.61 () {60 vars in 1146 bytes} [Wed Aug 31 16:04:18 2022] POST /compute/v2.1/flavors => generated 498 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:04:18.396136 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b9292b7c-4460-4065-ba45-88f9ba0f1a4e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:18.396890 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b9292b7c-4460-4065-ba45-88f9ba0f1a4e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 9e504a13-2fea-4da7-880d-b1782f9c5053] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:18.415071 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b9292b7c-4460-4065-ba45-88f9ba0f1a4e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:18.415959 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b9292b7c-4460-4065-ba45-88f9ba0f1a4e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:18.416801 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b9292b7c-4460-4065-ba45-88f9ba0f1a4e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:18.418926 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b9292b7c-4460-4065-ba45-88f9ba0f1a4e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:18.420509 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b9292b7c-4460-4065-ba45-88f9ba0f1a4e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:18.422379 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b9292b7c-4460-4065-ba45-88f9ba0f1a4e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:18.487921 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:04:18.709910 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=4 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:04:18.756205 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ff100d8d-a8e5-4e54-a544-6a87c8345ebd tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "DELETE /compute/v2.1/images/cc5491e8-7a29-4de4-8ca1-76f2ed80aed9" status: 204 len: 0 microversion: 2.1 time: 0.471527 Aug 31 16:04:18.758238 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1070/2153] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:18 2022] DELETE /compute/v2.1/images/cc5491e8-7a29-4de4-8ca1-76f2ed80aed9 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:04:18.765480 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-89cb1114-e954-4a39-9d89-b941b53a893d tempest-SecurityGroupRulesTestJSON-1778299432 tempest-SecurityGroupRulesTestJSON-1778299432-project] Calling method '.version_select at 0x7f5aed34d1f0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:19.102119 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b9292b7c-4460-4065-ba45-88f9ba0f1a4e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:19.122236 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b9292b7c-4460-4065-ba45-88f9ba0f1a4e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/9e504a13-2fea-4da7-880d-b1782f9c5053" status: 200 len: 1317 microversion: 2.1 time: 0.725467 Aug 31 16:04:19.124172 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1084/2154] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:18 2022] GET /compute/v2.1/servers/9e504a13-2fea-4da7-880d-b1782f9c5053 => generated 1317 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:19.134101 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a11cd755-1f0e-465d-a26d-8024a3415001 tempest-MigrationsAdminTest-62329235 tempest-MigrationsAdminTest-62329235-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:19.161780 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a11cd755-1f0e-465d-a26d-8024a3415001 tempest-MigrationsAdminTest-62329235 tempest-MigrationsAdminTest-62329235-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.036147 Aug 31 16:04:19.170108 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1085/2155] 10.222.0.61 () {58 vars in 1182 bytes} [Wed Aug 31 16:04:19 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 16:04:19.192887 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=4 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:04:19.202414 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6fbd07b9-80df-484f-ac84-c6a214b67c12 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:19.212755 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6fbd07b9-80df-484f-ac84-c6a214b67c12 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 006771fc-9da9-4b78-9fad-f4b72c311fd5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:19.223201 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6fbd07b9-80df-484f-ac84-c6a214b67c12 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:19.224930 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6fbd07b9-80df-484f-ac84-c6a214b67c12 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:19.229059 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6fbd07b9-80df-484f-ac84-c6a214b67c12 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:19.231175 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6fbd07b9-80df-484f-ac84-c6a214b67c12 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:19.232482 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6fbd07b9-80df-484f-ac84-c6a214b67c12 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:19.233383 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6fbd07b9-80df-484f-ac84-c6a214b67c12 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:20.012300 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-6fbd07b9-80df-484f-ac84-c6a214b67c12 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:20.026215 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-6fbd07b9-80df-484f-ac84-c6a214b67c12 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:20.032179 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-6fbd07b9-80df-484f-ac84-c6a214b67c12 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:20.033452 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6fbd07b9-80df-484f-ac84-c6a214b67c12 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5" status: 200 len: 1487 microversion: 2.25 time: 0.851415 Aug 31 16:04:20.034044 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1086/2156] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:04:19 2022] GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5 => generated 1487 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:04:20.045680 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2d75b9a4-12eb-4020-850c-fdec6c2b8a7d tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '.version_select at 0x7f5ae93789d0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:20.087288 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-2d75b9a4-12eb-4020-850c-fdec6c2b8a7d tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] HTTP exception thrown: Image not found. Aug 31 16:04:20.091750 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2d75b9a4-12eb-4020-850c-fdec6c2b8a7d tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Request method failure captured: Aug 31 16:04:20.091750 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/images/cc5491e8-7a29-4de4-8ca1-76f2ed80aed9 HTTP/1.1 Aug 31 16:04:20.091750 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:04:20.091750 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:04:20.091750 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:04:20.091750 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:04:20.091750 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:04:20.091750 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:04:20.091750 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:04:20.091750 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:04:20.091750 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4WG8AwQfYxlaGjRgYpPss_ZLDHrwQ0s3V0ZYjpGoaX5c5ru3y4LKPsB00yIoE66HOwzwSIJazTKHiyNnca12D_Uy-mgAi8PZmyamMJJse3n9yKimFm7AmbTJuRTt52xba3n10yK-nX_dGyxA35SpAwrRJtOVgpB_jiU61ZzJvR7O8M Aug 31 16:04:20.091750 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:04:20.091750 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:04:20.091750 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:04:20.091750 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:04:20.091750 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:04:20.091750 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:04:20.091750 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 61a9f3fcc4b445349e5c66ff712e8598 Aug 31 16:04:20.091750 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ImagesTestJSON-1850054072 Aug 31 16:04:20.091750 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:04:20.091750 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:04:20.091750 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/61a9f3fcc4b445349e5c66ff712e8598"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/61a9f3fcc4b445349e5c66ff712e8598"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_61a9f3fcc4b445349e5c66ff712e8598", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/61a9f3fcc4b445349e5c66ff712e8598"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:04:20.091750 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ImagesTestJSON-1850054072 Aug 31 16:04:20.091750 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 61a9f3fcc4b445349e5c66ff712e8598 Aug 31 16:04:20.091750 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ImagesTestJSON-1850054072 Aug 31 16:04:20.091750 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ImagesTestJSON-1850054072-project Aug 31 16:04:20.091750 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:04:20.091750 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:04:20.091750 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: f1ccd03a4aa84f93bc26b438e1468f46 Aug 31 16:04:20.091750 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ImagesTestJSON-1850054072-project Aug 31 16:04:20.091750 n-d-850499-9 devstack@n-api.service[122256]: method: Aug 31 16:04:20.091750 n-d-850499-9 devstack@n-api.service[122256]: exception: Image not found. Aug 31 16:04:20.091750 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': 'cc5491e8-7a29-4de4-8ca1-76f2ed80aed9'} Aug 31 16:04:20.091750 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:04:20.091750 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:04:20.091750 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 31 16:04:20.091750 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 31 16:04:20.091750 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 31 16:04:20.091750 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 31 16:04:20.091750 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 31 16:04:20.091750 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 31 16:04:20.091750 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 31 16:04:20.091750 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 31 16:04:20.091750 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 31 16:04:20.091750 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 31 16:04:20.091750 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 31 16:04:20.091750 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 31 16:04:20.091750 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 31 16:04:20.091750 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 31 16:04:20.091750 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 31 16:04:20.091750 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 31 16:04:20.091750 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID cc5491e8-7a29-4de4-8ca1-76f2ed80aed9 Aug 31 16:04:20.091750 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:04:20.091750 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:04:20.091750 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:04:20.091750 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:04:20.091750 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 31 16:04:20.091750 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 31 16:04:20.091750 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 31 16:04:20.091750 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 31 16:04:20.091750 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 31 16:04:20.091750 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 31 16:04:20.091750 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 31 16:04:20.091750 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 31 16:04:20.097754 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 31 16:04:20.097754 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 31 16:04:20.097754 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 31 16:04:20.097754 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 31 16:04:20.097754 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 31 16:04:20.097754 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 31 16:04:20.097754 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 31 16:04:20.097754 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 31 16:04:20.097754 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 31 16:04:20.097754 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 31 16:04:20.097754 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 31 16:04:20.097754 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 31 16:04:20.097754 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 31 16:04:20.097754 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 31 16:04:20.097754 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 31 16:04:20.097754 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 31 16:04:20.097754 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image cc5491e8-7a29-4de4-8ca1-76f2ed80aed9 could not be found. Aug 31 16:04:20.097754 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:04:20.097754 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:04:20.097754 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:04:20.097754 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:04:20.097754 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:04:20.097754 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:04:20.097754 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:04:20.097754 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:04:20.097754 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:04:20.097754 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:04:20.097754 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:04:20.097754 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:04:20.097754 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 31 16:04:20.097754 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 31 16:04:20.097754 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 31 16:04:20.097754 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:04:20.097754 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:04:20.097754 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:04:20.097754 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:04:20.097754 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:04:20.097754 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:04:20.097754 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:04:20.097754 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:04:20.097754 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 31 16:04:20.097754 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:04:20.113014 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2d75b9a4-12eb-4020-850c-fdec6c2b8a7d tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Returning 404 to user: Image not found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:04:20.114277 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2d75b9a4-12eb-4020-850c-fdec6c2b8a7d tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/images/cc5491e8-7a29-4de4-8ca1-76f2ed80aed9" status: 404 len: 62 microversion: 2.1 time: 0.073272 Aug 31 16:04:20.115954 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1087/2157] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:04:20 2022] GET /compute/v2.1/images/cc5491e8-7a29-4de4-8ca1-76f2ed80aed9 => generated 62 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 31 16:04:20.123335 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-afe2325a-f700-4496-9b8b-49da2aacd243 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:20.140545 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-afe2325a-f700-4496-9b8b-49da2aacd243 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: dd702273-095b-4d44-8d1b-3d90f7833d5f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:20.159435 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-afe2325a-f700-4496-9b8b-49da2aacd243 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:20.165152 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-afe2325a-f700-4496-9b8b-49da2aacd243 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:20.166005 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-afe2325a-f700-4496-9b8b-49da2aacd243 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:20.167021 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-afe2325a-f700-4496-9b8b-49da2aacd243 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:20.168322 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-afe2325a-f700-4496-9b8b-49da2aacd243 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:20.169263 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-afe2325a-f700-4496-9b8b-49da2aacd243 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:20.516321 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-89cb1114-e954-4a39-9d89-b941b53a893d tempest-SecurityGroupRulesTestJSON-1778299432 tempest-SecurityGroupRulesTestJSON-1778299432-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/2e96bd89-f112-45b4-8e74-e5710ec4aa56" status: 202 len: 0 microversion: 2.1 time: 1.755816 Aug 31 16:04:20.516919 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1071/2158] 10.222.0.61 () {58 vars in 1272 bytes} [Wed Aug 31 16:04:18 2022] DELETE /compute/v2.1/os-security-groups/2e96bd89-f112-45b4-8e74-e5710ec4aa56 => generated 0 bytes in 1758 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:04:20.531544 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-756b5711-eaf1-479a-a4df-d1debbb89a2e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-769458618", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "3308ef12-9ed9-4ca1-8e85-790a96a45515"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:04:20.569730 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:04:20.735928 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-756b5711-eaf1-479a-a4df-d1debbb89a2e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] validate_networks() for None {{(pid=122257) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:04:21.251013 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-afe2325a-f700-4496-9b8b-49da2aacd243 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:21.263698 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-afe2325a-f700-4496-9b8b-49da2aacd243 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f" status: 200 len: 1392 microversion: 2.1 time: 1.146220 Aug 31 16:04:21.264910 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1088/2159] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:20 2022] GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f => generated 1392 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:21.275451 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a37d6ea2-aa9e-48c8-b2f2-33a8211d7fec tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:21.278209 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a37d6ea2-aa9e-48c8-b2f2-33a8211d7fec tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: 007aba90-0e41-45d6-97f2-2d20b29d4296] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:21.297388 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a37d6ea2-aa9e-48c8-b2f2-33a8211d7fec tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:21.298428 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a37d6ea2-aa9e-48c8-b2f2-33a8211d7fec tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:21.299404 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a37d6ea2-aa9e-48c8-b2f2-33a8211d7fec tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:21.300576 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a37d6ea2-aa9e-48c8-b2f2-33a8211d7fec tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:21.305188 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a37d6ea2-aa9e-48c8-b2f2-33a8211d7fec tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:21.306091 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a37d6ea2-aa9e-48c8-b2f2-33a8211d7fec tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:22.621454 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-756b5711-eaf1-479a-a4df-d1debbb89a2e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:04:22.623676 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-756b5711-eaf1-479a-a4df-d1debbb89a2e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:04:22.631671 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-756b5711-eaf1-479a-a4df-d1debbb89a2e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:04:22.632435 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-756b5711-eaf1-479a-a4df-d1debbb89a2e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:04:22.633132 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-756b5711-eaf1-479a-a4df-d1debbb89a2e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:04:22.653148 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a37d6ea2-aa9e-48c8-b2f2-33a8211d7fec tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ccd03a4aa84f93bc26b438e1468f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a9f3fcc4b445349e5c66ff712e8598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:22.672507 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-756b5711-eaf1-479a-a4df-d1debbb89a2e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:22.673312 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-756b5711-eaf1-479a-a4df-d1debbb89a2e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:22.673962 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-756b5711-eaf1-479a-a4df-d1debbb89a2e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:22.675125 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-756b5711-eaf1-479a-a4df-d1debbb89a2e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:22.675884 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-756b5711-eaf1-479a-a4df-d1debbb89a2e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:22.676552 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-756b5711-eaf1-479a-a4df-d1debbb89a2e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:22.677109 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a37d6ea2-aa9e-48c8-b2f2-33a8211d7fec tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/servers/007aba90-0e41-45d6-97f2-2d20b29d4296" status: 200 len: 1506 microversion: 2.1 time: 1.407444 Aug 31 16:04:22.678845 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1089/2160] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:21 2022] GET /compute/v2.1/servers/007aba90-0e41-45d6-97f2-2d20b29d4296 => generated 1506 bytes in 1413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:22.705291 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-785be3c9-18d2-4799-887e-1fdd3b1e98ec tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:22.709149 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-785be3c9-18d2-4799-887e-1fdd3b1e98ec tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 9e504a13-2fea-4da7-880d-b1782f9c5053] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:22.726178 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-756b5711-eaf1-479a-a4df-d1debbb89a2e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Getting quotas for project 55ea476c41904e458bae79e7dad5d654. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:04:22.730791 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-785be3c9-18d2-4799-887e-1fdd3b1e98ec tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:22.733719 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-785be3c9-18d2-4799-887e-1fdd3b1e98ec tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:22.734280 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-785be3c9-18d2-4799-887e-1fdd3b1e98ec tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:22.735066 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-785be3c9-18d2-4799-887e-1fdd3b1e98ec tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:22.735575 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-785be3c9-18d2-4799-887e-1fdd3b1e98ec tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:22.736020 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-785be3c9-18d2-4799-887e-1fdd3b1e98ec tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:22.752323 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-756b5711-eaf1-479a-a4df-d1debbb89a2e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Getting quotas for user 0a552442b7e94406b1689baf7a23fa52 and project 55ea476c41904e458bae79e7dad5d654. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:04:22.796421 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-756b5711-eaf1-479a-a4df-d1debbb89a2e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Going to run 1 instances... {{(pid=122257) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:04:22.799115 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-756b5711-eaf1-479a-a4df-d1debbb89a2e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: f9b66475-83f6-49a3-bc63-8965fc1aec14] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:04:22.956289 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-756b5711-eaf1-479a-a4df-d1debbb89a2e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.438009 Aug 31 16:04:22.957399 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1072/2161] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:04:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 2440 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:04:22.971949 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e41671b8-31b1-48b4-b2ff-f736264af43a tempest-SecurityGroupRulesTestJSON-1778299432 tempest-SecurityGroupRulesTestJSON-1778299432-project] Calling method '.version_select at 0x7f5ae8cd5b80>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:23.146169 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e41671b8-31b1-48b4-b2ff-f736264af43a tempest-SecurityGroupRulesTestJSON-1778299432 tempest-SecurityGroupRulesTestJSON-1778299432-project] 10.222.0.61 "GET /compute/v2.1/os-security-groups/9e13a03d-e32a-43ce-a006-3795b8b1893c" status: 200 len: 248 microversion: 2.1 time: 0.186857 Aug 31 16:04:23.147200 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1073/2162] 10.222.0.61 () {58 vars in 1269 bytes} [Wed Aug 31 16:04:22 2022] GET /compute/v2.1/os-security-groups/9e13a03d-e32a-43ce-a006-3795b8b1893c => generated 248 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:04:23.157391 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-370ce703-8630-490c-aae0-b6b088156325 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:23.158043 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-370ce703-8630-490c-aae0-b6b088156325 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 006771fc-9da9-4b78-9fad-f4b72c311fd5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:23.181351 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-785be3c9-18d2-4799-887e-1fdd3b1e98ec tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:23.205861 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-370ce703-8630-490c-aae0-b6b088156325 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:23.206776 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-370ce703-8630-490c-aae0-b6b088156325 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:23.207422 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-370ce703-8630-490c-aae0-b6b088156325 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:23.213175 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-785be3c9-18d2-4799-887e-1fdd3b1e98ec tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/9e504a13-2fea-4da7-880d-b1782f9c5053" status: 200 len: 1317 microversion: 2.1 time: 0.529619 Aug 31 16:04:23.214887 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1090/2163] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:22 2022] GET /compute/v2.1/servers/9e504a13-2fea-4da7-880d-b1782f9c5053 => generated 1317 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:23.216187 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-370ce703-8630-490c-aae0-b6b088156325 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:23.216960 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-370ce703-8630-490c-aae0-b6b088156325 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:23.220034 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-7c2f4944-437e-4e7b-bf1d-41ddd944d2d5 req-64f4a564-00b2-48b6-be70-3b0ce91ddd15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd702273-095b-4d44-8d1b-3d90f7833d5f", "name": "network-vif-unplugged", "status": "completed", "tag": "64253c19-8d47-46b3-808b-0eed0e37d942"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:04:23.220889 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-370ce703-8630-490c-aae0-b6b088156325 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:23.243442 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-7c2f4944-437e-4e7b-bf1d-41ddd944d2d5 req-64f4a564-00b2-48b6-be70-3b0ce91ddd15 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:23.244887 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-7c2f4944-437e-4e7b-bf1d-41ddd944d2d5 req-64f4a564-00b2-48b6-be70-3b0ce91ddd15 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:23.246090 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-7c2f4944-437e-4e7b-bf1d-41ddd944d2d5 req-64f4a564-00b2-48b6-be70-3b0ce91ddd15 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:23.295700 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-7c2f4944-437e-4e7b-bf1d-41ddd944d2d5 req-64f4a564-00b2-48b6-be70-3b0ce91ddd15 service nova] Creating event network-vif-unplugged:64253c19-8d47-46b3-808b-0eed0e37d942 for instance dd702273-095b-4d44-8d1b-3d90f7833d5f on n-h2-850499-9 Aug 31 16:04:23.316350 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-7c2f4944-437e-4e7b-bf1d-41ddd944d2d5 req-64f4a564-00b2-48b6-be70-3b0ce91ddd15 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.097513 Aug 31 16:04:23.319111 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1091/2164] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:04:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:04:23.333027 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2f868b5f-04eb-4002-bcae-899776f18fe6 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:23.337728 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2f868b5f-04eb-4002-bcae-899776f18fe6 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: dd702273-095b-4d44-8d1b-3d90f7833d5f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:23.360856 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2f868b5f-04eb-4002-bcae-899776f18fe6 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:23.363337 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2f868b5f-04eb-4002-bcae-899776f18fe6 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:23.364646 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2f868b5f-04eb-4002-bcae-899776f18fe6 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:23.366272 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2f868b5f-04eb-4002-bcae-899776f18fe6 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:23.368118 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2f868b5f-04eb-4002-bcae-899776f18fe6 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:23.370415 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2f868b5f-04eb-4002-bcae-899776f18fe6 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:23.534089 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-370ce703-8630-490c-aae0-b6b088156325 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:23.550688 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-370ce703-8630-490c-aae0-b6b088156325 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:23.554612 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-370ce703-8630-490c-aae0-b6b088156325 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:23.559656 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-370ce703-8630-490c-aae0-b6b088156325 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5" status: 200 len: 1487 microversion: 2.25 time: 0.409181 Aug 31 16:04:23.562448 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1074/2165] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:04:23 2022] GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5 => generated 1487 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:04:23.571709 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-60e98bf1-9ff9-402a-bb68-e62b60d5830e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:23.575485 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-60e98bf1-9ff9-402a-bb68-e62b60d5830e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: f9b66475-83f6-49a3-bc63-8965fc1aec14] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:23.801310 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-60e98bf1-9ff9-402a-bb68-e62b60d5830e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:23.814206 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-60e98bf1-9ff9-402a-bb68-e62b60d5830e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/f9b66475-83f6-49a3-bc63-8965fc1aec14" status: 200 len: 1278 microversion: 2.1 time: 0.248664 Aug 31 16:04:23.818521 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1075/2166] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:23 2022] GET /compute/v2.1/servers/f9b66475-83f6-49a3-bc63-8965fc1aec14 => generated 1278 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:23.831379 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-815368c9-8f84-4dbc-a54e-de2e2e839473 tempest-SecurityGroupRulesTestJSON-1778299432 tempest-SecurityGroupRulesTestJSON-1778299432-project] Action: 'create', calling method: .version_select at 0x7f5ae8cd5040>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1739743802", "description": "tempest-description-1625058401"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:04:23.899237 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-2f868b5f-04eb-4002-bcae-899776f18fe6 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:23.917319 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2f868b5f-04eb-4002-bcae-899776f18fe6 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f" status: 200 len: 1392 microversion: 2.1 time: 0.596407 Aug 31 16:04:23.919546 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1092/2167] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:23 2022] GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f => generated 1392 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:23.927775 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-80aa7cae-28c5-4128-b6ff-f680cd09f703 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:23.929140 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-80aa7cae-28c5-4128-b6ff-f680cd09f703 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: 007aba90-0e41-45d6-97f2-2d20b29d4296] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:23.932055 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:04:23.952348 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-80aa7cae-28c5-4128-b6ff-f680cd09f703 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:23.954967 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-80aa7cae-28c5-4128-b6ff-f680cd09f703 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:23.956267 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-80aa7cae-28c5-4128-b6ff-f680cd09f703 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:23.958290 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-80aa7cae-28c5-4128-b6ff-f680cd09f703 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:23.959311 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-80aa7cae-28c5-4128-b6ff-f680cd09f703 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:23.960968 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-80aa7cae-28c5-4128-b6ff-f680cd09f703 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:24.386462 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-80aa7cae-28c5-4128-b6ff-f680cd09f703 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ccd03a4aa84f93bc26b438e1468f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a9f3fcc4b445349e5c66ff712e8598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:24.410501 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-80aa7cae-28c5-4128-b6ff-f680cd09f703 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/servers/007aba90-0e41-45d6-97f2-2d20b29d4296" status: 200 len: 1506 microversion: 2.1 time: 0.489113 Aug 31 16:04:24.415415 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1093/2168] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:23 2022] GET /compute/v2.1/servers/007aba90-0e41-45d6-97f2-2d20b29d4296 => generated 1506 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:24.435711 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c700a54f-2607-440f-ad4a-e6b5d918c393 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:24.436706 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c700a54f-2607-440f-ad4a-e6b5d918c393 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 9e504a13-2fea-4da7-880d-b1782f9c5053] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:24.466260 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c700a54f-2607-440f-ad4a-e6b5d918c393 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:24.466922 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c700a54f-2607-440f-ad4a-e6b5d918c393 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:24.467804 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c700a54f-2607-440f-ad4a-e6b5d918c393 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:24.469369 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c700a54f-2607-440f-ad4a-e6b5d918c393 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:24.470550 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c700a54f-2607-440f-ad4a-e6b5d918c393 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:24.471611 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c700a54f-2607-440f-ad4a-e6b5d918c393 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:24.670606 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-815368c9-8f84-4dbc-a54e-de2e2e839473 tempest-SecurityGroupRulesTestJSON-1778299432 tempest-SecurityGroupRulesTestJSON-1778299432-project] 10.222.0.61 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.850230 Aug 31 16:04:24.671894 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1076/2169] 10.222.0.61 () {60 vars in 1180 bytes} [Wed Aug 31 16:04:23 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:04:24.677089 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9caeb9f1-fb5d-4525-82f3-f5efb4543c3c tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:24.677729 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9caeb9f1-fb5d-4525-82f3-f5efb4543c3c tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 006771fc-9da9-4b78-9fad-f4b72c311fd5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:24.691633 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9caeb9f1-fb5d-4525-82f3-f5efb4543c3c tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:24.692139 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9caeb9f1-fb5d-4525-82f3-f5efb4543c3c tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:24.700168 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9caeb9f1-fb5d-4525-82f3-f5efb4543c3c tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:24.701414 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9caeb9f1-fb5d-4525-82f3-f5efb4543c3c tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:24.702117 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9caeb9f1-fb5d-4525-82f3-f5efb4543c3c tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:24.702334 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9caeb9f1-fb5d-4525-82f3-f5efb4543c3c tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:25.021054 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c700a54f-2607-440f-ad4a-e6b5d918c393 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:25.037937 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c700a54f-2607-440f-ad4a-e6b5d918c393 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/9e504a13-2fea-4da7-880d-b1782f9c5053" status: 200 len: 1317 microversion: 2.1 time: 0.620923 Aug 31 16:04:25.047166 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1094/2170] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:24 2022] GET /compute/v2.1/servers/9e504a13-2fea-4da7-880d-b1782f9c5053 => generated 1317 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:25.056405 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8065d5c9-70d6-42cc-ab4d-7598e6224772 tempest-SecurityGroupRulesTestJSON-1778299432 tempest-SecurityGroupRulesTestJSON-1778299432-project] Action: 'create', calling method: .version_select at 0x7f5ae92a2c10>, body: {"security_group_rule": {"parent_group_id": "70d17b4b-8087-4ef8-b1b3-a8c630008eb6", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:04:25.083087 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9caeb9f1-fb5d-4525-82f3-f5efb4543c3c tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:25.095122 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9caeb9f1-fb5d-4525-82f3-f5efb4543c3c tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:25.097632 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9caeb9f1-fb5d-4525-82f3-f5efb4543c3c tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:25.099084 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9caeb9f1-fb5d-4525-82f3-f5efb4543c3c tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5" status: 200 len: 1487 microversion: 2.25 time: 0.425921 Aug 31 16:04:25.101287 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1077/2171] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:04:24 2022] GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5 => generated 1487 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:04:25.115412 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f8edffd3-b5fd-4298-8e79-19eefe4aaebe tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:25.116227 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f8edffd3-b5fd-4298-8e79-19eefe4aaebe tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: f9b66475-83f6-49a3-bc63-8965fc1aec14] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:25.125929 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f8edffd3-b5fd-4298-8e79-19eefe4aaebe tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:25.126770 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f8edffd3-b5fd-4298-8e79-19eefe4aaebe tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:25.127448 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f8edffd3-b5fd-4298-8e79-19eefe4aaebe tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:25.128393 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f8edffd3-b5fd-4298-8e79-19eefe4aaebe tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:25.129025 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f8edffd3-b5fd-4298-8e79-19eefe4aaebe tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:25.129644 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f8edffd3-b5fd-4298-8e79-19eefe4aaebe tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:25.256895 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f8edffd3-b5fd-4298-8e79-19eefe4aaebe tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:25.270969 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f8edffd3-b5fd-4298-8e79-19eefe4aaebe tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/f9b66475-83f6-49a3-bc63-8965fc1aec14" status: 200 len: 1330 microversion: 2.1 time: 0.161079 Aug 31 16:04:25.272364 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1078/2172] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:25 2022] GET /compute/v2.1/servers/f9b66475-83f6-49a3-bc63-8965fc1aec14 => generated 1330 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:25.295889 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-629d7ea7-861f-40dd-b1ac-2926e2f6a3cf tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:25.297627 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-629d7ea7-861f-40dd-b1ac-2926e2f6a3cf tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: dd702273-095b-4d44-8d1b-3d90f7833d5f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:25.313325 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-629d7ea7-861f-40dd-b1ac-2926e2f6a3cf tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:25.320341 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-629d7ea7-861f-40dd-b1ac-2926e2f6a3cf tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:25.321285 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-629d7ea7-861f-40dd-b1ac-2926e2f6a3cf tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:25.322343 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-629d7ea7-861f-40dd-b1ac-2926e2f6a3cf tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:25.323386 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-629d7ea7-861f-40dd-b1ac-2926e2f6a3cf tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:25.324493 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-629d7ea7-861f-40dd-b1ac-2926e2f6a3cf tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:25.444595 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8065d5c9-70d6-42cc-ab4d-7598e6224772 tempest-SecurityGroupRulesTestJSON-1778299432 tempest-SecurityGroupRulesTestJSON-1778299432-project] 10.222.0.61 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.395350 Aug 31 16:04:25.445929 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1095/2173] 10.222.0.61 () {60 vars in 1195 bytes} [Wed Aug 31 16:04:25 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:04:25.451383 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-700854ae-385a-4867-a58c-52f3a4bcfc75 req-8f0217c6-b249-4fbd-9338-6c3d6b9146d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd702273-095b-4d44-8d1b-3d90f7833d5f", "tag": "64253c19-8d47-46b3-808b-0eed0e37d942"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:04:25.474561 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-700854ae-385a-4867-a58c-52f3a4bcfc75 req-8f0217c6-b249-4fbd-9338-6c3d6b9146d2 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:25.474561 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-700854ae-385a-4867-a58c-52f3a4bcfc75 req-8f0217c6-b249-4fbd-9338-6c3d6b9146d2 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:25.474914 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-700854ae-385a-4867-a58c-52f3a4bcfc75 req-8f0217c6-b249-4fbd-9338-6c3d6b9146d2 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:25.506287 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-700854ae-385a-4867-a58c-52f3a4bcfc75 req-8f0217c6-b249-4fbd-9338-6c3d6b9146d2 service nova] Creating event network-changed:64253c19-8d47-46b3-808b-0eed0e37d942 for instance dd702273-095b-4d44-8d1b-3d90f7833d5f on n-h2-850499-9 Aug 31 16:04:25.526085 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-700854ae-385a-4867-a58c-52f3a4bcfc75 req-8f0217c6-b249-4fbd-9338-6c3d6b9146d2 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078489 Aug 31 16:04:25.527602 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1096/2174] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:04:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:04:25.537834 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8112ed2b-8d4b-4b5c-91d4-1cff5afa7171 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:25.539339 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8112ed2b-8d4b-4b5c-91d4-1cff5afa7171 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: 007aba90-0e41-45d6-97f2-2d20b29d4296] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:25.553000 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8112ed2b-8d4b-4b5c-91d4-1cff5afa7171 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:25.553538 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8112ed2b-8d4b-4b5c-91d4-1cff5afa7171 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:25.554080 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8112ed2b-8d4b-4b5c-91d4-1cff5afa7171 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:25.554890 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8112ed2b-8d4b-4b5c-91d4-1cff5afa7171 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:25.555347 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8112ed2b-8d4b-4b5c-91d4-1cff5afa7171 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:25.565454 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8112ed2b-8d4b-4b5c-91d4-1cff5afa7171 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:25.657533 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-629d7ea7-861f-40dd-b1ac-2926e2f6a3cf tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:25.666505 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-629d7ea7-861f-40dd-b1ac-2926e2f6a3cf tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f" status: 200 len: 1392 microversion: 2.1 time: 0.392879 Aug 31 16:04:25.677773 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1079/2175] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:25 2022] GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f => generated 1392 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:25.683125 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1dbf5706-6240-4149-ba8a-9c76ec79e4c5 tempest-SecurityGroupRulesTestJSON-1778299432 tempest-SecurityGroupRulesTestJSON-1778299432-project] Action: 'create', calling method: .version_select at 0x7f5ae8c3c280>, body: {"security_group_rule": {"parent_group_id": "70d17b4b-8087-4ef8-b1b3-a8c630008eb6", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:04:25.990745 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8112ed2b-8d4b-4b5c-91d4-1cff5afa7171 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ccd03a4aa84f93bc26b438e1468f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a9f3fcc4b445349e5c66ff712e8598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:26.003052 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8112ed2b-8d4b-4b5c-91d4-1cff5afa7171 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/servers/007aba90-0e41-45d6-97f2-2d20b29d4296" status: 200 len: 1506 microversion: 2.1 time: 0.473575 Aug 31 16:04:26.003902 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1097/2176] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:25 2022] GET /compute/v2.1/servers/007aba90-0e41-45d6-97f2-2d20b29d4296 => generated 1506 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:26.084314 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-08203e5b-0383-4bae-b771-c8405f3c32b6 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:26.087058 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-08203e5b-0383-4bae-b771-c8405f3c32b6 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 9e504a13-2fea-4da7-880d-b1782f9c5053] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:26.112036 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-08203e5b-0383-4bae-b771-c8405f3c32b6 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:26.124524 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-08203e5b-0383-4bae-b771-c8405f3c32b6 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:26.125121 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-08203e5b-0383-4bae-b771-c8405f3c32b6 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:26.126878 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-08203e5b-0383-4bae-b771-c8405f3c32b6 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:26.127620 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-08203e5b-0383-4bae-b771-c8405f3c32b6 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:26.128094 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-08203e5b-0383-4bae-b771-c8405f3c32b6 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:26.414313 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1dbf5706-6240-4149-ba8a-9c76ec79e4c5 tempest-SecurityGroupRulesTestJSON-1778299432 tempest-SecurityGroupRulesTestJSON-1778299432-project] 10.222.0.61 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.735111 Aug 31 16:04:26.414919 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1080/2177] 10.222.0.61 () {60 vars in 1195 bytes} [Wed Aug 31 16:04:25 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:04:26.422413 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a0e7420a-ee6e-451e-b61e-17617e34b60c tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:26.423446 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a0e7420a-ee6e-451e-b61e-17617e34b60c tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 006771fc-9da9-4b78-9fad-f4b72c311fd5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:26.433329 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a0e7420a-ee6e-451e-b61e-17617e34b60c tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:26.435204 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a0e7420a-ee6e-451e-b61e-17617e34b60c tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:26.436753 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a0e7420a-ee6e-451e-b61e-17617e34b60c tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:26.438672 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a0e7420a-ee6e-451e-b61e-17617e34b60c tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:26.439434 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a0e7420a-ee6e-451e-b61e-17617e34b60c tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:26.439846 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a0e7420a-ee6e-451e-b61e-17617e34b60c tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:26.727825 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-08203e5b-0383-4bae-b771-c8405f3c32b6 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:26.748418 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a0e7420a-ee6e-451e-b61e-17617e34b60c tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:26.751349 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-08203e5b-0383-4bae-b771-c8405f3c32b6 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/9e504a13-2fea-4da7-880d-b1782f9c5053" status: 200 len: 1317 microversion: 2.1 time: 0.688190 Aug 31 16:04:26.752458 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1098/2178] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:26 2022] GET /compute/v2.1/servers/9e504a13-2fea-4da7-880d-b1782f9c5053 => generated 1317 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:26.770587 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c43052a8-1034-4126-b486-e0cbcc3b2dcb tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:26.771652 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c43052a8-1034-4126-b486-e0cbcc3b2dcb tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: f9b66475-83f6-49a3-bc63-8965fc1aec14] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:26.778140 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a0e7420a-ee6e-451e-b61e-17617e34b60c tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:26.779246 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c43052a8-1034-4126-b486-e0cbcc3b2dcb tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:26.779655 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a0e7420a-ee6e-451e-b61e-17617e34b60c tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:26.780418 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c43052a8-1034-4126-b486-e0cbcc3b2dcb tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:26.780963 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c43052a8-1034-4126-b486-e0cbcc3b2dcb tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:26.785897 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c43052a8-1034-4126-b486-e0cbcc3b2dcb tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:26.786538 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c43052a8-1034-4126-b486-e0cbcc3b2dcb tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:26.787571 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c43052a8-1034-4126-b486-e0cbcc3b2dcb tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:26.788695 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a0e7420a-ee6e-451e-b61e-17617e34b60c tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5" status: 200 len: 1487 microversion: 2.25 time: 0.371088 Aug 31 16:04:26.789310 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1081/2179] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:04:26 2022] GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5 => generated 1487 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:04:26.814018 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-fa8f0824-2d31-4287-a0dc-8a20f39d5251 req-081a0afd-9661-4abe-9b4d-e39f4da2a6c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "007aba90-0e41-45d6-97f2-2d20b29d4296", "name": "network-vif-plugged", "status": "completed", "tag": "884c2568-ad01-48ba-ac30-4fc6751c3295"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:04:26.828300 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-fa8f0824-2d31-4287-a0dc-8a20f39d5251 req-081a0afd-9661-4abe-9b4d-e39f4da2a6c8 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:26.828808 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-fa8f0824-2d31-4287-a0dc-8a20f39d5251 req-081a0afd-9661-4abe-9b4d-e39f4da2a6c8 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:26.837042 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-fa8f0824-2d31-4287-a0dc-8a20f39d5251 req-081a0afd-9661-4abe-9b4d-e39f4da2a6c8 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:26.857920 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-fa8f0824-2d31-4287-a0dc-8a20f39d5251 req-081a0afd-9661-4abe-9b4d-e39f4da2a6c8 service nova] Creating event network-vif-plugged:884c2568-ad01-48ba-ac30-4fc6751c3295 for instance 007aba90-0e41-45d6-97f2-2d20b29d4296 on n-h2-850499-9 Aug 31 16:04:26.888510 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-fa8f0824-2d31-4287-a0dc-8a20f39d5251 req-081a0afd-9661-4abe-9b4d-e39f4da2a6c8 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078156 Aug 31 16:04:26.889864 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1082/2180] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:04:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:04:26.896518 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d99c3b36-d2b3-4a05-aaed-2d5ad92ad5c9 tempest-SecurityGroupRulesTestJSON-1778299432 tempest-SecurityGroupRulesTestJSON-1778299432-project] Calling method '.version_select at 0x7f5ae8f12f70>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:26.937524 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c43052a8-1034-4126-b486-e0cbcc3b2dcb tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:26.948422 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c43052a8-1034-4126-b486-e0cbcc3b2dcb tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/f9b66475-83f6-49a3-bc63-8965fc1aec14" status: 200 len: 1330 microversion: 2.1 time: 0.194551 Aug 31 16:04:26.952044 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1099/2181] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:26 2022] GET /compute/v2.1/servers/f9b66475-83f6-49a3-bc63-8965fc1aec14 => generated 1330 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:26.959721 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-37fffe52-3369-491d-b375-9aec81d73596 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:26.960975 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-37fffe52-3369-491d-b375-9aec81d73596 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: dd702273-095b-4d44-8d1b-3d90f7833d5f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:26.975014 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-37fffe52-3369-491d-b375-9aec81d73596 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:26.975860 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-37fffe52-3369-491d-b375-9aec81d73596 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:26.976540 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-37fffe52-3369-491d-b375-9aec81d73596 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:26.978411 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-37fffe52-3369-491d-b375-9aec81d73596 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:26.979112 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-37fffe52-3369-491d-b375-9aec81d73596 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:26.980111 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-37fffe52-3369-491d-b375-9aec81d73596 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:27.015400 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d99c3b36-d2b3-4a05-aaed-2d5ad92ad5c9 tempest-SecurityGroupRulesTestJSON-1778299432 tempest-SecurityGroupRulesTestJSON-1778299432-project] 10.222.0.61 "GET /compute/v2.1/os-security-groups/70d17b4b-8087-4ef8-b1b3-a8c630008eb6" status: 200 len: 665 microversion: 2.1 time: 0.123406 Aug 31 16:04:27.023674 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1083/2182] 10.222.0.61 () {58 vars in 1269 bytes} [Wed Aug 31 16:04:26 2022] GET /compute/v2.1/os-security-groups/70d17b4b-8087-4ef8-b1b3-a8c630008eb6 => generated 665 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:04:27.035004 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8be82a9c-a667-482a-92ee-8933311c5a82 tempest-SecurityGroupRulesTestJSON-1778299432 tempest-SecurityGroupRulesTestJSON-1778299432-project] Calling method '.version_select at 0x7f5ae8c9a790>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:27.397268 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-37fffe52-3369-491d-b375-9aec81d73596 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:27.421901 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-37fffe52-3369-491d-b375-9aec81d73596 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f" status: 200 len: 1392 microversion: 2.1 time: 0.468013 Aug 31 16:04:27.436148 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1100/2183] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:26 2022] GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f => generated 1392 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:27.443246 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9697d1d8-6c44-4299-8eee-2f06b19dc4da tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:27.448740 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9697d1d8-6c44-4299-8eee-2f06b19dc4da tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: 007aba90-0e41-45d6-97f2-2d20b29d4296] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:27.472545 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9697d1d8-6c44-4299-8eee-2f06b19dc4da tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:27.473425 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9697d1d8-6c44-4299-8eee-2f06b19dc4da tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:27.474190 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9697d1d8-6c44-4299-8eee-2f06b19dc4da tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:27.475444 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9697d1d8-6c44-4299-8eee-2f06b19dc4da tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:27.476177 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9697d1d8-6c44-4299-8eee-2f06b19dc4da tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:27.476901 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9697d1d8-6c44-4299-8eee-2f06b19dc4da tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:27.762903 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8be82a9c-a667-482a-92ee-8933311c5a82 tempest-SecurityGroupRulesTestJSON-1778299432 tempest-SecurityGroupRulesTestJSON-1778299432-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-group-rules/5b316ba5-a01b-4377-9027-3c125906c44e" status: 202 len: 0 microversion: 2.1 time: 0.733735 Aug 31 16:04:27.763515 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1084/2184] 10.222.0.61 () {58 vars in 1287 bytes} [Wed Aug 31 16:04:27 2022] DELETE /compute/v2.1/os-security-group-rules/5b316ba5-a01b-4377-9027-3c125906c44e => generated 0 bytes in 736 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:04:27.775447 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2c24aee4-1701-4b6e-b741-b283104e835b tempest-SecurityGroupRulesTestJSON-1778299432 tempest-SecurityGroupRulesTestJSON-1778299432-project] Calling method '.version_select at 0x7f5ae8cd5ee0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:27.832101 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-9697d1d8-6c44-4299-8eee-2f06b19dc4da tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ccd03a4aa84f93bc26b438e1468f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a9f3fcc4b445349e5c66ff712e8598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:27.841716 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9697d1d8-6c44-4299-8eee-2f06b19dc4da tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/servers/007aba90-0e41-45d6-97f2-2d20b29d4296" status: 200 len: 1488 microversion: 2.1 time: 0.407547 Aug 31 16:04:27.842405 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1101/2185] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:27 2022] GET /compute/v2.1/servers/007aba90-0e41-45d6-97f2-2d20b29d4296 => generated 1488 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:27.850563 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4f118f1b-2afb-4e07-b97a-3b767a6e1288 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:27.851455 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4f118f1b-2afb-4e07-b97a-3b767a6e1288 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 9e504a13-2fea-4da7-880d-b1782f9c5053] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:27.859750 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4f118f1b-2afb-4e07-b97a-3b767a6e1288 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:27.860328 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4f118f1b-2afb-4e07-b97a-3b767a6e1288 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:27.860844 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4f118f1b-2afb-4e07-b97a-3b767a6e1288 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:27.861626 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4f118f1b-2afb-4e07-b97a-3b767a6e1288 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:27.862234 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4f118f1b-2afb-4e07-b97a-3b767a6e1288 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:27.863283 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4f118f1b-2afb-4e07-b97a-3b767a6e1288 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:28.351907 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-4f118f1b-2afb-4e07-b97a-3b767a6e1288 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:28.362892 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4f118f1b-2afb-4e07-b97a-3b767a6e1288 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/9e504a13-2fea-4da7-880d-b1782f9c5053" status: 200 len: 1317 microversion: 2.1 time: 0.519161 Aug 31 16:04:28.363806 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1102/2186] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:27 2022] GET /compute/v2.1/servers/9e504a13-2fea-4da7-880d-b1782f9c5053 => generated 1317 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:28.382421 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-eb8ae10a-a72d-4271-8ae7-547fe5b97f6f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:28.383441 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-eb8ae10a-a72d-4271-8ae7-547fe5b97f6f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 006771fc-9da9-4b78-9fad-f4b72c311fd5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:28.393450 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eb8ae10a-a72d-4271-8ae7-547fe5b97f6f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:28.394615 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eb8ae10a-a72d-4271-8ae7-547fe5b97f6f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:28.395287 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eb8ae10a-a72d-4271-8ae7-547fe5b97f6f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:28.396054 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eb8ae10a-a72d-4271-8ae7-547fe5b97f6f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:28.396900 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eb8ae10a-a72d-4271-8ae7-547fe5b97f6f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:28.397384 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eb8ae10a-a72d-4271-8ae7-547fe5b97f6f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:28.570212 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2c24aee4-1701-4b6e-b741-b283104e835b tempest-SecurityGroupRulesTestJSON-1778299432 tempest-SecurityGroupRulesTestJSON-1778299432-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/70d17b4b-8087-4ef8-b1b3-a8c630008eb6" status: 202 len: 0 microversion: 2.1 time: 0.801091 Aug 31 16:04:28.572141 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1085/2187] 10.222.0.61 () {58 vars in 1272 bytes} [Wed Aug 31 16:04:27 2022] DELETE /compute/v2.1/os-security-groups/70d17b4b-8087-4ef8-b1b3-a8c630008eb6 => generated 0 bytes in 804 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:04:28.586922 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e1a00475-91c7-4bef-967c-6ae6b4da8ab7 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:28.590673 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e1a00475-91c7-4bef-967c-6ae6b4da8ab7 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: 007aba90-0e41-45d6-97f2-2d20b29d4296] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:28.626285 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e1a00475-91c7-4bef-967c-6ae6b4da8ab7 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:28.637740 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e1a00475-91c7-4bef-967c-6ae6b4da8ab7 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:28.644239 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e1a00475-91c7-4bef-967c-6ae6b4da8ab7 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:28.656835 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e1a00475-91c7-4bef-967c-6ae6b4da8ab7 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:28.658373 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e1a00475-91c7-4bef-967c-6ae6b4da8ab7 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:28.664988 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e1a00475-91c7-4bef-967c-6ae6b4da8ab7 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:28.706941 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-eb8ae10a-a72d-4271-8ae7-547fe5b97f6f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:28.719657 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-eb8ae10a-a72d-4271-8ae7-547fe5b97f6f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:28.721064 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-eb8ae10a-a72d-4271-8ae7-547fe5b97f6f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:28.725440 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-eb8ae10a-a72d-4271-8ae7-547fe5b97f6f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5" status: 200 len: 1487 microversion: 2.25 time: 0.360332 Aug 31 16:04:28.729040 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1103/2188] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:04:28 2022] GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5 => generated 1487 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:04:28.738744 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-45a435e3-e3f6-406d-bff7-19e0ff274fd1 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:28.739368 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-45a435e3-e3f6-406d-bff7-19e0ff274fd1 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: f9b66475-83f6-49a3-bc63-8965fc1aec14] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:28.750646 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e1a00475-91c7-4bef-967c-6ae6b4da8ab7 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: 007aba90-0e41-45d6-97f2-2d20b29d4296] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:04:28.751690 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-45a435e3-e3f6-406d-bff7-19e0ff274fd1 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:28.752815 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-45a435e3-e3f6-406d-bff7-19e0ff274fd1 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:28.753465 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-45a435e3-e3f6-406d-bff7-19e0ff274fd1 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:28.754392 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-45a435e3-e3f6-406d-bff7-19e0ff274fd1 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:28.755064 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-45a435e3-e3f6-406d-bff7-19e0ff274fd1 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:28.755764 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-45a435e3-e3f6-406d-bff7-19e0ff274fd1 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:28.910639 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-45a435e3-e3f6-406d-bff7-19e0ff274fd1 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:28.937779 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-45a435e3-e3f6-406d-bff7-19e0ff274fd1 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/f9b66475-83f6-49a3-bc63-8965fc1aec14" status: 200 len: 1336 microversion: 2.1 time: 0.206789 Aug 31 16:04:28.938646 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1104/2189] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:28 2022] GET /compute/v2.1/servers/f9b66475-83f6-49a3-bc63-8965fc1aec14 => generated 1336 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:28.956373 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1b341290-6a49-4fc2-b5d5-98a259c893ef tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:28.959844 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1b341290-6a49-4fc2-b5d5-98a259c893ef tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: dd702273-095b-4d44-8d1b-3d90f7833d5f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:28.967559 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1b341290-6a49-4fc2-b5d5-98a259c893ef tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:28.968058 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1b341290-6a49-4fc2-b5d5-98a259c893ef tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:28.975351 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1b341290-6a49-4fc2-b5d5-98a259c893ef tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:28.976353 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1b341290-6a49-4fc2-b5d5-98a259c893ef tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:28.977015 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1b341290-6a49-4fc2-b5d5-98a259c893ef tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:28.985946 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1b341290-6a49-4fc2-b5d5-98a259c893ef tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:29.008035 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=100 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:04:29.054487 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e1a00475-91c7-4bef-967c-6ae6b4da8ab7 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "DELETE /compute/v2.1/servers/007aba90-0e41-45d6-97f2-2d20b29d4296" status: 204 len: 0 microversion: 2.1 time: 0.479329 Aug 31 16:04:29.059022 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1086/2190] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:04:28 2022] DELETE /compute/v2.1/servers/007aba90-0e41-45d6-97f2-2d20b29d4296 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:04:29.086677 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2cf3b430-328b-4b4b-8163-c87f10e81d5d tempest-SecurityGroupRulesTestJSON-1778299432 tempest-SecurityGroupRulesTestJSON-1778299432-project] Calling method '.version_select at 0x7f5aed344b80>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:29.153301 n-d-850499-9 devstack@n-api.service[122257]: DEBUG neutronclient.v2_0.client [None req-2cf3b430-328b-4b4b-8163-c87f10e81d5d tempest-SecurityGroupRulesTestJSON-1778299432 tempest-SecurityGroupRulesTestJSON-1778299432-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 2e96bd89-f112-45b4-8e74-e5710ec4aa56 does not exist", "detail": ""}} {{(pid=122257) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 31 16:04:29.154708 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.security_group_api [None req-2cf3b430-328b-4b4b-8163-c87f10e81d5d tempest-SecurityGroupRulesTestJSON-1778299432 tempest-SecurityGroupRulesTestJSON-1778299432-project] Neutron security group 2e96bd89-f112-45b4-8e74-e5710ec4aa56 not found {{(pid=122257) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 31 16:04:29.155791 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-2cf3b430-328b-4b4b-8163-c87f10e81d5d tempest-SecurityGroupRulesTestJSON-1778299432 tempest-SecurityGroupRulesTestJSON-1778299432-project] HTTP exception thrown: Security group 2e96bd89-f112-45b4-8e74-e5710ec4aa56 does not exist Aug 31 16:04:29.155791 n-d-850499-9 devstack@n-api.service[122257]: Neutron server returns request_ids: ['req-673c60de-fd9d-4a8c-89c8-4a5fafbe44df'] Aug 31 16:04:29.167046 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2cf3b430-328b-4b4b-8163-c87f10e81d5d tempest-SecurityGroupRulesTestJSON-1778299432 tempest-SecurityGroupRulesTestJSON-1778299432-project] Request method failure captured: Aug 31 16:04:29.167046 n-d-850499-9 devstack@n-api.service[122257]: request: DELETE /compute/v2.1/os-security-groups/2e96bd89-f112-45b4-8e74-e5710ec4aa56 HTTP/1.1 Aug 31 16:04:29.167046 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:04:29.167046 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:04:29.167046 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:04:29.167046 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:04:29.167046 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:04:29.167046 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:04:29.167046 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:04:29.167046 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:04:29.167046 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4ZupiK9QifZ3G7R1tY9qSfXUeYL9xaE407Aql-aJbH4AjhCf9Pl3FkX3poHKiGu6g1DpQQFxunoG6nl-VfmMaVEQJwLCNS1xqaipqbfkLzXgIfQfG_3yymWmrnjgUP05VNAG7LRiMPmqVob2sI8Lkt2iWzFJQwSwkSG3YKwj01QOiw Aug 31 16:04:29.167046 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:04:29.167046 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:04:29.167046 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:04:29.167046 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:04:29.167046 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:04:29.167046 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:04:29.167046 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 7699c334eff440f899adc0e05bcf582f Aug 31 16:04:29.167046 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-1778299432 Aug 31 16:04:29.167046 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:04:29.167046 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:04:29.167046 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7699c334eff440f899adc0e05bcf582f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7699c334eff440f899adc0e05bcf582f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7699c334eff440f899adc0e05bcf582f", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7699c334eff440f899adc0e05bcf582f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:04:29.167046 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-SecurityGroupRulesTestJSON-1778299432 Aug 31 16:04:29.167046 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 7699c334eff440f899adc0e05bcf582f Aug 31 16:04:29.167046 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-1778299432 Aug 31 16:04:29.167046 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-SecurityGroupRulesTestJSON-1778299432-project Aug 31 16:04:29.167046 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:04:29.167046 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:04:29.167046 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 02da3d32636742f4a3f6f44813db15ca Aug 31 16:04:29.167046 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-SecurityGroupRulesTestJSON-1778299432-project Aug 31 16:04:29.167046 n-d-850499-9 devstack@n-api.service[122257]: method: Aug 31 16:04:29.167046 n-d-850499-9 devstack@n-api.service[122257]: exception: Security group 2e96bd89-f112-45b4-8e74-e5710ec4aa56 does not exist Aug 31 16:04:29.167046 n-d-850499-9 devstack@n-api.service[122257]: Neutron server returns request_ids: ['req-673c60de-fd9d-4a8c-89c8-4a5fafbe44df'] Aug 31 16:04:29.167046 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '2e96bd89-f112-45b4-8e74-e5710ec4aa56'} Aug 31 16:04:29.167046 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:04:29.167046 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:04:29.167046 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 31 16:04:29.167046 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 31 16:04:29.167046 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:04:29.167046 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:04:29.167046 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 31 16:04:29.167046 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 31 16:04:29.167046 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:04:29.167046 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:04:29.167046 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 31 16:04:29.167046 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 31 16:04:29.167046 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:04:29.167046 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:04:29.167046 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 31 16:04:29.167046 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 31 16:04:29.167046 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:04:29.167046 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:04:29.167046 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 31 16:04:29.167046 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 31 16:04:29.167046 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:04:29.167046 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:04:29.167046 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 31 16:04:29.167046 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 31 16:04:29.167046 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 31 16:04:29.167046 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 31 16:04:29.167046 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 2e96bd89-f112-45b4-8e74-e5710ec4aa56 does not exist Aug 31 16:04:29.174486 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-673c60de-fd9d-4a8c-89c8-4a5fafbe44df'] Aug 31 16:04:29.174486 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:04:29.174486 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:04:29.174486 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:04:29.174486 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:04:29.174486 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 31 16:04:29.174486 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 31 16:04:29.174486 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 31 16:04:29.174486 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 31 16:04:29.174486 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 2e96bd89-f112-45b4-8e74-e5710ec4aa56 does not exist Aug 31 16:04:29.174486 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-673c60de-fd9d-4a8c-89c8-4a5fafbe44df'] Aug 31 16:04:29.174486 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:04:29.174486 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:04:29.174486 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:04:29.174486 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:04:29.174486 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:04:29.174486 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:04:29.174486 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:04:29.174486 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:04:29.174486 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:04:29.174486 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:04:29.174486 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:04:29.174486 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:04:29.174486 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 31 16:04:29.174486 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 31 16:04:29.174486 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 2e96bd89-f112-45b4-8e74-e5710ec4aa56 does not exist Aug 31 16:04:29.174486 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-673c60de-fd9d-4a8c-89c8-4a5fafbe44df'] Aug 31 16:04:29.174486 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:04:29.174486 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:04:29.174486 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:04:29.174486 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:04:29.174486 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:04:29.174486 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:04:29.174486 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:04:29.174486 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:04:29.174486 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 2e96bd89-f112-45b4-8e74-e5710ec4aa56 does not exist Aug 31 16:04:29.174486 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-673c60de-fd9d-4a8c-89c8-4a5fafbe44df'] Aug 31 16:04:29.174486 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:04:29.185341 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2cf3b430-328b-4b4b-8163-c87f10e81d5d tempest-SecurityGroupRulesTestJSON-1778299432 tempest-SecurityGroupRulesTestJSON-1778299432-project] Returning 404 to user: Security group 2e96bd89-f112-45b4-8e74-e5710ec4aa56 does not exist Aug 31 16:04:29.185341 n-d-850499-9 devstack@n-api.service[122257]: Neutron server returns request_ids: ['req-673c60de-fd9d-4a8c-89c8-4a5fafbe44df'] {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:04:29.189123 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2cf3b430-328b-4b4b-8163-c87f10e81d5d tempest-SecurityGroupRulesTestJSON-1778299432 tempest-SecurityGroupRulesTestJSON-1778299432-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/2e96bd89-f112-45b4-8e74-e5710ec4aa56" status: 404 len: 194 microversion: 2.1 time: 0.124776 Aug 31 16:04:29.190927 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1087/2191] 10.222.0.61 () {58 vars in 1272 bytes} [Wed Aug 31 16:04:29 2022] DELETE /compute/v2.1/os-security-groups/2e96bd89-f112-45b4-8e74-e5710ec4aa56 => generated 194 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:04:29.199215 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5de85af8-a0ac-4697-a792-4a7cb03329d5 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '.version_select at 0x7f5aed1caf70>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:29.232230 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-5de85af8-a0ac-4697-a792-4a7cb03329d5 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] HTTP exception thrown: Image not found. Aug 31 16:04:29.238273 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5de85af8-a0ac-4697-a792-4a7cb03329d5 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Request method failure captured: Aug 31 16:04:29.238273 n-d-850499-9 devstack@n-api.service[122257]: request: DELETE /compute/v2.1/images/cc5491e8-7a29-4de4-8ca1-76f2ed80aed9 HTTP/1.1 Aug 31 16:04:29.238273 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:04:29.238273 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:04:29.238273 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:04:29.238273 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:04:29.238273 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:04:29.238273 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:04:29.238273 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:04:29.238273 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:04:29.238273 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4WG8AwQfYxlaGjRgYpPss_ZLDHrwQ0s3V0ZYjpGoaX5c5ru3y4LKPsB00yIoE66HOwzwSIJazTKHiyNnca12D_Uy-mgAi8PZmyamMJJse3n9yKimFm7AmbTJuRTt52xba3n10yK-nX_dGyxA35SpAwrRJtOVgpB_jiU61ZzJvR7O8M Aug 31 16:04:29.238273 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:04:29.238273 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:04:29.238273 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:04:29.238273 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:04:29.238273 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:04:29.238273 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:04:29.238273 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 61a9f3fcc4b445349e5c66ff712e8598 Aug 31 16:04:29.238273 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ImagesTestJSON-1850054072 Aug 31 16:04:29.238273 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:04:29.238273 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:04:29.238273 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/61a9f3fcc4b445349e5c66ff712e8598"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/61a9f3fcc4b445349e5c66ff712e8598"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_61a9f3fcc4b445349e5c66ff712e8598", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/61a9f3fcc4b445349e5c66ff712e8598"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:04:29.238273 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ImagesTestJSON-1850054072 Aug 31 16:04:29.238273 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 61a9f3fcc4b445349e5c66ff712e8598 Aug 31 16:04:29.238273 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ImagesTestJSON-1850054072 Aug 31 16:04:29.238273 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ImagesTestJSON-1850054072-project Aug 31 16:04:29.238273 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:04:29.238273 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:04:29.238273 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: f1ccd03a4aa84f93bc26b438e1468f46 Aug 31 16:04:29.238273 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ImagesTestJSON-1850054072-project Aug 31 16:04:29.238273 n-d-850499-9 devstack@n-api.service[122257]: method: Aug 31 16:04:29.238273 n-d-850499-9 devstack@n-api.service[122257]: exception: Image not found. Aug 31 16:04:29.238273 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': 'cc5491e8-7a29-4de4-8ca1-76f2ed80aed9'} Aug 31 16:04:29.238273 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:04:29.238273 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:04:29.238273 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 31 16:04:29.238273 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 31 16:04:29.238273 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 31 16:04:29.238273 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 31 16:04:29.238273 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 31 16:04:29.238273 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 31 16:04:29.238273 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 31 16:04:29.238273 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 31 16:04:29.238273 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 31 16:04:29.238273 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 31 16:04:29.238273 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 31 16:04:29.238273 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 31 16:04:29.238273 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 31 16:04:29.238273 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 31 16:04:29.238273 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image cc5491e8-7a29-4de4-8ca1-76f2ed80aed9 to delete Aug 31 16:04:29.238273 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:04:29.238273 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:04:29.238273 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:04:29.238273 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:04:29.238273 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 31 16:04:29.238273 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 31 16:04:29.238273 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 31 16:04:29.238273 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 31 16:04:29.238273 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 31 16:04:29.238273 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 31 16:04:29.238273 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image cc5491e8-7a29-4de4-8ca1-76f2ed80aed9 could not be found. Aug 31 16:04:29.238273 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:04:29.238273 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:04:29.238273 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:04:29.238273 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:04:29.243376 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:04:29.243376 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:04:29.243376 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:04:29.243376 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:04:29.243376 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:04:29.243376 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:04:29.243376 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:04:29.243376 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:04:29.243376 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 31 16:04:29.243376 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 31 16:04:29.243376 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 31 16:04:29.243376 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:04:29.243376 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:04:29.243376 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:04:29.243376 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:04:29.243376 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:04:29.243376 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:04:29.243376 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:04:29.243376 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:04:29.243376 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 31 16:04:29.243376 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:04:29.243376 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5de85af8-a0ac-4697-a792-4a7cb03329d5 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Returning 404 to user: Image not found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:04:29.243376 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5de85af8-a0ac-4697-a792-4a7cb03329d5 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "DELETE /compute/v2.1/images/cc5491e8-7a29-4de4-8ca1-76f2ed80aed9" status: 404 len: 62 microversion: 2.1 time: 0.050441 Aug 31 16:04:29.251729 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1088/2192] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:29 2022] DELETE /compute/v2.1/images/cc5491e8-7a29-4de4-8ca1-76f2ed80aed9 => generated 62 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 31 16:04:29.254724 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1b341290-6a49-4fc2-b5d5-98a259c893ef tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:29.268300 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f0c0302e-19ee-4552-b700-a5b0618e387d tempest-SecurityGroupRulesTestJSON-1778299432 tempest-SecurityGroupRulesTestJSON-1778299432-project] Calling method '.version_select at 0x7f5ae8f12790>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:29.269851 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1b341290-6a49-4fc2-b5d5-98a259c893ef tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f" status: 200 len: 1392 microversion: 2.1 time: 0.329948 Aug 31 16:04:29.271070 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1105/2193] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:28 2022] GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f => generated 1392 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:29.283612 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-25d43f09-be4c-4c57-a99a-3115cccc9b78 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:29.285634 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-25d43f09-be4c-4c57-a99a-3115cccc9b78 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: 007aba90-0e41-45d6-97f2-2d20b29d4296] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:29.303228 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-25d43f09-be4c-4c57-a99a-3115cccc9b78 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:29.304505 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-25d43f09-be4c-4c57-a99a-3115cccc9b78 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:29.306818 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-25d43f09-be4c-4c57-a99a-3115cccc9b78 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:29.308679 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-25d43f09-be4c-4c57-a99a-3115cccc9b78 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:29.309639 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-25d43f09-be4c-4c57-a99a-3115cccc9b78 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:29.310689 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-25d43f09-be4c-4c57-a99a-3115cccc9b78 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:29.370744 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-25d43f09-be4c-4c57-a99a-3115cccc9b78 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: 007aba90-0e41-45d6-97f2-2d20b29d4296] Going to try to terminate instance {{(pid=122256) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:04:29.472461 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.compute.api [None req-25d43f09-be4c-4c57-a99a-3115cccc9b78 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: 007aba90-0e41-45d6-97f2-2d20b29d4296] Instance is already in deleting state, ignoring this request Aug 31 16:04:29.473519 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-25d43f09-be4c-4c57-a99a-3115cccc9b78 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "DELETE /compute/v2.1/servers/007aba90-0e41-45d6-97f2-2d20b29d4296" status: 204 len: 0 microversion: 2.1 time: 0.200789 Aug 31 16:04:29.474389 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1106/2194] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:04:29 2022] DELETE /compute/v2.1/servers/007aba90-0e41-45d6-97f2-2d20b29d4296 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:04:29.483414 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b2b41bbe-1a1d-4ed8-920a-4d1669e6260e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:29.484705 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b2b41bbe-1a1d-4ed8-920a-4d1669e6260e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 9e504a13-2fea-4da7-880d-b1782f9c5053] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:29.507642 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b2b41bbe-1a1d-4ed8-920a-4d1669e6260e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:29.508195 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b2b41bbe-1a1d-4ed8-920a-4d1669e6260e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:29.508768 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b2b41bbe-1a1d-4ed8-920a-4d1669e6260e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:29.509683 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b2b41bbe-1a1d-4ed8-920a-4d1669e6260e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:29.510675 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b2b41bbe-1a1d-4ed8-920a-4d1669e6260e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:29.510675 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b2b41bbe-1a1d-4ed8-920a-4d1669e6260e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:29.797933 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f0c0302e-19ee-4552-b700-a5b0618e387d tempest-SecurityGroupRulesTestJSON-1778299432 tempest-SecurityGroupRulesTestJSON-1778299432-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/9e13a03d-e32a-43ce-a006-3795b8b1893c" status: 202 len: 0 microversion: 2.1 time: 0.543696 Aug 31 16:04:29.798526 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1089/2195] 10.222.0.61 () {58 vars in 1272 bytes} [Wed Aug 31 16:04:29 2022] DELETE /compute/v2.1/os-security-groups/9e13a03d-e32a-43ce-a006-3795b8b1893c => generated 0 bytes in 546 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:04:29.814011 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-982242d4-9b28-44d6-8c23-5d3310aa2e83 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:29.815724 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-982242d4-9b28-44d6-8c23-5d3310aa2e83 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: 007aba90-0e41-45d6-97f2-2d20b29d4296] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:29.832036 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-982242d4-9b28-44d6-8c23-5d3310aa2e83 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:29.832843 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-982242d4-9b28-44d6-8c23-5d3310aa2e83 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:29.833475 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-982242d4-9b28-44d6-8c23-5d3310aa2e83 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:29.834517 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-982242d4-9b28-44d6-8c23-5d3310aa2e83 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:29.835771 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-982242d4-9b28-44d6-8c23-5d3310aa2e83 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:29.836404 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-982242d4-9b28-44d6-8c23-5d3310aa2e83 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:30.405196 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-982242d4-9b28-44d6-8c23-5d3310aa2e83 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ccd03a4aa84f93bc26b438e1468f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a9f3fcc4b445349e5c66ff712e8598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:30.414573 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-982242d4-9b28-44d6-8c23-5d3310aa2e83 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/servers/007aba90-0e41-45d6-97f2-2d20b29d4296" status: 200 len: 1494 microversion: 2.1 time: 0.608852 Aug 31 16:04:30.415534 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1090/2196] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:29 2022] GET /compute/v2.1/servers/007aba90-0e41-45d6-97f2-2d20b29d4296 => generated 1494 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:30.419698 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b2b41bbe-1a1d-4ed8-920a-4d1669e6260e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:30.422770 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c51b2da3-3a26-4800-bc1c-bb93227f9954 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:30.424982 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c51b2da3-3a26-4800-bc1c-bb93227f9954 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 006771fc-9da9-4b78-9fad-f4b72c311fd5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:30.430618 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b2b41bbe-1a1d-4ed8-920a-4d1669e6260e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/9e504a13-2fea-4da7-880d-b1782f9c5053" status: 200 len: 1317 microversion: 2.1 time: 0.954589 Aug 31 16:04:30.433743 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c51b2da3-3a26-4800-bc1c-bb93227f9954 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:30.434972 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c51b2da3-3a26-4800-bc1c-bb93227f9954 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:30.435717 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c51b2da3-3a26-4800-bc1c-bb93227f9954 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:30.436753 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c51b2da3-3a26-4800-bc1c-bb93227f9954 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:30.437500 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c51b2da3-3a26-4800-bc1c-bb93227f9954 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:30.438305 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c51b2da3-3a26-4800-bc1c-bb93227f9954 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:30.449756 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1107/2197] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:29 2022] GET /compute/v2.1/servers/9e504a13-2fea-4da7-880d-b1782f9c5053 => generated 1317 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:30.457994 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6f3d4377-f0b5-43c1-8d18-2a8111356e1b tempest-SecurityGroupRulesTestJSON-1778299432 tempest-SecurityGroupRulesTestJSON-1778299432-project] Calling method '.version_select at 0x7f5ae9492160>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:30.732670 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c51b2da3-3a26-4800-bc1c-bb93227f9954 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:30.758727 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c51b2da3-3a26-4800-bc1c-bb93227f9954 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:30.761976 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c51b2da3-3a26-4800-bc1c-bb93227f9954 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:30.763490 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c51b2da3-3a26-4800-bc1c-bb93227f9954 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5" status: 200 len: 1487 microversion: 2.25 time: 0.346493 Aug 31 16:04:30.764756 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1091/2198] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:04:30 2022] GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5 => generated 1487 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:04:30.772675 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a8098224-4d2f-42f1-bec3-ffb2d0c39a90 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:30.776371 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a8098224-4d2f-42f1-bec3-ffb2d0c39a90 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: f9b66475-83f6-49a3-bc63-8965fc1aec14] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:30.787279 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a8098224-4d2f-42f1-bec3-ffb2d0c39a90 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:30.788375 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a8098224-4d2f-42f1-bec3-ffb2d0c39a90 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:30.789160 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a8098224-4d2f-42f1-bec3-ffb2d0c39a90 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:30.790376 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a8098224-4d2f-42f1-bec3-ffb2d0c39a90 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:30.791062 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a8098224-4d2f-42f1-bec3-ffb2d0c39a90 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:30.791756 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a8098224-4d2f-42f1-bec3-ffb2d0c39a90 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:30.888104 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6f3d4377-f0b5-43c1-8d18-2a8111356e1b tempest-SecurityGroupRulesTestJSON-1778299432 tempest-SecurityGroupRulesTestJSON-1778299432-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/8e4bc086-7d34-4eae-b5e1-0c7504c0f1b9" status: 202 len: 0 microversion: 2.1 time: 0.433003 Aug 31 16:04:30.891690 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1108/2199] 10.222.0.61 () {58 vars in 1272 bytes} [Wed Aug 31 16:04:30 2022] DELETE /compute/v2.1/os-security-groups/8e4bc086-7d34-4eae-b5e1-0c7504c0f1b9 => generated 0 bytes in 441 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:04:30.919712 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-e882e611-c67b-4e69-b62e-190eabf4919e req-30809f05-c667-428c-8f8a-7305be32f004 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "007aba90-0e41-45d6-97f2-2d20b29d4296", "name": "network-vif-unplugged", "status": "completed", "tag": "884c2568-ad01-48ba-ac30-4fc6751c3295"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:04:30.934743 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-e882e611-c67b-4e69-b62e-190eabf4919e req-30809f05-c667-428c-8f8a-7305be32f004 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:30.936704 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-e882e611-c67b-4e69-b62e-190eabf4919e req-30809f05-c667-428c-8f8a-7305be32f004 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:30.938108 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-e882e611-c67b-4e69-b62e-190eabf4919e req-30809f05-c667-428c-8f8a-7305be32f004 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:30.966457 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-e882e611-c67b-4e69-b62e-190eabf4919e req-30809f05-c667-428c-8f8a-7305be32f004 service nova] Creating event network-vif-unplugged:884c2568-ad01-48ba-ac30-4fc6751c3295 for instance 007aba90-0e41-45d6-97f2-2d20b29d4296 on n-h2-850499-9 Aug 31 16:04:30.977595 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-e882e611-c67b-4e69-b62e-190eabf4919e req-30809f05-c667-428c-8f8a-7305be32f004 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.081738 Aug 31 16:04:30.979700 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1109/2200] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:04:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:04:30.990860 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-df0259d9-26df-4446-8a42-44d46b102a06 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:30.992377 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-df0259d9-26df-4446-8a42-44d46b102a06 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: dd702273-095b-4d44-8d1b-3d90f7833d5f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:31.007021 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-df0259d9-26df-4446-8a42-44d46b102a06 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:31.008359 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-df0259d9-26df-4446-8a42-44d46b102a06 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:31.009026 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-df0259d9-26df-4446-8a42-44d46b102a06 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:31.010126 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-df0259d9-26df-4446-8a42-44d46b102a06 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:31.010942 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-df0259d9-26df-4446-8a42-44d46b102a06 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:31.011639 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-df0259d9-26df-4446-8a42-44d46b102a06 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:31.016005 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a8098224-4d2f-42f1-bec3-ffb2d0c39a90 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:31.025687 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a8098224-4d2f-42f1-bec3-ffb2d0c39a90 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/f9b66475-83f6-49a3-bc63-8965fc1aec14" status: 200 len: 1378 microversion: 2.1 time: 0.259568 Aug 31 16:04:31.037523 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1092/2201] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:30 2022] GET /compute/v2.1/servers/f9b66475-83f6-49a3-bc63-8965fc1aec14 => generated 1378 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:31.051836 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b0b043b0-7699-4aab-9fcd-b19ff39c2e66 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:31.052627 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b0b043b0-7699-4aab-9fcd-b19ff39c2e66 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: d8590729-e3da-4e04-9daa-7e04a3d88068] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:31.061717 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b0b043b0-7699-4aab-9fcd-b19ff39c2e66 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:31.062604 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b0b043b0-7699-4aab-9fcd-b19ff39c2e66 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:31.063275 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b0b043b0-7699-4aab-9fcd-b19ff39c2e66 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:31.064236 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b0b043b0-7699-4aab-9fcd-b19ff39c2e66 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:31.065232 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b0b043b0-7699-4aab-9fcd-b19ff39c2e66 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:31.066655 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b0b043b0-7699-4aab-9fcd-b19ff39c2e66 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:31.100455 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b0b043b0-7699-4aab-9fcd-b19ff39c2e66 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: d8590729-e3da-4e04-9daa-7e04a3d88068] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:04:31.253360 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b0b043b0-7699-4aab-9fcd-b19ff39c2e66 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "DELETE /compute/v2.1/servers/d8590729-e3da-4e04-9daa-7e04a3d88068" status: 204 len: 0 microversion: 2.1 time: 0.213481 Aug 31 16:04:31.254433 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1093/2202] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:04:31 2022] DELETE /compute/v2.1/servers/d8590729-e3da-4e04-9daa-7e04a3d88068 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:04:31.269414 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a8394361-e1e5-4924-826e-dbaf82773e35 tempest-SecurityGroupRulesTestJSON-1778299432 tempest-SecurityGroupRulesTestJSON-1778299432-project] Calling method '.version_select at 0x7f5aed34d1f0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:31.287545 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-df0259d9-26df-4446-8a42-44d46b102a06 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:31.298895 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-df0259d9-26df-4446-8a42-44d46b102a06 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f" status: 200 len: 1392 microversion: 2.1 time: 0.315989 Aug 31 16:04:31.315552 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1110/2203] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:30 2022] GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f => generated 1392 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:31.341981 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a9835b81-229e-48f8-9e65-a0d1841a9560 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:31.343071 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a9835b81-229e-48f8-9e65-a0d1841a9560 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: d8590729-e3da-4e04-9daa-7e04a3d88068] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:31.366838 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a9835b81-229e-48f8-9e65-a0d1841a9560 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:31.367353 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a9835b81-229e-48f8-9e65-a0d1841a9560 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:31.367831 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a9835b81-229e-48f8-9e65-a0d1841a9560 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:31.368623 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a9835b81-229e-48f8-9e65-a0d1841a9560 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:31.369117 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a9835b81-229e-48f8-9e65-a0d1841a9560 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:31.369610 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a9835b81-229e-48f8-9e65-a0d1841a9560 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:31.632804 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a9835b81-229e-48f8-9e65-a0d1841a9560 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:31.643461 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a9835b81-229e-48f8-9e65-a0d1841a9560 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/d8590729-e3da-4e04-9daa-7e04a3d88068" status: 200 len: 1553 microversion: 2.1 time: 0.324733 Aug 31 16:04:31.644558 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1111/2204] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:31 2022] GET /compute/v2.1/servers/d8590729-e3da-4e04-9daa-7e04a3d88068 => generated 1553 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:31.656244 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-78b8a719-40c4-40df-abbb-a5429e6aadc6 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:31.656244 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-78b8a719-40c4-40df-abbb-a5429e6aadc6 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: 007aba90-0e41-45d6-97f2-2d20b29d4296] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:31.664506 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-78b8a719-40c4-40df-abbb-a5429e6aadc6 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:31.665017 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-78b8a719-40c4-40df-abbb-a5429e6aadc6 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:31.665464 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-78b8a719-40c4-40df-abbb-a5429e6aadc6 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:31.666179 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-78b8a719-40c4-40df-abbb-a5429e6aadc6 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:31.666639 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-78b8a719-40c4-40df-abbb-a5429e6aadc6 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:31.667003 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a8394361-e1e5-4924-826e-dbaf82773e35 tempest-SecurityGroupRulesTestJSON-1778299432 tempest-SecurityGroupRulesTestJSON-1778299432-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/4744aa8a-76c6-43f0-be5c-37418fd8e90c" status: 202 len: 0 microversion: 2.1 time: 0.410491 Aug 31 16:04:31.669105 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-78b8a719-40c4-40df-abbb-a5429e6aadc6 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:31.669302 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1094/2205] 10.222.0.61 () {58 vars in 1272 bytes} [Wed Aug 31 16:04:31 2022] DELETE /compute/v2.1/os-security-groups/4744aa8a-76c6-43f0-be5c-37418fd8e90c => generated 0 bytes in 413 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:04:31.674520 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d6c8a83e-7ae7-49ff-ad1f-359639287d8b tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:31.675886 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d6c8a83e-7ae7-49ff-ad1f-359639287d8b tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 9e504a13-2fea-4da7-880d-b1782f9c5053] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:31.684159 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d6c8a83e-7ae7-49ff-ad1f-359639287d8b tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:31.684855 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d6c8a83e-7ae7-49ff-ad1f-359639287d8b tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:31.685420 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d6c8a83e-7ae7-49ff-ad1f-359639287d8b tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:31.686465 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d6c8a83e-7ae7-49ff-ad1f-359639287d8b tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:31.687040 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d6c8a83e-7ae7-49ff-ad1f-359639287d8b tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:31.687605 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d6c8a83e-7ae7-49ff-ad1f-359639287d8b tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:32.448307 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d6c8a83e-7ae7-49ff-ad1f-359639287d8b tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:32.459938 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:04:32.462796 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d6c8a83e-7ae7-49ff-ad1f-359639287d8b tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/9e504a13-2fea-4da7-880d-b1782f9c5053" status: 200 len: 1317 microversion: 2.1 time: 0.792842 Aug 31 16:04:32.467543 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1095/2206] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:31 2022] GET /compute/v2.1/servers/9e504a13-2fea-4da7-880d-b1782f9c5053 => generated 1317 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:32.476862 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9b21eb50-79be-4aad-9bc7-feebda49e77f tempest-SecurityGroupRulesTestJSON-1778299432 tempest-SecurityGroupRulesTestJSON-1778299432-project] Calling method '.version_select at 0x7f5aed2f43a0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:32.608906 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-78b8a719-40c4-40df-abbb-a5429e6aadc6 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ccd03a4aa84f93bc26b438e1468f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a9f3fcc4b445349e5c66ff712e8598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:32.622974 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-78b8a719-40c4-40df-abbb-a5429e6aadc6 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/servers/007aba90-0e41-45d6-97f2-2d20b29d4296" status: 200 len: 1494 microversion: 2.1 time: 0.977157 Aug 31 16:04:32.624332 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1112/2207] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:31 2022] GET /compute/v2.1/servers/007aba90-0e41-45d6-97f2-2d20b29d4296 => generated 1494 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:32.647775 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9f19a95d-9b36-40fc-aa61-34bca1c8fcea tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:32.648469 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9f19a95d-9b36-40fc-aa61-34bca1c8fcea tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 006771fc-9da9-4b78-9fad-f4b72c311fd5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:32.660448 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9f19a95d-9b36-40fc-aa61-34bca1c8fcea tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:32.661036 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9f19a95d-9b36-40fc-aa61-34bca1c8fcea tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:32.661505 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9f19a95d-9b36-40fc-aa61-34bca1c8fcea tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:32.662445 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9f19a95d-9b36-40fc-aa61-34bca1c8fcea tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:32.663119 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9f19a95d-9b36-40fc-aa61-34bca1c8fcea tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:32.663839 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9f19a95d-9b36-40fc-aa61-34bca1c8fcea tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:32.689022 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:04:33.225758 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-9f19a95d-9b36-40fc-aa61-34bca1c8fcea tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:33.240161 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-9f19a95d-9b36-40fc-aa61-34bca1c8fcea tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:33.242892 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-9f19a95d-9b36-40fc-aa61-34bca1c8fcea tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:33.244357 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9f19a95d-9b36-40fc-aa61-34bca1c8fcea tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5" status: 200 len: 1487 microversion: 2.25 time: 0.604281 Aug 31 16:04:33.246884 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1113/2208] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:04:32 2022] GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5 => generated 1487 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:04:33.252409 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-82c50215-5e1d-4afe-a94e-be312b603aae tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:33.253015 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-82c50215-5e1d-4afe-a94e-be312b603aae tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: f9b66475-83f6-49a3-bc63-8965fc1aec14] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:33.260013 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-82c50215-5e1d-4afe-a94e-be312b603aae tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:33.260730 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-82c50215-5e1d-4afe-a94e-be312b603aae tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:33.262268 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-82c50215-5e1d-4afe-a94e-be312b603aae tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:33.263595 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-82c50215-5e1d-4afe-a94e-be312b603aae tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:33.264243 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-82c50215-5e1d-4afe-a94e-be312b603aae tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:33.264840 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-82c50215-5e1d-4afe-a94e-be312b603aae tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:33.505741 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9b21eb50-79be-4aad-9bc7-feebda49e77f tempest-SecurityGroupRulesTestJSON-1778299432 tempest-SecurityGroupRulesTestJSON-1778299432-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/4967e459-06f8-4953-b4ea-aee42792f350" status: 202 len: 0 microversion: 2.1 time: 1.032542 Aug 31 16:04:33.507488 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1096/2209] 10.222.0.61 () {58 vars in 1272 bytes} [Wed Aug 31 16:04:32 2022] DELETE /compute/v2.1/os-security-groups/4967e459-06f8-4953-b4ea-aee42792f350 => generated 0 bytes in 1039 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:04:33.514575 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-80f3b5a6-dd10-49c5-8f7f-dcc0fd7be22e tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:33.516165 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-80f3b5a6-dd10-49c5-8f7f-dcc0fd7be22e tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: dd702273-095b-4d44-8d1b-3d90f7833d5f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:33.525672 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-80f3b5a6-dd10-49c5-8f7f-dcc0fd7be22e tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:33.527601 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-80f3b5a6-dd10-49c5-8f7f-dcc0fd7be22e tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:33.529266 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-80f3b5a6-dd10-49c5-8f7f-dcc0fd7be22e tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:33.530953 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-80f3b5a6-dd10-49c5-8f7f-dcc0fd7be22e tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:33.532144 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-80f3b5a6-dd10-49c5-8f7f-dcc0fd7be22e tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:33.532820 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-80f3b5a6-dd10-49c5-8f7f-dcc0fd7be22e tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:33.806726 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=8 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:04:33.827683 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-82c50215-5e1d-4afe-a94e-be312b603aae tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:33.842672 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-82c50215-5e1d-4afe-a94e-be312b603aae tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/f9b66475-83f6-49a3-bc63-8965fc1aec14" status: 200 len: 1378 microversion: 2.1 time: 0.594289 Aug 31 16:04:33.843933 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1114/2210] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:33 2022] GET /compute/v2.1/servers/f9b66475-83f6-49a3-bc63-8965fc1aec14 => generated 1378 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:33.850033 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-815596de-af5f-4db0-9ce2-fa3f340ab534 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:33.851131 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-815596de-af5f-4db0-9ce2-fa3f340ab534 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: d8590729-e3da-4e04-9daa-7e04a3d88068] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:33.860075 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-815596de-af5f-4db0-9ce2-fa3f340ab534 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:33.861049 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-815596de-af5f-4db0-9ce2-fa3f340ab534 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:33.861683 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-815596de-af5f-4db0-9ce2-fa3f340ab534 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:33.863734 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-815596de-af5f-4db0-9ce2-fa3f340ab534 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:33.866815 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-815596de-af5f-4db0-9ce2-fa3f340ab534 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:33.868301 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-815596de-af5f-4db0-9ce2-fa3f340ab534 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:34.125339 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-80f3b5a6-dd10-49c5-8f7f-dcc0fd7be22e tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:34.142220 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-80f3b5a6-dd10-49c5-8f7f-dcc0fd7be22e tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f" status: 200 len: 1392 microversion: 2.1 time: 0.632857 Aug 31 16:04:34.143459 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1097/2211] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:33 2022] GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f => generated 1392 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:34.166996 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-0bfb4a8b-8502-430a-882d-6156bec58b7e req-43ffd718-07dd-4737-93f7-3b02789bba99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e504a13-2fea-4da7-880d-b1782f9c5053", "name": "network-vif-plugged", "status": "completed", "tag": "826d1d70-21bd-4629-a5dc-f0d355e78b2b"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:04:34.220422 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-0bfb4a8b-8502-430a-882d-6156bec58b7e req-43ffd718-07dd-4737-93f7-3b02789bba99 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:34.224444 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-0bfb4a8b-8502-430a-882d-6156bec58b7e req-43ffd718-07dd-4737-93f7-3b02789bba99 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:34.230889 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-0bfb4a8b-8502-430a-882d-6156bec58b7e req-43ffd718-07dd-4737-93f7-3b02789bba99 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:34.258241 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-0bfb4a8b-8502-430a-882d-6156bec58b7e req-43ffd718-07dd-4737-93f7-3b02789bba99 service nova] Creating event network-vif-plugged:826d1d70-21bd-4629-a5dc-f0d355e78b2b for instance 9e504a13-2fea-4da7-880d-b1782f9c5053 on n-h1-850499-9 Aug 31 16:04:34.265471 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-0bfb4a8b-8502-430a-882d-6156bec58b7e req-43ffd718-07dd-4737-93f7-3b02789bba99 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111299 Aug 31 16:04:34.266897 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1098/2212] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:04:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:04:34.273737 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-44af1d01-1da3-4f96-9a7f-7be0132ed7bf tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:34.274537 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-44af1d01-1da3-4f96-9a7f-7be0132ed7bf tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 9e504a13-2fea-4da7-880d-b1782f9c5053] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:34.282656 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-44af1d01-1da3-4f96-9a7f-7be0132ed7bf tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:34.283460 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-44af1d01-1da3-4f96-9a7f-7be0132ed7bf tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:34.284022 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-44af1d01-1da3-4f96-9a7f-7be0132ed7bf tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:34.290796 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-44af1d01-1da3-4f96-9a7f-7be0132ed7bf tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:34.291580 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-44af1d01-1da3-4f96-9a7f-7be0132ed7bf tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:34.292196 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-44af1d01-1da3-4f96-9a7f-7be0132ed7bf tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:34.628526 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-815596de-af5f-4db0-9ce2-fa3f340ab534 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:34.667661 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-815596de-af5f-4db0-9ce2-fa3f340ab534 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/d8590729-e3da-4e04-9daa-7e04a3d88068" status: 200 len: 1553 microversion: 2.1 time: 0.821081 Aug 31 16:04:34.671160 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1115/2213] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:33 2022] GET /compute/v2.1/servers/d8590729-e3da-4e04-9daa-7e04a3d88068 => generated 1553 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:34.706045 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-af8c5f6a-d91c-465d-9da8-3caa5a2f2027 tempest-SecurityGroupRulesTestJSON-1778299432 tempest-SecurityGroupRulesTestJSON-1778299432-project] Calling method '.version_select at 0x7f5ae9b36a60>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:35.193433 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-44af1d01-1da3-4f96-9a7f-7be0132ed7bf tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:35.217408 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-44af1d01-1da3-4f96-9a7f-7be0132ed7bf tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/9e504a13-2fea-4da7-880d-b1782f9c5053" status: 200 len: 1317 microversion: 2.1 time: 0.948053 Aug 31 16:04:35.218945 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1099/2214] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:34 2022] GET /compute/v2.1/servers/9e504a13-2fea-4da7-880d-b1782f9c5053 => generated 1317 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:35.231375 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2189be78-8b24-4633-b906-5e50996f2126 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:35.233235 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2189be78-8b24-4633-b906-5e50996f2126 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: 007aba90-0e41-45d6-97f2-2d20b29d4296] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:35.251472 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2189be78-8b24-4633-b906-5e50996f2126 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:35.252977 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2189be78-8b24-4633-b906-5e50996f2126 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:35.254258 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2189be78-8b24-4633-b906-5e50996f2126 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:35.256791 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2189be78-8b24-4633-b906-5e50996f2126 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:35.257889 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2189be78-8b24-4633-b906-5e50996f2126 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:35.259044 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2189be78-8b24-4633-b906-5e50996f2126 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:35.343332 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2189be78-8b24-4633-b906-5e50996f2126 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:35.344054 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2189be78-8b24-4633-b906-5e50996f2126 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:35.344808 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2189be78-8b24-4633-b906-5e50996f2126 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:35.345589 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-2189be78-8b24-4633-b906-5e50996f2126 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lazy-loading 'fault' on Instance uuid 007aba90-0e41-45d6-97f2-2d20b29d4296 {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:04:35.478999 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2189be78-8b24-4633-b906-5e50996f2126 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1ccd03a4aa84f93bc26b438e1468f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a9f3fcc4b445349e5c66ff712e8598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:35.493958 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2189be78-8b24-4633-b906-5e50996f2126 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/servers/007aba90-0e41-45d6-97f2-2d20b29d4296" status: 200 len: 1298 microversion: 2.1 time: 0.272869 Aug 31 16:04:35.496605 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1100/2215] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:35 2022] GET /compute/v2.1/servers/007aba90-0e41-45d6-97f2-2d20b29d4296 => generated 1298 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:35.504657 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3eed3cf2-b4c9-4b9a-80a4-3d122f5fe081 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:35.506450 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3eed3cf2-b4c9-4b9a-80a4-3d122f5fe081 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 006771fc-9da9-4b78-9fad-f4b72c311fd5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:35.517172 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3eed3cf2-b4c9-4b9a-80a4-3d122f5fe081 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:35.518361 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3eed3cf2-b4c9-4b9a-80a4-3d122f5fe081 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:35.519109 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3eed3cf2-b4c9-4b9a-80a4-3d122f5fe081 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:35.520263 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3eed3cf2-b4c9-4b9a-80a4-3d122f5fe081 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:35.520954 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3eed3cf2-b4c9-4b9a-80a4-3d122f5fe081 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:35.521801 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3eed3cf2-b4c9-4b9a-80a4-3d122f5fe081 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:36.324142 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3eed3cf2-b4c9-4b9a-80a4-3d122f5fe081 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:36.335387 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3eed3cf2-b4c9-4b9a-80a4-3d122f5fe081 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:36.337255 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3eed3cf2-b4c9-4b9a-80a4-3d122f5fe081 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:36.339428 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3eed3cf2-b4c9-4b9a-80a4-3d122f5fe081 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5" status: 200 len: 1487 microversion: 2.25 time: 0.840844 Aug 31 16:04:36.340498 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1101/2216] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:04:35 2022] GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5 => generated 1487 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:04:36.346862 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-2b4c761a-106f-4986-b474-c5d7752420f7 req-7b8fc833-4d06-4537-9771-acf8966a5b1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "007aba90-0e41-45d6-97f2-2d20b29d4296", "name": "network-vif-deleted", "tag": "884c2568-ad01-48ba-ac30-4fc6751c3295"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:04:36.365319 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-2b4c761a-106f-4986-b474-c5d7752420f7 req-7b8fc833-4d06-4537-9771-acf8966a5b1f service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:36.366142 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-2b4c761a-106f-4986-b474-c5d7752420f7 req-7b8fc833-4d06-4537-9771-acf8966a5b1f service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:36.366813 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-2b4c761a-106f-4986-b474-c5d7752420f7 req-7b8fc833-4d06-4537-9771-acf8966a5b1f service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:36.394605 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-af8c5f6a-d91c-465d-9da8-3caa5a2f2027 tempest-SecurityGroupRulesTestJSON-1778299432 tempest-SecurityGroupRulesTestJSON-1778299432-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/e076abb9-170b-4c8f-a85f-81cf74f78bbc" status: 202 len: 0 microversion: 2.1 time: 1.715814 Aug 31 16:04:36.396684 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1116/2217] 10.222.0.61 () {58 vars in 1272 bytes} [Wed Aug 31 16:04:34 2022] DELETE /compute/v2.1/os-security-groups/e076abb9-170b-4c8f-a85f-81cf74f78bbc => generated 0 bytes in 1724 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:04:36.405425 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-54f34a57-2f43-4e51-b996-7d427fb44973 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:36.408960 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-54f34a57-2f43-4e51-b996-7d427fb44973 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: f9b66475-83f6-49a3-bc63-8965fc1aec14] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:36.409291 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-2b4c761a-106f-4986-b474-c5d7752420f7 req-7b8fc833-4d06-4537-9771-acf8966a5b1f service nova] Creating event network-vif-deleted:884c2568-ad01-48ba-ac30-4fc6751c3295 for instance 007aba90-0e41-45d6-97f2-2d20b29d4296 on n-h2-850499-9 Aug 31 16:04:36.417168 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-2b4c761a-106f-4986-b474-c5d7752420f7 req-7b8fc833-4d06-4537-9771-acf8966a5b1f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074043 Aug 31 16:04:36.420547 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1102/2218] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:04:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:04:36.427406 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-54f34a57-2f43-4e51-b996-7d427fb44973 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:36.428048 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-54f34a57-2f43-4e51-b996-7d427fb44973 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:36.429439 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-54f34a57-2f43-4e51-b996-7d427fb44973 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:36.434469 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-54f34a57-2f43-4e51-b996-7d427fb44973 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:36.435363 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-54f34a57-2f43-4e51-b996-7d427fb44973 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:36.436657 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-54f34a57-2f43-4e51-b996-7d427fb44973 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:36.441241 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ff96aafb-052d-4ffe-8199-7a0576ed8559 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:36.442897 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ff96aafb-052d-4ffe-8199-7a0576ed8559 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: dd702273-095b-4d44-8d1b-3d90f7833d5f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:36.461456 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ff96aafb-052d-4ffe-8199-7a0576ed8559 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:36.462466 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ff96aafb-052d-4ffe-8199-7a0576ed8559 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:36.463157 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ff96aafb-052d-4ffe-8199-7a0576ed8559 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:36.464817 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ff96aafb-052d-4ffe-8199-7a0576ed8559 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:36.465687 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ff96aafb-052d-4ffe-8199-7a0576ed8559 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:36.466826 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ff96aafb-052d-4ffe-8199-7a0576ed8559 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:37.258874 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-54f34a57-2f43-4e51-b996-7d427fb44973 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:37.271825 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-54f34a57-2f43-4e51-b996-7d427fb44973 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/f9b66475-83f6-49a3-bc63-8965fc1aec14" status: 200 len: 1378 microversion: 2.1 time: 0.868837 Aug 31 16:04:37.272471 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1117/2219] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:36 2022] GET /compute/v2.1/servers/f9b66475-83f6-49a3-bc63-8965fc1aec14 => generated 1378 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:37.281940 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-601c419d-c035-420a-af8e-17b2efddf178 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:37.284214 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-601c419d-c035-420a-af8e-17b2efddf178 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: d8590729-e3da-4e04-9daa-7e04a3d88068] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:37.297734 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-601c419d-c035-420a-af8e-17b2efddf178 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:37.298520 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-601c419d-c035-420a-af8e-17b2efddf178 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:37.298963 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-601c419d-c035-420a-af8e-17b2efddf178 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:37.304647 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-601c419d-c035-420a-af8e-17b2efddf178 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:37.305273 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-601c419d-c035-420a-af8e-17b2efddf178 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:37.305718 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-601c419d-c035-420a-af8e-17b2efddf178 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:37.306257 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ff96aafb-052d-4ffe-8199-7a0576ed8559 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:37.321459 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ff96aafb-052d-4ffe-8199-7a0576ed8559 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f" status: 200 len: 1392 microversion: 2.1 time: 0.897757 Aug 31 16:04:37.321985 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1103/2220] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:36 2022] GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f => generated 1392 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:37.327884 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-45030b78-bb6a-477d-96cf-7cdf6c4e13b8 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:37.336912 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-45030b78-bb6a-477d-96cf-7cdf6c4e13b8 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 9e504a13-2fea-4da7-880d-b1782f9c5053] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:37.348324 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-45030b78-bb6a-477d-96cf-7cdf6c4e13b8 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:37.349108 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-45030b78-bb6a-477d-96cf-7cdf6c4e13b8 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:37.354671 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-45030b78-bb6a-477d-96cf-7cdf6c4e13b8 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:37.356454 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-45030b78-bb6a-477d-96cf-7cdf6c4e13b8 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:37.357154 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-45030b78-bb6a-477d-96cf-7cdf6c4e13b8 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:37.358063 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-45030b78-bb6a-477d-96cf-7cdf6c4e13b8 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:37.799891 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-601c419d-c035-420a-af8e-17b2efddf178 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:37.816521 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-601c419d-c035-420a-af8e-17b2efddf178 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/d8590729-e3da-4e04-9daa-7e04a3d88068" status: 200 len: 1345 microversion: 2.1 time: 0.542826 Aug 31 16:04:37.818864 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1118/2221] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:37 2022] GET /compute/v2.1/servers/d8590729-e3da-4e04-9daa-7e04a3d88068 => generated 1345 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:37.852550 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-28522295-a5bb-46f0-8283-ba9bffb0baf1 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:37.854190 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-28522295-a5bb-46f0-8283-ba9bffb0baf1 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: 007aba90-0e41-45d6-97f2-2d20b29d4296] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:37.866409 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-28522295-a5bb-46f0-8283-ba9bffb0baf1 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:37.866906 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-28522295-a5bb-46f0-8283-ba9bffb0baf1 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:37.871437 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-28522295-a5bb-46f0-8283-ba9bffb0baf1 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:37.874270 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-28522295-a5bb-46f0-8283-ba9bffb0baf1 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:37.874992 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-28522295-a5bb-46f0-8283-ba9bffb0baf1 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:37.875773 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-28522295-a5bb-46f0-8283-ba9bffb0baf1 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:37.926322 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-28522295-a5bb-46f0-8283-ba9bffb0baf1 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] HTTP exception thrown: Instance 007aba90-0e41-45d6-97f2-2d20b29d4296 could not be found. Aug 31 16:04:37.929001 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-28522295-a5bb-46f0-8283-ba9bffb0baf1 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Request method failure captured: Aug 31 16:04:37.929001 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/007aba90-0e41-45d6-97f2-2d20b29d4296 HTTP/1.1 Aug 31 16:04:37.929001 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:04:37.929001 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:04:37.929001 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:04:37.929001 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:04:37.929001 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:04:37.929001 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:04:37.929001 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:04:37.929001 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:04:37.929001 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4WG8AwQfYxlaGjRgYpPss_ZLDHrwQ0s3V0ZYjpGoaX5c5ru3y4LKPsB00yIoE66HOwzwSIJazTKHiyNnca12D_Uy-mgAi8PZmyamMJJse3n9yKimFm7AmbTJuRTt52xba3n10yK-nX_dGyxA35SpAwrRJtOVgpB_jiU61ZzJvR7O8M Aug 31 16:04:37.929001 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:04:37.929001 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:04:37.929001 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:04:37.929001 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:04:37.929001 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:04:37.929001 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:04:37.929001 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 61a9f3fcc4b445349e5c66ff712e8598 Aug 31 16:04:37.929001 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ImagesTestJSON-1850054072 Aug 31 16:04:37.929001 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:04:37.929001 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:04:37.929001 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/61a9f3fcc4b445349e5c66ff712e8598"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/61a9f3fcc4b445349e5c66ff712e8598"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_61a9f3fcc4b445349e5c66ff712e8598", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/61a9f3fcc4b445349e5c66ff712e8598"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:04:37.929001 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ImagesTestJSON-1850054072 Aug 31 16:04:37.929001 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 61a9f3fcc4b445349e5c66ff712e8598 Aug 31 16:04:37.929001 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ImagesTestJSON-1850054072 Aug 31 16:04:37.929001 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ImagesTestJSON-1850054072-project Aug 31 16:04:37.929001 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:04:37.929001 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:04:37.929001 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: f1ccd03a4aa84f93bc26b438e1468f46 Aug 31 16:04:37.929001 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ImagesTestJSON-1850054072-project Aug 31 16:04:37.929001 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:04:37.929001 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance 007aba90-0e41-45d6-97f2-2d20b29d4296 could not be found. Aug 31 16:04:37.929001 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '007aba90-0e41-45d6-97f2-2d20b29d4296'} Aug 31 16:04:37.929001 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:04:37.929001 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:04:37.929001 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:04:37.929001 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:04:37.929001 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:04:37.929001 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:04:37.929001 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:04:37.929001 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:04:37.929001 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:04:37.929001 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:04:37.929001 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 007aba90-0e41-45d6-97f2-2d20b29d4296 could not be found. Aug 31 16:04:37.929001 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:04:37.929001 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:04:37.929001 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:04:37.929001 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:04:37.929001 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:04:37.929001 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:04:37.929001 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:04:37.929001 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:04:37.929001 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:04:37.929001 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:04:37.929001 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:04:37.929001 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:04:37.929001 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:04:37.929001 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:04:37.929001 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:04:37.929001 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:04:37.929001 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 007aba90-0e41-45d6-97f2-2d20b29d4296 could not be found. Aug 31 16:04:37.929001 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:04:37.929001 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:04:37.929001 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:04:37.929001 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:04:37.936315 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:04:37.936315 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:04:37.936315 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:04:37.936315 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:04:37.936315 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 007aba90-0e41-45d6-97f2-2d20b29d4296 could not be found. Aug 31 16:04:37.936315 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:04:37.936315 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-28522295-a5bb-46f0-8283-ba9bffb0baf1 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Returning 404 to user: Instance 007aba90-0e41-45d6-97f2-2d20b29d4296 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:04:37.936315 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-28522295-a5bb-46f0-8283-ba9bffb0baf1 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/servers/007aba90-0e41-45d6-97f2-2d20b29d4296" status: 404 len: 111 microversion: 2.1 time: 0.113463 Aug 31 16:04:37.938566 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1119/2222] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:37 2022] GET /compute/v2.1/servers/007aba90-0e41-45d6-97f2-2d20b29d4296 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:04:37.943590 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-83be5018-1607-4fb7-8a72-e0222c04b76e tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:37.944254 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-83be5018-1607-4fb7-8a72-e0222c04b76e tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 006771fc-9da9-4b78-9fad-f4b72c311fd5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:37.954724 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-83be5018-1607-4fb7-8a72-e0222c04b76e tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:37.967045 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-83be5018-1607-4fb7-8a72-e0222c04b76e tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:37.968110 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-83be5018-1607-4fb7-8a72-e0222c04b76e tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:37.969170 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-83be5018-1607-4fb7-8a72-e0222c04b76e tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:37.969817 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-83be5018-1607-4fb7-8a72-e0222c04b76e tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:37.970633 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-83be5018-1607-4fb7-8a72-e0222c04b76e tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:38.016947 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-45030b78-bb6a-477d-96cf-7cdf6c4e13b8 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:38.032876 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-45030b78-bb6a-477d-96cf-7cdf6c4e13b8 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/9e504a13-2fea-4da7-880d-b1782f9c5053" status: 200 len: 1467 microversion: 2.1 time: 0.709292 Aug 31 16:04:38.044114 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1104/2223] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:37 2022] GET /compute/v2.1/servers/9e504a13-2fea-4da7-880d-b1782f9c5053 => generated 1467 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:38.060762 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d9493794-c82a-40b7-a65b-131a0977884a tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '.version_select at 0x7f5ae8cf6430>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:38.099424 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-d9493794-c82a-40b7-a65b-131a0977884a tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] HTTP exception thrown: Image not found. Aug 31 16:04:38.101848 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d9493794-c82a-40b7-a65b-131a0977884a tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Request method failure captured: Aug 31 16:04:38.101848 n-d-850499-9 devstack@n-api.service[122257]: request: DELETE /compute/v2.1/images/f505c75e-a15d-44cb-980b-62f98132dcb9 HTTP/1.1 Aug 31 16:04:38.101848 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:04:38.101848 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:04:38.101848 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:04:38.101848 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:04:38.101848 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:04:38.101848 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:04:38.101848 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:04:38.101848 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:04:38.101848 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4WG8AwQfYxlaGjRgYpPss_ZLDHrwQ0s3V0ZYjpGoaX5c5ru3y4LKPsB00yIoE66HOwzwSIJazTKHiyNnca12D_Uy-mgAi8PZmyamMJJse3n9yKimFm7AmbTJuRTt52xba3n10yK-nX_dGyxA35SpAwrRJtOVgpB_jiU61ZzJvR7O8M Aug 31 16:04:38.101848 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:04:38.101848 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:04:38.101848 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:04:38.101848 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:04:38.101848 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:04:38.101848 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:04:38.101848 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 61a9f3fcc4b445349e5c66ff712e8598 Aug 31 16:04:38.101848 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ImagesTestJSON-1850054072 Aug 31 16:04:38.101848 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:04:38.101848 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:04:38.101848 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/61a9f3fcc4b445349e5c66ff712e8598"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/61a9f3fcc4b445349e5c66ff712e8598"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_61a9f3fcc4b445349e5c66ff712e8598", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/61a9f3fcc4b445349e5c66ff712e8598"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:04:38.101848 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ImagesTestJSON-1850054072 Aug 31 16:04:38.101848 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 61a9f3fcc4b445349e5c66ff712e8598 Aug 31 16:04:38.101848 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ImagesTestJSON-1850054072 Aug 31 16:04:38.101848 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ImagesTestJSON-1850054072-project Aug 31 16:04:38.101848 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:04:38.101848 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:04:38.101848 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: f1ccd03a4aa84f93bc26b438e1468f46 Aug 31 16:04:38.101848 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ImagesTestJSON-1850054072-project Aug 31 16:04:38.101848 n-d-850499-9 devstack@n-api.service[122257]: method: Aug 31 16:04:38.101848 n-d-850499-9 devstack@n-api.service[122257]: exception: Image not found. Aug 31 16:04:38.101848 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': 'f505c75e-a15d-44cb-980b-62f98132dcb9'} Aug 31 16:04:38.101848 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:04:38.101848 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:04:38.101848 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 31 16:04:38.101848 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 31 16:04:38.101848 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 31 16:04:38.101848 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 31 16:04:38.101848 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 31 16:04:38.101848 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 31 16:04:38.101848 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 31 16:04:38.101848 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 31 16:04:38.101848 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 31 16:04:38.101848 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 31 16:04:38.101848 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 31 16:04:38.101848 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 31 16:04:38.101848 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 31 16:04:38.101848 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 31 16:04:38.101848 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image f505c75e-a15d-44cb-980b-62f98132dcb9 to delete Aug 31 16:04:38.101848 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:04:38.101848 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:04:38.101848 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:04:38.101848 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:04:38.101848 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 31 16:04:38.101848 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 31 16:04:38.101848 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 31 16:04:38.101848 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 31 16:04:38.101848 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 31 16:04:38.101848 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 31 16:04:38.101848 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f505c75e-a15d-44cb-980b-62f98132dcb9 could not be found. Aug 31 16:04:38.101848 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:04:38.101848 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:04:38.101848 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:04:38.101848 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:04:38.113827 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:04:38.113827 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:04:38.113827 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:04:38.113827 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:04:38.113827 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:04:38.113827 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:04:38.113827 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:04:38.113827 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:04:38.113827 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 31 16:04:38.113827 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 31 16:04:38.113827 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 31 16:04:38.113827 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:04:38.113827 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:04:38.113827 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:04:38.113827 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:04:38.113827 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:04:38.113827 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:04:38.113827 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:04:38.113827 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:04:38.113827 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 31 16:04:38.113827 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:04:38.113827 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d9493794-c82a-40b7-a65b-131a0977884a tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Returning 404 to user: Image not found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:04:38.113827 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d9493794-c82a-40b7-a65b-131a0977884a tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "DELETE /compute/v2.1/images/f505c75e-a15d-44cb-980b-62f98132dcb9" status: 404 len: 62 microversion: 2.1 time: 0.050630 Aug 31 16:04:38.113827 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1105/2224] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:38 2022] DELETE /compute/v2.1/images/f505c75e-a15d-44cb-980b-62f98132dcb9 => generated 62 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 31 16:04:38.118481 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-352fd9dc-ebb9-4360-9e43-74725dfffe12 tempest-ServersOnMultiNodesTest-1555970217 tempest-ServersOnMultiNodesTest-1555970217-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:38.118481 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-352fd9dc-ebb9-4360-9e43-74725dfffe12 tempest-ServersOnMultiNodesTest-1555970217 tempest-ServersOnMultiNodesTest-1555970217-project-admin] [instance: 9e504a13-2fea-4da7-880d-b1782f9c5053] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:38.139475 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-352fd9dc-ebb9-4360-9e43-74725dfffe12 tempest-ServersOnMultiNodesTest-1555970217 tempest-ServersOnMultiNodesTest-1555970217-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:38.141802 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-352fd9dc-ebb9-4360-9e43-74725dfffe12 tempest-ServersOnMultiNodesTest-1555970217 tempest-ServersOnMultiNodesTest-1555970217-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:38.143258 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-352fd9dc-ebb9-4360-9e43-74725dfffe12 tempest-ServersOnMultiNodesTest-1555970217 tempest-ServersOnMultiNodesTest-1555970217-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:38.144695 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-352fd9dc-ebb9-4360-9e43-74725dfffe12 tempest-ServersOnMultiNodesTest-1555970217 tempest-ServersOnMultiNodesTest-1555970217-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:38.148749 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-352fd9dc-ebb9-4360-9e43-74725dfffe12 tempest-ServersOnMultiNodesTest-1555970217 tempest-ServersOnMultiNodesTest-1555970217-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:38.149789 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-352fd9dc-ebb9-4360-9e43-74725dfffe12 tempest-ServersOnMultiNodesTest-1555970217 tempest-ServersOnMultiNodesTest-1555970217-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:38.337945 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-83be5018-1607-4fb7-8a72-e0222c04b76e tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:38.351751 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-83be5018-1607-4fb7-8a72-e0222c04b76e tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:38.353737 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-83be5018-1607-4fb7-8a72-e0222c04b76e tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:38.356615 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-83be5018-1607-4fb7-8a72-e0222c04b76e tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5" status: 200 len: 1487 microversion: 2.25 time: 0.416315 Aug 31 16:04:38.357902 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1120/2225] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:04:37 2022] GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5 => generated 1487 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:04:38.368709 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c7a093aa-bcb4-4bd4-9e03-39ac42978a86 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:38.369556 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c7a093aa-bcb4-4bd4-9e03-39ac42978a86 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: cafdad7c-e670-48df-8c07-a2405d19f357] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:38.378382 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c7a093aa-bcb4-4bd4-9e03-39ac42978a86 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:38.378888 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c7a093aa-bcb4-4bd4-9e03-39ac42978a86 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:38.379398 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c7a093aa-bcb4-4bd4-9e03-39ac42978a86 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:38.380219 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c7a093aa-bcb4-4bd4-9e03-39ac42978a86 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:38.380683 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c7a093aa-bcb4-4bd4-9e03-39ac42978a86 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:38.381171 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c7a093aa-bcb4-4bd4-9e03-39ac42978a86 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:38.408199 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-c7a093aa-bcb4-4bd4-9e03-39ac42978a86 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] HTTP exception thrown: Instance cafdad7c-e670-48df-8c07-a2405d19f357 could not be found. Aug 31 16:04:38.411534 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c7a093aa-bcb4-4bd4-9e03-39ac42978a86 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Request method failure captured: Aug 31 16:04:38.411534 n-d-850499-9 devstack@n-api.service[122256]: request: DELETE /compute/v2.1/servers/cafdad7c-e670-48df-8c07-a2405d19f357 HTTP/1.1 Aug 31 16:04:38.411534 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:04:38.411534 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:04:38.411534 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:04:38.411534 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:04:38.411534 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:04:38.411534 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:04:38.411534 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:04:38.411534 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:04:38.411534 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4WG8AwQfYxlaGjRgYpPss_ZLDHrwQ0s3V0ZYjpGoaX5c5ru3y4LKPsB00yIoE66HOwzwSIJazTKHiyNnca12D_Uy-mgAi8PZmyamMJJse3n9yKimFm7AmbTJuRTt52xba3n10yK-nX_dGyxA35SpAwrRJtOVgpB_jiU61ZzJvR7O8M Aug 31 16:04:38.411534 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:04:38.411534 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:04:38.411534 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:04:38.411534 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:04:38.411534 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:04:38.411534 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:04:38.411534 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 61a9f3fcc4b445349e5c66ff712e8598 Aug 31 16:04:38.411534 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ImagesTestJSON-1850054072 Aug 31 16:04:38.411534 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:04:38.411534 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:04:38.411534 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/61a9f3fcc4b445349e5c66ff712e8598"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/61a9f3fcc4b445349e5c66ff712e8598"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_61a9f3fcc4b445349e5c66ff712e8598", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/61a9f3fcc4b445349e5c66ff712e8598"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:04:38.411534 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ImagesTestJSON-1850054072 Aug 31 16:04:38.411534 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 61a9f3fcc4b445349e5c66ff712e8598 Aug 31 16:04:38.411534 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ImagesTestJSON-1850054072 Aug 31 16:04:38.411534 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ImagesTestJSON-1850054072-project Aug 31 16:04:38.411534 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:04:38.411534 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:04:38.411534 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: f1ccd03a4aa84f93bc26b438e1468f46 Aug 31 16:04:38.411534 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ImagesTestJSON-1850054072-project Aug 31 16:04:38.411534 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:04:38.411534 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance cafdad7c-e670-48df-8c07-a2405d19f357 could not be found. Aug 31 16:04:38.411534 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': 'cafdad7c-e670-48df-8c07-a2405d19f357'} Aug 31 16:04:38.411534 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:04:38.411534 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:04:38.411534 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:04:38.411534 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:04:38.411534 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:04:38.411534 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:04:38.411534 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:04:38.411534 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:04:38.411534 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:04:38.411534 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:04:38.411534 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cafdad7c-e670-48df-8c07-a2405d19f357 could not be found. Aug 31 16:04:38.411534 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:04:38.411534 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:04:38.411534 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:04:38.411534 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:04:38.411534 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:04:38.411534 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:04:38.411534 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:04:38.411534 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:04:38.411534 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:04:38.411534 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:04:38.411534 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:04:38.411534 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:04:38.411534 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:04:38.411534 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:04:38.411534 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:04:38.411534 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:04:38.411534 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:04:38.411534 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:04:38.411534 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cafdad7c-e670-48df-8c07-a2405d19f357 could not be found. Aug 31 16:04:38.419435 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:04:38.419435 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:04:38.419435 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:04:38.419435 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:04:38.419435 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:04:38.419435 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:04:38.419435 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:04:38.419435 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:04:38.419435 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cafdad7c-e670-48df-8c07-a2405d19f357 could not be found. Aug 31 16:04:38.419435 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:04:38.423626 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c7a093aa-bcb4-4bd4-9e03-39ac42978a86 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Returning 404 to user: Instance cafdad7c-e670-48df-8c07-a2405d19f357 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:04:38.425072 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c7a093aa-bcb4-4bd4-9e03-39ac42978a86 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "DELETE /compute/v2.1/servers/cafdad7c-e670-48df-8c07-a2405d19f357" status: 404 len: 111 microversion: 2.1 time: 0.065612 Aug 31 16:04:38.426646 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1121/2226] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:04:38 2022] DELETE /compute/v2.1/servers/cafdad7c-e670-48df-8c07-a2405d19f357 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:04:38.434162 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6ac91194-33ec-4733-a222-7245c37fcc8e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:38.435401 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6ac91194-33ec-4733-a222-7245c37fcc8e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: f9b66475-83f6-49a3-bc63-8965fc1aec14] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:38.444206 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6ac91194-33ec-4733-a222-7245c37fcc8e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:38.445506 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6ac91194-33ec-4733-a222-7245c37fcc8e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:38.446430 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6ac91194-33ec-4733-a222-7245c37fcc8e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:38.447674 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6ac91194-33ec-4733-a222-7245c37fcc8e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:38.448408 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6ac91194-33ec-4733-a222-7245c37fcc8e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:38.450690 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6ac91194-33ec-4733-a222-7245c37fcc8e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:38.475141 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-352fd9dc-ebb9-4360-9e43-74725dfffe12 tempest-ServersOnMultiNodesTest-1555970217 tempest-ServersOnMultiNodesTest-1555970217-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/9e504a13-2fea-4da7-880d-b1782f9c5053" status: 200 len: 1618 microversion: 2.1 time: 0.364839 Aug 31 16:04:38.478553 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1106/2227] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:38 2022] GET /compute/v2.1/servers/9e504a13-2fea-4da7-880d-b1782f9c5053 => generated 1618 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:38.490466 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a89e26a9-13dc-4d27-bc23-3d3eef9cbd64 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:38.492131 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a89e26a9-13dc-4d27-bc23-3d3eef9cbd64 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: dd702273-095b-4d44-8d1b-3d90f7833d5f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:38.509760 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a89e26a9-13dc-4d27-bc23-3d3eef9cbd64 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:38.512381 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a89e26a9-13dc-4d27-bc23-3d3eef9cbd64 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:38.514228 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a89e26a9-13dc-4d27-bc23-3d3eef9cbd64 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:38.517093 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a89e26a9-13dc-4d27-bc23-3d3eef9cbd64 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:38.518709 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a89e26a9-13dc-4d27-bc23-3d3eef9cbd64 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:38.521416 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a89e26a9-13dc-4d27-bc23-3d3eef9cbd64 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:38.928147 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-6ac91194-33ec-4733-a222-7245c37fcc8e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:38.942586 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6ac91194-33ec-4733-a222-7245c37fcc8e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/f9b66475-83f6-49a3-bc63-8965fc1aec14" status: 200 len: 1378 microversion: 2.1 time: 0.511807 Aug 31 16:04:38.944764 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1122/2228] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:38 2022] GET /compute/v2.1/servers/f9b66475-83f6-49a3-bc63-8965fc1aec14 => generated 1378 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:38.947834 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a89e26a9-13dc-4d27-bc23-3d3eef9cbd64 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:38.951417 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7886ae09-b4ff-490d-b8a5-36a33b0ae347 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:38.952702 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7886ae09-b4ff-490d-b8a5-36a33b0ae347 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: cafdad7c-e670-48df-8c07-a2405d19f357] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:38.960468 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a89e26a9-13dc-4d27-bc23-3d3eef9cbd64 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f" status: 200 len: 1392 microversion: 2.1 time: 0.480342 Aug 31 16:04:38.962307 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1107/2229] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:38 2022] GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f => generated 1392 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:38.969898 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-f69d2b61-1b5d-4d32-86bd-bffb185752e2 req-4dceecd0-52cc-452d-88bf-00663081b9eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9b66475-83f6-49a3-bc63-8965fc1aec14", "tag": "c1929c28-a0f2-4fed-aba4-ecfd08ac8e7e"}, {"server_uuid": "d8590729-e3da-4e04-9daa-7e04a3d88068", "name": "network-vif-deleted", "tag": "ad3a95e6-8a22-4c56-abd4-a82f6b1e06b0"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:04:38.976814 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7886ae09-b4ff-490d-b8a5-36a33b0ae347 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:38.979357 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7886ae09-b4ff-490d-b8a5-36a33b0ae347 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:38.979841 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7886ae09-b4ff-490d-b8a5-36a33b0ae347 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:38.980795 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7886ae09-b4ff-490d-b8a5-36a33b0ae347 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:38.981255 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7886ae09-b4ff-490d-b8a5-36a33b0ae347 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:38.981736 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7886ae09-b4ff-490d-b8a5-36a33b0ae347 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:39.006779 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-f69d2b61-1b5d-4d32-86bd-bffb185752e2 req-4dceecd0-52cc-452d-88bf-00663081b9eb service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:39.008148 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-f69d2b61-1b5d-4d32-86bd-bffb185752e2 req-4dceecd0-52cc-452d-88bf-00663081b9eb service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:39.009770 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-f69d2b61-1b5d-4d32-86bd-bffb185752e2 req-4dceecd0-52cc-452d-88bf-00663081b9eb service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:39.022054 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-7886ae09-b4ff-490d-b8a5-36a33b0ae347 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] HTTP exception thrown: Instance cafdad7c-e670-48df-8c07-a2405d19f357 could not be found. Aug 31 16:04:39.029465 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7886ae09-b4ff-490d-b8a5-36a33b0ae347 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Request method failure captured: Aug 31 16:04:39.029465 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/cafdad7c-e670-48df-8c07-a2405d19f357 HTTP/1.1 Aug 31 16:04:39.029465 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:04:39.029465 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:04:39.029465 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:04:39.029465 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:04:39.029465 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:04:39.029465 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:04:39.029465 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:04:39.029465 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:04:39.029465 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4WG8AwQfYxlaGjRgYpPss_ZLDHrwQ0s3V0ZYjpGoaX5c5ru3y4LKPsB00yIoE66HOwzwSIJazTKHiyNnca12D_Uy-mgAi8PZmyamMJJse3n9yKimFm7AmbTJuRTt52xba3n10yK-nX_dGyxA35SpAwrRJtOVgpB_jiU61ZzJvR7O8M Aug 31 16:04:39.029465 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:04:39.029465 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:04:39.029465 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:04:39.029465 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:04:39.029465 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:04:39.029465 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:04:39.029465 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 61a9f3fcc4b445349e5c66ff712e8598 Aug 31 16:04:39.029465 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ImagesTestJSON-1850054072 Aug 31 16:04:39.029465 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:04:39.029465 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:04:39.029465 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/61a9f3fcc4b445349e5c66ff712e8598"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/61a9f3fcc4b445349e5c66ff712e8598"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_61a9f3fcc4b445349e5c66ff712e8598", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/61a9f3fcc4b445349e5c66ff712e8598"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:04:39.029465 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ImagesTestJSON-1850054072 Aug 31 16:04:39.029465 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 61a9f3fcc4b445349e5c66ff712e8598 Aug 31 16:04:39.029465 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ImagesTestJSON-1850054072 Aug 31 16:04:39.029465 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ImagesTestJSON-1850054072-project Aug 31 16:04:39.029465 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:04:39.029465 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:04:39.029465 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: f1ccd03a4aa84f93bc26b438e1468f46 Aug 31 16:04:39.029465 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ImagesTestJSON-1850054072-project Aug 31 16:04:39.029465 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:04:39.029465 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance cafdad7c-e670-48df-8c07-a2405d19f357 could not be found. Aug 31 16:04:39.029465 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': 'cafdad7c-e670-48df-8c07-a2405d19f357'} Aug 31 16:04:39.029465 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:04:39.029465 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:04:39.029465 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:04:39.029465 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:04:39.029465 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:04:39.029465 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:04:39.029465 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:04:39.029465 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:04:39.029465 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:04:39.029465 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:04:39.029465 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cafdad7c-e670-48df-8c07-a2405d19f357 could not be found. Aug 31 16:04:39.029465 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:04:39.029465 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:04:39.029465 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:04:39.029465 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:04:39.029465 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:04:39.029465 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:04:39.029465 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:04:39.029465 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:04:39.029465 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:04:39.029465 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:04:39.029465 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:04:39.029465 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:04:39.029465 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:04:39.029465 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:04:39.029465 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:04:39.029465 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:04:39.029465 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cafdad7c-e670-48df-8c07-a2405d19f357 could not be found. Aug 31 16:04:39.029465 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:04:39.029465 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:04:39.029465 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:04:39.029465 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:04:39.035751 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:04:39.035751 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:04:39.035751 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:04:39.035751 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:04:39.035751 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cafdad7c-e670-48df-8c07-a2405d19f357 could not be found. Aug 31 16:04:39.035751 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:04:39.039871 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7886ae09-b4ff-490d-b8a5-36a33b0ae347 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Returning 404 to user: Instance cafdad7c-e670-48df-8c07-a2405d19f357 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:04:39.043406 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7886ae09-b4ff-490d-b8a5-36a33b0ae347 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/servers/cafdad7c-e670-48df-8c07-a2405d19f357" status: 404 len: 111 microversion: 2.1 time: 0.094766 Aug 31 16:04:39.047287 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1123/2230] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:38 2022] GET /compute/v2.1/servers/cafdad7c-e670-48df-8c07-a2405d19f357 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:04:39.069637 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-f69d2b61-1b5d-4d32-86bd-bffb185752e2 req-4dceecd0-52cc-452d-88bf-00663081b9eb service nova] Creating event network-changed:c1929c28-a0f2-4fed-aba4-ecfd08ac8e7e for instance f9b66475-83f6-49a3-bc63-8965fc1aec14 on n-h2-850499-9 Aug 31 16:04:39.071901 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-f69d2b61-1b5d-4d32-86bd-bffb185752e2 req-4dceecd0-52cc-452d-88bf-00663081b9eb service nova] Creating event network-vif-deleted:ad3a95e6-8a22-4c56-abd4-a82f6b1e06b0 for instance d8590729-e3da-4e04-9daa-7e04a3d88068 on n-h1-850499-9 Aug 31 16:04:39.073132 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e447caf0-d45e-42c3-b0d3-8e4ada1ef29f tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1242967265", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "44f1ab8f-3a6c-41f3-b9fd-7f8aa243bcfa"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:04:39.101072 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-f69d2b61-1b5d-4d32-86bd-bffb185752e2 req-4dceecd0-52cc-452d-88bf-00663081b9eb service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.135045 Aug 31 16:04:39.102597 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1108/2231] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:04:38 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:04:39.115698 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3fcef999-02b8-4e76-8b12-7f9569b62c78 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:39.117700 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3fcef999-02b8-4e76-8b12-7f9569b62c78 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: d8590729-e3da-4e04-9daa-7e04a3d88068] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:39.131079 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3fcef999-02b8-4e76-8b12-7f9569b62c78 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:39.132170 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3fcef999-02b8-4e76-8b12-7f9569b62c78 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:39.132798 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3fcef999-02b8-4e76-8b12-7f9569b62c78 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:39.134465 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3fcef999-02b8-4e76-8b12-7f9569b62c78 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:39.140338 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3fcef999-02b8-4e76-8b12-7f9569b62c78 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:39.155198 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3fcef999-02b8-4e76-8b12-7f9569b62c78 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:39.274154 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-e447caf0-d45e-42c3-b0d3-8e4ada1ef29f tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] validate_networks() for None {{(pid=122256) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:04:39.455407 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3fcef999-02b8-4e76-8b12-7f9569b62c78 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:39.471218 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3fcef999-02b8-4e76-8b12-7f9569b62c78 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/d8590729-e3da-4e04-9daa-7e04a3d88068" status: 200 len: 1345 microversion: 2.1 time: 0.366494 Aug 31 16:04:39.472643 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1109/2232] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:39 2022] GET /compute/v2.1/servers/d8590729-e3da-4e04-9daa-7e04a3d88068 => generated 1345 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:39.482693 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ed3925a8-bdc5-4e4a-b127-a87dee0c5dbb tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '.version_select at 0x7f5aed34d4c0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:39.546745 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-ed3925a8-bdc5-4e4a-b127-a87dee0c5dbb tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] HTTP exception thrown: Image not found. Aug 31 16:04:39.549655 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ed3925a8-bdc5-4e4a-b127-a87dee0c5dbb tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Request method failure captured: Aug 31 16:04:39.549655 n-d-850499-9 devstack@n-api.service[122257]: request: DELETE /compute/v2.1/images/34d69a63-c14a-4d91-9d9f-38bc5d717b66 HTTP/1.1 Aug 31 16:04:39.549655 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:04:39.549655 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:04:39.549655 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:04:39.549655 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:04:39.549655 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:04:39.549655 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:04:39.549655 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:04:39.549655 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:04:39.549655 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4WG8AwQfYxlaGjRgYpPss_ZLDHrwQ0s3V0ZYjpGoaX5c5ru3y4LKPsB00yIoE66HOwzwSIJazTKHiyNnca12D_Uy-mgAi8PZmyamMJJse3n9yKimFm7AmbTJuRTt52xba3n10yK-nX_dGyxA35SpAwrRJtOVgpB_jiU61ZzJvR7O8M Aug 31 16:04:39.549655 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:04:39.549655 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:04:39.549655 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:04:39.549655 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:04:39.549655 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:04:39.549655 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:04:39.549655 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 61a9f3fcc4b445349e5c66ff712e8598 Aug 31 16:04:39.549655 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ImagesTestJSON-1850054072 Aug 31 16:04:39.549655 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:04:39.549655 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:04:39.549655 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/61a9f3fcc4b445349e5c66ff712e8598"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/61a9f3fcc4b445349e5c66ff712e8598"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_61a9f3fcc4b445349e5c66ff712e8598", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/61a9f3fcc4b445349e5c66ff712e8598"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:04:39.549655 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ImagesTestJSON-1850054072 Aug 31 16:04:39.549655 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 61a9f3fcc4b445349e5c66ff712e8598 Aug 31 16:04:39.549655 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ImagesTestJSON-1850054072 Aug 31 16:04:39.549655 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ImagesTestJSON-1850054072-project Aug 31 16:04:39.549655 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:04:39.549655 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:04:39.549655 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: f1ccd03a4aa84f93bc26b438e1468f46 Aug 31 16:04:39.549655 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ImagesTestJSON-1850054072-project Aug 31 16:04:39.549655 n-d-850499-9 devstack@n-api.service[122257]: method: Aug 31 16:04:39.549655 n-d-850499-9 devstack@n-api.service[122257]: exception: Image not found. Aug 31 16:04:39.549655 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '34d69a63-c14a-4d91-9d9f-38bc5d717b66'} Aug 31 16:04:39.549655 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:04:39.549655 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:04:39.549655 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 31 16:04:39.549655 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 31 16:04:39.549655 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 31 16:04:39.549655 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 31 16:04:39.549655 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 31 16:04:39.549655 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 31 16:04:39.549655 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 31 16:04:39.549655 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 31 16:04:39.549655 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 31 16:04:39.549655 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 31 16:04:39.549655 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 31 16:04:39.549655 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 31 16:04:39.549655 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 31 16:04:39.549655 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 31 16:04:39.549655 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 34d69a63-c14a-4d91-9d9f-38bc5d717b66 to delete Aug 31 16:04:39.549655 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:04:39.549655 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:04:39.549655 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:04:39.549655 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:04:39.549655 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 31 16:04:39.549655 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 31 16:04:39.549655 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 31 16:04:39.549655 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 31 16:04:39.549655 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 31 16:04:39.549655 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 31 16:04:39.549655 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 34d69a63-c14a-4d91-9d9f-38bc5d717b66 could not be found. Aug 31 16:04:39.549655 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:04:39.549655 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:04:39.549655 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:04:39.549655 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:04:39.559615 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:04:39.559615 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:04:39.559615 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:04:39.559615 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:04:39.559615 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:04:39.559615 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:04:39.559615 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:04:39.559615 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:04:39.559615 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 31 16:04:39.559615 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 31 16:04:39.559615 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 31 16:04:39.559615 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:04:39.559615 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:04:39.559615 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:04:39.559615 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:04:39.559615 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:04:39.559615 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:04:39.559615 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:04:39.559615 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:04:39.559615 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 31 16:04:39.559615 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:04:39.565681 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ed3925a8-bdc5-4e4a-b127-a87dee0c5dbb tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Returning 404 to user: Image not found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:04:39.567704 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ed3925a8-bdc5-4e4a-b127-a87dee0c5dbb tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "DELETE /compute/v2.1/images/34d69a63-c14a-4d91-9d9f-38bc5d717b66" status: 404 len: 62 microversion: 2.1 time: 0.092622 Aug 31 16:04:39.569729 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1110/2233] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:39 2022] DELETE /compute/v2.1/images/34d69a63-c14a-4d91-9d9f-38bc5d717b66 => generated 62 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 31 16:04:39.590774 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-da1c782e-81c4-4bfd-98ae-fbbb8a8800a3 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:39.592711 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-da1c782e-81c4-4bfd-98ae-fbbb8a8800a3 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 006771fc-9da9-4b78-9fad-f4b72c311fd5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:39.614712 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-da1c782e-81c4-4bfd-98ae-fbbb8a8800a3 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:39.616893 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-da1c782e-81c4-4bfd-98ae-fbbb8a8800a3 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:39.617712 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-da1c782e-81c4-4bfd-98ae-fbbb8a8800a3 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:39.619883 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-da1c782e-81c4-4bfd-98ae-fbbb8a8800a3 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:39.622257 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-da1c782e-81c4-4bfd-98ae-fbbb8a8800a3 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:39.623659 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-da1c782e-81c4-4bfd-98ae-fbbb8a8800a3 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:39.886651 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-e447caf0-d45e-42c3-b0d3-8e4ada1ef29f tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:04:39.887455 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-e447caf0-d45e-42c3-b0d3-8e4ada1ef29f tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:04:39.888027 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-e447caf0-d45e-42c3-b0d3-8e4ada1ef29f tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:04:39.888447 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-e447caf0-d45e-42c3-b0d3-8e4ada1ef29f tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:04:39.889064 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-e447caf0-d45e-42c3-b0d3-8e4ada1ef29f tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:04:39.913963 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e447caf0-d45e-42c3-b0d3-8e4ada1ef29f tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:39.914502 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e447caf0-d45e-42c3-b0d3-8e4ada1ef29f tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:39.914955 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e447caf0-d45e-42c3-b0d3-8e4ada1ef29f tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:39.915755 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e447caf0-d45e-42c3-b0d3-8e4ada1ef29f tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:39.916330 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e447caf0-d45e-42c3-b0d3-8e4ada1ef29f tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:39.917043 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e447caf0-d45e-42c3-b0d3-8e4ada1ef29f tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:39.950371 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-e447caf0-d45e-42c3-b0d3-8e4ada1ef29f tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Getting quotas for project 7fa2effd15e440598752264e49d2457d. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:04:39.957953 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-e447caf0-d45e-42c3-b0d3-8e4ada1ef29f tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Getting quotas for user 547d88df13034daaad50c3582c7cc3b3 and project 7fa2effd15e440598752264e49d2457d. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:04:39.989625 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e447caf0-d45e-42c3-b0d3-8e4ada1ef29f tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Going to run 1 instances... {{(pid=122256) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:04:39.993400 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e447caf0-d45e-42c3-b0d3-8e4ada1ef29f tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 5efb9714-ab85-499c-b0ec-f79ffb2dea61] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:04:40.013962 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-da1c782e-81c4-4bfd-98ae-fbbb8a8800a3 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:40.034526 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-da1c782e-81c4-4bfd-98ae-fbbb8a8800a3 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:40.036531 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-da1c782e-81c4-4bfd-98ae-fbbb8a8800a3 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:40.038128 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-da1c782e-81c4-4bfd-98ae-fbbb8a8800a3 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5" status: 200 len: 1487 microversion: 2.25 time: 0.460721 Aug 31 16:04:40.038947 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1111/2234] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:04:39 2022] GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5 => generated 1487 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:04:40.049322 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7b470f56-806a-4044-bcde-a4695381cb7a tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:40.051576 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7b470f56-806a-4044-bcde-a4695381cb7a tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: 3f785545-d532-4487-b780-8a9be107a209] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:40.071399 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7b470f56-806a-4044-bcde-a4695381cb7a tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:40.072394 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7b470f56-806a-4044-bcde-a4695381cb7a tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:40.073079 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7b470f56-806a-4044-bcde-a4695381cb7a tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:40.074304 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7b470f56-806a-4044-bcde-a4695381cb7a tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:40.075011 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7b470f56-806a-4044-bcde-a4695381cb7a tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:40.085700 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7b470f56-806a-4044-bcde-a4695381cb7a tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:40.088879 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e447caf0-d45e-42c3-b0d3-8e4ada1ef29f tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.038682 Aug 31 16:04:40.090891 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1124/2235] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:04:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1043 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:04:40.099687 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-05245fcf-6c64-4d43-8271-034a5d13dc24 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:40.106062 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-05245fcf-6c64-4d43-8271-034a5d13dc24 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: f9b66475-83f6-49a3-bc63-8965fc1aec14] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:40.109753 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-7b470f56-806a-4044-bcde-a4695381cb7a tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] HTTP exception thrown: Instance 3f785545-d532-4487-b780-8a9be107a209 could not be found. Aug 31 16:04:40.113664 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-05245fcf-6c64-4d43-8271-034a5d13dc24 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:40.114712 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-05245fcf-6c64-4d43-8271-034a5d13dc24 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:40.115481 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-05245fcf-6c64-4d43-8271-034a5d13dc24 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:40.122820 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7b470f56-806a-4044-bcde-a4695381cb7a tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Request method failure captured: Aug 31 16:04:40.122820 n-d-850499-9 devstack@n-api.service[122257]: request: DELETE /compute/v2.1/servers/3f785545-d532-4487-b780-8a9be107a209 HTTP/1.1 Aug 31 16:04:40.122820 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:04:40.122820 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:04:40.122820 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:04:40.122820 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:04:40.122820 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:04:40.122820 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:04:40.122820 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:04:40.122820 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:04:40.122820 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4WG8AwQfYxlaGjRgYpPss_ZLDHrwQ0s3V0ZYjpGoaX5c5ru3y4LKPsB00yIoE66HOwzwSIJazTKHiyNnca12D_Uy-mgAi8PZmyamMJJse3n9yKimFm7AmbTJuRTt52xba3n10yK-nX_dGyxA35SpAwrRJtOVgpB_jiU61ZzJvR7O8M Aug 31 16:04:40.122820 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:04:40.122820 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:04:40.122820 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:04:40.122820 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:04:40.122820 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:04:40.122820 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:04:40.122820 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 61a9f3fcc4b445349e5c66ff712e8598 Aug 31 16:04:40.122820 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ImagesTestJSON-1850054072 Aug 31 16:04:40.122820 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:04:40.122820 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:04:40.122820 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/61a9f3fcc4b445349e5c66ff712e8598"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/61a9f3fcc4b445349e5c66ff712e8598"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_61a9f3fcc4b445349e5c66ff712e8598", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/61a9f3fcc4b445349e5c66ff712e8598"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:04:40.122820 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ImagesTestJSON-1850054072 Aug 31 16:04:40.122820 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 61a9f3fcc4b445349e5c66ff712e8598 Aug 31 16:04:40.122820 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ImagesTestJSON-1850054072 Aug 31 16:04:40.122820 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ImagesTestJSON-1850054072-project Aug 31 16:04:40.122820 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:04:40.122820 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:04:40.122820 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: f1ccd03a4aa84f93bc26b438e1468f46 Aug 31 16:04:40.122820 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ImagesTestJSON-1850054072-project Aug 31 16:04:40.122820 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:04:40.122820 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance 3f785545-d532-4487-b780-8a9be107a209 could not be found. Aug 31 16:04:40.122820 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '3f785545-d532-4487-b780-8a9be107a209'} Aug 31 16:04:40.122820 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:04:40.122820 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:04:40.122820 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:04:40.122820 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:04:40.122820 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:04:40.122820 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:04:40.122820 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:04:40.122820 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:04:40.122820 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:04:40.122820 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:04:40.122820 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f785545-d532-4487-b780-8a9be107a209 could not be found. Aug 31 16:04:40.122820 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:04:40.122820 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:04:40.122820 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:04:40.122820 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:04:40.122820 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:04:40.122820 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:04:40.122820 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:04:40.122820 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:04:40.122820 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:04:40.122820 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:04:40.122820 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:04:40.122820 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:04:40.122820 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:04:40.122820 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:04:40.122820 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:04:40.122820 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:04:40.122820 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:04:40.122820 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:04:40.122820 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f785545-d532-4487-b780-8a9be107a209 could not be found. Aug 31 16:04:40.131871 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:04:40.131871 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:04:40.131871 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:04:40.131871 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:04:40.131871 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:04:40.131871 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:04:40.131871 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:04:40.131871 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:04:40.131871 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f785545-d532-4487-b780-8a9be107a209 could not be found. Aug 31 16:04:40.131871 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:04:40.131871 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7b470f56-806a-4044-bcde-a4695381cb7a tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Returning 404 to user: Instance 3f785545-d532-4487-b780-8a9be107a209 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:04:40.131871 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7b470f56-806a-4044-bcde-a4695381cb7a tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "DELETE /compute/v2.1/servers/3f785545-d532-4487-b780-8a9be107a209" status: 404 len: 111 microversion: 2.1 time: 0.081989 Aug 31 16:04:40.131871 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1112/2236] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:04:40 2022] DELETE /compute/v2.1/servers/3f785545-d532-4487-b780-8a9be107a209 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:04:40.138743 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-775da09e-c7e3-4db1-b741-4aae10d64999 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:40.139849 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-775da09e-c7e3-4db1-b741-4aae10d64999 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: dd702273-095b-4d44-8d1b-3d90f7833d5f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:40.142547 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-05245fcf-6c64-4d43-8271-034a5d13dc24 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:40.143799 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-05245fcf-6c64-4d43-8271-034a5d13dc24 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:40.144458 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-05245fcf-6c64-4d43-8271-034a5d13dc24 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:40.154914 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-775da09e-c7e3-4db1-b741-4aae10d64999 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:40.159487 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-775da09e-c7e3-4db1-b741-4aae10d64999 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:40.160264 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-775da09e-c7e3-4db1-b741-4aae10d64999 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:40.161471 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-775da09e-c7e3-4db1-b741-4aae10d64999 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:40.162133 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-775da09e-c7e3-4db1-b741-4aae10d64999 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:40.166021 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-775da09e-c7e3-4db1-b741-4aae10d64999 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:40.540341 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-05245fcf-6c64-4d43-8271-034a5d13dc24 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:40.556511 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-05245fcf-6c64-4d43-8271-034a5d13dc24 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/f9b66475-83f6-49a3-bc63-8965fc1aec14" status: 200 len: 1378 microversion: 2.1 time: 0.461022 Aug 31 16:04:40.564120 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1125/2237] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:40 2022] GET /compute/v2.1/servers/f9b66475-83f6-49a3-bc63-8965fc1aec14 => generated 1378 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:40.569352 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-734b238d-b402-4dfc-a940-9bbc450c8077 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:40.570220 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-734b238d-b402-4dfc-a940-9bbc450c8077 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 5efb9714-ab85-499c-b0ec-f79ffb2dea61] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:40.716342 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-734b238d-b402-4dfc-a940-9bbc450c8077 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:40.728213 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-734b238d-b402-4dfc-a940-9bbc450c8077 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/5efb9714-ab85-499c-b0ec-f79ffb2dea61" status: 200 len: 1217 microversion: 2.1 time: 0.162786 Aug 31 16:04:40.731417 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1126/2238] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:40 2022] GET /compute/v2.1/servers/5efb9714-ab85-499c-b0ec-f79ffb2dea61 => generated 1217 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:40.744839 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-08b3ecbc-db1c-4ac2-af93-eb2ff924f92e tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:40.746712 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-08b3ecbc-db1c-4ac2-af93-eb2ff924f92e tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: 3f785545-d532-4487-b780-8a9be107a209] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:40.768440 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-08b3ecbc-db1c-4ac2-af93-eb2ff924f92e tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:40.768440 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-08b3ecbc-db1c-4ac2-af93-eb2ff924f92e tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:40.768440 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-08b3ecbc-db1c-4ac2-af93-eb2ff924f92e tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:40.769013 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-08b3ecbc-db1c-4ac2-af93-eb2ff924f92e tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:40.769722 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-08b3ecbc-db1c-4ac2-af93-eb2ff924f92e tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:40.769941 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-08b3ecbc-db1c-4ac2-af93-eb2ff924f92e tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:40.790106 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:04:40.825144 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-08b3ecbc-db1c-4ac2-af93-eb2ff924f92e tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] HTTP exception thrown: Instance 3f785545-d532-4487-b780-8a9be107a209 could not be found. Aug 31 16:04:40.829424 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-08b3ecbc-db1c-4ac2-af93-eb2ff924f92e tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Request method failure captured: Aug 31 16:04:40.829424 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/3f785545-d532-4487-b780-8a9be107a209 HTTP/1.1 Aug 31 16:04:40.829424 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:04:40.829424 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:04:40.829424 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:04:40.829424 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:04:40.829424 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:04:40.829424 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:04:40.829424 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:04:40.829424 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:04:40.829424 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4WG8AwQfYxlaGjRgYpPss_ZLDHrwQ0s3V0ZYjpGoaX5c5ru3y4LKPsB00yIoE66HOwzwSIJazTKHiyNnca12D_Uy-mgAi8PZmyamMJJse3n9yKimFm7AmbTJuRTt52xba3n10yK-nX_dGyxA35SpAwrRJtOVgpB_jiU61ZzJvR7O8M Aug 31 16:04:40.829424 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:04:40.829424 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:04:40.829424 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:04:40.829424 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:04:40.829424 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:04:40.829424 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:04:40.829424 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 61a9f3fcc4b445349e5c66ff712e8598 Aug 31 16:04:40.829424 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ImagesTestJSON-1850054072 Aug 31 16:04:40.829424 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:04:40.829424 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:04:40.829424 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/61a9f3fcc4b445349e5c66ff712e8598"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/61a9f3fcc4b445349e5c66ff712e8598"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_61a9f3fcc4b445349e5c66ff712e8598", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/61a9f3fcc4b445349e5c66ff712e8598"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:04:40.829424 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ImagesTestJSON-1850054072 Aug 31 16:04:40.829424 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 61a9f3fcc4b445349e5c66ff712e8598 Aug 31 16:04:40.829424 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ImagesTestJSON-1850054072 Aug 31 16:04:40.829424 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ImagesTestJSON-1850054072-project Aug 31 16:04:40.829424 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:04:40.829424 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:04:40.829424 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: f1ccd03a4aa84f93bc26b438e1468f46 Aug 31 16:04:40.829424 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ImagesTestJSON-1850054072-project Aug 31 16:04:40.829424 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:04:40.829424 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance 3f785545-d532-4487-b780-8a9be107a209 could not be found. Aug 31 16:04:40.829424 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '3f785545-d532-4487-b780-8a9be107a209'} Aug 31 16:04:40.829424 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:04:40.829424 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:04:40.829424 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:04:40.829424 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:04:40.829424 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:04:40.829424 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:04:40.829424 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:04:40.829424 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:04:40.829424 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:04:40.829424 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:04:40.829424 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f785545-d532-4487-b780-8a9be107a209 could not be found. Aug 31 16:04:40.829424 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:04:40.829424 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:04:40.829424 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:04:40.829424 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:04:40.829424 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:04:40.829424 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:04:40.829424 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:04:40.829424 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:04:40.829424 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:04:40.829424 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:04:40.829424 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:04:40.829424 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:04:40.829424 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:04:40.829424 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:04:40.829424 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:04:40.829424 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:04:40.829424 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f785545-d532-4487-b780-8a9be107a209 could not be found. Aug 31 16:04:40.829424 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:04:40.829424 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:04:40.829424 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:04:40.829424 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:04:40.838775 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:04:40.838775 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:04:40.838775 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:04:40.838775 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:04:40.838775 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f785545-d532-4487-b780-8a9be107a209 could not be found. Aug 31 16:04:40.838775 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:04:40.838775 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-08b3ecbc-db1c-4ac2-af93-eb2ff924f92e tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Returning 404 to user: Instance 3f785545-d532-4487-b780-8a9be107a209 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:04:40.838775 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-08b3ecbc-db1c-4ac2-af93-eb2ff924f92e tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/servers/3f785545-d532-4487-b780-8a9be107a209" status: 404 len: 111 microversion: 2.1 time: 0.098601 Aug 31 16:04:40.838775 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1127/2239] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:40 2022] GET /compute/v2.1/servers/3f785545-d532-4487-b780-8a9be107a209 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:04:40.854543 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-fe7d42eb-d7fc-44bc-8361-b33d51d8f6c3 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:40.876027 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-fe7d42eb-d7fc-44bc-8361-b33d51d8f6c3 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: d8590729-e3da-4e04-9daa-7e04a3d88068] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:40.891935 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fe7d42eb-d7fc-44bc-8361-b33d51d8f6c3 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:40.892462 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fe7d42eb-d7fc-44bc-8361-b33d51d8f6c3 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:40.892910 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fe7d42eb-d7fc-44bc-8361-b33d51d8f6c3 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:40.895812 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fe7d42eb-d7fc-44bc-8361-b33d51d8f6c3 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:40.896649 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fe7d42eb-d7fc-44bc-8361-b33d51d8f6c3 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:40.897123 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fe7d42eb-d7fc-44bc-8361-b33d51d8f6c3 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:40.946761 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-775da09e-c7e3-4db1-b741-4aae10d64999 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:40.959816 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-775da09e-c7e3-4db1-b741-4aae10d64999 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f" status: 200 len: 1392 microversion: 2.1 time: 0.830095 Aug 31 16:04:40.961108 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1113/2240] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:40 2022] GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f => generated 1392 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:40.972967 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9c1e1c0b-bc9c-4a0f-9f35-0efc08face42 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '.version_select at 0x7f5ae8ffcb80>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:41.018246 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-9c1e1c0b-bc9c-4a0f-9f35-0efc08face42 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] HTTP exception thrown: Image not found. Aug 31 16:04:41.023959 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9c1e1c0b-bc9c-4a0f-9f35-0efc08face42 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Request method failure captured: Aug 31 16:04:41.023959 n-d-850499-9 devstack@n-api.service[122257]: request: DELETE /compute/v2.1/images/91f26408-c009-455c-b26c-f5cfe4ba8d54 HTTP/1.1 Aug 31 16:04:41.023959 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:04:41.023959 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:04:41.023959 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:04:41.023959 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:04:41.023959 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:04:41.023959 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:04:41.023959 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:04:41.023959 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:04:41.023959 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4WG8AwQfYxlaGjRgYpPss_ZLDHrwQ0s3V0ZYjpGoaX5c5ru3y4LKPsB00yIoE66HOwzwSIJazTKHiyNnca12D_Uy-mgAi8PZmyamMJJse3n9yKimFm7AmbTJuRTt52xba3n10yK-nX_dGyxA35SpAwrRJtOVgpB_jiU61ZzJvR7O8M Aug 31 16:04:41.023959 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:04:41.023959 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:04:41.023959 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:04:41.023959 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:04:41.023959 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:04:41.023959 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:04:41.023959 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 61a9f3fcc4b445349e5c66ff712e8598 Aug 31 16:04:41.023959 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ImagesTestJSON-1850054072 Aug 31 16:04:41.023959 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:04:41.023959 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:04:41.023959 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/61a9f3fcc4b445349e5c66ff712e8598"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/61a9f3fcc4b445349e5c66ff712e8598"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_61a9f3fcc4b445349e5c66ff712e8598", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/61a9f3fcc4b445349e5c66ff712e8598"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:04:41.023959 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ImagesTestJSON-1850054072 Aug 31 16:04:41.023959 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 61a9f3fcc4b445349e5c66ff712e8598 Aug 31 16:04:41.023959 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ImagesTestJSON-1850054072 Aug 31 16:04:41.023959 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ImagesTestJSON-1850054072-project Aug 31 16:04:41.023959 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:04:41.023959 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:04:41.023959 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: f1ccd03a4aa84f93bc26b438e1468f46 Aug 31 16:04:41.023959 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ImagesTestJSON-1850054072-project Aug 31 16:04:41.023959 n-d-850499-9 devstack@n-api.service[122257]: method: Aug 31 16:04:41.023959 n-d-850499-9 devstack@n-api.service[122257]: exception: Image not found. Aug 31 16:04:41.023959 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '91f26408-c009-455c-b26c-f5cfe4ba8d54'} Aug 31 16:04:41.023959 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:04:41.023959 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:04:41.023959 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 31 16:04:41.023959 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 31 16:04:41.023959 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 31 16:04:41.023959 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 31 16:04:41.023959 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 31 16:04:41.023959 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 31 16:04:41.023959 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 31 16:04:41.023959 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 31 16:04:41.023959 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 31 16:04:41.023959 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 31 16:04:41.023959 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 31 16:04:41.023959 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 31 16:04:41.023959 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 31 16:04:41.023959 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 31 16:04:41.023959 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 91f26408-c009-455c-b26c-f5cfe4ba8d54 to delete Aug 31 16:04:41.023959 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:04:41.023959 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:04:41.023959 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:04:41.023959 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:04:41.023959 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 31 16:04:41.023959 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 31 16:04:41.023959 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 31 16:04:41.023959 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 31 16:04:41.023959 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 31 16:04:41.023959 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 31 16:04:41.023959 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 91f26408-c009-455c-b26c-f5cfe4ba8d54 could not be found. Aug 31 16:04:41.023959 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:04:41.023959 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:04:41.023959 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:04:41.023959 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:04:41.037140 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:04:41.037140 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:04:41.037140 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:04:41.037140 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:04:41.037140 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:04:41.037140 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:04:41.037140 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:04:41.037140 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:04:41.037140 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 31 16:04:41.037140 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 31 16:04:41.037140 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 31 16:04:41.037140 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:04:41.037140 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:04:41.037140 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:04:41.037140 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:04:41.037140 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:04:41.037140 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:04:41.037140 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:04:41.037140 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:04:41.037140 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 31 16:04:41.037140 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:04:41.037140 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9c1e1c0b-bc9c-4a0f-9f35-0efc08face42 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Returning 404 to user: Image not found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:04:41.037140 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9c1e1c0b-bc9c-4a0f-9f35-0efc08face42 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "DELETE /compute/v2.1/images/91f26408-c009-455c-b26c-f5cfe4ba8d54" status: 404 len: 62 microversion: 2.1 time: 0.063622 Aug 31 16:04:41.037140 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1114/2241] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:40 2022] DELETE /compute/v2.1/images/91f26408-c009-455c-b26c-f5cfe4ba8d54 => generated 62 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 31 16:04:41.043105 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-08d055fe-7194-4e5c-b2ba-da7b0f6aaff0 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:41.043105 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-08d055fe-7194-4e5c-b2ba-da7b0f6aaff0 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: 5f29cff7-a675-40c2-a0e5-2a62994be45a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:41.050925 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-08d055fe-7194-4e5c-b2ba-da7b0f6aaff0 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:41.051884 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-08d055fe-7194-4e5c-b2ba-da7b0f6aaff0 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:41.052346 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-08d055fe-7194-4e5c-b2ba-da7b0f6aaff0 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:41.053171 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-08d055fe-7194-4e5c-b2ba-da7b0f6aaff0 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:41.053818 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-08d055fe-7194-4e5c-b2ba-da7b0f6aaff0 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:41.054401 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-08d055fe-7194-4e5c-b2ba-da7b0f6aaff0 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:41.072390 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-fe7d42eb-d7fc-44bc-8361-b33d51d8f6c3 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:41.091208 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-fe7d42eb-d7fc-44bc-8361-b33d51d8f6c3 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/d8590729-e3da-4e04-9daa-7e04a3d88068" status: 200 len: 1345 microversion: 2.1 time: 0.253026 Aug 31 16:04:41.107540 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1128/2242] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:40 2022] GET /compute/v2.1/servers/d8590729-e3da-4e04-9daa-7e04a3d88068 => generated 1345 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:41.107811 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-08d055fe-7194-4e5c-b2ba-da7b0f6aaff0 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] HTTP exception thrown: Instance 5f29cff7-a675-40c2-a0e5-2a62994be45a could not be found. Aug 31 16:04:41.107983 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d04b6be4-ea5d-4c32-8a6f-9d57a281086f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:41.107983 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d04b6be4-ea5d-4c32-8a6f-9d57a281086f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 006771fc-9da9-4b78-9fad-f4b72c311fd5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:41.108282 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-08d055fe-7194-4e5c-b2ba-da7b0f6aaff0 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Request method failure captured: Aug 31 16:04:41.108282 n-d-850499-9 devstack@n-api.service[122257]: request: DELETE /compute/v2.1/servers/5f29cff7-a675-40c2-a0e5-2a62994be45a HTTP/1.1 Aug 31 16:04:41.108282 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:04:41.108282 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:04:41.108282 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:04:41.108282 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:04:41.108282 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:04:41.108282 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:04:41.108282 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:04:41.108282 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:04:41.108282 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4WG8AwQfYxlaGjRgYpPss_ZLDHrwQ0s3V0ZYjpGoaX5c5ru3y4LKPsB00yIoE66HOwzwSIJazTKHiyNnca12D_Uy-mgAi8PZmyamMJJse3n9yKimFm7AmbTJuRTt52xba3n10yK-nX_dGyxA35SpAwrRJtOVgpB_jiU61ZzJvR7O8M Aug 31 16:04:41.108282 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:04:41.108282 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:04:41.108282 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:04:41.108282 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:04:41.108282 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:04:41.108282 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:04:41.108282 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 61a9f3fcc4b445349e5c66ff712e8598 Aug 31 16:04:41.108282 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ImagesTestJSON-1850054072 Aug 31 16:04:41.108282 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:04:41.108282 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:04:41.108282 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/61a9f3fcc4b445349e5c66ff712e8598"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/61a9f3fcc4b445349e5c66ff712e8598"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_61a9f3fcc4b445349e5c66ff712e8598", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/61a9f3fcc4b445349e5c66ff712e8598"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:04:41.108282 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ImagesTestJSON-1850054072 Aug 31 16:04:41.108282 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 61a9f3fcc4b445349e5c66ff712e8598 Aug 31 16:04:41.108282 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ImagesTestJSON-1850054072 Aug 31 16:04:41.108282 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ImagesTestJSON-1850054072-project Aug 31 16:04:41.108282 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:04:41.108282 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:04:41.108282 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: f1ccd03a4aa84f93bc26b438e1468f46 Aug 31 16:04:41.108282 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ImagesTestJSON-1850054072-project Aug 31 16:04:41.108282 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:04:41.108282 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance 5f29cff7-a675-40c2-a0e5-2a62994be45a could not be found. Aug 31 16:04:41.108282 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '5f29cff7-a675-40c2-a0e5-2a62994be45a'} Aug 31 16:04:41.108282 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:04:41.108282 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:04:41.108282 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:04:41.108282 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:04:41.108282 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:04:41.108282 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:04:41.108282 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:04:41.108282 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:04:41.108282 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:04:41.108282 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:04:41.108282 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f29cff7-a675-40c2-a0e5-2a62994be45a could not be found. Aug 31 16:04:41.108282 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:04:41.108282 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:04:41.108282 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:04:41.108282 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:04:41.108282 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:04:41.108282 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:04:41.108282 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:04:41.108282 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:04:41.108282 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:04:41.108282 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:04:41.108282 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:04:41.108282 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:04:41.108282 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:04:41.108282 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:04:41.108282 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:04:41.108282 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:04:41.108282 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:04:41.108282 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:04:41.108282 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f29cff7-a675-40c2-a0e5-2a62994be45a could not be found. Aug 31 16:04:41.124897 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:04:41.124897 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:04:41.124897 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:04:41.124897 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:04:41.124897 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:04:41.124897 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:04:41.124897 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:04:41.124897 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:04:41.124897 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f29cff7-a675-40c2-a0e5-2a62994be45a could not be found. Aug 31 16:04:41.124897 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:04:41.124897 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-08d055fe-7194-4e5c-b2ba-da7b0f6aaff0 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Returning 404 to user: Instance 5f29cff7-a675-40c2-a0e5-2a62994be45a could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:04:41.128445 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d04b6be4-ea5d-4c32-8a6f-9d57a281086f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:41.128445 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d04b6be4-ea5d-4c32-8a6f-9d57a281086f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:41.128445 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d04b6be4-ea5d-4c32-8a6f-9d57a281086f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:41.128445 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d04b6be4-ea5d-4c32-8a6f-9d57a281086f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:41.130386 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-08d055fe-7194-4e5c-b2ba-da7b0f6aaff0 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "DELETE /compute/v2.1/servers/5f29cff7-a675-40c2-a0e5-2a62994be45a" status: 404 len: 111 microversion: 2.1 time: 0.077627 Aug 31 16:04:41.130858 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d04b6be4-ea5d-4c32-8a6f-9d57a281086f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:41.131126 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1115/2243] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:04:41 2022] DELETE /compute/v2.1/servers/5f29cff7-a675-40c2-a0e5-2a62994be45a => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:04:41.131345 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d04b6be4-ea5d-4c32-8a6f-9d57a281086f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:41.131954 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-09ad5af4-d1af-4368-b2bb-e151392fbf97 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:41.132716 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-09ad5af4-d1af-4368-b2bb-e151392fbf97 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] [instance: 5f29cff7-a675-40c2-a0e5-2a62994be45a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:41.150038 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-09ad5af4-d1af-4368-b2bb-e151392fbf97 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:41.150943 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-09ad5af4-d1af-4368-b2bb-e151392fbf97 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:41.155602 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-09ad5af4-d1af-4368-b2bb-e151392fbf97 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:41.157066 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-09ad5af4-d1af-4368-b2bb-e151392fbf97 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:41.157826 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-09ad5af4-d1af-4368-b2bb-e151392fbf97 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:41.158282 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-09ad5af4-d1af-4368-b2bb-e151392fbf97 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:41.174906 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-09ad5af4-d1af-4368-b2bb-e151392fbf97 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] HTTP exception thrown: Instance 5f29cff7-a675-40c2-a0e5-2a62994be45a could not be found. Aug 31 16:04:41.176913 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-09ad5af4-d1af-4368-b2bb-e151392fbf97 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Request method failure captured: Aug 31 16:04:41.176913 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/5f29cff7-a675-40c2-a0e5-2a62994be45a HTTP/1.1 Aug 31 16:04:41.176913 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:04:41.176913 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:04:41.176913 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:04:41.176913 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:04:41.176913 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:04:41.176913 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:04:41.176913 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:04:41.176913 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:04:41.176913 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4WG8AwQfYxlaGjRgYpPss_ZLDHrwQ0s3V0ZYjpGoaX5c5ru3y4LKPsB00yIoE66HOwzwSIJazTKHiyNnca12D_Uy-mgAi8PZmyamMJJse3n9yKimFm7AmbTJuRTt52xba3n10yK-nX_dGyxA35SpAwrRJtOVgpB_jiU61ZzJvR7O8M Aug 31 16:04:41.176913 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:04:41.176913 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:04:41.176913 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:04:41.176913 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:04:41.176913 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:04:41.176913 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:04:41.176913 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 61a9f3fcc4b445349e5c66ff712e8598 Aug 31 16:04:41.176913 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ImagesTestJSON-1850054072 Aug 31 16:04:41.176913 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:04:41.176913 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:04:41.176913 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/61a9f3fcc4b445349e5c66ff712e8598"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/61a9f3fcc4b445349e5c66ff712e8598"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_61a9f3fcc4b445349e5c66ff712e8598", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/61a9f3fcc4b445349e5c66ff712e8598"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:04:41.176913 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ImagesTestJSON-1850054072 Aug 31 16:04:41.176913 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 61a9f3fcc4b445349e5c66ff712e8598 Aug 31 16:04:41.176913 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ImagesTestJSON-1850054072 Aug 31 16:04:41.176913 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ImagesTestJSON-1850054072-project Aug 31 16:04:41.176913 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:04:41.176913 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:04:41.176913 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: f1ccd03a4aa84f93bc26b438e1468f46 Aug 31 16:04:41.176913 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ImagesTestJSON-1850054072-project Aug 31 16:04:41.176913 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:04:41.176913 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance 5f29cff7-a675-40c2-a0e5-2a62994be45a could not be found. Aug 31 16:04:41.176913 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '5f29cff7-a675-40c2-a0e5-2a62994be45a'} Aug 31 16:04:41.176913 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:04:41.176913 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:04:41.176913 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:04:41.176913 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:04:41.176913 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:04:41.176913 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:04:41.176913 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:04:41.176913 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:04:41.176913 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:04:41.176913 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:04:41.176913 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f29cff7-a675-40c2-a0e5-2a62994be45a could not be found. Aug 31 16:04:41.176913 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:04:41.176913 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:04:41.176913 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:04:41.176913 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:04:41.176913 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:04:41.176913 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:04:41.176913 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:04:41.176913 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:04:41.176913 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:04:41.176913 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:04:41.176913 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:04:41.176913 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:04:41.176913 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:04:41.176913 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:04:41.176913 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:04:41.176913 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:04:41.176913 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f29cff7-a675-40c2-a0e5-2a62994be45a could not be found. Aug 31 16:04:41.176913 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:04:41.176913 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:04:41.176913 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:04:41.176913 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:04:41.183132 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:04:41.183132 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:04:41.183132 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:04:41.183132 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:04:41.183132 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f29cff7-a675-40c2-a0e5-2a62994be45a could not be found. Aug 31 16:04:41.183132 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:04:41.183132 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-09ad5af4-d1af-4368-b2bb-e151392fbf97 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] Returning 404 to user: Instance 5f29cff7-a675-40c2-a0e5-2a62994be45a could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:04:41.183132 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-09ad5af4-d1af-4368-b2bb-e151392fbf97 tempest-ImagesTestJSON-1850054072 tempest-ImagesTestJSON-1850054072-project] 10.222.0.61 "GET /compute/v2.1/servers/5f29cff7-a675-40c2-a0e5-2a62994be45a" status: 404 len: 111 microversion: 2.1 time: 0.060843 Aug 31 16:04:41.183132 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1116/2244] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:41 2022] GET /compute/v2.1/servers/5f29cff7-a675-40c2-a0e5-2a62994be45a => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:04:41.438178 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d04b6be4-ea5d-4c32-8a6f-9d57a281086f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:41.454894 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d04b6be4-ea5d-4c32-8a6f-9d57a281086f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:41.457228 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d04b6be4-ea5d-4c32-8a6f-9d57a281086f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:41.458013 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d04b6be4-ea5d-4c32-8a6f-9d57a281086f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5" status: 200 len: 1487 microversion: 2.25 time: 0.363013 Aug 31 16:04:41.458665 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1129/2245] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:04:41 2022] GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5 => generated 1487 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:04:41.594864 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9b173e1d-45e6-4c9f-a318-4c5dae72ecac tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:41.595541 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9b173e1d-45e6-4c9f-a318-4c5dae72ecac tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: f9b66475-83f6-49a3-bc63-8965fc1aec14] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:41.608438 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9b173e1d-45e6-4c9f-a318-4c5dae72ecac tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:41.608944 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9b173e1d-45e6-4c9f-a318-4c5dae72ecac tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:41.611722 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9b173e1d-45e6-4c9f-a318-4c5dae72ecac tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:41.613081 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9b173e1d-45e6-4c9f-a318-4c5dae72ecac tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:41.615858 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9b173e1d-45e6-4c9f-a318-4c5dae72ecac tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:41.616561 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9b173e1d-45e6-4c9f-a318-4c5dae72ecac tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:41.754375 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-984794c9-b0aa-4ce7-a775-57975f8e0f84 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:41.755315 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-984794c9-b0aa-4ce7-a775-57975f8e0f84 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 5efb9714-ab85-499c-b0ec-f79ffb2dea61] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:41.773330 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-984794c9-b0aa-4ce7-a775-57975f8e0f84 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:41.773960 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-984794c9-b0aa-4ce7-a775-57975f8e0f84 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:41.776424 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-984794c9-b0aa-4ce7-a775-57975f8e0f84 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:41.778999 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-984794c9-b0aa-4ce7-a775-57975f8e0f84 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:41.780899 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-984794c9-b0aa-4ce7-a775-57975f8e0f84 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:41.798945 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-984794c9-b0aa-4ce7-a775-57975f8e0f84 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:41.997954 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-984794c9-b0aa-4ce7-a775-57975f8e0f84 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:42.011332 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-984794c9-b0aa-4ce7-a775-57975f8e0f84 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/5efb9714-ab85-499c-b0ec-f79ffb2dea61" status: 200 len: 1221 microversion: 2.1 time: 0.261468 Aug 31 16:04:42.014076 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1130/2246] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:41 2022] GET /compute/v2.1/servers/5efb9714-ab85-499c-b0ec-f79ffb2dea61 => generated 1221 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:04:42.029721 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-eceead27-3f22-4326-aad0-6898e70fee1e tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:42.030958 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-eceead27-3f22-4326-aad0-6898e70fee1e tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: dd702273-095b-4d44-8d1b-3d90f7833d5f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:42.056369 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eceead27-3f22-4326-aad0-6898e70fee1e tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:42.059920 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eceead27-3f22-4326-aad0-6898e70fee1e tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:42.060777 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eceead27-3f22-4326-aad0-6898e70fee1e tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:42.062889 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eceead27-3f22-4326-aad0-6898e70fee1e tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:42.063815 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eceead27-3f22-4326-aad0-6898e70fee1e tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:42.065244 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eceead27-3f22-4326-aad0-6898e70fee1e tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:42.458165 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9b173e1d-45e6-4c9f-a318-4c5dae72ecac tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:42.478690 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9b173e1d-45e6-4c9f-a318-4c5dae72ecac tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/f9b66475-83f6-49a3-bc63-8965fc1aec14" status: 200 len: 1378 microversion: 2.1 time: 0.888595 Aug 31 16:04:42.498286 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1117/2247] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:41 2022] GET /compute/v2.1/servers/f9b66475-83f6-49a3-bc63-8965fc1aec14 => generated 1378 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:04:42.513936 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a18627d3-9801-4cff-ab7b-445144fd89b0 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:42.514793 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a18627d3-9801-4cff-ab7b-445144fd89b0 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: d8590729-e3da-4e04-9daa-7e04a3d88068] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:42.525275 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a18627d3-9801-4cff-ab7b-445144fd89b0 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:42.530835 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a18627d3-9801-4cff-ab7b-445144fd89b0 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:42.531567 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a18627d3-9801-4cff-ab7b-445144fd89b0 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:42.532499 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a18627d3-9801-4cff-ab7b-445144fd89b0 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:42.533136 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a18627d3-9801-4cff-ab7b-445144fd89b0 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:42.533759 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a18627d3-9801-4cff-ab7b-445144fd89b0 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:42.873168 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a18627d3-9801-4cff-ab7b-445144fd89b0 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:42.886916 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a18627d3-9801-4cff-ab7b-445144fd89b0 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/d8590729-e3da-4e04-9daa-7e04a3d88068" status: 200 len: 1345 microversion: 2.1 time: 0.386972 Aug 31 16:04:42.901397 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1118/2248] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:42 2022] GET /compute/v2.1/servers/d8590729-e3da-4e04-9daa-7e04a3d88068 => generated 1345 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:42.910195 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c93709cc-bc95-442f-9174-437fe44120b4 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:42.934210 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c93709cc-bc95-442f-9174-437fe44120b4 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 006771fc-9da9-4b78-9fad-f4b72c311fd5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:42.949449 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c93709cc-bc95-442f-9174-437fe44120b4 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:42.951930 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c93709cc-bc95-442f-9174-437fe44120b4 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:42.954213 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c93709cc-bc95-442f-9174-437fe44120b4 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:42.955794 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c93709cc-bc95-442f-9174-437fe44120b4 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:42.959030 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c93709cc-bc95-442f-9174-437fe44120b4 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:42.961788 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c93709cc-bc95-442f-9174-437fe44120b4 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:42.974789 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-eceead27-3f22-4326-aad0-6898e70fee1e tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:43.004938 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-eceead27-3f22-4326-aad0-6898e70fee1e tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f" status: 200 len: 1392 microversion: 2.1 time: 0.984414 Aug 31 16:04:43.009175 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1131/2249] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:42 2022] GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f => generated 1392 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:43.047587 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-738522ea-8529-4869-b5e0-5425b9dd46ee tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:43.049324 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-738522ea-8529-4869-b5e0-5425b9dd46ee tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 5efb9714-ab85-499c-b0ec-f79ffb2dea61] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:43.078773 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-738522ea-8529-4869-b5e0-5425b9dd46ee tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:43.084397 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-738522ea-8529-4869-b5e0-5425b9dd46ee tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:43.085508 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-738522ea-8529-4869-b5e0-5425b9dd46ee tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:43.086762 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-738522ea-8529-4869-b5e0-5425b9dd46ee tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:43.087878 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-738522ea-8529-4869-b5e0-5425b9dd46ee tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:43.091463 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-738522ea-8529-4869-b5e0-5425b9dd46ee tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:43.366482 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-738522ea-8529-4869-b5e0-5425b9dd46ee tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:43.379311 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-738522ea-8529-4869-b5e0-5425b9dd46ee tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/5efb9714-ab85-499c-b0ec-f79ffb2dea61" status: 200 len: 1269 microversion: 2.1 time: 0.345282 Aug 31 16:04:43.399641 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1132/2250] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:43 2022] GET /compute/v2.1/servers/5efb9714-ab85-499c-b0ec-f79ffb2dea61 => generated 1269 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:43.505752 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c5c9ace8-898f-4f90-a92d-df512e1daf4c tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:43.506669 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c5c9ace8-898f-4f90-a92d-df512e1daf4c tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: f9b66475-83f6-49a3-bc63-8965fc1aec14] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:43.521457 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c5c9ace8-898f-4f90-a92d-df512e1daf4c tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:43.523605 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c5c9ace8-898f-4f90-a92d-df512e1daf4c tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:43.524247 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c5c9ace8-898f-4f90-a92d-df512e1daf4c tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:43.528869 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c5c9ace8-898f-4f90-a92d-df512e1daf4c tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:43.529612 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c5c9ace8-898f-4f90-a92d-df512e1daf4c tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:43.530259 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c5c9ace8-898f-4f90-a92d-df512e1daf4c tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:43.984400 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c93709cc-bc95-442f-9174-437fe44120b4 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:44.003262 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c93709cc-bc95-442f-9174-437fe44120b4 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:44.004906 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c93709cc-bc95-442f-9174-437fe44120b4 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:44.006142 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c93709cc-bc95-442f-9174-437fe44120b4 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5" status: 200 len: 1487 microversion: 2.25 time: 1.103368 Aug 31 16:04:44.006717 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1119/2251] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:04:42 2022] GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5 => generated 1487 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:04:44.029553 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7709dca7-98b8-4966-bf8e-80648f101099 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:44.030468 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7709dca7-98b8-4966-bf8e-80648f101099 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: d8590729-e3da-4e04-9daa-7e04a3d88068] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:44.037348 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7709dca7-98b8-4966-bf8e-80648f101099 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:44.037860 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7709dca7-98b8-4966-bf8e-80648f101099 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:44.038308 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7709dca7-98b8-4966-bf8e-80648f101099 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:44.039046 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7709dca7-98b8-4966-bf8e-80648f101099 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:44.039540 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7709dca7-98b8-4966-bf8e-80648f101099 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:44.039983 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7709dca7-98b8-4966-bf8e-80648f101099 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:44.057061 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=100 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:04:44.303840 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7709dca7-98b8-4966-bf8e-80648f101099 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:44.323662 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7709dca7-98b8-4966-bf8e-80648f101099 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/d8590729-e3da-4e04-9daa-7e04a3d88068" status: 200 len: 1345 microversion: 2.1 time: 0.295413 Aug 31 16:04:44.331356 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c5c9ace8-898f-4f90-a92d-df512e1daf4c tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:44.340151 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1120/2252] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:44 2022] GET /compute/v2.1/servers/d8590729-e3da-4e04-9daa-7e04a3d88068 => generated 1345 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:44.343069 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c5c9ace8-898f-4f90-a92d-df512e1daf4c tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/f9b66475-83f6-49a3-bc63-8965fc1aec14" status: 200 len: 1378 microversion: 2.1 time: 0.841374 Aug 31 16:04:44.352319 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1133/2253] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:43 2022] GET /compute/v2.1/servers/f9b66475-83f6-49a3-bc63-8965fc1aec14 => generated 1378 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:44.352934 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-46d4c631-e4ca-47b8-9740-b58913b2a422 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:44.353572 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-46d4c631-e4ca-47b8-9740-b58913b2a422 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: dd702273-095b-4d44-8d1b-3d90f7833d5f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:44.366879 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:04:44.368407 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-46d4c631-e4ca-47b8-9740-b58913b2a422 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:44.372637 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-46d4c631-e4ca-47b8-9740-b58913b2a422 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:44.373176 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-46d4c631-e4ca-47b8-9740-b58913b2a422 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:44.374177 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-46d4c631-e4ca-47b8-9740-b58913b2a422 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:44.374661 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-46d4c631-e4ca-47b8-9740-b58913b2a422 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:44.375102 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-46d4c631-e4ca-47b8-9740-b58913b2a422 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:44.402467 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-73a8e66d-91f1-48c1-8f1f-c5aef90f7bfc tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:44.403466 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-73a8e66d-91f1-48c1-8f1f-c5aef90f7bfc tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 5efb9714-ab85-499c-b0ec-f79ffb2dea61] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:44.417189 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-73a8e66d-91f1-48c1-8f1f-c5aef90f7bfc tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:44.418859 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-73a8e66d-91f1-48c1-8f1f-c5aef90f7bfc tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:44.419551 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-73a8e66d-91f1-48c1-8f1f-c5aef90f7bfc tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:44.420547 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-73a8e66d-91f1-48c1-8f1f-c5aef90f7bfc tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:44.421195 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-73a8e66d-91f1-48c1-8f1f-c5aef90f7bfc tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:44.421822 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-73a8e66d-91f1-48c1-8f1f-c5aef90f7bfc tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:44.685685 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-73a8e66d-91f1-48c1-8f1f-c5aef90f7bfc tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:44.695004 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-73a8e66d-91f1-48c1-8f1f-c5aef90f7bfc tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/5efb9714-ab85-499c-b0ec-f79ffb2dea61" status: 200 len: 1275 microversion: 2.1 time: 0.296637 Aug 31 16:04:44.700329 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1134/2254] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:44 2022] GET /compute/v2.1/servers/5efb9714-ab85-499c-b0ec-f79ffb2dea61 => generated 1275 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:04:45.034704 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4839ca13-e10c-472a-9485-f3163c3d8955 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:45.035340 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4839ca13-e10c-472a-9485-f3163c3d8955 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 006771fc-9da9-4b78-9fad-f4b72c311fd5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:45.048209 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4839ca13-e10c-472a-9485-f3163c3d8955 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:45.048711 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4839ca13-e10c-472a-9485-f3163c3d8955 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:45.049154 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4839ca13-e10c-472a-9485-f3163c3d8955 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:45.049885 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4839ca13-e10c-472a-9485-f3163c3d8955 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:45.050352 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4839ca13-e10c-472a-9485-f3163c3d8955 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:45.050785 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4839ca13-e10c-472a-9485-f3163c3d8955 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:45.749405 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-46d4c631-e4ca-47b8-9740-b58913b2a422 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:45.757048 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-4839ca13-e10c-472a-9485-f3163c3d8955 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:45.757619 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-46d4c631-e4ca-47b8-9740-b58913b2a422 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f" status: 200 len: 1392 microversion: 2.1 time: 1.415668 Aug 31 16:04:45.758035 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1121/2255] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:44 2022] GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f => generated 1392 bytes in 1417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:45.773072 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-c180151b-219d-422d-95cb-90a026eebf0a req-c748a042-5f97-44e7-8172-3ac545a73c8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9b66475-83f6-49a3-bc63-8965fc1aec14", "name": "network-vif-plugged", "status": "completed", "tag": "c1929c28-a0f2-4fed-aba4-ecfd08ac8e7e"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:04:45.780978 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-4839ca13-e10c-472a-9485-f3163c3d8955 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:45.793278 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-c180151b-219d-422d-95cb-90a026eebf0a req-c748a042-5f97-44e7-8172-3ac545a73c8a service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:45.795376 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-c180151b-219d-422d-95cb-90a026eebf0a req-c748a042-5f97-44e7-8172-3ac545a73c8a service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:45.796236 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-c180151b-219d-422d-95cb-90a026eebf0a req-c748a042-5f97-44e7-8172-3ac545a73c8a service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:45.810537 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-c180151b-219d-422d-95cb-90a026eebf0a req-c748a042-5f97-44e7-8172-3ac545a73c8a service nova] Creating event network-vif-plugged:c1929c28-a0f2-4fed-aba4-ecfd08ac8e7e for instance f9b66475-83f6-49a3-bc63-8965fc1aec14 on n-h2-850499-9 Aug 31 16:04:45.811870 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-4839ca13-e10c-472a-9485-f3163c3d8955 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:45.817935 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4839ca13-e10c-472a-9485-f3163c3d8955 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5" status: 200 len: 1487 microversion: 2.25 time: 0.787171 Aug 31 16:04:45.820525 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-c180151b-219d-422d-95cb-90a026eebf0a req-c748a042-5f97-44e7-8172-3ac545a73c8a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056021 Aug 31 16:04:45.824627 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1135/2256] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:04:45 2022] GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5 => generated 1487 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:04:45.838833 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2d71553b-e6f0-4b6a-ade2-81f0eac379d3 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:45.840615 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2d71553b-e6f0-4b6a-ade2-81f0eac379d3 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: d8590729-e3da-4e04-9daa-7e04a3d88068] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:45.841329 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1122/2257] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:04:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:04:45.853647 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2d71553b-e6f0-4b6a-ade2-81f0eac379d3 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:45.854549 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2d71553b-e6f0-4b6a-ade2-81f0eac379d3 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:45.856421 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2d71553b-e6f0-4b6a-ade2-81f0eac379d3 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:45.856838 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-baca72f3-14c6-4f5f-a3be-2d730eb2c2c7 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:45.859671 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-baca72f3-14c6-4f5f-a3be-2d730eb2c2c7 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: f9b66475-83f6-49a3-bc63-8965fc1aec14] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:45.859876 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2d71553b-e6f0-4b6a-ade2-81f0eac379d3 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:45.860485 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2d71553b-e6f0-4b6a-ade2-81f0eac379d3 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:45.862828 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2d71553b-e6f0-4b6a-ade2-81f0eac379d3 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:45.869154 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-baca72f3-14c6-4f5f-a3be-2d730eb2c2c7 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:45.869743 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-baca72f3-14c6-4f5f-a3be-2d730eb2c2c7 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:45.870201 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-baca72f3-14c6-4f5f-a3be-2d730eb2c2c7 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:45.871304 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-baca72f3-14c6-4f5f-a3be-2d730eb2c2c7 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:45.871807 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-baca72f3-14c6-4f5f-a3be-2d730eb2c2c7 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:45.872248 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-baca72f3-14c6-4f5f-a3be-2d730eb2c2c7 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:46.014993 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2d71553b-e6f0-4b6a-ade2-81f0eac379d3 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:46.016104 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2d71553b-e6f0-4b6a-ade2-81f0eac379d3 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:46.016914 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2d71553b-e6f0-4b6a-ade2-81f0eac379d3 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:46.017722 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-2d71553b-e6f0-4b6a-ade2-81f0eac379d3 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lazy-loading 'fault' on Instance uuid d8590729-e3da-4e04-9daa-7e04a3d88068 {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:04:46.202083 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-2d71553b-e6f0-4b6a-ade2-81f0eac379d3 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:46.225277 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2d71553b-e6f0-4b6a-ade2-81f0eac379d3 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/d8590729-e3da-4e04-9daa-7e04a3d88068" status: 200 len: 1350 microversion: 2.1 time: 0.397723 Aug 31 16:04:46.232413 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1136/2258] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:45 2022] GET /compute/v2.1/servers/d8590729-e3da-4e04-9daa-7e04a3d88068 => generated 1350 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:46.259826 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-30148e2e-bea4-44be-b6b3-275e42423900 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:46.260648 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-30148e2e-bea4-44be-b6b3-275e42423900 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 5efb9714-ab85-499c-b0ec-f79ffb2dea61] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:46.278485 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:04:46.283226 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-30148e2e-bea4-44be-b6b3-275e42423900 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:46.299592 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-30148e2e-bea4-44be-b6b3-275e42423900 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:46.302214 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-30148e2e-bea4-44be-b6b3-275e42423900 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:46.304733 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-30148e2e-bea4-44be-b6b3-275e42423900 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:46.307736 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-30148e2e-bea4-44be-b6b3-275e42423900 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:46.312733 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-30148e2e-bea4-44be-b6b3-275e42423900 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:46.654356 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-30148e2e-bea4-44be-b6b3-275e42423900 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:46.686885 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-30148e2e-bea4-44be-b6b3-275e42423900 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/5efb9714-ab85-499c-b0ec-f79ffb2dea61" status: 200 len: 1275 microversion: 2.1 time: 0.452478 Aug 31 16:04:46.701250 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1137/2259] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:46 2022] GET /compute/v2.1/servers/5efb9714-ab85-499c-b0ec-f79ffb2dea61 => generated 1275 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:46.756425 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-baca72f3-14c6-4f5f-a3be-2d730eb2c2c7 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:46.774483 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-baca72f3-14c6-4f5f-a3be-2d730eb2c2c7 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/f9b66475-83f6-49a3-bc63-8965fc1aec14" status: 200 len: 1378 microversion: 2.1 time: 0.931724 Aug 31 16:04:46.800965 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e3021978-c79f-4fd9-9b9d-b5ee6c6ef46e tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:46.804840 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e3021978-c79f-4fd9-9b9d-b5ee6c6ef46e tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: dd702273-095b-4d44-8d1b-3d90f7833d5f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:46.817334 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e3021978-c79f-4fd9-9b9d-b5ee6c6ef46e tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:46.818490 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e3021978-c79f-4fd9-9b9d-b5ee6c6ef46e tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:46.819317 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e3021978-c79f-4fd9-9b9d-b5ee6c6ef46e tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:46.820306 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e3021978-c79f-4fd9-9b9d-b5ee6c6ef46e tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:46.820975 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e3021978-c79f-4fd9-9b9d-b5ee6c6ef46e tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:46.821579 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e3021978-c79f-4fd9-9b9d-b5ee6c6ef46e tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:46.824207 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1123/2260] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:45 2022] GET /compute/v2.1/servers/f9b66475-83f6-49a3-bc63-8965fc1aec14 => generated 1378 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:46.846570 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-bd7ea6d4-c859-443b-a4cb-91b2c0848c04 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:46.847205 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-bd7ea6d4-c859-443b-a4cb-91b2c0848c04 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 006771fc-9da9-4b78-9fad-f4b72c311fd5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:46.872513 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bd7ea6d4-c859-443b-a4cb-91b2c0848c04 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:46.873034 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bd7ea6d4-c859-443b-a4cb-91b2c0848c04 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:46.873491 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bd7ea6d4-c859-443b-a4cb-91b2c0848c04 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:46.874231 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bd7ea6d4-c859-443b-a4cb-91b2c0848c04 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:46.874700 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bd7ea6d4-c859-443b-a4cb-91b2c0848c04 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:46.875140 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bd7ea6d4-c859-443b-a4cb-91b2c0848c04 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:47.465147 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-bd7ea6d4-c859-443b-a4cb-91b2c0848c04 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:47.477797 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e3021978-c79f-4fd9-9b9d-b5ee6c6ef46e tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:47.516373 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e3021978-c79f-4fd9-9b9d-b5ee6c6ef46e tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f" status: 200 len: 1392 microversion: 2.1 time: 0.733502 Aug 31 16:04:47.517041 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1138/2261] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:46 2022] GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f => generated 1392 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:04:47.518523 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-bd7ea6d4-c859-443b-a4cb-91b2c0848c04 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:47.524802 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-bd7ea6d4-c859-443b-a4cb-91b2c0848c04 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:47.526913 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-bd7ea6d4-c859-443b-a4cb-91b2c0848c04 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5" status: 200 len: 1487 microversion: 2.25 time: 0.684218 Aug 31 16:04:47.532677 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1124/2262] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:04:46 2022] GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5 => generated 1487 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:04:47.537209 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-cf617690-dbee-4d58-8f9b-4b5f8e15e1ee tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:47.538147 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-cf617690-dbee-4d58-8f9b-4b5f8e15e1ee tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: d8590729-e3da-4e04-9daa-7e04a3d88068] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:47.557310 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cf617690-dbee-4d58-8f9b-4b5f8e15e1ee tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:47.560413 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cf617690-dbee-4d58-8f9b-4b5f8e15e1ee tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:47.563071 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cf617690-dbee-4d58-8f9b-4b5f8e15e1ee tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:47.567144 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cf617690-dbee-4d58-8f9b-4b5f8e15e1ee tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:47.568072 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cf617690-dbee-4d58-8f9b-4b5f8e15e1ee tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:47.569945 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cf617690-dbee-4d58-8f9b-4b5f8e15e1ee tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:47.606618 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-cf617690-dbee-4d58-8f9b-4b5f8e15e1ee tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] HTTP exception thrown: Instance d8590729-e3da-4e04-9daa-7e04a3d88068 could not be found. Aug 31 16:04:47.609847 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-cf617690-dbee-4d58-8f9b-4b5f8e15e1ee tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Request method failure captured: Aug 31 16:04:47.609847 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/d8590729-e3da-4e04-9daa-7e04a3d88068 HTTP/1.1 Aug 31 16:04:47.609847 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:04:47.609847 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:04:47.609847 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:04:47.609847 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:04:47.609847 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:04:47.609847 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:04:47.609847 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:04:47.609847 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:04:47.609847 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4Yo5dNOTiRoHOXx-UM5Sn8Jbzoi0Z4yz9YBk3W8_DEhZnVZu-DDO0QOzNoQHJ1nNP8QtjbDsJSdq3n7hK4ZXI2LEyeWPrk9aNaREtGRbElEfeP-G76pg20KjiuDCyp0gfSMP_cw21bhq2fJbey8HuCI0lmGBIAsUVWfxqkVQu-gwfg Aug 31 16:04:47.609847 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:04:47.609847 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:04:47.609847 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:04:47.609847 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:04:47.609847 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:04:47.609847 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:04:47.609847 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: af5a8bccbcb14afd9c6bcd6f4d4f8047 Aug 31 16:04:47.609847 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-DeleteServersTestJSON-1125268000 Aug 31 16:04:47.609847 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:04:47.609847 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:04:47.609847 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/af5a8bccbcb14afd9c6bcd6f4d4f8047"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/af5a8bccbcb14afd9c6bcd6f4d4f8047"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_af5a8bccbcb14afd9c6bcd6f4d4f8047", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/af5a8bccbcb14afd9c6bcd6f4d4f8047"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:04:47.609847 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-DeleteServersTestJSON-1125268000 Aug 31 16:04:47.609847 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: af5a8bccbcb14afd9c6bcd6f4d4f8047 Aug 31 16:04:47.609847 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-DeleteServersTestJSON-1125268000 Aug 31 16:04:47.609847 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-DeleteServersTestJSON-1125268000-project Aug 31 16:04:47.609847 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:04:47.609847 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:04:47.609847 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 4ee58e6a7c284cc9a9c87d0a5c1239aa Aug 31 16:04:47.609847 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-DeleteServersTestJSON-1125268000-project Aug 31 16:04:47.609847 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:04:47.609847 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance d8590729-e3da-4e04-9daa-7e04a3d88068 could not be found. Aug 31 16:04:47.609847 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': 'd8590729-e3da-4e04-9daa-7e04a3d88068'} Aug 31 16:04:47.609847 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:04:47.609847 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:04:47.609847 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:04:47.609847 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:04:47.609847 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:04:47.609847 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:04:47.609847 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:04:47.609847 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:04:47.609847 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:04:47.609847 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:04:47.609847 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8590729-e3da-4e04-9daa-7e04a3d88068 could not be found. Aug 31 16:04:47.609847 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:04:47.609847 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:04:47.609847 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:04:47.609847 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:04:47.609847 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:04:47.609847 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:04:47.609847 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:04:47.609847 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:04:47.609847 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:04:47.609847 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:04:47.609847 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:04:47.609847 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:04:47.609847 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:04:47.609847 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:04:47.609847 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:04:47.609847 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:04:47.609847 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8590729-e3da-4e04-9daa-7e04a3d88068 could not be found. Aug 31 16:04:47.609847 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:04:47.609847 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:04:47.609847 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:04:47.615978 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:04:47.615978 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:04:47.615978 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:04:47.615978 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:04:47.615978 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:04:47.615978 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8590729-e3da-4e04-9daa-7e04a3d88068 could not be found. Aug 31 16:04:47.615978 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:04:47.618808 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-cf617690-dbee-4d58-8f9b-4b5f8e15e1ee tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Returning 404 to user: Instance d8590729-e3da-4e04-9daa-7e04a3d88068 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:04:47.620038 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-cf617690-dbee-4d58-8f9b-4b5f8e15e1ee tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/d8590729-e3da-4e04-9daa-7e04a3d88068" status: 404 len: 111 microversion: 2.1 time: 0.102048 Aug 31 16:04:47.624744 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1139/2263] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:47 2022] GET /compute/v2.1/servers/d8590729-e3da-4e04-9daa-7e04a3d88068 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:04:47.747095 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7b104d3f-2ff4-4cbf-9bf7-966eae0a0c57 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:47.747963 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7b104d3f-2ff4-4cbf-9bf7-966eae0a0c57 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 5efb9714-ab85-499c-b0ec-f79ffb2dea61] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:47.772875 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7b104d3f-2ff4-4cbf-9bf7-966eae0a0c57 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:47.776108 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7b104d3f-2ff4-4cbf-9bf7-966eae0a0c57 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:47.777990 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7b104d3f-2ff4-4cbf-9bf7-966eae0a0c57 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:47.779657 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7b104d3f-2ff4-4cbf-9bf7-966eae0a0c57 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:47.780982 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7b104d3f-2ff4-4cbf-9bf7-966eae0a0c57 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:47.782085 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7b104d3f-2ff4-4cbf-9bf7-966eae0a0c57 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:47.834730 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-dc467d87-7582-4083-ad12-2bfab5d6d3fd tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:47.835970 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-dc467d87-7582-4083-ad12-2bfab5d6d3fd tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: f9b66475-83f6-49a3-bc63-8965fc1aec14] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:47.867278 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dc467d87-7582-4083-ad12-2bfab5d6d3fd tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:47.875356 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dc467d87-7582-4083-ad12-2bfab5d6d3fd tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:47.875854 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dc467d87-7582-4083-ad12-2bfab5d6d3fd tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:47.876613 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dc467d87-7582-4083-ad12-2bfab5d6d3fd tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:47.878095 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dc467d87-7582-4083-ad12-2bfab5d6d3fd tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:47.878095 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dc467d87-7582-4083-ad12-2bfab5d6d3fd tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:48.381906 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-dc467d87-7582-4083-ad12-2bfab5d6d3fd tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:48.396497 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7b104d3f-2ff4-4cbf-9bf7-966eae0a0c57 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:48.412991 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-dc467d87-7582-4083-ad12-2bfab5d6d3fd tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/f9b66475-83f6-49a3-bc63-8965fc1aec14" status: 200 len: 1378 microversion: 2.1 time: 0.589948 Aug 31 16:04:48.413941 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7b104d3f-2ff4-4cbf-9bf7-966eae0a0c57 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/5efb9714-ab85-499c-b0ec-f79ffb2dea61" status: 200 len: 1317 microversion: 2.1 time: 0.670971 Aug 31 16:04:48.414845 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1125/2264] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:47 2022] GET /compute/v2.1/servers/5efb9714-ab85-499c-b0ec-f79ffb2dea61 => generated 1317 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:48.416778 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1140/2265] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:47 2022] GET /compute/v2.1/servers/f9b66475-83f6-49a3-bc63-8965fc1aec14 => generated 1378 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:04:48.424509 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e81444fe-702d-4393-ba09-bc9c9a57dbf9 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:48.434886 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e81444fe-702d-4393-ba09-bc9c9a57dbf9 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: d8590729-e3da-4e04-9daa-7e04a3d88068] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:48.441624 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e81444fe-702d-4393-ba09-bc9c9a57dbf9 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:48.442385 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e81444fe-702d-4393-ba09-bc9c9a57dbf9 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:48.443000 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e81444fe-702d-4393-ba09-bc9c9a57dbf9 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:48.443950 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e81444fe-702d-4393-ba09-bc9c9a57dbf9 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:48.445236 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e81444fe-702d-4393-ba09-bc9c9a57dbf9 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:48.445852 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e81444fe-702d-4393-ba09-bc9c9a57dbf9 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:48.473018 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-e81444fe-702d-4393-ba09-bc9c9a57dbf9 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] HTTP exception thrown: Instance d8590729-e3da-4e04-9daa-7e04a3d88068 could not be found. Aug 31 16:04:48.486460 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e81444fe-702d-4393-ba09-bc9c9a57dbf9 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Request method failure captured: Aug 31 16:04:48.486460 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/d8590729-e3da-4e04-9daa-7e04a3d88068/os-volume_attachments HTTP/1.1 Aug 31 16:04:48.486460 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:04:48.486460 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:04:48.486460 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:04:48.486460 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:04:48.486460 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:04:48.486460 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:04:48.486460 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:04:48.486460 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:04:48.486460 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4Yo5dNOTiRoHOXx-UM5Sn8Jbzoi0Z4yz9YBk3W8_DEhZnVZu-DDO0QOzNoQHJ1nNP8QtjbDsJSdq3n7hK4ZXI2LEyeWPrk9aNaREtGRbElEfeP-G76pg20KjiuDCyp0gfSMP_cw21bhq2fJbey8HuCI0lmGBIAsUVWfxqkVQu-gwfg Aug 31 16:04:48.486460 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:04:48.486460 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:04:48.486460 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:04:48.486460 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:04:48.486460 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:04:48.486460 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:04:48.486460 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: af5a8bccbcb14afd9c6bcd6f4d4f8047 Aug 31 16:04:48.486460 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-DeleteServersTestJSON-1125268000 Aug 31 16:04:48.486460 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:04:48.486460 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:04:48.486460 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/af5a8bccbcb14afd9c6bcd6f4d4f8047"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/af5a8bccbcb14afd9c6bcd6f4d4f8047"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_af5a8bccbcb14afd9c6bcd6f4d4f8047", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/af5a8bccbcb14afd9c6bcd6f4d4f8047"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:04:48.486460 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-DeleteServersTestJSON-1125268000 Aug 31 16:04:48.486460 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: af5a8bccbcb14afd9c6bcd6f4d4f8047 Aug 31 16:04:48.486460 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-DeleteServersTestJSON-1125268000 Aug 31 16:04:48.486460 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-DeleteServersTestJSON-1125268000-project Aug 31 16:04:48.486460 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:04:48.486460 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:04:48.486460 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 4ee58e6a7c284cc9a9c87d0a5c1239aa Aug 31 16:04:48.486460 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-DeleteServersTestJSON-1125268000-project Aug 31 16:04:48.486460 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:04:48.486460 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance d8590729-e3da-4e04-9daa-7e04a3d88068 could not be found. Aug 31 16:04:48.486460 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'server_id': 'd8590729-e3da-4e04-9daa-7e04a3d88068'} Aug 31 16:04:48.486460 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:04:48.486460 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:04:48.486460 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:04:48.486460 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:04:48.486460 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:04:48.486460 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:04:48.486460 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:04:48.486460 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:04:48.486460 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:04:48.486460 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:04:48.486460 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8590729-e3da-4e04-9daa-7e04a3d88068 could not be found. Aug 31 16:04:48.486460 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:04:48.486460 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:04:48.486460 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:04:48.486460 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:04:48.486460 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:04:48.486460 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:04:48.486460 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:04:48.486460 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:04:48.486460 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:04:48.486460 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:04:48.486460 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 31 16:04:48.486460 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:04:48.486460 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 31 16:04:48.486460 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:04:48.486460 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 31 16:04:48.486460 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 31 16:04:48.486460 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:04:48.486460 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:04:48.492605 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8590729-e3da-4e04-9daa-7e04a3d88068 could not be found. Aug 31 16:04:48.492605 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:04:48.492605 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:04:48.492605 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:04:48.492605 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:04:48.492605 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:04:48.492605 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:04:48.492605 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:04:48.492605 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:04:48.492605 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8590729-e3da-4e04-9daa-7e04a3d88068 could not be found. Aug 31 16:04:48.492605 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:04:48.494922 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e81444fe-702d-4393-ba09-bc9c9a57dbf9 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Returning 404 to user: Instance d8590729-e3da-4e04-9daa-7e04a3d88068 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:04:48.495918 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e81444fe-702d-4393-ba09-bc9c9a57dbf9 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/d8590729-e3da-4e04-9daa-7e04a3d88068/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.076774 Aug 31 16:04:48.499195 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1141/2266] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 16:04:48 2022] GET /compute/v2.1/servers/d8590729-e3da-4e04-9daa-7e04a3d88068/os-volume_attachments => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:04:48.539711 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d36f1d54-6193-4e70-9d13-cc939022864d tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:48.541397 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d36f1d54-6193-4e70-9d13-cc939022864d tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: dd702273-095b-4d44-8d1b-3d90f7833d5f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:48.562244 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-071e08ac-c696-4d71-af30-ce74aa7657fb tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:48.563233 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-071e08ac-c696-4d71-af30-ce74aa7657fb tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 006771fc-9da9-4b78-9fad-f4b72c311fd5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:48.589026 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-071e08ac-c696-4d71-af30-ce74aa7657fb tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:48.595432 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-071e08ac-c696-4d71-af30-ce74aa7657fb tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:48.597270 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-071e08ac-c696-4d71-af30-ce74aa7657fb tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:48.599051 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-071e08ac-c696-4d71-af30-ce74aa7657fb tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:48.600516 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d36f1d54-6193-4e70-9d13-cc939022864d tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:48.600983 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-071e08ac-c696-4d71-af30-ce74aa7657fb tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:48.602448 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-071e08ac-c696-4d71-af30-ce74aa7657fb tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:48.603620 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d36f1d54-6193-4e70-9d13-cc939022864d tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:48.610425 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d36f1d54-6193-4e70-9d13-cc939022864d tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:48.612130 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d36f1d54-6193-4e70-9d13-cc939022864d tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:48.619611 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d36f1d54-6193-4e70-9d13-cc939022864d tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:48.627628 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d36f1d54-6193-4e70-9d13-cc939022864d tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:49.062486 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-071e08ac-c696-4d71-af30-ce74aa7657fb tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:49.072386 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-071e08ac-c696-4d71-af30-ce74aa7657fb tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:49.077393 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-071e08ac-c696-4d71-af30-ce74aa7657fb tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:49.080091 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-071e08ac-c696-4d71-af30-ce74aa7657fb tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5" status: 200 len: 1487 microversion: 2.25 time: 0.523576 Aug 31 16:04:49.100396 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1142/2267] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:04:48 2022] GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5 => generated 1487 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:04:49.109718 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b25b87ee-716f-4cd0-82da-47604ae7fb91 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1883024617", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "networks": [{"uuid": "b472c169-a645-4811-858d-fe4088611ce7"}]}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:04:49.186602 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-b25b87ee-716f-4cd0-82da-47604ae7fb91 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] validate_networks() for [('b472c169-a645-4811-858d-fe4088611ce7', None, None, None, None, None)] {{(pid=122256) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:04:49.539260 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d36f1d54-6193-4e70-9d13-cc939022864d tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:49.551694 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d36f1d54-6193-4e70-9d13-cc939022864d tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f" status: 200 len: 1382 microversion: 2.1 time: 1.016991 Aug 31 16:04:49.552297 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1126/2268] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:48 2022] GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f => generated 1382 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:49.565318 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a91da769-c351-464a-bcb9-640c508b858b tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:49.572463 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a91da769-c351-464a-bcb9-640c508b858b tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 5efb9714-ab85-499c-b0ec-f79ffb2dea61] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:49.586156 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a91da769-c351-464a-bcb9-640c508b858b tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:49.596117 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a91da769-c351-464a-bcb9-640c508b858b tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:49.596674 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a91da769-c351-464a-bcb9-640c508b858b tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:49.597530 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a91da769-c351-464a-bcb9-640c508b858b tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:49.598100 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a91da769-c351-464a-bcb9-640c508b858b tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:49.598610 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a91da769-c351-464a-bcb9-640c508b858b tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:49.937993 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:04:50.009706 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a91da769-c351-464a-bcb9-640c508b858b tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:50.024788 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a91da769-c351-464a-bcb9-640c508b858b tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/5efb9714-ab85-499c-b0ec-f79ffb2dea61" status: 200 len: 1317 microversion: 2.1 time: 0.469320 Aug 31 16:04:50.025757 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1127/2269] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:49 2022] GET /compute/v2.1/servers/5efb9714-ab85-499c-b0ec-f79ffb2dea61 => generated 1317 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:50.044873 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-795dd9b2-7860-4094-a375-8dc82e9c4741 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:50.044873 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-795dd9b2-7860-4094-a375-8dc82e9c4741 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: f9b66475-83f6-49a3-bc63-8965fc1aec14] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:50.061555 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-795dd9b2-7860-4094-a375-8dc82e9c4741 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:50.063851 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-795dd9b2-7860-4094-a375-8dc82e9c4741 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:50.064567 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-795dd9b2-7860-4094-a375-8dc82e9c4741 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:50.066826 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-795dd9b2-7860-4094-a375-8dc82e9c4741 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:50.070003 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-795dd9b2-7860-4094-a375-8dc82e9c4741 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:50.070795 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-795dd9b2-7860-4094-a375-8dc82e9c4741 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:50.437807 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-795dd9b2-7860-4094-a375-8dc82e9c4741 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:50.457975 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-795dd9b2-7860-4094-a375-8dc82e9c4741 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/f9b66475-83f6-49a3-bc63-8965fc1aec14" status: 200 len: 1527 microversion: 2.1 time: 0.426673 Aug 31 16:04:50.461104 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1128/2270] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:50 2022] GET /compute/v2.1/servers/f9b66475-83f6-49a3-bc63-8965fc1aec14 => generated 1527 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:50.476627 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-bc3efb2a-c2f6-4501-9966-cad1ef1a764c tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Calling method '.version_select at 0x7f5ae8cdc310>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:50.488103 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bc3efb2a-c2f6-4501-9966-cad1ef1a764c tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:50.488638 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bc3efb2a-c2f6-4501-9966-cad1ef1a764c tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:50.489377 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bc3efb2a-c2f6-4501-9966-cad1ef1a764c tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:50.518175 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-bc3efb2a-c2f6-4501-9966-cad1ef1a764c tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] 10.222.0.61 "GET /compute/v2.1/os-migrations" status: 200 len: 3875 microversion: 2.1 time: 0.055487 Aug 31 16:04:50.518803 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1129/2271] 10.222.0.61 () {58 vars in 1143 bytes} [Wed Aug 31 16:04:50 2022] GET /compute/v2.1/os-migrations => generated 3875 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:50.531291 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f844f2bc-2a16-4160-8885-4f30aa373535 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:50.537677 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f844f2bc-2a16-4160-8885-4f30aa373535 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 006771fc-9da9-4b78-9fad-f4b72c311fd5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:50.547673 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f844f2bc-2a16-4160-8885-4f30aa373535 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:50.548425 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f844f2bc-2a16-4160-8885-4f30aa373535 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:50.550272 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f844f2bc-2a16-4160-8885-4f30aa373535 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:50.551270 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f844f2bc-2a16-4160-8885-4f30aa373535 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:50.551965 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f844f2bc-2a16-4160-8885-4f30aa373535 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:50.552515 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f844f2bc-2a16-4160-8885-4f30aa373535 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:50.592370 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-b25b87ee-716f-4cd0-82da-47604ae7fb91 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:04:50.593355 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-b25b87ee-716f-4cd0-82da-47604ae7fb91 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:04:50.593631 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-b25b87ee-716f-4cd0-82da-47604ae7fb91 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:04:50.594054 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-b25b87ee-716f-4cd0-82da-47604ae7fb91 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:04:50.594474 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-b25b87ee-716f-4cd0-82da-47604ae7fb91 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:04:50.614579 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b25b87ee-716f-4cd0-82da-47604ae7fb91 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:50.615093 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b25b87ee-716f-4cd0-82da-47604ae7fb91 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:50.615560 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b25b87ee-716f-4cd0-82da-47604ae7fb91 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:50.616305 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b25b87ee-716f-4cd0-82da-47604ae7fb91 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:50.616771 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b25b87ee-716f-4cd0-82da-47604ae7fb91 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:50.617206 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b25b87ee-716f-4cd0-82da-47604ae7fb91 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:50.661955 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-b25b87ee-716f-4cd0-82da-47604ae7fb91 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Getting quotas for project af5a8bccbcb14afd9c6bcd6f4d4f8047. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:04:50.675892 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-b25b87ee-716f-4cd0-82da-47604ae7fb91 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Getting quotas for user 4ee58e6a7c284cc9a9c87d0a5c1239aa and project af5a8bccbcb14afd9c6bcd6f4d4f8047. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:04:50.708449 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b25b87ee-716f-4cd0-82da-47604ae7fb91 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Going to run 1 instances... {{(pid=122256) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:04:50.711439 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b25b87ee-716f-4cd0-82da-47604ae7fb91 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 7413e400-d79a-4055-838e-86808cd23b83] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:04:50.834976 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b25b87ee-716f-4cd0-82da-47604ae7fb91 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.729387 Aug 31 16:04:50.858427 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1143/2272] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:04:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1757 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:04:50.880738 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ed82acee-c7ff-4bf8-8737-e40da33a3a4d tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:50.881370 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ed82acee-c7ff-4bf8-8737-e40da33a3a4d tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: f9b66475-83f6-49a3-bc63-8965fc1aec14] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:50.893568 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ed82acee-c7ff-4bf8-8737-e40da33a3a4d tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:50.893948 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ed82acee-c7ff-4bf8-8737-e40da33a3a4d tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:50.894384 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ed82acee-c7ff-4bf8-8737-e40da33a3a4d tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:50.909453 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ed82acee-c7ff-4bf8-8737-e40da33a3a4d tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:50.913111 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ed82acee-c7ff-4bf8-8737-e40da33a3a4d tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:50.913824 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ed82acee-c7ff-4bf8-8737-e40da33a3a4d tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:51.168353 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f844f2bc-2a16-4160-8885-4f30aa373535 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:51.193077 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f844f2bc-2a16-4160-8885-4f30aa373535 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:51.201274 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f844f2bc-2a16-4160-8885-4f30aa373535 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:51.207541 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f844f2bc-2a16-4160-8885-4f30aa373535 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5" status: 200 len: 1487 microversion: 2.25 time: 0.679030 Aug 31 16:04:51.227916 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1130/2273] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:04:50 2022] GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5 => generated 1487 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:04:51.238669 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1a536d55-84be-43f8-add3-07d892cb1a55 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:51.244785 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1a536d55-84be-43f8-add3-07d892cb1a55 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] [instance: dd702273-095b-4d44-8d1b-3d90f7833d5f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:51.261947 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1a536d55-84be-43f8-add3-07d892cb1a55 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:51.264561 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1a536d55-84be-43f8-add3-07d892cb1a55 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:51.265862 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1a536d55-84be-43f8-add3-07d892cb1a55 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:51.267608 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1a536d55-84be-43f8-add3-07d892cb1a55 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:51.270696 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1a536d55-84be-43f8-add3-07d892cb1a55 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:51.272030 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1a536d55-84be-43f8-add3-07d892cb1a55 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:51.894817 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ed82acee-c7ff-4bf8-8737-e40da33a3a4d tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:51.906667 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ed82acee-c7ff-4bf8-8737-e40da33a3a4d tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/f9b66475-83f6-49a3-bc63-8965fc1aec14" status: 200 len: 1527 microversion: 2.1 time: 1.046960 Aug 31 16:04:51.922485 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1144/2274] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:50 2022] GET /compute/v2.1/servers/f9b66475-83f6-49a3-bc63-8965fc1aec14 => generated 1527 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:51.932883 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d4a7bf67-926d-4823-901e-313472c78e08 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:51.941554 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d4a7bf67-926d-4823-901e-313472c78e08 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 7413e400-d79a-4055-838e-86808cd23b83] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:51.977749 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d4a7bf67-926d-4823-901e-313472c78e08 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:51.982899 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d4a7bf67-926d-4823-901e-313472c78e08 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:51.996723 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d4a7bf67-926d-4823-901e-313472c78e08 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:51.997627 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d4a7bf67-926d-4823-901e-313472c78e08 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:52.004487 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d4a7bf67-926d-4823-901e-313472c78e08 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:52.005763 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d4a7bf67-926d-4823-901e-313472c78e08 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:52.274539 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d4a7bf67-926d-4823-901e-313472c78e08 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:52.290997 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d4a7bf67-926d-4823-901e-313472c78e08 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/7413e400-d79a-4055-838e-86808cd23b83" status: 200 len: 1219 microversion: 2.1 time: 0.366903 Aug 31 16:04:52.294222 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1145/2275] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:51 2022] GET /compute/v2.1/servers/7413e400-d79a-4055-838e-86808cd23b83 => generated 1219 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:52.315328 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e3a8272d-c625-4655-8b40-8311390d085f tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:52.318615 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e3a8272d-c625-4655-8b40-8311390d085f tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 5efb9714-ab85-499c-b0ec-f79ffb2dea61] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:52.334821 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e3a8272d-c625-4655-8b40-8311390d085f tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:52.335734 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e3a8272d-c625-4655-8b40-8311390d085f tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:52.339441 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e3a8272d-c625-4655-8b40-8311390d085f tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:52.340964 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e3a8272d-c625-4655-8b40-8311390d085f tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:52.341473 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e3a8272d-c625-4655-8b40-8311390d085f tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:52.341930 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e3a8272d-c625-4655-8b40-8311390d085f tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:52.384428 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1a536d55-84be-43f8-add3-07d892cb1a55 tempest-LiveMigrationTest-3192099 tempest-LiveMigrationTest-3192099-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f" status: 200 len: 1533 microversion: 2.1 time: 1.154064 Aug 31 16:04:52.385064 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1131/2276] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:51 2022] GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f => generated 1533 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:52.410519 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-5253d763-5f7d-4cfa-a508-a0216b27b324 req-52732eb0-5b0a-47de-a184-157de3dc6a27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5efb9714-ab85-499c-b0ec-f79ffb2dea61", "tag": "7380b28d-6c2b-4a62-9b98-da18ab201665"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:04:52.429223 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=100 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:04:52.453865 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-5253d763-5f7d-4cfa-a508-a0216b27b324 req-52732eb0-5b0a-47de-a184-157de3dc6a27 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:52.455890 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-5253d763-5f7d-4cfa-a508-a0216b27b324 req-52732eb0-5b0a-47de-a184-157de3dc6a27 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:52.456523 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-5253d763-5f7d-4cfa-a508-a0216b27b324 req-52732eb0-5b0a-47de-a184-157de3dc6a27 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:52.497431 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-5253d763-5f7d-4cfa-a508-a0216b27b324 req-52732eb0-5b0a-47de-a184-157de3dc6a27 service nova] Creating event network-changed:7380b28d-6c2b-4a62-9b98-da18ab201665 for instance 5efb9714-ab85-499c-b0ec-f79ffb2dea61 on n-h2-850499-9 Aug 31 16:04:52.522604 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-5253d763-5f7d-4cfa-a508-a0216b27b324 req-52732eb0-5b0a-47de-a184-157de3dc6a27 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129309 Aug 31 16:04:52.525399 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1132/2277] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:04:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:04:52.547257 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6d21d598-8b14-45e1-b95b-20d1d425b105 tempest-MigrationsAdminTest-62329235 tempest-MigrationsAdminTest-62329235-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:52.577037 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6d21d598-8b14-45e1-b95b-20d1d425b105 tempest-MigrationsAdminTest-62329235 tempest-MigrationsAdminTest-62329235-project-admin] 10.222.0.61 "DELETE /compute/v2.1/flavors/3308ef12-9ed9-4ca1-8e85-790a96a45515" status: 202 len: 0 microversion: 2.1 time: 0.046181 Aug 31 16:04:52.578262 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1133/2278] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:04:52 2022] DELETE /compute/v2.1/flavors/3308ef12-9ed9-4ca1-8e85-790a96a45515 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:04:52.586446 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-41c45ee9-5858-40a2-8f31-109e28d3c322 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:52.587710 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-41c45ee9-5858-40a2-8f31-109e28d3c322 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 006771fc-9da9-4b78-9fad-f4b72c311fd5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:52.603481 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-41c45ee9-5858-40a2-8f31-109e28d3c322 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:52.604170 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-41c45ee9-5858-40a2-8f31-109e28d3c322 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:52.606313 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-41c45ee9-5858-40a2-8f31-109e28d3c322 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:52.607739 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-41c45ee9-5858-40a2-8f31-109e28d3c322 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:52.611046 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-41c45ee9-5858-40a2-8f31-109e28d3c322 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:52.612808 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-41c45ee9-5858-40a2-8f31-109e28d3c322 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:53.244187 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-41c45ee9-5858-40a2-8f31-109e28d3c322 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:53.244505 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e3a8272d-c625-4655-8b40-8311390d085f tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:53.263038 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e3a8272d-c625-4655-8b40-8311390d085f tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/5efb9714-ab85-499c-b0ec-f79ffb2dea61" status: 200 len: 1317 microversion: 2.1 time: 0.964758 Aug 31 16:04:53.269922 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1146/2279] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:52 2022] GET /compute/v2.1/servers/5efb9714-ab85-499c-b0ec-f79ffb2dea61 => generated 1317 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:53.275075 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-41c45ee9-5858-40a2-8f31-109e28d3c322 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:53.277932 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-41c45ee9-5858-40a2-8f31-109e28d3c322 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:53.281079 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-41c45ee9-5858-40a2-8f31-109e28d3c322 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5" status: 200 len: 1487 microversion: 2.25 time: 0.700900 Aug 31 16:04:53.288554 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1134/2280] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:04:52 2022] GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5 => generated 1487 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:04:53.299205 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-612e806e-ad75-4f63-8d09-fa7bea43419f tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:53.307830 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9189725b-e0e1-4ade-a523-45a815717e2c tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:53.308702 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-612e806e-ad75-4f63-8d09-fa7bea43419f tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 7413e400-d79a-4055-838e-86808cd23b83] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:53.309634 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9189725b-e0e1-4ade-a523-45a815717e2c tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: dd702273-095b-4d44-8d1b-3d90f7833d5f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:53.338159 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9189725b-e0e1-4ade-a523-45a815717e2c tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:53.340475 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9189725b-e0e1-4ade-a523-45a815717e2c tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:53.341059 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9189725b-e0e1-4ade-a523-45a815717e2c tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:53.341990 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9189725b-e0e1-4ade-a523-45a815717e2c tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:53.342573 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9189725b-e0e1-4ade-a523-45a815717e2c tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:53.343081 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9189725b-e0e1-4ade-a523-45a815717e2c tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:53.346875 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-612e806e-ad75-4f63-8d09-fa7bea43419f tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:53.348457 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-612e806e-ad75-4f63-8d09-fa7bea43419f tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:53.353341 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-612e806e-ad75-4f63-8d09-fa7bea43419f tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:53.354324 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-612e806e-ad75-4f63-8d09-fa7bea43419f tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:53.354858 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-612e806e-ad75-4f63-8d09-fa7bea43419f tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:53.357936 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-612e806e-ad75-4f63-8d09-fa7bea43419f tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:53.408787 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9189725b-e0e1-4ade-a523-45a815717e2c tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: dd702273-095b-4d44-8d1b-3d90f7833d5f] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:04:53.528246 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-612e806e-ad75-4f63-8d09-fa7bea43419f tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 7413e400-d79a-4055-838e-86808cd23b83] Going to try to terminate instance {{(pid=122256) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:04:53.581223 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9189725b-e0e1-4ade-a523-45a815717e2c tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "DELETE /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f" status: 204 len: 0 microversion: 2.1 time: 0.290343 Aug 31 16:04:53.582458 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1135/2281] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:04:53 2022] DELETE /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:04:53.601881 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b49b818a-e092-4f09-88f0-311a92f94b3d tempest-MigrationsAdminTest-62329235 tempest-MigrationsAdminTest-62329235-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:53.674509 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b49b818a-e092-4f09-88f0-311a92f94b3d tempest-MigrationsAdminTest-62329235 tempest-MigrationsAdminTest-62329235-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.088305 Aug 31 16:04:53.677336 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1136/2282] 10.222.0.61 () {58 vars in 1146 bytes} [Wed Aug 31 16:04:53 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:53.690180 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3d327649-9429-481f-9815-80490322bd49 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:53.692190 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3d327649-9429-481f-9815-80490322bd49 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: dd702273-095b-4d44-8d1b-3d90f7833d5f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:53.722957 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3d327649-9429-481f-9815-80490322bd49 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:53.727460 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3d327649-9429-481f-9815-80490322bd49 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:53.728566 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3d327649-9429-481f-9815-80490322bd49 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:53.733494 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3d327649-9429-481f-9815-80490322bd49 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:53.740102 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3d327649-9429-481f-9815-80490322bd49 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:53.740594 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3d327649-9429-481f-9815-80490322bd49 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:53.765053 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-612e806e-ad75-4f63-8d09-fa7bea43419f tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "DELETE /compute/v2.1/servers/7413e400-d79a-4055-838e-86808cd23b83" status: 204 len: 0 microversion: 2.1 time: 0.493309 Aug 31 16:04:53.774901 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1147/2283] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:04:53 2022] DELETE /compute/v2.1/servers/7413e400-d79a-4055-838e-86808cd23b83 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:04:53.781793 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-43af29f1-f4dd-44a4-adfa-daa444d8f374 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:04:53.788844 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-43af29f1-f4dd-44a4-adfa-daa444d8f374 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: f9b66475-83f6-49a3-bc63-8965fc1aec14] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:53.815943 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-43af29f1-f4dd-44a4-adfa-daa444d8f374 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:53.817140 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-43af29f1-f4dd-44a4-adfa-daa444d8f374 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:53.818048 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-43af29f1-f4dd-44a4-adfa-daa444d8f374 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:53.819078 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-43af29f1-f4dd-44a4-adfa-daa444d8f374 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:53.819781 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-43af29f1-f4dd-44a4-adfa-daa444d8f374 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:53.821482 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-43af29f1-f4dd-44a4-adfa-daa444d8f374 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:53.945991 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-43af29f1-f4dd-44a4-adfa-daa444d8f374 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:53.970038 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-43af29f1-f4dd-44a4-adfa-daa444d8f374 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: f9b66475-83f6-49a3-bc63-8965fc1aec14] Old instance type tempest-test_resize_flavor_-254454518, new instance type m1.heat {{(pid=122256) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 31 16:04:53.997875 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-43af29f1-f4dd-44a4-adfa-daa444d8f374 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:04:54.000009 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-43af29f1-f4dd-44a4-adfa-daa444d8f374 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:04:54.001666 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-43af29f1-f4dd-44a4-adfa-daa444d8f374 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:04:54.004284 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-43af29f1-f4dd-44a4-adfa-daa444d8f374 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:04:54.005016 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-43af29f1-f4dd-44a4-adfa-daa444d8f374 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:04:54.155409 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-43af29f1-f4dd-44a4-adfa-daa444d8f374 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "POST /compute/v2.1/servers/f9b66475-83f6-49a3-bc63-8965fc1aec14/action" status: 202 len: 0 microversion: 2.1 time: 0.378432 Aug 31 16:04:54.156368 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1148/2284] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:04:53 2022] POST /compute/v2.1/servers/f9b66475-83f6-49a3-bc63-8965fc1aec14/action => generated 0 bytes in 381 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:04:54.173627 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-fb2daf80-485f-4a21-91d3-14f1d346dd60 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:54.174264 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-fb2daf80-485f-4a21-91d3-14f1d346dd60 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 7413e400-d79a-4055-838e-86808cd23b83] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:54.189068 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fb2daf80-485f-4a21-91d3-14f1d346dd60 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:54.189547 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fb2daf80-485f-4a21-91d3-14f1d346dd60 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:54.190006 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fb2daf80-485f-4a21-91d3-14f1d346dd60 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:54.190745 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fb2daf80-485f-4a21-91d3-14f1d346dd60 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:54.191195 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fb2daf80-485f-4a21-91d3-14f1d346dd60 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:54.191649 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fb2daf80-485f-4a21-91d3-14f1d346dd60 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:54.192310 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3d327649-9429-481f-9815-80490322bd49 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:54.217628 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3d327649-9429-481f-9815-80490322bd49 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f" status: 200 len: 1388 microversion: 2.1 time: 0.538322 Aug 31 16:04:54.234180 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1137/2285] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:53 2022] GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f => generated 1388 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:54.267774 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c035ad71-f60e-4380-a6e5-24ebd674ee79 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:54.268421 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c035ad71-f60e-4380-a6e5-24ebd674ee79 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: f9b66475-83f6-49a3-bc63-8965fc1aec14] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:54.286118 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c035ad71-f60e-4380-a6e5-24ebd674ee79 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:54.287698 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c035ad71-f60e-4380-a6e5-24ebd674ee79 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:54.290320 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c035ad71-f60e-4380-a6e5-24ebd674ee79 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:54.291313 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c035ad71-f60e-4380-a6e5-24ebd674ee79 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:54.292499 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c035ad71-f60e-4380-a6e5-24ebd674ee79 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:54.294235 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c035ad71-f60e-4380-a6e5-24ebd674ee79 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:54.317490 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-fb2daf80-485f-4a21-91d3-14f1d346dd60 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:54.342827 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-fb2daf80-485f-4a21-91d3-14f1d346dd60 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/7413e400-d79a-4055-838e-86808cd23b83" status: 200 len: 1273 microversion: 2.1 time: 0.183035 Aug 31 16:04:54.355576 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1149/2286] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:54 2022] GET /compute/v2.1/servers/7413e400-d79a-4055-838e-86808cd23b83 => generated 1273 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:54.362638 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-55e3385f-e4c1-4f90-baa2-115900acd775 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:54.365819 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-55e3385f-e4c1-4f90-baa2-115900acd775 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 5efb9714-ab85-499c-b0ec-f79ffb2dea61] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:54.382183 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-55e3385f-e4c1-4f90-baa2-115900acd775 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:54.385525 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-55e3385f-e4c1-4f90-baa2-115900acd775 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:54.388305 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-55e3385f-e4c1-4f90-baa2-115900acd775 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:54.391463 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-55e3385f-e4c1-4f90-baa2-115900acd775 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:54.392269 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-55e3385f-e4c1-4f90-baa2-115900acd775 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:54.392914 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-55e3385f-e4c1-4f90-baa2-115900acd775 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:54.838952 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c035ad71-f60e-4380-a6e5-24ebd674ee79 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:54.871966 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c035ad71-f60e-4380-a6e5-24ebd674ee79 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/f9b66475-83f6-49a3-bc63-8965fc1aec14" status: 200 len: 1536 microversion: 2.1 time: 0.640392 Aug 31 16:04:54.890722 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1138/2287] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:54 2022] GET /compute/v2.1/servers/f9b66475-83f6-49a3-bc63-8965fc1aec14 => generated 1536 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:54.943139 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d2e7f98b-5d75-4d3c-abbc-038ab1b4ee75 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:54.944984 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d2e7f98b-5d75-4d3c-abbc-038ab1b4ee75 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 006771fc-9da9-4b78-9fad-f4b72c311fd5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:54.981999 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d2e7f98b-5d75-4d3c-abbc-038ab1b4ee75 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:54.984356 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d2e7f98b-5d75-4d3c-abbc-038ab1b4ee75 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:54.989924 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d2e7f98b-5d75-4d3c-abbc-038ab1b4ee75 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:54.991027 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d2e7f98b-5d75-4d3c-abbc-038ab1b4ee75 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:54.994762 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d2e7f98b-5d75-4d3c-abbc-038ab1b4ee75 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:54.995709 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d2e7f98b-5d75-4d3c-abbc-038ab1b4ee75 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:55.004074 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:04:55.214647 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-55e3385f-e4c1-4f90-baa2-115900acd775 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:55.230944 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-55e3385f-e4c1-4f90-baa2-115900acd775 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/5efb9714-ab85-499c-b0ec-f79ffb2dea61" status: 200 len: 1317 microversion: 2.1 time: 0.879080 Aug 31 16:04:55.248963 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1150/2288] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:54 2022] GET /compute/v2.1/servers/5efb9714-ab85-499c-b0ec-f79ffb2dea61 => generated 1317 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:55.261139 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-56e9e585-d954-4c8b-b770-ec4a00a26458 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '.version_select at 0x7f5ae929fdc0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:55.343039 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-56e9e585-d954-4c8b-b770-ec4a00a26458 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "GET /compute/v2.1/images/fe00e385-6709-4c5e-9db0-e15f3717ff7f" status: 200 len: 662 microversion: 2.1 time: 0.089891 Aug 31 16:04:55.343970 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1151/2289] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:04:55 2022] GET /compute/v2.1/images/fe00e385-6709-4c5e-9db0-e15f3717ff7f => generated 662 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:04:55.359212 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5bc346eb-ad5b-495f-b1dd-a5ebc904adeb tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:55.363738 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5bc346eb-ad5b-495f-b1dd-a5ebc904adeb tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: dd702273-095b-4d44-8d1b-3d90f7833d5f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:55.378505 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5bc346eb-ad5b-495f-b1dd-a5ebc904adeb tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:55.382588 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5bc346eb-ad5b-495f-b1dd-a5ebc904adeb tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:55.384700 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5bc346eb-ad5b-495f-b1dd-a5ebc904adeb tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:55.387171 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5bc346eb-ad5b-495f-b1dd-a5ebc904adeb tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:55.390640 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5bc346eb-ad5b-495f-b1dd-a5ebc904adeb tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:55.391631 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5bc346eb-ad5b-495f-b1dd-a5ebc904adeb tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:56.535576 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d2e7f98b-5d75-4d3c-abbc-038ab1b4ee75 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:56.545884 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d2e7f98b-5d75-4d3c-abbc-038ab1b4ee75 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:56.558108 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d2e7f98b-5d75-4d3c-abbc-038ab1b4ee75 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:56.567645 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d2e7f98b-5d75-4d3c-abbc-038ab1b4ee75 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5" status: 200 len: 1487 microversion: 2.25 time: 1.665939 Aug 31 16:04:56.569251 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1139/2290] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:04:54 2022] GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5 => generated 1487 bytes in 1677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:04:56.588948 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-915a5b29-f258-42ff-88eb-e40d49e2efac tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '.version_select at 0x7f5ae8e2bf70>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:56.682583 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-915a5b29-f258-42ff-88eb-e40d49e2efac tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "GET /compute/v2.1/images/fe00e385-6709-4c5e-9db0-e15f3717ff7f" status: 200 len: 662 microversion: 2.1 time: 0.111516 Aug 31 16:04:56.686954 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1140/2291] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:04:56 2022] GET /compute/v2.1/images/fe00e385-6709-4c5e-9db0-e15f3717ff7f => generated 662 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:04:56.709006 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8dbce332-1c37-4f5e-87da-a7d207328304 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:56.710679 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8dbce332-1c37-4f5e-87da-a7d207328304 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 7413e400-d79a-4055-838e-86808cd23b83] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:56.730819 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8dbce332-1c37-4f5e-87da-a7d207328304 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:56.738378 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8dbce332-1c37-4f5e-87da-a7d207328304 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:56.738929 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8dbce332-1c37-4f5e-87da-a7d207328304 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:56.741742 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8dbce332-1c37-4f5e-87da-a7d207328304 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:56.743781 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8dbce332-1c37-4f5e-87da-a7d207328304 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:56.750135 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8dbce332-1c37-4f5e-87da-a7d207328304 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:56.990016 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8dbce332-1c37-4f5e-87da-a7d207328304 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:56.994715 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5bc346eb-ad5b-495f-b1dd-a5ebc904adeb tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:57.002119 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8dbce332-1c37-4f5e-87da-a7d207328304 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/7413e400-d79a-4055-838e-86808cd23b83" status: 200 len: 1217 microversion: 2.1 time: 0.313217 Aug 31 16:04:57.003545 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5bc346eb-ad5b-495f-b1dd-a5ebc904adeb tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f" status: 200 len: 1388 microversion: 2.1 time: 1.654184 Aug 31 16:04:57.004235 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1152/2292] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:55 2022] GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f => generated 1388 bytes in 1655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:57.004701 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1141/2293] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:56 2022] GET /compute/v2.1/servers/7413e400-d79a-4055-838e-86808cd23b83 => generated 1217 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:57.010861 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-76389a32-bd54-484b-9cc1-3d62849ae086 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:57.012085 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-76389a32-bd54-484b-9cc1-3d62849ae086 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 5efb9714-ab85-499c-b0ec-f79ffb2dea61] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:57.019726 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2ce732f7-e2cf-4618-a936-6a1f8b5fe03e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:57.020858 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-76389a32-bd54-484b-9cc1-3d62849ae086 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:57.021522 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-76389a32-bd54-484b-9cc1-3d62849ae086 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:57.022065 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2ce732f7-e2cf-4618-a936-6a1f8b5fe03e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: f9b66475-83f6-49a3-bc63-8965fc1aec14] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:57.022513 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-76389a32-bd54-484b-9cc1-3d62849ae086 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:57.024589 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-76389a32-bd54-484b-9cc1-3d62849ae086 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:57.025247 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-76389a32-bd54-484b-9cc1-3d62849ae086 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:57.025865 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-76389a32-bd54-484b-9cc1-3d62849ae086 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:57.039770 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2ce732f7-e2cf-4618-a936-6a1f8b5fe03e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:57.040394 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2ce732f7-e2cf-4618-a936-6a1f8b5fe03e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:57.040874 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2ce732f7-e2cf-4618-a936-6a1f8b5fe03e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:57.041696 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2ce732f7-e2cf-4618-a936-6a1f8b5fe03e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:57.042178 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2ce732f7-e2cf-4618-a936-6a1f8b5fe03e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:57.043236 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2ce732f7-e2cf-4618-a936-6a1f8b5fe03e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:57.887959 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-76389a32-bd54-484b-9cc1-3d62849ae086 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:57.911779 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-76389a32-bd54-484b-9cc1-3d62849ae086 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/5efb9714-ab85-499c-b0ec-f79ffb2dea61" status: 200 len: 1317 microversion: 2.1 time: 0.905168 Aug 31 16:04:57.927531 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1142/2294] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:57 2022] GET /compute/v2.1/servers/5efb9714-ab85-499c-b0ec-f79ffb2dea61 => generated 1317 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:57.927531 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6f80c8dd-4d64-4aae-b192-eb008efc36c5 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:57.927531 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6f80c8dd-4d64-4aae-b192-eb008efc36c5 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 006771fc-9da9-4b78-9fad-f4b72c311fd5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:57.946929 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6f80c8dd-4d64-4aae-b192-eb008efc36c5 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:57.947465 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6f80c8dd-4d64-4aae-b192-eb008efc36c5 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:57.947917 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6f80c8dd-4d64-4aae-b192-eb008efc36c5 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:57.951348 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6f80c8dd-4d64-4aae-b192-eb008efc36c5 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:57.952931 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6f80c8dd-4d64-4aae-b192-eb008efc36c5 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:57.953571 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6f80c8dd-4d64-4aae-b192-eb008efc36c5 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:58.040785 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-2ce732f7-e2cf-4618-a936-6a1f8b5fe03e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:58.056210 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2ce732f7-e2cf-4618-a936-6a1f8b5fe03e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/f9b66475-83f6-49a3-bc63-8965fc1aec14" status: 200 len: 1536 microversion: 2.1 time: 1.049865 Aug 31 16:04:58.060325 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1153/2295] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:57 2022] GET /compute/v2.1/servers/f9b66475-83f6-49a3-bc63-8965fc1aec14 => generated 1536 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:58.071727 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-34338898-1aa7-4233-b4d8-2d95f12969c7 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:58.072306 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-34338898-1aa7-4233-b4d8-2d95f12969c7 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: dd702273-095b-4d44-8d1b-3d90f7833d5f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:58.088945 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-34338898-1aa7-4233-b4d8-2d95f12969c7 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:58.090032 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-34338898-1aa7-4233-b4d8-2d95f12969c7 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:58.090853 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-34338898-1aa7-4233-b4d8-2d95f12969c7 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:58.094585 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-34338898-1aa7-4233-b4d8-2d95f12969c7 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:58.095406 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-34338898-1aa7-4233-b4d8-2d95f12969c7 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:58.096071 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-34338898-1aa7-4233-b4d8-2d95f12969c7 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:59.404920 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-6f80c8dd-4d64-4aae-b192-eb008efc36c5 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:59.417873 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-6f80c8dd-4d64-4aae-b192-eb008efc36c5 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:59.419951 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-6f80c8dd-4d64-4aae-b192-eb008efc36c5 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:59.422320 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6f80c8dd-4d64-4aae-b192-eb008efc36c5 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5" status: 200 len: 1487 microversion: 2.25 time: 1.505475 Aug 31 16:04:59.423459 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1143/2296] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:04:57 2022] GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5 => generated 1487 bytes in 1507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:04:59.457259 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a504688f-c9cf-4a57-9c7b-5946f98f471e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:59.458180 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a504688f-c9cf-4a57-9c7b-5946f98f471e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 7413e400-d79a-4055-838e-86808cd23b83] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:59.480936 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a504688f-c9cf-4a57-9c7b-5946f98f471e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:59.481655 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a504688f-c9cf-4a57-9c7b-5946f98f471e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:59.482116 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a504688f-c9cf-4a57-9c7b-5946f98f471e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:59.482866 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a504688f-c9cf-4a57-9c7b-5946f98f471e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:59.483343 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a504688f-c9cf-4a57-9c7b-5946f98f471e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:59.483846 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a504688f-c9cf-4a57-9c7b-5946f98f471e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:59.528967 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-34338898-1aa7-4233-b4d8-2d95f12969c7 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:59.574809 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-34338898-1aa7-4233-b4d8-2d95f12969c7 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f" status: 200 len: 1388 microversion: 2.1 time: 1.513180 Aug 31 16:04:59.582909 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1154/2297] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:58 2022] GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f => generated 1388 bytes in 1522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:59.590846 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-03d3818c-9a30-4d4f-9ffd-44ad86b776d5 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '.version_select at 0x7f5aed2c8160>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:59.656140 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-03d3818c-9a30-4d4f-9ffd-44ad86b776d5 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "GET /compute/v2.1/images/04a8a450-b36b-4c4d-b7ac-78645bdf7885" status: 200 len: 661 microversion: 2.1 time: 0.071600 Aug 31 16:04:59.666402 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1155/2298] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:04:59 2022] GET /compute/v2.1/images/04a8a450-b36b-4c4d-b7ac-78645bdf7885 => generated 661 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:04:59.672696 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b75df718-378d-451e-8681-3aae46f6d457 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:59.673330 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b75df718-378d-451e-8681-3aae46f6d457 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 5efb9714-ab85-499c-b0ec-f79ffb2dea61] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:59.691364 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b75df718-378d-451e-8681-3aae46f6d457 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:59.692149 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b75df718-378d-451e-8681-3aae46f6d457 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:59.692824 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b75df718-378d-451e-8681-3aae46f6d457 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:59.693949 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b75df718-378d-451e-8681-3aae46f6d457 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:59.694653 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b75df718-378d-451e-8681-3aae46f6d457 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:59.695340 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b75df718-378d-451e-8681-3aae46f6d457 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:59.709311 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a504688f-c9cf-4a57-9c7b-5946f98f471e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:59.722421 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a504688f-c9cf-4a57-9c7b-5946f98f471e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/7413e400-d79a-4055-838e-86808cd23b83" status: 200 len: 1219 microversion: 2.1 time: 0.297417 Aug 31 16:04:59.725237 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1144/2299] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:59 2022] GET /compute/v2.1/servers/7413e400-d79a-4055-838e-86808cd23b83 => generated 1219 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:59.756216 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9c3e1c99-196a-4792-98e1-5125c1b97952 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:59.759794 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9c3e1c99-196a-4792-98e1-5125c1b97952 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: f9b66475-83f6-49a3-bc63-8965fc1aec14] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:59.786872 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9c3e1c99-196a-4792-98e1-5125c1b97952 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:59.790212 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9c3e1c99-196a-4792-98e1-5125c1b97952 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:59.792095 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9c3e1c99-196a-4792-98e1-5125c1b97952 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:59.795065 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9c3e1c99-196a-4792-98e1-5125c1b97952 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:59.795883 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9c3e1c99-196a-4792-98e1-5125c1b97952 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:59.796586 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9c3e1c99-196a-4792-98e1-5125c1b97952 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:00.164803 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b75df718-378d-451e-8681-3aae46f6d457 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:00.183834 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b75df718-378d-451e-8681-3aae46f6d457 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/5efb9714-ab85-499c-b0ec-f79ffb2dea61" status: 200 len: 1317 microversion: 2.1 time: 0.515598 Aug 31 16:05:00.184374 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9c3e1c99-196a-4792-98e1-5125c1b97952 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:00.195806 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1156/2300] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:59 2022] GET /compute/v2.1/servers/5efb9714-ab85-499c-b0ec-f79ffb2dea61 => generated 1317 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:00.206016 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9c3e1c99-196a-4792-98e1-5125c1b97952 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/f9b66475-83f6-49a3-bc63-8965fc1aec14" status: 200 len: 1536 microversion: 2.1 time: 0.473725 Aug 31 16:05:00.213370 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1145/2301] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:59 2022] GET /compute/v2.1/servers/f9b66475-83f6-49a3-bc63-8965fc1aec14 => generated 1536 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:00.221404 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-87bde774-8ae5-4f22-878a-b3570ee8abcc tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '.version_select at 0x7f5ae8d02280>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:00.222837 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-a0d17d10-ac2c-4ad8-9d26-5c9b1ff42af5 req-aa2310ec-a5bd-4af5-ae92-86917cf283ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd702273-095b-4d44-8d1b-3d90f7833d5f", "name": "network-vif-deleted", "tag": "64253c19-8d47-46b3-808b-0eed0e37d942"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:05:00.246138 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-a0d17d10-ac2c-4ad8-9d26-5c9b1ff42af5 req-aa2310ec-a5bd-4af5-ae92-86917cf283ba service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:00.246919 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-a0d17d10-ac2c-4ad8-9d26-5c9b1ff42af5 req-aa2310ec-a5bd-4af5-ae92-86917cf283ba service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:00.247547 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-a0d17d10-ac2c-4ad8-9d26-5c9b1ff42af5 req-aa2310ec-a5bd-4af5-ae92-86917cf283ba service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:00.262073 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-a0d17d10-ac2c-4ad8-9d26-5c9b1ff42af5 req-aa2310ec-a5bd-4af5-ae92-86917cf283ba service nova] Creating event network-vif-deleted:64253c19-8d47-46b3-808b-0eed0e37d942 for instance dd702273-095b-4d44-8d1b-3d90f7833d5f on n-h1-850499-9 Aug 31 16:05:00.273801 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-a0d17d10-ac2c-4ad8-9d26-5c9b1ff42af5 req-aa2310ec-a5bd-4af5-ae92-86917cf283ba service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075001 Aug 31 16:05:00.279047 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1157/2302] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:05:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:05:00.309726 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-87bde774-8ae5-4f22-878a-b3570ee8abcc tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "GET /compute/v2.1/images/04a8a450-b36b-4c4d-b7ac-78645bdf7885" status: 200 len: 661 microversion: 2.1 time: 0.095065 Aug 31 16:05:00.316205 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1146/2303] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:05:00 2022] GET /compute/v2.1/images/04a8a450-b36b-4c4d-b7ac-78645bdf7885 => generated 661 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:05:00.397493 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1439593d-f378-4b79-96c6-ca728bbaa48e tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Action: 'create', calling method: .version_select at 0x7f5ae8fb6ca0>, body: {"keypair": {"name": "tempest-keypair-1523735894", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPGBejB+YC0I1JBlYug6L5QiXDtBHiv5LH1yKO64K6M2tNUHX2cR/OWA1odvFJg2gRzuVW34HfG7N063gDXuXsSDX8mMKkfRZ06oQyYKL4w6J5MkqNsrC1RiIa2wRw6JPg=="}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:05:00.458282 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3d018af0-6a5c-4852-b11e-fca9a7449476 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:00.458974 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3d018af0-6a5c-4852-b11e-fca9a7449476 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 006771fc-9da9-4b78-9fad-f4b72c311fd5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:00.483068 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-1439593d-f378-4b79-96c6-ca728bbaa48e tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Getting quotas for project e3e9999df7e14609b1265351c83607bd. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:05:00.493441 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3d018af0-6a5c-4852-b11e-fca9a7449476 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:00.493989 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3d018af0-6a5c-4852-b11e-fca9a7449476 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:00.499170 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3d018af0-6a5c-4852-b11e-fca9a7449476 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:00.502391 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3d018af0-6a5c-4852-b11e-fca9a7449476 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:00.502898 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3d018af0-6a5c-4852-b11e-fca9a7449476 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:00.503353 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3d018af0-6a5c-4852-b11e-fca9a7449476 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:00.517233 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-1439593d-f378-4b79-96c6-ca728bbaa48e tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Getting quotas for user a837ababe7cb4284b96bc16deb40d2d2 and project e3e9999df7e14609b1265351c83607bd. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:05:00.615741 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1439593d-f378-4b79-96c6-ca728bbaa48e tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.333746 Aug 31 16:05:00.619604 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1158/2304] 10.222.0.61 () {60 vars in 1159 bytes} [Wed Aug 31 16:05:00 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:05:00.630375 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-77013bba-2353-41b4-9079-4ec2b97e66f7 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:00.631674 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-77013bba-2353-41b4-9079-4ec2b97e66f7 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: dd702273-095b-4d44-8d1b-3d90f7833d5f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:00.667134 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:05:00.701052 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-77013bba-2353-41b4-9079-4ec2b97e66f7 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:00.701850 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-77013bba-2353-41b4-9079-4ec2b97e66f7 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:00.702592 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-77013bba-2353-41b4-9079-4ec2b97e66f7 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:00.703868 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-77013bba-2353-41b4-9079-4ec2b97e66f7 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:00.704514 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-77013bba-2353-41b4-9079-4ec2b97e66f7 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:00.705262 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-77013bba-2353-41b4-9079-4ec2b97e66f7 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:01.034109 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-77013bba-2353-41b4-9079-4ec2b97e66f7 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:01.046713 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-77013bba-2353-41b4-9079-4ec2b97e66f7 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f" status: 200 len: 1184 microversion: 2.1 time: 0.425795 Aug 31 16:05:01.049828 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1159/2305] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:00 2022] GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f => generated 1184 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:01.064880 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b42588fa-3754-408a-8cc4-d8aca0d84f18 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:01.065514 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b42588fa-3754-408a-8cc4-d8aca0d84f18 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 7413e400-d79a-4055-838e-86808cd23b83] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:01.080768 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b42588fa-3754-408a-8cc4-d8aca0d84f18 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:01.081124 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b42588fa-3754-408a-8cc4-d8aca0d84f18 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:01.081575 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b42588fa-3754-408a-8cc4-d8aca0d84f18 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:01.082311 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b42588fa-3754-408a-8cc4-d8aca0d84f18 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:01.082780 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b42588fa-3754-408a-8cc4-d8aca0d84f18 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:01.083224 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b42588fa-3754-408a-8cc4-d8aca0d84f18 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:01.245041 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3d018af0-6a5c-4852-b11e-fca9a7449476 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:01.261842 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3d018af0-6a5c-4852-b11e-fca9a7449476 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:01.263994 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3d018af0-6a5c-4852-b11e-fca9a7449476 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:01.268606 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3d018af0-6a5c-4852-b11e-fca9a7449476 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5" status: 200 len: 1487 microversion: 2.25 time: 0.826374 Aug 31 16:05:01.272404 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1147/2306] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:05:00 2022] GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5 => generated 1487 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:05:01.293552 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b42588fa-3754-408a-8cc4-d8aca0d84f18 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:01.298883 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9c5ebc52-5ab9-48f7-8371-f61c1b93e661 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:01.301413 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9c5ebc52-5ab9-48f7-8371-f61c1b93e661 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 5efb9714-ab85-499c-b0ec-f79ffb2dea61] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:01.316335 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b42588fa-3754-408a-8cc4-d8aca0d84f18 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/7413e400-d79a-4055-838e-86808cd23b83" status: 200 len: 1219 microversion: 2.1 time: 0.263967 Aug 31 16:05:01.318110 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9c5ebc52-5ab9-48f7-8371-f61c1b93e661 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:01.320630 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9c5ebc52-5ab9-48f7-8371-f61c1b93e661 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:01.331376 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9c5ebc52-5ab9-48f7-8371-f61c1b93e661 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:01.332686 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9c5ebc52-5ab9-48f7-8371-f61c1b93e661 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:01.333828 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9c5ebc52-5ab9-48f7-8371-f61c1b93e661 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:01.336763 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9c5ebc52-5ab9-48f7-8371-f61c1b93e661 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:01.337115 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1160/2307] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:01 2022] GET /compute/v2.1/servers/7413e400-d79a-4055-838e-86808cd23b83 => generated 1219 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:01.354566 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a9e8a918-c3b1-4ef6-833a-3299225f2478 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:01.356568 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a9e8a918-c3b1-4ef6-833a-3299225f2478 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: f9b66475-83f6-49a3-bc63-8965fc1aec14] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:01.388067 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a9e8a918-c3b1-4ef6-833a-3299225f2478 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:01.389330 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a9e8a918-c3b1-4ef6-833a-3299225f2478 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:01.393556 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a9e8a918-c3b1-4ef6-833a-3299225f2478 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:01.394580 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a9e8a918-c3b1-4ef6-833a-3299225f2478 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:01.397390 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a9e8a918-c3b1-4ef6-833a-3299225f2478 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:01.401584 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a9e8a918-c3b1-4ef6-833a-3299225f2478 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:02.014477 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a9e8a918-c3b1-4ef6-833a-3299225f2478 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:02.029677 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a9e8a918-c3b1-4ef6-833a-3299225f2478 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/f9b66475-83f6-49a3-bc63-8965fc1aec14" status: 200 len: 1536 microversion: 2.1 time: 0.686393 Aug 31 16:05:02.030426 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1161/2308] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:01 2022] GET /compute/v2.1/servers/f9b66475-83f6-49a3-bc63-8965fc1aec14 => generated 1536 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:02.054022 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9c5ebc52-5ab9-48f7-8371-f61c1b93e661 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:02.066489 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9c5ebc52-5ab9-48f7-8371-f61c1b93e661 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/5efb9714-ab85-499c-b0ec-f79ffb2dea61" status: 200 len: 1317 microversion: 2.1 time: 0.792538 Aug 31 16:05:02.088838 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4c544b09-f058-4032-b304-c2551c51b2bb tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:02.090716 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4c544b09-f058-4032-b304-c2551c51b2bb tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: dd702273-095b-4d44-8d1b-3d90f7833d5f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:02.098323 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1148/2309] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:01 2022] GET /compute/v2.1/servers/5efb9714-ab85-499c-b0ec-f79ffb2dea61 => generated 1317 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:02.107362 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4c544b09-f058-4032-b304-c2551c51b2bb tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:02.107892 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4c544b09-f058-4032-b304-c2551c51b2bb tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:02.108341 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4c544b09-f058-4032-b304-c2551c51b2bb tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:02.109056 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4c544b09-f058-4032-b304-c2551c51b2bb tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:02.109504 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4c544b09-f058-4032-b304-c2551c51b2bb tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:02.114250 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4c544b09-f058-4032-b304-c2551c51b2bb tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:02.186329 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-014be321-8469-4bf8-aba2-e40d85dacf6a tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '.version_select at 0x7f5ae8e34ca0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:02.251580 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-014be321-8469-4bf8-aba2-e40d85dacf6a tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "GET /compute/v2.1/images/d2eda1ea-ec1a-4d42-a593-3dd7f97c5d76" status: 200 len: 661 microversion: 2.1 time: 0.070327 Aug 31 16:05:02.256795 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1149/2310] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:05:02 2022] GET /compute/v2.1/images/d2eda1ea-ec1a-4d42-a593-3dd7f97c5d76 => generated 661 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:05:02.281588 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3d3c115c-ae93-49bf-b8de-ea74f82f6104 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '.version_select at 0x7f5ae8d12940>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:02.373492 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3d3c115c-ae93-49bf-b8de-ea74f82f6104 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "GET /compute/v2.1/images/d2eda1ea-ec1a-4d42-a593-3dd7f97c5d76" status: 200 len: 661 microversion: 2.1 time: 0.099849 Aug 31 16:05:02.374198 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1150/2311] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:05:02 2022] GET /compute/v2.1/images/d2eda1ea-ec1a-4d42-a593-3dd7f97c5d76 => generated 661 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:05:02.378463 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-4c544b09-f058-4032-b304-c2551c51b2bb tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:02.379644 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-fcd2c0db-df91-45af-bbc6-3e96086610e8 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:02.380707 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-fcd2c0db-df91-45af-bbc6-3e96086610e8 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 006771fc-9da9-4b78-9fad-f4b72c311fd5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:02.397938 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4c544b09-f058-4032-b304-c2551c51b2bb tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f" status: 200 len: 1184 microversion: 2.1 time: 0.316803 Aug 31 16:05:02.399277 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fcd2c0db-df91-45af-bbc6-3e96086610e8 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:02.400127 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fcd2c0db-df91-45af-bbc6-3e96086610e8 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:02.400753 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fcd2c0db-df91-45af-bbc6-3e96086610e8 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:02.401860 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fcd2c0db-df91-45af-bbc6-3e96086610e8 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:02.402932 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1162/2312] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:02 2022] GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f => generated 1184 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:02.403320 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fcd2c0db-df91-45af-bbc6-3e96086610e8 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:02.403936 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fcd2c0db-df91-45af-bbc6-3e96086610e8 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:02.419414 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-59184b77-8808-47e6-92ef-c5caea8315d6 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:02.422477 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-59184b77-8808-47e6-92ef-c5caea8315d6 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 7413e400-d79a-4055-838e-86808cd23b83] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:02.438889 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-59184b77-8808-47e6-92ef-c5caea8315d6 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:02.439722 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-59184b77-8808-47e6-92ef-c5caea8315d6 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:02.440177 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-59184b77-8808-47e6-92ef-c5caea8315d6 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:02.440920 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-59184b77-8808-47e6-92ef-c5caea8315d6 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:02.441389 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-59184b77-8808-47e6-92ef-c5caea8315d6 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:02.441823 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-59184b77-8808-47e6-92ef-c5caea8315d6 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:02.481735 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-59184b77-8808-47e6-92ef-c5caea8315d6 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] HTTP exception thrown: Instance 7413e400-d79a-4055-838e-86808cd23b83 could not be found. Aug 31 16:05:02.484113 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-59184b77-8808-47e6-92ef-c5caea8315d6 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Request method failure captured: Aug 31 16:05:02.484113 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/7413e400-d79a-4055-838e-86808cd23b83 HTTP/1.1 Aug 31 16:05:02.484113 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:05:02.484113 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:05:02.484113 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:05:02.484113 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:05:02.484113 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:05:02.484113 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:05:02.484113 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:05:02.484113 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:05:02.484113 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4Yo5dNOTiRoHOXx-UM5Sn8Jbzoi0Z4yz9YBk3W8_DEhZnVZu-DDO0QOzNoQHJ1nNP8QtjbDsJSdq3n7hK4ZXI2LEyeWPrk9aNaREtGRbElEfeP-G76pg20KjiuDCyp0gfSMP_cw21bhq2fJbey8HuCI0lmGBIAsUVWfxqkVQu-gwfg Aug 31 16:05:02.484113 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:05:02.484113 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:05:02.484113 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:05:02.484113 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:05:02.484113 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:05:02.484113 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:05:02.484113 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: af5a8bccbcb14afd9c6bcd6f4d4f8047 Aug 31 16:05:02.484113 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-DeleteServersTestJSON-1125268000 Aug 31 16:05:02.484113 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:05:02.484113 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:05:02.484113 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/af5a8bccbcb14afd9c6bcd6f4d4f8047"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/af5a8bccbcb14afd9c6bcd6f4d4f8047"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_af5a8bccbcb14afd9c6bcd6f4d4f8047", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/af5a8bccbcb14afd9c6bcd6f4d4f8047"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:05:02.484113 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-DeleteServersTestJSON-1125268000 Aug 31 16:05:02.484113 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: af5a8bccbcb14afd9c6bcd6f4d4f8047 Aug 31 16:05:02.484113 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-DeleteServersTestJSON-1125268000 Aug 31 16:05:02.484113 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-DeleteServersTestJSON-1125268000-project Aug 31 16:05:02.484113 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:05:02.484113 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:05:02.484113 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 4ee58e6a7c284cc9a9c87d0a5c1239aa Aug 31 16:05:02.484113 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-DeleteServersTestJSON-1125268000-project Aug 31 16:05:02.484113 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:05:02.484113 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance 7413e400-d79a-4055-838e-86808cd23b83 could not be found. Aug 31 16:05:02.484113 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '7413e400-d79a-4055-838e-86808cd23b83'} Aug 31 16:05:02.484113 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:05:02.484113 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:05:02.484113 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:05:02.484113 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:05:02.484113 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:05:02.484113 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:05:02.484113 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:05:02.484113 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:05:02.484113 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:05:02.484113 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:05:02.484113 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7413e400-d79a-4055-838e-86808cd23b83 could not be found. Aug 31 16:05:02.484113 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:05:02.484113 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:05:02.484113 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:05:02.484113 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:05:02.484113 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:05:02.484113 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:05:02.484113 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:05:02.484113 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:05:02.484113 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:05:02.484113 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:05:02.484113 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:05:02.484113 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:05:02.484113 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:05:02.484113 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:05:02.484113 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:05:02.484113 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:05:02.484113 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7413e400-d79a-4055-838e-86808cd23b83 could not be found. Aug 31 16:05:02.484113 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:05:02.484113 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:05:02.484113 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:05:02.489118 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:05:02.489118 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:05:02.489118 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:05:02.489118 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:05:02.489118 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:05:02.489118 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7413e400-d79a-4055-838e-86808cd23b83 could not be found. Aug 31 16:05:02.489118 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:05:02.491650 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-59184b77-8808-47e6-92ef-c5caea8315d6 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Returning 404 to user: Instance 7413e400-d79a-4055-838e-86808cd23b83 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:05:02.493042 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-59184b77-8808-47e6-92ef-c5caea8315d6 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/7413e400-d79a-4055-838e-86808cd23b83" status: 404 len: 111 microversion: 2.1 time: 0.086801 Aug 31 16:05:02.493917 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1163/2313] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:02 2022] GET /compute/v2.1/servers/7413e400-d79a-4055-838e-86808cd23b83 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:05:02.500479 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-596b165e-643e-4ab4-8917-28b16523d817 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-56102934", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:05:02.633997 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-596b165e-643e-4ab4-8917-28b16523d817 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] validate_networks() for None {{(pid=122256) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:05:02.993058 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-fcd2c0db-df91-45af-bbc6-3e96086610e8 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:03.025012 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-fcd2c0db-df91-45af-bbc6-3e96086610e8 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:03.035739 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-fcd2c0db-df91-45af-bbc6-3e96086610e8 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:03.041527 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-fcd2c0db-df91-45af-bbc6-3e96086610e8 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5" status: 200 len: 1487 microversion: 2.25 time: 0.665676 Aug 31 16:05:03.065456 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1151/2314] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:05:02 2022] GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5 => generated 1487 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:05:03.099723 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-531cfea9-6fab-402f-b421-c9427fc89c3f tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-758412770", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "networks": [{"uuid": "b472c169-a645-4811-858d-fe4088611ce7"}]}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:05:03.237457 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-531cfea9-6fab-402f-b421-c9427fc89c3f tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] validate_networks() for [('b472c169-a645-4811-858d-fe4088611ce7', None, None, None, None, None)] {{(pid=122257) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:05:03.958118 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-596b165e-643e-4ab4-8917-28b16523d817 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:05:03.958569 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-596b165e-643e-4ab4-8917-28b16523d817 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:05:03.959595 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-596b165e-643e-4ab4-8917-28b16523d817 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:05:03.960019 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-596b165e-643e-4ab4-8917-28b16523d817 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:05:03.960441 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-596b165e-643e-4ab4-8917-28b16523d817 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:05:03.972074 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-596b165e-643e-4ab4-8917-28b16523d817 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:03.972483 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-596b165e-643e-4ab4-8917-28b16523d817 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:03.972925 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-596b165e-643e-4ab4-8917-28b16523d817 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:03.973662 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-596b165e-643e-4ab4-8917-28b16523d817 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:03.974267 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-596b165e-643e-4ab4-8917-28b16523d817 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:03.975265 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-596b165e-643e-4ab4-8917-28b16523d817 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:03.985293 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:05:04.001077 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-596b165e-643e-4ab4-8917-28b16523d817 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Getting quotas for project 4efd94380dcf4b3cb7a2b9fa194fcb83. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:05:04.008693 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-596b165e-643e-4ab4-8917-28b16523d817 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Getting quotas for user c7f0b27a48fd41dd846ba60856349ab5 and project 4efd94380dcf4b3cb7a2b9fa194fcb83. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:05:04.037481 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-596b165e-643e-4ab4-8917-28b16523d817 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Going to run 1 instances... {{(pid=122256) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:05:04.045600 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-596b165e-643e-4ab4-8917-28b16523d817 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] [instance: 359f06bd-00e9-4d68-b066-db73d7073a04] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:05:04.108489 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-596b165e-643e-4ab4-8917-28b16523d817 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.613209 Aug 31 16:05:04.109988 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1164/2315] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:05:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1615 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:05:04.116418 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-21804da5-ca59-4c46-ba30-baf5f7424ca6 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:04.117345 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-21804da5-ca59-4c46-ba30-baf5f7424ca6 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: f9b66475-83f6-49a3-bc63-8965fc1aec14] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:04.122228 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:05:04.139082 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-21804da5-ca59-4c46-ba30-baf5f7424ca6 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:04.140133 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-21804da5-ca59-4c46-ba30-baf5f7424ca6 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:04.141502 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-21804da5-ca59-4c46-ba30-baf5f7424ca6 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:04.143128 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-21804da5-ca59-4c46-ba30-baf5f7424ca6 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:04.143790 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-21804da5-ca59-4c46-ba30-baf5f7424ca6 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:04.144402 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-21804da5-ca59-4c46-ba30-baf5f7424ca6 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:04.600583 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-21804da5-ca59-4c46-ba30-baf5f7424ca6 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:04.621366 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-21804da5-ca59-4c46-ba30-baf5f7424ca6 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/f9b66475-83f6-49a3-bc63-8965fc1aec14" status: 200 len: 1541 microversion: 2.1 time: 0.510007 Aug 31 16:05:04.622052 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1165/2316] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:04 2022] GET /compute/v2.1/servers/f9b66475-83f6-49a3-bc63-8965fc1aec14 => generated 1541 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:04.626852 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a86204cf-45c9-4e2c-86e2-a993e5d50d1c tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:04.627491 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a86204cf-45c9-4e2c-86e2-a993e5d50d1c tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 5efb9714-ab85-499c-b0ec-f79ffb2dea61] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:04.647794 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a86204cf-45c9-4e2c-86e2-a993e5d50d1c tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:04.648583 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a86204cf-45c9-4e2c-86e2-a993e5d50d1c tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:04.649226 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a86204cf-45c9-4e2c-86e2-a993e5d50d1c tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:04.650126 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a86204cf-45c9-4e2c-86e2-a993e5d50d1c tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:04.650766 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a86204cf-45c9-4e2c-86e2-a993e5d50d1c tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:04.651398 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a86204cf-45c9-4e2c-86e2-a993e5d50d1c tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:05.026371 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-531cfea9-6fab-402f-b421-c9427fc89c3f tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:05:05.027961 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-531cfea9-6fab-402f-b421-c9427fc89c3f tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:05:05.028356 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-531cfea9-6fab-402f-b421-c9427fc89c3f tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:05:05.029017 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-531cfea9-6fab-402f-b421-c9427fc89c3f tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:05:05.029818 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-531cfea9-6fab-402f-b421-c9427fc89c3f tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:05:05.045677 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-531cfea9-6fab-402f-b421-c9427fc89c3f tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:05.046595 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-531cfea9-6fab-402f-b421-c9427fc89c3f tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:05.047381 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-531cfea9-6fab-402f-b421-c9427fc89c3f tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:05.048460 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-531cfea9-6fab-402f-b421-c9427fc89c3f tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:05.049332 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-531cfea9-6fab-402f-b421-c9427fc89c3f tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:05.049996 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-531cfea9-6fab-402f-b421-c9427fc89c3f tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:05.094904 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-531cfea9-6fab-402f-b421-c9427fc89c3f tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Getting quotas for project af5a8bccbcb14afd9c6bcd6f4d4f8047. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:05:05.109051 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-531cfea9-6fab-402f-b421-c9427fc89c3f tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Getting quotas for user 4ee58e6a7c284cc9a9c87d0a5c1239aa and project af5a8bccbcb14afd9c6bcd6f4d4f8047. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:05:05.162903 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-531cfea9-6fab-402f-b421-c9427fc89c3f tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Going to run 1 instances... {{(pid=122257) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:05:05.168224 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-531cfea9-6fab-402f-b421-c9427fc89c3f tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 1262191c-be8b-4535-8704-72db13e3f6cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:05:05.178937 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a86204cf-45c9-4e2c-86e2-a993e5d50d1c tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:05.200404 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a86204cf-45c9-4e2c-86e2-a993e5d50d1c tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/5efb9714-ab85-499c-b0ec-f79ffb2dea61" status: 200 len: 1317 microversion: 2.1 time: 0.577153 Aug 31 16:05:05.201701 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1166/2317] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:04 2022] GET /compute/v2.1/servers/5efb9714-ab85-499c-b0ec-f79ffb2dea61 => generated 1317 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:05.230009 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-38172cea-d29a-46b9-8ec5-42d47ed0bda6 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:05.242520 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-38172cea-d29a-46b9-8ec5-42d47ed0bda6 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: dd702273-095b-4d44-8d1b-3d90f7833d5f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:05.259435 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-38172cea-d29a-46b9-8ec5-42d47ed0bda6 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:05.260657 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-38172cea-d29a-46b9-8ec5-42d47ed0bda6 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:05.262221 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-38172cea-d29a-46b9-8ec5-42d47ed0bda6 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:05.263939 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-38172cea-d29a-46b9-8ec5-42d47ed0bda6 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:05.264859 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-38172cea-d29a-46b9-8ec5-42d47ed0bda6 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:05.265586 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-38172cea-d29a-46b9-8ec5-42d47ed0bda6 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:05.290733 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-531cfea9-6fab-402f-b421-c9427fc89c3f tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.220299 Aug 31 16:05:05.292191 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1152/2318] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:05:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 2225 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:05:05.314626 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-2fa68e7c-72a5-4305-babc-6ed755afa46c req-ff71bf16-4cab-4356-beb0-2aa722cb0238 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5efb9714-ab85-499c-b0ec-f79ffb2dea61", "name": "network-vif-plugged", "status": "completed", "tag": "7380b28d-6c2b-4a62-9b98-da18ab201665"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:05:05.336976 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-2fa68e7c-72a5-4305-babc-6ed755afa46c req-ff71bf16-4cab-4356-beb0-2aa722cb0238 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:05.340738 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-2fa68e7c-72a5-4305-babc-6ed755afa46c req-ff71bf16-4cab-4356-beb0-2aa722cb0238 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:05.341534 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-2fa68e7c-72a5-4305-babc-6ed755afa46c req-ff71bf16-4cab-4356-beb0-2aa722cb0238 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:05.357348 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-2fa68e7c-72a5-4305-babc-6ed755afa46c req-ff71bf16-4cab-4356-beb0-2aa722cb0238 service nova] Creating event network-vif-plugged:7380b28d-6c2b-4a62-9b98-da18ab201665 for instance 5efb9714-ab85-499c-b0ec-f79ffb2dea61 on n-h2-850499-9 Aug 31 16:05:05.365500 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-2fa68e7c-72a5-4305-babc-6ed755afa46c req-ff71bf16-4cab-4356-beb0-2aa722cb0238 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070518 Aug 31 16:05:05.375926 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1153/2319] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:05:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:05:05.392140 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-719ea22c-0276-4cdb-8ad1-7f1e8b1d932a tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-577350026", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "b079ae93-c705-4aca-9c4f-1c379bda3136"}], "security_groups": [{"name": "tempest-securitygroup--1604486522"}], "key_name": "tempest-keypair-1523735894", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:05:05.609088 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-38172cea-d29a-46b9-8ec5-42d47ed0bda6 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:05.624230 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-38172cea-d29a-46b9-8ec5-42d47ed0bda6 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f" status: 200 len: 1184 microversion: 2.1 time: 0.421205 Aug 31 16:05:05.640623 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1167/2320] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:05 2022] GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f => generated 1184 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:05.646350 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-faaae954-e536-4356-bc12-136e15aea3d6 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:05.647492 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-faaae954-e536-4356-bc12-136e15aea3d6 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 006771fc-9da9-4b78-9fad-f4b72c311fd5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:05.665499 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-faaae954-e536-4356-bc12-136e15aea3d6 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:05.666794 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-faaae954-e536-4356-bc12-136e15aea3d6 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:05.669255 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-faaae954-e536-4356-bc12-136e15aea3d6 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:05.700768 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-faaae954-e536-4356-bc12-136e15aea3d6 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:05.702692 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-faaae954-e536-4356-bc12-136e15aea3d6 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.032s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:05.707954 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-faaae954-e536-4356-bc12-136e15aea3d6 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:05.987305 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-719ea22c-0276-4cdb-8ad1-7f1e8b1d932a tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] validate_networks() for [('b079ae93-c705-4aca-9c4f-1c379bda3136', None, None, None, None, None)] {{(pid=122257) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:05:06.274166 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-faaae954-e536-4356-bc12-136e15aea3d6 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:06.293548 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-faaae954-e536-4356-bc12-136e15aea3d6 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:06.295973 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-faaae954-e536-4356-bc12-136e15aea3d6 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:06.303135 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-faaae954-e536-4356-bc12-136e15aea3d6 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5" status: 200 len: 1487 microversion: 2.25 time: 0.661316 Aug 31 16:05:06.303938 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1168/2321] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:05:05 2022] GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5 => generated 1487 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:05:06.310286 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6e96f567-2dce-4543-9141-d1295048be35 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1324550792", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:05:06.480711 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-6e96f567-2dce-4543-9141-d1295048be35 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] validate_networks() for None {{(pid=122256) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:05:07.291470 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-6e96f567-2dce-4543-9141-d1295048be35 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:05:07.292240 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-6e96f567-2dce-4543-9141-d1295048be35 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:05:07.293350 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-6e96f567-2dce-4543-9141-d1295048be35 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:05:07.294222 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-6e96f567-2dce-4543-9141-d1295048be35 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:05:07.295107 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-6e96f567-2dce-4543-9141-d1295048be35 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:05:07.340333 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6e96f567-2dce-4543-9141-d1295048be35 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:07.341315 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6e96f567-2dce-4543-9141-d1295048be35 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:07.342101 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6e96f567-2dce-4543-9141-d1295048be35 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:07.343832 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6e96f567-2dce-4543-9141-d1295048be35 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:07.344655 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6e96f567-2dce-4543-9141-d1295048be35 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:07.345416 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6e96f567-2dce-4543-9141-d1295048be35 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:07.390908 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-6e96f567-2dce-4543-9141-d1295048be35 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Getting quotas for project 4efd94380dcf4b3cb7a2b9fa194fcb83. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:05:07.397058 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-6e96f567-2dce-4543-9141-d1295048be35 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Getting quotas for user c7f0b27a48fd41dd846ba60856349ab5 and project 4efd94380dcf4b3cb7a2b9fa194fcb83. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:05:07.412600 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6e96f567-2dce-4543-9141-d1295048be35 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Going to run 1 instances... {{(pid=122256) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:05:07.414798 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6e96f567-2dce-4543-9141-d1295048be35 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] [instance: 560a01e5-93f8-46c8-9261-5030e28766b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:05:07.470403 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6e96f567-2dce-4543-9141-d1295048be35 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.165200 Aug 31 16:05:07.477304 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1169/2322] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:05:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1172 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:05:07.501479 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e65c0bd4-9a46-4158-9528-12bebc9d2f47 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:07.502323 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e65c0bd4-9a46-4158-9528-12bebc9d2f47 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 1262191c-be8b-4535-8704-72db13e3f6cc] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:07.521909 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e65c0bd4-9a46-4158-9528-12bebc9d2f47 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:07.522666 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e65c0bd4-9a46-4158-9528-12bebc9d2f47 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:07.523706 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e65c0bd4-9a46-4158-9528-12bebc9d2f47 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:07.524612 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e65c0bd4-9a46-4158-9528-12bebc9d2f47 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:07.525487 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e65c0bd4-9a46-4158-9528-12bebc9d2f47 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:07.526068 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e65c0bd4-9a46-4158-9528-12bebc9d2f47 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:07.754566 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e65c0bd4-9a46-4158-9528-12bebc9d2f47 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:07.765144 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e65c0bd4-9a46-4158-9528-12bebc9d2f47 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/1262191c-be8b-4535-8704-72db13e3f6cc" status: 200 len: 1210 microversion: 2.1 time: 0.286465 Aug 31 16:05:07.787926 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1170/2323] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:07 2022] GET /compute/v2.1/servers/1262191c-be8b-4535-8704-72db13e3f6cc => generated 1210 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:07.794294 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a56ce139-8e52-4891-8730-dae79a50ea69 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:07.795251 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a56ce139-8e52-4891-8730-dae79a50ea69 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: f9b66475-83f6-49a3-bc63-8965fc1aec14] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:07.805108 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-719ea22c-0276-4cdb-8ad1-7f1e8b1d932a tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Getting quotas for project e3e9999df7e14609b1265351c83607bd. Resources: dict_keys(['metadata_items']) {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:05:07.812130 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a56ce139-8e52-4891-8730-dae79a50ea69 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:07.813072 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a56ce139-8e52-4891-8730-dae79a50ea69 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:07.813597 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-719ea22c-0276-4cdb-8ad1-7f1e8b1d932a tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Getting quotas for user a837ababe7cb4284b96bc16deb40d2d2 and project e3e9999df7e14609b1265351c83607bd. Resources: dict_keys(['metadata_items']) {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:05:07.813773 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a56ce139-8e52-4891-8730-dae79a50ea69 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:07.816246 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a56ce139-8e52-4891-8730-dae79a50ea69 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:07.816947 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a56ce139-8e52-4891-8730-dae79a50ea69 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:07.818614 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a56ce139-8e52-4891-8730-dae79a50ea69 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:07.836945 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-719ea22c-0276-4cdb-8ad1-7f1e8b1d932a tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:05:07.838050 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-719ea22c-0276-4cdb-8ad1-7f1e8b1d932a tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:05:07.838927 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-719ea22c-0276-4cdb-8ad1-7f1e8b1d932a tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:05:07.840286 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-719ea22c-0276-4cdb-8ad1-7f1e8b1d932a tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:05:07.840861 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-719ea22c-0276-4cdb-8ad1-7f1e8b1d932a tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:05:07.865529 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-719ea22c-0276-4cdb-8ad1-7f1e8b1d932a tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:07.866292 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-719ea22c-0276-4cdb-8ad1-7f1e8b1d932a tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:07.866905 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-719ea22c-0276-4cdb-8ad1-7f1e8b1d932a tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:07.868058 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-719ea22c-0276-4cdb-8ad1-7f1e8b1d932a tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:07.868717 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-719ea22c-0276-4cdb-8ad1-7f1e8b1d932a tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:07.869356 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-719ea22c-0276-4cdb-8ad1-7f1e8b1d932a tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:07.902714 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-719ea22c-0276-4cdb-8ad1-7f1e8b1d932a tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Getting quotas for project e3e9999df7e14609b1265351c83607bd. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:05:07.916456 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-719ea22c-0276-4cdb-8ad1-7f1e8b1d932a tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Getting quotas for user a837ababe7cb4284b96bc16deb40d2d2 and project e3e9999df7e14609b1265351c83607bd. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:05:07.920607 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=3,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:05:07.946879 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-719ea22c-0276-4cdb-8ad1-7f1e8b1d932a tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Going to run 1 instances... {{(pid=122257) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:05:07.953597 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-719ea22c-0276-4cdb-8ad1-7f1e8b1d932a tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] [instance: 1f11f86d-3387-4c6e-9099-fc8d232b11a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:05:08.125653 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-719ea22c-0276-4cdb-8ad1-7f1e8b1d932a tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.746933 Aug 31 16:05:08.129035 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1154/2324] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:05:05 2022] POST /compute/v2.1/servers => generated 407 bytes in 2752 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:05:08.146105 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2e6c0121-3d95-4f7f-9c5d-a03fa74c512f tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:08.150922 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2e6c0121-3d95-4f7f-9c5d-a03fa74c512f tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 5efb9714-ab85-499c-b0ec-f79ffb2dea61] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:08.174112 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2e6c0121-3d95-4f7f-9c5d-a03fa74c512f tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:08.176168 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2e6c0121-3d95-4f7f-9c5d-a03fa74c512f tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:08.177407 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2e6c0121-3d95-4f7f-9c5d-a03fa74c512f tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:08.181851 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2e6c0121-3d95-4f7f-9c5d-a03fa74c512f tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:08.184387 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2e6c0121-3d95-4f7f-9c5d-a03fa74c512f tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:08.185477 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2e6c0121-3d95-4f7f-9c5d-a03fa74c512f tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:09.045603 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a56ce139-8e52-4891-8730-dae79a50ea69 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:09.060206 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a56ce139-8e52-4891-8730-dae79a50ea69 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/f9b66475-83f6-49a3-bc63-8965fc1aec14" status: 200 len: 1541 microversion: 2.1 time: 1.270492 Aug 31 16:05:09.060798 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1171/2325] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:07 2022] GET /compute/v2.1/servers/f9b66475-83f6-49a3-bc63-8965fc1aec14 => generated 1541 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:09.103401 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-621ecd22-5306-4ff1-a2c7-0f61bf60302b tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:09.105347 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-621ecd22-5306-4ff1-a2c7-0f61bf60302b tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: dd702273-095b-4d44-8d1b-3d90f7833d5f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:09.141788 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-621ecd22-5306-4ff1-a2c7-0f61bf60302b tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:09.142307 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-621ecd22-5306-4ff1-a2c7-0f61bf60302b tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:09.142756 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-621ecd22-5306-4ff1-a2c7-0f61bf60302b tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:09.143522 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-621ecd22-5306-4ff1-a2c7-0f61bf60302b tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:09.144012 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-621ecd22-5306-4ff1-a2c7-0f61bf60302b tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:09.144446 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-621ecd22-5306-4ff1-a2c7-0f61bf60302b tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:09.281765 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-621ecd22-5306-4ff1-a2c7-0f61bf60302b tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:09.282174 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-621ecd22-5306-4ff1-a2c7-0f61bf60302b tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:09.283739 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-621ecd22-5306-4ff1-a2c7-0f61bf60302b tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:09.284868 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-621ecd22-5306-4ff1-a2c7-0f61bf60302b tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lazy-loading 'fault' on Instance uuid dd702273-095b-4d44-8d1b-3d90f7833d5f {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:05:09.462383 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2e6c0121-3d95-4f7f-9c5d-a03fa74c512f tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:09.479540 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2e6c0121-3d95-4f7f-9c5d-a03fa74c512f tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/5efb9714-ab85-499c-b0ec-f79ffb2dea61" status: 200 len: 1317 microversion: 2.1 time: 1.348186 Aug 31 16:05:09.481452 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1155/2326] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:08 2022] GET /compute/v2.1/servers/5efb9714-ab85-499c-b0ec-f79ffb2dea61 => generated 1317 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:09.490288 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-18888238-8787-4c3a-92af-8a11e0490b67 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:09.490915 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-18888238-8787-4c3a-92af-8a11e0490b67 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 006771fc-9da9-4b78-9fad-f4b72c311fd5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:09.500730 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-621ecd22-5306-4ff1-a2c7-0f61bf60302b tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:09.510881 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-621ecd22-5306-4ff1-a2c7-0f61bf60302b tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f" status: 200 len: 1189 microversion: 2.1 time: 0.448878 Aug 31 16:05:09.515078 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1172/2327] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:09 2022] GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f => generated 1189 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:09.516490 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-18888238-8787-4c3a-92af-8a11e0490b67 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:09.518090 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-18888238-8787-4c3a-92af-8a11e0490b67 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:09.519585 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-18888238-8787-4c3a-92af-8a11e0490b67 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:09.521329 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-18888238-8787-4c3a-92af-8a11e0490b67 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:09.523859 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-18888238-8787-4c3a-92af-8a11e0490b67 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:09.525203 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-18888238-8787-4c3a-92af-8a11e0490b67 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:09.534456 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8cd8d0c2-a391-4019-b3a5-314de5287507 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:09.535810 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8cd8d0c2-a391-4019-b3a5-314de5287507 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] [instance: 560a01e5-93f8-46c8-9261-5030e28766b4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:09.555390 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8cd8d0c2-a391-4019-b3a5-314de5287507 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:09.556261 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8cd8d0c2-a391-4019-b3a5-314de5287507 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:09.566817 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8cd8d0c2-a391-4019-b3a5-314de5287507 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:09.567622 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8cd8d0c2-a391-4019-b3a5-314de5287507 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:09.570258 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8cd8d0c2-a391-4019-b3a5-314de5287507 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:09.571618 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8cd8d0c2-a391-4019-b3a5-314de5287507 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:10.192201 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8cd8d0c2-a391-4019-b3a5-314de5287507 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f0b27a48fd41dd846ba60856349ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4efd94380dcf4b3cb7a2b9fa194fcb83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:10.206240 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8cd8d0c2-a391-4019-b3a5-314de5287507 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "GET /compute/v2.1/servers/560a01e5-93f8-46c8-9261-5030e28766b4" status: 200 len: 1214 microversion: 2.1 time: 0.689226 Aug 31 16:05:10.206735 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1173/2328] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:09 2022] GET /compute/v2.1/servers/560a01e5-93f8-46c8-9261-5030e28766b4 => generated 1214 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:10.216497 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7e32eabe-fab7-428a-8246-047445d706fa tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:10.217084 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7e32eabe-fab7-428a-8246-047445d706fa tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] [instance: 1f11f86d-3387-4c6e-9099-fc8d232b11a8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:10.232995 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7e32eabe-fab7-428a-8246-047445d706fa tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:10.233507 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7e32eabe-fab7-428a-8246-047445d706fa tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:10.233949 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7e32eabe-fab7-428a-8246-047445d706fa tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:10.234677 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7e32eabe-fab7-428a-8246-047445d706fa tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:10.235145 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7e32eabe-fab7-428a-8246-047445d706fa tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:10.235603 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7e32eabe-fab7-428a-8246-047445d706fa tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:10.398719 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-18888238-8787-4c3a-92af-8a11e0490b67 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:10.424868 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-18888238-8787-4c3a-92af-8a11e0490b67 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:10.430447 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-18888238-8787-4c3a-92af-8a11e0490b67 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:10.433502 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-18888238-8787-4c3a-92af-8a11e0490b67 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5" status: 200 len: 1487 microversion: 2.25 time: 0.950164 Aug 31 16:05:10.435130 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1156/2329] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:05:09 2022] GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5 => generated 1487 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:05:10.445703 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-355debd0-c441-436b-9974-9a19b3e9e5e0 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:10.458380 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-355debd0-c441-436b-9974-9a19b3e9e5e0 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 1262191c-be8b-4535-8704-72db13e3f6cc] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:10.460609 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7e32eabe-fab7-428a-8246-047445d706fa tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a837ababe7cb4284b96bc16deb40d2d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e9999df7e14609b1265351c83607bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:10.471103 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7e32eabe-fab7-428a-8246-047445d706fa tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] 10.222.0.61 "GET /compute/v2.1/servers/1f11f86d-3387-4c6e-9099-fc8d232b11a8" status: 200 len: 1265 microversion: 2.1 time: 0.263100 Aug 31 16:05:10.484241 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1174/2330] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:10 2022] GET /compute/v2.1/servers/1f11f86d-3387-4c6e-9099-fc8d232b11a8 => generated 1265 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:10.488511 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-355debd0-c441-436b-9974-9a19b3e9e5e0 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:10.490788 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-355debd0-c441-436b-9974-9a19b3e9e5e0 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:10.491516 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-355debd0-c441-436b-9974-9a19b3e9e5e0 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:10.492264 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f3c72b92-4ba4-4774-9d98-db893ceffd0b tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:10.492664 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-355debd0-c441-436b-9974-9a19b3e9e5e0 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:10.492895 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f3c72b92-4ba4-4774-9d98-db893ceffd0b tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: f9b66475-83f6-49a3-bc63-8965fc1aec14] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:10.493700 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-355debd0-c441-436b-9974-9a19b3e9e5e0 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:10.494649 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-355debd0-c441-436b-9974-9a19b3e9e5e0 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:10.510831 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f3c72b92-4ba4-4774-9d98-db893ceffd0b tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:10.513757 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f3c72b92-4ba4-4774-9d98-db893ceffd0b tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:10.514277 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f3c72b92-4ba4-4774-9d98-db893ceffd0b tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:10.515132 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f3c72b92-4ba4-4774-9d98-db893ceffd0b tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:10.515637 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f3c72b92-4ba4-4774-9d98-db893ceffd0b tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:10.516072 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f3c72b92-4ba4-4774-9d98-db893ceffd0b tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:10.749211 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-355debd0-c441-436b-9974-9a19b3e9e5e0 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:10.760411 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-355debd0-c441-436b-9974-9a19b3e9e5e0 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/1262191c-be8b-4535-8704-72db13e3f6cc" status: 200 len: 1266 microversion: 2.1 time: 0.321877 Aug 31 16:05:10.762466 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1157/2331] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:10 2022] GET /compute/v2.1/servers/1262191c-be8b-4535-8704-72db13e3f6cc => generated 1266 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:10.796395 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ca6803d3-c0c3-4e7a-8ef5-e99ada3458dc tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:10.797334 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ca6803d3-c0c3-4e7a-8ef5-e99ada3458dc tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 5efb9714-ab85-499c-b0ec-f79ffb2dea61] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:10.805939 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ca6803d3-c0c3-4e7a-8ef5-e99ada3458dc tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:10.806440 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ca6803d3-c0c3-4e7a-8ef5-e99ada3458dc tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:10.806879 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ca6803d3-c0c3-4e7a-8ef5-e99ada3458dc tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:10.819061 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ca6803d3-c0c3-4e7a-8ef5-e99ada3458dc tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:10.821498 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ca6803d3-c0c3-4e7a-8ef5-e99ada3458dc tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:10.822053 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ca6803d3-c0c3-4e7a-8ef5-e99ada3458dc tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:11.081182 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f3c72b92-4ba4-4774-9d98-db893ceffd0b tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:11.091145 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f3c72b92-4ba4-4774-9d98-db893ceffd0b tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/f9b66475-83f6-49a3-bc63-8965fc1aec14" status: 200 len: 1541 microversion: 2.1 time: 0.609967 Aug 31 16:05:11.103080 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1175/2332] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:10 2022] GET /compute/v2.1/servers/f9b66475-83f6-49a3-bc63-8965fc1aec14 => generated 1541 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:11.116008 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3d02a521-d9a7-4295-bc4d-e7e27649bcb1 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:11.116640 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3d02a521-d9a7-4295-bc4d-e7e27649bcb1 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: dd702273-095b-4d44-8d1b-3d90f7833d5f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:11.133184 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3d02a521-d9a7-4295-bc4d-e7e27649bcb1 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:11.133862 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3d02a521-d9a7-4295-bc4d-e7e27649bcb1 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:11.134450 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3d02a521-d9a7-4295-bc4d-e7e27649bcb1 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:11.135394 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3d02a521-d9a7-4295-bc4d-e7e27649bcb1 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:11.135864 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3d02a521-d9a7-4295-bc4d-e7e27649bcb1 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:11.136934 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3d02a521-d9a7-4295-bc4d-e7e27649bcb1 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:11.161329 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-3d02a521-d9a7-4295-bc4d-e7e27649bcb1 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] HTTP exception thrown: Instance dd702273-095b-4d44-8d1b-3d90f7833d5f could not be found. Aug 31 16:05:11.164873 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3d02a521-d9a7-4295-bc4d-e7e27649bcb1 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Request method failure captured: Aug 31 16:05:11.164873 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f HTTP/1.1 Aug 31 16:05:11.164873 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:05:11.164873 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:05:11.164873 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:05:11.164873 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:05:11.164873 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:05:11.164873 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:05:11.164873 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:05:11.164873 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:05:11.164873 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4St87glls8nrcJLaszJCTH3u-5gjP_zR_CDcTJmGRy-icHFnPPaQEjN24lPcF68k7cJy-u1N7wTTpAM3QT_rwVgkInJP4vDJQWfb13puTbBaWpSNY7AqOuE9gOwubT4HvKPey49JpgyvzFifvxP5d5LPnrAimWxJ7aL70cmuBZOFis Aug 31 16:05:11.164873 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:05:11.164873 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:05:11.164873 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:05:11.164873 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:05:11.164873 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:05:11.164873 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:05:11.164873 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 150e5f8e376a40e089de8ed092e269fd Aug 31 16:05:11.164873 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-LiveMigrationTest-774357135 Aug 31 16:05:11.164873 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:05:11.164873 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:05:11.164873 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/150e5f8e376a40e089de8ed092e269fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/150e5f8e376a40e089de8ed092e269fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_150e5f8e376a40e089de8ed092e269fd", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/150e5f8e376a40e089de8ed092e269fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:05:11.164873 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-LiveMigrationTest-774357135 Aug 31 16:05:11.164873 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 150e5f8e376a40e089de8ed092e269fd Aug 31 16:05:11.164873 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-LiveMigrationTest-774357135 Aug 31 16:05:11.164873 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-LiveMigrationTest-774357135-project Aug 31 16:05:11.164873 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:05:11.164873 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:05:11.164873 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: de0e032fc09b48ada1dfe99e549aa623 Aug 31 16:05:11.164873 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-LiveMigrationTest-774357135-project Aug 31 16:05:11.164873 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:05:11.164873 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance dd702273-095b-4d44-8d1b-3d90f7833d5f could not be found. Aug 31 16:05:11.164873 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': 'dd702273-095b-4d44-8d1b-3d90f7833d5f'} Aug 31 16:05:11.164873 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:05:11.164873 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:05:11.164873 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:05:11.164873 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:05:11.164873 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:05:11.164873 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:05:11.164873 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:05:11.164873 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:05:11.164873 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:05:11.164873 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:05:11.164873 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd702273-095b-4d44-8d1b-3d90f7833d5f could not be found. Aug 31 16:05:11.164873 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:05:11.164873 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:05:11.164873 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:05:11.164873 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:05:11.164873 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:05:11.164873 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:05:11.164873 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:05:11.164873 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:05:11.164873 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:05:11.164873 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:05:11.164873 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:05:11.164873 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:05:11.164873 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:05:11.164873 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:05:11.164873 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:05:11.164873 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:05:11.164873 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd702273-095b-4d44-8d1b-3d90f7833d5f could not be found. Aug 31 16:05:11.164873 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:05:11.164873 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:05:11.164873 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:05:11.168801 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:05:11.168801 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:05:11.168801 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:05:11.168801 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:05:11.168801 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:05:11.168801 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd702273-095b-4d44-8d1b-3d90f7833d5f could not be found. Aug 31 16:05:11.168801 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:05:11.172217 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3d02a521-d9a7-4295-bc4d-e7e27649bcb1 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Returning 404 to user: Instance dd702273-095b-4d44-8d1b-3d90f7833d5f could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:05:11.173515 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3d02a521-d9a7-4295-bc4d-e7e27649bcb1 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f" status: 404 len: 111 microversion: 2.1 time: 0.068755 Aug 31 16:05:11.174330 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1176/2333] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:11 2022] GET /compute/v2.1/servers/dd702273-095b-4d44-8d1b-3d90f7833d5f => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:05:11.245261 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-47092b5b-5ccb-4bf0-b421-1016f560f55f tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:11.246471 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-47092b5b-5ccb-4bf0-b421-1016f560f55f tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] [instance: 560a01e5-93f8-46c8-9261-5030e28766b4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:11.277666 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-47092b5b-5ccb-4bf0-b421-1016f560f55f tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:11.281635 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-47092b5b-5ccb-4bf0-b421-1016f560f55f tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:11.283968 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-47092b5b-5ccb-4bf0-b421-1016f560f55f tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:11.296200 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-47092b5b-5ccb-4bf0-b421-1016f560f55f tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:11.297191 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-47092b5b-5ccb-4bf0-b421-1016f560f55f tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:11.297808 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-47092b5b-5ccb-4bf0-b421-1016f560f55f tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:11.423572 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ca6803d3-c0c3-4e7a-8ef5-e99ada3458dc tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:11.435036 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ca6803d3-c0c3-4e7a-8ef5-e99ada3458dc tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/5efb9714-ab85-499c-b0ec-f79ffb2dea61" status: 200 len: 1466 microversion: 2.1 time: 0.670555 Aug 31 16:05:11.440233 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1158/2334] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:10 2022] GET /compute/v2.1/servers/5efb9714-ab85-499c-b0ec-f79ffb2dea61 => generated 1466 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:11.490527 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f0d61b24-7e1f-4b13-8166-025ab8ac47af tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:11.496440 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f0d61b24-7e1f-4b13-8166-025ab8ac47af tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 006771fc-9da9-4b78-9fad-f4b72c311fd5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:11.513845 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f0d61b24-7e1f-4b13-8166-025ab8ac47af tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:11.515107 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f0d61b24-7e1f-4b13-8166-025ab8ac47af tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:11.515834 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f0d61b24-7e1f-4b13-8166-025ab8ac47af tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:11.516951 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f0d61b24-7e1f-4b13-8166-025ab8ac47af tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:11.517881 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f0d61b24-7e1f-4b13-8166-025ab8ac47af tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:11.518810 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f0d61b24-7e1f-4b13-8166-025ab8ac47af tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:11.540105 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-47092b5b-5ccb-4bf0-b421-1016f560f55f tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f0b27a48fd41dd846ba60856349ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4efd94380dcf4b3cb7a2b9fa194fcb83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:11.560987 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-47092b5b-5ccb-4bf0-b421-1016f560f55f tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "GET /compute/v2.1/servers/560a01e5-93f8-46c8-9261-5030e28766b4" status: 200 len: 1214 microversion: 2.1 time: 0.320701 Aug 31 16:05:11.563219 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1177/2335] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:11 2022] GET /compute/v2.1/servers/560a01e5-93f8-46c8-9261-5030e28766b4 => generated 1214 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:05:11.572741 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f806265b-bae8-46fd-b1af-c4c546dfedae tempest-ServersOnMultiNodesTest-1555970217 tempest-ServersOnMultiNodesTest-1555970217-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:11.574717 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f806265b-bae8-46fd-b1af-c4c546dfedae tempest-ServersOnMultiNodesTest-1555970217 tempest-ServersOnMultiNodesTest-1555970217-project-admin] [instance: 5efb9714-ab85-499c-b0ec-f79ffb2dea61] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:11.590311 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f806265b-bae8-46fd-b1af-c4c546dfedae tempest-ServersOnMultiNodesTest-1555970217 tempest-ServersOnMultiNodesTest-1555970217-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:11.591649 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f806265b-bae8-46fd-b1af-c4c546dfedae tempest-ServersOnMultiNodesTest-1555970217 tempest-ServersOnMultiNodesTest-1555970217-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:11.593667 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f806265b-bae8-46fd-b1af-c4c546dfedae tempest-ServersOnMultiNodesTest-1555970217 tempest-ServersOnMultiNodesTest-1555970217-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:11.594983 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f806265b-bae8-46fd-b1af-c4c546dfedae tempest-ServersOnMultiNodesTest-1555970217 tempest-ServersOnMultiNodesTest-1555970217-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:11.596149 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f806265b-bae8-46fd-b1af-c4c546dfedae tempest-ServersOnMultiNodesTest-1555970217 tempest-ServersOnMultiNodesTest-1555970217-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:11.597209 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f806265b-bae8-46fd-b1af-c4c546dfedae tempest-ServersOnMultiNodesTest-1555970217 tempest-ServersOnMultiNodesTest-1555970217-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:11.872870 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f0d61b24-7e1f-4b13-8166-025ab8ac47af tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:11.891039 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f0d61b24-7e1f-4b13-8166-025ab8ac47af tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:11.893611 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f0d61b24-7e1f-4b13-8166-025ab8ac47af tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:11.895244 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f0d61b24-7e1f-4b13-8166-025ab8ac47af tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5" status: 200 len: 1487 microversion: 2.25 time: 0.434109 Aug 31 16:05:11.895874 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1159/2336] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:05:11 2022] GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5 => generated 1487 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:05:11.911018 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5dfb6f15-e83d-4cca-a9ae-b352d57b5cb4 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:11.912055 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5dfb6f15-e83d-4cca-a9ae-b352d57b5cb4 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] [instance: 1f11f86d-3387-4c6e-9099-fc8d232b11a8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:11.924127 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5dfb6f15-e83d-4cca-a9ae-b352d57b5cb4 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:11.924868 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5dfb6f15-e83d-4cca-a9ae-b352d57b5cb4 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:11.925500 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5dfb6f15-e83d-4cca-a9ae-b352d57b5cb4 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:11.926383 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5dfb6f15-e83d-4cca-a9ae-b352d57b5cb4 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:11.927027 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5dfb6f15-e83d-4cca-a9ae-b352d57b5cb4 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:11.928201 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5dfb6f15-e83d-4cca-a9ae-b352d57b5cb4 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:11.968756 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f806265b-bae8-46fd-b1af-c4c546dfedae tempest-ServersOnMultiNodesTest-1555970217 tempest-ServersOnMultiNodesTest-1555970217-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/5efb9714-ab85-499c-b0ec-f79ffb2dea61" status: 200 len: 1617 microversion: 2.1 time: 0.403420 Aug 31 16:05:11.969789 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1178/2337] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:11 2022] GET /compute/v2.1/servers/5efb9714-ab85-499c-b0ec-f79ffb2dea61 => generated 1617 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:11.978861 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-df4355ab-6040-46f0-8dbd-65a3ac68cfa3 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:11.979537 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-df4355ab-6040-46f0-8dbd-65a3ac68cfa3 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 1262191c-be8b-4535-8704-72db13e3f6cc] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:11.991442 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-df4355ab-6040-46f0-8dbd-65a3ac68cfa3 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:11.992584 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-df4355ab-6040-46f0-8dbd-65a3ac68cfa3 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:11.993546 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-df4355ab-6040-46f0-8dbd-65a3ac68cfa3 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:11.999038 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-df4355ab-6040-46f0-8dbd-65a3ac68cfa3 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:12.000230 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-df4355ab-6040-46f0-8dbd-65a3ac68cfa3 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:12.000697 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-df4355ab-6040-46f0-8dbd-65a3ac68cfa3 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:12.051272 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5dfb6f15-e83d-4cca-a9ae-b352d57b5cb4 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a837ababe7cb4284b96bc16deb40d2d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e9999df7e14609b1265351c83607bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:12.066192 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5dfb6f15-e83d-4cca-a9ae-b352d57b5cb4 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] 10.222.0.61 "GET /compute/v2.1/servers/1f11f86d-3387-4c6e-9099-fc8d232b11a8" status: 200 len: 1329 microversion: 2.1 time: 0.161879 Aug 31 16:05:12.067091 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1160/2338] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:11 2022] GET /compute/v2.1/servers/1f11f86d-3387-4c6e-9099-fc8d232b11a8 => generated 1329 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:12.072747 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2cecac4c-e0ec-4be5-9254-07ae4320ce0c tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:12.074410 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2cecac4c-e0ec-4be5-9254-07ae4320ce0c tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 5efb9714-ab85-499c-b0ec-f79ffb2dea61] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:12.084382 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2cecac4c-e0ec-4be5-9254-07ae4320ce0c tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:12.085248 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2cecac4c-e0ec-4be5-9254-07ae4320ce0c tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:12.086302 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2cecac4c-e0ec-4be5-9254-07ae4320ce0c tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:12.087693 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2cecac4c-e0ec-4be5-9254-07ae4320ce0c tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:12.088546 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2cecac4c-e0ec-4be5-9254-07ae4320ce0c tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:12.088708 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2cecac4c-e0ec-4be5-9254-07ae4320ce0c tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:12.121872 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2cecac4c-e0ec-4be5-9254-07ae4320ce0c tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 5efb9714-ab85-499c-b0ec-f79ffb2dea61] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:05:12.125689 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=100 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:05:12.165042 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-df4355ab-6040-46f0-8dbd-65a3ac68cfa3 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:12.176304 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-df4355ab-6040-46f0-8dbd-65a3ac68cfa3 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/1262191c-be8b-4535-8704-72db13e3f6cc" status: 200 len: 1266 microversion: 2.1 time: 0.202291 Aug 31 16:05:12.182280 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1179/2339] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:11 2022] GET /compute/v2.1/servers/1262191c-be8b-4535-8704-72db13e3f6cc => generated 1266 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:12.187668 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a21fcba3-d7a6-4a82-b085-428dc4fd4e58 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:12.188576 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a21fcba3-d7a6-4a82-b085-428dc4fd4e58 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: f9b66475-83f6-49a3-bc63-8965fc1aec14] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:12.204787 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a21fcba3-d7a6-4a82-b085-428dc4fd4e58 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:12.205387 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a21fcba3-d7a6-4a82-b085-428dc4fd4e58 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:12.208897 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a21fcba3-d7a6-4a82-b085-428dc4fd4e58 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:12.209832 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a21fcba3-d7a6-4a82-b085-428dc4fd4e58 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:12.210456 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a21fcba3-d7a6-4a82-b085-428dc4fd4e58 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:12.211290 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a21fcba3-d7a6-4a82-b085-428dc4fd4e58 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:12.224413 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2cecac4c-e0ec-4be5-9254-07ae4320ce0c tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "DELETE /compute/v2.1/servers/5efb9714-ab85-499c-b0ec-f79ffb2dea61" status: 204 len: 0 microversion: 2.1 time: 0.154963 Aug 31 16:05:12.228884 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1161/2340] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:05:12 2022] DELETE /compute/v2.1/servers/5efb9714-ab85-499c-b0ec-f79ffb2dea61 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:05:12.237830 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2dace71a-9236-4094-ba7d-788575c234bd tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:12.238962 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2dace71a-9236-4094-ba7d-788575c234bd tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 5efb9714-ab85-499c-b0ec-f79ffb2dea61] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:12.247491 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2dace71a-9236-4094-ba7d-788575c234bd tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:12.249483 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2dace71a-9236-4094-ba7d-788575c234bd tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:12.250728 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2dace71a-9236-4094-ba7d-788575c234bd tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:12.251846 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2dace71a-9236-4094-ba7d-788575c234bd tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:12.252552 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2dace71a-9236-4094-ba7d-788575c234bd tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:12.253202 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2dace71a-9236-4094-ba7d-788575c234bd tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:12.891719 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2dace71a-9236-4094-ba7d-788575c234bd tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:12.909839 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2dace71a-9236-4094-ba7d-788575c234bd tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/5efb9714-ab85-499c-b0ec-f79ffb2dea61" status: 200 len: 1472 microversion: 2.1 time: 0.677847 Aug 31 16:05:12.912816 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1162/2341] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:12 2022] GET /compute/v2.1/servers/5efb9714-ab85-499c-b0ec-f79ffb2dea61 => generated 1472 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:12.917200 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a21fcba3-d7a6-4a82-b085-428dc4fd4e58 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:12.926675 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4760ad3e-8619-4faf-abc4-596f9372a31d tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:12.930533 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4760ad3e-8619-4faf-abc4-596f9372a31d tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] [instance: 560a01e5-93f8-46c8-9261-5030e28766b4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:12.937556 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a21fcba3-d7a6-4a82-b085-428dc4fd4e58 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/f9b66475-83f6-49a3-bc63-8965fc1aec14" status: 200 len: 1541 microversion: 2.1 time: 0.755822 Aug 31 16:05:12.944654 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1180/2342] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:12 2022] GET /compute/v2.1/servers/f9b66475-83f6-49a3-bc63-8965fc1aec14 => generated 1541 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:12.948237 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4760ad3e-8619-4faf-abc4-596f9372a31d tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:12.951388 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4760ad3e-8619-4faf-abc4-596f9372a31d tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:12.952255 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4760ad3e-8619-4faf-abc4-596f9372a31d tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:12.957082 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4760ad3e-8619-4faf-abc4-596f9372a31d tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:12.959234 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4760ad3e-8619-4faf-abc4-596f9372a31d tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:12.959951 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-71e740c5-a32c-45a7-b362-f959c2b5aa9c tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:12.960583 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-71e740c5-a32c-45a7-b362-f959c2b5aa9c tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 006771fc-9da9-4b78-9fad-f4b72c311fd5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:12.961458 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4760ad3e-8619-4faf-abc4-596f9372a31d tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:12.979581 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-71e740c5-a32c-45a7-b362-f959c2b5aa9c tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:12.986623 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-71e740c5-a32c-45a7-b362-f959c2b5aa9c tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:12.987449 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-71e740c5-a32c-45a7-b362-f959c2b5aa9c tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:12.988376 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-71e740c5-a32c-45a7-b362-f959c2b5aa9c tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:12.989070 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-71e740c5-a32c-45a7-b362-f959c2b5aa9c tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:12.989690 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-71e740c5-a32c-45a7-b362-f959c2b5aa9c tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:13.236125 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-4760ad3e-8619-4faf-abc4-596f9372a31d tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f0b27a48fd41dd846ba60856349ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4efd94380dcf4b3cb7a2b9fa194fcb83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:13.251694 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4760ad3e-8619-4faf-abc4-596f9372a31d tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "GET /compute/v2.1/servers/560a01e5-93f8-46c8-9261-5030e28766b4" status: 200 len: 1270 microversion: 2.1 time: 0.336416 Aug 31 16:05:13.267072 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1163/2343] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:12 2022] GET /compute/v2.1/servers/560a01e5-93f8-46c8-9261-5030e28766b4 => generated 1270 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:13.267072 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-2b020c2f-0317-4c5a-9bd1-601581d2a1bc req-67bf4d1f-5deb-45b2-80f1-e23e28d87f14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "359f06bd-00e9-4d68-b066-db73d7073a04", "tag": "0cd3b24d-ce36-4d42-806b-496fd2089b1b"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:05:13.284164 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-2b020c2f-0317-4c5a-9bd1-601581d2a1bc req-67bf4d1f-5deb-45b2-80f1-e23e28d87f14 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:13.284690 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-2b020c2f-0317-4c5a-9bd1-601581d2a1bc req-67bf4d1f-5deb-45b2-80f1-e23e28d87f14 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:13.285121 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-2b020c2f-0317-4c5a-9bd1-601581d2a1bc req-67bf4d1f-5deb-45b2-80f1-e23e28d87f14 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:13.303446 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-2b020c2f-0317-4c5a-9bd1-601581d2a1bc req-67bf4d1f-5deb-45b2-80f1-e23e28d87f14 service nova] Creating event network-changed:0cd3b24d-ce36-4d42-806b-496fd2089b1b for instance 359f06bd-00e9-4d68-b066-db73d7073a04 on n-h1-850499-9 Aug 31 16:05:13.313003 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-2b020c2f-0317-4c5a-9bd1-601581d2a1bc req-67bf4d1f-5deb-45b2-80f1-e23e28d87f14 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057824 Aug 31 16:05:13.314324 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1164/2344] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:05:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:05:13.325665 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-38d7554f-0c01-4604-8b20-e2d7806bb3d0 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:13.327040 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-38d7554f-0c01-4604-8b20-e2d7806bb3d0 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] [instance: 1f11f86d-3387-4c6e-9099-fc8d232b11a8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:13.354057 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-38d7554f-0c01-4604-8b20-e2d7806bb3d0 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:13.355270 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-38d7554f-0c01-4604-8b20-e2d7806bb3d0 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:13.356478 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-38d7554f-0c01-4604-8b20-e2d7806bb3d0 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:13.357951 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-38d7554f-0c01-4604-8b20-e2d7806bb3d0 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:13.359366 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-38d7554f-0c01-4604-8b20-e2d7806bb3d0 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:13.360437 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-38d7554f-0c01-4604-8b20-e2d7806bb3d0 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:13.543568 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-38d7554f-0c01-4604-8b20-e2d7806bb3d0 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a837ababe7cb4284b96bc16deb40d2d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e9999df7e14609b1265351c83607bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:13.549236 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-71e740c5-a32c-45a7-b362-f959c2b5aa9c tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:13.585542 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-71e740c5-a32c-45a7-b362-f959c2b5aa9c tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:13.588482 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-71e740c5-a32c-45a7-b362-f959c2b5aa9c tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:13.589682 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-38d7554f-0c01-4604-8b20-e2d7806bb3d0 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] 10.222.0.61 "GET /compute/v2.1/servers/1f11f86d-3387-4c6e-9099-fc8d232b11a8" status: 200 len: 1339 microversion: 2.1 time: 0.273208 Aug 31 16:05:13.589876 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-71e740c5-a32c-45a7-b362-f959c2b5aa9c tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5" status: 200 len: 1487 microversion: 2.25 time: 0.643559 Aug 31 16:05:13.603550 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1165/2345] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:13 2022] GET /compute/v2.1/servers/1f11f86d-3387-4c6e-9099-fc8d232b11a8 => generated 1339 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:13.603816 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1181/2346] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:05:12 2022] GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5 => generated 1487 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:05:13.611081 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8f1ad414-5f81-4b0d-9a90-30b41031d14a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:13.617576 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8f1ad414-5f81-4b0d-9a90-30b41031d14a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 1262191c-be8b-4535-8704-72db13e3f6cc] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:13.647114 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8f1ad414-5f81-4b0d-9a90-30b41031d14a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:13.648028 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8f1ad414-5f81-4b0d-9a90-30b41031d14a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:13.648642 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8f1ad414-5f81-4b0d-9a90-30b41031d14a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:13.649396 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8f1ad414-5f81-4b0d-9a90-30b41031d14a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:13.649896 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8f1ad414-5f81-4b0d-9a90-30b41031d14a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:13.651289 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8f1ad414-5f81-4b0d-9a90-30b41031d14a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:13.904569 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8f1ad414-5f81-4b0d-9a90-30b41031d14a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:13.938234 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8f1ad414-5f81-4b0d-9a90-30b41031d14a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/1262191c-be8b-4535-8704-72db13e3f6cc" status: 200 len: 1274 microversion: 2.1 time: 0.345849 Aug 31 16:05:13.944083 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1166/2347] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:13 2022] GET /compute/v2.1/servers/1262191c-be8b-4535-8704-72db13e3f6cc => generated 1274 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:13.945588 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-744732d2-ea7e-41a5-85b4-ad9a2a635235 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:13.946604 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-744732d2-ea7e-41a5-85b4-ad9a2a635235 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 5efb9714-ab85-499c-b0ec-f79ffb2dea61] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:13.982283 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b4b2fc5f-17eb-4b75-a7c5-56b54cf4143a tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:13.982533 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-744732d2-ea7e-41a5-85b4-ad9a2a635235 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:13.983281 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b4b2fc5f-17eb-4b75-a7c5-56b54cf4143a tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: f9b66475-83f6-49a3-bc63-8965fc1aec14] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:13.983455 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-744732d2-ea7e-41a5-85b4-ad9a2a635235 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:13.988490 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-744732d2-ea7e-41a5-85b4-ad9a2a635235 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:13.989407 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-744732d2-ea7e-41a5-85b4-ad9a2a635235 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:13.989911 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-744732d2-ea7e-41a5-85b4-ad9a2a635235 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:14.000852 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-744732d2-ea7e-41a5-85b4-ad9a2a635235 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:14.002727 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b4b2fc5f-17eb-4b75-a7c5-56b54cf4143a tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:14.003288 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b4b2fc5f-17eb-4b75-a7c5-56b54cf4143a tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:14.003852 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b4b2fc5f-17eb-4b75-a7c5-56b54cf4143a tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:14.006190 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b4b2fc5f-17eb-4b75-a7c5-56b54cf4143a tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:14.006689 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b4b2fc5f-17eb-4b75-a7c5-56b54cf4143a tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:14.007237 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b4b2fc5f-17eb-4b75-a7c5-56b54cf4143a tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:14.113936 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=100 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:05:15.668169 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b4b2fc5f-17eb-4b75-a7c5-56b54cf4143a tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:15.695690 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b4b2fc5f-17eb-4b75-a7c5-56b54cf4143a tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/f9b66475-83f6-49a3-bc63-8965fc1aec14" status: 200 len: 1541 microversion: 2.1 time: 1.719378 Aug 31 16:05:15.700407 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1167/2348] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:13 2022] GET /compute/v2.1/servers/f9b66475-83f6-49a3-bc63-8965fc1aec14 => generated 1541 bytes in 1725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:15.720957 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-64514256-0ba3-4024-9f00-810770baabe0 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:15.721531 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-64514256-0ba3-4024-9f00-810770baabe0 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] [instance: 560a01e5-93f8-46c8-9261-5030e28766b4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:15.747039 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-64514256-0ba3-4024-9f00-810770baabe0 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:15.754828 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-64514256-0ba3-4024-9f00-810770baabe0 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:15.755974 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-64514256-0ba3-4024-9f00-810770baabe0 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:15.757036 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-64514256-0ba3-4024-9f00-810770baabe0 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:15.757871 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-64514256-0ba3-4024-9f00-810770baabe0 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:15.758740 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-64514256-0ba3-4024-9f00-810770baabe0 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:15.860493 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-744732d2-ea7e-41a5-85b4-ad9a2a635235 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:15.883668 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-744732d2-ea7e-41a5-85b4-ad9a2a635235 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/5efb9714-ab85-499c-b0ec-f79ffb2dea61" status: 200 len: 1472 microversion: 2.1 time: 1.945639 Aug 31 16:05:15.885483 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1182/2349] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:13 2022] GET /compute/v2.1/servers/5efb9714-ab85-499c-b0ec-f79ffb2dea61 => generated 1472 bytes in 1949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:05:15.896018 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5ba1806f-116c-4102-9569-d3d710d7da7d tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:15.897643 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5ba1806f-116c-4102-9569-d3d710d7da7d tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] [instance: 1f11f86d-3387-4c6e-9099-fc8d232b11a8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:15.910823 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5ba1806f-116c-4102-9569-d3d710d7da7d tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:15.912247 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5ba1806f-116c-4102-9569-d3d710d7da7d tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:15.913293 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5ba1806f-116c-4102-9569-d3d710d7da7d tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:15.914889 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5ba1806f-116c-4102-9569-d3d710d7da7d tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:15.916095 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5ba1806f-116c-4102-9569-d3d710d7da7d tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:15.917624 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5ba1806f-116c-4102-9569-d3d710d7da7d tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:16.216915 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-64514256-0ba3-4024-9f00-810770baabe0 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f0b27a48fd41dd846ba60856349ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4efd94380dcf4b3cb7a2b9fa194fcb83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:16.242971 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5ba1806f-116c-4102-9569-d3d710d7da7d tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a837ababe7cb4284b96bc16deb40d2d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e9999df7e14609b1265351c83607bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:16.272513 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-64514256-0ba3-4024-9f00-810770baabe0 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "GET /compute/v2.1/servers/560a01e5-93f8-46c8-9261-5030e28766b4" status: 200 len: 1270 microversion: 2.1 time: 0.567890 Aug 31 16:05:16.274974 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5ba1806f-116c-4102-9569-d3d710d7da7d tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] 10.222.0.61 "GET /compute/v2.1/servers/1f11f86d-3387-4c6e-9099-fc8d232b11a8" status: 200 len: 1327 microversion: 2.1 time: 0.384295 Aug 31 16:05:16.275529 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1168/2350] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:15 2022] GET /compute/v2.1/servers/560a01e5-93f8-46c8-9261-5030e28766b4 => generated 1270 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:16.311691 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1183/2351] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:15 2022] GET /compute/v2.1/servers/1f11f86d-3387-4c6e-9099-fc8d232b11a8 => generated 1327 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:16.323429 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4e5da446-85a5-4990-96c9-d6335aa3ce19 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:16.325823 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-863dd1e7-2280-4437-ac81-884e24523bde tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:16.326078 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4e5da446-85a5-4990-96c9-d6335aa3ce19 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 006771fc-9da9-4b78-9fad-f4b72c311fd5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:16.327744 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-863dd1e7-2280-4437-ac81-884e24523bde tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 1262191c-be8b-4535-8704-72db13e3f6cc] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:16.354311 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4e5da446-85a5-4990-96c9-d6335aa3ce19 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:16.357901 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4e5da446-85a5-4990-96c9-d6335aa3ce19 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:16.359936 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4e5da446-85a5-4990-96c9-d6335aa3ce19 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:16.361297 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-863dd1e7-2280-4437-ac81-884e24523bde tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:16.361695 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4e5da446-85a5-4990-96c9-d6335aa3ce19 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:16.362375 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-863dd1e7-2280-4437-ac81-884e24523bde tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:16.363373 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4e5da446-85a5-4990-96c9-d6335aa3ce19 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:16.364034 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-863dd1e7-2280-4437-ac81-884e24523bde tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:16.364621 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4e5da446-85a5-4990-96c9-d6335aa3ce19 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:16.367438 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-863dd1e7-2280-4437-ac81-884e24523bde tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:16.368092 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-863dd1e7-2280-4437-ac81-884e24523bde tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:16.370185 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-863dd1e7-2280-4437-ac81-884e24523bde tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:16.774539 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-863dd1e7-2280-4437-ac81-884e24523bde tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:16.809347 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-863dd1e7-2280-4437-ac81-884e24523bde tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/1262191c-be8b-4535-8704-72db13e3f6cc" status: 200 len: 1272 microversion: 2.1 time: 0.494774 Aug 31 16:05:16.810912 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1184/2352] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:16 2022] GET /compute/v2.1/servers/1262191c-be8b-4535-8704-72db13e3f6cc => generated 1272 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:16.836584 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-65802839-cc67-4e43-bc20-8202e0f2d794 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:16.851983 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-65802839-cc67-4e43-bc20-8202e0f2d794 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: f9b66475-83f6-49a3-bc63-8965fc1aec14] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:16.864551 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-65802839-cc67-4e43-bc20-8202e0f2d794 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:16.868293 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-65802839-cc67-4e43-bc20-8202e0f2d794 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:16.872640 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-65802839-cc67-4e43-bc20-8202e0f2d794 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:16.874480 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-65802839-cc67-4e43-bc20-8202e0f2d794 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:16.878019 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-65802839-cc67-4e43-bc20-8202e0f2d794 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:16.879193 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-65802839-cc67-4e43-bc20-8202e0f2d794 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:17.369487 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=4 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:05:17.408223 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=30 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:05:17.886826 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=4 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:05:17.936881 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=16 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:05:19.118415 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-4e5da446-85a5-4990-96c9-d6335aa3ce19 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:19.166458 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-4e5da446-85a5-4990-96c9-d6335aa3ce19 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:19.175887 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-4e5da446-85a5-4990-96c9-d6335aa3ce19 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:19.177153 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4e5da446-85a5-4990-96c9-d6335aa3ce19 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5" status: 200 len: 1487 microversion: 2.25 time: 2.898877 Aug 31 16:05:19.185821 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1169/2353] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:05:16 2022] GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5 => generated 1487 bytes in 2909 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:05:19.199853 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d794e795-2a21-437c-af24-799c70f8d0b4 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:19.200580 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d794e795-2a21-437c-af24-799c70f8d0b4 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 5efb9714-ab85-499c-b0ec-f79ffb2dea61] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:19.247225 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d794e795-2a21-437c-af24-799c70f8d0b4 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:19.255605 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d794e795-2a21-437c-af24-799c70f8d0b4 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:19.257222 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d794e795-2a21-437c-af24-799c70f8d0b4 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:19.262142 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d794e795-2a21-437c-af24-799c70f8d0b4 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:19.262899 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d794e795-2a21-437c-af24-799c70f8d0b4 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:19.263607 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d794e795-2a21-437c-af24-799c70f8d0b4 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:19.572536 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-65802839-cc67-4e43-bc20-8202e0f2d794 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:19.626392 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-65802839-cc67-4e43-bc20-8202e0f2d794 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/f9b66475-83f6-49a3-bc63-8965fc1aec14" status: 200 len: 1541 microversion: 2.1 time: 2.799331 Aug 31 16:05:19.652841 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1185/2354] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:16 2022] GET /compute/v2.1/servers/f9b66475-83f6-49a3-bc63-8965fc1aec14 => generated 1541 bytes in 2839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:19.670422 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4eb6a805-93bd-4d99-aeb6-98d868562bed tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:19.671049 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4eb6a805-93bd-4d99-aeb6-98d868562bed tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] [instance: 560a01e5-93f8-46c8-9261-5030e28766b4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:19.698240 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4eb6a805-93bd-4d99-aeb6-98d868562bed tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:19.698799 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4eb6a805-93bd-4d99-aeb6-98d868562bed tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:19.702610 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4eb6a805-93bd-4d99-aeb6-98d868562bed tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:19.703480 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4eb6a805-93bd-4d99-aeb6-98d868562bed tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:19.704007 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4eb6a805-93bd-4d99-aeb6-98d868562bed tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:19.707336 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4eb6a805-93bd-4d99-aeb6-98d868562bed tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:20.216796 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d794e795-2a21-437c-af24-799c70f8d0b4 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:20.247902 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d794e795-2a21-437c-af24-799c70f8d0b4 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/5efb9714-ab85-499c-b0ec-f79ffb2dea61" status: 200 len: 1302 microversion: 2.1 time: 1.060873 Aug 31 16:05:20.256353 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1170/2355] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:19 2022] GET /compute/v2.1/servers/5efb9714-ab85-499c-b0ec-f79ffb2dea61 => generated 1302 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:20.268608 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-87168a58-cc1c-4497-8c5c-4ea14a7537df tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:20.269231 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-87168a58-cc1c-4497-8c5c-4ea14a7537df tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] [instance: 1f11f86d-3387-4c6e-9099-fc8d232b11a8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:20.304998 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-87168a58-cc1c-4497-8c5c-4ea14a7537df tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:20.305553 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-87168a58-cc1c-4497-8c5c-4ea14a7537df tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:20.306007 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-87168a58-cc1c-4497-8c5c-4ea14a7537df tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:20.306761 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-87168a58-cc1c-4497-8c5c-4ea14a7537df tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:20.307347 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-87168a58-cc1c-4497-8c5c-4ea14a7537df tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:20.307686 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-87168a58-cc1c-4497-8c5c-4ea14a7537df tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:20.512880 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-4eb6a805-93bd-4d99-aeb6-98d868562bed tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f0b27a48fd41dd846ba60856349ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4efd94380dcf4b3cb7a2b9fa194fcb83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:20.571557 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4eb6a805-93bd-4d99-aeb6-98d868562bed tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "GET /compute/v2.1/servers/560a01e5-93f8-46c8-9261-5030e28766b4" status: 200 len: 1276 microversion: 2.1 time: 0.915647 Aug 31 16:05:20.574612 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1186/2356] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:19 2022] GET /compute/v2.1/servers/560a01e5-93f8-46c8-9261-5030e28766b4 => generated 1276 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:20.575785 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-87168a58-cc1c-4497-8c5c-4ea14a7537df tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a837ababe7cb4284b96bc16deb40d2d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e9999df7e14609b1265351c83607bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:20.590770 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-71e0642a-f1d8-4a9e-90fa-ccb778b3342b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:20.592311 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-71e0642a-f1d8-4a9e-90fa-ccb778b3342b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 1262191c-be8b-4535-8704-72db13e3f6cc] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:20.603105 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-87168a58-cc1c-4497-8c5c-4ea14a7537df tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] 10.222.0.61 "GET /compute/v2.1/servers/1f11f86d-3387-4c6e-9099-fc8d232b11a8" status: 200 len: 1327 microversion: 2.1 time: 0.345300 Aug 31 16:05:20.608129 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-71e0642a-f1d8-4a9e-90fa-ccb778b3342b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:20.612533 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-71e0642a-f1d8-4a9e-90fa-ccb778b3342b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:20.614684 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-71e0642a-f1d8-4a9e-90fa-ccb778b3342b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:20.618326 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-71e0642a-f1d8-4a9e-90fa-ccb778b3342b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:20.619449 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-71e0642a-f1d8-4a9e-90fa-ccb778b3342b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:20.621552 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-71e0642a-f1d8-4a9e-90fa-ccb778b3342b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:20.632723 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1171/2357] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:20 2022] GET /compute/v2.1/servers/1f11f86d-3387-4c6e-9099-fc8d232b11a8 => generated 1327 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:20.644720 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-d38981ef-a415-4023-927b-d1c0382c3124 req-a614eaa0-51a7-4d3d-a724-022f017f8da3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5efb9714-ab85-499c-b0ec-f79ffb2dea61", "name": "network-vif-deleted", "tag": "7380b28d-6c2b-4a62-9b98-da18ab201665"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:05:20.669976 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-d38981ef-a415-4023-927b-d1c0382c3124 req-a614eaa0-51a7-4d3d-a724-022f017f8da3 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:20.690540 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-d38981ef-a415-4023-927b-d1c0382c3124 req-a614eaa0-51a7-4d3d-a724-022f017f8da3 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:20.691045 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-d38981ef-a415-4023-927b-d1c0382c3124 req-a614eaa0-51a7-4d3d-a724-022f017f8da3 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:20.722238 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-d38981ef-a415-4023-927b-d1c0382c3124 req-a614eaa0-51a7-4d3d-a724-022f017f8da3 service nova] Creating event network-vif-deleted:7380b28d-6c2b-4a62-9b98-da18ab201665 for instance 5efb9714-ab85-499c-b0ec-f79ffb2dea61 on n-h2-850499-9 Aug 31 16:05:20.736274 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-d38981ef-a415-4023-927b-d1c0382c3124 req-a614eaa0-51a7-4d3d-a724-022f017f8da3 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102120 Aug 31 16:05:20.737069 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1172/2358] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:05:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:05:20.743551 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-cd9a84ef-8d92-47d0-860c-35985632d503 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:20.744372 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-cd9a84ef-8d92-47d0-860c-35985632d503 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: cc085aaa-21b2-48a6-b69c-de4e261dfe7f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:20.773719 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cd9a84ef-8d92-47d0-860c-35985632d503 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:20.774488 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cd9a84ef-8d92-47d0-860c-35985632d503 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:20.775064 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cd9a84ef-8d92-47d0-860c-35985632d503 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:20.775969 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cd9a84ef-8d92-47d0-860c-35985632d503 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:20.776911 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cd9a84ef-8d92-47d0-860c-35985632d503 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:20.777526 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cd9a84ef-8d92-47d0-860c-35985632d503 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:20.840416 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-cd9a84ef-8d92-47d0-860c-35985632d503 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: cc085aaa-21b2-48a6-b69c-de4e261dfe7f] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:05:21.014338 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-cd9a84ef-8d92-47d0-860c-35985632d503 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "DELETE /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f" status: 204 len: 0 microversion: 2.1 time: 0.274982 Aug 31 16:05:21.020246 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1173/2359] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:05:20 2022] DELETE /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:05:21.039813 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0e3d9159-a46f-4943-b6f3-4c22ceab02bb tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:21.041381 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0e3d9159-a46f-4943-b6f3-4c22ceab02bb tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 006771fc-9da9-4b78-9fad-f4b72c311fd5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:21.050550 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0e3d9159-a46f-4943-b6f3-4c22ceab02bb tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:21.051458 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0e3d9159-a46f-4943-b6f3-4c22ceab02bb tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:21.052189 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0e3d9159-a46f-4943-b6f3-4c22ceab02bb tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:21.053172 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0e3d9159-a46f-4943-b6f3-4c22ceab02bb tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:21.053952 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0e3d9159-a46f-4943-b6f3-4c22ceab02bb tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:21.054593 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0e3d9159-a46f-4943-b6f3-4c22ceab02bb tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:21.506788 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-71e0642a-f1d8-4a9e-90fa-ccb778b3342b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:21.526382 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-71e0642a-f1d8-4a9e-90fa-ccb778b3342b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/1262191c-be8b-4535-8704-72db13e3f6cc" status: 200 len: 1272 microversion: 2.1 time: 0.946679 Aug 31 16:05:21.528391 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1187/2360] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:20 2022] GET /compute/v2.1/servers/1262191c-be8b-4535-8704-72db13e3f6cc => generated 1272 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:21.534144 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b4702275-6467-4337-a8b3-39599e86410b tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:21.536709 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b4702275-6467-4337-a8b3-39599e86410b tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: f9b66475-83f6-49a3-bc63-8965fc1aec14] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:21.545319 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b4702275-6467-4337-a8b3-39599e86410b tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:21.546205 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b4702275-6467-4337-a8b3-39599e86410b tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:21.547159 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b4702275-6467-4337-a8b3-39599e86410b tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:21.548172 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b4702275-6467-4337-a8b3-39599e86410b tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:21.550780 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b4702275-6467-4337-a8b3-39599e86410b tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:21.554398 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b4702275-6467-4337-a8b3-39599e86410b tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:22.465450 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0e3d9159-a46f-4943-b6f3-4c22ceab02bb tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:22.507934 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0e3d9159-a46f-4943-b6f3-4c22ceab02bb tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:22.515156 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0e3d9159-a46f-4943-b6f3-4c22ceab02bb tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:22.527866 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0e3d9159-a46f-4943-b6f3-4c22ceab02bb tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5" status: 200 len: 1487 microversion: 2.25 time: 1.504951 Aug 31 16:05:22.530229 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1174/2361] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:05:21 2022] GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5 => generated 1487 bytes in 1509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:05:22.544557 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e15629b9-a79c-40ad-acac-6cef5a4be7a9 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Action: 'create', calling method: .version_select at 0x7f5ae8cdce50>, body: {"keypair": {"name": "tempest-keypair-1434139224", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7cfQH2wtCkCNOfPcpDJPwJZEylBDQinr7JFQf0msdIe1TzGX+FkMaiGdGJvcljujDoUGb7GFRinkC/Dx/Lj2N461jjna/oDdTpRrc7BUOit1rkHLNnlAFLb4vZ2I4zgw=="}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:05:22.611465 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-e15629b9-a79c-40ad-acac-6cef5a4be7a9 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Getting quotas for project de3a6577c7c34e8e928dfc1a4172f51c. Resources: {'key_pairs'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:05:22.621651 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-e15629b9-a79c-40ad-acac-6cef5a4be7a9 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Getting quotas for user ccb8cf5661d641bca73aa56cb8cc334c and project de3a6577c7c34e8e928dfc1a4172f51c. Resources: {'key_pairs'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:05:22.724655 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e15629b9-a79c-40ad-acac-6cef5a4be7a9 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.189353 Aug 31 16:05:22.725886 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1175/2362] 10.222.0.61 () {62 vars in 1200 bytes} [Wed Aug 31 16:05:22 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 195 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 31 16:05:22.737362 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d3bf3b9e-c674-4b37-838c-c1020825c363 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:22.740260 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d3bf3b9e-c674-4b37-838c-c1020825c363 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: cc085aaa-21b2-48a6-b69c-de4e261dfe7f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:22.759843 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d3bf3b9e-c674-4b37-838c-c1020825c363 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:22.763452 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d3bf3b9e-c674-4b37-838c-c1020825c363 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:22.765384 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d3bf3b9e-c674-4b37-838c-c1020825c363 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:22.768661 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d3bf3b9e-c674-4b37-838c-c1020825c363 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:22.770279 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d3bf3b9e-c674-4b37-838c-c1020825c363 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:22.774021 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d3bf3b9e-c674-4b37-838c-c1020825c363 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:23.502555 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b4702275-6467-4337-a8b3-39599e86410b tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:23.519733 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b4702275-6467-4337-a8b3-39599e86410b tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/f9b66475-83f6-49a3-bc63-8965fc1aec14" status: 200 len: 1541 microversion: 2.1 time: 1.989284 Aug 31 16:05:23.520973 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1188/2363] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:21 2022] GET /compute/v2.1/servers/f9b66475-83f6-49a3-bc63-8965fc1aec14 => generated 1541 bytes in 1992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:23.530484 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-905005f0-39cb-4f82-9a0a-744c11160e5d tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:23.532117 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-905005f0-39cb-4f82-9a0a-744c11160e5d tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 5efb9714-ab85-499c-b0ec-f79ffb2dea61] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:23.542651 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-905005f0-39cb-4f82-9a0a-744c11160e5d tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:23.543713 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-905005f0-39cb-4f82-9a0a-744c11160e5d tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:23.545075 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-905005f0-39cb-4f82-9a0a-744c11160e5d tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:23.547437 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-905005f0-39cb-4f82-9a0a-744c11160e5d tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:23.548836 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-905005f0-39cb-4f82-9a0a-744c11160e5d tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:23.549740 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-905005f0-39cb-4f82-9a0a-744c11160e5d tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:23.584257 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-905005f0-39cb-4f82-9a0a-744c11160e5d tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] HTTP exception thrown: Instance 5efb9714-ab85-499c-b0ec-f79ffb2dea61 could not be found. Aug 31 16:05:23.587074 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-905005f0-39cb-4f82-9a0a-744c11160e5d tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Request method failure captured: Aug 31 16:05:23.587074 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/5efb9714-ab85-499c-b0ec-f79ffb2dea61 HTTP/1.1 Aug 31 16:05:23.587074 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:05:23.587074 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:05:23.587074 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:05:23.587074 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:05:23.587074 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:05:23.587074 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:05:23.587074 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:05:23.587074 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:05:23.587074 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4XtNmkvMwnHSL7qhg4V3Wdw6j3Xq_Y_rjXmT_SLe0FMvGo1gt1LwtP8iZQqS4u70Er7TOj14npyXUlDGoqy-1fk7VS9f_3ajnUzSZB5vWqF2Pe5k8siWL_JGtE8zCZBhN_wgL3NLoqpJfp9eoMAktgpjf2nAX9ECp3Cc5bDcIxyAw0 Aug 31 16:05:23.587074 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:05:23.587074 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:05:23.587074 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:05:23.587074 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:05:23.587074 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:05:23.587074 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:05:23.587074 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 7fa2effd15e440598752264e49d2457d Aug 31 16:05:23.587074 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ServersOnMultiNodesTest-1308696187 Aug 31 16:05:23.587074 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:05:23.587074 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:05:23.587074 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7fa2effd15e440598752264e49d2457d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7fa2effd15e440598752264e49d2457d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7fa2effd15e440598752264e49d2457d", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7fa2effd15e440598752264e49d2457d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:05:23.587074 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ServersOnMultiNodesTest-1308696187 Aug 31 16:05:23.587074 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 7fa2effd15e440598752264e49d2457d Aug 31 16:05:23.587074 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1308696187 Aug 31 16:05:23.587074 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ServersOnMultiNodesTest-1308696187-project Aug 31 16:05:23.587074 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:05:23.587074 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:05:23.587074 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 547d88df13034daaad50c3582c7cc3b3 Aug 31 16:05:23.587074 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ServersOnMultiNodesTest-1308696187-project Aug 31 16:05:23.587074 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:05:23.587074 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance 5efb9714-ab85-499c-b0ec-f79ffb2dea61 could not be found. Aug 31 16:05:23.587074 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '5efb9714-ab85-499c-b0ec-f79ffb2dea61'} Aug 31 16:05:23.587074 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:05:23.587074 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:05:23.587074 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:05:23.587074 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:05:23.587074 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:05:23.587074 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:05:23.587074 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:05:23.587074 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:05:23.587074 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:05:23.587074 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:05:23.587074 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5efb9714-ab85-499c-b0ec-f79ffb2dea61 could not be found. Aug 31 16:05:23.587074 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:05:23.587074 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:05:23.587074 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:05:23.587074 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:05:23.587074 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:05:23.587074 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:05:23.587074 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:05:23.587074 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:05:23.587074 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:05:23.587074 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:05:23.587074 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:05:23.587074 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:05:23.587074 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:05:23.587074 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:05:23.587074 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:05:23.587074 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:05:23.587074 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5efb9714-ab85-499c-b0ec-f79ffb2dea61 could not be found. Aug 31 16:05:23.587074 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:05:23.587074 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:05:23.587074 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:05:23.590905 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:05:23.590905 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:05:23.590905 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:05:23.590905 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:05:23.590905 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:05:23.590905 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5efb9714-ab85-499c-b0ec-f79ffb2dea61 could not be found. Aug 31 16:05:23.590905 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:05:23.593425 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-905005f0-39cb-4f82-9a0a-744c11160e5d tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Returning 404 to user: Instance 5efb9714-ab85-499c-b0ec-f79ffb2dea61 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:05:23.595798 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-905005f0-39cb-4f82-9a0a-744c11160e5d tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/5efb9714-ab85-499c-b0ec-f79ffb2dea61" status: 404 len: 111 microversion: 2.1 time: 0.071716 Aug 31 16:05:23.598281 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1189/2364] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:23 2022] GET /compute/v2.1/servers/5efb9714-ab85-499c-b0ec-f79ffb2dea61 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:05:23.614125 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b6e72a5e-7402-462b-a268-fb3e2094482d tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:23.615130 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b6e72a5e-7402-462b-a268-fb3e2094482d tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] [instance: 560a01e5-93f8-46c8-9261-5030e28766b4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:23.627117 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b6e72a5e-7402-462b-a268-fb3e2094482d tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:23.628352 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b6e72a5e-7402-462b-a268-fb3e2094482d tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:23.629319 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b6e72a5e-7402-462b-a268-fb3e2094482d tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:23.630671 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b6e72a5e-7402-462b-a268-fb3e2094482d tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:23.631266 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b6e72a5e-7402-462b-a268-fb3e2094482d tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:23.631799 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b6e72a5e-7402-462b-a268-fb3e2094482d tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:24.383828 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b6e72a5e-7402-462b-a268-fb3e2094482d tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f0b27a48fd41dd846ba60856349ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4efd94380dcf4b3cb7a2b9fa194fcb83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:24.431225 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b6e72a5e-7402-462b-a268-fb3e2094482d tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "GET /compute/v2.1/servers/560a01e5-93f8-46c8-9261-5030e28766b4" status: 200 len: 1276 microversion: 2.1 time: 0.830175 Aug 31 16:05:24.433913 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1190/2365] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:23 2022] GET /compute/v2.1/servers/560a01e5-93f8-46c8-9261-5030e28766b4 => generated 1276 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:24.442684 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c08d9b53-286d-4c26-966a-8e4786662513 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:24.443948 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c08d9b53-286d-4c26-966a-8e4786662513 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] [instance: 1f11f86d-3387-4c6e-9099-fc8d232b11a8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:24.452111 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d3bf3b9e-c674-4b37-838c-c1020825c363 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:24.470910 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c08d9b53-286d-4c26-966a-8e4786662513 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:24.472356 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c08d9b53-286d-4c26-966a-8e4786662513 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:24.473158 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c08d9b53-286d-4c26-966a-8e4786662513 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:24.474079 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c08d9b53-286d-4c26-966a-8e4786662513 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:24.474309 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d3bf3b9e-c674-4b37-838c-c1020825c363 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f" status: 200 len: 1669 microversion: 2.1 time: 1.746219 Aug 31 16:05:24.474960 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c08d9b53-286d-4c26-966a-8e4786662513 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:24.475537 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1176/2366] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:22 2022] GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f => generated 1669 bytes in 1749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:24.475845 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c08d9b53-286d-4c26-966a-8e4786662513 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:24.486009 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-09e6b3f4-c896-44e2-a4ee-ce35d96ae2ff tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:24.489499 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-09e6b3f4-c896-44e2-a4ee-ce35d96ae2ff tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 1262191c-be8b-4535-8704-72db13e3f6cc] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:24.504801 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-09e6b3f4-c896-44e2-a4ee-ce35d96ae2ff tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:24.509690 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-09e6b3f4-c896-44e2-a4ee-ce35d96ae2ff tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:24.510346 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-09e6b3f4-c896-44e2-a4ee-ce35d96ae2ff tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:24.511280 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-09e6b3f4-c896-44e2-a4ee-ce35d96ae2ff tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:24.511917 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-09e6b3f4-c896-44e2-a4ee-ce35d96ae2ff tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:24.517818 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-09e6b3f4-c896-44e2-a4ee-ce35d96ae2ff tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:24.582336 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:05:25.487174 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c08d9b53-286d-4c26-966a-8e4786662513 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a837ababe7cb4284b96bc16deb40d2d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e9999df7e14609b1265351c83607bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:25.497494 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c08d9b53-286d-4c26-966a-8e4786662513 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] 10.222.0.61 "GET /compute/v2.1/servers/1f11f86d-3387-4c6e-9099-fc8d232b11a8" status: 200 len: 1395 microversion: 2.1 time: 1.061035 Aug 31 16:05:25.498725 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1191/2367] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:24 2022] GET /compute/v2.1/servers/1f11f86d-3387-4c6e-9099-fc8d232b11a8 => generated 1395 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:25.505044 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e646d5d4-12a8-4e48-9e47-4d571549d8fc tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:25.506147 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e646d5d4-12a8-4e48-9e47-4d571549d8fc tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 006771fc-9da9-4b78-9fad-f4b72c311fd5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:25.515428 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e646d5d4-12a8-4e48-9e47-4d571549d8fc tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:25.516138 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e646d5d4-12a8-4e48-9e47-4d571549d8fc tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:25.516863 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e646d5d4-12a8-4e48-9e47-4d571549d8fc tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:25.518083 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e646d5d4-12a8-4e48-9e47-4d571549d8fc tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:25.518901 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e646d5d4-12a8-4e48-9e47-4d571549d8fc tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:25.519729 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e646d5d4-12a8-4e48-9e47-4d571549d8fc tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:25.662012 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-09e6b3f4-c896-44e2-a4ee-ce35d96ae2ff tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:25.674958 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-09e6b3f4-c896-44e2-a4ee-ce35d96ae2ff tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/1262191c-be8b-4535-8704-72db13e3f6cc" status: 200 len: 1314 microversion: 2.1 time: 1.197473 Aug 31 16:05:25.676660 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1177/2368] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:24 2022] GET /compute/v2.1/servers/1262191c-be8b-4535-8704-72db13e3f6cc => generated 1314 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:25.687020 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6a171de2-420e-4c44-a6da-5e57835d7fb2 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:25.688598 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6a171de2-420e-4c44-a6da-5e57835d7fb2 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 9e504a13-2fea-4da7-880d-b1782f9c5053] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:25.700855 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6a171de2-420e-4c44-a6da-5e57835d7fb2 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:25.704475 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6a171de2-420e-4c44-a6da-5e57835d7fb2 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:25.705334 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6a171de2-420e-4c44-a6da-5e57835d7fb2 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:25.706539 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6a171de2-420e-4c44-a6da-5e57835d7fb2 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:25.707211 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6a171de2-420e-4c44-a6da-5e57835d7fb2 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:25.707991 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6a171de2-420e-4c44-a6da-5e57835d7fb2 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:25.754255 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6a171de2-420e-4c44-a6da-5e57835d7fb2 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 9e504a13-2fea-4da7-880d-b1782f9c5053] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:05:25.873775 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6a171de2-420e-4c44-a6da-5e57835d7fb2 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "DELETE /compute/v2.1/servers/9e504a13-2fea-4da7-880d-b1782f9c5053" status: 204 len: 0 microversion: 2.1 time: 0.194643 Aug 31 16:05:25.875118 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1178/2369] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:05:25 2022] DELETE /compute/v2.1/servers/9e504a13-2fea-4da7-880d-b1782f9c5053 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:05:25.883615 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f6f7d635-0411-49fe-b4d8-99ce41ef7935 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:25.884614 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f6f7d635-0411-49fe-b4d8-99ce41ef7935 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: f9b66475-83f6-49a3-bc63-8965fc1aec14] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:25.893367 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f6f7d635-0411-49fe-b4d8-99ce41ef7935 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:25.893877 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f6f7d635-0411-49fe-b4d8-99ce41ef7935 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:25.894379 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f6f7d635-0411-49fe-b4d8-99ce41ef7935 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:25.895121 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f6f7d635-0411-49fe-b4d8-99ce41ef7935 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:25.895620 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f6f7d635-0411-49fe-b4d8-99ce41ef7935 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:25.896119 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f6f7d635-0411-49fe-b4d8-99ce41ef7935 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:26.296315 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e646d5d4-12a8-4e48-9e47-4d571549d8fc tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:26.319343 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e646d5d4-12a8-4e48-9e47-4d571549d8fc tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:26.320951 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e646d5d4-12a8-4e48-9e47-4d571549d8fc tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:26.322185 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e646d5d4-12a8-4e48-9e47-4d571549d8fc tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5" status: 200 len: 1487 microversion: 2.25 time: 0.822161 Aug 31 16:05:26.327721 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1192/2370] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:05:25 2022] GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5 => generated 1487 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:05:26.328659 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-2a092e09-fc1f-4a72-9039-4370fee40aa1 req-0e616429-bc99-471e-9575-2b1190f5677e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "006771fc-9da9-4b78-9fad-f4b72c311fd5", "name": "network-vif-unplugged", "status": "completed", "tag": "a0210474-72a8-4f79-a241-42969b6b4b66"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:05:26.340040 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-2a092e09-fc1f-4a72-9039-4370fee40aa1 req-0e616429-bc99-471e-9575-2b1190f5677e service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:26.340660 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-2a092e09-fc1f-4a72-9039-4370fee40aa1 req-0e616429-bc99-471e-9575-2b1190f5677e service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:26.341740 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-2a092e09-fc1f-4a72-9039-4370fee40aa1 req-0e616429-bc99-471e-9575-2b1190f5677e service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:26.360325 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-2a092e09-fc1f-4a72-9039-4370fee40aa1 req-0e616429-bc99-471e-9575-2b1190f5677e service nova] Creating event network-vif-unplugged:a0210474-72a8-4f79-a241-42969b6b4b66 for instance 006771fc-9da9-4b78-9fad-f4b72c311fd5 on n-h2-850499-9 Aug 31 16:05:26.367105 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-2a092e09-fc1f-4a72-9039-4370fee40aa1 req-0e616429-bc99-471e-9575-2b1190f5677e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041812 Aug 31 16:05:26.368075 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1193/2371] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:05:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:05:26.373907 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-39a7e80c-aeef-4317-9a49-161085333e13 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1541588667", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "9feafc74-03ec-4aa4-b1de-9a5c2055f5cc"}, {"port": "4f30e818-6489-4d7e-b214-37689cbe6c21", "tag": "port-1"}, {"port": "4fb7438a-39e7-4bab-9387-26385ed169d1", "tag": "port-2"}, {"uuid": "bd2dca63-b853-489a-ae91-23802c038eb1", "tag": "net-1"}, {"uuid": "bd2dca63-b853-489a-ae91-23802c038eb1"}, {"uuid": "66031e42-68da-497b-a693-e7e86a245a0c", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "66031e42-68da-497b-a693-e7e86a245a0c", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "c53d8837-dbcf-412d-b3bf-f3c658f34748", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "c8af26cd-3050-42e1-b138-a161d997df4a", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "2ed3e3f7-03c9-4b56-8d95-6fcc7191cd3d", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--188195985"}], "key_name": "tempest-keypair-1434139224", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:05:26.660478 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f6f7d635-0411-49fe-b4d8-99ce41ef7935 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:26.674861 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f6f7d635-0411-49fe-b4d8-99ce41ef7935 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/f9b66475-83f6-49a3-bc63-8965fc1aec14" status: 200 len: 1541 microversion: 2.1 time: 0.798221 Aug 31 16:05:26.681289 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1179/2372] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:25 2022] GET /compute/v2.1/servers/f9b66475-83f6-49a3-bc63-8965fc1aec14 => generated 1541 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:26.697707 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-98c9c84c-3d91-41de-bebc-5c59aff19e59 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:26.701101 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-98c9c84c-3d91-41de-bebc-5c59aff19e59 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] [instance: 560a01e5-93f8-46c8-9261-5030e28766b4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:26.714615 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-98c9c84c-3d91-41de-bebc-5c59aff19e59 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:26.715625 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-98c9c84c-3d91-41de-bebc-5c59aff19e59 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:26.716687 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-98c9c84c-3d91-41de-bebc-5c59aff19e59 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:26.718385 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-98c9c84c-3d91-41de-bebc-5c59aff19e59 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:26.719253 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-98c9c84c-3d91-41de-bebc-5c59aff19e59 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:26.720284 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-98c9c84c-3d91-41de-bebc-5c59aff19e59 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:26.914313 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-39a7e80c-aeef-4317-9a49-161085333e13 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] validate_networks() for [('9feafc74-03ec-4aa4-b1de-9a5c2055f5cc', None, None, None, None, None), (None, None, '4f30e818-6489-4d7e-b214-37689cbe6c21', None, None, None), (None, None, '4fb7438a-39e7-4bab-9387-26385ed169d1', None, None, None), ('bd2dca63-b853-489a-ae91-23802c038eb1', None, None, None, None, None), ('bd2dca63-b853-489a-ae91-23802c038eb1', None, None, None, None, None), ('66031e42-68da-497b-a693-e7e86a245a0c', '10.2.2.100', None, None, None, None), ('66031e42-68da-497b-a693-e7e86a245a0c', '10.2.2.200', None, None, None, None)] {{(pid=122256) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:05:28.023733 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-98c9c84c-3d91-41de-bebc-5c59aff19e59 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f0b27a48fd41dd846ba60856349ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4efd94380dcf4b3cb7a2b9fa194fcb83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:28.035419 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-98c9c84c-3d91-41de-bebc-5c59aff19e59 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "GET /compute/v2.1/servers/560a01e5-93f8-46c8-9261-5030e28766b4" status: 200 len: 1318 microversion: 2.1 time: 1.351967 Aug 31 16:05:28.036466 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1180/2373] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:26 2022] GET /compute/v2.1/servers/560a01e5-93f8-46c8-9261-5030e28766b4 => generated 1318 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:28.041991 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ae06236f-c655-4df4-a0a7-a72d4cb6205f tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:28.043342 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ae06236f-c655-4df4-a0a7-a72d4cb6205f tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: cc085aaa-21b2-48a6-b69c-de4e261dfe7f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:28.054480 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ae06236f-c655-4df4-a0a7-a72d4cb6205f tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:28.055237 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ae06236f-c655-4df4-a0a7-a72d4cb6205f tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:28.056037 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ae06236f-c655-4df4-a0a7-a72d4cb6205f tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:28.057343 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ae06236f-c655-4df4-a0a7-a72d4cb6205f tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:28.059039 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ae06236f-c655-4df4-a0a7-a72d4cb6205f tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:28.059341 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ae06236f-c655-4df4-a0a7-a72d4cb6205f tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:28.328558 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ae06236f-c655-4df4-a0a7-a72d4cb6205f tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:28.339903 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ae06236f-c655-4df4-a0a7-a72d4cb6205f tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f" status: 200 len: 1601 microversion: 2.1 time: 0.301433 Aug 31 16:05:28.340504 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1181/2374] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:28 2022] GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f => generated 1601 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:28.357583 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a78079fb-8826-4a82-adf9-f4701d4c07ac tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:28.359828 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a78079fb-8826-4a82-adf9-f4701d4c07ac tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 9e504a13-2fea-4da7-880d-b1782f9c5053] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:28.368271 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a78079fb-8826-4a82-adf9-f4701d4c07ac tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:28.369366 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a78079fb-8826-4a82-adf9-f4701d4c07ac tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:28.370157 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a78079fb-8826-4a82-adf9-f4701d4c07ac tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:28.371636 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a78079fb-8826-4a82-adf9-f4701d4c07ac tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:28.372933 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a78079fb-8826-4a82-adf9-f4701d4c07ac tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:28.373603 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a78079fb-8826-4a82-adf9-f4701d4c07ac tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:29.463577 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a78079fb-8826-4a82-adf9-f4701d4c07ac tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:29.474698 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a78079fb-8826-4a82-adf9-f4701d4c07ac tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/9e504a13-2fea-4da7-880d-b1782f9c5053" status: 200 len: 1473 microversion: 2.1 time: 1.132877 Aug 31 16:05:29.475552 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1182/2375] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:28 2022] GET /compute/v2.1/servers/9e504a13-2fea-4da7-880d-b1782f9c5053 => generated 1473 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:29.484088 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-66453450-1de3-4e0f-a61b-000d16aefac4 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:29.485654 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-66453450-1de3-4e0f-a61b-000d16aefac4 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] [instance: 1f11f86d-3387-4c6e-9099-fc8d232b11a8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:29.497465 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-66453450-1de3-4e0f-a61b-000d16aefac4 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:29.499035 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-66453450-1de3-4e0f-a61b-000d16aefac4 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:29.499782 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-66453450-1de3-4e0f-a61b-000d16aefac4 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:29.501459 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-66453450-1de3-4e0f-a61b-000d16aefac4 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:29.502125 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-66453450-1de3-4e0f-a61b-000d16aefac4 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:29.502603 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-66453450-1de3-4e0f-a61b-000d16aefac4 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:30.892411 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-66453450-1de3-4e0f-a61b-000d16aefac4 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a837ababe7cb4284b96bc16deb40d2d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e9999df7e14609b1265351c83607bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:30.919700 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-66453450-1de3-4e0f-a61b-000d16aefac4 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] 10.222.0.61 "GET /compute/v2.1/servers/1f11f86d-3387-4c6e-9099-fc8d232b11a8" status: 200 len: 1395 microversion: 2.1 time: 1.441945 Aug 31 16:05:30.927343 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1183/2376] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:29 2022] GET /compute/v2.1/servers/1f11f86d-3387-4c6e-9099-fc8d232b11a8 => generated 1395 bytes in 1450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:30.950188 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c066022a-0a93-4086-ac20-c6d3efcaa2f1 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:30.951683 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c066022a-0a93-4086-ac20-c6d3efcaa2f1 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 1262191c-be8b-4535-8704-72db13e3f6cc] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:30.973860 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c066022a-0a93-4086-ac20-c6d3efcaa2f1 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:30.974572 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c066022a-0a93-4086-ac20-c6d3efcaa2f1 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:30.975220 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c066022a-0a93-4086-ac20-c6d3efcaa2f1 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:30.978167 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c066022a-0a93-4086-ac20-c6d3efcaa2f1 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:30.979358 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c066022a-0a93-4086-ac20-c6d3efcaa2f1 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:30.981495 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c066022a-0a93-4086-ac20-c6d3efcaa2f1 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:31.805074 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c066022a-0a93-4086-ac20-c6d3efcaa2f1 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:31.828822 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c066022a-0a93-4086-ac20-c6d3efcaa2f1 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/1262191c-be8b-4535-8704-72db13e3f6cc" status: 200 len: 1314 microversion: 2.1 time: 0.898694 Aug 31 16:05:31.831175 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1184/2377] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:30 2022] GET /compute/v2.1/servers/1262191c-be8b-4535-8704-72db13e3f6cc => generated 1314 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:31.838587 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-89ed4ac9-889d-40f4-ad4d-61bf671d30a7 req-dfcfdfc4-57d5-4913-b4d0-3aaa080a552a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "359f06bd-00e9-4d68-b066-db73d7073a04", "name": "network-vif-plugged", "status": "completed", "tag": "0cd3b24d-ce36-4d42-806b-496fd2089b1b"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:05:31.889899 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-89ed4ac9-889d-40f4-ad4d-61bf671d30a7 req-dfcfdfc4-57d5-4913-b4d0-3aaa080a552a service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:31.891711 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-89ed4ac9-889d-40f4-ad4d-61bf671d30a7 req-dfcfdfc4-57d5-4913-b4d0-3aaa080a552a service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:31.892309 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-89ed4ac9-889d-40f4-ad4d-61bf671d30a7 req-dfcfdfc4-57d5-4913-b4d0-3aaa080a552a service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:31.932590 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-89ed4ac9-889d-40f4-ad4d-61bf671d30a7 req-dfcfdfc4-57d5-4913-b4d0-3aaa080a552a service nova] Creating event network-vif-plugged:0cd3b24d-ce36-4d42-806b-496fd2089b1b for instance 359f06bd-00e9-4d68-b066-db73d7073a04 on n-h1-850499-9 Aug 31 16:05:31.947839 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-89ed4ac9-889d-40f4-ad4d-61bf671d30a7 req-dfcfdfc4-57d5-4913-b4d0-3aaa080a552a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114892 Aug 31 16:05:31.951749 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1185/2378] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:05:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:05:31.960855 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2cb2ac1d-01e8-4921-b2b4-5c997efcb2f4 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:31.962454 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2cb2ac1d-01e8-4921-b2b4-5c997efcb2f4 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 006771fc-9da9-4b78-9fad-f4b72c311fd5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:31.973315 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2cb2ac1d-01e8-4921-b2b4-5c997efcb2f4 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:31.974492 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2cb2ac1d-01e8-4921-b2b4-5c997efcb2f4 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:31.975936 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2cb2ac1d-01e8-4921-b2b4-5c997efcb2f4 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:31.976826 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2cb2ac1d-01e8-4921-b2b4-5c997efcb2f4 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:31.977555 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2cb2ac1d-01e8-4921-b2b4-5c997efcb2f4 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:31.979280 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2cb2ac1d-01e8-4921-b2b4-5c997efcb2f4 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:32.642701 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=4 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:05:33.055567 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2cb2ac1d-01e8-4921-b2b4-5c997efcb2f4 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:33.079177 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2cb2ac1d-01e8-4921-b2b4-5c997efcb2f4 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:33.081274 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2cb2ac1d-01e8-4921-b2b4-5c997efcb2f4 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:33.082913 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2cb2ac1d-01e8-4921-b2b4-5c997efcb2f4 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5" status: 200 len: 1487 microversion: 2.25 time: 1.127580 Aug 31 16:05:33.099688 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1186/2379] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:05:31 2022] GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5 => generated 1487 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:05:33.099688 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-be67c3e5-4b88-4847-9c14-5245adc83df8 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:33.099688 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-be67c3e5-4b88-4847-9c14-5245adc83df8 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: f9b66475-83f6-49a3-bc63-8965fc1aec14] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:33.120516 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:UPDATE=3 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:05:33.124654 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-be67c3e5-4b88-4847-9c14-5245adc83df8 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:33.126946 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-be67c3e5-4b88-4847-9c14-5245adc83df8 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:33.128072 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-be67c3e5-4b88-4847-9c14-5245adc83df8 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:33.130705 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-be67c3e5-4b88-4847-9c14-5245adc83df8 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:33.132077 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-be67c3e5-4b88-4847-9c14-5245adc83df8 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:33.133158 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-be67c3e5-4b88-4847-9c14-5245adc83df8 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:33.645940 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-be67c3e5-4b88-4847-9c14-5245adc83df8 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:33.662958 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-be67c3e5-4b88-4847-9c14-5245adc83df8 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/f9b66475-83f6-49a3-bc63-8965fc1aec14" status: 200 len: 1540 microversion: 2.1 time: 0.577065 Aug 31 16:05:33.665756 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1187/2380] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:33 2022] GET /compute/v2.1/servers/f9b66475-83f6-49a3-bc63-8965fc1aec14 => generated 1540 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:33.675690 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-0c53a061-4df9-462c-b357-5a21239e5adc req-e150c045-f021-49a3-9df0-46d256d78c9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "006771fc-9da9-4b78-9fad-f4b72c311fd5", "tag": "a0210474-72a8-4f79-a241-42969b6b4b66"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:05:33.700712 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-0c53a061-4df9-462c-b357-5a21239e5adc req-e150c045-f021-49a3-9df0-46d256d78c9e service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:33.702112 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-0c53a061-4df9-462c-b357-5a21239e5adc req-e150c045-f021-49a3-9df0-46d256d78c9e service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:33.703720 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-0c53a061-4df9-462c-b357-5a21239e5adc req-e150c045-f021-49a3-9df0-46d256d78c9e service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:33.752744 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-0c53a061-4df9-462c-b357-5a21239e5adc req-e150c045-f021-49a3-9df0-46d256d78c9e service nova] Creating event network-changed:a0210474-72a8-4f79-a241-42969b6b4b66 for instance 006771fc-9da9-4b78-9fad-f4b72c311fd5 on n-h2-850499-9 Aug 31 16:05:33.764654 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-0c53a061-4df9-462c-b357-5a21239e5adc req-e150c045-f021-49a3-9df0-46d256d78c9e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096104 Aug 31 16:05:33.767472 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1188/2381] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:05:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:05:33.779743 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d329a81c-898c-4a57-bc2b-2da10e0b172a tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:33.781797 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d329a81c-898c-4a57-bc2b-2da10e0b172a tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] [instance: 560a01e5-93f8-46c8-9261-5030e28766b4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:33.798982 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d329a81c-898c-4a57-bc2b-2da10e0b172a tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:33.800805 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d329a81c-898c-4a57-bc2b-2da10e0b172a tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:33.802393 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d329a81c-898c-4a57-bc2b-2da10e0b172a tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:33.804053 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d329a81c-898c-4a57-bc2b-2da10e0b172a tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:33.805486 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d329a81c-898c-4a57-bc2b-2da10e0b172a tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:33.806994 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d329a81c-898c-4a57-bc2b-2da10e0b172a tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:34.321131 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d329a81c-898c-4a57-bc2b-2da10e0b172a tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f0b27a48fd41dd846ba60856349ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4efd94380dcf4b3cb7a2b9fa194fcb83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:34.340092 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d329a81c-898c-4a57-bc2b-2da10e0b172a tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "GET /compute/v2.1/servers/560a01e5-93f8-46c8-9261-5030e28766b4" status: 200 len: 1318 microversion: 2.1 time: 0.567993 Aug 31 16:05:34.357458 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1189/2382] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:33 2022] GET /compute/v2.1/servers/560a01e5-93f8-46c8-9261-5030e28766b4 => generated 1318 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:34.380726 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-bef8a171-1c7b-434f-aa76-f175fb7f743e tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:34.381917 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-bef8a171-1c7b-434f-aa76-f175fb7f743e tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: cc085aaa-21b2-48a6-b69c-de4e261dfe7f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:34.410291 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bef8a171-1c7b-434f-aa76-f175fb7f743e tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:34.411230 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bef8a171-1c7b-434f-aa76-f175fb7f743e tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:34.412112 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bef8a171-1c7b-434f-aa76-f175fb7f743e tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:34.413416 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bef8a171-1c7b-434f-aa76-f175fb7f743e tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:34.414272 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bef8a171-1c7b-434f-aa76-f175fb7f743e tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:34.415067 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bef8a171-1c7b-434f-aa76-f175fb7f743e tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:34.444595 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-bef8a171-1c7b-434f-aa76-f175fb7f743e tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] HTTP exception thrown: Instance cc085aaa-21b2-48a6-b69c-de4e261dfe7f could not be found. Aug 31 16:05:34.456636 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-bef8a171-1c7b-434f-aa76-f175fb7f743e tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Request method failure captured: Aug 31 16:05:34.456636 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f HTTP/1.1 Aug 31 16:05:34.456636 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:05:34.456636 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:05:34.456636 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:05:34.456636 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:05:34.456636 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:05:34.456636 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:05:34.456636 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:05:34.456636 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:05:34.456636 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4St87glls8nrcJLaszJCTH3u-5gjP_zR_CDcTJmGRy-icHFnPPaQEjN24lPcF68k7cJy-u1N7wTTpAM3QT_rwVgkInJP4vDJQWfb13puTbBaWpSNY7AqOuE9gOwubT4HvKPey49JpgyvzFifvxP5d5LPnrAimWxJ7aL70cmuBZOFis Aug 31 16:05:34.456636 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:05:34.456636 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:05:34.456636 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:05:34.456636 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:05:34.456636 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:05:34.456636 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:05:34.456636 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 150e5f8e376a40e089de8ed092e269fd Aug 31 16:05:34.456636 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-LiveMigrationTest-774357135 Aug 31 16:05:34.456636 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:05:34.456636 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:05:34.456636 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/150e5f8e376a40e089de8ed092e269fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/150e5f8e376a40e089de8ed092e269fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_150e5f8e376a40e089de8ed092e269fd", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/150e5f8e376a40e089de8ed092e269fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:05:34.456636 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-LiveMigrationTest-774357135 Aug 31 16:05:34.456636 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 150e5f8e376a40e089de8ed092e269fd Aug 31 16:05:34.456636 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-LiveMigrationTest-774357135 Aug 31 16:05:34.456636 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-LiveMigrationTest-774357135-project Aug 31 16:05:34.456636 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:05:34.456636 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:05:34.456636 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: de0e032fc09b48ada1dfe99e549aa623 Aug 31 16:05:34.456636 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-LiveMigrationTest-774357135-project Aug 31 16:05:34.456636 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:05:34.456636 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance cc085aaa-21b2-48a6-b69c-de4e261dfe7f could not be found. Aug 31 16:05:34.456636 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': 'cc085aaa-21b2-48a6-b69c-de4e261dfe7f'} Aug 31 16:05:34.456636 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:05:34.456636 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:05:34.456636 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:05:34.456636 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:05:34.456636 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:05:34.456636 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:05:34.456636 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:05:34.456636 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:05:34.456636 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:05:34.456636 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:05:34.456636 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc085aaa-21b2-48a6-b69c-de4e261dfe7f could not be found. Aug 31 16:05:34.456636 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:05:34.456636 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:05:34.456636 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:05:34.456636 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:05:34.456636 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:05:34.456636 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:05:34.456636 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:05:34.456636 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:05:34.456636 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:05:34.456636 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:05:34.456636 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:05:34.456636 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:05:34.456636 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:05:34.456636 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:05:34.456636 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:05:34.456636 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:05:34.456636 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc085aaa-21b2-48a6-b69c-de4e261dfe7f could not be found. Aug 31 16:05:34.456636 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:05:34.456636 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:05:34.456636 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:05:34.467760 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:05:34.467760 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:05:34.467760 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:05:34.467760 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:05:34.467760 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:05:34.467760 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc085aaa-21b2-48a6-b69c-de4e261dfe7f could not be found. Aug 31 16:05:34.467760 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:05:34.467760 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-bef8a171-1c7b-434f-aa76-f175fb7f743e tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Returning 404 to user: Instance cc085aaa-21b2-48a6-b69c-de4e261dfe7f could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:05:34.467760 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-bef8a171-1c7b-434f-aa76-f175fb7f743e tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f" status: 404 len: 111 microversion: 2.1 time: 0.097941 Aug 31 16:05:34.467760 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1190/2383] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:34 2022] GET /compute/v2.1/servers/cc085aaa-21b2-48a6-b69c-de4e261dfe7f => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:05:34.467760 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2f6cc5ff-228d-4eab-8831-aeb6443420d7 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:34.467760 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2f6cc5ff-228d-4eab-8831-aeb6443420d7 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 9e504a13-2fea-4da7-880d-b1782f9c5053] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:34.474523 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2f6cc5ff-228d-4eab-8831-aeb6443420d7 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:34.475202 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2f6cc5ff-228d-4eab-8831-aeb6443420d7 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:34.475809 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2f6cc5ff-228d-4eab-8831-aeb6443420d7 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:34.477210 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2f6cc5ff-228d-4eab-8831-aeb6443420d7 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:34.477940 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2f6cc5ff-228d-4eab-8831-aeb6443420d7 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:34.478565 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2f6cc5ff-228d-4eab-8831-aeb6443420d7 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:34.524060 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2f6cc5ff-228d-4eab-8831-aeb6443420d7 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:34.524575 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2f6cc5ff-228d-4eab-8831-aeb6443420d7 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:34.525028 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2f6cc5ff-228d-4eab-8831-aeb6443420d7 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:34.525500 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-2f6cc5ff-228d-4eab-8831-aeb6443420d7 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lazy-loading 'fault' on Instance uuid 9e504a13-2fea-4da7-880d-b1782f9c5053 {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:05:34.697032 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2f6cc5ff-228d-4eab-8831-aeb6443420d7 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:34.707851 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2f6cc5ff-228d-4eab-8831-aeb6443420d7 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/9e504a13-2fea-4da7-880d-b1782f9c5053" status: 200 len: 1307 microversion: 2.1 time: 0.247286 Aug 31 16:05:34.723535 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1191/2384] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:34 2022] GET /compute/v2.1/servers/9e504a13-2fea-4da7-880d-b1782f9c5053 => generated 1307 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:34.723535 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4dca0bab-8aa2-428c-95a5-19e9561fe8b7 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:34.723535 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4dca0bab-8aa2-428c-95a5-19e9561fe8b7 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] [instance: 1f11f86d-3387-4c6e-9099-fc8d232b11a8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:34.725175 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4dca0bab-8aa2-428c-95a5-19e9561fe8b7 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:34.725560 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4dca0bab-8aa2-428c-95a5-19e9561fe8b7 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:34.726121 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4dca0bab-8aa2-428c-95a5-19e9561fe8b7 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:34.727156 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4dca0bab-8aa2-428c-95a5-19e9561fe8b7 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:34.727759 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4dca0bab-8aa2-428c-95a5-19e9561fe8b7 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:34.728565 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4dca0bab-8aa2-428c-95a5-19e9561fe8b7 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:35.371945 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-4dca0bab-8aa2-428c-95a5-19e9561fe8b7 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a837ababe7cb4284b96bc16deb40d2d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e9999df7e14609b1265351c83607bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:35.382860 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4dca0bab-8aa2-428c-95a5-19e9561fe8b7 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] 10.222.0.61 "GET /compute/v2.1/servers/1f11f86d-3387-4c6e-9099-fc8d232b11a8" status: 200 len: 1395 microversion: 2.1 time: 0.672485 Aug 31 16:05:35.383721 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1192/2385] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:34 2022] GET /compute/v2.1/servers/1f11f86d-3387-4c6e-9099-fc8d232b11a8 => generated 1395 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:35.402527 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6b9998f7-9abb-489a-9d72-4d12b3d09f58 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:35.403819 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6b9998f7-9abb-489a-9d72-4d12b3d09f58 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 1262191c-be8b-4535-8704-72db13e3f6cc] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:35.411374 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6b9998f7-9abb-489a-9d72-4d12b3d09f58 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:35.412775 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6b9998f7-9abb-489a-9d72-4d12b3d09f58 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:35.413341 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6b9998f7-9abb-489a-9d72-4d12b3d09f58 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:35.414541 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6b9998f7-9abb-489a-9d72-4d12b3d09f58 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:35.415302 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6b9998f7-9abb-489a-9d72-4d12b3d09f58 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:35.416582 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6b9998f7-9abb-489a-9d72-4d12b3d09f58 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:35.713893 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-6b9998f7-9abb-489a-9d72-4d12b3d09f58 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:35.729111 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6b9998f7-9abb-489a-9d72-4d12b3d09f58 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/1262191c-be8b-4535-8704-72db13e3f6cc" status: 200 len: 1314 microversion: 2.1 time: 0.330194 Aug 31 16:05:35.736588 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1193/2386] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:35 2022] GET /compute/v2.1/servers/1262191c-be8b-4535-8704-72db13e3f6cc => generated 1314 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:35.741809 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-5f470c85-4df1-46df-90a5-eb76b412ab1d req-a1d94f7c-2d25-4ebd-98cf-c69d04edd9aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e504a13-2fea-4da7-880d-b1782f9c5053", "name": "network-vif-unplugged", "status": "completed", "tag": "826d1d70-21bd-4629-a5dc-f0d355e78b2b"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:05:35.760367 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-5f470c85-4df1-46df-90a5-eb76b412ab1d req-a1d94f7c-2d25-4ebd-98cf-c69d04edd9aa service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:35.760367 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-5f470c85-4df1-46df-90a5-eb76b412ab1d req-a1d94f7c-2d25-4ebd-98cf-c69d04edd9aa service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:35.760891 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-5f470c85-4df1-46df-90a5-eb76b412ab1d req-a1d94f7c-2d25-4ebd-98cf-c69d04edd9aa service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:35.768573 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:05:35.788734 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-5f470c85-4df1-46df-90a5-eb76b412ab1d req-a1d94f7c-2d25-4ebd-98cf-c69d04edd9aa service nova] Creating event network-vif-unplugged:826d1d70-21bd-4629-a5dc-f0d355e78b2b for instance 9e504a13-2fea-4da7-880d-b1782f9c5053 on n-h1-850499-9 Aug 31 16:05:35.796487 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-5f470c85-4df1-46df-90a5-eb76b412ab1d req-a1d94f7c-2d25-4ebd-98cf-c69d04edd9aa service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058038 Aug 31 16:05:35.797781 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1194/2387] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:05:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:05:35.805491 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9597a3c7-5b25-452f-932b-61a52b4cd0f9 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:35.806678 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9597a3c7-5b25-452f-932b-61a52b4cd0f9 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 006771fc-9da9-4b78-9fad-f4b72c311fd5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:35.817850 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9597a3c7-5b25-452f-932b-61a52b4cd0f9 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:35.818698 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9597a3c7-5b25-452f-932b-61a52b4cd0f9 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:35.819431 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9597a3c7-5b25-452f-932b-61a52b4cd0f9 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:35.820671 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9597a3c7-5b25-452f-932b-61a52b4cd0f9 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:35.821454 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9597a3c7-5b25-452f-932b-61a52b4cd0f9 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:35.822216 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9597a3c7-5b25-452f-932b-61a52b4cd0f9 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:36.228518 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9597a3c7-5b25-452f-932b-61a52b4cd0f9 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:36.241142 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9597a3c7-5b25-452f-932b-61a52b4cd0f9 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:36.242656 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9597a3c7-5b25-452f-932b-61a52b4cd0f9 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:36.243922 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9597a3c7-5b25-452f-932b-61a52b4cd0f9 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5" status: 200 len: 1487 microversion: 2.25 time: 0.444879 Aug 31 16:05:36.244690 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1195/2388] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:05:35 2022] GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5 => generated 1487 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:05:36.249735 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f6a8941b-5b5d-4ad8-9641-e83995766fcb tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '.version_select at 0x7f5ae8d123a0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:36.293748 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f6a8941b-5b5d-4ad8-9641-e83995766fcb tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1523154201" status: 202 len: 0 microversion: 2.1 time: 0.047508 Aug 31 16:05:36.294426 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1196/2389] 10.222.0.61 () {58 vars in 1221 bytes} [Wed Aug 31 16:05:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1523154201 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:05:36.299951 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-946692d6-a477-4159-814a-bee508d6eb7b tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:36.300896 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-946692d6-a477-4159-814a-bee508d6eb7b tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: f9b66475-83f6-49a3-bc63-8965fc1aec14] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:36.310269 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-946692d6-a477-4159-814a-bee508d6eb7b tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:36.310781 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-946692d6-a477-4159-814a-bee508d6eb7b tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:36.311231 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-946692d6-a477-4159-814a-bee508d6eb7b tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:36.311988 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-946692d6-a477-4159-814a-bee508d6eb7b tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:36.312457 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-946692d6-a477-4159-814a-bee508d6eb7b tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:36.313002 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-946692d6-a477-4159-814a-bee508d6eb7b tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:36.362752 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=61 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:05:36.653883 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-946692d6-a477-4159-814a-bee508d6eb7b tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:36.672103 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-946692d6-a477-4159-814a-bee508d6eb7b tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/f9b66475-83f6-49a3-bc63-8965fc1aec14" status: 200 len: 1472 microversion: 2.1 time: 0.375965 Aug 31 16:05:36.673495 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1197/2390] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:36 2022] GET /compute/v2.1/servers/f9b66475-83f6-49a3-bc63-8965fc1aec14 => generated 1472 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:36.695164 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2e4a0825-320e-4b64-8618-ee564fde6ffa tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:36.696711 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2e4a0825-320e-4b64-8618-ee564fde6ffa tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] [instance: 560a01e5-93f8-46c8-9261-5030e28766b4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:36.710088 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2e4a0825-320e-4b64-8618-ee564fde6ffa tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:36.711382 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2e4a0825-320e-4b64-8618-ee564fde6ffa tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:36.712894 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2e4a0825-320e-4b64-8618-ee564fde6ffa tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:36.713994 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2e4a0825-320e-4b64-8618-ee564fde6ffa tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:36.714836 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2e4a0825-320e-4b64-8618-ee564fde6ffa tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:36.715611 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2e4a0825-320e-4b64-8618-ee564fde6ffa tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:36.895024 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-39a7e80c-aeef-4317-9a49-161085333e13 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:05:36.896805 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-39a7e80c-aeef-4317-9a49-161085333e13 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:05:36.900073 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-39a7e80c-aeef-4317-9a49-161085333e13 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:05:36.901212 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-39a7e80c-aeef-4317-9a49-161085333e13 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:05:36.904800 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-39a7e80c-aeef-4317-9a49-161085333e13 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:05:36.908271 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:05:36.927184 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-39a7e80c-aeef-4317-9a49-161085333e13 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:36.927723 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-39a7e80c-aeef-4317-9a49-161085333e13 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:36.928425 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-39a7e80c-aeef-4317-9a49-161085333e13 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:36.929543 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-39a7e80c-aeef-4317-9a49-161085333e13 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:36.930110 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-39a7e80c-aeef-4317-9a49-161085333e13 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:36.931011 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-39a7e80c-aeef-4317-9a49-161085333e13 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:36.984242 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2e4a0825-320e-4b64-8618-ee564fde6ffa tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f0b27a48fd41dd846ba60856349ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4efd94380dcf4b3cb7a2b9fa194fcb83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:36.990194 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-39a7e80c-aeef-4317-9a49-161085333e13 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Getting quotas for project de3a6577c7c34e8e928dfc1a4172f51c. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:05:36.997254 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-39a7e80c-aeef-4317-9a49-161085333e13 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Getting quotas for user ccb8cf5661d641bca73aa56cb8cc334c and project de3a6577c7c34e8e928dfc1a4172f51c. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:05:36.997790 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2e4a0825-320e-4b64-8618-ee564fde6ffa tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "GET /compute/v2.1/servers/560a01e5-93f8-46c8-9261-5030e28766b4" status: 200 len: 1318 microversion: 2.1 time: 0.309189 Aug 31 16:05:36.998476 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1198/2391] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:36 2022] GET /compute/v2.1/servers/560a01e5-93f8-46c8-9261-5030e28766b4 => generated 1318 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:37.003560 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3bc32020-8f40-4e7a-9c8d-2f8945a69cd1 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:37.004532 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3bc32020-8f40-4e7a-9c8d-2f8945a69cd1 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 9e504a13-2fea-4da7-880d-b1782f9c5053] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:37.012011 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3bc32020-8f40-4e7a-9c8d-2f8945a69cd1 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:37.013113 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3bc32020-8f40-4e7a-9c8d-2f8945a69cd1 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:37.013788 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3bc32020-8f40-4e7a-9c8d-2f8945a69cd1 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:37.014754 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3bc32020-8f40-4e7a-9c8d-2f8945a69cd1 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:37.015435 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3bc32020-8f40-4e7a-9c8d-2f8945a69cd1 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:37.016120 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3bc32020-8f40-4e7a-9c8d-2f8945a69cd1 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:37.036518 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-3bc32020-8f40-4e7a-9c8d-2f8945a69cd1 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] HTTP exception thrown: Instance 9e504a13-2fea-4da7-880d-b1782f9c5053 could not be found. Aug 31 16:05:37.038417 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3bc32020-8f40-4e7a-9c8d-2f8945a69cd1 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Request method failure captured: Aug 31 16:05:37.038417 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/9e504a13-2fea-4da7-880d-b1782f9c5053 HTTP/1.1 Aug 31 16:05:37.038417 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:05:37.038417 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:05:37.038417 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:05:37.038417 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:05:37.038417 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:05:37.038417 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:05:37.038417 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:05:37.038417 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:05:37.038417 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4XtNmkvMwnHSL7qhg4V3Wdw6j3Xq_Y_rjXmT_SLe0FMvGo1gt1LwtP8iZQqS4u70Er7TOj14npyXUlDGoqy-1fk7VS9f_3ajnUzSZB5vWqF2Pe5k8siWL_JGtE8zCZBhN_wgL3NLoqpJfp9eoMAktgpjf2nAX9ECp3Cc5bDcIxyAw0 Aug 31 16:05:37.038417 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:05:37.038417 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:05:37.038417 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:05:37.038417 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:05:37.038417 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:05:37.038417 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:05:37.038417 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 7fa2effd15e440598752264e49d2457d Aug 31 16:05:37.038417 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ServersOnMultiNodesTest-1308696187 Aug 31 16:05:37.038417 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:05:37.038417 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:05:37.038417 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7fa2effd15e440598752264e49d2457d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7fa2effd15e440598752264e49d2457d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7fa2effd15e440598752264e49d2457d", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7fa2effd15e440598752264e49d2457d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:05:37.038417 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ServersOnMultiNodesTest-1308696187 Aug 31 16:05:37.038417 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 7fa2effd15e440598752264e49d2457d Aug 31 16:05:37.038417 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1308696187 Aug 31 16:05:37.038417 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ServersOnMultiNodesTest-1308696187-project Aug 31 16:05:37.038417 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:05:37.038417 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:05:37.038417 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 547d88df13034daaad50c3582c7cc3b3 Aug 31 16:05:37.038417 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ServersOnMultiNodesTest-1308696187-project Aug 31 16:05:37.038417 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:05:37.038417 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance 9e504a13-2fea-4da7-880d-b1782f9c5053 could not be found. Aug 31 16:05:37.038417 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '9e504a13-2fea-4da7-880d-b1782f9c5053'} Aug 31 16:05:37.038417 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:05:37.038417 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:05:37.038417 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:05:37.038417 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:05:37.038417 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:05:37.038417 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:05:37.038417 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:05:37.038417 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:05:37.038417 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:05:37.038417 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:05:37.038417 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e504a13-2fea-4da7-880d-b1782f9c5053 could not be found. Aug 31 16:05:37.038417 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:05:37.038417 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:05:37.038417 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:05:37.038417 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:05:37.038417 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:05:37.038417 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:05:37.038417 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:05:37.038417 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:05:37.038417 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:05:37.038417 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:05:37.038417 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:05:37.038417 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:05:37.038417 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:05:37.038417 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:05:37.038417 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:05:37.038417 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:05:37.038417 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e504a13-2fea-4da7-880d-b1782f9c5053 could not be found. Aug 31 16:05:37.038417 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:05:37.038417 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:05:37.038417 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:05:37.048647 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:05:37.048647 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:05:37.048647 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:05:37.048647 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:05:37.048647 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:05:37.048647 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e504a13-2fea-4da7-880d-b1782f9c5053 could not be found. Aug 31 16:05:37.048647 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:05:37.048647 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3bc32020-8f40-4e7a-9c8d-2f8945a69cd1 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Returning 404 to user: Instance 9e504a13-2fea-4da7-880d-b1782f9c5053 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:05:37.048647 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3bc32020-8f40-4e7a-9c8d-2f8945a69cd1 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/9e504a13-2fea-4da7-880d-b1782f9c5053" status: 404 len: 111 microversion: 2.1 time: 0.041629 Aug 31 16:05:37.048647 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1199/2392] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:36 2022] GET /compute/v2.1/servers/9e504a13-2fea-4da7-880d-b1782f9c5053 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:05:37.056170 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-023ee54e-232f-41d9-8f0e-d1a26b27cf32 req-f2a6aa0e-b735-4e1f-a24e-cbcc6c23c6d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f11f86d-3387-4c6e-9099-fc8d232b11a8", "tag": "63593e47-213f-4d04-ae59-a652fc80fcbd"}, {"name": "network-changed", "server_uuid": "1262191c-be8b-4535-8704-72db13e3f6cc", "tag": "583b8caf-b274-433c-9305-a71044fdd417"}, {"server_uuid": "cc085aaa-21b2-48a6-b69c-de4e261dfe7f", "name": "network-vif-deleted", "tag": "c4a89a46-30ca-4df0-bd23-f2ae8050bb54"}, {"server_uuid": "f9b66475-83f6-49a3-bc63-8965fc1aec14", "name": "network-vif-unplugged", "status": "completed", "tag": "c1929c28-a0f2-4fed-aba4-ecfd08ac8e7e"}, {"name": "network-changed", "server_uuid": "560a01e5-93f8-46c8-9261-5030e28766b4", "tag": "f7a3259e-6ecb-48c9-a90a-0b0d027258f4"}, {"server_uuid": "9e504a13-2fea-4da7-880d-b1782f9c5053", "name": "network-vif-deleted", "tag": "826d1d70-21bd-4629-a5dc-f0d355e78b2b"}, {"name": "network-changed", "server_uuid": "f9b66475-83f6-49a3-bc63-8965fc1aec14", "tag": "c1929c28-a0f2-4fed-aba4-ecfd08ac8e7e"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:05:37.090899 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-023ee54e-232f-41d9-8f0e-d1a26b27cf32 req-f2a6aa0e-b735-4e1f-a24e-cbcc6c23c6d0 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:37.092030 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-023ee54e-232f-41d9-8f0e-d1a26b27cf32 req-f2a6aa0e-b735-4e1f-a24e-cbcc6c23c6d0 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:37.093084 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-023ee54e-232f-41d9-8f0e-d1a26b27cf32 req-f2a6aa0e-b735-4e1f-a24e-cbcc6c23c6d0 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:37.117997 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-023ee54e-232f-41d9-8f0e-d1a26b27cf32 req-f2a6aa0e-b735-4e1f-a24e-cbcc6c23c6d0 service nova] Creating event network-changed:63593e47-213f-4d04-ae59-a652fc80fcbd for instance 1f11f86d-3387-4c6e-9099-fc8d232b11a8 on n-h2-850499-9 Aug 31 16:05:37.118589 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-023ee54e-232f-41d9-8f0e-d1a26b27cf32 req-f2a6aa0e-b735-4e1f-a24e-cbcc6c23c6d0 service nova] Creating event network-changed:583b8caf-b274-433c-9305-a71044fdd417 for instance 1262191c-be8b-4535-8704-72db13e3f6cc on n-h2-850499-9 Aug 31 16:05:37.119097 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-023ee54e-232f-41d9-8f0e-d1a26b27cf32 req-f2a6aa0e-b735-4e1f-a24e-cbcc6c23c6d0 service nova] Creating event network-vif-deleted:c4a89a46-30ca-4df0-bd23-f2ae8050bb54 for instance cc085aaa-21b2-48a6-b69c-de4e261dfe7f on n-h2-850499-9 Aug 31 16:05:37.119832 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-023ee54e-232f-41d9-8f0e-d1a26b27cf32 req-f2a6aa0e-b735-4e1f-a24e-cbcc6c23c6d0 service nova] Creating event network-vif-unplugged:c1929c28-a0f2-4fed-aba4-ecfd08ac8e7e for instance f9b66475-83f6-49a3-bc63-8965fc1aec14 on n-h1-850499-9 Aug 31 16:05:37.120481 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-023ee54e-232f-41d9-8f0e-d1a26b27cf32 req-f2a6aa0e-b735-4e1f-a24e-cbcc6c23c6d0 service nova] Creating event network-changed:f7a3259e-6ecb-48c9-a90a-0b0d027258f4 for instance 560a01e5-93f8-46c8-9261-5030e28766b4 on n-h2-850499-9 Aug 31 16:05:37.121129 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-023ee54e-232f-41d9-8f0e-d1a26b27cf32 req-f2a6aa0e-b735-4e1f-a24e-cbcc6c23c6d0 service nova] Creating event network-vif-deleted:826d1d70-21bd-4629-a5dc-f0d355e78b2b for instance 9e504a13-2fea-4da7-880d-b1782f9c5053 on n-h1-850499-9 Aug 31 16:05:37.121964 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-023ee54e-232f-41d9-8f0e-d1a26b27cf32 req-f2a6aa0e-b735-4e1f-a24e-cbcc6c23c6d0 service nova] Creating event network-changed:c1929c28-a0f2-4fed-aba4-ecfd08ac8e7e for instance f9b66475-83f6-49a3-bc63-8965fc1aec14 on n-h1-850499-9 Aug 31 16:05:37.140049 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [req-023ee54e-232f-41d9-8f0e-d1a26b27cf32 req-f2a6aa0e-b735-4e1f-a24e-cbcc6c23c6d0 service nova] Instance f9b66475-83f6-49a3-bc63-8965fc1aec14 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850499-9', 'n-h2-850499-9'} {{(pid=122257) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 31 16:05:37.177719 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-023ee54e-232f-41d9-8f0e-d1a26b27cf32 req-f2a6aa0e-b735-4e1f-a24e-cbcc6c23c6d0 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1195 microversion: 2.1 time: 0.131036 Aug 31 16:05:37.178642 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1200/2393] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:05:37 2022] POST /compute/v2.1/os-server-external-events => generated 1195 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:37.189092 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f6de4410-bdcf-4a2e-8f9c-723ea51a6158 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:37.191074 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f6de4410-bdcf-4a2e-8f9c-723ea51a6158 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] [instance: 1f11f86d-3387-4c6e-9099-fc8d232b11a8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:37.209544 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f6de4410-bdcf-4a2e-8f9c-723ea51a6158 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:37.210229 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f6de4410-bdcf-4a2e-8f9c-723ea51a6158 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:37.210805 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f6de4410-bdcf-4a2e-8f9c-723ea51a6158 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:37.212152 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f6de4410-bdcf-4a2e-8f9c-723ea51a6158 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:37.212962 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f6de4410-bdcf-4a2e-8f9c-723ea51a6158 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:37.213701 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f6de4410-bdcf-4a2e-8f9c-723ea51a6158 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:37.291679 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-39a7e80c-aeef-4317-9a49-161085333e13 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Going to run 1 instances... {{(pid=122256) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:05:37.298081 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-39a7e80c-aeef-4317-9a49-161085333e13 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] [instance: 685d47e4-721e-4eae-b5f8-78fdb68454ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='c53d8837-dbcf-412d-b3bf-f3c658f34748',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='c8af26cd-3050-42e1-b138-a161d997df4a',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2ed3e3f7-03c9-4b56-8d95-6fcc7191cd3d',volume_size=None,volume_type=None)] {{(pid=122256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:05:37.436920 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f6de4410-bdcf-4a2e-8f9c-723ea51a6158 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a837ababe7cb4284b96bc16deb40d2d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e9999df7e14609b1265351c83607bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:37.453134 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f6de4410-bdcf-4a2e-8f9c-723ea51a6158 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] 10.222.0.61 "GET /compute/v2.1/servers/1f11f86d-3387-4c6e-9099-fc8d232b11a8" status: 200 len: 1395 microversion: 2.1 time: 0.272264 Aug 31 16:05:37.454523 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1201/2394] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:37 2022] GET /compute/v2.1/servers/1f11f86d-3387-4c6e-9099-fc8d232b11a8 => generated 1395 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:37.463896 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1d32a082-421e-4659-bc58-a6f760a6b29b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:37.465657 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1d32a082-421e-4659-bc58-a6f760a6b29b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 1262191c-be8b-4535-8704-72db13e3f6cc] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:37.473876 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1d32a082-421e-4659-bc58-a6f760a6b29b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:37.474416 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1d32a082-421e-4659-bc58-a6f760a6b29b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:37.474827 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1d32a082-421e-4659-bc58-a6f760a6b29b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:37.475630 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1d32a082-421e-4659-bc58-a6f760a6b29b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:37.476232 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1d32a082-421e-4659-bc58-a6f760a6b29b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:37.476538 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1d32a082-421e-4659-bc58-a6f760a6b29b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:37.662988 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-1d32a082-421e-4659-bc58-a6f760a6b29b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:37.673965 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1d32a082-421e-4659-bc58-a6f760a6b29b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/1262191c-be8b-4535-8704-72db13e3f6cc" status: 200 len: 1314 microversion: 2.1 time: 0.217867 Aug 31 16:05:37.674936 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1202/2395] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:37 2022] GET /compute/v2.1/servers/1262191c-be8b-4535-8704-72db13e3f6cc => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:37.682605 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8ce2022d-44d8-4e44-94c9-60b8a32061ff tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:37.684004 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8ce2022d-44d8-4e44-94c9-60b8a32061ff tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 9d6a4c52-02e5-491b-ac04-917b710c332c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:37.692583 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8ce2022d-44d8-4e44-94c9-60b8a32061ff tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:37.693232 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8ce2022d-44d8-4e44-94c9-60b8a32061ff tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:37.693763 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8ce2022d-44d8-4e44-94c9-60b8a32061ff tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:37.694602 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8ce2022d-44d8-4e44-94c9-60b8a32061ff tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:37.695287 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8ce2022d-44d8-4e44-94c9-60b8a32061ff tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:37.695897 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8ce2022d-44d8-4e44-94c9-60b8a32061ff tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:37.736174 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8ce2022d-44d8-4e44-94c9-60b8a32061ff tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 9d6a4c52-02e5-491b-ac04-917b710c332c] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:05:37.786181 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-39a7e80c-aeef-4317-9a49-161085333e13 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.42 time: 11.416856 Aug 31 16:05:37.787239 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1194/2396] 10.222.0.61 () {62 vars in 1189 bytes} [Wed Aug 31 16:05:26 2022] POST /compute/v2.1/servers => generated 405 bytes in 11418 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 31 16:05:37.792142 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2baed06e-a60d-4d95-9bde-85ec90bf03c9 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:37.793147 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2baed06e-a60d-4d95-9bde-85ec90bf03c9 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 006771fc-9da9-4b78-9fad-f4b72c311fd5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:37.800869 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2baed06e-a60d-4d95-9bde-85ec90bf03c9 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:37.801471 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2baed06e-a60d-4d95-9bde-85ec90bf03c9 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:37.801989 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2baed06e-a60d-4d95-9bde-85ec90bf03c9 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:37.802833 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2baed06e-a60d-4d95-9bde-85ec90bf03c9 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:37.803366 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2baed06e-a60d-4d95-9bde-85ec90bf03c9 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:37.804665 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2baed06e-a60d-4d95-9bde-85ec90bf03c9 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:37.897399 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8ce2022d-44d8-4e44-94c9-60b8a32061ff tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "DELETE /compute/v2.1/servers/9d6a4c52-02e5-491b-ac04-917b710c332c" status: 204 len: 0 microversion: 2.1 time: 0.219600 Aug 31 16:05:37.905689 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1203/2397] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:05:37 2022] DELETE /compute/v2.1/servers/9d6a4c52-02e5-491b-ac04-917b710c332c => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:05:37.914711 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3a4c17a4-b47c-40eb-87c5-b73d49275834 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:37.915249 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3a4c17a4-b47c-40eb-87c5-b73d49275834 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: 2ddb0b07-9e31-403c-91d5-a278d632d754] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:37.929880 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3a4c17a4-b47c-40eb-87c5-b73d49275834 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:37.930615 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3a4c17a4-b47c-40eb-87c5-b73d49275834 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:37.931765 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3a4c17a4-b47c-40eb-87c5-b73d49275834 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:37.934522 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3a4c17a4-b47c-40eb-87c5-b73d49275834 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:37.935812 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3a4c17a4-b47c-40eb-87c5-b73d49275834 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:37.937166 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3a4c17a4-b47c-40eb-87c5-b73d49275834 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:38.003809 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3a4c17a4-b47c-40eb-87c5-b73d49275834 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: 2ddb0b07-9e31-403c-91d5-a278d632d754] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:05:38.079187 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-2baed06e-a60d-4d95-9bde-85ec90bf03c9 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:38.114016 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-2baed06e-a60d-4d95-9bde-85ec90bf03c9 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:38.116436 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-2baed06e-a60d-4d95-9bde-85ec90bf03c9 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:38.118513 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2baed06e-a60d-4d95-9bde-85ec90bf03c9 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5" status: 200 len: 1487 microversion: 2.25 time: 0.329922 Aug 31 16:05:38.124485 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1195/2398] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:05:37 2022] GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5 => generated 1487 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:05:38.148592 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-12b59e5f-285b-49c2-bb18-0a4e4248846f tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:38.154714 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3a4c17a4-b47c-40eb-87c5-b73d49275834 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "DELETE /compute/v2.1/servers/2ddb0b07-9e31-403c-91d5-a278d632d754" status: 204 len: 0 microversion: 2.1 time: 0.245890 Aug 31 16:05:38.155002 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-12b59e5f-285b-49c2-bb18-0a4e4248846f tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: f9b66475-83f6-49a3-bc63-8965fc1aec14] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:38.157080 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1204/2399] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:05:37 2022] DELETE /compute/v2.1/servers/2ddb0b07-9e31-403c-91d5-a278d632d754 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:05:38.167301 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-86bfe8b3-37e8-407a-b9d2-59e8752c9580 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:38.168992 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-86bfe8b3-37e8-407a-b9d2-59e8752c9580 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] [instance: 685d47e4-721e-4eae-b5f8-78fdb68454ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:38.177067 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-12b59e5f-285b-49c2-bb18-0a4e4248846f tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:38.178386 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-12b59e5f-285b-49c2-bb18-0a4e4248846f tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:38.179251 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-12b59e5f-285b-49c2-bb18-0a4e4248846f tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:38.180562 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-12b59e5f-285b-49c2-bb18-0a4e4248846f tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:38.181367 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-12b59e5f-285b-49c2-bb18-0a4e4248846f tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:38.182322 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-12b59e5f-285b-49c2-bb18-0a4e4248846f tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:38.282185 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-86bfe8b3-37e8-407a-b9d2-59e8752c9580 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:38.295754 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-86bfe8b3-37e8-407a-b9d2-59e8752c9580 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:38.298675 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-86bfe8b3-37e8-407a-b9d2-59e8752c9580 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:38.300923 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-86bfe8b3-37e8-407a-b9d2-59e8752c9580 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] 10.222.0.61 "GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae" status: 200 len: 1286 microversion: 2.42 time: 0.141540 Aug 31 16:05:38.302407 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1205/2400] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:05:38 2022] GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae => generated 1286 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:05:38.310196 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-fd86bcf1-719f-4d83-8281-bdb33f39cce5 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:38.311335 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-fd86bcf1-719f-4d83-8281-bdb33f39cce5 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 9d6a4c52-02e5-491b-ac04-917b710c332c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:38.321780 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fd86bcf1-719f-4d83-8281-bdb33f39cce5 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:38.322630 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fd86bcf1-719f-4d83-8281-bdb33f39cce5 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:38.324021 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fd86bcf1-719f-4d83-8281-bdb33f39cce5 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:38.325243 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fd86bcf1-719f-4d83-8281-bdb33f39cce5 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:38.326015 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fd86bcf1-719f-4d83-8281-bdb33f39cce5 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:38.326832 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fd86bcf1-719f-4d83-8281-bdb33f39cce5 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:38.435460 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-12b59e5f-285b-49c2-bb18-0a4e4248846f tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:38.446051 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-12b59e5f-285b-49c2-bb18-0a4e4248846f tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/f9b66475-83f6-49a3-bc63-8965fc1aec14" status: 200 len: 1472 microversion: 2.1 time: 0.318910 Aug 31 16:05:38.455932 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1196/2401] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:38 2022] GET /compute/v2.1/servers/f9b66475-83f6-49a3-bc63-8965fc1aec14 => generated 1472 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:38.461415 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f5eb4e1a-acf3-41e6-b83a-d31526373e17 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:38.462546 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f5eb4e1a-acf3-41e6-b83a-d31526373e17 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] [instance: 560a01e5-93f8-46c8-9261-5030e28766b4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:38.471733 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f5eb4e1a-acf3-41e6-b83a-d31526373e17 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:38.472277 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f5eb4e1a-acf3-41e6-b83a-d31526373e17 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:38.472735 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f5eb4e1a-acf3-41e6-b83a-d31526373e17 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:38.473465 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f5eb4e1a-acf3-41e6-b83a-d31526373e17 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:38.474003 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f5eb4e1a-acf3-41e6-b83a-d31526373e17 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:38.474564 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f5eb4e1a-acf3-41e6-b83a-d31526373e17 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:38.600338 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-fd86bcf1-719f-4d83-8281-bdb33f39cce5 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:38.625190 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-fd86bcf1-719f-4d83-8281-bdb33f39cce5 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/9d6a4c52-02e5-491b-ac04-917b710c332c" status: 200 len: 1473 microversion: 2.1 time: 0.321009 Aug 31 16:05:38.626757 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1206/2402] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:38 2022] GET /compute/v2.1/servers/9d6a4c52-02e5-491b-ac04-917b710c332c => generated 1473 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:38.637221 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5b94ad30-2377-40c5-a195-cc4bbb75de26 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:38.638875 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5b94ad30-2377-40c5-a195-cc4bbb75de26 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: 2ddb0b07-9e31-403c-91d5-a278d632d754] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:38.651439 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b94ad30-2377-40c5-a195-cc4bbb75de26 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:38.653505 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b94ad30-2377-40c5-a195-cc4bbb75de26 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:38.654407 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b94ad30-2377-40c5-a195-cc4bbb75de26 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:38.656088 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b94ad30-2377-40c5-a195-cc4bbb75de26 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:38.657298 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b94ad30-2377-40c5-a195-cc4bbb75de26 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:38.658384 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b94ad30-2377-40c5-a195-cc4bbb75de26 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:38.706080 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f5eb4e1a-acf3-41e6-b83a-d31526373e17 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f0b27a48fd41dd846ba60856349ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4efd94380dcf4b3cb7a2b9fa194fcb83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:38.714876 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f5eb4e1a-acf3-41e6-b83a-d31526373e17 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "GET /compute/v2.1/servers/560a01e5-93f8-46c8-9261-5030e28766b4" status: 200 len: 1318 microversion: 2.1 time: 0.257150 Aug 31 16:05:38.716008 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1197/2403] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:38 2022] GET /compute/v2.1/servers/560a01e5-93f8-46c8-9261-5030e28766b4 => generated 1318 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:38.741503 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5efb2fda-9006-48b3-b8ef-8cf5d01e1f8c tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:38.744197 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5efb2fda-9006-48b3-b8ef-8cf5d01e1f8c tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] [instance: 1f11f86d-3387-4c6e-9099-fc8d232b11a8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:38.760772 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5efb2fda-9006-48b3-b8ef-8cf5d01e1f8c tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:38.764241 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5efb2fda-9006-48b3-b8ef-8cf5d01e1f8c tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:38.765469 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5efb2fda-9006-48b3-b8ef-8cf5d01e1f8c tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:38.767063 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5efb2fda-9006-48b3-b8ef-8cf5d01e1f8c tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:38.768252 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5efb2fda-9006-48b3-b8ef-8cf5d01e1f8c tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:38.769560 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5efb2fda-9006-48b3-b8ef-8cf5d01e1f8c tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:38.956961 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5b94ad30-2377-40c5-a195-cc4bbb75de26 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:38.968966 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5b94ad30-2377-40c5-a195-cc4bbb75de26 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/2ddb0b07-9e31-403c-91d5-a278d632d754" status: 200 len: 1484 microversion: 2.1 time: 0.340249 Aug 31 16:05:38.969648 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1207/2404] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:38 2022] GET /compute/v2.1/servers/2ddb0b07-9e31-403c-91d5-a278d632d754 => generated 1484 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:38.974715 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-fed3003d-95f7-4199-95f1-c944a8a55ae0 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:38.975605 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-fed3003d-95f7-4199-95f1-c944a8a55ae0 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 1262191c-be8b-4535-8704-72db13e3f6cc] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:38.986138 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fed3003d-95f7-4199-95f1-c944a8a55ae0 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:38.986901 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fed3003d-95f7-4199-95f1-c944a8a55ae0 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:38.987517 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fed3003d-95f7-4199-95f1-c944a8a55ae0 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:38.988403 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fed3003d-95f7-4199-95f1-c944a8a55ae0 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:38.989042 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fed3003d-95f7-4199-95f1-c944a8a55ae0 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:38.989623 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fed3003d-95f7-4199-95f1-c944a8a55ae0 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:39.014457 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5efb2fda-9006-48b3-b8ef-8cf5d01e1f8c tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a837ababe7cb4284b96bc16deb40d2d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e9999df7e14609b1265351c83607bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:39.029050 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5efb2fda-9006-48b3-b8ef-8cf5d01e1f8c tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] 10.222.0.61 "GET /compute/v2.1/servers/1f11f86d-3387-4c6e-9099-fc8d232b11a8" status: 200 len: 1395 microversion: 2.1 time: 0.311618 Aug 31 16:05:39.029963 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1198/2405] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:38 2022] GET /compute/v2.1/servers/1f11f86d-3387-4c6e-9099-fc8d232b11a8 => generated 1395 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:39.169756 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0f7eca83-6122-48bf-aa89-6abb31e16b74 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:39.170781 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0f7eca83-6122-48bf-aa89-6abb31e16b74 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 006771fc-9da9-4b78-9fad-f4b72c311fd5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:39.184713 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0f7eca83-6122-48bf-aa89-6abb31e16b74 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:39.185733 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0f7eca83-6122-48bf-aa89-6abb31e16b74 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:39.186240 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0f7eca83-6122-48bf-aa89-6abb31e16b74 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:39.186996 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0f7eca83-6122-48bf-aa89-6abb31e16b74 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:39.187694 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0f7eca83-6122-48bf-aa89-6abb31e16b74 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:39.188209 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0f7eca83-6122-48bf-aa89-6abb31e16b74 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:39.655944 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-fed3003d-95f7-4199-95f1-c944a8a55ae0 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:39.673716 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-fed3003d-95f7-4199-95f1-c944a8a55ae0 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/1262191c-be8b-4535-8704-72db13e3f6cc" status: 200 len: 1314 microversion: 2.1 time: 0.701869 Aug 31 16:05:39.674893 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1208/2406] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:38 2022] GET /compute/v2.1/servers/1262191c-be8b-4535-8704-72db13e3f6cc => generated 1314 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:39.688988 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0c5e74ea-8ddc-4d3e-9320-a73f9c726875 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:39.691351 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0c5e74ea-8ddc-4d3e-9320-a73f9c726875 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] [instance: 685d47e4-721e-4eae-b5f8-78fdb68454ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:39.705575 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0c5e74ea-8ddc-4d3e-9320-a73f9c726875 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:39.706230 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0c5e74ea-8ddc-4d3e-9320-a73f9c726875 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:39.706754 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0c5e74ea-8ddc-4d3e-9320-a73f9c726875 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:39.707663 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0c5e74ea-8ddc-4d3e-9320-a73f9c726875 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:39.708317 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0c5e74ea-8ddc-4d3e-9320-a73f9c726875 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:39.708872 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0c5e74ea-8ddc-4d3e-9320-a73f9c726875 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:39.944244 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-0f7eca83-6122-48bf-aa89-6abb31e16b74 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:39.964796 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-0f7eca83-6122-48bf-aa89-6abb31e16b74 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:39.966239 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0c5e74ea-8ddc-4d3e-9320-a73f9c726875 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:39.968043 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-0f7eca83-6122-48bf-aa89-6abb31e16b74 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:39.970585 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0f7eca83-6122-48bf-aa89-6abb31e16b74 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5" status: 200 len: 1487 microversion: 2.25 time: 0.806590 Aug 31 16:05:39.971582 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1199/2407] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:05:39 2022] GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5 => generated 1487 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:05:39.994495 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0c5e74ea-8ddc-4d3e-9320-a73f9c726875 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:39.997390 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0c5e74ea-8ddc-4d3e-9320-a73f9c726875 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:39.999010 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0c5e74ea-8ddc-4d3e-9320-a73f9c726875 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] 10.222.0.61 "GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae" status: 200 len: 1576 microversion: 2.42 time: 0.322418 Aug 31 16:05:39.999908 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f7b22891-74dd-4f42-bff9-5a0cdf5e2c2d tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:40.000677 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f7b22891-74dd-4f42-bff9-5a0cdf5e2c2d tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: f9b66475-83f6-49a3-bc63-8965fc1aec14] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:40.011800 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f7b22891-74dd-4f42-bff9-5a0cdf5e2c2d tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:40.015423 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1209/2408] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:05:39 2022] GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae => generated 1576 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:05:40.020226 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f7b22891-74dd-4f42-bff9-5a0cdf5e2c2d tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:40.022201 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f7b22891-74dd-4f42-bff9-5a0cdf5e2c2d tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:40.023222 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f7b22891-74dd-4f42-bff9-5a0cdf5e2c2d tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:40.024268 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f7b22891-74dd-4f42-bff9-5a0cdf5e2c2d tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:40.024956 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f7b22891-74dd-4f42-bff9-5a0cdf5e2c2d tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:40.033492 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7b9fccc8-3d3c-48b2-b3d6-f020b081c762 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:40.049003 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7b9fccc8-3d3c-48b2-b3d6-f020b081c762 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 9d6a4c52-02e5-491b-ac04-917b710c332c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:40.056242 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7b9fccc8-3d3c-48b2-b3d6-f020b081c762 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:40.056908 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7b9fccc8-3d3c-48b2-b3d6-f020b081c762 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:40.057454 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7b9fccc8-3d3c-48b2-b3d6-f020b081c762 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:40.059063 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7b9fccc8-3d3c-48b2-b3d6-f020b081c762 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:40.059820 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7b9fccc8-3d3c-48b2-b3d6-f020b081c762 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:40.063754 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7b9fccc8-3d3c-48b2-b3d6-f020b081c762 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:40.927233 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f7b22891-74dd-4f42-bff9-5a0cdf5e2c2d tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:40.942287 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f7b22891-74dd-4f42-bff9-5a0cdf5e2c2d tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/f9b66475-83f6-49a3-bc63-8965fc1aec14" status: 200 len: 1472 microversion: 2.1 time: 0.968946 Aug 31 16:05:40.942982 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1200/2409] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:39 2022] GET /compute/v2.1/servers/f9b66475-83f6-49a3-bc63-8965fc1aec14 => generated 1472 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:40.959446 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b2cae4ab-97b9-41d1-b4a0-6c0eb80fc0cc tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:40.960473 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b2cae4ab-97b9-41d1-b4a0-6c0eb80fc0cc tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] [instance: 560a01e5-93f8-46c8-9261-5030e28766b4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:40.979420 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b2cae4ab-97b9-41d1-b4a0-6c0eb80fc0cc tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:40.981000 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b2cae4ab-97b9-41d1-b4a0-6c0eb80fc0cc tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:40.981695 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b2cae4ab-97b9-41d1-b4a0-6c0eb80fc0cc tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:40.982621 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b2cae4ab-97b9-41d1-b4a0-6c0eb80fc0cc tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:40.983557 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b2cae4ab-97b9-41d1-b4a0-6c0eb80fc0cc tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:40.984170 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b2cae4ab-97b9-41d1-b4a0-6c0eb80fc0cc tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:41.019820 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7b9fccc8-3d3c-48b2-b3d6-f020b081c762 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:41.037173 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7b9fccc8-3d3c-48b2-b3d6-f020b081c762 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/9d6a4c52-02e5-491b-ac04-917b710c332c" status: 200 len: 1473 microversion: 2.1 time: 1.020239 Aug 31 16:05:41.056057 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1210/2410] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:40 2022] GET /compute/v2.1/servers/9d6a4c52-02e5-491b-ac04-917b710c332c => generated 1473 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:41.072421 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-808800d3-dffc-4ab9-a550-1eb441c2337b tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:41.073334 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-808800d3-dffc-4ab9-a550-1eb441c2337b tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: 2ddb0b07-9e31-403c-91d5-a278d632d754] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:41.081005 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-808800d3-dffc-4ab9-a550-1eb441c2337b tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:41.081782 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-808800d3-dffc-4ab9-a550-1eb441c2337b tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:41.082558 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-808800d3-dffc-4ab9-a550-1eb441c2337b tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:41.083474 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-808800d3-dffc-4ab9-a550-1eb441c2337b tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:41.084124 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-808800d3-dffc-4ab9-a550-1eb441c2337b tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:41.084715 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-808800d3-dffc-4ab9-a550-1eb441c2337b tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:41.088818 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:05:41.708804 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-808800d3-dffc-4ab9-a550-1eb441c2337b tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:41.721596 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-808800d3-dffc-4ab9-a550-1eb441c2337b tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/2ddb0b07-9e31-403c-91d5-a278d632d754" status: 200 len: 1442 microversion: 2.1 time: 0.663723 Aug 31 16:05:41.722259 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1211/2411] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:41 2022] GET /compute/v2.1/servers/2ddb0b07-9e31-403c-91d5-a278d632d754 => generated 1442 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:41.727136 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-be846466-dd66-47b6-9a3b-86856ce7402a tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:41.727793 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-be846466-dd66-47b6-9a3b-86856ce7402a tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] [instance: 1f11f86d-3387-4c6e-9099-fc8d232b11a8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:41.739058 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-be846466-dd66-47b6-9a3b-86856ce7402a tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:41.739844 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-be846466-dd66-47b6-9a3b-86856ce7402a tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:41.740638 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-be846466-dd66-47b6-9a3b-86856ce7402a tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:41.741703 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-be846466-dd66-47b6-9a3b-86856ce7402a tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:41.742380 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-be846466-dd66-47b6-9a3b-86856ce7402a tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:41.743098 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-be846466-dd66-47b6-9a3b-86856ce7402a tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:42.080327 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b2cae4ab-97b9-41d1-b4a0-6c0eb80fc0cc tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f0b27a48fd41dd846ba60856349ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4efd94380dcf4b3cb7a2b9fa194fcb83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:42.093404 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b2cae4ab-97b9-41d1-b4a0-6c0eb80fc0cc tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "GET /compute/v2.1/servers/560a01e5-93f8-46c8-9261-5030e28766b4" status: 200 len: 1318 microversion: 2.1 time: 1.148685 Aug 31 16:05:42.108286 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1201/2412] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:40 2022] GET /compute/v2.1/servers/560a01e5-93f8-46c8-9261-5030e28766b4 => generated 1318 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:42.121096 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-01dce05b-8ca0-4412-835f-3c7d0ad55463 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:42.122021 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-01dce05b-8ca0-4412-835f-3c7d0ad55463 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 1262191c-be8b-4535-8704-72db13e3f6cc] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:42.131631 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-01dce05b-8ca0-4412-835f-3c7d0ad55463 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:42.132409 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-01dce05b-8ca0-4412-835f-3c7d0ad55463 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:42.133100 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-01dce05b-8ca0-4412-835f-3c7d0ad55463 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:42.134137 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-01dce05b-8ca0-4412-835f-3c7d0ad55463 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:42.135199 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-01dce05b-8ca0-4412-835f-3c7d0ad55463 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:42.136947 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-01dce05b-8ca0-4412-835f-3c7d0ad55463 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:42.409246 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-be846466-dd66-47b6-9a3b-86856ce7402a tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a837ababe7cb4284b96bc16deb40d2d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e9999df7e14609b1265351c83607bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:42.419368 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-be846466-dd66-47b6-9a3b-86856ce7402a tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] 10.222.0.61 "GET /compute/v2.1/servers/1f11f86d-3387-4c6e-9099-fc8d232b11a8" status: 200 len: 1395 microversion: 2.1 time: 0.695980 Aug 31 16:05:42.420051 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1212/2413] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:41 2022] GET /compute/v2.1/servers/1f11f86d-3387-4c6e-9099-fc8d232b11a8 => generated 1395 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:42.425305 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-5771d336-f2d9-4b89-a6a7-6dc1b093dd27 req-5f0f9ae1-6f31-42ba-910b-b8b87484488b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f11f86d-3387-4c6e-9099-fc8d232b11a8", "name": "network-vif-plugged", "status": "completed", "tag": "63593e47-213f-4d04-ae59-a652fc80fcbd"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:05:42.441405 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-5771d336-f2d9-4b89-a6a7-6dc1b093dd27 req-5f0f9ae1-6f31-42ba-910b-b8b87484488b service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:42.442205 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-5771d336-f2d9-4b89-a6a7-6dc1b093dd27 req-5f0f9ae1-6f31-42ba-910b-b8b87484488b service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:42.442948 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-5771d336-f2d9-4b89-a6a7-6dc1b093dd27 req-5f0f9ae1-6f31-42ba-910b-b8b87484488b service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:42.468543 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-5771d336-f2d9-4b89-a6a7-6dc1b093dd27 req-5f0f9ae1-6f31-42ba-910b-b8b87484488b service nova] Creating event network-vif-plugged:63593e47-213f-4d04-ae59-a652fc80fcbd for instance 1f11f86d-3387-4c6e-9099-fc8d232b11a8 on n-h2-850499-9 Aug 31 16:05:42.473751 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-5771d336-f2d9-4b89-a6a7-6dc1b093dd27 req-5f0f9ae1-6f31-42ba-910b-b8b87484488b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052554 Aug 31 16:05:42.474371 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1213/2414] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:05:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:05:42.482428 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-72c8524b-30f1-46ab-bac0-748aecac1fb5 req-e93301a8-2948-4261-975b-c23c4cc41b55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ddb0b07-9e31-403c-91d5-a278d632d754", "name": "network-vif-deleted", "tag": "e7598456-3858-4c71-8638-c50e65f3fc7a"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:05:42.497971 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-72c8524b-30f1-46ab-bac0-748aecac1fb5 req-e93301a8-2948-4261-975b-c23c4cc41b55 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:42.498764 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-72c8524b-30f1-46ab-bac0-748aecac1fb5 req-e93301a8-2948-4261-975b-c23c4cc41b55 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:42.499197 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-72c8524b-30f1-46ab-bac0-748aecac1fb5 req-e93301a8-2948-4261-975b-c23c4cc41b55 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:42.519948 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-72c8524b-30f1-46ab-bac0-748aecac1fb5 req-e93301a8-2948-4261-975b-c23c4cc41b55 service nova] Creating event network-vif-deleted:e7598456-3858-4c71-8638-c50e65f3fc7a for instance 2ddb0b07-9e31-403c-91d5-a278d632d754 on n-h2-850499-9 Aug 31 16:05:42.526763 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-72c8524b-30f1-46ab-bac0-748aecac1fb5 req-e93301a8-2948-4261-975b-c23c4cc41b55 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050418 Aug 31 16:05:42.527685 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1214/2415] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:05:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:05:42.538886 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-27783af1-8269-44dc-a7f4-41f86b1e4b9b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:42.540270 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-27783af1-8269-44dc-a7f4-41f86b1e4b9b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 006771fc-9da9-4b78-9fad-f4b72c311fd5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:42.548233 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-27783af1-8269-44dc-a7f4-41f86b1e4b9b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:42.549376 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-27783af1-8269-44dc-a7f4-41f86b1e4b9b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:42.549829 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-27783af1-8269-44dc-a7f4-41f86b1e4b9b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:42.550553 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-27783af1-8269-44dc-a7f4-41f86b1e4b9b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:42.551017 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-27783af1-8269-44dc-a7f4-41f86b1e4b9b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:42.551453 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-27783af1-8269-44dc-a7f4-41f86b1e4b9b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:42.703274 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-01dce05b-8ca0-4412-835f-3c7d0ad55463 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:42.715346 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-01dce05b-8ca0-4412-835f-3c7d0ad55463 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/1262191c-be8b-4535-8704-72db13e3f6cc" status: 200 len: 1314 microversion: 2.1 time: 0.604966 Aug 31 16:05:42.716294 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1202/2416] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:42 2022] GET /compute/v2.1/servers/1262191c-be8b-4535-8704-72db13e3f6cc => generated 1314 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:42.724155 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5b1d3bba-c898-477b-bdcd-9d43a8feae32 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:42.725241 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5b1d3bba-c898-477b-bdcd-9d43a8feae32 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] [instance: 685d47e4-721e-4eae-b5f8-78fdb68454ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:42.736104 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5b1d3bba-c898-477b-bdcd-9d43a8feae32 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:42.736952 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5b1d3bba-c898-477b-bdcd-9d43a8feae32 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:42.737702 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5b1d3bba-c898-477b-bdcd-9d43a8feae32 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:42.738881 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5b1d3bba-c898-477b-bdcd-9d43a8feae32 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:42.739614 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5b1d3bba-c898-477b-bdcd-9d43a8feae32 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:42.740572 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5b1d3bba-c898-477b-bdcd-9d43a8feae32 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:42.946432 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5b1d3bba-c898-477b-bdcd-9d43a8feae32 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:42.971329 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5b1d3bba-c898-477b-bdcd-9d43a8feae32 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:42.974647 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5b1d3bba-c898-477b-bdcd-9d43a8feae32 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:42.977827 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5b1d3bba-c898-477b-bdcd-9d43a8feae32 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] 10.222.0.61 "GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae" status: 200 len: 1584 microversion: 2.42 time: 0.259909 Aug 31 16:05:42.978740 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1203/2417] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:05:42 2022] GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae => generated 1584 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:05:42.989243 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5dffb8d0-2eae-4170-b13e-1e6128e8f2a1 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:42.990719 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5dffb8d0-2eae-4170-b13e-1e6128e8f2a1 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: f9b66475-83f6-49a3-bc63-8965fc1aec14] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:43.002381 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-27783af1-8269-44dc-a7f4-41f86b1e4b9b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:43.011964 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5dffb8d0-2eae-4170-b13e-1e6128e8f2a1 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:43.012963 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5dffb8d0-2eae-4170-b13e-1e6128e8f2a1 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:43.013863 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5dffb8d0-2eae-4170-b13e-1e6128e8f2a1 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:43.015108 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5dffb8d0-2eae-4170-b13e-1e6128e8f2a1 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:43.016132 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5dffb8d0-2eae-4170-b13e-1e6128e8f2a1 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:43.017125 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5dffb8d0-2eae-4170-b13e-1e6128e8f2a1 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:43.024410 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-27783af1-8269-44dc-a7f4-41f86b1e4b9b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:43.027467 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-27783af1-8269-44dc-a7f4-41f86b1e4b9b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:43.039020 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-27783af1-8269-44dc-a7f4-41f86b1e4b9b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5" status: 200 len: 1487 microversion: 2.25 time: 0.505480 Aug 31 16:05:43.041040 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1215/2418] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:05:42 2022] GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5 => generated 1487 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:05:43.054982 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-25ef3d58-36d1-473b-8f9b-451d137bdfec tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:43.056563 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-25ef3d58-36d1-473b-8f9b-451d137bdfec tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 9d6a4c52-02e5-491b-ac04-917b710c332c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:43.072985 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-25ef3d58-36d1-473b-8f9b-451d137bdfec tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:43.073702 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-25ef3d58-36d1-473b-8f9b-451d137bdfec tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:43.074157 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-25ef3d58-36d1-473b-8f9b-451d137bdfec tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:43.082273 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-25ef3d58-36d1-473b-8f9b-451d137bdfec tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:43.082980 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-25ef3d58-36d1-473b-8f9b-451d137bdfec tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:43.083656 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-25ef3d58-36d1-473b-8f9b-451d137bdfec tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:43.252775 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-25ef3d58-36d1-473b-8f9b-451d137bdfec tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:43.273052 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-25ef3d58-36d1-473b-8f9b-451d137bdfec tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/9d6a4c52-02e5-491b-ac04-917b710c332c" status: 200 len: 1431 microversion: 2.1 time: 0.228542 Aug 31 16:05:43.283534 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1216/2419] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:43 2022] GET /compute/v2.1/servers/9d6a4c52-02e5-491b-ac04-917b710c332c => generated 1431 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:43.284640 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-23c34b29-822b-48ee-9766-950ff49474cf tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:43.286408 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-23c34b29-822b-48ee-9766-950ff49474cf tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: 2ddb0b07-9e31-403c-91d5-a278d632d754] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:43.296882 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-23c34b29-822b-48ee-9766-950ff49474cf tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:43.297934 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-23c34b29-822b-48ee-9766-950ff49474cf tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:43.298693 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-23c34b29-822b-48ee-9766-950ff49474cf tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:43.299988 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-23c34b29-822b-48ee-9766-950ff49474cf tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:43.300772 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-23c34b29-822b-48ee-9766-950ff49474cf tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:43.301736 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-23c34b29-822b-48ee-9766-950ff49474cf tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:43.430599 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-23c34b29-822b-48ee-9766-950ff49474cf tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:43.438426 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5dffb8d0-2eae-4170-b13e-1e6128e8f2a1 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:43.455022 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-23c34b29-822b-48ee-9766-950ff49474cf tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/2ddb0b07-9e31-403c-91d5-a278d632d754" status: 200 len: 1442 microversion: 2.1 time: 0.178221 Aug 31 16:05:43.486290 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1217/2420] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:43 2022] GET /compute/v2.1/servers/2ddb0b07-9e31-403c-91d5-a278d632d754 => generated 1442 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:43.486290 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d3b47e66-9ef8-4176-9e29-14f15cefb70a tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:43.486290 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d3b47e66-9ef8-4176-9e29-14f15cefb70a tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] [instance: 560a01e5-93f8-46c8-9261-5030e28766b4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:43.486657 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5dffb8d0-2eae-4170-b13e-1e6128e8f2a1 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/f9b66475-83f6-49a3-bc63-8965fc1aec14" status: 200 len: 1469 microversion: 2.1 time: 0.494405 Aug 31 16:05:43.486657 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1204/2421] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:42 2022] GET /compute/v2.1/servers/f9b66475-83f6-49a3-bc63-8965fc1aec14 => generated 1469 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:43.489331 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-cb76183c-c24b-4b72-8cef-4d0d18690f30 req-c9e683f5-6311-4f49-bce8-61a4bb7ebb8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d6a4c52-02e5-491b-ac04-917b710c332c", "name": "network-vif-deleted", "tag": "ecf300a4-940b-4328-9b57-bd2c3a0ae844"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:05:43.510265 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d3b47e66-9ef8-4176-9e29-14f15cefb70a tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:43.512723 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d3b47e66-9ef8-4176-9e29-14f15cefb70a tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:43.512723 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d3b47e66-9ef8-4176-9e29-14f15cefb70a tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:43.514390 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-cb76183c-c24b-4b72-8cef-4d0d18690f30 req-c9e683f5-6311-4f49-bce8-61a4bb7ebb8c service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:43.514911 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-cb76183c-c24b-4b72-8cef-4d0d18690f30 req-c9e683f5-6311-4f49-bce8-61a4bb7ebb8c service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:43.515348 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-cb76183c-c24b-4b72-8cef-4d0d18690f30 req-c9e683f5-6311-4f49-bce8-61a4bb7ebb8c service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:43.520230 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d3b47e66-9ef8-4176-9e29-14f15cefb70a tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:43.520704 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d3b47e66-9ef8-4176-9e29-14f15cefb70a tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:43.521153 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d3b47e66-9ef8-4176-9e29-14f15cefb70a tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:43.546056 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-cb76183c-c24b-4b72-8cef-4d0d18690f30 req-c9e683f5-6311-4f49-bce8-61a4bb7ebb8c service nova] Creating event network-vif-deleted:ecf300a4-940b-4328-9b57-bd2c3a0ae844 for instance 9d6a4c52-02e5-491b-ac04-917b710c332c on n-h1-850499-9 Aug 31 16:05:43.556949 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-cb76183c-c24b-4b72-8cef-4d0d18690f30 req-c9e683f5-6311-4f49-bce8-61a4bb7ebb8c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076983 Aug 31 16:05:43.558550 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1205/2422] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:05:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:05:43.582172 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c3d7f7e6-b749-4d2c-b485-c1e0b3ceb43a tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:43.583433 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c3d7f7e6-b749-4d2c-b485-c1e0b3ceb43a tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] [instance: 1f11f86d-3387-4c6e-9099-fc8d232b11a8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:43.597453 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c3d7f7e6-b749-4d2c-b485-c1e0b3ceb43a tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:43.598957 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c3d7f7e6-b749-4d2c-b485-c1e0b3ceb43a tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:43.599725 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c3d7f7e6-b749-4d2c-b485-c1e0b3ceb43a tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:43.600916 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c3d7f7e6-b749-4d2c-b485-c1e0b3ceb43a tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:43.601952 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c3d7f7e6-b749-4d2c-b485-c1e0b3ceb43a tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:43.604329 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c3d7f7e6-b749-4d2c-b485-c1e0b3ceb43a tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:43.808325 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d3b47e66-9ef8-4176-9e29-14f15cefb70a tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f0b27a48fd41dd846ba60856349ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4efd94380dcf4b3cb7a2b9fa194fcb83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:43.817405 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d3b47e66-9ef8-4176-9e29-14f15cefb70a tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "GET /compute/v2.1/servers/560a01e5-93f8-46c8-9261-5030e28766b4" status: 200 len: 1318 microversion: 2.1 time: 0.359578 Aug 31 16:05:43.831477 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1218/2423] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:43 2022] GET /compute/v2.1/servers/560a01e5-93f8-46c8-9261-5030e28766b4 => generated 1318 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:43.844546 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b665acfe-f4d8-4c57-aa77-542a3f7a70c2 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:05:43.845938 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b665acfe-f4d8-4c57-aa77-542a3f7a70c2 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: f9b66475-83f6-49a3-bc63-8965fc1aec14] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:43.863467 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b665acfe-f4d8-4c57-aa77-542a3f7a70c2 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:43.864078 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b665acfe-f4d8-4c57-aa77-542a3f7a70c2 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:43.864523 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b665acfe-f4d8-4c57-aa77-542a3f7a70c2 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:43.865245 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b665acfe-f4d8-4c57-aa77-542a3f7a70c2 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:43.865705 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b665acfe-f4d8-4c57-aa77-542a3f7a70c2 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:43.866134 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b665acfe-f4d8-4c57-aa77-542a3f7a70c2 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:43.968763 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b665acfe-f4d8-4c57-aa77-542a3f7a70c2 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:43.978750 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b665acfe-f4d8-4c57-aa77-542a3f7a70c2 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:43.979289 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b665acfe-f4d8-4c57-aa77-542a3f7a70c2 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:43.984199 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b665acfe-f4d8-4c57-aa77-542a3f7a70c2 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:43.988837 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c3d7f7e6-b749-4d2c-b485-c1e0b3ceb43a tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a837ababe7cb4284b96bc16deb40d2d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e9999df7e14609b1265351c83607bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:43.996677 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b665acfe-f4d8-4c57-aa77-542a3f7a70c2 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:44.001866 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c3d7f7e6-b749-4d2c-b485-c1e0b3ceb43a tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] 10.222.0.61 "GET /compute/v2.1/servers/1f11f86d-3387-4c6e-9099-fc8d232b11a8" status: 200 len: 1395 microversion: 2.1 time: 0.437108 Aug 31 16:05:44.002282 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b665acfe-f4d8-4c57-aa77-542a3f7a70c2 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:44.005949 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1206/2424] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:43 2022] GET /compute/v2.1/servers/1f11f86d-3387-4c6e-9099-fc8d232b11a8 => generated 1395 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:44.013972 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5de5a44a-8075-4dfc-a0ed-1bb787bd27db tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:44.029679 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5de5a44a-8075-4dfc-a0ed-1bb787bd27db tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 1262191c-be8b-4535-8704-72db13e3f6cc] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:44.064337 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5de5a44a-8075-4dfc-a0ed-1bb787bd27db tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:44.066711 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5de5a44a-8075-4dfc-a0ed-1bb787bd27db tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:44.068305 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5de5a44a-8075-4dfc-a0ed-1bb787bd27db tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:44.070564 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5de5a44a-8075-4dfc-a0ed-1bb787bd27db tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:44.071463 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5de5a44a-8075-4dfc-a0ed-1bb787bd27db tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:44.072185 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5de5a44a-8075-4dfc-a0ed-1bb787bd27db tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:44.080823 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-b665acfe-f4d8-4c57-aa77-542a3f7a70c2 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Getting quotas for project 55ea476c41904e458bae79e7dad5d654. Resources: {'ram', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:05:44.093514 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-b665acfe-f4d8-4c57-aa77-542a3f7a70c2 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Getting quotas for user 0a552442b7e94406b1689baf7a23fa52 and project 55ea476c41904e458bae79e7dad5d654. Resources: {'ram', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:05:44.298208 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b665acfe-f4d8-4c57-aa77-542a3f7a70c2 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "POST /compute/v2.1/servers/f9b66475-83f6-49a3-bc63-8965fc1aec14/action" status: 202 len: 0 microversion: 2.1 time: 0.471879 Aug 31 16:05:44.301600 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1219/2425] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:05:43 2022] POST /compute/v2.1/servers/f9b66475-83f6-49a3-bc63-8965fc1aec14/action => generated 0 bytes in 476 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:05:44.319611 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8b329e73-030f-4403-9dcc-4b0dddb787be tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:44.321150 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8b329e73-030f-4403-9dcc-4b0dddb787be tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] [instance: 685d47e4-721e-4eae-b5f8-78fdb68454ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:44.343238 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b329e73-030f-4403-9dcc-4b0dddb787be tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:44.344175 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b329e73-030f-4403-9dcc-4b0dddb787be tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:44.344931 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b329e73-030f-4403-9dcc-4b0dddb787be tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:44.347758 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b329e73-030f-4403-9dcc-4b0dddb787be tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:44.349500 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b329e73-030f-4403-9dcc-4b0dddb787be tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:44.350869 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b329e73-030f-4403-9dcc-4b0dddb787be tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:44.715625 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8b329e73-030f-4403-9dcc-4b0dddb787be tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:44.760794 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8b329e73-030f-4403-9dcc-4b0dddb787be tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:44.770929 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8b329e73-030f-4403-9dcc-4b0dddb787be tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:44.775325 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8b329e73-030f-4403-9dcc-4b0dddb787be tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] 10.222.0.61 "GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae" status: 200 len: 1594 microversion: 2.42 time: 0.466796 Aug 31 16:05:44.777291 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1220/2426] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:05:44 2022] GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae => generated 1594 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:05:44.789398 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c0c89c44-0974-4186-b165-7342da310465 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:44.789950 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c0c89c44-0974-4186-b165-7342da310465 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 006771fc-9da9-4b78-9fad-f4b72c311fd5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:44.815314 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:UPDATE=3 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:05:44.839294 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c0c89c44-0974-4186-b165-7342da310465 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:44.840015 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c0c89c44-0974-4186-b165-7342da310465 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:44.840563 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c0c89c44-0974-4186-b165-7342da310465 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:44.841381 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c0c89c44-0974-4186-b165-7342da310465 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:44.841990 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c0c89c44-0974-4186-b165-7342da310465 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:44.842514 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c0c89c44-0974-4186-b165-7342da310465 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:45.476773 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5de5a44a-8075-4dfc-a0ed-1bb787bd27db tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:45.494471 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5de5a44a-8075-4dfc-a0ed-1bb787bd27db tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/1262191c-be8b-4535-8704-72db13e3f6cc" status: 200 len: 1314 microversion: 2.1 time: 1.484028 Aug 31 16:05:45.497042 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1207/2427] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:44 2022] GET /compute/v2.1/servers/1262191c-be8b-4535-8704-72db13e3f6cc => generated 1314 bytes in 1490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:45.507218 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c0c89c44-0974-4186-b165-7342da310465 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:45.508103 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-77c8dd1f-270a-4b23-b489-fed2d45f7d16 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:45.509773 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-77c8dd1f-270a-4b23-b489-fed2d45f7d16 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 9d6a4c52-02e5-491b-ac04-917b710c332c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:45.517853 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c0c89c44-0974-4186-b165-7342da310465 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:45.522638 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-77c8dd1f-270a-4b23-b489-fed2d45f7d16 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:45.523903 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-77c8dd1f-270a-4b23-b489-fed2d45f7d16 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:45.524414 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c0c89c44-0974-4186-b165-7342da310465 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:45.524890 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-77c8dd1f-270a-4b23-b489-fed2d45f7d16 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:45.526276 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c0c89c44-0974-4186-b165-7342da310465 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5" status: 200 len: 1487 microversion: 2.25 time: 0.743159 Aug 31 16:05:45.527418 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-77c8dd1f-270a-4b23-b489-fed2d45f7d16 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:45.539541 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-77c8dd1f-270a-4b23-b489-fed2d45f7d16 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:45.539541 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-77c8dd1f-270a-4b23-b489-fed2d45f7d16 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:45.540843 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1221/2428] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:05:44 2022] GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5 => generated 1487 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:05:45.558941 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-77c8dd1f-270a-4b23-b489-fed2d45f7d16 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] HTTP exception thrown: Instance 9d6a4c52-02e5-491b-ac04-917b710c332c could not be found. Aug 31 16:05:45.559585 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-04007010-593a-4118-8d48-7490dc5dca23 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:45.560550 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-04007010-593a-4118-8d48-7490dc5dca23 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: f9b66475-83f6-49a3-bc63-8965fc1aec14] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:45.562158 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-77c8dd1f-270a-4b23-b489-fed2d45f7d16 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Request method failure captured: Aug 31 16:05:45.562158 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/9d6a4c52-02e5-491b-ac04-917b710c332c HTTP/1.1 Aug 31 16:05:45.562158 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:05:45.562158 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:05:45.562158 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:05:45.562158 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:05:45.562158 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:05:45.562158 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:05:45.562158 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:05:45.562158 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:05:45.562158 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4XtNmkvMwnHSL7qhg4V3Wdw6j3Xq_Y_rjXmT_SLe0FMvGo1gt1LwtP8iZQqS4u70Er7TOj14npyXUlDGoqy-1fk7VS9f_3ajnUzSZB5vWqF2Pe5k8siWL_JGtE8zCZBhN_wgL3NLoqpJfp9eoMAktgpjf2nAX9ECp3Cc5bDcIxyAw0 Aug 31 16:05:45.562158 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:05:45.562158 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:05:45.562158 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:05:45.562158 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:05:45.562158 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:05:45.562158 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:05:45.562158 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 7fa2effd15e440598752264e49d2457d Aug 31 16:05:45.562158 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ServersOnMultiNodesTest-1308696187 Aug 31 16:05:45.562158 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:05:45.562158 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:05:45.562158 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7fa2effd15e440598752264e49d2457d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7fa2effd15e440598752264e49d2457d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7fa2effd15e440598752264e49d2457d", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7fa2effd15e440598752264e49d2457d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:05:45.562158 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ServersOnMultiNodesTest-1308696187 Aug 31 16:05:45.562158 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 7fa2effd15e440598752264e49d2457d Aug 31 16:05:45.562158 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1308696187 Aug 31 16:05:45.562158 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ServersOnMultiNodesTest-1308696187-project Aug 31 16:05:45.562158 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:05:45.562158 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:05:45.562158 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 547d88df13034daaad50c3582c7cc3b3 Aug 31 16:05:45.562158 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ServersOnMultiNodesTest-1308696187-project Aug 31 16:05:45.562158 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:05:45.562158 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance 9d6a4c52-02e5-491b-ac04-917b710c332c could not be found. Aug 31 16:05:45.562158 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '9d6a4c52-02e5-491b-ac04-917b710c332c'} Aug 31 16:05:45.562158 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:05:45.562158 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:05:45.562158 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:05:45.562158 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:05:45.562158 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:05:45.562158 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:05:45.562158 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:05:45.562158 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:05:45.562158 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:05:45.562158 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:05:45.562158 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d6a4c52-02e5-491b-ac04-917b710c332c could not be found. Aug 31 16:05:45.562158 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:05:45.562158 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:05:45.562158 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:05:45.562158 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:05:45.562158 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:05:45.562158 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:05:45.562158 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:05:45.562158 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:05:45.562158 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:05:45.562158 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:05:45.562158 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:05:45.562158 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:05:45.562158 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:05:45.562158 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:05:45.562158 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:05:45.562158 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:05:45.562158 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d6a4c52-02e5-491b-ac04-917b710c332c could not be found. Aug 31 16:05:45.562158 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:05:45.562158 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:05:45.562158 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:05:45.565952 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:05:45.565952 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:05:45.565952 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:05:45.565952 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:05:45.565952 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:05:45.565952 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d6a4c52-02e5-491b-ac04-917b710c332c could not be found. Aug 31 16:05:45.565952 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:05:45.565952 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-77c8dd1f-270a-4b23-b489-fed2d45f7d16 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Returning 404 to user: Instance 9d6a4c52-02e5-491b-ac04-917b710c332c could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:05:45.565952 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-77c8dd1f-270a-4b23-b489-fed2d45f7d16 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/9d6a4c52-02e5-491b-ac04-917b710c332c" status: 404 len: 111 microversion: 2.1 time: 0.064494 Aug 31 16:05:45.565952 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1208/2429] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:45 2022] GET /compute/v2.1/servers/9d6a4c52-02e5-491b-ac04-917b710c332c => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:05:45.569228 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5fba2846-0252-473a-a37c-9a03ca7d1f14 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:45.569856 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5fba2846-0252-473a-a37c-9a03ca7d1f14 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: 2ddb0b07-9e31-403c-91d5-a278d632d754] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:45.578123 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5fba2846-0252-473a-a37c-9a03ca7d1f14 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:45.578903 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5fba2846-0252-473a-a37c-9a03ca7d1f14 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:45.579664 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5fba2846-0252-473a-a37c-9a03ca7d1f14 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:45.580637 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5fba2846-0252-473a-a37c-9a03ca7d1f14 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:45.581327 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5fba2846-0252-473a-a37c-9a03ca7d1f14 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:45.582036 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5fba2846-0252-473a-a37c-9a03ca7d1f14 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:45.584780 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-04007010-593a-4118-8d48-7490dc5dca23 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:45.585598 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-04007010-593a-4118-8d48-7490dc5dca23 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:45.586105 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-04007010-593a-4118-8d48-7490dc5dca23 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:45.587110 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-04007010-593a-4118-8d48-7490dc5dca23 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:45.594789 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-04007010-593a-4118-8d48-7490dc5dca23 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:45.595455 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-04007010-593a-4118-8d48-7490dc5dca23 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:45.632058 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5fba2846-0252-473a-a37c-9a03ca7d1f14 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:45.633463 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5fba2846-0252-473a-a37c-9a03ca7d1f14 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:45.634768 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5fba2846-0252-473a-a37c-9a03ca7d1f14 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:45.635635 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-5fba2846-0252-473a-a37c-9a03ca7d1f14 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lazy-loading 'fault' on Instance uuid 2ddb0b07-9e31-403c-91d5-a278d632d754 {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:05:45.802720 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5fba2846-0252-473a-a37c-9a03ca7d1f14 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:45.816866 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5fba2846-0252-473a-a37c-9a03ca7d1f14 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/2ddb0b07-9e31-403c-91d5-a278d632d754" status: 200 len: 1299 microversion: 2.1 time: 0.250745 Aug 31 16:05:45.818517 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1209/2430] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:45 2022] GET /compute/v2.1/servers/2ddb0b07-9e31-403c-91d5-a278d632d754 => generated 1299 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:45.828637 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-8c899f11-5dbd-4de2-84c5-89c2803d334f req-31f006fb-6b08-4de8-ae87-de717b223950 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1262191c-be8b-4535-8704-72db13e3f6cc", "name": "network-vif-plugged", "status": "completed", "tag": "583b8caf-b274-433c-9305-a71044fdd417"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:05:45.842824 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-8c899f11-5dbd-4de2-84c5-89c2803d334f req-31f006fb-6b08-4de8-ae87-de717b223950 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:45.843324 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-8c899f11-5dbd-4de2-84c5-89c2803d334f req-31f006fb-6b08-4de8-ae87-de717b223950 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:45.844455 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-8c899f11-5dbd-4de2-84c5-89c2803d334f req-31f006fb-6b08-4de8-ae87-de717b223950 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:45.892985 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-8c899f11-5dbd-4de2-84c5-89c2803d334f req-31f006fb-6b08-4de8-ae87-de717b223950 service nova] Creating event network-vif-plugged:583b8caf-b274-433c-9305-a71044fdd417 for instance 1262191c-be8b-4535-8704-72db13e3f6cc on n-h2-850499-9 Aug 31 16:05:45.922479 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-8c899f11-5dbd-4de2-84c5-89c2803d334f req-31f006fb-6b08-4de8-ae87-de717b223950 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086857 Aug 31 16:05:45.923581 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1210/2431] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:05:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:05:45.935571 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c50436a9-5cc1-433e-9a66-3c6a53cc84eb tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:45.936365 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c50436a9-5cc1-433e-9a66-3c6a53cc84eb tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] [instance: 560a01e5-93f8-46c8-9261-5030e28766b4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:45.954301 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c50436a9-5cc1-433e-9a66-3c6a53cc84eb tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:45.954801 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c50436a9-5cc1-433e-9a66-3c6a53cc84eb tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:45.955459 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c50436a9-5cc1-433e-9a66-3c6a53cc84eb tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:45.956406 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c50436a9-5cc1-433e-9a66-3c6a53cc84eb tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:45.957086 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c50436a9-5cc1-433e-9a66-3c6a53cc84eb tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:45.957681 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c50436a9-5cc1-433e-9a66-3c6a53cc84eb tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:46.944829 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:05:46.965209 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-04007010-593a-4118-8d48-7490dc5dca23 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:46.982054 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-04007010-593a-4118-8d48-7490dc5dca23 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/f9b66475-83f6-49a3-bc63-8965fc1aec14" status: 200 len: 1468 microversion: 2.1 time: 1.439211 Aug 31 16:05:46.982713 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1222/2432] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:45 2022] GET /compute/v2.1/servers/f9b66475-83f6-49a3-bc63-8965fc1aec14 => generated 1468 bytes in 1441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:46.987488 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0810d7e5-3353-4e7e-85b0-3b5d22798db8 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:46.988451 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0810d7e5-3353-4e7e-85b0-3b5d22798db8 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] [instance: 1f11f86d-3387-4c6e-9099-fc8d232b11a8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:47.005874 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0810d7e5-3353-4e7e-85b0-3b5d22798db8 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:47.007545 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0810d7e5-3353-4e7e-85b0-3b5d22798db8 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:47.008147 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0810d7e5-3353-4e7e-85b0-3b5d22798db8 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:47.008882 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0810d7e5-3353-4e7e-85b0-3b5d22798db8 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:47.009366 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0810d7e5-3353-4e7e-85b0-3b5d22798db8 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:47.010010 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0810d7e5-3353-4e7e-85b0-3b5d22798db8 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:47.019014 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=6 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:05:47.307620 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c50436a9-5cc1-433e-9a66-3c6a53cc84eb tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f0b27a48fd41dd846ba60856349ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4efd94380dcf4b3cb7a2b9fa194fcb83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:47.354049 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c50436a9-5cc1-433e-9a66-3c6a53cc84eb tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "GET /compute/v2.1/servers/560a01e5-93f8-46c8-9261-5030e28766b4" status: 200 len: 1318 microversion: 2.1 time: 1.429160 Aug 31 16:05:47.372840 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1211/2433] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:45 2022] GET /compute/v2.1/servers/560a01e5-93f8-46c8-9261-5030e28766b4 => generated 1318 bytes in 1448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:47.378962 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5243b897-bbbf-4d06-9dd3-c93a30f83b1b tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:47.379730 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5243b897-bbbf-4d06-9dd3-c93a30f83b1b tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: bf253a58-f38a-42d9-90b6-f3a80141cad2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:47.393151 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5243b897-bbbf-4d06-9dd3-c93a30f83b1b tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:47.393867 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5243b897-bbbf-4d06-9dd3-c93a30f83b1b tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:47.394500 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5243b897-bbbf-4d06-9dd3-c93a30f83b1b tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:47.395451 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5243b897-bbbf-4d06-9dd3-c93a30f83b1b tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:47.396142 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5243b897-bbbf-4d06-9dd3-c93a30f83b1b tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:47.396762 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5243b897-bbbf-4d06-9dd3-c93a30f83b1b tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:47.443308 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5243b897-bbbf-4d06-9dd3-c93a30f83b1b tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: bf253a58-f38a-42d9-90b6-f3a80141cad2] Going to try to terminate instance {{(pid=122256) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:05:47.459365 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=100 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:05:47.666760 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5243b897-bbbf-4d06-9dd3-c93a30f83b1b tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "DELETE /compute/v2.1/servers/bf253a58-f38a-42d9-90b6-f3a80141cad2" status: 204 len: 0 microversion: 2.1 time: 0.288708 Aug 31 16:05:47.670882 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1212/2434] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:05:47 2022] DELETE /compute/v2.1/servers/bf253a58-f38a-42d9-90b6-f3a80141cad2 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:05:47.691643 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d6b3ad69-ddd8-4435-9857-b215bad67101 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:47.692384 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d6b3ad69-ddd8-4435-9857-b215bad67101 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] [instance: 685d47e4-721e-4eae-b5f8-78fdb68454ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:47.706923 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d6b3ad69-ddd8-4435-9857-b215bad67101 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:47.710436 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d6b3ad69-ddd8-4435-9857-b215bad67101 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:47.710982 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d6b3ad69-ddd8-4435-9857-b215bad67101 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:47.712042 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d6b3ad69-ddd8-4435-9857-b215bad67101 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:47.712534 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d6b3ad69-ddd8-4435-9857-b215bad67101 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:47.712977 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d6b3ad69-ddd8-4435-9857-b215bad67101 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:47.768538 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0810d7e5-3353-4e7e-85b0-3b5d22798db8 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a837ababe7cb4284b96bc16deb40d2d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e9999df7e14609b1265351c83607bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:47.785452 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0810d7e5-3353-4e7e-85b0-3b5d22798db8 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] 10.222.0.61 "GET /compute/v2.1/servers/1f11f86d-3387-4c6e-9099-fc8d232b11a8" status: 200 len: 1395 microversion: 2.1 time: 0.801555 Aug 31 16:05:47.791896 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1223/2435] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:46 2022] GET /compute/v2.1/servers/1f11f86d-3387-4c6e-9099-fc8d232b11a8 => generated 1395 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:47.809557 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-21803aee-aec7-4b6c-b3ff-12241faeef8a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:47.810689 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-21803aee-aec7-4b6c-b3ff-12241faeef8a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 1262191c-be8b-4535-8704-72db13e3f6cc] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:47.831540 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-21803aee-aec7-4b6c-b3ff-12241faeef8a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:47.832994 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-21803aee-aec7-4b6c-b3ff-12241faeef8a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:47.835036 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-21803aee-aec7-4b6c-b3ff-12241faeef8a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:47.836026 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-21803aee-aec7-4b6c-b3ff-12241faeef8a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:47.837728 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-21803aee-aec7-4b6c-b3ff-12241faeef8a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:47.840210 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-21803aee-aec7-4b6c-b3ff-12241faeef8a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:48.174385 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d6b3ad69-ddd8-4435-9857-b215bad67101 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:48.196628 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d6b3ad69-ddd8-4435-9857-b215bad67101 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:48.201171 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d6b3ad69-ddd8-4435-9857-b215bad67101 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:48.205649 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d6b3ad69-ddd8-4435-9857-b215bad67101 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] 10.222.0.61 "GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae" status: 200 len: 1707 microversion: 2.42 time: 0.532116 Aug 31 16:05:48.209261 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1213/2436] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:05:47 2022] GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae => generated 1707 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:05:48.224950 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8e5d836c-248f-4107-b812-6d92690b5b5f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:48.226525 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8e5d836c-248f-4107-b812-6d92690b5b5f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 006771fc-9da9-4b78-9fad-f4b72c311fd5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:48.249748 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8e5d836c-248f-4107-b812-6d92690b5b5f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:48.256663 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8e5d836c-248f-4107-b812-6d92690b5b5f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:48.259655 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8e5d836c-248f-4107-b812-6d92690b5b5f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:48.261227 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8e5d836c-248f-4107-b812-6d92690b5b5f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:48.263898 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8e5d836c-248f-4107-b812-6d92690b5b5f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:48.266049 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8e5d836c-248f-4107-b812-6d92690b5b5f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:48.288410 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:05:48.454091 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-21803aee-aec7-4b6c-b3ff-12241faeef8a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:48.487325 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-21803aee-aec7-4b6c-b3ff-12241faeef8a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/1262191c-be8b-4535-8704-72db13e3f6cc" status: 200 len: 1314 microversion: 2.1 time: 0.690459 Aug 31 16:05:48.488965 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1224/2437] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:47 2022] GET /compute/v2.1/servers/1262191c-be8b-4535-8704-72db13e3f6cc => generated 1314 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:48.497690 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-cccf0a32-5d7e-4893-bf3d-f7aeb0b68560 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:48.498553 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-cccf0a32-5d7e-4893-bf3d-f7aeb0b68560 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: 2ddb0b07-9e31-403c-91d5-a278d632d754] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:48.513306 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cccf0a32-5d7e-4893-bf3d-f7aeb0b68560 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:48.514307 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cccf0a32-5d7e-4893-bf3d-f7aeb0b68560 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:48.514607 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cccf0a32-5d7e-4893-bf3d-f7aeb0b68560 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:48.515833 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cccf0a32-5d7e-4893-bf3d-f7aeb0b68560 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:48.516377 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cccf0a32-5d7e-4893-bf3d-f7aeb0b68560 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:48.516937 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cccf0a32-5d7e-4893-bf3d-f7aeb0b68560 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:48.546827 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-cccf0a32-5d7e-4893-bf3d-f7aeb0b68560 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] HTTP exception thrown: Instance 2ddb0b07-9e31-403c-91d5-a278d632d754 could not be found. Aug 31 16:05:48.550302 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-cccf0a32-5d7e-4893-bf3d-f7aeb0b68560 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Request method failure captured: Aug 31 16:05:48.550302 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/2ddb0b07-9e31-403c-91d5-a278d632d754 HTTP/1.1 Aug 31 16:05:48.550302 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:05:48.550302 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:05:48.550302 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:05:48.550302 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:05:48.550302 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:05:48.550302 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:05:48.550302 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:05:48.550302 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:05:48.550302 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4St87glls8nrcJLaszJCTH3u-5gjP_zR_CDcTJmGRy-icHFnPPaQEjN24lPcF68k7cJy-u1N7wTTpAM3QT_rwVgkInJP4vDJQWfb13puTbBaWpSNY7AqOuE9gOwubT4HvKPey49JpgyvzFifvxP5d5LPnrAimWxJ7aL70cmuBZOFis Aug 31 16:05:48.550302 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:05:48.550302 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:05:48.550302 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:05:48.550302 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:05:48.550302 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:05:48.550302 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:05:48.550302 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 150e5f8e376a40e089de8ed092e269fd Aug 31 16:05:48.550302 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-LiveMigrationTest-774357135 Aug 31 16:05:48.550302 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:05:48.550302 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:05:48.550302 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/150e5f8e376a40e089de8ed092e269fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/150e5f8e376a40e089de8ed092e269fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_150e5f8e376a40e089de8ed092e269fd", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/150e5f8e376a40e089de8ed092e269fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:05:48.550302 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-LiveMigrationTest-774357135 Aug 31 16:05:48.550302 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 150e5f8e376a40e089de8ed092e269fd Aug 31 16:05:48.550302 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-LiveMigrationTest-774357135 Aug 31 16:05:48.550302 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-LiveMigrationTest-774357135-project Aug 31 16:05:48.550302 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:05:48.550302 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:05:48.550302 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: de0e032fc09b48ada1dfe99e549aa623 Aug 31 16:05:48.550302 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-LiveMigrationTest-774357135-project Aug 31 16:05:48.550302 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:05:48.550302 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance 2ddb0b07-9e31-403c-91d5-a278d632d754 could not be found. Aug 31 16:05:48.550302 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '2ddb0b07-9e31-403c-91d5-a278d632d754'} Aug 31 16:05:48.550302 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:05:48.550302 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:05:48.550302 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:05:48.550302 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:05:48.550302 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:05:48.550302 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:05:48.550302 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:05:48.550302 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:05:48.550302 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:05:48.550302 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:05:48.550302 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ddb0b07-9e31-403c-91d5-a278d632d754 could not be found. Aug 31 16:05:48.550302 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:05:48.550302 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:05:48.550302 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:05:48.550302 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:05:48.550302 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:05:48.550302 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:05:48.550302 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:05:48.550302 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:05:48.550302 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:05:48.550302 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:05:48.550302 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:05:48.550302 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:05:48.550302 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:05:48.550302 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:05:48.550302 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:05:48.550302 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:05:48.550302 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ddb0b07-9e31-403c-91d5-a278d632d754 could not be found. Aug 31 16:05:48.550302 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:05:48.550302 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:05:48.550302 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:05:48.558764 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:05:48.558764 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:05:48.558764 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:05:48.558764 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:05:48.558764 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:05:48.558764 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ddb0b07-9e31-403c-91d5-a278d632d754 could not be found. Aug 31 16:05:48.558764 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:05:48.558764 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-cccf0a32-5d7e-4893-bf3d-f7aeb0b68560 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Returning 404 to user: Instance 2ddb0b07-9e31-403c-91d5-a278d632d754 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:05:48.558764 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-cccf0a32-5d7e-4893-bf3d-f7aeb0b68560 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/2ddb0b07-9e31-403c-91d5-a278d632d754" status: 404 len: 111 microversion: 2.1 time: 0.063641 Aug 31 16:05:48.558764 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1225/2438] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:48 2022] GET /compute/v2.1/servers/2ddb0b07-9e31-403c-91d5-a278d632d754 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:05:48.566261 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-230d9cd9-8644-4765-b735-7e209e1b4b8e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:48.567090 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-230d9cd9-8644-4765-b735-7e209e1b4b8e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 646d0250-a626-4bd1-821b-2117fde78cc8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:48.581449 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-230d9cd9-8644-4765-b735-7e209e1b4b8e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:48.585316 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-230d9cd9-8644-4765-b735-7e209e1b4b8e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:48.593115 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-230d9cd9-8644-4765-b735-7e209e1b4b8e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:48.595172 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-230d9cd9-8644-4765-b735-7e209e1b4b8e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:48.597351 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-230d9cd9-8644-4765-b735-7e209e1b4b8e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:48.598481 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-230d9cd9-8644-4765-b735-7e209e1b4b8e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:48.698754 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-230d9cd9-8644-4765-b735-7e209e1b4b8e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 646d0250-a626-4bd1-821b-2117fde78cc8] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:05:48.700014 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8e5d836c-248f-4107-b812-6d92690b5b5f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:48.701690 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:05:48.715622 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8e5d836c-248f-4107-b812-6d92690b5b5f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:48.721037 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8e5d836c-248f-4107-b812-6d92690b5b5f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:48.727799 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8e5d836c-248f-4107-b812-6d92690b5b5f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5" status: 200 len: 1487 microversion: 2.25 time: 0.513242 Aug 31 16:05:48.729960 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1214/2439] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:05:48 2022] GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5 => generated 1487 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:05:48.749854 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-e00cb083-1986-472c-be33-9ebedd94a8f3 req-12aea368-ea11-4279-9960-ebb4dd5ee59a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9b66475-83f6-49a3-bc63-8965fc1aec14", "name": "network-vif-plugged", "status": "completed", "tag": "c1929c28-a0f2-4fed-aba4-ecfd08ac8e7e"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:05:48.791284 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-e00cb083-1986-472c-be33-9ebedd94a8f3 req-12aea368-ea11-4279-9960-ebb4dd5ee59a service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:48.793397 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-e00cb083-1986-472c-be33-9ebedd94a8f3 req-12aea368-ea11-4279-9960-ebb4dd5ee59a service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:48.794436 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-e00cb083-1986-472c-be33-9ebedd94a8f3 req-12aea368-ea11-4279-9960-ebb4dd5ee59a service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:48.825619 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-e00cb083-1986-472c-be33-9ebedd94a8f3 req-12aea368-ea11-4279-9960-ebb4dd5ee59a service nova] Creating event network-vif-plugged:c1929c28-a0f2-4fed-aba4-ecfd08ac8e7e for instance f9b66475-83f6-49a3-bc63-8965fc1aec14 on n-h1-850499-9 Aug 31 16:05:48.837261 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [req-e00cb083-1986-472c-be33-9ebedd94a8f3 req-12aea368-ea11-4279-9960-ebb4dd5ee59a service nova] Instance f9b66475-83f6-49a3-bc63-8965fc1aec14 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850499-9', 'n-h2-850499-9'} {{(pid=122256) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 31 16:05:48.852696 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-e00cb083-1986-472c-be33-9ebedd94a8f3 req-12aea368-ea11-4279-9960-ebb4dd5ee59a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119358 Aug 31 16:05:48.853865 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1215/2440] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:05:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:05:48.866910 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b61553b5-0385-447d-bfc0-b4ddbf229a61 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:48.868064 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b61553b5-0385-447d-bfc0-b4ddbf229a61 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: f9b66475-83f6-49a3-bc63-8965fc1aec14] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:48.878483 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-230d9cd9-8644-4765-b735-7e209e1b4b8e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "DELETE /compute/v2.1/servers/646d0250-a626-4bd1-821b-2117fde78cc8" status: 204 len: 0 microversion: 2.1 time: 0.319808 Aug 31 16:05:48.882463 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b61553b5-0385-447d-bfc0-b4ddbf229a61 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:48.883548 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b61553b5-0385-447d-bfc0-b4ddbf229a61 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:48.884270 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b61553b5-0385-447d-bfc0-b4ddbf229a61 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:48.885772 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b61553b5-0385-447d-bfc0-b4ddbf229a61 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:48.887354 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b61553b5-0385-447d-bfc0-b4ddbf229a61 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:48.887595 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1226/2441] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:05:48 2022] DELETE /compute/v2.1/servers/646d0250-a626-4bd1-821b-2117fde78cc8 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:05:48.888238 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b61553b5-0385-447d-bfc0-b4ddbf229a61 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:48.895471 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e2f3995d-69ef-43dd-be1b-1ae1d5a8c00b tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:48.897151 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e2f3995d-69ef-43dd-be1b-1ae1d5a8c00b tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] [instance: 560a01e5-93f8-46c8-9261-5030e28766b4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:48.906851 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e2f3995d-69ef-43dd-be1b-1ae1d5a8c00b tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:48.907747 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e2f3995d-69ef-43dd-be1b-1ae1d5a8c00b tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:48.908557 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e2f3995d-69ef-43dd-be1b-1ae1d5a8c00b tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:48.910458 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e2f3995d-69ef-43dd-be1b-1ae1d5a8c00b tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:48.912610 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e2f3995d-69ef-43dd-be1b-1ae1d5a8c00b tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:48.913610 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e2f3995d-69ef-43dd-be1b-1ae1d5a8c00b tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:49.167919 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b61553b5-0385-447d-bfc0-b4ddbf229a61 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:49.178788 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b61553b5-0385-447d-bfc0-b4ddbf229a61 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/f9b66475-83f6-49a3-bc63-8965fc1aec14" status: 200 len: 1468 microversion: 2.1 time: 0.322635 Aug 31 16:05:49.180666 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1216/2442] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:48 2022] GET /compute/v2.1/servers/f9b66475-83f6-49a3-bc63-8965fc1aec14 => generated 1468 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:49.187126 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-83de1072-af78-4580-8aeb-2eb5bd210f5f tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:49.188535 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-83de1072-af78-4580-8aeb-2eb5bd210f5f tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:49.201048 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-83de1072-af78-4580-8aeb-2eb5bd210f5f tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:49.202095 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-83de1072-af78-4580-8aeb-2eb5bd210f5f tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:49.202843 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-83de1072-af78-4580-8aeb-2eb5bd210f5f tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:49.203797 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-83de1072-af78-4580-8aeb-2eb5bd210f5f tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:49.204408 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-83de1072-af78-4580-8aeb-2eb5bd210f5f tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:49.205057 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-83de1072-af78-4580-8aeb-2eb5bd210f5f tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:49.213516 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e2f3995d-69ef-43dd-be1b-1ae1d5a8c00b tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f0b27a48fd41dd846ba60856349ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4efd94380dcf4b3cb7a2b9fa194fcb83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:49.232425 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e2f3995d-69ef-43dd-be1b-1ae1d5a8c00b tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "GET /compute/v2.1/servers/560a01e5-93f8-46c8-9261-5030e28766b4" status: 200 len: 1318 microversion: 2.1 time: 0.342564 Aug 31 16:05:49.235988 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1227/2443] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:48 2022] GET /compute/v2.1/servers/560a01e5-93f8-46c8-9261-5030e28766b4 => generated 1318 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:49.238443 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-83de1072-af78-4580-8aeb-2eb5bd210f5f tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56] Going to try to terminate instance {{(pid=122256) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:05:49.249013 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-16830686-963c-4c39-9694-b58fdccdf96a tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:49.250138 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-16830686-963c-4c39-9694-b58fdccdf96a tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] [instance: 1f11f86d-3387-4c6e-9099-fc8d232b11a8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:49.257008 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-16830686-963c-4c39-9694-b58fdccdf96a tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:49.259728 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-16830686-963c-4c39-9694-b58fdccdf96a tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:49.260421 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-16830686-963c-4c39-9694-b58fdccdf96a tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:49.261350 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-16830686-963c-4c39-9694-b58fdccdf96a tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:49.261959 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-16830686-963c-4c39-9694-b58fdccdf96a tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:49.262496 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-16830686-963c-4c39-9694-b58fdccdf96a tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:49.343924 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-83de1072-af78-4580-8aeb-2eb5bd210f5f tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "DELETE /compute/v2.1/servers/bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56" status: 204 len: 0 microversion: 2.1 time: 0.161659 Aug 31 16:05:49.347983 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1217/2444] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:05:49 2022] DELETE /compute/v2.1/servers/bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:05:49.355665 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4fd13a98-94f6-4081-8c0a-6c22a7174020 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:49.356672 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4fd13a98-94f6-4081-8c0a-6c22a7174020 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: bf253a58-f38a-42d9-90b6-f3a80141cad2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:49.367011 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4fd13a98-94f6-4081-8c0a-6c22a7174020 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:49.367689 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4fd13a98-94f6-4081-8c0a-6c22a7174020 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:49.368226 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4fd13a98-94f6-4081-8c0a-6c22a7174020 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:49.369066 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4fd13a98-94f6-4081-8c0a-6c22a7174020 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:49.369640 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4fd13a98-94f6-4081-8c0a-6c22a7174020 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:49.371957 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4fd13a98-94f6-4081-8c0a-6c22a7174020 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:49.526560 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-16830686-963c-4c39-9694-b58fdccdf96a tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a837ababe7cb4284b96bc16deb40d2d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e9999df7e14609b1265351c83607bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:49.540818 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-16830686-963c-4c39-9694-b58fdccdf96a tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] 10.222.0.61 "GET /compute/v2.1/servers/1f11f86d-3387-4c6e-9099-fc8d232b11a8" status: 200 len: 1577 microversion: 2.1 time: 0.300810 Aug 31 16:05:49.544146 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1228/2445] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:49 2022] GET /compute/v2.1/servers/1f11f86d-3387-4c6e-9099-fc8d232b11a8 => generated 1577 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:49.552281 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-17b8b9ad-1d05-4eb5-8950-acfdbfc1f3fd tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:49.553766 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-17b8b9ad-1d05-4eb5-8950-acfdbfc1f3fd tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] [instance: 685d47e4-721e-4eae-b5f8-78fdb68454ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:49.565531 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-17b8b9ad-1d05-4eb5-8950-acfdbfc1f3fd tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:49.567320 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-17b8b9ad-1d05-4eb5-8950-acfdbfc1f3fd tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:49.568172 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-17b8b9ad-1d05-4eb5-8950-acfdbfc1f3fd tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:49.570521 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-17b8b9ad-1d05-4eb5-8950-acfdbfc1f3fd tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:49.571375 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-17b8b9ad-1d05-4eb5-8950-acfdbfc1f3fd tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:49.572646 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-17b8b9ad-1d05-4eb5-8950-acfdbfc1f3fd tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:49.621724 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-4fd13a98-94f6-4081-8c0a-6c22a7174020 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:49.642818 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4fd13a98-94f6-4081-8c0a-6c22a7174020 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/bf253a58-f38a-42d9-90b6-f3a80141cad2" status: 200 len: 1473 microversion: 2.1 time: 0.283342 Aug 31 16:05:49.644773 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1218/2446] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:49 2022] GET /compute/v2.1/servers/bf253a58-f38a-42d9-90b6-f3a80141cad2 => generated 1473 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:49.658041 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-407f5d2e-46ba-4b62-a9f5-c0389050b559 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:49.659278 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-407f5d2e-46ba-4b62-a9f5-c0389050b559 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:49.673737 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-407f5d2e-46ba-4b62-a9f5-c0389050b559 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:49.674781 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-407f5d2e-46ba-4b62-a9f5-c0389050b559 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:49.677467 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-407f5d2e-46ba-4b62-a9f5-c0389050b559 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:49.678913 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-407f5d2e-46ba-4b62-a9f5-c0389050b559 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:49.679929 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-407f5d2e-46ba-4b62-a9f5-c0389050b559 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:49.680782 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-407f5d2e-46ba-4b62-a9f5-c0389050b559 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:49.885171 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-17b8b9ad-1d05-4eb5-8950-acfdbfc1f3fd tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:49.908039 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-17b8b9ad-1d05-4eb5-8950-acfdbfc1f3fd tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:49.910913 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-17b8b9ad-1d05-4eb5-8950-acfdbfc1f3fd tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:49.912817 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-17b8b9ad-1d05-4eb5-8950-acfdbfc1f3fd tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] 10.222.0.61 "GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae" status: 200 len: 1753 microversion: 2.42 time: 0.367171 Aug 31 16:05:49.920340 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1229/2447] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:05:49 2022] GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae => generated 1753 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:05:49.948568 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-407f5d2e-46ba-4b62-a9f5-c0389050b559 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:49.949106 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7eba4600-dc19-4344-9185-95ae80d02bb4 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:49.949847 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7eba4600-dc19-4344-9185-95ae80d02bb4 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 1262191c-be8b-4535-8704-72db13e3f6cc] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:49.968884 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-407f5d2e-46ba-4b62-a9f5-c0389050b559 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56" status: 200 len: 1499 microversion: 2.1 time: 0.321861 Aug 31 16:05:49.972021 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1219/2448] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:49 2022] GET /compute/v2.1/servers/bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56 => generated 1499 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:49.980534 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-dd5cf985-0e7a-4cd7-9ff5-40735edbb4f1 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:49.981040 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-dd5cf985-0e7a-4cd7-9ff5-40735edbb4f1 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] [instance: 1f11f86d-3387-4c6e-9099-fc8d232b11a8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:49.989186 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7eba4600-dc19-4344-9185-95ae80d02bb4 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:49.990387 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dd5cf985-0e7a-4cd7-9ff5-40735edbb4f1 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:49.990904 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dd5cf985-0e7a-4cd7-9ff5-40735edbb4f1 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:49.991328 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dd5cf985-0e7a-4cd7-9ff5-40735edbb4f1 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:49.992297 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dd5cf985-0e7a-4cd7-9ff5-40735edbb4f1 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:49.992806 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dd5cf985-0e7a-4cd7-9ff5-40735edbb4f1 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:49.993293 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dd5cf985-0e7a-4cd7-9ff5-40735edbb4f1 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:49.993818 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7eba4600-dc19-4344-9185-95ae80d02bb4 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:49.996407 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7eba4600-dc19-4344-9185-95ae80d02bb4 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:49.999990 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7eba4600-dc19-4344-9185-95ae80d02bb4 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:50.000879 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7eba4600-dc19-4344-9185-95ae80d02bb4 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:50.001641 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7eba4600-dc19-4344-9185-95ae80d02bb4 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:50.135075 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-dd5cf985-0e7a-4cd7-9ff5-40735edbb4f1 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] 10.222.0.61 "GET /compute/v2.1/servers/1f11f86d-3387-4c6e-9099-fc8d232b11a8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.161003 Aug 31 16:05:50.136239 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1220/2449] 10.222.0.61 () {58 vars in 1275 bytes} [Wed Aug 31 16:05:49 2022] GET /compute/v2.1/servers/1f11f86d-3387-4c6e-9099-fc8d232b11a8/os-interface => generated 285 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:05:50.141532 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-dd91b8f2-cc0b-4489-997f-835e4a4eb00b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:50.142157 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-dd91b8f2-cc0b-4489-997f-835e4a4eb00b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 006771fc-9da9-4b78-9fad-f4b72c311fd5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:50.152871 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dd91b8f2-cc0b-4489-997f-835e4a4eb00b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:50.153776 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dd91b8f2-cc0b-4489-997f-835e4a4eb00b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:50.155612 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dd91b8f2-cc0b-4489-997f-835e4a4eb00b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:50.156014 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dd91b8f2-cc0b-4489-997f-835e4a4eb00b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:50.156182 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dd91b8f2-cc0b-4489-997f-835e4a4eb00b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:50.156857 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dd91b8f2-cc0b-4489-997f-835e4a4eb00b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:50.252171 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7eba4600-dc19-4344-9185-95ae80d02bb4 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:50.276193 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7eba4600-dc19-4344-9185-95ae80d02bb4 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/1262191c-be8b-4535-8704-72db13e3f6cc" status: 200 len: 1314 microversion: 2.1 time: 0.353156 Aug 31 16:05:50.278323 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1230/2450] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:49 2022] GET /compute/v2.1/servers/1262191c-be8b-4535-8704-72db13e3f6cc => generated 1314 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:50.291055 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ec8b9b8b-8bde-457f-926b-c6618575541c tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:50.291733 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ec8b9b8b-8bde-457f-926b-c6618575541c tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: f9b66475-83f6-49a3-bc63-8965fc1aec14] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:50.312311 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ec8b9b8b-8bde-457f-926b-c6618575541c tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:50.314183 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ec8b9b8b-8bde-457f-926b-c6618575541c tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:50.314668 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ec8b9b8b-8bde-457f-926b-c6618575541c tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:50.315952 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ec8b9b8b-8bde-457f-926b-c6618575541c tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:50.316627 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ec8b9b8b-8bde-457f-926b-c6618575541c tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:50.317383 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ec8b9b8b-8bde-457f-926b-c6618575541c tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:50.577575 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-dd91b8f2-cc0b-4489-997f-835e4a4eb00b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:50.615461 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ec8b9b8b-8bde-457f-926b-c6618575541c tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:50.620844 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-dd91b8f2-cc0b-4489-997f-835e4a4eb00b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:50.630185 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ec8b9b8b-8bde-457f-926b-c6618575541c tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/f9b66475-83f6-49a3-bc63-8965fc1aec14" status: 200 len: 1468 microversion: 2.1 time: 0.350708 Aug 31 16:05:50.631682 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1231/2451] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:50 2022] GET /compute/v2.1/servers/f9b66475-83f6-49a3-bc63-8965fc1aec14 => generated 1468 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:50.633884 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-dd91b8f2-cc0b-4489-997f-835e4a4eb00b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:50.636861 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-dd91b8f2-cc0b-4489-997f-835e4a4eb00b tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5" status: 200 len: 1477 microversion: 2.25 time: 0.498822 Aug 31 16:05:50.651879 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-90e4548b-1134-4506-9aab-353510831467 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:50.651879 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-90e4548b-1134-4506-9aab-353510831467 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] [instance: 560a01e5-93f8-46c8-9261-5030e28766b4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:50.653660 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1221/2452] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:05:50 2022] GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5 => generated 1477 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:05:50.668223 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-90e4548b-1134-4506-9aab-353510831467 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:50.668223 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-90e4548b-1134-4506-9aab-353510831467 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:50.668223 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-90e4548b-1134-4506-9aab-353510831467 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:50.668223 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-90e4548b-1134-4506-9aab-353510831467 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:50.668223 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-90e4548b-1134-4506-9aab-353510831467 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:50.668223 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-90e4548b-1134-4506-9aab-353510831467 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:50.684346 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-26f35ca9-f999-4106-ae72-77e20f8c91a6 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Calling method '.version_select at 0x7f5ae9079040>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:50.693074 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-26f35ca9-f999-4106-ae72-77e20f8c91a6 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:50.694688 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-26f35ca9-f999-4106-ae72-77e20f8c91a6 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:50.695069 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-26f35ca9-f999-4106-ae72-77e20f8c91a6 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:50.712338 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-26f35ca9-f999-4106-ae72-77e20f8c91a6 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] 10.222.0.61 "GET /compute/v2.1/os-migrations" status: 200 len: 3630 microversion: 2.25 time: 0.034178 Aug 31 16:05:50.724116 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1222/2453] 10.222.0.61 () {60 vars in 1184 bytes} [Wed Aug 31 16:05:50 2022] GET /compute/v2.1/os-migrations => generated 3630 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:05:50.730673 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e847a18e-55cb-48d0-9507-9634436d96bf tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:50.731581 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e847a18e-55cb-48d0-9507-9634436d96bf tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: bf253a58-f38a-42d9-90b6-f3a80141cad2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:50.742614 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e847a18e-55cb-48d0-9507-9634436d96bf tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:50.743675 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e847a18e-55cb-48d0-9507-9634436d96bf tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:50.744635 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e847a18e-55cb-48d0-9507-9634436d96bf tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:50.746080 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e847a18e-55cb-48d0-9507-9634436d96bf tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:50.747273 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e847a18e-55cb-48d0-9507-9634436d96bf tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:50.748176 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e847a18e-55cb-48d0-9507-9634436d96bf tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:51.101334 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-90e4548b-1134-4506-9aab-353510831467 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f0b27a48fd41dd846ba60856349ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4efd94380dcf4b3cb7a2b9fa194fcb83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:51.120993 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-90e4548b-1134-4506-9aab-353510831467 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "GET /compute/v2.1/servers/560a01e5-93f8-46c8-9261-5030e28766b4" status: 200 len: 1318 microversion: 2.1 time: 0.487412 Aug 31 16:05:51.124259 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1232/2454] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:50 2022] GET /compute/v2.1/servers/560a01e5-93f8-46c8-9261-5030e28766b4 => generated 1318 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:51.130095 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5013085c-5920-47fd-8acd-c57c83748b65 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:51.130283 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e847a18e-55cb-48d0-9507-9634436d96bf tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:51.131056 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5013085c-5920-47fd-8acd-c57c83748b65 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] [instance: 006771fc-9da9-4b78-9fad-f4b72c311fd5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:51.151108 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5013085c-5920-47fd-8acd-c57c83748b65 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:51.152783 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e847a18e-55cb-48d0-9507-9634436d96bf tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/bf253a58-f38a-42d9-90b6-f3a80141cad2" status: 200 len: 1473 microversion: 2.1 time: 0.426548 Aug 31 16:05:51.154279 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1223/2455] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:50 2022] GET /compute/v2.1/servers/bf253a58-f38a-42d9-90b6-f3a80141cad2 => generated 1473 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:51.154757 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5013085c-5920-47fd-8acd-c57c83748b65 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:51.155572 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5013085c-5920-47fd-8acd-c57c83748b65 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:51.156586 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5013085c-5920-47fd-8acd-c57c83748b65 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:51.157374 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5013085c-5920-47fd-8acd-c57c83748b65 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:51.158691 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5013085c-5920-47fd-8acd-c57c83748b65 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:51.161157 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-8e663475-3aa3-4428-aeb5-f8308dd14f86 req-ac4c42c0-8353-4c57-8664-e96d4c2c2311 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "560a01e5-93f8-46c8-9261-5030e28766b4", "name": "network-vif-plugged", "status": "completed", "tag": "f7a3259e-6ecb-48c9-a90a-0b0d027258f4"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:05:51.189624 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-8e663475-3aa3-4428-aeb5-f8308dd14f86 req-ac4c42c0-8353-4c57-8664-e96d4c2c2311 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:51.190625 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-8e663475-3aa3-4428-aeb5-f8308dd14f86 req-ac4c42c0-8353-4c57-8664-e96d4c2c2311 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:51.191233 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-8e663475-3aa3-4428-aeb5-f8308dd14f86 req-ac4c42c0-8353-4c57-8664-e96d4c2c2311 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:51.207627 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-8e663475-3aa3-4428-aeb5-f8308dd14f86 req-ac4c42c0-8353-4c57-8664-e96d4c2c2311 service nova] Creating event network-vif-plugged:f7a3259e-6ecb-48c9-a90a-0b0d027258f4 for instance 560a01e5-93f8-46c8-9261-5030e28766b4 on n-h2-850499-9 Aug 31 16:05:51.217312 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-8e663475-3aa3-4428-aeb5-f8308dd14f86 req-ac4c42c0-8353-4c57-8664-e96d4c2c2311 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061196 Aug 31 16:05:51.219247 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1224/2456] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:05:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:05:51.230793 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7d211599-accd-4a21-9fee-6e434f738b3f tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:51.232511 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7d211599-accd-4a21-9fee-6e434f738b3f tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] [instance: 685d47e4-721e-4eae-b5f8-78fdb68454ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:51.254523 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7d211599-accd-4a21-9fee-6e434f738b3f tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:51.255582 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7d211599-accd-4a21-9fee-6e434f738b3f tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:51.256907 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7d211599-accd-4a21-9fee-6e434f738b3f tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:51.258487 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7d211599-accd-4a21-9fee-6e434f738b3f tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:51.259877 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7d211599-accd-4a21-9fee-6e434f738b3f tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:51.260601 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7d211599-accd-4a21-9fee-6e434f738b3f tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:51.444257 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-5013085c-5920-47fd-8acd-c57c83748b65 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] Lazy-loading 'services' on Instance uuid 006771fc-9da9-4b78-9fad-f4b72c311fd5 {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:05:51.480904 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5013085c-5920-47fd-8acd-c57c83748b65 tempest-LiveAutoBlockMigrationV225Test-1073041172 tempest-LiveAutoBlockMigrationV225Test-1073041172-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5" status: 200 len: 1969 microversion: 2.25 time: 0.353040 Aug 31 16:05:51.482824 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1233/2457] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:05:51 2022] GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5 => generated 1969 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:05:51.497198 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-74e551e8-2c53-4495-82d7-2dc207c7839c tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:51.498794 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-74e551e8-2c53-4495-82d7-2dc207c7839c tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:51.538419 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-74e551e8-2c53-4495-82d7-2dc207c7839c tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:51.539449 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-74e551e8-2c53-4495-82d7-2dc207c7839c tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:51.540903 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-74e551e8-2c53-4495-82d7-2dc207c7839c tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:51.545204 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-74e551e8-2c53-4495-82d7-2dc207c7839c tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:51.548016 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-74e551e8-2c53-4495-82d7-2dc207c7839c tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:51.548692 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-74e551e8-2c53-4495-82d7-2dc207c7839c tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:51.739760 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7d211599-accd-4a21-9fee-6e434f738b3f tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:51.771031 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7d211599-accd-4a21-9fee-6e434f738b3f tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:51.781910 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7d211599-accd-4a21-9fee-6e434f738b3f tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:51.782378 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7d211599-accd-4a21-9fee-6e434f738b3f tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] 10.222.0.61 "GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae" status: 200 len: 1753 microversion: 2.42 time: 0.561177 Aug 31 16:05:51.783461 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1225/2458] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:05:51 2022] GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae => generated 1753 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:05:51.788440 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9ea17161-5160-452f-be6e-996986010fb1 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:51.789029 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9ea17161-5160-452f-be6e-996986010fb1 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 1262191c-be8b-4535-8704-72db13e3f6cc] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:51.819624 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9ea17161-5160-452f-be6e-996986010fb1 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:51.820172 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9ea17161-5160-452f-be6e-996986010fb1 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:51.820873 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9ea17161-5160-452f-be6e-996986010fb1 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:51.821695 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9ea17161-5160-452f-be6e-996986010fb1 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:51.822331 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9ea17161-5160-452f-be6e-996986010fb1 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:51.823033 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9ea17161-5160-452f-be6e-996986010fb1 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:52.057294 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-74e551e8-2c53-4495-82d7-2dc207c7839c tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:52.114999 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-74e551e8-2c53-4495-82d7-2dc207c7839c tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56" status: 200 len: 1499 microversion: 2.1 time: 0.628652 Aug 31 16:05:52.115668 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1234/2459] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:51 2022] GET /compute/v2.1/servers/bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56 => generated 1499 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:52.133902 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-829e7db2-d38e-47ed-9771-5d556d769fcb tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:52.135182 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-829e7db2-d38e-47ed-9771-5d556d769fcb tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 006771fc-9da9-4b78-9fad-f4b72c311fd5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:52.147846 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-829e7db2-d38e-47ed-9771-5d556d769fcb tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:52.150906 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-829e7db2-d38e-47ed-9771-5d556d769fcb tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:52.152680 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-829e7db2-d38e-47ed-9771-5d556d769fcb tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:52.153896 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-829e7db2-d38e-47ed-9771-5d556d769fcb tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:52.154806 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-829e7db2-d38e-47ed-9771-5d556d769fcb tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:52.155794 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-829e7db2-d38e-47ed-9771-5d556d769fcb tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:52.306818 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-829e7db2-d38e-47ed-9771-5d556d769fcb tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 006771fc-9da9-4b78-9fad-f4b72c311fd5] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:05:52.364785 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-9ea17161-5160-452f-be6e-996986010fb1 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:52.393385 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9ea17161-5160-452f-be6e-996986010fb1 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/1262191c-be8b-4535-8704-72db13e3f6cc" status: 200 len: 1501 microversion: 2.1 time: 0.603234 Aug 31 16:05:52.395004 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1226/2460] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:51 2022] GET /compute/v2.1/servers/1262191c-be8b-4535-8704-72db13e3f6cc => generated 1501 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:52.399899 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d50c6362-f35c-42bc-9f2a-eada4cec2825 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:52.400915 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d50c6362-f35c-42bc-9f2a-eada4cec2825 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: f9b66475-83f6-49a3-bc63-8965fc1aec14] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:52.422346 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d50c6362-f35c-42bc-9f2a-eada4cec2825 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:52.423244 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d50c6362-f35c-42bc-9f2a-eada4cec2825 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:52.423939 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d50c6362-f35c-42bc-9f2a-eada4cec2825 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:52.426562 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d50c6362-f35c-42bc-9f2a-eada4cec2825 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:52.428210 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d50c6362-f35c-42bc-9f2a-eada4cec2825 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:52.430881 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d50c6362-f35c-42bc-9f2a-eada4cec2825 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:52.576794 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-829e7db2-d38e-47ed-9771-5d556d769fcb tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "DELETE /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5" status: 204 len: 0 microversion: 2.25 time: 0.454585 Aug 31 16:05:52.577722 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1235/2461] 10.222.0.61 () {60 vars in 1280 bytes} [Wed Aug 31 16:05:52 2022] DELETE /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 16:05:52.600149 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b098bb9a-8345-4a5b-a16d-289ac45f6811 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:52.601435 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b098bb9a-8345-4a5b-a16d-289ac45f6811 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] [instance: 560a01e5-93f8-46c8-9261-5030e28766b4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:52.613969 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b098bb9a-8345-4a5b-a16d-289ac45f6811 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:52.614828 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b098bb9a-8345-4a5b-a16d-289ac45f6811 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:52.615644 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b098bb9a-8345-4a5b-a16d-289ac45f6811 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:52.617150 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b098bb9a-8345-4a5b-a16d-289ac45f6811 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:52.619042 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b098bb9a-8345-4a5b-a16d-289ac45f6811 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:52.619626 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b098bb9a-8345-4a5b-a16d-289ac45f6811 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:54.043592 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=3 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:05:54.395532 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b098bb9a-8345-4a5b-a16d-289ac45f6811 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f0b27a48fd41dd846ba60856349ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4efd94380dcf4b3cb7a2b9fa194fcb83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:54.462159 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b098bb9a-8345-4a5b-a16d-289ac45f6811 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "GET /compute/v2.1/servers/560a01e5-93f8-46c8-9261-5030e28766b4" status: 200 len: 1318 microversion: 2.1 time: 1.877488 Aug 31 16:05:54.467870 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1236/2462] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:52 2022] GET /compute/v2.1/servers/560a01e5-93f8-46c8-9261-5030e28766b4 => generated 1318 bytes in 1889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:54.486820 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0074ef6e-bf0e-47e6-b868-cc9dadb285e2 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:54.488877 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0074ef6e-bf0e-47e6-b868-cc9dadb285e2 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: bf253a58-f38a-42d9-90b6-f3a80141cad2] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:54.509222 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0074ef6e-bf0e-47e6-b868-cc9dadb285e2 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:54.509222 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0074ef6e-bf0e-47e6-b868-cc9dadb285e2 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:54.510454 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0074ef6e-bf0e-47e6-b868-cc9dadb285e2 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:54.511628 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0074ef6e-bf0e-47e6-b868-cc9dadb285e2 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:54.513105 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0074ef6e-bf0e-47e6-b868-cc9dadb285e2 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:54.514298 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0074ef6e-bf0e-47e6-b868-cc9dadb285e2 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:54.897651 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d50c6362-f35c-42bc-9f2a-eada4cec2825 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:54.914587 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d50c6362-f35c-42bc-9f2a-eada4cec2825 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/f9b66475-83f6-49a3-bc63-8965fc1aec14" status: 200 len: 1468 microversion: 2.1 time: 2.518234 Aug 31 16:05:54.934912 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1227/2463] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:52 2022] GET /compute/v2.1/servers/f9b66475-83f6-49a3-bc63-8965fc1aec14 => generated 1468 bytes in 2539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:54.943159 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-489a7166-97ce-4691-95d4-20874ff05d7c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:05:54.944422 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-489a7166-97ce-4691-95d4-20874ff05d7c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 1262191c-be8b-4535-8704-72db13e3f6cc] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:54.967938 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-489a7166-97ce-4691-95d4-20874ff05d7c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:54.970870 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-489a7166-97ce-4691-95d4-20874ff05d7c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:54.975657 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-489a7166-97ce-4691-95d4-20874ff05d7c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:54.977830 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-489a7166-97ce-4691-95d4-20874ff05d7c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:54.985903 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-489a7166-97ce-4691-95d4-20874ff05d7c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:54.987324 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-489a7166-97ce-4691-95d4-20874ff05d7c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:55.010057 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:05:55.214829 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-489a7166-97ce-4691-95d4-20874ff05d7c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "POST /compute/v2.1/servers/1262191c-be8b-4535-8704-72db13e3f6cc/action" status: 202 len: 0 microversion: 2.1 time: 0.276676 Aug 31 16:05:55.220901 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1228/2464] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:05:54 2022] POST /compute/v2.1/servers/1262191c-be8b-4535-8704-72db13e3f6cc/action => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:05:55.228415 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-575f5d32-7b84-4b41-ba9c-55c22b18d94f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:55.229142 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-575f5d32-7b84-4b41-ba9c-55c22b18d94f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 006771fc-9da9-4b78-9fad-f4b72c311fd5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:55.260388 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-575f5d32-7b84-4b41-ba9c-55c22b18d94f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:55.261096 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-575f5d32-7b84-4b41-ba9c-55c22b18d94f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:55.261558 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-575f5d32-7b84-4b41-ba9c-55c22b18d94f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:55.262360 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-575f5d32-7b84-4b41-ba9c-55c22b18d94f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:55.262886 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-575f5d32-7b84-4b41-ba9c-55c22b18d94f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:55.263557 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-575f5d32-7b84-4b41-ba9c-55c22b18d94f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:55.954371 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0074ef6e-bf0e-47e6-b868-cc9dadb285e2 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:55.979356 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0074ef6e-bf0e-47e6-b868-cc9dadb285e2 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/bf253a58-f38a-42d9-90b6-f3a80141cad2" status: 200 len: 1473 microversion: 2.1 time: 1.509166 Aug 31 16:05:55.986841 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1237/2465] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:54 2022] GET /compute/v2.1/servers/bf253a58-f38a-42d9-90b6-f3a80141cad2 => generated 1473 bytes in 1518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:55.998703 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0c67c1f9-a4c3-4ce0-bd5b-708e997f149f tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:56.002094 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0c67c1f9-a4c3-4ce0-bd5b-708e997f149f tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] [instance: 685d47e4-721e-4eae-b5f8-78fdb68454ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:56.018914 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0c67c1f9-a4c3-4ce0-bd5b-708e997f149f tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:56.019718 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0c67c1f9-a4c3-4ce0-bd5b-708e997f149f tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:56.023758 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0c67c1f9-a4c3-4ce0-bd5b-708e997f149f tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:56.024859 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0c67c1f9-a4c3-4ce0-bd5b-708e997f149f tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:56.025502 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0c67c1f9-a4c3-4ce0-bd5b-708e997f149f tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:56.026108 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0c67c1f9-a4c3-4ce0-bd5b-708e997f149f tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:57.387268 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-575f5d32-7b84-4b41-ba9c-55c22b18d94f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:57.411919 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-575f5d32-7b84-4b41-ba9c-55c22b18d94f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:57.426115 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-575f5d32-7b84-4b41-ba9c-55c22b18d94f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:57.429447 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-575f5d32-7b84-4b41-ba9c-55c22b18d94f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5" status: 200 len: 1483 microversion: 2.25 time: 2.206351 Aug 31 16:05:57.430979 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1229/2466] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:05:55 2022] GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5 => generated 1483 bytes in 2209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:05:57.437850 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b0e06c1c-42e3-41e0-b371-c6ca7f732d2b tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:57.438865 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b0e06c1c-42e3-41e0-b371-c6ca7f732d2b tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:57.447753 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b0e06c1c-42e3-41e0-b371-c6ca7f732d2b tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:57.448751 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b0e06c1c-42e3-41e0-b371-c6ca7f732d2b tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:57.449353 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b0e06c1c-42e3-41e0-b371-c6ca7f732d2b tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:57.450232 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b0e06c1c-42e3-41e0-b371-c6ca7f732d2b tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:57.450999 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b0e06c1c-42e3-41e0-b371-c6ca7f732d2b tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:57.452212 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b0e06c1c-42e3-41e0-b371-c6ca7f732d2b tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:57.744193 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b0e06c1c-42e3-41e0-b371-c6ca7f732d2b tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0e032fc09b48ada1dfe99e549aa623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150e5f8e376a40e089de8ed092e269fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:57.770035 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b0e06c1c-42e3-41e0-b371-c6ca7f732d2b tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56" status: 200 len: 1457 microversion: 2.1 time: 0.336970 Aug 31 16:05:57.770633 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1230/2467] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:57 2022] GET /compute/v2.1/servers/bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56 => generated 1457 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:57.781603 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-224d428d-71ba-49f1-a47b-5c15b464821f tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:57.782269 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-224d428d-71ba-49f1-a47b-5c15b464821f tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] [instance: 1f11f86d-3387-4c6e-9099-fc8d232b11a8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:57.793451 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-224d428d-71ba-49f1-a47b-5c15b464821f tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:57.793451 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-224d428d-71ba-49f1-a47b-5c15b464821f tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:57.797685 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-224d428d-71ba-49f1-a47b-5c15b464821f tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:57.799654 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-224d428d-71ba-49f1-a47b-5c15b464821f tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:57.807688 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-224d428d-71ba-49f1-a47b-5c15b464821f tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:57.809067 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-224d428d-71ba-49f1-a47b-5c15b464821f tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:58.042835 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0c67c1f9-a4c3-4ce0-bd5b-708e997f149f tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:58.115784 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0c67c1f9-a4c3-4ce0-bd5b-708e997f149f tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:58.129836 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0c67c1f9-a4c3-4ce0-bd5b-708e997f149f tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:58.136481 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0c67c1f9-a4c3-4ce0-bd5b-708e997f149f tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] 10.222.0.61 "GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae" status: 200 len: 1845 microversion: 2.42 time: 2.143985 Aug 31 16:05:58.166037 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1238/2468] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:05:55 2022] GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae => generated 1845 bytes in 2175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:05:58.186285 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-93fe6637-ec7b-4237-8d8e-a7d3886a6098 req-ce86d609-ea62-47a6-9f53-9e99c221faa4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f11f86d-3387-4c6e-9099-fc8d232b11a8", "tag": "63593e47-213f-4d04-ae59-a652fc80fcbd"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:05:58.204613 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-93fe6637-ec7b-4237-8d8e-a7d3886a6098 req-ce86d609-ea62-47a6-9f53-9e99c221faa4 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:58.206110 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-93fe6637-ec7b-4237-8d8e-a7d3886a6098 req-ce86d609-ea62-47a6-9f53-9e99c221faa4 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:58.207109 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-93fe6637-ec7b-4237-8d8e-a7d3886a6098 req-ce86d609-ea62-47a6-9f53-9e99c221faa4 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:58.246245 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-93fe6637-ec7b-4237-8d8e-a7d3886a6098 req-ce86d609-ea62-47a6-9f53-9e99c221faa4 service nova] Creating event network-changed:63593e47-213f-4d04-ae59-a652fc80fcbd for instance 1f11f86d-3387-4c6e-9099-fc8d232b11a8 on n-h2-850499-9 Aug 31 16:05:58.266239 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-93fe6637-ec7b-4237-8d8e-a7d3886a6098 req-ce86d609-ea62-47a6-9f53-9e99c221faa4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096399 Aug 31 16:05:58.268526 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1239/2469] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:05:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:05:58.280785 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3a327131-c1ce-455b-9471-ac5416cdfa55 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:58.282093 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3a327131-c1ce-455b-9471-ac5416cdfa55 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 1262191c-be8b-4535-8704-72db13e3f6cc] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:58.294571 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3a327131-c1ce-455b-9471-ac5416cdfa55 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:58.295601 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3a327131-c1ce-455b-9471-ac5416cdfa55 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:58.296351 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3a327131-c1ce-455b-9471-ac5416cdfa55 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:58.298012 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3a327131-c1ce-455b-9471-ac5416cdfa55 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:58.298988 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3a327131-c1ce-455b-9471-ac5416cdfa55 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:58.302650 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3a327131-c1ce-455b-9471-ac5416cdfa55 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:58.343651 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:05:59.316841 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-224d428d-71ba-49f1-a47b-5c15b464821f tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a837ababe7cb4284b96bc16deb40d2d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e9999df7e14609b1265351c83607bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:59.358086 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-224d428d-71ba-49f1-a47b-5c15b464821f tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] 10.222.0.61 "GET /compute/v2.1/servers/1f11f86d-3387-4c6e-9099-fc8d232b11a8" status: 200 len: 1577 microversion: 2.1 time: 1.584832 Aug 31 16:05:59.364649 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3a327131-c1ce-455b-9471-ac5416cdfa55 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:59.368926 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1231/2470] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:57 2022] GET /compute/v2.1/servers/1f11f86d-3387-4c6e-9099-fc8d232b11a8 => generated 1577 bytes in 1598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:59.384250 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3a327131-c1ce-455b-9471-ac5416cdfa55 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/1262191c-be8b-4535-8704-72db13e3f6cc" status: 200 len: 1486 microversion: 2.1 time: 1.112943 Aug 31 16:05:59.390474 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1240/2471] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:58 2022] GET /compute/v2.1/servers/1262191c-be8b-4535-8704-72db13e3f6cc => generated 1486 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:59.405134 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-bdaf98fc-253d-4981-b8e0-76f07ae8a581 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:59.405782 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-bdaf98fc-253d-4981-b8e0-76f07ae8a581 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] [instance: 560a01e5-93f8-46c8-9261-5030e28766b4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:59.406433 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-10963ad1-d029-48ed-9228-5f1ef66a397c tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:59.407309 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-10963ad1-d029-48ed-9228-5f1ef66a397c tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: f9b66475-83f6-49a3-bc63-8965fc1aec14] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:59.431418 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-10963ad1-d029-48ed-9228-5f1ef66a397c tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:59.432375 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-10963ad1-d029-48ed-9228-5f1ef66a397c tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:59.433148 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-10963ad1-d029-48ed-9228-5f1ef66a397c tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:59.435482 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-10963ad1-d029-48ed-9228-5f1ef66a397c tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:59.436251 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-10963ad1-d029-48ed-9228-5f1ef66a397c tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:59.442771 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-10963ad1-d029-48ed-9228-5f1ef66a397c tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:59.445393 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:05:59.447918 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bdaf98fc-253d-4981-b8e0-76f07ae8a581 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:59.452568 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bdaf98fc-253d-4981-b8e0-76f07ae8a581 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:59.453605 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bdaf98fc-253d-4981-b8e0-76f07ae8a581 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:59.458851 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bdaf98fc-253d-4981-b8e0-76f07ae8a581 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:59.460053 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bdaf98fc-253d-4981-b8e0-76f07ae8a581 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:59.460947 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bdaf98fc-253d-4981-b8e0-76f07ae8a581 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:00.498661 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-bdaf98fc-253d-4981-b8e0-76f07ae8a581 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f0b27a48fd41dd846ba60856349ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4efd94380dcf4b3cb7a2b9fa194fcb83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:00.512773 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-bdaf98fc-253d-4981-b8e0-76f07ae8a581 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "GET /compute/v2.1/servers/560a01e5-93f8-46c8-9261-5030e28766b4" status: 200 len: 1467 microversion: 2.1 time: 1.142087 Aug 31 16:06:00.514118 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1232/2472] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:59 2022] GET /compute/v2.1/servers/560a01e5-93f8-46c8-9261-5030e28766b4 => generated 1467 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:00.522829 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-7cbaeed0-0f4a-458e-a102-6f4f5c9b962c req-d0265b10-b106-4961-98c2-3edf87bcfd20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9b66475-83f6-49a3-bc63-8965fc1aec14", "name": "network-vif-unplugged", "status": "completed", "tag": "c1929c28-a0f2-4fed-aba4-ecfd08ac8e7e"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:06:00.541321 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-7cbaeed0-0f4a-458e-a102-6f4f5c9b962c req-d0265b10-b106-4961-98c2-3edf87bcfd20 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:00.543920 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-7cbaeed0-0f4a-458e-a102-6f4f5c9b962c req-d0265b10-b106-4961-98c2-3edf87bcfd20 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:00.544987 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-7cbaeed0-0f4a-458e-a102-6f4f5c9b962c req-d0265b10-b106-4961-98c2-3edf87bcfd20 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:00.561092 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-10963ad1-d029-48ed-9228-5f1ef66a397c tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:00.570259 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-7cbaeed0-0f4a-458e-a102-6f4f5c9b962c req-d0265b10-b106-4961-98c2-3edf87bcfd20 service nova] Creating event network-vif-unplugged:c1929c28-a0f2-4fed-aba4-ecfd08ac8e7e for instance f9b66475-83f6-49a3-bc63-8965fc1aec14 on n-h2-850499-9 Aug 31 16:06:00.581305 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-10963ad1-d029-48ed-9228-5f1ef66a397c tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/f9b66475-83f6-49a3-bc63-8965fc1aec14" status: 200 len: 1534 microversion: 2.1 time: 1.187785 Aug 31 16:06:00.583693 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1241/2473] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:59 2022] GET /compute/v2.1/servers/f9b66475-83f6-49a3-bc63-8965fc1aec14 => generated 1534 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:00.604394 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [req-7cbaeed0-0f4a-458e-a102-6f4f5c9b962c req-d0265b10-b106-4961-98c2-3edf87bcfd20 service nova] Instance f9b66475-83f6-49a3-bc63-8965fc1aec14 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850499-9', 'n-h1-850499-9'} {{(pid=122256) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 31 16:06:00.610855 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-d3b9c067-0db4-46b8-bf93-2d7b1af05d3b req-9cd1736b-f985-4320-abe0-94b94b553c2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "646d0250-a626-4bd1-821b-2117fde78cc8", "name": "network-vif-deleted", "tag": "747c0501-222d-4eee-84f7-1e23b1a1f270"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:06:00.632608 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-7cbaeed0-0f4a-458e-a102-6f4f5c9b962c req-d0265b10-b106-4961-98c2-3edf87bcfd20 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.115874 Aug 31 16:06:00.634219 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-d3b9c067-0db4-46b8-bf93-2d7b1af05d3b req-9cd1736b-f985-4320-abe0-94b94b553c2b service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:00.634888 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-d3b9c067-0db4-46b8-bf93-2d7b1af05d3b req-9cd1736b-f985-4320-abe0-94b94b553c2b service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:00.635474 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-d3b9c067-0db4-46b8-bf93-2d7b1af05d3b req-9cd1736b-f985-4320-abe0-94b94b553c2b service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:00.644590 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1233/2474] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:06:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:06:00.652328 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-d3b9c067-0db4-46b8-bf93-2d7b1af05d3b req-9cd1736b-f985-4320-abe0-94b94b553c2b service nova] Creating event network-vif-deleted:747c0501-222d-4eee-84f7-1e23b1a1f270 for instance 646d0250-a626-4bd1-821b-2117fde78cc8 on n-h1-850499-9 Aug 31 16:06:00.656341 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-fa51bf81-82da-4738-9bf5-ea506b429537 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:00.657447 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-d3b9c067-0db4-46b8-bf93-2d7b1af05d3b req-9cd1736b-f985-4320-abe0-94b94b553c2b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069236 Aug 31 16:06:00.658244 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1242/2475] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:06:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:06:00.659850 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-fa51bf81-82da-4738-9bf5-ea506b429537 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: bf253a58-f38a-42d9-90b6-f3a80141cad2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:00.664929 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f5b62e81-57de-4792-b4bd-0e139b07c4f7 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:00.666271 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f5b62e81-57de-4792-b4bd-0e139b07c4f7 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 006771fc-9da9-4b78-9fad-f4b72c311fd5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:00.674843 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fa51bf81-82da-4738-9bf5-ea506b429537 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:00.675074 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f5b62e81-57de-4792-b4bd-0e139b07c4f7 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:00.675826 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f5b62e81-57de-4792-b4bd-0e139b07c4f7 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:00.676202 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fa51bf81-82da-4738-9bf5-ea506b429537 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:00.677053 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f5b62e81-57de-4792-b4bd-0e139b07c4f7 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:00.677373 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fa51bf81-82da-4738-9bf5-ea506b429537 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:00.678158 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f5b62e81-57de-4792-b4bd-0e139b07c4f7 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:00.678778 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f5b62e81-57de-4792-b4bd-0e139b07c4f7 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:00.678896 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fa51bf81-82da-4738-9bf5-ea506b429537 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:00.679458 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f5b62e81-57de-4792-b4bd-0e139b07c4f7 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:00.680297 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fa51bf81-82da-4738-9bf5-ea506b429537 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:00.680901 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fa51bf81-82da-4738-9bf5-ea506b429537 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:00.765233 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fa51bf81-82da-4738-9bf5-ea506b429537 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:00.775186 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fa51bf81-82da-4738-9bf5-ea506b429537 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:00.776472 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fa51bf81-82da-4738-9bf5-ea506b429537 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:00.777336 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-fa51bf81-82da-4738-9bf5-ea506b429537 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lazy-loading 'fault' on Instance uuid bf253a58-f38a-42d9-90b6-f3a80141cad2 {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:06:00.845396 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f5b62e81-57de-4792-b4bd-0e139b07c4f7 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:00.856982 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f5b62e81-57de-4792-b4bd-0e139b07c4f7 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:00.859440 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f5b62e81-57de-4792-b4bd-0e139b07c4f7 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:00.860885 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f5b62e81-57de-4792-b4bd-0e139b07c4f7 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5" status: 200 len: 1265 microversion: 2.25 time: 0.201361 Aug 31 16:06:00.861983 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1243/2476] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:06:00 2022] GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5 => generated 1265 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:06:00.867417 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8b9f3a12-c1af-475e-a7c6-960597ebcad9 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:00.868329 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8b9f3a12-c1af-475e-a7c6-960597ebcad9 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] [instance: bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:00.876012 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b9f3a12-c1af-475e-a7c6-960597ebcad9 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:00.876899 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b9f3a12-c1af-475e-a7c6-960597ebcad9 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:00.877482 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b9f3a12-c1af-475e-a7c6-960597ebcad9 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:00.878403 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b9f3a12-c1af-475e-a7c6-960597ebcad9 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:00.879044 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b9f3a12-c1af-475e-a7c6-960597ebcad9 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:00.879744 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b9f3a12-c1af-475e-a7c6-960597ebcad9 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:00.900843 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-8b9f3a12-c1af-475e-a7c6-960597ebcad9 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] HTTP exception thrown: Instance bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56 could not be found. Aug 31 16:06:00.904651 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8b9f3a12-c1af-475e-a7c6-960597ebcad9 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Request method failure captured: Aug 31 16:06:00.904651 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56 HTTP/1.1 Aug 31 16:06:00.904651 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:06:00.904651 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:06:00.904651 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:06:00.904651 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:06:00.904651 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:06:00.904651 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:06:00.904651 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:06:00.904651 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:06:00.904651 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4St87glls8nrcJLaszJCTH3u-5gjP_zR_CDcTJmGRy-icHFnPPaQEjN24lPcF68k7cJy-u1N7wTTpAM3QT_rwVgkInJP4vDJQWfb13puTbBaWpSNY7AqOuE9gOwubT4HvKPey49JpgyvzFifvxP5d5LPnrAimWxJ7aL70cmuBZOFis Aug 31 16:06:00.904651 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:06:00.904651 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:06:00.904651 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:06:00.904651 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:06:00.904651 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:06:00.904651 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:06:00.904651 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 150e5f8e376a40e089de8ed092e269fd Aug 31 16:06:00.904651 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-LiveMigrationTest-774357135 Aug 31 16:06:00.904651 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:06:00.904651 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:06:00.904651 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/150e5f8e376a40e089de8ed092e269fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/150e5f8e376a40e089de8ed092e269fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_150e5f8e376a40e089de8ed092e269fd", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/150e5f8e376a40e089de8ed092e269fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:06:00.904651 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-LiveMigrationTest-774357135 Aug 31 16:06:00.904651 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 150e5f8e376a40e089de8ed092e269fd Aug 31 16:06:00.904651 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-LiveMigrationTest-774357135 Aug 31 16:06:00.904651 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-LiveMigrationTest-774357135-project Aug 31 16:06:00.904651 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:06:00.904651 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:06:00.904651 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: de0e032fc09b48ada1dfe99e549aa623 Aug 31 16:06:00.904651 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-LiveMigrationTest-774357135-project Aug 31 16:06:00.904651 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:06:00.904651 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56 could not be found. Aug 31 16:06:00.904651 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': 'bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56'} Aug 31 16:06:00.904651 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:06:00.904651 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:06:00.904651 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:06:00.904651 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:06:00.904651 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:06:00.904651 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:06:00.904651 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:06:00.904651 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:06:00.904651 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:06:00.904651 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:06:00.904651 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56 could not be found. Aug 31 16:06:00.904651 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:06:00.904651 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:06:00.904651 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:06:00.904651 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:06:00.904651 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:06:00.904651 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:06:00.904651 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:06:00.904651 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:06:00.904651 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:06:00.904651 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:06:00.904651 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:06:00.904651 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:06:00.904651 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:06:00.904651 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:06:00.904651 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:06:00.904651 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:06:00.904651 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56 could not be found. Aug 31 16:06:00.904651 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:06:00.904651 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:06:00.904651 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:06:00.908462 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:06:00.908462 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:06:00.908462 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:06:00.908462 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:06:00.908462 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:06:00.908462 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56 could not be found. Aug 31 16:06:00.908462 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:06:00.909859 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8b9f3a12-c1af-475e-a7c6-960597ebcad9 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] Returning 404 to user: Instance bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:06:00.910888 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8b9f3a12-c1af-475e-a7c6-960597ebcad9 tempest-LiveMigrationTest-774357135 tempest-LiveMigrationTest-774357135-project] 10.222.0.61 "GET /compute/v2.1/servers/bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56" status: 404 len: 111 microversion: 2.1 time: 0.047759 Aug 31 16:06:00.912073 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1244/2477] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:00 2022] GET /compute/v2.1/servers/bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:06:00.917970 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-46b676c5-c3b6-424d-b4d4-ed7ab1dcb2c0 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:00.918943 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-46b676c5-c3b6-424d-b4d4-ed7ab1dcb2c0 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] [instance: 685d47e4-721e-4eae-b5f8-78fdb68454ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:00.927078 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-46b676c5-c3b6-424d-b4d4-ed7ab1dcb2c0 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:00.928794 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-46b676c5-c3b6-424d-b4d4-ed7ab1dcb2c0 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:00.929541 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-46b676c5-c3b6-424d-b4d4-ed7ab1dcb2c0 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:00.930480 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-46b676c5-c3b6-424d-b4d4-ed7ab1dcb2c0 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:00.931123 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-46b676c5-c3b6-424d-b4d4-ed7ab1dcb2c0 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:00.931735 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-46b676c5-c3b6-424d-b4d4-ed7ab1dcb2c0 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:01.065387 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-fa51bf81-82da-4738-9bf5-ea506b429537 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:01.078851 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-fa51bf81-82da-4738-9bf5-ea506b429537 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/bf253a58-f38a-42d9-90b6-f3a80141cad2" status: 200 len: 1308 microversion: 2.1 time: 0.431568 Aug 31 16:06:01.096804 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1234/2478] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:00 2022] GET /compute/v2.1/servers/bf253a58-f38a-42d9-90b6-f3a80141cad2 => generated 1308 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:01.105359 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-07cb6d25-ffc5-4047-9066-25e5ed6d2933 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:01.106077 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-07cb6d25-ffc5-4047-9066-25e5ed6d2933 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 1262191c-be8b-4535-8704-72db13e3f6cc] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:01.125990 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-07cb6d25-ffc5-4047-9066-25e5ed6d2933 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:01.126498 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-07cb6d25-ffc5-4047-9066-25e5ed6d2933 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:01.126946 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-07cb6d25-ffc5-4047-9066-25e5ed6d2933 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:01.127746 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-07cb6d25-ffc5-4047-9066-25e5ed6d2933 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:01.128407 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-07cb6d25-ffc5-4047-9066-25e5ed6d2933 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:01.128993 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-07cb6d25-ffc5-4047-9066-25e5ed6d2933 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:01.189628 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-07cb6d25-ffc5-4047-9066-25e5ed6d2933 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 1262191c-be8b-4535-8704-72db13e3f6cc] Going to try to terminate instance {{(pid=122256) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:06:01.422130 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-07cb6d25-ffc5-4047-9066-25e5ed6d2933 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "DELETE /compute/v2.1/servers/1262191c-be8b-4535-8704-72db13e3f6cc" status: 204 len: 0 microversion: 2.1 time: 0.323249 Aug 31 16:06:01.423087 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1235/2479] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:06:01 2022] DELETE /compute/v2.1/servers/1262191c-be8b-4535-8704-72db13e3f6cc => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:06:01.442433 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-585f5cf9-6886-4312-aaed-184f9930a41b req-565b481a-5674-4df9-a4af-4abb9697885d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "685d47e4-721e-4eae-b5f8-78fdb68454ae", "tag": "b14c9074-fcb3-408a-abec-9842ca262740"}, {"name": "network-changed", "server_uuid": "685d47e4-721e-4eae-b5f8-78fdb68454ae", "tag": "4f30e818-6489-4d7e-b214-37689cbe6c21"}, {"name": "network-changed", "server_uuid": "685d47e4-721e-4eae-b5f8-78fdb68454ae", "tag": "4fb7438a-39e7-4bab-9387-26385ed169d1"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:06:01.475706 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-585f5cf9-6886-4312-aaed-184f9930a41b req-565b481a-5674-4df9-a4af-4abb9697885d service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:01.476845 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-585f5cf9-6886-4312-aaed-184f9930a41b req-565b481a-5674-4df9-a4af-4abb9697885d service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:01.479110 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-585f5cf9-6886-4312-aaed-184f9930a41b req-565b481a-5674-4df9-a4af-4abb9697885d service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:01.522762 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-585f5cf9-6886-4312-aaed-184f9930a41b req-565b481a-5674-4df9-a4af-4abb9697885d service nova] Creating event network-changed:b14c9074-fcb3-408a-abec-9842ca262740 for instance 685d47e4-721e-4eae-b5f8-78fdb68454ae on n-h2-850499-9 Aug 31 16:06:01.525188 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-585f5cf9-6886-4312-aaed-184f9930a41b req-565b481a-5674-4df9-a4af-4abb9697885d service nova] Creating event network-changed:4f30e818-6489-4d7e-b214-37689cbe6c21 for instance 685d47e4-721e-4eae-b5f8-78fdb68454ae on n-h2-850499-9 Aug 31 16:06:01.526296 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-585f5cf9-6886-4312-aaed-184f9930a41b req-565b481a-5674-4df9-a4af-4abb9697885d service nova] Creating event network-changed:4fb7438a-39e7-4bab-9387-26385ed169d1 for instance 685d47e4-721e-4eae-b5f8-78fdb68454ae on n-h2-850499-9 Aug 31 16:06:01.554567 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-585f5cf9-6886-4312-aaed-184f9930a41b req-565b481a-5674-4df9-a4af-4abb9697885d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.124986 Aug 31 16:06:01.556253 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1236/2480] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:06:01 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:06:01.567710 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-20679cdc-cf3d-423c-8a4d-733956fb9ff2 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:01.569764 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-20679cdc-cf3d-423c-8a4d-733956fb9ff2 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] [instance: 359f06bd-00e9-4d68-b066-db73d7073a04] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:01.581247 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-20679cdc-cf3d-423c-8a4d-733956fb9ff2 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:01.582098 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-20679cdc-cf3d-423c-8a4d-733956fb9ff2 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:01.582759 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-20679cdc-cf3d-423c-8a4d-733956fb9ff2 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:01.585693 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-20679cdc-cf3d-423c-8a4d-733956fb9ff2 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:01.586431 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-20679cdc-cf3d-423c-8a4d-733956fb9ff2 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:01.587491 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-20679cdc-cf3d-423c-8a4d-733956fb9ff2 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:01.941042 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-46b676c5-c3b6-424d-b4d4-ed7ab1dcb2c0 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:01.968458 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-46b676c5-c3b6-424d-b4d4-ed7ab1dcb2c0 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:01.969511 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-20679cdc-cf3d-423c-8a4d-733956fb9ff2 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f0b27a48fd41dd846ba60856349ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4efd94380dcf4b3cb7a2b9fa194fcb83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:01.971935 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-46b676c5-c3b6-424d-b4d4-ed7ab1dcb2c0 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:01.976932 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-46b676c5-c3b6-424d-b4d4-ed7ab1dcb2c0 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] 10.222.0.61 "GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae" status: 200 len: 1887 microversion: 2.42 time: 1.063383 Aug 31 16:06:01.981496 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1245/2481] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:06:00 2022] GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae => generated 1887 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:06:01.989334 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-dd3ef5f8-ee36-4cb7-abb7-99485606e6b0 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:01.998406 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-dd3ef5f8-ee36-4cb7-abb7-99485606e6b0 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 1262191c-be8b-4535-8704-72db13e3f6cc] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:02.001437 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-20679cdc-cf3d-423c-8a4d-733956fb9ff2 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "GET /compute/v2.1/servers/359f06bd-00e9-4d68-b066-db73d7073a04" status: 200 len: 1466 microversion: 2.1 time: 0.442407 Aug 31 16:06:02.002379 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1237/2482] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:01 2022] GET /compute/v2.1/servers/359f06bd-00e9-4d68-b066-db73d7073a04 => generated 1466 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:02.007339 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f5d7f35d-2eaa-4a94-aa72-0a10528bd89d tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:02.007993 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f5d7f35d-2eaa-4a94-aa72-0a10528bd89d tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: f9b66475-83f6-49a3-bc63-8965fc1aec14] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:02.020901 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f5d7f35d-2eaa-4a94-aa72-0a10528bd89d tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:02.022113 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f5d7f35d-2eaa-4a94-aa72-0a10528bd89d tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:02.022945 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dd3ef5f8-ee36-4cb7-abb7-99485606e6b0 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:02.023122 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f5d7f35d-2eaa-4a94-aa72-0a10528bd89d tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:02.024400 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f5d7f35d-2eaa-4a94-aa72-0a10528bd89d tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:02.025010 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f5d7f35d-2eaa-4a94-aa72-0a10528bd89d tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:02.025460 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f5d7f35d-2eaa-4a94-aa72-0a10528bd89d tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:02.026174 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dd3ef5f8-ee36-4cb7-abb7-99485606e6b0 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:02.029313 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dd3ef5f8-ee36-4cb7-abb7-99485606e6b0 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:02.030817 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dd3ef5f8-ee36-4cb7-abb7-99485606e6b0 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:02.038310 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dd3ef5f8-ee36-4cb7-abb7-99485606e6b0 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:02.039110 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dd3ef5f8-ee36-4cb7-abb7-99485606e6b0 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:02.373943 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f5d7f35d-2eaa-4a94-aa72-0a10528bd89d tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:02.403302 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f5d7f35d-2eaa-4a94-aa72-0a10528bd89d tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/f9b66475-83f6-49a3-bc63-8965fc1aec14" status: 200 len: 1534 microversion: 2.1 time: 0.399441 Aug 31 16:06:02.426208 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1238/2483] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:02 2022] GET /compute/v2.1/servers/f9b66475-83f6-49a3-bc63-8965fc1aec14 => generated 1534 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:02.426208 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-fb1e2193-9757-40b1-8b9d-02e35dc78a10 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:02.426208 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-fb1e2193-9757-40b1-8b9d-02e35dc78a10 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 006771fc-9da9-4b78-9fad-f4b72c311fd5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:02.436115 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-dd3ef5f8-ee36-4cb7-abb7-99485606e6b0 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:02.437224 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fb1e2193-9757-40b1-8b9d-02e35dc78a10 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:02.437740 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fb1e2193-9757-40b1-8b9d-02e35dc78a10 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:02.438189 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fb1e2193-9757-40b1-8b9d-02e35dc78a10 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:02.438990 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fb1e2193-9757-40b1-8b9d-02e35dc78a10 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:02.439462 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fb1e2193-9757-40b1-8b9d-02e35dc78a10 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:02.439927 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fb1e2193-9757-40b1-8b9d-02e35dc78a10 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:02.447659 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-dd3ef5f8-ee36-4cb7-abb7-99485606e6b0 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/1262191c-be8b-4535-8704-72db13e3f6cc" status: 200 len: 1492 microversion: 2.1 time: 0.464385 Aug 31 16:06:02.463087 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1246/2484] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:01 2022] GET /compute/v2.1/servers/1262191c-be8b-4535-8704-72db13e3f6cc => generated 1492 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:02.468678 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-fdb192c8-7897-458b-b246-75d6dc6540c6 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-59364104"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:06:02.471443 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-fdb192c8-7897-458b-b246-75d6dc6540c6 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] [instance: 359f06bd-00e9-4d68-b066-db73d7073a04] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:02.478249 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fdb192c8-7897-458b-b246-75d6dc6540c6 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:02.478982 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fdb192c8-7897-458b-b246-75d6dc6540c6 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:02.480138 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fdb192c8-7897-458b-b246-75d6dc6540c6 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:02.481153 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fdb192c8-7897-458b-b246-75d6dc6540c6 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:02.481778 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fdb192c8-7897-458b-b246-75d6dc6540c6 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:02.482364 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fdb192c8-7897-458b-b246-75d6dc6540c6 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:02.530776 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-fb1e2193-9757-40b1-8b9d-02e35dc78a10 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:02.540132 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-fb1e2193-9757-40b1-8b9d-02e35dc78a10 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:02.541600 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-fb1e2193-9757-40b1-8b9d-02e35dc78a10 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:02.545138 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-fb1e2193-9757-40b1-8b9d-02e35dc78a10 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5" status: 200 len: 1265 microversion: 2.25 time: 0.126022 Aug 31 16:06:02.546039 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1239/2485] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:06:02 2022] GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5 => generated 1265 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:06:02.551413 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-057fb29a-2c41-4416-8ed2-e85be72e26aa tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:02.553983 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-057fb29a-2c41-4416-8ed2-e85be72e26aa tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: bf253a58-f38a-42d9-90b6-f3a80141cad2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:02.561991 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-057fb29a-2c41-4416-8ed2-e85be72e26aa tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:02.562685 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-057fb29a-2c41-4416-8ed2-e85be72e26aa tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:02.563689 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-057fb29a-2c41-4416-8ed2-e85be72e26aa tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:02.564557 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-057fb29a-2c41-4416-8ed2-e85be72e26aa tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:02.565238 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-057fb29a-2c41-4416-8ed2-e85be72e26aa tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:02.565870 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-057fb29a-2c41-4416-8ed2-e85be72e26aa tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:02.584637 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-057fb29a-2c41-4416-8ed2-e85be72e26aa tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] HTTP exception thrown: Instance bf253a58-f38a-42d9-90b6-f3a80141cad2 could not be found. Aug 31 16:06:02.586956 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-057fb29a-2c41-4416-8ed2-e85be72e26aa tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Request method failure captured: Aug 31 16:06:02.586956 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/bf253a58-f38a-42d9-90b6-f3a80141cad2 HTTP/1.1 Aug 31 16:06:02.586956 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:06:02.586956 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:06:02.586956 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:06:02.586956 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:06:02.586956 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:06:02.586956 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:06:02.586956 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:06:02.586956 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:06:02.586956 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4XtNmkvMwnHSL7qhg4V3Wdw6j3Xq_Y_rjXmT_SLe0FMvGo1gt1LwtP8iZQqS4u70Er7TOj14npyXUlDGoqy-1fk7VS9f_3ajnUzSZB5vWqF2Pe5k8siWL_JGtE8zCZBhN_wgL3NLoqpJfp9eoMAktgpjf2nAX9ECp3Cc5bDcIxyAw0 Aug 31 16:06:02.586956 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:06:02.586956 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:06:02.586956 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:06:02.586956 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:06:02.586956 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:06:02.586956 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:06:02.586956 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 7fa2effd15e440598752264e49d2457d Aug 31 16:06:02.586956 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ServersOnMultiNodesTest-1308696187 Aug 31 16:06:02.586956 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:06:02.586956 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:06:02.586956 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7fa2effd15e440598752264e49d2457d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7fa2effd15e440598752264e49d2457d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7fa2effd15e440598752264e49d2457d", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7fa2effd15e440598752264e49d2457d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:06:02.586956 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ServersOnMultiNodesTest-1308696187 Aug 31 16:06:02.586956 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 7fa2effd15e440598752264e49d2457d Aug 31 16:06:02.586956 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1308696187 Aug 31 16:06:02.586956 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ServersOnMultiNodesTest-1308696187-project Aug 31 16:06:02.586956 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:06:02.586956 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:06:02.586956 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 547d88df13034daaad50c3582c7cc3b3 Aug 31 16:06:02.586956 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ServersOnMultiNodesTest-1308696187-project Aug 31 16:06:02.586956 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:06:02.586956 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance bf253a58-f38a-42d9-90b6-f3a80141cad2 could not be found. Aug 31 16:06:02.586956 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': 'bf253a58-f38a-42d9-90b6-f3a80141cad2'} Aug 31 16:06:02.586956 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:06:02.586956 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:06:02.586956 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:06:02.586956 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:06:02.586956 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:06:02.586956 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:06:02.586956 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:06:02.586956 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:06:02.586956 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:06:02.586956 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:06:02.586956 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf253a58-f38a-42d9-90b6-f3a80141cad2 could not be found. Aug 31 16:06:02.586956 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:06:02.586956 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:06:02.586956 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:06:02.586956 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:06:02.586956 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:06:02.586956 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:06:02.586956 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:06:02.586956 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:06:02.586956 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:06:02.586956 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:06:02.586956 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:06:02.586956 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:06:02.586956 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:06:02.586956 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:06:02.586956 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:06:02.586956 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:06:02.586956 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf253a58-f38a-42d9-90b6-f3a80141cad2 could not be found. Aug 31 16:06:02.586956 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:06:02.586956 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:06:02.586956 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:06:02.591759 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:06:02.591759 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:06:02.591759 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:06:02.591759 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:06:02.591759 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:06:02.591759 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf253a58-f38a-42d9-90b6-f3a80141cad2 could not be found. Aug 31 16:06:02.591759 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:06:02.593180 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-057fb29a-2c41-4416-8ed2-e85be72e26aa tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Returning 404 to user: Instance bf253a58-f38a-42d9-90b6-f3a80141cad2 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:06:02.594666 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-057fb29a-2c41-4416-8ed2-e85be72e26aa tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/bf253a58-f38a-42d9-90b6-f3a80141cad2" status: 404 len: 111 microversion: 2.1 time: 0.047315 Aug 31 16:06:02.598118 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1240/2486] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:02 2022] GET /compute/v2.1/servers/bf253a58-f38a-42d9-90b6-f3a80141cad2 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:06:02.605468 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8fee883c-34e0-48f6-b708-3dc5e79b05fc tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:02.606180 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8fee883c-34e0-48f6-b708-3dc5e79b05fc tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 646d0250-a626-4bd1-821b-2117fde78cc8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:02.614738 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8fee883c-34e0-48f6-b708-3dc5e79b05fc tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:02.615247 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8fee883c-34e0-48f6-b708-3dc5e79b05fc tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:02.615719 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8fee883c-34e0-48f6-b708-3dc5e79b05fc tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:02.616437 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8fee883c-34e0-48f6-b708-3dc5e79b05fc tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:02.616903 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8fee883c-34e0-48f6-b708-3dc5e79b05fc tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:02.617336 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8fee883c-34e0-48f6-b708-3dc5e79b05fc tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:02.637870 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-8fee883c-34e0-48f6-b708-3dc5e79b05fc tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] HTTP exception thrown: Instance 646d0250-a626-4bd1-821b-2117fde78cc8 could not be found. Aug 31 16:06:02.639948 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8fee883c-34e0-48f6-b708-3dc5e79b05fc tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Request method failure captured: Aug 31 16:06:02.639948 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/646d0250-a626-4bd1-821b-2117fde78cc8 HTTP/1.1 Aug 31 16:06:02.639948 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:06:02.639948 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:06:02.639948 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:06:02.639948 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:06:02.639948 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:06:02.639948 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:06:02.639948 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:06:02.639948 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:06:02.639948 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4XtNmkvMwnHSL7qhg4V3Wdw6j3Xq_Y_rjXmT_SLe0FMvGo1gt1LwtP8iZQqS4u70Er7TOj14npyXUlDGoqy-1fk7VS9f_3ajnUzSZB5vWqF2Pe5k8siWL_JGtE8zCZBhN_wgL3NLoqpJfp9eoMAktgpjf2nAX9ECp3Cc5bDcIxyAw0 Aug 31 16:06:02.639948 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:06:02.639948 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:06:02.639948 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:06:02.639948 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:06:02.639948 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:06:02.639948 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:06:02.639948 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 7fa2effd15e440598752264e49d2457d Aug 31 16:06:02.639948 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ServersOnMultiNodesTest-1308696187 Aug 31 16:06:02.639948 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:06:02.639948 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:06:02.639948 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7fa2effd15e440598752264e49d2457d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7fa2effd15e440598752264e49d2457d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7fa2effd15e440598752264e49d2457d", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7fa2effd15e440598752264e49d2457d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:06:02.639948 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ServersOnMultiNodesTest-1308696187 Aug 31 16:06:02.639948 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 7fa2effd15e440598752264e49d2457d Aug 31 16:06:02.639948 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1308696187 Aug 31 16:06:02.639948 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ServersOnMultiNodesTest-1308696187-project Aug 31 16:06:02.639948 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:06:02.639948 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:06:02.639948 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 547d88df13034daaad50c3582c7cc3b3 Aug 31 16:06:02.639948 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ServersOnMultiNodesTest-1308696187-project Aug 31 16:06:02.639948 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:06:02.639948 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance 646d0250-a626-4bd1-821b-2117fde78cc8 could not be found. Aug 31 16:06:02.639948 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '646d0250-a626-4bd1-821b-2117fde78cc8'} Aug 31 16:06:02.639948 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:06:02.639948 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:06:02.639948 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:06:02.639948 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:06:02.639948 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:06:02.639948 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:06:02.639948 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:06:02.639948 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:06:02.639948 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:06:02.639948 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:06:02.639948 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 646d0250-a626-4bd1-821b-2117fde78cc8 could not be found. Aug 31 16:06:02.639948 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:06:02.639948 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:06:02.639948 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:06:02.639948 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:06:02.639948 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:06:02.639948 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:06:02.639948 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:06:02.639948 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:06:02.639948 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:06:02.639948 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:06:02.639948 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:06:02.639948 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:06:02.639948 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:06:02.639948 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:06:02.639948 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:06:02.639948 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:06:02.639948 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 646d0250-a626-4bd1-821b-2117fde78cc8 could not be found. Aug 31 16:06:02.639948 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:06:02.639948 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:06:02.639948 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:06:02.643236 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:06:02.643236 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:06:02.643236 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:06:02.643236 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:06:02.643236 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:06:02.643236 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 646d0250-a626-4bd1-821b-2117fde78cc8 could not be found. Aug 31 16:06:02.643236 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:06:02.645399 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8fee883c-34e0-48f6-b708-3dc5e79b05fc tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Returning 404 to user: Instance 646d0250-a626-4bd1-821b-2117fde78cc8 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:06:02.646971 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8fee883c-34e0-48f6-b708-3dc5e79b05fc tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/646d0250-a626-4bd1-821b-2117fde78cc8" status: 404 len: 111 microversion: 2.1 time: 0.046258 Aug 31 16:06:02.648293 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1241/2487] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:02 2022] GET /compute/v2.1/servers/646d0250-a626-4bd1-821b-2117fde78cc8 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:06:02.664922 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-360e544e-a23f-46fe-ae92-afb33ee977a5 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:02.728975 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-360e544e-a23f-46fe-ae92-afb33ee977a5 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "DELETE /compute/v2.1/os-server-groups/35f33a95-96b8-42b6-b807-0bcb84d43121" status: 204 len: 0 microversion: 2.1 time: 0.075567 Aug 31 16:06:02.736685 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1242/2488] 10.222.0.61 () {58 vars in 1266 bytes} [Wed Aug 31 16:06:02 2022] DELETE /compute/v2.1/os-server-groups/35f33a95-96b8-42b6-b807-0bcb84d43121 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:06:02.743405 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-08e2101a-bebc-45a9-9734-1f805d2dc544 req-eeafec41-7524-4a8f-b8e1-066f7237895e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf253a58-f38a-42d9-90b6-f3a80141cad2", "name": "network-vif-unplugged", "status": "completed", "tag": "c9f01bdb-2d61-4e28-bce8-39dd0d48b820"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:06:02.765902 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-08e2101a-bebc-45a9-9734-1f805d2dc544 req-eeafec41-7524-4a8f-b8e1-066f7237895e service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:02.766697 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-08e2101a-bebc-45a9-9734-1f805d2dc544 req-eeafec41-7524-4a8f-b8e1-066f7237895e service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:02.767382 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-08e2101a-bebc-45a9-9734-1f805d2dc544 req-eeafec41-7524-4a8f-b8e1-066f7237895e service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:02.786310 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-08e2101a-bebc-45a9-9734-1f805d2dc544 req-eeafec41-7524-4a8f-b8e1-066f7237895e service nova] Creating event network-vif-unplugged:c9f01bdb-2d61-4e28-bce8-39dd0d48b820 for instance bf253a58-f38a-42d9-90b6-f3a80141cad2 on n-h2-850499-9 Aug 31 16:06:02.797104 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-fdb192c8-7897-458b-b246-75d6dc6540c6 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "POST /compute/v2.1/servers/359f06bd-00e9-4d68-b066-db73d7073a04/action" status: 202 len: 0 microversion: 2.1 time: 0.330314 Aug 31 16:06:02.807247 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1247/2489] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:06:02 2022] POST /compute/v2.1/servers/359f06bd-00e9-4d68-b066-db73d7073a04/action => generated 0 bytes in 336 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 31 16:06:02.807579 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-08e2101a-bebc-45a9-9734-1f805d2dc544 req-eeafec41-7524-4a8f-b8e1-066f7237895e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.063133 Aug 31 16:06:02.807579 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1243/2490] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:06:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:06:02.811422 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3ce41b37-eb73-4949-ba67-ef0ffa178363 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:02.812528 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3ce41b37-eb73-4949-ba67-ef0ffa178363 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 65eb7e79-83ec-41c9-80f3-b8cac7369261] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:02.828781 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3ce41b37-eb73-4949-ba67-ef0ffa178363 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:02.829508 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3ce41b37-eb73-4949-ba67-ef0ffa178363 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:02.830422 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3ce41b37-eb73-4949-ba67-ef0ffa178363 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:02.831765 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3ce41b37-eb73-4949-ba67-ef0ffa178363 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:02.832503 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3ce41b37-eb73-4949-ba67-ef0ffa178363 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:02.833306 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3ce41b37-eb73-4949-ba67-ef0ffa178363 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:02.843306 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-e7edb74c-310b-4752-a7b9-d3bd85d3c79f req-dfdea7aa-71f5-413a-b230-ce9e5b4c5aaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56", "name": "network-vif-deleted", "tag": "2b648b75-ab1e-4141-bc80-3cbc9b5b261b"}, {"server_uuid": "006771fc-9da9-4b78-9fad-f4b72c311fd5", "name": "network-vif-deleted", "tag": "a0210474-72a8-4f79-a241-42969b6b4b66"}, {"server_uuid": "bf253a58-f38a-42d9-90b6-f3a80141cad2", "name": "network-vif-deleted", "tag": "c9f01bdb-2d61-4e28-bce8-39dd0d48b820"}, {"name": "network-changed", "server_uuid": "f9b66475-83f6-49a3-bc63-8965fc1aec14", "tag": "c1929c28-a0f2-4fed-aba4-ecfd08ac8e7e"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:06:02.869383 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-e7edb74c-310b-4752-a7b9-d3bd85d3c79f req-dfdea7aa-71f5-413a-b230-ce9e5b4c5aaf service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:02.869868 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-e7edb74c-310b-4752-a7b9-d3bd85d3c79f req-dfdea7aa-71f5-413a-b230-ce9e5b4c5aaf service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:02.872885 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-e7edb74c-310b-4752-a7b9-d3bd85d3c79f req-dfdea7aa-71f5-413a-b230-ce9e5b4c5aaf service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:02.905551 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3ce41b37-eb73-4949-ba67-ef0ffa178363 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 65eb7e79-83ec-41c9-80f3-b8cac7369261] Going to try to terminate instance {{(pid=122256) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:06:02.918948 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-e7edb74c-310b-4752-a7b9-d3bd85d3c79f req-dfdea7aa-71f5-413a-b230-ce9e5b4c5aaf service nova] Creating event network-vif-deleted:2b648b75-ab1e-4141-bc80-3cbc9b5b261b for instance bfe59a32-b3bd-44b5-8b0b-f1a6a5786d56 on n-h2-850499-9 Aug 31 16:06:02.919880 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-e7edb74c-310b-4752-a7b9-d3bd85d3c79f req-dfdea7aa-71f5-413a-b230-ce9e5b4c5aaf service nova] Creating event network-vif-deleted:a0210474-72a8-4f79-a241-42969b6b4b66 for instance 006771fc-9da9-4b78-9fad-f4b72c311fd5 on n-h1-850499-9 Aug 31 16:06:02.920773 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-e7edb74c-310b-4752-a7b9-d3bd85d3c79f req-dfdea7aa-71f5-413a-b230-ce9e5b4c5aaf service nova] Creating event network-vif-deleted:c9f01bdb-2d61-4e28-bce8-39dd0d48b820 for instance bf253a58-f38a-42d9-90b6-f3a80141cad2 on n-h2-850499-9 Aug 31 16:06:02.921650 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-e7edb74c-310b-4752-a7b9-d3bd85d3c79f req-dfdea7aa-71f5-413a-b230-ce9e5b4c5aaf service nova] Creating event network-changed:c1929c28-a0f2-4fed-aba4-ecfd08ac8e7e for instance f9b66475-83f6-49a3-bc63-8965fc1aec14 on n-h2-850499-9 Aug 31 16:06:02.932602 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [req-e7edb74c-310b-4752-a7b9-d3bd85d3c79f req-dfdea7aa-71f5-413a-b230-ce9e5b4c5aaf service nova] Instance f9b66475-83f6-49a3-bc63-8965fc1aec14 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850499-9', 'n-h1-850499-9'} {{(pid=122257) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 31 16:06:02.963743 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-e7edb74c-310b-4752-a7b9-d3bd85d3c79f req-dfdea7aa-71f5-413a-b230-ce9e5b4c5aaf service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 692 microversion: 2.1 time: 0.139919 Aug 31 16:06:02.965811 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1248/2491] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:06:02 2022] POST /compute/v2.1/os-server-external-events => generated 692 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:06:02.972806 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9f20590a-ba41-445f-8f3b-10e2b0a21b2b tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '.version_select at 0x7f5ae84e6280>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:03.014483 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:06:03.062395 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9f20590a-ba41-445f-8f3b-10e2b0a21b2b tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "GET /compute/v2.1/images/f8c63da2-efca-43a3-a8dd-7f0b9e1fcefc" status: 200 len: 1451 microversion: 2.1 time: 0.094965 Aug 31 16:06:03.062992 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1249/2492] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:06:02 2022] GET /compute/v2.1/images/f8c63da2-efca-43a3-a8dd-7f0b9e1fcefc => generated 1451 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:03.083782 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2a7706cd-7fa1-4e74-b682-acc8871cc702 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:03.085189 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2a7706cd-7fa1-4e74-b682-acc8871cc702 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] [instance: 685d47e4-721e-4eae-b5f8-78fdb68454ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:03.094315 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3ce41b37-eb73-4949-ba67-ef0ffa178363 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "DELETE /compute/v2.1/servers/65eb7e79-83ec-41c9-80f3-b8cac7369261" status: 204 len: 0 microversion: 2.1 time: 0.290186 Aug 31 16:06:03.099617 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1244/2493] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:06:02 2022] DELETE /compute/v2.1/servers/65eb7e79-83ec-41c9-80f3-b8cac7369261 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:06:03.105964 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2a7706cd-7fa1-4e74-b682-acc8871cc702 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:03.106640 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2a7706cd-7fa1-4e74-b682-acc8871cc702 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:03.107303 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2a7706cd-7fa1-4e74-b682-acc8871cc702 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:03.109920 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-be4548b0-ace0-4553-ba5b-e38ad97edd58 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:03.110256 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2a7706cd-7fa1-4e74-b682-acc8871cc702 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:03.111027 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2a7706cd-7fa1-4e74-b682-acc8871cc702 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:03.111135 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-be4548b0-ace0-4553-ba5b-e38ad97edd58 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: efbe58d1-9726-4fa7-a7fb-f3cdc1b70ca4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:03.111731 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2a7706cd-7fa1-4e74-b682-acc8871cc702 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:03.121723 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-be4548b0-ace0-4553-ba5b-e38ad97edd58 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:03.122574 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-be4548b0-ace0-4553-ba5b-e38ad97edd58 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:03.123346 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-be4548b0-ace0-4553-ba5b-e38ad97edd58 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:03.124652 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-be4548b0-ace0-4553-ba5b-e38ad97edd58 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:03.135250 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-be4548b0-ace0-4553-ba5b-e38ad97edd58 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:03.136792 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-be4548b0-ace0-4553-ba5b-e38ad97edd58 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:03.214348 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-be4548b0-ace0-4553-ba5b-e38ad97edd58 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: efbe58d1-9726-4fa7-a7fb-f3cdc1b70ca4] Going to try to terminate instance {{(pid=122256) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:06:03.372208 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-be4548b0-ace0-4553-ba5b-e38ad97edd58 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "DELETE /compute/v2.1/servers/efbe58d1-9726-4fa7-a7fb-f3cdc1b70ca4" status: 204 len: 0 microversion: 2.1 time: 0.269252 Aug 31 16:06:03.373498 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1245/2494] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:06:03 2022] DELETE /compute/v2.1/servers/efbe58d1-9726-4fa7-a7fb-f3cdc1b70ca4 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:06:03.386521 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-63e31691-adcf-4b59-98c9-f6be939f06cf tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:03.402963 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-63e31691-adcf-4b59-98c9-f6be939f06cf tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 65eb7e79-83ec-41c9-80f3-b8cac7369261] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:03.418739 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-63e31691-adcf-4b59-98c9-f6be939f06cf tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:03.419643 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-63e31691-adcf-4b59-98c9-f6be939f06cf tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:03.420410 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-63e31691-adcf-4b59-98c9-f6be939f06cf tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:03.421659 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-63e31691-adcf-4b59-98c9-f6be939f06cf tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:03.422474 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-63e31691-adcf-4b59-98c9-f6be939f06cf tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:03.423234 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-63e31691-adcf-4b59-98c9-f6be939f06cf tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:04.072591 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2a7706cd-7fa1-4e74-b682-acc8871cc702 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:04.096538 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2a7706cd-7fa1-4e74-b682-acc8871cc702 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:04.100562 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2a7706cd-7fa1-4e74-b682-acc8871cc702 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:04.103976 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2a7706cd-7fa1-4e74-b682-acc8871cc702 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] 10.222.0.61 "GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae" status: 200 len: 1887 microversion: 2.42 time: 1.039668 Aug 31 16:06:04.123903 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1250/2495] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:06:03 2022] GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae => generated 1887 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:06:04.146375 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-62e8f062-34fd-4eef-a3ab-1b8e2b5f4999 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:04.147577 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-62e8f062-34fd-4eef-a3ab-1b8e2b5f4999 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: f9b66475-83f6-49a3-bc63-8965fc1aec14] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:04.157924 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-63e31691-adcf-4b59-98c9-f6be939f06cf tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:04.162881 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-62e8f062-34fd-4eef-a3ab-1b8e2b5f4999 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:04.163427 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-62e8f062-34fd-4eef-a3ab-1b8e2b5f4999 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:04.171667 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-62e8f062-34fd-4eef-a3ab-1b8e2b5f4999 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:04.172377 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-62e8f062-34fd-4eef-a3ab-1b8e2b5f4999 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:04.172867 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-62e8f062-34fd-4eef-a3ab-1b8e2b5f4999 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:04.173039 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-63e31691-adcf-4b59-98c9-f6be939f06cf tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/65eb7e79-83ec-41c9-80f3-b8cac7369261" status: 200 len: 1473 microversion: 2.1 time: 0.794597 Aug 31 16:06:04.173316 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-62e8f062-34fd-4eef-a3ab-1b8e2b5f4999 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:04.174001 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1246/2496] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:03 2022] GET /compute/v2.1/servers/65eb7e79-83ec-41c9-80f3-b8cac7369261 => generated 1473 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:06:04.205398 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ebe5faf0-d46b-441a-ad6f-bba4ac8b94db tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:04.209482 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ebe5faf0-d46b-441a-ad6f-bba4ac8b94db tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 1262191c-be8b-4535-8704-72db13e3f6cc] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:04.226583 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ebe5faf0-d46b-441a-ad6f-bba4ac8b94db tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:04.228032 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ebe5faf0-d46b-441a-ad6f-bba4ac8b94db tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:04.229283 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ebe5faf0-d46b-441a-ad6f-bba4ac8b94db tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:04.232993 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ebe5faf0-d46b-441a-ad6f-bba4ac8b94db tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:04.234133 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ebe5faf0-d46b-441a-ad6f-bba4ac8b94db tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:04.235200 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ebe5faf0-d46b-441a-ad6f-bba4ac8b94db tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:05.086755 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ebe5faf0-d46b-441a-ad6f-bba4ac8b94db tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:05.113857 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ebe5faf0-d46b-441a-ad6f-bba4ac8b94db tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/1262191c-be8b-4535-8704-72db13e3f6cc" status: 200 len: 1492 microversion: 2.1 time: 0.921990 Aug 31 16:06:05.127267 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1247/2497] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:04 2022] GET /compute/v2.1/servers/1262191c-be8b-4535-8704-72db13e3f6cc => generated 1492 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:05.139484 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-47285b98-226b-4c87-b58f-75f3a7561b22 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:05.141158 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-47285b98-226b-4c87-b58f-75f3a7561b22 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 006771fc-9da9-4b78-9fad-f4b72c311fd5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:05.162098 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-47285b98-226b-4c87-b58f-75f3a7561b22 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:05.165290 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-47285b98-226b-4c87-b58f-75f3a7561b22 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:05.166080 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-47285b98-226b-4c87-b58f-75f3a7561b22 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:05.170326 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-47285b98-226b-4c87-b58f-75f3a7561b22 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:05.172254 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-47285b98-226b-4c87-b58f-75f3a7561b22 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:05.172901 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-47285b98-226b-4c87-b58f-75f3a7561b22 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:05.277695 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-62e8f062-34fd-4eef-a3ab-1b8e2b5f4999 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:05.290022 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-62e8f062-34fd-4eef-a3ab-1b8e2b5f4999 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/f9b66475-83f6-49a3-bc63-8965fc1aec14" status: 200 len: 1534 microversion: 2.1 time: 1.162381 Aug 31 16:06:05.291134 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1251/2498] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:04 2022] GET /compute/v2.1/servers/f9b66475-83f6-49a3-bc63-8965fc1aec14 => generated 1534 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:05.299845 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-8e42d9c5-1429-492d-a45a-6a2ec26f7f4b req-58e54fa6-6da6-45b1-bd72-a17bd70f097c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "685d47e4-721e-4eae-b5f8-78fdb68454ae", "tag": "a7a5f1a9-2d7d-4203-b9c4-5b85512da4d2"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:06:05.317008 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-8e42d9c5-1429-492d-a45a-6a2ec26f7f4b req-58e54fa6-6da6-45b1-bd72-a17bd70f097c service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:05.317992 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-8e42d9c5-1429-492d-a45a-6a2ec26f7f4b req-58e54fa6-6da6-45b1-bd72-a17bd70f097c service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:05.319294 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-8e42d9c5-1429-492d-a45a-6a2ec26f7f4b req-58e54fa6-6da6-45b1-bd72-a17bd70f097c service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:05.341325 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-8e42d9c5-1429-492d-a45a-6a2ec26f7f4b req-58e54fa6-6da6-45b1-bd72-a17bd70f097c service nova] Creating event network-changed:a7a5f1a9-2d7d-4203-b9c4-5b85512da4d2 for instance 685d47e4-721e-4eae-b5f8-78fdb68454ae on n-h2-850499-9 Aug 31 16:06:05.348998 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-8e42d9c5-1429-492d-a45a-6a2ec26f7f4b req-58e54fa6-6da6-45b1-bd72-a17bd70f097c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055948 Aug 31 16:06:05.350308 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1252/2499] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:06:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:06:05.360833 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-47285b98-226b-4c87-b58f-75f3a7561b22 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:05.365464 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3d3cb789-15be-4d1e-8446-499ab2cde46b tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '.version_select at 0x7f5ae84e6430>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:05.376267 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-47285b98-226b-4c87-b58f-75f3a7561b22 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:05.379444 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-47285b98-226b-4c87-b58f-75f3a7561b22 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:05.383096 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-47285b98-226b-4c87-b58f-75f3a7561b22 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5" status: 200 len: 1265 microversion: 2.25 time: 0.252784 Aug 31 16:06:05.384326 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1248/2500] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:06:05 2022] GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5 => generated 1265 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:06:05.392513 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0da477ca-89c1-4eb0-8281-3cb9244bff19 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:05.393305 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0da477ca-89c1-4eb0-8281-3cb9244bff19 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] [instance: 685d47e4-721e-4eae-b5f8-78fdb68454ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:05.412904 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0da477ca-89c1-4eb0-8281-3cb9244bff19 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:05.413427 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0da477ca-89c1-4eb0-8281-3cb9244bff19 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:05.413874 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0da477ca-89c1-4eb0-8281-3cb9244bff19 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:05.418262 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0da477ca-89c1-4eb0-8281-3cb9244bff19 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:05.418869 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0da477ca-89c1-4eb0-8281-3cb9244bff19 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:05.419346 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0da477ca-89c1-4eb0-8281-3cb9244bff19 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:05.454952 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3d3cb789-15be-4d1e-8446-499ab2cde46b tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "GET /compute/v2.1/images/f8c63da2-efca-43a3-a8dd-7f0b9e1fcefc" status: 200 len: 1451 microversion: 2.1 time: 0.103204 Aug 31 16:06:05.473283 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1253/2501] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:06:05 2022] GET /compute/v2.1/images/f8c63da2-efca-43a3-a8dd-7f0b9e1fcefc => generated 1451 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:05.496031 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-506a5875-d6e7-4bb0-a4be-4d030c2d2bd1 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:05.497150 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-506a5875-d6e7-4bb0-a4be-4d030c2d2bd1 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 65eb7e79-83ec-41c9-80f3-b8cac7369261] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:05.506934 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-506a5875-d6e7-4bb0-a4be-4d030c2d2bd1 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:05.507819 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-506a5875-d6e7-4bb0-a4be-4d030c2d2bd1 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:05.508497 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-506a5875-d6e7-4bb0-a4be-4d030c2d2bd1 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:05.509396 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-506a5875-d6e7-4bb0-a4be-4d030c2d2bd1 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:05.510106 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-506a5875-d6e7-4bb0-a4be-4d030c2d2bd1 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:05.512619 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-506a5875-d6e7-4bb0-a4be-4d030c2d2bd1 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:07.284647 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-506a5875-d6e7-4bb0-a4be-4d030c2d2bd1 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:07.296848 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-506a5875-d6e7-4bb0-a4be-4d030c2d2bd1 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/65eb7e79-83ec-41c9-80f3-b8cac7369261" status: 200 len: 1473 microversion: 2.1 time: 1.821964 Aug 31 16:06:07.313339 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1254/2502] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:05 2022] GET /compute/v2.1/servers/65eb7e79-83ec-41c9-80f3-b8cac7369261 => generated 1473 bytes in 1839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:07.334023 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2c96329d-d8c8-4814-a2c6-8cf71eb2993a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:07.335178 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2c96329d-d8c8-4814-a2c6-8cf71eb2993a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 1262191c-be8b-4535-8704-72db13e3f6cc] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:07.345189 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2c96329d-d8c8-4814-a2c6-8cf71eb2993a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:07.346392 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2c96329d-d8c8-4814-a2c6-8cf71eb2993a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:07.347416 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2c96329d-d8c8-4814-a2c6-8cf71eb2993a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:07.348690 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2c96329d-d8c8-4814-a2c6-8cf71eb2993a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:07.349596 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2c96329d-d8c8-4814-a2c6-8cf71eb2993a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:07.350379 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2c96329d-d8c8-4814-a2c6-8cf71eb2993a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:07.996507 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2c96329d-d8c8-4814-a2c6-8cf71eb2993a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:08.037571 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2c96329d-d8c8-4814-a2c6-8cf71eb2993a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/1262191c-be8b-4535-8704-72db13e3f6cc" status: 200 len: 1450 microversion: 2.1 time: 0.680377 Aug 31 16:06:08.038365 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1255/2503] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:07 2022] GET /compute/v2.1/servers/1262191c-be8b-4535-8704-72db13e3f6cc => generated 1450 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:08.046877 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3f67280b-5df6-40c7-89b8-73208fd5a12d tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:08.046877 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3f67280b-5df6-40c7-89b8-73208fd5a12d tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: f9b66475-83f6-49a3-bc63-8965fc1aec14] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:08.072847 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3f67280b-5df6-40c7-89b8-73208fd5a12d tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:08.073911 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3f67280b-5df6-40c7-89b8-73208fd5a12d tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:08.074749 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3f67280b-5df6-40c7-89b8-73208fd5a12d tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:08.076426 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3f67280b-5df6-40c7-89b8-73208fd5a12d tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:08.076946 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3f67280b-5df6-40c7-89b8-73208fd5a12d tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:08.077738 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3f67280b-5df6-40c7-89b8-73208fd5a12d tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:08.122640 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-0da477ca-89c1-4eb0-8281-3cb9244bff19 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:08.142792 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-0da477ca-89c1-4eb0-8281-3cb9244bff19 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:08.144503 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-0da477ca-89c1-4eb0-8281-3cb9244bff19 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:08.162373 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0da477ca-89c1-4eb0-8281-3cb9244bff19 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] 10.222.0.61 "GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae" status: 200 len: 1887 microversion: 2.42 time: 2.776206 Aug 31 16:06:08.166006 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1249/2504] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:06:05 2022] GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae => generated 1887 bytes in 2780 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:06:08.178322 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f1587328-499e-4546-8cbb-ef52c960adc5 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:08.181212 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f1587328-499e-4546-8cbb-ef52c960adc5 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 006771fc-9da9-4b78-9fad-f4b72c311fd5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:08.200059 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f1587328-499e-4546-8cbb-ef52c960adc5 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:08.201003 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f1587328-499e-4546-8cbb-ef52c960adc5 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:08.202985 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f1587328-499e-4546-8cbb-ef52c960adc5 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:08.205767 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f1587328-499e-4546-8cbb-ef52c960adc5 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:08.207867 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f1587328-499e-4546-8cbb-ef52c960adc5 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:08.208848 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f1587328-499e-4546-8cbb-ef52c960adc5 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:08.299243 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f1587328-499e-4546-8cbb-ef52c960adc5 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:08.300929 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f1587328-499e-4546-8cbb-ef52c960adc5 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:08.301558 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f1587328-499e-4546-8cbb-ef52c960adc5 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:08.303458 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-f1587328-499e-4546-8cbb-ef52c960adc5 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lazy-loading 'fault' on Instance uuid 006771fc-9da9-4b78-9fad-f4b72c311fd5 {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:06:08.827607 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f1587328-499e-4546-8cbb-ef52c960adc5 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:08.859216 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f1587328-499e-4546-8cbb-ef52c960adc5 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:08.865686 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f1587328-499e-4546-8cbb-ef52c960adc5 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:08.875746 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f1587328-499e-4546-8cbb-ef52c960adc5 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5" status: 200 len: 1193 microversion: 2.25 time: 0.705818 Aug 31 16:06:08.877168 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1250/2505] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:06:08 2022] GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5 => generated 1193 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:06:08.894446 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b795a4e7-4935-4916-9c07-69d840333e2e tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '.version_select at 0x7f5ae8623ee0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:09.047794 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3f67280b-5df6-40c7-89b8-73208fd5a12d tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:09.069922 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3f67280b-5df6-40c7-89b8-73208fd5a12d tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/f9b66475-83f6-49a3-bc63-8965fc1aec14" status: 200 len: 1534 microversion: 2.1 time: 1.029541 Aug 31 16:06:09.085143 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b795a4e7-4935-4916-9c07-69d840333e2e tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "GET /compute/v2.1/images/f8c63da2-efca-43a3-a8dd-7f0b9e1fcefc" status: 200 len: 1451 microversion: 2.1 time: 0.190378 Aug 31 16:06:09.088977 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1256/2506] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:08 2022] GET /compute/v2.1/servers/f9b66475-83f6-49a3-bc63-8965fc1aec14 => generated 1534 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:09.089870 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1251/2507] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:06:08 2022] GET /compute/v2.1/images/f8c63da2-efca-43a3-a8dd-7f0b9e1fcefc => generated 1451 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:09.100745 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-55eb91dd-718c-458c-a744-880a8ea2974d tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:09.102724 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-646cd1c8-97bc-4ae7-be88-45baa9f10519 req-e518eca6-3123-4434-a87a-d38fb3acfa5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1262191c-be8b-4535-8704-72db13e3f6cc", "name": "network-vif-deleted", "tag": "583b8caf-b274-433c-9305-a71044fdd417"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:06:09.107948 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-55eb91dd-718c-458c-a744-880a8ea2974d tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 65eb7e79-83ec-41c9-80f3-b8cac7369261] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:09.130683 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-55eb91dd-718c-458c-a744-880a8ea2974d tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:09.132217 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-55eb91dd-718c-458c-a744-880a8ea2974d tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:09.135293 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-55eb91dd-718c-458c-a744-880a8ea2974d tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:09.137693 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-55eb91dd-718c-458c-a744-880a8ea2974d tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:09.138436 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-55eb91dd-718c-458c-a744-880a8ea2974d tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:09.139116 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-55eb91dd-718c-458c-a744-880a8ea2974d tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:09.158754 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-646cd1c8-97bc-4ae7-be88-45baa9f10519 req-e518eca6-3123-4434-a87a-d38fb3acfa5b service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:09.158754 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-646cd1c8-97bc-4ae7-be88-45baa9f10519 req-e518eca6-3123-4434-a87a-d38fb3acfa5b service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:09.158754 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-646cd1c8-97bc-4ae7-be88-45baa9f10519 req-e518eca6-3123-4434-a87a-d38fb3acfa5b service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:09.194058 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-646cd1c8-97bc-4ae7-be88-45baa9f10519 req-e518eca6-3123-4434-a87a-d38fb3acfa5b service nova] Creating event network-vif-deleted:583b8caf-b274-433c-9305-a71044fdd417 for instance 1262191c-be8b-4535-8704-72db13e3f6cc on n-h2-850499-9 Aug 31 16:06:09.199391 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-646cd1c8-97bc-4ae7-be88-45baa9f10519 req-e518eca6-3123-4434-a87a-d38fb3acfa5b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104895 Aug 31 16:06:09.200421 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1252/2508] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:06:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:06:09.205765 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7b714b01-658e-4619-b6f1-2c97d2891eb5 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:09.206469 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7b714b01-658e-4619-b6f1-2c97d2891eb5 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 1262191c-be8b-4535-8704-72db13e3f6cc] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:09.215542 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7b714b01-658e-4619-b6f1-2c97d2891eb5 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:09.216061 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7b714b01-658e-4619-b6f1-2c97d2891eb5 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:09.216494 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7b714b01-658e-4619-b6f1-2c97d2891eb5 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:09.217618 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7b714b01-658e-4619-b6f1-2c97d2891eb5 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:09.218095 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7b714b01-658e-4619-b6f1-2c97d2891eb5 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:09.218534 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7b714b01-658e-4619-b6f1-2c97d2891eb5 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:09.421029 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7b714b01-658e-4619-b6f1-2c97d2891eb5 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:09.433460 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7b714b01-658e-4619-b6f1-2c97d2891eb5 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/1262191c-be8b-4535-8704-72db13e3f6cc" status: 200 len: 1450 microversion: 2.1 time: 0.230293 Aug 31 16:06:09.438117 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1253/2509] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:09 2022] GET /compute/v2.1/servers/1262191c-be8b-4535-8704-72db13e3f6cc => generated 1450 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:09.466958 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-eab4433d-55a3-4600-aadf-abb0870d035e tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:09.468181 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-eab4433d-55a3-4600-aadf-abb0870d035e tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] [instance: 685d47e4-721e-4eae-b5f8-78fdb68454ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:09.484022 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eab4433d-55a3-4600-aadf-abb0870d035e tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:09.484661 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eab4433d-55a3-4600-aadf-abb0870d035e tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:09.485580 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eab4433d-55a3-4600-aadf-abb0870d035e tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:09.487018 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eab4433d-55a3-4600-aadf-abb0870d035e tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:09.487711 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eab4433d-55a3-4600-aadf-abb0870d035e tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:09.488299 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eab4433d-55a3-4600-aadf-abb0870d035e tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:09.951472 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-55eb91dd-718c-458c-a744-880a8ea2974d tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:09.986957 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-55eb91dd-718c-458c-a744-880a8ea2974d tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/65eb7e79-83ec-41c9-80f3-b8cac7369261" status: 200 len: 1473 microversion: 2.1 time: 0.895879 Aug 31 16:06:10.010316 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1257/2510] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:09 2022] GET /compute/v2.1/servers/65eb7e79-83ec-41c9-80f3-b8cac7369261 => generated 1473 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:10.043886 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-48700766-428a-41ae-bc30-f884ef2ece5e req-773578a7-28ec-4d02-9c71-61af35dcb303 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "359f06bd-00e9-4d68-b066-db73d7073a04", "name": "network-vif-plugged", "status": "completed", "tag": "0cd3b24d-ce36-4d42-806b-496fd2089b1b"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:06:10.092717 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-48700766-428a-41ae-bc30-f884ef2ece5e req-773578a7-28ec-4d02-9c71-61af35dcb303 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:10.093547 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-48700766-428a-41ae-bc30-f884ef2ece5e req-773578a7-28ec-4d02-9c71-61af35dcb303 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:10.093547 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-48700766-428a-41ae-bc30-f884ef2ece5e req-773578a7-28ec-4d02-9c71-61af35dcb303 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:10.143632 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-48700766-428a-41ae-bc30-f884ef2ece5e req-773578a7-28ec-4d02-9c71-61af35dcb303 service nova] Creating event network-vif-plugged:0cd3b24d-ce36-4d42-806b-496fd2089b1b for instance 359f06bd-00e9-4d68-b066-db73d7073a04 on n-h1-850499-9 Aug 31 16:06:10.183262 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-48700766-428a-41ae-bc30-f884ef2ece5e req-773578a7-28ec-4d02-9c71-61af35dcb303 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165176 Aug 31 16:06:10.193175 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1258/2511] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:06:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:06:10.207834 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-a9fd26b3-a3d4-43aa-9ab7-80a1fb1d996a req-800eeb61-0433-495e-84be-20a047d73456 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efbe58d1-9726-4fa7-a7fb-f3cdc1b70ca4", "name": "network-vif-deleted", "tag": "79a220dd-5cdb-47b6-bea1-c9cad9dc263f"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:06:10.220262 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-a9fd26b3-a3d4-43aa-9ab7-80a1fb1d996a req-800eeb61-0433-495e-84be-20a047d73456 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:10.220848 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-a9fd26b3-a3d4-43aa-9ab7-80a1fb1d996a req-800eeb61-0433-495e-84be-20a047d73456 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:10.221283 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-a9fd26b3-a3d4-43aa-9ab7-80a1fb1d996a req-800eeb61-0433-495e-84be-20a047d73456 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:10.239113 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-a9fd26b3-a3d4-43aa-9ab7-80a1fb1d996a req-800eeb61-0433-495e-84be-20a047d73456 service nova] Creating event network-vif-deleted:79a220dd-5cdb-47b6-bea1-c9cad9dc263f for instance efbe58d1-9726-4fa7-a7fb-f3cdc1b70ca4 on n-h1-850499-9 Aug 31 16:06:10.247438 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-a9fd26b3-a3d4-43aa-9ab7-80a1fb1d996a req-800eeb61-0433-495e-84be-20a047d73456 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050130 Aug 31 16:06:10.248624 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1259/2512] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:06:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:06:10.255395 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6353cf3c-91af-481e-b2b5-5ea99bfb2b5d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:10.256853 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6353cf3c-91af-481e-b2b5-5ea99bfb2b5d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 006771fc-9da9-4b78-9fad-f4b72c311fd5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:10.264475 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6353cf3c-91af-481e-b2b5-5ea99bfb2b5d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:10.265061 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6353cf3c-91af-481e-b2b5-5ea99bfb2b5d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:10.265538 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6353cf3c-91af-481e-b2b5-5ea99bfb2b5d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:10.266428 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6353cf3c-91af-481e-b2b5-5ea99bfb2b5d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:10.266899 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6353cf3c-91af-481e-b2b5-5ea99bfb2b5d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:10.267322 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6353cf3c-91af-481e-b2b5-5ea99bfb2b5d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:10.305062 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-6353cf3c-91af-481e-b2b5-5ea99bfb2b5d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] HTTP exception thrown: Instance 006771fc-9da9-4b78-9fad-f4b72c311fd5 could not be found. Aug 31 16:06:10.307198 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6353cf3c-91af-481e-b2b5-5ea99bfb2b5d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Request method failure captured: Aug 31 16:06:10.307198 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5 HTTP/1.1 Aug 31 16:06:10.307198 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:06:10.307198 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:06:10.307198 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:06:10.307198 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:06:10.307198 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:06:10.307198 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:06:10.307198 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:06:10.307198 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:06:10.307198 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4Sz-nEtBIir4h6pKigKL9l8DQ-FgYlbEQSEmOoXkJYtraxr-5lRgxCapV6PXVJ4YbN1zbOPnHuzBENR6jTq9c9nKu5JErZVbYmzTyVmurBnViPBcsdVuA7zckwipUv_K3iEGy1xSXMXAMx1-1GWp5CVSbFfBIPYyZm0WGFyBwt-m9A Aug 31 16:06:10.307198 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:06:10.307198 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:06:10.307198 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:06:10.307198 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:06:10.307198 n-d-850499-9 devstack@n-api.service[122257]: X-Openstack-Nova-Api-Version: 2.25 Aug 31 16:06:10.307198 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:06:10.307198 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:06:10.307198 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 01a9266ba9b14c6a8b6e79aecfe86df6 Aug 31 16:06:10.307198 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-850802922 Aug 31 16:06:10.307198 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:06:10.307198 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:06:10.307198 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/01a9266ba9b14c6a8b6e79aecfe86df6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/01a9266ba9b14c6a8b6e79aecfe86df6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_01a9266ba9b14c6a8b6e79aecfe86df6", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/01a9266ba9b14c6a8b6e79aecfe86df6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:06:10.307198 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-850802922 Aug 31 16:06:10.307198 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 01a9266ba9b14c6a8b6e79aecfe86df6 Aug 31 16:06:10.307198 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-850802922 Aug 31 16:06:10.307198 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-LiveAutoBlockMigrationV225Test-850802922-project Aug 31 16:06:10.307198 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:06:10.307198 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:06:10.307198 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: bb8e30aa23194f898b07dfbc6fd8d5de Aug 31 16:06:10.307198 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-850802922-project Aug 31 16:06:10.307198 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:06:10.307198 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance 006771fc-9da9-4b78-9fad-f4b72c311fd5 could not be found. Aug 31 16:06:10.307198 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '006771fc-9da9-4b78-9fad-f4b72c311fd5'} Aug 31 16:06:10.307198 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:06:10.307198 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:06:10.307198 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:06:10.307198 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:06:10.307198 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:06:10.307198 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:06:10.307198 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:06:10.307198 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:06:10.307198 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:06:10.307198 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:06:10.307198 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 006771fc-9da9-4b78-9fad-f4b72c311fd5 could not be found. Aug 31 16:06:10.307198 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:06:10.307198 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:06:10.307198 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:06:10.307198 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:06:10.307198 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:06:10.307198 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:06:10.307198 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:06:10.307198 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:06:10.307198 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:06:10.307198 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:06:10.307198 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:06:10.307198 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:06:10.307198 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:06:10.307198 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:06:10.307198 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:06:10.307198 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:06:10.307198 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 006771fc-9da9-4b78-9fad-f4b72c311fd5 could not be found. Aug 31 16:06:10.307198 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:06:10.311794 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:06:10.311794 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:06:10.311794 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:06:10.311794 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:06:10.311794 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:06:10.311794 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:06:10.311794 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:06:10.311794 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 006771fc-9da9-4b78-9fad-f4b72c311fd5 could not be found. Aug 31 16:06:10.311794 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:06:10.314162 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6353cf3c-91af-481e-b2b5-5ea99bfb2b5d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Returning 404 to user: Instance 006771fc-9da9-4b78-9fad-f4b72c311fd5 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:06:10.315315 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6353cf3c-91af-481e-b2b5-5ea99bfb2b5d tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5" status: 404 len: 111 microversion: 2.25 time: 0.065367 Aug 31 16:06:10.317983 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1260/2513] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:06:10 2022] GET /compute/v2.1/servers/006771fc-9da9-4b78-9fad-f4b72c311fd5 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:06:10.817656 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-eab4433d-55a3-4600-aadf-abb0870d035e tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:10.843940 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-831ae4da-6212-4b40-8d19-4cd60f745a95 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:10.845284 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-831ae4da-6212-4b40-8d19-4cd60f745a95 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: f9b66475-83f6-49a3-bc63-8965fc1aec14] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:10.859246 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-eab4433d-55a3-4600-aadf-abb0870d035e tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:10.865260 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-831ae4da-6212-4b40-8d19-4cd60f745a95 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:10.866009 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-831ae4da-6212-4b40-8d19-4cd60f745a95 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:10.866565 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-eab4433d-55a3-4600-aadf-abb0870d035e tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:10.867413 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-831ae4da-6212-4b40-8d19-4cd60f745a95 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:10.872058 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-831ae4da-6212-4b40-8d19-4cd60f745a95 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:10.872969 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-eab4433d-55a3-4600-aadf-abb0870d035e tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] 10.222.0.61 "GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae" status: 200 len: 1887 microversion: 2.42 time: 1.433388 Aug 31 16:06:10.875633 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1254/2514] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:06:09 2022] GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae => generated 1887 bytes in 1437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:06:10.876145 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-831ae4da-6212-4b40-8d19-4cd60f745a95 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:10.876855 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-831ae4da-6212-4b40-8d19-4cd60f745a95 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:10.894835 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f281bb2d-4e43-4751-ab4a-596a229349e1 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '.version_select at 0x7f5ae85ee670>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:11.042498 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f281bb2d-4e43-4751-ab4a-596a229349e1 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "GET /compute/v2.1/images/f8c63da2-efca-43a3-a8dd-7f0b9e1fcefc" status: 200 len: 1451 microversion: 2.1 time: 0.163792 Aug 31 16:06:11.044564 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1255/2515] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:06:10 2022] GET /compute/v2.1/images/f8c63da2-efca-43a3-a8dd-7f0b9e1fcefc => generated 1451 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:11.053215 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-71aca28e-44d6-4835-a3a8-809db47a862e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:11.054155 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-71aca28e-44d6-4835-a3a8-809db47a862e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 1262191c-be8b-4535-8704-72db13e3f6cc] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:11.062935 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-71aca28e-44d6-4835-a3a8-809db47a862e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:11.072781 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-71aca28e-44d6-4835-a3a8-809db47a862e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:11.076993 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-71aca28e-44d6-4835-a3a8-809db47a862e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:11.081048 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-71aca28e-44d6-4835-a3a8-809db47a862e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:11.082016 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-71aca28e-44d6-4835-a3a8-809db47a862e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:11.083092 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-71aca28e-44d6-4835-a3a8-809db47a862e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:11.308406 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-831ae4da-6212-4b40-8d19-4cd60f745a95 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:11.315126 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-71aca28e-44d6-4835-a3a8-809db47a862e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:11.325111 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-71aca28e-44d6-4835-a3a8-809db47a862e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/1262191c-be8b-4535-8704-72db13e3f6cc" status: 200 len: 1450 microversion: 2.1 time: 0.278268 Aug 31 16:06:11.326945 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1256/2516] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:11 2022] GET /compute/v2.1/servers/1262191c-be8b-4535-8704-72db13e3f6cc => generated 1450 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:11.327283 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-831ae4da-6212-4b40-8d19-4cd60f745a95 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/f9b66475-83f6-49a3-bc63-8965fc1aec14" status: 200 len: 1534 microversion: 2.1 time: 1.007498 Aug 31 16:06:11.332291 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-94334013-8853-4f24-b6fd-3049ce5f6e60 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:11.333236 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-94334013-8853-4f24-b6fd-3049ce5f6e60 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 65eb7e79-83ec-41c9-80f3-b8cac7369261] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:11.340904 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-94334013-8853-4f24-b6fd-3049ce5f6e60 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:11.341840 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-94334013-8853-4f24-b6fd-3049ce5f6e60 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:11.342505 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-94334013-8853-4f24-b6fd-3049ce5f6e60 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:11.343458 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-94334013-8853-4f24-b6fd-3049ce5f6e60 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:11.344189 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-94334013-8853-4f24-b6fd-3049ce5f6e60 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:11.344857 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-94334013-8853-4f24-b6fd-3049ce5f6e60 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:11.348058 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1261/2517] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:10 2022] GET /compute/v2.1/servers/f9b66475-83f6-49a3-bc63-8965fc1aec14 => generated 1534 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:11.366180 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-57d657fc-f895-41d8-be62-5838b57067ab req-b48febfd-078d-43f7-9216-64c5048b7975 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "685d47e4-721e-4eae-b5f8-78fdb68454ae", "tag": "8734df6b-18ab-45c5-8c67-15fbeeb4e447"}, {"server_uuid": "65eb7e79-83ec-41c9-80f3-b8cac7369261", "name": "network-vif-deleted", "tag": "05d541ce-2ca3-4539-b544-f59c6a407ca6"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:06:11.420046 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-57d657fc-f895-41d8-be62-5838b57067ab req-b48febfd-078d-43f7-9216-64c5048b7975 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:11.423641 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-57d657fc-f895-41d8-be62-5838b57067ab req-b48febfd-078d-43f7-9216-64c5048b7975 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:11.428633 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-57d657fc-f895-41d8-be62-5838b57067ab req-b48febfd-078d-43f7-9216-64c5048b7975 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:11.437894 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:06:11.467738 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-57d657fc-f895-41d8-be62-5838b57067ab req-b48febfd-078d-43f7-9216-64c5048b7975 service nova] Creating event network-changed:8734df6b-18ab-45c5-8c67-15fbeeb4e447 for instance 685d47e4-721e-4eae-b5f8-78fdb68454ae on n-h2-850499-9 Aug 31 16:06:11.471245 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-57d657fc-f895-41d8-be62-5838b57067ab req-b48febfd-078d-43f7-9216-64c5048b7975 service nova] Creating event network-vif-deleted:05d541ce-2ca3-4539-b544-f59c6a407ca6 for instance 65eb7e79-83ec-41c9-80f3-b8cac7369261 on n-h1-850499-9 Aug 31 16:06:11.477800 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-94334013-8853-4f24-b6fd-3049ce5f6e60 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:11.478430 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-94334013-8853-4f24-b6fd-3049ce5f6e60 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:11.479064 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-94334013-8853-4f24-b6fd-3049ce5f6e60 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:11.480443 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-94334013-8853-4f24-b6fd-3049ce5f6e60 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lazy-loading 'fault' on Instance uuid 65eb7e79-83ec-41c9-80f3-b8cac7369261 {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:06:11.509255 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-57d657fc-f895-41d8-be62-5838b57067ab req-b48febfd-078d-43f7-9216-64c5048b7975 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.153874 Aug 31 16:06:11.515802 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1262/2518] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:06:11 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:06:11.580794 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-94334013-8853-4f24-b6fd-3049ce5f6e60 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:11.596568 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-94334013-8853-4f24-b6fd-3049ce5f6e60 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/65eb7e79-83ec-41c9-80f3-b8cac7369261" status: 200 len: 1308 microversion: 2.1 time: 0.267960 Aug 31 16:06:11.597816 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1257/2519] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:11 2022] GET /compute/v2.1/servers/65eb7e79-83ec-41c9-80f3-b8cac7369261 => generated 1308 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:11.951098 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8251cc61-6db9-4b2f-9b8a-93e7b9007871 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:11.953079 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8251cc61-6db9-4b2f-9b8a-93e7b9007871 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] [instance: 685d47e4-721e-4eae-b5f8-78fdb68454ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:12.027865 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8251cc61-6db9-4b2f-9b8a-93e7b9007871 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:12.030495 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8251cc61-6db9-4b2f-9b8a-93e7b9007871 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:12.049250 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8251cc61-6db9-4b2f-9b8a-93e7b9007871 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:12.050822 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8251cc61-6db9-4b2f-9b8a-93e7b9007871 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:12.051704 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8251cc61-6db9-4b2f-9b8a-93e7b9007871 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:12.052306 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8251cc61-6db9-4b2f-9b8a-93e7b9007871 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:12.072682 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-527cd213-d5ad-4e99-b616-875230109ebf tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '.version_select at 0x7f5ae8623f70>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:12.257224 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-527cd213-d5ad-4e99-b616-875230109ebf tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "GET /compute/v2.1/images/f8c63da2-efca-43a3-a8dd-7f0b9e1fcefc" status: 200 len: 1451 microversion: 2.1 time: 0.189557 Aug 31 16:06:12.292186 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1258/2520] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:06:12 2022] GET /compute/v2.1/images/f8c63da2-efca-43a3-a8dd-7f0b9e1fcefc => generated 1451 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:12.361713 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-016b06da-ad35-407f-a153-1c163ead3cfd tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:12.362917 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-016b06da-ad35-407f-a153-1c163ead3cfd tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 1262191c-be8b-4535-8704-72db13e3f6cc] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:12.396208 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-016b06da-ad35-407f-a153-1c163ead3cfd tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:12.399884 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-016b06da-ad35-407f-a153-1c163ead3cfd tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:12.400917 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-016b06da-ad35-407f-a153-1c163ead3cfd tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:12.402473 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-016b06da-ad35-407f-a153-1c163ead3cfd tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:12.408248 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-016b06da-ad35-407f-a153-1c163ead3cfd tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:12.409271 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-016b06da-ad35-407f-a153-1c163ead3cfd tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:12.554679 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-016b06da-ad35-407f-a153-1c163ead3cfd tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:12.573419 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-016b06da-ad35-407f-a153-1c163ead3cfd tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:12.573949 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-016b06da-ad35-407f-a153-1c163ead3cfd tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:12.582867 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-016b06da-ad35-407f-a153-1c163ead3cfd tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lazy-loading 'fault' on Instance uuid 1262191c-be8b-4535-8704-72db13e3f6cc {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:06:14.344203 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-016b06da-ad35-407f-a153-1c163ead3cfd tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:14.403165 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-016b06da-ad35-407f-a153-1c163ead3cfd tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/1262191c-be8b-4535-8704-72db13e3f6cc" status: 200 len: 1304 microversion: 2.1 time: 2.030242 Aug 31 16:06:14.418774 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1259/2521] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:12 2022] GET /compute/v2.1/servers/1262191c-be8b-4535-8704-72db13e3f6cc => generated 1304 bytes in 2062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:06:14.455870 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-78d4bd50-fe83-41d1-a2f9-a67958aa6bda tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:14.463001 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-78d4bd50-fe83-41d1-a2f9-a67958aa6bda tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: f9b66475-83f6-49a3-bc63-8965fc1aec14] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:14.477700 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-78d4bd50-fe83-41d1-a2f9-a67958aa6bda tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:14.478346 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-78d4bd50-fe83-41d1-a2f9-a67958aa6bda tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:14.478919 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-78d4bd50-fe83-41d1-a2f9-a67958aa6bda tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:14.484413 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-78d4bd50-fe83-41d1-a2f9-a67958aa6bda tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:14.486114 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-78d4bd50-fe83-41d1-a2f9-a67958aa6bda tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:14.491447 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-78d4bd50-fe83-41d1-a2f9-a67958aa6bda tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:15.494302 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-78d4bd50-fe83-41d1-a2f9-a67958aa6bda tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:15.516819 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-78d4bd50-fe83-41d1-a2f9-a67958aa6bda tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/f9b66475-83f6-49a3-bc63-8965fc1aec14" status: 200 len: 1527 microversion: 2.1 time: 1.085321 Aug 31 16:06:15.518244 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1260/2522] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:14 2022] GET /compute/v2.1/servers/f9b66475-83f6-49a3-bc63-8965fc1aec14 => generated 1527 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:15.518818 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8251cc61-6db9-4b2f-9b8a-93e7b9007871 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:15.535994 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8251cc61-6db9-4b2f-9b8a-93e7b9007871 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:15.543734 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f460b148-1b5d-46a7-ac29-31cd7b0d4dcb tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:15.544380 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f460b148-1b5d-46a7-ac29-31cd7b0d4dcb tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 65eb7e79-83ec-41c9-80f3-b8cac7369261] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:15.559704 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8251cc61-6db9-4b2f-9b8a-93e7b9007871 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:15.561154 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8251cc61-6db9-4b2f-9b8a-93e7b9007871 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] 10.222.0.61 "GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae" status: 200 len: 1887 microversion: 2.42 time: 3.638336 Aug 31 16:06:15.562249 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1263/2523] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:06:11 2022] GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae => generated 1887 bytes in 3642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:06:15.576019 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-000b30f7-8c91-4717-bfc9-c034c4d767b8 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '.version_select at 0x7f5ae8449040>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:15.576992 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f460b148-1b5d-46a7-ac29-31cd7b0d4dcb tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:15.577555 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f460b148-1b5d-46a7-ac29-31cd7b0d4dcb tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:15.578048 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f460b148-1b5d-46a7-ac29-31cd7b0d4dcb tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:15.578773 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f460b148-1b5d-46a7-ac29-31cd7b0d4dcb tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:15.579240 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f460b148-1b5d-46a7-ac29-31cd7b0d4dcb tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:15.579769 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f460b148-1b5d-46a7-ac29-31cd7b0d4dcb tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:15.636775 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-f460b148-1b5d-46a7-ac29-31cd7b0d4dcb tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] HTTP exception thrown: Instance 65eb7e79-83ec-41c9-80f3-b8cac7369261 could not be found. Aug 31 16:06:15.638981 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f460b148-1b5d-46a7-ac29-31cd7b0d4dcb tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Request method failure captured: Aug 31 16:06:15.638981 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/65eb7e79-83ec-41c9-80f3-b8cac7369261 HTTP/1.1 Aug 31 16:06:15.638981 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:06:15.638981 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:06:15.638981 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:06:15.638981 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:06:15.638981 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:06:15.638981 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:06:15.638981 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:06:15.638981 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:06:15.638981 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4XtNmkvMwnHSL7qhg4V3Wdw6j3Xq_Y_rjXmT_SLe0FMvGo1gt1LwtP8iZQqS4u70Er7TOj14npyXUlDGoqy-1fk7VS9f_3ajnUzSZB5vWqF2Pe5k8siWL_JGtE8zCZBhN_wgL3NLoqpJfp9eoMAktgpjf2nAX9ECp3Cc5bDcIxyAw0 Aug 31 16:06:15.638981 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:06:15.638981 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:06:15.638981 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:06:15.638981 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:06:15.638981 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:06:15.638981 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:06:15.638981 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 7fa2effd15e440598752264e49d2457d Aug 31 16:06:15.638981 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ServersOnMultiNodesTest-1308696187 Aug 31 16:06:15.638981 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:06:15.638981 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:06:15.638981 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7fa2effd15e440598752264e49d2457d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7fa2effd15e440598752264e49d2457d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7fa2effd15e440598752264e49d2457d", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7fa2effd15e440598752264e49d2457d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:06:15.638981 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ServersOnMultiNodesTest-1308696187 Aug 31 16:06:15.638981 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 7fa2effd15e440598752264e49d2457d Aug 31 16:06:15.638981 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1308696187 Aug 31 16:06:15.638981 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ServersOnMultiNodesTest-1308696187-project Aug 31 16:06:15.638981 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:06:15.638981 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:06:15.638981 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 547d88df13034daaad50c3582c7cc3b3 Aug 31 16:06:15.638981 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ServersOnMultiNodesTest-1308696187-project Aug 31 16:06:15.638981 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:06:15.638981 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance 65eb7e79-83ec-41c9-80f3-b8cac7369261 could not be found. Aug 31 16:06:15.638981 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '65eb7e79-83ec-41c9-80f3-b8cac7369261'} Aug 31 16:06:15.638981 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:06:15.638981 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:06:15.638981 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:06:15.638981 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:06:15.638981 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:06:15.638981 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:06:15.638981 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:06:15.638981 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:06:15.638981 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:06:15.638981 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:06:15.638981 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65eb7e79-83ec-41c9-80f3-b8cac7369261 could not be found. Aug 31 16:06:15.638981 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:06:15.638981 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:06:15.638981 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:06:15.638981 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:06:15.638981 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:06:15.638981 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:06:15.638981 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:06:15.638981 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:06:15.638981 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:06:15.638981 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:06:15.638981 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:06:15.638981 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:06:15.638981 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:06:15.638981 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:06:15.638981 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:06:15.638981 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:06:15.638981 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65eb7e79-83ec-41c9-80f3-b8cac7369261 could not be found. Aug 31 16:06:15.638981 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:06:15.638981 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:06:15.638981 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:06:15.643678 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:06:15.643678 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:06:15.643678 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:06:15.643678 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:06:15.643678 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:06:15.643678 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65eb7e79-83ec-41c9-80f3-b8cac7369261 could not be found. Aug 31 16:06:15.643678 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:06:15.644748 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f460b148-1b5d-46a7-ac29-31cd7b0d4dcb tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Returning 404 to user: Instance 65eb7e79-83ec-41c9-80f3-b8cac7369261 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:06:15.653424 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f460b148-1b5d-46a7-ac29-31cd7b0d4dcb tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/65eb7e79-83ec-41c9-80f3-b8cac7369261" status: 404 len: 111 microversion: 2.1 time: 0.133194 Aug 31 16:06:15.659381 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1261/2524] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:15 2022] GET /compute/v2.1/servers/65eb7e79-83ec-41c9-80f3-b8cac7369261 => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:06:15.679758 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-dd653b5f-6451-41fd-ba17-e58aca263203 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:15.681395 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-dd653b5f-6451-41fd-ba17-e58aca263203 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 1262191c-be8b-4535-8704-72db13e3f6cc] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:15.699007 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dd653b5f-6451-41fd-ba17-e58aca263203 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:15.700152 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dd653b5f-6451-41fd-ba17-e58aca263203 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:15.703888 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dd653b5f-6451-41fd-ba17-e58aca263203 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:15.704824 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dd653b5f-6451-41fd-ba17-e58aca263203 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:15.705422 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dd653b5f-6451-41fd-ba17-e58aca263203 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:15.708269 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dd653b5f-6451-41fd-ba17-e58aca263203 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:15.718103 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-000b30f7-8c91-4717-bfc9-c034c4d767b8 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "GET /compute/v2.1/images/f8c63da2-efca-43a3-a8dd-7f0b9e1fcefc" status: 200 len: 1451 microversion: 2.1 time: 0.154518 Aug 31 16:06:15.718705 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1264/2525] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:06:15 2022] GET /compute/v2.1/images/f8c63da2-efca-43a3-a8dd-7f0b9e1fcefc => generated 1451 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:15.744010 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-de055d18-14ea-41ff-998d-4c2fc83e49d4 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:15.747862 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-dd653b5f-6451-41fd-ba17-e58aca263203 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] HTTP exception thrown: Instance 1262191c-be8b-4535-8704-72db13e3f6cc could not be found. Aug 31 16:06:15.754886 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-de055d18-14ea-41ff-998d-4c2fc83e49d4 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: f9b66475-83f6-49a3-bc63-8965fc1aec14] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:15.758367 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-dd653b5f-6451-41fd-ba17-e58aca263203 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Request method failure captured: Aug 31 16:06:15.758367 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/1262191c-be8b-4535-8704-72db13e3f6cc HTTP/1.1 Aug 31 16:06:15.758367 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:06:15.758367 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:06:15.758367 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:06:15.758367 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:06:15.758367 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:06:15.758367 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:06:15.758367 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:06:15.758367 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:06:15.758367 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4Yo5dNOTiRoHOXx-UM5Sn8Jbzoi0Z4yz9YBk3W8_DEhZnVZu-DDO0QOzNoQHJ1nNP8QtjbDsJSdq3n7hK4ZXI2LEyeWPrk9aNaREtGRbElEfeP-G76pg20KjiuDCyp0gfSMP_cw21bhq2fJbey8HuCI0lmGBIAsUVWfxqkVQu-gwfg Aug 31 16:06:15.758367 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:06:15.758367 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:06:15.758367 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:06:15.758367 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:06:15.758367 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:06:15.758367 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:06:15.758367 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: af5a8bccbcb14afd9c6bcd6f4d4f8047 Aug 31 16:06:15.758367 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-DeleteServersTestJSON-1125268000 Aug 31 16:06:15.758367 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:06:15.758367 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:06:15.758367 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/af5a8bccbcb14afd9c6bcd6f4d4f8047"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/af5a8bccbcb14afd9c6bcd6f4d4f8047"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_af5a8bccbcb14afd9c6bcd6f4d4f8047", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/af5a8bccbcb14afd9c6bcd6f4d4f8047"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:06:15.758367 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-DeleteServersTestJSON-1125268000 Aug 31 16:06:15.758367 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: af5a8bccbcb14afd9c6bcd6f4d4f8047 Aug 31 16:06:15.758367 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-DeleteServersTestJSON-1125268000 Aug 31 16:06:15.758367 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-DeleteServersTestJSON-1125268000-project Aug 31 16:06:15.758367 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:06:15.758367 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:06:15.758367 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 4ee58e6a7c284cc9a9c87d0a5c1239aa Aug 31 16:06:15.758367 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-DeleteServersTestJSON-1125268000-project Aug 31 16:06:15.758367 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:06:15.758367 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance 1262191c-be8b-4535-8704-72db13e3f6cc could not be found. Aug 31 16:06:15.758367 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '1262191c-be8b-4535-8704-72db13e3f6cc'} Aug 31 16:06:15.758367 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:06:15.758367 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:06:15.758367 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:06:15.758367 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:06:15.758367 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:06:15.758367 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:06:15.758367 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:06:15.758367 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:06:15.758367 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:06:15.758367 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:06:15.758367 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1262191c-be8b-4535-8704-72db13e3f6cc could not be found. Aug 31 16:06:15.758367 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:06:15.758367 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:06:15.758367 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:06:15.758367 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:06:15.758367 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:06:15.758367 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:06:15.758367 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:06:15.758367 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:06:15.758367 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:06:15.758367 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:06:15.758367 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:06:15.758367 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:06:15.758367 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:06:15.758367 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:06:15.758367 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:06:15.758367 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:06:15.758367 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1262191c-be8b-4535-8704-72db13e3f6cc could not be found. Aug 31 16:06:15.758367 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:06:15.758367 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:06:15.758367 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:06:15.767656 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:06:15.767656 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:06:15.767656 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:06:15.767656 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:06:15.767656 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:06:15.767656 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1262191c-be8b-4535-8704-72db13e3f6cc could not be found. Aug 31 16:06:15.767656 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:06:15.771134 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-dd653b5f-6451-41fd-ba17-e58aca263203 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Returning 404 to user: Instance 1262191c-be8b-4535-8704-72db13e3f6cc could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:06:15.773451 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-dd653b5f-6451-41fd-ba17-e58aca263203 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/1262191c-be8b-4535-8704-72db13e3f6cc" status: 404 len: 111 microversion: 2.1 time: 0.112030 Aug 31 16:06:15.775860 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1262/2526] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:15 2022] GET /compute/v2.1/servers/1262191c-be8b-4535-8704-72db13e3f6cc => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:06:15.800550 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-59d90430-2bcd-4dc2-9c5f-aeb9baede054 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:15.801539 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-59d90430-2bcd-4dc2-9c5f-aeb9baede054 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: efbe58d1-9726-4fa7-a7fb-f3cdc1b70ca4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:15.802614 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:06:15.809073 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-de055d18-14ea-41ff-998d-4c2fc83e49d4 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:15.809829 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-de055d18-14ea-41ff-998d-4c2fc83e49d4 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:15.810283 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-de055d18-14ea-41ff-998d-4c2fc83e49d4 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:15.810706 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-59d90430-2bcd-4dc2-9c5f-aeb9baede054 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:15.811029 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-de055d18-14ea-41ff-998d-4c2fc83e49d4 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:15.811627 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-de055d18-14ea-41ff-998d-4c2fc83e49d4 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:15.811832 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-59d90430-2bcd-4dc2-9c5f-aeb9baede054 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:15.812061 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-de055d18-14ea-41ff-998d-4c2fc83e49d4 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:15.812654 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-59d90430-2bcd-4dc2-9c5f-aeb9baede054 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:15.813862 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-59d90430-2bcd-4dc2-9c5f-aeb9baede054 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:15.814567 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-59d90430-2bcd-4dc2-9c5f-aeb9baede054 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:15.815209 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-59d90430-2bcd-4dc2-9c5f-aeb9baede054 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:15.845261 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:06:15.847800 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-59d90430-2bcd-4dc2-9c5f-aeb9baede054 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] HTTP exception thrown: Instance efbe58d1-9726-4fa7-a7fb-f3cdc1b70ca4 could not be found. Aug 31 16:06:15.849774 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-59d90430-2bcd-4dc2-9c5f-aeb9baede054 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Request method failure captured: Aug 31 16:06:15.849774 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/efbe58d1-9726-4fa7-a7fb-f3cdc1b70ca4 HTTP/1.1 Aug 31 16:06:15.849774 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:06:15.849774 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:06:15.849774 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:06:15.849774 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:06:15.849774 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:06:15.849774 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:06:15.849774 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:06:15.849774 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:06:15.849774 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4XtNmkvMwnHSL7qhg4V3Wdw6j3Xq_Y_rjXmT_SLe0FMvGo1gt1LwtP8iZQqS4u70Er7TOj14npyXUlDGoqy-1fk7VS9f_3ajnUzSZB5vWqF2Pe5k8siWL_JGtE8zCZBhN_wgL3NLoqpJfp9eoMAktgpjf2nAX9ECp3Cc5bDcIxyAw0 Aug 31 16:06:15.849774 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:06:15.849774 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:06:15.849774 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:06:15.849774 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:06:15.849774 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:06:15.849774 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:06:15.849774 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 7fa2effd15e440598752264e49d2457d Aug 31 16:06:15.849774 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ServersOnMultiNodesTest-1308696187 Aug 31 16:06:15.849774 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:06:15.849774 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:06:15.849774 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7fa2effd15e440598752264e49d2457d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7fa2effd15e440598752264e49d2457d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7fa2effd15e440598752264e49d2457d", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7fa2effd15e440598752264e49d2457d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:06:15.849774 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ServersOnMultiNodesTest-1308696187 Aug 31 16:06:15.849774 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 7fa2effd15e440598752264e49d2457d Aug 31 16:06:15.849774 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1308696187 Aug 31 16:06:15.849774 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ServersOnMultiNodesTest-1308696187-project Aug 31 16:06:15.849774 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:06:15.849774 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:06:15.849774 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 547d88df13034daaad50c3582c7cc3b3 Aug 31 16:06:15.849774 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ServersOnMultiNodesTest-1308696187-project Aug 31 16:06:15.849774 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:06:15.849774 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance efbe58d1-9726-4fa7-a7fb-f3cdc1b70ca4 could not be found. Aug 31 16:06:15.849774 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': 'efbe58d1-9726-4fa7-a7fb-f3cdc1b70ca4'} Aug 31 16:06:15.849774 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:06:15.849774 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:06:15.849774 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:06:15.849774 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:06:15.849774 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:06:15.849774 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:06:15.849774 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:06:15.849774 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:06:15.849774 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:06:15.849774 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:06:15.849774 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efbe58d1-9726-4fa7-a7fb-f3cdc1b70ca4 could not be found. Aug 31 16:06:15.849774 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:06:15.849774 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:06:15.849774 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:06:15.849774 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:06:15.849774 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:06:15.849774 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:06:15.849774 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:06:15.849774 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:06:15.849774 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:06:15.849774 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:06:15.849774 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:06:15.849774 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:06:15.849774 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:06:15.849774 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:06:15.849774 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:06:15.849774 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:06:15.849774 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efbe58d1-9726-4fa7-a7fb-f3cdc1b70ca4 could not be found. Aug 31 16:06:15.849774 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:06:15.849774 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:06:15.849774 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:06:15.854013 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:06:15.854013 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:06:15.854013 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:06:15.854013 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:06:15.854013 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:06:15.854013 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efbe58d1-9726-4fa7-a7fb-f3cdc1b70ca4 could not be found. Aug 31 16:06:15.854013 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:06:15.856553 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-59d90430-2bcd-4dc2-9c5f-aeb9baede054 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Returning 404 to user: Instance efbe58d1-9726-4fa7-a7fb-f3cdc1b70ca4 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:06:15.857669 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-59d90430-2bcd-4dc2-9c5f-aeb9baede054 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/efbe58d1-9726-4fa7-a7fb-f3cdc1b70ca4" status: 404 len: 111 microversion: 2.1 time: 0.063865 Aug 31 16:06:15.858454 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1263/2527] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:15 2022] GET /compute/v2.1/servers/efbe58d1-9726-4fa7-a7fb-f3cdc1b70ca4 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:06:15.871738 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9a156d2e-3bc2-4ccb-9074-2836289497c1 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:15.910328 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9a156d2e-3bc2-4ccb-9074-2836289497c1 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "DELETE /compute/v2.1/os-server-groups/94c2e967-fbb5-4f0a-b5ce-f169fbd5b499" status: 204 len: 0 microversion: 2.1 time: 0.044636 Aug 31 16:06:15.914636 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1264/2528] 10.222.0.61 () {58 vars in 1266 bytes} [Wed Aug 31 16:06:15 2022] DELETE /compute/v2.1/os-server-groups/94c2e967-fbb5-4f0a-b5ce-f169fbd5b499 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:06:15.922268 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6c4bdaba-f860-42e7-b8b5-0d7e6d6e8064 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:15.923043 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6c4bdaba-f860-42e7-b8b5-0d7e6d6e8064 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 44f1ab8f-3a6c-41f3-b9fd-7f8aa243bcfa] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:15.932015 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6c4bdaba-f860-42e7-b8b5-0d7e6d6e8064 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:15.933713 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6c4bdaba-f860-42e7-b8b5-0d7e6d6e8064 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:15.934446 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6c4bdaba-f860-42e7-b8b5-0d7e6d6e8064 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:15.936388 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6c4bdaba-f860-42e7-b8b5-0d7e6d6e8064 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:15.937125 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6c4bdaba-f860-42e7-b8b5-0d7e6d6e8064 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:15.938178 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6c4bdaba-f860-42e7-b8b5-0d7e6d6e8064 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:15.979048 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6c4bdaba-f860-42e7-b8b5-0d7e6d6e8064 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 44f1ab8f-3a6c-41f3-b9fd-7f8aa243bcfa] Going to try to terminate instance {{(pid=122256) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:06:16.151111 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=3,nova_api:DELETE=6 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:06:16.218449 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6c4bdaba-f860-42e7-b8b5-0d7e6d6e8064 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "DELETE /compute/v2.1/servers/44f1ab8f-3a6c-41f3-b9fd-7f8aa243bcfa" status: 204 len: 0 microversion: 2.1 time: 0.301939 Aug 31 16:06:16.227704 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1265/2529] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:06:15 2022] DELETE /compute/v2.1/servers/44f1ab8f-3a6c-41f3-b9fd-7f8aa243bcfa => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:06:16.264323 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b3b4d8ff-860f-4e3c-b6fa-af59567b3ff7 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1126780430", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "networks": [{"uuid": "b472c169-a645-4811-858d-fe4088611ce7"}]}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:06:16.442950 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-b3b4d8ff-860f-4e3c-b6fa-af59567b3ff7 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] validate_networks() for [('b472c169-a645-4811-858d-fe4088611ce7', None, None, None, None, None)] {{(pid=122256) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:06:17.116399 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-de055d18-14ea-41ff-998d-4c2fc83e49d4 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:17.128192 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-de055d18-14ea-41ff-998d-4c2fc83e49d4 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/f9b66475-83f6-49a3-bc63-8965fc1aec14" status: 200 len: 1527 microversion: 2.1 time: 1.403043 Aug 31 16:06:17.128790 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1265/2530] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:15 2022] GET /compute/v2.1/servers/f9b66475-83f6-49a3-bc63-8965fc1aec14 => generated 1527 bytes in 1404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:17.149650 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-97b7b96e-e72a-497a-a0b9-0b3a0178368a tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:17.150696 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-97b7b96e-e72a-497a-a0b9-0b3a0178368a tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 44f1ab8f-3a6c-41f3-b9fd-7f8aa243bcfa] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:17.193269 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-97b7b96e-e72a-497a-a0b9-0b3a0178368a tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:17.196999 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-97b7b96e-e72a-497a-a0b9-0b3a0178368a tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:17.198042 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-97b7b96e-e72a-497a-a0b9-0b3a0178368a tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:17.203844 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-97b7b96e-e72a-497a-a0b9-0b3a0178368a tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:17.204816 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-97b7b96e-e72a-497a-a0b9-0b3a0178368a tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:17.205730 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-97b7b96e-e72a-497a-a0b9-0b3a0178368a tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:18.323088 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-97b7b96e-e72a-497a-a0b9-0b3a0178368a tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:18.337828 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-97b7b96e-e72a-497a-a0b9-0b3a0178368a tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/44f1ab8f-3a6c-41f3-b9fd-7f8aa243bcfa" status: 200 len: 1472 microversion: 2.1 time: 1.204540 Aug 31 16:06:18.358282 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1266/2531] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:17 2022] GET /compute/v2.1/servers/44f1ab8f-3a6c-41f3-b9fd-7f8aa243bcfa => generated 1472 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:18.363486 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-744d6d54-9f90-4a64-a6d5-d8dbcf379dab tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:18.376225 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-744d6d54-9f90-4a64-a6d5-d8dbcf379dab tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] [instance: 685d47e4-721e-4eae-b5f8-78fdb68454ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:18.403426 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-744d6d54-9f90-4a64-a6d5-d8dbcf379dab tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:18.407521 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-744d6d54-9f90-4a64-a6d5-d8dbcf379dab tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:18.410096 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-744d6d54-9f90-4a64-a6d5-d8dbcf379dab tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:18.412761 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-744d6d54-9f90-4a64-a6d5-d8dbcf379dab tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:18.417209 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-744d6d54-9f90-4a64-a6d5-d8dbcf379dab tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:18.421306 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-744d6d54-9f90-4a64-a6d5-d8dbcf379dab tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:20.832979 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-b3b4d8ff-860f-4e3c-b6fa-af59567b3ff7 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:06:20.833641 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-b3b4d8ff-860f-4e3c-b6fa-af59567b3ff7 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:06:20.833874 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-b3b4d8ff-860f-4e3c-b6fa-af59567b3ff7 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:06:20.834296 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-b3b4d8ff-860f-4e3c-b6fa-af59567b3ff7 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:06:20.834702 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-b3b4d8ff-860f-4e3c-b6fa-af59567b3ff7 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:06:20.870773 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b3b4d8ff-860f-4e3c-b6fa-af59567b3ff7 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:20.871920 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b3b4d8ff-860f-4e3c-b6fa-af59567b3ff7 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:20.872556 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b3b4d8ff-860f-4e3c-b6fa-af59567b3ff7 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:20.873421 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b3b4d8ff-860f-4e3c-b6fa-af59567b3ff7 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:20.886594 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b3b4d8ff-860f-4e3c-b6fa-af59567b3ff7 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:20.887513 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b3b4d8ff-860f-4e3c-b6fa-af59567b3ff7 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:20.985750 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-b3b4d8ff-860f-4e3c-b6fa-af59567b3ff7 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Getting quotas for project af5a8bccbcb14afd9c6bcd6f4d4f8047. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:06:21.002499 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-b3b4d8ff-860f-4e3c-b6fa-af59567b3ff7 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Getting quotas for user 4ee58e6a7c284cc9a9c87d0a5c1239aa and project af5a8bccbcb14afd9c6bcd6f4d4f8047. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:06:21.050491 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b3b4d8ff-860f-4e3c-b6fa-af59567b3ff7 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Going to run 1 instances... {{(pid=122256) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:06:21.061814 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b3b4d8ff-860f-4e3c-b6fa-af59567b3ff7 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: db1ac026-e512-4e5f-839d-4056cec509b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:06:21.207432 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b3b4d8ff-860f-4e3c-b6fa-af59567b3ff7 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.982352 Aug 31 16:06:21.208232 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1266/2532] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:06:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 4985 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:06:21.227040 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-cfe76483-4d68-4c22-82b4-20a48469e9b5 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '.version_select at 0x7f5ae8674790>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:21.476010 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-cfe76483-4d68-4c22-82b4-20a48469e9b5 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "GET /compute/v2.1/images/f8c63da2-efca-43a3-a8dd-7f0b9e1fcefc" status: 200 len: 1451 microversion: 2.1 time: 0.258415 Aug 31 16:06:21.489992 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1267/2533] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:06:21 2022] GET /compute/v2.1/images/f8c63da2-efca-43a3-a8dd-7f0b9e1fcefc => generated 1451 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:21.508008 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-d521fabc-7e5a-4d12-aa76-5285ab4d2fff req-7fedc686-fb31-462e-99b1-8aaec421861c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9b66475-83f6-49a3-bc63-8965fc1aec14", "name": "network-vif-plugged", "status": "completed", "tag": "c1929c28-a0f2-4fed-aba4-ecfd08ac8e7e"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:06:21.541609 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-d521fabc-7e5a-4d12-aa76-5285ab4d2fff req-7fedc686-fb31-462e-99b1-8aaec421861c service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:21.542921 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-d521fabc-7e5a-4d12-aa76-5285ab4d2fff req-7fedc686-fb31-462e-99b1-8aaec421861c service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:21.546825 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-d521fabc-7e5a-4d12-aa76-5285ab4d2fff req-7fedc686-fb31-462e-99b1-8aaec421861c service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:21.565888 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-d521fabc-7e5a-4d12-aa76-5285ab4d2fff req-7fedc686-fb31-462e-99b1-8aaec421861c service nova] Creating event network-vif-plugged:c1929c28-a0f2-4fed-aba4-ecfd08ac8e7e for instance f9b66475-83f6-49a3-bc63-8965fc1aec14 on n-h2-850499-9 Aug 31 16:06:21.572967 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-d521fabc-7e5a-4d12-aa76-5285ab4d2fff req-7fedc686-fb31-462e-99b1-8aaec421861c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081076 Aug 31 16:06:21.578396 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1268/2534] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:06:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:06:21.585914 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-98424212-e86b-4200-9110-882e6859a254 tempest-MigrationsAdminTest-62329235 tempest-MigrationsAdminTest-62329235-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:21.596411 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-98424212-e86b-4200-9110-882e6859a254 tempest-MigrationsAdminTest-62329235 tempest-MigrationsAdminTest-62329235-project-admin] HTTP exception thrown: Flavor 3308ef12-9ed9-4ca1-8e85-790a96a45515 could not be found. Aug 31 16:06:21.619001 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-98424212-e86b-4200-9110-882e6859a254 tempest-MigrationsAdminTest-62329235 tempest-MigrationsAdminTest-62329235-project-admin] Request method failure captured: Aug 31 16:06:21.619001 n-d-850499-9 devstack@n-api.service[122256]: request: DELETE /compute/v2.1/flavors/3308ef12-9ed9-4ca1-8e85-790a96a45515 HTTP/1.1 Aug 31 16:06:21.619001 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:06:21.619001 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:06:21.619001 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:06:21.619001 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:06:21.619001 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:06:21.619001 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:06:21.619001 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:06:21.619001 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:06:21.619001 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4XETGtOamLPOwOygwhoLCUkVMF20wYrlQFQ4SNzYJ3llqTS9lfHpOgyMscNviveCYolVK9KfV69wFczaeU3aCAvBPGeMAVe6nnAs57io5PGJKO7eQLADma2KhR3ol18Du_tjXZRQNDUoJ0Oh6M_fDYikt4muM3nIsPRyaGhf7IEnQA Aug 31 16:06:21.619001 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:06:21.619001 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:06:21.619001 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:06:21.619001 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:06:21.619001 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:06:21.619001 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:06:21.619001 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: ce7fba32c4f24ac5ab8c5ce5fc340022 Aug 31 16:06:21.619001 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-MigrationsAdminTest-62329235 Aug 31 16:06:21.619001 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,admin,member Aug 31 16:06:21.619001 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,admin,member Aug 31 16:06:21.619001 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ce7fba32c4f24ac5ab8c5ce5fc340022"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ce7fba32c4f24ac5ab8c5ce5fc340022"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ce7fba32c4f24ac5ab8c5ce5fc340022", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ce7fba32c4f24ac5ab8c5ce5fc340022"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:06:21.619001 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-MigrationsAdminTest-62329235 Aug 31 16:06:21.619001 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: ce7fba32c4f24ac5ab8c5ce5fc340022 Aug 31 16:06:21.619001 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-MigrationsAdminTest-62329235 Aug 31 16:06:21.619001 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-MigrationsAdminTest-62329235-project-admin Aug 31 16:06:21.619001 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:06:21.619001 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:06:21.619001 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: dc86cb60a19744a9b7124dff4e1f025b Aug 31 16:06:21.619001 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-MigrationsAdminTest-62329235-project-admin Aug 31 16:06:21.619001 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:06:21.619001 n-d-850499-9 devstack@n-api.service[122256]: exception: Flavor 3308ef12-9ed9-4ca1-8e85-790a96a45515 could not be found. Aug 31 16:06:21.619001 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '3308ef12-9ed9-4ca1-8e85-790a96a45515'} Aug 31 16:06:21.619001 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:06:21.619001 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:06:21.619001 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Aug 31 16:06:21.619001 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi flavor.destroy() Aug 31 16:06:21.619001 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 31 16:06:21.619001 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 31 16:06:21.619001 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Aug 31 16:06:21.619001 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Aug 31 16:06:21.619001 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Aug 31 16:06:21.619001 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Aug 31 16:06:21.619001 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 31 16:06:21.619001 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 31 16:06:21.619001 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Aug 31 16:06:21.619001 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Aug 31 16:06:21.619001 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 3308ef12-9ed9-4ca1-8e85-790a96a45515 could not be found. Aug 31 16:06:21.619001 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:06:21.619001 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:06:21.619001 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:06:21.619001 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:06:21.619001 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:06:21.619001 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:06:21.619001 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:06:21.619001 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:06:21.619001 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:06:21.619001 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:06:21.619001 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Aug 31 16:06:21.619001 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:06:21.619001 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 3308ef12-9ed9-4ca1-8e85-790a96a45515 could not be found. Aug 31 16:06:21.619001 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:06:21.619001 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:06:21.624913 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:06:21.624913 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:06:21.624913 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:06:21.624913 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:06:21.624913 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:06:21.624913 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:06:21.624913 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 3308ef12-9ed9-4ca1-8e85-790a96a45515 could not be found. Aug 31 16:06:21.624913 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:06:21.629046 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-98424212-e86b-4200-9110-882e6859a254 tempest-MigrationsAdminTest-62329235 tempest-MigrationsAdminTest-62329235-project-admin] Returning 404 to user: Flavor 3308ef12-9ed9-4ca1-8e85-790a96a45515 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:06:21.630867 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-98424212-e86b-4200-9110-882e6859a254 tempest-MigrationsAdminTest-62329235 tempest-MigrationsAdminTest-62329235-project-admin] 10.222.0.61 "DELETE /compute/v2.1/flavors/3308ef12-9ed9-4ca1-8e85-790a96a45515" status: 404 len: 109 microversion: 2.1 time: 0.050581 Aug 31 16:06:21.636803 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1269/2535] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:06:21 2022] DELETE /compute/v2.1/flavors/3308ef12-9ed9-4ca1-8e85-790a96a45515 => generated 109 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:06:21.829345 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-2dea2007-b4fe-4b85-ac5c-7e24dd085d95 req-f3f65c49-7ebb-4465-a898-233d3d94253a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "685d47e4-721e-4eae-b5f8-78fdb68454ae", "tag": "95c43f6b-98f3-4304-acef-e290fff017c7"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:06:21.861563 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-2dea2007-b4fe-4b85-ac5c-7e24dd085d95 req-f3f65c49-7ebb-4465-a898-233d3d94253a service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:21.862809 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-2dea2007-b4fe-4b85-ac5c-7e24dd085d95 req-f3f65c49-7ebb-4465-a898-233d3d94253a service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:21.863546 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-2dea2007-b4fe-4b85-ac5c-7e24dd085d95 req-f3f65c49-7ebb-4465-a898-233d3d94253a service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:21.923085 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-2dea2007-b4fe-4b85-ac5c-7e24dd085d95 req-f3f65c49-7ebb-4465-a898-233d3d94253a service nova] Creating event network-changed:95c43f6b-98f3-4304-acef-e290fff017c7 for instance 685d47e4-721e-4eae-b5f8-78fdb68454ae on n-h2-850499-9 Aug 31 16:06:21.933888 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-2dea2007-b4fe-4b85-ac5c-7e24dd085d95 req-f3f65c49-7ebb-4465-a898-233d3d94253a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.294314 Aug 31 16:06:21.936170 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1270/2536] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:06:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:06:21.946519 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4aa2171b-349d-46d3-96ce-800c9415441e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:21.948636 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4aa2171b-349d-46d3-96ce-800c9415441e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 44f1ab8f-3a6c-41f3-b9fd-7f8aa243bcfa] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:21.967425 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4aa2171b-349d-46d3-96ce-800c9415441e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:21.968621 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4aa2171b-349d-46d3-96ce-800c9415441e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:21.969677 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4aa2171b-349d-46d3-96ce-800c9415441e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:21.971230 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4aa2171b-349d-46d3-96ce-800c9415441e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:21.986365 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4aa2171b-349d-46d3-96ce-800c9415441e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:21.988044 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4aa2171b-349d-46d3-96ce-800c9415441e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:22.345791 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-744d6d54-9f90-4a64-a6d5-d8dbcf379dab tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:22.383763 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-744d6d54-9f90-4a64-a6d5-d8dbcf379dab tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:22.388480 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-744d6d54-9f90-4a64-a6d5-d8dbcf379dab tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:22.399762 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-744d6d54-9f90-4a64-a6d5-d8dbcf379dab tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] 10.222.0.61 "GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae" status: 200 len: 1887 microversion: 2.42 time: 4.039869 Aug 31 16:06:22.401058 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1267/2537] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:06:18 2022] GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae => generated 1887 bytes in 4042 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:06:22.425846 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0302b4c3-ad67-4afb-9800-505b7db85a38 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:22.427078 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0302b4c3-ad67-4afb-9800-505b7db85a38 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 35b89015-3888-493a-b521-49a5e3769b00] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:22.456809 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0302b4c3-ad67-4afb-9800-505b7db85a38 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:22.456809 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0302b4c3-ad67-4afb-9800-505b7db85a38 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:22.457760 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0302b4c3-ad67-4afb-9800-505b7db85a38 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:22.459268 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0302b4c3-ad67-4afb-9800-505b7db85a38 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:22.460406 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0302b4c3-ad67-4afb-9800-505b7db85a38 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:22.462028 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0302b4c3-ad67-4afb-9800-505b7db85a38 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:22.498675 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0302b4c3-ad67-4afb-9800-505b7db85a38 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 35b89015-3888-493a-b521-49a5e3769b00] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:06:22.884460 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0302b4c3-ad67-4afb-9800-505b7db85a38 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "DELETE /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00" status: 204 len: 0 microversion: 2.25 time: 0.479823 Aug 31 16:06:22.886289 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1268/2538] 10.222.0.61 () {60 vars in 1280 bytes} [Wed Aug 31 16:06:22 2022] DELETE /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 16:06:22.900789 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-96cbec59-949f-4209-897d-2e2104b2440a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:22.905954 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-96cbec59-949f-4209-897d-2e2104b2440a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: db1ac026-e512-4e5f-839d-4056cec509b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:23.168012 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-96cbec59-949f-4209-897d-2e2104b2440a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:23.195256 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-96cbec59-949f-4209-897d-2e2104b2440a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/db1ac026-e512-4e5f-839d-4056cec509b3" status: 200 len: 1215 microversion: 2.1 time: 0.303792 Aug 31 16:06:23.227815 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1269/2539] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:22 2022] GET /compute/v2.1/servers/db1ac026-e512-4e5f-839d-4056cec509b3 => generated 1215 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:23.265767 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ef7ecccb-69ee-48a1-ad23-147ab66842f5 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-788140218", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:06:23.428668 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-ef7ecccb-69ee-48a1-ad23-147ab66842f5 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] validate_networks() for None {{(pid=122257) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:06:24.617287 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-4aa2171b-349d-46d3-96ce-800c9415441e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:24.642911 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4aa2171b-349d-46d3-96ce-800c9415441e tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/44f1ab8f-3a6c-41f3-b9fd-7f8aa243bcfa" status: 200 len: 1472 microversion: 2.1 time: 2.704520 Aug 31 16:06:24.644096 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1271/2540] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:21 2022] GET /compute/v2.1/servers/44f1ab8f-3a6c-41f3-b9fd-7f8aa243bcfa => generated 1472 bytes in 2707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:24.652199 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d568c3a7-7454-4165-aa98-712daff51fe3 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '.version_select at 0x7f5ae858f040>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:24.746003 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d568c3a7-7454-4165-aa98-712daff51fe3 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "GET /compute/v2.1/images/f8c63da2-efca-43a3-a8dd-7f0b9e1fcefc" status: 200 len: 1451 microversion: 2.1 time: 0.100491 Aug 31 16:06:24.747100 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1272/2541] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:06:24 2022] GET /compute/v2.1/images/f8c63da2-efca-43a3-a8dd-7f0b9e1fcefc => generated 1451 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:24.752061 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8a989f40-d856-49ce-9844-fa32c42fa877 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:24.752868 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8a989f40-d856-49ce-9844-fa32c42fa877 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 35b89015-3888-493a-b521-49a5e3769b00] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:24.761617 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8a989f40-d856-49ce-9844-fa32c42fa877 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:24.762597 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8a989f40-d856-49ce-9844-fa32c42fa877 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:24.763221 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8a989f40-d856-49ce-9844-fa32c42fa877 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:24.764439 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8a989f40-d856-49ce-9844-fa32c42fa877 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:24.765093 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8a989f40-d856-49ce-9844-fa32c42fa877 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:24.765705 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8a989f40-d856-49ce-9844-fa32c42fa877 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:26.377341 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8a989f40-d856-49ce-9844-fa32c42fa877 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:26.409476 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-ef7ecccb-69ee-48a1-ad23-147ab66842f5 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:06:26.410127 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-ef7ecccb-69ee-48a1-ad23-147ab66842f5 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:06:26.410646 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-ef7ecccb-69ee-48a1-ad23-147ab66842f5 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:06:26.411274 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-ef7ecccb-69ee-48a1-ad23-147ab66842f5 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:06:26.411908 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-ef7ecccb-69ee-48a1-ad23-147ab66842f5 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:06:26.439467 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8a989f40-d856-49ce-9844-fa32c42fa877 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:26.442550 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8a989f40-d856-49ce-9844-fa32c42fa877 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:26.462396 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8a989f40-d856-49ce-9844-fa32c42fa877 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00" status: 200 len: 1733 microversion: 2.25 time: 1.713830 Aug 31 16:06:26.469322 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1273/2542] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:06:24 2022] GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00 => generated 1733 bytes in 1721 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:06:26.487456 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ef7ecccb-69ee-48a1-ad23-147ab66842f5 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:26.492974 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-981754cf-8891-4cee-9e3a-230d6d2148f9 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:26.493924 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-981754cf-8891-4cee-9e3a-230d6d2148f9 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] [instance: 685d47e4-721e-4eae-b5f8-78fdb68454ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:26.494889 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ef7ecccb-69ee-48a1-ad23-147ab66842f5 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:26.503363 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ef7ecccb-69ee-48a1-ad23-147ab66842f5 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:26.504039 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-981754cf-8891-4cee-9e3a-230d6d2148f9 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:26.504904 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-981754cf-8891-4cee-9e3a-230d6d2148f9 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:26.505642 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-981754cf-8891-4cee-9e3a-230d6d2148f9 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:26.506658 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-981754cf-8891-4cee-9e3a-230d6d2148f9 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:26.507871 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-981754cf-8891-4cee-9e3a-230d6d2148f9 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:26.508607 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-981754cf-8891-4cee-9e3a-230d6d2148f9 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:26.511637 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ef7ecccb-69ee-48a1-ad23-147ab66842f5 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:26.523308 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ef7ecccb-69ee-48a1-ad23-147ab66842f5 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:26.524257 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ef7ecccb-69ee-48a1-ad23-147ab66842f5 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:26.592075 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-ef7ecccb-69ee-48a1-ad23-147ab66842f5 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Getting quotas for project 55ea476c41904e458bae79e7dad5d654. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:06:26.606045 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-ef7ecccb-69ee-48a1-ad23-147ab66842f5 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Getting quotas for user 0a552442b7e94406b1689baf7a23fa52 and project 55ea476c41904e458bae79e7dad5d654. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:06:26.632885 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ef7ecccb-69ee-48a1-ad23-147ab66842f5 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Going to run 1 instances... {{(pid=122257) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:06:26.646425 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ef7ecccb-69ee-48a1-ad23-147ab66842f5 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 8f165110-0ea6-48c0-8357-ba419171f7af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:06:26.797439 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ef7ecccb-69ee-48a1-ad23-147ab66842f5 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.565600 Aug 31 16:06:26.810972 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1270/2543] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:06:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 3581 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:06:26.818755 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-89089ab2-1c01-4563-936b-c4d61d5e1d12 req-8e5e43f7-cae4-467a-95a2-6d3afd01ce9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44f1ab8f-3a6c-41f3-b9fd-7f8aa243bcfa", "name": "network-vif-unplugged", "status": "completed", "tag": "0a145e45-a983-4c65-8958-474ffc10da86"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:06:26.835943 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-89089ab2-1c01-4563-936b-c4d61d5e1d12 req-8e5e43f7-cae4-467a-95a2-6d3afd01ce9c service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:26.836602 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-89089ab2-1c01-4563-936b-c4d61d5e1d12 req-8e5e43f7-cae4-467a-95a2-6d3afd01ce9c service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:26.837261 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-89089ab2-1c01-4563-936b-c4d61d5e1d12 req-8e5e43f7-cae4-467a-95a2-6d3afd01ce9c service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:26.852475 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-89089ab2-1c01-4563-936b-c4d61d5e1d12 req-8e5e43f7-cae4-467a-95a2-6d3afd01ce9c service nova] Creating event network-vif-unplugged:0a145e45-a983-4c65-8958-474ffc10da86 for instance 44f1ab8f-3a6c-41f3-b9fd-7f8aa243bcfa on n-h2-850499-9 Aug 31 16:06:26.866553 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-89089ab2-1c01-4563-936b-c4d61d5e1d12 req-8e5e43f7-cae4-467a-95a2-6d3afd01ce9c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052047 Aug 31 16:06:26.868536 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1271/2544] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:06:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:06:26.875440 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c018f06d-0b2f-4398-af56-3f8cb59b0839 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:26.876618 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c018f06d-0b2f-4398-af56-3f8cb59b0839 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: db1ac026-e512-4e5f-839d-4056cec509b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:26.884563 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c018f06d-0b2f-4398-af56-3f8cb59b0839 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:26.886087 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c018f06d-0b2f-4398-af56-3f8cb59b0839 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:26.886839 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c018f06d-0b2f-4398-af56-3f8cb59b0839 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:26.887942 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c018f06d-0b2f-4398-af56-3f8cb59b0839 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:26.888651 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c018f06d-0b2f-4398-af56-3f8cb59b0839 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:26.889293 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c018f06d-0b2f-4398-af56-3f8cb59b0839 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:28.177238 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c018f06d-0b2f-4398-af56-3f8cb59b0839 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:28.197192 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c018f06d-0b2f-4398-af56-3f8cb59b0839 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/db1ac026-e512-4e5f-839d-4056cec509b3" status: 200 len: 1315 microversion: 2.1 time: 1.325788 Aug 31 16:06:28.199069 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1272/2545] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:26 2022] GET /compute/v2.1/servers/db1ac026-e512-4e5f-839d-4056cec509b3 => generated 1315 bytes in 1329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:28.216357 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1ddedfb6-92b3-459f-822f-4f0a3a631c78 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:28.217357 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1ddedfb6-92b3-459f-822f-4f0a3a631c78 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 44f1ab8f-3a6c-41f3-b9fd-7f8aa243bcfa] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:28.232066 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1ddedfb6-92b3-459f-822f-4f0a3a631c78 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:28.233007 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1ddedfb6-92b3-459f-822f-4f0a3a631c78 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:28.233636 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1ddedfb6-92b3-459f-822f-4f0a3a631c78 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:28.234607 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1ddedfb6-92b3-459f-822f-4f0a3a631c78 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:28.235355 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1ddedfb6-92b3-459f-822f-4f0a3a631c78 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:28.236023 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1ddedfb6-92b3-459f-822f-4f0a3a631c78 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:28.784894 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-1ddedfb6-92b3-459f-822f-4f0a3a631c78 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d88df13034daaad50c3582c7cc3b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fa2effd15e440598752264e49d2457d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:28.802111 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1ddedfb6-92b3-459f-822f-4f0a3a631c78 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/44f1ab8f-3a6c-41f3-b9fd-7f8aa243bcfa" status: 200 len: 1430 microversion: 2.1 time: 0.601424 Aug 31 16:06:28.802710 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1273/2546] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:28 2022] GET /compute/v2.1/servers/44f1ab8f-3a6c-41f3-b9fd-7f8aa243bcfa => generated 1430 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:28.808125 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-f3e9563e-e8a8-49c2-b091-55f11c8d08b5 req-93be11d9-2268-46aa-8171-44fc731a6766 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "685d47e4-721e-4eae-b5f8-78fdb68454ae", "tag": "ad0f25db-5150-4147-a615-e7e75398c04e"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:06:28.833849 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-f3e9563e-e8a8-49c2-b091-55f11c8d08b5 req-93be11d9-2268-46aa-8171-44fc731a6766 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:28.834626 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-f3e9563e-e8a8-49c2-b091-55f11c8d08b5 req-93be11d9-2268-46aa-8171-44fc731a6766 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:28.835216 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-f3e9563e-e8a8-49c2-b091-55f11c8d08b5 req-93be11d9-2268-46aa-8171-44fc731a6766 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:28.885093 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-f3e9563e-e8a8-49c2-b091-55f11c8d08b5 req-93be11d9-2268-46aa-8171-44fc731a6766 service nova] Creating event network-changed:ad0f25db-5150-4147-a615-e7e75398c04e for instance 685d47e4-721e-4eae-b5f8-78fdb68454ae on n-h2-850499-9 Aug 31 16:06:28.899452 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-f3e9563e-e8a8-49c2-b091-55f11c8d08b5 req-93be11d9-2268-46aa-8171-44fc731a6766 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095004 Aug 31 16:06:28.901019 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1274/2547] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:06:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:06:28.910815 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c38ec556-0270-412e-994e-12f0f7dd557f tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '.version_select at 0x7f5ae910b790>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:29.028520 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c38ec556-0270-412e-994e-12f0f7dd557f tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "GET /compute/v2.1/images/f8c63da2-efca-43a3-a8dd-7f0b9e1fcefc" status: 200 len: 1451 microversion: 2.1 time: 0.124899 Aug 31 16:06:29.060079 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1275/2548] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:06:28 2022] GET /compute/v2.1/images/f8c63da2-efca-43a3-a8dd-7f0b9e1fcefc => generated 1451 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:29.072518 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3093e112-b529-463b-b0e0-5c64134cb3bf tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:29.076547 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3093e112-b529-463b-b0e0-5c64134cb3bf tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 8f165110-0ea6-48c0-8357-ba419171f7af] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:29.105149 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3093e112-b529-463b-b0e0-5c64134cb3bf tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:29.106374 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3093e112-b529-463b-b0e0-5c64134cb3bf tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:29.107386 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3093e112-b529-463b-b0e0-5c64134cb3bf tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:29.108955 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3093e112-b529-463b-b0e0-5c64134cb3bf tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:29.110085 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3093e112-b529-463b-b0e0-5c64134cb3bf tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:29.111263 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3093e112-b529-463b-b0e0-5c64134cb3bf tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:29.610315 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-981754cf-8891-4cee-9e3a-230d6d2148f9 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:29.642711 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-981754cf-8891-4cee-9e3a-230d6d2148f9 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:29.647493 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-981754cf-8891-4cee-9e3a-230d6d2148f9 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:29.648988 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-981754cf-8891-4cee-9e3a-230d6d2148f9 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] 10.222.0.61 "GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae" status: 200 len: 1875 microversion: 2.42 time: 3.160729 Aug 31 16:06:29.663528 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1274/2549] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:06:26 2022] GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae => generated 1875 bytes in 3186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:06:29.667631 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8271be0a-2bcb-4b9a-95db-7c1594b2389f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:29.667631 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8271be0a-2bcb-4b9a-95db-7c1594b2389f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 35b89015-3888-493a-b521-49a5e3769b00] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:29.679982 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8271be0a-2bcb-4b9a-95db-7c1594b2389f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:29.680872 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8271be0a-2bcb-4b9a-95db-7c1594b2389f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:29.681461 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8271be0a-2bcb-4b9a-95db-7c1594b2389f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:29.688217 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8271be0a-2bcb-4b9a-95db-7c1594b2389f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:29.689392 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8271be0a-2bcb-4b9a-95db-7c1594b2389f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:29.690122 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8271be0a-2bcb-4b9a-95db-7c1594b2389f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:29.691064 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3093e112-b529-463b-b0e0-5c64134cb3bf tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:29.705548 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3093e112-b529-463b-b0e0-5c64134cb3bf tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/8f165110-0ea6-48c0-8357-ba419171f7af" status: 200 len: 1264 microversion: 2.1 time: 0.643080 Aug 31 16:06:29.716341 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1276/2550] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:29 2022] GET /compute/v2.1/servers/8f165110-0ea6-48c0-8357-ba419171f7af => generated 1264 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:29.725128 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-5ae92aed-e5f1-4e4c-97d4-38c6bf74d4a9 req-eb610954-4ec6-4b91-9bb4-56432ff7c792 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db1ac026-e512-4e5f-839d-4056cec509b3", "tag": "af630af3-517b-4dc1-b7cf-dda0aebb1a90"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:06:29.757646 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-5ae92aed-e5f1-4e4c-97d4-38c6bf74d4a9 req-eb610954-4ec6-4b91-9bb4-56432ff7c792 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:29.758681 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-5ae92aed-e5f1-4e4c-97d4-38c6bf74d4a9 req-eb610954-4ec6-4b91-9bb4-56432ff7c792 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:29.759351 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-5ae92aed-e5f1-4e4c-97d4-38c6bf74d4a9 req-eb610954-4ec6-4b91-9bb4-56432ff7c792 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:29.813045 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-5ae92aed-e5f1-4e4c-97d4-38c6bf74d4a9 req-eb610954-4ec6-4b91-9bb4-56432ff7c792 service nova] Creating event network-changed:af630af3-517b-4dc1-b7cf-dda0aebb1a90 for instance db1ac026-e512-4e5f-839d-4056cec509b3 on n-h1-850499-9 Aug 31 16:06:29.818522 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-5ae92aed-e5f1-4e4c-97d4-38c6bf74d4a9 req-eb610954-4ec6-4b91-9bb4-56432ff7c792 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099837 Aug 31 16:06:29.820951 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1277/2551] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:06:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:06:29.843899 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-243a6efa-c4b4-473e-948a-666b7f63112e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:29.843899 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-243a6efa-c4b4-473e-948a-666b7f63112e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: db1ac026-e512-4e5f-839d-4056cec509b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:29.843899 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-243a6efa-c4b4-473e-948a-666b7f63112e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:29.843899 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-243a6efa-c4b4-473e-948a-666b7f63112e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:29.843899 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-243a6efa-c4b4-473e-948a-666b7f63112e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:29.844940 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-243a6efa-c4b4-473e-948a-666b7f63112e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:29.846127 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-243a6efa-c4b4-473e-948a-666b7f63112e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:29.846127 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-243a6efa-c4b4-473e-948a-666b7f63112e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:30.623809 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8271be0a-2bcb-4b9a-95db-7c1594b2389f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:30.651200 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8271be0a-2bcb-4b9a-95db-7c1594b2389f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:30.658070 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8271be0a-2bcb-4b9a-95db-7c1594b2389f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:30.671224 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8271be0a-2bcb-4b9a-95db-7c1594b2389f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00" status: 200 len: 1733 microversion: 2.25 time: 1.012031 Aug 31 16:06:30.677944 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1275/2552] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:06:29 2022] GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00 => generated 1733 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:06:30.701458 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b5ce63ef-3116-49b1-abb1-e6ad1787a9c5 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:30.702824 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b5ce63ef-3116-49b1-abb1-e6ad1787a9c5 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] [instance: 44f1ab8f-3a6c-41f3-b9fd-7f8aa243bcfa] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:30.728902 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b5ce63ef-3116-49b1-abb1-e6ad1787a9c5 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:30.730320 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b5ce63ef-3116-49b1-abb1-e6ad1787a9c5 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:30.734818 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b5ce63ef-3116-49b1-abb1-e6ad1787a9c5 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:30.741365 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b5ce63ef-3116-49b1-abb1-e6ad1787a9c5 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:30.750293 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b5ce63ef-3116-49b1-abb1-e6ad1787a9c5 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:30.753703 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b5ce63ef-3116-49b1-abb1-e6ad1787a9c5 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:30.763438 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-243a6efa-c4b4-473e-948a-666b7f63112e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:30.779102 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-243a6efa-c4b4-473e-948a-666b7f63112e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/db1ac026-e512-4e5f-839d-4056cec509b3" status: 200 len: 1315 microversion: 2.1 time: 0.956242 Aug 31 16:06:30.781284 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1278/2553] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:29 2022] GET /compute/v2.1/servers/db1ac026-e512-4e5f-839d-4056cec509b3 => generated 1315 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:30.800199 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-b5ce63ef-3116-49b1-abb1-e6ad1787a9c5 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] HTTP exception thrown: Instance 44f1ab8f-3a6c-41f3-b9fd-7f8aa243bcfa could not be found. Aug 31 16:06:30.802463 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b5ce63ef-3116-49b1-abb1-e6ad1787a9c5 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Request method failure captured: Aug 31 16:06:30.802463 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/44f1ab8f-3a6c-41f3-b9fd-7f8aa243bcfa HTTP/1.1 Aug 31 16:06:30.802463 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:06:30.802463 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:06:30.802463 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:06:30.802463 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:06:30.802463 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:06:30.802463 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:06:30.802463 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:06:30.802463 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:06:30.802463 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4XtNmkvMwnHSL7qhg4V3Wdw6j3Xq_Y_rjXmT_SLe0FMvGo1gt1LwtP8iZQqS4u70Er7TOj14npyXUlDGoqy-1fk7VS9f_3ajnUzSZB5vWqF2Pe5k8siWL_JGtE8zCZBhN_wgL3NLoqpJfp9eoMAktgpjf2nAX9ECp3Cc5bDcIxyAw0 Aug 31 16:06:30.802463 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:06:30.802463 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:06:30.802463 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:06:30.802463 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:06:30.802463 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:06:30.802463 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:06:30.802463 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 7fa2effd15e440598752264e49d2457d Aug 31 16:06:30.802463 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ServersOnMultiNodesTest-1308696187 Aug 31 16:06:30.802463 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:06:30.802463 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:06:30.802463 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7fa2effd15e440598752264e49d2457d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7fa2effd15e440598752264e49d2457d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7fa2effd15e440598752264e49d2457d", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7fa2effd15e440598752264e49d2457d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:06:30.802463 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ServersOnMultiNodesTest-1308696187 Aug 31 16:06:30.802463 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 7fa2effd15e440598752264e49d2457d Aug 31 16:06:30.802463 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1308696187 Aug 31 16:06:30.802463 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ServersOnMultiNodesTest-1308696187-project Aug 31 16:06:30.802463 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:06:30.802463 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:06:30.802463 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 547d88df13034daaad50c3582c7cc3b3 Aug 31 16:06:30.802463 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ServersOnMultiNodesTest-1308696187-project Aug 31 16:06:30.802463 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:06:30.802463 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance 44f1ab8f-3a6c-41f3-b9fd-7f8aa243bcfa could not be found. Aug 31 16:06:30.802463 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '44f1ab8f-3a6c-41f3-b9fd-7f8aa243bcfa'} Aug 31 16:06:30.802463 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:06:30.802463 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:06:30.802463 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:06:30.802463 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:06:30.802463 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:06:30.802463 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:06:30.802463 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:06:30.802463 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:06:30.802463 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:06:30.802463 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:06:30.802463 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44f1ab8f-3a6c-41f3-b9fd-7f8aa243bcfa could not be found. Aug 31 16:06:30.802463 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:06:30.802463 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:06:30.802463 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:06:30.802463 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:06:30.802463 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:06:30.802463 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:06:30.802463 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:06:30.802463 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:06:30.802463 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:06:30.802463 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:06:30.802463 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:06:30.802463 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:06:30.802463 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:06:30.802463 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:06:30.802463 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:06:30.802463 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:06:30.802463 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44f1ab8f-3a6c-41f3-b9fd-7f8aa243bcfa could not be found. Aug 31 16:06:30.802463 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:06:30.802463 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:06:30.802463 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:06:30.806195 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:06:30.806195 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:06:30.806195 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:06:30.806195 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:06:30.806195 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:06:30.806195 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44f1ab8f-3a6c-41f3-b9fd-7f8aa243bcfa could not be found. Aug 31 16:06:30.806195 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:06:30.807367 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2ba7553d-836f-45a5-b446-f5ababbf97ad tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '.version_select at 0x7f5ae8449b80>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:30.813775 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b5ce63ef-3116-49b1-abb1-e6ad1787a9c5 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] Returning 404 to user: Instance 44f1ab8f-3a6c-41f3-b9fd-7f8aa243bcfa could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:06:30.814939 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b5ce63ef-3116-49b1-abb1-e6ad1787a9c5 tempest-ServersOnMultiNodesTest-1308696187 tempest-ServersOnMultiNodesTest-1308696187-project] 10.222.0.61 "GET /compute/v2.1/servers/44f1ab8f-3a6c-41f3-b9fd-7f8aa243bcfa" status: 404 len: 111 microversion: 2.1 time: 0.135368 Aug 31 16:06:30.857829 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1276/2554] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:30 2022] GET /compute/v2.1/servers/44f1ab8f-3a6c-41f3-b9fd-7f8aa243bcfa => generated 111 bytes in 176 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:06:30.887658 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f243c92a-99a7-447f-90ef-3019b9bd254f tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:30.890916 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f243c92a-99a7-447f-90ef-3019b9bd254f tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] [instance: 685d47e4-721e-4eae-b5f8-78fdb68454ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:30.928423 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:06:30.933455 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f243c92a-99a7-447f-90ef-3019b9bd254f tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:30.938238 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f243c92a-99a7-447f-90ef-3019b9bd254f tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:30.940537 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f243c92a-99a7-447f-90ef-3019b9bd254f tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:30.943863 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f243c92a-99a7-447f-90ef-3019b9bd254f tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:30.946800 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f243c92a-99a7-447f-90ef-3019b9bd254f tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:30.949794 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f243c92a-99a7-447f-90ef-3019b9bd254f tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:30.978924 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2ba7553d-836f-45a5-b446-f5ababbf97ad tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "GET /compute/v2.1/images/f8c63da2-efca-43a3-a8dd-7f0b9e1fcefc" status: 200 len: 1451 microversion: 2.1 time: 0.190988 Aug 31 16:06:30.982957 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1279/2555] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:06:30 2022] GET /compute/v2.1/images/f8c63da2-efca-43a3-a8dd-7f0b9e1fcefc => generated 1451 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:31.003722 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-04ea9003-5f11-4622-8856-9fa7c6c78a34 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:31.007291 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-04ea9003-5f11-4622-8856-9fa7c6c78a34 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 8f165110-0ea6-48c0-8357-ba419171f7af] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:31.035297 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-04ea9003-5f11-4622-8856-9fa7c6c78a34 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:31.035868 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-04ea9003-5f11-4622-8856-9fa7c6c78a34 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:31.036341 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-04ea9003-5f11-4622-8856-9fa7c6c78a34 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:31.041331 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=6 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:06:31.043751 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-04ea9003-5f11-4622-8856-9fa7c6c78a34 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:31.045151 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-04ea9003-5f11-4622-8856-9fa7c6c78a34 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:31.045614 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-04ea9003-5f11-4622-8856-9fa7c6c78a34 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:31.458891 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-04ea9003-5f11-4622-8856-9fa7c6c78a34 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:31.475385 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-04ea9003-5f11-4622-8856-9fa7c6c78a34 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/8f165110-0ea6-48c0-8357-ba419171f7af" status: 200 len: 1282 microversion: 2.1 time: 0.488993 Aug 31 16:06:31.476672 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1280/2556] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:30 2022] GET /compute/v2.1/servers/8f165110-0ea6-48c0-8357-ba419171f7af => generated 1282 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:31.486685 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-b97bdd6a-5ab4-425c-b88c-7d95e3dd727c req-33b71327-77e2-4b9c-9595-18abeb81093a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44f1ab8f-3a6c-41f3-b9fd-7f8aa243bcfa", "name": "network-vif-deleted", "tag": "0a145e45-a983-4c65-8958-474ffc10da86"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:06:31.520385 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-b97bdd6a-5ab4-425c-b88c-7d95e3dd727c req-33b71327-77e2-4b9c-9595-18abeb81093a service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:31.531450 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-b97bdd6a-5ab4-425c-b88c-7d95e3dd727c req-33b71327-77e2-4b9c-9595-18abeb81093a service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:31.543895 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-b97bdd6a-5ab4-425c-b88c-7d95e3dd727c req-33b71327-77e2-4b9c-9595-18abeb81093a service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:31.585007 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-b97bdd6a-5ab4-425c-b88c-7d95e3dd727c req-33b71327-77e2-4b9c-9595-18abeb81093a service nova] Creating event network-vif-deleted:0a145e45-a983-4c65-8958-474ffc10da86 for instance 44f1ab8f-3a6c-41f3-b9fd-7f8aa243bcfa on n-h2-850499-9 Aug 31 16:06:31.601306 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-b97bdd6a-5ab4-425c-b88c-7d95e3dd727c req-33b71327-77e2-4b9c-9595-18abeb81093a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122939 Aug 31 16:06:31.603148 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1281/2557] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:06:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:06:31.718536 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-532ff795-dc07-4738-9d2c-d3d80e5ac416 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:31.719790 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-532ff795-dc07-4738-9d2c-d3d80e5ac416 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 35b89015-3888-493a-b521-49a5e3769b00] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:31.741851 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-532ff795-dc07-4738-9d2c-d3d80e5ac416 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:31.742867 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-532ff795-dc07-4738-9d2c-d3d80e5ac416 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:31.743626 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-532ff795-dc07-4738-9d2c-d3d80e5ac416 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:31.746900 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-532ff795-dc07-4738-9d2c-d3d80e5ac416 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:31.748051 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-532ff795-dc07-4738-9d2c-d3d80e5ac416 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:31.750928 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-532ff795-dc07-4738-9d2c-d3d80e5ac416 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:31.963444 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-532ff795-dc07-4738-9d2c-d3d80e5ac416 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:31.990937 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-532ff795-dc07-4738-9d2c-d3d80e5ac416 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:31.999405 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-532ff795-dc07-4738-9d2c-d3d80e5ac416 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:32.000937 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-532ff795-dc07-4738-9d2c-d3d80e5ac416 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00" status: 200 len: 1665 microversion: 2.25 time: 0.296118 Aug 31 16:06:32.018665 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1282/2558] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:06:31 2022] GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00 => generated 1665 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:06:32.037421 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d3dba0af-a2ae-4cdd-9a8c-5f24085a02e8 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:32.050791 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d3dba0af-a2ae-4cdd-9a8c-5f24085a02e8 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: db1ac026-e512-4e5f-839d-4056cec509b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:32.091371 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d3dba0af-a2ae-4cdd-9a8c-5f24085a02e8 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:32.092155 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d3dba0af-a2ae-4cdd-9a8c-5f24085a02e8 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:32.092903 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d3dba0af-a2ae-4cdd-9a8c-5f24085a02e8 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:32.097237 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d3dba0af-a2ae-4cdd-9a8c-5f24085a02e8 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:32.098024 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d3dba0af-a2ae-4cdd-9a8c-5f24085a02e8 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:32.099022 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d3dba0af-a2ae-4cdd-9a8c-5f24085a02e8 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:32.372799 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f243c92a-99a7-447f-90ef-3019b9bd254f tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:32.436579 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f243c92a-99a7-447f-90ef-3019b9bd254f tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:32.442587 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f243c92a-99a7-447f-90ef-3019b9bd254f tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:32.455934 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f243c92a-99a7-447f-90ef-3019b9bd254f tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] 10.222.0.61 "GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae" status: 200 len: 1875 microversion: 2.42 time: 1.586698 Aug 31 16:06:32.458133 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1277/2559] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:06:30 2022] GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae => generated 1875 bytes in 1600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:06:32.471800 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-771ddd38-9d32-420d-b6cd-372ee578e9e5 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '.version_select at 0x7f5ae86744c0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:32.617532 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-771ddd38-9d32-420d-b6cd-372ee578e9e5 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "GET /compute/v2.1/images/f8c63da2-efca-43a3-a8dd-7f0b9e1fcefc" status: 200 len: 1451 microversion: 2.1 time: 0.152580 Aug 31 16:06:32.618385 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1278/2560] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:06:32 2022] GET /compute/v2.1/images/f8c63da2-efca-43a3-a8dd-7f0b9e1fcefc => generated 1451 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:32.630988 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-42a34b40-701e-4cd6-9cd3-b007441294aa tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:32.634365 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-42a34b40-701e-4cd6-9cd3-b007441294aa tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 8f165110-0ea6-48c0-8357-ba419171f7af] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:32.672149 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42a34b40-701e-4cd6-9cd3-b007441294aa tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:32.672660 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42a34b40-701e-4cd6-9cd3-b007441294aa tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:32.673116 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42a34b40-701e-4cd6-9cd3-b007441294aa tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:32.673848 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42a34b40-701e-4cd6-9cd3-b007441294aa tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:32.674311 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42a34b40-701e-4cd6-9cd3-b007441294aa tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:32.674748 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42a34b40-701e-4cd6-9cd3-b007441294aa tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:33.763861 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-42a34b40-701e-4cd6-9cd3-b007441294aa tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:33.780940 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-42a34b40-701e-4cd6-9cd3-b007441294aa tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/8f165110-0ea6-48c0-8357-ba419171f7af" status: 200 len: 1270 microversion: 2.1 time: 1.159157 Aug 31 16:06:33.786096 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1279/2561] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:32 2022] GET /compute/v2.1/servers/8f165110-0ea6-48c0-8357-ba419171f7af => generated 1270 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:33.803568 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e2c692a9-65f7-4ef6-81c1-a7beeca6de45 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:33.804573 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e2c692a9-65f7-4ef6-81c1-a7beeca6de45 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 35b89015-3888-493a-b521-49a5e3769b00] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:33.811954 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e2c692a9-65f7-4ef6-81c1-a7beeca6de45 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:33.817805 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e2c692a9-65f7-4ef6-81c1-a7beeca6de45 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:33.818523 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e2c692a9-65f7-4ef6-81c1-a7beeca6de45 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:33.819444 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e2c692a9-65f7-4ef6-81c1-a7beeca6de45 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:33.820130 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e2c692a9-65f7-4ef6-81c1-a7beeca6de45 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:33.822327 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e2c692a9-65f7-4ef6-81c1-a7beeca6de45 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:33.833215 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d3dba0af-a2ae-4cdd-9a8c-5f24085a02e8 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:33.860115 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-e2c692a9-65f7-4ef6-81c1-a7beeca6de45 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] HTTP exception thrown: Instance 35b89015-3888-493a-b521-49a5e3769b00 could not be found. Aug 31 16:06:33.862099 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d3dba0af-a2ae-4cdd-9a8c-5f24085a02e8 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/db1ac026-e512-4e5f-839d-4056cec509b3" status: 200 len: 1315 microversion: 2.1 time: 1.841724 Aug 31 16:06:33.862255 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e2c692a9-65f7-4ef6-81c1-a7beeca6de45 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Request method failure captured: Aug 31 16:06:33.862255 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00 HTTP/1.1 Aug 31 16:06:33.862255 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:06:33.862255 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:06:33.862255 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:06:33.862255 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:06:33.862255 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:06:33.862255 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:06:33.862255 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:06:33.862255 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:06:33.862255 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4Sz-nEtBIir4h6pKigKL9l8DQ-FgYlbEQSEmOoXkJYtraxr-5lRgxCapV6PXVJ4YbN1zbOPnHuzBENR6jTq9c9nKu5JErZVbYmzTyVmurBnViPBcsdVuA7zckwipUv_K3iEGy1xSXMXAMx1-1GWp5CVSbFfBIPYyZm0WGFyBwt-m9A Aug 31 16:06:33.862255 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:06:33.862255 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:06:33.862255 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:06:33.862255 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:06:33.862255 n-d-850499-9 devstack@n-api.service[122256]: X-Openstack-Nova-Api-Version: 2.25 Aug 31 16:06:33.862255 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:06:33.862255 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:06:33.862255 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 01a9266ba9b14c6a8b6e79aecfe86df6 Aug 31 16:06:33.862255 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-850802922 Aug 31 16:06:33.862255 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:06:33.862255 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:06:33.862255 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/01a9266ba9b14c6a8b6e79aecfe86df6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/01a9266ba9b14c6a8b6e79aecfe86df6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_01a9266ba9b14c6a8b6e79aecfe86df6", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/01a9266ba9b14c6a8b6e79aecfe86df6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:06:33.862255 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-850802922 Aug 31 16:06:33.862255 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 01a9266ba9b14c6a8b6e79aecfe86df6 Aug 31 16:06:33.862255 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-850802922 Aug 31 16:06:33.862255 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-LiveAutoBlockMigrationV225Test-850802922-project Aug 31 16:06:33.862255 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:06:33.862255 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:06:33.862255 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: bb8e30aa23194f898b07dfbc6fd8d5de Aug 31 16:06:33.862255 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-850802922-project Aug 31 16:06:33.862255 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:06:33.862255 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance 35b89015-3888-493a-b521-49a5e3769b00 could not be found. Aug 31 16:06:33.862255 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '35b89015-3888-493a-b521-49a5e3769b00'} Aug 31 16:06:33.862255 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:06:33.862255 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:06:33.862255 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:06:33.862255 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:06:33.862255 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:06:33.862255 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:06:33.862255 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:06:33.862255 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:06:33.862255 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:06:33.862255 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:06:33.862255 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35b89015-3888-493a-b521-49a5e3769b00 could not be found. Aug 31 16:06:33.862255 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:06:33.862255 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:06:33.862255 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:06:33.862255 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:06:33.862255 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:06:33.862255 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:06:33.862255 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:06:33.862255 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:06:33.862255 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:06:33.862255 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:06:33.862255 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:06:33.862255 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:06:33.862255 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:06:33.862255 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:06:33.862255 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:06:33.862255 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:06:33.862255 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35b89015-3888-493a-b521-49a5e3769b00 could not be found. Aug 31 16:06:33.862255 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:06:33.866361 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:06:33.866361 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:06:33.866361 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:06:33.866361 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:06:33.866361 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:06:33.866361 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:06:33.866361 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:06:33.866361 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35b89015-3888-493a-b521-49a5e3769b00 could not be found. Aug 31 16:06:33.866361 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:06:33.866361 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e2c692a9-65f7-4ef6-81c1-a7beeca6de45 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Returning 404 to user: Instance 35b89015-3888-493a-b521-49a5e3769b00 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:06:33.871203 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1283/2562] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:32 2022] GET /compute/v2.1/servers/db1ac026-e512-4e5f-839d-4056cec509b3 => generated 1315 bytes in 1852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:33.881164 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e2c692a9-65f7-4ef6-81c1-a7beeca6de45 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00" status: 404 len: 111 microversion: 2.25 time: 0.091406 Aug 31 16:06:33.883825 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ea20ee5a-5a27-4fb3-8b9d-e8c76c8e5438 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:33.885557 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ea20ee5a-5a27-4fb3-8b9d-e8c76c8e5438 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] [instance: 685d47e4-721e-4eae-b5f8-78fdb68454ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:33.897414 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1280/2563] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:06:33 2022] GET /compute/v2.1/servers/35b89015-3888-493a-b521-49a5e3769b00 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:06:33.904333 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-fb87d80e-2e8c-4df5-a48f-7f42a59960a6 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '.version_select at 0x7f5ae85ee4c0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:33.910087 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ea20ee5a-5a27-4fb3-8b9d-e8c76c8e5438 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:33.914402 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ea20ee5a-5a27-4fb3-8b9d-e8c76c8e5438 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:33.915180 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ea20ee5a-5a27-4fb3-8b9d-e8c76c8e5438 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:33.916187 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ea20ee5a-5a27-4fb3-8b9d-e8c76c8e5438 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:33.917439 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ea20ee5a-5a27-4fb3-8b9d-e8c76c8e5438 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:33.918099 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ea20ee5a-5a27-4fb3-8b9d-e8c76c8e5438 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:34.015185 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-fb87d80e-2e8c-4df5-a48f-7f42a59960a6 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "GET /compute/v2.1/images/f8c63da2-efca-43a3-a8dd-7f0b9e1fcefc" status: 200 len: 1451 microversion: 2.1 time: 0.116513 Aug 31 16:06:34.019719 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1281/2564] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:06:33 2022] GET /compute/v2.1/images/f8c63da2-efca-43a3-a8dd-7f0b9e1fcefc => generated 1451 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:34.033258 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-87721493-713a-4868-bcce-c8e2aee27211 req-a52a3dc5-cf4d-4430-b4f5-54dbb518bb70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35b89015-3888-493a-b521-49a5e3769b00", "name": "network-vif-deleted", "tag": "fdce032a-0b32-49de-acd3-1c9df93ae828"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:06:34.066602 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-87721493-713a-4868-bcce-c8e2aee27211 req-a52a3dc5-cf4d-4430-b4f5-54dbb518bb70 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:34.067908 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-87721493-713a-4868-bcce-c8e2aee27211 req-a52a3dc5-cf4d-4430-b4f5-54dbb518bb70 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:34.069002 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-87721493-713a-4868-bcce-c8e2aee27211 req-a52a3dc5-cf4d-4430-b4f5-54dbb518bb70 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:34.097524 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-87721493-713a-4868-bcce-c8e2aee27211 req-a52a3dc5-cf4d-4430-b4f5-54dbb518bb70 service nova] Creating event network-vif-deleted:fdce032a-0b32-49de-acd3-1c9df93ae828 for instance 35b89015-3888-493a-b521-49a5e3769b00 on n-h1-850499-9 Aug 31 16:06:34.105624 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-87721493-713a-4868-bcce-c8e2aee27211 req-a52a3dc5-cf4d-4430-b4f5-54dbb518bb70 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084265 Aug 31 16:06:34.107924 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1282/2565] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:06:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:06:34.118710 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-72957dd2-3859-44fc-aafe-f867b143ddb3 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '.version_select at 0x7f5ae85ee3a0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:34.148523 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-72957dd2-3859-44fc-aafe-f867b143ddb3 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1943951676" status: 204 len: 0 microversion: 2.25 time: 0.038064 Aug 31 16:06:34.150902 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1283/2566] 10.222.0.61 () {60 vars in 1262 bytes} [Wed Aug 31 16:06:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1943951676 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 16:06:34.826906 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6de17bb1-a6f1-45c9-b107-89a6bdf893b2 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:34.835681 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6de17bb1-a6f1-45c9-b107-89a6bdf893b2 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 8f165110-0ea6-48c0-8357-ba419171f7af] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:34.884394 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6de17bb1-a6f1-45c9-b107-89a6bdf893b2 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:34.885304 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6de17bb1-a6f1-45c9-b107-89a6bdf893b2 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:34.886014 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6de17bb1-a6f1-45c9-b107-89a6bdf893b2 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:34.887031 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6de17bb1-a6f1-45c9-b107-89a6bdf893b2 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:34.891488 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6de17bb1-a6f1-45c9-b107-89a6bdf893b2 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:34.892810 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6de17bb1-a6f1-45c9-b107-89a6bdf893b2 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:35.303185 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-6de17bb1-a6f1-45c9-b107-89a6bdf893b2 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:35.319414 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6de17bb1-a6f1-45c9-b107-89a6bdf893b2 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/8f165110-0ea6-48c0-8357-ba419171f7af" status: 200 len: 1270 microversion: 2.1 time: 0.494900 Aug 31 16:06:35.351134 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1284/2567] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:34 2022] GET /compute/v2.1/servers/8f165110-0ea6-48c0-8357-ba419171f7af => generated 1270 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:35.366616 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4813b0d6-bebe-4130-8625-0ebf8fa2e2b5 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:35.367906 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4813b0d6-bebe-4130-8625-0ebf8fa2e2b5 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: db1ac026-e512-4e5f-839d-4056cec509b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:35.410098 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4813b0d6-bebe-4130-8625-0ebf8fa2e2b5 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:35.411196 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4813b0d6-bebe-4130-8625-0ebf8fa2e2b5 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:35.411687 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4813b0d6-bebe-4130-8625-0ebf8fa2e2b5 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:35.412425 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4813b0d6-bebe-4130-8625-0ebf8fa2e2b5 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:35.412892 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4813b0d6-bebe-4130-8625-0ebf8fa2e2b5 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:35.414387 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4813b0d6-bebe-4130-8625-0ebf8fa2e2b5 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:36.035958 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ea20ee5a-5a27-4fb3-8b9d-e8c76c8e5438 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:36.072454 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ea20ee5a-5a27-4fb3-8b9d-e8c76c8e5438 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:36.074613 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ea20ee5a-5a27-4fb3-8b9d-e8c76c8e5438 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:36.114308 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ea20ee5a-5a27-4fb3-8b9d-e8c76c8e5438 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] 10.222.0.61 "GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae" status: 200 len: 1875 microversion: 2.42 time: 2.202665 Aug 31 16:06:36.123726 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1284/2568] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:06:33 2022] GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae => generated 1875 bytes in 2251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:06:36.142224 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-4813b0d6-bebe-4130-8625-0ebf8fa2e2b5 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:36.147417 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4391929e-7d15-4c6a-9c9c-6d8cb405ba3a tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '.version_select at 0x7f5ae84cd9d0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:36.175900 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4813b0d6-bebe-4130-8625-0ebf8fa2e2b5 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/db1ac026-e512-4e5f-839d-4056cec509b3" status: 200 len: 1315 microversion: 2.1 time: 0.813789 Aug 31 16:06:36.177488 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1285/2569] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:35 2022] GET /compute/v2.1/servers/db1ac026-e512-4e5f-839d-4056cec509b3 => generated 1315 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:36.274272 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4391929e-7d15-4c6a-9c9c-6d8cb405ba3a tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "GET /compute/v2.1/images/f8c63da2-efca-43a3-a8dd-7f0b9e1fcefc" status: 200 len: 1451 microversion: 2.1 time: 0.142046 Aug 31 16:06:36.290909 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1285/2570] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:06:36 2022] GET /compute/v2.1/images/f8c63da2-efca-43a3-a8dd-7f0b9e1fcefc => generated 1451 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:36.362734 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9580e75d-feb3-4b63-9bdf-1ce5b12c1f4d tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:36.370812 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9580e75d-feb3-4b63-9bdf-1ce5b12c1f4d tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 8f165110-0ea6-48c0-8357-ba419171f7af] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:36.388687 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9580e75d-feb3-4b63-9bdf-1ce5b12c1f4d tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:36.389391 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9580e75d-feb3-4b63-9bdf-1ce5b12c1f4d tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:36.390167 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9580e75d-feb3-4b63-9bdf-1ce5b12c1f4d tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:36.391370 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9580e75d-feb3-4b63-9bdf-1ce5b12c1f4d tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:36.392244 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9580e75d-feb3-4b63-9bdf-1ce5b12c1f4d tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:36.392967 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9580e75d-feb3-4b63-9bdf-1ce5b12c1f4d tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:36.611317 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-9580e75d-feb3-4b63-9bdf-1ce5b12c1f4d tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:36.644578 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9580e75d-feb3-4b63-9bdf-1ce5b12c1f4d tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/8f165110-0ea6-48c0-8357-ba419171f7af" status: 200 len: 1270 microversion: 2.1 time: 0.287777 Aug 31 16:06:36.660009 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1286/2571] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:36 2022] GET /compute/v2.1/servers/8f165110-0ea6-48c0-8357-ba419171f7af => generated 1270 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:37.158847 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:06:37.164866 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=8 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:06:37.208376 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-48ffa270-e949-4655-bb73-ac0d1354b703 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:37.208516 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-cbf8f26a-ce6e-4bc8-9c8d-cf8a39c424d4 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:37.209287 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-48ffa270-e949-4655-bb73-ac0d1354b703 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] [instance: 685d47e4-721e-4eae-b5f8-78fdb68454ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:37.209456 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-cbf8f26a-ce6e-4bc8-9c8d-cf8a39c424d4 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: db1ac026-e512-4e5f-839d-4056cec509b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:37.235129 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-48ffa270-e949-4655-bb73-ac0d1354b703 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:37.236730 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-48ffa270-e949-4655-bb73-ac0d1354b703 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:37.237311 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-48ffa270-e949-4655-bb73-ac0d1354b703 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:37.238645 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cbf8f26a-ce6e-4bc8-9c8d-cf8a39c424d4 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:37.239815 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-48ffa270-e949-4655-bb73-ac0d1354b703 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:37.241187 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-48ffa270-e949-4655-bb73-ac0d1354b703 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:37.242449 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cbf8f26a-ce6e-4bc8-9c8d-cf8a39c424d4 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:37.244080 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-48ffa270-e949-4655-bb73-ac0d1354b703 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:37.245344 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cbf8f26a-ce6e-4bc8-9c8d-cf8a39c424d4 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:37.251846 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cbf8f26a-ce6e-4bc8-9c8d-cf8a39c424d4 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:37.253210 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cbf8f26a-ce6e-4bc8-9c8d-cf8a39c424d4 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:37.262012 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cbf8f26a-ce6e-4bc8-9c8d-cf8a39c424d4 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:37.264403 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:06:38.303647 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-cbf8f26a-ce6e-4bc8-9c8d-cf8a39c424d4 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:38.331388 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-cbf8f26a-ce6e-4bc8-9c8d-cf8a39c424d4 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/db1ac026-e512-4e5f-839d-4056cec509b3" status: 200 len: 1315 microversion: 2.1 time: 1.128361 Aug 31 16:06:38.332634 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1287/2572] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:37 2022] GET /compute/v2.1/servers/db1ac026-e512-4e5f-839d-4056cec509b3 => generated 1315 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:38.349088 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8cb02be8-ed8b-4a44-8899-e4b821827cdd tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '.version_select at 0x7f5ae8623f70>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:38.426001 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-48ffa270-e949-4655-bb73-ac0d1354b703 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:38.487828 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-48ffa270-e949-4655-bb73-ac0d1354b703 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:38.505578 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-48ffa270-e949-4655-bb73-ac0d1354b703 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:38.508653 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-48ffa270-e949-4655-bb73-ac0d1354b703 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] 10.222.0.61 "GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae" status: 200 len: 1875 microversion: 2.42 time: 1.357761 Aug 31 16:06:38.510564 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8cb02be8-ed8b-4a44-8899-e4b821827cdd tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "GET /compute/v2.1/images/f8c63da2-efca-43a3-a8dd-7f0b9e1fcefc" status: 200 len: 1451 microversion: 2.1 time: 0.173355 Aug 31 16:06:38.512251 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1288/2573] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:06:38 2022] GET /compute/v2.1/images/f8c63da2-efca-43a3-a8dd-7f0b9e1fcefc => generated 1451 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:38.530915 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1286/2574] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:06:37 2022] GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae => generated 1875 bytes in 1387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:06:38.552997 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7e34c01c-78e5-4f22-87f2-8d1bd502680c tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:38.560961 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7e34c01c-78e5-4f22-87f2-8d1bd502680c tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 8555b294-db38-4246-ac58-035cb2acc70e] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:38.590998 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7e34c01c-78e5-4f22-87f2-8d1bd502680c tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:38.593873 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7e34c01c-78e5-4f22-87f2-8d1bd502680c tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:38.610728 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7e34c01c-78e5-4f22-87f2-8d1bd502680c tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:38.620917 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7e34c01c-78e5-4f22-87f2-8d1bd502680c tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:38.626632 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7e34c01c-78e5-4f22-87f2-8d1bd502680c tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:38.632310 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7e34c01c-78e5-4f22-87f2-8d1bd502680c tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:38.695537 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7e34c01c-78e5-4f22-87f2-8d1bd502680c tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 8555b294-db38-4246-ac58-035cb2acc70e] Going to try to terminate instance {{(pid=122256) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:06:38.889559 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:06:39.045442 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7e34c01c-78e5-4f22-87f2-8d1bd502680c tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "DELETE /compute/v2.1/servers/8555b294-db38-4246-ac58-035cb2acc70e" status: 204 len: 0 microversion: 2.25 time: 0.518203 Aug 31 16:06:39.050437 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1289/2575] 10.222.0.61 () {60 vars in 1280 bytes} [Wed Aug 31 16:06:38 2022] DELETE /compute/v2.1/servers/8555b294-db38-4246-ac58-035cb2acc70e => generated 0 bytes in 537 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 16:06:39.072920 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b7757c8c-6632-42ab-ad3c-89143ea38ad3 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:39.077390 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b7757c8c-6632-42ab-ad3c-89143ea38ad3 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 8f165110-0ea6-48c0-8357-ba419171f7af] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:39.094693 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b7757c8c-6632-42ab-ad3c-89143ea38ad3 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:39.095637 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b7757c8c-6632-42ab-ad3c-89143ea38ad3 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:39.096916 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b7757c8c-6632-42ab-ad3c-89143ea38ad3 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:39.100054 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b7757c8c-6632-42ab-ad3c-89143ea38ad3 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:39.101379 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b7757c8c-6632-42ab-ad3c-89143ea38ad3 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:39.101998 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b7757c8c-6632-42ab-ad3c-89143ea38ad3 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:39.146437 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-38c434fe-e941-44ec-b101-7167490601d5 req-8171658d-e13a-4bae-8dba-31c4e171799b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db1ac026-e512-4e5f-839d-4056cec509b3", "name": "network-vif-plugged", "status": "completed", "tag": "af630af3-517b-4dc1-b7cf-dda0aebb1a90"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:06:39.189787 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-38c434fe-e941-44ec-b101-7167490601d5 req-8171658d-e13a-4bae-8dba-31c4e171799b service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:39.190705 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-38c434fe-e941-44ec-b101-7167490601d5 req-8171658d-e13a-4bae-8dba-31c4e171799b service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:39.191554 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-38c434fe-e941-44ec-b101-7167490601d5 req-8171658d-e13a-4bae-8dba-31c4e171799b service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:39.248472 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-38c434fe-e941-44ec-b101-7167490601d5 req-8171658d-e13a-4bae-8dba-31c4e171799b service nova] Creating event network-vif-plugged:af630af3-517b-4dc1-b7cf-dda0aebb1a90 for instance db1ac026-e512-4e5f-839d-4056cec509b3 on n-h1-850499-9 Aug 31 16:06:39.261879 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-38c434fe-e941-44ec-b101-7167490601d5 req-8171658d-e13a-4bae-8dba-31c4e171799b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.729142 Aug 31 16:06:39.272874 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1287/2576] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:06:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:06:39.280094 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-66a24969-86db-4185-8e78-68e662022c2f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:39.281007 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-66a24969-86db-4185-8e78-68e662022c2f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 8555b294-db38-4246-ac58-035cb2acc70e] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:39.316357 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-66a24969-86db-4185-8e78-68e662022c2f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:39.319984 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-66a24969-86db-4185-8e78-68e662022c2f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:39.320801 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-66a24969-86db-4185-8e78-68e662022c2f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:39.326869 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-66a24969-86db-4185-8e78-68e662022c2f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:39.327970 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-66a24969-86db-4185-8e78-68e662022c2f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:39.332874 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-66a24969-86db-4185-8e78-68e662022c2f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:40.223911 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-66a24969-86db-4185-8e78-68e662022c2f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:40.249716 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-66a24969-86db-4185-8e78-68e662022c2f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:40.252119 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-66a24969-86db-4185-8e78-68e662022c2f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:40.254115 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-66a24969-86db-4185-8e78-68e662022c2f tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/8555b294-db38-4246-ac58-035cb2acc70e" status: 200 len: 1548 microversion: 2.25 time: 0.979579 Aug 31 16:06:40.259256 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1288/2577] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:06:39 2022] GET /compute/v2.1/servers/8555b294-db38-4246-ac58-035cb2acc70e => generated 1548 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:06:40.272528 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-622ad267-77c1-4e23-a743-7864c9ba3eda tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:40.277655 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-622ad267-77c1-4e23-a743-7864c9ba3eda tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: db1ac026-e512-4e5f-839d-4056cec509b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:40.290645 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-622ad267-77c1-4e23-a743-7864c9ba3eda tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:40.293770 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-622ad267-77c1-4e23-a743-7864c9ba3eda tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:40.294419 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-622ad267-77c1-4e23-a743-7864c9ba3eda tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:40.295329 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-622ad267-77c1-4e23-a743-7864c9ba3eda tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:40.299235 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-622ad267-77c1-4e23-a743-7864c9ba3eda tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:40.300033 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-622ad267-77c1-4e23-a743-7864c9ba3eda tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:41.098137 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b7757c8c-6632-42ab-ad3c-89143ea38ad3 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:41.119878 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b7757c8c-6632-42ab-ad3c-89143ea38ad3 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/8f165110-0ea6-48c0-8357-ba419171f7af" status: 200 len: 1312 microversion: 2.1 time: 2.065762 Aug 31 16:06:41.131653 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1290/2578] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:39 2022] GET /compute/v2.1/servers/8f165110-0ea6-48c0-8357-ba419171f7af => generated 1312 bytes in 2080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:41.137045 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-df0b1821-5e1e-4697-8184-10b555c8fcd3 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '.version_select at 0x7f5ae858fe50>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:41.220897 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-df0b1821-5e1e-4697-8184-10b555c8fcd3 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "GET /compute/v2.1/images/f8c63da2-efca-43a3-a8dd-7f0b9e1fcefc" status: 200 len: 1460 microversion: 2.1 time: 0.087846 Aug 31 16:06:41.221682 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1291/2579] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:06:41 2022] GET /compute/v2.1/images/f8c63da2-efca-43a3-a8dd-7f0b9e1fcefc => generated 1460 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:41.235866 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-99ef3583-cb4a-45c8-9c2a-a315fa4a32ea tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:41.236801 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-99ef3583-cb4a-45c8-9c2a-a315fa4a32ea tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] [instance: 685d47e4-721e-4eae-b5f8-78fdb68454ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:41.245324 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-99ef3583-cb4a-45c8-9c2a-a315fa4a32ea tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:41.245942 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-99ef3583-cb4a-45c8-9c2a-a315fa4a32ea tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:41.246396 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-99ef3583-cb4a-45c8-9c2a-a315fa4a32ea tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:41.247169 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-99ef3583-cb4a-45c8-9c2a-a315fa4a32ea tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:41.252035 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-99ef3583-cb4a-45c8-9c2a-a315fa4a32ea tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:41.254005 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-99ef3583-cb4a-45c8-9c2a-a315fa4a32ea tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:41.442411 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-622ad267-77c1-4e23-a743-7864c9ba3eda tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:41.455265 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-622ad267-77c1-4e23-a743-7864c9ba3eda tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/db1ac026-e512-4e5f-839d-4056cec509b3" status: 200 len: 1315 microversion: 2.1 time: 1.194550 Aug 31 16:06:41.456274 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1289/2580] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:40 2022] GET /compute/v2.1/servers/db1ac026-e512-4e5f-839d-4056cec509b3 => generated 1315 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:41.460837 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f506b7a1-28ae-4fc6-8e18-fdd48a1b5c79 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '.version_select at 0x7f5ae8419160>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:41.535094 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f506b7a1-28ae-4fc6-8e18-fdd48a1b5c79 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "GET /compute/v2.1/images/f8c63da2-efca-43a3-a8dd-7f0b9e1fcefc" status: 200 len: 1460 microversion: 2.1 time: 0.077529 Aug 31 16:06:41.548374 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1290/2581] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:06:41 2022] GET /compute/v2.1/images/f8c63da2-efca-43a3-a8dd-7f0b9e1fcefc => generated 1460 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:41.559640 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7b1ab008-f742-45f0-be3c-6e08e2663cf5 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:41.560573 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7b1ab008-f742-45f0-be3c-6e08e2663cf5 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 8555b294-db38-4246-ac58-035cb2acc70e] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:41.568250 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7b1ab008-f742-45f0-be3c-6e08e2663cf5 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:41.568917 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7b1ab008-f742-45f0-be3c-6e08e2663cf5 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:41.569671 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7b1ab008-f742-45f0-be3c-6e08e2663cf5 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:41.570422 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7b1ab008-f742-45f0-be3c-6e08e2663cf5 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:41.572435 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7b1ab008-f742-45f0-be3c-6e08e2663cf5 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:41.572435 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7b1ab008-f742-45f0-be3c-6e08e2663cf5 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:42.215595 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-99ef3583-cb4a-45c8-9c2a-a315fa4a32ea tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:42.226635 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-99ef3583-cb4a-45c8-9c2a-a315fa4a32ea tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:42.228864 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-99ef3583-cb4a-45c8-9c2a-a315fa4a32ea tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:42.229434 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-99ef3583-cb4a-45c8-9c2a-a315fa4a32ea tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] 10.222.0.61 "GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae" status: 200 len: 1875 microversion: 2.42 time: 1.005728 Aug 31 16:06:42.230000 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1292/2582] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:06:41 2022] GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae => generated 1875 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:06:42.236086 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-96fc62d4-8d71-48c3-8b57-01aa156344c6 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:42.237085 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-96fc62d4-8d71-48c3-8b57-01aa156344c6 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] [instance: 359f06bd-00e9-4d68-b066-db73d7073a04] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:42.247675 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-96fc62d4-8d71-48c3-8b57-01aa156344c6 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:42.248532 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-96fc62d4-8d71-48c3-8b57-01aa156344c6 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:42.249276 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-96fc62d4-8d71-48c3-8b57-01aa156344c6 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:42.250796 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-96fc62d4-8d71-48c3-8b57-01aa156344c6 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:42.251963 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-96fc62d4-8d71-48c3-8b57-01aa156344c6 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:42.252736 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-96fc62d4-8d71-48c3-8b57-01aa156344c6 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:42.367767 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7b1ab008-f742-45f0-be3c-6e08e2663cf5 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:42.386177 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7b1ab008-f742-45f0-be3c-6e08e2663cf5 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:42.389695 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7b1ab008-f742-45f0-be3c-6e08e2663cf5 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:42.392039 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7b1ab008-f742-45f0-be3c-6e08e2663cf5 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/8555b294-db38-4246-ac58-035cb2acc70e" status: 200 len: 1548 microversion: 2.25 time: 0.840452 Aug 31 16:06:42.393185 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1291/2583] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:06:41 2022] GET /compute/v2.1/servers/8555b294-db38-4246-ac58-035cb2acc70e => generated 1548 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:06:42.586401 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7835d185-de2c-48d8-a7e5-bf4614ede284 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-226009900", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:06:42.670170 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-7835d185-de2c-48d8-a7e5-bf4614ede284 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] validate_networks() for None {{(pid=122257) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:06:42.845399 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-96fc62d4-8d71-48c3-8b57-01aa156344c6 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f0b27a48fd41dd846ba60856349ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4efd94380dcf4b3cb7a2b9fa194fcb83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:42.866221 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-96fc62d4-8d71-48c3-8b57-01aa156344c6 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "GET /compute/v2.1/servers/359f06bd-00e9-4d68-b066-db73d7073a04" status: 200 len: 1466 microversion: 2.1 time: 0.634948 Aug 31 16:06:42.866841 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1293/2584] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:42 2022] GET /compute/v2.1/servers/359f06bd-00e9-4d68-b066-db73d7073a04 => generated 1466 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:42.879005 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7a508d37-4e92-4a94-9b66-1339340aa888 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:42.880539 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7a508d37-4e92-4a94-9b66-1339340aa888 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 8f165110-0ea6-48c0-8357-ba419171f7af] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:42.899784 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7a508d37-4e92-4a94-9b66-1339340aa888 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:42.901326 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7a508d37-4e92-4a94-9b66-1339340aa888 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:42.947292 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7a508d37-4e92-4a94-9b66-1339340aa888 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.041s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:42.956190 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7a508d37-4e92-4a94-9b66-1339340aa888 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:42.957402 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7a508d37-4e92-4a94-9b66-1339340aa888 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:42.961072 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7a508d37-4e92-4a94-9b66-1339340aa888 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:43.724678 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-7835d185-de2c-48d8-a7e5-bf4614ede284 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:06:43.725458 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-7835d185-de2c-48d8-a7e5-bf4614ede284 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:06:43.726401 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-7835d185-de2c-48d8-a7e5-bf4614ede284 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:06:43.727142 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-7835d185-de2c-48d8-a7e5-bf4614ede284 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:06:43.729367 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-7835d185-de2c-48d8-a7e5-bf4614ede284 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:06:43.755770 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7835d185-de2c-48d8-a7e5-bf4614ede284 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:43.756680 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7835d185-de2c-48d8-a7e5-bf4614ede284 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:43.757907 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7835d185-de2c-48d8-a7e5-bf4614ede284 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:43.760221 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7835d185-de2c-48d8-a7e5-bf4614ede284 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:43.761556 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7835d185-de2c-48d8-a7e5-bf4614ede284 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:43.762901 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7835d185-de2c-48d8-a7e5-bf4614ede284 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:43.809798 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-7835d185-de2c-48d8-a7e5-bf4614ede284 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Getting quotas for project f79872256b2647d6a01c9e753b93b3c2. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:06:43.822490 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-7835d185-de2c-48d8-a7e5-bf4614ede284 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Getting quotas for user 4bb6a27e336449738f68a88d870ca6e2 and project f79872256b2647d6a01c9e753b93b3c2. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:06:43.829279 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7a508d37-4e92-4a94-9b66-1339340aa888 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:43.851385 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7a508d37-4e92-4a94-9b66-1339340aa888 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/8f165110-0ea6-48c0-8357-ba419171f7af" status: 200 len: 1312 microversion: 2.1 time: 0.980680 Aug 31 16:06:43.853281 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1294/2585] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:42 2022] GET /compute/v2.1/servers/8f165110-0ea6-48c0-8357-ba419171f7af => generated 1312 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:43.862726 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4d5e36d7-a23b-4956-b774-b6cedbaa5116 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:43.863968 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4d5e36d7-a23b-4956-b774-b6cedbaa5116 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: db1ac026-e512-4e5f-839d-4056cec509b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:43.871337 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4d5e36d7-a23b-4956-b774-b6cedbaa5116 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:43.872366 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4d5e36d7-a23b-4956-b774-b6cedbaa5116 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:43.873109 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4d5e36d7-a23b-4956-b774-b6cedbaa5116 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:43.874116 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4d5e36d7-a23b-4956-b774-b6cedbaa5116 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:43.874789 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4d5e36d7-a23b-4956-b774-b6cedbaa5116 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:43.875454 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4d5e36d7-a23b-4956-b774-b6cedbaa5116 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:43.905670 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7835d185-de2c-48d8-a7e5-bf4614ede284 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Going to run 1 instances... {{(pid=122257) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:06:43.910191 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7835d185-de2c-48d8-a7e5-bf4614ede284 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] [instance: 5709d363-0934-4d14-a734-35a54bdc03d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:06:44.053995 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7835d185-de2c-48d8-a7e5-bf4614ede284 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.659070 Aug 31 16:06:44.059951 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1292/2586] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:06:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1666 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:06:44.071105 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-3daff360-8ed0-4de3-85dd-461f5d6db400 req-1298caac-9868-490c-ba22-9d2c66fe759d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8555b294-db38-4246-ac58-035cb2acc70e", "name": "network-vif-deleted", "tag": "a4e66017-bbca-4435-8809-d986a9a6cbd2"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:06:44.089299 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-3daff360-8ed0-4de3-85dd-461f5d6db400 req-1298caac-9868-490c-ba22-9d2c66fe759d service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:44.089299 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-3daff360-8ed0-4de3-85dd-461f5d6db400 req-1298caac-9868-490c-ba22-9d2c66fe759d service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:44.089776 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-3daff360-8ed0-4de3-85dd-461f5d6db400 req-1298caac-9868-490c-ba22-9d2c66fe759d service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:44.102824 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-3daff360-8ed0-4de3-85dd-461f5d6db400 req-1298caac-9868-490c-ba22-9d2c66fe759d service nova] Creating event network-vif-deleted:a4e66017-bbca-4435-8809-d986a9a6cbd2 for instance 8555b294-db38-4246-ac58-035cb2acc70e on n-h1-850499-9 Aug 31 16:06:44.111558 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-3daff360-8ed0-4de3-85dd-461f5d6db400 req-1298caac-9868-490c-ba22-9d2c66fe759d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050005 Aug 31 16:06:44.116099 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1293/2587] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:06:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:06:44.122810 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c6b0581e-94af-4cde-b395-48c308c2bdae tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-330313220"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:06:44.125429 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c6b0581e-94af-4cde-b395-48c308c2bdae tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] [instance: 560a01e5-93f8-46c8-9261-5030e28766b4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:44.151301 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c6b0581e-94af-4cde-b395-48c308c2bdae tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:44.152767 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c6b0581e-94af-4cde-b395-48c308c2bdae tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:44.152767 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c6b0581e-94af-4cde-b395-48c308c2bdae tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:44.153128 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c6b0581e-94af-4cde-b395-48c308c2bdae tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:44.153269 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c6b0581e-94af-4cde-b395-48c308c2bdae tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:44.153673 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c6b0581e-94af-4cde-b395-48c308c2bdae tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:44.352635 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-4d5e36d7-a23b-4956-b774-b6cedbaa5116 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:44.365258 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4d5e36d7-a23b-4956-b774-b6cedbaa5116 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/db1ac026-e512-4e5f-839d-4056cec509b3" status: 200 len: 1501 microversion: 2.1 time: 0.509664 Aug 31 16:06:44.371067 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1295/2588] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:43 2022] GET /compute/v2.1/servers/db1ac026-e512-4e5f-839d-4056cec509b3 => generated 1501 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:44.387710 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-92aaa330-a1db-4766-9f76-5cd087beefd7 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:44.388898 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-92aaa330-a1db-4766-9f76-5cd087beefd7 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] [instance: 685d47e4-721e-4eae-b5f8-78fdb68454ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:44.423253 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-92aaa330-a1db-4766-9f76-5cd087beefd7 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:44.424190 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-92aaa330-a1db-4766-9f76-5cd087beefd7 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:44.425000 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-92aaa330-a1db-4766-9f76-5cd087beefd7 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:44.426266 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-92aaa330-a1db-4766-9f76-5cd087beefd7 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:44.427114 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-92aaa330-a1db-4766-9f76-5cd087beefd7 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:44.427937 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-92aaa330-a1db-4766-9f76-5cd087beefd7 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:44.845507 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c6b0581e-94af-4cde-b395-48c308c2bdae tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "POST /compute/v2.1/servers/560a01e5-93f8-46c8-9261-5030e28766b4/action" status: 202 len: 0 microversion: 2.1 time: 0.725752 Aug 31 16:06:44.851452 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1294/2589] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:06:44 2022] POST /compute/v2.1/servers/560a01e5-93f8-46c8-9261-5030e28766b4/action => generated 0 bytes in 733 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 31 16:06:44.886207 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-5c2855ea-178d-4b77-82a7-3f4c3038f9ad req-0c1c6ad3-7a6b-430b-aa5c-2f49d18a8809 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "359f06bd-00e9-4d68-b066-db73d7073a04", "name": "network-vif-unplugged", "status": "completed", "tag": "0cd3b24d-ce36-4d42-806b-496fd2089b1b"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:06:44.910468 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-5c2855ea-178d-4b77-82a7-3f4c3038f9ad req-0c1c6ad3-7a6b-430b-aa5c-2f49d18a8809 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:44.911430 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-5c2855ea-178d-4b77-82a7-3f4c3038f9ad req-0c1c6ad3-7a6b-430b-aa5c-2f49d18a8809 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:44.918657 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-92aaa330-a1db-4766-9f76-5cd087beefd7 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:44.922087 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-5c2855ea-178d-4b77-82a7-3f4c3038f9ad req-0c1c6ad3-7a6b-430b-aa5c-2f49d18a8809 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:44.946134 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-5c2855ea-178d-4b77-82a7-3f4c3038f9ad req-0c1c6ad3-7a6b-430b-aa5c-2f49d18a8809 service nova] Creating event network-vif-unplugged:0cd3b24d-ce36-4d42-806b-496fd2089b1b for instance 359f06bd-00e9-4d68-b066-db73d7073a04 on n-h1-850499-9 Aug 31 16:06:44.951953 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-92aaa330-a1db-4766-9f76-5cd087beefd7 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:44.956564 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-5c2855ea-178d-4b77-82a7-3f4c3038f9ad req-0c1c6ad3-7a6b-430b-aa5c-2f49d18a8809 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.101095 Aug 31 16:06:44.957420 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1295/2590] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:06:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:06:44.960149 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-92aaa330-a1db-4766-9f76-5cd087beefd7 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:44.963377 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-865af93a-f3dd-4b89-9f2e-09a5a2742522 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:44.964999 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-865af93a-f3dd-4b89-9f2e-09a5a2742522 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 8555b294-db38-4246-ac58-035cb2acc70e] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:44.972569 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-92aaa330-a1db-4766-9f76-5cd087beefd7 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] 10.222.0.61 "GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae" status: 200 len: 1875 microversion: 2.42 time: 0.594263 Aug 31 16:06:44.975016 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-865af93a-f3dd-4b89-9f2e-09a5a2742522 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:44.975816 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-865af93a-f3dd-4b89-9f2e-09a5a2742522 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:44.976270 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1296/2591] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:06:44 2022] GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae => generated 1875 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:06:44.976917 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-865af93a-f3dd-4b89-9f2e-09a5a2742522 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:44.977941 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-865af93a-f3dd-4b89-9f2e-09a5a2742522 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:44.978501 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-865af93a-f3dd-4b89-9f2e-09a5a2742522 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:44.979012 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-865af93a-f3dd-4b89-9f2e-09a5a2742522 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:44.986195 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-927f386e-fcbb-4b92-a442-4bdd8107d6fe tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:44.987655 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-927f386e-fcbb-4b92-a442-4bdd8107d6fe tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] [instance: 5709d363-0934-4d14-a734-35a54bdc03d0] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:45.011073 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-865af93a-f3dd-4b89-9f2e-09a5a2742522 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] HTTP exception thrown: Instance 8555b294-db38-4246-ac58-035cb2acc70e could not be found. Aug 31 16:06:45.011073 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-865af93a-f3dd-4b89-9f2e-09a5a2742522 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Request method failure captured: Aug 31 16:06:45.011073 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/8555b294-db38-4246-ac58-035cb2acc70e HTTP/1.1 Aug 31 16:06:45.011073 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:06:45.011073 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:06:45.011073 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:06:45.011073 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:06:45.011073 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:06:45.011073 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:06:45.011073 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:06:45.011073 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:06:45.011073 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4Sz-nEtBIir4h6pKigKL9l8DQ-FgYlbEQSEmOoXkJYtraxr-5lRgxCapV6PXVJ4YbN1zbOPnHuzBENR6jTq9c9nKu5JErZVbYmzTyVmurBnViPBcsdVuA7zckwipUv_K3iEGy1xSXMXAMx1-1GWp5CVSbFfBIPYyZm0WGFyBwt-m9A Aug 31 16:06:45.011073 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:06:45.011073 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:06:45.011073 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:06:45.011073 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:06:45.011073 n-d-850499-9 devstack@n-api.service[122257]: X-Openstack-Nova-Api-Version: 2.25 Aug 31 16:06:45.011073 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:06:45.011073 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:06:45.011073 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 01a9266ba9b14c6a8b6e79aecfe86df6 Aug 31 16:06:45.011073 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-850802922 Aug 31 16:06:45.011073 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:06:45.011073 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:06:45.011073 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/01a9266ba9b14c6a8b6e79aecfe86df6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/01a9266ba9b14c6a8b6e79aecfe86df6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_01a9266ba9b14c6a8b6e79aecfe86df6", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/01a9266ba9b14c6a8b6e79aecfe86df6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:06:45.011073 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-850802922 Aug 31 16:06:45.011073 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 01a9266ba9b14c6a8b6e79aecfe86df6 Aug 31 16:06:45.011073 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-850802922 Aug 31 16:06:45.011073 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-LiveAutoBlockMigrationV225Test-850802922-project Aug 31 16:06:45.011073 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:06:45.011073 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:06:45.011073 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: bb8e30aa23194f898b07dfbc6fd8d5de Aug 31 16:06:45.011073 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-850802922-project Aug 31 16:06:45.011073 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:06:45.011073 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance 8555b294-db38-4246-ac58-035cb2acc70e could not be found. Aug 31 16:06:45.011073 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '8555b294-db38-4246-ac58-035cb2acc70e'} Aug 31 16:06:45.011073 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:06:45.011073 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:06:45.011073 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:06:45.011073 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:06:45.011073 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:06:45.011073 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:06:45.011073 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:06:45.011073 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:06:45.011073 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:06:45.011073 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:06:45.011073 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8555b294-db38-4246-ac58-035cb2acc70e could not be found. Aug 31 16:06:45.011073 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:06:45.011073 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:06:45.011073 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:06:45.011073 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:06:45.011073 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:06:45.011073 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:06:45.011073 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:06:45.011073 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:06:45.011073 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:06:45.011073 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:06:45.011073 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:06:45.011073 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:06:45.011073 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:06:45.011073 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:06:45.011073 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:06:45.022500 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:06:45.022500 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8555b294-db38-4246-ac58-035cb2acc70e could not be found. Aug 31 16:06:45.022500 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:06:45.022500 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:06:45.022500 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:06:45.022500 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:06:45.022500 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:06:45.022500 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:06:45.022500 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:06:45.022500 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:06:45.022500 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8555b294-db38-4246-ac58-035cb2acc70e could not be found. Aug 31 16:06:45.022500 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:06:45.022500 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-865af93a-f3dd-4b89-9f2e-09a5a2742522 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Returning 404 to user: Instance 8555b294-db38-4246-ac58-035cb2acc70e could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:06:45.022500 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-865af93a-f3dd-4b89-9f2e-09a5a2742522 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/8555b294-db38-4246-ac58-035cb2acc70e" status: 404 len: 111 microversion: 2.25 time: 0.060521 Aug 31 16:06:45.033138 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1296/2592] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:06:44 2022] GET /compute/v2.1/servers/8555b294-db38-4246-ac58-035cb2acc70e => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:06:45.045079 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8e2c8b70-2423-42ba-ba1d-9d8d9d3f86ea tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:06:45.046216 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8e2c8b70-2423-42ba-ba1d-9d8d9d3f86ea tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: db1ac026-e512-4e5f-839d-4056cec509b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:45.070138 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8e2c8b70-2423-42ba-ba1d-9d8d9d3f86ea tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:45.074372 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8e2c8b70-2423-42ba-ba1d-9d8d9d3f86ea tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:45.075280 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8e2c8b70-2423-42ba-ba1d-9d8d9d3f86ea tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:45.076417 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8e2c8b70-2423-42ba-ba1d-9d8d9d3f86ea tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:45.077486 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8e2c8b70-2423-42ba-ba1d-9d8d9d3f86ea tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:45.078554 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8e2c8b70-2423-42ba-ba1d-9d8d9d3f86ea tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:45.155158 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-8e2c8b70-2423-42ba-ba1d-9d8d9d3f86ea tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lazy-loading 'flavor' on Instance uuid db1ac026-e512-4e5f-839d-4056cec509b3 {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:06:45.239951 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-927f386e-fcbb-4b92-a442-4bdd8107d6fe tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb6a27e336449738f68a88d870ca6e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f79872256b2647d6a01c9e753b93b3c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:45.262027 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-927f386e-fcbb-4b92-a442-4bdd8107d6fe tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] 10.222.0.61 "GET /compute/v2.1/servers/5709d363-0934-4d14-a734-35a54bdc03d0" status: 200 len: 1218 microversion: 2.1 time: 0.283458 Aug 31 16:06:45.263387 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1297/2593] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:44 2022] GET /compute/v2.1/servers/5709d363-0934-4d14-a734-35a54bdc03d0 => generated 1218 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:45.268623 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c67e553e-6430-4605-a65e-4a37c467aa6b tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '.version_select at 0x7f5ae85a3ee0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:45.364829 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c67e553e-6430-4605-a65e-4a37c467aa6b tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "GET /compute/v2.1/images/03df45dd-ab3d-44b8-97f9-0f9148109666" status: 200 len: 1452 microversion: 2.1 time: 0.099801 Aug 31 16:06:45.378101 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1298/2594] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:06:45 2022] GET /compute/v2.1/images/03df45dd-ab3d-44b8-97f9-0f9148109666 => generated 1452 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:45.390304 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-90cb1aa1-b9b9-4338-897f-bc358a5736c9 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:45.391052 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-90cb1aa1-b9b9-4338-897f-bc358a5736c9 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 8f165110-0ea6-48c0-8357-ba419171f7af] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:45.397713 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-90cb1aa1-b9b9-4338-897f-bc358a5736c9 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:45.398302 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-90cb1aa1-b9b9-4338-897f-bc358a5736c9 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:45.398827 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-90cb1aa1-b9b9-4338-897f-bc358a5736c9 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:45.399645 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-90cb1aa1-b9b9-4338-897f-bc358a5736c9 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:45.400179 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-90cb1aa1-b9b9-4338-897f-bc358a5736c9 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:45.400680 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-90cb1aa1-b9b9-4338-897f-bc358a5736c9 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:45.458718 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8e2c8b70-2423-42ba-ba1d-9d8d9d3f86ea tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "POST /compute/v2.1/servers/db1ac026-e512-4e5f-839d-4056cec509b3/action" status: 202 len: 0 microversion: 2.1 time: 0.423449 Aug 31 16:06:45.462795 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1297/2595] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:06:45 2022] POST /compute/v2.1/servers/db1ac026-e512-4e5f-839d-4056cec509b3/action => generated 0 bytes in 428 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:06:45.468477 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-35fa06f7-8f42-488f-a88d-7bea59e867dc tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:45.469234 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-35fa06f7-8f42-488f-a88d-7bea59e867dc tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 79ee7e24-93df-450b-9030-b08c00d019eb] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:45.477447 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-35fa06f7-8f42-488f-a88d-7bea59e867dc tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:45.478250 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-35fa06f7-8f42-488f-a88d-7bea59e867dc tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:45.479025 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-35fa06f7-8f42-488f-a88d-7bea59e867dc tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:45.480862 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-35fa06f7-8f42-488f-a88d-7bea59e867dc tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:45.481662 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-35fa06f7-8f42-488f-a88d-7bea59e867dc tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:45.482438 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-35fa06f7-8f42-488f-a88d-7bea59e867dc tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:45.524714 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-35fa06f7-8f42-488f-a88d-7bea59e867dc tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 79ee7e24-93df-450b-9030-b08c00d019eb] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:06:45.571312 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-90cb1aa1-b9b9-4338-897f-bc358a5736c9 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:45.581175 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-90cb1aa1-b9b9-4338-897f-bc358a5736c9 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/8f165110-0ea6-48c0-8357-ba419171f7af" status: 200 len: 1312 microversion: 2.1 time: 0.201717 Aug 31 16:06:45.582002 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1299/2596] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:45 2022] GET /compute/v2.1/servers/8f165110-0ea6-48c0-8357-ba419171f7af => generated 1312 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:45.596644 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-599d7776-d9f6-41e8-b127-487d93b14875 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:45.598253 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-599d7776-d9f6-41e8-b127-487d93b14875 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: db1ac026-e512-4e5f-839d-4056cec509b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:45.612451 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-599d7776-d9f6-41e8-b127-487d93b14875 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:45.613363 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-599d7776-d9f6-41e8-b127-487d93b14875 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:45.614114 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-599d7776-d9f6-41e8-b127-487d93b14875 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:45.615161 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-599d7776-d9f6-41e8-b127-487d93b14875 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:45.615905 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-599d7776-d9f6-41e8-b127-487d93b14875 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:45.616649 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-599d7776-d9f6-41e8-b127-487d93b14875 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:45.644723 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:06:45.656816 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-35fa06f7-8f42-488f-a88d-7bea59e867dc tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "DELETE /compute/v2.1/servers/79ee7e24-93df-450b-9030-b08c00d019eb" status: 204 len: 0 microversion: 2.25 time: 0.193761 Aug 31 16:06:45.658251 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1298/2597] 10.222.0.61 () {60 vars in 1280 bytes} [Wed Aug 31 16:06:45 2022] DELETE /compute/v2.1/servers/79ee7e24-93df-450b-9030-b08c00d019eb => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 16:06:45.669090 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b648757f-e445-4fcb-92c6-2d441955d071 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:45.670060 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b648757f-e445-4fcb-92c6-2d441955d071 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 79ee7e24-93df-450b-9030-b08c00d019eb] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:45.681294 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b648757f-e445-4fcb-92c6-2d441955d071 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:45.682105 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b648757f-e445-4fcb-92c6-2d441955d071 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:45.682947 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b648757f-e445-4fcb-92c6-2d441955d071 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:45.684184 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b648757f-e445-4fcb-92c6-2d441955d071 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:45.684824 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b648757f-e445-4fcb-92c6-2d441955d071 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:45.685376 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b648757f-e445-4fcb-92c6-2d441955d071 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:45.888868 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-599d7776-d9f6-41e8-b127-487d93b14875 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:45.906356 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-599d7776-d9f6-41e8-b127-487d93b14875 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/db1ac026-e512-4e5f-839d-4056cec509b3" status: 200 len: 1507 microversion: 2.1 time: 0.321005 Aug 31 16:06:45.907985 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1300/2598] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:45 2022] GET /compute/v2.1/servers/db1ac026-e512-4e5f-839d-4056cec509b3 => generated 1507 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:46.032815 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b648757f-e445-4fcb-92c6-2d441955d071 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:46.037783 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f59b4f26-5850-4a9d-99c0-8d0ecba79377 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:46.039714 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f59b4f26-5850-4a9d-99c0-8d0ecba79377 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] [instance: 685d47e4-721e-4eae-b5f8-78fdb68454ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:46.052290 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f59b4f26-5850-4a9d-99c0-8d0ecba79377 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:46.053552 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f59b4f26-5850-4a9d-99c0-8d0ecba79377 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:46.054562 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f59b4f26-5850-4a9d-99c0-8d0ecba79377 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:46.054941 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b648757f-e445-4fcb-92c6-2d441955d071 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:46.056798 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f59b4f26-5850-4a9d-99c0-8d0ecba79377 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:46.058262 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b648757f-e445-4fcb-92c6-2d441955d071 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:46.059161 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f59b4f26-5850-4a9d-99c0-8d0ecba79377 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:46.060510 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f59b4f26-5850-4a9d-99c0-8d0ecba79377 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:46.080493 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b648757f-e445-4fcb-92c6-2d441955d071 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/79ee7e24-93df-450b-9030-b08c00d019eb" status: 200 len: 1563 microversion: 2.25 time: 0.417526 Aug 31 16:06:46.081188 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1299/2599] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:06:45 2022] GET /compute/v2.1/servers/79ee7e24-93df-450b-9030-b08c00d019eb => generated 1563 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:06:46.235236 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-605dab42-d960-497b-87dc-cac3d160f83e req-d38d734b-36e1-4eb3-a0ca-ac53d1f38aa5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f165110-0ea6-48c0-8357-ba419171f7af", "tag": "900ed2dd-d7d4-47d6-b6c7-2d39286cc7dc"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:06:46.289673 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-605dab42-d960-497b-87dc-cac3d160f83e req-d38d734b-36e1-4eb3-a0ca-ac53d1f38aa5 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:46.295781 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-605dab42-d960-497b-87dc-cac3d160f83e req-d38d734b-36e1-4eb3-a0ca-ac53d1f38aa5 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:46.296451 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-605dab42-d960-497b-87dc-cac3d160f83e req-d38d734b-36e1-4eb3-a0ca-ac53d1f38aa5 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:46.342641 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-605dab42-d960-497b-87dc-cac3d160f83e req-d38d734b-36e1-4eb3-a0ca-ac53d1f38aa5 service nova] Creating event network-changed:900ed2dd-d7d4-47d6-b6c7-2d39286cc7dc for instance 8f165110-0ea6-48c0-8357-ba419171f7af on n-h1-850499-9 Aug 31 16:06:46.351966 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-605dab42-d960-497b-87dc-cac3d160f83e req-d38d734b-36e1-4eb3-a0ca-ac53d1f38aa5 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122460 Aug 31 16:06:46.356215 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1300/2600] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:06:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:06:46.396447 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-259e9ea8-62a5-4b8a-88cc-6c972edd4caa tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:46.397724 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-259e9ea8-62a5-4b8a-88cc-6c972edd4caa tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] [instance: 5709d363-0934-4d14-a734-35a54bdc03d0] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:46.433732 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-259e9ea8-62a5-4b8a-88cc-6c972edd4caa tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:46.434234 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-259e9ea8-62a5-4b8a-88cc-6c972edd4caa tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:46.434702 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-259e9ea8-62a5-4b8a-88cc-6c972edd4caa tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:46.435386 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-259e9ea8-62a5-4b8a-88cc-6c972edd4caa tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:46.435880 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-259e9ea8-62a5-4b8a-88cc-6c972edd4caa tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:46.436307 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-259e9ea8-62a5-4b8a-88cc-6c972edd4caa tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:46.569944 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-259e9ea8-62a5-4b8a-88cc-6c972edd4caa tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb6a27e336449738f68a88d870ca6e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f79872256b2647d6a01c9e753b93b3c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:46.586463 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-259e9ea8-62a5-4b8a-88cc-6c972edd4caa tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] 10.222.0.61 "GET /compute/v2.1/servers/5709d363-0934-4d14-a734-35a54bdc03d0" status: 200 len: 1214 microversion: 2.1 time: 0.227735 Aug 31 16:06:46.607335 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1301/2601] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:46 2022] GET /compute/v2.1/servers/5709d363-0934-4d14-a734-35a54bdc03d0 => generated 1214 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:46.620566 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-34bfb037-4768-4cb4-a727-03ad8706c77e tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '.version_select at 0x7f5ae84d7ca0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:46.646814 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f59b4f26-5850-4a9d-99c0-8d0ecba79377 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:46.665095 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f59b4f26-5850-4a9d-99c0-8d0ecba79377 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:46.668720 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f59b4f26-5850-4a9d-99c0-8d0ecba79377 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:46.669970 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f59b4f26-5850-4a9d-99c0-8d0ecba79377 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] 10.222.0.61 "GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae" status: 200 len: 1875 microversion: 2.42 time: 0.644142 Aug 31 16:06:46.670549 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1301/2602] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:06:46 2022] GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae => generated 1875 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:06:46.690201 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c0ce645e-5fdb-4965-b0a6-8d96c0e80798 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:46.691759 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c0ce645e-5fdb-4965-b0a6-8d96c0e80798 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 8f165110-0ea6-48c0-8357-ba419171f7af] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:46.697500 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:06:46.724536 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c0ce645e-5fdb-4965-b0a6-8d96c0e80798 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:46.725671 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c0ce645e-5fdb-4965-b0a6-8d96c0e80798 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:46.726317 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c0ce645e-5fdb-4965-b0a6-8d96c0e80798 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:46.727292 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c0ce645e-5fdb-4965-b0a6-8d96c0e80798 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:46.728038 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c0ce645e-5fdb-4965-b0a6-8d96c0e80798 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:46.728700 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c0ce645e-5fdb-4965-b0a6-8d96c0e80798 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:46.777670 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-34bfb037-4768-4cb4-a727-03ad8706c77e tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "GET /compute/v2.1/images/03df45dd-ab3d-44b8-97f9-0f9148109666" status: 200 len: 1452 microversion: 2.1 time: 0.169053 Aug 31 16:06:46.782290 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1302/2603] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:06:46 2022] GET /compute/v2.1/images/03df45dd-ab3d-44b8-97f9-0f9148109666 => generated 1452 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:46.932070 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1898bbc7-5542-4129-bf59-fb9c14ee58ce tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:46.933785 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1898bbc7-5542-4129-bf59-fb9c14ee58ce tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: db1ac026-e512-4e5f-839d-4056cec509b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:46.947851 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1898bbc7-5542-4129-bf59-fb9c14ee58ce tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:46.948403 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1898bbc7-5542-4129-bf59-fb9c14ee58ce tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:46.951808 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1898bbc7-5542-4129-bf59-fb9c14ee58ce tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:46.952588 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1898bbc7-5542-4129-bf59-fb9c14ee58ce tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:46.953073 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1898bbc7-5542-4129-bf59-fb9c14ee58ce tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:46.953512 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1898bbc7-5542-4129-bf59-fb9c14ee58ce tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:47.766113 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-1898bbc7-5542-4129-bf59-fb9c14ee58ce tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:47.783971 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:06:47.789509 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1898bbc7-5542-4129-bf59-fb9c14ee58ce tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/db1ac026-e512-4e5f-839d-4056cec509b3" status: 200 len: 1507 microversion: 2.1 time: 0.861705 Aug 31 16:06:47.793584 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1303/2604] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:46 2022] GET /compute/v2.1/servers/db1ac026-e512-4e5f-839d-4056cec509b3 => generated 1507 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:06:47.802864 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c19b2f14-8c17-4028-ba44-b94e42eb3bcd tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:47.804076 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c19b2f14-8c17-4028-ba44-b94e42eb3bcd tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 79ee7e24-93df-450b-9030-b08c00d019eb] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:47.815151 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c19b2f14-8c17-4028-ba44-b94e42eb3bcd tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:47.816302 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c19b2f14-8c17-4028-ba44-b94e42eb3bcd tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:47.817188 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c19b2f14-8c17-4028-ba44-b94e42eb3bcd tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:47.818624 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c19b2f14-8c17-4028-ba44-b94e42eb3bcd tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:47.819311 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c19b2f14-8c17-4028-ba44-b94e42eb3bcd tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:47.820147 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c19b2f14-8c17-4028-ba44-b94e42eb3bcd tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:47.988858 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c0ce645e-5fdb-4965-b0a6-8d96c0e80798 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:48.006684 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c0ce645e-5fdb-4965-b0a6-8d96c0e80798 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/8f165110-0ea6-48c0-8357-ba419171f7af" status: 200 len: 1312 microversion: 2.1 time: 1.327121 Aug 31 16:06:48.009691 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1302/2605] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:46 2022] GET /compute/v2.1/servers/8f165110-0ea6-48c0-8357-ba419171f7af => generated 1312 bytes in 1331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:48.022718 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-28d60f17-fccc-49de-b799-fe773ba10c8f tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:48.023846 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-28d60f17-fccc-49de-b799-fe773ba10c8f tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] [instance: 5709d363-0934-4d14-a734-35a54bdc03d0] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:48.037902 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-28d60f17-fccc-49de-b799-fe773ba10c8f tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:48.039274 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-28d60f17-fccc-49de-b799-fe773ba10c8f tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:48.045800 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-28d60f17-fccc-49de-b799-fe773ba10c8f tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:48.048825 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-28d60f17-fccc-49de-b799-fe773ba10c8f tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:48.050095 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-28d60f17-fccc-49de-b799-fe773ba10c8f tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:48.050766 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-28d60f17-fccc-49de-b799-fe773ba10c8f tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:48.316086 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-28d60f17-fccc-49de-b799-fe773ba10c8f tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb6a27e336449738f68a88d870ca6e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f79872256b2647d6a01c9e753b93b3c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:48.332461 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-28d60f17-fccc-49de-b799-fe773ba10c8f tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] 10.222.0.61 "GET /compute/v2.1/servers/5709d363-0934-4d14-a734-35a54bdc03d0" status: 200 len: 1270 microversion: 2.1 time: 0.318151 Aug 31 16:06:48.335868 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1303/2606] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:48 2022] GET /compute/v2.1/servers/5709d363-0934-4d14-a734-35a54bdc03d0 => generated 1270 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:48.353658 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ad64e619-3a07-43fc-b6db-1377d668f541 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:48.355646 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ad64e619-3a07-43fc-b6db-1377d668f541 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] [instance: 685d47e4-721e-4eae-b5f8-78fdb68454ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:48.383657 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ad64e619-3a07-43fc-b6db-1377d668f541 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:48.384545 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ad64e619-3a07-43fc-b6db-1377d668f541 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:48.385239 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ad64e619-3a07-43fc-b6db-1377d668f541 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:48.386330 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ad64e619-3a07-43fc-b6db-1377d668f541 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:48.387100 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ad64e619-3a07-43fc-b6db-1377d668f541 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:48.396506 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ad64e619-3a07-43fc-b6db-1377d668f541 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:48.803839 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c19b2f14-8c17-4028-ba44-b94e42eb3bcd tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:48.815538 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c19b2f14-8c17-4028-ba44-b94e42eb3bcd tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:48.817612 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c19b2f14-8c17-4028-ba44-b94e42eb3bcd tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:48.819371 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c19b2f14-8c17-4028-ba44-b94e42eb3bcd tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/79ee7e24-93df-450b-9030-b08c00d019eb" status: 200 len: 1563 microversion: 2.25 time: 1.024334 Aug 31 16:06:48.832485 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1304/2607] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:06:47 2022] GET /compute/v2.1/servers/79ee7e24-93df-450b-9030-b08c00d019eb => generated 1563 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:06:48.844713 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9514920e-d497-4244-bb14-1131d8ef27fe tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '.version_select at 0x7f5ae8457820>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:48.919094 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9514920e-d497-4244-bb14-1131d8ef27fe tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "GET /compute/v2.1/images/03df45dd-ab3d-44b8-97f9-0f9148109666" status: 200 len: 1452 microversion: 2.1 time: 0.084786 Aug 31 16:06:48.919378 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1305/2608] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:06:48 2022] GET /compute/v2.1/images/03df45dd-ab3d-44b8-97f9-0f9148109666 => generated 1452 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:48.933507 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8e8a3906-7625-4c28-97a8-4edd4fc0bf1c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:48.934501 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8e8a3906-7625-4c28-97a8-4edd4fc0bf1c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: db1ac026-e512-4e5f-839d-4056cec509b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:48.941831 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8e8a3906-7625-4c28-97a8-4edd4fc0bf1c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:48.942740 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8e8a3906-7625-4c28-97a8-4edd4fc0bf1c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:48.943421 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8e8a3906-7625-4c28-97a8-4edd4fc0bf1c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:48.944424 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8e8a3906-7625-4c28-97a8-4edd4fc0bf1c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:48.945118 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8e8a3906-7625-4c28-97a8-4edd4fc0bf1c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:48.945790 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8e8a3906-7625-4c28-97a8-4edd4fc0bf1c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:49.340016 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ad64e619-3a07-43fc-b6db-1377d668f541 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:49.358858 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ad64e619-3a07-43fc-b6db-1377d668f541 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:49.360755 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ad64e619-3a07-43fc-b6db-1377d668f541 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:49.365717 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ad64e619-3a07-43fc-b6db-1377d668f541 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] 10.222.0.61 "GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae" status: 200 len: 1875 microversion: 2.42 time: 1.024760 Aug 31 16:06:49.368429 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1304/2609] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:06:48 2022] GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae => generated 1875 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:06:49.381670 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5a732d0c-4ee3-4f65-b4f2-4efe9a3b7b53 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:49.386001 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5a732d0c-4ee3-4f65-b4f2-4efe9a3b7b53 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 8f165110-0ea6-48c0-8357-ba419171f7af] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:49.402734 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5a732d0c-4ee3-4f65-b4f2-4efe9a3b7b53 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:49.403488 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5a732d0c-4ee3-4f65-b4f2-4efe9a3b7b53 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:49.404135 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5a732d0c-4ee3-4f65-b4f2-4efe9a3b7b53 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:49.405043 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5a732d0c-4ee3-4f65-b4f2-4efe9a3b7b53 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:49.405868 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5a732d0c-4ee3-4f65-b4f2-4efe9a3b7b53 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:49.406441 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5a732d0c-4ee3-4f65-b4f2-4efe9a3b7b53 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:49.756662 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8e8a3906-7625-4c28-97a8-4edd4fc0bf1c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:49.771877 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8e8a3906-7625-4c28-97a8-4edd4fc0bf1c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/db1ac026-e512-4e5f-839d-4056cec509b3" status: 200 len: 1507 microversion: 2.1 time: 0.843127 Aug 31 16:06:49.775456 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1306/2610] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:48 2022] GET /compute/v2.1/servers/db1ac026-e512-4e5f-839d-4056cec509b3 => generated 1507 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:49.786786 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-86d0f118-5c19-423e-8fa4-c902788ed281 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:49.787429 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-86d0f118-5c19-423e-8fa4-c902788ed281 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] [instance: 5709d363-0934-4d14-a734-35a54bdc03d0] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:49.802516 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-86d0f118-5c19-423e-8fa4-c902788ed281 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:49.803030 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-86d0f118-5c19-423e-8fa4-c902788ed281 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:49.803480 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-86d0f118-5c19-423e-8fa4-c902788ed281 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:49.806806 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-86d0f118-5c19-423e-8fa4-c902788ed281 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:49.811431 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-86d0f118-5c19-423e-8fa4-c902788ed281 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:49.812555 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-86d0f118-5c19-423e-8fa4-c902788ed281 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:50.036991 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-86d0f118-5c19-423e-8fa4-c902788ed281 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb6a27e336449738f68a88d870ca6e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f79872256b2647d6a01c9e753b93b3c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:50.043190 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5a732d0c-4ee3-4f65-b4f2-4efe9a3b7b53 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:50.056314 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5a732d0c-4ee3-4f65-b4f2-4efe9a3b7b53 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/8f165110-0ea6-48c0-8357-ba419171f7af" status: 200 len: 1312 microversion: 2.1 time: 0.686424 Aug 31 16:06:50.057595 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1305/2611] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:49 2022] GET /compute/v2.1/servers/8f165110-0ea6-48c0-8357-ba419171f7af => generated 1312 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:50.063269 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-42977d5c-1108-4ba0-88ae-c1c08f11ad17 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:50.064003 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-42977d5c-1108-4ba0-88ae-c1c08f11ad17 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 79ee7e24-93df-450b-9030-b08c00d019eb] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:50.071410 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42977d5c-1108-4ba0-88ae-c1c08f11ad17 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:50.072077 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42977d5c-1108-4ba0-88ae-c1c08f11ad17 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:50.072712 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42977d5c-1108-4ba0-88ae-c1c08f11ad17 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:50.074600 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42977d5c-1108-4ba0-88ae-c1c08f11ad17 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:50.075325 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42977d5c-1108-4ba0-88ae-c1c08f11ad17 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:50.076052 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42977d5c-1108-4ba0-88ae-c1c08f11ad17 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:50.080011 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-86d0f118-5c19-423e-8fa4-c902788ed281 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] 10.222.0.61 "GET /compute/v2.1/servers/5709d363-0934-4d14-a734-35a54bdc03d0" status: 200 len: 1276 microversion: 2.1 time: 0.301479 Aug 31 16:06:50.081148 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1307/2612] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:49 2022] GET /compute/v2.1/servers/5709d363-0934-4d14-a734-35a54bdc03d0 => generated 1276 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:50.093285 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7625db18-5389-40ca-8494-85e3bb1cfabe tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '.version_select at 0x7f5ae8419790>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:50.177640 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7625db18-5389-40ca-8494-85e3bb1cfabe tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "GET /compute/v2.1/images/03df45dd-ab3d-44b8-97f9-0f9148109666" status: 200 len: 1452 microversion: 2.1 time: 0.094897 Aug 31 16:06:50.178373 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1308/2613] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:06:50 2022] GET /compute/v2.1/images/03df45dd-ab3d-44b8-97f9-0f9148109666 => generated 1452 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:50.292961 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-42977d5c-1108-4ba0-88ae-c1c08f11ad17 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:50.308758 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-42977d5c-1108-4ba0-88ae-c1c08f11ad17 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:50.310388 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-42977d5c-1108-4ba0-88ae-c1c08f11ad17 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:50.314468 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-16161862-d82a-4c9b-ab68-f0c886290f89 tempest-FloatingIPsNegativeTestJSON-498808996 tempest-FloatingIPsNegativeTestJSON-498808996-project] Calling method '.version_select at 0x7f5ae8404dc0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:50.316893 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-42977d5c-1108-4ba0-88ae-c1c08f11ad17 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/79ee7e24-93df-450b-9030-b08c00d019eb" status: 200 len: 1521 microversion: 2.25 time: 0.253336 Aug 31 16:06:50.317591 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1306/2614] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:06:50 2022] GET /compute/v2.1/servers/79ee7e24-93df-450b-9030-b08c00d019eb => generated 1521 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:06:50.406187 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-839e5eb1-9136-431d-b72f-c43ad39e41dc tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:50.407212 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-839e5eb1-9136-431d-b72f-c43ad39e41dc tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] [instance: 685d47e4-721e-4eae-b5f8-78fdb68454ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:50.416517 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-839e5eb1-9136-431d-b72f-c43ad39e41dc tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:50.417634 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-839e5eb1-9136-431d-b72f-c43ad39e41dc tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:50.418585 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-839e5eb1-9136-431d-b72f-c43ad39e41dc tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:50.419691 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-839e5eb1-9136-431d-b72f-c43ad39e41dc tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:50.420314 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-839e5eb1-9136-431d-b72f-c43ad39e41dc tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:50.420989 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-839e5eb1-9136-431d-b72f-c43ad39e41dc tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:50.510850 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-16161862-d82a-4c9b-ab68-f0c886290f89 tempest-FloatingIPsNegativeTestJSON-498808996 tempest-FloatingIPsNegativeTestJSON-498808996-project] 10.222.0.61 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.329079 Aug 31 16:06:50.511914 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1309/2615] 10.222.0.61 () {58 vars in 1149 bytes} [Wed Aug 31 16:06:50 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 16:06:50.531051 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-41ca6089-2cc7-4bdc-8902-4aa6812baab0 tempest-FloatingIPsNegativeTestJSON-498808996 tempest-FloatingIPsNegativeTestJSON-498808996-project] Action: 'create', calling method: .version_select at 0x7f5ae841de50>, body: {"pool": "non_exist_pool"} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:06:50.650068 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-41ca6089-2cc7-4bdc-8902-4aa6812baab0 tempest-FloatingIPsNegativeTestJSON-498808996 tempest-FloatingIPsNegativeTestJSON-498808996-project] HTTP exception thrown: Floating IP pool not found. Aug 31 16:06:50.653932 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-41ca6089-2cc7-4bdc-8902-4aa6812baab0 tempest-FloatingIPsNegativeTestJSON-498808996 tempest-FloatingIPsNegativeTestJSON-498808996-project] Request method failure captured: Aug 31 16:06:50.653932 n-d-850499-9 devstack@n-api.service[122257]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Aug 31 16:06:50.653932 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:06:50.653932 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:06:50.653932 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:06:50.653932 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 26 Aug 31 16:06:50.653932 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:06:50.653932 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:06:50.653932 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:06:50.653932 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:06:50.653932 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4cZfWuFZ_oPzgapQ1ngBZqt-AvR71XXqsnCifCwbH8GgjTGC_-ssF0eJvdCEvX61OsvFVzeTUXfRRNCrcaqRfPM_lk7FIyW2bdXgo4YqTF6nTUjfRmgR7bUur7cZzafyL3T8lNn6jSw_WJ6A68_j9CUrhEYz3ymmP-TPBfSmIzZKBs Aug 31 16:06:50.653932 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:06:50.653932 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:06:50.653932 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:06:50.653932 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:06:50.653932 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:06:50.653932 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:06:50.653932 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 5b9710d79602493e95e1ff1d5b33a298 Aug 31 16:06:50.653932 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-498808996 Aug 31 16:06:50.653932 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:06:50.653932 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:06:50.653932 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5b9710d79602493e95e1ff1d5b33a298"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5b9710d79602493e95e1ff1d5b33a298"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5b9710d79602493e95e1ff1d5b33a298", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5b9710d79602493e95e1ff1d5b33a298"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:06:50.653932 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-498808996 Aug 31 16:06:50.653932 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 5b9710d79602493e95e1ff1d5b33a298 Aug 31 16:06:50.653932 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-498808996 Aug 31 16:06:50.653932 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-FloatingIPsNegativeTestJSON-498808996-project Aug 31 16:06:50.653932 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:06:50.653932 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:06:50.653932 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 43ca7dac1fdf4f6e951c46a2e6e65229 Aug 31 16:06:50.653932 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-498808996-project Aug 31 16:06:50.653932 n-d-850499-9 devstack@n-api.service[122257]: Aug 31 16:06:50.653932 n-d-850499-9 devstack@n-api.service[122257]: {"pool": "non_exist_pool"} Aug 31 16:06:50.653932 n-d-850499-9 devstack@n-api.service[122257]: method: Aug 31 16:06:50.653932 n-d-850499-9 devstack@n-api.service[122257]: exception: Floating IP pool not found. Aug 31 16:06:50.653932 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'body': {'pool': 'non_exist_pool'}} Aug 31 16:06:50.653932 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:06:50.653932 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:06:50.653932 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Aug 31 16:06:50.653932 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Aug 31 16:06:50.653932 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2975, in allocate_floating_ip Aug 31 16:06:50.653932 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Aug 31 16:06:50.653932 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2965, in _get_floating_ip_pool_id_by_name_or_id Aug 31 16:06:50.653932 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Aug 31 16:06:50.653932 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Aug 31 16:06:50.653932 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:06:50.653932 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:06:50.653932 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:06:50.653932 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:06:50.653932 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:06:50.653932 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:06:50.653932 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:06:50.653932 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:06:50.653932 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:06:50.653932 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:06:50.653932 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:06:50.653932 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:06:50.653932 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Aug 31 16:06:50.653932 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:06:50.653932 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Aug 31 16:06:50.653932 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:06:50.653932 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:06:50.653932 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:06:50.653932 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:06:50.653932 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:06:50.653932 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:06:50.653932 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:06:50.653932 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:06:50.659221 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Aug 31 16:06:50.659221 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:06:50.661100 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-41ca6089-2cc7-4bdc-8902-4aa6812baab0 tempest-FloatingIPsNegativeTestJSON-498808996 tempest-FloatingIPsNegativeTestJSON-498808996-project] Returning 404 to user: Floating IP pool not found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:06:50.662358 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-41ca6089-2cc7-4bdc-8902-4aa6812baab0 tempest-FloatingIPsNegativeTestJSON-498808996 tempest-FloatingIPsNegativeTestJSON-498808996-project] 10.222.0.61 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.136441 Aug 31 16:06:50.663765 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1310/2616] 10.222.0.61 () {60 vars in 1170 bytes} [Wed Aug 31 16:06:50 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 31 16:06:50.685805 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-06f3e4b5-e9b0-4e73-8eb4-0201fe00a0b5 req-fc563b71-fed3-488c-92b9-bedd8e9def4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79ee7e24-93df-450b-9030-b08c00d019eb", "name": "network-vif-deleted", "tag": "a2a2e771-f0ba-4149-867f-67716bfa9d07"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:06:50.745702 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-06f3e4b5-e9b0-4e73-8eb4-0201fe00a0b5 req-fc563b71-fed3-488c-92b9-bedd8e9def4c service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:50.747166 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-06f3e4b5-e9b0-4e73-8eb4-0201fe00a0b5 req-fc563b71-fed3-488c-92b9-bedd8e9def4c service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:50.749567 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-06f3e4b5-e9b0-4e73-8eb4-0201fe00a0b5 req-fc563b71-fed3-488c-92b9-bedd8e9def4c service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:50.784909 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-06f3e4b5-e9b0-4e73-8eb4-0201fe00a0b5 req-fc563b71-fed3-488c-92b9-bedd8e9def4c service nova] Creating event network-vif-deleted:a2a2e771-f0ba-4149-867f-67716bfa9d07 for instance 79ee7e24-93df-450b-9030-b08c00d019eb on n-h2-850499-9 Aug 31 16:06:50.792772 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-06f3e4b5-e9b0-4e73-8eb4-0201fe00a0b5 req-fc563b71-fed3-488c-92b9-bedd8e9def4c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120260 Aug 31 16:06:50.793994 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1311/2617] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:06:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:06:50.801756 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-db60a13d-fd68-4508-8a99-e238e14aad73 tempest-FloatingIPsNegativeTestJSON-498808996 tempest-FloatingIPsNegativeTestJSON-498808996-project] Calling method '.version_select at 0x7f5ae84e6820>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:50.961208 n-d-850499-9 devstack@n-api.service[122257]: DEBUG neutronclient.v2_0.client [None req-db60a13d-fd68-4508-8a99-e238e14aad73 tempest-FloatingIPsNegativeTestJSON-498808996 tempest-FloatingIPsNegativeTestJSON-498808996-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 671f4358-295a-4f91-a528-e469effae5e2 could not be found", "detail": ""}} {{(pid=122257) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 31 16:06:50.965279 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-db60a13d-fd68-4508-8a99-e238e14aad73 tempest-FloatingIPsNegativeTestJSON-498808996 tempest-FloatingIPsNegativeTestJSON-498808996-project] HTTP exception thrown: Floating IP not found for ID 671f4358-295a-4f91-a528-e469effae5e2 Aug 31 16:06:50.968829 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-db60a13d-fd68-4508-8a99-e238e14aad73 tempest-FloatingIPsNegativeTestJSON-498808996 tempest-FloatingIPsNegativeTestJSON-498808996-project] Request method failure captured: Aug 31 16:06:50.968829 n-d-850499-9 devstack@n-api.service[122257]: request: DELETE /compute/v2.1/os-floating-ips/671f4358-295a-4f91-a528-e469effae5e2 HTTP/1.1 Aug 31 16:06:50.968829 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:06:50.968829 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:06:50.968829 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:06:50.968829 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:06:50.968829 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:06:50.968829 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:06:50.968829 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:06:50.968829 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:06:50.968829 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4cZfWuFZ_oPzgapQ1ngBZqt-AvR71XXqsnCifCwbH8GgjTGC_-ssF0eJvdCEvX61OsvFVzeTUXfRRNCrcaqRfPM_lk7FIyW2bdXgo4YqTF6nTUjfRmgR7bUur7cZzafyL3T8lNn6jSw_WJ6A68_j9CUrhEYz3ymmP-TPBfSmIzZKBs Aug 31 16:06:50.968829 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:06:50.968829 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:06:50.968829 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:06:50.968829 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:06:50.968829 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:06:50.968829 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:06:50.968829 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 5b9710d79602493e95e1ff1d5b33a298 Aug 31 16:06:50.968829 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-498808996 Aug 31 16:06:50.968829 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:06:50.968829 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:06:50.968829 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5b9710d79602493e95e1ff1d5b33a298"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5b9710d79602493e95e1ff1d5b33a298"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5b9710d79602493e95e1ff1d5b33a298", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5b9710d79602493e95e1ff1d5b33a298"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:06:50.968829 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-498808996 Aug 31 16:06:50.968829 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 5b9710d79602493e95e1ff1d5b33a298 Aug 31 16:06:50.968829 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-498808996 Aug 31 16:06:50.968829 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-FloatingIPsNegativeTestJSON-498808996-project Aug 31 16:06:50.968829 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:06:50.968829 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:06:50.968829 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 43ca7dac1fdf4f6e951c46a2e6e65229 Aug 31 16:06:50.968829 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-498808996-project Aug 31 16:06:50.968829 n-d-850499-9 devstack@n-api.service[122257]: method: Aug 31 16:06:50.968829 n-d-850499-9 devstack@n-api.service[122257]: exception: Floating IP not found for ID 671f4358-295a-4f91-a528-e469effae5e2 Aug 31 16:06:50.968829 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '671f4358-295a-4f91-a528-e469effae5e2'} Aug 31 16:06:50.968829 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:06:50.968829 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:06:50.968829 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 31 16:06:50.968829 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 31 16:06:50.968829 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:06:50.968829 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:06:50.968829 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 31 16:06:50.968829 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 31 16:06:50.968829 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:06:50.968829 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:06:50.968829 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 31 16:06:50.968829 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 31 16:06:50.968829 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:06:50.968829 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:06:50.968829 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 31 16:06:50.968829 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 31 16:06:50.968829 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:06:50.968829 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:06:50.968829 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 31 16:06:50.968829 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 31 16:06:50.968829 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:06:50.968829 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:06:50.968829 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 31 16:06:50.968829 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 31 16:06:50.968829 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 31 16:06:50.968829 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 31 16:06:50.968829 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 671f4358-295a-4f91-a528-e469effae5e2 could not be found Aug 31 16:06:50.968829 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-22d99584-6bfc-4863-a795-2f292e89fffc'] Aug 31 16:06:50.972786 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:06:50.972786 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:06:50.972786 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:06:50.972786 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:06:50.972786 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Aug 31 16:06:50.972786 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 31 16:06:50.972786 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 31 16:06:50.972786 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 31 16:06:50.972786 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 671f4358-295a-4f91-a528-e469effae5e2. Aug 31 16:06:50.972786 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:06:50.972786 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:06:50.972786 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:06:50.972786 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:06:50.972786 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:06:50.972786 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:06:50.972786 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:06:50.972786 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:06:50.972786 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:06:50.972786 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:06:50.972786 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:06:50.972786 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:06:50.972786 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Aug 31 16:06:50.972786 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 31 16:06:50.972786 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 671f4358-295a-4f91-a528-e469effae5e2 Aug 31 16:06:50.972786 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:06:50.972786 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:06:50.972786 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:06:50.972786 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:06:50.972786 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:06:50.972786 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:06:50.972786 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:06:50.972786 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:06:50.972786 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 671f4358-295a-4f91-a528-e469effae5e2 Aug 31 16:06:50.972786 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:06:50.976346 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-db60a13d-fd68-4508-8a99-e238e14aad73 tempest-FloatingIPsNegativeTestJSON-498808996 tempest-FloatingIPsNegativeTestJSON-498808996-project] Returning 404 to user: Floating IP not found for ID 671f4358-295a-4f91-a528-e469effae5e2 {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:06:50.977832 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-db60a13d-fd68-4508-8a99-e238e14aad73 tempest-FloatingIPsNegativeTestJSON-498808996 tempest-FloatingIPsNegativeTestJSON-498808996-project] 10.222.0.61 "DELETE /compute/v2.1/os-floating-ips/671f4358-295a-4f91-a528-e469effae5e2" status: 404 len: 111 microversion: 2.1 time: 0.182137 Aug 31 16:06:50.978806 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1312/2618] 10.222.0.61 () {58 vars in 1263 bytes} [Wed Aug 31 16:06:50 2022] DELETE /compute/v2.1/os-floating-ips/671f4358-295a-4f91-a528-e469effae5e2 => generated 111 bytes in 184 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:06:50.991477 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-12510477-11e9-4129-a3f0-e727fd0b55e0 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:50.992556 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-12510477-11e9-4129-a3f0-e727fd0b55e0 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: db1ac026-e512-4e5f-839d-4056cec509b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:51.005536 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-12510477-11e9-4129-a3f0-e727fd0b55e0 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:51.006401 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-12510477-11e9-4129-a3f0-e727fd0b55e0 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:51.007034 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-12510477-11e9-4129-a3f0-e727fd0b55e0 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:51.008071 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-12510477-11e9-4129-a3f0-e727fd0b55e0 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:51.008968 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-12510477-11e9-4129-a3f0-e727fd0b55e0 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:51.009591 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-12510477-11e9-4129-a3f0-e727fd0b55e0 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:51.068084 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-839e5eb1-9136-431d-b72f-c43ad39e41dc tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:51.083554 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-839e5eb1-9136-431d-b72f-c43ad39e41dc tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:51.091528 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-839e5eb1-9136-431d-b72f-c43ad39e41dc tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:51.097364 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-839e5eb1-9136-431d-b72f-c43ad39e41dc tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] 10.222.0.61 "GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae" status: 200 len: 1875 microversion: 2.42 time: 0.698969 Aug 31 16:06:51.100713 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1307/2619] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:06:50 2022] GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae => generated 1875 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:06:51.111943 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ed7cf2b6-379d-494a-b627-0065f21278ca tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:51.112952 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ed7cf2b6-379d-494a-b627-0065f21278ca tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 8f165110-0ea6-48c0-8357-ba419171f7af] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:51.126260 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ed7cf2b6-379d-494a-b627-0065f21278ca tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:51.127184 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ed7cf2b6-379d-494a-b627-0065f21278ca tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:51.132523 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ed7cf2b6-379d-494a-b627-0065f21278ca tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:51.136287 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ed7cf2b6-379d-494a-b627-0065f21278ca tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:51.138279 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ed7cf2b6-379d-494a-b627-0065f21278ca tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:51.140475 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ed7cf2b6-379d-494a-b627-0065f21278ca tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:51.490982 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-12510477-11e9-4129-a3f0-e727fd0b55e0 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:51.502084 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-12510477-11e9-4129-a3f0-e727fd0b55e0 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/db1ac026-e512-4e5f-839d-4056cec509b3" status: 200 len: 1507 microversion: 2.1 time: 0.516309 Aug 31 16:06:51.502820 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1313/2620] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:50 2022] GET /compute/v2.1/servers/db1ac026-e512-4e5f-839d-4056cec509b3 => generated 1507 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:51.510059 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-df764d82-3671-48ba-8430-81f37549d6e7 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:51.521221 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-df764d82-3671-48ba-8430-81f37549d6e7 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] [instance: 5709d363-0934-4d14-a734-35a54bdc03d0] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:51.560040 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-df764d82-3671-48ba-8430-81f37549d6e7 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:51.576223 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-df764d82-3671-48ba-8430-81f37549d6e7 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:51.577041 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-df764d82-3671-48ba-8430-81f37549d6e7 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:51.578289 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-df764d82-3671-48ba-8430-81f37549d6e7 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:51.580927 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-df764d82-3671-48ba-8430-81f37549d6e7 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:51.584861 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-df764d82-3671-48ba-8430-81f37549d6e7 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:51.610878 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ed7cf2b6-379d-494a-b627-0065f21278ca tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:51.616292 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:06:51.631111 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ed7cf2b6-379d-494a-b627-0065f21278ca tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/8f165110-0ea6-48c0-8357-ba419171f7af" status: 200 len: 1312 microversion: 2.1 time: 0.524895 Aug 31 16:06:51.633888 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1308/2621] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:51 2022] GET /compute/v2.1/servers/8f165110-0ea6-48c0-8357-ba419171f7af => generated 1312 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:51.648228 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c197983f-cd4b-49b9-b7fd-37f5858402fa tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '.version_select at 0x7f5ae85a3940>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:51.762450 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c197983f-cd4b-49b9-b7fd-37f5858402fa tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "GET /compute/v2.1/images/03df45dd-ab3d-44b8-97f9-0f9148109666" status: 200 len: 1452 microversion: 2.1 time: 0.127063 Aug 31 16:06:51.763468 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1309/2622] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:06:51 2022] GET /compute/v2.1/images/03df45dd-ab3d-44b8-97f9-0f9148109666 => generated 1452 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:51.788059 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-df764d82-3671-48ba-8430-81f37549d6e7 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb6a27e336449738f68a88d870ca6e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f79872256b2647d6a01c9e753b93b3c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:51.807853 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-df764d82-3671-48ba-8430-81f37549d6e7 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] 10.222.0.61 "GET /compute/v2.1/servers/5709d363-0934-4d14-a734-35a54bdc03d0" status: 200 len: 1276 microversion: 2.1 time: 0.303508 Aug 31 16:06:51.809376 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1314/2623] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:51 2022] GET /compute/v2.1/servers/5709d363-0934-4d14-a734-35a54bdc03d0 => generated 1276 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:51.976416 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-03c4d481-4c6f-4a01-a738-8c4c80275f4c req-07207303-20a5-4035-8ffb-dab7e5f51e59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f165110-0ea6-48c0-8357-ba419171f7af", "name": "network-vif-plugged", "status": "completed", "tag": "900ed2dd-d7d4-47d6-b6c7-2d39286cc7dc"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:06:51.996738 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-03c4d481-4c6f-4a01-a738-8c4c80275f4c req-07207303-20a5-4035-8ffb-dab7e5f51e59 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:52.000395 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-03c4d481-4c6f-4a01-a738-8c4c80275f4c req-07207303-20a5-4035-8ffb-dab7e5f51e59 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:52.001425 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-03c4d481-4c6f-4a01-a738-8c4c80275f4c req-07207303-20a5-4035-8ffb-dab7e5f51e59 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:52.040294 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-03c4d481-4c6f-4a01-a738-8c4c80275f4c req-07207303-20a5-4035-8ffb-dab7e5f51e59 service nova] Creating event network-vif-plugged:900ed2dd-d7d4-47d6-b6c7-2d39286cc7dc for instance 8f165110-0ea6-48c0-8357-ba419171f7af on n-h1-850499-9 Aug 31 16:06:52.058542 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-03c4d481-4c6f-4a01-a738-8c4c80275f4c req-07207303-20a5-4035-8ffb-dab7e5f51e59 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086193 Aug 31 16:06:52.063100 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1315/2624] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:06:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:06:52.127639 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e1ca151d-91b7-417f-b587-6e477bd63d45 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:52.128818 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e1ca151d-91b7-417f-b587-6e477bd63d45 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] [instance: 685d47e4-721e-4eae-b5f8-78fdb68454ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:52.147673 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e1ca151d-91b7-417f-b587-6e477bd63d45 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:52.149656 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e1ca151d-91b7-417f-b587-6e477bd63d45 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:52.151391 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e1ca151d-91b7-417f-b587-6e477bd63d45 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:52.152939 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e1ca151d-91b7-417f-b587-6e477bd63d45 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:52.155104 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e1ca151d-91b7-417f-b587-6e477bd63d45 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:52.157369 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e1ca151d-91b7-417f-b587-6e477bd63d45 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:52.202052 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-02c38342-c784-4f0c-85ab-010766cd09c4 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:52.202847 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-02c38342-c784-4f0c-85ab-010766cd09c4 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 79ee7e24-93df-450b-9030-b08c00d019eb] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:52.255542 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-02c38342-c784-4f0c-85ab-010766cd09c4 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:52.256302 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-02c38342-c784-4f0c-85ab-010766cd09c4 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:52.258151 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-02c38342-c784-4f0c-85ab-010766cd09c4 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:52.261530 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-02c38342-c784-4f0c-85ab-010766cd09c4 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:52.264956 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-02c38342-c784-4f0c-85ab-010766cd09c4 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:52.271826 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-02c38342-c784-4f0c-85ab-010766cd09c4 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:52.504390 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-02c38342-c784-4f0c-85ab-010766cd09c4 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:52.504944 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-02c38342-c784-4f0c-85ab-010766cd09c4 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:52.505431 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-02c38342-c784-4f0c-85ab-010766cd09c4 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:52.505905 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-02c38342-c784-4f0c-85ab-010766cd09c4 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lazy-loading 'fault' on Instance uuid 79ee7e24-93df-450b-9030-b08c00d019eb {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:06:52.886088 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-02c38342-c784-4f0c-85ab-010766cd09c4 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:52.899667 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-02c38342-c784-4f0c-85ab-010766cd09c4 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:52.920653 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-02c38342-c784-4f0c-85ab-010766cd09c4 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8e30aa23194f898b07dfbc6fd8d5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a9266ba9b14c6a8b6e79aecfe86df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:52.927299 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-02c38342-c784-4f0c-85ab-010766cd09c4 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/79ee7e24-93df-450b-9030-b08c00d019eb" status: 200 len: 1351 microversion: 2.25 time: 1.161922 Aug 31 16:06:52.929260 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1310/2625] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:06:51 2022] GET /compute/v2.1/servers/79ee7e24-93df-450b-9030-b08c00d019eb => generated 1351 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:06:52.936994 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5afdb2f7-8df3-4905-89aa-703e10f8d336 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:52.939086 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5afdb2f7-8df3-4905-89aa-703e10f8d336 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: db1ac026-e512-4e5f-839d-4056cec509b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:52.968298 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5afdb2f7-8df3-4905-89aa-703e10f8d336 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:52.969562 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5afdb2f7-8df3-4905-89aa-703e10f8d336 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:52.970166 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5afdb2f7-8df3-4905-89aa-703e10f8d336 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:52.973843 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5afdb2f7-8df3-4905-89aa-703e10f8d336 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:52.976383 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5afdb2f7-8df3-4905-89aa-703e10f8d336 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:52.977463 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5afdb2f7-8df3-4905-89aa-703e10f8d336 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:52.996972 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e1ca151d-91b7-417f-b587-6e477bd63d45 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:53.019953 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e1ca151d-91b7-417f-b587-6e477bd63d45 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:53.021595 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e1ca151d-91b7-417f-b587-6e477bd63d45 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:53.024630 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e1ca151d-91b7-417f-b587-6e477bd63d45 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] 10.222.0.61 "GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae" status: 200 len: 1875 microversion: 2.42 time: 0.904986 Aug 31 16:06:53.035370 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1316/2626] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:06:52 2022] GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae => generated 1875 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:06:53.041501 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-eec9e56d-58ea-48b3-9588-764f1fff22c9 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:53.044695 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-eec9e56d-58ea-48b3-9588-764f1fff22c9 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 8f165110-0ea6-48c0-8357-ba419171f7af] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:53.070603 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eec9e56d-58ea-48b3-9588-764f1fff22c9 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:53.076705 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eec9e56d-58ea-48b3-9588-764f1fff22c9 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:53.077591 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eec9e56d-58ea-48b3-9588-764f1fff22c9 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:53.079154 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eec9e56d-58ea-48b3-9588-764f1fff22c9 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:53.079837 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eec9e56d-58ea-48b3-9588-764f1fff22c9 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:53.080457 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eec9e56d-58ea-48b3-9588-764f1fff22c9 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:53.781982 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:06:53.888550 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=6 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:06:54.145013 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-eec9e56d-58ea-48b3-9588-764f1fff22c9 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:54.155430 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5afdb2f7-8df3-4905-89aa-703e10f8d336 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:54.169838 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5afdb2f7-8df3-4905-89aa-703e10f8d336 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/db1ac026-e512-4e5f-839d-4056cec509b3" status: 200 len: 1507 microversion: 2.1 time: 1.239287 Aug 31 16:06:54.194940 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1311/2627] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:52 2022] GET /compute/v2.1/servers/db1ac026-e512-4e5f-839d-4056cec509b3 => generated 1507 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:54.197942 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-eec9e56d-58ea-48b3-9588-764f1fff22c9 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/8f165110-0ea6-48c0-8357-ba419171f7af" status: 200 len: 1312 microversion: 2.1 time: 1.160246 Aug 31 16:06:54.200893 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b26e129c-de46-4a88-b8c6-bc7bfdc687c2 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '.version_select at 0x7f5ae8553dc0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:54.206439 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1317/2628] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:53 2022] GET /compute/v2.1/servers/8f165110-0ea6-48c0-8357-ba419171f7af => generated 1312 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:54.224830 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-988e727d-b3ac-4f1c-a41f-d5eae4deeb14 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:54.235402 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-988e727d-b3ac-4f1c-a41f-d5eae4deeb14 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] [instance: 5709d363-0934-4d14-a734-35a54bdc03d0] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:54.243335 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-988e727d-b3ac-4f1c-a41f-d5eae4deeb14 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:54.244017 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-988e727d-b3ac-4f1c-a41f-d5eae4deeb14 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:54.244543 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-988e727d-b3ac-4f1c-a41f-d5eae4deeb14 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:54.246796 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-988e727d-b3ac-4f1c-a41f-d5eae4deeb14 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:54.247387 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-988e727d-b3ac-4f1c-a41f-d5eae4deeb14 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:54.248024 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-988e727d-b3ac-4f1c-a41f-d5eae4deeb14 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:54.338088 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b26e129c-de46-4a88-b8c6-bc7bfdc687c2 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "GET /compute/v2.1/images/03df45dd-ab3d-44b8-97f9-0f9148109666" status: 200 len: 1452 microversion: 2.1 time: 0.141843 Aug 31 16:06:54.339051 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1312/2629] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:06:54 2022] GET /compute/v2.1/images/03df45dd-ab3d-44b8-97f9-0f9148109666 => generated 1452 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:54.360613 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7e4e4fba-f43e-4566-b8da-15fa778e9ad4 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:54.361819 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7e4e4fba-f43e-4566-b8da-15fa778e9ad4 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] [instance: 79ee7e24-93df-450b-9030-b08c00d019eb] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:54.374422 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7e4e4fba-f43e-4566-b8da-15fa778e9ad4 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:54.375592 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7e4e4fba-f43e-4566-b8da-15fa778e9ad4 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:54.376577 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7e4e4fba-f43e-4566-b8da-15fa778e9ad4 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:54.378093 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7e4e4fba-f43e-4566-b8da-15fa778e9ad4 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:54.379167 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7e4e4fba-f43e-4566-b8da-15fa778e9ad4 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:54.379828 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7e4e4fba-f43e-4566-b8da-15fa778e9ad4 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:54.437028 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-7e4e4fba-f43e-4566-b8da-15fa778e9ad4 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] HTTP exception thrown: Instance 79ee7e24-93df-450b-9030-b08c00d019eb could not be found. Aug 31 16:06:54.444276 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7e4e4fba-f43e-4566-b8da-15fa778e9ad4 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Request method failure captured: Aug 31 16:06:54.444276 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/79ee7e24-93df-450b-9030-b08c00d019eb HTTP/1.1 Aug 31 16:06:54.444276 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:06:54.444276 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:06:54.444276 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:06:54.444276 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:06:54.444276 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:06:54.444276 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:06:54.444276 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:06:54.444276 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:06:54.444276 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4Sz-nEtBIir4h6pKigKL9l8DQ-FgYlbEQSEmOoXkJYtraxr-5lRgxCapV6PXVJ4YbN1zbOPnHuzBENR6jTq9c9nKu5JErZVbYmzTyVmurBnViPBcsdVuA7zckwipUv_K3iEGy1xSXMXAMx1-1GWp5CVSbFfBIPYyZm0WGFyBwt-m9A Aug 31 16:06:54.444276 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:06:54.444276 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:06:54.444276 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:06:54.444276 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:06:54.444276 n-d-850499-9 devstack@n-api.service[122256]: X-Openstack-Nova-Api-Version: 2.25 Aug 31 16:06:54.444276 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:06:54.444276 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:06:54.444276 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 01a9266ba9b14c6a8b6e79aecfe86df6 Aug 31 16:06:54.444276 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-850802922 Aug 31 16:06:54.444276 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:06:54.444276 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:06:54.444276 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/01a9266ba9b14c6a8b6e79aecfe86df6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/01a9266ba9b14c6a8b6e79aecfe86df6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_01a9266ba9b14c6a8b6e79aecfe86df6", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/01a9266ba9b14c6a8b6e79aecfe86df6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:06:54.444276 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-850802922 Aug 31 16:06:54.444276 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 01a9266ba9b14c6a8b6e79aecfe86df6 Aug 31 16:06:54.444276 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-850802922 Aug 31 16:06:54.444276 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-LiveAutoBlockMigrationV225Test-850802922-project Aug 31 16:06:54.444276 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:06:54.444276 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:06:54.444276 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: bb8e30aa23194f898b07dfbc6fd8d5de Aug 31 16:06:54.444276 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-850802922-project Aug 31 16:06:54.444276 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:06:54.444276 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance 79ee7e24-93df-450b-9030-b08c00d019eb could not be found. Aug 31 16:06:54.444276 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '79ee7e24-93df-450b-9030-b08c00d019eb'} Aug 31 16:06:54.444276 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:06:54.444276 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:06:54.444276 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:06:54.444276 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:06:54.444276 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:06:54.444276 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:06:54.444276 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:06:54.444276 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:06:54.444276 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:06:54.444276 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:06:54.444276 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79ee7e24-93df-450b-9030-b08c00d019eb could not be found. Aug 31 16:06:54.444276 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:06:54.444276 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:06:54.444276 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:06:54.444276 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:06:54.444276 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:06:54.444276 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:06:54.444276 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:06:54.444276 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:06:54.444276 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:06:54.444276 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:06:54.444276 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:06:54.444276 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:06:54.444276 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:06:54.444276 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:06:54.444276 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:06:54.444276 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:06:54.444276 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79ee7e24-93df-450b-9030-b08c00d019eb could not be found. Aug 31 16:06:54.444276 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:06:54.451307 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:06:54.451307 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:06:54.451307 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:06:54.451307 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:06:54.451307 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:06:54.451307 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:06:54.451307 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:06:54.451307 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79ee7e24-93df-450b-9030-b08c00d019eb could not be found. Aug 31 16:06:54.451307 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:06:54.456440 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7e4e4fba-f43e-4566-b8da-15fa778e9ad4 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] Returning 404 to user: Instance 79ee7e24-93df-450b-9030-b08c00d019eb could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:06:54.457685 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7e4e4fba-f43e-4566-b8da-15fa778e9ad4 tempest-LiveAutoBlockMigrationV225Test-850802922 tempest-LiveAutoBlockMigrationV225Test-850802922-project] 10.222.0.61 "GET /compute/v2.1/servers/79ee7e24-93df-450b-9030-b08c00d019eb" status: 404 len: 111 microversion: 2.25 time: 0.117663 Aug 31 16:06:54.458950 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1313/2630] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:06:54 2022] GET /compute/v2.1/servers/79ee7e24-93df-450b-9030-b08c00d019eb => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:06:54.465509 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-be3fd017-cd2c-4b3a-8576-38997bbfce57 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:54.466408 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-be3fd017-cd2c-4b3a-8576-38997bbfce57 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] [instance: 685d47e4-721e-4eae-b5f8-78fdb68454ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:54.473723 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-be3fd017-cd2c-4b3a-8576-38997bbfce57 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:54.474676 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-be3fd017-cd2c-4b3a-8576-38997bbfce57 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:54.475822 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-be3fd017-cd2c-4b3a-8576-38997bbfce57 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:54.476807 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-be3fd017-cd2c-4b3a-8576-38997bbfce57 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:54.477491 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-be3fd017-cd2c-4b3a-8576-38997bbfce57 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:54.478153 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-be3fd017-cd2c-4b3a-8576-38997bbfce57 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:54.714565 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-988e727d-b3ac-4f1c-a41f-d5eae4deeb14 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb6a27e336449738f68a88d870ca6e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f79872256b2647d6a01c9e753b93b3c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:54.747217 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-988e727d-b3ac-4f1c-a41f-d5eae4deeb14 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] 10.222.0.61 "GET /compute/v2.1/servers/5709d363-0934-4d14-a734-35a54bdc03d0" status: 200 len: 1318 microversion: 2.1 time: 0.536257 Aug 31 16:06:54.750820 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1318/2631] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:54 2022] GET /compute/v2.1/servers/5709d363-0934-4d14-a734-35a54bdc03d0 => generated 1318 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:55.003484 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-b8eb7b06-107a-4ca6-84e4-20eda57a9a65 req-1482041f-390a-4ad9-849f-9bbd8b6543a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "560a01e5-93f8-46c8-9261-5030e28766b4", "name": "network-vif-plugged", "status": "completed", "tag": "f7a3259e-6ecb-48c9-a90a-0b0d027258f4"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:06:55.033304 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-b8eb7b06-107a-4ca6-84e4-20eda57a9a65 req-1482041f-390a-4ad9-849f-9bbd8b6543a8 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:55.033805 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-b8eb7b06-107a-4ca6-84e4-20eda57a9a65 req-1482041f-390a-4ad9-849f-9bbd8b6543a8 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:55.034245 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-b8eb7b06-107a-4ca6-84e4-20eda57a9a65 req-1482041f-390a-4ad9-849f-9bbd8b6543a8 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:55.069070 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-be3fd017-cd2c-4b3a-8576-38997bbfce57 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:55.080896 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-b8eb7b06-107a-4ca6-84e4-20eda57a9a65 req-1482041f-390a-4ad9-849f-9bbd8b6543a8 service nova] Creating event network-vif-plugged:f7a3259e-6ecb-48c9-a90a-0b0d027258f4 for instance 560a01e5-93f8-46c8-9261-5030e28766b4 on n-h2-850499-9 Aug 31 16:06:55.086141 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-be3fd017-cd2c-4b3a-8576-38997bbfce57 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:55.097616 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-be3fd017-cd2c-4b3a-8576-38997bbfce57 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:55.100448 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-b8eb7b06-107a-4ca6-84e4-20eda57a9a65 req-1482041f-390a-4ad9-849f-9bbd8b6543a8 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103707 Aug 31 16:06:55.105538 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1319/2632] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:06:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:06:55.105923 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-be3fd017-cd2c-4b3a-8576-38997bbfce57 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] 10.222.0.61 "GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae" status: 200 len: 1875 microversion: 2.42 time: 0.638894 Aug 31 16:06:55.108938 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1314/2633] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:06:54 2022] GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae => generated 1875 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:06:55.200560 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f865ef77-162f-4e17-9914-4e7122289da2 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:55.201824 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f865ef77-162f-4e17-9914-4e7122289da2 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: db1ac026-e512-4e5f-839d-4056cec509b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:55.219460 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-d1f8f977-feb2-4362-8c0e-b5b614e5e98f req-18a5be80-12f9-4a39-bd1f-f704b6dfbb0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5709d363-0934-4d14-a734-35a54bdc03d0", "tag": "a0a375b6-a9e9-4b0f-94cf-3a5beea5090c"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:06:55.227327 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f865ef77-162f-4e17-9914-4e7122289da2 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:55.227898 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f865ef77-162f-4e17-9914-4e7122289da2 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:55.228353 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f865ef77-162f-4e17-9914-4e7122289da2 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:55.229780 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f865ef77-162f-4e17-9914-4e7122289da2 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:55.230454 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f865ef77-162f-4e17-9914-4e7122289da2 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:55.230954 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f865ef77-162f-4e17-9914-4e7122289da2 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:55.252903 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-d1f8f977-feb2-4362-8c0e-b5b614e5e98f req-18a5be80-12f9-4a39-bd1f-f704b6dfbb0e service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:55.254147 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-d1f8f977-feb2-4362-8c0e-b5b614e5e98f req-18a5be80-12f9-4a39-bd1f-f704b6dfbb0e service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:55.254844 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-d1f8f977-feb2-4362-8c0e-b5b614e5e98f req-18a5be80-12f9-4a39-bd1f-f704b6dfbb0e service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:55.269111 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:06:55.293147 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-d1f8f977-feb2-4362-8c0e-b5b614e5e98f req-18a5be80-12f9-4a39-bd1f-f704b6dfbb0e service nova] Creating event network-changed:a0a375b6-a9e9-4b0f-94cf-3a5beea5090c for instance 5709d363-0934-4d14-a734-35a54bdc03d0 on n-h2-850499-9 Aug 31 16:06:55.308826 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-d1f8f977-feb2-4362-8c0e-b5b614e5e98f req-18a5be80-12f9-4a39-bd1f-f704b6dfbb0e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095409 Aug 31 16:06:55.312515 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1315/2634] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:06:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:06:55.325389 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-910c866e-9c4e-438a-9ba2-e8c1dab28046 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:55.326902 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-910c866e-9c4e-438a-9ba2-e8c1dab28046 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 8f165110-0ea6-48c0-8357-ba419171f7af] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:55.339348 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-910c866e-9c4e-438a-9ba2-e8c1dab28046 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:55.340180 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-910c866e-9c4e-438a-9ba2-e8c1dab28046 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:55.340792 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-910c866e-9c4e-438a-9ba2-e8c1dab28046 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:55.341865 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-910c866e-9c4e-438a-9ba2-e8c1dab28046 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:55.342670 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-910c866e-9c4e-438a-9ba2-e8c1dab28046 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:55.343279 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-910c866e-9c4e-438a-9ba2-e8c1dab28046 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:55.679998 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f865ef77-162f-4e17-9914-4e7122289da2 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:55.708822 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f865ef77-162f-4e17-9914-4e7122289da2 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/db1ac026-e512-4e5f-839d-4056cec509b3" status: 200 len: 1507 microversion: 2.1 time: 0.515947 Aug 31 16:06:55.709110 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-910c866e-9c4e-438a-9ba2-e8c1dab28046 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:55.724455 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1320/2635] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:55 2022] GET /compute/v2.1/servers/db1ac026-e512-4e5f-839d-4056cec509b3 => generated 1507 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:55.728055 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-910c866e-9c4e-438a-9ba2-e8c1dab28046 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/8f165110-0ea6-48c0-8357-ba419171f7af" status: 200 len: 1462 microversion: 2.1 time: 0.413364 Aug 31 16:06:55.729853 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1316/2636] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:55 2022] GET /compute/v2.1/servers/8f165110-0ea6-48c0-8357-ba419171f7af => generated 1462 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:55.737130 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f91b6c1a-3ba0-447a-bd76-b1e50d5ec06b tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '.version_select at 0x7f5ae83cfb80>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:55.825450 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f91b6c1a-3ba0-447a-bd76-b1e50d5ec06b tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "GET /compute/v2.1/images/03df45dd-ab3d-44b8-97f9-0f9148109666" status: 200 len: 1452 microversion: 2.1 time: 0.098030 Aug 31 16:06:55.826557 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1321/2637] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:06:55 2022] GET /compute/v2.1/images/03df45dd-ab3d-44b8-97f9-0f9148109666 => generated 1452 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:55.833174 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f8c549e5-3393-4cd3-a34c-fd7a0c757482 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:55.834452 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f8c549e5-3393-4cd3-a34c-fd7a0c757482 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] [instance: 5709d363-0934-4d14-a734-35a54bdc03d0] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:55.844215 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f8c549e5-3393-4cd3-a34c-fd7a0c757482 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:55.845280 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f8c549e5-3393-4cd3-a34c-fd7a0c757482 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:55.846360 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f8c549e5-3393-4cd3-a34c-fd7a0c757482 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:55.847640 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f8c549e5-3393-4cd3-a34c-fd7a0c757482 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:55.848561 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f8c549e5-3393-4cd3-a34c-fd7a0c757482 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:55.849413 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f8c549e5-3393-4cd3-a34c-fd7a0c757482 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:55.975729 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-79350ff9-885b-4814-81d9-ed1869a3d5f7 tempest-MigrationsAdminTest-62329235 tempest-MigrationsAdminTest-62329235-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:55.976626 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-79350ff9-885b-4814-81d9-ed1869a3d5f7 tempest-MigrationsAdminTest-62329235 tempest-MigrationsAdminTest-62329235-project-admin] [instance: 8f165110-0ea6-48c0-8357-ba419171f7af] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:55.985821 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-79350ff9-885b-4814-81d9-ed1869a3d5f7 tempest-MigrationsAdminTest-62329235 tempest-MigrationsAdminTest-62329235-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:55.986528 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-79350ff9-885b-4814-81d9-ed1869a3d5f7 tempest-MigrationsAdminTest-62329235 tempest-MigrationsAdminTest-62329235-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:55.987485 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-79350ff9-885b-4814-81d9-ed1869a3d5f7 tempest-MigrationsAdminTest-62329235 tempest-MigrationsAdminTest-62329235-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:55.988823 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-79350ff9-885b-4814-81d9-ed1869a3d5f7 tempest-MigrationsAdminTest-62329235 tempest-MigrationsAdminTest-62329235-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:55.989777 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-79350ff9-885b-4814-81d9-ed1869a3d5f7 tempest-MigrationsAdminTest-62329235 tempest-MigrationsAdminTest-62329235-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:55.990636 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-79350ff9-885b-4814-81d9-ed1869a3d5f7 tempest-MigrationsAdminTest-62329235 tempest-MigrationsAdminTest-62329235-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:56.328676 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f8c549e5-3393-4cd3-a34c-fd7a0c757482 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb6a27e336449738f68a88d870ca6e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f79872256b2647d6a01c9e753b93b3c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:56.360961 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f8c549e5-3393-4cd3-a34c-fd7a0c757482 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] 10.222.0.61 "GET /compute/v2.1/servers/5709d363-0934-4d14-a734-35a54bdc03d0" status: 200 len: 1318 microversion: 2.1 time: 0.533214 Aug 31 16:06:56.364573 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-79350ff9-885b-4814-81d9-ed1869a3d5f7 tempest-MigrationsAdminTest-62329235 tempest-MigrationsAdminTest-62329235-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/8f165110-0ea6-48c0-8357-ba419171f7af" status: 200 len: 1613 microversion: 2.1 time: 0.608145 Aug 31 16:06:56.366025 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1322/2638] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:55 2022] GET /compute/v2.1/servers/5709d363-0934-4d14-a734-35a54bdc03d0 => generated 1318 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:56.368464 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1317/2639] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:55 2022] GET /compute/v2.1/servers/8f165110-0ea6-48c0-8357-ba419171f7af => generated 1613 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:56.371714 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e5dd87f9-0372-4c43-9d6a-5f64061790f3 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:56.373734 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e5dd87f9-0372-4c43-9d6a-5f64061790f3 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] [instance: 685d47e4-721e-4eae-b5f8-78fdb68454ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:56.384007 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e5dd87f9-0372-4c43-9d6a-5f64061790f3 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:56.384544 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e5dd87f9-0372-4c43-9d6a-5f64061790f3 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:56.385221 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e5dd87f9-0372-4c43-9d6a-5f64061790f3 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:56.386235 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e5dd87f9-0372-4c43-9d6a-5f64061790f3 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:56.386803 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e5dd87f9-0372-4c43-9d6a-5f64061790f3 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:56.388102 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e5dd87f9-0372-4c43-9d6a-5f64061790f3 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:56.407009 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-170b1556-3dbe-445f-b75c-8bf05c75dc4d tempest-MigrationsAdminTest-62329235 tempest-MigrationsAdminTest-62329235-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:06:56.413410 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-170b1556-3dbe-445f-b75c-8bf05c75dc4d tempest-MigrationsAdminTest-62329235 tempest-MigrationsAdminTest-62329235-project-admin] [instance: 8f165110-0ea6-48c0-8357-ba419171f7af] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:56.444963 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-170b1556-3dbe-445f-b75c-8bf05c75dc4d tempest-MigrationsAdminTest-62329235 tempest-MigrationsAdminTest-62329235-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:56.457497 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-170b1556-3dbe-445f-b75c-8bf05c75dc4d tempest-MigrationsAdminTest-62329235 tempest-MigrationsAdminTest-62329235-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:56.460645 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-170b1556-3dbe-445f-b75c-8bf05c75dc4d tempest-MigrationsAdminTest-62329235 tempest-MigrationsAdminTest-62329235-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:56.461505 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-170b1556-3dbe-445f-b75c-8bf05c75dc4d tempest-MigrationsAdminTest-62329235 tempest-MigrationsAdminTest-62329235-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:56.462006 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-170b1556-3dbe-445f-b75c-8bf05c75dc4d tempest-MigrationsAdminTest-62329235 tempest-MigrationsAdminTest-62329235-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:56.462383 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-170b1556-3dbe-445f-b75c-8bf05c75dc4d tempest-MigrationsAdminTest-62329235 tempest-MigrationsAdminTest-62329235-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:56.572694 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-170b1556-3dbe-445f-b75c-8bf05c75dc4d tempest-MigrationsAdminTest-62329235 tempest-MigrationsAdminTest-62329235-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'dc86cb60a19744a9b7124dff4e1f025b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7fba32c4f24ac5ab8c5ce5fc340022', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:56.574153 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-170b1556-3dbe-445f-b75c-8bf05c75dc4d tempest-MigrationsAdminTest-62329235 tempest-MigrationsAdminTest-62329235-project-admin] [instance: 8f165110-0ea6-48c0-8357-ba419171f7af] flavor_id is None. Assuming migration. {{(pid=122256) resize /opt/stack/nova/nova/compute/api.py:4194}} Aug 31 16:06:56.575062 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-170b1556-3dbe-445f-b75c-8bf05c75dc4d tempest-MigrationsAdminTest-62329235 tempest-MigrationsAdminTest-62329235-project-admin] [instance: 8f165110-0ea6-48c0-8357-ba419171f7af] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122256) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 31 16:06:56.691171 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e5dd87f9-0372-4c43-9d6a-5f64061790f3 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:56.729222 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e5dd87f9-0372-4c43-9d6a-5f64061790f3 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:56.733058 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e5dd87f9-0372-4c43-9d6a-5f64061790f3 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:56.738601 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e5dd87f9-0372-4c43-9d6a-5f64061790f3 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] 10.222.0.61 "GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae" status: 200 len: 1875 microversion: 2.42 time: 0.370177 Aug 31 16:06:56.740265 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1323/2640] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:06:56 2022] GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae => generated 1875 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:06:56.748607 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-57976293-3fce-4902-958b-7ae9ead0fbab tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:56.749609 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-57976293-3fce-4902-958b-7ae9ead0fbab tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: db1ac026-e512-4e5f-839d-4056cec509b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:56.759402 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-57976293-3fce-4902-958b-7ae9ead0fbab tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:56.761755 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-57976293-3fce-4902-958b-7ae9ead0fbab tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:56.762854 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-57976293-3fce-4902-958b-7ae9ead0fbab tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:56.764736 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-57976293-3fce-4902-958b-7ae9ead0fbab tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:56.765828 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-57976293-3fce-4902-958b-7ae9ead0fbab tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:56.766845 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-57976293-3fce-4902-958b-7ae9ead0fbab tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:57.043532 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-57976293-3fce-4902-958b-7ae9ead0fbab tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:57.054922 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-57976293-3fce-4902-958b-7ae9ead0fbab tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/db1ac026-e512-4e5f-839d-4056cec509b3" status: 200 len: 1507 microversion: 2.1 time: 0.312795 Aug 31 16:06:57.058859 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-170b1556-3dbe-445f-b75c-8bf05c75dc4d tempest-MigrationsAdminTest-62329235 tempest-MigrationsAdminTest-62329235-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/8f165110-0ea6-48c0-8357-ba419171f7af/action" status: 202 len: 0 microversion: 2.1 time: 0.669772 Aug 31 16:06:57.060467 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1318/2641] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:06:56 2022] POST /compute/v2.1/servers/8f165110-0ea6-48c0-8357-ba419171f7af/action => generated 0 bytes in 673 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:06:57.066834 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2ccbdf12-9b3e-47b5-ae85-12d57932e890 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '.version_select at 0x7f5ae8cf8f70>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:57.098655 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1324/2642] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:56 2022] GET /compute/v2.1/servers/db1ac026-e512-4e5f-839d-4056cec509b3 => generated 1507 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:57.124790 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a01c0d93-a8d5-4498-b2e9-898f7924d4b8 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:57.125815 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a01c0d93-a8d5-4498-b2e9-898f7924d4b8 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 8f165110-0ea6-48c0-8357-ba419171f7af] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:57.154560 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a01c0d93-a8d5-4498-b2e9-898f7924d4b8 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:57.155473 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a01c0d93-a8d5-4498-b2e9-898f7924d4b8 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:57.156008 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a01c0d93-a8d5-4498-b2e9-898f7924d4b8 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:57.156954 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a01c0d93-a8d5-4498-b2e9-898f7924d4b8 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:57.157487 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a01c0d93-a8d5-4498-b2e9-898f7924d4b8 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:57.158099 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a01c0d93-a8d5-4498-b2e9-898f7924d4b8 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:57.162785 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2ccbdf12-9b3e-47b5-ae85-12d57932e890 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "GET /compute/v2.1/images/03df45dd-ab3d-44b8-97f9-0f9148109666" status: 200 len: 1452 microversion: 2.1 time: 0.100500 Aug 31 16:06:57.176541 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1319/2643] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:06:57 2022] GET /compute/v2.1/images/03df45dd-ab3d-44b8-97f9-0f9148109666 => generated 1452 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:57.408443 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-efd5d23d-beff-4f60-a190-740508a98668 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:57.412858 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-efd5d23d-beff-4f60-a190-740508a98668 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] [instance: 5709d363-0934-4d14-a734-35a54bdc03d0] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:57.434846 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-efd5d23d-beff-4f60-a190-740508a98668 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:57.440385 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-efd5d23d-beff-4f60-a190-740508a98668 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:57.449757 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-efd5d23d-beff-4f60-a190-740508a98668 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:57.457105 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-efd5d23d-beff-4f60-a190-740508a98668 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:57.458348 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-efd5d23d-beff-4f60-a190-740508a98668 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:57.459410 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-efd5d23d-beff-4f60-a190-740508a98668 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:57.807872 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a01c0d93-a8d5-4498-b2e9-898f7924d4b8 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:57.833121 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a01c0d93-a8d5-4498-b2e9-898f7924d4b8 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/8f165110-0ea6-48c0-8357-ba419171f7af" status: 200 len: 1471 microversion: 2.1 time: 0.731407 Aug 31 16:06:57.835021 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1325/2644] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:57 2022] GET /compute/v2.1/servers/8f165110-0ea6-48c0-8357-ba419171f7af => generated 1471 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:57.851832 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e595b53a-bd0d-4ced-b297-c176c1e5e564 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:57.855655 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e595b53a-bd0d-4ced-b297-c176c1e5e564 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] [instance: 685d47e4-721e-4eae-b5f8-78fdb68454ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:57.871159 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e595b53a-bd0d-4ced-b297-c176c1e5e564 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:57.872159 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e595b53a-bd0d-4ced-b297-c176c1e5e564 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:57.873150 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e595b53a-bd0d-4ced-b297-c176c1e5e564 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:57.874823 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e595b53a-bd0d-4ced-b297-c176c1e5e564 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:57.875952 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e595b53a-bd0d-4ced-b297-c176c1e5e564 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:57.877046 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e595b53a-bd0d-4ced-b297-c176c1e5e564 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:58.039885 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-efd5d23d-beff-4f60-a190-740508a98668 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb6a27e336449738f68a88d870ca6e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f79872256b2647d6a01c9e753b93b3c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:58.058418 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-efd5d23d-beff-4f60-a190-740508a98668 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] 10.222.0.61 "GET /compute/v2.1/servers/5709d363-0934-4d14-a734-35a54bdc03d0" status: 200 len: 1318 microversion: 2.1 time: 0.661706 Aug 31 16:06:58.067679 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1320/2645] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:57 2022] GET /compute/v2.1/servers/5709d363-0934-4d14-a734-35a54bdc03d0 => generated 1318 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:58.111718 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e5c69d2c-7ead-410f-aed7-792b3cfd729a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:58.114028 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e5c69d2c-7ead-410f-aed7-792b3cfd729a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: db1ac026-e512-4e5f-839d-4056cec509b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:58.150366 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e5c69d2c-7ead-410f-aed7-792b3cfd729a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:58.151772 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e5c69d2c-7ead-410f-aed7-792b3cfd729a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:58.152824 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e5c69d2c-7ead-410f-aed7-792b3cfd729a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:58.154220 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e5c69d2c-7ead-410f-aed7-792b3cfd729a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:58.155092 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e5c69d2c-7ead-410f-aed7-792b3cfd729a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:58.155761 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e5c69d2c-7ead-410f-aed7-792b3cfd729a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:58.449161 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e595b53a-bd0d-4ced-b297-c176c1e5e564 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:58.483754 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e595b53a-bd0d-4ced-b297-c176c1e5e564 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:58.486913 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e595b53a-bd0d-4ced-b297-c176c1e5e564 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:58.488429 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e595b53a-bd0d-4ced-b297-c176c1e5e564 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] 10.222.0.61 "GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae" status: 200 len: 1875 microversion: 2.42 time: 0.652031 Aug 31 16:06:58.489959 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1326/2646] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:06:57 2022] GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae => generated 1875 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:06:58.498759 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-363a180b-f619-4ae3-8945-219f795be4c7 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '.version_select at 0x7f5ae84af1f0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:58.567712 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e5c69d2c-7ead-410f-aed7-792b3cfd729a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:58.583765 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-363a180b-f619-4ae3-8945-219f795be4c7 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "GET /compute/v2.1/images/03df45dd-ab3d-44b8-97f9-0f9148109666" status: 200 len: 1452 microversion: 2.1 time: 0.091672 Aug 31 16:06:58.584803 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e5c69d2c-7ead-410f-aed7-792b3cfd729a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/db1ac026-e512-4e5f-839d-4056cec509b3" status: 200 len: 1507 microversion: 2.1 time: 0.481758 Aug 31 16:06:58.585223 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1327/2647] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:06:58 2022] GET /compute/v2.1/images/03df45dd-ab3d-44b8-97f9-0f9148109666 => generated 1452 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:58.608165 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1321/2648] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:58 2022] GET /compute/v2.1/servers/db1ac026-e512-4e5f-839d-4056cec509b3 => generated 1507 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:58.873040 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-efb15197-76db-40b0-b3fa-e4d957a3b1d5 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:58.877261 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-efb15197-76db-40b0-b3fa-e4d957a3b1d5 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 8f165110-0ea6-48c0-8357-ba419171f7af] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:58.897981 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-efb15197-76db-40b0-b3fa-e4d957a3b1d5 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:58.900348 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-efb15197-76db-40b0-b3fa-e4d957a3b1d5 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:58.902483 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-efb15197-76db-40b0-b3fa-e4d957a3b1d5 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:58.904462 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-efb15197-76db-40b0-b3fa-e4d957a3b1d5 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:58.907061 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-efb15197-76db-40b0-b3fa-e4d957a3b1d5 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:58.908197 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-efb15197-76db-40b0-b3fa-e4d957a3b1d5 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:59.081065 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c5bb4fb2-4c0d-4d63-a150-61819183aa09 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:59.082024 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c5bb4fb2-4c0d-4d63-a150-61819183aa09 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] [instance: 5709d363-0934-4d14-a734-35a54bdc03d0] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:59.090769 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c5bb4fb2-4c0d-4d63-a150-61819183aa09 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:59.091577 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c5bb4fb2-4c0d-4d63-a150-61819183aa09 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:59.092386 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c5bb4fb2-4c0d-4d63-a150-61819183aa09 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:59.093257 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c5bb4fb2-4c0d-4d63-a150-61819183aa09 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:59.093997 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c5bb4fb2-4c0d-4d63-a150-61819183aa09 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:59.094574 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c5bb4fb2-4c0d-4d63-a150-61819183aa09 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:59.268439 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-efb15197-76db-40b0-b3fa-e4d957a3b1d5 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:59.281921 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-efb15197-76db-40b0-b3fa-e4d957a3b1d5 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/8f165110-0ea6-48c0-8357-ba419171f7af" status: 200 len: 1471 microversion: 2.1 time: 0.416924 Aug 31 16:06:59.284024 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1328/2649] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:58 2022] GET /compute/v2.1/servers/8f165110-0ea6-48c0-8357-ba419171f7af => generated 1471 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:59.395991 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c5bb4fb2-4c0d-4d63-a150-61819183aa09 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb6a27e336449738f68a88d870ca6e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f79872256b2647d6a01c9e753b93b3c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:59.414740 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c5bb4fb2-4c0d-4d63-a150-61819183aa09 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] 10.222.0.61 "GET /compute/v2.1/servers/5709d363-0934-4d14-a734-35a54bdc03d0" status: 200 len: 1318 microversion: 2.1 time: 0.337747 Aug 31 16:06:59.418157 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1322/2650] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:59 2022] GET /compute/v2.1/servers/5709d363-0934-4d14-a734-35a54bdc03d0 => generated 1318 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:59.535557 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6c5bef07-77e7-4db5-8316-7e94d04bf226 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:59.536921 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6c5bef07-77e7-4db5-8316-7e94d04bf226 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] [instance: 685d47e4-721e-4eae-b5f8-78fdb68454ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:59.546435 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6c5bef07-77e7-4db5-8316-7e94d04bf226 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:59.547243 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6c5bef07-77e7-4db5-8316-7e94d04bf226 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:59.548841 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6c5bef07-77e7-4db5-8316-7e94d04bf226 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:59.549814 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6c5bef07-77e7-4db5-8316-7e94d04bf226 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:59.550868 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6c5bef07-77e7-4db5-8316-7e94d04bf226 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:59.551869 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6c5bef07-77e7-4db5-8316-7e94d04bf226 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:59.579612 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=100 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:06:59.607375 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-46522746-7953-4d52-8608-2aa14151d63d tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '.version_select at 0x7f5ae8553700>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:59.671269 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-46522746-7953-4d52-8608-2aa14151d63d tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "GET /compute/v2.1/images/03df45dd-ab3d-44b8-97f9-0f9148109666" status: 200 len: 1452 microversion: 2.1 time: 0.068006 Aug 31 16:06:59.680277 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1323/2651] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:06:59 2022] GET /compute/v2.1/images/03df45dd-ab3d-44b8-97f9-0f9148109666 => generated 1452 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:06:59.688630 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-65c23cb4-d1ba-4c69-b74f-ed5be887cca1 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:59.689264 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-65c23cb4-d1ba-4c69-b74f-ed5be887cca1 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: db1ac026-e512-4e5f-839d-4056cec509b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:59.696984 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-65c23cb4-d1ba-4c69-b74f-ed5be887cca1 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:59.698013 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-65c23cb4-d1ba-4c69-b74f-ed5be887cca1 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:59.698981 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-65c23cb4-d1ba-4c69-b74f-ed5be887cca1 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:59.700194 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-65c23cb4-d1ba-4c69-b74f-ed5be887cca1 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:59.701040 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-65c23cb4-d1ba-4c69-b74f-ed5be887cca1 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:59.701665 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-65c23cb4-d1ba-4c69-b74f-ed5be887cca1 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:00.011139 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-6c5bef07-77e7-4db5-8316-7e94d04bf226 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:00.023235 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-6c5bef07-77e7-4db5-8316-7e94d04bf226 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:00.026710 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-6c5bef07-77e7-4db5-8316-7e94d04bf226 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:00.029575 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6c5bef07-77e7-4db5-8316-7e94d04bf226 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] 10.222.0.61 "GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae" status: 200 len: 1875 microversion: 2.42 time: 0.499923 Aug 31 16:07:00.031438 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1329/2652] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:06:59 2022] GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae => generated 1875 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:07:00.259325 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-65c23cb4-d1ba-4c69-b74f-ed5be887cca1 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:00.279240 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-65c23cb4-d1ba-4c69-b74f-ed5be887cca1 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/db1ac026-e512-4e5f-839d-4056cec509b3" status: 200 len: 1507 microversion: 2.1 time: 0.597094 Aug 31 16:07:00.280658 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1324/2653] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:59 2022] GET /compute/v2.1/servers/db1ac026-e512-4e5f-839d-4056cec509b3 => generated 1507 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:00.318291 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-cf401bad-f2ed-4c49-b8e4-ebbd7f8fa6ba tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:00.319148 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-cf401bad-f2ed-4c49-b8e4-ebbd7f8fa6ba tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 8f165110-0ea6-48c0-8357-ba419171f7af] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:00.328975 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cf401bad-f2ed-4c49-b8e4-ebbd7f8fa6ba tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:00.329824 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cf401bad-f2ed-4c49-b8e4-ebbd7f8fa6ba tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:00.330610 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cf401bad-f2ed-4c49-b8e4-ebbd7f8fa6ba tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:00.331796 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cf401bad-f2ed-4c49-b8e4-ebbd7f8fa6ba tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:00.332737 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cf401bad-f2ed-4c49-b8e4-ebbd7f8fa6ba tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:00.333888 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cf401bad-f2ed-4c49-b8e4-ebbd7f8fa6ba tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:00.440453 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8fcaf702-8094-4a8b-9bee-60c9d7535a5f tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:00.441542 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8fcaf702-8094-4a8b-9bee-60c9d7535a5f tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] [instance: 5709d363-0934-4d14-a734-35a54bdc03d0] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:00.449824 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8fcaf702-8094-4a8b-9bee-60c9d7535a5f tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:00.450597 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8fcaf702-8094-4a8b-9bee-60c9d7535a5f tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:00.451206 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8fcaf702-8094-4a8b-9bee-60c9d7535a5f tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:00.452222 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8fcaf702-8094-4a8b-9bee-60c9d7535a5f tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:00.452832 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8fcaf702-8094-4a8b-9bee-60c9d7535a5f tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:00.454070 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8fcaf702-8094-4a8b-9bee-60c9d7535a5f tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:00.655682 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-cf401bad-f2ed-4c49-b8e4-ebbd7f8fa6ba tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:00.666224 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-cf401bad-f2ed-4c49-b8e4-ebbd7f8fa6ba tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/8f165110-0ea6-48c0-8357-ba419171f7af" status: 200 len: 1471 microversion: 2.1 time: 0.352214 Aug 31 16:07:00.690844 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1330/2654] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:00 2022] GET /compute/v2.1/servers/8f165110-0ea6-48c0-8357-ba419171f7af => generated 1471 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:00.701093 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-45ab07dc-8b83-4745-9d5b-e59fc8a0d4f4 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '.version_select at 0x7f5ae84194c0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:00.789871 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-45ab07dc-8b83-4745-9d5b-e59fc8a0d4f4 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "GET /compute/v2.1/images/03df45dd-ab3d-44b8-97f9-0f9148109666" status: 200 len: 1452 microversion: 2.1 time: 0.095361 Aug 31 16:07:00.792285 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1331/2655] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:07:00 2022] GET /compute/v2.1/images/03df45dd-ab3d-44b8-97f9-0f9148109666 => generated 1452 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:00.892906 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8fcaf702-8094-4a8b-9bee-60c9d7535a5f tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb6a27e336449738f68a88d870ca6e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f79872256b2647d6a01c9e753b93b3c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:00.929639 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8fcaf702-8094-4a8b-9bee-60c9d7535a5f tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] 10.222.0.61 "GET /compute/v2.1/servers/5709d363-0934-4d14-a734-35a54bdc03d0" status: 200 len: 1318 microversion: 2.1 time: 0.493213 Aug 31 16:07:00.931724 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1325/2656] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:00 2022] GET /compute/v2.1/servers/5709d363-0934-4d14-a734-35a54bdc03d0 => generated 1318 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:01.062805 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f6dd6ee7-014c-4138-b745-3d7269fa528e tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:01.063582 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f6dd6ee7-014c-4138-b745-3d7269fa528e tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] [instance: 685d47e4-721e-4eae-b5f8-78fdb68454ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:01.079036 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f6dd6ee7-014c-4138-b745-3d7269fa528e tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:01.080223 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f6dd6ee7-014c-4138-b745-3d7269fa528e tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:01.081118 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f6dd6ee7-014c-4138-b745-3d7269fa528e tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:01.083058 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f6dd6ee7-014c-4138-b745-3d7269fa528e tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:01.083940 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f6dd6ee7-014c-4138-b745-3d7269fa528e tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:01.085191 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f6dd6ee7-014c-4138-b745-3d7269fa528e tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:01.305592 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d3de102e-33f5-4d5e-84f4-e2766ebd83ee tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:01.306645 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d3de102e-33f5-4d5e-84f4-e2766ebd83ee tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: db1ac026-e512-4e5f-839d-4056cec509b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:01.319281 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d3de102e-33f5-4d5e-84f4-e2766ebd83ee tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:01.320184 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d3de102e-33f5-4d5e-84f4-e2766ebd83ee tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:01.321052 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d3de102e-33f5-4d5e-84f4-e2766ebd83ee tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:01.322045 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d3de102e-33f5-4d5e-84f4-e2766ebd83ee tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:01.322777 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d3de102e-33f5-4d5e-84f4-e2766ebd83ee tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:01.324443 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d3de102e-33f5-4d5e-84f4-e2766ebd83ee tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:01.579881 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f6dd6ee7-014c-4138-b745-3d7269fa528e tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:01.598076 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f6dd6ee7-014c-4138-b745-3d7269fa528e tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:01.599512 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f6dd6ee7-014c-4138-b745-3d7269fa528e tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:01.600746 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f6dd6ee7-014c-4138-b745-3d7269fa528e tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] 10.222.0.61 "GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae" status: 200 len: 1875 microversion: 2.42 time: 0.543799 Aug 31 16:07:01.616018 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1332/2657] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:07:01 2022] GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae => generated 1875 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:07:01.689908 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5eda9bc4-9bc8-4f62-a123-c9a907ae6674 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:01.690524 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5eda9bc4-9bc8-4f62-a123-c9a907ae6674 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 8f165110-0ea6-48c0-8357-ba419171f7af] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:01.703223 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5eda9bc4-9bc8-4f62-a123-c9a907ae6674 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:01.708297 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5eda9bc4-9bc8-4f62-a123-c9a907ae6674 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:01.708945 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5eda9bc4-9bc8-4f62-a123-c9a907ae6674 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:01.709856 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5eda9bc4-9bc8-4f62-a123-c9a907ae6674 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:01.710487 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5eda9bc4-9bc8-4f62-a123-c9a907ae6674 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:01.711081 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5eda9bc4-9bc8-4f62-a123-c9a907ae6674 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:01.783524 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d3de102e-33f5-4d5e-84f4-e2766ebd83ee tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:01.799772 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d3de102e-33f5-4d5e-84f4-e2766ebd83ee tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/db1ac026-e512-4e5f-839d-4056cec509b3" status: 200 len: 1507 microversion: 2.1 time: 0.497517 Aug 31 16:07:01.821970 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1326/2658] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:01 2022] GET /compute/v2.1/servers/db1ac026-e512-4e5f-839d-4056cec509b3 => generated 1507 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:01.840465 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-cf07ab8d-5c96-4bb6-8d5b-cb11c25fa69a tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '.version_select at 0x7f5ae85531f0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:01.970866 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-cf07ab8d-5c96-4bb6-8d5b-cb11c25fa69a tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "GET /compute/v2.1/images/03df45dd-ab3d-44b8-97f9-0f9148109666" status: 200 len: 1452 microversion: 2.1 time: 0.147664 Aug 31 16:07:01.972396 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1327/2659] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:07:01 2022] GET /compute/v2.1/images/03df45dd-ab3d-44b8-97f9-0f9148109666 => generated 1452 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:01.987016 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5fabb2d7-2cdf-4c0c-9f2a-2ad8546b90a5 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:01.989767 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5fabb2d7-2cdf-4c0c-9f2a-2ad8546b90a5 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] [instance: 5709d363-0934-4d14-a734-35a54bdc03d0] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:02.003108 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5fabb2d7-2cdf-4c0c-9f2a-2ad8546b90a5 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:02.003643 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5fabb2d7-2cdf-4c0c-9f2a-2ad8546b90a5 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:02.004252 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5fabb2d7-2cdf-4c0c-9f2a-2ad8546b90a5 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:02.005131 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5fabb2d7-2cdf-4c0c-9f2a-2ad8546b90a5 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:02.005763 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5fabb2d7-2cdf-4c0c-9f2a-2ad8546b90a5 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:02.006354 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5fabb2d7-2cdf-4c0c-9f2a-2ad8546b90a5 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:02.148750 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5eda9bc4-9bc8-4f62-a123-c9a907ae6674 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:02.163356 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5eda9bc4-9bc8-4f62-a123-c9a907ae6674 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/8f165110-0ea6-48c0-8357-ba419171f7af" status: 200 len: 1471 microversion: 2.1 time: 0.477192 Aug 31 16:07:02.164462 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1333/2660] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:01 2022] GET /compute/v2.1/servers/8f165110-0ea6-48c0-8357-ba419171f7af => generated 1471 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:07:02.375695 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5fabb2d7-2cdf-4c0c-9f2a-2ad8546b90a5 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb6a27e336449738f68a88d870ca6e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f79872256b2647d6a01c9e753b93b3c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:02.404218 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5fabb2d7-2cdf-4c0c-9f2a-2ad8546b90a5 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] 10.222.0.61 "GET /compute/v2.1/servers/5709d363-0934-4d14-a734-35a54bdc03d0" status: 200 len: 1318 microversion: 2.1 time: 0.427540 Aug 31 16:07:02.407607 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1328/2661] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:01 2022] GET /compute/v2.1/servers/5709d363-0934-4d14-a734-35a54bdc03d0 => generated 1318 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:02.630113 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9e401b63-ea6b-45d5-9c92-29c51166b61c tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:02.631287 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9e401b63-ea6b-45d5-9c92-29c51166b61c tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] [instance: 685d47e4-721e-4eae-b5f8-78fdb68454ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:02.644860 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9e401b63-ea6b-45d5-9c92-29c51166b61c tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:02.645746 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9e401b63-ea6b-45d5-9c92-29c51166b61c tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:02.646530 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9e401b63-ea6b-45d5-9c92-29c51166b61c tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:02.647980 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9e401b63-ea6b-45d5-9c92-29c51166b61c tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:02.649322 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9e401b63-ea6b-45d5-9c92-29c51166b61c tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:02.649443 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9e401b63-ea6b-45d5-9c92-29c51166b61c tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:02.834920 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-787e6be4-425b-40a2-96e2-06f109e37918 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:02.836848 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-787e6be4-425b-40a2-96e2-06f109e37918 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: db1ac026-e512-4e5f-839d-4056cec509b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:02.849091 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-787e6be4-425b-40a2-96e2-06f109e37918 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:02.850471 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-787e6be4-425b-40a2-96e2-06f109e37918 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:02.852909 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-787e6be4-425b-40a2-96e2-06f109e37918 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:02.855036 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-787e6be4-425b-40a2-96e2-06f109e37918 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:02.857048 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-787e6be4-425b-40a2-96e2-06f109e37918 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:02.858376 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-787e6be4-425b-40a2-96e2-06f109e37918 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:03.435615 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-787e6be4-425b-40a2-96e2-06f109e37918 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:03.448418 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:07:03.452998 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-787e6be4-425b-40a2-96e2-06f109e37918 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/db1ac026-e512-4e5f-839d-4056cec509b3" status: 200 len: 1507 microversion: 2.1 time: 0.626282 Aug 31 16:07:03.454477 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1329/2662] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:02 2022] GET /compute/v2.1/servers/db1ac026-e512-4e5f-839d-4056cec509b3 => generated 1507 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:03.469553 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ee1feae3-bbed-4a9b-aa5b-3d7f273fb1a4 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '.version_select at 0x7f5ae8667d30>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:03.509346 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9e401b63-ea6b-45d5-9c92-29c51166b61c tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:03.534176 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9e401b63-ea6b-45d5-9c92-29c51166b61c tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:03.549012 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9e401b63-ea6b-45d5-9c92-29c51166b61c tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:03.556088 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9e401b63-ea6b-45d5-9c92-29c51166b61c tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] 10.222.0.61 "GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae" status: 200 len: 1875 microversion: 2.42 time: 0.929577 Aug 31 16:07:03.557434 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1334/2663] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:07:02 2022] GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae => generated 1875 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:07:03.584484 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a832b8b0-cdee-4a91-8c06-07ec2ebc101a tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:03.588434 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a832b8b0-cdee-4a91-8c06-07ec2ebc101a tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 8f165110-0ea6-48c0-8357-ba419171f7af] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:03.596704 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ee1feae3-bbed-4a9b-aa5b-3d7f273fb1a4 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "GET /compute/v2.1/images/03df45dd-ab3d-44b8-97f9-0f9148109666" status: 200 len: 1452 microversion: 2.1 time: 0.140889 Aug 31 16:07:03.606104 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1330/2664] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:07:03 2022] GET /compute/v2.1/images/03df45dd-ab3d-44b8-97f9-0f9148109666 => generated 1452 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:03.611712 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-935569ca-0239-4b26-bd74-331f0f09a172 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:03.612831 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-935569ca-0239-4b26-bd74-331f0f09a172 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] [instance: 5709d363-0934-4d14-a734-35a54bdc03d0] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:03.614067 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a832b8b0-cdee-4a91-8c06-07ec2ebc101a tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:03.614689 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a832b8b0-cdee-4a91-8c06-07ec2ebc101a tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:03.622025 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-935569ca-0239-4b26-bd74-331f0f09a172 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:03.622776 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-935569ca-0239-4b26-bd74-331f0f09a172 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:03.624234 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a832b8b0-cdee-4a91-8c06-07ec2ebc101a tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:03.624455 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-935569ca-0239-4b26-bd74-331f0f09a172 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:03.625378 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-935569ca-0239-4b26-bd74-331f0f09a172 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:03.625520 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a832b8b0-cdee-4a91-8c06-07ec2ebc101a tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:03.626324 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a832b8b0-cdee-4a91-8c06-07ec2ebc101a tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:03.626528 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-935569ca-0239-4b26-bd74-331f0f09a172 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:03.626782 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a832b8b0-cdee-4a91-8c06-07ec2ebc101a tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:03.627122 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-935569ca-0239-4b26-bd74-331f0f09a172 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:04.500953 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-935569ca-0239-4b26-bd74-331f0f09a172 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb6a27e336449738f68a88d870ca6e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f79872256b2647d6a01c9e753b93b3c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:04.527423 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-935569ca-0239-4b26-bd74-331f0f09a172 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] 10.222.0.61 "GET /compute/v2.1/servers/5709d363-0934-4d14-a734-35a54bdc03d0" status: 200 len: 1318 microversion: 2.1 time: 0.918564 Aug 31 16:07:04.528869 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1331/2665] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:03 2022] GET /compute/v2.1/servers/5709d363-0934-4d14-a734-35a54bdc03d0 => generated 1318 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:04.542209 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-69b001f2-4acd-486f-9258-6b42df57a669 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:04.550320 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a832b8b0-cdee-4a91-8c06-07ec2ebc101a tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:04.552736 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-69b001f2-4acd-486f-9258-6b42df57a669 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: db1ac026-e512-4e5f-839d-4056cec509b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:04.591645 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a832b8b0-cdee-4a91-8c06-07ec2ebc101a tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/8f165110-0ea6-48c0-8357-ba419171f7af" status: 200 len: 1471 microversion: 2.1 time: 1.024553 Aug 31 16:07:04.592321 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-69b001f2-4acd-486f-9258-6b42df57a669 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:04.592696 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1335/2666] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:03 2022] GET /compute/v2.1/servers/8f165110-0ea6-48c0-8357-ba419171f7af => generated 1471 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:04.595548 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-69b001f2-4acd-486f-9258-6b42df57a669 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:04.598681 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-69b001f2-4acd-486f-9258-6b42df57a669 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:04.603072 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-69b001f2-4acd-486f-9258-6b42df57a669 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:04.615240 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-69b001f2-4acd-486f-9258-6b42df57a669 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:04.616563 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-69b001f2-4acd-486f-9258-6b42df57a669 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:04.621734 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-cbe07345-e584-4c19-b8d7-1a4c9a0566a6 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:04.622376 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-cbe07345-e584-4c19-b8d7-1a4c9a0566a6 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] [instance: 685d47e4-721e-4eae-b5f8-78fdb68454ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:04.663531 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cbe07345-e584-4c19-b8d7-1a4c9a0566a6 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:04.664426 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cbe07345-e584-4c19-b8d7-1a4c9a0566a6 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:04.669962 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cbe07345-e584-4c19-b8d7-1a4c9a0566a6 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:04.671182 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cbe07345-e584-4c19-b8d7-1a4c9a0566a6 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:04.672600 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cbe07345-e584-4c19-b8d7-1a4c9a0566a6 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:04.673402 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cbe07345-e584-4c19-b8d7-1a4c9a0566a6 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:05.829709 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-69b001f2-4acd-486f-9258-6b42df57a669 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:05.859289 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-69b001f2-4acd-486f-9258-6b42df57a669 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/db1ac026-e512-4e5f-839d-4056cec509b3" status: 200 len: 1507 microversion: 2.1 time: 1.325183 Aug 31 16:07:05.861200 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1332/2667] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:04 2022] GET /compute/v2.1/servers/db1ac026-e512-4e5f-839d-4056cec509b3 => generated 1507 bytes in 1331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:05.878074 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8d9fb87d-3e6f-4648-8b08-3f1e1ae2fa51 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '.version_select at 0x7f5ae9007a60>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:06.012854 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8d9fb87d-3e6f-4648-8b08-3f1e1ae2fa51 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "GET /compute/v2.1/images/03df45dd-ab3d-44b8-97f9-0f9148109666" status: 200 len: 1452 microversion: 2.1 time: 0.120452 Aug 31 16:07:06.016059 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1333/2668] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:07:05 2022] GET /compute/v2.1/images/03df45dd-ab3d-44b8-97f9-0f9148109666 => generated 1452 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:06.031187 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-8e9b54f5-3b86-40de-944a-ee6fdf248edf req-a42750a9-f53b-4e36-a178-125d83063dd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5709d363-0934-4d14-a734-35a54bdc03d0", "name": "network-vif-plugged", "status": "completed", "tag": "a0a375b6-a9e9-4b0f-94cf-3a5beea5090c"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:07:06.056311 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-8e9b54f5-3b86-40de-944a-ee6fdf248edf req-a42750a9-f53b-4e36-a178-125d83063dd1 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:06.057537 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-8e9b54f5-3b86-40de-944a-ee6fdf248edf req-a42750a9-f53b-4e36-a178-125d83063dd1 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:06.058573 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-8e9b54f5-3b86-40de-944a-ee6fdf248edf req-a42750a9-f53b-4e36-a178-125d83063dd1 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:06.081945 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-8e9b54f5-3b86-40de-944a-ee6fdf248edf req-a42750a9-f53b-4e36-a178-125d83063dd1 service nova] Creating event network-vif-plugged:a0a375b6-a9e9-4b0f-94cf-3a5beea5090c for instance 5709d363-0934-4d14-a734-35a54bdc03d0 on n-h2-850499-9 Aug 31 16:07:06.088008 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-8e9b54f5-3b86-40de-944a-ee6fdf248edf req-a42750a9-f53b-4e36-a178-125d83063dd1 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070184 Aug 31 16:07:06.090099 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1334/2669] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:07:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:07:06.106842 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0a6cc7dd-b34e-41df-9591-0715e1d79e2a tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:06.107927 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0a6cc7dd-b34e-41df-9591-0715e1d79e2a tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] [instance: 5709d363-0934-4d14-a734-35a54bdc03d0] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:06.126844 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0a6cc7dd-b34e-41df-9591-0715e1d79e2a tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:06.132956 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0a6cc7dd-b34e-41df-9591-0715e1d79e2a tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:06.136038 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0a6cc7dd-b34e-41df-9591-0715e1d79e2a tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:06.142559 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0a6cc7dd-b34e-41df-9591-0715e1d79e2a tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:06.144411 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0a6cc7dd-b34e-41df-9591-0715e1d79e2a tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:06.149830 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0a6cc7dd-b34e-41df-9591-0715e1d79e2a tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:06.253811 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-cbe07345-e584-4c19-b8d7-1a4c9a0566a6 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:06.293451 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-cbe07345-e584-4c19-b8d7-1a4c9a0566a6 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:06.300520 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-cbe07345-e584-4c19-b8d7-1a4c9a0566a6 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:06.310423 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-cbe07345-e584-4c19-b8d7-1a4c9a0566a6 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] 10.222.0.61 "GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae" status: 200 len: 1875 microversion: 2.42 time: 1.710637 Aug 31 16:07:06.332360 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1336/2670] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:07:04 2022] GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae => generated 1875 bytes in 1739 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:07:06.353208 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3c1f1d14-8e71-4581-86d9-18ff431cb12d tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:06.354605 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3c1f1d14-8e71-4581-86d9-18ff431cb12d tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 8f165110-0ea6-48c0-8357-ba419171f7af] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:06.447525 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3c1f1d14-8e71-4581-86d9-18ff431cb12d tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:06.449432 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3c1f1d14-8e71-4581-86d9-18ff431cb12d tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:06.450856 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3c1f1d14-8e71-4581-86d9-18ff431cb12d tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:06.461891 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3c1f1d14-8e71-4581-86d9-18ff431cb12d tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:06.463027 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3c1f1d14-8e71-4581-86d9-18ff431cb12d tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:06.466674 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3c1f1d14-8e71-4581-86d9-18ff431cb12d tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:06.941552 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-0a6cc7dd-b34e-41df-9591-0715e1d79e2a tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb6a27e336449738f68a88d870ca6e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f79872256b2647d6a01c9e753b93b3c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:06.976907 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0a6cc7dd-b34e-41df-9591-0715e1d79e2a tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] 10.222.0.61 "GET /compute/v2.1/servers/5709d363-0934-4d14-a734-35a54bdc03d0" status: 200 len: 1318 microversion: 2.1 time: 0.885004 Aug 31 16:07:06.978137 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1335/2671] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:06 2022] GET /compute/v2.1/servers/5709d363-0934-4d14-a734-35a54bdc03d0 => generated 1318 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:06.986965 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-34225868-ad27-43a9-831b-80e964bb8306 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:06.998402 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-34225868-ad27-43a9-831b-80e964bb8306 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: db1ac026-e512-4e5f-839d-4056cec509b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:07.031779 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-34225868-ad27-43a9-831b-80e964bb8306 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:07.032856 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-34225868-ad27-43a9-831b-80e964bb8306 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:07.033650 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-34225868-ad27-43a9-831b-80e964bb8306 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:07.035042 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-34225868-ad27-43a9-831b-80e964bb8306 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:07.036390 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-34225868-ad27-43a9-831b-80e964bb8306 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:07.037660 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-34225868-ad27-43a9-831b-80e964bb8306 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:07.451604 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3c1f1d14-8e71-4581-86d9-18ff431cb12d tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:07.469093 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3c1f1d14-8e71-4581-86d9-18ff431cb12d tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/8f165110-0ea6-48c0-8357-ba419171f7af" status: 200 len: 1471 microversion: 2.1 time: 1.135462 Aug 31 16:07:07.491893 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1337/2672] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:06 2022] GET /compute/v2.1/servers/8f165110-0ea6-48c0-8357-ba419171f7af => generated 1471 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:07.507430 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-77901d4e-8fda-4177-abe6-8d959659c388 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '.version_select at 0x7f5aed1c2ca0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:07.596873 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-34225868-ad27-43a9-831b-80e964bb8306 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:07.618435 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-34225868-ad27-43a9-831b-80e964bb8306 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/db1ac026-e512-4e5f-839d-4056cec509b3" status: 200 len: 1507 microversion: 2.1 time: 0.637272 Aug 31 16:07:07.639639 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1336/2673] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:06 2022] GET /compute/v2.1/servers/db1ac026-e512-4e5f-839d-4056cec509b3 => generated 1507 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:07.639966 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-dcd6779b-d567-49d8-aa90-a5e3be75c25b tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:07.640897 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-dcd6779b-d567-49d8-aa90-a5e3be75c25b tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] [instance: 685d47e4-721e-4eae-b5f8-78fdb68454ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:07.648468 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-77901d4e-8fda-4177-abe6-8d959659c388 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "GET /compute/v2.1/images/03df45dd-ab3d-44b8-97f9-0f9148109666" status: 200 len: 1452 microversion: 2.1 time: 0.146482 Aug 31 16:07:07.659767 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1338/2674] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:07:07 2022] GET /compute/v2.1/images/03df45dd-ab3d-44b8-97f9-0f9148109666 => generated 1452 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:07.662454 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dcd6779b-d567-49d8-aa90-a5e3be75c25b tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:07.665803 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dcd6779b-d567-49d8-aa90-a5e3be75c25b tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:07.668404 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dcd6779b-d567-49d8-aa90-a5e3be75c25b tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:07.672362 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dcd6779b-d567-49d8-aa90-a5e3be75c25b tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:07.675058 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dcd6779b-d567-49d8-aa90-a5e3be75c25b tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:07.678990 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dcd6779b-d567-49d8-aa90-a5e3be75c25b tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:08.015743 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ee1398c7-1581-4e55-9797-0e7d7ce9bb94 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:08.017494 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ee1398c7-1581-4e55-9797-0e7d7ce9bb94 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] [instance: 5709d363-0934-4d14-a734-35a54bdc03d0] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:08.056328 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ee1398c7-1581-4e55-9797-0e7d7ce9bb94 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:08.058778 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ee1398c7-1581-4e55-9797-0e7d7ce9bb94 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:08.060790 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ee1398c7-1581-4e55-9797-0e7d7ce9bb94 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:08.065824 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ee1398c7-1581-4e55-9797-0e7d7ce9bb94 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:08.067341 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ee1398c7-1581-4e55-9797-0e7d7ce9bb94 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:08.072212 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ee1398c7-1581-4e55-9797-0e7d7ce9bb94 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:08.519908 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ee1398c7-1581-4e55-9797-0e7d7ce9bb94 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb6a27e336449738f68a88d870ca6e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f79872256b2647d6a01c9e753b93b3c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:08.546109 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ee1398c7-1581-4e55-9797-0e7d7ce9bb94 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] 10.222.0.61 "GET /compute/v2.1/servers/5709d363-0934-4d14-a734-35a54bdc03d0" status: 200 len: 1318 microversion: 2.1 time: 0.537757 Aug 31 16:07:08.548432 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1339/2675] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:08 2022] GET /compute/v2.1/servers/5709d363-0934-4d14-a734-35a54bdc03d0 => generated 1318 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:08.563083 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2636fe7e-88a0-48df-b129-4654c29ed6af tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:08.565780 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2636fe7e-88a0-48df-b129-4654c29ed6af tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 8f165110-0ea6-48c0-8357-ba419171f7af] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:08.584861 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2636fe7e-88a0-48df-b129-4654c29ed6af tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:08.588249 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2636fe7e-88a0-48df-b129-4654c29ed6af tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:08.593262 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2636fe7e-88a0-48df-b129-4654c29ed6af tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:08.594963 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2636fe7e-88a0-48df-b129-4654c29ed6af tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:08.596270 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2636fe7e-88a0-48df-b129-4654c29ed6af tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:08.600641 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2636fe7e-88a0-48df-b129-4654c29ed6af tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:08.966710 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-dcd6779b-d567-49d8-aa90-a5e3be75c25b tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:08.977746 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-dcd6779b-d567-49d8-aa90-a5e3be75c25b tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:08.989085 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-dcd6779b-d567-49d8-aa90-a5e3be75c25b tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:08.995261 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-dcd6779b-d567-49d8-aa90-a5e3be75c25b tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] 10.222.0.61 "GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae" status: 200 len: 1875 microversion: 2.42 time: 1.371444 Aug 31 16:07:09.008900 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1337/2676] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:07:07 2022] GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae => generated 1875 bytes in 1386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:07:09.025499 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e39bca47-d0f7-463c-8b1d-bc650c35649c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:09.027289 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e39bca47-d0f7-463c-8b1d-bc650c35649c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: db1ac026-e512-4e5f-839d-4056cec509b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:09.044932 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e39bca47-d0f7-463c-8b1d-bc650c35649c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:09.048330 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e39bca47-d0f7-463c-8b1d-bc650c35649c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:09.049172 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e39bca47-d0f7-463c-8b1d-bc650c35649c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:09.050213 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e39bca47-d0f7-463c-8b1d-bc650c35649c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:09.052969 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e39bca47-d0f7-463c-8b1d-bc650c35649c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:09.053800 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e39bca47-d0f7-463c-8b1d-bc650c35649c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:09.933106 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2636fe7e-88a0-48df-b129-4654c29ed6af tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:09.948961 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2636fe7e-88a0-48df-b129-4654c29ed6af tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/8f165110-0ea6-48c0-8357-ba419171f7af" status: 200 len: 1476 microversion: 2.1 time: 1.399068 Aug 31 16:07:09.949906 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1340/2677] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:08 2022] GET /compute/v2.1/servers/8f165110-0ea6-48c0-8357-ba419171f7af => generated 1476 bytes in 1401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:09.975474 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-bfd9d9cc-99ea-47dd-bf11-d7bae0197fd6 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '.version_select at 0x7f5ae841de50>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:10.086142 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-bfd9d9cc-99ea-47dd-bf11-d7bae0197fd6 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "GET /compute/v2.1/images/03df45dd-ab3d-44b8-97f9-0f9148109666" status: 200 len: 1452 microversion: 2.1 time: 0.132966 Aug 31 16:07:10.087442 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1341/2678] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:07:09 2022] GET /compute/v2.1/images/03df45dd-ab3d-44b8-97f9-0f9148109666 => generated 1452 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:10.104228 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6e8702e2-43c5-42fe-aa46-dce2923fbbe7 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:10.105874 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6e8702e2-43c5-42fe-aa46-dce2923fbbe7 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] [instance: 5709d363-0934-4d14-a734-35a54bdc03d0] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:10.114156 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6e8702e2-43c5-42fe-aa46-dce2923fbbe7 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:10.115571 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6e8702e2-43c5-42fe-aa46-dce2923fbbe7 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:10.116516 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6e8702e2-43c5-42fe-aa46-dce2923fbbe7 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:10.117991 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6e8702e2-43c5-42fe-aa46-dce2923fbbe7 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:10.118944 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6e8702e2-43c5-42fe-aa46-dce2923fbbe7 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:10.120505 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6e8702e2-43c5-42fe-aa46-dce2923fbbe7 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:10.408985 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e39bca47-d0f7-463c-8b1d-bc650c35649c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:10.434813 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e39bca47-d0f7-463c-8b1d-bc650c35649c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/db1ac026-e512-4e5f-839d-4056cec509b3" status: 200 len: 1507 microversion: 2.1 time: 1.421493 Aug 31 16:07:10.458456 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1338/2679] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:09 2022] GET /compute/v2.1/servers/db1ac026-e512-4e5f-839d-4056cec509b3 => generated 1507 bytes in 1448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:10.466016 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-453bf1a4-4210-4012-a1bd-92149930a794 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:10.472703 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-453bf1a4-4210-4012-a1bd-92149930a794 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] [instance: 685d47e4-721e-4eae-b5f8-78fdb68454ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:10.492212 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-453bf1a4-4210-4012-a1bd-92149930a794 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:10.493036 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-453bf1a4-4210-4012-a1bd-92149930a794 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:10.493741 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-453bf1a4-4210-4012-a1bd-92149930a794 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:10.499124 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-453bf1a4-4210-4012-a1bd-92149930a794 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:10.500256 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-453bf1a4-4210-4012-a1bd-92149930a794 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:10.500902 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-453bf1a4-4210-4012-a1bd-92149930a794 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:11.375925 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-6e8702e2-43c5-42fe-aa46-dce2923fbbe7 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb6a27e336449738f68a88d870ca6e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f79872256b2647d6a01c9e753b93b3c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:11.390469 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6e8702e2-43c5-42fe-aa46-dce2923fbbe7 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] 10.222.0.61 "GET /compute/v2.1/servers/5709d363-0934-4d14-a734-35a54bdc03d0" status: 200 len: 1318 microversion: 2.1 time: 1.291265 Aug 31 16:07:11.390818 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1342/2680] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:10 2022] GET /compute/v2.1/servers/5709d363-0934-4d14-a734-35a54bdc03d0 => generated 1318 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:11.416115 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-453bf1a4-4210-4012-a1bd-92149930a794 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:11.419904 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b312995a-3475-4aec-a001-46c840078a16 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:11.422131 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b312995a-3475-4aec-a001-46c840078a16 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 8f165110-0ea6-48c0-8357-ba419171f7af] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:11.433347 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-453bf1a4-4210-4012-a1bd-92149930a794 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:11.437698 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-453bf1a4-4210-4012-a1bd-92149930a794 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:11.442321 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-453bf1a4-4210-4012-a1bd-92149930a794 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] 10.222.0.61 "GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae" status: 200 len: 1875 microversion: 2.42 time: 0.983131 Aug 31 16:07:11.446419 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1339/2681] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:07:10 2022] GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae => generated 1875 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:07:11.452297 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-26e82494-58a5-4b43-8bf5-c454cd07166e tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '.version_select at 0x7f5aed2c8f70>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:11.485926 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b312995a-3475-4aec-a001-46c840078a16 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:11.493295 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b312995a-3475-4aec-a001-46c840078a16 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:11.497268 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b312995a-3475-4aec-a001-46c840078a16 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:11.498911 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b312995a-3475-4aec-a001-46c840078a16 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:11.500229 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b312995a-3475-4aec-a001-46c840078a16 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:11.501213 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b312995a-3475-4aec-a001-46c840078a16 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:11.568196 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-26e82494-58a5-4b43-8bf5-c454cd07166e tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "GET /compute/v2.1/images/03df45dd-ab3d-44b8-97f9-0f9148109666" status: 200 len: 1452 microversion: 2.1 time: 0.120369 Aug 31 16:07:11.574862 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1340/2682] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:07:11 2022] GET /compute/v2.1/images/03df45dd-ab3d-44b8-97f9-0f9148109666 => generated 1452 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:11.580139 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-42faedc4-139f-45b3-a06b-36e651813095 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:11.589460 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-42faedc4-139f-45b3-a06b-36e651813095 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: db1ac026-e512-4e5f-839d-4056cec509b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:11.612963 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42faedc4-139f-45b3-a06b-36e651813095 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:11.613713 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42faedc4-139f-45b3-a06b-36e651813095 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:11.614336 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42faedc4-139f-45b3-a06b-36e651813095 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:11.615229 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42faedc4-139f-45b3-a06b-36e651813095 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:11.615929 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42faedc4-139f-45b3-a06b-36e651813095 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:11.616515 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42faedc4-139f-45b3-a06b-36e651813095 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:12.075470 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b312995a-3475-4aec-a001-46c840078a16 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:12.091822 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-42faedc4-139f-45b3-a06b-36e651813095 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:12.103616 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-42faedc4-139f-45b3-a06b-36e651813095 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/db1ac026-e512-4e5f-839d-4056cec509b3" status: 200 len: 1507 microversion: 2.1 time: 0.526069 Aug 31 16:07:12.107490 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1341/2683] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:11 2022] GET /compute/v2.1/servers/db1ac026-e512-4e5f-839d-4056cec509b3 => generated 1507 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:12.117140 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b312995a-3475-4aec-a001-46c840078a16 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/8f165110-0ea6-48c0-8357-ba419171f7af" status: 200 len: 1476 microversion: 2.1 time: 0.719340 Aug 31 16:07:12.137476 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1343/2684] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:11 2022] GET /compute/v2.1/servers/8f165110-0ea6-48c0-8357-ba419171f7af => generated 1476 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:12.435556 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-aab0bf3b-913b-445b-bb1c-6ec632b82a66 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:12.438699 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-aab0bf3b-913b-445b-bb1c-6ec632b82a66 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] [instance: 5709d363-0934-4d14-a734-35a54bdc03d0] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:12.473507 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aab0bf3b-913b-445b-bb1c-6ec632b82a66 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:12.474440 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aab0bf3b-913b-445b-bb1c-6ec632b82a66 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:12.476854 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aab0bf3b-913b-445b-bb1c-6ec632b82a66 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:12.477979 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aab0bf3b-913b-445b-bb1c-6ec632b82a66 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:12.478610 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aab0bf3b-913b-445b-bb1c-6ec632b82a66 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:12.479791 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aab0bf3b-913b-445b-bb1c-6ec632b82a66 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:12.486110 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b5e6304d-5c62-4f8f-aeea-2cc5b165564d tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:12.487362 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b5e6304d-5c62-4f8f-aeea-2cc5b165564d tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] [instance: 685d47e4-721e-4eae-b5f8-78fdb68454ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:12.496821 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b5e6304d-5c62-4f8f-aeea-2cc5b165564d tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:12.501662 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b5e6304d-5c62-4f8f-aeea-2cc5b165564d tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:12.502364 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b5e6304d-5c62-4f8f-aeea-2cc5b165564d tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:12.503284 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b5e6304d-5c62-4f8f-aeea-2cc5b165564d tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:12.511550 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b5e6304d-5c62-4f8f-aeea-2cc5b165564d tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:12.512435 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b5e6304d-5c62-4f8f-aeea-2cc5b165564d tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:13.101001 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-aab0bf3b-913b-445b-bb1c-6ec632b82a66 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb6a27e336449738f68a88d870ca6e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f79872256b2647d6a01c9e753b93b3c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:13.116169 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-aab0bf3b-913b-445b-bb1c-6ec632b82a66 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] 10.222.0.61 "GET /compute/v2.1/servers/5709d363-0934-4d14-a734-35a54bdc03d0" status: 200 len: 1318 microversion: 2.1 time: 0.701405 Aug 31 16:07:13.120202 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1342/2685] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:12 2022] GET /compute/v2.1/servers/5709d363-0934-4d14-a734-35a54bdc03d0 => generated 1318 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:13.131794 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3d2351a8-2f34-4d55-8aac-fce62b36270e tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '.version_select at 0x7f5ae858fdc0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:13.261765 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3d2351a8-2f34-4d55-8aac-fce62b36270e tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "GET /compute/v2.1/images/03df45dd-ab3d-44b8-97f9-0f9148109666" status: 200 len: 1452 microversion: 2.1 time: 0.140285 Aug 31 16:07:13.264717 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1343/2686] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:07:13 2022] GET /compute/v2.1/images/03df45dd-ab3d-44b8-97f9-0f9148109666 => generated 1452 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:13.280095 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6e418d74-0686-4f0f-bb37-e11e2a911a3c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:13.282833 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6e418d74-0686-4f0f-bb37-e11e2a911a3c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: db1ac026-e512-4e5f-839d-4056cec509b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:13.297264 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6e418d74-0686-4f0f-bb37-e11e2a911a3c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:13.301520 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6e418d74-0686-4f0f-bb37-e11e2a911a3c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:13.302639 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6e418d74-0686-4f0f-bb37-e11e2a911a3c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:13.303644 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6e418d74-0686-4f0f-bb37-e11e2a911a3c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:13.309814 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6e418d74-0686-4f0f-bb37-e11e2a911a3c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:13.310606 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6e418d74-0686-4f0f-bb37-e11e2a911a3c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:13.312806 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b5e6304d-5c62-4f8f-aeea-2cc5b165564d tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:13.358022 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b5e6304d-5c62-4f8f-aeea-2cc5b165564d tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:13.367115 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b5e6304d-5c62-4f8f-aeea-2cc5b165564d tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:13.376300 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b5e6304d-5c62-4f8f-aeea-2cc5b165564d tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] 10.222.0.61 "GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae" status: 200 len: 1875 microversion: 2.42 time: 0.893953 Aug 31 16:07:13.382152 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1344/2687] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:07:12 2022] GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae => generated 1875 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:07:13.413909 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-61fdc0c8-95ec-4e6c-ac82-25258492ab0e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:13.422597 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-61fdc0c8-95ec-4e6c-ac82-25258492ab0e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 8f165110-0ea6-48c0-8357-ba419171f7af] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:13.468746 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-61fdc0c8-95ec-4e6c-ac82-25258492ab0e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:13.473938 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-61fdc0c8-95ec-4e6c-ac82-25258492ab0e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:13.480895 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-61fdc0c8-95ec-4e6c-ac82-25258492ab0e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:13.488728 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-61fdc0c8-95ec-4e6c-ac82-25258492ab0e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:13.489548 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-61fdc0c8-95ec-4e6c-ac82-25258492ab0e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:13.489693 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-61fdc0c8-95ec-4e6c-ac82-25258492ab0e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:13.629953 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-6e418d74-0686-4f0f-bb37-e11e2a911a3c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:13.646403 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6e418d74-0686-4f0f-bb37-e11e2a911a3c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/db1ac026-e512-4e5f-839d-4056cec509b3" status: 200 len: 1507 microversion: 2.1 time: 0.377617 Aug 31 16:07:13.648142 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1344/2688] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:13 2022] GET /compute/v2.1/servers/db1ac026-e512-4e5f-839d-4056cec509b3 => generated 1507 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:13.835622 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-61fdc0c8-95ec-4e6c-ac82-25258492ab0e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:13.847291 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-61fdc0c8-95ec-4e6c-ac82-25258492ab0e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/8f165110-0ea6-48c0-8357-ba419171f7af" status: 200 len: 1476 microversion: 2.1 time: 0.463435 Aug 31 16:07:13.848321 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1345/2689] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:13 2022] GET /compute/v2.1/servers/8f165110-0ea6-48c0-8357-ba419171f7af => generated 1476 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:14.145060 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5f18a684-7baa-470b-94d1-b07f53f18ee0 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:14.146002 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5f18a684-7baa-470b-94d1-b07f53f18ee0 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] [instance: 5709d363-0934-4d14-a734-35a54bdc03d0] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:14.189569 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5f18a684-7baa-470b-94d1-b07f53f18ee0 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:14.190088 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5f18a684-7baa-470b-94d1-b07f53f18ee0 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:14.203767 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5f18a684-7baa-470b-94d1-b07f53f18ee0 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:14.210791 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5f18a684-7baa-470b-94d1-b07f53f18ee0 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:14.212620 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5f18a684-7baa-470b-94d1-b07f53f18ee0 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:14.214703 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5f18a684-7baa-470b-94d1-b07f53f18ee0 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:14.279113 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3eb3ba68-787b-4546-b44d-930035139536 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '.version_select at 0x7f5aed1c2790>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:14.402551 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3eb3ba68-787b-4546-b44d-930035139536 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "GET /compute/v2.1/images/03df45dd-ab3d-44b8-97f9-0f9148109666" status: 200 len: 1452 microversion: 2.1 time: 0.128211 Aug 31 16:07:14.410313 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1346/2690] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:07:14 2022] GET /compute/v2.1/images/03df45dd-ab3d-44b8-97f9-0f9148109666 => generated 1452 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:07:14.421109 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-cf391a8a-0f9a-4eb0-8b67-e41dccd5c986 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:14.438213 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-cf391a8a-0f9a-4eb0-8b67-e41dccd5c986 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] [instance: 685d47e4-721e-4eae-b5f8-78fdb68454ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:14.495812 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5f18a684-7baa-470b-94d1-b07f53f18ee0 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb6a27e336449738f68a88d870ca6e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f79872256b2647d6a01c9e753b93b3c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:14.498986 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cf391a8a-0f9a-4eb0-8b67-e41dccd5c986 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:14.499799 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cf391a8a-0f9a-4eb0-8b67-e41dccd5c986 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:14.500860 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cf391a8a-0f9a-4eb0-8b67-e41dccd5c986 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:14.505748 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cf391a8a-0f9a-4eb0-8b67-e41dccd5c986 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:14.507406 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cf391a8a-0f9a-4eb0-8b67-e41dccd5c986 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:14.513170 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cf391a8a-0f9a-4eb0-8b67-e41dccd5c986 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:14.516497 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5f18a684-7baa-470b-94d1-b07f53f18ee0 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] 10.222.0.61 "GET /compute/v2.1/servers/5709d363-0934-4d14-a734-35a54bdc03d0" status: 200 len: 1468 microversion: 2.1 time: 0.375509 Aug 31 16:07:14.532431 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1345/2691] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:14 2022] GET /compute/v2.1/servers/5709d363-0934-4d14-a734-35a54bdc03d0 => generated 1468 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:15.012751 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-cf391a8a-0f9a-4eb0-8b67-e41dccd5c986 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:15.050887 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-cf391a8a-0f9a-4eb0-8b67-e41dccd5c986 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:15.061323 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-cf391a8a-0f9a-4eb0-8b67-e41dccd5c986 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:15.071933 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-cf391a8a-0f9a-4eb0-8b67-e41dccd5c986 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] 10.222.0.61 "GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae" status: 200 len: 1875 microversion: 2.42 time: 0.655219 Aug 31 16:07:15.077611 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1347/2692] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:07:14 2022] GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae => generated 1875 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:07:15.093347 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5470d9a4-2e6a-4cf3-9039-b0583488ea04 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:15.098534 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5470d9a4-2e6a-4cf3-9039-b0583488ea04 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: db1ac026-e512-4e5f-839d-4056cec509b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:15.129535 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5470d9a4-2e6a-4cf3-9039-b0583488ea04 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:15.132673 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5470d9a4-2e6a-4cf3-9039-b0583488ea04 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:15.136357 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5470d9a4-2e6a-4cf3-9039-b0583488ea04 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:15.141372 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5470d9a4-2e6a-4cf3-9039-b0583488ea04 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:15.142139 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5470d9a4-2e6a-4cf3-9039-b0583488ea04 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:15.144928 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5470d9a4-2e6a-4cf3-9039-b0583488ea04 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:15.308322 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ebad0ae1-1419-499f-b036-f8294b0ec7c7 tempest-LiveMigrationNegativeTest-205709442 tempest-LiveMigrationNegativeTest-205709442-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-1314951354", "block_migration": true, "disk_over_commit": false}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:07:15.311990 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ebad0ae1-1419-499f-b036-f8294b0ec7c7 tempest-LiveMigrationNegativeTest-205709442 tempest-LiveMigrationNegativeTest-205709442-project-admin] [instance: 5709d363-0934-4d14-a734-35a54bdc03d0] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:15.326143 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ebad0ae1-1419-499f-b036-f8294b0ec7c7 tempest-LiveMigrationNegativeTest-205709442 tempest-LiveMigrationNegativeTest-205709442-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:15.333115 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ebad0ae1-1419-499f-b036-f8294b0ec7c7 tempest-LiveMigrationNegativeTest-205709442 tempest-LiveMigrationNegativeTest-205709442-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:15.334319 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ebad0ae1-1419-499f-b036-f8294b0ec7c7 tempest-LiveMigrationNegativeTest-205709442 tempest-LiveMigrationNegativeTest-205709442-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:15.335609 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ebad0ae1-1419-499f-b036-f8294b0ec7c7 tempest-LiveMigrationNegativeTest-205709442 tempest-LiveMigrationNegativeTest-205709442-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:15.336607 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ebad0ae1-1419-499f-b036-f8294b0ec7c7 tempest-LiveMigrationNegativeTest-205709442 tempest-LiveMigrationNegativeTest-205709442-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:15.339326 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ebad0ae1-1419-499f-b036-f8294b0ec7c7 tempest-LiveMigrationNegativeTest-205709442 tempest-LiveMigrationNegativeTest-205709442-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:15.422469 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-ebad0ae1-1419-499f-b036-f8294b0ec7c7 tempest-LiveMigrationNegativeTest-205709442 tempest-LiveMigrationNegativeTest-205709442-project-admin] Lazy-loading 'flavor' on Instance uuid 5709d363-0934-4d14-a734-35a54bdc03d0 {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:07:15.452737 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ebad0ae1-1419-499f-b036-f8294b0ec7c7 tempest-LiveMigrationNegativeTest-205709442 tempest-LiveMigrationNegativeTest-205709442-project-admin] [instance: 5709d363-0934-4d14-a734-35a54bdc03d0] Going to try to live migrate instance to tempest-host-1314951354 {{(pid=122256) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 31 16:07:15.469650 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-ebad0ae1-1419-499f-b036-f8294b0ec7c7 tempest-LiveMigrationNegativeTest-205709442 tempest-LiveMigrationNegativeTest-205709442-project-admin] HTTP exception thrown: Compute host tempest-host-1314951354 could not be found. Aug 31 16:07:15.498236 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ebad0ae1-1419-499f-b036-f8294b0ec7c7 tempest-LiveMigrationNegativeTest-205709442 tempest-LiveMigrationNegativeTest-205709442-project-admin] Request method failure captured: Aug 31 16:07:15.498236 n-d-850499-9 devstack@n-api.service[122256]: request: POST /compute/v2.1/servers/5709d363-0934-4d14-a734-35a54bdc03d0/action HTTP/1.1 Aug 31 16:07:15.498236 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:07:15.498236 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:07:15.498236 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:07:15.498236 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 107 Aug 31 16:07:15.498236 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:07:15.498236 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:07:15.498236 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:07:15.498236 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:07:15.498236 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4cRLxq1Ur5r76ObfqS5EDajrocTGGtgvT085fW1uTEZYPyOhJXvTFcx9i8gOMtAXr1XeZor8uLg0dRzBvTVpv1cKTmZu6trQF07nwqI8yP1v8amcFj_V0-_tX6qGhbfjtD-us9mrXsronOFo3FzKcg3lA2gpWE3-OJlYneAGyeTGuA Aug 31 16:07:15.498236 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:07:15.498236 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:07:15.498236 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:07:15.498236 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:07:15.498236 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:07:15.498236 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:07:15.498236 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: ccfe68a9d8564f1b8b1b104f8c09ae4c Aug 31 16:07:15.498236 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-LiveMigrationNegativeTest-205709442 Aug 31 16:07:15.498236 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,admin,member Aug 31 16:07:15.498236 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,admin,member Aug 31 16:07:15.498236 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ccfe68a9d8564f1b8b1b104f8c09ae4c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ccfe68a9d8564f1b8b1b104f8c09ae4c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ccfe68a9d8564f1b8b1b104f8c09ae4c", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ccfe68a9d8564f1b8b1b104f8c09ae4c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:07:15.498236 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-LiveMigrationNegativeTest-205709442 Aug 31 16:07:15.498236 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: ccfe68a9d8564f1b8b1b104f8c09ae4c Aug 31 16:07:15.498236 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-205709442 Aug 31 16:07:15.498236 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-LiveMigrationNegativeTest-205709442-project-admin Aug 31 16:07:15.498236 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:07:15.498236 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:07:15.498236 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: f405d19982554d888ec40a4331c0f94a Aug 31 16:07:15.498236 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-LiveMigrationNegativeTest-205709442-project-admin Aug 31 16:07:15.498236 n-d-850499-9 devstack@n-api.service[122256]: Aug 31 16:07:15.498236 n-d-850499-9 devstack@n-api.service[122256]: {"os-migrateLive": {"host": "tempest-host-1314951354", "block_migration": true, "disk_over_commit": false}} Aug 31 16:07:15.498236 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:07:15.498236 n-d-850499-9 devstack@n-api.service[122256]: exception: Compute host tempest-host-1314951354 could not be found. Aug 31 16:07:15.498236 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '5709d363-0934-4d14-a734-35a54bdc03d0', 'body': {'os-migrateLive': {'host': 'tempest-host-1314951354', 'block_migration': True, 'disk_over_commit': False}}} Aug 31 16:07:15.498236 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:07:15.498236 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:07:15.498236 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Aug 31 16:07:15.498236 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Aug 31 16:07:15.498236 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 31 16:07:15.498236 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 16:07:15.498236 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 31 16:07:15.498236 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 31 16:07:15.498236 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Aug 31 16:07:15.498236 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 31 16:07:15.498236 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 31 16:07:15.498236 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 31 16:07:15.498236 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Aug 31 16:07:15.498236 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 31 16:07:15.498236 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Aug 31 16:07:15.498236 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 31 16:07:15.498236 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 16:07:15.498236 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 16:07:15.498236 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 31 16:07:15.498236 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 31 16:07:15.498236 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5486, in live_migrate Aug 31 16:07:15.498236 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Aug 31 16:07:15.498236 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 16:07:15.498236 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 16:07:15.498236 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Aug 31 16:07:15.498236 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Aug 31 16:07:15.503404 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Aug 31 16:07:15.503404 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:07:15.503404 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Aug 31 16:07:15.503404 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Aug 31 16:07:15.503404 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Aug 31 16:07:15.503404 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Aug 31 16:07:15.503404 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Aug 31 16:07:15.503404 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Aug 31 16:07:15.503404 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-1314951354 could not be found. Aug 31 16:07:15.503404 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:07:15.503404 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:07:15.503404 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:07:15.503404 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:07:15.503404 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:07:15.503404 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:07:15.503404 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:07:15.503404 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:07:15.503404 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:07:15.503404 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:07:15.503404 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:07:15.503404 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:07:15.503404 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:07:15.503404 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:07:15.503404 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:07:15.503404 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:07:15.503404 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 31 16:07:15.503404 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Aug 31 16:07:15.503404 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 31 16:07:15.503404 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-1314951354 could not be found. Aug 31 16:07:15.503404 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:07:15.503404 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:07:15.503404 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:07:15.503404 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:07:15.503404 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:07:15.503404 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:07:15.503404 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:07:15.503404 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:07:15.503404 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-1314951354 could not be found. Aug 31 16:07:15.503404 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:07:15.511096 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ebad0ae1-1419-499f-b036-f8294b0ec7c7 tempest-LiveMigrationNegativeTest-205709442 tempest-LiveMigrationNegativeTest-205709442-project-admin] Returning 400 to user: Compute host tempest-host-1314951354 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:07:15.513473 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ebad0ae1-1419-499f-b036-f8294b0ec7c7 tempest-LiveMigrationNegativeTest-205709442 tempest-LiveMigrationNegativeTest-205709442-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/5709d363-0934-4d14-a734-35a54bdc03d0/action" status: 400 len: 100 microversion: 2.1 time: 0.964962 Aug 31 16:07:15.514884 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1346/2693] 10.222.0.61 () {60 vars in 1279 bytes} [Wed Aug 31 16:07:14 2022] POST /compute/v2.1/servers/5709d363-0934-4d14-a734-35a54bdc03d0/action => generated 100 bytes in 968 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 31 16:07:15.525300 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4b693353-b55f-43c8-846a-3f98bde66f33 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:15.526653 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4b693353-b55f-43c8-846a-3f98bde66f33 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 8f165110-0ea6-48c0-8357-ba419171f7af] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:15.572358 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4b693353-b55f-43c8-846a-3f98bde66f33 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:15.573221 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5470d9a4-2e6a-4cf3-9039-b0583488ea04 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:15.581497 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4b693353-b55f-43c8-846a-3f98bde66f33 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:15.583233 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4b693353-b55f-43c8-846a-3f98bde66f33 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:15.585406 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4b693353-b55f-43c8-846a-3f98bde66f33 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:15.586568 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4b693353-b55f-43c8-846a-3f98bde66f33 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:15.587821 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4b693353-b55f-43c8-846a-3f98bde66f33 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:15.593577 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5470d9a4-2e6a-4cf3-9039-b0583488ea04 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/db1ac026-e512-4e5f-839d-4056cec509b3" status: 200 len: 1528 microversion: 2.1 time: 0.507834 Aug 31 16:07:15.595881 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1348/2694] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:15 2022] GET /compute/v2.1/servers/db1ac026-e512-4e5f-839d-4056cec509b3 => generated 1528 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:15.612046 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0f8f11c8-a1f5-43b1-9fa4-74a95a0dcae2 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '.version_select at 0x7f5ae83cf8b0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:15.708766 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0f8f11c8-a1f5-43b1-9fa4-74a95a0dcae2 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "GET /compute/v2.1/images/03df45dd-ab3d-44b8-97f9-0f9148109666" status: 200 len: 1452 microversion: 2.1 time: 0.111479 Aug 31 16:07:15.710726 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1349/2695] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:07:15 2022] GET /compute/v2.1/images/03df45dd-ab3d-44b8-97f9-0f9148109666 => generated 1452 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:15.732172 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2093f8fd-c51a-487d-8cba-fbfb08d476a8 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:15.736780 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2093f8fd-c51a-487d-8cba-fbfb08d476a8 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] [instance: 5709d363-0934-4d14-a734-35a54bdc03d0] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:15.760289 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=78 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:07:15.773033 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2093f8fd-c51a-487d-8cba-fbfb08d476a8 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:15.773703 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2093f8fd-c51a-487d-8cba-fbfb08d476a8 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:15.774271 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2093f8fd-c51a-487d-8cba-fbfb08d476a8 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:15.776722 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2093f8fd-c51a-487d-8cba-fbfb08d476a8 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:15.777588 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2093f8fd-c51a-487d-8cba-fbfb08d476a8 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:15.778267 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2093f8fd-c51a-487d-8cba-fbfb08d476a8 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:16.240625 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-4b693353-b55f-43c8-846a-3f98bde66f33 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:16.279993 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4b693353-b55f-43c8-846a-3f98bde66f33 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/8f165110-0ea6-48c0-8357-ba419171f7af" status: 200 len: 1476 microversion: 2.1 time: 0.762809 Aug 31 16:07:16.286527 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1347/2696] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:15 2022] GET /compute/v2.1/servers/8f165110-0ea6-48c0-8357-ba419171f7af => generated 1476 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:16.302713 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3b5a2efd-e4e6-4053-9c09-fa674a8a32d1 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:16.304276 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3b5a2efd-e4e6-4053-9c09-fa674a8a32d1 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] [instance: 685d47e4-721e-4eae-b5f8-78fdb68454ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:16.318043 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3b5a2efd-e4e6-4053-9c09-fa674a8a32d1 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:16.320280 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3b5a2efd-e4e6-4053-9c09-fa674a8a32d1 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:16.321405 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3b5a2efd-e4e6-4053-9c09-fa674a8a32d1 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:16.324388 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3b5a2efd-e4e6-4053-9c09-fa674a8a32d1 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:16.325464 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3b5a2efd-e4e6-4053-9c09-fa674a8a32d1 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:16.326692 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3b5a2efd-e4e6-4053-9c09-fa674a8a32d1 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:16.340946 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2093f8fd-c51a-487d-8cba-fbfb08d476a8 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb6a27e336449738f68a88d870ca6e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f79872256b2647d6a01c9e753b93b3c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:16.391966 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2093f8fd-c51a-487d-8cba-fbfb08d476a8 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] 10.222.0.61 "GET /compute/v2.1/servers/5709d363-0934-4d14-a734-35a54bdc03d0" status: 200 len: 1468 microversion: 2.1 time: 0.676273 Aug 31 16:07:16.396018 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1350/2697] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:15 2022] GET /compute/v2.1/servers/5709d363-0934-4d14-a734-35a54bdc03d0 => generated 1468 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:16.616242 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ab678fb1-4d09-4d08-be82-3ee2b867aa96 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:16.618194 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ab678fb1-4d09-4d08-be82-3ee2b867aa96 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: db1ac026-e512-4e5f-839d-4056cec509b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:16.632150 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ab678fb1-4d09-4d08-be82-3ee2b867aa96 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:16.639259 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ab678fb1-4d09-4d08-be82-3ee2b867aa96 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:16.641468 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ab678fb1-4d09-4d08-be82-3ee2b867aa96 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:16.643440 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ab678fb1-4d09-4d08-be82-3ee2b867aa96 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:16.652565 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ab678fb1-4d09-4d08-be82-3ee2b867aa96 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:16.653362 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ab678fb1-4d09-4d08-be82-3ee2b867aa96 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:16.745394 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=100 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:07:17.346724 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3b5a2efd-e4e6-4053-9c09-fa674a8a32d1 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:17.376881 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3b5a2efd-e4e6-4053-9c09-fa674a8a32d1 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:17.378849 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3b5a2efd-e4e6-4053-9c09-fa674a8a32d1 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:17.380364 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3b5a2efd-e4e6-4053-9c09-fa674a8a32d1 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] 10.222.0.61 "GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae" status: 200 len: 1875 microversion: 2.42 time: 1.091945 Aug 31 16:07:17.381739 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1348/2698] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:07:16 2022] GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae => generated 1875 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:07:17.394669 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-faab983c-cdff-432e-98a0-05d35223894e tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '.version_select at 0x7f5ae86961f0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:17.418574 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ab678fb1-4d09-4d08-be82-3ee2b867aa96 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:17.460599 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ab678fb1-4d09-4d08-be82-3ee2b867aa96 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/db1ac026-e512-4e5f-839d-4056cec509b3" status: 200 len: 1528 microversion: 2.1 time: 0.848247 Aug 31 16:07:17.476773 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1351/2699] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:16 2022] GET /compute/v2.1/servers/db1ac026-e512-4e5f-839d-4056cec509b3 => generated 1528 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:07:17.485866 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a47424fc-3e0e-4196-9b8d-03414ebe2f0c tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-748664517", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:07:17.489484 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-faab983c-cdff-432e-98a0-05d35223894e tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "GET /compute/v2.1/images/03df45dd-ab3d-44b8-97f9-0f9148109666" status: 200 len: 1452 microversion: 2.1 time: 0.105806 Aug 31 16:07:17.490080 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1349/2700] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:07:17 2022] GET /compute/v2.1/images/03df45dd-ab3d-44b8-97f9-0f9148109666 => generated 1452 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:17.607916 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-a47424fc-3e0e-4196-9b8d-03414ebe2f0c tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] validate_networks() for None {{(pid=122257) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:07:18.134643 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-afa6cbae-8aa6-4b8e-b83f-cd0cfb8f4576 tempest-QuotasAdminTestV257-1103954378 tempest-QuotasAdminTestV257-1103954378-project-admin] Action: 'update', calling method: .version_select at 0x7f5ae9326550>, body: {"quota_set": {"ram": "5120"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:07:18.159374 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-a47424fc-3e0e-4196-9b8d-03414ebe2f0c tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:07:18.161085 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-a47424fc-3e0e-4196-9b8d-03414ebe2f0c tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:07:18.165047 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-a47424fc-3e0e-4196-9b8d-03414ebe2f0c tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:07:18.165588 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-a47424fc-3e0e-4196-9b8d-03414ebe2f0c tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:07:18.166016 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-a47424fc-3e0e-4196-9b8d-03414ebe2f0c tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:07:18.212294 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a47424fc-3e0e-4196-9b8d-03414ebe2f0c tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:18.215228 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a47424fc-3e0e-4196-9b8d-03414ebe2f0c tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:18.215935 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a47424fc-3e0e-4196-9b8d-03414ebe2f0c tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:18.217145 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a47424fc-3e0e-4196-9b8d-03414ebe2f0c tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:18.217801 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a47424fc-3e0e-4196-9b8d-03414ebe2f0c tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:18.218409 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a47424fc-3e0e-4196-9b8d-03414ebe2f0c tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:18.257258 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=80 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:07:18.273672 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-a47424fc-3e0e-4196-9b8d-03414ebe2f0c tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Getting quotas for project f79872256b2647d6a01c9e753b93b3c2. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:07:18.274529 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-afa6cbae-8aa6-4b8e-b83f-cd0cfb8f4576 tempest-QuotasAdminTestV257-1103954378 tempest-QuotasAdminTestV257-1103954378-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:18.275407 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-afa6cbae-8aa6-4b8e-b83f-cd0cfb8f4576 tempest-QuotasAdminTestV257-1103954378 tempest-QuotasAdminTestV257-1103954378-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:18.276814 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-afa6cbae-8aa6-4b8e-b83f-cd0cfb8f4576 tempest-QuotasAdminTestV257-1103954378 tempest-QuotasAdminTestV257-1103954378-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:18.278176 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-afa6cbae-8aa6-4b8e-b83f-cd0cfb8f4576 tempest-QuotasAdminTestV257-1103954378 tempest-QuotasAdminTestV257-1103954378-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:18.279048 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-afa6cbae-8aa6-4b8e-b83f-cd0cfb8f4576 tempest-QuotasAdminTestV257-1103954378 tempest-QuotasAdminTestV257-1103954378-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:18.279863 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-afa6cbae-8aa6-4b8e-b83f-cd0cfb8f4576 tempest-QuotasAdminTestV257-1103954378 tempest-QuotasAdminTestV257-1103954378-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:18.285727 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-a47424fc-3e0e-4196-9b8d-03414ebe2f0c tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Getting quotas for user 4bb6a27e336449738f68a88d870ca6e2 and project f79872256b2647d6a01c9e753b93b3c2. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:07:18.303643 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a47424fc-3e0e-4196-9b8d-03414ebe2f0c tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Going to run 1 instances... {{(pid=122257) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:07:18.306439 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a47424fc-3e0e-4196-9b8d-03414ebe2f0c tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] [instance: 1df89d79-3817-40af-b956-b9b75919acbc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:07:18.389325 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-afa6cbae-8aa6-4b8e-b83f-cd0cfb8f4576 tempest-QuotasAdminTestV257-1103954378 tempest-QuotasAdminTestV257-1103954378-project-admin] 10.222.0.61 "PUT /compute/v2.1/os-quota-sets/2377feb1627348b3b1a2a8b159c1e44f" status: 200 len: 148 microversion: 2.57 time: 0.898147 Aug 31 16:07:18.395316 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1350/2701] 10.222.0.61 () {62 vars in 1303 bytes} [Wed Aug 31 16:07:17 2022] PUT /compute/v2.1/os-quota-sets/2377feb1627348b3b1a2a8b159c1e44f => generated 148 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 16:07:18.401646 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4770881a-9ec6-4bd3-832c-d22b21062559 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:18.402281 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4770881a-9ec6-4bd3-832c-d22b21062559 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 8f165110-0ea6-48c0-8357-ba419171f7af] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:18.409645 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4770881a-9ec6-4bd3-832c-d22b21062559 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:18.410159 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4770881a-9ec6-4bd3-832c-d22b21062559 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:18.410606 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4770881a-9ec6-4bd3-832c-d22b21062559 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:18.411345 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4770881a-9ec6-4bd3-832c-d22b21062559 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:18.411874 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4770881a-9ec6-4bd3-832c-d22b21062559 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:18.412323 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4770881a-9ec6-4bd3-832c-d22b21062559 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:18.421121 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a47424fc-3e0e-4196-9b8d-03414ebe2f0c tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.940506 Aug 31 16:07:18.423762 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1352/2702] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:07:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 944 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:07:18.434157 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-db4f09cb-0842-45f4-b6f0-f7d44bc3feab tempest-QuotasAdminTestV257-1103954378 tempest-QuotasAdminTestV257-1103954378-project-admin] Calling method '.version_select at 0x7f5ae84cf040>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:18.601125 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-db4f09cb-0842-45f4-b6f0-f7d44bc3feab tempest-QuotasAdminTestV257-1103954378 tempest-QuotasAdminTestV257-1103954378-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:18.602012 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-db4f09cb-0842-45f4-b6f0-f7d44bc3feab tempest-QuotasAdminTestV257-1103954378 tempest-QuotasAdminTestV257-1103954378-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:18.602691 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-db4f09cb-0842-45f4-b6f0-f7d44bc3feab tempest-QuotasAdminTestV257-1103954378 tempest-QuotasAdminTestV257-1103954378-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:18.603679 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-db4f09cb-0842-45f4-b6f0-f7d44bc3feab tempest-QuotasAdminTestV257-1103954378 tempest-QuotasAdminTestV257-1103954378-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:18.604911 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-db4f09cb-0842-45f4-b6f0-f7d44bc3feab tempest-QuotasAdminTestV257-1103954378 tempest-QuotasAdminTestV257-1103954378-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:18.605754 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-db4f09cb-0842-45f4-b6f0-f7d44bc3feab tempest-QuotasAdminTestV257-1103954378 tempest-QuotasAdminTestV257-1103954378-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:18.674092 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-4770881a-9ec6-4bd3-832c-d22b21062559 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:18.676531 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-db4f09cb-0842-45f4-b6f0-f7d44bc3feab tempest-QuotasAdminTestV257-1103954378 tempest-QuotasAdminTestV257-1103954378-project-admin] 10.222.0.61 "GET /compute/v2.1/os-quota-sets/2377feb1627348b3b1a2a8b159c1e44f/detail" status: 200 len: 463 microversion: 2.57 time: 0.249731 Aug 31 16:07:18.677734 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1353/2703] 10.222.0.61 () {60 vars in 1304 bytes} [Wed Aug 31 16:07:18 2022] GET /compute/v2.1/os-quota-sets/2377feb1627348b3b1a2a8b159c1e44f/detail => generated 463 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 16:07:18.684795 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4770881a-9ec6-4bd3-832c-d22b21062559 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/8f165110-0ea6-48c0-8357-ba419171f7af" status: 200 len: 1476 microversion: 2.1 time: 0.288035 Aug 31 16:07:18.686577 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1351/2704] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:18 2022] GET /compute/v2.1/servers/8f165110-0ea6-48c0-8357-ba419171f7af => generated 1476 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:18.694360 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1a4ab93f-34af-4bf8-8b67-62f846adc04b tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:18.695234 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1a4ab93f-34af-4bf8-8b67-62f846adc04b tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] [instance: 1df89d79-3817-40af-b956-b9b75919acbc] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:18.705730 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7c8ed816-3f0f-496a-80d3-fb7bfe9d4337 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:18.706397 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7c8ed816-3f0f-496a-80d3-fb7bfe9d4337 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] [instance: 685d47e4-721e-4eae-b5f8-78fdb68454ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:18.725519 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7c8ed816-3f0f-496a-80d3-fb7bfe9d4337 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:18.726062 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7c8ed816-3f0f-496a-80d3-fb7bfe9d4337 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:18.726539 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7c8ed816-3f0f-496a-80d3-fb7bfe9d4337 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:18.727237 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7c8ed816-3f0f-496a-80d3-fb7bfe9d4337 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:18.727745 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7c8ed816-3f0f-496a-80d3-fb7bfe9d4337 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:18.728711 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7c8ed816-3f0f-496a-80d3-fb7bfe9d4337 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:18.804981 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1a4ab93f-34af-4bf8-8b67-62f846adc04b tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb6a27e336449738f68a88d870ca6e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f79872256b2647d6a01c9e753b93b3c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:18.816877 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1a4ab93f-34af-4bf8-8b67-62f846adc04b tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] 10.222.0.61 "GET /compute/v2.1/servers/1df89d79-3817-40af-b956-b9b75919acbc" status: 200 len: 1218 microversion: 2.1 time: 0.128676 Aug 31 16:07:18.831536 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1352/2705] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:18 2022] GET /compute/v2.1/servers/1df89d79-3817-40af-b956-b9b75919acbc => generated 1218 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:18.831913 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-403a4c24-2964-4198-8638-f31d4ef16069 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:18.832540 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-403a4c24-2964-4198-8638-f31d4ef16069 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: db1ac026-e512-4e5f-839d-4056cec509b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:18.842138 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-403a4c24-2964-4198-8638-f31d4ef16069 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:18.842907 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-403a4c24-2964-4198-8638-f31d4ef16069 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:18.843791 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-403a4c24-2964-4198-8638-f31d4ef16069 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:18.845089 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-403a4c24-2964-4198-8638-f31d4ef16069 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:18.845926 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-403a4c24-2964-4198-8638-f31d4ef16069 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:18.846625 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-403a4c24-2964-4198-8638-f31d4ef16069 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:18.946527 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=100 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:07:19.306094 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-403a4c24-2964-4198-8638-f31d4ef16069 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:19.328789 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-403a4c24-2964-4198-8638-f31d4ef16069 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/db1ac026-e512-4e5f-839d-4056cec509b3" status: 200 len: 1528 microversion: 2.1 time: 0.507054 Aug 31 16:07:19.347331 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1353/2706] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:18 2022] GET /compute/v2.1/servers/db1ac026-e512-4e5f-839d-4056cec509b3 => generated 1528 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:19.355937 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7c8ed816-3f0f-496a-80d3-fb7bfe9d4337 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:19.372559 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7c8ed816-3f0f-496a-80d3-fb7bfe9d4337 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:19.373521 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-76a373dd-d8de-42af-81c1-51bb3330d6ca tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '.version_select at 0x7f5ae8fea820>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:19.381502 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7c8ed816-3f0f-496a-80d3-fb7bfe9d4337 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:19.383856 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7c8ed816-3f0f-496a-80d3-fb7bfe9d4337 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] 10.222.0.61 "GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae" status: 200 len: 1875 microversion: 2.42 time: 0.704522 Aug 31 16:07:19.384930 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1354/2707] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:07:18 2022] GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae => generated 1875 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:07:19.475188 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-76a373dd-d8de-42af-81c1-51bb3330d6ca tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "GET /compute/v2.1/images/03df45dd-ab3d-44b8-97f9-0f9148109666" status: 200 len: 1452 microversion: 2.1 time: 0.124789 Aug 31 16:07:19.477526 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1354/2708] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:07:19 2022] GET /compute/v2.1/images/03df45dd-ab3d-44b8-97f9-0f9148109666 => generated 1452 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:19.491447 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-fdc46315-7f83-4908-87de-1e0e44253eb8 tempest-QuotasAdminTestV257-1103954378 tempest-QuotasAdminTestV257-1103954378-project-admin] Action: 'update', calling method: .version_select at 0x7f5ae8fea940>, body: {"quota_set": {"ram": "2048"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:07:19.553163 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a3bec27c-a57d-4b47-9176-141eb6b48e89 tempest-FloatingIPDetailsTestJSON-1928649283 tempest-FloatingIPDetailsTestJSON-1928649283-project] Action: 'create', calling method: .version_select at 0x7f5ae841d670>, body: {"pool": null} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:07:19.619210 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fdc46315-7f83-4908-87de-1e0e44253eb8 tempest-QuotasAdminTestV257-1103954378 tempest-QuotasAdminTestV257-1103954378-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:19.620756 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fdc46315-7f83-4908-87de-1e0e44253eb8 tempest-QuotasAdminTestV257-1103954378 tempest-QuotasAdminTestV257-1103954378-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:19.621526 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fdc46315-7f83-4908-87de-1e0e44253eb8 tempest-QuotasAdminTestV257-1103954378 tempest-QuotasAdminTestV257-1103954378-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:19.622705 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fdc46315-7f83-4908-87de-1e0e44253eb8 tempest-QuotasAdminTestV257-1103954378 tempest-QuotasAdminTestV257-1103954378-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:19.629062 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fdc46315-7f83-4908-87de-1e0e44253eb8 tempest-QuotasAdminTestV257-1103954378 tempest-QuotasAdminTestV257-1103954378-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:19.630471 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fdc46315-7f83-4908-87de-1e0e44253eb8 tempest-QuotasAdminTestV257-1103954378 tempest-QuotasAdminTestV257-1103954378-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:19.730661 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fdc46315-7f83-4908-87de-1e0e44253eb8 tempest-QuotasAdminTestV257-1103954378 tempest-QuotasAdminTestV257-1103954378-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:19.746742 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fdc46315-7f83-4908-87de-1e0e44253eb8 tempest-QuotasAdminTestV257-1103954378 tempest-QuotasAdminTestV257-1103954378-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:19.747793 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fdc46315-7f83-4908-87de-1e0e44253eb8 tempest-QuotasAdminTestV257-1103954378 tempest-QuotasAdminTestV257-1103954378-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:19.751035 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fdc46315-7f83-4908-87de-1e0e44253eb8 tempest-QuotasAdminTestV257-1103954378 tempest-QuotasAdminTestV257-1103954378-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:19.753465 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fdc46315-7f83-4908-87de-1e0e44253eb8 tempest-QuotasAdminTestV257-1103954378 tempest-QuotasAdminTestV257-1103954378-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:19.754174 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fdc46315-7f83-4908-87de-1e0e44253eb8 tempest-QuotasAdminTestV257-1103954378 tempest-QuotasAdminTestV257-1103954378-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:19.905372 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-fdc46315-7f83-4908-87de-1e0e44253eb8 tempest-QuotasAdminTestV257-1103954378 tempest-QuotasAdminTestV257-1103954378-project-admin] 10.222.0.61 "PUT /compute/v2.1/os-quota-sets/2377feb1627348b3b1a2a8b159c1e44f?user_id=945c750a8cc241ccbf4eb13789445491" status: 200 len: 148 microversion: 2.57 time: 0.426385 Aug 31 16:07:19.907733 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1355/2709] 10.222.0.61 () {62 vars in 1384 bytes} [Wed Aug 31 16:07:19 2022] PUT /compute/v2.1/os-quota-sets/2377feb1627348b3b1a2a8b159c1e44f?user_id=945c750a8cc241ccbf4eb13789445491 => generated 148 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 16:07:19.925653 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-973db0a6-9b75-44ca-b3bf-1eedda2bc926 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:19.928369 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-973db0a6-9b75-44ca-b3bf-1eedda2bc926 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 8f165110-0ea6-48c0-8357-ba419171f7af] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:19.942185 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-973db0a6-9b75-44ca-b3bf-1eedda2bc926 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:19.954000 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-973db0a6-9b75-44ca-b3bf-1eedda2bc926 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:19.954481 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-973db0a6-9b75-44ca-b3bf-1eedda2bc926 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:19.955260 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-973db0a6-9b75-44ca-b3bf-1eedda2bc926 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:19.955756 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-973db0a6-9b75-44ca-b3bf-1eedda2bc926 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:19.956189 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-973db0a6-9b75-44ca-b3bf-1eedda2bc926 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:20.402731 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-973db0a6-9b75-44ca-b3bf-1eedda2bc926 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:20.420860 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-973db0a6-9b75-44ca-b3bf-1eedda2bc926 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/8f165110-0ea6-48c0-8357-ba419171f7af" status: 200 len: 1476 microversion: 2.1 time: 0.509531 Aug 31 16:07:20.431747 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1356/2710] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:19 2022] GET /compute/v2.1/servers/8f165110-0ea6-48c0-8357-ba419171f7af => generated 1476 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:20.434133 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-cd247d4e-f803-4fc5-b19c-fc9ae967b850 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:20.435521 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-cd247d4e-f803-4fc5-b19c-fc9ae967b850 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] [instance: 1df89d79-3817-40af-b956-b9b75919acbc] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:20.456554 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cd247d4e-f803-4fc5-b19c-fc9ae967b850 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:20.457092 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cd247d4e-f803-4fc5-b19c-fc9ae967b850 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:20.458880 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cd247d4e-f803-4fc5-b19c-fc9ae967b850 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:20.460787 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cd247d4e-f803-4fc5-b19c-fc9ae967b850 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:20.461723 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cd247d4e-f803-4fc5-b19c-fc9ae967b850 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:20.464359 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cd247d4e-f803-4fc5-b19c-fc9ae967b850 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:20.668481 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-cd247d4e-f803-4fc5-b19c-fc9ae967b850 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb6a27e336449738f68a88d870ca6e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f79872256b2647d6a01c9e753b93b3c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:20.680621 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-cd247d4e-f803-4fc5-b19c-fc9ae967b850 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] 10.222.0.61 "GET /compute/v2.1/servers/1df89d79-3817-40af-b956-b9b75919acbc" status: 200 len: 1270 microversion: 2.1 time: 0.255713 Aug 31 16:07:20.696806 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1357/2711] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:20 2022] GET /compute/v2.1/servers/1df89d79-3817-40af-b956-b9b75919acbc => generated 1270 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:20.708575 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f84e782e-9a78-4c21-9ebc-b38528e4eee8 tempest-QuotasAdminTestV257-1103954378 tempest-QuotasAdminTestV257-1103954378-project-admin] Calling method '.version_select at 0x7f5ae8feae50>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:20.970939 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f84e782e-9a78-4c21-9ebc-b38528e4eee8 tempest-QuotasAdminTestV257-1103954378 tempest-QuotasAdminTestV257-1103954378-project-admin] 10.222.0.61 "GET /compute/v2.1/os-quota-sets/2377feb1627348b3b1a2a8b159c1e44f?user_id=945c750a8cc241ccbf4eb13789445491" status: 200 len: 190 microversion: 2.57 time: 0.272614 Aug 31 16:07:20.972272 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1358/2712] 10.222.0.61 () {60 vars in 1364 bytes} [Wed Aug 31 16:07:20 2022] GET /compute/v2.1/os-quota-sets/2377feb1627348b3b1a2a8b159c1e44f?user_id=945c750a8cc241ccbf4eb13789445491 => generated 190 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 16:07:21.022837 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8c9062bf-f3ff-465a-8023-dfb8389f434c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:21.024772 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8c9062bf-f3ff-465a-8023-dfb8389f434c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: db1ac026-e512-4e5f-839d-4056cec509b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:21.043798 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8c9062bf-f3ff-465a-8023-dfb8389f434c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:21.044703 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8c9062bf-f3ff-465a-8023-dfb8389f434c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:21.045157 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8c9062bf-f3ff-465a-8023-dfb8389f434c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:21.048423 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8c9062bf-f3ff-465a-8023-dfb8389f434c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:21.049130 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8c9062bf-f3ff-465a-8023-dfb8389f434c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:21.049623 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8c9062bf-f3ff-465a-8023-dfb8389f434c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:22.583133 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8c9062bf-f3ff-465a-8023-dfb8389f434c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:22.598702 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8c9062bf-f3ff-465a-8023-dfb8389f434c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/db1ac026-e512-4e5f-839d-4056cec509b3" status: 200 len: 1523 microversion: 2.1 time: 1.621749 Aug 31 16:07:22.602216 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1359/2713] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:20 2022] GET /compute/v2.1/servers/db1ac026-e512-4e5f-839d-4056cec509b3 => generated 1523 bytes in 1629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:22.624468 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-40e5b6f1-4cd3-405f-a640-caecbc250ab1 req-6b104487-2bb8-4c92-b9f9-0c5b84428324 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "685d47e4-721e-4eae-b5f8-78fdb68454ae", "name": "network-vif-plugged", "status": "completed", "tag": "a7a5f1a9-2d7d-4203-b9c4-5b85512da4d2"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:07:22.681163 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-40e5b6f1-4cd3-405f-a640-caecbc250ab1 req-6b104487-2bb8-4c92-b9f9-0c5b84428324 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:22.692164 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-40e5b6f1-4cd3-405f-a640-caecbc250ab1 req-6b104487-2bb8-4c92-b9f9-0c5b84428324 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:22.693445 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-40e5b6f1-4cd3-405f-a640-caecbc250ab1 req-6b104487-2bb8-4c92-b9f9-0c5b84428324 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:22.753468 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-40e5b6f1-4cd3-405f-a640-caecbc250ab1 req-6b104487-2bb8-4c92-b9f9-0c5b84428324 service nova] Creating event network-vif-plugged:a7a5f1a9-2d7d-4203-b9c4-5b85512da4d2 for instance 685d47e4-721e-4eae-b5f8-78fdb68454ae on n-h2-850499-9 Aug 31 16:07:22.790998 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-40e5b6f1-4cd3-405f-a640-caecbc250ab1 req-6b104487-2bb8-4c92-b9f9-0c5b84428324 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.185809 Aug 31 16:07:22.799095 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1360/2714] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:07:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:07:22.827784 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-255a05ed-49d6-4e8a-ab33-d672b0661f7f tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:22.836153 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-255a05ed-49d6-4e8a-ab33-d672b0661f7f tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] [instance: 685d47e4-721e-4eae-b5f8-78fdb68454ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:22.863405 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-255a05ed-49d6-4e8a-ab33-d672b0661f7f tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:22.866449 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-255a05ed-49d6-4e8a-ab33-d672b0661f7f tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:22.868160 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-255a05ed-49d6-4e8a-ab33-d672b0661f7f tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:22.869062 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-255a05ed-49d6-4e8a-ab33-d672b0661f7f tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:22.876318 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-255a05ed-49d6-4e8a-ab33-d672b0661f7f tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:22.876943 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-255a05ed-49d6-4e8a-ab33-d672b0661f7f tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:23.797301 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-255a05ed-49d6-4e8a-ab33-d672b0661f7f tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:23.812629 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-255a05ed-49d6-4e8a-ab33-d672b0661f7f tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:23.814339 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-255a05ed-49d6-4e8a-ab33-d672b0661f7f tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:23.815871 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-255a05ed-49d6-4e8a-ab33-d672b0661f7f tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] 10.222.0.61 "GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae" status: 200 len: 1875 microversion: 2.42 time: 1.014943 Aug 31 16:07:23.827418 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1361/2715] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:07:22 2022] GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae => generated 1875 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:07:23.839367 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6947bc3e-3963-485d-8568-c35933b2d9b5 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '.version_select at 0x7f5ae8553f70>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:25.117370 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a3bec27c-a57d-4b47-9176-141eb6b48e89 tempest-FloatingIPDetailsTestJSON-1928649283 tempest-FloatingIPDetailsTestJSON-1928649283-project] 10.222.0.61 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.682898 Aug 31 16:07:25.117370 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1355/2716] 10.222.0.61 () {60 vars in 1170 bytes} [Wed Aug 31 16:07:19 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5686 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:07:25.117370 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a10fdc8e-3344-49f0-8492-1960c2ad5f09 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:25.117370 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a10fdc8e-3344-49f0-8492-1960c2ad5f09 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 8f165110-0ea6-48c0-8357-ba419171f7af] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:25.117370 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a10fdc8e-3344-49f0-8492-1960c2ad5f09 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:25.117370 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a10fdc8e-3344-49f0-8492-1960c2ad5f09 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:25.117370 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a10fdc8e-3344-49f0-8492-1960c2ad5f09 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:25.117370 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a10fdc8e-3344-49f0-8492-1960c2ad5f09 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:25.117370 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a10fdc8e-3344-49f0-8492-1960c2ad5f09 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:25.117370 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a10fdc8e-3344-49f0-8492-1960c2ad5f09 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:25.582284 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a10fdc8e-3344-49f0-8492-1960c2ad5f09 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:25.599674 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a10fdc8e-3344-49f0-8492-1960c2ad5f09 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/8f165110-0ea6-48c0-8357-ba419171f7af" status: 200 len: 1476 microversion: 2.1 time: 0.525203 Aug 31 16:07:25.601215 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1356/2717] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:25 2022] GET /compute/v2.1/servers/8f165110-0ea6-48c0-8357-ba419171f7af => generated 1476 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:25.628518 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b6409c2c-5546-429f-ab0c-cd12b16f9e2a tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:25.631416 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b6409c2c-5546-429f-ab0c-cd12b16f9e2a tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] [instance: 1df89d79-3817-40af-b956-b9b75919acbc] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:25.641546 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b6409c2c-5546-429f-ab0c-cd12b16f9e2a tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:25.642987 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b6409c2c-5546-429f-ab0c-cd12b16f9e2a tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:25.643978 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b6409c2c-5546-429f-ab0c-cd12b16f9e2a tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:25.645520 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b6409c2c-5546-429f-ab0c-cd12b16f9e2a tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:25.646250 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b6409c2c-5546-429f-ab0c-cd12b16f9e2a tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:25.647096 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b6409c2c-5546-429f-ab0c-cd12b16f9e2a tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:26.580817 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b6409c2c-5546-429f-ab0c-cd12b16f9e2a tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb6a27e336449738f68a88d870ca6e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f79872256b2647d6a01c9e753b93b3c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:26.607802 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b6409c2c-5546-429f-ab0c-cd12b16f9e2a tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] 10.222.0.61 "GET /compute/v2.1/servers/1df89d79-3817-40af-b956-b9b75919acbc" status: 200 len: 1318 microversion: 2.1 time: 0.995585 Aug 31 16:07:26.608798 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1357/2718] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:25 2022] GET /compute/v2.1/servers/1df89d79-3817-40af-b956-b9b75919acbc => generated 1318 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:26.634138 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d5a5bebb-c303-4378-8b6f-29c50496f454 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:26.634138 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d5a5bebb-c303-4378-8b6f-29c50496f454 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: db1ac026-e512-4e5f-839d-4056cec509b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:26.665238 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d5a5bebb-c303-4378-8b6f-29c50496f454 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:26.670397 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d5a5bebb-c303-4378-8b6f-29c50496f454 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:26.673501 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d5a5bebb-c303-4378-8b6f-29c50496f454 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:26.678549 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d5a5bebb-c303-4378-8b6f-29c50496f454 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:26.679275 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d5a5bebb-c303-4378-8b6f-29c50496f454 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:26.679954 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d5a5bebb-c303-4378-8b6f-29c50496f454 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:26.865285 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6947bc3e-3963-485d-8568-c35933b2d9b5 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "GET /compute/v2.1/images/03df45dd-ab3d-44b8-97f9-0f9148109666" status: 200 len: 1461 microversion: 2.1 time: 3.036231 Aug 31 16:07:26.868225 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1362/2719] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:07:23 2022] GET /compute/v2.1/images/03df45dd-ab3d-44b8-97f9-0f9148109666 => generated 1461 bytes in 3040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:26.874701 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f00420a1-e91c-4dff-aee4-f7772ea0893f tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:26.875651 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f00420a1-e91c-4dff-aee4-f7772ea0893f tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] [instance: 685d47e4-721e-4eae-b5f8-78fdb68454ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:26.894393 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f00420a1-e91c-4dff-aee4-f7772ea0893f tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:26.895112 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f00420a1-e91c-4dff-aee4-f7772ea0893f tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:26.895932 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f00420a1-e91c-4dff-aee4-f7772ea0893f tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:26.897305 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f00420a1-e91c-4dff-aee4-f7772ea0893f tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:26.898127 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f00420a1-e91c-4dff-aee4-f7772ea0893f tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:26.898730 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f00420a1-e91c-4dff-aee4-f7772ea0893f tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:27.118167 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d5a5bebb-c303-4378-8b6f-29c50496f454 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:27.142303 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d5a5bebb-c303-4378-8b6f-29c50496f454 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/db1ac026-e512-4e5f-839d-4056cec509b3" status: 200 len: 1523 microversion: 2.1 time: 0.532147 Aug 31 16:07:27.143232 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1358/2720] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:26 2022] GET /compute/v2.1/servers/db1ac026-e512-4e5f-839d-4056cec509b3 => generated 1523 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:27.161820 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-8dd72ee8-5d16-478e-a568-3d2d4146a36e req-3fc47362-2e0d-462d-822e-b581d5838b27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db1ac026-e512-4e5f-839d-4056cec509b3", "name": "network-vif-plugged", "status": "completed", "tag": "af630af3-517b-4dc1-b7cf-dda0aebb1a90"}, {"server_uuid": "685d47e4-721e-4eae-b5f8-78fdb68454ae", "name": "network-vif-plugged", "status": "completed", "tag": "ad0f25db-5150-4147-a615-e7e75398c04e"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:07:27.181284 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-8dd72ee8-5d16-478e-a568-3d2d4146a36e req-3fc47362-2e0d-462d-822e-b581d5838b27 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:27.182089 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-8dd72ee8-5d16-478e-a568-3d2d4146a36e req-3fc47362-2e0d-462d-822e-b581d5838b27 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:27.182964 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-8dd72ee8-5d16-478e-a568-3d2d4146a36e req-3fc47362-2e0d-462d-822e-b581d5838b27 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:27.211662 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-8dd72ee8-5d16-478e-a568-3d2d4146a36e req-3fc47362-2e0d-462d-822e-b581d5838b27 service nova] Creating event network-vif-plugged:af630af3-517b-4dc1-b7cf-dda0aebb1a90 for instance db1ac026-e512-4e5f-839d-4056cec509b3 on n-h1-850499-9 Aug 31 16:07:27.212960 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-8dd72ee8-5d16-478e-a568-3d2d4146a36e req-3fc47362-2e0d-462d-822e-b581d5838b27 service nova] Creating event network-vif-plugged:ad0f25db-5150-4147-a615-e7e75398c04e for instance 685d47e4-721e-4eae-b5f8-78fdb68454ae on n-h2-850499-9 Aug 31 16:07:27.228676 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-8dd72ee8-5d16-478e-a568-3d2d4146a36e req-3fc47362-2e0d-462d-822e-b581d5838b27 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.083575 Aug 31 16:07:27.234638 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1359/2721] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:07:27 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:07:27.240753 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a79c0e78-f1a6-4a83-b843-c2d713ebab60 tempest-FloatingIPDetailsTestJSON-1928649283 tempest-FloatingIPDetailsTestJSON-1928649283-project] Action: 'create', calling method: .version_select at 0x7f5ae83d8d30>, body: {"pool": null} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:07:27.401206 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f00420a1-e91c-4dff-aee4-f7772ea0893f tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:27.411458 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f00420a1-e91c-4dff-aee4-f7772ea0893f tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:27.413700 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f00420a1-e91c-4dff-aee4-f7772ea0893f tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:27.415341 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f00420a1-e91c-4dff-aee4-f7772ea0893f tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] 10.222.0.61 "GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae" status: 200 len: 1875 microversion: 2.42 time: 0.545804 Aug 31 16:07:27.418392 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1363/2722] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:07:26 2022] GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae => generated 1875 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:07:27.437820 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d029e39f-4a65-4658-a71a-a5507ed914bc tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:27.438529 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d029e39f-4a65-4658-a71a-a5507ed914bc tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 8f165110-0ea6-48c0-8357-ba419171f7af] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:27.473309 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d029e39f-4a65-4658-a71a-a5507ed914bc tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:27.480742 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d029e39f-4a65-4658-a71a-a5507ed914bc tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:27.484872 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d029e39f-4a65-4658-a71a-a5507ed914bc tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:27.488282 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d029e39f-4a65-4658-a71a-a5507ed914bc tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:27.490871 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d029e39f-4a65-4658-a71a-a5507ed914bc tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:27.492302 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d029e39f-4a65-4658-a71a-a5507ed914bc tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:27.932568 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d029e39f-4a65-4658-a71a-a5507ed914bc tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:27.943648 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d029e39f-4a65-4658-a71a-a5507ed914bc tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/8f165110-0ea6-48c0-8357-ba419171f7af" status: 200 len: 1476 microversion: 2.1 time: 0.523858 Aug 31 16:07:27.944411 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1364/2723] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:27 2022] GET /compute/v2.1/servers/8f165110-0ea6-48c0-8357-ba419171f7af => generated 1476 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:28.277088 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7a742590-c8bd-4122-a639-ff680b8de6c8 tempest-ListImageFiltersNegativeTestJSON-1946330981 tempest-ListImageFiltersNegativeTestJSON-1946330981-project] Calling method '.version_select at 0x7f5aed2c88b0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:28.321167 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-7a742590-c8bd-4122-a639-ff680b8de6c8 tempest-ListImageFiltersNegativeTestJSON-1946330981 tempest-ListImageFiltersNegativeTestJSON-1946330981-project] HTTP exception thrown: Image not found. Aug 31 16:07:28.324216 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7a742590-c8bd-4122-a639-ff680b8de6c8 tempest-ListImageFiltersNegativeTestJSON-1946330981 tempest-ListImageFiltersNegativeTestJSON-1946330981-project] Request method failure captured: Aug 31 16:07:28.324216 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/images/a0b68bb5-b439-461e-a60a-725d1f214bd3 HTTP/1.1 Aug 31 16:07:28.324216 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:07:28.324216 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:07:28.324216 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:07:28.324216 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:07:28.324216 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:07:28.324216 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:07:28.324216 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:07:28.324216 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:07:28.324216 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4c-CKXo4OrW7b7rbNvtgD40SkJuzW7TpKOcbzRtBgfK8Xd51c0j3MBce3Ryux8ctOlCcUAEywHr4WhYi04OQ6DT2lx2UNpQrnvRvFWeu347WSTnUFSyMdJ1Gbmjl7-2YVZqSkLprdT7SEmp4_ee7MSfeLcK4Rh1mOY7Li8FlQhvIgg Aug 31 16:07:28.324216 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:07:28.324216 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:07:28.324216 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:07:28.324216 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:07:28.324216 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:07:28.324216 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:07:28.324216 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: fc892f70d61a46c88d37706b8de4e1db Aug 31 16:07:28.324216 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-1946330981 Aug 31 16:07:28.324216 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:07:28.324216 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:07:28.324216 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fc892f70d61a46c88d37706b8de4e1db"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/fc892f70d61a46c88d37706b8de4e1db"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_fc892f70d61a46c88d37706b8de4e1db", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fc892f70d61a46c88d37706b8de4e1db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:07:28.324216 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-1946330981 Aug 31 16:07:28.324216 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: fc892f70d61a46c88d37706b8de4e1db Aug 31 16:07:28.324216 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-1946330981 Aug 31 16:07:28.324216 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ListImageFiltersNegativeTestJSON-1946330981-project Aug 31 16:07:28.324216 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:07:28.324216 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:07:28.324216 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 03f89c547e2146f6a0abe4a860781cfb Aug 31 16:07:28.324216 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-1946330981-project Aug 31 16:07:28.324216 n-d-850499-9 devstack@n-api.service[122256]: method: Aug 31 16:07:28.324216 n-d-850499-9 devstack@n-api.service[122256]: exception: Image not found. Aug 31 16:07:28.324216 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': 'a0b68bb5-b439-461e-a60a-725d1f214bd3'} Aug 31 16:07:28.324216 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:07:28.324216 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:07:28.324216 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 31 16:07:28.324216 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 31 16:07:28.324216 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 31 16:07:28.324216 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 31 16:07:28.324216 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 31 16:07:28.324216 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 31 16:07:28.324216 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 31 16:07:28.324216 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 31 16:07:28.324216 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 31 16:07:28.324216 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 31 16:07:28.324216 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 31 16:07:28.324216 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 31 16:07:28.324216 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 31 16:07:28.324216 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 31 16:07:28.324216 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 31 16:07:28.324216 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 31 16:07:28.324216 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID a0b68bb5-b439-461e-a60a-725d1f214bd3 Aug 31 16:07:28.324216 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:07:28.324216 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:07:28.324216 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:07:28.324216 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:07:28.324216 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 31 16:07:28.324216 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 31 16:07:28.324216 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 31 16:07:28.324216 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 31 16:07:28.324216 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 31 16:07:28.324216 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 31 16:07:28.324216 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 31 16:07:28.331018 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 31 16:07:28.331018 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 31 16:07:28.331018 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 31 16:07:28.331018 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 31 16:07:28.331018 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 31 16:07:28.331018 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 31 16:07:28.331018 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 31 16:07:28.331018 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 31 16:07:28.331018 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 31 16:07:28.331018 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 31 16:07:28.331018 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 31 16:07:28.331018 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 31 16:07:28.331018 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 31 16:07:28.331018 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 31 16:07:28.331018 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 31 16:07:28.331018 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 31 16:07:28.331018 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 31 16:07:28.331018 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a0b68bb5-b439-461e-a60a-725d1f214bd3 could not be found. Aug 31 16:07:28.331018 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:07:28.331018 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:07:28.331018 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:07:28.331018 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:07:28.331018 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:07:28.331018 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:07:28.331018 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:07:28.331018 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:07:28.331018 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:07:28.331018 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:07:28.331018 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:07:28.331018 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:07:28.331018 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 31 16:07:28.331018 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 31 16:07:28.331018 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 31 16:07:28.331018 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:07:28.331018 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:07:28.331018 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:07:28.331018 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:07:28.331018 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:07:28.331018 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:07:28.331018 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:07:28.331018 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:07:28.331018 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 31 16:07:28.331018 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:07:28.331018 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7a742590-c8bd-4122-a639-ff680b8de6c8 tempest-ListImageFiltersNegativeTestJSON-1946330981 tempest-ListImageFiltersNegativeTestJSON-1946330981-project] Returning 404 to user: Image not found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:07:28.331018 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7a742590-c8bd-4122-a639-ff680b8de6c8 tempest-ListImageFiltersNegativeTestJSON-1946330981 tempest-ListImageFiltersNegativeTestJSON-1946330981-project] 10.222.0.61 "GET /compute/v2.1/images/a0b68bb5-b439-461e-a60a-725d1f214bd3" status: 404 len: 62 microversion: 2.1 time: 0.380148 Aug 31 16:07:28.338161 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1365/2724] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:07:27 2022] GET /compute/v2.1/images/a0b68bb5-b439-461e-a60a-725d1f214bd3 => generated 62 bytes in 388 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 31 16:07:28.343589 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-94e2ba09-c983-40a8-a614-a9812512e070 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '.version_select at 0x7f5ae8f1cca0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:28.423457 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-94e2ba09-c983-40a8-a614-a9812512e070 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "GET /compute/v2.1/images/03df45dd-ab3d-44b8-97f9-0f9148109666" status: 200 len: 1461 microversion: 2.1 time: 0.088406 Aug 31 16:07:28.425047 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1366/2725] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:07:28 2022] GET /compute/v2.1/images/03df45dd-ab3d-44b8-97f9-0f9148109666 => generated 1461 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:28.449828 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8fb8f51b-abef-4755-b70f-26bfba8766bc tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:28.459140 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8fb8f51b-abef-4755-b70f-26bfba8766bc tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] [instance: 1df89d79-3817-40af-b956-b9b75919acbc] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:28.482230 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8fb8f51b-abef-4755-b70f-26bfba8766bc tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:28.489439 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8fb8f51b-abef-4755-b70f-26bfba8766bc tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:28.490250 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8fb8f51b-abef-4755-b70f-26bfba8766bc tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:28.496919 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8fb8f51b-abef-4755-b70f-26bfba8766bc tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:28.497708 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8fb8f51b-abef-4755-b70f-26bfba8766bc tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:28.498402 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8fb8f51b-abef-4755-b70f-26bfba8766bc tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:28.600945 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=8 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:07:28.620491 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=4 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:07:29.015949 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8fb8f51b-abef-4755-b70f-26bfba8766bc tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb6a27e336449738f68a88d870ca6e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f79872256b2647d6a01c9e753b93b3c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:29.030623 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8fb8f51b-abef-4755-b70f-26bfba8766bc tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] 10.222.0.61 "GET /compute/v2.1/servers/1df89d79-3817-40af-b956-b9b75919acbc" status: 200 len: 1318 microversion: 2.1 time: 0.592882 Aug 31 16:07:29.037091 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1367/2726] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:28 2022] GET /compute/v2.1/servers/1df89d79-3817-40af-b956-b9b75919acbc => generated 1318 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:29.045852 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-9fa7d393-78a5-42d9-bb2d-7a5fb10e19ed req-fa7417dc-8565-4ced-941e-7ba6605e39a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1df89d79-3817-40af-b956-b9b75919acbc", "tag": "135eec2f-431d-42f1-8efa-c99feabd21c0"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:07:29.078973 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-9fa7d393-78a5-42d9-bb2d-7a5fb10e19ed req-fa7417dc-8565-4ced-941e-7ba6605e39a7 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:29.079563 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-9fa7d393-78a5-42d9-bb2d-7a5fb10e19ed req-fa7417dc-8565-4ced-941e-7ba6605e39a7 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:29.080207 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-9fa7d393-78a5-42d9-bb2d-7a5fb10e19ed req-fa7417dc-8565-4ced-941e-7ba6605e39a7 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:29.120755 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-9fa7d393-78a5-42d9-bb2d-7a5fb10e19ed req-fa7417dc-8565-4ced-941e-7ba6605e39a7 service nova] Creating event network-changed:135eec2f-431d-42f1-8efa-c99feabd21c0 for instance 1df89d79-3817-40af-b956-b9b75919acbc on n-h1-850499-9 Aug 31 16:07:29.126179 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-9fa7d393-78a5-42d9-bb2d-7a5fb10e19ed req-fa7417dc-8565-4ced-941e-7ba6605e39a7 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085891 Aug 31 16:07:29.127171 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1368/2727] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:07:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:07:29.147875 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4f22dc8a-9816-42d8-9316-73a280460d35 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:29.152621 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4f22dc8a-9816-42d8-9316-73a280460d35 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: db1ac026-e512-4e5f-839d-4056cec509b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:29.168327 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4f22dc8a-9816-42d8-9316-73a280460d35 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:29.169327 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4f22dc8a-9816-42d8-9316-73a280460d35 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:29.169881 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4f22dc8a-9816-42d8-9316-73a280460d35 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:29.171270 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4f22dc8a-9816-42d8-9316-73a280460d35 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:29.172578 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4f22dc8a-9816-42d8-9316-73a280460d35 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:29.173125 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4f22dc8a-9816-42d8-9316-73a280460d35 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:29.596994 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-4f22dc8a-9816-42d8-9316-73a280460d35 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:29.614655 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4f22dc8a-9816-42d8-9316-73a280460d35 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/db1ac026-e512-4e5f-839d-4056cec509b3" status: 200 len: 1523 microversion: 2.1 time: 0.483024 Aug 31 16:07:29.615984 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1369/2728] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:29 2022] GET /compute/v2.1/servers/db1ac026-e512-4e5f-839d-4056cec509b3 => generated 1523 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:29.624278 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1085271a-9141-4056-87e2-9d4ab3687ea6 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:29.625294 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1085271a-9141-4056-87e2-9d4ab3687ea6 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] [instance: 560a01e5-93f8-46c8-9261-5030e28766b4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:29.638534 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1085271a-9141-4056-87e2-9d4ab3687ea6 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:29.639399 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1085271a-9141-4056-87e2-9d4ab3687ea6 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:29.640081 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1085271a-9141-4056-87e2-9d4ab3687ea6 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:29.641021 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1085271a-9141-4056-87e2-9d4ab3687ea6 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:29.641953 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1085271a-9141-4056-87e2-9d4ab3687ea6 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:29.643013 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1085271a-9141-4056-87e2-9d4ab3687ea6 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:29.792909 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=7 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:07:30.156479 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1085271a-9141-4056-87e2-9d4ab3687ea6 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f0b27a48fd41dd846ba60856349ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4efd94380dcf4b3cb7a2b9fa194fcb83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:30.166036 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1085271a-9141-4056-87e2-9d4ab3687ea6 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "GET /compute/v2.1/servers/560a01e5-93f8-46c8-9261-5030e28766b4" status: 200 len: 1467 microversion: 2.1 time: 0.548139 Aug 31 16:07:30.183895 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1370/2729] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:29 2022] GET /compute/v2.1/servers/560a01e5-93f8-46c8-9261-5030e28766b4 => generated 1467 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:30.189239 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e48ae159-9e9e-4190-a716-bfcf58d26a1b tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:30.190746 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e48ae159-9e9e-4190-a716-bfcf58d26a1b tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] [instance: 685d47e4-721e-4eae-b5f8-78fdb68454ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:30.223445 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e48ae159-9e9e-4190-a716-bfcf58d26a1b tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:30.226091 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e48ae159-9e9e-4190-a716-bfcf58d26a1b tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:30.226670 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e48ae159-9e9e-4190-a716-bfcf58d26a1b tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:30.227699 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e48ae159-9e9e-4190-a716-bfcf58d26a1b tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:30.232608 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e48ae159-9e9e-4190-a716-bfcf58d26a1b tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:30.233435 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e48ae159-9e9e-4190-a716-bfcf58d26a1b tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:30.926849 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=26 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:07:31.232247 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e48ae159-9e9e-4190-a716-bfcf58d26a1b tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:31.251222 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e48ae159-9e9e-4190-a716-bfcf58d26a1b tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:31.263248 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e48ae159-9e9e-4190-a716-bfcf58d26a1b tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:31.264524 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e48ae159-9e9e-4190-a716-bfcf58d26a1b tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] 10.222.0.61 "GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae" status: 200 len: 1875 microversion: 2.42 time: 1.079213 Aug 31 16:07:31.265280 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1371/2730] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:07:30 2022] GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae => generated 1875 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:07:31.297019 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-556dac9b-aa96-4126-a0a6-f5ba426f2ad1 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:31.299849 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-556dac9b-aa96-4126-a0a6-f5ba426f2ad1 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 8f165110-0ea6-48c0-8357-ba419171f7af] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:31.339896 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-556dac9b-aa96-4126-a0a6-f5ba426f2ad1 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:31.342660 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-556dac9b-aa96-4126-a0a6-f5ba426f2ad1 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:31.346434 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-556dac9b-aa96-4126-a0a6-f5ba426f2ad1 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:31.347665 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-556dac9b-aa96-4126-a0a6-f5ba426f2ad1 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:31.353104 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-556dac9b-aa96-4126-a0a6-f5ba426f2ad1 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:31.356126 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-556dac9b-aa96-4126-a0a6-f5ba426f2ad1 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:32.089834 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-556dac9b-aa96-4126-a0a6-f5ba426f2ad1 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:32.114704 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a79c0e78-f1a6-4a83-b843-c2d713ebab60 tempest-FloatingIPDetailsTestJSON-1928649283 tempest-FloatingIPDetailsTestJSON-1928649283-project] 10.222.0.61 "POST /compute/v2.1/os-floating-ips" status: 200 len: 140 microversion: 2.1 time: 4.877634 Aug 31 16:07:32.118348 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1360/2731] 10.222.0.61 () {60 vars in 1170 bytes} [Wed Aug 31 16:07:27 2022] POST /compute/v2.1/os-floating-ips => generated 140 bytes in 4883 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:07:32.121952 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-556dac9b-aa96-4126-a0a6-f5ba426f2ad1 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/8f165110-0ea6-48c0-8357-ba419171f7af" status: 200 len: 1475 microversion: 2.1 time: 0.852923 Aug 31 16:07:32.123207 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1372/2732] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:31 2022] GET /compute/v2.1/servers/8f165110-0ea6-48c0-8357-ba419171f7af => generated 1475 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:32.144799 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-cefb95f3-56b2-4ba0-8b07-70f68fce20a4 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:32.148517 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-cefb95f3-56b2-4ba0-8b07-70f68fce20a4 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] [instance: 1df89d79-3817-40af-b956-b9b75919acbc] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:32.160266 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-efe2fcf3-4ba5-4e0e-a4c9-7958c8c1ecb9 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1683367776"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:07:32.173723 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-efe2fcf3-4ba5-4e0e-a4c9-7958c8c1ecb9 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] [instance: 359f06bd-00e9-4d68-b066-db73d7073a04] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:32.176920 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cefb95f3-56b2-4ba0-8b07-70f68fce20a4 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:32.177838 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cefb95f3-56b2-4ba0-8b07-70f68fce20a4 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:32.181949 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cefb95f3-56b2-4ba0-8b07-70f68fce20a4 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:32.188534 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cefb95f3-56b2-4ba0-8b07-70f68fce20a4 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:32.190934 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cefb95f3-56b2-4ba0-8b07-70f68fce20a4 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:32.192800 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cefb95f3-56b2-4ba0-8b07-70f68fce20a4 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:32.201829 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-efe2fcf3-4ba5-4e0e-a4c9-7958c8c1ecb9 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:32.204774 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-efe2fcf3-4ba5-4e0e-a4c9-7958c8c1ecb9 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:32.205863 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-efe2fcf3-4ba5-4e0e-a4c9-7958c8c1ecb9 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:32.210302 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-efe2fcf3-4ba5-4e0e-a4c9-7958c8c1ecb9 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:32.211991 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-efe2fcf3-4ba5-4e0e-a4c9-7958c8c1ecb9 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:32.218343 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-efe2fcf3-4ba5-4e0e-a4c9-7958c8c1ecb9 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:32.808387 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-efe2fcf3-4ba5-4e0e-a4c9-7958c8c1ecb9 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "POST /compute/v2.1/servers/359f06bd-00e9-4d68-b066-db73d7073a04/action" status: 202 len: 0 microversion: 2.1 time: 0.679550 Aug 31 16:07:32.809036 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1373/2733] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:07:32 2022] POST /compute/v2.1/servers/359f06bd-00e9-4d68-b066-db73d7073a04/action => generated 0 bytes in 685 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 31 16:07:32.830931 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-04a60abe-3e32-49bd-aaa9-19d93b8f44cc tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:32.831339 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-04a60abe-3e32-49bd-aaa9-19d93b8f44cc tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: db1ac026-e512-4e5f-839d-4056cec509b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:32.854001 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-04a60abe-3e32-49bd-aaa9-19d93b8f44cc tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:32.855375 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-04a60abe-3e32-49bd-aaa9-19d93b8f44cc tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:32.856640 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-04a60abe-3e32-49bd-aaa9-19d93b8f44cc tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:32.872172 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-04a60abe-3e32-49bd-aaa9-19d93b8f44cc tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:32.875238 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-04a60abe-3e32-49bd-aaa9-19d93b8f44cc tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:32.883819 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-04a60abe-3e32-49bd-aaa9-19d93b8f44cc tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:32.992332 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-cefb95f3-56b2-4ba0-8b07-70f68fce20a4 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb6a27e336449738f68a88d870ca6e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f79872256b2647d6a01c9e753b93b3c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:33.014291 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-cefb95f3-56b2-4ba0-8b07-70f68fce20a4 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] 10.222.0.61 "GET /compute/v2.1/servers/1df89d79-3817-40af-b956-b9b75919acbc" status: 200 len: 1318 microversion: 2.1 time: 0.892707 Aug 31 16:07:33.029221 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1361/2734] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:32 2022] GET /compute/v2.1/servers/1df89d79-3817-40af-b956-b9b75919acbc => generated 1318 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:33.035133 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-0f46a3b0-46a6-4c3e-92db-cce04c87bae7 req-3c041d09-1e79-4762-a694-e0f15a62ed4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f165110-0ea6-48c0-8357-ba419171f7af", "name": "network-vif-unplugged", "status": "completed", "tag": "900ed2dd-d7d4-47d6-b6c7-2d39286cc7dc"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:07:33.061804 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-0f46a3b0-46a6-4c3e-92db-cce04c87bae7 req-3c041d09-1e79-4762-a694-e0f15a62ed4d service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:33.067792 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-0f46a3b0-46a6-4c3e-92db-cce04c87bae7 req-3c041d09-1e79-4762-a694-e0f15a62ed4d service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:33.068469 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-0f46a3b0-46a6-4c3e-92db-cce04c87bae7 req-3c041d09-1e79-4762-a694-e0f15a62ed4d service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:33.094620 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-0f46a3b0-46a6-4c3e-92db-cce04c87bae7 req-3c041d09-1e79-4762-a694-e0f15a62ed4d service nova] Creating event network-vif-unplugged:900ed2dd-d7d4-47d6-b6c7-2d39286cc7dc for instance 8f165110-0ea6-48c0-8357-ba419171f7af on n-h2-850499-9 Aug 31 16:07:33.111905 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [req-0f46a3b0-46a6-4c3e-92db-cce04c87bae7 req-3c041d09-1e79-4762-a694-e0f15a62ed4d service nova] Instance 8f165110-0ea6-48c0-8357-ba419171f7af is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850499-9', 'n-h1-850499-9'} {{(pid=122257) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 31 16:07:33.163688 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-0f46a3b0-46a6-4c3e-92db-cce04c87bae7 req-3c041d09-1e79-4762-a694-e0f15a62ed4d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.131708 Aug 31 16:07:33.166031 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1362/2735] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:07:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:07:33.177320 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6673854c-abed-4e40-b65f-5a0a66358d3e tempest-FloatingIPDetailsTestJSON-1928649283 tempest-FloatingIPDetailsTestJSON-1928649283-project] Action: 'create', calling method: .version_select at 0x7f5ae83f29d0>, body: {"pool": null} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:07:33.687277 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-04a60abe-3e32-49bd-aaa9-19d93b8f44cc tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:33.701578 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-04a60abe-3e32-49bd-aaa9-19d93b8f44cc tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/db1ac026-e512-4e5f-839d-4056cec509b3" status: 200 len: 1523 microversion: 2.1 time: 0.891290 Aug 31 16:07:33.715942 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1374/2736] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:32 2022] GET /compute/v2.1/servers/db1ac026-e512-4e5f-839d-4056cec509b3 => generated 1523 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:33.721480 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-08c1f696-70c0-476f-b5e7-8af886e77391 req-be53b745-f3b4-4274-a3f0-7edcb3f15d5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "685d47e4-721e-4eae-b5f8-78fdb68454ae", "name": "network-vif-plugged", "status": "completed", "tag": "95c43f6b-98f3-4304-acef-e290fff017c7"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:07:33.732177 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-08c1f696-70c0-476f-b5e7-8af886e77391 req-be53b745-f3b4-4274-a3f0-7edcb3f15d5d service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:33.732878 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-08c1f696-70c0-476f-b5e7-8af886e77391 req-be53b745-f3b4-4274-a3f0-7edcb3f15d5d service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:33.733474 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-08c1f696-70c0-476f-b5e7-8af886e77391 req-be53b745-f3b4-4274-a3f0-7edcb3f15d5d service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:33.749035 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-08c1f696-70c0-476f-b5e7-8af886e77391 req-be53b745-f3b4-4274-a3f0-7edcb3f15d5d service nova] Creating event network-vif-plugged:95c43f6b-98f3-4304-acef-e290fff017c7 for instance 685d47e4-721e-4eae-b5f8-78fdb68454ae on n-h2-850499-9 Aug 31 16:07:33.756140 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-08c1f696-70c0-476f-b5e7-8af886e77391 req-be53b745-f3b4-4274-a3f0-7edcb3f15d5d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038463 Aug 31 16:07:33.757384 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1375/2737] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:07:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:07:33.764237 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c1c62433-d414-4775-aac6-8758a9367dc1 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:33.765500 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c1c62433-d414-4775-aac6-8758a9367dc1 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] [instance: 685d47e4-721e-4eae-b5f8-78fdb68454ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:33.772799 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c1c62433-d414-4775-aac6-8758a9367dc1 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:33.773739 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c1c62433-d414-4775-aac6-8758a9367dc1 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:33.774439 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c1c62433-d414-4775-aac6-8758a9367dc1 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:33.775801 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c1c62433-d414-4775-aac6-8758a9367dc1 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:33.776524 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c1c62433-d414-4775-aac6-8758a9367dc1 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:33.777168 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c1c62433-d414-4775-aac6-8758a9367dc1 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:33.781013 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:07:35.067995 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c1c62433-d414-4775-aac6-8758a9367dc1 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:35.100708 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c1c62433-d414-4775-aac6-8758a9367dc1 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:35.102670 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c1c62433-d414-4775-aac6-8758a9367dc1 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:35.104781 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c1c62433-d414-4775-aac6-8758a9367dc1 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] 10.222.0.61 "GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae" status: 200 len: 1875 microversion: 2.42 time: 1.345720 Aug 31 16:07:35.115929 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1376/2738] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:07:33 2022] GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae => generated 1875 bytes in 1358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:07:35.121627 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3e840584-4fa3-4a92-a47a-fe38daa21be7 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '.version_select at 0x7f5ae9326790>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:35.198887 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3e840584-4fa3-4a92-a47a-fe38daa21be7 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "GET /compute/v2.1/images/31a273f9-69d4-464b-8d35-a1a99ede5380" status: 200 len: 1453 microversion: 2.1 time: 0.081380 Aug 31 16:07:35.199837 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1377/2739] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:07:35 2022] GET /compute/v2.1/images/31a273f9-69d4-464b-8d35-a1a99ede5380 => generated 1453 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:35.205801 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6c32ca16-9c3e-4ef0-9a26-e8d420b2ba92 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:35.206870 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6c32ca16-9c3e-4ef0-9a26-e8d420b2ba92 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 8f165110-0ea6-48c0-8357-ba419171f7af] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:35.217236 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6c32ca16-9c3e-4ef0-9a26-e8d420b2ba92 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:35.218485 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6c32ca16-9c3e-4ef0-9a26-e8d420b2ba92 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:35.219141 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6c32ca16-9c3e-4ef0-9a26-e8d420b2ba92 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:35.220108 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6c32ca16-9c3e-4ef0-9a26-e8d420b2ba92 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:35.221375 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6c32ca16-9c3e-4ef0-9a26-e8d420b2ba92 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:35.222004 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6c32ca16-9c3e-4ef0-9a26-e8d420b2ba92 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:35.899212 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-6c32ca16-9c3e-4ef0-9a26-e8d420b2ba92 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:35.914132 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6c32ca16-9c3e-4ef0-9a26-e8d420b2ba92 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/8f165110-0ea6-48c0-8357-ba419171f7af" status: 200 len: 1475 microversion: 2.1 time: 0.712536 Aug 31 16:07:35.914863 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1378/2740] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:35 2022] GET /compute/v2.1/servers/8f165110-0ea6-48c0-8357-ba419171f7af => generated 1475 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:35.920853 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8d8110e8-66df-4d52-a473-701fb4ec7e55 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:35.921617 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8d8110e8-66df-4d52-a473-701fb4ec7e55 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] [instance: 1df89d79-3817-40af-b956-b9b75919acbc] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:35.958262 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8d8110e8-66df-4d52-a473-701fb4ec7e55 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:35.958807 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8d8110e8-66df-4d52-a473-701fb4ec7e55 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:35.959255 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8d8110e8-66df-4d52-a473-701fb4ec7e55 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:35.960086 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8d8110e8-66df-4d52-a473-701fb4ec7e55 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:35.960634 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8d8110e8-66df-4d52-a473-701fb4ec7e55 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:35.961002 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8d8110e8-66df-4d52-a473-701fb4ec7e55 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:36.667927 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8d8110e8-66df-4d52-a473-701fb4ec7e55 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb6a27e336449738f68a88d870ca6e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f79872256b2647d6a01c9e753b93b3c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:36.711895 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8d8110e8-66df-4d52-a473-701fb4ec7e55 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] 10.222.0.61 "GET /compute/v2.1/servers/1df89d79-3817-40af-b956-b9b75919acbc" status: 200 len: 1318 microversion: 2.1 time: 0.788154 Aug 31 16:07:36.713546 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1379/2741] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:35 2022] GET /compute/v2.1/servers/1df89d79-3817-40af-b956-b9b75919acbc => generated 1318 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:36.725412 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b58ffc1f-08c6-4517-97fb-b5766b1b8ff0 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:36.733782 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b58ffc1f-08c6-4517-97fb-b5766b1b8ff0 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: db1ac026-e512-4e5f-839d-4056cec509b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:36.754010 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b58ffc1f-08c6-4517-97fb-b5766b1b8ff0 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:36.758248 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b58ffc1f-08c6-4517-97fb-b5766b1b8ff0 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:36.758849 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b58ffc1f-08c6-4517-97fb-b5766b1b8ff0 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:36.759750 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b58ffc1f-08c6-4517-97fb-b5766b1b8ff0 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:36.760851 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b58ffc1f-08c6-4517-97fb-b5766b1b8ff0 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:36.766920 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b58ffc1f-08c6-4517-97fb-b5766b1b8ff0 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:38.006529 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b58ffc1f-08c6-4517-97fb-b5766b1b8ff0 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:38.019150 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b58ffc1f-08c6-4517-97fb-b5766b1b8ff0 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/db1ac026-e512-4e5f-839d-4056cec509b3" status: 200 len: 1523 microversion: 2.1 time: 1.302361 Aug 31 16:07:38.027873 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1380/2742] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:36 2022] GET /compute/v2.1/servers/db1ac026-e512-4e5f-839d-4056cec509b3 => generated 1523 bytes in 1312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:38.039066 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-3ebc7621-64c8-47c6-83cc-4d6aec4310ce req-39a8101c-c74a-4276-80c2-c7e07743a03e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f165110-0ea6-48c0-8357-ba419171f7af", "tag": "900ed2dd-d7d4-47d6-b6c7-2d39286cc7dc"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:07:38.090417 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-3ebc7621-64c8-47c6-83cc-4d6aec4310ce req-39a8101c-c74a-4276-80c2-c7e07743a03e service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:38.091172 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-3ebc7621-64c8-47c6-83cc-4d6aec4310ce req-39a8101c-c74a-4276-80c2-c7e07743a03e service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:38.091747 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-3ebc7621-64c8-47c6-83cc-4d6aec4310ce req-39a8101c-c74a-4276-80c2-c7e07743a03e service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:38.134528 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-3ebc7621-64c8-47c6-83cc-4d6aec4310ce req-39a8101c-c74a-4276-80c2-c7e07743a03e service nova] Creating event network-changed:900ed2dd-d7d4-47d6-b6c7-2d39286cc7dc for instance 8f165110-0ea6-48c0-8357-ba419171f7af on n-h2-850499-9 Aug 31 16:07:38.158522 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [req-3ebc7621-64c8-47c6-83cc-4d6aec4310ce req-39a8101c-c74a-4276-80c2-c7e07743a03e service nova] Instance 8f165110-0ea6-48c0-8357-ba419171f7af is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850499-9', 'n-h1-850499-9'} {{(pid=122256) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 31 16:07:38.163274 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6673854c-abed-4e40-b65f-5a0a66358d3e tempest-FloatingIPDetailsTestJSON-1928649283 tempest-FloatingIPDetailsTestJSON-1928649283-project] 10.222.0.61 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.994476 Aug 31 16:07:38.165297 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1363/2743] 10.222.0.61 () {60 vars in 1170 bytes} [Wed Aug 31 16:07:33 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4998 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:07:38.180529 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-79897709-4717-47be-874e-331f71426834 req-d488c685-3628-45a2-9c07-b66a0049186e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "685d47e4-721e-4eae-b5f8-78fdb68454ae", "name": "network-vif-plugged", "status": "completed", "tag": "4f30e818-6489-4d7e-b214-37689cbe6c21"}, {"server_uuid": "685d47e4-721e-4eae-b5f8-78fdb68454ae", "name": "network-vif-plugged", "status": "completed", "tag": "8734df6b-18ab-45c5-8c67-15fbeeb4e447"}, {"server_uuid": "685d47e4-721e-4eae-b5f8-78fdb68454ae", "name": "network-vif-plugged", "status": "completed", "tag": "4fb7438a-39e7-4bab-9387-26385ed169d1"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:07:38.222025 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-3ebc7621-64c8-47c6-83cc-4d6aec4310ce req-39a8101c-c74a-4276-80c2-c7e07743a03e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.192534 Aug 31 16:07:38.222671 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1381/2744] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:07:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:07:38.247873 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-79897709-4717-47be-874e-331f71426834 req-d488c685-3628-45a2-9c07-b66a0049186e service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:38.248387 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-79897709-4717-47be-874e-331f71426834 req-d488c685-3628-45a2-9c07-b66a0049186e service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:38.248838 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-79897709-4717-47be-874e-331f71426834 req-d488c685-3628-45a2-9c07-b66a0049186e service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:38.251243 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6f03228d-62fc-4a4e-ae84-2cf489b29bbb tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:38.257485 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6f03228d-62fc-4a4e-ae84-2cf489b29bbb tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] [instance: 685d47e4-721e-4eae-b5f8-78fdb68454ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:38.283050 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6f03228d-62fc-4a4e-ae84-2cf489b29bbb tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:38.286787 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6f03228d-62fc-4a4e-ae84-2cf489b29bbb tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:38.289863 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6f03228d-62fc-4a4e-ae84-2cf489b29bbb tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:38.292863 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6f03228d-62fc-4a4e-ae84-2cf489b29bbb tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:38.299673 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6f03228d-62fc-4a4e-ae84-2cf489b29bbb tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:38.301571 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6f03228d-62fc-4a4e-ae84-2cf489b29bbb tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:38.311165 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-79897709-4717-47be-874e-331f71426834 req-d488c685-3628-45a2-9c07-b66a0049186e service nova] Creating event network-vif-plugged:4f30e818-6489-4d7e-b214-37689cbe6c21 for instance 685d47e4-721e-4eae-b5f8-78fdb68454ae on n-h2-850499-9 Aug 31 16:07:38.313163 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-79897709-4717-47be-874e-331f71426834 req-d488c685-3628-45a2-9c07-b66a0049186e service nova] Creating event network-vif-plugged:8734df6b-18ab-45c5-8c67-15fbeeb4e447 for instance 685d47e4-721e-4eae-b5f8-78fdb68454ae on n-h2-850499-9 Aug 31 16:07:38.316365 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-79897709-4717-47be-874e-331f71426834 req-d488c685-3628-45a2-9c07-b66a0049186e service nova] Creating event network-vif-plugged:4fb7438a-39e7-4bab-9387-26385ed169d1 for instance 685d47e4-721e-4eae-b5f8-78fdb68454ae on n-h2-850499-9 Aug 31 16:07:38.329847 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-79897709-4717-47be-874e-331f71426834 req-d488c685-3628-45a2-9c07-b66a0049186e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.162943 Aug 31 16:07:38.330712 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1364/2745] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:07:38 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:07:38.339092 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1b1be75c-c109-438e-820b-3aae33f136e5 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '.version_select at 0x7f5ae83f2820>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:38.459591 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1b1be75c-c109-438e-820b-3aae33f136e5 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "GET /compute/v2.1/images/31a273f9-69d4-464b-8d35-a1a99ede5380" status: 200 len: 1453 microversion: 2.1 time: 0.127244 Aug 31 16:07:38.469811 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1365/2746] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:07:38 2022] GET /compute/v2.1/images/31a273f9-69d4-464b-8d35-a1a99ede5380 => generated 1453 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:38.474996 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9a178c61-101a-4c99-814f-c7dbd98dea51 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:38.476091 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9a178c61-101a-4c99-814f-c7dbd98dea51 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 8f165110-0ea6-48c0-8357-ba419171f7af] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:38.484177 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9a178c61-101a-4c99-814f-c7dbd98dea51 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:38.484925 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9a178c61-101a-4c99-814f-c7dbd98dea51 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:38.485530 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9a178c61-101a-4c99-814f-c7dbd98dea51 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:38.486403 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9a178c61-101a-4c99-814f-c7dbd98dea51 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:38.487197 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9a178c61-101a-4c99-814f-c7dbd98dea51 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:38.487790 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9a178c61-101a-4c99-814f-c7dbd98dea51 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:39.173883 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-6f03228d-62fc-4a4e-ae84-2cf489b29bbb tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:39.193486 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-6f03228d-62fc-4a4e-ae84-2cf489b29bbb tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:39.208212 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-6f03228d-62fc-4a4e-ae84-2cf489b29bbb tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:39.209689 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6f03228d-62fc-4a4e-ae84-2cf489b29bbb tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] 10.222.0.61 "GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae" status: 200 len: 1875 microversion: 2.42 time: 0.978692 Aug 31 16:07:39.210410 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1382/2747] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:07:38 2022] GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae => generated 1875 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:07:39.238403 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2f6fda2d-73bc-4405-8c0a-8833f31ec4f4 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:39.239589 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2f6fda2d-73bc-4405-8c0a-8833f31ec4f4 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] [instance: 1df89d79-3817-40af-b956-b9b75919acbc] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:39.253900 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2f6fda2d-73bc-4405-8c0a-8833f31ec4f4 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:39.254677 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2f6fda2d-73bc-4405-8c0a-8833f31ec4f4 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:39.255292 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2f6fda2d-73bc-4405-8c0a-8833f31ec4f4 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:39.256244 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2f6fda2d-73bc-4405-8c0a-8833f31ec4f4 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:39.256871 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2f6fda2d-73bc-4405-8c0a-8833f31ec4f4 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:39.257577 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2f6fda2d-73bc-4405-8c0a-8833f31ec4f4 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:39.337868 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9a178c61-101a-4c99-814f-c7dbd98dea51 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:39.358184 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9a178c61-101a-4c99-814f-c7dbd98dea51 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/8f165110-0ea6-48c0-8357-ba419171f7af" status: 200 len: 1473 microversion: 2.1 time: 0.886400 Aug 31 16:07:39.359557 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1366/2748] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:38 2022] GET /compute/v2.1/servers/8f165110-0ea6-48c0-8357-ba419171f7af => generated 1473 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:39.391025 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f4411532-d985-4602-a12b-e0bd6b26e5f3 tempest-FloatingIPDetailsTestJSON-1928649283 tempest-FloatingIPDetailsTestJSON-1928649283-project] Action: 'create', calling method: .version_select at 0x7f5ae83d8d30>, body: {"pool": null} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:07:40.295162 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-2f6fda2d-73bc-4405-8c0a-8833f31ec4f4 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb6a27e336449738f68a88d870ca6e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f79872256b2647d6a01c9e753b93b3c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:40.333481 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2f6fda2d-73bc-4405-8c0a-8833f31ec4f4 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] 10.222.0.61 "GET /compute/v2.1/servers/1df89d79-3817-40af-b956-b9b75919acbc" status: 200 len: 1318 microversion: 2.1 time: 1.101714 Aug 31 16:07:40.334956 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1383/2749] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:39 2022] GET /compute/v2.1/servers/1df89d79-3817-40af-b956-b9b75919acbc => generated 1318 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:40.346992 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ea98e999-f919-47fe-975f-24056e2ac470 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:40.348411 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ea98e999-f919-47fe-975f-24056e2ac470 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: db1ac026-e512-4e5f-839d-4056cec509b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:40.367216 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ea98e999-f919-47fe-975f-24056e2ac470 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:40.374395 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ea98e999-f919-47fe-975f-24056e2ac470 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:40.375769 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ea98e999-f919-47fe-975f-24056e2ac470 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:40.377380 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ea98e999-f919-47fe-975f-24056e2ac470 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:40.378753 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ea98e999-f919-47fe-975f-24056e2ac470 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:40.379855 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ea98e999-f919-47fe-975f-24056e2ac470 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:40.943182 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ea98e999-f919-47fe-975f-24056e2ac470 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:40.969723 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ea98e999-f919-47fe-975f-24056e2ac470 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/db1ac026-e512-4e5f-839d-4056cec509b3" status: 200 len: 1523 microversion: 2.1 time: 0.632357 Aug 31 16:07:40.970788 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1384/2750] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:40 2022] GET /compute/v2.1/servers/db1ac026-e512-4e5f-839d-4056cec509b3 => generated 1523 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:40.995795 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7ebcb122-2178-41fa-a323-c680d21be536 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '.version_select at 0x7f5ae8f9c8b0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:41.110975 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7ebcb122-2178-41fa-a323-c680d21be536 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "GET /compute/v2.1/images/31a273f9-69d4-464b-8d35-a1a99ede5380" status: 200 len: 1453 microversion: 2.1 time: 0.127175 Aug 31 16:07:41.111627 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1385/2751] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:07:40 2022] GET /compute/v2.1/images/31a273f9-69d4-464b-8d35-a1a99ede5380 => generated 1453 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:41.132770 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a7d26901-9b43-45bd-8f38-d57b5801a2a8 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:41.134428 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a7d26901-9b43-45bd-8f38-d57b5801a2a8 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] [instance: 685d47e4-721e-4eae-b5f8-78fdb68454ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:41.183359 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:07:41.188872 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a7d26901-9b43-45bd-8f38-d57b5801a2a8 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:41.189511 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a7d26901-9b43-45bd-8f38-d57b5801a2a8 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:41.190003 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a7d26901-9b43-45bd-8f38-d57b5801a2a8 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:41.190925 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a7d26901-9b43-45bd-8f38-d57b5801a2a8 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:41.191408 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a7d26901-9b43-45bd-8f38-d57b5801a2a8 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:41.191934 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a7d26901-9b43-45bd-8f38-d57b5801a2a8 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:42.013532 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a7d26901-9b43-45bd-8f38-d57b5801a2a8 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:42.101085 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a7d26901-9b43-45bd-8f38-d57b5801a2a8 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:42.104788 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a7d26901-9b43-45bd-8f38-d57b5801a2a8 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:42.113925 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a7d26901-9b43-45bd-8f38-d57b5801a2a8 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] 10.222.0.61 "GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae" status: 200 len: 1875 microversion: 2.42 time: 1.000771 Aug 31 16:07:42.121098 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1386/2752] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:07:41 2022] GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae => generated 1875 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:07:42.140164 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-fb2a3c27-f658-4f6c-9cd2-20db7b072998 req-7d136cf5-8ab1-448c-8a6a-9a6816645bc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "685d47e4-721e-4eae-b5f8-78fdb68454ae", "name": "network-vif-plugged", "status": "completed", "tag": "b14c9074-fcb3-408a-abec-9842ca262740"}, {"server_uuid": "560a01e5-93f8-46c8-9261-5030e28766b4", "name": "network-vif-unplugged", "status": "completed", "tag": "f7a3259e-6ecb-48c9-a90a-0b0d027258f4"}, {"server_uuid": "1df89d79-3817-40af-b956-b9b75919acbc", "name": "network-vif-plugged", "status": "completed", "tag": "135eec2f-431d-42f1-8efa-c99feabd21c0"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:07:42.208302 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-fb2a3c27-f658-4f6c-9cd2-20db7b072998 req-7d136cf5-8ab1-448c-8a6a-9a6816645bc9 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:42.209250 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-fb2a3c27-f658-4f6c-9cd2-20db7b072998 req-7d136cf5-8ab1-448c-8a6a-9a6816645bc9 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:42.210048 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-fb2a3c27-f658-4f6c-9cd2-20db7b072998 req-7d136cf5-8ab1-448c-8a6a-9a6816645bc9 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:42.303095 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-fb2a3c27-f658-4f6c-9cd2-20db7b072998 req-7d136cf5-8ab1-448c-8a6a-9a6816645bc9 service nova] Creating event network-vif-plugged:b14c9074-fcb3-408a-abec-9842ca262740 for instance 685d47e4-721e-4eae-b5f8-78fdb68454ae on n-h2-850499-9 Aug 31 16:07:42.304472 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-fb2a3c27-f658-4f6c-9cd2-20db7b072998 req-7d136cf5-8ab1-448c-8a6a-9a6816645bc9 service nova] Creating event network-vif-unplugged:f7a3259e-6ecb-48c9-a90a-0b0d027258f4 for instance 560a01e5-93f8-46c8-9261-5030e28766b4 on n-h2-850499-9 Aug 31 16:07:42.305656 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-fb2a3c27-f658-4f6c-9cd2-20db7b072998 req-7d136cf5-8ab1-448c-8a6a-9a6816645bc9 service nova] Creating event network-vif-plugged:135eec2f-431d-42f1-8efa-c99feabd21c0 for instance 1df89d79-3817-40af-b956-b9b75919acbc on n-h1-850499-9 Aug 31 16:07:42.446147 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-fb2a3c27-f658-4f6c-9cd2-20db7b072998 req-7d136cf5-8ab1-448c-8a6a-9a6816645bc9 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.322963 Aug 31 16:07:42.459935 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1387/2753] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:07:42 2022] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:07:42.473498 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e0fad3c9-a6e8-4b82-a768-ea4dbc2f68e2 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:42.474942 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e0fad3c9-a6e8-4b82-a768-ea4dbc2f68e2 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 8f165110-0ea6-48c0-8357-ba419171f7af] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:42.483903 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e0fad3c9-a6e8-4b82-a768-ea4dbc2f68e2 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:42.485298 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e0fad3c9-a6e8-4b82-a768-ea4dbc2f68e2 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:42.485911 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e0fad3c9-a6e8-4b82-a768-ea4dbc2f68e2 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:42.486818 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e0fad3c9-a6e8-4b82-a768-ea4dbc2f68e2 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:42.487426 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e0fad3c9-a6e8-4b82-a768-ea4dbc2f68e2 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:42.488217 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e0fad3c9-a6e8-4b82-a768-ea4dbc2f68e2 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:43.360398 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e0fad3c9-a6e8-4b82-a768-ea4dbc2f68e2 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:43.372778 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e0fad3c9-a6e8-4b82-a768-ea4dbc2f68e2 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/8f165110-0ea6-48c0-8357-ba419171f7af" status: 200 len: 1473 microversion: 2.1 time: 0.910896 Aug 31 16:07:43.396222 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1388/2754] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:42 2022] GET /compute/v2.1/servers/8f165110-0ea6-48c0-8357-ba419171f7af => generated 1473 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:43.416201 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-170e0ebc-f62a-47e8-bfa3-8c430da24aa5 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:43.416840 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-170e0ebc-f62a-47e8-bfa3-8c430da24aa5 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] [instance: 1df89d79-3817-40af-b956-b9b75919acbc] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:43.436196 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-170e0ebc-f62a-47e8-bfa3-8c430da24aa5 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:43.436713 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-170e0ebc-f62a-47e8-bfa3-8c430da24aa5 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:43.437163 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-170e0ebc-f62a-47e8-bfa3-8c430da24aa5 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:43.437893 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-170e0ebc-f62a-47e8-bfa3-8c430da24aa5 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:43.438530 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-170e0ebc-f62a-47e8-bfa3-8c430da24aa5 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:43.439223 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-170e0ebc-f62a-47e8-bfa3-8c430da24aa5 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:43.823260 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-170e0ebc-f62a-47e8-bfa3-8c430da24aa5 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb6a27e336449738f68a88d870ca6e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f79872256b2647d6a01c9e753b93b3c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:43.836676 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-170e0ebc-f62a-47e8-bfa3-8c430da24aa5 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] 10.222.0.61 "GET /compute/v2.1/servers/1df89d79-3817-40af-b956-b9b75919acbc" status: 200 len: 1318 microversion: 2.1 time: 0.438876 Aug 31 16:07:43.856172 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1389/2755] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:43 2022] GET /compute/v2.1/servers/1df89d79-3817-40af-b956-b9b75919acbc => generated 1318 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:43.866464 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7d212fac-66ba-40d2-95d9-cbef3e4bf4b2 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:43.867546 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7d212fac-66ba-40d2-95d9-cbef3e4bf4b2 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: db1ac026-e512-4e5f-839d-4056cec509b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:43.875457 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7d212fac-66ba-40d2-95d9-cbef3e4bf4b2 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:43.876404 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7d212fac-66ba-40d2-95d9-cbef3e4bf4b2 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:43.877065 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7d212fac-66ba-40d2-95d9-cbef3e4bf4b2 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:43.878051 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7d212fac-66ba-40d2-95d9-cbef3e4bf4b2 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:43.878867 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7d212fac-66ba-40d2-95d9-cbef3e4bf4b2 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:43.879571 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7d212fac-66ba-40d2-95d9-cbef3e4bf4b2 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:44.274687 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7d212fac-66ba-40d2-95d9-cbef3e4bf4b2 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:44.290935 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7d212fac-66ba-40d2-95d9-cbef3e4bf4b2 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/db1ac026-e512-4e5f-839d-4056cec509b3" status: 200 len: 1523 microversion: 2.1 time: 0.432562 Aug 31 16:07:44.292984 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1390/2756] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:43 2022] GET /compute/v2.1/servers/db1ac026-e512-4e5f-839d-4056cec509b3 => generated 1523 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:44.305776 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-89268b73-707b-462f-9301-a4bfc7773d42 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '.version_select at 0x7f5aed2c8ca0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:44.387658 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-89268b73-707b-462f-9301-a4bfc7773d42 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "GET /compute/v2.1/images/31a273f9-69d4-464b-8d35-a1a99ede5380" status: 200 len: 1453 microversion: 2.1 time: 0.092472 Aug 31 16:07:44.389023 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1391/2757] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:07:44 2022] GET /compute/v2.1/images/31a273f9-69d4-464b-8d35-a1a99ede5380 => generated 1453 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:44.602130 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d0d3d21f-fda5-48cc-a610-ee0595b26905 tempest-SecurityGroupRulesNegativeTestJSON-8994449 tempest-SecurityGroupRulesNegativeTestJSON-8994449-project] Action: 'create', calling method: .version_select at 0x7f5ae9357430>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1209703456", "description": "tempest-description-2113732023"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:07:44.728706 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f4411532-d985-4602-a12b-e0bd6b26e5f3 tempest-FloatingIPDetailsTestJSON-1928649283 tempest-FloatingIPDetailsTestJSON-1928649283-project] 10.222.0.61 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.354792 Aug 31 16:07:44.730985 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1367/2758] 10.222.0.61 () {60 vars in 1170 bytes} [Wed Aug 31 16:07:39 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:07:44.736953 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-15c6b9e3-3e77-453d-9e85-90b2ec6b032c tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:44.737585 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-15c6b9e3-3e77-453d-9e85-90b2ec6b032c tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] [instance: 685d47e4-721e-4eae-b5f8-78fdb68454ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:44.752186 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-15c6b9e3-3e77-453d-9e85-90b2ec6b032c tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:44.752691 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-15c6b9e3-3e77-453d-9e85-90b2ec6b032c tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:44.753131 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-15c6b9e3-3e77-453d-9e85-90b2ec6b032c tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:44.753844 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-15c6b9e3-3e77-453d-9e85-90b2ec6b032c tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:44.754298 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-15c6b9e3-3e77-453d-9e85-90b2ec6b032c tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:44.754732 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-15c6b9e3-3e77-453d-9e85-90b2ec6b032c tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:45.068087 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d0d3d21f-fda5-48cc-a610-ee0595b26905 tempest-SecurityGroupRulesNegativeTestJSON-8994449 tempest-SecurityGroupRulesNegativeTestJSON-8994449-project] 10.222.0.61 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.676411 Aug 31 16:07:45.084845 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1392/2759] 10.222.0.61 () {60 vars in 1180 bytes} [Wed Aug 31 16:07:44 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:07:45.096572 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-00734b6c-bef9-4ec0-bfa2-8a8811f4a777 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:45.106112 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-00734b6c-bef9-4ec0-bfa2-8a8811f4a777 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 8f165110-0ea6-48c0-8357-ba419171f7af] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:45.117198 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-00734b6c-bef9-4ec0-bfa2-8a8811f4a777 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:45.118210 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-00734b6c-bef9-4ec0-bfa2-8a8811f4a777 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:45.118871 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-00734b6c-bef9-4ec0-bfa2-8a8811f4a777 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:45.119897 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-00734b6c-bef9-4ec0-bfa2-8a8811f4a777 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:45.121011 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-00734b6c-bef9-4ec0-bfa2-8a8811f4a777 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:45.121668 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-00734b6c-bef9-4ec0-bfa2-8a8811f4a777 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:45.208318 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-15c6b9e3-3e77-453d-9e85-90b2ec6b032c tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:45.248177 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-15c6b9e3-3e77-453d-9e85-90b2ec6b032c tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:45.252998 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-15c6b9e3-3e77-453d-9e85-90b2ec6b032c tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:45.257053 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-15c6b9e3-3e77-453d-9e85-90b2ec6b032c tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] 10.222.0.61 "GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae" status: 200 len: 1875 microversion: 2.42 time: 0.524292 Aug 31 16:07:45.258424 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1368/2760] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:07:44 2022] GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae => generated 1875 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:07:45.269460 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-ad734cac-6c26-4010-b6d2-0546017683db req-2f3e419f-a96f-4db3-b3a2-658463478442 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "359f06bd-00e9-4d68-b066-db73d7073a04", "name": "network-vif-plugged", "status": "completed", "tag": "0cd3b24d-ce36-4d42-806b-496fd2089b1b"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:07:45.318298 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-ad734cac-6c26-4010-b6d2-0546017683db req-2f3e419f-a96f-4db3-b3a2-658463478442 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:45.318796 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-ad734cac-6c26-4010-b6d2-0546017683db req-2f3e419f-a96f-4db3-b3a2-658463478442 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:45.319242 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-ad734cac-6c26-4010-b6d2-0546017683db req-2f3e419f-a96f-4db3-b3a2-658463478442 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:45.349998 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-ad734cac-6c26-4010-b6d2-0546017683db req-2f3e419f-a96f-4db3-b3a2-658463478442 service nova] Creating event network-vif-plugged:0cd3b24d-ce36-4d42-806b-496fd2089b1b for instance 359f06bd-00e9-4d68-b066-db73d7073a04 on n-h1-850499-9 Aug 31 16:07:45.364251 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-ad734cac-6c26-4010-b6d2-0546017683db req-2f3e419f-a96f-4db3-b3a2-658463478442 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102380 Aug 31 16:07:45.365374 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1369/2761] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:07:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:07:45.378053 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ed151ed0-7119-4256-820e-6e5ca1abd099 tempest-FloatingIPDetailsTestJSON-1928649283 tempest-FloatingIPDetailsTestJSON-1928649283-project] Calling method '.version_select at 0x7f5ae83d6160>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:45.521373 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-00734b6c-bef9-4ec0-bfa2-8a8811f4a777 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:45.532134 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-00734b6c-bef9-4ec0-bfa2-8a8811f4a777 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/8f165110-0ea6-48c0-8357-ba419171f7af" status: 200 len: 1470 microversion: 2.1 time: 0.445394 Aug 31 16:07:45.551537 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1393/2762] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:45 2022] GET /compute/v2.1/servers/8f165110-0ea6-48c0-8357-ba419171f7af => generated 1470 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:45.558921 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-11135ef0-556a-485d-ae51-2b5809e7e13e tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:45.558921 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-11135ef0-556a-485d-ae51-2b5809e7e13e tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] [instance: 1df89d79-3817-40af-b956-b9b75919acbc] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:45.583341 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-11135ef0-556a-485d-ae51-2b5809e7e13e tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:45.584041 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-11135ef0-556a-485d-ae51-2b5809e7e13e tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:45.584591 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-11135ef0-556a-485d-ae51-2b5809e7e13e tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:45.585426 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-11135ef0-556a-485d-ae51-2b5809e7e13e tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:45.586025 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-11135ef0-556a-485d-ae51-2b5809e7e13e tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:45.586559 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-11135ef0-556a-485d-ae51-2b5809e7e13e tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:45.861406 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ed151ed0-7119-4256-820e-6e5ca1abd099 tempest-FloatingIPDetailsTestJSON-1928649283 tempest-FloatingIPDetailsTestJSON-1928649283-project] 10.222.0.61 "GET /compute/v2.1/os-floating-ips/93dc55d5-1ad3-42d6-a4a5-bfb518200c7f" status: 200 len: 142 microversion: 2.1 time: 0.493465 Aug 31 16:07:45.871306 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1370/2763] 10.222.0.61 () {58 vars in 1260 bytes} [Wed Aug 31 16:07:45 2022] GET /compute/v2.1/os-floating-ips/93dc55d5-1ad3-42d6-a4a5-bfb518200c7f => generated 142 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:07:45.878043 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-25e4050a-ada5-451c-a877-0378022f5539 tempest-SecurityGroupRulesNegativeTestJSON-8994449 tempest-SecurityGroupRulesNegativeTestJSON-8994449-project] Action: 'create', calling method: .version_select at 0x7f5ae84af940>, body: {"security_group_rule": {"parent_group_id": "938af94a-8bcd-4d0c-8bfb-a011640e85ff", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:07:45.989743 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-11135ef0-556a-485d-ae51-2b5809e7e13e tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb6a27e336449738f68a88d870ca6e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f79872256b2647d6a01c9e753b93b3c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:46.006605 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-11135ef0-556a-485d-ae51-2b5809e7e13e tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] 10.222.0.61 "GET /compute/v2.1/servers/1df89d79-3817-40af-b956-b9b75919acbc" status: 200 len: 1466 microversion: 2.1 time: 0.467194 Aug 31 16:07:46.008034 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1394/2764] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:45 2022] GET /compute/v2.1/servers/1df89d79-3817-40af-b956-b9b75919acbc => generated 1466 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:46.014957 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4b72df09-8b86-464e-baf4-ae4f07696ba2 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:46.016014 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4b72df09-8b86-464e-baf4-ae4f07696ba2 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: db1ac026-e512-4e5f-839d-4056cec509b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:46.046892 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4b72df09-8b86-464e-baf4-ae4f07696ba2 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:46.049944 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4b72df09-8b86-464e-baf4-ae4f07696ba2 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:46.054986 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4b72df09-8b86-464e-baf4-ae4f07696ba2 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:46.057374 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4b72df09-8b86-464e-baf4-ae4f07696ba2 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:46.062854 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4b72df09-8b86-464e-baf4-ae4f07696ba2 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:46.064815 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4b72df09-8b86-464e-baf4-ae4f07696ba2 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:46.563907 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-4b72df09-8b86-464e-baf4-ae4f07696ba2 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:46.584824 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4b72df09-8b86-464e-baf4-ae4f07696ba2 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/db1ac026-e512-4e5f-839d-4056cec509b3" status: 200 len: 1505 microversion: 2.1 time: 0.575446 Aug 31 16:07:46.592244 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1395/2765] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:46 2022] GET /compute/v2.1/servers/db1ac026-e512-4e5f-839d-4056cec509b3 => generated 1505 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:46.602344 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-505f52e0-1408-4c85-a1f5-9ccd089101db tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '.version_select at 0x7f5ae9079dc0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:46.705434 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-505f52e0-1408-4c85-a1f5-9ccd089101db tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "GET /compute/v2.1/images/31a273f9-69d4-464b-8d35-a1a99ede5380" status: 200 len: 1453 microversion: 2.1 time: 0.111267 Aug 31 16:07:46.705908 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1396/2766] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:07:46 2022] GET /compute/v2.1/images/31a273f9-69d4-464b-8d35-a1a99ede5380 => generated 1453 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:46.717871 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-25e4050a-ada5-451c-a877-0378022f5539 tempest-SecurityGroupRulesNegativeTestJSON-8994449 tempest-SecurityGroupRulesNegativeTestJSON-8994449-project] 10.222.0.61 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.844101 Aug 31 16:07:46.720982 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1371/2767] 10.222.0.61 () {60 vars in 1195 bytes} [Wed Aug 31 16:07:45 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:07:46.723643 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a1959936-d615-41f5-800a-2dd6b236d146 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:07:46.724209 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a1959936-d615-41f5-800a-2dd6b236d146 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 8f165110-0ea6-48c0-8357-ba419171f7af] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:46.738973 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-86c682bd-1209-4753-a4cd-563c045c6e32 tempest-FloatingIPDetailsTestJSON-1928649283 tempest-FloatingIPDetailsTestJSON-1928649283-project] Calling method '.version_select at 0x7f5ae8381c10>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:46.749087 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a1959936-d615-41f5-800a-2dd6b236d146 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:46.749606 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a1959936-d615-41f5-800a-2dd6b236d146 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:46.750057 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a1959936-d615-41f5-800a-2dd6b236d146 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:46.754903 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a1959936-d615-41f5-800a-2dd6b236d146 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:46.755609 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a1959936-d615-41f5-800a-2dd6b236d146 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:46.756446 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a1959936-d615-41f5-800a-2dd6b236d146 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:46.911262 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:07:47.047123 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a1959936-d615-41f5-800a-2dd6b236d146 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "POST /compute/v2.1/servers/8f165110-0ea6-48c0-8357-ba419171f7af/action" status: 202 len: 0 microversion: 2.1 time: 0.338184 Aug 31 16:07:47.050512 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1397/2768] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:07:46 2022] POST /compute/v2.1/servers/8f165110-0ea6-48c0-8357-ba419171f7af/action => generated 0 bytes in 344 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:07:47.070753 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ec4b081c-eaa6-4cea-b9e7-6e27cefb7731 tempest-LiveMigrationNegativeTest-205709442 tempest-LiveMigrationNegativeTest-205709442-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:07:47.085379 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ec4b081c-eaa6-4cea-b9e7-6e27cefb7731 tempest-LiveMigrationNegativeTest-205709442 tempest-LiveMigrationNegativeTest-205709442-project-admin] [instance: 1df89d79-3817-40af-b956-b9b75919acbc] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:47.115356 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ec4b081c-eaa6-4cea-b9e7-6e27cefb7731 tempest-LiveMigrationNegativeTest-205709442 tempest-LiveMigrationNegativeTest-205709442-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:47.116002 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ec4b081c-eaa6-4cea-b9e7-6e27cefb7731 tempest-LiveMigrationNegativeTest-205709442 tempest-LiveMigrationNegativeTest-205709442-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:47.116463 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ec4b081c-eaa6-4cea-b9e7-6e27cefb7731 tempest-LiveMigrationNegativeTest-205709442 tempest-LiveMigrationNegativeTest-205709442-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:47.119681 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ec4b081c-eaa6-4cea-b9e7-6e27cefb7731 tempest-LiveMigrationNegativeTest-205709442 tempest-LiveMigrationNegativeTest-205709442-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:47.121665 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ec4b081c-eaa6-4cea-b9e7-6e27cefb7731 tempest-LiveMigrationNegativeTest-205709442 tempest-LiveMigrationNegativeTest-205709442-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:47.123170 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ec4b081c-eaa6-4cea-b9e7-6e27cefb7731 tempest-LiveMigrationNegativeTest-205709442 tempest-LiveMigrationNegativeTest-205709442-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:47.196829 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-ec4b081c-eaa6-4cea-b9e7-6e27cefb7731 tempest-LiveMigrationNegativeTest-205709442 tempest-LiveMigrationNegativeTest-205709442-project-admin] Lazy-loading 'flavor' on Instance uuid 1df89d79-3817-40af-b956-b9b75919acbc {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:07:47.348189 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ec4b081c-eaa6-4cea-b9e7-6e27cefb7731 tempest-LiveMigrationNegativeTest-205709442 tempest-LiveMigrationNegativeTest-205709442-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/1df89d79-3817-40af-b956-b9b75919acbc/action" status: 202 len: 0 microversion: 2.1 time: 0.294689 Aug 31 16:07:47.350216 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1398/2769] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:07:47 2022] POST /compute/v2.1/servers/1df89d79-3817-40af-b956-b9b75919acbc/action => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:07:47.382580 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-66b13928-4585-4930-b601-fb1b7cb17bb0 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:47.383437 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-66b13928-4585-4930-b601-fb1b7cb17bb0 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] [instance: 685d47e4-721e-4eae-b5f8-78fdb68454ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:47.400882 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-66b13928-4585-4930-b601-fb1b7cb17bb0 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:47.401929 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-66b13928-4585-4930-b601-fb1b7cb17bb0 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:47.404033 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-66b13928-4585-4930-b601-fb1b7cb17bb0 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:47.405028 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-66b13928-4585-4930-b601-fb1b7cb17bb0 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:47.407431 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-66b13928-4585-4930-b601-fb1b7cb17bb0 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:47.408078 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-66b13928-4585-4930-b601-fb1b7cb17bb0 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:48.387412 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-66b13928-4585-4930-b601-fb1b7cb17bb0 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:48.406245 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-66b13928-4585-4930-b601-fb1b7cb17bb0 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:48.409488 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-66b13928-4585-4930-b601-fb1b7cb17bb0 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:48.412017 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-66b13928-4585-4930-b601-fb1b7cb17bb0 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] 10.222.0.61 "GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae" status: 200 len: 2836 microversion: 2.42 time: 1.058912 Aug 31 16:07:48.413232 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1399/2770] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:07:47 2022] GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae => generated 2836 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:07:48.437673 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3692cf80-d9e7-4c4f-9a5d-a9386c9af34e tempest-SecurityGroupRulesNegativeTestJSON-8994449 tempest-SecurityGroupRulesNegativeTestJSON-8994449-project] Action: 'create', calling method: .version_select at 0x7f5ae9326940>, body: {"security_group_rule": {"parent_group_id": "938af94a-8bcd-4d0c-8bfb-a011640e85ff", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:07:48.783973 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-3692cf80-d9e7-4c4f-9a5d-a9386c9af34e tempest-SecurityGroupRulesNegativeTestJSON-8994449 tempest-SecurityGroupRulesNegativeTestJSON-8994449-project] HTTP exception thrown: This rule already exists in group 938af94a-8bcd-4d0c-8bfb-a011640e85ff Aug 31 16:07:48.786047 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3692cf80-d9e7-4c4f-9a5d-a9386c9af34e tempest-SecurityGroupRulesNegativeTestJSON-8994449 tempest-SecurityGroupRulesNegativeTestJSON-8994449-project] Request method failure captured: Aug 31 16:07:48.786047 n-d-850499-9 devstack@n-api.service[122256]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 31 16:07:48.786047 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:07:48.786047 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:07:48.786047 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:07:48.786047 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 138 Aug 31 16:07:48.786047 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:07:48.786047 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:07:48.786047 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:07:48.786047 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:07:48.786047 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4dOO52EJKop8o-fsZmduM55cO24kBduef9IRVN5qFpmftsOkgvTc4AlcKEAIvsnY8Cf_8hxw1aDngsDJGouRBV0m2nXJhgXIxPJJvxKfwIrLrxUEme39KU3zIhTVyZq7aY2E-EFBToOkhLPaPrSaeAPEsKcN-1lMqhTnLQbfcByruw Aug 31 16:07:48.786047 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:07:48.786047 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:07:48.786047 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:07:48.786047 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:07:48.786047 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:07:48.786047 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:07:48.786047 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 6051168fe5674988aab651f98240a6a3 Aug 31 16:07:48.786047 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-8994449 Aug 31 16:07:48.786047 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:07:48.786047 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:07:48.786047 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6051168fe5674988aab651f98240a6a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/6051168fe5674988aab651f98240a6a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_6051168fe5674988aab651f98240a6a3", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6051168fe5674988aab651f98240a6a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:07:48.786047 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-8994449 Aug 31 16:07:48.786047 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 6051168fe5674988aab651f98240a6a3 Aug 31 16:07:48.786047 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-8994449 Aug 31 16:07:48.786047 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-8994449-project Aug 31 16:07:48.786047 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:07:48.786047 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:07:48.786047 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 29387cff4fab4b6dbb6e84770e1e94f4 Aug 31 16:07:48.786047 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-8994449-project Aug 31 16:07:48.786047 n-d-850499-9 devstack@n-api.service[122256]: Aug 31 16:07:48.786047 n-d-850499-9 devstack@n-api.service[122256]: {"security_group_rule": {"parent_group_id": "938af94a-8bcd-4d0c-8bfb-a011640e85ff", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 31 16:07:48.786047 n-d-850499-9 devstack@n-api.service[122256]: method: Aug 31 16:07:48.786047 n-d-850499-9 devstack@n-api.service[122256]: exception: This rule already exists in group 938af94a-8bcd-4d0c-8bfb-a011640e85ff Aug 31 16:07:48.786047 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'body': {'security_group_rule': {'parent_group_id': '938af94a-8bcd-4d0c-8bfb-a011640e85ff', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 31 16:07:48.786047 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:07:48.786047 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:07:48.786047 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Aug 31 16:07:48.786047 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Aug 31 16:07:48.786047 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Aug 31 16:07:48.786047 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Aug 31 16:07:48.786047 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 938af94a-8bcd-4d0c-8bfb-a011640e85ff Aug 31 16:07:48.786047 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:07:48.786047 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:07:48.786047 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:07:48.786047 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:07:48.786047 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:07:48.786047 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:07:48.786047 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:07:48.786047 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:07:48.786047 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:07:48.786047 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:07:48.786047 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:07:48.786047 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:07:48.786047 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Aug 31 16:07:48.786047 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 31 16:07:48.786047 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 938af94a-8bcd-4d0c-8bfb-a011640e85ff Aug 31 16:07:48.786047 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:07:48.786047 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:07:48.786047 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:07:48.786047 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:07:48.786047 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:07:48.786047 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:07:48.794600 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:07:48.794600 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:07:48.794600 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 938af94a-8bcd-4d0c-8bfb-a011640e85ff Aug 31 16:07:48.794600 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:07:48.794600 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3692cf80-d9e7-4c4f-9a5d-a9386c9af34e tempest-SecurityGroupRulesNegativeTestJSON-8994449 tempest-SecurityGroupRulesNegativeTestJSON-8994449-project] Returning 400 to user: This rule already exists in group 938af94a-8bcd-4d0c-8bfb-a011640e85ff {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:07:48.794600 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3692cf80-d9e7-4c4f-9a5d-a9386c9af34e tempest-SecurityGroupRulesNegativeTestJSON-8994449 tempest-SecurityGroupRulesNegativeTestJSON-8994449-project] 10.222.0.61 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.368371 Aug 31 16:07:48.794600 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1400/2771] 10.222.0.61 () {60 vars in 1195 bytes} [Wed Aug 31 16:07:48 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 378 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:07:48.799251 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-815473e7-bf02-4625-b44b-398ddcec096e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:48.805802 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-815473e7-bf02-4625-b44b-398ddcec096e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 8f165110-0ea6-48c0-8357-ba419171f7af] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:48.830901 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-815473e7-bf02-4625-b44b-398ddcec096e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:48.831602 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-815473e7-bf02-4625-b44b-398ddcec096e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:48.832372 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-815473e7-bf02-4625-b44b-398ddcec096e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:48.833355 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-815473e7-bf02-4625-b44b-398ddcec096e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:48.834626 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-815473e7-bf02-4625-b44b-398ddcec096e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:48.834626 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-815473e7-bf02-4625-b44b-398ddcec096e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:49.297693 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-815473e7-bf02-4625-b44b-398ddcec096e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:49.313971 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-815473e7-bf02-4625-b44b-398ddcec096e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/8f165110-0ea6-48c0-8357-ba419171f7af" status: 200 len: 1469 microversion: 2.1 time: 0.519830 Aug 31 16:07:49.314921 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1401/2772] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:48 2022] GET /compute/v2.1/servers/8f165110-0ea6-48c0-8357-ba419171f7af => generated 1469 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:49.343103 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-110c4812-94fd-4d0d-88af-90adb9a8286d tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:49.343790 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-110c4812-94fd-4d0d-88af-90adb9a8286d tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] [instance: 1df89d79-3817-40af-b956-b9b75919acbc] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:49.352051 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-110c4812-94fd-4d0d-88af-90adb9a8286d tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:49.352707 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-110c4812-94fd-4d0d-88af-90adb9a8286d tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:49.353298 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-110c4812-94fd-4d0d-88af-90adb9a8286d tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:49.354480 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-110c4812-94fd-4d0d-88af-90adb9a8286d tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:49.355113 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-110c4812-94fd-4d0d-88af-90adb9a8286d tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:49.356115 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-110c4812-94fd-4d0d-88af-90adb9a8286d tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:49.636197 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-86c682bd-1209-4753-a4cd-563c045c6e32 tempest-FloatingIPDetailsTestJSON-1928649283 tempest-FloatingIPDetailsTestJSON-1928649283-project] 10.222.0.61 "DELETE /compute/v2.1/os-floating-ips/93dc55d5-1ad3-42d6-a4a5-bfb518200c7f" status: 202 len: 0 microversion: 2.1 time: 2.902413 Aug 31 16:07:49.645156 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1372/2773] 10.222.0.61 () {58 vars in 1263 bytes} [Wed Aug 31 16:07:46 2022] DELETE /compute/v2.1/os-floating-ips/93dc55d5-1ad3-42d6-a4a5-bfb518200c7f => generated 0 bytes in 2923 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:07:49.724113 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-110c4812-94fd-4d0d-88af-90adb9a8286d tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb6a27e336449738f68a88d870ca6e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f79872256b2647d6a01c9e753b93b3c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:49.737094 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-110c4812-94fd-4d0d-88af-90adb9a8286d tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] 10.222.0.61 "GET /compute/v2.1/servers/1df89d79-3817-40af-b956-b9b75919acbc" status: 200 len: 1457 microversion: 2.1 time: 0.400821 Aug 31 16:07:49.737950 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1402/2774] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:49 2022] GET /compute/v2.1/servers/1df89d79-3817-40af-b956-b9b75919acbc => generated 1457 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:49.746304 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-abb2685a-213a-45f1-8a5e-44343e74db04 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '.version_select at 0x7f5ae9751f70>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:49.850047 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-abb2685a-213a-45f1-8a5e-44343e74db04 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "GET /compute/v2.1/images/31a273f9-69d4-464b-8d35-a1a99ede5380" status: 200 len: 1453 microversion: 2.1 time: 0.103389 Aug 31 16:07:49.858294 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1403/2775] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:07:49 2022] GET /compute/v2.1/images/31a273f9-69d4-464b-8d35-a1a99ede5380 => generated 1453 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:49.864610 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8b52f480-9e8a-4de1-a934-9ae9dc3e063d tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:49.867840 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8b52f480-9e8a-4de1-a934-9ae9dc3e063d tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] [instance: 685d47e4-721e-4eae-b5f8-78fdb68454ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:49.899807 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-26726350-30ab-4c5c-9809-cbd37d78449b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:49.901592 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-26726350-30ab-4c5c-9809-cbd37d78449b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: db1ac026-e512-4e5f-839d-4056cec509b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:49.904216 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:07:49.913603 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8b52f480-9e8a-4de1-a934-9ae9dc3e063d tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:49.914128 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8b52f480-9e8a-4de1-a934-9ae9dc3e063d tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:49.914578 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8b52f480-9e8a-4de1-a934-9ae9dc3e063d tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:49.916292 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8b52f480-9e8a-4de1-a934-9ae9dc3e063d tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:49.916814 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8b52f480-9e8a-4de1-a934-9ae9dc3e063d tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:49.917262 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8b52f480-9e8a-4de1-a934-9ae9dc3e063d tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:49.918795 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-26726350-30ab-4c5c-9809-cbd37d78449b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:49.919539 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-26726350-30ab-4c5c-9809-cbd37d78449b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:49.920076 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-26726350-30ab-4c5c-9809-cbd37d78449b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:49.920905 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-26726350-30ab-4c5c-9809-cbd37d78449b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:49.921639 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-26726350-30ab-4c5c-9809-cbd37d78449b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:49.922534 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-26726350-30ab-4c5c-9809-cbd37d78449b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:49.927420 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=62 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:07:50.223397 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8b52f480-9e8a-4de1-a934-9ae9dc3e063d tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] 10.222.0.61 "GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae/os-interface" status: 200 len: 1833 microversion: 2.42 time: 0.369384 Aug 31 16:07:50.224575 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1404/2776] 10.222.0.61 () {60 vars in 1316 bytes} [Wed Aug 31 16:07:49 2022] GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae/os-interface => generated 1833 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:07:50.231102 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b8e02563-9bb4-4d23-ae0b-a61a96304668 tempest-SecurityGroupRulesNegativeTestJSON-8994449 tempest-SecurityGroupRulesNegativeTestJSON-8994449-project] Calling method '.version_select at 0x7f5ae9535d30>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:50.430671 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-26726350-30ab-4c5c-9809-cbd37d78449b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:50.457838 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-26726350-30ab-4c5c-9809-cbd37d78449b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/db1ac026-e512-4e5f-839d-4056cec509b3" status: 200 len: 1505 microversion: 2.1 time: 0.810030 Aug 31 16:07:50.460419 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1373/2777] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:49 2022] GET /compute/v2.1/servers/db1ac026-e512-4e5f-839d-4056cec509b3 => generated 1505 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:50.470098 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-34a7017b-a35e-44f5-8ffb-3bad3f1860e2 req-bcc62486-2974-4ae4-9957-883fd96353fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db1ac026-e512-4e5f-839d-4056cec509b3", "name": "network-vif-unplugged", "status": "completed", "tag": "af630af3-517b-4dc1-b7cf-dda0aebb1a90"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:07:50.483044 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-34a7017b-a35e-44f5-8ffb-3bad3f1860e2 req-bcc62486-2974-4ae4-9957-883fd96353fa service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:50.483815 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-34a7017b-a35e-44f5-8ffb-3bad3f1860e2 req-bcc62486-2974-4ae4-9957-883fd96353fa service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:50.484536 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-34a7017b-a35e-44f5-8ffb-3bad3f1860e2 req-bcc62486-2974-4ae4-9957-883fd96353fa service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:50.500251 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-34a7017b-a35e-44f5-8ffb-3bad3f1860e2 req-bcc62486-2974-4ae4-9957-883fd96353fa service nova] Creating event network-vif-unplugged:af630af3-517b-4dc1-b7cf-dda0aebb1a90 for instance db1ac026-e512-4e5f-839d-4056cec509b3 on n-h1-850499-9 Aug 31 16:07:50.514503 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-34a7017b-a35e-44f5-8ffb-3bad3f1860e2 req-bcc62486-2974-4ae4-9957-883fd96353fa service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048065 Aug 31 16:07:50.518800 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1374/2778] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:07:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:07:50.524189 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f63dc3a1-24a9-40da-9683-1b56367d15ba tempest-FloatingIPDetailsTestJSON-1928649283 tempest-FloatingIPDetailsTestJSON-1928649283-project] Calling method '.version_select at 0x7f5ae8420f70>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:50.801828 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b8e02563-9bb4-4d23-ae0b-a61a96304668 tempest-SecurityGroupRulesNegativeTestJSON-8994449 tempest-SecurityGroupRulesNegativeTestJSON-8994449-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-group-rules/04c18004-e42b-4750-af2b-f68cb3af6422" status: 202 len: 0 microversion: 2.1 time: 0.575692 Aug 31 16:07:50.803710 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1405/2779] 10.222.0.61 () {58 vars in 1287 bytes} [Wed Aug 31 16:07:50 2022] DELETE /compute/v2.1/os-security-group-rules/04c18004-e42b-4750-af2b-f68cb3af6422 => generated 0 bytes in 579 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:07:50.814497 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0d1c5001-3020-4c94-b217-d1ff1476a653 tempest-LiveMigrationNegativeTest-205709442 tempest-LiveMigrationNegativeTest-205709442-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:50.825227 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0d1c5001-3020-4c94-b217-d1ff1476a653 tempest-LiveMigrationNegativeTest-205709442 tempest-LiveMigrationNegativeTest-205709442-project-admin] [instance: 1df89d79-3817-40af-b956-b9b75919acbc] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:50.841046 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0d1c5001-3020-4c94-b217-d1ff1476a653 tempest-LiveMigrationNegativeTest-205709442 tempest-LiveMigrationNegativeTest-205709442-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:50.848774 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0d1c5001-3020-4c94-b217-d1ff1476a653 tempest-LiveMigrationNegativeTest-205709442 tempest-LiveMigrationNegativeTest-205709442-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:50.850711 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0d1c5001-3020-4c94-b217-d1ff1476a653 tempest-LiveMigrationNegativeTest-205709442 tempest-LiveMigrationNegativeTest-205709442-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:50.855066 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0d1c5001-3020-4c94-b217-d1ff1476a653 tempest-LiveMigrationNegativeTest-205709442 tempest-LiveMigrationNegativeTest-205709442-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:50.858850 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0d1c5001-3020-4c94-b217-d1ff1476a653 tempest-LiveMigrationNegativeTest-205709442 tempest-LiveMigrationNegativeTest-205709442-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:50.860828 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0d1c5001-3020-4c94-b217-d1ff1476a653 tempest-LiveMigrationNegativeTest-205709442 tempest-LiveMigrationNegativeTest-205709442-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:50.878764 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f63dc3a1-24a9-40da-9683-1b56367d15ba tempest-FloatingIPDetailsTestJSON-1928649283 tempest-FloatingIPDetailsTestJSON-1928649283-project] 10.222.0.61 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.358572 Aug 31 16:07:50.881364 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1375/2780] 10.222.0.61 () {58 vars in 1164 bytes} [Wed Aug 31 16:07:50 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 16:07:50.892430 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b62cdc5d-a223-443c-97cd-e32c8d2b3d8d tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:50.896341 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b62cdc5d-a223-443c-97cd-e32c8d2b3d8d tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 8f165110-0ea6-48c0-8357-ba419171f7af] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:50.905279 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b62cdc5d-a223-443c-97cd-e32c8d2b3d8d tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:50.906381 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b62cdc5d-a223-443c-97cd-e32c8d2b3d8d tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:50.907032 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b62cdc5d-a223-443c-97cd-e32c8d2b3d8d tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:50.908038 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b62cdc5d-a223-443c-97cd-e32c8d2b3d8d tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:50.908701 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b62cdc5d-a223-443c-97cd-e32c8d2b3d8d tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:50.909351 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b62cdc5d-a223-443c-97cd-e32c8d2b3d8d tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:51.220812 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b62cdc5d-a223-443c-97cd-e32c8d2b3d8d tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:51.232997 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b62cdc5d-a223-443c-97cd-e32c8d2b3d8d tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/8f165110-0ea6-48c0-8357-ba419171f7af" status: 200 len: 1469 microversion: 2.1 time: 0.350215 Aug 31 16:07:51.247215 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1376/2781] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:50 2022] GET /compute/v2.1/servers/8f165110-0ea6-48c0-8357-ba419171f7af => generated 1469 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:51.247215 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2a131d1d-37e3-4d4e-9a79-ec9ac75fce72 tempest-SecurityGroupRulesNegativeTestJSON-8994449 tempest-SecurityGroupRulesNegativeTestJSON-8994449-project] Action: 'create', calling method: .version_select at 0x7f5ae8420f70>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-558812254", "description": "tempest-description-1769740272"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:07:51.502640 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2a131d1d-37e3-4d4e-9a79-ec9ac75fce72 tempest-SecurityGroupRulesNegativeTestJSON-8994449 tempest-SecurityGroupRulesNegativeTestJSON-8994449-project] 10.222.0.61 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.267337 Aug 31 16:07:51.503250 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1377/2782] 10.222.0.61 () {60 vars in 1180 bytes} [Wed Aug 31 16:07:51 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:07:51.519872 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4b94d55e-8273-46e0-98f6-e573360012d9 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '.version_select at 0x7f5ae8381670>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:51.555197 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0d1c5001-3020-4c94-b217-d1ff1476a653 tempest-LiveMigrationNegativeTest-205709442 tempest-LiveMigrationNegativeTest-205709442-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/1df89d79-3817-40af-b956-b9b75919acbc" status: 200 len: 1608 microversion: 2.1 time: 0.749337 Aug 31 16:07:51.561121 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1406/2783] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:50 2022] GET /compute/v2.1/servers/1df89d79-3817-40af-b956-b9b75919acbc => generated 1608 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:51.574877 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ca5a697c-f04d-4fff-b30b-705c438a84fe tempest-FloatingIPDetailsTestJSON-1928649283 tempest-FloatingIPDetailsTestJSON-1928649283-project] Calling method '.version_select at 0x7f5aed2ecca0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:51.606326 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4b94d55e-8273-46e0-98f6-e573360012d9 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "GET /compute/v2.1/images/31a273f9-69d4-464b-8d35-a1a99ede5380" status: 200 len: 1453 microversion: 2.1 time: 0.091853 Aug 31 16:07:51.609812 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1378/2784] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:07:51 2022] GET /compute/v2.1/images/31a273f9-69d4-464b-8d35-a1a99ede5380 => generated 1453 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:51.621010 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-19019764-5b6d-4a7d-b013-084ef527341e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:51.621643 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-19019764-5b6d-4a7d-b013-084ef527341e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: db1ac026-e512-4e5f-839d-4056cec509b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:51.629923 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-19019764-5b6d-4a7d-b013-084ef527341e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:51.630432 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-19019764-5b6d-4a7d-b013-084ef527341e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:51.631065 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-19019764-5b6d-4a7d-b013-084ef527341e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:51.631815 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-19019764-5b6d-4a7d-b013-084ef527341e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:51.632288 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-19019764-5b6d-4a7d-b013-084ef527341e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:51.632747 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-19019764-5b6d-4a7d-b013-084ef527341e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:52.186291 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ca5a697c-f04d-4fff-b30b-705c438a84fe tempest-FloatingIPDetailsTestJSON-1928649283 tempest-FloatingIPDetailsTestJSON-1928649283-project] 10.222.0.61 "GET /compute/v2.1/os-floating-ips" status: 200 len: 396 microversion: 2.1 time: 0.619989 Aug 31 16:07:52.197864 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1407/2785] 10.222.0.61 () {58 vars in 1149 bytes} [Wed Aug 31 16:07:51 2022] GET /compute/v2.1/os-floating-ips => generated 396 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:07:52.198940 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-19019764-5b6d-4a7d-b013-084ef527341e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:52.203093 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d5155c23-cf3b-4144-8303-1805675166f6 tempest-SecurityGroupRulesNegativeTestJSON-8994449 tempest-SecurityGroupRulesNegativeTestJSON-8994449-project] Action: 'create', calling method: .version_select at 0x7f5ae93574c0>, body: {"security_group_rule": {"parent_group_id": "ab8498ef-de2e-4102-90d3-20b5337afdeb", "ip_protocol": "tcp", "from_port": 122946062, "to_port": 22}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:07:52.208895 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-19019764-5b6d-4a7d-b013-084ef527341e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/db1ac026-e512-4e5f-839d-4056cec509b3" status: 200 len: 1448 microversion: 2.1 time: 0.601055 Aug 31 16:07:52.209923 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1379/2786] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:51 2022] GET /compute/v2.1/servers/db1ac026-e512-4e5f-839d-4056cec509b3 => generated 1448 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:52.216581 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d0a57dbc-ce6e-45bb-bf92-46918b04a718 tempest-LiveMigrationNegativeTest-205709442 tempest-LiveMigrationNegativeTest-205709442-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:52.221194 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d0a57dbc-ce6e-45bb-bf92-46918b04a718 tempest-LiveMigrationNegativeTest-205709442 tempest-LiveMigrationNegativeTest-205709442-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:52.222107 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d0a57dbc-ce6e-45bb-bf92-46918b04a718 tempest-LiveMigrationNegativeTest-205709442 tempest-LiveMigrationNegativeTest-205709442-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:52.222820 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d0a57dbc-ce6e-45bb-bf92-46918b04a718 tempest-LiveMigrationNegativeTest-205709442 tempest-LiveMigrationNegativeTest-205709442-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:52.224493 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d0a57dbc-ce6e-45bb-bf92-46918b04a718 tempest-LiveMigrationNegativeTest-205709442 tempest-LiveMigrationNegativeTest-205709442-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:52.228840 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d0a57dbc-ce6e-45bb-bf92-46918b04a718 tempest-LiveMigrationNegativeTest-205709442 tempest-LiveMigrationNegativeTest-205709442-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:52.229691 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d0a57dbc-ce6e-45bb-bf92-46918b04a718 tempest-LiveMigrationNegativeTest-205709442 tempest-LiveMigrationNegativeTest-205709442-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:52.279432 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d0a57dbc-ce6e-45bb-bf92-46918b04a718 tempest-LiveMigrationNegativeTest-205709442 tempest-LiveMigrationNegativeTest-205709442-project-admin] 10.222.0.61 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.068263 Aug 31 16:07:52.280553 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1380/2787] 10.222.0.61 () {58 vars in 1176 bytes} [Wed Aug 31 16:07:52 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:07:52.321709 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-d5155c23-cf3b-4144-8303-1805675166f6 tempest-SecurityGroupRulesNegativeTestJSON-8994449 tempest-SecurityGroupRulesNegativeTestJSON-8994449-project] HTTP exception thrown: Invalid port range 122946062:22. Former value cannot be greater than the later Aug 31 16:07:52.324126 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d5155c23-cf3b-4144-8303-1805675166f6 tempest-SecurityGroupRulesNegativeTestJSON-8994449 tempest-SecurityGroupRulesNegativeTestJSON-8994449-project] Request method failure captured: Aug 31 16:07:52.324126 n-d-850499-9 devstack@n-api.service[122256]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 31 16:07:52.324126 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:07:52.324126 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:07:52.324126 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:07:52.324126 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 145 Aug 31 16:07:52.324126 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:07:52.324126 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:07:52.324126 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:07:52.324126 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:07:52.324126 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4dOO52EJKop8o-fsZmduM55cO24kBduef9IRVN5qFpmftsOkgvTc4AlcKEAIvsnY8Cf_8hxw1aDngsDJGouRBV0m2nXJhgXIxPJJvxKfwIrLrxUEme39KU3zIhTVyZq7aY2E-EFBToOkhLPaPrSaeAPEsKcN-1lMqhTnLQbfcByruw Aug 31 16:07:52.324126 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:07:52.324126 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:07:52.324126 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:07:52.324126 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:07:52.324126 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:07:52.324126 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:07:52.324126 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 6051168fe5674988aab651f98240a6a3 Aug 31 16:07:52.324126 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-8994449 Aug 31 16:07:52.324126 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:07:52.324126 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:07:52.324126 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6051168fe5674988aab651f98240a6a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/6051168fe5674988aab651f98240a6a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_6051168fe5674988aab651f98240a6a3", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6051168fe5674988aab651f98240a6a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:07:52.324126 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-8994449 Aug 31 16:07:52.324126 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 6051168fe5674988aab651f98240a6a3 Aug 31 16:07:52.324126 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-8994449 Aug 31 16:07:52.324126 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-8994449-project Aug 31 16:07:52.324126 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:07:52.324126 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:07:52.324126 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 29387cff4fab4b6dbb6e84770e1e94f4 Aug 31 16:07:52.324126 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-8994449-project Aug 31 16:07:52.324126 n-d-850499-9 devstack@n-api.service[122256]: Aug 31 16:07:52.324126 n-d-850499-9 devstack@n-api.service[122256]: {"security_group_rule": {"parent_group_id": "ab8498ef-de2e-4102-90d3-20b5337afdeb", "ip_protocol": "tcp", "from_port": 122946062, "to_port": 22}} Aug 31 16:07:52.324126 n-d-850499-9 devstack@n-api.service[122256]: method: Aug 31 16:07:52.324126 n-d-850499-9 devstack@n-api.service[122256]: exception: Invalid port range 122946062:22. Former value cannot be greater than the later Aug 31 16:07:52.324126 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'ab8498ef-de2e-4102-90d3-20b5337afdeb', 'ip_protocol': 'tcp', 'from_port': 122946062, 'to_port': 22}}} Aug 31 16:07:52.324126 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:07:52.324126 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:07:52.324126 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 31 16:07:52.324126 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 31 16:07:52.324126 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 31 16:07:52.324126 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 31 16:07:52.324126 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 31 16:07:52.324126 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 31 16:07:52.324126 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Aug 31 16:07:52.324126 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 31 16:07:52.324126 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 122946062:22. Former value cannot be greater than the later Aug 31 16:07:52.324126 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:07:52.324126 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:07:52.324126 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:07:52.324126 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:07:52.324126 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:07:52.324126 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:07:52.324126 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:07:52.324126 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:07:52.324126 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:07:52.324126 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:07:52.324126 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:07:52.324126 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:07:52.324126 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 31 16:07:52.324126 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 31 16:07:52.324126 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 122946062:22. Former value cannot be greater than the later Aug 31 16:07:52.324126 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:07:52.328280 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:07:52.328280 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:07:52.328280 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:07:52.328280 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:07:52.328280 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:07:52.328280 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:07:52.328280 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:07:52.328280 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 122946062:22. Former value cannot be greater than the later Aug 31 16:07:52.328280 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:07:52.330609 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d5155c23-cf3b-4144-8303-1805675166f6 tempest-SecurityGroupRulesNegativeTestJSON-8994449 tempest-SecurityGroupRulesNegativeTestJSON-8994449-project] Returning 400 to user: Invalid port range 122946062:22. Former value cannot be greater than the later {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:07:52.331732 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d5155c23-cf3b-4144-8303-1805675166f6 tempest-SecurityGroupRulesNegativeTestJSON-8994449 tempest-SecurityGroupRulesNegativeTestJSON-8994449-project] 10.222.0.61 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 122 microversion: 2.1 time: 0.132643 Aug 31 16:07:52.338728 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1408/2788] 10.222.0.61 () {60 vars in 1195 bytes} [Wed Aug 31 16:07:52 2022] POST /compute/v2.1/os-security-group-rules => generated 122 bytes in 140 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:07:52.346717 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9d61714d-289c-490f-be5c-ac97a51604f1 tempest-FloatingIPDetailsTestJSON-1928649283 tempest-FloatingIPDetailsTestJSON-1928649283-project] Calling method '.version_select at 0x7f5ae9326d30>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:52.402298 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-e07b2c51-0545-47db-95e7-4d8de7adcfe1 req-2cf0ec60-e0fa-462b-be0d-b6ebdade0d9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "685d47e4-721e-4eae-b5f8-78fdb68454ae", "tag": "b14c9074-fcb3-408a-abec-9842ca262740"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:07:52.412256 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-e07b2c51-0545-47db-95e7-4d8de7adcfe1 req-2cf0ec60-e0fa-462b-be0d-b6ebdade0d9d service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:52.413333 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-e07b2c51-0545-47db-95e7-4d8de7adcfe1 req-2cf0ec60-e0fa-462b-be0d-b6ebdade0d9d service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:52.414279 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-e07b2c51-0545-47db-95e7-4d8de7adcfe1 req-2cf0ec60-e0fa-462b-be0d-b6ebdade0d9d service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:52.460230 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-e07b2c51-0545-47db-95e7-4d8de7adcfe1 req-2cf0ec60-e0fa-462b-be0d-b6ebdade0d9d service nova] Creating event network-changed:b14c9074-fcb3-408a-abec-9842ca262740 for instance 685d47e4-721e-4eae-b5f8-78fdb68454ae on n-h2-850499-9 Aug 31 16:07:52.474922 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-e07b2c51-0545-47db-95e7-4d8de7adcfe1 req-2cf0ec60-e0fa-462b-be0d-b6ebdade0d9d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.192740 Aug 31 16:07:52.475963 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1381/2789] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:07:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:07:52.482728 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f75471d8-4167-4d34-9ed2-9e9b8eed481b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:52.483447 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f75471d8-4167-4d34-9ed2-9e9b8eed481b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: db1ac026-e512-4e5f-839d-4056cec509b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:52.493905 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f75471d8-4167-4d34-9ed2-9e9b8eed481b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:52.494961 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f75471d8-4167-4d34-9ed2-9e9b8eed481b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:52.495573 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f75471d8-4167-4d34-9ed2-9e9b8eed481b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:52.496408 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f75471d8-4167-4d34-9ed2-9e9b8eed481b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:52.497078 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f75471d8-4167-4d34-9ed2-9e9b8eed481b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:52.497522 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f75471d8-4167-4d34-9ed2-9e9b8eed481b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:52.549166 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f75471d8-4167-4d34-9ed2-9e9b8eed481b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: db1ac026-e512-4e5f-839d-4056cec509b3] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:07:52.558286 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.compute.api [None req-f75471d8-4167-4d34-9ed2-9e9b8eed481b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: db1ac026-e512-4e5f-839d-4056cec509b3] Working on deleting snapshot cb20f850-721b-4d36-8065-7085f6166f65 from shelved instance... Aug 31 16:07:54.105322 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f75471d8-4167-4d34-9ed2-9e9b8eed481b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: db1ac026-e512-4e5f-839d-4056cec509b3] Doing local delete in cell 9f6d6683-96bf-42a7-a78d-78a22f1453ed(cell1) {{(pid=122257) _delete /opt/stack/nova/nova/compute/api.py:2546}} Aug 31 16:07:54.111666 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f75471d8-4167-4d34-9ed2-9e9b8eed481b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:54.112438 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f75471d8-4167-4d34-9ed2-9e9b8eed481b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:54.116816 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f75471d8-4167-4d34-9ed2-9e9b8eed481b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:54.117996 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.compute.api [None req-f75471d8-4167-4d34-9ed2-9e9b8eed481b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: db1ac026-e512-4e5f-839d-4056cec509b3] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Aug 31 16:07:54.140573 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-f75471d8-4167-4d34-9ed2-9e9b8eed481b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: db1ac026-e512-4e5f-839d-4056cec509b3] deallocate_for_instance() {{(pid=122257) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Aug 31 16:07:54.738746 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9d61714d-289c-490f-be5c-ac97a51604f1 tempest-FloatingIPDetailsTestJSON-1928649283 tempest-FloatingIPDetailsTestJSON-1928649283-project] 10.222.0.61 "DELETE /compute/v2.1/os-floating-ips/4855aa6e-298b-48e8-97d5-63ff7bd02bbe" status: 202 len: 0 microversion: 2.1 time: 2.398820 Aug 31 16:07:54.739411 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1409/2790] 10.222.0.61 () {58 vars in 1263 bytes} [Wed Aug 31 16:07:52 2022] DELETE /compute/v2.1/os-floating-ips/4855aa6e-298b-48e8-97d5-63ff7bd02bbe => generated 0 bytes in 2400 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:07:54.748466 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-affb7a7a-0ef1-45de-8aa2-02bcaadcc312 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:54.749201 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-affb7a7a-0ef1-45de-8aa2-02bcaadcc312 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 8f165110-0ea6-48c0-8357-ba419171f7af] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:54.763341 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-affb7a7a-0ef1-45de-8aa2-02bcaadcc312 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:54.764743 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-affb7a7a-0ef1-45de-8aa2-02bcaadcc312 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:54.765845 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-affb7a7a-0ef1-45de-8aa2-02bcaadcc312 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:54.767078 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-affb7a7a-0ef1-45de-8aa2-02bcaadcc312 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:54.768037 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-affb7a7a-0ef1-45de-8aa2-02bcaadcc312 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:54.768917 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-affb7a7a-0ef1-45de-8aa2-02bcaadcc312 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:55.212103 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-affb7a7a-0ef1-45de-8aa2-02bcaadcc312 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:55.225544 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-affb7a7a-0ef1-45de-8aa2-02bcaadcc312 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/8f165110-0ea6-48c0-8357-ba419171f7af" status: 200 len: 1469 microversion: 2.1 time: 0.484735 Aug 31 16:07:55.226917 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1410/2791] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:54 2022] GET /compute/v2.1/servers/8f165110-0ea6-48c0-8357-ba419171f7af => generated 1469 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:55.233633 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-649dc403-8ae2-44e5-99a2-729d771befec tempest-LiveMigrationNegativeTest-205709442 tempest-LiveMigrationNegativeTest-205709442-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-850499-9", "block_migration": true, "disk_over_commit": false}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:07:55.236603 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-649dc403-8ae2-44e5-99a2-729d771befec tempest-LiveMigrationNegativeTest-205709442 tempest-LiveMigrationNegativeTest-205709442-project-admin] [instance: 1df89d79-3817-40af-b956-b9b75919acbc] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:55.245468 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-649dc403-8ae2-44e5-99a2-729d771befec tempest-LiveMigrationNegativeTest-205709442 tempest-LiveMigrationNegativeTest-205709442-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:55.246483 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-649dc403-8ae2-44e5-99a2-729d771befec tempest-LiveMigrationNegativeTest-205709442 tempest-LiveMigrationNegativeTest-205709442-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:55.247277 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-649dc403-8ae2-44e5-99a2-729d771befec tempest-LiveMigrationNegativeTest-205709442 tempest-LiveMigrationNegativeTest-205709442-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:55.248379 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-649dc403-8ae2-44e5-99a2-729d771befec tempest-LiveMigrationNegativeTest-205709442 tempest-LiveMigrationNegativeTest-205709442-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:55.249169 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-649dc403-8ae2-44e5-99a2-729d771befec tempest-LiveMigrationNegativeTest-205709442 tempest-LiveMigrationNegativeTest-205709442-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:55.249924 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-649dc403-8ae2-44e5-99a2-729d771befec tempest-LiveMigrationNegativeTest-205709442 tempest-LiveMigrationNegativeTest-205709442-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:55.343063 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-649dc403-8ae2-44e5-99a2-729d771befec tempest-LiveMigrationNegativeTest-205709442 tempest-LiveMigrationNegativeTest-205709442-project-admin] Lazy-loading 'flavor' on Instance uuid 1df89d79-3817-40af-b956-b9b75919acbc {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:07:55.359340 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-649dc403-8ae2-44e5-99a2-729d771befec tempest-LiveMigrationNegativeTest-205709442 tempest-LiveMigrationNegativeTest-205709442-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 1df89d79-3817-40af-b956-b9b75919acbc while it is in vm_state suspended Aug 31 16:07:55.363385 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-649dc403-8ae2-44e5-99a2-729d771befec tempest-LiveMigrationNegativeTest-205709442 tempest-LiveMigrationNegativeTest-205709442-project-admin] Request method failure captured: Aug 31 16:07:55.363385 n-d-850499-9 devstack@n-api.service[122256]: request: POST /compute/v2.1/servers/1df89d79-3817-40af-b956-b9b75919acbc/action HTTP/1.1 Aug 31 16:07:55.363385 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:07:55.363385 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:07:55.363385 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:07:55.363385 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 97 Aug 31 16:07:55.363385 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:07:55.363385 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:07:55.363385 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:07:55.363385 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:07:55.363385 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4cRLxq1Ur5r76ObfqS5EDajrocTGGtgvT085fW1uTEZYPyOhJXvTFcx9i8gOMtAXr1XeZor8uLg0dRzBvTVpv1cKTmZu6trQF07nwqI8yP1v8amcFj_V0-_tX6qGhbfjtD-us9mrXsronOFo3FzKcg3lA2gpWE3-OJlYneAGyeTGuA Aug 31 16:07:55.363385 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:07:55.363385 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:07:55.363385 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:07:55.363385 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:07:55.363385 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:07:55.363385 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:07:55.363385 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: ccfe68a9d8564f1b8b1b104f8c09ae4c Aug 31 16:07:55.363385 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-LiveMigrationNegativeTest-205709442 Aug 31 16:07:55.363385 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,admin,member Aug 31 16:07:55.363385 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,admin,member Aug 31 16:07:55.363385 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ccfe68a9d8564f1b8b1b104f8c09ae4c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ccfe68a9d8564f1b8b1b104f8c09ae4c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ccfe68a9d8564f1b8b1b104f8c09ae4c", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ccfe68a9d8564f1b8b1b104f8c09ae4c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:07:55.363385 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-LiveMigrationNegativeTest-205709442 Aug 31 16:07:55.363385 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: ccfe68a9d8564f1b8b1b104f8c09ae4c Aug 31 16:07:55.363385 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-205709442 Aug 31 16:07:55.363385 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-LiveMigrationNegativeTest-205709442-project-admin Aug 31 16:07:55.363385 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:07:55.363385 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:07:55.363385 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: f405d19982554d888ec40a4331c0f94a Aug 31 16:07:55.363385 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-LiveMigrationNegativeTest-205709442-project-admin Aug 31 16:07:55.363385 n-d-850499-9 devstack@n-api.service[122256]: Aug 31 16:07:55.363385 n-d-850499-9 devstack@n-api.service[122256]: {"os-migrateLive": {"host": "n-h2-850499-9", "block_migration": true, "disk_over_commit": false}} Aug 31 16:07:55.363385 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:07:55.363385 n-d-850499-9 devstack@n-api.service[122256]: exception: Cannot 'os-migrateLive' instance 1df89d79-3817-40af-b956-b9b75919acbc while it is in vm_state suspended Aug 31 16:07:55.363385 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '1df89d79-3817-40af-b956-b9b75919acbc', 'body': {'os-migrateLive': {'host': 'n-h2-850499-9', 'block_migration': True, 'disk_over_commit': False}}} Aug 31 16:07:55.363385 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:07:55.363385 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:07:55.363385 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Aug 31 16:07:55.363385 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Aug 31 16:07:55.363385 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 31 16:07:55.363385 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 16:07:55.363385 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 31 16:07:55.363385 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 31 16:07:55.363385 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Aug 31 16:07:55.363385 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 31 16:07:55.363385 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 31 16:07:55.363385 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 31 16:07:55.363385 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Aug 31 16:07:55.363385 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 31 16:07:55.363385 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Aug 31 16:07:55.363385 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 31 16:07:55.363385 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 16:07:55.363385 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 16:07:55.363385 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 31 16:07:55.363385 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 31 16:07:55.363385 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1df89d79-3817-40af-b956-b9b75919acbc in vm_state suspended. Cannot live_migrate while the instance is in this state. Aug 31 16:07:55.363385 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:07:55.363385 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:07:55.363385 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:07:55.363385 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:07:55.363385 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:07:55.376108 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:07:55.376108 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:07:55.376108 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:07:55.376108 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:07:55.376108 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:07:55.376108 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:07:55.376108 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:07:55.376108 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:07:55.376108 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:07:55.376108 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:07:55.376108 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:07:55.376108 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 31 16:07:55.376108 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Aug 31 16:07:55.376108 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 31 16:07:55.376108 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 31 16:07:55.376108 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 31 16:07:55.376108 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 1df89d79-3817-40af-b956-b9b75919acbc while it is in vm_state suspended Aug 31 16:07:55.376108 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:07:55.376108 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:07:55.376108 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:07:55.376108 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:07:55.376108 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:07:55.376108 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:07:55.376108 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:07:55.376108 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:07:55.376108 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 1df89d79-3817-40af-b956-b9b75919acbc while it is in vm_state suspended Aug 31 16:07:55.376108 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:07:55.376108 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-649dc403-8ae2-44e5-99a2-729d771befec tempest-LiveMigrationNegativeTest-205709442 tempest-LiveMigrationNegativeTest-205709442-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 1df89d79-3817-40af-b956-b9b75919acbc while it is in vm_state suspended {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:07:55.376108 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-649dc403-8ae2-44e5-99a2-729d771befec tempest-LiveMigrationNegativeTest-205709442 tempest-LiveMigrationNegativeTest-205709442-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/1df89d79-3817-40af-b956-b9b75919acbc/action" status: 409 len: 155 microversion: 2.1 time: 0.138677 Aug 31 16:07:55.376108 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1411/2792] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:07:55 2022] POST /compute/v2.1/servers/1df89d79-3817-40af-b956-b9b75919acbc/action => generated 155 bytes in 147 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 31 16:07:55.385989 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-18729b60-ee61-4e5b-99af-7d6abd4ff48f tempest-SecurityGroupRulesNegativeTestJSON-8994449 tempest-SecurityGroupRulesNegativeTestJSON-8994449-project] Action: 'create', calling method: .version_select at 0x7f5ae93931f0>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-403875430", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:07:55.391132 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-18729b60-ee61-4e5b-99af-7d6abd4ff48f tempest-SecurityGroupRulesNegativeTestJSON-8994449 tempest-SecurityGroupRulesNegativeTestJSON-8994449-project] HTTP exception thrown: Security group id should be uuid Aug 31 16:07:55.394682 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-18729b60-ee61-4e5b-99af-7d6abd4ff48f tempest-SecurityGroupRulesNegativeTestJSON-8994449 tempest-SecurityGroupRulesNegativeTestJSON-8994449-project] Request method failure captured: Aug 31 16:07:55.394682 n-d-850499-9 devstack@n-api.service[122256]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 31 16:07:55.394682 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:07:55.394682 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:07:55.394682 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:07:55.394682 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 130 Aug 31 16:07:55.394682 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:07:55.394682 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:07:55.394682 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:07:55.394682 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:07:55.394682 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4dOO52EJKop8o-fsZmduM55cO24kBduef9IRVN5qFpmftsOkgvTc4AlcKEAIvsnY8Cf_8hxw1aDngsDJGouRBV0m2nXJhgXIxPJJvxKfwIrLrxUEme39KU3zIhTVyZq7aY2E-EFBToOkhLPaPrSaeAPEsKcN-1lMqhTnLQbfcByruw Aug 31 16:07:55.394682 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:07:55.394682 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:07:55.394682 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:07:55.394682 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:07:55.394682 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:07:55.394682 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:07:55.394682 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 6051168fe5674988aab651f98240a6a3 Aug 31 16:07:55.394682 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-8994449 Aug 31 16:07:55.394682 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:07:55.394682 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:07:55.394682 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6051168fe5674988aab651f98240a6a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/6051168fe5674988aab651f98240a6a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_6051168fe5674988aab651f98240a6a3", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6051168fe5674988aab651f98240a6a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:07:55.394682 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-8994449 Aug 31 16:07:55.394682 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 6051168fe5674988aab651f98240a6a3 Aug 31 16:07:55.394682 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-8994449 Aug 31 16:07:55.394682 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-8994449-project Aug 31 16:07:55.394682 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:07:55.394682 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:07:55.394682 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 29387cff4fab4b6dbb6e84770e1e94f4 Aug 31 16:07:55.394682 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-8994449-project Aug 31 16:07:55.394682 n-d-850499-9 devstack@n-api.service[122256]: Aug 31 16:07:55.394682 n-d-850499-9 devstack@n-api.service[122256]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-403875430", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 31 16:07:55.394682 n-d-850499-9 devstack@n-api.service[122256]: method: Aug 31 16:07:55.394682 n-d-850499-9 devstack@n-api.service[122256]: exception: Security group id should be uuid Aug 31 16:07:55.394682 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-403875430', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 31 16:07:55.394682 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:07:55.394682 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:07:55.394682 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Aug 31 16:07:55.394682 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Aug 31 16:07:55.394682 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Aug 31 16:07:55.394682 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Aug 31 16:07:55.394682 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Aug 31 16:07:55.394682 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:07:55.394682 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:07:55.394682 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:07:55.394682 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:07:55.394682 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:07:55.394682 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:07:55.394682 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:07:55.394682 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:07:55.394682 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:07:55.394682 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:07:55.394682 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:07:55.394682 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:07:55.394682 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 31 16:07:55.394682 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 31 16:07:55.394682 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Aug 31 16:07:55.394682 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:07:55.394682 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:07:55.394682 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:07:55.394682 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:07:55.394682 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:07:55.394682 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:07:55.394682 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:07:55.394682 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:07:55.409814 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Aug 31 16:07:55.409814 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:07:55.409814 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-18729b60-ee61-4e5b-99af-7d6abd4ff48f tempest-SecurityGroupRulesNegativeTestJSON-8994449 tempest-SecurityGroupRulesNegativeTestJSON-8994449-project] Returning 400 to user: Security group id should be uuid {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:07:55.409814 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-18729b60-ee61-4e5b-99af-7d6abd4ff48f tempest-SecurityGroupRulesNegativeTestJSON-8994449 tempest-SecurityGroupRulesNegativeTestJSON-8994449-project] 10.222.0.61 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.017680 Aug 31 16:07:55.409814 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1412/2793] 10.222.0.61 () {60 vars in 1195 bytes} [Wed Aug 31 16:07:55 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 31 16:07:55.418805 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-b33bb6b5-aa3c-4255-95bb-fdb4e11bede5 req-0100537d-b23d-49bb-ac31-99f63dc2c39b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f165110-0ea6-48c0-8357-ba419171f7af", "name": "network-vif-plugged", "status": "completed", "tag": "900ed2dd-d7d4-47d6-b6c7-2d39286cc7dc"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:07:55.431828 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-b33bb6b5-aa3c-4255-95bb-fdb4e11bede5 req-0100537d-b23d-49bb-ac31-99f63dc2c39b service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:55.432820 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-b33bb6b5-aa3c-4255-95bb-fdb4e11bede5 req-0100537d-b23d-49bb-ac31-99f63dc2c39b service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:55.433508 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-b33bb6b5-aa3c-4255-95bb-fdb4e11bede5 req-0100537d-b23d-49bb-ac31-99f63dc2c39b service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:55.453006 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-b33bb6b5-aa3c-4255-95bb-fdb4e11bede5 req-0100537d-b23d-49bb-ac31-99f63dc2c39b service nova] Creating event network-vif-plugged:900ed2dd-d7d4-47d6-b6c7-2d39286cc7dc for instance 8f165110-0ea6-48c0-8357-ba419171f7af on n-h1-850499-9 Aug 31 16:07:55.461446 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [req-b33bb6b5-aa3c-4255-95bb-fdb4e11bede5 req-0100537d-b23d-49bb-ac31-99f63dc2c39b service nova] Instance 8f165110-0ea6-48c0-8357-ba419171f7af is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850499-9', 'n-h2-850499-9'} {{(pid=122256) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 31 16:07:55.477932 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-b33bb6b5-aa3c-4255-95bb-fdb4e11bede5 req-0100537d-b23d-49bb-ac31-99f63dc2c39b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077804 Aug 31 16:07:55.484331 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1413/2794] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:07:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:07:55.490521 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ff0802f3-dd99-475f-a60d-ab5cad7497a4 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '.version_select at 0x7f5ae8f9ce50>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:55.547081 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ff0802f3-dd99-475f-a60d-ab5cad7497a4 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "GET /compute/v2.1/images/31a273f9-69d4-464b-8d35-a1a99ede5380" status: 200 len: 1453 microversion: 2.1 time: 0.061056 Aug 31 16:07:55.548043 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1414/2795] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:07:55 2022] GET /compute/v2.1/images/31a273f9-69d4-464b-8d35-a1a99ede5380 => generated 1453 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:55.560922 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-bac9c256-4040-453e-93db-c6c1b7f1e4d6 tempest-FloatingIPDetailsTestJSON-1928649283 tempest-FloatingIPDetailsTestJSON-1928649283-project] Calling method '.version_select at 0x7f5ae91cd430>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:56.070446 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-f75471d8-4167-4d34-9ed2-9e9b8eed481b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: db1ac026-e512-4e5f-839d-4056cec509b3] Updating instance_info_cache with network_info: [] {{(pid=122257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 31 16:07:56.642066 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f75471d8-4167-4d34-9ed2-9e9b8eed481b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "DELETE /compute/v2.1/servers/db1ac026-e512-4e5f-839d-4056cec509b3" status: 204 len: 0 microversion: 2.1 time: 4.164932 Aug 31 16:07:56.643486 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1382/2796] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:07:52 2022] DELETE /compute/v2.1/servers/db1ac026-e512-4e5f-839d-4056cec509b3 => generated 0 bytes in 4167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:07:56.655521 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2180a4cd-081d-4ca2-a7f8-72b85e61a831 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:56.666101 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2180a4cd-081d-4ca2-a7f8-72b85e61a831 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a837ababe7cb4284b96bc16deb40d2d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e9999df7e14609b1265351c83607bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:56.667907 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2180a4cd-081d-4ca2-a7f8-72b85e61a831 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Searching by: {'deleted': False, 'project_id': 'e3e9999df7e14609b1265351c83607bd'} {{(pid=122257) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 16:07:56.680148 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2180a4cd-081d-4ca2-a7f8-72b85e61a831 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:56.680866 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2180a4cd-081d-4ca2-a7f8-72b85e61a831 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:56.682689 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2180a4cd-081d-4ca2-a7f8-72b85e61a831 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:56.684383 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2180a4cd-081d-4ca2-a7f8-72b85e61a831 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:56.686082 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2180a4cd-081d-4ca2-a7f8-72b85e61a831 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:56.687204 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2180a4cd-081d-4ca2-a7f8-72b85e61a831 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:56.732490 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.multi_cell_list [None req-2180a4cd-081d-4ca2-a7f8-72b85e61a831 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122257) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 31 16:07:56.782242 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2180a4cd-081d-4ca2-a7f8-72b85e61a831 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] 10.222.0.61 "GET /compute/v2.1/servers" status: 200 len: 333 microversion: 2.1 time: 0.137258 Aug 31 16:07:56.793679 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1383/2797] 10.222.0.61 () {58 vars in 1125 bytes} [Wed Aug 31 16:07:56 2022] GET /compute/v2.1/servers => generated 333 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:07:56.793679 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-77567329-2fe1-437e-a692-9b7150532da3 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:56.793679 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-77567329-2fe1-437e-a692-9b7150532da3 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] [instance: 1df89d79-3817-40af-b956-b9b75919acbc] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:56.802431 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-77567329-2fe1-437e-a692-9b7150532da3 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:56.803210 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-77567329-2fe1-437e-a692-9b7150532da3 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:56.811057 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-77567329-2fe1-437e-a692-9b7150532da3 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:56.811057 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-77567329-2fe1-437e-a692-9b7150532da3 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:56.811057 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-77567329-2fe1-437e-a692-9b7150532da3 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:56.811057 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-77567329-2fe1-437e-a692-9b7150532da3 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:56.857061 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-77567329-2fe1-437e-a692-9b7150532da3 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] [instance: 1df89d79-3817-40af-b956-b9b75919acbc] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:07:57.006042 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-77567329-2fe1-437e-a692-9b7150532da3 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] 10.222.0.61 "DELETE /compute/v2.1/servers/1df89d79-3817-40af-b956-b9b75919acbc" status: 204 len: 0 microversion: 2.1 time: 0.220417 Aug 31 16:07:57.007363 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1384/2798] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:07:56 2022] DELETE /compute/v2.1/servers/1df89d79-3817-40af-b956-b9b75919acbc => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:07:57.016041 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-714c9bbd-fb32-44a7-8bcc-9afd476ec72f tempest-SecurityGroupRulesNegativeTestJSON-8994449 tempest-SecurityGroupRulesNegativeTestJSON-8994449-project] Action: 'create', calling method: .version_select at 0x7f5ae8404670>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-93288859", "description": "tempest-description-371772427"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:07:57.480093 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-bac9c256-4040-453e-93db-c6c1b7f1e4d6 tempest-FloatingIPDetailsTestJSON-1928649283 tempest-FloatingIPDetailsTestJSON-1928649283-project] 10.222.0.61 "DELETE /compute/v2.1/os-floating-ips/9648c5c8-32f4-4be3-9fb0-0e171af848fa" status: 202 len: 0 microversion: 2.1 time: 1.930551 Aug 31 16:07:57.480691 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1415/2799] 10.222.0.61 () {58 vars in 1263 bytes} [Wed Aug 31 16:07:55 2022] DELETE /compute/v2.1/os-floating-ips/9648c5c8-32f4-4be3-9fb0-0e171af848fa => generated 0 bytes in 1932 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:07:57.486530 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-8718e7aa-8af5-4d3c-8ca4-9151ceaa3e12 req-20936c59-1ffb-4dfe-b62c-8cc53e0cfe3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db1ac026-e512-4e5f-839d-4056cec509b3", "name": "network-vif-deleted", "tag": "af630af3-517b-4dc1-b7cf-dda0aebb1a90"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:07:57.499293 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-8718e7aa-8af5-4d3c-8ca4-9151ceaa3e12 req-20936c59-1ffb-4dfe-b62c-8cc53e0cfe3e service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:57.499817 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-8718e7aa-8af5-4d3c-8ca4-9151ceaa3e12 req-20936c59-1ffb-4dfe-b62c-8cc53e0cfe3e service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:57.500325 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-8718e7aa-8af5-4d3c-8ca4-9151ceaa3e12 req-20936c59-1ffb-4dfe-b62c-8cc53e0cfe3e service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:57.510543 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-714c9bbd-fb32-44a7-8bcc-9afd476ec72f tempest-SecurityGroupRulesNegativeTestJSON-8994449 tempest-SecurityGroupRulesNegativeTestJSON-8994449-project] 10.222.0.61 "POST /compute/v2.1/os-security-groups" status: 200 len: 253 microversion: 2.1 time: 0.496830 Aug 31 16:07:57.510543 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1385/2800] 10.222.0.61 () {60 vars in 1180 bytes} [Wed Aug 31 16:07:57 2022] POST /compute/v2.1/os-security-groups => generated 253 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:07:57.515708 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e0b2b59d-7292-44d3-9ca2-4ca848f459f5 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:57.516790 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e0b2b59d-7292-44d3-9ca2-4ca848f459f5 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 8f165110-0ea6-48c0-8357-ba419171f7af] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:57.529631 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.compute.server_external_events [req-8718e7aa-8af5-4d3c-8ca4-9151ceaa3e12 req-20936c59-1ffb-4dfe-b62c-8cc53e0cfe3e service nova] Unable to find a host for instance db1ac026-e512-4e5f-839d-4056cec509b3. Dropping event network-vif-deleted {{(pid=122256) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 31 16:07:57.530538 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-8718e7aa-8af5-4d3c-8ca4-9151ceaa3e12 req-20936c59-1ffb-4dfe-b62c-8cc53e0cfe3e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.048845 Aug 31 16:07:57.534386 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1416/2801] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:07:57 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 53 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 31 16:07:57.540837 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f3e29aed-0870-4252-a678-52fe41fdc806 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '.version_select at 0x7f5ae92bb8b0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:57.592588 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e0b2b59d-7292-44d3-9ca2-4ca848f459f5 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:57.593013 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e0b2b59d-7292-44d3-9ca2-4ca848f459f5 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:57.593520 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e0b2b59d-7292-44d3-9ca2-4ca848f459f5 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:57.594395 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e0b2b59d-7292-44d3-9ca2-4ca848f459f5 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:57.594960 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e0b2b59d-7292-44d3-9ca2-4ca848f459f5 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:57.595482 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e0b2b59d-7292-44d3-9ca2-4ca848f459f5 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:57.625510 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f3e29aed-0870-4252-a678-52fe41fdc806 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "GET /compute/v2.1/images/31a273f9-69d4-464b-8d35-a1a99ede5380" status: 200 len: 1453 microversion: 2.1 time: 0.089658 Aug 31 16:07:57.626561 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1417/2802] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:07:57 2022] GET /compute/v2.1/images/31a273f9-69d4-464b-8d35-a1a99ede5380 => generated 1453 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:57.634199 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-23b4eaee-510a-499d-b0c8-97f97608a19c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:57.636112 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-23b4eaee-510a-499d-b0c8-97f97608a19c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: db1ac026-e512-4e5f-839d-4056cec509b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:57.646507 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-23b4eaee-510a-499d-b0c8-97f97608a19c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:57.647180 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-23b4eaee-510a-499d-b0c8-97f97608a19c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:57.647879 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-23b4eaee-510a-499d-b0c8-97f97608a19c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:57.649030 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-23b4eaee-510a-499d-b0c8-97f97608a19c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:57.649868 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-23b4eaee-510a-499d-b0c8-97f97608a19c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:57.652142 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-23b4eaee-510a-499d-b0c8-97f97608a19c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:57.674319 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-23b4eaee-510a-499d-b0c8-97f97608a19c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] HTTP exception thrown: Instance db1ac026-e512-4e5f-839d-4056cec509b3 could not be found. Aug 31 16:07:57.676067 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-23b4eaee-510a-499d-b0c8-97f97608a19c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Request method failure captured: Aug 31 16:07:57.676067 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/db1ac026-e512-4e5f-839d-4056cec509b3 HTTP/1.1 Aug 31 16:07:57.676067 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:07:57.676067 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:07:57.676067 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:07:57.676067 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:07:57.676067 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:07:57.676067 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:07:57.676067 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:07:57.676067 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:07:57.676067 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4Yo5dNOTiRoHOXx-UM5Sn8Jbzoi0Z4yz9YBk3W8_DEhZnVZu-DDO0QOzNoQHJ1nNP8QtjbDsJSdq3n7hK4ZXI2LEyeWPrk9aNaREtGRbElEfeP-G76pg20KjiuDCyp0gfSMP_cw21bhq2fJbey8HuCI0lmGBIAsUVWfxqkVQu-gwfg Aug 31 16:07:57.676067 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:07:57.676067 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:07:57.676067 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:07:57.676067 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:07:57.676067 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:07:57.676067 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:07:57.676067 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: af5a8bccbcb14afd9c6bcd6f4d4f8047 Aug 31 16:07:57.676067 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-DeleteServersTestJSON-1125268000 Aug 31 16:07:57.676067 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:07:57.676067 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:07:57.676067 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/af5a8bccbcb14afd9c6bcd6f4d4f8047"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/af5a8bccbcb14afd9c6bcd6f4d4f8047"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_af5a8bccbcb14afd9c6bcd6f4d4f8047", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/af5a8bccbcb14afd9c6bcd6f4d4f8047"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:07:57.676067 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-DeleteServersTestJSON-1125268000 Aug 31 16:07:57.676067 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: af5a8bccbcb14afd9c6bcd6f4d4f8047 Aug 31 16:07:57.676067 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-DeleteServersTestJSON-1125268000 Aug 31 16:07:57.676067 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-DeleteServersTestJSON-1125268000-project Aug 31 16:07:57.676067 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:07:57.676067 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:07:57.676067 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 4ee58e6a7c284cc9a9c87d0a5c1239aa Aug 31 16:07:57.676067 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-DeleteServersTestJSON-1125268000-project Aug 31 16:07:57.676067 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:07:57.676067 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance db1ac026-e512-4e5f-839d-4056cec509b3 could not be found. Aug 31 16:07:57.676067 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': 'db1ac026-e512-4e5f-839d-4056cec509b3'} Aug 31 16:07:57.676067 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:07:57.676067 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:07:57.676067 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:07:57.676067 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:07:57.676067 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:07:57.676067 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:07:57.676067 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:07:57.676067 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:07:57.676067 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:07:57.676067 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:07:57.676067 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db1ac026-e512-4e5f-839d-4056cec509b3 could not be found. Aug 31 16:07:57.676067 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:07:57.676067 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:07:57.676067 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:07:57.676067 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:07:57.676067 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:07:57.676067 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:07:57.676067 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:07:57.676067 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:07:57.676067 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:07:57.676067 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:07:57.676067 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:07:57.676067 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:07:57.676067 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:07:57.676067 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:07:57.676067 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:07:57.676067 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:07:57.676067 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db1ac026-e512-4e5f-839d-4056cec509b3 could not be found. Aug 31 16:07:57.676067 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:07:57.676067 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:07:57.676067 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:07:57.682283 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:07:57.682283 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:07:57.682283 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:07:57.682283 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:07:57.682283 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:07:57.682283 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db1ac026-e512-4e5f-839d-4056cec509b3 could not be found. Aug 31 16:07:57.682283 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:07:57.682283 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-23b4eaee-510a-499d-b0c8-97f97608a19c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Returning 404 to user: Instance db1ac026-e512-4e5f-839d-4056cec509b3 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:07:57.682283 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-23b4eaee-510a-499d-b0c8-97f97608a19c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/db1ac026-e512-4e5f-839d-4056cec509b3" status: 404 len: 111 microversion: 2.1 time: 0.049701 Aug 31 16:07:57.683927 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1418/2803] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:57 2022] GET /compute/v2.1/servers/db1ac026-e512-4e5f-839d-4056cec509b3 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:07:57.688905 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-212a8d46-a9da-4d3c-9ee6-bd7b0b807687 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:57.694174 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-212a8d46-a9da-4d3c-9ee6-bd7b0b807687 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a837ababe7cb4284b96bc16deb40d2d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e9999df7e14609b1265351c83607bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:57.695071 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-212a8d46-a9da-4d3c-9ee6-bd7b0b807687 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Searching by: {'deleted': False, 'project_id': 'e3e9999df7e14609b1265351c83607bd'} {{(pid=122256) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 16:07:57.708681 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-212a8d46-a9da-4d3c-9ee6-bd7b0b807687 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:57.709392 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-212a8d46-a9da-4d3c-9ee6-bd7b0b807687 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:57.732968 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-212a8d46-a9da-4d3c-9ee6-bd7b0b807687 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:57.732968 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-212a8d46-a9da-4d3c-9ee6-bd7b0b807687 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:57.732968 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-212a8d46-a9da-4d3c-9ee6-bd7b0b807687 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:57.732968 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-212a8d46-a9da-4d3c-9ee6-bd7b0b807687 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:57.774624 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.multi_cell_list [None req-212a8d46-a9da-4d3c-9ee6-bd7b0b807687 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122256) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 31 16:07:57.826190 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-212a8d46-a9da-4d3c-9ee6-bd7b0b807687 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a837ababe7cb4284b96bc16deb40d2d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e9999df7e14609b1265351c83607bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:57.833165 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-212a8d46-a9da-4d3c-9ee6-bd7b0b807687 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:57.833899 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-212a8d46-a9da-4d3c-9ee6-bd7b0b807687 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:57.834348 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-212a8d46-a9da-4d3c-9ee6-bd7b0b807687 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:57.886345 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e0b2b59d-7292-44d3-9ca2-4ca848f459f5 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:57.897871 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e0b2b59d-7292-44d3-9ca2-4ca848f459f5 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/8f165110-0ea6-48c0-8357-ba419171f7af" status: 200 len: 1469 microversion: 2.1 time: 0.389179 Aug 31 16:07:57.918732 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1386/2804] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:57 2022] GET /compute/v2.1/servers/8f165110-0ea6-48c0-8357-ba419171f7af => generated 1469 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:57.933041 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a7b2971f-2347-4457-a762-74338b6b3e48 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:57.933667 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a7b2971f-2347-4457-a762-74338b6b3e48 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] [instance: 1df89d79-3817-40af-b956-b9b75919acbc] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:57.940263 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a7b2971f-2347-4457-a762-74338b6b3e48 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:57.940846 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a7b2971f-2347-4457-a762-74338b6b3e48 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:57.941289 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a7b2971f-2347-4457-a762-74338b6b3e48 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:57.941993 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a7b2971f-2347-4457-a762-74338b6b3e48 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:57.942485 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a7b2971f-2347-4457-a762-74338b6b3e48 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:57.942909 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a7b2971f-2347-4457-a762-74338b6b3e48 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:57.962318 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:07:58.068537 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-212a8d46-a9da-4d3c-9ee6-bd7b0b807687 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] 10.222.0.61 "GET /compute/v2.1/servers/detail" status: 200 len: 1698 microversion: 2.1 time: 0.383399 Aug 31 16:07:58.069413 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1419/2805] 10.222.0.61 () {58 vars in 1146 bytes} [Wed Aug 31 16:07:57 2022] GET /compute/v2.1/servers/detail => generated 1698 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:58.074828 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2c4c9ec4-3085-4f0a-8818-855f29d65561 tempest-FloatingIPDetailsTestJSON-1928649283 tempest-FloatingIPDetailsTestJSON-1928649283-project] Calling method '.version_select at 0x7f5ae9313a60>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:58.336412 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a7b2971f-2347-4457-a762-74338b6b3e48 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb6a27e336449738f68a88d870ca6e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f79872256b2647d6a01c9e753b93b3c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:58.352854 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a7b2971f-2347-4457-a762-74338b6b3e48 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] 10.222.0.61 "GET /compute/v2.1/servers/1df89d79-3817-40af-b956-b9b75919acbc" status: 200 len: 1463 microversion: 2.1 time: 0.428614 Aug 31 16:07:58.354203 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1387/2806] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:57 2022] GET /compute/v2.1/servers/1df89d79-3817-40af-b956-b9b75919acbc => generated 1463 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:58.360756 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8c97248c-70ba-4392-b142-9179d6cdc3f1 tempest-SecurityGroupRulesNegativeTestJSON-8994449 tempest-SecurityGroupRulesNegativeTestJSON-8994449-project] Action: 'create', calling method: .version_select at 0x7f5ae83e2310>, body: {"security_group_rule": {"parent_group_id": "f2c533a2-bcf6-4868-8857-9af91627e646", "ip_protocol": "tempest-999-225472695", "from_port": 22, "to_port": 22}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:07:58.854928 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-8c97248c-70ba-4392-b142-9179d6cdc3f1 tempest-SecurityGroupRulesNegativeTestJSON-8994449 tempest-SecurityGroupRulesNegativeTestJSON-8994449-project] HTTP exception thrown: Invalid IP protocol tempest-999-225472695. Aug 31 16:07:58.856779 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8c97248c-70ba-4392-b142-9179d6cdc3f1 tempest-SecurityGroupRulesNegativeTestJSON-8994449 tempest-SecurityGroupRulesNegativeTestJSON-8994449-project] Request method failure captured: Aug 31 16:07:58.856779 n-d-850499-9 devstack@n-api.service[122257]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 31 16:07:58.856779 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:07:58.856779 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:07:58.856779 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:07:58.856779 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 156 Aug 31 16:07:58.856779 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:07:58.856779 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:07:58.856779 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:07:58.856779 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:07:58.856779 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4dOO52EJKop8o-fsZmduM55cO24kBduef9IRVN5qFpmftsOkgvTc4AlcKEAIvsnY8Cf_8hxw1aDngsDJGouRBV0m2nXJhgXIxPJJvxKfwIrLrxUEme39KU3zIhTVyZq7aY2E-EFBToOkhLPaPrSaeAPEsKcN-1lMqhTnLQbfcByruw Aug 31 16:07:58.856779 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:07:58.856779 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:07:58.856779 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:07:58.856779 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:07:58.856779 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:07:58.856779 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:07:58.856779 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 6051168fe5674988aab651f98240a6a3 Aug 31 16:07:58.856779 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-8994449 Aug 31 16:07:58.856779 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:07:58.856779 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:07:58.856779 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6051168fe5674988aab651f98240a6a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/6051168fe5674988aab651f98240a6a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_6051168fe5674988aab651f98240a6a3", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6051168fe5674988aab651f98240a6a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:07:58.856779 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-8994449 Aug 31 16:07:58.856779 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 6051168fe5674988aab651f98240a6a3 Aug 31 16:07:58.856779 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-8994449 Aug 31 16:07:58.856779 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-8994449-project Aug 31 16:07:58.856779 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:07:58.856779 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:07:58.856779 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 29387cff4fab4b6dbb6e84770e1e94f4 Aug 31 16:07:58.856779 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-8994449-project Aug 31 16:07:58.856779 n-d-850499-9 devstack@n-api.service[122257]: Aug 31 16:07:58.856779 n-d-850499-9 devstack@n-api.service[122257]: {"security_group_rule": {"parent_group_id": "f2c533a2-bcf6-4868-8857-9af91627e646", "ip_protocol": "tempest-999-225472695", "from_port": 22, "to_port": 22}} Aug 31 16:07:58.856779 n-d-850499-9 devstack@n-api.service[122257]: method: Aug 31 16:07:58.856779 n-d-850499-9 devstack@n-api.service[122257]: exception: Invalid IP protocol tempest-999-225472695. Aug 31 16:07:58.856779 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'f2c533a2-bcf6-4868-8857-9af91627e646', 'ip_protocol': 'tempest-999-225472695', 'from_port': 22, 'to_port': 22}}} Aug 31 16:07:58.856779 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:07:58.856779 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:07:58.856779 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 31 16:07:58.856779 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 31 16:07:58.856779 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 31 16:07:58.856779 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 31 16:07:58.856779 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 31 16:07:58.856779 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 31 16:07:58.856779 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Aug 31 16:07:58.856779 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Aug 31 16:07:58.856779 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-225472695. Aug 31 16:07:58.856779 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:07:58.856779 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:07:58.856779 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:07:58.856779 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:07:58.856779 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:07:58.856779 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:07:58.856779 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:07:58.856779 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:07:58.856779 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:07:58.856779 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:07:58.856779 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:07:58.856779 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:07:58.856779 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 31 16:07:58.856779 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 31 16:07:58.856779 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-225472695. Aug 31 16:07:58.856779 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:07:58.856779 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:07:58.860857 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:07:58.860857 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:07:58.860857 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:07:58.860857 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:07:58.860857 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:07:58.860857 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:07:58.860857 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-225472695. Aug 31 16:07:58.860857 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:07:58.860857 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8c97248c-70ba-4392-b142-9179d6cdc3f1 tempest-SecurityGroupRulesNegativeTestJSON-8994449 tempest-SecurityGroupRulesNegativeTestJSON-8994449-project] Returning 400 to user: Invalid IP protocol tempest-999-225472695. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:07:58.860857 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8c97248c-70ba-4392-b142-9179d6cdc3f1 tempest-SecurityGroupRulesNegativeTestJSON-8994449 tempest-SecurityGroupRulesNegativeTestJSON-8994449-project] 10.222.0.61 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 86 microversion: 2.1 time: 0.503714 Aug 31 16:07:58.865902 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1388/2807] 10.222.0.61 () {60 vars in 1195 bytes} [Wed Aug 31 16:07:58 2022] POST /compute/v2.1/os-security-group-rules => generated 86 bytes in 506 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 31 16:07:58.875171 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f6c78ddf-2d01-43b2-afcf-62e72eaa985c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-110874985", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "networks": [{"uuid": "b472c169-a645-4811-858d-fe4088611ce7"}]}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:07:58.953179 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-f6c78ddf-2d01-43b2-afcf-62e72eaa985c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] validate_networks() for [('b472c169-a645-4811-858d-fe4088611ce7', None, None, None, None, None)] {{(pid=122257) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:08:00.343810 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-f6c78ddf-2d01-43b2-afcf-62e72eaa985c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:08:00.344442 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-f6c78ddf-2d01-43b2-afcf-62e72eaa985c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:08:00.344984 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-f6c78ddf-2d01-43b2-afcf-62e72eaa985c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:08:00.345593 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-f6c78ddf-2d01-43b2-afcf-62e72eaa985c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:08:00.346029 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-f6c78ddf-2d01-43b2-afcf-62e72eaa985c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:08:00.359641 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f6c78ddf-2d01-43b2-afcf-62e72eaa985c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:00.360847 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f6c78ddf-2d01-43b2-afcf-62e72eaa985c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:00.361482 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f6c78ddf-2d01-43b2-afcf-62e72eaa985c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:00.363056 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f6c78ddf-2d01-43b2-afcf-62e72eaa985c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:00.363865 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f6c78ddf-2d01-43b2-afcf-62e72eaa985c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:00.364715 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f6c78ddf-2d01-43b2-afcf-62e72eaa985c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:00.403434 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-f6c78ddf-2d01-43b2-afcf-62e72eaa985c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Getting quotas for project af5a8bccbcb14afd9c6bcd6f4d4f8047. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:08:00.410479 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-f6c78ddf-2d01-43b2-afcf-62e72eaa985c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Getting quotas for user 4ee58e6a7c284cc9a9c87d0a5c1239aa and project af5a8bccbcb14afd9c6bcd6f4d4f8047. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:08:00.430210 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f6c78ddf-2d01-43b2-afcf-62e72eaa985c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Going to run 1 instances... {{(pid=122257) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:08:00.435153 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f6c78ddf-2d01-43b2-afcf-62e72eaa985c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 0a5d6a47-ce38-4d1d-8d97-550f5e950af5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:08:00.459035 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2c4c9ec4-3085-4f0a-8818-855f29d65561 tempest-FloatingIPDetailsTestJSON-1928649283 tempest-FloatingIPDetailsTestJSON-1928649283-project] 10.222.0.61 "DELETE /compute/v2.1/os-floating-ips/3e0cf371-c5cf-474d-9b17-ae39823fbfa0" status: 202 len: 0 microversion: 2.1 time: 2.387352 Aug 31 16:08:00.464102 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1420/2808] 10.222.0.61 () {58 vars in 1263 bytes} [Wed Aug 31 16:07:58 2022] DELETE /compute/v2.1/os-floating-ips/3e0cf371-c5cf-474d-9b17-ae39823fbfa0 => generated 0 bytes in 2394 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:08:00.470999 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-50d597fe-1482-4332-8135-54b068d98553 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:00.483866 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-50d597fe-1482-4332-8135-54b068d98553 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] 10.222.0.61 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017153 Aug 31 16:08:00.492733 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1421/2809] 10.222.0.61 () {58 vars in 1137 bytes} [Wed Aug 31 16:08:00 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:08:00.499722 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c6cdeebb-d98d-4039-8c14-c3998ff87a85 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '.version_select at 0x7f5ae98510d0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:00.500577 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f6c78ddf-2d01-43b2-afcf-62e72eaa985c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.631900 Aug 31 16:08:00.502454 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1389/2810] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:07:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1636 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:08:00.513038 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-35c7584f-30c1-4070-b922-09a66dcce973 tempest-SecurityGroupRulesNegativeTestJSON-8994449 tempest-SecurityGroupRulesNegativeTestJSON-8994449-project] Action: 'create', calling method: .version_select at 0x7f5ae83f2d30>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1334266651", "description": "tempest-description-697929754"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:08:00.587066 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c6cdeebb-d98d-4039-8c14-c3998ff87a85 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "GET /compute/v2.1/images/31a273f9-69d4-464b-8d35-a1a99ede5380" status: 200 len: 1462 microversion: 2.1 time: 0.091284 Aug 31 16:08:00.593175 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1422/2811] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:08:00 2022] GET /compute/v2.1/images/31a273f9-69d4-464b-8d35-a1a99ede5380 => generated 1462 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:00.600946 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c2f5e9e7-96c8-42dd-bea9-f3a8fdd0d438 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:00.603765 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c2f5e9e7-96c8-42dd-bea9-f3a8fdd0d438 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 8f165110-0ea6-48c0-8357-ba419171f7af] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:00.618678 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c2f5e9e7-96c8-42dd-bea9-f3a8fdd0d438 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:00.623075 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c2f5e9e7-96c8-42dd-bea9-f3a8fdd0d438 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:00.625892 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c2f5e9e7-96c8-42dd-bea9-f3a8fdd0d438 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:00.626918 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c2f5e9e7-96c8-42dd-bea9-f3a8fdd0d438 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:00.630284 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c2f5e9e7-96c8-42dd-bea9-f3a8fdd0d438 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:00.631139 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c2f5e9e7-96c8-42dd-bea9-f3a8fdd0d438 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:00.788976 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-35c7584f-30c1-4070-b922-09a66dcce973 tempest-SecurityGroupRulesNegativeTestJSON-8994449 tempest-SecurityGroupRulesNegativeTestJSON-8994449-project] 10.222.0.61 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.284779 Aug 31 16:08:00.790702 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1390/2812] 10.222.0.61 () {60 vars in 1180 bytes} [Wed Aug 31 16:08:00 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:08:00.798612 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-67a69a08-14eb-43c6-bb2f-3db2049edf02 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:00.800069 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-67a69a08-14eb-43c6-bb2f-3db2049edf02 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] [instance: 1df89d79-3817-40af-b956-b9b75919acbc] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:00.830793 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-67a69a08-14eb-43c6-bb2f-3db2049edf02 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:00.841018 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-67a69a08-14eb-43c6-bb2f-3db2049edf02 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:00.841630 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-67a69a08-14eb-43c6-bb2f-3db2049edf02 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:00.842395 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-67a69a08-14eb-43c6-bb2f-3db2049edf02 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:00.842922 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-67a69a08-14eb-43c6-bb2f-3db2049edf02 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:00.843799 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-67a69a08-14eb-43c6-bb2f-3db2049edf02 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:00.932217 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c2f5e9e7-96c8-42dd-bea9-f3a8fdd0d438 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:00.942371 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c2f5e9e7-96c8-42dd-bea9-f3a8fdd0d438 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/8f165110-0ea6-48c0-8357-ba419171f7af" status: 200 len: 1469 microversion: 2.1 time: 0.347916 Aug 31 16:08:00.957476 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1423/2813] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:00 2022] GET /compute/v2.1/servers/8f165110-0ea6-48c0-8357-ba419171f7af => generated 1469 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:00.959532 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-67a69a08-14eb-43c6-bb2f-3db2049edf02 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb6a27e336449738f68a88d870ca6e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f79872256b2647d6a01c9e753b93b3c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:00.963990 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-fe224ffb-0f3b-4d9b-ad3c-7be647c86c1b req-6cd8a15f-65ef-452b-a8a7-8d27a505a124 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f165110-0ea6-48c0-8357-ba419171f7af", "name": "network-vif-unplugged", "status": "completed", "tag": "900ed2dd-d7d4-47d6-b6c7-2d39286cc7dc"}, {"name": "network-changed", "server_uuid": "8f165110-0ea6-48c0-8357-ba419171f7af", "tag": "900ed2dd-d7d4-47d6-b6c7-2d39286cc7dc"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:08:00.977895 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-fe224ffb-0f3b-4d9b-ad3c-7be647c86c1b req-6cd8a15f-65ef-452b-a8a7-8d27a505a124 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:00.980075 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-67a69a08-14eb-43c6-bb2f-3db2049edf02 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] 10.222.0.61 "GET /compute/v2.1/servers/1df89d79-3817-40af-b956-b9b75919acbc" status: 200 len: 1421 microversion: 2.1 time: 0.187659 Aug 31 16:08:00.980702 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1391/2814] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:00 2022] GET /compute/v2.1/servers/1df89d79-3817-40af-b956-b9b75919acbc => generated 1421 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:00.985361 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1f750f29-92ed-47db-be52-8b09e8fca05b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:00.985552 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-fe224ffb-0f3b-4d9b-ad3c-7be647c86c1b req-6cd8a15f-65ef-452b-a8a7-8d27a505a124 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:00.986127 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-fe224ffb-0f3b-4d9b-ad3c-7be647c86c1b req-6cd8a15f-65ef-452b-a8a7-8d27a505a124 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:00.986498 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1f750f29-92ed-47db-be52-8b09e8fca05b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 0a5d6a47-ce38-4d1d-8d97-550f5e950af5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:01.003336 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-fe224ffb-0f3b-4d9b-ad3c-7be647c86c1b req-6cd8a15f-65ef-452b-a8a7-8d27a505a124 service nova] Creating event network-vif-unplugged:900ed2dd-d7d4-47d6-b6c7-2d39286cc7dc for instance 8f165110-0ea6-48c0-8357-ba419171f7af on n-h1-850499-9 Aug 31 16:08:01.004027 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-fe224ffb-0f3b-4d9b-ad3c-7be647c86c1b req-6cd8a15f-65ef-452b-a8a7-8d27a505a124 service nova] Creating event network-changed:900ed2dd-d7d4-47d6-b6c7-2d39286cc7dc for instance 8f165110-0ea6-48c0-8357-ba419171f7af on n-h1-850499-9 Aug 31 16:08:01.011349 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [req-fe224ffb-0f3b-4d9b-ad3c-7be647c86c1b req-6cd8a15f-65ef-452b-a8a7-8d27a505a124 service nova] Instance 8f165110-0ea6-48c0-8357-ba419171f7af is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850499-9', 'n-h2-850499-9'} {{(pid=122256) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 31 16:08:01.035043 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-fe224ffb-0f3b-4d9b-ad3c-7be647c86c1b req-6cd8a15f-65ef-452b-a8a7-8d27a505a124 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.080141 Aug 31 16:08:01.035043 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1424/2815] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:08:00 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:08:01.041562 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-eafc64c2-d51c-4943-9f69-959fddcc076e tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '.version_select at 0x7f5ae9367310>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:01.080834 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-1f750f29-92ed-47db-be52-8b09e8fca05b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:01.097844 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1f750f29-92ed-47db-be52-8b09e8fca05b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/0a5d6a47-ce38-4d1d-8d97-550f5e950af5" status: 200 len: 1214 microversion: 2.1 time: 0.115970 Aug 31 16:08:01.098823 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1392/2816] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:00 2022] GET /compute/v2.1/servers/0a5d6a47-ce38-4d1d-8d97-550f5e950af5 => generated 1214 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:01.111020 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-eafc64c2-d51c-4943-9f69-959fddcc076e tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "GET /compute/v2.1/images/31a273f9-69d4-464b-8d35-a1a99ede5380" status: 200 len: 1462 microversion: 2.1 time: 0.075261 Aug 31 16:08:01.113009 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1425/2817] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:08:01 2022] GET /compute/v2.1/images/31a273f9-69d4-464b-8d35-a1a99ede5380 => generated 1462 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:01.116279 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-14059baa-522c-43d6-a150-6d328c67303d tempest-SecurityGroupRulesNegativeTestJSON-8994449 tempest-SecurityGroupRulesNegativeTestJSON-8994449-project] Action: 'create', calling method: .version_select at 0x7f5ae83f2a60>, body: {"security_group_rule": {"parent_group_id": "77cf5f77-7030-42f1-ac84-a17f608d3c3e", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:08:01.128751 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8fa87c9e-ee87-4689-a94e-0dcef0f9878d tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:01.129876 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8fa87c9e-ee87-4689-a94e-0dcef0f9878d tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] [instance: 1f11f86d-3387-4c6e-9099-fc8d232b11a8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:01.140640 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8fa87c9e-ee87-4689-a94e-0dcef0f9878d tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:01.142175 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8fa87c9e-ee87-4689-a94e-0dcef0f9878d tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:01.143089 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8fa87c9e-ee87-4689-a94e-0dcef0f9878d tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:01.145656 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8fa87c9e-ee87-4689-a94e-0dcef0f9878d tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:01.146394 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8fa87c9e-ee87-4689-a94e-0dcef0f9878d tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:01.147278 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8fa87c9e-ee87-4689-a94e-0dcef0f9878d tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:01.213654 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8fa87c9e-ee87-4689-a94e-0dcef0f9878d tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] [instance: 1f11f86d-3387-4c6e-9099-fc8d232b11a8] Going to try to terminate instance {{(pid=122256) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:08:01.275105 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:08:01.305086 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-14059baa-522c-43d6-a150-6d328c67303d tempest-SecurityGroupRulesNegativeTestJSON-8994449 tempest-SecurityGroupRulesNegativeTestJSON-8994449-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Aug 31 16:08:01.307665 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-14059baa-522c-43d6-a150-6d328c67303d tempest-SecurityGroupRulesNegativeTestJSON-8994449 tempest-SecurityGroupRulesNegativeTestJSON-8994449-project] Request method failure captured: Aug 31 16:08:01.307665 n-d-850499-9 devstack@n-api.service[122257]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 31 16:08:01.307665 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:08:01.307665 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:08:01.307665 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:08:01.307665 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 138 Aug 31 16:08:01.307665 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:08:01.307665 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:08:01.307665 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:08:01.307665 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:08:01.307665 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4dOO52EJKop8o-fsZmduM55cO24kBduef9IRVN5qFpmftsOkgvTc4AlcKEAIvsnY8Cf_8hxw1aDngsDJGouRBV0m2nXJhgXIxPJJvxKfwIrLrxUEme39KU3zIhTVyZq7aY2E-EFBToOkhLPaPrSaeAPEsKcN-1lMqhTnLQbfcByruw Aug 31 16:08:01.307665 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:08:01.307665 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:08:01.307665 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:08:01.307665 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:08:01.307665 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:08:01.307665 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:08:01.307665 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 6051168fe5674988aab651f98240a6a3 Aug 31 16:08:01.307665 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-8994449 Aug 31 16:08:01.307665 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:08:01.307665 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:08:01.307665 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6051168fe5674988aab651f98240a6a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/6051168fe5674988aab651f98240a6a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_6051168fe5674988aab651f98240a6a3", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6051168fe5674988aab651f98240a6a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:08:01.307665 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-8994449 Aug 31 16:08:01.307665 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 6051168fe5674988aab651f98240a6a3 Aug 31 16:08:01.307665 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-8994449 Aug 31 16:08:01.307665 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-8994449-project Aug 31 16:08:01.307665 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:08:01.307665 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:08:01.307665 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 29387cff4fab4b6dbb6e84770e1e94f4 Aug 31 16:08:01.307665 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-8994449-project Aug 31 16:08:01.307665 n-d-850499-9 devstack@n-api.service[122257]: Aug 31 16:08:01.307665 n-d-850499-9 devstack@n-api.service[122257]: {"security_group_rule": {"parent_group_id": "77cf5f77-7030-42f1-ac84-a17f608d3c3e", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Aug 31 16:08:01.307665 n-d-850499-9 devstack@n-api.service[122257]: method: Aug 31 16:08:01.307665 n-d-850499-9 devstack@n-api.service[122257]: exception: Invalid port range 22:21. Former value cannot be greater than the later Aug 31 16:08:01.307665 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'body': {'security_group_rule': {'parent_group_id': '77cf5f77-7030-42f1-ac84-a17f608d3c3e', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Aug 31 16:08:01.307665 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:08:01.307665 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:08:01.307665 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 31 16:08:01.307665 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 31 16:08:01.307665 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 31 16:08:01.307665 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 31 16:08:01.307665 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 31 16:08:01.307665 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 31 16:08:01.307665 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Aug 31 16:08:01.307665 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 31 16:08:01.307665 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Aug 31 16:08:01.307665 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:08:01.307665 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:08:01.307665 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:08:01.307665 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:08:01.307665 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:08:01.307665 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:08:01.307665 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:08:01.307665 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:08:01.307665 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:08:01.307665 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:08:01.307665 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:08:01.307665 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:08:01.307665 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 31 16:08:01.307665 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 31 16:08:01.307665 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Aug 31 16:08:01.307665 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:08:01.314205 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:08:01.314205 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:08:01.314205 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:08:01.314205 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:08:01.314205 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:08:01.314205 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:08:01.314205 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:08:01.314205 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Aug 31 16:08:01.314205 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:08:01.318896 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-14059baa-522c-43d6-a150-6d328c67303d tempest-SecurityGroupRulesNegativeTestJSON-8994449 tempest-SecurityGroupRulesNegativeTestJSON-8994449-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:08:01.320370 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-14059baa-522c-43d6-a150-6d328c67303d tempest-SecurityGroupRulesNegativeTestJSON-8994449 tempest-SecurityGroupRulesNegativeTestJSON-8994449-project] 10.222.0.61 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.219900 Aug 31 16:08:01.321997 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1393/2818] 10.222.0.61 () {60 vars in 1195 bytes} [Wed Aug 31 16:08:01 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 222 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:08:01.340915 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8a6879e2-f0df-45a4-9893-5183e6cfd437 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:01.341654 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8a6879e2-f0df-45a4-9893-5183e6cfd437 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] [instance: 359f06bd-00e9-4d68-b066-db73d7073a04] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:01.356033 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8fa87c9e-ee87-4689-a94e-0dcef0f9878d tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] 10.222.0.61 "DELETE /compute/v2.1/servers/1f11f86d-3387-4c6e-9099-fc8d232b11a8" status: 204 len: 0 microversion: 2.1 time: 0.239287 Aug 31 16:08:01.358746 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8a6879e2-f0df-45a4-9893-5183e6cfd437 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:01.359259 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8a6879e2-f0df-45a4-9893-5183e6cfd437 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:01.359580 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1426/2819] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:08:01 2022] DELETE /compute/v2.1/servers/1f11f86d-3387-4c6e-9099-fc8d232b11a8 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:08:01.359732 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8a6879e2-f0df-45a4-9893-5183e6cfd437 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:01.360851 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8a6879e2-f0df-45a4-9893-5183e6cfd437 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:01.361374 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8a6879e2-f0df-45a4-9893-5183e6cfd437 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:01.361786 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8a6879e2-f0df-45a4-9893-5183e6cfd437 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:01.367969 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-43be291a-425c-45a9-80ad-b49117eeba7a tempest-SecurityGroupRulesNegativeTestJSON-8994449 tempest-SecurityGroupRulesNegativeTestJSON-8994449-project] Action: 'create', calling method: .version_select at 0x7f5ae986c9d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1672525728", "description": "tempest-description-1655649122"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:08:01.699913 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8a6879e2-f0df-45a4-9893-5183e6cfd437 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f0b27a48fd41dd846ba60856349ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4efd94380dcf4b3cb7a2b9fa194fcb83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:01.722159 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8a6879e2-f0df-45a4-9893-5183e6cfd437 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "GET /compute/v2.1/servers/359f06bd-00e9-4d68-b066-db73d7073a04" status: 200 len: 1466 microversion: 2.1 time: 0.398267 Aug 31 16:08:01.723005 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1394/2820] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:01 2022] GET /compute/v2.1/servers/359f06bd-00e9-4d68-b066-db73d7073a04 => generated 1466 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:01.740051 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5b53683d-1ed8-4f2a-8451-5c5e3f7be3d1 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:01.742035 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5b53683d-1ed8-4f2a-8451-5c5e3f7be3d1 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] [instance: 1f11f86d-3387-4c6e-9099-fc8d232b11a8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:01.755664 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b53683d-1ed8-4f2a-8451-5c5e3f7be3d1 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:01.757377 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b53683d-1ed8-4f2a-8451-5c5e3f7be3d1 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:01.758274 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b53683d-1ed8-4f2a-8451-5c5e3f7be3d1 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:01.759345 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b53683d-1ed8-4f2a-8451-5c5e3f7be3d1 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:01.762290 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b53683d-1ed8-4f2a-8451-5c5e3f7be3d1 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:01.763534 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b53683d-1ed8-4f2a-8451-5c5e3f7be3d1 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:01.815450 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-43be291a-425c-45a9-80ad-b49117eeba7a tempest-SecurityGroupRulesNegativeTestJSON-8994449 tempest-SecurityGroupRulesNegativeTestJSON-8994449-project] 10.222.0.61 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.452905 Aug 31 16:08:01.816324 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1427/2821] 10.222.0.61 () {60 vars in 1180 bytes} [Wed Aug 31 16:08:01 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:08:01.831380 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-694371ed-f62f-4ce6-a654-10b3f12b8fb3 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '.version_select at 0x7f5ae9367700>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:02.063053 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5b53683d-1ed8-4f2a-8451-5c5e3f7be3d1 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a837ababe7cb4284b96bc16deb40d2d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e9999df7e14609b1265351c83607bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:02.083740 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-694371ed-f62f-4ce6-a654-10b3f12b8fb3 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "GET /compute/v2.1/images?changes-since=2022-08-31T16%3A05%3A00Z" status: 200 len: 1900 microversion: 2.1 time: 0.261994 Aug 31 16:08:02.096662 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1428/2822] 10.222.0.61 () {58 vars in 1199 bytes} [Wed Aug 31 16:08:01 2022] GET /compute/v2.1/images?changes-since=2022-08-31T16%3A05%3A00Z => generated 1900 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:02.103028 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f4cde2c9-65d1-4e19-8314-4df852e81ef8 tempest-SecurityGroupRulesNegativeTestJSON-8994449 tempest-SecurityGroupRulesNegativeTestJSON-8994449-project] Action: 'create', calling method: .version_select at 0x7f5ae86a7430>, body: {"security_group_rule": {"parent_group_id": "c43b319c-f505-413f-baac-cb02756ff9a6", "ip_protocol": "tcp", "from_port": 22, "to_port": 1022727079}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:08:02.124915 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5b53683d-1ed8-4f2a-8451-5c5e3f7be3d1 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] 10.222.0.61 "GET /compute/v2.1/servers/1f11f86d-3387-4c6e-9099-fc8d232b11a8" status: 200 len: 1701 microversion: 2.1 time: 0.400165 Aug 31 16:08:02.128963 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1395/2823] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:01 2022] GET /compute/v2.1/servers/1f11f86d-3387-4c6e-9099-fc8d232b11a8 => generated 1701 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:02.145872 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-58e4ed18-0ca6-4a82-b7db-12d351f75241 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:02.147316 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-58e4ed18-0ca6-4a82-b7db-12d351f75241 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 8f165110-0ea6-48c0-8357-ba419171f7af] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:02.159023 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-58e4ed18-0ca6-4a82-b7db-12d351f75241 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:02.159820 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-58e4ed18-0ca6-4a82-b7db-12d351f75241 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:02.160477 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-58e4ed18-0ca6-4a82-b7db-12d351f75241 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:02.161470 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-58e4ed18-0ca6-4a82-b7db-12d351f75241 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:02.163347 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-58e4ed18-0ca6-4a82-b7db-12d351f75241 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:02.164052 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-58e4ed18-0ca6-4a82-b7db-12d351f75241 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:02.172082 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-f4cde2c9-65d1-4e19-8314-4df852e81ef8 tempest-SecurityGroupRulesNegativeTestJSON-8994449 tempest-SecurityGroupRulesNegativeTestJSON-8994449-project] HTTP exception thrown: Invalid port range 22:1022727079. Valid TCP ports should be between 1-65535 Aug 31 16:08:02.174033 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f4cde2c9-65d1-4e19-8314-4df852e81ef8 tempest-SecurityGroupRulesNegativeTestJSON-8994449 tempest-SecurityGroupRulesNegativeTestJSON-8994449-project] Request method failure captured: Aug 31 16:08:02.174033 n-d-850499-9 devstack@n-api.service[122256]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 31 16:08:02.174033 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:08:02.174033 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:08:02.174033 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:08:02.174033 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 146 Aug 31 16:08:02.174033 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:08:02.174033 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:08:02.174033 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:08:02.174033 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:08:02.174033 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4dOO52EJKop8o-fsZmduM55cO24kBduef9IRVN5qFpmftsOkgvTc4AlcKEAIvsnY8Cf_8hxw1aDngsDJGouRBV0m2nXJhgXIxPJJvxKfwIrLrxUEme39KU3zIhTVyZq7aY2E-EFBToOkhLPaPrSaeAPEsKcN-1lMqhTnLQbfcByruw Aug 31 16:08:02.174033 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:08:02.174033 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:08:02.174033 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:08:02.174033 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:08:02.174033 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:08:02.174033 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:08:02.174033 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 6051168fe5674988aab651f98240a6a3 Aug 31 16:08:02.174033 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-8994449 Aug 31 16:08:02.174033 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:08:02.174033 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:08:02.174033 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6051168fe5674988aab651f98240a6a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/6051168fe5674988aab651f98240a6a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_6051168fe5674988aab651f98240a6a3", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6051168fe5674988aab651f98240a6a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:08:02.174033 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-8994449 Aug 31 16:08:02.174033 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 6051168fe5674988aab651f98240a6a3 Aug 31 16:08:02.174033 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-8994449 Aug 31 16:08:02.174033 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-8994449-project Aug 31 16:08:02.174033 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:08:02.174033 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:08:02.174033 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 29387cff4fab4b6dbb6e84770e1e94f4 Aug 31 16:08:02.174033 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-8994449-project Aug 31 16:08:02.174033 n-d-850499-9 devstack@n-api.service[122256]: Aug 31 16:08:02.174033 n-d-850499-9 devstack@n-api.service[122256]: {"security_group_rule": {"parent_group_id": "c43b319c-f505-413f-baac-cb02756ff9a6", "ip_protocol": "tcp", "from_port": 22, "to_port": 1022727079}} Aug 31 16:08:02.174033 n-d-850499-9 devstack@n-api.service[122256]: method: Aug 31 16:08:02.174033 n-d-850499-9 devstack@n-api.service[122256]: exception: Invalid port range 22:1022727079. Valid TCP ports should be between 1-65535 Aug 31 16:08:02.174033 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'c43b319c-f505-413f-baac-cb02756ff9a6', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 1022727079}}} Aug 31 16:08:02.174033 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:08:02.174033 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:08:02.174033 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 31 16:08:02.174033 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 31 16:08:02.174033 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 31 16:08:02.174033 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 31 16:08:02.174033 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 31 16:08:02.174033 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 31 16:08:02.174033 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Aug 31 16:08:02.174033 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 31 16:08:02.174033 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:1022727079. Valid TCP ports should be between 1-65535 Aug 31 16:08:02.174033 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:08:02.174033 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:08:02.174033 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:08:02.174033 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:08:02.174033 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:08:02.174033 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:08:02.174033 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:08:02.174033 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:08:02.174033 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:08:02.174033 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:08:02.174033 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:08:02.174033 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:08:02.174033 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 31 16:08:02.174033 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 31 16:08:02.174033 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:1022727079. Valid TCP ports should be between 1-65535 Aug 31 16:08:02.174033 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:08:02.179844 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:08:02.179844 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:08:02.179844 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:08:02.179844 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:08:02.179844 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:08:02.179844 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:08:02.179844 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:08:02.179844 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:1022727079. Valid TCP ports should be between 1-65535 Aug 31 16:08:02.179844 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:08:02.179844 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f4cde2c9-65d1-4e19-8314-4df852e81ef8 tempest-SecurityGroupRulesNegativeTestJSON-8994449 tempest-SecurityGroupRulesNegativeTestJSON-8994449-project] Returning 400 to user: Invalid port range 22:1022727079. Valid TCP ports should be between 1-65535 {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:08:02.179844 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f4cde2c9-65d1-4e19-8314-4df852e81ef8 tempest-SecurityGroupRulesNegativeTestJSON-8994449 tempest-SecurityGroupRulesNegativeTestJSON-8994449-project] 10.222.0.61 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.077548 Aug 31 16:08:02.179844 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1429/2824] 10.222.0.61 () {60 vars in 1195 bytes} [Wed Aug 31 16:08:02 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 80 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:08:02.191422 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2cc50450-d861-4056-a04d-65b261deb25b tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:02.192895 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2cc50450-d861-4056-a04d-65b261deb25b tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] [instance: 1df89d79-3817-40af-b956-b9b75919acbc] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:02.208932 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2cc50450-d861-4056-a04d-65b261deb25b tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:02.209884 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2cc50450-d861-4056-a04d-65b261deb25b tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:02.210462 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2cc50450-d861-4056-a04d-65b261deb25b tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:02.211651 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2cc50450-d861-4056-a04d-65b261deb25b tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:02.212480 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2cc50450-d861-4056-a04d-65b261deb25b tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:02.215111 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2cc50450-d861-4056-a04d-65b261deb25b tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:02.375078 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-2cc50450-d861-4056-a04d-65b261deb25b tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb6a27e336449738f68a88d870ca6e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f79872256b2647d6a01c9e753b93b3c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:02.386700 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2cc50450-d861-4056-a04d-65b261deb25b tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] 10.222.0.61 "GET /compute/v2.1/servers/1df89d79-3817-40af-b956-b9b75919acbc" status: 200 len: 1421 microversion: 2.1 time: 0.207908 Aug 31 16:08:02.390405 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1430/2825] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:02 2022] GET /compute/v2.1/servers/1df89d79-3817-40af-b956-b9b75919acbc => generated 1421 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:02.420213 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a4f12136-f3eb-4599-af0e-04299728e24a tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '.version_select at 0x7f5ae91cdf70>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:02.474789 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-58e4ed18-0ca6-4a82-b7db-12d351f75241 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:02.484958 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-58e4ed18-0ca6-4a82-b7db-12d351f75241 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/8f165110-0ea6-48c0-8357-ba419171f7af" status: 200 len: 1469 microversion: 2.1 time: 0.353183 Aug 31 16:08:02.486533 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1396/2826] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:02 2022] GET /compute/v2.1/servers/8f165110-0ea6-48c0-8357-ba419171f7af => generated 1469 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:02.505549 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8a645265-d665-4c16-9f71-ccdfbf3c1f3a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:02.508840 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8a645265-d665-4c16-9f71-ccdfbf3c1f3a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 0a5d6a47-ce38-4d1d-8d97-550f5e950af5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:02.518159 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8a645265-d665-4c16-9f71-ccdfbf3c1f3a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:02.518938 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8a645265-d665-4c16-9f71-ccdfbf3c1f3a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:02.519682 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8a645265-d665-4c16-9f71-ccdfbf3c1f3a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:02.520961 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8a645265-d665-4c16-9f71-ccdfbf3c1f3a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:02.521774 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8a645265-d665-4c16-9f71-ccdfbf3c1f3a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:02.522482 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8a645265-d665-4c16-9f71-ccdfbf3c1f3a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:02.587052 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a4f12136-f3eb-4599-af0e-04299728e24a tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1907428448" status: 200 len: 485 microversion: 2.1 time: 0.194123 Aug 31 16:08:02.591408 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1431/2827] 10.222.0.61 () {58 vars in 1231 bytes} [Wed Aug 31 16:08:02 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1907428448 => generated 485 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:08:02.599210 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-29e69c3b-f014-4fe8-99a0-0edcb53a41cf tempest-SecurityGroupRulesNegativeTestJSON-8994449 tempest-SecurityGroupRulesNegativeTestJSON-8994449-project] Action: 'create', calling method: .version_select at 0x7f5ae93571f0>, body: {"security_group_rule": {"parent_group_id": "826d827c-dae9-420a-a645-19fe3c24389d", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:08:02.633735 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8a645265-d665-4c16-9f71-ccdfbf3c1f3a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:02.650769 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8a645265-d665-4c16-9f71-ccdfbf3c1f3a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/0a5d6a47-ce38-4d1d-8d97-550f5e950af5" status: 200 len: 1218 microversion: 2.1 time: 0.160427 Aug 31 16:08:02.663883 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1397/2828] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:02 2022] GET /compute/v2.1/servers/0a5d6a47-ce38-4d1d-8d97-550f5e950af5 => generated 1218 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:02.671159 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4d2339f3-109f-44d8-9620-e80cac8bb58a tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '.version_select at 0x7f5ae8371700>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:02.686172 n-d-850499-9 devstack@n-api.service[122256]: DEBUG neutronclient.v2_0.client [None req-29e69c3b-f014-4fe8-99a0-0edcb53a41cf tempest-SecurityGroupRulesNegativeTestJSON-8994449 tempest-SecurityGroupRulesNegativeTestJSON-8994449-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 826d827c-dae9-420a-a645-19fe3c24389d does not exist", "detail": ""}} {{(pid=122256) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 31 16:08:02.686759 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.security_group_api [None req-29e69c3b-f014-4fe8-99a0-0edcb53a41cf tempest-SecurityGroupRulesNegativeTestJSON-8994449 tempest-SecurityGroupRulesNegativeTestJSON-8994449-project] Neutron security group 826d827c-dae9-420a-a645-19fe3c24389d not found {{(pid=122256) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 31 16:08:02.687414 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-29e69c3b-f014-4fe8-99a0-0edcb53a41cf tempest-SecurityGroupRulesNegativeTestJSON-8994449 tempest-SecurityGroupRulesNegativeTestJSON-8994449-project] HTTP exception thrown: Security group 826d827c-dae9-420a-a645-19fe3c24389d does not exist Aug 31 16:08:02.687414 n-d-850499-9 devstack@n-api.service[122256]: Neutron server returns request_ids: ['req-08a14512-f09d-49dd-9718-f9f32f854152'] Aug 31 16:08:02.689469 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-29e69c3b-f014-4fe8-99a0-0edcb53a41cf tempest-SecurityGroupRulesNegativeTestJSON-8994449 tempest-SecurityGroupRulesNegativeTestJSON-8994449-project] Request method failure captured: Aug 31 16:08:02.689469 n-d-850499-9 devstack@n-api.service[122256]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 31 16:08:02.689469 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:08:02.689469 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:08:02.689469 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:08:02.689469 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 138 Aug 31 16:08:02.689469 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:08:02.689469 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:08:02.689469 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:08:02.689469 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:08:02.689469 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4dOO52EJKop8o-fsZmduM55cO24kBduef9IRVN5qFpmftsOkgvTc4AlcKEAIvsnY8Cf_8hxw1aDngsDJGouRBV0m2nXJhgXIxPJJvxKfwIrLrxUEme39KU3zIhTVyZq7aY2E-EFBToOkhLPaPrSaeAPEsKcN-1lMqhTnLQbfcByruw Aug 31 16:08:02.689469 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:08:02.689469 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:08:02.689469 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:08:02.689469 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:08:02.689469 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:08:02.689469 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:08:02.689469 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 6051168fe5674988aab651f98240a6a3 Aug 31 16:08:02.689469 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-8994449 Aug 31 16:08:02.689469 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:08:02.689469 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:08:02.689469 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6051168fe5674988aab651f98240a6a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/6051168fe5674988aab651f98240a6a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_6051168fe5674988aab651f98240a6a3", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6051168fe5674988aab651f98240a6a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:08:02.689469 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-8994449 Aug 31 16:08:02.689469 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 6051168fe5674988aab651f98240a6a3 Aug 31 16:08:02.689469 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-8994449 Aug 31 16:08:02.689469 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-8994449-project Aug 31 16:08:02.689469 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:08:02.689469 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:08:02.689469 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 29387cff4fab4b6dbb6e84770e1e94f4 Aug 31 16:08:02.689469 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-8994449-project Aug 31 16:08:02.689469 n-d-850499-9 devstack@n-api.service[122256]: Aug 31 16:08:02.689469 n-d-850499-9 devstack@n-api.service[122256]: {"security_group_rule": {"parent_group_id": "826d827c-dae9-420a-a645-19fe3c24389d", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 31 16:08:02.689469 n-d-850499-9 devstack@n-api.service[122256]: method: Aug 31 16:08:02.689469 n-d-850499-9 devstack@n-api.service[122256]: exception: Security group 826d827c-dae9-420a-a645-19fe3c24389d does not exist Aug 31 16:08:02.689469 n-d-850499-9 devstack@n-api.service[122256]: Neutron server returns request_ids: ['req-08a14512-f09d-49dd-9718-f9f32f854152'] Aug 31 16:08:02.689469 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'body': {'security_group_rule': {'parent_group_id': '826d827c-dae9-420a-a645-19fe3c24389d', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 31 16:08:02.689469 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:08:02.689469 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:08:02.689469 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 31 16:08:02.689469 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 31 16:08:02.689469 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:08:02.689469 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:08:02.689469 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 31 16:08:02.689469 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 31 16:08:02.689469 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:08:02.689469 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:08:02.689469 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 31 16:08:02.689469 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 31 16:08:02.689469 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:08:02.689469 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:08:02.689469 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 31 16:08:02.689469 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 31 16:08:02.689469 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:08:02.689469 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:08:02.689469 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 31 16:08:02.689469 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 31 16:08:02.689469 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:08:02.689469 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:08:02.689469 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 31 16:08:02.689469 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 31 16:08:02.689469 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 31 16:08:02.693738 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 31 16:08:02.693738 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 826d827c-dae9-420a-a645-19fe3c24389d does not exist Aug 31 16:08:02.693738 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-08a14512-f09d-49dd-9718-f9f32f854152'] Aug 31 16:08:02.693738 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:08:02.693738 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:08:02.693738 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:08:02.693738 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:08:02.693738 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Aug 31 16:08:02.693738 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Aug 31 16:08:02.693738 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 31 16:08:02.693738 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 31 16:08:02.693738 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 826d827c-dae9-420a-a645-19fe3c24389d does not exist Aug 31 16:08:02.693738 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-08a14512-f09d-49dd-9718-f9f32f854152'] Aug 31 16:08:02.693738 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:08:02.693738 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:08:02.693738 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:08:02.693738 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:08:02.693738 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:08:02.693738 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:08:02.693738 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:08:02.693738 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:08:02.693738 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:08:02.693738 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:08:02.693738 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:08:02.693738 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:08:02.693738 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Aug 31 16:08:02.693738 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 31 16:08:02.693738 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 826d827c-dae9-420a-a645-19fe3c24389d does not exist Aug 31 16:08:02.693738 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-08a14512-f09d-49dd-9718-f9f32f854152'] Aug 31 16:08:02.693738 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:08:02.693738 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:08:02.693738 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:08:02.693738 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:08:02.693738 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:08:02.693738 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:08:02.693738 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:08:02.693738 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:08:02.693738 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 826d827c-dae9-420a-a645-19fe3c24389d does not exist Aug 31 16:08:02.693738 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-08a14512-f09d-49dd-9718-f9f32f854152'] Aug 31 16:08:02.693738 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:08:02.693738 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-29e69c3b-f014-4fe8-99a0-0edcb53a41cf tempest-SecurityGroupRulesNegativeTestJSON-8994449 tempest-SecurityGroupRulesNegativeTestJSON-8994449-project] Returning 404 to user: Security group 826d827c-dae9-420a-a645-19fe3c24389d does not exist Aug 31 16:08:02.693738 n-d-850499-9 devstack@n-api.service[122256]: Neutron server returns request_ids: ['req-08a14512-f09d-49dd-9718-f9f32f854152'] {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:08:02.697156 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-29e69c3b-f014-4fe8-99a0-0edcb53a41cf tempest-SecurityGroupRulesNegativeTestJSON-8994449 tempest-SecurityGroupRulesNegativeTestJSON-8994449-project] 10.222.0.61 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.100540 Aug 31 16:08:02.697156 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1432/2829] 10.222.0.61 () {60 vars in 1195 bytes} [Wed Aug 31 16:08:02 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:08:02.714548 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-356e6b71-ce9a-4672-947b-add8b8ac779d req-008a0b54-4246-4a88-92cd-6ab6bb3d2cc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "359f06bd-00e9-4d68-b066-db73d7073a04", "name": "network-vif-unplugged", "status": "completed", "tag": "0cd3b24d-ce36-4d42-806b-496fd2089b1b"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:08:02.738996 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-356e6b71-ce9a-4672-947b-add8b8ac779d req-008a0b54-4246-4a88-92cd-6ab6bb3d2cc7 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:02.739618 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-356e6b71-ce9a-4672-947b-add8b8ac779d req-008a0b54-4246-4a88-92cd-6ab6bb3d2cc7 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:02.740129 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-356e6b71-ce9a-4672-947b-add8b8ac779d req-008a0b54-4246-4a88-92cd-6ab6bb3d2cc7 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:02.784385 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-356e6b71-ce9a-4672-947b-add8b8ac779d req-008a0b54-4246-4a88-92cd-6ab6bb3d2cc7 service nova] Creating event network-vif-unplugged:0cd3b24d-ce36-4d42-806b-496fd2089b1b for instance 359f06bd-00e9-4d68-b066-db73d7073a04 on n-h1-850499-9 Aug 31 16:08:02.814364 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-356e6b71-ce9a-4672-947b-add8b8ac779d req-008a0b54-4246-4a88-92cd-6ab6bb3d2cc7 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.113807 Aug 31 16:08:02.816386 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1433/2830] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:08:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:08:02.844699 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f0a66a10-386a-4a6f-85bf-d90fd6d32314 tempest-SecurityGroupRulesNegativeTestJSON-8994449 tempest-SecurityGroupRulesNegativeTestJSON-8994449-project] Calling method '.version_select at 0x7f5ae947fc10>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:02.927451 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4d2339f3-109f-44d8-9620-e80cac8bb58a tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "GET /compute/v2.1/images?server=359f06bd-00e9-4d68-b066-db73d7073a04" status: 200 len: 956 microversion: 2.1 time: 0.273041 Aug 31 16:08:02.928526 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1398/2831] 10.222.0.61 () {58 vars in 1209 bytes} [Wed Aug 31 16:08:02 2022] GET /compute/v2.1/images?server=359f06bd-00e9-4d68-b066-db73d7073a04 => generated 956 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:08:02.942380 n-d-850499-9 devstack@n-api.service[122256]: DEBUG neutronclient.v2_0.client [None req-f0a66a10-386a-4a6f-85bf-d90fd6d32314 tempest-SecurityGroupRulesNegativeTestJSON-8994449 tempest-SecurityGroupRulesNegativeTestJSON-8994449-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule a3f38a8f-2304-490a-b602-5ef61899356b does not exist", "detail": ""}} {{(pid=122256) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 31 16:08:02.943006 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.security_group_api [None req-f0a66a10-386a-4a6f-85bf-d90fd6d32314 tempest-SecurityGroupRulesNegativeTestJSON-8994449 tempest-SecurityGroupRulesNegativeTestJSON-8994449-project] Neutron security group rule a3f38a8f-2304-490a-b602-5ef61899356b not found {{(pid=122256) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Aug 31 16:08:02.943832 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-f0a66a10-386a-4a6f-85bf-d90fd6d32314 tempest-SecurityGroupRulesNegativeTestJSON-8994449 tempest-SecurityGroupRulesNegativeTestJSON-8994449-project] HTTP exception thrown: Security group rule a3f38a8f-2304-490a-b602-5ef61899356b does not exist Aug 31 16:08:02.943832 n-d-850499-9 devstack@n-api.service[122256]: Neutron server returns request_ids: ['req-20c62667-6240-4024-9766-41f5e7b69b1e'] Aug 31 16:08:02.946170 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f0a66a10-386a-4a6f-85bf-d90fd6d32314 tempest-SecurityGroupRulesNegativeTestJSON-8994449 tempest-SecurityGroupRulesNegativeTestJSON-8994449-project] Request method failure captured: Aug 31 16:08:02.946170 n-d-850499-9 devstack@n-api.service[122256]: request: DELETE /compute/v2.1/os-security-group-rules/a3f38a8f-2304-490a-b602-5ef61899356b HTTP/1.1 Aug 31 16:08:02.946170 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:08:02.946170 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:08:02.946170 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:08:02.946170 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:08:02.946170 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:08:02.946170 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:08:02.946170 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:08:02.946170 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:08:02.946170 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4dOO52EJKop8o-fsZmduM55cO24kBduef9IRVN5qFpmftsOkgvTc4AlcKEAIvsnY8Cf_8hxw1aDngsDJGouRBV0m2nXJhgXIxPJJvxKfwIrLrxUEme39KU3zIhTVyZq7aY2E-EFBToOkhLPaPrSaeAPEsKcN-1lMqhTnLQbfcByruw Aug 31 16:08:02.946170 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:08:02.946170 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:08:02.946170 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:08:02.946170 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:08:02.946170 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:08:02.946170 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:08:02.946170 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 6051168fe5674988aab651f98240a6a3 Aug 31 16:08:02.946170 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-8994449 Aug 31 16:08:02.946170 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:08:02.946170 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:08:02.946170 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6051168fe5674988aab651f98240a6a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/6051168fe5674988aab651f98240a6a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_6051168fe5674988aab651f98240a6a3", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6051168fe5674988aab651f98240a6a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:08:02.946170 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-8994449 Aug 31 16:08:02.946170 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 6051168fe5674988aab651f98240a6a3 Aug 31 16:08:02.946170 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-8994449 Aug 31 16:08:02.946170 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-8994449-project Aug 31 16:08:02.946170 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:08:02.946170 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:08:02.946170 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 29387cff4fab4b6dbb6e84770e1e94f4 Aug 31 16:08:02.946170 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-8994449-project Aug 31 16:08:02.946170 n-d-850499-9 devstack@n-api.service[122256]: method: Aug 31 16:08:02.946170 n-d-850499-9 devstack@n-api.service[122256]: exception: Security group rule a3f38a8f-2304-490a-b602-5ef61899356b does not exist Aug 31 16:08:02.946170 n-d-850499-9 devstack@n-api.service[122256]: Neutron server returns request_ids: ['req-20c62667-6240-4024-9766-41f5e7b69b1e'] Aug 31 16:08:02.946170 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': 'a3f38a8f-2304-490a-b602-5ef61899356b'} Aug 31 16:08:02.946170 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:08:02.946170 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:08:02.946170 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Aug 31 16:08:02.946170 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Aug 31 16:08:02.946170 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:08:02.946170 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:08:02.946170 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1064, in show_security_group_rule Aug 31 16:08:02.946170 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Aug 31 16:08:02.946170 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:08:02.946170 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:08:02.946170 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 31 16:08:02.946170 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 31 16:08:02.946170 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:08:02.946170 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:08:02.946170 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 31 16:08:02.946170 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 31 16:08:02.946170 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:08:02.946170 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:08:02.946170 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 31 16:08:02.946170 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 31 16:08:02.946170 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:08:02.946170 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:08:02.946170 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 31 16:08:02.946170 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 31 16:08:02.946170 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 31 16:08:02.946170 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 31 16:08:02.946170 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule a3f38a8f-2304-490a-b602-5ef61899356b does not exist Aug 31 16:08:02.952775 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-20c62667-6240-4024-9766-41f5e7b69b1e'] Aug 31 16:08:02.952775 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:08:02.952775 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:08:02.952775 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:08:02.952775 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:08:02.952775 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Aug 31 16:08:02.952775 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Aug 31 16:08:02.952775 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Aug 31 16:08:02.952775 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 31 16:08:02.952775 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule a3f38a8f-2304-490a-b602-5ef61899356b does not exist Aug 31 16:08:02.952775 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-20c62667-6240-4024-9766-41f5e7b69b1e'] Aug 31 16:08:02.952775 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:08:02.952775 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:08:02.952775 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:08:02.952775 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:08:02.952775 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:08:02.952775 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:08:02.952775 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:08:02.952775 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:08:02.952775 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:08:02.952775 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:08:02.952775 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:08:02.952775 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:08:02.952775 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Aug 31 16:08:02.952775 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 31 16:08:02.952775 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule a3f38a8f-2304-490a-b602-5ef61899356b does not exist Aug 31 16:08:02.952775 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-20c62667-6240-4024-9766-41f5e7b69b1e'] Aug 31 16:08:02.952775 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:08:02.952775 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:08:02.952775 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:08:02.952775 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:08:02.952775 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:08:02.952775 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:08:02.952775 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:08:02.952775 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:08:02.952775 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule a3f38a8f-2304-490a-b602-5ef61899356b does not exist Aug 31 16:08:02.952775 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-20c62667-6240-4024-9766-41f5e7b69b1e'] Aug 31 16:08:02.952775 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:08:02.952775 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f0a66a10-386a-4a6f-85bf-d90fd6d32314 tempest-SecurityGroupRulesNegativeTestJSON-8994449 tempest-SecurityGroupRulesNegativeTestJSON-8994449-project] Returning 404 to user: Security group rule a3f38a8f-2304-490a-b602-5ef61899356b does not exist Aug 31 16:08:02.952775 n-d-850499-9 devstack@n-api.service[122256]: Neutron server returns request_ids: ['req-20c62667-6240-4024-9766-41f5e7b69b1e'] {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:08:02.952775 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f0a66a10-386a-4a6f-85bf-d90fd6d32314 tempest-SecurityGroupRulesNegativeTestJSON-8994449 tempest-SecurityGroupRulesNegativeTestJSON-8994449-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-group-rules/a3f38a8f-2304-490a-b602-5ef61899356b" status: 404 len: 199 microversion: 2.1 time: 0.127049 Aug 31 16:08:02.952775 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1434/2832] 10.222.0.61 () {58 vars in 1287 bytes} [Wed Aug 31 16:08:02 2022] DELETE /compute/v2.1/os-security-group-rules/a3f38a8f-2304-490a-b602-5ef61899356b => generated 199 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:08:02.959178 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d18a9f42-9c2b-4b5e-93c9-0ecd778ab2ba tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '.version_select at 0x7f5ae82f8b80>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:02.965016 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-948ec804-38a4-4d33-9972-a8aef3d0ee08 tempest-SecurityGroupRulesNegativeTestJSON-8994449 tempest-SecurityGroupRulesNegativeTestJSON-8994449-project] Calling method '.version_select at 0x7f5ae9378670>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:03.315309 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d18a9f42-9c2b-4b5e-93c9-0ecd778ab2ba tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.61%2Fcompute%2Fv2.1%2Fservers%2F560a01e5-93f8-46c8-9261-5030e28766b4" status: 200 len: 484 microversion: 2.1 time: 0.377195 Aug 31 16:08:03.319727 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1399/2833] 10.222.0.61 () {58 vars in 1317 bytes} [Wed Aug 31 16:08:02 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.61%2Fcompute%2Fv2.1%2Fservers%2F560a01e5-93f8-46c8-9261-5030e28766b4 => generated 484 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:08:03.331057 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-e4072f94-5501-4234-b59e-d504a917deb6 req-7a575290-03d4-4cc1-befa-670b052d6280 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1df89d79-3817-40af-b956-b9b75919acbc", "name": "network-vif-deleted", "tag": "135eec2f-431d-42f1-8efa-c99feabd21c0"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:08:03.352415 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-e4072f94-5501-4234-b59e-d504a917deb6 req-7a575290-03d4-4cc1-befa-670b052d6280 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:03.353742 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-e4072f94-5501-4234-b59e-d504a917deb6 req-7a575290-03d4-4cc1-befa-670b052d6280 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:03.355308 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-e4072f94-5501-4234-b59e-d504a917deb6 req-7a575290-03d4-4cc1-befa-670b052d6280 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:03.371839 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-e4072f94-5501-4234-b59e-d504a917deb6 req-7a575290-03d4-4cc1-befa-670b052d6280 service nova] Creating event network-vif-deleted:135eec2f-431d-42f1-8efa-c99feabd21c0 for instance 1df89d79-3817-40af-b956-b9b75919acbc on n-h1-850499-9 Aug 31 16:08:03.377699 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-e4072f94-5501-4234-b59e-d504a917deb6 req-7a575290-03d4-4cc1-befa-670b052d6280 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055859 Aug 31 16:08:03.379077 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1400/2834] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:08:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:08:03.386043 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e7f4fe9c-f984-4b63-b18c-3c980c3dcfa7 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:03.386766 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e7f4fe9c-f984-4b63-b18c-3c980c3dcfa7 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] [instance: 1f11f86d-3387-4c6e-9099-fc8d232b11a8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:03.404807 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e7f4fe9c-f984-4b63-b18c-3c980c3dcfa7 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:03.405322 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e7f4fe9c-f984-4b63-b18c-3c980c3dcfa7 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:03.405785 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e7f4fe9c-f984-4b63-b18c-3c980c3dcfa7 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:03.406517 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e7f4fe9c-f984-4b63-b18c-3c980c3dcfa7 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:03.406983 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e7f4fe9c-f984-4b63-b18c-3c980c3dcfa7 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:03.407414 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e7f4fe9c-f984-4b63-b18c-3c980c3dcfa7 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:04.030340 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e7f4fe9c-f984-4b63-b18c-3c980c3dcfa7 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a837ababe7cb4284b96bc16deb40d2d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e9999df7e14609b1265351c83607bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:04.053773 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e7f4fe9c-f984-4b63-b18c-3c980c3dcfa7 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] 10.222.0.61 "GET /compute/v2.1/servers/1f11f86d-3387-4c6e-9099-fc8d232b11a8" status: 200 len: 1701 microversion: 2.1 time: 0.673132 Aug 31 16:08:04.055642 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1401/2835] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:03 2022] GET /compute/v2.1/servers/1f11f86d-3387-4c6e-9099-fc8d232b11a8 => generated 1701 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:04.063036 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-73f96b4c-b8c6-47af-9505-e3c18a94199f tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '.version_select at 0x7f5ae82f8e50>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:04.094261 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-948ec804-38a4-4d33-9972-a8aef3d0ee08 tempest-SecurityGroupRulesNegativeTestJSON-8994449 tempest-SecurityGroupRulesNegativeTestJSON-8994449-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/c43b319c-f505-413f-baac-cb02756ff9a6" status: 202 len: 0 microversion: 2.1 time: 1.137251 Aug 31 16:08:04.098530 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1435/2836] 10.222.0.61 () {58 vars in 1272 bytes} [Wed Aug 31 16:08:02 2022] DELETE /compute/v2.1/os-security-groups/c43b319c-f505-413f-baac-cb02756ff9a6 => generated 0 bytes in 1142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 16:08:04.105490 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9647364b-304f-45ff-9114-a7c9e310fc12 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:04.107427 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9647364b-304f-45ff-9114-a7c9e310fc12 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] [instance: 1df89d79-3817-40af-b956-b9b75919acbc] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:04.131385 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9647364b-304f-45ff-9114-a7c9e310fc12 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:04.136367 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9647364b-304f-45ff-9114-a7c9e310fc12 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:04.139343 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9647364b-304f-45ff-9114-a7c9e310fc12 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:04.147056 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9647364b-304f-45ff-9114-a7c9e310fc12 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:04.148429 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9647364b-304f-45ff-9114-a7c9e310fc12 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:04.149383 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9647364b-304f-45ff-9114-a7c9e310fc12 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:04.152784 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-73f96b4c-b8c6-47af-9505-e3c18a94199f tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.61%2Fcompute%2Fservers%2F560a01e5-93f8-46c8-9261-5030e28766b4" status: 200 len: 484 microversion: 2.1 time: 0.095498 Aug 31 16:08:04.153899 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1402/2837] 10.222.0.61 () {58 vars in 1303 bytes} [Wed Aug 31 16:08:04 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.61%2Fcompute%2Fservers%2F560a01e5-93f8-46c8-9261-5030e28766b4 => generated 484 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:08:04.160453 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e1fc54c3-10e7-4b7c-98c7-e1268fbe169b tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:04.161773 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e1fc54c3-10e7-4b7c-98c7-e1268fbe169b tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 8f165110-0ea6-48c0-8357-ba419171f7af] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:04.211123 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e1fc54c3-10e7-4b7c-98c7-e1268fbe169b tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:04.219459 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e1fc54c3-10e7-4b7c-98c7-e1268fbe169b tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:04.220598 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e1fc54c3-10e7-4b7c-98c7-e1268fbe169b tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:04.229604 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e1fc54c3-10e7-4b7c-98c7-e1268fbe169b tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:04.231936 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e1fc54c3-10e7-4b7c-98c7-e1268fbe169b tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:04.234137 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e1fc54c3-10e7-4b7c-98c7-e1268fbe169b tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:04.266864 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9647364b-304f-45ff-9114-a7c9e310fc12 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:04.267601 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9647364b-304f-45ff-9114-a7c9e310fc12 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:04.268059 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9647364b-304f-45ff-9114-a7c9e310fc12 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:04.268535 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-9647364b-304f-45ff-9114-a7c9e310fc12 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lazy-loading 'fault' on Instance uuid 1df89d79-3817-40af-b956-b9b75919acbc {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:08:04.409764 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-9647364b-304f-45ff-9114-a7c9e310fc12 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb6a27e336449738f68a88d870ca6e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f79872256b2647d6a01c9e753b93b3c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:04.429707 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9647364b-304f-45ff-9114-a7c9e310fc12 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] 10.222.0.61 "GET /compute/v2.1/servers/1df89d79-3817-40af-b956-b9b75919acbc" status: 200 len: 1308 microversion: 2.1 time: 0.329425 Aug 31 16:08:04.436249 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1436/2838] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:04 2022] GET /compute/v2.1/servers/1df89d79-3817-40af-b956-b9b75919acbc => generated 1308 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:04.441669 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d488b4a3-5f2a-42c7-ad02-76481e3b8a4f tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:04.443300 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d488b4a3-5f2a-42c7-ad02-76481e3b8a4f tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 0a5d6a47-ce38-4d1d-8d97-550f5e950af5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:04.466672 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d488b4a3-5f2a-42c7-ad02-76481e3b8a4f tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:04.468138 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d488b4a3-5f2a-42c7-ad02-76481e3b8a4f tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:04.473753 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d488b4a3-5f2a-42c7-ad02-76481e3b8a4f tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:04.475013 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d488b4a3-5f2a-42c7-ad02-76481e3b8a4f tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:04.475791 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d488b4a3-5f2a-42c7-ad02-76481e3b8a4f tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:04.476404 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d488b4a3-5f2a-42c7-ad02-76481e3b8a4f tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:04.680554 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d488b4a3-5f2a-42c7-ad02-76481e3b8a4f tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:04.694427 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d488b4a3-5f2a-42c7-ad02-76481e3b8a4f tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/0a5d6a47-ce38-4d1d-8d97-550f5e950af5" status: 200 len: 1210 microversion: 2.1 time: 0.255501 Aug 31 16:08:04.704577 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1437/2839] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:04 2022] GET /compute/v2.1/servers/0a5d6a47-ce38-4d1d-8d97-550f5e950af5 => generated 1210 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:04.732066 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c5bf6a30-469f-4a06-a620-6e1d5a88da91 tempest-SecurityGroupRulesNegativeTestJSON-8994449 tempest-SecurityGroupRulesNegativeTestJSON-8994449-project] Calling method '.version_select at 0x7f5ae93671f0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:05.099600 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e1fc54c3-10e7-4b7c-98c7-e1268fbe169b tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:05.117056 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e1fc54c3-10e7-4b7c-98c7-e1268fbe169b tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/8f165110-0ea6-48c0-8357-ba419171f7af" status: 200 len: 1462 microversion: 2.1 time: 0.961632 Aug 31 16:08:05.143895 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1403/2840] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:04 2022] GET /compute/v2.1/servers/8f165110-0ea6-48c0-8357-ba419171f7af => generated 1462 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:05.149240 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-61ba572e-a079-4ed0-84cd-0a433b0f6284 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '.version_select at 0x7f5ae83e6f70>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:05.353784 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-61ba572e-a079-4ed0-84cd-0a433b0f6284 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3278 microversion: 2.1 time: 0.207726 Aug 31 16:08:05.354460 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1404/2841] 10.222.0.61 () {58 vars in 1149 bytes} [Wed Aug 31 16:08:05 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3278 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:05.359665 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-480058dc-e065-4894-a27a-250701f4f884 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:05.360439 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-480058dc-e065-4894-a27a-250701f4f884 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] [instance: 1f11f86d-3387-4c6e-9099-fc8d232b11a8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:05.369371 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-480058dc-e065-4894-a27a-250701f4f884 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:05.370303 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-480058dc-e065-4894-a27a-250701f4f884 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:05.371087 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-480058dc-e065-4894-a27a-250701f4f884 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:05.372557 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-480058dc-e065-4894-a27a-250701f4f884 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:05.373360 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-480058dc-e065-4894-a27a-250701f4f884 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:05.374148 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-480058dc-e065-4894-a27a-250701f4f884 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:06.364400 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-480058dc-e065-4894-a27a-250701f4f884 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a837ababe7cb4284b96bc16deb40d2d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e9999df7e14609b1265351c83607bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:06.382327 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-480058dc-e065-4894-a27a-250701f4f884 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] 10.222.0.61 "GET /compute/v2.1/servers/1f11f86d-3387-4c6e-9099-fc8d232b11a8" status: 200 len: 1701 microversion: 2.1 time: 1.026583 Aug 31 16:08:06.386449 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1405/2842] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:05 2022] GET /compute/v2.1/servers/1f11f86d-3387-4c6e-9099-fc8d232b11a8 => generated 1701 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:06.427696 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a21404c6-4843-4f43-a913-30c5ac2ba1f3 tempest-MigrationsAdminTest-62329235 tempest-MigrationsAdminTest-62329235-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:06.429575 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a21404c6-4843-4f43-a913-30c5ac2ba1f3 tempest-MigrationsAdminTest-62329235 tempest-MigrationsAdminTest-62329235-project-admin] [instance: 8f165110-0ea6-48c0-8357-ba419171f7af] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:06.440134 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a21404c6-4843-4f43-a913-30c5ac2ba1f3 tempest-MigrationsAdminTest-62329235 tempest-MigrationsAdminTest-62329235-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:06.441044 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a21404c6-4843-4f43-a913-30c5ac2ba1f3 tempest-MigrationsAdminTest-62329235 tempest-MigrationsAdminTest-62329235-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:06.441578 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a21404c6-4843-4f43-a913-30c5ac2ba1f3 tempest-MigrationsAdminTest-62329235 tempest-MigrationsAdminTest-62329235-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:06.442983 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a21404c6-4843-4f43-a913-30c5ac2ba1f3 tempest-MigrationsAdminTest-62329235 tempest-MigrationsAdminTest-62329235-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:06.445066 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a21404c6-4843-4f43-a913-30c5ac2ba1f3 tempest-MigrationsAdminTest-62329235 tempest-MigrationsAdminTest-62329235-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:06.445534 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a21404c6-4843-4f43-a913-30c5ac2ba1f3 tempest-MigrationsAdminTest-62329235 tempest-MigrationsAdminTest-62329235-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:06.783488 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c5bf6a30-469f-4a06-a620-6e1d5a88da91 tempest-SecurityGroupRulesNegativeTestJSON-8994449 tempest-SecurityGroupRulesNegativeTestJSON-8994449-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/77cf5f77-7030-42f1-ac84-a17f608d3c3e" status: 202 len: 0 microversion: 2.1 time: 2.063126 Aug 31 16:08:06.785493 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1438/2843] 10.222.0.61 () {58 vars in 1272 bytes} [Wed Aug 31 16:08:04 2022] DELETE /compute/v2.1/os-security-groups/77cf5f77-7030-42f1-ac84-a17f608d3c3e => generated 0 bytes in 2068 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:08:06.798189 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-71a32b03-c5e7-45f0-9c31-02e94352367c tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '.version_select at 0x7f5ae8f1cb80>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:06.882367 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-71a32b03-c5e7-45f0-9c31-02e94352367c tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1428 microversion: 2.1 time: 0.089520 Aug 31 16:08:06.883265 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1439/2844] 10.222.0.61 () {58 vars in 1149 bytes} [Wed Aug 31 16:08:06 2022] GET /compute/v2.1/images?type=snapshot => generated 1428 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:06.892978 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c434c497-0d97-431d-a23d-320dd9d201bb tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:06.893908 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c434c497-0d97-431d-a23d-320dd9d201bb tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] [instance: 1df89d79-3817-40af-b956-b9b75919acbc] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:06.901668 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c434c497-0d97-431d-a23d-320dd9d201bb tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:06.902453 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c434c497-0d97-431d-a23d-320dd9d201bb tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:06.903053 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c434c497-0d97-431d-a23d-320dd9d201bb tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:06.904005 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c434c497-0d97-431d-a23d-320dd9d201bb tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:06.904689 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c434c497-0d97-431d-a23d-320dd9d201bb tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:06.905285 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c434c497-0d97-431d-a23d-320dd9d201bb tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:06.925227 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-c434c497-0d97-431d-a23d-320dd9d201bb tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] HTTP exception thrown: Instance 1df89d79-3817-40af-b956-b9b75919acbc could not be found. Aug 31 16:08:06.927626 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c434c497-0d97-431d-a23d-320dd9d201bb tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Request method failure captured: Aug 31 16:08:06.927626 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/1df89d79-3817-40af-b956-b9b75919acbc HTTP/1.1 Aug 31 16:08:06.927626 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:08:06.927626 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:08:06.927626 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:08:06.927626 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:08:06.927626 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:08:06.927626 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:08:06.927626 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:08:06.927626 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:08:06.927626 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4cQjW4RKqSiV5952upvIdfix-v8ArV-hdDrsMVQL2iqapdAKuJMVMBit-LQndqchCARhAtzgcWVEQP96bYgTLFYpSyAECAMkMrll5vcQzqANHbpTZgKZlP4yxj9CziN9j-8yIhUMwhBtpoBU1lVdOcoTDp-aBrSs_SMOJzLp_OYP8o Aug 31 16:08:06.927626 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:08:06.927626 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:08:06.927626 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:08:06.927626 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:08:06.927626 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:08:06.927626 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:08:06.927626 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: f79872256b2647d6a01c9e753b93b3c2 Aug 31 16:08:06.927626 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-LiveMigrationNegativeTest-1227032868 Aug 31 16:08:06.927626 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:08:06.927626 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:08:06.927626 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f79872256b2647d6a01c9e753b93b3c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f79872256b2647d6a01c9e753b93b3c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f79872256b2647d6a01c9e753b93b3c2", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f79872256b2647d6a01c9e753b93b3c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:08:06.927626 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-LiveMigrationNegativeTest-1227032868 Aug 31 16:08:06.927626 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: f79872256b2647d6a01c9e753b93b3c2 Aug 31 16:08:06.927626 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1227032868 Aug 31 16:08:06.927626 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-LiveMigrationNegativeTest-1227032868-project Aug 31 16:08:06.927626 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:08:06.927626 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:08:06.927626 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 4bb6a27e336449738f68a88d870ca6e2 Aug 31 16:08:06.927626 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-LiveMigrationNegativeTest-1227032868-project Aug 31 16:08:06.927626 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:08:06.927626 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance 1df89d79-3817-40af-b956-b9b75919acbc could not be found. Aug 31 16:08:06.927626 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '1df89d79-3817-40af-b956-b9b75919acbc'} Aug 31 16:08:06.927626 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:08:06.927626 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:08:06.927626 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:08:06.927626 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:08:06.927626 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:08:06.927626 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:08:06.927626 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:08:06.927626 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:08:06.927626 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:08:06.927626 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:08:06.927626 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1df89d79-3817-40af-b956-b9b75919acbc could not be found. Aug 31 16:08:06.927626 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:08:06.927626 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:08:06.927626 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:08:06.927626 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:08:06.927626 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:08:06.927626 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:08:06.927626 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:08:06.927626 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:08:06.927626 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:08:06.927626 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:08:06.927626 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:08:06.927626 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:08:06.927626 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:08:06.927626 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:08:06.927626 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:08:06.927626 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:08:06.927626 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1df89d79-3817-40af-b956-b9b75919acbc could not be found. Aug 31 16:08:06.927626 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:08:06.927626 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:08:06.927626 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:08:06.931525 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:08:06.931525 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:08:06.931525 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:08:06.931525 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:08:06.931525 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:08:06.931525 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1df89d79-3817-40af-b956-b9b75919acbc could not be found. Aug 31 16:08:06.931525 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:08:06.933518 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c434c497-0d97-431d-a23d-320dd9d201bb tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Returning 404 to user: Instance 1df89d79-3817-40af-b956-b9b75919acbc could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:08:06.934847 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c434c497-0d97-431d-a23d-320dd9d201bb tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] 10.222.0.61 "GET /compute/v2.1/servers/1df89d79-3817-40af-b956-b9b75919acbc" status: 404 len: 111 microversion: 2.1 time: 0.050460 Aug 31 16:08:06.935658 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1440/2845] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:06 2022] GET /compute/v2.1/servers/1df89d79-3817-40af-b956-b9b75919acbc => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:08:06.942151 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-55405da7-7d41-46f5-8c4b-e9f0064154b8 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:06.943313 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-55405da7-7d41-46f5-8c4b-e9f0064154b8 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 0a5d6a47-ce38-4d1d-8d97-550f5e950af5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:06.954433 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-55405da7-7d41-46f5-8c4b-e9f0064154b8 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:06.956084 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-55405da7-7d41-46f5-8c4b-e9f0064154b8 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:06.957230 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-55405da7-7d41-46f5-8c4b-e9f0064154b8 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:06.959929 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-55405da7-7d41-46f5-8c4b-e9f0064154b8 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:06.961713 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-55405da7-7d41-46f5-8c4b-e9f0064154b8 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:06.962482 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-55405da7-7d41-46f5-8c4b-e9f0064154b8 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:07.142684 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a21404c6-4843-4f43-a913-30c5ac2ba1f3 tempest-MigrationsAdminTest-62329235 tempest-MigrationsAdminTest-62329235-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/8f165110-0ea6-48c0-8357-ba419171f7af" status: 200 len: 1613 microversion: 2.1 time: 0.754653 Aug 31 16:08:07.150496 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-55405da7-7d41-46f5-8c4b-e9f0064154b8 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:07.161463 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1406/2846] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:06 2022] GET /compute/v2.1/servers/8f165110-0ea6-48c0-8357-ba419171f7af => generated 1613 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:07.166442 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-55405da7-7d41-46f5-8c4b-e9f0064154b8 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/0a5d6a47-ce38-4d1d-8d97-550f5e950af5" status: 200 len: 1272 microversion: 2.1 time: 0.228674 Aug 31 16:08:07.167039 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1441/2847] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:06 2022] GET /compute/v2.1/servers/0a5d6a47-ce38-4d1d-8d97-550f5e950af5 => generated 1272 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:07.183216 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-25204383-7511-4846-9b5e-f202f3d4efd6 req-301eaf53-ffe6-4fb1-9b78-e8d2dea18480 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f11f86d-3387-4c6e-9099-fc8d232b11a8", "name": "network-vif-unplugged", "status": "completed", "tag": "63593e47-213f-4d04-ae59-a652fc80fcbd"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:08:07.193454 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c0a9cc14-55e8-4186-b139-ebeea6f87046 tempest-SecurityGroupRulesNegativeTestJSON-8994449 tempest-SecurityGroupRulesNegativeTestJSON-8994449-project] Calling method '.version_select at 0x7f5ae91409d0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:07.199994 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-25204383-7511-4846-9b5e-f202f3d4efd6 req-301eaf53-ffe6-4fb1-9b78-e8d2dea18480 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:07.200941 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-25204383-7511-4846-9b5e-f202f3d4efd6 req-301eaf53-ffe6-4fb1-9b78-e8d2dea18480 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:07.201944 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-25204383-7511-4846-9b5e-f202f3d4efd6 req-301eaf53-ffe6-4fb1-9b78-e8d2dea18480 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:07.219106 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-25204383-7511-4846-9b5e-f202f3d4efd6 req-301eaf53-ffe6-4fb1-9b78-e8d2dea18480 service nova] Creating event network-vif-unplugged:63593e47-213f-4d04-ae59-a652fc80fcbd for instance 1f11f86d-3387-4c6e-9099-fc8d232b11a8 on n-h2-850499-9 Aug 31 16:08:07.227754 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-25204383-7511-4846-9b5e-f202f3d4efd6 req-301eaf53-ffe6-4fb1-9b78-e8d2dea18480 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055330 Aug 31 16:08:07.229132 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1407/2848] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:08:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:08:07.239053 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b4b7f52c-4236-4308-abb9-0ed4d8fe0807 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '.version_select at 0x7f5ae8475f70>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:07.372939 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b4b7f52c-4236-4308-abb9-0ed4d8fe0807 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "GET /compute/v2.1/images?limit=1" status: 200 len: 622 microversion: 2.1 time: 0.140038 Aug 31 16:08:07.375892 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1408/2849] 10.222.0.61 () {58 vars in 1137 bytes} [Wed Aug 31 16:08:07 2022] GET /compute/v2.1/images?limit=1 => generated 622 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:08:07.383113 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3d6fc0c4-69e3-464d-b943-5faa221cf70a tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:07.384089 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3d6fc0c4-69e3-464d-b943-5faa221cf70a tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] [instance: 5709d363-0934-4d14-a734-35a54bdc03d0] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:07.397194 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3d6fc0c4-69e3-464d-b943-5faa221cf70a tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:07.397879 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3d6fc0c4-69e3-464d-b943-5faa221cf70a tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:07.398517 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3d6fc0c4-69e3-464d-b943-5faa221cf70a tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:07.399684 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3d6fc0c4-69e3-464d-b943-5faa221cf70a tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:07.400459 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3d6fc0c4-69e3-464d-b943-5faa221cf70a tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:07.403303 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3d6fc0c4-69e3-464d-b943-5faa221cf70a tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:07.441080 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3d6fc0c4-69e3-464d-b943-5faa221cf70a tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] [instance: 5709d363-0934-4d14-a734-35a54bdc03d0] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:08:07.563346 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3d6fc0c4-69e3-464d-b943-5faa221cf70a tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] 10.222.0.61 "DELETE /compute/v2.1/servers/5709d363-0934-4d14-a734-35a54bdc03d0" status: 204 len: 0 microversion: 2.1 time: 0.185293 Aug 31 16:08:07.567610 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1409/2850] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:08:07 2022] DELETE /compute/v2.1/servers/5709d363-0934-4d14-a734-35a54bdc03d0 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:08:07.574042 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3150afa8-a5df-4517-83bd-a08e11bd9294 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:07.575563 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3150afa8-a5df-4517-83bd-a08e11bd9294 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 8f165110-0ea6-48c0-8357-ba419171f7af] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:07.582995 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3150afa8-a5df-4517-83bd-a08e11bd9294 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:07.583893 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3150afa8-a5df-4517-83bd-a08e11bd9294 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:07.584439 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3150afa8-a5df-4517-83bd-a08e11bd9294 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:07.585338 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3150afa8-a5df-4517-83bd-a08e11bd9294 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:07.585778 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3150afa8-a5df-4517-83bd-a08e11bd9294 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:07.586562 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3150afa8-a5df-4517-83bd-a08e11bd9294 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:07.619878 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3150afa8-a5df-4517-83bd-a08e11bd9294 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 8f165110-0ea6-48c0-8357-ba419171f7af] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:08:07.746315 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:08:07.769502 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3150afa8-a5df-4517-83bd-a08e11bd9294 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "DELETE /compute/v2.1/servers/8f165110-0ea6-48c0-8357-ba419171f7af" status: 204 len: 0 microversion: 2.1 time: 0.199131 Aug 31 16:08:07.770017 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1410/2851] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:08:07 2022] DELETE /compute/v2.1/servers/8f165110-0ea6-48c0-8357-ba419171f7af => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:08:07.779125 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d51fe3cf-d746-4e81-b2be-6660e51e7dcd tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '.version_select at 0x7f5ae83e6700>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:07.826658 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:08:07.878662 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d51fe3cf-d746-4e81-b2be-6660e51e7dcd tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "GET /compute/v2.1/images/detail?changes-since=2022-08-31T16%3A04%3A53Z" status: 200 len: 6325 microversion: 2.1 time: 0.103812 Aug 31 16:08:07.886376 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1411/2852] 10.222.0.61 () {58 vars in 1220 bytes} [Wed Aug 31 16:08:07 2022] GET /compute/v2.1/images/detail?changes-since=2022-08-31T16%3A04%3A53Z => generated 6325 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:07.898121 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5b5e418f-03cf-4513-b28a-85fb40766a6d tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:07.901130 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5b5e418f-03cf-4513-b28a-85fb40766a6d tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] [instance: 1f11f86d-3387-4c6e-9099-fc8d232b11a8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:07.919231 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b5e418f-03cf-4513-b28a-85fb40766a6d tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:07.920269 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b5e418f-03cf-4513-b28a-85fb40766a6d tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:07.920888 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b5e418f-03cf-4513-b28a-85fb40766a6d tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:07.921979 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b5e418f-03cf-4513-b28a-85fb40766a6d tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:07.922599 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b5e418f-03cf-4513-b28a-85fb40766a6d tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:07.923312 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b5e418f-03cf-4513-b28a-85fb40766a6d tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:08.064651 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5b5e418f-03cf-4513-b28a-85fb40766a6d tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a837ababe7cb4284b96bc16deb40d2d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e9999df7e14609b1265351c83607bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:08.066987 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:08:08.074684 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5b5e418f-03cf-4513-b28a-85fb40766a6d tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] 10.222.0.61 "GET /compute/v2.1/servers/1f11f86d-3387-4c6e-9099-fc8d232b11a8" status: 200 len: 1633 microversion: 2.1 time: 0.186784 Aug 31 16:08:08.075569 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1412/2853] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:07 2022] GET /compute/v2.1/servers/1f11f86d-3387-4c6e-9099-fc8d232b11a8 => generated 1633 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:08.081172 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ea05addd-5291-4350-9e6f-84bf9c2aa252 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:08.081172 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ea05addd-5291-4350-9e6f-84bf9c2aa252 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] [instance: 5709d363-0934-4d14-a734-35a54bdc03d0] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:08.097911 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ea05addd-5291-4350-9e6f-84bf9c2aa252 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:08.098408 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ea05addd-5291-4350-9e6f-84bf9c2aa252 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:08.098860 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ea05addd-5291-4350-9e6f-84bf9c2aa252 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:08.099629 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ea05addd-5291-4350-9e6f-84bf9c2aa252 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:08.100105 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ea05addd-5291-4350-9e6f-84bf9c2aa252 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:08.100544 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ea05addd-5291-4350-9e6f-84bf9c2aa252 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:08.327846 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c0a9cc14-55e8-4186-b139-ebeea6f87046 tempest-SecurityGroupRulesNegativeTestJSON-8994449 tempest-SecurityGroupRulesNegativeTestJSON-8994449-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/f2c533a2-bcf6-4868-8857-9af91627e646" status: 202 len: 0 microversion: 2.1 time: 1.153370 Aug 31 16:08:08.329205 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1442/2854] 10.222.0.61 () {58 vars in 1272 bytes} [Wed Aug 31 16:08:07 2022] DELETE /compute/v2.1/os-security-groups/f2c533a2-bcf6-4868-8857-9af91627e646 => generated 0 bytes in 1161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:08:08.337458 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f04c24ee-72aa-4e8d-b8db-36cf4c25fe5d tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:08.340210 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f04c24ee-72aa-4e8d-b8db-36cf4c25fe5d tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 8f165110-0ea6-48c0-8357-ba419171f7af] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:08.347297 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f04c24ee-72aa-4e8d-b8db-36cf4c25fe5d tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:08.348053 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f04c24ee-72aa-4e8d-b8db-36cf4c25fe5d tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:08.348647 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f04c24ee-72aa-4e8d-b8db-36cf4c25fe5d tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:08.349484 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f04c24ee-72aa-4e8d-b8db-36cf4c25fe5d tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:08.350194 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f04c24ee-72aa-4e8d-b8db-36cf4c25fe5d tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:08.350791 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f04c24ee-72aa-4e8d-b8db-36cf4c25fe5d tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:08.747339 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ea05addd-5291-4350-9e6f-84bf9c2aa252 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb6a27e336449738f68a88d870ca6e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f79872256b2647d6a01c9e753b93b3c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:08.768530 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ea05addd-5291-4350-9e6f-84bf9c2aa252 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] 10.222.0.61 "GET /compute/v2.1/servers/5709d363-0934-4d14-a734-35a54bdc03d0" status: 200 len: 1474 microversion: 2.1 time: 0.691760 Aug 31 16:08:08.770807 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1413/2855] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:08 2022] GET /compute/v2.1/servers/5709d363-0934-4d14-a734-35a54bdc03d0 => generated 1474 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:08.787553 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-95d962cb-a864-4d97-844b-14e9cbe71b47 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '.version_select at 0x7f5ae8475dc0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:08.851479 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f04c24ee-72aa-4e8d-b8db-36cf4c25fe5d tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:08.869231 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f04c24ee-72aa-4e8d-b8db-36cf4c25fe5d tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/8f165110-0ea6-48c0-8357-ba419171f7af" status: 200 len: 1468 microversion: 2.1 time: 0.538152 Aug 31 16:08:08.873433 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1443/2856] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:08 2022] GET /compute/v2.1/servers/8f165110-0ea6-48c0-8357-ba419171f7af => generated 1468 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:08.893430 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c8abd179-94ac-4bb0-9484-33c21b42fde8 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:08.894741 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c8abd179-94ac-4bb0-9484-33c21b42fde8 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 0a5d6a47-ce38-4d1d-8d97-550f5e950af5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:08.905120 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c8abd179-94ac-4bb0-9484-33c21b42fde8 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:08.906552 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c8abd179-94ac-4bb0-9484-33c21b42fde8 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:08.907047 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c8abd179-94ac-4bb0-9484-33c21b42fde8 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:08.907828 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c8abd179-94ac-4bb0-9484-33c21b42fde8 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:08.908459 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c8abd179-94ac-4bb0-9484-33c21b42fde8 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:08.909169 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c8abd179-94ac-4bb0-9484-33c21b42fde8 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:08.925789 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-95d962cb-a864-4d97-844b-14e9cbe71b47 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1907428448" status: 200 len: 665 microversion: 2.1 time: 0.145948 Aug 31 16:08:08.931326 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1414/2857] 10.222.0.61 () {58 vars in 1252 bytes} [Wed Aug 31 16:08:08 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1907428448 => generated 665 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:08:08.941969 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-66944c2f-14e6-432a-b5e5-62a974d9e2fa tempest-SecurityGroupRulesNegativeTestJSON-8994449 tempest-SecurityGroupRulesNegativeTestJSON-8994449-project] Calling method '.version_select at 0x7f5ae84194c0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:09.586018 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c8abd179-94ac-4bb0-9484-33c21b42fde8 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:09.601231 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c8abd179-94ac-4bb0-9484-33c21b42fde8 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/0a5d6a47-ce38-4d1d-8d97-550f5e950af5" status: 200 len: 1314 microversion: 2.1 time: 0.725664 Aug 31 16:08:09.602177 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1444/2858] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:08 2022] GET /compute/v2.1/servers/0a5d6a47-ce38-4d1d-8d97-550f5e950af5 => generated 1314 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:09.610602 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-0aefae1a-6442-4b04-b49d-95f05c82c925 req-33cb2fa0-2b58-4319-b3fa-da31761ff45d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f11f86d-3387-4c6e-9099-fc8d232b11a8", "name": "network-vif-deleted", "tag": "63593e47-213f-4d04-ae59-a652fc80fcbd"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:08:09.647584 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-0aefae1a-6442-4b04-b49d-95f05c82c925 req-33cb2fa0-2b58-4319-b3fa-da31761ff45d service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:09.648631 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-0aefae1a-6442-4b04-b49d-95f05c82c925 req-33cb2fa0-2b58-4319-b3fa-da31761ff45d service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:09.660676 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-0aefae1a-6442-4b04-b49d-95f05c82c925 req-33cb2fa0-2b58-4319-b3fa-da31761ff45d service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:09.692188 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-0aefae1a-6442-4b04-b49d-95f05c82c925 req-33cb2fa0-2b58-4319-b3fa-da31761ff45d service nova] Creating event network-vif-deleted:63593e47-213f-4d04-ae59-a652fc80fcbd for instance 1f11f86d-3387-4c6e-9099-fc8d232b11a8 on n-h2-850499-9 Aug 31 16:08:09.701704 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-0aefae1a-6442-4b04-b49d-95f05c82c925 req-33cb2fa0-2b58-4319-b3fa-da31761ff45d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096093 Aug 31 16:08:09.702771 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1445/2859] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:08:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:08:09.709567 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4a0d0d3a-a92f-4038-8d71-7f672f151b6c tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '.version_select at 0x7f5ae93cd1f0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:09.832006 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4a0d0d3a-a92f-4038-8d71-7f672f151b6c tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.61%2Fcompute%2Fv2.1%2Fservers%2F560a01e5-93f8-46c8-9261-5030e28766b4" status: 200 len: 1464 microversion: 2.1 time: 0.126503 Aug 31 16:08:09.833982 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1446/2860] 10.222.0.61 () {58 vars in 1338 bytes} [Wed Aug 31 16:08:09 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.61%2Fcompute%2Fv2.1%2Fservers%2F560a01e5-93f8-46c8-9261-5030e28766b4 => generated 1464 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:09.846700 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-fc3956fc-9491-4ad5-9685-14c76ba00c4e tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:09.848636 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-fc3956fc-9491-4ad5-9685-14c76ba00c4e tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] [instance: 1f11f86d-3387-4c6e-9099-fc8d232b11a8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:09.861432 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fc3956fc-9491-4ad5-9685-14c76ba00c4e tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:09.865030 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fc3956fc-9491-4ad5-9685-14c76ba00c4e tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:09.866208 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fc3956fc-9491-4ad5-9685-14c76ba00c4e tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:09.870823 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fc3956fc-9491-4ad5-9685-14c76ba00c4e tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:09.871821 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fc3956fc-9491-4ad5-9685-14c76ba00c4e tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:09.873603 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fc3956fc-9491-4ad5-9685-14c76ba00c4e tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:09.890732 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-66944c2f-14e6-432a-b5e5-62a974d9e2fa tempest-SecurityGroupRulesNegativeTestJSON-8994449 tempest-SecurityGroupRulesNegativeTestJSON-8994449-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/ab8498ef-de2e-4102-90d3-20b5337afdeb" status: 202 len: 0 microversion: 2.1 time: 0.958173 Aug 31 16:08:09.897157 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1415/2861] 10.222.0.61 () {58 vars in 1272 bytes} [Wed Aug 31 16:08:08 2022] DELETE /compute/v2.1/os-security-groups/ab8498ef-de2e-4102-90d3-20b5337afdeb => generated 0 bytes in 965 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:08:09.903796 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-f6d7706c-c4cc-4fba-bfdf-247027569a29 req-5aeec201-2dfd-425d-8e90-c83bc4816e81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f165110-0ea6-48c0-8357-ba419171f7af", "name": "network-vif-plugged", "status": "completed", "tag": "900ed2dd-d7d4-47d6-b6c7-2d39286cc7dc"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:08:09.911804 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=4,nova_api:INSERT=3 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:08:09.926706 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-f6d7706c-c4cc-4fba-bfdf-247027569a29 req-5aeec201-2dfd-425d-8e90-c83bc4816e81 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:09.927748 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-f6d7706c-c4cc-4fba-bfdf-247027569a29 req-5aeec201-2dfd-425d-8e90-c83bc4816e81 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:09.928526 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-f6d7706c-c4cc-4fba-bfdf-247027569a29 req-5aeec201-2dfd-425d-8e90-c83bc4816e81 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:09.985893 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-f6d7706c-c4cc-4fba-bfdf-247027569a29 req-5aeec201-2dfd-425d-8e90-c83bc4816e81 service nova] Creating event network-vif-plugged:900ed2dd-d7d4-47d6-b6c7-2d39286cc7dc for instance 8f165110-0ea6-48c0-8357-ba419171f7af on n-h1-850499-9 Aug 31 16:08:09.991721 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fc3956fc-9491-4ad5-9685-14c76ba00c4e tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:09.993070 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fc3956fc-9491-4ad5-9685-14c76ba00c4e tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:09.994217 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fc3956fc-9491-4ad5-9685-14c76ba00c4e tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:09.995346 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-fc3956fc-9491-4ad5-9685-14c76ba00c4e tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lazy-loading 'fault' on Instance uuid 1f11f86d-3387-4c6e-9099-fc8d232b11a8 {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:08:10.003133 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-f6d7706c-c4cc-4fba-bfdf-247027569a29 req-5aeec201-2dfd-425d-8e90-c83bc4816e81 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104046 Aug 31 16:08:10.003772 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1416/2862] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:08:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:08:10.027431 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9ce5b309-f74c-4aaa-92b1-f1dde1eb2a89 tempest-ImagesMetadataTestJSON-1089699170 tempest-ImagesMetadataTestJSON-1089699170-project] Calling method '.version_select at 0x7f5ae83cf940>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:10.111124 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9ce5b309-f74c-4aaa-92b1-f1dde1eb2a89 tempest-ImagesMetadataTestJSON-1089699170 tempest-ImagesMetadataTestJSON-1089699170-project] 10.222.0.61 "GET /compute/v2.1/images/de39420f-2805-45ff-b83c-cabc5422f621" status: 200 len: 637 microversion: 2.1 time: 0.105902 Aug 31 16:08:10.111750 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1417/2863] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:08:10 2022] GET /compute/v2.1/images/de39420f-2805-45ff-b83c-cabc5422f621 => generated 637 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:08:10.117106 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7875984d-b0e7-436d-8090-5bbbd992d973 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:10.122234 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7875984d-b0e7-436d-8090-5bbbd992d973 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] [instance: 5709d363-0934-4d14-a734-35a54bdc03d0] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:10.130569 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7875984d-b0e7-436d-8090-5bbbd992d973 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:10.131473 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7875984d-b0e7-436d-8090-5bbbd992d973 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:10.132335 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7875984d-b0e7-436d-8090-5bbbd992d973 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:10.133279 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7875984d-b0e7-436d-8090-5bbbd992d973 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:10.133760 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7875984d-b0e7-436d-8090-5bbbd992d973 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:10.134221 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7875984d-b0e7-436d-8090-5bbbd992d973 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:10.379854 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=6 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:08:10.453005 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-fc3956fc-9491-4ad5-9685-14c76ba00c4e tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a837ababe7cb4284b96bc16deb40d2d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e9999df7e14609b1265351c83607bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:10.469721 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-fc3956fc-9491-4ad5-9685-14c76ba00c4e tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] 10.222.0.61 "GET /compute/v2.1/servers/1f11f86d-3387-4c6e-9099-fc8d232b11a8" status: 200 len: 1359 microversion: 2.1 time: 0.633969 Aug 31 16:08:10.470912 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1447/2864] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:09 2022] GET /compute/v2.1/servers/1f11f86d-3387-4c6e-9099-fc8d232b11a8 => generated 1359 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:10.482345 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-52d07263-cbe5-4b58-98fa-48add3578599 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '.version_select at 0x7f5ae8f1cc10>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:10.575052 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-52d07263-cbe5-4b58-98fa-48add3578599 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.61%2Fcompute%2Fservers%2F560a01e5-93f8-46c8-9261-5030e28766b4" status: 200 len: 1464 microversion: 2.1 time: 0.102350 Aug 31 16:08:10.578104 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1448/2865] 10.222.0.61 () {58 vars in 1324 bytes} [Wed Aug 31 16:08:10 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.61%2Fcompute%2Fservers%2F560a01e5-93f8-46c8-9261-5030e28766b4 => generated 1464 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:10.588364 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9875139f-be39-4bb1-bcfe-0c2848c6b415 tempest-SecurityGroupRulesNegativeTestJSON-8994449 tempest-SecurityGroupRulesNegativeTestJSON-8994449-project] Calling method '.version_select at 0x7f5ae9079310>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:10.788959 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7875984d-b0e7-436d-8090-5bbbd992d973 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb6a27e336449738f68a88d870ca6e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f79872256b2647d6a01c9e753b93b3c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:10.802452 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7875984d-b0e7-436d-8090-5bbbd992d973 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] 10.222.0.61 "GET /compute/v2.1/servers/5709d363-0934-4d14-a734-35a54bdc03d0" status: 200 len: 1474 microversion: 2.1 time: 0.689212 Aug 31 16:08:10.803462 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1418/2866] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:10 2022] GET /compute/v2.1/servers/5709d363-0934-4d14-a734-35a54bdc03d0 => generated 1474 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:10.813759 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1dd969b5-f320-4bd2-ab82-e3a3ab6394bd tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:10.814587 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1dd969b5-f320-4bd2-ab82-e3a3ab6394bd tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 8f165110-0ea6-48c0-8357-ba419171f7af] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:10.825477 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1dd969b5-f320-4bd2-ab82-e3a3ab6394bd tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:10.826215 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1dd969b5-f320-4bd2-ab82-e3a3ab6394bd tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:10.826964 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1dd969b5-f320-4bd2-ab82-e3a3ab6394bd tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:10.828345 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1dd969b5-f320-4bd2-ab82-e3a3ab6394bd tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:10.829072 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1dd969b5-f320-4bd2-ab82-e3a3ab6394bd tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:10.829864 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1dd969b5-f320-4bd2-ab82-e3a3ab6394bd tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:11.092126 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=8 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:08:11.331201 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-1dd969b5-f320-4bd2-ab82-e3a3ab6394bd tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:11.344073 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1dd969b5-f320-4bd2-ab82-e3a3ab6394bd tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/8f165110-0ea6-48c0-8357-ba419171f7af" status: 200 len: 1468 microversion: 2.1 time: 0.536386 Aug 31 16:08:11.344982 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1419/2867] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:10 2022] GET /compute/v2.1/servers/8f165110-0ea6-48c0-8357-ba419171f7af => generated 1468 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:11.351702 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c6cc14a0-7ebe-4fb6-9b7d-c859b930792c tempest-ImagesMetadataTestJSON-1089699170 tempest-ImagesMetadataTestJSON-1089699170-project] Action: 'update_all', calling method: .version_select at 0x7f5ae8371e50>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:08:11.482450 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-c6cc14a0-7ebe-4fb6-9b7d-c859b930792c tempest-ImagesMetadataTestJSON-1089699170 tempest-ImagesMetadataTestJSON-1089699170-project] Getting quotas for project 7e64d9d4b9674febb32169ec4ec6b40f. Resources: dict_keys(['metadata_items']) {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:08:11.500364 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-c6cc14a0-7ebe-4fb6-9b7d-c859b930792c tempest-ImagesMetadataTestJSON-1089699170 tempest-ImagesMetadataTestJSON-1089699170-project] Getting quotas for user 00fdafbbe22c4d5c8c1cc5b1bf88ae42 and project 7e64d9d4b9674febb32169ec4ec6b40f. Resources: dict_keys(['metadata_items']) {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:08:11.758827 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9875139f-be39-4bb1-bcfe-0c2848c6b415 tempest-SecurityGroupRulesNegativeTestJSON-8994449 tempest-SecurityGroupRulesNegativeTestJSON-8994449-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/938af94a-8bcd-4d0c-8bfb-a011640e85ff" status: 202 len: 0 microversion: 2.1 time: 1.173907 Aug 31 16:08:11.761794 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1449/2868] 10.222.0.61 () {58 vars in 1272 bytes} [Wed Aug 31 16:08:10 2022] DELETE /compute/v2.1/os-security-groups/938af94a-8bcd-4d0c-8bfb-a011640e85ff => generated 0 bytes in 1183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:08:11.826195 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1aeca849-3d91-41a2-974e-4ae0a57628f7 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '.version_select at 0x7f5ae928e3a0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:12.139689 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1aeca849-3d91-41a2-974e-4ae0a57628f7 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7100 microversion: 2.1 time: 0.374877 Aug 31 16:08:12.141516 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1450/2869] 10.222.0.61 () {58 vars in 1170 bytes} [Wed Aug 31 16:08:11 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7100 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:12.189083 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c6cc14a0-7ebe-4fb6-9b7d-c859b930792c tempest-ImagesMetadataTestJSON-1089699170 tempest-ImagesMetadataTestJSON-1089699170-project] 10.222.0.61 "PUT /compute/v2.1/images/de39420f-2805-45ff-b83c-cabc5422f621/metadata" status: 200 len: 61 microversion: 2.1 time: 0.841808 Aug 31 16:08:12.189701 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1420/2870] 10.222.0.61 () {60 vars in 1280 bytes} [Wed Aug 31 16:08:11 2022] PUT /compute/v2.1/images/de39420f-2805-45ff-b83c-cabc5422f621/metadata => generated 61 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 16:08:12.212308 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-aa992e36-61ed-440a-bb52-bba3da9d3227 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:12.213462 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-aa992e36-61ed-440a-bb52-bba3da9d3227 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 0a5d6a47-ce38-4d1d-8d97-550f5e950af5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:12.230609 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f04576a9-5a19-4567-ac8f-2d640dc5c007 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:12.236452 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f04576a9-5a19-4567-ac8f-2d640dc5c007 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] [instance: 1f11f86d-3387-4c6e-9099-fc8d232b11a8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:12.245951 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:08:12.258159 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f04576a9-5a19-4567-ac8f-2d640dc5c007 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:12.258979 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f04576a9-5a19-4567-ac8f-2d640dc5c007 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:12.261009 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f04576a9-5a19-4567-ac8f-2d640dc5c007 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:12.263428 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f04576a9-5a19-4567-ac8f-2d640dc5c007 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:12.264246 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aa992e36-61ed-440a-bb52-bba3da9d3227 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:12.264837 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f04576a9-5a19-4567-ac8f-2d640dc5c007 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:12.265758 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f04576a9-5a19-4567-ac8f-2d640dc5c007 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:12.265923 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aa992e36-61ed-440a-bb52-bba3da9d3227 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:12.267491 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aa992e36-61ed-440a-bb52-bba3da9d3227 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:12.268308 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aa992e36-61ed-440a-bb52-bba3da9d3227 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:12.268791 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aa992e36-61ed-440a-bb52-bba3da9d3227 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:12.270667 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aa992e36-61ed-440a-bb52-bba3da9d3227 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:12.360948 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-f04576a9-5a19-4567-ac8f-2d640dc5c007 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] HTTP exception thrown: Instance 1f11f86d-3387-4c6e-9099-fc8d232b11a8 could not be found. Aug 31 16:08:12.365157 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f04576a9-5a19-4567-ac8f-2d640dc5c007 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Request method failure captured: Aug 31 16:08:12.365157 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/1f11f86d-3387-4c6e-9099-fc8d232b11a8 HTTP/1.1 Aug 31 16:08:12.365157 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:08:12.365157 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:08:12.365157 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:08:12.365157 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:08:12.365157 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:08:12.365157 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:08:12.365157 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:08:12.365157 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:08:12.365157 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4arB9dac-5Eqe7dTvyfls8TYWUmHbrxE-z5K1r3BqNYRVy4AK10ONW917HRZ7EF2fgE3ivN0S9JJLi356XUI0UyWQdARW896UmxFpFuuutDJP7mg2vBf8sT_Mc_lVLSHsbMCTcCtlgueXFAqcSGFfdYnMDiuQ3XSaH5RuvY3L_ulO0 Aug 31 16:08:12.365157 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:08:12.365157 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:08:12.365157 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:08:12.365157 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:08:12.365157 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:08:12.365157 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:08:12.365157 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: e3e9999df7e14609b1265351c83607bd Aug 31 16:08:12.365157 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ServersTestJSON-1491808426 Aug 31 16:08:12.365157 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:08:12.365157 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:08:12.365157 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e3e9999df7e14609b1265351c83607bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/e3e9999df7e14609b1265351c83607bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_e3e9999df7e14609b1265351c83607bd", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e3e9999df7e14609b1265351c83607bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:08:12.365157 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ServersTestJSON-1491808426 Aug 31 16:08:12.365157 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: e3e9999df7e14609b1265351c83607bd Aug 31 16:08:12.365157 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ServersTestJSON-1491808426 Aug 31 16:08:12.365157 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ServersTestJSON-1491808426-project Aug 31 16:08:12.365157 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:08:12.365157 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:08:12.365157 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: a837ababe7cb4284b96bc16deb40d2d2 Aug 31 16:08:12.365157 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ServersTestJSON-1491808426-project Aug 31 16:08:12.365157 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:08:12.365157 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance 1f11f86d-3387-4c6e-9099-fc8d232b11a8 could not be found. Aug 31 16:08:12.365157 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '1f11f86d-3387-4c6e-9099-fc8d232b11a8'} Aug 31 16:08:12.365157 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:08:12.365157 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:08:12.365157 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:08:12.365157 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:08:12.365157 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:08:12.365157 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:08:12.365157 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:08:12.365157 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:08:12.365157 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:08:12.365157 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:08:12.365157 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f11f86d-3387-4c6e-9099-fc8d232b11a8 could not be found. Aug 31 16:08:12.365157 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:08:12.365157 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:08:12.365157 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:08:12.365157 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:08:12.365157 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:08:12.365157 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:08:12.365157 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:08:12.365157 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:08:12.365157 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:08:12.365157 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:08:12.365157 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:08:12.365157 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:08:12.365157 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:08:12.365157 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:08:12.365157 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:08:12.365157 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:08:12.365157 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f11f86d-3387-4c6e-9099-fc8d232b11a8 could not be found. Aug 31 16:08:12.365157 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:08:12.365157 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:08:12.365157 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:08:12.373559 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:08:12.373559 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:08:12.373559 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:08:12.373559 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:08:12.373559 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:08:12.373559 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f11f86d-3387-4c6e-9099-fc8d232b11a8 could not be found. Aug 31 16:08:12.373559 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:08:12.382856 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f04576a9-5a19-4567-ac8f-2d640dc5c007 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Returning 404 to user: Instance 1f11f86d-3387-4c6e-9099-fc8d232b11a8 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:08:12.383646 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f04576a9-5a19-4567-ac8f-2d640dc5c007 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] 10.222.0.61 "GET /compute/v2.1/servers/1f11f86d-3387-4c6e-9099-fc8d232b11a8" status: 404 len: 111 microversion: 2.1 time: 0.175990 Aug 31 16:08:12.384387 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1421/2871] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:12 2022] GET /compute/v2.1/servers/1f11f86d-3387-4c6e-9099-fc8d232b11a8 => generated 111 bytes in 194 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:08:12.398479 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3177c16b-f27e-4071-8808-a7244c091702 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:12.399530 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3177c16b-f27e-4071-8808-a7244c091702 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] [instance: 5709d363-0934-4d14-a734-35a54bdc03d0] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:12.408397 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3177c16b-f27e-4071-8808-a7244c091702 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:12.408992 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3177c16b-f27e-4071-8808-a7244c091702 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:12.409532 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3177c16b-f27e-4071-8808-a7244c091702 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:12.410323 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3177c16b-f27e-4071-8808-a7244c091702 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:12.410924 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3177c16b-f27e-4071-8808-a7244c091702 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:12.411424 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3177c16b-f27e-4071-8808-a7244c091702 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:12.795538 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-aa992e36-61ed-440a-bb52-bba3da9d3227 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:12.811248 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-aa992e36-61ed-440a-bb52-bba3da9d3227 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/0a5d6a47-ce38-4d1d-8d97-550f5e950af5" status: 200 len: 1314 microversion: 2.1 time: 0.666825 Aug 31 16:08:12.812889 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1451/2872] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:12 2022] GET /compute/v2.1/servers/0a5d6a47-ce38-4d1d-8d97-550f5e950af5 => generated 1314 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:12.820918 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-69139e83-805d-49e6-9c96-3f0ae11e7956 req-90f1cfb6-ed55-4bb8-b222-626765080aa9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f165110-0ea6-48c0-8357-ba419171f7af", "name": "network-vif-deleted", "tag": "900ed2dd-d7d4-47d6-b6c7-2d39286cc7dc"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:08:12.842099 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-69139e83-805d-49e6-9c96-3f0ae11e7956 req-90f1cfb6-ed55-4bb8-b222-626765080aa9 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:12.843245 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-69139e83-805d-49e6-9c96-3f0ae11e7956 req-90f1cfb6-ed55-4bb8-b222-626765080aa9 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:12.844428 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-69139e83-805d-49e6-9c96-3f0ae11e7956 req-90f1cfb6-ed55-4bb8-b222-626765080aa9 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:12.863108 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-69139e83-805d-49e6-9c96-3f0ae11e7956 req-90f1cfb6-ed55-4bb8-b222-626765080aa9 service nova] Creating event network-vif-deleted:900ed2dd-d7d4-47d6-b6c7-2d39286cc7dc for instance 8f165110-0ea6-48c0-8357-ba419171f7af on n-h1-850499-9 Aug 31 16:08:12.875998 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3177c16b-f27e-4071-8808-a7244c091702 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb6a27e336449738f68a88d870ca6e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f79872256b2647d6a01c9e753b93b3c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:12.885839 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-69139e83-805d-49e6-9c96-3f0ae11e7956 req-90f1cfb6-ed55-4bb8-b222-626765080aa9 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070127 Aug 31 16:08:12.891010 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1452/2873] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:08:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:08:12.897562 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3177c16b-f27e-4071-8808-a7244c091702 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] 10.222.0.61 "GET /compute/v2.1/servers/5709d363-0934-4d14-a734-35a54bdc03d0" status: 200 len: 1474 microversion: 2.1 time: 0.510845 Aug 31 16:08:12.921970 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1422/2874] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:12 2022] GET /compute/v2.1/servers/5709d363-0934-4d14-a734-35a54bdc03d0 => generated 1474 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:12.924912 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d5761dd3-bdd2-4334-9d68-71bb75ff8ee5 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '.version_select at 0x7f5ae92bbaf0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:12.927288 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-aaa18e19-28ba-41c2-b218-110e9a1631a6 tempest-ImagesMetadataTestJSON-1089699170 tempest-ImagesMetadataTestJSON-1089699170-project] Calling method '.version_select at 0x7f5ae83719d0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:13.106980 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d5761dd3-bdd2-4334-9d68-71bb75ff8ee5 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4368 microversion: 2.1 time: 0.212638 Aug 31 16:08:13.107651 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1453/2875] 10.222.0.61 () {58 vars in 1170 bytes} [Wed Aug 31 16:08:12 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4368 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:13.118845 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-500ea8e0-8da6-4e1b-ba87-5117baff3ba3 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:13.118845 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-500ea8e0-8da6-4e1b-ba87-5117baff3ba3 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 8f165110-0ea6-48c0-8357-ba419171f7af] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:13.137379 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-500ea8e0-8da6-4e1b-ba87-5117baff3ba3 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:13.137894 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-500ea8e0-8da6-4e1b-ba87-5117baff3ba3 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:13.138337 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-500ea8e0-8da6-4e1b-ba87-5117baff3ba3 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:13.139067 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-500ea8e0-8da6-4e1b-ba87-5117baff3ba3 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:13.140236 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-500ea8e0-8da6-4e1b-ba87-5117baff3ba3 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:13.140665 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-500ea8e0-8da6-4e1b-ba87-5117baff3ba3 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:13.212242 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-500ea8e0-8da6-4e1b-ba87-5117baff3ba3 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:13.213959 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-500ea8e0-8da6-4e1b-ba87-5117baff3ba3 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:13.214798 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-500ea8e0-8da6-4e1b-ba87-5117baff3ba3 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:13.215769 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-500ea8e0-8da6-4e1b-ba87-5117baff3ba3 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lazy-loading 'fault' on Instance uuid 8f165110-0ea6-48c0-8357-ba419171f7af {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:08:13.392057 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-500ea8e0-8da6-4e1b-ba87-5117baff3ba3 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:13.400543 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-500ea8e0-8da6-4e1b-ba87-5117baff3ba3 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/8f165110-0ea6-48c0-8357-ba419171f7af" status: 200 len: 1302 microversion: 2.1 time: 0.289734 Aug 31 16:08:13.404574 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1454/2876] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:13 2022] GET /compute/v2.1/servers/8f165110-0ea6-48c0-8357-ba419171f7af => generated 1302 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:13.411337 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a9dab539-de83-4112-a877-0ff35f1f1548 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] Calling method '.version_select at 0x7f5ae9326310>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:13.449441 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-aaa18e19-28ba-41c2-b218-110e9a1631a6 tempest-ImagesMetadataTestJSON-1089699170 tempest-ImagesMetadataTestJSON-1089699170-project] 10.222.0.61 "DELETE /compute/v2.1/images/de39420f-2805-45ff-b83c-cabc5422f621/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.527914 Aug 31 16:08:13.451094 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1423/2877] 10.222.0.61 () {58 vars in 1296 bytes} [Wed Aug 31 16:08:12 2022] DELETE /compute/v2.1/images/de39420f-2805-45ff-b83c-cabc5422f621/metadata/os_version => generated 0 bytes in 530 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:08:13.456871 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9515f3af-febf-40e7-94ef-02ec5cbe44af tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '.version_select at 0x7f5ae84a2af0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:13.482654 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a9dab539-de83-4112-a877-0ff35f1f1548 tempest-ServersTestJSON-1491808426 tempest-ServersTestJSON-1491808426-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1523735894" status: 202 len: 0 microversion: 2.1 time: 0.076242 Aug 31 16:08:13.483573 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1455/2878] 10.222.0.61 () {58 vars in 1221 bytes} [Wed Aug 31 16:08:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1523735894 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:08:13.491741 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3c99d62e-da0d-4d1a-a7d0-4395e22c8ce1 tempest-ImagesMetadataTestJSON-1089699170 tempest-ImagesMetadataTestJSON-1089699170-project] Calling method '.version_select at 0x7f5ae9357280>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:13.559886 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9515f3af-febf-40e7-94ef-02ec5cbe44af tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "GET /compute/v2.1/images/b9c36d42-ed46-4bf5-ad18-1df45cbd0413" status: 200 len: 784 microversion: 2.1 time: 0.107323 Aug 31 16:08:13.571003 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1424/2879] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:08:13 2022] GET /compute/v2.1/images/b9c36d42-ed46-4bf5-ad18-1df45cbd0413 => generated 784 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:08:13.580740 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-35ed07e7-f627-41a1-adb3-25ceed5a99e9 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '.version_select at 0x7f5ae84d7ca0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:13.593184 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3c99d62e-da0d-4d1a-a7d0-4395e22c8ce1 tempest-ImagesMetadataTestJSON-1089699170 tempest-ImagesMetadataTestJSON-1089699170-project] 10.222.0.61 "GET /compute/v2.1/images/de39420f-2805-45ff-b83c-cabc5422f621/metadata" status: 200 len: 37 microversion: 2.1 time: 0.096037 Aug 31 16:08:13.594376 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1456/2880] 10.222.0.61 () {58 vars in 1260 bytes} [Wed Aug 31 16:08:13 2022] GET /compute/v2.1/images/de39420f-2805-45ff-b83c-cabc5422f621/metadata => generated 37 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 16:08:13.614476 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-40e6f2cb-d39c-45ad-ab0f-cb64294ac422 tempest-ImagesMetadataTestJSON-1089699170 tempest-ImagesMetadataTestJSON-1089699170-project] Action: 'update_all', calling method: .version_select at 0x7f5ae93c53a0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:08:13.706134 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-35ed07e7-f627-41a1-adb3-25ceed5a99e9 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1609 microversion: 2.1 time: 0.132588 Aug 31 16:08:13.712040 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1425/2881] 10.222.0.61 () {58 vars in 1158 bytes} [Wed Aug 31 16:08:13 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1609 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:13.738499 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-69d1ef67-835d-4532-836e-b756535ffa7c tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '.version_select at 0x7f5ae84d7a60>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:13.768388 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-40e6f2cb-d39c-45ad-ab0f-cb64294ac422 tempest-ImagesMetadataTestJSON-1089699170 tempest-ImagesMetadataTestJSON-1089699170-project] Getting quotas for project 7e64d9d4b9674febb32169ec4ec6b40f. Resources: dict_keys(['metadata_items']) {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:08:13.779521 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-40e6f2cb-d39c-45ad-ab0f-cb64294ac422 tempest-ImagesMetadataTestJSON-1089699170 tempest-ImagesMetadataTestJSON-1089699170-project] Getting quotas for user 00fdafbbe22c4d5c8c1cc5b1bf88ae42 and project 7e64d9d4b9674febb32169ec4ec6b40f. Resources: dict_keys(['metadata_items']) {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:08:14.436133 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-40e6f2cb-d39c-45ad-ab0f-cb64294ac422 tempest-ImagesMetadataTestJSON-1089699170 tempest-ImagesMetadataTestJSON-1089699170-project] 10.222.0.61 "PUT /compute/v2.1/images/de39420f-2805-45ff-b83c-cabc5422f621/metadata" status: 200 len: 61 microversion: 2.1 time: 0.831013 Aug 31 16:08:14.437860 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1457/2882] 10.222.0.61 () {60 vars in 1280 bytes} [Wed Aug 31 16:08:13 2022] PUT /compute/v2.1/images/de39420f-2805-45ff-b83c-cabc5422f621/metadata => generated 61 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 31 16:08:14.443280 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8150fcdc-869c-4258-a395-6d5b16150216 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:14.456712 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8150fcdc-869c-4258-a395-6d5b16150216 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 0a5d6a47-ce38-4d1d-8d97-550f5e950af5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:14.474363 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8150fcdc-869c-4258-a395-6d5b16150216 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:14.475749 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8150fcdc-869c-4258-a395-6d5b16150216 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:14.479533 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8150fcdc-869c-4258-a395-6d5b16150216 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:14.483206 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8150fcdc-869c-4258-a395-6d5b16150216 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:14.484174 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8150fcdc-869c-4258-a395-6d5b16150216 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:14.485011 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8150fcdc-869c-4258-a395-6d5b16150216 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:14.602831 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-69d1ef67-835d-4532-836e-b756535ffa7c tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "DELETE /compute/v2.1/images/31a273f9-69d4-464b-8d35-a1a99ede5380" status: 204 len: 0 microversion: 2.1 time: 0.871047 Aug 31 16:08:14.603775 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1426/2883] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:13 2022] DELETE /compute/v2.1/images/31a273f9-69d4-464b-8d35-a1a99ede5380 => generated 0 bytes in 873 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:08:14.608935 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d84c28ac-632c-4d64-99d2-2d9ad72df845 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:14.609552 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d84c28ac-632c-4d64-99d2-2d9ad72df845 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] [instance: 5709d363-0934-4d14-a734-35a54bdc03d0] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:14.621316 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d84c28ac-632c-4d64-99d2-2d9ad72df845 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:14.622048 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d84c28ac-632c-4d64-99d2-2d9ad72df845 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:14.622817 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d84c28ac-632c-4d64-99d2-2d9ad72df845 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:14.624310 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d84c28ac-632c-4d64-99d2-2d9ad72df845 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:14.624792 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d84c28ac-632c-4d64-99d2-2d9ad72df845 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:14.625228 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d84c28ac-632c-4d64-99d2-2d9ad72df845 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:14.645290 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-d84c28ac-632c-4d64-99d2-2d9ad72df845 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] HTTP exception thrown: Instance 5709d363-0934-4d14-a734-35a54bdc03d0 could not be found. Aug 31 16:08:14.647334 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d84c28ac-632c-4d64-99d2-2d9ad72df845 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Request method failure captured: Aug 31 16:08:14.647334 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/5709d363-0934-4d14-a734-35a54bdc03d0 HTTP/1.1 Aug 31 16:08:14.647334 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:08:14.647334 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:08:14.647334 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:08:14.647334 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:08:14.647334 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:08:14.647334 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:08:14.647334 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:08:14.647334 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:08:14.647334 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4cQjW4RKqSiV5952upvIdfix-v8ArV-hdDrsMVQL2iqapdAKuJMVMBit-LQndqchCARhAtzgcWVEQP96bYgTLFYpSyAECAMkMrll5vcQzqANHbpTZgKZlP4yxj9CziN9j-8yIhUMwhBtpoBU1lVdOcoTDp-aBrSs_SMOJzLp_OYP8o Aug 31 16:08:14.647334 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:08:14.647334 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:08:14.647334 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:08:14.647334 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:08:14.647334 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:08:14.647334 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:08:14.647334 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: f79872256b2647d6a01c9e753b93b3c2 Aug 31 16:08:14.647334 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-LiveMigrationNegativeTest-1227032868 Aug 31 16:08:14.647334 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:08:14.647334 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:08:14.647334 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f79872256b2647d6a01c9e753b93b3c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f79872256b2647d6a01c9e753b93b3c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f79872256b2647d6a01c9e753b93b3c2", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f79872256b2647d6a01c9e753b93b3c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:08:14.647334 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-LiveMigrationNegativeTest-1227032868 Aug 31 16:08:14.647334 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: f79872256b2647d6a01c9e753b93b3c2 Aug 31 16:08:14.647334 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1227032868 Aug 31 16:08:14.647334 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-LiveMigrationNegativeTest-1227032868-project Aug 31 16:08:14.647334 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:08:14.647334 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:08:14.647334 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 4bb6a27e336449738f68a88d870ca6e2 Aug 31 16:08:14.647334 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-LiveMigrationNegativeTest-1227032868-project Aug 31 16:08:14.647334 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:08:14.647334 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance 5709d363-0934-4d14-a734-35a54bdc03d0 could not be found. Aug 31 16:08:14.647334 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '5709d363-0934-4d14-a734-35a54bdc03d0'} Aug 31 16:08:14.647334 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:08:14.647334 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:08:14.647334 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:08:14.647334 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:08:14.647334 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:08:14.647334 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:08:14.647334 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:08:14.647334 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:08:14.647334 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:08:14.647334 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:08:14.647334 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5709d363-0934-4d14-a734-35a54bdc03d0 could not be found. Aug 31 16:08:14.647334 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:08:14.647334 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:08:14.647334 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:08:14.647334 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:08:14.647334 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:08:14.647334 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:08:14.647334 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:08:14.647334 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:08:14.647334 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:08:14.647334 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:08:14.647334 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:08:14.647334 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:08:14.647334 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:08:14.647334 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:08:14.647334 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:08:14.647334 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:08:14.647334 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5709d363-0934-4d14-a734-35a54bdc03d0 could not be found. Aug 31 16:08:14.647334 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:08:14.647334 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:08:14.647334 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:08:14.650973 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:08:14.650973 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:08:14.650973 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:08:14.650973 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:08:14.650973 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:08:14.650973 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5709d363-0934-4d14-a734-35a54bdc03d0 could not be found. Aug 31 16:08:14.650973 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:08:14.653985 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d84c28ac-632c-4d64-99d2-2d9ad72df845 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] Returning 404 to user: Instance 5709d363-0934-4d14-a734-35a54bdc03d0 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:08:14.655414 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d84c28ac-632c-4d64-99d2-2d9ad72df845 tempest-LiveMigrationNegativeTest-1227032868 tempest-LiveMigrationNegativeTest-1227032868-project] 10.222.0.61 "GET /compute/v2.1/servers/5709d363-0934-4d14-a734-35a54bdc03d0" status: 404 len: 111 microversion: 2.1 time: 0.050605 Aug 31 16:08:14.656270 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1427/2884] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:14 2022] GET /compute/v2.1/servers/5709d363-0934-4d14-a734-35a54bdc03d0 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:08:14.661860 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b3f06c8e-18b7-4942-b1df-36966b2a1795 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:14.663244 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b3f06c8e-18b7-4942-b1df-36966b2a1795 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 8f165110-0ea6-48c0-8357-ba419171f7af] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:14.671235 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b3f06c8e-18b7-4942-b1df-36966b2a1795 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:14.672162 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b3f06c8e-18b7-4942-b1df-36966b2a1795 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:14.672831 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b3f06c8e-18b7-4942-b1df-36966b2a1795 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:14.673900 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b3f06c8e-18b7-4942-b1df-36966b2a1795 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:14.674594 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b3f06c8e-18b7-4942-b1df-36966b2a1795 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:14.675231 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b3f06c8e-18b7-4942-b1df-36966b2a1795 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:14.694448 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-b3f06c8e-18b7-4942-b1df-36966b2a1795 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] HTTP exception thrown: Instance 8f165110-0ea6-48c0-8357-ba419171f7af could not be found. Aug 31 16:08:14.698373 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b3f06c8e-18b7-4942-b1df-36966b2a1795 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Request method failure captured: Aug 31 16:08:14.698373 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/8f165110-0ea6-48c0-8357-ba419171f7af HTTP/1.1 Aug 31 16:08:14.698373 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:08:14.698373 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:08:14.698373 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:08:14.698373 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:08:14.698373 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:08:14.698373 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:08:14.698373 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:08:14.698373 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:08:14.698373 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4XCW8vlmi5ifUcmnrjxPNarpAxpfywGPf-yd0UXQDJn2VdmP64lnoSqfVFZOcHY2qwW0yLEixf1Z23Zt4Nnq_GfiTivZJ0pmJbIGzYCbyd170Z4KfuU55yKEE3eYeNWcxHNH6myZAsB0F1tRELNR62UNRY-BZzGiOmXdQUpaWONroQ Aug 31 16:08:14.698373 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:08:14.698373 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:08:14.698373 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:08:14.698373 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:08:14.698373 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:08:14.698373 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:08:14.698373 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 55ea476c41904e458bae79e7dad5d654 Aug 31 16:08:14.698373 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-MigrationsAdminTest-925549718 Aug 31 16:08:14.698373 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:08:14.698373 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:08:14.698373 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/55ea476c41904e458bae79e7dad5d654"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/55ea476c41904e458bae79e7dad5d654"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_55ea476c41904e458bae79e7dad5d654", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/55ea476c41904e458bae79e7dad5d654"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:08:14.698373 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-MigrationsAdminTest-925549718 Aug 31 16:08:14.698373 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 55ea476c41904e458bae79e7dad5d654 Aug 31 16:08:14.698373 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-MigrationsAdminTest-925549718 Aug 31 16:08:14.698373 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-MigrationsAdminTest-925549718-project Aug 31 16:08:14.698373 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:08:14.698373 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:08:14.698373 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 0a552442b7e94406b1689baf7a23fa52 Aug 31 16:08:14.698373 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-MigrationsAdminTest-925549718-project Aug 31 16:08:14.698373 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:08:14.698373 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance 8f165110-0ea6-48c0-8357-ba419171f7af could not be found. Aug 31 16:08:14.698373 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '8f165110-0ea6-48c0-8357-ba419171f7af'} Aug 31 16:08:14.698373 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:08:14.698373 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:08:14.698373 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:08:14.698373 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:08:14.698373 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:08:14.698373 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:08:14.698373 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:08:14.698373 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:08:14.698373 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:08:14.698373 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:08:14.698373 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f165110-0ea6-48c0-8357-ba419171f7af could not be found. Aug 31 16:08:14.698373 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:08:14.698373 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:08:14.698373 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:08:14.698373 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:08:14.698373 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:08:14.698373 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:08:14.698373 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:08:14.698373 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:08:14.698373 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:08:14.698373 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:08:14.698373 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:08:14.698373 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:08:14.698373 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:08:14.698373 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:08:14.698373 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:08:14.698373 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:08:14.698373 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f165110-0ea6-48c0-8357-ba419171f7af could not be found. Aug 31 16:08:14.698373 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:08:14.698373 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:08:14.698373 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:08:14.701977 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:08:14.701977 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:08:14.701977 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:08:14.701977 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:08:14.701977 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:08:14.701977 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f165110-0ea6-48c0-8357-ba419171f7af could not be found. Aug 31 16:08:14.701977 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:08:14.703550 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b3f06c8e-18b7-4942-b1df-36966b2a1795 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Returning 404 to user: Instance 8f165110-0ea6-48c0-8357-ba419171f7af could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:08:14.704587 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b3f06c8e-18b7-4942-b1df-36966b2a1795 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/8f165110-0ea6-48c0-8357-ba419171f7af" status: 404 len: 111 microversion: 2.1 time: 0.047015 Aug 31 16:08:14.705861 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1428/2885] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:14 2022] GET /compute/v2.1/servers/8f165110-0ea6-48c0-8357-ba419171f7af => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:08:14.713660 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0e2d8e1a-9901-4660-8479-b398e31fcbe7 tempest-ImagesMetadataTestJSON-1089699170 tempest-ImagesMetadataTestJSON-1089699170-project] Calling method '.version_select at 0x7f5ae82f8af0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:14.725486 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8150fcdc-869c-4258-a395-6d5b16150216 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:14.737459 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8150fcdc-869c-4258-a395-6d5b16150216 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/0a5d6a47-ce38-4d1d-8d97-550f5e950af5" status: 200 len: 1314 microversion: 2.1 time: 0.298321 Aug 31 16:08:14.738080 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1458/2886] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:14 2022] GET /compute/v2.1/servers/0a5d6a47-ce38-4d1d-8d97-550f5e950af5 => generated 1314 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:14.766901 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-791d8371-5636-4c4a-948a-4272722f088f tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '.version_select at 0x7f5ae94b40d0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:14.778721 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0e2d8e1a-9901-4660-8479-b398e31fcbe7 tempest-ImagesMetadataTestJSON-1089699170 tempest-ImagesMetadataTestJSON-1089699170-project] 10.222.0.61 "GET /compute/v2.1/images/de39420f-2805-45ff-b83c-cabc5422f621/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.071026 Aug 31 16:08:14.786948 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1429/2887] 10.222.0.61 () {58 vars in 1290 bytes} [Wed Aug 31 16:08:14 2022] GET /compute/v2.1/images/de39420f-2805-45ff-b83c-cabc5422f621/metadata/os_distro => generated 33 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 16:08:14.791785 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-870c5722-d6ce-4fa9-a4b9-cb3968ad30b2 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:14.792282 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-870c5722-d6ce-4fa9-a4b9-cb3968ad30b2 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: f9b66475-83f6-49a3-bc63-8965fc1aec14] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:14.801575 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-870c5722-d6ce-4fa9-a4b9-cb3968ad30b2 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:14.802392 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-870c5722-d6ce-4fa9-a4b9-cb3968ad30b2 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:14.803151 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-870c5722-d6ce-4fa9-a4b9-cb3968ad30b2 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:14.805197 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-870c5722-d6ce-4fa9-a4b9-cb3968ad30b2 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:14.806695 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-870c5722-d6ce-4fa9-a4b9-cb3968ad30b2 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:14.807881 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-870c5722-d6ce-4fa9-a4b9-cb3968ad30b2 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:14.846839 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-870c5722-d6ce-4fa9-a4b9-cb3968ad30b2 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: f9b66475-83f6-49a3-bc63-8965fc1aec14] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:08:15.006483 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-870c5722-d6ce-4fa9-a4b9-cb3968ad30b2 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "DELETE /compute/v2.1/servers/f9b66475-83f6-49a3-bc63-8965fc1aec14" status: 204 len: 0 microversion: 2.1 time: 0.222730 Aug 31 16:08:15.010296 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1430/2888] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:08:14 2022] DELETE /compute/v2.1/servers/f9b66475-83f6-49a3-bc63-8965fc1aec14 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:08:15.016492 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-fda87f8b-9e03-4548-a457-e31b66a50917 tempest-ImagesMetadataTestJSON-1089699170 tempest-ImagesMetadataTestJSON-1089699170-project] Action: 'update_all', calling method: .version_select at 0x7f5ae84a2940>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:08:15.130519 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-fda87f8b-9e03-4548-a457-e31b66a50917 tempest-ImagesMetadataTestJSON-1089699170 tempest-ImagesMetadataTestJSON-1089699170-project] Getting quotas for project 7e64d9d4b9674febb32169ec4ec6b40f. Resources: dict_keys(['metadata_items']) {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:08:15.148050 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-fda87f8b-9e03-4548-a457-e31b66a50917 tempest-ImagesMetadataTestJSON-1089699170 tempest-ImagesMetadataTestJSON-1089699170-project] Getting quotas for user 00fdafbbe22c4d5c8c1cc5b1bf88ae42 and project 7e64d9d4b9674febb32169ec4ec6b40f. Resources: dict_keys(['metadata_items']) {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:08:15.635820 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-fda87f8b-9e03-4548-a457-e31b66a50917 tempest-ImagesMetadataTestJSON-1089699170 tempest-ImagesMetadataTestJSON-1089699170-project] 10.222.0.61 "PUT /compute/v2.1/images/de39420f-2805-45ff-b83c-cabc5422f621/metadata" status: 200 len: 61 microversion: 2.1 time: 0.621253 Aug 31 16:08:15.635820 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1431/2889] 10.222.0.61 () {60 vars in 1280 bytes} [Wed Aug 31 16:08:15 2022] PUT /compute/v2.1/images/de39420f-2805-45ff-b83c-cabc5422f621/metadata => generated 61 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 16:08:15.639670 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-caa0dd42-5232-44a4-8f5c-0104b8ed68f9 req-b2399156-9e41-497f-ace3-e187c8b2ca2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a5d6a47-ce38-4d1d-8d97-550f5e950af5", "tag": "ebd19817-6484-40fc-bcca-5b49c8f8bbc4"}, {"server_uuid": "5709d363-0934-4d14-a734-35a54bdc03d0", "name": "network-vif-deleted", "tag": "a0a375b6-a9e9-4b0f-94cf-3a5beea5090c"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:08:15.657646 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-caa0dd42-5232-44a4-8f5c-0104b8ed68f9 req-b2399156-9e41-497f-ace3-e187c8b2ca2d service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:15.658878 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-caa0dd42-5232-44a4-8f5c-0104b8ed68f9 req-b2399156-9e41-497f-ace3-e187c8b2ca2d service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:15.664961 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-caa0dd42-5232-44a4-8f5c-0104b8ed68f9 req-b2399156-9e41-497f-ace3-e187c8b2ca2d service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:15.699664 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-caa0dd42-5232-44a4-8f5c-0104b8ed68f9 req-b2399156-9e41-497f-ace3-e187c8b2ca2d service nova] Creating event network-changed:ebd19817-6484-40fc-bcca-5b49c8f8bbc4 for instance 0a5d6a47-ce38-4d1d-8d97-550f5e950af5 on n-h1-850499-9 Aug 31 16:08:15.700524 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-caa0dd42-5232-44a4-8f5c-0104b8ed68f9 req-b2399156-9e41-497f-ace3-e187c8b2ca2d service nova] Creating event network-vif-deleted:a0a375b6-a9e9-4b0f-94cf-3a5beea5090c for instance 5709d363-0934-4d14-a734-35a54bdc03d0 on n-h2-850499-9 Aug 31 16:08:15.719227 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-caa0dd42-5232-44a4-8f5c-0104b8ed68f9 req-b2399156-9e41-497f-ace3-e187c8b2ca2d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.085283 Aug 31 16:08:15.720326 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1432/2890] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:08:15 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:08:15.729852 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f9d9a456-3514-40e6-b273-cdec30c316ce tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:15.731013 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f9d9a456-3514-40e6-b273-cdec30c316ce tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: f9b66475-83f6-49a3-bc63-8965fc1aec14] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:15.742678 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f9d9a456-3514-40e6-b273-cdec30c316ce tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:15.743260 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f9d9a456-3514-40e6-b273-cdec30c316ce tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:15.744842 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f9d9a456-3514-40e6-b273-cdec30c316ce tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:15.746082 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f9d9a456-3514-40e6-b273-cdec30c316ce tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:15.746996 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f9d9a456-3514-40e6-b273-cdec30c316ce tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:15.748942 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f9d9a456-3514-40e6-b273-cdec30c316ce tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:15.885878 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-791d8371-5636-4c4a-948a-4272722f088f tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "DELETE /compute/v2.1/images/03df45dd-ab3d-44b8-97f9-0f9148109666" status: 204 len: 0 microversion: 2.1 time: 1.129128 Aug 31 16:08:15.891846 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1459/2891] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:14 2022] DELETE /compute/v2.1/images/03df45dd-ab3d-44b8-97f9-0f9148109666 => generated 0 bytes in 1148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:08:15.894708 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-37b2652d-ef67-4437-b6ac-5d0e3f02ca85 tempest-ImagesMetadataTestJSON-1089699170 tempest-ImagesMetadataTestJSON-1089699170-project] Calling method '.version_select at 0x7f5ae9393d30>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:15.981350 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-37b2652d-ef67-4437-b6ac-5d0e3f02ca85 tempest-ImagesMetadataTestJSON-1089699170 tempest-ImagesMetadataTestJSON-1089699170-project] 10.222.0.61 "GET /compute/v2.1/images/de39420f-2805-45ff-b83c-cabc5422f621/metadata" status: 200 len: 61 microversion: 2.1 time: 0.092142 Aug 31 16:08:15.982156 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1460/2892] 10.222.0.61 () {58 vars in 1260 bytes} [Wed Aug 31 16:08:15 2022] GET /compute/v2.1/images/de39420f-2805-45ff-b83c-cabc5422f621/metadata => generated 61 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 16:08:15.992310 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e3e662d2-8eaa-4b43-a81a-97258c18e86e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:15.995571 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e3e662d2-8eaa-4b43-a81a-97258c18e86e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 0a5d6a47-ce38-4d1d-8d97-550f5e950af5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:16.006548 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e3e662d2-8eaa-4b43-a81a-97258c18e86e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:16.007795 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e3e662d2-8eaa-4b43-a81a-97258c18e86e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:16.008560 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e3e662d2-8eaa-4b43-a81a-97258c18e86e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:16.009796 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e3e662d2-8eaa-4b43-a81a-97258c18e86e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:16.011024 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e3e662d2-8eaa-4b43-a81a-97258c18e86e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:16.011781 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e3e662d2-8eaa-4b43-a81a-97258c18e86e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:16.105540 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f9d9a456-3514-40e6-b273-cdec30c316ce tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:16.121175 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f9d9a456-3514-40e6-b273-cdec30c316ce tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/f9b66475-83f6-49a3-bc63-8965fc1aec14" status: 200 len: 1533 microversion: 2.1 time: 0.398963 Aug 31 16:08:16.122626 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1433/2893] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:15 2022] GET /compute/v2.1/servers/f9b66475-83f6-49a3-bc63-8965fc1aec14 => generated 1533 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:16.128798 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-40de4493-b78d-49b2-a7ff-282fe80e3144 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '.version_select at 0x7f5ae8475ee0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:16.873704 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e3e662d2-8eaa-4b43-a81a-97258c18e86e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:16.892541 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e3e662d2-8eaa-4b43-a81a-97258c18e86e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/0a5d6a47-ce38-4d1d-8d97-550f5e950af5" status: 200 len: 1314 microversion: 2.1 time: 0.908108 Aug 31 16:08:16.906152 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1461/2894] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:15 2022] GET /compute/v2.1/servers/0a5d6a47-ce38-4d1d-8d97-550f5e950af5 => generated 1314 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:16.910816 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-cefa5e6e-f658-438e-836c-57ef0b210fd1 tempest-ImagesMetadataTestJSON-1089699170 tempest-ImagesMetadataTestJSON-1089699170-project] Action: 'update_all', calling method: .version_select at 0x7f5ae937a040>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:08:17.095703 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-cefa5e6e-f658-438e-836c-57ef0b210fd1 tempest-ImagesMetadataTestJSON-1089699170 tempest-ImagesMetadataTestJSON-1089699170-project] Getting quotas for project 7e64d9d4b9674febb32169ec4ec6b40f. Resources: dict_keys(['metadata_items']) {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:08:17.109024 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-cefa5e6e-f658-438e-836c-57ef0b210fd1 tempest-ImagesMetadataTestJSON-1089699170 tempest-ImagesMetadataTestJSON-1089699170-project] Getting quotas for user 00fdafbbe22c4d5c8c1cc5b1bf88ae42 and project 7e64d9d4b9674febb32169ec4ec6b40f. Resources: dict_keys(['metadata_items']) {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:08:17.476742 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-cefa5e6e-f658-438e-836c-57ef0b210fd1 tempest-ImagesMetadataTestJSON-1089699170 tempest-ImagesMetadataTestJSON-1089699170-project] 10.222.0.61 "PUT /compute/v2.1/images/de39420f-2805-45ff-b83c-cabc5422f621/metadata" status: 200 len: 61 microversion: 2.1 time: 0.582334 Aug 31 16:08:17.477326 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1462/2895] 10.222.0.61 () {60 vars in 1280 bytes} [Wed Aug 31 16:08:16 2022] PUT /compute/v2.1/images/de39420f-2805-45ff-b83c-cabc5422f621/metadata => generated 61 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 16:08:17.488428 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5371f2cf-a928-46e2-9898-a3587bea1550 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:17.489339 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5371f2cf-a928-46e2-9898-a3587bea1550 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: f9b66475-83f6-49a3-bc63-8965fc1aec14] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:17.504460 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5371f2cf-a928-46e2-9898-a3587bea1550 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:17.508529 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5371f2cf-a928-46e2-9898-a3587bea1550 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:17.511695 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5371f2cf-a928-46e2-9898-a3587bea1550 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:17.514837 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5371f2cf-a928-46e2-9898-a3587bea1550 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:17.516084 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5371f2cf-a928-46e2-9898-a3587bea1550 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:17.517027 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5371f2cf-a928-46e2-9898-a3587bea1550 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:17.812577 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-40de4493-b78d-49b2-a7ff-282fe80e3144 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "DELETE /compute/v2.1/images/f8c63da2-efca-43a3-a8dd-7f0b9e1fcefc" status: 204 len: 0 microversion: 2.1 time: 1.688268 Aug 31 16:08:17.815587 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1434/2896] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:16 2022] DELETE /compute/v2.1/images/f8c63da2-efca-43a3-a8dd-7f0b9e1fcefc => generated 0 bytes in 1692 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:08:17.822170 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a912f4e0-d42f-4d3d-8b91-f1e5e3f598ec tempest-ImagesMetadataTestJSON-1089699170 tempest-ImagesMetadataTestJSON-1089699170-project] Action: 'update_all', calling method: .version_select at 0x7f5ae8371a60>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:08:17.976920 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-a912f4e0-d42f-4d3d-8b91-f1e5e3f598ec tempest-ImagesMetadataTestJSON-1089699170 tempest-ImagesMetadataTestJSON-1089699170-project] Getting quotas for project 7e64d9d4b9674febb32169ec4ec6b40f. Resources: dict_keys(['metadata_items']) {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:08:17.981963 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-a912f4e0-d42f-4d3d-8b91-f1e5e3f598ec tempest-ImagesMetadataTestJSON-1089699170 tempest-ImagesMetadataTestJSON-1089699170-project] Getting quotas for user 00fdafbbe22c4d5c8c1cc5b1bf88ae42 and project 7e64d9d4b9674febb32169ec4ec6b40f. Resources: dict_keys(['metadata_items']) {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:08:18.157414 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5371f2cf-a928-46e2-9898-a3587bea1550 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:18.172992 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5371f2cf-a928-46e2-9898-a3587bea1550 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/f9b66475-83f6-49a3-bc63-8965fc1aec14" status: 200 len: 1533 microversion: 2.1 time: 0.688201 Aug 31 16:08:18.176679 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1463/2897] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:17 2022] GET /compute/v2.1/servers/f9b66475-83f6-49a3-bc63-8965fc1aec14 => generated 1533 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:18.191220 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2c9c1636-31a5-4548-bf52-b4ea2cdb038f tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:18.191220 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2c9c1636-31a5-4548-bf52-b4ea2cdb038f tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] [instance: 560a01e5-93f8-46c8-9261-5030e28766b4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:18.201851 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2c9c1636-31a5-4548-bf52-b4ea2cdb038f tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:18.204612 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2c9c1636-31a5-4548-bf52-b4ea2cdb038f tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:18.204612 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2c9c1636-31a5-4548-bf52-b4ea2cdb038f tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:18.204612 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2c9c1636-31a5-4548-bf52-b4ea2cdb038f tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:18.204612 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2c9c1636-31a5-4548-bf52-b4ea2cdb038f tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:18.204612 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2c9c1636-31a5-4548-bf52-b4ea2cdb038f tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:18.281394 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2c9c1636-31a5-4548-bf52-b4ea2cdb038f tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] [instance: 560a01e5-93f8-46c8-9261-5030e28766b4] Going to try to terminate instance {{(pid=122256) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:08:18.302114 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:08:18.497711 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2c9c1636-31a5-4548-bf52-b4ea2cdb038f tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "DELETE /compute/v2.1/servers/560a01e5-93f8-46c8-9261-5030e28766b4" status: 204 len: 0 microversion: 2.1 time: 0.317976 Aug 31 16:08:18.500375 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1464/2898] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:08:18 2022] DELETE /compute/v2.1/servers/560a01e5-93f8-46c8-9261-5030e28766b4 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:08:18.512390 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b5f89f94-fddf-4203-bae8-3ffa11c117c7 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:18.514956 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b5f89f94-fddf-4203-bae8-3ffa11c117c7 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 0a5d6a47-ce38-4d1d-8d97-550f5e950af5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:18.532732 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b5f89f94-fddf-4203-bae8-3ffa11c117c7 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:18.535131 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b5f89f94-fddf-4203-bae8-3ffa11c117c7 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:18.539949 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b5f89f94-fddf-4203-bae8-3ffa11c117c7 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:18.543428 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b5f89f94-fddf-4203-bae8-3ffa11c117c7 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:18.545216 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b5f89f94-fddf-4203-bae8-3ffa11c117c7 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:18.547831 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b5f89f94-fddf-4203-bae8-3ffa11c117c7 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:18.807007 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a912f4e0-d42f-4d3d-8b91-f1e5e3f598ec tempest-ImagesMetadataTestJSON-1089699170 tempest-ImagesMetadataTestJSON-1089699170-project] 10.222.0.61 "PUT /compute/v2.1/images/de39420f-2805-45ff-b83c-cabc5422f621/metadata" status: 200 len: 64 microversion: 2.1 time: 0.989202 Aug 31 16:08:18.808592 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1435/2899] 10.222.0.61 () {60 vars in 1280 bytes} [Wed Aug 31 16:08:17 2022] PUT /compute/v2.1/images/de39420f-2805-45ff-b83c-cabc5422f621/metadata => generated 64 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 16:08:18.822778 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-77219b51-780f-4209-b431-f1db7d4e19e4 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:18.824501 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-77219b51-780f-4209-b431-f1db7d4e19e4 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] [instance: 560a01e5-93f8-46c8-9261-5030e28766b4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:18.834319 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-77219b51-780f-4209-b431-f1db7d4e19e4 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:18.836288 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-77219b51-780f-4209-b431-f1db7d4e19e4 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:18.837288 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-77219b51-780f-4209-b431-f1db7d4e19e4 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:18.838727 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-77219b51-780f-4209-b431-f1db7d4e19e4 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:18.839448 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-77219b51-780f-4209-b431-f1db7d4e19e4 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:18.840387 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-77219b51-780f-4209-b431-f1db7d4e19e4 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:19.744249 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b5f89f94-fddf-4203-bae8-3ffa11c117c7 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:19.753482 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b5f89f94-fddf-4203-bae8-3ffa11c117c7 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/0a5d6a47-ce38-4d1d-8d97-550f5e950af5" status: 200 len: 1314 microversion: 2.1 time: 1.250832 Aug 31 16:08:19.754220 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1465/2900] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:18 2022] GET /compute/v2.1/servers/0a5d6a47-ce38-4d1d-8d97-550f5e950af5 => generated 1314 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:19.771917 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3a4918bc-17d0-4e03-b5a1-cd9c4dc34a8b tempest-ImagesMetadataTestJSON-1089699170 tempest-ImagesMetadataTestJSON-1089699170-project] Calling method '.version_select at 0x7f5ae8ed1040>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:19.842120 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3a4918bc-17d0-4e03-b5a1-cd9c4dc34a8b tempest-ImagesMetadataTestJSON-1089699170 tempest-ImagesMetadataTestJSON-1089699170-project] 10.222.0.61 "GET /compute/v2.1/images/de39420f-2805-45ff-b83c-cabc5422f621/metadata" status: 200 len: 64 microversion: 2.1 time: 0.085734 Aug 31 16:08:19.843115 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1466/2901] 10.222.0.61 () {58 vars in 1260 bytes} [Wed Aug 31 16:08:19 2022] GET /compute/v2.1/images/de39420f-2805-45ff-b83c-cabc5422f621/metadata => generated 64 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 16:08:19.849857 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-24c19c44-63d0-470a-b0d7-f76c3637f592 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:19.850715 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-24c19c44-63d0-470a-b0d7-f76c3637f592 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: f9b66475-83f6-49a3-bc63-8965fc1aec14] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:19.870506 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-24c19c44-63d0-470a-b0d7-f76c3637f592 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:19.871398 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-24c19c44-63d0-470a-b0d7-f76c3637f592 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:19.872224 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-24c19c44-63d0-470a-b0d7-f76c3637f592 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:19.874184 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-24c19c44-63d0-470a-b0d7-f76c3637f592 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:19.875155 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-24c19c44-63d0-470a-b0d7-f76c3637f592 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:19.876046 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-24c19c44-63d0-470a-b0d7-f76c3637f592 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:19.993249 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-77219b51-780f-4209-b431-f1db7d4e19e4 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f0b27a48fd41dd846ba60856349ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4efd94380dcf4b3cb7a2b9fa194fcb83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:20.013991 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-77219b51-780f-4209-b431-f1db7d4e19e4 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "GET /compute/v2.1/servers/560a01e5-93f8-46c8-9261-5030e28766b4" status: 200 len: 1473 microversion: 2.1 time: 1.197156 Aug 31 16:08:20.016241 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1436/2902] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:18 2022] GET /compute/v2.1/servers/560a01e5-93f8-46c8-9261-5030e28766b4 => generated 1473 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:20.022976 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-dd002899-920e-44b0-960f-8dba98be717d tempest-ImagesMetadataTestJSON-1089699170 tempest-ImagesMetadataTestJSON-1089699170-project] Action: 'update_all', calling method: .version_select at 0x7f5ae84d7e50>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:08:20.117283 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-dd002899-920e-44b0-960f-8dba98be717d tempest-ImagesMetadataTestJSON-1089699170 tempest-ImagesMetadataTestJSON-1089699170-project] Getting quotas for project 7e64d9d4b9674febb32169ec4ec6b40f. Resources: dict_keys(['metadata_items']) {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:08:20.125721 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-dd002899-920e-44b0-960f-8dba98be717d tempest-ImagesMetadataTestJSON-1089699170 tempest-ImagesMetadataTestJSON-1089699170-project] Getting quotas for user 00fdafbbe22c4d5c8c1cc5b1bf88ae42 and project 7e64d9d4b9674febb32169ec4ec6b40f. Resources: dict_keys(['metadata_items']) {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:08:20.678904 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-24c19c44-63d0-470a-b0d7-f76c3637f592 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:20.687541 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-dd002899-920e-44b0-960f-8dba98be717d tempest-ImagesMetadataTestJSON-1089699170 tempest-ImagesMetadataTestJSON-1089699170-project] 10.222.0.61 "PUT /compute/v2.1/images/de39420f-2805-45ff-b83c-cabc5422f621/metadata" status: 200 len: 61 microversion: 2.1 time: 0.669464 Aug 31 16:08:20.695331 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1437/2903] 10.222.0.61 () {60 vars in 1280 bytes} [Wed Aug 31 16:08:20 2022] PUT /compute/v2.1/images/de39420f-2805-45ff-b83c-cabc5422f621/metadata => generated 61 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 16:08:20.698706 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-24c19c44-63d0-470a-b0d7-f76c3637f592 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/f9b66475-83f6-49a3-bc63-8965fc1aec14" status: 200 len: 1533 microversion: 2.1 time: 0.854246 Aug 31 16:08:20.699680 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1467/2904] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:19 2022] GET /compute/v2.1/servers/f9b66475-83f6-49a3-bc63-8965fc1aec14 => generated 1533 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:20.726006 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f5a2696b-44b5-43d1-9a58-fd08539d0c39 tempest-ImagesMetadataTestJSON-1089699170 tempest-ImagesMetadataTestJSON-1089699170-project] Action: 'update', calling method: .version_select at 0x7f5ae8fea3a0>, body: {"meta": {"os_version": "alt"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:08:20.847397 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-f5a2696b-44b5-43d1-9a58-fd08539d0c39 tempest-ImagesMetadataTestJSON-1089699170 tempest-ImagesMetadataTestJSON-1089699170-project] Getting quotas for project 7e64d9d4b9674febb32169ec4ec6b40f. Resources: dict_keys(['metadata_items']) {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:08:20.856353 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-f5a2696b-44b5-43d1-9a58-fd08539d0c39 tempest-ImagesMetadataTestJSON-1089699170 tempest-ImagesMetadataTestJSON-1089699170-project] Getting quotas for user 00fdafbbe22c4d5c8c1cc5b1bf88ae42 and project 7e64d9d4b9674febb32169ec4ec6b40f. Resources: dict_keys(['metadata_items']) {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:08:21.237407 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-53b8ddc5-d171-4fe4-a2e5-6cbd335866a4 tempest-SecurityGroupsTestAdminJSON-594959433 tempest-SecurityGroupsTestAdminJSON-594959433-project] Action: 'create', calling method: .version_select at 0x7f5ae84e6790>, body: {"security_group": {"name": "tempest-securitygroup-1463736062", "description": "tempest-description-1106717608"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:08:21.546457 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f5a2696b-44b5-43d1-9a58-fd08539d0c39 tempest-ImagesMetadataTestJSON-1089699170 tempest-ImagesMetadataTestJSON-1089699170-project] 10.222.0.61 "PUT /compute/v2.1/images/de39420f-2805-45ff-b83c-cabc5422f621/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.845428 Aug 31 16:08:21.553585 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1468/2905] 10.222.0.61 () {60 vars in 1313 bytes} [Wed Aug 31 16:08:20 2022] PUT /compute/v2.1/images/de39420f-2805-45ff-b83c-cabc5422f621/metadata/os_version => generated 31 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 16:08:21.562158 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-8b8c8490-ba45-4a16-bad4-a38d51360176 req-5413722f-1a9a-4475-864f-2b8a28a24921 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9b66475-83f6-49a3-bc63-8965fc1aec14", "name": "network-vif-deleted", "tag": "c1929c28-a0f2-4fed-aba4-ecfd08ac8e7e"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:08:21.577942 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-8b8c8490-ba45-4a16-bad4-a38d51360176 req-5413722f-1a9a-4475-864f-2b8a28a24921 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:21.579065 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-8b8c8490-ba45-4a16-bad4-a38d51360176 req-5413722f-1a9a-4475-864f-2b8a28a24921 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:21.580411 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-8b8c8490-ba45-4a16-bad4-a38d51360176 req-5413722f-1a9a-4475-864f-2b8a28a24921 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:21.600286 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-8b8c8490-ba45-4a16-bad4-a38d51360176 req-5413722f-1a9a-4475-864f-2b8a28a24921 service nova] Creating event network-vif-deleted:c1929c28-a0f2-4fed-aba4-ecfd08ac8e7e for instance f9b66475-83f6-49a3-bc63-8965fc1aec14 on n-h2-850499-9 Aug 31 16:08:21.614325 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-8b8c8490-ba45-4a16-bad4-a38d51360176 req-5413722f-1a9a-4475-864f-2b8a28a24921 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060037 Aug 31 16:08:21.617016 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1469/2906] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:08:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:08:21.629957 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-01d39680-1b38-40b6-8c5e-4d91cb86f021 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:21.632377 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-01d39680-1b38-40b6-8c5e-4d91cb86f021 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 0a5d6a47-ce38-4d1d-8d97-550f5e950af5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:21.649243 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-01d39680-1b38-40b6-8c5e-4d91cb86f021 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:21.651061 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-01d39680-1b38-40b6-8c5e-4d91cb86f021 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:21.652384 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-01d39680-1b38-40b6-8c5e-4d91cb86f021 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:21.656881 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-01d39680-1b38-40b6-8c5e-4d91cb86f021 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:21.657981 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-01d39680-1b38-40b6-8c5e-4d91cb86f021 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:21.659040 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-01d39680-1b38-40b6-8c5e-4d91cb86f021 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:22.420651 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-01d39680-1b38-40b6-8c5e-4d91cb86f021 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:22.429070 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-01d39680-1b38-40b6-8c5e-4d91cb86f021 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/0a5d6a47-ce38-4d1d-8d97-550f5e950af5" status: 200 len: 1314 microversion: 2.1 time: 0.809440 Aug 31 16:08:22.429871 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1470/2907] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:21 2022] GET /compute/v2.1/servers/0a5d6a47-ce38-4d1d-8d97-550f5e950af5 => generated 1314 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:22.435912 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5e6f0112-c9f2-4748-a9d8-ad67f2e0987a tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:22.436481 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5e6f0112-c9f2-4748-a9d8-ad67f2e0987a tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] [instance: 560a01e5-93f8-46c8-9261-5030e28766b4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:22.450386 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5e6f0112-c9f2-4748-a9d8-ad67f2e0987a tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:22.456849 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5e6f0112-c9f2-4748-a9d8-ad67f2e0987a tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:22.457781 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5e6f0112-c9f2-4748-a9d8-ad67f2e0987a tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:22.458828 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5e6f0112-c9f2-4748-a9d8-ad67f2e0987a tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:22.459594 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5e6f0112-c9f2-4748-a9d8-ad67f2e0987a tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:22.464183 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5e6f0112-c9f2-4748-a9d8-ad67f2e0987a tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:23.380558 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-53b8ddc5-d171-4fe4-a2e5-6cbd335866a4 tempest-SecurityGroupsTestAdminJSON-594959433 tempest-SecurityGroupsTestAdminJSON-594959433-project] 10.222.0.61 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 2.689579 Aug 31 16:08:23.382169 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1438/2908] 10.222.0.61 () {60 vars in 1180 bytes} [Wed Aug 31 16:08:20 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 2692 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:08:23.395457 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c32f40bf-4c07-4900-85b6-f71b4b98f231 tempest-ImagesMetadataTestJSON-1089699170 tempest-ImagesMetadataTestJSON-1089699170-project] Calling method '.version_select at 0x7f5ae84d7ca0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:23.421915 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5e6f0112-c9f2-4748-a9d8-ad67f2e0987a tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f0b27a48fd41dd846ba60856349ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4efd94380dcf4b3cb7a2b9fa194fcb83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:23.473937 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5e6f0112-c9f2-4748-a9d8-ad67f2e0987a tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "GET /compute/v2.1/servers/560a01e5-93f8-46c8-9261-5030e28766b4" status: 200 len: 1473 microversion: 2.1 time: 1.042738 Aug 31 16:08:23.474452 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1471/2909] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:22 2022] GET /compute/v2.1/servers/560a01e5-93f8-46c8-9261-5030e28766b4 => generated 1473 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:23.493042 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-47c11c70-f4ae-4c8f-b94c-bbade4a5f714 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:23.494285 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-47c11c70-f4ae-4c8f-b94c-bbade4a5f714 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: f9b66475-83f6-49a3-bc63-8965fc1aec14] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:23.523726 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c32f40bf-4c07-4900-85b6-f71b4b98f231 tempest-ImagesMetadataTestJSON-1089699170 tempest-ImagesMetadataTestJSON-1089699170-project] 10.222.0.61 "GET /compute/v2.1/images/de39420f-2805-45ff-b83c-cabc5422f621/metadata" status: 200 len: 58 microversion: 2.1 time: 0.139364 Aug 31 16:08:23.527656 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1439/2910] 10.222.0.61 () {58 vars in 1260 bytes} [Wed Aug 31 16:08:23 2022] GET /compute/v2.1/images/de39420f-2805-45ff-b83c-cabc5422f621/metadata => generated 58 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 16:08:23.533061 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-47c11c70-f4ae-4c8f-b94c-bbade4a5f714 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:23.535886 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-47c11c70-f4ae-4c8f-b94c-bbade4a5f714 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:23.537668 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-47c11c70-f4ae-4c8f-b94c-bbade4a5f714 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:23.541702 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-b9432c19-34f3-4369-8f0d-cbf945a4873f req-652e7b9a-109a-4585-94e3-f1e4b8e1e423 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a5d6a47-ce38-4d1d-8d97-550f5e950af5", "name": "network-vif-plugged", "status": "completed", "tag": "ebd19817-6484-40fc-bcca-5b49c8f8bbc4"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:08:23.542446 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-47c11c70-f4ae-4c8f-b94c-bbade4a5f714 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:23.543079 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-47c11c70-f4ae-4c8f-b94c-bbade4a5f714 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:23.543633 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-47c11c70-f4ae-4c8f-b94c-bbade4a5f714 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:23.575219 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-b9432c19-34f3-4369-8f0d-cbf945a4873f req-652e7b9a-109a-4585-94e3-f1e4b8e1e423 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:23.578551 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-b9432c19-34f3-4369-8f0d-cbf945a4873f req-652e7b9a-109a-4585-94e3-f1e4b8e1e423 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:23.579413 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-b9432c19-34f3-4369-8f0d-cbf945a4873f req-652e7b9a-109a-4585-94e3-f1e4b8e1e423 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:23.588870 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-47c11c70-f4ae-4c8f-b94c-bbade4a5f714 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] HTTP exception thrown: Instance f9b66475-83f6-49a3-bc63-8965fc1aec14 could not be found. Aug 31 16:08:23.594736 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-47c11c70-f4ae-4c8f-b94c-bbade4a5f714 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Request method failure captured: Aug 31 16:08:23.594736 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/f9b66475-83f6-49a3-bc63-8965fc1aec14 HTTP/1.1 Aug 31 16:08:23.594736 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:08:23.594736 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:08:23.594736 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:08:23.594736 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:08:23.594736 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:08:23.594736 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:08:23.594736 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:08:23.594736 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:08:23.594736 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4XCW8vlmi5ifUcmnrjxPNarpAxpfywGPf-yd0UXQDJn2VdmP64lnoSqfVFZOcHY2qwW0yLEixf1Z23Zt4Nnq_GfiTivZJ0pmJbIGzYCbyd170Z4KfuU55yKEE3eYeNWcxHNH6myZAsB0F1tRELNR62UNRY-BZzGiOmXdQUpaWONroQ Aug 31 16:08:23.594736 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:08:23.594736 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:08:23.594736 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:08:23.594736 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:08:23.594736 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:08:23.594736 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:08:23.594736 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 55ea476c41904e458bae79e7dad5d654 Aug 31 16:08:23.594736 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-MigrationsAdminTest-925549718 Aug 31 16:08:23.594736 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:08:23.594736 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:08:23.594736 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/55ea476c41904e458bae79e7dad5d654"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/55ea476c41904e458bae79e7dad5d654"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_55ea476c41904e458bae79e7dad5d654", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/55ea476c41904e458bae79e7dad5d654"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:08:23.594736 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-MigrationsAdminTest-925549718 Aug 31 16:08:23.594736 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 55ea476c41904e458bae79e7dad5d654 Aug 31 16:08:23.594736 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-MigrationsAdminTest-925549718 Aug 31 16:08:23.594736 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-MigrationsAdminTest-925549718-project Aug 31 16:08:23.594736 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:08:23.594736 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:08:23.594736 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 0a552442b7e94406b1689baf7a23fa52 Aug 31 16:08:23.594736 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-MigrationsAdminTest-925549718-project Aug 31 16:08:23.594736 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:08:23.594736 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance f9b66475-83f6-49a3-bc63-8965fc1aec14 could not be found. Aug 31 16:08:23.594736 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': 'f9b66475-83f6-49a3-bc63-8965fc1aec14'} Aug 31 16:08:23.594736 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:08:23.594736 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:08:23.594736 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:08:23.594736 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:08:23.594736 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:08:23.594736 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:08:23.594736 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:08:23.594736 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:08:23.594736 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:08:23.594736 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:08:23.594736 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9b66475-83f6-49a3-bc63-8965fc1aec14 could not be found. Aug 31 16:08:23.594736 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:08:23.594736 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:08:23.594736 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:08:23.594736 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:08:23.594736 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:08:23.594736 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:08:23.594736 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:08:23.594736 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:08:23.594736 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:08:23.594736 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:08:23.594736 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:08:23.594736 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:08:23.594736 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:08:23.594736 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:08:23.594736 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:08:23.594736 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:08:23.594736 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9b66475-83f6-49a3-bc63-8965fc1aec14 could not be found. Aug 31 16:08:23.594736 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:08:23.594736 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:08:23.594736 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:08:23.601834 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:08:23.601834 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:08:23.601834 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:08:23.601834 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:08:23.601834 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:08:23.601834 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9b66475-83f6-49a3-bc63-8965fc1aec14 could not be found. Aug 31 16:08:23.601834 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:08:23.601834 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-47c11c70-f4ae-4c8f-b94c-bbade4a5f714 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Returning 404 to user: Instance f9b66475-83f6-49a3-bc63-8965fc1aec14 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:08:23.607399 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-47c11c70-f4ae-4c8f-b94c-bbade4a5f714 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/f9b66475-83f6-49a3-bc63-8965fc1aec14" status: 404 len: 111 microversion: 2.1 time: 0.117107 Aug 31 16:08:23.607399 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1472/2911] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:23 2022] GET /compute/v2.1/servers/f9b66475-83f6-49a3-bc63-8965fc1aec14 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:08:23.619674 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-da5d7056-7a77-443b-bcd7-01c24ee3c345 tempest-SecurityGroupsTestAdminJSON-594959433 tempest-SecurityGroupsTestAdminJSON-594959433-project] Action: 'create', calling method: .version_select at 0x7f5ae9333c10>, body: {"security_group": {"name": "tempest-securitygroup-1455797830", "description": "tempest-description-1405580451"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:08:23.623037 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-b9432c19-34f3-4369-8f0d-cbf945a4873f req-652e7b9a-109a-4585-94e3-f1e4b8e1e423 service nova] Creating event network-vif-plugged:ebd19817-6484-40fc-bcca-5b49c8f8bbc4 for instance 0a5d6a47-ce38-4d1d-8d97-550f5e950af5 on n-h1-850499-9 Aug 31 16:08:23.631928 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-b9432c19-34f3-4369-8f0d-cbf945a4873f req-652e7b9a-109a-4585-94e3-f1e4b8e1e423 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104005 Aug 31 16:08:23.636122 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1440/2912] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:08:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:08:23.648761 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5c2feea2-2170-4178-a8ae-f7a7c5c5ccfd tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:23.651050 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5c2feea2-2170-4178-a8ae-f7a7c5c5ccfd tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 0a5d6a47-ce38-4d1d-8d97-550f5e950af5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:23.659015 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5c2feea2-2170-4178-a8ae-f7a7c5c5ccfd tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:23.659842 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5c2feea2-2170-4178-a8ae-f7a7c5c5ccfd tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:23.660640 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5c2feea2-2170-4178-a8ae-f7a7c5c5ccfd tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:23.661895 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5c2feea2-2170-4178-a8ae-f7a7c5c5ccfd tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:23.662744 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5c2feea2-2170-4178-a8ae-f7a7c5c5ccfd tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:23.663406 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5c2feea2-2170-4178-a8ae-f7a7c5c5ccfd tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:24.077201 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5c2feea2-2170-4178-a8ae-f7a7c5c5ccfd tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:24.098372 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5c2feea2-2170-4178-a8ae-f7a7c5c5ccfd tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/0a5d6a47-ce38-4d1d-8d97-550f5e950af5" status: 200 len: 1314 microversion: 2.1 time: 0.454416 Aug 31 16:08:24.099764 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1441/2913] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:23 2022] GET /compute/v2.1/servers/0a5d6a47-ce38-4d1d-8d97-550f5e950af5 => generated 1314 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:24.116465 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ad3f9bc2-071c-432f-a82b-7f7efdbc5cfa tempest-ImagesMetadataTestJSON-1089699170 tempest-ImagesMetadataTestJSON-1089699170-project] Action: 'update_all', calling method: .version_select at 0x7f5ae84750d0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:08:24.266486 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-da5d7056-7a77-443b-bcd7-01c24ee3c345 tempest-SecurityGroupsTestAdminJSON-594959433 tempest-SecurityGroupsTestAdminJSON-594959433-project] 10.222.0.61 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.658848 Aug 31 16:08:24.267205 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1473/2914] 10.222.0.61 () {60 vars in 1180 bytes} [Wed Aug 31 16:08:23 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:08:24.273016 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a69d9d68-6b8c-4fbf-9fc2-6e3c0dd9324e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '.version_select at 0x7f5ae97cbee0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:24.284283 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-ad3f9bc2-071c-432f-a82b-7f7efdbc5cfa tempest-ImagesMetadataTestJSON-1089699170 tempest-ImagesMetadataTestJSON-1089699170-project] Getting quotas for project 7e64d9d4b9674febb32169ec4ec6b40f. Resources: dict_keys(['metadata_items']) {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:08:24.328622 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a69d9d68-6b8c-4fbf-9fc2-6e3c0dd9324e tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-364087997" status: 202 len: 0 microversion: 2.1 time: 0.058425 Aug 31 16:08:24.333647 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1474/2915] 10.222.0.61 () {58 vars in 1218 bytes} [Wed Aug 31 16:08:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-364087997 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:08:24.363593 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-46342aa1-c0f2-4319-a43f-8c596b11f831 req-0bf48816-84bf-4fc6-9bb6-0767a9eb734f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "560a01e5-93f8-46c8-9261-5030e28766b4", "name": "network-vif-deleted", "tag": "f7a3259e-6ecb-48c9-a90a-0b0d027258f4"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:08:24.378577 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-ad3f9bc2-071c-432f-a82b-7f7efdbc5cfa tempest-ImagesMetadataTestJSON-1089699170 tempest-ImagesMetadataTestJSON-1089699170-project] Getting quotas for user 00fdafbbe22c4d5c8c1cc5b1bf88ae42 and project 7e64d9d4b9674febb32169ec4ec6b40f. Resources: dict_keys(['metadata_items']) {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:08:24.386735 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-46342aa1-c0f2-4319-a43f-8c596b11f831 req-0bf48816-84bf-4fc6-9bb6-0767a9eb734f service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:24.387224 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-46342aa1-c0f2-4319-a43f-8c596b11f831 req-0bf48816-84bf-4fc6-9bb6-0767a9eb734f service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:24.395425 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-46342aa1-c0f2-4319-a43f-8c596b11f831 req-0bf48816-84bf-4fc6-9bb6-0767a9eb734f service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:24.423698 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-46342aa1-c0f2-4319-a43f-8c596b11f831 req-0bf48816-84bf-4fc6-9bb6-0767a9eb734f service nova] Creating event network-vif-deleted:f7a3259e-6ecb-48c9-a90a-0b0d027258f4 for instance 560a01e5-93f8-46c8-9261-5030e28766b4 on n-h2-850499-9 Aug 31 16:08:24.439988 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-46342aa1-c0f2-4319-a43f-8c596b11f831 req-0bf48816-84bf-4fc6-9bb6-0767a9eb734f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102917 Aug 31 16:08:24.443463 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1475/2916] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:08:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:08:24.943391 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ad3f9bc2-071c-432f-a82b-7f7efdbc5cfa tempest-ImagesMetadataTestJSON-1089699170 tempest-ImagesMetadataTestJSON-1089699170-project] 10.222.0.61 "PUT /compute/v2.1/images/de39420f-2805-45ff-b83c-cabc5422f621/metadata" status: 200 len: 61 microversion: 2.1 time: 0.841749 Aug 31 16:08:24.944701 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1442/2917] 10.222.0.61 () {60 vars in 1280 bytes} [Wed Aug 31 16:08:24 2022] PUT /compute/v2.1/images/de39420f-2805-45ff-b83c-cabc5422f621/metadata => generated 61 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 16:08:24.955443 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-85c60816-06db-451a-9c3a-e9d90d0c4486 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:24.960902 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-85c60816-06db-451a-9c3a-e9d90d0c4486 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] [instance: 560a01e5-93f8-46c8-9261-5030e28766b4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:24.967424 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-84b0a0bd-62f6-4a1e-9241-39db5f8254b5 tempest-SecurityGroupsTestAdminJSON-1104765286 tempest-SecurityGroupsTestAdminJSON-1104765286-project-admin] Action: 'create', calling method: .version_select at 0x7f5ae858f670>, body: {"security_group": {"name": "tempest-securitygroup-1869050024", "description": "tempest-description-2125796996"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:08:24.975089 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-85c60816-06db-451a-9c3a-e9d90d0c4486 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:24.975915 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-85c60816-06db-451a-9c3a-e9d90d0c4486 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:24.976623 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-85c60816-06db-451a-9c3a-e9d90d0c4486 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:24.978700 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-85c60816-06db-451a-9c3a-e9d90d0c4486 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:24.979863 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-85c60816-06db-451a-9c3a-e9d90d0c4486 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:24.980542 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-85c60816-06db-451a-9c3a-e9d90d0c4486 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:25.002458 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-85c60816-06db-451a-9c3a-e9d90d0c4486 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] HTTP exception thrown: Instance 560a01e5-93f8-46c8-9261-5030e28766b4 could not be found. Aug 31 16:08:25.004611 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-85c60816-06db-451a-9c3a-e9d90d0c4486 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Request method failure captured: Aug 31 16:08:25.004611 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/560a01e5-93f8-46c8-9261-5030e28766b4 HTTP/1.1 Aug 31 16:08:25.004611 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:08:25.004611 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:08:25.004611 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:08:25.004611 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:08:25.004611 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:08:25.004611 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:08:25.004611 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:08:25.004611 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:08:25.004611 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4ak3Iu_CON4wzsYG60KGfqF_dMVFgf7ewVMkLihE8pgwNg-kuSAGgCjcVAPONai-DPecwzS4_VhSvDE62kz8_ECrmUtLxaLELCdlP15zoSt_l27BzwIMnKW4Bu8zloHpq_8KH3_014SVsdbSr1Cmx04YorwZosvqiXyyO7AvWzdC0Q Aug 31 16:08:25.004611 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:08:25.004611 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:08:25.004611 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:08:25.004611 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:08:25.004611 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:08:25.004611 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:08:25.004611 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 4efd94380dcf4b3cb7a2b9fa194fcb83 Aug 31 16:08:25.004611 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ListImageFiltersTestJSON-185321200 Aug 31 16:08:25.004611 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:08:25.004611 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:08:25.004611 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4efd94380dcf4b3cb7a2b9fa194fcb83"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/4efd94380dcf4b3cb7a2b9fa194fcb83"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_4efd94380dcf4b3cb7a2b9fa194fcb83", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4efd94380dcf4b3cb7a2b9fa194fcb83"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:08:25.004611 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ListImageFiltersTestJSON-185321200 Aug 31 16:08:25.004611 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 4efd94380dcf4b3cb7a2b9fa194fcb83 Aug 31 16:08:25.004611 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-185321200 Aug 31 16:08:25.004611 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ListImageFiltersTestJSON-185321200-project Aug 31 16:08:25.004611 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:08:25.004611 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:08:25.004611 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: c7f0b27a48fd41dd846ba60856349ab5 Aug 31 16:08:25.004611 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ListImageFiltersTestJSON-185321200-project Aug 31 16:08:25.004611 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:08:25.004611 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance 560a01e5-93f8-46c8-9261-5030e28766b4 could not be found. Aug 31 16:08:25.004611 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '560a01e5-93f8-46c8-9261-5030e28766b4'} Aug 31 16:08:25.004611 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:08:25.004611 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:08:25.004611 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:08:25.004611 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:08:25.004611 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:08:25.004611 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:08:25.004611 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:08:25.004611 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:08:25.004611 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:08:25.004611 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:08:25.004611 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 560a01e5-93f8-46c8-9261-5030e28766b4 could not be found. Aug 31 16:08:25.004611 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:08:25.004611 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:08:25.004611 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:08:25.004611 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:08:25.004611 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:08:25.004611 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:08:25.004611 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:08:25.004611 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:08:25.004611 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:08:25.004611 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:08:25.004611 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:08:25.004611 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:08:25.004611 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:08:25.004611 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:08:25.004611 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:08:25.004611 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:08:25.004611 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 560a01e5-93f8-46c8-9261-5030e28766b4 could not be found. Aug 31 16:08:25.004611 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:08:25.004611 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:08:25.004611 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:08:25.009992 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:08:25.009992 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:08:25.009992 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:08:25.009992 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:08:25.009992 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:08:25.009992 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 560a01e5-93f8-46c8-9261-5030e28766b4 could not be found. Aug 31 16:08:25.009992 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:08:25.012567 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-85c60816-06db-451a-9c3a-e9d90d0c4486 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Returning 404 to user: Instance 560a01e5-93f8-46c8-9261-5030e28766b4 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:08:25.013740 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-85c60816-06db-451a-9c3a-e9d90d0c4486 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "GET /compute/v2.1/servers/560a01e5-93f8-46c8-9261-5030e28766b4" status: 404 len: 111 microversion: 2.1 time: 0.062880 Aug 31 16:08:25.014476 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1443/2918] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:24 2022] GET /compute/v2.1/servers/560a01e5-93f8-46c8-9261-5030e28766b4 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:08:25.019912 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6f0b6cf9-77e8-4a4f-b0d1-60dd1fa13d8f tempest-ImagesMetadataTestJSON-1089699170 tempest-ImagesMetadataTestJSON-1089699170-project] Action: 'create', calling method: .version_select at 0x7f5ae841d9d0>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:08:25.102466 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-6f0b6cf9-77e8-4a4f-b0d1-60dd1fa13d8f tempest-ImagesMetadataTestJSON-1089699170 tempest-ImagesMetadataTestJSON-1089699170-project] Getting quotas for project 7e64d9d4b9674febb32169ec4ec6b40f. Resources: dict_keys(['metadata_items']) {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:08:25.109900 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-6f0b6cf9-77e8-4a4f-b0d1-60dd1fa13d8f tempest-ImagesMetadataTestJSON-1089699170 tempest-ImagesMetadataTestJSON-1089699170-project] Getting quotas for user 00fdafbbe22c4d5c8c1cc5b1bf88ae42 and project 7e64d9d4b9674febb32169ec4ec6b40f. Resources: dict_keys(['metadata_items']) {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:08:25.645155 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6f0b6cf9-77e8-4a4f-b0d1-60dd1fa13d8f tempest-ImagesMetadataTestJSON-1089699170 tempest-ImagesMetadataTestJSON-1089699170-project] 10.222.0.61 "POST /compute/v2.1/images/de39420f-2805-45ff-b83c-cabc5422f621/metadata" status: 200 len: 85 microversion: 2.1 time: 0.629089 Aug 31 16:08:25.647421 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1444/2919] 10.222.0.61 () {60 vars in 1281 bytes} [Wed Aug 31 16:08:25 2022] POST /compute/v2.1/images/de39420f-2805-45ff-b83c-cabc5422f621/metadata => generated 85 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 16:08:25.664299 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7ac0f01e-26e1-4fc7-987e-24ac56a3839d tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:25.666735 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7ac0f01e-26e1-4fc7-987e-24ac56a3839d tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] [instance: 359f06bd-00e9-4d68-b066-db73d7073a04] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:25.674294 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7ac0f01e-26e1-4fc7-987e-24ac56a3839d tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:25.674844 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7ac0f01e-26e1-4fc7-987e-24ac56a3839d tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:25.675542 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7ac0f01e-26e1-4fc7-987e-24ac56a3839d tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:25.676798 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7ac0f01e-26e1-4fc7-987e-24ac56a3839d tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:25.677418 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7ac0f01e-26e1-4fc7-987e-24ac56a3839d tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:25.677946 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7ac0f01e-26e1-4fc7-987e-24ac56a3839d tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:25.711859 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7ac0f01e-26e1-4fc7-987e-24ac56a3839d tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] [instance: 359f06bd-00e9-4d68-b066-db73d7073a04] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:08:25.827747 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-84b0a0bd-62f6-4a1e-9241-39db5f8254b5 tempest-SecurityGroupsTestAdminJSON-1104765286 tempest-SecurityGroupsTestAdminJSON-1104765286-project-admin] 10.222.0.61 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 1.382429 Aug 31 16:08:25.829070 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1476/2920] 10.222.0.61 () {60 vars in 1180 bytes} [Wed Aug 31 16:08:24 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 1385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:08:25.864821 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-59ed26fa-b12b-447e-8325-c2affa4d08f7 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:25.868223 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-59ed26fa-b12b-447e-8325-c2affa4d08f7 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 0a5d6a47-ce38-4d1d-8d97-550f5e950af5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:25.891174 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7ac0f01e-26e1-4fc7-987e-24ac56a3839d tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "DELETE /compute/v2.1/servers/359f06bd-00e9-4d68-b066-db73d7073a04" status: 204 len: 0 microversion: 2.1 time: 0.240753 Aug 31 16:08:25.896664 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1445/2921] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:08:25 2022] DELETE /compute/v2.1/servers/359f06bd-00e9-4d68-b066-db73d7073a04 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:08:25.905096 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-59ed26fa-b12b-447e-8325-c2affa4d08f7 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:25.908269 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-59ed26fa-b12b-447e-8325-c2affa4d08f7 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:25.909684 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-59ed26fa-b12b-447e-8325-c2affa4d08f7 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:25.915059 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-59ed26fa-b12b-447e-8325-c2affa4d08f7 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:25.915678 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-55d39041-4c3f-4080-8b14-dcf3d14443a1 tempest-ImagesMetadataTestJSON-1089699170 tempest-ImagesMetadataTestJSON-1089699170-project] Calling method '.version_select at 0x7f5ae9a98670>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:25.918034 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-59ed26fa-b12b-447e-8325-c2affa4d08f7 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:25.919343 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-59ed26fa-b12b-447e-8325-c2affa4d08f7 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:26.001229 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-55d39041-4c3f-4080-8b14-dcf3d14443a1 tempest-ImagesMetadataTestJSON-1089699170 tempest-ImagesMetadataTestJSON-1089699170-project] 10.222.0.61 "GET /compute/v2.1/images/de39420f-2805-45ff-b83c-cabc5422f621/metadata" status: 200 len: 85 microversion: 2.1 time: 0.102120 Aug 31 16:08:26.002491 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1446/2922] 10.222.0.61 () {58 vars in 1260 bytes} [Wed Aug 31 16:08:25 2022] GET /compute/v2.1/images/de39420f-2805-45ff-b83c-cabc5422f621/metadata => generated 85 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 16:08:26.014357 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-67e58e13-365c-413e-8ef9-aa5d7b17637c tempest-SecurityGroupsTestAdminJSON-1104765286 tempest-SecurityGroupsTestAdminJSON-1104765286-project-admin] Action: 'create', calling method: .version_select at 0x7f5ae84e63a0>, body: {"security_group": {"name": "tempest-securitygroup-1275648458", "description": "tempest-description-1067367876"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:08:26.476651 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-59ed26fa-b12b-447e-8325-c2affa4d08f7 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:26.503845 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-59ed26fa-b12b-447e-8325-c2affa4d08f7 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/0a5d6a47-ce38-4d1d-8d97-550f5e950af5" status: 200 len: 1501 microversion: 2.1 time: 0.663210 Aug 31 16:08:26.504300 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1477/2923] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:25 2022] GET /compute/v2.1/servers/0a5d6a47-ce38-4d1d-8d97-550f5e950af5 => generated 1501 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:26.526573 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f9b14027-daed-42ab-971e-79d41357f36f tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:26.530775 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f9b14027-daed-42ab-971e-79d41357f36f tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] [instance: 359f06bd-00e9-4d68-b066-db73d7073a04] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:26.561037 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f9b14027-daed-42ab-971e-79d41357f36f tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:26.562150 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f9b14027-daed-42ab-971e-79d41357f36f tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:26.562849 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f9b14027-daed-42ab-971e-79d41357f36f tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:26.563830 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f9b14027-daed-42ab-971e-79d41357f36f tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:26.564506 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f9b14027-daed-42ab-971e-79d41357f36f tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:26.565162 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f9b14027-daed-42ab-971e-79d41357f36f tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:26.599551 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-67e58e13-365c-413e-8ef9-aa5d7b17637c tempest-SecurityGroupsTestAdminJSON-1104765286 tempest-SecurityGroupsTestAdminJSON-1104765286-project-admin] 10.222.0.61 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.595181 Aug 31 16:08:26.600956 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1447/2924] 10.222.0.61 () {60 vars in 1180 bytes} [Wed Aug 31 16:08:26 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:08:26.616380 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-68dc22e1-ad08-45a8-8c21-3da1bcad10eb tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:08:26.655700 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-68dc22e1-ad08-45a8-8c21-3da1bcad10eb tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:26.656662 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-68dc22e1-ad08-45a8-8c21-3da1bcad10eb tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:26.657212 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-68dc22e1-ad08-45a8-8c21-3da1bcad10eb tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:26.877882 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-68dc22e1-ad08-45a8-8c21-3da1bcad10eb tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 0a5d6a47-ce38-4d1d-8d97-550f5e950af5] Going to try to stop instance {{(pid=122257) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 31 16:08:26.939203 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:08:26.957287 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f9b14027-daed-42ab-971e-79d41357f36f tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f0b27a48fd41dd846ba60856349ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4efd94380dcf4b3cb7a2b9fa194fcb83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:26.973280 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-68dc22e1-ad08-45a8-8c21-3da1bcad10eb tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "POST /compute/v2.1/servers/0a5d6a47-ce38-4d1d-8d97-550f5e950af5/action" status: 202 len: 0 microversion: 2.1 time: 0.357779 Aug 31 16:08:26.973600 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f9b14027-daed-42ab-971e-79d41357f36f tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "GET /compute/v2.1/servers/359f06bd-00e9-4d68-b066-db73d7073a04" status: 200 len: 1472 microversion: 2.1 time: 0.463338 Aug 31 16:08:26.974467 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1448/2925] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:08:26 2022] POST /compute/v2.1/servers/0a5d6a47-ce38-4d1d-8d97-550f5e950af5/action => generated 0 bytes in 363 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:08:26.976869 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1478/2926] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:26 2022] GET /compute/v2.1/servers/359f06bd-00e9-4d68-b066-db73d7073a04 => generated 1472 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:26.995409 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-95881159-d05e-4e2b-8b13-c8cf30da5d53 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:26.996446 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0d0d18ac-6540-49c0-8f59-1cd1719eb0c2 tempest-SecurityGroupsTestAdminJSON-1104765286 tempest-SecurityGroupsTestAdminJSON-1104765286-project-admin] Calling method '.version_select at 0x7f5ae934c4c0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:27.001542 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-95881159-d05e-4e2b-8b13-c8cf30da5d53 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6e82c98f-d644-4464-aca0-13901e551aa4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:27.017962 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-95881159-d05e-4e2b-8b13-c8cf30da5d53 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:27.018164 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-95881159-d05e-4e2b-8b13-c8cf30da5d53 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:27.018797 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-95881159-d05e-4e2b-8b13-c8cf30da5d53 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:27.020021 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-95881159-d05e-4e2b-8b13-c8cf30da5d53 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:27.020912 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-95881159-d05e-4e2b-8b13-c8cf30da5d53 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:27.021971 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-95881159-d05e-4e2b-8b13-c8cf30da5d53 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:27.077658 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-95881159-d05e-4e2b-8b13-c8cf30da5d53 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6e82c98f-d644-4464-aca0-13901e551aa4] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:08:27.281035 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-95881159-d05e-4e2b-8b13-c8cf30da5d53 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "DELETE /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4" status: 204 len: 0 microversion: 2.1 time: 0.295859 Aug 31 16:08:27.283602 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1449/2927] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:08:26 2022] DELETE /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:08:27.298576 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8e71fe47-241e-4ca8-ab36-36ca151f1402 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:27.300475 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8e71fe47-241e-4ca8-ab36-36ca151f1402 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 0a5d6a47-ce38-4d1d-8d97-550f5e950af5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:27.310735 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:08:27.319231 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8e71fe47-241e-4ca8-ab36-36ca151f1402 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:27.320432 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8e71fe47-241e-4ca8-ab36-36ca151f1402 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:27.321060 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8e71fe47-241e-4ca8-ab36-36ca151f1402 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:27.322229 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8e71fe47-241e-4ca8-ab36-36ca151f1402 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:27.323156 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8e71fe47-241e-4ca8-ab36-36ca151f1402 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:27.323800 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8e71fe47-241e-4ca8-ab36-36ca151f1402 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:27.801452 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8e71fe47-241e-4ca8-ab36-36ca151f1402 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:27.814881 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8e71fe47-241e-4ca8-ab36-36ca151f1402 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/0a5d6a47-ce38-4d1d-8d97-550f5e950af5" status: 200 len: 1511 microversion: 2.1 time: 0.525617 Aug 31 16:08:27.816071 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1450/2928] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:27 2022] GET /compute/v2.1/servers/0a5d6a47-ce38-4d1d-8d97-550f5e950af5 => generated 1511 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:27.823894 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-22e0f5c0-7559-4639-8a36-8fa1e25dfc0a tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:27.824859 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-22e0f5c0-7559-4639-8a36-8fa1e25dfc0a tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6e82c98f-d644-4464-aca0-13901e551aa4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:27.833758 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-22e0f5c0-7559-4639-8a36-8fa1e25dfc0a tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:27.834275 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-22e0f5c0-7559-4639-8a36-8fa1e25dfc0a tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:27.834985 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-22e0f5c0-7559-4639-8a36-8fa1e25dfc0a tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:27.835876 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-22e0f5c0-7559-4639-8a36-8fa1e25dfc0a tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:27.836446 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-22e0f5c0-7559-4639-8a36-8fa1e25dfc0a tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:27.836772 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-22e0f5c0-7559-4639-8a36-8fa1e25dfc0a tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:27.873171 n-d-850499-9 devstack@n-api.service[122256]: DEBUG neutronclient.v2_0.client [None req-0d0d18ac-6540-49c0-8f59-1cd1719eb0c2 tempest-SecurityGroupsTestAdminJSON-1104765286 tempest-SecurityGroupsTestAdminJSON-1104765286-project-admin] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 002508ea-a862-49a2-a566-7c16682b597a does not exist", "detail": ""}} {{(pid=122256) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 31 16:08:27.873792 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.security_group_api [None req-0d0d18ac-6540-49c0-8f59-1cd1719eb0c2 tempest-SecurityGroupsTestAdminJSON-1104765286 tempest-SecurityGroupsTestAdminJSON-1104765286-project-admin] Neutron security group 002508ea-a862-49a2-a566-7c16682b597a not found {{(pid=122256) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 31 16:08:27.874260 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.compute.security_groups [None req-0d0d18ac-6540-49c0-8f59-1cd1719eb0c2 tempest-SecurityGroupsTestAdminJSON-1104765286 tempest-SecurityGroupsTestAdminJSON-1104765286-project-admin] Security Group ID 002508ea-a862-49a2-a566-7c16682b597a does not exist {{(pid=122256) _format_security_group_rule /opt/stack/nova/nova/api/openstack/compute/security_groups.py:75}} Aug 31 16:08:27.947608 n-d-850499-9 devstack@n-api.service[122256]: DEBUG neutronclient.v2_0.client [None req-0d0d18ac-6540-49c0-8f59-1cd1719eb0c2 tempest-SecurityGroupsTestAdminJSON-1104765286 tempest-SecurityGroupsTestAdminJSON-1104765286-project-admin] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 002508ea-a862-49a2-a566-7c16682b597a does not exist", "detail": ""}} {{(pid=122256) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 31 16:08:27.949387 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.security_group_api [None req-0d0d18ac-6540-49c0-8f59-1cd1719eb0c2 tempest-SecurityGroupsTestAdminJSON-1104765286 tempest-SecurityGroupsTestAdminJSON-1104765286-project-admin] Neutron security group 002508ea-a862-49a2-a566-7c16682b597a not found {{(pid=122256) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 31 16:08:27.950395 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.compute.security_groups [None req-0d0d18ac-6540-49c0-8f59-1cd1719eb0c2 tempest-SecurityGroupsTestAdminJSON-1104765286 tempest-SecurityGroupsTestAdminJSON-1104765286-project-admin] Security Group ID 002508ea-a862-49a2-a566-7c16682b597a does not exist {{(pid=122256) _format_security_group_rule /opt/stack/nova/nova/api/openstack/compute/security_groups.py:75}} Aug 31 16:08:28.282743 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-22e0f5c0-7559-4639-8a36-8fa1e25dfc0a tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:28.304747 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-22e0f5c0-7559-4639-8a36-8fa1e25dfc0a tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4" status: 200 len: 1467 microversion: 2.1 time: 0.486928 Aug 31 16:08:28.307887 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1451/2929] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:27 2022] GET /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4 => generated 1467 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:28.324074 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-eb969422-c1b8-4c40-9270-66974d61d795 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:28.326469 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-eb969422-c1b8-4c40-9270-66974d61d795 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] [instance: 359f06bd-00e9-4d68-b066-db73d7073a04] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:28.344241 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eb969422-c1b8-4c40-9270-66974d61d795 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:28.345397 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eb969422-c1b8-4c40-9270-66974d61d795 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:28.346484 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eb969422-c1b8-4c40-9270-66974d61d795 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:28.348311 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eb969422-c1b8-4c40-9270-66974d61d795 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:28.349786 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eb969422-c1b8-4c40-9270-66974d61d795 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:28.352754 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eb969422-c1b8-4c40-9270-66974d61d795 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:28.722652 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-eb969422-c1b8-4c40-9270-66974d61d795 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f0b27a48fd41dd846ba60856349ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4efd94380dcf4b3cb7a2b9fa194fcb83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:28.778234 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-eb969422-c1b8-4c40-9270-66974d61d795 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "GET /compute/v2.1/servers/359f06bd-00e9-4d68-b066-db73d7073a04" status: 200 len: 1472 microversion: 2.1 time: 0.466346 Aug 31 16:08:28.782487 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1452/2930] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:28 2022] GET /compute/v2.1/servers/359f06bd-00e9-4d68-b066-db73d7073a04 => generated 1472 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:28.857914 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f32fe56a-f2eb-47a3-881e-76b79e434c9c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:28.860685 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f32fe56a-f2eb-47a3-881e-76b79e434c9c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 0a5d6a47-ce38-4d1d-8d97-550f5e950af5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:28.896337 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f32fe56a-f2eb-47a3-881e-76b79e434c9c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:28.897380 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f32fe56a-f2eb-47a3-881e-76b79e434c9c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:28.898909 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f32fe56a-f2eb-47a3-881e-76b79e434c9c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:28.902491 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f32fe56a-f2eb-47a3-881e-76b79e434c9c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:28.904801 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f32fe56a-f2eb-47a3-881e-76b79e434c9c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:28.906187 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f32fe56a-f2eb-47a3-881e-76b79e434c9c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:29.560577 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f32fe56a-f2eb-47a3-881e-76b79e434c9c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:29.574142 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f32fe56a-f2eb-47a3-881e-76b79e434c9c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/0a5d6a47-ce38-4d1d-8d97-550f5e950af5" status: 200 len: 1511 microversion: 2.1 time: 0.732651 Aug 31 16:08:29.576915 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1453/2931] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:28 2022] GET /compute/v2.1/servers/0a5d6a47-ce38-4d1d-8d97-550f5e950af5 => generated 1511 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:08:29.592218 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-17c0c0e0-8b05-412e-9961-d2b9068b4fda tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:29.593434 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-17c0c0e0-8b05-412e-9961-d2b9068b4fda tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6e82c98f-d644-4464-aca0-13901e551aa4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:29.625088 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-17c0c0e0-8b05-412e-9961-d2b9068b4fda tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:29.626743 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-17c0c0e0-8b05-412e-9961-d2b9068b4fda tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:29.627213 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-17c0c0e0-8b05-412e-9961-d2b9068b4fda tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:29.628001 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-17c0c0e0-8b05-412e-9961-d2b9068b4fda tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:29.628478 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-17c0c0e0-8b05-412e-9961-d2b9068b4fda tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:29.631798 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-17c0c0e0-8b05-412e-9961-d2b9068b4fda tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:30.671331 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-17c0c0e0-8b05-412e-9961-d2b9068b4fda tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:30.692476 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-17c0c0e0-8b05-412e-9961-d2b9068b4fda tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4" status: 200 len: 1467 microversion: 2.1 time: 1.110202 Aug 31 16:08:30.693771 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1454/2932] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:29 2022] GET /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4 => generated 1467 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:30.706124 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d4dd7e79-8667-4e82-a55f-7acacc166338 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:30.706855 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d4dd7e79-8667-4e82-a55f-7acacc166338 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] [instance: 359f06bd-00e9-4d68-b066-db73d7073a04] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:30.724460 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d4dd7e79-8667-4e82-a55f-7acacc166338 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:30.726777 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d4dd7e79-8667-4e82-a55f-7acacc166338 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:30.729344 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d4dd7e79-8667-4e82-a55f-7acacc166338 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:30.730618 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d4dd7e79-8667-4e82-a55f-7acacc166338 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:30.732366 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d4dd7e79-8667-4e82-a55f-7acacc166338 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:30.732854 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d4dd7e79-8667-4e82-a55f-7acacc166338 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:30.869664 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=12 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:08:30.966847 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d4dd7e79-8667-4e82-a55f-7acacc166338 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f0b27a48fd41dd846ba60856349ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4efd94380dcf4b3cb7a2b9fa194fcb83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:30.984875 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d4dd7e79-8667-4e82-a55f-7acacc166338 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "GET /compute/v2.1/servers/359f06bd-00e9-4d68-b066-db73d7073a04" status: 200 len: 1301 microversion: 2.1 time: 0.285394 Aug 31 16:08:30.985661 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1455/2933] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:30 2022] GET /compute/v2.1/servers/359f06bd-00e9-4d68-b066-db73d7073a04 => generated 1301 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:31.295860 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-bb05a048-6956-4983-81e4-ead7594c0152 tempest-ListImagesTestJSON-689490853 tempest-ListImagesTestJSON-689490853-project] Calling method '.version_select at 0x7f5ae856b940>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:31.434912 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-bb05a048-6956-4983-81e4-ead7594c0152 tempest-ListImagesTestJSON-689490853 tempest-ListImagesTestJSON-689490853-project] 10.222.0.61 "GET /compute/v2.1/images/b9c36d42-ed46-4bf5-ad18-1df45cbd0413" status: 200 len: 784 microversion: 2.1 time: 0.447855 Aug 31 16:08:31.436231 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1456/2934] 10.222.0.61 () {58 vars in 1233 bytes} [Wed Aug 31 16:08:30 2022] GET /compute/v2.1/images/b9c36d42-ed46-4bf5-ad18-1df45cbd0413 => generated 784 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:08:31.449962 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ab82cb3e-23f3-4bc0-a9d8-322438fc007a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:31.453776 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ab82cb3e-23f3-4bc0-a9d8-322438fc007a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 0a5d6a47-ce38-4d1d-8d97-550f5e950af5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:31.500292 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ab82cb3e-23f3-4bc0-a9d8-322438fc007a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:31.521324 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ab82cb3e-23f3-4bc0-a9d8-322438fc007a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:31.523771 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ab82cb3e-23f3-4bc0-a9d8-322438fc007a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:31.527579 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ab82cb3e-23f3-4bc0-a9d8-322438fc007a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:31.530048 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ab82cb3e-23f3-4bc0-a9d8-322438fc007a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:31.533455 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ab82cb3e-23f3-4bc0-a9d8-322438fc007a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:32.126170 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ab82cb3e-23f3-4bc0-a9d8-322438fc007a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:32.143989 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ab82cb3e-23f3-4bc0-a9d8-322438fc007a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/0a5d6a47-ce38-4d1d-8d97-550f5e950af5" status: 200 len: 1511 microversion: 2.1 time: 0.704388 Aug 31 16:08:32.145077 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1457/2935] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:31 2022] GET /compute/v2.1/servers/0a5d6a47-ce38-4d1d-8d97-550f5e950af5 => generated 1511 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:32.163750 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-0fe88683-b2d6-43d3-8b3e-70a2a11ad430 req-b0d7ee26-0828-4fe4-9201-1b402e91b147 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "359f06bd-00e9-4d68-b066-db73d7073a04", "name": "network-vif-deleted", "tag": "0cd3b24d-ce36-4d42-806b-496fd2089b1b"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:08:32.176895 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-0fe88683-b2d6-43d3-8b3e-70a2a11ad430 req-b0d7ee26-0828-4fe4-9201-1b402e91b147 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:32.177409 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-0fe88683-b2d6-43d3-8b3e-70a2a11ad430 req-b0d7ee26-0828-4fe4-9201-1b402e91b147 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:32.177952 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-0fe88683-b2d6-43d3-8b3e-70a2a11ad430 req-b0d7ee26-0828-4fe4-9201-1b402e91b147 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:32.191925 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-0fe88683-b2d6-43d3-8b3e-70a2a11ad430 req-b0d7ee26-0828-4fe4-9201-1b402e91b147 service nova] Creating event network-vif-deleted:0cd3b24d-ce36-4d42-806b-496fd2089b1b for instance 359f06bd-00e9-4d68-b066-db73d7073a04 on n-h1-850499-9 Aug 31 16:08:32.205900 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-0fe88683-b2d6-43d3-8b3e-70a2a11ad430 req-b0d7ee26-0828-4fe4-9201-1b402e91b147 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058438 Aug 31 16:08:32.206739 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1458/2936] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:08:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:08:32.221666 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-618a8f62-43ba-4bc6-9145-1164b61ecf05 tempest-ListImagesTestJSON-689490853 tempest-ListImagesTestJSON-689490853-project] Calling method '.version_select at 0x7f5ae9054280>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:32.335152 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-618a8f62-43ba-4bc6-9145-1164b61ecf05 tempest-ListImagesTestJSON-689490853 tempest-ListImagesTestJSON-689490853-project] 10.222.0.61 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.118897 Aug 31 16:08:32.336248 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1459/2937] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 31 16:08:32 2022] GET /compute/v2.1/images => generated 445 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:08:32.349645 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-64b2d5af-b9ad-4744-9065-f90834a1a778 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:32.355227 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-64b2d5af-b9ad-4744-9065-f90834a1a778 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6e82c98f-d644-4464-aca0-13901e551aa4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:32.380457 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-64b2d5af-b9ad-4744-9065-f90834a1a778 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:32.381331 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-64b2d5af-b9ad-4744-9065-f90834a1a778 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:32.381977 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-64b2d5af-b9ad-4744-9065-f90834a1a778 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:32.383051 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-64b2d5af-b9ad-4744-9065-f90834a1a778 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:32.387621 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-64b2d5af-b9ad-4744-9065-f90834a1a778 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:32.388640 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-64b2d5af-b9ad-4744-9065-f90834a1a778 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:32.489134 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-64b2d5af-b9ad-4744-9065-f90834a1a778 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:32.489920 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-64b2d5af-b9ad-4744-9065-f90834a1a778 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:32.490475 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-64b2d5af-b9ad-4744-9065-f90834a1a778 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:32.491055 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-64b2d5af-b9ad-4744-9065-f90834a1a778 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lazy-loading 'fault' on Instance uuid 6e82c98f-d644-4464-aca0-13901e551aa4 {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:08:32.580071 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-64b2d5af-b9ad-4744-9065-f90834a1a778 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:32.592129 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-64b2d5af-b9ad-4744-9065-f90834a1a778 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4" status: 200 len: 1302 microversion: 2.1 time: 0.254399 Aug 31 16:08:32.593496 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1460/2938] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:32 2022] GET /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4 => generated 1302 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:32.600742 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-818ca173-0657-4ebd-ac12-d6edcb484911 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:32.607594 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-818ca173-0657-4ebd-ac12-d6edcb484911 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] [instance: 359f06bd-00e9-4d68-b066-db73d7073a04] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:32.624396 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-818ca173-0657-4ebd-ac12-d6edcb484911 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:32.628338 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-818ca173-0657-4ebd-ac12-d6edcb484911 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:32.629846 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-818ca173-0657-4ebd-ac12-d6edcb484911 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:32.632658 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-818ca173-0657-4ebd-ac12-d6edcb484911 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:32.633813 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-818ca173-0657-4ebd-ac12-d6edcb484911 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:32.634776 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-818ca173-0657-4ebd-ac12-d6edcb484911 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:32.674113 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-818ca173-0657-4ebd-ac12-d6edcb484911 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] HTTP exception thrown: Instance 359f06bd-00e9-4d68-b066-db73d7073a04 could not be found. Aug 31 16:08:32.682658 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-818ca173-0657-4ebd-ac12-d6edcb484911 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Request method failure captured: Aug 31 16:08:32.682658 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/359f06bd-00e9-4d68-b066-db73d7073a04 HTTP/1.1 Aug 31 16:08:32.682658 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:08:32.682658 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:08:32.682658 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:08:32.682658 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:08:32.682658 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:08:32.682658 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:08:32.682658 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:08:32.682658 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:08:32.682658 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4ak3Iu_CON4wzsYG60KGfqF_dMVFgf7ewVMkLihE8pgwNg-kuSAGgCjcVAPONai-DPecwzS4_VhSvDE62kz8_ECrmUtLxaLELCdlP15zoSt_l27BzwIMnKW4Bu8zloHpq_8KH3_014SVsdbSr1Cmx04YorwZosvqiXyyO7AvWzdC0Q Aug 31 16:08:32.682658 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:08:32.682658 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:08:32.682658 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:08:32.682658 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:08:32.682658 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:08:32.682658 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:08:32.682658 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 4efd94380dcf4b3cb7a2b9fa194fcb83 Aug 31 16:08:32.682658 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ListImageFiltersTestJSON-185321200 Aug 31 16:08:32.682658 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:08:32.682658 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:08:32.682658 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4efd94380dcf4b3cb7a2b9fa194fcb83"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/4efd94380dcf4b3cb7a2b9fa194fcb83"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_4efd94380dcf4b3cb7a2b9fa194fcb83", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4efd94380dcf4b3cb7a2b9fa194fcb83"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:08:32.682658 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ListImageFiltersTestJSON-185321200 Aug 31 16:08:32.682658 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 4efd94380dcf4b3cb7a2b9fa194fcb83 Aug 31 16:08:32.682658 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-185321200 Aug 31 16:08:32.682658 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ListImageFiltersTestJSON-185321200-project Aug 31 16:08:32.682658 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:08:32.682658 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:08:32.682658 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: c7f0b27a48fd41dd846ba60856349ab5 Aug 31 16:08:32.682658 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ListImageFiltersTestJSON-185321200-project Aug 31 16:08:32.682658 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:08:32.682658 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance 359f06bd-00e9-4d68-b066-db73d7073a04 could not be found. Aug 31 16:08:32.682658 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '359f06bd-00e9-4d68-b066-db73d7073a04'} Aug 31 16:08:32.682658 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:08:32.682658 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:08:32.682658 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:08:32.682658 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:08:32.682658 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:08:32.682658 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:08:32.682658 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:08:32.682658 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:08:32.682658 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:08:32.682658 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:08:32.682658 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 359f06bd-00e9-4d68-b066-db73d7073a04 could not be found. Aug 31 16:08:32.682658 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:08:32.682658 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:08:32.682658 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:08:32.682658 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:08:32.682658 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:08:32.682658 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:08:32.682658 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:08:32.682658 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:08:32.682658 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:08:32.682658 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:08:32.682658 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:08:32.682658 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:08:32.682658 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:08:32.682658 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:08:32.682658 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:08:32.682658 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:08:32.682658 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 359f06bd-00e9-4d68-b066-db73d7073a04 could not be found. Aug 31 16:08:32.682658 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:08:32.682658 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:08:32.682658 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:08:32.686664 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:08:32.686664 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:08:32.686664 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:08:32.686664 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:08:32.686664 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:08:32.686664 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 359f06bd-00e9-4d68-b066-db73d7073a04 could not be found. Aug 31 16:08:32.686664 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:08:32.686664 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-818ca173-0657-4ebd-ac12-d6edcb484911 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Returning 404 to user: Instance 359f06bd-00e9-4d68-b066-db73d7073a04 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:08:32.686664 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-818ca173-0657-4ebd-ac12-d6edcb484911 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "GET /compute/v2.1/servers/359f06bd-00e9-4d68-b066-db73d7073a04" status: 404 len: 111 microversion: 2.1 time: 0.089772 Aug 31 16:08:32.687361 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1461/2939] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:32 2022] GET /compute/v2.1/servers/359f06bd-00e9-4d68-b066-db73d7073a04 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:08:32.697812 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b650b4f3-56db-4735-8f4a-15d6aecb525a tempest-ListImagesTestJSON-689490853 tempest-ListImagesTestJSON-689490853-project] Calling method '.version_select at 0x7f5ae8371550>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:32.820041 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b650b4f3-56db-4735-8f4a-15d6aecb525a tempest-ListImagesTestJSON-689490853 tempest-ListImagesTestJSON-689490853-project] 10.222.0.61 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.130723 Aug 31 16:08:32.820888 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1462/2940] 10.222.0.61 () {58 vars in 1143 bytes} [Wed Aug 31 16:08:32 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:08:32.828449 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3293a088-4ee6-4c72-9f31-4b3dc54df6a1 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '.version_select at 0x7f5ae8475820>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:33.084408 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0d0d18ac-6540-49c0-8f59-1cd1719eb0c2 tempest-SecurityGroupsTestAdminJSON-1104765286 tempest-SecurityGroupsTestAdminJSON-1104765286-project-admin] 10.222.0.61 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 9856 microversion: 2.1 time: 6.103129 Aug 31 16:08:33.085216 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1479/2941] 10.222.0.61 () {58 vars in 1191 bytes} [Wed Aug 31 16:08:26 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 9856 bytes in 6105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:33.110838 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a59966e8-546a-4995-81a3-33cdc2e64e91 tempest-SecurityGroupsTestAdminJSON-594959433 tempest-SecurityGroupsTestAdminJSON-594959433-project] Calling method '.version_select at 0x7f5ae9378a60>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:33.675274 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a59966e8-546a-4995-81a3-33cdc2e64e91 tempest-SecurityGroupsTestAdminJSON-594959433 tempest-SecurityGroupsTestAdminJSON-594959433-project] 10.222.0.61 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1113 microversion: 2.1 time: 0.573295 Aug 31 16:08:33.676471 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1480/2942] 10.222.0.61 () {58 vars in 1191 bytes} [Wed Aug 31 16:08:33 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1113 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:33.699445 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8e35a759-3cfe-49a3-b3b1-e23a324f3b67 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:33.700684 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8e35a759-3cfe-49a3-b3b1-e23a324f3b67 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 0a5d6a47-ce38-4d1d-8d97-550f5e950af5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:33.719949 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8e35a759-3cfe-49a3-b3b1-e23a324f3b67 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:33.721286 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8e35a759-3cfe-49a3-b3b1-e23a324f3b67 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:33.725107 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8e35a759-3cfe-49a3-b3b1-e23a324f3b67 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:33.726810 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8e35a759-3cfe-49a3-b3b1-e23a324f3b67 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:33.728420 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8e35a759-3cfe-49a3-b3b1-e23a324f3b67 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:33.730822 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8e35a759-3cfe-49a3-b3b1-e23a324f3b67 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:33.974808 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3293a088-4ee6-4c72-9f31-4b3dc54df6a1 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "DELETE /compute/v2.1/images/d2eda1ea-ec1a-4d42-a593-3dd7f97c5d76" status: 204 len: 0 microversion: 2.1 time: 1.152107 Aug 31 16:08:33.976424 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1463/2943] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:32 2022] DELETE /compute/v2.1/images/d2eda1ea-ec1a-4d42-a593-3dd7f97c5d76 => generated 0 bytes in 1155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:08:33.988344 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-081e64a6-6991-4938-81d0-e6e74631fe1a tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:33.991271 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-081e64a6-6991-4938-81d0-e6e74631fe1a tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6e82c98f-d644-4464-aca0-13901e551aa4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:34.018273 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-081e64a6-6991-4938-81d0-e6e74631fe1a tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:34.020908 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-081e64a6-6991-4938-81d0-e6e74631fe1a tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:34.034476 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-081e64a6-6991-4938-81d0-e6e74631fe1a tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:34.037245 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-081e64a6-6991-4938-81d0-e6e74631fe1a tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:34.037820 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-081e64a6-6991-4938-81d0-e6e74631fe1a tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:34.043159 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-081e64a6-6991-4938-81d0-e6e74631fe1a tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:34.089454 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-081e64a6-6991-4938-81d0-e6e74631fe1a tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] HTTP exception thrown: Instance 6e82c98f-d644-4464-aca0-13901e551aa4 could not be found. Aug 31 16:08:34.092789 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-081e64a6-6991-4938-81d0-e6e74631fe1a tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Request method failure captured: Aug 31 16:08:34.092789 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4 HTTP/1.1 Aug 31 16:08:34.092789 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:08:34.092789 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:08:34.092789 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:08:34.092789 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:08:34.092789 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:08:34.092789 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:08:34.092789 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:08:34.092789 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:08:34.092789 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4XCW8vlmi5ifUcmnrjxPNarpAxpfywGPf-yd0UXQDJn2VdmP64lnoSqfVFZOcHY2qwW0yLEixf1Z23Zt4Nnq_GfiTivZJ0pmJbIGzYCbyd170Z4KfuU55yKEE3eYeNWcxHNH6myZAsB0F1tRELNR62UNRY-BZzGiOmXdQUpaWONroQ Aug 31 16:08:34.092789 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:08:34.092789 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:08:34.092789 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:08:34.092789 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:08:34.092789 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:08:34.092789 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:08:34.092789 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 55ea476c41904e458bae79e7dad5d654 Aug 31 16:08:34.092789 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-MigrationsAdminTest-925549718 Aug 31 16:08:34.092789 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:08:34.092789 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:08:34.092789 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/55ea476c41904e458bae79e7dad5d654"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/55ea476c41904e458bae79e7dad5d654"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_55ea476c41904e458bae79e7dad5d654", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/55ea476c41904e458bae79e7dad5d654"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:08:34.092789 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-MigrationsAdminTest-925549718 Aug 31 16:08:34.092789 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 55ea476c41904e458bae79e7dad5d654 Aug 31 16:08:34.092789 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-MigrationsAdminTest-925549718 Aug 31 16:08:34.092789 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-MigrationsAdminTest-925549718-project Aug 31 16:08:34.092789 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:08:34.092789 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:08:34.092789 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 0a552442b7e94406b1689baf7a23fa52 Aug 31 16:08:34.092789 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-MigrationsAdminTest-925549718-project Aug 31 16:08:34.092789 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:08:34.092789 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance 6e82c98f-d644-4464-aca0-13901e551aa4 could not be found. Aug 31 16:08:34.092789 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '6e82c98f-d644-4464-aca0-13901e551aa4'} Aug 31 16:08:34.092789 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:08:34.092789 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:08:34.092789 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:08:34.092789 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:08:34.092789 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:08:34.092789 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:08:34.092789 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:08:34.092789 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:08:34.092789 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:08:34.092789 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:08:34.092789 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e82c98f-d644-4464-aca0-13901e551aa4 could not be found. Aug 31 16:08:34.092789 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:08:34.092789 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:08:34.092789 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:08:34.092789 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:08:34.092789 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:08:34.092789 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:08:34.092789 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:08:34.092789 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:08:34.092789 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:08:34.092789 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:08:34.092789 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:08:34.092789 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:08:34.092789 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:08:34.092789 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:08:34.092789 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:08:34.092789 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:08:34.092789 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e82c98f-d644-4464-aca0-13901e551aa4 could not be found. Aug 31 16:08:34.092789 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:08:34.092789 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:08:34.092789 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:08:34.098283 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:08:34.098283 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:08:34.098283 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:08:34.098283 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:08:34.098283 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:08:34.098283 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e82c98f-d644-4464-aca0-13901e551aa4 could not be found. Aug 31 16:08:34.098283 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:08:34.102941 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-081e64a6-6991-4938-81d0-e6e74631fe1a tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Returning 404 to user: Instance 6e82c98f-d644-4464-aca0-13901e551aa4 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:08:34.107578 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-081e64a6-6991-4938-81d0-e6e74631fe1a tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4" status: 404 len: 111 microversion: 2.1 time: 0.128054 Aug 31 16:08:34.112822 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1464/2944] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:33 2022] GET /compute/v2.1/servers/6e82c98f-d644-4464-aca0-13901e551aa4 => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:08:34.126573 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6bb5f8e6-11b4-4143-beca-53fd4dad657b tempest-SecurityGroupsTestAdminJSON-1104765286 tempest-SecurityGroupsTestAdminJSON-1104765286-project-admin] Calling method '.version_select at 0x7f5ae8419940>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:34.300287 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8e35a759-3cfe-49a3-b3b1-e23a324f3b67 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:34.329466 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8e35a759-3cfe-49a3-b3b1-e23a324f3b67 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/0a5d6a47-ce38-4d1d-8d97-550f5e950af5" status: 200 len: 1511 microversion: 2.1 time: 0.651091 Aug 31 16:08:34.340616 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1481/2945] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:33 2022] GET /compute/v2.1/servers/0a5d6a47-ce38-4d1d-8d97-550f5e950af5 => generated 1511 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:34.359018 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7ad9d8f1-1f82-4227-8b02-cc7910f400f0 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '.version_select at 0x7f5ae8eecd30>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:34.908378 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6bb5f8e6-11b4-4143-beca-53fd4dad657b tempest-SecurityGroupsTestAdminJSON-1104765286 tempest-SecurityGroupsTestAdminJSON-1104765286-project-admin] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/d2766770-2aee-47da-a1f9-98073ebc3a01" status: 202 len: 0 microversion: 2.1 time: 0.793076 Aug 31 16:08:34.910066 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1465/2946] 10.222.0.61 () {58 vars in 1272 bytes} [Wed Aug 31 16:08:34 2022] DELETE /compute/v2.1/os-security-groups/d2766770-2aee-47da-a1f9-98073ebc3a01 => generated 0 bytes in 796 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:08:34.915269 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7ad9d8f1-1f82-4227-8b02-cc7910f400f0 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "DELETE /compute/v2.1/images/04a8a450-b36b-4c4d-b7ac-78645bdf7885" status: 204 len: 0 microversion: 2.1 time: 0.572930 Aug 31 16:08:34.920034 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6bd831dd-447b-4265-b545-e8abeab979a8 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:34.920034 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6bd831dd-447b-4265-b545-e8abeab979a8 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6c7489e2-1ba0-4689-b2d7-e37886757266] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:34.920736 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1482/2947] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:34 2022] DELETE /compute/v2.1/images/04a8a450-b36b-4c4d-b7ac-78645bdf7885 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:08:34.929422 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-6fb4f003-a501-4b82-a619-07a0bb96d216 req-7345a2c7-8800-4f6f-a4ed-63cb5fb46501 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e82c98f-d644-4464-aca0-13901e551aa4", "name": "network-vif-deleted", "tag": "0dddc681-0580-40ec-b2fe-b4af40412267"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:08:34.941098 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6bd831dd-447b-4265-b545-e8abeab979a8 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:34.942606 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6bd831dd-447b-4265-b545-e8abeab979a8 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:34.944081 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6bd831dd-447b-4265-b545-e8abeab979a8 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:34.946455 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6bd831dd-447b-4265-b545-e8abeab979a8 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:34.951578 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6bd831dd-447b-4265-b545-e8abeab979a8 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:34.952374 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6bd831dd-447b-4265-b545-e8abeab979a8 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:34.972326 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-6fb4f003-a501-4b82-a619-07a0bb96d216 req-7345a2c7-8800-4f6f-a4ed-63cb5fb46501 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:34.972828 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-6fb4f003-a501-4b82-a619-07a0bb96d216 req-7345a2c7-8800-4f6f-a4ed-63cb5fb46501 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:34.973270 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-6fb4f003-a501-4b82-a619-07a0bb96d216 req-7345a2c7-8800-4f6f-a4ed-63cb5fb46501 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:34.989669 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-6fb4f003-a501-4b82-a619-07a0bb96d216 req-7345a2c7-8800-4f6f-a4ed-63cb5fb46501 service nova] Creating event network-vif-deleted:0dddc681-0580-40ec-b2fe-b4af40412267 for instance 6e82c98f-d644-4464-aca0-13901e551aa4 on n-h1-850499-9 Aug 31 16:08:34.997977 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-6fb4f003-a501-4b82-a619-07a0bb96d216 req-7345a2c7-8800-4f6f-a4ed-63cb5fb46501 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075375 Aug 31 16:08:35.000819 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1483/2948] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:08:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:08:35.012822 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-31c616aa-cd51-49c8-a0af-3e7087c4f944 tempest-SecurityGroupsTestAdminJSON-1104765286 tempest-SecurityGroupsTestAdminJSON-1104765286-project-admin] Calling method '.version_select at 0x7f5ae8e53af0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:35.054035 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6bd831dd-447b-4265-b545-e8abeab979a8 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6c7489e2-1ba0-4689-b2d7-e37886757266] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:08:35.143469 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=24 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:08:35.309836 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6bd831dd-447b-4265-b545-e8abeab979a8 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "DELETE /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266" status: 204 len: 0 microversion: 2.1 time: 0.389582 Aug 31 16:08:35.316180 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1466/2949] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:08:34 2022] DELETE /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:08:35.324358 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a9fbb4bb-50c8-4b46-b037-da0e75042c82 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] Calling method '.version_select at 0x7f5ae84cfaf0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:35.781646 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-31c616aa-cd51-49c8-a0af-3e7087c4f944 tempest-SecurityGroupsTestAdminJSON-1104765286 tempest-SecurityGroupsTestAdminJSON-1104765286-project-admin] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/ac78a95b-0d46-48a1-94ca-984c5451402c" status: 202 len: 0 microversion: 2.1 time: 0.778588 Aug 31 16:08:35.787419 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1484/2950] 10.222.0.61 () {58 vars in 1272 bytes} [Wed Aug 31 16:08:35 2022] DELETE /compute/v2.1/os-security-groups/ac78a95b-0d46-48a1-94ca-984c5451402c => generated 0 bytes in 785 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:08:35.800366 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-618fb238-6e13-44bc-9e86-2b870447a010 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:35.810131 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-618fb238-6e13-44bc-9e86-2b870447a010 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6c7489e2-1ba0-4689-b2d7-e37886757266] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:35.857805 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-618fb238-6e13-44bc-9e86-2b870447a010 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:35.861313 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-618fb238-6e13-44bc-9e86-2b870447a010 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:35.861906 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-618fb238-6e13-44bc-9e86-2b870447a010 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:35.867013 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-618fb238-6e13-44bc-9e86-2b870447a010 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:35.868102 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-618fb238-6e13-44bc-9e86-2b870447a010 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:35.870584 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-618fb238-6e13-44bc-9e86-2b870447a010 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:36.433051 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a9fbb4bb-50c8-4b46-b037-da0e75042c82 tempest-ListImageFiltersTestJSON-185321200 tempest-ListImageFiltersTestJSON-185321200-project] 10.222.0.61 "DELETE /compute/v2.1/images/fe00e385-6709-4c5e-9db0-e15f3717ff7f" status: 204 len: 0 microversion: 2.1 time: 1.114132 Aug 31 16:08:36.438401 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1467/2951] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:35 2022] DELETE /compute/v2.1/images/fe00e385-6709-4c5e-9db0-e15f3717ff7f => generated 0 bytes in 1118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:08:36.443602 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a6040c95-d96a-4785-a053-127205a733b2 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:36.444363 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a6040c95-d96a-4785-a053-127205a733b2 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 0a5d6a47-ce38-4d1d-8d97-550f5e950af5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:36.472819 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a6040c95-d96a-4785-a053-127205a733b2 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:36.475534 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a6040c95-d96a-4785-a053-127205a733b2 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:36.476300 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a6040c95-d96a-4785-a053-127205a733b2 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:36.477248 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a6040c95-d96a-4785-a053-127205a733b2 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:36.480242 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a6040c95-d96a-4785-a053-127205a733b2 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:36.481527 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a6040c95-d96a-4785-a053-127205a733b2 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:36.941589 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a6040c95-d96a-4785-a053-127205a733b2 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:36.964444 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a6040c95-d96a-4785-a053-127205a733b2 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/0a5d6a47-ce38-4d1d-8d97-550f5e950af5" status: 200 len: 1511 microversion: 2.1 time: 0.524825 Aug 31 16:08:36.971106 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1468/2952] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:36 2022] GET /compute/v2.1/servers/0a5d6a47-ce38-4d1d-8d97-550f5e950af5 => generated 1511 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:36.995434 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6fec368e-5de4-4430-8863-8f506e2db000 tempest-SecurityGroupsTestAdminJSON-594959433 tempest-SecurityGroupsTestAdminJSON-594959433-project] Calling method '.version_select at 0x7f5ae8cdc4c0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:37.547409 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-618fb238-6e13-44bc-9e86-2b870447a010 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:37.575573 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-618fb238-6e13-44bc-9e86-2b870447a010 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266" status: 200 len: 1468 microversion: 2.1 time: 1.781337 Aug 31 16:08:37.576696 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1485/2953] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:35 2022] GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266 => generated 1468 bytes in 1788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:38.003859 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-395f5889-f294-4fd5-9ef1-9b482e8b9e6c tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Action: 'create', calling method: .version_select at 0x7f5ae92e83a0>, body: {"keypair": {"name": "tempest-keypair-1779875600", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLAfhuusUrz+NW8udbNvVhsdaQ1e4AwzYXcCJ0y2KOYWvONRsmBriuifdFUyoFKy8W4XGVfxRd+SEK14VDrZI2A6P7bKPOjp6vst9+CJo+arAaU+mwB9XIA85+lhxVQs9A=="}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:08:38.029699 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-395f5889-f294-4fd5-9ef1-9b482e8b9e6c tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Getting quotas for project 55320a9c8f714bc0911ded3ab88ddf31. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:08:38.085662 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-395f5889-f294-4fd5-9ef1-9b482e8b9e6c tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Getting quotas for user c65ee5ffa9d74bfdacbea45f1564d19a and project 55320a9c8f714bc0911ded3ab88ddf31. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:08:38.135941 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-395f5889-f294-4fd5-9ef1-9b482e8b9e6c tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.555619 Aug 31 16:08:38.137083 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1486/2954] 10.222.0.61 () {60 vars in 1159 bytes} [Wed Aug 31 16:08:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:08:38.143392 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8a6c078b-f59b-433b-beea-114b0a7553a0 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:38.144561 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8a6c078b-f59b-433b-beea-114b0a7553a0 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 0a5d6a47-ce38-4d1d-8d97-550f5e950af5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:38.158232 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8a6c078b-f59b-433b-beea-114b0a7553a0 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:38.160472 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8a6c078b-f59b-433b-beea-114b0a7553a0 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:38.161343 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8a6c078b-f59b-433b-beea-114b0a7553a0 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:38.163794 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8a6c078b-f59b-433b-beea-114b0a7553a0 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:38.166569 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8a6c078b-f59b-433b-beea-114b0a7553a0 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:38.167644 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8a6c078b-f59b-433b-beea-114b0a7553a0 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:38.986255 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6fec368e-5de4-4430-8863-8f506e2db000 tempest-SecurityGroupsTestAdminJSON-594959433 tempest-SecurityGroupsTestAdminJSON-594959433-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/f64b4131-e019-45fb-9047-13b17a28d3e8" status: 202 len: 0 microversion: 2.1 time: 2.013311 Aug 31 16:08:38.987099 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1469/2955] 10.222.0.61 () {58 vars in 1272 bytes} [Wed Aug 31 16:08:36 2022] DELETE /compute/v2.1/os-security-groups/f64b4131-e019-45fb-9047-13b17a28d3e8 => generated 0 bytes in 2015 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:08:38.998283 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0aad86ca-a628-4352-981f-bb0e8792c963 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:39.004789 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0aad86ca-a628-4352-981f-bb0e8792c963 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6c7489e2-1ba0-4689-b2d7-e37886757266] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:39.050163 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0aad86ca-a628-4352-981f-bb0e8792c963 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:39.052197 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0aad86ca-a628-4352-981f-bb0e8792c963 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:39.052924 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0aad86ca-a628-4352-981f-bb0e8792c963 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:39.055231 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0aad86ca-a628-4352-981f-bb0e8792c963 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:39.058214 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0aad86ca-a628-4352-981f-bb0e8792c963 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:39.059650 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0aad86ca-a628-4352-981f-bb0e8792c963 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:39.282308 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0aad86ca-a628-4352-981f-bb0e8792c963 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:39.323861 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=95,nova_cell1:UPDATE=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:08:39.325788 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8a6c078b-f59b-433b-beea-114b0a7553a0 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:39.359636 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0aad86ca-a628-4352-981f-bb0e8792c963 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266" status: 200 len: 1426 microversion: 2.1 time: 0.365347 Aug 31 16:08:39.367182 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8a6c078b-f59b-433b-beea-114b0a7553a0 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/0a5d6a47-ce38-4d1d-8d97-550f5e950af5" status: 200 len: 1511 microversion: 2.1 time: 1.225652 Aug 31 16:08:39.369896 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1487/2956] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:38 2022] GET /compute/v2.1/servers/0a5d6a47-ce38-4d1d-8d97-550f5e950af5 => generated 1511 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:39.374213 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1470/2957] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:38 2022] GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266 => generated 1426 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:39.385373 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-12c7ab3d-a6cf-470e-899d-cf42fe21948c tempest-SecurityGroupsTestAdminJSON-594959433 tempest-SecurityGroupsTestAdminJSON-594959433-project] Calling method '.version_select at 0x7f5ae934c3a0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:39.648988 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-67f5f857-4d94-42fd-adc4-3de975e33ca4 req-4102b11f-b8e1-4869-b045-63fcca31610e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c7489e2-1ba0-4689-b2d7-e37886757266", "name": "network-vif-deleted", "tag": "e136c42f-9bc1-433f-8e80-0837c9be0717"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:08:39.677638 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-67f5f857-4d94-42fd-adc4-3de975e33ca4 req-4102b11f-b8e1-4869-b045-63fcca31610e service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:39.678646 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-67f5f857-4d94-42fd-adc4-3de975e33ca4 req-4102b11f-b8e1-4869-b045-63fcca31610e service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:39.679480 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-67f5f857-4d94-42fd-adc4-3de975e33ca4 req-4102b11f-b8e1-4869-b045-63fcca31610e service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:39.720333 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-67f5f857-4d94-42fd-adc4-3de975e33ca4 req-4102b11f-b8e1-4869-b045-63fcca31610e service nova] Creating event network-vif-deleted:e136c42f-9bc1-433f-8e80-0837c9be0717 for instance 6c7489e2-1ba0-4689-b2d7-e37886757266 on n-h1-850499-9 Aug 31 16:08:39.730570 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-67f5f857-4d94-42fd-adc4-3de975e33ca4 req-4102b11f-b8e1-4869-b045-63fcca31610e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099032 Aug 31 16:08:39.740420 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1471/2958] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:08:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:08:40.398644 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2744cf91-8f94-45b8-b61a-b8715c657a23 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:40.402661 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2744cf91-8f94-45b8-b61a-b8715c657a23 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6c7489e2-1ba0-4689-b2d7-e37886757266] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:40.409816 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2744cf91-8f94-45b8-b61a-b8715c657a23 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:40.410830 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2744cf91-8f94-45b8-b61a-b8715c657a23 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:40.411484 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2744cf91-8f94-45b8-b61a-b8715c657a23 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:40.412424 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2744cf91-8f94-45b8-b61a-b8715c657a23 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:40.413049 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2744cf91-8f94-45b8-b61a-b8715c657a23 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:40.413830 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2744cf91-8f94-45b8-b61a-b8715c657a23 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:40.495699 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2744cf91-8f94-45b8-b61a-b8715c657a23 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:40.497118 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2744cf91-8f94-45b8-b61a-b8715c657a23 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:40.497633 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2744cf91-8f94-45b8-b61a-b8715c657a23 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:40.500731 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-2744cf91-8f94-45b8-b61a-b8715c657a23 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lazy-loading 'fault' on Instance uuid 6c7489e2-1ba0-4689-b2d7-e37886757266 {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:08:40.541601 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-12c7ab3d-a6cf-470e-899d-cf42fe21948c tempest-SecurityGroupsTestAdminJSON-594959433 tempest-SecurityGroupsTestAdminJSON-594959433-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/b75ffcf3-9041-4c19-a77c-742ea00de48c" status: 202 len: 0 microversion: 2.1 time: 1.170265 Aug 31 16:08:40.543909 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1488/2959] 10.222.0.61 () {58 vars in 1272 bytes} [Wed Aug 31 16:08:39 2022] DELETE /compute/v2.1/os-security-groups/b75ffcf3-9041-4c19-a77c-742ea00de48c => generated 0 bytes in 1173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:08:40.568252 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-fb217ebe-9b3e-4367-a7f8-9ef390c518cd tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:40.569396 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-fb217ebe-9b3e-4367-a7f8-9ef390c518cd tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 0a5d6a47-ce38-4d1d-8d97-550f5e950af5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:40.614516 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fb217ebe-9b3e-4367-a7f8-9ef390c518cd tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:40.619900 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fb217ebe-9b3e-4367-a7f8-9ef390c518cd tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:40.620665 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fb217ebe-9b3e-4367-a7f8-9ef390c518cd tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:40.621897 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fb217ebe-9b3e-4367-a7f8-9ef390c518cd tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:40.622537 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fb217ebe-9b3e-4367-a7f8-9ef390c518cd tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:40.625288 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fb217ebe-9b3e-4367-a7f8-9ef390c518cd tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:40.637383 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2744cf91-8f94-45b8-b61a-b8715c657a23 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a552442b7e94406b1689baf7a23fa52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ea476c41904e458bae79e7dad5d654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:40.658205 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2744cf91-8f94-45b8-b61a-b8715c657a23 tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266" status: 200 len: 1303 microversion: 2.1 time: 0.260109 Aug 31 16:08:40.659913 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1472/2960] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:40 2022] GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266 => generated 1303 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:08:41.248321 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-fb217ebe-9b3e-4367-a7f8-9ef390c518cd tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:41.300713 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-fb217ebe-9b3e-4367-a7f8-9ef390c518cd tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/0a5d6a47-ce38-4d1d-8d97-550f5e950af5" status: 200 len: 1511 microversion: 2.1 time: 0.752691 Aug 31 16:08:41.303989 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1489/2961] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:40 2022] GET /compute/v2.1/servers/0a5d6a47-ce38-4d1d-8d97-550f5e950af5 => generated 1511 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:41.659357 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d2761fc4-7ed2-4eeb-93ef-cda4f2d7bd10 tempest-KeyPairsV2TestJSON-742394382 tempest-KeyPairsV2TestJSON-742394382-project] Action: 'create', calling method: .version_select at 0x7f5ae8cdca60>, body: {"keypair": {"name": "tempest-keypair-884291831", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCFTQI9Fhr+7IYu0PiGKJ52qnizB+gSheDmDgvxVmqvCQRQUkfY4MiPfAH8GZu8GcWIsLHV/eVFJaG9O3xBnv+8IiSfjlHc3oxqijbIBMuJQeP13YXG229ODrfFYj46enQ=="}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:08:41.683595 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-d2761fc4-7ed2-4eeb-93ef-cda4f2d7bd10 tempest-KeyPairsV2TestJSON-742394382 tempest-KeyPairsV2TestJSON-742394382-project] Getting quotas for project 2fa1b2d6cfc449a28320916c7bf5dd94. Resources: {'key_pairs'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:08:41.691235 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0e41d26d-9ffe-480b-86b8-92c27c5b949f tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:41.692554 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0e41d26d-9ffe-480b-86b8-92c27c5b949f tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] [instance: 6c7489e2-1ba0-4689-b2d7-e37886757266] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:41.693598 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-d2761fc4-7ed2-4eeb-93ef-cda4f2d7bd10 tempest-KeyPairsV2TestJSON-742394382 tempest-KeyPairsV2TestJSON-742394382-project] Getting quotas for user 5cb9ca2597da48e1a3e4468c11c53517 and project 2fa1b2d6cfc449a28320916c7bf5dd94. Resources: {'key_pairs'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:08:41.729976 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0e41d26d-9ffe-480b-86b8-92c27c5b949f tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:41.730952 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0e41d26d-9ffe-480b-86b8-92c27c5b949f tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:41.731824 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0e41d26d-9ffe-480b-86b8-92c27c5b949f tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:41.733371 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0e41d26d-9ffe-480b-86b8-92c27c5b949f tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:41.734203 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0e41d26d-9ffe-480b-86b8-92c27c5b949f tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:41.737022 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0e41d26d-9ffe-480b-86b8-92c27c5b949f tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:41.738478 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d2761fc4-7ed2-4eeb-93ef-cda4f2d7bd10 tempest-KeyPairsV2TestJSON-742394382 tempest-KeyPairsV2TestJSON-742394382-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.571915 Aug 31 16:08:41.745327 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1473/2962] 10.222.0.61 () {60 vars in 1159 bytes} [Wed Aug 31 16:08:41 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:08:41.752511 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-346ef577-c274-4d44-b4f9-968c93d0e05f tempest-KeyPairsV2TestJSON-742394382 tempest-KeyPairsV2TestJSON-742394382-project] Calling method '.version_select at 0x7f5ae84cfee0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:41.763876 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-346ef577-c274-4d44-b4f9-968c93d0e05f tempest-KeyPairsV2TestJSON-742394382 tempest-KeyPairsV2TestJSON-742394382-project] 10.222.0.61 "GET /compute/v2.1/os-keypairs/tempest-keypair-884291831" status: 200 len: 497 microversion: 2.1 time: 0.017101 Aug 31 16:08:41.767545 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1474/2963] 10.222.0.61 () {58 vars in 1215 bytes} [Wed Aug 31 16:08:41 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-884291831 => generated 497 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:08:41.779744 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-87546d5d-4d58-4d43-b778-58d85e40767d tempest-KeyPairsV2TestJSON-742394382 tempest-KeyPairsV2TestJSON-742394382-project] Calling method '.version_select at 0x7f5ae84e6280>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:41.809977 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-0e41d26d-9ffe-480b-86b8-92c27c5b949f tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] HTTP exception thrown: Instance 6c7489e2-1ba0-4689-b2d7-e37886757266 could not be found. Aug 31 16:08:41.812536 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0e41d26d-9ffe-480b-86b8-92c27c5b949f tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Request method failure captured: Aug 31 16:08:41.812536 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266 HTTP/1.1 Aug 31 16:08:41.812536 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:08:41.812536 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:08:41.812536 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:08:41.812536 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:08:41.812536 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:08:41.812536 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:08:41.812536 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:08:41.812536 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:08:41.812536 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4XCW8vlmi5ifUcmnrjxPNarpAxpfywGPf-yd0UXQDJn2VdmP64lnoSqfVFZOcHY2qwW0yLEixf1Z23Zt4Nnq_GfiTivZJ0pmJbIGzYCbyd170Z4KfuU55yKEE3eYeNWcxHNH6myZAsB0F1tRELNR62UNRY-BZzGiOmXdQUpaWONroQ Aug 31 16:08:41.812536 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:08:41.812536 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:08:41.812536 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:08:41.812536 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:08:41.812536 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:08:41.812536 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:08:41.812536 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 55ea476c41904e458bae79e7dad5d654 Aug 31 16:08:41.812536 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-MigrationsAdminTest-925549718 Aug 31 16:08:41.812536 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:08:41.812536 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:08:41.812536 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/55ea476c41904e458bae79e7dad5d654"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/55ea476c41904e458bae79e7dad5d654"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_55ea476c41904e458bae79e7dad5d654", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/55ea476c41904e458bae79e7dad5d654"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:08:41.812536 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-MigrationsAdminTest-925549718 Aug 31 16:08:41.812536 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 55ea476c41904e458bae79e7dad5d654 Aug 31 16:08:41.812536 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-MigrationsAdminTest-925549718 Aug 31 16:08:41.812536 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-MigrationsAdminTest-925549718-project Aug 31 16:08:41.812536 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:08:41.812536 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:08:41.812536 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 0a552442b7e94406b1689baf7a23fa52 Aug 31 16:08:41.812536 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-MigrationsAdminTest-925549718-project Aug 31 16:08:41.812536 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:08:41.812536 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance 6c7489e2-1ba0-4689-b2d7-e37886757266 could not be found. Aug 31 16:08:41.812536 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '6c7489e2-1ba0-4689-b2d7-e37886757266'} Aug 31 16:08:41.812536 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:08:41.812536 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:08:41.812536 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:08:41.812536 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:08:41.812536 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:08:41.812536 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:08:41.812536 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:08:41.812536 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:08:41.812536 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:08:41.812536 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:08:41.812536 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c7489e2-1ba0-4689-b2d7-e37886757266 could not be found. Aug 31 16:08:41.812536 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:08:41.812536 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:08:41.812536 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:08:41.812536 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:08:41.812536 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:08:41.812536 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:08:41.812536 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:08:41.812536 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:08:41.812536 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:08:41.812536 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:08:41.812536 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:08:41.812536 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:08:41.812536 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:08:41.812536 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:08:41.812536 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:08:41.812536 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:08:41.812536 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c7489e2-1ba0-4689-b2d7-e37886757266 could not be found. Aug 31 16:08:41.812536 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:08:41.812536 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:08:41.812536 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:08:41.817267 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:08:41.817267 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:08:41.817267 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:08:41.817267 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:08:41.817267 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:08:41.817267 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c7489e2-1ba0-4689-b2d7-e37886757266 could not be found. Aug 31 16:08:41.817267 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:08:41.818951 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0e41d26d-9ffe-480b-86b8-92c27c5b949f tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] Returning 404 to user: Instance 6c7489e2-1ba0-4689-b2d7-e37886757266 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:08:41.820050 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0e41d26d-9ffe-480b-86b8-92c27c5b949f tempest-MigrationsAdminTest-925549718 tempest-MigrationsAdminTest-925549718-project] 10.222.0.61 "GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266" status: 404 len: 111 microversion: 2.1 time: 0.135425 Aug 31 16:08:41.827679 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1490/2964] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:41 2022] GET /compute/v2.1/servers/6c7489e2-1ba0-4689-b2d7-e37886757266 => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 16:08:41.837163 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-87546d5d-4d58-4d43-b778-58d85e40767d tempest-KeyPairsV2TestJSON-742394382 tempest-KeyPairsV2TestJSON-742394382-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-884291831" status: 202 len: 0 microversion: 2.1 time: 0.064608 Aug 31 16:08:41.838505 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1475/2965] 10.222.0.61 () {58 vars in 1218 bytes} [Wed Aug 31 16:08:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-884291831 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:08:41.853061 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-324ac2f1-7d7d-4778-b28c-7b5e45ff16f6 tempest-KeyPairsV2TestJSON-742394382 tempest-KeyPairsV2TestJSON-742394382-project] Action: 'create', calling method: .version_select at 0x7f5ae929f670>, body: {"keypair": {"name": "tempest-keypair-2119608327", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGR7XurI3Kjs25lZ/csUWUrcxTHTX1UGMwzvmlYFEgWknrp6lxuktPd5hl2PLl19lhcpk9aFO63MSMQtrqDIujZ+hNfMg6zaS70J7o+WUxGObcI6rbirlrVSVacI9haV2g=="}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:08:41.872767 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-324ac2f1-7d7d-4778-b28c-7b5e45ff16f6 tempest-KeyPairsV2TestJSON-742394382 tempest-KeyPairsV2TestJSON-742394382-project] Getting quotas for project 2fa1b2d6cfc449a28320916c7bf5dd94. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:08:41.874894 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:08:41.880952 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-324ac2f1-7d7d-4778-b28c-7b5e45ff16f6 tempest-KeyPairsV2TestJSON-742394382 tempest-KeyPairsV2TestJSON-742394382-project] Getting quotas for user 5cb9ca2597da48e1a3e4468c11c53517 and project 2fa1b2d6cfc449a28320916c7bf5dd94. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:08:41.943085 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-324ac2f1-7d7d-4778-b28c-7b5e45ff16f6 tempest-KeyPairsV2TestJSON-742394382 tempest-KeyPairsV2TestJSON-742394382-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.094452 Aug 31 16:08:41.944926 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1491/2966] 10.222.0.61 () {60 vars in 1159 bytes} [Wed Aug 31 16:08:41 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:08:41.960191 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d774f363-633b-4c9f-9b6d-298d25460099 tempest-KeyPairsV2TestJSON-742394382 tempest-KeyPairsV2TestJSON-742394382-project] Calling method '.version_select at 0x7f5ae856ba60>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:42.015963 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d774f363-633b-4c9f-9b6d-298d25460099 tempest-KeyPairsV2TestJSON-742394382 tempest-KeyPairsV2TestJSON-742394382-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2119608327" status: 202 len: 0 microversion: 2.1 time: 0.062336 Aug 31 16:08:42.021073 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1476/2967] 10.222.0.61 () {58 vars in 1221 bytes} [Wed Aug 31 16:08:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2119608327 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:08:42.027125 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5e173e18-87ce-42d7-bcab-99b38494b75a tempest-KeyPairsV2TestJSON-742394382 tempest-KeyPairsV2TestJSON-742394382-project] Action: 'create', calling method: .version_select at 0x7f5ae9576280>, body: {"keypair": {"name": "tempest-keypair-518434341", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:08:42.073362 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-5e173e18-87ce-42d7-bcab-99b38494b75a tempest-KeyPairsV2TestJSON-742394382 tempest-KeyPairsV2TestJSON-742394382-project] Getting quotas for project 2fa1b2d6cfc449a28320916c7bf5dd94. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:08:42.109898 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-5e173e18-87ce-42d7-bcab-99b38494b75a tempest-KeyPairsV2TestJSON-742394382 tempest-KeyPairsV2TestJSON-742394382-project] Getting quotas for user 5cb9ca2597da48e1a3e4468c11c53517 and project 2fa1b2d6cfc449a28320916c7bf5dd94. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:08:42.220147 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5e173e18-87ce-42d7-bcab-99b38494b75a tempest-KeyPairsV2TestJSON-742394382 tempest-KeyPairsV2TestJSON-742394382-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 573 microversion: 2.1 time: 0.197393 Aug 31 16:08:42.223458 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1492/2968] 10.222.0.61 () {60 vars in 1159 bytes} [Wed Aug 31 16:08:42 2022] POST /compute/v2.1/os-keypairs => generated 573 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:08:42.241568 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7f4833b4-4cda-4b19-9d24-09d1dfd3f392 tempest-KeyPairsV2TestJSON-742394382 tempest-KeyPairsV2TestJSON-742394382-project] Calling method '.version_select at 0x7f5aed106af0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:42.291445 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7f4833b4-4cda-4b19-9d24-09d1dfd3f392 tempest-KeyPairsV2TestJSON-742394382 tempest-KeyPairsV2TestJSON-742394382-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-518434341" status: 202 len: 0 microversion: 2.1 time: 0.059281 Aug 31 16:08:42.301106 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1477/2969] 10.222.0.61 () {58 vars in 1218 bytes} [Wed Aug 31 16:08:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-518434341 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:08:42.309647 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-646e8491-601d-47d9-b32b-4770bcf7093c tempest-KeyPairsV2TestJSON-742394382 tempest-KeyPairsV2TestJSON-742394382-project] Action: 'create', calling method: .version_select at 0x7f5ae928e790>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-47287998", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDLOdWZ5mAikOpPGjiwrs4UhS9p1hEqO4HUEj3s9iRWHW0XzZYwI1eSCgHRfXpEd5dIpq4SyT3nhBfiaiXDZnSXBTysVaa860gOe/Qx1+aQPJ9NeiOO0e8XGzh5UCfPxiA=="}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:08:42.332371 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-65cc1937-ff55-445b-a9bd-c7235d0fba9a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:42.333262 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-65cc1937-ff55-445b-a9bd-c7235d0fba9a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 0a5d6a47-ce38-4d1d-8d97-550f5e950af5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:42.354133 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-65cc1937-ff55-445b-a9bd-c7235d0fba9a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:42.354647 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-65cc1937-ff55-445b-a9bd-c7235d0fba9a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:42.355130 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-65cc1937-ff55-445b-a9bd-c7235d0fba9a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:42.366565 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-65cc1937-ff55-445b-a9bd-c7235d0fba9a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:42.369545 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-65cc1937-ff55-445b-a9bd-c7235d0fba9a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:42.370232 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-65cc1937-ff55-445b-a9bd-c7235d0fba9a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:42.376665 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-646e8491-601d-47d9-b32b-4770bcf7093c tempest-KeyPairsV2TestJSON-742394382 tempest-KeyPairsV2TestJSON-742394382-project] Getting quotas for project 2fa1b2d6cfc449a28320916c7bf5dd94. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:08:42.390595 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-646e8491-601d-47d9-b32b-4770bcf7093c tempest-KeyPairsV2TestJSON-742394382 tempest-KeyPairsV2TestJSON-742394382-project] Getting quotas for user 5cb9ca2597da48e1a3e4468c11c53517 and project 2fa1b2d6cfc449a28320916c7bf5dd94. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:08:42.440184 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-646e8491-601d-47d9-b32b-4770bcf7093c tempest-KeyPairsV2TestJSON-742394382 tempest-KeyPairsV2TestJSON-742394382-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.137744 Aug 31 16:08:42.441490 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1493/2970] 10.222.0.61 () {60 vars in 1159 bytes} [Wed Aug 31 16:08:42 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:08:42.467767 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-389815ae-b77c-4f2a-be9e-a830477d859f tempest-KeyPairsV2TestJSON-742394382 tempest-KeyPairsV2TestJSON-742394382-project] Action: 'create', calling method: .version_select at 0x7f5ae929f670>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-633612154", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFuq/erhKd6QupYqtmZtfc/izL1i2KTGcHBYjwP52NI22HdAXOCoSCE21eYW7Erc8d4io8FGeFXmyD2CsDA5RM9GlgsqT+aHCB8cfiivZXMqQkfCIOiH+g/cmVYBWjKBVQ=="}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:08:42.511832 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-389815ae-b77c-4f2a-be9e-a830477d859f tempest-KeyPairsV2TestJSON-742394382 tempest-KeyPairsV2TestJSON-742394382-project] Getting quotas for project 2fa1b2d6cfc449a28320916c7bf5dd94. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:08:42.519480 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-389815ae-b77c-4f2a-be9e-a830477d859f tempest-KeyPairsV2TestJSON-742394382 tempest-KeyPairsV2TestJSON-742394382-project] Getting quotas for user 5cb9ca2597da48e1a3e4468c11c53517 and project 2fa1b2d6cfc449a28320916c7bf5dd94. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:08:42.565186 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-389815ae-b77c-4f2a-be9e-a830477d859f tempest-KeyPairsV2TestJSON-742394382 tempest-KeyPairsV2TestJSON-742394382-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.102076 Aug 31 16:08:42.567146 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1494/2971] 10.222.0.61 () {60 vars in 1159 bytes} [Wed Aug 31 16:08:42 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:08:42.604434 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-44e961f3-6c5f-43ca-a191-9fe94142c582 tempest-KeyPairsV2TestJSON-742394382 tempest-KeyPairsV2TestJSON-742394382-project] Action: 'create', calling method: .version_select at 0x7f5ae9333940>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1750422698", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHOsgGqSy0XIhVJLjxhbhcP75RPITCtD79gVnbR59B39fVPNSTzoJ6N1I9LiB1zFcHrVqHAIBYeZzI1ZqqXJVrBDfgbicQfoV0k7xVupv9ArsPVzO+mX9fNAkgTlpO4AdQ=="}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:08:42.628399 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-44e961f3-6c5f-43ca-a191-9fe94142c582 tempest-KeyPairsV2TestJSON-742394382 tempest-KeyPairsV2TestJSON-742394382-project] Getting quotas for project 2fa1b2d6cfc449a28320916c7bf5dd94. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:08:42.635944 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-44e961f3-6c5f-43ca-a191-9fe94142c582 tempest-KeyPairsV2TestJSON-742394382 tempest-KeyPairsV2TestJSON-742394382-project] Getting quotas for user 5cb9ca2597da48e1a3e4468c11c53517 and project 2fa1b2d6cfc449a28320916c7bf5dd94. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:08:42.733671 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-44e961f3-6c5f-43ca-a191-9fe94142c582 tempest-KeyPairsV2TestJSON-742394382 tempest-KeyPairsV2TestJSON-742394382-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.155978 Aug 31 16:08:42.734782 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1495/2972] 10.222.0.61 () {60 vars in 1159 bytes} [Wed Aug 31 16:08:42 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:08:42.745170 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-509b3af6-6da7-405d-b221-7c8fd70d9d5c tempest-KeyPairsV2TestJSON-742394382 tempest-KeyPairsV2TestJSON-742394382-project] Calling method '.version_select at 0x7f5ae94b4c10>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:42.755492 n-d-850499-9 devstack@n-api.service[122256]: WARNING oslo_db.sqlalchemy.utils [None req-509b3af6-6da7-405d-b221-7c8fd70d9d5c tempest-KeyPairsV2TestJSON-742394382 tempest-KeyPairsV2TestJSON-742394382-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 31 16:08:42.775428 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-509b3af6-6da7-405d-b221-7c8fd70d9d5c tempest-KeyPairsV2TestJSON-742394382 tempest-KeyPairsV2TestJSON-742394382-project] 10.222.0.61 "GET /compute/v2.1/os-keypairs" status: 200 len: 1091 microversion: 2.1 time: 0.033964 Aug 31 16:08:42.778975 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1496/2973] 10.222.0.61 () {58 vars in 1137 bytes} [Wed Aug 31 16:08:42 2022] GET /compute/v2.1/os-keypairs => generated 1091 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:08:42.798569 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1fe5b440-458b-495a-8e0d-134570c74f1b tempest-KeyPairsV2TestJSON-742394382 tempest-KeyPairsV2TestJSON-742394382-project] Calling method '.version_select at 0x7f5ae8dd20d0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:42.860530 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1fe5b440-458b-495a-8e0d-134570c74f1b tempest-KeyPairsV2TestJSON-742394382 tempest-KeyPairsV2TestJSON-742394382-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1750422698" status: 202 len: 0 microversion: 2.1 time: 0.070576 Aug 31 16:08:42.861540 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1497/2974] 10.222.0.61 () {58 vars in 1278 bytes} [Wed Aug 31 16:08:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1750422698 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:08:42.876456 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5407c337-8d7a-4066-b125-118b32927e00 tempest-KeyPairsV2TestJSON-742394382 tempest-KeyPairsV2TestJSON-742394382-project] Calling method '.version_select at 0x7f5ae9851d30>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:42.925311 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5407c337-8d7a-4066-b125-118b32927e00 tempest-KeyPairsV2TestJSON-742394382 tempest-KeyPairsV2TestJSON-742394382-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-633612154" status: 202 len: 0 microversion: 2.1 time: 0.058912 Aug 31 16:08:42.926175 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1498/2975] 10.222.0.61 () {58 vars in 1275 bytes} [Wed Aug 31 16:08:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-633612154 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:08:42.937087 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-21daeb30-6bdd-4f8c-9c37-720c1f958513 tempest-KeyPairsV2TestJSON-742394382 tempest-KeyPairsV2TestJSON-742394382-project] Calling method '.version_select at 0x7f5ae8dd2820>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:42.979483 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-21daeb30-6bdd-4f8c-9c37-720c1f958513 tempest-KeyPairsV2TestJSON-742394382 tempest-KeyPairsV2TestJSON-742394382-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-47287998" status: 202 len: 0 microversion: 2.1 time: 0.046545 Aug 31 16:08:42.985793 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1499/2976] 10.222.0.61 () {58 vars in 1272 bytes} [Wed Aug 31 16:08:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-47287998 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:08:43.334425 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-65cc1937-ff55-445b-a9bd-c7235d0fba9a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:43.356877 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-65cc1937-ff55-445b-a9bd-c7235d0fba9a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/0a5d6a47-ce38-4d1d-8d97-550f5e950af5" status: 200 len: 1511 microversion: 2.1 time: 1.028789 Aug 31 16:08:43.360956 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1478/2977] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:42 2022] GET /compute/v2.1/servers/0a5d6a47-ce38-4d1d-8d97-550f5e950af5 => generated 1511 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:44.398383 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-790d6714-d7f4-42b1-852b-c029f9c16de3 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:44.405276 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-790d6714-d7f4-42b1-852b-c029f9c16de3 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 0a5d6a47-ce38-4d1d-8d97-550f5e950af5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:44.445363 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-790d6714-d7f4-42b1-852b-c029f9c16de3 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:44.449922 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-790d6714-d7f4-42b1-852b-c029f9c16de3 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:44.453972 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-790d6714-d7f4-42b1-852b-c029f9c16de3 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:44.460007 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-790d6714-d7f4-42b1-852b-c029f9c16de3 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:44.461461 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-790d6714-d7f4-42b1-852b-c029f9c16de3 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:44.464759 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-790d6714-d7f4-42b1-852b-c029f9c16de3 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:45.695873 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f631e19e-e9fc-4b12-b06a-c0b9bf9a122c tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:45.697056 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f631e19e-e9fc-4b12-b06a-c0b9bf9a122c tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] [instance: 685d47e4-721e-4eae-b5f8-78fdb68454ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:45.717481 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f631e19e-e9fc-4b12-b06a-c0b9bf9a122c tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:45.717981 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f631e19e-e9fc-4b12-b06a-c0b9bf9a122c tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:45.718425 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f631e19e-e9fc-4b12-b06a-c0b9bf9a122c tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:45.719134 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f631e19e-e9fc-4b12-b06a-c0b9bf9a122c tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:45.719818 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f631e19e-e9fc-4b12-b06a-c0b9bf9a122c tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:45.720412 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f631e19e-e9fc-4b12-b06a-c0b9bf9a122c tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:46.041368 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-790d6714-d7f4-42b1-852b-c029f9c16de3 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:46.068983 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-790d6714-d7f4-42b1-852b-c029f9c16de3 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/0a5d6a47-ce38-4d1d-8d97-550f5e950af5" status: 200 len: 1511 microversion: 2.1 time: 1.683540 Aug 31 16:08:46.085872 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1500/2978] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:44 2022] GET /compute/v2.1/servers/0a5d6a47-ce38-4d1d-8d97-550f5e950af5 => generated 1511 bytes in 1702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:47.113560 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4f578899-e489-4aeb-80d2-75b446c12a00 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:47.114613 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4f578899-e489-4aeb-80d2-75b446c12a00 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 0a5d6a47-ce38-4d1d-8d97-550f5e950af5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:47.165788 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4f578899-e489-4aeb-80d2-75b446c12a00 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:47.169128 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4f578899-e489-4aeb-80d2-75b446c12a00 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:47.169931 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4f578899-e489-4aeb-80d2-75b446c12a00 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:47.173096 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4f578899-e489-4aeb-80d2-75b446c12a00 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:47.173909 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4f578899-e489-4aeb-80d2-75b446c12a00 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:47.174660 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4f578899-e489-4aeb-80d2-75b446c12a00 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:47.918862 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f631e19e-e9fc-4b12-b06a-c0b9bf9a122c tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:47.943187 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f631e19e-e9fc-4b12-b06a-c0b9bf9a122c tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:47.949461 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f631e19e-e9fc-4b12-b06a-c0b9bf9a122c tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:47.952848 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f631e19e-e9fc-4b12-b06a-c0b9bf9a122c tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] 10.222.0.61 "GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae" status: 200 len: 2955 microversion: 2.42 time: 2.261141 Aug 31 16:08:47.980936 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1479/2979] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:08:45 2022] GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae => generated 2955 bytes in 2290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:08:47.991773 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-da60badb-98c0-4244-85e2-b47f2a1ae73b tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:47.993842 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-da60badb-98c0-4244-85e2-b47f2a1ae73b tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] [instance: 685d47e4-721e-4eae-b5f8-78fdb68454ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:48.013139 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-da60badb-98c0-4244-85e2-b47f2a1ae73b tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:48.014819 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-da60badb-98c0-4244-85e2-b47f2a1ae73b tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:48.015609 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-da60badb-98c0-4244-85e2-b47f2a1ae73b tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:48.017667 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-da60badb-98c0-4244-85e2-b47f2a1ae73b tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:48.018868 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-da60badb-98c0-4244-85e2-b47f2a1ae73b tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:48.020167 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-da60badb-98c0-4244-85e2-b47f2a1ae73b tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:48.025939 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-4f578899-e489-4aeb-80d2-75b446c12a00 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:48.049325 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4f578899-e489-4aeb-80d2-75b446c12a00 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/0a5d6a47-ce38-4d1d-8d97-550f5e950af5" status: 200 len: 1511 microversion: 2.1 time: 0.949828 Aug 31 16:08:48.049963 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1501/2980] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:47 2022] GET /compute/v2.1/servers/0a5d6a47-ce38-4d1d-8d97-550f5e950af5 => generated 1511 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:48.756867 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-da60badb-98c0-4244-85e2-b47f2a1ae73b tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] 10.222.0.61 "GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae/os-interface" status: 200 len: 1833 microversion: 2.42 time: 0.769356 Aug 31 16:08:48.757474 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1480/2981] 10.222.0.61 () {60 vars in 1316 bytes} [Wed Aug 31 16:08:47 2022] GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae/os-interface => generated 1833 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:08:49.096382 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-42aa3fa4-bea4-4ab7-b7df-1a8ae2fd2985 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:49.097100 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-42aa3fa4-bea4-4ab7-b7df-1a8ae2fd2985 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 0a5d6a47-ce38-4d1d-8d97-550f5e950af5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:49.117357 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42aa3fa4-bea4-4ab7-b7df-1a8ae2fd2985 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:49.117927 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42aa3fa4-bea4-4ab7-b7df-1a8ae2fd2985 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:49.119229 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42aa3fa4-bea4-4ab7-b7df-1a8ae2fd2985 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:49.126344 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42aa3fa4-bea4-4ab7-b7df-1a8ae2fd2985 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:49.127202 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42aa3fa4-bea4-4ab7-b7df-1a8ae2fd2985 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:49.128750 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42aa3fa4-bea4-4ab7-b7df-1a8ae2fd2985 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:49.160169 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:08:50.051985 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-42aa3fa4-bea4-4ab7-b7df-1a8ae2fd2985 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:50.082429 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-42aa3fa4-bea4-4ab7-b7df-1a8ae2fd2985 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/0a5d6a47-ce38-4d1d-8d97-550f5e950af5" status: 200 len: 1511 microversion: 2.1 time: 0.989774 Aug 31 16:08:50.096653 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1502/2982] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:49 2022] GET /compute/v2.1/servers/0a5d6a47-ce38-4d1d-8d97-550f5e950af5 => generated 1511 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:50.416966 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d8f9cdba-0225-48b1-bb16-87f609a57c2a tempest-SecurityGroupsNegativeTestJSON-331999179 tempest-SecurityGroupsNegativeTestJSON-331999179-project] Calling method '.version_select at 0x7f5aed106ee0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:50.672338 n-d-850499-9 devstack@n-api.service[122257]: DEBUG neutronclient.v2_0.client [None req-d8f9cdba-0225-48b1-bb16-87f609a57c2a tempest-SecurityGroupsNegativeTestJSON-331999179 tempest-SecurityGroupsNegativeTestJSON-331999179-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e57bec0c-3e45-4ea9-b0e6-3406553e6263 does not exist", "detail": ""}} {{(pid=122257) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 31 16:08:50.673517 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.security_group_api [None req-d8f9cdba-0225-48b1-bb16-87f609a57c2a tempest-SecurityGroupsNegativeTestJSON-331999179 tempest-SecurityGroupsNegativeTestJSON-331999179-project] Neutron security group e57bec0c-3e45-4ea9-b0e6-3406553e6263 not found {{(pid=122257) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 31 16:08:50.674582 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-d8f9cdba-0225-48b1-bb16-87f609a57c2a tempest-SecurityGroupsNegativeTestJSON-331999179 tempest-SecurityGroupsNegativeTestJSON-331999179-project] HTTP exception thrown: Security group e57bec0c-3e45-4ea9-b0e6-3406553e6263 does not exist Aug 31 16:08:50.674582 n-d-850499-9 devstack@n-api.service[122257]: Neutron server returns request_ids: ['req-50072395-81ee-497e-9633-97aeddb73eb4'] Aug 31 16:08:50.678421 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d8f9cdba-0225-48b1-bb16-87f609a57c2a tempest-SecurityGroupsNegativeTestJSON-331999179 tempest-SecurityGroupsNegativeTestJSON-331999179-project] Request method failure captured: Aug 31 16:08:50.678421 n-d-850499-9 devstack@n-api.service[122257]: request: DELETE /compute/v2.1/os-security-groups/e57bec0c-3e45-4ea9-b0e6-3406553e6263 HTTP/1.1 Aug 31 16:08:50.678421 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:08:50.678421 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:08:50.678421 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:08:50.678421 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:08:50.678421 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:08:50.678421 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:08:50.678421 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:08:50.678421 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:08:50.678421 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4eRXFhyayjnvWD-QXgADr-t8JtrNGKLw_xFwM4F1dPIrReoA978lzwvCCIedboPEbUS2dmPMl-LggnPn7lwMQ6L1pl4qDx3z9vA8q7w0efzQYxCgw1ilgLd_CZC0Xxsm_uukMaUV8OXDe6rejy1MaejVpLuwdD6debx4uIC531RYgQ Aug 31 16:08:50.678421 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:08:50.678421 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:08:50.678421 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:08:50.678421 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:08:50.678421 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:08:50.678421 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:08:50.678421 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: fd609355e46d4d44828c3390adb1169e Aug 31 16:08:50.678421 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-331999179 Aug 31 16:08:50.678421 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:08:50.678421 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:08:50.678421 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fd609355e46d4d44828c3390adb1169e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/fd609355e46d4d44828c3390adb1169e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_fd609355e46d4d44828c3390adb1169e", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fd609355e46d4d44828c3390adb1169e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:08:50.678421 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-331999179 Aug 31 16:08:50.678421 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: fd609355e46d4d44828c3390adb1169e Aug 31 16:08:50.678421 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-331999179 Aug 31 16:08:50.678421 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-SecurityGroupsNegativeTestJSON-331999179-project Aug 31 16:08:50.678421 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:08:50.678421 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:08:50.678421 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 1d21d092a98646c69227fe2a0c4dc3c4 Aug 31 16:08:50.678421 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-331999179-project Aug 31 16:08:50.678421 n-d-850499-9 devstack@n-api.service[122257]: method: Aug 31 16:08:50.678421 n-d-850499-9 devstack@n-api.service[122257]: exception: Security group e57bec0c-3e45-4ea9-b0e6-3406553e6263 does not exist Aug 31 16:08:50.678421 n-d-850499-9 devstack@n-api.service[122257]: Neutron server returns request_ids: ['req-50072395-81ee-497e-9633-97aeddb73eb4'] Aug 31 16:08:50.678421 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': 'e57bec0c-3e45-4ea9-b0e6-3406553e6263'} Aug 31 16:08:50.678421 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:08:50.678421 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:08:50.678421 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 31 16:08:50.678421 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 31 16:08:50.678421 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:08:50.678421 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:08:50.678421 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 31 16:08:50.678421 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 31 16:08:50.678421 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:08:50.678421 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:08:50.678421 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 31 16:08:50.678421 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 31 16:08:50.678421 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:08:50.678421 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:08:50.678421 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 31 16:08:50.678421 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 31 16:08:50.678421 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:08:50.678421 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:08:50.678421 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 31 16:08:50.678421 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 31 16:08:50.678421 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:08:50.678421 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:08:50.678421 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 31 16:08:50.678421 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 31 16:08:50.678421 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 31 16:08:50.678421 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 31 16:08:50.678421 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group e57bec0c-3e45-4ea9-b0e6-3406553e6263 does not exist Aug 31 16:08:50.686172 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-50072395-81ee-497e-9633-97aeddb73eb4'] Aug 31 16:08:50.686172 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:08:50.686172 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:08:50.686172 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:08:50.686172 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:08:50.686172 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 31 16:08:50.686172 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 31 16:08:50.686172 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 31 16:08:50.686172 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 31 16:08:50.686172 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group e57bec0c-3e45-4ea9-b0e6-3406553e6263 does not exist Aug 31 16:08:50.686172 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-50072395-81ee-497e-9633-97aeddb73eb4'] Aug 31 16:08:50.686172 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:08:50.686172 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:08:50.686172 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:08:50.686172 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:08:50.686172 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:08:50.686172 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:08:50.686172 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:08:50.686172 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:08:50.686172 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:08:50.686172 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:08:50.686172 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:08:50.686172 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:08:50.686172 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 31 16:08:50.686172 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 31 16:08:50.686172 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group e57bec0c-3e45-4ea9-b0e6-3406553e6263 does not exist Aug 31 16:08:50.686172 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-50072395-81ee-497e-9633-97aeddb73eb4'] Aug 31 16:08:50.686172 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:08:50.686172 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:08:50.686172 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:08:50.686172 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:08:50.686172 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:08:50.686172 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:08:50.686172 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:08:50.686172 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:08:50.686172 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group e57bec0c-3e45-4ea9-b0e6-3406553e6263 does not exist Aug 31 16:08:50.686172 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-50072395-81ee-497e-9633-97aeddb73eb4'] Aug 31 16:08:50.686172 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:08:50.686172 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d8f9cdba-0225-48b1-bb16-87f609a57c2a tempest-SecurityGroupsNegativeTestJSON-331999179 tempest-SecurityGroupsNegativeTestJSON-331999179-project] Returning 404 to user: Security group e57bec0c-3e45-4ea9-b0e6-3406553e6263 does not exist Aug 31 16:08:50.686172 n-d-850499-9 devstack@n-api.service[122257]: Neutron server returns request_ids: ['req-50072395-81ee-497e-9633-97aeddb73eb4'] {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:08:50.691117 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d8f9cdba-0225-48b1-bb16-87f609a57c2a tempest-SecurityGroupsNegativeTestJSON-331999179 tempest-SecurityGroupsNegativeTestJSON-331999179-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/e57bec0c-3e45-4ea9-b0e6-3406553e6263" status: 404 len: 194 microversion: 2.1 time: 1.278200 Aug 31 16:08:50.691117 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1481/2983] 10.222.0.61 () {58 vars in 1272 bytes} [Wed Aug 31 16:08:49 2022] DELETE /compute/v2.1/os-security-groups/e57bec0c-3e45-4ea9-b0e6-3406553e6263 => generated 194 bytes in 1286 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 16:08:50.701190 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-73d40184-cac2-48b5-a866-b40d975e72a7 tempest-SecurityGroupsNegativeTestJSON-331999179 tempest-SecurityGroupsNegativeTestJSON-331999179-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.005409 Aug 31 16:08:50.701759 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1503/2984] 10.222.0.61 () {58 vars in 1164 bytes} [Wed Aug 31 16:08:50 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 31 16:08:50.737878 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-104d5b9a-f331-4df4-be93-b3b485f227f1 tempest-SecurityGroupsNegativeTestJSON-331999179 tempest-SecurityGroupsNegativeTestJSON-331999179-project] Calling method '.version_select at 0x7f5ae8cdc280>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:51.143368 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-33ef643d-b6c9-492f-8fca-308ef1e99d7b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:51.152676 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-33ef643d-b6c9-492f-8fca-308ef1e99d7b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 0a5d6a47-ce38-4d1d-8d97-550f5e950af5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:51.208162 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-33ef643d-b6c9-492f-8fca-308ef1e99d7b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:51.209842 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-33ef643d-b6c9-492f-8fca-308ef1e99d7b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:51.212467 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-33ef643d-b6c9-492f-8fca-308ef1e99d7b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:51.225138 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-33ef643d-b6c9-492f-8fca-308ef1e99d7b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:51.230501 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-33ef643d-b6c9-492f-8fca-308ef1e99d7b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:51.233393 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-33ef643d-b6c9-492f-8fca-308ef1e99d7b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:51.705956 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=4 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:08:52.405622 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-33ef643d-b6c9-492f-8fca-308ef1e99d7b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:52.421574 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-33ef643d-b6c9-492f-8fca-308ef1e99d7b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/0a5d6a47-ce38-4d1d-8d97-550f5e950af5" status: 200 len: 1511 microversion: 2.1 time: 1.287432 Aug 31 16:08:52.422440 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1504/2985] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:51 2022] GET /compute/v2.1/servers/0a5d6a47-ce38-4d1d-8d97-550f5e950af5 => generated 1511 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:08:52.469276 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-104d5b9a-f331-4df4-be93-b3b485f227f1 tempest-SecurityGroupsNegativeTestJSON-331999179 tempest-SecurityGroupsNegativeTestJSON-331999179-project] 10.222.0.61 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 1.756563 Aug 31 16:08:52.470476 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1482/2986] 10.222.0.61 () {58 vars in 1158 bytes} [Wed Aug 31 16:08:50 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 1759 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:08:52.490811 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a5438fea-f384-4690-a23d-969cba6b658a tempest-SecurityGroupsNegativeTestJSON-331999179 tempest-SecurityGroupsNegativeTestJSON-331999179-project] Calling method '.version_select at 0x7f5ae8eece50>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:52.646369 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=24 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:08:53.229359 n-d-850499-9 devstack@n-api.service[122256]: DEBUG neutronclient.v2_0.client [None req-a5438fea-f384-4690-a23d-969cba6b658a tempest-SecurityGroupsNegativeTestJSON-331999179 tempest-SecurityGroupsNegativeTestJSON-331999179-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=122256) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 31 16:08:53.230262 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-a5438fea-f384-4690-a23d-969cba6b658a tempest-SecurityGroupsNegativeTestJSON-331999179 tempest-SecurityGroupsNegativeTestJSON-331999179-project] HTTP exception thrown: Insufficient rights for removing default security group. Aug 31 16:08:53.230262 n-d-850499-9 devstack@n-api.service[122256]: Neutron server returns request_ids: ['req-e195cad9-fd33-43ea-ac8d-a1945e9ecb73'] Aug 31 16:08:53.232418 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a5438fea-f384-4690-a23d-969cba6b658a tempest-SecurityGroupsNegativeTestJSON-331999179 tempest-SecurityGroupsNegativeTestJSON-331999179-project] Request method failure captured: Aug 31 16:08:53.232418 n-d-850499-9 devstack@n-api.service[122256]: request: DELETE /compute/v2.1/os-security-groups/705e0543-6eb0-493c-b487-bce6400668e7 HTTP/1.1 Aug 31 16:08:53.232418 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:08:53.232418 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:08:53.232418 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:08:53.232418 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:08:53.232418 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:08:53.232418 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:08:53.232418 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:08:53.232418 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:08:53.232418 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4eRXFhyayjnvWD-QXgADr-t8JtrNGKLw_xFwM4F1dPIrReoA978lzwvCCIedboPEbUS2dmPMl-LggnPn7lwMQ6L1pl4qDx3z9vA8q7w0efzQYxCgw1ilgLd_CZC0Xxsm_uukMaUV8OXDe6rejy1MaejVpLuwdD6debx4uIC531RYgQ Aug 31 16:08:53.232418 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:08:53.232418 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:08:53.232418 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:08:53.232418 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:08:53.232418 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:08:53.232418 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:08:53.232418 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: fd609355e46d4d44828c3390adb1169e Aug 31 16:08:53.232418 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-331999179 Aug 31 16:08:53.232418 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:08:53.232418 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:08:53.232418 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fd609355e46d4d44828c3390adb1169e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/fd609355e46d4d44828c3390adb1169e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_fd609355e46d4d44828c3390adb1169e", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fd609355e46d4d44828c3390adb1169e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:08:53.232418 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-331999179 Aug 31 16:08:53.232418 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: fd609355e46d4d44828c3390adb1169e Aug 31 16:08:53.232418 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-331999179 Aug 31 16:08:53.232418 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-SecurityGroupsNegativeTestJSON-331999179-project Aug 31 16:08:53.232418 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:08:53.232418 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:08:53.232418 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 1d21d092a98646c69227fe2a0c4dc3c4 Aug 31 16:08:53.232418 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-331999179-project Aug 31 16:08:53.232418 n-d-850499-9 devstack@n-api.service[122256]: method: Aug 31 16:08:53.232418 n-d-850499-9 devstack@n-api.service[122256]: exception: Insufficient rights for removing default security group. Aug 31 16:08:53.232418 n-d-850499-9 devstack@n-api.service[122256]: Neutron server returns request_ids: ['req-e195cad9-fd33-43ea-ac8d-a1945e9ecb73'] Aug 31 16:08:53.232418 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '705e0543-6eb0-493c-b487-bce6400668e7'} Aug 31 16:08:53.232418 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:08:53.232418 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:08:53.232418 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 31 16:08:53.232418 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 31 16:08:53.232418 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:08:53.232418 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:08:53.232418 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 31 16:08:53.232418 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 31 16:08:53.232418 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:08:53.232418 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:08:53.232418 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 31 16:08:53.232418 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 31 16:08:53.232418 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:08:53.232418 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:08:53.232418 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 31 16:08:53.232418 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 31 16:08:53.232418 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:08:53.232418 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:08:53.232418 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 31 16:08:53.232418 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 31 16:08:53.232418 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:08:53.232418 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:08:53.232418 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 31 16:08:53.232418 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 31 16:08:53.232418 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 31 16:08:53.232418 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 31 16:08:53.232418 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Aug 31 16:08:53.236496 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e195cad9-fd33-43ea-ac8d-a1945e9ecb73'] Aug 31 16:08:53.236496 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:08:53.236496 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:08:53.236496 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:08:53.236496 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:08:53.236496 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 31 16:08:53.236496 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 31 16:08:53.236496 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 31 16:08:53.236496 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 31 16:08:53.236496 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Aug 31 16:08:53.236496 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e195cad9-fd33-43ea-ac8d-a1945e9ecb73'] Aug 31 16:08:53.236496 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:08:53.236496 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:08:53.236496 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:08:53.236496 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:08:53.236496 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:08:53.236496 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:08:53.236496 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:08:53.236496 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:08:53.236496 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:08:53.236496 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:08:53.236496 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:08:53.236496 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:08:53.236496 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 31 16:08:53.236496 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 31 16:08:53.236496 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Aug 31 16:08:53.236496 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e195cad9-fd33-43ea-ac8d-a1945e9ecb73'] Aug 31 16:08:53.236496 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:08:53.236496 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:08:53.236496 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:08:53.236496 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:08:53.236496 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:08:53.236496 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:08:53.236496 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:08:53.236496 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:08:53.236496 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Aug 31 16:08:53.236496 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e195cad9-fd33-43ea-ac8d-a1945e9ecb73'] Aug 31 16:08:53.236496 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:08:53.236496 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a5438fea-f384-4690-a23d-969cba6b658a tempest-SecurityGroupsNegativeTestJSON-331999179 tempest-SecurityGroupsNegativeTestJSON-331999179-project] Returning 400 to user: Insufficient rights for removing default security group. Aug 31 16:08:53.236496 n-d-850499-9 devstack@n-api.service[122256]: Neutron server returns request_ids: ['req-e195cad9-fd33-43ea-ac8d-a1945e9ecb73'] {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:08:53.236496 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a5438fea-f384-4690-a23d-969cba6b658a tempest-SecurityGroupsNegativeTestJSON-331999179 tempest-SecurityGroupsNegativeTestJSON-331999179-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/705e0543-6eb0-493c-b487-bce6400668e7" status: 400 len: 182 microversion: 2.1 time: 0.750413 Aug 31 16:08:53.236496 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1505/2987] 10.222.0.61 () {58 vars in 1272 bytes} [Wed Aug 31 16:08:52 2022] DELETE /compute/v2.1/os-security-groups/705e0543-6eb0-493c-b487-bce6400668e7 => generated 182 bytes in 753 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:08:53.254074 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b2569b60-5858-45f2-8547-9eec3900982d tempest-SecurityGroupsNegativeTestJSON-331999179 tempest-SecurityGroupsNegativeTestJSON-331999179-project] Calling method '.version_select at 0x7f5ae8cdc4c0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:53.468238 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-99743c02-ce17-430c-a04a-cf1d2baae340 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:53.470330 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-99743c02-ce17-430c-a04a-cf1d2baae340 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 0a5d6a47-ce38-4d1d-8d97-550f5e950af5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:53.484140 n-d-850499-9 devstack@n-api.service[122257]: DEBUG neutronclient.v2_0.client [None req-b2569b60-5858-45f2-8547-9eec3900982d tempest-SecurityGroupsNegativeTestJSON-331999179 tempest-SecurityGroupsNegativeTestJSON-331999179-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 29a7e01a-c98e-42bd-b9ba-371c4f6c6381 does not exist", "detail": ""}} {{(pid=122257) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 31 16:08:53.485732 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.security_group_api [None req-b2569b60-5858-45f2-8547-9eec3900982d tempest-SecurityGroupsNegativeTestJSON-331999179 tempest-SecurityGroupsNegativeTestJSON-331999179-project] Neutron security group 29a7e01a-c98e-42bd-b9ba-371c4f6c6381 not found {{(pid=122257) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 31 16:08:53.486734 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-b2569b60-5858-45f2-8547-9eec3900982d tempest-SecurityGroupsNegativeTestJSON-331999179 tempest-SecurityGroupsNegativeTestJSON-331999179-project] HTTP exception thrown: Security group 29a7e01a-c98e-42bd-b9ba-371c4f6c6381 does not exist Aug 31 16:08:53.486734 n-d-850499-9 devstack@n-api.service[122257]: Neutron server returns request_ids: ['req-80883619-3477-4362-b798-f8678ac44086'] Aug 31 16:08:53.493931 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b2569b60-5858-45f2-8547-9eec3900982d tempest-SecurityGroupsNegativeTestJSON-331999179 tempest-SecurityGroupsNegativeTestJSON-331999179-project] Request method failure captured: Aug 31 16:08:53.493931 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/os-security-groups/29a7e01a-c98e-42bd-b9ba-371c4f6c6381 HTTP/1.1 Aug 31 16:08:53.493931 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:08:53.493931 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:08:53.493931 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:08:53.493931 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:08:53.493931 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:08:53.493931 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:08:53.493931 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:08:53.493931 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:08:53.493931 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4eRXFhyayjnvWD-QXgADr-t8JtrNGKLw_xFwM4F1dPIrReoA978lzwvCCIedboPEbUS2dmPMl-LggnPn7lwMQ6L1pl4qDx3z9vA8q7w0efzQYxCgw1ilgLd_CZC0Xxsm_uukMaUV8OXDe6rejy1MaejVpLuwdD6debx4uIC531RYgQ Aug 31 16:08:53.493931 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:08:53.493931 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:08:53.493931 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:08:53.493931 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:08:53.493931 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:08:53.493931 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:08:53.493931 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: fd609355e46d4d44828c3390adb1169e Aug 31 16:08:53.493931 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-331999179 Aug 31 16:08:53.493931 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:08:53.493931 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:08:53.493931 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fd609355e46d4d44828c3390adb1169e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/fd609355e46d4d44828c3390adb1169e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_fd609355e46d4d44828c3390adb1169e", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fd609355e46d4d44828c3390adb1169e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:08:53.493931 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-331999179 Aug 31 16:08:53.493931 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: fd609355e46d4d44828c3390adb1169e Aug 31 16:08:53.493931 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-331999179 Aug 31 16:08:53.493931 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-SecurityGroupsNegativeTestJSON-331999179-project Aug 31 16:08:53.493931 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:08:53.493931 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:08:53.493931 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 1d21d092a98646c69227fe2a0c4dc3c4 Aug 31 16:08:53.493931 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-331999179-project Aug 31 16:08:53.493931 n-d-850499-9 devstack@n-api.service[122257]: method: Aug 31 16:08:53.493931 n-d-850499-9 devstack@n-api.service[122257]: exception: Security group 29a7e01a-c98e-42bd-b9ba-371c4f6c6381 does not exist Aug 31 16:08:53.493931 n-d-850499-9 devstack@n-api.service[122257]: Neutron server returns request_ids: ['req-80883619-3477-4362-b798-f8678ac44086'] Aug 31 16:08:53.493931 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '29a7e01a-c98e-42bd-b9ba-371c4f6c6381'} Aug 31 16:08:53.493931 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:08:53.493931 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:08:53.493931 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 31 16:08:53.493931 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 31 16:08:53.493931 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:08:53.493931 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:08:53.493931 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 31 16:08:53.493931 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 31 16:08:53.493931 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:08:53.493931 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:08:53.493931 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 31 16:08:53.493931 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 31 16:08:53.493931 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:08:53.493931 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:08:53.493931 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 31 16:08:53.493931 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 31 16:08:53.493931 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:08:53.493931 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:08:53.493931 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 31 16:08:53.493931 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 31 16:08:53.493931 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:08:53.493931 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:08:53.493931 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 31 16:08:53.493931 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 31 16:08:53.493931 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 31 16:08:53.493931 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 31 16:08:53.493931 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 29a7e01a-c98e-42bd-b9ba-371c4f6c6381 does not exist Aug 31 16:08:53.501242 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-80883619-3477-4362-b798-f8678ac44086'] Aug 31 16:08:53.501242 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:08:53.501242 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:08:53.501242 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:08:53.501242 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:08:53.501242 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 31 16:08:53.501242 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 31 16:08:53.501242 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 31 16:08:53.501242 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 31 16:08:53.501242 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 29a7e01a-c98e-42bd-b9ba-371c4f6c6381 does not exist Aug 31 16:08:53.501242 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-80883619-3477-4362-b798-f8678ac44086'] Aug 31 16:08:53.501242 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:08:53.501242 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:08:53.501242 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:08:53.501242 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:08:53.501242 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:08:53.501242 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:08:53.501242 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:08:53.501242 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:08:53.501242 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:08:53.501242 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:08:53.501242 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:08:53.501242 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:08:53.501242 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 31 16:08:53.501242 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 31 16:08:53.501242 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 29a7e01a-c98e-42bd-b9ba-371c4f6c6381 does not exist Aug 31 16:08:53.501242 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-80883619-3477-4362-b798-f8678ac44086'] Aug 31 16:08:53.501242 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:08:53.501242 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:08:53.501242 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:08:53.501242 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:08:53.501242 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:08:53.501242 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:08:53.501242 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:08:53.501242 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:08:53.501242 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 29a7e01a-c98e-42bd-b9ba-371c4f6c6381 does not exist Aug 31 16:08:53.501242 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-80883619-3477-4362-b798-f8678ac44086'] Aug 31 16:08:53.501242 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:08:53.511088 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b2569b60-5858-45f2-8547-9eec3900982d tempest-SecurityGroupsNegativeTestJSON-331999179 tempest-SecurityGroupsNegativeTestJSON-331999179-project] Returning 404 to user: Security group 29a7e01a-c98e-42bd-b9ba-371c4f6c6381 does not exist Aug 31 16:08:53.511088 n-d-850499-9 devstack@n-api.service[122257]: Neutron server returns request_ids: ['req-80883619-3477-4362-b798-f8678ac44086'] {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:08:53.511473 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-99743c02-ce17-430c-a04a-cf1d2baae340 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:53.518937 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b2569b60-5858-45f2-8547-9eec3900982d tempest-SecurityGroupsNegativeTestJSON-331999179 tempest-SecurityGroupsNegativeTestJSON-331999179-project] 10.222.0.61 "GET /compute/v2.1/os-security-groups/29a7e01a-c98e-42bd-b9ba-371c4f6c6381" status: 404 len: 194 microversion: 2.1 time: 0.265229 Aug 31 16:08:53.524685 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-99743c02-ce17-430c-a04a-cf1d2baae340 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:53.528163 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-99743c02-ce17-430c-a04a-cf1d2baae340 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:53.529143 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-99743c02-ce17-430c-a04a-cf1d2baae340 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:53.531968 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-99743c02-ce17-430c-a04a-cf1d2baae340 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:53.532647 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-99743c02-ce17-430c-a04a-cf1d2baae340 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:53.546824 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1483/2988] 10.222.0.61 () {58 vars in 1269 bytes} [Wed Aug 31 16:08:53 2022] GET /compute/v2.1/os-security-groups/29a7e01a-c98e-42bd-b9ba-371c4f6c6381 => generated 194 bytes in 300 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:08:53.582825 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-42527062-d98f-4779-bc20-a6e871c6203a tempest-SecurityGroupsNegativeTestJSON-331999179 tempest-SecurityGroupsNegativeTestJSON-331999179-project] Action: 'update', calling method: .version_select at 0x7f5ae8371550>, body: {"security_group": {"name": "tempest-sg-1753831450", "description": "tempest-description-1553432102"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:08:53.902713 n-d-850499-9 devstack@n-api.service[122257]: DEBUG neutronclient.v2_0.client [None req-42527062-d98f-4779-bc20-a6e871c6203a tempest-SecurityGroupsNegativeTestJSON-331999179 tempest-SecurityGroupsNegativeTestJSON-331999179-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 86b7430c-8eb5-40ac-b5c1-dbfe85310f56 does not exist", "detail": ""}} {{(pid=122257) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 31 16:08:53.904840 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.security_group_api [None req-42527062-d98f-4779-bc20-a6e871c6203a tempest-SecurityGroupsNegativeTestJSON-331999179 tempest-SecurityGroupsNegativeTestJSON-331999179-project] Neutron security group 86b7430c-8eb5-40ac-b5c1-dbfe85310f56 not found {{(pid=122257) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 31 16:08:53.906370 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-42527062-d98f-4779-bc20-a6e871c6203a tempest-SecurityGroupsNegativeTestJSON-331999179 tempest-SecurityGroupsNegativeTestJSON-331999179-project] HTTP exception thrown: Security group 86b7430c-8eb5-40ac-b5c1-dbfe85310f56 does not exist Aug 31 16:08:53.906370 n-d-850499-9 devstack@n-api.service[122257]: Neutron server returns request_ids: ['req-c57d4b05-859e-440c-803d-82f431861179'] Aug 31 16:08:53.915146 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-42527062-d98f-4779-bc20-a6e871c6203a tempest-SecurityGroupsNegativeTestJSON-331999179 tempest-SecurityGroupsNegativeTestJSON-331999179-project] Request method failure captured: Aug 31 16:08:53.915146 n-d-850499-9 devstack@n-api.service[122257]: request: PUT /compute/v2.1/os-security-groups/86b7430c-8eb5-40ac-b5c1-dbfe85310f56 HTTP/1.1 Aug 31 16:08:53.915146 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:08:53.915146 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:08:53.915146 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:08:53.915146 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 102 Aug 31 16:08:53.915146 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:08:53.915146 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:08:53.915146 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:08:53.915146 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:08:53.915146 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4eRXFhyayjnvWD-QXgADr-t8JtrNGKLw_xFwM4F1dPIrReoA978lzwvCCIedboPEbUS2dmPMl-LggnPn7lwMQ6L1pl4qDx3z9vA8q7w0efzQYxCgw1ilgLd_CZC0Xxsm_uukMaUV8OXDe6rejy1MaejVpLuwdD6debx4uIC531RYgQ Aug 31 16:08:53.915146 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:08:53.915146 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:08:53.915146 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:08:53.915146 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:08:53.915146 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:08:53.915146 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:08:53.915146 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: fd609355e46d4d44828c3390adb1169e Aug 31 16:08:53.915146 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-331999179 Aug 31 16:08:53.915146 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:08:53.915146 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:08:53.915146 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fd609355e46d4d44828c3390adb1169e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/fd609355e46d4d44828c3390adb1169e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_fd609355e46d4d44828c3390adb1169e", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fd609355e46d4d44828c3390adb1169e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:08:53.915146 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-331999179 Aug 31 16:08:53.915146 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: fd609355e46d4d44828c3390adb1169e Aug 31 16:08:53.915146 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-331999179 Aug 31 16:08:53.915146 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-SecurityGroupsNegativeTestJSON-331999179-project Aug 31 16:08:53.915146 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:08:53.915146 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:08:53.915146 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 1d21d092a98646c69227fe2a0c4dc3c4 Aug 31 16:08:53.915146 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-331999179-project Aug 31 16:08:53.915146 n-d-850499-9 devstack@n-api.service[122257]: Aug 31 16:08:53.915146 n-d-850499-9 devstack@n-api.service[122257]: {"security_group": {"name": "tempest-sg-1753831450", "description": "tempest-description-1553432102"}} Aug 31 16:08:53.915146 n-d-850499-9 devstack@n-api.service[122257]: method: Aug 31 16:08:53.915146 n-d-850499-9 devstack@n-api.service[122257]: exception: Security group 86b7430c-8eb5-40ac-b5c1-dbfe85310f56 does not exist Aug 31 16:08:53.915146 n-d-850499-9 devstack@n-api.service[122257]: Neutron server returns request_ids: ['req-c57d4b05-859e-440c-803d-82f431861179'] Aug 31 16:08:53.915146 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '86b7430c-8eb5-40ac-b5c1-dbfe85310f56', 'body': {'security_group': {'name': 'tempest-sg-1753831450', 'description': 'tempest-description-1553432102'}}} Aug 31 16:08:53.915146 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:08:53.915146 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:08:53.915146 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 31 16:08:53.915146 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 31 16:08:53.915146 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:08:53.915146 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:08:53.915146 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 31 16:08:53.915146 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 31 16:08:53.915146 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:08:53.915146 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:08:53.915146 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 31 16:08:53.915146 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 31 16:08:53.915146 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:08:53.915146 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:08:53.915146 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 31 16:08:53.915146 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 31 16:08:53.915146 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:08:53.915146 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:08:53.915146 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 31 16:08:53.915146 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 31 16:08:53.915146 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:08:53.915146 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:08:53.915146 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 31 16:08:53.915146 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 31 16:08:53.915146 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 31 16:08:53.919805 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 31 16:08:53.919805 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 86b7430c-8eb5-40ac-b5c1-dbfe85310f56 does not exist Aug 31 16:08:53.919805 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c57d4b05-859e-440c-803d-82f431861179'] Aug 31 16:08:53.919805 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:08:53.919805 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:08:53.919805 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:08:53.919805 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:08:53.919805 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Aug 31 16:08:53.919805 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 31 16:08:53.919805 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 31 16:08:53.919805 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 31 16:08:53.919805 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 86b7430c-8eb5-40ac-b5c1-dbfe85310f56 does not exist Aug 31 16:08:53.919805 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c57d4b05-859e-440c-803d-82f431861179'] Aug 31 16:08:53.919805 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:08:53.919805 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:08:53.919805 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:08:53.919805 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:08:53.919805 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:08:53.919805 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:08:53.919805 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:08:53.919805 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:08:53.919805 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:08:53.919805 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:08:53.919805 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:08:53.919805 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:08:53.919805 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Aug 31 16:08:53.919805 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 31 16:08:53.919805 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 86b7430c-8eb5-40ac-b5c1-dbfe85310f56 does not exist Aug 31 16:08:53.919805 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c57d4b05-859e-440c-803d-82f431861179'] Aug 31 16:08:53.919805 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:08:53.919805 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:08:53.919805 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:08:53.919805 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:08:53.919805 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:08:53.919805 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:08:53.919805 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:08:53.919805 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:08:53.919805 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 86b7430c-8eb5-40ac-b5c1-dbfe85310f56 does not exist Aug 31 16:08:53.919805 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c57d4b05-859e-440c-803d-82f431861179'] Aug 31 16:08:53.919805 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:08:53.922257 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-42527062-d98f-4779-bc20-a6e871c6203a tempest-SecurityGroupsNegativeTestJSON-331999179 tempest-SecurityGroupsNegativeTestJSON-331999179-project] Returning 404 to user: Security group 86b7430c-8eb5-40ac-b5c1-dbfe85310f56 does not exist Aug 31 16:08:53.922257 n-d-850499-9 devstack@n-api.service[122257]: Neutron server returns request_ids: ['req-c57d4b05-859e-440c-803d-82f431861179'] {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:08:53.924146 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-42527062-d98f-4779-bc20-a6e871c6203a tempest-SecurityGroupsNegativeTestJSON-331999179 tempest-SecurityGroupsNegativeTestJSON-331999179-project] 10.222.0.61 "PUT /compute/v2.1/os-security-groups/86b7430c-8eb5-40ac-b5c1-dbfe85310f56" status: 404 len: 194 microversion: 2.1 time: 0.372447 Aug 31 16:08:53.934441 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1484/2989] 10.222.0.61 () {60 vars in 1290 bytes} [Wed Aug 31 16:08:53 2022] PUT /compute/v2.1/os-security-groups/86b7430c-8eb5-40ac-b5c1-dbfe85310f56 => generated 194 bytes in 381 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:08:54.156293 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-abbb68ed-8bbd-4569-a44b-6b0ba05ea6d2 tempest-QuotasAdminTestJSON-1237312796 tempest-QuotasAdminTestJSON-1237312796-project-admin] Calling method '.version_select at 0x7f5ae8cdc700>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:54.434807 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-abbb68ed-8bbd-4569-a44b-6b0ba05ea6d2 tempest-QuotasAdminTestJSON-1237312796 tempest-QuotasAdminTestJSON-1237312796-project-admin] 10.222.0.61 "GET /compute/v2.1/os-quota-sets/1cc298a2b1e9427ca9349d2c1ca44765" status: 200 len: 371 microversion: 2.1 time: 0.503849 Aug 31 16:08:54.447646 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1485/2990] 10.222.0.61 () {58 vars in 1242 bytes} [Wed Aug 31 16:08:53 2022] GET /compute/v2.1/os-quota-sets/1cc298a2b1e9427ca9349d2c1ca44765 => generated 371 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:08:54.528848 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-99743c02-ce17-430c-a04a-cf1d2baae340 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:54.560676 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-99743c02-ce17-430c-a04a-cf1d2baae340 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/0a5d6a47-ce38-4d1d-8d97-550f5e950af5" status: 200 len: 1511 microversion: 2.1 time: 1.098704 Aug 31 16:08:54.566044 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1506/2991] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:53 2022] GET /compute/v2.1/servers/0a5d6a47-ce38-4d1d-8d97-550f5e950af5 => generated 1511 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:54.574614 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-bef6b956-5a0e-4193-b20d-5318d4d8dc7f tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-437544270", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "networks": [{"uuid": "9caeebc7-b4c5-4cf9-8879-597736ffa82b"}]}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:08:54.584506 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9ede232e-d75c-4fe1-bbc9-09f2256c6d39 tempest-QuotasAdminTestJSON-1237312796 tempest-QuotasAdminTestJSON-1237312796-project-admin] Action: 'update', calling method: .version_select at 0x7f5ae858fa60>, body: {"quota_set": {"ram": "5120"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:08:54.716835 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-bef6b956-5a0e-4193-b20d-5318d4d8dc7f tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] validate_networks() for [('9caeebc7-b4c5-4cf9-8879-597736ffa82b', None, None, None, None, None)] {{(pid=122257) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:08:54.892903 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9ede232e-d75c-4fe1-bbc9-09f2256c6d39 tempest-QuotasAdminTestJSON-1237312796 tempest-QuotasAdminTestJSON-1237312796-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:54.893660 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9ede232e-d75c-4fe1-bbc9-09f2256c6d39 tempest-QuotasAdminTestJSON-1237312796 tempest-QuotasAdminTestJSON-1237312796-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:54.894418 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9ede232e-d75c-4fe1-bbc9-09f2256c6d39 tempest-QuotasAdminTestJSON-1237312796 tempest-QuotasAdminTestJSON-1237312796-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:54.898637 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9ede232e-d75c-4fe1-bbc9-09f2256c6d39 tempest-QuotasAdminTestJSON-1237312796 tempest-QuotasAdminTestJSON-1237312796-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:54.901682 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9ede232e-d75c-4fe1-bbc9-09f2256c6d39 tempest-QuotasAdminTestJSON-1237312796 tempest-QuotasAdminTestJSON-1237312796-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:54.902589 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9ede232e-d75c-4fe1-bbc9-09f2256c6d39 tempest-QuotasAdminTestJSON-1237312796 tempest-QuotasAdminTestJSON-1237312796-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:55.082091 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9ede232e-d75c-4fe1-bbc9-09f2256c6d39 tempest-QuotasAdminTestJSON-1237312796 tempest-QuotasAdminTestJSON-1237312796-project-admin] 10.222.0.61 "PUT /compute/v2.1/os-quota-sets/1cc298a2b1e9427ca9349d2c1ca44765" status: 200 len: 328 microversion: 2.1 time: 0.513264 Aug 31 16:08:55.089450 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1507/2992] 10.222.0.61 () {60 vars in 1262 bytes} [Wed Aug 31 16:08:54 2022] PUT /compute/v2.1/os-quota-sets/1cc298a2b1e9427ca9349d2c1ca44765 => generated 328 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:08:55.105281 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-fbba2683-9575-45dc-8115-0da416942c39 tempest-QuotasAdminTestJSON-1237312796 tempest-QuotasAdminTestJSON-1237312796-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:55.129985 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-fbba2683-9575-45dc-8115-0da416942c39 tempest-QuotasAdminTestJSON-1237312796 tempest-QuotasAdminTestJSON-1237312796-project-admin] 10.222.0.61 "DELETE /compute/v2.1/os-quota-sets/1cc298a2b1e9427ca9349d2c1ca44765" status: 202 len: 0 microversion: 2.1 time: 0.036716 Aug 31 16:08:55.131023 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1508/2993] 10.222.0.61 () {58 vars in 1245 bytes} [Wed Aug 31 16:08:55 2022] DELETE /compute/v2.1/os-quota-sets/1cc298a2b1e9427ca9349d2c1ca44765 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:08:55.140233 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-48c7a54a-5122-4b81-9090-beb7e41e49f0 tempest-QuotasAdminTestJSON-1237312796 tempest-QuotasAdminTestJSON-1237312796-project-admin] Calling method '.version_select at 0x7f5ae9079dc0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:55.295140 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=6,nova_api:DELETE=5 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:08:55.308666 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-48c7a54a-5122-4b81-9090-beb7e41e49f0 tempest-QuotasAdminTestJSON-1237312796 tempest-QuotasAdminTestJSON-1237312796-project-admin] 10.222.0.61 "GET /compute/v2.1/os-quota-sets/1cc298a2b1e9427ca9349d2c1ca44765" status: 200 len: 371 microversion: 2.1 time: 0.170802 Aug 31 16:08:55.313742 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1509/2994] 10.222.0.61 () {58 vars in 1242 bytes} [Wed Aug 31 16:08:55 2022] GET /compute/v2.1/os-quota-sets/1cc298a2b1e9427ca9349d2c1ca44765 => generated 371 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:08:55.591982 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0c11f31b-e3ef-477a-b235-620f2938977b tempest-QuotasAdminTestJSON-1237312796 tempest-QuotasAdminTestJSON-1237312796-project-admin] Calling method '.version_select at 0x7f5ae93cd700>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:56.169588 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0c11f31b-e3ef-477a-b235-620f2938977b tempest-QuotasAdminTestJSON-1237312796 tempest-QuotasAdminTestJSON-1237312796-project-admin] 10.222.0.61 "GET /compute/v2.1/os-quota-sets/ff3a47c03d4d44ed84beb0a813230c82/defaults" status: 200 len: 371 microversion: 2.1 time: 0.599498 Aug 31 16:08:56.184025 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1510/2995] 10.222.0.61 () {58 vars in 1269 bytes} [Wed Aug 31 16:08:55 2022] GET /compute/v2.1/os-quota-sets/ff3a47c03d4d44ed84beb0a813230c82/defaults => generated 371 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:08:56.205368 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-cc6be6c6-c10c-4f13-aef4-def86ff47177 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:56.207881 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-cc6be6c6-c10c-4f13-aef4-def86ff47177 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 0a5d6a47-ce38-4d1d-8d97-550f5e950af5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:56.223421 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cc6be6c6-c10c-4f13-aef4-def86ff47177 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:56.224797 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cc6be6c6-c10c-4f13-aef4-def86ff47177 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:56.226706 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cc6be6c6-c10c-4f13-aef4-def86ff47177 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:56.229691 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cc6be6c6-c10c-4f13-aef4-def86ff47177 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:56.230518 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cc6be6c6-c10c-4f13-aef4-def86ff47177 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:56.231219 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cc6be6c6-c10c-4f13-aef4-def86ff47177 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:56.414640 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-bef6b956-5a0e-4193-b20d-5318d4d8dc7f tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:08:56.415934 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-bef6b956-5a0e-4193-b20d-5318d4d8dc7f tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:08:56.416391 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-bef6b956-5a0e-4193-b20d-5318d4d8dc7f tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:08:56.416948 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-bef6b956-5a0e-4193-b20d-5318d4d8dc7f tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:08:56.417423 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-bef6b956-5a0e-4193-b20d-5318d4d8dc7f tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:08:56.459588 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bef6b956-5a0e-4193-b20d-5318d4d8dc7f tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:56.460181 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bef6b956-5a0e-4193-b20d-5318d4d8dc7f tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:56.467367 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bef6b956-5a0e-4193-b20d-5318d4d8dc7f tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:56.468369 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bef6b956-5a0e-4193-b20d-5318d4d8dc7f tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:56.468867 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bef6b956-5a0e-4193-b20d-5318d4d8dc7f tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:56.469311 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bef6b956-5a0e-4193-b20d-5318d4d8dc7f tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:56.554472 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-bef6b956-5a0e-4193-b20d-5318d4d8dc7f tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Getting quotas for project 1cf281e8857247c6b9e60d4216741f89. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:08:56.569988 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-bef6b956-5a0e-4193-b20d-5318d4d8dc7f tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Getting quotas for user 41b93395d63a4db895ff224a311940e3 and project 1cf281e8857247c6b9e60d4216741f89. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:08:56.604396 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-bef6b956-5a0e-4193-b20d-5318d4d8dc7f tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Going to run 1 instances... {{(pid=122257) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:08:56.610423 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-bef6b956-5a0e-4193-b20d-5318d4d8dc7f tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] [instance: c393928f-2414-4093-9d72-93a21fc6c460] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:08:56.717857 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-bef6b956-5a0e-4193-b20d-5318d4d8dc7f tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.278026 Aug 31 16:08:56.719130 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1486/2996] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:08:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 2281 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:08:57.138869 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d8797252-f139-40d3-a06c-889b8e276e75 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1719537864", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "networks": [{"uuid": "9caeebc7-b4c5-4cf9-8879-597736ffa82b"}]}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:08:57.340289 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-cc6be6c6-c10c-4f13-aef4-def86ff47177 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:57.374692 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-cc6be6c6-c10c-4f13-aef4-def86ff47177 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/0a5d6a47-ce38-4d1d-8d97-550f5e950af5" status: 200 len: 1488 microversion: 2.1 time: 1.184334 Aug 31 16:08:57.408501 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1511/2997] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:56 2022] GET /compute/v2.1/servers/0a5d6a47-ce38-4d1d-8d97-550f5e950af5 => generated 1488 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:57.413386 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-d8797252-f139-40d3-a06c-889b8e276e75 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] validate_networks() for [('9caeebc7-b4c5-4cf9-8879-597736ffa82b', None, None, None, None, None)] {{(pid=122257) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:08:57.431219 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9eecf8bb-b0fa-4a20-bf4d-2d48139f836e tempest-QuotasAdminTestJSON-1237312796 tempest-QuotasAdminTestJSON-1237312796-project-admin] Action: 'update', calling method: .version_select at 0x7f5ae8e37f70>, body: {"quota_set": {"ram": "5120"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:08:57.858567 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9eecf8bb-b0fa-4a20-bf4d-2d48139f836e tempest-QuotasAdminTestJSON-1237312796 tempest-QuotasAdminTestJSON-1237312796-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:57.859083 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9eecf8bb-b0fa-4a20-bf4d-2d48139f836e tempest-QuotasAdminTestJSON-1237312796 tempest-QuotasAdminTestJSON-1237312796-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:57.859574 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9eecf8bb-b0fa-4a20-bf4d-2d48139f836e tempest-QuotasAdminTestJSON-1237312796 tempest-QuotasAdminTestJSON-1237312796-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:57.860874 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9eecf8bb-b0fa-4a20-bf4d-2d48139f836e tempest-QuotasAdminTestJSON-1237312796 tempest-QuotasAdminTestJSON-1237312796-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:57.861019 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9eecf8bb-b0fa-4a20-bf4d-2d48139f836e tempest-QuotasAdminTestJSON-1237312796 tempest-QuotasAdminTestJSON-1237312796-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:57.861387 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9eecf8bb-b0fa-4a20-bf4d-2d48139f836e tempest-QuotasAdminTestJSON-1237312796 tempest-QuotasAdminTestJSON-1237312796-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:58.018845 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9eecf8bb-b0fa-4a20-bf4d-2d48139f836e tempest-QuotasAdminTestJSON-1237312796 tempest-QuotasAdminTestJSON-1237312796-project-admin] 10.222.0.61 "PUT /compute/v2.1/os-quota-sets/a2b97afbf1744c1586c9cbf16156fd84" status: 200 len: 328 microversion: 2.1 time: 0.605448 Aug 31 16:08:58.020527 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1512/2998] 10.222.0.61 () {60 vars in 1262 bytes} [Wed Aug 31 16:08:57 2022] PUT /compute/v2.1/os-quota-sets/a2b97afbf1744c1586c9cbf16156fd84 => generated 328 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:08:58.054147 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5fa44156-9ade-4515-a4ee-79c3e865dec5 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:58.056305 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5fa44156-9ade-4515-a4ee-79c3e865dec5 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 0a5d6a47-ce38-4d1d-8d97-550f5e950af5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:58.071225 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5fa44156-9ade-4515-a4ee-79c3e865dec5 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:58.073140 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5fa44156-9ade-4515-a4ee-79c3e865dec5 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:58.074232 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5fa44156-9ade-4515-a4ee-79c3e865dec5 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:58.077284 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5fa44156-9ade-4515-a4ee-79c3e865dec5 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:58.081186 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5fa44156-9ade-4515-a4ee-79c3e865dec5 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:58.087624 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5fa44156-9ade-4515-a4ee-79c3e865dec5 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:58.186857 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5fa44156-9ade-4515-a4ee-79c3e865dec5 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 0a5d6a47-ce38-4d1d-8d97-550f5e950af5] Going to try to terminate instance {{(pid=122256) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:08:58.505476 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5fa44156-9ade-4515-a4ee-79c3e865dec5 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "DELETE /compute/v2.1/servers/0a5d6a47-ce38-4d1d-8d97-550f5e950af5" status: 204 len: 0 microversion: 2.1 time: 0.482929 Aug 31 16:08:58.507091 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1513/2999] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:08:58 2022] DELETE /compute/v2.1/servers/0a5d6a47-ce38-4d1d-8d97-550f5e950af5 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:08:58.521497 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-16458d9d-5cd8-4a4e-aff1-676c991e0fcc tempest-QuotasAdminTestJSON-1237312796 tempest-QuotasAdminTestJSON-1237312796-project-admin] Calling method '.version_select at 0x7f5ae934c0d0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:58.709251 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-16458d9d-5cd8-4a4e-aff1-676c991e0fcc tempest-QuotasAdminTestJSON-1237312796 tempest-QuotasAdminTestJSON-1237312796-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:58.710501 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-16458d9d-5cd8-4a4e-aff1-676c991e0fcc tempest-QuotasAdminTestJSON-1237312796 tempest-QuotasAdminTestJSON-1237312796-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:58.711278 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-16458d9d-5cd8-4a4e-aff1-676c991e0fcc tempest-QuotasAdminTestJSON-1237312796 tempest-QuotasAdminTestJSON-1237312796-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:58.712692 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-16458d9d-5cd8-4a4e-aff1-676c991e0fcc tempest-QuotasAdminTestJSON-1237312796 tempest-QuotasAdminTestJSON-1237312796-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:58.713428 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-16458d9d-5cd8-4a4e-aff1-676c991e0fcc tempest-QuotasAdminTestJSON-1237312796 tempest-QuotasAdminTestJSON-1237312796-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:58.714066 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-16458d9d-5cd8-4a4e-aff1-676c991e0fcc tempest-QuotasAdminTestJSON-1237312796 tempest-QuotasAdminTestJSON-1237312796-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:58.789127 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-16458d9d-5cd8-4a4e-aff1-676c991e0fcc tempest-QuotasAdminTestJSON-1237312796 tempest-QuotasAdminTestJSON-1237312796-project-admin] 10.222.0.61 "GET /compute/v2.1/os-quota-sets/a2b97afbf1744c1586c9cbf16156fd84/detail" status: 200 len: 916 microversion: 2.1 time: 0.279855 Aug 31 16:08:58.791612 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1514/3000] 10.222.0.61 () {58 vars in 1263 bytes} [Wed Aug 31 16:08:58 2022] GET /compute/v2.1/os-quota-sets/a2b97afbf1744c1586c9cbf16156fd84/detail => generated 916 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:08:58.801177 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-97cc6826-9104-4d86-abef-9383e793bc8a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:58.807534 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-97cc6826-9104-4d86-abef-9383e793bc8a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 0a5d6a47-ce38-4d1d-8d97-550f5e950af5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:58.819160 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-97cc6826-9104-4d86-abef-9383e793bc8a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:58.824403 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-97cc6826-9104-4d86-abef-9383e793bc8a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:58.825335 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-97cc6826-9104-4d86-abef-9383e793bc8a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:58.830708 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-97cc6826-9104-4d86-abef-9383e793bc8a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:58.832009 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-97cc6826-9104-4d86-abef-9383e793bc8a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:58.832988 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-97cc6826-9104-4d86-abef-9383e793bc8a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:59.481934 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-97cc6826-9104-4d86-abef-9383e793bc8a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:59.491580 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-97cc6826-9104-4d86-abef-9383e793bc8a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/0a5d6a47-ce38-4d1d-8d97-550f5e950af5" status: 200 len: 1494 microversion: 2.1 time: 0.698374 Aug 31 16:08:59.499991 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1515/3001] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:58 2022] GET /compute/v2.1/servers/0a5d6a47-ce38-4d1d-8d97-550f5e950af5 => generated 1494 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:59.505300 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9daf35b3-2ba5-4816-86f6-8922b2b53099 tempest-QuotasAdminTestJSON-1237312796 tempest-QuotasAdminTestJSON-1237312796-project-admin] Action: 'update', calling method: .version_select at 0x7f5ae9333670>, body: {"quota_set": {"ram": "2048"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:08:59.552317 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-d8797252-f139-40d3-a06c-889b8e276e75 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:08:59.553531 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-d8797252-f139-40d3-a06c-889b8e276e75 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:08:59.554330 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-d8797252-f139-40d3-a06c-889b8e276e75 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:08:59.555006 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-d8797252-f139-40d3-a06c-889b8e276e75 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:08:59.556432 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-d8797252-f139-40d3-a06c-889b8e276e75 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:08:59.559969 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:08:59.586298 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d8797252-f139-40d3-a06c-889b8e276e75 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:59.587894 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d8797252-f139-40d3-a06c-889b8e276e75 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:59.588651 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d8797252-f139-40d3-a06c-889b8e276e75 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:59.592718 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d8797252-f139-40d3-a06c-889b8e276e75 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:59.593393 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d8797252-f139-40d3-a06c-889b8e276e75 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:59.593968 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d8797252-f139-40d3-a06c-889b8e276e75 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:59.653206 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-d8797252-f139-40d3-a06c-889b8e276e75 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Getting quotas for project 1cf281e8857247c6b9e60d4216741f89. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:08:59.692378 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-d8797252-f139-40d3-a06c-889b8e276e75 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Getting quotas for user 41b93395d63a4db895ff224a311940e3 and project 1cf281e8857247c6b9e60d4216741f89. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:08:59.694318 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9daf35b3-2ba5-4816-86f6-8922b2b53099 tempest-QuotasAdminTestJSON-1237312796 tempest-QuotasAdminTestJSON-1237312796-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:59.699341 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9daf35b3-2ba5-4816-86f6-8922b2b53099 tempest-QuotasAdminTestJSON-1237312796 tempest-QuotasAdminTestJSON-1237312796-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:59.700209 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9daf35b3-2ba5-4816-86f6-8922b2b53099 tempest-QuotasAdminTestJSON-1237312796 tempest-QuotasAdminTestJSON-1237312796-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:59.701286 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9daf35b3-2ba5-4816-86f6-8922b2b53099 tempest-QuotasAdminTestJSON-1237312796 tempest-QuotasAdminTestJSON-1237312796-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:59.707951 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9daf35b3-2ba5-4816-86f6-8922b2b53099 tempest-QuotasAdminTestJSON-1237312796 tempest-QuotasAdminTestJSON-1237312796-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:59.712515 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9daf35b3-2ba5-4816-86f6-8922b2b53099 tempest-QuotasAdminTestJSON-1237312796 tempest-QuotasAdminTestJSON-1237312796-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:59.764141 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d8797252-f139-40d3-a06c-889b8e276e75 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Going to run 1 instances... {{(pid=122257) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:08:59.782254 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d8797252-f139-40d3-a06c-889b8e276e75 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] [instance: e6064a64-eae1-400c-b60c-2189e025905f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:08:59.878134 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9daf35b3-2ba5-4816-86f6-8922b2b53099 tempest-QuotasAdminTestJSON-1237312796 tempest-QuotasAdminTestJSON-1237312796-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:59.878971 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9daf35b3-2ba5-4816-86f6-8922b2b53099 tempest-QuotasAdminTestJSON-1237312796 tempest-QuotasAdminTestJSON-1237312796-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:59.879428 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9daf35b3-2ba5-4816-86f6-8922b2b53099 tempest-QuotasAdminTestJSON-1237312796 tempest-QuotasAdminTestJSON-1237312796-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:59.880582 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9daf35b3-2ba5-4816-86f6-8922b2b53099 tempest-QuotasAdminTestJSON-1237312796 tempest-QuotasAdminTestJSON-1237312796-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:59.881261 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9daf35b3-2ba5-4816-86f6-8922b2b53099 tempest-QuotasAdminTestJSON-1237312796 tempest-QuotasAdminTestJSON-1237312796-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:59.881772 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9daf35b3-2ba5-4816-86f6-8922b2b53099 tempest-QuotasAdminTestJSON-1237312796 tempest-QuotasAdminTestJSON-1237312796-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:59.941129 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d8797252-f139-40d3-a06c-889b8e276e75 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.817442 Aug 31 16:08:59.942391 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1487/3002] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:08:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 2827 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:09:00.009410 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9daf35b3-2ba5-4816-86f6-8922b2b53099 tempest-QuotasAdminTestJSON-1237312796 tempest-QuotasAdminTestJSON-1237312796-project-admin] 10.222.0.61 "PUT /compute/v2.1/os-quota-sets/a2b97afbf1744c1586c9cbf16156fd84?user_id=64694110663a4c53a068b9f063ce6ad2" status: 200 len: 328 microversion: 2.1 time: 0.507181 Aug 31 16:09:00.017891 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1516/3003] 10.222.0.61 () {60 vars in 1343 bytes} [Wed Aug 31 16:08:59 2022] PUT /compute/v2.1/os-quota-sets/a2b97afbf1744c1586c9cbf16156fd84?user_id=64694110663a4c53a068b9f063ce6ad2 => generated 328 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:09:00.028124 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b413f92e-ea6a-446c-ba7c-147ff1ab6925 tempest-QuotasAdminTestJSON-1237312796 tempest-QuotasAdminTestJSON-1237312796-project-admin] Calling method '.version_select at 0x7f5ae9054dc0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:00.133054 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-91c03041-d47a-42e5-be44-83feeb649fe3 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-513644095", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "451", "networks": [{"uuid": "9caeebc7-b4c5-4cf9-8879-597736ffa82b"}]}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:09:00.233554 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-91c03041-d47a-42e5-be44-83feeb649fe3 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] validate_networks() for [('9caeebc7-b4c5-4cf9-8879-597736ffa82b', None, None, None, None, None)] {{(pid=122256) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:09:00.310986 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b413f92e-ea6a-446c-ba7c-147ff1ab6925 tempest-QuotasAdminTestJSON-1237312796 tempest-QuotasAdminTestJSON-1237312796-project-admin] 10.222.0.61 "GET /compute/v2.1/os-quota-sets/a2b97afbf1744c1586c9cbf16156fd84?user_id=64694110663a4c53a068b9f063ce6ad2" status: 200 len: 370 microversion: 2.1 time: 0.285188 Aug 31 16:09:00.312873 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1488/3004] 10.222.0.61 () {58 vars in 1323 bytes} [Wed Aug 31 16:09:00 2022] GET /compute/v2.1/os-quota-sets/a2b97afbf1744c1586c9cbf16156fd84?user_id=64694110663a4c53a068b9f063ce6ad2 => generated 370 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:09:00.524627 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-876f6a4a-2ebf-481a-9e08-01aacb01b766 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:00.528244 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-876f6a4a-2ebf-481a-9e08-01aacb01b766 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 0a5d6a47-ce38-4d1d-8d97-550f5e950af5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:00.546479 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-876f6a4a-2ebf-481a-9e08-01aacb01b766 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:00.547580 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-876f6a4a-2ebf-481a-9e08-01aacb01b766 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:00.549046 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-876f6a4a-2ebf-481a-9e08-01aacb01b766 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:00.550037 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-876f6a4a-2ebf-481a-9e08-01aacb01b766 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:00.551035 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-876f6a4a-2ebf-481a-9e08-01aacb01b766 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:00.551832 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-876f6a4a-2ebf-481a-9e08-01aacb01b766 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:03.826927 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-876f6a4a-2ebf-481a-9e08-01aacb01b766 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:03.849323 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-876f6a4a-2ebf-481a-9e08-01aacb01b766 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/0a5d6a47-ce38-4d1d-8d97-550f5e950af5" status: 200 len: 1494 microversion: 2.1 time: 3.327605 Aug 31 16:09:03.850018 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1489/3005] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:00 2022] GET /compute/v2.1/servers/0a5d6a47-ce38-4d1d-8d97-550f5e950af5 => generated 1494 bytes in 3332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:09:03.861168 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8f825be3-2e22-4b45-8588-31fa60fbd44e tempest-QuotasAdminTestJSON-1237312796 tempest-QuotasAdminTestJSON-1237312796-project-admin] Calling method '.version_select at 0x7f5ae8de7040>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:04.210961 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8f825be3-2e22-4b45-8588-31fa60fbd44e tempest-QuotasAdminTestJSON-1237312796 tempest-QuotasAdminTestJSON-1237312796-project-admin] 10.222.0.61 "GET /compute/v2.1/os-quota-sets/ff3a47c03d4d44ed84beb0a813230c82/defaults" status: 200 len: 371 microversion: 2.1 time: 0.354035 Aug 31 16:09:04.213034 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1490/3006] 10.222.0.61 () {58 vars in 1269 bytes} [Wed Aug 31 16:09:03 2022] GET /compute/v2.1/os-quota-sets/ff3a47c03d4d44ed84beb0a813230c82/defaults => generated 371 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:09:04.230897 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f8b1df99-5099-4ccb-9a03-a3759066d42e tempest-QuotasAdminTestJSON-1237312796 tempest-QuotasAdminTestJSON-1237312796-project-admin] Action: 'update', calling method: .version_select at 0x7f5ae8de7ee0>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:09:04.438186 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f8b1df99-5099-4ccb-9a03-a3759066d42e tempest-QuotasAdminTestJSON-1237312796 tempest-QuotasAdminTestJSON-1237312796-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:04.438687 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f8b1df99-5099-4ccb-9a03-a3759066d42e tempest-QuotasAdminTestJSON-1237312796 tempest-QuotasAdminTestJSON-1237312796-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:04.441535 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f8b1df99-5099-4ccb-9a03-a3759066d42e tempest-QuotasAdminTestJSON-1237312796 tempest-QuotasAdminTestJSON-1237312796-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:04.442334 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f8b1df99-5099-4ccb-9a03-a3759066d42e tempest-QuotasAdminTestJSON-1237312796 tempest-QuotasAdminTestJSON-1237312796-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:04.442800 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f8b1df99-5099-4ccb-9a03-a3759066d42e tempest-QuotasAdminTestJSON-1237312796 tempest-QuotasAdminTestJSON-1237312796-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:04.443237 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f8b1df99-5099-4ccb-9a03-a3759066d42e tempest-QuotasAdminTestJSON-1237312796 tempest-QuotasAdminTestJSON-1237312796-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:04.553521 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-91c03041-d47a-42e5-be44-83feeb649fe3 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:09:04.554130 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-91c03041-d47a-42e5-be44-83feeb649fe3 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:09:04.554463 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-91c03041-d47a-42e5-be44-83feeb649fe3 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:09:04.554880 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-91c03041-d47a-42e5-be44-83feeb649fe3 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:09:04.555300 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-91c03041-d47a-42e5-be44-83feeb649fe3 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:09:04.593927 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-91c03041-d47a-42e5-be44-83feeb649fe3 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:04.599927 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-91c03041-d47a-42e5-be44-83feeb649fe3 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:04.602267 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-91c03041-d47a-42e5-be44-83feeb649fe3 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:04.606365 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-91c03041-d47a-42e5-be44-83feeb649fe3 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:04.609240 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-91c03041-d47a-42e5-be44-83feeb649fe3 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:04.611280 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-91c03041-d47a-42e5-be44-83feeb649fe3 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:04.739192 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-91c03041-d47a-42e5-be44-83feeb649fe3 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Getting quotas for project 1cf281e8857247c6b9e60d4216741f89. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:09:04.769900 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-91c03041-d47a-42e5-be44-83feeb649fe3 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Getting quotas for user 41b93395d63a4db895ff224a311940e3 and project 1cf281e8857247c6b9e60d4216741f89. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:09:04.843445 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-91c03041-d47a-42e5-be44-83feeb649fe3 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Going to run 1 instances... {{(pid=122256) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:09:04.855066 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f8b1df99-5099-4ccb-9a03-a3759066d42e tempest-QuotasAdminTestJSON-1237312796 tempest-QuotasAdminTestJSON-1237312796-project-admin] 10.222.0.61 "PUT /compute/v2.1/os-quota-sets/ff3a47c03d4d44ed84beb0a813230c82" status: 200 len: 329 microversion: 2.1 time: 0.632151 Aug 31 16:09:04.858837 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1491/3007] 10.222.0.61 () {60 vars in 1263 bytes} [Wed Aug 31 16:09:04 2022] PUT /compute/v2.1/os-quota-sets/ff3a47c03d4d44ed84beb0a813230c82 => generated 329 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:09:04.862927 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-91c03041-d47a-42e5-be44-83feeb649fe3 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] [instance: d1e43fd8-2e15-468d-9da0-2851a41bd23b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:09:04.871160 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9c675318-6349-4d13-921d-a34be8cfbd00 tempest-QuotasAdminTestJSON-1237312796 tempest-QuotasAdminTestJSON-1237312796-project-admin] Action: 'update', calling method: .version_select at 0x7f5ae8ec5790>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:09:04.985528 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-91c03041-d47a-42e5-be44-83feeb649fe3 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.857848 Aug 31 16:09:04.986939 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1517/3008] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:09:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 4860 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:09:04.996768 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-703e8686-f28e-46f5-97d8-32964366bd09 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:04.998552 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-703e8686-f28e-46f5-97d8-32964366bd09 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 0a5d6a47-ce38-4d1d-8d97-550f5e950af5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:05.007892 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-703e8686-f28e-46f5-97d8-32964366bd09 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:05.008817 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-703e8686-f28e-46f5-97d8-32964366bd09 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:05.009471 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-703e8686-f28e-46f5-97d8-32964366bd09 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:05.010578 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-703e8686-f28e-46f5-97d8-32964366bd09 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:05.012266 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-703e8686-f28e-46f5-97d8-32964366bd09 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:05.012907 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-703e8686-f28e-46f5-97d8-32964366bd09 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:05.028592 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9c675318-6349-4d13-921d-a34be8cfbd00 tempest-QuotasAdminTestJSON-1237312796 tempest-QuotasAdminTestJSON-1237312796-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:05.029107 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9c675318-6349-4d13-921d-a34be8cfbd00 tempest-QuotasAdminTestJSON-1237312796 tempest-QuotasAdminTestJSON-1237312796-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:05.029576 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9c675318-6349-4d13-921d-a34be8cfbd00 tempest-QuotasAdminTestJSON-1237312796 tempest-QuotasAdminTestJSON-1237312796-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:05.035554 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9c675318-6349-4d13-921d-a34be8cfbd00 tempest-QuotasAdminTestJSON-1237312796 tempest-QuotasAdminTestJSON-1237312796-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:05.036149 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9c675318-6349-4d13-921d-a34be8cfbd00 tempest-QuotasAdminTestJSON-1237312796 tempest-QuotasAdminTestJSON-1237312796-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:05.036610 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9c675318-6349-4d13-921d-a34be8cfbd00 tempest-QuotasAdminTestJSON-1237312796 tempest-QuotasAdminTestJSON-1237312796-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:05.585458 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=24,nova_api:UPDATE=7 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:09:06.038425 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9c675318-6349-4d13-921d-a34be8cfbd00 tempest-QuotasAdminTestJSON-1237312796 tempest-QuotasAdminTestJSON-1237312796-project-admin] 10.222.0.61 "PUT /compute/v2.1/os-quota-sets/ff3a47c03d4d44ed84beb0a813230c82" status: 200 len: 329 microversion: 2.1 time: 1.171330 Aug 31 16:09:06.042261 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1492/3009] 10.222.0.61 () {60 vars in 1263 bytes} [Wed Aug 31 16:09:04 2022] PUT /compute/v2.1/os-quota-sets/ff3a47c03d4d44ed84beb0a813230c82 => generated 329 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:09:06.056939 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1c74000d-db25-4bb0-953e-e4f56934c866 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:06.060278 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1c74000d-db25-4bb0-953e-e4f56934c866 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] [instance: d1e43fd8-2e15-468d-9da0-2851a41bd23b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:06.634992 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-1c74000d-db25-4bb0-953e-e4f56934c866 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b93395d63a4db895ff224a311940e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf281e8857247c6b9e60d4216741f89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:06.662718 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1c74000d-db25-4bb0-953e-e4f56934c866 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] 10.222.0.61 "GET /compute/v2.1/servers/d1e43fd8-2e15-468d-9da0-2851a41bd23b" status: 200 len: 1220 microversion: 2.1 time: 0.616157 Aug 31 16:09:06.666325 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1493/3010] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:06 2022] GET /compute/v2.1/servers/d1e43fd8-2e15-468d-9da0-2851a41bd23b => generated 1220 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:06.856570 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-703e8686-f28e-46f5-97d8-32964366bd09 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:06.868402 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-703e8686-f28e-46f5-97d8-32964366bd09 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/0a5d6a47-ce38-4d1d-8d97-550f5e950af5" status: 200 len: 1494 microversion: 2.1 time: 1.880003 Aug 31 16:09:06.876304 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1518/3011] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:04 2022] GET /compute/v2.1/servers/0a5d6a47-ce38-4d1d-8d97-550f5e950af5 => generated 1494 bytes in 1889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:07.096961 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-9f3a7691-abd2-4734-bafa-ed70112d68d9 req-edede652-a0e0-444a-a9c0-81b6010e04ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a5d6a47-ce38-4d1d-8d97-550f5e950af5", "name": "network-vif-deleted", "tag": "ebd19817-6484-40fc-bcca-5b49c8f8bbc4"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:09:07.129555 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-9f3a7691-abd2-4734-bafa-ed70112d68d9 req-edede652-a0e0-444a-a9c0-81b6010e04ea service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:07.130057 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-9f3a7691-abd2-4734-bafa-ed70112d68d9 req-edede652-a0e0-444a-a9c0-81b6010e04ea service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:07.130497 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-9f3a7691-abd2-4734-bafa-ed70112d68d9 req-edede652-a0e0-444a-a9c0-81b6010e04ea service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:07.173961 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-9f3a7691-abd2-4734-bafa-ed70112d68d9 req-edede652-a0e0-444a-a9c0-81b6010e04ea service nova] Creating event network-vif-deleted:ebd19817-6484-40fc-bcca-5b49c8f8bbc4 for instance 0a5d6a47-ce38-4d1d-8d97-550f5e950af5 on n-h1-850499-9 Aug 31 16:09:07.179409 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-9f3a7691-abd2-4734-bafa-ed70112d68d9 req-edede652-a0e0-444a-a9c0-81b6010e04ea service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086677 Aug 31 16:09:07.190828 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1494/3012] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:09:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:09:07.687734 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1c335f93-f05a-45bf-bb9b-af475fc76d7f tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:07.688649 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1c335f93-f05a-45bf-bb9b-af475fc76d7f tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] [instance: d1e43fd8-2e15-468d-9da0-2851a41bd23b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:07.705244 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1c335f93-f05a-45bf-bb9b-af475fc76d7f tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:07.708993 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1c335f93-f05a-45bf-bb9b-af475fc76d7f tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:07.711689 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1c335f93-f05a-45bf-bb9b-af475fc76d7f tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:07.715021 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1c335f93-f05a-45bf-bb9b-af475fc76d7f tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:07.717720 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1c335f93-f05a-45bf-bb9b-af475fc76d7f tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:07.721437 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1c335f93-f05a-45bf-bb9b-af475fc76d7f tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:07.897537 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-cc323e01-d733-4675-882b-597c84f2f14b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:07.900850 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-cc323e01-d733-4675-882b-597c84f2f14b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 0a5d6a47-ce38-4d1d-8d97-550f5e950af5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:07.963728 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cc323e01-d733-4675-882b-597c84f2f14b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:07.964817 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cc323e01-d733-4675-882b-597c84f2f14b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:07.968469 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cc323e01-d733-4675-882b-597c84f2f14b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:07.969667 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cc323e01-d733-4675-882b-597c84f2f14b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:07.970555 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cc323e01-d733-4675-882b-597c84f2f14b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:07.971156 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cc323e01-d733-4675-882b-597c84f2f14b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:08.210782 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cc323e01-d733-4675-882b-597c84f2f14b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:08.218936 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cc323e01-d733-4675-882b-597c84f2f14b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:08.219600 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cc323e01-d733-4675-882b-597c84f2f14b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:08.220544 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-cc323e01-d733-4675-882b-597c84f2f14b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lazy-loading 'fault' on Instance uuid 0a5d6a47-ce38-4d1d-8d97-550f5e950af5 {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:09:08.479596 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1c335f93-f05a-45bf-bb9b-af475fc76d7f tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b93395d63a4db895ff224a311940e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf281e8857247c6b9e60d4216741f89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:08.502475 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1c335f93-f05a-45bf-bb9b-af475fc76d7f tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] 10.222.0.61 "GET /compute/v2.1/servers/d1e43fd8-2e15-468d-9da0-2851a41bd23b" status: 200 len: 1272 microversion: 2.1 time: 0.813357 Aug 31 16:09:08.507064 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1519/3013] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:07 2022] GET /compute/v2.1/servers/d1e43fd8-2e15-468d-9da0-2851a41bd23b => generated 1272 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:08.537843 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-cc323e01-d733-4675-882b-597c84f2f14b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:08.561885 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-cc323e01-d733-4675-882b-597c84f2f14b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/0a5d6a47-ce38-4d1d-8d97-550f5e950af5" status: 200 len: 1304 microversion: 2.1 time: 0.668468 Aug 31 16:09:08.577628 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1495/3014] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:07 2022] GET /compute/v2.1/servers/0a5d6a47-ce38-4d1d-8d97-550f5e950af5 => generated 1304 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:09:09.529999 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1b0e7832-4876-4e75-9d2a-2b0726b5cd27 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:09.530621 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1b0e7832-4876-4e75-9d2a-2b0726b5cd27 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] [instance: d1e43fd8-2e15-468d-9da0-2851a41bd23b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:09.548965 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1b0e7832-4876-4e75-9d2a-2b0726b5cd27 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:09.549514 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1b0e7832-4876-4e75-9d2a-2b0726b5cd27 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:09.549967 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1b0e7832-4876-4e75-9d2a-2b0726b5cd27 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:09.555106 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1b0e7832-4876-4e75-9d2a-2b0726b5cd27 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:09.557575 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1b0e7832-4876-4e75-9d2a-2b0726b5cd27 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:09.558077 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1b0e7832-4876-4e75-9d2a-2b0726b5cd27 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:09.595095 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-27ed4b57-7ee6-4a02-a543-323cd3bb6f21 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:09.596894 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-27ed4b57-7ee6-4a02-a543-323cd3bb6f21 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 0a5d6a47-ce38-4d1d-8d97-550f5e950af5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:09.618733 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-27ed4b57-7ee6-4a02-a543-323cd3bb6f21 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:09.620250 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-27ed4b57-7ee6-4a02-a543-323cd3bb6f21 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:09.621648 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-27ed4b57-7ee6-4a02-a543-323cd3bb6f21 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:09.624050 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-27ed4b57-7ee6-4a02-a543-323cd3bb6f21 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:09.625488 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-27ed4b57-7ee6-4a02-a543-323cd3bb6f21 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:09.627463 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-27ed4b57-7ee6-4a02-a543-323cd3bb6f21 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:09.663105 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-27ed4b57-7ee6-4a02-a543-323cd3bb6f21 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] HTTP exception thrown: Instance 0a5d6a47-ce38-4d1d-8d97-550f5e950af5 could not be found. Aug 31 16:09:09.668766 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-27ed4b57-7ee6-4a02-a543-323cd3bb6f21 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Request method failure captured: Aug 31 16:09:09.668766 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/0a5d6a47-ce38-4d1d-8d97-550f5e950af5 HTTP/1.1 Aug 31 16:09:09.668766 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:09:09.668766 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:09:09.668766 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:09:09.668766 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:09:09.668766 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:09:09.668766 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:09:09.668766 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:09:09.668766 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:09:09.668766 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4Yo5dNOTiRoHOXx-UM5Sn8Jbzoi0Z4yz9YBk3W8_DEhZnVZu-DDO0QOzNoQHJ1nNP8QtjbDsJSdq3n7hK4ZXI2LEyeWPrk9aNaREtGRbElEfeP-G76pg20KjiuDCyp0gfSMP_cw21bhq2fJbey8HuCI0lmGBIAsUVWfxqkVQu-gwfg Aug 31 16:09:09.668766 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:09:09.668766 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:09:09.668766 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:09:09.668766 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:09:09.668766 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:09:09.668766 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:09:09.668766 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: af5a8bccbcb14afd9c6bcd6f4d4f8047 Aug 31 16:09:09.668766 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-DeleteServersTestJSON-1125268000 Aug 31 16:09:09.668766 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:09:09.668766 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:09:09.668766 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/af5a8bccbcb14afd9c6bcd6f4d4f8047"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/af5a8bccbcb14afd9c6bcd6f4d4f8047"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_af5a8bccbcb14afd9c6bcd6f4d4f8047", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/af5a8bccbcb14afd9c6bcd6f4d4f8047"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:09:09.668766 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-DeleteServersTestJSON-1125268000 Aug 31 16:09:09.668766 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: af5a8bccbcb14afd9c6bcd6f4d4f8047 Aug 31 16:09:09.668766 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-DeleteServersTestJSON-1125268000 Aug 31 16:09:09.668766 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-DeleteServersTestJSON-1125268000-project Aug 31 16:09:09.668766 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:09:09.668766 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:09:09.668766 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 4ee58e6a7c284cc9a9c87d0a5c1239aa Aug 31 16:09:09.668766 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-DeleteServersTestJSON-1125268000-project Aug 31 16:09:09.668766 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:09:09.668766 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance 0a5d6a47-ce38-4d1d-8d97-550f5e950af5 could not be found. Aug 31 16:09:09.668766 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '0a5d6a47-ce38-4d1d-8d97-550f5e950af5'} Aug 31 16:09:09.668766 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:09:09.668766 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:09:09.668766 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:09:09.668766 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:09:09.668766 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:09:09.668766 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:09:09.668766 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:09:09.668766 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:09:09.668766 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:09:09.668766 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:09:09.668766 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a5d6a47-ce38-4d1d-8d97-550f5e950af5 could not be found. Aug 31 16:09:09.668766 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:09:09.668766 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:09:09.668766 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:09:09.668766 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:09:09.668766 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:09:09.668766 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:09:09.668766 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:09:09.668766 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:09:09.668766 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:09:09.668766 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:09:09.668766 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:09:09.668766 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:09:09.668766 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:09:09.668766 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:09:09.668766 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:09:09.668766 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:09:09.668766 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a5d6a47-ce38-4d1d-8d97-550f5e950af5 could not be found. Aug 31 16:09:09.668766 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:09:09.668766 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:09:09.668766 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:09:09.672827 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:09:09.672827 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:09:09.672827 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:09:09.672827 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:09:09.672827 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:09:09.672827 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a5d6a47-ce38-4d1d-8d97-550f5e950af5 could not be found. Aug 31 16:09:09.672827 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:09:09.677055 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-27ed4b57-7ee6-4a02-a543-323cd3bb6f21 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Returning 404 to user: Instance 0a5d6a47-ce38-4d1d-8d97-550f5e950af5 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:09:09.678321 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-27ed4b57-7ee6-4a02-a543-323cd3bb6f21 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/0a5d6a47-ce38-4d1d-8d97-550f5e950af5" status: 404 len: 111 microversion: 2.1 time: 0.095889 Aug 31 16:09:09.681779 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1496/3015] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:09 2022] GET /compute/v2.1/servers/0a5d6a47-ce38-4d1d-8d97-550f5e950af5 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:09:09.907743 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6df35918-169e-4624-9302-57517671b04a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1456655307", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "networks": [{"uuid": "b472c169-a645-4811-858d-fe4088611ce7"}]}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:09:10.041953 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-6df35918-169e-4624-9302-57517671b04a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] validate_networks() for [('b472c169-a645-4811-858d-fe4088611ce7', None, None, None, None, None)] {{(pid=122257) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:09:10.408860 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1b0e7832-4876-4e75-9d2a-2b0726b5cd27 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b93395d63a4db895ff224a311940e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf281e8857247c6b9e60d4216741f89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:10.444719 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1b0e7832-4876-4e75-9d2a-2b0726b5cd27 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] 10.222.0.61 "GET /compute/v2.1/servers/d1e43fd8-2e15-468d-9da0-2851a41bd23b" status: 200 len: 1278 microversion: 2.1 time: 0.920008 Aug 31 16:09:10.446670 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1520/3016] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:09 2022] GET /compute/v2.1/servers/d1e43fd8-2e15-468d-9da0-2851a41bd23b => generated 1278 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:11.503036 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-20a44d3d-56d0-4b65-8efd-dc89747dda29 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:11.504630 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-20a44d3d-56d0-4b65-8efd-dc89747dda29 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] [instance: d1e43fd8-2e15-468d-9da0-2851a41bd23b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:11.525777 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-20a44d3d-56d0-4b65-8efd-dc89747dda29 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:11.530166 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-20a44d3d-56d0-4b65-8efd-dc89747dda29 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:11.531270 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-20a44d3d-56d0-4b65-8efd-dc89747dda29 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:11.532759 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-20a44d3d-56d0-4b65-8efd-dc89747dda29 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:11.535624 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-20a44d3d-56d0-4b65-8efd-dc89747dda29 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:11.537531 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-20a44d3d-56d0-4b65-8efd-dc89747dda29 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:12.014680 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-20a44d3d-56d0-4b65-8efd-dc89747dda29 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b93395d63a4db895ff224a311940e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf281e8857247c6b9e60d4216741f89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:12.047340 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-20a44d3d-56d0-4b65-8efd-dc89747dda29 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] 10.222.0.61 "GET /compute/v2.1/servers/d1e43fd8-2e15-468d-9da0-2851a41bd23b" status: 200 len: 1278 microversion: 2.1 time: 0.552123 Aug 31 16:09:12.050536 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1521/3017] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:11 2022] GET /compute/v2.1/servers/d1e43fd8-2e15-468d-9da0-2851a41bd23b => generated 1278 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:09:13.074338 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-30a72c3f-2f06-47cb-a077-1508f1f5aa41 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:13.075732 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-30a72c3f-2f06-47cb-a077-1508f1f5aa41 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] [instance: d1e43fd8-2e15-468d-9da0-2851a41bd23b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:13.091625 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-30a72c3f-2f06-47cb-a077-1508f1f5aa41 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:13.092495 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-30a72c3f-2f06-47cb-a077-1508f1f5aa41 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:13.094133 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-30a72c3f-2f06-47cb-a077-1508f1f5aa41 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:13.096488 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-30a72c3f-2f06-47cb-a077-1508f1f5aa41 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:13.097214 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-30a72c3f-2f06-47cb-a077-1508f1f5aa41 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:13.099694 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-30a72c3f-2f06-47cb-a077-1508f1f5aa41 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:14.156752 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-30a72c3f-2f06-47cb-a077-1508f1f5aa41 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b93395d63a4db895ff224a311940e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf281e8857247c6b9e60d4216741f89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:14.215179 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-30a72c3f-2f06-47cb-a077-1508f1f5aa41 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] 10.222.0.61 "GET /compute/v2.1/servers/d1e43fd8-2e15-468d-9da0-2851a41bd23b" status: 200 len: 1278 microversion: 2.1 time: 1.146822 Aug 31 16:09:14.223938 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1522/3018] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:13 2022] GET /compute/v2.1/servers/d1e43fd8-2e15-468d-9da0-2851a41bd23b => generated 1278 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:09:14.662960 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-6df35918-169e-4624-9302-57517671b04a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:09:14.663984 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-6df35918-169e-4624-9302-57517671b04a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:09:14.664643 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-6df35918-169e-4624-9302-57517671b04a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:09:14.665264 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-6df35918-169e-4624-9302-57517671b04a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:09:14.665851 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-6df35918-169e-4624-9302-57517671b04a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:09:14.689668 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6df35918-169e-4624-9302-57517671b04a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:14.691791 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6df35918-169e-4624-9302-57517671b04a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:14.692621 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6df35918-169e-4624-9302-57517671b04a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:14.695342 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6df35918-169e-4624-9302-57517671b04a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:14.696772 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6df35918-169e-4624-9302-57517671b04a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:14.698978 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6df35918-169e-4624-9302-57517671b04a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:14.733269 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=54 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:09:14.788876 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-6df35918-169e-4624-9302-57517671b04a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Getting quotas for project af5a8bccbcb14afd9c6bcd6f4d4f8047. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:09:14.808594 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-6df35918-169e-4624-9302-57517671b04a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Getting quotas for user 4ee58e6a7c284cc9a9c87d0a5c1239aa and project af5a8bccbcb14afd9c6bcd6f4d4f8047. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:09:14.886029 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6df35918-169e-4624-9302-57517671b04a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Going to run 1 instances... {{(pid=122257) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:09:14.902388 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6df35918-169e-4624-9302-57517671b04a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:09:15.054473 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6df35918-169e-4624-9302-57517671b04a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.156262 Aug 31 16:09:15.069045 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4d2e7210-3cc9-4336-9e1b-b6fb11b54650 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:15.069736 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4d2e7210-3cc9-4336-9e1b-b6fb11b54650 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:15.074093 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1497/3019] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:09:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 5177 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:09:15.074695 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=13 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:09:15.076604 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=38 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:09:15.248623 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f71d2366-b57b-469d-a5b8-bd4cf1edcc0b tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:15.249524 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f71d2366-b57b-469d-a5b8-bd4cf1edcc0b tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] [instance: d1e43fd8-2e15-468d-9da0-2851a41bd23b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:15.271296 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f71d2366-b57b-469d-a5b8-bd4cf1edcc0b tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:15.274081 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f71d2366-b57b-469d-a5b8-bd4cf1edcc0b tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:15.276570 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f71d2366-b57b-469d-a5b8-bd4cf1edcc0b tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:15.279610 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f71d2366-b57b-469d-a5b8-bd4cf1edcc0b tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:15.280654 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f71d2366-b57b-469d-a5b8-bd4cf1edcc0b tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:15.281419 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f71d2366-b57b-469d-a5b8-bd4cf1edcc0b tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:17.180160 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-4d2e7210-3cc9-4336-9e1b-b6fb11b54650 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:17.202150 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4d2e7210-3cc9-4336-9e1b-b6fb11b54650 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c" status: 200 len: 1215 microversion: 2.1 time: 2.137308 Aug 31 16:09:17.215718 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1523/3020] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:15 2022] GET /compute/v2.1/servers/0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c => generated 1215 bytes in 2151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:17.237504 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-29d09a08-e0a7-4d46-9974-42026bdf3df2 req-62df5a3f-8131-45be-9328-a4f1c78d26f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c393928f-2414-4093-9d72-93a21fc6c460", "tag": "090b122c-ccba-41fe-89db-ee3852481377"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:09:17.281502 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-29d09a08-e0a7-4d46-9974-42026bdf3df2 req-62df5a3f-8131-45be-9328-a4f1c78d26f4 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:17.287154 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-29d09a08-e0a7-4d46-9974-42026bdf3df2 req-62df5a3f-8131-45be-9328-a4f1c78d26f4 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:17.287658 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-29d09a08-e0a7-4d46-9974-42026bdf3df2 req-62df5a3f-8131-45be-9328-a4f1c78d26f4 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:17.326552 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-29d09a08-e0a7-4d46-9974-42026bdf3df2 req-62df5a3f-8131-45be-9328-a4f1c78d26f4 service nova] Creating event network-changed:090b122c-ccba-41fe-89db-ee3852481377 for instance c393928f-2414-4093-9d72-93a21fc6c460 on n-h2-850499-9 Aug 31 16:09:17.354145 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-29d09a08-e0a7-4d46-9974-42026bdf3df2 req-62df5a3f-8131-45be-9328-a4f1c78d26f4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124339 Aug 31 16:09:17.356551 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1524/3021] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:09:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:09:18.260609 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2bfe1eab-0cf2-4c9e-a190-645fff1c256f tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:18.262646 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2bfe1eab-0cf2-4c9e-a190-645fff1c256f tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:18.291730 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2bfe1eab-0cf2-4c9e-a190-645fff1c256f tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:18.297197 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2bfe1eab-0cf2-4c9e-a190-645fff1c256f tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:18.300047 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2bfe1eab-0cf2-4c9e-a190-645fff1c256f tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:18.306243 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2bfe1eab-0cf2-4c9e-a190-645fff1c256f tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:18.312250 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2bfe1eab-0cf2-4c9e-a190-645fff1c256f tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:18.316377 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2bfe1eab-0cf2-4c9e-a190-645fff1c256f tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:18.837938 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-2bfe1eab-0cf2-4c9e-a190-645fff1c256f tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:18.881077 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2bfe1eab-0cf2-4c9e-a190-645fff1c256f tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c" status: 200 len: 1273 microversion: 2.1 time: 0.637302 Aug 31 16:09:18.890969 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1525/3022] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:18 2022] GET /compute/v2.1/servers/0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c => generated 1273 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:09:19.177003 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f71d2366-b57b-469d-a5b8-bd4cf1edcc0b tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b93395d63a4db895ff224a311940e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf281e8857247c6b9e60d4216741f89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:19.214029 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f71d2366-b57b-469d-a5b8-bd4cf1edcc0b tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] 10.222.0.61 "GET /compute/v2.1/servers/d1e43fd8-2e15-468d-9da0-2851a41bd23b" status: 200 len: 1320 microversion: 2.1 time: 3.971344 Aug 31 16:09:19.217132 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1498/3023] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:15 2022] GET /compute/v2.1/servers/d1e43fd8-2e15-468d-9da0-2851a41bd23b => generated 1320 bytes in 3977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:09:19.915077 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-023ac636-d57a-4037-a283-4b3c6b626324 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:19.919862 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-023ac636-d57a-4037-a283-4b3c6b626324 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:19.955835 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-023ac636-d57a-4037-a283-4b3c6b626324 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:19.956418 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-023ac636-d57a-4037-a283-4b3c6b626324 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:19.956873 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-023ac636-d57a-4037-a283-4b3c6b626324 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:19.963041 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-023ac636-d57a-4037-a283-4b3c6b626324 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:19.964670 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-023ac636-d57a-4037-a283-4b3c6b626324 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:19.965467 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-023ac636-d57a-4037-a283-4b3c6b626324 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:19.997713 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:09:20.724679 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-cedf301f-f4f9-4dcc-a873-33c5ce7353e5 tempest-ServicesAdminNegativeTestJSON-2111411537 tempest-ServicesAdminNegativeTestJSON-2111411537-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:20.742602 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cedf301f-f4f9-4dcc-a873-33c5ce7353e5 tempest-ServicesAdminNegativeTestJSON-2111411537 tempest-ServicesAdminNegativeTestJSON-2111411537-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:20.751854 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cedf301f-f4f9-4dcc-a873-33c5ce7353e5 tempest-ServicesAdminNegativeTestJSON-2111411537 tempest-ServicesAdminNegativeTestJSON-2111411537-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:20.761652 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cedf301f-f4f9-4dcc-a873-33c5ce7353e5 tempest-ServicesAdminNegativeTestJSON-2111411537 tempest-ServicesAdminNegativeTestJSON-2111411537-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:20.764507 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cedf301f-f4f9-4dcc-a873-33c5ce7353e5 tempest-ServicesAdminNegativeTestJSON-2111411537 tempest-ServicesAdminNegativeTestJSON-2111411537-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:20.767867 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cedf301f-f4f9-4dcc-a873-33c5ce7353e5 tempest-ServicesAdminNegativeTestJSON-2111411537 tempest-ServicesAdminNegativeTestJSON-2111411537-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:20.769633 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cedf301f-f4f9-4dcc-a873-33c5ce7353e5 tempest-ServicesAdminNegativeTestJSON-2111411537 tempest-ServicesAdminNegativeTestJSON-2111411537-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:20.808765 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=11 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:09:20.873229 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-cedf301f-f4f9-4dcc-a873-33c5ce7353e5 tempest-ServicesAdminNegativeTestJSON-2111411537 tempest-ServicesAdminNegativeTestJSON-2111411537-project-admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.671226 Aug 31 16:09:20.878035 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1499/3024] 10.222.0.61 () {58 vars in 1137 bytes} [Wed Aug 31 16:09:20 2022] GET /compute/v2.1/os-services => generated 944 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:09:20.889517 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b24bd8a5-e0e8-426c-8f86-199f119693b0 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:20.890292 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b24bd8a5-e0e8-426c-8f86-199f119693b0 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] [instance: d1e43fd8-2e15-468d-9da0-2851a41bd23b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:20.912157 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b24bd8a5-e0e8-426c-8f86-199f119693b0 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:20.919373 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b24bd8a5-e0e8-426c-8f86-199f119693b0 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:20.920488 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b24bd8a5-e0e8-426c-8f86-199f119693b0 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:20.921378 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b24bd8a5-e0e8-426c-8f86-199f119693b0 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:20.923313 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b24bd8a5-e0e8-426c-8f86-199f119693b0 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:20.924746 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b24bd8a5-e0e8-426c-8f86-199f119693b0 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:21.537020 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-023ac636-d57a-4037-a283-4b3c6b626324 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:21.564533 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-023ac636-d57a-4037-a283-4b3c6b626324 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c" status: 200 len: 1273 microversion: 2.1 time: 1.654998 Aug 31 16:09:21.569049 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1526/3025] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:19 2022] GET /compute/v2.1/servers/0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c => generated 1273 bytes in 1666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:21.587924 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5d18706a-39e4-410a-af52-83214fafc746 tempest-ServicesAdminNegativeTestJSON-2111411537 tempest-ServicesAdminNegativeTestJSON-2111411537-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:21.602695 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5d18706a-39e4-410a-af52-83214fafc746 tempest-ServicesAdminNegativeTestJSON-2111411537 tempest-ServicesAdminNegativeTestJSON-2111411537-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:21.608669 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5d18706a-39e4-410a-af52-83214fafc746 tempest-ServicesAdminNegativeTestJSON-2111411537 tempest-ServicesAdminNegativeTestJSON-2111411537-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:21.609223 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5d18706a-39e4-410a-af52-83214fafc746 tempest-ServicesAdminNegativeTestJSON-2111411537 tempest-ServicesAdminNegativeTestJSON-2111411537-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:21.610062 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5d18706a-39e4-410a-af52-83214fafc746 tempest-ServicesAdminNegativeTestJSON-2111411537 tempest-ServicesAdminNegativeTestJSON-2111411537-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:21.610547 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5d18706a-39e4-410a-af52-83214fafc746 tempest-ServicesAdminNegativeTestJSON-2111411537 tempest-ServicesAdminNegativeTestJSON-2111411537-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:21.610984 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5d18706a-39e4-410a-af52-83214fafc746 tempest-ServicesAdminNegativeTestJSON-2111411537 tempest-ServicesAdminNegativeTestJSON-2111411537-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:21.728490 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5d18706a-39e4-410a-af52-83214fafc746 tempest-ServicesAdminNegativeTestJSON-2111411537 tempest-ServicesAdminNegativeTestJSON-2111411537-project-admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.143128 Aug 31 16:09:21.731011 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1527/3026] 10.222.0.61 () {58 vars in 1170 bytes} [Wed Aug 31 16:09:21 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:09:21.741922 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2b61a1ae-fc03-4205-bfbf-cefa6fbaa640 tempest-ServicesAdminNegativeTestJSON-2111411537 tempest-ServicesAdminNegativeTestJSON-2111411537-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:21.750989 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2b61a1ae-fc03-4205-bfbf-cefa6fbaa640 tempest-ServicesAdminNegativeTestJSON-2111411537 tempest-ServicesAdminNegativeTestJSON-2111411537-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:21.751418 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2b61a1ae-fc03-4205-bfbf-cefa6fbaa640 tempest-ServicesAdminNegativeTestJSON-2111411537 tempest-ServicesAdminNegativeTestJSON-2111411537-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:21.751899 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2b61a1ae-fc03-4205-bfbf-cefa6fbaa640 tempest-ServicesAdminNegativeTestJSON-2111411537 tempest-ServicesAdminNegativeTestJSON-2111411537-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:21.752652 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2b61a1ae-fc03-4205-bfbf-cefa6fbaa640 tempest-ServicesAdminNegativeTestJSON-2111411537 tempest-ServicesAdminNegativeTestJSON-2111411537-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:21.753118 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2b61a1ae-fc03-4205-bfbf-cefa6fbaa640 tempest-ServicesAdminNegativeTestJSON-2111411537 tempest-ServicesAdminNegativeTestJSON-2111411537-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:21.753555 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2b61a1ae-fc03-4205-bfbf-cefa6fbaa640 tempest-ServicesAdminNegativeTestJSON-2111411537 tempest-ServicesAdminNegativeTestJSON-2111411537-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:21.850504 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:09:21.869601 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2b61a1ae-fc03-4205-bfbf-cefa6fbaa640 tempest-ServicesAdminNegativeTestJSON-2111411537 tempest-ServicesAdminNegativeTestJSON-2111411537-project-admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.129551 Aug 31 16:09:21.873856 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1528/3027] 10.222.0.61 () {58 vars in 1137 bytes} [Wed Aug 31 16:09:21 2022] GET /compute/v2.1/os-services => generated 944 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:09:21.888564 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-819d6227-f568-4ebb-bcc5-fa04398b65ef tempest-ServicesAdminNegativeTestJSON-2111411537 tempest-ServicesAdminNegativeTestJSON-2111411537-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:21.905113 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-819d6227-f568-4ebb-bcc5-fa04398b65ef tempest-ServicesAdminNegativeTestJSON-2111411537 tempest-ServicesAdminNegativeTestJSON-2111411537-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:21.908620 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-819d6227-f568-4ebb-bcc5-fa04398b65ef tempest-ServicesAdminNegativeTestJSON-2111411537 tempest-ServicesAdminNegativeTestJSON-2111411537-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:21.912625 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-819d6227-f568-4ebb-bcc5-fa04398b65ef tempest-ServicesAdminNegativeTestJSON-2111411537 tempest-ServicesAdminNegativeTestJSON-2111411537-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:21.918894 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-819d6227-f568-4ebb-bcc5-fa04398b65ef tempest-ServicesAdminNegativeTestJSON-2111411537 tempest-ServicesAdminNegativeTestJSON-2111411537-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:21.920479 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-819d6227-f568-4ebb-bcc5-fa04398b65ef tempest-ServicesAdminNegativeTestJSON-2111411537 tempest-ServicesAdminNegativeTestJSON-2111411537-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:21.921747 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-819d6227-f568-4ebb-bcc5-fa04398b65ef tempest-ServicesAdminNegativeTestJSON-2111411537 tempest-ServicesAdminNegativeTestJSON-2111411537-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:22.026788 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-819d6227-f568-4ebb-bcc5-fa04398b65ef tempest-ServicesAdminNegativeTestJSON-2111411537 tempest-ServicesAdminNegativeTestJSON-2111411537-project-admin] 10.222.0.61 "GET /compute/v2.1/os-services?host=n-d-850499-9&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.147102 Aug 31 16:09:22.044619 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1529/3028] 10.222.0.61 () {58 vars in 1194 bytes} [Wed Aug 31 16:09:21 2022] GET /compute/v2.1/os-services?host=n-d-850499-9&binary=xxx => generated 16 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 16:09:22.049841 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-00dd9010-f344-41dc-ba80-9a152f684b4c tempest-ServicesAdminNegativeTestJSON-2111411537 tempest-ServicesAdminNegativeTestJSON-2111411537-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:22.054085 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-00dd9010-f344-41dc-ba80-9a152f684b4c tempest-ServicesAdminNegativeTestJSON-2111411537 tempest-ServicesAdminNegativeTestJSON-2111411537-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:22.054577 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-00dd9010-f344-41dc-ba80-9a152f684b4c tempest-ServicesAdminNegativeTestJSON-2111411537 tempest-ServicesAdminNegativeTestJSON-2111411537-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:22.060325 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-00dd9010-f344-41dc-ba80-9a152f684b4c tempest-ServicesAdminNegativeTestJSON-2111411537 tempest-ServicesAdminNegativeTestJSON-2111411537-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:22.061407 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-00dd9010-f344-41dc-ba80-9a152f684b4c tempest-ServicesAdminNegativeTestJSON-2111411537 tempest-ServicesAdminNegativeTestJSON-2111411537-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:22.061908 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-00dd9010-f344-41dc-ba80-9a152f684b4c tempest-ServicesAdminNegativeTestJSON-2111411537 tempest-ServicesAdminNegativeTestJSON-2111411537-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:22.062429 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-00dd9010-f344-41dc-ba80-9a152f684b4c tempest-ServicesAdminNegativeTestJSON-2111411537 tempest-ServicesAdminNegativeTestJSON-2111411537-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:22.126737 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-00dd9010-f344-41dc-ba80-9a152f684b4c tempest-ServicesAdminNegativeTestJSON-2111411537 tempest-ServicesAdminNegativeTestJSON-2111411537-project-admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.068729 Aug 31 16:09:22.127795 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1530/3029] 10.222.0.61 () {58 vars in 1137 bytes} [Wed Aug 31 16:09:22 2022] GET /compute/v2.1/os-services => generated 944 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:09:22.142489 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8ebd114e-db74-4a96-bf7c-0e1938a18fce tempest-ServicesAdminNegativeTestJSON-2111411537 tempest-ServicesAdminNegativeTestJSON-2111411537-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:22.161585 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8ebd114e-db74-4a96-bf7c-0e1938a18fce tempest-ServicesAdminNegativeTestJSON-2111411537 tempest-ServicesAdminNegativeTestJSON-2111411537-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:22.162300 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8ebd114e-db74-4a96-bf7c-0e1938a18fce tempest-ServicesAdminNegativeTestJSON-2111411537 tempest-ServicesAdminNegativeTestJSON-2111411537-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:22.163122 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8ebd114e-db74-4a96-bf7c-0e1938a18fce tempest-ServicesAdminNegativeTestJSON-2111411537 tempest-ServicesAdminNegativeTestJSON-2111411537-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:22.164058 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8ebd114e-db74-4a96-bf7c-0e1938a18fce tempest-ServicesAdminNegativeTestJSON-2111411537 tempest-ServicesAdminNegativeTestJSON-2111411537-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:22.165435 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8ebd114e-db74-4a96-bf7c-0e1938a18fce tempest-ServicesAdminNegativeTestJSON-2111411537 tempest-ServicesAdminNegativeTestJSON-2111411537-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:22.166116 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8ebd114e-db74-4a96-bf7c-0e1938a18fce tempest-ServicesAdminNegativeTestJSON-2111411537 tempest-ServicesAdminNegativeTestJSON-2111411537-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:22.234661 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8ebd114e-db74-4a96-bf7c-0e1938a18fce tempest-ServicesAdminNegativeTestJSON-2111411537 tempest-ServicesAdminNegativeTestJSON-2111411537-project-admin] 10.222.0.61 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.098109 Aug 31 16:09:22.259309 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1531/3030] 10.222.0.61 () {58 vars in 1198 bytes} [Wed Aug 31 16:09:22 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 16:09:22.554968 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d5ecbaf0-349a-4ac4-abda-ea289d6cf8dd tempest-ServicesAdminNegativeTestJSON-413727506 tempest-ServicesAdminNegativeTestJSON-413727506-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:22.565166 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d5ecbaf0-349a-4ac4-abda-ea289d6cf8dd tempest-ServicesAdminNegativeTestJSON-413727506 tempest-ServicesAdminNegativeTestJSON-413727506-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '0cdfd85788f9407eb5525679d0b23d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e91261b0114b509ebe1b2d2c3e55d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:22.585773 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d5ecbaf0-349a-4ac4-abda-ea289d6cf8dd tempest-ServicesAdminNegativeTestJSON-413727506 tempest-ServicesAdminNegativeTestJSON-413727506-project] Request method failure captured: Aug 31 16:09:22.585773 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/os-services HTTP/1.1 Aug 31 16:09:22.585773 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:09:22.585773 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:09:22.585773 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:09:22.585773 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:09:22.585773 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:09:22.585773 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:09:22.585773 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:09:22.585773 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:09:22.585773 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4etG5WkcI1bF5fv_QSlYUQDktcKHfUd_AIXI2BXgIpCcynNo64pt3q-t5yH5aALbIvbnlz7ZTTjPtoHFLYB0gDv_QZezLyTGRZJ9iYAgYRd0z9rwDrJeecsIWOnAksqkvO4Ib1JeAMc_O8s8j8f4pYx45nU6g9YCl8MqWNHLIQ6hSE Aug 31 16:09:22.585773 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:09:22.585773 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:09:22.585773 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:09:22.585773 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:09:22.585773 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:09:22.585773 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:09:22.585773 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 67e91261b0114b509ebe1b2d2c3e55d1 Aug 31 16:09:22.585773 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-413727506 Aug 31 16:09:22.585773 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:09:22.585773 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:09:22.585773 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/67e91261b0114b509ebe1b2d2c3e55d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/67e91261b0114b509ebe1b2d2c3e55d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_67e91261b0114b509ebe1b2d2c3e55d1", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/67e91261b0114b509ebe1b2d2c3e55d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:09:22.585773 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-413727506 Aug 31 16:09:22.585773 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 67e91261b0114b509ebe1b2d2c3e55d1 Aug 31 16:09:22.585773 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-413727506 Aug 31 16:09:22.585773 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ServicesAdminNegativeTestJSON-413727506-project Aug 31 16:09:22.585773 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:09:22.585773 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:09:22.585773 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 0cdfd85788f9407eb5525679d0b23d0f Aug 31 16:09:22.585773 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-413727506-project Aug 31 16:09:22.585773 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:09:22.585773 n-d-850499-9 devstack@n-api.service[122256]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 31 16:09:22.585773 n-d-850499-9 devstack@n-api.service[122256]: action_args: {} Aug 31 16:09:22.585773 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:09:22.585773 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:09:22.585773 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:09:22.585773 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:09:22.585773 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:09:22.585773 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:09:22.585773 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 31 16:09:22.585773 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:09:22.585773 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 31 16:09:22.585773 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:09:22.585773 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:09:22.585773 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:09:22.585773 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Aug 31 16:09:22.585773 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Aug 31 16:09:22.585773 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 31 16:09:22.585773 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 31 16:09:22.585773 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 31 16:09:22.585773 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 31 16:09:22.585773 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 16:09:22.585773 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 31 16:09:22.585773 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 16:09:22.585773 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise self.value Aug 31 16:09:22.585773 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 31 16:09:22.585773 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 31 16:09:22.585773 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 31 16:09:22.585773 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 31 16:09:22.585773 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 31 16:09:22.585773 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 31 16:09:22.585773 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 31 16:09:22.585773 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:09:22.589829 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:09:22.589829 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:09:22.589829 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:09:22.589829 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:09:22.589829 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:09:22.589829 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 31 16:09:22.589829 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 31 16:09:22.589829 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 31 16:09:22.589829 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:09:22.595198 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d5ecbaf0-349a-4ac4-abda-ea289d6cf8dd tempest-ServicesAdminNegativeTestJSON-413727506 tempest-ServicesAdminNegativeTestJSON-413727506-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:09:22.597265 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d5ecbaf0-349a-4ac4-abda-ea289d6cf8dd tempest-ServicesAdminNegativeTestJSON-413727506 tempest-ServicesAdminNegativeTestJSON-413727506-project] 10.222.0.61 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.336867 Aug 31 16:09:22.610878 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1532/3031] 10.222.0.61 () {58 vars in 1137 bytes} [Wed Aug 31 16:09:22 2022] GET /compute/v2.1/os-services => generated 112 bytes in 351 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:09:22.629043 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-090e96fa-feae-456d-a053-624b8025cfb1 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:22.635573 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-090e96fa-feae-456d-a053-624b8025cfb1 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:22.661758 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-090e96fa-feae-456d-a053-624b8025cfb1 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:22.662599 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-090e96fa-feae-456d-a053-624b8025cfb1 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:22.663276 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-090e96fa-feae-456d-a053-624b8025cfb1 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:22.664262 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-090e96fa-feae-456d-a053-624b8025cfb1 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:22.665620 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-090e96fa-feae-456d-a053-624b8025cfb1 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:22.667479 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-090e96fa-feae-456d-a053-624b8025cfb1 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:23.187641 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-090e96fa-feae-456d-a053-624b8025cfb1 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:23.211911 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-090e96fa-feae-456d-a053-624b8025cfb1 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c" status: 200 len: 1273 microversion: 2.1 time: 0.588856 Aug 31 16:09:23.214432 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1533/3032] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:22 2022] GET /compute/v2.1/servers/0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c => generated 1273 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:23.726584 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b24bd8a5-e0e8-426c-8f86-199f119693b0 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b93395d63a4db895ff224a311940e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf281e8857247c6b9e60d4216741f89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:23.742022 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b24bd8a5-e0e8-426c-8f86-199f119693b0 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] 10.222.0.61 "GET /compute/v2.1/servers/d1e43fd8-2e15-468d-9da0-2851a41bd23b" status: 200 len: 1320 microversion: 2.1 time: 2.861965 Aug 31 16:09:23.747311 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1500/3033] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:20 2022] GET /compute/v2.1/servers/d1e43fd8-2e15-468d-9da0-2851a41bd23b => generated 1320 bytes in 2869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:24.242295 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-451e5eff-5a35-40c3-9270-7978bafd4928 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:24.243958 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-451e5eff-5a35-40c3-9270-7978bafd4928 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:24.273074 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-451e5eff-5a35-40c3-9270-7978bafd4928 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:24.274348 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-451e5eff-5a35-40c3-9270-7978bafd4928 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:24.277900 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-451e5eff-5a35-40c3-9270-7978bafd4928 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:24.279186 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-451e5eff-5a35-40c3-9270-7978bafd4928 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:24.280123 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-451e5eff-5a35-40c3-9270-7978bafd4928 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:24.282862 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-451e5eff-5a35-40c3-9270-7978bafd4928 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:24.450900 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-451e5eff-5a35-40c3-9270-7978bafd4928 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:24.460971 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-451e5eff-5a35-40c3-9270-7978bafd4928 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c" status: 200 len: 1273 microversion: 2.1 time: 0.224147 Aug 31 16:09:24.462179 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1534/3034] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:24 2022] GET /compute/v2.1/servers/0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c => generated 1273 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:24.772078 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ca3531ea-5d3d-4b2b-b07e-801a0ac4f715 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:24.772871 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ca3531ea-5d3d-4b2b-b07e-801a0ac4f715 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] [instance: d1e43fd8-2e15-468d-9da0-2851a41bd23b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:24.790737 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ca3531ea-5d3d-4b2b-b07e-801a0ac4f715 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:24.800972 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ca3531ea-5d3d-4b2b-b07e-801a0ac4f715 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:24.802070 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ca3531ea-5d3d-4b2b-b07e-801a0ac4f715 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:24.804116 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ca3531ea-5d3d-4b2b-b07e-801a0ac4f715 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:24.812275 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ca3531ea-5d3d-4b2b-b07e-801a0ac4f715 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:24.813883 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ca3531ea-5d3d-4b2b-b07e-801a0ac4f715 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:24.909126 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=94 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:09:25.000260 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-9e397161-ed9c-4fec-9b09-28af5736abc9 req-72d0d5f0-cf9a-467c-989f-799c0a4cffdd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6064a64-eae1-400c-b60c-2189e025905f", "tag": "5006df16-da92-4553-98f9-b281a211f4cd"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:09:25.018967 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-9e397161-ed9c-4fec-9b09-28af5736abc9 req-72d0d5f0-cf9a-467c-989f-799c0a4cffdd service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:25.019837 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-9e397161-ed9c-4fec-9b09-28af5736abc9 req-72d0d5f0-cf9a-467c-989f-799c0a4cffdd service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:25.020522 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-9e397161-ed9c-4fec-9b09-28af5736abc9 req-72d0d5f0-cf9a-467c-989f-799c0a4cffdd service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:25.034516 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-9e397161-ed9c-4fec-9b09-28af5736abc9 req-72d0d5f0-cf9a-467c-989f-799c0a4cffdd service nova] Creating event network-changed:5006df16-da92-4553-98f9-b281a211f4cd for instance e6064a64-eae1-400c-b60c-2189e025905f on n-h1-850499-9 Aug 31 16:09:25.059024 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-9e397161-ed9c-4fec-9b09-28af5736abc9 req-72d0d5f0-cf9a-467c-989f-799c0a4cffdd service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058476 Aug 31 16:09:25.065587 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1535/3035] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:09:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:09:25.489051 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-bd3d6426-603b-408a-bbbe-e17e6c12cb3b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:25.490932 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-bd3d6426-603b-408a-bbbe-e17e6c12cb3b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:25.518129 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bd3d6426-603b-408a-bbbe-e17e6c12cb3b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:25.523533 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bd3d6426-603b-408a-bbbe-e17e6c12cb3b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:25.524514 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bd3d6426-603b-408a-bbbe-e17e6c12cb3b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:25.526264 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bd3d6426-603b-408a-bbbe-e17e6c12cb3b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:25.526948 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bd3d6426-603b-408a-bbbe-e17e6c12cb3b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:25.528228 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bd3d6426-603b-408a-bbbe-e17e6c12cb3b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:27.187012 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:09:27.430518 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ca3531ea-5d3d-4b2b-b07e-801a0ac4f715 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b93395d63a4db895ff224a311940e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf281e8857247c6b9e60d4216741f89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:27.448458 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ca3531ea-5d3d-4b2b-b07e-801a0ac4f715 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] 10.222.0.61 "GET /compute/v2.1/servers/d1e43fd8-2e15-468d-9da0-2851a41bd23b" status: 200 len: 1320 microversion: 2.1 time: 2.680559 Aug 31 16:09:27.468656 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1501/3036] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:24 2022] GET /compute/v2.1/servers/d1e43fd8-2e15-468d-9da0-2851a41bd23b => generated 1320 bytes in 2701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:27.477700 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-4f016519-ca59-444d-9cc9-3f9bbf87fc56 req-956abc37-ebea-43f2-b53a-ef2b932587e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1e43fd8-2e15-468d-9da0-2851a41bd23b", "tag": "d51ed438-7b34-4bdd-985c-393bd746e794"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:09:27.489409 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-4f016519-ca59-444d-9cc9-3f9bbf87fc56 req-956abc37-ebea-43f2-b53a-ef2b932587e3 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:27.490343 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-4f016519-ca59-444d-9cc9-3f9bbf87fc56 req-956abc37-ebea-43f2-b53a-ef2b932587e3 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:27.491026 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-4f016519-ca59-444d-9cc9-3f9bbf87fc56 req-956abc37-ebea-43f2-b53a-ef2b932587e3 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:27.513738 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-4f016519-ca59-444d-9cc9-3f9bbf87fc56 req-956abc37-ebea-43f2-b53a-ef2b932587e3 service nova] Creating event network-changed:d51ed438-7b34-4bdd-985c-393bd746e794 for instance d1e43fd8-2e15-468d-9da0-2851a41bd23b on n-h1-850499-9 Aug 31 16:09:27.522878 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-4f016519-ca59-444d-9cc9-3f9bbf87fc56 req-956abc37-ebea-43f2-b53a-ef2b932587e3 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052747 Aug 31 16:09:27.525857 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1502/3037] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:09:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:09:28.552127 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-bd3d6426-603b-408a-bbbe-e17e6c12cb3b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:28.567421 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-bd3d6426-603b-408a-bbbe-e17e6c12cb3b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c" status: 200 len: 1315 microversion: 2.1 time: 3.086240 Aug 31 16:09:28.581400 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1536/3038] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:25 2022] GET /compute/v2.1/servers/0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c => generated 1315 bytes in 3102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:28.607710 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0ac3c6f3-a145-4bbd-85b9-4824ff4fd2f3 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:28.609359 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0ac3c6f3-a145-4bbd-85b9-4824ff4fd2f3 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] [instance: d1e43fd8-2e15-468d-9da0-2851a41bd23b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:28.639172 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0ac3c6f3-a145-4bbd-85b9-4824ff4fd2f3 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:28.644310 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0ac3c6f3-a145-4bbd-85b9-4824ff4fd2f3 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:28.646350 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0ac3c6f3-a145-4bbd-85b9-4824ff4fd2f3 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:28.649428 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0ac3c6f3-a145-4bbd-85b9-4824ff4fd2f3 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:28.651873 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0ac3c6f3-a145-4bbd-85b9-4824ff4fd2f3 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:28.658364 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0ac3c6f3-a145-4bbd-85b9-4824ff4fd2f3 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:28.750114 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e3c1d812-99e6-4de1-bae4-4951c3810d45 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1939192479", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "c9459329-3286-4b91-ae92-84b8eedc2e9a"}]}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:09:28.970683 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-e3c1d812-99e6-4de1-bae4-4951c3810d45 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] validate_networks() for [('c9459329-3286-4b91-ae92-84b8eedc2e9a', None, None, None, None, None)] {{(pid=122257) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:09:30.450031 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-0ac3c6f3-a145-4bbd-85b9-4824ff4fd2f3 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b93395d63a4db895ff224a311940e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf281e8857247c6b9e60d4216741f89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:30.463729 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0ac3c6f3-a145-4bbd-85b9-4824ff4fd2f3 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] 10.222.0.61 "GET /compute/v2.1/servers/d1e43fd8-2e15-468d-9da0-2851a41bd23b" status: 200 len: 1320 microversion: 2.1 time: 1.880589 Aug 31 16:09:30.492494 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1537/3039] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:28 2022] GET /compute/v2.1/servers/d1e43fd8-2e15-468d-9da0-2851a41bd23b => generated 1320 bytes in 1910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:30.515961 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c98868e0-da5a-4a7a-b306-145de467f69b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:30.521034 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c98868e0-da5a-4a7a-b306-145de467f69b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:30.578601 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c98868e0-da5a-4a7a-b306-145de467f69b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:30.595554 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c98868e0-da5a-4a7a-b306-145de467f69b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:30.609903 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c98868e0-da5a-4a7a-b306-145de467f69b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:30.613052 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c98868e0-da5a-4a7a-b306-145de467f69b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:30.613875 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c98868e0-da5a-4a7a-b306-145de467f69b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:30.618835 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c98868e0-da5a-4a7a-b306-145de467f69b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:30.872655 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:09:32.183217 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=10 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:09:33.069088 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c98868e0-da5a-4a7a-b306-145de467f69b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:33.094535 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c98868e0-da5a-4a7a-b306-145de467f69b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c" status: 200 len: 1315 microversion: 2.1 time: 2.598340 Aug 31 16:09:33.095662 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1538/3040] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:30 2022] GET /compute/v2.1/servers/0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c => generated 1315 bytes in 2602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:33.113076 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d8eab488-472b-45b3-a205-f308b649c37c tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:33.115581 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d8eab488-472b-45b3-a205-f308b649c37c tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] [instance: d1e43fd8-2e15-468d-9da0-2851a41bd23b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:33.131273 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d8eab488-472b-45b3-a205-f308b649c37c tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:33.135345 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d8eab488-472b-45b3-a205-f308b649c37c tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:33.136055 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d8eab488-472b-45b3-a205-f308b649c37c tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:33.137205 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d8eab488-472b-45b3-a205-f308b649c37c tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:33.140627 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d8eab488-472b-45b3-a205-f308b649c37c tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:33.141645 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d8eab488-472b-45b3-a205-f308b649c37c tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:33.399589 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-e3c1d812-99e6-4de1-bae4-4951c3810d45 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:09:33.400371 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-e3c1d812-99e6-4de1-bae4-4951c3810d45 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:09:33.401198 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-e3c1d812-99e6-4de1-bae4-4951c3810d45 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:09:33.401640 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-e3c1d812-99e6-4de1-bae4-4951c3810d45 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:09:33.402151 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-e3c1d812-99e6-4de1-bae4-4951c3810d45 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:09:33.417787 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e3c1d812-99e6-4de1-bae4-4951c3810d45 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:33.418551 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e3c1d812-99e6-4de1-bae4-4951c3810d45 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:33.419186 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e3c1d812-99e6-4de1-bae4-4951c3810d45 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:33.420143 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e3c1d812-99e6-4de1-bae4-4951c3810d45 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:33.420780 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e3c1d812-99e6-4de1-bae4-4951c3810d45 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:33.421379 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e3c1d812-99e6-4de1-bae4-4951c3810d45 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:33.463387 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-e3c1d812-99e6-4de1-bae4-4951c3810d45 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Getting quotas for project c965154856f84fecb30f49dfeac46fa0. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:09:33.511387 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-e3c1d812-99e6-4de1-bae4-4951c3810d45 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Getting quotas for user 68db583fb8fd4e6090fb220eeaafdd36 and project c965154856f84fecb30f49dfeac46fa0. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:09:33.560994 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e3c1d812-99e6-4de1-bae4-4951c3810d45 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Going to run 3 instances... {{(pid=122257) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:09:33.568309 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e3c1d812-99e6-4de1-bae4-4951c3810d45 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] [instance: b68db583-0d09-4485-8b26-ff5c02e23c01] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:09:33.667135 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e3c1d812-99e6-4de1-bae4-4951c3810d45 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] [instance: 29a78fc3-93ff-4f42-8c9f-79dfdc5229c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=b68db583-0d09-4485-8b26-ff5c02e23c01,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:09:33.779289 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e3c1d812-99e6-4de1-bae4-4951c3810d45 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] [instance: 33bb5423-4b3e-4030-a835-8ab823e2e00a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=29a78fc3-93ff-4f42-8c9f-79dfdc5229c6,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:09:34.116919 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e3c1d812-99e6-4de1-bae4-4951c3810d45 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.367549 Aug 31 16:09:34.119617 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1503/3041] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:09:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 6371 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 16:09:34.140083 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-eb79eb91-8442-4bc5-9ac6-e2eabe88ee0e tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:34.145460 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-eb79eb91-8442-4bc5-9ac6-e2eabe88ee0e tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '68db583fb8fd4e6090fb220eeaafdd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c965154856f84fecb30f49dfeac46fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:34.146752 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-eb79eb91-8442-4bc5-9ac6-e2eabe88ee0e tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Searching by: {'deleted': False, 'project_id': 'c965154856f84fecb30f49dfeac46fa0'} {{(pid=122257) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 16:09:34.240822 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eb79eb91-8442-4bc5-9ac6-e2eabe88ee0e tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:34.241715 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eb79eb91-8442-4bc5-9ac6-e2eabe88ee0e tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:34.247705 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eb79eb91-8442-4bc5-9ac6-e2eabe88ee0e tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:34.250837 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eb79eb91-8442-4bc5-9ac6-e2eabe88ee0e tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:34.267204 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eb79eb91-8442-4bc5-9ac6-e2eabe88ee0e tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:34.268349 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eb79eb91-8442-4bc5-9ac6-e2eabe88ee0e tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:34.410939 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-eb79eb91-8442-4bc5-9ac6-e2eabe88ee0e tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] 10.222.0.61 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.275052 Aug 31 16:09:34.415092 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1504/3042] 10.222.0.61 () {58 vars in 1125 bytes} [Wed Aug 31 16:09:34 2022] GET /compute/v2.1/servers => generated 1018 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:34.435989 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-98a26657-2a94-4528-a0da-beb6c506bd55 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:34.442341 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-98a26657-2a94-4528-a0da-beb6c506bd55 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:34.474664 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-98a26657-2a94-4528-a0da-beb6c506bd55 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:34.480783 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-98a26657-2a94-4528-a0da-beb6c506bd55 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:34.483062 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-98a26657-2a94-4528-a0da-beb6c506bd55 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:34.483794 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-98a26657-2a94-4528-a0da-beb6c506bd55 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:34.485174 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-98a26657-2a94-4528-a0da-beb6c506bd55 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:34.487216 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-98a26657-2a94-4528-a0da-beb6c506bd55 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:35.322656 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d8eab488-472b-45b3-a205-f308b649c37c tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b93395d63a4db895ff224a311940e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf281e8857247c6b9e60d4216741f89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:35.342436 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d8eab488-472b-45b3-a205-f308b649c37c tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] 10.222.0.61 "GET /compute/v2.1/servers/d1e43fd8-2e15-468d-9da0-2851a41bd23b" status: 200 len: 1320 microversion: 2.1 time: 2.244867 Aug 31 16:09:35.344614 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1539/3043] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:33 2022] GET /compute/v2.1/servers/d1e43fd8-2e15-468d-9da0-2851a41bd23b => generated 1320 bytes in 2248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:35.356040 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2ea4bc70-b2bb-4da9-9cb5-ce3c8786ca34 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:35.366695 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2ea4bc70-b2bb-4da9-9cb5-ce3c8786ca34 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] [instance: 33bb5423-4b3e-4030-a835-8ab823e2e00a] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:35.689528 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-2ea4bc70-b2bb-4da9-9cb5-ce3c8786ca34 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68db583fb8fd4e6090fb220eeaafdd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c965154856f84fecb30f49dfeac46fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:35.719060 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2ea4bc70-b2bb-4da9-9cb5-ce3c8786ca34 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] 10.222.0.61 "GET /compute/v2.1/servers/33bb5423-4b3e-4030-a835-8ab823e2e00a" status: 200 len: 1223 microversion: 2.1 time: 0.371628 Aug 31 16:09:35.720119 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1540/3044] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:35 2022] GET /compute/v2.1/servers/33bb5423-4b3e-4030-a835-8ab823e2e00a => generated 1223 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:35.731406 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-99794f4f-5d79-4567-a8b8-7365385b3b27 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-877491886", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "78f9d9ff-7812-4996-a58c-1bc2d43a58b5"}], "security_groups": [{"name": "tempest-securitygroup--1228051534"}], "key_name": "tempest-keypair-1779875600", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "b1910690-9680-4998-998b-040c900fa39e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:09:36.027465 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-98a26657-2a94-4528-a0da-beb6c506bd55 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:36.042409 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-98a26657-2a94-4528-a0da-beb6c506bd55 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c" status: 200 len: 1315 microversion: 2.1 time: 1.624177 Aug 31 16:09:36.057651 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1505/3045] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:34 2022] GET /compute/v2.1/servers/0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c => generated 1315 bytes in 1641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:36.245858 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6df7cd4e-f71b-43b3-b0da-39b4265b9a17 tempest-ServicesAdminNegativeV253TestJSON-210589138 tempest-ServicesAdminNegativeV253TestJSON-210589138-project-admin] Action: 'update', calling method: .version_select at 0x7f5ae8e3c9d0>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:09:36.250788 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6df7cd4e-f71b-43b3-b0da-39b4265b9a17 tempest-ServicesAdminNegativeV253TestJSON-210589138 tempest-ServicesAdminNegativeV253TestJSON-210589138-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:36.252130 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6df7cd4e-f71b-43b3-b0da-39b4265b9a17 tempest-ServicesAdminNegativeV253TestJSON-210589138 tempest-ServicesAdminNegativeV253TestJSON-210589138-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:36.252895 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6df7cd4e-f71b-43b3-b0da-39b4265b9a17 tempest-ServicesAdminNegativeV253TestJSON-210589138 tempest-ServicesAdminNegativeV253TestJSON-210589138-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:36.266624 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6df7cd4e-f71b-43b3-b0da-39b4265b9a17 tempest-ServicesAdminNegativeV253TestJSON-210589138 tempest-ServicesAdminNegativeV253TestJSON-210589138-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:36.267414 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6df7cd4e-f71b-43b3-b0da-39b4265b9a17 tempest-ServicesAdminNegativeV253TestJSON-210589138 tempest-ServicesAdminNegativeV253TestJSON-210589138-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:36.268063 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6df7cd4e-f71b-43b3-b0da-39b4265b9a17 tempest-ServicesAdminNegativeV253TestJSON-210589138 tempest-ServicesAdminNegativeV253TestJSON-210589138-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:36.277402 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-6df7cd4e-f71b-43b3-b0da-39b4265b9a17 tempest-ServicesAdminNegativeV253TestJSON-210589138 tempest-ServicesAdminNegativeV253TestJSON-210589138-project-admin] HTTP exception thrown: Service bf78381b-fbd0-45d4-a72f-d1109f3c3ebd could not be found. Aug 31 16:09:36.279912 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6df7cd4e-f71b-43b3-b0da-39b4265b9a17 tempest-ServicesAdminNegativeV253TestJSON-210589138 tempest-ServicesAdminNegativeV253TestJSON-210589138-project-admin] Request method failure captured: Aug 31 16:09:36.279912 n-d-850499-9 devstack@n-api.service[122257]: request: PUT /compute/v2.1/os-services/bf78381b-fbd0-45d4-a72f-d1109f3c3ebd HTTP/1.1 Aug 31 16:09:36.279912 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:09:36.279912 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:09:36.279912 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:09:36.279912 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 56 Aug 31 16:09:36.279912 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:09:36.279912 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:09:36.279912 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:09:36.279912 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:09:36.279912 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4e_G2dsInicQ6DV0C561yPSwhbTzA-sFhCyM2bbdzOz1B04tWcG5MpYGqWlbVZQJCnvZWuGyhs1sByeeB2n-XufYypWwtrIpGFuHkyw-xHuROlgUc4O0IsBZ9aoAjqfq7VAP_sGCy6IR-HzcXqR3pdDv7QdWvp_GBeojy6v9P7meQU Aug 31 16:09:36.279912 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:09:36.279912 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:09:36.279912 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:09:36.279912 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:09:36.279912 n-d-850499-9 devstack@n-api.service[122257]: X-Openstack-Nova-Api-Version: 2.53 Aug 31 16:09:36.279912 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:09:36.279912 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:09:36.279912 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 679a5f72295c414b80c418653b1cf7a8 Aug 31 16:09:36.279912 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-210589138 Aug 31 16:09:36.279912 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,admin,member Aug 31 16:09:36.279912 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,admin,member Aug 31 16:09:36.279912 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/679a5f72295c414b80c418653b1cf7a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/679a5f72295c414b80c418653b1cf7a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_679a5f72295c414b80c418653b1cf7a8", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/679a5f72295c414b80c418653b1cf7a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:09:36.279912 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-210589138 Aug 31 16:09:36.279912 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 679a5f72295c414b80c418653b1cf7a8 Aug 31 16:09:36.279912 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-210589138 Aug 31 16:09:36.279912 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ServicesAdminNegativeV253TestJSON-210589138-project-admin Aug 31 16:09:36.279912 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:09:36.279912 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:09:36.279912 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: fee57238069b4ceb873ffd6a8562069b Aug 31 16:09:36.279912 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-210589138-project-admin Aug 31 16:09:36.279912 n-d-850499-9 devstack@n-api.service[122257]: Aug 31 16:09:36.279912 n-d-850499-9 devstack@n-api.service[122257]: {"status": "disabled", "disabled_reason": "maintenance"} Aug 31 16:09:36.279912 n-d-850499-9 devstack@n-api.service[122257]: method: Aug 31 16:09:36.279912 n-d-850499-9 devstack@n-api.service[122257]: exception: Service bf78381b-fbd0-45d4-a72f-d1109f3c3ebd could not be found. Aug 31 16:09:36.279912 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': 'bf78381b-fbd0-45d4-a72f-d1109f3c3ebd', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Aug 31 16:09:36.279912 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:09:36.279912 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:09:36.279912 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6205, in service_get_by_id Aug 31 16:09:36.279912 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 31 16:09:36.279912 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6065, in _find_service_in_cell Aug 31 16:09:36.279912 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 31 16:09:36.279912 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 31 16:09:36.279912 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:09:36.279912 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:09:36.279912 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:09:36.279912 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:09:36.279912 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Aug 31 16:09:36.279912 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 31 16:09:36.279912 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Aug 31 16:09:36.279912 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 31 16:09:36.279912 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service bf78381b-fbd0-45d4-a72f-d1109f3c3ebd could not be found. Aug 31 16:09:36.279912 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:09:36.279912 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:09:36.279912 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:09:36.279912 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:09:36.279912 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:09:36.279912 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:09:36.279912 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:09:36.279912 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:09:36.279912 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:09:36.279912 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:09:36.279912 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:09:36.279912 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:09:36.279912 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:09:36.279912 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:09:36.284097 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Aug 31 16:09:36.284097 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:09:36.284097 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service bf78381b-fbd0-45d4-a72f-d1109f3c3ebd could not be found. Aug 31 16:09:36.284097 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:09:36.284097 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:09:36.284097 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:09:36.284097 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:09:36.284097 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:09:36.284097 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:09:36.284097 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:09:36.284097 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:09:36.284097 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service bf78381b-fbd0-45d4-a72f-d1109f3c3ebd could not be found. Aug 31 16:09:36.284097 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:09:36.290030 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6df7cd4e-f71b-43b3-b0da-39b4265b9a17 tempest-ServicesAdminNegativeV253TestJSON-210589138 tempest-ServicesAdminNegativeV253TestJSON-210589138-project-admin] Returning 404 to user: Service bf78381b-fbd0-45d4-a72f-d1109f3c3ebd could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:09:36.291261 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6df7cd4e-f71b-43b3-b0da-39b4265b9a17 tempest-ServicesAdminNegativeV253TestJSON-210589138 tempest-ServicesAdminNegativeV253TestJSON-210589138-project-admin] 10.222.0.61 "PUT /compute/v2.1/os-services/bf78381b-fbd0-45d4-a72f-d1109f3c3ebd" status: 404 len: 110 microversion: 2.53 time: 0.231989 Aug 31 16:09:36.292061 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1506/3046] 10.222.0.61 () {62 vars in 1309 bytes} [Wed Aug 31 16:09:36 2022] PUT /compute/v2.1/os-services/bf78381b-fbd0-45d4-a72f-d1109f3c3ebd => generated 110 bytes in 234 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:09:36.303467 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ff5db4de-fe5d-4d93-8925-60815bf895a4 tempest-ServicesAdminNegativeV253TestJSON-210589138 tempest-ServicesAdminNegativeV253TestJSON-210589138-project-admin] Action: 'update', calling method: .version_select at 0x7f5ae8475670>, body: {"status": "disabled"} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:09:36.308900 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ff5db4de-fe5d-4d93-8925-60815bf895a4 tempest-ServicesAdminNegativeV253TestJSON-210589138 tempest-ServicesAdminNegativeV253TestJSON-210589138-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:36.309691 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ff5db4de-fe5d-4d93-8925-60815bf895a4 tempest-ServicesAdminNegativeV253TestJSON-210589138 tempest-ServicesAdminNegativeV253TestJSON-210589138-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:36.310299 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ff5db4de-fe5d-4d93-8925-60815bf895a4 tempest-ServicesAdminNegativeV253TestJSON-210589138 tempest-ServicesAdminNegativeV253TestJSON-210589138-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:36.316756 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ff5db4de-fe5d-4d93-8925-60815bf895a4 tempest-ServicesAdminNegativeV253TestJSON-210589138 tempest-ServicesAdminNegativeV253TestJSON-210589138-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:36.318446 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ff5db4de-fe5d-4d93-8925-60815bf895a4 tempest-ServicesAdminNegativeV253TestJSON-210589138 tempest-ServicesAdminNegativeV253TestJSON-210589138-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:36.319277 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ff5db4de-fe5d-4d93-8925-60815bf895a4 tempest-ServicesAdminNegativeV253TestJSON-210589138 tempest-ServicesAdminNegativeV253TestJSON-210589138-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:36.326099 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-ff5db4de-fe5d-4d93-8925-60815bf895a4 tempest-ServicesAdminNegativeV253TestJSON-210589138 tempest-ServicesAdminNegativeV253TestJSON-210589138-project-admin] HTTP exception thrown: Service bf78381b-fbd0-45d4-a72f-d1109f3c3ebd could not be found. Aug 31 16:09:36.329735 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ff5db4de-fe5d-4d93-8925-60815bf895a4 tempest-ServicesAdminNegativeV253TestJSON-210589138 tempest-ServicesAdminNegativeV253TestJSON-210589138-project-admin] Request method failure captured: Aug 31 16:09:36.329735 n-d-850499-9 devstack@n-api.service[122257]: request: PUT /compute/v2.1/os-services/bf78381b-fbd0-45d4-a72f-d1109f3c3ebd HTTP/1.1 Aug 31 16:09:36.329735 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:09:36.329735 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:09:36.329735 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:09:36.329735 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 22 Aug 31 16:09:36.329735 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:09:36.329735 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:09:36.329735 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:09:36.329735 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:09:36.329735 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4e_G2dsInicQ6DV0C561yPSwhbTzA-sFhCyM2bbdzOz1B04tWcG5MpYGqWlbVZQJCnvZWuGyhs1sByeeB2n-XufYypWwtrIpGFuHkyw-xHuROlgUc4O0IsBZ9aoAjqfq7VAP_sGCy6IR-HzcXqR3pdDv7QdWvp_GBeojy6v9P7meQU Aug 31 16:09:36.329735 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:09:36.329735 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:09:36.329735 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:09:36.329735 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:09:36.329735 n-d-850499-9 devstack@n-api.service[122257]: X-Openstack-Nova-Api-Version: 2.53 Aug 31 16:09:36.329735 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:09:36.329735 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:09:36.329735 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 679a5f72295c414b80c418653b1cf7a8 Aug 31 16:09:36.329735 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-210589138 Aug 31 16:09:36.329735 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,admin,member Aug 31 16:09:36.329735 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,admin,member Aug 31 16:09:36.329735 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/679a5f72295c414b80c418653b1cf7a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/679a5f72295c414b80c418653b1cf7a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_679a5f72295c414b80c418653b1cf7a8", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/679a5f72295c414b80c418653b1cf7a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:09:36.329735 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-210589138 Aug 31 16:09:36.329735 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 679a5f72295c414b80c418653b1cf7a8 Aug 31 16:09:36.329735 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-210589138 Aug 31 16:09:36.329735 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ServicesAdminNegativeV253TestJSON-210589138-project-admin Aug 31 16:09:36.329735 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:09:36.329735 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:09:36.329735 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: fee57238069b4ceb873ffd6a8562069b Aug 31 16:09:36.329735 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-210589138-project-admin Aug 31 16:09:36.329735 n-d-850499-9 devstack@n-api.service[122257]: Aug 31 16:09:36.329735 n-d-850499-9 devstack@n-api.service[122257]: {"status": "disabled"} Aug 31 16:09:36.329735 n-d-850499-9 devstack@n-api.service[122257]: method: Aug 31 16:09:36.329735 n-d-850499-9 devstack@n-api.service[122257]: exception: Service bf78381b-fbd0-45d4-a72f-d1109f3c3ebd could not be found. Aug 31 16:09:36.329735 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': 'bf78381b-fbd0-45d4-a72f-d1109f3c3ebd', 'body': {'status': 'disabled'}} Aug 31 16:09:36.329735 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:09:36.329735 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:09:36.329735 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6205, in service_get_by_id Aug 31 16:09:36.329735 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 31 16:09:36.329735 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6065, in _find_service_in_cell Aug 31 16:09:36.329735 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 31 16:09:36.329735 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 31 16:09:36.329735 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:09:36.329735 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:09:36.329735 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:09:36.329735 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:09:36.329735 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Aug 31 16:09:36.329735 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 31 16:09:36.329735 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Aug 31 16:09:36.329735 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 31 16:09:36.329735 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service bf78381b-fbd0-45d4-a72f-d1109f3c3ebd could not be found. Aug 31 16:09:36.329735 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:09:36.329735 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:09:36.329735 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:09:36.329735 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:09:36.329735 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:09:36.329735 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:09:36.329735 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:09:36.329735 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:09:36.329735 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:09:36.329735 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:09:36.329735 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:09:36.329735 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:09:36.329735 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:09:36.329735 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:09:36.337069 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Aug 31 16:09:36.337069 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:09:36.337069 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service bf78381b-fbd0-45d4-a72f-d1109f3c3ebd could not be found. Aug 31 16:09:36.337069 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:09:36.337069 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:09:36.337069 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:09:36.337069 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:09:36.337069 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:09:36.337069 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:09:36.337069 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:09:36.337069 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:09:36.337069 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service bf78381b-fbd0-45d4-a72f-d1109f3c3ebd could not be found. Aug 31 16:09:36.337069 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:09:36.340139 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ff5db4de-fe5d-4d93-8925-60815bf895a4 tempest-ServicesAdminNegativeV253TestJSON-210589138 tempest-ServicesAdminNegativeV253TestJSON-210589138-project-admin] Returning 404 to user: Service bf78381b-fbd0-45d4-a72f-d1109f3c3ebd could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:09:36.341239 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ff5db4de-fe5d-4d93-8925-60815bf895a4 tempest-ServicesAdminNegativeV253TestJSON-210589138 tempest-ServicesAdminNegativeV253TestJSON-210589138-project-admin] 10.222.0.61 "PUT /compute/v2.1/os-services/bf78381b-fbd0-45d4-a72f-d1109f3c3ebd" status: 404 len: 110 microversion: 2.53 time: 0.041840 Aug 31 16:09:36.346813 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1507/3047] 10.222.0.61 () {62 vars in 1309 bytes} [Wed Aug 31 16:09:36 2022] PUT /compute/v2.1/os-services/bf78381b-fbd0-45d4-a72f-d1109f3c3ebd => generated 110 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:09:36.354147 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8a6a00bd-ead2-41c7-8809-b417ae94a598 tempest-ServicesAdminNegativeV253TestJSON-210589138 tempest-ServicesAdminNegativeV253TestJSON-210589138-project-admin] Action: 'update', calling method: .version_select at 0x7f5ae8cf6b80>, body: {"status": "enabled"} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:09:36.360157 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8a6a00bd-ead2-41c7-8809-b417ae94a598 tempest-ServicesAdminNegativeV253TestJSON-210589138 tempest-ServicesAdminNegativeV253TestJSON-210589138-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:36.360911 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8a6a00bd-ead2-41c7-8809-b417ae94a598 tempest-ServicesAdminNegativeV253TestJSON-210589138 tempest-ServicesAdminNegativeV253TestJSON-210589138-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:36.361581 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8a6a00bd-ead2-41c7-8809-b417ae94a598 tempest-ServicesAdminNegativeV253TestJSON-210589138 tempest-ServicesAdminNegativeV253TestJSON-210589138-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:36.369003 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8a6a00bd-ead2-41c7-8809-b417ae94a598 tempest-ServicesAdminNegativeV253TestJSON-210589138 tempest-ServicesAdminNegativeV253TestJSON-210589138-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:36.370715 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8a6a00bd-ead2-41c7-8809-b417ae94a598 tempest-ServicesAdminNegativeV253TestJSON-210589138 tempest-ServicesAdminNegativeV253TestJSON-210589138-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:36.371372 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8a6a00bd-ead2-41c7-8809-b417ae94a598 tempest-ServicesAdminNegativeV253TestJSON-210589138 tempest-ServicesAdminNegativeV253TestJSON-210589138-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:36.378340 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-8a6a00bd-ead2-41c7-8809-b417ae94a598 tempest-ServicesAdminNegativeV253TestJSON-210589138 tempest-ServicesAdminNegativeV253TestJSON-210589138-project-admin] HTTP exception thrown: Service bf78381b-fbd0-45d4-a72f-d1109f3c3ebd could not be found. Aug 31 16:09:36.381803 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8a6a00bd-ead2-41c7-8809-b417ae94a598 tempest-ServicesAdminNegativeV253TestJSON-210589138 tempest-ServicesAdminNegativeV253TestJSON-210589138-project-admin] Request method failure captured: Aug 31 16:09:36.381803 n-d-850499-9 devstack@n-api.service[122257]: request: PUT /compute/v2.1/os-services/bf78381b-fbd0-45d4-a72f-d1109f3c3ebd HTTP/1.1 Aug 31 16:09:36.381803 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:09:36.381803 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:09:36.381803 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:09:36.381803 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 21 Aug 31 16:09:36.381803 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:09:36.381803 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:09:36.381803 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:09:36.381803 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:09:36.381803 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4e_G2dsInicQ6DV0C561yPSwhbTzA-sFhCyM2bbdzOz1B04tWcG5MpYGqWlbVZQJCnvZWuGyhs1sByeeB2n-XufYypWwtrIpGFuHkyw-xHuROlgUc4O0IsBZ9aoAjqfq7VAP_sGCy6IR-HzcXqR3pdDv7QdWvp_GBeojy6v9P7meQU Aug 31 16:09:36.381803 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:09:36.381803 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:09:36.381803 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:09:36.381803 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:09:36.381803 n-d-850499-9 devstack@n-api.service[122257]: X-Openstack-Nova-Api-Version: 2.53 Aug 31 16:09:36.381803 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:09:36.381803 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:09:36.381803 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 679a5f72295c414b80c418653b1cf7a8 Aug 31 16:09:36.381803 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-210589138 Aug 31 16:09:36.381803 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,admin,member Aug 31 16:09:36.381803 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,admin,member Aug 31 16:09:36.381803 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/679a5f72295c414b80c418653b1cf7a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/679a5f72295c414b80c418653b1cf7a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_679a5f72295c414b80c418653b1cf7a8", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/679a5f72295c414b80c418653b1cf7a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:09:36.381803 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-210589138 Aug 31 16:09:36.381803 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 679a5f72295c414b80c418653b1cf7a8 Aug 31 16:09:36.381803 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-210589138 Aug 31 16:09:36.381803 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ServicesAdminNegativeV253TestJSON-210589138-project-admin Aug 31 16:09:36.381803 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:09:36.381803 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:09:36.381803 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: fee57238069b4ceb873ffd6a8562069b Aug 31 16:09:36.381803 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-210589138-project-admin Aug 31 16:09:36.381803 n-d-850499-9 devstack@n-api.service[122257]: Aug 31 16:09:36.381803 n-d-850499-9 devstack@n-api.service[122257]: {"status": "enabled"} Aug 31 16:09:36.381803 n-d-850499-9 devstack@n-api.service[122257]: method: Aug 31 16:09:36.381803 n-d-850499-9 devstack@n-api.service[122257]: exception: Service bf78381b-fbd0-45d4-a72f-d1109f3c3ebd could not be found. Aug 31 16:09:36.381803 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': 'bf78381b-fbd0-45d4-a72f-d1109f3c3ebd', 'body': {'status': 'enabled'}} Aug 31 16:09:36.381803 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:09:36.381803 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:09:36.381803 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6205, in service_get_by_id Aug 31 16:09:36.381803 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 31 16:09:36.381803 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6065, in _find_service_in_cell Aug 31 16:09:36.381803 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 31 16:09:36.381803 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 31 16:09:36.381803 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:09:36.381803 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:09:36.381803 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:09:36.381803 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:09:36.381803 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Aug 31 16:09:36.381803 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 31 16:09:36.381803 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Aug 31 16:09:36.381803 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 31 16:09:36.381803 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service bf78381b-fbd0-45d4-a72f-d1109f3c3ebd could not be found. Aug 31 16:09:36.381803 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:09:36.381803 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:09:36.381803 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:09:36.381803 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:09:36.381803 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:09:36.381803 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:09:36.381803 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:09:36.381803 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:09:36.381803 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:09:36.381803 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:09:36.381803 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:09:36.381803 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:09:36.381803 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:09:36.381803 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:09:36.387809 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Aug 31 16:09:36.387809 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:09:36.387809 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service bf78381b-fbd0-45d4-a72f-d1109f3c3ebd could not be found. Aug 31 16:09:36.387809 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:09:36.387809 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:09:36.387809 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:09:36.387809 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:09:36.387809 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:09:36.387809 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:09:36.387809 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:09:36.387809 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:09:36.387809 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service bf78381b-fbd0-45d4-a72f-d1109f3c3ebd could not be found. Aug 31 16:09:36.387809 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:09:36.387809 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8a6a00bd-ead2-41c7-8809-b417ae94a598 tempest-ServicesAdminNegativeV253TestJSON-210589138 tempest-ServicesAdminNegativeV253TestJSON-210589138-project-admin] Returning 404 to user: Service bf78381b-fbd0-45d4-a72f-d1109f3c3ebd could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:09:36.387809 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8a6a00bd-ead2-41c7-8809-b417ae94a598 tempest-ServicesAdminNegativeV253TestJSON-210589138 tempest-ServicesAdminNegativeV253TestJSON-210589138-project-admin] 10.222.0.61 "PUT /compute/v2.1/os-services/bf78381b-fbd0-45d4-a72f-d1109f3c3ebd" status: 404 len: 110 microversion: 2.53 time: 0.036190 Aug 31 16:09:36.387809 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1508/3048] 10.222.0.61 () {62 vars in 1309 bytes} [Wed Aug 31 16:09:36 2022] PUT /compute/v2.1/os-services/bf78381b-fbd0-45d4-a72f-d1109f3c3ebd => generated 110 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:09:36.397198 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c071a38b-8394-419c-9104-d470f3ebff19 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:36.398204 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c071a38b-8394-419c-9104-d470f3ebff19 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] [instance: d1e43fd8-2e15-468d-9da0-2851a41bd23b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:36.406891 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:INSERT=19,nova_api:SELECT=74,nova_api:UPDATE=7 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:09:36.409205 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c071a38b-8394-419c-9104-d470f3ebff19 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:36.410095 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c071a38b-8394-419c-9104-d470f3ebff19 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:36.410756 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c071a38b-8394-419c-9104-d470f3ebff19 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:36.413086 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c071a38b-8394-419c-9104-d470f3ebff19 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:36.413890 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c071a38b-8394-419c-9104-d470f3ebff19 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:36.414872 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c071a38b-8394-419c-9104-d470f3ebff19 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:36.839086 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-99794f4f-5d79-4567-a8b8-7365385b3b27 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] validate_networks() for [('78f9d9ff-7812-4996-a58c-1bc2d43a58b5', None, None, None, None, None)] {{(pid=122256) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:09:38.428098 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c071a38b-8394-419c-9104-d470f3ebff19 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b93395d63a4db895ff224a311940e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf281e8857247c6b9e60d4216741f89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:38.459565 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c071a38b-8394-419c-9104-d470f3ebff19 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] 10.222.0.61 "GET /compute/v2.1/servers/d1e43fd8-2e15-468d-9da0-2851a41bd23b" status: 200 len: 1320 microversion: 2.1 time: 2.063074 Aug 31 16:09:38.461926 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1509/3049] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:36 2022] GET /compute/v2.1/servers/d1e43fd8-2e15-468d-9da0-2851a41bd23b => generated 1320 bytes in 2076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:38.483774 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-45237823-96d9-4565-a313-d308481b38bf tempest-ServicesAdminNegativeV253TestJSON-210589138 tempest-ServicesAdminNegativeV253TestJSON-210589138-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:38.488161 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-45237823-96d9-4565-a313-d308481b38bf tempest-ServicesAdminNegativeV253TestJSON-210589138 tempest-ServicesAdminNegativeV253TestJSON-210589138-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:38.488847 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-45237823-96d9-4565-a313-d308481b38bf tempest-ServicesAdminNegativeV253TestJSON-210589138 tempest-ServicesAdminNegativeV253TestJSON-210589138-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:38.489463 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-45237823-96d9-4565-a313-d308481b38bf tempest-ServicesAdminNegativeV253TestJSON-210589138 tempest-ServicesAdminNegativeV253TestJSON-210589138-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:38.490411 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-45237823-96d9-4565-a313-d308481b38bf tempest-ServicesAdminNegativeV253TestJSON-210589138 tempest-ServicesAdminNegativeV253TestJSON-210589138-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:38.491911 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-45237823-96d9-4565-a313-d308481b38bf tempest-ServicesAdminNegativeV253TestJSON-210589138 tempest-ServicesAdminNegativeV253TestJSON-210589138-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:38.495118 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-45237823-96d9-4565-a313-d308481b38bf tempest-ServicesAdminNegativeV253TestJSON-210589138 tempest-ServicesAdminNegativeV253TestJSON-210589138-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:38.581547 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-45237823-96d9-4565-a313-d308481b38bf tempest-ServicesAdminNegativeV253TestJSON-210589138 tempest-ServicesAdminNegativeV253TestJSON-210589138-project-admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.116416 Aug 31 16:09:38.589830 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1510/3050] 10.222.0.61 () {60 vars in 1178 bytes} [Wed Aug 31 16:09:38 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:09:38.602746 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-d0eb62e4-3575-4170-acae-16142be1c8b5 req-1aa6bbca-2cbd-4fbf-97c2-9bf0c43f246a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c", "tag": "01ac81c6-6528-4881-a131-08caa56e847d"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:09:38.624181 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-d0eb62e4-3575-4170-acae-16142be1c8b5 req-1aa6bbca-2cbd-4fbf-97c2-9bf0c43f246a service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:38.625375 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-d0eb62e4-3575-4170-acae-16142be1c8b5 req-1aa6bbca-2cbd-4fbf-97c2-9bf0c43f246a service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:38.626674 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-d0eb62e4-3575-4170-acae-16142be1c8b5 req-1aa6bbca-2cbd-4fbf-97c2-9bf0c43f246a service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:38.661706 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-99794f4f-5d79-4567-a8b8-7365385b3b27 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Getting quotas for project 55320a9c8f714bc0911ded3ab88ddf31. Resources: dict_keys(['metadata_items']) {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:09:38.687974 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-99794f4f-5d79-4567-a8b8-7365385b3b27 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Getting quotas for user c65ee5ffa9d74bfdacbea45f1564d19a and project 55320a9c8f714bc0911ded3ab88ddf31. Resources: dict_keys(['metadata_items']) {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:09:38.714752 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-d0eb62e4-3575-4170-acae-16142be1c8b5 req-1aa6bbca-2cbd-4fbf-97c2-9bf0c43f246a service nova] Creating event network-changed:01ac81c6-6528-4881-a131-08caa56e847d for instance 0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c on n-h2-850499-9 Aug 31 16:09:38.720111 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-99794f4f-5d79-4567-a8b8-7365385b3b27 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:09:38.721740 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-99794f4f-5d79-4567-a8b8-7365385b3b27 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:09:38.722573 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-99794f4f-5d79-4567-a8b8-7365385b3b27 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:09:38.724591 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-99794f4f-5d79-4567-a8b8-7365385b3b27 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:09:38.726236 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-99794f4f-5d79-4567-a8b8-7365385b3b27 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:09:38.742734 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-d0eb62e4-3575-4170-acae-16142be1c8b5 req-1aa6bbca-2cbd-4fbf-97c2-9bf0c43f246a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.148045 Aug 31 16:09:38.746904 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1511/3051] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:09:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:09:38.768359 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-99794f4f-5d79-4567-a8b8-7365385b3b27 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:38.769377 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-39d8fd79-d3d4-48ce-a95f-dfa69c6f1dca tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:38.769925 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-99794f4f-5d79-4567-a8b8-7365385b3b27 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:38.770612 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-99794f4f-5d79-4567-a8b8-7365385b3b27 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:38.772150 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-99794f4f-5d79-4567-a8b8-7365385b3b27 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:38.772637 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-39d8fd79-d3d4-48ce-a95f-dfa69c6f1dca tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] [instance: 33bb5423-4b3e-4030-a835-8ab823e2e00a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:38.777107 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-99794f4f-5d79-4567-a8b8-7365385b3b27 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:38.782127 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-99794f4f-5d79-4567-a8b8-7365385b3b27 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:38.800027 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-39d8fd79-d3d4-48ce-a95f-dfa69c6f1dca tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:38.802341 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-39d8fd79-d3d4-48ce-a95f-dfa69c6f1dca tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:38.807983 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-39d8fd79-d3d4-48ce-a95f-dfa69c6f1dca tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:38.810276 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-39d8fd79-d3d4-48ce-a95f-dfa69c6f1dca tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:38.812423 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-39d8fd79-d3d4-48ce-a95f-dfa69c6f1dca tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:38.821185 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-39d8fd79-d3d4-48ce-a95f-dfa69c6f1dca tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:38.857692 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-99794f4f-5d79-4567-a8b8-7365385b3b27 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Getting quotas for project 55320a9c8f714bc0911ded3ab88ddf31. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:09:38.883562 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-99794f4f-5d79-4567-a8b8-7365385b3b27 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Getting quotas for user c65ee5ffa9d74bfdacbea45f1564d19a and project 55320a9c8f714bc0911ded3ab88ddf31. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:09:39.034312 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-99794f4f-5d79-4567-a8b8-7365385b3b27 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Going to run 1 instances... {{(pid=122256) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:09:39.037092 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-99794f4f-5d79-4567-a8b8-7365385b3b27 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] [instance: 0ac914d2-e9f7-4f2f-a01d-49674180d8db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b1910690-9680-4998-998b-040c900fa39e',volume_size=None,volume_type=None)] {{(pid=122256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:09:39.252616 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-39d8fd79-d3d4-48ce-a95f-dfa69c6f1dca tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68db583fb8fd4e6090fb220eeaafdd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c965154856f84fecb30f49dfeac46fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:39.279915 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-39d8fd79-d3d4-48ce-a95f-dfa69c6f1dca tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] 10.222.0.61 "GET /compute/v2.1/servers/33bb5423-4b3e-4030-a835-8ab823e2e00a" status: 200 len: 1275 microversion: 2.1 time: 0.531137 Aug 31 16:09:39.285235 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1512/3052] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:38 2022] GET /compute/v2.1/servers/33bb5423-4b3e-4030-a835-8ab823e2e00a => generated 1275 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:39.315640 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6e6b8a92-b945-40c4-b3d9-2d2fad0393b9 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:39.316636 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6e6b8a92-b945-40c4-b3d9-2d2fad0393b9 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:39.339323 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6e6b8a92-b945-40c4-b3d9-2d2fad0393b9 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:39.347685 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6e6b8a92-b945-40c4-b3d9-2d2fad0393b9 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:39.363981 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6e6b8a92-b945-40c4-b3d9-2d2fad0393b9 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:39.369297 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6e6b8a92-b945-40c4-b3d9-2d2fad0393b9 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:39.371308 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6e6b8a92-b945-40c4-b3d9-2d2fad0393b9 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:39.373585 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6e6b8a92-b945-40c4-b3d9-2d2fad0393b9 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:39.619407 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-99794f4f-5d79-4567-a8b8-7365385b3b27 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 3.894049 Aug 31 16:09:39.623864 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1541/3053] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:09:35 2022] POST /compute/v2.1/servers => generated 407 bytes in 3903 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:09:39.641269 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f2a6c990-bb05-4ab5-930e-cac3b06fbe9d tempest-ServicesAdminNegativeV253TestJSON-210589138 tempest-ServicesAdminNegativeV253TestJSON-210589138-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:39.670367 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f2a6c990-bb05-4ab5-930e-cac3b06fbe9d tempest-ServicesAdminNegativeV253TestJSON-210589138 tempest-ServicesAdminNegativeV253TestJSON-210589138-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:39.671487 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f2a6c990-bb05-4ab5-930e-cac3b06fbe9d tempest-ServicesAdminNegativeV253TestJSON-210589138 tempest-ServicesAdminNegativeV253TestJSON-210589138-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:39.672124 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f2a6c990-bb05-4ab5-930e-cac3b06fbe9d tempest-ServicesAdminNegativeV253TestJSON-210589138 tempest-ServicesAdminNegativeV253TestJSON-210589138-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:39.674614 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f2a6c990-bb05-4ab5-930e-cac3b06fbe9d tempest-ServicesAdminNegativeV253TestJSON-210589138 tempest-ServicesAdminNegativeV253TestJSON-210589138-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:39.675642 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f2a6c990-bb05-4ab5-930e-cac3b06fbe9d tempest-ServicesAdminNegativeV253TestJSON-210589138 tempest-ServicesAdminNegativeV253TestJSON-210589138-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:39.676725 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f2a6c990-bb05-4ab5-930e-cac3b06fbe9d tempest-ServicesAdminNegativeV253TestJSON-210589138 tempest-ServicesAdminNegativeV253TestJSON-210589138-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:39.730865 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f2a6c990-bb05-4ab5-930e-cac3b06fbe9d tempest-ServicesAdminNegativeV253TestJSON-210589138 tempest-ServicesAdminNegativeV253TestJSON-210589138-project-admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.104165 Aug 31 16:09:39.731881 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1542/3054] 10.222.0.61 () {60 vars in 1211 bytes} [Wed Aug 31 16:09:39 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1239 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:09:39.739763 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5354499f-f15d-49cf-88b0-8c74151e1b36 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:39.742002 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5354499f-f15d-49cf-88b0-8c74151e1b36 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] [instance: d1e43fd8-2e15-468d-9da0-2851a41bd23b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:39.761363 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5354499f-f15d-49cf-88b0-8c74151e1b36 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:39.763600 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5354499f-f15d-49cf-88b0-8c74151e1b36 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:39.764288 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5354499f-f15d-49cf-88b0-8c74151e1b36 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:39.767466 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5354499f-f15d-49cf-88b0-8c74151e1b36 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:39.768151 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5354499f-f15d-49cf-88b0-8c74151e1b36 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:39.771764 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5354499f-f15d-49cf-88b0-8c74151e1b36 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:41.114953 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-6e6b8a92-b945-40c4-b3d9-2d2fad0393b9 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:41.138434 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6e6b8a92-b945-40c4-b3d9-2d2fad0393b9 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c" status: 200 len: 1315 microversion: 2.1 time: 1.841998 Aug 31 16:09:41.139576 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1513/3055] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:39 2022] GET /compute/v2.1/servers/0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c => generated 1315 bytes in 1852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:41.144920 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c07f8542-3892-4366-8dbd-aaf801ec1e80 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:41.145704 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c07f8542-3892-4366-8dbd-aaf801ec1e80 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] [instance: 0ac914d2-e9f7-4f2f-a01d-49674180d8db] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:41.162588 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c07f8542-3892-4366-8dbd-aaf801ec1e80 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:41.163988 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c07f8542-3892-4366-8dbd-aaf801ec1e80 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:41.165861 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c07f8542-3892-4366-8dbd-aaf801ec1e80 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:41.171941 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c07f8542-3892-4366-8dbd-aaf801ec1e80 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:41.175600 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c07f8542-3892-4366-8dbd-aaf801ec1e80 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:41.175600 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c07f8542-3892-4366-8dbd-aaf801ec1e80 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:41.305947 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5354499f-f15d-49cf-88b0-8c74151e1b36 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b93395d63a4db895ff224a311940e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf281e8857247c6b9e60d4216741f89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:41.320877 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5354499f-f15d-49cf-88b0-8c74151e1b36 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] 10.222.0.61 "GET /compute/v2.1/servers/d1e43fd8-2e15-468d-9da0-2851a41bd23b" status: 200 len: 1320 microversion: 2.1 time: 1.587532 Aug 31 16:09:41.330709 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1543/3056] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:39 2022] GET /compute/v2.1/servers/d1e43fd8-2e15-468d-9da0-2851a41bd23b => generated 1320 bytes in 1598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:41.410085 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5e61f2a4-6c61-4ea4-aac2-2cf8438937a6 tempest-ServicesAdminNegativeV253TestJSON-210589138 tempest-ServicesAdminNegativeV253TestJSON-210589138-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:41.437545 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5e61f2a4-6c61-4ea4-aac2-2cf8438937a6 tempest-ServicesAdminNegativeV253TestJSON-210589138 tempest-ServicesAdminNegativeV253TestJSON-210589138-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:41.469227 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5e61f2a4-6c61-4ea4-aac2-2cf8438937a6 tempest-ServicesAdminNegativeV253TestJSON-210589138 tempest-ServicesAdminNegativeV253TestJSON-210589138-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:41.470011 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5e61f2a4-6c61-4ea4-aac2-2cf8438937a6 tempest-ServicesAdminNegativeV253TestJSON-210589138 tempest-ServicesAdminNegativeV253TestJSON-210589138-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:41.475437 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5e61f2a4-6c61-4ea4-aac2-2cf8438937a6 tempest-ServicesAdminNegativeV253TestJSON-210589138 tempest-ServicesAdminNegativeV253TestJSON-210589138-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:41.487262 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5e61f2a4-6c61-4ea4-aac2-2cf8438937a6 tempest-ServicesAdminNegativeV253TestJSON-210589138 tempest-ServicesAdminNegativeV253TestJSON-210589138-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:41.492544 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5e61f2a4-6c61-4ea4-aac2-2cf8438937a6 tempest-ServicesAdminNegativeV253TestJSON-210589138 tempest-ServicesAdminNegativeV253TestJSON-210589138-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:41.518576 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c07f8542-3892-4366-8dbd-aaf801ec1e80 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c65ee5ffa9d74bfdacbea45f1564d19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55320a9c8f714bc0911ded3ab88ddf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:41.563722 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c07f8542-3892-4366-8dbd-aaf801ec1e80 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] 10.222.0.61 "GET /compute/v2.1/servers/0ac914d2-e9f7-4f2f-a01d-49674180d8db" status: 200 len: 1163 microversion: 2.1 time: 0.422800 Aug 31 16:09:41.568149 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1514/3057] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:41 2022] GET /compute/v2.1/servers/0ac914d2-e9f7-4f2f-a01d-49674180d8db => generated 1163 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:41.588993 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ea2cbfd9-94bc-438a-863c-311157ffc817 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:41.592513 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ea2cbfd9-94bc-438a-863c-311157ffc817 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] [instance: 33bb5423-4b3e-4030-a835-8ab823e2e00a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:41.613343 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ea2cbfd9-94bc-438a-863c-311157ffc817 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:41.618965 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ea2cbfd9-94bc-438a-863c-311157ffc817 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:41.622473 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ea2cbfd9-94bc-438a-863c-311157ffc817 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:41.629928 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ea2cbfd9-94bc-438a-863c-311157ffc817 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:41.635113 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ea2cbfd9-94bc-438a-863c-311157ffc817 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:41.636641 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ea2cbfd9-94bc-438a-863c-311157ffc817 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:41.652969 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5e61f2a4-6c61-4ea4-aac2-2cf8438937a6 tempest-ServicesAdminNegativeV253TestJSON-210589138 tempest-ServicesAdminNegativeV253TestJSON-210589138-project-admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.314688 Aug 31 16:09:41.653625 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1544/3058] 10.222.0.61 () {60 vars in 1178 bytes} [Wed Aug 31 16:09:41 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:09:41.661670 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-26b6fa82-15a1-4282-8368-4ba2de8948fe req-869637ca-26f4-4ce9-80a5-5d6250782edc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c393928f-2414-4093-9d72-93a21fc6c460", "name": "network-vif-plugged", "status": "completed", "tag": "090b122c-ccba-41fe-89db-ee3852481377"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:09:41.750096 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-26b6fa82-15a1-4282-8368-4ba2de8948fe req-869637ca-26f4-4ce9-80a5-5d6250782edc service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:41.755071 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-26b6fa82-15a1-4282-8368-4ba2de8948fe req-869637ca-26f4-4ce9-80a5-5d6250782edc service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:41.755698 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-26b6fa82-15a1-4282-8368-4ba2de8948fe req-869637ca-26f4-4ce9-80a5-5d6250782edc service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:41.807823 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-26b6fa82-15a1-4282-8368-4ba2de8948fe req-869637ca-26f4-4ce9-80a5-5d6250782edc service nova] Creating event network-vif-plugged:090b122c-ccba-41fe-89db-ee3852481377 for instance c393928f-2414-4093-9d72-93a21fc6c460 on n-h2-850499-9 Aug 31 16:09:41.828416 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-26b6fa82-15a1-4282-8368-4ba2de8948fe req-869637ca-26f4-4ce9-80a5-5d6250782edc service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.172636 Aug 31 16:09:41.829541 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1545/3059] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:09:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:09:41.842607 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-42e14eee-c8a6-4877-92b4-da5fa0b8f120 tempest-ServicesAdminNegativeV253TestJSON-210589138 tempest-ServicesAdminNegativeV253TestJSON-210589138-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:41.851136 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42e14eee-c8a6-4877-92b4-da5fa0b8f120 tempest-ServicesAdminNegativeV253TestJSON-210589138 tempest-ServicesAdminNegativeV253TestJSON-210589138-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:41.861211 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42e14eee-c8a6-4877-92b4-da5fa0b8f120 tempest-ServicesAdminNegativeV253TestJSON-210589138 tempest-ServicesAdminNegativeV253TestJSON-210589138-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:41.862356 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42e14eee-c8a6-4877-92b4-da5fa0b8f120 tempest-ServicesAdminNegativeV253TestJSON-210589138 tempest-ServicesAdminNegativeV253TestJSON-210589138-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:41.863890 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42e14eee-c8a6-4877-92b4-da5fa0b8f120 tempest-ServicesAdminNegativeV253TestJSON-210589138 tempest-ServicesAdminNegativeV253TestJSON-210589138-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:41.866762 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42e14eee-c8a6-4877-92b4-da5fa0b8f120 tempest-ServicesAdminNegativeV253TestJSON-210589138 tempest-ServicesAdminNegativeV253TestJSON-210589138-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:41.879437 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42e14eee-c8a6-4877-92b4-da5fa0b8f120 tempest-ServicesAdminNegativeV253TestJSON-210589138 tempest-ServicesAdminNegativeV253TestJSON-210589138-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:41.923456 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ea2cbfd9-94bc-438a-863c-311157ffc817 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68db583fb8fd4e6090fb220eeaafdd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c965154856f84fecb30f49dfeac46fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:41.944335 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ea2cbfd9-94bc-438a-863c-311157ffc817 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] 10.222.0.61 "GET /compute/v2.1/servers/33bb5423-4b3e-4030-a835-8ab823e2e00a" status: 200 len: 1281 microversion: 2.1 time: 0.368613 Aug 31 16:09:41.948908 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1515/3060] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:41 2022] GET /compute/v2.1/servers/33bb5423-4b3e-4030-a835-8ab823e2e00a => generated 1281 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:41.997440 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-42e14eee-c8a6-4877-92b4-da5fa0b8f120 tempest-ServicesAdminNegativeV253TestJSON-210589138 tempest-ServicesAdminNegativeV253TestJSON-210589138-project-admin] 10.222.0.61 "GET /compute/v2.1/os-services?host=n-d-850499-9&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.164245 Aug 31 16:09:41.998501 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1546/3061] 10.222.0.61 () {60 vars in 1235 bytes} [Wed Aug 31 16:09:41 2022] GET /compute/v2.1/os-services?host=n-d-850499-9&binary=xxx => generated 16 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:42.016377 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-db9f2293-055b-4832-87fd-20c91c471baa tempest-ServicesAdminNegativeV253TestJSON-210589138 tempest-ServicesAdminNegativeV253TestJSON-210589138-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:42.022189 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-db9f2293-055b-4832-87fd-20c91c471baa tempest-ServicesAdminNegativeV253TestJSON-210589138 tempest-ServicesAdminNegativeV253TestJSON-210589138-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:42.022775 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-db9f2293-055b-4832-87fd-20c91c471baa tempest-ServicesAdminNegativeV253TestJSON-210589138 tempest-ServicesAdminNegativeV253TestJSON-210589138-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:42.023224 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-db9f2293-055b-4832-87fd-20c91c471baa tempest-ServicesAdminNegativeV253TestJSON-210589138 tempest-ServicesAdminNegativeV253TestJSON-210589138-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:42.028723 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-db9f2293-055b-4832-87fd-20c91c471baa tempest-ServicesAdminNegativeV253TestJSON-210589138 tempest-ServicesAdminNegativeV253TestJSON-210589138-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:42.032342 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-db9f2293-055b-4832-87fd-20c91c471baa tempest-ServicesAdminNegativeV253TestJSON-210589138 tempest-ServicesAdminNegativeV253TestJSON-210589138-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:42.033251 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-db9f2293-055b-4832-87fd-20c91c471baa tempest-ServicesAdminNegativeV253TestJSON-210589138 tempest-ServicesAdminNegativeV253TestJSON-210589138-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:42.124218 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-db9f2293-055b-4832-87fd-20c91c471baa tempest-ServicesAdminNegativeV253TestJSON-210589138 tempest-ServicesAdminNegativeV253TestJSON-210589138-project-admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.107935 Aug 31 16:09:42.127131 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1516/3062] 10.222.0.61 () {60 vars in 1178 bytes} [Wed Aug 31 16:09:42 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:09:42.148843 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-90024bd1-7631-417f-a99a-c5a126e31da3 tempest-ServicesAdminNegativeV253TestJSON-210589138 tempest-ServicesAdminNegativeV253TestJSON-210589138-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:42.161678 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-90024bd1-7631-417f-a99a-c5a126e31da3 tempest-ServicesAdminNegativeV253TestJSON-210589138 tempest-ServicesAdminNegativeV253TestJSON-210589138-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:42.163254 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-90024bd1-7631-417f-a99a-c5a126e31da3 tempest-ServicesAdminNegativeV253TestJSON-210589138 tempest-ServicesAdminNegativeV253TestJSON-210589138-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:42.163954 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-90024bd1-7631-417f-a99a-c5a126e31da3 tempest-ServicesAdminNegativeV253TestJSON-210589138 tempest-ServicesAdminNegativeV253TestJSON-210589138-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:42.165821 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-90024bd1-7631-417f-a99a-c5a126e31da3 tempest-ServicesAdminNegativeV253TestJSON-210589138 tempest-ServicesAdminNegativeV253TestJSON-210589138-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:42.166994 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-90024bd1-7631-417f-a99a-c5a126e31da3 tempest-ServicesAdminNegativeV253TestJSON-210589138 tempest-ServicesAdminNegativeV253TestJSON-210589138-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:42.168146 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-90024bd1-7631-417f-a99a-c5a126e31da3 tempest-ServicesAdminNegativeV253TestJSON-210589138 tempest-ServicesAdminNegativeV253TestJSON-210589138-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:42.170839 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6d76029d-35a5-4c8d-938d-ccd534f29448 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:42.171564 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6d76029d-35a5-4c8d-938d-ccd534f29448 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:42.194987 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6d76029d-35a5-4c8d-938d-ccd534f29448 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:42.196287 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6d76029d-35a5-4c8d-938d-ccd534f29448 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:42.196686 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6d76029d-35a5-4c8d-938d-ccd534f29448 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:42.197931 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6d76029d-35a5-4c8d-938d-ccd534f29448 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:42.202263 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6d76029d-35a5-4c8d-938d-ccd534f29448 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:42.203115 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6d76029d-35a5-4c8d-938d-ccd534f29448 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:42.212668 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-90024bd1-7631-417f-a99a-c5a126e31da3 tempest-ServicesAdminNegativeV253TestJSON-210589138 tempest-ServicesAdminNegativeV253TestJSON-210589138-project-admin] 10.222.0.61 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.071953 Aug 31 16:09:42.218287 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1547/3063] 10.222.0.61 () {60 vars in 1239 bytes} [Wed Aug 31 16:09:42 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:42.671607 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-bc794b50-fbcd-4e0a-a501-d5606e9d7082 tempest-ServicesAdminNegativeV253TestJSON-351520959 tempest-ServicesAdminNegativeV253TestJSON-351520959-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:42.710350 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-bc794b50-fbcd-4e0a-a501-d5606e9d7082 tempest-ServicesAdminNegativeV253TestJSON-351520959 tempest-ServicesAdminNegativeV253TestJSON-351520959-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'f221ecdcf1d143b6a6782a4db12f37b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd85e74169e4015b01abb8303e64d00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:42.718322 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-bc794b50-fbcd-4e0a-a501-d5606e9d7082 tempest-ServicesAdminNegativeV253TestJSON-351520959 tempest-ServicesAdminNegativeV253TestJSON-351520959-project] Request method failure captured: Aug 31 16:09:42.718322 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/os-services HTTP/1.1 Aug 31 16:09:42.718322 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:09:42.718322 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:09:42.718322 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:09:42.718322 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:09:42.718322 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:09:42.718322 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:09:42.718322 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:09:42.718322 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:09:42.718322 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4e8uvE5baL_l6ZsioHl3qUsEfTkKoe1DeeToBHdReMR44lAg3SsDU5utl4NXNfapbW96QkTbDHV9d6FCsh5Hphc0sLuiTOnbOXVJ0NE9y34gZNYPpR5gdzroVHXTgbcQnQClDWIc8J0KdeNVKXaEG8V42LAUfogO1DpkIH0JgYil_w Aug 31 16:09:42.718322 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:09:42.718322 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:09:42.718322 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:09:42.718322 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:09:42.718322 n-d-850499-9 devstack@n-api.service[122256]: X-Openstack-Nova-Api-Version: 2.53 Aug 31 16:09:42.718322 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:09:42.718322 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:09:42.718322 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: ffd85e74169e4015b01abb8303e64d00 Aug 31 16:09:42.718322 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-351520959 Aug 31 16:09:42.718322 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:09:42.718322 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:09:42.718322 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ffd85e74169e4015b01abb8303e64d00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ffd85e74169e4015b01abb8303e64d00"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ffd85e74169e4015b01abb8303e64d00", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ffd85e74169e4015b01abb8303e64d00"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:09:42.718322 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-351520959 Aug 31 16:09:42.718322 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: ffd85e74169e4015b01abb8303e64d00 Aug 31 16:09:42.718322 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-351520959 Aug 31 16:09:42.718322 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ServicesAdminNegativeV253TestJSON-351520959-project Aug 31 16:09:42.718322 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:09:42.718322 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:09:42.718322 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: f221ecdcf1d143b6a6782a4db12f37b4 Aug 31 16:09:42.718322 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-351520959-project Aug 31 16:09:42.718322 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:09:42.718322 n-d-850499-9 devstack@n-api.service[122256]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 31 16:09:42.718322 n-d-850499-9 devstack@n-api.service[122256]: action_args: {} Aug 31 16:09:42.718322 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:09:42.718322 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:09:42.718322 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:09:42.718322 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:09:42.718322 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:09:42.718322 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:09:42.718322 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 31 16:09:42.718322 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:09:42.718322 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 31 16:09:42.718322 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:09:42.718322 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:09:42.718322 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:09:42.718322 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Aug 31 16:09:42.718322 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Aug 31 16:09:42.718322 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 31 16:09:42.718322 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 31 16:09:42.718322 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 31 16:09:42.718322 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 31 16:09:42.718322 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 16:09:42.718322 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 31 16:09:42.718322 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 16:09:42.718322 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise self.value Aug 31 16:09:42.718322 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 31 16:09:42.718322 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 31 16:09:42.718322 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 31 16:09:42.718322 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 31 16:09:42.718322 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 31 16:09:42.718322 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 31 16:09:42.718322 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 31 16:09:42.737577 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:09:42.737577 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:09:42.737577 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:09:42.737577 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:09:42.737577 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:09:42.737577 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:09:42.737577 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 31 16:09:42.737577 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 31 16:09:42.737577 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 31 16:09:42.737577 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:09:42.737577 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-bc794b50-fbcd-4e0a-a501-d5606e9d7082 tempest-ServicesAdminNegativeV253TestJSON-351520959 tempest-ServicesAdminNegativeV253TestJSON-351520959-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:09:42.737577 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-bc794b50-fbcd-4e0a-a501-d5606e9d7082 tempest-ServicesAdminNegativeV253TestJSON-351520959 tempest-ServicesAdminNegativeV253TestJSON-351520959-project] 10.222.0.61 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.495695 Aug 31 16:09:42.746788 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1548/3064] 10.222.0.61 () {60 vars in 1178 bytes} [Wed Aug 31 16:09:42 2022] GET /compute/v2.1/os-services => generated 112 bytes in 518 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:09:42.788843 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3e2da0ab-782e-467a-aa3b-bacebc2576a5 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:42.792815 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3e2da0ab-782e-467a-aa3b-bacebc2576a5 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] [instance: d1e43fd8-2e15-468d-9da0-2851a41bd23b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:42.807953 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3e2da0ab-782e-467a-aa3b-bacebc2576a5 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:42.809410 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3e2da0ab-782e-467a-aa3b-bacebc2576a5 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:42.809410 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3e2da0ab-782e-467a-aa3b-bacebc2576a5 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:42.810913 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3e2da0ab-782e-467a-aa3b-bacebc2576a5 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:42.811757 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3e2da0ab-782e-467a-aa3b-bacebc2576a5 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:42.812437 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3e2da0ab-782e-467a-aa3b-bacebc2576a5 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:42.833957 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-6d76029d-35a5-4c8d-938d-ccd534f29448 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:42.863958 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6d76029d-35a5-4c8d-938d-ccd534f29448 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c" status: 200 len: 1315 microversion: 2.1 time: 0.701511 Aug 31 16:09:42.864563 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1517/3065] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:42 2022] GET /compute/v2.1/servers/0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c => generated 1315 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:09:42.891698 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-66e4e563-a31a-402d-b205-645fb9c537a5 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:42.891698 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-66e4e563-a31a-402d-b205-645fb9c537a5 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] [instance: 0ac914d2-e9f7-4f2f-a01d-49674180d8db] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:42.923487 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-66e4e563-a31a-402d-b205-645fb9c537a5 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:42.924387 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-66e4e563-a31a-402d-b205-645fb9c537a5 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:42.924881 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-66e4e563-a31a-402d-b205-645fb9c537a5 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:42.925636 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-66e4e563-a31a-402d-b205-645fb9c537a5 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:42.926103 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-66e4e563-a31a-402d-b205-645fb9c537a5 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:42.926539 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-66e4e563-a31a-402d-b205-645fb9c537a5 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:43.279685 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-66e4e563-a31a-402d-b205-645fb9c537a5 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c65ee5ffa9d74bfdacbea45f1564d19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55320a9c8f714bc0911ded3ab88ddf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:43.356479 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-66e4e563-a31a-402d-b205-645fb9c537a5 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] 10.222.0.61 "GET /compute/v2.1/servers/0ac914d2-e9f7-4f2f-a01d-49674180d8db" status: 200 len: 1219 microversion: 2.1 time: 0.481907 Aug 31 16:09:43.357460 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1518/3066] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:42 2022] GET /compute/v2.1/servers/0ac914d2-e9f7-4f2f-a01d-49674180d8db => generated 1219 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:43.380264 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-fc44ad8c-95bb-4b65-90bc-769ae4959e84 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:43.384582 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-fc44ad8c-95bb-4b65-90bc-769ae4959e84 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] [instance: 33bb5423-4b3e-4030-a835-8ab823e2e00a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:43.404456 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fc44ad8c-95bb-4b65-90bc-769ae4959e84 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:43.405361 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fc44ad8c-95bb-4b65-90bc-769ae4959e84 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:43.406181 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fc44ad8c-95bb-4b65-90bc-769ae4959e84 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:43.425789 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fc44ad8c-95bb-4b65-90bc-769ae4959e84 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:43.426600 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fc44ad8c-95bb-4b65-90bc-769ae4959e84 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:43.427378 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fc44ad8c-95bb-4b65-90bc-769ae4959e84 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:43.542411 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=6 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:09:43.548048 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3e2da0ab-782e-467a-aa3b-bacebc2576a5 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b93395d63a4db895ff224a311940e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf281e8857247c6b9e60d4216741f89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:43.580579 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3e2da0ab-782e-467a-aa3b-bacebc2576a5 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] 10.222.0.61 "GET /compute/v2.1/servers/d1e43fd8-2e15-468d-9da0-2851a41bd23b" status: 200 len: 1320 microversion: 2.1 time: 0.803374 Aug 31 16:09:43.596501 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1549/3067] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:42 2022] GET /compute/v2.1/servers/d1e43fd8-2e15-468d-9da0-2851a41bd23b => generated 1320 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:43.686364 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-fc44ad8c-95bb-4b65-90bc-769ae4959e84 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68db583fb8fd4e6090fb220eeaafdd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c965154856f84fecb30f49dfeac46fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:43.700778 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-fc44ad8c-95bb-4b65-90bc-769ae4959e84 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] 10.222.0.61 "GET /compute/v2.1/servers/33bb5423-4b3e-4030-a835-8ab823e2e00a" status: 200 len: 1281 microversion: 2.1 time: 0.341364 Aug 31 16:09:43.703004 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1519/3068] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:43 2022] GET /compute/v2.1/servers/33bb5423-4b3e-4030-a835-8ab823e2e00a => generated 1281 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:43.912788 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-33e7b5bc-48ca-4831-bc99-660c9f593dfa tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:43.913742 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-33e7b5bc-48ca-4831-bc99-660c9f593dfa tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:43.940395 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-33e7b5bc-48ca-4831-bc99-660c9f593dfa tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:43.944408 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-33e7b5bc-48ca-4831-bc99-660c9f593dfa tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:43.949870 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-33e7b5bc-48ca-4831-bc99-660c9f593dfa tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:43.954607 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-33e7b5bc-48ca-4831-bc99-660c9f593dfa tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:43.958076 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-33e7b5bc-48ca-4831-bc99-660c9f593dfa tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:43.960367 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-33e7b5bc-48ca-4831-bc99-660c9f593dfa tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:44.061982 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1a7e45b4-eed0-43ed-af2d-2880d613119a tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Action: 'create', calling method: .version_select at 0x7f5ae9282ee0>, body: {"keypair": {"name": "tempest-keypair-266537551", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNPjeh25LSdI41GqLLFrglTH1saCEjhK+vAjf29afY9s9aOcmZlLq6/vbdotiegHF8jfOxxDYtqLOMRgqNGjvpYNbouej4MqwtdFsLfqvxKDCyVk3qyJNXotAvMbZAqdig=="}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:09:44.177858 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-1a7e45b4-eed0-43ed-af2d-2880d613119a tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Getting quotas for project e14140e7303046f1ada446437826f742. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:09:44.235151 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-1a7e45b4-eed0-43ed-af2d-2880d613119a tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Getting quotas for user 6ab268a4d607497da5476256055bb07c and project e14140e7303046f1ada446437826f742. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:09:44.358724 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1a7e45b4-eed0-43ed-af2d-2880d613119a tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.759828 Aug 31 16:09:44.360023 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1550/3069] 10.222.0.61 () {60 vars in 1159 bytes} [Wed Aug 31 16:09:43 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:09:44.394512 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c6e85202-b157-4e62-bd9f-7ed2f797be35 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:44.395559 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c6e85202-b157-4e62-bd9f-7ed2f797be35 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] [instance: 0ac914d2-e9f7-4f2f-a01d-49674180d8db] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:44.414449 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c6e85202-b157-4e62-bd9f-7ed2f797be35 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:44.431343 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c6e85202-b157-4e62-bd9f-7ed2f797be35 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:44.432651 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c6e85202-b157-4e62-bd9f-7ed2f797be35 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:44.434268 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c6e85202-b157-4e62-bd9f-7ed2f797be35 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:44.435923 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c6e85202-b157-4e62-bd9f-7ed2f797be35 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:44.436844 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c6e85202-b157-4e62-bd9f-7ed2f797be35 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:44.853812 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c6e85202-b157-4e62-bd9f-7ed2f797be35 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c65ee5ffa9d74bfdacbea45f1564d19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55320a9c8f714bc0911ded3ab88ddf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:44.879594 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c6e85202-b157-4e62-bd9f-7ed2f797be35 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] 10.222.0.61 "GET /compute/v2.1/servers/0ac914d2-e9f7-4f2f-a01d-49674180d8db" status: 200 len: 1219 microversion: 2.1 time: 0.492249 Aug 31 16:09:44.884950 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1551/3070] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:44 2022] GET /compute/v2.1/servers/0ac914d2-e9f7-4f2f-a01d-49674180d8db => generated 1219 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:44.894378 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7f4e8edb-71be-4b87-b8ec-9afffcf65d7b tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:44.895781 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7f4e8edb-71be-4b87-b8ec-9afffcf65d7b tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] [instance: d1e43fd8-2e15-468d-9da0-2851a41bd23b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:44.929004 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7f4e8edb-71be-4b87-b8ec-9afffcf65d7b tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:44.931765 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7f4e8edb-71be-4b87-b8ec-9afffcf65d7b tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:44.933615 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7f4e8edb-71be-4b87-b8ec-9afffcf65d7b tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:44.934931 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7f4e8edb-71be-4b87-b8ec-9afffcf65d7b tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:44.938709 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7f4e8edb-71be-4b87-b8ec-9afffcf65d7b tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:44.944094 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7f4e8edb-71be-4b87-b8ec-9afffcf65d7b tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:44.954534 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-33e7b5bc-48ca-4831-bc99-660c9f593dfa tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:44.957589 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=98 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:09:44.971961 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-33e7b5bc-48ca-4831-bc99-660c9f593dfa tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c" status: 200 len: 1315 microversion: 2.1 time: 1.065815 Aug 31 16:09:44.995998 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1520/3071] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:43 2022] GET /compute/v2.1/servers/0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c => generated 1315 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:45.010553 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5f6f5eb3-c987-4a35-bd89-c6ab1c08e5ee tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:45.025298 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5f6f5eb3-c987-4a35-bd89-c6ab1c08e5ee tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] [instance: 33bb5423-4b3e-4030-a835-8ab823e2e00a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:45.042780 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5f6f5eb3-c987-4a35-bd89-c6ab1c08e5ee tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:45.048808 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5f6f5eb3-c987-4a35-bd89-c6ab1c08e5ee tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:45.050043 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5f6f5eb3-c987-4a35-bd89-c6ab1c08e5ee tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:45.060932 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5f6f5eb3-c987-4a35-bd89-c6ab1c08e5ee tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:45.061828 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5f6f5eb3-c987-4a35-bd89-c6ab1c08e5ee tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:45.062972 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5f6f5eb3-c987-4a35-bd89-c6ab1c08e5ee tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:46.036499 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5f6f5eb3-c987-4a35-bd89-c6ab1c08e5ee tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68db583fb8fd4e6090fb220eeaafdd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c965154856f84fecb30f49dfeac46fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:46.066004 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5f6f5eb3-c987-4a35-bd89-c6ab1c08e5ee tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] 10.222.0.61 "GET /compute/v2.1/servers/33bb5423-4b3e-4030-a835-8ab823e2e00a" status: 200 len: 1323 microversion: 2.1 time: 1.067496 Aug 31 16:09:46.066890 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1521/3072] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:44 2022] GET /compute/v2.1/servers/33bb5423-4b3e-4030-a835-8ab823e2e00a => generated 1323 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:46.096136 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8faf1259-5e57-4069-98fc-c64d8ac6bc4c tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:46.097703 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8faf1259-5e57-4069-98fc-c64d8ac6bc4c tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] [instance: 0ac914d2-e9f7-4f2f-a01d-49674180d8db] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:46.108471 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8faf1259-5e57-4069-98fc-c64d8ac6bc4c tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:46.109265 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8faf1259-5e57-4069-98fc-c64d8ac6bc4c tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:46.109888 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8faf1259-5e57-4069-98fc-c64d8ac6bc4c tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:46.110797 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8faf1259-5e57-4069-98fc-c64d8ac6bc4c tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:46.111430 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8faf1259-5e57-4069-98fc-c64d8ac6bc4c tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:46.112042 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8faf1259-5e57-4069-98fc-c64d8ac6bc4c tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:46.153121 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7f4e8edb-71be-4b87-b8ec-9afffcf65d7b tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b93395d63a4db895ff224a311940e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf281e8857247c6b9e60d4216741f89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:46.165653 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7f4e8edb-71be-4b87-b8ec-9afffcf65d7b tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] 10.222.0.61 "GET /compute/v2.1/servers/d1e43fd8-2e15-468d-9da0-2851a41bd23b" status: 200 len: 1320 microversion: 2.1 time: 1.278072 Aug 31 16:09:46.168243 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1552/3073] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:44 2022] GET /compute/v2.1/servers/d1e43fd8-2e15-468d-9da0-2851a41bd23b => generated 1320 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:46.188104 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-4e759bd0-0213-4ce6-9e4c-b7021c341efa req-9f8bf964-e9d4-43d8-8e08-f65c34a3e369 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6064a64-eae1-400c-b60c-2189e025905f", "name": "network-vif-plugged", "status": "completed", "tag": "5006df16-da92-4553-98f9-b281a211f4cd"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:09:46.200118 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-4e759bd0-0213-4ce6-9e4c-b7021c341efa req-9f8bf964-e9d4-43d8-8e08-f65c34a3e369 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:46.201201 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-4e759bd0-0213-4ce6-9e4c-b7021c341efa req-9f8bf964-e9d4-43d8-8e08-f65c34a3e369 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:46.201810 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-4e759bd0-0213-4ce6-9e4c-b7021c341efa req-9f8bf964-e9d4-43d8-8e08-f65c34a3e369 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:46.227622 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-4e759bd0-0213-4ce6-9e4c-b7021c341efa req-9f8bf964-e9d4-43d8-8e08-f65c34a3e369 service nova] Creating event network-vif-plugged:5006df16-da92-4553-98f9-b281a211f4cd for instance e6064a64-eae1-400c-b60c-2189e025905f on n-h1-850499-9 Aug 31 16:09:46.238850 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-4e759bd0-0213-4ce6-9e4c-b7021c341efa req-9f8bf964-e9d4-43d8-8e08-f65c34a3e369 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056101 Aug 31 16:09:46.238850 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1553/3074] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:09:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:09:46.274855 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e8d12a6a-7448-49e5-b56e-0ab64a62736f tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:46.277153 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e8d12a6a-7448-49e5-b56e-0ab64a62736f tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:46.309932 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e8d12a6a-7448-49e5-b56e-0ab64a62736f tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:46.310795 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e8d12a6a-7448-49e5-b56e-0ab64a62736f tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:46.312836 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e8d12a6a-7448-49e5-b56e-0ab64a62736f tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:46.314064 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e8d12a6a-7448-49e5-b56e-0ab64a62736f tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:46.315530 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e8d12a6a-7448-49e5-b56e-0ab64a62736f tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:46.316415 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e8d12a6a-7448-49e5-b56e-0ab64a62736f tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:46.545443 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8faf1259-5e57-4069-98fc-c64d8ac6bc4c tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c65ee5ffa9d74bfdacbea45f1564d19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55320a9c8f714bc0911ded3ab88ddf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:46.579238 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8faf1259-5e57-4069-98fc-c64d8ac6bc4c tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] 10.222.0.61 "GET /compute/v2.1/servers/0ac914d2-e9f7-4f2f-a01d-49674180d8db" status: 200 len: 1237 microversion: 2.1 time: 0.496936 Aug 31 16:09:46.579895 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1522/3075] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:46 2022] GET /compute/v2.1/servers/0ac914d2-e9f7-4f2f-a01d-49674180d8db => generated 1237 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:47.102276 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-bdb8ba71-4a4b-4c45-9eae-72fbe4c0d475 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:47.103157 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-bdb8ba71-4a4b-4c45-9eae-72fbe4c0d475 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] [instance: 33bb5423-4b3e-4030-a835-8ab823e2e00a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:47.119798 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bdb8ba71-4a4b-4c45-9eae-72fbe4c0d475 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:47.120719 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bdb8ba71-4a4b-4c45-9eae-72fbe4c0d475 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:47.121367 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bdb8ba71-4a4b-4c45-9eae-72fbe4c0d475 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:47.123676 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bdb8ba71-4a4b-4c45-9eae-72fbe4c0d475 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:47.127484 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bdb8ba71-4a4b-4c45-9eae-72fbe4c0d475 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:47.128825 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bdb8ba71-4a4b-4c45-9eae-72fbe4c0d475 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:48.144046 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e8d12a6a-7448-49e5-b56e-0ab64a62736f tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:48.162144 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e8d12a6a-7448-49e5-b56e-0ab64a62736f tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c" status: 200 len: 1315 microversion: 2.1 time: 1.921897 Aug 31 16:09:48.164626 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1554/3076] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:46 2022] GET /compute/v2.1/servers/0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c => generated 1315 bytes in 1925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:48.184079 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f6af2f8a-37b6-4a1e-9db8-75d86ac8d27c tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:48.186095 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f6af2f8a-37b6-4a1e-9db8-75d86ac8d27c tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] [instance: d1e43fd8-2e15-468d-9da0-2851a41bd23b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:48.220060 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:09:48.225626 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f6af2f8a-37b6-4a1e-9db8-75d86ac8d27c tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:48.230461 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f6af2f8a-37b6-4a1e-9db8-75d86ac8d27c tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:48.234311 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f6af2f8a-37b6-4a1e-9db8-75d86ac8d27c tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:48.240109 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f6af2f8a-37b6-4a1e-9db8-75d86ac8d27c tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:48.241406 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f6af2f8a-37b6-4a1e-9db8-75d86ac8d27c tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:48.242575 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f6af2f8a-37b6-4a1e-9db8-75d86ac8d27c tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:48.317194 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=100 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:09:49.306129 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-bdb8ba71-4a4b-4c45-9eae-72fbe4c0d475 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68db583fb8fd4e6090fb220eeaafdd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c965154856f84fecb30f49dfeac46fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:49.318171 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-bdb8ba71-4a4b-4c45-9eae-72fbe4c0d475 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] 10.222.0.61 "GET /compute/v2.1/servers/33bb5423-4b3e-4030-a835-8ab823e2e00a" status: 200 len: 1323 microversion: 2.1 time: 2.220064 Aug 31 16:09:49.328473 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1523/3077] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:47 2022] GET /compute/v2.1/servers/33bb5423-4b3e-4030-a835-8ab823e2e00a => generated 1323 bytes in 2231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:49.340881 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-83528f91-0ce6-4028-9429-3931f4aabb41 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:49.342135 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-83528f91-0ce6-4028-9429-3931f4aabb41 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] [instance: 0ac914d2-e9f7-4f2f-a01d-49674180d8db] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:49.361968 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-83528f91-0ce6-4028-9429-3931f4aabb41 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:49.363539 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-83528f91-0ce6-4028-9429-3931f4aabb41 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:49.364372 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-83528f91-0ce6-4028-9429-3931f4aabb41 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:49.365591 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-83528f91-0ce6-4028-9429-3931f4aabb41 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:49.366495 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-83528f91-0ce6-4028-9429-3931f4aabb41 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:49.368505 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-83528f91-0ce6-4028-9429-3931f4aabb41 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:49.955715 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-83528f91-0ce6-4028-9429-3931f4aabb41 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c65ee5ffa9d74bfdacbea45f1564d19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55320a9c8f714bc0911ded3ab88ddf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:49.968349 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-83528f91-0ce6-4028-9429-3931f4aabb41 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] 10.222.0.61 "GET /compute/v2.1/servers/0ac914d2-e9f7-4f2f-a01d-49674180d8db" status: 200 len: 1237 microversion: 2.1 time: 0.638157 Aug 31 16:09:49.969687 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1524/3078] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:49 2022] GET /compute/v2.1/servers/0ac914d2-e9f7-4f2f-a01d-49674180d8db => generated 1237 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:49.976089 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f6af2f8a-37b6-4a1e-9db8-75d86ac8d27c tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b93395d63a4db895ff224a311940e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf281e8857247c6b9e60d4216741f89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:49.990947 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f6af2f8a-37b6-4a1e-9db8-75d86ac8d27c tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] 10.222.0.61 "GET /compute/v2.1/servers/d1e43fd8-2e15-468d-9da0-2851a41bd23b" status: 200 len: 1320 microversion: 2.1 time: 1.820803 Aug 31 16:09:50.003994 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1555/3079] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:48 2022] GET /compute/v2.1/servers/d1e43fd8-2e15-468d-9da0-2851a41bd23b => generated 1320 bytes in 1826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:50.004531 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-a81dd16d-b8f3-4b93-a67a-be0a205b23d3 req-27d4006f-705f-45cb-8835-9fe33914c382 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b68db583-0d09-4485-8b26-ff5c02e23c01", "tag": "a44cba0a-b891-4f5c-88cb-0f6b3c9d2376"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:09:50.022141 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4658fd89-3b55-4e58-8de3-a8d9f763d211 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:50.022141 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4658fd89-3b55-4e58-8de3-a8d9f763d211 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:50.040393 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-a81dd16d-b8f3-4b93-a67a-be0a205b23d3 req-27d4006f-705f-45cb-8835-9fe33914c382 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:50.042040 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-a81dd16d-b8f3-4b93-a67a-be0a205b23d3 req-27d4006f-705f-45cb-8835-9fe33914c382 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:50.047091 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-a81dd16d-b8f3-4b93-a67a-be0a205b23d3 req-27d4006f-705f-45cb-8835-9fe33914c382 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:50.049629 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4658fd89-3b55-4e58-8de3-a8d9f763d211 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:50.052395 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4658fd89-3b55-4e58-8de3-a8d9f763d211 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:50.053800 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4658fd89-3b55-4e58-8de3-a8d9f763d211 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:50.056872 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4658fd89-3b55-4e58-8de3-a8d9f763d211 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:50.060138 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4658fd89-3b55-4e58-8de3-a8d9f763d211 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:50.060138 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4658fd89-3b55-4e58-8de3-a8d9f763d211 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:50.075761 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-a81dd16d-b8f3-4b93-a67a-be0a205b23d3 req-27d4006f-705f-45cb-8835-9fe33914c382 service nova] Creating event network-changed:a44cba0a-b891-4f5c-88cb-0f6b3c9d2376 for instance b68db583-0d09-4485-8b26-ff5c02e23c01 on n-h1-850499-9 Aug 31 16:09:50.090601 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-a81dd16d-b8f3-4b93-a67a-be0a205b23d3 req-27d4006f-705f-45cb-8835-9fe33914c382 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118119 Aug 31 16:09:50.092068 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1525/3080] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:09:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:09:50.103125 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-43ddcddb-9994-4325-8091-4a3a13c67297 req-8d26fdc3-ad4d-43e4-bd19-225c9703e457 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1e43fd8-2e15-468d-9da0-2851a41bd23b", "name": "network-vif-plugged", "status": "completed", "tag": "d51ed438-7b34-4bdd-985c-393bd746e794"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:09:50.131079 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-43ddcddb-9994-4325-8091-4a3a13c67297 req-8d26fdc3-ad4d-43e4-bd19-225c9703e457 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:50.131879 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-43ddcddb-9994-4325-8091-4a3a13c67297 req-8d26fdc3-ad4d-43e4-bd19-225c9703e457 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:50.132479 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-43ddcddb-9994-4325-8091-4a3a13c67297 req-8d26fdc3-ad4d-43e4-bd19-225c9703e457 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:50.161702 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-43ddcddb-9994-4325-8091-4a3a13c67297 req-8d26fdc3-ad4d-43e4-bd19-225c9703e457 service nova] Creating event network-vif-plugged:d51ed438-7b34-4bdd-985c-393bd746e794 for instance d1e43fd8-2e15-468d-9da0-2851a41bd23b on n-h1-850499-9 Aug 31 16:09:50.173752 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-43ddcddb-9994-4325-8091-4a3a13c67297 req-8d26fdc3-ad4d-43e4-bd19-225c9703e457 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079889 Aug 31 16:09:50.174987 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1526/3081] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:09:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:09:50.350440 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9cc3ec5e-b8a7-40b1-92aa-8a10b0dd4ed7 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:50.359410 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9cc3ec5e-b8a7-40b1-92aa-8a10b0dd4ed7 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] [instance: 33bb5423-4b3e-4030-a835-8ab823e2e00a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:50.385003 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9cc3ec5e-b8a7-40b1-92aa-8a10b0dd4ed7 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:50.386002 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9cc3ec5e-b8a7-40b1-92aa-8a10b0dd4ed7 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:50.386716 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9cc3ec5e-b8a7-40b1-92aa-8a10b0dd4ed7 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:50.389057 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9cc3ec5e-b8a7-40b1-92aa-8a10b0dd4ed7 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:50.402361 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9cc3ec5e-b8a7-40b1-92aa-8a10b0dd4ed7 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:50.404399 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9cc3ec5e-b8a7-40b1-92aa-8a10b0dd4ed7 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:52.074509 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=14 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:09:52.177606 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=10 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:09:52.213739 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9cc3ec5e-b8a7-40b1-92aa-8a10b0dd4ed7 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68db583fb8fd4e6090fb220eeaafdd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c965154856f84fecb30f49dfeac46fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:52.221821 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-4658fd89-3b55-4e58-8de3-a8d9f763d211 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:52.245267 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4658fd89-3b55-4e58-8de3-a8d9f763d211 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c" status: 200 len: 1315 microversion: 2.1 time: 2.244333 Aug 31 16:09:52.247088 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1556/3082] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:49 2022] GET /compute/v2.1/servers/0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c => generated 1315 bytes in 2252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:52.266881 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9cc3ec5e-b8a7-40b1-92aa-8a10b0dd4ed7 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] 10.222.0.61 "GET /compute/v2.1/servers/33bb5423-4b3e-4030-a835-8ab823e2e00a" status: 200 len: 1323 microversion: 2.1 time: 1.928067 Aug 31 16:09:52.287421 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1527/3083] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:50 2022] GET /compute/v2.1/servers/33bb5423-4b3e-4030-a835-8ab823e2e00a => generated 1323 bytes in 1944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:52.287957 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-55e244b1-bf07-406d-b44e-732c5bed035d tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:52.289574 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-55e244b1-bf07-406d-b44e-732c5bed035d tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] [instance: 0ac914d2-e9f7-4f2f-a01d-49674180d8db] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:52.310298 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-91b51a55-c75f-4218-81bd-7d819950ce45 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:52.310871 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-55e244b1-bf07-406d-b44e-732c5bed035d tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:52.312347 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-55e244b1-bf07-406d-b44e-732c5bed035d tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:52.312968 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-55e244b1-bf07-406d-b44e-732c5bed035d tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:52.315188 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-55e244b1-bf07-406d-b44e-732c5bed035d tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:52.316521 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-55e244b1-bf07-406d-b44e-732c5bed035d tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:52.317161 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-55e244b1-bf07-406d-b44e-732c5bed035d tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:52.321656 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-91b51a55-c75f-4218-81bd-7d819950ce45 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] [instance: d1e43fd8-2e15-468d-9da0-2851a41bd23b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:52.344470 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-91b51a55-c75f-4218-81bd-7d819950ce45 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:52.347437 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-91b51a55-c75f-4218-81bd-7d819950ce45 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:52.348159 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-91b51a55-c75f-4218-81bd-7d819950ce45 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:52.349794 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-91b51a55-c75f-4218-81bd-7d819950ce45 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:52.352104 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-91b51a55-c75f-4218-81bd-7d819950ce45 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:52.353759 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-91b51a55-c75f-4218-81bd-7d819950ce45 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:53.163098 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-55e244b1-bf07-406d-b44e-732c5bed035d tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c65ee5ffa9d74bfdacbea45f1564d19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55320a9c8f714bc0911ded3ab88ddf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:53.189504 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-55e244b1-bf07-406d-b44e-732c5bed035d tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] 10.222.0.61 "GET /compute/v2.1/servers/0ac914d2-e9f7-4f2f-a01d-49674180d8db" status: 200 len: 1305 microversion: 2.1 time: 0.938832 Aug 31 16:09:53.190144 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1557/3084] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:52 2022] GET /compute/v2.1/servers/0ac914d2-e9f7-4f2f-a01d-49674180d8db => generated 1305 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:53.191475 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-91b51a55-c75f-4218-81bd-7d819950ce45 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b93395d63a4db895ff224a311940e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf281e8857247c6b9e60d4216741f89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:53.223237 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-91b51a55-c75f-4218-81bd-7d819950ce45 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] 10.222.0.61 "GET /compute/v2.1/servers/d1e43fd8-2e15-468d-9da0-2851a41bd23b" status: 200 len: 1320 microversion: 2.1 time: 0.931234 Aug 31 16:09:53.224340 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1528/3085] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:52 2022] GET /compute/v2.1/servers/d1e43fd8-2e15-468d-9da0-2851a41bd23b => generated 1320 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:53.236094 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-70ca5064-9df7-4049-86a1-e01179e21625 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-481827791", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "networks": [{"uuid": "76e9647f-4a38-405c-b14a-4bf676c35b51"}], "security_groups": [{"name": "tempest-securitygroup--988262039"}], "key_name": "tempest-keypair-266537551", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:09:53.264736 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-bb3fa829-f663-4c52-ad62-feeaea8d25a2 req-f7be1681-f328-4eb6-b1f5-f0bb68375ff5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33bb5423-4b3e-4030-a835-8ab823e2e00a", "tag": "c095212f-1c48-4cbd-8b3f-2a8e3b2bd211"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:09:53.286305 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-bb3fa829-f663-4c52-ad62-feeaea8d25a2 req-f7be1681-f328-4eb6-b1f5-f0bb68375ff5 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:53.291752 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-bb3fa829-f663-4c52-ad62-feeaea8d25a2 req-f7be1681-f328-4eb6-b1f5-f0bb68375ff5 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:53.297205 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-bb3fa829-f663-4c52-ad62-feeaea8d25a2 req-f7be1681-f328-4eb6-b1f5-f0bb68375ff5 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:53.325517 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-bb3fa829-f663-4c52-ad62-feeaea8d25a2 req-f7be1681-f328-4eb6-b1f5-f0bb68375ff5 service nova] Creating event network-changed:c095212f-1c48-4cbd-8b3f-2a8e3b2bd211 for instance 33bb5423-4b3e-4030-a835-8ab823e2e00a on n-h1-850499-9 Aug 31 16:09:53.336986 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-bb3fa829-f663-4c52-ad62-feeaea8d25a2 req-f7be1681-f328-4eb6-b1f5-f0bb68375ff5 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097923 Aug 31 16:09:53.340645 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1529/3086] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:09:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:09:53.349523 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-1ddceca3-c39c-4f04-8b5f-1ade14686ef7 req-ad2a4ded-6999-43fb-b230-08cfa034b311 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c", "name": "network-vif-plugged", "status": "completed", "tag": "01ac81c6-6528-4881-a131-08caa56e847d"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:09:53.407100 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-1ddceca3-c39c-4f04-8b5f-1ade14686ef7 req-ad2a4ded-6999-43fb-b230-08cfa034b311 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:53.408062 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-1ddceca3-c39c-4f04-8b5f-1ade14686ef7 req-ad2a4ded-6999-43fb-b230-08cfa034b311 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:53.408851 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-1ddceca3-c39c-4f04-8b5f-1ade14686ef7 req-ad2a4ded-6999-43fb-b230-08cfa034b311 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:53.455467 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-1ddceca3-c39c-4f04-8b5f-1ade14686ef7 req-ad2a4ded-6999-43fb-b230-08cfa034b311 service nova] Creating event network-vif-plugged:01ac81c6-6528-4881-a131-08caa56e847d for instance 0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c on n-h2-850499-9 Aug 31 16:09:53.480401 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-1ddceca3-c39c-4f04-8b5f-1ade14686ef7 req-ad2a4ded-6999-43fb-b230-08cfa034b311 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131372 Aug 31 16:09:53.482113 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1530/3087] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:09:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:09:53.508598 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-595d6130-f648-4621-91dc-e4f735d4b859 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:53.509661 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-595d6130-f648-4621-91dc-e4f735d4b859 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:53.521119 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-595d6130-f648-4621-91dc-e4f735d4b859 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:53.521875 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-595d6130-f648-4621-91dc-e4f735d4b859 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:53.522829 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-595d6130-f648-4621-91dc-e4f735d4b859 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:53.524363 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-595d6130-f648-4621-91dc-e4f735d4b859 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:53.525057 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-595d6130-f648-4621-91dc-e4f735d4b859 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:53.526431 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-595d6130-f648-4621-91dc-e4f735d4b859 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:53.983915 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-70ca5064-9df7-4049-86a1-e01179e21625 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] validate_networks() for [('76e9647f-4a38-405c-b14a-4bf676c35b51', None, None, None, None, None)] {{(pid=122256) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:09:54.278520 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=16 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:09:54.809185 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-595d6130-f648-4621-91dc-e4f735d4b859 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:54.832954 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-595d6130-f648-4621-91dc-e4f735d4b859 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c" status: 200 len: 1315 microversion: 2.1 time: 1.332379 Aug 31 16:09:54.849732 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1531/3088] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:53 2022] GET /compute/v2.1/servers/0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c => generated 1315 bytes in 1366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:54.888717 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3e9b1142-0f01-420a-9252-7eb9e8731117 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:54.891898 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3e9b1142-0f01-420a-9252-7eb9e8731117 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] [instance: 33bb5423-4b3e-4030-a835-8ab823e2e00a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:54.922546 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3e9b1142-0f01-420a-9252-7eb9e8731117 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:54.923417 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3e9b1142-0f01-420a-9252-7eb9e8731117 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:54.927999 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3e9b1142-0f01-420a-9252-7eb9e8731117 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:54.928931 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3e9b1142-0f01-420a-9252-7eb9e8731117 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:54.933727 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3e9b1142-0f01-420a-9252-7eb9e8731117 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:54.936856 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3e9b1142-0f01-420a-9252-7eb9e8731117 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:56.152060 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3e9b1142-0f01-420a-9252-7eb9e8731117 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68db583fb8fd4e6090fb220eeaafdd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c965154856f84fecb30f49dfeac46fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:56.170463 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3e9b1142-0f01-420a-9252-7eb9e8731117 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] 10.222.0.61 "GET /compute/v2.1/servers/33bb5423-4b3e-4030-a835-8ab823e2e00a" status: 200 len: 1323 microversion: 2.1 time: 1.308768 Aug 31 16:09:56.174666 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1532/3089] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:54 2022] GET /compute/v2.1/servers/33bb5423-4b3e-4030-a835-8ab823e2e00a => generated 1323 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:56.196027 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e59904e1-0e70-4dd4-859e-3ae57ed43b5e tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:56.197023 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e59904e1-0e70-4dd4-859e-3ae57ed43b5e tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] [instance: 0ac914d2-e9f7-4f2f-a01d-49674180d8db] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:56.208911 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e59904e1-0e70-4dd4-859e-3ae57ed43b5e tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:56.209247 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e59904e1-0e70-4dd4-859e-3ae57ed43b5e tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:56.210041 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e59904e1-0e70-4dd4-859e-3ae57ed43b5e tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:56.212023 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e59904e1-0e70-4dd4-859e-3ae57ed43b5e tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:56.212837 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e59904e1-0e70-4dd4-859e-3ae57ed43b5e tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:56.214336 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e59904e1-0e70-4dd4-859e-3ae57ed43b5e tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:56.221029 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-70ca5064-9df7-4049-86a1-e01179e21625 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:09:56.224908 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-70ca5064-9df7-4049-86a1-e01179e21625 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:09:56.227854 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-70ca5064-9df7-4049-86a1-e01179e21625 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:09:56.229110 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-70ca5064-9df7-4049-86a1-e01179e21625 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:09:56.231669 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-70ca5064-9df7-4049-86a1-e01179e21625 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:09:56.275999 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-70ca5064-9df7-4049-86a1-e01179e21625 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:56.280822 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-70ca5064-9df7-4049-86a1-e01179e21625 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:56.282979 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-70ca5064-9df7-4049-86a1-e01179e21625 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:56.289517 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-70ca5064-9df7-4049-86a1-e01179e21625 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:56.293720 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-70ca5064-9df7-4049-86a1-e01179e21625 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:56.294695 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-70ca5064-9df7-4049-86a1-e01179e21625 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:56.353662 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-70ca5064-9df7-4049-86a1-e01179e21625 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Getting quotas for project e14140e7303046f1ada446437826f742. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:09:56.364710 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-70ca5064-9df7-4049-86a1-e01179e21625 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Getting quotas for user 6ab268a4d607497da5476256055bb07c and project e14140e7303046f1ada446437826f742. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:09:56.422261 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-70ca5064-9df7-4049-86a1-e01179e21625 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Going to run 1 instances... {{(pid=122256) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:09:56.426623 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-70ca5064-9df7-4049-86a1-e01179e21625 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] [instance: eed024b5-986b-40fa-a686-ceab563a6131] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:09:56.563544 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-70ca5064-9df7-4049-86a1-e01179e21625 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 3.365788 Aug 31 16:09:56.575178 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1558/3090] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:09:53 2022] POST /compute/v2.1/servers => generated 405 bytes in 3384 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:09:56.591885 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-49c20a03-7651-4ec2-8606-509fdc090288 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:56.593119 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-49c20a03-7651-4ec2-8606-509fdc090288 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] [instance: d1e43fd8-2e15-468d-9da0-2851a41bd23b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:56.609786 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-49c20a03-7651-4ec2-8606-509fdc090288 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:56.610514 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-49c20a03-7651-4ec2-8606-509fdc090288 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:56.611190 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-49c20a03-7651-4ec2-8606-509fdc090288 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:56.612222 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-49c20a03-7651-4ec2-8606-509fdc090288 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:56.612714 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-49c20a03-7651-4ec2-8606-509fdc090288 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:56.613260 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-49c20a03-7651-4ec2-8606-509fdc090288 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:56.814899 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e59904e1-0e70-4dd4-859e-3ae57ed43b5e tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c65ee5ffa9d74bfdacbea45f1564d19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55320a9c8f714bc0911ded3ab88ddf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:56.871960 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e59904e1-0e70-4dd4-859e-3ae57ed43b5e tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] 10.222.0.61 "GET /compute/v2.1/servers/0ac914d2-e9f7-4f2f-a01d-49674180d8db" status: 200 len: 1305 microversion: 2.1 time: 0.695235 Aug 31 16:09:56.879827 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1533/3091] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:56 2022] GET /compute/v2.1/servers/0ac914d2-e9f7-4f2f-a01d-49674180d8db => generated 1305 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:56.912608 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-8ad321e9-6a3c-4ca8-b2d2-b115619e6967 req-5f4079c3-009d-4a7a-8f4d-3c7953e42577 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29a78fc3-93ff-4f42-8c9f-79dfdc5229c6", "tag": "cf59a33a-70b0-49f7-99b3-a7b4760a6cef"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:09:56.974990 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-8ad321e9-6a3c-4ca8-b2d2-b115619e6967 req-5f4079c3-009d-4a7a-8f4d-3c7953e42577 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:56.975488 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-8ad321e9-6a3c-4ca8-b2d2-b115619e6967 req-5f4079c3-009d-4a7a-8f4d-3c7953e42577 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:56.977462 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-8ad321e9-6a3c-4ca8-b2d2-b115619e6967 req-5f4079c3-009d-4a7a-8f4d-3c7953e42577 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:56.998012 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-8ad321e9-6a3c-4ca8-b2d2-b115619e6967 req-5f4079c3-009d-4a7a-8f4d-3c7953e42577 service nova] Creating event network-changed:cf59a33a-70b0-49f7-99b3-a7b4760a6cef for instance 29a78fc3-93ff-4f42-8c9f-79dfdc5229c6 on n-h2-850499-9 Aug 31 16:09:57.007469 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-8ad321e9-6a3c-4ca8-b2d2-b115619e6967 req-5f4079c3-009d-4a7a-8f4d-3c7953e42577 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124397 Aug 31 16:09:57.010340 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1534/3092] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:09:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:09:57.245963 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-672b3c7e-ae20-4fa4-a0ea-d113303eba7a tempest-TenantUsagesNegativeTestJSON-1309015286 tempest-TenantUsagesNegativeTestJSON-1309015286-project-admin] 10.222.0.61 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-08-30T16%3A09%3A55.791984&end=2022-09-01T16%3A09%3A55.791984" status: 404 len: 112 microversion: - time: 0.232931 Aug 31 16:09:57.246925 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1535/3093] 10.222.0.61 () {58 vars in 1316 bytes} [Wed Aug 31 16:09:57 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-08-30T16%3A09%3A55.791984&end=2022-09-01T16%3A09%3A55.791984 => generated 112 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 31 16:09:57.274087 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a6a9b501-2f65-4950-a2eb-a5d8d949c8c3 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:57.276096 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a6a9b501-2f65-4950-a2eb-a5d8d949c8c3 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:57.299585 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a6a9b501-2f65-4950-a2eb-a5d8d949c8c3 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:57.307431 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a6a9b501-2f65-4950-a2eb-a5d8d949c8c3 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:57.308301 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a6a9b501-2f65-4950-a2eb-a5d8d949c8c3 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:57.309296 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a6a9b501-2f65-4950-a2eb-a5d8d949c8c3 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:57.310166 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a6a9b501-2f65-4950-a2eb-a5d8d949c8c3 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:57.310849 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a6a9b501-2f65-4950-a2eb-a5d8d949c8c3 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:57.622140 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-49c20a03-7651-4ec2-8606-509fdc090288 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b93395d63a4db895ff224a311940e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf281e8857247c6b9e60d4216741f89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:57.637714 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-49c20a03-7651-4ec2-8606-509fdc090288 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] 10.222.0.61 "GET /compute/v2.1/servers/d1e43fd8-2e15-468d-9da0-2851a41bd23b" status: 200 len: 1512 microversion: 2.1 time: 1.057433 Aug 31 16:09:57.639893 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1559/3094] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:56 2022] GET /compute/v2.1/servers/d1e43fd8-2e15-468d-9da0-2851a41bd23b => generated 1512 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:57.655478 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-cdff9f14-7095-44b0-8b37-dce11b1413a5 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:57.662474 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-cdff9f14-7095-44b0-8b37-dce11b1413a5 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] [instance: eed024b5-986b-40fa-a686-ceab563a6131] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:57.680460 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cdff9f14-7095-44b0-8b37-dce11b1413a5 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:57.682538 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cdff9f14-7095-44b0-8b37-dce11b1413a5 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:57.683087 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cdff9f14-7095-44b0-8b37-dce11b1413a5 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:57.684015 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cdff9f14-7095-44b0-8b37-dce11b1413a5 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:57.691188 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cdff9f14-7095-44b0-8b37-dce11b1413a5 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:57.691809 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cdff9f14-7095-44b0-8b37-dce11b1413a5 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:57.842494 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-cdff9f14-7095-44b0-8b37-dce11b1413a5 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab268a4d607497da5476256055bb07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14140e7303046f1ada446437826f742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:57.861277 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-cdff9f14-7095-44b0-8b37-dce11b1413a5 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] 10.222.0.61 "GET /compute/v2.1/servers/eed024b5-986b-40fa-a686-ceab563a6131" status: 200 len: 1244 microversion: 2.1 time: 0.219441 Aug 31 16:09:57.881837 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1560/3095] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:57 2022] GET /compute/v2.1/servers/eed024b5-986b-40fa-a686-ceab563a6131 => generated 1244 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:57.895992 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-8d5bf01a-3c37-4b50-84e3-8ea7f8fcaac1 req-fe992f6a-3f56-4665-8a94-0f63bd6c10dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33bb5423-4b3e-4030-a835-8ab823e2e00a", "name": "network-vif-plugged", "status": "completed", "tag": "c095212f-1c48-4cbd-8b3f-2a8e3b2bd211"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:09:57.930119 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-8d5bf01a-3c37-4b50-84e3-8ea7f8fcaac1 req-fe992f6a-3f56-4665-8a94-0f63bd6c10dd service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:57.932375 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-8d5bf01a-3c37-4b50-84e3-8ea7f8fcaac1 req-fe992f6a-3f56-4665-8a94-0f63bd6c10dd service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:57.936941 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-8d5bf01a-3c37-4b50-84e3-8ea7f8fcaac1 req-fe992f6a-3f56-4665-8a94-0f63bd6c10dd service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:57.955615 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a6a9b501-2f65-4950-a2eb-a5d8d949c8c3 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:57.968899 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a6a9b501-2f65-4950-a2eb-a5d8d949c8c3 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c" status: 200 len: 1502 microversion: 2.1 time: 0.714317 Aug 31 16:09:57.970127 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1536/3096] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:57 2022] GET /compute/v2.1/servers/0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c => generated 1502 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:57.978505 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7a033dc5-e738-4197-a858-13dfbdd97bf4 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:57.979465 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7a033dc5-e738-4197-a858-13dfbdd97bf4 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] [instance: 33bb5423-4b3e-4030-a835-8ab823e2e00a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:57.997791 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7a033dc5-e738-4197-a858-13dfbdd97bf4 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:57.998739 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7a033dc5-e738-4197-a858-13dfbdd97bf4 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:58.002103 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7a033dc5-e738-4197-a858-13dfbdd97bf4 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:58.003863 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7a033dc5-e738-4197-a858-13dfbdd97bf4 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:58.010391 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7a033dc5-e738-4197-a858-13dfbdd97bf4 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:58.011598 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7a033dc5-e738-4197-a858-13dfbdd97bf4 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:58.022151 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-8d5bf01a-3c37-4b50-84e3-8ea7f8fcaac1 req-fe992f6a-3f56-4665-8a94-0f63bd6c10dd service nova] Creating event network-vif-plugged:c095212f-1c48-4cbd-8b3f-2a8e3b2bd211 for instance 33bb5423-4b3e-4030-a835-8ab823e2e00a on n-h1-850499-9 Aug 31 16:09:58.045591 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-8d5bf01a-3c37-4b50-84e3-8ea7f8fcaac1 req-fe992f6a-3f56-4665-8a94-0f63bd6c10dd service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161554 Aug 31 16:09:58.048501 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1561/3097] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:09:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:09:58.057179 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b8248384-5a55-499d-9887-bb49bc319ad6 tempest-TenantUsagesNegativeTestJSON-1309015286 tempest-TenantUsagesNegativeTestJSON-1309015286-project-admin] Calling method '.version_select at 0x7f5aed2bd040>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:58.063786 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-b8248384-5a55-499d-9887-bb49bc319ad6 tempest-TenantUsagesNegativeTestJSON-1309015286 tempest-TenantUsagesNegativeTestJSON-1309015286-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Aug 31 16:09:58.084809 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b8248384-5a55-499d-9887-bb49bc319ad6 tempest-TenantUsagesNegativeTestJSON-1309015286 tempest-TenantUsagesNegativeTestJSON-1309015286-project-admin] Request method failure captured: Aug 31 16:09:58.084809 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/os-simple-tenant-usage/39d97c54db934c828f8e68cae296a5ac?start=2022-09-01T16%3A09%3A55.791984&end=2022-08-30T16%3A09%3A55.791984 HTTP/1.1 Aug 31 16:09:58.084809 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:09:58.084809 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:09:58.084809 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:09:58.084809 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:09:58.084809 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:09:58.084809 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:09:58.084809 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:09:58.084809 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:09:58.084809 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4fTQdZBeWewGis_SpGtJ5d67aMS9Npp8jlRVfK6mz7ns7YHBB6HvLGbf56VV0j6aeMKkZEnQi_OYcSTxl7MaKttyfvZKuwVOk2UU-6GlkH0IMxftXM3FNy2C0mQYQEOy8nh-sz4LROeSSXla4D_YtLMlhXR7jiHKtULBTXJ2Jq2k3I Aug 31 16:09:58.084809 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:09:58.084809 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:09:58.084809 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:09:58.084809 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:09:58.084809 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:09:58.084809 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:09:58.084809 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: aab4d39bcdd848c8bc1ac5ef4eb02cbd Aug 31 16:09:58.084809 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1309015286 Aug 31 16:09:58.084809 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,admin,member Aug 31 16:09:58.084809 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,admin,member Aug 31 16:09:58.084809 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/aab4d39bcdd848c8bc1ac5ef4eb02cbd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/aab4d39bcdd848c8bc1ac5ef4eb02cbd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_aab4d39bcdd848c8bc1ac5ef4eb02cbd", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/aab4d39bcdd848c8bc1ac5ef4eb02cbd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:09:58.084809 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1309015286 Aug 31 16:09:58.084809 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: aab4d39bcdd848c8bc1ac5ef4eb02cbd Aug 31 16:09:58.084809 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1309015286 Aug 31 16:09:58.084809 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-TenantUsagesNegativeTestJSON-1309015286-project-admin Aug 31 16:09:58.084809 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:09:58.084809 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:09:58.084809 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 2d3d782a2c164c6a8ac904309a924fcf Aug 31 16:09:58.084809 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1309015286-project-admin Aug 31 16:09:58.084809 n-d-850499-9 devstack@n-api.service[122256]: method: Aug 31 16:09:58.084809 n-d-850499-9 devstack@n-api.service[122256]: exception: Invalid start time. The start time cannot occur after the end time. Aug 31 16:09:58.084809 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '39d97c54db934c828f8e68cae296a5ac'} Aug 31 16:09:58.084809 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:09:58.084809 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:09:58.084809 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:09:58.084809 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:09:58.084809 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:09:58.084809 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:09:58.084809 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:09:58.084809 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:09:58.084809 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 31 16:09:58.084809 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:09:58.084809 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:09:58.084809 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:09:58.084809 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Aug 31 16:09:58.084809 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 31 16:09:58.084809 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Aug 31 16:09:58.084809 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Aug 31 16:09:58.084809 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Aug 31 16:09:58.084809 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 31 16:09:58.084809 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Aug 31 16:09:58.084809 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:09:58.084809 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:09:58.084809 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:09:58.084809 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:09:58.084809 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:09:58.084809 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:09:58.084809 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:09:58.084809 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:09:58.084809 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Aug 31 16:09:58.084809 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:09:58.089393 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b8248384-5a55-499d-9887-bb49bc319ad6 tempest-TenantUsagesNegativeTestJSON-1309015286 tempest-TenantUsagesNegativeTestJSON-1309015286-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:09:58.093034 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b8248384-5a55-499d-9887-bb49bc319ad6 tempest-TenantUsagesNegativeTestJSON-1309015286 tempest-TenantUsagesNegativeTestJSON-1309015286-project-admin] 10.222.0.61 "GET /compute/v2.1/os-simple-tenant-usage/39d97c54db934c828f8e68cae296a5ac?start=2022-09-01T16%3A09%3A55.791984&end=2022-08-30T16%3A09%3A55.791984" status: 400 len: 111 microversion: 2.1 time: 0.041530 Aug 31 16:09:58.100497 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1562/3098] 10.222.0.61 () {58 vars in 1412 bytes} [Wed Aug 31 16:09:58 2022] GET /compute/v2.1/os-simple-tenant-usage/39d97c54db934c828f8e68cae296a5ac?start=2022-09-01T16%3A09%3A55.791984&end=2022-08-30T16%3A09%3A55.791984 => generated 111 bytes in 51 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:09:58.121625 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ede98b05-ca2d-4ed9-9320-c3818f4d091e tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:58.135941 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ede98b05-ca2d-4ed9-9320-c3818f4d091e tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] [instance: c393928f-2414-4093-9d72-93a21fc6c460] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:58.156077 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ede98b05-ca2d-4ed9-9320-c3818f4d091e tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:58.156908 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ede98b05-ca2d-4ed9-9320-c3818f4d091e tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:58.157449 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ede98b05-ca2d-4ed9-9320-c3818f4d091e tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:58.158692 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ede98b05-ca2d-4ed9-9320-c3818f4d091e tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:58.158819 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ede98b05-ca2d-4ed9-9320-c3818f4d091e tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:58.159350 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ede98b05-ca2d-4ed9-9320-c3818f4d091e tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:58.466106 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7a033dc5-e738-4197-a858-13dfbdd97bf4 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68db583fb8fd4e6090fb220eeaafdd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c965154856f84fecb30f49dfeac46fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:58.500319 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7a033dc5-e738-4197-a858-13dfbdd97bf4 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] 10.222.0.61 "GET /compute/v2.1/servers/33bb5423-4b3e-4030-a835-8ab823e2e00a" status: 200 len: 1323 microversion: 2.1 time: 0.528051 Aug 31 16:09:58.501232 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ede98b05-ca2d-4ed9-9320-c3818f4d091e tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b93395d63a4db895ff224a311940e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf281e8857247c6b9e60d4216741f89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:58.517000 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1537/3099] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:57 2022] GET /compute/v2.1/servers/33bb5423-4b3e-4030-a835-8ab823e2e00a => generated 1323 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:58.521415 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ede98b05-ca2d-4ed9-9320-c3818f4d091e tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] 10.222.0.61 "GET /compute/v2.1/servers/c393928f-2414-4093-9d72-93a21fc6c460" status: 200 len: 1512 microversion: 2.1 time: 0.417141 Aug 31 16:09:58.527142 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c0a99d95-fe01-470b-9a77-f1a656bcb8ee tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:58.528613 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c0a99d95-fe01-470b-9a77-f1a656bcb8ee tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] [instance: 0ac914d2-e9f7-4f2f-a01d-49674180d8db] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:58.537171 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1563/3100] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:58 2022] GET /compute/v2.1/servers/c393928f-2414-4093-9d72-93a21fc6c460 => generated 1512 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:58.540392 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c0a99d95-fe01-470b-9a77-f1a656bcb8ee tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:58.541608 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c0a99d95-fe01-470b-9a77-f1a656bcb8ee tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:58.542578 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c0a99d95-fe01-470b-9a77-f1a656bcb8ee tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:58.543841 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c0a99d95-fe01-470b-9a77-f1a656bcb8ee tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:58.544542 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c0a99d95-fe01-470b-9a77-f1a656bcb8ee tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:58.545480 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c0a99d95-fe01-470b-9a77-f1a656bcb8ee tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:58.562875 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8cd85f80-5fcd-4635-8358-26f5e2d9bf63 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:09:58.568858 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8cd85f80-5fcd-4635-8358-26f5e2d9bf63 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:58.584951 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8cd85f80-5fcd-4635-8358-26f5e2d9bf63 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:58.586133 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8cd85f80-5fcd-4635-8358-26f5e2d9bf63 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:58.588557 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8cd85f80-5fcd-4635-8358-26f5e2d9bf63 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:58.590896 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8cd85f80-5fcd-4635-8358-26f5e2d9bf63 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:58.592805 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8cd85f80-5fcd-4635-8358-26f5e2d9bf63 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:58.594014 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8cd85f80-5fcd-4635-8358-26f5e2d9bf63 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:58.657194 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-8cd85f80-5fcd-4635-8358-26f5e2d9bf63 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lazy-loading 'flavor' on Instance uuid 0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:09:58.786404 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c0a99d95-fe01-470b-9a77-f1a656bcb8ee tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c65ee5ffa9d74bfdacbea45f1564d19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55320a9c8f714bc0911ded3ab88ddf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:58.797316 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c0a99d95-fe01-470b-9a77-f1a656bcb8ee tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] 10.222.0.61 "GET /compute/v2.1/servers/0ac914d2-e9f7-4f2f-a01d-49674180d8db" status: 200 len: 1293 microversion: 2.1 time: 0.276951 Aug 31 16:09:58.798019 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1538/3101] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:58 2022] GET /compute/v2.1/servers/0ac914d2-e9f7-4f2f-a01d-49674180d8db => generated 1293 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:58.807450 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8cd85f80-5fcd-4635-8358-26f5e2d9bf63 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "POST /compute/v2.1/servers/0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c/action" status: 202 len: 0 microversion: 2.1 time: 0.268865 Aug 31 16:09:58.808359 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1564/3102] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:09:58 2022] POST /compute/v2.1/servers/0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c/action => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:09:58.813696 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4dfb6b2f-c48b-4215-9d99-d4c6d69ac5c3 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:58.815705 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4dfb6b2f-c48b-4215-9d99-d4c6d69ac5c3 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] [instance: e6064a64-eae1-400c-b60c-2189e025905f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:58.824655 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4dfb6b2f-c48b-4215-9d99-d4c6d69ac5c3 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:58.825164 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4dfb6b2f-c48b-4215-9d99-d4c6d69ac5c3 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:58.825617 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4dfb6b2f-c48b-4215-9d99-d4c6d69ac5c3 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:58.826343 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4dfb6b2f-c48b-4215-9d99-d4c6d69ac5c3 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:58.826846 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4dfb6b2f-c48b-4215-9d99-d4c6d69ac5c3 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:58.827287 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4dfb6b2f-c48b-4215-9d99-d4c6d69ac5c3 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:59.045728 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-4dfb6b2f-c48b-4215-9d99-d4c6d69ac5c3 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b93395d63a4db895ff224a311940e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf281e8857247c6b9e60d4216741f89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:59.047316 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9fbdf3d7-e897-4d3b-b3f5-8849fa452fd1 tempest-TenantUsagesNegativeTestJSON-595033849 tempest-TenantUsagesNegativeTestJSON-595033849-project] Calling method '.version_select at 0x7f5ae8f3da60>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:59.051571 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9fbdf3d7-e897-4d3b-b3f5-8849fa452fd1 tempest-TenantUsagesNegativeTestJSON-595033849 tempest-TenantUsagesNegativeTestJSON-595033849-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': 'fdd1ba8753894e2f93c15daa3f22de7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39d97c54db934c828f8e68cae296a5ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:59.054505 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9fbdf3d7-e897-4d3b-b3f5-8849fa452fd1 tempest-TenantUsagesNegativeTestJSON-595033849 tempest-TenantUsagesNegativeTestJSON-595033849-project] Request method failure captured: Aug 31 16:09:59.054505 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-30T16%3A09%3A55.791984&end=2022-09-01T16%3A09%3A55.791984&detailed=1 HTTP/1.1 Aug 31 16:09:59.054505 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:09:59.054505 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:09:59.054505 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:09:59.054505 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:09:59.054505 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:09:59.054505 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:09:59.054505 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:09:59.054505 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:09:59.054505 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4fSqZgsyMfGeAB37ERHVWhbzMiwYK7kRt5Lq74tJFktM7Mbg27v-5tsPhUOBuOB1y9IyO3tBRSFeebYc7IfPS47Rksi66eBjnikTRvBTdVktnG6vsOLSabsXFwWpmV9xFlcbR1VBl87VMslGLZTQ7C588yGrhByYQvgC-Zcu-35v3I Aug 31 16:09:59.054505 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:09:59.054505 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:09:59.054505 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:09:59.054505 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:09:59.054505 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:09:59.054505 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:09:59.054505 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 39d97c54db934c828f8e68cae296a5ac Aug 31 16:09:59.054505 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-595033849 Aug 31 16:09:59.054505 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:09:59.054505 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:09:59.054505 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/39d97c54db934c828f8e68cae296a5ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/39d97c54db934c828f8e68cae296a5ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_39d97c54db934c828f8e68cae296a5ac", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/39d97c54db934c828f8e68cae296a5ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:09:59.054505 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-595033849 Aug 31 16:09:59.054505 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 39d97c54db934c828f8e68cae296a5ac Aug 31 16:09:59.054505 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-595033849 Aug 31 16:09:59.054505 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-TenantUsagesNegativeTestJSON-595033849-project Aug 31 16:09:59.054505 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:09:59.054505 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:09:59.054505 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: fdd1ba8753894e2f93c15daa3f22de7d Aug 31 16:09:59.054505 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-595033849-project Aug 31 16:09:59.054505 n-d-850499-9 devstack@n-api.service[122257]: method: Aug 31 16:09:59.054505 n-d-850499-9 devstack@n-api.service[122257]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 31 16:09:59.054505 n-d-850499-9 devstack@n-api.service[122257]: action_args: {} Aug 31 16:09:59.054505 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:09:59.054505 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:09:59.054505 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:09:59.054505 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:09:59.054505 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:09:59.054505 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:09:59.054505 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:09:59.054505 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:09:59.054505 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 31 16:09:59.054505 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:09:59.054505 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:09:59.054505 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:09:59.054505 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Aug 31 16:09:59.054505 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self._index(req) Aug 31 16:09:59.054505 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Aug 31 16:09:59.054505 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Aug 31 16:09:59.054505 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 31 16:09:59.054505 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 31 16:09:59.054505 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 31 16:09:59.054505 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 31 16:09:59.054505 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 16:09:59.054505 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 31 16:09:59.054505 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 16:09:59.054505 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise self.value Aug 31 16:09:59.054505 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 31 16:09:59.054505 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 31 16:09:59.054505 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 31 16:09:59.054505 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 31 16:09:59.054505 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 31 16:09:59.054505 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 31 16:09:59.065164 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 31 16:09:59.065164 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:09:59.065164 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:09:59.065164 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:09:59.065164 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:09:59.065164 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:09:59.065164 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:09:59.065164 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 31 16:09:59.065164 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 31 16:09:59.065164 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 31 16:09:59.065164 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:09:59.065164 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9fbdf3d7-e897-4d3b-b3f5-8849fa452fd1 tempest-TenantUsagesNegativeTestJSON-595033849 tempest-TenantUsagesNegativeTestJSON-595033849-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:09:59.065164 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9fbdf3d7-e897-4d3b-b3f5-8849fa452fd1 tempest-TenantUsagesNegativeTestJSON-595033849 tempest-TenantUsagesNegativeTestJSON-595033849-project] 10.222.0.61 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-30T16%3A09%3A55.791984&end=2022-09-01T16%3A09%3A55.791984&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.258626 Aug 31 16:09:59.065164 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1539/3103] 10.222.0.61 () {58 vars in 1335 bytes} [Wed Aug 31 16:09:58 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-30T16%3A09%3A55.791984&end=2022-09-01T16%3A09%3A55.791984&detailed=1 => generated 123 bytes in 260 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:09:59.071564 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3c39262b-ba00-46ef-8d2a-28604a9aa700 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:59.071750 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4dfb6b2f-c48b-4215-9d99-d4c6d69ac5c3 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] 10.222.0.61 "GET /compute/v2.1/servers/e6064a64-eae1-400c-b60c-2189e025905f" status: 200 len: 1512 microversion: 2.1 time: 0.259067 Aug 31 16:09:59.071750 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1565/3104] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:58 2022] GET /compute/v2.1/servers/e6064a64-eae1-400c-b60c-2189e025905f => generated 1512 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:59.073738 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3c39262b-ba00-46ef-8d2a-28604a9aa700 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:59.086856 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4f1ee91b-9769-41e8-9373-707eeb7c7ee8 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:59.088598 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4f1ee91b-9769-41e8-9373-707eeb7c7ee8 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] [instance: eed024b5-986b-40fa-a686-ceab563a6131] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:59.099056 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3c39262b-ba00-46ef-8d2a-28604a9aa700 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:59.099940 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3c39262b-ba00-46ef-8d2a-28604a9aa700 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:59.100675 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3c39262b-ba00-46ef-8d2a-28604a9aa700 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:59.100911 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4f1ee91b-9769-41e8-9373-707eeb7c7ee8 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:59.101979 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3c39262b-ba00-46ef-8d2a-28604a9aa700 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:59.102887 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4f1ee91b-9769-41e8-9373-707eeb7c7ee8 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:59.103105 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3c39262b-ba00-46ef-8d2a-28604a9aa700 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:59.103887 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4f1ee91b-9769-41e8-9373-707eeb7c7ee8 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:59.104358 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3c39262b-ba00-46ef-8d2a-28604a9aa700 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:59.105441 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4f1ee91b-9769-41e8-9373-707eeb7c7ee8 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:59.106388 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4f1ee91b-9769-41e8-9373-707eeb7c7ee8 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:59.107138 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4f1ee91b-9769-41e8-9373-707eeb7c7ee8 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:59.293662 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-4f1ee91b-9769-41e8-9373-707eeb7c7ee8 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab268a4d607497da5476256055bb07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14140e7303046f1ada446437826f742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:59.307296 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4f1ee91b-9769-41e8-9373-707eeb7c7ee8 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] 10.222.0.61 "GET /compute/v2.1/servers/eed024b5-986b-40fa-a686-ceab563a6131" status: 200 len: 1292 microversion: 2.1 time: 0.234156 Aug 31 16:09:59.308207 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1566/3105] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:59 2022] GET /compute/v2.1/servers/eed024b5-986b-40fa-a686-ceab563a6131 => generated 1292 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:59.342766 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-42754041-aed2-4f38-9454-d8625b4c55a4 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:59.355203 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-42754041-aed2-4f38-9454-d8625b4c55a4 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '41b93395d63a4db895ff224a311940e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf281e8857247c6b9e60d4216741f89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:59.357765 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-42754041-aed2-4f38-9454-d8625b4c55a4 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '1cf281e8857247c6b9e60d4216741f89'} {{(pid=122256) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 16:09:59.390033 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42754041-aed2-4f38-9454-d8625b4c55a4 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:59.390640 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42754041-aed2-4f38-9454-d8625b4c55a4 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:59.391166 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42754041-aed2-4f38-9454-d8625b4c55a4 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:59.397489 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42754041-aed2-4f38-9454-d8625b4c55a4 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:59.398233 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42754041-aed2-4f38-9454-d8625b4c55a4 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:59.399731 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42754041-aed2-4f38-9454-d8625b4c55a4 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:59.417687 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3c39262b-ba00-46ef-8d2a-28604a9aa700 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:59.430388 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3c39262b-ba00-46ef-8d2a-28604a9aa700 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c" status: 200 len: 1510 microversion: 2.1 time: 0.370404 Aug 31 16:09:59.431161 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1540/3106] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:59 2022] GET /compute/v2.1/servers/0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c => generated 1510 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:59.463894 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-cff6b489-1623-482b-b000-5fb4854f1d26 req-bb780745-3fd2-4dc3-bcd5-c20d061128c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ac914d2-e9f7-4f2f-a01d-49674180d8db", "tag": "2c7e9f34-2b8a-470a-af28-22027bffc1a7"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:09:59.485425 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-cff6b489-1623-482b-b000-5fb4854f1d26 req-bb780745-3fd2-4dc3-bcd5-c20d061128c7 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:59.487914 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-cff6b489-1623-482b-b000-5fb4854f1d26 req-bb780745-3fd2-4dc3-bcd5-c20d061128c7 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:59.489332 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-cff6b489-1623-482b-b000-5fb4854f1d26 req-bb780745-3fd2-4dc3-bcd5-c20d061128c7 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:59.514893 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-cff6b489-1623-482b-b000-5fb4854f1d26 req-bb780745-3fd2-4dc3-bcd5-c20d061128c7 service nova] Creating event network-changed:2c7e9f34-2b8a-470a-af28-22027bffc1a7 for instance 0ac914d2-e9f7-4f2f-a01d-49674180d8db on n-h2-850499-9 Aug 31 16:09:59.531952 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-cff6b489-1623-482b-b000-5fb4854f1d26 req-bb780745-3fd2-4dc3-bcd5-c20d061128c7 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098276 Aug 31 16:09:59.533289 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1541/3107] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:09:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:09:59.553337 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-50fe1e6c-4f1f-444e-b9a2-e3d9f5ff246c tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:59.554835 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-50fe1e6c-4f1f-444e-b9a2-e3d9f5ff246c tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] [instance: 33bb5423-4b3e-4030-a835-8ab823e2e00a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:59.568689 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-50fe1e6c-4f1f-444e-b9a2-e3d9f5ff246c tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:59.569871 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-50fe1e6c-4f1f-444e-b9a2-e3d9f5ff246c tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:59.571717 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-50fe1e6c-4f1f-444e-b9a2-e3d9f5ff246c tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:59.587222 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-50fe1e6c-4f1f-444e-b9a2-e3d9f5ff246c tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:59.587931 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-50fe1e6c-4f1f-444e-b9a2-e3d9f5ff246c tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:59.590280 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-50fe1e6c-4f1f-444e-b9a2-e3d9f5ff246c tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:59.691416 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.multi_cell_list [None req-42754041-aed2-4f38-9454-d8625b4c55a4 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122256) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 31 16:09:59.886258 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-42754041-aed2-4f38-9454-d8625b4c55a4 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b93395d63a4db895ff224a311940e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf281e8857247c6b9e60d4216741f89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:59.887627 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-50fe1e6c-4f1f-444e-b9a2-e3d9f5ff246c tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68db583fb8fd4e6090fb220eeaafdd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c965154856f84fecb30f49dfeac46fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:59.897649 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42754041-aed2-4f38-9454-d8625b4c55a4 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:59.898624 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42754041-aed2-4f38-9454-d8625b4c55a4 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:59.899147 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42754041-aed2-4f38-9454-d8625b4c55a4 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:59.907319 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-50fe1e6c-4f1f-444e-b9a2-e3d9f5ff246c tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] 10.222.0.61 "GET /compute/v2.1/servers/33bb5423-4b3e-4030-a835-8ab823e2e00a" status: 200 len: 1323 microversion: 2.1 time: 0.371671 Aug 31 16:09:59.908238 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1542/3108] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:59 2022] GET /compute/v2.1/servers/33bb5423-4b3e-4030-a835-8ab823e2e00a => generated 1323 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:59.918497 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-19257d78-9d3a-4ebe-b186-aceb3801744e tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:59.926574 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-19257d78-9d3a-4ebe-b186-aceb3801744e tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] [instance: 0ac914d2-e9f7-4f2f-a01d-49674180d8db] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:59.948407 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-19257d78-9d3a-4ebe-b186-aceb3801744e tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:59.953893 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-19257d78-9d3a-4ebe-b186-aceb3801744e tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:59.954854 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-19257d78-9d3a-4ebe-b186-aceb3801744e tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:59.959790 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-19257d78-9d3a-4ebe-b186-aceb3801744e tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:59.961666 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-19257d78-9d3a-4ebe-b186-aceb3801744e tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:59.967171 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-19257d78-9d3a-4ebe-b186-aceb3801744e tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:59.992998 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=100 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:10:00.272863 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-42754041-aed2-4f38-9454-d8625b4c55a4 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] 10.222.0.61 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1515 microversion: 2.1 time: 0.955559 Aug 31 16:10:00.276326 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1567/3109] 10.222.0.61 () {58 vars in 1167 bytes} [Wed Aug 31 16:09:59 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1515 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:00.308301 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-19257d78-9d3a-4ebe-b186-aceb3801744e tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c65ee5ffa9d74bfdacbea45f1564d19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55320a9c8f714bc0911ded3ab88ddf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:00.325423 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-19257d78-9d3a-4ebe-b186-aceb3801744e tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] 10.222.0.61 "GET /compute/v2.1/servers/0ac914d2-e9f7-4f2f-a01d-49674180d8db" status: 200 len: 1293 microversion: 2.1 time: 0.414780 Aug 31 16:10:00.327826 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1543/3110] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:59 2022] GET /compute/v2.1/servers/0ac914d2-e9f7-4f2f-a01d-49674180d8db => generated 1293 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:00.339410 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-784a05e5-48f6-4f52-87e0-f016d4b6eebd tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:00.340884 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-784a05e5-48f6-4f52-87e0-f016d4b6eebd tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] [instance: eed024b5-986b-40fa-a686-ceab563a6131] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:00.349157 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-af11deab-03d7-4706-9e83-6d13fc4066be tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:00.355694 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-784a05e5-48f6-4f52-87e0-f016d4b6eebd tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:00.356895 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-784a05e5-48f6-4f52-87e0-f016d4b6eebd tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:00.357928 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-784a05e5-48f6-4f52-87e0-f016d4b6eebd tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:00.360299 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-784a05e5-48f6-4f52-87e0-f016d4b6eebd tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:00.361465 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-784a05e5-48f6-4f52-87e0-f016d4b6eebd tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:00.362502 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-784a05e5-48f6-4f52-87e0-f016d4b6eebd tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:00.382016 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-af11deab-03d7-4706-9e83-6d13fc4066be tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '41b93395d63a4db895ff224a311940e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf281e8857247c6b9e60d4216741f89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:00.383845 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-af11deab-03d7-4706-9e83-6d13fc4066be tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-437544270', 'deleted': False, 'project_id': '1cf281e8857247c6b9e60d4216741f89'} {{(pid=122256) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 16:10:00.400629 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-af11deab-03d7-4706-9e83-6d13fc4066be tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:00.401131 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-af11deab-03d7-4706-9e83-6d13fc4066be tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:00.401574 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-af11deab-03d7-4706-9e83-6d13fc4066be tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:00.402330 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-af11deab-03d7-4706-9e83-6d13fc4066be tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:00.402787 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-af11deab-03d7-4706-9e83-6d13fc4066be tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:00.403222 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-af11deab-03d7-4706-9e83-6d13fc4066be tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:00.611838 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.multi_cell_list [None req-af11deab-03d7-4706-9e83-6d13fc4066be tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122256) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 31 16:10:00.693200 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-784a05e5-48f6-4f52-87e0-f016d4b6eebd tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab268a4d607497da5476256055bb07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14140e7303046f1ada446437826f742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:00.715289 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-784a05e5-48f6-4f52-87e0-f016d4b6eebd tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] 10.222.0.61 "GET /compute/v2.1/servers/eed024b5-986b-40fa-a686-ceab563a6131" status: 200 len: 1292 microversion: 2.1 time: 0.384229 Aug 31 16:10:00.720154 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1544/3111] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:00 2022] GET /compute/v2.1/servers/eed024b5-986b-40fa-a686-ceab563a6131 => generated 1292 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:00.732517 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-72b29697-6bf3-4b70-8e80-a356d12574a2 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:00.750493 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-72b29697-6bf3-4b70-8e80-a356d12574a2 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:00.767601 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-72b29697-6bf3-4b70-8e80-a356d12574a2 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:00.777141 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-72b29697-6bf3-4b70-8e80-a356d12574a2 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:00.778591 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-72b29697-6bf3-4b70-8e80-a356d12574a2 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:00.780359 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-72b29697-6bf3-4b70-8e80-a356d12574a2 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:00.781838 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-72b29697-6bf3-4b70-8e80-a356d12574a2 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:00.784252 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-72b29697-6bf3-4b70-8e80-a356d12574a2 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:00.986263 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-af11deab-03d7-4706-9e83-6d13fc4066be tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b93395d63a4db895ff224a311940e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf281e8857247c6b9e60d4216741f89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:00.998437 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-af11deab-03d7-4706-9e83-6d13fc4066be tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:01.000494 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-af11deab-03d7-4706-9e83-6d13fc4066be tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:01.000997 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-af11deab-03d7-4706-9e83-6d13fc4066be tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:01.189904 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-72b29697-6bf3-4b70-8e80-a356d12574a2 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:01.203256 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-72b29697-6bf3-4b70-8e80-a356d12574a2 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c" status: 200 len: 1510 microversion: 2.1 time: 0.479259 Aug 31 16:10:01.226043 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1545/3112] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:00 2022] GET /compute/v2.1/servers/0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c => generated 1510 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:01.238273 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-65bbacc7-cef0-4a8f-a838-a138ea5596f3 req-7efe6365-37f2-4637-8ed1-7bec84f7287f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b68db583-0d09-4485-8b26-ff5c02e23c01", "name": "network-vif-plugged", "status": "completed", "tag": "a44cba0a-b891-4f5c-88cb-0f6b3c9d2376"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:10:01.253995 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-af11deab-03d7-4706-9e83-6d13fc4066be tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] 10.222.0.61 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-437544270" status: 200 len: 1515 microversion: 2.1 time: 0.936758 Aug 31 16:10:01.254665 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1568/3113] 10.222.0.61 () {58 vars in 1261 bytes} [Wed Aug 31 16:10:00 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-437544270 => generated 1515 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:01.256612 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-65bbacc7-cef0-4a8f-a838-a138ea5596f3 req-7efe6365-37f2-4637-8ed1-7bec84f7287f service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:01.257117 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-65bbacc7-cef0-4a8f-a838-a138ea5596f3 req-7efe6365-37f2-4637-8ed1-7bec84f7287f service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:01.257561 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-65bbacc7-cef0-4a8f-a838-a138ea5596f3 req-7efe6365-37f2-4637-8ed1-7bec84f7287f service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:01.268068 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-db463198-9ae3-4ba6-8fb0-3288e92b4cfe tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:01.268624 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-db463198-9ae3-4ba6-8fb0-3288e92b4cfe tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] [instance: 33bb5423-4b3e-4030-a835-8ab823e2e00a] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:01.275393 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-65bbacc7-cef0-4a8f-a838-a138ea5596f3 req-7efe6365-37f2-4637-8ed1-7bec84f7287f service nova] Creating event network-vif-plugged:a44cba0a-b891-4f5c-88cb-0f6b3c9d2376 for instance b68db583-0d09-4485-8b26-ff5c02e23c01 on n-h1-850499-9 Aug 31 16:10:01.281591 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-db463198-9ae3-4ba6-8fb0-3288e92b4cfe tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:01.282103 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-db463198-9ae3-4ba6-8fb0-3288e92b4cfe tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:01.282733 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-db463198-9ae3-4ba6-8fb0-3288e92b4cfe tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:01.283491 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-db463198-9ae3-4ba6-8fb0-3288e92b4cfe tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:01.289818 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-65bbacc7-cef0-4a8f-a838-a138ea5596f3 req-7efe6365-37f2-4637-8ed1-7bec84f7287f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060369 Aug 31 16:10:01.290449 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-db463198-9ae3-4ba6-8fb0-3288e92b4cfe tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:01.290983 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1546/3114] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:10:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:10:01.291119 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-db463198-9ae3-4ba6-8fb0-3288e92b4cfe tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:01.302376 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-004c8c45-eaf2-474c-88a4-00f7644ea803 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:01.309779 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-004c8c45-eaf2-474c-88a4-00f7644ea803 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '41b93395d63a4db895ff224a311940e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf281e8857247c6b9e60d4216741f89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:01.310882 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-004c8c45-eaf2-474c-88a4-00f7644ea803 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '1cf281e8857247c6b9e60d4216741f89'} {{(pid=122257) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 16:10:01.318389 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-004c8c45-eaf2-474c-88a4-00f7644ea803 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:01.318897 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-004c8c45-eaf2-474c-88a4-00f7644ea803 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:01.319342 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-004c8c45-eaf2-474c-88a4-00f7644ea803 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:01.321092 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-004c8c45-eaf2-474c-88a4-00f7644ea803 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:01.321828 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-004c8c45-eaf2-474c-88a4-00f7644ea803 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:01.322496 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-004c8c45-eaf2-474c-88a4-00f7644ea803 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:01.444773 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.multi_cell_list [None req-004c8c45-eaf2-474c-88a4-00f7644ea803 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122257) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 31 16:10:01.552656 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-004c8c45-eaf2-474c-88a4-00f7644ea803 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b93395d63a4db895ff224a311940e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf281e8857247c6b9e60d4216741f89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:01.568687 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-004c8c45-eaf2-474c-88a4-00f7644ea803 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:01.570247 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-004c8c45-eaf2-474c-88a4-00f7644ea803 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:01.571139 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-004c8c45-eaf2-474c-88a4-00f7644ea803 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:01.874798 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-db463198-9ae3-4ba6-8fb0-3288e92b4cfe tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68db583fb8fd4e6090fb220eeaafdd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c965154856f84fecb30f49dfeac46fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:01.888384 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-db463198-9ae3-4ba6-8fb0-3288e92b4cfe tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] 10.222.0.61 "GET /compute/v2.1/servers/33bb5423-4b3e-4030-a835-8ab823e2e00a" status: 200 len: 1516 microversion: 2.1 time: 0.632767 Aug 31 16:10:01.889180 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1569/3115] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:01 2022] GET /compute/v2.1/servers/33bb5423-4b3e-4030-a835-8ab823e2e00a => generated 1516 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:01.896697 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f437843f-21b8-4e0c-b7fc-bf0305dd9077 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:01.897678 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f437843f-21b8-4e0c-b7fc-bf0305dd9077 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] [instance: 0ac914d2-e9f7-4f2f-a01d-49674180d8db] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:01.907355 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f437843f-21b8-4e0c-b7fc-bf0305dd9077 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:01.908250 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f437843f-21b8-4e0c-b7fc-bf0305dd9077 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:01.908809 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f437843f-21b8-4e0c-b7fc-bf0305dd9077 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:01.909746 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f437843f-21b8-4e0c-b7fc-bf0305dd9077 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:01.910308 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f437843f-21b8-4e0c-b7fc-bf0305dd9077 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:01.911061 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f437843f-21b8-4e0c-b7fc-bf0305dd9077 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:01.928107 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-004c8c45-eaf2-474c-88a4-00f7644ea803 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] 10.222.0.61 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4519 microversion: 2.1 time: 0.635136 Aug 31 16:10:01.934090 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1547/3116] 10.222.0.61 () {58 vars in 1173 bytes} [Wed Aug 31 16:10:01 2022] GET /compute/v2.1/servers/detail?status=active => generated 4519 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:01.952724 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ee6189a9-8f0d-4eaa-b30c-61899a5d383b tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:01.953962 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ee6189a9-8f0d-4eaa-b30c-61899a5d383b tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] [instance: eed024b5-986b-40fa-a686-ceab563a6131] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:01.964627 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ee6189a9-8f0d-4eaa-b30c-61899a5d383b tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:01.965130 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ee6189a9-8f0d-4eaa-b30c-61899a5d383b tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:01.965583 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ee6189a9-8f0d-4eaa-b30c-61899a5d383b tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:01.966489 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ee6189a9-8f0d-4eaa-b30c-61899a5d383b tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:01.967387 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ee6189a9-8f0d-4eaa-b30c-61899a5d383b tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:01.967999 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ee6189a9-8f0d-4eaa-b30c-61899a5d383b tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:02.081372 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ee6189a9-8f0d-4eaa-b30c-61899a5d383b tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab268a4d607497da5476256055bb07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14140e7303046f1ada446437826f742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:02.094820 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ee6189a9-8f0d-4eaa-b30c-61899a5d383b tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] 10.222.0.61 "GET /compute/v2.1/servers/eed024b5-986b-40fa-a686-ceab563a6131" status: 200 len: 1298 microversion: 2.1 time: 0.158527 Aug 31 16:10:02.110404 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1548/3117] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:01 2022] GET /compute/v2.1/servers/eed024b5-986b-40fa-a686-ceab563a6131 => generated 1298 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:02.117670 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-59ccc96f-e9b8-4cb5-bfea-170cd5d0aaac tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:02.118820 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-59ccc96f-e9b8-4cb5-bfea-170cd5d0aaac tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] [instance: 29a78fc3-93ff-4f42-8c9f-79dfdc5229c6] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:02.127712 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-59ccc96f-e9b8-4cb5-bfea-170cd5d0aaac tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:02.128755 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-59ccc96f-e9b8-4cb5-bfea-170cd5d0aaac tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:02.129428 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-59ccc96f-e9b8-4cb5-bfea-170cd5d0aaac tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:02.134929 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-59ccc96f-e9b8-4cb5-bfea-170cd5d0aaac tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:02.135628 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-59ccc96f-e9b8-4cb5-bfea-170cd5d0aaac tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:02.136201 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-59ccc96f-e9b8-4cb5-bfea-170cd5d0aaac tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:02.164747 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f437843f-21b8-4e0c-b7fc-bf0305dd9077 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c65ee5ffa9d74bfdacbea45f1564d19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55320a9c8f714bc0911ded3ab88ddf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:02.173462 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f437843f-21b8-4e0c-b7fc-bf0305dd9077 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] 10.222.0.61 "GET /compute/v2.1/servers/0ac914d2-e9f7-4f2f-a01d-49674180d8db" status: 200 len: 1293 microversion: 2.1 time: 0.282963 Aug 31 16:10:02.174209 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1570/3118] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:01 2022] GET /compute/v2.1/servers/0ac914d2-e9f7-4f2f-a01d-49674180d8db => generated 1293 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:02.179233 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e7ab7bc6-f22f-4eaa-b22d-a2a97d41bb3e tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:02.184744 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e7ab7bc6-f22f-4eaa-b22d-a2a97d41bb3e tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '41b93395d63a4db895ff224a311940e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf281e8857247c6b9e60d4216741f89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:02.185383 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.compute.servers [None req-e7ab7bc6-f22f-4eaa-b22d-a2a97d41bb3e tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Removing options 'limit' from query {{(pid=122256) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 31 16:10:02.186136 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e7ab7bc6-f22f-4eaa-b22d-a2a97d41bb3e tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Searching by: {'deleted': False, 'project_id': '1cf281e8857247c6b9e60d4216741f89'} {{(pid=122256) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 16:10:02.191425 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e7ab7bc6-f22f-4eaa-b22d-a2a97d41bb3e tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:02.191944 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e7ab7bc6-f22f-4eaa-b22d-a2a97d41bb3e tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:02.192476 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e7ab7bc6-f22f-4eaa-b22d-a2a97d41bb3e tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:02.193199 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e7ab7bc6-f22f-4eaa-b22d-a2a97d41bb3e tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:02.193657 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e7ab7bc6-f22f-4eaa-b22d-a2a97d41bb3e tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:02.194327 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e7ab7bc6-f22f-4eaa-b22d-a2a97d41bb3e tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:02.235937 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:10:02.255613 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e7ab7bc6-f22f-4eaa-b22d-a2a97d41bb3e tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b93395d63a4db895ff224a311940e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf281e8857247c6b9e60d4216741f89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:02.266987 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e7ab7bc6-f22f-4eaa-b22d-a2a97d41bb3e tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:02.267973 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e7ab7bc6-f22f-4eaa-b22d-a2a97d41bb3e tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:02.268743 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e7ab7bc6-f22f-4eaa-b22d-a2a97d41bb3e tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:02.429230 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-59ccc96f-e9b8-4cb5-bfea-170cd5d0aaac tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68db583fb8fd4e6090fb220eeaafdd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c965154856f84fecb30f49dfeac46fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:02.464909 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-59ccc96f-e9b8-4cb5-bfea-170cd5d0aaac tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] 10.222.0.61 "GET /compute/v2.1/servers/29a78fc3-93ff-4f42-8c9f-79dfdc5229c6" status: 200 len: 1323 microversion: 2.1 time: 0.344621 Aug 31 16:10:02.467760 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1549/3119] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:02 2022] GET /compute/v2.1/servers/29a78fc3-93ff-4f42-8c9f-79dfdc5229c6 => generated 1323 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:02.485362 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-dd133723-9dd6-4722-9e61-f98b97971fb3 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:02.486134 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-dd133723-9dd6-4722-9e61-f98b97971fb3 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:02.501791 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dd133723-9dd6-4722-9e61-f98b97971fb3 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:02.502318 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dd133723-9dd6-4722-9e61-f98b97971fb3 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:02.502775 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dd133723-9dd6-4722-9e61-f98b97971fb3 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:02.514881 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dd133723-9dd6-4722-9e61-f98b97971fb3 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:02.515938 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dd133723-9dd6-4722-9e61-f98b97971fb3 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:02.519153 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dd133723-9dd6-4722-9e61-f98b97971fb3 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:02.537073 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e7ab7bc6-f22f-4eaa-b22d-a2a97d41bb3e tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] 10.222.0.61 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1661 microversion: 2.1 time: 0.361816 Aug 31 16:10:02.537828 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1571/3120] 10.222.0.61 () {58 vars in 1161 bytes} [Wed Aug 31 16:10:02 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1661 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:02.568402 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-46df2f36-64b0-4743-92fd-c6c3430d2e8e tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:02.578469 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-46df2f36-64b0-4743-92fd-c6c3430d2e8e tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '41b93395d63a4db895ff224a311940e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf281e8857247c6b9e60d4216741f89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:02.580768 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-46df2f36-64b0-4743-92fd-c6c3430d2e8e tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '1cf281e8857247c6b9e60d4216741f89'} {{(pid=122256) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 16:10:02.590974 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-46df2f36-64b0-4743-92fd-c6c3430d2e8e tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:02.592268 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-46df2f36-64b0-4743-92fd-c6c3430d2e8e tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:02.593153 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-46df2f36-64b0-4743-92fd-c6c3430d2e8e tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:02.594099 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-46df2f36-64b0-4743-92fd-c6c3430d2e8e tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:02.594729 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-46df2f36-64b0-4743-92fd-c6c3430d2e8e tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:02.595409 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-46df2f36-64b0-4743-92fd-c6c3430d2e8e tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:02.715199 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.multi_cell_list [None req-46df2f36-64b0-4743-92fd-c6c3430d2e8e tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122256) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 31 16:10:02.819340 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-46df2f36-64b0-4743-92fd-c6c3430d2e8e tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] 10.222.0.61 "GET /compute/v2.1/servers?status=active" status: 200 len: 1010 microversion: 2.1 time: 0.256255 Aug 31 16:10:02.827201 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-dd133723-9dd6-4722-9e61-f98b97971fb3 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:02.829501 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1572/3121] 10.222.0.61 () {58 vars in 1152 bytes} [Wed Aug 31 16:10:02 2022] GET /compute/v2.1/servers?status=active => generated 1010 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:02.834798 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-33144ce0-ac94-46bc-82e6-889e4c5a87ee tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:02.844376 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-33144ce0-ac94-46bc-82e6-889e4c5a87ee tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '41b93395d63a4db895ff224a311940e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf281e8857247c6b9e60d4216741f89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:02.844990 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.compute.servers [None req-33144ce0-ac94-46bc-82e6-889e4c5a87ee tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Removing options 'limit' from query {{(pid=122256) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 31 16:10:02.845723 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-33144ce0-ac94-46bc-82e6-889e4c5a87ee tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Searching by: {'deleted': False, 'project_id': '1cf281e8857247c6b9e60d4216741f89'} {{(pid=122256) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 16:10:02.853856 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-33144ce0-ac94-46bc-82e6-889e4c5a87ee tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:02.855176 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-33144ce0-ac94-46bc-82e6-889e4c5a87ee tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:02.855176 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-33144ce0-ac94-46bc-82e6-889e4c5a87ee tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:02.855609 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-33144ce0-ac94-46bc-82e6-889e4c5a87ee tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:02.856085 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-33144ce0-ac94-46bc-82e6-889e4c5a87ee tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:02.856276 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-dd133723-9dd6-4722-9e61-f98b97971fb3 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c" status: 200 len: 1510 microversion: 2.1 time: 0.387246 Aug 31 16:10:02.856595 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-33144ce0-ac94-46bc-82e6-889e4c5a87ee tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:02.856776 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1550/3122] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:02 2022] GET /compute/v2.1/servers/0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c => generated 1510 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:02.910071 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.multi_cell_list [None req-33144ce0-ac94-46bc-82e6-889e4c5a87ee tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122256) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 31 16:10:02.979840 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-33144ce0-ac94-46bc-82e6-889e4c5a87ee tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] 10.222.0.61 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1010 microversion: 2.1 time: 0.148814 Aug 31 16:10:02.988298 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1573/3123] 10.222.0.61 () {58 vars in 1150 bytes} [Wed Aug 31 16:10:02 2022] GET /compute/v2.1/servers?limit=100000 => generated 1010 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:02.995390 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8ac35ab2-aeaa-4598-b529-abe54ed9fac4 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:03.002438 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8ac35ab2-aeaa-4598-b529-abe54ed9fac4 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '41b93395d63a4db895ff224a311940e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf281e8857247c6b9e60d4216741f89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:03.003455 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8ac35ab2-aeaa-4598-b529-abe54ed9fac4 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Searching by: {'deleted': False, 'project_id': '1cf281e8857247c6b9e60d4216741f89'} {{(pid=122257) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 16:10:03.012749 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8ac35ab2-aeaa-4598-b529-abe54ed9fac4 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:03.013664 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8ac35ab2-aeaa-4598-b529-abe54ed9fac4 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:03.014316 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8ac35ab2-aeaa-4598-b529-abe54ed9fac4 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:03.015575 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8ac35ab2-aeaa-4598-b529-abe54ed9fac4 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:03.016372 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8ac35ab2-aeaa-4598-b529-abe54ed9fac4 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:03.017150 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8ac35ab2-aeaa-4598-b529-abe54ed9fac4 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:03.053353 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.multi_cell_list [None req-8ac35ab2-aeaa-4598-b529-abe54ed9fac4 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122257) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 31 16:10:03.089866 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8ac35ab2-aeaa-4598-b529-abe54ed9fac4 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] 10.222.0.61 "GET /compute/v2.1/servers" status: 200 len: 1010 microversion: 2.1 time: 0.099777 Aug 31 16:10:03.098641 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1551/3124] 10.222.0.61 () {58 vars in 1125 bytes} [Wed Aug 31 16:10:02 2022] GET /compute/v2.1/servers => generated 1010 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:03.108097 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e42a8def-06b7-44fb-88ec-51c6c1586146 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:03.115071 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e42a8def-06b7-44fb-88ec-51c6c1586146 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '41b93395d63a4db895ff224a311940e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf281e8857247c6b9e60d4216741f89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:03.115945 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e42a8def-06b7-44fb-88ec-51c6c1586146 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '1cf281e8857247c6b9e60d4216741f89'} {{(pid=122256) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 16:10:03.122083 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-bb78bab8-ff1f-4792-a2a2-737fd9cb2e88 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:03.123339 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-bb78bab8-ff1f-4792-a2a2-737fd9cb2e88 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] [instance: eed024b5-986b-40fa-a686-ceab563a6131] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:03.130963 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e42a8def-06b7-44fb-88ec-51c6c1586146 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:03.131748 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e42a8def-06b7-44fb-88ec-51c6c1586146 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:03.132414 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e42a8def-06b7-44fb-88ec-51c6c1586146 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:03.133515 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bb78bab8-ff1f-4792-a2a2-737fd9cb2e88 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:03.133779 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e42a8def-06b7-44fb-88ec-51c6c1586146 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:03.134041 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bb78bab8-ff1f-4792-a2a2-737fd9cb2e88 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:03.134684 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bb78bab8-ff1f-4792-a2a2-737fd9cb2e88 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:03.135135 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e42a8def-06b7-44fb-88ec-51c6c1586146 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:03.135947 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e42a8def-06b7-44fb-88ec-51c6c1586146 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:03.138122 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bb78bab8-ff1f-4792-a2a2-737fd9cb2e88 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:03.139925 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bb78bab8-ff1f-4792-a2a2-737fd9cb2e88 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:03.141277 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bb78bab8-ff1f-4792-a2a2-737fd9cb2e88 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:03.279763 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.multi_cell_list [None req-e42a8def-06b7-44fb-88ec-51c6c1586146 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122256) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 31 16:10:03.390907 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e42a8def-06b7-44fb-88ec-51c6c1586146 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] 10.222.0.61 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 345 microversion: 2.1 time: 0.290339 Aug 31 16:10:03.392114 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1574/3125] 10.222.0.61 () {58 vars in 1146 bytes} [Wed Aug 31 16:10:03 2022] GET /compute/v2.1/servers?flavor=451 => generated 345 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:10:03.400795 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8bddb73e-9ff8-49ea-b817-e440e7420c1c tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:03.402786 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8bddb73e-9ff8-49ea-b817-e440e7420c1c tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] [instance: 0ac914d2-e9f7-4f2f-a01d-49674180d8db] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:03.412523 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8bddb73e-9ff8-49ea-b817-e440e7420c1c tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:03.413294 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8bddb73e-9ff8-49ea-b817-e440e7420c1c tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:03.414682 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8bddb73e-9ff8-49ea-b817-e440e7420c1c tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:03.418678 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8bddb73e-9ff8-49ea-b817-e440e7420c1c tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:03.418678 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8bddb73e-9ff8-49ea-b817-e440e7420c1c tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:03.419050 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8bddb73e-9ff8-49ea-b817-e440e7420c1c tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:03.673466 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-bb78bab8-ff1f-4792-a2a2-737fd9cb2e88 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab268a4d607497da5476256055bb07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14140e7303046f1ada446437826f742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:03.692336 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-bb78bab8-ff1f-4792-a2a2-737fd9cb2e88 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] 10.222.0.61 "GET /compute/v2.1/servers/eed024b5-986b-40fa-a686-ceab563a6131" status: 200 len: 1365 microversion: 2.1 time: 0.578877 Aug 31 16:10:03.695909 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1552/3126] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:03 2022] GET /compute/v2.1/servers/eed024b5-986b-40fa-a686-ceab563a6131 => generated 1365 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:10:03.718057 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d5130855-e453-45ad-9285-02eb3f35635d tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:03.745230 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d5130855-e453-45ad-9285-02eb3f35635d tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '41b93395d63a4db895ff224a311940e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf281e8857247c6b9e60d4216741f89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:03.748141 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.compute.servers [None req-d5130855-e453-45ad-9285-02eb3f35635d tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Removing options 'limit' from query {{(pid=122257) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 31 16:10:03.751817 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d5130855-e453-45ad-9285-02eb3f35635d tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Searching by: {'deleted': False, 'project_id': '1cf281e8857247c6b9e60d4216741f89'} {{(pid=122257) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 16:10:03.768341 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d5130855-e453-45ad-9285-02eb3f35635d tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:03.770806 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d5130855-e453-45ad-9285-02eb3f35635d tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:03.776892 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d5130855-e453-45ad-9285-02eb3f35635d tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:03.780353 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d5130855-e453-45ad-9285-02eb3f35635d tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:03.781030 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d5130855-e453-45ad-9285-02eb3f35635d tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:03.782998 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d5130855-e453-45ad-9285-02eb3f35635d tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:03.862240 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d5130855-e453-45ad-9285-02eb3f35635d tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] 10.222.0.61 "GET /compute/v2.1/servers?limit=1" status: 200 len: 484 microversion: 2.1 time: 0.164454 Aug 31 16:10:03.864807 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1553/3127] 10.222.0.61 () {58 vars in 1140 bytes} [Wed Aug 31 16:10:03 2022] GET /compute/v2.1/servers?limit=1 => generated 484 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:10:03.881132 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-29e3d750-414c-4315-9cea-9eaec5036f04 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:03.883175 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-29e3d750-414c-4315-9cea-9eaec5036f04 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] [instance: 29a78fc3-93ff-4f42-8c9f-79dfdc5229c6] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:03.905770 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-29e3d750-414c-4315-9cea-9eaec5036f04 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:03.911298 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-29e3d750-414c-4315-9cea-9eaec5036f04 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:03.914399 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-29e3d750-414c-4315-9cea-9eaec5036f04 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:03.917747 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-29e3d750-414c-4315-9cea-9eaec5036f04 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:03.919121 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-29e3d750-414c-4315-9cea-9eaec5036f04 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:03.920566 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-29e3d750-414c-4315-9cea-9eaec5036f04 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:03.966222 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8bddb73e-9ff8-49ea-b817-e440e7420c1c tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c65ee5ffa9d74bfdacbea45f1564d19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55320a9c8f714bc0911ded3ab88ddf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:03.981665 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8bddb73e-9ff8-49ea-b817-e440e7420c1c tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] 10.222.0.61 "GET /compute/v2.1/servers/0ac914d2-e9f7-4f2f-a01d-49674180d8db" status: 200 len: 1293 microversion: 2.1 time: 0.588188 Aug 31 16:10:04.000008 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1575/3128] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:03 2022] GET /compute/v2.1/servers/0ac914d2-e9f7-4f2f-a01d-49674180d8db => generated 1293 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:04.019358 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ba7b76ef-db6d-455e-881a-c6b254c6a809 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:04.028804 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ba7b76ef-db6d-455e-881a-c6b254c6a809 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:04.048953 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ba7b76ef-db6d-455e-881a-c6b254c6a809 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:04.049774 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ba7b76ef-db6d-455e-881a-c6b254c6a809 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:04.051182 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ba7b76ef-db6d-455e-881a-c6b254c6a809 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:04.052168 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ba7b76ef-db6d-455e-881a-c6b254c6a809 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:04.056405 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ba7b76ef-db6d-455e-881a-c6b254c6a809 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:04.057363 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ba7b76ef-db6d-455e-881a-c6b254c6a809 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:04.912166 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-29e3d750-414c-4315-9cea-9eaec5036f04 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68db583fb8fd4e6090fb220eeaafdd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c965154856f84fecb30f49dfeac46fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:04.921352 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ba7b76ef-db6d-455e-881a-c6b254c6a809 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:04.922751 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-29e3d750-414c-4315-9cea-9eaec5036f04 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] 10.222.0.61 "GET /compute/v2.1/servers/29a78fc3-93ff-4f42-8c9f-79dfdc5229c6" status: 200 len: 1323 microversion: 2.1 time: 1.056175 Aug 31 16:10:04.923824 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1554/3129] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:03 2022] GET /compute/v2.1/servers/29a78fc3-93ff-4f42-8c9f-79dfdc5229c6 => generated 1323 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:04.930131 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-bb189eed-48b5-4ac1-b379-8666b8a284b2 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:04.937977 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-bb189eed-48b5-4ac1-b379-8666b8a284b2 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '41b93395d63a4db895ff224a311940e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf281e8857247c6b9e60d4216741f89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:04.939122 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-bb189eed-48b5-4ac1-b379-8666b8a284b2 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-437544270', 'deleted': False, 'project_id': '1cf281e8857247c6b9e60d4216741f89'} {{(pid=122257) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 16:10:04.944235 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ba7b76ef-db6d-455e-881a-c6b254c6a809 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c" status: 200 len: 1493 microversion: 2.1 time: 0.941518 Aug 31 16:10:04.945352 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bb189eed-48b5-4ac1-b379-8666b8a284b2 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:04.946464 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bb189eed-48b5-4ac1-b379-8666b8a284b2 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:04.947177 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bb189eed-48b5-4ac1-b379-8666b8a284b2 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:04.948375 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bb189eed-48b5-4ac1-b379-8666b8a284b2 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:04.949132 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bb189eed-48b5-4ac1-b379-8666b8a284b2 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:04.949787 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bb189eed-48b5-4ac1-b379-8666b8a284b2 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:04.960100 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1576/3130] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:04 2022] GET /compute/v2.1/servers/0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c => generated 1493 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:04.975653 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-71f46065-bc18-425b-8202-2b949b27a0f8 req-76293742-d151-4796-bebe-fed658f1899b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eed024b5-986b-40fa-a686-ceab563a6131", "tag": "512921c8-73a5-4a95-ab19-e9b589b7421e"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:10:04.998206 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-71f46065-bc18-425b-8202-2b949b27a0f8 req-76293742-d151-4796-bebe-fed658f1899b service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:05.001150 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-71f46065-bc18-425b-8202-2b949b27a0f8 req-76293742-d151-4796-bebe-fed658f1899b service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:05.004334 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-71f46065-bc18-425b-8202-2b949b27a0f8 req-76293742-d151-4796-bebe-fed658f1899b service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:05.040456 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-71f46065-bc18-425b-8202-2b949b27a0f8 req-76293742-d151-4796-bebe-fed658f1899b service nova] Creating event network-changed:512921c8-73a5-4a95-ab19-e9b589b7421e for instance eed024b5-986b-40fa-a686-ceab563a6131 on n-h1-850499-9 Aug 31 16:10:05.051327 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-71f46065-bc18-425b-8202-2b949b27a0f8 req-76293742-d151-4796-bebe-fed658f1899b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087918 Aug 31 16:10:05.053808 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1577/3131] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:10:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:10:05.067054 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.multi_cell_list [None req-bb189eed-48b5-4ac1-b379-8666b8a284b2 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122257) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 31 16:10:05.068069 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8f614bf8-9cd7-48b2-9618-dd1d98a82b57 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:05.069944 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8f614bf8-9cd7-48b2-9618-dd1d98a82b57 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] [instance: eed024b5-986b-40fa-a686-ceab563a6131] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:05.083639 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8f614bf8-9cd7-48b2-9618-dd1d98a82b57 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:05.084907 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8f614bf8-9cd7-48b2-9618-dd1d98a82b57 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:05.087206 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8f614bf8-9cd7-48b2-9618-dd1d98a82b57 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:05.088960 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8f614bf8-9cd7-48b2-9618-dd1d98a82b57 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:05.090108 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8f614bf8-9cd7-48b2-9618-dd1d98a82b57 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:05.091122 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8f614bf8-9cd7-48b2-9618-dd1d98a82b57 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:05.136387 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-bb189eed-48b5-4ac1-b379-8666b8a284b2 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] 10.222.0.61 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-437544270" status: 200 len: 345 microversion: 2.1 time: 0.210989 Aug 31 16:10:05.145136 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1555/3132] 10.222.0.61 () {58 vars in 1240 bytes} [Wed Aug 31 16:10:04 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-437544270 => generated 345 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:10:05.151294 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6e8fad0d-ea19-488b-a61d-661f5ef2659e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:05.151897 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6e8fad0d-ea19-488b-a61d-661f5ef2659e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:05.159257 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6e8fad0d-ea19-488b-a61d-661f5ef2659e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:05.160145 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6e8fad0d-ea19-488b-a61d-661f5ef2659e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:05.160945 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6e8fad0d-ea19-488b-a61d-661f5ef2659e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:05.161871 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6e8fad0d-ea19-488b-a61d-661f5ef2659e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:05.162491 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6e8fad0d-ea19-488b-a61d-661f5ef2659e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:05.163067 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6e8fad0d-ea19-488b-a61d-661f5ef2659e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:05.193299 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6e8fad0d-ea19-488b-a61d-661f5ef2659e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:10:05.289304 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=100 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:10:05.296296 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6e8fad0d-ea19-488b-a61d-661f5ef2659e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "DELETE /compute/v2.1/servers/0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c" status: 204 len: 0 microversion: 2.1 time: 0.150026 Aug 31 16:10:05.301243 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1556/3133] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:10:05 2022] DELETE /compute/v2.1/servers/0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:10:05.308885 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-cd5806d3-686c-4143-ad8d-bf609ad756d7 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:05.309616 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-cd5806d3-686c-4143-ad8d-bf609ad756d7 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] [instance: 0ac914d2-e9f7-4f2f-a01d-49674180d8db] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:05.317967 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cd5806d3-686c-4143-ad8d-bf609ad756d7 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:05.318472 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cd5806d3-686c-4143-ad8d-bf609ad756d7 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:05.319105 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cd5806d3-686c-4143-ad8d-bf609ad756d7 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:05.319928 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cd5806d3-686c-4143-ad8d-bf609ad756d7 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:05.320984 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cd5806d3-686c-4143-ad8d-bf609ad756d7 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:05.321758 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cd5806d3-686c-4143-ad8d-bf609ad756d7 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:05.632560 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8f614bf8-9cd7-48b2-9618-dd1d98a82b57 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab268a4d607497da5476256055bb07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14140e7303046f1ada446437826f742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:05.650628 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8f614bf8-9cd7-48b2-9618-dd1d98a82b57 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] 10.222.0.61 "GET /compute/v2.1/servers/eed024b5-986b-40fa-a686-ceab563a6131" status: 200 len: 1365 microversion: 2.1 time: 0.592499 Aug 31 16:10:05.652821 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1578/3134] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:05 2022] GET /compute/v2.1/servers/eed024b5-986b-40fa-a686-ceab563a6131 => generated 1365 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:05.660475 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b76fff82-9937-4d21-bad3-c8f2619ce0dc tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:10:05.669790 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b76fff82-9937-4d21-bad3-c8f2619ce0dc tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:05.670803 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b76fff82-9937-4d21-bad3-c8f2619ce0dc tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:05.671463 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b76fff82-9937-4d21-bad3-c8f2619ce0dc tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:05.695779 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-cd5806d3-686c-4143-ad8d-bf609ad756d7 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c65ee5ffa9d74bfdacbea45f1564d19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55320a9c8f714bc0911ded3ab88ddf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:05.701197 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b76fff82-9937-4d21-bad3-c8f2619ce0dc tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] [instance: c393928f-2414-4093-9d72-93a21fc6c460] Going to try to stop instance {{(pid=122256) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 31 16:10:05.706635 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-cd5806d3-686c-4143-ad8d-bf609ad756d7 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] 10.222.0.61 "GET /compute/v2.1/servers/0ac914d2-e9f7-4f2f-a01d-49674180d8db" status: 200 len: 1293 microversion: 2.1 time: 0.403319 Aug 31 16:10:05.707240 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1557/3135] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:05 2022] GET /compute/v2.1/servers/0ac914d2-e9f7-4f2f-a01d-49674180d8db => generated 1293 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:05.727824 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-03beafe3-9d17-4da4-9040-0c6b1937cfdf tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:05.728760 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-03beafe3-9d17-4da4-9040-0c6b1937cfdf tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:05.736099 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-03beafe3-9d17-4da4-9040-0c6b1937cfdf tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:05.736856 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-03beafe3-9d17-4da4-9040-0c6b1937cfdf tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:05.737457 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-03beafe3-9d17-4da4-9040-0c6b1937cfdf tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:05.738379 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-03beafe3-9d17-4da4-9040-0c6b1937cfdf tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:05.739004 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-03beafe3-9d17-4da4-9040-0c6b1937cfdf tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:05.739634 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-03beafe3-9d17-4da4-9040-0c6b1937cfdf tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:05.744558 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:10:05.789221 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b76fff82-9937-4d21-bad3-c8f2619ce0dc tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] 10.222.0.61 "POST /compute/v2.1/servers/c393928f-2414-4093-9d72-93a21fc6c460/action" status: 202 len: 0 microversion: 2.1 time: 0.134026 Aug 31 16:10:05.795405 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1579/3136] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:10:05 2022] POST /compute/v2.1/servers/c393928f-2414-4093-9d72-93a21fc6c460/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:10:05.806133 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e3315b49-bb09-400b-a9ec-a0bf298dbf3a tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:05.807280 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e3315b49-bb09-400b-a9ec-a0bf298dbf3a tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] [instance: c393928f-2414-4093-9d72-93a21fc6c460] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:05.818383 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e3315b49-bb09-400b-a9ec-a0bf298dbf3a tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:05.818383 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e3315b49-bb09-400b-a9ec-a0bf298dbf3a tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:05.820759 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e3315b49-bb09-400b-a9ec-a0bf298dbf3a tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:05.822325 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e3315b49-bb09-400b-a9ec-a0bf298dbf3a tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:05.823237 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e3315b49-bb09-400b-a9ec-a0bf298dbf3a tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:05.823955 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e3315b49-bb09-400b-a9ec-a0bf298dbf3a tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:06.131770 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-03beafe3-9d17-4da4-9040-0c6b1937cfdf tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:06.144256 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-03beafe3-9d17-4da4-9040-0c6b1937cfdf tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c" status: 200 len: 1499 microversion: 2.1 time: 0.431516 Aug 31 16:10:06.145058 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1558/3137] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:05 2022] GET /compute/v2.1/servers/0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c => generated 1499 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:06.154862 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-60849ef2-b3c0-43ab-84c3-1013d3f9ffa7 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:06.155780 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-60849ef2-b3c0-43ab-84c3-1013d3f9ffa7 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] [instance: 29a78fc3-93ff-4f42-8c9f-79dfdc5229c6] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:06.164419 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-60849ef2-b3c0-43ab-84c3-1013d3f9ffa7 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:06.165455 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-60849ef2-b3c0-43ab-84c3-1013d3f9ffa7 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:06.166281 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-60849ef2-b3c0-43ab-84c3-1013d3f9ffa7 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:06.167289 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-60849ef2-b3c0-43ab-84c3-1013d3f9ffa7 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:06.168134 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-60849ef2-b3c0-43ab-84c3-1013d3f9ffa7 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:06.168768 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-60849ef2-b3c0-43ab-84c3-1013d3f9ffa7 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:06.234155 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e3315b49-bb09-400b-a9ec-a0bf298dbf3a tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b93395d63a4db895ff224a311940e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf281e8857247c6b9e60d4216741f89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:06.250116 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e3315b49-bb09-400b-a9ec-a0bf298dbf3a tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] 10.222.0.61 "GET /compute/v2.1/servers/c393928f-2414-4093-9d72-93a21fc6c460" status: 200 len: 1522 microversion: 2.1 time: 0.452493 Aug 31 16:10:06.250734 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1580/3138] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:05 2022] GET /compute/v2.1/servers/c393928f-2414-4093-9d72-93a21fc6c460 => generated 1522 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:06.351168 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-60849ef2-b3c0-43ab-84c3-1013d3f9ffa7 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68db583fb8fd4e6090fb220eeaafdd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c965154856f84fecb30f49dfeac46fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:06.363624 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-60849ef2-b3c0-43ab-84c3-1013d3f9ffa7 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] 10.222.0.61 "GET /compute/v2.1/servers/29a78fc3-93ff-4f42-8c9f-79dfdc5229c6" status: 200 len: 1323 microversion: 2.1 time: 0.212455 Aug 31 16:10:06.364902 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1559/3139] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:06 2022] GET /compute/v2.1/servers/29a78fc3-93ff-4f42-8c9f-79dfdc5229c6 => generated 1323 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:06.446185 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-c38958b2-376a-4520-98ae-9865692d02f7 req-167715a9-ec90-49ab-81f7-0b5582c7d45f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29a78fc3-93ff-4f42-8c9f-79dfdc5229c6", "name": "network-vif-plugged", "status": "completed", "tag": "cf59a33a-70b0-49f7-99b3-a7b4760a6cef"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:10:06.467956 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-c38958b2-376a-4520-98ae-9865692d02f7 req-167715a9-ec90-49ab-81f7-0b5582c7d45f service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:06.469198 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-c38958b2-376a-4520-98ae-9865692d02f7 req-167715a9-ec90-49ab-81f7-0b5582c7d45f service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:06.470141 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-c38958b2-376a-4520-98ae-9865692d02f7 req-167715a9-ec90-49ab-81f7-0b5582c7d45f service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:06.488551 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-c38958b2-376a-4520-98ae-9865692d02f7 req-167715a9-ec90-49ab-81f7-0b5582c7d45f service nova] Creating event network-vif-plugged:cf59a33a-70b0-49f7-99b3-a7b4760a6cef for instance 29a78fc3-93ff-4f42-8c9f-79dfdc5229c6 on n-h2-850499-9 Aug 31 16:10:06.494484 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-c38958b2-376a-4520-98ae-9865692d02f7 req-167715a9-ec90-49ab-81f7-0b5582c7d45f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052563 Aug 31 16:10:06.495104 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1581/3140] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:10:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:10:06.672920 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ff5cd38b-b914-4c7f-8979-13aecad9e671 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:06.673547 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ff5cd38b-b914-4c7f-8979-13aecad9e671 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] [instance: eed024b5-986b-40fa-a686-ceab563a6131] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:06.682839 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ff5cd38b-b914-4c7f-8979-13aecad9e671 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:06.683672 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ff5cd38b-b914-4c7f-8979-13aecad9e671 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:06.684401 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ff5cd38b-b914-4c7f-8979-13aecad9e671 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:06.685572 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ff5cd38b-b914-4c7f-8979-13aecad9e671 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:06.686301 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ff5cd38b-b914-4c7f-8979-13aecad9e671 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:06.687029 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ff5cd38b-b914-4c7f-8979-13aecad9e671 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:06.737789 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c30cb001-75f0-4f10-82a0-26dc06d467d3 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:06.739625 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c30cb001-75f0-4f10-82a0-26dc06d467d3 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] [instance: 0ac914d2-e9f7-4f2f-a01d-49674180d8db] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:06.748889 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c30cb001-75f0-4f10-82a0-26dc06d467d3 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:06.749710 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c30cb001-75f0-4f10-82a0-26dc06d467d3 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:06.750309 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c30cb001-75f0-4f10-82a0-26dc06d467d3 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:06.751194 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c30cb001-75f0-4f10-82a0-26dc06d467d3 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:06.751844 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c30cb001-75f0-4f10-82a0-26dc06d467d3 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:06.752434 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c30cb001-75f0-4f10-82a0-26dc06d467d3 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:06.994130 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ff5cd38b-b914-4c7f-8979-13aecad9e671 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab268a4d607497da5476256055bb07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14140e7303046f1ada446437826f742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:07.009795 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ff5cd38b-b914-4c7f-8979-13aecad9e671 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] 10.222.0.61 "GET /compute/v2.1/servers/eed024b5-986b-40fa-a686-ceab563a6131" status: 200 len: 1365 microversion: 2.1 time: 0.340743 Aug 31 16:10:07.014491 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1560/3141] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:06 2022] GET /compute/v2.1/servers/eed024b5-986b-40fa-a686-ceab563a6131 => generated 1365 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:10:07.037440 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c30cb001-75f0-4f10-82a0-26dc06d467d3 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c65ee5ffa9d74bfdacbea45f1564d19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55320a9c8f714bc0911ded3ab88ddf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:07.058458 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c30cb001-75f0-4f10-82a0-26dc06d467d3 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] 10.222.0.61 "GET /compute/v2.1/servers/0ac914d2-e9f7-4f2f-a01d-49674180d8db" status: 200 len: 1293 microversion: 2.1 time: 0.327413 Aug 31 16:10:07.063094 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1582/3142] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:06 2022] GET /compute/v2.1/servers/0ac914d2-e9f7-4f2f-a01d-49674180d8db => generated 1293 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:07.175662 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-af14c7f6-f5ed-4122-9053-f543411aa13e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:07.176834 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-af14c7f6-f5ed-4122-9053-f543411aa13e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:07.185378 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-af14c7f6-f5ed-4122-9053-f543411aa13e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:07.185819 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-af14c7f6-f5ed-4122-9053-f543411aa13e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:07.186264 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-af14c7f6-f5ed-4122-9053-f543411aa13e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:07.187038 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-af14c7f6-f5ed-4122-9053-f543411aa13e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:07.187640 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-af14c7f6-f5ed-4122-9053-f543411aa13e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:07.188070 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-af14c7f6-f5ed-4122-9053-f543411aa13e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:07.272571 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-70335343-d318-453e-9dbc-5722431e852a tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:07.273858 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-70335343-d318-453e-9dbc-5722431e852a tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] [instance: c393928f-2414-4093-9d72-93a21fc6c460] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:07.283318 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-70335343-d318-453e-9dbc-5722431e852a tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:07.284101 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-70335343-d318-453e-9dbc-5722431e852a tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:07.284700 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-70335343-d318-453e-9dbc-5722431e852a tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:07.286164 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-70335343-d318-453e-9dbc-5722431e852a tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:07.286630 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-70335343-d318-453e-9dbc-5722431e852a tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:07.287332 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-70335343-d318-453e-9dbc-5722431e852a tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:07.559984 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-af14c7f6-f5ed-4122-9053-f543411aa13e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:07.569874 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-af14c7f6-f5ed-4122-9053-f543411aa13e tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c" status: 200 len: 1499 microversion: 2.1 time: 0.407501 Aug 31 16:10:07.576988 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1561/3143] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:07 2022] GET /compute/v2.1/servers/0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c => generated 1499 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:10:07.597577 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ab8d0355-0938-4052-9418-ae76e7c3d78e tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:07.598211 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ab8d0355-0938-4052-9418-ae76e7c3d78e tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] [instance: 29a78fc3-93ff-4f42-8c9f-79dfdc5229c6] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:07.618484 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ab8d0355-0938-4052-9418-ae76e7c3d78e tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:07.622866 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ab8d0355-0938-4052-9418-ae76e7c3d78e tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:07.624755 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ab8d0355-0938-4052-9418-ae76e7c3d78e tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:07.626574 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ab8d0355-0938-4052-9418-ae76e7c3d78e tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:07.629732 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ab8d0355-0938-4052-9418-ae76e7c3d78e tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:07.631084 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ab8d0355-0938-4052-9418-ae76e7c3d78e tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:07.646467 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-70335343-d318-453e-9dbc-5722431e852a tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b93395d63a4db895ff224a311940e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf281e8857247c6b9e60d4216741f89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:07.656128 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-70335343-d318-453e-9dbc-5722431e852a tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] 10.222.0.61 "GET /compute/v2.1/servers/c393928f-2414-4093-9d72-93a21fc6c460" status: 200 len: 1522 microversion: 2.1 time: 0.387720 Aug 31 16:10:07.660737 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1583/3144] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:07 2022] GET /compute/v2.1/servers/c393928f-2414-4093-9d72-93a21fc6c460 => generated 1522 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:10:07.876910 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ab8d0355-0938-4052-9418-ae76e7c3d78e tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68db583fb8fd4e6090fb220eeaafdd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c965154856f84fecb30f49dfeac46fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:07.887361 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ab8d0355-0938-4052-9418-ae76e7c3d78e tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] 10.222.0.61 "GET /compute/v2.1/servers/29a78fc3-93ff-4f42-8c9f-79dfdc5229c6" status: 200 len: 1323 microversion: 2.1 time: 0.297829 Aug 31 16:10:07.888386 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1562/3145] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:07 2022] GET /compute/v2.1/servers/29a78fc3-93ff-4f42-8c9f-79dfdc5229c6 => generated 1323 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:08.042900 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-73c36937-5b80-4cf7-aff3-2e45c82d3503 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:08.043873 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-73c36937-5b80-4cf7-aff3-2e45c82d3503 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] [instance: eed024b5-986b-40fa-a686-ceab563a6131] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:08.051633 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-73c36937-5b80-4cf7-aff3-2e45c82d3503 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:08.052467 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-73c36937-5b80-4cf7-aff3-2e45c82d3503 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:08.053186 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-73c36937-5b80-4cf7-aff3-2e45c82d3503 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:08.068042 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-73c36937-5b80-4cf7-aff3-2e45c82d3503 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:08.071629 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-73c36937-5b80-4cf7-aff3-2e45c82d3503 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:08.073064 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-73c36937-5b80-4cf7-aff3-2e45c82d3503 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:08.095336 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8279e900-4027-4b0a-a0bb-03da7ba7e7d4 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:08.099376 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8279e900-4027-4b0a-a0bb-03da7ba7e7d4 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] [instance: 0ac914d2-e9f7-4f2f-a01d-49674180d8db] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:08.127236 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8279e900-4027-4b0a-a0bb-03da7ba7e7d4 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:08.128031 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8279e900-4027-4b0a-a0bb-03da7ba7e7d4 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:08.132328 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8279e900-4027-4b0a-a0bb-03da7ba7e7d4 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:08.136651 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8279e900-4027-4b0a-a0bb-03da7ba7e7d4 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:08.139036 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8279e900-4027-4b0a-a0bb-03da7ba7e7d4 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:08.141495 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8279e900-4027-4b0a-a0bb-03da7ba7e7d4 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:08.435317 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-73c36937-5b80-4cf7-aff3-2e45c82d3503 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab268a4d607497da5476256055bb07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14140e7303046f1ada446437826f742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:08.448332 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-73c36937-5b80-4cf7-aff3-2e45c82d3503 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] 10.222.0.61 "GET /compute/v2.1/servers/eed024b5-986b-40fa-a686-ceab563a6131" status: 200 len: 1365 microversion: 2.1 time: 0.411793 Aug 31 16:10:08.449592 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1584/3146] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:08 2022] GET /compute/v2.1/servers/eed024b5-986b-40fa-a686-ceab563a6131 => generated 1365 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:08.519205 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8279e900-4027-4b0a-a0bb-03da7ba7e7d4 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c65ee5ffa9d74bfdacbea45f1564d19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55320a9c8f714bc0911ded3ab88ddf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:08.536719 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8279e900-4027-4b0a-a0bb-03da7ba7e7d4 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] 10.222.0.61 "GET /compute/v2.1/servers/0ac914d2-e9f7-4f2f-a01d-49674180d8db" status: 200 len: 1293 microversion: 2.1 time: 0.449117 Aug 31 16:10:08.537641 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1563/3147] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:08 2022] GET /compute/v2.1/servers/0ac914d2-e9f7-4f2f-a01d-49674180d8db => generated 1293 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:08.615541 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3943094c-1037-4ce7-b643-9e1517ec91cb tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:08.617471 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3943094c-1037-4ce7-b643-9e1517ec91cb tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:08.626605 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3943094c-1037-4ce7-b643-9e1517ec91cb tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:08.627387 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3943094c-1037-4ce7-b643-9e1517ec91cb tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:08.628020 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3943094c-1037-4ce7-b643-9e1517ec91cb tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:08.630738 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3943094c-1037-4ce7-b643-9e1517ec91cb tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:08.631722 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3943094c-1037-4ce7-b643-9e1517ec91cb tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:08.634250 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3943094c-1037-4ce7-b643-9e1517ec91cb tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:08.683542 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9a9d1720-acfb-40a9-affe-55b0ad9180f1 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:08.684649 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9a9d1720-acfb-40a9-affe-55b0ad9180f1 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] [instance: c393928f-2414-4093-9d72-93a21fc6c460] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:08.699702 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9a9d1720-acfb-40a9-affe-55b0ad9180f1 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:08.700604 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9a9d1720-acfb-40a9-affe-55b0ad9180f1 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:08.708233 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9a9d1720-acfb-40a9-affe-55b0ad9180f1 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:08.709383 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9a9d1720-acfb-40a9-affe-55b0ad9180f1 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:08.710086 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9a9d1720-acfb-40a9-affe-55b0ad9180f1 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:08.710856 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9a9d1720-acfb-40a9-affe-55b0ad9180f1 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:09.129861 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3943094c-1037-4ce7-b643-9e1517ec91cb tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:09.144701 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3943094c-1037-4ce7-b643-9e1517ec91cb tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c" status: 200 len: 1499 microversion: 2.1 time: 0.544591 Aug 31 16:10:09.147664 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1585/3148] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:08 2022] GET /compute/v2.1/servers/0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c => generated 1499 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:09.157466 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e0b3fd12-9123-4e83-b61d-69426f944236 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:09.158140 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e0b3fd12-9123-4e83-b61d-69426f944236 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] [instance: 29a78fc3-93ff-4f42-8c9f-79dfdc5229c6] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:09.165819 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e0b3fd12-9123-4e83-b61d-69426f944236 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:09.166585 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e0b3fd12-9123-4e83-b61d-69426f944236 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:09.170663 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e0b3fd12-9123-4e83-b61d-69426f944236 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:09.171669 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e0b3fd12-9123-4e83-b61d-69426f944236 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:09.172323 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e0b3fd12-9123-4e83-b61d-69426f944236 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:09.172930 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e0b3fd12-9123-4e83-b61d-69426f944236 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:09.209887 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9a9d1720-acfb-40a9-affe-55b0ad9180f1 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b93395d63a4db895ff224a311940e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf281e8857247c6b9e60d4216741f89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:09.230395 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9a9d1720-acfb-40a9-affe-55b0ad9180f1 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] 10.222.0.61 "GET /compute/v2.1/servers/c393928f-2414-4093-9d72-93a21fc6c460" status: 200 len: 1522 microversion: 2.1 time: 0.551858 Aug 31 16:10:09.236332 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1564/3149] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:08 2022] GET /compute/v2.1/servers/c393928f-2414-4093-9d72-93a21fc6c460 => generated 1522 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:10:09.482042 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-eca798ea-1d62-4c12-aafb-86e44d3fa377 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:09.483332 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-eca798ea-1d62-4c12-aafb-86e44d3fa377 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] [instance: eed024b5-986b-40fa-a686-ceab563a6131] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:09.497661 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eca798ea-1d62-4c12-aafb-86e44d3fa377 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:09.498344 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eca798ea-1d62-4c12-aafb-86e44d3fa377 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:09.498897 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eca798ea-1d62-4c12-aafb-86e44d3fa377 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:09.500075 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eca798ea-1d62-4c12-aafb-86e44d3fa377 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:09.500591 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eca798ea-1d62-4c12-aafb-86e44d3fa377 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:09.501145 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eca798ea-1d62-4c12-aafb-86e44d3fa377 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:09.587439 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e0b3fd12-9123-4e83-b61d-69426f944236 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68db583fb8fd4e6090fb220eeaafdd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c965154856f84fecb30f49dfeac46fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:09.612196 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e0b3fd12-9123-4e83-b61d-69426f944236 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] 10.222.0.61 "GET /compute/v2.1/servers/29a78fc3-93ff-4f42-8c9f-79dfdc5229c6" status: 200 len: 1323 microversion: 2.1 time: 0.459959 Aug 31 16:10:09.639967 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1586/3150] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:09 2022] GET /compute/v2.1/servers/29a78fc3-93ff-4f42-8c9f-79dfdc5229c6 => generated 1323 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:09.669932 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-802ca3f4-5b7e-4fc2-835e-a6163fcb1cce req-41ff6d1c-f045-4c48-ab84-8c517a17d744 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c", "name": "network-vif-deleted", "tag": "01ac81c6-6528-4881-a131-08caa56e847d"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:10:09.729953 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-802ca3f4-5b7e-4fc2-835e-a6163fcb1cce req-41ff6d1c-f045-4c48-ab84-8c517a17d744 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:09.730670 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-802ca3f4-5b7e-4fc2-835e-a6163fcb1cce req-41ff6d1c-f045-4c48-ab84-8c517a17d744 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:09.731121 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-802ca3f4-5b7e-4fc2-835e-a6163fcb1cce req-41ff6d1c-f045-4c48-ab84-8c517a17d744 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:09.781559 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-802ca3f4-5b7e-4fc2-835e-a6163fcb1cce req-41ff6d1c-f045-4c48-ab84-8c517a17d744 service nova] Creating event network-vif-deleted:01ac81c6-6528-4881-a131-08caa56e847d for instance 0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c on n-h2-850499-9 Aug 31 16:10:09.794645 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-802ca3f4-5b7e-4fc2-835e-a6163fcb1cce req-41ff6d1c-f045-4c48-ab84-8c517a17d744 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153156 Aug 31 16:10:09.795258 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1587/3151] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:10:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:10:09.813956 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5f3c1a1e-42b6-4ef8-909a-25240a3f0c80 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:09.816375 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5f3c1a1e-42b6-4ef8-909a-25240a3f0c80 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] [instance: 0ac914d2-e9f7-4f2f-a01d-49674180d8db] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:09.836855 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5f3c1a1e-42b6-4ef8-909a-25240a3f0c80 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:09.840432 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5f3c1a1e-42b6-4ef8-909a-25240a3f0c80 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:09.841274 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5f3c1a1e-42b6-4ef8-909a-25240a3f0c80 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:09.842851 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5f3c1a1e-42b6-4ef8-909a-25240a3f0c80 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:09.848603 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5f3c1a1e-42b6-4ef8-909a-25240a3f0c80 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:09.849325 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5f3c1a1e-42b6-4ef8-909a-25240a3f0c80 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:09.859616 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:10:10.090053 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-eca798ea-1d62-4c12-aafb-86e44d3fa377 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab268a4d607497da5476256055bb07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14140e7303046f1ada446437826f742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:10.110024 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-eca798ea-1d62-4c12-aafb-86e44d3fa377 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] 10.222.0.61 "GET /compute/v2.1/servers/eed024b5-986b-40fa-a686-ceab563a6131" status: 200 len: 1365 microversion: 2.1 time: 0.636445 Aug 31 16:10:10.126318 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1565/3152] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:09 2022] GET /compute/v2.1/servers/eed024b5-986b-40fa-a686-ceab563a6131 => generated 1365 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:10.144664 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5f3c1a1e-42b6-4ef8-909a-25240a3f0c80 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c65ee5ffa9d74bfdacbea45f1564d19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55320a9c8f714bc0911ded3ab88ddf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:10.156254 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5f3c1a1e-42b6-4ef8-909a-25240a3f0c80 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] 10.222.0.61 "GET /compute/v2.1/servers/0ac914d2-e9f7-4f2f-a01d-49674180d8db" status: 200 len: 1293 microversion: 2.1 time: 0.358484 Aug 31 16:10:10.157417 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1588/3153] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:09 2022] GET /compute/v2.1/servers/0ac914d2-e9f7-4f2f-a01d-49674180d8db => generated 1293 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:10.176682 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-eb45f5d9-cc97-4055-8990-d116e44ce264 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:10.177514 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-eb45f5d9-cc97-4055-8990-d116e44ce264 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:10.190097 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eb45f5d9-cc97-4055-8990-d116e44ce264 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:10.190964 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eb45f5d9-cc97-4055-8990-d116e44ce264 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:10.191416 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eb45f5d9-cc97-4055-8990-d116e44ce264 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:10.192235 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eb45f5d9-cc97-4055-8990-d116e44ce264 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:10.192702 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eb45f5d9-cc97-4055-8990-d116e44ce264 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:10.193314 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eb45f5d9-cc97-4055-8990-d116e44ce264 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:10.260381 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1ff30755-56e8-47d4-aa8d-434ea06811f2 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:10.261314 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1ff30755-56e8-47d4-aa8d-434ea06811f2 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] [instance: c393928f-2414-4093-9d72-93a21fc6c460] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:10.271068 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1ff30755-56e8-47d4-aa8d-434ea06811f2 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:10.271865 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1ff30755-56e8-47d4-aa8d-434ea06811f2 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:10.272539 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1ff30755-56e8-47d4-aa8d-434ea06811f2 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:10.273728 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1ff30755-56e8-47d4-aa8d-434ea06811f2 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:10.275112 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1ff30755-56e8-47d4-aa8d-434ea06811f2 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:10.275742 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1ff30755-56e8-47d4-aa8d-434ea06811f2 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:10.322151 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-eb45f5d9-cc97-4055-8990-d116e44ce264 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:10.338132 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-eb45f5d9-cc97-4055-8990-d116e44ce264 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c" status: 200 len: 1457 microversion: 2.1 time: 0.164599 Aug 31 16:10:10.340723 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1566/3154] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:10 2022] GET /compute/v2.1/servers/0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c => generated 1457 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:10.505881 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1ff30755-56e8-47d4-aa8d-434ea06811f2 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b93395d63a4db895ff224a311940e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf281e8857247c6b9e60d4216741f89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:10.519063 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1ff30755-56e8-47d4-aa8d-434ea06811f2 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] 10.222.0.61 "GET /compute/v2.1/servers/c393928f-2414-4093-9d72-93a21fc6c460" status: 200 len: 1522 microversion: 2.1 time: 0.266324 Aug 31 16:10:10.520172 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1589/3155] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:10 2022] GET /compute/v2.1/servers/c393928f-2414-4093-9d72-93a21fc6c460 => generated 1522 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:10.644220 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-96e84d09-dc62-48ad-ad90-dcdf47c58179 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:10.644852 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-96e84d09-dc62-48ad-ad90-dcdf47c58179 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] [instance: 29a78fc3-93ff-4f42-8c9f-79dfdc5229c6] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:10.653289 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-96e84d09-dc62-48ad-ad90-dcdf47c58179 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:10.655433 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-96e84d09-dc62-48ad-ad90-dcdf47c58179 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:10.656331 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-96e84d09-dc62-48ad-ad90-dcdf47c58179 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:10.657356 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-96e84d09-dc62-48ad-ad90-dcdf47c58179 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:10.658001 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-96e84d09-dc62-48ad-ad90-dcdf47c58179 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:10.658653 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-96e84d09-dc62-48ad-ad90-dcdf47c58179 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:11.142658 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-db7d5ddb-6c58-455b-99e0-e8b8f41fe96f tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:11.144372 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-db7d5ddb-6c58-455b-99e0-e8b8f41fe96f tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] [instance: eed024b5-986b-40fa-a686-ceab563a6131] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:11.165901 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-db7d5ddb-6c58-455b-99e0-e8b8f41fe96f tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:11.166422 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-db7d5ddb-6c58-455b-99e0-e8b8f41fe96f tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:11.171210 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-db7d5ddb-6c58-455b-99e0-e8b8f41fe96f tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:11.172353 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-db7d5ddb-6c58-455b-99e0-e8b8f41fe96f tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:11.174777 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-db7d5ddb-6c58-455b-99e0-e8b8f41fe96f tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:11.178387 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-db7d5ddb-6c58-455b-99e0-e8b8f41fe96f tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:11.550944 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:10:12.139809 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-96e84d09-dc62-48ad-ad90-dcdf47c58179 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68db583fb8fd4e6090fb220eeaafdd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c965154856f84fecb30f49dfeac46fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:12.153238 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-96e84d09-dc62-48ad-ad90-dcdf47c58179 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] 10.222.0.61 "GET /compute/v2.1/servers/29a78fc3-93ff-4f42-8c9f-79dfdc5229c6" status: 200 len: 1323 microversion: 2.1 time: 1.513410 Aug 31 16:10:12.158356 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1567/3156] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:10 2022] GET /compute/v2.1/servers/29a78fc3-93ff-4f42-8c9f-79dfdc5229c6 => generated 1323 bytes in 1518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:12.172561 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8429990f-2450-4b5c-8306-90aa7f023aba tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:12.173194 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8429990f-2450-4b5c-8306-90aa7f023aba tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] [instance: 0ac914d2-e9f7-4f2f-a01d-49674180d8db] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:12.191832 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8429990f-2450-4b5c-8306-90aa7f023aba tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:12.193485 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8429990f-2450-4b5c-8306-90aa7f023aba tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:12.195969 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8429990f-2450-4b5c-8306-90aa7f023aba tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:12.199092 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8429990f-2450-4b5c-8306-90aa7f023aba tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:12.200910 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8429990f-2450-4b5c-8306-90aa7f023aba tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:12.201636 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8429990f-2450-4b5c-8306-90aa7f023aba tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:12.215990 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-db7d5ddb-6c58-455b-99e0-e8b8f41fe96f tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab268a4d607497da5476256055bb07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14140e7303046f1ada446437826f742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:12.226857 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-db7d5ddb-6c58-455b-99e0-e8b8f41fe96f tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] 10.222.0.61 "GET /compute/v2.1/servers/eed024b5-986b-40fa-a686-ceab563a6131" status: 200 len: 1365 microversion: 2.1 time: 1.089775 Aug 31 16:10:12.239470 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1590/3157] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:11 2022] GET /compute/v2.1/servers/eed024b5-986b-40fa-a686-ceab563a6131 => generated 1365 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:12.245221 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3c29b97b-7745-4031-9141-c4cac7146d41 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:12.246037 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3c29b97b-7745-4031-9141-c4cac7146d41 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:12.260849 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=12 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:10:12.263233 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3c29b97b-7745-4031-9141-c4cac7146d41 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:12.264001 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3c29b97b-7745-4031-9141-c4cac7146d41 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:12.265493 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3c29b97b-7745-4031-9141-c4cac7146d41 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:12.272541 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3c29b97b-7745-4031-9141-c4cac7146d41 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:12.273103 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3c29b97b-7745-4031-9141-c4cac7146d41 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:12.273693 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3c29b97b-7745-4031-9141-c4cac7146d41 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:12.383821 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3c29b97b-7745-4031-9141-c4cac7146d41 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:12.384325 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3c29b97b-7745-4031-9141-c4cac7146d41 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:12.384937 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3c29b97b-7745-4031-9141-c4cac7146d41 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:12.385411 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-3c29b97b-7745-4031-9141-c4cac7146d41 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lazy-loading 'fault' on Instance uuid 0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:10:12.529150 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3c29b97b-7745-4031-9141-c4cac7146d41 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee58e6a7c284cc9a9c87d0a5c1239aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5a8bccbcb14afd9c6bcd6f4d4f8047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:12.543816 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3c29b97b-7745-4031-9141-c4cac7146d41 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c" status: 200 len: 1305 microversion: 2.1 time: 0.302799 Aug 31 16:10:12.559536 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1591/3158] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:12 2022] GET /compute/v2.1/servers/0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c => generated 1305 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:12.576465 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-cc3c1e45-c7c1-407f-95f5-b84ca4eb8d77 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:12.578192 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-cc3c1e45-c7c1-407f-95f5-b84ca4eb8d77 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] [instance: c393928f-2414-4093-9d72-93a21fc6c460] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:12.584810 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:10:12.587636 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cc3c1e45-c7c1-407f-95f5-b84ca4eb8d77 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:12.588596 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cc3c1e45-c7c1-407f-95f5-b84ca4eb8d77 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:12.589206 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cc3c1e45-c7c1-407f-95f5-b84ca4eb8d77 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:12.590393 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cc3c1e45-c7c1-407f-95f5-b84ca4eb8d77 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:12.592494 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cc3c1e45-c7c1-407f-95f5-b84ca4eb8d77 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:12.593114 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cc3c1e45-c7c1-407f-95f5-b84ca4eb8d77 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:13.172773 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=14 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:10:13.281691 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8429990f-2450-4b5c-8306-90aa7f023aba tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c65ee5ffa9d74bfdacbea45f1564d19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55320a9c8f714bc0911ded3ab88ddf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:13.297303 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8429990f-2450-4b5c-8306-90aa7f023aba tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] 10.222.0.61 "GET /compute/v2.1/servers/0ac914d2-e9f7-4f2f-a01d-49674180d8db" status: 200 len: 1293 microversion: 2.1 time: 1.135415 Aug 31 16:10:13.301195 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1568/3159] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:12 2022] GET /compute/v2.1/servers/0ac914d2-e9f7-4f2f-a01d-49674180d8db => generated 1293 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:13.317897 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5b36805c-3e46-4002-a860-1a81145ed1fe tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:13.321459 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5b36805c-3e46-4002-a860-1a81145ed1fe tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] [instance: 29a78fc3-93ff-4f42-8c9f-79dfdc5229c6] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:13.341674 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b36805c-3e46-4002-a860-1a81145ed1fe tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:13.343412 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b36805c-3e46-4002-a860-1a81145ed1fe tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:13.346682 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b36805c-3e46-4002-a860-1a81145ed1fe tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:13.350623 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b36805c-3e46-4002-a860-1a81145ed1fe tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:13.351270 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b36805c-3e46-4002-a860-1a81145ed1fe tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:13.353697 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b36805c-3e46-4002-a860-1a81145ed1fe tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:13.623051 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-cc3c1e45-c7c1-407f-95f5-b84ca4eb8d77 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b93395d63a4db895ff224a311940e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf281e8857247c6b9e60d4216741f89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:13.632274 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-cc3c1e45-c7c1-407f-95f5-b84ca4eb8d77 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] 10.222.0.61 "GET /compute/v2.1/servers/c393928f-2414-4093-9d72-93a21fc6c460" status: 200 len: 1522 microversion: 2.1 time: 1.071229 Aug 31 16:10:13.638306 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1592/3160] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:12 2022] GET /compute/v2.1/servers/c393928f-2414-4093-9d72-93a21fc6c460 => generated 1522 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:13.649509 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c76e868d-54a6-4c18-ab56-60b01081e85b tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:13.650571 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c76e868d-54a6-4c18-ab56-60b01081e85b tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] [instance: eed024b5-986b-40fa-a686-ceab563a6131] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:13.663479 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c76e868d-54a6-4c18-ab56-60b01081e85b tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:13.668767 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c76e868d-54a6-4c18-ab56-60b01081e85b tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:13.669559 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c76e868d-54a6-4c18-ab56-60b01081e85b tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:13.670500 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c76e868d-54a6-4c18-ab56-60b01081e85b tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:13.671167 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c76e868d-54a6-4c18-ab56-60b01081e85b tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:13.674662 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c76e868d-54a6-4c18-ab56-60b01081e85b tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:14.032940 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5b36805c-3e46-4002-a860-1a81145ed1fe tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68db583fb8fd4e6090fb220eeaafdd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c965154856f84fecb30f49dfeac46fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:14.059179 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5b36805c-3e46-4002-a860-1a81145ed1fe tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] 10.222.0.61 "GET /compute/v2.1/servers/29a78fc3-93ff-4f42-8c9f-79dfdc5229c6" status: 200 len: 1516 microversion: 2.1 time: 0.753985 Aug 31 16:10:14.062184 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1569/3161] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:13 2022] GET /compute/v2.1/servers/29a78fc3-93ff-4f42-8c9f-79dfdc5229c6 => generated 1516 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:14.069288 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e9dfa499-d36a-4f67-8624-7d261ac5df6c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:14.071924 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e9dfa499-d36a-4f67-8624-7d261ac5df6c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:14.090894 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e9dfa499-d36a-4f67-8624-7d261ac5df6c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:14.092647 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e9dfa499-d36a-4f67-8624-7d261ac5df6c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:14.093603 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e9dfa499-d36a-4f67-8624-7d261ac5df6c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:14.098451 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e9dfa499-d36a-4f67-8624-7d261ac5df6c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:14.099389 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e9dfa499-d36a-4f67-8624-7d261ac5df6c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:14.100093 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e9dfa499-d36a-4f67-8624-7d261ac5df6c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:14.156054 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-e9dfa499-d36a-4f67-8624-7d261ac5df6c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] HTTP exception thrown: Instance 0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c could not be found. Aug 31 16:10:14.159703 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e9dfa499-d36a-4f67-8624-7d261ac5df6c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Request method failure captured: Aug 31 16:10:14.159703 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c HTTP/1.1 Aug 31 16:10:14.159703 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:10:14.159703 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:10:14.159703 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:10:14.159703 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:10:14.159703 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:10:14.159703 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:10:14.159703 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:10:14.159703 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:10:14.159703 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4Yo5dNOTiRoHOXx-UM5Sn8Jbzoi0Z4yz9YBk3W8_DEhZnVZu-DDO0QOzNoQHJ1nNP8QtjbDsJSdq3n7hK4ZXI2LEyeWPrk9aNaREtGRbElEfeP-G76pg20KjiuDCyp0gfSMP_cw21bhq2fJbey8HuCI0lmGBIAsUVWfxqkVQu-gwfg Aug 31 16:10:14.159703 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:10:14.159703 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:10:14.159703 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:10:14.159703 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:10:14.159703 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:10:14.159703 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:10:14.159703 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: af5a8bccbcb14afd9c6bcd6f4d4f8047 Aug 31 16:10:14.159703 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-DeleteServersTestJSON-1125268000 Aug 31 16:10:14.159703 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:10:14.159703 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:10:14.159703 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/af5a8bccbcb14afd9c6bcd6f4d4f8047"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/af5a8bccbcb14afd9c6bcd6f4d4f8047"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_af5a8bccbcb14afd9c6bcd6f4d4f8047", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/af5a8bccbcb14afd9c6bcd6f4d4f8047"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:10:14.159703 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-DeleteServersTestJSON-1125268000 Aug 31 16:10:14.159703 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: af5a8bccbcb14afd9c6bcd6f4d4f8047 Aug 31 16:10:14.159703 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-DeleteServersTestJSON-1125268000 Aug 31 16:10:14.159703 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-DeleteServersTestJSON-1125268000-project Aug 31 16:10:14.159703 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:10:14.159703 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:10:14.159703 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 4ee58e6a7c284cc9a9c87d0a5c1239aa Aug 31 16:10:14.159703 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-DeleteServersTestJSON-1125268000-project Aug 31 16:10:14.159703 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:10:14.159703 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance 0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c could not be found. Aug 31 16:10:14.159703 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c'} Aug 31 16:10:14.159703 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:10:14.159703 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:14.159703 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:10:14.159703 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:10:14.159703 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:10:14.159703 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:10:14.159703 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:10:14.159703 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:10:14.159703 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:10:14.159703 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:10:14.159703 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c could not be found. Aug 31 16:10:14.159703 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:10:14.159703 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:10:14.159703 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:10:14.159703 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:14.159703 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:10:14.159703 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:10:14.159703 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:10:14.159703 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:10:14.159703 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:10:14.159703 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:10:14.159703 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:10:14.159703 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:10:14.159703 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:10:14.159703 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:10:14.159703 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:10:14.159703 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:10:14.159703 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c could not be found. Aug 31 16:10:14.159703 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:10:14.159703 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:10:14.159703 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:10:14.171264 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:14.171264 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:10:14.171264 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:10:14.171264 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:10:14.171264 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:10:14.171264 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c could not be found. Aug 31 16:10:14.171264 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:10:14.171900 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c76e868d-54a6-4c18-ab56-60b01081e85b tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab268a4d607497da5476256055bb07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14140e7303046f1ada446437826f742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:14.171900 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c76e868d-54a6-4c18-ab56-60b01081e85b tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] 10.222.0.61 "GET /compute/v2.1/servers/eed024b5-986b-40fa-a686-ceab563a6131" status: 200 len: 1365 microversion: 2.1 time: 0.530577 Aug 31 16:10:14.171900 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1593/3162] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:13 2022] GET /compute/v2.1/servers/eed024b5-986b-40fa-a686-ceab563a6131 => generated 1365 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:14.179388 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e9dfa499-d36a-4f67-8624-7d261ac5df6c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Returning 404 to user: Instance 0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:10:14.181408 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e9dfa499-d36a-4f67-8624-7d261ac5df6c tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c" status: 404 len: 111 microversion: 2.1 time: 0.117391 Aug 31 16:10:14.182332 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1570/3163] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:14 2022] GET /compute/v2.1/servers/0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:10:14.184901 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ee82856d-b2ce-4b67-9128-c6c459980f7d tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Action: 'create', calling method: .version_select at 0x7f5ae8674a60>, body: {"keypair": {"name": "tempest-keypair-1688734994", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDosDVtM1Pqjbn1ANOLmVNi2iZ6YssOZgBRg6ElOkf9GOeH8Mg2bw7LKXqVYn5o1NMRt5oVsr/KaHZp7ZHbHD6jxy4eTAKX9P7QtazpRoPzllw2sXY4cMpB0tocYb+0E8A=="}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:10:14.197026 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4cd40728-9c24-4a2d-822e-6a04bbf33b21 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:14.198111 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4cd40728-9c24-4a2d-822e-6a04bbf33b21 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] [instance: b68db583-0d09-4485-8b26-ff5c02e23c01] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:14.218143 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4cd40728-9c24-4a2d-822e-6a04bbf33b21 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:14.218973 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4cd40728-9c24-4a2d-822e-6a04bbf33b21 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:14.219651 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4cd40728-9c24-4a2d-822e-6a04bbf33b21 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:14.220576 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4cd40728-9c24-4a2d-822e-6a04bbf33b21 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:14.221208 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4cd40728-9c24-4a2d-822e-6a04bbf33b21 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:14.221817 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4cd40728-9c24-4a2d-822e-6a04bbf33b21 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:14.227041 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-ee82856d-b2ce-4b67-9128-c6c459980f7d tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Getting quotas for project 68e7010151a7457b9ff7574126683b32. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:10:14.256886 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-ee82856d-b2ce-4b67-9128-c6c459980f7d tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Getting quotas for user 51c2d1cf18074bfda706dc2d5713b4f2 and project 68e7010151a7457b9ff7574126683b32. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:10:14.320999 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ee82856d-b2ce-4b67-9128-c6c459980f7d tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.139423 Aug 31 16:10:14.322237 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1594/3164] 10.222.0.61 () {62 vars in 1200 bytes} [Wed Aug 31 16:10:14 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 151 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 31 16:10:14.344299 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b21a7edd-b2e4-488a-bd9e-6192af313997 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:14.349705 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b21a7edd-b2e4-488a-bd9e-6192af313997 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:14.389147 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b21a7edd-b2e4-488a-bd9e-6192af313997 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:14.391631 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b21a7edd-b2e4-488a-bd9e-6192af313997 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:14.392804 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b21a7edd-b2e4-488a-bd9e-6192af313997 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:14.399879 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b21a7edd-b2e4-488a-bd9e-6192af313997 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:14.401019 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b21a7edd-b2e4-488a-bd9e-6192af313997 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:14.402104 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b21a7edd-b2e4-488a-bd9e-6192af313997 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:14.455796 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-b21a7edd-b2e4-488a-bd9e-6192af313997 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] HTTP exception thrown: Instance 0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c could not be found. Aug 31 16:10:14.462956 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b21a7edd-b2e4-488a-bd9e-6192af313997 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Request method failure captured: Aug 31 16:10:14.462956 n-d-850499-9 devstack@n-api.service[122256]: request: DELETE /compute/v2.1/servers/0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c HTTP/1.1 Aug 31 16:10:14.462956 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:10:14.462956 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:10:14.462956 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:10:14.462956 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:10:14.462956 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:10:14.462956 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:10:14.462956 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:10:14.462956 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:10:14.462956 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4Yo5dNOTiRoHOXx-UM5Sn8Jbzoi0Z4yz9YBk3W8_DEhZnVZu-DDO0QOzNoQHJ1nNP8QtjbDsJSdq3n7hK4ZXI2LEyeWPrk9aNaREtGRbElEfeP-G76pg20KjiuDCyp0gfSMP_cw21bhq2fJbey8HuCI0lmGBIAsUVWfxqkVQu-gwfg Aug 31 16:10:14.462956 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:10:14.462956 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:10:14.462956 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:10:14.462956 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:10:14.462956 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:10:14.462956 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:10:14.462956 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: af5a8bccbcb14afd9c6bcd6f4d4f8047 Aug 31 16:10:14.462956 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-DeleteServersTestJSON-1125268000 Aug 31 16:10:14.462956 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:10:14.462956 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:10:14.462956 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/af5a8bccbcb14afd9c6bcd6f4d4f8047"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/af5a8bccbcb14afd9c6bcd6f4d4f8047"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_af5a8bccbcb14afd9c6bcd6f4d4f8047", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/af5a8bccbcb14afd9c6bcd6f4d4f8047"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:10:14.462956 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-DeleteServersTestJSON-1125268000 Aug 31 16:10:14.462956 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: af5a8bccbcb14afd9c6bcd6f4d4f8047 Aug 31 16:10:14.462956 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-DeleteServersTestJSON-1125268000 Aug 31 16:10:14.462956 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-DeleteServersTestJSON-1125268000-project Aug 31 16:10:14.462956 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:10:14.462956 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:10:14.462956 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 4ee58e6a7c284cc9a9c87d0a5c1239aa Aug 31 16:10:14.462956 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-DeleteServersTestJSON-1125268000-project Aug 31 16:10:14.462956 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:10:14.462956 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance 0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c could not be found. Aug 31 16:10:14.462956 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c'} Aug 31 16:10:14.462956 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:10:14.462956 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:14.462956 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:10:14.462956 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:10:14.462956 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:10:14.462956 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:10:14.462956 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:10:14.462956 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:10:14.462956 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:10:14.462956 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:10:14.462956 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c could not be found. Aug 31 16:10:14.462956 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:10:14.462956 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:10:14.462956 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:10:14.462956 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:14.462956 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:10:14.462956 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:10:14.462956 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:10:14.462956 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:10:14.462956 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:10:14.462956 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:10:14.462956 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:10:14.462956 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:10:14.462956 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:10:14.462956 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:10:14.462956 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:10:14.462956 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:10:14.462956 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:10:14.462956 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:10:14.467895 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c could not be found. Aug 31 16:10:14.467895 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:10:14.467895 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:10:14.467895 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:10:14.467895 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:14.467895 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:10:14.467895 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:10:14.467895 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:10:14.467895 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:10:14.467895 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c could not be found. Aug 31 16:10:14.467895 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:10:14.474904 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b21a7edd-b2e4-488a-bd9e-6192af313997 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Returning 404 to user: Instance 0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:10:14.477382 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b21a7edd-b2e4-488a-bd9e-6192af313997 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "DELETE /compute/v2.1/servers/0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c" status: 404 len: 111 microversion: 2.1 time: 0.152645 Aug 31 16:10:14.481429 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1595/3165] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:10:14 2022] DELETE /compute/v2.1/servers/0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c => generated 111 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:10:14.497801 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8afd4fe3-ff6b-477f-ba94-7ffb8f3ca22a tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:14.500550 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8afd4fe3-ff6b-477f-ba94-7ffb8f3ca22a tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] [instance: 0ac914d2-e9f7-4f2f-a01d-49674180d8db] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:14.527179 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8afd4fe3-ff6b-477f-ba94-7ffb8f3ca22a tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:14.528317 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8afd4fe3-ff6b-477f-ba94-7ffb8f3ca22a tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:14.529888 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8afd4fe3-ff6b-477f-ba94-7ffb8f3ca22a tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:14.534916 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8afd4fe3-ff6b-477f-ba94-7ffb8f3ca22a tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:14.537112 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8afd4fe3-ff6b-477f-ba94-7ffb8f3ca22a tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:14.538064 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8afd4fe3-ff6b-477f-ba94-7ffb8f3ca22a tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:15.009763 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=8 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:10:15.022819 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-4cd40728-9c24-4a2d-822e-6a04bbf33b21 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68db583fb8fd4e6090fb220eeaafdd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c965154856f84fecb30f49dfeac46fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:15.050964 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4cd40728-9c24-4a2d-822e-6a04bbf33b21 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] 10.222.0.61 "GET /compute/v2.1/servers/b68db583-0d09-4485-8b26-ff5c02e23c01" status: 200 len: 1516 microversion: 2.1 time: 0.867120 Aug 31 16:10:15.057311 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1571/3166] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:14 2022] GET /compute/v2.1/servers/b68db583-0d09-4485-8b26-ff5c02e23c01 => generated 1516 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:15.069530 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-40d8cc08-7fe3-43fb-aa1a-7ea7552d2aeb tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:15.072928 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-40d8cc08-7fe3-43fb-aa1a-7ea7552d2aeb tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:15.094481 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-40d8cc08-7fe3-43fb-aa1a-7ea7552d2aeb tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:15.096065 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-40d8cc08-7fe3-43fb-aa1a-7ea7552d2aeb tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:15.097991 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-40d8cc08-7fe3-43fb-aa1a-7ea7552d2aeb tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:15.101322 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-40d8cc08-7fe3-43fb-aa1a-7ea7552d2aeb tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:15.102615 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-40d8cc08-7fe3-43fb-aa1a-7ea7552d2aeb tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:15.103460 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-40d8cc08-7fe3-43fb-aa1a-7ea7552d2aeb tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:15.130024 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-40d8cc08-7fe3-43fb-aa1a-7ea7552d2aeb tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] HTTP exception thrown: Instance 0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c could not be found. Aug 31 16:10:15.133292 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-40d8cc08-7fe3-43fb-aa1a-7ea7552d2aeb tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Request method failure captured: Aug 31 16:10:15.133292 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c HTTP/1.1 Aug 31 16:10:15.133292 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:10:15.133292 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:10:15.133292 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:10:15.133292 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:10:15.133292 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:10:15.133292 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:10:15.133292 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:10:15.133292 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:10:15.133292 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4Yo5dNOTiRoHOXx-UM5Sn8Jbzoi0Z4yz9YBk3W8_DEhZnVZu-DDO0QOzNoQHJ1nNP8QtjbDsJSdq3n7hK4ZXI2LEyeWPrk9aNaREtGRbElEfeP-G76pg20KjiuDCyp0gfSMP_cw21bhq2fJbey8HuCI0lmGBIAsUVWfxqkVQu-gwfg Aug 31 16:10:15.133292 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:10:15.133292 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:10:15.133292 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:10:15.133292 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:10:15.133292 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:10:15.133292 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:10:15.133292 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: af5a8bccbcb14afd9c6bcd6f4d4f8047 Aug 31 16:10:15.133292 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-DeleteServersTestJSON-1125268000 Aug 31 16:10:15.133292 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:10:15.133292 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:10:15.133292 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/af5a8bccbcb14afd9c6bcd6f4d4f8047"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/af5a8bccbcb14afd9c6bcd6f4d4f8047"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_af5a8bccbcb14afd9c6bcd6f4d4f8047", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/af5a8bccbcb14afd9c6bcd6f4d4f8047"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:10:15.133292 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-DeleteServersTestJSON-1125268000 Aug 31 16:10:15.133292 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: af5a8bccbcb14afd9c6bcd6f4d4f8047 Aug 31 16:10:15.133292 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-DeleteServersTestJSON-1125268000 Aug 31 16:10:15.133292 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-DeleteServersTestJSON-1125268000-project Aug 31 16:10:15.133292 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:10:15.133292 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:10:15.133292 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 4ee58e6a7c284cc9a9c87d0a5c1239aa Aug 31 16:10:15.133292 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-DeleteServersTestJSON-1125268000-project Aug 31 16:10:15.133292 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:10:15.133292 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance 0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c could not be found. Aug 31 16:10:15.133292 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c'} Aug 31 16:10:15.133292 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:10:15.133292 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:15.133292 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:10:15.133292 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:10:15.133292 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:10:15.133292 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:10:15.133292 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:10:15.133292 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:10:15.133292 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:10:15.133292 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:10:15.133292 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c could not be found. Aug 31 16:10:15.133292 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:10:15.133292 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:10:15.133292 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:10:15.133292 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:15.133292 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:10:15.133292 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:10:15.133292 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:10:15.133292 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:10:15.133292 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:10:15.133292 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:10:15.133292 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:10:15.133292 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:10:15.133292 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:10:15.133292 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:10:15.133292 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:10:15.133292 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:10:15.133292 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c could not be found. Aug 31 16:10:15.133292 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:10:15.133292 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:10:15.133292 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:10:15.138846 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:15.138846 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:10:15.138846 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:10:15.138846 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:10:15.138846 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:10:15.138846 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c could not be found. Aug 31 16:10:15.138846 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:10:15.141337 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-40d8cc08-7fe3-43fb-aa1a-7ea7552d2aeb tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Returning 404 to user: Instance 0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:10:15.142638 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-40d8cc08-7fe3-43fb-aa1a-7ea7552d2aeb tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c" status: 404 len: 111 microversion: 2.1 time: 0.082852 Aug 31 16:10:15.144206 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1572/3167] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:15 2022] GET /compute/v2.1/servers/0a70788e-a76f-4d5c-a2ba-b8d528f8fd4c => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:10:15.152179 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-63e3b9ca-7b96-4cb7-b43c-425149d1f6bc tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:15.153171 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-63e3b9ca-7b96-4cb7-b43c-425149d1f6bc tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] [instance: c393928f-2414-4093-9d72-93a21fc6c460] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:15.165674 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-63e3b9ca-7b96-4cb7-b43c-425149d1f6bc tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:15.166199 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-63e3b9ca-7b96-4cb7-b43c-425149d1f6bc tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:15.166654 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-63e3b9ca-7b96-4cb7-b43c-425149d1f6bc tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:15.171220 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-63e3b9ca-7b96-4cb7-b43c-425149d1f6bc tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:15.171993 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-63e3b9ca-7b96-4cb7-b43c-425149d1f6bc tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:15.172818 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-63e3b9ca-7b96-4cb7-b43c-425149d1f6bc tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:15.438999 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8afd4fe3-ff6b-477f-ba94-7ffb8f3ca22a tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c65ee5ffa9d74bfdacbea45f1564d19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55320a9c8f714bc0911ded3ab88ddf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:15.471177 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8afd4fe3-ff6b-477f-ba94-7ffb8f3ca22a tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] 10.222.0.61 "GET /compute/v2.1/servers/0ac914d2-e9f7-4f2f-a01d-49674180d8db" status: 200 len: 1293 microversion: 2.1 time: 0.984865 Aug 31 16:10:15.472347 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1596/3168] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:14 2022] GET /compute/v2.1/servers/0ac914d2-e9f7-4f2f-a01d-49674180d8db => generated 1293 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:15.499014 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-ca187e64-c354-4d71-8ea7-c332af1c1cf9 req-032e2b61-662b-4769-949a-bc0c92202a90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eed024b5-986b-40fa-a686-ceab563a6131", "name": "network-vif-plugged", "status": "completed", "tag": "512921c8-73a5-4a95-ab19-e9b589b7421e"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:10:15.532967 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-ca187e64-c354-4d71-8ea7-c332af1c1cf9 req-032e2b61-662b-4769-949a-bc0c92202a90 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:15.534335 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-ca187e64-c354-4d71-8ea7-c332af1c1cf9 req-032e2b61-662b-4769-949a-bc0c92202a90 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:15.543843 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-ca187e64-c354-4d71-8ea7-c332af1c1cf9 req-032e2b61-662b-4769-949a-bc0c92202a90 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:15.559458 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-ca187e64-c354-4d71-8ea7-c332af1c1cf9 req-032e2b61-662b-4769-949a-bc0c92202a90 service nova] Creating event network-vif-plugged:512921c8-73a5-4a95-ab19-e9b589b7421e for instance eed024b5-986b-40fa-a686-ceab563a6131 on n-h1-850499-9 Aug 31 16:10:15.566466 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-ca187e64-c354-4d71-8ea7-c332af1c1cf9 req-032e2b61-662b-4769-949a-bc0c92202a90 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090777 Aug 31 16:10:15.568311 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1597/3169] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:10:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:10:15.578596 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-88ea700b-418d-45d5-841d-546e1982fcae tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:15.579549 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-88ea700b-418d-45d5-841d-546e1982fcae tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] [instance: b68db583-0d09-4485-8b26-ff5c02e23c01] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:15.593575 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-88ea700b-418d-45d5-841d-546e1982fcae tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:15.594481 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-88ea700b-418d-45d5-841d-546e1982fcae tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:15.596313 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-88ea700b-418d-45d5-841d-546e1982fcae tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:15.600669 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-88ea700b-418d-45d5-841d-546e1982fcae tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:15.602072 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-88ea700b-418d-45d5-841d-546e1982fcae tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:15.604815 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-88ea700b-418d-45d5-841d-546e1982fcae tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:15.661417 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-88ea700b-418d-45d5-841d-546e1982fcae tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] [instance: b68db583-0d09-4485-8b26-ff5c02e23c01] Going to try to terminate instance {{(pid=122256) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:10:15.709024 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-63e3b9ca-7b96-4cb7-b43c-425149d1f6bc tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b93395d63a4db895ff224a311940e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf281e8857247c6b9e60d4216741f89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:15.725643 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-63e3b9ca-7b96-4cb7-b43c-425149d1f6bc tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] 10.222.0.61 "GET /compute/v2.1/servers/c393928f-2414-4093-9d72-93a21fc6c460" status: 200 len: 1499 microversion: 2.1 time: 0.577059 Aug 31 16:10:15.726726 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1573/3170] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:15 2022] GET /compute/v2.1/servers/c393928f-2414-4093-9d72-93a21fc6c460 => generated 1499 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:15.734464 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-164b3c33-8566-4da2-84cc-171fc8de2707 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:15.739882 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-164b3c33-8566-4da2-84cc-171fc8de2707 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 0a5d6a47-ce38-4d1d-8d97-550f5e950af5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:15.760183 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-164b3c33-8566-4da2-84cc-171fc8de2707 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:15.764347 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-164b3c33-8566-4da2-84cc-171fc8de2707 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:15.768166 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-164b3c33-8566-4da2-84cc-171fc8de2707 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:15.771156 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-164b3c33-8566-4da2-84cc-171fc8de2707 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:15.772045 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-164b3c33-8566-4da2-84cc-171fc8de2707 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:15.774326 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-164b3c33-8566-4da2-84cc-171fc8de2707 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:15.813957 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-164b3c33-8566-4da2-84cc-171fc8de2707 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] HTTP exception thrown: Instance 0a5d6a47-ce38-4d1d-8d97-550f5e950af5 could not be found. Aug 31 16:10:15.818285 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-164b3c33-8566-4da2-84cc-171fc8de2707 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Request method failure captured: Aug 31 16:10:15.818285 n-d-850499-9 devstack@n-api.service[122257]: request: DELETE /compute/v2.1/servers/0a5d6a47-ce38-4d1d-8d97-550f5e950af5 HTTP/1.1 Aug 31 16:10:15.818285 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:10:15.818285 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:10:15.818285 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:10:15.818285 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:10:15.818285 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:10:15.818285 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:10:15.818285 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:10:15.818285 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:10:15.818285 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4Yo5dNOTiRoHOXx-UM5Sn8Jbzoi0Z4yz9YBk3W8_DEhZnVZu-DDO0QOzNoQHJ1nNP8QtjbDsJSdq3n7hK4ZXI2LEyeWPrk9aNaREtGRbElEfeP-G76pg20KjiuDCyp0gfSMP_cw21bhq2fJbey8HuCI0lmGBIAsUVWfxqkVQu-gwfg Aug 31 16:10:15.818285 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:10:15.818285 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:10:15.818285 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:10:15.818285 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:10:15.818285 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:10:15.818285 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:10:15.818285 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: af5a8bccbcb14afd9c6bcd6f4d4f8047 Aug 31 16:10:15.818285 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-DeleteServersTestJSON-1125268000 Aug 31 16:10:15.818285 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:10:15.818285 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:10:15.818285 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/af5a8bccbcb14afd9c6bcd6f4d4f8047"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/af5a8bccbcb14afd9c6bcd6f4d4f8047"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_af5a8bccbcb14afd9c6bcd6f4d4f8047", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/af5a8bccbcb14afd9c6bcd6f4d4f8047"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:10:15.818285 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-DeleteServersTestJSON-1125268000 Aug 31 16:10:15.818285 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: af5a8bccbcb14afd9c6bcd6f4d4f8047 Aug 31 16:10:15.818285 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-DeleteServersTestJSON-1125268000 Aug 31 16:10:15.818285 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-DeleteServersTestJSON-1125268000-project Aug 31 16:10:15.818285 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:10:15.818285 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:10:15.818285 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 4ee58e6a7c284cc9a9c87d0a5c1239aa Aug 31 16:10:15.818285 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-DeleteServersTestJSON-1125268000-project Aug 31 16:10:15.818285 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:10:15.818285 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance 0a5d6a47-ce38-4d1d-8d97-550f5e950af5 could not be found. Aug 31 16:10:15.818285 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '0a5d6a47-ce38-4d1d-8d97-550f5e950af5'} Aug 31 16:10:15.818285 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:10:15.818285 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:15.818285 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:10:15.818285 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:10:15.818285 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:10:15.818285 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:10:15.818285 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:10:15.818285 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:10:15.818285 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:10:15.818285 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:10:15.818285 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a5d6a47-ce38-4d1d-8d97-550f5e950af5 could not be found. Aug 31 16:10:15.818285 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:10:15.818285 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:10:15.818285 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:10:15.818285 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:15.818285 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:10:15.818285 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:10:15.818285 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:10:15.818285 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:10:15.818285 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:10:15.818285 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:10:15.818285 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:10:15.818285 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:10:15.818285 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:10:15.818285 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:10:15.818285 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:10:15.818285 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:10:15.818285 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:10:15.818285 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:10:15.825355 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a5d6a47-ce38-4d1d-8d97-550f5e950af5 could not be found. Aug 31 16:10:15.825355 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:10:15.825355 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:10:15.825355 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:10:15.825355 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:15.825355 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:10:15.825355 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:10:15.825355 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:10:15.825355 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:10:15.825355 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a5d6a47-ce38-4d1d-8d97-550f5e950af5 could not be found. Aug 31 16:10:15.825355 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:10:15.829557 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-164b3c33-8566-4da2-84cc-171fc8de2707 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Returning 404 to user: Instance 0a5d6a47-ce38-4d1d-8d97-550f5e950af5 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:10:15.830928 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-164b3c33-8566-4da2-84cc-171fc8de2707 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "DELETE /compute/v2.1/servers/0a5d6a47-ce38-4d1d-8d97-550f5e950af5" status: 404 len: 111 microversion: 2.1 time: 0.102950 Aug 31 16:10:15.832012 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1574/3171] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:10:15 2022] DELETE /compute/v2.1/servers/0a5d6a47-ce38-4d1d-8d97-550f5e950af5 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:10:15.857312 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-61c70a9b-88e9-40c5-b4f6-17fe531025b1 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:15.858492 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-61c70a9b-88e9-40c5-b4f6-17fe531025b1 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] [instance: eed024b5-986b-40fa-a686-ceab563a6131] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:15.870039 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-61c70a9b-88e9-40c5-b4f6-17fe531025b1 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:15.870565 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-61c70a9b-88e9-40c5-b4f6-17fe531025b1 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:15.871082 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-61c70a9b-88e9-40c5-b4f6-17fe531025b1 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:15.871933 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-61c70a9b-88e9-40c5-b4f6-17fe531025b1 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:15.872408 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-61c70a9b-88e9-40c5-b4f6-17fe531025b1 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:15.872902 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-61c70a9b-88e9-40c5-b4f6-17fe531025b1 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:15.878741 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-88ea700b-418d-45d5-841d-546e1982fcae tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] 10.222.0.61 "DELETE /compute/v2.1/servers/b68db583-0d09-4485-8b26-ff5c02e23c01" status: 204 len: 0 microversion: 2.1 time: 0.307105 Aug 31 16:10:15.879834 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1598/3172] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:10:15 2022] DELETE /compute/v2.1/servers/b68db583-0d09-4485-8b26-ff5c02e23c01 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:10:15.889916 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-619abcd9-3125-497c-8fec-ab343bd61dca tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:15.896576 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-619abcd9-3125-497c-8fec-ab343bd61dca tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '41b93395d63a4db895ff224a311940e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf281e8857247c6b9e60d4216741f89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:15.898521 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-619abcd9-3125-497c-8fec-ab343bd61dca tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '1cf281e8857247c6b9e60d4216741f89'} {{(pid=122256) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 16:10:15.912588 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-619abcd9-3125-497c-8fec-ab343bd61dca tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:15.915885 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-619abcd9-3125-497c-8fec-ab343bd61dca tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:15.916762 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-619abcd9-3125-497c-8fec-ab343bd61dca tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:15.918538 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-619abcd9-3125-497c-8fec-ab343bd61dca tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:15.922921 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-619abcd9-3125-497c-8fec-ab343bd61dca tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:15.925199 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-619abcd9-3125-497c-8fec-ab343bd61dca tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:15.994031 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.multi_cell_list [None req-619abcd9-3125-497c-8fec-ab343bd61dca tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122256) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 31 16:10:16.074009 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-619abcd9-3125-497c-8fec-ab343bd61dca tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] 10.222.0.61 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 345 microversion: 2.1 time: 0.189904 Aug 31 16:10:16.081722 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1599/3173] 10.222.0.61 () {58 vars in 1154 bytes} [Wed Aug 31 16:10:15 2022] GET /compute/v2.1/servers?status=shutoff => generated 345 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:10:16.094807 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d1658445-9fcd-4edd-82aa-577decd6e953 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:16.100891 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d1658445-9fcd-4edd-82aa-577decd6e953 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 0a5d6a47-ce38-4d1d-8d97-550f5e950af5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:16.114644 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d1658445-9fcd-4edd-82aa-577decd6e953 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:16.115529 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d1658445-9fcd-4edd-82aa-577decd6e953 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:16.116235 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d1658445-9fcd-4edd-82aa-577decd6e953 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:16.117273 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d1658445-9fcd-4edd-82aa-577decd6e953 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:16.117995 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d1658445-9fcd-4edd-82aa-577decd6e953 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:16.118698 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d1658445-9fcd-4edd-82aa-577decd6e953 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:16.153788 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-d1658445-9fcd-4edd-82aa-577decd6e953 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] HTTP exception thrown: Instance 0a5d6a47-ce38-4d1d-8d97-550f5e950af5 could not be found. Aug 31 16:10:16.160702 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d1658445-9fcd-4edd-82aa-577decd6e953 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Request method failure captured: Aug 31 16:10:16.160702 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/0a5d6a47-ce38-4d1d-8d97-550f5e950af5 HTTP/1.1 Aug 31 16:10:16.160702 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:10:16.160702 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:10:16.160702 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:10:16.160702 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:10:16.160702 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:10:16.160702 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:10:16.160702 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:10:16.160702 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:10:16.160702 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4Yo5dNOTiRoHOXx-UM5Sn8Jbzoi0Z4yz9YBk3W8_DEhZnVZu-DDO0QOzNoQHJ1nNP8QtjbDsJSdq3n7hK4ZXI2LEyeWPrk9aNaREtGRbElEfeP-G76pg20KjiuDCyp0gfSMP_cw21bhq2fJbey8HuCI0lmGBIAsUVWfxqkVQu-gwfg Aug 31 16:10:16.160702 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:10:16.160702 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:10:16.160702 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:10:16.160702 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:10:16.160702 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:10:16.160702 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:10:16.160702 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: af5a8bccbcb14afd9c6bcd6f4d4f8047 Aug 31 16:10:16.160702 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-DeleteServersTestJSON-1125268000 Aug 31 16:10:16.160702 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:10:16.160702 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:10:16.160702 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/af5a8bccbcb14afd9c6bcd6f4d4f8047"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/af5a8bccbcb14afd9c6bcd6f4d4f8047"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_af5a8bccbcb14afd9c6bcd6f4d4f8047", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/af5a8bccbcb14afd9c6bcd6f4d4f8047"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:10:16.160702 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-DeleteServersTestJSON-1125268000 Aug 31 16:10:16.160702 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: af5a8bccbcb14afd9c6bcd6f4d4f8047 Aug 31 16:10:16.160702 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-DeleteServersTestJSON-1125268000 Aug 31 16:10:16.160702 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-DeleteServersTestJSON-1125268000-project Aug 31 16:10:16.160702 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:10:16.160702 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:10:16.160702 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 4ee58e6a7c284cc9a9c87d0a5c1239aa Aug 31 16:10:16.160702 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-DeleteServersTestJSON-1125268000-project Aug 31 16:10:16.160702 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:10:16.160702 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance 0a5d6a47-ce38-4d1d-8d97-550f5e950af5 could not be found. Aug 31 16:10:16.160702 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '0a5d6a47-ce38-4d1d-8d97-550f5e950af5'} Aug 31 16:10:16.160702 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:10:16.160702 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:16.160702 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:10:16.160702 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:10:16.160702 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:10:16.160702 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:10:16.160702 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:10:16.160702 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:10:16.160702 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:10:16.160702 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:10:16.160702 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a5d6a47-ce38-4d1d-8d97-550f5e950af5 could not be found. Aug 31 16:10:16.160702 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:10:16.160702 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:10:16.160702 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:10:16.160702 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:16.160702 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:10:16.160702 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:10:16.160702 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:10:16.160702 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:10:16.160702 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:10:16.160702 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:10:16.160702 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:10:16.160702 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:10:16.160702 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:10:16.160702 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:10:16.160702 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:10:16.160702 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:10:16.160702 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a5d6a47-ce38-4d1d-8d97-550f5e950af5 could not be found. Aug 31 16:10:16.160702 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:10:16.160702 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:10:16.160702 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:10:16.166421 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:16.166421 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:10:16.166421 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:10:16.166421 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:10:16.166421 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:10:16.166421 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a5d6a47-ce38-4d1d-8d97-550f5e950af5 could not be found. Aug 31 16:10:16.166421 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:10:16.167718 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d1658445-9fcd-4edd-82aa-577decd6e953 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Returning 404 to user: Instance 0a5d6a47-ce38-4d1d-8d97-550f5e950af5 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:10:16.169368 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d1658445-9fcd-4edd-82aa-577decd6e953 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/0a5d6a47-ce38-4d1d-8d97-550f5e950af5" status: 404 len: 111 microversion: 2.1 time: 0.080248 Aug 31 16:10:16.172545 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1600/3174] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:16 2022] GET /compute/v2.1/servers/0a5d6a47-ce38-4d1d-8d97-550f5e950af5 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:10:16.186681 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5b14ff7f-7ee6-4eaf-9c20-fa5dee72e24e tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:16.187423 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5b14ff7f-7ee6-4eaf-9c20-fa5dee72e24e tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] [instance: b68db583-0d09-4485-8b26-ff5c02e23c01] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:16.202351 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5b14ff7f-7ee6-4eaf-9c20-fa5dee72e24e tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:16.207743 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5b14ff7f-7ee6-4eaf-9c20-fa5dee72e24e tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:16.208600 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5b14ff7f-7ee6-4eaf-9c20-fa5dee72e24e tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:16.215221 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5b14ff7f-7ee6-4eaf-9c20-fa5dee72e24e tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:16.221079 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5b14ff7f-7ee6-4eaf-9c20-fa5dee72e24e tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:16.222364 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5b14ff7f-7ee6-4eaf-9c20-fa5dee72e24e tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:16.762945 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-61c70a9b-88e9-40c5-b4f6-17fe531025b1 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab268a4d607497da5476256055bb07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14140e7303046f1ada446437826f742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:16.771108 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-61c70a9b-88e9-40c5-b4f6-17fe531025b1 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] 10.222.0.61 "GET /compute/v2.1/servers/eed024b5-986b-40fa-a686-ceab563a6131" status: 200 len: 1365 microversion: 2.1 time: 0.925695 Aug 31 16:10:16.784484 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1575/3175] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:15 2022] GET /compute/v2.1/servers/eed024b5-986b-40fa-a686-ceab563a6131 => generated 1365 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:16.792793 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f56720f9-8f85-4562-93df-868d8ec22983 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:10:16.799257 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f56720f9-8f85-4562-93df-868d8ec22983 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:16.799990 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f56720f9-8f85-4562-93df-868d8ec22983 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:16.800619 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f56720f9-8f85-4562-93df-868d8ec22983 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:16.830068 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f56720f9-8f85-4562-93df-868d8ec22983 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] [instance: c393928f-2414-4093-9d72-93a21fc6c460] Going to try to start instance {{(pid=122257) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 31 16:10:16.834963 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=100 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:10:16.903293 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f56720f9-8f85-4562-93df-868d8ec22983 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] 10.222.0.61 "POST /compute/v2.1/servers/c393928f-2414-4093-9d72-93a21fc6c460/action" status: 202 len: 0 microversion: 2.1 time: 0.116187 Aug 31 16:10:16.904744 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1576/3176] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:10:16 2022] POST /compute/v2.1/servers/c393928f-2414-4093-9d72-93a21fc6c460/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:10:16.914292 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-cbfabc25-3c55-41e7-a221-1243014ebd93 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:16.915824 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-cbfabc25-3c55-41e7-a221-1243014ebd93 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: db1ac026-e512-4e5f-839d-4056cec509b3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:16.926639 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cbfabc25-3c55-41e7-a221-1243014ebd93 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:16.929291 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cbfabc25-3c55-41e7-a221-1243014ebd93 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:16.930275 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cbfabc25-3c55-41e7-a221-1243014ebd93 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:16.931452 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cbfabc25-3c55-41e7-a221-1243014ebd93 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:16.932240 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cbfabc25-3c55-41e7-a221-1243014ebd93 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:16.932939 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cbfabc25-3c55-41e7-a221-1243014ebd93 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:16.953789 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-cbfabc25-3c55-41e7-a221-1243014ebd93 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] HTTP exception thrown: Instance db1ac026-e512-4e5f-839d-4056cec509b3 could not be found. Aug 31 16:10:16.955533 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-cbfabc25-3c55-41e7-a221-1243014ebd93 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Request method failure captured: Aug 31 16:10:16.955533 n-d-850499-9 devstack@n-api.service[122257]: request: DELETE /compute/v2.1/servers/db1ac026-e512-4e5f-839d-4056cec509b3 HTTP/1.1 Aug 31 16:10:16.955533 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:10:16.955533 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:10:16.955533 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:10:16.955533 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:10:16.955533 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:10:16.955533 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:10:16.955533 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:10:16.955533 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:10:16.955533 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4Yo5dNOTiRoHOXx-UM5Sn8Jbzoi0Z4yz9YBk3W8_DEhZnVZu-DDO0QOzNoQHJ1nNP8QtjbDsJSdq3n7hK4ZXI2LEyeWPrk9aNaREtGRbElEfeP-G76pg20KjiuDCyp0gfSMP_cw21bhq2fJbey8HuCI0lmGBIAsUVWfxqkVQu-gwfg Aug 31 16:10:16.955533 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:10:16.955533 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:10:16.955533 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:10:16.955533 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:10:16.955533 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:10:16.955533 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:10:16.955533 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: af5a8bccbcb14afd9c6bcd6f4d4f8047 Aug 31 16:10:16.955533 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-DeleteServersTestJSON-1125268000 Aug 31 16:10:16.955533 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:10:16.955533 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:10:16.955533 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/af5a8bccbcb14afd9c6bcd6f4d4f8047"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/af5a8bccbcb14afd9c6bcd6f4d4f8047"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_af5a8bccbcb14afd9c6bcd6f4d4f8047", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/af5a8bccbcb14afd9c6bcd6f4d4f8047"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:10:16.955533 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-DeleteServersTestJSON-1125268000 Aug 31 16:10:16.955533 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: af5a8bccbcb14afd9c6bcd6f4d4f8047 Aug 31 16:10:16.955533 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-DeleteServersTestJSON-1125268000 Aug 31 16:10:16.955533 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-DeleteServersTestJSON-1125268000-project Aug 31 16:10:16.955533 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:10:16.955533 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:10:16.955533 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 4ee58e6a7c284cc9a9c87d0a5c1239aa Aug 31 16:10:16.955533 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-DeleteServersTestJSON-1125268000-project Aug 31 16:10:16.955533 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:10:16.955533 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance db1ac026-e512-4e5f-839d-4056cec509b3 could not be found. Aug 31 16:10:16.955533 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': 'db1ac026-e512-4e5f-839d-4056cec509b3'} Aug 31 16:10:16.955533 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:10:16.955533 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:16.955533 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:10:16.955533 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:10:16.955533 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:10:16.955533 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:10:16.955533 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:10:16.955533 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:10:16.955533 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:10:16.955533 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:10:16.955533 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db1ac026-e512-4e5f-839d-4056cec509b3 could not be found. Aug 31 16:10:16.955533 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:10:16.955533 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:10:16.955533 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:10:16.955533 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:16.955533 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:10:16.955533 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:10:16.955533 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:10:16.955533 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:10:16.955533 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:10:16.955533 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:10:16.955533 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:10:16.955533 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:10:16.955533 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:10:16.955533 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:10:16.955533 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:10:16.955533 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:10:16.955533 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:10:16.955533 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:10:16.959382 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db1ac026-e512-4e5f-839d-4056cec509b3 could not be found. Aug 31 16:10:16.959382 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:10:16.959382 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:10:16.959382 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:10:16.959382 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:16.959382 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:10:16.959382 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:10:16.959382 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:10:16.959382 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:10:16.959382 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db1ac026-e512-4e5f-839d-4056cec509b3 could not be found. Aug 31 16:10:16.959382 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:10:16.959382 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-cbfabc25-3c55-41e7-a221-1243014ebd93 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Returning 404 to user: Instance db1ac026-e512-4e5f-839d-4056cec509b3 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:10:16.959382 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-cbfabc25-3c55-41e7-a221-1243014ebd93 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "DELETE /compute/v2.1/servers/db1ac026-e512-4e5f-839d-4056cec509b3" status: 404 len: 111 microversion: 2.1 time: 0.050802 Aug 31 16:10:16.959382 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1577/3177] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:10:16 2022] DELETE /compute/v2.1/servers/db1ac026-e512-4e5f-839d-4056cec509b3 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:10:16.985401 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-dc62a456-cb5f-469b-9cba-86a0840e5212 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:16.987693 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-dc62a456-cb5f-469b-9cba-86a0840e5212 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] [instance: 0ac914d2-e9f7-4f2f-a01d-49674180d8db] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:16.995344 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dc62a456-cb5f-469b-9cba-86a0840e5212 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:16.995877 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dc62a456-cb5f-469b-9cba-86a0840e5212 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:16.996459 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dc62a456-cb5f-469b-9cba-86a0840e5212 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:16.997777 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dc62a456-cb5f-469b-9cba-86a0840e5212 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:16.999190 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dc62a456-cb5f-469b-9cba-86a0840e5212 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:17.000261 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dc62a456-cb5f-469b-9cba-86a0840e5212 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:17.017375 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5b14ff7f-7ee6-4eaf-9c20-fa5dee72e24e tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68db583fb8fd4e6090fb220eeaafdd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c965154856f84fecb30f49dfeac46fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:17.043482 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5b14ff7f-7ee6-4eaf-9c20-fa5dee72e24e tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] 10.222.0.61 "GET /compute/v2.1/servers/b68db583-0d09-4485-8b26-ff5c02e23c01" status: 200 len: 1522 microversion: 2.1 time: 0.866965 Aug 31 16:10:17.046168 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1601/3178] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:16 2022] GET /compute/v2.1/servers/b68db583-0d09-4485-8b26-ff5c02e23c01 => generated 1522 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:17.058845 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-499288e7-a5f1-4dbb-8f61-838dcfeeebbd tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:17.059787 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-499288e7-a5f1-4dbb-8f61-838dcfeeebbd tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] [instance: c393928f-2414-4093-9d72-93a21fc6c460] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:17.076976 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-499288e7-a5f1-4dbb-8f61-838dcfeeebbd tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:17.077572 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-499288e7-a5f1-4dbb-8f61-838dcfeeebbd tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:17.078088 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-499288e7-a5f1-4dbb-8f61-838dcfeeebbd tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:17.079618 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-499288e7-a5f1-4dbb-8f61-838dcfeeebbd tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:17.080222 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-499288e7-a5f1-4dbb-8f61-838dcfeeebbd tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:17.080668 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-499288e7-a5f1-4dbb-8f61-838dcfeeebbd tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:17.605452 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-dc62a456-cb5f-469b-9cba-86a0840e5212 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c65ee5ffa9d74bfdacbea45f1564d19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55320a9c8f714bc0911ded3ab88ddf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:17.608703 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-499288e7-a5f1-4dbb-8f61-838dcfeeebbd tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b93395d63a4db895ff224a311940e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf281e8857247c6b9e60d4216741f89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:17.614034 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-dc62a456-cb5f-469b-9cba-86a0840e5212 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] 10.222.0.61 "GET /compute/v2.1/servers/0ac914d2-e9f7-4f2f-a01d-49674180d8db" status: 200 len: 1293 microversion: 2.1 time: 0.655472 Aug 31 16:10:17.614967 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1578/3179] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:16 2022] GET /compute/v2.1/servers/0ac914d2-e9f7-4f2f-a01d-49674180d8db => generated 1293 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:17.620182 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c3a821f3-c562-4ee5-b7c9-5fcc1ed2d768 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-480108271", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "b0d4a090-bcfb-4391-8f67-1bf0791c2756"}, {"port": "4a18af29-4324-4844-bf75-25dcac3740f5", "tag": "port-1"}, {"port": "fd6970db-5a6c-4005-91a0-c09d46e9fd47", "tag": "port-2"}, {"uuid": "fb89fb4d-556d-4d60-b8d1-f716a8c0937c", "tag": "net-1"}, {"uuid": "fb89fb4d-556d-4d60-b8d1-f716a8c0937c"}, {"uuid": "35f33868-2b91-4189-b7e9-af9df4b85daa", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "35f33868-2b91-4189-b7e9-af9df4b85daa", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "6b9d535d-ca18-41f8-b818-cd9d83454608", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "16f75ca9-7666-4176-a9ae-21c719ce918d", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "d67e87dd-a329-4f9d-a6df-e3917023ba09", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1774558507"}], "key_name": "tempest-keypair-1688734994", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:10:17.634720 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-499288e7-a5f1-4dbb-8f61-838dcfeeebbd tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] 10.222.0.61 "GET /compute/v2.1/servers/c393928f-2414-4093-9d72-93a21fc6c460" status: 200 len: 1508 microversion: 2.1 time: 0.587202 Aug 31 16:10:17.635920 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1602/3180] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:17 2022] GET /compute/v2.1/servers/c393928f-2414-4093-9d72-93a21fc6c460 => generated 1508 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:17.642692 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-37087f71-a840-4e4f-a75e-45852aa5f8a0 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:17.643306 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-37087f71-a840-4e4f-a75e-45852aa5f8a0 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: db1ac026-e512-4e5f-839d-4056cec509b3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:17.652170 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-37087f71-a840-4e4f-a75e-45852aa5f8a0 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:17.652671 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-37087f71-a840-4e4f-a75e-45852aa5f8a0 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:17.653117 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-37087f71-a840-4e4f-a75e-45852aa5f8a0 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:17.654998 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-37087f71-a840-4e4f-a75e-45852aa5f8a0 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:17.655530 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-37087f71-a840-4e4f-a75e-45852aa5f8a0 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:17.655975 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-37087f71-a840-4e4f-a75e-45852aa5f8a0 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:17.673582 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-37087f71-a840-4e4f-a75e-45852aa5f8a0 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] HTTP exception thrown: Instance db1ac026-e512-4e5f-839d-4056cec509b3 could not be found. Aug 31 16:10:17.675408 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-37087f71-a840-4e4f-a75e-45852aa5f8a0 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Request method failure captured: Aug 31 16:10:17.675408 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/db1ac026-e512-4e5f-839d-4056cec509b3 HTTP/1.1 Aug 31 16:10:17.675408 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:10:17.675408 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:10:17.675408 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:10:17.675408 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:10:17.675408 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:10:17.675408 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:10:17.675408 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:10:17.675408 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:10:17.675408 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4Yo5dNOTiRoHOXx-UM5Sn8Jbzoi0Z4yz9YBk3W8_DEhZnVZu-DDO0QOzNoQHJ1nNP8QtjbDsJSdq3n7hK4ZXI2LEyeWPrk9aNaREtGRbElEfeP-G76pg20KjiuDCyp0gfSMP_cw21bhq2fJbey8HuCI0lmGBIAsUVWfxqkVQu-gwfg Aug 31 16:10:17.675408 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:10:17.675408 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:10:17.675408 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:10:17.675408 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:10:17.675408 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:10:17.675408 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:10:17.675408 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: af5a8bccbcb14afd9c6bcd6f4d4f8047 Aug 31 16:10:17.675408 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-DeleteServersTestJSON-1125268000 Aug 31 16:10:17.675408 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:10:17.675408 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:10:17.675408 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/af5a8bccbcb14afd9c6bcd6f4d4f8047"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/af5a8bccbcb14afd9c6bcd6f4d4f8047"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_af5a8bccbcb14afd9c6bcd6f4d4f8047", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/af5a8bccbcb14afd9c6bcd6f4d4f8047"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:10:17.675408 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-DeleteServersTestJSON-1125268000 Aug 31 16:10:17.675408 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: af5a8bccbcb14afd9c6bcd6f4d4f8047 Aug 31 16:10:17.675408 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-DeleteServersTestJSON-1125268000 Aug 31 16:10:17.675408 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-DeleteServersTestJSON-1125268000-project Aug 31 16:10:17.675408 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:10:17.675408 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:10:17.675408 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 4ee58e6a7c284cc9a9c87d0a5c1239aa Aug 31 16:10:17.675408 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-DeleteServersTestJSON-1125268000-project Aug 31 16:10:17.675408 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:10:17.675408 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance db1ac026-e512-4e5f-839d-4056cec509b3 could not be found. Aug 31 16:10:17.675408 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': 'db1ac026-e512-4e5f-839d-4056cec509b3'} Aug 31 16:10:17.675408 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:10:17.675408 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:17.675408 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:10:17.675408 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:10:17.675408 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:10:17.675408 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:10:17.675408 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:10:17.675408 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:10:17.675408 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:10:17.675408 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:10:17.675408 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db1ac026-e512-4e5f-839d-4056cec509b3 could not be found. Aug 31 16:10:17.675408 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:10:17.675408 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:10:17.675408 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:10:17.675408 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:17.675408 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:10:17.675408 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:10:17.675408 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:10:17.675408 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:10:17.675408 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:10:17.675408 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:10:17.675408 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:10:17.675408 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:10:17.675408 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:10:17.675408 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:10:17.675408 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:10:17.675408 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:10:17.675408 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db1ac026-e512-4e5f-839d-4056cec509b3 could not be found. Aug 31 16:10:17.675408 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:10:17.675408 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:10:17.675408 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:10:17.683461 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:17.683461 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:10:17.683461 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:10:17.683461 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:10:17.683461 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:10:17.683461 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db1ac026-e512-4e5f-839d-4056cec509b3 could not be found. Aug 31 16:10:17.683461 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:10:17.683461 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-37087f71-a840-4e4f-a75e-45852aa5f8a0 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Returning 404 to user: Instance db1ac026-e512-4e5f-839d-4056cec509b3 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:10:17.683461 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-37087f71-a840-4e4f-a75e-45852aa5f8a0 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/db1ac026-e512-4e5f-839d-4056cec509b3" status: 404 len: 111 microversion: 2.1 time: 0.039693 Aug 31 16:10:17.683461 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1603/3181] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:17 2022] GET /compute/v2.1/servers/db1ac026-e512-4e5f-839d-4056cec509b3 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:10:17.685862 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-478645bf-493b-4829-ac0b-6914d99bfd0e req-264606fa-c0d8-4129-a8bd-12e908903aba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ac914d2-e9f7-4f2f-a01d-49674180d8db", "name": "network-vif-plugged", "status": "completed", "tag": "2c7e9f34-2b8a-470a-af28-22027bffc1a7"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:10:17.696106 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-478645bf-493b-4829-ac0b-6914d99bfd0e req-264606fa-c0d8-4129-a8bd-12e908903aba service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:17.697671 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-478645bf-493b-4829-ac0b-6914d99bfd0e req-264606fa-c0d8-4129-a8bd-12e908903aba service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:17.700148 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-478645bf-493b-4829-ac0b-6914d99bfd0e req-264606fa-c0d8-4129-a8bd-12e908903aba service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:17.715285 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-478645bf-493b-4829-ac0b-6914d99bfd0e req-264606fa-c0d8-4129-a8bd-12e908903aba service nova] Creating event network-vif-plugged:2c7e9f34-2b8a-470a-af28-22027bffc1a7 for instance 0ac914d2-e9f7-4f2f-a01d-49674180d8db on n-h2-850499-9 Aug 31 16:10:17.721327 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-478645bf-493b-4829-ac0b-6914d99bfd0e req-264606fa-c0d8-4129-a8bd-12e908903aba service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039104 Aug 31 16:10:17.722001 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1604/3182] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:10:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:10:17.728410 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9671bbe1-09f1-4ac9-8fbc-12168bce0403 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:17.729004 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9671bbe1-09f1-4ac9-8fbc-12168bce0403 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 1262191c-be8b-4535-8704-72db13e3f6cc] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:17.735798 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9671bbe1-09f1-4ac9-8fbc-12168bce0403 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:17.736480 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9671bbe1-09f1-4ac9-8fbc-12168bce0403 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:17.736926 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9671bbe1-09f1-4ac9-8fbc-12168bce0403 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:17.737635 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9671bbe1-09f1-4ac9-8fbc-12168bce0403 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:17.738092 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9671bbe1-09f1-4ac9-8fbc-12168bce0403 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:17.738516 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9671bbe1-09f1-4ac9-8fbc-12168bce0403 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:17.755420 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-9671bbe1-09f1-4ac9-8fbc-12168bce0403 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] HTTP exception thrown: Instance 1262191c-be8b-4535-8704-72db13e3f6cc could not be found. Aug 31 16:10:17.757146 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9671bbe1-09f1-4ac9-8fbc-12168bce0403 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Request method failure captured: Aug 31 16:10:17.757146 n-d-850499-9 devstack@n-api.service[122256]: request: DELETE /compute/v2.1/servers/1262191c-be8b-4535-8704-72db13e3f6cc HTTP/1.1 Aug 31 16:10:17.757146 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:10:17.757146 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:10:17.757146 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:10:17.757146 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:10:17.757146 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:10:17.757146 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:10:17.757146 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:10:17.757146 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:10:17.757146 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4Yo5dNOTiRoHOXx-UM5Sn8Jbzoi0Z4yz9YBk3W8_DEhZnVZu-DDO0QOzNoQHJ1nNP8QtjbDsJSdq3n7hK4ZXI2LEyeWPrk9aNaREtGRbElEfeP-G76pg20KjiuDCyp0gfSMP_cw21bhq2fJbey8HuCI0lmGBIAsUVWfxqkVQu-gwfg Aug 31 16:10:17.757146 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:10:17.757146 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:10:17.757146 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:10:17.757146 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:10:17.757146 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:10:17.757146 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:10:17.757146 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: af5a8bccbcb14afd9c6bcd6f4d4f8047 Aug 31 16:10:17.757146 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-DeleteServersTestJSON-1125268000 Aug 31 16:10:17.757146 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:10:17.757146 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:10:17.757146 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/af5a8bccbcb14afd9c6bcd6f4d4f8047"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/af5a8bccbcb14afd9c6bcd6f4d4f8047"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_af5a8bccbcb14afd9c6bcd6f4d4f8047", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/af5a8bccbcb14afd9c6bcd6f4d4f8047"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:10:17.757146 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-DeleteServersTestJSON-1125268000 Aug 31 16:10:17.757146 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: af5a8bccbcb14afd9c6bcd6f4d4f8047 Aug 31 16:10:17.757146 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-DeleteServersTestJSON-1125268000 Aug 31 16:10:17.757146 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-DeleteServersTestJSON-1125268000-project Aug 31 16:10:17.757146 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:10:17.757146 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:10:17.757146 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 4ee58e6a7c284cc9a9c87d0a5c1239aa Aug 31 16:10:17.757146 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-DeleteServersTestJSON-1125268000-project Aug 31 16:10:17.757146 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:10:17.757146 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance 1262191c-be8b-4535-8704-72db13e3f6cc could not be found. Aug 31 16:10:17.757146 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '1262191c-be8b-4535-8704-72db13e3f6cc'} Aug 31 16:10:17.757146 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:10:17.757146 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:17.757146 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:10:17.757146 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:10:17.757146 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:10:17.757146 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:10:17.757146 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:10:17.757146 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:10:17.757146 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:10:17.757146 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:10:17.757146 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1262191c-be8b-4535-8704-72db13e3f6cc could not be found. Aug 31 16:10:17.757146 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:10:17.757146 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:10:17.757146 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:10:17.757146 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:17.757146 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:10:17.757146 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:10:17.757146 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:10:17.757146 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:10:17.757146 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:10:17.757146 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:10:17.757146 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:10:17.757146 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:10:17.757146 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:10:17.757146 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:10:17.757146 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:10:17.757146 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:10:17.757146 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:10:17.757146 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:10:17.765513 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1262191c-be8b-4535-8704-72db13e3f6cc could not be found. Aug 31 16:10:17.765513 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:10:17.765513 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:10:17.765513 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:10:17.765513 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:17.765513 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:10:17.765513 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:10:17.765513 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:10:17.765513 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:10:17.765513 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1262191c-be8b-4535-8704-72db13e3f6cc could not be found. Aug 31 16:10:17.765513 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:10:17.765513 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9671bbe1-09f1-4ac9-8fbc-12168bce0403 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Returning 404 to user: Instance 1262191c-be8b-4535-8704-72db13e3f6cc could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:10:17.765513 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9671bbe1-09f1-4ac9-8fbc-12168bce0403 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "DELETE /compute/v2.1/servers/1262191c-be8b-4535-8704-72db13e3f6cc" status: 404 len: 111 microversion: 2.1 time: 0.035653 Aug 31 16:10:17.765513 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1605/3183] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:10:17 2022] DELETE /compute/v2.1/servers/1262191c-be8b-4535-8704-72db13e3f6cc => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:10:17.768274 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7e27eb53-f914-4cba-9a4b-e6b446bfd188 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:17.768996 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7e27eb53-f914-4cba-9a4b-e6b446bfd188 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 1262191c-be8b-4535-8704-72db13e3f6cc] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:17.776814 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7e27eb53-f914-4cba-9a4b-e6b446bfd188 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:17.777383 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7e27eb53-f914-4cba-9a4b-e6b446bfd188 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:17.777906 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7e27eb53-f914-4cba-9a4b-e6b446bfd188 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:17.778615 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7e27eb53-f914-4cba-9a4b-e6b446bfd188 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:17.779091 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7e27eb53-f914-4cba-9a4b-e6b446bfd188 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:17.779534 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7e27eb53-f914-4cba-9a4b-e6b446bfd188 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:17.796551 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-7e27eb53-f914-4cba-9a4b-e6b446bfd188 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] HTTP exception thrown: Instance 1262191c-be8b-4535-8704-72db13e3f6cc could not be found. Aug 31 16:10:17.798122 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7e27eb53-f914-4cba-9a4b-e6b446bfd188 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Request method failure captured: Aug 31 16:10:17.798122 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/1262191c-be8b-4535-8704-72db13e3f6cc HTTP/1.1 Aug 31 16:10:17.798122 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:10:17.798122 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:10:17.798122 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:10:17.798122 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:10:17.798122 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:10:17.798122 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:10:17.798122 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:10:17.798122 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:10:17.798122 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4Yo5dNOTiRoHOXx-UM5Sn8Jbzoi0Z4yz9YBk3W8_DEhZnVZu-DDO0QOzNoQHJ1nNP8QtjbDsJSdq3n7hK4ZXI2LEyeWPrk9aNaREtGRbElEfeP-G76pg20KjiuDCyp0gfSMP_cw21bhq2fJbey8HuCI0lmGBIAsUVWfxqkVQu-gwfg Aug 31 16:10:17.798122 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:10:17.798122 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:10:17.798122 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:10:17.798122 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:10:17.798122 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:10:17.798122 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:10:17.798122 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: af5a8bccbcb14afd9c6bcd6f4d4f8047 Aug 31 16:10:17.798122 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-DeleteServersTestJSON-1125268000 Aug 31 16:10:17.798122 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:10:17.798122 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:10:17.798122 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/af5a8bccbcb14afd9c6bcd6f4d4f8047"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/af5a8bccbcb14afd9c6bcd6f4d4f8047"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_af5a8bccbcb14afd9c6bcd6f4d4f8047", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/af5a8bccbcb14afd9c6bcd6f4d4f8047"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:10:17.798122 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-DeleteServersTestJSON-1125268000 Aug 31 16:10:17.798122 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: af5a8bccbcb14afd9c6bcd6f4d4f8047 Aug 31 16:10:17.798122 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-DeleteServersTestJSON-1125268000 Aug 31 16:10:17.798122 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-DeleteServersTestJSON-1125268000-project Aug 31 16:10:17.798122 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:10:17.798122 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:10:17.798122 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 4ee58e6a7c284cc9a9c87d0a5c1239aa Aug 31 16:10:17.798122 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-DeleteServersTestJSON-1125268000-project Aug 31 16:10:17.798122 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:10:17.798122 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance 1262191c-be8b-4535-8704-72db13e3f6cc could not be found. Aug 31 16:10:17.798122 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '1262191c-be8b-4535-8704-72db13e3f6cc'} Aug 31 16:10:17.798122 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:10:17.798122 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:17.798122 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:10:17.798122 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:10:17.798122 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:10:17.798122 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:10:17.798122 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:10:17.798122 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:10:17.798122 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:10:17.798122 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:10:17.798122 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1262191c-be8b-4535-8704-72db13e3f6cc could not be found. Aug 31 16:10:17.798122 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:10:17.798122 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:10:17.798122 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:10:17.798122 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:17.798122 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:10:17.798122 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:10:17.798122 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:10:17.798122 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:10:17.798122 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:10:17.798122 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:10:17.798122 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:10:17.798122 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:10:17.798122 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:10:17.798122 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:10:17.798122 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:10:17.798122 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:10:17.798122 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1262191c-be8b-4535-8704-72db13e3f6cc could not be found. Aug 31 16:10:17.798122 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:10:17.798122 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:10:17.798122 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:10:17.803730 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:17.803730 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:10:17.803730 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:10:17.803730 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:10:17.803730 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:10:17.803730 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1262191c-be8b-4535-8704-72db13e3f6cc could not be found. Aug 31 16:10:17.803730 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:10:17.803730 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7e27eb53-f914-4cba-9a4b-e6b446bfd188 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Returning 404 to user: Instance 1262191c-be8b-4535-8704-72db13e3f6cc could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:10:17.803730 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7e27eb53-f914-4cba-9a4b-e6b446bfd188 tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/1262191c-be8b-4535-8704-72db13e3f6cc" status: 404 len: 111 microversion: 2.1 time: 0.035964 Aug 31 16:10:17.803730 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1606/3184] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:17 2022] GET /compute/v2.1/servers/1262191c-be8b-4535-8704-72db13e3f6cc => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:10:17.806803 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-69de1dfa-056a-4124-abaf-8afd110690de tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:17.807254 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-69de1dfa-056a-4124-abaf-8afd110690de tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] [instance: eed024b5-986b-40fa-a686-ceab563a6131] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:17.814678 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-69de1dfa-056a-4124-abaf-8afd110690de tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:17.815235 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-69de1dfa-056a-4124-abaf-8afd110690de tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:17.815765 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-69de1dfa-056a-4124-abaf-8afd110690de tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:17.816538 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-69de1dfa-056a-4124-abaf-8afd110690de tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:17.817316 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-69de1dfa-056a-4124-abaf-8afd110690de tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:17.817316 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-69de1dfa-056a-4124-abaf-8afd110690de tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:18.055993 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-c3a821f3-c562-4ee5-b7c9-5fcc1ed2d768 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] validate_networks() for [('b0d4a090-bcfb-4391-8f67-1bf0791c2756', None, None, None, None, None), (None, None, '4a18af29-4324-4844-bf75-25dcac3740f5', None, None, None), (None, None, 'fd6970db-5a6c-4005-91a0-c09d46e9fd47', None, None, None), ('fb89fb4d-556d-4d60-b8d1-f716a8c0937c', None, None, None, None, None), ('fb89fb4d-556d-4d60-b8d1-f716a8c0937c', None, None, None, None, None), ('35f33868-2b91-4189-b7e9-af9df4b85daa', '10.2.2.100', None, None, None, None), ('35f33868-2b91-4189-b7e9-af9df4b85daa', '10.2.2.200', None, None, None, None)] {{(pid=122257) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:10:18.436952 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-69de1dfa-056a-4124-abaf-8afd110690de tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab268a4d607497da5476256055bb07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14140e7303046f1ada446437826f742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:18.446006 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-69de1dfa-056a-4124-abaf-8afd110690de tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] 10.222.0.61 "GET /compute/v2.1/servers/eed024b5-986b-40fa-a686-ceab563a6131" status: 200 len: 1365 microversion: 2.1 time: 0.643829 Aug 31 16:10:18.447296 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1607/3185] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:17 2022] GET /compute/v2.1/servers/eed024b5-986b-40fa-a686-ceab563a6131 => generated 1365 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:18.452263 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-aa076f6f-7535-44cc-b02d-05c8fea3c55b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:18.452970 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-aa076f6f-7535-44cc-b02d-05c8fea3c55b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 7413e400-d79a-4055-838e-86808cd23b83] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:18.462297 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aa076f6f-7535-44cc-b02d-05c8fea3c55b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:18.462818 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aa076f6f-7535-44cc-b02d-05c8fea3c55b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:18.463263 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aa076f6f-7535-44cc-b02d-05c8fea3c55b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:18.464029 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aa076f6f-7535-44cc-b02d-05c8fea3c55b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:18.464522 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aa076f6f-7535-44cc-b02d-05c8fea3c55b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:18.464950 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aa076f6f-7535-44cc-b02d-05c8fea3c55b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:18.470773 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:10:18.483452 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-aa076f6f-7535-44cc-b02d-05c8fea3c55b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] HTTP exception thrown: Instance 7413e400-d79a-4055-838e-86808cd23b83 could not be found. Aug 31 16:10:18.485003 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-aa076f6f-7535-44cc-b02d-05c8fea3c55b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Request method failure captured: Aug 31 16:10:18.485003 n-d-850499-9 devstack@n-api.service[122256]: request: DELETE /compute/v2.1/servers/7413e400-d79a-4055-838e-86808cd23b83 HTTP/1.1 Aug 31 16:10:18.485003 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:10:18.485003 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:10:18.485003 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:10:18.485003 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:10:18.485003 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:10:18.485003 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:10:18.485003 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:10:18.485003 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:10:18.485003 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4Yo5dNOTiRoHOXx-UM5Sn8Jbzoi0Z4yz9YBk3W8_DEhZnVZu-DDO0QOzNoQHJ1nNP8QtjbDsJSdq3n7hK4ZXI2LEyeWPrk9aNaREtGRbElEfeP-G76pg20KjiuDCyp0gfSMP_cw21bhq2fJbey8HuCI0lmGBIAsUVWfxqkVQu-gwfg Aug 31 16:10:18.485003 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:10:18.485003 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:10:18.485003 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:10:18.485003 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:10:18.485003 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:10:18.485003 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:10:18.485003 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: af5a8bccbcb14afd9c6bcd6f4d4f8047 Aug 31 16:10:18.485003 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-DeleteServersTestJSON-1125268000 Aug 31 16:10:18.485003 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:10:18.485003 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:10:18.485003 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/af5a8bccbcb14afd9c6bcd6f4d4f8047"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/af5a8bccbcb14afd9c6bcd6f4d4f8047"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_af5a8bccbcb14afd9c6bcd6f4d4f8047", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/af5a8bccbcb14afd9c6bcd6f4d4f8047"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:10:18.485003 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-DeleteServersTestJSON-1125268000 Aug 31 16:10:18.485003 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: af5a8bccbcb14afd9c6bcd6f4d4f8047 Aug 31 16:10:18.485003 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-DeleteServersTestJSON-1125268000 Aug 31 16:10:18.485003 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-DeleteServersTestJSON-1125268000-project Aug 31 16:10:18.485003 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:10:18.485003 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:10:18.485003 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 4ee58e6a7c284cc9a9c87d0a5c1239aa Aug 31 16:10:18.485003 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-DeleteServersTestJSON-1125268000-project Aug 31 16:10:18.485003 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:10:18.485003 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance 7413e400-d79a-4055-838e-86808cd23b83 could not be found. Aug 31 16:10:18.485003 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '7413e400-d79a-4055-838e-86808cd23b83'} Aug 31 16:10:18.485003 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:10:18.485003 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:18.485003 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:10:18.485003 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:10:18.485003 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:10:18.485003 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:10:18.485003 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:10:18.485003 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:10:18.485003 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:10:18.485003 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:10:18.485003 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7413e400-d79a-4055-838e-86808cd23b83 could not be found. Aug 31 16:10:18.485003 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:10:18.485003 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:10:18.485003 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:10:18.485003 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:18.485003 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:10:18.485003 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:10:18.485003 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:10:18.485003 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:10:18.485003 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:10:18.485003 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:10:18.485003 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:10:18.485003 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:10:18.485003 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:10:18.485003 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:10:18.485003 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:10:18.485003 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:10:18.485003 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:10:18.485003 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:10:18.489326 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7413e400-d79a-4055-838e-86808cd23b83 could not be found. Aug 31 16:10:18.489326 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:10:18.489326 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:10:18.489326 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:10:18.489326 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:18.489326 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:10:18.489326 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:10:18.489326 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:10:18.489326 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:10:18.489326 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7413e400-d79a-4055-838e-86808cd23b83 could not be found. Aug 31 16:10:18.489326 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:10:18.489326 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-aa076f6f-7535-44cc-b02d-05c8fea3c55b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Returning 404 to user: Instance 7413e400-d79a-4055-838e-86808cd23b83 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:10:18.489326 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-aa076f6f-7535-44cc-b02d-05c8fea3c55b tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "DELETE /compute/v2.1/servers/7413e400-d79a-4055-838e-86808cd23b83" status: 404 len: 111 microversion: 2.1 time: 0.037980 Aug 31 16:10:18.491376 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1608/3186] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:10:18 2022] DELETE /compute/v2.1/servers/7413e400-d79a-4055-838e-86808cd23b83 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:10:18.498319 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4ec89ab6-332d-4cb6-802e-ae05336f46a3 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:18.499267 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4ec89ab6-332d-4cb6-802e-ae05336f46a3 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] [instance: b68db583-0d09-4485-8b26-ff5c02e23c01] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:18.509933 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4ec89ab6-332d-4cb6-802e-ae05336f46a3 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:18.510583 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4ec89ab6-332d-4cb6-802e-ae05336f46a3 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:18.511180 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4ec89ab6-332d-4cb6-802e-ae05336f46a3 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:18.511943 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4ec89ab6-332d-4cb6-802e-ae05336f46a3 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:18.512409 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4ec89ab6-332d-4cb6-802e-ae05336f46a3 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:18.512952 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4ec89ab6-332d-4cb6-802e-ae05336f46a3 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:19.409424 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-4ec89ab6-332d-4cb6-802e-ae05336f46a3 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68db583fb8fd4e6090fb220eeaafdd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c965154856f84fecb30f49dfeac46fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:19.421625 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4ec89ab6-332d-4cb6-802e-ae05336f46a3 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] 10.222.0.61 "GET /compute/v2.1/servers/b68db583-0d09-4485-8b26-ff5c02e23c01" status: 200 len: 1522 microversion: 2.1 time: 0.928570 Aug 31 16:10:19.422880 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1609/3187] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:18 2022] GET /compute/v2.1/servers/b68db583-0d09-4485-8b26-ff5c02e23c01 => generated 1522 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:19.434470 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-35f57d6a-e6a4-4ec7-8540-820fb64de1ac tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:19.435785 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-35f57d6a-e6a4-4ec7-8540-820fb64de1ac tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: 7413e400-d79a-4055-838e-86808cd23b83] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:19.458561 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-35f57d6a-e6a4-4ec7-8540-820fb64de1ac tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:19.462572 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-35f57d6a-e6a4-4ec7-8540-820fb64de1ac tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:19.467160 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-35f57d6a-e6a4-4ec7-8540-820fb64de1ac tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:19.468281 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-35f57d6a-e6a4-4ec7-8540-820fb64de1ac tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:19.469057 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-35f57d6a-e6a4-4ec7-8540-820fb64de1ac tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:19.469679 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-35f57d6a-e6a4-4ec7-8540-820fb64de1ac tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:19.497326 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-35f57d6a-e6a4-4ec7-8540-820fb64de1ac tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] HTTP exception thrown: Instance 7413e400-d79a-4055-838e-86808cd23b83 could not be found. Aug 31 16:10:19.499547 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-35f57d6a-e6a4-4ec7-8540-820fb64de1ac tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Request method failure captured: Aug 31 16:10:19.499547 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/7413e400-d79a-4055-838e-86808cd23b83 HTTP/1.1 Aug 31 16:10:19.499547 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:10:19.499547 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:10:19.499547 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:10:19.499547 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:10:19.499547 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:10:19.499547 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:10:19.499547 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:10:19.499547 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:10:19.499547 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4Yo5dNOTiRoHOXx-UM5Sn8Jbzoi0Z4yz9YBk3W8_DEhZnVZu-DDO0QOzNoQHJ1nNP8QtjbDsJSdq3n7hK4ZXI2LEyeWPrk9aNaREtGRbElEfeP-G76pg20KjiuDCyp0gfSMP_cw21bhq2fJbey8HuCI0lmGBIAsUVWfxqkVQu-gwfg Aug 31 16:10:19.499547 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:10:19.499547 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:10:19.499547 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:10:19.499547 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:10:19.499547 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:10:19.499547 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:10:19.499547 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: af5a8bccbcb14afd9c6bcd6f4d4f8047 Aug 31 16:10:19.499547 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-DeleteServersTestJSON-1125268000 Aug 31 16:10:19.499547 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:10:19.499547 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:10:19.499547 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/af5a8bccbcb14afd9c6bcd6f4d4f8047"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/af5a8bccbcb14afd9c6bcd6f4d4f8047"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_af5a8bccbcb14afd9c6bcd6f4d4f8047", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/af5a8bccbcb14afd9c6bcd6f4d4f8047"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:10:19.499547 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-DeleteServersTestJSON-1125268000 Aug 31 16:10:19.499547 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: af5a8bccbcb14afd9c6bcd6f4d4f8047 Aug 31 16:10:19.499547 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-DeleteServersTestJSON-1125268000 Aug 31 16:10:19.499547 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-DeleteServersTestJSON-1125268000-project Aug 31 16:10:19.499547 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:10:19.499547 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:10:19.499547 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 4ee58e6a7c284cc9a9c87d0a5c1239aa Aug 31 16:10:19.499547 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-DeleteServersTestJSON-1125268000-project Aug 31 16:10:19.499547 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:10:19.499547 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance 7413e400-d79a-4055-838e-86808cd23b83 could not be found. Aug 31 16:10:19.499547 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '7413e400-d79a-4055-838e-86808cd23b83'} Aug 31 16:10:19.499547 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:10:19.499547 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:19.499547 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:10:19.499547 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:10:19.499547 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:10:19.499547 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:10:19.499547 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:10:19.499547 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:10:19.499547 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:10:19.499547 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:10:19.499547 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7413e400-d79a-4055-838e-86808cd23b83 could not be found. Aug 31 16:10:19.499547 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:10:19.499547 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:10:19.499547 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:10:19.499547 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:19.499547 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:10:19.499547 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:10:19.499547 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:10:19.499547 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:10:19.499547 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:10:19.499547 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:10:19.499547 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:10:19.499547 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:10:19.499547 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:10:19.499547 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:10:19.499547 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:10:19.499547 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:10:19.499547 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7413e400-d79a-4055-838e-86808cd23b83 could not be found. Aug 31 16:10:19.499547 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:10:19.499547 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:10:19.499547 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:10:19.504380 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:19.504380 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:10:19.504380 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:10:19.504380 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:10:19.504380 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:10:19.504380 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7413e400-d79a-4055-838e-86808cd23b83 could not be found. Aug 31 16:10:19.504380 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:10:19.506177 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-35f57d6a-e6a4-4ec7-8540-820fb64de1ac tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Returning 404 to user: Instance 7413e400-d79a-4055-838e-86808cd23b83 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:10:19.508069 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-35f57d6a-e6a4-4ec7-8540-820fb64de1ac tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/7413e400-d79a-4055-838e-86808cd23b83" status: 404 len: 111 microversion: 2.1 time: 0.083233 Aug 31 16:10:19.510737 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1610/3188] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:19 2022] GET /compute/v2.1/servers/7413e400-d79a-4055-838e-86808cd23b83 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:10:19.536573 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4d2855dd-d4ea-4494-898e-9e3bf57be658 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:19.538113 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4d2855dd-d4ea-4494-898e-9e3bf57be658 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] [instance: 0ac914d2-e9f7-4f2f-a01d-49674180d8db] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:19.574396 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4d2855dd-d4ea-4494-898e-9e3bf57be658 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:19.576017 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4d2855dd-d4ea-4494-898e-9e3bf57be658 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:19.577814 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4d2855dd-d4ea-4494-898e-9e3bf57be658 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:19.579158 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4d2855dd-d4ea-4494-898e-9e3bf57be658 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:19.581525 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4d2855dd-d4ea-4494-898e-9e3bf57be658 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:19.585829 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4d2855dd-d4ea-4494-898e-9e3bf57be658 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:20.268584 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-4d2855dd-d4ea-4494-898e-9e3bf57be658 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c65ee5ffa9d74bfdacbea45f1564d19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55320a9c8f714bc0911ded3ab88ddf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:20.292544 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4d2855dd-d4ea-4494-898e-9e3bf57be658 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] 10.222.0.61 "GET /compute/v2.1/servers/0ac914d2-e9f7-4f2f-a01d-49674180d8db" status: 200 len: 1293 microversion: 2.1 time: 0.773282 Aug 31 16:10:20.293228 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1611/3189] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:19 2022] GET /compute/v2.1/servers/0ac914d2-e9f7-4f2f-a01d-49674180d8db => generated 1293 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:20.314116 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-827a2c4d-4b67-4a6d-904d-513feedd9285 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:20.321166 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-827a2c4d-4b67-4a6d-904d-513feedd9285 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] [instance: c393928f-2414-4093-9d72-93a21fc6c460] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:20.345153 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-827a2c4d-4b67-4a6d-904d-513feedd9285 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:20.348280 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-827a2c4d-4b67-4a6d-904d-513feedd9285 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:20.348882 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-827a2c4d-4b67-4a6d-904d-513feedd9285 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:20.357496 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-827a2c4d-4b67-4a6d-904d-513feedd9285 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:20.358824 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-827a2c4d-4b67-4a6d-904d-513feedd9285 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:20.363057 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-827a2c4d-4b67-4a6d-904d-513feedd9285 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:21.029031 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-827a2c4d-4b67-4a6d-904d-513feedd9285 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b93395d63a4db895ff224a311940e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf281e8857247c6b9e60d4216741f89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:21.037898 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-827a2c4d-4b67-4a6d-904d-513feedd9285 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] 10.222.0.61 "GET /compute/v2.1/servers/c393928f-2414-4093-9d72-93a21fc6c460" status: 200 len: 1508 microversion: 2.1 time: 0.733844 Aug 31 16:10:21.044712 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1612/3190] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:20 2022] GET /compute/v2.1/servers/c393928f-2414-4093-9d72-93a21fc6c460 => generated 1508 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:21.049942 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-5529249e-d87b-4087-bd0e-6eb6816c4e01 req-db0377e4-be02-42a1-8052-222f5bc6550d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b68db583-0d09-4485-8b26-ff5c02e23c01", "name": "network-vif-deleted", "tag": "a44cba0a-b891-4f5c-88cb-0f6b3c9d2376"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:10:21.075682 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-5529249e-d87b-4087-bd0e-6eb6816c4e01 req-db0377e4-be02-42a1-8052-222f5bc6550d service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:21.076183 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-5529249e-d87b-4087-bd0e-6eb6816c4e01 req-db0377e4-be02-42a1-8052-222f5bc6550d service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:21.076629 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-5529249e-d87b-4087-bd0e-6eb6816c4e01 req-db0377e4-be02-42a1-8052-222f5bc6550d service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:21.096107 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-5529249e-d87b-4087-bd0e-6eb6816c4e01 req-db0377e4-be02-42a1-8052-222f5bc6550d service nova] Creating event network-vif-deleted:a44cba0a-b891-4f5c-88cb-0f6b3c9d2376 for instance b68db583-0d09-4485-8b26-ff5c02e23c01 on n-h1-850499-9 Aug 31 16:10:21.102346 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-5529249e-d87b-4087-bd0e-6eb6816c4e01 req-db0377e4-be02-42a1-8052-222f5bc6550d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055321 Aug 31 16:10:21.103230 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1613/3191] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:10:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:10:21.108606 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-80d7610a-fd8f-4dd5-9ed9-0be626174b71 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:21.109312 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-80d7610a-fd8f-4dd5-9ed9-0be626174b71 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] [instance: eed024b5-986b-40fa-a686-ceab563a6131] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:21.123668 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-80d7610a-fd8f-4dd5-9ed9-0be626174b71 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:21.124407 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-80d7610a-fd8f-4dd5-9ed9-0be626174b71 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:21.125018 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-80d7610a-fd8f-4dd5-9ed9-0be626174b71 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:21.125917 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-80d7610a-fd8f-4dd5-9ed9-0be626174b71 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:21.126541 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-80d7610a-fd8f-4dd5-9ed9-0be626174b71 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:21.127213 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-80d7610a-fd8f-4dd5-9ed9-0be626174b71 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:21.666826 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-80d7610a-fd8f-4dd5-9ed9-0be626174b71 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab268a4d607497da5476256055bb07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14140e7303046f1ada446437826f742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:21.675753 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-80d7610a-fd8f-4dd5-9ed9-0be626174b71 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] 10.222.0.61 "GET /compute/v2.1/servers/eed024b5-986b-40fa-a686-ceab563a6131" status: 200 len: 1554 microversion: 2.1 time: 0.570833 Aug 31 16:10:21.691459 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1614/3192] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:21 2022] GET /compute/v2.1/servers/eed024b5-986b-40fa-a686-ceab563a6131 => generated 1554 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:21.860185 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ff161e10-88ba-43df-9179-2d4f2f856a13 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-781067289", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "networks": [{"uuid": "567c9ba1-6364-4d01-9016-4aec92f3efc9"}]}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:10:21.986274 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-ff161e10-88ba-43df-9179-2d4f2f856a13 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] validate_networks() for [('567c9ba1-6364-4d01-9016-4aec92f3efc9', None, None, None, None, None)] {{(pid=122256) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:10:23.380699 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-ff161e10-88ba-43df-9179-2d4f2f856a13 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:10:23.381909 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-ff161e10-88ba-43df-9179-2d4f2f856a13 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:10:23.383354 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-ff161e10-88ba-43df-9179-2d4f2f856a13 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:10:23.384027 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-ff161e10-88ba-43df-9179-2d4f2f856a13 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:10:23.384673 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-ff161e10-88ba-43df-9179-2d4f2f856a13 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:10:23.408998 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ff161e10-88ba-43df-9179-2d4f2f856a13 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:23.409487 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ff161e10-88ba-43df-9179-2d4f2f856a13 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:23.409923 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ff161e10-88ba-43df-9179-2d4f2f856a13 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:23.410919 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ff161e10-88ba-43df-9179-2d4f2f856a13 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:23.411378 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ff161e10-88ba-43df-9179-2d4f2f856a13 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:23.411829 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ff161e10-88ba-43df-9179-2d4f2f856a13 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:23.441949 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-ff161e10-88ba-43df-9179-2d4f2f856a13 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Getting quotas for project eab7f0d889224cefbca55343f3208a86. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:10:23.451037 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-ff161e10-88ba-43df-9179-2d4f2f856a13 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Getting quotas for user d13cabcaa79043bea338128594a6b00a and project eab7f0d889224cefbca55343f3208a86. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:10:23.474598 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ff161e10-88ba-43df-9179-2d4f2f856a13 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Going to run 1 instances... {{(pid=122256) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:10:23.477554 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ff161e10-88ba-43df-9179-2d4f2f856a13 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] [instance: 606f1624-8c53-409e-b06b-ace080f7fc44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:10:23.561494 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ff161e10-88ba-43df-9179-2d4f2f856a13 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.868411 Aug 31 16:10:23.568907 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1615/3193] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:10:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1876 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:10:23.574552 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8c911a23-c631-4367-9b0f-15559a700b7e tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:23.575400 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8c911a23-c631-4367-9b0f-15559a700b7e tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] [instance: b68db583-0d09-4485-8b26-ff5c02e23c01] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:23.583284 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8c911a23-c631-4367-9b0f-15559a700b7e tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:23.584246 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8c911a23-c631-4367-9b0f-15559a700b7e tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:23.584948 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8c911a23-c631-4367-9b0f-15559a700b7e tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:23.586453 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8c911a23-c631-4367-9b0f-15559a700b7e tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:23.587560 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8c911a23-c631-4367-9b0f-15559a700b7e tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:23.588904 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8c911a23-c631-4367-9b0f-15559a700b7e tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:23.612253 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-8c911a23-c631-4367-9b0f-15559a700b7e tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] HTTP exception thrown: Instance b68db583-0d09-4485-8b26-ff5c02e23c01 could not be found. Aug 31 16:10:23.613922 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8c911a23-c631-4367-9b0f-15559a700b7e tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Request method failure captured: Aug 31 16:10:23.613922 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/b68db583-0d09-4485-8b26-ff5c02e23c01 HTTP/1.1 Aug 31 16:10:23.613922 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:10:23.613922 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:10:23.613922 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:10:23.613922 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:10:23.613922 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:10:23.613922 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:10:23.613922 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:10:23.613922 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:10:23.613922 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4e3VulAbsVbf-R_KJJopCzL4TMuVlDpJWFc1QxE_VfyNmRdCYzoeGI3DOp904JH19R2ftEX6dDaPCOB9WVPxd6DoNCdJI6XasCui_OVYbMISua7YP2-9CFPcxpMidTtXQe3Mq7ucg5-1-_FtBTisohEps1qxvpOawH_RIjV85BgAaM Aug 31 16:10:23.613922 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:10:23.613922 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:10:23.613922 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:10:23.613922 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:10:23.613922 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:10:23.613922 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:10:23.613922 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: c965154856f84fecb30f49dfeac46fa0 Aug 31 16:10:23.613922 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ListServersNegativeTestJSON-1676734841 Aug 31 16:10:23.613922 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:10:23.613922 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:10:23.613922 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c965154856f84fecb30f49dfeac46fa0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/c965154856f84fecb30f49dfeac46fa0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_c965154856f84fecb30f49dfeac46fa0", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c965154856f84fecb30f49dfeac46fa0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:10:23.613922 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ListServersNegativeTestJSON-1676734841 Aug 31 16:10:23.613922 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: c965154856f84fecb30f49dfeac46fa0 Aug 31 16:10:23.613922 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1676734841 Aug 31 16:10:23.613922 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ListServersNegativeTestJSON-1676734841-project Aug 31 16:10:23.613922 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:10:23.613922 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:10:23.613922 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 68db583fb8fd4e6090fb220eeaafdd36 Aug 31 16:10:23.613922 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ListServersNegativeTestJSON-1676734841-project Aug 31 16:10:23.613922 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:10:23.613922 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance b68db583-0d09-4485-8b26-ff5c02e23c01 could not be found. Aug 31 16:10:23.613922 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': 'b68db583-0d09-4485-8b26-ff5c02e23c01'} Aug 31 16:10:23.613922 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:10:23.613922 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:23.613922 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:10:23.613922 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:10:23.613922 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:10:23.613922 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:10:23.613922 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:10:23.613922 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:10:23.613922 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:10:23.613922 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:10:23.613922 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b68db583-0d09-4485-8b26-ff5c02e23c01 could not be found. Aug 31 16:10:23.613922 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:10:23.613922 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:10:23.613922 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:10:23.613922 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:23.613922 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:10:23.613922 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:10:23.613922 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:10:23.613922 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:10:23.613922 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:10:23.613922 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:10:23.613922 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:10:23.613922 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:10:23.613922 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:10:23.613922 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:10:23.613922 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:10:23.613922 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:10:23.613922 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b68db583-0d09-4485-8b26-ff5c02e23c01 could not be found. Aug 31 16:10:23.613922 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:10:23.613922 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:10:23.620164 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:10:23.620164 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:23.620164 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:10:23.620164 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:10:23.620164 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:10:23.620164 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:10:23.620164 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b68db583-0d09-4485-8b26-ff5c02e23c01 could not be found. Aug 31 16:10:23.620164 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:10:23.620164 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8c911a23-c631-4367-9b0f-15559a700b7e tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Returning 404 to user: Instance b68db583-0d09-4485-8b26-ff5c02e23c01 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:10:23.620164 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8c911a23-c631-4367-9b0f-15559a700b7e tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] 10.222.0.61 "GET /compute/v2.1/servers/b68db583-0d09-4485-8b26-ff5c02e23c01" status: 404 len: 111 microversion: 2.1 time: 0.045059 Aug 31 16:10:23.621344 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1616/3194] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:23 2022] GET /compute/v2.1/servers/b68db583-0d09-4485-8b26-ff5c02e23c01 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:10:23.630409 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f1422572-57a8-4598-b1c5-d386e69e05b5 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:23.631042 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f1422572-57a8-4598-b1c5-d386e69e05b5 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] [instance: 0ac914d2-e9f7-4f2f-a01d-49674180d8db] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:23.640179 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f1422572-57a8-4598-b1c5-d386e69e05b5 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:23.640668 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f1422572-57a8-4598-b1c5-d386e69e05b5 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:23.641345 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f1422572-57a8-4598-b1c5-d386e69e05b5 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:23.642269 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f1422572-57a8-4598-b1c5-d386e69e05b5 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:23.642886 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f1422572-57a8-4598-b1c5-d386e69e05b5 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:23.643473 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f1422572-57a8-4598-b1c5-d386e69e05b5 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:23.919284 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f1422572-57a8-4598-b1c5-d386e69e05b5 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c65ee5ffa9d74bfdacbea45f1564d19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55320a9c8f714bc0911ded3ab88ddf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:23.947394 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f1422572-57a8-4598-b1c5-d386e69e05b5 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] 10.222.0.61 "GET /compute/v2.1/servers/0ac914d2-e9f7-4f2f-a01d-49674180d8db" status: 200 len: 1483 microversion: 2.1 time: 0.324401 Aug 31 16:10:23.951978 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1617/3195] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:23 2022] GET /compute/v2.1/servers/0ac914d2-e9f7-4f2f-a01d-49674180d8db => generated 1483 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:23.956810 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b7baa171-5da4-4450-91d0-3ed46a86abbf tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:23.957311 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b7baa171-5da4-4450-91d0-3ed46a86abbf tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] [instance: eed024b5-986b-40fa-a686-ceab563a6131] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:23.970236 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b7baa171-5da4-4450-91d0-3ed46a86abbf tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:23.971057 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b7baa171-5da4-4450-91d0-3ed46a86abbf tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:23.971867 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b7baa171-5da4-4450-91d0-3ed46a86abbf tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:23.972851 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b7baa171-5da4-4450-91d0-3ed46a86abbf tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:23.973530 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b7baa171-5da4-4450-91d0-3ed46a86abbf tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:23.974654 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b7baa171-5da4-4450-91d0-3ed46a86abbf tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:24.185967 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b7baa171-5da4-4450-91d0-3ed46a86abbf tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] 10.222.0.61 "GET /compute/v2.1/servers/eed024b5-986b-40fa-a686-ceab563a6131/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.232736 Aug 31 16:10:24.191990 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1618/3196] 10.222.0.61 () {58 vars in 1275 bytes} [Wed Aug 31 16:10:23 2022] GET /compute/v2.1/servers/eed024b5-986b-40fa-a686-ceab563a6131/os-interface => generated 284 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:10:24.200923 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-c3a821f3-c562-4ee5-b7c9-5fcc1ed2d768 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:10:24.201343 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-c3a821f3-c562-4ee5-b7c9-5fcc1ed2d768 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:10:24.201823 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-c3a821f3-c562-4ee5-b7c9-5fcc1ed2d768 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:10:24.202237 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-c3a821f3-c562-4ee5-b7c9-5fcc1ed2d768 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:10:24.207186 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-019922fe-a5f3-47e2-98d0-26de480388ff tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:24.207869 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-019922fe-a5f3-47e2-98d0-26de480388ff tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] [instance: c393928f-2414-4093-9d72-93a21fc6c460] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:24.208591 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-c3a821f3-c562-4ee5-b7c9-5fcc1ed2d768 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:10:24.231095 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-019922fe-a5f3-47e2-98d0-26de480388ff tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:24.231932 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-019922fe-a5f3-47e2-98d0-26de480388ff tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:24.232216 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-019922fe-a5f3-47e2-98d0-26de480388ff tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:24.232933 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-019922fe-a5f3-47e2-98d0-26de480388ff tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:24.234737 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-019922fe-a5f3-47e2-98d0-26de480388ff tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:24.235408 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-019922fe-a5f3-47e2-98d0-26de480388ff tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:24.246359 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c3a821f3-c562-4ee5-b7c9-5fcc1ed2d768 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:24.247309 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c3a821f3-c562-4ee5-b7c9-5fcc1ed2d768 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:24.248221 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c3a821f3-c562-4ee5-b7c9-5fcc1ed2d768 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:24.249240 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c3a821f3-c562-4ee5-b7c9-5fcc1ed2d768 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:24.249932 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c3a821f3-c562-4ee5-b7c9-5fcc1ed2d768 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:24.250585 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c3a821f3-c562-4ee5-b7c9-5fcc1ed2d768 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:24.291129 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-c3a821f3-c562-4ee5-b7c9-5fcc1ed2d768 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Getting quotas for project 68e7010151a7457b9ff7574126683b32. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:10:24.302400 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-c3a821f3-c562-4ee5-b7c9-5fcc1ed2d768 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Getting quotas for user 51c2d1cf18074bfda706dc2d5713b4f2 and project 68e7010151a7457b9ff7574126683b32. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:10:24.419939 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-019922fe-a5f3-47e2-98d0-26de480388ff tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b93395d63a4db895ff224a311940e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf281e8857247c6b9e60d4216741f89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:24.430455 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-019922fe-a5f3-47e2-98d0-26de480388ff tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] 10.222.0.61 "GET /compute/v2.1/servers/c393928f-2414-4093-9d72-93a21fc6c460" status: 200 len: 1512 microversion: 2.1 time: 0.233716 Aug 31 16:10:24.431334 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1619/3197] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:24 2022] GET /compute/v2.1/servers/c393928f-2414-4093-9d72-93a21fc6c460 => generated 1512 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:24.437213 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-52db5c93-968a-4828-82a9-bb99a923253f tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:24.438151 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-52db5c93-968a-4828-82a9-bb99a923253f tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] [instance: 606f1624-8c53-409e-b06b-ace080f7fc44] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:24.445291 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-52db5c93-968a-4828-82a9-bb99a923253f tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:24.446036 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-52db5c93-968a-4828-82a9-bb99a923253f tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:24.446487 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-52db5c93-968a-4828-82a9-bb99a923253f tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:24.450604 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-52db5c93-968a-4828-82a9-bb99a923253f tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:24.451037 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-52db5c93-968a-4828-82a9-bb99a923253f tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:24.451482 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-52db5c93-968a-4828-82a9-bb99a923253f tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:24.532254 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-52db5c93-968a-4828-82a9-bb99a923253f tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13cabcaa79043bea338128594a6b00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab7f0d889224cefbca55343f3208a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:24.542995 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-52db5c93-968a-4828-82a9-bb99a923253f tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] 10.222.0.61 "GET /compute/v2.1/servers/606f1624-8c53-409e-b06b-ace080f7fc44" status: 200 len: 1219 microversion: 2.1 time: 0.110421 Aug 31 16:10:24.544770 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1620/3198] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:24 2022] GET /compute/v2.1/servers/606f1624-8c53-409e-b06b-ace080f7fc44 => generated 1219 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:24.551074 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-03941489-f136-4644-bd85-c5e5cfb037c1 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:24.559147 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-03941489-f136-4644-bd85-c5e5cfb037c1 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '68db583fb8fd4e6090fb220eeaafdd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c965154856f84fecb30f49dfeac46fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:24.560460 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-03941489-f136-4644-bd85-c5e5cfb037c1 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': 'c965154856f84fecb30f49dfeac46fa0'} {{(pid=122256) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 16:10:24.567846 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-03941489-f136-4644-bd85-c5e5cfb037c1 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:24.568822 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-03941489-f136-4644-bd85-c5e5cfb037c1 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:24.569862 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-03941489-f136-4644-bd85-c5e5cfb037c1 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:24.570896 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-03941489-f136-4644-bd85-c5e5cfb037c1 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:24.572143 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-03941489-f136-4644-bd85-c5e5cfb037c1 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:24.574439 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-03941489-f136-4644-bd85-c5e5cfb037c1 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:24.609598 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c3a821f3-c562-4ee5-b7c9-5fcc1ed2d768 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Going to run 1 instances... {{(pid=122257) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:10:24.612751 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c3a821f3-c562-4ee5-b7c9-5fcc1ed2d768 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] [instance: fa0932e8-1aa4-4d1a-b653-14be35568f3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='6b9d535d-ca18-41f8-b818-cd9d83454608',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='16f75ca9-7666-4176-a9ae-21c719ce918d',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d67e87dd-a329-4f9d-a6df-e3917023ba09',volume_size=None,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:10:24.680872 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-03941489-f136-4644-bd85-c5e5cfb037c1 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] 10.222.0.61 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.133361 Aug 31 16:10:24.681756 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1621/3199] 10.222.0.61 () {58 vars in 1230 bytes} [Wed Aug 31 16:10:24 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 16:10:24.686875 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6dee1857-eee4-4bd4-aa2d-9f5b26e04a49 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:24.687550 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6dee1857-eee4-4bd4-aa2d-9f5b26e04a49 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] [instance: 0ac914d2-e9f7-4f2f-a01d-49674180d8db] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:24.695812 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6dee1857-eee4-4bd4-aa2d-9f5b26e04a49 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:24.696461 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6dee1857-eee4-4bd4-aa2d-9f5b26e04a49 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:24.696977 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6dee1857-eee4-4bd4-aa2d-9f5b26e04a49 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:24.697849 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6dee1857-eee4-4bd4-aa2d-9f5b26e04a49 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:24.698441 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6dee1857-eee4-4bd4-aa2d-9f5b26e04a49 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:24.698971 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6dee1857-eee4-4bd4-aa2d-9f5b26e04a49 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:24.837312 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6dee1857-eee4-4bd4-aa2d-9f5b26e04a49 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] 10.222.0.61 "GET /compute/v2.1/servers/0ac914d2-e9f7-4f2f-a01d-49674180d8db/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.154548 Aug 31 16:10:24.845674 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1622/3200] 10.222.0.61 () {58 vars in 1275 bytes} [Wed Aug 31 16:10:24 2022] GET /compute/v2.1/servers/0ac914d2-e9f7-4f2f-a01d-49674180d8db/os-interface => generated 284 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:10:24.851943 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9f3cb093-b75e-4e28-9fc7-6dbbe849d9aa tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:24.864822 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9f3cb093-b75e-4e28-9fc7-6dbbe849d9aa tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: d8590729-e3da-4e04-9daa-7e04a3d88068] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:24.872070 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9f3cb093-b75e-4e28-9fc7-6dbbe849d9aa tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:24.872567 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9f3cb093-b75e-4e28-9fc7-6dbbe849d9aa tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:24.872997 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9f3cb093-b75e-4e28-9fc7-6dbbe849d9aa tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:24.873698 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9f3cb093-b75e-4e28-9fc7-6dbbe849d9aa tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:24.874150 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9f3cb093-b75e-4e28-9fc7-6dbbe849d9aa tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:24.875414 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9f3cb093-b75e-4e28-9fc7-6dbbe849d9aa tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:24.895234 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-9f3cb093-b75e-4e28-9fc7-6dbbe849d9aa tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] HTTP exception thrown: Instance d8590729-e3da-4e04-9daa-7e04a3d88068 could not be found. Aug 31 16:10:24.904546 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9f3cb093-b75e-4e28-9fc7-6dbbe849d9aa tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Request method failure captured: Aug 31 16:10:24.904546 n-d-850499-9 devstack@n-api.service[122256]: request: DELETE /compute/v2.1/servers/d8590729-e3da-4e04-9daa-7e04a3d88068 HTTP/1.1 Aug 31 16:10:24.904546 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:10:24.904546 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:10:24.904546 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:10:24.904546 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:10:24.904546 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:10:24.904546 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:10:24.904546 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:10:24.904546 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:10:24.904546 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4Yo5dNOTiRoHOXx-UM5Sn8Jbzoi0Z4yz9YBk3W8_DEhZnVZu-DDO0QOzNoQHJ1nNP8QtjbDsJSdq3n7hK4ZXI2LEyeWPrk9aNaREtGRbElEfeP-G76pg20KjiuDCyp0gfSMP_cw21bhq2fJbey8HuCI0lmGBIAsUVWfxqkVQu-gwfg Aug 31 16:10:24.904546 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:10:24.904546 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:10:24.904546 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:10:24.904546 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:10:24.904546 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:10:24.904546 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:10:24.904546 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: af5a8bccbcb14afd9c6bcd6f4d4f8047 Aug 31 16:10:24.904546 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-DeleteServersTestJSON-1125268000 Aug 31 16:10:24.904546 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:10:24.904546 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:10:24.904546 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/af5a8bccbcb14afd9c6bcd6f4d4f8047"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/af5a8bccbcb14afd9c6bcd6f4d4f8047"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_af5a8bccbcb14afd9c6bcd6f4d4f8047", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/af5a8bccbcb14afd9c6bcd6f4d4f8047"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:10:24.904546 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-DeleteServersTestJSON-1125268000 Aug 31 16:10:24.904546 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: af5a8bccbcb14afd9c6bcd6f4d4f8047 Aug 31 16:10:24.904546 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-DeleteServersTestJSON-1125268000 Aug 31 16:10:24.904546 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-DeleteServersTestJSON-1125268000-project Aug 31 16:10:24.904546 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:10:24.904546 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:10:24.904546 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 4ee58e6a7c284cc9a9c87d0a5c1239aa Aug 31 16:10:24.904546 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-DeleteServersTestJSON-1125268000-project Aug 31 16:10:24.904546 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:10:24.904546 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance d8590729-e3da-4e04-9daa-7e04a3d88068 could not be found. Aug 31 16:10:24.904546 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': 'd8590729-e3da-4e04-9daa-7e04a3d88068'} Aug 31 16:10:24.904546 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:10:24.904546 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:24.904546 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:10:24.904546 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:10:24.904546 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:10:24.904546 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:10:24.904546 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:10:24.904546 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:10:24.904546 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:10:24.904546 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:10:24.904546 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8590729-e3da-4e04-9daa-7e04a3d88068 could not be found. Aug 31 16:10:24.904546 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:10:24.904546 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:10:24.904546 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:10:24.904546 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:24.904546 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:10:24.904546 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:10:24.904546 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:10:24.904546 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:10:24.904546 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:10:24.904546 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:10:24.904546 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:10:24.904546 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:10:24.904546 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:10:24.904546 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:10:24.904546 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:10:24.904546 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:10:24.904546 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:10:24.904546 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:10:24.909959 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8590729-e3da-4e04-9daa-7e04a3d88068 could not be found. Aug 31 16:10:24.909959 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:10:24.909959 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:10:24.909959 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:10:24.909959 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:24.909959 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:10:24.909959 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:10:24.909959 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:10:24.909959 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:10:24.909959 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8590729-e3da-4e04-9daa-7e04a3d88068 could not be found. Aug 31 16:10:24.909959 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:10:24.909959 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9f3cb093-b75e-4e28-9fc7-6dbbe849d9aa tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Returning 404 to user: Instance d8590729-e3da-4e04-9daa-7e04a3d88068 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:10:24.909959 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9f3cb093-b75e-4e28-9fc7-6dbbe849d9aa tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "DELETE /compute/v2.1/servers/d8590729-e3da-4e04-9daa-7e04a3d88068" status: 404 len: 111 microversion: 2.1 time: 0.059438 Aug 31 16:10:24.912408 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1623/3201] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:10:24 2022] DELETE /compute/v2.1/servers/d8590729-e3da-4e04-9daa-7e04a3d88068 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:10:24.920312 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-dadb89e3-ecc1-440e-9ab8-92acf0c52152 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:24.942022 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-dadb89e3-ecc1-440e-9ab8-92acf0c52152 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '41b93395d63a4db895ff224a311940e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf281e8857247c6b9e60d4216741f89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:24.942699 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.compute.servers [None req-dadb89e3-ecc1-440e-9ab8-92acf0c52152 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Removing options 'limit' from query {{(pid=122256) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 31 16:10:24.943407 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-dadb89e3-ecc1-440e-9ab8-92acf0c52152 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Searching by: {'deleted': False, 'project_id': '1cf281e8857247c6b9e60d4216741f89'} {{(pid=122256) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 16:10:24.944464 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dadb89e3-ecc1-440e-9ab8-92acf0c52152 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:24.945591 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dadb89e3-ecc1-440e-9ab8-92acf0c52152 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:24.945965 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dadb89e3-ecc1-440e-9ab8-92acf0c52152 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:24.953012 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dadb89e3-ecc1-440e-9ab8-92acf0c52152 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:24.953715 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dadb89e3-ecc1-440e-9ab8-92acf0c52152 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:24.954165 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dadb89e3-ecc1-440e-9ab8-92acf0c52152 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:24.955719 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-dadb89e3-ecc1-440e-9ab8-92acf0c52152 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] 10.222.0.61 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.042216 Aug 31 16:10:24.964022 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1624/3202] 10.222.0.61 () {58 vars in 1140 bytes} [Wed Aug 31 16:10:24 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 16:10:24.977059 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0499025c-69f3-42a5-b8e1-7b1f1859efca tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:24.989577 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0499025c-69f3-42a5-b8e1-7b1f1859efca tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Request method failure captured: Aug 31 16:10:24.989577 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Aug 31 16:10:24.989577 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:10:24.989577 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:10:24.989577 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:10:24.989577 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:10:24.989577 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:10:24.989577 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:10:24.989577 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:10:24.989577 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:10:24.989577 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4e3VulAbsVbf-R_KJJopCzL4TMuVlDpJWFc1QxE_VfyNmRdCYzoeGI3DOp904JH19R2ftEX6dDaPCOB9WVPxd6DoNCdJI6XasCui_OVYbMISua7YP2-9CFPcxpMidTtXQe3Mq7ucg5-1-_FtBTisohEps1qxvpOawH_RIjV85BgAaM Aug 31 16:10:24.989577 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:10:24.989577 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:10:24.989577 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:10:24.989577 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:10:24.989577 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:10:24.989577 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:10:24.989577 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: c965154856f84fecb30f49dfeac46fa0 Aug 31 16:10:24.989577 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ListServersNegativeTestJSON-1676734841 Aug 31 16:10:24.989577 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:10:24.989577 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:10:24.989577 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c965154856f84fecb30f49dfeac46fa0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/c965154856f84fecb30f49dfeac46fa0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_c965154856f84fecb30f49dfeac46fa0", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c965154856f84fecb30f49dfeac46fa0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:10:24.989577 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ListServersNegativeTestJSON-1676734841 Aug 31 16:10:24.989577 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: c965154856f84fecb30f49dfeac46fa0 Aug 31 16:10:24.989577 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1676734841 Aug 31 16:10:24.989577 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ListServersNegativeTestJSON-1676734841-project Aug 31 16:10:24.989577 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:10:24.989577 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:10:24.989577 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 68db583fb8fd4e6090fb220eeaafdd36 Aug 31 16:10:24.989577 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ListServersNegativeTestJSON-1676734841-project Aug 31 16:10:24.989577 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:10:24.989577 n-d-850499-9 devstack@n-api.service[122256]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 31 16:10:24.989577 n-d-850499-9 devstack@n-api.service[122256]: action_args: {} Aug 31 16:10:24.989577 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:10:24.989577 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:24.989577 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 16:10:24.989577 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 16:10:24.989577 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 16:10:24.989577 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise error Aug 31 16:10:24.989577 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Aug 31 16:10:24.989577 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:10:24.989577 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Aug 31 16:10:24.989577 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Aug 31 16:10:24.989577 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:10:24.989577 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 31 16:10:24.989577 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi '2011/01/01' Aug 31 16:10:24.989577 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:10:24.989577 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:10:24.989577 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:10:24.989577 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:24.989577 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:10:24.989577 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:10:24.989577 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:10:24.989577 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:10:24.989577 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:10:24.989577 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:10:24.989577 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 31 16:10:24.989577 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:10:24.989577 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 31 16:10:24.989577 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:10:24.989577 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 31 16:10:24.989577 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:10:24.989577 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 31 16:10:24.989577 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 31 16:10:24.989577 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 31 16:10:24.989577 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 16:10:24.993918 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 16:10:24.993918 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 16:10:24.993918 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 16:10:24.993918 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 31 16:10:24.993918 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:10:24.993918 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:10:24.993918 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:10:24.993918 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:24.993918 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:10:24.993918 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:10:24.993918 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 16:10:24.993918 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 16:10:24.993918 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 31 16:10:24.993918 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:10:24.993918 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0499025c-69f3-42a5-b8e1-7b1f1859efca tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:10:24.993918 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0499025c-69f3-42a5-b8e1-7b1f1859efca tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] 10.222.0.61 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.025371 Aug 31 16:10:24.997531 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1625/3203] 10.222.0.61 () {58 vars in 1182 bytes} [Wed Aug 31 16:10:24 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:10:25.006678 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e35eb99a-2231-4df7-af94-88af8d52bf4a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:25.009461 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e35eb99a-2231-4df7-af94-88af8d52bf4a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: d8590729-e3da-4e04-9daa-7e04a3d88068] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:25.025118 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e35eb99a-2231-4df7-af94-88af8d52bf4a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:25.027688 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e35eb99a-2231-4df7-af94-88af8d52bf4a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:25.029246 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e35eb99a-2231-4df7-af94-88af8d52bf4a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:25.031458 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e35eb99a-2231-4df7-af94-88af8d52bf4a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:25.032551 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e35eb99a-2231-4df7-af94-88af8d52bf4a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:25.035417 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e35eb99a-2231-4df7-af94-88af8d52bf4a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:25.065233 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-e35eb99a-2231-4df7-af94-88af8d52bf4a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] HTTP exception thrown: Instance d8590729-e3da-4e04-9daa-7e04a3d88068 could not be found. Aug 31 16:10:25.071933 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e35eb99a-2231-4df7-af94-88af8d52bf4a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Request method failure captured: Aug 31 16:10:25.071933 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/d8590729-e3da-4e04-9daa-7e04a3d88068 HTTP/1.1 Aug 31 16:10:25.071933 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:10:25.071933 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:10:25.071933 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:10:25.071933 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:10:25.071933 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:10:25.071933 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:10:25.071933 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:10:25.071933 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:10:25.071933 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4Yo5dNOTiRoHOXx-UM5Sn8Jbzoi0Z4yz9YBk3W8_DEhZnVZu-DDO0QOzNoQHJ1nNP8QtjbDsJSdq3n7hK4ZXI2LEyeWPrk9aNaREtGRbElEfeP-G76pg20KjiuDCyp0gfSMP_cw21bhq2fJbey8HuCI0lmGBIAsUVWfxqkVQu-gwfg Aug 31 16:10:25.071933 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:10:25.071933 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:10:25.071933 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:10:25.071933 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:10:25.071933 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:10:25.071933 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:10:25.071933 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: af5a8bccbcb14afd9c6bcd6f4d4f8047 Aug 31 16:10:25.071933 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-DeleteServersTestJSON-1125268000 Aug 31 16:10:25.071933 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:10:25.071933 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:10:25.071933 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/af5a8bccbcb14afd9c6bcd6f4d4f8047"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/af5a8bccbcb14afd9c6bcd6f4d4f8047"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_af5a8bccbcb14afd9c6bcd6f4d4f8047", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/af5a8bccbcb14afd9c6bcd6f4d4f8047"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:10:25.071933 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-DeleteServersTestJSON-1125268000 Aug 31 16:10:25.071933 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: af5a8bccbcb14afd9c6bcd6f4d4f8047 Aug 31 16:10:25.071933 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-DeleteServersTestJSON-1125268000 Aug 31 16:10:25.071933 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-DeleteServersTestJSON-1125268000-project Aug 31 16:10:25.071933 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:10:25.071933 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:10:25.071933 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 4ee58e6a7c284cc9a9c87d0a5c1239aa Aug 31 16:10:25.071933 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-DeleteServersTestJSON-1125268000-project Aug 31 16:10:25.071933 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:10:25.071933 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance d8590729-e3da-4e04-9daa-7e04a3d88068 could not be found. Aug 31 16:10:25.071933 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': 'd8590729-e3da-4e04-9daa-7e04a3d88068'} Aug 31 16:10:25.071933 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:10:25.071933 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:25.071933 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:10:25.071933 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:10:25.071933 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:10:25.071933 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:10:25.071933 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:10:25.071933 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:10:25.071933 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:10:25.071933 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:10:25.071933 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8590729-e3da-4e04-9daa-7e04a3d88068 could not be found. Aug 31 16:10:25.071933 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:10:25.071933 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:10:25.071933 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:10:25.071933 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:25.071933 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:10:25.071933 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:10:25.071933 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:10:25.071933 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:10:25.071933 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:10:25.071933 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:10:25.071933 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:10:25.071933 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:10:25.071933 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:10:25.071933 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:10:25.071933 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:10:25.071933 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:10:25.071933 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8590729-e3da-4e04-9daa-7e04a3d88068 could not be found. Aug 31 16:10:25.071933 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:10:25.071933 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:10:25.071933 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:10:25.075714 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:25.075714 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:10:25.075714 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:10:25.075714 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:10:25.075714 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:10:25.075714 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8590729-e3da-4e04-9daa-7e04a3d88068 could not be found. Aug 31 16:10:25.075714 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:10:25.075714 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e35eb99a-2231-4df7-af94-88af8d52bf4a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Returning 404 to user: Instance d8590729-e3da-4e04-9daa-7e04a3d88068 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:10:25.075714 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e35eb99a-2231-4df7-af94-88af8d52bf4a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/d8590729-e3da-4e04-9daa-7e04a3d88068" status: 404 len: 111 microversion: 2.1 time: 0.079204 Aug 31 16:10:25.076436 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1626/3204] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:24 2022] GET /compute/v2.1/servers/d8590729-e3da-4e04-9daa-7e04a3d88068 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:10:25.087990 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6c0cfaeb-fe85-47b6-aaa7-fe8011f033d1 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:25.093170 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6c0cfaeb-fe85-47b6-aaa7-fe8011f033d1 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] [instance: c393928f-2414-4093-9d72-93a21fc6c460] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:25.106864 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6c0cfaeb-fe85-47b6-aaa7-fe8011f033d1 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:25.107256 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6c0cfaeb-fe85-47b6-aaa7-fe8011f033d1 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:25.109028 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6c0cfaeb-fe85-47b6-aaa7-fe8011f033d1 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:25.110623 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6c0cfaeb-fe85-47b6-aaa7-fe8011f033d1 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:25.113451 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6c0cfaeb-fe85-47b6-aaa7-fe8011f033d1 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:25.113911 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6c0cfaeb-fe85-47b6-aaa7-fe8011f033d1 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:25.258350 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c3a821f3-c562-4ee5-b7c9-5fcc1ed2d768 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 7.642002 Aug 31 16:10:25.270726 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1579/3205] 10.222.0.61 () {62 vars in 1189 bytes} [Wed Aug 31 16:10:17 2022] POST /compute/v2.1/servers => generated 406 bytes in 7655 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 31 16:10:25.278659 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9ed0d76e-05f0-45a0-9694-4c2bf8c91221 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:25.289069 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9ed0d76e-05f0-45a0-9694-4c2bf8c91221 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '68db583fb8fd4e6090fb220eeaafdd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c965154856f84fecb30f49dfeac46fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:25.289971 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9ed0d76e-05f0-45a0-9694-4c2bf8c91221 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Searching by: {'deleted': False, 'project_id': 'c965154856f84fecb30f49dfeac46fa0'} {{(pid=122257) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 16:10:25.299898 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9ed0d76e-05f0-45a0-9694-4c2bf8c91221 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:25.300601 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9ed0d76e-05f0-45a0-9694-4c2bf8c91221 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:25.301322 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9ed0d76e-05f0-45a0-9694-4c2bf8c91221 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:25.302444 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9ed0d76e-05f0-45a0-9694-4c2bf8c91221 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:25.303164 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9ed0d76e-05f0-45a0-9694-4c2bf8c91221 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:25.304540 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9ed0d76e-05f0-45a0-9694-4c2bf8c91221 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:25.340106 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.multi_cell_list [None req-9ed0d76e-05f0-45a0-9694-4c2bf8c91221 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122257) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 31 16:10:25.380599 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9ed0d76e-05f0-45a0-9694-4c2bf8c91221 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] 10.222.0.61 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.108653 Aug 31 16:10:25.381807 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1580/3206] 10.222.0.61 () {58 vars in 1125 bytes} [Wed Aug 31 16:10:25 2022] GET /compute/v2.1/servers => generated 683 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:10:25.397155 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-47d0e245-6bd5-442a-b798-996ab7c8500a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:25.399468 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-47d0e245-6bd5-442a-b798-996ab7c8500a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: b1c1e611-4be6-4a43-aaf0-d02bfd87875c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:25.406189 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-47d0e245-6bd5-442a-b798-996ab7c8500a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:25.406687 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-47d0e245-6bd5-442a-b798-996ab7c8500a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:25.407417 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-47d0e245-6bd5-442a-b798-996ab7c8500a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:25.408357 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-47d0e245-6bd5-442a-b798-996ab7c8500a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:25.409169 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-47d0e245-6bd5-442a-b798-996ab7c8500a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:25.409889 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-47d0e245-6bd5-442a-b798-996ab7c8500a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:25.420254 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-6c0cfaeb-fe85-47b6-aaa7-fe8011f033d1 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b93395d63a4db895ff224a311940e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf281e8857247c6b9e60d4216741f89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:25.433594 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6c0cfaeb-fe85-47b6-aaa7-fe8011f033d1 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] 10.222.0.61 "GET /compute/v2.1/servers/c393928f-2414-4093-9d72-93a21fc6c460" status: 200 len: 1512 microversion: 2.1 time: 0.348133 Aug 31 16:10:25.435579 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1627/3207] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:25 2022] GET /compute/v2.1/servers/c393928f-2414-4093-9d72-93a21fc6c460 => generated 1512 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:25.444653 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-651128d3-958b-4406-8f47-6fd588febca4 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:25.447720 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-651128d3-958b-4406-8f47-6fd588febca4 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] [instance: fa0932e8-1aa4-4d1a-b653-14be35568f3d] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:25.451620 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-47d0e245-6bd5-442a-b798-996ab7c8500a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] HTTP exception thrown: Instance b1c1e611-4be6-4a43-aaf0-d02bfd87875c could not be found. Aug 31 16:10:25.457120 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-47d0e245-6bd5-442a-b798-996ab7c8500a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Request method failure captured: Aug 31 16:10:25.457120 n-d-850499-9 devstack@n-api.service[122257]: request: DELETE /compute/v2.1/servers/b1c1e611-4be6-4a43-aaf0-d02bfd87875c HTTP/1.1 Aug 31 16:10:25.457120 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:10:25.457120 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:10:25.457120 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:10:25.457120 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:10:25.457120 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:10:25.457120 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:10:25.457120 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:10:25.457120 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:10:25.457120 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4Yo5dNOTiRoHOXx-UM5Sn8Jbzoi0Z4yz9YBk3W8_DEhZnVZu-DDO0QOzNoQHJ1nNP8QtjbDsJSdq3n7hK4ZXI2LEyeWPrk9aNaREtGRbElEfeP-G76pg20KjiuDCyp0gfSMP_cw21bhq2fJbey8HuCI0lmGBIAsUVWfxqkVQu-gwfg Aug 31 16:10:25.457120 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:10:25.457120 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:10:25.457120 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:10:25.457120 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:10:25.457120 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:10:25.457120 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:10:25.457120 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: af5a8bccbcb14afd9c6bcd6f4d4f8047 Aug 31 16:10:25.457120 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-DeleteServersTestJSON-1125268000 Aug 31 16:10:25.457120 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:10:25.457120 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:10:25.457120 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/af5a8bccbcb14afd9c6bcd6f4d4f8047"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/af5a8bccbcb14afd9c6bcd6f4d4f8047"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_af5a8bccbcb14afd9c6bcd6f4d4f8047", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/af5a8bccbcb14afd9c6bcd6f4d4f8047"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:10:25.457120 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-DeleteServersTestJSON-1125268000 Aug 31 16:10:25.457120 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: af5a8bccbcb14afd9c6bcd6f4d4f8047 Aug 31 16:10:25.457120 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-DeleteServersTestJSON-1125268000 Aug 31 16:10:25.457120 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-DeleteServersTestJSON-1125268000-project Aug 31 16:10:25.457120 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:10:25.457120 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:10:25.457120 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 4ee58e6a7c284cc9a9c87d0a5c1239aa Aug 31 16:10:25.457120 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-DeleteServersTestJSON-1125268000-project Aug 31 16:10:25.457120 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:10:25.457120 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance b1c1e611-4be6-4a43-aaf0-d02bfd87875c could not be found. Aug 31 16:10:25.457120 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': 'b1c1e611-4be6-4a43-aaf0-d02bfd87875c'} Aug 31 16:10:25.457120 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:10:25.457120 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:25.457120 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:10:25.457120 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:10:25.457120 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:10:25.457120 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:10:25.457120 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:10:25.457120 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:10:25.457120 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:10:25.457120 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:10:25.457120 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1c1e611-4be6-4a43-aaf0-d02bfd87875c could not be found. Aug 31 16:10:25.457120 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:10:25.457120 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:10:25.457120 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:10:25.457120 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:25.457120 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:10:25.457120 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:10:25.457120 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:10:25.457120 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:10:25.457120 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:10:25.457120 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:10:25.457120 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:10:25.457120 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:10:25.457120 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:10:25.457120 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:10:25.457120 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:10:25.457120 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:10:25.457120 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:10:25.457120 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:10:25.463632 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1c1e611-4be6-4a43-aaf0-d02bfd87875c could not be found. Aug 31 16:10:25.463632 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:10:25.463632 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:10:25.463632 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:10:25.463632 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:25.463632 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:10:25.463632 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:10:25.463632 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:10:25.463632 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:10:25.463632 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1c1e611-4be6-4a43-aaf0-d02bfd87875c could not be found. Aug 31 16:10:25.463632 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:10:25.463632 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-47d0e245-6bd5-442a-b798-996ab7c8500a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Returning 404 to user: Instance b1c1e611-4be6-4a43-aaf0-d02bfd87875c could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:10:25.463632 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-47d0e245-6bd5-442a-b798-996ab7c8500a tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "DELETE /compute/v2.1/servers/b1c1e611-4be6-4a43-aaf0-d02bfd87875c" status: 404 len: 111 microversion: 2.1 time: 0.077949 Aug 31 16:10:25.463632 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1581/3208] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:10:25 2022] DELETE /compute/v2.1/servers/b1c1e611-4be6-4a43-aaf0-d02bfd87875c => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:10:25.472690 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:10:25.479070 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a6bfbf59-1957-4f33-844e-095eebdbae94 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:25.483905 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a6bfbf59-1957-4f33-844e-095eebdbae94 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '68db583fb8fd4e6090fb220eeaafdd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c965154856f84fecb30f49dfeac46fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:25.484368 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.compute.servers [None req-a6bfbf59-1957-4f33-844e-095eebdbae94 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Removing options 'limit' from query {{(pid=122257) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 31 16:10:25.485034 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a6bfbf59-1957-4f33-844e-095eebdbae94 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Searching by: {'deleted': False, 'project_id': 'c965154856f84fecb30f49dfeac46fa0'} {{(pid=122257) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 16:10:25.502317 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a6bfbf59-1957-4f33-844e-095eebdbae94 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:25.502804 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a6bfbf59-1957-4f33-844e-095eebdbae94 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:25.503243 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a6bfbf59-1957-4f33-844e-095eebdbae94 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:25.504117 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a6bfbf59-1957-4f33-844e-095eebdbae94 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:25.505087 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a6bfbf59-1957-4f33-844e-095eebdbae94 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:25.505754 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a6bfbf59-1957-4f33-844e-095eebdbae94 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:25.544527 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.multi_cell_list [None req-a6bfbf59-1957-4f33-844e-095eebdbae94 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=122257) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 31 16:10:25.592839 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a6bfbf59-1957-4f33-844e-095eebdbae94 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] 10.222.0.61 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.124873 Aug 31 16:10:25.593906 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1582/3209] 10.222.0.61 () {58 vars in 1144 bytes} [Wed Aug 31 16:10:25 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:10:25.601661 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-85523dcb-5532-48b3-b654-3a8f4335e810 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:25.602778 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-85523dcb-5532-48b3-b654-3a8f4335e810 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] [instance: e6064a64-eae1-400c-b60c-2189e025905f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:25.610307 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-85523dcb-5532-48b3-b654-3a8f4335e810 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:25.611819 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-85523dcb-5532-48b3-b654-3a8f4335e810 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:25.613149 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-85523dcb-5532-48b3-b654-3a8f4335e810 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:25.614639 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-85523dcb-5532-48b3-b654-3a8f4335e810 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:25.616014 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-85523dcb-5532-48b3-b654-3a8f4335e810 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:25.616660 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-85523dcb-5532-48b3-b654-3a8f4335e810 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:25.676332 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-651128d3-958b-4406-8f47-6fd588febca4 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:25.685456 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-651128d3-958b-4406-8f47-6fd588febca4 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:25.687420 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-651128d3-958b-4406-8f47-6fd588febca4 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:25.688774 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-651128d3-958b-4406-8f47-6fd588febca4 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] 10.222.0.61 "GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d" status: 200 len: 1285 microversion: 2.32 time: 0.252086 Aug 31 16:10:25.689561 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1628/3210] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:10:25 2022] GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d => generated 1285 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:10:25.704528 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a6ce2d5c-d3bf-4c08-9afb-890fbca132bf tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:25.704528 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a6ce2d5c-d3bf-4c08-9afb-890fbca132bf tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] [instance: b1c1e611-4be6-4a43-aaf0-d02bfd87875c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:25.711242 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a6ce2d5c-d3bf-4c08-9afb-890fbca132bf tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:25.711931 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a6ce2d5c-d3bf-4c08-9afb-890fbca132bf tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:25.713146 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a6ce2d5c-d3bf-4c08-9afb-890fbca132bf tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:25.713896 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a6ce2d5c-d3bf-4c08-9afb-890fbca132bf tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:25.714383 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a6ce2d5c-d3bf-4c08-9afb-890fbca132bf tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:25.714816 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a6ce2d5c-d3bf-4c08-9afb-890fbca132bf tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:25.731041 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-a6ce2d5c-d3bf-4c08-9afb-890fbca132bf tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] HTTP exception thrown: Instance b1c1e611-4be6-4a43-aaf0-d02bfd87875c could not be found. Aug 31 16:10:25.732662 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a6ce2d5c-d3bf-4c08-9afb-890fbca132bf tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Request method failure captured: Aug 31 16:10:25.732662 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/b1c1e611-4be6-4a43-aaf0-d02bfd87875c HTTP/1.1 Aug 31 16:10:25.732662 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:10:25.732662 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:10:25.732662 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:10:25.732662 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:10:25.732662 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:10:25.732662 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:10:25.732662 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:10:25.732662 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:10:25.732662 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4Yo5dNOTiRoHOXx-UM5Sn8Jbzoi0Z4yz9YBk3W8_DEhZnVZu-DDO0QOzNoQHJ1nNP8QtjbDsJSdq3n7hK4ZXI2LEyeWPrk9aNaREtGRbElEfeP-G76pg20KjiuDCyp0gfSMP_cw21bhq2fJbey8HuCI0lmGBIAsUVWfxqkVQu-gwfg Aug 31 16:10:25.732662 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:10:25.732662 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:10:25.732662 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:10:25.732662 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:10:25.732662 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:10:25.732662 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:10:25.732662 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: af5a8bccbcb14afd9c6bcd6f4d4f8047 Aug 31 16:10:25.732662 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-DeleteServersTestJSON-1125268000 Aug 31 16:10:25.732662 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:10:25.732662 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:10:25.732662 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/af5a8bccbcb14afd9c6bcd6f4d4f8047"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/af5a8bccbcb14afd9c6bcd6f4d4f8047"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_af5a8bccbcb14afd9c6bcd6f4d4f8047", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/af5a8bccbcb14afd9c6bcd6f4d4f8047"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:10:25.732662 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-DeleteServersTestJSON-1125268000 Aug 31 16:10:25.732662 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: af5a8bccbcb14afd9c6bcd6f4d4f8047 Aug 31 16:10:25.732662 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-DeleteServersTestJSON-1125268000 Aug 31 16:10:25.732662 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-DeleteServersTestJSON-1125268000-project Aug 31 16:10:25.732662 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:10:25.732662 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:10:25.732662 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 4ee58e6a7c284cc9a9c87d0a5c1239aa Aug 31 16:10:25.732662 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-DeleteServersTestJSON-1125268000-project Aug 31 16:10:25.732662 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:10:25.732662 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance b1c1e611-4be6-4a43-aaf0-d02bfd87875c could not be found. Aug 31 16:10:25.732662 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': 'b1c1e611-4be6-4a43-aaf0-d02bfd87875c'} Aug 31 16:10:25.732662 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:10:25.732662 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:25.732662 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:10:25.732662 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:10:25.732662 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:10:25.732662 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:10:25.732662 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:10:25.732662 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:10:25.732662 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:10:25.732662 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:10:25.732662 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1c1e611-4be6-4a43-aaf0-d02bfd87875c could not be found. Aug 31 16:10:25.732662 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:10:25.732662 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:10:25.732662 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:10:25.732662 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:25.732662 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:10:25.732662 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:10:25.732662 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:10:25.732662 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:10:25.732662 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:10:25.732662 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:10:25.732662 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:10:25.732662 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:10:25.732662 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:10:25.732662 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:10:25.732662 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:10:25.732662 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:10:25.732662 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1c1e611-4be6-4a43-aaf0-d02bfd87875c could not be found. Aug 31 16:10:25.732662 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:10:25.732662 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:10:25.732662 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:10:25.736500 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:25.736500 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:10:25.736500 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:10:25.736500 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:10:25.736500 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:10:25.736500 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1c1e611-4be6-4a43-aaf0-d02bfd87875c could not be found. Aug 31 16:10:25.736500 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:10:25.736500 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a6ce2d5c-d3bf-4c08-9afb-890fbca132bf tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] Returning 404 to user: Instance b1c1e611-4be6-4a43-aaf0-d02bfd87875c could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:10:25.736500 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a6ce2d5c-d3bf-4c08-9afb-890fbca132bf tempest-DeleteServersTestJSON-1125268000 tempest-DeleteServersTestJSON-1125268000-project] 10.222.0.61 "GET /compute/v2.1/servers/b1c1e611-4be6-4a43-aaf0-d02bfd87875c" status: 404 len: 111 microversion: 2.1 time: 0.037576 Aug 31 16:10:25.736500 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1629/3211] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:25 2022] GET /compute/v2.1/servers/b1c1e611-4be6-4a43-aaf0-d02bfd87875c => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:10:25.740004 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-22105922-e392-4526-a7dc-b85275724705 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:25.741699 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-22105922-e392-4526-a7dc-b85275724705 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] [instance: 606f1624-8c53-409e-b06b-ace080f7fc44] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:25.747980 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-22105922-e392-4526-a7dc-b85275724705 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:25.748549 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-22105922-e392-4526-a7dc-b85275724705 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:25.749830 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-22105922-e392-4526-a7dc-b85275724705 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:25.750557 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-22105922-e392-4526-a7dc-b85275724705 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:25.750995 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-22105922-e392-4526-a7dc-b85275724705 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:25.751596 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-22105922-e392-4526-a7dc-b85275724705 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:26.182792 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-22105922-e392-4526-a7dc-b85275724705 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13cabcaa79043bea338128594a6b00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab7f0d889224cefbca55343f3208a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:26.194734 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-22105922-e392-4526-a7dc-b85275724705 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] 10.222.0.61 "GET /compute/v2.1/servers/606f1624-8c53-409e-b06b-ace080f7fc44" status: 200 len: 1281 microversion: 2.1 time: 0.458849 Aug 31 16:10:26.195971 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1630/3212] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:25 2022] GET /compute/v2.1/servers/606f1624-8c53-409e-b06b-ace080f7fc44 => generated 1281 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:26.212055 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-47b96fb3-4b8a-4300-bd24-215cb5f27fed tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:26.216085 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-47b96fb3-4b8a-4300-bd24-215cb5f27fed tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Request method failure captured: Aug 31 16:10:26.216085 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Aug 31 16:10:26.216085 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:10:26.216085 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:10:26.216085 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:10:26.216085 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:10:26.216085 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:10:26.216085 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:10:26.216085 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:10:26.216085 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:10:26.216085 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4e3VulAbsVbf-R_KJJopCzL4TMuVlDpJWFc1QxE_VfyNmRdCYzoeGI3DOp904JH19R2ftEX6dDaPCOB9WVPxd6DoNCdJI6XasCui_OVYbMISua7YP2-9CFPcxpMidTtXQe3Mq7ucg5-1-_FtBTisohEps1qxvpOawH_RIjV85BgAaM Aug 31 16:10:26.216085 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:10:26.216085 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:10:26.216085 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:10:26.216085 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:10:26.216085 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:10:26.216085 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:10:26.216085 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: c965154856f84fecb30f49dfeac46fa0 Aug 31 16:10:26.216085 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ListServersNegativeTestJSON-1676734841 Aug 31 16:10:26.216085 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:10:26.216085 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:10:26.216085 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c965154856f84fecb30f49dfeac46fa0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/c965154856f84fecb30f49dfeac46fa0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_c965154856f84fecb30f49dfeac46fa0", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c965154856f84fecb30f49dfeac46fa0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:10:26.216085 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ListServersNegativeTestJSON-1676734841 Aug 31 16:10:26.216085 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: c965154856f84fecb30f49dfeac46fa0 Aug 31 16:10:26.216085 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1676734841 Aug 31 16:10:26.216085 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ListServersNegativeTestJSON-1676734841-project Aug 31 16:10:26.216085 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:10:26.216085 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:10:26.216085 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 68db583fb8fd4e6090fb220eeaafdd36 Aug 31 16:10:26.216085 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ListServersNegativeTestJSON-1676734841-project Aug 31 16:10:26.216085 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:10:26.216085 n-d-850499-9 devstack@n-api.service[122256]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 31 16:10:26.216085 n-d-850499-9 devstack@n-api.service[122256]: action_args: {} Aug 31 16:10:26.216085 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:10:26.216085 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:26.216085 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 16:10:26.216085 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 16:10:26.216085 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 16:10:26.216085 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise error Aug 31 16:10:26.216085 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Aug 31 16:10:26.216085 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:10:26.216085 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Aug 31 16:10:26.216085 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 31 16:10:26.216085 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi 'minimum': 0, Aug 31 16:10:26.216085 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 31 16:10:26.216085 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 31 16:10:26.216085 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:10:26.216085 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 31 16:10:26.216085 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi '-1' Aug 31 16:10:26.216085 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:10:26.216085 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:10:26.216085 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:10:26.216085 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:26.216085 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:10:26.216085 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:10:26.216085 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:10:26.216085 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:10:26.216085 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:10:26.216085 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:10:26.216085 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 31 16:10:26.216085 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:10:26.216085 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 31 16:10:26.216085 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:10:26.216085 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 31 16:10:26.216085 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:10:26.216085 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 31 16:10:26.216085 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 31 16:10:26.216085 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 31 16:10:26.220538 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 16:10:26.220538 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 16:10:26.220538 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 16:10:26.220538 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 16:10:26.220538 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 31 16:10:26.220538 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:10:26.220538 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:10:26.220538 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:10:26.220538 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:26.220538 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:10:26.220538 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:10:26.220538 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 16:10:26.220538 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 16:10:26.220538 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 31 16:10:26.220538 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:10:26.220538 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-47b96fb3-4b8a-4300-bd24-215cb5f27fed tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:10:26.220538 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-47b96fb3-4b8a-4300-bd24-215cb5f27fed tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] 10.222.0.61 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.021004 Aug 31 16:10:26.222765 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1631/3213] 10.222.0.61 () {58 vars in 1142 bytes} [Wed Aug 31 16:10:26 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:10:26.229892 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-cd967c87-debb-444e-b6e2-3924943a9661 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:26.237839 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-cd967c87-debb-444e-b6e2-3924943a9661 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Request method failure captured: Aug 31 16:10:26.237839 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Aug 31 16:10:26.237839 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:10:26.237839 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:10:26.237839 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:10:26.237839 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:10:26.237839 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:10:26.237839 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:10:26.237839 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:10:26.237839 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:10:26.237839 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4e3VulAbsVbf-R_KJJopCzL4TMuVlDpJWFc1QxE_VfyNmRdCYzoeGI3DOp904JH19R2ftEX6dDaPCOB9WVPxd6DoNCdJI6XasCui_OVYbMISua7YP2-9CFPcxpMidTtXQe3Mq7ucg5-1-_FtBTisohEps1qxvpOawH_RIjV85BgAaM Aug 31 16:10:26.237839 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:10:26.237839 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:10:26.237839 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:10:26.237839 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:10:26.237839 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:10:26.237839 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:10:26.237839 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: c965154856f84fecb30f49dfeac46fa0 Aug 31 16:10:26.237839 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ListServersNegativeTestJSON-1676734841 Aug 31 16:10:26.237839 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:10:26.237839 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:10:26.237839 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c965154856f84fecb30f49dfeac46fa0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/c965154856f84fecb30f49dfeac46fa0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_c965154856f84fecb30f49dfeac46fa0", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c965154856f84fecb30f49dfeac46fa0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:10:26.237839 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ListServersNegativeTestJSON-1676734841 Aug 31 16:10:26.237839 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: c965154856f84fecb30f49dfeac46fa0 Aug 31 16:10:26.237839 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1676734841 Aug 31 16:10:26.237839 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ListServersNegativeTestJSON-1676734841-project Aug 31 16:10:26.237839 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:10:26.237839 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:10:26.237839 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 68db583fb8fd4e6090fb220eeaafdd36 Aug 31 16:10:26.237839 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ListServersNegativeTestJSON-1676734841-project Aug 31 16:10:26.237839 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:10:26.237839 n-d-850499-9 devstack@n-api.service[122256]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 31 16:10:26.237839 n-d-850499-9 devstack@n-api.service[122256]: action_args: {} Aug 31 16:10:26.237839 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:10:26.237839 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:26.237839 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 16:10:26.237839 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 16:10:26.237839 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 16:10:26.237839 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise error Aug 31 16:10:26.237839 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Aug 31 16:10:26.237839 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:10:26.237839 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Aug 31 16:10:26.237839 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 31 16:10:26.237839 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi 'minimum': 0, Aug 31 16:10:26.237839 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 31 16:10:26.237839 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 31 16:10:26.237839 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:10:26.237839 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 31 16:10:26.237839 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi 'testing' Aug 31 16:10:26.237839 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:10:26.237839 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:10:26.237839 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:10:26.237839 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:26.237839 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:10:26.237839 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:10:26.237839 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:10:26.237839 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:10:26.237839 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:10:26.237839 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:10:26.237839 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 31 16:10:26.237839 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:10:26.237839 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 31 16:10:26.237839 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:10:26.237839 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 31 16:10:26.237839 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:10:26.237839 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 31 16:10:26.237839 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 31 16:10:26.237839 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 31 16:10:26.243492 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 16:10:26.243492 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 16:10:26.243492 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 16:10:26.243492 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 16:10:26.243492 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 31 16:10:26.243492 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:10:26.243492 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:10:26.243492 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:10:26.243492 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:26.243492 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:10:26.243492 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:10:26.243492 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 16:10:26.243492 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 16:10:26.243492 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 31 16:10:26.243492 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:10:26.243492 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-cd967c87-debb-444e-b6e2-3924943a9661 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:10:26.243492 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-cd967c87-debb-444e-b6e2-3924943a9661 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] 10.222.0.61 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.015239 Aug 31 16:10:26.251474 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1632/3214] 10.222.0.61 () {58 vars in 1152 bytes} [Wed Aug 31 16:10:26 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:10:26.257335 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-14f8fc19-18ba-4402-bc3d-00f40e2540d1 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:26.273769 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-14f8fc19-18ba-4402-bc3d-00f40e2540d1 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '68db583fb8fd4e6090fb220eeaafdd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c965154856f84fecb30f49dfeac46fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:26.274480 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-14f8fc19-18ba-4402-bc3d-00f40e2540d1 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': 'c965154856f84fecb30f49dfeac46fa0'} {{(pid=122256) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 16:10:26.294561 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.compute.servers [None req-14f8fc19-18ba-4402-bc3d-00f40e2540d1 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Flavor 'non_existing_flavor' could not be found {{(pid=122256) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Aug 31 16:10:26.295658 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-14f8fc19-18ba-4402-bc3d-00f40e2540d1 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] 10.222.0.61 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.042209 Aug 31 16:10:26.296245 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1633/3215] 10.222.0.61 () {58 vars in 1178 bytes} [Wed Aug 31 16:10:26 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 16:10:26.308309 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-68940b16-1291-42b7-a9eb-dbe2493fedff req-7788f9f1-ce71-4738-824e-ae7e241a5561 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eed024b5-986b-40fa-a686-ceab563a6131", "tag": "512921c8-73a5-4a95-ab19-e9b589b7421e"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:10:26.326059 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-68940b16-1291-42b7-a9eb-dbe2493fedff req-7788f9f1-ce71-4738-824e-ae7e241a5561 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:26.326783 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-68940b16-1291-42b7-a9eb-dbe2493fedff req-7788f9f1-ce71-4738-824e-ae7e241a5561 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:26.327397 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-68940b16-1291-42b7-a9eb-dbe2493fedff req-7788f9f1-ce71-4738-824e-ae7e241a5561 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:26.347186 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-68940b16-1291-42b7-a9eb-dbe2493fedff req-7788f9f1-ce71-4738-824e-ae7e241a5561 service nova] Creating event network-changed:512921c8-73a5-4a95-ab19-e9b589b7421e for instance eed024b5-986b-40fa-a686-ceab563a6131 on n-h1-850499-9 Aug 31 16:10:26.356807 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-68940b16-1291-42b7-a9eb-dbe2493fedff req-7788f9f1-ce71-4738-824e-ae7e241a5561 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059330 Aug 31 16:10:26.361084 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-85523dcb-5532-48b3-b654-3a8f4335e810 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b93395d63a4db895ff224a311940e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf281e8857247c6b9e60d4216741f89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:26.361868 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1634/3216] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:10:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:10:26.371763 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-85523dcb-5532-48b3-b654-3a8f4335e810 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] 10.222.0.61 "GET /compute/v2.1/servers/e6064a64-eae1-400c-b60c-2189e025905f" status: 200 len: 1512 microversion: 2.1 time: 0.776183 Aug 31 16:10:26.383524 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1583/3217] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:25 2022] GET /compute/v2.1/servers/e6064a64-eae1-400c-b60c-2189e025905f => generated 1512 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:26.384373 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3136ed50-7f4b-4524-a622-be8ae2c530c3 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:26.397248 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-df4334f7-b7f1-4a67-8944-bf68a3c85197 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:26.401026 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-df4334f7-b7f1-4a67-8944-bf68a3c85197 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] [instance: d1e43fd8-2e15-468d-9da0-2851a41bd23b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:26.406542 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3136ed50-7f4b-4524-a622-be8ae2c530c3 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '68db583fb8fd4e6090fb220eeaafdd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c965154856f84fecb30f49dfeac46fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:26.407343 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3136ed50-7f4b-4524-a622-be8ae2c530c3 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': 'c965154856f84fecb30f49dfeac46fa0'} {{(pid=122256) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 16:10:26.418562 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-df4334f7-b7f1-4a67-8944-bf68a3c85197 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:26.422847 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-df4334f7-b7f1-4a67-8944-bf68a3c85197 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:26.426428 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-df4334f7-b7f1-4a67-8944-bf68a3c85197 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:26.430663 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3136ed50-7f4b-4524-a622-be8ae2c530c3 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:26.431209 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3136ed50-7f4b-4524-a622-be8ae2c530c3 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:26.431551 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-df4334f7-b7f1-4a67-8944-bf68a3c85197 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:26.432731 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-df4334f7-b7f1-4a67-8944-bf68a3c85197 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:26.434631 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-df4334f7-b7f1-4a67-8944-bf68a3c85197 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:26.436531 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3136ed50-7f4b-4524-a622-be8ae2c530c3 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:26.437451 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3136ed50-7f4b-4524-a622-be8ae2c530c3 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:26.438033 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3136ed50-7f4b-4524-a622-be8ae2c530c3 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:26.438375 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3136ed50-7f4b-4524-a622-be8ae2c530c3 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:26.627518 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3136ed50-7f4b-4524-a622-be8ae2c530c3 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] 10.222.0.61 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.262589 Aug 31 16:10:26.628447 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1635/3218] 10.222.0.61 () {58 vars in 1174 bytes} [Wed Aug 31 16:10:26 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 16:10:26.644918 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6b60616b-277b-418c-b525-6e1a6369bea5 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:26.653052 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-6b60616b-277b-418c-b525-6e1a6369bea5 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '68db583fb8fd4e6090fb220eeaafdd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c965154856f84fecb30f49dfeac46fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:26.654254 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6b60616b-277b-418c-b525-6e1a6369bea5 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': 'c965154856f84fecb30f49dfeac46fa0'} {{(pid=122256) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 16:10:26.660753 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6b60616b-277b-418c-b525-6e1a6369bea5 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:26.661673 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6b60616b-277b-418c-b525-6e1a6369bea5 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:26.662217 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6b60616b-277b-418c-b525-6e1a6369bea5 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:26.663138 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6b60616b-277b-418c-b525-6e1a6369bea5 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:26.665876 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6b60616b-277b-418c-b525-6e1a6369bea5 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:26.666604 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6b60616b-277b-418c-b525-6e1a6369bea5 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:26.787930 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6b60616b-277b-418c-b525-6e1a6369bea5 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] 10.222.0.61 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.147984 Aug 31 16:10:26.792072 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1636/3219] 10.222.0.61 () {58 vars in 1184 bytes} [Wed Aug 31 16:10:26 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 16:10:26.799902 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f3e91098-1495-4fd5-938b-7a1c650aac90 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:26.801937 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f3e91098-1495-4fd5-938b-7a1c650aac90 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] [instance: fa0932e8-1aa4-4d1a-b653-14be35568f3d] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:26.905527 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f3e91098-1495-4fd5-938b-7a1c650aac90 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:26.918659 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f3e91098-1495-4fd5-938b-7a1c650aac90 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:26.920894 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f3e91098-1495-4fd5-938b-7a1c650aac90 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:26.923267 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f3e91098-1495-4fd5-938b-7a1c650aac90 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] 10.222.0.61 "GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d" status: 200 len: 1285 microversion: 2.32 time: 0.128926 Aug 31 16:10:26.925046 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1637/3220] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:10:26 2022] GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d => generated 1285 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:10:26.933446 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b685d465-3a4d-4ae3-854e-d2501988a747 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:26.940780 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b685d465-3a4d-4ae3-854e-d2501988a747 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '68db583fb8fd4e6090fb220eeaafdd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c965154856f84fecb30f49dfeac46fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:26.942410 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b685d465-3a4d-4ae3-854e-d2501988a747 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Searching by: {'deleted': False, 'project_id': 'c965154856f84fecb30f49dfeac46fa0'} {{(pid=122256) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 16:10:26.952203 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b685d465-3a4d-4ae3-854e-d2501988a747 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:26.953490 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b685d465-3a4d-4ae3-854e-d2501988a747 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:26.954971 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b685d465-3a4d-4ae3-854e-d2501988a747 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:26.956091 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b685d465-3a4d-4ae3-854e-d2501988a747 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:26.958761 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b685d465-3a4d-4ae3-854e-d2501988a747 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:26.959389 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b685d465-3a4d-4ae3-854e-d2501988a747 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:27.014619 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.multi_cell_list [None req-b685d465-3a4d-4ae3-854e-d2501988a747 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122256) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 31 16:10:27.076073 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b685d465-3a4d-4ae3-854e-d2501988a747 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68db583fb8fd4e6090fb220eeaafdd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c965154856f84fecb30f49dfeac46fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:27.088899 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b685d465-3a4d-4ae3-854e-d2501988a747 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:27.091537 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b685d465-3a4d-4ae3-854e-d2501988a747 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:27.091537 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b685d465-3a4d-4ae3-854e-d2501988a747 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:27.334321 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-df4334f7-b7f1-4a67-8944-bf68a3c85197 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b93395d63a4db895ff224a311940e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf281e8857247c6b9e60d4216741f89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:27.344824 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-df4334f7-b7f1-4a67-8944-bf68a3c85197 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] 10.222.0.61 "GET /compute/v2.1/servers/d1e43fd8-2e15-468d-9da0-2851a41bd23b" status: 200 len: 1512 microversion: 2.1 time: 0.955419 Aug 31 16:10:27.345935 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1584/3221] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:26 2022] GET /compute/v2.1/servers/d1e43fd8-2e15-468d-9da0-2851a41bd23b => generated 1512 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:10:27.352414 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e0e1baec-81b4-4d64-a198-1d47750f56b8 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:27.360330 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e0e1baec-81b4-4d64-a198-1d47750f56b8 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] [instance: 606f1624-8c53-409e-b06b-ace080f7fc44] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:27.368397 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e0e1baec-81b4-4d64-a198-1d47750f56b8 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:27.372536 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e0e1baec-81b4-4d64-a198-1d47750f56b8 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:27.373216 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e0e1baec-81b4-4d64-a198-1d47750f56b8 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:27.374495 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e0e1baec-81b4-4d64-a198-1d47750f56b8 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:27.376046 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e0e1baec-81b4-4d64-a198-1d47750f56b8 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:27.377772 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e0e1baec-81b4-4d64-a198-1d47750f56b8 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:27.400014 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b685d465-3a4d-4ae3-854e-d2501988a747 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] 10.222.0.61 "GET /compute/v2.1/servers/detail" status: 200 len: 3025 microversion: 2.1 time: 0.471324 Aug 31 16:10:27.400014 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1638/3222] 10.222.0.61 () {58 vars in 1146 bytes} [Wed Aug 31 16:10:26 2022] GET /compute/v2.1/servers/detail => generated 3025 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:27.405348 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ece6cad0-723e-44ac-bc45-d97f9827d9c4 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:27.418668 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ece6cad0-723e-44ac-bc45-d97f9827d9c4 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '41b93395d63a4db895ff224a311940e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf281e8857247c6b9e60d4216741f89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:27.420659 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ece6cad0-723e-44ac-bc45-d97f9827d9c4 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Searching by: {'ip': '172.20.0.14', 'deleted': False, 'project_id': '1cf281e8857247c6b9e60d4216741f89'} {{(pid=122256) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 16:10:27.636348 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ece6cad0-723e-44ac-bc45-d97f9827d9c4 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:27.636934 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ece6cad0-723e-44ac-bc45-d97f9827d9c4 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:27.637299 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ece6cad0-723e-44ac-bc45-d97f9827d9c4 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:27.638047 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ece6cad0-723e-44ac-bc45-d97f9827d9c4 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:27.638511 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ece6cad0-723e-44ac-bc45-d97f9827d9c4 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:27.638947 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ece6cad0-723e-44ac-bc45-d97f9827d9c4 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:27.860502 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e0e1baec-81b4-4d64-a198-1d47750f56b8 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13cabcaa79043bea338128594a6b00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab7f0d889224cefbca55343f3208a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:27.877016 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.multi_cell_list [None req-ece6cad0-723e-44ac-bc45-d97f9827d9c4 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122256) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 31 16:10:27.896390 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e0e1baec-81b4-4d64-a198-1d47750f56b8 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] 10.222.0.61 "GET /compute/v2.1/servers/606f1624-8c53-409e-b06b-ace080f7fc44" status: 200 len: 1323 microversion: 2.1 time: 0.548894 Aug 31 16:10:27.899429 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1585/3223] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:27 2022] GET /compute/v2.1/servers/606f1624-8c53-409e-b06b-ace080f7fc44 => generated 1323 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:27.905947 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-97ead8a8-82d5-4cfc-8e58-1d43a542c5e6 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:27.929176 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-97ead8a8-82d5-4cfc-8e58-1d43a542c5e6 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '68db583fb8fd4e6090fb220eeaafdd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c965154856f84fecb30f49dfeac46fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:27.933670 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-97ead8a8-82d5-4cfc-8e58-1d43a542c5e6 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] 10.222.0.61 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.032995 Aug 31 16:10:27.940898 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1586/3224] 10.222.0.61 () {58 vars in 1178 bytes} [Wed Aug 31 16:10:27 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 16:10:27.941072 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=100 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:10:27.954483 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-649d6db2-aea2-4e2d-88ad-e54c37193c3f tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:27.955974 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-649d6db2-aea2-4e2d-88ad-e54c37193c3f tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] [instance: 0ac914d2-e9f7-4f2f-a01d-49674180d8db] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:27.976558 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-649d6db2-aea2-4e2d-88ad-e54c37193c3f tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:27.977254 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-649d6db2-aea2-4e2d-88ad-e54c37193c3f tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:27.979889 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-649d6db2-aea2-4e2d-88ad-e54c37193c3f tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:27.980649 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-649d6db2-aea2-4e2d-88ad-e54c37193c3f tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:27.983671 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-649d6db2-aea2-4e2d-88ad-e54c37193c3f tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:27.984160 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-649d6db2-aea2-4e2d-88ad-e54c37193c3f tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:28.071988 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ece6cad0-723e-44ac-bc45-d97f9827d9c4 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] 10.222.0.61 "GET /compute/v2.1/servers?ip=172.20.0.14" status: 200 len: 345 microversion: 2.1 time: 0.671061 Aug 31 16:10:28.079998 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1639/3225] 10.222.0.61 () {58 vars in 1154 bytes} [Wed Aug 31 16:10:27 2022] GET /compute/v2.1/servers?ip=172.20.0.14 => generated 345 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:10:28.082927 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-deed5d90-82c3-471f-adc3-6cea6033f0e4 req-65a92a67-0bda-467e-ade3-679631159f3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ac914d2-e9f7-4f2f-a01d-49674180d8db", "tag": "2c7e9f34-2b8a-470a-af28-22027bffc1a7"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:10:28.113522 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-deed5d90-82c3-471f-adc3-6cea6033f0e4 req-65a92a67-0bda-467e-ade3-679631159f3b service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:28.114031 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-deed5d90-82c3-471f-adc3-6cea6033f0e4 req-65a92a67-0bda-467e-ade3-679631159f3b service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:28.114475 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-deed5d90-82c3-471f-adc3-6cea6033f0e4 req-65a92a67-0bda-467e-ade3-679631159f3b service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:28.149964 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-deed5d90-82c3-471f-adc3-6cea6033f0e4 req-65a92a67-0bda-467e-ade3-679631159f3b service nova] Creating event network-changed:2c7e9f34-2b8a-470a-af28-22027bffc1a7 for instance 0ac914d2-e9f7-4f2f-a01d-49674180d8db on n-h2-850499-9 Aug 31 16:10:28.164766 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-649d6db2-aea2-4e2d-88ad-e54c37193c3f tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c65ee5ffa9d74bfdacbea45f1564d19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55320a9c8f714bc0911ded3ab88ddf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:28.166407 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-deed5d90-82c3-471f-adc3-6cea6033f0e4 req-65a92a67-0bda-467e-ade3-679631159f3b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091885 Aug 31 16:10:28.167023 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1640/3226] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:10:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:10:28.172043 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0e8b9bee-2572-4311-ad59-ced043daa5f7 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:28.178089 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-649d6db2-aea2-4e2d-88ad-e54c37193c3f tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] 10.222.0.61 "GET /compute/v2.1/servers/0ac914d2-e9f7-4f2f-a01d-49674180d8db" status: 200 len: 1483 microversion: 2.1 time: 0.239304 Aug 31 16:10:28.180664 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1587/3227] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:27 2022] GET /compute/v2.1/servers/0ac914d2-e9f7-4f2f-a01d-49674180d8db => generated 1483 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:28.187070 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-23ae4a3a-993b-45cb-8124-517862a7fa27 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:28.187959 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-23ae4a3a-993b-45cb-8124-517862a7fa27 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] [instance: fa0932e8-1aa4-4d1a-b653-14be35568f3d] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:28.189105 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-0e8b9bee-2572-4311-ad59-ced043daa5f7 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '68db583fb8fd4e6090fb220eeaafdd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c965154856f84fecb30f49dfeac46fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:28.189929 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0e8b9bee-2572-4311-ad59-ced043daa5f7 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Searching by: {'deleted': False, 'project_id': 'c965154856f84fecb30f49dfeac46fa0'} {{(pid=122256) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 16:10:28.195542 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-23ae4a3a-993b-45cb-8124-517862a7fa27 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:28.196367 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-23ae4a3a-993b-45cb-8124-517862a7fa27 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:28.197085 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-23ae4a3a-993b-45cb-8124-517862a7fa27 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:28.197277 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0e8b9bee-2572-4311-ad59-ced043daa5f7 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:28.197743 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0e8b9bee-2572-4311-ad59-ced043daa5f7 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:28.198190 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0e8b9bee-2572-4311-ad59-ced043daa5f7 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:28.198738 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-23ae4a3a-993b-45cb-8124-517862a7fa27 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:28.199294 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-23ae4a3a-993b-45cb-8124-517862a7fa27 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:28.199986 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-23ae4a3a-993b-45cb-8124-517862a7fa27 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:28.204171 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0e8b9bee-2572-4311-ad59-ced043daa5f7 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:28.204689 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0e8b9bee-2572-4311-ad59-ced043daa5f7 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:28.205224 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0e8b9bee-2572-4311-ad59-ced043daa5f7 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:28.250998 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.multi_cell_list [None req-0e8b9bee-2572-4311-ad59-ced043daa5f7 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122256) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 31 16:10:28.289985 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-23ae4a3a-993b-45cb-8124-517862a7fa27 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:28.302363 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0e8b9bee-2572-4311-ad59-ced043daa5f7 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] 10.222.0.61 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.134093 Aug 31 16:10:28.312310 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1641/3228] 10.222.0.61 () {58 vars in 1125 bytes} [Wed Aug 31 16:10:28 2022] GET /compute/v2.1/servers => generated 683 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:10:28.313048 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-23ae4a3a-993b-45cb-8124-517862a7fa27 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:28.314878 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-23ae4a3a-993b-45cb-8124-517862a7fa27 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:28.316963 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-23ae4a3a-993b-45cb-8124-517862a7fa27 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] 10.222.0.61 "GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d" status: 200 len: 1575 microversion: 2.32 time: 0.134820 Aug 31 16:10:28.317890 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-06526d02-55f3-4896-9653-4b2bc6d454a4 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:28.318347 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1588/3229] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:10:28 2022] GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d => generated 1575 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:10:28.318687 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-06526d02-55f3-4896-9653-4b2bc6d454a4 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] [instance: c393928f-2414-4093-9d72-93a21fc6c460] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:28.323827 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-82ef6fc9-bca0-4e8e-bcb6-8ca29f25bfbf tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:28.324678 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-82ef6fc9-bca0-4e8e-bcb6-8ca29f25bfbf tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] [instance: b68db583-0d09-4485-8b26-ff5c02e23c01] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:28.331087 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-06526d02-55f3-4896-9653-4b2bc6d454a4 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:28.331611 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-06526d02-55f3-4896-9653-4b2bc6d454a4 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:28.332386 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-06526d02-55f3-4896-9653-4b2bc6d454a4 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:28.332925 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-06526d02-55f3-4896-9653-4b2bc6d454a4 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:28.333394 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-06526d02-55f3-4896-9653-4b2bc6d454a4 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:28.333826 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-06526d02-55f3-4896-9653-4b2bc6d454a4 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:28.339492 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-82ef6fc9-bca0-4e8e-bcb6-8ca29f25bfbf tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:28.340377 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-82ef6fc9-bca0-4e8e-bcb6-8ca29f25bfbf tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:28.341028 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-82ef6fc9-bca0-4e8e-bcb6-8ca29f25bfbf tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:28.342369 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-82ef6fc9-bca0-4e8e-bcb6-8ca29f25bfbf tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:28.343036 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-82ef6fc9-bca0-4e8e-bcb6-8ca29f25bfbf tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:28.343726 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-82ef6fc9-bca0-4e8e-bcb6-8ca29f25bfbf tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:28.361913 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-82ef6fc9-bca0-4e8e-bcb6-8ca29f25bfbf tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] HTTP exception thrown: Instance b68db583-0d09-4485-8b26-ff5c02e23c01 could not be found. Aug 31 16:10:28.363843 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-82ef6fc9-bca0-4e8e-bcb6-8ca29f25bfbf tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Request method failure captured: Aug 31 16:10:28.363843 n-d-850499-9 devstack@n-api.service[122257]: request: DELETE /compute/v2.1/servers/b68db583-0d09-4485-8b26-ff5c02e23c01 HTTP/1.1 Aug 31 16:10:28.363843 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:10:28.363843 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:10:28.363843 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:10:28.363843 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:10:28.363843 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:10:28.363843 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:10:28.363843 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:10:28.363843 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:10:28.363843 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4e3VulAbsVbf-R_KJJopCzL4TMuVlDpJWFc1QxE_VfyNmRdCYzoeGI3DOp904JH19R2ftEX6dDaPCOB9WVPxd6DoNCdJI6XasCui_OVYbMISua7YP2-9CFPcxpMidTtXQe3Mq7ucg5-1-_FtBTisohEps1qxvpOawH_RIjV85BgAaM Aug 31 16:10:28.363843 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:10:28.363843 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:10:28.363843 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:10:28.363843 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:10:28.363843 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:10:28.363843 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:10:28.363843 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: c965154856f84fecb30f49dfeac46fa0 Aug 31 16:10:28.363843 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ListServersNegativeTestJSON-1676734841 Aug 31 16:10:28.363843 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:10:28.363843 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:10:28.363843 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c965154856f84fecb30f49dfeac46fa0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/c965154856f84fecb30f49dfeac46fa0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_c965154856f84fecb30f49dfeac46fa0", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c965154856f84fecb30f49dfeac46fa0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:10:28.363843 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ListServersNegativeTestJSON-1676734841 Aug 31 16:10:28.363843 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: c965154856f84fecb30f49dfeac46fa0 Aug 31 16:10:28.363843 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1676734841 Aug 31 16:10:28.363843 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ListServersNegativeTestJSON-1676734841-project Aug 31 16:10:28.363843 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:10:28.363843 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:10:28.363843 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 68db583fb8fd4e6090fb220eeaafdd36 Aug 31 16:10:28.363843 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ListServersNegativeTestJSON-1676734841-project Aug 31 16:10:28.363843 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:10:28.363843 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance b68db583-0d09-4485-8b26-ff5c02e23c01 could not be found. Aug 31 16:10:28.363843 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': 'b68db583-0d09-4485-8b26-ff5c02e23c01'} Aug 31 16:10:28.363843 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:10:28.363843 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:28.363843 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:10:28.363843 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:10:28.363843 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:10:28.363843 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:10:28.363843 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:10:28.363843 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:10:28.363843 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:10:28.363843 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:10:28.363843 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b68db583-0d09-4485-8b26-ff5c02e23c01 could not be found. Aug 31 16:10:28.363843 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:10:28.363843 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:10:28.363843 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:10:28.363843 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:28.363843 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:10:28.363843 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:10:28.363843 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:10:28.363843 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:10:28.363843 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:10:28.363843 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:10:28.363843 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:10:28.363843 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:10:28.363843 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:10:28.363843 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:10:28.363843 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:10:28.363843 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:10:28.363843 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:10:28.363843 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:10:28.369655 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b68db583-0d09-4485-8b26-ff5c02e23c01 could not be found. Aug 31 16:10:28.369655 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:10:28.369655 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:10:28.369655 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:10:28.369655 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:28.369655 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:10:28.369655 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:10:28.369655 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:10:28.369655 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:10:28.369655 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b68db583-0d09-4485-8b26-ff5c02e23c01 could not be found. Aug 31 16:10:28.369655 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:10:28.380596 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-82ef6fc9-bca0-4e8e-bcb6-8ca29f25bfbf tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Returning 404 to user: Instance b68db583-0d09-4485-8b26-ff5c02e23c01 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:10:28.381644 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-82ef6fc9-bca0-4e8e-bcb6-8ca29f25bfbf tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] 10.222.0.61 "DELETE /compute/v2.1/servers/b68db583-0d09-4485-8b26-ff5c02e23c01" status: 404 len: 111 microversion: 2.1 time: 0.061864 Aug 31 16:10:28.386100 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1589/3230] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:10:28 2022] DELETE /compute/v2.1/servers/b68db583-0d09-4485-8b26-ff5c02e23c01 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:10:28.402346 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f839eab8-101e-4792-a73c-6c636a9dd33e tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:28.406629 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f839eab8-101e-4792-a73c-6c636a9dd33e tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] [instance: 29a78fc3-93ff-4f42-8c9f-79dfdc5229c6] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:28.419827 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f839eab8-101e-4792-a73c-6c636a9dd33e tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:28.420420 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f839eab8-101e-4792-a73c-6c636a9dd33e tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:28.427055 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f839eab8-101e-4792-a73c-6c636a9dd33e tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:28.427957 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f839eab8-101e-4792-a73c-6c636a9dd33e tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:28.428508 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f839eab8-101e-4792-a73c-6c636a9dd33e tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:28.429606 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f839eab8-101e-4792-a73c-6c636a9dd33e tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:28.487114 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f839eab8-101e-4792-a73c-6c636a9dd33e tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] [instance: 29a78fc3-93ff-4f42-8c9f-79dfdc5229c6] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:10:28.610947 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-06526d02-55f3-4896-9653-4b2bc6d454a4 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b93395d63a4db895ff224a311940e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf281e8857247c6b9e60d4216741f89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:28.630291 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-06526d02-55f3-4896-9653-4b2bc6d454a4 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] 10.222.0.61 "GET /compute/v2.1/servers/c393928f-2414-4093-9d72-93a21fc6c460" status: 200 len: 1512 microversion: 2.1 time: 0.316502 Aug 31 16:10:28.631706 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1642/3231] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:28 2022] GET /compute/v2.1/servers/c393928f-2414-4093-9d72-93a21fc6c460 => generated 1512 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:28.646141 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f839eab8-101e-4792-a73c-6c636a9dd33e tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] 10.222.0.61 "DELETE /compute/v2.1/servers/29a78fc3-93ff-4f42-8c9f-79dfdc5229c6" status: 204 len: 0 microversion: 2.1 time: 0.239488 Aug 31 16:10:28.650087 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1590/3232] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:10:28 2022] DELETE /compute/v2.1/servers/29a78fc3-93ff-4f42-8c9f-79dfdc5229c6 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:10:28.658697 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1d96203c-e9bb-4140-a011-f6c6338553e5 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:28.658959 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1d96203c-e9bb-4140-a011-f6c6338553e5 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] [instance: 33bb5423-4b3e-4030-a835-8ab823e2e00a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:28.664902 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7fc3e081-438a-4fdb-8550-d37816eb5a57 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:28.671229 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7fc3e081-438a-4fdb-8550-d37816eb5a57 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] [instance: e6064a64-eae1-400c-b60c-2189e025905f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:28.676954 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1d96203c-e9bb-4140-a011-f6c6338553e5 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:28.677455 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1d96203c-e9bb-4140-a011-f6c6338553e5 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:28.678064 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1d96203c-e9bb-4140-a011-f6c6338553e5 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:28.678614 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1d96203c-e9bb-4140-a011-f6c6338553e5 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:28.679876 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1d96203c-e9bb-4140-a011-f6c6338553e5 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:28.686939 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1d96203c-e9bb-4140-a011-f6c6338553e5 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:28.698482 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7fc3e081-438a-4fdb-8550-d37816eb5a57 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:28.702020 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7fc3e081-438a-4fdb-8550-d37816eb5a57 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:28.702748 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7fc3e081-438a-4fdb-8550-d37816eb5a57 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:28.704232 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7fc3e081-438a-4fdb-8550-d37816eb5a57 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:28.706471 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7fc3e081-438a-4fdb-8550-d37816eb5a57 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:28.710875 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7fc3e081-438a-4fdb-8550-d37816eb5a57 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:28.755599 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1d96203c-e9bb-4140-a011-f6c6338553e5 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] [instance: 33bb5423-4b3e-4030-a835-8ab823e2e00a] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:10:28.920547 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1d96203c-e9bb-4140-a011-f6c6338553e5 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] 10.222.0.61 "DELETE /compute/v2.1/servers/33bb5423-4b3e-4030-a835-8ab823e2e00a" status: 204 len: 0 microversion: 2.1 time: 0.267562 Aug 31 16:10:28.924544 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1591/3233] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:10:28 2022] DELETE /compute/v2.1/servers/33bb5423-4b3e-4030-a835-8ab823e2e00a => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 16:10:28.932275 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-02e6836a-0d05-4aba-bf86-8acb2facb749 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:28.933282 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-02e6836a-0d05-4aba-bf86-8acb2facb749 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] [instance: 606f1624-8c53-409e-b06b-ace080f7fc44] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:28.937869 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:10:28.942890 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-02e6836a-0d05-4aba-bf86-8acb2facb749 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:28.943850 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-02e6836a-0d05-4aba-bf86-8acb2facb749 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:28.944345 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-02e6836a-0d05-4aba-bf86-8acb2facb749 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:28.945405 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-02e6836a-0d05-4aba-bf86-8acb2facb749 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:28.945878 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-02e6836a-0d05-4aba-bf86-8acb2facb749 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:28.946480 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-02e6836a-0d05-4aba-bf86-8acb2facb749 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:28.976819 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:10:29.196076 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-02e6836a-0d05-4aba-bf86-8acb2facb749 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13cabcaa79043bea338128594a6b00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab7f0d889224cefbca55343f3208a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:29.208136 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-02e6836a-0d05-4aba-bf86-8acb2facb749 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] 10.222.0.61 "GET /compute/v2.1/servers/606f1624-8c53-409e-b06b-ace080f7fc44" status: 200 len: 1323 microversion: 2.1 time: 0.284060 Aug 31 16:10:29.211339 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1592/3234] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:28 2022] GET /compute/v2.1/servers/606f1624-8c53-409e-b06b-ace080f7fc44 => generated 1323 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:29.215913 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c3aee6cd-2ef6-4c7c-bdee-3fc4c9720c69 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:29.217248 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c3aee6cd-2ef6-4c7c-bdee-3fc4c9720c69 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] [instance: b68db583-0d09-4485-8b26-ff5c02e23c01] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:29.237334 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c3aee6cd-2ef6-4c7c-bdee-3fc4c9720c69 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:29.237946 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c3aee6cd-2ef6-4c7c-bdee-3fc4c9720c69 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:29.238501 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c3aee6cd-2ef6-4c7c-bdee-3fc4c9720c69 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:29.239874 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c3aee6cd-2ef6-4c7c-bdee-3fc4c9720c69 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:29.240484 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c3aee6cd-2ef6-4c7c-bdee-3fc4c9720c69 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:29.242848 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c3aee6cd-2ef6-4c7c-bdee-3fc4c9720c69 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:29.263593 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-c3aee6cd-2ef6-4c7c-bdee-3fc4c9720c69 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] HTTP exception thrown: Instance b68db583-0d09-4485-8b26-ff5c02e23c01 could not be found. Aug 31 16:10:29.265569 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c3aee6cd-2ef6-4c7c-bdee-3fc4c9720c69 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Request method failure captured: Aug 31 16:10:29.265569 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/b68db583-0d09-4485-8b26-ff5c02e23c01 HTTP/1.1 Aug 31 16:10:29.265569 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:10:29.265569 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:10:29.265569 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:10:29.265569 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:10:29.265569 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:10:29.265569 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:10:29.265569 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:10:29.265569 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:10:29.265569 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4e3VulAbsVbf-R_KJJopCzL4TMuVlDpJWFc1QxE_VfyNmRdCYzoeGI3DOp904JH19R2ftEX6dDaPCOB9WVPxd6DoNCdJI6XasCui_OVYbMISua7YP2-9CFPcxpMidTtXQe3Mq7ucg5-1-_FtBTisohEps1qxvpOawH_RIjV85BgAaM Aug 31 16:10:29.265569 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:10:29.265569 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:10:29.265569 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:10:29.265569 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:10:29.265569 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:10:29.265569 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:10:29.265569 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: c965154856f84fecb30f49dfeac46fa0 Aug 31 16:10:29.265569 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ListServersNegativeTestJSON-1676734841 Aug 31 16:10:29.265569 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:10:29.265569 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:10:29.265569 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c965154856f84fecb30f49dfeac46fa0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/c965154856f84fecb30f49dfeac46fa0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_c965154856f84fecb30f49dfeac46fa0", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c965154856f84fecb30f49dfeac46fa0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:10:29.265569 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ListServersNegativeTestJSON-1676734841 Aug 31 16:10:29.265569 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: c965154856f84fecb30f49dfeac46fa0 Aug 31 16:10:29.265569 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1676734841 Aug 31 16:10:29.265569 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ListServersNegativeTestJSON-1676734841-project Aug 31 16:10:29.265569 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:10:29.265569 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:10:29.265569 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 68db583fb8fd4e6090fb220eeaafdd36 Aug 31 16:10:29.265569 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ListServersNegativeTestJSON-1676734841-project Aug 31 16:10:29.265569 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:10:29.265569 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance b68db583-0d09-4485-8b26-ff5c02e23c01 could not be found. Aug 31 16:10:29.265569 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': 'b68db583-0d09-4485-8b26-ff5c02e23c01'} Aug 31 16:10:29.265569 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:10:29.265569 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:29.265569 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:10:29.265569 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:10:29.265569 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:10:29.265569 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:10:29.265569 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:10:29.265569 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:10:29.265569 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:10:29.265569 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:10:29.265569 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b68db583-0d09-4485-8b26-ff5c02e23c01 could not be found. Aug 31 16:10:29.265569 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:10:29.265569 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:10:29.265569 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:10:29.265569 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:29.265569 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:10:29.265569 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:10:29.265569 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:10:29.265569 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:10:29.265569 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:10:29.265569 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:10:29.265569 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:10:29.265569 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:10:29.265569 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:10:29.265569 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:10:29.265569 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:10:29.265569 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:10:29.265569 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b68db583-0d09-4485-8b26-ff5c02e23c01 could not be found. Aug 31 16:10:29.265569 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:10:29.265569 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:10:29.272401 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:10:29.272401 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:29.272401 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:10:29.272401 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:10:29.272401 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:10:29.272401 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:10:29.272401 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b68db583-0d09-4485-8b26-ff5c02e23c01 could not be found. Aug 31 16:10:29.272401 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:10:29.273440 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7fc3e081-438a-4fdb-8550-d37816eb5a57 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b93395d63a4db895ff224a311940e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf281e8857247c6b9e60d4216741f89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:29.276912 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c3aee6cd-2ef6-4c7c-bdee-3fc4c9720c69 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Returning 404 to user: Instance b68db583-0d09-4485-8b26-ff5c02e23c01 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:10:29.277911 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c3aee6cd-2ef6-4c7c-bdee-3fc4c9720c69 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] 10.222.0.61 "GET /compute/v2.1/servers/b68db583-0d09-4485-8b26-ff5c02e23c01" status: 404 len: 111 microversion: 2.1 time: 0.067834 Aug 31 16:10:29.278730 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1593/3235] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:29 2022] GET /compute/v2.1/servers/b68db583-0d09-4485-8b26-ff5c02e23c01 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:10:29.290709 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8bc13761-fb77-49a4-9b1c-618e0984e654 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:29.291598 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7fc3e081-438a-4fdb-8550-d37816eb5a57 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] 10.222.0.61 "GET /compute/v2.1/servers/e6064a64-eae1-400c-b60c-2189e025905f" status: 200 len: 1512 microversion: 2.1 time: 0.638412 Aug 31 16:10:29.292983 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1643/3236] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:28 2022] GET /compute/v2.1/servers/e6064a64-eae1-400c-b60c-2189e025905f => generated 1512 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:29.295931 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8bc13761-fb77-49a4-9b1c-618e0984e654 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] [instance: 29a78fc3-93ff-4f42-8c9f-79dfdc5229c6] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:29.304992 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8bc13761-fb77-49a4-9b1c-618e0984e654 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:29.305771 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8bc13761-fb77-49a4-9b1c-618e0984e654 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:29.306476 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8bc13761-fb77-49a4-9b1c-618e0984e654 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:29.307528 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8bc13761-fb77-49a4-9b1c-618e0984e654 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:29.308175 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8bc13761-fb77-49a4-9b1c-618e0984e654 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:29.308793 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8bc13761-fb77-49a4-9b1c-618e0984e654 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:29.326305 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-63c79dc7-5630-46b5-9849-d0ffe02ea1f0 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:29.329494 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-63c79dc7-5630-46b5-9849-d0ffe02ea1f0 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] [instance: d1e43fd8-2e15-468d-9da0-2851a41bd23b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:29.352822 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-63c79dc7-5630-46b5-9849-d0ffe02ea1f0 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:29.354087 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-63c79dc7-5630-46b5-9849-d0ffe02ea1f0 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:29.355156 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-63c79dc7-5630-46b5-9849-d0ffe02ea1f0 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:29.358177 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-63c79dc7-5630-46b5-9849-d0ffe02ea1f0 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:29.359229 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-63c79dc7-5630-46b5-9849-d0ffe02ea1f0 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:29.372131 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-63c79dc7-5630-46b5-9849-d0ffe02ea1f0 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:29.612028 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-63c79dc7-5630-46b5-9849-d0ffe02ea1f0 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b93395d63a4db895ff224a311940e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf281e8857247c6b9e60d4216741f89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:29.626056 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-63c79dc7-5630-46b5-9849-d0ffe02ea1f0 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] 10.222.0.61 "GET /compute/v2.1/servers/d1e43fd8-2e15-468d-9da0-2851a41bd23b" status: 200 len: 1512 microversion: 2.1 time: 0.309268 Aug 31 16:10:29.639541 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1644/3237] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:29 2022] GET /compute/v2.1/servers/d1e43fd8-2e15-468d-9da0-2851a41bd23b => generated 1512 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:29.639541 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ff48166e-f396-48c7-a600-7bf7159fcb6d tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:29.639541 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ff48166e-f396-48c7-a600-7bf7159fcb6d tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] [instance: fa0932e8-1aa4-4d1a-b653-14be35568f3d] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:29.648415 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ff48166e-f396-48c7-a600-7bf7159fcb6d tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:29.649066 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ff48166e-f396-48c7-a600-7bf7159fcb6d tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:29.649624 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ff48166e-f396-48c7-a600-7bf7159fcb6d tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:29.650453 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ff48166e-f396-48c7-a600-7bf7159fcb6d tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:29.651011 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ff48166e-f396-48c7-a600-7bf7159fcb6d tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:29.651553 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ff48166e-f396-48c7-a600-7bf7159fcb6d tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:29.651989 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8bc13761-fb77-49a4-9b1c-618e0984e654 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68db583fb8fd4e6090fb220eeaafdd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c965154856f84fecb30f49dfeac46fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:29.660795 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8bc13761-fb77-49a4-9b1c-618e0984e654 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] 10.222.0.61 "GET /compute/v2.1/servers/29a78fc3-93ff-4f42-8c9f-79dfdc5229c6" status: 200 len: 1522 microversion: 2.1 time: 0.377131 Aug 31 16:10:29.663486 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1594/3238] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:29 2022] GET /compute/v2.1/servers/29a78fc3-93ff-4f42-8c9f-79dfdc5229c6 => generated 1522 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:29.667406 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-de29590f-69ab-4116-a8fa-64e7307f6321 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:29.672874 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-de29590f-69ab-4116-a8fa-64e7307f6321 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '41b93395d63a4db895ff224a311940e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf281e8857247c6b9e60d4216741f89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:29.674328 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-de29590f-69ab-4116-a8fa-64e7307f6321 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Searching by: {'deleted': False, 'project_id': '1cf281e8857247c6b9e60d4216741f89'} {{(pid=122257) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 16:10:29.681657 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-de29590f-69ab-4116-a8fa-64e7307f6321 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:29.682426 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-de29590f-69ab-4116-a8fa-64e7307f6321 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:29.682880 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-de29590f-69ab-4116-a8fa-64e7307f6321 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:29.683671 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-de29590f-69ab-4116-a8fa-64e7307f6321 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:29.684204 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-de29590f-69ab-4116-a8fa-64e7307f6321 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:29.684641 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-de29590f-69ab-4116-a8fa-64e7307f6321 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:29.720232 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.multi_cell_list [None req-de29590f-69ab-4116-a8fa-64e7307f6321 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122257) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 31 16:10:29.729757 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ff48166e-f396-48c7-a600-7bf7159fcb6d tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:29.744737 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ff48166e-f396-48c7-a600-7bf7159fcb6d tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:29.746546 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ff48166e-f396-48c7-a600-7bf7159fcb6d tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:29.747846 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ff48166e-f396-48c7-a600-7bf7159fcb6d tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] 10.222.0.61 "GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d" status: 200 len: 1593 microversion: 2.32 time: 0.118444 Aug 31 16:10:29.748427 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1645/3239] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:10:29 2022] GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d => generated 1593 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:10:29.763351 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-de29590f-69ab-4116-a8fa-64e7307f6321 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b93395d63a4db895ff224a311940e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf281e8857247c6b9e60d4216741f89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:29.771679 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-de29590f-69ab-4116-a8fa-64e7307f6321 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:29.772175 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-de29590f-69ab-4116-a8fa-64e7307f6321 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:29.772623 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-de29590f-69ab-4116-a8fa-64e7307f6321 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:29.925020 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-de29590f-69ab-4116-a8fa-64e7307f6321 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] 10.222.0.61 "GET /compute/v2.1/servers/detail" status: 200 len: 4519 microversion: 2.1 time: 0.261845 Aug 31 16:10:29.925867 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1595/3240] 10.222.0.61 () {58 vars in 1146 bytes} [Wed Aug 31 16:10:29 2022] GET /compute/v2.1/servers/detail => generated 4519 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:29.954758 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-96592ec0-5f35-4d23-b708-34b6ef67ef3e tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:29.959751 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-96592ec0-5f35-4d23-b708-34b6ef67ef3e tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '41b93395d63a4db895ff224a311940e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf281e8857247c6b9e60d4216741f89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:29.960540 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-96592ec0-5f35-4d23-b708-34b6ef67ef3e tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '1cf281e8857247c6b9e60d4216741f89'} {{(pid=122256) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 16:10:30.030014 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-96592ec0-5f35-4d23-b708-34b6ef67ef3e tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:30.030510 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-96592ec0-5f35-4d23-b708-34b6ef67ef3e tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:30.030978 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-96592ec0-5f35-4d23-b708-34b6ef67ef3e tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:30.031800 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-96592ec0-5f35-4d23-b708-34b6ef67ef3e tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:30.032278 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-96592ec0-5f35-4d23-b708-34b6ef67ef3e tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:30.032703 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-96592ec0-5f35-4d23-b708-34b6ef67ef3e tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:30.065989 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.multi_cell_list [None req-96592ec0-5f35-4d23-b708-34b6ef67ef3e tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122256) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 31 16:10:30.099441 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-96592ec0-5f35-4d23-b708-34b6ef67ef3e tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] 10.222.0.61 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1010 microversion: 2.1 time: 0.148324 Aug 31 16:10:30.100152 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1646/3241] 10.222.0.61 () {58 vars in 1150 bytes} [Wed Aug 31 16:10:29 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1010 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:30.114386 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-14a4c1fa-64af-46b9-9520-2794b5814a42 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:30.120114 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-14a4c1fa-64af-46b9-9520-2794b5814a42 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '41b93395d63a4db895ff224a311940e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf281e8857247c6b9e60d4216741f89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:30.121767 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-14a4c1fa-64af-46b9-9520-2794b5814a42 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '1cf281e8857247c6b9e60d4216741f89'} {{(pid=122257) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 16:10:30.124521 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-2c105f08-9dc9-464d-8d00-d240fb195518 req-f4c6b372-b675-4718-a76c-8664261d5bf1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "606f1624-8c53-409e-b06b-ace080f7fc44", "tag": "bd761e9e-656b-4464-b63f-bb9440ae7e14"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:10:30.127434 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-14a4c1fa-64af-46b9-9520-2794b5814a42 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:30.128072 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-14a4c1fa-64af-46b9-9520-2794b5814a42 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:30.128534 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-14a4c1fa-64af-46b9-9520-2794b5814a42 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:30.129904 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-14a4c1fa-64af-46b9-9520-2794b5814a42 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:30.129904 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-14a4c1fa-64af-46b9-9520-2794b5814a42 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:30.130297 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-14a4c1fa-64af-46b9-9520-2794b5814a42 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:30.139618 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-2c105f08-9dc9-464d-8d00-d240fb195518 req-f4c6b372-b675-4718-a76c-8664261d5bf1 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:30.140493 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-2c105f08-9dc9-464d-8d00-d240fb195518 req-f4c6b372-b675-4718-a76c-8664261d5bf1 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:30.141135 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-2c105f08-9dc9-464d-8d00-d240fb195518 req-f4c6b372-b675-4718-a76c-8664261d5bf1 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:30.155088 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-2c105f08-9dc9-464d-8d00-d240fb195518 req-f4c6b372-b675-4718-a76c-8664261d5bf1 service nova] Creating event network-changed:bd761e9e-656b-4464-b63f-bb9440ae7e14 for instance 606f1624-8c53-409e-b06b-ace080f7fc44 on n-h1-850499-9 Aug 31 16:10:30.160493 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-2c105f08-9dc9-464d-8d00-d240fb195518 req-f4c6b372-b675-4718-a76c-8664261d5bf1 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040670 Aug 31 16:10:30.161421 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1647/3242] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:10:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:10:30.233493 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.multi_cell_list [None req-14a4c1fa-64af-46b9-9520-2794b5814a42 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122257) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 31 16:10:30.236978 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7f4a34b9-436b-4e80-bec5-bb54153da5c6 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:30.237672 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7f4a34b9-436b-4e80-bec5-bb54153da5c6 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] [instance: 606f1624-8c53-409e-b06b-ace080f7fc44] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:30.245911 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7f4a34b9-436b-4e80-bec5-bb54153da5c6 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:30.245911 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7f4a34b9-436b-4e80-bec5-bb54153da5c6 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:30.249245 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7f4a34b9-436b-4e80-bec5-bb54153da5c6 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:30.249245 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7f4a34b9-436b-4e80-bec5-bb54153da5c6 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:30.249245 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7f4a34b9-436b-4e80-bec5-bb54153da5c6 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:30.249245 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7f4a34b9-436b-4e80-bec5-bb54153da5c6 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:30.313559 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-14a4c1fa-64af-46b9-9520-2794b5814a42 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] 10.222.0.61 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1010 microversion: 2.1 time: 0.203392 Aug 31 16:10:30.314359 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1596/3243] 10.222.0.61 () {58 vars in 1212 bytes} [Wed Aug 31 16:10:30 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1010 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:30.326953 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-609c02bb-27e6-4b93-bd3f-821da9375fbe tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:30.332809 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-609c02bb-27e6-4b93-bd3f-821da9375fbe tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '41b93395d63a4db895ff224a311940e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf281e8857247c6b9e60d4216741f89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:30.333562 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-609c02bb-27e6-4b93-bd3f-821da9375fbe tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '1cf281e8857247c6b9e60d4216741f89'} {{(pid=122257) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 16:10:30.340863 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-609c02bb-27e6-4b93-bd3f-821da9375fbe tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:30.341654 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-609c02bb-27e6-4b93-bd3f-821da9375fbe tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:30.342481 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-609c02bb-27e6-4b93-bd3f-821da9375fbe tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:30.343324 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-609c02bb-27e6-4b93-bd3f-821da9375fbe tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:30.343923 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-609c02bb-27e6-4b93-bd3f-821da9375fbe tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:30.344458 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-609c02bb-27e6-4b93-bd3f-821da9375fbe tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:30.441888 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.multi_cell_list [None req-609c02bb-27e6-4b93-bd3f-821da9375fbe tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122257) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 31 16:10:30.500024 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7f4a34b9-436b-4e80-bec5-bb54153da5c6 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13cabcaa79043bea338128594a6b00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab7f0d889224cefbca55343f3208a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:30.517072 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-609c02bb-27e6-4b93-bd3f-821da9375fbe tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] 10.222.0.61 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1010 microversion: 2.1 time: 0.194262 Aug 31 16:10:30.518302 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1597/3244] 10.222.0.61 () {58 vars in 1196 bytes} [Wed Aug 31 16:10:30 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1010 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:10:30.532162 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7f4a34b9-436b-4e80-bec5-bb54153da5c6 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] 10.222.0.61 "GET /compute/v2.1/servers/606f1624-8c53-409e-b06b-ace080f7fc44" status: 200 len: 1323 microversion: 2.1 time: 0.299700 Aug 31 16:10:30.536212 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1648/3245] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:30 2022] GET /compute/v2.1/servers/606f1624-8c53-409e-b06b-ace080f7fc44 => generated 1323 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:10:30.536505 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-52bba6ce-0ce7-43a3-9584-d08ee5059a4e tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:30.543891 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-52bba6ce-0ce7-43a3-9584-d08ee5059a4e tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '41b93395d63a4db895ff224a311940e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf281e8857247c6b9e60d4216741f89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:30.546162 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-52bba6ce-0ce7-43a3-9584-d08ee5059a4e tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Searching by: {'name': '-437544270', 'deleted': False, 'project_id': '1cf281e8857247c6b9e60d4216741f89'} {{(pid=122257) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 16:10:30.552005 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-52bba6ce-0ce7-43a3-9584-d08ee5059a4e tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:30.552495 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-52bba6ce-0ce7-43a3-9584-d08ee5059a4e tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:30.552929 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-52bba6ce-0ce7-43a3-9584-d08ee5059a4e tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:30.553660 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-52bba6ce-0ce7-43a3-9584-d08ee5059a4e tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:30.554330 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-52bba6ce-0ce7-43a3-9584-d08ee5059a4e tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:30.554797 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-52bba6ce-0ce7-43a3-9584-d08ee5059a4e tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:30.686381 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-043cc1d5-93e8-44ee-9933-43ec99e69689 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:30.687117 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-043cc1d5-93e8-44ee-9933-43ec99e69689 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] [instance: 29a78fc3-93ff-4f42-8c9f-79dfdc5229c6] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:30.691727 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.multi_cell_list [None req-52bba6ce-0ce7-43a3-9584-d08ee5059a4e tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122257) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 31 16:10:30.700538 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-043cc1d5-93e8-44ee-9933-43ec99e69689 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:30.701125 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-043cc1d5-93e8-44ee-9933-43ec99e69689 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:30.701644 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-043cc1d5-93e8-44ee-9933-43ec99e69689 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:30.702436 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-043cc1d5-93e8-44ee-9933-43ec99e69689 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:30.702979 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-043cc1d5-93e8-44ee-9933-43ec99e69689 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:30.703483 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-043cc1d5-93e8-44ee-9933-43ec99e69689 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:30.869446 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-52bba6ce-0ce7-43a3-9584-d08ee5059a4e tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] 10.222.0.61 "GET /compute/v2.1/servers?name=-437544270" status: 200 len: 345 microversion: 2.1 time: 0.338081 Aug 31 16:10:30.872902 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1598/3246] 10.222.0.61 () {58 vars in 1156 bytes} [Wed Aug 31 16:10:30 2022] GET /compute/v2.1/servers?name=-437544270 => generated 345 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:10:30.884651 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8e400616-c561-4909-a271-225ef5d4e7d0 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:30.885627 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8e400616-c561-4909-a271-225ef5d4e7d0 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] [instance: fa0932e8-1aa4-4d1a-b653-14be35568f3d] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:30.901876 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8e400616-c561-4909-a271-225ef5d4e7d0 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:30.907474 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8e400616-c561-4909-a271-225ef5d4e7d0 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:30.907793 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8e400616-c561-4909-a271-225ef5d4e7d0 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:30.908683 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8e400616-c561-4909-a271-225ef5d4e7d0 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:30.909272 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8e400616-c561-4909-a271-225ef5d4e7d0 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:30.909815 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8e400616-c561-4909-a271-225ef5d4e7d0 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:31.121189 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8e400616-c561-4909-a271-225ef5d4e7d0 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:31.143043 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8e400616-c561-4909-a271-225ef5d4e7d0 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:31.145299 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8e400616-c561-4909-a271-225ef5d4e7d0 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:31.147562 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8e400616-c561-4909-a271-225ef5d4e7d0 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] 10.222.0.61 "GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d" status: 200 len: 1593 microversion: 2.32 time: 0.272971 Aug 31 16:10:31.148622 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1599/3247] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:10:30 2022] GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d => generated 1593 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:10:31.168817 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-dece222d-89b1-4d43-99fb-f8a9163e0cf1 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:31.174358 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-dece222d-89b1-4d43-99fb-f8a9163e0cf1 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '41b93395d63a4db895ff224a311940e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf281e8857247c6b9e60d4216741f89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:31.174605 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-dece222d-89b1-4d43-99fb-f8a9163e0cf1 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '1cf281e8857247c6b9e60d4216741f89'} {{(pid=122257) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 16:10:31.190627 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dece222d-89b1-4d43-99fb-f8a9163e0cf1 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:31.191547 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dece222d-89b1-4d43-99fb-f8a9163e0cf1 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:31.191874 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dece222d-89b1-4d43-99fb-f8a9163e0cf1 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:31.192617 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dece222d-89b1-4d43-99fb-f8a9163e0cf1 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:31.193153 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dece222d-89b1-4d43-99fb-f8a9163e0cf1 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:31.193579 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dece222d-89b1-4d43-99fb-f8a9163e0cf1 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:31.330705 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.multi_cell_list [None req-dece222d-89b1-4d43-99fb-f8a9163e0cf1 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122257) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 31 16:10:31.411280 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-dece222d-89b1-4d43-99fb-f8a9163e0cf1 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] 10.222.0.61 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1010 microversion: 2.1 time: 0.261460 Aug 31 16:10:31.412914 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1600/3248] 10.222.0.61 () {58 vars in 1154 bytes} [Wed Aug 31 16:10:31 2022] GET /compute/v2.1/servers?name=-instance => generated 1010 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:31.428770 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1197b9b8-cd34-49a2-b853-8d0e618b337a tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:31.457412 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-1197b9b8-cd34-49a2-b853-8d0e618b337a tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '41b93395d63a4db895ff224a311940e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf281e8857247c6b9e60d4216741f89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:31.458691 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1197b9b8-cd34-49a2-b853-8d0e618b337a tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-43754427', 'deleted': False, 'project_id': '1cf281e8857247c6b9e60d4216741f89'} {{(pid=122257) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 16:10:31.466271 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1197b9b8-cd34-49a2-b853-8d0e618b337a tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:31.466728 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1197b9b8-cd34-49a2-b853-8d0e618b337a tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:31.467443 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1197b9b8-cd34-49a2-b853-8d0e618b337a tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:31.468294 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1197b9b8-cd34-49a2-b853-8d0e618b337a tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:31.468940 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1197b9b8-cd34-49a2-b853-8d0e618b337a tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:31.469205 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1197b9b8-cd34-49a2-b853-8d0e618b337a tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:31.629426 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.multi_cell_list [None req-1197b9b8-cd34-49a2-b853-8d0e618b337a tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122257) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 31 16:10:31.765031 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1197b9b8-cd34-49a2-b853-8d0e618b337a tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] 10.222.0.61 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-43754427" status: 200 len: 345 microversion: 2.1 time: 0.341806 Aug 31 16:10:31.778713 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1601/3249] 10.222.0.61 () {58 vars in 1226 bytes} [Wed Aug 31 16:10:31 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-43754427 => generated 345 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:10:31.778713 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9a772c8d-c9a1-4207-a813-eb3871512e28 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:31.778713 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9a772c8d-c9a1-4207-a813-eb3871512e28 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] [instance: 606f1624-8c53-409e-b06b-ace080f7fc44] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:31.782867 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9a772c8d-c9a1-4207-a813-eb3871512e28 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:31.783373 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9a772c8d-c9a1-4207-a813-eb3871512e28 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:31.783844 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9a772c8d-c9a1-4207-a813-eb3871512e28 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:31.799887 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9a772c8d-c9a1-4207-a813-eb3871512e28 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:31.801978 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9a772c8d-c9a1-4207-a813-eb3871512e28 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:31.802477 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9a772c8d-c9a1-4207-a813-eb3871512e28 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:32.070284 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-043cc1d5-93e8-44ee-9933-43ec99e69689 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68db583fb8fd4e6090fb220eeaafdd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c965154856f84fecb30f49dfeac46fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:32.085614 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-043cc1d5-93e8-44ee-9933-43ec99e69689 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] 10.222.0.61 "GET /compute/v2.1/servers/29a78fc3-93ff-4f42-8c9f-79dfdc5229c6" status: 200 len: 1522 microversion: 2.1 time: 1.403182 Aug 31 16:10:32.096526 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1649/3250] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:30 2022] GET /compute/v2.1/servers/29a78fc3-93ff-4f42-8c9f-79dfdc5229c6 => generated 1522 bytes in 1415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:10:32.107422 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7e56725c-9f72-41a5-888a-21ac16b4efa3 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:32.108215 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7e56725c-9f72-41a5-888a-21ac16b4efa3 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] [instance: d1e43fd8-2e15-468d-9da0-2851a41bd23b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:32.118178 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7e56725c-9f72-41a5-888a-21ac16b4efa3 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:32.119410 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7e56725c-9f72-41a5-888a-21ac16b4efa3 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:32.120401 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7e56725c-9f72-41a5-888a-21ac16b4efa3 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:32.121361 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7e56725c-9f72-41a5-888a-21ac16b4efa3 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:32.122325 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7e56725c-9f72-41a5-888a-21ac16b4efa3 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:32.122824 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7e56725c-9f72-41a5-888a-21ac16b4efa3 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:32.152245 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7e56725c-9f72-41a5-888a-21ac16b4efa3 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] [instance: d1e43fd8-2e15-468d-9da0-2851a41bd23b] Going to try to terminate instance {{(pid=122256) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:10:32.265798 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7e56725c-9f72-41a5-888a-21ac16b4efa3 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] 10.222.0.61 "DELETE /compute/v2.1/servers/d1e43fd8-2e15-468d-9da0-2851a41bd23b" status: 204 len: 0 microversion: 2.1 time: 0.167028 Aug 31 16:10:32.271030 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1650/3251] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:10:32 2022] DELETE /compute/v2.1/servers/d1e43fd8-2e15-468d-9da0-2851a41bd23b => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:10:32.276132 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-78771064-427c-4ea9-816d-c4983be0f258 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:32.277065 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-78771064-427c-4ea9-816d-c4983be0f258 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] [instance: fa0932e8-1aa4-4d1a-b653-14be35568f3d] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:32.284906 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-78771064-427c-4ea9-816d-c4983be0f258 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:32.285734 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-78771064-427c-4ea9-816d-c4983be0f258 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:32.286686 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-78771064-427c-4ea9-816d-c4983be0f258 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:32.287743 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-78771064-427c-4ea9-816d-c4983be0f258 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:32.290264 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-78771064-427c-4ea9-816d-c4983be0f258 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:32.291374 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-78771064-427c-4ea9-816d-c4983be0f258 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:32.475389 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9a772c8d-c9a1-4207-a813-eb3871512e28 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13cabcaa79043bea338128594a6b00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab7f0d889224cefbca55343f3208a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:32.483543 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9a772c8d-c9a1-4207-a813-eb3871512e28 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] 10.222.0.61 "GET /compute/v2.1/servers/606f1624-8c53-409e-b06b-ace080f7fc44" status: 200 len: 1323 microversion: 2.1 time: 0.716171 Aug 31 16:10:32.484450 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1602/3252] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:31 2022] GET /compute/v2.1/servers/606f1624-8c53-409e-b06b-ace080f7fc44 => generated 1323 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:32.489433 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-a49a49e3-a829-4274-99d2-ee17dbd6a01e req-552a4d36-dd1c-49b6-969d-a419384725a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33bb5423-4b3e-4030-a835-8ab823e2e00a", "name": "network-vif-deleted", "tag": "c095212f-1c48-4cbd-8b3f-2a8e3b2bd211"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:10:32.503750 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-a49a49e3-a829-4274-99d2-ee17dbd6a01e req-552a4d36-dd1c-49b6-969d-a419384725a2 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:32.504644 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-a49a49e3-a829-4274-99d2-ee17dbd6a01e req-552a4d36-dd1c-49b6-969d-a419384725a2 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:32.505270 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-a49a49e3-a829-4274-99d2-ee17dbd6a01e req-552a4d36-dd1c-49b6-969d-a419384725a2 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:32.521073 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-a49a49e3-a829-4274-99d2-ee17dbd6a01e req-552a4d36-dd1c-49b6-969d-a419384725a2 service nova] Creating event network-vif-deleted:c095212f-1c48-4cbd-8b3f-2a8e3b2bd211 for instance 33bb5423-4b3e-4030-a835-8ab823e2e00a on n-h1-850499-9 Aug 31 16:10:32.528341 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-a49a49e3-a829-4274-99d2-ee17dbd6a01e req-552a4d36-dd1c-49b6-969d-a419384725a2 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042779 Aug 31 16:10:32.529788 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1603/3253] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:10:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:10:32.535848 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-cc37bd3c-58bf-4d62-aadd-c5bcd31710d7 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:32.536649 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-cc37bd3c-58bf-4d62-aadd-c5bcd31710d7 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] [instance: d1e43fd8-2e15-468d-9da0-2851a41bd23b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:32.544342 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cc37bd3c-58bf-4d62-aadd-c5bcd31710d7 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:32.544931 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cc37bd3c-58bf-4d62-aadd-c5bcd31710d7 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:32.545562 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cc37bd3c-58bf-4d62-aadd-c5bcd31710d7 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:32.546343 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cc37bd3c-58bf-4d62-aadd-c5bcd31710d7 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:32.547277 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cc37bd3c-58bf-4d62-aadd-c5bcd31710d7 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:32.547277 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cc37bd3c-58bf-4d62-aadd-c5bcd31710d7 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:32.562006 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-78771064-427c-4ea9-816d-c4983be0f258 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:32.580560 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-78771064-427c-4ea9-816d-c4983be0f258 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:32.584306 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-78771064-427c-4ea9-816d-c4983be0f258 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:32.587671 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-78771064-427c-4ea9-816d-c4983be0f258 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] 10.222.0.61 "GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d" status: 200 len: 1593 microversion: 2.32 time: 0.319087 Aug 31 16:10:32.588672 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1651/3254] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:10:32 2022] GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d => generated 1593 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:10:33.075980 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-cc37bd3c-58bf-4d62-aadd-c5bcd31710d7 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b93395d63a4db895ff224a311940e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf281e8857247c6b9e60d4216741f89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:33.086928 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-cc37bd3c-58bf-4d62-aadd-c5bcd31710d7 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] 10.222.0.61 "GET /compute/v2.1/servers/d1e43fd8-2e15-468d-9da0-2851a41bd23b" status: 200 len: 1518 microversion: 2.1 time: 0.554587 Aug 31 16:10:33.102511 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1604/3255] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:32 2022] GET /compute/v2.1/servers/d1e43fd8-2e15-468d-9da0-2851a41bd23b => generated 1518 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:33.110150 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3ed5a2aa-3264-4849-8f74-ed064ce02bf7 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:33.110772 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3ed5a2aa-3264-4849-8f74-ed064ce02bf7 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] [instance: 29a78fc3-93ff-4f42-8c9f-79dfdc5229c6] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:33.118004 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3ed5a2aa-3264-4849-8f74-ed064ce02bf7 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:33.118529 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3ed5a2aa-3264-4849-8f74-ed064ce02bf7 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:33.119168 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3ed5a2aa-3264-4849-8f74-ed064ce02bf7 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:33.119924 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3ed5a2aa-3264-4849-8f74-ed064ce02bf7 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:33.120379 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3ed5a2aa-3264-4849-8f74-ed064ce02bf7 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:33.120809 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3ed5a2aa-3264-4849-8f74-ed064ce02bf7 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:33.505714 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-fd832c94-d5da-459e-b623-e0cb46eba751 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:33.506877 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-fd832c94-d5da-459e-b623-e0cb46eba751 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] [instance: 606f1624-8c53-409e-b06b-ace080f7fc44] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:33.516811 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fd832c94-d5da-459e-b623-e0cb46eba751 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:33.517694 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fd832c94-d5da-459e-b623-e0cb46eba751 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:33.518459 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fd832c94-d5da-459e-b623-e0cb46eba751 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:33.519815 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fd832c94-d5da-459e-b623-e0cb46eba751 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:33.521031 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fd832c94-d5da-459e-b623-e0cb46eba751 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:33.522441 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fd832c94-d5da-459e-b623-e0cb46eba751 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:33.543542 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3ed5a2aa-3264-4849-8f74-ed064ce02bf7 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68db583fb8fd4e6090fb220eeaafdd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c965154856f84fecb30f49dfeac46fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:33.552469 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3ed5a2aa-3264-4849-8f74-ed064ce02bf7 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] 10.222.0.61 "GET /compute/v2.1/servers/29a78fc3-93ff-4f42-8c9f-79dfdc5229c6" status: 200 len: 1522 microversion: 2.1 time: 0.445933 Aug 31 16:10:33.552867 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1652/3256] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:33 2022] GET /compute/v2.1/servers/29a78fc3-93ff-4f42-8c9f-79dfdc5229c6 => generated 1522 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:33.588426 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-0243f023-a364-457d-b8d5-a7df585fdcbc req-7642c461-1f4a-48e9-85bc-98081865c359 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29a78fc3-93ff-4f42-8c9f-79dfdc5229c6", "name": "network-vif-deleted", "tag": "cf59a33a-70b0-49f7-99b3-a7b4760a6cef"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:10:33.598470 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-0243f023-a364-457d-b8d5-a7df585fdcbc req-7642c461-1f4a-48e9-85bc-98081865c359 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:33.599221 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-0243f023-a364-457d-b8d5-a7df585fdcbc req-7642c461-1f4a-48e9-85bc-98081865c359 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:33.600059 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-0243f023-a364-457d-b8d5-a7df585fdcbc req-7642c461-1f4a-48e9-85bc-98081865c359 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:33.614005 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-0243f023-a364-457d-b8d5-a7df585fdcbc req-7642c461-1f4a-48e9-85bc-98081865c359 service nova] Creating event network-vif-deleted:cf59a33a-70b0-49f7-99b3-a7b4760a6cef for instance 29a78fc3-93ff-4f42-8c9f-79dfdc5229c6 on n-h2-850499-9 Aug 31 16:10:33.627962 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-0243f023-a364-457d-b8d5-a7df585fdcbc req-7642c461-1f4a-48e9-85bc-98081865c359 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043117 Aug 31 16:10:33.629390 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1653/3257] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:10:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:10:33.640031 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b3fdcfe2-bfa0-4e92-93c8-251c0e4de1ff tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:33.664439 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b3fdcfe2-bfa0-4e92-93c8-251c0e4de1ff tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] [instance: fa0932e8-1aa4-4d1a-b653-14be35568f3d] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:33.684087 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b3fdcfe2-bfa0-4e92-93c8-251c0e4de1ff tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:33.684597 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b3fdcfe2-bfa0-4e92-93c8-251c0e4de1ff tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:33.685050 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b3fdcfe2-bfa0-4e92-93c8-251c0e4de1ff tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:33.685782 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b3fdcfe2-bfa0-4e92-93c8-251c0e4de1ff tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:33.687541 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b3fdcfe2-bfa0-4e92-93c8-251c0e4de1ff tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:33.687541 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b3fdcfe2-bfa0-4e92-93c8-251c0e4de1ff tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:33.842337 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b3fdcfe2-bfa0-4e92-93c8-251c0e4de1ff tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:33.857819 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b3fdcfe2-bfa0-4e92-93c8-251c0e4de1ff tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:33.859697 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b3fdcfe2-bfa0-4e92-93c8-251c0e4de1ff tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:33.862182 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b3fdcfe2-bfa0-4e92-93c8-251c0e4de1ff tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] 10.222.0.61 "GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d" status: 200 len: 1593 microversion: 2.32 time: 0.230574 Aug 31 16:10:33.863243 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1654/3258] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:10:33 2022] GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d => generated 1593 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:10:34.109227 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-fd832c94-d5da-459e-b623-e0cb46eba751 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13cabcaa79043bea338128594a6b00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab7f0d889224cefbca55343f3208a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:34.112145 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7a71d2bf-1682-49a9-8c39-dff37db9bc2a tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:34.113311 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7a71d2bf-1682-49a9-8c39-dff37db9bc2a tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] [instance: d1e43fd8-2e15-468d-9da0-2851a41bd23b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:34.129628 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7a71d2bf-1682-49a9-8c39-dff37db9bc2a tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:34.131429 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-fd832c94-d5da-459e-b623-e0cb46eba751 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] 10.222.0.61 "GET /compute/v2.1/servers/606f1624-8c53-409e-b06b-ace080f7fc44" status: 200 len: 1323 microversion: 2.1 time: 0.630107 Aug 31 16:10:34.132512 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7a71d2bf-1682-49a9-8c39-dff37db9bc2a tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:34.133180 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1605/3259] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:33 2022] GET /compute/v2.1/servers/606f1624-8c53-409e-b06b-ace080f7fc44 => generated 1323 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:34.133748 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7a71d2bf-1682-49a9-8c39-dff37db9bc2a tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:34.134641 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7a71d2bf-1682-49a9-8c39-dff37db9bc2a tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:34.135261 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7a71d2bf-1682-49a9-8c39-dff37db9bc2a tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:34.136071 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7a71d2bf-1682-49a9-8c39-dff37db9bc2a tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:34.562481 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7a71d2bf-1682-49a9-8c39-dff37db9bc2a tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b93395d63a4db895ff224a311940e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf281e8857247c6b9e60d4216741f89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:34.574489 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:10:34.576597 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-77f82da0-6df6-4225-9d98-d38529903ff7 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:34.577888 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-77f82da0-6df6-4225-9d98-d38529903ff7 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] [instance: 29a78fc3-93ff-4f42-8c9f-79dfdc5229c6] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:34.582790 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7a71d2bf-1682-49a9-8c39-dff37db9bc2a tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] 10.222.0.61 "GET /compute/v2.1/servers/d1e43fd8-2e15-468d-9da0-2851a41bd23b" status: 200 len: 1518 microversion: 2.1 time: 0.477586 Aug 31 16:10:34.584155 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1655/3260] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:34 2022] GET /compute/v2.1/servers/d1e43fd8-2e15-468d-9da0-2851a41bd23b => generated 1518 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:34.593348 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-77f82da0-6df6-4225-9d98-d38529903ff7 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:34.593854 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-77f82da0-6df6-4225-9d98-d38529903ff7 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:34.594296 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-77f82da0-6df6-4225-9d98-d38529903ff7 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:34.595015 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-77f82da0-6df6-4225-9d98-d38529903ff7 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:34.597165 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-77f82da0-6df6-4225-9d98-d38529903ff7 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:34.601548 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-77f82da0-6df6-4225-9d98-d38529903ff7 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:34.754943 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-77f82da0-6df6-4225-9d98-d38529903ff7 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:34.756484 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-77f82da0-6df6-4225-9d98-d38529903ff7 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:34.758616 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-77f82da0-6df6-4225-9d98-d38529903ff7 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:34.761778 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-77f82da0-6df6-4225-9d98-d38529903ff7 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lazy-loading 'fault' on Instance uuid 29a78fc3-93ff-4f42-8c9f-79dfdc5229c6 {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:10:34.894782 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1b975a04-e000-4921-8e37-3afa2ee1ab31 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:34.895912 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1b975a04-e000-4921-8e37-3afa2ee1ab31 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] [instance: fa0932e8-1aa4-4d1a-b653-14be35568f3d] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:34.921375 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1b975a04-e000-4921-8e37-3afa2ee1ab31 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:34.922672 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1b975a04-e000-4921-8e37-3afa2ee1ab31 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:34.924959 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1b975a04-e000-4921-8e37-3afa2ee1ab31 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:34.926429 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1b975a04-e000-4921-8e37-3afa2ee1ab31 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:34.927791 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1b975a04-e000-4921-8e37-3afa2ee1ab31 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:34.930255 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1b975a04-e000-4921-8e37-3afa2ee1ab31 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:35.402213 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-77f82da0-6df6-4225-9d98-d38529903ff7 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68db583fb8fd4e6090fb220eeaafdd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c965154856f84fecb30f49dfeac46fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:35.446586 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-77f82da0-6df6-4225-9d98-d38529903ff7 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] 10.222.0.61 "GET /compute/v2.1/servers/29a78fc3-93ff-4f42-8c9f-79dfdc5229c6" status: 200 len: 1313 microversion: 2.1 time: 0.869061 Aug 31 16:10:35.456492 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1606/3261] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:34 2022] GET /compute/v2.1/servers/29a78fc3-93ff-4f42-8c9f-79dfdc5229c6 => generated 1313 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:10:35.465758 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-51bd6f5a-a310-4c04-ad89-f1b7e62e8858 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:35.467741 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-51bd6f5a-a310-4c04-ad89-f1b7e62e8858 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] [instance: 606f1624-8c53-409e-b06b-ace080f7fc44] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:35.486353 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-51bd6f5a-a310-4c04-ad89-f1b7e62e8858 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:35.490732 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-51bd6f5a-a310-4c04-ad89-f1b7e62e8858 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:35.492129 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-51bd6f5a-a310-4c04-ad89-f1b7e62e8858 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:35.493384 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-51bd6f5a-a310-4c04-ad89-f1b7e62e8858 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:35.494523 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-51bd6f5a-a310-4c04-ad89-f1b7e62e8858 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:35.495354 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-51bd6f5a-a310-4c04-ad89-f1b7e62e8858 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:35.545170 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=100 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:10:35.834200 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1b975a04-e000-4921-8e37-3afa2ee1ab31 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:35.855074 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1b975a04-e000-4921-8e37-3afa2ee1ab31 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:35.856784 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1b975a04-e000-4921-8e37-3afa2ee1ab31 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:35.858031 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1b975a04-e000-4921-8e37-3afa2ee1ab31 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] 10.222.0.61 "GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d" status: 200 len: 1661 microversion: 2.32 time: 0.967693 Aug 31 16:10:35.858602 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1656/3262] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:10:34 2022] GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d => generated 1661 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:10:35.865382 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-00f9d990-f717-4c4d-acf8-fa3c9340e761 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:35.872513 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-00f9d990-f717-4c4d-acf8-fa3c9340e761 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] [instance: d1e43fd8-2e15-468d-9da0-2851a41bd23b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:35.895906 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-00f9d990-f717-4c4d-acf8-fa3c9340e761 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:35.901760 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-00f9d990-f717-4c4d-acf8-fa3c9340e761 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:35.902366 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-00f9d990-f717-4c4d-acf8-fa3c9340e761 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:35.903256 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-00f9d990-f717-4c4d-acf8-fa3c9340e761 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:35.904051 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-00f9d990-f717-4c4d-acf8-fa3c9340e761 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:35.904719 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-00f9d990-f717-4c4d-acf8-fa3c9340e761 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:35.921665 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-51bd6f5a-a310-4c04-ad89-f1b7e62e8858 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13cabcaa79043bea338128594a6b00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab7f0d889224cefbca55343f3208a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:35.934227 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-51bd6f5a-a310-4c04-ad89-f1b7e62e8858 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] 10.222.0.61 "GET /compute/v2.1/servers/606f1624-8c53-409e-b06b-ace080f7fc44" status: 200 len: 1323 microversion: 2.1 time: 0.474288 Aug 31 16:10:35.956172 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1607/3263] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:35 2022] GET /compute/v2.1/servers/606f1624-8c53-409e-b06b-ace080f7fc44 => generated 1323 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:36.406196 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-00f9d990-f717-4c4d-acf8-fa3c9340e761 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b93395d63a4db895ff224a311940e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf281e8857247c6b9e60d4216741f89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:36.426819 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-00f9d990-f717-4c4d-acf8-fa3c9340e761 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] 10.222.0.61 "GET /compute/v2.1/servers/d1e43fd8-2e15-468d-9da0-2851a41bd23b" status: 200 len: 1518 microversion: 2.1 time: 0.564625 Aug 31 16:10:36.430076 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1657/3264] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:35 2022] GET /compute/v2.1/servers/d1e43fd8-2e15-468d-9da0-2851a41bd23b => generated 1518 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:36.490276 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-00e170cd-84a1-4301-a129-cd19c135c2cb tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:36.492158 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-00e170cd-84a1-4301-a129-cd19c135c2cb tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] [instance: 29a78fc3-93ff-4f42-8c9f-79dfdc5229c6] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:36.500229 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-00e170cd-84a1-4301-a129-cd19c135c2cb tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:36.501072 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-00e170cd-84a1-4301-a129-cd19c135c2cb tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:36.501750 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-00e170cd-84a1-4301-a129-cd19c135c2cb tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:36.502882 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-00e170cd-84a1-4301-a129-cd19c135c2cb tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:36.504256 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-00e170cd-84a1-4301-a129-cd19c135c2cb tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:36.505085 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-00e170cd-84a1-4301-a129-cd19c135c2cb tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:36.528971 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-00e170cd-84a1-4301-a129-cd19c135c2cb tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] HTTP exception thrown: Instance 29a78fc3-93ff-4f42-8c9f-79dfdc5229c6 could not be found. Aug 31 16:10:36.531137 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-00e170cd-84a1-4301-a129-cd19c135c2cb tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Request method failure captured: Aug 31 16:10:36.531137 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/29a78fc3-93ff-4f42-8c9f-79dfdc5229c6 HTTP/1.1 Aug 31 16:10:36.531137 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:10:36.531137 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:10:36.531137 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:10:36.531137 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:10:36.531137 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:10:36.531137 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:10:36.531137 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:10:36.531137 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:10:36.531137 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4e3VulAbsVbf-R_KJJopCzL4TMuVlDpJWFc1QxE_VfyNmRdCYzoeGI3DOp904JH19R2ftEX6dDaPCOB9WVPxd6DoNCdJI6XasCui_OVYbMISua7YP2-9CFPcxpMidTtXQe3Mq7ucg5-1-_FtBTisohEps1qxvpOawH_RIjV85BgAaM Aug 31 16:10:36.531137 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:10:36.531137 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:10:36.531137 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:10:36.531137 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:10:36.531137 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:10:36.531137 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:10:36.531137 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: c965154856f84fecb30f49dfeac46fa0 Aug 31 16:10:36.531137 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ListServersNegativeTestJSON-1676734841 Aug 31 16:10:36.531137 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:10:36.531137 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:10:36.531137 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c965154856f84fecb30f49dfeac46fa0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/c965154856f84fecb30f49dfeac46fa0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_c965154856f84fecb30f49dfeac46fa0", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c965154856f84fecb30f49dfeac46fa0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:10:36.531137 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ListServersNegativeTestJSON-1676734841 Aug 31 16:10:36.531137 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: c965154856f84fecb30f49dfeac46fa0 Aug 31 16:10:36.531137 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1676734841 Aug 31 16:10:36.531137 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ListServersNegativeTestJSON-1676734841-project Aug 31 16:10:36.531137 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:10:36.531137 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:10:36.531137 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 68db583fb8fd4e6090fb220eeaafdd36 Aug 31 16:10:36.531137 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ListServersNegativeTestJSON-1676734841-project Aug 31 16:10:36.531137 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:10:36.531137 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance 29a78fc3-93ff-4f42-8c9f-79dfdc5229c6 could not be found. Aug 31 16:10:36.531137 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '29a78fc3-93ff-4f42-8c9f-79dfdc5229c6'} Aug 31 16:10:36.531137 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:10:36.531137 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:36.531137 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:10:36.531137 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:10:36.531137 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:10:36.531137 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:10:36.531137 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:10:36.531137 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:10:36.531137 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:10:36.531137 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:10:36.531137 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29a78fc3-93ff-4f42-8c9f-79dfdc5229c6 could not be found. Aug 31 16:10:36.531137 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:10:36.531137 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:10:36.531137 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:10:36.531137 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:36.531137 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:10:36.531137 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:10:36.531137 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:10:36.531137 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:10:36.531137 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:10:36.531137 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:10:36.531137 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:10:36.531137 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:10:36.531137 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:10:36.531137 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:10:36.531137 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:10:36.531137 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:10:36.531137 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29a78fc3-93ff-4f42-8c9f-79dfdc5229c6 could not be found. Aug 31 16:10:36.531137 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:10:36.531137 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:10:36.537582 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:10:36.537582 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:36.537582 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:10:36.537582 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:10:36.537582 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:10:36.537582 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:10:36.537582 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29a78fc3-93ff-4f42-8c9f-79dfdc5229c6 could not be found. Aug 31 16:10:36.537582 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:10:36.540143 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-00e170cd-84a1-4301-a129-cd19c135c2cb tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Returning 404 to user: Instance 29a78fc3-93ff-4f42-8c9f-79dfdc5229c6 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:10:36.542084 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-00e170cd-84a1-4301-a129-cd19c135c2cb tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] 10.222.0.61 "GET /compute/v2.1/servers/29a78fc3-93ff-4f42-8c9f-79dfdc5229c6" status: 404 len: 111 microversion: 2.1 time: 0.058072 Aug 31 16:10:36.546986 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1608/3265] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:36 2022] GET /compute/v2.1/servers/29a78fc3-93ff-4f42-8c9f-79dfdc5229c6 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:10:36.551835 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-bbeaef6c-8f8a-4c47-bcc8-8b751047dafc tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:36.552643 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-bbeaef6c-8f8a-4c47-bcc8-8b751047dafc tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] [instance: 33bb5423-4b3e-4030-a835-8ab823e2e00a] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:36.567836 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bbeaef6c-8f8a-4c47-bcc8-8b751047dafc tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:36.568396 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bbeaef6c-8f8a-4c47-bcc8-8b751047dafc tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:36.568843 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bbeaef6c-8f8a-4c47-bcc8-8b751047dafc tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:36.570252 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bbeaef6c-8f8a-4c47-bcc8-8b751047dafc tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:36.570923 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bbeaef6c-8f8a-4c47-bcc8-8b751047dafc tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:36.571741 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bbeaef6c-8f8a-4c47-bcc8-8b751047dafc tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:36.661361 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bbeaef6c-8f8a-4c47-bcc8-8b751047dafc tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:36.663043 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bbeaef6c-8f8a-4c47-bcc8-8b751047dafc tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:36.667750 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bbeaef6c-8f8a-4c47-bcc8-8b751047dafc tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:36.671687 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-bbeaef6c-8f8a-4c47-bcc8-8b751047dafc tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lazy-loading 'fault' on Instance uuid 33bb5423-4b3e-4030-a835-8ab823e2e00a {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:10:36.745400 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-bbeaef6c-8f8a-4c47-bcc8-8b751047dafc tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68db583fb8fd4e6090fb220eeaafdd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c965154856f84fecb30f49dfeac46fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:36.752727 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-bbeaef6c-8f8a-4c47-bcc8-8b751047dafc tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] 10.222.0.61 "GET /compute/v2.1/servers/33bb5423-4b3e-4030-a835-8ab823e2e00a" status: 200 len: 1313 microversion: 2.1 time: 0.204777 Aug 31 16:10:36.759260 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1658/3266] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:36 2022] GET /compute/v2.1/servers/33bb5423-4b3e-4030-a835-8ab823e2e00a => generated 1313 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:36.888994 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-896c0302-3b2d-4a4e-8f42-b01f4ce88503 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:36.891296 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-896c0302-3b2d-4a4e-8f42-b01f4ce88503 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] [instance: fa0932e8-1aa4-4d1a-b653-14be35568f3d] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:36.899764 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-896c0302-3b2d-4a4e-8f42-b01f4ce88503 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:36.901025 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-896c0302-3b2d-4a4e-8f42-b01f4ce88503 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:36.901776 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-896c0302-3b2d-4a4e-8f42-b01f4ce88503 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:36.902648 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-896c0302-3b2d-4a4e-8f42-b01f4ce88503 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:36.903263 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-896c0302-3b2d-4a4e-8f42-b01f4ce88503 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:36.903869 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-896c0302-3b2d-4a4e-8f42-b01f4ce88503 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:36.972515 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b1a1cdca-4a0a-422a-89fa-8eaa8a3aa528 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:36.973756 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b1a1cdca-4a0a-422a-89fa-8eaa8a3aa528 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] [instance: 606f1624-8c53-409e-b06b-ace080f7fc44] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:37.000345 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b1a1cdca-4a0a-422a-89fa-8eaa8a3aa528 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:37.004701 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b1a1cdca-4a0a-422a-89fa-8eaa8a3aa528 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:37.004701 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b1a1cdca-4a0a-422a-89fa-8eaa8a3aa528 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:37.005524 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b1a1cdca-4a0a-422a-89fa-8eaa8a3aa528 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:37.006097 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b1a1cdca-4a0a-422a-89fa-8eaa8a3aa528 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:37.006325 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b1a1cdca-4a0a-422a-89fa-8eaa8a3aa528 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:37.098800 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=16 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:10:37.333440 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-896c0302-3b2d-4a4e-8f42-b01f4ce88503 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:37.354117 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-896c0302-3b2d-4a4e-8f42-b01f4ce88503 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:37.388215 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-896c0302-3b2d-4a4e-8f42-b01f4ce88503 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:37.390449 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-896c0302-3b2d-4a4e-8f42-b01f4ce88503 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] 10.222.0.61 "GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d" status: 200 len: 1708 microversion: 2.32 time: 0.508497 Aug 31 16:10:37.394418 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1609/3267] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:10:36 2022] GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d => generated 1708 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:10:37.422065 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-9bb007dd-9302-4873-8553-5580c5a94956 req-a18145fa-2b2d-4ecf-8435-757f2f57360b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "606f1624-8c53-409e-b06b-ace080f7fc44", "name": "network-vif-plugged", "status": "completed", "tag": "bd761e9e-656b-4464-b63f-bb9440ae7e14"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:10:37.442329 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-9bb007dd-9302-4873-8553-5580c5a94956 req-a18145fa-2b2d-4ecf-8435-757f2f57360b service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:37.444092 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-9bb007dd-9302-4873-8553-5580c5a94956 req-a18145fa-2b2d-4ecf-8435-757f2f57360b service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:37.446157 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-9bb007dd-9302-4873-8553-5580c5a94956 req-a18145fa-2b2d-4ecf-8435-757f2f57360b service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:37.474868 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-9bb007dd-9302-4873-8553-5580c5a94956 req-a18145fa-2b2d-4ecf-8435-757f2f57360b service nova] Creating event network-vif-plugged:bd761e9e-656b-4464-b63f-bb9440ae7e14 for instance 606f1624-8c53-409e-b06b-ace080f7fc44 on n-h1-850499-9 Aug 31 16:10:37.485293 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-9bb007dd-9302-4873-8553-5580c5a94956 req-a18145fa-2b2d-4ecf-8435-757f2f57360b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089087 Aug 31 16:10:37.486419 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1610/3268] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:10:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:10:37.498956 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-31758840-5612-4e75-934b-495a2b76fe85 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:37.499916 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-31758840-5612-4e75-934b-495a2b76fe85 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] [instance: d1e43fd8-2e15-468d-9da0-2851a41bd23b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:37.515972 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b1a1cdca-4a0a-422a-89fa-8eaa8a3aa528 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13cabcaa79043bea338128594a6b00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab7f0d889224cefbca55343f3208a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:37.521489 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-31758840-5612-4e75-934b-495a2b76fe85 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:37.522441 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-31758840-5612-4e75-934b-495a2b76fe85 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:37.523424 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-31758840-5612-4e75-934b-495a2b76fe85 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:37.524530 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-31758840-5612-4e75-934b-495a2b76fe85 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:37.525162 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-31758840-5612-4e75-934b-495a2b76fe85 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:37.525962 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-31758840-5612-4e75-934b-495a2b76fe85 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:37.544760 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b1a1cdca-4a0a-422a-89fa-8eaa8a3aa528 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] 10.222.0.61 "GET /compute/v2.1/servers/606f1624-8c53-409e-b06b-ace080f7fc44" status: 200 len: 1323 microversion: 2.1 time: 0.577401 Aug 31 16:10:37.545357 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1659/3269] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:36 2022] GET /compute/v2.1/servers/606f1624-8c53-409e-b06b-ace080f7fc44 => generated 1323 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:10:37.586657 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-e5687759-bf23-4d4d-83a4-010626ad37c7 req-e8d36be2-a336-44b1-97fd-a7788f903cd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1e43fd8-2e15-468d-9da0-2851a41bd23b", "name": "network-vif-deleted", "tag": "d51ed438-7b34-4bdd-985c-393bd746e794"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:10:37.612382 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-e5687759-bf23-4d4d-83a4-010626ad37c7 req-e8d36be2-a336-44b1-97fd-a7788f903cd6 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:37.614574 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-e5687759-bf23-4d4d-83a4-010626ad37c7 req-e8d36be2-a336-44b1-97fd-a7788f903cd6 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:37.622832 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-e5687759-bf23-4d4d-83a4-010626ad37c7 req-e8d36be2-a336-44b1-97fd-a7788f903cd6 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:37.646688 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-e5687759-bf23-4d4d-83a4-010626ad37c7 req-e8d36be2-a336-44b1-97fd-a7788f903cd6 service nova] Creating event network-vif-deleted:d51ed438-7b34-4bdd-985c-393bd746e794 for instance d1e43fd8-2e15-468d-9da0-2851a41bd23b on n-h1-850499-9 Aug 31 16:10:37.656920 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-e5687759-bf23-4d4d-83a4-010626ad37c7 req-e8d36be2-a336-44b1-97fd-a7788f903cd6 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100983 Aug 31 16:10:37.657477 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1660/3270] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:10:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:10:37.738769 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-31758840-5612-4e75-934b-495a2b76fe85 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b93395d63a4db895ff224a311940e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf281e8857247c6b9e60d4216741f89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:37.753997 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-31758840-5612-4e75-934b-495a2b76fe85 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] 10.222.0.61 "GET /compute/v2.1/servers/d1e43fd8-2e15-468d-9da0-2851a41bd23b" status: 200 len: 1305 microversion: 2.1 time: 0.262676 Aug 31 16:10:37.756347 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1611/3271] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:37 2022] GET /compute/v2.1/servers/d1e43fd8-2e15-468d-9da0-2851a41bd23b => generated 1305 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:37.780000 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9a63cdd5-1636-447a-a412-ba281ab172a2 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:37.781002 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9a63cdd5-1636-447a-a412-ba281ab172a2 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] [instance: 33bb5423-4b3e-4030-a835-8ab823e2e00a] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:37.813430 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9a63cdd5-1636-447a-a412-ba281ab172a2 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:37.823159 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9a63cdd5-1636-447a-a412-ba281ab172a2 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:37.825036 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9a63cdd5-1636-447a-a412-ba281ab172a2 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:37.825816 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9a63cdd5-1636-447a-a412-ba281ab172a2 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:37.826297 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9a63cdd5-1636-447a-a412-ba281ab172a2 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:37.826985 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9a63cdd5-1636-447a-a412-ba281ab172a2 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:37.862988 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-9a63cdd5-1636-447a-a412-ba281ab172a2 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] HTTP exception thrown: Instance 33bb5423-4b3e-4030-a835-8ab823e2e00a could not be found. Aug 31 16:10:37.864707 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9a63cdd5-1636-447a-a412-ba281ab172a2 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Request method failure captured: Aug 31 16:10:37.864707 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/33bb5423-4b3e-4030-a835-8ab823e2e00a HTTP/1.1 Aug 31 16:10:37.864707 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:10:37.864707 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:10:37.864707 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:10:37.864707 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:10:37.864707 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:10:37.864707 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:10:37.864707 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:10:37.864707 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:10:37.864707 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4e3VulAbsVbf-R_KJJopCzL4TMuVlDpJWFc1QxE_VfyNmRdCYzoeGI3DOp904JH19R2ftEX6dDaPCOB9WVPxd6DoNCdJI6XasCui_OVYbMISua7YP2-9CFPcxpMidTtXQe3Mq7ucg5-1-_FtBTisohEps1qxvpOawH_RIjV85BgAaM Aug 31 16:10:37.864707 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:10:37.864707 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:10:37.864707 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:10:37.864707 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:10:37.864707 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:10:37.864707 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:10:37.864707 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: c965154856f84fecb30f49dfeac46fa0 Aug 31 16:10:37.864707 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ListServersNegativeTestJSON-1676734841 Aug 31 16:10:37.864707 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:10:37.864707 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:10:37.864707 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c965154856f84fecb30f49dfeac46fa0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/c965154856f84fecb30f49dfeac46fa0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_c965154856f84fecb30f49dfeac46fa0", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c965154856f84fecb30f49dfeac46fa0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:10:37.864707 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ListServersNegativeTestJSON-1676734841 Aug 31 16:10:37.864707 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: c965154856f84fecb30f49dfeac46fa0 Aug 31 16:10:37.864707 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1676734841 Aug 31 16:10:37.864707 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ListServersNegativeTestJSON-1676734841-project Aug 31 16:10:37.864707 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:10:37.864707 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:10:37.864707 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 68db583fb8fd4e6090fb220eeaafdd36 Aug 31 16:10:37.864707 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ListServersNegativeTestJSON-1676734841-project Aug 31 16:10:37.864707 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:10:37.864707 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance 33bb5423-4b3e-4030-a835-8ab823e2e00a could not be found. Aug 31 16:10:37.864707 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '33bb5423-4b3e-4030-a835-8ab823e2e00a'} Aug 31 16:10:37.864707 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:10:37.864707 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:37.864707 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:10:37.864707 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:10:37.864707 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:10:37.864707 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:10:37.864707 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:10:37.864707 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:10:37.864707 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:10:37.864707 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:10:37.864707 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33bb5423-4b3e-4030-a835-8ab823e2e00a could not be found. Aug 31 16:10:37.864707 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:10:37.864707 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:10:37.864707 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:10:37.864707 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:37.864707 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:10:37.864707 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:10:37.864707 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:10:37.864707 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:10:37.864707 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:10:37.864707 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:10:37.864707 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:10:37.864707 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:10:37.864707 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:10:37.864707 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:10:37.864707 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:10:37.864707 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:10:37.864707 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33bb5423-4b3e-4030-a835-8ab823e2e00a could not be found. Aug 31 16:10:37.864707 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:10:37.864707 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:10:37.870211 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:10:37.870211 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:37.870211 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:10:37.870211 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:10:37.870211 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:10:37.870211 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:10:37.870211 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33bb5423-4b3e-4030-a835-8ab823e2e00a could not be found. Aug 31 16:10:37.870211 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:10:37.871616 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9a63cdd5-1636-447a-a412-ba281ab172a2 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] Returning 404 to user: Instance 33bb5423-4b3e-4030-a835-8ab823e2e00a could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:10:37.872677 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9a63cdd5-1636-447a-a412-ba281ab172a2 tempest-ListServersNegativeTestJSON-1676734841 tempest-ListServersNegativeTestJSON-1676734841-project] 10.222.0.61 "GET /compute/v2.1/servers/33bb5423-4b3e-4030-a835-8ab823e2e00a" status: 404 len: 111 microversion: 2.1 time: 0.101790 Aug 31 16:10:37.873736 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1661/3272] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:37 2022] GET /compute/v2.1/servers/33bb5423-4b3e-4030-a835-8ab823e2e00a => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 16:10:38.432812 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-72dbff3a-8fea-4084-9c43-9f0aa07f45a3 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:38.435112 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-72dbff3a-8fea-4084-9c43-9f0aa07f45a3 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] [instance: fa0932e8-1aa4-4d1a-b653-14be35568f3d] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:38.446754 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-72dbff3a-8fea-4084-9c43-9f0aa07f45a3 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:38.449628 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-72dbff3a-8fea-4084-9c43-9f0aa07f45a3 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:38.450275 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-72dbff3a-8fea-4084-9c43-9f0aa07f45a3 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:38.451432 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-72dbff3a-8fea-4084-9c43-9f0aa07f45a3 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:38.452529 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-72dbff3a-8fea-4084-9c43-9f0aa07f45a3 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:38.453266 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-72dbff3a-8fea-4084-9c43-9f0aa07f45a3 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:38.566015 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-cea07bc1-feb0-4af8-9bd4-51a801aa4ca7 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:38.568215 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-cea07bc1-feb0-4af8-9bd4-51a801aa4ca7 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] [instance: 606f1624-8c53-409e-b06b-ace080f7fc44] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:38.583164 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cea07bc1-feb0-4af8-9bd4-51a801aa4ca7 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:38.584016 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cea07bc1-feb0-4af8-9bd4-51a801aa4ca7 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:38.584673 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cea07bc1-feb0-4af8-9bd4-51a801aa4ca7 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:38.586792 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cea07bc1-feb0-4af8-9bd4-51a801aa4ca7 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:38.589967 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cea07bc1-feb0-4af8-9bd4-51a801aa4ca7 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:38.592705 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cea07bc1-feb0-4af8-9bd4-51a801aa4ca7 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:39.024127 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-72dbff3a-8fea-4084-9c43-9f0aa07f45a3 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:39.040151 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-72dbff3a-8fea-4084-9c43-9f0aa07f45a3 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:39.045098 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-72dbff3a-8fea-4084-9c43-9f0aa07f45a3 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:39.050194 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-72dbff3a-8fea-4084-9c43-9f0aa07f45a3 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] 10.222.0.61 "GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d" status: 200 len: 1708 microversion: 2.32 time: 0.625406 Aug 31 16:10:39.051253 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1612/3273] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:10:38 2022] GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d => generated 1708 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:10:39.058084 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b134f717-13d3-4b37-ac17-8b023f7c8be6 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:39.066948 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-cea07bc1-feb0-4af8-9bd4-51a801aa4ca7 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13cabcaa79043bea338128594a6b00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab7f0d889224cefbca55343f3208a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:39.076798 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b134f717-13d3-4b37-ac17-8b023f7c8be6 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] [instance: d1e43fd8-2e15-468d-9da0-2851a41bd23b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:39.081394 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-cea07bc1-feb0-4af8-9bd4-51a801aa4ca7 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] 10.222.0.61 "GET /compute/v2.1/servers/606f1624-8c53-409e-b06b-ace080f7fc44" status: 200 len: 1323 microversion: 2.1 time: 0.519272 Aug 31 16:10:39.088892 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b134f717-13d3-4b37-ac17-8b023f7c8be6 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:39.089430 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b134f717-13d3-4b37-ac17-8b023f7c8be6 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:39.090035 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b134f717-13d3-4b37-ac17-8b023f7c8be6 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:39.090631 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b134f717-13d3-4b37-ac17-8b023f7c8be6 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:39.091169 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b134f717-13d3-4b37-ac17-8b023f7c8be6 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:39.091545 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b134f717-13d3-4b37-ac17-8b023f7c8be6 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:39.105777 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1662/3274] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:38 2022] GET /compute/v2.1/servers/606f1624-8c53-409e-b06b-ace080f7fc44 => generated 1323 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:10:39.204321 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b134f717-13d3-4b37-ac17-8b023f7c8be6 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:39.205201 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b134f717-13d3-4b37-ac17-8b023f7c8be6 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:39.210125 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b134f717-13d3-4b37-ac17-8b023f7c8be6 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:39.211897 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-b134f717-13d3-4b37-ac17-8b023f7c8be6 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lazy-loading 'fault' on Instance uuid d1e43fd8-2e15-468d-9da0-2851a41bd23b {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:10:39.319771 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b134f717-13d3-4b37-ac17-8b023f7c8be6 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b93395d63a4db895ff224a311940e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf281e8857247c6b9e60d4216741f89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:39.338535 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b134f717-13d3-4b37-ac17-8b023f7c8be6 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] 10.222.0.61 "GET /compute/v2.1/servers/d1e43fd8-2e15-468d-9da0-2851a41bd23b" status: 200 len: 1310 microversion: 2.1 time: 0.284544 Aug 31 16:10:39.344079 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1613/3275] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:39 2022] GET /compute/v2.1/servers/d1e43fd8-2e15-468d-9da0-2851a41bd23b => generated 1310 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:40.039319 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=18 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:10:40.081012 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-88e0841b-4d9a-47bf-a225-e87370a62a1a tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:40.081669 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-88e0841b-4d9a-47bf-a225-e87370a62a1a tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] [instance: fa0932e8-1aa4-4d1a-b653-14be35568f3d] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:40.088954 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=8 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:10:40.091015 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-88e0841b-4d9a-47bf-a225-e87370a62a1a tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:40.091774 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-88e0841b-4d9a-47bf-a225-e87370a62a1a tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:40.092799 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-88e0841b-4d9a-47bf-a225-e87370a62a1a tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:40.093718 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-88e0841b-4d9a-47bf-a225-e87370a62a1a tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:40.094332 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-88e0841b-4d9a-47bf-a225-e87370a62a1a tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:40.094914 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-88e0841b-4d9a-47bf-a225-e87370a62a1a tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:40.177699 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0da3f003-81b2-409f-8955-a764e0c05e4b tempest-MultipleCreateNegativeTestJSON-2025832496 tempest-MultipleCreateNegativeTestJSON-2025832496-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-231847640", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:10:40.184489 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-0da3f003-81b2-409f-8955-a764e0c05e4b tempest-MultipleCreateNegativeTestJSON-2025832496 tempest-MultipleCreateNegativeTestJSON-2025832496-project] HTTP exception thrown: min_count must be <= max_count Aug 31 16:10:40.186308 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0da3f003-81b2-409f-8955-a764e0c05e4b tempest-MultipleCreateNegativeTestJSON-2025832496 tempest-MultipleCreateNegativeTestJSON-2025832496-project] Request method failure captured: Aug 31 16:10:40.186308 n-d-850499-9 devstack@n-api.service[122256]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 31 16:10:40.186308 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:10:40.186308 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:10:40.186308 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:10:40.186308 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 183 Aug 31 16:10:40.186308 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:10:40.186308 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:10:40.186308 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:10:40.186308 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:10:40.186308 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4f_Y6obSnPuFxiu_9E8Cg5RZdAOicwWcMeH3wro_2jTZZVjInoUN0m5648_FTrpf7XzDbpSE0liJDAIBpXaLtgWBxwRue7tk0MUIPEqoG20V3xlTQvfO_ZAvNROQTgwGHM6KNXmofMISPtBMeGOD77jjb8wd4ZRyxdKgVdsFqBhm98 Aug 31 16:10:40.186308 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:10:40.186308 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:10:40.186308 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:10:40.186308 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:10:40.186308 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:10:40.186308 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:10:40.186308 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: bc2cc1aeff814f66890715edc7da3ece Aug 31 16:10:40.186308 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-2025832496 Aug 31 16:10:40.186308 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:10:40.186308 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:10:40.186308 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/bc2cc1aeff814f66890715edc7da3ece"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/bc2cc1aeff814f66890715edc7da3ece"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_bc2cc1aeff814f66890715edc7da3ece", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/bc2cc1aeff814f66890715edc7da3ece"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:10:40.186308 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-2025832496 Aug 31 16:10:40.186308 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: bc2cc1aeff814f66890715edc7da3ece Aug 31 16:10:40.186308 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-2025832496 Aug 31 16:10:40.186308 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-MultipleCreateNegativeTestJSON-2025832496-project Aug 31 16:10:40.186308 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:10:40.186308 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:10:40.186308 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 2b3a6ad0a6074fbb86b82050e81da597 Aug 31 16:10:40.186308 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-2025832496-project Aug 31 16:10:40.186308 n-d-850499-9 devstack@n-api.service[122256]: Aug 31 16:10:40.186308 n-d-850499-9 devstack@n-api.service[122256]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-231847640", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "min_count": 3, "max_count": 2}} Aug 31 16:10:40.186308 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:10:40.186308 n-d-850499-9 devstack@n-api.service[122256]: exception: min_count must be <= max_count Aug 31 16:10:40.186308 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-231847640', 'imageRef': 'b9c36d42-ed46-4bf5-ad18-1df45cbd0413', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Aug 31 16:10:40.186308 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:10:40.186308 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:40.186308 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:10:40.186308 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:10:40.186308 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:10:40.186308 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:10:40.186308 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:10:40.186308 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:10:40.186308 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:10:40.186308 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:10:40.186308 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:10:40.186308 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:10:40.186308 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:10:40.186308 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:10:40.186308 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 31 16:10:40.186308 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Aug 31 16:10:40.186308 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 31 16:10:40.186308 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Aug 31 16:10:40.186308 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:10:40.186308 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:10:40.186308 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:10:40.186308 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:40.186308 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:10:40.186308 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:10:40.186308 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:10:40.186308 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:10:40.186308 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Aug 31 16:10:40.186308 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:10:40.193460 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0da3f003-81b2-409f-8955-a764e0c05e4b tempest-MultipleCreateNegativeTestJSON-2025832496 tempest-MultipleCreateNegativeTestJSON-2025832496-project] Returning 400 to user: min_count must be <= max_count {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:10:40.195155 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0da3f003-81b2-409f-8955-a764e0c05e4b tempest-MultipleCreateNegativeTestJSON-2025832496 tempest-MultipleCreateNegativeTestJSON-2025832496-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.213746 Aug 31 16:10:40.209168 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1663/3276] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:10:39 2022] POST /compute/v2.1/servers => generated 74 bytes in 228 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 31 16:10:40.217624 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a0ea667d-1ef5-4ce7-b1aa-8d8ecd9ec55b tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:40.219360 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a0ea667d-1ef5-4ce7-b1aa-8d8ecd9ec55b tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] [instance: 606f1624-8c53-409e-b06b-ace080f7fc44] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:40.233666 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a0ea667d-1ef5-4ce7-b1aa-8d8ecd9ec55b tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:40.234389 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a0ea667d-1ef5-4ce7-b1aa-8d8ecd9ec55b tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:40.235031 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a0ea667d-1ef5-4ce7-b1aa-8d8ecd9ec55b tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:40.235941 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a0ea667d-1ef5-4ce7-b1aa-8d8ecd9ec55b tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:40.236562 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a0ea667d-1ef5-4ce7-b1aa-8d8ecd9ec55b tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:40.237330 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a0ea667d-1ef5-4ce7-b1aa-8d8ecd9ec55b tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:40.359866 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-88e0841b-4d9a-47bf-a225-e87370a62a1a tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:40.375678 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-88e0841b-4d9a-47bf-a225-e87370a62a1a tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:40.377641 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-88e0841b-4d9a-47bf-a225-e87370a62a1a tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:40.379452 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-88e0841b-4d9a-47bf-a225-e87370a62a1a tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] 10.222.0.61 "GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d" status: 200 len: 1755 microversion: 2.32 time: 0.302809 Aug 31 16:10:40.396051 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1614/3277] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:10:40 2022] GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d => generated 1755 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:10:40.402091 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-87b36a2f-74a3-4ea5-a435-012a76913b80 tempest-MultipleCreateNegativeTestJSON-2025832496 tempest-MultipleCreateNegativeTestJSON-2025832496-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-552253174", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "max_count": 0}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:10:40.406920 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-87b36a2f-74a3-4ea5-a435-012a76913b80 tempest-MultipleCreateNegativeTestJSON-2025832496 tempest-MultipleCreateNegativeTestJSON-2025832496-project] Request method failure captured: Aug 31 16:10:40.406920 n-d-850499-9 devstack@n-api.service[122257]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 31 16:10:40.406920 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:10:40.406920 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:10:40.406920 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:10:40.406920 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 167 Aug 31 16:10:40.406920 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:10:40.406920 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:10:40.406920 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:10:40.406920 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:10:40.406920 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4f_Y6obSnPuFxiu_9E8Cg5RZdAOicwWcMeH3wro_2jTZZVjInoUN0m5648_FTrpf7XzDbpSE0liJDAIBpXaLtgWBxwRue7tk0MUIPEqoG20V3xlTQvfO_ZAvNROQTgwGHM6KNXmofMISPtBMeGOD77jjb8wd4ZRyxdKgVdsFqBhm98 Aug 31 16:10:40.406920 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:10:40.406920 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:10:40.406920 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:10:40.406920 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:10:40.406920 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:10:40.406920 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:10:40.406920 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: bc2cc1aeff814f66890715edc7da3ece Aug 31 16:10:40.406920 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-2025832496 Aug 31 16:10:40.406920 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:10:40.406920 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:10:40.406920 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/bc2cc1aeff814f66890715edc7da3ece"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/bc2cc1aeff814f66890715edc7da3ece"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_bc2cc1aeff814f66890715edc7da3ece", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/bc2cc1aeff814f66890715edc7da3ece"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:10:40.406920 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-2025832496 Aug 31 16:10:40.406920 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: bc2cc1aeff814f66890715edc7da3ece Aug 31 16:10:40.406920 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-2025832496 Aug 31 16:10:40.406920 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-MultipleCreateNegativeTestJSON-2025832496-project Aug 31 16:10:40.406920 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:10:40.406920 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:10:40.406920 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 2b3a6ad0a6074fbb86b82050e81da597 Aug 31 16:10:40.406920 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-2025832496-project Aug 31 16:10:40.406920 n-d-850499-9 devstack@n-api.service[122257]: Aug 31 16:10:40.406920 n-d-850499-9 devstack@n-api.service[122257]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-552253174", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "max_count": 0}} Aug 31 16:10:40.406920 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:10:40.406920 n-d-850499-9 devstack@n-api.service[122257]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 31 16:10:40.406920 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-552253174', 'imageRef': 'b9c36d42-ed46-4bf5-ad18-1df45cbd0413', 'flavorRef': '452', 'max_count': 0}}} Aug 31 16:10:40.406920 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:10:40.406920 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:40.406920 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 16:10:40.406920 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 16:10:40.406920 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 16:10:40.406920 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise error Aug 31 16:10:40.406920 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 31 16:10:40.406920 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:10:40.406920 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Aug 31 16:10:40.406920 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 31 16:10:40.406920 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 31 16:10:40.406920 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 31 16:10:40.406920 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 31 16:10:40.406920 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:10:40.406920 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 31 16:10:40.406920 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi 0 Aug 31 16:10:40.406920 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:10:40.406920 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:10:40.406920 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:10:40.406920 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:40.406920 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:10:40.406920 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:10:40.406920 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:10:40.406920 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:10:40.406920 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:10:40.406920 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:10:40.406920 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:10:40.406920 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:10:40.406920 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 16:10:40.406920 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 16:10:40.411850 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 16:10:40.411850 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 16:10:40.411850 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 16:10:40.411850 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 16:10:40.411850 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 31 16:10:40.411850 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:10:40.411850 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:10:40.411850 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:10:40.411850 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:40.411850 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:10:40.411850 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:10:40.411850 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 16:10:40.411850 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 16:10:40.411850 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 31 16:10:40.411850 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:10:40.418432 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-87b36a2f-74a3-4ea5-a435-012a76913b80 tempest-MultipleCreateNegativeTestJSON-2025832496 tempest-MultipleCreateNegativeTestJSON-2025832496-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:10:40.430680 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-87b36a2f-74a3-4ea5-a435-012a76913b80 tempest-MultipleCreateNegativeTestJSON-2025832496 tempest-MultipleCreateNegativeTestJSON-2025832496-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.033018 Aug 31 16:10:40.431355 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1615/3278] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:10:40 2022] POST /compute/v2.1/servers => generated 130 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:10:40.452807 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a866dcdf-ec3b-4e42-b889-32295522c77d tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:40.457932 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a866dcdf-ec3b-4e42-b889-32295522c77d tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] [instance: d1e43fd8-2e15-468d-9da0-2851a41bd23b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:40.472262 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a866dcdf-ec3b-4e42-b889-32295522c77d tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:40.480631 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a866dcdf-ec3b-4e42-b889-32295522c77d tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:40.481403 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a866dcdf-ec3b-4e42-b889-32295522c77d tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:40.482335 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a866dcdf-ec3b-4e42-b889-32295522c77d tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:40.485482 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a866dcdf-ec3b-4e42-b889-32295522c77d tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:40.486152 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a866dcdf-ec3b-4e42-b889-32295522c77d tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:40.514886 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-a866dcdf-ec3b-4e42-b889-32295522c77d tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] HTTP exception thrown: Instance d1e43fd8-2e15-468d-9da0-2851a41bd23b could not be found. Aug 31 16:10:40.529843 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a866dcdf-ec3b-4e42-b889-32295522c77d tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Request method failure captured: Aug 31 16:10:40.529843 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/d1e43fd8-2e15-468d-9da0-2851a41bd23b HTTP/1.1 Aug 31 16:10:40.529843 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:10:40.529843 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:10:40.529843 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:10:40.529843 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:10:40.529843 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:10:40.529843 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:10:40.529843 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:10:40.529843 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:10:40.529843 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4eVQ1PcyZWLoBMNFxcMiX2OodHQu9EW4JwQWAxIo_nw1s9ooTO24TL1mVZbfvgZALONSJPrmH5bhQs5sHUEYxalHzFvyKy3JUCiHPJ5vH8NJSAQPNSDudZN8x3Z5nVsjKx_wgQvz9eBUHeMS3AnA6IWUTfGsDF6PXmWRAyf_27pxvs Aug 31 16:10:40.529843 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:10:40.529843 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:10:40.529843 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:10:40.529843 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:10:40.529843 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:10:40.529843 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:10:40.529843 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 1cf281e8857247c6b9e60d4216741f89 Aug 31 16:10:40.529843 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ListServerFiltersTestJSON-1562372280 Aug 31 16:10:40.529843 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:10:40.529843 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:10:40.529843 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1cf281e8857247c6b9e60d4216741f89"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1cf281e8857247c6b9e60d4216741f89"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1cf281e8857247c6b9e60d4216741f89", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1cf281e8857247c6b9e60d4216741f89"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:10:40.529843 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ListServerFiltersTestJSON-1562372280 Aug 31 16:10:40.529843 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 1cf281e8857247c6b9e60d4216741f89 Aug 31 16:10:40.529843 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1562372280 Aug 31 16:10:40.529843 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ListServerFiltersTestJSON-1562372280-project Aug 31 16:10:40.529843 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:10:40.529843 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:10:40.529843 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 41b93395d63a4db895ff224a311940e3 Aug 31 16:10:40.529843 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ListServerFiltersTestJSON-1562372280-project Aug 31 16:10:40.529843 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:10:40.529843 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance d1e43fd8-2e15-468d-9da0-2851a41bd23b could not be found. Aug 31 16:10:40.529843 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': 'd1e43fd8-2e15-468d-9da0-2851a41bd23b'} Aug 31 16:10:40.529843 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:10:40.529843 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:40.529843 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:10:40.529843 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:10:40.529843 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:10:40.529843 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:10:40.529843 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:10:40.529843 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:10:40.529843 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:10:40.529843 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:10:40.529843 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1e43fd8-2e15-468d-9da0-2851a41bd23b could not be found. Aug 31 16:10:40.529843 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:10:40.529843 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:10:40.529843 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:10:40.529843 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:40.529843 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:10:40.529843 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:10:40.529843 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:10:40.529843 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:10:40.529843 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:10:40.529843 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:10:40.529843 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:10:40.529843 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:10:40.529843 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:10:40.529843 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:10:40.529843 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:10:40.529843 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:10:40.529843 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1e43fd8-2e15-468d-9da0-2851a41bd23b could not be found. Aug 31 16:10:40.529843 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:10:40.529843 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:10:40.529843 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:10:40.536364 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:40.536364 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:10:40.536364 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:10:40.536364 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:10:40.536364 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:10:40.536364 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1e43fd8-2e15-468d-9da0-2851a41bd23b could not be found. Aug 31 16:10:40.536364 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:10:40.542647 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a866dcdf-ec3b-4e42-b889-32295522c77d tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Returning 404 to user: Instance d1e43fd8-2e15-468d-9da0-2851a41bd23b could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:10:40.544237 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a866dcdf-ec3b-4e42-b889-32295522c77d tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] 10.222.0.61 "GET /compute/v2.1/servers/d1e43fd8-2e15-468d-9da0-2851a41bd23b" status: 404 len: 111 microversion: 2.1 time: 0.109106 Aug 31 16:10:40.547983 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1616/3279] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:40 2022] GET /compute/v2.1/servers/d1e43fd8-2e15-468d-9da0-2851a41bd23b => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:10:40.559824 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-909affc5-7def-450a-ada2-fc3f3fe8995a tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:40.560659 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-909affc5-7def-450a-ada2-fc3f3fe8995a tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] [instance: e6064a64-eae1-400c-b60c-2189e025905f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:40.568614 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-909affc5-7def-450a-ada2-fc3f3fe8995a tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:40.569942 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-909affc5-7def-450a-ada2-fc3f3fe8995a tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:40.570563 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-909affc5-7def-450a-ada2-fc3f3fe8995a tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:40.572207 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-909affc5-7def-450a-ada2-fc3f3fe8995a tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:40.573544 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-909affc5-7def-450a-ada2-fc3f3fe8995a tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:40.574480 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-909affc5-7def-450a-ada2-fc3f3fe8995a tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:40.579614 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a0ea667d-1ef5-4ce7-b1aa-8d8ecd9ec55b tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13cabcaa79043bea338128594a6b00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab7f0d889224cefbca55343f3208a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:40.594816 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a0ea667d-1ef5-4ce7-b1aa-8d8ecd9ec55b tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] 10.222.0.61 "GET /compute/v2.1/servers/606f1624-8c53-409e-b06b-ace080f7fc44" status: 200 len: 1519 microversion: 2.1 time: 0.383621 Aug 31 16:10:40.595622 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1664/3280] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:40 2022] GET /compute/v2.1/servers/606f1624-8c53-409e-b06b-ace080f7fc44 => generated 1519 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:40.608794 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2c44c2b6-83bc-4624-b3ab-b0a9df3f4724 tempest-MultipleCreateNegativeTestJSON-2025832496 tempest-MultipleCreateNegativeTestJSON-2025832496-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1891212599", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "max_count": 2.5}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:10:40.620769 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2c44c2b6-83bc-4624-b3ab-b0a9df3f4724 tempest-MultipleCreateNegativeTestJSON-2025832496 tempest-MultipleCreateNegativeTestJSON-2025832496-project] Request method failure captured: Aug 31 16:10:40.620769 n-d-850499-9 devstack@n-api.service[122256]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 31 16:10:40.620769 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:10:40.620769 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:10:40.620769 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:10:40.620769 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 170 Aug 31 16:10:40.620769 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:10:40.620769 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:10:40.620769 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:10:40.620769 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:10:40.620769 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4f_Y6obSnPuFxiu_9E8Cg5RZdAOicwWcMeH3wro_2jTZZVjInoUN0m5648_FTrpf7XzDbpSE0liJDAIBpXaLtgWBxwRue7tk0MUIPEqoG20V3xlTQvfO_ZAvNROQTgwGHM6KNXmofMISPtBMeGOD77jjb8wd4ZRyxdKgVdsFqBhm98 Aug 31 16:10:40.620769 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:10:40.620769 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:10:40.620769 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:10:40.620769 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:10:40.620769 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:10:40.620769 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:10:40.620769 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: bc2cc1aeff814f66890715edc7da3ece Aug 31 16:10:40.620769 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-2025832496 Aug 31 16:10:40.620769 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:10:40.620769 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:10:40.620769 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/bc2cc1aeff814f66890715edc7da3ece"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/bc2cc1aeff814f66890715edc7da3ece"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_bc2cc1aeff814f66890715edc7da3ece", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/bc2cc1aeff814f66890715edc7da3ece"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:10:40.620769 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-2025832496 Aug 31 16:10:40.620769 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: bc2cc1aeff814f66890715edc7da3ece Aug 31 16:10:40.620769 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-2025832496 Aug 31 16:10:40.620769 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-MultipleCreateNegativeTestJSON-2025832496-project Aug 31 16:10:40.620769 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:10:40.620769 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:10:40.620769 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 2b3a6ad0a6074fbb86b82050e81da597 Aug 31 16:10:40.620769 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-2025832496-project Aug 31 16:10:40.620769 n-d-850499-9 devstack@n-api.service[122256]: Aug 31 16:10:40.620769 n-d-850499-9 devstack@n-api.service[122256]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1891212599", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "max_count": 2.5}} Aug 31 16:10:40.620769 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:10:40.620769 n-d-850499-9 devstack@n-api.service[122256]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 31 16:10:40.620769 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1891212599', 'imageRef': 'b9c36d42-ed46-4bf5-ad18-1df45cbd0413', 'flavorRef': '452', 'max_count': 2.5}}} Aug 31 16:10:40.620769 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:10:40.620769 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:40.620769 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 16:10:40.620769 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 16:10:40.620769 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 16:10:40.620769 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise error Aug 31 16:10:40.620769 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Aug 31 16:10:40.620769 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:10:40.620769 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Aug 31 16:10:40.620769 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 31 16:10:40.620769 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 31 16:10:40.620769 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 31 16:10:40.620769 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 31 16:10:40.620769 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:10:40.620769 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 31 16:10:40.620769 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi 2.5 Aug 31 16:10:40.620769 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:10:40.620769 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:10:40.620769 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:10:40.620769 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:40.620769 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:10:40.620769 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:10:40.620769 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:10:40.620769 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:10:40.620769 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:10:40.620769 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:10:40.620769 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:10:40.620769 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:10:40.620769 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 16:10:40.620769 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 16:10:40.626972 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 16:10:40.626972 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 16:10:40.626972 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 16:10:40.626972 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 16:10:40.626972 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 31 16:10:40.626972 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:10:40.626972 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:10:40.626972 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:10:40.626972 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:40.626972 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:10:40.626972 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:10:40.626972 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 16:10:40.626972 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 16:10:40.626972 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 31 16:10:40.626972 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:10:40.631750 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2c44c2b6-83bc-4624-b3ab-b0a9df3f4724 tempest-MultipleCreateNegativeTestJSON-2025832496 tempest-MultipleCreateNegativeTestJSON-2025832496-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:10:40.631750 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2c44c2b6-83bc-4624-b3ab-b0a9df3f4724 tempest-MultipleCreateNegativeTestJSON-2025832496 tempest-MultipleCreateNegativeTestJSON-2025832496-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.033863 Aug 31 16:10:40.632674 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1665/3281] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:10:40 2022] POST /compute/v2.1/servers => generated 139 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:10:40.638180 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d341af73-f6a3-429f-8711-2529f2595a2d tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Action: 'create', calling method: .version_select at 0x7f5aed23c430>, body: {"pool": null} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:10:40.652518 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-909affc5-7def-450a-ada2-fc3f3fe8995a tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] [instance: e6064a64-eae1-400c-b60c-2189e025905f] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:10:40.837133 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-909affc5-7def-450a-ada2-fc3f3fe8995a tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] 10.222.0.61 "DELETE /compute/v2.1/servers/e6064a64-eae1-400c-b60c-2189e025905f" status: 204 len: 0 microversion: 2.1 time: 0.286273 Aug 31 16:10:40.838899 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1617/3282] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:10:40 2022] DELETE /compute/v2.1/servers/e6064a64-eae1-400c-b60c-2189e025905f => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 16:10:40.848542 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-24b1cfe6-1eb5-428b-a429-e06df1279644 tempest-MultipleCreateNegativeTestJSON-2025832496 tempest-MultipleCreateNegativeTestJSON-2025832496-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-441545568", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "min_count": 0}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:10:40.854276 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-24b1cfe6-1eb5-428b-a429-e06df1279644 tempest-MultipleCreateNegativeTestJSON-2025832496 tempest-MultipleCreateNegativeTestJSON-2025832496-project] Request method failure captured: Aug 31 16:10:40.854276 n-d-850499-9 devstack@n-api.service[122257]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 31 16:10:40.854276 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:10:40.854276 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:10:40.854276 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:10:40.854276 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 167 Aug 31 16:10:40.854276 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:10:40.854276 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:10:40.854276 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:10:40.854276 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:10:40.854276 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4f_Y6obSnPuFxiu_9E8Cg5RZdAOicwWcMeH3wro_2jTZZVjInoUN0m5648_FTrpf7XzDbpSE0liJDAIBpXaLtgWBxwRue7tk0MUIPEqoG20V3xlTQvfO_ZAvNROQTgwGHM6KNXmofMISPtBMeGOD77jjb8wd4ZRyxdKgVdsFqBhm98 Aug 31 16:10:40.854276 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:10:40.854276 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:10:40.854276 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:10:40.854276 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:10:40.854276 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:10:40.854276 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:10:40.854276 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: bc2cc1aeff814f66890715edc7da3ece Aug 31 16:10:40.854276 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-2025832496 Aug 31 16:10:40.854276 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:10:40.854276 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:10:40.854276 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/bc2cc1aeff814f66890715edc7da3ece"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/bc2cc1aeff814f66890715edc7da3ece"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_bc2cc1aeff814f66890715edc7da3ece", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/bc2cc1aeff814f66890715edc7da3ece"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:10:40.854276 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-2025832496 Aug 31 16:10:40.854276 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: bc2cc1aeff814f66890715edc7da3ece Aug 31 16:10:40.854276 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-2025832496 Aug 31 16:10:40.854276 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-MultipleCreateNegativeTestJSON-2025832496-project Aug 31 16:10:40.854276 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:10:40.854276 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:10:40.854276 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 2b3a6ad0a6074fbb86b82050e81da597 Aug 31 16:10:40.854276 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-2025832496-project Aug 31 16:10:40.854276 n-d-850499-9 devstack@n-api.service[122257]: Aug 31 16:10:40.854276 n-d-850499-9 devstack@n-api.service[122257]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-441545568", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "min_count": 0}} Aug 31 16:10:40.854276 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:10:40.854276 n-d-850499-9 devstack@n-api.service[122257]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 31 16:10:40.854276 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-441545568', 'imageRef': 'b9c36d42-ed46-4bf5-ad18-1df45cbd0413', 'flavorRef': '452', 'min_count': 0}}} Aug 31 16:10:40.854276 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:10:40.854276 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:40.854276 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 16:10:40.854276 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 16:10:40.854276 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 16:10:40.854276 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise error Aug 31 16:10:40.854276 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 31 16:10:40.854276 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:10:40.854276 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Aug 31 16:10:40.854276 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 31 16:10:40.854276 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 31 16:10:40.854276 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 31 16:10:40.854276 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 31 16:10:40.854276 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:10:40.854276 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 31 16:10:40.854276 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi 0 Aug 31 16:10:40.854276 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:10:40.854276 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:10:40.854276 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:10:40.854276 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:40.854276 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:10:40.854276 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:10:40.854276 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:10:40.854276 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:10:40.854276 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:10:40.854276 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:10:40.854276 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:10:40.854276 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:10:40.854276 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 16:10:40.854276 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 16:10:40.858678 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 16:10:40.858678 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 16:10:40.858678 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 16:10:40.858678 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 16:10:40.858678 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 31 16:10:40.858678 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:10:40.858678 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:10:40.858678 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:10:40.858678 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:40.858678 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:10:40.858678 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:10:40.858678 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 16:10:40.858678 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 16:10:40.858678 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 31 16:10:40.858678 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:10:40.861421 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-24b1cfe6-1eb5-428b-a429-e06df1279644 tempest-MultipleCreateNegativeTestJSON-2025832496 tempest-MultipleCreateNegativeTestJSON-2025832496-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:10:40.863416 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-24b1cfe6-1eb5-428b-a429-e06df1279644 tempest-MultipleCreateNegativeTestJSON-2025832496 tempest-MultipleCreateNegativeTestJSON-2025832496-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.022630 Aug 31 16:10:40.864719 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1618/3283] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:10:40 2022] POST /compute/v2.1/servers => generated 130 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:10:40.873363 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-313dafe6-2256-41e0-9157-90fa322d5284 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:40.874545 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-313dafe6-2256-41e0-9157-90fa322d5284 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] [instance: e6064a64-eae1-400c-b60c-2189e025905f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:40.903248 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-313dafe6-2256-41e0-9157-90fa322d5284 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:40.905401 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-313dafe6-2256-41e0-9157-90fa322d5284 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:40.905855 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-313dafe6-2256-41e0-9157-90fa322d5284 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:40.906579 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-313dafe6-2256-41e0-9157-90fa322d5284 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:40.907036 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-313dafe6-2256-41e0-9157-90fa322d5284 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:40.907471 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-313dafe6-2256-41e0-9157-90fa322d5284 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:41.314235 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-313dafe6-2256-41e0-9157-90fa322d5284 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b93395d63a4db895ff224a311940e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf281e8857247c6b9e60d4216741f89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:41.325772 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-313dafe6-2256-41e0-9157-90fa322d5284 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] 10.222.0.61 "GET /compute/v2.1/servers/e6064a64-eae1-400c-b60c-2189e025905f" status: 200 len: 1518 microversion: 2.1 time: 0.459507 Aug 31 16:10:41.326379 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1619/3284] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:40 2022] GET /compute/v2.1/servers/e6064a64-eae1-400c-b60c-2189e025905f => generated 1518 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:41.344646 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f7771ff8-a917-424e-8b59-7723a4cb9932 tempest-MultipleCreateNegativeTestJSON-2025832496 tempest-MultipleCreateNegativeTestJSON-2025832496-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1876821320", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "min_count": 2.5}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:10:41.360648 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f7771ff8-a917-424e-8b59-7723a4cb9932 tempest-MultipleCreateNegativeTestJSON-2025832496 tempest-MultipleCreateNegativeTestJSON-2025832496-project] Request method failure captured: Aug 31 16:10:41.360648 n-d-850499-9 devstack@n-api.service[122257]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 31 16:10:41.360648 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:10:41.360648 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:10:41.360648 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:10:41.360648 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 170 Aug 31 16:10:41.360648 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:10:41.360648 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:10:41.360648 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:10:41.360648 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:10:41.360648 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4f_Y6obSnPuFxiu_9E8Cg5RZdAOicwWcMeH3wro_2jTZZVjInoUN0m5648_FTrpf7XzDbpSE0liJDAIBpXaLtgWBxwRue7tk0MUIPEqoG20V3xlTQvfO_ZAvNROQTgwGHM6KNXmofMISPtBMeGOD77jjb8wd4ZRyxdKgVdsFqBhm98 Aug 31 16:10:41.360648 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:10:41.360648 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:10:41.360648 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:10:41.360648 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:10:41.360648 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:10:41.360648 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:10:41.360648 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: bc2cc1aeff814f66890715edc7da3ece Aug 31 16:10:41.360648 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-2025832496 Aug 31 16:10:41.360648 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:10:41.360648 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:10:41.360648 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/bc2cc1aeff814f66890715edc7da3ece"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/bc2cc1aeff814f66890715edc7da3ece"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_bc2cc1aeff814f66890715edc7da3ece", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/bc2cc1aeff814f66890715edc7da3ece"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:10:41.360648 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-2025832496 Aug 31 16:10:41.360648 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: bc2cc1aeff814f66890715edc7da3ece Aug 31 16:10:41.360648 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-2025832496 Aug 31 16:10:41.360648 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-MultipleCreateNegativeTestJSON-2025832496-project Aug 31 16:10:41.360648 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:10:41.360648 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:10:41.360648 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 2b3a6ad0a6074fbb86b82050e81da597 Aug 31 16:10:41.360648 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-2025832496-project Aug 31 16:10:41.360648 n-d-850499-9 devstack@n-api.service[122257]: Aug 31 16:10:41.360648 n-d-850499-9 devstack@n-api.service[122257]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1876821320", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "min_count": 2.5}} Aug 31 16:10:41.360648 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:10:41.360648 n-d-850499-9 devstack@n-api.service[122257]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 31 16:10:41.360648 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1876821320', 'imageRef': 'b9c36d42-ed46-4bf5-ad18-1df45cbd0413', 'flavorRef': '452', 'min_count': 2.5}}} Aug 31 16:10:41.360648 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:10:41.360648 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:41.360648 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 16:10:41.360648 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 16:10:41.360648 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 16:10:41.360648 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise error Aug 31 16:10:41.360648 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Aug 31 16:10:41.360648 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:10:41.360648 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Aug 31 16:10:41.360648 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 31 16:10:41.360648 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 31 16:10:41.360648 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 31 16:10:41.360648 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 31 16:10:41.360648 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:10:41.360648 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 31 16:10:41.360648 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi 2.5 Aug 31 16:10:41.360648 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:10:41.360648 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:10:41.360648 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:10:41.360648 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:41.360648 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:10:41.360648 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:10:41.360648 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:10:41.360648 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:10:41.360648 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:10:41.360648 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:10:41.360648 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:10:41.360648 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:10:41.360648 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 16:10:41.360648 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 16:10:41.366237 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 16:10:41.366237 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 16:10:41.366237 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 16:10:41.366237 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 16:10:41.366237 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 31 16:10:41.366237 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:10:41.366237 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:10:41.366237 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:10:41.366237 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:41.366237 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:10:41.366237 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:10:41.366237 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 16:10:41.366237 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 16:10:41.366237 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 31 16:10:41.366237 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:10:41.366237 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f7771ff8-a917-424e-8b59-7723a4cb9932 tempest-MultipleCreateNegativeTestJSON-2025832496 tempest-MultipleCreateNegativeTestJSON-2025832496-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:10:41.366237 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f7771ff8-a917-424e-8b59-7723a4cb9932 tempest-MultipleCreateNegativeTestJSON-2025832496 tempest-MultipleCreateNegativeTestJSON-2025832496-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.021879 Aug 31 16:10:41.366237 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1620/3285] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:10:41 2022] POST /compute/v2.1/servers => generated 139 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:10:41.402629 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-459b70f3-908a-4e73-b45c-b317a7eca388 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:41.403249 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-459b70f3-908a-4e73-b45c-b317a7eca388 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] [instance: fa0932e8-1aa4-4d1a-b653-14be35568f3d] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:41.412004 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-459b70f3-908a-4e73-b45c-b317a7eca388 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:41.412513 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-459b70f3-908a-4e73-b45c-b317a7eca388 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:41.412965 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-459b70f3-908a-4e73-b45c-b317a7eca388 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:41.414254 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-459b70f3-908a-4e73-b45c-b317a7eca388 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:41.414723 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-459b70f3-908a-4e73-b45c-b317a7eca388 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:41.424066 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-459b70f3-908a-4e73-b45c-b317a7eca388 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:41.508418 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=18 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:10:42.484189 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-459b70f3-908a-4e73-b45c-b317a7eca388 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:42.499378 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-459b70f3-908a-4e73-b45c-b317a7eca388 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:42.502411 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-459b70f3-908a-4e73-b45c-b317a7eca388 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:42.503924 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-459b70f3-908a-4e73-b45c-b317a7eca388 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] 10.222.0.61 "GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d" status: 200 len: 1802 microversion: 2.32 time: 1.105143 Aug 31 16:10:42.504795 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1621/3286] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:10:41 2022] GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d => generated 1802 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:10:42.511751 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ef3d1830-698f-42ea-b9cd-2c47675e5713 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:42.512693 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ef3d1830-698f-42ea-b9cd-2c47675e5713 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] [instance: e6064a64-eae1-400c-b60c-2189e025905f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:42.519982 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ef3d1830-698f-42ea-b9cd-2c47675e5713 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:42.520765 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ef3d1830-698f-42ea-b9cd-2c47675e5713 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:42.521456 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ef3d1830-698f-42ea-b9cd-2c47675e5713 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:42.522377 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ef3d1830-698f-42ea-b9cd-2c47675e5713 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:42.524109 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ef3d1830-698f-42ea-b9cd-2c47675e5713 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:42.524949 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ef3d1830-698f-42ea-b9cd-2c47675e5713 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:43.323700 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ef3d1830-698f-42ea-b9cd-2c47675e5713 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b93395d63a4db895ff224a311940e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf281e8857247c6b9e60d4216741f89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:43.341525 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ef3d1830-698f-42ea-b9cd-2c47675e5713 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] 10.222.0.61 "GET /compute/v2.1/servers/e6064a64-eae1-400c-b60c-2189e025905f" status: 200 len: 1518 microversion: 2.1 time: 0.832671 Aug 31 16:10:43.345126 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1622/3287] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:42 2022] GET /compute/v2.1/servers/e6064a64-eae1-400c-b60c-2189e025905f => generated 1518 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:43.539888 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8bffae96-a53b-47e0-9006-a22652e02140 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:43.540647 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8bffae96-a53b-47e0-9006-a22652e02140 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] [instance: fa0932e8-1aa4-4d1a-b653-14be35568f3d] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:43.550671 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8bffae96-a53b-47e0-9006-a22652e02140 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:43.551854 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8bffae96-a53b-47e0-9006-a22652e02140 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:43.552649 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8bffae96-a53b-47e0-9006-a22652e02140 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:43.553590 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8bffae96-a53b-47e0-9006-a22652e02140 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:43.556966 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8bffae96-a53b-47e0-9006-a22652e02140 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:43.557602 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8bffae96-a53b-47e0-9006-a22652e02140 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:44.454557 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8bffae96-a53b-47e0-9006-a22652e02140 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:44.503391 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8bffae96-a53b-47e0-9006-a22652e02140 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:44.505110 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8bffae96-a53b-47e0-9006-a22652e02140 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:44.510667 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8bffae96-a53b-47e0-9006-a22652e02140 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] 10.222.0.61 "GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d" status: 200 len: 1849 microversion: 2.32 time: 0.972261 Aug 31 16:10:44.513648 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1623/3288] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:10:43 2022] GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d => generated 1849 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:10:44.518525 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-02a8b98d-d5a9-4410-a57b-068dd80efaf9 req-67a0c62a-3af1-41c0-a2c3-03f4d8950eb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6064a64-eae1-400c-b60c-2189e025905f", "name": "network-vif-deleted", "tag": "5006df16-da92-4553-98f9-b281a211f4cd"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:10:44.542333 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-02a8b98d-d5a9-4410-a57b-068dd80efaf9 req-67a0c62a-3af1-41c0-a2c3-03f4d8950eb8 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:44.543581 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-02a8b98d-d5a9-4410-a57b-068dd80efaf9 req-67a0c62a-3af1-41c0-a2c3-03f4d8950eb8 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:44.544199 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-02a8b98d-d5a9-4410-a57b-068dd80efaf9 req-67a0c62a-3af1-41c0-a2c3-03f4d8950eb8 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:44.558667 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-02a8b98d-d5a9-4410-a57b-068dd80efaf9 req-67a0c62a-3af1-41c0-a2c3-03f4d8950eb8 service nova] Creating event network-vif-deleted:5006df16-da92-4553-98f9-b281a211f4cd for instance e6064a64-eae1-400c-b60c-2189e025905f on n-h1-850499-9 Aug 31 16:10:44.568959 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-02a8b98d-d5a9-4410-a57b-068dd80efaf9 req-67a0c62a-3af1-41c0-a2c3-03f4d8950eb8 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052152 Aug 31 16:10:44.571089 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1624/3289] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:10:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:10:44.582711 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b8238557-07cc-454f-8f7d-bc0635be9a6f tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:44.584332 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b8238557-07cc-454f-8f7d-bc0635be9a6f tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] [instance: e6064a64-eae1-400c-b60c-2189e025905f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:44.593064 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b8238557-07cc-454f-8f7d-bc0635be9a6f tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:44.593911 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b8238557-07cc-454f-8f7d-bc0635be9a6f tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:44.594569 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b8238557-07cc-454f-8f7d-bc0635be9a6f tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:44.595546 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b8238557-07cc-454f-8f7d-bc0635be9a6f tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:44.596197 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b8238557-07cc-454f-8f7d-bc0635be9a6f tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:44.596833 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b8238557-07cc-454f-8f7d-bc0635be9a6f tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:44.658688 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b8238557-07cc-454f-8f7d-bc0635be9a6f tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:44.659674 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b8238557-07cc-454f-8f7d-bc0635be9a6f tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:44.660455 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b8238557-07cc-454f-8f7d-bc0635be9a6f tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:44.661208 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-b8238557-07cc-454f-8f7d-bc0635be9a6f tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lazy-loading 'fault' on Instance uuid e6064a64-eae1-400c-b60c-2189e025905f {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:10:44.851699 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b8238557-07cc-454f-8f7d-bc0635be9a6f tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b93395d63a4db895ff224a311940e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf281e8857247c6b9e60d4216741f89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:44.859321 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b8238557-07cc-454f-8f7d-bc0635be9a6f tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] 10.222.0.61 "GET /compute/v2.1/servers/e6064a64-eae1-400c-b60c-2189e025905f" status: 200 len: 1311 microversion: 2.1 time: 0.285580 Aug 31 16:10:44.863792 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1625/3290] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:44 2022] GET /compute/v2.1/servers/e6064a64-eae1-400c-b60c-2189e025905f => generated 1311 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:45.538495 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-275e8550-dc5e-469c-8d7b-f0bb471df2e1 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:45.539088 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-275e8550-dc5e-469c-8d7b-f0bb471df2e1 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] [instance: fa0932e8-1aa4-4d1a-b653-14be35568f3d] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:45.555918 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-275e8550-dc5e-469c-8d7b-f0bb471df2e1 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:45.556811 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-275e8550-dc5e-469c-8d7b-f0bb471df2e1 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:45.556973 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-275e8550-dc5e-469c-8d7b-f0bb471df2e1 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:45.557656 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-275e8550-dc5e-469c-8d7b-f0bb471df2e1 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:45.558118 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-275e8550-dc5e-469c-8d7b-f0bb471df2e1 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:45.558614 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-275e8550-dc5e-469c-8d7b-f0bb471df2e1 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:46.242867 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-275e8550-dc5e-469c-8d7b-f0bb471df2e1 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:46.271592 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-275e8550-dc5e-469c-8d7b-f0bb471df2e1 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:46.279797 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-275e8550-dc5e-469c-8d7b-f0bb471df2e1 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:46.281993 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-275e8550-dc5e-469c-8d7b-f0bb471df2e1 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] 10.222.0.61 "GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d" status: 200 len: 1849 microversion: 2.32 time: 0.747862 Aug 31 16:10:46.284282 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1626/3291] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:10:45 2022] GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d => generated 1849 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:10:46.295265 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4d23fe48-ae6a-4440-9d10-a4e06d2f2c64 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:46.296282 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4d23fe48-ae6a-4440-9d10-a4e06d2f2c64 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] [instance: e6064a64-eae1-400c-b60c-2189e025905f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:46.306379 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4d23fe48-ae6a-4440-9d10-a4e06d2f2c64 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:46.307668 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4d23fe48-ae6a-4440-9d10-a4e06d2f2c64 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:46.308602 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4d23fe48-ae6a-4440-9d10-a4e06d2f2c64 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:46.309621 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4d23fe48-ae6a-4440-9d10-a4e06d2f2c64 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:46.310561 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4d23fe48-ae6a-4440-9d10-a4e06d2f2c64 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:46.311286 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4d23fe48-ae6a-4440-9d10-a4e06d2f2c64 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:46.344950 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-4d23fe48-ae6a-4440-9d10-a4e06d2f2c64 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] HTTP exception thrown: Instance e6064a64-eae1-400c-b60c-2189e025905f could not be found. Aug 31 16:10:46.347439 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4d23fe48-ae6a-4440-9d10-a4e06d2f2c64 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Request method failure captured: Aug 31 16:10:46.347439 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/e6064a64-eae1-400c-b60c-2189e025905f HTTP/1.1 Aug 31 16:10:46.347439 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:10:46.347439 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:10:46.347439 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:10:46.347439 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:10:46.347439 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:10:46.347439 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:10:46.347439 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:10:46.347439 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:10:46.347439 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4eVQ1PcyZWLoBMNFxcMiX2OodHQu9EW4JwQWAxIo_nw1s9ooTO24TL1mVZbfvgZALONSJPrmH5bhQs5sHUEYxalHzFvyKy3JUCiHPJ5vH8NJSAQPNSDudZN8x3Z5nVsjKx_wgQvz9eBUHeMS3AnA6IWUTfGsDF6PXmWRAyf_27pxvs Aug 31 16:10:46.347439 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:10:46.347439 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:10:46.347439 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:10:46.347439 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:10:46.347439 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:10:46.347439 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:10:46.347439 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 1cf281e8857247c6b9e60d4216741f89 Aug 31 16:10:46.347439 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ListServerFiltersTestJSON-1562372280 Aug 31 16:10:46.347439 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:10:46.347439 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:10:46.347439 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1cf281e8857247c6b9e60d4216741f89"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1cf281e8857247c6b9e60d4216741f89"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1cf281e8857247c6b9e60d4216741f89", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1cf281e8857247c6b9e60d4216741f89"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:10:46.347439 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ListServerFiltersTestJSON-1562372280 Aug 31 16:10:46.347439 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 1cf281e8857247c6b9e60d4216741f89 Aug 31 16:10:46.347439 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1562372280 Aug 31 16:10:46.347439 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ListServerFiltersTestJSON-1562372280-project Aug 31 16:10:46.347439 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:10:46.347439 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:10:46.347439 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 41b93395d63a4db895ff224a311940e3 Aug 31 16:10:46.347439 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ListServerFiltersTestJSON-1562372280-project Aug 31 16:10:46.347439 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:10:46.347439 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance e6064a64-eae1-400c-b60c-2189e025905f could not be found. Aug 31 16:10:46.347439 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': 'e6064a64-eae1-400c-b60c-2189e025905f'} Aug 31 16:10:46.347439 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:10:46.347439 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:46.347439 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:10:46.347439 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:10:46.347439 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:10:46.347439 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:10:46.347439 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:10:46.347439 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:10:46.347439 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:10:46.347439 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:10:46.347439 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6064a64-eae1-400c-b60c-2189e025905f could not be found. Aug 31 16:10:46.347439 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:10:46.347439 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:10:46.347439 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:10:46.347439 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:46.347439 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:10:46.347439 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:10:46.347439 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:10:46.347439 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:10:46.347439 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:10:46.347439 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:10:46.347439 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:10:46.347439 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:10:46.347439 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:10:46.347439 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:10:46.347439 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:10:46.347439 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:10:46.347439 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6064a64-eae1-400c-b60c-2189e025905f could not be found. Aug 31 16:10:46.347439 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:10:46.347439 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:10:46.347439 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:10:46.355751 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:46.355751 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:10:46.355751 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:10:46.355751 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:10:46.355751 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:10:46.355751 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6064a64-eae1-400c-b60c-2189e025905f could not be found. Aug 31 16:10:46.355751 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:10:46.358033 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4d23fe48-ae6a-4440-9d10-a4e06d2f2c64 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Returning 404 to user: Instance e6064a64-eae1-400c-b60c-2189e025905f could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:10:46.359782 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4d23fe48-ae6a-4440-9d10-a4e06d2f2c64 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] 10.222.0.61 "GET /compute/v2.1/servers/e6064a64-eae1-400c-b60c-2189e025905f" status: 404 len: 111 microversion: 2.1 time: 0.073316 Aug 31 16:10:46.360627 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1627/3292] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:46 2022] GET /compute/v2.1/servers/e6064a64-eae1-400c-b60c-2189e025905f => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:10:46.368810 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-96cbfa89-7c72-4d6d-9a62-2d748ef9adaa req-33efd38f-8793-479e-a8e1-ffdb0eaf00dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa0932e8-1aa4-4d1a-b653-14be35568f3d", "tag": "b9b65d25-b9da-474a-88d8-821f34d0be4e"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:10:46.380485 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-96cbfa89-7c72-4d6d-9a62-2d748ef9adaa req-33efd38f-8793-479e-a8e1-ffdb0eaf00dc service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:46.381409 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-96cbfa89-7c72-4d6d-9a62-2d748ef9adaa req-33efd38f-8793-479e-a8e1-ffdb0eaf00dc service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:46.382314 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-96cbfa89-7c72-4d6d-9a62-2d748ef9adaa req-33efd38f-8793-479e-a8e1-ffdb0eaf00dc service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:46.389424 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:10:46.433431 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-96cbfa89-7c72-4d6d-9a62-2d748ef9adaa req-33efd38f-8793-479e-a8e1-ffdb0eaf00dc service nova] Creating event network-changed:b9b65d25-b9da-474a-88d8-821f34d0be4e for instance fa0932e8-1aa4-4d1a-b653-14be35568f3d on n-h2-850499-9 Aug 31 16:10:46.454021 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-96cbfa89-7c72-4d6d-9a62-2d748ef9adaa req-33efd38f-8793-479e-a8e1-ffdb0eaf00dc service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091170 Aug 31 16:10:46.459075 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1628/3293] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:10:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:10:46.480219 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e86ed95f-9f18-47db-be71-fcbd42016764 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:46.481922 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e86ed95f-9f18-47db-be71-fcbd42016764 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] [instance: c393928f-2414-4093-9d72-93a21fc6c460] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:46.493426 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e86ed95f-9f18-47db-be71-fcbd42016764 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:46.495789 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e86ed95f-9f18-47db-be71-fcbd42016764 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:46.496606 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e86ed95f-9f18-47db-be71-fcbd42016764 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:46.497783 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e86ed95f-9f18-47db-be71-fcbd42016764 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:46.499215 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e86ed95f-9f18-47db-be71-fcbd42016764 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:46.501914 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e86ed95f-9f18-47db-be71-fcbd42016764 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:46.525299 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d341af73-f6a3-429f-8711-2529f2595a2d tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] 10.222.0.61 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.891148 Aug 31 16:10:46.527529 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1666/3294] 10.222.0.61 () {60 vars in 1170 bytes} [Wed Aug 31 16:10:40 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5894 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:10:46.575446 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e86ed95f-9f18-47db-be71-fcbd42016764 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] [instance: c393928f-2414-4093-9d72-93a21fc6c460] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:10:46.759480 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e86ed95f-9f18-47db-be71-fcbd42016764 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] 10.222.0.61 "DELETE /compute/v2.1/servers/c393928f-2414-4093-9d72-93a21fc6c460" status: 204 len: 0 microversion: 2.1 time: 0.296009 Aug 31 16:10:46.763115 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1629/3295] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:10:46 2022] DELETE /compute/v2.1/servers/c393928f-2414-4093-9d72-93a21fc6c460 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:10:46.770885 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-625054b4-a19a-48b9-9dc0-5241bf515232 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:46.771149 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-625054b4-a19a-48b9-9dc0-5241bf515232 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] [instance: c393928f-2414-4093-9d72-93a21fc6c460] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:46.784752 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-625054b4-a19a-48b9-9dc0-5241bf515232 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:46.784752 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-625054b4-a19a-48b9-9dc0-5241bf515232 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:46.784752 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-625054b4-a19a-48b9-9dc0-5241bf515232 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:46.784752 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-625054b4-a19a-48b9-9dc0-5241bf515232 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:46.795539 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1588df44-eca2-4fa8-a53c-914130f84eae tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-310843490", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "networks": [{"uuid": "567c9ba1-6364-4d01-9016-4aec92f3efc9"}]}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:10:46.796279 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-625054b4-a19a-48b9-9dc0-5241bf515232 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:46.799258 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-625054b4-a19a-48b9-9dc0-5241bf515232 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:46.920037 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-1588df44-eca2-4fa8-a53c-914130f84eae tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] validate_networks() for [('567c9ba1-6364-4d01-9016-4aec92f3efc9', None, None, None, None, None)] {{(pid=122257) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:10:47.734566 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-625054b4-a19a-48b9-9dc0-5241bf515232 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b93395d63a4db895ff224a311940e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf281e8857247c6b9e60d4216741f89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:47.747185 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-625054b4-a19a-48b9-9dc0-5241bf515232 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] 10.222.0.61 "GET /compute/v2.1/servers/c393928f-2414-4093-9d72-93a21fc6c460" status: 200 len: 1518 microversion: 2.1 time: 0.982461 Aug 31 16:10:47.751039 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1667/3296] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:46 2022] GET /compute/v2.1/servers/c393928f-2414-4093-9d72-93a21fc6c460 => generated 1518 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:47.780798 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3c7df2ff-a3c3-4add-ab03-628c5e5aa481 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:47.782346 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3c7df2ff-a3c3-4add-ab03-628c5e5aa481 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] [instance: fa0932e8-1aa4-4d1a-b653-14be35568f3d] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:47.797507 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3c7df2ff-a3c3-4add-ab03-628c5e5aa481 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:47.798794 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3c7df2ff-a3c3-4add-ab03-628c5e5aa481 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:47.800040 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3c7df2ff-a3c3-4add-ab03-628c5e5aa481 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:47.801582 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3c7df2ff-a3c3-4add-ab03-628c5e5aa481 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:47.802487 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3c7df2ff-a3c3-4add-ab03-628c5e5aa481 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:47.803416 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3c7df2ff-a3c3-4add-ab03-628c5e5aa481 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:48.292725 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3c7df2ff-a3c3-4add-ab03-628c5e5aa481 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:48.312878 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3c7df2ff-a3c3-4add-ab03-628c5e5aa481 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:48.314749 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3c7df2ff-a3c3-4add-ab03-628c5e5aa481 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:48.317040 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3c7df2ff-a3c3-4add-ab03-628c5e5aa481 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] 10.222.0.61 "GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d" status: 200 len: 1849 microversion: 2.32 time: 0.547969 Aug 31 16:10:48.318281 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1668/3297] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:10:47 2022] GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d => generated 1849 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:10:48.523949 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-1588df44-eca2-4fa8-a53c-914130f84eae tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:10:48.524900 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-1588df44-eca2-4fa8-a53c-914130f84eae tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:10:48.525071 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-1588df44-eca2-4fa8-a53c-914130f84eae tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:10:48.525449 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-1588df44-eca2-4fa8-a53c-914130f84eae tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:10:48.525880 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-1588df44-eca2-4fa8-a53c-914130f84eae tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:10:48.545109 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1588df44-eca2-4fa8-a53c-914130f84eae tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:48.545601 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1588df44-eca2-4fa8-a53c-914130f84eae tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:48.546043 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1588df44-eca2-4fa8-a53c-914130f84eae tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:48.546965 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1588df44-eca2-4fa8-a53c-914130f84eae tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:48.547432 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1588df44-eca2-4fa8-a53c-914130f84eae tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:48.547887 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1588df44-eca2-4fa8-a53c-914130f84eae tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:48.572555 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-1588df44-eca2-4fa8-a53c-914130f84eae tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Getting quotas for project eab7f0d889224cefbca55343f3208a86. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:10:48.579523 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-1588df44-eca2-4fa8-a53c-914130f84eae tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Getting quotas for user d13cabcaa79043bea338128594a6b00a and project eab7f0d889224cefbca55343f3208a86. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:10:48.599566 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:10:48.606661 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1588df44-eca2-4fa8-a53c-914130f84eae tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Going to run 1 instances... {{(pid=122257) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:10:48.610614 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1588df44-eca2-4fa8-a53c-914130f84eae tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] [instance: c7ae279f-9e24-4755-a912-6bec59837e6c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:10:48.707328 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1588df44-eca2-4fa8-a53c-914130f84eae tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.920167 Aug 31 16:10:48.708569 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1630/3298] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:10:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1923 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:10:48.720703 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ed30ab8e-e571-4104-8d26-1ca5253bed16 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:48.721333 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ed30ab8e-e571-4104-8d26-1ca5253bed16 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] [instance: c7ae279f-9e24-4755-a912-6bec59837e6c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:48.774837 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-20cbca60-f1c1-44b9-8a58-3835de80677a tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:48.776140 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-20cbca60-f1c1-44b9-8a58-3835de80677a tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] [instance: c393928f-2414-4093-9d72-93a21fc6c460] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:48.796602 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-20cbca60-f1c1-44b9-8a58-3835de80677a tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:48.797751 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-20cbca60-f1c1-44b9-8a58-3835de80677a tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:48.800262 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-20cbca60-f1c1-44b9-8a58-3835de80677a tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:48.803134 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-20cbca60-f1c1-44b9-8a58-3835de80677a tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:48.806085 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-20cbca60-f1c1-44b9-8a58-3835de80677a tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:48.806683 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-20cbca60-f1c1-44b9-8a58-3835de80677a tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:49.183068 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ed30ab8e-e571-4104-8d26-1ca5253bed16 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13cabcaa79043bea338128594a6b00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab7f0d889224cefbca55343f3208a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:49.196693 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ed30ab8e-e571-4104-8d26-1ca5253bed16 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] 10.222.0.61 "GET /compute/v2.1/servers/c7ae279f-9e24-4755-a912-6bec59837e6c" status: 200 len: 1223 microversion: 2.1 time: 0.480824 Aug 31 16:10:49.197603 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1669/3299] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:48 2022] GET /compute/v2.1/servers/c7ae279f-9e24-4755-a912-6bec59837e6c => generated 1223 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:49.622488 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c44f0e24-a31f-43b5-9d9c-955c1f49a3f7 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-1685674339", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "networks": "none"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:10:49.755671 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-c44f0e24-a31f-43b5-9d9c-955c1f49a3f7 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:10:49.756110 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-c44f0e24-a31f-43b5-9d9c-955c1f49a3f7 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:10:49.756591 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-c44f0e24-a31f-43b5-9d9c-955c1f49a3f7 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:10:49.757798 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-c44f0e24-a31f-43b5-9d9c-955c1f49a3f7 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:10:49.758442 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-c44f0e24-a31f-43b5-9d9c-955c1f49a3f7 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:10:49.781054 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c44f0e24-a31f-43b5-9d9c-955c1f49a3f7 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:49.782095 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c44f0e24-a31f-43b5-9d9c-955c1f49a3f7 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:49.782960 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c44f0e24-a31f-43b5-9d9c-955c1f49a3f7 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:49.783976 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c44f0e24-a31f-43b5-9d9c-955c1f49a3f7 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:49.788831 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c44f0e24-a31f-43b5-9d9c-955c1f49a3f7 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:49.789587 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c44f0e24-a31f-43b5-9d9c-955c1f49a3f7 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:49.820711 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-c44f0e24-a31f-43b5-9d9c-955c1f49a3f7 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Getting quotas for project a6723a5ba6cb4b88924e0b6fbf9bc3a5. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:10:49.828836 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-c44f0e24-a31f-43b5-9d9c-955c1f49a3f7 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Getting quotas for user 15bc6381d590409493f487f6cc0a1f8b and project a6723a5ba6cb4b88924e0b6fbf9bc3a5. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:10:49.849278 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c44f0e24-a31f-43b5-9d9c-955c1f49a3f7 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Going to run 1 instances... {{(pid=122256) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:10:49.854177 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c44f0e24-a31f-43b5-9d9c-955c1f49a3f7 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] [instance: bb5a2211-fd4e-4c45-a75e-5df8bca76a2a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:10:49.895833 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-20cbca60-f1c1-44b9-8a58-3835de80677a tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b93395d63a4db895ff224a311940e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf281e8857247c6b9e60d4216741f89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:49.909925 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-20cbca60-f1c1-44b9-8a58-3835de80677a tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] 10.222.0.61 "GET /compute/v2.1/servers/c393928f-2414-4093-9d72-93a21fc6c460" status: 200 len: 1518 microversion: 2.1 time: 1.139286 Aug 31 16:10:49.911172 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1631/3300] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:48 2022] GET /compute/v2.1/servers/c393928f-2414-4093-9d72-93a21fc6c460 => generated 1518 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:10:49.926108 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-14b2c1a4-073a-46ad-a40e-d7e59b141e7e tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:49.927265 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-14b2c1a4-073a-46ad-a40e-d7e59b141e7e tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] [instance: fa0932e8-1aa4-4d1a-b653-14be35568f3d] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:49.932332 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c44f0e24-a31f-43b5-9d9c-955c1f49a3f7 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.644192 Aug 31 16:10:49.933186 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1670/3301] 10.222.0.61 () {62 vars in 1188 bytes} [Wed Aug 31 16:10:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 647 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 31 16:10:49.943912 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-6067f4b0-4a51-4168-b6c4-f2f467f5e04c req-6b1829bc-bcae-4f95-aea2-1972a520a09e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa0932e8-1aa4-4d1a-b653-14be35568f3d", "tag": "4a18af29-4324-4844-bf75-25dcac3740f5"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:10:49.952866 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-14b2c1a4-073a-46ad-a40e-d7e59b141e7e tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:49.953615 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-14b2c1a4-073a-46ad-a40e-d7e59b141e7e tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:49.954825 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-14b2c1a4-073a-46ad-a40e-d7e59b141e7e tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:49.956565 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-14b2c1a4-073a-46ad-a40e-d7e59b141e7e tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:49.956724 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:10:49.958887 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-6067f4b0-4a51-4168-b6c4-f2f467f5e04c req-6b1829bc-bcae-4f95-aea2-1972a520a09e service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:49.960387 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-6067f4b0-4a51-4168-b6c4-f2f467f5e04c req-6b1829bc-bcae-4f95-aea2-1972a520a09e service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:49.961983 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-14b2c1a4-073a-46ad-a40e-d7e59b141e7e tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:49.962458 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-14b2c1a4-073a-46ad-a40e-d7e59b141e7e tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:49.963281 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-6067f4b0-4a51-4168-b6c4-f2f467f5e04c req-6b1829bc-bcae-4f95-aea2-1972a520a09e service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:49.990247 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-6067f4b0-4a51-4168-b6c4-f2f467f5e04c req-6b1829bc-bcae-4f95-aea2-1972a520a09e service nova] Creating event network-changed:4a18af29-4324-4844-bf75-25dcac3740f5 for instance fa0932e8-1aa4-4d1a-b653-14be35568f3d on n-h2-850499-9 Aug 31 16:10:50.002266 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-6067f4b0-4a51-4168-b6c4-f2f467f5e04c req-6b1829bc-bcae-4f95-aea2-1972a520a09e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065933 Aug 31 16:10:50.003527 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1671/3302] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:10:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:10:50.014007 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6f6e856d-2c8c-4bea-8731-78cf943632c1 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:50.015287 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6f6e856d-2c8c-4bea-8731-78cf943632c1 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] [instance: bb5a2211-fd4e-4c45-a75e-5df8bca76a2a] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:50.187775 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-6f6e856d-2c8c-4bea-8731-78cf943632c1 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15bc6381d590409493f487f6cc0a1f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6723a5ba6cb4b88924e0b6fbf9bc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:50.209428 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-6f6e856d-2c8c-4bea-8731-78cf943632c1 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15bc6381d590409493f487f6cc0a1f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6723a5ba6cb4b88924e0b6fbf9bc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:50.212533 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-6f6e856d-2c8c-4bea-8731-78cf943632c1 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15bc6381d590409493f487f6cc0a1f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6723a5ba6cb4b88924e0b6fbf9bc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:50.214505 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6f6e856d-2c8c-4bea-8731-78cf943632c1 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] 10.222.0.61 "GET /compute/v2.1/servers/bb5a2211-fd4e-4c45-a75e-5df8bca76a2a" status: 200 len: 1281 microversion: 2.47 time: 0.208982 Aug 31 16:10:50.236764 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1672/3303] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:10:50 2022] GET /compute/v2.1/servers/bb5a2211-fd4e-4c45-a75e-5df8bca76a2a => generated 1281 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:10:50.244341 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0f65d987-c5ad-4aaf-8896-dccb6099b9c1 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:50.246545 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0f65d987-c5ad-4aaf-8896-dccb6099b9c1 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] [instance: c7ae279f-9e24-4755-a912-6bec59837e6c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:50.258828 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0f65d987-c5ad-4aaf-8896-dccb6099b9c1 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:50.260227 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0f65d987-c5ad-4aaf-8896-dccb6099b9c1 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:50.261064 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0f65d987-c5ad-4aaf-8896-dccb6099b9c1 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:50.262334 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0f65d987-c5ad-4aaf-8896-dccb6099b9c1 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:50.263161 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0f65d987-c5ad-4aaf-8896-dccb6099b9c1 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:50.263878 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0f65d987-c5ad-4aaf-8896-dccb6099b9c1 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:51.191490 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-0f65d987-c5ad-4aaf-8896-dccb6099b9c1 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13cabcaa79043bea338128594a6b00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab7f0d889224cefbca55343f3208a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:51.204259 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0f65d987-c5ad-4aaf-8896-dccb6099b9c1 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] 10.222.0.61 "GET /compute/v2.1/servers/c7ae279f-9e24-4755-a912-6bec59837e6c" status: 200 len: 1227 microversion: 2.1 time: 0.966234 Aug 31 16:10:51.207577 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1673/3304] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:50 2022] GET /compute/v2.1/servers/c7ae279f-9e24-4755-a912-6bec59837e6c => generated 1227 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:51.213476 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b4ac5681-ab3b-4413-ac7a-76036a2743db tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:51.221942 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b4ac5681-ab3b-4413-ac7a-76036a2743db tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] [instance: c393928f-2414-4093-9d72-93a21fc6c460] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:51.252104 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b4ac5681-ab3b-4413-ac7a-76036a2743db tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:51.253005 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b4ac5681-ab3b-4413-ac7a-76036a2743db tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:51.253634 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b4ac5681-ab3b-4413-ac7a-76036a2743db tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:51.254540 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b4ac5681-ab3b-4413-ac7a-76036a2743db tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:51.259244 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b4ac5681-ab3b-4413-ac7a-76036a2743db tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:51.260078 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b4ac5681-ab3b-4413-ac7a-76036a2743db tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:51.328902 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-14b2c1a4-073a-46ad-a40e-d7e59b141e7e tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:51.347294 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-14b2c1a4-073a-46ad-a40e-d7e59b141e7e tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:51.354850 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-14b2c1a4-073a-46ad-a40e-d7e59b141e7e tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:51.356129 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-14b2c1a4-073a-46ad-a40e-d7e59b141e7e tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] 10.222.0.61 "GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d" status: 200 len: 1870 microversion: 2.32 time: 1.443642 Aug 31 16:10:51.378841 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1632/3305] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:10:49 2022] GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d => generated 1870 bytes in 1467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:10:51.398519 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7b6d0018-ccae-40f8-93f8-0df1fa6e8d26 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:51.399246 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7b6d0018-ccae-40f8-93f8-0df1fa6e8d26 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] [instance: bb5a2211-fd4e-4c45-a75e-5df8bca76a2a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:51.405649 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7b6d0018-ccae-40f8-93f8-0df1fa6e8d26 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:51.406250 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7b6d0018-ccae-40f8-93f8-0df1fa6e8d26 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:51.406766 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7b6d0018-ccae-40f8-93f8-0df1fa6e8d26 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:51.407578 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7b6d0018-ccae-40f8-93f8-0df1fa6e8d26 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:51.408153 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7b6d0018-ccae-40f8-93f8-0df1fa6e8d26 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:51.408678 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7b6d0018-ccae-40f8-93f8-0df1fa6e8d26 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:51.714496 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7b6d0018-ccae-40f8-93f8-0df1fa6e8d26 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15bc6381d590409493f487f6cc0a1f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6723a5ba6cb4b88924e0b6fbf9bc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:51.738042 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7b6d0018-ccae-40f8-93f8-0df1fa6e8d26 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15bc6381d590409493f487f6cc0a1f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6723a5ba6cb4b88924e0b6fbf9bc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:51.743980 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7b6d0018-ccae-40f8-93f8-0df1fa6e8d26 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15bc6381d590409493f487f6cc0a1f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6723a5ba6cb4b88924e0b6fbf9bc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:51.748052 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7b6d0018-ccae-40f8-93f8-0df1fa6e8d26 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] 10.222.0.61 "GET /compute/v2.1/servers/bb5a2211-fd4e-4c45-a75e-5df8bca76a2a" status: 200 len: 1277 microversion: 2.47 time: 0.367226 Aug 31 16:10:51.748867 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1633/3306] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:10:51 2022] GET /compute/v2.1/servers/bb5a2211-fd4e-4c45-a75e-5df8bca76a2a => generated 1277 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:10:52.231201 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e98c807c-24f6-4259-9d21-17d33c9b8230 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:52.232133 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e98c807c-24f6-4259-9d21-17d33c9b8230 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] [instance: c7ae279f-9e24-4755-a912-6bec59837e6c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:52.251693 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e98c807c-24f6-4259-9d21-17d33c9b8230 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:52.252526 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e98c807c-24f6-4259-9d21-17d33c9b8230 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:52.253339 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e98c807c-24f6-4259-9d21-17d33c9b8230 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:52.254297 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e98c807c-24f6-4259-9d21-17d33c9b8230 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:52.255132 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e98c807c-24f6-4259-9d21-17d33c9b8230 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:52.255857 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e98c807c-24f6-4259-9d21-17d33c9b8230 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:52.337676 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b4ac5681-ab3b-4413-ac7a-76036a2743db tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b93395d63a4db895ff224a311940e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf281e8857247c6b9e60d4216741f89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:52.352741 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b4ac5681-ab3b-4413-ac7a-76036a2743db tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] 10.222.0.61 "GET /compute/v2.1/servers/c393928f-2414-4093-9d72-93a21fc6c460" status: 200 len: 1518 microversion: 2.1 time: 1.143449 Aug 31 16:10:52.369882 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1674/3307] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:51 2022] GET /compute/v2.1/servers/c393928f-2414-4093-9d72-93a21fc6c460 => generated 1518 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:52.385335 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-27a066e5-9554-47e7-829b-14eb1e288962 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:52.385969 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-27a066e5-9554-47e7-829b-14eb1e288962 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] [instance: fa0932e8-1aa4-4d1a-b653-14be35568f3d] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:52.398299 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-27a066e5-9554-47e7-829b-14eb1e288962 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:52.399744 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-27a066e5-9554-47e7-829b-14eb1e288962 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:52.400539 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-27a066e5-9554-47e7-829b-14eb1e288962 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:52.401847 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-27a066e5-9554-47e7-829b-14eb1e288962 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:52.402589 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-27a066e5-9554-47e7-829b-14eb1e288962 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:52.403374 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-27a066e5-9554-47e7-829b-14eb1e288962 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:52.444612 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e98c807c-24f6-4259-9d21-17d33c9b8230 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13cabcaa79043bea338128594a6b00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab7f0d889224cefbca55343f3208a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:52.455616 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e98c807c-24f6-4259-9d21-17d33c9b8230 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] 10.222.0.61 "GET /compute/v2.1/servers/c7ae279f-9e24-4755-a912-6bec59837e6c" status: 200 len: 1281 microversion: 2.1 time: 0.228145 Aug 31 16:10:52.456925 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1634/3308] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:52 2022] GET /compute/v2.1/servers/c7ae279f-9e24-4755-a912-6bec59837e6c => generated 1281 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:52.790796 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d2e109fb-ea66-4216-9cb2-5e62af9ebb41 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:52.792799 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d2e109fb-ea66-4216-9cb2-5e62af9ebb41 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] [instance: bb5a2211-fd4e-4c45-a75e-5df8bca76a2a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:52.806773 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d2e109fb-ea66-4216-9cb2-5e62af9ebb41 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:52.808022 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d2e109fb-ea66-4216-9cb2-5e62af9ebb41 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:52.809872 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d2e109fb-ea66-4216-9cb2-5e62af9ebb41 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:52.811405 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d2e109fb-ea66-4216-9cb2-5e62af9ebb41 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:52.812523 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d2e109fb-ea66-4216-9cb2-5e62af9ebb41 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:52.813584 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d2e109fb-ea66-4216-9cb2-5e62af9ebb41 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:53.144927 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d2e109fb-ea66-4216-9cb2-5e62af9ebb41 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15bc6381d590409493f487f6cc0a1f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6723a5ba6cb4b88924e0b6fbf9bc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:53.165473 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d2e109fb-ea66-4216-9cb2-5e62af9ebb41 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15bc6381d590409493f487f6cc0a1f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6723a5ba6cb4b88924e0b6fbf9bc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:53.167409 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d2e109fb-ea66-4216-9cb2-5e62af9ebb41 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15bc6381d590409493f487f6cc0a1f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6723a5ba6cb4b88924e0b6fbf9bc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:53.168735 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d2e109fb-ea66-4216-9cb2-5e62af9ebb41 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] 10.222.0.61 "GET /compute/v2.1/servers/bb5a2211-fd4e-4c45-a75e-5df8bca76a2a" status: 200 len: 1333 microversion: 2.47 time: 0.387803 Aug 31 16:10:53.175056 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1635/3309] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:10:52 2022] GET /compute/v2.1/servers/bb5a2211-fd4e-4c45-a75e-5df8bca76a2a => generated 1333 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:10:53.384447 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b6720d2c-1d42-4fb7-b9ee-225328256bb3 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:53.385411 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b6720d2c-1d42-4fb7-b9ee-225328256bb3 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] [instance: c393928f-2414-4093-9d72-93a21fc6c460] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:53.403957 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b6720d2c-1d42-4fb7-b9ee-225328256bb3 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:53.404393 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b6720d2c-1d42-4fb7-b9ee-225328256bb3 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:53.404848 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b6720d2c-1d42-4fb7-b9ee-225328256bb3 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:53.405563 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b6720d2c-1d42-4fb7-b9ee-225328256bb3 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:53.406186 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b6720d2c-1d42-4fb7-b9ee-225328256bb3 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:53.414621 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b6720d2c-1d42-4fb7-b9ee-225328256bb3 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:53.546217 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-27a066e5-9554-47e7-829b-14eb1e288962 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:53.570066 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-27a066e5-9554-47e7-829b-14eb1e288962 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:53.573558 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-27a066e5-9554-47e7-829b-14eb1e288962 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:53.576108 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-27a066e5-9554-47e7-829b-14eb1e288962 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] 10.222.0.61 "GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d" status: 200 len: 1870 microversion: 2.32 time: 1.195141 Aug 31 16:10:53.590078 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1675/3310] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:10:52 2022] GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d => generated 1870 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:10:53.616263 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ad1e95eb-2cc4-4081-bdf0-de62ea49439b tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:53.617416 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ad1e95eb-2cc4-4081-bdf0-de62ea49439b tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] [instance: c7ae279f-9e24-4755-a912-6bec59837e6c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:53.627388 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ad1e95eb-2cc4-4081-bdf0-de62ea49439b tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:53.629343 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ad1e95eb-2cc4-4081-bdf0-de62ea49439b tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:53.630170 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ad1e95eb-2cc4-4081-bdf0-de62ea49439b tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:53.631287 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ad1e95eb-2cc4-4081-bdf0-de62ea49439b tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:53.632455 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ad1e95eb-2cc4-4081-bdf0-de62ea49439b tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:53.633641 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ad1e95eb-2cc4-4081-bdf0-de62ea49439b tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:53.917142 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ad1e95eb-2cc4-4081-bdf0-de62ea49439b tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13cabcaa79043bea338128594a6b00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab7f0d889224cefbca55343f3208a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:53.928684 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ad1e95eb-2cc4-4081-bdf0-de62ea49439b tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] 10.222.0.61 "GET /compute/v2.1/servers/c7ae279f-9e24-4755-a912-6bec59837e6c" status: 200 len: 1281 microversion: 2.1 time: 0.331929 Aug 31 16:10:53.929741 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1676/3311] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:53 2022] GET /compute/v2.1/servers/c7ae279f-9e24-4755-a912-6bec59837e6c => generated 1281 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:53.935013 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-620dfbfd-5f16-474a-97fe-18f0edbf571e req-b744f3b5-9d16-4c87-bb21-ecfd7f6daa23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c393928f-2414-4093-9d72-93a21fc6c460", "name": "network-vif-unplugged", "status": "completed", "tag": "090b122c-ccba-41fe-89db-ee3852481377"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:10:53.948266 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-620dfbfd-5f16-474a-97fe-18f0edbf571e req-b744f3b5-9d16-4c87-bb21-ecfd7f6daa23 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:53.949084 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-620dfbfd-5f16-474a-97fe-18f0edbf571e req-b744f3b5-9d16-4c87-bb21-ecfd7f6daa23 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:53.949882 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-620dfbfd-5f16-474a-97fe-18f0edbf571e req-b744f3b5-9d16-4c87-bb21-ecfd7f6daa23 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:53.982179 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-620dfbfd-5f16-474a-97fe-18f0edbf571e req-b744f3b5-9d16-4c87-bb21-ecfd7f6daa23 service nova] Creating event network-vif-unplugged:090b122c-ccba-41fe-89db-ee3852481377 for instance c393928f-2414-4093-9d72-93a21fc6c460 on n-h2-850499-9 Aug 31 16:10:53.989504 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-620dfbfd-5f16-474a-97fe-18f0edbf571e req-b744f3b5-9d16-4c87-bb21-ecfd7f6daa23 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057850 Aug 31 16:10:53.993281 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1677/3312] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:10:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:10:54.124594 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b6720d2c-1d42-4fb7-b9ee-225328256bb3 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b93395d63a4db895ff224a311940e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf281e8857247c6b9e60d4216741f89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:54.150191 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b6720d2c-1d42-4fb7-b9ee-225328256bb3 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] 10.222.0.61 "GET /compute/v2.1/servers/c393928f-2414-4093-9d72-93a21fc6c460" status: 200 len: 1518 microversion: 2.1 time: 0.771914 Aug 31 16:10:54.151375 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1636/3313] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:53 2022] GET /compute/v2.1/servers/c393928f-2414-4093-9d72-93a21fc6c460 => generated 1518 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:10:54.206333 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-55656272-b189-45f8-bffb-d8812d6b0ff6 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:54.207661 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-55656272-b189-45f8-bffb-d8812d6b0ff6 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] [instance: bb5a2211-fd4e-4c45-a75e-5df8bca76a2a] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:54.223017 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-55656272-b189-45f8-bffb-d8812d6b0ff6 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:54.223693 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-55656272-b189-45f8-bffb-d8812d6b0ff6 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:54.226573 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-55656272-b189-45f8-bffb-d8812d6b0ff6 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:54.228886 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-55656272-b189-45f8-bffb-d8812d6b0ff6 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:54.237683 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-55656272-b189-45f8-bffb-d8812d6b0ff6 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:54.237683 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-55656272-b189-45f8-bffb-d8812d6b0ff6 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:54.358134 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-62c695e9-6704-4fe2-9d44-eeb4c23522c9 req-907f3706-8d31-4319-80dd-30a0a68043f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c393928f-2414-4093-9d72-93a21fc6c460", "name": "network-vif-deleted", "tag": "090b122c-ccba-41fe-89db-ee3852481377"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:10:54.377652 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-62c695e9-6704-4fe2-9d44-eeb4c23522c9 req-907f3706-8d31-4319-80dd-30a0a68043f2 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:54.378249 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-62c695e9-6704-4fe2-9d44-eeb4c23522c9 req-907f3706-8d31-4319-80dd-30a0a68043f2 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:54.379097 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-62c695e9-6704-4fe2-9d44-eeb4c23522c9 req-907f3706-8d31-4319-80dd-30a0a68043f2 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:54.400875 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-62c695e9-6704-4fe2-9d44-eeb4c23522c9 req-907f3706-8d31-4319-80dd-30a0a68043f2 service nova] Creating event network-vif-deleted:090b122c-ccba-41fe-89db-ee3852481377 for instance c393928f-2414-4093-9d72-93a21fc6c460 on n-h2-850499-9 Aug 31 16:10:54.411740 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-62c695e9-6704-4fe2-9d44-eeb4c23522c9 req-907f3706-8d31-4319-80dd-30a0a68043f2 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058212 Aug 31 16:10:54.414660 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1637/3314] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:10:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:10:54.434242 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-55656272-b189-45f8-bffb-d8812d6b0ff6 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15bc6381d590409493f487f6cc0a1f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6723a5ba6cb4b88924e0b6fbf9bc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:54.444631 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-55656272-b189-45f8-bffb-d8812d6b0ff6 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15bc6381d590409493f487f6cc0a1f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6723a5ba6cb4b88924e0b6fbf9bc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:54.446811 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-55656272-b189-45f8-bffb-d8812d6b0ff6 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15bc6381d590409493f487f6cc0a1f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6723a5ba6cb4b88924e0b6fbf9bc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:54.448517 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-55656272-b189-45f8-bffb-d8812d6b0ff6 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] 10.222.0.61 "GET /compute/v2.1/servers/bb5a2211-fd4e-4c45-a75e-5df8bca76a2a" status: 200 len: 1339 microversion: 2.47 time: 0.254115 Aug 31 16:10:54.451375 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1678/3315] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:10:54 2022] GET /compute/v2.1/servers/bb5a2211-fd4e-4c45-a75e-5df8bca76a2a => generated 1339 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:10:54.619474 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0bcfdb38-12d1-411a-aad1-2a30fca90105 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:54.620189 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0bcfdb38-12d1-411a-aad1-2a30fca90105 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] [instance: fa0932e8-1aa4-4d1a-b653-14be35568f3d] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:54.626502 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0bcfdb38-12d1-411a-aad1-2a30fca90105 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:54.626986 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0bcfdb38-12d1-411a-aad1-2a30fca90105 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:54.627628 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0bcfdb38-12d1-411a-aad1-2a30fca90105 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:54.628620 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0bcfdb38-12d1-411a-aad1-2a30fca90105 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:54.629137 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0bcfdb38-12d1-411a-aad1-2a30fca90105 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:54.629793 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0bcfdb38-12d1-411a-aad1-2a30fca90105 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:54.951727 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3e711be9-27fd-40d3-8a5e-2e9007c76c1d tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:54.952268 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3e711be9-27fd-40d3-8a5e-2e9007c76c1d tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] [instance: 685d47e4-721e-4eae-b5f8-78fdb68454ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:54.961525 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3e711be9-27fd-40d3-8a5e-2e9007c76c1d tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:54.962127 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3e711be9-27fd-40d3-8a5e-2e9007c76c1d tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:54.962660 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3e711be9-27fd-40d3-8a5e-2e9007c76c1d tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:54.963465 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3e711be9-27fd-40d3-8a5e-2e9007c76c1d tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:54.964011 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3e711be9-27fd-40d3-8a5e-2e9007c76c1d tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:54.964506 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3e711be9-27fd-40d3-8a5e-2e9007c76c1d tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:55.008988 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3e711be9-27fd-40d3-8a5e-2e9007c76c1d tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] [instance: 685d47e4-721e-4eae-b5f8-78fdb68454ae] Going to try to terminate instance {{(pid=122256) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:10:55.048845 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=100 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:10:55.132444 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3e711be9-27fd-40d3-8a5e-2e9007c76c1d tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] 10.222.0.61 "DELETE /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae" status: 204 len: 0 microversion: 2.42 time: 0.342649 Aug 31 16:10:55.133607 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1679/3316] 10.222.0.61 () {60 vars in 1280 bytes} [Wed Aug 31 16:10:54 2022] DELETE /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 16:10:55.139481 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-81862067-5ec0-453d-9473-f08d8b444243 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:55.140585 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-81862067-5ec0-453d-9473-f08d8b444243 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] [instance: c7ae279f-9e24-4755-a912-6bec59837e6c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:55.148645 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-81862067-5ec0-453d-9473-f08d8b444243 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:55.149390 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-81862067-5ec0-453d-9473-f08d8b444243 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:55.150610 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-81862067-5ec0-453d-9473-f08d8b444243 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:55.151578 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-81862067-5ec0-453d-9473-f08d8b444243 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:55.152182 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-81862067-5ec0-453d-9473-f08d8b444243 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:55.152766 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-81862067-5ec0-453d-9473-f08d8b444243 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:55.316504 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-81862067-5ec0-453d-9473-f08d8b444243 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13cabcaa79043bea338128594a6b00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab7f0d889224cefbca55343f3208a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:55.327076 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-81862067-5ec0-453d-9473-f08d8b444243 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] 10.222.0.61 "GET /compute/v2.1/servers/c7ae279f-9e24-4755-a912-6bec59837e6c" status: 200 len: 1281 microversion: 2.1 time: 0.191650 Aug 31 16:10:55.332706 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1680/3317] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:55 2022] GET /compute/v2.1/servers/c7ae279f-9e24-4755-a912-6bec59837e6c => generated 1281 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:55.334644 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-86236d44-9c39-439e-910a-7b3cf238c454 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:55.335534 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-86236d44-9c39-439e-910a-7b3cf238c454 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] [instance: 685d47e4-721e-4eae-b5f8-78fdb68454ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:55.345446 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-86236d44-9c39-439e-910a-7b3cf238c454 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:55.345941 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-86236d44-9c39-439e-910a-7b3cf238c454 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:55.346520 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-86236d44-9c39-439e-910a-7b3cf238c454 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:55.347226 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-86236d44-9c39-439e-910a-7b3cf238c454 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:55.347715 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-86236d44-9c39-439e-910a-7b3cf238c454 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:55.348193 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-86236d44-9c39-439e-910a-7b3cf238c454 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:55.385290 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0bcfdb38-12d1-411a-aad1-2a30fca90105 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:55.397515 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0bcfdb38-12d1-411a-aad1-2a30fca90105 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:55.399716 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0bcfdb38-12d1-411a-aad1-2a30fca90105 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:55.401148 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0bcfdb38-12d1-411a-aad1-2a30fca90105 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] 10.222.0.61 "GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d" status: 200 len: 1891 microversion: 2.32 time: 0.786290 Aug 31 16:10:55.401726 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1638/3318] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:10:54 2022] GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d => generated 1891 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:10:55.407432 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-cc50395b-2bca-4791-b1d3-949ae89bae22 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:55.408335 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-cc50395b-2bca-4791-b1d3-949ae89bae22 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] [instance: c393928f-2414-4093-9d72-93a21fc6c460] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:55.417190 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cc50395b-2bca-4791-b1d3-949ae89bae22 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:55.418126 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cc50395b-2bca-4791-b1d3-949ae89bae22 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:55.418775 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cc50395b-2bca-4791-b1d3-949ae89bae22 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:55.419720 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cc50395b-2bca-4791-b1d3-949ae89bae22 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:55.420454 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cc50395b-2bca-4791-b1d3-949ae89bae22 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:55.421207 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cc50395b-2bca-4791-b1d3-949ae89bae22 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:55.564576 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-cc50395b-2bca-4791-b1d3-949ae89bae22 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b93395d63a4db895ff224a311940e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf281e8857247c6b9e60d4216741f89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:55.574844 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-cc50395b-2bca-4791-b1d3-949ae89bae22 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] 10.222.0.61 "GET /compute/v2.1/servers/c393928f-2414-4093-9d72-93a21fc6c460" status: 200 len: 1476 microversion: 2.1 time: 0.171901 Aug 31 16:10:55.575452 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1639/3319] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:55 2022] GET /compute/v2.1/servers/c393928f-2414-4093-9d72-93a21fc6c460 => generated 1476 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:55.580672 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-cea64988-0ee9-48ab-889d-af264bf86954 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:55.581506 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-cea64988-0ee9-48ab-889d-af264bf86954 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] [instance: bb5a2211-fd4e-4c45-a75e-5df8bca76a2a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:55.588415 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cea64988-0ee9-48ab-889d-af264bf86954 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:55.589135 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cea64988-0ee9-48ab-889d-af264bf86954 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:55.589914 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cea64988-0ee9-48ab-889d-af264bf86954 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:55.590845 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cea64988-0ee9-48ab-889d-af264bf86954 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:55.591312 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cea64988-0ee9-48ab-889d-af264bf86954 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:55.591776 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cea64988-0ee9-48ab-889d-af264bf86954 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:55.783403 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-cea64988-0ee9-48ab-889d-af264bf86954 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15bc6381d590409493f487f6cc0a1f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6723a5ba6cb4b88924e0b6fbf9bc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:55.794377 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-cea64988-0ee9-48ab-889d-af264bf86954 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15bc6381d590409493f487f6cc0a1f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6723a5ba6cb4b88924e0b6fbf9bc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:55.801123 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-cea64988-0ee9-48ab-889d-af264bf86954 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15bc6381d590409493f487f6cc0a1f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6723a5ba6cb4b88924e0b6fbf9bc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:55.803190 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-cea64988-0ee9-48ab-889d-af264bf86954 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] 10.222.0.61 "GET /compute/v2.1/servers/bb5a2211-fd4e-4c45-a75e-5df8bca76a2a" status: 200 len: 1339 microversion: 2.47 time: 0.226377 Aug 31 16:10:55.823684 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1640/3320] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:10:55 2022] GET /compute/v2.1/servers/bb5a2211-fd4e-4c45-a75e-5df8bca76a2a => generated 1339 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:10:55.937526 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-86236d44-9c39-439e-910a-7b3cf238c454 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:55.950671 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-86236d44-9c39-439e-910a-7b3cf238c454 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:55.952600 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-86236d44-9c39-439e-910a-7b3cf238c454 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:55.954945 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-86236d44-9c39-439e-910a-7b3cf238c454 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] 10.222.0.61 "GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae" status: 200 len: 2961 microversion: 2.42 time: 0.625697 Aug 31 16:10:55.956222 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1681/3321] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:10:55 2022] GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae => generated 2961 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:10:56.350190 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c80afa99-3102-418c-8d54-fd99535d09c9 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:56.351719 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c80afa99-3102-418c-8d54-fd99535d09c9 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] [instance: c7ae279f-9e24-4755-a912-6bec59837e6c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:56.365802 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c80afa99-3102-418c-8d54-fd99535d09c9 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:56.367174 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c80afa99-3102-418c-8d54-fd99535d09c9 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:56.368080 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c80afa99-3102-418c-8d54-fd99535d09c9 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:56.368859 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c80afa99-3102-418c-8d54-fd99535d09c9 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:56.369606 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c80afa99-3102-418c-8d54-fd99535d09c9 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:56.370318 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c80afa99-3102-418c-8d54-fd99535d09c9 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:56.438739 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-e7eb2feb-fa56-4332-ac3d-c6b381729538 req-50d33422-3b8f-423c-93e8-7ac1c4e46856 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa0932e8-1aa4-4d1a-b653-14be35568f3d", "tag": "fd6970db-5a6c-4005-91a0-c09d46e9fd47"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:10:56.476388 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-e7eb2feb-fa56-4332-ac3d-c6b381729538 req-50d33422-3b8f-423c-93e8-7ac1c4e46856 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:56.476616 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-e7eb2feb-fa56-4332-ac3d-c6b381729538 req-50d33422-3b8f-423c-93e8-7ac1c4e46856 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:56.477151 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-e7eb2feb-fa56-4332-ac3d-c6b381729538 req-50d33422-3b8f-423c-93e8-7ac1c4e46856 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:56.492242 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-e7eb2feb-fa56-4332-ac3d-c6b381729538 req-50d33422-3b8f-423c-93e8-7ac1c4e46856 service nova] Creating event network-changed:fd6970db-5a6c-4005-91a0-c09d46e9fd47 for instance fa0932e8-1aa4-4d1a-b653-14be35568f3d on n-h2-850499-9 Aug 31 16:10:56.498272 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-e7eb2feb-fa56-4332-ac3d-c6b381729538 req-50d33422-3b8f-423c-93e8-7ac1c4e46856 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067355 Aug 31 16:10:56.500743 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1682/3322] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:10:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:10:56.512734 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5739b457-bf32-4d29-a0ca-6dde01ffd552 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:56.513576 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5739b457-bf32-4d29-a0ca-6dde01ffd552 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] [instance: fa0932e8-1aa4-4d1a-b653-14be35568f3d] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:56.521708 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5739b457-bf32-4d29-a0ca-6dde01ffd552 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:56.522415 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5739b457-bf32-4d29-a0ca-6dde01ffd552 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:56.522866 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5739b457-bf32-4d29-a0ca-6dde01ffd552 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:56.523986 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5739b457-bf32-4d29-a0ca-6dde01ffd552 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:56.524509 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5739b457-bf32-4d29-a0ca-6dde01ffd552 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:56.525127 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5739b457-bf32-4d29-a0ca-6dde01ffd552 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:56.608662 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c80afa99-3102-418c-8d54-fd99535d09c9 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13cabcaa79043bea338128594a6b00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab7f0d889224cefbca55343f3208a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:56.619600 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c80afa99-3102-418c-8d54-fd99535d09c9 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] 10.222.0.61 "GET /compute/v2.1/servers/c7ae279f-9e24-4755-a912-6bec59837e6c" status: 200 len: 1323 microversion: 2.1 time: 0.274040 Aug 31 16:10:56.620431 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1641/3323] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:56 2022] GET /compute/v2.1/servers/c7ae279f-9e24-4755-a912-6bec59837e6c => generated 1323 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:10:56.700191 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ab01db39-b4ec-4846-9317-573610c36195 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-619544025", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "networks": [{"uuid": "e418f255-318f-476c-a353-8d292b5f7798"}]}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:10:56.781204 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5739b457-bf32-4d29-a0ca-6dde01ffd552 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:56.792025 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-ab01db39-b4ec-4846-9317-573610c36195 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] validate_networks() for [('e418f255-318f-476c-a353-8d292b5f7798', None, None, None, None, None)] {{(pid=122257) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:10:56.810646 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5739b457-bf32-4d29-a0ca-6dde01ffd552 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:56.812338 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5739b457-bf32-4d29-a0ca-6dde01ffd552 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:56.813712 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5739b457-bf32-4d29-a0ca-6dde01ffd552 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] 10.222.0.61 "GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d" status: 200 len: 1891 microversion: 2.32 time: 0.311520 Aug 31 16:10:56.814456 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1683/3324] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:10:56 2022] GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d => generated 1891 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:10:56.819973 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6306f0ba-9b0f-4cf5-bc5e-dcbde61ecffa tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:56.821179 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6306f0ba-9b0f-4cf5-bc5e-dcbde61ecffa tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] [instance: c393928f-2414-4093-9d72-93a21fc6c460] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:56.833455 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6306f0ba-9b0f-4cf5-bc5e-dcbde61ecffa tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:56.834124 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6306f0ba-9b0f-4cf5-bc5e-dcbde61ecffa tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:56.835195 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6306f0ba-9b0f-4cf5-bc5e-dcbde61ecffa tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:56.836162 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6306f0ba-9b0f-4cf5-bc5e-dcbde61ecffa tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:56.836870 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6306f0ba-9b0f-4cf5-bc5e-dcbde61ecffa tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:56.837423 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6306f0ba-9b0f-4cf5-bc5e-dcbde61ecffa tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:56.916066 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-6306f0ba-9b0f-4cf5-bc5e-dcbde61ecffa tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b93395d63a4db895ff224a311940e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf281e8857247c6b9e60d4216741f89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:56.925073 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6306f0ba-9b0f-4cf5-bc5e-dcbde61ecffa tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] 10.222.0.61 "GET /compute/v2.1/servers/c393928f-2414-4093-9d72-93a21fc6c460" status: 200 len: 1476 microversion: 2.1 time: 0.109179 Aug 31 16:10:56.926092 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1684/3325] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:56 2022] GET /compute/v2.1/servers/c393928f-2414-4093-9d72-93a21fc6c460 => generated 1476 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:56.931333 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1f5df2b6-96b2-4176-9dff-3eab647e0ecf tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:56.931999 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1f5df2b6-96b2-4176-9dff-3eab647e0ecf tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] [instance: bb5a2211-fd4e-4c45-a75e-5df8bca76a2a] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:56.944524 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1f5df2b6-96b2-4176-9dff-3eab647e0ecf tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:56.946521 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1f5df2b6-96b2-4176-9dff-3eab647e0ecf tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:56.947335 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1f5df2b6-96b2-4176-9dff-3eab647e0ecf tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:56.948326 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1f5df2b6-96b2-4176-9dff-3eab647e0ecf tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:56.948899 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1f5df2b6-96b2-4176-9dff-3eab647e0ecf tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:56.949333 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1f5df2b6-96b2-4176-9dff-3eab647e0ecf tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:57.072349 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1f5df2b6-96b2-4176-9dff-3eab647e0ecf tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15bc6381d590409493f487f6cc0a1f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6723a5ba6cb4b88924e0b6fbf9bc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:57.084215 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1f5df2b6-96b2-4176-9dff-3eab647e0ecf tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15bc6381d590409493f487f6cc0a1f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6723a5ba6cb4b88924e0b6fbf9bc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:57.087549 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1f5df2b6-96b2-4176-9dff-3eab647e0ecf tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15bc6381d590409493f487f6cc0a1f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6723a5ba6cb4b88924e0b6fbf9bc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:57.089088 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1f5df2b6-96b2-4176-9dff-3eab647e0ecf tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] 10.222.0.61 "GET /compute/v2.1/servers/bb5a2211-fd4e-4c45-a75e-5df8bca76a2a" status: 200 len: 1339 microversion: 2.47 time: 0.161932 Aug 31 16:10:57.090096 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1685/3326] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:10:56 2022] GET /compute/v2.1/servers/bb5a2211-fd4e-4c45-a75e-5df8bca76a2a => generated 1339 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:10:57.095408 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8555ca9d-99e8-46be-9043-ed4579e25780 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:57.096255 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8555ca9d-99e8-46be-9043-ed4579e25780 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] [instance: 685d47e4-721e-4eae-b5f8-78fdb68454ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:57.103670 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8555ca9d-99e8-46be-9043-ed4579e25780 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:57.104099 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8555ca9d-99e8-46be-9043-ed4579e25780 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:57.104547 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8555ca9d-99e8-46be-9043-ed4579e25780 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:57.105398 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8555ca9d-99e8-46be-9043-ed4579e25780 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:57.106136 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8555ca9d-99e8-46be-9043-ed4579e25780 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:57.106867 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8555ca9d-99e8-46be-9043-ed4579e25780 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:57.434575 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-ab01db39-b4ec-4846-9317-573610c36195 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:10:57.436283 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-ab01db39-b4ec-4846-9317-573610c36195 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:10:57.437550 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-ab01db39-b4ec-4846-9317-573610c36195 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:10:57.438086 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8555ca9d-99e8-46be-9043-ed4579e25780 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:57.438736 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-ab01db39-b4ec-4846-9317-573610c36195 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:10:57.439857 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-ab01db39-b4ec-4846-9317-573610c36195 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:10:57.450184 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8555ca9d-99e8-46be-9043-ed4579e25780 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:57.452359 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8555ca9d-99e8-46be-9043-ed4579e25780 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:57.453764 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8555ca9d-99e8-46be-9043-ed4579e25780 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] 10.222.0.61 "GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae" status: 200 len: 2961 microversion: 2.42 time: 0.362643 Aug 31 16:10:57.456119 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1686/3327] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:10:57 2022] GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae => generated 2961 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:10:57.456920 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ab01db39-b4ec-4846-9317-573610c36195 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:57.457418 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ab01db39-b4ec-4846-9317-573610c36195 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:57.457861 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ab01db39-b4ec-4846-9317-573610c36195 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:57.458615 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ab01db39-b4ec-4846-9317-573610c36195 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:57.459072 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ab01db39-b4ec-4846-9317-573610c36195 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:57.459490 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ab01db39-b4ec-4846-9317-573610c36195 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:57.480113 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-ab01db39-b4ec-4846-9317-573610c36195 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Getting quotas for project 5299955053c842b6aa02e058f4b1c0cb. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:10:57.489493 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-ab01db39-b4ec-4846-9317-573610c36195 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Getting quotas for user 6e707652819c497bbdf94f85f39c447a and project 5299955053c842b6aa02e058f4b1c0cb. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:10:57.514051 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ab01db39-b4ec-4846-9317-573610c36195 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Going to run 1 instances... {{(pid=122257) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:10:57.517604 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ab01db39-b4ec-4846-9317-573610c36195 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 3de9f9a4-15c5-4bd9-a187-07d36cf9fb03] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:10:57.571160 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ab01db39-b4ec-4846-9317-573610c36195 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.949281 Aug 31 16:10:57.571938 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1642/3328] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:10:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 951 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:10:57.586600 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a58814bd-b0de-4bdc-ba35-925d92b9edf1 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:57.587225 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a58814bd-b0de-4bdc-ba35-925d92b9edf1 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 3de9f9a4-15c5-4bd9-a187-07d36cf9fb03] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:57.643182 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ab3f0f9c-8fae-49bd-a17c-8eb7ad7dce18 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:57.648270 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ab3f0f9c-8fae-49bd-a17c-8eb7ad7dce18 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] [instance: c7ae279f-9e24-4755-a912-6bec59837e6c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:57.667308 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ab3f0f9c-8fae-49bd-a17c-8eb7ad7dce18 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:57.668532 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ab3f0f9c-8fae-49bd-a17c-8eb7ad7dce18 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:57.669265 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ab3f0f9c-8fae-49bd-a17c-8eb7ad7dce18 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:57.670567 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ab3f0f9c-8fae-49bd-a17c-8eb7ad7dce18 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:57.671538 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ab3f0f9c-8fae-49bd-a17c-8eb7ad7dce18 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:57.672047 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ab3f0f9c-8fae-49bd-a17c-8eb7ad7dce18 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:57.709265 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a58814bd-b0de-4bdc-ba35-925d92b9edf1 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:57.723232 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a58814bd-b0de-4bdc-ba35-925d92b9edf1 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/3de9f9a4-15c5-4bd9-a187-07d36cf9fb03" status: 200 len: 1192 microversion: 2.1 time: 0.140767 Aug 31 16:10:57.725962 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1687/3329] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:57 2022] GET /compute/v2.1/servers/3de9f9a4-15c5-4bd9-a187-07d36cf9fb03 => generated 1192 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:57.841452 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1e82d7a3-dc1e-427a-b37a-5650a5db63e2 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:57.843412 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1e82d7a3-dc1e-427a-b37a-5650a5db63e2 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] [instance: fa0932e8-1aa4-4d1a-b653-14be35568f3d] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:57.858124 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ab3f0f9c-8fae-49bd-a17c-8eb7ad7dce18 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13cabcaa79043bea338128594a6b00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab7f0d889224cefbca55343f3208a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:57.860699 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1e82d7a3-dc1e-427a-b37a-5650a5db63e2 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:57.861309 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1e82d7a3-dc1e-427a-b37a-5650a5db63e2 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:57.861763 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1e82d7a3-dc1e-427a-b37a-5650a5db63e2 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:57.862919 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1e82d7a3-dc1e-427a-b37a-5650a5db63e2 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:57.863464 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1e82d7a3-dc1e-427a-b37a-5650a5db63e2 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:57.864045 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1e82d7a3-dc1e-427a-b37a-5650a5db63e2 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:57.868941 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ab3f0f9c-8fae-49bd-a17c-8eb7ad7dce18 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] 10.222.0.61 "GET /compute/v2.1/servers/c7ae279f-9e24-4755-a912-6bec59837e6c" status: 200 len: 1323 microversion: 2.1 time: 0.229593 Aug 31 16:10:57.882383 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1643/3330] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:57 2022] GET /compute/v2.1/servers/c7ae279f-9e24-4755-a912-6bec59837e6c => generated 1323 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:57.948025 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6381eb35-777d-45e6-aa50-ac9fae875aa2 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:57.948892 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6381eb35-777d-45e6-aa50-ac9fae875aa2 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] [instance: c393928f-2414-4093-9d72-93a21fc6c460] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:57.956120 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6381eb35-777d-45e6-aa50-ac9fae875aa2 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:57.956961 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6381eb35-777d-45e6-aa50-ac9fae875aa2 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:57.957825 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6381eb35-777d-45e6-aa50-ac9fae875aa2 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:57.959176 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6381eb35-777d-45e6-aa50-ac9fae875aa2 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:57.961449 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6381eb35-777d-45e6-aa50-ac9fae875aa2 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:57.962180 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6381eb35-777d-45e6-aa50-ac9fae875aa2 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:58.080819 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-6381eb35-777d-45e6-aa50-ac9fae875aa2 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b93395d63a4db895ff224a311940e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf281e8857247c6b9e60d4216741f89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:58.091138 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6381eb35-777d-45e6-aa50-ac9fae875aa2 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] 10.222.0.61 "GET /compute/v2.1/servers/c393928f-2414-4093-9d72-93a21fc6c460" status: 200 len: 1476 microversion: 2.1 time: 0.148076 Aug 31 16:10:58.092566 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1644/3331] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:57 2022] GET /compute/v2.1/servers/c393928f-2414-4093-9d72-93a21fc6c460 => generated 1476 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:58.122115 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-78f6634f-42b3-40e6-9b98-8b8663434ef8 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:58.122753 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-78f6634f-42b3-40e6-9b98-8b8663434ef8 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] [instance: bb5a2211-fd4e-4c45-a75e-5df8bca76a2a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:58.134018 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-78f6634f-42b3-40e6-9b98-8b8663434ef8 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:58.134750 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-78f6634f-42b3-40e6-9b98-8b8663434ef8 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:58.135263 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-78f6634f-42b3-40e6-9b98-8b8663434ef8 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:58.136364 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-78f6634f-42b3-40e6-9b98-8b8663434ef8 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:58.136918 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-78f6634f-42b3-40e6-9b98-8b8663434ef8 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:58.137366 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-78f6634f-42b3-40e6-9b98-8b8663434ef8 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:58.137922 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1e82d7a3-dc1e-427a-b37a-5650a5db63e2 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:58.149645 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1e82d7a3-dc1e-427a-b37a-5650a5db63e2 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:58.152670 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1e82d7a3-dc1e-427a-b37a-5650a5db63e2 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:58.154088 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1e82d7a3-dc1e-427a-b37a-5650a5db63e2 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] 10.222.0.61 "GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d" status: 200 len: 1891 microversion: 2.32 time: 0.317059 Aug 31 16:10:58.155157 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1688/3332] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:10:57 2022] GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d => generated 1891 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:10:58.216452 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-78f6634f-42b3-40e6-9b98-8b8663434ef8 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15bc6381d590409493f487f6cc0a1f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6723a5ba6cb4b88924e0b6fbf9bc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:58.221535 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:10:58.229958 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-78f6634f-42b3-40e6-9b98-8b8663434ef8 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15bc6381d590409493f487f6cc0a1f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6723a5ba6cb4b88924e0b6fbf9bc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:58.231792 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-78f6634f-42b3-40e6-9b98-8b8663434ef8 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15bc6381d590409493f487f6cc0a1f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6723a5ba6cb4b88924e0b6fbf9bc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:58.232947 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-78f6634f-42b3-40e6-9b98-8b8663434ef8 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] 10.222.0.61 "GET /compute/v2.1/servers/bb5a2211-fd4e-4c45-a75e-5df8bca76a2a" status: 200 len: 1339 microversion: 2.47 time: 0.118029 Aug 31 16:10:58.233612 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1645/3333] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:10:58 2022] GET /compute/v2.1/servers/bb5a2211-fd4e-4c45-a75e-5df8bca76a2a => generated 1339 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:10:58.484217 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-64d05d7c-639c-4fc8-b6e6-f4d8a22bdb78 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:58.484957 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-64d05d7c-639c-4fc8-b6e6-f4d8a22bdb78 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] [instance: 685d47e4-721e-4eae-b5f8-78fdb68454ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:58.491862 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-64d05d7c-639c-4fc8-b6e6-f4d8a22bdb78 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:58.492513 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-64d05d7c-639c-4fc8-b6e6-f4d8a22bdb78 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:58.493086 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-64d05d7c-639c-4fc8-b6e6-f4d8a22bdb78 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:58.493890 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-64d05d7c-639c-4fc8-b6e6-f4d8a22bdb78 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:58.494380 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-64d05d7c-639c-4fc8-b6e6-f4d8a22bdb78 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:58.494803 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-64d05d7c-639c-4fc8-b6e6-f4d8a22bdb78 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:58.723200 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-64d05d7c-639c-4fc8-b6e6-f4d8a22bdb78 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:58.734275 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-64d05d7c-639c-4fc8-b6e6-f4d8a22bdb78 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:58.735910 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-64d05d7c-639c-4fc8-b6e6-f4d8a22bdb78 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:58.737188 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-64d05d7c-639c-4fc8-b6e6-f4d8a22bdb78 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] 10.222.0.61 "GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae" status: 200 len: 2961 microversion: 2.42 time: 0.257757 Aug 31 16:10:58.737752 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1689/3334] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:10:58 2022] GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae => generated 2961 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:10:58.750616 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b4b6fe3f-5308-41da-b7e7-8f06fae20775 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:58.752320 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b4b6fe3f-5308-41da-b7e7-8f06fae20775 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 3de9f9a4-15c5-4bd9-a187-07d36cf9fb03] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:58.765189 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b4b6fe3f-5308-41da-b7e7-8f06fae20775 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:58.766075 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b4b6fe3f-5308-41da-b7e7-8f06fae20775 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:58.766499 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b4b6fe3f-5308-41da-b7e7-8f06fae20775 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:58.767655 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b4b6fe3f-5308-41da-b7e7-8f06fae20775 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:58.768552 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b4b6fe3f-5308-41da-b7e7-8f06fae20775 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:58.769195 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b4b6fe3f-5308-41da-b7e7-8f06fae20775 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:58.855869 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b4b6fe3f-5308-41da-b7e7-8f06fae20775 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:58.865048 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b4b6fe3f-5308-41da-b7e7-8f06fae20775 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/3de9f9a4-15c5-4bd9-a187-07d36cf9fb03" status: 200 len: 1244 microversion: 2.1 time: 0.121496 Aug 31 16:10:58.865854 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1646/3335] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:58 2022] GET /compute/v2.1/servers/3de9f9a4-15c5-4bd9-a187-07d36cf9fb03 => generated 1244 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:58.894775 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a28842ce-fd4b-41c7-a5f0-19fa0f64bc21 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:58.895756 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a28842ce-fd4b-41c7-a5f0-19fa0f64bc21 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] [instance: c7ae279f-9e24-4755-a912-6bec59837e6c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:58.905031 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a28842ce-fd4b-41c7-a5f0-19fa0f64bc21 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:58.905778 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a28842ce-fd4b-41c7-a5f0-19fa0f64bc21 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:58.906425 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a28842ce-fd4b-41c7-a5f0-19fa0f64bc21 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:58.907331 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a28842ce-fd4b-41c7-a5f0-19fa0f64bc21 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:58.908006 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a28842ce-fd4b-41c7-a5f0-19fa0f64bc21 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:58.908607 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a28842ce-fd4b-41c7-a5f0-19fa0f64bc21 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:59.119841 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4dcf6165-3a85-4424-90e6-909860d3404a tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:59.120523 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4dcf6165-3a85-4424-90e6-909860d3404a tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] [instance: c393928f-2414-4093-9d72-93a21fc6c460] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:59.150264 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4dcf6165-3a85-4424-90e6-909860d3404a tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:59.154428 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4dcf6165-3a85-4424-90e6-909860d3404a tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:59.157080 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4dcf6165-3a85-4424-90e6-909860d3404a tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:59.164423 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4dcf6165-3a85-4424-90e6-909860d3404a tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:59.165891 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4dcf6165-3a85-4424-90e6-909860d3404a tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:59.167563 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4dcf6165-3a85-4424-90e6-909860d3404a tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:59.170070 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a28842ce-fd4b-41c7-a5f0-19fa0f64bc21 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13cabcaa79043bea338128594a6b00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab7f0d889224cefbca55343f3208a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:59.187139 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a28842ce-fd4b-41c7-a5f0-19fa0f64bc21 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] 10.222.0.61 "GET /compute/v2.1/servers/c7ae279f-9e24-4755-a912-6bec59837e6c" status: 200 len: 1323 microversion: 2.1 time: 0.293279 Aug 31 16:10:59.189289 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1690/3336] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:58 2022] GET /compute/v2.1/servers/c7ae279f-9e24-4755-a912-6bec59837e6c => generated 1323 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:59.196097 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b105c207-ac09-4991-987a-48e4f3e4dddd tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:59.197155 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b105c207-ac09-4991-987a-48e4f3e4dddd tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] [instance: fa0932e8-1aa4-4d1a-b653-14be35568f3d] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:59.228453 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b105c207-ac09-4991-987a-48e4f3e4dddd tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:59.231083 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b105c207-ac09-4991-987a-48e4f3e4dddd tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:59.231602 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b105c207-ac09-4991-987a-48e4f3e4dddd tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:59.232390 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b105c207-ac09-4991-987a-48e4f3e4dddd tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:59.235055 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b105c207-ac09-4991-987a-48e4f3e4dddd tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:59.235566 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b105c207-ac09-4991-987a-48e4f3e4dddd tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:59.317625 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-4dcf6165-3a85-4424-90e6-909860d3404a tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b93395d63a4db895ff224a311940e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf281e8857247c6b9e60d4216741f89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:59.340711 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4dcf6165-3a85-4424-90e6-909860d3404a tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] 10.222.0.61 "GET /compute/v2.1/servers/c393928f-2414-4093-9d72-93a21fc6c460" status: 200 len: 1476 microversion: 2.1 time: 0.228119 Aug 31 16:10:59.353042 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1647/3337] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:59 2022] GET /compute/v2.1/servers/c393928f-2414-4093-9d72-93a21fc6c460 => generated 1476 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:10:59.358518 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5f15c632-64f7-4927-869f-6e39a9c045b3 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:59.359551 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5f15c632-64f7-4927-869f-6e39a9c045b3 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] [instance: bb5a2211-fd4e-4c45-a75e-5df8bca76a2a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:59.377892 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5f15c632-64f7-4927-869f-6e39a9c045b3 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:59.379098 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5f15c632-64f7-4927-869f-6e39a9c045b3 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:59.386645 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5f15c632-64f7-4927-869f-6e39a9c045b3 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:59.394074 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5f15c632-64f7-4927-869f-6e39a9c045b3 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:59.394577 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5f15c632-64f7-4927-869f-6e39a9c045b3 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:59.397746 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5f15c632-64f7-4927-869f-6e39a9c045b3 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:59.542274 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5f15c632-64f7-4927-869f-6e39a9c045b3 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15bc6381d590409493f487f6cc0a1f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6723a5ba6cb4b88924e0b6fbf9bc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:59.557398 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5f15c632-64f7-4927-869f-6e39a9c045b3 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15bc6381d590409493f487f6cc0a1f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6723a5ba6cb4b88924e0b6fbf9bc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:59.559927 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5f15c632-64f7-4927-869f-6e39a9c045b3 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15bc6381d590409493f487f6cc0a1f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6723a5ba6cb4b88924e0b6fbf9bc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:59.561468 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5f15c632-64f7-4927-869f-6e39a9c045b3 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] 10.222.0.61 "GET /compute/v2.1/servers/bb5a2211-fd4e-4c45-a75e-5df8bca76a2a" status: 200 len: 1339 microversion: 2.47 time: 0.207229 Aug 31 16:10:59.562920 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1648/3338] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:10:59 2022] GET /compute/v2.1/servers/bb5a2211-fd4e-4c45-a75e-5df8bca76a2a => generated 1339 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:10:59.615699 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b105c207-ac09-4991-987a-48e4f3e4dddd tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:59.626906 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b105c207-ac09-4991-987a-48e4f3e4dddd tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:59.628609 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b105c207-ac09-4991-987a-48e4f3e4dddd tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:59.629912 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b105c207-ac09-4991-987a-48e4f3e4dddd tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] 10.222.0.61 "GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d" status: 200 len: 1891 microversion: 2.32 time: 0.439574 Aug 31 16:10:59.630641 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1691/3339] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:10:59 2022] GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d => generated 1891 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:10:59.773010 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7f6128a8-8e53-455a-b4b8-cd370286db8f tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:59.774421 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7f6128a8-8e53-455a-b4b8-cd370286db8f tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] [instance: 685d47e4-721e-4eae-b5f8-78fdb68454ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:59.800720 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7f6128a8-8e53-455a-b4b8-cd370286db8f tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:59.801724 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7f6128a8-8e53-455a-b4b8-cd370286db8f tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:59.802433 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7f6128a8-8e53-455a-b4b8-cd370286db8f tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:59.803462 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7f6128a8-8e53-455a-b4b8-cd370286db8f tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:59.804889 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7f6128a8-8e53-455a-b4b8-cd370286db8f tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:59.805571 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7f6128a8-8e53-455a-b4b8-cd370286db8f tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:59.889312 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-861ce199-e1a1-48ff-b282-e55260534a0f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:59.890569 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-861ce199-e1a1-48ff-b282-e55260534a0f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 3de9f9a4-15c5-4bd9-a187-07d36cf9fb03] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:59.905671 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:10:59.911721 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-861ce199-e1a1-48ff-b282-e55260534a0f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:59.915895 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-861ce199-e1a1-48ff-b282-e55260534a0f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:59.918598 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-861ce199-e1a1-48ff-b282-e55260534a0f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:59.921617 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-861ce199-e1a1-48ff-b282-e55260534a0f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:59.924978 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-861ce199-e1a1-48ff-b282-e55260534a0f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:59.925518 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-861ce199-e1a1-48ff-b282-e55260534a0f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:00.507462 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7f6128a8-8e53-455a-b4b8-cd370286db8f tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:00.519823 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7f6128a8-8e53-455a-b4b8-cd370286db8f tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:00.522019 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7f6128a8-8e53-455a-b4b8-cd370286db8f tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:00.525221 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7f6128a8-8e53-455a-b4b8-cd370286db8f tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] 10.222.0.61 "GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae" status: 200 len: 2961 microversion: 2.42 time: 0.758808 Aug 31 16:11:00.526449 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1649/3340] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:10:59 2022] GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae => generated 2961 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:11:00.532230 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5cc4c0e7-633e-4c40-bc27-5b321d24dce9 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:00.533118 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5cc4c0e7-633e-4c40-bc27-5b321d24dce9 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] [instance: c7ae279f-9e24-4755-a912-6bec59837e6c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:00.541601 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5cc4c0e7-633e-4c40-bc27-5b321d24dce9 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:00.543804 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5cc4c0e7-633e-4c40-bc27-5b321d24dce9 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:00.544456 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5cc4c0e7-633e-4c40-bc27-5b321d24dce9 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:00.545435 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5cc4c0e7-633e-4c40-bc27-5b321d24dce9 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:00.546080 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5cc4c0e7-633e-4c40-bc27-5b321d24dce9 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:00.546918 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5cc4c0e7-633e-4c40-bc27-5b321d24dce9 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:00.689762 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-861ce199-e1a1-48ff-b282-e55260534a0f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:00.705293 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-861ce199-e1a1-48ff-b282-e55260534a0f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/3de9f9a4-15c5-4bd9-a187-07d36cf9fb03" status: 200 len: 1292 microversion: 2.1 time: 0.820060 Aug 31 16:11:00.706469 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1692/3341] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:59 2022] GET /compute/v2.1/servers/3de9f9a4-15c5-4bd9-a187-07d36cf9fb03 => generated 1292 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:00.712887 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-51e200b1-19dd-4472-8cb8-10a3c537e09d tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:00.713657 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-51e200b1-19dd-4472-8cb8-10a3c537e09d tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] [instance: c393928f-2414-4093-9d72-93a21fc6c460] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:00.721814 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-51e200b1-19dd-4472-8cb8-10a3c537e09d tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:00.722719 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-51e200b1-19dd-4472-8cb8-10a3c537e09d tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:00.723984 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-51e200b1-19dd-4472-8cb8-10a3c537e09d tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:00.724426 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-51e200b1-19dd-4472-8cb8-10a3c537e09d tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:00.725929 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-51e200b1-19dd-4472-8cb8-10a3c537e09d tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:00.726796 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-51e200b1-19dd-4472-8cb8-10a3c537e09d tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:00.765700 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-51e200b1-19dd-4472-8cb8-10a3c537e09d tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:00.766348 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-51e200b1-19dd-4472-8cb8-10a3c537e09d tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:00.767035 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-51e200b1-19dd-4472-8cb8-10a3c537e09d tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:00.767856 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-51e200b1-19dd-4472-8cb8-10a3c537e09d tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lazy-loading 'fault' on Instance uuid c393928f-2414-4093-9d72-93a21fc6c460 {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:11:00.895806 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-51e200b1-19dd-4472-8cb8-10a3c537e09d tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b93395d63a4db895ff224a311940e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf281e8857247c6b9e60d4216741f89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:00.906230 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-51e200b1-19dd-4472-8cb8-10a3c537e09d tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] 10.222.0.61 "GET /compute/v2.1/servers/c393928f-2414-4093-9d72-93a21fc6c460" status: 200 len: 1310 microversion: 2.1 time: 0.198277 Aug 31 16:11:00.906828 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1693/3342] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:00 2022] GET /compute/v2.1/servers/c393928f-2414-4093-9d72-93a21fc6c460 => generated 1310 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:00.929199 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d7210585-2c14-4ab1-abc0-5d35e90f629c tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:00.930144 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d7210585-2c14-4ab1-abc0-5d35e90f629c tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] [instance: bb5a2211-fd4e-4c45-a75e-5df8bca76a2a] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:00.938424 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d7210585-2c14-4ab1-abc0-5d35e90f629c tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:00.939541 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d7210585-2c14-4ab1-abc0-5d35e90f629c tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:00.940447 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d7210585-2c14-4ab1-abc0-5d35e90f629c tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:00.941578 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d7210585-2c14-4ab1-abc0-5d35e90f629c tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:00.942274 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d7210585-2c14-4ab1-abc0-5d35e90f629c tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:00.942888 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d7210585-2c14-4ab1-abc0-5d35e90f629c tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:01.091911 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d7210585-2c14-4ab1-abc0-5d35e90f629c tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15bc6381d590409493f487f6cc0a1f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6723a5ba6cb4b88924e0b6fbf9bc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:01.108821 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d7210585-2c14-4ab1-abc0-5d35e90f629c tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15bc6381d590409493f487f6cc0a1f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6723a5ba6cb4b88924e0b6fbf9bc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:01.111825 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d7210585-2c14-4ab1-abc0-5d35e90f629c tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15bc6381d590409493f487f6cc0a1f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6723a5ba6cb4b88924e0b6fbf9bc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:01.114891 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d7210585-2c14-4ab1-abc0-5d35e90f629c tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] 10.222.0.61 "GET /compute/v2.1/servers/bb5a2211-fd4e-4c45-a75e-5df8bca76a2a" status: 200 len: 1339 microversion: 2.47 time: 0.206740 Aug 31 16:11:01.116608 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1694/3343] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:11:00 2022] GET /compute/v2.1/servers/bb5a2211-fd4e-4c45-a75e-5df8bca76a2a => generated 1339 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:11:01.147945 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8fce78eb-b02d-4b41-af8b-d81bf3231d98 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:01.150589 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8fce78eb-b02d-4b41-af8b-d81bf3231d98 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] [instance: fa0932e8-1aa4-4d1a-b653-14be35568f3d] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:01.160989 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8fce78eb-b02d-4b41-af8b-d81bf3231d98 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:01.162048 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8fce78eb-b02d-4b41-af8b-d81bf3231d98 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:01.163969 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8fce78eb-b02d-4b41-af8b-d81bf3231d98 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:01.166355 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8fce78eb-b02d-4b41-af8b-d81bf3231d98 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:01.167545 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8fce78eb-b02d-4b41-af8b-d81bf3231d98 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:01.168226 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8fce78eb-b02d-4b41-af8b-d81bf3231d98 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:01.177750 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5cc4c0e7-633e-4c40-bc27-5b321d24dce9 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13cabcaa79043bea338128594a6b00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab7f0d889224cefbca55343f3208a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:01.197123 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5cc4c0e7-633e-4c40-bc27-5b321d24dce9 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] 10.222.0.61 "GET /compute/v2.1/servers/c7ae279f-9e24-4755-a912-6bec59837e6c" status: 200 len: 1323 microversion: 2.1 time: 0.669228 Aug 31 16:11:01.197626 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1650/3344] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:00 2022] GET /compute/v2.1/servers/c7ae279f-9e24-4755-a912-6bec59837e6c => generated 1323 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:01.354262 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-86b37569-fb4b-4300-a44f-04ae3a19fa91 req-3ef0f7c7-1528-4c98-bd74-7c82ab55bf86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3de9f9a4-15c5-4bd9-a187-07d36cf9fb03", "tag": "aaaa54d4-97ee-443d-9dbc-56512afbfca7"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:11:01.366670 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-86b37569-fb4b-4300-a44f-04ae3a19fa91 req-3ef0f7c7-1528-4c98-bd74-7c82ab55bf86 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:01.367357 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-86b37569-fb4b-4300-a44f-04ae3a19fa91 req-3ef0f7c7-1528-4c98-bd74-7c82ab55bf86 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:01.367780 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-86b37569-fb4b-4300-a44f-04ae3a19fa91 req-3ef0f7c7-1528-4c98-bd74-7c82ab55bf86 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:01.385084 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-86b37569-fb4b-4300-a44f-04ae3a19fa91 req-3ef0f7c7-1528-4c98-bd74-7c82ab55bf86 service nova] Creating event network-changed:aaaa54d4-97ee-443d-9dbc-56512afbfca7 for instance 3de9f9a4-15c5-4bd9-a187-07d36cf9fb03 on n-h1-850499-9 Aug 31 16:11:01.390815 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-86b37569-fb4b-4300-a44f-04ae3a19fa91 req-3ef0f7c7-1528-4c98-bd74-7c82ab55bf86 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041632 Aug 31 16:11:01.391985 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1651/3345] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:11:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:11:01.560856 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-bdadc9b9-e3c3-4031-b6a7-0f34a2ca89de tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:01.562271 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-bdadc9b9-e3c3-4031-b6a7-0f34a2ca89de tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] [instance: 685d47e4-721e-4eae-b5f8-78fdb68454ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:01.569964 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bdadc9b9-e3c3-4031-b6a7-0f34a2ca89de tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:01.570469 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bdadc9b9-e3c3-4031-b6a7-0f34a2ca89de tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:01.571574 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bdadc9b9-e3c3-4031-b6a7-0f34a2ca89de tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:01.572337 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bdadc9b9-e3c3-4031-b6a7-0f34a2ca89de tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:01.572820 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bdadc9b9-e3c3-4031-b6a7-0f34a2ca89de tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:01.573244 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bdadc9b9-e3c3-4031-b6a7-0f34a2ca89de tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:02.242259 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8fce78eb-b02d-4b41-af8b-d81bf3231d98 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:02.252180 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8fce78eb-b02d-4b41-af8b-d81bf3231d98 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:02.253653 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8fce78eb-b02d-4b41-af8b-d81bf3231d98 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:02.254883 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8fce78eb-b02d-4b41-af8b-d81bf3231d98 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] 10.222.0.61 "GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d" status: 200 len: 1879 microversion: 2.32 time: 1.121162 Aug 31 16:11:02.255455 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1695/3346] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:11:01 2022] GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d => generated 1879 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:11:02.260367 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-89c2399e-b153-4183-95df-2b3f88ac2531 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:02.260982 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-89c2399e-b153-4183-95df-2b3f88ac2531 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 3de9f9a4-15c5-4bd9-a187-07d36cf9fb03] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:02.277455 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-89c2399e-b153-4183-95df-2b3f88ac2531 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:02.277962 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-89c2399e-b153-4183-95df-2b3f88ac2531 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:02.278413 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-89c2399e-b153-4183-95df-2b3f88ac2531 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:02.279132 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-89c2399e-b153-4183-95df-2b3f88ac2531 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:02.279621 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-89c2399e-b153-4183-95df-2b3f88ac2531 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:02.280064 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-89c2399e-b153-4183-95df-2b3f88ac2531 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:02.448996 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-bdadc9b9-e3c3-4031-b6a7-0f34a2ca89de tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:02.459561 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-bdadc9b9-e3c3-4031-b6a7-0f34a2ca89de tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:02.461795 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-bdadc9b9-e3c3-4031-b6a7-0f34a2ca89de tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:02.463080 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-bdadc9b9-e3c3-4031-b6a7-0f34a2ca89de tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] 10.222.0.61 "GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae" status: 200 len: 2961 microversion: 2.42 time: 0.908465 Aug 31 16:11:02.463699 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1652/3347] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:11:01 2022] GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae => generated 2961 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:11:02.468419 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1d33dbbd-f493-4bd1-b7dc-e7218a09ea32 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:02.469163 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1d33dbbd-f493-4bd1-b7dc-e7218a09ea32 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] [instance: c393928f-2414-4093-9d72-93a21fc6c460] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:02.480681 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1d33dbbd-f493-4bd1-b7dc-e7218a09ea32 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:02.481278 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1d33dbbd-f493-4bd1-b7dc-e7218a09ea32 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:02.488895 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1d33dbbd-f493-4bd1-b7dc-e7218a09ea32 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:02.489945 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1d33dbbd-f493-4bd1-b7dc-e7218a09ea32 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:02.490355 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1d33dbbd-f493-4bd1-b7dc-e7218a09ea32 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:02.490844 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1d33dbbd-f493-4bd1-b7dc-e7218a09ea32 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:02.546423 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1d33dbbd-f493-4bd1-b7dc-e7218a09ea32 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:02.547142 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1d33dbbd-f493-4bd1-b7dc-e7218a09ea32 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:02.547792 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1d33dbbd-f493-4bd1-b7dc-e7218a09ea32 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:02.548517 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-1d33dbbd-f493-4bd1-b7dc-e7218a09ea32 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lazy-loading 'fault' on Instance uuid c393928f-2414-4093-9d72-93a21fc6c460 {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:11:02.661985 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-1d33dbbd-f493-4bd1-b7dc-e7218a09ea32 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b93395d63a4db895ff224a311940e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf281e8857247c6b9e60d4216741f89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:02.674256 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1d33dbbd-f493-4bd1-b7dc-e7218a09ea32 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] 10.222.0.61 "GET /compute/v2.1/servers/c393928f-2414-4093-9d72-93a21fc6c460" status: 200 len: 1310 microversion: 2.1 time: 0.209078 Aug 31 16:11:02.675286 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1653/3348] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:02 2022] GET /compute/v2.1/servers/c393928f-2414-4093-9d72-93a21fc6c460 => generated 1310 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:02.684340 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4bed0bff-2b92-4fbd-a884-8c2d898cf235 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:02.685231 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4bed0bff-2b92-4fbd-a884-8c2d898cf235 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] [instance: bb5a2211-fd4e-4c45-a75e-5df8bca76a2a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:02.698216 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4bed0bff-2b92-4fbd-a884-8c2d898cf235 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:02.700482 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-89c2399e-b153-4183-95df-2b3f88ac2531 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:02.701112 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4bed0bff-2b92-4fbd-a884-8c2d898cf235 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:02.702164 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4bed0bff-2b92-4fbd-a884-8c2d898cf235 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:02.703636 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4bed0bff-2b92-4fbd-a884-8c2d898cf235 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:02.704941 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4bed0bff-2b92-4fbd-a884-8c2d898cf235 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:02.705929 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4bed0bff-2b92-4fbd-a884-8c2d898cf235 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:02.708396 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:11:02.719795 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-89c2399e-b153-4183-95df-2b3f88ac2531 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/3de9f9a4-15c5-4bd9-a187-07d36cf9fb03" status: 200 len: 1292 microversion: 2.1 time: 0.462898 Aug 31 16:11:02.720802 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1696/3349] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:02 2022] GET /compute/v2.1/servers/3de9f9a4-15c5-4bd9-a187-07d36cf9fb03 => generated 1292 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:02.753031 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-65b1d1c1-07d1-48f0-bda5-509401e54096 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:02.754247 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-65b1d1c1-07d1-48f0-bda5-509401e54096 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] [instance: c7ae279f-9e24-4755-a912-6bec59837e6c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:02.770412 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-65b1d1c1-07d1-48f0-bda5-509401e54096 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:02.771372 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-65b1d1c1-07d1-48f0-bda5-509401e54096 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:02.771872 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-65b1d1c1-07d1-48f0-bda5-509401e54096 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:02.773326 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-65b1d1c1-07d1-48f0-bda5-509401e54096 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:02.773798 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-65b1d1c1-07d1-48f0-bda5-509401e54096 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:02.774230 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-65b1d1c1-07d1-48f0-bda5-509401e54096 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:02.806097 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-4bed0bff-2b92-4fbd-a884-8c2d898cf235 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15bc6381d590409493f487f6cc0a1f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6723a5ba6cb4b88924e0b6fbf9bc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:02.817112 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-4bed0bff-2b92-4fbd-a884-8c2d898cf235 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15bc6381d590409493f487f6cc0a1f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6723a5ba6cb4b88924e0b6fbf9bc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:02.818589 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-4bed0bff-2b92-4fbd-a884-8c2d898cf235 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15bc6381d590409493f487f6cc0a1f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6723a5ba6cb4b88924e0b6fbf9bc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:02.820957 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4bed0bff-2b92-4fbd-a884-8c2d898cf235 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] 10.222.0.61 "GET /compute/v2.1/servers/bb5a2211-fd4e-4c45-a75e-5df8bca76a2a" status: 200 len: 1360 microversion: 2.47 time: 0.142978 Aug 31 16:11:02.821569 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1654/3350] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:11:02 2022] GET /compute/v2.1/servers/bb5a2211-fd4e-4c45-a75e-5df8bca76a2a => generated 1360 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:11:02.826467 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-10a93ee5-3711-49d6-a2a2-6838c03379b0 req-5ab4998d-8dd6-4783-93f8-385427cf144a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7ae279f-9e24-4755-a912-6bec59837e6c", "tag": "8b930bc1-225f-4f61-b131-4d4ae19c2ba2"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:11:02.837808 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-10a93ee5-3711-49d6-a2a2-6838c03379b0 req-5ab4998d-8dd6-4783-93f8-385427cf144a service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:02.838150 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-10a93ee5-3711-49d6-a2a2-6838c03379b0 req-5ab4998d-8dd6-4783-93f8-385427cf144a service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:02.838769 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-10a93ee5-3711-49d6-a2a2-6838c03379b0 req-5ab4998d-8dd6-4783-93f8-385427cf144a service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:02.852972 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-10a93ee5-3711-49d6-a2a2-6838c03379b0 req-5ab4998d-8dd6-4783-93f8-385427cf144a service nova] Creating event network-changed:8b930bc1-225f-4f61-b131-4d4ae19c2ba2 for instance c7ae279f-9e24-4755-a912-6bec59837e6c on n-h2-850499-9 Aug 31 16:11:02.858004 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-10a93ee5-3711-49d6-a2a2-6838c03379b0 req-5ab4998d-8dd6-4783-93f8-385427cf144a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035278 Aug 31 16:11:02.858616 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1655/3351] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:11:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:11:02.864065 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-41ebc23a-1386-45ad-bc1e-f868033a8dce tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1766420089"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:11:02.867703 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-41ebc23a-1386-45ad-bc1e-f868033a8dce tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] [instance: bb5a2211-fd4e-4c45-a75e-5df8bca76a2a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:02.875012 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-41ebc23a-1386-45ad-bc1e-f868033a8dce tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:02.875533 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-41ebc23a-1386-45ad-bc1e-f868033a8dce tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:02.875988 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-41ebc23a-1386-45ad-bc1e-f868033a8dce tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:02.876686 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-41ebc23a-1386-45ad-bc1e-f868033a8dce tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:02.877143 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-41ebc23a-1386-45ad-bc1e-f868033a8dce tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:02.877580 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-41ebc23a-1386-45ad-bc1e-f868033a8dce tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:03.024269 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-65b1d1c1-07d1-48f0-bda5-509401e54096 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13cabcaa79043bea338128594a6b00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab7f0d889224cefbca55343f3208a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:03.034842 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-65b1d1c1-07d1-48f0-bda5-509401e54096 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] 10.222.0.61 "GET /compute/v2.1/servers/c7ae279f-9e24-4755-a912-6bec59837e6c" status: 200 len: 1323 microversion: 2.1 time: 0.297239 Aug 31 16:11:03.036314 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1697/3352] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:02 2022] GET /compute/v2.1/servers/c7ae279f-9e24-4755-a912-6bec59837e6c => generated 1323 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:03.124196 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-41ebc23a-1386-45ad-bc1e-f868033a8dce tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] 10.222.0.61 "POST /compute/v2.1/servers/bb5a2211-fd4e-4c45-a75e-5df8bca76a2a/action" status: 202 len: 52 microversion: 2.47 time: 0.263790 Aug 31 16:11:03.124981 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1656/3353] 10.222.0.61 () {62 vars in 1319 bytes} [Wed Aug 31 16:11:02 2022] POST /compute/v2.1/servers/bb5a2211-fd4e-4c45-a75e-5df8bca76a2a/action => generated 52 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Aug 31 16:11:03.137890 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-82141ba9-ea6f-432d-8098-70c44d6d933f tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:03.138407 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-82141ba9-ea6f-432d-8098-70c44d6d933f tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] [instance: bb5a2211-fd4e-4c45-a75e-5df8bca76a2a] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:03.149256 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-82141ba9-ea6f-432d-8098-70c44d6d933f tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:03.150635 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-82141ba9-ea6f-432d-8098-70c44d6d933f tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:03.152165 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-82141ba9-ea6f-432d-8098-70c44d6d933f tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:03.155231 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-82141ba9-ea6f-432d-8098-70c44d6d933f tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:03.156574 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-82141ba9-ea6f-432d-8098-70c44d6d933f tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:03.157780 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-82141ba9-ea6f-432d-8098-70c44d6d933f tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:03.202363 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-82141ba9-ea6f-432d-8098-70c44d6d933f tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] [instance: bb5a2211-fd4e-4c45-a75e-5df8bca76a2a] Going to try to terminate instance {{(pid=122256) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:11:03.284695 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-76f460ab-bd9a-4ca4-85ef-24fd676bd41d tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:03.285569 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-76f460ab-bd9a-4ca4-85ef-24fd676bd41d tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] [instance: fa0932e8-1aa4-4d1a-b653-14be35568f3d] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:03.308616 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-76f460ab-bd9a-4ca4-85ef-24fd676bd41d tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:03.311950 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-76f460ab-bd9a-4ca4-85ef-24fd676bd41d tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:03.315139 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-76f460ab-bd9a-4ca4-85ef-24fd676bd41d tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:03.320587 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-76f460ab-bd9a-4ca4-85ef-24fd676bd41d tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:03.322157 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-76f460ab-bd9a-4ca4-85ef-24fd676bd41d tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:03.323135 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-76f460ab-bd9a-4ca4-85ef-24fd676bd41d tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:03.343911 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-82141ba9-ea6f-432d-8098-70c44d6d933f tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] 10.222.0.61 "DELETE /compute/v2.1/servers/bb5a2211-fd4e-4c45-a75e-5df8bca76a2a" status: 204 len: 0 microversion: 2.47 time: 0.210297 Aug 31 16:11:03.344914 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1698/3354] 10.222.0.61 () {60 vars in 1280 bytes} [Wed Aug 31 16:11:03 2022] DELETE /compute/v2.1/servers/bb5a2211-fd4e-4c45-a75e-5df8bca76a2a => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 16:11:03.357111 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-eb90f409-7bc3-418b-9a5e-021c8995f62b tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:03.358228 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-eb90f409-7bc3-418b-9a5e-021c8995f62b tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] [instance: bb5a2211-fd4e-4c45-a75e-5df8bca76a2a] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:03.368535 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eb90f409-7bc3-418b-9a5e-021c8995f62b tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:03.370748 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eb90f409-7bc3-418b-9a5e-021c8995f62b tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:03.372475 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eb90f409-7bc3-418b-9a5e-021c8995f62b tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:03.374149 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eb90f409-7bc3-418b-9a5e-021c8995f62b tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:03.375461 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eb90f409-7bc3-418b-9a5e-021c8995f62b tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:03.376604 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eb90f409-7bc3-418b-9a5e-021c8995f62b tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:03.579905 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-eb90f409-7bc3-418b-9a5e-021c8995f62b tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15bc6381d590409493f487f6cc0a1f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6723a5ba6cb4b88924e0b6fbf9bc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:03.591535 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-eb90f409-7bc3-418b-9a5e-021c8995f62b tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15bc6381d590409493f487f6cc0a1f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6723a5ba6cb4b88924e0b6fbf9bc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:03.593315 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-eb90f409-7bc3-418b-9a5e-021c8995f62b tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15bc6381d590409493f487f6cc0a1f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6723a5ba6cb4b88924e0b6fbf9bc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:03.595139 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-eb90f409-7bc3-418b-9a5e-021c8995f62b tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] 10.222.0.61 "GET /compute/v2.1/servers/bb5a2211-fd4e-4c45-a75e-5df8bca76a2a" status: 200 len: 1366 microversion: 2.47 time: 0.243520 Aug 31 16:11:03.595692 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1699/3355] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:11:03 2022] GET /compute/v2.1/servers/bb5a2211-fd4e-4c45-a75e-5df8bca76a2a => generated 1366 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:11:03.610730 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-bcdd8ed5-a342-440a-94b3-3b5534842c59 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:03.612130 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-bcdd8ed5-a342-440a-94b3-3b5534842c59 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] [instance: 685d47e4-721e-4eae-b5f8-78fdb68454ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:03.624518 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bcdd8ed5-a342-440a-94b3-3b5534842c59 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:03.625240 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bcdd8ed5-a342-440a-94b3-3b5534842c59 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:03.625554 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bcdd8ed5-a342-440a-94b3-3b5534842c59 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:03.626380 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bcdd8ed5-a342-440a-94b3-3b5534842c59 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:03.626849 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bcdd8ed5-a342-440a-94b3-3b5534842c59 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:03.627287 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bcdd8ed5-a342-440a-94b3-3b5534842c59 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:04.282566 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-76f460ab-bd9a-4ca4-85ef-24fd676bd41d tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:04.306153 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-76f460ab-bd9a-4ca4-85ef-24fd676bd41d tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:04.308656 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-76f460ab-bd9a-4ca4-85ef-24fd676bd41d tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:04.313343 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-76f460ab-bd9a-4ca4-85ef-24fd676bd41d tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] 10.222.0.61 "GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d" status: 200 len: 1879 microversion: 2.32 time: 1.035193 Aug 31 16:11:04.314125 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1657/3356] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:11:03 2022] GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d => generated 1879 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:11:04.319078 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0f170ef5-f9d5-4d5f-a37c-58f54bc1f919 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:04.320832 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0f170ef5-f9d5-4d5f-a37c-58f54bc1f919 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] [instance: c393928f-2414-4093-9d72-93a21fc6c460] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:04.343388 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0f170ef5-f9d5-4d5f-a37c-58f54bc1f919 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:04.344529 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0f170ef5-f9d5-4d5f-a37c-58f54bc1f919 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:04.345712 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0f170ef5-f9d5-4d5f-a37c-58f54bc1f919 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:04.347859 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0f170ef5-f9d5-4d5f-a37c-58f54bc1f919 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:04.349029 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0f170ef5-f9d5-4d5f-a37c-58f54bc1f919 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:04.351146 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0f170ef5-f9d5-4d5f-a37c-58f54bc1f919 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:04.390695 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-0f170ef5-f9d5-4d5f-a37c-58f54bc1f919 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] HTTP exception thrown: Instance c393928f-2414-4093-9d72-93a21fc6c460 could not be found. Aug 31 16:11:04.392652 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0f170ef5-f9d5-4d5f-a37c-58f54bc1f919 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Request method failure captured: Aug 31 16:11:04.392652 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/c393928f-2414-4093-9d72-93a21fc6c460 HTTP/1.1 Aug 31 16:11:04.392652 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:11:04.392652 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:11:04.392652 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:11:04.392652 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:11:04.392652 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:11:04.392652 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:11:04.392652 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:11:04.392652 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:11:04.392652 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4eVQ1PcyZWLoBMNFxcMiX2OodHQu9EW4JwQWAxIo_nw1s9ooTO24TL1mVZbfvgZALONSJPrmH5bhQs5sHUEYxalHzFvyKy3JUCiHPJ5vH8NJSAQPNSDudZN8x3Z5nVsjKx_wgQvz9eBUHeMS3AnA6IWUTfGsDF6PXmWRAyf_27pxvs Aug 31 16:11:04.392652 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:11:04.392652 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:11:04.392652 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:11:04.392652 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:11:04.392652 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:11:04.392652 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:11:04.392652 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 1cf281e8857247c6b9e60d4216741f89 Aug 31 16:11:04.392652 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ListServerFiltersTestJSON-1562372280 Aug 31 16:11:04.392652 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:11:04.392652 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:11:04.392652 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1cf281e8857247c6b9e60d4216741f89"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1cf281e8857247c6b9e60d4216741f89"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1cf281e8857247c6b9e60d4216741f89", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1cf281e8857247c6b9e60d4216741f89"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:11:04.392652 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ListServerFiltersTestJSON-1562372280 Aug 31 16:11:04.392652 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 1cf281e8857247c6b9e60d4216741f89 Aug 31 16:11:04.392652 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1562372280 Aug 31 16:11:04.392652 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ListServerFiltersTestJSON-1562372280-project Aug 31 16:11:04.392652 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:11:04.392652 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:11:04.392652 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 41b93395d63a4db895ff224a311940e3 Aug 31 16:11:04.392652 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ListServerFiltersTestJSON-1562372280-project Aug 31 16:11:04.392652 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:11:04.392652 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance c393928f-2414-4093-9d72-93a21fc6c460 could not be found. Aug 31 16:11:04.392652 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': 'c393928f-2414-4093-9d72-93a21fc6c460'} Aug 31 16:11:04.392652 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:11:04.392652 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:11:04.392652 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:11:04.392652 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:11:04.392652 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:11:04.392652 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:11:04.392652 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:11:04.392652 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:11:04.392652 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:11:04.392652 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:11:04.392652 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c393928f-2414-4093-9d72-93a21fc6c460 could not be found. Aug 31 16:11:04.392652 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:11:04.392652 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:11:04.392652 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:11:04.392652 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:11:04.392652 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:11:04.392652 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:11:04.392652 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:11:04.392652 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:11:04.392652 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:11:04.392652 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:11:04.392652 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:11:04.392652 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:11:04.392652 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:11:04.392652 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:11:04.392652 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:11:04.392652 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:11:04.392652 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c393928f-2414-4093-9d72-93a21fc6c460 could not be found. Aug 31 16:11:04.392652 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:11:04.392652 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:11:04.392652 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:11:04.399310 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:11:04.399310 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:11:04.399310 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:11:04.399310 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:11:04.399310 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:11:04.399310 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c393928f-2414-4093-9d72-93a21fc6c460 could not be found. Aug 31 16:11:04.399310 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:11:04.404525 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0f170ef5-f9d5-4d5f-a37c-58f54bc1f919 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] Returning 404 to user: Instance c393928f-2414-4093-9d72-93a21fc6c460 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:11:04.406112 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0f170ef5-f9d5-4d5f-a37c-58f54bc1f919 tempest-ListServerFiltersTestJSON-1562372280 tempest-ListServerFiltersTestJSON-1562372280-project] 10.222.0.61 "GET /compute/v2.1/servers/c393928f-2414-4093-9d72-93a21fc6c460" status: 404 len: 111 microversion: 2.1 time: 0.090564 Aug 31 16:11:04.407435 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1658/3357] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:04 2022] GET /compute/v2.1/servers/c393928f-2414-4093-9d72-93a21fc6c460 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:11:04.424290 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-63d3e185-9d53-49ac-b04f-1499af667ad4 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:04.426103 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-63d3e185-9d53-49ac-b04f-1499af667ad4 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 3de9f9a4-15c5-4bd9-a187-07d36cf9fb03] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:04.451623 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-63d3e185-9d53-49ac-b04f-1499af667ad4 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:04.452838 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-63d3e185-9d53-49ac-b04f-1499af667ad4 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:04.453808 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-63d3e185-9d53-49ac-b04f-1499af667ad4 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:04.455922 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-63d3e185-9d53-49ac-b04f-1499af667ad4 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:04.457692 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-63d3e185-9d53-49ac-b04f-1499af667ad4 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:04.458601 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-63d3e185-9d53-49ac-b04f-1499af667ad4 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:04.490511 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-bcdd8ed5-a342-440a-94b3-3b5534842c59 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:04.503523 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-bcdd8ed5-a342-440a-94b3-3b5534842c59 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:04.505106 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-bcdd8ed5-a342-440a-94b3-3b5534842c59 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:04.507193 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-bcdd8ed5-a342-440a-94b3-3b5534842c59 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] 10.222.0.61 "GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae" status: 200 len: 2961 microversion: 2.42 time: 0.903960 Aug 31 16:11:04.516238 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1700/3358] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:11:03 2022] GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae => generated 2961 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:11:04.524983 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ba857ae6-fb57-4e3e-8415-565fc3eeef11 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:04.526263 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ba857ae6-fb57-4e3e-8415-565fc3eeef11 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] [instance: c7ae279f-9e24-4755-a912-6bec59837e6c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:04.539090 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ba857ae6-fb57-4e3e-8415-565fc3eeef11 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:04.540081 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ba857ae6-fb57-4e3e-8415-565fc3eeef11 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:04.540896 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ba857ae6-fb57-4e3e-8415-565fc3eeef11 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:04.542263 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ba857ae6-fb57-4e3e-8415-565fc3eeef11 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:04.543143 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ba857ae6-fb57-4e3e-8415-565fc3eeef11 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:04.544012 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ba857ae6-fb57-4e3e-8415-565fc3eeef11 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:05.470985 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-63d3e185-9d53-49ac-b04f-1499af667ad4 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:05.481824 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ba857ae6-fb57-4e3e-8415-565fc3eeef11 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13cabcaa79043bea338128594a6b00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab7f0d889224cefbca55343f3208a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:05.485149 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-63d3e185-9d53-49ac-b04f-1499af667ad4 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/3de9f9a4-15c5-4bd9-a187-07d36cf9fb03" status: 200 len: 1292 microversion: 2.1 time: 1.075119 Aug 31 16:11:05.492815 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ba857ae6-fb57-4e3e-8415-565fc3eeef11 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] 10.222.0.61 "GET /compute/v2.1/servers/c7ae279f-9e24-4755-a912-6bec59837e6c" status: 200 len: 1323 microversion: 2.1 time: 0.974740 Aug 31 16:11:05.495414 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1701/3359] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:04 2022] GET /compute/v2.1/servers/c7ae279f-9e24-4755-a912-6bec59837e6c => generated 1323 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:05.503455 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1659/3360] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:04 2022] GET /compute/v2.1/servers/3de9f9a4-15c5-4bd9-a187-07d36cf9fb03 => generated 1292 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:05.513097 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-e3912f80-e852-4b56-9659-2772be88a445 req-5bcd837c-a8c5-4afb-bd43-482094a54a1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa0932e8-1aa4-4d1a-b653-14be35568f3d", "tag": "1acb52ee-181f-4844-aa80-9a93a9c9b7ae"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:11:05.518770 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c09d1cd7-01cc-4f61-8ac4-8d280a6ce5e6 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:05.519561 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c09d1cd7-01cc-4f61-8ac4-8d280a6ce5e6 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] [instance: bb5a2211-fd4e-4c45-a75e-5df8bca76a2a] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:05.539862 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c09d1cd7-01cc-4f61-8ac4-8d280a6ce5e6 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:05.545317 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c09d1cd7-01cc-4f61-8ac4-8d280a6ce5e6 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:05.546218 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c09d1cd7-01cc-4f61-8ac4-8d280a6ce5e6 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:05.547209 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c09d1cd7-01cc-4f61-8ac4-8d280a6ce5e6 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:05.547906 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c09d1cd7-01cc-4f61-8ac4-8d280a6ce5e6 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:05.549203 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-e3912f80-e852-4b56-9659-2772be88a445 req-5bcd837c-a8c5-4afb-bd43-482094a54a1c service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:05.549947 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c09d1cd7-01cc-4f61-8ac4-8d280a6ce5e6 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:05.550726 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-e3912f80-e852-4b56-9659-2772be88a445 req-5bcd837c-a8c5-4afb-bd43-482094a54a1c service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:05.551788 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-e3912f80-e852-4b56-9659-2772be88a445 req-5bcd837c-a8c5-4afb-bd43-482094a54a1c service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:05.577915 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-e3912f80-e852-4b56-9659-2772be88a445 req-5bcd837c-a8c5-4afb-bd43-482094a54a1c service nova] Creating event network-changed:1acb52ee-181f-4844-aa80-9a93a9c9b7ae for instance fa0932e8-1aa4-4d1a-b653-14be35568f3d on n-h2-850499-9 Aug 31 16:11:05.588225 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-e3912f80-e852-4b56-9659-2772be88a445 req-5bcd837c-a8c5-4afb-bd43-482094a54a1c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078978 Aug 31 16:11:05.591690 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1660/3361] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:11:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:11:05.604846 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ce727adf-dc10-4844-8f9f-262e9420170e tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:05.606065 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ce727adf-dc10-4844-8f9f-262e9420170e tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] [instance: fa0932e8-1aa4-4d1a-b653-14be35568f3d] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:05.621897 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ce727adf-dc10-4844-8f9f-262e9420170e tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:05.623041 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ce727adf-dc10-4844-8f9f-262e9420170e tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:05.623886 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ce727adf-dc10-4844-8f9f-262e9420170e tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:05.624828 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ce727adf-dc10-4844-8f9f-262e9420170e tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:05.625950 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ce727adf-dc10-4844-8f9f-262e9420170e tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:05.627467 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ce727adf-dc10-4844-8f9f-262e9420170e tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:05.687708 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c09d1cd7-01cc-4f61-8ac4-8d280a6ce5e6 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15bc6381d590409493f487f6cc0a1f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6723a5ba6cb4b88924e0b6fbf9bc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:05.703484 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c09d1cd7-01cc-4f61-8ac4-8d280a6ce5e6 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15bc6381d590409493f487f6cc0a1f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6723a5ba6cb4b88924e0b6fbf9bc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:05.715559 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c09d1cd7-01cc-4f61-8ac4-8d280a6ce5e6 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15bc6381d590409493f487f6cc0a1f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6723a5ba6cb4b88924e0b6fbf9bc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:05.718709 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c09d1cd7-01cc-4f61-8ac4-8d280a6ce5e6 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] 10.222.0.61 "GET /compute/v2.1/servers/bb5a2211-fd4e-4c45-a75e-5df8bca76a2a" status: 200 len: 1366 microversion: 2.47 time: 0.221857 Aug 31 16:11:05.720196 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1702/3362] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:11:05 2022] GET /compute/v2.1/servers/bb5a2211-fd4e-4c45-a75e-5df8bca76a2a => generated 1366 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:11:05.727390 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-decd7e0b-b38e-449a-af19-7dcc5dc8b996 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:05.728281 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-decd7e0b-b38e-449a-af19-7dcc5dc8b996 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] [instance: 685d47e4-721e-4eae-b5f8-78fdb68454ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:05.750205 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-decd7e0b-b38e-449a-af19-7dcc5dc8b996 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:05.751048 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-decd7e0b-b38e-449a-af19-7dcc5dc8b996 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:05.751705 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-decd7e0b-b38e-449a-af19-7dcc5dc8b996 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:05.752604 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-decd7e0b-b38e-449a-af19-7dcc5dc8b996 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:05.753239 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-decd7e0b-b38e-449a-af19-7dcc5dc8b996 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:05.753849 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-decd7e0b-b38e-449a-af19-7dcc5dc8b996 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:06.294279 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ce727adf-dc10-4844-8f9f-262e9420170e tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:06.306663 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ce727adf-dc10-4844-8f9f-262e9420170e tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:06.309137 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ce727adf-dc10-4844-8f9f-262e9420170e tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:06.310883 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ce727adf-dc10-4844-8f9f-262e9420170e tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] 10.222.0.61 "GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d" status: 200 len: 1879 microversion: 2.32 time: 0.715301 Aug 31 16:11:06.331307 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1661/3363] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:11:05 2022] GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d => generated 1879 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:11:06.343598 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-25e3451d-afaf-49b4-a5e3-5a732620bba7 req-056e300a-4379-4cd7-8f64-4eef58fd79bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "685d47e4-721e-4eae-b5f8-78fdb68454ae", "name": "network-vif-unplugged", "status": "completed", "tag": "95c43f6b-98f3-4304-acef-e290fff017c7"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:11:06.362576 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-25e3451d-afaf-49b4-a5e3-5a732620bba7 req-056e300a-4379-4cd7-8f64-4eef58fd79bc service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:06.363336 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-25e3451d-afaf-49b4-a5e3-5a732620bba7 req-056e300a-4379-4cd7-8f64-4eef58fd79bc service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:06.363984 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-25e3451d-afaf-49b4-a5e3-5a732620bba7 req-056e300a-4379-4cd7-8f64-4eef58fd79bc service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:06.382619 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-25e3451d-afaf-49b4-a5e3-5a732620bba7 req-056e300a-4379-4cd7-8f64-4eef58fd79bc service nova] Creating event network-vif-unplugged:95c43f6b-98f3-4304-acef-e290fff017c7 for instance 685d47e4-721e-4eae-b5f8-78fdb68454ae on n-h2-850499-9 Aug 31 16:11:06.389417 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-25e3451d-afaf-49b4-a5e3-5a732620bba7 req-056e300a-4379-4cd7-8f64-4eef58fd79bc service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056439 Aug 31 16:11:06.390283 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1662/3364] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:11:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:11:06.398528 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-decd7e0b-b38e-449a-af19-7dcc5dc8b996 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:06.425058 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-decd7e0b-b38e-449a-af19-7dcc5dc8b996 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:06.430160 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-decd7e0b-b38e-449a-af19-7dcc5dc8b996 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:06.431785 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-decd7e0b-b38e-449a-af19-7dcc5dc8b996 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] 10.222.0.61 "GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae" status: 200 len: 2961 microversion: 2.42 time: 0.710431 Aug 31 16:11:06.435644 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1703/3365] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:11:05 2022] GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae => generated 2961 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:11:06.510693 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4fcbc0c6-d742-4bbf-81ba-cc85a3184185 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:06.512806 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4fcbc0c6-d742-4bbf-81ba-cc85a3184185 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 3de9f9a4-15c5-4bd9-a187-07d36cf9fb03] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:06.521822 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d484a9f6-d8c4-49c0-9c76-a8a136db179d tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:06.523712 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d484a9f6-d8c4-49c0-9c76-a8a136db179d tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] [instance: c7ae279f-9e24-4755-a912-6bec59837e6c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:06.525234 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4fcbc0c6-d742-4bbf-81ba-cc85a3184185 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:06.525754 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4fcbc0c6-d742-4bbf-81ba-cc85a3184185 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:06.526202 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4fcbc0c6-d742-4bbf-81ba-cc85a3184185 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:06.527078 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4fcbc0c6-d742-4bbf-81ba-cc85a3184185 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:06.527737 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4fcbc0c6-d742-4bbf-81ba-cc85a3184185 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:06.528173 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4fcbc0c6-d742-4bbf-81ba-cc85a3184185 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:06.531979 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d484a9f6-d8c4-49c0-9c76-a8a136db179d tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:06.535433 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d484a9f6-d8c4-49c0-9c76-a8a136db179d tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:06.536150 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d484a9f6-d8c4-49c0-9c76-a8a136db179d tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:06.537057 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d484a9f6-d8c4-49c0-9c76-a8a136db179d tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:06.538411 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d484a9f6-d8c4-49c0-9c76-a8a136db179d tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:06.539162 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d484a9f6-d8c4-49c0-9c76-a8a136db179d tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:06.860213 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-4fcbc0c6-d742-4bbf-81ba-cc85a3184185 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:06.865025 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d484a9f6-d8c4-49c0-9c76-a8a136db179d tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13cabcaa79043bea338128594a6b00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab7f0d889224cefbca55343f3208a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:06.878943 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4fcbc0c6-d742-4bbf-81ba-cc85a3184185 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/3de9f9a4-15c5-4bd9-a187-07d36cf9fb03" status: 200 len: 1292 microversion: 2.1 time: 0.373785 Aug 31 16:11:06.883836 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1663/3366] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:06 2022] GET /compute/v2.1/servers/3de9f9a4-15c5-4bd9-a187-07d36cf9fb03 => generated 1292 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:06.888789 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4361cb1d-01c9-4cd4-aa75-abe0d2fbfad3 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:06.889469 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4361cb1d-01c9-4cd4-aa75-abe0d2fbfad3 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] [instance: bb5a2211-fd4e-4c45-a75e-5df8bca76a2a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:06.892569 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d484a9f6-d8c4-49c0-9c76-a8a136db179d tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] 10.222.0.61 "GET /compute/v2.1/servers/c7ae279f-9e24-4755-a912-6bec59837e6c" status: 200 len: 1323 microversion: 2.1 time: 0.375128 Aug 31 16:11:06.893176 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1704/3367] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:06 2022] GET /compute/v2.1/servers/c7ae279f-9e24-4755-a912-6bec59837e6c => generated 1323 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:06.902295 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4361cb1d-01c9-4cd4-aa75-abe0d2fbfad3 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:06.902811 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4361cb1d-01c9-4cd4-aa75-abe0d2fbfad3 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:06.903259 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4361cb1d-01c9-4cd4-aa75-abe0d2fbfad3 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:06.904094 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4361cb1d-01c9-4cd4-aa75-abe0d2fbfad3 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:06.904568 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4361cb1d-01c9-4cd4-aa75-abe0d2fbfad3 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:06.905007 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4361cb1d-01c9-4cd4-aa75-abe0d2fbfad3 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:06.914494 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:11:07.011171 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-4361cb1d-01c9-4cd4-aa75-abe0d2fbfad3 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15bc6381d590409493f487f6cc0a1f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6723a5ba6cb4b88924e0b6fbf9bc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:07.030918 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-4361cb1d-01c9-4cd4-aa75-abe0d2fbfad3 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15bc6381d590409493f487f6cc0a1f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6723a5ba6cb4b88924e0b6fbf9bc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:07.032426 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-4361cb1d-01c9-4cd4-aa75-abe0d2fbfad3 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15bc6381d590409493f487f6cc0a1f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6723a5ba6cb4b88924e0b6fbf9bc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:07.036631 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4361cb1d-01c9-4cd4-aa75-abe0d2fbfad3 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] 10.222.0.61 "GET /compute/v2.1/servers/bb5a2211-fd4e-4c45-a75e-5df8bca76a2a" status: 200 len: 1366 microversion: 2.47 time: 0.149670 Aug 31 16:11:07.038137 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1664/3368] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:11:06 2022] GET /compute/v2.1/servers/bb5a2211-fd4e-4c45-a75e-5df8bca76a2a => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:11:07.343435 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e9b6f5dd-b157-426d-9f51-a650f2a5c0b8 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:07.344167 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e9b6f5dd-b157-426d-9f51-a650f2a5c0b8 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] [instance: fa0932e8-1aa4-4d1a-b653-14be35568f3d] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:07.352959 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e9b6f5dd-b157-426d-9f51-a650f2a5c0b8 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:07.353811 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e9b6f5dd-b157-426d-9f51-a650f2a5c0b8 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:07.354469 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e9b6f5dd-b157-426d-9f51-a650f2a5c0b8 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:07.355369 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e9b6f5dd-b157-426d-9f51-a650f2a5c0b8 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:07.356040 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e9b6f5dd-b157-426d-9f51-a650f2a5c0b8 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:07.356667 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e9b6f5dd-b157-426d-9f51-a650f2a5c0b8 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:07.459398 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0d6c5c43-6e77-4596-8008-113dfb001103 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:07.460391 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0d6c5c43-6e77-4596-8008-113dfb001103 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] [instance: 685d47e4-721e-4eae-b5f8-78fdb68454ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:07.468027 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0d6c5c43-6e77-4596-8008-113dfb001103 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:07.468544 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0d6c5c43-6e77-4596-8008-113dfb001103 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:07.468984 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0d6c5c43-6e77-4596-8008-113dfb001103 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:07.469974 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0d6c5c43-6e77-4596-8008-113dfb001103 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:07.470649 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0d6c5c43-6e77-4596-8008-113dfb001103 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:07.471095 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0d6c5c43-6e77-4596-8008-113dfb001103 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:07.471591 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=4 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:11:07.506163 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=12 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:11:07.718910 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=12 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:11:07.816282 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0d6c5c43-6e77-4596-8008-113dfb001103 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:07.848132 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0d6c5c43-6e77-4596-8008-113dfb001103 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:07.851284 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0d6c5c43-6e77-4596-8008-113dfb001103 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:07.853609 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0d6c5c43-6e77-4596-8008-113dfb001103 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] 10.222.0.61 "GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae" status: 200 len: 2940 microversion: 2.42 time: 0.399072 Aug 31 16:11:07.854655 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1665/3369] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:11:07 2022] GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae => generated 2940 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:11:07.861193 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-2e04ff7f-a570-44fa-b211-5cb5f0405d36 req-220651d2-5e22-450d-918f-1a7b9cc2ab74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa0932e8-1aa4-4d1a-b653-14be35568f3d", "tag": "0f58cd66-acb5-4926-a732-c7608df7b8da"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:11:07.878949 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-2e04ff7f-a570-44fa-b211-5cb5f0405d36 req-220651d2-5e22-450d-918f-1a7b9cc2ab74 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:07.879858 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-2e04ff7f-a570-44fa-b211-5cb5f0405d36 req-220651d2-5e22-450d-918f-1a7b9cc2ab74 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:07.880672 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-2e04ff7f-a570-44fa-b211-5cb5f0405d36 req-220651d2-5e22-450d-918f-1a7b9cc2ab74 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:07.906544 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-2e04ff7f-a570-44fa-b211-5cb5f0405d36 req-220651d2-5e22-450d-918f-1a7b9cc2ab74 service nova] Creating event network-changed:0f58cd66-acb5-4926-a732-c7608df7b8da for instance fa0932e8-1aa4-4d1a-b653-14be35568f3d on n-h2-850499-9 Aug 31 16:11:07.916918 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-2e04ff7f-a570-44fa-b211-5cb5f0405d36 req-220651d2-5e22-450d-918f-1a7b9cc2ab74 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060323 Aug 31 16:11:07.917704 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1666/3370] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:11:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:11:08.002011 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e9b6f5dd-b157-426d-9f51-a650f2a5c0b8 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:08.016233 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e9b6f5dd-b157-426d-9f51-a650f2a5c0b8 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:08.017810 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e9b6f5dd-b157-426d-9f51-a650f2a5c0b8 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:08.019062 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e9b6f5dd-b157-426d-9f51-a650f2a5c0b8 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] 10.222.0.61 "GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d" status: 200 len: 1879 microversion: 2.32 time: 0.683357 Aug 31 16:11:08.019671 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1705/3371] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:11:07 2022] GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d => generated 1879 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:11:08.025129 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a9c01d1d-0c97-43b1-814f-08f138cb4556 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:08.025761 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a9c01d1d-0c97-43b1-814f-08f138cb4556 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 3de9f9a4-15c5-4bd9-a187-07d36cf9fb03] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:08.032950 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a9c01d1d-0c97-43b1-814f-08f138cb4556 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:08.033451 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a9c01d1d-0c97-43b1-814f-08f138cb4556 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:08.033896 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a9c01d1d-0c97-43b1-814f-08f138cb4556 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:08.034621 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a9c01d1d-0c97-43b1-814f-08f138cb4556 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:08.035083 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a9c01d1d-0c97-43b1-814f-08f138cb4556 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:08.035620 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a9c01d1d-0c97-43b1-814f-08f138cb4556 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:08.093675 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-08c2dc9e-c7f7-4dde-8b9c-137fc4f5d836 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-496808876", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "networks": "none"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:11:08.169262 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-08c2dc9e-c7f7-4dde-8b9c-137fc4f5d836 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:11:08.170006 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-08c2dc9e-c7f7-4dde-8b9c-137fc4f5d836 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:11:08.170858 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-08c2dc9e-c7f7-4dde-8b9c-137fc4f5d836 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:11:08.171618 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-08c2dc9e-c7f7-4dde-8b9c-137fc4f5d836 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:11:08.172373 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-08c2dc9e-c7f7-4dde-8b9c-137fc4f5d836 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:11:08.188639 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-08c2dc9e-c7f7-4dde-8b9c-137fc4f5d836 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:08.189322 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-08c2dc9e-c7f7-4dde-8b9c-137fc4f5d836 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:08.190144 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-08c2dc9e-c7f7-4dde-8b9c-137fc4f5d836 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:08.191890 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-08c2dc9e-c7f7-4dde-8b9c-137fc4f5d836 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:08.192492 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-08c2dc9e-c7f7-4dde-8b9c-137fc4f5d836 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:08.193272 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-08c2dc9e-c7f7-4dde-8b9c-137fc4f5d836 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:08.227072 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-08c2dc9e-c7f7-4dde-8b9c-137fc4f5d836 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Getting quotas for project 780f91ca8c6f461ba347cd2510dceeed. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:11:08.230819 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:11:08.236381 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-08c2dc9e-c7f7-4dde-8b9c-137fc4f5d836 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Getting quotas for user 56c32defec8443468861dbc8d33e3b7c and project 780f91ca8c6f461ba347cd2510dceeed. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:11:08.254328 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-08c2dc9e-c7f7-4dde-8b9c-137fc4f5d836 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Going to run 1 instances... {{(pid=122257) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:11:08.257821 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-08c2dc9e-c7f7-4dde-8b9c-137fc4f5d836 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] [instance: a2758687-ae57-4655-9f6f-d9363dcd3e26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:11:08.258460 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a9c01d1d-0c97-43b1-814f-08f138cb4556 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:08.267043 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a9c01d1d-0c97-43b1-814f-08f138cb4556 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/3de9f9a4-15c5-4bd9-a187-07d36cf9fb03" status: 200 len: 1292 microversion: 2.1 time: 0.246300 Aug 31 16:11:08.267777 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1706/3372] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:08 2022] GET /compute/v2.1/servers/3de9f9a4-15c5-4bd9-a187-07d36cf9fb03 => generated 1292 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:08.273514 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b6a56d34-c75b-4d4b-9c4a-8edd4cdefc7a tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:08.274462 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b6a56d34-c75b-4d4b-9c4a-8edd4cdefc7a tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] [instance: c7ae279f-9e24-4755-a912-6bec59837e6c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:08.281338 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b6a56d34-c75b-4d4b-9c4a-8edd4cdefc7a tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:08.281846 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b6a56d34-c75b-4d4b-9c4a-8edd4cdefc7a tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:08.282292 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b6a56d34-c75b-4d4b-9c4a-8edd4cdefc7a tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:08.283184 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b6a56d34-c75b-4d4b-9c4a-8edd4cdefc7a tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:08.284011 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b6a56d34-c75b-4d4b-9c4a-8edd4cdefc7a tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:08.284765 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b6a56d34-c75b-4d4b-9c4a-8edd4cdefc7a tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:08.315742 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-08c2dc9e-c7f7-4dde-8b9c-137fc4f5d836 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.396482 Aug 31 16:11:08.326608 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1667/3373] 10.222.0.61 () {62 vars in 1188 bytes} [Wed Aug 31 16:11:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 399 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 31 16:11:08.326608 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6ed384bc-b846-4a05-af97-4b8036d2ad7d tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:08.326608 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6ed384bc-b846-4a05-af97-4b8036d2ad7d tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] [instance: bb5a2211-fd4e-4c45-a75e-5df8bca76a2a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:08.333175 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6ed384bc-b846-4a05-af97-4b8036d2ad7d tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:08.333704 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6ed384bc-b846-4a05-af97-4b8036d2ad7d tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:08.334223 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6ed384bc-b846-4a05-af97-4b8036d2ad7d tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:08.335759 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6ed384bc-b846-4a05-af97-4b8036d2ad7d tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:08.336248 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6ed384bc-b846-4a05-af97-4b8036d2ad7d tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:08.336911 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6ed384bc-b846-4a05-af97-4b8036d2ad7d tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:08.467393 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-6ed384bc-b846-4a05-af97-4b8036d2ad7d tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15bc6381d590409493f487f6cc0a1f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6723a5ba6cb4b88924e0b6fbf9bc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:08.483375 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-6ed384bc-b846-4a05-af97-4b8036d2ad7d tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15bc6381d590409493f487f6cc0a1f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6723a5ba6cb4b88924e0b6fbf9bc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:08.486776 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-6ed384bc-b846-4a05-af97-4b8036d2ad7d tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15bc6381d590409493f487f6cc0a1f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6723a5ba6cb4b88924e0b6fbf9bc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:08.489206 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6ed384bc-b846-4a05-af97-4b8036d2ad7d tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] 10.222.0.61 "GET /compute/v2.1/servers/bb5a2211-fd4e-4c45-a75e-5df8bca76a2a" status: 200 len: 1366 microversion: 2.47 time: 0.170580 Aug 31 16:11:08.490591 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1668/3374] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:11:08 2022] GET /compute/v2.1/servers/bb5a2211-fd4e-4c45-a75e-5df8bca76a2a => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:11:08.498961 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-04f60179-156e-4316-b9a9-362842b74fc3 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:08.499826 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-04f60179-156e-4316-b9a9-362842b74fc3 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] [instance: a2758687-ae57-4655-9f6f-d9363dcd3e26] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:08.599967 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-04f60179-156e-4316-b9a9-362842b74fc3 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c32defec8443468861dbc8d33e3b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780f91ca8c6f461ba347cd2510dceeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:08.617423 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-04f60179-156e-4316-b9a9-362842b74fc3 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c32defec8443468861dbc8d33e3b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780f91ca8c6f461ba347cd2510dceeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:08.620784 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-04f60179-156e-4316-b9a9-362842b74fc3 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c32defec8443468861dbc8d33e3b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780f91ca8c6f461ba347cd2510dceeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:08.623324 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-04f60179-156e-4316-b9a9-362842b74fc3 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] 10.222.0.61 "GET /compute/v2.1/servers/a2758687-ae57-4655-9f6f-d9363dcd3e26" status: 200 len: 1277 microversion: 2.47 time: 0.130866 Aug 31 16:11:08.635887 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1669/3375] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:11:08 2022] GET /compute/v2.1/servers/a2758687-ae57-4655-9f6f-d9363dcd3e26 => generated 1277 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:11:08.636243 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b6a56d34-c75b-4d4b-9c4a-8edd4cdefc7a tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13cabcaa79043bea338128594a6b00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab7f0d889224cefbca55343f3208a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:08.636442 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-cc50fdb7-a982-446b-a081-d7cddb66206f req-9691ad19-466d-49d2-bbf3-b150aeb67084 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "685d47e4-721e-4eae-b5f8-78fdb68454ae", "name": "network-vif-unplugged", "status": "completed", "tag": "a7a5f1a9-2d7d-4203-b9c4-5b85512da4d2"}, {"server_uuid": "685d47e4-721e-4eae-b5f8-78fdb68454ae", "name": "network-vif-unplugged", "status": "completed", "tag": "ad0f25db-5150-4147-a615-e7e75398c04e"}, {"server_uuid": "685d47e4-721e-4eae-b5f8-78fdb68454ae", "name": "network-vif-unplugged", "status": "completed", "tag": "4f30e818-6489-4d7e-b214-37689cbe6c21"}, {"server_uuid": "685d47e4-721e-4eae-b5f8-78fdb68454ae", "name": "network-vif-unplugged", "status": "completed", "tag": "8734df6b-18ab-45c5-8c67-15fbeeb4e447"}, {"server_uuid": "685d47e4-721e-4eae-b5f8-78fdb68454ae", "name": "network-vif-unplugged", "status": "completed", "tag": "b14c9074-fcb3-408a-abec-9842ca262740"}, {"server_uuid": "3de9f9a4-15c5-4bd9-a187-07d36cf9fb03", "name": "network-vif-plugged", "status": "completed", "tag": "aaaa54d4-97ee-443d-9dbc-56512afbfca7"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:11:08.650311 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b6a56d34-c75b-4d4b-9c4a-8edd4cdefc7a tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] 10.222.0.61 "GET /compute/v2.1/servers/c7ae279f-9e24-4755-a912-6bec59837e6c" status: 200 len: 1323 microversion: 2.1 time: 0.380891 Aug 31 16:11:08.654246 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1707/3376] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:08 2022] GET /compute/v2.1/servers/c7ae279f-9e24-4755-a912-6bec59837e6c => generated 1323 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:08.666331 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-cc50fdb7-a982-446b-a081-d7cddb66206f req-9691ad19-466d-49d2-bbf3-b150aeb67084 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:08.666331 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-cc50fdb7-a982-446b-a081-d7cddb66206f req-9691ad19-466d-49d2-bbf3-b150aeb67084 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:08.666331 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-cc50fdb7-a982-446b-a081-d7cddb66206f req-9691ad19-466d-49d2-bbf3-b150aeb67084 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:08.683976 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-cc50fdb7-a982-446b-a081-d7cddb66206f req-9691ad19-466d-49d2-bbf3-b150aeb67084 service nova] Creating event network-vif-unplugged:a7a5f1a9-2d7d-4203-b9c4-5b85512da4d2 for instance 685d47e4-721e-4eae-b5f8-78fdb68454ae on n-h2-850499-9 Aug 31 16:11:08.685322 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-cc50fdb7-a982-446b-a081-d7cddb66206f req-9691ad19-466d-49d2-bbf3-b150aeb67084 service nova] Creating event network-vif-unplugged:ad0f25db-5150-4147-a615-e7e75398c04e for instance 685d47e4-721e-4eae-b5f8-78fdb68454ae on n-h2-850499-9 Aug 31 16:11:08.686366 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-cc50fdb7-a982-446b-a081-d7cddb66206f req-9691ad19-466d-49d2-bbf3-b150aeb67084 service nova] Creating event network-vif-unplugged:4f30e818-6489-4d7e-b214-37689cbe6c21 for instance 685d47e4-721e-4eae-b5f8-78fdb68454ae on n-h2-850499-9 Aug 31 16:11:08.687222 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-cc50fdb7-a982-446b-a081-d7cddb66206f req-9691ad19-466d-49d2-bbf3-b150aeb67084 service nova] Creating event network-vif-unplugged:8734df6b-18ab-45c5-8c67-15fbeeb4e447 for instance 685d47e4-721e-4eae-b5f8-78fdb68454ae on n-h2-850499-9 Aug 31 16:11:08.688267 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-cc50fdb7-a982-446b-a081-d7cddb66206f req-9691ad19-466d-49d2-bbf3-b150aeb67084 service nova] Creating event network-vif-unplugged:b14c9074-fcb3-408a-abec-9842ca262740 for instance 685d47e4-721e-4eae-b5f8-78fdb68454ae on n-h2-850499-9 Aug 31 16:11:08.689276 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-cc50fdb7-a982-446b-a081-d7cddb66206f req-9691ad19-466d-49d2-bbf3-b150aeb67084 service nova] Creating event network-vif-plugged:aaaa54d4-97ee-443d-9dbc-56512afbfca7 for instance 3de9f9a4-15c5-4bd9-a187-07d36cf9fb03 on n-h1-850499-9 Aug 31 16:11:08.707177 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-cc50fdb7-a982-446b-a081-d7cddb66206f req-9691ad19-466d-49d2-bbf3-b150aeb67084 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1048 microversion: 2.1 time: 0.080119 Aug 31 16:11:08.708359 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1670/3377] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:11:08 2022] POST /compute/v2.1/os-server-external-events => generated 1048 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:08.728470 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-eac4e538-f3fc-44ac-9d03-699e104ad7a1 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1667254855", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "networks": "none"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:11:08.817349 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-eac4e538-f3fc-44ac-9d03-699e104ad7a1 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:11:08.818450 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-eac4e538-f3fc-44ac-9d03-699e104ad7a1 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:11:08.819555 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-eac4e538-f3fc-44ac-9d03-699e104ad7a1 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:11:08.821077 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-eac4e538-f3fc-44ac-9d03-699e104ad7a1 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:11:08.821904 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-eac4e538-f3fc-44ac-9d03-699e104ad7a1 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:11:08.849841 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eac4e538-f3fc-44ac-9d03-699e104ad7a1 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:08.851792 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eac4e538-f3fc-44ac-9d03-699e104ad7a1 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:08.851792 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eac4e538-f3fc-44ac-9d03-699e104ad7a1 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:08.852932 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eac4e538-f3fc-44ac-9d03-699e104ad7a1 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:08.853647 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eac4e538-f3fc-44ac-9d03-699e104ad7a1 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:08.854811 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eac4e538-f3fc-44ac-9d03-699e104ad7a1 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:08.882136 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-eac4e538-f3fc-44ac-9d03-699e104ad7a1 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Getting quotas for project 780f91ca8c6f461ba347cd2510dceeed. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:11:08.902838 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0adbadeb-c8e5-4402-99a9-fe0d9417c351 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:08.905254 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0adbadeb-c8e5-4402-99a9-fe0d9417c351 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] [instance: 685d47e4-721e-4eae-b5f8-78fdb68454ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:08.907232 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-eac4e538-f3fc-44ac-9d03-699e104ad7a1 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Getting quotas for user 56c32defec8443468861dbc8d33e3b7c and project 780f91ca8c6f461ba347cd2510dceeed. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:11:08.920552 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0adbadeb-c8e5-4402-99a9-fe0d9417c351 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:08.921745 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:11:08.922297 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0adbadeb-c8e5-4402-99a9-fe0d9417c351 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:08.923154 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0adbadeb-c8e5-4402-99a9-fe0d9417c351 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:08.924416 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0adbadeb-c8e5-4402-99a9-fe0d9417c351 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:08.925232 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0adbadeb-c8e5-4402-99a9-fe0d9417c351 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:08.925956 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0adbadeb-c8e5-4402-99a9-fe0d9417c351 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:08.966711 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-eac4e538-f3fc-44ac-9d03-699e104ad7a1 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Going to run 1 instances... {{(pid=122256) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:11:08.974681 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-eac4e538-f3fc-44ac-9d03-699e104ad7a1 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] [instance: e8cfd63c-6e99-429f-93f2-ea40c02d7657] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:11:09.070447 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-eac4e538-f3fc-44ac-9d03-699e104ad7a1 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.345803 Aug 31 16:11:09.072212 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1708/3378] 10.222.0.61 () {62 vars in 1188 bytes} [Wed Aug 31 16:11:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 350 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 31 16:11:09.094351 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b75833cc-21f6-4074-ba84-e08d7a232b26 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:09.095154 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b75833cc-21f6-4074-ba84-e08d7a232b26 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] [instance: fa0932e8-1aa4-4d1a-b653-14be35568f3d] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:09.108577 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b75833cc-21f6-4074-ba84-e08d7a232b26 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:09.109603 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b75833cc-21f6-4074-ba84-e08d7a232b26 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:09.110683 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b75833cc-21f6-4074-ba84-e08d7a232b26 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:09.112697 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b75833cc-21f6-4074-ba84-e08d7a232b26 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:09.113931 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b75833cc-21f6-4074-ba84-e08d7a232b26 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:09.115005 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b75833cc-21f6-4074-ba84-e08d7a232b26 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:09.480335 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0adbadeb-c8e5-4402-99a9-fe0d9417c351 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:09.496789 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0adbadeb-c8e5-4402-99a9-fe0d9417c351 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:09.499582 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0adbadeb-c8e5-4402-99a9-fe0d9417c351 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:09.501651 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0adbadeb-c8e5-4402-99a9-fe0d9417c351 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] 10.222.0.61 "GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae" status: 200 len: 2940 microversion: 2.42 time: 0.609038 Aug 31 16:11:09.503166 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1671/3379] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:11:08 2022] GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae => generated 2940 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:11:09.511835 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-df0cda70-ae12-4352-af57-984a137b3a07 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:11:09.516055 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-df0cda70-ae12-4352-af57-984a137b3a07 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] [instance: e8cfd63c-6e99-429f-93f2-ea40c02d7657] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:09.570490 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-df0cda70-ae12-4352-af57-984a137b3a07 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] 10.222.0.61 "PUT /compute/v2.1/servers/e8cfd63c-6e99-429f-93f2-ea40c02d7657" status: 200 len: 992 microversion: 2.47 time: 0.065307 Aug 31 16:11:09.571255 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1672/3380] 10.222.0.61 () {62 vars in 1297 bytes} [Wed Aug 31 16:11:09 2022] PUT /compute/v2.1/servers/e8cfd63c-6e99-429f-93f2-ea40c02d7657 => generated 992 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 16:11:09.576817 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f62b92e0-9f5b-4100-a29c-6ac7812537f2 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:09.577517 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f62b92e0-9f5b-4100-a29c-6ac7812537f2 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 3de9f9a4-15c5-4bd9-a187-07d36cf9fb03] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:09.582583 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b75833cc-21f6-4074-ba84-e08d7a232b26 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:09.592012 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f62b92e0-9f5b-4100-a29c-6ac7812537f2 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:09.593298 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f62b92e0-9f5b-4100-a29c-6ac7812537f2 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:09.593799 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f62b92e0-9f5b-4100-a29c-6ac7812537f2 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:09.595127 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f62b92e0-9f5b-4100-a29c-6ac7812537f2 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:09.596764 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f62b92e0-9f5b-4100-a29c-6ac7812537f2 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:09.596764 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f62b92e0-9f5b-4100-a29c-6ac7812537f2 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:09.606031 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b75833cc-21f6-4074-ba84-e08d7a232b26 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:09.610235 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b75833cc-21f6-4074-ba84-e08d7a232b26 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:09.612718 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b75833cc-21f6-4074-ba84-e08d7a232b26 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] 10.222.0.61 "GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d" status: 200 len: 1879 microversion: 2.32 time: 0.537486 Aug 31 16:11:09.613032 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1709/3381] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:11:09 2022] GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d => generated 1879 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:11:09.619944 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3c1efe9a-82f3-42ad-916d-84a75f9bb1d5 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:09.621305 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3c1efe9a-82f3-42ad-916d-84a75f9bb1d5 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] [instance: bb5a2211-fd4e-4c45-a75e-5df8bca76a2a] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:09.629983 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3c1efe9a-82f3-42ad-916d-84a75f9bb1d5 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:09.630838 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3c1efe9a-82f3-42ad-916d-84a75f9bb1d5 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:09.631564 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3c1efe9a-82f3-42ad-916d-84a75f9bb1d5 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:09.632575 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3c1efe9a-82f3-42ad-916d-84a75f9bb1d5 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:09.633325 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3c1efe9a-82f3-42ad-916d-84a75f9bb1d5 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:09.634076 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3c1efe9a-82f3-42ad-916d-84a75f9bb1d5 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:09.826660 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3c1efe9a-82f3-42ad-916d-84a75f9bb1d5 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15bc6381d590409493f487f6cc0a1f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6723a5ba6cb4b88924e0b6fbf9bc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:09.838855 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3c1efe9a-82f3-42ad-916d-84a75f9bb1d5 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15bc6381d590409493f487f6cc0a1f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6723a5ba6cb4b88924e0b6fbf9bc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:09.840388 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3c1efe9a-82f3-42ad-916d-84a75f9bb1d5 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15bc6381d590409493f487f6cc0a1f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6723a5ba6cb4b88924e0b6fbf9bc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:09.841643 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3c1efe9a-82f3-42ad-916d-84a75f9bb1d5 tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] 10.222.0.61 "GET /compute/v2.1/servers/bb5a2211-fd4e-4c45-a75e-5df8bca76a2a" status: 200 len: 1366 microversion: 2.47 time: 0.227435 Aug 31 16:11:09.842212 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1710/3382] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:11:09 2022] GET /compute/v2.1/servers/bb5a2211-fd4e-4c45-a75e-5df8bca76a2a => generated 1366 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:11:09.867965 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8cce5eed-2c26-4a65-8332-3d43f58111b9 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:09.868793 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8cce5eed-2c26-4a65-8332-3d43f58111b9 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] [instance: e8cfd63c-6e99-429f-93f2-ea40c02d7657] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:09.875453 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8cce5eed-2c26-4a65-8332-3d43f58111b9 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:09.875991 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8cce5eed-2c26-4a65-8332-3d43f58111b9 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:09.876433 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8cce5eed-2c26-4a65-8332-3d43f58111b9 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:09.878246 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8cce5eed-2c26-4a65-8332-3d43f58111b9 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:09.878844 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8cce5eed-2c26-4a65-8332-3d43f58111b9 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:09.879340 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8cce5eed-2c26-4a65-8332-3d43f58111b9 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:10.020232 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8cce5eed-2c26-4a65-8332-3d43f58111b9 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c32defec8443468861dbc8d33e3b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780f91ca8c6f461ba347cd2510dceeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:10.037447 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8cce5eed-2c26-4a65-8332-3d43f58111b9 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c32defec8443468861dbc8d33e3b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780f91ca8c6f461ba347cd2510dceeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:10.040227 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8cce5eed-2c26-4a65-8332-3d43f58111b9 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c32defec8443468861dbc8d33e3b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780f91ca8c6f461ba347cd2510dceeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:10.041658 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8cce5eed-2c26-4a65-8332-3d43f58111b9 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] 10.222.0.61 "GET /compute/v2.1/servers/e8cfd63c-6e99-429f-93f2-ea40c02d7657" status: 200 len: 1282 microversion: 2.47 time: 0.187674 Aug 31 16:11:10.051585 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1711/3383] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:11:09 2022] GET /compute/v2.1/servers/e8cfd63c-6e99-429f-93f2-ea40c02d7657 => generated 1282 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:11:10.051585 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b132351b-4c24-4a0f-b8a3-c4e88fd2b665 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:10.051585 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b132351b-4c24-4a0f-b8a3-c4e88fd2b665 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] [instance: c7ae279f-9e24-4755-a912-6bec59837e6c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:10.066065 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f62b92e0-9f5b-4100-a29c-6ac7812537f2 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:10.090116 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b132351b-4c24-4a0f-b8a3-c4e88fd2b665 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:10.091649 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b132351b-4c24-4a0f-b8a3-c4e88fd2b665 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:10.092007 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f62b92e0-9f5b-4100-a29c-6ac7812537f2 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/3de9f9a4-15c5-4bd9-a187-07d36cf9fb03" status: 200 len: 1292 microversion: 2.1 time: 0.517865 Aug 31 16:11:10.094434 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b132351b-4c24-4a0f-b8a3-c4e88fd2b665 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:10.095210 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b132351b-4c24-4a0f-b8a3-c4e88fd2b665 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:10.096369 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b132351b-4c24-4a0f-b8a3-c4e88fd2b665 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:10.096369 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b132351b-4c24-4a0f-b8a3-c4e88fd2b665 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:10.098902 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1673/3384] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:09 2022] GET /compute/v2.1/servers/3de9f9a4-15c5-4bd9-a187-07d36cf9fb03 => generated 1292 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:10.138435 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:11:10.545117 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5a7a6014-f3f7-42fb-aca5-5bd66adca735 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:10.547012 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5a7a6014-f3f7-42fb-aca5-5bd66adca735 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] [instance: 685d47e4-721e-4eae-b5f8-78fdb68454ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:10.565261 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5a7a6014-f3f7-42fb-aca5-5bd66adca735 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:10.567417 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5a7a6014-f3f7-42fb-aca5-5bd66adca735 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:10.569885 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5a7a6014-f3f7-42fb-aca5-5bd66adca735 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:10.572089 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5a7a6014-f3f7-42fb-aca5-5bd66adca735 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:10.573439 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5a7a6014-f3f7-42fb-aca5-5bd66adca735 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:10.574885 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5a7a6014-f3f7-42fb-aca5-5bd66adca735 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:10.879345 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b132351b-4c24-4a0f-b8a3-c4e88fd2b665 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13cabcaa79043bea338128594a6b00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab7f0d889224cefbca55343f3208a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:10.889263 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b132351b-4c24-4a0f-b8a3-c4e88fd2b665 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] 10.222.0.61 "GET /compute/v2.1/servers/c7ae279f-9e24-4755-a912-6bec59837e6c" status: 200 len: 1323 microversion: 2.1 time: 0.845226 Aug 31 16:11:10.898612 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1712/3385] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:10 2022] GET /compute/v2.1/servers/c7ae279f-9e24-4755-a912-6bec59837e6c => generated 1323 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:10.906394 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e65c8b00-3899-4333-a739-41e683bca2cd tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:10.907298 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e65c8b00-3899-4333-a739-41e683bca2cd tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] [instance: fa0932e8-1aa4-4d1a-b653-14be35568f3d] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:10.916324 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e65c8b00-3899-4333-a739-41e683bca2cd tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:10.916934 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e65c8b00-3899-4333-a739-41e683bca2cd tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:10.917458 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e65c8b00-3899-4333-a739-41e683bca2cd tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:10.918194 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e65c8b00-3899-4333-a739-41e683bca2cd tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:10.918651 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e65c8b00-3899-4333-a739-41e683bca2cd tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:10.919089 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e65c8b00-3899-4333-a739-41e683bca2cd tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:11.440573 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5a7a6014-f3f7-42fb-aca5-5bd66adca735 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:11.461096 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5a7a6014-f3f7-42fb-aca5-5bd66adca735 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:11.465791 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5a7a6014-f3f7-42fb-aca5-5bd66adca735 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:11.469401 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5a7a6014-f3f7-42fb-aca5-5bd66adca735 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] 10.222.0.61 "GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae" status: 200 len: 2940 microversion: 2.42 time: 0.932178 Aug 31 16:11:11.476815 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1674/3386] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:11:10 2022] GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae => generated 2940 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:11:11.481947 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-462797fa-e421-4369-8d4e-18530eb5f86d tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:11.484269 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-462797fa-e421-4369-8d4e-18530eb5f86d tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] [instance: bb5a2211-fd4e-4c45-a75e-5df8bca76a2a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:11.499335 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-462797fa-e421-4369-8d4e-18530eb5f86d tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:11.500720 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-462797fa-e421-4369-8d4e-18530eb5f86d tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:11.501524 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-462797fa-e421-4369-8d4e-18530eb5f86d tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:11.502830 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-462797fa-e421-4369-8d4e-18530eb5f86d tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:11.503722 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-462797fa-e421-4369-8d4e-18530eb5f86d tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:11.504334 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-462797fa-e421-4369-8d4e-18530eb5f86d tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:11.604440 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-462797fa-e421-4369-8d4e-18530eb5f86d tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:11.604941 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-462797fa-e421-4369-8d4e-18530eb5f86d tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:11.605432 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-462797fa-e421-4369-8d4e-18530eb5f86d tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:11.606110 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-462797fa-e421-4369-8d4e-18530eb5f86d tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Lazy-loading 'fault' on Instance uuid bb5a2211-fd4e-4c45-a75e-5df8bca76a2a {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:11:12.115392 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-462797fa-e421-4369-8d4e-18530eb5f86d tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15bc6381d590409493f487f6cc0a1f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6723a5ba6cb4b88924e0b6fbf9bc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:12.126768 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-462797fa-e421-4369-8d4e-18530eb5f86d tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15bc6381d590409493f487f6cc0a1f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6723a5ba6cb4b88924e0b6fbf9bc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:12.128754 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-462797fa-e421-4369-8d4e-18530eb5f86d tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15bc6381d590409493f487f6cc0a1f8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6723a5ba6cb4b88924e0b6fbf9bc3a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:12.129989 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-462797fa-e421-4369-8d4e-18530eb5f86d tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] 10.222.0.61 "GET /compute/v2.1/servers/bb5a2211-fd4e-4c45-a75e-5df8bca76a2a" status: 200 len: 1371 microversion: 2.47 time: 0.651944 Aug 31 16:11:12.130935 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1675/3387] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:11:11 2022] GET /compute/v2.1/servers/bb5a2211-fd4e-4c45-a75e-5df8bca76a2a => generated 1371 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:11:12.136478 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8250f498-14e7-4113-aed7-9b0a7a767a63 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:12.137684 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8250f498-14e7-4113-aed7-9b0a7a767a63 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] [instance: e8cfd63c-6e99-429f-93f2-ea40c02d7657] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:12.145216 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8250f498-14e7-4113-aed7-9b0a7a767a63 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:12.145785 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8250f498-14e7-4113-aed7-9b0a7a767a63 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:12.146235 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8250f498-14e7-4113-aed7-9b0a7a767a63 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:12.147134 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8250f498-14e7-4113-aed7-9b0a7a767a63 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:12.147745 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8250f498-14e7-4113-aed7-9b0a7a767a63 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:12.148417 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8250f498-14e7-4113-aed7-9b0a7a767a63 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:12.283452 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e65c8b00-3899-4333-a739-41e683bca2cd tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:12.307673 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e65c8b00-3899-4333-a739-41e683bca2cd tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:12.310400 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e65c8b00-3899-4333-a739-41e683bca2cd tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:12.312631 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e65c8b00-3899-4333-a739-41e683bca2cd tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] 10.222.0.61 "GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d" status: 200 len: 1879 microversion: 2.32 time: 1.412013 Aug 31 16:11:12.330200 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1713/3388] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:11:10 2022] GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d => generated 1879 bytes in 1431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:11:12.341225 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0b9bd155-5d51-466a-ab91-938262b76027 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:12.342253 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0b9bd155-5d51-466a-ab91-938262b76027 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 3de9f9a4-15c5-4bd9-a187-07d36cf9fb03] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:12.351078 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0b9bd155-5d51-466a-ab91-938262b76027 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:12.352110 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0b9bd155-5d51-466a-ab91-938262b76027 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:12.352866 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0b9bd155-5d51-466a-ab91-938262b76027 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:12.354037 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0b9bd155-5d51-466a-ab91-938262b76027 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:12.354735 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0b9bd155-5d51-466a-ab91-938262b76027 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:12.355656 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0b9bd155-5d51-466a-ab91-938262b76027 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:12.445526 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8250f498-14e7-4113-aed7-9b0a7a767a63 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c32defec8443468861dbc8d33e3b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780f91ca8c6f461ba347cd2510dceeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:12.467949 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8250f498-14e7-4113-aed7-9b0a7a767a63 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c32defec8443468861dbc8d33e3b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780f91ca8c6f461ba347cd2510dceeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:12.470593 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8250f498-14e7-4113-aed7-9b0a7a767a63 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c32defec8443468861dbc8d33e3b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780f91ca8c6f461ba347cd2510dceeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:12.472712 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8250f498-14e7-4113-aed7-9b0a7a767a63 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] 10.222.0.61 "GET /compute/v2.1/servers/e8cfd63c-6e99-429f-93f2-ea40c02d7657" status: 200 len: 1336 microversion: 2.47 time: 0.340248 Aug 31 16:11:12.473392 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1676/3389] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:11:12 2022] GET /compute/v2.1/servers/e8cfd63c-6e99-429f-93f2-ea40c02d7657 => generated 1336 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:11:12.484009 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-83d03fe4-f655-485b-9f6a-44c4d0a7b1ff tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:12.485426 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-83d03fe4-f655-485b-9f6a-44c4d0a7b1ff tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] [instance: c7ae279f-9e24-4755-a912-6bec59837e6c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:12.505050 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-83d03fe4-f655-485b-9f6a-44c4d0a7b1ff tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:12.506065 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-83d03fe4-f655-485b-9f6a-44c4d0a7b1ff tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:12.507476 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-83d03fe4-f655-485b-9f6a-44c4d0a7b1ff tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:12.508993 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-83d03fe4-f655-485b-9f6a-44c4d0a7b1ff tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:12.510954 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-83d03fe4-f655-485b-9f6a-44c4d0a7b1ff tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:12.512081 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-83d03fe4-f655-485b-9f6a-44c4d0a7b1ff tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:13.228379 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-0b9bd155-5d51-466a-ab91-938262b76027 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:13.239587 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0b9bd155-5d51-466a-ab91-938262b76027 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/3de9f9a4-15c5-4bd9-a187-07d36cf9fb03" status: 200 len: 1474 microversion: 2.1 time: 0.907112 Aug 31 16:11:13.240372 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1714/3390] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:12 2022] GET /compute/v2.1/servers/3de9f9a4-15c5-4bd9-a187-07d36cf9fb03 => generated 1474 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:13.246980 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a288ccd6-c27d-4d04-a3c2-6b749293b3ab tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:13.248364 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a288ccd6-c27d-4d04-a3c2-6b749293b3ab tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] [instance: 685d47e4-721e-4eae-b5f8-78fdb68454ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:13.257629 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a288ccd6-c27d-4d04-a3c2-6b749293b3ab tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:13.258723 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a288ccd6-c27d-4d04-a3c2-6b749293b3ab tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:13.259452 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a288ccd6-c27d-4d04-a3c2-6b749293b3ab tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:13.260422 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a288ccd6-c27d-4d04-a3c2-6b749293b3ab tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:13.261178 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a288ccd6-c27d-4d04-a3c2-6b749293b3ab tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:13.261711 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a288ccd6-c27d-4d04-a3c2-6b749293b3ab tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:13.381884 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-83d03fe4-f655-485b-9f6a-44c4d0a7b1ff tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13cabcaa79043bea338128594a6b00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab7f0d889224cefbca55343f3208a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:13.411354 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-83d03fe4-f655-485b-9f6a-44c4d0a7b1ff tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] 10.222.0.61 "GET /compute/v2.1/servers/c7ae279f-9e24-4755-a912-6bec59837e6c" status: 200 len: 1323 microversion: 2.1 time: 0.934217 Aug 31 16:11:13.424188 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1677/3391] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:12 2022] GET /compute/v2.1/servers/c7ae279f-9e24-4755-a912-6bec59837e6c => generated 1323 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:13.435006 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-77689098-eac6-43ad-8b87-ea4931bb9627 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:13.440016 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-77689098-eac6-43ad-8b87-ea4931bb9627 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c65ee5ffa9d74bfdacbea45f1564d19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55320a9c8f714bc0911ded3ab88ddf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:13.440853 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-77689098-eac6-43ad-8b87-ea4931bb9627 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Searching by: {'deleted': False, 'project_id': '55320a9c8f714bc0911ded3ab88ddf31'} {{(pid=122257) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 16:11:13.448199 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-77689098-eac6-43ad-8b87-ea4931bb9627 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:13.449357 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-77689098-eac6-43ad-8b87-ea4931bb9627 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:13.449810 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-77689098-eac6-43ad-8b87-ea4931bb9627 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:13.450750 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-77689098-eac6-43ad-8b87-ea4931bb9627 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:13.451221 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-77689098-eac6-43ad-8b87-ea4931bb9627 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:13.451698 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-77689098-eac6-43ad-8b87-ea4931bb9627 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:13.484702 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.multi_cell_list [None req-77689098-eac6-43ad-8b87-ea4931bb9627 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122257) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 31 16:11:13.546036 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-77689098-eac6-43ad-8b87-ea4931bb9627 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] 10.222.0.61 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.120503 Aug 31 16:11:13.547587 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1678/3392] 10.222.0.61 () {58 vars in 1125 bytes} [Wed Aug 31 16:11:13 2022] GET /compute/v2.1/servers => generated 343 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:11:13.556934 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5d2bc9a0-60ee-4a73-ba74-f26b35f6ecce tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:13.557857 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5d2bc9a0-60ee-4a73-ba74-f26b35f6ecce tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] [instance: bb5a2211-fd4e-4c45-a75e-5df8bca76a2a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:13.571284 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5d2bc9a0-60ee-4a73-ba74-f26b35f6ecce tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:13.572362 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5d2bc9a0-60ee-4a73-ba74-f26b35f6ecce tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:13.573143 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5d2bc9a0-60ee-4a73-ba74-f26b35f6ecce tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:13.574690 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5d2bc9a0-60ee-4a73-ba74-f26b35f6ecce tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:13.575561 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5d2bc9a0-60ee-4a73-ba74-f26b35f6ecce tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:13.576350 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5d2bc9a0-60ee-4a73-ba74-f26b35f6ecce tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:13.605248 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-5d2bc9a0-60ee-4a73-ba74-f26b35f6ecce tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] HTTP exception thrown: Instance bb5a2211-fd4e-4c45-a75e-5df8bca76a2a could not be found. Aug 31 16:11:13.608629 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5d2bc9a0-60ee-4a73-ba74-f26b35f6ecce tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Request method failure captured: Aug 31 16:11:13.608629 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/bb5a2211-fd4e-4c45-a75e-5df8bca76a2a HTTP/1.1 Aug 31 16:11:13.608629 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:11:13.608629 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:11:13.608629 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:11:13.608629 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:11:13.608629 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:11:13.608629 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:11:13.608629 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:11:13.608629 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:11:13.608629 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4gIKJ-F_NFBrSUQsUcI9nLYJZzAadFm7vdM4uZjhN8E1VNL2yGhttXIoQxlAHPN4hPSJtTWBrEQwavujbZNOA1xEmyY3LJjIrC5wfVXOjxLJ59NZioyAuT7lHObmlThL5eaKkhQoRqQfvg_9gIm4O7qr0Wx4YmuF4K6r6a2g5F6c0g Aug 31 16:11:13.608629 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:11:13.608629 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:11:13.608629 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:11:13.608629 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:11:13.608629 n-d-850499-9 devstack@n-api.service[122257]: X-Openstack-Nova-Api-Version: 2.47 Aug 31 16:11:13.608629 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:11:13.608629 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:11:13.608629 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: a6723a5ba6cb4b88924e0b6fbf9bc3a5 Aug 31 16:11:13.608629 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ServersAaction247Test-1802804888 Aug 31 16:11:13.608629 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:11:13.608629 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:11:13.608629 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a6723a5ba6cb4b88924e0b6fbf9bc3a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a6723a5ba6cb4b88924e0b6fbf9bc3a5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a6723a5ba6cb4b88924e0b6fbf9bc3a5", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a6723a5ba6cb4b88924e0b6fbf9bc3a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:11:13.608629 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ServersAaction247Test-1802804888 Aug 31 16:11:13.608629 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: a6723a5ba6cb4b88924e0b6fbf9bc3a5 Aug 31 16:11:13.608629 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ServersAaction247Test-1802804888 Aug 31 16:11:13.608629 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ServersAaction247Test-1802804888-project Aug 31 16:11:13.608629 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:11:13.608629 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:11:13.608629 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 15bc6381d590409493f487f6cc0a1f8b Aug 31 16:11:13.608629 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ServersAaction247Test-1802804888-project Aug 31 16:11:13.608629 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:11:13.608629 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance bb5a2211-fd4e-4c45-a75e-5df8bca76a2a could not be found. Aug 31 16:11:13.608629 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': 'bb5a2211-fd4e-4c45-a75e-5df8bca76a2a'} Aug 31 16:11:13.608629 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:11:13.608629 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:11:13.608629 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:11:13.608629 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:11:13.608629 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:11:13.608629 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:11:13.608629 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:11:13.608629 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:11:13.608629 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:11:13.608629 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:11:13.608629 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb5a2211-fd4e-4c45-a75e-5df8bca76a2a could not be found. Aug 31 16:11:13.608629 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:11:13.608629 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:11:13.608629 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:11:13.608629 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:11:13.608629 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:11:13.608629 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:11:13.608629 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:11:13.608629 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:11:13.608629 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:11:13.608629 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:11:13.608629 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:11:13.608629 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:11:13.608629 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:11:13.608629 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:11:13.608629 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:11:13.608629 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:11:13.608629 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb5a2211-fd4e-4c45-a75e-5df8bca76a2a could not be found. Aug 31 16:11:13.608629 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:11:13.608629 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:11:13.618787 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:11:13.618787 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:11:13.618787 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:11:13.618787 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:11:13.618787 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:11:13.618787 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:11:13.618787 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb5a2211-fd4e-4c45-a75e-5df8bca76a2a could not be found. Aug 31 16:11:13.618787 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:11:13.624246 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5d2bc9a0-60ee-4a73-ba74-f26b35f6ecce tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] Returning 404 to user: Instance bb5a2211-fd4e-4c45-a75e-5df8bca76a2a could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:11:13.624246 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5d2bc9a0-60ee-4a73-ba74-f26b35f6ecce tempest-ServersAaction247Test-1802804888 tempest-ServersAaction247Test-1802804888-project] 10.222.0.61 "GET /compute/v2.1/servers/bb5a2211-fd4e-4c45-a75e-5df8bca76a2a" status: 404 len: 111 microversion: 2.47 time: 0.072195 Aug 31 16:11:13.624246 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1679/3393] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:11:13 2022] GET /compute/v2.1/servers/bb5a2211-fd4e-4c45-a75e-5df8bca76a2a => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:11:13.634335 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b3e1ef0a-87c3-434b-a81a-12839a400023 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:13.635482 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b3e1ef0a-87c3-434b-a81a-12839a400023 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] [instance: fa0932e8-1aa4-4d1a-b653-14be35568f3d] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:13.646555 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b3e1ef0a-87c3-434b-a81a-12839a400023 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:13.650297 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b3e1ef0a-87c3-434b-a81a-12839a400023 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:13.651086 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b3e1ef0a-87c3-434b-a81a-12839a400023 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:13.652403 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b3e1ef0a-87c3-434b-a81a-12839a400023 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:13.653265 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b3e1ef0a-87c3-434b-a81a-12839a400023 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:13.654072 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b3e1ef0a-87c3-434b-a81a-12839a400023 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:14.051229 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a288ccd6-c27d-4d04-a3c2-6b749293b3ab tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:14.066894 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a288ccd6-c27d-4d04-a3c2-6b749293b3ab tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:14.070036 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a288ccd6-c27d-4d04-a3c2-6b749293b3ab tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:14.072857 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a288ccd6-c27d-4d04-a3c2-6b749293b3ab tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] 10.222.0.61 "GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae" status: 200 len: 2919 microversion: 2.42 time: 0.830565 Aug 31 16:11:14.073865 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1715/3394] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:11:13 2022] GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae => generated 2919 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:11:14.092321 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-32815ef7-f54e-4311-8797-29d06fd3652f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-584612332", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:11:14.183958 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-32815ef7-f54e-4311-8797-29d06fd3652f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] validate_networks() for [('e418f255-318f-476c-a353-8d292b5f7798', None, None, None, None, None)] {{(pid=122256) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:11:14.290197 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b3e1ef0a-87c3-434b-a81a-12839a400023 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:14.300789 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b3e1ef0a-87c3-434b-a81a-12839a400023 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:14.302828 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b3e1ef0a-87c3-434b-a81a-12839a400023 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:14.306007 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b3e1ef0a-87c3-434b-a81a-12839a400023 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] 10.222.0.61 "GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d" status: 200 len: 1879 microversion: 2.32 time: 0.682347 Aug 31 16:11:14.306437 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1680/3395] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:11:13 2022] GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d => generated 1879 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:11:14.311430 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-041294ca-82cb-4f39-9a73-98567512fd7b tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:14.312445 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-041294ca-82cb-4f39-9a73-98567512fd7b tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] [instance: e8cfd63c-6e99-429f-93f2-ea40c02d7657] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:14.334022 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-041294ca-82cb-4f39-9a73-98567512fd7b tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:14.335688 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-041294ca-82cb-4f39-9a73-98567512fd7b tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:14.336257 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-041294ca-82cb-4f39-9a73-98567512fd7b tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:14.337278 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-041294ca-82cb-4f39-9a73-98567512fd7b tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:14.339120 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-041294ca-82cb-4f39-9a73-98567512fd7b tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:14.339858 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-041294ca-82cb-4f39-9a73-98567512fd7b tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:14.479741 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-041294ca-82cb-4f39-9a73-98567512fd7b tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c32defec8443468861dbc8d33e3b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780f91ca8c6f461ba347cd2510dceeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:14.497483 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-041294ca-82cb-4f39-9a73-98567512fd7b tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c32defec8443468861dbc8d33e3b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780f91ca8c6f461ba347cd2510dceeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:14.499396 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-041294ca-82cb-4f39-9a73-98567512fd7b tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c32defec8443468861dbc8d33e3b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780f91ca8c6f461ba347cd2510dceeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:14.501388 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-041294ca-82cb-4f39-9a73-98567512fd7b tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] 10.222.0.61 "GET /compute/v2.1/servers/e8cfd63c-6e99-429f-93f2-ea40c02d7657" status: 200 len: 1336 microversion: 2.47 time: 0.193879 Aug 31 16:11:14.502155 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1681/3396] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:11:14 2022] GET /compute/v2.1/servers/e8cfd63c-6e99-429f-93f2-ea40c02d7657 => generated 1336 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:11:14.512146 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f670dc17-922b-4977-bcba-d31c0232e35f tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:14.526044 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f670dc17-922b-4977-bcba-d31c0232e35f tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c65ee5ffa9d74bfdacbea45f1564d19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55320a9c8f714bc0911ded3ab88ddf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:14.529008 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f670dc17-922b-4977-bcba-d31c0232e35f tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Searching by: {'deleted': False, 'project_id': '55320a9c8f714bc0911ded3ab88ddf31'} {{(pid=122257) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 16:11:14.546462 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f670dc17-922b-4977-bcba-d31c0232e35f tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:14.547255 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f670dc17-922b-4977-bcba-d31c0232e35f tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:14.547915 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f670dc17-922b-4977-bcba-d31c0232e35f tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:14.548837 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f670dc17-922b-4977-bcba-d31c0232e35f tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:14.549514 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f670dc17-922b-4977-bcba-d31c0232e35f tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:14.551084 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f670dc17-922b-4977-bcba-d31c0232e35f tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:14.878342 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.multi_cell_list [None req-f670dc17-922b-4977-bcba-d31c0232e35f tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122257) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 31 16:11:14.940214 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f670dc17-922b-4977-bcba-d31c0232e35f tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c65ee5ffa9d74bfdacbea45f1564d19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55320a9c8f714bc0911ded3ab88ddf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:14.947958 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f670dc17-922b-4977-bcba-d31c0232e35f tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:14.948451 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f670dc17-922b-4977-bcba-d31c0232e35f tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:14.948892 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f670dc17-922b-4977-bcba-d31c0232e35f tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:15.642965 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f670dc17-922b-4977-bcba-d31c0232e35f tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] 10.222.0.61 "GET /compute/v2.1/servers/detail" status: 200 len: 1604 microversion: 2.1 time: 1.138815 Aug 31 16:11:15.644541 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1682/3397] 10.222.0.61 () {58 vars in 1146 bytes} [Wed Aug 31 16:11:14 2022] GET /compute/v2.1/servers/detail => generated 1604 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:15.652145 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-32a367de-474d-45e1-ac92-4f2cceaeebbe req-4970a71a-c8df-4508-87a7-85d382fc1d60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa0932e8-1aa4-4d1a-b653-14be35568f3d", "tag": "10959604-b4b5-4638-81b1-024cf0563917"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:11:15.663957 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-32a367de-474d-45e1-ac92-4f2cceaeebbe req-4970a71a-c8df-4508-87a7-85d382fc1d60 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:15.665200 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-32a367de-474d-45e1-ac92-4f2cceaeebbe req-4970a71a-c8df-4508-87a7-85d382fc1d60 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:15.665612 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-32a367de-474d-45e1-ac92-4f2cceaeebbe req-4970a71a-c8df-4508-87a7-85d382fc1d60 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:15.679730 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-32a367de-474d-45e1-ac92-4f2cceaeebbe req-4970a71a-c8df-4508-87a7-85d382fc1d60 service nova] Creating event network-changed:10959604-b4b5-4638-81b1-024cf0563917 for instance fa0932e8-1aa4-4d1a-b653-14be35568f3d on n-h2-850499-9 Aug 31 16:11:15.685439 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-32a367de-474d-45e1-ac92-4f2cceaeebbe req-4970a71a-c8df-4508-87a7-85d382fc1d60 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039306 Aug 31 16:11:15.686231 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1683/3398] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:11:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:11:15.691761 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-5ffa496a-d30e-4f89-9b79-d37eec8dc3e7 req-51da9e7c-23f1-4f7a-879e-14ceaf81961d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7ae279f-9e24-4755-a912-6bec59837e6c", "name": "network-vif-plugged", "status": "completed", "tag": "8b930bc1-225f-4f61-b131-4d4ae19c2ba2"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:11:15.707666 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-5ffa496a-d30e-4f89-9b79-d37eec8dc3e7 req-51da9e7c-23f1-4f7a-879e-14ceaf81961d service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:15.707666 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-5ffa496a-d30e-4f89-9b79-d37eec8dc3e7 req-51da9e7c-23f1-4f7a-879e-14ceaf81961d service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:15.707914 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-5ffa496a-d30e-4f89-9b79-d37eec8dc3e7 req-51da9e7c-23f1-4f7a-879e-14ceaf81961d service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:15.724470 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-5ffa496a-d30e-4f89-9b79-d37eec8dc3e7 req-51da9e7c-23f1-4f7a-879e-14ceaf81961d service nova] Creating event network-vif-plugged:8b930bc1-225f-4f61-b131-4d4ae19c2ba2 for instance c7ae279f-9e24-4755-a912-6bec59837e6c on n-h2-850499-9 Aug 31 16:11:15.730354 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-5ffa496a-d30e-4f89-9b79-d37eec8dc3e7 req-51da9e7c-23f1-4f7a-879e-14ceaf81961d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042514 Aug 31 16:11:15.730939 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1684/3399] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:11:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:11:15.736525 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-230c25f4-5cc6-44a1-9486-5f5142249a15 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:15.737844 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-230c25f4-5cc6-44a1-9486-5f5142249a15 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] [instance: c7ae279f-9e24-4755-a912-6bec59837e6c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:15.746172 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-230c25f4-5cc6-44a1-9486-5f5142249a15 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:15.747942 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-230c25f4-5cc6-44a1-9486-5f5142249a15 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:15.748768 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-230c25f4-5cc6-44a1-9486-5f5142249a15 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:15.750567 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-230c25f4-5cc6-44a1-9486-5f5142249a15 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:15.751375 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-230c25f4-5cc6-44a1-9486-5f5142249a15 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:15.752000 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-230c25f4-5cc6-44a1-9486-5f5142249a15 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:15.784070 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=100 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:11:16.012308 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-32815ef7-f54e-4311-8797-29d06fd3652f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:11:16.012927 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-32815ef7-f54e-4311-8797-29d06fd3652f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:11:16.013417 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-32815ef7-f54e-4311-8797-29d06fd3652f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:11:16.013857 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-32815ef7-f54e-4311-8797-29d06fd3652f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:11:16.014573 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-32815ef7-f54e-4311-8797-29d06fd3652f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:11:16.033760 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-32815ef7-f54e-4311-8797-29d06fd3652f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:16.034294 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-32815ef7-f54e-4311-8797-29d06fd3652f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:16.039997 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-32815ef7-f54e-4311-8797-29d06fd3652f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:16.040701 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-32815ef7-f54e-4311-8797-29d06fd3652f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:16.041247 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-32815ef7-f54e-4311-8797-29d06fd3652f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:16.042489 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-32815ef7-f54e-4311-8797-29d06fd3652f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:16.067191 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-32815ef7-f54e-4311-8797-29d06fd3652f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Getting quotas for project 5299955053c842b6aa02e058f4b1c0cb. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:11:16.074545 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-32815ef7-f54e-4311-8797-29d06fd3652f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Getting quotas for user 6e707652819c497bbdf94f85f39c447a and project 5299955053c842b6aa02e058f4b1c0cb. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:11:16.100758 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-32815ef7-f54e-4311-8797-29d06fd3652f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Going to run 1 instances... {{(pid=122256) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:11:16.124769 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-32815ef7-f54e-4311-8797-29d06fd3652f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: d291088a-652f-4c17-8e1e-c54e91c2c1f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:11:16.204425 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-32815ef7-f54e-4311-8797-29d06fd3652f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.128879 Aug 31 16:11:16.215639 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1716/3400] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:11:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 2141 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:11:16.224791 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1c29dfa7-23b4-4b4f-9ea7-5293cc2df65c tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:16.226000 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1c29dfa7-23b4-4b4f-9ea7-5293cc2df65c tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] [instance: 685d47e4-721e-4eae-b5f8-78fdb68454ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:16.237694 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1c29dfa7-23b4-4b4f-9ea7-5293cc2df65c tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:16.238460 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1c29dfa7-23b4-4b4f-9ea7-5293cc2df65c tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:16.239735 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1c29dfa7-23b4-4b4f-9ea7-5293cc2df65c tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:16.241045 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1c29dfa7-23b4-4b4f-9ea7-5293cc2df65c tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:16.242423 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1c29dfa7-23b4-4b4f-9ea7-5293cc2df65c tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:16.242944 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1c29dfa7-23b4-4b4f-9ea7-5293cc2df65c tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:16.420978 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-230c25f4-5cc6-44a1-9486-5f5142249a15 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13cabcaa79043bea338128594a6b00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab7f0d889224cefbca55343f3208a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:16.428966 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-230c25f4-5cc6-44a1-9486-5f5142249a15 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] 10.222.0.61 "GET /compute/v2.1/servers/c7ae279f-9e24-4755-a912-6bec59837e6c" status: 200 len: 1323 microversion: 2.1 time: 0.696686 Aug 31 16:11:16.430194 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1685/3401] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:15 2022] GET /compute/v2.1/servers/c7ae279f-9e24-4755-a912-6bec59837e6c => generated 1323 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:16.449111 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e5a54991-8a2f-4a9c-8734-fb04f971d64f tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:16.449892 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e5a54991-8a2f-4a9c-8734-fb04f971d64f tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] [instance: fa0932e8-1aa4-4d1a-b653-14be35568f3d] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:16.462203 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e5a54991-8a2f-4a9c-8734-fb04f971d64f tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:16.462792 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e5a54991-8a2f-4a9c-8734-fb04f971d64f tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:16.465707 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e5a54991-8a2f-4a9c-8734-fb04f971d64f tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:16.466745 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e5a54991-8a2f-4a9c-8734-fb04f971d64f tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:16.468927 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e5a54991-8a2f-4a9c-8734-fb04f971d64f tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:16.469392 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e5a54991-8a2f-4a9c-8734-fb04f971d64f tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:16.809433 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1c29dfa7-23b4-4b4f-9ea7-5293cc2df65c tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:16.821018 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1c29dfa7-23b4-4b4f-9ea7-5293cc2df65c tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:16.833914 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1c29dfa7-23b4-4b4f-9ea7-5293cc2df65c tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:16.836785 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1c29dfa7-23b4-4b4f-9ea7-5293cc2df65c tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] 10.222.0.61 "GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae" status: 200 len: 2873 microversion: 2.42 time: 0.619927 Aug 31 16:11:16.837668 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1717/3402] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:11:16 2022] GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae => generated 2873 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:11:16.848078 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c67aace1-901f-43a7-8c5f-a06eaf5800ba tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:16.856548 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c67aace1-901f-43a7-8c5f-a06eaf5800ba tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] [instance: e8cfd63c-6e99-429f-93f2-ea40c02d7657] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:16.864977 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c67aace1-901f-43a7-8c5f-a06eaf5800ba tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:16.872574 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c67aace1-901f-43a7-8c5f-a06eaf5800ba tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:16.873501 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c67aace1-901f-43a7-8c5f-a06eaf5800ba tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:16.874593 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c67aace1-901f-43a7-8c5f-a06eaf5800ba tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:16.875265 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c67aace1-901f-43a7-8c5f-a06eaf5800ba tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:16.876079 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c67aace1-901f-43a7-8c5f-a06eaf5800ba tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:17.073645 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c67aace1-901f-43a7-8c5f-a06eaf5800ba tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c32defec8443468861dbc8d33e3b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780f91ca8c6f461ba347cd2510dceeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:17.083349 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c67aace1-901f-43a7-8c5f-a06eaf5800ba tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c32defec8443468861dbc8d33e3b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780f91ca8c6f461ba347cd2510dceeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:17.088941 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c67aace1-901f-43a7-8c5f-a06eaf5800ba tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c32defec8443468861dbc8d33e3b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780f91ca8c6f461ba347cd2510dceeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:17.097186 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c67aace1-901f-43a7-8c5f-a06eaf5800ba tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] 10.222.0.61 "GET /compute/v2.1/servers/e8cfd63c-6e99-429f-93f2-ea40c02d7657" status: 200 len: 1336 microversion: 2.47 time: 0.258084 Aug 31 16:11:17.124282 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1718/3403] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:11:16 2022] GET /compute/v2.1/servers/e8cfd63c-6e99-429f-93f2-ea40c02d7657 => generated 1336 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:11:17.132526 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2e7124c9-449e-4826-a42e-ee0fdd128a3e tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:17.141520 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e5a54991-8a2f-4a9c-8734-fb04f971d64f tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:17.142173 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2e7124c9-449e-4826-a42e-ee0fdd128a3e tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] 10.222.0.61 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015743 Aug 31 16:11:17.143315 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1719/3404] 10.222.0.61 () {58 vars in 1137 bytes} [Wed Aug 31 16:11:17 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:11:17.162006 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e5a54991-8a2f-4a9c-8734-fb04f971d64f tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:17.171418 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8d44149d-ed11-4ea1-82b2-ce82ef5da828 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:17.172218 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8d44149d-ed11-4ea1-82b2-ce82ef5da828 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: d291088a-652f-4c17-8e1e-c54e91c2c1f2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:17.182123 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e5a54991-8a2f-4a9c-8734-fb04f971d64f tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:17.190812 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e5a54991-8a2f-4a9c-8734-fb04f971d64f tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] 10.222.0.61 "GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d" status: 200 len: 1879 microversion: 2.32 time: 0.754312 Aug 31 16:11:17.195185 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8d44149d-ed11-4ea1-82b2-ce82ef5da828 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:17.197706 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1686/3405] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:11:16 2022] GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d => generated 1879 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:11:17.198801 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8d44149d-ed11-4ea1-82b2-ce82ef5da828 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:17.201073 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8d44149d-ed11-4ea1-82b2-ce82ef5da828 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:17.202660 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8d44149d-ed11-4ea1-82b2-ce82ef5da828 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:17.204556 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8d44149d-ed11-4ea1-82b2-ce82ef5da828 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:17.205348 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8d44149d-ed11-4ea1-82b2-ce82ef5da828 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:17.260878 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8d44149d-ed11-4ea1-82b2-ce82ef5da828 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: d291088a-652f-4c17-8e1e-c54e91c2c1f2] Going to try to terminate instance {{(pid=122256) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:11:17.276570 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8d44149d-ed11-4ea1-82b2-ce82ef5da828 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:17.277233 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8d44149d-ed11-4ea1-82b2-ce82ef5da828 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:17.278032 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8d44149d-ed11-4ea1-82b2-ce82ef5da828 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:17.337876 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-8d44149d-ed11-4ea1-82b2-ce82ef5da828 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lazy-loading 'flavor' on Instance uuid d291088a-652f-4c17-8e1e-c54e91c2c1f2 {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:11:17.363161 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-8d44149d-ed11-4ea1-82b2-ce82ef5da828 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lazy-loading 'system_metadata' on Instance uuid d291088a-652f-4c17-8e1e-c54e91c2c1f2 {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:11:17.452520 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b76fe51f-fb01-4474-8d81-84ae278809c1 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:17.453155 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b76fe51f-fb01-4474-8d81-84ae278809c1 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] [instance: c7ae279f-9e24-4755-a912-6bec59837e6c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:17.456892 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-8d44149d-ed11-4ea1-82b2-ce82ef5da828 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lazy-loading 'metadata' on Instance uuid d291088a-652f-4c17-8e1e-c54e91c2c1f2 {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:11:17.471856 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b76fe51f-fb01-4474-8d81-84ae278809c1 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:17.472507 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b76fe51f-fb01-4474-8d81-84ae278809c1 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:17.474463 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b76fe51f-fb01-4474-8d81-84ae278809c1 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:17.475945 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b76fe51f-fb01-4474-8d81-84ae278809c1 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:17.476543 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b76fe51f-fb01-4474-8d81-84ae278809c1 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:17.481039 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b76fe51f-fb01-4474-8d81-84ae278809c1 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:17.850928 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.scheduler.client.report [None req-8d44149d-ed11-4ea1-82b2-ce82ef5da828 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Deleted allocations for instance d291088a-652f-4c17-8e1e-c54e91c2c1f2 Aug 31 16:11:17.891188 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8d44149d-ed11-4ea1-82b2-ce82ef5da828 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "DELETE /compute/v2.1/servers/d291088a-652f-4c17-8e1e-c54e91c2c1f2" status: 204 len: 0 microversion: 2.1 time: 0.746228 Aug 31 16:11:17.892208 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1720/3406] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:11:17 2022] DELETE /compute/v2.1/servers/d291088a-652f-4c17-8e1e-c54e91c2c1f2 => generated 0 bytes in 748 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:11:17.906055 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4f7b698e-2935-4135-a50e-97336ef2607f tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:17.908588 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4f7b698e-2935-4135-a50e-97336ef2607f tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] [instance: 0ac914d2-e9f7-4f2f-a01d-49674180d8db] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:17.931120 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4f7b698e-2935-4135-a50e-97336ef2607f tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:17.934094 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4f7b698e-2935-4135-a50e-97336ef2607f tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:17.935711 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4f7b698e-2935-4135-a50e-97336ef2607f tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:17.940183 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4f7b698e-2935-4135-a50e-97336ef2607f tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:17.942436 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4f7b698e-2935-4135-a50e-97336ef2607f tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:17.945821 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4f7b698e-2935-4135-a50e-97336ef2607f tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:17.954284 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b76fe51f-fb01-4474-8d81-84ae278809c1 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13cabcaa79043bea338128594a6b00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab7f0d889224cefbca55343f3208a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:17.976922 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b76fe51f-fb01-4474-8d81-84ae278809c1 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] 10.222.0.61 "GET /compute/v2.1/servers/c7ae279f-9e24-4755-a912-6bec59837e6c" status: 200 len: 1323 microversion: 2.1 time: 0.529000 Aug 31 16:11:17.977855 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1687/3407] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:17 2022] GET /compute/v2.1/servers/c7ae279f-9e24-4755-a912-6bec59837e6c => generated 1323 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:11:17.982676 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-8959b9cd-1803-4d50-936c-f8cea4b5c58f req-a229eaa0-5ba5-49fc-9cfa-f3d79b7f2fa4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa0932e8-1aa4-4d1a-b653-14be35568f3d", "tag": "887de267-2677-4f4b-8c82-d09ad6ad6fde"}, {"server_uuid": "685d47e4-721e-4eae-b5f8-78fdb68454ae", "name": "network-vif-deleted", "tag": "b14c9074-fcb3-408a-abec-9842ca262740"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:11:18.036703 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4f7b698e-2935-4135-a50e-97336ef2607f tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] [instance: 0ac914d2-e9f7-4f2f-a01d-49674180d8db] Going to try to terminate instance {{(pid=122256) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:11:18.038174 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-8959b9cd-1803-4d50-936c-f8cea4b5c58f req-a229eaa0-5ba5-49fc-9cfa-f3d79b7f2fa4 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:18.038902 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-8959b9cd-1803-4d50-936c-f8cea4b5c58f req-a229eaa0-5ba5-49fc-9cfa-f3d79b7f2fa4 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:18.039361 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-8959b9cd-1803-4d50-936c-f8cea4b5c58f req-a229eaa0-5ba5-49fc-9cfa-f3d79b7f2fa4 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:18.079524 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-8959b9cd-1803-4d50-936c-f8cea4b5c58f req-a229eaa0-5ba5-49fc-9cfa-f3d79b7f2fa4 service nova] Creating event network-changed:887de267-2677-4f4b-8c82-d09ad6ad6fde for instance fa0932e8-1aa4-4d1a-b653-14be35568f3d on n-h2-850499-9 Aug 31 16:11:18.080133 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-8959b9cd-1803-4d50-936c-f8cea4b5c58f req-a229eaa0-5ba5-49fc-9cfa-f3d79b7f2fa4 service nova] Creating event network-vif-deleted:b14c9074-fcb3-408a-abec-9842ca262740 for instance 685d47e4-721e-4eae-b5f8-78fdb68454ae on n-h2-850499-9 Aug 31 16:11:18.095177 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-8959b9cd-1803-4d50-936c-f8cea4b5c58f req-a229eaa0-5ba5-49fc-9cfa-f3d79b7f2fa4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.116024 Aug 31 16:11:18.095858 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1688/3408] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:11:17 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:11:18.122653 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e86ff566-b8a1-444d-9ee0-2b263b23e2e3 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:18.124502 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e86ff566-b8a1-444d-9ee0-2b263b23e2e3 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] [instance: 685d47e4-721e-4eae-b5f8-78fdb68454ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:18.143409 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e86ff566-b8a1-444d-9ee0-2b263b23e2e3 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:18.144391 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e86ff566-b8a1-444d-9ee0-2b263b23e2e3 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:18.145122 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e86ff566-b8a1-444d-9ee0-2b263b23e2e3 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:18.151736 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e86ff566-b8a1-444d-9ee0-2b263b23e2e3 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:18.152273 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e86ff566-b8a1-444d-9ee0-2b263b23e2e3 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:18.152750 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e86ff566-b8a1-444d-9ee0-2b263b23e2e3 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:18.251667 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4f7b698e-2935-4135-a50e-97336ef2607f tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] 10.222.0.61 "DELETE /compute/v2.1/servers/0ac914d2-e9f7-4f2f-a01d-49674180d8db" status: 204 len: 0 microversion: 2.1 time: 0.356780 Aug 31 16:11:18.253984 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1721/3409] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:11:17 2022] DELETE /compute/v2.1/servers/0ac914d2-e9f7-4f2f-a01d-49674180d8db => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:11:18.265943 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-da2c75b6-b3f8-43bd-9017-1e767263d986 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:18.270956 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-da2c75b6-b3f8-43bd-9017-1e767263d986 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: d291088a-652f-4c17-8e1e-c54e91c2c1f2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:18.291737 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-da2c75b6-b3f8-43bd-9017-1e767263d986 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:18.292540 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-da2c75b6-b3f8-43bd-9017-1e767263d986 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:18.296952 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-da2c75b6-b3f8-43bd-9017-1e767263d986 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:18.297914 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-da2c75b6-b3f8-43bd-9017-1e767263d986 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:18.298554 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-da2c75b6-b3f8-43bd-9017-1e767263d986 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:18.299152 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-da2c75b6-b3f8-43bd-9017-1e767263d986 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:18.371065 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-da2c75b6-b3f8-43bd-9017-1e767263d986 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] HTTP exception thrown: Instance d291088a-652f-4c17-8e1e-c54e91c2c1f2 could not be found. Aug 31 16:11:18.373380 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-da2c75b6-b3f8-43bd-9017-1e767263d986 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Request method failure captured: Aug 31 16:11:18.373380 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/d291088a-652f-4c17-8e1e-c54e91c2c1f2 HTTP/1.1 Aug 31 16:11:18.373380 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:11:18.373380 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:11:18.373380 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:11:18.373380 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:11:18.373380 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:11:18.373380 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:11:18.373380 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:11:18.373380 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:11:18.373380 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4gQXSNpx7T-s6ANX8A4XIz6BgCizm9VWKy6e0KLRI2pxjPOEzPLkRnoXGF3D-Jh3OWl1h65DNjP8YomYmS0bGyt_8avVSC7qeEvUleLImq7o7EhFYQT7JAMgMioD10eCPOZ7QHRsEPDslLrPXcQD5t1iAsH1xyWK7dbpfjoYLGjDpU Aug 31 16:11:18.373380 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:11:18.373380 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:11:18.373380 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:11:18.373380 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:11:18.373380 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:11:18.373380 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:11:18.373380 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 5299955053c842b6aa02e058f4b1c0cb Aug 31 16:11:18.373380 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ServersTestJSON-1028152372 Aug 31 16:11:18.373380 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:11:18.373380 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:11:18.373380 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5299955053c842b6aa02e058f4b1c0cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5299955053c842b6aa02e058f4b1c0cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5299955053c842b6aa02e058f4b1c0cb", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5299955053c842b6aa02e058f4b1c0cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:11:18.373380 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ServersTestJSON-1028152372 Aug 31 16:11:18.373380 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 5299955053c842b6aa02e058f4b1c0cb Aug 31 16:11:18.373380 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ServersTestJSON-1028152372 Aug 31 16:11:18.373380 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ServersTestJSON-1028152372-project Aug 31 16:11:18.373380 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:11:18.373380 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:11:18.373380 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 6e707652819c497bbdf94f85f39c447a Aug 31 16:11:18.373380 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ServersTestJSON-1028152372-project Aug 31 16:11:18.373380 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:11:18.373380 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance d291088a-652f-4c17-8e1e-c54e91c2c1f2 could not be found. Aug 31 16:11:18.373380 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': 'd291088a-652f-4c17-8e1e-c54e91c2c1f2'} Aug 31 16:11:18.373380 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:11:18.373380 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:11:18.373380 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:11:18.373380 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:11:18.373380 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:11:18.373380 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:11:18.373380 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:11:18.373380 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:11:18.373380 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:11:18.373380 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:11:18.373380 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d291088a-652f-4c17-8e1e-c54e91c2c1f2 could not be found. Aug 31 16:11:18.373380 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:11:18.373380 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:11:18.373380 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:11:18.373380 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:11:18.373380 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:11:18.373380 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:11:18.373380 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:11:18.373380 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:11:18.373380 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:11:18.373380 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:11:18.373380 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:11:18.373380 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:11:18.373380 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:11:18.373380 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:11:18.373380 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:11:18.373380 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:11:18.373380 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d291088a-652f-4c17-8e1e-c54e91c2c1f2 could not be found. Aug 31 16:11:18.373380 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:11:18.373380 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:11:18.373380 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:11:18.379623 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:11:18.379623 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:11:18.379623 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:11:18.379623 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:11:18.379623 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:11:18.379623 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d291088a-652f-4c17-8e1e-c54e91c2c1f2 could not be found. Aug 31 16:11:18.379623 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:11:18.381184 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-da2c75b6-b3f8-43bd-9017-1e767263d986 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Returning 404 to user: Instance d291088a-652f-4c17-8e1e-c54e91c2c1f2 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:11:18.382390 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-da2c75b6-b3f8-43bd-9017-1e767263d986 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/d291088a-652f-4c17-8e1e-c54e91c2c1f2" status: 404 len: 111 microversion: 2.1 time: 0.126960 Aug 31 16:11:18.383693 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1722/3410] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:18 2022] GET /compute/v2.1/servers/d291088a-652f-4c17-8e1e-c54e91c2c1f2 => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:11:18.390982 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e5efe7f6-4934-49dc-8ea9-ee9d1d30cd2c tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:18.406743 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e5efe7f6-4934-49dc-8ea9-ee9d1d30cd2c tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] [instance: e8cfd63c-6e99-429f-93f2-ea40c02d7657] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:18.427790 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e5efe7f6-4934-49dc-8ea9-ee9d1d30cd2c tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:18.428793 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e5efe7f6-4934-49dc-8ea9-ee9d1d30cd2c tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:18.429979 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e5efe7f6-4934-49dc-8ea9-ee9d1d30cd2c tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:18.432889 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e5efe7f6-4934-49dc-8ea9-ee9d1d30cd2c tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:18.433770 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e5efe7f6-4934-49dc-8ea9-ee9d1d30cd2c tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:18.434374 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e5efe7f6-4934-49dc-8ea9-ee9d1d30cd2c tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:18.666196 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e5efe7f6-4934-49dc-8ea9-ee9d1d30cd2c tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c32defec8443468861dbc8d33e3b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780f91ca8c6f461ba347cd2510dceeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:18.679813 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e5efe7f6-4934-49dc-8ea9-ee9d1d30cd2c tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c32defec8443468861dbc8d33e3b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780f91ca8c6f461ba347cd2510dceeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:18.687828 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e5efe7f6-4934-49dc-8ea9-ee9d1d30cd2c tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c32defec8443468861dbc8d33e3b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780f91ca8c6f461ba347cd2510dceeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:18.687828 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e5efe7f6-4934-49dc-8ea9-ee9d1d30cd2c tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] 10.222.0.61 "GET /compute/v2.1/servers/e8cfd63c-6e99-429f-93f2-ea40c02d7657" status: 200 len: 1336 microversion: 2.47 time: 0.298409 Aug 31 16:11:18.687828 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1723/3411] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:11:18 2022] GET /compute/v2.1/servers/e8cfd63c-6e99-429f-93f2-ea40c02d7657 => generated 1336 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:11:18.691981 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-dc440e1f-72e5-4cce-a44c-baa5b07179c1 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:18.692792 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-dc440e1f-72e5-4cce-a44c-baa5b07179c1 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] [instance: fa0932e8-1aa4-4d1a-b653-14be35568f3d] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:18.701653 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dc440e1f-72e5-4cce-a44c-baa5b07179c1 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:18.702501 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dc440e1f-72e5-4cce-a44c-baa5b07179c1 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:18.703184 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dc440e1f-72e5-4cce-a44c-baa5b07179c1 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:18.705083 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dc440e1f-72e5-4cce-a44c-baa5b07179c1 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:18.705339 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dc440e1f-72e5-4cce-a44c-baa5b07179c1 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:18.705843 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dc440e1f-72e5-4cce-a44c-baa5b07179c1 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:18.971515 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e86ff566-b8a1-444d-9ee0-2b263b23e2e3 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:18.987887 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e86ff566-b8a1-444d-9ee0-2b263b23e2e3 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:18.990268 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e86ff566-b8a1-444d-9ee0-2b263b23e2e3 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:18.992116 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e86ff566-b8a1-444d-9ee0-2b263b23e2e3 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] 10.222.0.61 "GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae" status: 200 len: 2873 microversion: 2.42 time: 0.880580 Aug 31 16:11:18.993475 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1689/3412] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:11:18 2022] GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae => generated 2873 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:11:19.011821 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-403897f9-32b7-451e-9327-27e0e3916b41 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:19.012809 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-403897f9-32b7-451e-9327-27e0e3916b41 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] [instance: 0ac914d2-e9f7-4f2f-a01d-49674180d8db] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:19.021620 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-403897f9-32b7-451e-9327-27e0e3916b41 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:19.026512 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-403897f9-32b7-451e-9327-27e0e3916b41 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:19.035039 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-403897f9-32b7-451e-9327-27e0e3916b41 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:19.036601 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-403897f9-32b7-451e-9327-27e0e3916b41 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:19.038909 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-403897f9-32b7-451e-9327-27e0e3916b41 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:19.039373 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-403897f9-32b7-451e-9327-27e0e3916b41 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:19.135366 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-dc440e1f-72e5-4cce-a44c-baa5b07179c1 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:19.162970 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-dc440e1f-72e5-4cce-a44c-baa5b07179c1 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:19.169135 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-dc440e1f-72e5-4cce-a44c-baa5b07179c1 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:19.173109 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-dc440e1f-72e5-4cce-a44c-baa5b07179c1 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] 10.222.0.61 "GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d" status: 200 len: 1879 microversion: 2.32 time: 0.486453 Aug 31 16:11:19.175064 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1724/3413] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:11:18 2022] GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d => generated 1879 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:11:19.204715 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5a2e6b53-5488-4288-a770-71d26356464d tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-315489521", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "e418f255-318f-476c-a353-8d292b5f7798"}]}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:11:19.385027 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-5a2e6b53-5488-4288-a770-71d26356464d tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] validate_networks() for [('e418f255-318f-476c-a353-8d292b5f7798', None, None, None, None, None)] {{(pid=122256) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:11:19.586406 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-403897f9-32b7-451e-9327-27e0e3916b41 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c65ee5ffa9d74bfdacbea45f1564d19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55320a9c8f714bc0911ded3ab88ddf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:19.623200 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-403897f9-32b7-451e-9327-27e0e3916b41 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] 10.222.0.61 "GET /compute/v2.1/servers/0ac914d2-e9f7-4f2f-a01d-49674180d8db" status: 200 len: 1607 microversion: 2.1 time: 0.619696 Aug 31 16:11:19.626010 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1690/3414] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:18 2022] GET /compute/v2.1/servers/0ac914d2-e9f7-4f2f-a01d-49674180d8db => generated 1607 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:19.654546 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-70d974fe-d489-4a82-9c2b-36a3509b8039 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:19.656381 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-70d974fe-d489-4a82-9c2b-36a3509b8039 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] [instance: c7ae279f-9e24-4755-a912-6bec59837e6c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:19.679752 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-70d974fe-d489-4a82-9c2b-36a3509b8039 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:19.681040 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-70d974fe-d489-4a82-9c2b-36a3509b8039 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:19.682023 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-70d974fe-d489-4a82-9c2b-36a3509b8039 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:19.683581 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-70d974fe-d489-4a82-9c2b-36a3509b8039 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:19.684589 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-70d974fe-d489-4a82-9c2b-36a3509b8039 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:19.685552 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-70d974fe-d489-4a82-9c2b-36a3509b8039 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:21.066755 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-70d974fe-d489-4a82-9c2b-36a3509b8039 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13cabcaa79043bea338128594a6b00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab7f0d889224cefbca55343f3208a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:21.076025 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-70d974fe-d489-4a82-9c2b-36a3509b8039 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] 10.222.0.61 "GET /compute/v2.1/servers/c7ae279f-9e24-4755-a912-6bec59837e6c" status: 200 len: 1520 microversion: 2.1 time: 1.448106 Aug 31 16:11:21.076323 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1691/3415] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:19 2022] GET /compute/v2.1/servers/c7ae279f-9e24-4755-a912-6bec59837e6c => generated 1520 bytes in 1450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:21.099841 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3762d1a4-1884-4336-95d4-924d9aaacefe tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:21.100773 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3762d1a4-1884-4336-95d4-924d9aaacefe tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] [instance: e8cfd63c-6e99-429f-93f2-ea40c02d7657] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:21.110334 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3762d1a4-1884-4336-95d4-924d9aaacefe tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:21.111758 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3762d1a4-1884-4336-95d4-924d9aaacefe tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:21.112577 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3762d1a4-1884-4336-95d4-924d9aaacefe tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:21.113515 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3762d1a4-1884-4336-95d4-924d9aaacefe tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:21.114207 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3762d1a4-1884-4336-95d4-924d9aaacefe tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:21.115091 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3762d1a4-1884-4336-95d4-924d9aaacefe tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:21.424709 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3762d1a4-1884-4336-95d4-924d9aaacefe tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c32defec8443468861dbc8d33e3b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780f91ca8c6f461ba347cd2510dceeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:21.440896 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3762d1a4-1884-4336-95d4-924d9aaacefe tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c32defec8443468861dbc8d33e3b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780f91ca8c6f461ba347cd2510dceeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:21.442338 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3762d1a4-1884-4336-95d4-924d9aaacefe tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c32defec8443468861dbc8d33e3b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780f91ca8c6f461ba347cd2510dceeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:21.444335 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3762d1a4-1884-4336-95d4-924d9aaacefe tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] 10.222.0.61 "GET /compute/v2.1/servers/e8cfd63c-6e99-429f-93f2-ea40c02d7657" status: 200 len: 1357 microversion: 2.47 time: 0.348880 Aug 31 16:11:21.445188 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1692/3416] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:11:21 2022] GET /compute/v2.1/servers/e8cfd63c-6e99-429f-93f2-ea40c02d7657 => generated 1357 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:11:21.474102 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8c341910-c824-4ab7-882a-57452eab5a68 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:21.474986 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8c341910-c824-4ab7-882a-57452eab5a68 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] [instance: 685d47e4-721e-4eae-b5f8-78fdb68454ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:21.482947 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8c341910-c824-4ab7-882a-57452eab5a68 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:21.483979 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8c341910-c824-4ab7-882a-57452eab5a68 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:21.484627 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8c341910-c824-4ab7-882a-57452eab5a68 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:21.485871 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8c341910-c824-4ab7-882a-57452eab5a68 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:21.486547 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8c341910-c824-4ab7-882a-57452eab5a68 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:21.487151 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8c341910-c824-4ab7-882a-57452eab5a68 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:21.672252 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-5a2e6b53-5488-4288-a770-71d26356464d tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:11:21.675215 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-5a2e6b53-5488-4288-a770-71d26356464d tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:11:21.676546 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-5a2e6b53-5488-4288-a770-71d26356464d tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:11:21.678310 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-5a2e6b53-5488-4288-a770-71d26356464d tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:11:21.679005 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-5a2e6b53-5488-4288-a770-71d26356464d tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:11:21.704451 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5a2e6b53-5488-4288-a770-71d26356464d tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:21.707428 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5a2e6b53-5488-4288-a770-71d26356464d tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:21.710314 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5a2e6b53-5488-4288-a770-71d26356464d tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:21.712243 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5a2e6b53-5488-4288-a770-71d26356464d tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:21.715360 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5a2e6b53-5488-4288-a770-71d26356464d tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:21.716215 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5a2e6b53-5488-4288-a770-71d26356464d tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:21.777805 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-5a2e6b53-5488-4288-a770-71d26356464d tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Getting quotas for project 5299955053c842b6aa02e058f4b1c0cb. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:11:21.797809 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-5a2e6b53-5488-4288-a770-71d26356464d tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Getting quotas for user 6e707652819c497bbdf94f85f39c447a and project 5299955053c842b6aa02e058f4b1c0cb. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:11:21.834965 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5a2e6b53-5488-4288-a770-71d26356464d tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Going to run 1 instances... {{(pid=122256) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:11:21.838666 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5a2e6b53-5488-4288-a770-71d26356464d tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 519c7ca0-6d6b-4250-9b7b-8d5b6ef3b6b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:11:21.964996 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5a2e6b53-5488-4288-a770-71d26356464d tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.785128 Aug 31 16:11:21.965923 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1725/3417] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:11:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 2790 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:11:21.978388 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4e742929-1436-4adb-b9c2-e5ba6b01ba35 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:21.979303 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4e742929-1436-4adb-b9c2-e5ba6b01ba35 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] [instance: fa0932e8-1aa4-4d1a-b653-14be35568f3d] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:21.986339 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4e742929-1436-4adb-b9c2-e5ba6b01ba35 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:21.987072 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4e742929-1436-4adb-b9c2-e5ba6b01ba35 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:21.987733 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4e742929-1436-4adb-b9c2-e5ba6b01ba35 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:21.988608 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4e742929-1436-4adb-b9c2-e5ba6b01ba35 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:21.989251 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4e742929-1436-4adb-b9c2-e5ba6b01ba35 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:21.990029 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4e742929-1436-4adb-b9c2-e5ba6b01ba35 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:22.045157 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=12,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:11:22.226740 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8c341910-c824-4ab7-882a-57452eab5a68 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:22.243530 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8c341910-c824-4ab7-882a-57452eab5a68 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:22.249407 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8c341910-c824-4ab7-882a-57452eab5a68 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:22.256919 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8c341910-c824-4ab7-882a-57452eab5a68 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] 10.222.0.61 "GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae" status: 200 len: 2827 microversion: 2.42 time: 0.794040 Aug 31 16:11:22.260575 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1693/3418] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:11:21 2022] GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae => generated 2827 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:11:22.524083 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-b6fed849-2b96-4a96-bb96-de04e48184eb req-c4a82d1b-003c-4fd9-9400-09ca0845b9d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "685d47e4-721e-4eae-b5f8-78fdb68454ae", "name": "network-vif-deleted", "tag": "8734df6b-18ab-45c5-8c67-15fbeeb4e447"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:11:22.544437 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-b6fed849-2b96-4a96-bb96-de04e48184eb req-c4a82d1b-003c-4fd9-9400-09ca0845b9d7 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:22.544931 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-b6fed849-2b96-4a96-bb96-de04e48184eb req-c4a82d1b-003c-4fd9-9400-09ca0845b9d7 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:22.545365 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-b6fed849-2b96-4a96-bb96-de04e48184eb req-c4a82d1b-003c-4fd9-9400-09ca0845b9d7 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:22.585239 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-b6fed849-2b96-4a96-bb96-de04e48184eb req-c4a82d1b-003c-4fd9-9400-09ca0845b9d7 service nova] Creating event network-vif-deleted:8734df6b-18ab-45c5-8c67-15fbeeb4e447 for instance 685d47e4-721e-4eae-b5f8-78fdb68454ae on n-h2-850499-9 Aug 31 16:11:22.597009 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-b6fed849-2b96-4a96-bb96-de04e48184eb req-c4a82d1b-003c-4fd9-9400-09ca0845b9d7 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.333872 Aug 31 16:11:22.598957 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1694/3419] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:11:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:11:22.618087 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c686a70a-c5b4-4a0a-b68b-f7227eb3041a tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:22.622183 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c686a70a-c5b4-4a0a-b68b-f7227eb3041a tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] [instance: 0ac914d2-e9f7-4f2f-a01d-49674180d8db] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:22.656256 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c686a70a-c5b4-4a0a-b68b-f7227eb3041a tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:22.656993 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c686a70a-c5b4-4a0a-b68b-f7227eb3041a tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:22.658653 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c686a70a-c5b4-4a0a-b68b-f7227eb3041a tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:22.661042 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c686a70a-c5b4-4a0a-b68b-f7227eb3041a tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:22.668639 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c686a70a-c5b4-4a0a-b68b-f7227eb3041a tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:22.669572 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c686a70a-c5b4-4a0a-b68b-f7227eb3041a tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:23.051668 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-4e742929-1436-4adb-b9c2-e5ba6b01ba35 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:23.064310 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-4e742929-1436-4adb-b9c2-e5ba6b01ba35 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:23.065946 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-4e742929-1436-4adb-b9c2-e5ba6b01ba35 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:23.076591 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4e742929-1436-4adb-b9c2-e5ba6b01ba35 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] 10.222.0.61 "GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d" status: 200 len: 1879 microversion: 2.32 time: 1.105389 Aug 31 16:11:23.092130 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1726/3420] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:11:21 2022] GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d => generated 1879 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:11:23.099019 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8ad31737-0850-48d1-8ace-4b99a2e15d7e tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.6.121"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:11:23.102394 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8ad31737-0850-48d1-8ace-4b99a2e15d7e tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] [instance: 606f1624-8c53-409e-b06b-ace080f7fc44] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:23.110410 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8ad31737-0850-48d1-8ace-4b99a2e15d7e tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:23.110916 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8ad31737-0850-48d1-8ace-4b99a2e15d7e tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:23.111355 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8ad31737-0850-48d1-8ace-4b99a2e15d7e tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:23.112466 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8ad31737-0850-48d1-8ace-4b99a2e15d7e tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:23.113098 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8ad31737-0850-48d1-8ace-4b99a2e15d7e tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:23.117352 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8ad31737-0850-48d1-8ace-4b99a2e15d7e tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:23.176834 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8ad31737-0850-48d1-8ace-4b99a2e15d7e tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquiring lock "refresh_cache-606f1624-8c53-409e-b06b-ace080f7fc44" {{(pid=122256) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 31 16:11:23.177259 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8ad31737-0850-48d1-8ace-4b99a2e15d7e tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquired lock "refresh_cache-606f1624-8c53-409e-b06b-ace080f7fc44" {{(pid=122256) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 31 16:11:23.730319 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c686a70a-c5b4-4a0a-b68b-f7227eb3041a tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c65ee5ffa9d74bfdacbea45f1564d19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55320a9c8f714bc0911ded3ab88ddf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:23.757263 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c686a70a-c5b4-4a0a-b68b-f7227eb3041a tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] 10.222.0.61 "GET /compute/v2.1/servers/0ac914d2-e9f7-4f2f-a01d-49674180d8db" status: 200 len: 1607 microversion: 2.1 time: 1.150163 Aug 31 16:11:23.758081 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1695/3421] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:22 2022] GET /compute/v2.1/servers/0ac914d2-e9f7-4f2f-a01d-49674180d8db => generated 1607 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:23.766172 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b19ed299-557b-4a3e-8601-cedab85db385 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:11:23.768740 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b19ed299-557b-4a3e-8601-cedab85db385 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] [instance: e8cfd63c-6e99-429f-93f2-ea40c02d7657] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:23.797221 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b19ed299-557b-4a3e-8601-cedab85db385 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:23.798046 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b19ed299-557b-4a3e-8601-cedab85db385 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:23.798718 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b19ed299-557b-4a3e-8601-cedab85db385 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:23.799836 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b19ed299-557b-4a3e-8601-cedab85db385 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:23.800536 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b19ed299-557b-4a3e-8601-cedab85db385 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:23.801779 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b19ed299-557b-4a3e-8601-cedab85db385 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:23.900601 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-b19ed299-557b-4a3e-8601-cedab85db385 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:11:23.901030 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-b19ed299-557b-4a3e-8601-cedab85db385 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:11:23.901513 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-b19ed299-557b-4a3e-8601-cedab85db385 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:11:23.901927 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-b19ed299-557b-4a3e-8601-cedab85db385 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:11:23.902345 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-b19ed299-557b-4a3e-8601-cedab85db385 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:11:23.981970 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b19ed299-557b-4a3e-8601-cedab85db385 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] [instance: e8cfd63c-6e99-429f-93f2-ea40c02d7657] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:23.988866 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b19ed299-557b-4a3e-8601-cedab85db385 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:23.989635 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b19ed299-557b-4a3e-8601-cedab85db385 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:23.990272 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b19ed299-557b-4a3e-8601-cedab85db385 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:23.992210 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b19ed299-557b-4a3e-8601-cedab85db385 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:23.992698 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b19ed299-557b-4a3e-8601-cedab85db385 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:23.993137 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b19ed299-557b-4a3e-8601-cedab85db385 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:24.026292 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b19ed299-557b-4a3e-8601-cedab85db385 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] 10.222.0.61 "POST /compute/v2.1/servers/e8cfd63c-6e99-429f-93f2-ea40c02d7657/action" status: 202 len: 1079 microversion: 2.47 time: 0.264936 Aug 31 16:11:24.028218 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1696/3422] 10.222.0.61 () {62 vars in 1319 bytes} [Wed Aug 31 16:11:23 2022] POST /compute/v2.1/servers/e8cfd63c-6e99-429f-93f2-ea40c02d7657/action => generated 1079 bytes in 269 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 31 16:11:24.033648 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-78052dbb-b251-42b1-b374-74dede8e540e tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:24.034280 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-78052dbb-b251-42b1-b374-74dede8e540e tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 519c7ca0-6d6b-4250-9b7b-8d5b6ef3b6b4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:24.041502 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-78052dbb-b251-42b1-b374-74dede8e540e tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:24.042284 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-78052dbb-b251-42b1-b374-74dede8e540e tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:24.042740 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-78052dbb-b251-42b1-b374-74dede8e540e tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:24.043465 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-78052dbb-b251-42b1-b374-74dede8e540e tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:24.043961 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-78052dbb-b251-42b1-b374-74dede8e540e tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:24.044670 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-78052dbb-b251-42b1-b374-74dede8e540e tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:24.462944 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-78052dbb-b251-42b1-b374-74dede8e540e tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:24.472769 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-78052dbb-b251-42b1-b374-74dede8e540e tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/519c7ca0-6d6b-4250-9b7b-8d5b6ef3b6b4" status: 200 len: 1272 microversion: 2.1 time: 0.443407 Aug 31 16:11:24.473375 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1697/3423] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:24 2022] GET /compute/v2.1/servers/519c7ca0-6d6b-4250-9b7b-8d5b6ef3b6b4 => generated 1272 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:24.480488 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0bb9b75c-a0a1-40a3-a087-198b576402b1 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:24.481722 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0bb9b75c-a0a1-40a3-a087-198b576402b1 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] [instance: 685d47e4-721e-4eae-b5f8-78fdb68454ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:24.499933 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0bb9b75c-a0a1-40a3-a087-198b576402b1 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:24.501189 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0bb9b75c-a0a1-40a3-a087-198b576402b1 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:24.501936 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0bb9b75c-a0a1-40a3-a087-198b576402b1 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:24.502935 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0bb9b75c-a0a1-40a3-a087-198b576402b1 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:24.503619 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0bb9b75c-a0a1-40a3-a087-198b576402b1 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:24.504275 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0bb9b75c-a0a1-40a3-a087-198b576402b1 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:24.561125 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=6 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:11:24.944361 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=10 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:11:25.215601 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0bb9b75c-a0a1-40a3-a087-198b576402b1 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:25.234562 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0bb9b75c-a0a1-40a3-a087-198b576402b1 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:25.236345 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0bb9b75c-a0a1-40a3-a087-198b576402b1 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:25.237432 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0bb9b75c-a0a1-40a3-a087-198b576402b1 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] 10.222.0.61 "GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae" status: 200 len: 2667 microversion: 2.42 time: 0.762863 Aug 31 16:11:25.239340 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1698/3424] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:11:24 2022] GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae => generated 2667 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:11:25.328416 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e6844e86-7ce2-40c7-b341-c78867ca68e6 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Action: 'create', calling method: .version_select at 0x7f5ae85f33a0>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-286877772", "policies": ["affinity"]}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:11:25.355781 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-e6844e86-7ce2-40c7-b341-c78867ca68e6 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Getting quotas for project 859e7bbce8ed4dea985c73abe3ec8cd8. Resources: {'server_groups'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:11:25.363234 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-e6844e86-7ce2-40c7-b341-c78867ca68e6 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Getting quotas for user de1444fdefda4eaeac9b11577ad7248b and project 859e7bbce8ed4dea985c73abe3ec8cd8. Resources: {'server_groups'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:11:25.393967 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:11:25.421536 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-e6844e86-7ce2-40c7-b341-c78867ca68e6 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Getting quotas for project 859e7bbce8ed4dea985c73abe3ec8cd8. Resources: {'server_groups'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:11:25.430282 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-e6844e86-7ce2-40c7-b341-c78867ca68e6 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Getting quotas for user de1444fdefda4eaeac9b11577ad7248b and project 859e7bbce8ed4dea985c73abe3ec8cd8. Resources: {'server_groups'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:11:25.452492 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e6844e86-7ce2-40c7-b341-c78867ca68e6 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] 10.222.0.61 "POST /compute/v2.1/os-server-groups" status: 200 len: 183 microversion: 2.1 time: 0.189938 Aug 31 16:11:25.453723 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1699/3425] 10.222.0.61 () {60 vars in 1174 bytes} [Wed Aug 31 16:11:25 2022] POST /compute/v2.1/os-server-groups => generated 183 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:11:25.458845 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-6e4f68de-d6ad-48c1-ace3-7a11047c97f6 req-d44f449f-58d6-4a9e-8062-fa232bd9b7e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ac914d2-e9f7-4f2f-a01d-49674180d8db", "name": "network-vif-unplugged", "status": "completed", "tag": "2c7e9f34-2b8a-470a-af28-22027bffc1a7"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:11:25.472637 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-6e4f68de-d6ad-48c1-ace3-7a11047c97f6 req-d44f449f-58d6-4a9e-8062-fa232bd9b7e8 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:25.473405 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-6e4f68de-d6ad-48c1-ace3-7a11047c97f6 req-d44f449f-58d6-4a9e-8062-fa232bd9b7e8 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:25.474004 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-6e4f68de-d6ad-48c1-ace3-7a11047c97f6 req-d44f449f-58d6-4a9e-8062-fa232bd9b7e8 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:25.489905 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-6e4f68de-d6ad-48c1-ace3-7a11047c97f6 req-d44f449f-58d6-4a9e-8062-fa232bd9b7e8 service nova] Creating event network-vif-unplugged:2c7e9f34-2b8a-470a-af28-22027bffc1a7 for instance 0ac914d2-e9f7-4f2f-a01d-49674180d8db on n-h2-850499-9 Aug 31 16:11:25.500863 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-6e4f68de-d6ad-48c1-ace3-7a11047c97f6 req-d44f449f-58d6-4a9e-8062-fa232bd9b7e8 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045188 Aug 31 16:11:25.502700 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1700/3426] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:11:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:11:25.508804 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3bb500ef-1091-44e6-8132-9427356259fb tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:25.509855 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3bb500ef-1091-44e6-8132-9427356259fb tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] [instance: e8cfd63c-6e99-429f-93f2-ea40c02d7657] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:25.516953 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3bb500ef-1091-44e6-8132-9427356259fb tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:25.517671 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3bb500ef-1091-44e6-8132-9427356259fb tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:25.518275 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3bb500ef-1091-44e6-8132-9427356259fb tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:25.519132 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3bb500ef-1091-44e6-8132-9427356259fb tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:25.519617 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3bb500ef-1091-44e6-8132-9427356259fb tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:25.520202 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3bb500ef-1091-44e6-8132-9427356259fb tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:25.705734 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3bb500ef-1091-44e6-8132-9427356259fb tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c32defec8443468861dbc8d33e3b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780f91ca8c6f461ba347cd2510dceeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:25.715919 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3bb500ef-1091-44e6-8132-9427356259fb tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c32defec8443468861dbc8d33e3b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780f91ca8c6f461ba347cd2510dceeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:25.718687 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3bb500ef-1091-44e6-8132-9427356259fb tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c32defec8443468861dbc8d33e3b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780f91ca8c6f461ba347cd2510dceeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:25.719891 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3bb500ef-1091-44e6-8132-9427356259fb tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] 10.222.0.61 "GET /compute/v2.1/servers/e8cfd63c-6e99-429f-93f2-ea40c02d7657" status: 200 len: 1366 microversion: 2.47 time: 0.215738 Aug 31 16:11:25.720782 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1701/3427] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:11:25 2022] GET /compute/v2.1/servers/e8cfd63c-6e99-429f-93f2-ea40c02d7657 => generated 1366 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:11:25.726654 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7c59e6db-2bac-4ccb-98ed-8c4b1bc1d88a tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:25.727493 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7c59e6db-2bac-4ccb-98ed-8c4b1bc1d88a tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] [instance: fa0932e8-1aa4-4d1a-b653-14be35568f3d] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:25.733971 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7c59e6db-2bac-4ccb-98ed-8c4b1bc1d88a tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:25.734623 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7c59e6db-2bac-4ccb-98ed-8c4b1bc1d88a tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:25.735193 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7c59e6db-2bac-4ccb-98ed-8c4b1bc1d88a tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:25.736056 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7c59e6db-2bac-4ccb-98ed-8c4b1bc1d88a tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:25.736838 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7c59e6db-2bac-4ccb-98ed-8c4b1bc1d88a tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:25.737395 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7c59e6db-2bac-4ccb-98ed-8c4b1bc1d88a tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:27.020795 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7c59e6db-2bac-4ccb-98ed-8c4b1bc1d88a tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:27.035937 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7c59e6db-2bac-4ccb-98ed-8c4b1bc1d88a tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:27.041915 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7c59e6db-2bac-4ccb-98ed-8c4b1bc1d88a tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:27.043597 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7c59e6db-2bac-4ccb-98ed-8c4b1bc1d88a tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] 10.222.0.61 "GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d" status: 200 len: 1879 microversion: 2.32 time: 1.321893 Aug 31 16:11:27.045967 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1702/3428] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:11:25 2022] GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d => generated 1879 bytes in 1325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:11:27.054124 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-e02fbb54-98dd-42f5-862e-d2df80aecc3f req-f5f31578-71ba-4634-8038-7f96bbe2c509 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "685d47e4-721e-4eae-b5f8-78fdb68454ae", "name": "network-vif-deleted", "tag": "ad0f25db-5150-4147-a615-e7e75398c04e"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:11:27.083676 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-e02fbb54-98dd-42f5-862e-d2df80aecc3f req-f5f31578-71ba-4634-8038-7f96bbe2c509 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:27.086487 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-e02fbb54-98dd-42f5-862e-d2df80aecc3f req-f5f31578-71ba-4634-8038-7f96bbe2c509 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:27.087080 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-e02fbb54-98dd-42f5-862e-d2df80aecc3f req-f5f31578-71ba-4634-8038-7f96bbe2c509 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:27.092177 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:11:27.120796 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-e02fbb54-98dd-42f5-862e-d2df80aecc3f req-f5f31578-71ba-4634-8038-7f96bbe2c509 service nova] Creating event network-vif-deleted:ad0f25db-5150-4147-a615-e7e75398c04e for instance 685d47e4-721e-4eae-b5f8-78fdb68454ae on n-h2-850499-9 Aug 31 16:11:27.131346 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-e02fbb54-98dd-42f5-862e-d2df80aecc3f req-f5f31578-71ba-4634-8038-7f96bbe2c509 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081037 Aug 31 16:11:27.137908 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1703/3429] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:11:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:11:27.155155 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-00e90af3-563c-48a0-9e57-22a3c05e85de tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:27.156167 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-00e90af3-563c-48a0-9e57-22a3c05e85de tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] [instance: 0ac914d2-e9f7-4f2f-a01d-49674180d8db] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:27.166571 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-00e90af3-563c-48a0-9e57-22a3c05e85de tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:27.169747 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-00e90af3-563c-48a0-9e57-22a3c05e85de tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:27.176287 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-00e90af3-563c-48a0-9e57-22a3c05e85de tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:27.177429 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-00e90af3-563c-48a0-9e57-22a3c05e85de tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:27.178245 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-00e90af3-563c-48a0-9e57-22a3c05e85de tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:27.178949 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-00e90af3-563c-48a0-9e57-22a3c05e85de tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:27.468137 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-00e90af3-563c-48a0-9e57-22a3c05e85de tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c65ee5ffa9d74bfdacbea45f1564d19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55320a9c8f714bc0911ded3ab88ddf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:27.489683 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-00e90af3-563c-48a0-9e57-22a3c05e85de tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] 10.222.0.61 "GET /compute/v2.1/servers/0ac914d2-e9f7-4f2f-a01d-49674180d8db" status: 200 len: 1252 microversion: 2.1 time: 0.350194 Aug 31 16:11:27.490784 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1704/3430] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:27 2022] GET /compute/v2.1/servers/0ac914d2-e9f7-4f2f-a01d-49674180d8db => generated 1252 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:27.495770 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-33f7ca85-f947-4d47-ace9-f32f35661957 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Action: 'create', calling method: .version_select at 0x7f5aed138c10>, body: {"server_group": {"name": "tempest-server-group-1010436257", "policies": ["affinity"]}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:11:27.558122 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-33f7ca85-f947-4d47-ace9-f32f35661957 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Getting quotas for project 859e7bbce8ed4dea985c73abe3ec8cd8. Resources: {'server_groups'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:11:27.572755 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-33f7ca85-f947-4d47-ace9-f32f35661957 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Getting quotas for user de1444fdefda4eaeac9b11577ad7248b and project 859e7bbce8ed4dea985c73abe3ec8cd8. Resources: {'server_groups'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:11:27.701313 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-33f7ca85-f947-4d47-ace9-f32f35661957 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Getting quotas for project 859e7bbce8ed4dea985c73abe3ec8cd8. Resources: {'server_groups'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:11:27.711149 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-33f7ca85-f947-4d47-ace9-f32f35661957 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Getting quotas for user de1444fdefda4eaeac9b11577ad7248b and project 859e7bbce8ed4dea985c73abe3ec8cd8. Resources: {'server_groups'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:11:27.734630 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-33f7ca85-f947-4d47-ace9-f32f35661957 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] 10.222.0.61 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.242420 Aug 31 16:11:27.740436 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1705/3431] 10.222.0.61 () {60 vars in 1173 bytes} [Wed Aug 31 16:11:27 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:11:27.754980 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f5014225-be32-4f5f-bf92-3daaa1497675 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:27.771739 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f5014225-be32-4f5f-bf92-3daaa1497675 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 519c7ca0-6d6b-4250-9b7b-8d5b6ef3b6b4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:27.780871 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f5014225-be32-4f5f-bf92-3daaa1497675 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:27.781620 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f5014225-be32-4f5f-bf92-3daaa1497675 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:27.782252 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f5014225-be32-4f5f-bf92-3daaa1497675 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:27.783137 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f5014225-be32-4f5f-bf92-3daaa1497675 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:27.783948 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f5014225-be32-4f5f-bf92-3daaa1497675 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:27.784682 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f5014225-be32-4f5f-bf92-3daaa1497675 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:27.999841 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f5014225-be32-4f5f-bf92-3daaa1497675 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:28.013922 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f5014225-be32-4f5f-bf92-3daaa1497675 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/519c7ca0-6d6b-4250-9b7b-8d5b6ef3b6b4" status: 200 len: 1278 microversion: 2.1 time: 0.270735 Aug 31 16:11:28.031740 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1706/3432] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:27 2022] GET /compute/v2.1/servers/519c7ca0-6d6b-4250-9b7b-8d5b6ef3b6b4 => generated 1278 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:28.044080 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-197d8e32-5c42-4f5a-af77-83d51259d469 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:28.044819 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-197d8e32-5c42-4f5a-af77-83d51259d469 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] [instance: 685d47e4-721e-4eae-b5f8-78fdb68454ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:28.054044 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-197d8e32-5c42-4f5a-af77-83d51259d469 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:28.055598 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-197d8e32-5c42-4f5a-af77-83d51259d469 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:28.057746 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-197d8e32-5c42-4f5a-af77-83d51259d469 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:28.057746 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-197d8e32-5c42-4f5a-af77-83d51259d469 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:28.057746 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-197d8e32-5c42-4f5a-af77-83d51259d469 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:28.058596 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-197d8e32-5c42-4f5a-af77-83d51259d469 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:28.601939 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-197d8e32-5c42-4f5a-af77-83d51259d469 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:28.651317 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-197d8e32-5c42-4f5a-af77-83d51259d469 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:28.655823 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-197d8e32-5c42-4f5a-af77-83d51259d469 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:28.657860 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-197d8e32-5c42-4f5a-af77-83d51259d469 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] 10.222.0.61 "GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae" status: 200 len: 2507 microversion: 2.42 time: 0.623798 Aug 31 16:11:28.664278 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1707/3433] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:11:28 2022] GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae => generated 2507 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:11:28.676453 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-eae23d05-3b1c-48f4-85b2-694cb7ff2803 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:28.677198 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-eae23d05-3b1c-48f4-85b2-694cb7ff2803 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] [instance: e8cfd63c-6e99-429f-93f2-ea40c02d7657] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:28.709096 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eae23d05-3b1c-48f4-85b2-694cb7ff2803 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:28.712807 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eae23d05-3b1c-48f4-85b2-694cb7ff2803 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:28.714603 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eae23d05-3b1c-48f4-85b2-694cb7ff2803 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:28.716352 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eae23d05-3b1c-48f4-85b2-694cb7ff2803 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:28.716841 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eae23d05-3b1c-48f4-85b2-694cb7ff2803 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:28.717280 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eae23d05-3b1c-48f4-85b2-694cb7ff2803 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:28.924796 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-eae23d05-3b1c-48f4-85b2-694cb7ff2803 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c32defec8443468861dbc8d33e3b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780f91ca8c6f461ba347cd2510dceeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:28.949733 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-eae23d05-3b1c-48f4-85b2-694cb7ff2803 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c32defec8443468861dbc8d33e3b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780f91ca8c6f461ba347cd2510dceeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:28.952125 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-eae23d05-3b1c-48f4-85b2-694cb7ff2803 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c32defec8443468861dbc8d33e3b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780f91ca8c6f461ba347cd2510dceeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:28.954337 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-eae23d05-3b1c-48f4-85b2-694cb7ff2803 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] 10.222.0.61 "GET /compute/v2.1/servers/e8cfd63c-6e99-429f-93f2-ea40c02d7657" status: 200 len: 1366 microversion: 2.47 time: 0.288224 Aug 31 16:11:28.955443 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1708/3434] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:11:28 2022] GET /compute/v2.1/servers/e8cfd63c-6e99-429f-93f2-ea40c02d7657 => generated 1366 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:11:28.980427 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-cc87ecd6-2838-4ded-971a-682501d5abdc tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Action: 'create', calling method: .version_select at 0x7f5aed214160>, body: {"server_group": {"name": "tempest-server-group-1010436257", "policies": ["affinity"]}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:11:29.021163 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-cc87ecd6-2838-4ded-971a-682501d5abdc tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Getting quotas for project 859e7bbce8ed4dea985c73abe3ec8cd8. Resources: {'server_groups'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:11:29.028685 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-cc87ecd6-2838-4ded-971a-682501d5abdc tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Getting quotas for user de1444fdefda4eaeac9b11577ad7248b and project 859e7bbce8ed4dea985c73abe3ec8cd8. Resources: {'server_groups'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:11:29.129578 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-cc87ecd6-2838-4ded-971a-682501d5abdc tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Getting quotas for project 859e7bbce8ed4dea985c73abe3ec8cd8. Resources: {'server_groups'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:11:29.139842 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-cc87ecd6-2838-4ded-971a-682501d5abdc tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Getting quotas for user de1444fdefda4eaeac9b11577ad7248b and project 859e7bbce8ed4dea985c73abe3ec8cd8. Resources: {'server_groups'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:11:29.165329 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-8ad31737-0850-48d1-8ace-4b99a2e15d7e tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] [instance: 606f1624-8c53-409e-b06b-ace080f7fc44] Building network info cache for instance {{(pid=122256) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 31 16:11:29.169472 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-cc87ecd6-2838-4ded-971a-682501d5abdc tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] 10.222.0.61 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.212623 Aug 31 16:11:29.175282 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1709/3435] 10.222.0.61 () {60 vars in 1173 bytes} [Wed Aug 31 16:11:28 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:11:29.177567 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-63be20d1-66f0-4da0-9a2d-eba7724b3255 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:29.179452 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-63be20d1-66f0-4da0-9a2d-eba7724b3255 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] [instance: fa0932e8-1aa4-4d1a-b653-14be35568f3d] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:29.221391 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-63be20d1-66f0-4da0-9a2d-eba7724b3255 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:29.221922 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-63be20d1-66f0-4da0-9a2d-eba7724b3255 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:29.242417 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-63be20d1-66f0-4da0-9a2d-eba7724b3255 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:29.243228 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-63be20d1-66f0-4da0-9a2d-eba7724b3255 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:29.256493 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-63be20d1-66f0-4da0-9a2d-eba7724b3255 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:29.259046 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-63be20d1-66f0-4da0-9a2d-eba7724b3255 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:30.222834 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-63be20d1-66f0-4da0-9a2d-eba7724b3255 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:30.241238 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-63be20d1-66f0-4da0-9a2d-eba7724b3255 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:30.242717 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-63be20d1-66f0-4da0-9a2d-eba7724b3255 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:30.244343 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-63be20d1-66f0-4da0-9a2d-eba7724b3255 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] 10.222.0.61 "GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d" status: 200 len: 1879 microversion: 2.32 time: 1.072296 Aug 31 16:11:30.248802 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1710/3436] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:11:29 2022] GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d => generated 1879 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:11:30.258049 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-07cd19b9-f4c2-4b86-9dc6-b0615fb94a1a tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:30.259615 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-07cd19b9-f4c2-4b86-9dc6-b0615fb94a1a tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] [instance: 0ac914d2-e9f7-4f2f-a01d-49674180d8db] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:30.268280 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-07cd19b9-f4c2-4b86-9dc6-b0615fb94a1a tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:30.270529 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-07cd19b9-f4c2-4b86-9dc6-b0615fb94a1a tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:30.272276 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-07cd19b9-f4c2-4b86-9dc6-b0615fb94a1a tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:30.273302 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-07cd19b9-f4c2-4b86-9dc6-b0615fb94a1a tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:30.274137 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-07cd19b9-f4c2-4b86-9dc6-b0615fb94a1a tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:30.274797 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-07cd19b9-f4c2-4b86-9dc6-b0615fb94a1a tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:30.412985 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-07cd19b9-f4c2-4b86-9dc6-b0615fb94a1a tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c65ee5ffa9d74bfdacbea45f1564d19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55320a9c8f714bc0911ded3ab88ddf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:30.422965 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-07cd19b9-f4c2-4b86-9dc6-b0615fb94a1a tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] 10.222.0.61 "GET /compute/v2.1/servers/0ac914d2-e9f7-4f2f-a01d-49674180d8db" status: 200 len: 1252 microversion: 2.1 time: 0.172713 Aug 31 16:11:30.423902 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1711/3437] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:30 2022] GET /compute/v2.1/servers/0ac914d2-e9f7-4f2f-a01d-49674180d8db => generated 1252 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:30.429971 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4e8eae19-81a7-4bae-9168-fbe417c492e9 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:30.430848 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4e8eae19-81a7-4bae-9168-fbe417c492e9 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 519c7ca0-6d6b-4250-9b7b-8d5b6ef3b6b4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:30.437065 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4e8eae19-81a7-4bae-9168-fbe417c492e9 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:30.437787 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4e8eae19-81a7-4bae-9168-fbe417c492e9 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:30.438384 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4e8eae19-81a7-4bae-9168-fbe417c492e9 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:30.439719 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4e8eae19-81a7-4bae-9168-fbe417c492e9 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:30.440559 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4e8eae19-81a7-4bae-9168-fbe417c492e9 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:30.441155 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4e8eae19-81a7-4bae-9168-fbe417c492e9 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:30.922465 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-4e8eae19-81a7-4bae-9168-fbe417c492e9 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:30.933470 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4e8eae19-81a7-4bae-9168-fbe417c492e9 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/519c7ca0-6d6b-4250-9b7b-8d5b6ef3b6b4" status: 200 len: 1320 microversion: 2.1 time: 0.508222 Aug 31 16:11:30.934378 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1712/3438] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:30 2022] GET /compute/v2.1/servers/519c7ca0-6d6b-4250-9b7b-8d5b6ef3b6b4 => generated 1320 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:30.940775 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-eec503eb-954b-4214-b7c8-995ea0c22f59 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:30.985655 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-eec503eb-954b-4214-b7c8-995ea0c22f59 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] 10.222.0.61 "DELETE /compute/v2.1/os-server-groups/c00530e7-9668-4e82-850e-02e24aeee959" status: 204 len: 0 microversion: 2.1 time: 0.049575 Aug 31 16:11:30.986979 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1713/3439] 10.222.0.61 () {58 vars in 1266 bytes} [Wed Aug 31 16:11:30 2022] DELETE /compute/v2.1/os-server-groups/c00530e7-9668-4e82-850e-02e24aeee959 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:11:30.995472 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-a3e4f0bc-d35e-4382-96ff-e27bc1a2dcda req-8696fd7a-4ca8-40c7-926a-3ad9ecb2fa8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "685d47e4-721e-4eae-b5f8-78fdb68454ae", "name": "network-vif-deleted", "tag": "a7a5f1a9-2d7d-4203-b9c4-5b85512da4d2"}, {"server_uuid": "0ac914d2-e9f7-4f2f-a01d-49674180d8db", "name": "network-vif-deleted", "tag": "2c7e9f34-2b8a-470a-af28-22027bffc1a7"}, {"server_uuid": "685d47e4-721e-4eae-b5f8-78fdb68454ae", "name": "network-vif-deleted", "tag": "95c43f6b-98f3-4304-acef-e290fff017c7"}, {"name": "network-changed", "server_uuid": "606f1624-8c53-409e-b06b-ace080f7fc44", "tag": "bd761e9e-656b-4464-b63f-bb9440ae7e14"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:11:31.002770 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5,nova_api:DELETE=3 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:11:31.011636 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-a3e4f0bc-d35e-4382-96ff-e27bc1a2dcda req-8696fd7a-4ca8-40c7-926a-3ad9ecb2fa8f service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:31.012128 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-a3e4f0bc-d35e-4382-96ff-e27bc1a2dcda req-8696fd7a-4ca8-40c7-926a-3ad9ecb2fa8f service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:31.012568 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-a3e4f0bc-d35e-4382-96ff-e27bc1a2dcda req-8696fd7a-4ca8-40c7-926a-3ad9ecb2fa8f service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:31.031436 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-a3e4f0bc-d35e-4382-96ff-e27bc1a2dcda req-8696fd7a-4ca8-40c7-926a-3ad9ecb2fa8f service nova] Creating event network-vif-deleted:a7a5f1a9-2d7d-4203-b9c4-5b85512da4d2 for instance 685d47e4-721e-4eae-b5f8-78fdb68454ae on n-h2-850499-9 Aug 31 16:11:31.032194 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-a3e4f0bc-d35e-4382-96ff-e27bc1a2dcda req-8696fd7a-4ca8-40c7-926a-3ad9ecb2fa8f service nova] Creating event network-vif-deleted:2c7e9f34-2b8a-470a-af28-22027bffc1a7 for instance 0ac914d2-e9f7-4f2f-a01d-49674180d8db on n-h2-850499-9 Aug 31 16:11:31.033113 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-a3e4f0bc-d35e-4382-96ff-e27bc1a2dcda req-8696fd7a-4ca8-40c7-926a-3ad9ecb2fa8f service nova] Creating event network-vif-deleted:95c43f6b-98f3-4304-acef-e290fff017c7 for instance 685d47e4-721e-4eae-b5f8-78fdb68454ae on n-h2-850499-9 Aug 31 16:11:31.033619 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-a3e4f0bc-d35e-4382-96ff-e27bc1a2dcda req-8696fd7a-4ca8-40c7-926a-3ad9ecb2fa8f service nova] Creating event network-changed:bd761e9e-656b-4464-b63f-bb9440ae7e14 for instance 606f1624-8c53-409e-b06b-ace080f7fc44 on n-h1-850499-9 Aug 31 16:11:31.044320 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-a3e4f0bc-d35e-4382-96ff-e27bc1a2dcda req-8696fd7a-4ca8-40c7-926a-3ad9ecb2fa8f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 692 microversion: 2.1 time: 0.054987 Aug 31 16:11:31.044978 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1714/3440] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:11:30 2022] POST /compute/v2.1/os-server-external-events => generated 692 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:11:31.050130 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ab27114a-9a1e-4c6f-a35c-af8a9d187c1d tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:31.050831 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ab27114a-9a1e-4c6f-a35c-af8a9d187c1d tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] [instance: 685d47e4-721e-4eae-b5f8-78fdb68454ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:31.058892 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ab27114a-9a1e-4c6f-a35c-af8a9d187c1d tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:31.059648 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ab27114a-9a1e-4c6f-a35c-af8a9d187c1d tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:31.060178 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ab27114a-9a1e-4c6f-a35c-af8a9d187c1d tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:31.061304 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ab27114a-9a1e-4c6f-a35c-af8a9d187c1d tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:31.062387 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ab27114a-9a1e-4c6f-a35c-af8a9d187c1d tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:31.062824 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ab27114a-9a1e-4c6f-a35c-af8a9d187c1d tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:31.205148 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ab27114a-9a1e-4c6f-a35c-af8a9d187c1d tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:31.217355 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ab27114a-9a1e-4c6f-a35c-af8a9d187c1d tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:31.219048 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ab27114a-9a1e-4c6f-a35c-af8a9d187c1d tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:31.222043 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ab27114a-9a1e-4c6f-a35c-af8a9d187c1d tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] 10.222.0.61 "GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae" status: 200 len: 1605 microversion: 2.42 time: 0.175809 Aug 31 16:11:31.222935 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1715/3441] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:11:31 2022] GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae => generated 1605 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:11:31.247701 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3c2ebfdd-e66d-46ea-ac1d-3c7c0fd8fbcd tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:31.248453 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3c2ebfdd-e66d-46ea-ac1d-3c7c0fd8fbcd tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] [instance: e8cfd63c-6e99-429f-93f2-ea40c02d7657] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:31.266472 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3c2ebfdd-e66d-46ea-ac1d-3c7c0fd8fbcd tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:31.266973 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3c2ebfdd-e66d-46ea-ac1d-3c7c0fd8fbcd tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:31.267410 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3c2ebfdd-e66d-46ea-ac1d-3c7c0fd8fbcd tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:31.268387 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3c2ebfdd-e66d-46ea-ac1d-3c7c0fd8fbcd tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:31.268840 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3c2ebfdd-e66d-46ea-ac1d-3c7c0fd8fbcd tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:31.269269 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3c2ebfdd-e66d-46ea-ac1d-3c7c0fd8fbcd tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:31.376176 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-8ad31737-0850-48d1-8ace-4b99a2e15d7e tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] [instance: 606f1624-8c53-409e-b06b-ace080f7fc44] Updating instance_info_cache with network_info: [{"id": "bd761e9e-656b-4464-b63f-bb9440ae7e14", "address": "fa:16:3e:01:26:ee", "network": {"id": "567c9ba1-6364-4d01-9016-4aec92f3efc9", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1516295813-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.6.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "eab7f0d889224cefbca55343f3208a86", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapbd761e9e-65", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122256) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 31 16:11:31.385211 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3c2ebfdd-e66d-46ea-ac1d-3c7c0fd8fbcd tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c32defec8443468861dbc8d33e3b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780f91ca8c6f461ba347cd2510dceeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:31.402119 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8ad31737-0850-48d1-8ace-4b99a2e15d7e tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Releasing lock "refresh_cache-606f1624-8c53-409e-b06b-ace080f7fc44" {{(pid=122256) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 31 16:11:31.403176 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8ad31737-0850-48d1-8ace-4b99a2e15d7e tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] 10.222.0.61 "POST /compute/v2.1/servers/606f1624-8c53-409e-b06b-ace080f7fc44/action" status: 202 len: 0 microversion: 2.1 time: 8.309540 Aug 31 16:11:31.403861 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1727/3442] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:11:23 2022] POST /compute/v2.1/servers/606f1624-8c53-409e-b06b-ace080f7fc44/action => generated 0 bytes in 8311 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 31 16:11:31.413810 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-cdd96b8e-da8d-4868-9b16-6b6e9c53d47a tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:31.429260 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3c2ebfdd-e66d-46ea-ac1d-3c7c0fd8fbcd tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c32defec8443468861dbc8d33e3b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780f91ca8c6f461ba347cd2510dceeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:31.435325 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3c2ebfdd-e66d-46ea-ac1d-3c7c0fd8fbcd tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c32defec8443468861dbc8d33e3b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780f91ca8c6f461ba347cd2510dceeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:31.437520 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3c2ebfdd-e66d-46ea-ac1d-3c7c0fd8fbcd tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] 10.222.0.61 "GET /compute/v2.1/servers/e8cfd63c-6e99-429f-93f2-ea40c02d7657" status: 200 len: 1366 microversion: 2.47 time: 0.207593 Aug 31 16:11:31.447938 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1716/3443] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:11:31 2022] GET /compute/v2.1/servers/e8cfd63c-6e99-429f-93f2-ea40c02d7657 => generated 1366 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:11:31.454629 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3e4661ac-58cb-4b2a-b533-cee78801e02f tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:31.464946 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3e4661ac-58cb-4b2a-b533-cee78801e02f tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] [instance: fa0932e8-1aa4-4d1a-b653-14be35568f3d] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:31.485635 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-cdd96b8e-da8d-4868-9b16-6b6e9c53d47a tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] 10.222.0.61 "GET /compute/v2.1/os-server-groups" status: 200 len: 334 microversion: 2.1 time: 0.076772 Aug 31 16:11:31.486270 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3e4661ac-58cb-4b2a-b533-cee78801e02f tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:31.487009 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3e4661ac-58cb-4b2a-b533-cee78801e02f tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:31.487800 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3e4661ac-58cb-4b2a-b533-cee78801e02f tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:31.488736 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3e4661ac-58cb-4b2a-b533-cee78801e02f tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:31.490283 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3e4661ac-58cb-4b2a-b533-cee78801e02f tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:31.492365 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3e4661ac-58cb-4b2a-b533-cee78801e02f tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:31.492591 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1728/3444] 10.222.0.61 () {58 vars in 1152 bytes} [Wed Aug 31 16:11:31 2022] GET /compute/v2.1/os-server-groups => generated 334 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:11:31.503641 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d8efb6cc-4809-46ad-8e13-923978d52eff tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.6.121"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:11:31.520205 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d8efb6cc-4809-46ad-8e13-923978d52eff tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] [instance: c7ae279f-9e24-4755-a912-6bec59837e6c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:31.528557 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d8efb6cc-4809-46ad-8e13-923978d52eff tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:31.529320 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d8efb6cc-4809-46ad-8e13-923978d52eff tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:31.529972 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d8efb6cc-4809-46ad-8e13-923978d52eff tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:31.530878 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d8efb6cc-4809-46ad-8e13-923978d52eff tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:31.535351 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d8efb6cc-4809-46ad-8e13-923978d52eff tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:31.535849 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d8efb6cc-4809-46ad-8e13-923978d52eff tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:31.581771 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d8efb6cc-4809-46ad-8e13-923978d52eff tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquiring lock "refresh_cache-c7ae279f-9e24-4755-a912-6bec59837e6c" {{(pid=122256) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 31 16:11:31.582185 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d8efb6cc-4809-46ad-8e13-923978d52eff tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquired lock "refresh_cache-c7ae279f-9e24-4755-a912-6bec59837e6c" {{(pid=122256) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 31 16:11:31.739174 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=6 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:11:31.815944 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=18 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:11:32.141669 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3e4661ac-58cb-4b2a-b533-cee78801e02f tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:32.152231 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3e4661ac-58cb-4b2a-b533-cee78801e02f tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:32.153862 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3e4661ac-58cb-4b2a-b533-cee78801e02f tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:32.155173 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3e4661ac-58cb-4b2a-b533-cee78801e02f tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] 10.222.0.61 "GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d" status: 200 len: 1879 microversion: 2.32 time: 0.705854 Aug 31 16:11:32.155885 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1717/3445] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:11:31 2022] GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d => generated 1879 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:11:32.161326 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6e9dd552-b962-42aa-80ab-21dd7461764d tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:32.162764 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6e9dd552-b962-42aa-80ab-21dd7461764d tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] [instance: 0ac914d2-e9f7-4f2f-a01d-49674180d8db] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:32.172132 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6e9dd552-b962-42aa-80ab-21dd7461764d tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:32.172775 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6e9dd552-b962-42aa-80ab-21dd7461764d tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:32.173324 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6e9dd552-b962-42aa-80ab-21dd7461764d tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:32.174139 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6e9dd552-b962-42aa-80ab-21dd7461764d tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:32.174707 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6e9dd552-b962-42aa-80ab-21dd7461764d tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:32.175275 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6e9dd552-b962-42aa-80ab-21dd7461764d tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:32.658642 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-6e9dd552-b962-42aa-80ab-21dd7461764d tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c65ee5ffa9d74bfdacbea45f1564d19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55320a9c8f714bc0911ded3ab88ddf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:32.668453 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6e9dd552-b962-42aa-80ab-21dd7461764d tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] 10.222.0.61 "GET /compute/v2.1/servers/0ac914d2-e9f7-4f2f-a01d-49674180d8db" status: 200 len: 1252 microversion: 2.1 time: 0.511183 Aug 31 16:11:32.669049 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1718/3446] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:32 2022] GET /compute/v2.1/servers/0ac914d2-e9f7-4f2f-a01d-49674180d8db => generated 1252 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:32.688531 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0e9962ea-3b69-431b-8e9b-bd93e5ace62c tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:32.725836 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0e9962ea-3b69-431b-8e9b-bd93e5ace62c tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] 10.222.0.61 "DELETE /compute/v2.1/os-server-groups/122baed1-49cd-460f-98fb-b05f48a941ee" status: 204 len: 0 microversion: 2.1 time: 0.043348 Aug 31 16:11:32.727588 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1719/3447] 10.222.0.61 () {58 vars in 1266 bytes} [Wed Aug 31 16:11:32 2022] DELETE /compute/v2.1/os-server-groups/122baed1-49cd-460f-98fb-b05f48a941ee => generated 0 bytes in 46 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:11:32.734030 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0a8331e2-e706-4eee-ae69-1f4a47bcf61c tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:32.734908 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0a8331e2-e706-4eee-ae69-1f4a47bcf61c tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 519c7ca0-6d6b-4250-9b7b-8d5b6ef3b6b4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:32.741759 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0a8331e2-e706-4eee-ae69-1f4a47bcf61c tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:32.742310 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0a8331e2-e706-4eee-ae69-1f4a47bcf61c tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:32.742757 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0a8331e2-e706-4eee-ae69-1f4a47bcf61c tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:32.743627 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0a8331e2-e706-4eee-ae69-1f4a47bcf61c tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:32.744118 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0a8331e2-e706-4eee-ae69-1f4a47bcf61c tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:32.744550 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0a8331e2-e706-4eee-ae69-1f4a47bcf61c tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:33.018900 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0a8331e2-e706-4eee-ae69-1f4a47bcf61c tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:33.028140 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0a8331e2-e706-4eee-ae69-1f4a47bcf61c tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/519c7ca0-6d6b-4250-9b7b-8d5b6ef3b6b4" status: 200 len: 1320 microversion: 2.1 time: 0.299198 Aug 31 16:11:33.028824 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1720/3448] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:32 2022] GET /compute/v2.1/servers/519c7ca0-6d6b-4250-9b7b-8d5b6ef3b6b4 => generated 1320 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:33.033745 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3d432148-ba4c-49e8-887b-0bd45f2aa51c tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:33.034433 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3d432148-ba4c-49e8-887b-0bd45f2aa51c tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] [instance: 685d47e4-721e-4eae-b5f8-78fdb68454ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:33.041344 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3d432148-ba4c-49e8-887b-0bd45f2aa51c tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:33.041982 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3d432148-ba4c-49e8-887b-0bd45f2aa51c tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:33.042639 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3d432148-ba4c-49e8-887b-0bd45f2aa51c tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:33.043420 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3d432148-ba4c-49e8-887b-0bd45f2aa51c tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:33.043985 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3d432148-ba4c-49e8-887b-0bd45f2aa51c tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:33.044478 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3d432148-ba4c-49e8-887b-0bd45f2aa51c tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:33.144314 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3d432148-ba4c-49e8-887b-0bd45f2aa51c tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:33.154909 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3d432148-ba4c-49e8-887b-0bd45f2aa51c tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:33.156440 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3d432148-ba4c-49e8-887b-0bd45f2aa51c tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:33.157576 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3d432148-ba4c-49e8-887b-0bd45f2aa51c tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] 10.222.0.61 "GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae" status: 200 len: 1605 microversion: 2.42 time: 0.127613 Aug 31 16:11:33.166067 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1721/3449] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:11:33 2022] GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae => generated 1605 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:11:33.166067 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-64a63986-2c3f-4f4a-9ad0-0623608e76d9 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:33.166067 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-64a63986-2c3f-4f4a-9ad0-0623608e76d9 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] [instance: e8cfd63c-6e99-429f-93f2-ea40c02d7657] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:33.170141 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-64a63986-2c3f-4f4a-9ad0-0623608e76d9 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:33.170634 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-64a63986-2c3f-4f4a-9ad0-0623608e76d9 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:33.171075 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-64a63986-2c3f-4f4a-9ad0-0623608e76d9 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:33.171809 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-64a63986-2c3f-4f4a-9ad0-0623608e76d9 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:33.172266 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-64a63986-2c3f-4f4a-9ad0-0623608e76d9 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:33.174364 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-64a63986-2c3f-4f4a-9ad0-0623608e76d9 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:33.261397 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-64a63986-2c3f-4f4a-9ad0-0623608e76d9 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c32defec8443468861dbc8d33e3b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780f91ca8c6f461ba347cd2510dceeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:33.273567 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-64a63986-2c3f-4f4a-9ad0-0623608e76d9 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c32defec8443468861dbc8d33e3b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780f91ca8c6f461ba347cd2510dceeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:33.274118 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-64a63986-2c3f-4f4a-9ad0-0623608e76d9 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c32defec8443468861dbc8d33e3b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780f91ca8c6f461ba347cd2510dceeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:33.275394 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-64a63986-2c3f-4f4a-9ad0-0623608e76d9 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] 10.222.0.61 "GET /compute/v2.1/servers/e8cfd63c-6e99-429f-93f2-ea40c02d7657" status: 200 len: 1366 microversion: 2.47 time: 0.116315 Aug 31 16:11:33.276324 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1722/3450] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:11:33 2022] GET /compute/v2.1/servers/e8cfd63c-6e99-429f-93f2-ea40c02d7657 => generated 1366 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:11:33.294864 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-472cf5cc-ec20-442e-9d1b-c68b09bd382d tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:33.312567 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-472cf5cc-ec20-442e-9d1b-c68b09bd382d tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] 10.222.0.61 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.023013 Aug 31 16:11:33.319958 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1723/3451] 10.222.0.61 () {58 vars in 1152 bytes} [Wed Aug 31 16:11:33 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:11:33.319958 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-1e615d22-65e1-4675-a983-7cf9ebfac4eb req-c114d31e-f0c6-4a02-b027-24afa3b9cdbe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "519c7ca0-6d6b-4250-9b7b-8d5b6ef3b6b4", "tag": "1a1343db-340f-4783-a294-d85170dd8622"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:11:33.328430 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-1e615d22-65e1-4675-a983-7cf9ebfac4eb req-c114d31e-f0c6-4a02-b027-24afa3b9cdbe service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:33.328925 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-1e615d22-65e1-4675-a983-7cf9ebfac4eb req-c114d31e-f0c6-4a02-b027-24afa3b9cdbe service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:33.329368 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-1e615d22-65e1-4675-a983-7cf9ebfac4eb req-c114d31e-f0c6-4a02-b027-24afa3b9cdbe service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:33.344577 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-1e615d22-65e1-4675-a983-7cf9ebfac4eb req-c114d31e-f0c6-4a02-b027-24afa3b9cdbe service nova] Creating event network-changed:1a1343db-340f-4783-a294-d85170dd8622 for instance 519c7ca0-6d6b-4250-9b7b-8d5b6ef3b6b4 on n-h2-850499-9 Aug 31 16:11:33.350732 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-1e615d22-65e1-4675-a983-7cf9ebfac4eb req-c114d31e-f0c6-4a02-b027-24afa3b9cdbe service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035219 Aug 31 16:11:33.351673 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1724/3452] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:11:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:11:33.356837 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-373caefd-6da6-485c-bc18-9eaf767520a9 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:33.357549 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-373caefd-6da6-485c-bc18-9eaf767520a9 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] [instance: fa0932e8-1aa4-4d1a-b653-14be35568f3d] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:33.364418 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-373caefd-6da6-485c-bc18-9eaf767520a9 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:33.364915 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-373caefd-6da6-485c-bc18-9eaf767520a9 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:33.365482 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-373caefd-6da6-485c-bc18-9eaf767520a9 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:33.366553 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-373caefd-6da6-485c-bc18-9eaf767520a9 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:33.367261 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-373caefd-6da6-485c-bc18-9eaf767520a9 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:33.367754 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-373caefd-6da6-485c-bc18-9eaf767520a9 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:33.689763 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-373caefd-6da6-485c-bc18-9eaf767520a9 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:33.700590 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-373caefd-6da6-485c-bc18-9eaf767520a9 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:33.702311 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-373caefd-6da6-485c-bc18-9eaf767520a9 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:33.703559 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-373caefd-6da6-485c-bc18-9eaf767520a9 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] 10.222.0.61 "GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d" status: 200 len: 1879 microversion: 2.32 time: 0.350738 Aug 31 16:11:33.704304 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1725/3453] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:11:33 2022] GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d => generated 1879 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:11:33.714723 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-352d244a-db75-47db-8da2-0934310dc354 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Action: 'create', calling method: .version_select at 0x7f5aed29a790>, body: {"server_group": {"name": "tempest-server-group-19911262", "policies": ["affinity"]}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:11:33.735964 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-352d244a-db75-47db-8da2-0934310dc354 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Getting quotas for project 859e7bbce8ed4dea985c73abe3ec8cd8. Resources: {'server_groups'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:11:33.742011 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-352d244a-db75-47db-8da2-0934310dc354 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Getting quotas for user de1444fdefda4eaeac9b11577ad7248b and project 859e7bbce8ed4dea985c73abe3ec8cd8. Resources: {'server_groups'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:11:33.788919 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-352d244a-db75-47db-8da2-0934310dc354 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Getting quotas for project 859e7bbce8ed4dea985c73abe3ec8cd8. Resources: {'server_groups'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:11:33.795389 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-352d244a-db75-47db-8da2-0934310dc354 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Getting quotas for user de1444fdefda4eaeac9b11577ad7248b and project 859e7bbce8ed4dea985c73abe3ec8cd8. Resources: {'server_groups'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:11:33.809723 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-352d244a-db75-47db-8da2-0934310dc354 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] 10.222.0.61 "POST /compute/v2.1/os-server-groups" status: 200 len: 162 microversion: 2.1 time: 0.100204 Aug 31 16:11:33.815812 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1726/3454] 10.222.0.61 () {60 vars in 1173 bytes} [Wed Aug 31 16:11:33 2022] POST /compute/v2.1/os-server-groups => generated 162 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:11:33.815812 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a6c8480b-7903-488c-b419-5ee737fd70b8 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:33.816067 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a6c8480b-7903-488c-b419-5ee737fd70b8 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] [instance: 0ac914d2-e9f7-4f2f-a01d-49674180d8db] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:33.825089 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a6c8480b-7903-488c-b419-5ee737fd70b8 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:33.825600 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a6c8480b-7903-488c-b419-5ee737fd70b8 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:33.826180 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a6c8480b-7903-488c-b419-5ee737fd70b8 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:33.826953 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a6c8480b-7903-488c-b419-5ee737fd70b8 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:33.827524 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a6c8480b-7903-488c-b419-5ee737fd70b8 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:33.828160 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a6c8480b-7903-488c-b419-5ee737fd70b8 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:33.907764 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a6c8480b-7903-488c-b419-5ee737fd70b8 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c65ee5ffa9d74bfdacbea45f1564d19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55320a9c8f714bc0911ded3ab88ddf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:33.913868 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=100 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:11:33.918980 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a6c8480b-7903-488c-b419-5ee737fd70b8 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] 10.222.0.61 "GET /compute/v2.1/servers/0ac914d2-e9f7-4f2f-a01d-49674180d8db" status: 200 len: 1252 microversion: 2.1 time: 0.107576 Aug 31 16:11:33.931741 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1727/3455] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:33 2022] GET /compute/v2.1/servers/0ac914d2-e9f7-4f2f-a01d-49674180d8db => generated 1252 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:33.931741 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-90a04b97-8a71-40b5-b0c5-33d371db7495 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:33.951316 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-90a04b97-8a71-40b5-b0c5-33d371db7495 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] 10.222.0.61 "DELETE /compute/v2.1/os-server-groups/a477d232-2344-4655-b54e-cc1171d27bba" status: 204 len: 0 microversion: 2.1 time: 0.030566 Aug 31 16:11:33.952213 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1728/3456] 10.222.0.61 () {58 vars in 1266 bytes} [Wed Aug 31 16:11:33 2022] DELETE /compute/v2.1/os-server-groups/a477d232-2344-4655-b54e-cc1171d27bba => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:11:33.961193 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-532dfa04-f19b-4bed-956f-0adec2a05b76 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:33.977807 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-532dfa04-f19b-4bed-956f-0adec2a05b76 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] 10.222.0.61 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.019115 Aug 31 16:11:33.984912 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1729/3457] 10.222.0.61 () {58 vars in 1152 bytes} [Wed Aug 31 16:11:33 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:11:33.998191 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-80028ca1-06bd-4630-877c-bd705ec6fb68 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Action: 'create', calling method: .version_select at 0x7f5aed2c70d0>, body: {"server_group": {"name": "tempest-server-group-187362515", "policies": ["anti-affinity"]}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:11:34.020950 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-80028ca1-06bd-4630-877c-bd705ec6fb68 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Getting quotas for project 859e7bbce8ed4dea985c73abe3ec8cd8. Resources: {'server_groups'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:11:34.028324 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-80028ca1-06bd-4630-877c-bd705ec6fb68 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Getting quotas for user de1444fdefda4eaeac9b11577ad7248b and project 859e7bbce8ed4dea985c73abe3ec8cd8. Resources: {'server_groups'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:11:34.133394 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-80028ca1-06bd-4630-877c-bd705ec6fb68 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Getting quotas for project 859e7bbce8ed4dea985c73abe3ec8cd8. Resources: {'server_groups'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:11:34.157790 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-80028ca1-06bd-4630-877c-bd705ec6fb68 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Getting quotas for user de1444fdefda4eaeac9b11577ad7248b and project 859e7bbce8ed4dea985c73abe3ec8cd8. Resources: {'server_groups'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:11:34.218858 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-80028ca1-06bd-4630-877c-bd705ec6fb68 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] 10.222.0.61 "POST /compute/v2.1/os-server-groups" status: 200 len: 168 microversion: 2.1 time: 0.226276 Aug 31 16:11:34.237737 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1730/3458] 10.222.0.61 () {60 vars in 1173 bytes} [Wed Aug 31 16:11:33 2022] POST /compute/v2.1/os-server-groups => generated 168 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:11:34.242761 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2ab5873d-d8b1-4c26-9599-45706b5759ca tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:34.243402 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2ab5873d-d8b1-4c26-9599-45706b5759ca tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 519c7ca0-6d6b-4250-9b7b-8d5b6ef3b6b4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:34.261058 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2ab5873d-d8b1-4c26-9599-45706b5759ca tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:34.261736 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2ab5873d-d8b1-4c26-9599-45706b5759ca tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:34.262319 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2ab5873d-d8b1-4c26-9599-45706b5759ca tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:34.263166 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2ab5873d-d8b1-4c26-9599-45706b5759ca tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:34.263771 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2ab5873d-d8b1-4c26-9599-45706b5759ca tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:34.264410 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2ab5873d-d8b1-4c26-9599-45706b5759ca tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:34.565021 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2ab5873d-d8b1-4c26-9599-45706b5759ca tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:34.575587 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2ab5873d-d8b1-4c26-9599-45706b5759ca tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/519c7ca0-6d6b-4250-9b7b-8d5b6ef3b6b4" status: 200 len: 1320 microversion: 2.1 time: 0.336640 Aug 31 16:11:34.587955 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1731/3459] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:34 2022] GET /compute/v2.1/servers/519c7ca0-6d6b-4250-9b7b-8d5b6ef3b6b4 => generated 1320 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:34.595032 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9f612ff3-b6ef-4912-845f-45de309a6295 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:34.595703 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9f612ff3-b6ef-4912-845f-45de309a6295 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] [instance: 685d47e4-721e-4eae-b5f8-78fdb68454ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:34.601687 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9f612ff3-b6ef-4912-845f-45de309a6295 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:34.602185 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9f612ff3-b6ef-4912-845f-45de309a6295 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:34.602635 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9f612ff3-b6ef-4912-845f-45de309a6295 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:34.603346 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9f612ff3-b6ef-4912-845f-45de309a6295 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:34.604001 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9f612ff3-b6ef-4912-845f-45de309a6295 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:34.604463 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9f612ff3-b6ef-4912-845f-45de309a6295 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:34.704786 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9f612ff3-b6ef-4912-845f-45de309a6295 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:34.715378 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9f612ff3-b6ef-4912-845f-45de309a6295 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:34.717151 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9f612ff3-b6ef-4912-845f-45de309a6295 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:34.718457 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9f612ff3-b6ef-4912-845f-45de309a6295 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] 10.222.0.61 "GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae" status: 200 len: 1605 microversion: 2.42 time: 0.129419 Aug 31 16:11:34.736772 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1732/3460] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:11:34 2022] GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae => generated 1605 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:11:34.745400 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-37e54d6e-1383-41af-a06d-72bfd940fdda tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:34.749053 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=6,nova_api:INSERT=4 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:11:34.776881 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-37e54d6e-1383-41af-a06d-72bfd940fdda tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] 10.222.0.61 "DELETE /compute/v2.1/os-server-groups/5ffb21ef-7dcf-4059-9498-4599fba7ce48" status: 204 len: 0 microversion: 2.1 time: 0.038774 Aug 31 16:11:34.777738 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1733/3461] 10.222.0.61 () {58 vars in 1266 bytes} [Wed Aug 31 16:11:34 2022] DELETE /compute/v2.1/os-server-groups/5ffb21ef-7dcf-4059-9498-4599fba7ce48 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:11:34.786159 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ab6d1a6f-2c65-4259-b232-bf443e280010 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:34.786790 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ab6d1a6f-2c65-4259-b232-bf443e280010 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] [instance: e8cfd63c-6e99-429f-93f2-ea40c02d7657] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:34.795145 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ab6d1a6f-2c65-4259-b232-bf443e280010 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:34.795780 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ab6d1a6f-2c65-4259-b232-bf443e280010 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:34.796310 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ab6d1a6f-2c65-4259-b232-bf443e280010 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:34.797136 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ab6d1a6f-2c65-4259-b232-bf443e280010 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:34.797614 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ab6d1a6f-2c65-4259-b232-bf443e280010 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:34.798224 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ab6d1a6f-2c65-4259-b232-bf443e280010 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:34.868621 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.network.neutron [None req-d8efb6cc-4809-46ad-8e13-923978d52eff tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] [instance: c7ae279f-9e24-4755-a912-6bec59837e6c] re-assign floating IP 172.25.6.121 from instance 606f1624-8c53-409e-b06b-ace080f7fc44 Aug 31 16:11:34.885039 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-d8efb6cc-4809-46ad-8e13-923978d52eff tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] [instance: 606f1624-8c53-409e-b06b-ace080f7fc44] Building network info cache for instance {{(pid=122256) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 31 16:11:34.903045 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ab6d1a6f-2c65-4259-b232-bf443e280010 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c32defec8443468861dbc8d33e3b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780f91ca8c6f461ba347cd2510dceeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:34.918960 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ab6d1a6f-2c65-4259-b232-bf443e280010 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c32defec8443468861dbc8d33e3b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780f91ca8c6f461ba347cd2510dceeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:34.924366 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ab6d1a6f-2c65-4259-b232-bf443e280010 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c32defec8443468861dbc8d33e3b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780f91ca8c6f461ba347cd2510dceeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:34.931543 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ab6d1a6f-2c65-4259-b232-bf443e280010 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] 10.222.0.61 "GET /compute/v2.1/servers/e8cfd63c-6e99-429f-93f2-ea40c02d7657" status: 200 len: 1366 microversion: 2.47 time: 0.149462 Aug 31 16:11:34.940187 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1734/3462] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:11:34 2022] GET /compute/v2.1/servers/e8cfd63c-6e99-429f-93f2-ea40c02d7657 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:11:34.940187 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-80e4ebdb-70cd-4cb0-a12e-eded04eb6608 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:34.940187 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-80e4ebdb-70cd-4cb0-a12e-eded04eb6608 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] [instance: fa0932e8-1aa4-4d1a-b653-14be35568f3d] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:34.949187 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-80e4ebdb-70cd-4cb0-a12e-eded04eb6608 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:34.949187 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-80e4ebdb-70cd-4cb0-a12e-eded04eb6608 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:34.949187 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-80e4ebdb-70cd-4cb0-a12e-eded04eb6608 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:34.950443 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-80e4ebdb-70cd-4cb0-a12e-eded04eb6608 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:34.950917 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-80e4ebdb-70cd-4cb0-a12e-eded04eb6608 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:34.951702 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-80e4ebdb-70cd-4cb0-a12e-eded04eb6608 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:35.272394 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-80e4ebdb-70cd-4cb0-a12e-eded04eb6608 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:35.284130 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-80e4ebdb-70cd-4cb0-a12e-eded04eb6608 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:35.285886 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-80e4ebdb-70cd-4cb0-a12e-eded04eb6608 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:35.287399 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-80e4ebdb-70cd-4cb0-a12e-eded04eb6608 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] 10.222.0.61 "GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d" status: 200 len: 1879 microversion: 2.32 time: 0.351951 Aug 31 16:11:35.288598 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1735/3463] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:11:34 2022] GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d => generated 1879 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:11:35.293698 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-bf34d79e-46f5-466c-9e5d-340d65a6055e tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:35.307957 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-bf34d79e-46f5-466c-9e5d-340d65a6055e tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] 10.222.0.61 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.017587 Aug 31 16:11:35.309022 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1736/3464] 10.222.0.61 () {58 vars in 1152 bytes} [Wed Aug 31 16:11:35 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:11:35.314950 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7b939821-12b6-457e-b4ff-1ed642a39e46 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:35.315732 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7b939821-12b6-457e-b4ff-1ed642a39e46 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] [instance: 0ac914d2-e9f7-4f2f-a01d-49674180d8db] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:35.327675 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7b939821-12b6-457e-b4ff-1ed642a39e46 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:35.328502 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7b939821-12b6-457e-b4ff-1ed642a39e46 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:35.328949 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7b939821-12b6-457e-b4ff-1ed642a39e46 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:35.329814 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7b939821-12b6-457e-b4ff-1ed642a39e46 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:35.330619 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7b939821-12b6-457e-b4ff-1ed642a39e46 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:35.331203 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7b939821-12b6-457e-b4ff-1ed642a39e46 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:35.384612 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7b939821-12b6-457e-b4ff-1ed642a39e46 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:35.385015 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7b939821-12b6-457e-b4ff-1ed642a39e46 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:35.385458 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7b939821-12b6-457e-b4ff-1ed642a39e46 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:35.385919 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-7b939821-12b6-457e-b4ff-1ed642a39e46 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lazy-loading 'fault' on Instance uuid 0ac914d2-e9f7-4f2f-a01d-49674180d8db {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:11:35.453611 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7b939821-12b6-457e-b4ff-1ed642a39e46 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c65ee5ffa9d74bfdacbea45f1564d19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55320a9c8f714bc0911ded3ab88ddf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:35.464991 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7b939821-12b6-457e-b4ff-1ed642a39e46 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] 10.222.0.61 "GET /compute/v2.1/servers/0ac914d2-e9f7-4f2f-a01d-49674180d8db" status: 200 len: 1257 microversion: 2.1 time: 0.154655 Aug 31 16:11:35.466200 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1737/3465] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:35 2022] GET /compute/v2.1/servers/0ac914d2-e9f7-4f2f-a01d-49674180d8db => generated 1257 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:35.473532 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-861a1c0c-8ce8-49bc-9519-990b111ca1a3 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-1869027736", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "networks": [{"uuid": "19b59070-5de1-4f26-8b09-14defef4785f"}]}, "os:scheduler_hints": {"group": "8c9fbf5a-c35f-4cec-ab26-f8079a47a3d8"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:11:35.550094 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-861a1c0c-8ce8-49bc-9519-990b111ca1a3 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] validate_networks() for [('19b59070-5de1-4f26-8b09-14defef4785f', None, None, None, None, None)] {{(pid=122257) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:11:35.796973 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-d8efb6cc-4809-46ad-8e13-923978d52eff tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] [instance: 606f1624-8c53-409e-b06b-ace080f7fc44] Updating instance_info_cache with network_info: [{"id": "bd761e9e-656b-4464-b63f-bb9440ae7e14", "address": "fa:16:3e:01:26:ee", "network": {"id": "567c9ba1-6364-4d01-9016-4aec92f3efc9", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1516295813-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "eab7f0d889224cefbca55343f3208a86", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapbd761e9e-65", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122256) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 31 16:11:35.811613 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-d8efb6cc-4809-46ad-8e13-923978d52eff tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] [instance: c7ae279f-9e24-4755-a912-6bec59837e6c] Building network info cache for instance {{(pid=122256) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 31 16:11:36.293005 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-861a1c0c-8ce8-49bc-9519-990b111ca1a3 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:11:36.294647 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-861a1c0c-8ce8-49bc-9519-990b111ca1a3 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:11:36.295392 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-861a1c0c-8ce8-49bc-9519-990b111ca1a3 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:11:36.296247 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-861a1c0c-8ce8-49bc-9519-990b111ca1a3 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:11:36.296826 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-861a1c0c-8ce8-49bc-9519-990b111ca1a3 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:11:36.314252 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-861a1c0c-8ce8-49bc-9519-990b111ca1a3 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:36.315844 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-861a1c0c-8ce8-49bc-9519-990b111ca1a3 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:36.316469 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-861a1c0c-8ce8-49bc-9519-990b111ca1a3 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:36.317318 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-861a1c0c-8ce8-49bc-9519-990b111ca1a3 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:36.319964 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-861a1c0c-8ce8-49bc-9519-990b111ca1a3 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:36.323902 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-861a1c0c-8ce8-49bc-9519-990b111ca1a3 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:36.347491 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-861a1c0c-8ce8-49bc-9519-990b111ca1a3 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Getting quotas for project 859e7bbce8ed4dea985c73abe3ec8cd8. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:11:36.355897 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-861a1c0c-8ce8-49bc-9519-990b111ca1a3 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Getting quotas for user de1444fdefda4eaeac9b11577ad7248b and project 859e7bbce8ed4dea985c73abe3ec8cd8. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:11:36.375030 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-861a1c0c-8ce8-49bc-9519-990b111ca1a3 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Going to run 1 instances... {{(pid=122257) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:11:36.378660 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-861a1c0c-8ce8-49bc-9519-990b111ca1a3 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] [instance: 596c5ff8-2dc8-4248-be52-eab6df1793e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:11:36.441121 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-861a1c0c-8ce8-49bc-9519-990b111ca1a3 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Getting quotas for project 859e7bbce8ed4dea985c73abe3ec8cd8. Resources: {'server_group_members'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:11:36.449135 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-861a1c0c-8ce8-49bc-9519-990b111ca1a3 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Getting quotas for user de1444fdefda4eaeac9b11577ad7248b and project 859e7bbce8ed4dea985c73abe3ec8cd8. Resources: {'server_group_members'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:11:36.503813 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-861a1c0c-8ce8-49bc-9519-990b111ca1a3 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Getting quotas for project 859e7bbce8ed4dea985c73abe3ec8cd8. Resources: {'server_group_members'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:11:36.514953 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-861a1c0c-8ce8-49bc-9519-990b111ca1a3 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Getting quotas for user de1444fdefda4eaeac9b11577ad7248b and project 859e7bbce8ed4dea985c73abe3ec8cd8. Resources: {'server_group_members'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:11:36.547713 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-861a1c0c-8ce8-49bc-9519-990b111ca1a3 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.078297 Aug 31 16:11:36.548805 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1738/3466] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:11:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1082 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:11:36.554803 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-0202e826-f918-4613-ab2a-66f968b176dc req-31a8e10c-2038-4bcf-85a2-518b1859a079 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "606f1624-8c53-409e-b06b-ace080f7fc44", "tag": "bd761e9e-656b-4464-b63f-bb9440ae7e14"}, {"name": "network-changed", "server_uuid": "c7ae279f-9e24-4755-a912-6bec59837e6c", "tag": "8b930bc1-225f-4f61-b131-4d4ae19c2ba2"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:11:36.566578 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-0202e826-f918-4613-ab2a-66f968b176dc req-31a8e10c-2038-4bcf-85a2-518b1859a079 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:36.567078 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-0202e826-f918-4613-ab2a-66f968b176dc req-31a8e10c-2038-4bcf-85a2-518b1859a079 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:36.567547 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-0202e826-f918-4613-ab2a-66f968b176dc req-31a8e10c-2038-4bcf-85a2-518b1859a079 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:36.589139 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-0202e826-f918-4613-ab2a-66f968b176dc req-31a8e10c-2038-4bcf-85a2-518b1859a079 service nova] Creating event network-changed:bd761e9e-656b-4464-b63f-bb9440ae7e14 for instance 606f1624-8c53-409e-b06b-ace080f7fc44 on n-h1-850499-9 Aug 31 16:11:36.590057 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-0202e826-f918-4613-ab2a-66f968b176dc req-31a8e10c-2038-4bcf-85a2-518b1859a079 service nova] Creating event network-changed:8b930bc1-225f-4f61-b131-4d4ae19c2ba2 for instance c7ae279f-9e24-4755-a912-6bec59837e6c on n-h2-850499-9 Aug 31 16:11:36.591549 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-d8efb6cc-4809-46ad-8e13-923978d52eff tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] [instance: c7ae279f-9e24-4755-a912-6bec59837e6c] Updating instance_info_cache with network_info: [{"id": "8b930bc1-225f-4f61-b131-4d4ae19c2ba2", "address": "fa:16:3e:35:f5:da", "network": {"id": "567c9ba1-6364-4d01-9016-4aec92f3efc9", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1516295813-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.6.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "eab7f0d889224cefbca55343f3208a86", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap8b930bc1-22", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122256) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 31 16:11:36.605073 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-0202e826-f918-4613-ab2a-66f968b176dc req-31a8e10c-2038-4bcf-85a2-518b1859a079 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.054878 Aug 31 16:11:36.606537 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1739/3467] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:11:36 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:11:36.607296 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d8efb6cc-4809-46ad-8e13-923978d52eff tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Releasing lock "refresh_cache-c7ae279f-9e24-4755-a912-6bec59837e6c" {{(pid=122256) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 31 16:11:36.608708 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d8efb6cc-4809-46ad-8e13-923978d52eff tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] 10.222.0.61 "POST /compute/v2.1/servers/c7ae279f-9e24-4755-a912-6bec59837e6c/action" status: 202 len: 0 microversion: 2.1 time: 5.114913 Aug 31 16:11:36.612338 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a6d46bd5-1c37-41fc-9b73-1591d47a94b1 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:36.613286 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a6d46bd5-1c37-41fc-9b73-1591d47a94b1 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 519c7ca0-6d6b-4250-9b7b-8d5b6ef3b6b4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:36.616318 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1729/3468] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:11:31 2022] POST /compute/v2.1/servers/c7ae279f-9e24-4755-a912-6bec59837e6c/action => generated 0 bytes in 5123 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 31 16:11:36.621164 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a6d46bd5-1c37-41fc-9b73-1591d47a94b1 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:36.621663 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a6d46bd5-1c37-41fc-9b73-1591d47a94b1 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:36.622095 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a6d46bd5-1c37-41fc-9b73-1591d47a94b1 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:36.622944 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a6d46bd5-1c37-41fc-9b73-1591d47a94b1 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:36.623483 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a6d46bd5-1c37-41fc-9b73-1591d47a94b1 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:36.623933 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a6d46bd5-1c37-41fc-9b73-1591d47a94b1 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:36.650146 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e27b3a11-b57b-45bf-a16c-2fc385a1c174 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:36.654039 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e27b3a11-b57b-45bf-a16c-2fc385a1c174 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] [instance: 685d47e4-721e-4eae-b5f8-78fdb68454ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:36.672669 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e27b3a11-b57b-45bf-a16c-2fc385a1c174 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:36.673436 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e27b3a11-b57b-45bf-a16c-2fc385a1c174 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:36.675313 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e27b3a11-b57b-45bf-a16c-2fc385a1c174 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:36.676666 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e27b3a11-b57b-45bf-a16c-2fc385a1c174 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:36.679592 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e27b3a11-b57b-45bf-a16c-2fc385a1c174 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:36.680228 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e27b3a11-b57b-45bf-a16c-2fc385a1c174 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:36.836750 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e27b3a11-b57b-45bf-a16c-2fc385a1c174 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:36.852178 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e27b3a11-b57b-45bf-a16c-2fc385a1c174 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:36.858620 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e27b3a11-b57b-45bf-a16c-2fc385a1c174 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:36.859876 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e27b3a11-b57b-45bf-a16c-2fc385a1c174 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] 10.222.0.61 "GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae" status: 200 len: 1605 microversion: 2.42 time: 0.240838 Aug 31 16:11:36.862121 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1730/3469] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:11:36 2022] GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae => generated 1605 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:11:36.872339 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d5ad0240-adc4-4770-931c-4061c4015661 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:36.873179 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d5ad0240-adc4-4770-931c-4061c4015661 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] [instance: e8cfd63c-6e99-429f-93f2-ea40c02d7657] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:36.886973 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d5ad0240-adc4-4770-931c-4061c4015661 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:36.890777 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d5ad0240-adc4-4770-931c-4061c4015661 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:36.891465 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d5ad0240-adc4-4770-931c-4061c4015661 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:36.893730 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d5ad0240-adc4-4770-931c-4061c4015661 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:36.894386 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d5ad0240-adc4-4770-931c-4061c4015661 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:36.896146 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d5ad0240-adc4-4770-931c-4061c4015661 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:37.314427 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d5ad0240-adc4-4770-931c-4061c4015661 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c32defec8443468861dbc8d33e3b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780f91ca8c6f461ba347cd2510dceeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:37.326014 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d5ad0240-adc4-4770-931c-4061c4015661 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c32defec8443468861dbc8d33e3b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780f91ca8c6f461ba347cd2510dceeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:37.327775 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d5ad0240-adc4-4770-931c-4061c4015661 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c32defec8443468861dbc8d33e3b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780f91ca8c6f461ba347cd2510dceeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:37.331911 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d5ad0240-adc4-4770-931c-4061c4015661 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] 10.222.0.61 "GET /compute/v2.1/servers/e8cfd63c-6e99-429f-93f2-ea40c02d7657" status: 200 len: 1366 microversion: 2.47 time: 0.468715 Aug 31 16:11:37.349099 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1731/3470] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:11:36 2022] GET /compute/v2.1/servers/e8cfd63c-6e99-429f-93f2-ea40c02d7657 => generated 1366 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:11:37.356835 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8316f114-13f2-49cb-8b73-3c9d47743505 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:37.357761 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8316f114-13f2-49cb-8b73-3c9d47743505 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] [instance: fa0932e8-1aa4-4d1a-b653-14be35568f3d] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:37.364585 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8316f114-13f2-49cb-8b73-3c9d47743505 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:37.366193 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8316f114-13f2-49cb-8b73-3c9d47743505 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:37.366821 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8316f114-13f2-49cb-8b73-3c9d47743505 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:37.368213 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8316f114-13f2-49cb-8b73-3c9d47743505 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:37.369144 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8316f114-13f2-49cb-8b73-3c9d47743505 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:37.369817 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8316f114-13f2-49cb-8b73-3c9d47743505 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:37.548670 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a6d46bd5-1c37-41fc-9b73-1591d47a94b1 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:37.559427 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a6d46bd5-1c37-41fc-9b73-1591d47a94b1 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/519c7ca0-6d6b-4250-9b7b-8d5b6ef3b6b4" status: 200 len: 1320 microversion: 2.1 time: 0.951097 Aug 31 16:11:37.567308 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1740/3471] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:36 2022] GET /compute/v2.1/servers/519c7ca0-6d6b-4250-9b7b-8d5b6ef3b6b4 => generated 1320 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:37.574678 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8e33ef5e-cd94-4dd5-aa1d-1cfccf6d6f0d tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:37.575345 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8e33ef5e-cd94-4dd5-aa1d-1cfccf6d6f0d tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] [instance: 0ac914d2-e9f7-4f2f-a01d-49674180d8db] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:37.582889 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8e33ef5e-cd94-4dd5-aa1d-1cfccf6d6f0d tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:37.583627 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8e33ef5e-cd94-4dd5-aa1d-1cfccf6d6f0d tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:37.584728 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8e33ef5e-cd94-4dd5-aa1d-1cfccf6d6f0d tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:37.585990 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8e33ef5e-cd94-4dd5-aa1d-1cfccf6d6f0d tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:37.586751 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8e33ef5e-cd94-4dd5-aa1d-1cfccf6d6f0d tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:37.588154 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8e33ef5e-cd94-4dd5-aa1d-1cfccf6d6f0d tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:37.637449 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8e33ef5e-cd94-4dd5-aa1d-1cfccf6d6f0d tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:37.638414 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8e33ef5e-cd94-4dd5-aa1d-1cfccf6d6f0d tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:37.638981 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8e33ef5e-cd94-4dd5-aa1d-1cfccf6d6f0d tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:37.639807 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-8e33ef5e-cd94-4dd5-aa1d-1cfccf6d6f0d tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lazy-loading 'fault' on Instance uuid 0ac914d2-e9f7-4f2f-a01d-49674180d8db {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:11:37.745885 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8e33ef5e-cd94-4dd5-aa1d-1cfccf6d6f0d tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c65ee5ffa9d74bfdacbea45f1564d19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55320a9c8f714bc0911ded3ab88ddf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:37.754913 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8e33ef5e-cd94-4dd5-aa1d-1cfccf6d6f0d tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] 10.222.0.61 "GET /compute/v2.1/servers/0ac914d2-e9f7-4f2f-a01d-49674180d8db" status: 200 len: 1257 microversion: 2.1 time: 0.185311 Aug 31 16:11:37.768072 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1741/3472] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:37 2022] GET /compute/v2.1/servers/0ac914d2-e9f7-4f2f-a01d-49674180d8db => generated 1257 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:37.778739 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ddfa1822-03a6-4d68-8c20-fe1b5a5f90bf tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:37.779525 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ddfa1822-03a6-4d68-8c20-fe1b5a5f90bf tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] [instance: 596c5ff8-2dc8-4248-be52-eab6df1793e0] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:37.786933 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ddfa1822-03a6-4d68-8c20-fe1b5a5f90bf tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:37.788860 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ddfa1822-03a6-4d68-8c20-fe1b5a5f90bf tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:37.789681 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ddfa1822-03a6-4d68-8c20-fe1b5a5f90bf tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:37.790671 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ddfa1822-03a6-4d68-8c20-fe1b5a5f90bf tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:37.791371 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ddfa1822-03a6-4d68-8c20-fe1b5a5f90bf tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:37.792062 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ddfa1822-03a6-4d68-8c20-fe1b5a5f90bf tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:37.909535 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8316f114-13f2-49cb-8b73-3c9d47743505 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:37.921610 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8316f114-13f2-49cb-8b73-3c9d47743505 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:37.923923 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8316f114-13f2-49cb-8b73-3c9d47743505 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:37.925598 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8316f114-13f2-49cb-8b73-3c9d47743505 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] 10.222.0.61 "GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d" status: 200 len: 1879 microversion: 2.32 time: 0.574735 Aug 31 16:11:37.926340 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1732/3473] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:11:37 2022] GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d => generated 1879 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:11:37.931803 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-df4917ff-9446-41fa-bb2a-c0025bcb5ab9 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.6.121"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:11:38.016180 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ddfa1822-03a6-4d68-8c20-fe1b5a5f90bf tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1444fdefda4eaeac9b11577ad7248b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859e7bbce8ed4dea985c73abe3ec8cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:38.031828 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ddfa1822-03a6-4d68-8c20-fe1b5a5f90bf tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] 10.222.0.61 "GET /compute/v2.1/servers/596c5ff8-2dc8-4248-be52-eab6df1793e0" status: 200 len: 1209 microversion: 2.1 time: 0.262089 Aug 31 16:11:38.033869 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1742/3474] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:37 2022] GET /compute/v2.1/servers/596c5ff8-2dc8-4248-be52-eab6df1793e0 => generated 1209 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:38.043064 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9de6b6d9-6847-41c7-9121-56a126efcca9 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:38.044380 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9de6b6d9-6847-41c7-9121-56a126efcca9 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] [instance: 685d47e4-721e-4eae-b5f8-78fdb68454ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:38.051365 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9de6b6d9-6847-41c7-9121-56a126efcca9 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:38.051918 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9de6b6d9-6847-41c7-9121-56a126efcca9 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:38.052367 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9de6b6d9-6847-41c7-9121-56a126efcca9 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:38.053473 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9de6b6d9-6847-41c7-9121-56a126efcca9 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:38.054396 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9de6b6d9-6847-41c7-9121-56a126efcca9 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:38.054922 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9de6b6d9-6847-41c7-9121-56a126efcca9 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:38.221382 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9de6b6d9-6847-41c7-9121-56a126efcca9 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:38.235271 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9de6b6d9-6847-41c7-9121-56a126efcca9 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:38.237540 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9de6b6d9-6847-41c7-9121-56a126efcca9 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:38.238888 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9de6b6d9-6847-41c7-9121-56a126efcca9 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] 10.222.0.61 "GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae" status: 200 len: 1605 microversion: 2.42 time: 0.203386 Aug 31 16:11:38.239824 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1743/3475] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:11:38 2022] GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae => generated 1605 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:11:38.337275 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-df4917ff-9446-41fa-bb2a-c0025bcb5ab9 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] [instance: c7ae279f-9e24-4755-a912-6bec59837e6c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:38.339347 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=9,nova_api:UPDATE=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:11:38.346072 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-df4917ff-9446-41fa-bb2a-c0025bcb5ab9 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:38.346563 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-df4917ff-9446-41fa-bb2a-c0025bcb5ab9 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:38.346998 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-df4917ff-9446-41fa-bb2a-c0025bcb5ab9 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:38.347727 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-df4917ff-9446-41fa-bb2a-c0025bcb5ab9 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:38.348188 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-df4917ff-9446-41fa-bb2a-c0025bcb5ab9 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:38.348669 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-df4917ff-9446-41fa-bb2a-c0025bcb5ab9 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:38.361071 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1ffdbb8d-8b3e-49d5-8310-394522f99096 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:38.362011 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1ffdbb8d-8b3e-49d5-8310-394522f99096 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] [instance: e8cfd63c-6e99-429f-93f2-ea40c02d7657] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:38.369483 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1ffdbb8d-8b3e-49d5-8310-394522f99096 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:38.369989 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1ffdbb8d-8b3e-49d5-8310-394522f99096 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:38.370434 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1ffdbb8d-8b3e-49d5-8310-394522f99096 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:38.371680 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1ffdbb8d-8b3e-49d5-8310-394522f99096 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:38.371680 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1ffdbb8d-8b3e-49d5-8310-394522f99096 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:38.372083 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1ffdbb8d-8b3e-49d5-8310-394522f99096 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:38.464315 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-1ffdbb8d-8b3e-49d5-8310-394522f99096 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c32defec8443468861dbc8d33e3b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780f91ca8c6f461ba347cd2510dceeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:38.473612 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-1ffdbb8d-8b3e-49d5-8310-394522f99096 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c32defec8443468861dbc8d33e3b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780f91ca8c6f461ba347cd2510dceeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:38.475739 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-1ffdbb8d-8b3e-49d5-8310-394522f99096 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c32defec8443468861dbc8d33e3b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780f91ca8c6f461ba347cd2510dceeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:38.477234 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1ffdbb8d-8b3e-49d5-8310-394522f99096 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] 10.222.0.61 "GET /compute/v2.1/servers/e8cfd63c-6e99-429f-93f2-ea40c02d7657" status: 200 len: 1366 microversion: 2.47 time: 0.120279 Aug 31 16:11:38.478024 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1744/3476] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:11:38 2022] GET /compute/v2.1/servers/e8cfd63c-6e99-429f-93f2-ea40c02d7657 => generated 1366 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:11:38.582252 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-120d93f9-e1df-4615-879f-22b1517891b9 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:38.582916 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-120d93f9-e1df-4615-879f-22b1517891b9 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 519c7ca0-6d6b-4250-9b7b-8d5b6ef3b6b4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:38.590154 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-120d93f9-e1df-4615-879f-22b1517891b9 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:38.590918 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-120d93f9-e1df-4615-879f-22b1517891b9 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:38.591536 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-120d93f9-e1df-4615-879f-22b1517891b9 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:38.592424 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-120d93f9-e1df-4615-879f-22b1517891b9 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:38.593464 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-120d93f9-e1df-4615-879f-22b1517891b9 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:38.594230 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-120d93f9-e1df-4615-879f-22b1517891b9 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:38.942145 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-df4917ff-9446-41fa-bb2a-c0025bcb5ab9 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] HTTP exception thrown: Floating IP 172.25.6.121 is not associated with instance 606f1624-8c53-409e-b06b-ace080f7fc44. Aug 31 16:11:38.945525 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-df4917ff-9446-41fa-bb2a-c0025bcb5ab9 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Request method failure captured: Aug 31 16:11:38.945525 n-d-850499-9 devstack@n-api.service[122256]: request: POST /compute/v2.1/servers/606f1624-8c53-409e-b06b-ace080f7fc44/action HTTP/1.1 Aug 31 16:11:38.945525 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:11:38.945525 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:11:38.945525 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:11:38.945525 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 49 Aug 31 16:11:38.945525 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:11:38.945525 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:11:38.945525 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:11:38.945525 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:11:38.945525 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4fsKyN6baYRkKZFdkFawvt-fGsSIPYso-zL9k4if2ZEVbk1i96HvHSfcgWmzzyXd9tGvrvveBymxe9E8ZXpgksDtVOINDra1gXJqNgSp6a7cek_PkdyatZirH0_JTfxRV_xZn0asOjTaFXuYk_-Aj-azwU3vocTevjKBZKpL5Avosw Aug 31 16:11:38.945525 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:11:38.945525 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:11:38.945525 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:11:38.945525 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:11:38.945525 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:11:38.945525 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:11:38.945525 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: eab7f0d889224cefbca55343f3208a86 Aug 31 16:11:38.945525 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1010837413 Aug 31 16:11:38.945525 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:11:38.945525 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:11:38.945525 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/eab7f0d889224cefbca55343f3208a86"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/eab7f0d889224cefbca55343f3208a86"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_eab7f0d889224cefbca55343f3208a86", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/eab7f0d889224cefbca55343f3208a86"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:11:38.945525 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1010837413 Aug 31 16:11:38.945525 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: eab7f0d889224cefbca55343f3208a86 Aug 31 16:11:38.945525 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1010837413 Aug 31 16:11:38.945525 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-FloatingIPsAssociationTestJSON-1010837413-project Aug 31 16:11:38.945525 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:11:38.945525 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:11:38.945525 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: d13cabcaa79043bea338128594a6b00a Aug 31 16:11:38.945525 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1010837413-project Aug 31 16:11:38.945525 n-d-850499-9 devstack@n-api.service[122256]: Aug 31 16:11:38.945525 n-d-850499-9 devstack@n-api.service[122256]: {"removeFloatingIp": {"address": "172.25.6.121"}} Aug 31 16:11:38.945525 n-d-850499-9 devstack@n-api.service[122256]: method: Aug 31 16:11:38.945525 n-d-850499-9 devstack@n-api.service[122256]: exception: Floating IP 172.25.6.121 is not associated with instance 606f1624-8c53-409e-b06b-ace080f7fc44. Aug 31 16:11:38.945525 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '606f1624-8c53-409e-b06b-ace080f7fc44', 'body': {'removeFloatingIp': {'address': '172.25.6.121'}}} Aug 31 16:11:38.945525 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:11:38.945525 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:11:38.945525 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:11:38.945525 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:11:38.945525 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:11:38.945525 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:11:38.945525 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:11:38.945525 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:11:38.945525 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:11:38.945525 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:11:38.945525 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:11:38.945525 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:11:38.945525 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Aug 31 16:11:38.945525 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 31 16:11:38.945525 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.6.121 is not associated with instance 606f1624-8c53-409e-b06b-ace080f7fc44. Aug 31 16:11:38.945525 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:11:38.945525 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:11:38.945525 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:11:38.945525 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:11:38.945525 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:11:38.945525 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:11:38.945525 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:11:38.945525 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:11:38.945525 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.6.121 is not associated with instance 606f1624-8c53-409e-b06b-ace080f7fc44. Aug 31 16:11:38.945525 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:11:38.952147 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-df4917ff-9446-41fa-bb2a-c0025bcb5ab9 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Returning 409 to user: Floating IP 172.25.6.121 is not associated with instance 606f1624-8c53-409e-b06b-ace080f7fc44. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:11:38.953347 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-df4917ff-9446-41fa-bb2a-c0025bcb5ab9 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] 10.222.0.61 "POST /compute/v2.1/servers/606f1624-8c53-409e-b06b-ace080f7fc44/action" status: 409 len: 146 microversion: 2.1 time: 1.025859 Aug 31 16:11:38.954820 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1733/3477] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:11:37 2022] POST /compute/v2.1/servers/606f1624-8c53-409e-b06b-ace080f7fc44/action => generated 146 bytes in 1028 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 31 16:11:38.960858 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6545c7db-426b-441a-beeb-cc56034e1b52 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:38.962316 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6545c7db-426b-441a-beeb-cc56034e1b52 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] [instance: 0ac914d2-e9f7-4f2f-a01d-49674180d8db] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:38.970586 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6545c7db-426b-441a-beeb-cc56034e1b52 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:38.972003 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6545c7db-426b-441a-beeb-cc56034e1b52 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:38.972865 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6545c7db-426b-441a-beeb-cc56034e1b52 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:38.975186 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6545c7db-426b-441a-beeb-cc56034e1b52 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:38.976272 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6545c7db-426b-441a-beeb-cc56034e1b52 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:38.977019 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6545c7db-426b-441a-beeb-cc56034e1b52 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:38.995014 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-6545c7db-426b-441a-beeb-cc56034e1b52 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] HTTP exception thrown: Instance 0ac914d2-e9f7-4f2f-a01d-49674180d8db could not be found. Aug 31 16:11:38.997570 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6545c7db-426b-441a-beeb-cc56034e1b52 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Request method failure captured: Aug 31 16:11:38.997570 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/0ac914d2-e9f7-4f2f-a01d-49674180d8db HTTP/1.1 Aug 31 16:11:38.997570 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:11:38.997570 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:11:38.997570 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:11:38.997570 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:11:38.997570 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:11:38.997570 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:11:38.997570 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:11:38.997570 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:11:38.997570 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4eEYc3it8wIpsEOxUvtxalR4jBPv8U8tXiCkiR9lvmu1ANMxEGbsepfX-uS7UBYaY7Y3yJGuN0gFfr6tP1-uCeFDUHPFcp-cKkfsO1L_H39uh23ynebOHylxbkMiqJBA3kWkQ2FJqFXXbVZRiSrlYKl0YnvUDH40GgOjxR_0rAmSbc Aug 31 16:11:38.997570 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:11:38.997570 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:11:38.997570 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:11:38.997570 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:11:38.997570 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:11:38.997570 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:11:38.997570 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 55320a9c8f714bc0911ded3ab88ddf31 Aug 31 16:11:38.997570 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ServersTestBootFromVolume-385757091 Aug 31 16:11:38.997570 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:11:38.997570 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:11:38.997570 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/55320a9c8f714bc0911ded3ab88ddf31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/55320a9c8f714bc0911ded3ab88ddf31"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_55320a9c8f714bc0911ded3ab88ddf31", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/55320a9c8f714bc0911ded3ab88ddf31"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:11:38.997570 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ServersTestBootFromVolume-385757091 Aug 31 16:11:38.997570 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 55320a9c8f714bc0911ded3ab88ddf31 Aug 31 16:11:38.997570 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ServersTestBootFromVolume-385757091 Aug 31 16:11:38.997570 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ServersTestBootFromVolume-385757091-project Aug 31 16:11:38.997570 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:11:38.997570 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:11:38.997570 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: c65ee5ffa9d74bfdacbea45f1564d19a Aug 31 16:11:38.997570 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ServersTestBootFromVolume-385757091-project Aug 31 16:11:38.997570 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:11:38.997570 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance 0ac914d2-e9f7-4f2f-a01d-49674180d8db could not be found. Aug 31 16:11:38.997570 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '0ac914d2-e9f7-4f2f-a01d-49674180d8db'} Aug 31 16:11:38.997570 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:11:38.997570 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:11:38.997570 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:11:38.997570 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:11:38.997570 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:11:38.997570 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:11:38.997570 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:11:38.997570 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:11:38.997570 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:11:38.997570 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:11:38.997570 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ac914d2-e9f7-4f2f-a01d-49674180d8db could not be found. Aug 31 16:11:38.997570 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:11:38.997570 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:11:38.997570 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:11:38.997570 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:11:38.997570 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:11:38.997570 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:11:38.997570 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:11:38.997570 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:11:38.997570 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:11:38.997570 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:11:38.997570 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:11:38.997570 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:11:38.997570 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:11:38.997570 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:11:38.997570 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:11:38.997570 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:11:38.997570 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ac914d2-e9f7-4f2f-a01d-49674180d8db could not be found. Aug 31 16:11:38.997570 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:11:38.997570 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:11:38.997570 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:11:39.001558 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:11:39.001558 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:11:39.001558 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:11:39.001558 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:11:39.001558 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:11:39.001558 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ac914d2-e9f7-4f2f-a01d-49674180d8db could not be found. Aug 31 16:11:39.001558 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:11:39.006196 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6545c7db-426b-441a-beeb-cc56034e1b52 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Returning 404 to user: Instance 0ac914d2-e9f7-4f2f-a01d-49674180d8db could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:11:39.007727 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6545c7db-426b-441a-beeb-cc56034e1b52 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] 10.222.0.61 "GET /compute/v2.1/servers/0ac914d2-e9f7-4f2f-a01d-49674180d8db" status: 404 len: 111 microversion: 2.1 time: 0.051437 Aug 31 16:11:39.009023 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1734/3478] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:38 2022] GET /compute/v2.1/servers/0ac914d2-e9f7-4f2f-a01d-49674180d8db => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:11:39.014162 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ad42cf73-e9c9-4de3-8a56-a169c4e35c30 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:39.022998 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ad42cf73-e9c9-4de3-8a56-a169c4e35c30 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] [instance: fa0932e8-1aa4-4d1a-b653-14be35568f3d] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:39.032350 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ad42cf73-e9c9-4de3-8a56-a169c4e35c30 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:39.033127 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ad42cf73-e9c9-4de3-8a56-a169c4e35c30 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:39.033813 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ad42cf73-e9c9-4de3-8a56-a169c4e35c30 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:39.037369 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ad42cf73-e9c9-4de3-8a56-a169c4e35c30 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:39.038265 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ad42cf73-e9c9-4de3-8a56-a169c4e35c30 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:39.038959 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ad42cf73-e9c9-4de3-8a56-a169c4e35c30 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:39.328147 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-120d93f9-e1df-4615-879f-22b1517891b9 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:39.344701 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-120d93f9-e1df-4615-879f-22b1517891b9 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/519c7ca0-6d6b-4250-9b7b-8d5b6ef3b6b4" status: 200 len: 1320 microversion: 2.1 time: 0.766663 Aug 31 16:11:39.345887 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1745/3479] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:38 2022] GET /compute/v2.1/servers/519c7ca0-6d6b-4250-9b7b-8d5b6ef3b6b4 => generated 1320 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:11:39.365842 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-224b550f-4326-4f3e-9971-63b34ce27688 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.6.121"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:11:39.542176 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ad42cf73-e9c9-4de3-8a56-a169c4e35c30 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:39.564259 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-224b550f-4326-4f3e-9971-63b34ce27688 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] [instance: c7ae279f-9e24-4755-a912-6bec59837e6c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:39.564541 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ad42cf73-e9c9-4de3-8a56-a169c4e35c30 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:39.566137 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ad42cf73-e9c9-4de3-8a56-a169c4e35c30 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:39.567386 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ad42cf73-e9c9-4de3-8a56-a169c4e35c30 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] 10.222.0.61 "GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d" status: 200 len: 1879 microversion: 2.32 time: 0.557068 Aug 31 16:11:39.579527 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1735/3480] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:11:39 2022] GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d => generated 1879 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:11:39.579527 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-079cf541-9a69-4d3a-adf2-a7650d402404 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] Calling method '.version_select at 0x7f5ae9367790>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:39.589381 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-224b550f-4326-4f3e-9971-63b34ce27688 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:39.590748 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-224b550f-4326-4f3e-9971-63b34ce27688 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:39.591428 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-224b550f-4326-4f3e-9971-63b34ce27688 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:39.592440 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-224b550f-4326-4f3e-9971-63b34ce27688 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:39.593565 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-224b550f-4326-4f3e-9971-63b34ce27688 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:39.594225 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-224b550f-4326-4f3e-9971-63b34ce27688 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:39.622486 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-079cf541-9a69-4d3a-adf2-a7650d402404 tempest-ServersTestBootFromVolume-385757091 tempest-ServersTestBootFromVolume-385757091-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1779875600" status: 202 len: 0 microversion: 2.1 time: 0.051808 Aug 31 16:11:39.623223 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1736/3481] 10.222.0.61 () {58 vars in 1221 bytes} [Wed Aug 31 16:11:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1779875600 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:11:39.642155 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d95f65df-fd00-4482-be7c-5094a8e0bea0 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:39.642790 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d95f65df-fd00-4482-be7c-5094a8e0bea0 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] [instance: 596c5ff8-2dc8-4248-be52-eab6df1793e0] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:39.656916 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d95f65df-fd00-4482-be7c-5094a8e0bea0 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:39.657687 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d95f65df-fd00-4482-be7c-5094a8e0bea0 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:39.658298 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d95f65df-fd00-4482-be7c-5094a8e0bea0 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:39.662792 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d95f65df-fd00-4482-be7c-5094a8e0bea0 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:39.667043 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d95f65df-fd00-4482-be7c-5094a8e0bea0 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:39.667888 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d95f65df-fd00-4482-be7c-5094a8e0bea0 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:40.061773 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d95f65df-fd00-4482-be7c-5094a8e0bea0 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1444fdefda4eaeac9b11577ad7248b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859e7bbce8ed4dea985c73abe3ec8cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:40.078505 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d95f65df-fd00-4482-be7c-5094a8e0bea0 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] 10.222.0.61 "GET /compute/v2.1/servers/596c5ff8-2dc8-4248-be52-eab6df1793e0" status: 200 len: 1271 microversion: 2.1 time: 0.454029 Aug 31 16:11:40.081847 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1737/3482] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:39 2022] GET /compute/v2.1/servers/596c5ff8-2dc8-4248-be52-eab6df1793e0 => generated 1271 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:40.102443 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6c832d07-8733-450d-8cbb-4601c52d5792 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:40.105408 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6c832d07-8733-450d-8cbb-4601c52d5792 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] [instance: 685d47e4-721e-4eae-b5f8-78fdb68454ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:40.124702 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6c832d07-8733-450d-8cbb-4601c52d5792 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:40.126186 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6c832d07-8733-450d-8cbb-4601c52d5792 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:40.127665 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6c832d07-8733-450d-8cbb-4601c52d5792 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:40.129701 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6c832d07-8733-450d-8cbb-4601c52d5792 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:40.132348 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6c832d07-8733-450d-8cbb-4601c52d5792 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:40.133123 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6c832d07-8733-450d-8cbb-4601c52d5792 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:40.903635 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-6c832d07-8733-450d-8cbb-4601c52d5792 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:40.917438 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-6c832d07-8733-450d-8cbb-4601c52d5792 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:40.921196 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-6c832d07-8733-450d-8cbb-4601c52d5792 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:40.932312 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6c832d07-8733-450d-8cbb-4601c52d5792 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] 10.222.0.61 "GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae" status: 200 len: 2375 microversion: 2.42 time: 0.847357 Aug 31 16:11:40.932943 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1738/3483] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:11:40 2022] GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae => generated 2375 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:11:40.937845 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-cf5b585d-36dc-4d2b-9e64-f98c2e0e8868 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:40.938500 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-cf5b585d-36dc-4d2b-9e64-f98c2e0e8868 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] [instance: e8cfd63c-6e99-429f-93f2-ea40c02d7657] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:40.955272 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cf5b585d-36dc-4d2b-9e64-f98c2e0e8868 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:40.956071 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cf5b585d-36dc-4d2b-9e64-f98c2e0e8868 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:40.956685 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cf5b585d-36dc-4d2b-9e64-f98c2e0e8868 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:40.960862 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cf5b585d-36dc-4d2b-9e64-f98c2e0e8868 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:40.961111 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cf5b585d-36dc-4d2b-9e64-f98c2e0e8868 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:40.961567 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cf5b585d-36dc-4d2b-9e64-f98c2e0e8868 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:41.092458 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-cf5b585d-36dc-4d2b-9e64-f98c2e0e8868 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c32defec8443468861dbc8d33e3b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780f91ca8c6f461ba347cd2510dceeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:41.120432 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-cf5b585d-36dc-4d2b-9e64-f98c2e0e8868 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c32defec8443468861dbc8d33e3b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780f91ca8c6f461ba347cd2510dceeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:41.124780 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-cf5b585d-36dc-4d2b-9e64-f98c2e0e8868 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c32defec8443468861dbc8d33e3b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780f91ca8c6f461ba347cd2510dceeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:41.132277 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-cf5b585d-36dc-4d2b-9e64-f98c2e0e8868 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] 10.222.0.61 "GET /compute/v2.1/servers/e8cfd63c-6e99-429f-93f2-ea40c02d7657" status: 200 len: 1366 microversion: 2.47 time: 0.198120 Aug 31 16:11:41.137196 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1739/3484] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:11:40 2022] GET /compute/v2.1/servers/e8cfd63c-6e99-429f-93f2-ea40c02d7657 => generated 1366 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:11:41.148168 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-bd5b9db6-251a-4041-b2b9-cda1dd4a70ff tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:41.151329 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-bd5b9db6-251a-4041-b2b9-cda1dd4a70ff tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 519c7ca0-6d6b-4250-9b7b-8d5b6ef3b6b4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:41.158379 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bd5b9db6-251a-4041-b2b9-cda1dd4a70ff tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:41.158879 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bd5b9db6-251a-4041-b2b9-cda1dd4a70ff tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:41.159322 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bd5b9db6-251a-4041-b2b9-cda1dd4a70ff tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:41.160138 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bd5b9db6-251a-4041-b2b9-cda1dd4a70ff tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:41.160617 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bd5b9db6-251a-4041-b2b9-cda1dd4a70ff tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:41.161056 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bd5b9db6-251a-4041-b2b9-cda1dd4a70ff tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:41.306850 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-224b550f-4326-4f3e-9971-63b34ce27688 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquiring lock "refresh_cache-c7ae279f-9e24-4755-a912-6bec59837e6c" {{(pid=122257) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 31 16:11:41.307631 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-224b550f-4326-4f3e-9971-63b34ce27688 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquired lock "refresh_cache-c7ae279f-9e24-4755-a912-6bec59837e6c" {{(pid=122257) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 31 16:11:41.797548 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-bd5b9db6-251a-4041-b2b9-cda1dd4a70ff tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:41.818365 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-bd5b9db6-251a-4041-b2b9-cda1dd4a70ff tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/519c7ca0-6d6b-4250-9b7b-8d5b6ef3b6b4" status: 200 len: 1320 microversion: 2.1 time: 0.679680 Aug 31 16:11:41.820151 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1740/3485] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:41 2022] GET /compute/v2.1/servers/519c7ca0-6d6b-4250-9b7b-8d5b6ef3b6b4 => generated 1320 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:41.827466 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-84c2d980-0afe-41a3-9aa8-ae07317dbf8e tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:41.828969 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-84c2d980-0afe-41a3-9aa8-ae07317dbf8e tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] [instance: fa0932e8-1aa4-4d1a-b653-14be35568f3d] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:41.842572 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-84c2d980-0afe-41a3-9aa8-ae07317dbf8e tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:41.856512 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-84c2d980-0afe-41a3-9aa8-ae07317dbf8e tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:41.857202 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-84c2d980-0afe-41a3-9aa8-ae07317dbf8e tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:41.858752 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-84c2d980-0afe-41a3-9aa8-ae07317dbf8e tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:41.872348 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-84c2d980-0afe-41a3-9aa8-ae07317dbf8e tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:41.873084 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-84c2d980-0afe-41a3-9aa8-ae07317dbf8e tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:42.458413 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-84c2d980-0afe-41a3-9aa8-ae07317dbf8e tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:42.478348 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-84c2d980-0afe-41a3-9aa8-ae07317dbf8e tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:42.479930 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-84c2d980-0afe-41a3-9aa8-ae07317dbf8e tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:42.481172 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-84c2d980-0afe-41a3-9aa8-ae07317dbf8e tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] 10.222.0.61 "GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d" status: 200 len: 1879 microversion: 2.32 time: 0.659706 Aug 31 16:11:42.481745 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1741/3486] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:11:41 2022] GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d => generated 1879 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:11:42.487478 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2d7673d6-9379-4b7e-bbad-7572007df98a tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:42.488009 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2d7673d6-9379-4b7e-bbad-7572007df98a tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] [instance: 596c5ff8-2dc8-4248-be52-eab6df1793e0] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:42.510432 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2d7673d6-9379-4b7e-bbad-7572007df98a tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:42.510976 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2d7673d6-9379-4b7e-bbad-7572007df98a tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:42.511427 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2d7673d6-9379-4b7e-bbad-7572007df98a tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:42.512215 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2d7673d6-9379-4b7e-bbad-7572007df98a tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:42.512691 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2d7673d6-9379-4b7e-bbad-7572007df98a tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:42.513129 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2d7673d6-9379-4b7e-bbad-7572007df98a tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:42.674311 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-2d7673d6-9379-4b7e-bbad-7572007df98a tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1444fdefda4eaeac9b11577ad7248b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859e7bbce8ed4dea985c73abe3ec8cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:42.678409 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=91,nova_cell1:SAVEPOINT=3,nova_cell1:UPDATE=3,nova_cell1:RELEASE=3 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:11:42.687272 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2d7673d6-9379-4b7e-bbad-7572007df98a tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] 10.222.0.61 "GET /compute/v2.1/servers/596c5ff8-2dc8-4248-be52-eab6df1793e0" status: 200 len: 1271 microversion: 2.1 time: 0.204331 Aug 31 16:11:42.704049 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1742/3487] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:42 2022] GET /compute/v2.1/servers/596c5ff8-2dc8-4248-be52-eab6df1793e0 => generated 1271 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:42.710270 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3a1f0f57-6b94-43ea-94ba-ad29b567f6cf tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "16a789f7-a487-425e-848e-4ae174bafb12"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:11:42.713741 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3a1f0f57-6b94-43ea-94ba-ad29b567f6cf tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] [instance: eed024b5-986b-40fa-a686-ceab563a6131] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:42.734882 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3a1f0f57-6b94-43ea-94ba-ad29b567f6cf tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:42.735703 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3a1f0f57-6b94-43ea-94ba-ad29b567f6cf tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:42.736351 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3a1f0f57-6b94-43ea-94ba-ad29b567f6cf tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:42.737289 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3a1f0f57-6b94-43ea-94ba-ad29b567f6cf tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:42.738042 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3a1f0f57-6b94-43ea-94ba-ad29b567f6cf tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:42.738939 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3a1f0f57-6b94-43ea-94ba-ad29b567f6cf tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:43.498472 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3a1f0f57-6b94-43ea-94ba-ad29b567f6cf tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] 10.222.0.61 "POST /compute/v2.1/servers/eed024b5-986b-40fa-a686-ceab563a6131/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.792072 Aug 31 16:11:43.500925 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1743/3488] 10.222.0.61 () {60 vars in 1323 bytes} [Wed Aug 31 16:11:42 2022] POST /compute/v2.1/servers/eed024b5-986b-40fa-a686-ceab563a6131/os-volume_attachments => generated 194 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:11:43.522896 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-63099066-2b8a-41cc-9eb1-5b5f80ef5ad3 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:43.523828 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-63099066-2b8a-41cc-9eb1-5b5f80ef5ad3 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] [instance: 685d47e4-721e-4eae-b5f8-78fdb68454ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:43.535169 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-63099066-2b8a-41cc-9eb1-5b5f80ef5ad3 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:43.536000 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-63099066-2b8a-41cc-9eb1-5b5f80ef5ad3 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:43.536680 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-63099066-2b8a-41cc-9eb1-5b5f80ef5ad3 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:43.538268 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-63099066-2b8a-41cc-9eb1-5b5f80ef5ad3 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:43.538925 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-63099066-2b8a-41cc-9eb1-5b5f80ef5ad3 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:43.539598 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-63099066-2b8a-41cc-9eb1-5b5f80ef5ad3 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:43.542009 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-224b550f-4326-4f3e-9971-63b34ce27688 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] [instance: c7ae279f-9e24-4755-a912-6bec59837e6c] Building network info cache for instance {{(pid=122257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 31 16:11:43.723660 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-63099066-2b8a-41cc-9eb1-5b5f80ef5ad3 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:43.734314 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-63099066-2b8a-41cc-9eb1-5b5f80ef5ad3 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:43.736006 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-63099066-2b8a-41cc-9eb1-5b5f80ef5ad3 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:43.737216 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-63099066-2b8a-41cc-9eb1-5b5f80ef5ad3 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] 10.222.0.61 "GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae" status: 200 len: 2375 microversion: 2.42 time: 0.222314 Aug 31 16:11:43.737807 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1744/3489] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:11:43 2022] GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae => generated 2375 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:11:44.048266 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-de447190-7ef0-446f-9a3d-f68814d16ee0 req-91353010-d728-49fe-af93-782ab4c6cb49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "519c7ca0-6d6b-4250-9b7b-8d5b6ef3b6b4", "name": "network-vif-plugged", "status": "completed", "tag": "1a1343db-340f-4783-a294-d85170dd8622"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:11:44.066279 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-de447190-7ef0-446f-9a3d-f68814d16ee0 req-91353010-d728-49fe-af93-782ab4c6cb49 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:44.072273 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-de447190-7ef0-446f-9a3d-f68814d16ee0 req-91353010-d728-49fe-af93-782ab4c6cb49 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:44.072735 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-de447190-7ef0-446f-9a3d-f68814d16ee0 req-91353010-d728-49fe-af93-782ab4c6cb49 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:44.098313 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-de447190-7ef0-446f-9a3d-f68814d16ee0 req-91353010-d728-49fe-af93-782ab4c6cb49 service nova] Creating event network-vif-plugged:1a1343db-340f-4783-a294-d85170dd8622 for instance 519c7ca0-6d6b-4250-9b7b-8d5b6ef3b6b4 on n-h2-850499-9 Aug 31 16:11:44.112915 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-de447190-7ef0-446f-9a3d-f68814d16ee0 req-91353010-d728-49fe-af93-782ab4c6cb49 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.373546 Aug 31 16:11:44.113837 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1745/3490] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:11:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:11:44.132104 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a5da862a-65ba-4a4f-aefa-06d811a7991f tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:44.133693 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a5da862a-65ba-4a4f-aefa-06d811a7991f tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] [instance: e8cfd63c-6e99-429f-93f2-ea40c02d7657] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:44.152271 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a5da862a-65ba-4a4f-aefa-06d811a7991f tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:44.153527 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a5da862a-65ba-4a4f-aefa-06d811a7991f tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:44.161674 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a5da862a-65ba-4a4f-aefa-06d811a7991f tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:44.164833 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a5da862a-65ba-4a4f-aefa-06d811a7991f tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:44.165943 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a5da862a-65ba-4a4f-aefa-06d811a7991f tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:44.166966 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a5da862a-65ba-4a4f-aefa-06d811a7991f tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:44.444931 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a5da862a-65ba-4a4f-aefa-06d811a7991f tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c32defec8443468861dbc8d33e3b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780f91ca8c6f461ba347cd2510dceeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:44.461674 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a5da862a-65ba-4a4f-aefa-06d811a7991f tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c32defec8443468861dbc8d33e3b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780f91ca8c6f461ba347cd2510dceeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:44.463472 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a5da862a-65ba-4a4f-aefa-06d811a7991f tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c32defec8443468861dbc8d33e3b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780f91ca8c6f461ba347cd2510dceeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:44.466797 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a5da862a-65ba-4a4f-aefa-06d811a7991f tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] 10.222.0.61 "GET /compute/v2.1/servers/e8cfd63c-6e99-429f-93f2-ea40c02d7657" status: 200 len: 1366 microversion: 2.47 time: 0.348116 Aug 31 16:11:44.471950 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1746/3491] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:11:44 2022] GET /compute/v2.1/servers/e8cfd63c-6e99-429f-93f2-ea40c02d7657 => generated 1366 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:11:44.485460 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a574baad-6675-4f66-bf7a-5df4ea8b8675 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:44.486677 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a574baad-6675-4f66-bf7a-5df4ea8b8675 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 519c7ca0-6d6b-4250-9b7b-8d5b6ef3b6b4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:44.500651 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a574baad-6675-4f66-bf7a-5df4ea8b8675 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:44.502727 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a574baad-6675-4f66-bf7a-5df4ea8b8675 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:44.506715 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a574baad-6675-4f66-bf7a-5df4ea8b8675 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:44.507792 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a574baad-6675-4f66-bf7a-5df4ea8b8675 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:44.508433 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a574baad-6675-4f66-bf7a-5df4ea8b8675 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:44.509027 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a574baad-6675-4f66-bf7a-5df4ea8b8675 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:45.068671 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a574baad-6675-4f66-bf7a-5df4ea8b8675 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:45.080776 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a574baad-6675-4f66-bf7a-5df4ea8b8675 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/519c7ca0-6d6b-4250-9b7b-8d5b6ef3b6b4" status: 200 len: 1320 microversion: 2.1 time: 0.607359 Aug 31 16:11:45.094236 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1747/3492] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:44 2022] GET /compute/v2.1/servers/519c7ca0-6d6b-4250-9b7b-8d5b6ef3b6b4 => generated 1320 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:45.107964 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-bc03ec31-594c-4aec-8aa7-d871956a6491 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:45.108507 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-bc03ec31-594c-4aec-8aa7-d871956a6491 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] [instance: fa0932e8-1aa4-4d1a-b653-14be35568f3d] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:45.124423 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bc03ec31-594c-4aec-8aa7-d871956a6491 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:45.124926 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bc03ec31-594c-4aec-8aa7-d871956a6491 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:45.128225 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bc03ec31-594c-4aec-8aa7-d871956a6491 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:45.129183 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bc03ec31-594c-4aec-8aa7-d871956a6491 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:45.130172 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bc03ec31-594c-4aec-8aa7-d871956a6491 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:45.132926 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bc03ec31-594c-4aec-8aa7-d871956a6491 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:45.225612 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-224b550f-4326-4f3e-9971-63b34ce27688 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] [instance: c7ae279f-9e24-4755-a912-6bec59837e6c] Updating instance_info_cache with network_info: [{"id": "8b930bc1-225f-4f61-b131-4d4ae19c2ba2", "address": "fa:16:3e:35:f5:da", "network": {"id": "567c9ba1-6364-4d01-9016-4aec92f3efc9", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1516295813-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "eab7f0d889224cefbca55343f3208a86", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap8b930bc1-22", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 31 16:11:45.254917 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-224b550f-4326-4f3e-9971-63b34ce27688 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Releasing lock "refresh_cache-c7ae279f-9e24-4755-a912-6bec59837e6c" {{(pid=122257) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 31 16:11:45.256809 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-224b550f-4326-4f3e-9971-63b34ce27688 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] 10.222.0.61 "POST /compute/v2.1/servers/c7ae279f-9e24-4755-a912-6bec59837e6c/action" status: 202 len: 0 microversion: 2.1 time: 5.895188 Aug 31 16:11:45.261883 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1746/3493] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:11:39 2022] POST /compute/v2.1/servers/c7ae279f-9e24-4755-a912-6bec59837e6c/action => generated 0 bytes in 5901 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 31 16:11:45.284875 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-6173449a-d67f-4dee-bf8b-aac915c4613d req-c12aa577-0a30-4a2e-9df4-aaec8c9d4a24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7ae279f-9e24-4755-a912-6bec59837e6c", "tag": "8b930bc1-225f-4f61-b131-4d4ae19c2ba2"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:11:45.297212 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-6173449a-d67f-4dee-bf8b-aac915c4613d req-c12aa577-0a30-4a2e-9df4-aaec8c9d4a24 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:45.298062 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-6173449a-d67f-4dee-bf8b-aac915c4613d req-c12aa577-0a30-4a2e-9df4-aaec8c9d4a24 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:45.298718 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-6173449a-d67f-4dee-bf8b-aac915c4613d req-c12aa577-0a30-4a2e-9df4-aaec8c9d4a24 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:45.315403 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-6173449a-d67f-4dee-bf8b-aac915c4613d req-c12aa577-0a30-4a2e-9df4-aaec8c9d4a24 service nova] Creating event network-changed:8b930bc1-225f-4f61-b131-4d4ae19c2ba2 for instance c7ae279f-9e24-4755-a912-6bec59837e6c on n-h2-850499-9 Aug 31 16:11:45.329310 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-6173449a-d67f-4dee-bf8b-aac915c4613d req-c12aa577-0a30-4a2e-9df4-aaec8c9d4a24 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065077 Aug 31 16:11:45.330103 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1747/3494] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:11:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:11:45.338709 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5b5273a3-6bf3-41f4-8a17-5eb8540b45e1 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:45.339745 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5b5273a3-6bf3-41f4-8a17-5eb8540b45e1 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] [instance: 596c5ff8-2dc8-4248-be52-eab6df1793e0] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:45.346741 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b5273a3-6bf3-41f4-8a17-5eb8540b45e1 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:45.347226 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b5273a3-6bf3-41f4-8a17-5eb8540b45e1 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:45.347810 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b5273a3-6bf3-41f4-8a17-5eb8540b45e1 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:45.348535 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b5273a3-6bf3-41f4-8a17-5eb8540b45e1 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:45.349188 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b5273a3-6bf3-41f4-8a17-5eb8540b45e1 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:45.350363 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b5273a3-6bf3-41f4-8a17-5eb8540b45e1 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:46.116744 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-bc03ec31-594c-4aec-8aa7-d871956a6491 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:46.133118 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-bc03ec31-594c-4aec-8aa7-d871956a6491 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:46.143185 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-bc03ec31-594c-4aec-8aa7-d871956a6491 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:46.145855 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-bc03ec31-594c-4aec-8aa7-d871956a6491 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] 10.222.0.61 "GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d" status: 200 len: 1879 microversion: 2.32 time: 1.049166 Aug 31 16:11:46.164052 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1748/3495] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:11:45 2022] GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d => generated 1879 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:11:46.172304 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f889c0a6-a942-4501-84d3-35eaefd9bf39 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:46.173567 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f889c0a6-a942-4501-84d3-35eaefd9bf39 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] [instance: 685d47e4-721e-4eae-b5f8-78fdb68454ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:46.182533 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f889c0a6-a942-4501-84d3-35eaefd9bf39 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:46.183420 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f889c0a6-a942-4501-84d3-35eaefd9bf39 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:46.184428 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f889c0a6-a942-4501-84d3-35eaefd9bf39 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:46.185419 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f889c0a6-a942-4501-84d3-35eaefd9bf39 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:46.186130 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f889c0a6-a942-4501-84d3-35eaefd9bf39 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:46.186808 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f889c0a6-a942-4501-84d3-35eaefd9bf39 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:46.199129 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5b5273a3-6bf3-41f4-8a17-5eb8540b45e1 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1444fdefda4eaeac9b11577ad7248b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859e7bbce8ed4dea985c73abe3ec8cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:46.208110 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5b5273a3-6bf3-41f4-8a17-5eb8540b45e1 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] 10.222.0.61 "GET /compute/v2.1/servers/596c5ff8-2dc8-4248-be52-eab6df1793e0" status: 200 len: 1313 microversion: 2.1 time: 0.876135 Aug 31 16:11:46.218192 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1748/3496] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:45 2022] GET /compute/v2.1/servers/596c5ff8-2dc8-4248-be52-eab6df1793e0 => generated 1313 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:46.223306 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4ceb6830-487a-495a-9ab0-2a1af8d46831 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:46.224078 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4ceb6830-487a-495a-9ab0-2a1af8d46831 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] [instance: c7ae279f-9e24-4755-a912-6bec59837e6c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:46.238144 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4ceb6830-487a-495a-9ab0-2a1af8d46831 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:46.239477 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4ceb6830-487a-495a-9ab0-2a1af8d46831 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:46.240341 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4ceb6830-487a-495a-9ab0-2a1af8d46831 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:46.241351 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4ceb6830-487a-495a-9ab0-2a1af8d46831 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:46.242032 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4ceb6830-487a-495a-9ab0-2a1af8d46831 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:46.242674 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4ceb6830-487a-495a-9ab0-2a1af8d46831 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:46.283868 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4ceb6830-487a-495a-9ab0-2a1af8d46831 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] [instance: c7ae279f-9e24-4755-a912-6bec59837e6c] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:11:46.306349 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:11:46.333391 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:11:46.368429 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f889c0a6-a942-4501-84d3-35eaefd9bf39 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:46.399384 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f889c0a6-a942-4501-84d3-35eaefd9bf39 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:46.401613 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f889c0a6-a942-4501-84d3-35eaefd9bf39 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:46.403375 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f889c0a6-a942-4501-84d3-35eaefd9bf39 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] 10.222.0.61 "GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae" status: 200 len: 2375 microversion: 2.42 time: 0.237719 Aug 31 16:11:46.404701 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1749/3497] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:11:46 2022] GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae => generated 2375 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:11:46.410459 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d0c36a78-0cfc-444e-bef6-1d07cafe1ecc tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:46.411423 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d0c36a78-0cfc-444e-bef6-1d07cafe1ecc tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] [instance: e8cfd63c-6e99-429f-93f2-ea40c02d7657] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:46.423123 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d0c36a78-0cfc-444e-bef6-1d07cafe1ecc tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:46.430709 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d0c36a78-0cfc-444e-bef6-1d07cafe1ecc tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:46.431303 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d0c36a78-0cfc-444e-bef6-1d07cafe1ecc tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:46.432169 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d0c36a78-0cfc-444e-bef6-1d07cafe1ecc tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:46.432714 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d0c36a78-0cfc-444e-bef6-1d07cafe1ecc tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:46.433206 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d0c36a78-0cfc-444e-bef6-1d07cafe1ecc tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:46.466957 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4ceb6830-487a-495a-9ab0-2a1af8d46831 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] 10.222.0.61 "DELETE /compute/v2.1/servers/c7ae279f-9e24-4755-a912-6bec59837e6c" status: 204 len: 0 microversion: 2.1 time: 0.244503 Aug 31 16:11:46.469016 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1749/3498] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:11:46 2022] DELETE /compute/v2.1/servers/c7ae279f-9e24-4755-a912-6bec59837e6c => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:11:46.481598 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-668ea08b-402d-4c21-bf1a-67ee9dc6f0cc tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:46.482988 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-668ea08b-402d-4c21-bf1a-67ee9dc6f0cc tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 519c7ca0-6d6b-4250-9b7b-8d5b6ef3b6b4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:46.494453 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-668ea08b-402d-4c21-bf1a-67ee9dc6f0cc tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:46.495322 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-668ea08b-402d-4c21-bf1a-67ee9dc6f0cc tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:46.495808 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-668ea08b-402d-4c21-bf1a-67ee9dc6f0cc tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:46.496542 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-668ea08b-402d-4c21-bf1a-67ee9dc6f0cc tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:46.497169 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-668ea08b-402d-4c21-bf1a-67ee9dc6f0cc tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:46.497889 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-668ea08b-402d-4c21-bf1a-67ee9dc6f0cc tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:46.524569 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=54 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:11:46.590352 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d0c36a78-0cfc-444e-bef6-1d07cafe1ecc tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c32defec8443468861dbc8d33e3b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780f91ca8c6f461ba347cd2510dceeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:46.614304 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d0c36a78-0cfc-444e-bef6-1d07cafe1ecc tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c32defec8443468861dbc8d33e3b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780f91ca8c6f461ba347cd2510dceeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:46.616876 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d0c36a78-0cfc-444e-bef6-1d07cafe1ecc tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c32defec8443468861dbc8d33e3b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780f91ca8c6f461ba347cd2510dceeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:46.618099 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d0c36a78-0cfc-444e-bef6-1d07cafe1ecc tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] 10.222.0.61 "GET /compute/v2.1/servers/e8cfd63c-6e99-429f-93f2-ea40c02d7657" status: 200 len: 1366 microversion: 2.47 time: 0.212011 Aug 31 16:11:46.618914 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1750/3499] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:11:46 2022] GET /compute/v2.1/servers/e8cfd63c-6e99-429f-93f2-ea40c02d7657 => generated 1366 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:11:46.638668 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-bf9f8d79-af68-4edf-891d-9ca4dbe0dab0 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.6.121"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:11:46.642438 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-bf9f8d79-af68-4edf-891d-9ca4dbe0dab0 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] [instance: 606f1624-8c53-409e-b06b-ace080f7fc44] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:46.652805 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bf9f8d79-af68-4edf-891d-9ca4dbe0dab0 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:46.653310 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bf9f8d79-af68-4edf-891d-9ca4dbe0dab0 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:46.653750 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bf9f8d79-af68-4edf-891d-9ca4dbe0dab0 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:46.657495 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bf9f8d79-af68-4edf-891d-9ca4dbe0dab0 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:46.658392 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bf9f8d79-af68-4edf-891d-9ca4dbe0dab0 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:46.658941 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bf9f8d79-af68-4edf-891d-9ca4dbe0dab0 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:46.690024 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bf9f8d79-af68-4edf-891d-9ca4dbe0dab0 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquiring lock "refresh_cache-606f1624-8c53-409e-b06b-ace080f7fc44" {{(pid=122256) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 31 16:11:46.690497 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bf9f8d79-af68-4edf-891d-9ca4dbe0dab0 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquired lock "refresh_cache-606f1624-8c53-409e-b06b-ace080f7fc44" {{(pid=122256) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 31 16:11:47.040483 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-668ea08b-402d-4c21-bf1a-67ee9dc6f0cc tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:47.060322 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-668ea08b-402d-4c21-bf1a-67ee9dc6f0cc tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/519c7ca0-6d6b-4250-9b7b-8d5b6ef3b6b4" status: 200 len: 1320 microversion: 2.1 time: 0.586853 Aug 31 16:11:47.061208 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1750/3500] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:46 2022] GET /compute/v2.1/servers/519c7ca0-6d6b-4250-9b7b-8d5b6ef3b6b4 => generated 1320 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:47.180619 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-638a4cf0-d990-4ce9-a93a-2bd1d9aa4262 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:47.181840 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-638a4cf0-d990-4ce9-a93a-2bd1d9aa4262 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] [instance: fa0932e8-1aa4-4d1a-b653-14be35568f3d] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:47.195402 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-638a4cf0-d990-4ce9-a93a-2bd1d9aa4262 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:47.196365 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-638a4cf0-d990-4ce9-a93a-2bd1d9aa4262 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:47.197093 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-638a4cf0-d990-4ce9-a93a-2bd1d9aa4262 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:47.206222 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-638a4cf0-d990-4ce9-a93a-2bd1d9aa4262 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:47.207022 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-638a4cf0-d990-4ce9-a93a-2bd1d9aa4262 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:47.207750 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-638a4cf0-d990-4ce9-a93a-2bd1d9aa4262 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:47.598489 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-638a4cf0-d990-4ce9-a93a-2bd1d9aa4262 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:47.613343 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-638a4cf0-d990-4ce9-a93a-2bd1d9aa4262 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:47.615717 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-638a4cf0-d990-4ce9-a93a-2bd1d9aa4262 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:47.621969 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-638a4cf0-d990-4ce9-a93a-2bd1d9aa4262 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] 10.222.0.61 "GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d" status: 200 len: 1879 microversion: 2.32 time: 0.448814 Aug 31 16:11:47.624231 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1751/3501] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:11:47 2022] GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d => generated 1879 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:11:47.640696 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-237a3e1d-60b2-4c88-aea2-2774ef402685 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:47.642951 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-237a3e1d-60b2-4c88-aea2-2774ef402685 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] [instance: 596c5ff8-2dc8-4248-be52-eab6df1793e0] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:47.653814 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-237a3e1d-60b2-4c88-aea2-2774ef402685 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:47.654323 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-237a3e1d-60b2-4c88-aea2-2774ef402685 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:47.654773 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-237a3e1d-60b2-4c88-aea2-2774ef402685 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:47.655559 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-237a3e1d-60b2-4c88-aea2-2774ef402685 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:47.655998 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-237a3e1d-60b2-4c88-aea2-2774ef402685 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:47.656433 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-237a3e1d-60b2-4c88-aea2-2774ef402685 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:47.935227 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-237a3e1d-60b2-4c88-aea2-2774ef402685 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1444fdefda4eaeac9b11577ad7248b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859e7bbce8ed4dea985c73abe3ec8cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:47.944513 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-237a3e1d-60b2-4c88-aea2-2774ef402685 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] 10.222.0.61 "GET /compute/v2.1/servers/596c5ff8-2dc8-4248-be52-eab6df1793e0" status: 200 len: 1313 microversion: 2.1 time: 0.317101 Aug 31 16:11:47.957995 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1752/3502] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:47 2022] GET /compute/v2.1/servers/596c5ff8-2dc8-4248-be52-eab6df1793e0 => generated 1313 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:47.964865 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-1805fb9a-764b-4bba-b7e6-df8fdacff317 req-5db437d0-e914-4657-8db3-b1feec4489e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "596c5ff8-2dc8-4248-be52-eab6df1793e0", "tag": "293f95ee-1eeb-4199-8e23-db11698e1449"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:11:47.983335 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-1805fb9a-764b-4bba-b7e6-df8fdacff317 req-5db437d0-e914-4657-8db3-b1feec4489e3 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:47.983858 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-1805fb9a-764b-4bba-b7e6-df8fdacff317 req-5db437d0-e914-4657-8db3-b1feec4489e3 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:47.984297 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-1805fb9a-764b-4bba-b7e6-df8fdacff317 req-5db437d0-e914-4657-8db3-b1feec4489e3 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:48.001907 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-1805fb9a-764b-4bba-b7e6-df8fdacff317 req-5db437d0-e914-4657-8db3-b1feec4489e3 service nova] Creating event network-changed:293f95ee-1eeb-4199-8e23-db11698e1449 for instance 596c5ff8-2dc8-4248-be52-eab6df1793e0 on n-h2-850499-9 Aug 31 16:11:48.009641 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-1805fb9a-764b-4bba-b7e6-df8fdacff317 req-5db437d0-e914-4657-8db3-b1feec4489e3 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049165 Aug 31 16:11:48.010577 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1753/3503] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:11:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:11:48.020442 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2f60eb2e-86bc-497c-8683-8187a39117a5 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:48.022096 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2f60eb2e-86bc-497c-8683-8187a39117a5 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] [instance: 685d47e4-721e-4eae-b5f8-78fdb68454ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:48.034222 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2f60eb2e-86bc-497c-8683-8187a39117a5 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:48.035394 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2f60eb2e-86bc-497c-8683-8187a39117a5 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:48.035887 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2f60eb2e-86bc-497c-8683-8187a39117a5 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:48.036702 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2f60eb2e-86bc-497c-8683-8187a39117a5 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:48.037125 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2f60eb2e-86bc-497c-8683-8187a39117a5 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:48.037554 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2f60eb2e-86bc-497c-8683-8187a39117a5 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:48.158726 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2f60eb2e-86bc-497c-8683-8187a39117a5 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:48.169637 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2f60eb2e-86bc-497c-8683-8187a39117a5 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:48.171847 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2f60eb2e-86bc-497c-8683-8187a39117a5 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:48.173434 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2f60eb2e-86bc-497c-8683-8187a39117a5 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] 10.222.0.61 "GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae" status: 200 len: 2375 microversion: 2.42 time: 0.157891 Aug 31 16:11:48.174460 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1754/3504] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:11:48 2022] GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae => generated 2375 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:11:48.180638 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a76a2b72-e2eb-4851-b72f-eec1e77a41d5 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:48.181587 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a76a2b72-e2eb-4851-b72f-eec1e77a41d5 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] [instance: e8cfd63c-6e99-429f-93f2-ea40c02d7657] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:48.184824 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=3,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:11:48.191008 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a76a2b72-e2eb-4851-b72f-eec1e77a41d5 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:48.191779 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a76a2b72-e2eb-4851-b72f-eec1e77a41d5 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:48.192381 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a76a2b72-e2eb-4851-b72f-eec1e77a41d5 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:48.193444 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a76a2b72-e2eb-4851-b72f-eec1e77a41d5 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:48.194144 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a76a2b72-e2eb-4851-b72f-eec1e77a41d5 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:48.194745 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a76a2b72-e2eb-4851-b72f-eec1e77a41d5 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:48.322996 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a76a2b72-e2eb-4851-b72f-eec1e77a41d5 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c32defec8443468861dbc8d33e3b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780f91ca8c6f461ba347cd2510dceeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:48.356066 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a76a2b72-e2eb-4851-b72f-eec1e77a41d5 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c32defec8443468861dbc8d33e3b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780f91ca8c6f461ba347cd2510dceeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:48.362229 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a76a2b72-e2eb-4851-b72f-eec1e77a41d5 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c32defec8443468861dbc8d33e3b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780f91ca8c6f461ba347cd2510dceeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:48.363771 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a76a2b72-e2eb-4851-b72f-eec1e77a41d5 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] 10.222.0.61 "GET /compute/v2.1/servers/e8cfd63c-6e99-429f-93f2-ea40c02d7657" status: 200 len: 1366 microversion: 2.47 time: 0.188241 Aug 31 16:11:48.366665 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1755/3505] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:11:48 2022] GET /compute/v2.1/servers/e8cfd63c-6e99-429f-93f2-ea40c02d7657 => generated 1366 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:11:48.373300 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b6760644-d830-40ba-91e2-92b4a97c5e37 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:48.374768 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b6760644-d830-40ba-91e2-92b4a97c5e37 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 519c7ca0-6d6b-4250-9b7b-8d5b6ef3b6b4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:48.382897 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b6760644-d830-40ba-91e2-92b4a97c5e37 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:48.383736 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b6760644-d830-40ba-91e2-92b4a97c5e37 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:48.384359 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b6760644-d830-40ba-91e2-92b4a97c5e37 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:48.385369 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b6760644-d830-40ba-91e2-92b4a97c5e37 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:48.385993 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b6760644-d830-40ba-91e2-92b4a97c5e37 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:48.386765 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b6760644-d830-40ba-91e2-92b4a97c5e37 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:48.824835 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b6760644-d830-40ba-91e2-92b4a97c5e37 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:48.844280 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b6760644-d830-40ba-91e2-92b4a97c5e37 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/519c7ca0-6d6b-4250-9b7b-8d5b6ef3b6b4" status: 200 len: 1502 microversion: 2.1 time: 0.473826 Aug 31 16:11:48.846352 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1756/3506] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:48 2022] GET /compute/v2.1/servers/519c7ca0-6d6b-4250-9b7b-8d5b6ef3b6b4 => generated 1502 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:48.852464 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f24bedbc-b819-4806-b0f2-a9c9814035e0 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:48.853497 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f24bedbc-b819-4806-b0f2-a9c9814035e0 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] [instance: fa0932e8-1aa4-4d1a-b653-14be35568f3d] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:48.868126 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f24bedbc-b819-4806-b0f2-a9c9814035e0 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:48.869626 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f24bedbc-b819-4806-b0f2-a9c9814035e0 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:48.871296 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f24bedbc-b819-4806-b0f2-a9c9814035e0 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:48.872331 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f24bedbc-b819-4806-b0f2-a9c9814035e0 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:48.873191 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f24bedbc-b819-4806-b0f2-a9c9814035e0 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:48.873886 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f24bedbc-b819-4806-b0f2-a9c9814035e0 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:49.271889 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f24bedbc-b819-4806-b0f2-a9c9814035e0 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:49.321119 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f24bedbc-b819-4806-b0f2-a9c9814035e0 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:49.326867 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-bf9f8d79-af68-4edf-891d-9ca4dbe0dab0 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] [instance: 606f1624-8c53-409e-b06b-ace080f7fc44] Building network info cache for instance {{(pid=122256) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 31 16:11:49.330599 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f24bedbc-b819-4806-b0f2-a9c9814035e0 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:49.332019 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f24bedbc-b819-4806-b0f2-a9c9814035e0 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] 10.222.0.61 "GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d" status: 200 len: 1879 microversion: 2.32 time: 0.484529 Aug 31 16:11:49.334708 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1757/3507] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:11:48 2022] GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d => generated 1879 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:11:49.346190 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-fef0c021-8f12-488c-8667-87b14077e896 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:49.350784 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-fef0c021-8f12-488c-8667-87b14077e896 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 519c7ca0-6d6b-4250-9b7b-8d5b6ef3b6b4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:49.365724 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fef0c021-8f12-488c-8667-87b14077e896 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:49.369409 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fef0c021-8f12-488c-8667-87b14077e896 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:49.370472 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fef0c021-8f12-488c-8667-87b14077e896 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:49.371539 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fef0c021-8f12-488c-8667-87b14077e896 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:49.374330 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fef0c021-8f12-488c-8667-87b14077e896 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:49.374814 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fef0c021-8f12-488c-8667-87b14077e896 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:49.640560 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-fef0c021-8f12-488c-8667-87b14077e896 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:49.651409 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-fef0c021-8f12-488c-8667-87b14077e896 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/519c7ca0-6d6b-4250-9b7b-8d5b6ef3b6b4" status: 200 len: 1502 microversion: 2.1 time: 0.315384 Aug 31 16:11:49.672585 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1758/3508] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:49 2022] GET /compute/v2.1/servers/519c7ca0-6d6b-4250-9b7b-8d5b6ef3b6b4 => generated 1502 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:49.672585 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-55298988-51b2-4c7b-9db8-65528d03722f tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:49.672585 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-55298988-51b2-4c7b-9db8-65528d03722f tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] [instance: 596c5ff8-2dc8-4248-be52-eab6df1793e0] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:49.690543 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-55298988-51b2-4c7b-9db8-65528d03722f tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:49.691064 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-55298988-51b2-4c7b-9db8-65528d03722f tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:49.691547 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-55298988-51b2-4c7b-9db8-65528d03722f tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:49.692287 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-55298988-51b2-4c7b-9db8-65528d03722f tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:49.692757 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-55298988-51b2-4c7b-9db8-65528d03722f tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:49.693237 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-55298988-51b2-4c7b-9db8-65528d03722f tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:50.350960 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-55298988-51b2-4c7b-9db8-65528d03722f tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1444fdefda4eaeac9b11577ad7248b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859e7bbce8ed4dea985c73abe3ec8cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:50.361234 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-55298988-51b2-4c7b-9db8-65528d03722f tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] 10.222.0.61 "GET /compute/v2.1/servers/596c5ff8-2dc8-4248-be52-eab6df1793e0" status: 200 len: 1313 microversion: 2.1 time: 0.701759 Aug 31 16:11:50.372334 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1759/3509] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:49 2022] GET /compute/v2.1/servers/596c5ff8-2dc8-4248-be52-eab6df1793e0 => generated 1313 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:50.377546 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-46025c2b-c208-4f76-9462-ca92308be403 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:50.378355 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-46025c2b-c208-4f76-9462-ca92308be403 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] [instance: 685d47e4-721e-4eae-b5f8-78fdb68454ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:50.388810 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-46025c2b-c208-4f76-9462-ca92308be403 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:50.389342 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-46025c2b-c208-4f76-9462-ca92308be403 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:50.389761 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-46025c2b-c208-4f76-9462-ca92308be403 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:50.390476 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-46025c2b-c208-4f76-9462-ca92308be403 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:50.390939 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-46025c2b-c208-4f76-9462-ca92308be403 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:50.391379 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-46025c2b-c208-4f76-9462-ca92308be403 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:50.574069 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-46025c2b-c208-4f76-9462-ca92308be403 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:50.608003 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-46025c2b-c208-4f76-9462-ca92308be403 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:50.615146 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-46025c2b-c208-4f76-9462-ca92308be403 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:50.617562 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-46025c2b-c208-4f76-9462-ca92308be403 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] 10.222.0.61 "GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae" status: 200 len: 2375 microversion: 2.42 time: 0.243877 Aug 31 16:11:50.620508 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1760/3510] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:11:50 2022] GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae => generated 2375 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:11:50.628478 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b24b6db3-a748-44fd-bcfb-5c1c142eb49c tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:50.637235 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b24b6db3-a748-44fd-bcfb-5c1c142eb49c tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] [instance: e8cfd63c-6e99-429f-93f2-ea40c02d7657] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:50.652496 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b24b6db3-a748-44fd-bcfb-5c1c142eb49c tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:50.652999 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b24b6db3-a748-44fd-bcfb-5c1c142eb49c tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:50.653441 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b24b6db3-a748-44fd-bcfb-5c1c142eb49c tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:50.654153 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b24b6db3-a748-44fd-bcfb-5c1c142eb49c tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:50.660962 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b24b6db3-a748-44fd-bcfb-5c1c142eb49c tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:50.661465 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b24b6db3-a748-44fd-bcfb-5c1c142eb49c tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:50.732205 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-bf9f8d79-af68-4edf-891d-9ca4dbe0dab0 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] [instance: 606f1624-8c53-409e-b06b-ace080f7fc44] Updating instance_info_cache with network_info: [{"id": "bd761e9e-656b-4464-b63f-bb9440ae7e14", "address": "fa:16:3e:01:26:ee", "network": {"id": "567c9ba1-6364-4d01-9016-4aec92f3efc9", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1516295813-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.6.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "eab7f0d889224cefbca55343f3208a86", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapbd761e9e-65", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122256) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 31 16:11:50.749569 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bf9f8d79-af68-4edf-891d-9ca4dbe0dab0 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Releasing lock "refresh_cache-606f1624-8c53-409e-b06b-ace080f7fc44" {{(pid=122256) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 31 16:11:50.750502 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-bf9f8d79-af68-4edf-891d-9ca4dbe0dab0 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] 10.222.0.61 "POST /compute/v2.1/servers/606f1624-8c53-409e-b06b-ace080f7fc44/action" status: 202 len: 0 microversion: 2.1 time: 4.130843 Aug 31 16:11:50.751225 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1751/3511] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:11:46 2022] POST /compute/v2.1/servers/606f1624-8c53-409e-b06b-ace080f7fc44/action => generated 0 bytes in 4132 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 31 16:11:50.762857 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6adeeb3b-e2e0-4a35-911d-a48eaeb83d9d tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:50.763386 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6adeeb3b-e2e0-4a35-911d-a48eaeb83d9d tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 519c7ca0-6d6b-4250-9b7b-8d5b6ef3b6b4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:50.778029 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6adeeb3b-e2e0-4a35-911d-a48eaeb83d9d tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:50.778544 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6adeeb3b-e2e0-4a35-911d-a48eaeb83d9d tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:50.778990 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6adeeb3b-e2e0-4a35-911d-a48eaeb83d9d tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:50.779731 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6adeeb3b-e2e0-4a35-911d-a48eaeb83d9d tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:50.788798 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6adeeb3b-e2e0-4a35-911d-a48eaeb83d9d tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:50.789538 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6adeeb3b-e2e0-4a35-911d-a48eaeb83d9d tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:50.806637 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b24b6db3-a748-44fd-bcfb-5c1c142eb49c tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c32defec8443468861dbc8d33e3b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780f91ca8c6f461ba347cd2510dceeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:50.821374 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b24b6db3-a748-44fd-bcfb-5c1c142eb49c tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c32defec8443468861dbc8d33e3b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780f91ca8c6f461ba347cd2510dceeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:50.824080 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b24b6db3-a748-44fd-bcfb-5c1c142eb49c tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c32defec8443468861dbc8d33e3b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780f91ca8c6f461ba347cd2510dceeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:50.827105 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b24b6db3-a748-44fd-bcfb-5c1c142eb49c tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] 10.222.0.61 "GET /compute/v2.1/servers/e8cfd63c-6e99-429f-93f2-ea40c02d7657" status: 200 len: 1366 microversion: 2.47 time: 0.203247 Aug 31 16:11:50.828335 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1761/3512] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:11:50 2022] GET /compute/v2.1/servers/e8cfd63c-6e99-429f-93f2-ea40c02d7657 => generated 1366 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:11:50.834418 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-18ffa8a7-2066-4fe1-b00b-354f1ee7a39e req-6586cce3-5888-4698-acdf-dbfad0013bb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "606f1624-8c53-409e-b06b-ace080f7fc44", "tag": "bd761e9e-656b-4464-b63f-bb9440ae7e14"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:11:50.848162 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-18ffa8a7-2066-4fe1-b00b-354f1ee7a39e req-6586cce3-5888-4698-acdf-dbfad0013bb5 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:50.849276 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-18ffa8a7-2066-4fe1-b00b-354f1ee7a39e req-6586cce3-5888-4698-acdf-dbfad0013bb5 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:50.850017 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-18ffa8a7-2066-4fe1-b00b-354f1ee7a39e req-6586cce3-5888-4698-acdf-dbfad0013bb5 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:50.860234 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6adeeb3b-e2e0-4a35-911d-a48eaeb83d9d tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 519c7ca0-6d6b-4250-9b7b-8d5b6ef3b6b4] Going to try to terminate instance {{(pid=122256) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:11:50.874323 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-18ffa8a7-2066-4fe1-b00b-354f1ee7a39e req-6586cce3-5888-4698-acdf-dbfad0013bb5 service nova] Creating event network-changed:bd761e9e-656b-4464-b63f-bb9440ae7e14 for instance 606f1624-8c53-409e-b06b-ace080f7fc44 on n-h1-850499-9 Aug 31 16:11:50.892035 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-18ffa8a7-2066-4fe1-b00b-354f1ee7a39e req-6586cce3-5888-4698-acdf-dbfad0013bb5 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059561 Aug 31 16:11:50.894441 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1762/3513] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:11:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:11:50.910469 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8514d9f6-3151-4b95-a8a8-ef50ccf1887f tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:50.917417 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8514d9f6-3151-4b95-a8a8-ef50ccf1887f tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] [instance: fa0932e8-1aa4-4d1a-b653-14be35568f3d] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:50.933146 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8514d9f6-3151-4b95-a8a8-ef50ccf1887f tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:50.934081 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8514d9f6-3151-4b95-a8a8-ef50ccf1887f tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:50.934990 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8514d9f6-3151-4b95-a8a8-ef50ccf1887f tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:50.935707 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8514d9f6-3151-4b95-a8a8-ef50ccf1887f tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:50.936316 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8514d9f6-3151-4b95-a8a8-ef50ccf1887f tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:50.936847 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8514d9f6-3151-4b95-a8a8-ef50ccf1887f tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:50.980375 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6adeeb3b-e2e0-4a35-911d-a48eaeb83d9d tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "DELETE /compute/v2.1/servers/519c7ca0-6d6b-4250-9b7b-8d5b6ef3b6b4" status: 204 len: 0 microversion: 2.1 time: 0.226013 Aug 31 16:11:50.983804 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1752/3514] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:11:50 2022] DELETE /compute/v2.1/servers/519c7ca0-6d6b-4250-9b7b-8d5b6ef3b6b4 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:11:51.007923 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-807817e7-3778-4f89-a220-a7b338df62ee tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Calling method '.version_select at 0x7f5ae93331f0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:51.517859 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8514d9f6-3151-4b95-a8a8-ef50ccf1887f tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:51.536027 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8514d9f6-3151-4b95-a8a8-ef50ccf1887f tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:51.538023 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8514d9f6-3151-4b95-a8a8-ef50ccf1887f tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:51.549806 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8514d9f6-3151-4b95-a8a8-ef50ccf1887f tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] 10.222.0.61 "GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d" status: 200 len: 1879 microversion: 2.32 time: 0.636454 Aug 31 16:11:51.563690 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1763/3515] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:11:50 2022] GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d => generated 1879 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:11:51.572014 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b84e3880-1853-454d-92f9-47dc134f3378 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:51.572881 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b84e3880-1853-454d-92f9-47dc134f3378 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 519c7ca0-6d6b-4250-9b7b-8d5b6ef3b6b4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:51.585671 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b84e3880-1853-454d-92f9-47dc134f3378 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:51.586120 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b84e3880-1853-454d-92f9-47dc134f3378 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:51.586563 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b84e3880-1853-454d-92f9-47dc134f3378 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:51.587294 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b84e3880-1853-454d-92f9-47dc134f3378 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:51.587779 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b84e3880-1853-454d-92f9-47dc134f3378 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:51.588208 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b84e3880-1853-454d-92f9-47dc134f3378 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:51.695244 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-807817e7-3778-4f89-a220-a7b338df62ee tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] 10.222.0.61 "GET /compute/v2.1/os-floating-ips/d06375ae-1e43-4a94-924c-86ca7a24f5f1" status: 200 len: 184 microversion: 2.1 time: 0.706184 Aug 31 16:11:51.696114 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1753/3516] 10.222.0.61 () {58 vars in 1260 bytes} [Wed Aug 31 16:11:50 2022] GET /compute/v2.1/os-floating-ips/d06375ae-1e43-4a94-924c-86ca7a24f5f1 => generated 184 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:11:51.701322 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-91a7f726-5add-4656-a1ff-d522cfa907c7 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:51.702468 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-91a7f726-5add-4656-a1ff-d522cfa907c7 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] [instance: 596c5ff8-2dc8-4248-be52-eab6df1793e0] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:51.729729 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-91a7f726-5add-4656-a1ff-d522cfa907c7 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:51.730458 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-91a7f726-5add-4656-a1ff-d522cfa907c7 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:51.731075 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-91a7f726-5add-4656-a1ff-d522cfa907c7 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:51.731969 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-91a7f726-5add-4656-a1ff-d522cfa907c7 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:51.732583 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-91a7f726-5add-4656-a1ff-d522cfa907c7 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:51.733592 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-91a7f726-5add-4656-a1ff-d522cfa907c7 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:51.870638 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b84e3880-1853-454d-92f9-47dc134f3378 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:51.886260 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b84e3880-1853-454d-92f9-47dc134f3378 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/519c7ca0-6d6b-4250-9b7b-8d5b6ef3b6b4" status: 200 len: 1508 microversion: 2.1 time: 0.321342 Aug 31 16:11:51.886945 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1764/3517] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:51 2022] GET /compute/v2.1/servers/519c7ca0-6d6b-4250-9b7b-8d5b6ef3b6b4 => generated 1508 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:51.895859 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b2881c1c-e8cf-4a21-8ea7-388111e54d28 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:51.896812 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b2881c1c-e8cf-4a21-8ea7-388111e54d28 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] [instance: 685d47e4-721e-4eae-b5f8-78fdb68454ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:51.915825 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b2881c1c-e8cf-4a21-8ea7-388111e54d28 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:51.916438 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b2881c1c-e8cf-4a21-8ea7-388111e54d28 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:51.919941 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b2881c1c-e8cf-4a21-8ea7-388111e54d28 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:51.920745 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b2881c1c-e8cf-4a21-8ea7-388111e54d28 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:51.921221 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b2881c1c-e8cf-4a21-8ea7-388111e54d28 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:51.925180 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b2881c1c-e8cf-4a21-8ea7-388111e54d28 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:52.094854 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b2881c1c-e8cf-4a21-8ea7-388111e54d28 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:52.117831 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b2881c1c-e8cf-4a21-8ea7-388111e54d28 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:52.119448 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b2881c1c-e8cf-4a21-8ea7-388111e54d28 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:52.128244 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b2881c1c-e8cf-4a21-8ea7-388111e54d28 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] 10.222.0.61 "GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae" status: 200 len: 2375 microversion: 2.42 time: 0.240350 Aug 31 16:11:52.128844 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1765/3518] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:11:51 2022] GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae => generated 2375 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:11:52.134788 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-812a7f53-b17d-4a40-a0aa-eed74d0a6753 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.6.121"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:11:52.147785 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-91a7f726-5add-4656-a1ff-d522cfa907c7 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1444fdefda4eaeac9b11577ad7248b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859e7bbce8ed4dea985c73abe3ec8cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:52.158928 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-91a7f726-5add-4656-a1ff-d522cfa907c7 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] 10.222.0.61 "GET /compute/v2.1/servers/596c5ff8-2dc8-4248-be52-eab6df1793e0" status: 200 len: 1313 microversion: 2.1 time: 0.461333 Aug 31 16:11:52.165982 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1754/3519] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:51 2022] GET /compute/v2.1/servers/596c5ff8-2dc8-4248-be52-eab6df1793e0 => generated 1313 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:52.171266 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a0c9f7f2-5e40-495f-8559-83fc6b703b82 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:52.178838 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a0c9f7f2-5e40-495f-8559-83fc6b703b82 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] [instance: e8cfd63c-6e99-429f-93f2-ea40c02d7657] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:52.191416 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a0c9f7f2-5e40-495f-8559-83fc6b703b82 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:52.192313 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a0c9f7f2-5e40-495f-8559-83fc6b703b82 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:52.193053 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a0c9f7f2-5e40-495f-8559-83fc6b703b82 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:52.194010 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a0c9f7f2-5e40-495f-8559-83fc6b703b82 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:52.194681 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a0c9f7f2-5e40-495f-8559-83fc6b703b82 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:52.195323 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a0c9f7f2-5e40-495f-8559-83fc6b703b82 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:52.465752 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a0c9f7f2-5e40-495f-8559-83fc6b703b82 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c32defec8443468861dbc8d33e3b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780f91ca8c6f461ba347cd2510dceeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:52.483834 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a0c9f7f2-5e40-495f-8559-83fc6b703b82 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c32defec8443468861dbc8d33e3b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780f91ca8c6f461ba347cd2510dceeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:52.487645 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a0c9f7f2-5e40-495f-8559-83fc6b703b82 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c32defec8443468861dbc8d33e3b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780f91ca8c6f461ba347cd2510dceeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:52.491933 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a0c9f7f2-5e40-495f-8559-83fc6b703b82 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] 10.222.0.61 "GET /compute/v2.1/servers/e8cfd63c-6e99-429f-93f2-ea40c02d7657" status: 200 len: 1366 microversion: 2.47 time: 0.324600 Aug 31 16:11:52.514871 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1755/3520] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:11:52 2022] GET /compute/v2.1/servers/e8cfd63c-6e99-429f-93f2-ea40c02d7657 => generated 1366 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:11:52.526261 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-812a7f53-b17d-4a40-a0aa-eed74d0a6753 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] [instance: 606f1624-8c53-409e-b06b-ace080f7fc44] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:52.534616 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-812a7f53-b17d-4a40-a0aa-eed74d0a6753 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:52.535376 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-812a7f53-b17d-4a40-a0aa-eed74d0a6753 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:52.537496 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-812a7f53-b17d-4a40-a0aa-eed74d0a6753 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:52.538651 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-812a7f53-b17d-4a40-a0aa-eed74d0a6753 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:52.539293 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-812a7f53-b17d-4a40-a0aa-eed74d0a6753 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:52.539950 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-812a7f53-b17d-4a40-a0aa-eed74d0a6753 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:52.576559 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-70e7cf2e-e7e8-4796-9dd4-523c7cd4da60 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:52.577433 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-70e7cf2e-e7e8-4796-9dd4-523c7cd4da60 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] [instance: fa0932e8-1aa4-4d1a-b653-14be35568f3d] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:52.589916 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-70e7cf2e-e7e8-4796-9dd4-523c7cd4da60 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:52.594419 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-70e7cf2e-e7e8-4796-9dd4-523c7cd4da60 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:52.597905 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-70e7cf2e-e7e8-4796-9dd4-523c7cd4da60 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:52.598688 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-70e7cf2e-e7e8-4796-9dd4-523c7cd4da60 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:52.599277 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-70e7cf2e-e7e8-4796-9dd4-523c7cd4da60 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:52.599756 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-70e7cf2e-e7e8-4796-9dd4-523c7cd4da60 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:52.602535 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:11:53.477987 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-812a7f53-b17d-4a40-a0aa-eed74d0a6753 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquiring lock "refresh_cache-606f1624-8c53-409e-b06b-ace080f7fc44" {{(pid=122257) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 31 16:11:53.478410 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-812a7f53-b17d-4a40-a0aa-eed74d0a6753 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquired lock "refresh_cache-606f1624-8c53-409e-b06b-ace080f7fc44" {{(pid=122257) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 31 16:11:53.972319 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-70e7cf2e-e7e8-4796-9dd4-523c7cd4da60 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:53.993227 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-70e7cf2e-e7e8-4796-9dd4-523c7cd4da60 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:53.997614 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-70e7cf2e-e7e8-4796-9dd4-523c7cd4da60 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:53.999094 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-70e7cf2e-e7e8-4796-9dd4-523c7cd4da60 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] 10.222.0.61 "GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d" status: 200 len: 1879 microversion: 2.32 time: 1.426818 Aug 31 16:11:54.000466 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1756/3521] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:11:52 2022] GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d => generated 1879 bytes in 1429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:11:54.027416 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1f55f55b-d83f-433f-a266-a850ff7d1c8b tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:54.028411 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1f55f55b-d83f-433f-a266-a850ff7d1c8b tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 519c7ca0-6d6b-4250-9b7b-8d5b6ef3b6b4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:54.036147 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1f55f55b-d83f-433f-a266-a850ff7d1c8b tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:54.043186 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1f55f55b-d83f-433f-a266-a850ff7d1c8b tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:54.045024 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1f55f55b-d83f-433f-a266-a850ff7d1c8b tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:54.046109 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1f55f55b-d83f-433f-a266-a850ff7d1c8b tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:54.046767 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1f55f55b-d83f-433f-a266-a850ff7d1c8b tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:54.048051 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1f55f55b-d83f-433f-a266-a850ff7d1c8b tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:54.125438 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:11:56.247104 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1f55f55b-d83f-433f-a266-a850ff7d1c8b tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:56.272915 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1f55f55b-d83f-433f-a266-a850ff7d1c8b tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/519c7ca0-6d6b-4250-9b7b-8d5b6ef3b6b4" status: 200 len: 1508 microversion: 2.1 time: 2.258085 Aug 31 16:11:56.276106 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1757/3522] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:54 2022] GET /compute/v2.1/servers/519c7ca0-6d6b-4250-9b7b-8d5b6ef3b6b4 => generated 1508 bytes in 2262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:56.285915 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-22d78069-181a-4a0a-bb2c-71773af5fcb9 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:56.288695 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-22d78069-181a-4a0a-bb2c-71773af5fcb9 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] [instance: 685d47e4-721e-4eae-b5f8-78fdb68454ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:56.300995 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-22d78069-181a-4a0a-bb2c-71773af5fcb9 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:56.304462 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-22d78069-181a-4a0a-bb2c-71773af5fcb9 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:56.305201 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-22d78069-181a-4a0a-bb2c-71773af5fcb9 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:56.306437 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-22d78069-181a-4a0a-bb2c-71773af5fcb9 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:56.310872 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-22d78069-181a-4a0a-bb2c-71773af5fcb9 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:56.315884 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-22d78069-181a-4a0a-bb2c-71773af5fcb9 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:56.396300 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-22d78069-181a-4a0a-bb2c-71773af5fcb9 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:56.397703 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-22d78069-181a-4a0a-bb2c-71773af5fcb9 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:56.400668 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-22d78069-181a-4a0a-bb2c-71773af5fcb9 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:56.401456 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-22d78069-181a-4a0a-bb2c-71773af5fcb9 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lazy-loading 'fault' on Instance uuid 685d47e4-721e-4eae-b5f8-78fdb68454ae {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:11:57.011092 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-22d78069-181a-4a0a-bb2c-71773af5fcb9 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:57.058024 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-22d78069-181a-4a0a-bb2c-71773af5fcb9 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:57.061244 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-22d78069-181a-4a0a-bb2c-71773af5fcb9 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccb8cf5661d641bca73aa56cb8cc334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3a6577c7c34e8e928dfc1a4172f51c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:57.082892 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-22d78069-181a-4a0a-bb2c-71773af5fcb9 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] 10.222.0.61 "GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae" status: 200 len: 2142 microversion: 2.42 time: 0.787718 Aug 31 16:11:57.100862 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1758/3523] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:11:56 2022] GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae => generated 2142 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:11:57.111118 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-670ac000-126e-450c-a704-e1e970e31f13 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:57.112052 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-670ac000-126e-450c-a704-e1e970e31f13 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] [instance: 596c5ff8-2dc8-4248-be52-eab6df1793e0] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:57.121916 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-670ac000-126e-450c-a704-e1e970e31f13 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:57.122683 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-670ac000-126e-450c-a704-e1e970e31f13 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:57.123482 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-670ac000-126e-450c-a704-e1e970e31f13 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:57.124595 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-670ac000-126e-450c-a704-e1e970e31f13 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:57.125219 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-670ac000-126e-450c-a704-e1e970e31f13 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:57.125805 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-670ac000-126e-450c-a704-e1e970e31f13 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:57.835264 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-670ac000-126e-450c-a704-e1e970e31f13 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1444fdefda4eaeac9b11577ad7248b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859e7bbce8ed4dea985c73abe3ec8cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:57.846717 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-670ac000-126e-450c-a704-e1e970e31f13 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] 10.222.0.61 "GET /compute/v2.1/servers/596c5ff8-2dc8-4248-be52-eab6df1793e0" status: 200 len: 1313 microversion: 2.1 time: 0.744353 Aug 31 16:11:57.852098 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1759/3524] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:57 2022] GET /compute/v2.1/servers/596c5ff8-2dc8-4248-be52-eab6df1793e0 => generated 1313 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:57.869791 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3bd2ba0b-fa0f-48b5-8f8a-aecb7c54910a tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:57.870747 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3bd2ba0b-fa0f-48b5-8f8a-aecb7c54910a tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] [instance: e8cfd63c-6e99-429f-93f2-ea40c02d7657] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:57.877270 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3bd2ba0b-fa0f-48b5-8f8a-aecb7c54910a tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:57.888319 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3bd2ba0b-fa0f-48b5-8f8a-aecb7c54910a tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:57.888923 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3bd2ba0b-fa0f-48b5-8f8a-aecb7c54910a tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:57.889795 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3bd2ba0b-fa0f-48b5-8f8a-aecb7c54910a tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:57.890753 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3bd2ba0b-fa0f-48b5-8f8a-aecb7c54910a tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:57.891299 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3bd2ba0b-fa0f-48b5-8f8a-aecb7c54910a tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:58.001591 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-812a7f53-b17d-4a40-a0aa-eed74d0a6753 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] [instance: 606f1624-8c53-409e-b06b-ace080f7fc44] Building network info cache for instance {{(pid=122257) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 31 16:11:58.038116 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3bd2ba0b-fa0f-48b5-8f8a-aecb7c54910a tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c32defec8443468861dbc8d33e3b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780f91ca8c6f461ba347cd2510dceeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:58.048485 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3bd2ba0b-fa0f-48b5-8f8a-aecb7c54910a tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c32defec8443468861dbc8d33e3b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780f91ca8c6f461ba347cd2510dceeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:58.055592 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3bd2ba0b-fa0f-48b5-8f8a-aecb7c54910a tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c32defec8443468861dbc8d33e3b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780f91ca8c6f461ba347cd2510dceeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:58.058777 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3bd2ba0b-fa0f-48b5-8f8a-aecb7c54910a tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] 10.222.0.61 "GET /compute/v2.1/servers/e8cfd63c-6e99-429f-93f2-ea40c02d7657" status: 200 len: 1357 microversion: 2.47 time: 0.194012 Aug 31 16:11:58.063879 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1760/3525] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:11:57 2022] GET /compute/v2.1/servers/e8cfd63c-6e99-429f-93f2-ea40c02d7657 => generated 1357 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:11:58.076921 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e054246c-61b6-4c68-9191-63279a4b0ce1 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:58.077836 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e054246c-61b6-4c68-9191-63279a4b0ce1 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] [instance: fa0932e8-1aa4-4d1a-b653-14be35568f3d] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:58.098552 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e054246c-61b6-4c68-9191-63279a4b0ce1 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:58.099364 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e054246c-61b6-4c68-9191-63279a4b0ce1 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:58.099998 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e054246c-61b6-4c68-9191-63279a4b0ce1 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:58.100709 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e054246c-61b6-4c68-9191-63279a4b0ce1 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:58.101237 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e054246c-61b6-4c68-9191-63279a4b0ce1 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:58.101868 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e054246c-61b6-4c68-9191-63279a4b0ce1 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:58.553672 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e054246c-61b6-4c68-9191-63279a4b0ce1 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:58.569278 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e054246c-61b6-4c68-9191-63279a4b0ce1 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:58.570960 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e054246c-61b6-4c68-9191-63279a4b0ce1 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:58.572233 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e054246c-61b6-4c68-9191-63279a4b0ce1 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] 10.222.0.61 "GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d" status: 200 len: 1879 microversion: 2.32 time: 0.507080 Aug 31 16:11:58.587874 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1761/3526] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:11:58 2022] GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d => generated 1879 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:11:58.595246 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-b9f76687-bc0e-471f-a81c-3eda8972b0e9 req-3604b362-00f7-45ec-bfdb-6dd31ec965bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7ae279f-9e24-4755-a912-6bec59837e6c", "name": "network-vif-deleted", "tag": "8b930bc1-225f-4f61-b131-4d4ae19c2ba2"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:11:58.605819 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-b9f76687-bc0e-471f-a81c-3eda8972b0e9 req-3604b362-00f7-45ec-bfdb-6dd31ec965bd service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:58.606724 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-b9f76687-bc0e-471f-a81c-3eda8972b0e9 req-3604b362-00f7-45ec-bfdb-6dd31ec965bd service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:58.607338 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-b9f76687-bc0e-471f-a81c-3eda8972b0e9 req-3604b362-00f7-45ec-bfdb-6dd31ec965bd service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:58.620712 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-b9f76687-bc0e-471f-a81c-3eda8972b0e9 req-3604b362-00f7-45ec-bfdb-6dd31ec965bd service nova] Creating event network-vif-deleted:8b930bc1-225f-4f61-b131-4d4ae19c2ba2 for instance c7ae279f-9e24-4755-a912-6bec59837e6c on n-h2-850499-9 Aug 31 16:11:58.628051 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-b9f76687-bc0e-471f-a81c-3eda8972b0e9 req-3604b362-00f7-45ec-bfdb-6dd31ec965bd service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037749 Aug 31 16:11:58.629474 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1762/3527] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:11:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:11:58.636549 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-55213860-c574-4009-a890-40183da091ab tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:58.638343 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-55213860-c574-4009-a890-40183da091ab tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 519c7ca0-6d6b-4250-9b7b-8d5b6ef3b6b4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:58.648504 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-55213860-c574-4009-a890-40183da091ab tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:58.649600 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-55213860-c574-4009-a890-40183da091ab tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:58.650214 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-55213860-c574-4009-a890-40183da091ab tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:58.651096 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-55213860-c574-4009-a890-40183da091ab tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:58.651745 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-55213860-c574-4009-a890-40183da091ab tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:58.652355 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-55213860-c574-4009-a890-40183da091ab tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:58.691658 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-55213860-c574-4009-a890-40183da091ab tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:58.692423 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-55213860-c574-4009-a890-40183da091ab tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:58.693562 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-55213860-c574-4009-a890-40183da091ab tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:58.694187 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-55213860-c574-4009-a890-40183da091ab tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lazy-loading 'fault' on Instance uuid 519c7ca0-6d6b-4250-9b7b-8d5b6ef3b6b4 {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:11:58.772828 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-55213860-c574-4009-a890-40183da091ab tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:58.784731 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-55213860-c574-4009-a890-40183da091ab tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/519c7ca0-6d6b-4250-9b7b-8d5b6ef3b6b4" status: 200 len: 1310 microversion: 2.1 time: 0.153057 Aug 31 16:11:58.786811 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1763/3528] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:58 2022] GET /compute/v2.1/servers/519c7ca0-6d6b-4250-9b7b-8d5b6ef3b6b4 => generated 1310 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:58.994110 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-812a7f53-b17d-4a40-a0aa-eed74d0a6753 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] [instance: 606f1624-8c53-409e-b06b-ace080f7fc44] Updating instance_info_cache with network_info: [{"id": "bd761e9e-656b-4464-b63f-bb9440ae7e14", "address": "fa:16:3e:01:26:ee", "network": {"id": "567c9ba1-6364-4d01-9016-4aec92f3efc9", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1516295813-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "eab7f0d889224cefbca55343f3208a86", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapbd761e9e-65", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122257) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 31 16:11:59.009707 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-812a7f53-b17d-4a40-a0aa-eed74d0a6753 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Releasing lock "refresh_cache-606f1624-8c53-409e-b06b-ace080f7fc44" {{(pid=122257) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 31 16:11:59.012012 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-812a7f53-b17d-4a40-a0aa-eed74d0a6753 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] 10.222.0.61 "POST /compute/v2.1/servers/606f1624-8c53-409e-b06b-ace080f7fc44/action" status: 202 len: 0 microversion: 2.1 time: 6.880799 Aug 31 16:11:59.013121 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1766/3529] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:11:52 2022] POST /compute/v2.1/servers/606f1624-8c53-409e-b06b-ace080f7fc44/action => generated 0 bytes in 6884 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 31 16:11:59.019889 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-fd46ae3b-bd5d-4085-9d97-f0b94b67fdee tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:59.020444 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-076acc50-831e-4f1f-9020-3e8e24751673 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Action: 'create', calling method: .version_select at 0x7f5ae9492d30>, body: {"keypair": {"name": "tempest-keypair-84006608", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOPEeUUlSklKy6negdHlOQrKaSTO2jxu2icP+n/UGafhmWQ7gix5quTHJ5bAGsvZ+rwAWubj7i6z/yaQTTHbOTIad8NrbFbhMTqyAc5BxoXELEY8YvQDNPtV3n45X6E3fQ=="}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:11:59.026678 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-fd46ae3b-bd5d-4085-9d97-f0b94b67fdee tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '56c32defec8443468861dbc8d33e3b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780f91ca8c6f461ba347cd2510dceeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:59.027781 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-fd46ae3b-bd5d-4085-9d97-f0b94b67fdee tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Searching by: {'deleted': False, 'project_id': '780f91ca8c6f461ba347cd2510dceeed'} {{(pid=122257) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 16:11:59.034442 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fd46ae3b-bd5d-4085-9d97-f0b94b67fdee tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:59.035093 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fd46ae3b-bd5d-4085-9d97-f0b94b67fdee tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:59.035778 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fd46ae3b-bd5d-4085-9d97-f0b94b67fdee tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:59.037537 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fd46ae3b-bd5d-4085-9d97-f0b94b67fdee tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:59.038166 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fd46ae3b-bd5d-4085-9d97-f0b94b67fdee tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:59.038868 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fd46ae3b-bd5d-4085-9d97-f0b94b67fdee tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:59.057564 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-076acc50-831e-4f1f-9020-3e8e24751673 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Getting quotas for project 805e39cb57794a138813c776b889741f. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:11:59.065241 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-076acc50-831e-4f1f-9020-3e8e24751673 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Getting quotas for user 9ea74590916f437b9722321f420ca2a8 and project 805e39cb57794a138813c776b889741f. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:11:59.112671 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-076acc50-831e-4f1f-9020-3e8e24751673 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.324442 Aug 31 16:11:59.113343 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1764/3530] 10.222.0.61 () {60 vars in 1159 bytes} [Wed Aug 31 16:11:58 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:11:59.119059 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b01d611f-623d-46a1-b3d9-7d4819282bf2 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:59.119924 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b01d611f-623d-46a1-b3d9-7d4819282bf2 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] [instance: 685d47e4-721e-4eae-b5f8-78fdb68454ae] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:59.128438 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b01d611f-623d-46a1-b3d9-7d4819282bf2 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:59.130944 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b01d611f-623d-46a1-b3d9-7d4819282bf2 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:59.131795 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b01d611f-623d-46a1-b3d9-7d4819282bf2 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:59.132744 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b01d611f-623d-46a1-b3d9-7d4819282bf2 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:59.133398 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b01d611f-623d-46a1-b3d9-7d4819282bf2 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:59.134307 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b01d611f-623d-46a1-b3d9-7d4819282bf2 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:59.160872 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-b01d611f-623d-46a1-b3d9-7d4819282bf2 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] HTTP exception thrown: Instance 685d47e4-721e-4eae-b5f8-78fdb68454ae could not be found. Aug 31 16:11:59.168029 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b01d611f-623d-46a1-b3d9-7d4819282bf2 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Request method failure captured: Aug 31 16:11:59.168029 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae HTTP/1.1 Aug 31 16:11:59.168029 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:11:59.168029 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:11:59.168029 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:11:59.168029 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:11:59.168029 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:11:59.168029 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:11:59.168029 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:11:59.168029 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:11:59.168029 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4Z8CyjK8UqRhdwHgFOKy2ozAsazp8wPxAyE8O6uvfINAaEAqIDqza_6nhJKxpu8JlJc2Ngykrs-cDot939-ySg5A8AWboNAxxeYabXGrT9Gi9LBTEpDB4-hbItQ0o066sffSwzMNW0DkHVMs9vh-TaIOlOyi0Fnef9PhCG1vuJdYOE Aug 31 16:11:59.168029 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:11:59.168029 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:11:59.168029 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:11:59.168029 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:11:59.168029 n-d-850499-9 devstack@n-api.service[122256]: X-Openstack-Nova-Api-Version: 2.42 Aug 31 16:11:59.168029 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:11:59.168029 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:11:59.168029 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: de3a6577c7c34e8e928dfc1a4172f51c Aug 31 16:11:59.168029 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-89490816 Aug 31 16:11:59.168029 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:11:59.168029 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:11:59.168029 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/de3a6577c7c34e8e928dfc1a4172f51c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/de3a6577c7c34e8e928dfc1a4172f51c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_de3a6577c7c34e8e928dfc1a4172f51c", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/de3a6577c7c34e8e928dfc1a4172f51c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:11:59.168029 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-TaggedBootDevicesTest_v242-89490816 Aug 31 16:11:59.168029 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: de3a6577c7c34e8e928dfc1a4172f51c Aug 31 16:11:59.168029 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-89490816 Aug 31 16:11:59.168029 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-TaggedBootDevicesTest_v242-89490816-project Aug 31 16:11:59.168029 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:11:59.168029 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:11:59.168029 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: ccb8cf5661d641bca73aa56cb8cc334c Aug 31 16:11:59.168029 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-TaggedBootDevicesTest_v242-89490816-project Aug 31 16:11:59.168029 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:11:59.168029 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance 685d47e4-721e-4eae-b5f8-78fdb68454ae could not be found. Aug 31 16:11:59.168029 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '685d47e4-721e-4eae-b5f8-78fdb68454ae'} Aug 31 16:11:59.168029 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:11:59.168029 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:11:59.168029 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:11:59.168029 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:11:59.168029 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:11:59.168029 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:11:59.168029 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:11:59.168029 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:11:59.168029 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:11:59.168029 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:11:59.168029 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 685d47e4-721e-4eae-b5f8-78fdb68454ae could not be found. Aug 31 16:11:59.168029 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:11:59.168029 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:11:59.168029 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:11:59.168029 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:11:59.168029 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:11:59.168029 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:11:59.168029 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:11:59.168029 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:11:59.168029 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:11:59.168029 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:11:59.168029 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:11:59.168029 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:11:59.168029 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:11:59.168029 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:11:59.168029 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:11:59.168029 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:11:59.168029 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 685d47e4-721e-4eae-b5f8-78fdb68454ae could not be found. Aug 31 16:11:59.168029 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:11:59.168029 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:11:59.172667 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:11:59.172667 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:11:59.172667 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:11:59.172667 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:11:59.172667 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:11:59.172667 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:11:59.172667 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 685d47e4-721e-4eae-b5f8-78fdb68454ae could not be found. Aug 31 16:11:59.172667 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:11:59.172667 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b01d611f-623d-46a1-b3d9-7d4819282bf2 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Returning 404 to user: Instance 685d47e4-721e-4eae-b5f8-78fdb68454ae could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:11:59.172667 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b01d611f-623d-46a1-b3d9-7d4819282bf2 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] 10.222.0.61 "GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae" status: 404 len: 111 microversion: 2.42 time: 0.054956 Aug 31 16:11:59.172667 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1765/3531] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:11:59 2022] GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:11:59.176262 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-94fa2a7b-2fb2-4d0c-af0e-29b452eda4eb tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:59.176886 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-94fa2a7b-2fb2-4d0c-af0e-29b452eda4eb tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] [instance: 596c5ff8-2dc8-4248-be52-eab6df1793e0] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:59.200922 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-94fa2a7b-2fb2-4d0c-af0e-29b452eda4eb tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:59.205600 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-94fa2a7b-2fb2-4d0c-af0e-29b452eda4eb tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:59.206119 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-94fa2a7b-2fb2-4d0c-af0e-29b452eda4eb tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:59.206874 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-94fa2a7b-2fb2-4d0c-af0e-29b452eda4eb tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:59.207353 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-94fa2a7b-2fb2-4d0c-af0e-29b452eda4eb tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:59.207828 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-94fa2a7b-2fb2-4d0c-af0e-29b452eda4eb tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:59.209403 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.multi_cell_list [None req-fd46ae3b-bd5d-4085-9d97-f0b94b67fdee tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122257) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 31 16:11:59.318535 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-fd46ae3b-bd5d-4085-9d97-f0b94b67fdee tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c32defec8443468861dbc8d33e3b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780f91ca8c6f461ba347cd2510dceeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:59.329618 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fd46ae3b-bd5d-4085-9d97-f0b94b67fdee tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:59.330225 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fd46ae3b-bd5d-4085-9d97-f0b94b67fdee tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:59.330586 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fd46ae3b-bd5d-4085-9d97-f0b94b67fdee tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:59.347848 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-fd46ae3b-bd5d-4085-9d97-f0b94b67fdee tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c32defec8443468861dbc8d33e3b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780f91ca8c6f461ba347cd2510dceeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:59.350361 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-fd46ae3b-bd5d-4085-9d97-f0b94b67fdee tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c32defec8443468861dbc8d33e3b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780f91ca8c6f461ba347cd2510dceeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:59.422459 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-fd46ae3b-bd5d-4085-9d97-f0b94b67fdee tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] 10.222.0.61 "GET /compute/v2.1/servers/detail" status: 200 len: 2706 microversion: 2.47 time: 0.408084 Aug 31 16:11:59.425067 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1767/3532] 10.222.0.61 () {60 vars in 1187 bytes} [Wed Aug 31 16:11:59 2022] GET /compute/v2.1/servers/detail => generated 2706 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:11:59.431187 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-443a6e53-2229-48a9-8fb0-562c031989b7 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:59.431732 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-443a6e53-2229-48a9-8fb0-562c031989b7 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] [instance: c7ae279f-9e24-4755-a912-6bec59837e6c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:59.440096 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-443a6e53-2229-48a9-8fb0-562c031989b7 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:59.440559 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-443a6e53-2229-48a9-8fb0-562c031989b7 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:59.441509 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-443a6e53-2229-48a9-8fb0-562c031989b7 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:59.442319 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-443a6e53-2229-48a9-8fb0-562c031989b7 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:59.443651 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-443a6e53-2229-48a9-8fb0-562c031989b7 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:59.444241 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-443a6e53-2229-48a9-8fb0-562c031989b7 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:59.486671 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-443a6e53-2229-48a9-8fb0-562c031989b7 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] [instance: c7ae279f-9e24-4755-a912-6bec59837e6c] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:11:59.502037 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-94fa2a7b-2fb2-4d0c-af0e-29b452eda4eb tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1444fdefda4eaeac9b11577ad7248b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859e7bbce8ed4dea985c73abe3ec8cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:59.510097 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-94fa2a7b-2fb2-4d0c-af0e-29b452eda4eb tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] 10.222.0.61 "GET /compute/v2.1/servers/596c5ff8-2dc8-4248-be52-eab6df1793e0" status: 200 len: 1313 microversion: 2.1 time: 0.338427 Aug 31 16:11:59.510675 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1766/3533] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:59 2022] GET /compute/v2.1/servers/596c5ff8-2dc8-4248-be52-eab6df1793e0 => generated 1313 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:59.522076 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-dc57cabc-beca-4845-b78d-fea3c810ba5e tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Calling method '.version_select at 0x7f5ae9492430>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:59.561763 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-dc57cabc-beca-4845-b78d-fea3c810ba5e tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1434139224" status: 204 len: 0 microversion: 2.42 time: 0.047576 Aug 31 16:11:59.562975 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1767/3534] 10.222.0.61 () {60 vars in 1262 bytes} [Wed Aug 31 16:11:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1434139224 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 16:11:59.569918 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5f33bc0a-d63d-490e-932e-28a8d1a4232e tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:59.570760 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5f33bc0a-d63d-490e-932e-28a8d1a4232e tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] [instance: e8cfd63c-6e99-429f-93f2-ea40c02d7657] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:59.579431 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5f33bc0a-d63d-490e-932e-28a8d1a4232e tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:59.580509 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5f33bc0a-d63d-490e-932e-28a8d1a4232e tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:59.581183 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5f33bc0a-d63d-490e-932e-28a8d1a4232e tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:59.582125 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5f33bc0a-d63d-490e-932e-28a8d1a4232e tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:59.582820 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5f33bc0a-d63d-490e-932e-28a8d1a4232e tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:59.584202 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5f33bc0a-d63d-490e-932e-28a8d1a4232e tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:59.615191 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5f33bc0a-d63d-490e-932e-28a8d1a4232e tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] [instance: e8cfd63c-6e99-429f-93f2-ea40c02d7657] Going to try to terminate instance {{(pid=122256) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:11:59.650523 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-443a6e53-2229-48a9-8fb0-562c031989b7 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] 10.222.0.61 "DELETE /compute/v2.1/servers/c7ae279f-9e24-4755-a912-6bec59837e6c" status: 204 len: 0 microversion: 2.1 time: 0.223875 Aug 31 16:11:59.651654 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1768/3535] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:11:59 2022] DELETE /compute/v2.1/servers/c7ae279f-9e24-4755-a912-6bec59837e6c => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:11:59.664398 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6d4456b0-95f1-46f8-ae6d-fb71c066f36f tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:59.665130 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6d4456b0-95f1-46f8-ae6d-fb71c066f36f tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] [instance: fa0932e8-1aa4-4d1a-b653-14be35568f3d] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:59.685587 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6d4456b0-95f1-46f8-ae6d-fb71c066f36f tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:59.686551 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6d4456b0-95f1-46f8-ae6d-fb71c066f36f tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:59.686551 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6d4456b0-95f1-46f8-ae6d-fb71c066f36f tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:59.687270 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6d4456b0-95f1-46f8-ae6d-fb71c066f36f tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:59.687805 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6d4456b0-95f1-46f8-ae6d-fb71c066f36f tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:59.688157 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6d4456b0-95f1-46f8-ae6d-fb71c066f36f tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:59.763619 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5f33bc0a-d63d-490e-932e-28a8d1a4232e tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] 10.222.0.61 "DELETE /compute/v2.1/servers/e8cfd63c-6e99-429f-93f2-ea40c02d7657" status: 204 len: 0 microversion: 2.47 time: 0.199090 Aug 31 16:11:59.768400 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1768/3536] 10.222.0.61 () {60 vars in 1280 bytes} [Wed Aug 31 16:11:59 2022] DELETE /compute/v2.1/servers/e8cfd63c-6e99-429f-93f2-ea40c02d7657 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 16:11:59.779358 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-72ef3f8b-6d7e-48a6-b0ef-4ec68692c964 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:59.780473 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-72ef3f8b-6d7e-48a6-b0ef-4ec68692c964 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] [instance: c7ae279f-9e24-4755-a912-6bec59837e6c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:59.784175 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=2,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:11:59.812117 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-72ef3f8b-6d7e-48a6-b0ef-4ec68692c964 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:59.813180 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-72ef3f8b-6d7e-48a6-b0ef-4ec68692c964 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:59.813956 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-72ef3f8b-6d7e-48a6-b0ef-4ec68692c964 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:59.815486 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-72ef3f8b-6d7e-48a6-b0ef-4ec68692c964 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:59.815999 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-72ef3f8b-6d7e-48a6-b0ef-4ec68692c964 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:59.824008 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-72ef3f8b-6d7e-48a6-b0ef-4ec68692c964 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:59.893059 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-72ef3f8b-6d7e-48a6-b0ef-4ec68692c964 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:59.894062 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-72ef3f8b-6d7e-48a6-b0ef-4ec68692c964 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:59.894777 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-72ef3f8b-6d7e-48a6-b0ef-4ec68692c964 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:59.895475 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-72ef3f8b-6d7e-48a6-b0ef-4ec68692c964 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lazy-loading 'fault' on Instance uuid c7ae279f-9e24-4755-a912-6bec59837e6c {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:12:00.014082 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-72ef3f8b-6d7e-48a6-b0ef-4ec68692c964 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13cabcaa79043bea338128594a6b00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab7f0d889224cefbca55343f3208a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:00.039771 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-72ef3f8b-6d7e-48a6-b0ef-4ec68692c964 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] 10.222.0.61 "GET /compute/v2.1/servers/c7ae279f-9e24-4755-a912-6bec59837e6c" status: 200 len: 1319 microversion: 2.1 time: 0.269231 Aug 31 16:12:00.042314 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1769/3537] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:59 2022] GET /compute/v2.1/servers/c7ae279f-9e24-4755-a912-6bec59837e6c => generated 1319 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:00.049797 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-50245426-1575-4bb0-8ed7-e738353bd1e4 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:00.050827 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-50245426-1575-4bb0-8ed7-e738353bd1e4 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] [instance: e8cfd63c-6e99-429f-93f2-ea40c02d7657] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:00.061506 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-50245426-1575-4bb0-8ed7-e738353bd1e4 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:00.062436 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-50245426-1575-4bb0-8ed7-e738353bd1e4 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:00.063256 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-50245426-1575-4bb0-8ed7-e738353bd1e4 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:00.065878 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-50245426-1575-4bb0-8ed7-e738353bd1e4 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:00.067306 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-50245426-1575-4bb0-8ed7-e738353bd1e4 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:00.071171 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-50245426-1575-4bb0-8ed7-e738353bd1e4 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:00.136046 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-6d4456b0-95f1-46f8-ae6d-fb71c066f36f tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:00.153543 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-6d4456b0-95f1-46f8-ae6d-fb71c066f36f tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:00.157120 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-6d4456b0-95f1-46f8-ae6d-fb71c066f36f tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:00.161076 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6d4456b0-95f1-46f8-ae6d-fb71c066f36f tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] 10.222.0.61 "GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d" status: 200 len: 1879 microversion: 2.32 time: 0.508313 Aug 31 16:12:00.167182 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1769/3538] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:11:59 2022] GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d => generated 1879 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:12:00.172466 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-012fe568-42cf-465d-8c6a-b89379fc930a tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:00.173101 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-012fe568-42cf-465d-8c6a-b89379fc930a tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 519c7ca0-6d6b-4250-9b7b-8d5b6ef3b6b4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:00.184279 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-012fe568-42cf-465d-8c6a-b89379fc930a tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:00.185052 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-012fe568-42cf-465d-8c6a-b89379fc930a tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:00.186298 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-012fe568-42cf-465d-8c6a-b89379fc930a tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:00.187652 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-012fe568-42cf-465d-8c6a-b89379fc930a tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:00.188517 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-012fe568-42cf-465d-8c6a-b89379fc930a tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:00.189838 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-012fe568-42cf-465d-8c6a-b89379fc930a tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:00.214432 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-50245426-1575-4bb0-8ed7-e738353bd1e4 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c32defec8443468861dbc8d33e3b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780f91ca8c6f461ba347cd2510dceeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:00.225436 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-50245426-1575-4bb0-8ed7-e738353bd1e4 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c32defec8443468861dbc8d33e3b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780f91ca8c6f461ba347cd2510dceeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:00.227391 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-50245426-1575-4bb0-8ed7-e738353bd1e4 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c32defec8443468861dbc8d33e3b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780f91ca8c6f461ba347cd2510dceeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:00.229398 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-50245426-1575-4bb0-8ed7-e738353bd1e4 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] 10.222.0.61 "GET /compute/v2.1/servers/e8cfd63c-6e99-429f-93f2-ea40c02d7657" status: 200 len: 1363 microversion: 2.47 time: 0.185156 Aug 31 16:12:00.243606 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1770/3539] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:12:00 2022] GET /compute/v2.1/servers/e8cfd63c-6e99-429f-93f2-ea40c02d7657 => generated 1363 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:12:00.254798 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-012fe568-42cf-465d-8c6a-b89379fc930a tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:00.255654 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-012fe568-42cf-465d-8c6a-b89379fc930a tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:00.257384 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-012fe568-42cf-465d-8c6a-b89379fc930a tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:00.258077 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-012fe568-42cf-465d-8c6a-b89379fc930a tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lazy-loading 'fault' on Instance uuid 519c7ca0-6d6b-4250-9b7b-8d5b6ef3b6b4 {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:12:00.318695 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-012fe568-42cf-465d-8c6a-b89379fc930a tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:00.329143 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-012fe568-42cf-465d-8c6a-b89379fc930a tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/519c7ca0-6d6b-4250-9b7b-8d5b6ef3b6b4" status: 200 len: 1310 microversion: 2.1 time: 0.160736 Aug 31 16:12:00.349613 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1770/3540] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:00 2022] GET /compute/v2.1/servers/519c7ca0-6d6b-4250-9b7b-8d5b6ef3b6b4 => generated 1310 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:00.533648 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-38b3816e-7e34-4c68-93ef-2616ad44340a tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:00.534279 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-38b3816e-7e34-4c68-93ef-2616ad44340a tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] [instance: 596c5ff8-2dc8-4248-be52-eab6df1793e0] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:00.545517 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-38b3816e-7e34-4c68-93ef-2616ad44340a tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:00.546029 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-38b3816e-7e34-4c68-93ef-2616ad44340a tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:00.548404 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-38b3816e-7e34-4c68-93ef-2616ad44340a tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:00.549168 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-38b3816e-7e34-4c68-93ef-2616ad44340a tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:00.551438 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-38b3816e-7e34-4c68-93ef-2616ad44340a tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:00.552662 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-38b3816e-7e34-4c68-93ef-2616ad44340a tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:00.678123 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-e0a7cf75-5550-468c-8bc6-faed4318718f req-7a90b867-874a-4cac-9b59-11cd85e646c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "519c7ca0-6d6b-4250-9b7b-8d5b6ef3b6b4", "name": "network-vif-deleted", "tag": "1a1343db-340f-4783-a294-d85170dd8622"}, {"name": "network-changed", "server_uuid": "606f1624-8c53-409e-b06b-ace080f7fc44", "tag": "bd761e9e-656b-4464-b63f-bb9440ae7e14"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:12:00.692220 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-e0a7cf75-5550-468c-8bc6-faed4318718f req-7a90b867-874a-4cac-9b59-11cd85e646c1 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:00.693593 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-e0a7cf75-5550-468c-8bc6-faed4318718f req-7a90b867-874a-4cac-9b59-11cd85e646c1 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:00.694231 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-e0a7cf75-5550-468c-8bc6-faed4318718f req-7a90b867-874a-4cac-9b59-11cd85e646c1 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:00.711095 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-e0a7cf75-5550-468c-8bc6-faed4318718f req-7a90b867-874a-4cac-9b59-11cd85e646c1 service nova] Creating event network-vif-deleted:1a1343db-340f-4783-a294-d85170dd8622 for instance 519c7ca0-6d6b-4250-9b7b-8d5b6ef3b6b4 on n-h2-850499-9 Aug 31 16:12:00.711855 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-e0a7cf75-5550-468c-8bc6-faed4318718f req-7a90b867-874a-4cac-9b59-11cd85e646c1 service nova] Creating event network-changed:bd761e9e-656b-4464-b63f-bb9440ae7e14 for instance 606f1624-8c53-409e-b06b-ace080f7fc44 on n-h1-850499-9 Aug 31 16:12:00.722151 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-e0a7cf75-5550-468c-8bc6-faed4318718f req-7a90b867-874a-4cac-9b59-11cd85e646c1 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.049199 Aug 31 16:12:00.723425 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1771/3541] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:12:00 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:12:00.845881 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-38b3816e-7e34-4c68-93ef-2616ad44340a tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1444fdefda4eaeac9b11577ad7248b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859e7bbce8ed4dea985c73abe3ec8cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:00.866269 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-38b3816e-7e34-4c68-93ef-2616ad44340a tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] 10.222.0.61 "GET /compute/v2.1/servers/596c5ff8-2dc8-4248-be52-eab6df1793e0" status: 200 len: 1313 microversion: 2.1 time: 0.336476 Aug 31 16:12:00.868227 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1771/3542] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:00 2022] GET /compute/v2.1/servers/596c5ff8-2dc8-4248-be52-eab6df1793e0 => generated 1313 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:01.073694 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-19f62620-a5d1-4eba-8bb9-ed51b3c5d5e5 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:01.075067 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-19f62620-a5d1-4eba-8bb9-ed51b3c5d5e5 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] [instance: c7ae279f-9e24-4755-a912-6bec59837e6c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:01.094847 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-19f62620-a5d1-4eba-8bb9-ed51b3c5d5e5 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:01.098410 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-19f62620-a5d1-4eba-8bb9-ed51b3c5d5e5 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:01.099189 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-19f62620-a5d1-4eba-8bb9-ed51b3c5d5e5 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:01.100338 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-19f62620-a5d1-4eba-8bb9-ed51b3c5d5e5 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:01.103469 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-19f62620-a5d1-4eba-8bb9-ed51b3c5d5e5 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:01.104191 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-19f62620-a5d1-4eba-8bb9-ed51b3c5d5e5 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:01.164415 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-19f62620-a5d1-4eba-8bb9-ed51b3c5d5e5 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:01.164979 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-19f62620-a5d1-4eba-8bb9-ed51b3c5d5e5 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:01.165354 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-19f62620-a5d1-4eba-8bb9-ed51b3c5d5e5 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:01.165862 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-19f62620-a5d1-4eba-8bb9-ed51b3c5d5e5 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lazy-loading 'fault' on Instance uuid c7ae279f-9e24-4755-a912-6bec59837e6c {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:12:01.187989 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-34a39a48-406c-4ddb-b1cf-3f5d27c55fbc tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:01.188608 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-34a39a48-406c-4ddb-b1cf-3f5d27c55fbc tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] [instance: fa0932e8-1aa4-4d1a-b653-14be35568f3d] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:01.197088 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-34a39a48-406c-4ddb-b1cf-3f5d27c55fbc tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:01.197627 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-34a39a48-406c-4ddb-b1cf-3f5d27c55fbc tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:01.202712 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-34a39a48-406c-4ddb-b1cf-3f5d27c55fbc tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:01.203709 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-34a39a48-406c-4ddb-b1cf-3f5d27c55fbc tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:01.204833 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-34a39a48-406c-4ddb-b1cf-3f5d27c55fbc tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:01.205453 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-34a39a48-406c-4ddb-b1cf-3f5d27c55fbc tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:01.242015 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-19f62620-a5d1-4eba-8bb9-ed51b3c5d5e5 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13cabcaa79043bea338128594a6b00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab7f0d889224cefbca55343f3208a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:01.275158 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-19f62620-a5d1-4eba-8bb9-ed51b3c5d5e5 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] 10.222.0.61 "GET /compute/v2.1/servers/c7ae279f-9e24-4755-a912-6bec59837e6c" status: 200 len: 1319 microversion: 2.1 time: 0.207431 Aug 31 16:12:01.277973 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1772/3543] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:01 2022] GET /compute/v2.1/servers/c7ae279f-9e24-4755-a912-6bec59837e6c => generated 1319 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:01.290378 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-01de5ea2-a692-46ed-99d0-4c93c9886202 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:01.291357 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-01de5ea2-a692-46ed-99d0-4c93c9886202 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] [instance: e8cfd63c-6e99-429f-93f2-ea40c02d7657] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:01.299892 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-01de5ea2-a692-46ed-99d0-4c93c9886202 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:01.300629 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-01de5ea2-a692-46ed-99d0-4c93c9886202 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:01.301243 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-01de5ea2-a692-46ed-99d0-4c93c9886202 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:01.302306 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-01de5ea2-a692-46ed-99d0-4c93c9886202 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:01.302946 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-01de5ea2-a692-46ed-99d0-4c93c9886202 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:01.303622 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-01de5ea2-a692-46ed-99d0-4c93c9886202 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:01.397513 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-01de5ea2-a692-46ed-99d0-4c93c9886202 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c32defec8443468861dbc8d33e3b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780f91ca8c6f461ba347cd2510dceeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:01.409381 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-01de5ea2-a692-46ed-99d0-4c93c9886202 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c32defec8443468861dbc8d33e3b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780f91ca8c6f461ba347cd2510dceeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:01.411015 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-01de5ea2-a692-46ed-99d0-4c93c9886202 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c32defec8443468861dbc8d33e3b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780f91ca8c6f461ba347cd2510dceeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:01.413381 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-01de5ea2-a692-46ed-99d0-4c93c9886202 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] 10.222.0.61 "GET /compute/v2.1/servers/e8cfd63c-6e99-429f-93f2-ea40c02d7657" status: 200 len: 1363 microversion: 2.47 time: 0.133696 Aug 31 16:12:01.429188 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1773/3544] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:12:01 2022] GET /compute/v2.1/servers/e8cfd63c-6e99-429f-93f2-ea40c02d7657 => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:12:01.457405 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9d5c8bfb-0f70-44d2-842d-b7f26d41bf9f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:01.459619 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9d5c8bfb-0f70-44d2-842d-b7f26d41bf9f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 519c7ca0-6d6b-4250-9b7b-8d5b6ef3b6b4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:01.469299 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9d5c8bfb-0f70-44d2-842d-b7f26d41bf9f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:01.470018 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9d5c8bfb-0f70-44d2-842d-b7f26d41bf9f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:01.471247 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9d5c8bfb-0f70-44d2-842d-b7f26d41bf9f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:01.472180 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9d5c8bfb-0f70-44d2-842d-b7f26d41bf9f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:01.472817 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9d5c8bfb-0f70-44d2-842d-b7f26d41bf9f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:01.473399 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9d5c8bfb-0f70-44d2-842d-b7f26d41bf9f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:01.569520 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9d5c8bfb-0f70-44d2-842d-b7f26d41bf9f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:01.571325 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9d5c8bfb-0f70-44d2-842d-b7f26d41bf9f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:01.571965 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9d5c8bfb-0f70-44d2-842d-b7f26d41bf9f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:01.575226 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-9d5c8bfb-0f70-44d2-842d-b7f26d41bf9f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lazy-loading 'fault' on Instance uuid 519c7ca0-6d6b-4250-9b7b-8d5b6ef3b6b4 {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:12:01.678071 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9d5c8bfb-0f70-44d2-842d-b7f26d41bf9f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:01.687223 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9d5c8bfb-0f70-44d2-842d-b7f26d41bf9f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/519c7ca0-6d6b-4250-9b7b-8d5b6ef3b6b4" status: 200 len: 1310 microversion: 2.1 time: 0.238464 Aug 31 16:12:01.693280 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-34a39a48-406c-4ddb-b1cf-3f5d27c55fbc tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:01.704366 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1774/3545] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:01 2022] GET /compute/v2.1/servers/519c7ca0-6d6b-4250-9b7b-8d5b6ef3b6b4 => generated 1310 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:01.707321 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-34a39a48-406c-4ddb-b1cf-3f5d27c55fbc tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:01.709578 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-34a39a48-406c-4ddb-b1cf-3f5d27c55fbc tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:01.728634 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-34a39a48-406c-4ddb-b1cf-3f5d27c55fbc tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] 10.222.0.61 "GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d" status: 200 len: 1879 microversion: 2.32 time: 0.544293 Aug 31 16:12:01.729357 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1772/3546] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:12:01 2022] GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d => generated 1879 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:12:01.887761 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-cec925a1-1035-46f5-8ff8-b7337473703f tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:01.888811 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-cec925a1-1035-46f5-8ff8-b7337473703f tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] [instance: 596c5ff8-2dc8-4248-be52-eab6df1793e0] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:01.896617 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cec925a1-1035-46f5-8ff8-b7337473703f tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:01.898807 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cec925a1-1035-46f5-8ff8-b7337473703f tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:01.899643 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cec925a1-1035-46f5-8ff8-b7337473703f tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:01.901093 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cec925a1-1035-46f5-8ff8-b7337473703f tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:01.901787 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cec925a1-1035-46f5-8ff8-b7337473703f tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:01.902445 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cec925a1-1035-46f5-8ff8-b7337473703f tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:02.299284 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c2774447-27c1-4b37-9a34-09de42c820e4 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:02.300621 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c2774447-27c1-4b37-9a34-09de42c820e4 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] [instance: c7ae279f-9e24-4755-a912-6bec59837e6c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:02.309460 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c2774447-27c1-4b37-9a34-09de42c820e4 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:02.310274 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c2774447-27c1-4b37-9a34-09de42c820e4 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:02.310912 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c2774447-27c1-4b37-9a34-09de42c820e4 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:02.311866 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c2774447-27c1-4b37-9a34-09de42c820e4 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:02.312535 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c2774447-27c1-4b37-9a34-09de42c820e4 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:02.313146 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c2774447-27c1-4b37-9a34-09de42c820e4 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:02.329874 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-c2774447-27c1-4b37-9a34-09de42c820e4 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] HTTP exception thrown: Instance c7ae279f-9e24-4755-a912-6bec59837e6c could not be found. Aug 31 16:12:02.332213 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c2774447-27c1-4b37-9a34-09de42c820e4 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Request method failure captured: Aug 31 16:12:02.332213 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/c7ae279f-9e24-4755-a912-6bec59837e6c HTTP/1.1 Aug 31 16:12:02.332213 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:12:02.332213 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:12:02.332213 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:12:02.332213 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:12:02.332213 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:12:02.332213 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:12:02.332213 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:12:02.332213 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:12:02.332213 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4fsKyN6baYRkKZFdkFawvt-fGsSIPYso-zL9k4if2ZEVbk1i96HvHSfcgWmzzyXd9tGvrvveBymxe9E8ZXpgksDtVOINDra1gXJqNgSp6a7cek_PkdyatZirH0_JTfxRV_xZn0asOjTaFXuYk_-Aj-azwU3vocTevjKBZKpL5Avosw Aug 31 16:12:02.332213 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:12:02.332213 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:12:02.332213 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:12:02.332213 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:12:02.332213 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:12:02.332213 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:12:02.332213 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: eab7f0d889224cefbca55343f3208a86 Aug 31 16:12:02.332213 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1010837413 Aug 31 16:12:02.332213 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:12:02.332213 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:12:02.332213 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/eab7f0d889224cefbca55343f3208a86"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/eab7f0d889224cefbca55343f3208a86"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_eab7f0d889224cefbca55343f3208a86", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/eab7f0d889224cefbca55343f3208a86"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:12:02.332213 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1010837413 Aug 31 16:12:02.332213 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: eab7f0d889224cefbca55343f3208a86 Aug 31 16:12:02.332213 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1010837413 Aug 31 16:12:02.332213 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-FloatingIPsAssociationTestJSON-1010837413-project Aug 31 16:12:02.332213 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:12:02.332213 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:12:02.332213 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: d13cabcaa79043bea338128594a6b00a Aug 31 16:12:02.332213 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1010837413-project Aug 31 16:12:02.332213 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:12:02.332213 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance c7ae279f-9e24-4755-a912-6bec59837e6c could not be found. Aug 31 16:12:02.332213 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': 'c7ae279f-9e24-4755-a912-6bec59837e6c'} Aug 31 16:12:02.332213 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:12:02.332213 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:12:02.332213 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:12:02.332213 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:12:02.332213 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:12:02.332213 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:12:02.332213 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:12:02.332213 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:12:02.332213 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:12:02.332213 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:12:02.332213 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7ae279f-9e24-4755-a912-6bec59837e6c could not be found. Aug 31 16:12:02.332213 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:12:02.332213 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:12:02.332213 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:12:02.332213 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:12:02.332213 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:12:02.332213 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:12:02.332213 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:12:02.332213 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:12:02.332213 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:12:02.332213 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:12:02.332213 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:12:02.332213 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:12:02.332213 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:12:02.332213 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:12:02.332213 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:12:02.332213 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:12:02.332213 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7ae279f-9e24-4755-a912-6bec59837e6c could not be found. Aug 31 16:12:02.332213 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:12:02.332213 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:12:02.337423 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:12:02.337423 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:12:02.337423 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:12:02.337423 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:12:02.337423 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:12:02.337423 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:12:02.337423 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7ae279f-9e24-4755-a912-6bec59837e6c could not be found. Aug 31 16:12:02.337423 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:12:02.338941 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c2774447-27c1-4b37-9a34-09de42c820e4 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Returning 404 to user: Instance c7ae279f-9e24-4755-a912-6bec59837e6c could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:12:02.340038 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c2774447-27c1-4b37-9a34-09de42c820e4 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] 10.222.0.61 "GET /compute/v2.1/servers/c7ae279f-9e24-4755-a912-6bec59837e6c" status: 404 len: 111 microversion: 2.1 time: 0.044868 Aug 31 16:12:02.340995 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1773/3547] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:02 2022] GET /compute/v2.1/servers/c7ae279f-9e24-4755-a912-6bec59837e6c => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 16:12:02.351665 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-fb84110a-4b58-4ad6-a05e-89ec6899c655 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Calling method '.version_select at 0x7f5ae858f160>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:02.661038 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-cec925a1-1035-46f5-8ff8-b7337473703f tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1444fdefda4eaeac9b11577ad7248b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859e7bbce8ed4dea985c73abe3ec8cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:02.679577 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-cec925a1-1035-46f5-8ff8-b7337473703f tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] 10.222.0.61 "GET /compute/v2.1/servers/596c5ff8-2dc8-4248-be52-eab6df1793e0" status: 200 len: 1313 microversion: 2.1 time: 0.795700 Aug 31 16:12:02.682200 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1775/3548] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:01 2022] GET /compute/v2.1/servers/596c5ff8-2dc8-4248-be52-eab6df1793e0 => generated 1313 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:02.700187 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5acb1ea6-77d0-4c28-ae2a-d3271bf3e925 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:02.700905 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5acb1ea6-77d0-4c28-ae2a-d3271bf3e925 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] [instance: e8cfd63c-6e99-429f-93f2-ea40c02d7657] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:02.708000 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5acb1ea6-77d0-4c28-ae2a-d3271bf3e925 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:02.709543 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5acb1ea6-77d0-4c28-ae2a-d3271bf3e925 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:02.710236 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5acb1ea6-77d0-4c28-ae2a-d3271bf3e925 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:02.713242 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5acb1ea6-77d0-4c28-ae2a-d3271bf3e925 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:02.713985 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5acb1ea6-77d0-4c28-ae2a-d3271bf3e925 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:02.714721 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5acb1ea6-77d0-4c28-ae2a-d3271bf3e925 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:02.770011 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5acb1ea6-77d0-4c28-ae2a-d3271bf3e925 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:02.771732 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5acb1ea6-77d0-4c28-ae2a-d3271bf3e925 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:02.772449 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5acb1ea6-77d0-4c28-ae2a-d3271bf3e925 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:02.773103 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-5acb1ea6-77d0-4c28-ae2a-d3271bf3e925 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lazy-loading 'fault' on Instance uuid e8cfd63c-6e99-429f-93f2-ea40c02d7657 {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:12:02.916641 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5acb1ea6-77d0-4c28-ae2a-d3271bf3e925 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c32defec8443468861dbc8d33e3b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780f91ca8c6f461ba347cd2510dceeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:02.926180 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5acb1ea6-77d0-4c28-ae2a-d3271bf3e925 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c32defec8443468861dbc8d33e3b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780f91ca8c6f461ba347cd2510dceeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:02.928503 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5acb1ea6-77d0-4c28-ae2a-d3271bf3e925 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c32defec8443468861dbc8d33e3b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780f91ca8c6f461ba347cd2510dceeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:02.929953 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5acb1ea6-77d0-4c28-ae2a-d3271bf3e925 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] 10.222.0.61 "GET /compute/v2.1/servers/e8cfd63c-6e99-429f-93f2-ea40c02d7657" status: 200 len: 1368 microversion: 2.47 time: 0.244838 Aug 31 16:12:02.931016 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1776/3549] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:12:02 2022] GET /compute/v2.1/servers/e8cfd63c-6e99-429f-93f2-ea40c02d7657 => generated 1368 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:12:02.936371 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-154fb471-ce5a-400e-9cf7-f9920b6b12ad tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "89af2495-1b6d-40eb-8a97-5526cd3f7bb8"}], "security_groups": [{"name": "tempest-securitygroup--2125551323"}], "key_name": "tempest-keypair-84006608", "user_data": "}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:12:03.235226 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-154fb471-ce5a-400e-9cf7-f9920b6b12ad tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] validate_networks() for [('89af2495-1b6d-40eb-8a97-5526cd3f7bb8', None, None, None, None, None)] {{(pid=122257) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:12:03.965125 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-fb84110a-4b58-4ad6-a05e-89ec6899c655 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] 10.222.0.61 "DELETE /compute/v2.1/os-floating-ips/d06375ae-1e43-4a94-924c-86ca7a24f5f1" status: 202 len: 0 microversion: 2.1 time: 1.619275 Aug 31 16:12:03.969113 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1774/3550] 10.222.0.61 () {58 vars in 1263 bytes} [Wed Aug 31 16:12:02 2022] DELETE /compute/v2.1/os-floating-ips/d06375ae-1e43-4a94-924c-86ca7a24f5f1 => generated 0 bytes in 1621 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 16:12:03.972936 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-10866431-fed9-4a46-aabc-d06eeb93266e tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:03.973678 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-10866431-fed9-4a46-aabc-d06eeb93266e tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 519c7ca0-6d6b-4250-9b7b-8d5b6ef3b6b4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:03.981987 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-10866431-fed9-4a46-aabc-d06eeb93266e tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:03.982905 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-10866431-fed9-4a46-aabc-d06eeb93266e tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:03.984296 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-10866431-fed9-4a46-aabc-d06eeb93266e tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:03.985370 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-10866431-fed9-4a46-aabc-d06eeb93266e tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:03.985913 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-10866431-fed9-4a46-aabc-d06eeb93266e tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:03.986427 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-10866431-fed9-4a46-aabc-d06eeb93266e tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:04.002991 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-154fb471-ce5a-400e-9cf7-f9920b6b12ad tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:12:04.003645 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-154fb471-ce5a-400e-9cf7-f9920b6b12ad tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:12:04.003920 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-154fb471-ce5a-400e-9cf7-f9920b6b12ad tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:12:04.004540 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-154fb471-ce5a-400e-9cf7-f9920b6b12ad tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:12:04.004979 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-154fb471-ce5a-400e-9cf7-f9920b6b12ad tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:12:04.013215 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-10866431-fed9-4a46-aabc-d06eeb93266e tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] HTTP exception thrown: Instance 519c7ca0-6d6b-4250-9b7b-8d5b6ef3b6b4 could not be found. Aug 31 16:12:04.015060 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-10866431-fed9-4a46-aabc-d06eeb93266e tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Request method failure captured: Aug 31 16:12:04.015060 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/519c7ca0-6d6b-4250-9b7b-8d5b6ef3b6b4 HTTP/1.1 Aug 31 16:12:04.015060 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:12:04.015060 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:12:04.015060 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:12:04.015060 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:12:04.015060 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:12:04.015060 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:12:04.015060 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:12:04.015060 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:12:04.015060 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4gQXSNpx7T-s6ANX8A4XIz6BgCizm9VWKy6e0KLRI2pxjPOEzPLkRnoXGF3D-Jh3OWl1h65DNjP8YomYmS0bGyt_8avVSC7qeEvUleLImq7o7EhFYQT7JAMgMioD10eCPOZ7QHRsEPDslLrPXcQD5t1iAsH1xyWK7dbpfjoYLGjDpU Aug 31 16:12:04.015060 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:12:04.015060 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:12:04.015060 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:12:04.015060 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:12:04.015060 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:12:04.015060 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:12:04.015060 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 5299955053c842b6aa02e058f4b1c0cb Aug 31 16:12:04.015060 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ServersTestJSON-1028152372 Aug 31 16:12:04.015060 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:12:04.015060 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:12:04.015060 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5299955053c842b6aa02e058f4b1c0cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5299955053c842b6aa02e058f4b1c0cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5299955053c842b6aa02e058f4b1c0cb", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5299955053c842b6aa02e058f4b1c0cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:12:04.015060 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ServersTestJSON-1028152372 Aug 31 16:12:04.015060 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 5299955053c842b6aa02e058f4b1c0cb Aug 31 16:12:04.015060 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ServersTestJSON-1028152372 Aug 31 16:12:04.015060 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ServersTestJSON-1028152372-project Aug 31 16:12:04.015060 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:12:04.015060 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:12:04.015060 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 6e707652819c497bbdf94f85f39c447a Aug 31 16:12:04.015060 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ServersTestJSON-1028152372-project Aug 31 16:12:04.015060 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:12:04.015060 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance 519c7ca0-6d6b-4250-9b7b-8d5b6ef3b6b4 could not be found. Aug 31 16:12:04.015060 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '519c7ca0-6d6b-4250-9b7b-8d5b6ef3b6b4'} Aug 31 16:12:04.015060 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:12:04.015060 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:12:04.015060 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:12:04.015060 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:12:04.015060 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:12:04.015060 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:12:04.015060 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:12:04.015060 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:12:04.015060 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:12:04.015060 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:12:04.015060 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 519c7ca0-6d6b-4250-9b7b-8d5b6ef3b6b4 could not be found. Aug 31 16:12:04.015060 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:12:04.015060 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:12:04.015060 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:12:04.015060 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:12:04.015060 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:12:04.015060 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:12:04.015060 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:12:04.015060 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:12:04.015060 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:12:04.015060 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:12:04.015060 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:12:04.015060 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:12:04.015060 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:12:04.015060 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:12:04.015060 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:12:04.015060 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:12:04.015060 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 519c7ca0-6d6b-4250-9b7b-8d5b6ef3b6b4 could not be found. Aug 31 16:12:04.015060 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:12:04.015060 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:12:04.015060 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:12:04.019291 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:12:04.019291 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:12:04.019291 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:12:04.019291 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:12:04.019291 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:12:04.019291 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 519c7ca0-6d6b-4250-9b7b-8d5b6ef3b6b4 could not be found. Aug 31 16:12:04.019291 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:12:04.023655 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-10866431-fed9-4a46-aabc-d06eeb93266e tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Returning 404 to user: Instance 519c7ca0-6d6b-4250-9b7b-8d5b6ef3b6b4 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:12:04.025219 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-10866431-fed9-4a46-aabc-d06eeb93266e tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/519c7ca0-6d6b-4250-9b7b-8d5b6ef3b6b4" status: 404 len: 111 microversion: 2.1 time: 0.057578 Aug 31 16:12:04.033365 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-154fb471-ce5a-400e-9cf7-f9920b6b12ad tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:04.033365 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-154fb471-ce5a-400e-9cf7-f9920b6b12ad tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:04.033365 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-154fb471-ce5a-400e-9cf7-f9920b6b12ad tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:04.033365 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-154fb471-ce5a-400e-9cf7-f9920b6b12ad tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:04.033365 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-154fb471-ce5a-400e-9cf7-f9920b6b12ad tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:04.033365 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-154fb471-ce5a-400e-9cf7-f9920b6b12ad tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:04.034583 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1775/3551] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:03 2022] GET /compute/v2.1/servers/519c7ca0-6d6b-4250-9b7b-8d5b6ef3b6b4 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:12:04.040528 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8f77750b-8cb7-454c-864e-686e8e1db10e tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:04.041443 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8f77750b-8cb7-454c-864e-686e8e1db10e tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] [instance: fa0932e8-1aa4-4d1a-b653-14be35568f3d] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:04.047801 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8f77750b-8cb7-454c-864e-686e8e1db10e tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:04.048991 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8f77750b-8cb7-454c-864e-686e8e1db10e tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:04.050124 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8f77750b-8cb7-454c-864e-686e8e1db10e tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:04.051067 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8f77750b-8cb7-454c-864e-686e8e1db10e tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:04.051703 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8f77750b-8cb7-454c-864e-686e8e1db10e tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:04.053028 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8f77750b-8cb7-454c-864e-686e8e1db10e tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:04.057712 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-154fb471-ce5a-400e-9cf7-f9920b6b12ad tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Getting quotas for project 805e39cb57794a138813c776b889741f. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:12:04.066669 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-154fb471-ce5a-400e-9cf7-f9920b6b12ad tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Getting quotas for user 9ea74590916f437b9722321f420ca2a8 and project 805e39cb57794a138813c776b889741f. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:12:04.098373 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-154fb471-ce5a-400e-9cf7-f9920b6b12ad tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Going to run 1 instances... {{(pid=122257) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:12:04.101199 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-154fb471-ce5a-400e-9cf7-f9920b6b12ad tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] [instance: af6da672-bcfb-433b-b868-3dd1dd3e4770] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:12:04.158789 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-154fb471-ce5a-400e-9cf7-f9920b6b12ad tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.226329 Aug 31 16:12:04.160029 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1777/3552] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:12:02 2022] POST /compute/v2.1/servers => generated 409 bytes in 1228 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:12:04.165835 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-428bd244-7330-40fe-9c17-5a3432287285 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:04.166631 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-428bd244-7330-40fe-9c17-5a3432287285 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] [instance: 596c5ff8-2dc8-4248-be52-eab6df1793e0] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:04.173169 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-428bd244-7330-40fe-9c17-5a3432287285 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:04.174475 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-428bd244-7330-40fe-9c17-5a3432287285 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:04.175108 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-428bd244-7330-40fe-9c17-5a3432287285 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:04.176013 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-428bd244-7330-40fe-9c17-5a3432287285 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:04.176632 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-428bd244-7330-40fe-9c17-5a3432287285 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:04.177461 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-428bd244-7330-40fe-9c17-5a3432287285 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:04.510044 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8f77750b-8cb7-454c-864e-686e8e1db10e tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:04.530691 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8f77750b-8cb7-454c-864e-686e8e1db10e tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:04.535083 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8f77750b-8cb7-454c-864e-686e8e1db10e tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:04.537911 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8f77750b-8cb7-454c-864e-686e8e1db10e tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] 10.222.0.61 "GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d" status: 200 len: 1879 microversion: 2.32 time: 0.502089 Aug 31 16:12:04.543571 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1776/3553] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:12:04 2022] GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d => generated 1879 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:12:04.558564 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7a4bc95c-bcf1-458c-b53e-92c41f89e02f tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:04.564072 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7a4bc95c-bcf1-458c-b53e-92c41f89e02f tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] [instance: e8cfd63c-6e99-429f-93f2-ea40c02d7657] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:04.586242 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7a4bc95c-bcf1-458c-b53e-92c41f89e02f tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:04.587204 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7a4bc95c-bcf1-458c-b53e-92c41f89e02f tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:04.587923 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7a4bc95c-bcf1-458c-b53e-92c41f89e02f tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:04.589859 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-428bd244-7330-40fe-9c17-5a3432287285 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1444fdefda4eaeac9b11577ad7248b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859e7bbce8ed4dea985c73abe3ec8cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:04.590340 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7a4bc95c-bcf1-458c-b53e-92c41f89e02f tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:04.591103 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7a4bc95c-bcf1-458c-b53e-92c41f89e02f tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:04.592076 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7a4bc95c-bcf1-458c-b53e-92c41f89e02f tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:04.603868 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:12:04.605665 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-428bd244-7330-40fe-9c17-5a3432287285 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] 10.222.0.61 "GET /compute/v2.1/servers/596c5ff8-2dc8-4248-be52-eab6df1793e0" status: 200 len: 1313 microversion: 2.1 time: 0.438548 Aug 31 16:12:04.606554 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1778/3554] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:04 2022] GET /compute/v2.1/servers/596c5ff8-2dc8-4248-be52-eab6df1793e0 => generated 1313 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:04.622013 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-7a4bc95c-bcf1-458c-b53e-92c41f89e02f tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] HTTP exception thrown: Instance e8cfd63c-6e99-429f-93f2-ea40c02d7657 could not be found. Aug 31 16:12:04.624003 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7a4bc95c-bcf1-458c-b53e-92c41f89e02f tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Request method failure captured: Aug 31 16:12:04.624003 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/e8cfd63c-6e99-429f-93f2-ea40c02d7657 HTTP/1.1 Aug 31 16:12:04.624003 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:12:04.624003 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:12:04.624003 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:12:04.624003 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:12:04.624003 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:12:04.624003 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:12:04.624003 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:12:04.624003 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:12:04.624003 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4gbd2cgRcb88tRJKGpdlb29V9irubNkYTjYHLn9YajNbTIMBGIg8PQ0b1UBBbJ55Bs6CGmqVK4DPiQ-OmECdS0w7HdiRcl0KIVXR4ZRYZF12ysVg4mu2xTEUkvOjh2Wi7OBA3xLBtuDT_yeDjoZrrNZVzzCr64j40-G4GjXDnL4el0 Aug 31 16:12:04.624003 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:12:04.624003 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:12:04.624003 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:12:04.624003 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:12:04.624003 n-d-850499-9 devstack@n-api.service[122256]: X-Openstack-Nova-Api-Version: 2.47 Aug 31 16:12:04.624003 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:12:04.624003 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:12:04.624003 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 780f91ca8c6f461ba347cd2510dceeed Aug 31 16:12:04.624003 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ServerShowV247Test-716197726 Aug 31 16:12:04.624003 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:12:04.624003 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:12:04.624003 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/780f91ca8c6f461ba347cd2510dceeed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/780f91ca8c6f461ba347cd2510dceeed"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_780f91ca8c6f461ba347cd2510dceeed", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/780f91ca8c6f461ba347cd2510dceeed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:12:04.624003 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ServerShowV247Test-716197726 Aug 31 16:12:04.624003 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 780f91ca8c6f461ba347cd2510dceeed Aug 31 16:12:04.624003 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ServerShowV247Test-716197726 Aug 31 16:12:04.624003 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ServerShowV247Test-716197726-project Aug 31 16:12:04.624003 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:12:04.624003 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:12:04.624003 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 56c32defec8443468861dbc8d33e3b7c Aug 31 16:12:04.624003 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ServerShowV247Test-716197726-project Aug 31 16:12:04.624003 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:12:04.624003 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance e8cfd63c-6e99-429f-93f2-ea40c02d7657 could not be found. Aug 31 16:12:04.624003 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': 'e8cfd63c-6e99-429f-93f2-ea40c02d7657'} Aug 31 16:12:04.624003 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:12:04.624003 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:12:04.624003 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:12:04.624003 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:12:04.624003 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:12:04.624003 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:12:04.624003 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:12:04.624003 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:12:04.624003 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:12:04.624003 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:12:04.624003 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8cfd63c-6e99-429f-93f2-ea40c02d7657 could not be found. Aug 31 16:12:04.624003 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:12:04.624003 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:12:04.624003 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:12:04.624003 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:12:04.624003 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:12:04.624003 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:12:04.624003 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:12:04.624003 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:12:04.624003 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:12:04.624003 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:12:04.624003 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:12:04.624003 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:12:04.624003 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:12:04.624003 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:12:04.624003 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:12:04.624003 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:12:04.624003 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8cfd63c-6e99-429f-93f2-ea40c02d7657 could not be found. Aug 31 16:12:04.624003 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:12:04.624003 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:12:04.624003 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:12:04.628227 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:12:04.628227 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:12:04.628227 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:12:04.628227 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:12:04.628227 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:12:04.628227 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8cfd63c-6e99-429f-93f2-ea40c02d7657 could not be found. Aug 31 16:12:04.628227 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:12:04.628677 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4c8fc86c-232e-4063-8647-05ec51d8691b tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:04.628677 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4c8fc86c-232e-4063-8647-05ec51d8691b tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] [instance: 606f1624-8c53-409e-b06b-ace080f7fc44] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:04.631540 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7a4bc95c-bcf1-458c-b53e-92c41f89e02f tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Returning 404 to user: Instance e8cfd63c-6e99-429f-93f2-ea40c02d7657 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:12:04.632691 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7a4bc95c-bcf1-458c-b53e-92c41f89e02f tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] 10.222.0.61 "GET /compute/v2.1/servers/e8cfd63c-6e99-429f-93f2-ea40c02d7657" status: 404 len: 111 microversion: 2.47 time: 0.087909 Aug 31 16:12:04.633955 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1777/3555] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:12:04 2022] GET /compute/v2.1/servers/e8cfd63c-6e99-429f-93f2-ea40c02d7657 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:12:04.640117 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-65c3f04f-fc37-43f8-832d-bd587b62a5cc tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Action: 'create', calling method: .version_select at 0x7f5ae8f1cc10>, body: {"keypair": {"name": "tempest-key-751293242", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNkvmW9tD9lqZ4L/diYOlnCegARgjiDptoaA9/qryyYzC41zbPrUukJx3+ezGD5cNOqk9M2viGNNLQRIkOOQk6BmlfgLnBa1/a/SQng6MZ9XlspHR8tvEegEip4ubCHPQA=="}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:12:04.645203 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4c8fc86c-232e-4063-8647-05ec51d8691b tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:04.645772 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4c8fc86c-232e-4063-8647-05ec51d8691b tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:04.647211 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4c8fc86c-232e-4063-8647-05ec51d8691b tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:04.648736 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4c8fc86c-232e-4063-8647-05ec51d8691b tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:04.651394 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4c8fc86c-232e-4063-8647-05ec51d8691b tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:04.652070 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4c8fc86c-232e-4063-8647-05ec51d8691b tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:04.682613 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-65c3f04f-fc37-43f8-832d-bd587b62a5cc tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Getting quotas for project 5299955053c842b6aa02e058f4b1c0cb. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:12:04.701255 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-65c3f04f-fc37-43f8-832d-bd587b62a5cc tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Getting quotas for user 6e707652819c497bbdf94f85f39c447a and project 5299955053c842b6aa02e058f4b1c0cb. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:12:04.742089 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4c8fc86c-232e-4063-8647-05ec51d8691b tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] [instance: 606f1624-8c53-409e-b06b-ace080f7fc44] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:12:04.745724 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:12:04.746427 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-65c3f04f-fc37-43f8-832d-bd587b62a5cc tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 381 microversion: 2.1 time: 0.109159 Aug 31 16:12:04.757369 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1778/3556] 10.222.0.61 () {60 vars in 1159 bytes} [Wed Aug 31 16:12:04 2022] POST /compute/v2.1/os-keypairs => generated 381 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:12:04.765848 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-85e388e1-bf1b-4645-9d24-3220c8f06b77 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:04.772954 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-85e388e1-bf1b-4645-9d24-3220c8f06b77 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] [instance: af6da672-bcfb-433b-b868-3dd1dd3e4770] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:04.929226 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4c8fc86c-232e-4063-8647-05ec51d8691b tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] 10.222.0.61 "DELETE /compute/v2.1/servers/606f1624-8c53-409e-b06b-ace080f7fc44" status: 204 len: 0 microversion: 2.1 time: 0.307446 Aug 31 16:12:04.933471 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1779/3557] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:12:04 2022] DELETE /compute/v2.1/servers/606f1624-8c53-409e-b06b-ace080f7fc44 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:12:04.942368 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-93aa02d6-1c87-41e0-97d6-e7728f982a03 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:04.944201 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-93aa02d6-1c87-41e0-97d6-e7728f982a03 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] [instance: a2758687-ae57-4655-9f6f-d9363dcd3e26] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:04.972013 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-93aa02d6-1c87-41e0-97d6-e7728f982a03 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:04.972625 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-93aa02d6-1c87-41e0-97d6-e7728f982a03 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:04.973140 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-93aa02d6-1c87-41e0-97d6-e7728f982a03 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:04.974523 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-93aa02d6-1c87-41e0-97d6-e7728f982a03 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:04.974993 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-93aa02d6-1c87-41e0-97d6-e7728f982a03 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:04.977436 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-85e388e1-bf1b-4645-9d24-3220c8f06b77 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea74590916f437b9722321f420ca2a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805e39cb57794a138813c776b889741f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:04.984500 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-93aa02d6-1c87-41e0-97d6-e7728f982a03 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:05.009013 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-85e388e1-bf1b-4645-9d24-3220c8f06b77 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] 10.222.0.61 "GET /compute/v2.1/servers/af6da672-bcfb-433b-b868-3dd1dd3e4770" status: 200 len: 1224 microversion: 2.1 time: 0.248765 Aug 31 16:12:05.011007 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1779/3558] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:04 2022] GET /compute/v2.1/servers/af6da672-bcfb-433b-b868-3dd1dd3e4770 => generated 1224 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:05.040121 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-93aa02d6-1c87-41e0-97d6-e7728f982a03 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] [instance: a2758687-ae57-4655-9f6f-d9363dcd3e26] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:12:05.044908 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-280d5969-0cbf-4126-a226-c003b19fd497 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '.version_select at 0x7f5ae96e5820>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:05.050185 n-d-850499-9 devstack@n-api.service[122256]: WARNING oslo_db.sqlalchemy.utils [None req-280d5969-0cbf-4126-a226-c003b19fd497 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 31 16:12:05.057774 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-280d5969-0cbf-4126-a226-c003b19fd497 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/os-keypairs" status: 200 len: 350 microversion: 2.1 time: 0.045347 Aug 31 16:12:05.059104 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1780/3559] 10.222.0.61 () {58 vars in 1137 bytes} [Wed Aug 31 16:12:05 2022] GET /compute/v2.1/os-keypairs => generated 350 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:12:05.065031 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-91d6ac7d-98b4-4c7a-a5ec-3d4b68cad180 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:05.066447 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-91d6ac7d-98b4-4c7a-a5ec-3d4b68cad180 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] [instance: 606f1624-8c53-409e-b06b-ace080f7fc44] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:05.083565 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-91d6ac7d-98b4-4c7a-a5ec-3d4b68cad180 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:05.084334 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-91d6ac7d-98b4-4c7a-a5ec-3d4b68cad180 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:05.085373 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-91d6ac7d-98b4-4c7a-a5ec-3d4b68cad180 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:05.086371 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-91d6ac7d-98b4-4c7a-a5ec-3d4b68cad180 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:05.087046 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-91d6ac7d-98b4-4c7a-a5ec-3d4b68cad180 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:05.087716 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-91d6ac7d-98b4-4c7a-a5ec-3d4b68cad180 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:05.222313 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-93aa02d6-1c87-41e0-97d6-e7728f982a03 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] 10.222.0.61 "DELETE /compute/v2.1/servers/a2758687-ae57-4655-9f6f-d9363dcd3e26" status: 204 len: 0 microversion: 2.47 time: 0.286190 Aug 31 16:12:05.222925 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1780/3560] 10.222.0.61 () {60 vars in 1280 bytes} [Wed Aug 31 16:12:04 2022] DELETE /compute/v2.1/servers/a2758687-ae57-4655-9f6f-d9363dcd3e26 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 16:12:05.237862 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a945929b-94ff-4f01-8b17-78f11757bcd2 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:05.238783 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a945929b-94ff-4f01-8b17-78f11757bcd2 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] [instance: a2758687-ae57-4655-9f6f-d9363dcd3e26] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:05.252736 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a945929b-94ff-4f01-8b17-78f11757bcd2 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:05.254603 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a945929b-94ff-4f01-8b17-78f11757bcd2 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:05.254603 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a945929b-94ff-4f01-8b17-78f11757bcd2 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:05.254603 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a945929b-94ff-4f01-8b17-78f11757bcd2 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:05.254908 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a945929b-94ff-4f01-8b17-78f11757bcd2 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:05.256062 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a945929b-94ff-4f01-8b17-78f11757bcd2 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:05.289044 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-91d6ac7d-98b4-4c7a-a5ec-3d4b68cad180 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13cabcaa79043bea338128594a6b00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab7f0d889224cefbca55343f3208a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:05.299029 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-91d6ac7d-98b4-4c7a-a5ec-3d4b68cad180 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] 10.222.0.61 "GET /compute/v2.1/servers/606f1624-8c53-409e-b06b-ace080f7fc44" status: 200 len: 1525 microversion: 2.1 time: 0.238314 Aug 31 16:12:05.319901 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1781/3561] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:05 2022] GET /compute/v2.1/servers/606f1624-8c53-409e-b06b-ace080f7fc44 => generated 1525 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:05.327665 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-94c516ad-f013-4c78-ab8f-1a75525ad875 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-445730079", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "key_name": "tempest-key-751293242", "networks": [{"uuid": "e418f255-318f-476c-a353-8d292b5f7798"}]}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:12:05.361699 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a945929b-94ff-4f01-8b17-78f11757bcd2 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c32defec8443468861dbc8d33e3b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780f91ca8c6f461ba347cd2510dceeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:05.371860 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a945929b-94ff-4f01-8b17-78f11757bcd2 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c32defec8443468861dbc8d33e3b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780f91ca8c6f461ba347cd2510dceeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:05.373977 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a945929b-94ff-4f01-8b17-78f11757bcd2 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c32defec8443468861dbc8d33e3b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780f91ca8c6f461ba347cd2510dceeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:05.375396 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a945929b-94ff-4f01-8b17-78f11757bcd2 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] 10.222.0.61 "GET /compute/v2.1/servers/a2758687-ae57-4655-9f6f-d9363dcd3e26" status: 200 len: 1362 microversion: 2.47 time: 0.146487 Aug 31 16:12:05.388926 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1781/3562] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:12:05 2022] GET /compute/v2.1/servers/a2758687-ae57-4655-9f6f-d9363dcd3e26 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:12:05.404718 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-94c516ad-f013-4c78-ab8f-1a75525ad875 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] validate_networks() for [('e418f255-318f-476c-a353-8d292b5f7798', None, None, None, None, None)] {{(pid=122256) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:12:05.571972 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-cadced47-d409-49f5-b470-3090243878d8 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:05.572879 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-cadced47-d409-49f5-b470-3090243878d8 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] [instance: fa0932e8-1aa4-4d1a-b653-14be35568f3d] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:05.584478 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cadced47-d409-49f5-b470-3090243878d8 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:05.585224 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cadced47-d409-49f5-b470-3090243878d8 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:05.586447 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cadced47-d409-49f5-b470-3090243878d8 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:05.589142 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cadced47-d409-49f5-b470-3090243878d8 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:05.589923 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cadced47-d409-49f5-b470-3090243878d8 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:05.590429 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cadced47-d409-49f5-b470-3090243878d8 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:05.884196 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-cadced47-d409-49f5-b470-3090243878d8 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:05.893499 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-cadced47-d409-49f5-b470-3090243878d8 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:05.895085 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-cadced47-d409-49f5-b470-3090243878d8 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:05.897366 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-cadced47-d409-49f5-b470-3090243878d8 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] 10.222.0.61 "GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d" status: 200 len: 1879 microversion: 2.32 time: 0.328674 Aug 31 16:12:05.897934 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1782/3563] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:12:05 2022] GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d => generated 1879 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:12:05.903076 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d9db6dba-d177-4882-8a34-35dd9ea0a458 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:05.903915 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d9db6dba-d177-4882-8a34-35dd9ea0a458 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] [instance: 685d47e4-721e-4eae-b5f8-78fdb68454ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:05.916058 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d9db6dba-d177-4882-8a34-35dd9ea0a458 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:05.917238 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d9db6dba-d177-4882-8a34-35dd9ea0a458 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:05.918050 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d9db6dba-d177-4882-8a34-35dd9ea0a458 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:05.920494 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d9db6dba-d177-4882-8a34-35dd9ea0a458 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:05.921195 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d9db6dba-d177-4882-8a34-35dd9ea0a458 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:05.921643 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d9db6dba-d177-4882-8a34-35dd9ea0a458 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:05.938567 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-d9db6dba-d177-4882-8a34-35dd9ea0a458 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] HTTP exception thrown: Instance 685d47e4-721e-4eae-b5f8-78fdb68454ae could not be found. Aug 31 16:12:05.940555 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d9db6dba-d177-4882-8a34-35dd9ea0a458 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Request method failure captured: Aug 31 16:12:05.940555 n-d-850499-9 devstack@n-api.service[122257]: request: DELETE /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae HTTP/1.1 Aug 31 16:12:05.940555 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:12:05.940555 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:12:05.940555 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:12:05.940555 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:12:05.940555 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:12:05.940555 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:12:05.940555 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:12:05.940555 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:12:05.940555 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4Z8CyjK8UqRhdwHgFOKy2ozAsazp8wPxAyE8O6uvfINAaEAqIDqza_6nhJKxpu8JlJc2Ngykrs-cDot939-ySg5A8AWboNAxxeYabXGrT9Gi9LBTEpDB4-hbItQ0o066sffSwzMNW0DkHVMs9vh-TaIOlOyi0Fnef9PhCG1vuJdYOE Aug 31 16:12:05.940555 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:12:05.940555 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:12:05.940555 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:12:05.940555 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:12:05.940555 n-d-850499-9 devstack@n-api.service[122257]: X-Openstack-Nova-Api-Version: 2.42 Aug 31 16:12:05.940555 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:12:05.940555 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:12:05.940555 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: de3a6577c7c34e8e928dfc1a4172f51c Aug 31 16:12:05.940555 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-89490816 Aug 31 16:12:05.940555 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:12:05.940555 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:12:05.940555 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/de3a6577c7c34e8e928dfc1a4172f51c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/de3a6577c7c34e8e928dfc1a4172f51c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_de3a6577c7c34e8e928dfc1a4172f51c", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/de3a6577c7c34e8e928dfc1a4172f51c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:12:05.940555 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-TaggedBootDevicesTest_v242-89490816 Aug 31 16:12:05.940555 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: de3a6577c7c34e8e928dfc1a4172f51c Aug 31 16:12:05.940555 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-89490816 Aug 31 16:12:05.940555 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-TaggedBootDevicesTest_v242-89490816-project Aug 31 16:12:05.940555 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:12:05.940555 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:12:05.940555 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: ccb8cf5661d641bca73aa56cb8cc334c Aug 31 16:12:05.940555 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-TaggedBootDevicesTest_v242-89490816-project Aug 31 16:12:05.940555 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:12:05.940555 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance 685d47e4-721e-4eae-b5f8-78fdb68454ae could not be found. Aug 31 16:12:05.940555 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '685d47e4-721e-4eae-b5f8-78fdb68454ae'} Aug 31 16:12:05.940555 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:12:05.940555 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:12:05.940555 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:12:05.940555 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:12:05.940555 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:12:05.940555 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:12:05.940555 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:12:05.940555 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:12:05.940555 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:12:05.940555 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:12:05.940555 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 685d47e4-721e-4eae-b5f8-78fdb68454ae could not be found. Aug 31 16:12:05.940555 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:12:05.940555 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:12:05.940555 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:12:05.940555 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:12:05.940555 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:12:05.940555 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:12:05.940555 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:12:05.940555 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:12:05.940555 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:12:05.940555 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:12:05.940555 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:12:05.940555 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:12:05.940555 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:12:05.940555 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:12:05.940555 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:12:05.940555 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:12:05.940555 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:12:05.940555 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:12:05.945716 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 685d47e4-721e-4eae-b5f8-78fdb68454ae could not be found. Aug 31 16:12:05.945716 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:12:05.945716 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:12:05.945716 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:12:05.945716 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:12:05.945716 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:12:05.945716 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:12:05.945716 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:12:05.945716 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:12:05.945716 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 685d47e4-721e-4eae-b5f8-78fdb68454ae could not be found. Aug 31 16:12:05.945716 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:12:05.945716 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d9db6dba-d177-4882-8a34-35dd9ea0a458 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Returning 404 to user: Instance 685d47e4-721e-4eae-b5f8-78fdb68454ae could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:12:05.945716 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d9db6dba-d177-4882-8a34-35dd9ea0a458 tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] 10.222.0.61 "DELETE /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae" status: 404 len: 111 microversion: 2.42 time: 0.042863 Aug 31 16:12:05.945716 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1783/3564] 10.222.0.61 () {60 vars in 1280 bytes} [Wed Aug 31 16:12:05 2022] DELETE /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:12:05.948384 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-db529d6e-343c-4fa9-ad9e-98fd9d646cbf tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:05.948645 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-db529d6e-343c-4fa9-ad9e-98fd9d646cbf tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] [instance: 596c5ff8-2dc8-4248-be52-eab6df1793e0] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:05.952015 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:12:05.956708 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-db529d6e-343c-4fa9-ad9e-98fd9d646cbf tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:05.957201 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-db529d6e-343c-4fa9-ad9e-98fd9d646cbf tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:05.958086 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-db529d6e-343c-4fa9-ad9e-98fd9d646cbf tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:05.959778 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-db529d6e-343c-4fa9-ad9e-98fd9d646cbf tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:05.959902 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-db529d6e-343c-4fa9-ad9e-98fd9d646cbf tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:05.960271 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-db529d6e-343c-4fa9-ad9e-98fd9d646cbf tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:06.070949 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-94c516ad-f013-4c78-ab8f-1a75525ad875 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:12:06.071466 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-94c516ad-f013-4c78-ab8f-1a75525ad875 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:12:06.071920 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-94c516ad-f013-4c78-ab8f-1a75525ad875 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:12:06.072379 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-94c516ad-f013-4c78-ab8f-1a75525ad875 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:12:06.072794 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-94c516ad-f013-4c78-ab8f-1a75525ad875 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:12:06.086292 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-94c516ad-f013-4c78-ab8f-1a75525ad875 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:06.086789 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-94c516ad-f013-4c78-ab8f-1a75525ad875 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:06.087229 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-94c516ad-f013-4c78-ab8f-1a75525ad875 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:06.087981 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-94c516ad-f013-4c78-ab8f-1a75525ad875 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:06.088697 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-94c516ad-f013-4c78-ab8f-1a75525ad875 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:06.089433 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-94c516ad-f013-4c78-ab8f-1a75525ad875 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:06.127275 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-94c516ad-f013-4c78-ab8f-1a75525ad875 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Getting quotas for project 5299955053c842b6aa02e058f4b1c0cb. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:12:06.136977 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-94c516ad-f013-4c78-ab8f-1a75525ad875 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Getting quotas for user 6e707652819c497bbdf94f85f39c447a and project 5299955053c842b6aa02e058f4b1c0cb. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:12:06.145166 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-db529d6e-343c-4fa9-ad9e-98fd9d646cbf tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1444fdefda4eaeac9b11577ad7248b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859e7bbce8ed4dea985c73abe3ec8cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:06.157515 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-db529d6e-343c-4fa9-ad9e-98fd9d646cbf tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] 10.222.0.61 "GET /compute/v2.1/servers/596c5ff8-2dc8-4248-be52-eab6df1793e0" status: 200 len: 1313 microversion: 2.1 time: 0.212858 Aug 31 16:12:06.168148 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1784/3565] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:05 2022] GET /compute/v2.1/servers/596c5ff8-2dc8-4248-be52-eab6df1793e0 => generated 1313 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:06.168388 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-94c516ad-f013-4c78-ab8f-1a75525ad875 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Going to run 1 instances... {{(pid=122256) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:12:06.168504 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6fe4d56d-dd79-4374-8466-8ad785dfcd8b tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:06.168593 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-94c516ad-f013-4c78-ab8f-1a75525ad875 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 8e287ae9-272b-4148-a159-790187f5d8a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:12:06.168701 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6fe4d56d-dd79-4374-8466-8ad785dfcd8b tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] [instance: 685d47e4-721e-4eae-b5f8-78fdb68454ae] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:06.184635 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6fe4d56d-dd79-4374-8466-8ad785dfcd8b tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:06.185226 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6fe4d56d-dd79-4374-8466-8ad785dfcd8b tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:06.185757 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6fe4d56d-dd79-4374-8466-8ad785dfcd8b tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:06.186545 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6fe4d56d-dd79-4374-8466-8ad785dfcd8b tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:06.187016 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6fe4d56d-dd79-4374-8466-8ad785dfcd8b tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:06.187450 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6fe4d56d-dd79-4374-8466-8ad785dfcd8b tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:06.207472 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-6fe4d56d-dd79-4374-8466-8ad785dfcd8b tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] HTTP exception thrown: Instance 685d47e4-721e-4eae-b5f8-78fdb68454ae could not be found. Aug 31 16:12:06.209375 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6fe4d56d-dd79-4374-8466-8ad785dfcd8b tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Request method failure captured: Aug 31 16:12:06.209375 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae HTTP/1.1 Aug 31 16:12:06.209375 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:12:06.209375 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:12:06.209375 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:12:06.209375 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:12:06.209375 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:12:06.209375 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:12:06.209375 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:12:06.209375 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:12:06.209375 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4Z8CyjK8UqRhdwHgFOKy2ozAsazp8wPxAyE8O6uvfINAaEAqIDqza_6nhJKxpu8JlJc2Ngykrs-cDot939-ySg5A8AWboNAxxeYabXGrT9Gi9LBTEpDB4-hbItQ0o066sffSwzMNW0DkHVMs9vh-TaIOlOyi0Fnef9PhCG1vuJdYOE Aug 31 16:12:06.209375 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:12:06.209375 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:12:06.209375 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:12:06.209375 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:12:06.209375 n-d-850499-9 devstack@n-api.service[122257]: X-Openstack-Nova-Api-Version: 2.42 Aug 31 16:12:06.209375 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:12:06.209375 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:12:06.209375 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: de3a6577c7c34e8e928dfc1a4172f51c Aug 31 16:12:06.209375 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-89490816 Aug 31 16:12:06.209375 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:12:06.209375 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:12:06.209375 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/de3a6577c7c34e8e928dfc1a4172f51c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/de3a6577c7c34e8e928dfc1a4172f51c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_de3a6577c7c34e8e928dfc1a4172f51c", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/de3a6577c7c34e8e928dfc1a4172f51c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:12:06.209375 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-TaggedBootDevicesTest_v242-89490816 Aug 31 16:12:06.209375 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: de3a6577c7c34e8e928dfc1a4172f51c Aug 31 16:12:06.209375 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-89490816 Aug 31 16:12:06.209375 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-TaggedBootDevicesTest_v242-89490816-project Aug 31 16:12:06.209375 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:12:06.209375 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:12:06.209375 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: ccb8cf5661d641bca73aa56cb8cc334c Aug 31 16:12:06.209375 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-TaggedBootDevicesTest_v242-89490816-project Aug 31 16:12:06.209375 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:12:06.209375 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance 685d47e4-721e-4eae-b5f8-78fdb68454ae could not be found. Aug 31 16:12:06.209375 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '685d47e4-721e-4eae-b5f8-78fdb68454ae'} Aug 31 16:12:06.209375 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:12:06.209375 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:12:06.209375 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:12:06.209375 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:12:06.209375 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:12:06.209375 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:12:06.209375 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:12:06.209375 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:12:06.209375 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:12:06.209375 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:12:06.209375 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 685d47e4-721e-4eae-b5f8-78fdb68454ae could not be found. Aug 31 16:12:06.209375 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:12:06.209375 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:12:06.209375 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:12:06.209375 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:12:06.209375 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:12:06.209375 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:12:06.209375 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:12:06.209375 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:12:06.209375 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:12:06.209375 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:12:06.209375 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:12:06.209375 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:12:06.209375 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:12:06.209375 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:12:06.209375 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:12:06.209375 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:12:06.209375 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 685d47e4-721e-4eae-b5f8-78fdb68454ae could not be found. Aug 31 16:12:06.209375 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:12:06.209375 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:12:06.214039 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:12:06.214039 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:12:06.214039 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:12:06.214039 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:12:06.214039 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:12:06.214039 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:12:06.214039 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 685d47e4-721e-4eae-b5f8-78fdb68454ae could not be found. Aug 31 16:12:06.214039 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:12:06.214039 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6fe4d56d-dd79-4374-8466-8ad785dfcd8b tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] Returning 404 to user: Instance 685d47e4-721e-4eae-b5f8-78fdb68454ae could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:12:06.214039 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6fe4d56d-dd79-4374-8466-8ad785dfcd8b tempest-TaggedBootDevicesTest_v242-89490816 tempest-TaggedBootDevicesTest_v242-89490816-project] 10.222.0.61 "GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae" status: 404 len: 111 microversion: 2.42 time: 0.052547 Aug 31 16:12:06.214039 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1785/3566] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:12:06 2022] GET /compute/v2.1/servers/685d47e4-721e-4eae-b5f8-78fdb68454ae => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:12:06.278260 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-94c516ad-f013-4c78-ab8f-1a75525ad875 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.956691 Aug 31 16:12:06.284563 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1782/3567] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:12:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 958 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:12:06.301062 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-dbef29fd-24cf-4566-a56b-3fc250d24b1e tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:06.308130 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-dbef29fd-24cf-4566-a56b-3fc250d24b1e tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] [instance: af6da672-bcfb-433b-b868-3dd1dd3e4770] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:06.329818 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dbef29fd-24cf-4566-a56b-3fc250d24b1e tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:06.332202 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dbef29fd-24cf-4566-a56b-3fc250d24b1e tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:06.334884 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dbef29fd-24cf-4566-a56b-3fc250d24b1e tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:06.355289 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dbef29fd-24cf-4566-a56b-3fc250d24b1e tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:06.363310 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dbef29fd-24cf-4566-a56b-3fc250d24b1e tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:06.366459 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dbef29fd-24cf-4566-a56b-3fc250d24b1e tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:06.519290 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-dbef29fd-24cf-4566-a56b-3fc250d24b1e tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea74590916f437b9722321f420ca2a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805e39cb57794a138813c776b889741f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:06.536750 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4963a056-3f81-4fec-889e-faa7e1a78f7a tempest-VolumesAdminNegativeTest-18935182 tempest-VolumesAdminNegativeTest-18935182-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "5255a44c-53cc-4a20-a617-30af3bfdb14c"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:12:06.539325 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4963a056-3f81-4fec-889e-faa7e1a78f7a tempest-VolumesAdminNegativeTest-18935182 tempest-VolumesAdminNegativeTest-18935182-project-admin] [instance: eed024b5-986b-40fa-a686-ceab563a6131] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:06.543133 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-dbef29fd-24cf-4566-a56b-3fc250d24b1e tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] 10.222.0.61 "GET /compute/v2.1/servers/af6da672-bcfb-433b-b868-3dd1dd3e4770" status: 200 len: 1282 microversion: 2.1 time: 0.263058 Aug 31 16:12:06.548770 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1783/3568] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:06 2022] GET /compute/v2.1/servers/af6da672-bcfb-433b-b868-3dd1dd3e4770 => generated 1282 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:06.570306 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4963a056-3f81-4fec-889e-faa7e1a78f7a tempest-VolumesAdminNegativeTest-18935182 tempest-VolumesAdminNegativeTest-18935182-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:06.571914 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4963a056-3f81-4fec-889e-faa7e1a78f7a tempest-VolumesAdminNegativeTest-18935182 tempest-VolumesAdminNegativeTest-18935182-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:06.572038 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b68eb13f-c1b0-49cf-91a9-deb32cc44bb9 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:06.572735 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b68eb13f-c1b0-49cf-91a9-deb32cc44bb9 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 8e287ae9-272b-4148-a159-790187f5d8a3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:06.572957 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4963a056-3f81-4fec-889e-faa7e1a78f7a tempest-VolumesAdminNegativeTest-18935182 tempest-VolumesAdminNegativeTest-18935182-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:06.574206 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4963a056-3f81-4fec-889e-faa7e1a78f7a tempest-VolumesAdminNegativeTest-18935182 tempest-VolumesAdminNegativeTest-18935182-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:06.574897 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4963a056-3f81-4fec-889e-faa7e1a78f7a tempest-VolumesAdminNegativeTest-18935182 tempest-VolumesAdminNegativeTest-18935182-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:06.576101 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4963a056-3f81-4fec-889e-faa7e1a78f7a tempest-VolumesAdminNegativeTest-18935182 tempest-VolumesAdminNegativeTest-18935182-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:06.729696 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b68eb13f-c1b0-49cf-91a9-deb32cc44bb9 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:06.737692 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b68eb13f-c1b0-49cf-91a9-deb32cc44bb9 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/8e287ae9-272b-4148-a159-790187f5d8a3" status: 200 len: 1227 microversion: 2.1 time: 0.186333 Aug 31 16:12:06.747294 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1784/3569] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:06 2022] GET /compute/v2.1/servers/8e287ae9-272b-4148-a159-790187f5d8a3 => generated 1227 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:06.754907 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-17f736de-45a2-4a0e-931e-8514562b5a28 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:06.758982 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-17f736de-45a2-4a0e-931e-8514562b5a28 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] [instance: 606f1624-8c53-409e-b06b-ace080f7fc44] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:06.779236 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-17f736de-45a2-4a0e-931e-8514562b5a28 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:06.780270 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-17f736de-45a2-4a0e-931e-8514562b5a28 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:06.780893 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-17f736de-45a2-4a0e-931e-8514562b5a28 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:06.781792 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-17f736de-45a2-4a0e-931e-8514562b5a28 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:06.782423 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-17f736de-45a2-4a0e-931e-8514562b5a28 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:06.783028 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-17f736de-45a2-4a0e-931e-8514562b5a28 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:06.875213 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-4963a056-3f81-4fec-889e-faa7e1a78f7a tempest-VolumesAdminNegativeTest-18935182 tempest-VolumesAdminNegativeTest-18935182-project-admin] HTTP exception thrown: Volume 5255a44c-53cc-4a20-a617-30af3bfdb14c could not be found. Aug 31 16:12:06.904927 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4963a056-3f81-4fec-889e-faa7e1a78f7a tempest-VolumesAdminNegativeTest-18935182 tempest-VolumesAdminNegativeTest-18935182-project-admin] Request method failure captured: Aug 31 16:12:06.904927 n-d-850499-9 devstack@n-api.service[122257]: request: PUT /compute/v2.1/servers/eed024b5-986b-40fa-a686-ceab563a6131/os-volume_attachments/16a789f7-a487-425e-848e-4ae174bafb12 HTTP/1.1 Aug 31 16:12:06.904927 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:12:06.904927 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:12:06.904927 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:12:06.904927 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 74 Aug 31 16:12:06.904927 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:12:06.904927 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:12:06.904927 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:12:06.904927 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:12:06.904927 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4fHPABUZVxy0beiHZUwbmBbZPlkiXN_i2m1Rx1klV-PAoFz4DsX1cdYgn1KjL6G7aDk886eEuDFniOwpF1vl6JaBpyqerCVPaYU_Lw4lGjUy8BsJgjDk8XIkGQHmCzpTYgQOTbMY9UtWI7V2smJYQ3lliwbxPzq_E7AVcG0r9OT7OI Aug 31 16:12:06.904927 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:12:06.904927 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:12:06.904927 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:12:06.904927 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:12:06.904927 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:12:06.904927 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:12:06.904927 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: d17f5af7cbfe432a8340e34c17504cae Aug 31 16:12:06.904927 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-VolumesAdminNegativeTest-18935182 Aug 31 16:12:06.904927 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,admin,member Aug 31 16:12:06.904927 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,admin,member Aug 31 16:12:06.904927 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d17f5af7cbfe432a8340e34c17504cae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/d17f5af7cbfe432a8340e34c17504cae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_d17f5af7cbfe432a8340e34c17504cae", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d17f5af7cbfe432a8340e34c17504cae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:12:06.904927 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-VolumesAdminNegativeTest-18935182 Aug 31 16:12:06.904927 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: d17f5af7cbfe432a8340e34c17504cae Aug 31 16:12:06.904927 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-18935182 Aug 31 16:12:06.904927 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-VolumesAdminNegativeTest-18935182-project-admin Aug 31 16:12:06.904927 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:12:06.904927 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:12:06.904927 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 016693f4f56c4068a63145017c3097b1 Aug 31 16:12:06.904927 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-VolumesAdminNegativeTest-18935182-project-admin Aug 31 16:12:06.904927 n-d-850499-9 devstack@n-api.service[122257]: Aug 31 16:12:06.904927 n-d-850499-9 devstack@n-api.service[122257]: {"volumeAttachment": {"volumeId": "5255a44c-53cc-4a20-a617-30af3bfdb14c"}} Aug 31 16:12:06.904927 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:12:06.904927 n-d-850499-9 devstack@n-api.service[122257]: exception: Volume 5255a44c-53cc-4a20-a617-30af3bfdb14c could not be found. Aug 31 16:12:06.904927 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'server_id': 'eed024b5-986b-40fa-a686-ceab563a6131', 'id': '16a789f7-a487-425e-848e-4ae174bafb12', 'body': {'volumeAttachment': {'volumeId': '5255a44c-53cc-4a20-a617-30af3bfdb14c'}}} Aug 31 16:12:06.904927 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:12:06.904927 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:12:06.904927 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 16:12:06.904927 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 16:12:06.904927 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 16:12:06.904927 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 16:12:06.904927 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 16:12:06.904927 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 16:12:06.904927 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 16:12:06.904927 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 16:12:06.904927 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 16:12:06.904927 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 16:12:06.904927 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 16:12:06.904927 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 16:12:06.904927 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 16:12:06.904927 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 16:12:06.904927 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5255a44c-53cc-4a20-a617-30af3bfdb14c could not be found. (HTTP 404) (Request-ID: req-f0fa3590-03e4-463f-882f-6838066b8a74) Aug 31 16:12:06.904927 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:12:06.904927 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:12:06.904927 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:12:06.904927 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:12:06.904927 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Aug 31 16:12:06.904927 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Aug 31 16:12:06.904927 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 16:12:06.904927 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 16:12:06.904927 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 16:12:06.910969 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 16:12:06.910969 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 16:12:06.910969 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 16:12:06.910969 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 16:12:06.910969 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 16:12:06.910969 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 16:12:06.910969 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 16:12:06.910969 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 16:12:06.910969 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 16:12:06.910969 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 16:12:06.910969 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 16:12:06.910969 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 16:12:06.910969 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 16:12:06.910969 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 16:12:06.910969 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 16:12:06.910969 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 16:12:06.910969 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 16:12:06.910969 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5255a44c-53cc-4a20-a617-30af3bfdb14c could not be found. Aug 31 16:12:06.910969 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:12:06.910969 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:12:06.910969 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:12:06.910969 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:12:06.910969 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:12:06.910969 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:12:06.910969 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:12:06.910969 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:12:06.910969 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:12:06.910969 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:12:06.910969 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:12:06.910969 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:12:06.910969 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:12:06.910969 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:12:06.910969 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Aug 31 16:12:06.910969 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Aug 31 16:12:06.910969 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Aug 31 16:12:06.910969 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 31 16:12:06.910969 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 5255a44c-53cc-4a20-a617-30af3bfdb14c could not be found. Aug 31 16:12:06.910969 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:12:06.910969 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:12:06.910969 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:12:06.910969 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:12:06.910969 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:12:06.910969 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:12:06.910969 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:12:06.910969 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:12:06.910969 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5255a44c-53cc-4a20-a617-30af3bfdb14c could not be found. Aug 31 16:12:06.910969 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:12:06.910969 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4963a056-3f81-4fec-889e-faa7e1a78f7a tempest-VolumesAdminNegativeTest-18935182 tempest-VolumesAdminNegativeTest-18935182-project-admin] Returning 400 to user: Volume 5255a44c-53cc-4a20-a617-30af3bfdb14c could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:12:06.910969 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4963a056-3f81-4fec-889e-faa7e1a78f7a tempest-VolumesAdminNegativeTest-18935182 tempest-VolumesAdminNegativeTest-18935182-project-admin] 10.222.0.61 "PUT /compute/v2.1/servers/eed024b5-986b-40fa-a686-ceab563a6131/os-volume_attachments/16a789f7-a487-425e-848e-4ae174bafb12" status: 400 len: 107 microversion: 2.1 time: 0.691438 Aug 31 16:12:06.910969 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1786/3570] 10.222.0.61 () {60 vars in 1433 bytes} [Wed Aug 31 16:12:06 2022] PUT /compute/v2.1/servers/eed024b5-986b-40fa-a686-ceab563a6131/os-volume_attachments/16a789f7-a487-425e-848e-4ae174bafb12 => generated 107 bytes in 693 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:12:06.920813 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-99edc1d5-0672-4f2d-8827-564e28bae3d5 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:06.920813 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-99edc1d5-0672-4f2d-8827-564e28bae3d5 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] [instance: a2758687-ae57-4655-9f6f-d9363dcd3e26] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:06.948296 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-99edc1d5-0672-4f2d-8827-564e28bae3d5 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:06.950031 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-99edc1d5-0672-4f2d-8827-564e28bae3d5 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:06.951259 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-99edc1d5-0672-4f2d-8827-564e28bae3d5 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:06.953116 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-99edc1d5-0672-4f2d-8827-564e28bae3d5 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:06.955875 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-99edc1d5-0672-4f2d-8827-564e28bae3d5 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:06.960908 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-99edc1d5-0672-4f2d-8827-564e28bae3d5 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:07.274297 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-99edc1d5-0672-4f2d-8827-564e28bae3d5 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c32defec8443468861dbc8d33e3b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780f91ca8c6f461ba347cd2510dceeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:07.292962 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-99edc1d5-0672-4f2d-8827-564e28bae3d5 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c32defec8443468861dbc8d33e3b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780f91ca8c6f461ba347cd2510dceeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:07.308217 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-99edc1d5-0672-4f2d-8827-564e28bae3d5 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c32defec8443468861dbc8d33e3b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780f91ca8c6f461ba347cd2510dceeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:07.309741 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-99edc1d5-0672-4f2d-8827-564e28bae3d5 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] 10.222.0.61 "GET /compute/v2.1/servers/a2758687-ae57-4655-9f6f-d9363dcd3e26" status: 200 len: 1362 microversion: 2.47 time: 0.400773 Aug 31 16:12:07.310811 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1787/3571] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:12:06 2022] GET /compute/v2.1/servers/a2758687-ae57-4655-9f6f-d9363dcd3e26 => generated 1362 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:12:07.323866 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-389661aa-6c53-46b6-ac10-dae79a24912f req-172250db-f7f3-42f3-9131-32463e576466 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa0932e8-1aa4-4d1a-b653-14be35568f3d", "name": "network-vif-plugged", "status": "completed", "tag": "10959604-b4b5-4638-81b1-024cf0563917"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:12:07.357060 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-389661aa-6c53-46b6-ac10-dae79a24912f req-172250db-f7f3-42f3-9131-32463e576466 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:07.357846 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-389661aa-6c53-46b6-ac10-dae79a24912f req-172250db-f7f3-42f3-9131-32463e576466 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:07.358466 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-389661aa-6c53-46b6-ac10-dae79a24912f req-172250db-f7f3-42f3-9131-32463e576466 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:07.392990 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-389661aa-6c53-46b6-ac10-dae79a24912f req-172250db-f7f3-42f3-9131-32463e576466 service nova] Creating event network-vif-plugged:10959604-b4b5-4638-81b1-024cf0563917 for instance fa0932e8-1aa4-4d1a-b653-14be35568f3d on n-h2-850499-9 Aug 31 16:12:07.397913 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-389661aa-6c53-46b6-ac10-dae79a24912f req-172250db-f7f3-42f3-9131-32463e576466 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085469 Aug 31 16:12:07.398733 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1788/3572] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:12:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:12:07.404464 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ce1bf5c0-2a0b-4cb7-8c05-f4a9fd43b416 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:07.405531 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ce1bf5c0-2a0b-4cb7-8c05-f4a9fd43b416 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] [instance: fa0932e8-1aa4-4d1a-b653-14be35568f3d] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:07.413398 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ce1bf5c0-2a0b-4cb7-8c05-f4a9fd43b416 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:07.414122 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ce1bf5c0-2a0b-4cb7-8c05-f4a9fd43b416 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:07.414650 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ce1bf5c0-2a0b-4cb7-8c05-f4a9fd43b416 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:07.415588 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ce1bf5c0-2a0b-4cb7-8c05-f4a9fd43b416 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:07.416346 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ce1bf5c0-2a0b-4cb7-8c05-f4a9fd43b416 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:07.416839 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ce1bf5c0-2a0b-4cb7-8c05-f4a9fd43b416 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:07.423833 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-17f736de-45a2-4a0e-931e-8514562b5a28 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13cabcaa79043bea338128594a6b00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab7f0d889224cefbca55343f3208a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:07.444192 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-17f736de-45a2-4a0e-931e-8514562b5a28 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] 10.222.0.61 "GET /compute/v2.1/servers/606f1624-8c53-409e-b06b-ace080f7fc44" status: 200 len: 1525 microversion: 2.1 time: 0.695459 Aug 31 16:12:07.467111 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1785/3573] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:06 2022] GET /compute/v2.1/servers/606f1624-8c53-409e-b06b-ace080f7fc44 => generated 1525 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:07.482156 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f3b62776-c7ae-4268-af24-e0c715943156 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:07.483639 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f3b62776-c7ae-4268-af24-e0c715943156 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] [instance: eed024b5-986b-40fa-a686-ceab563a6131] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:07.521726 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f3b62776-c7ae-4268-af24-e0c715943156 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:07.523047 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f3b62776-c7ae-4268-af24-e0c715943156 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:07.524880 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f3b62776-c7ae-4268-af24-e0c715943156 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:07.525637 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f3b62776-c7ae-4268-af24-e0c715943156 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:07.532383 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f3b62776-c7ae-4268-af24-e0c715943156 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:07.540268 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f3b62776-c7ae-4268-af24-e0c715943156 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:07.695477 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-f3b62776-c7ae-4268-af24-e0c715943156 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lazy-loading 'services' on Instance uuid eed024b5-986b-40fa-a686-ceab563a6131 {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:12:07.832749 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f3b62776-c7ae-4268-af24-e0c715943156 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] 10.222.0.61 "DELETE /compute/v2.1/servers/eed024b5-986b-40fa-a686-ceab563a6131/os-volume_attachments/16a789f7-a487-425e-848e-4ae174bafb12" status: 202 len: 0 microversion: 2.1 time: 0.364155 Aug 31 16:12:07.834875 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1786/3574] 10.222.0.61 () {58 vars in 1416 bytes} [Wed Aug 31 16:12:07 2022] DELETE /compute/v2.1/servers/eed024b5-986b-40fa-a686-ceab563a6131/os-volume_attachments/16a789f7-a487-425e-848e-4ae174bafb12 => generated 0 bytes in 367 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:12:07.851106 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ce1bf5c0-2a0b-4cb7-8c05-f4a9fd43b416 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:07.853323 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4c37a72b-4ab7-4364-880a-c4fbb28384c6 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:07.854247 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4c37a72b-4ab7-4364-880a-c4fbb28384c6 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] [instance: 596c5ff8-2dc8-4248-be52-eab6df1793e0] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:07.862353 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4c37a72b-4ab7-4364-880a-c4fbb28384c6 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:07.863149 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4c37a72b-4ab7-4364-880a-c4fbb28384c6 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:07.863794 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4c37a72b-4ab7-4364-880a-c4fbb28384c6 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:07.864771 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4c37a72b-4ab7-4364-880a-c4fbb28384c6 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:07.865109 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ce1bf5c0-2a0b-4cb7-8c05-f4a9fd43b416 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:07.865667 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4c37a72b-4ab7-4364-880a-c4fbb28384c6 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:07.866272 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4c37a72b-4ab7-4364-880a-c4fbb28384c6 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:07.867046 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ce1bf5c0-2a0b-4cb7-8c05-f4a9fd43b416 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:07.868556 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ce1bf5c0-2a0b-4cb7-8c05-f4a9fd43b416 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] 10.222.0.61 "GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d" status: 200 len: 1879 microversion: 2.32 time: 0.468342 Aug 31 16:12:07.869335 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1789/3575] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:12:07 2022] GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d => generated 1879 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:12:07.876144 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2947673a-3f44-42b2-aa96-2ceae456291e tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:07.877046 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2947673a-3f44-42b2-aa96-2ceae456291e tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] [instance: af6da672-bcfb-433b-b868-3dd1dd3e4770] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:07.883790 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2947673a-3f44-42b2-aa96-2ceae456291e tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:07.884453 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2947673a-3f44-42b2-aa96-2ceae456291e tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:07.885002 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2947673a-3f44-42b2-aa96-2ceae456291e tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:07.886638 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2947673a-3f44-42b2-aa96-2ceae456291e tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:07.887255 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2947673a-3f44-42b2-aa96-2ceae456291e tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:07.888035 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2947673a-3f44-42b2-aa96-2ceae456291e tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:08.045270 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2947673a-3f44-42b2-aa96-2ceae456291e tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea74590916f437b9722321f420ca2a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805e39cb57794a138813c776b889741f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:08.061354 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2947673a-3f44-42b2-aa96-2ceae456291e tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] 10.222.0.61 "GET /compute/v2.1/servers/af6da672-bcfb-433b-b868-3dd1dd3e4770" status: 200 len: 1282 microversion: 2.1 time: 0.190601 Aug 31 16:12:08.063936 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1790/3576] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:07 2022] GET /compute/v2.1/servers/af6da672-bcfb-433b-b868-3dd1dd3e4770 => generated 1282 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:08.101895 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-cf318d37-12d5-4048-a7e9-753f7c756cfa tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:08.103097 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-cf318d37-12d5-4048-a7e9-753f7c756cfa tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 8e287ae9-272b-4148-a159-790187f5d8a3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:08.110933 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cf318d37-12d5-4048-a7e9-753f7c756cfa tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:08.111745 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cf318d37-12d5-4048-a7e9-753f7c756cfa tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:08.112376 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cf318d37-12d5-4048-a7e9-753f7c756cfa tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:08.113348 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cf318d37-12d5-4048-a7e9-753f7c756cfa tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:08.114075 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cf318d37-12d5-4048-a7e9-753f7c756cfa tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:08.114845 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cf318d37-12d5-4048-a7e9-753f7c756cfa tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:08.207568 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-4c37a72b-4ab7-4364-880a-c4fbb28384c6 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1444fdefda4eaeac9b11577ad7248b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859e7bbce8ed4dea985c73abe3ec8cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:08.216447 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4c37a72b-4ab7-4364-880a-c4fbb28384c6 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] 10.222.0.61 "GET /compute/v2.1/servers/596c5ff8-2dc8-4248-be52-eab6df1793e0" status: 200 len: 1313 microversion: 2.1 time: 0.380285 Aug 31 16:12:08.217338 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1787/3577] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:07 2022] GET /compute/v2.1/servers/596c5ff8-2dc8-4248-be52-eab6df1793e0 => generated 1313 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:08.222634 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-11261770-354f-4f6c-9172-176edd73cc93 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:08.225743 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-11261770-354f-4f6c-9172-176edd73cc93 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] [instance: eed024b5-986b-40fa-a686-ceab563a6131] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:08.234734 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-cf318d37-12d5-4048-a7e9-753f7c756cfa tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:08.236439 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-11261770-354f-4f6c-9172-176edd73cc93 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:08.237289 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-11261770-354f-4f6c-9172-176edd73cc93 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:08.238460 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-11261770-354f-4f6c-9172-176edd73cc93 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:08.239943 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-11261770-354f-4f6c-9172-176edd73cc93 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:08.240813 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-11261770-354f-4f6c-9172-176edd73cc93 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:08.241810 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-11261770-354f-4f6c-9172-176edd73cc93 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:08.243079 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-cf318d37-12d5-4048-a7e9-753f7c756cfa tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/8e287ae9-272b-4148-a159-790187f5d8a3" status: 200 len: 1223 microversion: 2.1 time: 0.156226 Aug 31 16:12:08.250904 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1791/3578] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:08 2022] GET /compute/v2.1/servers/8e287ae9-272b-4148-a159-790187f5d8a3 => generated 1223 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:08.259417 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-482f2c6d-f6fd-486f-9e1e-074504742ea6 req-e6f44b82-d021-4fc1-a9f7-a64766ecaf98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "606f1624-8c53-409e-b06b-ace080f7fc44", "name": "network-vif-deleted", "tag": "bd761e9e-656b-4464-b63f-bb9440ae7e14"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:12:08.282802 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-482f2c6d-f6fd-486f-9e1e-074504742ea6 req-e6f44b82-d021-4fc1-a9f7-a64766ecaf98 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:08.283359 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-482f2c6d-f6fd-486f-9e1e-074504742ea6 req-e6f44b82-d021-4fc1-a9f7-a64766ecaf98 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:08.284002 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-482f2c6d-f6fd-486f-9e1e-074504742ea6 req-e6f44b82-d021-4fc1-a9f7-a64766ecaf98 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:08.310189 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-482f2c6d-f6fd-486f-9e1e-074504742ea6 req-e6f44b82-d021-4fc1-a9f7-a64766ecaf98 service nova] Creating event network-vif-deleted:bd761e9e-656b-4464-b63f-bb9440ae7e14 for instance 606f1624-8c53-409e-b06b-ace080f7fc44 on n-h1-850499-9 Aug 31 16:12:08.318768 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-11261770-354f-4f6c-9172-176edd73cc93 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] 10.222.0.61 "GET /compute/v2.1/servers/eed024b5-986b-40fa-a686-ceab563a6131/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099048 Aug 31 16:12:08.323362 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-482f2c6d-f6fd-486f-9e1e-074504742ea6 req-e6f44b82-d021-4fc1-a9f7-a64766ecaf98 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076002 Aug 31 16:12:08.323362 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1792/3579] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:12:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:12:08.323798 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1788/3580] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 16:12:08 2022] GET /compute/v2.1/servers/eed024b5-986b-40fa-a686-ceab563a6131/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:12:08.339530 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-fd292d38-6c70-481c-b21d-88b8262cd8c3 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:08.340492 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-fd292d38-6c70-481c-b21d-88b8262cd8c3 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] [instance: a2758687-ae57-4655-9f6f-d9363dcd3e26] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:08.347388 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fd292d38-6c70-481c-b21d-88b8262cd8c3 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:08.347920 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fd292d38-6c70-481c-b21d-88b8262cd8c3 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:08.348366 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fd292d38-6c70-481c-b21d-88b8262cd8c3 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:08.349671 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fd292d38-6c70-481c-b21d-88b8262cd8c3 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:08.350270 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fd292d38-6c70-481c-b21d-88b8262cd8c3 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:08.350827 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fd292d38-6c70-481c-b21d-88b8262cd8c3 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:08.466673 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4744af82-8eff-4b55-a2fb-a233c298ce85 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:08.468392 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4744af82-8eff-4b55-a2fb-a233c298ce85 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] [instance: 606f1624-8c53-409e-b06b-ace080f7fc44] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:08.485597 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4744af82-8eff-4b55-a2fb-a233c298ce85 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:08.486135 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4744af82-8eff-4b55-a2fb-a233c298ce85 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:08.486774 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4744af82-8eff-4b55-a2fb-a233c298ce85 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:08.487899 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4744af82-8eff-4b55-a2fb-a233c298ce85 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:08.488533 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4744af82-8eff-4b55-a2fb-a233c298ce85 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:08.489136 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4744af82-8eff-4b55-a2fb-a233c298ce85 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:08.541934 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-fd292d38-6c70-481c-b21d-88b8262cd8c3 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c32defec8443468861dbc8d33e3b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780f91ca8c6f461ba347cd2510dceeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:08.563212 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-fd292d38-6c70-481c-b21d-88b8262cd8c3 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c32defec8443468861dbc8d33e3b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780f91ca8c6f461ba347cd2510dceeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:08.565099 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-fd292d38-6c70-481c-b21d-88b8262cd8c3 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c32defec8443468861dbc8d33e3b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780f91ca8c6f461ba347cd2510dceeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:08.584648 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-fd292d38-6c70-481c-b21d-88b8262cd8c3 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] 10.222.0.61 "GET /compute/v2.1/servers/a2758687-ae57-4655-9f6f-d9363dcd3e26" status: 200 len: 1362 microversion: 2.47 time: 0.243847 Aug 31 16:12:08.585239 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1793/3581] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:12:08 2022] GET /compute/v2.1/servers/a2758687-ae57-4655-9f6f-d9363dcd3e26 => generated 1362 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:12:08.660478 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-4744af82-8eff-4b55-a2fb-a233c298ce85 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13cabcaa79043bea338128594a6b00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab7f0d889224cefbca55343f3208a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:08.670995 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4744af82-8eff-4b55-a2fb-a233c298ce85 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] 10.222.0.61 "GET /compute/v2.1/servers/606f1624-8c53-409e-b06b-ace080f7fc44" status: 200 len: 1483 microversion: 2.1 time: 0.208252 Aug 31 16:12:08.674984 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1789/3582] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:08 2022] GET /compute/v2.1/servers/606f1624-8c53-409e-b06b-ace080f7fc44 => generated 1483 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:12:08.902380 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5d8bdf8d-529d-4f7a-a848-392fe32994ad tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:08.903300 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5d8bdf8d-529d-4f7a-a848-392fe32994ad tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] [instance: fa0932e8-1aa4-4d1a-b653-14be35568f3d] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:08.913778 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5d8bdf8d-529d-4f7a-a848-392fe32994ad tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:08.914287 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5d8bdf8d-529d-4f7a-a848-392fe32994ad tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:08.914730 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5d8bdf8d-529d-4f7a-a848-392fe32994ad tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:08.915467 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5d8bdf8d-529d-4f7a-a848-392fe32994ad tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:08.915980 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5d8bdf8d-529d-4f7a-a848-392fe32994ad tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:08.916418 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5d8bdf8d-529d-4f7a-a848-392fe32994ad tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:09.093027 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-45632cd7-9a4a-4565-876f-eeb123143401 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:09.094009 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-45632cd7-9a4a-4565-876f-eeb123143401 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] [instance: af6da672-bcfb-433b-b868-3dd1dd3e4770] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:09.102756 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-45632cd7-9a4a-4565-876f-eeb123143401 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:09.103297 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-45632cd7-9a4a-4565-876f-eeb123143401 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:09.103783 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-45632cd7-9a4a-4565-876f-eeb123143401 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:09.104487 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-45632cd7-9a4a-4565-876f-eeb123143401 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:09.104950 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-45632cd7-9a4a-4565-876f-eeb123143401 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:09.105391 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-45632cd7-9a4a-4565-876f-eeb123143401 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:09.273399 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5d8bdf8d-529d-4f7a-a848-392fe32994ad tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:09.293402 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5d8bdf8d-529d-4f7a-a848-392fe32994ad tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:09.298842 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5d8bdf8d-529d-4f7a-a848-392fe32994ad tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:09.300934 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5d8bdf8d-529d-4f7a-a848-392fe32994ad tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] 10.222.0.61 "GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d" status: 200 len: 1879 microversion: 2.32 time: 0.407214 Aug 31 16:12:09.321695 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1794/3583] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:12:08 2022] GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d => generated 1879 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:12:09.327760 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a320ac41-bb45-4704-9c6d-406b00e97e3d tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:09.329773 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a320ac41-bb45-4704-9c6d-406b00e97e3d tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] [instance: 596c5ff8-2dc8-4248-be52-eab6df1793e0] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:09.338657 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a320ac41-bb45-4704-9c6d-406b00e97e3d tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:09.339907 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a320ac41-bb45-4704-9c6d-406b00e97e3d tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:09.341378 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a320ac41-bb45-4704-9c6d-406b00e97e3d tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:09.342582 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a320ac41-bb45-4704-9c6d-406b00e97e3d tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:09.343682 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a320ac41-bb45-4704-9c6d-406b00e97e3d tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:09.344353 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a320ac41-bb45-4704-9c6d-406b00e97e3d tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:09.415620 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-45632cd7-9a4a-4565-876f-eeb123143401 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea74590916f437b9722321f420ca2a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805e39cb57794a138813c776b889741f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:09.427681 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-45632cd7-9a4a-4565-876f-eeb123143401 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] 10.222.0.61 "GET /compute/v2.1/servers/af6da672-bcfb-433b-b868-3dd1dd3e4770" status: 200 len: 1350 microversion: 2.1 time: 0.341142 Aug 31 16:12:09.441394 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1790/3584] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:09 2022] GET /compute/v2.1/servers/af6da672-bcfb-433b-b868-3dd1dd3e4770 => generated 1350 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:09.454320 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-168e77a2-0b3b-4128-b7bd-39fd732e647b tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:09.454956 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-168e77a2-0b3b-4128-b7bd-39fd732e647b tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 8e287ae9-272b-4148-a159-790187f5d8a3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:09.470882 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-168e77a2-0b3b-4128-b7bd-39fd732e647b tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:09.472348 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-168e77a2-0b3b-4128-b7bd-39fd732e647b tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:09.473037 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-168e77a2-0b3b-4128-b7bd-39fd732e647b tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:09.474782 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-168e77a2-0b3b-4128-b7bd-39fd732e647b tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:09.476599 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-168e77a2-0b3b-4128-b7bd-39fd732e647b tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:09.477302 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-168e77a2-0b3b-4128-b7bd-39fd732e647b tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:10.166181 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-168e77a2-0b3b-4128-b7bd-39fd732e647b tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:10.175529 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-168e77a2-0b3b-4128-b7bd-39fd732e647b tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/8e287ae9-272b-4148-a159-790187f5d8a3" status: 200 len: 1279 microversion: 2.1 time: 0.730850 Aug 31 16:12:10.180044 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1791/3585] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:09 2022] GET /compute/v2.1/servers/8e287ae9-272b-4148-a159-790187f5d8a3 => generated 1279 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:10.189636 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7cac95e2-21e9-418b-b0e5-d411b4da4263 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:10.196969 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7cac95e2-21e9-418b-b0e5-d411b4da4263 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] [instance: eed024b5-986b-40fa-a686-ceab563a6131] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:10.212309 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7cac95e2-21e9-418b-b0e5-d411b4da4263 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:10.213900 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7cac95e2-21e9-418b-b0e5-d411b4da4263 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:10.214540 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7cac95e2-21e9-418b-b0e5-d411b4da4263 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:10.216382 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7cac95e2-21e9-418b-b0e5-d411b4da4263 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:10.217566 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7cac95e2-21e9-418b-b0e5-d411b4da4263 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:10.219006 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7cac95e2-21e9-418b-b0e5-d411b4da4263 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:10.288910 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7cac95e2-21e9-418b-b0e5-d411b4da4263 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] 10.222.0.61 "GET /compute/v2.1/servers/eed024b5-986b-40fa-a686-ceab563a6131/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107539 Aug 31 16:12:10.299511 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1792/3586] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 16:12:10 2022] GET /compute/v2.1/servers/eed024b5-986b-40fa-a686-ceab563a6131/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:12:10.305641 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-04ca4fe3-4038-4efc-a622-c2a748538c2a req-73d2e924-e5a8-49ec-87ad-17e416e4bf14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa0932e8-1aa4-4d1a-b653-14be35568f3d", "name": "network-vif-plugged", "status": "completed", "tag": "1acb52ee-181f-4844-aa80-9a93a9c9b7ae"}, {"server_uuid": "fa0932e8-1aa4-4d1a-b653-14be35568f3d", "name": "network-vif-plugged", "status": "completed", "tag": "b9b65d25-b9da-474a-88d8-821f34d0be4e"}, {"server_uuid": "fa0932e8-1aa4-4d1a-b653-14be35568f3d", "name": "network-vif-plugged", "status": "completed", "tag": "0f58cd66-acb5-4926-a732-c7608df7b8da"}, {"server_uuid": "fa0932e8-1aa4-4d1a-b653-14be35568f3d", "name": "network-vif-plugged", "status": "completed", "tag": "fd6970db-5a6c-4005-91a0-c09d46e9fd47"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:12:10.316953 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-04ca4fe3-4038-4efc-a622-c2a748538c2a req-73d2e924-e5a8-49ec-87ad-17e416e4bf14 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:10.318322 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-04ca4fe3-4038-4efc-a622-c2a748538c2a req-73d2e924-e5a8-49ec-87ad-17e416e4bf14 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:10.319212 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-04ca4fe3-4038-4efc-a622-c2a748538c2a req-73d2e924-e5a8-49ec-87ad-17e416e4bf14 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:10.336565 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-04ca4fe3-4038-4efc-a622-c2a748538c2a req-73d2e924-e5a8-49ec-87ad-17e416e4bf14 service nova] Creating event network-vif-plugged:1acb52ee-181f-4844-aa80-9a93a9c9b7ae for instance fa0932e8-1aa4-4d1a-b653-14be35568f3d on n-h2-850499-9 Aug 31 16:12:10.337454 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-04ca4fe3-4038-4efc-a622-c2a748538c2a req-73d2e924-e5a8-49ec-87ad-17e416e4bf14 service nova] Creating event network-vif-plugged:b9b65d25-b9da-474a-88d8-821f34d0be4e for instance fa0932e8-1aa4-4d1a-b653-14be35568f3d on n-h2-850499-9 Aug 31 16:12:10.338315 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-04ca4fe3-4038-4efc-a622-c2a748538c2a req-73d2e924-e5a8-49ec-87ad-17e416e4bf14 service nova] Creating event network-vif-plugged:0f58cd66-acb5-4926-a732-c7608df7b8da for instance fa0932e8-1aa4-4d1a-b653-14be35568f3d on n-h2-850499-9 Aug 31 16:12:10.339051 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-04ca4fe3-4038-4efc-a622-c2a748538c2a req-73d2e924-e5a8-49ec-87ad-17e416e4bf14 service nova] Creating event network-vif-plugged:fd6970db-5a6c-4005-91a0-c09d46e9fd47 for instance fa0932e8-1aa4-4d1a-b653-14be35568f3d on n-h2-850499-9 Aug 31 16:12:10.349811 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-04ca4fe3-4038-4efc-a622-c2a748538c2a req-73d2e924-e5a8-49ec-87ad-17e416e4bf14 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.045059 Aug 31 16:12:10.351263 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1793/3587] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:12:10 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:12:10.359683 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-19e2352b-a337-4739-afb0-d17797ead577 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:10.361135 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-19e2352b-a337-4739-afb0-d17797ead577 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] [instance: a2758687-ae57-4655-9f6f-d9363dcd3e26] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:10.370430 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-19e2352b-a337-4739-afb0-d17797ead577 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:10.371376 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-19e2352b-a337-4739-afb0-d17797ead577 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:10.372055 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-19e2352b-a337-4739-afb0-d17797ead577 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:10.372963 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-19e2352b-a337-4739-afb0-d17797ead577 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:10.373591 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-19e2352b-a337-4739-afb0-d17797ead577 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:10.374190 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-19e2352b-a337-4739-afb0-d17797ead577 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:10.462486 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-19e2352b-a337-4739-afb0-d17797ead577 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:10.463319 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-19e2352b-a337-4739-afb0-d17797ead577 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:10.464728 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-19e2352b-a337-4739-afb0-d17797ead577 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:10.465608 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-19e2352b-a337-4739-afb0-d17797ead577 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lazy-loading 'fault' on Instance uuid a2758687-ae57-4655-9f6f-d9363dcd3e26 {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:12:10.472677 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a320ac41-bb45-4704-9c6d-406b00e97e3d tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1444fdefda4eaeac9b11577ad7248b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859e7bbce8ed4dea985c73abe3ec8cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:10.503331 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a320ac41-bb45-4704-9c6d-406b00e97e3d tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] 10.222.0.61 "GET /compute/v2.1/servers/596c5ff8-2dc8-4248-be52-eab6df1793e0" status: 200 len: 1313 microversion: 2.1 time: 1.178287 Aug 31 16:12:10.504197 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1795/3588] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:09 2022] GET /compute/v2.1/servers/596c5ff8-2dc8-4248-be52-eab6df1793e0 => generated 1313 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:10.515140 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-44fc9260-9d2b-4fdc-a599-24ef0ca67793 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:10.527959 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-44fc9260-9d2b-4fdc-a599-24ef0ca67793 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] [instance: 606f1624-8c53-409e-b06b-ace080f7fc44] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:10.555597 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-19e2352b-a337-4739-afb0-d17797ead577 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c32defec8443468861dbc8d33e3b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780f91ca8c6f461ba347cd2510dceeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:10.562991 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-44fc9260-9d2b-4fdc-a599-24ef0ca67793 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:10.567951 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-44fc9260-9d2b-4fdc-a599-24ef0ca67793 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:10.568474 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-44fc9260-9d2b-4fdc-a599-24ef0ca67793 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:10.570697 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-44fc9260-9d2b-4fdc-a599-24ef0ca67793 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:10.573222 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-19e2352b-a337-4739-afb0-d17797ead577 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c32defec8443468861dbc8d33e3b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780f91ca8c6f461ba347cd2510dceeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:10.577171 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-19e2352b-a337-4739-afb0-d17797ead577 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c32defec8443468861dbc8d33e3b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '780f91ca8c6f461ba347cd2510dceeed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:10.577571 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-44fc9260-9d2b-4fdc-a599-24ef0ca67793 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:10.578778 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-44fc9260-9d2b-4fdc-a599-24ef0ca67793 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:10.582794 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-19e2352b-a337-4739-afb0-d17797ead577 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] 10.222.0.61 "GET /compute/v2.1/servers/a2758687-ae57-4655-9f6f-d9363dcd3e26" status: 200 len: 1367 microversion: 2.47 time: 0.228850 Aug 31 16:12:10.588059 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1794/3589] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:12:10 2022] GET /compute/v2.1/servers/a2758687-ae57-4655-9f6f-d9363dcd3e26 => generated 1367 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:12:10.595068 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:12:10.600108 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f7d71466-2af9-4ef9-8263-8c060ba5e385 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:10.602460 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f7d71466-2af9-4ef9-8263-8c060ba5e385 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] [instance: fa0932e8-1aa4-4d1a-b653-14be35568f3d] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:10.617070 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f7d71466-2af9-4ef9-8263-8c060ba5e385 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:10.618882 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f7d71466-2af9-4ef9-8263-8c060ba5e385 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:10.620605 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f7d71466-2af9-4ef9-8263-8c060ba5e385 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:10.622593 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f7d71466-2af9-4ef9-8263-8c060ba5e385 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:10.634944 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f7d71466-2af9-4ef9-8263-8c060ba5e385 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:10.637518 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f7d71466-2af9-4ef9-8263-8c060ba5e385 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:10.678860 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-44fc9260-9d2b-4fdc-a599-24ef0ca67793 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:10.679556 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-44fc9260-9d2b-4fdc-a599-24ef0ca67793 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:10.680098 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-44fc9260-9d2b-4fdc-a599-24ef0ca67793 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:10.680817 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-44fc9260-9d2b-4fdc-a599-24ef0ca67793 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lazy-loading 'fault' on Instance uuid 606f1624-8c53-409e-b06b-ace080f7fc44 {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:12:10.829817 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-44fc9260-9d2b-4fdc-a599-24ef0ca67793 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd13cabcaa79043bea338128594a6b00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab7f0d889224cefbca55343f3208a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:10.850102 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-44fc9260-9d2b-4fdc-a599-24ef0ca67793 tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] 10.222.0.61 "GET /compute/v2.1/servers/606f1624-8c53-409e-b06b-ace080f7fc44" status: 200 len: 1313 microversion: 2.1 time: 0.344697 Aug 31 16:12:10.851572 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1796/3590] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:10 2022] GET /compute/v2.1/servers/606f1624-8c53-409e-b06b-ace080f7fc44 => generated 1313 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:10.858355 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-90502418-a8c1-40b0-9272-7b3651b25d5b tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:10.859300 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-90502418-a8c1-40b0-9272-7b3651b25d5b tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] [instance: af6da672-bcfb-433b-b868-3dd1dd3e4770] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:10.866955 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-90502418-a8c1-40b0-9272-7b3651b25d5b tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:10.867901 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-90502418-a8c1-40b0-9272-7b3651b25d5b tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:10.868635 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-90502418-a8c1-40b0-9272-7b3651b25d5b tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:10.869581 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-90502418-a8c1-40b0-9272-7b3651b25d5b tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:10.870263 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-90502418-a8c1-40b0-9272-7b3651b25d5b tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:10.871120 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-90502418-a8c1-40b0-9272-7b3651b25d5b tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:11.268816 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-90502418-a8c1-40b0-9272-7b3651b25d5b tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea74590916f437b9722321f420ca2a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805e39cb57794a138813c776b889741f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:11.284284 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-90502418-a8c1-40b0-9272-7b3651b25d5b tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] 10.222.0.61 "GET /compute/v2.1/servers/af6da672-bcfb-433b-b868-3dd1dd3e4770" status: 200 len: 1350 microversion: 2.1 time: 0.429816 Aug 31 16:12:11.285743 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1797/3591] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:10 2022] GET /compute/v2.1/servers/af6da672-bcfb-433b-b868-3dd1dd3e4770 => generated 1350 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:11.292132 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f7d71466-2af9-4ef9-8263-8c060ba5e385 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:11.306041 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-a0fe8603-4013-408f-a923-9b3c355ab05c req-5b7d7763-54d0-4a8b-bb6b-411de16de1c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af6da672-bcfb-433b-b868-3dd1dd3e4770", "tag": "aa1f0e1c-7d31-43c6-bd52-1902f678ccdb"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:12:11.313854 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f7d71466-2af9-4ef9-8263-8c060ba5e385 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:11.315325 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f7d71466-2af9-4ef9-8263-8c060ba5e385 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:11.316634 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f7d71466-2af9-4ef9-8263-8c060ba5e385 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] 10.222.0.61 "GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d" status: 200 len: 1879 microversion: 2.32 time: 0.727248 Aug 31 16:12:11.317219 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1795/3592] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:12:10 2022] GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d => generated 1879 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:12:11.337437 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2c8319fb-7b43-484f-a88a-133563ef0b5c tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:11.340583 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2c8319fb-7b43-484f-a88a-133563ef0b5c tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 8e287ae9-272b-4148-a159-790187f5d8a3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:11.351410 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-a0fe8603-4013-408f-a923-9b3c355ab05c req-5b7d7763-54d0-4a8b-bb6b-411de16de1c1 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:11.355121 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2c8319fb-7b43-484f-a88a-133563ef0b5c tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:11.359732 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-a0fe8603-4013-408f-a923-9b3c355ab05c req-5b7d7763-54d0-4a8b-bb6b-411de16de1c1 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:11.360387 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-a0fe8603-4013-408f-a923-9b3c355ab05c req-5b7d7763-54d0-4a8b-bb6b-411de16de1c1 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:11.366459 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2c8319fb-7b43-484f-a88a-133563ef0b5c tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:11.370576 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2c8319fb-7b43-484f-a88a-133563ef0b5c tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:11.372160 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2c8319fb-7b43-484f-a88a-133563ef0b5c tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:11.373046 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2c8319fb-7b43-484f-a88a-133563ef0b5c tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:11.373652 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2c8319fb-7b43-484f-a88a-133563ef0b5c tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:11.395926 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-a0fe8603-4013-408f-a923-9b3c355ab05c req-5b7d7763-54d0-4a8b-bb6b-411de16de1c1 service nova] Creating event network-changed:aa1f0e1c-7d31-43c6-bd52-1902f678ccdb for instance af6da672-bcfb-433b-b868-3dd1dd3e4770 on n-h2-850499-9 Aug 31 16:12:11.418692 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-a0fe8603-4013-408f-a923-9b3c355ab05c req-5b7d7763-54d0-4a8b-bb6b-411de16de1c1 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117318 Aug 31 16:12:11.428235 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1798/3593] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:12:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:12:11.437627 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4e9cfc30-a5c9-48e6-8667-d4832c69c45c tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:11.454190 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4e9cfc30-a5c9-48e6-8667-d4832c69c45c tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] [instance: eed024b5-986b-40fa-a686-ceab563a6131] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:11.478526 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4e9cfc30-a5c9-48e6-8667-d4832c69c45c tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:11.483407 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4e9cfc30-a5c9-48e6-8667-d4832c69c45c tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:11.484151 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4e9cfc30-a5c9-48e6-8667-d4832c69c45c tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:11.491409 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4e9cfc30-a5c9-48e6-8667-d4832c69c45c tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:11.492481 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4e9cfc30-a5c9-48e6-8667-d4832c69c45c tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:11.493284 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4e9cfc30-a5c9-48e6-8667-d4832c69c45c tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:11.515353 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-2c8319fb-7b43-484f-a88a-133563ef0b5c tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:11.525173 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2c8319fb-7b43-484f-a88a-133563ef0b5c tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/8e287ae9-272b-4148-a159-790187f5d8a3" status: 200 len: 1285 microversion: 2.1 time: 0.206712 Aug 31 16:12:11.532442 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1796/3594] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:11 2022] GET /compute/v2.1/servers/8e287ae9-272b-4148-a159-790187f5d8a3 => generated 1285 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:11.537881 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9635f7f8-fe92-4170-9878-6cde54748fce tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:11.544023 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9635f7f8-fe92-4170-9878-6cde54748fce tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] [instance: 596c5ff8-2dc8-4248-be52-eab6df1793e0] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:11.560441 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9635f7f8-fe92-4170-9878-6cde54748fce tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:11.564079 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9635f7f8-fe92-4170-9878-6cde54748fce tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:11.564776 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9635f7f8-fe92-4170-9878-6cde54748fce tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:11.565716 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9635f7f8-fe92-4170-9878-6cde54748fce tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:11.566589 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4e9cfc30-a5c9-48e6-8667-d4832c69c45c tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] 10.222.0.61 "GET /compute/v2.1/servers/eed024b5-986b-40fa-a686-ceab563a6131/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.133251 Aug 31 16:12:11.571619 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9635f7f8-fe92-4170-9878-6cde54748fce tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:11.574592 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9635f7f8-fe92-4170-9878-6cde54748fce tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:11.577217 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1799/3595] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 16:12:11 2022] GET /compute/v2.1/servers/eed024b5-986b-40fa-a686-ceab563a6131/os-volume_attachments => generated 197 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:12:11.614774 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-710f4bb9-cd81-4d7e-a6b3-f9c65dfbb2d2 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:11.615907 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-710f4bb9-cd81-4d7e-a6b3-f9c65dfbb2d2 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] [instance: a2758687-ae57-4655-9f6f-d9363dcd3e26] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:11.623394 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-710f4bb9-cd81-4d7e-a6b3-f9c65dfbb2d2 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:11.628394 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-710f4bb9-cd81-4d7e-a6b3-f9c65dfbb2d2 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:11.629046 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-710f4bb9-cd81-4d7e-a6b3-f9c65dfbb2d2 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:11.634912 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-710f4bb9-cd81-4d7e-a6b3-f9c65dfbb2d2 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:11.635681 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-710f4bb9-cd81-4d7e-a6b3-f9c65dfbb2d2 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:11.636341 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-710f4bb9-cd81-4d7e-a6b3-f9c65dfbb2d2 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:11.660435 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-710f4bb9-cd81-4d7e-a6b3-f9c65dfbb2d2 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] HTTP exception thrown: Instance a2758687-ae57-4655-9f6f-d9363dcd3e26 could not be found. Aug 31 16:12:11.671392 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-710f4bb9-cd81-4d7e-a6b3-f9c65dfbb2d2 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Request method failure captured: Aug 31 16:12:11.671392 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/a2758687-ae57-4655-9f6f-d9363dcd3e26 HTTP/1.1 Aug 31 16:12:11.671392 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:12:11.671392 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:12:11.671392 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:12:11.671392 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:12:11.671392 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:12:11.671392 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:12:11.671392 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:12:11.671392 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:12:11.671392 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4gbd2cgRcb88tRJKGpdlb29V9irubNkYTjYHLn9YajNbTIMBGIg8PQ0b1UBBbJ55Bs6CGmqVK4DPiQ-OmECdS0w7HdiRcl0KIVXR4ZRYZF12ysVg4mu2xTEUkvOjh2Wi7OBA3xLBtuDT_yeDjoZrrNZVzzCr64j40-G4GjXDnL4el0 Aug 31 16:12:11.671392 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:12:11.671392 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:12:11.671392 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:12:11.671392 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:12:11.671392 n-d-850499-9 devstack@n-api.service[122257]: X-Openstack-Nova-Api-Version: 2.47 Aug 31 16:12:11.671392 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:12:11.671392 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:12:11.671392 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 780f91ca8c6f461ba347cd2510dceeed Aug 31 16:12:11.671392 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ServerShowV247Test-716197726 Aug 31 16:12:11.671392 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:12:11.671392 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:12:11.671392 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/780f91ca8c6f461ba347cd2510dceeed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/780f91ca8c6f461ba347cd2510dceeed"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_780f91ca8c6f461ba347cd2510dceeed", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/780f91ca8c6f461ba347cd2510dceeed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:12:11.671392 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ServerShowV247Test-716197726 Aug 31 16:12:11.671392 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 780f91ca8c6f461ba347cd2510dceeed Aug 31 16:12:11.671392 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ServerShowV247Test-716197726 Aug 31 16:12:11.671392 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ServerShowV247Test-716197726-project Aug 31 16:12:11.671392 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:12:11.671392 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:12:11.671392 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 56c32defec8443468861dbc8d33e3b7c Aug 31 16:12:11.671392 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ServerShowV247Test-716197726-project Aug 31 16:12:11.671392 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:12:11.671392 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance a2758687-ae57-4655-9f6f-d9363dcd3e26 could not be found. Aug 31 16:12:11.671392 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': 'a2758687-ae57-4655-9f6f-d9363dcd3e26'} Aug 31 16:12:11.671392 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:12:11.671392 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:12:11.671392 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:12:11.671392 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:12:11.671392 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:12:11.671392 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:12:11.671392 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:12:11.671392 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:12:11.671392 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:12:11.671392 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:12:11.671392 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2758687-ae57-4655-9f6f-d9363dcd3e26 could not be found. Aug 31 16:12:11.671392 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:12:11.671392 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:12:11.671392 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:12:11.671392 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:12:11.671392 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:12:11.671392 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:12:11.671392 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:12:11.671392 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:12:11.671392 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:12:11.671392 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:12:11.671392 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:12:11.671392 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:12:11.671392 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:12:11.671392 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:12:11.671392 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:12:11.671392 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:12:11.671392 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2758687-ae57-4655-9f6f-d9363dcd3e26 could not be found. Aug 31 16:12:11.671392 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:12:11.671392 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:12:11.671392 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:12:11.675548 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:12:11.675548 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:12:11.675548 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:12:11.675548 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:12:11.675548 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:12:11.675548 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2758687-ae57-4655-9f6f-d9363dcd3e26 could not be found. Aug 31 16:12:11.675548 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:12:11.678251 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-710f4bb9-cd81-4d7e-a6b3-f9c65dfbb2d2 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] Returning 404 to user: Instance a2758687-ae57-4655-9f6f-d9363dcd3e26 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:12:11.680546 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-710f4bb9-cd81-4d7e-a6b3-f9c65dfbb2d2 tempest-ServerShowV247Test-716197726 tempest-ServerShowV247Test-716197726-project] 10.222.0.61 "GET /compute/v2.1/servers/a2758687-ae57-4655-9f6f-d9363dcd3e26" status: 404 len: 111 microversion: 2.47 time: 0.070178 Aug 31 16:12:11.685007 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1800/3596] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:12:11 2022] GET /compute/v2.1/servers/a2758687-ae57-4655-9f6f-d9363dcd3e26 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:12:11.888048 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-59824a24-a3bf-4855-871a-b71fe250e41f tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:11.890272 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-59824a24-a3bf-4855-871a-b71fe250e41f tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] [instance: 606f1624-8c53-409e-b06b-ace080f7fc44] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:11.907541 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-59824a24-a3bf-4855-871a-b71fe250e41f tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:11.915289 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-59824a24-a3bf-4855-871a-b71fe250e41f tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:11.916382 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-59824a24-a3bf-4855-871a-b71fe250e41f tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:11.917757 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-59824a24-a3bf-4855-871a-b71fe250e41f tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:11.918593 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-59824a24-a3bf-4855-871a-b71fe250e41f tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:11.921731 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-59824a24-a3bf-4855-871a-b71fe250e41f tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:11.985245 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-59824a24-a3bf-4855-871a-b71fe250e41f tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] HTTP exception thrown: Instance 606f1624-8c53-409e-b06b-ace080f7fc44 could not be found. Aug 31 16:12:11.997468 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-59824a24-a3bf-4855-871a-b71fe250e41f tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Request method failure captured: Aug 31 16:12:11.997468 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/606f1624-8c53-409e-b06b-ace080f7fc44 HTTP/1.1 Aug 31 16:12:11.997468 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:12:11.997468 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:12:11.997468 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:12:11.997468 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:12:11.997468 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:12:11.997468 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:12:11.997468 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:12:11.997468 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:12:11.997468 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4fsKyN6baYRkKZFdkFawvt-fGsSIPYso-zL9k4if2ZEVbk1i96HvHSfcgWmzzyXd9tGvrvveBymxe9E8ZXpgksDtVOINDra1gXJqNgSp6a7cek_PkdyatZirH0_JTfxRV_xZn0asOjTaFXuYk_-Aj-azwU3vocTevjKBZKpL5Avosw Aug 31 16:12:11.997468 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:12:11.997468 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:12:11.997468 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:12:11.997468 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:12:11.997468 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:12:11.997468 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:12:11.997468 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: eab7f0d889224cefbca55343f3208a86 Aug 31 16:12:11.997468 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1010837413 Aug 31 16:12:11.997468 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:12:11.997468 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:12:11.997468 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/eab7f0d889224cefbca55343f3208a86"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/eab7f0d889224cefbca55343f3208a86"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_eab7f0d889224cefbca55343f3208a86", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/eab7f0d889224cefbca55343f3208a86"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:12:11.997468 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1010837413 Aug 31 16:12:11.997468 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: eab7f0d889224cefbca55343f3208a86 Aug 31 16:12:11.997468 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1010837413 Aug 31 16:12:11.997468 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-FloatingIPsAssociationTestJSON-1010837413-project Aug 31 16:12:11.997468 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:12:11.997468 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:12:11.997468 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: d13cabcaa79043bea338128594a6b00a Aug 31 16:12:11.997468 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1010837413-project Aug 31 16:12:11.997468 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:12:11.997468 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance 606f1624-8c53-409e-b06b-ace080f7fc44 could not be found. Aug 31 16:12:11.997468 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '606f1624-8c53-409e-b06b-ace080f7fc44'} Aug 31 16:12:11.997468 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:12:11.997468 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:12:11.997468 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:12:11.997468 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:12:11.997468 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:12:11.997468 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:12:11.997468 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:12:11.997468 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:12:11.997468 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:12:11.997468 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:12:11.997468 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 606f1624-8c53-409e-b06b-ace080f7fc44 could not be found. Aug 31 16:12:11.997468 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:12:11.997468 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:12:11.997468 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:12:11.997468 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:12:11.997468 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:12:11.997468 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:12:11.997468 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:12:11.997468 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:12:11.997468 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:12:11.997468 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:12:11.997468 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:12:11.997468 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:12:11.997468 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:12:11.997468 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:12:11.997468 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:12:11.997468 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:12:11.997468 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 606f1624-8c53-409e-b06b-ace080f7fc44 could not be found. Aug 31 16:12:11.997468 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:12:11.997468 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:12:12.001868 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:12:12.001868 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:12:12.001868 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:12:12.001868 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:12:12.001868 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:12:12.001868 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:12:12.001868 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 606f1624-8c53-409e-b06b-ace080f7fc44 could not be found. Aug 31 16:12:12.001868 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:12:12.002827 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-9635f7f8-fe92-4170-9878-6cde54748fce tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1444fdefda4eaeac9b11577ad7248b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859e7bbce8ed4dea985c73abe3ec8cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:12.009662 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-59824a24-a3bf-4855-871a-b71fe250e41f tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] Returning 404 to user: Instance 606f1624-8c53-409e-b06b-ace080f7fc44 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:12:12.010798 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-59824a24-a3bf-4855-871a-b71fe250e41f tempest-FloatingIPsAssociationTestJSON-1010837413 tempest-FloatingIPsAssociationTestJSON-1010837413-project] 10.222.0.61 "GET /compute/v2.1/servers/606f1624-8c53-409e-b06b-ace080f7fc44" status: 404 len: 111 microversion: 2.1 time: 0.139151 Aug 31 16:12:12.017511 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1801/3597] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:11 2022] GET /compute/v2.1/servers/606f1624-8c53-409e-b06b-ace080f7fc44 => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:12:12.026570 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9635f7f8-fe92-4170-9878-6cde54748fce tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] 10.222.0.61 "GET /compute/v2.1/servers/596c5ff8-2dc8-4248-be52-eab6df1793e0" status: 200 len: 1313 microversion: 2.1 time: 0.488911 Aug 31 16:12:12.030104 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1797/3598] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:11 2022] GET /compute/v2.1/servers/596c5ff8-2dc8-4248-be52-eab6df1793e0 => generated 1313 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:12.308351 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-be274fc5-a4b1-4fb0-b7d5-09d1e71b7da1 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:12.309944 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-be274fc5-a4b1-4fb0-b7d5-09d1e71b7da1 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] [instance: af6da672-bcfb-433b-b868-3dd1dd3e4770] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:12.327241 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-be274fc5-a4b1-4fb0-b7d5-09d1e71b7da1 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:12.333560 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-be274fc5-a4b1-4fb0-b7d5-09d1e71b7da1 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:12.368774 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ad51b7f1-d375-4ba6-867f-1a91e223c511 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:12.371006 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ad51b7f1-d375-4ba6-867f-1a91e223c511 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] [instance: fa0932e8-1aa4-4d1a-b653-14be35568f3d] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:12.378299 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-be274fc5-a4b1-4fb0-b7d5-09d1e71b7da1 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.044s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:12.386229 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-be274fc5-a4b1-4fb0-b7d5-09d1e71b7da1 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:12.386735 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-be274fc5-a4b1-4fb0-b7d5-09d1e71b7da1 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:12.398733 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-be274fc5-a4b1-4fb0-b7d5-09d1e71b7da1 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:12.405454 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ad51b7f1-d375-4ba6-867f-1a91e223c511 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:12.413224 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ad51b7f1-d375-4ba6-867f-1a91e223c511 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:12.415000 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ad51b7f1-d375-4ba6-867f-1a91e223c511 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:12.429814 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ad51b7f1-d375-4ba6-867f-1a91e223c511 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:12.430808 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ad51b7f1-d375-4ba6-867f-1a91e223c511 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:12.435331 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ad51b7f1-d375-4ba6-867f-1a91e223c511 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:12.872866 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ad51b7f1-d375-4ba6-867f-1a91e223c511 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:12.876081 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:12:12.886207 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ad51b7f1-d375-4ba6-867f-1a91e223c511 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:12.894736 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ad51b7f1-d375-4ba6-867f-1a91e223c511 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:12.898530 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ad51b7f1-d375-4ba6-867f-1a91e223c511 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] 10.222.0.61 "GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d" status: 200 len: 1879 microversion: 2.32 time: 0.556493 Aug 31 16:12:12.900043 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1798/3599] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:12:12 2022] GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d => generated 1879 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:12:12.905122 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-fdf1c3e0-6de1-4618-9224-35d31be62b10 req-0a44bf90-94ef-4b33-bcf0-2dd2ba3e6ccf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa0932e8-1aa4-4d1a-b653-14be35568f3d", "name": "network-vif-plugged", "status": "completed", "tag": "4a18af29-4324-4844-bf75-25dcac3740f5"}, {"server_uuid": "fa0932e8-1aa4-4d1a-b653-14be35568f3d", "name": "network-vif-plugged", "status": "completed", "tag": "887de267-2677-4f4b-8c82-d09ad6ad6fde"}, {"server_uuid": "596c5ff8-2dc8-4248-be52-eab6df1793e0", "name": "network-vif-plugged", "status": "completed", "tag": "293f95ee-1eeb-4199-8e23-db11698e1449"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:12:12.918332 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-fdf1c3e0-6de1-4618-9224-35d31be62b10 req-0a44bf90-94ef-4b33-bcf0-2dd2ba3e6ccf service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:12.919192 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-fdf1c3e0-6de1-4618-9224-35d31be62b10 req-0a44bf90-94ef-4b33-bcf0-2dd2ba3e6ccf service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:12.920430 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-fdf1c3e0-6de1-4618-9224-35d31be62b10 req-0a44bf90-94ef-4b33-bcf0-2dd2ba3e6ccf service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:12.940382 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-fdf1c3e0-6de1-4618-9224-35d31be62b10 req-0a44bf90-94ef-4b33-bcf0-2dd2ba3e6ccf service nova] Creating event network-vif-plugged:4a18af29-4324-4844-bf75-25dcac3740f5 for instance fa0932e8-1aa4-4d1a-b653-14be35568f3d on n-h2-850499-9 Aug 31 16:12:12.941068 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-fdf1c3e0-6de1-4618-9224-35d31be62b10 req-0a44bf90-94ef-4b33-bcf0-2dd2ba3e6ccf service nova] Creating event network-vif-plugged:887de267-2677-4f4b-8c82-d09ad6ad6fde for instance fa0932e8-1aa4-4d1a-b653-14be35568f3d on n-h2-850499-9 Aug 31 16:12:12.941769 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-fdf1c3e0-6de1-4618-9224-35d31be62b10 req-0a44bf90-94ef-4b33-bcf0-2dd2ba3e6ccf service nova] Creating event network-vif-plugged:293f95ee-1eeb-4199-8e23-db11698e1449 for instance 596c5ff8-2dc8-4248-be52-eab6df1793e0 on n-h2-850499-9 Aug 31 16:12:12.951119 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-fdf1c3e0-6de1-4618-9224-35d31be62b10 req-0a44bf90-94ef-4b33-bcf0-2dd2ba3e6ccf service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.049556 Aug 31 16:12:12.952719 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1799/3600] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:12:12 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:12:12.961153 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-17e23cbc-9db0-434a-8105-e8d951827ea8 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:12.962286 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-17e23cbc-9db0-434a-8105-e8d951827ea8 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 8e287ae9-272b-4148-a159-790187f5d8a3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:12.970028 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-17e23cbc-9db0-434a-8105-e8d951827ea8 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:12.970868 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-17e23cbc-9db0-434a-8105-e8d951827ea8 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:12.971579 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-17e23cbc-9db0-434a-8105-e8d951827ea8 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:12.972512 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-17e23cbc-9db0-434a-8105-e8d951827ea8 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:12.973188 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-17e23cbc-9db0-434a-8105-e8d951827ea8 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:12.974377 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-17e23cbc-9db0-434a-8105-e8d951827ea8 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:13.175689 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-be274fc5-a4b1-4fb0-b7d5-09d1e71b7da1 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea74590916f437b9722321f420ca2a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805e39cb57794a138813c776b889741f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:13.192896 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-be274fc5-a4b1-4fb0-b7d5-09d1e71b7da1 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] 10.222.0.61 "GET /compute/v2.1/servers/af6da672-bcfb-433b-b868-3dd1dd3e4770" status: 200 len: 1350 microversion: 2.1 time: 0.889602 Aug 31 16:12:13.195351 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1802/3601] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:12 2022] GET /compute/v2.1/servers/af6da672-bcfb-433b-b868-3dd1dd3e4770 => generated 1350 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:13.208810 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e0305979-ba47-4eaa-ba57-ee86179c6bd8 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:13.212842 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e0305979-ba47-4eaa-ba57-ee86179c6bd8 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] [instance: eed024b5-986b-40fa-a686-ceab563a6131] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:13.225617 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e0305979-ba47-4eaa-ba57-ee86179c6bd8 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:13.231233 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e0305979-ba47-4eaa-ba57-ee86179c6bd8 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:13.235258 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e0305979-ba47-4eaa-ba57-ee86179c6bd8 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:13.236286 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e0305979-ba47-4eaa-ba57-ee86179c6bd8 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:13.237660 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e0305979-ba47-4eaa-ba57-ee86179c6bd8 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:13.248521 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e0305979-ba47-4eaa-ba57-ee86179c6bd8 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:13.307989 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e0305979-ba47-4eaa-ba57-ee86179c6bd8 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] 10.222.0.61 "GET /compute/v2.1/servers/eed024b5-986b-40fa-a686-ceab563a6131/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.111385 Aug 31 16:12:13.312446 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1803/3602] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 16:12:13 2022] GET /compute/v2.1/servers/eed024b5-986b-40fa-a686-ceab563a6131/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:12:13.326223 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-6eec7353-3531-43fd-9a38-8668093c4241 req-e9951033-aa69-457e-bc18-ea5e0c0385da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e287ae9-272b-4148-a159-790187f5d8a3", "tag": "c37204c6-352c-4ad3-ba7a-072c6bbd57ef"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:12:13.357724 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-6eec7353-3531-43fd-9a38-8668093c4241 req-e9951033-aa69-457e-bc18-ea5e0c0385da service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:13.358544 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-6eec7353-3531-43fd-9a38-8668093c4241 req-e9951033-aa69-457e-bc18-ea5e0c0385da service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:13.359173 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-6eec7353-3531-43fd-9a38-8668093c4241 req-e9951033-aa69-457e-bc18-ea5e0c0385da service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:13.374532 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-6eec7353-3531-43fd-9a38-8668093c4241 req-e9951033-aa69-457e-bc18-ea5e0c0385da service nova] Creating event network-changed:c37204c6-352c-4ad3-ba7a-072c6bbd57ef for instance 8e287ae9-272b-4148-a159-790187f5d8a3 on n-h1-850499-9 Aug 31 16:12:13.380140 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-6eec7353-3531-43fd-9a38-8668093c4241 req-e9951033-aa69-457e-bc18-ea5e0c0385da service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067280 Aug 31 16:12:13.381505 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1804/3603] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:12:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:12:13.387431 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0faa7b46-6b98-4559-9575-bbd9da1bb91c tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:13.396180 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0faa7b46-6b98-4559-9575-bbd9da1bb91c tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] [instance: 596c5ff8-2dc8-4248-be52-eab6df1793e0] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:13.406899 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0faa7b46-6b98-4559-9575-bbd9da1bb91c tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:13.407878 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0faa7b46-6b98-4559-9575-bbd9da1bb91c tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:13.408440 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0faa7b46-6b98-4559-9575-bbd9da1bb91c tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:13.409226 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0faa7b46-6b98-4559-9575-bbd9da1bb91c tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:13.409967 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0faa7b46-6b98-4559-9575-bbd9da1bb91c tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:13.410462 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0faa7b46-6b98-4559-9575-bbd9da1bb91c tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:13.670050 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-17e23cbc-9db0-434a-8105-e8d951827ea8 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:13.678920 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-17e23cbc-9db0-434a-8105-e8d951827ea8 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/8e287ae9-272b-4148-a159-790187f5d8a3" status: 200 len: 1327 microversion: 2.1 time: 0.724704 Aug 31 16:12:13.679789 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1800/3604] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:12 2022] GET /compute/v2.1/servers/8e287ae9-272b-4148-a159-790187f5d8a3 => generated 1327 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:13.767646 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0faa7b46-6b98-4559-9575-bbd9da1bb91c tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1444fdefda4eaeac9b11577ad7248b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859e7bbce8ed4dea985c73abe3ec8cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:13.777766 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0faa7b46-6b98-4559-9575-bbd9da1bb91c tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] 10.222.0.61 "GET /compute/v2.1/servers/596c5ff8-2dc8-4248-be52-eab6df1793e0" status: 200 len: 1313 microversion: 2.1 time: 0.394974 Aug 31 16:12:13.783584 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1805/3605] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:13 2022] GET /compute/v2.1/servers/596c5ff8-2dc8-4248-be52-eab6df1793e0 => generated 1313 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:13.927401 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-50a140d8-b411-48bc-943e-f7fdac329f19 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:13.928069 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-50a140d8-b411-48bc-943e-f7fdac329f19 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] [instance: fa0932e8-1aa4-4d1a-b653-14be35568f3d] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:13.939196 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-50a140d8-b411-48bc-943e-f7fdac329f19 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:13.940160 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-50a140d8-b411-48bc-943e-f7fdac329f19 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:13.940838 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-50a140d8-b411-48bc-943e-f7fdac329f19 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:13.942486 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-50a140d8-b411-48bc-943e-f7fdac329f19 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:13.944102 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-50a140d8-b411-48bc-943e-f7fdac329f19 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:13.945813 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-50a140d8-b411-48bc-943e-f7fdac329f19 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:14.216933 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=4 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:12:14.217619 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=8 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:12:14.221961 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-585e96cc-bdcb-49a7-9e91-365d716333d8 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:14.222805 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-585e96cc-bdcb-49a7-9e91-365d716333d8 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] [instance: af6da672-bcfb-433b-b868-3dd1dd3e4770] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:14.230483 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-585e96cc-bdcb-49a7-9e91-365d716333d8 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:14.231239 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-585e96cc-bdcb-49a7-9e91-365d716333d8 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:14.231872 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-585e96cc-bdcb-49a7-9e91-365d716333d8 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:14.232920 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-585e96cc-bdcb-49a7-9e91-365d716333d8 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:14.233550 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-50a140d8-b411-48bc-943e-f7fdac329f19 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:14.233695 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-585e96cc-bdcb-49a7-9e91-365d716333d8 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:14.234264 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-585e96cc-bdcb-49a7-9e91-365d716333d8 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:14.273663 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-50a140d8-b411-48bc-943e-f7fdac329f19 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:14.280050 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-50a140d8-b411-48bc-943e-f7fdac329f19 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:14.283328 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-50a140d8-b411-48bc-943e-f7fdac329f19 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] 10.222.0.61 "GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d" status: 200 len: 1879 microversion: 2.32 time: 0.359621 Aug 31 16:12:14.289874 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1801/3606] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:12:13 2022] GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d => generated 1879 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:12:14.329177 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-30a88611-10de-4a4c-ae23-04fe50bae4f9 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:14.334384 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-30a88611-10de-4a4c-ae23-04fe50bae4f9 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] [instance: eed024b5-986b-40fa-a686-ceab563a6131] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:14.342622 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-30a88611-10de-4a4c-ae23-04fe50bae4f9 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:14.344233 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-30a88611-10de-4a4c-ae23-04fe50bae4f9 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:14.344483 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-30a88611-10de-4a4c-ae23-04fe50bae4f9 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:14.346169 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-30a88611-10de-4a4c-ae23-04fe50bae4f9 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:14.346699 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-30a88611-10de-4a4c-ae23-04fe50bae4f9 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:14.347394 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-30a88611-10de-4a4c-ae23-04fe50bae4f9 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:14.393830 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-30a88611-10de-4a4c-ae23-04fe50bae4f9 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] 10.222.0.61 "GET /compute/v2.1/servers/eed024b5-986b-40fa-a686-ceab563a6131/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077430 Aug 31 16:12:14.395080 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1802/3607] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 16:12:14 2022] GET /compute/v2.1/servers/eed024b5-986b-40fa-a686-ceab563a6131/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:12:14.580665 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-585e96cc-bdcb-49a7-9e91-365d716333d8 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea74590916f437b9722321f420ca2a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805e39cb57794a138813c776b889741f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:14.599748 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-585e96cc-bdcb-49a7-9e91-365d716333d8 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] 10.222.0.61 "GET /compute/v2.1/servers/af6da672-bcfb-433b-b868-3dd1dd3e4770" status: 200 len: 1350 microversion: 2.1 time: 0.383064 Aug 31 16:12:14.602032 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1806/3608] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:14 2022] GET /compute/v2.1/servers/af6da672-bcfb-433b-b868-3dd1dd3e4770 => generated 1350 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:12:14.701426 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d5596541-3c09-4243-83b7-5ec687d5c6ed tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:14.702034 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d5596541-3c09-4243-83b7-5ec687d5c6ed tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 8e287ae9-272b-4148-a159-790187f5d8a3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:14.712296 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:12:14.714216 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d5596541-3c09-4243-83b7-5ec687d5c6ed tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:14.715204 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d5596541-3c09-4243-83b7-5ec687d5c6ed tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:14.715849 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d5596541-3c09-4243-83b7-5ec687d5c6ed tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:14.716744 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d5596541-3c09-4243-83b7-5ec687d5c6ed tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:14.717394 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d5596541-3c09-4243-83b7-5ec687d5c6ed tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:14.717976 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d5596541-3c09-4243-83b7-5ec687d5c6ed tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:14.800123 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f38861bd-5243-4d72-8888-cb1a68ffedd9 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:14.800856 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f38861bd-5243-4d72-8888-cb1a68ffedd9 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] [instance: 596c5ff8-2dc8-4248-be52-eab6df1793e0] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:14.809859 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f38861bd-5243-4d72-8888-cb1a68ffedd9 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:14.810499 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f38861bd-5243-4d72-8888-cb1a68ffedd9 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:14.811079 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f38861bd-5243-4d72-8888-cb1a68ffedd9 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:14.812975 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f38861bd-5243-4d72-8888-cb1a68ffedd9 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:14.813528 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f38861bd-5243-4d72-8888-cb1a68ffedd9 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:14.814180 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f38861bd-5243-4d72-8888-cb1a68ffedd9 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:15.038519 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d5596541-3c09-4243-83b7-5ec687d5c6ed tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:15.054026 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d5596541-3c09-4243-83b7-5ec687d5c6ed tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/8e287ae9-272b-4148-a159-790187f5d8a3" status: 200 len: 1327 microversion: 2.1 time: 0.356269 Aug 31 16:12:15.056437 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1803/3609] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:14 2022] GET /compute/v2.1/servers/8e287ae9-272b-4148-a159-790187f5d8a3 => generated 1327 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:15.122874 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f38861bd-5243-4d72-8888-cb1a68ffedd9 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1444fdefda4eaeac9b11577ad7248b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859e7bbce8ed4dea985c73abe3ec8cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:15.131666 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f38861bd-5243-4d72-8888-cb1a68ffedd9 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] 10.222.0.61 "GET /compute/v2.1/servers/596c5ff8-2dc8-4248-be52-eab6df1793e0" status: 200 len: 1313 microversion: 2.1 time: 0.335213 Aug 31 16:12:15.132570 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1807/3610] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:14 2022] GET /compute/v2.1/servers/596c5ff8-2dc8-4248-be52-eab6df1793e0 => generated 1313 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:12:15.307460 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5755f235-863b-465a-b772-fab2a04f6f36 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:15.308398 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5755f235-863b-465a-b772-fab2a04f6f36 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] [instance: fa0932e8-1aa4-4d1a-b653-14be35568f3d] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:15.322573 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5755f235-863b-465a-b772-fab2a04f6f36 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:15.323082 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5755f235-863b-465a-b772-fab2a04f6f36 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:15.323550 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5755f235-863b-465a-b772-fab2a04f6f36 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:15.324333 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5755f235-863b-465a-b772-fab2a04f6f36 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:15.324799 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5755f235-863b-465a-b772-fab2a04f6f36 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:15.325399 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5755f235-863b-465a-b772-fab2a04f6f36 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:15.408004 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-32d6e622-6e1e-4efc-b512-c3471bcba0a0 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:15.412023 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-32d6e622-6e1e-4efc-b512-c3471bcba0a0 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] [instance: eed024b5-986b-40fa-a686-ceab563a6131] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:15.432509 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-32d6e622-6e1e-4efc-b512-c3471bcba0a0 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:15.434303 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-32d6e622-6e1e-4efc-b512-c3471bcba0a0 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:15.435983 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-32d6e622-6e1e-4efc-b512-c3471bcba0a0 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:15.436905 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-32d6e622-6e1e-4efc-b512-c3471bcba0a0 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:15.438609 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-32d6e622-6e1e-4efc-b512-c3471bcba0a0 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:15.441096 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-32d6e622-6e1e-4efc-b512-c3471bcba0a0 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:15.522966 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-32d6e622-6e1e-4efc-b512-c3471bcba0a0 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] 10.222.0.61 "GET /compute/v2.1/servers/eed024b5-986b-40fa-a686-ceab563a6131/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.116014 Aug 31 16:12:15.525527 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1808/3611] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 16:12:15 2022] GET /compute/v2.1/servers/eed024b5-986b-40fa-a686-ceab563a6131/os-volume_attachments => generated 197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:12:15.626247 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1fe578b5-7bc4-4e91-9275-d55f1ef1d0f2 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:15.627145 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1fe578b5-7bc4-4e91-9275-d55f1ef1d0f2 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] [instance: af6da672-bcfb-433b-b868-3dd1dd3e4770] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:15.637634 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1fe578b5-7bc4-4e91-9275-d55f1ef1d0f2 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:15.638430 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1fe578b5-7bc4-4e91-9275-d55f1ef1d0f2 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:15.639056 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1fe578b5-7bc4-4e91-9275-d55f1ef1d0f2 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:15.639969 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1fe578b5-7bc4-4e91-9275-d55f1ef1d0f2 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:15.640619 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1fe578b5-7bc4-4e91-9275-d55f1ef1d0f2 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:15.641217 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1fe578b5-7bc4-4e91-9275-d55f1ef1d0f2 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:16.101977 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:12:16.737157 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=18 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:12:16.851265 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5755f235-863b-465a-b772-fab2a04f6f36 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:16.865069 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5755f235-863b-465a-b772-fab2a04f6f36 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:16.873305 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5755f235-863b-465a-b772-fab2a04f6f36 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:16.879369 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5755f235-863b-465a-b772-fab2a04f6f36 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] 10.222.0.61 "GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d" status: 200 len: 1879 microversion: 2.32 time: 1.575249 Aug 31 16:12:16.883278 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1804/3612] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:12:15 2022] GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d => generated 1879 bytes in 1582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:12:16.910002 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-1fe578b5-7bc4-4e91-9275-d55f1ef1d0f2 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea74590916f437b9722321f420ca2a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805e39cb57794a138813c776b889741f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:16.924912 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1fe578b5-7bc4-4e91-9275-d55f1ef1d0f2 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] 10.222.0.61 "GET /compute/v2.1/servers/af6da672-bcfb-433b-b868-3dd1dd3e4770" status: 200 len: 1350 microversion: 2.1 time: 1.303733 Aug 31 16:12:16.929249 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1809/3613] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:15 2022] GET /compute/v2.1/servers/af6da672-bcfb-433b-b868-3dd1dd3e4770 => generated 1350 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:12:16.936428 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-035e7e68-9a76-4246-a583-bb36afc6fe39 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:16.938525 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-035e7e68-9a76-4246-a583-bb36afc6fe39 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 8e287ae9-272b-4148-a159-790187f5d8a3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:16.951876 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-035e7e68-9a76-4246-a583-bb36afc6fe39 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:16.953348 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-035e7e68-9a76-4246-a583-bb36afc6fe39 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:16.956142 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-035e7e68-9a76-4246-a583-bb36afc6fe39 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:16.969322 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-035e7e68-9a76-4246-a583-bb36afc6fe39 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:16.970269 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-035e7e68-9a76-4246-a583-bb36afc6fe39 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:16.977627 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-035e7e68-9a76-4246-a583-bb36afc6fe39 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:17.118441 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f7297c7c-6cce-4b05-b52f-a04b1c2e7c29 tempest-ComputeTenantNetworksTest-1963382553 tempest-ComputeTenantNetworksTest-1963382553-project] Calling method '.version_select at 0x7f5aed2c88b0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:17.458759 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-035e7e68-9a76-4246-a583-bb36afc6fe39 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:17.467273 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-035e7e68-9a76-4246-a583-bb36afc6fe39 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/8e287ae9-272b-4148-a159-790187f5d8a3" status: 200 len: 1327 microversion: 2.1 time: 0.536456 Aug 31 16:12:17.468613 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1810/3614] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:16 2022] GET /compute/v2.1/servers/8e287ae9-272b-4148-a159-790187f5d8a3 => generated 1327 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:17.488022 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-564ac1a8-eb6d-4ff3-9a97-20ef8e84ec40 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:17.488734 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-564ac1a8-eb6d-4ff3-9a97-20ef8e84ec40 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] [instance: 596c5ff8-2dc8-4248-be52-eab6df1793e0] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:17.493395 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f7297c7c-6cce-4b05-b52f-a04b1c2e7c29 tempest-ComputeTenantNetworksTest-1963382553 tempest-ComputeTenantNetworksTest-1963382553-project] 10.222.0.61 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 308 microversion: 2.1 time: 0.607106 Aug 31 16:12:17.494293 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1805/3615] 10.222.0.61 () {58 vars in 1158 bytes} [Wed Aug 31 16:12:16 2022] GET /compute/v2.1/os-tenant-networks => generated 308 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:12:17.499061 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ee929869-5745-4b9b-a72a-042c22c2a1fd tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:17.501354 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ee929869-5745-4b9b-a72a-042c22c2a1fd tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] [instance: eed024b5-986b-40fa-a686-ceab563a6131] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:17.501501 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-564ac1a8-eb6d-4ff3-9a97-20ef8e84ec40 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:17.502114 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-564ac1a8-eb6d-4ff3-9a97-20ef8e84ec40 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:17.502627 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-564ac1a8-eb6d-4ff3-9a97-20ef8e84ec40 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:17.503461 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-564ac1a8-eb6d-4ff3-9a97-20ef8e84ec40 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:17.504002 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-564ac1a8-eb6d-4ff3-9a97-20ef8e84ec40 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:17.504510 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-564ac1a8-eb6d-4ff3-9a97-20ef8e84ec40 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:17.515704 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ee929869-5745-4b9b-a72a-042c22c2a1fd tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:17.516221 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ee929869-5745-4b9b-a72a-042c22c2a1fd tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:17.516667 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ee929869-5745-4b9b-a72a-042c22c2a1fd tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:17.517390 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ee929869-5745-4b9b-a72a-042c22c2a1fd tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:17.517858 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ee929869-5745-4b9b-a72a-042c22c2a1fd tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:17.518291 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ee929869-5745-4b9b-a72a-042c22c2a1fd tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:17.565300 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ee929869-5745-4b9b-a72a-042c22c2a1fd tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] 10.222.0.61 "GET /compute/v2.1/servers/eed024b5-986b-40fa-a686-ceab563a6131/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.069900 Aug 31 16:12:17.572107 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1806/3616] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 16:12:17 2022] GET /compute/v2.1/servers/eed024b5-986b-40fa-a686-ceab563a6131/os-volume_attachments => generated 25 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 16:12:17.577646 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f8e3e6e8-e59d-404e-a10f-320ecc04fbf3 tempest-ComputeTenantNetworksTest-1963382553 tempest-ComputeTenantNetworksTest-1963382553-project] Calling method '.version_select at 0x7f5ae986c430>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:17.881307 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f8e3e6e8-e59d-404e-a10f-320ecc04fbf3 tempest-ComputeTenantNetworksTest-1963382553 tempest-ComputeTenantNetworksTest-1963382553-project] 10.222.0.61 "GET /compute/v2.1/os-tenant-networks/423207b9-1e23-4684-a10a-a8877f4e9f91" status: 200 len: 139 microversion: 2.1 time: 0.313907 Aug 31 16:12:17.882718 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1807/3617] 10.222.0.61 () {58 vars in 1269 bytes} [Wed Aug 31 16:12:17 2022] GET /compute/v2.1/os-tenant-networks/423207b9-1e23-4684-a10a-a8877f4e9f91 => generated 139 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:12:17.889083 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-55482433-8358-4881-9927-4e03e2eb946e tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-892068676", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "networks": [{"uuid": "76e9647f-4a38-405c-b14a-4bf676c35b51"}]}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:12:17.913806 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-564ac1a8-eb6d-4ff3-9a97-20ef8e84ec40 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1444fdefda4eaeac9b11577ad7248b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859e7bbce8ed4dea985c73abe3ec8cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:17.933393 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-564ac1a8-eb6d-4ff3-9a97-20ef8e84ec40 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] 10.222.0.61 "GET /compute/v2.1/servers/596c5ff8-2dc8-4248-be52-eab6df1793e0" status: 200 len: 1313 microversion: 2.1 time: 0.451825 Aug 31 16:12:17.934292 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1811/3618] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:17 2022] GET /compute/v2.1/servers/596c5ff8-2dc8-4248-be52-eab6df1793e0 => generated 1313 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:17.947261 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7a530e4e-8b19-4815-b58c-7d40d3aa9a2c tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:17.952018 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7a530e4e-8b19-4815-b58c-7d40d3aa9a2c tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] [instance: fa0932e8-1aa4-4d1a-b653-14be35568f3d] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:17.972904 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7a530e4e-8b19-4815-b58c-7d40d3aa9a2c tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:17.974039 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7a530e4e-8b19-4815-b58c-7d40d3aa9a2c tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:17.975010 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7a530e4e-8b19-4815-b58c-7d40d3aa9a2c tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:17.976049 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7a530e4e-8b19-4815-b58c-7d40d3aa9a2c tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:17.976640 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7a530e4e-8b19-4815-b58c-7d40d3aa9a2c tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:17.977086 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7a530e4e-8b19-4815-b58c-7d40d3aa9a2c tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:17.997802 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-55482433-8358-4881-9927-4e03e2eb946e tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] validate_networks() for [('76e9647f-4a38-405c-b14a-4bf676c35b51', None, None, None, None, None)] {{(pid=122256) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:12:18.425476 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7a530e4e-8b19-4815-b58c-7d40d3aa9a2c tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:18.438866 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7a530e4e-8b19-4815-b58c-7d40d3aa9a2c tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:18.440521 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7a530e4e-8b19-4815-b58c-7d40d3aa9a2c tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:18.442111 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7a530e4e-8b19-4815-b58c-7d40d3aa9a2c tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] 10.222.0.61 "GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d" status: 200 len: 1879 microversion: 2.32 time: 0.506549 Aug 31 16:12:18.443683 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1812/3619] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:12:17 2022] GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d => generated 1879 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:12:18.449472 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c7604b87-5cd1-43d0-af05-30a5647085bc tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:18.450232 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c7604b87-5cd1-43d0-af05-30a5647085bc tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] [instance: af6da672-bcfb-433b-b868-3dd1dd3e4770] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:18.457450 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c7604b87-5cd1-43d0-af05-30a5647085bc tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:18.460003 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c7604b87-5cd1-43d0-af05-30a5647085bc tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:18.460727 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c7604b87-5cd1-43d0-af05-30a5647085bc tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:18.461749 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c7604b87-5cd1-43d0-af05-30a5647085bc tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:18.462607 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c7604b87-5cd1-43d0-af05-30a5647085bc tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:18.465800 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c7604b87-5cd1-43d0-af05-30a5647085bc tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:18.882302 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c7604b87-5cd1-43d0-af05-30a5647085bc tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea74590916f437b9722321f420ca2a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805e39cb57794a138813c776b889741f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:18.901970 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c7604b87-5cd1-43d0-af05-30a5647085bc tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] 10.222.0.61 "GET /compute/v2.1/servers/af6da672-bcfb-433b-b868-3dd1dd3e4770" status: 200 len: 1350 microversion: 2.1 time: 0.456466 Aug 31 16:12:18.902914 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1813/3620] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:18 2022] GET /compute/v2.1/servers/af6da672-bcfb-433b-b868-3dd1dd3e4770 => generated 1350 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:18.913461 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-50c9054a-77b5-43a3-befa-71edb97a6c70 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:18.914501 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-50c9054a-77b5-43a3-befa-71edb97a6c70 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 8e287ae9-272b-4148-a159-790187f5d8a3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:18.925489 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-50c9054a-77b5-43a3-befa-71edb97a6c70 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:18.926065 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-50c9054a-77b5-43a3-befa-71edb97a6c70 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:18.926451 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-50c9054a-77b5-43a3-befa-71edb97a6c70 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:18.928175 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-50c9054a-77b5-43a3-befa-71edb97a6c70 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:18.928708 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-50c9054a-77b5-43a3-befa-71edb97a6c70 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:18.936380 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-50c9054a-77b5-43a3-befa-71edb97a6c70 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:19.325939 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-50c9054a-77b5-43a3-befa-71edb97a6c70 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:19.339455 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-50c9054a-77b5-43a3-befa-71edb97a6c70 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/8e287ae9-272b-4148-a159-790187f5d8a3" status: 200 len: 1327 microversion: 2.1 time: 0.435422 Aug 31 16:12:19.340697 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1814/3621] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:18 2022] GET /compute/v2.1/servers/8e287ae9-272b-4148-a159-790187f5d8a3 => generated 1327 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:19.352419 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-df70b04e-c0e5-4675-8463-27c1200dea76 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:19.357729 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-df70b04e-c0e5-4675-8463-27c1200dea76 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] [instance: 596c5ff8-2dc8-4248-be52-eab6df1793e0] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:19.373446 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-df70b04e-c0e5-4675-8463-27c1200dea76 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:19.374956 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-df70b04e-c0e5-4675-8463-27c1200dea76 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:19.375968 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-df70b04e-c0e5-4675-8463-27c1200dea76 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:19.377327 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-df70b04e-c0e5-4675-8463-27c1200dea76 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:19.380738 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-df70b04e-c0e5-4675-8463-27c1200dea76 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:19.381756 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-df70b04e-c0e5-4675-8463-27c1200dea76 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:19.413203 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-55482433-8358-4881-9927-4e03e2eb946e tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:12:19.413713 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-55482433-8358-4881-9927-4e03e2eb946e tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:12:19.414198 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-55482433-8358-4881-9927-4e03e2eb946e tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:12:19.414618 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-55482433-8358-4881-9927-4e03e2eb946e tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:12:19.415132 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-55482433-8358-4881-9927-4e03e2eb946e tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:12:19.434983 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-55482433-8358-4881-9927-4e03e2eb946e tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:19.435491 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-55482433-8358-4881-9927-4e03e2eb946e tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:19.435965 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-55482433-8358-4881-9927-4e03e2eb946e tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:19.437995 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-55482433-8358-4881-9927-4e03e2eb946e tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:19.440209 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-55482433-8358-4881-9927-4e03e2eb946e tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:19.441464 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-55482433-8358-4881-9927-4e03e2eb946e tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:19.450630 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=100 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:12:19.525154 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-55482433-8358-4881-9927-4e03e2eb946e tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Getting quotas for project e14140e7303046f1ada446437826f742. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:12:19.541773 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-55482433-8358-4881-9927-4e03e2eb946e tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Getting quotas for user 6ab268a4d607497da5476256055bb07c and project e14140e7303046f1ada446437826f742. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:12:19.585604 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-55482433-8358-4881-9927-4e03e2eb946e tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Going to run 1 instances... {{(pid=122256) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:12:19.589478 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-55482433-8358-4881-9927-4e03e2eb946e tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] [instance: 9bed27f7-16a5-414d-bb64-700cb4f5cb4b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:12:19.672675 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-55482433-8358-4881-9927-4e03e2eb946e tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.788482 Aug 31 16:12:19.685031 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1808/3622] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:12:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1796 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:12:19.698559 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-c04b1967-a0bd-4846-87b1-302d41c7a8b3 req-f1bef513-d5ed-4194-8a19-18d828011c73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af6da672-bcfb-433b-b868-3dd1dd3e4770", "name": "network-vif-plugged", "status": "completed", "tag": "aa1f0e1c-7d31-43c6-bd52-1902f678ccdb"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:12:19.715226 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-c04b1967-a0bd-4846-87b1-302d41c7a8b3 req-f1bef513-d5ed-4194-8a19-18d828011c73 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:19.715992 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-c04b1967-a0bd-4846-87b1-302d41c7a8b3 req-f1bef513-d5ed-4194-8a19-18d828011c73 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:19.716740 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-c04b1967-a0bd-4846-87b1-302d41c7a8b3 req-f1bef513-d5ed-4194-8a19-18d828011c73 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:19.735880 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-c04b1967-a0bd-4846-87b1-302d41c7a8b3 req-f1bef513-d5ed-4194-8a19-18d828011c73 service nova] Creating event network-vif-plugged:aa1f0e1c-7d31-43c6-bd52-1902f678ccdb for instance af6da672-bcfb-433b-b868-3dd1dd3e4770 on n-h2-850499-9 Aug 31 16:12:19.746393 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-c04b1967-a0bd-4846-87b1-302d41c7a8b3 req-f1bef513-d5ed-4194-8a19-18d828011c73 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059140 Aug 31 16:12:19.747840 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1809/3623] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:12:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:12:19.751366 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-df70b04e-c0e5-4675-8463-27c1200dea76 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1444fdefda4eaeac9b11577ad7248b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859e7bbce8ed4dea985c73abe3ec8cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:19.754182 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-fde83545-aaa6-4ce3-a36f-d001d9d07f94 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:19.755640 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-fde83545-aaa6-4ce3-a36f-d001d9d07f94 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] [instance: fa0932e8-1aa4-4d1a-b653-14be35568f3d] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:19.765005 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fde83545-aaa6-4ce3-a36f-d001d9d07f94 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:19.765880 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fde83545-aaa6-4ce3-a36f-d001d9d07f94 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:19.766847 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fde83545-aaa6-4ce3-a36f-d001d9d07f94 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:19.767876 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fde83545-aaa6-4ce3-a36f-d001d9d07f94 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:19.768357 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-df70b04e-c0e5-4675-8463-27c1200dea76 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] 10.222.0.61 "GET /compute/v2.1/servers/596c5ff8-2dc8-4248-be52-eab6df1793e0" status: 200 len: 1313 microversion: 2.1 time: 0.426439 Aug 31 16:12:19.768775 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fde83545-aaa6-4ce3-a36f-d001d9d07f94 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:19.784291 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1815/3624] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:19 2022] GET /compute/v2.1/servers/596c5ff8-2dc8-4248-be52-eab6df1793e0 => generated 1313 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:19.789179 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fde83545-aaa6-4ce3-a36f-d001d9d07f94 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:19.789751 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6ab353f5-9711-4d64-a896-315e484cfef7 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:19.790350 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6ab353f5-9711-4d64-a896-315e484cfef7 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] [instance: 9bed27f7-16a5-414d-bb64-700cb4f5cb4b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:20.024285 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-6ab353f5-9711-4d64-a896-315e484cfef7 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab268a4d607497da5476256055bb07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14140e7303046f1ada446437826f742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:20.034993 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6ab353f5-9711-4d64-a896-315e484cfef7 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] 10.222.0.61 "GET /compute/v2.1/servers/9bed27f7-16a5-414d-bb64-700cb4f5cb4b" status: 200 len: 1217 microversion: 2.1 time: 0.250134 Aug 31 16:12:20.035877 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1816/3625] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:19 2022] GET /compute/v2.1/servers/9bed27f7-16a5-414d-bb64-700cb4f5cb4b => generated 1217 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:20.101717 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e199205b-d92a-4ac9-9cef-85c0a7c0481b tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:20.102697 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e199205b-d92a-4ac9-9cef-85c0a7c0481b tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] [instance: af6da672-bcfb-433b-b868-3dd1dd3e4770] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:20.135654 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e199205b-d92a-4ac9-9cef-85c0a7c0481b tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:20.136161 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e199205b-d92a-4ac9-9cef-85c0a7c0481b tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:20.136594 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e199205b-d92a-4ac9-9cef-85c0a7c0481b tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:20.137316 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e199205b-d92a-4ac9-9cef-85c0a7c0481b tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:20.137813 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e199205b-d92a-4ac9-9cef-85c0a7c0481b tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:20.138276 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e199205b-d92a-4ac9-9cef-85c0a7c0481b tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:20.461515 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-fde83545-aaa6-4ce3-a36f-d001d9d07f94 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:20.481845 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-fde83545-aaa6-4ce3-a36f-d001d9d07f94 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:20.488853 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-fde83545-aaa6-4ce3-a36f-d001d9d07f94 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:20.493183 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-fde83545-aaa6-4ce3-a36f-d001d9d07f94 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] 10.222.0.61 "GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d" status: 200 len: 2832 microversion: 2.32 time: 0.742678 Aug 31 16:12:20.494406 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1810/3626] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:12:19 2022] GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d => generated 2832 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:12:20.512820 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2cc36b3c-9ff3-4ae0-8164-e56a054f0443 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:20.513696 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2cc36b3c-9ff3-4ae0-8164-e56a054f0443 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 8e287ae9-272b-4148-a159-790187f5d8a3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:20.521618 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2cc36b3c-9ff3-4ae0-8164-e56a054f0443 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:20.522597 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2cc36b3c-9ff3-4ae0-8164-e56a054f0443 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:20.523244 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2cc36b3c-9ff3-4ae0-8164-e56a054f0443 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:20.524341 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2cc36b3c-9ff3-4ae0-8164-e56a054f0443 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:20.525837 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2cc36b3c-9ff3-4ae0-8164-e56a054f0443 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:20.526733 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2cc36b3c-9ff3-4ae0-8164-e56a054f0443 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:21.343836 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-2cc36b3c-9ff3-4ae0-8164-e56a054f0443 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:21.350245 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e199205b-d92a-4ac9-9cef-85c0a7c0481b tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea74590916f437b9722321f420ca2a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805e39cb57794a138813c776b889741f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:21.357713 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2cc36b3c-9ff3-4ae0-8164-e56a054f0443 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/8e287ae9-272b-4148-a159-790187f5d8a3" status: 200 len: 1327 microversion: 2.1 time: 0.859720 Aug 31 16:12:21.359822 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1811/3627] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:20 2022] GET /compute/v2.1/servers/8e287ae9-272b-4148-a159-790187f5d8a3 => generated 1327 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:21.365393 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e199205b-d92a-4ac9-9cef-85c0a7c0481b tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] 10.222.0.61 "GET /compute/v2.1/servers/af6da672-bcfb-433b-b868-3dd1dd3e4770" status: 200 len: 1350 microversion: 2.1 time: 1.295039 Aug 31 16:12:21.372119 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-fbf2ca4b-2e26-45b7-95d9-ace0eb38dd51 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:21.372880 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-fbf2ca4b-2e26-45b7-95d9-ace0eb38dd51 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] [instance: fa0932e8-1aa4-4d1a-b653-14be35568f3d] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:21.381836 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1817/3628] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:20 2022] GET /compute/v2.1/servers/af6da672-bcfb-433b-b868-3dd1dd3e4770 => generated 1350 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:21.387424 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fbf2ca4b-2e26-45b7-95d9-ace0eb38dd51 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:21.388255 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fbf2ca4b-2e26-45b7-95d9-ace0eb38dd51 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:21.390443 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5567f8cf-65d2-489a-bb8f-b10635732042 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:21.391017 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fbf2ca4b-2e26-45b7-95d9-ace0eb38dd51 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:21.392510 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5567f8cf-65d2-489a-bb8f-b10635732042 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] [instance: 596c5ff8-2dc8-4248-be52-eab6df1793e0] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:21.399220 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5567f8cf-65d2-489a-bb8f-b10635732042 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:21.400000 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5567f8cf-65d2-489a-bb8f-b10635732042 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:21.401073 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5567f8cf-65d2-489a-bb8f-b10635732042 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:21.401981 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5567f8cf-65d2-489a-bb8f-b10635732042 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:21.402633 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5567f8cf-65d2-489a-bb8f-b10635732042 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:21.403233 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5567f8cf-65d2-489a-bb8f-b10635732042 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:21.403855 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fbf2ca4b-2e26-45b7-95d9-ace0eb38dd51 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:21.404509 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fbf2ca4b-2e26-45b7-95d9-ace0eb38dd51 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:21.404950 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fbf2ca4b-2e26-45b7-95d9-ace0eb38dd51 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:21.684221 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-fbf2ca4b-2e26-45b7-95d9-ace0eb38dd51 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] 10.222.0.61 "GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d/os-interface" status: 200 len: 1832 microversion: 2.32 time: 0.322897 Aug 31 16:12:21.685091 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1812/3629] 10.222.0.61 () {60 vars in 1316 bytes} [Wed Aug 31 16:12:21 2022] GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d/os-interface => generated 1832 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:12:21.700265 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e8ce6fda-8df2-48b9-9312-8ebedd06a43b tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:21.702325 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e8ce6fda-8df2-48b9-9312-8ebedd06a43b tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] [instance: 9bed27f7-16a5-414d-bb64-700cb4f5cb4b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:21.729521 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e8ce6fda-8df2-48b9-9312-8ebedd06a43b tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:21.730131 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e8ce6fda-8df2-48b9-9312-8ebedd06a43b tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:21.730588 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e8ce6fda-8df2-48b9-9312-8ebedd06a43b tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:21.731335 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e8ce6fda-8df2-48b9-9312-8ebedd06a43b tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:21.737303 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e8ce6fda-8df2-48b9-9312-8ebedd06a43b tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:21.738940 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e8ce6fda-8df2-48b9-9312-8ebedd06a43b tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:21.794952 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5567f8cf-65d2-489a-bb8f-b10635732042 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1444fdefda4eaeac9b11577ad7248b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859e7bbce8ed4dea985c73abe3ec8cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:21.807970 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5567f8cf-65d2-489a-bb8f-b10635732042 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] 10.222.0.61 "GET /compute/v2.1/servers/596c5ff8-2dc8-4248-be52-eab6df1793e0" status: 200 len: 1498 microversion: 2.1 time: 0.421342 Aug 31 16:12:21.808581 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1818/3630] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:21 2022] GET /compute/v2.1/servers/596c5ff8-2dc8-4248-be52-eab6df1793e0 => generated 1498 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:21.840399 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-672feeb9-da79-4655-8bfb-167a940391fd tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:21.872001 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.compute.server_groups [None req-672feeb9-da79-4655-8bfb-167a940391fd tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Querying cell 9f6d6683-96bf-42a7-a78d-78a22f1453ed(cell1) for 1 instances {{(pid=122257) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 31 16:12:21.872817 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-672feeb9-da79-4655-8bfb-167a940391fd tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:21.873324 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-672feeb9-da79-4655-8bfb-167a940391fd tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:21.873773 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-672feeb9-da79-4655-8bfb-167a940391fd tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:21.894456 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e8ce6fda-8df2-48b9-9312-8ebedd06a43b tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab268a4d607497da5476256055bb07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14140e7303046f1ada446437826f742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:21.907904 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e8ce6fda-8df2-48b9-9312-8ebedd06a43b tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] 10.222.0.61 "GET /compute/v2.1/servers/9bed27f7-16a5-414d-bb64-700cb4f5cb4b" status: 200 len: 1269 microversion: 2.1 time: 0.219635 Aug 31 16:12:21.922102 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1813/3631] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:21 2022] GET /compute/v2.1/servers/9bed27f7-16a5-414d-bb64-700cb4f5cb4b => generated 1269 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:21.950174 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-447c991c-3b2c-472b-ae7f-6c61af5850ef req-c51e4f8f-8a09-44b0-9f66-e48e3f4e5607 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e287ae9-272b-4148-a159-790187f5d8a3", "name": "network-vif-plugged", "status": "completed", "tag": "c37204c6-352c-4ad3-ba7a-072c6bbd57ef"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:12:21.969529 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-672feeb9-da79-4655-8bfb-167a940391fd tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] 10.222.0.61 "GET /compute/v2.1/os-server-groups/8c9fbf5a-c35f-4cec-ab26-f8079a47a3d8" status: 200 len: 221 microversion: 2.1 time: 0.140800 Aug 31 16:12:21.977534 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-447c991c-3b2c-472b-ae7f-6c61af5850ef req-c51e4f8f-8a09-44b0-9f66-e48e3f4e5607 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:21.978410 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-447c991c-3b2c-472b-ae7f-6c61af5850ef req-c51e4f8f-8a09-44b0-9f66-e48e3f4e5607 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:21.980683 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-447c991c-3b2c-472b-ae7f-6c61af5850ef req-c51e4f8f-8a09-44b0-9f66-e48e3f4e5607 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:21.981129 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1819/3632] 10.222.0.61 () {58 vars in 1263 bytes} [Wed Aug 31 16:12:21 2022] GET /compute/v2.1/os-server-groups/8c9fbf5a-c35f-4cec-ab26-f8079a47a3d8 => generated 221 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:12:21.986481 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f3f6d1f6-dcea-4be1-881a-8783ad26225a tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:21.987254 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f3f6d1f6-dcea-4be1-881a-8783ad26225a tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] [instance: 596c5ff8-2dc8-4248-be52-eab6df1793e0] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:21.994779 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f3f6d1f6-dcea-4be1-881a-8783ad26225a tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:21.995586 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f3f6d1f6-dcea-4be1-881a-8783ad26225a tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:21.996196 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f3f6d1f6-dcea-4be1-881a-8783ad26225a tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:21.997192 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f3f6d1f6-dcea-4be1-881a-8783ad26225a tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:22.003461 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f3f6d1f6-dcea-4be1-881a-8783ad26225a tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:22.004127 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f3f6d1f6-dcea-4be1-881a-8783ad26225a tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:22.022573 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-447c991c-3b2c-472b-ae7f-6c61af5850ef req-c51e4f8f-8a09-44b0-9f66-e48e3f4e5607 service nova] Creating event network-vif-plugged:c37204c6-352c-4ad3-ba7a-072c6bbd57ef for instance 8e287ae9-272b-4148-a159-790187f5d8a3 on n-h1-850499-9 Aug 31 16:12:22.037049 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f3f6d1f6-dcea-4be1-881a-8783ad26225a tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] [instance: 596c5ff8-2dc8-4248-be52-eab6df1793e0] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:12:22.039655 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-447c991c-3b2c-472b-ae7f-6c61af5850ef req-c51e4f8f-8a09-44b0-9f66-e48e3f4e5607 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114331 Aug 31 16:12:22.040890 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1814/3633] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:12:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:12:22.240337 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f3f6d1f6-dcea-4be1-881a-8783ad26225a tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] 10.222.0.61 "DELETE /compute/v2.1/servers/596c5ff8-2dc8-4248-be52-eab6df1793e0" status: 204 len: 0 microversion: 2.1 time: 0.253229 Aug 31 16:12:22.247955 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1820/3634] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:12:21 2022] DELETE /compute/v2.1/servers/596c5ff8-2dc8-4248-be52-eab6df1793e0 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 16:12:22.253141 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ae98b912-c2f3-4f69-aec2-1829b94b5805 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:22.254281 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ae98b912-c2f3-4f69-aec2-1829b94b5805 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] [instance: 596c5ff8-2dc8-4248-be52-eab6df1793e0] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:22.265824 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ae98b912-c2f3-4f69-aec2-1829b94b5805 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:22.273843 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ae98b912-c2f3-4f69-aec2-1829b94b5805 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:22.274618 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ae98b912-c2f3-4f69-aec2-1829b94b5805 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:22.275736 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ae98b912-c2f3-4f69-aec2-1829b94b5805 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:22.276451 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ae98b912-c2f3-4f69-aec2-1829b94b5805 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:22.277119 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ae98b912-c2f3-4f69-aec2-1829b94b5805 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:22.387441 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9d80af95-bbc0-4b6d-b702-97d850ce5afb tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:22.389153 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9d80af95-bbc0-4b6d-b702-97d850ce5afb tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 8e287ae9-272b-4148-a159-790187f5d8a3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:22.399277 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9d80af95-bbc0-4b6d-b702-97d850ce5afb tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:22.400506 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9d80af95-bbc0-4b6d-b702-97d850ce5afb tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:22.415487 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9d80af95-bbc0-4b6d-b702-97d850ce5afb tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:22.418095 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9d80af95-bbc0-4b6d-b702-97d850ce5afb tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:22.418973 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9d80af95-bbc0-4b6d-b702-97d850ce5afb tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:22.421874 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9d80af95-bbc0-4b6d-b702-97d850ce5afb tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:22.617198 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ae98b912-c2f3-4f69-aec2-1829b94b5805 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1444fdefda4eaeac9b11577ad7248b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859e7bbce8ed4dea985c73abe3ec8cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:22.636937 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ae98b912-c2f3-4f69-aec2-1829b94b5805 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] 10.222.0.61 "GET /compute/v2.1/servers/596c5ff8-2dc8-4248-be52-eab6df1793e0" status: 200 len: 1504 microversion: 2.1 time: 0.388831 Aug 31 16:12:22.650312 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1815/3635] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:22 2022] GET /compute/v2.1/servers/596c5ff8-2dc8-4248-be52-eab6df1793e0 => generated 1504 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:12:22.666302 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-71e37c5b-5ff0-4f62-b9c4-9acc043b1787 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:22.672534 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-71e37c5b-5ff0-4f62-b9c4-9acc043b1787 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] [instance: af6da672-bcfb-433b-b868-3dd1dd3e4770] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:22.690993 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-71e37c5b-5ff0-4f62-b9c4-9acc043b1787 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:22.691718 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-71e37c5b-5ff0-4f62-b9c4-9acc043b1787 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:22.691961 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-71e37c5b-5ff0-4f62-b9c4-9acc043b1787 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:22.699710 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-71e37c5b-5ff0-4f62-b9c4-9acc043b1787 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:22.700745 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-71e37c5b-5ff0-4f62-b9c4-9acc043b1787 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:22.704228 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-71e37c5b-5ff0-4f62-b9c4-9acc043b1787 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:22.903003 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9d80af95-bbc0-4b6d-b702-97d850ce5afb tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:22.914496 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9d80af95-bbc0-4b6d-b702-97d850ce5afb tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/8e287ae9-272b-4148-a159-790187f5d8a3" status: 200 len: 1327 microversion: 2.1 time: 0.533151 Aug 31 16:12:22.942219 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1821/3636] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:22 2022] GET /compute/v2.1/servers/8e287ae9-272b-4148-a159-790187f5d8a3 => generated 1327 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:22.952862 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d59a58be-361e-4dd4-91c0-31ff82a04718 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:22.954121 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d59a58be-361e-4dd4-91c0-31ff82a04718 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] [instance: 9bed27f7-16a5-414d-bb64-700cb4f5cb4b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:22.965559 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d59a58be-361e-4dd4-91c0-31ff82a04718 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:22.966975 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d59a58be-361e-4dd4-91c0-31ff82a04718 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:22.968918 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d59a58be-361e-4dd4-91c0-31ff82a04718 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:22.970471 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d59a58be-361e-4dd4-91c0-31ff82a04718 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:22.972314 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d59a58be-361e-4dd4-91c0-31ff82a04718 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:22.987136 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d59a58be-361e-4dd4-91c0-31ff82a04718 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:23.042863 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-71e37c5b-5ff0-4f62-b9c4-9acc043b1787 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea74590916f437b9722321f420ca2a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805e39cb57794a138813c776b889741f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:23.055717 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-71e37c5b-5ff0-4f62-b9c4-9acc043b1787 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] 10.222.0.61 "GET /compute/v2.1/servers/af6da672-bcfb-433b-b868-3dd1dd3e4770" status: 200 len: 1350 microversion: 2.1 time: 0.403767 Aug 31 16:12:23.078627 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1816/3637] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:22 2022] GET /compute/v2.1/servers/af6da672-bcfb-433b-b868-3dd1dd3e4770 => generated 1350 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:23.127538 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d59a58be-361e-4dd4-91c0-31ff82a04718 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab268a4d607497da5476256055bb07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14140e7303046f1ada446437826f742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:23.138402 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d59a58be-361e-4dd4-91c0-31ff82a04718 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] 10.222.0.61 "GET /compute/v2.1/servers/9bed27f7-16a5-414d-bb64-700cb4f5cb4b" status: 200 len: 1275 microversion: 2.1 time: 0.193718 Aug 31 16:12:23.140451 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1822/3638] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:22 2022] GET /compute/v2.1/servers/9bed27f7-16a5-414d-bb64-700cb4f5cb4b => generated 1275 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:23.677376 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-84021c55-d0d2-4f3f-bf9c-643fecb5688b tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:23.678327 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-84021c55-d0d2-4f3f-bf9c-643fecb5688b tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] [instance: 596c5ff8-2dc8-4248-be52-eab6df1793e0] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:23.697668 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-84021c55-d0d2-4f3f-bf9c-643fecb5688b tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:23.700620 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-84021c55-d0d2-4f3f-bf9c-643fecb5688b tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:23.701364 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-84021c55-d0d2-4f3f-bf9c-643fecb5688b tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:23.702769 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-84021c55-d0d2-4f3f-bf9c-643fecb5688b tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:23.703857 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-84021c55-d0d2-4f3f-bf9c-643fecb5688b tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:23.704713 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-84021c55-d0d2-4f3f-bf9c-643fecb5688b tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:23.951380 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2b9f5cba-4fa4-48ae-ac81-d730bee9f2c0 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:23.952466 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2b9f5cba-4fa4-48ae-ac81-d730bee9f2c0 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 8e287ae9-272b-4148-a159-790187f5d8a3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:23.965868 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2b9f5cba-4fa4-48ae-ac81-d730bee9f2c0 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:23.968913 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2b9f5cba-4fa4-48ae-ac81-d730bee9f2c0 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:23.970921 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2b9f5cba-4fa4-48ae-ac81-d730bee9f2c0 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:23.974702 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2b9f5cba-4fa4-48ae-ac81-d730bee9f2c0 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:23.976026 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2b9f5cba-4fa4-48ae-ac81-d730bee9f2c0 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:23.976841 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2b9f5cba-4fa4-48ae-ac81-d730bee9f2c0 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:24.281438 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-84021c55-d0d2-4f3f-bf9c-643fecb5688b tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1444fdefda4eaeac9b11577ad7248b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859e7bbce8ed4dea985c73abe3ec8cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:24.308164 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-84021c55-d0d2-4f3f-bf9c-643fecb5688b tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] 10.222.0.61 "GET /compute/v2.1/servers/596c5ff8-2dc8-4248-be52-eab6df1793e0" status: 200 len: 1504 microversion: 2.1 time: 0.635758 Aug 31 16:12:24.309483 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1817/3639] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:23 2022] GET /compute/v2.1/servers/596c5ff8-2dc8-4248-be52-eab6df1793e0 => generated 1504 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:12:24.519903 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7a8433a0-2cfa-4fe0-ae51-413e389f4ce0 tempest-AbsoluteLimitsTestJSON-575995576 tempest-AbsoluteLimitsTestJSON-575995576-project] Calling method '.version_select at 0x7f5ae8696700>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:24.535740 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7a8433a0-2cfa-4fe0-ae51-413e389f4ce0 tempest-AbsoluteLimitsTestJSON-575995576 tempest-AbsoluteLimitsTestJSON-575995576-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:24.537061 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7a8433a0-2cfa-4fe0-ae51-413e389f4ce0 tempest-AbsoluteLimitsTestJSON-575995576 tempest-AbsoluteLimitsTestJSON-575995576-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:24.538711 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7a8433a0-2cfa-4fe0-ae51-413e389f4ce0 tempest-AbsoluteLimitsTestJSON-575995576 tempest-AbsoluteLimitsTestJSON-575995576-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:24.539935 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7a8433a0-2cfa-4fe0-ae51-413e389f4ce0 tempest-AbsoluteLimitsTestJSON-575995576 tempest-AbsoluteLimitsTestJSON-575995576-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:24.540680 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7a8433a0-2cfa-4fe0-ae51-413e389f4ce0 tempest-AbsoluteLimitsTestJSON-575995576 tempest-AbsoluteLimitsTestJSON-575995576-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:24.541766 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7a8433a0-2cfa-4fe0-ae51-413e389f4ce0 tempest-AbsoluteLimitsTestJSON-575995576 tempest-AbsoluteLimitsTestJSON-575995576-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:24.569889 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7a8433a0-2cfa-4fe0-ae51-413e389f4ce0 tempest-AbsoluteLimitsTestJSON-575995576 tempest-AbsoluteLimitsTestJSON-575995576-project] 10.222.0.61 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.258739 Aug 31 16:12:24.571184 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1818/3640] 10.222.0.61 () {58 vars in 1122 bytes} [Wed Aug 31 16:12:24 2022] GET /compute/v2.1/limits => generated 511 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:12:24.576895 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7c8ab47c-d1f2-4f55-9609-de6fecff5f15 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:24.577997 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7c8ab47c-d1f2-4f55-9609-de6fecff5f15 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] [instance: af6da672-bcfb-433b-b868-3dd1dd3e4770] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:24.584764 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7c8ab47c-d1f2-4f55-9609-de6fecff5f15 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:24.585920 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7c8ab47c-d1f2-4f55-9609-de6fecff5f15 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:24.586604 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7c8ab47c-d1f2-4f55-9609-de6fecff5f15 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:24.587895 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7c8ab47c-d1f2-4f55-9609-de6fecff5f15 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:24.588669 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7c8ab47c-d1f2-4f55-9609-de6fecff5f15 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:24.589317 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7c8ab47c-d1f2-4f55-9609-de6fecff5f15 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:25.096041 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2b9f5cba-4fa4-48ae-ac81-d730bee9f2c0 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:25.111070 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2b9f5cba-4fa4-48ae-ac81-d730bee9f2c0 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/8e287ae9-272b-4148-a159-790187f5d8a3" status: 200 len: 1327 microversion: 2.1 time: 1.175174 Aug 31 16:12:25.117349 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1823/3641] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:23 2022] GET /compute/v2.1/servers/8e287ae9-272b-4148-a159-790187f5d8a3 => generated 1327 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:25.122855 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f3212438-3f90-472c-b43e-f01ac26ef562 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:25.128300 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f3212438-3f90-472c-b43e-f01ac26ef562 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] [instance: 9bed27f7-16a5-414d-bb64-700cb4f5cb4b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:25.162266 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f3212438-3f90-472c-b43e-f01ac26ef562 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:25.163727 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f3212438-3f90-472c-b43e-f01ac26ef562 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:25.165096 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f3212438-3f90-472c-b43e-f01ac26ef562 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:25.166786 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f3212438-3f90-472c-b43e-f01ac26ef562 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:25.168030 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f3212438-3f90-472c-b43e-f01ac26ef562 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:25.169155 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f3212438-3f90-472c-b43e-f01ac26ef562 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:25.509350 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7c8ab47c-d1f2-4f55-9609-de6fecff5f15 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea74590916f437b9722321f420ca2a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805e39cb57794a138813c776b889741f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:25.524990 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7c8ab47c-d1f2-4f55-9609-de6fecff5f15 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] 10.222.0.61 "GET /compute/v2.1/servers/af6da672-bcfb-433b-b868-3dd1dd3e4770" status: 200 len: 1541 microversion: 2.1 time: 0.952353 Aug 31 16:12:25.528704 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1819/3642] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:24 2022] GET /compute/v2.1/servers/af6da672-bcfb-433b-b868-3dd1dd3e4770 => generated 1541 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:25.541513 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3dee7203-ee1c-465e-9335-b15e510f7438 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:25.544654 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3dee7203-ee1c-465e-9335-b15e510f7438 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] [instance: 596c5ff8-2dc8-4248-be52-eab6df1793e0] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:25.560212 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3dee7203-ee1c-465e-9335-b15e510f7438 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:25.562283 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3dee7203-ee1c-465e-9335-b15e510f7438 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:25.563788 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3dee7203-ee1c-465e-9335-b15e510f7438 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:25.565642 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3dee7203-ee1c-465e-9335-b15e510f7438 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:25.568344 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3dee7203-ee1c-465e-9335-b15e510f7438 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:25.569007 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3dee7203-ee1c-465e-9335-b15e510f7438 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:25.813606 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f3212438-3f90-472c-b43e-f01ac26ef562 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab268a4d607497da5476256055bb07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14140e7303046f1ada446437826f742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:25.825566 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f3212438-3f90-472c-b43e-f01ac26ef562 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] 10.222.0.61 "GET /compute/v2.1/servers/9bed27f7-16a5-414d-bb64-700cb4f5cb4b" status: 200 len: 1317 microversion: 2.1 time: 0.706671 Aug 31 16:12:25.826766 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1824/3643] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:25 2022] GET /compute/v2.1/servers/9bed27f7-16a5-414d-bb64-700cb4f5cb4b => generated 1317 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:25.839017 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-750b149c-fda0-4cda-bf11-98ba5a1eea93 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:25.841533 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-750b149c-fda0-4cda-bf11-98ba5a1eea93 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] [instance: af6da672-bcfb-433b-b868-3dd1dd3e4770] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:25.859596 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-750b149c-fda0-4cda-bf11-98ba5a1eea93 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:25.860586 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-750b149c-fda0-4cda-bf11-98ba5a1eea93 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:25.861241 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-750b149c-fda0-4cda-bf11-98ba5a1eea93 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:25.862181 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-750b149c-fda0-4cda-bf11-98ba5a1eea93 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:25.862810 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-750b149c-fda0-4cda-bf11-98ba5a1eea93 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:25.863422 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-750b149c-fda0-4cda-bf11-98ba5a1eea93 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:25.997188 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-750b149c-fda0-4cda-bf11-98ba5a1eea93 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] 10.222.0.61 "GET /compute/v2.1/servers/af6da672-bcfb-433b-b868-3dd1dd3e4770/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.168792 Aug 31 16:12:25.998330 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1825/3644] 10.222.0.61 () {58 vars in 1275 bytes} [Wed Aug 31 16:12:25 2022] GET /compute/v2.1/servers/af6da672-bcfb-433b-b868-3dd1dd3e4770/os-interface => generated 285 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:12:26.004253 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-374ccffb-3cd6-4811-b5d2-09021365f1a1 req-011ac72c-d6a5-44c1-b7eb-d59503b0a7bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa0932e8-1aa4-4d1a-b653-14be35568f3d", "tag": "b9b65d25-b9da-474a-88d8-821f34d0be4e"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:12:26.024104 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-374ccffb-3cd6-4811-b5d2-09021365f1a1 req-011ac72c-d6a5-44c1-b7eb-d59503b0a7bd service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:26.026615 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-374ccffb-3cd6-4811-b5d2-09021365f1a1 req-011ac72c-d6a5-44c1-b7eb-d59503b0a7bd service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:26.028018 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-374ccffb-3cd6-4811-b5d2-09021365f1a1 req-011ac72c-d6a5-44c1-b7eb-d59503b0a7bd service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:26.061875 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-374ccffb-3cd6-4811-b5d2-09021365f1a1 req-011ac72c-d6a5-44c1-b7eb-d59503b0a7bd service nova] Creating event network-changed:b9b65d25-b9da-474a-88d8-821f34d0be4e for instance fa0932e8-1aa4-4d1a-b653-14be35568f3d on n-h2-850499-9 Aug 31 16:12:26.090516 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-374ccffb-3cd6-4811-b5d2-09021365f1a1 req-011ac72c-d6a5-44c1-b7eb-d59503b0a7bd service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089805 Aug 31 16:12:26.092425 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1826/3645] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:12:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:12:26.158195 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3150867e-4ed2-47dc-8170-fc2de7dbbd1f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:26.159493 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3150867e-4ed2-47dc-8170-fc2de7dbbd1f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 8e287ae9-272b-4148-a159-790187f5d8a3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:26.189149 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3150867e-4ed2-47dc-8170-fc2de7dbbd1f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:26.190047 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3150867e-4ed2-47dc-8170-fc2de7dbbd1f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:26.191056 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3150867e-4ed2-47dc-8170-fc2de7dbbd1f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:26.193496 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3150867e-4ed2-47dc-8170-fc2de7dbbd1f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:26.194449 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3150867e-4ed2-47dc-8170-fc2de7dbbd1f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:26.195229 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3150867e-4ed2-47dc-8170-fc2de7dbbd1f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:26.413846 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3dee7203-ee1c-465e-9335-b15e510f7438 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1444fdefda4eaeac9b11577ad7248b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859e7bbce8ed4dea985c73abe3ec8cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:26.426050 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3dee7203-ee1c-465e-9335-b15e510f7438 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] 10.222.0.61 "GET /compute/v2.1/servers/596c5ff8-2dc8-4248-be52-eab6df1793e0" status: 200 len: 1504 microversion: 2.1 time: 0.895383 Aug 31 16:12:26.446394 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1820/3646] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:25 2022] GET /compute/v2.1/servers/596c5ff8-2dc8-4248-be52-eab6df1793e0 => generated 1504 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:26.872547 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5a87100f-bb3a-41a4-a8ae-928f04327130 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:26.874270 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5a87100f-bb3a-41a4-a8ae-928f04327130 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] [instance: 9bed27f7-16a5-414d-bb64-700cb4f5cb4b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:26.901103 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5a87100f-bb3a-41a4-a8ae-928f04327130 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:26.902065 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5a87100f-bb3a-41a4-a8ae-928f04327130 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:26.904733 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5a87100f-bb3a-41a4-a8ae-928f04327130 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:26.905731 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5a87100f-bb3a-41a4-a8ae-928f04327130 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:26.906866 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5a87100f-bb3a-41a4-a8ae-928f04327130 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:26.908614 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5a87100f-bb3a-41a4-a8ae-928f04327130 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:26.928571 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=100 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:12:27.295765 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3150867e-4ed2-47dc-8170-fc2de7dbbd1f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:27.300131 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3150867e-4ed2-47dc-8170-fc2de7dbbd1f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/8e287ae9-272b-4148-a159-790187f5d8a3" status: 200 len: 1508 microversion: 2.1 time: 1.148516 Aug 31 16:12:27.300131 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1827/3647] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:26 2022] GET /compute/v2.1/servers/8e287ae9-272b-4148-a159-790187f5d8a3 => generated 1508 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:12:27.321439 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c293a7cd-b9e2-4601-958e-ed591b148b06 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:27.322069 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c293a7cd-b9e2-4601-958e-ed591b148b06 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 8e287ae9-272b-4148-a159-790187f5d8a3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:27.337754 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:12:27.348641 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c293a7cd-b9e2-4601-958e-ed591b148b06 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:27.349639 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c293a7cd-b9e2-4601-958e-ed591b148b06 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:27.364435 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c293a7cd-b9e2-4601-958e-ed591b148b06 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:27.365637 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c293a7cd-b9e2-4601-958e-ed591b148b06 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:27.366142 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c293a7cd-b9e2-4601-958e-ed591b148b06 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:27.366595 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c293a7cd-b9e2-4601-958e-ed591b148b06 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:28.294859 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5a87100f-bb3a-41a4-a8ae-928f04327130 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab268a4d607497da5476256055bb07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14140e7303046f1ada446437826f742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:28.315858 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5a87100f-bb3a-41a4-a8ae-928f04327130 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] 10.222.0.61 "GET /compute/v2.1/servers/9bed27f7-16a5-414d-bb64-700cb4f5cb4b" status: 200 len: 1317 microversion: 2.1 time: 1.448433 Aug 31 16:12:28.316416 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1821/3648] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:26 2022] GET /compute/v2.1/servers/9bed27f7-16a5-414d-bb64-700cb4f5cb4b => generated 1317 bytes in 1450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:12:28.345616 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e41c790c-c228-4745-a512-8a42e7017b55 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:28.346251 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e41c790c-c228-4745-a512-8a42e7017b55 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] [instance: 596c5ff8-2dc8-4248-be52-eab6df1793e0] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:28.378465 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e41c790c-c228-4745-a512-8a42e7017b55 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:28.379780 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e41c790c-c228-4745-a512-8a42e7017b55 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:28.381370 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e41c790c-c228-4745-a512-8a42e7017b55 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:28.388716 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e41c790c-c228-4745-a512-8a42e7017b55 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:28.389598 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e41c790c-c228-4745-a512-8a42e7017b55 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:28.390315 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e41c790c-c228-4745-a512-8a42e7017b55 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:29.213533 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e41c790c-c228-4745-a512-8a42e7017b55 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1444fdefda4eaeac9b11577ad7248b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859e7bbce8ed4dea985c73abe3ec8cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:29.241729 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c293a7cd-b9e2-4601-958e-ed591b148b06 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:29.246882 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e41c790c-c228-4745-a512-8a42e7017b55 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] 10.222.0.61 "GET /compute/v2.1/servers/596c5ff8-2dc8-4248-be52-eab6df1793e0" status: 200 len: 1462 microversion: 2.1 time: 0.915285 Aug 31 16:12:29.258776 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1822/3649] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:28 2022] GET /compute/v2.1/servers/596c5ff8-2dc8-4248-be52-eab6df1793e0 => generated 1462 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:29.265010 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-2f87d9db-a20a-4113-ac10-73a4d14508ab req-6b3e99e2-899a-40d9-a8b1-a6c6e34c8fae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bed27f7-16a5-414d-bb64-700cb4f5cb4b", "tag": "4e213241-95f3-4caf-a654-70d6036c1d24"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:12:29.268016 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c293a7cd-b9e2-4601-958e-ed591b148b06 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/8e287ae9-272b-4148-a159-790187f5d8a3" status: 200 len: 1508 microversion: 2.1 time: 1.948214 Aug 31 16:12:29.269148 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1828/3650] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:27 2022] GET /compute/v2.1/servers/8e287ae9-272b-4148-a159-790187f5d8a3 => generated 1508 bytes in 1953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:12:29.296639 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-5768fe29-b192-4753-bbdb-f3936a0d6c73 req-ff6b93bb-fff4-4769-8a9d-c89be848da24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "596c5ff8-2dc8-4248-be52-eab6df1793e0", "name": "network-vif-deleted", "tag": "293f95ee-1eeb-4199-8e23-db11698e1449"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:12:29.317888 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-2f87d9db-a20a-4113-ac10-73a4d14508ab req-6b3e99e2-899a-40d9-a8b1-a6c6e34c8fae service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:29.319124 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-2f87d9db-a20a-4113-ac10-73a4d14508ab req-6b3e99e2-899a-40d9-a8b1-a6c6e34c8fae service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:29.319862 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-2f87d9db-a20a-4113-ac10-73a4d14508ab req-6b3e99e2-899a-40d9-a8b1-a6c6e34c8fae service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:29.330655 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-5768fe29-b192-4753-bbdb-f3936a0d6c73 req-ff6b93bb-fff4-4769-8a9d-c89be848da24 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:29.335109 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-5768fe29-b192-4753-bbdb-f3936a0d6c73 req-ff6b93bb-fff4-4769-8a9d-c89be848da24 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:29.346938 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-5768fe29-b192-4753-bbdb-f3936a0d6c73 req-ff6b93bb-fff4-4769-8a9d-c89be848da24 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:29.355758 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-2f87d9db-a20a-4113-ac10-73a4d14508ab req-6b3e99e2-899a-40d9-a8b1-a6c6e34c8fae service nova] Creating event network-changed:4e213241-95f3-4caf-a654-70d6036c1d24 for instance 9bed27f7-16a5-414d-bb64-700cb4f5cb4b on n-h1-850499-9 Aug 31 16:12:29.381633 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-2f87d9db-a20a-4113-ac10-73a4d14508ab req-6b3e99e2-899a-40d9-a8b1-a6c6e34c8fae service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114246 Aug 31 16:12:29.384442 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1823/3651] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:12:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:12:29.408376 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-54eebb84-f050-42ef-b4ed-ec88063b0408 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:29.412655 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-54eebb84-f050-42ef-b4ed-ec88063b0408 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 8e287ae9-272b-4148-a159-790187f5d8a3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:29.414614 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-5768fe29-b192-4753-bbdb-f3936a0d6c73 req-ff6b93bb-fff4-4769-8a9d-c89be848da24 service nova] Creating event network-vif-deleted:293f95ee-1eeb-4199-8e23-db11698e1449 for instance 596c5ff8-2dc8-4248-be52-eab6df1793e0 on n-h2-850499-9 Aug 31 16:12:29.423256 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-5768fe29-b192-4753-bbdb-f3936a0d6c73 req-ff6b93bb-fff4-4769-8a9d-c89be848da24 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150692 Aug 31 16:12:29.424728 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1829/3652] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:12:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:12:29.435020 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-54eebb84-f050-42ef-b4ed-ec88063b0408 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:29.435247 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6ecfaa99-dfe5-43de-aa9c-5596a4795635 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:29.436931 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-54eebb84-f050-42ef-b4ed-ec88063b0408 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:29.437682 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-54eebb84-f050-42ef-b4ed-ec88063b0408 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:29.438704 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-54eebb84-f050-42ef-b4ed-ec88063b0408 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:29.439904 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-54eebb84-f050-42ef-b4ed-ec88063b0408 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:29.440594 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-54eebb84-f050-42ef-b4ed-ec88063b0408 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:29.446399 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6ecfaa99-dfe5-43de-aa9c-5596a4795635 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] [instance: 9bed27f7-16a5-414d-bb64-700cb4f5cb4b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:29.465773 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6ecfaa99-dfe5-43de-aa9c-5596a4795635 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:29.466570 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6ecfaa99-dfe5-43de-aa9c-5596a4795635 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:29.467174 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6ecfaa99-dfe5-43de-aa9c-5596a4795635 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:29.468146 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6ecfaa99-dfe5-43de-aa9c-5596a4795635 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:29.469191 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6ecfaa99-dfe5-43de-aa9c-5596a4795635 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:29.470341 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6ecfaa99-dfe5-43de-aa9c-5596a4795635 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:29.551263 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-54eebb84-f050-42ef-b4ed-ec88063b0408 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 8e287ae9-272b-4148-a159-790187f5d8a3] Going to try to terminate instance {{(pid=122256) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:12:29.758503 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-54eebb84-f050-42ef-b4ed-ec88063b0408 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "DELETE /compute/v2.1/servers/8e287ae9-272b-4148-a159-790187f5d8a3" status: 204 len: 0 microversion: 2.1 time: 0.372092 Aug 31 16:12:29.760752 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1824/3653] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:12:29 2022] DELETE /compute/v2.1/servers/8e287ae9-272b-4148-a159-790187f5d8a3 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:12:29.774488 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3cb80151-b9ac-4e76-a3a4-ef8834dc95fe tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:29.776848 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3cb80151-b9ac-4e76-a3a4-ef8834dc95fe tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 8e287ae9-272b-4148-a159-790187f5d8a3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:29.790906 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3cb80151-b9ac-4e76-a3a4-ef8834dc95fe tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:29.794211 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3cb80151-b9ac-4e76-a3a4-ef8834dc95fe tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:29.794976 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3cb80151-b9ac-4e76-a3a4-ef8834dc95fe tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:29.798168 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3cb80151-b9ac-4e76-a3a4-ef8834dc95fe tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:29.798935 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3cb80151-b9ac-4e76-a3a4-ef8834dc95fe tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:29.802530 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3cb80151-b9ac-4e76-a3a4-ef8834dc95fe tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:30.035111 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:12:30.174574 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-6ecfaa99-dfe5-43de-aa9c-5596a4795635 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab268a4d607497da5476256055bb07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14140e7303046f1ada446437826f742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:30.198332 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6ecfaa99-dfe5-43de-aa9c-5596a4795635 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] 10.222.0.61 "GET /compute/v2.1/servers/9bed27f7-16a5-414d-bb64-700cb4f5cb4b" status: 200 len: 1317 microversion: 2.1 time: 0.769559 Aug 31 16:12:30.208478 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1830/3654] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:29 2022] GET /compute/v2.1/servers/9bed27f7-16a5-414d-bb64-700cb4f5cb4b => generated 1317 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:30.315050 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0405ea4c-454a-42c5-9789-dd733afffb53 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:30.316124 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0405ea4c-454a-42c5-9789-dd733afffb53 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] [instance: 596c5ff8-2dc8-4248-be52-eab6df1793e0] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:30.345133 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0405ea4c-454a-42c5-9789-dd733afffb53 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:30.350836 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0405ea4c-454a-42c5-9789-dd733afffb53 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:30.352490 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0405ea4c-454a-42c5-9789-dd733afffb53 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:30.354048 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0405ea4c-454a-42c5-9789-dd733afffb53 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:30.365327 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0405ea4c-454a-42c5-9789-dd733afffb53 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:30.366104 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0405ea4c-454a-42c5-9789-dd733afffb53 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:30.423731 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-0405ea4c-454a-42c5-9789-dd733afffb53 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] HTTP exception thrown: Instance 596c5ff8-2dc8-4248-be52-eab6df1793e0 could not be found. Aug 31 16:12:30.427548 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0405ea4c-454a-42c5-9789-dd733afffb53 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Request method failure captured: Aug 31 16:12:30.427548 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/596c5ff8-2dc8-4248-be52-eab6df1793e0 HTTP/1.1 Aug 31 16:12:30.427548 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:12:30.427548 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:12:30.427548 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:12:30.427548 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:12:30.427548 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:12:30.427548 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:12:30.427548 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:12:30.427548 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:12:30.427548 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4gr7VKqVX2wOeXpLpydWHmbrXehZHzToH1WiChCJvw7iF8CxXKWzQ26RqxqctqnDZRmpKkiolPKOHp6f8r2tHb6CFNOSn4RNFLts5Pd5ceoOSgXmSCZYtI01whCK8rvvWmTaDgmficIzu41gzLMpcBsmOZ6AKZ2Ca5KjVyvdeOExt4 Aug 31 16:12:30.427548 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:12:30.427548 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:12:30.427548 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:12:30.427548 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:12:30.427548 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:12:30.427548 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:12:30.427548 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 859e7bbce8ed4dea985c73abe3ec8cd8 Aug 31 16:12:30.427548 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ServerGroupTestJSON-235867701 Aug 31 16:12:30.427548 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:12:30.427548 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:12:30.427548 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/859e7bbce8ed4dea985c73abe3ec8cd8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/859e7bbce8ed4dea985c73abe3ec8cd8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_859e7bbce8ed4dea985c73abe3ec8cd8", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/859e7bbce8ed4dea985c73abe3ec8cd8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:12:30.427548 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ServerGroupTestJSON-235867701 Aug 31 16:12:30.427548 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 859e7bbce8ed4dea985c73abe3ec8cd8 Aug 31 16:12:30.427548 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ServerGroupTestJSON-235867701 Aug 31 16:12:30.427548 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ServerGroupTestJSON-235867701-project Aug 31 16:12:30.427548 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:12:30.427548 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:12:30.427548 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: de1444fdefda4eaeac9b11577ad7248b Aug 31 16:12:30.427548 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ServerGroupTestJSON-235867701-project Aug 31 16:12:30.427548 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:12:30.427548 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance 596c5ff8-2dc8-4248-be52-eab6df1793e0 could not be found. Aug 31 16:12:30.427548 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '596c5ff8-2dc8-4248-be52-eab6df1793e0'} Aug 31 16:12:30.427548 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:12:30.427548 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:12:30.427548 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:12:30.427548 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:12:30.427548 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:12:30.427548 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:12:30.427548 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:12:30.427548 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:12:30.427548 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:12:30.427548 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:12:30.427548 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 596c5ff8-2dc8-4248-be52-eab6df1793e0 could not be found. Aug 31 16:12:30.427548 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:12:30.427548 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:12:30.427548 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:12:30.427548 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:12:30.427548 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:12:30.427548 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:12:30.427548 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:12:30.427548 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:12:30.427548 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:12:30.427548 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:12:30.427548 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:12:30.427548 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:12:30.427548 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:12:30.427548 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:12:30.427548 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:12:30.427548 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:12:30.427548 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 596c5ff8-2dc8-4248-be52-eab6df1793e0 could not be found. Aug 31 16:12:30.427548 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:12:30.427548 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:12:30.427548 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:12:30.436392 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:12:30.436392 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:12:30.436392 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:12:30.436392 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:12:30.436392 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:12:30.436392 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 596c5ff8-2dc8-4248-be52-eab6df1793e0 could not be found. Aug 31 16:12:30.436392 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:12:30.439763 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0405ea4c-454a-42c5-9789-dd733afffb53 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Returning 404 to user: Instance 596c5ff8-2dc8-4248-be52-eab6df1793e0 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:12:30.441617 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0405ea4c-454a-42c5-9789-dd733afffb53 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] 10.222.0.61 "GET /compute/v2.1/servers/596c5ff8-2dc8-4248-be52-eab6df1793e0" status: 404 len: 111 microversion: 2.1 time: 0.137894 Aug 31 16:12:30.460879 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1831/3655] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:30 2022] GET /compute/v2.1/servers/596c5ff8-2dc8-4248-be52-eab6df1793e0 => generated 111 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 16:12:30.466813 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9b970cde-1b48-4641-b51a-a00ca5dcfabf tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:30.494687 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.compute.server_groups [None req-9b970cde-1b48-4641-b51a-a00ca5dcfabf tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Querying cell 9f6d6683-96bf-42a7-a78d-78a22f1453ed(cell1) for 1 instances {{(pid=122257) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 31 16:12:30.495774 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9b970cde-1b48-4641-b51a-a00ca5dcfabf tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:30.496558 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9b970cde-1b48-4641-b51a-a00ca5dcfabf tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:30.497445 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9b970cde-1b48-4641-b51a-a00ca5dcfabf tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:30.518975 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9b970cde-1b48-4641-b51a-a00ca5dcfabf tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] 10.222.0.61 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.056247 Aug 31 16:12:30.522094 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1832/3656] 10.222.0.61 () {58 vars in 1152 bytes} [Wed Aug 31 16:12:30 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:12:30.537948 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1456c01d-23fb-4650-91fc-13f57d1573a3 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:30.573873 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3cb80151-b9ac-4e76-a3a4-ef8834dc95fe tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:30.582330 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3cb80151-b9ac-4e76-a3a4-ef8834dc95fe tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/8e287ae9-272b-4148-a159-790187f5d8a3" status: 200 len: 1514 microversion: 2.1 time: 0.813638 Aug 31 16:12:30.600323 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1825/3657] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:29 2022] GET /compute/v2.1/servers/8e287ae9-272b-4148-a159-790187f5d8a3 => generated 1514 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:30.608566 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.compute.server_groups [None req-1456c01d-23fb-4650-91fc-13f57d1573a3 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Querying cell 9f6d6683-96bf-42a7-a78d-78a22f1453ed(cell1) for 1 instances {{(pid=122257) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 31 16:12:30.618552 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1456c01d-23fb-4650-91fc-13f57d1573a3 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:30.619445 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1456c01d-23fb-4650-91fc-13f57d1573a3 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:30.620181 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1456c01d-23fb-4650-91fc-13f57d1573a3 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:30.652824 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1456c01d-23fb-4650-91fc-13f57d1573a3 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] 10.222.0.61 "GET /compute/v2.1/os-server-groups/8c9fbf5a-c35f-4cec-ab26-f8079a47a3d8" status: 200 len: 183 microversion: 2.1 time: 0.122605 Aug 31 16:12:30.655996 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1833/3658] 10.222.0.61 () {58 vars in 1263 bytes} [Wed Aug 31 16:12:30 2022] GET /compute/v2.1/os-server-groups/8c9fbf5a-c35f-4cec-ab26-f8079a47a3d8 => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:12:30.668049 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-cb6d63e0-1505-438a-88c6-7ec3915859db tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:30.668932 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-cb6d63e0-1505-438a-88c6-7ec3915859db tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] [instance: 596c5ff8-2dc8-4248-be52-eab6df1793e0] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:30.690205 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cb6d63e0-1505-438a-88c6-7ec3915859db tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:30.691077 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cb6d63e0-1505-438a-88c6-7ec3915859db tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:30.691754 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cb6d63e0-1505-438a-88c6-7ec3915859db tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:30.693674 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cb6d63e0-1505-438a-88c6-7ec3915859db tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:30.694394 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cb6d63e0-1505-438a-88c6-7ec3915859db tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:30.695024 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cb6d63e0-1505-438a-88c6-7ec3915859db tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:30.725697 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-cb6d63e0-1505-438a-88c6-7ec3915859db tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] HTTP exception thrown: Instance 596c5ff8-2dc8-4248-be52-eab6df1793e0 could not be found. Aug 31 16:12:30.727712 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-cb6d63e0-1505-438a-88c6-7ec3915859db tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Request method failure captured: Aug 31 16:12:30.727712 n-d-850499-9 devstack@n-api.service[122256]: request: DELETE /compute/v2.1/servers/596c5ff8-2dc8-4248-be52-eab6df1793e0 HTTP/1.1 Aug 31 16:12:30.727712 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:12:30.727712 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:12:30.727712 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:12:30.727712 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:12:30.727712 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:12:30.727712 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:12:30.727712 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:12:30.727712 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:12:30.727712 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4gr7VKqVX2wOeXpLpydWHmbrXehZHzToH1WiChCJvw7iF8CxXKWzQ26RqxqctqnDZRmpKkiolPKOHp6f8r2tHb6CFNOSn4RNFLts5Pd5ceoOSgXmSCZYtI01whCK8rvvWmTaDgmficIzu41gzLMpcBsmOZ6AKZ2Ca5KjVyvdeOExt4 Aug 31 16:12:30.727712 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:12:30.727712 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:12:30.727712 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:12:30.727712 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:12:30.727712 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:12:30.727712 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:12:30.727712 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 859e7bbce8ed4dea985c73abe3ec8cd8 Aug 31 16:12:30.727712 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ServerGroupTestJSON-235867701 Aug 31 16:12:30.727712 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:12:30.727712 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:12:30.727712 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/859e7bbce8ed4dea985c73abe3ec8cd8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/859e7bbce8ed4dea985c73abe3ec8cd8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_859e7bbce8ed4dea985c73abe3ec8cd8", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/859e7bbce8ed4dea985c73abe3ec8cd8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:12:30.727712 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ServerGroupTestJSON-235867701 Aug 31 16:12:30.727712 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 859e7bbce8ed4dea985c73abe3ec8cd8 Aug 31 16:12:30.727712 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ServerGroupTestJSON-235867701 Aug 31 16:12:30.727712 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ServerGroupTestJSON-235867701-project Aug 31 16:12:30.727712 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:12:30.727712 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:12:30.727712 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: de1444fdefda4eaeac9b11577ad7248b Aug 31 16:12:30.727712 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ServerGroupTestJSON-235867701-project Aug 31 16:12:30.727712 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:12:30.727712 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance 596c5ff8-2dc8-4248-be52-eab6df1793e0 could not be found. Aug 31 16:12:30.727712 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '596c5ff8-2dc8-4248-be52-eab6df1793e0'} Aug 31 16:12:30.727712 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:12:30.727712 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:12:30.727712 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:12:30.727712 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:12:30.727712 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:12:30.727712 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:12:30.727712 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:12:30.727712 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:12:30.727712 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:12:30.727712 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:12:30.727712 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 596c5ff8-2dc8-4248-be52-eab6df1793e0 could not be found. Aug 31 16:12:30.727712 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:12:30.727712 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:12:30.727712 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:12:30.727712 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:12:30.727712 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:12:30.727712 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:12:30.727712 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:12:30.727712 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:12:30.727712 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:12:30.727712 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:12:30.727712 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:12:30.727712 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:12:30.727712 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:12:30.727712 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:12:30.727712 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:12:30.727712 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:12:30.727712 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:12:30.727712 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:12:30.732544 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 596c5ff8-2dc8-4248-be52-eab6df1793e0 could not be found. Aug 31 16:12:30.732544 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:12:30.732544 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:12:30.732544 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:12:30.732544 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:12:30.732544 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:12:30.732544 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:12:30.732544 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:12:30.732544 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:12:30.732544 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 596c5ff8-2dc8-4248-be52-eab6df1793e0 could not be found. Aug 31 16:12:30.732544 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:12:30.734234 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-cb6d63e0-1505-438a-88c6-7ec3915859db tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Returning 404 to user: Instance 596c5ff8-2dc8-4248-be52-eab6df1793e0 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:12:30.735280 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-cb6d63e0-1505-438a-88c6-7ec3915859db tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] 10.222.0.61 "DELETE /compute/v2.1/servers/596c5ff8-2dc8-4248-be52-eab6df1793e0" status: 404 len: 111 microversion: 2.1 time: 0.071290 Aug 31 16:12:30.736479 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1826/3659] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:12:30 2022] DELETE /compute/v2.1/servers/596c5ff8-2dc8-4248-be52-eab6df1793e0 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:12:30.745829 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d298f3a9-8ca1-4296-b189-777872b7ba69 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:30.746627 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d298f3a9-8ca1-4296-b189-777872b7ba69 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] [instance: 596c5ff8-2dc8-4248-be52-eab6df1793e0] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:30.759938 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d298f3a9-8ca1-4296-b189-777872b7ba69 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:30.761637 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d298f3a9-8ca1-4296-b189-777872b7ba69 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:30.764029 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d298f3a9-8ca1-4296-b189-777872b7ba69 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:30.764927 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d298f3a9-8ca1-4296-b189-777872b7ba69 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:30.766428 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d298f3a9-8ca1-4296-b189-777872b7ba69 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:30.768887 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d298f3a9-8ca1-4296-b189-777872b7ba69 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:30.825157 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-d298f3a9-8ca1-4296-b189-777872b7ba69 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] HTTP exception thrown: Instance 596c5ff8-2dc8-4248-be52-eab6df1793e0 could not be found. Aug 31 16:12:30.826845 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d298f3a9-8ca1-4296-b189-777872b7ba69 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Request method failure captured: Aug 31 16:12:30.826845 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/596c5ff8-2dc8-4248-be52-eab6df1793e0 HTTP/1.1 Aug 31 16:12:30.826845 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:12:30.826845 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:12:30.826845 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:12:30.826845 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:12:30.826845 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:12:30.826845 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:12:30.826845 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:12:30.826845 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:12:30.826845 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4gr7VKqVX2wOeXpLpydWHmbrXehZHzToH1WiChCJvw7iF8CxXKWzQ26RqxqctqnDZRmpKkiolPKOHp6f8r2tHb6CFNOSn4RNFLts5Pd5ceoOSgXmSCZYtI01whCK8rvvWmTaDgmficIzu41gzLMpcBsmOZ6AKZ2Ca5KjVyvdeOExt4 Aug 31 16:12:30.826845 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:12:30.826845 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:12:30.826845 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:12:30.826845 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:12:30.826845 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:12:30.826845 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:12:30.826845 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 859e7bbce8ed4dea985c73abe3ec8cd8 Aug 31 16:12:30.826845 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ServerGroupTestJSON-235867701 Aug 31 16:12:30.826845 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:12:30.826845 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:12:30.826845 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/859e7bbce8ed4dea985c73abe3ec8cd8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/859e7bbce8ed4dea985c73abe3ec8cd8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_859e7bbce8ed4dea985c73abe3ec8cd8", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/859e7bbce8ed4dea985c73abe3ec8cd8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:12:30.826845 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ServerGroupTestJSON-235867701 Aug 31 16:12:30.826845 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 859e7bbce8ed4dea985c73abe3ec8cd8 Aug 31 16:12:30.826845 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ServerGroupTestJSON-235867701 Aug 31 16:12:30.826845 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ServerGroupTestJSON-235867701-project Aug 31 16:12:30.826845 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:12:30.826845 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:12:30.826845 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: de1444fdefda4eaeac9b11577ad7248b Aug 31 16:12:30.826845 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ServerGroupTestJSON-235867701-project Aug 31 16:12:30.826845 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:12:30.826845 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance 596c5ff8-2dc8-4248-be52-eab6df1793e0 could not be found. Aug 31 16:12:30.826845 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '596c5ff8-2dc8-4248-be52-eab6df1793e0'} Aug 31 16:12:30.826845 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:12:30.826845 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:12:30.826845 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:12:30.826845 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:12:30.826845 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:12:30.826845 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:12:30.826845 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:12:30.826845 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:12:30.826845 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:12:30.826845 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:12:30.826845 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 596c5ff8-2dc8-4248-be52-eab6df1793e0 could not be found. Aug 31 16:12:30.826845 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:12:30.826845 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:12:30.826845 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:12:30.826845 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:12:30.826845 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:12:30.826845 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:12:30.826845 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:12:30.826845 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:12:30.826845 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:12:30.826845 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:12:30.826845 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:12:30.826845 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:12:30.826845 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:12:30.826845 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:12:30.826845 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:12:30.826845 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:12:30.826845 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 596c5ff8-2dc8-4248-be52-eab6df1793e0 could not be found. Aug 31 16:12:30.826845 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:12:30.826845 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:12:30.826845 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:12:30.831068 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:12:30.831068 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:12:30.831068 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:12:30.831068 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:12:30.831068 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:12:30.831068 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 596c5ff8-2dc8-4248-be52-eab6df1793e0 could not be found. Aug 31 16:12:30.831068 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:12:30.831068 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d298f3a9-8ca1-4296-b189-777872b7ba69 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Returning 404 to user: Instance 596c5ff8-2dc8-4248-be52-eab6df1793e0 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:12:30.831068 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d298f3a9-8ca1-4296-b189-777872b7ba69 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] 10.222.0.61 "GET /compute/v2.1/servers/596c5ff8-2dc8-4248-be52-eab6df1793e0" status: 404 len: 111 microversion: 2.1 time: 0.087784 Aug 31 16:12:30.831068 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1834/3660] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:30 2022] GET /compute/v2.1/servers/596c5ff8-2dc8-4248-be52-eab6df1793e0 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:12:30.838001 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-43c9a339-705e-4e6d-aa59-0cf5359384cb tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:30.844897 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-43c9a339-705e-4e6d-aa59-0cf5359384cb tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] HTTP exception thrown: Instance group 5ffb21ef-7dcf-4059-9498-4599fba7ce48 could not be found. Aug 31 16:12:30.850649 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-43c9a339-705e-4e6d-aa59-0cf5359384cb tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Request method failure captured: Aug 31 16:12:30.850649 n-d-850499-9 devstack@n-api.service[122256]: request: DELETE /compute/v2.1/os-server-groups/5ffb21ef-7dcf-4059-9498-4599fba7ce48 HTTP/1.1 Aug 31 16:12:30.850649 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:12:30.850649 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:12:30.850649 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:12:30.850649 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:12:30.850649 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:12:30.850649 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:12:30.850649 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:12:30.850649 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:12:30.850649 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4gr7VKqVX2wOeXpLpydWHmbrXehZHzToH1WiChCJvw7iF8CxXKWzQ26RqxqctqnDZRmpKkiolPKOHp6f8r2tHb6CFNOSn4RNFLts5Pd5ceoOSgXmSCZYtI01whCK8rvvWmTaDgmficIzu41gzLMpcBsmOZ6AKZ2Ca5KjVyvdeOExt4 Aug 31 16:12:30.850649 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:12:30.850649 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:12:30.850649 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:12:30.850649 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:12:30.850649 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:12:30.850649 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:12:30.850649 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 859e7bbce8ed4dea985c73abe3ec8cd8 Aug 31 16:12:30.850649 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ServerGroupTestJSON-235867701 Aug 31 16:12:30.850649 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:12:30.850649 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:12:30.850649 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/859e7bbce8ed4dea985c73abe3ec8cd8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/859e7bbce8ed4dea985c73abe3ec8cd8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_859e7bbce8ed4dea985c73abe3ec8cd8", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/859e7bbce8ed4dea985c73abe3ec8cd8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:12:30.850649 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ServerGroupTestJSON-235867701 Aug 31 16:12:30.850649 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 859e7bbce8ed4dea985c73abe3ec8cd8 Aug 31 16:12:30.850649 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ServerGroupTestJSON-235867701 Aug 31 16:12:30.850649 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ServerGroupTestJSON-235867701-project Aug 31 16:12:30.850649 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:12:30.850649 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:12:30.850649 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: de1444fdefda4eaeac9b11577ad7248b Aug 31 16:12:30.850649 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ServerGroupTestJSON-235867701-project Aug 31 16:12:30.850649 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:12:30.850649 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance group 5ffb21ef-7dcf-4059-9498-4599fba7ce48 could not be found. Aug 31 16:12:30.850649 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '5ffb21ef-7dcf-4059-9498-4599fba7ce48'} Aug 31 16:12:30.850649 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:12:30.850649 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:12:30.850649 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 31 16:12:30.850649 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 31 16:12:30.850649 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 16:12:30.850649 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 16:12:30.850649 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 31 16:12:30.850649 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 31 16:12:30.850649 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 31 16:12:30.850649 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 31 16:12:30.850649 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 31 16:12:30.850649 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 31 16:12:30.850649 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 5ffb21ef-7dcf-4059-9498-4599fba7ce48 could not be found. Aug 31 16:12:30.850649 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:12:30.850649 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:12:30.850649 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:12:30.850649 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:12:30.850649 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:12:30.850649 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:12:30.850649 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:12:30.850649 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:12:30.850649 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:12:30.850649 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:12:30.850649 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 31 16:12:30.850649 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:12:30.850649 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 5ffb21ef-7dcf-4059-9498-4599fba7ce48 could not be found. Aug 31 16:12:30.850649 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:12:30.850649 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:12:30.850649 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:12:30.850649 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:12:30.855168 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:12:30.855168 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:12:30.855168 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:12:30.855168 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:12:30.855168 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 5ffb21ef-7dcf-4059-9498-4599fba7ce48 could not be found. Aug 31 16:12:30.855168 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:12:30.855168 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-43c9a339-705e-4e6d-aa59-0cf5359384cb tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Returning 404 to user: Instance group 5ffb21ef-7dcf-4059-9498-4599fba7ce48 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:12:30.855168 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-43c9a339-705e-4e6d-aa59-0cf5359384cb tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] 10.222.0.61 "DELETE /compute/v2.1/os-server-groups/5ffb21ef-7dcf-4059-9498-4599fba7ce48" status: 404 len: 117 microversion: 2.1 time: 0.018540 Aug 31 16:12:30.857348 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1827/3661] 10.222.0.61 () {58 vars in 1266 bytes} [Wed Aug 31 16:12:30 2022] DELETE /compute/v2.1/os-server-groups/5ffb21ef-7dcf-4059-9498-4599fba7ce48 => generated 117 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:12:30.865130 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-72f026b1-1b0a-483f-a783-5d960bba4f71 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:30.881249 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-72f026b1-1b0a-483f-a783-5d960bba4f71 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] HTTP exception thrown: Instance group a477d232-2344-4655-b54e-cc1171d27bba could not be found. Aug 31 16:12:30.884869 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-72f026b1-1b0a-483f-a783-5d960bba4f71 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Request method failure captured: Aug 31 16:12:30.884869 n-d-850499-9 devstack@n-api.service[122257]: request: DELETE /compute/v2.1/os-server-groups/a477d232-2344-4655-b54e-cc1171d27bba HTTP/1.1 Aug 31 16:12:30.884869 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:12:30.884869 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:12:30.884869 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:12:30.884869 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:12:30.884869 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:12:30.884869 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:12:30.884869 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:12:30.884869 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:12:30.884869 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4gr7VKqVX2wOeXpLpydWHmbrXehZHzToH1WiChCJvw7iF8CxXKWzQ26RqxqctqnDZRmpKkiolPKOHp6f8r2tHb6CFNOSn4RNFLts5Pd5ceoOSgXmSCZYtI01whCK8rvvWmTaDgmficIzu41gzLMpcBsmOZ6AKZ2Ca5KjVyvdeOExt4 Aug 31 16:12:30.884869 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:12:30.884869 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:12:30.884869 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:12:30.884869 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:12:30.884869 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:12:30.884869 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:12:30.884869 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 859e7bbce8ed4dea985c73abe3ec8cd8 Aug 31 16:12:30.884869 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ServerGroupTestJSON-235867701 Aug 31 16:12:30.884869 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:12:30.884869 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:12:30.884869 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/859e7bbce8ed4dea985c73abe3ec8cd8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/859e7bbce8ed4dea985c73abe3ec8cd8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_859e7bbce8ed4dea985c73abe3ec8cd8", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/859e7bbce8ed4dea985c73abe3ec8cd8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:12:30.884869 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ServerGroupTestJSON-235867701 Aug 31 16:12:30.884869 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 859e7bbce8ed4dea985c73abe3ec8cd8 Aug 31 16:12:30.884869 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ServerGroupTestJSON-235867701 Aug 31 16:12:30.884869 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ServerGroupTestJSON-235867701-project Aug 31 16:12:30.884869 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:12:30.884869 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:12:30.884869 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: de1444fdefda4eaeac9b11577ad7248b Aug 31 16:12:30.884869 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ServerGroupTestJSON-235867701-project Aug 31 16:12:30.884869 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:12:30.884869 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance group a477d232-2344-4655-b54e-cc1171d27bba could not be found. Aug 31 16:12:30.884869 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': 'a477d232-2344-4655-b54e-cc1171d27bba'} Aug 31 16:12:30.884869 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:12:30.884869 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:12:30.884869 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 31 16:12:30.884869 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 31 16:12:30.884869 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 16:12:30.884869 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 16:12:30.884869 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 31 16:12:30.884869 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 31 16:12:30.884869 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 31 16:12:30.884869 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 31 16:12:30.884869 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 31 16:12:30.884869 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 31 16:12:30.884869 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group a477d232-2344-4655-b54e-cc1171d27bba could not be found. Aug 31 16:12:30.884869 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:12:30.884869 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:12:30.884869 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:12:30.884869 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:12:30.884869 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:12:30.884869 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:12:30.884869 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:12:30.884869 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:12:30.884869 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:12:30.884869 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:12:30.884869 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 31 16:12:30.884869 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:12:30.884869 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group a477d232-2344-4655-b54e-cc1171d27bba could not be found. Aug 31 16:12:30.884869 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:12:30.884869 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:12:30.884869 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:12:30.884869 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:12:30.889245 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:12:30.889245 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:12:30.889245 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:12:30.889245 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:12:30.889245 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group a477d232-2344-4655-b54e-cc1171d27bba could not be found. Aug 31 16:12:30.889245 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:12:30.889245 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-72f026b1-1b0a-483f-a783-5d960bba4f71 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Returning 404 to user: Instance group a477d232-2344-4655-b54e-cc1171d27bba could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:12:30.889708 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-72f026b1-1b0a-483f-a783-5d960bba4f71 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] 10.222.0.61 "DELETE /compute/v2.1/os-server-groups/a477d232-2344-4655-b54e-cc1171d27bba" status: 404 len: 117 microversion: 2.1 time: 0.029444 Aug 31 16:12:30.892069 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1835/3662] 10.222.0.61 () {58 vars in 1266 bytes} [Wed Aug 31 16:12:30 2022] DELETE /compute/v2.1/os-server-groups/a477d232-2344-4655-b54e-cc1171d27bba => generated 117 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:12:30.901810 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c1261b4b-d7a7-4ad0-9a89-67854c672fd8 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:30.920173 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-c1261b4b-d7a7-4ad0-9a89-67854c672fd8 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] HTTP exception thrown: Instance group 122baed1-49cd-460f-98fb-b05f48a941ee could not be found. Aug 31 16:12:30.922021 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c1261b4b-d7a7-4ad0-9a89-67854c672fd8 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Request method failure captured: Aug 31 16:12:30.922021 n-d-850499-9 devstack@n-api.service[122256]: request: DELETE /compute/v2.1/os-server-groups/122baed1-49cd-460f-98fb-b05f48a941ee HTTP/1.1 Aug 31 16:12:30.922021 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:12:30.922021 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:12:30.922021 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:12:30.922021 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:12:30.922021 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:12:30.922021 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:12:30.922021 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:12:30.922021 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:12:30.922021 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4gr7VKqVX2wOeXpLpydWHmbrXehZHzToH1WiChCJvw7iF8CxXKWzQ26RqxqctqnDZRmpKkiolPKOHp6f8r2tHb6CFNOSn4RNFLts5Pd5ceoOSgXmSCZYtI01whCK8rvvWmTaDgmficIzu41gzLMpcBsmOZ6AKZ2Ca5KjVyvdeOExt4 Aug 31 16:12:30.922021 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:12:30.922021 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:12:30.922021 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:12:30.922021 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:12:30.922021 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:12:30.922021 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:12:30.922021 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 859e7bbce8ed4dea985c73abe3ec8cd8 Aug 31 16:12:30.922021 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ServerGroupTestJSON-235867701 Aug 31 16:12:30.922021 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:12:30.922021 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:12:30.922021 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/859e7bbce8ed4dea985c73abe3ec8cd8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/859e7bbce8ed4dea985c73abe3ec8cd8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_859e7bbce8ed4dea985c73abe3ec8cd8", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/859e7bbce8ed4dea985c73abe3ec8cd8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:12:30.922021 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ServerGroupTestJSON-235867701 Aug 31 16:12:30.922021 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 859e7bbce8ed4dea985c73abe3ec8cd8 Aug 31 16:12:30.922021 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ServerGroupTestJSON-235867701 Aug 31 16:12:30.922021 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ServerGroupTestJSON-235867701-project Aug 31 16:12:30.922021 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:12:30.922021 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:12:30.922021 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: de1444fdefda4eaeac9b11577ad7248b Aug 31 16:12:30.922021 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ServerGroupTestJSON-235867701-project Aug 31 16:12:30.922021 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:12:30.922021 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance group 122baed1-49cd-460f-98fb-b05f48a941ee could not be found. Aug 31 16:12:30.922021 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '122baed1-49cd-460f-98fb-b05f48a941ee'} Aug 31 16:12:30.922021 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:12:30.922021 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:12:30.922021 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 31 16:12:30.922021 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 31 16:12:30.922021 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 16:12:30.922021 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 16:12:30.922021 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 31 16:12:30.922021 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 31 16:12:30.922021 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 31 16:12:30.922021 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 31 16:12:30.922021 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 31 16:12:30.922021 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 31 16:12:30.922021 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 122baed1-49cd-460f-98fb-b05f48a941ee could not be found. Aug 31 16:12:30.922021 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:12:30.922021 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:12:30.922021 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:12:30.922021 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:12:30.922021 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:12:30.922021 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:12:30.922021 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:12:30.922021 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:12:30.922021 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:12:30.922021 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:12:30.922021 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 31 16:12:30.922021 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:12:30.922021 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 122baed1-49cd-460f-98fb-b05f48a941ee could not be found. Aug 31 16:12:30.922021 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:12:30.922021 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:12:30.922021 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:12:30.922021 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:12:30.927577 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:12:30.927577 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:12:30.927577 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:12:30.927577 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:12:30.927577 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 122baed1-49cd-460f-98fb-b05f48a941ee could not be found. Aug 31 16:12:30.927577 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:12:30.927577 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c1261b4b-d7a7-4ad0-9a89-67854c672fd8 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Returning 404 to user: Instance group 122baed1-49cd-460f-98fb-b05f48a941ee could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:12:30.927577 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c1261b4b-d7a7-4ad0-9a89-67854c672fd8 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] 10.222.0.61 "DELETE /compute/v2.1/os-server-groups/122baed1-49cd-460f-98fb-b05f48a941ee" status: 404 len: 117 microversion: 2.1 time: 0.026615 Aug 31 16:12:30.928253 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1828/3663] 10.222.0.61 () {58 vars in 1266 bytes} [Wed Aug 31 16:12:30 2022] DELETE /compute/v2.1/os-server-groups/122baed1-49cd-460f-98fb-b05f48a941ee => generated 117 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:12:30.937508 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e83ebaba-b1ec-407c-bd9b-cfa1ff51d581 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:30.947289 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-e83ebaba-b1ec-407c-bd9b-cfa1ff51d581 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] HTTP exception thrown: Instance group c00530e7-9668-4e82-850e-02e24aeee959 could not be found. Aug 31 16:12:30.949029 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e83ebaba-b1ec-407c-bd9b-cfa1ff51d581 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Request method failure captured: Aug 31 16:12:30.949029 n-d-850499-9 devstack@n-api.service[122257]: request: DELETE /compute/v2.1/os-server-groups/c00530e7-9668-4e82-850e-02e24aeee959 HTTP/1.1 Aug 31 16:12:30.949029 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:12:30.949029 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:12:30.949029 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:12:30.949029 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:12:30.949029 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:12:30.949029 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:12:30.949029 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:12:30.949029 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:12:30.949029 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4gr7VKqVX2wOeXpLpydWHmbrXehZHzToH1WiChCJvw7iF8CxXKWzQ26RqxqctqnDZRmpKkiolPKOHp6f8r2tHb6CFNOSn4RNFLts5Pd5ceoOSgXmSCZYtI01whCK8rvvWmTaDgmficIzu41gzLMpcBsmOZ6AKZ2Ca5KjVyvdeOExt4 Aug 31 16:12:30.949029 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:12:30.949029 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:12:30.949029 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:12:30.949029 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:12:30.949029 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:12:30.949029 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:12:30.949029 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 859e7bbce8ed4dea985c73abe3ec8cd8 Aug 31 16:12:30.949029 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ServerGroupTestJSON-235867701 Aug 31 16:12:30.949029 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:12:30.949029 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:12:30.949029 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/859e7bbce8ed4dea985c73abe3ec8cd8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/859e7bbce8ed4dea985c73abe3ec8cd8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_859e7bbce8ed4dea985c73abe3ec8cd8", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/859e7bbce8ed4dea985c73abe3ec8cd8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:12:30.949029 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ServerGroupTestJSON-235867701 Aug 31 16:12:30.949029 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 859e7bbce8ed4dea985c73abe3ec8cd8 Aug 31 16:12:30.949029 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ServerGroupTestJSON-235867701 Aug 31 16:12:30.949029 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ServerGroupTestJSON-235867701-project Aug 31 16:12:30.949029 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:12:30.949029 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:12:30.949029 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: de1444fdefda4eaeac9b11577ad7248b Aug 31 16:12:30.949029 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ServerGroupTestJSON-235867701-project Aug 31 16:12:30.949029 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:12:30.949029 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance group c00530e7-9668-4e82-850e-02e24aeee959 could not be found. Aug 31 16:12:30.949029 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': 'c00530e7-9668-4e82-850e-02e24aeee959'} Aug 31 16:12:30.949029 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:12:30.949029 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:12:30.949029 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 31 16:12:30.949029 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 31 16:12:30.949029 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 16:12:30.949029 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 16:12:30.949029 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 31 16:12:30.949029 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 31 16:12:30.949029 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 31 16:12:30.949029 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 31 16:12:30.949029 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 31 16:12:30.949029 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 31 16:12:30.949029 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group c00530e7-9668-4e82-850e-02e24aeee959 could not be found. Aug 31 16:12:30.949029 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:12:30.949029 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:12:30.949029 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:12:30.949029 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:12:30.949029 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:12:30.949029 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:12:30.949029 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:12:30.949029 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:12:30.949029 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:12:30.949029 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:12:30.949029 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 31 16:12:30.949029 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:12:30.949029 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group c00530e7-9668-4e82-850e-02e24aeee959 could not be found. Aug 31 16:12:30.949029 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:12:30.949029 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:12:30.949029 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:12:30.949029 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:12:30.953198 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:12:30.953198 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:12:30.953198 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:12:30.953198 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:12:30.953198 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group c00530e7-9668-4e82-850e-02e24aeee959 could not be found. Aug 31 16:12:30.953198 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:12:30.953198 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e83ebaba-b1ec-407c-bd9b-cfa1ff51d581 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Returning 404 to user: Instance group c00530e7-9668-4e82-850e-02e24aeee959 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:12:30.953198 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e83ebaba-b1ec-407c-bd9b-cfa1ff51d581 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] 10.222.0.61 "DELETE /compute/v2.1/os-server-groups/c00530e7-9668-4e82-850e-02e24aeee959" status: 404 len: 117 microversion: 2.1 time: 0.017991 Aug 31 16:12:30.953198 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1836/3664] 10.222.0.61 () {58 vars in 1266 bytes} [Wed Aug 31 16:12:30 2022] DELETE /compute/v2.1/os-server-groups/c00530e7-9668-4e82-850e-02e24aeee959 => generated 117 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 16:12:30.963622 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2c08ed56-f8ce-49fd-bf2a-24102a1473f7 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:31.000675 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2c08ed56-f8ce-49fd-bf2a-24102a1473f7 tempest-ServerGroupTestJSON-235867701 tempest-ServerGroupTestJSON-235867701-project] 10.222.0.61 "DELETE /compute/v2.1/os-server-groups/8c9fbf5a-c35f-4cec-ab26-f8079a47a3d8" status: 204 len: 0 microversion: 2.1 time: 0.043828 Aug 31 16:12:31.001274 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1829/3665] 10.222.0.61 () {58 vars in 1266 bytes} [Wed Aug 31 16:12:30 2022] DELETE /compute/v2.1/os-server-groups/8c9fbf5a-c35f-4cec-ab26-f8079a47a3d8 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:12:31.233398 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ad8dfdee-358e-44de-b80e-962930462cdd tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:31.234228 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ad8dfdee-358e-44de-b80e-962930462cdd tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] [instance: 9bed27f7-16a5-414d-bb64-700cb4f5cb4b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:31.242066 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ad8dfdee-358e-44de-b80e-962930462cdd tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:31.243028 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ad8dfdee-358e-44de-b80e-962930462cdd tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:31.243735 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ad8dfdee-358e-44de-b80e-962930462cdd tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:31.244682 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ad8dfdee-358e-44de-b80e-962930462cdd tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:31.245398 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ad8dfdee-358e-44de-b80e-962930462cdd tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:31.246050 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ad8dfdee-358e-44de-b80e-962930462cdd tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:31.610237 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f350e5fe-62f6-4832-8906-759c21170cf2 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:31.611743 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f350e5fe-62f6-4832-8906-759c21170cf2 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 8e287ae9-272b-4148-a159-790187f5d8a3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:31.636647 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f350e5fe-62f6-4832-8906-759c21170cf2 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:31.637903 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f350e5fe-62f6-4832-8906-759c21170cf2 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:31.638982 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f350e5fe-62f6-4832-8906-759c21170cf2 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:31.648561 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f350e5fe-62f6-4832-8906-759c21170cf2 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:31.651003 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f350e5fe-62f6-4832-8906-759c21170cf2 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:31.651961 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f350e5fe-62f6-4832-8906-759c21170cf2 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:31.896572 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ad8dfdee-358e-44de-b80e-962930462cdd tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab268a4d607497da5476256055bb07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14140e7303046f1ada446437826f742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:31.899712 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:12:31.915888 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ad8dfdee-358e-44de-b80e-962930462cdd tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] 10.222.0.61 "GET /compute/v2.1/servers/9bed27f7-16a5-414d-bb64-700cb4f5cb4b" status: 200 len: 1317 microversion: 2.1 time: 0.686189 Aug 31 16:12:31.931598 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1837/3666] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:31 2022] GET /compute/v2.1/servers/9bed27f7-16a5-414d-bb64-700cb4f5cb4b => generated 1317 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:31.939186 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-e998e5bd-ddfe-4687-97b7-c00541ce98a3 req-a251c401-f6b2-487d-8ee2-9706f3909f61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af6da672-bcfb-433b-b868-3dd1dd3e4770", "tag": "aa1f0e1c-7d31-43c6-bd52-1902f678ccdb"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:12:31.967302 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-e998e5bd-ddfe-4687-97b7-c00541ce98a3 req-a251c401-f6b2-487d-8ee2-9706f3909f61 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:31.968878 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-e998e5bd-ddfe-4687-97b7-c00541ce98a3 req-a251c401-f6b2-487d-8ee2-9706f3909f61 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:31.970261 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-e998e5bd-ddfe-4687-97b7-c00541ce98a3 req-a251c401-f6b2-487d-8ee2-9706f3909f61 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:31.993865 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-e998e5bd-ddfe-4687-97b7-c00541ce98a3 req-a251c401-f6b2-487d-8ee2-9706f3909f61 service nova] Creating event network-changed:aa1f0e1c-7d31-43c6-bd52-1902f678ccdb for instance af6da672-bcfb-433b-b868-3dd1dd3e4770 on n-h2-850499-9 Aug 31 16:12:32.001920 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-e998e5bd-ddfe-4687-97b7-c00541ce98a3 req-a251c401-f6b2-487d-8ee2-9706f3909f61 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067347 Aug 31 16:12:32.003538 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1838/3667] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:12:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:12:32.102100 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f350e5fe-62f6-4832-8906-759c21170cf2 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:32.118591 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f350e5fe-62f6-4832-8906-759c21170cf2 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/8e287ae9-272b-4148-a159-790187f5d8a3" status: 200 len: 1514 microversion: 2.1 time: 0.509008 Aug 31 16:12:32.120104 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1830/3668] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:31 2022] GET /compute/v2.1/servers/8e287ae9-272b-4148-a159-790187f5d8a3 => generated 1514 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:12:32.939662 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-bcbd6dbe-e7e2-4a5a-9c73-05da96d6426b tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:32.941237 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-bcbd6dbe-e7e2-4a5a-9c73-05da96d6426b tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] [instance: 9bed27f7-16a5-414d-bb64-700cb4f5cb4b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:32.952114 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bcbd6dbe-e7e2-4a5a-9c73-05da96d6426b tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:32.953707 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bcbd6dbe-e7e2-4a5a-9c73-05da96d6426b tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:32.956036 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bcbd6dbe-e7e2-4a5a-9c73-05da96d6426b tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:32.957095 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bcbd6dbe-e7e2-4a5a-9c73-05da96d6426b tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:32.960899 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bcbd6dbe-e7e2-4a5a-9c73-05da96d6426b tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:32.961702 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bcbd6dbe-e7e2-4a5a-9c73-05da96d6426b tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:33.146427 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b4820de6-8386-44c8-a3bb-b13055bbb645 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:33.147873 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b4820de6-8386-44c8-a3bb-b13055bbb645 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 8e287ae9-272b-4148-a159-790187f5d8a3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:33.156663 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b4820de6-8386-44c8-a3bb-b13055bbb645 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:33.157393 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b4820de6-8386-44c8-a3bb-b13055bbb645 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:33.158754 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b4820de6-8386-44c8-a3bb-b13055bbb645 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:33.159886 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b4820de6-8386-44c8-a3bb-b13055bbb645 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:33.160528 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b4820de6-8386-44c8-a3bb-b13055bbb645 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:33.161350 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b4820de6-8386-44c8-a3bb-b13055bbb645 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:33.544967 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-bcbd6dbe-e7e2-4a5a-9c73-05da96d6426b tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab268a4d607497da5476256055bb07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14140e7303046f1ada446437826f742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:33.561488 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-bcbd6dbe-e7e2-4a5a-9c73-05da96d6426b tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] 10.222.0.61 "GET /compute/v2.1/servers/9bed27f7-16a5-414d-bb64-700cb4f5cb4b" status: 200 len: 1317 microversion: 2.1 time: 0.623724 Aug 31 16:12:33.565258 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1839/3669] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:32 2022] GET /compute/v2.1/servers/9bed27f7-16a5-414d-bb64-700cb4f5cb4b => generated 1317 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:33.727391 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b4820de6-8386-44c8-a3bb-b13055bbb645 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:33.740026 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b4820de6-8386-44c8-a3bb-b13055bbb645 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/8e287ae9-272b-4148-a159-790187f5d8a3" status: 200 len: 1514 microversion: 2.1 time: 0.595043 Aug 31 16:12:33.755779 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1831/3670] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:33 2022] GET /compute/v2.1/servers/8e287ae9-272b-4148-a159-790187f5d8a3 => generated 1514 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:34.586819 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a75485a2-c95b-4070-9395-b00cdad45fe1 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:34.587627 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a75485a2-c95b-4070-9395-b00cdad45fe1 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] [instance: 9bed27f7-16a5-414d-bb64-700cb4f5cb4b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:34.605406 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a75485a2-c95b-4070-9395-b00cdad45fe1 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:34.606781 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a75485a2-c95b-4070-9395-b00cdad45fe1 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:34.608795 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a75485a2-c95b-4070-9395-b00cdad45fe1 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:34.611254 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a75485a2-c95b-4070-9395-b00cdad45fe1 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:34.612548 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a75485a2-c95b-4070-9395-b00cdad45fe1 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:34.613380 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a75485a2-c95b-4070-9395-b00cdad45fe1 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:34.765220 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-594acb65-8762-4320-aeb0-93a91a86c266 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:34.766443 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-594acb65-8762-4320-aeb0-93a91a86c266 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 8e287ae9-272b-4148-a159-790187f5d8a3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:34.769608 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=8 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:12:34.773089 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=4 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:12:34.791221 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-594acb65-8762-4320-aeb0-93a91a86c266 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:34.809733 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-594acb65-8762-4320-aeb0-93a91a86c266 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:34.811804 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-594acb65-8762-4320-aeb0-93a91a86c266 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:34.812772 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-594acb65-8762-4320-aeb0-93a91a86c266 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:34.817496 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-594acb65-8762-4320-aeb0-93a91a86c266 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:34.818487 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-594acb65-8762-4320-aeb0-93a91a86c266 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:35.021078 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-594acb65-8762-4320-aeb0-93a91a86c266 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:35.056455 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-594acb65-8762-4320-aeb0-93a91a86c266 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/8e287ae9-272b-4148-a159-790187f5d8a3" status: 200 len: 1472 microversion: 2.1 time: 0.295459 Aug 31 16:12:35.093059 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1832/3671] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:34 2022] GET /compute/v2.1/servers/8e287ae9-272b-4148-a159-790187f5d8a3 => generated 1472 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:35.197771 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a75485a2-c95b-4070-9395-b00cdad45fe1 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab268a4d607497da5476256055bb07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14140e7303046f1ada446437826f742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:35.215005 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a75485a2-c95b-4070-9395-b00cdad45fe1 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] 10.222.0.61 "GET /compute/v2.1/servers/9bed27f7-16a5-414d-bb64-700cb4f5cb4b" status: 200 len: 1317 microversion: 2.1 time: 0.634346 Aug 31 16:12:35.231572 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1840/3672] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:34 2022] GET /compute/v2.1/servers/9bed27f7-16a5-414d-bb64-700cb4f5cb4b => generated 1317 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:12:35.306784 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-dd0185af-52f4-4550-b92f-12d293aade6f req-da9d454a-3838-4993-83cb-b02367ba4de9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e287ae9-272b-4148-a159-790187f5d8a3", "name": "network-vif-deleted", "tag": "c37204c6-352c-4ad3-ba7a-072c6bbd57ef"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:12:35.327517 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-dd0185af-52f4-4550-b92f-12d293aade6f req-da9d454a-3838-4993-83cb-b02367ba4de9 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:35.333869 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-dd0185af-52f4-4550-b92f-12d293aade6f req-da9d454a-3838-4993-83cb-b02367ba4de9 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:35.334587 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-dd0185af-52f4-4550-b92f-12d293aade6f req-da9d454a-3838-4993-83cb-b02367ba4de9 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:35.362786 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-dd0185af-52f4-4550-b92f-12d293aade6f req-da9d454a-3838-4993-83cb-b02367ba4de9 service nova] Creating event network-vif-deleted:c37204c6-352c-4ad3-ba7a-072c6bbd57ef for instance 8e287ae9-272b-4148-a159-790187f5d8a3 on n-h1-850499-9 Aug 31 16:12:35.382065 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-dd0185af-52f4-4550-b92f-12d293aade6f req-da9d454a-3838-4993-83cb-b02367ba4de9 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088293 Aug 31 16:12:35.383234 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1833/3673] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:12:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:12:36.087059 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-91c55e22-0eb0-4832-8f77-16a61de75786 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:36.087748 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-91c55e22-0eb0-4832-8f77-16a61de75786 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 8e287ae9-272b-4148-a159-790187f5d8a3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:36.104584 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-91c55e22-0eb0-4832-8f77-16a61de75786 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:36.105107 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-91c55e22-0eb0-4832-8f77-16a61de75786 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:36.105566 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-91c55e22-0eb0-4832-8f77-16a61de75786 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:36.107466 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-91c55e22-0eb0-4832-8f77-16a61de75786 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:36.108163 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-91c55e22-0eb0-4832-8f77-16a61de75786 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:36.108616 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-91c55e22-0eb0-4832-8f77-16a61de75786 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:36.226316 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-91c55e22-0eb0-4832-8f77-16a61de75786 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:36.227090 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-91c55e22-0eb0-4832-8f77-16a61de75786 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:36.227770 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-91c55e22-0eb0-4832-8f77-16a61de75786 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:36.228390 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-91c55e22-0eb0-4832-8f77-16a61de75786 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lazy-loading 'fault' on Instance uuid 8e287ae9-272b-4148-a159-790187f5d8a3 {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:12:36.262891 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-96220f07-7d53-4906-8685-646c71a8ba72 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:36.264783 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-96220f07-7d53-4906-8685-646c71a8ba72 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] [instance: 9bed27f7-16a5-414d-bb64-700cb4f5cb4b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:36.273241 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-96220f07-7d53-4906-8685-646c71a8ba72 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:36.274585 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-96220f07-7d53-4906-8685-646c71a8ba72 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:36.275670 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-96220f07-7d53-4906-8685-646c71a8ba72 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:36.278046 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-96220f07-7d53-4906-8685-646c71a8ba72 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:36.279321 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-96220f07-7d53-4906-8685-646c71a8ba72 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:36.280458 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-96220f07-7d53-4906-8685-646c71a8ba72 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:36.647420 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-91c55e22-0eb0-4832-8f77-16a61de75786 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:36.660313 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-91c55e22-0eb0-4832-8f77-16a61de75786 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/8e287ae9-272b-4148-a159-790187f5d8a3" status: 200 len: 1317 microversion: 2.1 time: 0.577407 Aug 31 16:12:36.672817 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1841/3674] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:36 2022] GET /compute/v2.1/servers/8e287ae9-272b-4148-a159-790187f5d8a3 => generated 1317 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:36.683414 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-472344e2-84ec-4ebd-b9a7-d4fbb40892d7 req-fa8577ab-4ab8-4321-9398-5bd08b684b6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bed27f7-16a5-414d-bb64-700cb4f5cb4b", "name": "network-vif-plugged", "status": "completed", "tag": "4e213241-95f3-4caf-a654-70d6036c1d24"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:12:36.713747 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-472344e2-84ec-4ebd-b9a7-d4fbb40892d7 req-fa8577ab-4ab8-4321-9398-5bd08b684b6f service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:36.714489 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-472344e2-84ec-4ebd-b9a7-d4fbb40892d7 req-fa8577ab-4ab8-4321-9398-5bd08b684b6f service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:36.715086 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-472344e2-84ec-4ebd-b9a7-d4fbb40892d7 req-fa8577ab-4ab8-4321-9398-5bd08b684b6f service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:36.744383 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-472344e2-84ec-4ebd-b9a7-d4fbb40892d7 req-fa8577ab-4ab8-4321-9398-5bd08b684b6f service nova] Creating event network-vif-plugged:4e213241-95f3-4caf-a654-70d6036c1d24 for instance 9bed27f7-16a5-414d-bb64-700cb4f5cb4b on n-h1-850499-9 Aug 31 16:12:36.757786 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-472344e2-84ec-4ebd-b9a7-d4fbb40892d7 req-fa8577ab-4ab8-4321-9398-5bd08b684b6f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082720 Aug 31 16:12:36.758673 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1842/3675] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:12:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:12:36.939175 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-96220f07-7d53-4906-8685-646c71a8ba72 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab268a4d607497da5476256055bb07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14140e7303046f1ada446437826f742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:36.953947 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-96220f07-7d53-4906-8685-646c71a8ba72 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] 10.222.0.61 "GET /compute/v2.1/servers/9bed27f7-16a5-414d-bb64-700cb4f5cb4b" status: 200 len: 1317 microversion: 2.1 time: 0.696271 Aug 31 16:12:36.976661 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1834/3676] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:36 2022] GET /compute/v2.1/servers/9bed27f7-16a5-414d-bb64-700cb4f5cb4b => generated 1317 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:37.700514 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8f4656ca-b20f-4036-a210-c08f85541b7d tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:37.702929 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8f4656ca-b20f-4036-a210-c08f85541b7d tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 8e287ae9-272b-4148-a159-790187f5d8a3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:37.726287 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8f4656ca-b20f-4036-a210-c08f85541b7d tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:37.727286 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8f4656ca-b20f-4036-a210-c08f85541b7d tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:37.728101 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8f4656ca-b20f-4036-a210-c08f85541b7d tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:37.731393 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8f4656ca-b20f-4036-a210-c08f85541b7d tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:37.732108 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8f4656ca-b20f-4036-a210-c08f85541b7d tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:37.732731 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8f4656ca-b20f-4036-a210-c08f85541b7d tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:37.768224 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-8f4656ca-b20f-4036-a210-c08f85541b7d tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] HTTP exception thrown: Instance 8e287ae9-272b-4148-a159-790187f5d8a3 could not be found. Aug 31 16:12:37.803712 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8f4656ca-b20f-4036-a210-c08f85541b7d tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Request method failure captured: Aug 31 16:12:37.803712 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/8e287ae9-272b-4148-a159-790187f5d8a3 HTTP/1.1 Aug 31 16:12:37.803712 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:12:37.803712 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:12:37.803712 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:12:37.803712 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:12:37.803712 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:12:37.803712 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:12:37.803712 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:12:37.803712 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:12:37.803712 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4gQXSNpx7T-s6ANX8A4XIz6BgCizm9VWKy6e0KLRI2pxjPOEzPLkRnoXGF3D-Jh3OWl1h65DNjP8YomYmS0bGyt_8avVSC7qeEvUleLImq7o7EhFYQT7JAMgMioD10eCPOZ7QHRsEPDslLrPXcQD5t1iAsH1xyWK7dbpfjoYLGjDpU Aug 31 16:12:37.803712 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:12:37.803712 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:12:37.803712 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:12:37.803712 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:12:37.803712 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:12:37.803712 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:12:37.803712 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 5299955053c842b6aa02e058f4b1c0cb Aug 31 16:12:37.803712 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ServersTestJSON-1028152372 Aug 31 16:12:37.803712 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:12:37.803712 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:12:37.803712 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5299955053c842b6aa02e058f4b1c0cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5299955053c842b6aa02e058f4b1c0cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5299955053c842b6aa02e058f4b1c0cb", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5299955053c842b6aa02e058f4b1c0cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:12:37.803712 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ServersTestJSON-1028152372 Aug 31 16:12:37.803712 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 5299955053c842b6aa02e058f4b1c0cb Aug 31 16:12:37.803712 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ServersTestJSON-1028152372 Aug 31 16:12:37.803712 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ServersTestJSON-1028152372-project Aug 31 16:12:37.803712 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:12:37.803712 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:12:37.803712 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 6e707652819c497bbdf94f85f39c447a Aug 31 16:12:37.803712 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ServersTestJSON-1028152372-project Aug 31 16:12:37.803712 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:12:37.803712 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance 8e287ae9-272b-4148-a159-790187f5d8a3 could not be found. Aug 31 16:12:37.803712 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '8e287ae9-272b-4148-a159-790187f5d8a3'} Aug 31 16:12:37.803712 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:12:37.803712 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:12:37.803712 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:12:37.803712 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:12:37.803712 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:12:37.803712 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:12:37.803712 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:12:37.803712 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:12:37.803712 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:12:37.803712 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:12:37.803712 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e287ae9-272b-4148-a159-790187f5d8a3 could not be found. Aug 31 16:12:37.803712 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:12:37.803712 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:12:37.803712 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:12:37.803712 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:12:37.803712 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:12:37.803712 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:12:37.803712 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:12:37.803712 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:12:37.803712 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:12:37.803712 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:12:37.803712 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:12:37.803712 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:12:37.803712 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:12:37.803712 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:12:37.803712 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:12:37.803712 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:12:37.803712 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e287ae9-272b-4148-a159-790187f5d8a3 could not be found. Aug 31 16:12:37.803712 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:12:37.803712 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:12:37.803712 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:12:37.814301 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:12:37.814301 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:12:37.814301 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:12:37.814301 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:12:37.814301 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:12:37.814301 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e287ae9-272b-4148-a159-790187f5d8a3 could not be found. Aug 31 16:12:37.814301 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:12:37.814301 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8f4656ca-b20f-4036-a210-c08f85541b7d tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Returning 404 to user: Instance 8e287ae9-272b-4148-a159-790187f5d8a3 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:12:37.814301 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8f4656ca-b20f-4036-a210-c08f85541b7d tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/8e287ae9-272b-4148-a159-790187f5d8a3" status: 404 len: 111 microversion: 2.1 time: 0.110932 Aug 31 16:12:37.820855 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1843/3677] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:37 2022] GET /compute/v2.1/servers/8e287ae9-272b-4148-a159-790187f5d8a3 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 16:12:37.828004 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-39a3b6d1-b76f-419f-aeeb-3b722a45855f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '.version_select at 0x7f5ae86674c0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:37.875238 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-39a3b6d1-b76f-419f-aeeb-3b722a45855f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-key-751293242" status: 202 len: 0 microversion: 2.1 time: 0.055752 Aug 31 16:12:37.876480 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1835/3678] 10.222.0.61 () {58 vars in 1206 bytes} [Wed Aug 31 16:12:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-751293242 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:12:37.986085 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3a97a55b-c8e0-4d38-88e1-9bf74489060a tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:37.987259 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3a97a55b-c8e0-4d38-88e1-9bf74489060a tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] [instance: 9bed27f7-16a5-414d-bb64-700cb4f5cb4b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:38.013632 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3a97a55b-c8e0-4d38-88e1-9bf74489060a tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:38.018551 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3a97a55b-c8e0-4d38-88e1-9bf74489060a tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:38.019784 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3a97a55b-c8e0-4d38-88e1-9bf74489060a tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:38.025993 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3a97a55b-c8e0-4d38-88e1-9bf74489060a tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:38.027177 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3a97a55b-c8e0-4d38-88e1-9bf74489060a tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:38.033301 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3a97a55b-c8e0-4d38-88e1-9bf74489060a tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:38.173188 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-017ae34a-635e-4b5c-a8ff-0b7ac3afeb39 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1705637090", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "networks": [{"uuid": "e418f255-318f-476c-a353-8d292b5f7798"}]}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:12:38.373219 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-017ae34a-635e-4b5c-a8ff-0b7ac3afeb39 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] validate_networks() for [('e418f255-318f-476c-a353-8d292b5f7798', None, None, None, None, None)] {{(pid=122256) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:12:38.691222 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3a97a55b-c8e0-4d38-88e1-9bf74489060a tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab268a4d607497da5476256055bb07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14140e7303046f1ada446437826f742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:38.712183 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3a97a55b-c8e0-4d38-88e1-9bf74489060a tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] 10.222.0.61 "GET /compute/v2.1/servers/9bed27f7-16a5-414d-bb64-700cb4f5cb4b" status: 200 len: 1317 microversion: 2.1 time: 0.733274 Aug 31 16:12:38.713141 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1844/3679] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:37 2022] GET /compute/v2.1/servers/9bed27f7-16a5-414d-bb64-700cb4f5cb4b => generated 1317 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:39.736504 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-db37a4ce-d14b-4d2e-aeb4-d5765ed043e5 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:39.738041 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-db37a4ce-d14b-4d2e-aeb4-d5765ed043e5 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] [instance: 9bed27f7-16a5-414d-bb64-700cb4f5cb4b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:39.750330 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-db37a4ce-d14b-4d2e-aeb4-d5765ed043e5 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:39.752941 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-db37a4ce-d14b-4d2e-aeb4-d5765ed043e5 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:39.753592 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-db37a4ce-d14b-4d2e-aeb4-d5765ed043e5 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:39.754527 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-db37a4ce-d14b-4d2e-aeb4-d5765ed043e5 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:39.756584 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-017ae34a-635e-4b5c-a8ff-0b7ac3afeb39 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:12:39.757081 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-017ae34a-635e-4b5c-a8ff-0b7ac3afeb39 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:12:39.757403 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-db37a4ce-d14b-4d2e-aeb4-d5765ed043e5 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:39.757548 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-017ae34a-635e-4b5c-a8ff-0b7ac3afeb39 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:12:39.758150 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-db37a4ce-d14b-4d2e-aeb4-d5765ed043e5 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:39.758443 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-017ae34a-635e-4b5c-a8ff-0b7ac3afeb39 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:12:39.758874 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-017ae34a-635e-4b5c-a8ff-0b7ac3afeb39 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:12:39.774654 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-017ae34a-635e-4b5c-a8ff-0b7ac3afeb39 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:39.775889 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-017ae34a-635e-4b5c-a8ff-0b7ac3afeb39 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:39.776566 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-017ae34a-635e-4b5c-a8ff-0b7ac3afeb39 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:39.777681 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-017ae34a-635e-4b5c-a8ff-0b7ac3afeb39 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:39.778972 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-017ae34a-635e-4b5c-a8ff-0b7ac3afeb39 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:39.779592 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-017ae34a-635e-4b5c-a8ff-0b7ac3afeb39 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:39.863599 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-017ae34a-635e-4b5c-a8ff-0b7ac3afeb39 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Getting quotas for project 5299955053c842b6aa02e058f4b1c0cb. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:12:39.884697 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=4 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:12:39.886896 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-017ae34a-635e-4b5c-a8ff-0b7ac3afeb39 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Getting quotas for user 6e707652819c497bbdf94f85f39c447a and project 5299955053c842b6aa02e058f4b1c0cb. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:12:39.922924 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-017ae34a-635e-4b5c-a8ff-0b7ac3afeb39 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Going to run 1 instances... {{(pid=122256) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:12:39.927531 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-017ae34a-635e-4b5c-a8ff-0b7ac3afeb39 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: ce9f8f4c-9d4e-48c0-bd66-1c409e91bf5a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:12:40.019119 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-017ae34a-635e-4b5c-a8ff-0b7ac3afeb39 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.853604 Aug 31 16:12:40.028719 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1836/3680] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:12:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1864 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:12:40.033811 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6ac0aaf6-ce40-4ce1-8aa0-08535f3d293f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:40.035309 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6ac0aaf6-ce40-4ce1-8aa0-08535f3d293f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: ce9f8f4c-9d4e-48c0-bd66-1c409e91bf5a] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:40.313881 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-6ac0aaf6-ce40-4ce1-8aa0-08535f3d293f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:40.326348 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6ac0aaf6-ce40-4ce1-8aa0-08535f3d293f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/ce9f8f4c-9d4e-48c0-bd66-1c409e91bf5a" status: 200 len: 1209 microversion: 2.1 time: 0.296217 Aug 31 16:12:40.326946 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1837/3681] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:40 2022] GET /compute/v2.1/servers/ce9f8f4c-9d4e-48c0-bd66-1c409e91bf5a => generated 1209 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:40.446081 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-db37a4ce-d14b-4d2e-aeb4-d5765ed043e5 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab268a4d607497da5476256055bb07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14140e7303046f1ada446437826f742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:40.474468 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-db37a4ce-d14b-4d2e-aeb4-d5765ed043e5 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] 10.222.0.61 "GET /compute/v2.1/servers/9bed27f7-16a5-414d-bb64-700cb4f5cb4b" status: 200 len: 1506 microversion: 2.1 time: 0.741310 Aug 31 16:12:40.477355 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1845/3682] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:39 2022] GET /compute/v2.1/servers/9bed27f7-16a5-414d-bb64-700cb4f5cb4b => generated 1506 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:12:41.351860 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-bffb10b6-d1da-4bc9-89c8-06a5edd3ad5b tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:41.354552 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-bffb10b6-d1da-4bc9-89c8-06a5edd3ad5b tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: ce9f8f4c-9d4e-48c0-bd66-1c409e91bf5a] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:41.382350 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bffb10b6-d1da-4bc9-89c8-06a5edd3ad5b tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:41.383279 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bffb10b6-d1da-4bc9-89c8-06a5edd3ad5b tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:41.383918 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bffb10b6-d1da-4bc9-89c8-06a5edd3ad5b tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:41.384758 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bffb10b6-d1da-4bc9-89c8-06a5edd3ad5b tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:41.388076 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bffb10b6-d1da-4bc9-89c8-06a5edd3ad5b tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:41.400253 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bffb10b6-d1da-4bc9-89c8-06a5edd3ad5b tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:41.705635 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-bffb10b6-d1da-4bc9-89c8-06a5edd3ad5b tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:41.739969 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-bffb10b6-d1da-4bc9-89c8-06a5edd3ad5b tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/ce9f8f4c-9d4e-48c0-bd66-1c409e91bf5a" status: 200 len: 1213 microversion: 2.1 time: 0.386602 Aug 31 16:12:41.741026 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1838/3683] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:41 2022] GET /compute/v2.1/servers/ce9f8f4c-9d4e-48c0-bd66-1c409e91bf5a => generated 1213 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:42.815046 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-fd63697f-f6a5-40f2-8a7b-04218d1509db tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:42.815705 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-fd63697f-f6a5-40f2-8a7b-04218d1509db tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: ce9f8f4c-9d4e-48c0-bd66-1c409e91bf5a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:42.831796 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fd63697f-f6a5-40f2-8a7b-04218d1509db tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:42.836023 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fd63697f-f6a5-40f2-8a7b-04218d1509db tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:42.836718 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fd63697f-f6a5-40f2-8a7b-04218d1509db tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:42.837795 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fd63697f-f6a5-40f2-8a7b-04218d1509db tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:42.838497 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fd63697f-f6a5-40f2-8a7b-04218d1509db tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:42.845730 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fd63697f-f6a5-40f2-8a7b-04218d1509db tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:43.172967 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-fd63697f-f6a5-40f2-8a7b-04218d1509db tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:43.185275 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-fd63697f-f6a5-40f2-8a7b-04218d1509db tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/ce9f8f4c-9d4e-48c0-bd66-1c409e91bf5a" status: 200 len: 1269 microversion: 2.1 time: 0.424139 Aug 31 16:12:43.191975 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1846/3684] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:42 2022] GET /compute/v2.1/servers/ce9f8f4c-9d4e-48c0-bd66-1c409e91bf5a => generated 1269 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:44.214302 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7768f218-b5b7-4029-8b68-2836c4aa3e5b tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:44.219260 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7768f218-b5b7-4029-8b68-2836c4aa3e5b tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: ce9f8f4c-9d4e-48c0-bd66-1c409e91bf5a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:44.238108 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7768f218-b5b7-4029-8b68-2836c4aa3e5b tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:44.239483 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7768f218-b5b7-4029-8b68-2836c4aa3e5b tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:44.240243 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7768f218-b5b7-4029-8b68-2836c4aa3e5b tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:44.241131 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7768f218-b5b7-4029-8b68-2836c4aa3e5b tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:44.241758 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7768f218-b5b7-4029-8b68-2836c4aa3e5b tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:44.242352 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7768f218-b5b7-4029-8b68-2836c4aa3e5b tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:44.445564 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7768f218-b5b7-4029-8b68-2836c4aa3e5b tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:44.453696 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7768f218-b5b7-4029-8b68-2836c4aa3e5b tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/ce9f8f4c-9d4e-48c0-bd66-1c409e91bf5a" status: 200 len: 1267 microversion: 2.1 time: 0.247583 Aug 31 16:12:44.460459 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1847/3685] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:44 2022] GET /compute/v2.1/servers/ce9f8f4c-9d4e-48c0-bd66-1c409e91bf5a => generated 1267 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:44.546701 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4112c48c-254e-4d29-8c66-5f57a4b0ee8b tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Action: 'create', calling method: .version_select at 0x7f5ae8f9c700>, body: {"keypair": {"name": "tempest-keypair-596488238", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHi2nGKpORZHU6HpMTX95w2vc1Z0D3oCV05rdTkxoUTHhNwca6VUR6k+o+FRfwClCJo3pDxkqEfmEi7j+PAm05Kk4ALUYkHunJtJUVFwlIT3KbBvIYWBJ2wY2dgzL8tXBQ=="}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:12:44.599842 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-4112c48c-254e-4d29-8c66-5f57a4b0ee8b tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Getting quotas for project 3511432a7dee4bec9d1093c9d95b3734. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:12:44.631951 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-4112c48c-254e-4d29-8c66-5f57a4b0ee8b tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Getting quotas for user 4ed06378eb9b446680b5a3156a14941d and project 3511432a7dee4bec9d1093c9d95b3734. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:12:44.712492 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4112c48c-254e-4d29-8c66-5f57a4b0ee8b tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.804240 Aug 31 16:12:44.715854 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1839/3686] 10.222.0.61 () {60 vars in 1159 bytes} [Wed Aug 31 16:12:43 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:12:44.846692 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-80f540ec-2410-4538-ba62-19015b4413f4 tempest-VolumesAdminNegativeTest-18935182 tempest-VolumesAdminNegativeTest-18935182-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "4040e9d8-eeff-411e-bf7c-53a5a94c5850"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:12:44.849898 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-80f540ec-2410-4538-ba62-19015b4413f4 tempest-VolumesAdminNegativeTest-18935182 tempest-VolumesAdminNegativeTest-18935182-project-admin] [instance: 9bed27f7-16a5-414d-bb64-700cb4f5cb4b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:44.872625 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-80f540ec-2410-4538-ba62-19015b4413f4 tempest-VolumesAdminNegativeTest-18935182 tempest-VolumesAdminNegativeTest-18935182-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:44.876843 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-80f540ec-2410-4538-ba62-19015b4413f4 tempest-VolumesAdminNegativeTest-18935182 tempest-VolumesAdminNegativeTest-18935182-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:44.881086 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-80f540ec-2410-4538-ba62-19015b4413f4 tempest-VolumesAdminNegativeTest-18935182 tempest-VolumesAdminNegativeTest-18935182-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:44.886763 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-80f540ec-2410-4538-ba62-19015b4413f4 tempest-VolumesAdminNegativeTest-18935182 tempest-VolumesAdminNegativeTest-18935182-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:44.888773 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-80f540ec-2410-4538-ba62-19015b4413f4 tempest-VolumesAdminNegativeTest-18935182 tempest-VolumesAdminNegativeTest-18935182-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:44.892432 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-80f540ec-2410-4538-ba62-19015b4413f4 tempest-VolumesAdminNegativeTest-18935182 tempest-VolumesAdminNegativeTest-18935182-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:45.042276 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-80f540ec-2410-4538-ba62-19015b4413f4 tempest-VolumesAdminNegativeTest-18935182 tempest-VolumesAdminNegativeTest-18935182-project-admin] HTTP exception thrown: Volume 69f0bb9e-b44e-421e-b8c5-db3e006644dd could not be found. Aug 31 16:12:45.042830 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-80f540ec-2410-4538-ba62-19015b4413f4 tempest-VolumesAdminNegativeTest-18935182 tempest-VolumesAdminNegativeTest-18935182-project-admin] Request method failure captured: Aug 31 16:12:45.042830 n-d-850499-9 devstack@n-api.service[122257]: request: PUT /compute/v2.1/servers/9bed27f7-16a5-414d-bb64-700cb4f5cb4b/os-volume_attachments/69f0bb9e-b44e-421e-b8c5-db3e006644dd HTTP/1.1 Aug 31 16:12:45.042830 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:12:45.042830 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:12:45.042830 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:12:45.042830 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 74 Aug 31 16:12:45.042830 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:12:45.042830 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:12:45.042830 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:12:45.042830 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:12:45.042830 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4fHPABUZVxy0beiHZUwbmBbZPlkiXN_i2m1Rx1klV-PAoFz4DsX1cdYgn1KjL6G7aDk886eEuDFniOwpF1vl6JaBpyqerCVPaYU_Lw4lGjUy8BsJgjDk8XIkGQHmCzpTYgQOTbMY9UtWI7V2smJYQ3lliwbxPzq_E7AVcG0r9OT7OI Aug 31 16:12:45.042830 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:12:45.042830 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:12:45.042830 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:12:45.042830 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:12:45.042830 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:12:45.042830 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:12:45.042830 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: d17f5af7cbfe432a8340e34c17504cae Aug 31 16:12:45.042830 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-VolumesAdminNegativeTest-18935182 Aug 31 16:12:45.042830 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,admin,member Aug 31 16:12:45.042830 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,admin,member Aug 31 16:12:45.042830 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d17f5af7cbfe432a8340e34c17504cae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/d17f5af7cbfe432a8340e34c17504cae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_d17f5af7cbfe432a8340e34c17504cae", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d17f5af7cbfe432a8340e34c17504cae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:12:45.042830 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-VolumesAdminNegativeTest-18935182 Aug 31 16:12:45.042830 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: d17f5af7cbfe432a8340e34c17504cae Aug 31 16:12:45.042830 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-18935182 Aug 31 16:12:45.042830 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-VolumesAdminNegativeTest-18935182-project-admin Aug 31 16:12:45.042830 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:12:45.042830 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:12:45.042830 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 016693f4f56c4068a63145017c3097b1 Aug 31 16:12:45.042830 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-VolumesAdminNegativeTest-18935182-project-admin Aug 31 16:12:45.042830 n-d-850499-9 devstack@n-api.service[122257]: Aug 31 16:12:45.042830 n-d-850499-9 devstack@n-api.service[122257]: {"volumeAttachment": {"volumeId": "4040e9d8-eeff-411e-bf7c-53a5a94c5850"}} Aug 31 16:12:45.042830 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:12:45.042830 n-d-850499-9 devstack@n-api.service[122257]: exception: Volume 69f0bb9e-b44e-421e-b8c5-db3e006644dd could not be found. Aug 31 16:12:45.042830 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'server_id': '9bed27f7-16a5-414d-bb64-700cb4f5cb4b', 'id': '69f0bb9e-b44e-421e-b8c5-db3e006644dd', 'body': {'volumeAttachment': {'volumeId': '4040e9d8-eeff-411e-bf7c-53a5a94c5850'}}} Aug 31 16:12:45.042830 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:12:45.042830 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:12:45.042830 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 16:12:45.042830 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 16:12:45.042830 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 16:12:45.042830 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 16:12:45.042830 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 16:12:45.042830 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 16:12:45.042830 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 16:12:45.042830 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 16:12:45.042830 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 16:12:45.042830 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 16:12:45.042830 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 16:12:45.042830 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 16:12:45.042830 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 16:12:45.042830 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 16:12:45.042830 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 69f0bb9e-b44e-421e-b8c5-db3e006644dd could not be found. (HTTP 404) (Request-ID: req-c594c927-cf13-498c-8260-41bb1599cc42) Aug 31 16:12:45.042830 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:12:45.042830 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:12:45.042830 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:12:45.042830 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:12:45.042830 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Aug 31 16:12:45.042830 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Aug 31 16:12:45.042830 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 16:12:45.042830 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 16:12:45.042830 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 16:12:45.047041 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 16:12:45.047041 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 16:12:45.047041 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 16:12:45.047041 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 16:12:45.047041 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 16:12:45.047041 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 16:12:45.047041 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 16:12:45.047041 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 16:12:45.047041 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 16:12:45.047041 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 16:12:45.047041 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 16:12:45.047041 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 16:12:45.047041 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 16:12:45.047041 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 16:12:45.047041 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 16:12:45.047041 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 16:12:45.047041 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 16:12:45.047041 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 69f0bb9e-b44e-421e-b8c5-db3e006644dd could not be found. Aug 31 16:12:45.047041 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:12:45.047041 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:12:45.047041 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:12:45.047041 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:12:45.047041 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:12:45.047041 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:12:45.047041 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:12:45.047041 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:12:45.047041 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:12:45.047041 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:12:45.047041 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:12:45.047041 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:12:45.047041 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:12:45.047041 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:12:45.047041 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Aug 31 16:12:45.047041 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Aug 31 16:12:45.047041 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Aug 31 16:12:45.047041 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:12:45.047041 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 69f0bb9e-b44e-421e-b8c5-db3e006644dd could not be found. Aug 31 16:12:45.047041 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:12:45.047041 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:12:45.047041 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:12:45.047041 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:12:45.047041 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:12:45.047041 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:12:45.047041 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:12:45.047041 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:12:45.047041 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 69f0bb9e-b44e-421e-b8c5-db3e006644dd could not be found. Aug 31 16:12:45.047041 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:12:45.056475 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-80f540ec-2410-4538-ba62-19015b4413f4 tempest-VolumesAdminNegativeTest-18935182 tempest-VolumesAdminNegativeTest-18935182-project-admin] Returning 404 to user: Volume 69f0bb9e-b44e-421e-b8c5-db3e006644dd could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:12:45.056475 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-80f540ec-2410-4538-ba62-19015b4413f4 tempest-VolumesAdminNegativeTest-18935182 tempest-VolumesAdminNegativeTest-18935182-project-admin] 10.222.0.61 "PUT /compute/v2.1/servers/9bed27f7-16a5-414d-bb64-700cb4f5cb4b/os-volume_attachments/69f0bb9e-b44e-421e-b8c5-db3e006644dd" status: 404 len: 109 microversion: 2.1 time: 0.213584 Aug 31 16:12:45.057780 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1848/3687] 10.222.0.61 () {60 vars in 1433 bytes} [Wed Aug 31 16:12:44 2022] PUT /compute/v2.1/servers/9bed27f7-16a5-414d-bb64-700cb4f5cb4b/os-volume_attachments/69f0bb9e-b44e-421e-b8c5-db3e006644dd => generated 109 bytes in 217 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:12:45.510822 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-fe7b34fd-3986-4d09-8e73-fe61adb6dd52 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:45.512133 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-fe7b34fd-3986-4d09-8e73-fe61adb6dd52 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: ce9f8f4c-9d4e-48c0-bd66-1c409e91bf5a] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:45.545178 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fe7b34fd-3986-4d09-8e73-fe61adb6dd52 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:45.545688 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fe7b34fd-3986-4d09-8e73-fe61adb6dd52 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:45.546141 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fe7b34fd-3986-4d09-8e73-fe61adb6dd52 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:45.549860 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fe7b34fd-3986-4d09-8e73-fe61adb6dd52 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:45.553943 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fe7b34fd-3986-4d09-8e73-fe61adb6dd52 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:45.554847 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fe7b34fd-3986-4d09-8e73-fe61adb6dd52 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:46.257896 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-fe7b34fd-3986-4d09-8e73-fe61adb6dd52 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:46.276742 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-fe7b34fd-3986-4d09-8e73-fe61adb6dd52 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/ce9f8f4c-9d4e-48c0-bd66-1c409e91bf5a" status: 200 len: 1309 microversion: 2.1 time: 0.793382 Aug 31 16:12:46.278006 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1840/3688] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:45 2022] GET /compute/v2.1/servers/ce9f8f4c-9d4e-48c0-bd66-1c409e91bf5a => generated 1309 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:47.304008 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-bfa28184-902b-495a-a253-034e25f42d8b tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:47.305614 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-bfa28184-902b-495a-a253-034e25f42d8b tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: ce9f8f4c-9d4e-48c0-bd66-1c409e91bf5a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:47.328158 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bfa28184-902b-495a-a253-034e25f42d8b tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:47.328880 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bfa28184-902b-495a-a253-034e25f42d8b tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:47.329411 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bfa28184-902b-495a-a253-034e25f42d8b tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:47.330236 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bfa28184-902b-495a-a253-034e25f42d8b tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:47.332360 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bfa28184-902b-495a-a253-034e25f42d8b tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:47.333374 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bfa28184-902b-495a-a253-034e25f42d8b tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:47.863860 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-bfa28184-902b-495a-a253-034e25f42d8b tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:47.883044 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-bfa28184-902b-495a-a253-034e25f42d8b tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/ce9f8f4c-9d4e-48c0-bd66-1c409e91bf5a" status: 200 len: 1309 microversion: 2.1 time: 0.586173 Aug 31 16:12:47.883827 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1849/3689] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:47 2022] GET /compute/v2.1/servers/ce9f8f4c-9d4e-48c0-bd66-1c409e91bf5a => generated 1309 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:48.912269 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f7d4848a-1904-4cc1-8d8f-739206c29a35 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:48.916096 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f7d4848a-1904-4cc1-8d8f-739206c29a35 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: ce9f8f4c-9d4e-48c0-bd66-1c409e91bf5a] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:48.937546 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f7d4848a-1904-4cc1-8d8f-739206c29a35 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:48.938324 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f7d4848a-1904-4cc1-8d8f-739206c29a35 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:48.939094 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f7d4848a-1904-4cc1-8d8f-739206c29a35 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:48.940500 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f7d4848a-1904-4cc1-8d8f-739206c29a35 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:48.942559 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f7d4848a-1904-4cc1-8d8f-739206c29a35 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:48.943674 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f7d4848a-1904-4cc1-8d8f-739206c29a35 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:49.646449 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2030782d-2598-492a-88a4-9287ef5c0b9d tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Action: 'create', calling method: .version_select at 0x7f5ae8475a60>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1927511947", "description": "tempest-description-733967288"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:12:49.758484 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f7d4848a-1904-4cc1-8d8f-739206c29a35 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:49.772562 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f7d4848a-1904-4cc1-8d8f-739206c29a35 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/ce9f8f4c-9d4e-48c0-bd66-1c409e91bf5a" status: 200 len: 1309 microversion: 2.1 time: 0.866790 Aug 31 16:12:49.775376 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1841/3690] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:48 2022] GET /compute/v2.1/servers/ce9f8f4c-9d4e-48c0-bd66-1c409e91bf5a => generated 1309 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:49.783128 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-195c55eb-b286-40bc-a6b2-28a22dd0afd9 req-e2c59042-25f2-41c3-bd82-1bc416bf0ea1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce9f8f4c-9d4e-48c0-bd66-1c409e91bf5a", "tag": "c4695205-af18-4876-807f-c392a29402d0"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:12:49.811103 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-195c55eb-b286-40bc-a6b2-28a22dd0afd9 req-e2c59042-25f2-41c3-bd82-1bc416bf0ea1 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:49.812787 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-195c55eb-b286-40bc-a6b2-28a22dd0afd9 req-e2c59042-25f2-41c3-bd82-1bc416bf0ea1 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:49.814755 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-195c55eb-b286-40bc-a6b2-28a22dd0afd9 req-e2c59042-25f2-41c3-bd82-1bc416bf0ea1 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:49.834703 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:12:49.842308 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-195c55eb-b286-40bc-a6b2-28a22dd0afd9 req-e2c59042-25f2-41c3-bd82-1bc416bf0ea1 service nova] Creating event network-changed:c4695205-af18-4876-807f-c392a29402d0 for instance ce9f8f4c-9d4e-48c0-bd66-1c409e91bf5a on n-h1-850499-9 Aug 31 16:12:49.859216 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-195c55eb-b286-40bc-a6b2-28a22dd0afd9 req-e2c59042-25f2-41c3-bd82-1bc416bf0ea1 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079765 Aug 31 16:12:49.861275 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1842/3691] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:12:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:12:49.889226 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-74e1e642-915d-4d32-9ace-5c82b4ed3700 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:49.891663 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-74e1e642-915d-4d32-9ace-5c82b4ed3700 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] [instance: 9bed27f7-16a5-414d-bb64-700cb4f5cb4b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:49.924335 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-74e1e642-915d-4d32-9ace-5c82b4ed3700 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:49.929508 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-74e1e642-915d-4d32-9ace-5c82b4ed3700 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:49.932231 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-74e1e642-915d-4d32-9ace-5c82b4ed3700 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:49.935331 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-74e1e642-915d-4d32-9ace-5c82b4ed3700 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:49.940253 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-74e1e642-915d-4d32-9ace-5c82b4ed3700 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:49.942380 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-74e1e642-915d-4d32-9ace-5c82b4ed3700 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:50.050744 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-74e1e642-915d-4d32-9ace-5c82b4ed3700 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] [instance: 9bed27f7-16a5-414d-bb64-700cb4f5cb4b] Going to try to terminate instance {{(pid=122256) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:12:50.192732 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:12:50.258453 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-74e1e642-915d-4d32-9ace-5c82b4ed3700 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] 10.222.0.61 "DELETE /compute/v2.1/servers/9bed27f7-16a5-414d-bb64-700cb4f5cb4b" status: 204 len: 0 microversion: 2.1 time: 0.390852 Aug 31 16:12:50.260601 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1843/3692] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:12:49 2022] DELETE /compute/v2.1/servers/9bed27f7-16a5-414d-bb64-700cb4f5cb4b => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:12:50.272518 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-573dc39d-2e79-4940-8ecf-ea16bdffd3b2 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:50.273437 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-573dc39d-2e79-4940-8ecf-ea16bdffd3b2 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] [instance: 9bed27f7-16a5-414d-bb64-700cb4f5cb4b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:50.291892 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-573dc39d-2e79-4940-8ecf-ea16bdffd3b2 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:50.292565 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-573dc39d-2e79-4940-8ecf-ea16bdffd3b2 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:50.293211 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-573dc39d-2e79-4940-8ecf-ea16bdffd3b2 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:50.294053 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-573dc39d-2e79-4940-8ecf-ea16bdffd3b2 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:50.294628 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-573dc39d-2e79-4940-8ecf-ea16bdffd3b2 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:50.295708 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-573dc39d-2e79-4940-8ecf-ea16bdffd3b2 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:50.528537 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2030782d-2598-492a-88a4-9287ef5c0b9d tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] 10.222.0.61 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.283068 Aug 31 16:12:50.537699 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1850/3693] 10.222.0.61 () {60 vars in 1180 bytes} [Wed Aug 31 16:12:49 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:12:50.543161 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-133bd5d5-f5f3-49b9-8d6c-bb791499cd63 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Action: 'create', calling method: .version_select at 0x7f5ae8cecb80>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-717455075", "description": "tempest-description-999198453"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:12:51.038786 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-573dc39d-2e79-4940-8ecf-ea16bdffd3b2 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab268a4d607497da5476256055bb07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14140e7303046f1ada446437826f742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:51.074369 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-573dc39d-2e79-4940-8ecf-ea16bdffd3b2 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] 10.222.0.61 "GET /compute/v2.1/servers/9bed27f7-16a5-414d-bb64-700cb4f5cb4b" status: 200 len: 1512 microversion: 2.1 time: 0.807231 Aug 31 16:12:51.080861 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1844/3694] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:50 2022] GET /compute/v2.1/servers/9bed27f7-16a5-414d-bb64-700cb4f5cb4b => generated 1512 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:51.091487 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-61b9c8e9-d086-4a77-9619-d3a64e1365cb tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:51.094628 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-61b9c8e9-d086-4a77-9619-d3a64e1365cb tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: ce9f8f4c-9d4e-48c0-bd66-1c409e91bf5a] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:51.113133 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-61b9c8e9-d086-4a77-9619-d3a64e1365cb tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:51.118483 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-61b9c8e9-d086-4a77-9619-d3a64e1365cb tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:51.119300 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-61b9c8e9-d086-4a77-9619-d3a64e1365cb tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:51.120523 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-61b9c8e9-d086-4a77-9619-d3a64e1365cb tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:51.122869 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-61b9c8e9-d086-4a77-9619-d3a64e1365cb tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:51.123539 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-61b9c8e9-d086-4a77-9619-d3a64e1365cb tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:51.217897 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-133bd5d5-f5f3-49b9-8d6c-bb791499cd63 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] 10.222.0.61 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.678501 Aug 31 16:12:51.219593 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1851/3695] 10.222.0.61 () {60 vars in 1180 bytes} [Wed Aug 31 16:12:50 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:12:51.335277 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b04328fb-2086-4273-855a-5c9f11dd9c67 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-455721571", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "networks": [{"uuid": "d687da68-2dd2-4155-9017-14e1ffc41ed6"}]}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:12:51.446041 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-b04328fb-2086-4273-855a-5c9f11dd9c67 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] validate_networks() for [('d687da68-2dd2-4155-9017-14e1ffc41ed6', None, None, None, None, None)] {{(pid=122257) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:12:51.830917 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-61b9c8e9-d086-4a77-9619-d3a64e1365cb tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:51.854308 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-61b9c8e9-d086-4a77-9619-d3a64e1365cb tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/ce9f8f4c-9d4e-48c0-bd66-1c409e91bf5a" status: 200 len: 1309 microversion: 2.1 time: 0.764795 Aug 31 16:12:51.857417 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1845/3696] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:51 2022] GET /compute/v2.1/servers/ce9f8f4c-9d4e-48c0-bd66-1c409e91bf5a => generated 1309 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:52.121916 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a2cc858c-0382-4130-830f-1b1d09f120e5 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:52.123237 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a2cc858c-0382-4130-830f-1b1d09f120e5 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] [instance: 9bed27f7-16a5-414d-bb64-700cb4f5cb4b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:52.140336 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a2cc858c-0382-4130-830f-1b1d09f120e5 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:52.144085 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a2cc858c-0382-4130-830f-1b1d09f120e5 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:52.146844 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a2cc858c-0382-4130-830f-1b1d09f120e5 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:52.147904 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a2cc858c-0382-4130-830f-1b1d09f120e5 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:52.150452 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a2cc858c-0382-4130-830f-1b1d09f120e5 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:52.152508 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a2cc858c-0382-4130-830f-1b1d09f120e5 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:52.548354 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a2cc858c-0382-4130-830f-1b1d09f120e5 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab268a4d607497da5476256055bb07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14140e7303046f1ada446437826f742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:52.574526 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a2cc858c-0382-4130-830f-1b1d09f120e5 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] 10.222.0.61 "GET /compute/v2.1/servers/9bed27f7-16a5-414d-bb64-700cb4f5cb4b" status: 200 len: 1512 microversion: 2.1 time: 0.457183 Aug 31 16:12:52.576674 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1846/3697] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:52 2022] GET /compute/v2.1/servers/9bed27f7-16a5-414d-bb64-700cb4f5cb4b => generated 1512 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:52.588110 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2dc14722-33dd-4508-aa09-f698d0c73275 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-415443694", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "73549f6f-0b06-4956-9c44-ea3ca5b7ecda"}], "security_groups": [{"name": "tempest-securitygroup--375716984"}], "key_name": "tempest-keypair-596488238", "user_data": "}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:12:52.736001 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-b04328fb-2086-4273-855a-5c9f11dd9c67 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:12:52.736823 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-b04328fb-2086-4273-855a-5c9f11dd9c67 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:12:52.737171 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-b04328fb-2086-4273-855a-5c9f11dd9c67 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:12:52.737965 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-b04328fb-2086-4273-855a-5c9f11dd9c67 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:12:52.738981 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-b04328fb-2086-4273-855a-5c9f11dd9c67 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:12:52.754817 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b04328fb-2086-4273-855a-5c9f11dd9c67 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:52.755927 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b04328fb-2086-4273-855a-5c9f11dd9c67 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:52.756559 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b04328fb-2086-4273-855a-5c9f11dd9c67 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:52.757507 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b04328fb-2086-4273-855a-5c9f11dd9c67 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:52.760095 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-2dc14722-33dd-4508-aa09-f698d0c73275 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] validate_networks() for [('73549f6f-0b06-4956-9c44-ea3ca5b7ecda', None, None, None, None, None)] {{(pid=122256) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:12:52.766367 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b04328fb-2086-4273-855a-5c9f11dd9c67 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:52.767070 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b04328fb-2086-4273-855a-5c9f11dd9c67 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:52.799174 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-b04328fb-2086-4273-855a-5c9f11dd9c67 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Getting quotas for project 9f66705b4a0f4711ba14d9ceb5699bd1. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:12:52.806987 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-b04328fb-2086-4273-855a-5c9f11dd9c67 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Getting quotas for user 5f911026e35d40a480094376c6556d03 and project 9f66705b4a0f4711ba14d9ceb5699bd1. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:12:52.840754 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b04328fb-2086-4273-855a-5c9f11dd9c67 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Going to run 1 instances... {{(pid=122257) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:12:52.845424 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b04328fb-2086-4273-855a-5c9f11dd9c67 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] [instance: 73e59de1-a2a7-4fa3-b397-2c2c76ba1139] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:12:52.928580 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b04328fb-2086-4273-855a-5c9f11dd9c67 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.619912 Aug 31 16:12:52.930244 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1852/3698] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:12:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1623 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 16:12:52.941149 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9d37c0a6-170f-4c06-a8ec-8b229eb2435f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:52.941879 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9d37c0a6-170f-4c06-a8ec-8b229eb2435f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: ce9f8f4c-9d4e-48c0-bd66-1c409e91bf5a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:52.950669 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9d37c0a6-170f-4c06-a8ec-8b229eb2435f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:52.951207 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9d37c0a6-170f-4c06-a8ec-8b229eb2435f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:52.951693 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9d37c0a6-170f-4c06-a8ec-8b229eb2435f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:52.952653 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9d37c0a6-170f-4c06-a8ec-8b229eb2435f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:52.953289 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9d37c0a6-170f-4c06-a8ec-8b229eb2435f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:52.953907 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9d37c0a6-170f-4c06-a8ec-8b229eb2435f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:53.968753 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9d37c0a6-170f-4c06-a8ec-8b229eb2435f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:53.985317 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9d37c0a6-170f-4c06-a8ec-8b229eb2435f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/ce9f8f4c-9d4e-48c0-bd66-1c409e91bf5a" status: 200 len: 1309 microversion: 2.1 time: 1.053497 Aug 31 16:12:53.995975 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1853/3699] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:52 2022] GET /compute/v2.1/servers/ce9f8f4c-9d4e-48c0-bd66-1c409e91bf5a => generated 1309 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:54.011459 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-015e5e0c-7537-42e7-916c-057c404fe628 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:54.022834 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-015e5e0c-7537-42e7-916c-057c404fe628 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] [instance: 73e59de1-a2a7-4fa3-b397-2c2c76ba1139] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:54.044943 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-015e5e0c-7537-42e7-916c-057c404fe628 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:54.045838 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-015e5e0c-7537-42e7-916c-057c404fe628 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:54.046768 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-015e5e0c-7537-42e7-916c-057c404fe628 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:54.048185 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-015e5e0c-7537-42e7-916c-057c404fe628 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:54.048947 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-015e5e0c-7537-42e7-916c-057c404fe628 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:54.049707 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-015e5e0c-7537-42e7-916c-057c404fe628 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:54.089470 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-2dc14722-33dd-4508-aa09-f698d0c73275 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:12:54.090055 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-2dc14722-33dd-4508-aa09-f698d0c73275 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:12:54.090530 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-2dc14722-33dd-4508-aa09-f698d0c73275 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:12:54.099430 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-2dc14722-33dd-4508-aa09-f698d0c73275 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:12:54.100469 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-2dc14722-33dd-4508-aa09-f698d0c73275 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:12:54.127018 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2dc14722-33dd-4508-aa09-f698d0c73275 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:54.127646 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2dc14722-33dd-4508-aa09-f698d0c73275 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:54.128212 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2dc14722-33dd-4508-aa09-f698d0c73275 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:54.129293 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2dc14722-33dd-4508-aa09-f698d0c73275 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:54.135664 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2dc14722-33dd-4508-aa09-f698d0c73275 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:54.136617 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2dc14722-33dd-4508-aa09-f698d0c73275 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:54.171667 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-015e5e0c-7537-42e7-916c-057c404fe628 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f911026e35d40a480094376c6556d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f66705b4a0f4711ba14d9ceb5699bd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:54.184834 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-2dc14722-33dd-4508-aa09-f698d0c73275 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Getting quotas for project 3511432a7dee4bec9d1093c9d95b3734. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:12:54.188131 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-015e5e0c-7537-42e7-916c-057c404fe628 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] 10.222.0.61 "GET /compute/v2.1/servers/73e59de1-a2a7-4fa3-b397-2c2c76ba1139" status: 200 len: 1211 microversion: 2.1 time: 0.188294 Aug 31 16:12:54.189228 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1854/3700] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:53 2022] GET /compute/v2.1/servers/73e59de1-a2a7-4fa3-b397-2c2c76ba1139 => generated 1211 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:54.194026 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-2dc14722-33dd-4508-aa09-f698d0c73275 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Getting quotas for user 4ed06378eb9b446680b5a3156a14941d and project 3511432a7dee4bec9d1093c9d95b3734. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:12:54.208634 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e55626e5-47be-4c7a-bef2-26f6f1391b92 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:54.209642 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e55626e5-47be-4c7a-bef2-26f6f1391b92 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] [instance: 9bed27f7-16a5-414d-bb64-700cb4f5cb4b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:54.212262 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2dc14722-33dd-4508-aa09-f698d0c73275 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Going to run 1 instances... {{(pid=122256) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:12:54.215994 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2dc14722-33dd-4508-aa09-f698d0c73275 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] [instance: f04eb48d-000e-4c3b-8799-a4d3cdacf0e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:12:54.225277 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e55626e5-47be-4c7a-bef2-26f6f1391b92 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:54.225797 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e55626e5-47be-4c7a-bef2-26f6f1391b92 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:54.226246 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e55626e5-47be-4c7a-bef2-26f6f1391b92 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:54.230232 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e55626e5-47be-4c7a-bef2-26f6f1391b92 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:54.238975 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e55626e5-47be-4c7a-bef2-26f6f1391b92 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:54.239918 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e55626e5-47be-4c7a-bef2-26f6f1391b92 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:54.304552 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2dc14722-33dd-4508-aa09-f698d0c73275 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.726427 Aug 31 16:12:54.308740 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1847/3701] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:12:52 2022] POST /compute/v2.1/servers => generated 401 bytes in 1730 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:12:54.326487 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-658f89c5-9754-4451-8f5d-2656df5711ff tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:54.327790 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-658f89c5-9754-4451-8f5d-2656df5711ff tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] [instance: f04eb48d-000e-4c3b-8799-a4d3cdacf0e2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:54.478972 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-658f89c5-9754-4451-8f5d-2656df5711ff tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed06378eb9b446680b5a3156a14941d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511432a7dee4bec9d1093c9d95b3734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:54.489444 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-658f89c5-9754-4451-8f5d-2656df5711ff tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] 10.222.0.61 "GET /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2" status: 200 len: 1236 microversion: 2.1 time: 0.172635 Aug 31 16:12:54.490061 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1848/3702] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:54 2022] GET /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2 => generated 1236 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:12:54.622848 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e55626e5-47be-4c7a-bef2-26f6f1391b92 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab268a4d607497da5476256055bb07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14140e7303046f1ada446437826f742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:54.643305 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e55626e5-47be-4c7a-bef2-26f6f1391b92 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] 10.222.0.61 "GET /compute/v2.1/servers/9bed27f7-16a5-414d-bb64-700cb4f5cb4b" status: 200 len: 1512 microversion: 2.1 time: 0.451559 Aug 31 16:12:54.643305 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1855/3703] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:54 2022] GET /compute/v2.1/servers/9bed27f7-16a5-414d-bb64-700cb4f5cb4b => generated 1512 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:55.023414 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6d4ae02b-cbed-415e-9191-450c91592607 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:55.024830 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6d4ae02b-cbed-415e-9191-450c91592607 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: ce9f8f4c-9d4e-48c0-bd66-1c409e91bf5a] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:55.055091 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6d4ae02b-cbed-415e-9191-450c91592607 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:55.066285 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6d4ae02b-cbed-415e-9191-450c91592607 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:55.067483 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6d4ae02b-cbed-415e-9191-450c91592607 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:55.071995 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6d4ae02b-cbed-415e-9191-450c91592607 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:55.079129 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6d4ae02b-cbed-415e-9191-450c91592607 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:55.079937 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6d4ae02b-cbed-415e-9191-450c91592607 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:55.214914 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-03e086d7-23da-4440-91b3-48a93ad45f17 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:55.215630 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-03e086d7-23da-4440-91b3-48a93ad45f17 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] [instance: 73e59de1-a2a7-4fa3-b397-2c2c76ba1139] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:55.232171 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-03e086d7-23da-4440-91b3-48a93ad45f17 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:55.232957 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-03e086d7-23da-4440-91b3-48a93ad45f17 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:55.233632 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-03e086d7-23da-4440-91b3-48a93ad45f17 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:55.235187 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-03e086d7-23da-4440-91b3-48a93ad45f17 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:55.236228 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-03e086d7-23da-4440-91b3-48a93ad45f17 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:55.237614 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-03e086d7-23da-4440-91b3-48a93ad45f17 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:55.633172 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-6d4ae02b-cbed-415e-9191-450c91592607 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:55.637896 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-03e086d7-23da-4440-91b3-48a93ad45f17 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f911026e35d40a480094376c6556d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f66705b4a0f4711ba14d9ceb5699bd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:55.650354 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6d4ae02b-cbed-415e-9191-450c91592607 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/ce9f8f4c-9d4e-48c0-bd66-1c409e91bf5a" status: 200 len: 1309 microversion: 2.1 time: 0.633633 Aug 31 16:12:55.650605 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-03e086d7-23da-4440-91b3-48a93ad45f17 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] 10.222.0.61 "GET /compute/v2.1/servers/73e59de1-a2a7-4fa3-b397-2c2c76ba1139" status: 200 len: 1285 microversion: 2.1 time: 0.443974 Aug 31 16:12:55.658555 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1856/3704] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:55 2022] GET /compute/v2.1/servers/73e59de1-a2a7-4fa3-b397-2c2c76ba1139 => generated 1285 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:12:55.659818 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1849/3705] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:55 2022] GET /compute/v2.1/servers/ce9f8f4c-9d4e-48c0-bd66-1c409e91bf5a => generated 1309 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:55.670335 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-132b485c-b475-4bc2-bec2-b497f78838fd tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:55.670835 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-af172890-b8e2-4c3a-8576-afdb4915a47c tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:55.671292 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-132b485c-b475-4bc2-bec2-b497f78838fd tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] [instance: 9bed27f7-16a5-414d-bb64-700cb4f5cb4b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:55.672227 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-af172890-b8e2-4c3a-8576-afdb4915a47c tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] [instance: f04eb48d-000e-4c3b-8799-a4d3cdacf0e2] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:55.689094 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-af172890-b8e2-4c3a-8576-afdb4915a47c tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:55.690303 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-af172890-b8e2-4c3a-8576-afdb4915a47c tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:55.690946 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-af172890-b8e2-4c3a-8576-afdb4915a47c tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:55.695676 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-af172890-b8e2-4c3a-8576-afdb4915a47c tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:55.696014 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-132b485c-b475-4bc2-bec2-b497f78838fd tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:55.696588 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-af172890-b8e2-4c3a-8576-afdb4915a47c tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:55.696975 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-132b485c-b475-4bc2-bec2-b497f78838fd tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:55.697120 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-af172890-b8e2-4c3a-8576-afdb4915a47c tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:55.697705 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-132b485c-b475-4bc2-bec2-b497f78838fd tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:55.698598 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-132b485c-b475-4bc2-bec2-b497f78838fd tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:55.699333 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-132b485c-b475-4bc2-bec2-b497f78838fd tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:55.699987 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-132b485c-b475-4bc2-bec2-b497f78838fd tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:55.929727 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-132b485c-b475-4bc2-bec2-b497f78838fd tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab268a4d607497da5476256055bb07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14140e7303046f1ada446437826f742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:55.938411 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-af172890-b8e2-4c3a-8576-afdb4915a47c tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed06378eb9b446680b5a3156a14941d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511432a7dee4bec9d1093c9d95b3734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:55.945564 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-132b485c-b475-4bc2-bec2-b497f78838fd tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] 10.222.0.61 "GET /compute/v2.1/servers/9bed27f7-16a5-414d-bb64-700cb4f5cb4b" status: 200 len: 1470 microversion: 2.1 time: 0.278015 Aug 31 16:12:55.946870 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1850/3706] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:55 2022] GET /compute/v2.1/servers/9bed27f7-16a5-414d-bb64-700cb4f5cb4b => generated 1470 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:12:55.949586 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-af172890-b8e2-4c3a-8576-afdb4915a47c tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] 10.222.0.61 "GET /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2" status: 200 len: 1288 microversion: 2.1 time: 0.289204 Aug 31 16:12:55.950177 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1857/3707] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:55 2022] GET /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2 => generated 1288 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:56.677579 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-24ce77b7-0e38-4fff-9816-f4196c7e26f9 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:56.680285 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-24ce77b7-0e38-4fff-9816-f4196c7e26f9 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] [instance: 73e59de1-a2a7-4fa3-b397-2c2c76ba1139] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:56.689074 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-75548623-f599-443d-b857-cd487cdf3af1 req-fcae6b95-a6b6-4e1b-b513-c753bc8e5543 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bed27f7-16a5-414d-bb64-700cb4f5cb4b", "name": "network-vif-deleted", "tag": "4e213241-95f3-4caf-a654-70d6036c1d24"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:12:56.702167 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-24ce77b7-0e38-4fff-9816-f4196c7e26f9 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:56.709483 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-24ce77b7-0e38-4fff-9816-f4196c7e26f9 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:56.710859 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-24ce77b7-0e38-4fff-9816-f4196c7e26f9 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:56.715054 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-75548623-f599-443d-b857-cd487cdf3af1 req-fcae6b95-a6b6-4e1b-b513-c753bc8e5543 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:56.716394 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-24ce77b7-0e38-4fff-9816-f4196c7e26f9 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:56.716980 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-75548623-f599-443d-b857-cd487cdf3af1 req-fcae6b95-a6b6-4e1b-b513-c753bc8e5543 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:56.718054 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-75548623-f599-443d-b857-cd487cdf3af1 req-fcae6b95-a6b6-4e1b-b513-c753bc8e5543 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:56.718202 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-24ce77b7-0e38-4fff-9816-f4196c7e26f9 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:56.719351 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-24ce77b7-0e38-4fff-9816-f4196c7e26f9 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:56.742597 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-75548623-f599-443d-b857-cd487cdf3af1 req-fcae6b95-a6b6-4e1b-b513-c753bc8e5543 service nova] Creating event network-vif-deleted:4e213241-95f3-4caf-a654-70d6036c1d24 for instance 9bed27f7-16a5-414d-bb64-700cb4f5cb4b on n-h1-850499-9 Aug 31 16:12:56.754692 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-75548623-f599-443d-b857-cd487cdf3af1 req-fcae6b95-a6b6-4e1b-b513-c753bc8e5543 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.700619 Aug 31 16:12:56.756490 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1851/3708] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:12:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:12:56.764292 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-84ac4a16-2dec-44bf-bb64-306cf729845f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:56.765362 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-84ac4a16-2dec-44bf-bb64-306cf729845f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: ce9f8f4c-9d4e-48c0-bd66-1c409e91bf5a] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:56.776543 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-84ac4a16-2dec-44bf-bb64-306cf729845f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:56.777883 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-84ac4a16-2dec-44bf-bb64-306cf729845f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:56.779328 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-84ac4a16-2dec-44bf-bb64-306cf729845f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:56.780480 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-84ac4a16-2dec-44bf-bb64-306cf729845f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:56.781210 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-84ac4a16-2dec-44bf-bb64-306cf729845f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:56.782661 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-84ac4a16-2dec-44bf-bb64-306cf729845f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:57.293949 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-24ce77b7-0e38-4fff-9816-f4196c7e26f9 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f911026e35d40a480094376c6556d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f66705b4a0f4711ba14d9ceb5699bd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:57.313221 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-24ce77b7-0e38-4fff-9816-f4196c7e26f9 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] 10.222.0.61 "GET /compute/v2.1/servers/73e59de1-a2a7-4fa3-b397-2c2c76ba1139" status: 200 len: 1315 microversion: 2.1 time: 0.643620 Aug 31 16:12:57.313914 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1858/3709] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:56 2022] GET /compute/v2.1/servers/73e59de1-a2a7-4fa3-b397-2c2c76ba1139 => generated 1315 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:57.327789 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-dddbf8cc-7c7e-47bc-8ec2-269245bdc4a3 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:57.328687 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-dddbf8cc-7c7e-47bc-8ec2-269245bdc4a3 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] [instance: 9bed27f7-16a5-414d-bb64-700cb4f5cb4b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:57.341236 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dddbf8cc-7c7e-47bc-8ec2-269245bdc4a3 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:57.341729 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dddbf8cc-7c7e-47bc-8ec2-269245bdc4a3 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:57.342170 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dddbf8cc-7c7e-47bc-8ec2-269245bdc4a3 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:57.342883 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dddbf8cc-7c7e-47bc-8ec2-269245bdc4a3 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:57.343442 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dddbf8cc-7c7e-47bc-8ec2-269245bdc4a3 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:57.349334 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dddbf8cc-7c7e-47bc-8ec2-269245bdc4a3 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:57.358505 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=100 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:12:57.423669 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:12:57.434920 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dddbf8cc-7c7e-47bc-8ec2-269245bdc4a3 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:57.436772 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dddbf8cc-7c7e-47bc-8ec2-269245bdc4a3 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:57.437425 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dddbf8cc-7c7e-47bc-8ec2-269245bdc4a3 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:57.438182 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-dddbf8cc-7c7e-47bc-8ec2-269245bdc4a3 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lazy-loading 'fault' on Instance uuid 9bed27f7-16a5-414d-bb64-700cb4f5cb4b {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:12:57.579721 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-dddbf8cc-7c7e-47bc-8ec2-269245bdc4a3 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab268a4d607497da5476256055bb07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14140e7303046f1ada446437826f742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:57.595134 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-dddbf8cc-7c7e-47bc-8ec2-269245bdc4a3 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] 10.222.0.61 "GET /compute/v2.1/servers/9bed27f7-16a5-414d-bb64-700cb4f5cb4b" status: 200 len: 1307 microversion: 2.1 time: 0.279467 Aug 31 16:12:57.599624 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1859/3710] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:57 2022] GET /compute/v2.1/servers/9bed27f7-16a5-414d-bb64-700cb4f5cb4b => generated 1307 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:57.605979 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-84ac4a16-2dec-44bf-bb64-306cf729845f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:57.621533 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5dceb1a8-b4b9-4601-a38c-09ffa496a3a0 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:57.631039 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-84ac4a16-2dec-44bf-bb64-306cf729845f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/ce9f8f4c-9d4e-48c0-bd66-1c409e91bf5a" status: 200 len: 1309 microversion: 2.1 time: 0.872443 Aug 31 16:12:57.632214 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5dceb1a8-b4b9-4601-a38c-09ffa496a3a0 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] [instance: f04eb48d-000e-4c3b-8799-a4d3cdacf0e2] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:57.654320 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1852/3711] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:56 2022] GET /compute/v2.1/servers/ce9f8f4c-9d4e-48c0-bd66-1c409e91bf5a => generated 1309 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:57.665423 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5dceb1a8-b4b9-4601-a38c-09ffa496a3a0 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:57.665934 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5dceb1a8-b4b9-4601-a38c-09ffa496a3a0 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:57.666379 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5dceb1a8-b4b9-4601-a38c-09ffa496a3a0 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:57.667167 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5dceb1a8-b4b9-4601-a38c-09ffa496a3a0 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:57.667672 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5dceb1a8-b4b9-4601-a38c-09ffa496a3a0 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:57.668191 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5dceb1a8-b4b9-4601-a38c-09ffa496a3a0 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:57.846750 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5dceb1a8-b4b9-4601-a38c-09ffa496a3a0 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed06378eb9b446680b5a3156a14941d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511432a7dee4bec9d1093c9d95b3734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:57.862211 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5dceb1a8-b4b9-4601-a38c-09ffa496a3a0 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] 10.222.0.61 "GET /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2" status: 200 len: 1294 microversion: 2.1 time: 0.261152 Aug 31 16:12:57.863190 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1860/3712] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:57 2022] GET /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2 => generated 1294 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:58.337593 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c6b134ff-61f2-4fa9-a910-bcd81afcb4dc tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:58.338548 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c6b134ff-61f2-4fa9-a910-bcd81afcb4dc tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] [instance: 73e59de1-a2a7-4fa3-b397-2c2c76ba1139] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:58.368310 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c6b134ff-61f2-4fa9-a910-bcd81afcb4dc tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:58.373682 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c6b134ff-61f2-4fa9-a910-bcd81afcb4dc tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:58.374958 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c6b134ff-61f2-4fa9-a910-bcd81afcb4dc tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:58.376044 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c6b134ff-61f2-4fa9-a910-bcd81afcb4dc tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:58.376875 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c6b134ff-61f2-4fa9-a910-bcd81afcb4dc tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:58.377433 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c6b134ff-61f2-4fa9-a910-bcd81afcb4dc tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:58.626235 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7b4d6e94-ff9c-46a3-bd6c-297e7e6e4f09 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:58.626857 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7b4d6e94-ff9c-46a3-bd6c-297e7e6e4f09 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] [instance: 9bed27f7-16a5-414d-bb64-700cb4f5cb4b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:58.654943 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7b4d6e94-ff9c-46a3-bd6c-297e7e6e4f09 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:58.655954 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7b4d6e94-ff9c-46a3-bd6c-297e7e6e4f09 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:58.656569 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7b4d6e94-ff9c-46a3-bd6c-297e7e6e4f09 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:58.660621 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7b4d6e94-ff9c-46a3-bd6c-297e7e6e4f09 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:58.661451 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7b4d6e94-ff9c-46a3-bd6c-297e7e6e4f09 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:58.663118 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7b4d6e94-ff9c-46a3-bd6c-297e7e6e4f09 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:58.677153 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c6b134ff-61f2-4fa9-a910-bcd81afcb4dc tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f911026e35d40a480094376c6556d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f66705b4a0f4711ba14d9ceb5699bd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:58.682760 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-7b4d6e94-ff9c-46a3-bd6c-297e7e6e4f09 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] HTTP exception thrown: Instance 9bed27f7-16a5-414d-bb64-700cb4f5cb4b could not be found. Aug 31 16:12:58.684969 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7b4d6e94-ff9c-46a3-bd6c-297e7e6e4f09 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Request method failure captured: Aug 31 16:12:58.684969 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/9bed27f7-16a5-414d-bb64-700cb4f5cb4b HTTP/1.1 Aug 31 16:12:58.684969 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:12:58.684969 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:12:58.684969 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:12:58.684969 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:12:58.684969 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:12:58.684969 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:12:58.684969 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:12:58.684969 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:12:58.684969 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4e07VuyA09O3goN-IuYCEqeP0JaUjboqNsaZvnCv9kTcOWmdcYfwKnbotfAUEzeaWoisY7RuMfLOVNGjZfBajDQsdEDiTwL3z2DjYPFTffExpbvnn_edvMhKwMUZy5nl_LaysR04Sxr8LZ85ymrsn6-sE2ciT567voJYfjVFUmPw8Y Aug 31 16:12:58.684969 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:12:58.684969 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:12:58.684969 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:12:58.684969 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:12:58.684969 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:12:58.684969 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:12:58.684969 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: e14140e7303046f1ada446437826f742 Aug 31 16:12:58.684969 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-VolumesAdminNegativeTest-1855178427 Aug 31 16:12:58.684969 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:12:58.684969 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:12:58.684969 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e14140e7303046f1ada446437826f742"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/e14140e7303046f1ada446437826f742"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_e14140e7303046f1ada446437826f742", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e14140e7303046f1ada446437826f742"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:12:58.684969 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-VolumesAdminNegativeTest-1855178427 Aug 31 16:12:58.684969 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: e14140e7303046f1ada446437826f742 Aug 31 16:12:58.684969 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1855178427 Aug 31 16:12:58.684969 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-VolumesAdminNegativeTest-1855178427-project Aug 31 16:12:58.684969 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:12:58.684969 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:12:58.684969 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 6ab268a4d607497da5476256055bb07c Aug 31 16:12:58.684969 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-VolumesAdminNegativeTest-1855178427-project Aug 31 16:12:58.684969 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:12:58.684969 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance 9bed27f7-16a5-414d-bb64-700cb4f5cb4b could not be found. Aug 31 16:12:58.684969 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '9bed27f7-16a5-414d-bb64-700cb4f5cb4b'} Aug 31 16:12:58.684969 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:12:58.684969 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:12:58.684969 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:12:58.684969 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:12:58.684969 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:12:58.684969 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:12:58.684969 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:12:58.684969 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:12:58.684969 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:12:58.684969 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:12:58.684969 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9bed27f7-16a5-414d-bb64-700cb4f5cb4b could not be found. Aug 31 16:12:58.684969 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:12:58.684969 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:12:58.684969 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:12:58.684969 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:12:58.684969 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:12:58.684969 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:12:58.684969 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:12:58.684969 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:12:58.684969 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:12:58.684969 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:12:58.684969 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:12:58.684969 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:12:58.684969 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:12:58.684969 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:12:58.684969 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:12:58.684969 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:12:58.684969 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9bed27f7-16a5-414d-bb64-700cb4f5cb4b could not be found. Aug 31 16:12:58.684969 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:12:58.684969 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:12:58.684969 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:12:58.690693 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:12:58.690693 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:12:58.690693 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:12:58.690693 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:12:58.690693 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:12:58.690693 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9bed27f7-16a5-414d-bb64-700cb4f5cb4b could not be found. Aug 31 16:12:58.690693 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:12:58.693845 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7b4d6e94-ff9c-46a3-bd6c-297e7e6e4f09 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Returning 404 to user: Instance 9bed27f7-16a5-414d-bb64-700cb4f5cb4b could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:12:58.694960 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7b4d6e94-ff9c-46a3-bd6c-297e7e6e4f09 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] 10.222.0.61 "GET /compute/v2.1/servers/9bed27f7-16a5-414d-bb64-700cb4f5cb4b" status: 404 len: 111 microversion: 2.1 time: 0.074697 Aug 31 16:12:58.696330 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1861/3713] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:58 2022] GET /compute/v2.1/servers/9bed27f7-16a5-414d-bb64-700cb4f5cb4b => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 16:12:58.708679 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-67686639-ec7a-4512-9354-63b27443abdb tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:58.709302 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-67686639-ec7a-4512-9354-63b27443abdb tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: ce9f8f4c-9d4e-48c0-bd66-1c409e91bf5a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:58.717912 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-67686639-ec7a-4512-9354-63b27443abdb tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:58.718408 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-67686639-ec7a-4512-9354-63b27443abdb tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:58.719244 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-67686639-ec7a-4512-9354-63b27443abdb tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:58.719997 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-67686639-ec7a-4512-9354-63b27443abdb tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:58.720929 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-67686639-ec7a-4512-9354-63b27443abdb tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:58.721536 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-67686639-ec7a-4512-9354-63b27443abdb tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:58.733518 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c6b134ff-61f2-4fa9-a910-bcd81afcb4dc tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] 10.222.0.61 "GET /compute/v2.1/servers/73e59de1-a2a7-4fa3-b397-2c2c76ba1139" status: 200 len: 1315 microversion: 2.1 time: 0.397671 Aug 31 16:12:58.735140 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1853/3714] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:58 2022] GET /compute/v2.1/servers/73e59de1-a2a7-4fa3-b397-2c2c76ba1139 => generated 1315 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:58.896083 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-949a454e-7f3a-45e4-b7a6-7e87cb503375 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:58.899656 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-949a454e-7f3a-45e4-b7a6-7e87cb503375 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] [instance: f04eb48d-000e-4c3b-8799-a4d3cdacf0e2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:58.908159 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-949a454e-7f3a-45e4-b7a6-7e87cb503375 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:58.909060 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-949a454e-7f3a-45e4-b7a6-7e87cb503375 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:58.909782 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-949a454e-7f3a-45e4-b7a6-7e87cb503375 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:58.911712 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-949a454e-7f3a-45e4-b7a6-7e87cb503375 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:58.912438 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-949a454e-7f3a-45e4-b7a6-7e87cb503375 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:58.913097 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-949a454e-7f3a-45e4-b7a6-7e87cb503375 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:59.247650 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-949a454e-7f3a-45e4-b7a6-7e87cb503375 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed06378eb9b446680b5a3156a14941d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511432a7dee4bec9d1093c9d95b3734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:59.263937 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-949a454e-7f3a-45e4-b7a6-7e87cb503375 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] 10.222.0.61 "GET /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2" status: 200 len: 1294 microversion: 2.1 time: 0.381693 Aug 31 16:12:59.270310 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1854/3715] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:58 2022] GET /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2 => generated 1294 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:59.350817 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-be4fa92c-0cd7-4d74-b90a-6a3913d73f45 req-7ea9928c-75ba-4dc8-95a6-434915d1ef2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73e59de1-a2a7-4fa3-b397-2c2c76ba1139", "tag": "ecd8bce9-b4ed-48ce-8f0c-42438836ce20"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:12:59.387672 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-be4fa92c-0cd7-4d74-b90a-6a3913d73f45 req-7ea9928c-75ba-4dc8-95a6-434915d1ef2c service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:59.388389 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-be4fa92c-0cd7-4d74-b90a-6a3913d73f45 req-7ea9928c-75ba-4dc8-95a6-434915d1ef2c service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:59.388983 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-be4fa92c-0cd7-4d74-b90a-6a3913d73f45 req-7ea9928c-75ba-4dc8-95a6-434915d1ef2c service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:59.430082 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-be4fa92c-0cd7-4d74-b90a-6a3913d73f45 req-7ea9928c-75ba-4dc8-95a6-434915d1ef2c service nova] Creating event network-changed:ecd8bce9-b4ed-48ce-8f0c-42438836ce20 for instance 73e59de1-a2a7-4fa3-b397-2c2c76ba1139 on n-h2-850499-9 Aug 31 16:12:59.448141 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-be4fa92c-0cd7-4d74-b90a-6a3913d73f45 req-7ea9928c-75ba-4dc8-95a6-434915d1ef2c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102966 Aug 31 16:12:59.449554 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1855/3716] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:12:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:12:59.730354 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-67686639-ec7a-4512-9354-63b27443abdb tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:59.759411 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e197bad5-522c-4427-99a9-8aff4960ec30 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:59.760991 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e197bad5-522c-4427-99a9-8aff4960ec30 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] [instance: 73e59de1-a2a7-4fa3-b397-2c2c76ba1139] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:59.764156 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-67686639-ec7a-4512-9354-63b27443abdb tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/ce9f8f4c-9d4e-48c0-bd66-1c409e91bf5a" status: 200 len: 1309 microversion: 2.1 time: 1.064898 Aug 31 16:12:59.767187 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1862/3717] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:58 2022] GET /compute/v2.1/servers/ce9f8f4c-9d4e-48c0-bd66-1c409e91bf5a => generated 1309 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:59.795485 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e197bad5-522c-4427-99a9-8aff4960ec30 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:59.797973 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e197bad5-522c-4427-99a9-8aff4960ec30 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:59.805753 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e197bad5-522c-4427-99a9-8aff4960ec30 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:59.812182 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e197bad5-522c-4427-99a9-8aff4960ec30 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:59.814233 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e197bad5-522c-4427-99a9-8aff4960ec30 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:59.818113 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e197bad5-522c-4427-99a9-8aff4960ec30 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:00.227310 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e197bad5-522c-4427-99a9-8aff4960ec30 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f911026e35d40a480094376c6556d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f66705b4a0f4711ba14d9ceb5699bd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:00.246584 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e197bad5-522c-4427-99a9-8aff4960ec30 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] 10.222.0.61 "GET /compute/v2.1/servers/73e59de1-a2a7-4fa3-b397-2c2c76ba1139" status: 200 len: 1315 microversion: 2.1 time: 0.491634 Aug 31 16:13:00.251595 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1856/3718] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:59 2022] GET /compute/v2.1/servers/73e59de1-a2a7-4fa3-b397-2c2c76ba1139 => generated 1315 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:13:00.291668 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-94a3b157-2f44-409d-8b27-7659283118a0 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:00.293145 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-94a3b157-2f44-409d-8b27-7659283118a0 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] [instance: f04eb48d-000e-4c3b-8799-a4d3cdacf0e2] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:00.318067 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-94a3b157-2f44-409d-8b27-7659283118a0 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:00.320858 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-94a3b157-2f44-409d-8b27-7659283118a0 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:00.322628 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-94a3b157-2f44-409d-8b27-7659283118a0 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:00.324294 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-94a3b157-2f44-409d-8b27-7659283118a0 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:00.327333 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-94a3b157-2f44-409d-8b27-7659283118a0 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:00.328575 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-94a3b157-2f44-409d-8b27-7659283118a0 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:00.492539 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-59b039d4-575e-4a17-9330-6441a43f8f56 req-bd5ca54a-5565-4bb1-86a9-aa894f9c2851 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce9f8f4c-9d4e-48c0-bd66-1c409e91bf5a", "name": "network-vif-plugged", "status": "completed", "tag": "c4695205-af18-4876-807f-c392a29402d0"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:13:00.543190 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-59b039d4-575e-4a17-9330-6441a43f8f56 req-bd5ca54a-5565-4bb1-86a9-aa894f9c2851 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:00.547892 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-59b039d4-575e-4a17-9330-6441a43f8f56 req-bd5ca54a-5565-4bb1-86a9-aa894f9c2851 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:00.549918 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-59b039d4-575e-4a17-9330-6441a43f8f56 req-bd5ca54a-5565-4bb1-86a9-aa894f9c2851 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:00.602914 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-59b039d4-575e-4a17-9330-6441a43f8f56 req-bd5ca54a-5565-4bb1-86a9-aa894f9c2851 service nova] Creating event network-vif-plugged:c4695205-af18-4876-807f-c392a29402d0 for instance ce9f8f4c-9d4e-48c0-bd66-1c409e91bf5a on n-h1-850499-9 Aug 31 16:13:00.616950 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-59b039d4-575e-4a17-9330-6441a43f8f56 req-bd5ca54a-5565-4bb1-86a9-aa894f9c2851 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130365 Aug 31 16:13:00.627405 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1857/3719] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:13:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:13:00.729155 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-94a3b157-2f44-409d-8b27-7659283118a0 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed06378eb9b446680b5a3156a14941d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511432a7dee4bec9d1093c9d95b3734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:00.743572 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-94a3b157-2f44-409d-8b27-7659283118a0 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] 10.222.0.61 "GET /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2" status: 200 len: 1361 microversion: 2.1 time: 0.458049 Aug 31 16:13:00.765832 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1863/3720] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:00 2022] GET /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2 => generated 1361 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:00.797726 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5c2661c0-019f-4617-9884-c1cab277d1bd tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:00.798658 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5c2661c0-019f-4617-9884-c1cab277d1bd tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: ce9f8f4c-9d4e-48c0-bd66-1c409e91bf5a] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:00.809032 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5c2661c0-019f-4617-9884-c1cab277d1bd tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:00.810257 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5c2661c0-019f-4617-9884-c1cab277d1bd tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:00.811140 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5c2661c0-019f-4617-9884-c1cab277d1bd tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:00.812178 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5c2661c0-019f-4617-9884-c1cab277d1bd tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:00.812872 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5c2661c0-019f-4617-9884-c1cab277d1bd tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:00.814296 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5c2661c0-019f-4617-9884-c1cab277d1bd tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:01.107383 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5c2661c0-019f-4617-9884-c1cab277d1bd tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:01.124219 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5c2661c0-019f-4617-9884-c1cab277d1bd tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/ce9f8f4c-9d4e-48c0-bd66-1c409e91bf5a" status: 200 len: 1309 microversion: 2.1 time: 0.332373 Aug 31 16:13:01.126007 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1858/3721] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:00 2022] GET /compute/v2.1/servers/ce9f8f4c-9d4e-48c0-bd66-1c409e91bf5a => generated 1309 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:01.282389 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-26aa1276-38cf-434c-b3f0-787a693b9737 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:01.283835 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-26aa1276-38cf-434c-b3f0-787a693b9737 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] [instance: 73e59de1-a2a7-4fa3-b397-2c2c76ba1139] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:01.296245 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-26aa1276-38cf-434c-b3f0-787a693b9737 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:01.297121 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-26aa1276-38cf-434c-b3f0-787a693b9737 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:01.297940 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-26aa1276-38cf-434c-b3f0-787a693b9737 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:01.299205 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-26aa1276-38cf-434c-b3f0-787a693b9737 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:01.300312 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-26aa1276-38cf-434c-b3f0-787a693b9737 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:01.302565 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-26aa1276-38cf-434c-b3f0-787a693b9737 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:01.688851 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-26aa1276-38cf-434c-b3f0-787a693b9737 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f911026e35d40a480094376c6556d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f66705b4a0f4711ba14d9ceb5699bd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:01.713718 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-26aa1276-38cf-434c-b3f0-787a693b9737 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] 10.222.0.61 "GET /compute/v2.1/servers/73e59de1-a2a7-4fa3-b397-2c2c76ba1139" status: 200 len: 1315 microversion: 2.1 time: 0.438620 Aug 31 16:13:01.716001 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1864/3722] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:01 2022] GET /compute/v2.1/servers/73e59de1-a2a7-4fa3-b397-2c2c76ba1139 => generated 1315 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:01.774631 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d00e70e2-8de3-4a05-935f-b9eb7d9c4ece tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:01.781782 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d00e70e2-8de3-4a05-935f-b9eb7d9c4ece tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] [instance: f04eb48d-000e-4c3b-8799-a4d3cdacf0e2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:01.789490 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d00e70e2-8de3-4a05-935f-b9eb7d9c4ece tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:01.790372 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d00e70e2-8de3-4a05-935f-b9eb7d9c4ece tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:01.790849 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d00e70e2-8de3-4a05-935f-b9eb7d9c4ece tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:01.791766 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d00e70e2-8de3-4a05-935f-b9eb7d9c4ece tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:01.792253 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d00e70e2-8de3-4a05-935f-b9eb7d9c4ece tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:01.792919 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d00e70e2-8de3-4a05-935f-b9eb7d9c4ece tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:02.148648 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-188312d0-449b-4e3f-add1-2e6eab5dc0a4 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:02.149470 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-188312d0-449b-4e3f-add1-2e6eab5dc0a4 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: ce9f8f4c-9d4e-48c0-bd66-1c409e91bf5a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:02.172633 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-188312d0-449b-4e3f-add1-2e6eab5dc0a4 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:02.173526 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-188312d0-449b-4e3f-add1-2e6eab5dc0a4 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:02.174764 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-188312d0-449b-4e3f-add1-2e6eab5dc0a4 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:02.176596 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-188312d0-449b-4e3f-add1-2e6eab5dc0a4 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:02.177171 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-188312d0-449b-4e3f-add1-2e6eab5dc0a4 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:02.179227 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-188312d0-449b-4e3f-add1-2e6eab5dc0a4 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:02.305018 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d00e70e2-8de3-4a05-935f-b9eb7d9c4ece tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed06378eb9b446680b5a3156a14941d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511432a7dee4bec9d1093c9d95b3734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:02.323877 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d00e70e2-8de3-4a05-935f-b9eb7d9c4ece tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] 10.222.0.61 "GET /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2" status: 200 len: 1361 microversion: 2.1 time: 0.553976 Aug 31 16:13:02.326256 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1859/3723] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:01 2022] GET /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2 => generated 1361 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:13:02.686100 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-188312d0-449b-4e3f-add1-2e6eab5dc0a4 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:02.699244 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-188312d0-449b-4e3f-add1-2e6eab5dc0a4 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/ce9f8f4c-9d4e-48c0-bd66-1c409e91bf5a" status: 200 len: 1309 microversion: 2.1 time: 0.554988 Aug 31 16:13:02.700016 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1865/3724] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:02 2022] GET /compute/v2.1/servers/ce9f8f4c-9d4e-48c0-bd66-1c409e91bf5a => generated 1309 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:13:02.761333 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9a48d5e7-9d36-40e7-a320-1ace42d4ab14 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:02.765240 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9a48d5e7-9d36-40e7-a320-1ace42d4ab14 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] [instance: 73e59de1-a2a7-4fa3-b397-2c2c76ba1139] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:02.791660 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9a48d5e7-9d36-40e7-a320-1ace42d4ab14 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:02.793174 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9a48d5e7-9d36-40e7-a320-1ace42d4ab14 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:02.793720 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9a48d5e7-9d36-40e7-a320-1ace42d4ab14 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:02.794984 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9a48d5e7-9d36-40e7-a320-1ace42d4ab14 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:02.794984 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9a48d5e7-9d36-40e7-a320-1ace42d4ab14 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:02.799476 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9a48d5e7-9d36-40e7-a320-1ace42d4ab14 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:02.987805 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-d98fa71f-27ef-4763-87c6-39cf88949ad5 req-4065f0a3-858b-41ec-a824-f549f6a641f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f04eb48d-000e-4c3b-8799-a4d3cdacf0e2", "tag": "e50b9368-8cb7-4eff-9832-0a103ac0abdc"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:13:03.024985 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:13:03.027345 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=6 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:13:03.034811 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-d98fa71f-27ef-4763-87c6-39cf88949ad5 req-4065f0a3-858b-41ec-a824-f549f6a641f0 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:03.036352 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-d98fa71f-27ef-4763-87c6-39cf88949ad5 req-4065f0a3-858b-41ec-a824-f549f6a641f0 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:03.037439 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-d98fa71f-27ef-4763-87c6-39cf88949ad5 req-4065f0a3-858b-41ec-a824-f549f6a641f0 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:03.119672 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-d98fa71f-27ef-4763-87c6-39cf88949ad5 req-4065f0a3-858b-41ec-a824-f549f6a641f0 service nova] Creating event network-changed:e50b9368-8cb7-4eff-9832-0a103ac0abdc for instance f04eb48d-000e-4c3b-8799-a4d3cdacf0e2 on n-h1-850499-9 Aug 31 16:13:03.135977 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-d98fa71f-27ef-4763-87c6-39cf88949ad5 req-4065f0a3-858b-41ec-a824-f549f6a641f0 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.153080 Aug 31 16:13:03.138494 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1866/3725] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:13:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:13:03.360998 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1140faf6-f1a1-4b2b-92c9-6fdade589b38 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:03.368597 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1140faf6-f1a1-4b2b-92c9-6fdade589b38 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] [instance: f04eb48d-000e-4c3b-8799-a4d3cdacf0e2] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:03.397196 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1140faf6-f1a1-4b2b-92c9-6fdade589b38 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:03.400691 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1140faf6-f1a1-4b2b-92c9-6fdade589b38 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:03.427404 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1140faf6-f1a1-4b2b-92c9-6fdade589b38 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:03.430415 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1140faf6-f1a1-4b2b-92c9-6fdade589b38 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:03.433090 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1140faf6-f1a1-4b2b-92c9-6fdade589b38 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:03.438052 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1140faf6-f1a1-4b2b-92c9-6fdade589b38 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:03.616754 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-9a48d5e7-9d36-40e7-a320-1ace42d4ab14 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f911026e35d40a480094376c6556d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f66705b4a0f4711ba14d9ceb5699bd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:03.629262 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9a48d5e7-9d36-40e7-a320-1ace42d4ab14 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] 10.222.0.61 "GET /compute/v2.1/servers/73e59de1-a2a7-4fa3-b397-2c2c76ba1139" status: 200 len: 1315 microversion: 2.1 time: 0.880534 Aug 31 16:13:03.633305 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1860/3726] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:02 2022] GET /compute/v2.1/servers/73e59de1-a2a7-4fa3-b397-2c2c76ba1139 => generated 1315 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:03.733019 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0dcfde42-9f9f-422c-81ec-5c0661f968f8 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:03.733871 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0dcfde42-9f9f-422c-81ec-5c0661f968f8 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: ce9f8f4c-9d4e-48c0-bd66-1c409e91bf5a] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:03.753495 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0dcfde42-9f9f-422c-81ec-5c0661f968f8 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:03.759121 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0dcfde42-9f9f-422c-81ec-5c0661f968f8 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:03.760726 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0dcfde42-9f9f-422c-81ec-5c0661f968f8 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:03.762623 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0dcfde42-9f9f-422c-81ec-5c0661f968f8 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:03.763324 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0dcfde42-9f9f-422c-81ec-5c0661f968f8 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:03.764196 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0dcfde42-9f9f-422c-81ec-5c0661f968f8 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:04.098599 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-1140faf6-f1a1-4b2b-92c9-6fdade589b38 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed06378eb9b446680b5a3156a14941d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511432a7dee4bec9d1093c9d95b3734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:04.120848 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1140faf6-f1a1-4b2b-92c9-6fdade589b38 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] 10.222.0.61 "GET /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2" status: 200 len: 1361 microversion: 2.1 time: 0.767761 Aug 31 16:13:04.124788 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1867/3727] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:03 2022] GET /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2 => generated 1361 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:04.153755 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:13:04.365844 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e20c4e74-8699-4089-bae4-39d980731e8e tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-248626342", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:13:04.395582 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-0dcfde42-9f9f-422c-81ec-5c0661f968f8 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:04.406022 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0dcfde42-9f9f-422c-81ec-5c0661f968f8 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/ce9f8f4c-9d4e-48c0-bd66-1c409e91bf5a" status: 200 len: 1490 microversion: 2.1 time: 0.680126 Aug 31 16:13:04.407246 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1861/3728] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:03 2022] GET /compute/v2.1/servers/ce9f8f4c-9d4e-48c0-bd66-1c409e91bf5a => generated 1490 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:04.510152 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-e20c4e74-8699-4089-bae4-39d980731e8e tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] validate_networks() for [('082559a5-13c4-4b91-860a-8530721dd584', None, None, None, None, None)] {{(pid=122257) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:13:04.617050 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b8854b27-2183-49d2-9777-7626ef9969b9 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:04.617650 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b8854b27-2183-49d2-9777-7626ef9969b9 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] [instance: eed024b5-986b-40fa-a686-ceab563a6131] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:04.624920 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=20 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:13:04.630006 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b8854b27-2183-49d2-9777-7626ef9969b9 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:04.630799 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b8854b27-2183-49d2-9777-7626ef9969b9 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:04.631426 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b8854b27-2183-49d2-9777-7626ef9969b9 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:04.633208 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b8854b27-2183-49d2-9777-7626ef9969b9 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:04.634347 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b8854b27-2183-49d2-9777-7626ef9969b9 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:04.634946 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b8854b27-2183-49d2-9777-7626ef9969b9 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:04.673508 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b8854b27-2183-49d2-9777-7626ef9969b9 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] [instance: eed024b5-986b-40fa-a686-ceab563a6131] Going to try to terminate instance {{(pid=122256) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:13:04.754408 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=98,nova_cell1:UPDATE=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:13:04.788944 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:13:04.800205 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b8854b27-2183-49d2-9777-7626ef9969b9 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] 10.222.0.61 "DELETE /compute/v2.1/servers/eed024b5-986b-40fa-a686-ceab563a6131" status: 204 len: 0 microversion: 2.1 time: 0.187391 Aug 31 16:13:04.801512 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1862/3729] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:13:04 2022] DELETE /compute/v2.1/servers/eed024b5-986b-40fa-a686-ceab563a6131 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:13:04.807219 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-462bcdda-5831-4b72-83ae-4a1e96495140 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1705637090", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "networks": [{"uuid": "e418f255-318f-476c-a353-8d292b5f7798"}]}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:13:04.885480 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-462bcdda-5831-4b72-83ae-4a1e96495140 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] validate_networks() for [('e418f255-318f-476c-a353-8d292b5f7798', None, None, None, None, None)] {{(pid=122256) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:13:06.551707 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-e20c4e74-8699-4089-bae4-39d980731e8e tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:13:06.554000 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-e20c4e74-8699-4089-bae4-39d980731e8e tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:13:06.555723 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-e20c4e74-8699-4089-bae4-39d980731e8e tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:13:06.557139 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-e20c4e74-8699-4089-bae4-39d980731e8e tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:13:06.558741 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-e20c4e74-8699-4089-bae4-39d980731e8e tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:13:06.577438 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e20c4e74-8699-4089-bae4-39d980731e8e tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:06.579205 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e20c4e74-8699-4089-bae4-39d980731e8e tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:06.580416 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e20c4e74-8699-4089-bae4-39d980731e8e tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:06.582578 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e20c4e74-8699-4089-bae4-39d980731e8e tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:06.584439 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e20c4e74-8699-4089-bae4-39d980731e8e tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:06.585325 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e20c4e74-8699-4089-bae4-39d980731e8e tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:06.614651 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-e20c4e74-8699-4089-bae4-39d980731e8e tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Getting quotas for project 4a957b6585e74a31b5bc5f66441c33e3. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:13:06.625789 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-e20c4e74-8699-4089-bae4-39d980731e8e tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Getting quotas for user d48ee960c38f4d0584ea5ce34579279f and project 4a957b6585e74a31b5bc5f66441c33e3. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:13:06.671742 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e20c4e74-8699-4089-bae4-39d980731e8e tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Going to run 1 instances... {{(pid=122257) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:13:06.675001 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e20c4e74-8699-4089-bae4-39d980731e8e tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: c6bfb382-b9a8-4bf0-b868-ee5f51f9daac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:13:06.744423 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e20c4e74-8699-4089-bae4-39d980731e8e tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.617417 Aug 31 16:13:06.746016 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1868/3730] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:13:04 2022] POST /compute/v2.1/servers => generated 383 bytes in 2620 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:13:06.759830 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e4151b2d-e5e2-4a8a-abe6-259663c85f54 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:06.761594 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e4151b2d-e5e2-4a8a-abe6-259663c85f54 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] [instance: 73e59de1-a2a7-4fa3-b397-2c2c76ba1139] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:06.773096 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e4151b2d-e5e2-4a8a-abe6-259663c85f54 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:06.774024 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e4151b2d-e5e2-4a8a-abe6-259663c85f54 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:06.775214 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e4151b2d-e5e2-4a8a-abe6-259663c85f54 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:06.776180 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e4151b2d-e5e2-4a8a-abe6-259663c85f54 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:06.776812 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e4151b2d-e5e2-4a8a-abe6-259663c85f54 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:06.777395 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e4151b2d-e5e2-4a8a-abe6-259663c85f54 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:06.841289 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-462bcdda-5831-4b72-83ae-4a1e96495140 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:13:06.842248 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-462bcdda-5831-4b72-83ae-4a1e96495140 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:13:06.844465 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-462bcdda-5831-4b72-83ae-4a1e96495140 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:13:06.845222 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-462bcdda-5831-4b72-83ae-4a1e96495140 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:13:06.845912 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-462bcdda-5831-4b72-83ae-4a1e96495140 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:13:06.878556 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-462bcdda-5831-4b72-83ae-4a1e96495140 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:06.879377 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-462bcdda-5831-4b72-83ae-4a1e96495140 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:06.880105 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-462bcdda-5831-4b72-83ae-4a1e96495140 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:06.881112 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-462bcdda-5831-4b72-83ae-4a1e96495140 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:06.881750 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-462bcdda-5831-4b72-83ae-4a1e96495140 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:06.882354 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-462bcdda-5831-4b72-83ae-4a1e96495140 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:06.929945 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-462bcdda-5831-4b72-83ae-4a1e96495140 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Getting quotas for project 5299955053c842b6aa02e058f4b1c0cb. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:13:06.937354 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-462bcdda-5831-4b72-83ae-4a1e96495140 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Getting quotas for user 6e707652819c497bbdf94f85f39c447a and project 5299955053c842b6aa02e058f4b1c0cb. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:13:06.963264 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-462bcdda-5831-4b72-83ae-4a1e96495140 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Going to run 1 instances... {{(pid=122256) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:13:06.966652 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-462bcdda-5831-4b72-83ae-4a1e96495140 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 3bf38c6a-3419-4b05-a06c-ccf8d89397f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:13:07.059678 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-462bcdda-5831-4b72-83ae-4a1e96495140 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.256452 Aug 31 16:13:07.062828 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1863/3731] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:13:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 2260 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:13:07.073195 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8ea9293e-4268-4877-82ac-992dd4e8800d tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:07.076600 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8ea9293e-4268-4877-82ac-992dd4e8800d tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] [instance: eed024b5-986b-40fa-a686-ceab563a6131] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:07.098564 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8ea9293e-4268-4877-82ac-992dd4e8800d tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:07.098564 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8ea9293e-4268-4877-82ac-992dd4e8800d tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:07.098919 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8ea9293e-4268-4877-82ac-992dd4e8800d tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:07.099408 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8ea9293e-4268-4877-82ac-992dd4e8800d tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:07.100063 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8ea9293e-4268-4877-82ac-992dd4e8800d tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:07.100656 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8ea9293e-4268-4877-82ac-992dd4e8800d tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:07.433683 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e4151b2d-e5e2-4a8a-abe6-259663c85f54 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f911026e35d40a480094376c6556d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f66705b4a0f4711ba14d9ceb5699bd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:07.469914 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e4151b2d-e5e2-4a8a-abe6-259663c85f54 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] 10.222.0.61 "GET /compute/v2.1/servers/73e59de1-a2a7-4fa3-b397-2c2c76ba1139" status: 200 len: 1315 microversion: 2.1 time: 0.720830 Aug 31 16:13:07.502182 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1869/3732] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:06 2022] GET /compute/v2.1/servers/73e59de1-a2a7-4fa3-b397-2c2c76ba1139 => generated 1315 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:07.531158 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ee8851d7-1958-4691-9dcd-1c9264f484ff tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:07.534205 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ee8851d7-1958-4691-9dcd-1c9264f484ff tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] [instance: f04eb48d-000e-4c3b-8799-a4d3cdacf0e2] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:07.558410 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ee8851d7-1958-4691-9dcd-1c9264f484ff tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:07.560165 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ee8851d7-1958-4691-9dcd-1c9264f484ff tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:07.562640 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ee8851d7-1958-4691-9dcd-1c9264f484ff tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:07.571835 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ee8851d7-1958-4691-9dcd-1c9264f484ff tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:07.572966 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ee8851d7-1958-4691-9dcd-1c9264f484ff tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:07.573476 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ee8851d7-1958-4691-9dcd-1c9264f484ff tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:07.638905 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8ea9293e-4268-4877-82ac-992dd4e8800d tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab268a4d607497da5476256055bb07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14140e7303046f1ada446437826f742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:07.658533 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8ea9293e-4268-4877-82ac-992dd4e8800d tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] 10.222.0.61 "GET /compute/v2.1/servers/eed024b5-986b-40fa-a686-ceab563a6131" status: 200 len: 1679 microversion: 2.1 time: 0.594275 Aug 31 16:13:07.664652 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1864/3733] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:07 2022] GET /compute/v2.1/servers/eed024b5-986b-40fa-a686-ceab563a6131 => generated 1679 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:07.704074 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5584f8f6-5747-46db-97e6-2f748f447fb4 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:07.705623 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5584f8f6-5747-46db-97e6-2f748f447fb4 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: c6bfb382-b9a8-4bf0-b868-ee5f51f9daac] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:08.333305 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5584f8f6-5747-46db-97e6-2f748f447fb4 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48ee960c38f4d0584ea5ce34579279f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a957b6585e74a31b5bc5f66441c33e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:08.345911 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5584f8f6-5747-46db-97e6-2f748f447fb4 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "GET /compute/v2.1/servers/c6bfb382-b9a8-4bf0-b868-ee5f51f9daac" status: 200 len: 1213 microversion: 2.1 time: 0.675969 Aug 31 16:13:08.350042 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1865/3734] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:07 2022] GET /compute/v2.1/servers/c6bfb382-b9a8-4bf0-b868-ee5f51f9daac => generated 1213 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:08.361201 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3d7e01d7-a626-45c1-8da8-f3d3d0541355 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:08.364812 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3d7e01d7-a626-45c1-8da8-f3d3d0541355 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 3bf38c6a-3419-4b05-a06c-ccf8d89397f7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:08.382432 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3d7e01d7-a626-45c1-8da8-f3d3d0541355 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:08.383285 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3d7e01d7-a626-45c1-8da8-f3d3d0541355 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:08.383995 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3d7e01d7-a626-45c1-8da8-f3d3d0541355 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:08.387802 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3d7e01d7-a626-45c1-8da8-f3d3d0541355 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:08.388637 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3d7e01d7-a626-45c1-8da8-f3d3d0541355 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:08.389304 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3d7e01d7-a626-45c1-8da8-f3d3d0541355 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:08.741927 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3d7e01d7-a626-45c1-8da8-f3d3d0541355 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:08.762435 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3d7e01d7-a626-45c1-8da8-f3d3d0541355 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/3bf38c6a-3419-4b05-a06c-ccf8d89397f7" status: 200 len: 1213 microversion: 2.1 time: 0.408853 Aug 31 16:13:08.763378 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1866/3735] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:08 2022] GET /compute/v2.1/servers/3bf38c6a-3419-4b05-a06c-ccf8d89397f7 => generated 1213 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:08.775034 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-071e1e6d-bf0e-4374-8073-a0d207894f2f tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:08.775964 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-071e1e6d-bf0e-4374-8073-a0d207894f2f tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] [instance: 73e59de1-a2a7-4fa3-b397-2c2c76ba1139] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:08.793691 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-071e1e6d-bf0e-4374-8073-a0d207894f2f tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:08.793929 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-071e1e6d-bf0e-4374-8073-a0d207894f2f tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:08.794571 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-071e1e6d-bf0e-4374-8073-a0d207894f2f tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:08.795465 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-071e1e6d-bf0e-4374-8073-a0d207894f2f tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:08.795990 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-071e1e6d-bf0e-4374-8073-a0d207894f2f tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:08.795990 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-071e1e6d-bf0e-4374-8073-a0d207894f2f tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:08.928600 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ee8851d7-1958-4691-9dcd-1c9264f484ff tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed06378eb9b446680b5a3156a14941d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511432a7dee4bec9d1093c9d95b3734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:08.942927 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ee8851d7-1958-4691-9dcd-1c9264f484ff tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] 10.222.0.61 "GET /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2" status: 200 len: 1361 microversion: 2.1 time: 1.439291 Aug 31 16:13:08.962104 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1870/3736] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:07 2022] GET /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2 => generated 1361 bytes in 1455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:08.971187 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c4c08d9a-f451-425b-bc8d-3e45b8d638c7 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:08.972338 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c4c08d9a-f451-425b-bc8d-3e45b8d638c7 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] [instance: eed024b5-986b-40fa-a686-ceab563a6131] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:08.980895 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c4c08d9a-f451-425b-bc8d-3e45b8d638c7 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:08.981747 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c4c08d9a-f451-425b-bc8d-3e45b8d638c7 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:08.982499 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c4c08d9a-f451-425b-bc8d-3e45b8d638c7 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:08.983420 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c4c08d9a-f451-425b-bc8d-3e45b8d638c7 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:08.984137 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c4c08d9a-f451-425b-bc8d-3e45b8d638c7 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:08.984794 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c4c08d9a-f451-425b-bc8d-3e45b8d638c7 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:09.392014 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-071e1e6d-bf0e-4374-8073-a0d207894f2f tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f911026e35d40a480094376c6556d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f66705b4a0f4711ba14d9ceb5699bd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:09.405705 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-071e1e6d-bf0e-4374-8073-a0d207894f2f tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] 10.222.0.61 "GET /compute/v2.1/servers/73e59de1-a2a7-4fa3-b397-2c2c76ba1139" status: 200 len: 1315 microversion: 2.1 time: 0.640997 Aug 31 16:13:09.416370 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1867/3737] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:08 2022] GET /compute/v2.1/servers/73e59de1-a2a7-4fa3-b397-2c2c76ba1139 => generated 1315 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:09.421657 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ca2b37d9-f8bd-477b-a127-21343d35470c tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:09.430036 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ca2b37d9-f8bd-477b-a127-21343d35470c tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: c6bfb382-b9a8-4bf0-b868-ee5f51f9daac] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:09.437246 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ca2b37d9-f8bd-477b-a127-21343d35470c tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:09.438281 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ca2b37d9-f8bd-477b-a127-21343d35470c tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:09.438846 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ca2b37d9-f8bd-477b-a127-21343d35470c tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:09.439733 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ca2b37d9-f8bd-477b-a127-21343d35470c tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:09.440320 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ca2b37d9-f8bd-477b-a127-21343d35470c tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:09.440862 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ca2b37d9-f8bd-477b-a127-21343d35470c tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:09.607937 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ca2b37d9-f8bd-477b-a127-21343d35470c tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48ee960c38f4d0584ea5ce34579279f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a957b6585e74a31b5bc5f66441c33e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:09.625491 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ca2b37d9-f8bd-477b-a127-21343d35470c tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "GET /compute/v2.1/servers/c6bfb382-b9a8-4bf0-b868-ee5f51f9daac" status: 200 len: 1265 microversion: 2.1 time: 0.207560 Aug 31 16:13:09.636526 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1868/3738] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:09 2022] GET /compute/v2.1/servers/c6bfb382-b9a8-4bf0-b868-ee5f51f9daac => generated 1265 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:09.790838 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-012362b8-2bf9-47bf-b0cf-a527a93cfc90 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:09.791487 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-012362b8-2bf9-47bf-b0cf-a527a93cfc90 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 3bf38c6a-3419-4b05-a06c-ccf8d89397f7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:09.801759 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-012362b8-2bf9-47bf-b0cf-a527a93cfc90 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:09.802496 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-012362b8-2bf9-47bf-b0cf-a527a93cfc90 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:09.805771 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-012362b8-2bf9-47bf-b0cf-a527a93cfc90 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:09.806776 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-012362b8-2bf9-47bf-b0cf-a527a93cfc90 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:09.812787 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-012362b8-2bf9-47bf-b0cf-a527a93cfc90 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:09.813561 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c4c08d9a-f451-425b-bc8d-3e45b8d638c7 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab268a4d607497da5476256055bb07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14140e7303046f1ada446437826f742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:09.814114 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-012362b8-2bf9-47bf-b0cf-a527a93cfc90 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:09.832294 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c4c08d9a-f451-425b-bc8d-3e45b8d638c7 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] 10.222.0.61 "GET /compute/v2.1/servers/eed024b5-986b-40fa-a686-ceab563a6131" status: 200 len: 1679 microversion: 2.1 time: 0.868128 Aug 31 16:13:09.833491 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1871/3739] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:08 2022] GET /compute/v2.1/servers/eed024b5-986b-40fa-a686-ceab563a6131 => generated 1679 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:09.970939 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a4dc7f84-ed24-4c9e-9b34-6b436f896260 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:09.971948 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a4dc7f84-ed24-4c9e-9b34-6b436f896260 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] [instance: f04eb48d-000e-4c3b-8799-a4d3cdacf0e2] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:09.981428 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a4dc7f84-ed24-4c9e-9b34-6b436f896260 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:09.983404 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a4dc7f84-ed24-4c9e-9b34-6b436f896260 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:09.984315 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a4dc7f84-ed24-4c9e-9b34-6b436f896260 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:09.985274 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a4dc7f84-ed24-4c9e-9b34-6b436f896260 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:09.986738 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a4dc7f84-ed24-4c9e-9b34-6b436f896260 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:09.987616 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a4dc7f84-ed24-4c9e-9b34-6b436f896260 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:10.005012 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-012362b8-2bf9-47bf-b0cf-a527a93cfc90 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:10.013440 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-012362b8-2bf9-47bf-b0cf-a527a93cfc90 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/3bf38c6a-3419-4b05-a06c-ccf8d89397f7" status: 200 len: 1205 microversion: 2.1 time: 0.226261 Aug 31 16:13:10.023142 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1869/3740] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:09 2022] GET /compute/v2.1/servers/3bf38c6a-3419-4b05-a06c-ccf8d89397f7 => generated 1205 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:10.038606 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-6ee9769a-da3c-49d9-a598-5036fa266340 req-e9bfa889-bd01-4b58-8d79-437795f4d787 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73e59de1-a2a7-4fa3-b397-2c2c76ba1139", "name": "network-vif-plugged", "status": "completed", "tag": "ecd8bce9-b4ed-48ce-8f0c-42438836ce20"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:13:10.083121 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-6ee9769a-da3c-49d9-a598-5036fa266340 req-e9bfa889-bd01-4b58-8d79-437795f4d787 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:10.084405 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-6ee9769a-da3c-49d9-a598-5036fa266340 req-e9bfa889-bd01-4b58-8d79-437795f4d787 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:10.085512 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-6ee9769a-da3c-49d9-a598-5036fa266340 req-e9bfa889-bd01-4b58-8d79-437795f4d787 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:10.107267 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-6ee9769a-da3c-49d9-a598-5036fa266340 req-e9bfa889-bd01-4b58-8d79-437795f4d787 service nova] Creating event network-vif-plugged:ecd8bce9-b4ed-48ce-8f0c-42438836ce20 for instance 73e59de1-a2a7-4fa3-b397-2c2c76ba1139 on n-h2-850499-9 Aug 31 16:13:10.115234 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-6ee9769a-da3c-49d9-a598-5036fa266340 req-e9bfa889-bd01-4b58-8d79-437795f4d787 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087595 Aug 31 16:13:10.116414 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1870/3741] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:13:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:13:10.453256 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2f0b5aac-202b-4cad-b268-6fcf4f1d31fc tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:10.457487 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2f0b5aac-202b-4cad-b268-6fcf4f1d31fc tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] [instance: 73e59de1-a2a7-4fa3-b397-2c2c76ba1139] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:10.490332 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2f0b5aac-202b-4cad-b268-6fcf4f1d31fc tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:10.493578 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2f0b5aac-202b-4cad-b268-6fcf4f1d31fc tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:10.494266 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2f0b5aac-202b-4cad-b268-6fcf4f1d31fc tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:10.497214 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2f0b5aac-202b-4cad-b268-6fcf4f1d31fc tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:10.497990 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2f0b5aac-202b-4cad-b268-6fcf4f1d31fc tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:10.498605 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2f0b5aac-202b-4cad-b268-6fcf4f1d31fc tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:11.662865 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-2f0b5aac-202b-4cad-b268-6fcf4f1d31fc tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f911026e35d40a480094376c6556d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f66705b4a0f4711ba14d9ceb5699bd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:11.680452 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2f0b5aac-202b-4cad-b268-6fcf4f1d31fc tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] 10.222.0.61 "GET /compute/v2.1/servers/73e59de1-a2a7-4fa3-b397-2c2c76ba1139" status: 200 len: 1315 microversion: 2.1 time: 1.243248 Aug 31 16:13:11.692034 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1871/3742] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:10 2022] GET /compute/v2.1/servers/73e59de1-a2a7-4fa3-b397-2c2c76ba1139 => generated 1315 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:11.696617 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c49dc81e-fbb7-4ba1-92c1-31bc5bec8ad9 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:11.697235 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c49dc81e-fbb7-4ba1-92c1-31bc5bec8ad9 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: c6bfb382-b9a8-4bf0-b868-ee5f51f9daac] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:11.730029 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c49dc81e-fbb7-4ba1-92c1-31bc5bec8ad9 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:11.730542 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c49dc81e-fbb7-4ba1-92c1-31bc5bec8ad9 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:11.740251 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a4dc7f84-ed24-4c9e-9b34-6b436f896260 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed06378eb9b446680b5a3156a14941d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511432a7dee4bec9d1093c9d95b3734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:11.742425 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c49dc81e-fbb7-4ba1-92c1-31bc5bec8ad9 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:11.746751 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c49dc81e-fbb7-4ba1-92c1-31bc5bec8ad9 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:11.747415 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c49dc81e-fbb7-4ba1-92c1-31bc5bec8ad9 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:11.748075 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c49dc81e-fbb7-4ba1-92c1-31bc5bec8ad9 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:11.756436 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a4dc7f84-ed24-4c9e-9b34-6b436f896260 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] 10.222.0.61 "GET /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2" status: 200 len: 1361 microversion: 2.1 time: 1.791089 Aug 31 16:13:11.781216 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1872/3743] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:09 2022] GET /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2 => generated 1361 bytes in 1816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:13:11.800233 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-357f756d-2d32-40f6-a23c-fff5c9a173ee tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:11.809409 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-357f756d-2d32-40f6-a23c-fff5c9a173ee tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] [instance: eed024b5-986b-40fa-a686-ceab563a6131] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:11.823799 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-357f756d-2d32-40f6-a23c-fff5c9a173ee tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:11.825094 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-357f756d-2d32-40f6-a23c-fff5c9a173ee tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:11.828489 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-357f756d-2d32-40f6-a23c-fff5c9a173ee tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:11.829925 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-357f756d-2d32-40f6-a23c-fff5c9a173ee tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:11.835188 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-357f756d-2d32-40f6-a23c-fff5c9a173ee tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:11.848511 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-357f756d-2d32-40f6-a23c-fff5c9a173ee tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:11.977868 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c49dc81e-fbb7-4ba1-92c1-31bc5bec8ad9 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48ee960c38f4d0584ea5ce34579279f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a957b6585e74a31b5bc5f66441c33e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:12.005039 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c49dc81e-fbb7-4ba1-92c1-31bc5bec8ad9 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "GET /compute/v2.1/servers/c6bfb382-b9a8-4bf0-b868-ee5f51f9daac" status: 200 len: 1271 microversion: 2.1 time: 0.310646 Aug 31 16:13:12.008854 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1872/3744] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:11 2022] GET /compute/v2.1/servers/c6bfb382-b9a8-4bf0-b868-ee5f51f9daac => generated 1271 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:12.009105 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-357f756d-2d32-40f6-a23c-fff5c9a173ee tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:12.009478 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-357f756d-2d32-40f6-a23c-fff5c9a173ee tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:12.009939 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-357f756d-2d32-40f6-a23c-fff5c9a173ee tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:12.010424 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-357f756d-2d32-40f6-a23c-fff5c9a173ee tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lazy-loading 'fault' on Instance uuid eed024b5-986b-40fa-a686-ceab563a6131 {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:13:12.023691 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1ec49d1b-ecfd-4cb1-9fd7-af6f45702f0e tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:12.024710 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1ec49d1b-ecfd-4cb1-9fd7-af6f45702f0e tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 3bf38c6a-3419-4b05-a06c-ccf8d89397f7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:12.033397 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1ec49d1b-ecfd-4cb1-9fd7-af6f45702f0e tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:12.034546 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1ec49d1b-ecfd-4cb1-9fd7-af6f45702f0e tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:12.035889 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1ec49d1b-ecfd-4cb1-9fd7-af6f45702f0e tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:12.049089 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1ec49d1b-ecfd-4cb1-9fd7-af6f45702f0e tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:12.050023 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1ec49d1b-ecfd-4cb1-9fd7-af6f45702f0e tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:12.051270 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1ec49d1b-ecfd-4cb1-9fd7-af6f45702f0e tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:12.083809 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-357f756d-2d32-40f6-a23c-fff5c9a173ee tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ab268a4d607497da5476256055bb07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14140e7303046f1ada446437826f742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:12.103316 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-357f756d-2d32-40f6-a23c-fff5c9a173ee tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] 10.222.0.61 "GET /compute/v2.1/servers/eed024b5-986b-40fa-a686-ceab563a6131" status: 200 len: 1330 microversion: 2.1 time: 0.320552 Aug 31 16:13:12.109090 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1873/3745] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:11 2022] GET /compute/v2.1/servers/eed024b5-986b-40fa-a686-ceab563a6131 => generated 1330 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:12.118468 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-d7180326-01b0-492f-af52-31e21349425f req-a50f7757-dcb1-4617-a5b2-047d29c51a41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eed024b5-986b-40fa-a686-ceab563a6131", "name": "network-vif-deleted", "tag": "512921c8-73a5-4a95-ab19-e9b589b7421e"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:13:12.168545 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-d7180326-01b0-492f-af52-31e21349425f req-a50f7757-dcb1-4617-a5b2-047d29c51a41 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:12.169764 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-d7180326-01b0-492f-af52-31e21349425f req-a50f7757-dcb1-4617-a5b2-047d29c51a41 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:12.171309 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-d7180326-01b0-492f-af52-31e21349425f req-a50f7757-dcb1-4617-a5b2-047d29c51a41 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:12.214225 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1ec49d1b-ecfd-4cb1-9fd7-af6f45702f0e tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:12.219117 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-d7180326-01b0-492f-af52-31e21349425f req-a50f7757-dcb1-4617-a5b2-047d29c51a41 service nova] Creating event network-vif-deleted:512921c8-73a5-4a95-ab19-e9b589b7421e for instance eed024b5-986b-40fa-a686-ceab563a6131 on n-h1-850499-9 Aug 31 16:13:12.247546 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1ec49d1b-ecfd-4cb1-9fd7-af6f45702f0e tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/3bf38c6a-3419-4b05-a06c-ccf8d89397f7" status: 200 len: 1267 microversion: 2.1 time: 0.235911 Aug 31 16:13:12.248427 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1873/3746] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:12 2022] GET /compute/v2.1/servers/3bf38c6a-3419-4b05-a06c-ccf8d89397f7 => generated 1267 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:12.250315 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-d7180326-01b0-492f-af52-31e21349425f req-a50f7757-dcb1-4617-a5b2-047d29c51a41 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137067 Aug 31 16:13:12.257739 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1874/3747] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:13:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:13:12.733614 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3510163c-eec2-4f3b-97a5-e92685a229b0 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:12.736502 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3510163c-eec2-4f3b-97a5-e92685a229b0 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] [instance: 73e59de1-a2a7-4fa3-b397-2c2c76ba1139] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:12.749309 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3510163c-eec2-4f3b-97a5-e92685a229b0 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:12.750549 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3510163c-eec2-4f3b-97a5-e92685a229b0 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:12.751671 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3510163c-eec2-4f3b-97a5-e92685a229b0 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:12.754547 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3510163c-eec2-4f3b-97a5-e92685a229b0 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:12.755992 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3510163c-eec2-4f3b-97a5-e92685a229b0 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:12.757095 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3510163c-eec2-4f3b-97a5-e92685a229b0 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:12.791620 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-71bcf559-a271-4b15-a393-b2679845c3ff tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:12.792344 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-71bcf559-a271-4b15-a393-b2679845c3ff tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] [instance: f04eb48d-000e-4c3b-8799-a4d3cdacf0e2] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:12.817560 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-71bcf559-a271-4b15-a393-b2679845c3ff tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:12.818986 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-71bcf559-a271-4b15-a393-b2679845c3ff tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:12.821567 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-71bcf559-a271-4b15-a393-b2679845c3ff tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:12.822612 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-71bcf559-a271-4b15-a393-b2679845c3ff tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:12.825096 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-71bcf559-a271-4b15-a393-b2679845c3ff tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:12.826596 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-71bcf559-a271-4b15-a393-b2679845c3ff tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:13.357543 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3510163c-eec2-4f3b-97a5-e92685a229b0 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f911026e35d40a480094376c6556d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f66705b4a0f4711ba14d9ceb5699bd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:13.387018 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3510163c-eec2-4f3b-97a5-e92685a229b0 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] 10.222.0.61 "GET /compute/v2.1/servers/73e59de1-a2a7-4fa3-b397-2c2c76ba1139" status: 200 len: 1315 microversion: 2.1 time: 0.660316 Aug 31 16:13:13.389405 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1874/3748] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:12 2022] GET /compute/v2.1/servers/73e59de1-a2a7-4fa3-b397-2c2c76ba1139 => generated 1315 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:13.401154 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-8fd43e36-3d2b-466e-bcda-04079f84f0a4 req-dd362f34-6fb5-4177-8439-1e22835945a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f04eb48d-000e-4c3b-8799-a4d3cdacf0e2", "name": "network-vif-plugged", "status": "completed", "tag": "e50b9368-8cb7-4eff-9832-0a103ac0abdc"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:13:13.426495 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-71bcf559-a271-4b15-a393-b2679845c3ff tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed06378eb9b446680b5a3156a14941d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511432a7dee4bec9d1093c9d95b3734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:13.428874 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-8fd43e36-3d2b-466e-bcda-04079f84f0a4 req-dd362f34-6fb5-4177-8439-1e22835945a1 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:13.429385 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-8fd43e36-3d2b-466e-bcda-04079f84f0a4 req-dd362f34-6fb5-4177-8439-1e22835945a1 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:13.429828 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-8fd43e36-3d2b-466e-bcda-04079f84f0a4 req-dd362f34-6fb5-4177-8439-1e22835945a1 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:13.460318 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-71bcf559-a271-4b15-a393-b2679845c3ff tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] 10.222.0.61 "GET /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2" status: 200 len: 1361 microversion: 2.1 time: 0.667594 Aug 31 16:13:13.463263 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1875/3749] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:12 2022] GET /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2 => generated 1361 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:13:13.467325 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-8fd43e36-3d2b-466e-bcda-04079f84f0a4 req-dd362f34-6fb5-4177-8439-1e22835945a1 service nova] Creating event network-vif-plugged:e50b9368-8cb7-4eff-9832-0a103ac0abdc for instance f04eb48d-000e-4c3b-8799-a4d3cdacf0e2 on n-h1-850499-9 Aug 31 16:13:13.485377 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7dd8e64d-fa7c-47c1-88b9-0214f8b486dc tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:13.488901 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7dd8e64d-fa7c-47c1-88b9-0214f8b486dc tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: c6bfb382-b9a8-4bf0-b868-ee5f51f9daac] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:13.489656 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-8fd43e36-3d2b-466e-bcda-04079f84f0a4 req-dd362f34-6fb5-4177-8439-1e22835945a1 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096931 Aug 31 16:13:13.498452 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1875/3750] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:13:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:13:13.509926 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7dd8e64d-fa7c-47c1-88b9-0214f8b486dc tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:13.510822 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7dd8e64d-fa7c-47c1-88b9-0214f8b486dc tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:13.511418 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7dd8e64d-fa7c-47c1-88b9-0214f8b486dc tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:13.512499 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7dd8e64d-fa7c-47c1-88b9-0214f8b486dc tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:13.513163 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7dd8e64d-fa7c-47c1-88b9-0214f8b486dc tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:13.515836 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-17080231-cb9d-4874-b42a-80da1078ef22 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:13.528000 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-17080231-cb9d-4874-b42a-80da1078ef22 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] [instance: eed024b5-986b-40fa-a686-ceab563a6131] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:13.537899 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7dd8e64d-fa7c-47c1-88b9-0214f8b486dc tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:13.585646 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-17080231-cb9d-4874-b42a-80da1078ef22 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:13.586542 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-17080231-cb9d-4874-b42a-80da1078ef22 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:13.587604 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-17080231-cb9d-4874-b42a-80da1078ef22 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:13.590150 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-17080231-cb9d-4874-b42a-80da1078ef22 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:13.591209 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-17080231-cb9d-4874-b42a-80da1078ef22 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:13.594572 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-17080231-cb9d-4874-b42a-80da1078ef22 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:13.641170 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-17080231-cb9d-4874-b42a-80da1078ef22 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] HTTP exception thrown: Instance eed024b5-986b-40fa-a686-ceab563a6131 could not be found. Aug 31 16:13:13.653355 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-17080231-cb9d-4874-b42a-80da1078ef22 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Request method failure captured: Aug 31 16:13:13.653355 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/eed024b5-986b-40fa-a686-ceab563a6131 HTTP/1.1 Aug 31 16:13:13.653355 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:13:13.653355 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:13:13.653355 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:13:13.653355 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:13:13.653355 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:13:13.653355 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:13:13.653355 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:13:13.653355 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:13:13.653355 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4e07VuyA09O3goN-IuYCEqeP0JaUjboqNsaZvnCv9kTcOWmdcYfwKnbotfAUEzeaWoisY7RuMfLOVNGjZfBajDQsdEDiTwL3z2DjYPFTffExpbvnn_edvMhKwMUZy5nl_LaysR04Sxr8LZ85ymrsn6-sE2ciT567voJYfjVFUmPw8Y Aug 31 16:13:13.653355 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:13:13.653355 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:13:13.653355 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:13:13.653355 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:13:13.653355 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:13:13.653355 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:13:13.653355 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: e14140e7303046f1ada446437826f742 Aug 31 16:13:13.653355 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-VolumesAdminNegativeTest-1855178427 Aug 31 16:13:13.653355 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:13:13.653355 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:13:13.653355 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e14140e7303046f1ada446437826f742"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/e14140e7303046f1ada446437826f742"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_e14140e7303046f1ada446437826f742", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e14140e7303046f1ada446437826f742"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:13:13.653355 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-VolumesAdminNegativeTest-1855178427 Aug 31 16:13:13.653355 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: e14140e7303046f1ada446437826f742 Aug 31 16:13:13.653355 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1855178427 Aug 31 16:13:13.653355 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-VolumesAdminNegativeTest-1855178427-project Aug 31 16:13:13.653355 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:13:13.653355 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:13:13.653355 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 6ab268a4d607497da5476256055bb07c Aug 31 16:13:13.653355 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-VolumesAdminNegativeTest-1855178427-project Aug 31 16:13:13.653355 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:13:13.653355 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance eed024b5-986b-40fa-a686-ceab563a6131 could not be found. Aug 31 16:13:13.653355 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': 'eed024b5-986b-40fa-a686-ceab563a6131'} Aug 31 16:13:13.653355 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:13:13.653355 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:13.653355 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:13:13.653355 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:13:13.653355 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:13:13.653355 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:13:13.653355 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:13:13.653355 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:13:13.653355 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:13:13.653355 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:13:13.653355 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eed024b5-986b-40fa-a686-ceab563a6131 could not be found. Aug 31 16:13:13.653355 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:13:13.653355 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:13:13.653355 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:13:13.653355 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:13.653355 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:13:13.653355 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:13:13.653355 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:13:13.653355 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:13:13.653355 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:13:13.653355 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:13:13.653355 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:13:13.653355 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:13:13.653355 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:13:13.653355 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:13:13.653355 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:13:13.653355 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:13:13.653355 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eed024b5-986b-40fa-a686-ceab563a6131 could not be found. Aug 31 16:13:13.653355 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:13:13.653355 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:13:13.653355 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:13:13.657750 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:13.657750 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:13:13.657750 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:13:13.657750 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:13:13.657750 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:13:13.657750 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eed024b5-986b-40fa-a686-ceab563a6131 could not be found. Aug 31 16:13:13.657750 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:13:13.659793 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-17080231-cb9d-4874-b42a-80da1078ef22 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Returning 404 to user: Instance eed024b5-986b-40fa-a686-ceab563a6131 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:13:13.661230 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-17080231-cb9d-4874-b42a-80da1078ef22 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] 10.222.0.61 "GET /compute/v2.1/servers/eed024b5-986b-40fa-a686-ceab563a6131" status: 404 len: 111 microversion: 2.1 time: 0.159308 Aug 31 16:13:13.663311 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1876/3751] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:13 2022] GET /compute/v2.1/servers/eed024b5-986b-40fa-a686-ceab563a6131 => generated 111 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:13:13.673277 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-125a3e86-8cba-4ffb-a1b3-4dd83a77f1a9 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:13.674413 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-125a3e86-8cba-4ffb-a1b3-4dd83a77f1a9 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 3bf38c6a-3419-4b05-a06c-ccf8d89397f7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:13.681665 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-125a3e86-8cba-4ffb-a1b3-4dd83a77f1a9 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:13.682379 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-125a3e86-8cba-4ffb-a1b3-4dd83a77f1a9 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:13.683082 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-125a3e86-8cba-4ffb-a1b3-4dd83a77f1a9 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:13.683843 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-125a3e86-8cba-4ffb-a1b3-4dd83a77f1a9 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:13.684311 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-125a3e86-8cba-4ffb-a1b3-4dd83a77f1a9 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:13.684746 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-125a3e86-8cba-4ffb-a1b3-4dd83a77f1a9 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:13.855474 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7dd8e64d-fa7c-47c1-88b9-0214f8b486dc tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48ee960c38f4d0584ea5ce34579279f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a957b6585e74a31b5bc5f66441c33e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:13.857347 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-125a3e86-8cba-4ffb-a1b3-4dd83a77f1a9 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:13.868439 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7dd8e64d-fa7c-47c1-88b9-0214f8b486dc tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "GET /compute/v2.1/servers/c6bfb382-b9a8-4bf0-b868-ee5f51f9daac" status: 200 len: 1271 microversion: 2.1 time: 0.397558 Aug 31 16:13:13.869425 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1876/3752] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:13 2022] GET /compute/v2.1/servers/c6bfb382-b9a8-4bf0-b868-ee5f51f9daac => generated 1271 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:13.870378 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-125a3e86-8cba-4ffb-a1b3-4dd83a77f1a9 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/3bf38c6a-3419-4b05-a06c-ccf8d89397f7" status: 200 len: 1267 microversion: 2.1 time: 0.204038 Aug 31 16:13:13.878005 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1877/3753] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:13 2022] GET /compute/v2.1/servers/3bf38c6a-3419-4b05-a06c-ccf8d89397f7 => generated 1267 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:13.888908 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-59f477fe-96e5-4cc3-8ea3-7c52f10986a3 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] Calling method '.version_select at 0x7f5ae84750d0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:13.961861 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-59f477fe-96e5-4cc3-8ea3-7c52f10986a3 tempest-VolumesAdminNegativeTest-1855178427 tempest-VolumesAdminNegativeTest-1855178427-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-266537551" status: 202 len: 0 microversion: 2.1 time: 0.090835 Aug 31 16:13:13.965834 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1877/3754] 10.222.0.61 () {58 vars in 1218 bytes} [Wed Aug 31 16:13:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-266537551 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:13:14.427148 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-569a0baf-2f30-4116-a9d7-8563ffdbc6c8 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:14.433568 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-569a0baf-2f30-4116-a9d7-8563ffdbc6c8 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] [instance: 73e59de1-a2a7-4fa3-b397-2c2c76ba1139] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:14.465959 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-569a0baf-2f30-4116-a9d7-8563ffdbc6c8 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:14.470333 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-569a0baf-2f30-4116-a9d7-8563ffdbc6c8 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:14.471451 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-569a0baf-2f30-4116-a9d7-8563ffdbc6c8 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:14.473627 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-569a0baf-2f30-4116-a9d7-8563ffdbc6c8 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:14.474758 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-569a0baf-2f30-4116-a9d7-8563ffdbc6c8 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:14.475826 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-569a0baf-2f30-4116-a9d7-8563ffdbc6c8 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:14.487621 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b7e6d31a-bbaa-482b-88b6-893fe49e7253 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:14.489529 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b7e6d31a-bbaa-482b-88b6-893fe49e7253 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] [instance: f04eb48d-000e-4c3b-8799-a4d3cdacf0e2] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:14.500932 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b7e6d31a-bbaa-482b-88b6-893fe49e7253 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:14.502958 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b7e6d31a-bbaa-482b-88b6-893fe49e7253 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:14.503798 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b7e6d31a-bbaa-482b-88b6-893fe49e7253 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:14.510199 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b7e6d31a-bbaa-482b-88b6-893fe49e7253 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:14.510859 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b7e6d31a-bbaa-482b-88b6-893fe49e7253 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:14.511422 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b7e6d31a-bbaa-482b-88b6-893fe49e7253 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:15.179702 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-569a0baf-2f30-4116-a9d7-8563ffdbc6c8 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f911026e35d40a480094376c6556d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f66705b4a0f4711ba14d9ceb5699bd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:15.188342 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-569a0baf-2f30-4116-a9d7-8563ffdbc6c8 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] 10.222.0.61 "GET /compute/v2.1/servers/73e59de1-a2a7-4fa3-b397-2c2c76ba1139" status: 200 len: 1502 microversion: 2.1 time: 0.773361 Aug 31 16:13:15.203964 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1878/3755] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:14 2022] GET /compute/v2.1/servers/73e59de1-a2a7-4fa3-b397-2c2c76ba1139 => generated 1502 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:15.212464 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9f1ec3b2-b46f-401b-bfb2-cc0e50999109 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:15.213104 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9f1ec3b2-b46f-401b-bfb2-cc0e50999109 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: c6bfb382-b9a8-4bf0-b868-ee5f51f9daac] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:15.228208 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9f1ec3b2-b46f-401b-bfb2-cc0e50999109 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:15.228981 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9f1ec3b2-b46f-401b-bfb2-cc0e50999109 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:15.229910 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9f1ec3b2-b46f-401b-bfb2-cc0e50999109 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:15.230816 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9f1ec3b2-b46f-401b-bfb2-cc0e50999109 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:15.231458 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9f1ec3b2-b46f-401b-bfb2-cc0e50999109 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:15.232095 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9f1ec3b2-b46f-401b-bfb2-cc0e50999109 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:15.343063 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b7e6d31a-bbaa-482b-88b6-893fe49e7253 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed06378eb9b446680b5a3156a14941d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511432a7dee4bec9d1093c9d95b3734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:15.357689 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=100 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:13:15.373730 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b7e6d31a-bbaa-482b-88b6-893fe49e7253 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] 10.222.0.61 "GET /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2" status: 200 len: 1361 microversion: 2.1 time: 0.890447 Aug 31 16:13:15.376314 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1878/3756] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:14 2022] GET /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2 => generated 1361 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:15.401808 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-99ffbbfa-0e26-4d5e-9e84-df93f60da206 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:15.403026 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-99ffbbfa-0e26-4d5e-9e84-df93f60da206 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 3bf38c6a-3419-4b05-a06c-ccf8d89397f7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:15.426585 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-99ffbbfa-0e26-4d5e-9e84-df93f60da206 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:15.427245 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-99ffbbfa-0e26-4d5e-9e84-df93f60da206 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:15.428235 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-99ffbbfa-0e26-4d5e-9e84-df93f60da206 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:15.430022 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-99ffbbfa-0e26-4d5e-9e84-df93f60da206 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:15.431060 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-99ffbbfa-0e26-4d5e-9e84-df93f60da206 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:15.431799 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-99ffbbfa-0e26-4d5e-9e84-df93f60da206 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:16.134163 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-9f1ec3b2-b46f-401b-bfb2-cc0e50999109 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48ee960c38f4d0584ea5ce34579279f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a957b6585e74a31b5bc5f66441c33e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:16.152598 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9f1ec3b2-b46f-401b-bfb2-cc0e50999109 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "GET /compute/v2.1/servers/c6bfb382-b9a8-4bf0-b868-ee5f51f9daac" status: 200 len: 1313 microversion: 2.1 time: 0.947374 Aug 31 16:13:16.153773 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1879/3757] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:15 2022] GET /compute/v2.1/servers/c6bfb382-b9a8-4bf0-b868-ee5f51f9daac => generated 1313 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:16.168150 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8d31af8d-f86b-4f1e-b571-c9468aa22761 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1927511947"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:13:16.169293 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8d31af8d-f86b-4f1e-b571-c9468aa22761 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] [instance: 73e59de1-a2a7-4fa3-b397-2c2c76ba1139] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:16.185716 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8d31af8d-f86b-4f1e-b571-c9468aa22761 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:16.186489 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8d31af8d-f86b-4f1e-b571-c9468aa22761 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:16.187362 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8d31af8d-f86b-4f1e-b571-c9468aa22761 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:16.187874 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8d31af8d-f86b-4f1e-b571-c9468aa22761 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:16.188412 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8d31af8d-f86b-4f1e-b571-c9468aa22761 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:16.189019 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8d31af8d-f86b-4f1e-b571-c9468aa22761 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:16.247996 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-99ffbbfa-0e26-4d5e-9e84-df93f60da206 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:16.260503 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-99ffbbfa-0e26-4d5e-9e84-df93f60da206 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/3bf38c6a-3419-4b05-a06c-ccf8d89397f7" status: 200 len: 1309 microversion: 2.1 time: 0.882637 Aug 31 16:13:16.261112 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1879/3758] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:15 2022] GET /compute/v2.1/servers/3bf38c6a-3419-4b05-a06c-ccf8d89397f7 => generated 1309 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:16.404055 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2e944fc7-c716-40b1-8694-3780af594dde tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:16.405440 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2e944fc7-c716-40b1-8694-3780af594dde tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] [instance: f04eb48d-000e-4c3b-8799-a4d3cdacf0e2] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:16.414031 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2e944fc7-c716-40b1-8694-3780af594dde tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:16.414840 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2e944fc7-c716-40b1-8694-3780af594dde tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:16.415525 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2e944fc7-c716-40b1-8694-3780af594dde tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:16.416419 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2e944fc7-c716-40b1-8694-3780af594dde tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:16.417055 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2e944fc7-c716-40b1-8694-3780af594dde tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:16.417689 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2e944fc7-c716-40b1-8694-3780af594dde tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:16.597143 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:13:16.648707 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=6 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:13:16.824362 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.network.security_group_api [None req-8d31af8d-f86b-4f1e-b571-c9468aa22761 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Adding security group 04319d74-a60e-4e6f-af5f-d260e6e5b69d to port ecd8bce9-b4ed-48ce-8f0c-42438836ce20 Aug 31 16:13:16.905566 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:13:17.197453 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2e944fc7-c716-40b1-8694-3780af594dde tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed06378eb9b446680b5a3156a14941d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511432a7dee4bec9d1093c9d95b3734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:17.217117 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2e944fc7-c716-40b1-8694-3780af594dde tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] 10.222.0.61 "GET /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2" status: 200 len: 1547 microversion: 2.1 time: 0.817408 Aug 31 16:13:17.238714 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1880/3759] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:16 2022] GET /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2 => generated 1547 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:13:17.250240 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-956663c5-2344-4ce3-b592-3e0bb61e83c9 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:17.259992 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-956663c5-2344-4ce3-b592-3e0bb61e83c9 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] [instance: fa0932e8-1aa4-4d1a-b653-14be35568f3d] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:17.271412 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-956663c5-2344-4ce3-b592-3e0bb61e83c9 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:17.272617 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-956663c5-2344-4ce3-b592-3e0bb61e83c9 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:17.272617 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-956663c5-2344-4ce3-b592-3e0bb61e83c9 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:17.279689 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-956663c5-2344-4ce3-b592-3e0bb61e83c9 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:17.279689 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-956663c5-2344-4ce3-b592-3e0bb61e83c9 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:17.279689 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-956663c5-2344-4ce3-b592-3e0bb61e83c9 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:18.340319 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=8 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:13:18.419943 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-956663c5-2344-4ce3-b592-3e0bb61e83c9 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:18.433367 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-956663c5-2344-4ce3-b592-3e0bb61e83c9 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:18.436311 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-956663c5-2344-4ce3-b592-3e0bb61e83c9 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:18.437933 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-956663c5-2344-4ce3-b592-3e0bb61e83c9 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] 10.222.0.61 "GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d" status: 200 len: 2951 microversion: 2.32 time: 1.198028 Aug 31 16:13:18.438783 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1881/3760] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:13:17 2022] GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d => generated 2951 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:13:18.445560 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-fa4b864c-6897-4616-ae38-3644dc1d7ed7 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:18.446846 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-fa4b864c-6897-4616-ae38-3644dc1d7ed7 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: c6bfb382-b9a8-4bf0-b868-ee5f51f9daac] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:18.470655 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fa4b864c-6897-4616-ae38-3644dc1d7ed7 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:18.471580 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fa4b864c-6897-4616-ae38-3644dc1d7ed7 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:18.474943 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fa4b864c-6897-4616-ae38-3644dc1d7ed7 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:18.476032 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fa4b864c-6897-4616-ae38-3644dc1d7ed7 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:18.476558 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fa4b864c-6897-4616-ae38-3644dc1d7ed7 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:18.476997 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fa4b864c-6897-4616-ae38-3644dc1d7ed7 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:18.865606 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8d31af8d-f86b-4f1e-b571-c9468aa22761 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] 10.222.0.61 "POST /compute/v2.1/servers/73e59de1-a2a7-4fa3-b397-2c2c76ba1139/action" status: 202 len: 0 microversion: 2.1 time: 2.710072 Aug 31 16:13:18.873125 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1880/3761] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:13:16 2022] POST /compute/v2.1/servers/73e59de1-a2a7-4fa3-b397-2c2c76ba1139/action => generated 0 bytes in 2718 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:13:18.901437 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5d64b062-fd90-48bd-89da-6c16e79bf9d3 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:18.912791 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5d64b062-fd90-48bd-89da-6c16e79bf9d3 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] [instance: f04eb48d-000e-4c3b-8799-a4d3cdacf0e2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:18.935875 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5d64b062-fd90-48bd-89da-6c16e79bf9d3 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:18.938721 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5d64b062-fd90-48bd-89da-6c16e79bf9d3 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:18.939821 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5d64b062-fd90-48bd-89da-6c16e79bf9d3 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:18.943947 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5d64b062-fd90-48bd-89da-6c16e79bf9d3 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:18.945235 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5d64b062-fd90-48bd-89da-6c16e79bf9d3 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:18.945817 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5d64b062-fd90-48bd-89da-6c16e79bf9d3 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:19.036040 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-fa4b864c-6897-4616-ae38-3644dc1d7ed7 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48ee960c38f4d0584ea5ce34579279f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a957b6585e74a31b5bc5f66441c33e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:19.051989 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-fa4b864c-6897-4616-ae38-3644dc1d7ed7 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "GET /compute/v2.1/servers/c6bfb382-b9a8-4bf0-b868-ee5f51f9daac" status: 200 len: 1313 microversion: 2.1 time: 0.611267 Aug 31 16:13:19.053862 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1882/3762] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:18 2022] GET /compute/v2.1/servers/c6bfb382-b9a8-4bf0-b868-ee5f51f9daac => generated 1313 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:19.067270 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-3bbc1934-61c3-42f0-9702-08e9a1819d49 req-3ca61a4c-ede8-41bd-b199-d20d8495e4c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bf38c6a-3419-4b05-a06c-ccf8d89397f7", "tag": "9c66d108-ad5b-45b6-b9a6-40b1e08b67f5"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:13:19.089609 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-3bbc1934-61c3-42f0-9702-08e9a1819d49 req-3ca61a4c-ede8-41bd-b199-d20d8495e4c8 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:19.090608 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-3bbc1934-61c3-42f0-9702-08e9a1819d49 req-3ca61a4c-ede8-41bd-b199-d20d8495e4c8 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:19.091357 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-3bbc1934-61c3-42f0-9702-08e9a1819d49 req-3ca61a4c-ede8-41bd-b199-d20d8495e4c8 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:19.115011 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-3bbc1934-61c3-42f0-9702-08e9a1819d49 req-3ca61a4c-ede8-41bd-b199-d20d8495e4c8 service nova] Creating event network-changed:9c66d108-ad5b-45b6-b9a6-40b1e08b67f5 for instance 3bf38c6a-3419-4b05-a06c-ccf8d89397f7 on n-h1-850499-9 Aug 31 16:13:19.124719 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-3bbc1934-61c3-42f0-9702-08e9a1819d49 req-3ca61a4c-ede8-41bd-b199-d20d8495e4c8 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067533 Aug 31 16:13:19.127038 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1883/3763] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:13:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:13:19.139741 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f04b6f5c-f3ff-4373-8834-e0c1120807de tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:19.141822 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f04b6f5c-f3ff-4373-8834-e0c1120807de tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 3bf38c6a-3419-4b05-a06c-ccf8d89397f7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:19.158270 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f04b6f5c-f3ff-4373-8834-e0c1120807de tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:19.159088 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f04b6f5c-f3ff-4373-8834-e0c1120807de tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:19.159088 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f04b6f5c-f3ff-4373-8834-e0c1120807de tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:19.159710 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f04b6f5c-f3ff-4373-8834-e0c1120807de tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:19.160182 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f04b6f5c-f3ff-4373-8834-e0c1120807de tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:19.160694 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f04b6f5c-f3ff-4373-8834-e0c1120807de tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:19.313939 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5d64b062-fd90-48bd-89da-6c16e79bf9d3 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] 10.222.0.61 "GET /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.437383 Aug 31 16:13:19.314752 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1881/3764] 10.222.0.61 () {58 vars in 1275 bytes} [Wed Aug 31 16:13:18 2022] GET /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2/os-interface => generated 284 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:13:19.324145 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9776ad47-c05a-4d6c-8e7a-a27a1ea6361d tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:19.324926 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9776ad47-c05a-4d6c-8e7a-a27a1ea6361d tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] [instance: fa0932e8-1aa4-4d1a-b653-14be35568f3d] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:19.333547 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9776ad47-c05a-4d6c-8e7a-a27a1ea6361d tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:19.334346 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9776ad47-c05a-4d6c-8e7a-a27a1ea6361d tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:19.335104 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9776ad47-c05a-4d6c-8e7a-a27a1ea6361d tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:19.336119 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9776ad47-c05a-4d6c-8e7a-a27a1ea6361d tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:19.336926 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9776ad47-c05a-4d6c-8e7a-a27a1ea6361d tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:19.337569 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9776ad47-c05a-4d6c-8e7a-a27a1ea6361d tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:19.612242 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9776ad47-c05a-4d6c-8e7a-a27a1ea6361d tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] 10.222.0.61 "GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d/os-interface" status: 200 len: 1832 microversion: 2.32 time: 0.294720 Aug 31 16:13:19.624619 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1882/3765] 10.222.0.61 () {60 vars in 1316 bytes} [Wed Aug 31 16:13:19 2022] GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d/os-interface => generated 1832 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:13:19.631189 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e27708a9-e2b2-472b-b035-3b17ac249127 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-717455075"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:13:19.632060 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e27708a9-e2b2-472b-b035-3b17ac249127 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] [instance: 73e59de1-a2a7-4fa3-b397-2c2c76ba1139] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:19.639903 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e27708a9-e2b2-472b-b035-3b17ac249127 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:19.640704 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e27708a9-e2b2-472b-b035-3b17ac249127 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:19.641326 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e27708a9-e2b2-472b-b035-3b17ac249127 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:19.642312 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e27708a9-e2b2-472b-b035-3b17ac249127 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:19.642929 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e27708a9-e2b2-472b-b035-3b17ac249127 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:19.644006 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e27708a9-e2b2-472b-b035-3b17ac249127 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:19.693191 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f04b6f5c-f3ff-4373-8834-e0c1120807de tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:19.703130 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f04b6f5c-f3ff-4373-8834-e0c1120807de tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/3bf38c6a-3419-4b05-a06c-ccf8d89397f7" status: 200 len: 1309 microversion: 2.1 time: 0.574374 Aug 31 16:13:19.712787 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1884/3766] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:19 2022] GET /compute/v2.1/servers/3bf38c6a-3419-4b05-a06c-ccf8d89397f7 => generated 1309 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:19.723001 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-bc8ce633-95a4-41b8-a9a5-4cdd567aa1e4 req-81a4dd18-0250-4b91-a424-a2f21bdcb1ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73e59de1-a2a7-4fa3-b397-2c2c76ba1139", "tag": "ecd8bce9-b4ed-48ce-8f0c-42438836ce20"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:13:19.732925 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-bc8ce633-95a4-41b8-a9a5-4cdd567aa1e4 req-81a4dd18-0250-4b91-a424-a2f21bdcb1ed service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:19.733701 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-bc8ce633-95a4-41b8-a9a5-4cdd567aa1e4 req-81a4dd18-0250-4b91-a424-a2f21bdcb1ed service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:19.734292 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-bc8ce633-95a4-41b8-a9a5-4cdd567aa1e4 req-81a4dd18-0250-4b91-a424-a2f21bdcb1ed service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:19.747111 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-bc8ce633-95a4-41b8-a9a5-4cdd567aa1e4 req-81a4dd18-0250-4b91-a424-a2f21bdcb1ed service nova] Creating event network-changed:ecd8bce9-b4ed-48ce-8f0c-42438836ce20 for instance 73e59de1-a2a7-4fa3-b397-2c2c76ba1139 on n-h2-850499-9 Aug 31 16:13:19.755715 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-bc8ce633-95a4-41b8-a9a5-4cdd567aa1e4 req-81a4dd18-0250-4b91-a424-a2f21bdcb1ed service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039441 Aug 31 16:13:19.757414 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1885/3767] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:13:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:13:19.833109 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-53d6cf1c-3fab-4433-9f71-5ea13be5c21b tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-946183778", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "networks": [{"uuid": "0c944d67-1198-4bb1-8390-4c914230b452"}]}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:13:19.912242 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-53d6cf1c-3fab-4433-9f71-5ea13be5c21b tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] validate_networks() for [('0c944d67-1198-4bb1-8390-4c914230b452', None, None, None, None, None)] {{(pid=122257) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:13:20.244196 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.network.security_group_api [None req-e27708a9-e2b2-472b-b035-3b17ac249127 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Adding security group 9fe326bd-2dae-4d04-a40b-035d70314400 to port ecd8bce9-b4ed-48ce-8f0c-42438836ce20 Aug 31 16:13:22.923225 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-53d6cf1c-3fab-4433-9f71-5ea13be5c21b tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:13:22.924026 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-53d6cf1c-3fab-4433-9f71-5ea13be5c21b tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:13:22.925232 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-53d6cf1c-3fab-4433-9f71-5ea13be5c21b tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:13:22.925973 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-53d6cf1c-3fab-4433-9f71-5ea13be5c21b tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:13:22.926940 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-53d6cf1c-3fab-4433-9f71-5ea13be5c21b tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:13:22.945788 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-53d6cf1c-3fab-4433-9f71-5ea13be5c21b tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:22.947095 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-53d6cf1c-3fab-4433-9f71-5ea13be5c21b tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:22.949065 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-53d6cf1c-3fab-4433-9f71-5ea13be5c21b tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:22.950428 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-53d6cf1c-3fab-4433-9f71-5ea13be5c21b tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:22.951263 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-53d6cf1c-3fab-4433-9f71-5ea13be5c21b tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:22.952054 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-53d6cf1c-3fab-4433-9f71-5ea13be5c21b tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:22.990740 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-53d6cf1c-3fab-4433-9f71-5ea13be5c21b tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Getting quotas for project db0b14e6533a4396b15f9c08657d924f. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:13:23.000085 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-53d6cf1c-3fab-4433-9f71-5ea13be5c21b tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Getting quotas for user 3ce4e5c281c4432782d96b94323cdcc9 and project db0b14e6533a4396b15f9c08657d924f. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:13:23.019756 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-53d6cf1c-3fab-4433-9f71-5ea13be5c21b tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Going to run 1 instances... {{(pid=122257) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:13:23.023011 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-53d6cf1c-3fab-4433-9f71-5ea13be5c21b tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] [instance: b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:13:23.075480 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e27708a9-e2b2-472b-b035-3b17ac249127 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] 10.222.0.61 "POST /compute/v2.1/servers/73e59de1-a2a7-4fa3-b397-2c2c76ba1139/action" status: 202 len: 0 microversion: 2.1 time: 3.448669 Aug 31 16:13:23.085008 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1883/3768] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:13:19 2022] POST /compute/v2.1/servers/73e59de1-a2a7-4fa3-b397-2c2c76ba1139/action => generated 0 bytes in 3459 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:13:23.095383 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-35e530d0-522a-4c79-bcbb-b8a3f1bdc135 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:23.096735 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-35e530d0-522a-4c79-bcbb-b8a3f1bdc135 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: c6bfb382-b9a8-4bf0-b868-ee5f51f9daac] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:23.108573 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-53d6cf1c-3fab-4433-9f71-5ea13be5c21b tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.349129 Aug 31 16:13:23.109244 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1886/3769] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:13:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 3351 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:13:23.114350 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-06c15505-2e32-4c80-ae91-71bfaaefcefd tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:23.116255 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-06c15505-2e32-4c80-ae91-71bfaaefcefd tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 3bf38c6a-3419-4b05-a06c-ccf8d89397f7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:23.122661 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-35e530d0-522a-4c79-bcbb-b8a3f1bdc135 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:23.123574 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-35e530d0-522a-4c79-bcbb-b8a3f1bdc135 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:23.124186 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-35e530d0-522a-4c79-bcbb-b8a3f1bdc135 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:23.125298 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-35e530d0-522a-4c79-bcbb-b8a3f1bdc135 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:23.126135 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-35e530d0-522a-4c79-bcbb-b8a3f1bdc135 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:23.126825 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-35e530d0-522a-4c79-bcbb-b8a3f1bdc135 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:23.132098 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-06c15505-2e32-4c80-ae91-71bfaaefcefd tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:23.133976 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-06c15505-2e32-4c80-ae91-71bfaaefcefd tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:23.134664 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-06c15505-2e32-4c80-ae91-71bfaaefcefd tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:23.136879 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-06c15505-2e32-4c80-ae91-71bfaaefcefd tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:23.137591 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-06c15505-2e32-4c80-ae91-71bfaaefcefd tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:23.138336 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-06c15505-2e32-4c80-ae91-71bfaaefcefd tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:23.143045 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:13:23.724516 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-06c15505-2e32-4c80-ae91-71bfaaefcefd tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:23.736146 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-06c15505-2e32-4c80-ae91-71bfaaefcefd tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/3bf38c6a-3419-4b05-a06c-ccf8d89397f7" status: 200 len: 1309 microversion: 2.1 time: 0.625479 Aug 31 16:13:23.737254 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-35e530d0-522a-4c79-bcbb-b8a3f1bdc135 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48ee960c38f4d0584ea5ce34579279f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a957b6585e74a31b5bc5f66441c33e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:23.751545 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1887/3770] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:23 2022] GET /compute/v2.1/servers/3bf38c6a-3419-4b05-a06c-ccf8d89397f7 => generated 1309 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:23.751545 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-01ac828e-4c25-41fc-b3a5-64dafecac0c4 req-27407606-5448-4bb3-b61f-a3af6ae99338 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6bfb382-b9a8-4bf0-b868-ee5f51f9daac", "tag": "36afac70-65f8-4bf7-b126-7e6e5c89bdd6"}, {"name": "network-changed", "server_uuid": "f04eb48d-000e-4c3b-8799-a4d3cdacf0e2", "tag": "e50b9368-8cb7-4eff-9832-0a103ac0abdc"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:13:23.772641 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-35e530d0-522a-4c79-bcbb-b8a3f1bdc135 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "GET /compute/v2.1/servers/c6bfb382-b9a8-4bf0-b868-ee5f51f9daac" status: 200 len: 1313 microversion: 2.1 time: 0.685081 Aug 31 16:13:23.773254 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1884/3771] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:23 2022] GET /compute/v2.1/servers/c6bfb382-b9a8-4bf0-b868-ee5f51f9daac => generated 1313 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:23.779515 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9a6f591e-6f77-4ebb-ab0c-f72c03c42483 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:23.786741 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9a6f591e-6f77-4ebb-ab0c-f72c03c42483 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] [instance: 73e59de1-a2a7-4fa3-b397-2c2c76ba1139] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:23.790316 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-01ac828e-4c25-41fc-b3a5-64dafecac0c4 req-27407606-5448-4bb3-b61f-a3af6ae99338 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:23.791305 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-01ac828e-4c25-41fc-b3a5-64dafecac0c4 req-27407606-5448-4bb3-b61f-a3af6ae99338 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:23.792271 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-01ac828e-4c25-41fc-b3a5-64dafecac0c4 req-27407606-5448-4bb3-b61f-a3af6ae99338 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:23.820648 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9a6f591e-6f77-4ebb-ab0c-f72c03c42483 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:23.821273 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9a6f591e-6f77-4ebb-ab0c-f72c03c42483 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:23.821737 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9a6f591e-6f77-4ebb-ab0c-f72c03c42483 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:23.822486 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9a6f591e-6f77-4ebb-ab0c-f72c03c42483 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:23.822959 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9a6f591e-6f77-4ebb-ab0c-f72c03c42483 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:23.840793 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9a6f591e-6f77-4ebb-ab0c-f72c03c42483 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:23.848066 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-01ac828e-4c25-41fc-b3a5-64dafecac0c4 req-27407606-5448-4bb3-b61f-a3af6ae99338 service nova] Creating event network-changed:36afac70-65f8-4bf7-b126-7e6e5c89bdd6 for instance c6bfb382-b9a8-4bf0-b868-ee5f51f9daac on n-h1-850499-9 Aug 31 16:13:23.850082 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-01ac828e-4c25-41fc-b3a5-64dafecac0c4 req-27407606-5448-4bb3-b61f-a3af6ae99338 service nova] Creating event network-changed:e50b9368-8cb7-4eff-9832-0a103ac0abdc for instance f04eb48d-000e-4c3b-8799-a4d3cdacf0e2 on n-h1-850499-9 Aug 31 16:13:23.876926 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-01ac828e-4c25-41fc-b3a5-64dafecac0c4 req-27407606-5448-4bb3-b61f-a3af6ae99338 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.134333 Aug 31 16:13:23.882086 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1888/3772] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:13:23 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:13:23.899886 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5f70c921-5c4b-4ba6-a64d-70c838d986a0 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:23.905016 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5f70c921-5c4b-4ba6-a64d-70c838d986a0 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] [instance: b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:24.143742 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5f70c921-5c4b-4ba6-a64d-70c838d986a0 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce4e5c281c4432782d96b94323cdcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0b14e6533a4396b15f9c08657d924f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:24.152360 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5f70c921-5c4b-4ba6-a64d-70c838d986a0 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] 10.222.0.61 "GET /compute/v2.1/servers/b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd" status: 200 len: 1216 microversion: 2.1 time: 0.267693 Aug 31 16:13:24.153112 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1889/3773] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:23 2022] GET /compute/v2.1/servers/b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd => generated 1216 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:24.167761 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-1b69b88c-9cac-4b64-ae77-41a7cf0766e4 req-274a5e50-1159-46fe-9957-98a77a4ae21e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73e59de1-a2a7-4fa3-b397-2c2c76ba1139", "tag": "ecd8bce9-b4ed-48ce-8f0c-42438836ce20"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:13:24.173559 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-1b69b88c-9cac-4b64-ae77-41a7cf0766e4 req-274a5e50-1159-46fe-9957-98a77a4ae21e service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:24.174220 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-1b69b88c-9cac-4b64-ae77-41a7cf0766e4 req-274a5e50-1159-46fe-9957-98a77a4ae21e service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:24.174777 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-1b69b88c-9cac-4b64-ae77-41a7cf0766e4 req-274a5e50-1159-46fe-9957-98a77a4ae21e service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:24.208146 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-1b69b88c-9cac-4b64-ae77-41a7cf0766e4 req-274a5e50-1159-46fe-9957-98a77a4ae21e service nova] Creating event network-changed:ecd8bce9-b4ed-48ce-8f0c-42438836ce20 for instance 73e59de1-a2a7-4fa3-b397-2c2c76ba1139 on n-h2-850499-9 Aug 31 16:13:24.224453 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-1b69b88c-9cac-4b64-ae77-41a7cf0766e4 req-274a5e50-1159-46fe-9957-98a77a4ae21e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069855 Aug 31 16:13:24.225754 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1890/3774] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:13:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:13:24.451345 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9a6f591e-6f77-4ebb-ab0c-f72c03c42483 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] 10.222.0.61 "GET /compute/v2.1/servers/73e59de1-a2a7-4fa3-b397-2c2c76ba1139/os-security-groups" status: 200 len: 1156 microversion: 2.1 time: 0.676668 Aug 31 16:13:24.454088 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1885/3775] 10.222.0.61 () {58 vars in 1293 bytes} [Wed Aug 31 16:13:23 2022] GET /compute/v2.1/servers/73e59de1-a2a7-4fa3-b397-2c2c76ba1139/os-security-groups => generated 1156 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:24.471694 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a227db45-2c15-40c8-98d0-31431a7c14ae tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Action: 'create', calling method: .version_select at 0x7f5ae84cd280>, body: {"security_group": {"name": " tempest-securitygroup -1939586069 ", "description": "tempest-description-1949262511"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:13:24.772527 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-058861f1-22f0-4d4e-acdb-ed585f918f6a tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:24.773158 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-058861f1-22f0-4d4e-acdb-ed585f918f6a tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 3bf38c6a-3419-4b05-a06c-ccf8d89397f7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:24.788930 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-058861f1-22f0-4d4e-acdb-ed585f918f6a tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:24.789440 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-058861f1-22f0-4d4e-acdb-ed585f918f6a tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:24.789892 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-058861f1-22f0-4d4e-acdb-ed585f918f6a tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:24.790623 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-058861f1-22f0-4d4e-acdb-ed585f918f6a tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:24.791134 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-058861f1-22f0-4d4e-acdb-ed585f918f6a tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:24.791645 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-058861f1-22f0-4d4e-acdb-ed585f918f6a tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:25.568235 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-058861f1-22f0-4d4e-acdb-ed585f918f6a tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:25.592930 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-058861f1-22f0-4d4e-acdb-ed585f918f6a tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/3bf38c6a-3419-4b05-a06c-ccf8d89397f7" status: 200 len: 1309 microversion: 2.1 time: 0.824888 Aug 31 16:13:25.594580 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1886/3776] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:24 2022] GET /compute/v2.1/servers/3bf38c6a-3419-4b05-a06c-ccf8d89397f7 => generated 1309 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:25.601155 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2034db3e-143b-4965-8c21-a9c905c89c6e tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:25.602407 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2034db3e-143b-4965-8c21-a9c905c89c6e tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: c6bfb382-b9a8-4bf0-b868-ee5f51f9daac] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:25.611010 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2034db3e-143b-4965-8c21-a9c905c89c6e tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:25.611979 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2034db3e-143b-4965-8c21-a9c905c89c6e tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:25.614122 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2034db3e-143b-4965-8c21-a9c905c89c6e tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:25.615390 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2034db3e-143b-4965-8c21-a9c905c89c6e tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:25.616586 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2034db3e-143b-4965-8c21-a9c905c89c6e tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:25.617050 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2034db3e-143b-4965-8c21-a9c905c89c6e tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:25.759193 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a227db45-2c15-40c8-98d0-31431a7c14ae tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] 10.222.0.61 "POST /compute/v2.1/os-security-groups" status: 200 len: 224 microversion: 2.1 time: 1.292041 Aug 31 16:13:25.759964 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1891/3777] 10.222.0.61 () {60 vars in 1180 bytes} [Wed Aug 31 16:13:24 2022] POST /compute/v2.1/os-security-groups => generated 224 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:13:25.766362 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-bb3a31aa-388b-4e0f-8f63-9b044ad9123c req-2866fe7b-8e05-445a-8b8e-8c2c238eb6ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bf38c6a-3419-4b05-a06c-ccf8d89397f7", "name": "network-vif-plugged", "status": "completed", "tag": "9c66d108-ad5b-45b6-b9a6-40b1e08b67f5"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:13:25.782309 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-bb3a31aa-388b-4e0f-8f63-9b044ad9123c req-2866fe7b-8e05-445a-8b8e-8c2c238eb6ea service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:25.782459 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-bb3a31aa-388b-4e0f-8f63-9b044ad9123c req-2866fe7b-8e05-445a-8b8e-8c2c238eb6ea service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:25.783234 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-bb3a31aa-388b-4e0f-8f63-9b044ad9123c req-2866fe7b-8e05-445a-8b8e-8c2c238eb6ea service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:25.796102 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-bb3a31aa-388b-4e0f-8f63-9b044ad9123c req-2866fe7b-8e05-445a-8b8e-8c2c238eb6ea service nova] Creating event network-vif-plugged:9c66d108-ad5b-45b6-b9a6-40b1e08b67f5 for instance 3bf38c6a-3419-4b05-a06c-ccf8d89397f7 on n-h1-850499-9 Aug 31 16:13:25.802451 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-bb3a31aa-388b-4e0f-8f63-9b044ad9123c req-2866fe7b-8e05-445a-8b8e-8c2c238eb6ea service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040908 Aug 31 16:13:25.803170 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1892/3778] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:13:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:13:25.809077 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-365af8ff-c00e-496f-b503-f430959256ee tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:25.809805 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-365af8ff-c00e-496f-b503-f430959256ee tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] [instance: b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:25.812162 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:13:25.820735 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-365af8ff-c00e-496f-b503-f430959256ee tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:25.821288 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-365af8ff-c00e-496f-b503-f430959256ee tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:25.821737 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-365af8ff-c00e-496f-b503-f430959256ee tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:25.822460 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-365af8ff-c00e-496f-b503-f430959256ee tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:25.822923 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-365af8ff-c00e-496f-b503-f430959256ee tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:25.823413 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-365af8ff-c00e-496f-b503-f430959256ee tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:25.953664 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-365af8ff-c00e-496f-b503-f430959256ee tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce4e5c281c4432782d96b94323cdcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0b14e6533a4396b15f9c08657d924f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:25.959559 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-2034db3e-143b-4965-8c21-a9c905c89c6e tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48ee960c38f4d0584ea5ce34579279f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a957b6585e74a31b5bc5f66441c33e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:25.972795 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2034db3e-143b-4965-8c21-a9c905c89c6e tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "GET /compute/v2.1/servers/c6bfb382-b9a8-4bf0-b868-ee5f51f9daac" status: 200 len: 1313 microversion: 2.1 time: 0.375989 Aug 31 16:13:25.979441 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-365af8ff-c00e-496f-b503-f430959256ee tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] 10.222.0.61 "GET /compute/v2.1/servers/b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd" status: 200 len: 1268 microversion: 2.1 time: 0.170849 Aug 31 16:13:25.994694 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1893/3779] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:25 2022] GET /compute/v2.1/servers/b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd => generated 1268 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:25.995124 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1887/3780] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:25 2022] GET /compute/v2.1/servers/c6bfb382-b9a8-4bf0-b868-ee5f51f9daac => generated 1313 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:25.995251 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3334c578-4ecc-444c-9e0a-0a4e4cbd6835 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Calling method '.version_select at 0x7f5aed106f70>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:26.115373 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3334c578-4ecc-444c-9e0a-0a4e4cbd6835 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] 10.222.0.61 "GET /compute/v2.1/os-security-groups/313afc90-4263-4b1e-a4db-fa99cc503f78" status: 200 len: 224 microversion: 2.1 time: 0.133007 Aug 31 16:13:26.118613 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1894/3781] 10.222.0.61 () {58 vars in 1269 bytes} [Wed Aug 31 16:13:25 2022] GET /compute/v2.1/os-security-groups/313afc90-4263-4b1e-a4db-fa99cc503f78 => generated 224 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:13:26.138832 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-71f402d8-ad8e-4d09-81b9-873b281b80e1 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Calling method '.version_select at 0x7f5ae93c5f70>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:26.623286 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-20e9c03d-538c-4ccb-a7c2-0bbe9758cd9d tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:26.630709 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-20e9c03d-538c-4ccb-a7c2-0bbe9758cd9d tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 3bf38c6a-3419-4b05-a06c-ccf8d89397f7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:26.646054 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-20e9c03d-538c-4ccb-a7c2-0bbe9758cd9d tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:26.646929 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-20e9c03d-538c-4ccb-a7c2-0bbe9758cd9d tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:26.647903 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-20e9c03d-538c-4ccb-a7c2-0bbe9758cd9d tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:26.648986 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-20e9c03d-538c-4ccb-a7c2-0bbe9758cd9d tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:26.649967 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-20e9c03d-538c-4ccb-a7c2-0bbe9758cd9d tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:26.650980 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-20e9c03d-538c-4ccb-a7c2-0bbe9758cd9d tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:27.008598 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-71f402d8-ad8e-4d09-81b9-873b281b80e1 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/313afc90-4263-4b1e-a4db-fa99cc503f78" status: 202 len: 0 microversion: 2.1 time: 0.877534 Aug 31 16:13:27.009526 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1888/3782] 10.222.0.61 () {58 vars in 1272 bytes} [Wed Aug 31 16:13:26 2022] DELETE /compute/v2.1/os-security-groups/313afc90-4263-4b1e-a4db-fa99cc503f78 => generated 0 bytes in 879 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:13:27.014306 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-807c7caa-c808-4137-9d03-41037472f2da tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:27.015268 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-807c7caa-c808-4137-9d03-41037472f2da tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: c6bfb382-b9a8-4bf0-b868-ee5f51f9daac] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:27.023631 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-807c7caa-c808-4137-9d03-41037472f2da tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:27.024135 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-807c7caa-c808-4137-9d03-41037472f2da tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:27.024577 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-807c7caa-c808-4137-9d03-41037472f2da tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:27.025294 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-807c7caa-c808-4137-9d03-41037472f2da tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:27.025764 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-807c7caa-c808-4137-9d03-41037472f2da tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:27.026407 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-807c7caa-c808-4137-9d03-41037472f2da tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:27.066727 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-20e9c03d-538c-4ccb-a7c2-0bbe9758cd9d tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:27.079157 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-20e9c03d-538c-4ccb-a7c2-0bbe9758cd9d tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/3bf38c6a-3419-4b05-a06c-ccf8d89397f7" status: 200 len: 1309 microversion: 2.1 time: 0.463186 Aug 31 16:13:27.094912 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1895/3783] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:26 2022] GET /compute/v2.1/servers/3bf38c6a-3419-4b05-a06c-ccf8d89397f7 => generated 1309 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:13:27.105463 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a4662f45-1e9c-4ac2-a0b4-a8a71b6bea5b tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:27.106351 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a4662f45-1e9c-4ac2-a0b4-a8a71b6bea5b tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] [instance: b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:27.114506 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a4662f45-1e9c-4ac2-a0b4-a8a71b6bea5b tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:27.115006 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a4662f45-1e9c-4ac2-a0b4-a8a71b6bea5b tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:27.115452 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a4662f45-1e9c-4ac2-a0b4-a8a71b6bea5b tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:27.116479 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a4662f45-1e9c-4ac2-a0b4-a8a71b6bea5b tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:27.116993 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a4662f45-1e9c-4ac2-a0b4-a8a71b6bea5b tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:27.117755 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a4662f45-1e9c-4ac2-a0b4-a8a71b6bea5b tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:27.282256 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a4662f45-1e9c-4ac2-a0b4-a8a71b6bea5b tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce4e5c281c4432782d96b94323cdcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0b14e6533a4396b15f9c08657d924f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:27.290494 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a4662f45-1e9c-4ac2-a0b4-a8a71b6bea5b tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] 10.222.0.61 "GET /compute/v2.1/servers/b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd" status: 200 len: 1274 microversion: 2.1 time: 0.193720 Aug 31 16:13:27.291086 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1896/3784] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:27 2022] GET /compute/v2.1/servers/b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd => generated 1274 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:27.296234 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-467ca8ae-1a22-41f1-8d68-48d437cea193 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Calling method '.version_select at 0x7f5aed1c25e0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:27.402100 n-d-850499-9 devstack@n-api.service[122257]: DEBUG neutronclient.v2_0.client [None req-467ca8ae-1a22-41f1-8d68-48d437cea193 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 313afc90-4263-4b1e-a4db-fa99cc503f78 does not exist", "detail": ""}} {{(pid=122257) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 31 16:13:27.403031 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.security_group_api [None req-467ca8ae-1a22-41f1-8d68-48d437cea193 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Neutron security group 313afc90-4263-4b1e-a4db-fa99cc503f78 not found {{(pid=122257) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 31 16:13:27.403550 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-467ca8ae-1a22-41f1-8d68-48d437cea193 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] HTTP exception thrown: Security group 313afc90-4263-4b1e-a4db-fa99cc503f78 does not exist Aug 31 16:13:27.403550 n-d-850499-9 devstack@n-api.service[122257]: Neutron server returns request_ids: ['req-4dc8e00d-6dad-49e2-9208-e4dce85874a5'] Aug 31 16:13:27.409271 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-467ca8ae-1a22-41f1-8d68-48d437cea193 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Request method failure captured: Aug 31 16:13:27.409271 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/os-security-groups/313afc90-4263-4b1e-a4db-fa99cc503f78 HTTP/1.1 Aug 31 16:13:27.409271 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:13:27.409271 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:13:27.409271 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:13:27.409271 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:13:27.409271 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:13:27.409271 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:13:27.409271 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:13:27.409271 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:13:27.409271 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4iB3ZSM042t6H57DKQNRNkGdMmN-dpZ1iYL7Qp9DB5vaoQM-CcEpndp_H4eJtfFInIhXcNSw2oPrel3OUzJ_33XKrMtGya3pa2oH-wP6jy1-79FFGtwCTUUJYiIziOxflBbp14Trh2dPFGd_PM4hgPBygRYcEqBhkOx0cf9zQWBZvc Aug 31 16:13:27.409271 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:13:27.409271 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:13:27.409271 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:13:27.409271 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:13:27.409271 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:13:27.409271 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:13:27.409271 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 9f66705b4a0f4711ba14d9ceb5699bd1 Aug 31 16:13:27.409271 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-SecurityGroupsTestJSON-269266309 Aug 31 16:13:27.409271 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:13:27.409271 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:13:27.409271 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9f66705b4a0f4711ba14d9ceb5699bd1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9f66705b4a0f4711ba14d9ceb5699bd1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9f66705b4a0f4711ba14d9ceb5699bd1", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9f66705b4a0f4711ba14d9ceb5699bd1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:13:27.409271 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-SecurityGroupsTestJSON-269266309 Aug 31 16:13:27.409271 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 9f66705b4a0f4711ba14d9ceb5699bd1 Aug 31 16:13:27.409271 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-269266309 Aug 31 16:13:27.409271 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-SecurityGroupsTestJSON-269266309-project Aug 31 16:13:27.409271 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:13:27.409271 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:13:27.409271 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 5f911026e35d40a480094376c6556d03 Aug 31 16:13:27.409271 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-SecurityGroupsTestJSON-269266309-project Aug 31 16:13:27.409271 n-d-850499-9 devstack@n-api.service[122257]: method: Aug 31 16:13:27.409271 n-d-850499-9 devstack@n-api.service[122257]: exception: Security group 313afc90-4263-4b1e-a4db-fa99cc503f78 does not exist Aug 31 16:13:27.409271 n-d-850499-9 devstack@n-api.service[122257]: Neutron server returns request_ids: ['req-4dc8e00d-6dad-49e2-9208-e4dce85874a5'] Aug 31 16:13:27.409271 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '313afc90-4263-4b1e-a4db-fa99cc503f78'} Aug 31 16:13:27.409271 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:13:27.409271 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:27.409271 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 31 16:13:27.409271 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 31 16:13:27.409271 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:13:27.409271 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:13:27.409271 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 31 16:13:27.409271 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 31 16:13:27.409271 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:13:27.409271 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:13:27.409271 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 31 16:13:27.409271 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 31 16:13:27.409271 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:13:27.409271 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:13:27.409271 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 31 16:13:27.409271 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 31 16:13:27.409271 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:13:27.409271 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:13:27.409271 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 31 16:13:27.409271 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 31 16:13:27.409271 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:13:27.409271 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:13:27.409271 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 31 16:13:27.409271 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 31 16:13:27.409271 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 31 16:13:27.409271 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 31 16:13:27.409271 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 313afc90-4263-4b1e-a4db-fa99cc503f78 does not exist Aug 31 16:13:27.414503 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4dc8e00d-6dad-49e2-9208-e4dce85874a5'] Aug 31 16:13:27.414503 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:13:27.414503 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:13:27.414503 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:13:27.414503 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:27.414503 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 31 16:13:27.414503 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 31 16:13:27.414503 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 31 16:13:27.414503 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 31 16:13:27.414503 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 313afc90-4263-4b1e-a4db-fa99cc503f78 does not exist Aug 31 16:13:27.414503 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4dc8e00d-6dad-49e2-9208-e4dce85874a5'] Aug 31 16:13:27.414503 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:13:27.414503 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:13:27.414503 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:13:27.414503 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:27.414503 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:13:27.414503 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:13:27.414503 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:13:27.414503 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:13:27.414503 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:13:27.414503 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:13:27.414503 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:13:27.414503 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:13:27.414503 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 31 16:13:27.414503 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 31 16:13:27.414503 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 313afc90-4263-4b1e-a4db-fa99cc503f78 does not exist Aug 31 16:13:27.414503 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4dc8e00d-6dad-49e2-9208-e4dce85874a5'] Aug 31 16:13:27.414503 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:13:27.414503 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:13:27.414503 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:13:27.414503 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:27.414503 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:13:27.414503 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:13:27.414503 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:13:27.414503 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:13:27.414503 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 313afc90-4263-4b1e-a4db-fa99cc503f78 does not exist Aug 31 16:13:27.414503 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4dc8e00d-6dad-49e2-9208-e4dce85874a5'] Aug 31 16:13:27.414503 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:13:27.422338 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-467ca8ae-1a22-41f1-8d68-48d437cea193 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Returning 404 to user: Security group 313afc90-4263-4b1e-a4db-fa99cc503f78 does not exist Aug 31 16:13:27.422338 n-d-850499-9 devstack@n-api.service[122257]: Neutron server returns request_ids: ['req-4dc8e00d-6dad-49e2-9208-e4dce85874a5'] {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:13:27.423608 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-467ca8ae-1a22-41f1-8d68-48d437cea193 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] 10.222.0.61 "GET /compute/v2.1/os-security-groups/313afc90-4263-4b1e-a4db-fa99cc503f78" status: 404 len: 194 microversion: 2.1 time: 0.131541 Aug 31 16:13:27.426837 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1897/3785] 10.222.0.61 () {58 vars in 1269 bytes} [Wed Aug 31 16:13:27 2022] GET /compute/v2.1/os-security-groups/313afc90-4263-4b1e-a4db-fa99cc503f78 => generated 194 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:13:27.436475 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e9c252b7-b4c2-4627-8e2a-54ba7c52a346 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Action: 'create', calling method: .version_select at 0x7f5ae85759d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2022061990", "description": "tempest-description-784258907"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:13:27.471440 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-807c7caa-c808-4137-9d03-41037472f2da tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48ee960c38f4d0584ea5ce34579279f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a957b6585e74a31b5bc5f66441c33e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:27.489493 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-807c7caa-c808-4137-9d03-41037472f2da tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "GET /compute/v2.1/servers/c6bfb382-b9a8-4bf0-b868-ee5f51f9daac" status: 200 len: 1313 microversion: 2.1 time: 0.478805 Aug 31 16:13:27.490094 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1889/3786] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:27 2022] GET /compute/v2.1/servers/c6bfb382-b9a8-4bf0-b868-ee5f51f9daac => generated 1313 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:27.801845 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e9c252b7-b4c2-4627-8e2a-54ba7c52a346 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] 10.222.0.61 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.366879 Aug 31 16:13:27.819372 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b13c3d34-803c-4784-b72a-ab9e5052f340 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Action: 'create', calling method: .version_select at 0x7f5ae946f940>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-582656282", "description": "tempest-description-386515711"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:13:27.820810 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1898/3787] 10.222.0.61 () {60 vars in 1180 bytes} [Wed Aug 31 16:13:27 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:13:28.104186 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-051bfd26-16f8-4279-8a0b-4c1bd46aeb7e tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:28.106364 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-051bfd26-16f8-4279-8a0b-4c1bd46aeb7e tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 3bf38c6a-3419-4b05-a06c-ccf8d89397f7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:28.124978 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-051bfd26-16f8-4279-8a0b-4c1bd46aeb7e tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:28.125756 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-051bfd26-16f8-4279-8a0b-4c1bd46aeb7e tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:28.126377 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-051bfd26-16f8-4279-8a0b-4c1bd46aeb7e tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:28.127377 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-051bfd26-16f8-4279-8a0b-4c1bd46aeb7e tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:28.128087 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-051bfd26-16f8-4279-8a0b-4c1bd46aeb7e tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:28.129351 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-051bfd26-16f8-4279-8a0b-4c1bd46aeb7e tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:28.311727 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b13c3d34-803c-4784-b72a-ab9e5052f340 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] 10.222.0.61 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.496306 Aug 31 16:13:28.322233 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1890/3788] 10.222.0.61 () {60 vars in 1180 bytes} [Wed Aug 31 16:13:27 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:13:28.322233 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2f48defa-f65a-40f4-8b06-35ca5572ca1c tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:28.322233 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2f48defa-f65a-40f4-8b06-35ca5572ca1c tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] [instance: b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:28.344412 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2f48defa-f65a-40f4-8b06-35ca5572ca1c tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:28.345110 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2f48defa-f65a-40f4-8b06-35ca5572ca1c tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:28.345558 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2f48defa-f65a-40f4-8b06-35ca5572ca1c tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:28.346280 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2f48defa-f65a-40f4-8b06-35ca5572ca1c tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:28.346738 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2f48defa-f65a-40f4-8b06-35ca5572ca1c tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:28.347219 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2f48defa-f65a-40f4-8b06-35ca5572ca1c tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:28.599453 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-051bfd26-16f8-4279-8a0b-4c1bd46aeb7e tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:28.613136 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-051bfd26-16f8-4279-8a0b-4c1bd46aeb7e tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/3bf38c6a-3419-4b05-a06c-ccf8d89397f7" status: 200 len: 1490 microversion: 2.1 time: 0.512136 Aug 31 16:13:28.634978 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1899/3789] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:28 2022] GET /compute/v2.1/servers/3bf38c6a-3419-4b05-a06c-ccf8d89397f7 => generated 1490 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:13:28.641984 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2723e210-0ef1-4221-abe2-43e4a0d3b570 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Action: 'create', calling method: .version_select at 0x7f5ae856b4c0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1310843029", "description": "tempest-description-957730403"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:13:28.705248 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-2f48defa-f65a-40f4-8b06-35ca5572ca1c tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce4e5c281c4432782d96b94323cdcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0b14e6533a4396b15f9c08657d924f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:28.732332 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2f48defa-f65a-40f4-8b06-35ca5572ca1c tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] 10.222.0.61 "GET /compute/v2.1/servers/b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd" status: 200 len: 1316 microversion: 2.1 time: 0.416127 Aug 31 16:13:28.748262 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1891/3790] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:28 2022] GET /compute/v2.1/servers/b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd => generated 1316 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:28.759292 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-35a6c2c2-c0c1-43e3-8dbc-3ef81c002616 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:28.760691 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-35a6c2c2-c0c1-43e3-8dbc-3ef81c002616 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: c6bfb382-b9a8-4bf0-b868-ee5f51f9daac] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:28.788621 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-35a6c2c2-c0c1-43e3-8dbc-3ef81c002616 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:28.791617 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-35a6c2c2-c0c1-43e3-8dbc-3ef81c002616 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:28.794082 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-35a6c2c2-c0c1-43e3-8dbc-3ef81c002616 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:28.795217 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-35a6c2c2-c0c1-43e3-8dbc-3ef81c002616 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:28.797643 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-35a6c2c2-c0c1-43e3-8dbc-3ef81c002616 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:28.798438 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-35a6c2c2-c0c1-43e3-8dbc-3ef81c002616 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:29.660761 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-35a6c2c2-c0c1-43e3-8dbc-3ef81c002616 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48ee960c38f4d0584ea5ce34579279f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a957b6585e74a31b5bc5f66441c33e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:29.669745 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-35a6c2c2-c0c1-43e3-8dbc-3ef81c002616 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "GET /compute/v2.1/servers/c6bfb382-b9a8-4bf0-b868-ee5f51f9daac" status: 200 len: 1313 microversion: 2.1 time: 0.930045 Aug 31 16:13:29.670434 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1892/3791] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:28 2022] GET /compute/v2.1/servers/c6bfb382-b9a8-4bf0-b868-ee5f51f9daac => generated 1313 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:29.683393 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e097dc7a-25a4-4456-989d-770dfcc93cd7 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:29.684314 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e097dc7a-25a4-4456-989d-770dfcc93cd7 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: ce9f8f4c-9d4e-48c0-bd66-1c409e91bf5a] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:29.691546 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e097dc7a-25a4-4456-989d-770dfcc93cd7 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:29.692222 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e097dc7a-25a4-4456-989d-770dfcc93cd7 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:29.693117 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e097dc7a-25a4-4456-989d-770dfcc93cd7 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:29.694169 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e097dc7a-25a4-4456-989d-770dfcc93cd7 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:29.694926 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e097dc7a-25a4-4456-989d-770dfcc93cd7 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:29.695719 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e097dc7a-25a4-4456-989d-770dfcc93cd7 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:29.773864 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2723e210-0ef1-4221-abe2-43e4a0d3b570 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] 10.222.0.61 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.137325 Aug 31 16:13:29.774522 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1900/3792] 10.222.0.61 () {60 vars in 1180 bytes} [Wed Aug 31 16:13:28 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:13:29.781526 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-b07ff9d2-a571-4a2d-b9fc-af9bb369ac3b req-24a77cd2-f48a-476b-aee0-bc34414fd9a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6bfb382-b9a8-4bf0-b868-ee5f51f9daac", "name": "network-vif-plugged", "status": "completed", "tag": "36afac70-65f8-4bf7-b126-7e6e5c89bdd6"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:13:29.795273 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-b07ff9d2-a571-4a2d-b9fc-af9bb369ac3b req-24a77cd2-f48a-476b-aee0-bc34414fd9a8 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:29.795714 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-b07ff9d2-a571-4a2d-b9fc-af9bb369ac3b req-24a77cd2-f48a-476b-aee0-bc34414fd9a8 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:29.796485 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-b07ff9d2-a571-4a2d-b9fc-af9bb369ac3b req-24a77cd2-f48a-476b-aee0-bc34414fd9a8 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:29.808445 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-b07ff9d2-a571-4a2d-b9fc-af9bb369ac3b req-24a77cd2-f48a-476b-aee0-bc34414fd9a8 service nova] Creating event network-vif-plugged:36afac70-65f8-4bf7-b126-7e6e5c89bdd6 for instance c6bfb382-b9a8-4bf0-b868-ee5f51f9daac on n-h1-850499-9 Aug 31 16:13:29.814758 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-b07ff9d2-a571-4a2d-b9fc-af9bb369ac3b req-24a77cd2-f48a-476b-aee0-bc34414fd9a8 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037590 Aug 31 16:13:29.817190 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1901/3793] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:13:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:13:29.824621 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-fc391c4d-5ed8-4e2e-bc87-df871f7b4908 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:29.825326 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-fc391c4d-5ed8-4e2e-bc87-df871f7b4908 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] [instance: b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:29.832396 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fc391c4d-5ed8-4e2e-bc87-df871f7b4908 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:29.832891 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fc391c4d-5ed8-4e2e-bc87-df871f7b4908 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:29.833328 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fc391c4d-5ed8-4e2e-bc87-df871f7b4908 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:29.834036 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fc391c4d-5ed8-4e2e-bc87-df871f7b4908 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:29.834490 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fc391c4d-5ed8-4e2e-bc87-df871f7b4908 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:29.834919 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fc391c4d-5ed8-4e2e-bc87-df871f7b4908 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:30.137850 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e097dc7a-25a4-4456-989d-770dfcc93cd7 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:30.153377 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e097dc7a-25a4-4456-989d-770dfcc93cd7 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/ce9f8f4c-9d4e-48c0-bd66-1c409e91bf5a" status: 200 len: 1490 microversion: 2.1 time: 0.481253 Aug 31 16:13:30.171581 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1893/3794] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:29 2022] GET /compute/v2.1/servers/ce9f8f4c-9d4e-48c0-bd66-1c409e91bf5a => generated 1490 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:30.171581 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-aa14d2d9-7c3e-4072-9d71-dfdf2fe93c1e tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Calling method '.version_select at 0x7f5ae3f3c790>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:30.221464 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-fc391c4d-5ed8-4e2e-bc87-df871f7b4908 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce4e5c281c4432782d96b94323cdcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0b14e6533a4396b15f9c08657d924f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:30.230238 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-fc391c4d-5ed8-4e2e-bc87-df871f7b4908 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] 10.222.0.61 "GET /compute/v2.1/servers/b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd" status: 200 len: 1316 microversion: 2.1 time: 0.411248 Aug 31 16:13:30.230834 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1902/3795] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:29 2022] GET /compute/v2.1/servers/b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd => generated 1316 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:30.235828 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-660f1ef2-ed8d-4131-851f-09fae0c42750 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:30.236437 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-660f1ef2-ed8d-4131-851f-09fae0c42750 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 3bf38c6a-3419-4b05-a06c-ccf8d89397f7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:30.243391 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-660f1ef2-ed8d-4131-851f-09fae0c42750 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:30.244167 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-660f1ef2-ed8d-4131-851f-09fae0c42750 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:30.244615 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-660f1ef2-ed8d-4131-851f-09fae0c42750 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:30.245361 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-660f1ef2-ed8d-4131-851f-09fae0c42750 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:30.245821 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-660f1ef2-ed8d-4131-851f-09fae0c42750 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:30.246251 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-660f1ef2-ed8d-4131-851f-09fae0c42750 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:30.680603 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-660f1ef2-ed8d-4131-851f-09fae0c42750 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:30.690935 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-660f1ef2-ed8d-4131-851f-09fae0c42750 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/3bf38c6a-3419-4b05-a06c-ccf8d89397f7" status: 200 len: 1490 microversion: 2.1 time: 0.459039 Aug 31 16:13:30.691715 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1903/3796] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:30 2022] GET /compute/v2.1/servers/3bf38c6a-3419-4b05-a06c-ccf8d89397f7 => generated 1490 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:30.696743 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-46c7a031-9983-4c70-a6ec-b4ca4c2ea644 req-69dd0dc9-d707-4e30-b27c-4f4d05116579 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd", "tag": "1e0e4551-0c34-4d8d-ab3b-8543a1afdcca"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:13:30.706951 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-46c7a031-9983-4c70-a6ec-b4ca4c2ea644 req-69dd0dc9-d707-4e30-b27c-4f4d05116579 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:30.707655 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-46c7a031-9983-4c70-a6ec-b4ca4c2ea644 req-69dd0dc9-d707-4e30-b27c-4f4d05116579 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:30.708109 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-46c7a031-9983-4c70-a6ec-b4ca4c2ea644 req-69dd0dc9-d707-4e30-b27c-4f4d05116579 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:30.721101 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-46c7a031-9983-4c70-a6ec-b4ca4c2ea644 req-69dd0dc9-d707-4e30-b27c-4f4d05116579 service nova] Creating event network-changed:1e0e4551-0c34-4d8d-ab3b-8543a1afdcca for instance b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd on n-h2-850499-9 Aug 31 16:13:30.726567 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-46c7a031-9983-4c70-a6ec-b4ca4c2ea644 req-69dd0dc9-d707-4e30-b27c-4f4d05116579 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033435 Aug 31 16:13:30.727183 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1904/3797] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:13:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:13:30.732317 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1063c369-0553-45f4-9447-569138bfa5c8 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:30.733045 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1063c369-0553-45f4-9447-569138bfa5c8 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: c6bfb382-b9a8-4bf0-b868-ee5f51f9daac] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:30.740998 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1063c369-0553-45f4-9447-569138bfa5c8 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:30.741324 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1063c369-0553-45f4-9447-569138bfa5c8 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:30.741820 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1063c369-0553-45f4-9447-569138bfa5c8 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:30.742695 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1063c369-0553-45f4-9447-569138bfa5c8 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:30.743264 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1063c369-0553-45f4-9447-569138bfa5c8 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:30.743803 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1063c369-0553-45f4-9447-569138bfa5c8 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:30.997562 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-aa14d2d9-7c3e-4072-9d71-dfdf2fe93c1e tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] 10.222.0.61 "GET /compute/v2.1/os-security-groups" status: 200 len: 1830 microversion: 2.1 time: 0.841211 Aug 31 16:13:31.007921 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1894/3798] 10.222.0.61 () {58 vars in 1158 bytes} [Wed Aug 31 16:13:30 2022] GET /compute/v2.1/os-security-groups => generated 1830 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:31.007921 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-57e1a741-02fa-410c-9ba5-dadc04294542 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:31.007921 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-57e1a741-02fa-410c-9ba5-dadc04294542 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 3bf38c6a-3419-4b05-a06c-ccf8d89397f7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:31.012581 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-57e1a741-02fa-410c-9ba5-dadc04294542 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:31.013144 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-57e1a741-02fa-410c-9ba5-dadc04294542 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:31.013589 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-57e1a741-02fa-410c-9ba5-dadc04294542 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:31.014292 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-57e1a741-02fa-410c-9ba5-dadc04294542 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:31.014886 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-57e1a741-02fa-410c-9ba5-dadc04294542 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:31.015240 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-57e1a741-02fa-410c-9ba5-dadc04294542 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:31.044483 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-57e1a741-02fa-410c-9ba5-dadc04294542 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 3bf38c6a-3419-4b05-a06c-ccf8d89397f7] Going to try to terminate instance {{(pid=122256) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:13:31.127372 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-57e1a741-02fa-410c-9ba5-dadc04294542 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "DELETE /compute/v2.1/servers/3bf38c6a-3419-4b05-a06c-ccf8d89397f7" status: 204 len: 0 microversion: 2.1 time: 0.127598 Aug 31 16:13:31.128266 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1895/3799] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:13:30 2022] DELETE /compute/v2.1/servers/3bf38c6a-3419-4b05-a06c-ccf8d89397f7 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:13:31.134886 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7ca2a89a-fa54-4b74-b1c7-a2fd071607a6 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Calling method '.version_select at 0x7f5ae8674820>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:31.136955 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-1063c369-0553-45f4-9447-569138bfa5c8 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48ee960c38f4d0584ea5ce34579279f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a957b6585e74a31b5bc5f66441c33e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:31.157771 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1063c369-0553-45f4-9447-569138bfa5c8 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "GET /compute/v2.1/servers/c6bfb382-b9a8-4bf0-b868-ee5f51f9daac" status: 200 len: 1313 microversion: 2.1 time: 0.429317 Aug 31 16:13:31.158674 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1905/3800] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:30 2022] GET /compute/v2.1/servers/c6bfb382-b9a8-4bf0-b868-ee5f51f9daac => generated 1313 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:31.164705 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2aee8c5e-ba24-4803-b683-24486c2ca428 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:31.165672 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2aee8c5e-ba24-4803-b683-24486c2ca428 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 3bf38c6a-3419-4b05-a06c-ccf8d89397f7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:31.172082 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2aee8c5e-ba24-4803-b683-24486c2ca428 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:31.172863 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2aee8c5e-ba24-4803-b683-24486c2ca428 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:31.173492 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2aee8c5e-ba24-4803-b683-24486c2ca428 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:31.174222 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2aee8c5e-ba24-4803-b683-24486c2ca428 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:31.174689 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2aee8c5e-ba24-4803-b683-24486c2ca428 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:31.175231 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2aee8c5e-ba24-4803-b683-24486c2ca428 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:31.591645 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2aee8c5e-ba24-4803-b683-24486c2ca428 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:31.595461 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=100 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:13:31.602005 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2aee8c5e-ba24-4803-b683-24486c2ca428 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/3bf38c6a-3419-4b05-a06c-ccf8d89397f7" status: 200 len: 1496 microversion: 2.1 time: 0.441166 Aug 31 16:13:31.603004 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1906/3801] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:31 2022] GET /compute/v2.1/servers/3bf38c6a-3419-4b05-a06c-ccf8d89397f7 => generated 1496 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:31.607283 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d41fb099-68ea-4786-a68b-8e1f252256ba tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:31.607933 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d41fb099-68ea-4786-a68b-8e1f252256ba tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] [instance: b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:31.615463 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d41fb099-68ea-4786-a68b-8e1f252256ba tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:31.615793 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d41fb099-68ea-4786-a68b-8e1f252256ba tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:31.616346 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d41fb099-68ea-4786-a68b-8e1f252256ba tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:31.617180 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d41fb099-68ea-4786-a68b-8e1f252256ba tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:31.617665 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d41fb099-68ea-4786-a68b-8e1f252256ba tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:31.618086 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d41fb099-68ea-4786-a68b-8e1f252256ba tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:31.816758 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7ca2a89a-fa54-4b74-b1c7-a2fd071607a6 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/57f38355-04f6-4a74-ad78-f56fabb05161" status: 202 len: 0 microversion: 2.1 time: 0.687370 Aug 31 16:13:31.817673 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1896/3802] 10.222.0.61 () {58 vars in 1272 bytes} [Wed Aug 31 16:13:31 2022] DELETE /compute/v2.1/os-security-groups/57f38355-04f6-4a74-ad78-f56fabb05161 => generated 0 bytes in 689 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:13:31.825483 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-53dcad72-aefc-49ba-9401-d3649423fccd tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Calling method '.version_select at 0x7f5ae3ec3ca0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:31.882410 n-d-850499-9 devstack@n-api.service[122256]: DEBUG neutronclient.v2_0.client [None req-53dcad72-aefc-49ba-9401-d3649423fccd tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 57f38355-04f6-4a74-ad78-f56fabb05161 does not exist", "detail": ""}} {{(pid=122256) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 31 16:13:31.883098 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.security_group_api [None req-53dcad72-aefc-49ba-9401-d3649423fccd tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Neutron security group 57f38355-04f6-4a74-ad78-f56fabb05161 not found {{(pid=122256) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 31 16:13:31.883667 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-53dcad72-aefc-49ba-9401-d3649423fccd tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] HTTP exception thrown: Security group 57f38355-04f6-4a74-ad78-f56fabb05161 does not exist Aug 31 16:13:31.883667 n-d-850499-9 devstack@n-api.service[122256]: Neutron server returns request_ids: ['req-e4b29e5d-f998-4287-bd88-549b4061862e'] Aug 31 16:13:31.885671 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-53dcad72-aefc-49ba-9401-d3649423fccd tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Request method failure captured: Aug 31 16:13:31.885671 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/os-security-groups/57f38355-04f6-4a74-ad78-f56fabb05161 HTTP/1.1 Aug 31 16:13:31.885671 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:13:31.885671 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:13:31.885671 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:13:31.885671 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:13:31.885671 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:13:31.885671 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:13:31.885671 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:13:31.885671 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:13:31.885671 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4iB3ZSM042t6H57DKQNRNkGdMmN-dpZ1iYL7Qp9DB5vaoQM-CcEpndp_H4eJtfFInIhXcNSw2oPrel3OUzJ_33XKrMtGya3pa2oH-wP6jy1-79FFGtwCTUUJYiIziOxflBbp14Trh2dPFGd_PM4hgPBygRYcEqBhkOx0cf9zQWBZvc Aug 31 16:13:31.885671 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:13:31.885671 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:13:31.885671 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:13:31.885671 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:13:31.885671 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:13:31.885671 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:13:31.885671 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 9f66705b4a0f4711ba14d9ceb5699bd1 Aug 31 16:13:31.885671 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-SecurityGroupsTestJSON-269266309 Aug 31 16:13:31.885671 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:13:31.885671 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:13:31.885671 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9f66705b4a0f4711ba14d9ceb5699bd1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9f66705b4a0f4711ba14d9ceb5699bd1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9f66705b4a0f4711ba14d9ceb5699bd1", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9f66705b4a0f4711ba14d9ceb5699bd1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:13:31.885671 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-SecurityGroupsTestJSON-269266309 Aug 31 16:13:31.885671 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 9f66705b4a0f4711ba14d9ceb5699bd1 Aug 31 16:13:31.885671 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-269266309 Aug 31 16:13:31.885671 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-SecurityGroupsTestJSON-269266309-project Aug 31 16:13:31.885671 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:13:31.885671 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:13:31.885671 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 5f911026e35d40a480094376c6556d03 Aug 31 16:13:31.885671 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-SecurityGroupsTestJSON-269266309-project Aug 31 16:13:31.885671 n-d-850499-9 devstack@n-api.service[122256]: method: Aug 31 16:13:31.885671 n-d-850499-9 devstack@n-api.service[122256]: exception: Security group 57f38355-04f6-4a74-ad78-f56fabb05161 does not exist Aug 31 16:13:31.885671 n-d-850499-9 devstack@n-api.service[122256]: Neutron server returns request_ids: ['req-e4b29e5d-f998-4287-bd88-549b4061862e'] Aug 31 16:13:31.885671 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '57f38355-04f6-4a74-ad78-f56fabb05161'} Aug 31 16:13:31.885671 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:13:31.885671 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:31.885671 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 31 16:13:31.885671 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 31 16:13:31.885671 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:13:31.885671 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:13:31.885671 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 31 16:13:31.885671 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 31 16:13:31.885671 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:13:31.885671 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:13:31.885671 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 31 16:13:31.885671 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 31 16:13:31.885671 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:13:31.885671 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:13:31.885671 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 31 16:13:31.885671 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 31 16:13:31.885671 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:13:31.885671 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:13:31.885671 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 31 16:13:31.885671 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 31 16:13:31.885671 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:13:31.885671 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:13:31.885671 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 31 16:13:31.885671 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 31 16:13:31.885671 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 31 16:13:31.885671 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 31 16:13:31.885671 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 57f38355-04f6-4a74-ad78-f56fabb05161 does not exist Aug 31 16:13:31.890312 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e4b29e5d-f998-4287-bd88-549b4061862e'] Aug 31 16:13:31.890312 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:13:31.890312 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:13:31.890312 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:13:31.890312 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:31.890312 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 31 16:13:31.890312 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 31 16:13:31.890312 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 31 16:13:31.890312 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 31 16:13:31.890312 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 57f38355-04f6-4a74-ad78-f56fabb05161 does not exist Aug 31 16:13:31.890312 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e4b29e5d-f998-4287-bd88-549b4061862e'] Aug 31 16:13:31.890312 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:13:31.890312 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:13:31.890312 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:13:31.890312 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:31.890312 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:13:31.890312 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:13:31.890312 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:13:31.890312 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:13:31.890312 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:13:31.890312 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:13:31.890312 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:13:31.890312 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:13:31.890312 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 31 16:13:31.890312 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 31 16:13:31.890312 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 57f38355-04f6-4a74-ad78-f56fabb05161 does not exist Aug 31 16:13:31.890312 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e4b29e5d-f998-4287-bd88-549b4061862e'] Aug 31 16:13:31.890312 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:13:31.890312 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:13:31.890312 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:13:31.890312 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:31.890312 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:13:31.890312 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:13:31.890312 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:13:31.890312 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:13:31.890312 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 57f38355-04f6-4a74-ad78-f56fabb05161 does not exist Aug 31 16:13:31.890312 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e4b29e5d-f998-4287-bd88-549b4061862e'] Aug 31 16:13:31.890312 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:13:31.894801 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-53dcad72-aefc-49ba-9401-d3649423fccd tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Returning 404 to user: Security group 57f38355-04f6-4a74-ad78-f56fabb05161 does not exist Aug 31 16:13:31.894801 n-d-850499-9 devstack@n-api.service[122256]: Neutron server returns request_ids: ['req-e4b29e5d-f998-4287-bd88-549b4061862e'] {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:13:31.896255 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-53dcad72-aefc-49ba-9401-d3649423fccd tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] 10.222.0.61 "GET /compute/v2.1/os-security-groups/57f38355-04f6-4a74-ad78-f56fabb05161" status: 404 len: 194 microversion: 2.1 time: 0.074241 Aug 31 16:13:31.896638 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1897/3803] 10.222.0.61 () {58 vars in 1269 bytes} [Wed Aug 31 16:13:31 2022] GET /compute/v2.1/os-security-groups/57f38355-04f6-4a74-ad78-f56fabb05161 => generated 194 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 16:13:31.905942 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9a79e044-3408-4c9d-8887-c8628ed75bca tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Calling method '.version_select at 0x7f5ae867e550>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:31.908699 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d41fb099-68ea-4786-a68b-8e1f252256ba tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce4e5c281c4432782d96b94323cdcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0b14e6533a4396b15f9c08657d924f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:31.920486 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d41fb099-68ea-4786-a68b-8e1f252256ba tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] 10.222.0.61 "GET /compute/v2.1/servers/b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd" status: 200 len: 1316 microversion: 2.1 time: 0.316722 Aug 31 16:13:31.921656 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1907/3804] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:31 2022] GET /compute/v2.1/servers/b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd => generated 1316 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:32.181796 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-351d3e56-be0e-4468-86e1-7d4b65322320 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:32.183120 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-351d3e56-be0e-4468-86e1-7d4b65322320 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: c6bfb382-b9a8-4bf0-b868-ee5f51f9daac] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:32.189740 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-351d3e56-be0e-4468-86e1-7d4b65322320 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:32.190354 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-351d3e56-be0e-4468-86e1-7d4b65322320 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:32.190937 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-351d3e56-be0e-4468-86e1-7d4b65322320 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:32.191963 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-351d3e56-be0e-4468-86e1-7d4b65322320 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:32.194957 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-351d3e56-be0e-4468-86e1-7d4b65322320 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:32.194957 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-351d3e56-be0e-4468-86e1-7d4b65322320 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:32.432396 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9a79e044-3408-4c9d-8887-c8628ed75bca tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/234eeda0-f780-4a41-ae00-ef033e1b5f8f" status: 202 len: 0 microversion: 2.1 time: 0.529003 Aug 31 16:13:32.433593 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1898/3805] 10.222.0.61 () {58 vars in 1272 bytes} [Wed Aug 31 16:13:31 2022] DELETE /compute/v2.1/os-security-groups/234eeda0-f780-4a41-ae00-ef033e1b5f8f => generated 0 bytes in 533 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:13:32.445448 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4e13fa43-0fe7-4f80-af08-c8ad8da41bc4 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Calling method '.version_select at 0x7f5ae3ec30d0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:32.478979 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-351d3e56-be0e-4468-86e1-7d4b65322320 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48ee960c38f4d0584ea5ce34579279f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a957b6585e74a31b5bc5f66441c33e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:32.485761 n-d-850499-9 devstack@n-api.service[122256]: DEBUG neutronclient.v2_0.client [None req-4e13fa43-0fe7-4f80-af08-c8ad8da41bc4 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 234eeda0-f780-4a41-ae00-ef033e1b5f8f does not exist", "detail": ""}} {{(pid=122256) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 31 16:13:32.486998 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.security_group_api [None req-4e13fa43-0fe7-4f80-af08-c8ad8da41bc4 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Neutron security group 234eeda0-f780-4a41-ae00-ef033e1b5f8f not found {{(pid=122256) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 31 16:13:32.488037 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-4e13fa43-0fe7-4f80-af08-c8ad8da41bc4 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] HTTP exception thrown: Security group 234eeda0-f780-4a41-ae00-ef033e1b5f8f does not exist Aug 31 16:13:32.488037 n-d-850499-9 devstack@n-api.service[122256]: Neutron server returns request_ids: ['req-99bf527c-8ff4-4229-8d3c-ecf61297e69e'] Aug 31 16:13:32.490396 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4e13fa43-0fe7-4f80-af08-c8ad8da41bc4 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Request method failure captured: Aug 31 16:13:32.490396 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/os-security-groups/234eeda0-f780-4a41-ae00-ef033e1b5f8f HTTP/1.1 Aug 31 16:13:32.490396 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:13:32.490396 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:13:32.490396 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:13:32.490396 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:13:32.490396 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:13:32.490396 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:13:32.490396 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:13:32.490396 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:13:32.490396 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4iB3ZSM042t6H57DKQNRNkGdMmN-dpZ1iYL7Qp9DB5vaoQM-CcEpndp_H4eJtfFInIhXcNSw2oPrel3OUzJ_33XKrMtGya3pa2oH-wP6jy1-79FFGtwCTUUJYiIziOxflBbp14Trh2dPFGd_PM4hgPBygRYcEqBhkOx0cf9zQWBZvc Aug 31 16:13:32.490396 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:13:32.490396 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:13:32.490396 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:13:32.490396 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:13:32.490396 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:13:32.490396 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:13:32.490396 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 9f66705b4a0f4711ba14d9ceb5699bd1 Aug 31 16:13:32.490396 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-SecurityGroupsTestJSON-269266309 Aug 31 16:13:32.490396 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:13:32.490396 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:13:32.490396 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9f66705b4a0f4711ba14d9ceb5699bd1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9f66705b4a0f4711ba14d9ceb5699bd1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9f66705b4a0f4711ba14d9ceb5699bd1", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9f66705b4a0f4711ba14d9ceb5699bd1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:13:32.490396 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-SecurityGroupsTestJSON-269266309 Aug 31 16:13:32.490396 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 9f66705b4a0f4711ba14d9ceb5699bd1 Aug 31 16:13:32.490396 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-269266309 Aug 31 16:13:32.490396 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-SecurityGroupsTestJSON-269266309-project Aug 31 16:13:32.490396 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:13:32.490396 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:13:32.490396 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 5f911026e35d40a480094376c6556d03 Aug 31 16:13:32.490396 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-SecurityGroupsTestJSON-269266309-project Aug 31 16:13:32.490396 n-d-850499-9 devstack@n-api.service[122256]: method: Aug 31 16:13:32.490396 n-d-850499-9 devstack@n-api.service[122256]: exception: Security group 234eeda0-f780-4a41-ae00-ef033e1b5f8f does not exist Aug 31 16:13:32.490396 n-d-850499-9 devstack@n-api.service[122256]: Neutron server returns request_ids: ['req-99bf527c-8ff4-4229-8d3c-ecf61297e69e'] Aug 31 16:13:32.490396 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '234eeda0-f780-4a41-ae00-ef033e1b5f8f'} Aug 31 16:13:32.490396 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:13:32.490396 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:32.490396 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 31 16:13:32.490396 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 31 16:13:32.490396 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:13:32.490396 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:13:32.490396 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 31 16:13:32.490396 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 31 16:13:32.490396 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:13:32.490396 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:13:32.490396 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 31 16:13:32.490396 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 31 16:13:32.490396 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:13:32.490396 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:13:32.490396 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 31 16:13:32.490396 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 31 16:13:32.490396 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:13:32.490396 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:13:32.490396 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 31 16:13:32.490396 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 31 16:13:32.490396 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:13:32.490396 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:13:32.490396 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 31 16:13:32.490396 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 31 16:13:32.490396 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 31 16:13:32.490396 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 31 16:13:32.490396 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 234eeda0-f780-4a41-ae00-ef033e1b5f8f does not exist Aug 31 16:13:32.497453 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-99bf527c-8ff4-4229-8d3c-ecf61297e69e'] Aug 31 16:13:32.497453 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:13:32.497453 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:13:32.497453 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:13:32.497453 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:32.497453 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 31 16:13:32.497453 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 31 16:13:32.497453 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 31 16:13:32.497453 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 31 16:13:32.497453 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 234eeda0-f780-4a41-ae00-ef033e1b5f8f does not exist Aug 31 16:13:32.497453 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-99bf527c-8ff4-4229-8d3c-ecf61297e69e'] Aug 31 16:13:32.497453 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:13:32.497453 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:13:32.497453 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:13:32.497453 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:32.497453 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:13:32.497453 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:13:32.497453 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:13:32.497453 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:13:32.497453 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:13:32.497453 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:13:32.497453 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:13:32.497453 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:13:32.497453 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 31 16:13:32.497453 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 31 16:13:32.497453 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 234eeda0-f780-4a41-ae00-ef033e1b5f8f does not exist Aug 31 16:13:32.497453 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-99bf527c-8ff4-4229-8d3c-ecf61297e69e'] Aug 31 16:13:32.497453 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:13:32.497453 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:13:32.497453 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:13:32.497453 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:32.497453 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:13:32.497453 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:13:32.497453 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:13:32.497453 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:13:32.497453 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 234eeda0-f780-4a41-ae00-ef033e1b5f8f does not exist Aug 31 16:13:32.497453 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-99bf527c-8ff4-4229-8d3c-ecf61297e69e'] Aug 31 16:13:32.497453 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:13:32.497453 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4e13fa43-0fe7-4f80-af08-c8ad8da41bc4 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Returning 404 to user: Security group 234eeda0-f780-4a41-ae00-ef033e1b5f8f does not exist Aug 31 16:13:32.497453 n-d-850499-9 devstack@n-api.service[122256]: Neutron server returns request_ids: ['req-99bf527c-8ff4-4229-8d3c-ecf61297e69e'] {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:13:32.497453 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4e13fa43-0fe7-4f80-af08-c8ad8da41bc4 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] 10.222.0.61 "GET /compute/v2.1/os-security-groups/234eeda0-f780-4a41-ae00-ef033e1b5f8f" status: 404 len: 194 microversion: 2.1 time: 0.052980 Aug 31 16:13:32.497453 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1899/3806] 10.222.0.61 () {58 vars in 1269 bytes} [Wed Aug 31 16:13:32 2022] GET /compute/v2.1/os-security-groups/234eeda0-f780-4a41-ae00-ef033e1b5f8f => generated 194 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:13:32.502653 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-feb59dc9-6bd6-4c39-97d4-6285f0eae1a0 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Calling method '.version_select at 0x7f5ae3f3c8b0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:32.504750 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-351d3e56-be0e-4468-86e1-7d4b65322320 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "GET /compute/v2.1/servers/c6bfb382-b9a8-4bf0-b868-ee5f51f9daac" status: 200 len: 1313 microversion: 2.1 time: 0.327145 Aug 31 16:13:32.505438 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1908/3807] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:32 2022] GET /compute/v2.1/servers/c6bfb382-b9a8-4bf0-b868-ee5f51f9daac => generated 1313 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:13:32.625529 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d23adbe2-774d-48fa-a25f-baee529a936a tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:32.626270 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d23adbe2-774d-48fa-a25f-baee529a936a tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 3bf38c6a-3419-4b05-a06c-ccf8d89397f7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:32.635355 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d23adbe2-774d-48fa-a25f-baee529a936a tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:32.636210 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d23adbe2-774d-48fa-a25f-baee529a936a tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:32.636834 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d23adbe2-774d-48fa-a25f-baee529a936a tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:32.637773 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d23adbe2-774d-48fa-a25f-baee529a936a tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:32.638235 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d23adbe2-774d-48fa-a25f-baee529a936a tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:32.638835 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d23adbe2-774d-48fa-a25f-baee529a936a tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:32.973629 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:13:33.301199 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d23adbe2-774d-48fa-a25f-baee529a936a tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:33.313034 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-feb59dc9-6bd6-4c39-97d4-6285f0eae1a0 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/33cd3db7-9234-4312-b6e8-1dd9f95aaa81" status: 202 len: 0 microversion: 2.1 time: 0.815313 Aug 31 16:13:33.314572 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1900/3808] 10.222.0.61 () {58 vars in 1272 bytes} [Wed Aug 31 16:13:32 2022] DELETE /compute/v2.1/os-security-groups/33cd3db7-9234-4312-b6e8-1dd9f95aaa81 => generated 0 bytes in 817 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:13:33.320689 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d949780e-a809-4d71-81b2-d35fc21ce532 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:33.321829 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d949780e-a809-4d71-81b2-d35fc21ce532 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] [instance: b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:33.325925 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d23adbe2-774d-48fa-a25f-baee529a936a tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/3bf38c6a-3419-4b05-a06c-ccf8d89397f7" status: 200 len: 1496 microversion: 2.1 time: 0.702444 Aug 31 16:13:33.327793 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1909/3809] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:32 2022] GET /compute/v2.1/servers/3bf38c6a-3419-4b05-a06c-ccf8d89397f7 => generated 1496 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:13:33.337688 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d949780e-a809-4d71-81b2-d35fc21ce532 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:33.338574 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d949780e-a809-4d71-81b2-d35fc21ce532 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:33.339251 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d949780e-a809-4d71-81b2-d35fc21ce532 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:33.341211 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-457d6aa0-bd0f-4ae7-acbc-d3fbe77607bc tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Calling method '.version_select at 0x7f5ae8475a60>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:33.342295 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d949780e-a809-4d71-81b2-d35fc21ce532 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:33.343000 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d949780e-a809-4d71-81b2-d35fc21ce532 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:33.343727 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d949780e-a809-4d71-81b2-d35fc21ce532 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:33.389745 n-d-850499-9 devstack@n-api.service[122257]: DEBUG neutronclient.v2_0.client [None req-457d6aa0-bd0f-4ae7-acbc-d3fbe77607bc tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 33cd3db7-9234-4312-b6e8-1dd9f95aaa81 does not exist", "detail": ""}} {{(pid=122257) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 31 16:13:33.390683 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.security_group_api [None req-457d6aa0-bd0f-4ae7-acbc-d3fbe77607bc tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Neutron security group 33cd3db7-9234-4312-b6e8-1dd9f95aaa81 not found {{(pid=122257) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 31 16:13:33.391370 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-457d6aa0-bd0f-4ae7-acbc-d3fbe77607bc tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] HTTP exception thrown: Security group 33cd3db7-9234-4312-b6e8-1dd9f95aaa81 does not exist Aug 31 16:13:33.391370 n-d-850499-9 devstack@n-api.service[122257]: Neutron server returns request_ids: ['req-40367268-1291-4c72-8945-0dd17a033ba8'] Aug 31 16:13:33.395000 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-457d6aa0-bd0f-4ae7-acbc-d3fbe77607bc tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Request method failure captured: Aug 31 16:13:33.395000 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/os-security-groups/33cd3db7-9234-4312-b6e8-1dd9f95aaa81 HTTP/1.1 Aug 31 16:13:33.395000 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:13:33.395000 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:13:33.395000 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:13:33.395000 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:13:33.395000 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:13:33.395000 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:13:33.395000 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:13:33.395000 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:13:33.395000 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4iB3ZSM042t6H57DKQNRNkGdMmN-dpZ1iYL7Qp9DB5vaoQM-CcEpndp_H4eJtfFInIhXcNSw2oPrel3OUzJ_33XKrMtGya3pa2oH-wP6jy1-79FFGtwCTUUJYiIziOxflBbp14Trh2dPFGd_PM4hgPBygRYcEqBhkOx0cf9zQWBZvc Aug 31 16:13:33.395000 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:13:33.395000 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:13:33.395000 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:13:33.395000 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:13:33.395000 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:13:33.395000 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:13:33.395000 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 9f66705b4a0f4711ba14d9ceb5699bd1 Aug 31 16:13:33.395000 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-SecurityGroupsTestJSON-269266309 Aug 31 16:13:33.395000 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:13:33.395000 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:13:33.395000 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9f66705b4a0f4711ba14d9ceb5699bd1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9f66705b4a0f4711ba14d9ceb5699bd1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9f66705b4a0f4711ba14d9ceb5699bd1", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9f66705b4a0f4711ba14d9ceb5699bd1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:13:33.395000 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-SecurityGroupsTestJSON-269266309 Aug 31 16:13:33.395000 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 9f66705b4a0f4711ba14d9ceb5699bd1 Aug 31 16:13:33.395000 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-269266309 Aug 31 16:13:33.395000 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-SecurityGroupsTestJSON-269266309-project Aug 31 16:13:33.395000 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:13:33.395000 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:13:33.395000 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 5f911026e35d40a480094376c6556d03 Aug 31 16:13:33.395000 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-SecurityGroupsTestJSON-269266309-project Aug 31 16:13:33.395000 n-d-850499-9 devstack@n-api.service[122257]: method: Aug 31 16:13:33.395000 n-d-850499-9 devstack@n-api.service[122257]: exception: Security group 33cd3db7-9234-4312-b6e8-1dd9f95aaa81 does not exist Aug 31 16:13:33.395000 n-d-850499-9 devstack@n-api.service[122257]: Neutron server returns request_ids: ['req-40367268-1291-4c72-8945-0dd17a033ba8'] Aug 31 16:13:33.395000 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '33cd3db7-9234-4312-b6e8-1dd9f95aaa81'} Aug 31 16:13:33.395000 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:13:33.395000 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:33.395000 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 31 16:13:33.395000 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 31 16:13:33.395000 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:13:33.395000 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:13:33.395000 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 31 16:13:33.395000 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 31 16:13:33.395000 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:13:33.395000 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:13:33.395000 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 31 16:13:33.395000 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 31 16:13:33.395000 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:13:33.395000 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:13:33.395000 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 31 16:13:33.395000 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 31 16:13:33.395000 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:13:33.395000 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:13:33.395000 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 31 16:13:33.395000 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 31 16:13:33.395000 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:13:33.395000 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:13:33.395000 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 31 16:13:33.395000 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 31 16:13:33.395000 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 31 16:13:33.395000 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 31 16:13:33.395000 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 33cd3db7-9234-4312-b6e8-1dd9f95aaa81 does not exist Aug 31 16:13:33.399281 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-40367268-1291-4c72-8945-0dd17a033ba8'] Aug 31 16:13:33.399281 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:13:33.399281 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:13:33.399281 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:13:33.399281 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:33.399281 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 31 16:13:33.399281 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 31 16:13:33.399281 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 31 16:13:33.399281 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 31 16:13:33.399281 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 33cd3db7-9234-4312-b6e8-1dd9f95aaa81 does not exist Aug 31 16:13:33.399281 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-40367268-1291-4c72-8945-0dd17a033ba8'] Aug 31 16:13:33.399281 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:13:33.399281 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:13:33.399281 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:13:33.399281 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:33.399281 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:13:33.399281 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:13:33.399281 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:13:33.399281 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:13:33.399281 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:13:33.399281 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:13:33.399281 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:13:33.399281 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:13:33.399281 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 31 16:13:33.399281 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 31 16:13:33.399281 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 33cd3db7-9234-4312-b6e8-1dd9f95aaa81 does not exist Aug 31 16:13:33.399281 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-40367268-1291-4c72-8945-0dd17a033ba8'] Aug 31 16:13:33.399281 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:13:33.399281 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:13:33.399281 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:13:33.399281 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:33.399281 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:13:33.399281 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:13:33.399281 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:13:33.399281 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:13:33.399281 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 33cd3db7-9234-4312-b6e8-1dd9f95aaa81 does not exist Aug 31 16:13:33.399281 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-40367268-1291-4c72-8945-0dd17a033ba8'] Aug 31 16:13:33.399281 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:13:33.399281 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-457d6aa0-bd0f-4ae7-acbc-d3fbe77607bc tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Returning 404 to user: Security group 33cd3db7-9234-4312-b6e8-1dd9f95aaa81 does not exist Aug 31 16:13:33.399281 n-d-850499-9 devstack@n-api.service[122257]: Neutron server returns request_ids: ['req-40367268-1291-4c72-8945-0dd17a033ba8'] {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:13:33.399281 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-457d6aa0-bd0f-4ae7-acbc-d3fbe77607bc tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] 10.222.0.61 "GET /compute/v2.1/os-security-groups/33cd3db7-9234-4312-b6e8-1dd9f95aaa81" status: 404 len: 194 microversion: 2.1 time: 0.066644 Aug 31 16:13:33.399281 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1910/3810] 10.222.0.61 () {58 vars in 1269 bytes} [Wed Aug 31 16:13:33 2022] GET /compute/v2.1/os-security-groups/33cd3db7-9234-4312-b6e8-1dd9f95aaa81 => generated 194 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:13:33.411768 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-21142fd2-a07c-4f99-b143-9be870711e85 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Calling method '.version_select at 0x7f5ae84a23a0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:33.668414 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d949780e-a809-4d71-81b2-d35fc21ce532 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce4e5c281c4432782d96b94323cdcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0b14e6533a4396b15f9c08657d924f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:33.685619 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d949780e-a809-4d71-81b2-d35fc21ce532 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] 10.222.0.61 "GET /compute/v2.1/servers/b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd" status: 200 len: 1316 microversion: 2.1 time: 0.369093 Aug 31 16:13:33.700259 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1901/3811] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:33 2022] GET /compute/v2.1/servers/b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd => generated 1316 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:33.724405 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ae49a36d-f3a0-43c5-afeb-30d73661213e tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:33.726359 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ae49a36d-f3a0-43c5-afeb-30d73661213e tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: c6bfb382-b9a8-4bf0-b868-ee5f51f9daac] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:33.740140 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ae49a36d-f3a0-43c5-afeb-30d73661213e tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:33.742366 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ae49a36d-f3a0-43c5-afeb-30d73661213e tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:33.744089 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ae49a36d-f3a0-43c5-afeb-30d73661213e tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:33.748561 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ae49a36d-f3a0-43c5-afeb-30d73661213e tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:33.749071 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ae49a36d-f3a0-43c5-afeb-30d73661213e tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:33.749851 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ae49a36d-f3a0-43c5-afeb-30d73661213e tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:33.813008 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-21142fd2-a07c-4f99-b143-9be870711e85 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] 10.222.0.61 "GET /compute/v2.1/os-security-groups" status: 200 len: 1156 microversion: 2.1 time: 0.409281 Aug 31 16:13:33.813967 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1911/3812] 10.222.0.61 () {58 vars in 1158 bytes} [Wed Aug 31 16:13:33 2022] GET /compute/v2.1/os-security-groups => generated 1156 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:13:33.830030 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9daa2ffd-2f94-41b3-8df2-c404be87a995 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Action: 'create', calling method: .version_select at 0x7f5ae841d040>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2108013832", "description": "tempest-description-1190460848"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:13:33.997165 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ae49a36d-f3a0-43c5-afeb-30d73661213e tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48ee960c38f4d0584ea5ce34579279f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a957b6585e74a31b5bc5f66441c33e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:34.011811 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ae49a36d-f3a0-43c5-afeb-30d73661213e tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "GET /compute/v2.1/servers/c6bfb382-b9a8-4bf0-b868-ee5f51f9daac" status: 200 len: 1500 microversion: 2.1 time: 0.309045 Aug 31 16:13:34.012700 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1902/3813] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:33 2022] GET /compute/v2.1/servers/c6bfb382-b9a8-4bf0-b868-ee5f51f9daac => generated 1500 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:34.036479 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b66f6918-e089-4c34-bce6-f43123b9aa3d tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:13:34.047493 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b66f6918-e089-4c34-bce6-f43123b9aa3d tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: c6bfb382-b9a8-4bf0-b868-ee5f51f9daac] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:34.055553 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b66f6918-e089-4c34-bce6-f43123b9aa3d tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:34.058159 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b66f6918-e089-4c34-bce6-f43123b9aa3d tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:34.059023 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b66f6918-e089-4c34-bce6-f43123b9aa3d tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:34.059878 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b66f6918-e089-4c34-bce6-f43123b9aa3d tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:34.060570 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b66f6918-e089-4c34-bce6-f43123b9aa3d tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:34.062527 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b66f6918-e089-4c34-bce6-f43123b9aa3d tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:34.102629 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-b66f6918-e089-4c34-bce6-f43123b9aa3d tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lazy-loading 'flavor' on Instance uuid c6bfb382-b9a8-4bf0-b868-ee5f51f9daac {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:13:34.149107 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=8 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:13:34.210276 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9daa2ffd-2f94-41b3-8df2-c404be87a995 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] 10.222.0.61 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.385343 Aug 31 16:13:34.219759 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1912/3814] 10.222.0.61 () {60 vars in 1180 bytes} [Wed Aug 31 16:13:33 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:13:34.227155 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e131c29b-3f9b-4fac-8147-0de06ca95220 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Action: 'create', calling method: .version_select at 0x7f5aed106790>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1670130029", "description": "tempest-description-702326057"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:13:34.401062 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b66f6918-e089-4c34-bce6-f43123b9aa3d tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "POST /compute/v2.1/servers/c6bfb382-b9a8-4bf0-b868-ee5f51f9daac/action" status: 200 len: 32 microversion: 2.1 time: 0.366417 Aug 31 16:13:34.407640 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1903/3815] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:13:34 2022] POST /compute/v2.1/servers/c6bfb382-b9a8-4bf0-b868-ee5f51f9daac/action => generated 32 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 16:13:34.425363 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5e8ce585-6b0d-4d8c-8d15-37c22d00d464 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:34.426508 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5e8ce585-6b0d-4d8c-8d15-37c22d00d464 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 3bf38c6a-3419-4b05-a06c-ccf8d89397f7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:34.436814 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5e8ce585-6b0d-4d8c-8d15-37c22d00d464 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:34.438628 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5e8ce585-6b0d-4d8c-8d15-37c22d00d464 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:34.440343 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5e8ce585-6b0d-4d8c-8d15-37c22d00d464 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:34.444188 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5e8ce585-6b0d-4d8c-8d15-37c22d00d464 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:34.444932 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5e8ce585-6b0d-4d8c-8d15-37c22d00d464 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:34.445583 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5e8ce585-6b0d-4d8c-8d15-37c22d00d464 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:34.512493 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e131c29b-3f9b-4fac-8147-0de06ca95220 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] 10.222.0.61 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.291087 Aug 31 16:13:34.513227 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1913/3816] 10.222.0.61 () {60 vars in 1180 bytes} [Wed Aug 31 16:13:34 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:13:34.524844 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-b1afeb7e-0250-4dcd-b434-ee51b5e91423 req-db7d8f70-a6b7-4dee-963e-45bd183dd42e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bf38c6a-3419-4b05-a06c-ccf8d89397f7", "name": "network-vif-deleted", "tag": "9c66d108-ad5b-45b6-b9a6-40b1e08b67f5"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:13:34.551483 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-b1afeb7e-0250-4dcd-b434-ee51b5e91423 req-db7d8f70-a6b7-4dee-963e-45bd183dd42e service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:34.551889 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-b1afeb7e-0250-4dcd-b434-ee51b5e91423 req-db7d8f70-a6b7-4dee-963e-45bd183dd42e service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:34.552332 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-b1afeb7e-0250-4dcd-b434-ee51b5e91423 req-db7d8f70-a6b7-4dee-963e-45bd183dd42e service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:34.573077 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5e8ce585-6b0d-4d8c-8d15-37c22d00d464 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:34.584298 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5e8ce585-6b0d-4d8c-8d15-37c22d00d464 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/3bf38c6a-3419-4b05-a06c-ccf8d89397f7" status: 200 len: 1294 microversion: 2.1 time: 0.167946 Aug 31 16:13:34.600605 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-b1afeb7e-0250-4dcd-b434-ee51b5e91423 req-db7d8f70-a6b7-4dee-963e-45bd183dd42e service nova] Creating event network-vif-deleted:9c66d108-ad5b-45b6-b9a6-40b1e08b67f5 for instance 3bf38c6a-3419-4b05-a06c-ccf8d89397f7 on n-h1-850499-9 Aug 31 16:13:34.604804 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1904/3817] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:34 2022] GET /compute/v2.1/servers/3bf38c6a-3419-4b05-a06c-ccf8d89397f7 => generated 1294 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:34.609176 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-b1afeb7e-0250-4dcd-b434-ee51b5e91423 req-db7d8f70-a6b7-4dee-963e-45bd183dd42e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087213 Aug 31 16:13:34.610506 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9bb8b859-df0f-4408-8280-7b7f956e7c27 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:34.610649 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1914/3818] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:13:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:13:34.611972 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9bb8b859-df0f-4408-8280-7b7f956e7c27 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: c6bfb382-b9a8-4bf0-b868-ee5f51f9daac] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:34.620065 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9bb8b859-df0f-4408-8280-7b7f956e7c27 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:34.620872 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9bb8b859-df0f-4408-8280-7b7f956e7c27 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:34.621490 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9bb8b859-df0f-4408-8280-7b7f956e7c27 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:34.622972 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9bb8b859-df0f-4408-8280-7b7f956e7c27 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:34.639321 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9bb8b859-df0f-4408-8280-7b7f956e7c27 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:34.642319 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9bb8b859-df0f-4408-8280-7b7f956e7c27 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:34.689765 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:13:34.731963 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-180dbefd-be0e-450b-b080-c3e95c38ff95 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-2115605430", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "networks": [{"uuid": "d687da68-2dd2-4155-9017-14e1ffc41ed6"}]}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:13:34.804659 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-180dbefd-be0e-450b-b080-c3e95c38ff95 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] validate_networks() for [('d687da68-2dd2-4155-9017-14e1ffc41ed6', None, None, None, None, None)] {{(pid=122257) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:13:34.943172 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-9bb8b859-df0f-4408-8280-7b7f956e7c27 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48ee960c38f4d0584ea5ce34579279f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a957b6585e74a31b5bc5f66441c33e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:34.951956 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9bb8b859-df0f-4408-8280-7b7f956e7c27 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "GET /compute/v2.1/servers/c6bfb382-b9a8-4bf0-b868-ee5f51f9daac" status: 200 len: 1506 microversion: 2.1 time: 0.345664 Aug 31 16:13:34.952553 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1905/3819] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:34 2022] GET /compute/v2.1/servers/c6bfb382-b9a8-4bf0-b868-ee5f51f9daac => generated 1506 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:34.959347 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-57f22dbd-9690-4192-8d51-fbdd13952e38 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:34.960267 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-57f22dbd-9690-4192-8d51-fbdd13952e38 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] [instance: b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:34.963436 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:13:34.968164 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-57f22dbd-9690-4192-8d51-fbdd13952e38 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:34.969273 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-57f22dbd-9690-4192-8d51-fbdd13952e38 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:34.970049 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-57f22dbd-9690-4192-8d51-fbdd13952e38 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:34.970950 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-57f22dbd-9690-4192-8d51-fbdd13952e38 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:34.971826 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-57f22dbd-9690-4192-8d51-fbdd13952e38 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:34.973011 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-57f22dbd-9690-4192-8d51-fbdd13952e38 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:35.280274 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-57f22dbd-9690-4192-8d51-fbdd13952e38 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce4e5c281c4432782d96b94323cdcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0b14e6533a4396b15f9c08657d924f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:35.304056 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-57f22dbd-9690-4192-8d51-fbdd13952e38 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] 10.222.0.61 "GET /compute/v2.1/servers/b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd" status: 200 len: 1316 microversion: 2.1 time: 0.350141 Aug 31 16:13:35.304811 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1906/3820] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:34 2022] GET /compute/v2.1/servers/b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd => generated 1316 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:35.570072 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-180dbefd-be0e-450b-b080-c3e95c38ff95 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:13:35.570861 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-180dbefd-be0e-450b-b080-c3e95c38ff95 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:13:35.571757 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-180dbefd-be0e-450b-b080-c3e95c38ff95 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:13:35.572415 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-180dbefd-be0e-450b-b080-c3e95c38ff95 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:13:35.573309 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-180dbefd-be0e-450b-b080-c3e95c38ff95 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:13:35.585160 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-180dbefd-be0e-450b-b080-c3e95c38ff95 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:35.585953 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-180dbefd-be0e-450b-b080-c3e95c38ff95 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:35.586403 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-180dbefd-be0e-450b-b080-c3e95c38ff95 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:35.587156 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-180dbefd-be0e-450b-b080-c3e95c38ff95 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:35.587652 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-180dbefd-be0e-450b-b080-c3e95c38ff95 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:35.588085 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-180dbefd-be0e-450b-b080-c3e95c38ff95 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:35.605065 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e8d4a9b0-c685-4819-b2d2-d07b59d3f2a3 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:35.605810 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e8d4a9b0-c685-4819-b2d2-d07b59d3f2a3 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 3bf38c6a-3419-4b05-a06c-ccf8d89397f7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:35.611476 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-180dbefd-be0e-450b-b080-c3e95c38ff95 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Getting quotas for project 9f66705b4a0f4711ba14d9ceb5699bd1. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:13:35.611906 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e8d4a9b0-c685-4819-b2d2-d07b59d3f2a3 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:35.612963 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e8d4a9b0-c685-4819-b2d2-d07b59d3f2a3 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:35.613745 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e8d4a9b0-c685-4819-b2d2-d07b59d3f2a3 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:35.614457 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e8d4a9b0-c685-4819-b2d2-d07b59d3f2a3 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:35.614916 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e8d4a9b0-c685-4819-b2d2-d07b59d3f2a3 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:35.615348 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e8d4a9b0-c685-4819-b2d2-d07b59d3f2a3 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:35.627652 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-180dbefd-be0e-450b-b080-c3e95c38ff95 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Getting quotas for user 5f911026e35d40a480094376c6556d03 and project 9f66705b4a0f4711ba14d9ceb5699bd1. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:13:35.633688 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-e8d4a9b0-c685-4819-b2d2-d07b59d3f2a3 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] HTTP exception thrown: Instance 3bf38c6a-3419-4b05-a06c-ccf8d89397f7 could not be found. Aug 31 16:13:35.635619 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e8d4a9b0-c685-4819-b2d2-d07b59d3f2a3 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Request method failure captured: Aug 31 16:13:35.635619 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/3bf38c6a-3419-4b05-a06c-ccf8d89397f7 HTTP/1.1 Aug 31 16:13:35.635619 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:13:35.635619 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:13:35.635619 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:13:35.635619 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:13:35.635619 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:13:35.635619 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:13:35.635619 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:13:35.635619 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:13:35.635619 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4gQXSNpx7T-s6ANX8A4XIz6BgCizm9VWKy6e0KLRI2pxjPOEzPLkRnoXGF3D-Jh3OWl1h65DNjP8YomYmS0bGyt_8avVSC7qeEvUleLImq7o7EhFYQT7JAMgMioD10eCPOZ7QHRsEPDslLrPXcQD5t1iAsH1xyWK7dbpfjoYLGjDpU Aug 31 16:13:35.635619 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:13:35.635619 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:13:35.635619 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:13:35.635619 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:13:35.635619 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:13:35.635619 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:13:35.635619 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 5299955053c842b6aa02e058f4b1c0cb Aug 31 16:13:35.635619 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ServersTestJSON-1028152372 Aug 31 16:13:35.635619 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:13:35.635619 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:13:35.635619 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5299955053c842b6aa02e058f4b1c0cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5299955053c842b6aa02e058f4b1c0cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5299955053c842b6aa02e058f4b1c0cb", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5299955053c842b6aa02e058f4b1c0cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:13:35.635619 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ServersTestJSON-1028152372 Aug 31 16:13:35.635619 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 5299955053c842b6aa02e058f4b1c0cb Aug 31 16:13:35.635619 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ServersTestJSON-1028152372 Aug 31 16:13:35.635619 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ServersTestJSON-1028152372-project Aug 31 16:13:35.635619 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:13:35.635619 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:13:35.635619 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 6e707652819c497bbdf94f85f39c447a Aug 31 16:13:35.635619 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ServersTestJSON-1028152372-project Aug 31 16:13:35.635619 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:13:35.635619 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance 3bf38c6a-3419-4b05-a06c-ccf8d89397f7 could not be found. Aug 31 16:13:35.635619 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '3bf38c6a-3419-4b05-a06c-ccf8d89397f7'} Aug 31 16:13:35.635619 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:13:35.635619 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:35.635619 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:13:35.635619 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:13:35.635619 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:13:35.635619 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:13:35.635619 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:13:35.635619 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:13:35.635619 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:13:35.635619 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:13:35.635619 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bf38c6a-3419-4b05-a06c-ccf8d89397f7 could not be found. Aug 31 16:13:35.635619 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:13:35.635619 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:13:35.635619 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:13:35.635619 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:35.635619 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:13:35.635619 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:13:35.635619 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:13:35.635619 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:13:35.635619 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:13:35.635619 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:13:35.635619 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:13:35.635619 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:13:35.635619 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:13:35.635619 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:13:35.635619 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:13:35.635619 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:13:35.635619 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bf38c6a-3419-4b05-a06c-ccf8d89397f7 could not be found. Aug 31 16:13:35.635619 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:13:35.635619 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:13:35.635619 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:13:35.648849 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:35.648849 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:13:35.648849 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:13:35.648849 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:13:35.648849 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:13:35.648849 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bf38c6a-3419-4b05-a06c-ccf8d89397f7 could not be found. Aug 31 16:13:35.648849 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:13:35.648849 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e8d4a9b0-c685-4819-b2d2-d07b59d3f2a3 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Returning 404 to user: Instance 3bf38c6a-3419-4b05-a06c-ccf8d89397f7 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:13:35.648849 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e8d4a9b0-c685-4819-b2d2-d07b59d3f2a3 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/3bf38c6a-3419-4b05-a06c-ccf8d89397f7" status: 404 len: 111 microversion: 2.1 time: 0.036024 Aug 31 16:13:35.648849 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1907/3821] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:35 2022] GET /compute/v2.1/servers/3bf38c6a-3419-4b05-a06c-ccf8d89397f7 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 16:13:35.648849 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1548aa81-fde1-4c89-9aec-c0b124eab9c2 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:35.648849 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1548aa81-fde1-4c89-9aec-c0b124eab9c2 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: ce9f8f4c-9d4e-48c0-bd66-1c409e91bf5a] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:35.654825 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1548aa81-fde1-4c89-9aec-c0b124eab9c2 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:35.655364 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1548aa81-fde1-4c89-9aec-c0b124eab9c2 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:35.655912 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1548aa81-fde1-4c89-9aec-c0b124eab9c2 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:35.656669 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1548aa81-fde1-4c89-9aec-c0b124eab9c2 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:35.657238 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1548aa81-fde1-4c89-9aec-c0b124eab9c2 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:35.657672 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1548aa81-fde1-4c89-9aec-c0b124eab9c2 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:35.669448 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-180dbefd-be0e-450b-b080-c3e95c38ff95 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Going to run 1 instances... {{(pid=122257) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:13:35.672772 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-180dbefd-be0e-450b-b080-c3e95c38ff95 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] [instance: 18dc9f32-b72a-4f4f-9153-a6a54f9d21b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:13:35.709706 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1548aa81-fde1-4c89-9aec-c0b124eab9c2 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: ce9f8f4c-9d4e-48c0-bd66-1c409e91bf5a] Going to try to terminate instance {{(pid=122256) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:13:35.759448 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-180dbefd-be0e-450b-b080-c3e95c38ff95 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.031492 Aug 31 16:13:35.760265 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1915/3822] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:13:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1033 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:13:35.789421 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e506056f-0bed-4069-9f3c-a3dc876b5f22 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:35.790340 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e506056f-0bed-4069-9f3c-a3dc876b5f22 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] [instance: 18dc9f32-b72a-4f4f-9153-a6a54f9d21b8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:35.879791 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1548aa81-fde1-4c89-9aec-c0b124eab9c2 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "DELETE /compute/v2.1/servers/ce9f8f4c-9d4e-48c0-bd66-1c409e91bf5a" status: 204 len: 0 microversion: 2.1 time: 0.236800 Aug 31 16:13:35.883685 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1908/3823] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:13:35 2022] DELETE /compute/v2.1/servers/ce9f8f4c-9d4e-48c0-bd66-1c409e91bf5a => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:13:35.891796 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f805faaf-8b7d-4af9-bb65-d0461b7faad1 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:35.892498 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f805faaf-8b7d-4af9-bb65-d0461b7faad1 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: ce9f8f4c-9d4e-48c0-bd66-1c409e91bf5a] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:35.916404 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f805faaf-8b7d-4af9-bb65-d0461b7faad1 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:35.917083 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f805faaf-8b7d-4af9-bb65-d0461b7faad1 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:35.917457 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f805faaf-8b7d-4af9-bb65-d0461b7faad1 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:35.918200 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f805faaf-8b7d-4af9-bb65-d0461b7faad1 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:35.918670 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f805faaf-8b7d-4af9-bb65-d0461b7faad1 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:35.919126 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f805faaf-8b7d-4af9-bb65-d0461b7faad1 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:35.943968 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e506056f-0bed-4069-9f3c-a3dc876b5f22 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f911026e35d40a480094376c6556d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f66705b4a0f4711ba14d9ceb5699bd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:35.963974 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e506056f-0bed-4069-9f3c-a3dc876b5f22 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] 10.222.0.61 "GET /compute/v2.1/servers/18dc9f32-b72a-4f4f-9153-a6a54f9d21b8" status: 200 len: 1216 microversion: 2.1 time: 0.189962 Aug 31 16:13:35.964852 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1916/3824] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:35 2022] GET /compute/v2.1/servers/18dc9f32-b72a-4f4f-9153-a6a54f9d21b8 => generated 1216 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:35.975145 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8a904c4d-4309-4c69-b0d3-8a069de85c3e tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:35.975786 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8a904c4d-4309-4c69-b0d3-8a069de85c3e tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: c6bfb382-b9a8-4bf0-b868-ee5f51f9daac] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:35.989308 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8a904c4d-4309-4c69-b0d3-8a069de85c3e tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:35.989308 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8a904c4d-4309-4c69-b0d3-8a069de85c3e tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:35.989308 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8a904c4d-4309-4c69-b0d3-8a069de85c3e tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:35.989308 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8a904c4d-4309-4c69-b0d3-8a069de85c3e tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:35.989308 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8a904c4d-4309-4c69-b0d3-8a069de85c3e tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:35.989308 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8a904c4d-4309-4c69-b0d3-8a069de85c3e tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:36.302898 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f805faaf-8b7d-4af9-bb65-d0461b7faad1 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:36.314651 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f805faaf-8b7d-4af9-bb65-d0461b7faad1 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/ce9f8f4c-9d4e-48c0-bd66-1c409e91bf5a" status: 200 len: 1496 microversion: 2.1 time: 0.427093 Aug 31 16:13:36.329377 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1909/3825] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:35 2022] GET /compute/v2.1/servers/ce9f8f4c-9d4e-48c0-bd66-1c409e91bf5a => generated 1496 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:13:36.330899 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8a904c4d-4309-4c69-b0d3-8a069de85c3e tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48ee960c38f4d0584ea5ce34579279f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a957b6585e74a31b5bc5f66441c33e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:36.335358 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e96c769b-7d40-4bf5-837e-914ca31ccad3 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:36.336528 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e96c769b-7d40-4bf5-837e-914ca31ccad3 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] [instance: b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:36.344533 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e96c769b-7d40-4bf5-837e-914ca31ccad3 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:36.345292 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e96c769b-7d40-4bf5-837e-914ca31ccad3 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:36.345936 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e96c769b-7d40-4bf5-837e-914ca31ccad3 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:36.348072 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e96c769b-7d40-4bf5-837e-914ca31ccad3 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:36.349632 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e96c769b-7d40-4bf5-837e-914ca31ccad3 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:36.350620 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e96c769b-7d40-4bf5-837e-914ca31ccad3 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:36.362490 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8a904c4d-4309-4c69-b0d3-8a069de85c3e tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "GET /compute/v2.1/servers/c6bfb382-b9a8-4bf0-b868-ee5f51f9daac" status: 200 len: 1506 microversion: 2.1 time: 0.391012 Aug 31 16:13:36.363404 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1917/3826] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:35 2022] GET /compute/v2.1/servers/c6bfb382-b9a8-4bf0-b868-ee5f51f9daac => generated 1506 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:13:36.598484 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e96c769b-7d40-4bf5-837e-914ca31ccad3 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce4e5c281c4432782d96b94323cdcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0b14e6533a4396b15f9c08657d924f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:36.611099 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e96c769b-7d40-4bf5-837e-914ca31ccad3 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] 10.222.0.61 "GET /compute/v2.1/servers/b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd" status: 200 len: 1316 microversion: 2.1 time: 0.280284 Aug 31 16:13:36.612420 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1910/3827] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:36 2022] GET /compute/v2.1/servers/b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd => generated 1316 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:37.000295 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a99057c7-a949-4dab-a526-ab9b44c83930 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:37.002843 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a99057c7-a949-4dab-a526-ab9b44c83930 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] [instance: 18dc9f32-b72a-4f4f-9153-a6a54f9d21b8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:37.014371 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a99057c7-a949-4dab-a526-ab9b44c83930 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:37.016016 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a99057c7-a949-4dab-a526-ab9b44c83930 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:37.026733 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a99057c7-a949-4dab-a526-ab9b44c83930 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:37.029482 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a99057c7-a949-4dab-a526-ab9b44c83930 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:37.031814 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a99057c7-a949-4dab-a526-ab9b44c83930 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:37.032521 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a99057c7-a949-4dab-a526-ab9b44c83930 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:37.148632 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a99057c7-a949-4dab-a526-ab9b44c83930 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f911026e35d40a480094376c6556d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f66705b4a0f4711ba14d9ceb5699bd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:37.160495 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a99057c7-a949-4dab-a526-ab9b44c83930 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] 10.222.0.61 "GET /compute/v2.1/servers/18dc9f32-b72a-4f4f-9153-a6a54f9d21b8" status: 200 len: 1212 microversion: 2.1 time: 0.165863 Aug 31 16:13:37.162598 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1918/3828] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:36 2022] GET /compute/v2.1/servers/18dc9f32-b72a-4f4f-9153-a6a54f9d21b8 => generated 1212 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:13:37.338396 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-bef7233a-9baf-432c-a721-64692d14b7f3 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:37.340356 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-bef7233a-9baf-432c-a721-64692d14b7f3 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: ce9f8f4c-9d4e-48c0-bd66-1c409e91bf5a] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:37.354087 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bef7233a-9baf-432c-a721-64692d14b7f3 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:37.355382 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bef7233a-9baf-432c-a721-64692d14b7f3 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:37.356172 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bef7233a-9baf-432c-a721-64692d14b7f3 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:37.357151 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bef7233a-9baf-432c-a721-64692d14b7f3 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:37.358223 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bef7233a-9baf-432c-a721-64692d14b7f3 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:37.361000 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bef7233a-9baf-432c-a721-64692d14b7f3 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:37.389373 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-539cefea-eaf1-468f-acea-2e3134e093e1 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:37.390074 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-539cefea-eaf1-468f-acea-2e3134e093e1 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: c6bfb382-b9a8-4bf0-b868-ee5f51f9daac] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:37.413574 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-539cefea-eaf1-468f-acea-2e3134e093e1 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:37.414222 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-539cefea-eaf1-468f-acea-2e3134e093e1 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:37.414864 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-539cefea-eaf1-468f-acea-2e3134e093e1 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:37.415607 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-539cefea-eaf1-468f-acea-2e3134e093e1 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:37.416458 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-539cefea-eaf1-468f-acea-2e3134e093e1 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:37.417100 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-539cefea-eaf1-468f-acea-2e3134e093e1 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:37.648331 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-bef7233a-9baf-432c-a721-64692d14b7f3 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:37.654318 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-539cefea-eaf1-468f-acea-2e3134e093e1 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48ee960c38f4d0584ea5ce34579279f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a957b6585e74a31b5bc5f66441c33e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:37.665192 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-bef7233a-9baf-432c-a721-64692d14b7f3 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/ce9f8f4c-9d4e-48c0-bd66-1c409e91bf5a" status: 200 len: 1496 microversion: 2.1 time: 0.331563 Aug 31 16:13:37.665652 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-539cefea-eaf1-468f-acea-2e3134e093e1 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "GET /compute/v2.1/servers/c6bfb382-b9a8-4bf0-b868-ee5f51f9daac" status: 200 len: 1506 microversion: 2.1 time: 0.281709 Aug 31 16:13:37.666530 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1911/3829] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:37 2022] GET /compute/v2.1/servers/ce9f8f4c-9d4e-48c0-bd66-1c409e91bf5a => generated 1496 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:13:37.673031 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0c903eba-5949-44d6-b9d3-d2bedd18eb8b tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:37.674291 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0c903eba-5949-44d6-b9d3-d2bedd18eb8b tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] [instance: b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:37.677102 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1919/3830] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:37 2022] GET /compute/v2.1/servers/c6bfb382-b9a8-4bf0-b868-ee5f51f9daac => generated 1506 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:37.692822 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0c903eba-5949-44d6-b9d3-d2bedd18eb8b tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:37.693219 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0c903eba-5949-44d6-b9d3-d2bedd18eb8b tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:37.693657 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0c903eba-5949-44d6-b9d3-d2bedd18eb8b tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:37.694539 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0c903eba-5949-44d6-b9d3-d2bedd18eb8b tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:37.695001 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0c903eba-5949-44d6-b9d3-d2bedd18eb8b tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:37.695424 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0c903eba-5949-44d6-b9d3-d2bedd18eb8b tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:37.894235 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-0c903eba-5949-44d6-b9d3-d2bedd18eb8b tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce4e5c281c4432782d96b94323cdcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0b14e6533a4396b15f9c08657d924f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:37.925371 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0c903eba-5949-44d6-b9d3-d2bedd18eb8b tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] 10.222.0.61 "GET /compute/v2.1/servers/b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd" status: 200 len: 1316 microversion: 2.1 time: 0.255996 Aug 31 16:13:37.926949 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1912/3831] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:37 2022] GET /compute/v2.1/servers/b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd => generated 1316 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:38.191277 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-650073fd-f61d-4e2e-a2f2-cdfff15f2ba3 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:38.192333 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-650073fd-f61d-4e2e-a2f2-cdfff15f2ba3 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] [instance: 18dc9f32-b72a-4f4f-9153-a6a54f9d21b8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:38.200859 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-650073fd-f61d-4e2e-a2f2-cdfff15f2ba3 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:38.202210 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-650073fd-f61d-4e2e-a2f2-cdfff15f2ba3 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:38.202835 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-650073fd-f61d-4e2e-a2f2-cdfff15f2ba3 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:38.203999 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-650073fd-f61d-4e2e-a2f2-cdfff15f2ba3 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:38.204711 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-650073fd-f61d-4e2e-a2f2-cdfff15f2ba3 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:38.208482 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-650073fd-f61d-4e2e-a2f2-cdfff15f2ba3 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:38.384871 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-650073fd-f61d-4e2e-a2f2-cdfff15f2ba3 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f911026e35d40a480094376c6556d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f66705b4a0f4711ba14d9ceb5699bd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:38.404367 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-650073fd-f61d-4e2e-a2f2-cdfff15f2ba3 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] 10.222.0.61 "GET /compute/v2.1/servers/18dc9f32-b72a-4f4f-9153-a6a54f9d21b8" status: 200 len: 1274 microversion: 2.1 time: 0.222042 Aug 31 16:13:38.405336 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1920/3832] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:38 2022] GET /compute/v2.1/servers/18dc9f32-b72a-4f4f-9153-a6a54f9d21b8 => generated 1274 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:38.411423 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-9bd173aa-367c-4a1c-acab-6a773c28068a req-8a3aeda7-46e2-443d-8e4b-bcd8f6208b4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce9f8f4c-9d4e-48c0-bd66-1c409e91bf5a", "name": "network-vif-deleted", "tag": "c4695205-af18-4876-807f-c392a29402d0"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:13:38.429918 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-9bd173aa-367c-4a1c-acab-6a773c28068a req-8a3aeda7-46e2-443d-8e4b-bcd8f6208b4d service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:38.430411 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-9bd173aa-367c-4a1c-acab-6a773c28068a req-8a3aeda7-46e2-443d-8e4b-bcd8f6208b4d service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:38.430846 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-9bd173aa-367c-4a1c-acab-6a773c28068a req-8a3aeda7-46e2-443d-8e4b-bcd8f6208b4d service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:38.468122 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-9bd173aa-367c-4a1c-acab-6a773c28068a req-8a3aeda7-46e2-443d-8e4b-bcd8f6208b4d service nova] Creating event network-vif-deleted:c4695205-af18-4876-807f-c392a29402d0 for instance ce9f8f4c-9d4e-48c0-bd66-1c409e91bf5a on n-h1-850499-9 Aug 31 16:13:38.475614 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-9bd173aa-367c-4a1c-acab-6a773c28068a req-8a3aeda7-46e2-443d-8e4b-bcd8f6208b4d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088625 Aug 31 16:13:38.492383 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1913/3833] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:13:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:13:38.702684 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4aa9c129-0237-4455-a889-8cf3df42d66f tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:38.704342 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5e72e272-d4ae-4f5f-923a-a43dbfcd4b14 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:38.705500 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4aa9c129-0237-4455-a889-8cf3df42d66f tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: c6bfb382-b9a8-4bf0-b868-ee5f51f9daac] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:38.709613 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5e72e272-d4ae-4f5f-923a-a43dbfcd4b14 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: ce9f8f4c-9d4e-48c0-bd66-1c409e91bf5a] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:38.724741 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4aa9c129-0237-4455-a889-8cf3df42d66f tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:38.725345 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4aa9c129-0237-4455-a889-8cf3df42d66f tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:38.725871 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4aa9c129-0237-4455-a889-8cf3df42d66f tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:38.727302 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4aa9c129-0237-4455-a889-8cf3df42d66f tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:38.727302 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4aa9c129-0237-4455-a889-8cf3df42d66f tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:38.727886 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4aa9c129-0237-4455-a889-8cf3df42d66f tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:38.750727 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5e72e272-d4ae-4f5f-923a-a43dbfcd4b14 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:38.751243 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5e72e272-d4ae-4f5f-923a-a43dbfcd4b14 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:38.751766 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5e72e272-d4ae-4f5f-923a-a43dbfcd4b14 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:38.752504 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5e72e272-d4ae-4f5f-923a-a43dbfcd4b14 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:38.754140 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5e72e272-d4ae-4f5f-923a-a43dbfcd4b14 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:38.754682 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5e72e272-d4ae-4f5f-923a-a43dbfcd4b14 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:38.832703 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5e72e272-d4ae-4f5f-923a-a43dbfcd4b14 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:38.833969 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5e72e272-d4ae-4f5f-923a-a43dbfcd4b14 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:38.834566 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5e72e272-d4ae-4f5f-923a-a43dbfcd4b14 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:38.835184 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-5e72e272-d4ae-4f5f-923a-a43dbfcd4b14 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lazy-loading 'fault' on Instance uuid ce9f8f4c-9d4e-48c0-bd66-1c409e91bf5a {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:13:38.908511 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5e72e272-d4ae-4f5f-923a-a43dbfcd4b14 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:38.919084 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5e72e272-d4ae-4f5f-923a-a43dbfcd4b14 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/ce9f8f4c-9d4e-48c0-bd66-1c409e91bf5a" status: 200 len: 1299 microversion: 2.1 time: 0.224374 Aug 31 16:13:38.919779 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1914/3834] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:38 2022] GET /compute/v2.1/servers/ce9f8f4c-9d4e-48c0-bd66-1c409e91bf5a => generated 1299 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:13:38.956977 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3c74c949-ff8f-4d2f-96f9-e0eb295e3a97 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:38.958120 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3c74c949-ff8f-4d2f-96f9-e0eb295e3a97 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] [instance: b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:38.964946 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3c74c949-ff8f-4d2f-96f9-e0eb295e3a97 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:38.965803 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3c74c949-ff8f-4d2f-96f9-e0eb295e3a97 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:38.966575 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3c74c949-ff8f-4d2f-96f9-e0eb295e3a97 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:38.967404 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3c74c949-ff8f-4d2f-96f9-e0eb295e3a97 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:38.968127 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3c74c949-ff8f-4d2f-96f9-e0eb295e3a97 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:38.968710 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3c74c949-ff8f-4d2f-96f9-e0eb295e3a97 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:39.096906 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-4aa9c129-0237-4455-a889-8cf3df42d66f tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48ee960c38f4d0584ea5ce34579279f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a957b6585e74a31b5bc5f66441c33e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:39.105072 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4aa9c129-0237-4455-a889-8cf3df42d66f tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "GET /compute/v2.1/servers/c6bfb382-b9a8-4bf0-b868-ee5f51f9daac" status: 200 len: 1506 microversion: 2.1 time: 0.418942 Aug 31 16:13:39.105842 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1921/3835] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:38 2022] GET /compute/v2.1/servers/c6bfb382-b9a8-4bf0-b868-ee5f51f9daac => generated 1506 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:39.259139 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3c74c949-ff8f-4d2f-96f9-e0eb295e3a97 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce4e5c281c4432782d96b94323cdcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0b14e6533a4396b15f9c08657d924f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:39.267585 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3c74c949-ff8f-4d2f-96f9-e0eb295e3a97 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] 10.222.0.61 "GET /compute/v2.1/servers/b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd" status: 200 len: 1316 microversion: 2.1 time: 0.316773 Aug 31 16:13:39.286268 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1915/3836] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:38 2022] GET /compute/v2.1/servers/b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd => generated 1316 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:39.435833 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ee1c2916-b663-4e74-a42d-af87060b7cc2 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:39.435833 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ee1c2916-b663-4e74-a42d-af87060b7cc2 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] [instance: 18dc9f32-b72a-4f4f-9153-a6a54f9d21b8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:39.456550 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ee1c2916-b663-4e74-a42d-af87060b7cc2 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:39.459184 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ee1c2916-b663-4e74-a42d-af87060b7cc2 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:39.460587 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ee1c2916-b663-4e74-a42d-af87060b7cc2 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:39.462288 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ee1c2916-b663-4e74-a42d-af87060b7cc2 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:39.463829 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ee1c2916-b663-4e74-a42d-af87060b7cc2 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:39.464916 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ee1c2916-b663-4e74-a42d-af87060b7cc2 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:39.735651 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ee1c2916-b663-4e74-a42d-af87060b7cc2 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f911026e35d40a480094376c6556d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f66705b4a0f4711ba14d9ceb5699bd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:39.747409 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ee1c2916-b663-4e74-a42d-af87060b7cc2 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] 10.222.0.61 "GET /compute/v2.1/servers/18dc9f32-b72a-4f4f-9153-a6a54f9d21b8" status: 200 len: 1316 microversion: 2.1 time: 0.319991 Aug 31 16:13:39.763214 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1922/3837] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:39 2022] GET /compute/v2.1/servers/18dc9f32-b72a-4f4f-9153-a6a54f9d21b8 => generated 1316 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:39.943385 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0a98d334-0a48-475d-be4b-1f066cc18bb5 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:39.943385 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0a98d334-0a48-475d-be4b-1f066cc18bb5 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: ce9f8f4c-9d4e-48c0-bd66-1c409e91bf5a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:39.951743 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0a98d334-0a48-475d-be4b-1f066cc18bb5 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:39.952366 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0a98d334-0a48-475d-be4b-1f066cc18bb5 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:39.952782 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0a98d334-0a48-475d-be4b-1f066cc18bb5 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:39.953641 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0a98d334-0a48-475d-be4b-1f066cc18bb5 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:39.954141 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0a98d334-0a48-475d-be4b-1f066cc18bb5 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:39.954570 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0a98d334-0a48-475d-be4b-1f066cc18bb5 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:39.970828 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-0a98d334-0a48-475d-be4b-1f066cc18bb5 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] HTTP exception thrown: Instance ce9f8f4c-9d4e-48c0-bd66-1c409e91bf5a could not be found. Aug 31 16:13:39.972693 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0a98d334-0a48-475d-be4b-1f066cc18bb5 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Request method failure captured: Aug 31 16:13:39.972693 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/ce9f8f4c-9d4e-48c0-bd66-1c409e91bf5a HTTP/1.1 Aug 31 16:13:39.972693 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:13:39.972693 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:13:39.972693 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:13:39.972693 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:13:39.972693 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:13:39.972693 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:13:39.972693 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:13:39.972693 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:13:39.972693 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4gQXSNpx7T-s6ANX8A4XIz6BgCizm9VWKy6e0KLRI2pxjPOEzPLkRnoXGF3D-Jh3OWl1h65DNjP8YomYmS0bGyt_8avVSC7qeEvUleLImq7o7EhFYQT7JAMgMioD10eCPOZ7QHRsEPDslLrPXcQD5t1iAsH1xyWK7dbpfjoYLGjDpU Aug 31 16:13:39.972693 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:13:39.972693 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:13:39.972693 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:13:39.972693 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:13:39.972693 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:13:39.972693 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:13:39.972693 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 5299955053c842b6aa02e058f4b1c0cb Aug 31 16:13:39.972693 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ServersTestJSON-1028152372 Aug 31 16:13:39.972693 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:13:39.972693 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:13:39.972693 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5299955053c842b6aa02e058f4b1c0cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5299955053c842b6aa02e058f4b1c0cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5299955053c842b6aa02e058f4b1c0cb", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5299955053c842b6aa02e058f4b1c0cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:13:39.972693 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ServersTestJSON-1028152372 Aug 31 16:13:39.972693 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 5299955053c842b6aa02e058f4b1c0cb Aug 31 16:13:39.972693 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ServersTestJSON-1028152372 Aug 31 16:13:39.972693 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ServersTestJSON-1028152372-project Aug 31 16:13:39.972693 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:13:39.972693 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:13:39.972693 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 6e707652819c497bbdf94f85f39c447a Aug 31 16:13:39.972693 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ServersTestJSON-1028152372-project Aug 31 16:13:39.972693 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:13:39.972693 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance ce9f8f4c-9d4e-48c0-bd66-1c409e91bf5a could not be found. Aug 31 16:13:39.972693 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': 'ce9f8f4c-9d4e-48c0-bd66-1c409e91bf5a'} Aug 31 16:13:39.972693 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:13:39.972693 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:39.972693 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:13:39.972693 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:13:39.972693 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:13:39.972693 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:13:39.972693 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:13:39.972693 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:13:39.972693 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:13:39.972693 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:13:39.972693 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce9f8f4c-9d4e-48c0-bd66-1c409e91bf5a could not be found. Aug 31 16:13:39.972693 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:13:39.972693 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:13:39.972693 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:13:39.972693 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:39.972693 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:13:39.972693 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:13:39.972693 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:13:39.972693 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:13:39.972693 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:13:39.972693 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:13:39.972693 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:13:39.972693 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:13:39.972693 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:13:39.972693 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:13:39.972693 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:13:39.972693 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:13:39.972693 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce9f8f4c-9d4e-48c0-bd66-1c409e91bf5a could not be found. Aug 31 16:13:39.972693 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:13:39.972693 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:13:39.972693 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:13:39.977212 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:39.977212 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:13:39.977212 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:13:39.977212 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:13:39.977212 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:13:39.977212 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce9f8f4c-9d4e-48c0-bd66-1c409e91bf5a could not be found. Aug 31 16:13:39.977212 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:13:39.977212 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0a98d334-0a48-475d-be4b-1f066cc18bb5 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Returning 404 to user: Instance ce9f8f4c-9d4e-48c0-bd66-1c409e91bf5a could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:13:39.977212 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0a98d334-0a48-475d-be4b-1f066cc18bb5 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/ce9f8f4c-9d4e-48c0-bd66-1c409e91bf5a" status: 404 len: 111 microversion: 2.1 time: 0.036988 Aug 31 16:13:39.978425 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1923/3838] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:39 2022] GET /compute/v2.1/servers/ce9f8f4c-9d4e-48c0-bd66-1c409e91bf5a => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 16:13:39.987572 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9d46d531-9bc2-4cdc-ab31-ccb1ea0145e3 tempest-FlavorsV2TestJSON-1219549133 tempest-FlavorsV2TestJSON-1219549133-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:39.993350 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9d46d531-9bc2-4cdc-ab31-ccb1ea0145e3 tempest-FlavorsV2TestJSON-1219549133 tempest-FlavorsV2TestJSON-1219549133-project] 10.222.0.61 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.161978 Aug 31 16:13:39.993977 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1916/3839] 10.222.0.61 () {58 vars in 1137 bytes} [Wed Aug 31 16:13:39 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:13:40.009820 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c29a7e32-e78d-4bc4-9cda-1062907db078 tempest-FlavorsV2TestJSON-1219549133 tempest-FlavorsV2TestJSON-1219549133-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:40.044929 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c29a7e32-e78d-4bc4-9cda-1062907db078 tempest-FlavorsV2TestJSON-1219549133 tempest-FlavorsV2TestJSON-1219549133-project] 10.222.0.61 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.039512 Aug 31 16:13:40.045817 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1924/3840] 10.222.0.61 () {58 vars in 1125 bytes} [Wed Aug 31 16:13:40 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:40.061128 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-de53247b-55de-4c01-8987-36ce6783fccc tempest-FlavorsV2TestJSON-1219549133 tempest-FlavorsV2TestJSON-1219549133-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:40.077738 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-de53247b-55de-4c01-8987-36ce6783fccc tempest-FlavorsV2TestJSON-1219549133 tempest-FlavorsV2TestJSON-1219549133-project] 10.222.0.61 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.020394 Aug 31 16:13:40.080577 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1917/3841] 10.222.0.61 () {58 vars in 1137 bytes} [Wed Aug 31 16:13:40 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:13:40.094781 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-45c9feb7-1ce2-4b94-8200-27a34ff65736 tempest-FlavorsV2TestJSON-1219549133 tempest-FlavorsV2TestJSON-1219549133-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:40.106612 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-45c9feb7-1ce2-4b94-8200-27a34ff65736 tempest-FlavorsV2TestJSON-1219549133 tempest-FlavorsV2TestJSON-1219549133-project] 10.222.0.61 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017031 Aug 31 16:13:40.108047 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1925/3842] 10.222.0.61 () {58 vars in 1137 bytes} [Wed Aug 31 16:13:40 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:13:40.123289 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8829f267-2314-4b4b-ad63-187267bf2323 tempest-FlavorsV2TestJSON-1219549133 tempest-FlavorsV2TestJSON-1219549133-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:40.137415 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-31dfd99d-01ea-46d3-bd3e-185326afb91b tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:40.145878 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-31dfd99d-01ea-46d3-bd3e-185326afb91b tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: c6bfb382-b9a8-4bf0-b868-ee5f51f9daac] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:40.177710 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-31dfd99d-01ea-46d3-bd3e-185326afb91b tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:40.180160 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-31dfd99d-01ea-46d3-bd3e-185326afb91b tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:40.182014 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-31dfd99d-01ea-46d3-bd3e-185326afb91b tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:40.184449 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-31dfd99d-01ea-46d3-bd3e-185326afb91b tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:40.188268 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-31dfd99d-01ea-46d3-bd3e-185326afb91b tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:40.189513 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-31dfd99d-01ea-46d3-bd3e-185326afb91b tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:40.192806 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8829f267-2314-4b4b-ad63-187267bf2323 tempest-FlavorsV2TestJSON-1219549133 tempest-FlavorsV2TestJSON-1219549133-project] 10.222.0.61 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.076539 Aug 31 16:13:40.193785 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1918/3843] 10.222.0.61 () {58 vars in 1165 bytes} [Wed Aug 31 16:13:40 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:40.204174 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e518f66f-20ad-4cbe-be9a-8834bec3f1af tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1139367248", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "networks": [{"uuid": "e418f255-318f-476c-a353-8d292b5f7798"}]}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:13:40.310361 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-e518f66f-20ad-4cbe-be9a-8834bec3f1af tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] validate_networks() for [('e418f255-318f-476c-a353-8d292b5f7798', None, None, None, None, None)] {{(pid=122256) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:13:40.596887 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-31dfd99d-01ea-46d3-bd3e-185326afb91b tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48ee960c38f4d0584ea5ce34579279f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a957b6585e74a31b5bc5f66441c33e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:40.615784 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-31dfd99d-01ea-46d3-bd3e-185326afb91b tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "GET /compute/v2.1/servers/c6bfb382-b9a8-4bf0-b868-ee5f51f9daac" status: 200 len: 1506 microversion: 2.1 time: 0.486425 Aug 31 16:13:40.616823 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1926/3844] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:40 2022] GET /compute/v2.1/servers/c6bfb382-b9a8-4bf0-b868-ee5f51f9daac => generated 1506 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:40.629713 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8d48fdaf-1801-4aa0-b42b-2506e9cb7efc tempest-FlavorsV2TestJSON-1219549133 tempest-FlavorsV2TestJSON-1219549133-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:40.657460 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8d48fdaf-1801-4aa0-b42b-2506e9cb7efc tempest-FlavorsV2TestJSON-1219549133 tempest-FlavorsV2TestJSON-1219549133-project] 10.222.0.61 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.037427 Aug 31 16:13:40.663197 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1927/3845] 10.222.0.61 () {58 vars in 1137 bytes} [Wed Aug 31 16:13:40 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:13:40.672894 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-92363436-1dcc-4537-9019-76a529b68e34 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:40.674492 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-92363436-1dcc-4537-9019-76a529b68e34 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] [instance: b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:40.682428 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-92363436-1dcc-4537-9019-76a529b68e34 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:40.682944 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-92363436-1dcc-4537-9019-76a529b68e34 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:40.683396 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-92363436-1dcc-4537-9019-76a529b68e34 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:40.684355 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-92363436-1dcc-4537-9019-76a529b68e34 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:40.684816 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-92363436-1dcc-4537-9019-76a529b68e34 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:40.685250 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-92363436-1dcc-4537-9019-76a529b68e34 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:41.048547 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-92363436-1dcc-4537-9019-76a529b68e34 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce4e5c281c4432782d96b94323cdcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0b14e6533a4396b15f9c08657d924f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:41.058886 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-92363436-1dcc-4537-9019-76a529b68e34 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] 10.222.0.61 "GET /compute/v2.1/servers/b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd" status: 200 len: 1316 microversion: 2.1 time: 0.397661 Aug 31 16:13:41.059478 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1928/3846] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:40 2022] GET /compute/v2.1/servers/b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd => generated 1316 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:41.065157 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-667e5bd9-eb3a-4c53-8ff5-be1eba57ebe8 req-3db4c2b4-64c7-492a-9564-7d1e92033333 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd", "name": "network-vif-plugged", "status": "completed", "tag": "1e0e4551-0c34-4d8d-ab3b-8543a1afdcca"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:13:41.076464 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-667e5bd9-eb3a-4c53-8ff5-be1eba57ebe8 req-3db4c2b4-64c7-492a-9564-7d1e92033333 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:41.076862 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-667e5bd9-eb3a-4c53-8ff5-be1eba57ebe8 req-3db4c2b4-64c7-492a-9564-7d1e92033333 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:41.077296 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-667e5bd9-eb3a-4c53-8ff5-be1eba57ebe8 req-3db4c2b4-64c7-492a-9564-7d1e92033333 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:41.089644 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-667e5bd9-eb3a-4c53-8ff5-be1eba57ebe8 req-3db4c2b4-64c7-492a-9564-7d1e92033333 service nova] Creating event network-vif-plugged:1e0e4551-0c34-4d8d-ab3b-8543a1afdcca for instance b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd on n-h2-850499-9 Aug 31 16:13:41.095940 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-667e5bd9-eb3a-4c53-8ff5-be1eba57ebe8 req-3db4c2b4-64c7-492a-9564-7d1e92033333 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034939 Aug 31 16:13:41.097046 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1929/3847] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:13:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:13:41.102716 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e316ec7a-6011-4c32-aa4f-9d7dcda8d8ea tempest-FlavorsV2TestJSON-1219549133 tempest-FlavorsV2TestJSON-1219549133-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:41.129448 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e316ec7a-6011-4c32-aa4f-9d7dcda8d8ea tempest-FlavorsV2TestJSON-1219549133 tempest-FlavorsV2TestJSON-1219549133-project] 10.222.0.61 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.031127 Aug 31 16:13:41.130195 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1930/3848] 10.222.0.61 () {58 vars in 1169 bytes} [Wed Aug 31 16:13:41 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:41.135093 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d85d737a-c115-441a-a8fe-8548d71b4c04 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:41.135904 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d85d737a-c115-441a-a8fe-8548d71b4c04 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] [instance: 18dc9f32-b72a-4f4f-9153-a6a54f9d21b8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:41.144680 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d85d737a-c115-441a-a8fe-8548d71b4c04 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:41.145363 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d85d737a-c115-441a-a8fe-8548d71b4c04 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:41.146064 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d85d737a-c115-441a-a8fe-8548d71b4c04 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:41.147253 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d85d737a-c115-441a-a8fe-8548d71b4c04 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:41.148168 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d85d737a-c115-441a-a8fe-8548d71b4c04 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:41.149171 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d85d737a-c115-441a-a8fe-8548d71b4c04 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:41.226582 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-e518f66f-20ad-4cbe-be9a-8834bec3f1af tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:13:41.227229 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-e518f66f-20ad-4cbe-be9a-8834bec3f1af tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:13:41.227787 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-e518f66f-20ad-4cbe-be9a-8834bec3f1af tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:13:41.228456 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-e518f66f-20ad-4cbe-be9a-8834bec3f1af tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:13:41.228987 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-e518f66f-20ad-4cbe-be9a-8834bec3f1af tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:13:41.240455 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e518f66f-20ad-4cbe-be9a-8834bec3f1af tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:41.241107 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e518f66f-20ad-4cbe-be9a-8834bec3f1af tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:41.241795 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e518f66f-20ad-4cbe-be9a-8834bec3f1af tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:41.242859 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e518f66f-20ad-4cbe-be9a-8834bec3f1af tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:41.243650 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e518f66f-20ad-4cbe-be9a-8834bec3f1af tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:41.244224 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e518f66f-20ad-4cbe-be9a-8834bec3f1af tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:41.264357 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-e518f66f-20ad-4cbe-be9a-8834bec3f1af tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Getting quotas for project 5299955053c842b6aa02e058f4b1c0cb. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:13:41.271045 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-e518f66f-20ad-4cbe-be9a-8834bec3f1af tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Getting quotas for user 6e707652819c497bbdf94f85f39c447a and project 5299955053c842b6aa02e058f4b1c0cb. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:13:41.288931 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e518f66f-20ad-4cbe-be9a-8834bec3f1af tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Going to run 1 instances... {{(pid=122256) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:13:41.291296 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e518f66f-20ad-4cbe-be9a-8834bec3f1af tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 73b19398-0c2c-42ea-8b4a-86e223c090ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:13:41.347770 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e518f66f-20ad-4cbe-be9a-8834bec3f1af tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.151459 Aug 31 16:13:41.354082 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1919/3849] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:13:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1154 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:13:41.354082 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-9d308dec-8886-4d0c-8174-f38b7fd3d5f0 req-3b4770f9-777c-4d86-bc33-0813e89b9b35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18dc9f32-b72a-4f4f-9153-a6a54f9d21b8", "tag": "02a0fc93-d351-4671-91b7-b1c1440a5fc6"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:13:41.366673 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-9d308dec-8886-4d0c-8174-f38b7fd3d5f0 req-3b4770f9-777c-4d86-bc33-0813e89b9b35 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:41.367165 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-9d308dec-8886-4d0c-8174-f38b7fd3d5f0 req-3b4770f9-777c-4d86-bc33-0813e89b9b35 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:41.367650 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-9d308dec-8886-4d0c-8174-f38b7fd3d5f0 req-3b4770f9-777c-4d86-bc33-0813e89b9b35 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:41.393242 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-9d308dec-8886-4d0c-8174-f38b7fd3d5f0 req-3b4770f9-777c-4d86-bc33-0813e89b9b35 service nova] Creating event network-changed:02a0fc93-d351-4671-91b7-b1c1440a5fc6 for instance 18dc9f32-b72a-4f4f-9153-a6a54f9d21b8 on n-h2-850499-9 Aug 31 16:13:41.402913 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-9d308dec-8886-4d0c-8174-f38b7fd3d5f0 req-3b4770f9-777c-4d86-bc33-0813e89b9b35 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053003 Aug 31 16:13:41.403910 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1920/3850] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:13:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:13:41.410496 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-69838440-a420-425e-a4c6-544ad46ea520 tempest-FlavorsV2TestJSON-1219549133 tempest-FlavorsV2TestJSON-1219549133-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:41.430677 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-69838440-a420-425e-a4c6-544ad46ea520 tempest-FlavorsV2TestJSON-1219549133 tempest-FlavorsV2TestJSON-1219549133-project] 10.222.0.61 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.025112 Aug 31 16:13:41.431940 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1921/3851] 10.222.0.61 () {58 vars in 1161 bytes} [Wed Aug 31 16:13:41 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:13:41.460004 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-328f7f67-8145-41dd-88b2-ae6a2ffd4aa8 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:41.461681 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-328f7f67-8145-41dd-88b2-ae6a2ffd4aa8 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 73b19398-0c2c-42ea-8b4a-86e223c090ff] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:41.797427 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-328f7f67-8145-41dd-88b2-ae6a2ffd4aa8 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:41.807861 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-328f7f67-8145-41dd-88b2-ae6a2ffd4aa8 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/73b19398-0c2c-42ea-8b4a-86e223c090ff" status: 200 len: 1209 microversion: 2.1 time: 0.373544 Aug 31 16:13:41.808686 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1922/3852] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:41 2022] GET /compute/v2.1/servers/73b19398-0c2c-42ea-8b4a-86e223c090ff => generated 1209 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:41.827455 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-82067094-738c-4f41-9332-a59897922618 tempest-FlavorsV2TestJSON-1219549133 tempest-FlavorsV2TestJSON-1219549133-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:41.839397 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-82067094-738c-4f41-9332-a59897922618 tempest-FlavorsV2TestJSON-1219549133 tempest-FlavorsV2TestJSON-1219549133-project] 10.222.0.61 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018384 Aug 31 16:13:41.843268 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d85d737a-c115-441a-a8fe-8548d71b4c04 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f911026e35d40a480094376c6556d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f66705b4a0f4711ba14d9ceb5699bd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:41.847179 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1923/3853] 10.222.0.61 () {58 vars in 1137 bytes} [Wed Aug 31 16:13:41 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:13:41.859912 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d85d737a-c115-441a-a8fe-8548d71b4c04 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] 10.222.0.61 "GET /compute/v2.1/servers/18dc9f32-b72a-4f4f-9153-a6a54f9d21b8" status: 200 len: 1316 microversion: 2.1 time: 0.728465 Aug 31 16:13:41.860843 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1931/3854] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:41 2022] GET /compute/v2.1/servers/18dc9f32-b72a-4f4f-9153-a6a54f9d21b8 => generated 1316 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:41.866603 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c4bdbf40-17b1-4f3f-92a0-0d19140f898c tempest-FlavorsV2TestJSON-1219549133 tempest-FlavorsV2TestJSON-1219549133-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:41.885793 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7c58b1d4-5c8d-4416-a30e-e813f1f3d115 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:41.886558 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7c58b1d4-5c8d-4416-a30e-e813f1f3d115 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: c6bfb382-b9a8-4bf0-b868-ee5f51f9daac] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:41.904417 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7c58b1d4-5c8d-4416-a30e-e813f1f3d115 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:41.904953 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7c58b1d4-5c8d-4416-a30e-e813f1f3d115 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:41.905404 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7c58b1d4-5c8d-4416-a30e-e813f1f3d115 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:41.906153 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7c58b1d4-5c8d-4416-a30e-e813f1f3d115 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:41.906684 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7c58b1d4-5c8d-4416-a30e-e813f1f3d115 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:41.907187 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7c58b1d4-5c8d-4416-a30e-e813f1f3d115 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:41.927997 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c4bdbf40-17b1-4f3f-92a0-0d19140f898c tempest-FlavorsV2TestJSON-1219549133 tempest-FlavorsV2TestJSON-1219549133-project] 10.222.0.61 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.065797 Aug 31 16:13:41.929311 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1932/3855] 10.222.0.61 () {58 vars in 1167 bytes} [Wed Aug 31 16:13:41 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:41.952894 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-010c3956-3019-4b04-a8d3-571d9c07a84b tempest-FlavorsV2TestJSON-1219549133 tempest-FlavorsV2TestJSON-1219549133-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:41.977083 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-010c3956-3019-4b04-a8d3-571d9c07a84b tempest-FlavorsV2TestJSON-1219549133 tempest-FlavorsV2TestJSON-1219549133-project] 10.222.0.61 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.028013 Aug 31 16:13:41.977815 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1933/3856] 10.222.0.61 () {58 vars in 1137 bytes} [Wed Aug 31 16:13:41 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:13:41.994854 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c3aeb609-8cbd-4cf6-87d2-10377ae8f89b tempest-FlavorsV2TestJSON-1219549133 tempest-FlavorsV2TestJSON-1219549133-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:42.024810 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c3aeb609-8cbd-4cf6-87d2-10377ae8f89b tempest-FlavorsV2TestJSON-1219549133 tempest-FlavorsV2TestJSON-1219549133-project] 10.222.0.61 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.035171 Aug 31 16:13:42.025694 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1934/3857] 10.222.0.61 () {58 vars in 1144 bytes} [Wed Aug 31 16:13:41 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:13:42.041476 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c299bb83-e780-4529-bbb4-fe639aea5e53 tempest-FlavorsV2TestJSON-1219549133 tempest-FlavorsV2TestJSON-1219549133-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:42.051761 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c299bb83-e780-4529-bbb4-fe639aea5e53 tempest-FlavorsV2TestJSON-1219549133 tempest-FlavorsV2TestJSON-1219549133-project] 10.222.0.61 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015038 Aug 31 16:13:42.060047 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1935/3858] 10.222.0.61 () {58 vars in 1137 bytes} [Wed Aug 31 16:13:42 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:13:42.065856 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-37a8d1dc-6980-4f46-9927-6c69189c1461 tempest-FlavorsV2TestJSON-1219549133 tempest-FlavorsV2TestJSON-1219549133-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:42.090633 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7c58b1d4-5c8d-4416-a30e-e813f1f3d115 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48ee960c38f4d0584ea5ce34579279f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a957b6585e74a31b5bc5f66441c33e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:42.092716 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-37a8d1dc-6980-4f46-9927-6c69189c1461 tempest-FlavorsV2TestJSON-1219549133 tempest-FlavorsV2TestJSON-1219549133-project] 10.222.0.61 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.031051 Aug 31 16:13:42.094302 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1936/3859] 10.222.0.61 () {58 vars in 1148 bytes} [Wed Aug 31 16:13:42 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:42.104348 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7c58b1d4-5c8d-4416-a30e-e813f1f3d115 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "GET /compute/v2.1/servers/c6bfb382-b9a8-4bf0-b868-ee5f51f9daac" status: 200 len: 1506 microversion: 2.1 time: 0.243711 Aug 31 16:13:42.105054 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1924/3860] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:41 2022] GET /compute/v2.1/servers/c6bfb382-b9a8-4bf0-b868-ee5f51f9daac => generated 1506 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:42.107277 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-eafcd640-65d9-4ba9-84bd-2ad36f5805a8 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:42.108478 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-eafcd640-65d9-4ba9-84bd-2ad36f5805a8 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] [instance: b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:42.111979 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a7d74e98-71c2-422b-9a8a-8effddd1a85a tempest-FlavorsV2TestJSON-1219549133 tempest-FlavorsV2TestJSON-1219549133-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:42.117964 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eafcd640-65d9-4ba9-84bd-2ad36f5805a8 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:42.118700 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eafcd640-65d9-4ba9-84bd-2ad36f5805a8 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:42.119304 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eafcd640-65d9-4ba9-84bd-2ad36f5805a8 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:42.120609 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eafcd640-65d9-4ba9-84bd-2ad36f5805a8 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:42.121585 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eafcd640-65d9-4ba9-84bd-2ad36f5805a8 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:42.121801 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eafcd640-65d9-4ba9-84bd-2ad36f5805a8 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:42.126875 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a7d74e98-71c2-422b-9a8a-8effddd1a85a tempest-FlavorsV2TestJSON-1219549133 tempest-FlavorsV2TestJSON-1219549133-project] 10.222.0.61 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.020473 Aug 31 16:13:42.127410 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1925/3861] 10.222.0.61 () {58 vars in 1140 bytes} [Wed Aug 31 16:13:42 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:13:42.141064 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1a29e07b-5e5d-4405-b565-ce389f4b8b0b tempest-FlavorsV2TestJSON-1219549133 tempest-FlavorsV2TestJSON-1219549133-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:42.151082 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1a29e07b-5e5d-4405-b565-ce389f4b8b0b tempest-FlavorsV2TestJSON-1219549133 tempest-FlavorsV2TestJSON-1219549133-project] 10.222.0.61 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014289 Aug 31 16:13:42.152202 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1926/3862] 10.222.0.61 () {58 vars in 1137 bytes} [Wed Aug 31 16:13:42 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:13:42.164962 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d3c9db88-bcf0-49bf-85d8-5b0e6c382f55 tempest-FlavorsV2TestJSON-1219549133 tempest-FlavorsV2TestJSON-1219549133-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:42.213887 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d3c9db88-bcf0-49bf-85d8-5b0e6c382f55 tempest-FlavorsV2TestJSON-1219549133 tempest-FlavorsV2TestJSON-1219549133-project] 10.222.0.61 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.053630 Aug 31 16:13:42.225805 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1927/3863] 10.222.0.61 () {58 vars in 1146 bytes} [Wed Aug 31 16:13:42 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:13:42.232292 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-70dd3b4f-f9ea-409d-8f97-d3587ee97d1f tempest-FlavorsV2TestJSON-1219549133 tempest-FlavorsV2TestJSON-1219549133-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:42.258177 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-70dd3b4f-f9ea-409d-8f97-d3587ee97d1f tempest-FlavorsV2TestJSON-1219549133 tempest-FlavorsV2TestJSON-1219549133-project] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.030587 Aug 31 16:13:42.259105 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1928/3864] 10.222.0.61 () {58 vars in 1146 bytes} [Wed Aug 31 16:13:42 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:42.277637 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4cbe4cfd-fe76-4d22-9be1-0c48dc92a135 tempest-FlavorsV2TestJSON-1219549133 tempest-FlavorsV2TestJSON-1219549133-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:42.293661 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4cbe4cfd-fe76-4d22-9be1-0c48dc92a135 tempest-FlavorsV2TestJSON-1219549133 tempest-FlavorsV2TestJSON-1219549133-project] 10.222.0.61 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.019434 Aug 31 16:13:42.299714 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1929/3865] 10.222.0.61 () {58 vars in 1137 bytes} [Wed Aug 31 16:13:42 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:13:42.330567 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-eafcd640-65d9-4ba9-84bd-2ad36f5805a8 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce4e5c281c4432782d96b94323cdcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0b14e6533a4396b15f9c08657d924f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:42.341739 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-eafcd640-65d9-4ba9-84bd-2ad36f5805a8 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] 10.222.0.61 "GET /compute/v2.1/servers/b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd" status: 200 len: 1316 microversion: 2.1 time: 0.245344 Aug 31 16:13:42.342350 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1937/3866] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:42 2022] GET /compute/v2.1/servers/b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd => generated 1316 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:42.833362 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f029b18d-aa8e-4394-9db4-feed1ca47a00 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:42.834450 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f029b18d-aa8e-4394-9db4-feed1ca47a00 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 73b19398-0c2c-42ea-8b4a-86e223c090ff] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:42.842053 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f029b18d-aa8e-4394-9db4-feed1ca47a00 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:42.843131 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f029b18d-aa8e-4394-9db4-feed1ca47a00 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:42.844113 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f029b18d-aa8e-4394-9db4-feed1ca47a00 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:42.845160 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f029b18d-aa8e-4394-9db4-feed1ca47a00 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:42.846386 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f029b18d-aa8e-4394-9db4-feed1ca47a00 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:42.848327 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f029b18d-aa8e-4394-9db4-feed1ca47a00 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:42.897664 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-98dfcbfc-ea02-4c11-bd64-e733909215a8 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:42.902116 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-98dfcbfc-ea02-4c11-bd64-e733909215a8 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] [instance: 18dc9f32-b72a-4f4f-9153-a6a54f9d21b8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:42.912974 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-98dfcbfc-ea02-4c11-bd64-e733909215a8 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:42.913911 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-98dfcbfc-ea02-4c11-bd64-e733909215a8 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:42.914613 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-98dfcbfc-ea02-4c11-bd64-e733909215a8 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:42.916000 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-98dfcbfc-ea02-4c11-bd64-e733909215a8 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:42.916801 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-98dfcbfc-ea02-4c11-bd64-e733909215a8 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:42.917505 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-98dfcbfc-ea02-4c11-bd64-e733909215a8 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:42.996114 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f029b18d-aa8e-4394-9db4-feed1ca47a00 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:43.018012 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f029b18d-aa8e-4394-9db4-feed1ca47a00 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/73b19398-0c2c-42ea-8b4a-86e223c090ff" status: 200 len: 1269 microversion: 2.1 time: 0.188006 Aug 31 16:13:43.019874 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1930/3867] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:42 2022] GET /compute/v2.1/servers/73b19398-0c2c-42ea-8b4a-86e223c090ff => generated 1269 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:43.132754 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2fae322b-9faa-43d8-a0fc-5e8f1a7bd1af tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:43.134385 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2fae322b-9faa-43d8-a0fc-5e8f1a7bd1af tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: c6bfb382-b9a8-4bf0-b868-ee5f51f9daac] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:43.150716 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2fae322b-9faa-43d8-a0fc-5e8f1a7bd1af tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:43.151631 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2fae322b-9faa-43d8-a0fc-5e8f1a7bd1af tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:43.153154 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2fae322b-9faa-43d8-a0fc-5e8f1a7bd1af tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:43.155366 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2fae322b-9faa-43d8-a0fc-5e8f1a7bd1af tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:43.158338 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2fae322b-9faa-43d8-a0fc-5e8f1a7bd1af tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:43.160021 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2fae322b-9faa-43d8-a0fc-5e8f1a7bd1af tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:43.260063 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-98dfcbfc-ea02-4c11-bd64-e733909215a8 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f911026e35d40a480094376c6556d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f66705b4a0f4711ba14d9ceb5699bd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:43.277403 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-98dfcbfc-ea02-4c11-bd64-e733909215a8 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] 10.222.0.61 "GET /compute/v2.1/servers/18dc9f32-b72a-4f4f-9153-a6a54f9d21b8" status: 200 len: 1316 microversion: 2.1 time: 0.390609 Aug 31 16:13:43.278613 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1938/3868] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:42 2022] GET /compute/v2.1/servers/18dc9f32-b72a-4f4f-9153-a6a54f9d21b8 => generated 1316 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:13:43.376112 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d2a39ea8-1d69-41c2-99e8-09365fcf6f46 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:43.377315 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d2a39ea8-1d69-41c2-99e8-09365fcf6f46 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] [instance: b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:43.385862 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d2a39ea8-1d69-41c2-99e8-09365fcf6f46 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:43.386525 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d2a39ea8-1d69-41c2-99e8-09365fcf6f46 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:43.387307 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d2a39ea8-1d69-41c2-99e8-09365fcf6f46 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:43.401054 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d2a39ea8-1d69-41c2-99e8-09365fcf6f46 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:43.401463 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d2a39ea8-1d69-41c2-99e8-09365fcf6f46 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:43.401971 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d2a39ea8-1d69-41c2-99e8-09365fcf6f46 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:43.499116 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-2fae322b-9faa-43d8-a0fc-5e8f1a7bd1af tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48ee960c38f4d0584ea5ce34579279f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a957b6585e74a31b5bc5f66441c33e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:43.512636 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2fae322b-9faa-43d8-a0fc-5e8f1a7bd1af tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "GET /compute/v2.1/servers/c6bfb382-b9a8-4bf0-b868-ee5f51f9daac" status: 200 len: 1506 microversion: 2.1 time: 0.388333 Aug 31 16:13:43.513675 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1931/3869] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:43 2022] GET /compute/v2.1/servers/c6bfb382-b9a8-4bf0-b868-ee5f51f9daac => generated 1506 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:43.670877 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d2a39ea8-1d69-41c2-99e8-09365fcf6f46 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce4e5c281c4432782d96b94323cdcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0b14e6533a4396b15f9c08657d924f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:43.684359 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d2a39ea8-1d69-41c2-99e8-09365fcf6f46 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] 10.222.0.61 "GET /compute/v2.1/servers/b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd" status: 200 len: 1316 microversion: 2.1 time: 0.314077 Aug 31 16:13:43.686483 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1939/3870] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:43 2022] GET /compute/v2.1/servers/b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd => generated 1316 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:44.059913 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4ac31d37-e3b6-4c1e-bac7-355c36ac5b70 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:44.062498 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4ac31d37-e3b6-4c1e-bac7-355c36ac5b70 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 73b19398-0c2c-42ea-8b4a-86e223c090ff] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:44.092164 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4ac31d37-e3b6-4c1e-bac7-355c36ac5b70 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:44.095893 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4ac31d37-e3b6-4c1e-bac7-355c36ac5b70 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:44.097520 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4ac31d37-e3b6-4c1e-bac7-355c36ac5b70 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:44.098482 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4ac31d37-e3b6-4c1e-bac7-355c36ac5b70 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:44.098965 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4ac31d37-e3b6-4c1e-bac7-355c36ac5b70 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:44.099404 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4ac31d37-e3b6-4c1e-bac7-355c36ac5b70 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:44.308991 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-985cd36b-316b-4287-ada2-47ea684a587e tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:44.310298 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-985cd36b-316b-4287-ada2-47ea684a587e tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] [instance: 18dc9f32-b72a-4f4f-9153-a6a54f9d21b8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:44.344733 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-4ac31d37-e3b6-4c1e-bac7-355c36ac5b70 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:44.353246 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-985cd36b-316b-4287-ada2-47ea684a587e tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:44.355113 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-985cd36b-316b-4287-ada2-47ea684a587e tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:44.356994 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4ac31d37-e3b6-4c1e-bac7-355c36ac5b70 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/73b19398-0c2c-42ea-8b4a-86e223c090ff" status: 200 len: 1309 microversion: 2.1 time: 0.314043 Aug 31 16:13:44.357679 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-985cd36b-316b-4287-ada2-47ea684a587e tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:44.358764 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-985cd36b-316b-4287-ada2-47ea684a587e tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:44.359402 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-985cd36b-316b-4287-ada2-47ea684a587e tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:44.360804 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-985cd36b-316b-4287-ada2-47ea684a587e tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:44.361208 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1932/3871] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:44 2022] GET /compute/v2.1/servers/73b19398-0c2c-42ea-8b4a-86e223c090ff => generated 1309 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:44.371098 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=100 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:13:44.542445 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d0d394a2-1199-4a4a-8404-ea5e920e9601 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:44.543067 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d0d394a2-1199-4a4a-8404-ea5e920e9601 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: c6bfb382-b9a8-4bf0-b868-ee5f51f9daac] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:44.562691 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d0d394a2-1199-4a4a-8404-ea5e920e9601 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:44.563238 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d0d394a2-1199-4a4a-8404-ea5e920e9601 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:44.563717 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d0d394a2-1199-4a4a-8404-ea5e920e9601 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:44.568739 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d0d394a2-1199-4a4a-8404-ea5e920e9601 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:44.569272 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d0d394a2-1199-4a4a-8404-ea5e920e9601 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:44.569676 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d0d394a2-1199-4a4a-8404-ea5e920e9601 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:44.582880 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-985cd36b-316b-4287-ada2-47ea684a587e tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f911026e35d40a480094376c6556d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f66705b4a0f4711ba14d9ceb5699bd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:44.592907 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-985cd36b-316b-4287-ada2-47ea684a587e tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] 10.222.0.61 "GET /compute/v2.1/servers/18dc9f32-b72a-4f4f-9153-a6a54f9d21b8" status: 200 len: 1316 microversion: 2.1 time: 0.293298 Aug 31 16:13:44.608141 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1940/3872] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:44 2022] GET /compute/v2.1/servers/18dc9f32-b72a-4f4f-9153-a6a54f9d21b8 => generated 1316 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:44.711693 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-489bbb55-5a7d-451d-bf8f-1872eaafe7d2 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:44.712507 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-489bbb55-5a7d-451d-bf8f-1872eaafe7d2 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] [instance: b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:44.721484 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-489bbb55-5a7d-451d-bf8f-1872eaafe7d2 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:44.723195 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-489bbb55-5a7d-451d-bf8f-1872eaafe7d2 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:44.723702 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-489bbb55-5a7d-451d-bf8f-1872eaafe7d2 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:44.725167 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-489bbb55-5a7d-451d-bf8f-1872eaafe7d2 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:44.726380 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-489bbb55-5a7d-451d-bf8f-1872eaafe7d2 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:44.726825 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-489bbb55-5a7d-451d-bf8f-1872eaafe7d2 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:44.801972 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d0d394a2-1199-4a4a-8404-ea5e920e9601 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48ee960c38f4d0584ea5ce34579279f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a957b6585e74a31b5bc5f66441c33e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:44.811209 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:13:44.818679 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d0d394a2-1199-4a4a-8404-ea5e920e9601 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "GET /compute/v2.1/servers/c6bfb382-b9a8-4bf0-b868-ee5f51f9daac" status: 200 len: 1506 microversion: 2.1 time: 0.281481 Aug 31 16:13:44.820756 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1933/3873] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:44 2022] GET /compute/v2.1/servers/c6bfb382-b9a8-4bf0-b868-ee5f51f9daac => generated 1506 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:44.937403 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-489bbb55-5a7d-451d-bf8f-1872eaafe7d2 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce4e5c281c4432782d96b94323cdcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0b14e6533a4396b15f9c08657d924f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:44.948158 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-489bbb55-5a7d-451d-bf8f-1872eaafe7d2 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] 10.222.0.61 "GET /compute/v2.1/servers/b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd" status: 200 len: 1316 microversion: 2.1 time: 0.244562 Aug 31 16:13:44.949412 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1941/3874] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:44 2022] GET /compute/v2.1/servers/b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd => generated 1316 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:45.321360 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-a06d0c30-c02f-496e-9a1a-b7365f5916c3 req-1df39bea-cfa2-44e9-b6f7-4f8058bf2e12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73b19398-0c2c-42ea-8b4a-86e223c090ff", "tag": "3d8c281c-2a4b-431f-87ce-34a3fa52e6c4"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:13:45.332991 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-a06d0c30-c02f-496e-9a1a-b7365f5916c3 req-1df39bea-cfa2-44e9-b6f7-4f8058bf2e12 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:45.333500 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-a06d0c30-c02f-496e-9a1a-b7365f5916c3 req-1df39bea-cfa2-44e9-b6f7-4f8058bf2e12 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:45.333974 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-a06d0c30-c02f-496e-9a1a-b7365f5916c3 req-1df39bea-cfa2-44e9-b6f7-4f8058bf2e12 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:45.359833 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-a06d0c30-c02f-496e-9a1a-b7365f5916c3 req-1df39bea-cfa2-44e9-b6f7-4f8058bf2e12 service nova] Creating event network-changed:3d8c281c-2a4b-431f-87ce-34a3fa52e6c4 for instance 73b19398-0c2c-42ea-8b4a-86e223c090ff on n-h1-850499-9 Aug 31 16:13:45.369352 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-a06d0c30-c02f-496e-9a1a-b7365f5916c3 req-1df39bea-cfa2-44e9-b6f7-4f8058bf2e12 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051952 Aug 31 16:13:45.370441 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1934/3875] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:13:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:13:45.388950 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5121f7c5-dcb3-4572-b1c8-e365b0571ffb tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:45.390105 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5121f7c5-dcb3-4572-b1c8-e365b0571ffb tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 73b19398-0c2c-42ea-8b4a-86e223c090ff] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:45.398501 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:13:45.410162 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5121f7c5-dcb3-4572-b1c8-e365b0571ffb tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:45.411458 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5121f7c5-dcb3-4572-b1c8-e365b0571ffb tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:45.412536 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5121f7c5-dcb3-4572-b1c8-e365b0571ffb tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:45.413842 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5121f7c5-dcb3-4572-b1c8-e365b0571ffb tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:45.416563 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5121f7c5-dcb3-4572-b1c8-e365b0571ffb tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:45.417660 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5121f7c5-dcb3-4572-b1c8-e365b0571ffb tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:45.600089 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:13:45.633732 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-07eaf2d9-166c-4871-8f05-15e98495fdb0 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:45.635106 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-07eaf2d9-166c-4871-8f05-15e98495fdb0 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] [instance: 18dc9f32-b72a-4f4f-9153-a6a54f9d21b8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:45.642761 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-07eaf2d9-166c-4871-8f05-15e98495fdb0 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:45.644229 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-07eaf2d9-166c-4871-8f05-15e98495fdb0 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:45.644858 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-07eaf2d9-166c-4871-8f05-15e98495fdb0 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:45.646024 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-07eaf2d9-166c-4871-8f05-15e98495fdb0 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:45.646956 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-07eaf2d9-166c-4871-8f05-15e98495fdb0 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:45.647585 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-07eaf2d9-166c-4871-8f05-15e98495fdb0 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:45.665186 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5121f7c5-dcb3-4572-b1c8-e365b0571ffb tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:45.682687 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5121f7c5-dcb3-4572-b1c8-e365b0571ffb tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/73b19398-0c2c-42ea-8b4a-86e223c090ff" status: 200 len: 1309 microversion: 2.1 time: 0.302767 Aug 31 16:13:45.686818 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1942/3876] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:45 2022] GET /compute/v2.1/servers/73b19398-0c2c-42ea-8b4a-86e223c090ff => generated 1309 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:45.842474 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-93895372-e380-4fdc-b9e5-e3ca58ff0d5b tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:45.842739 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-93895372-e380-4fdc-b9e5-e3ca58ff0d5b tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: c6bfb382-b9a8-4bf0-b868-ee5f51f9daac] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:45.851151 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-93895372-e380-4fdc-b9e5-e3ca58ff0d5b tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:45.852542 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-93895372-e380-4fdc-b9e5-e3ca58ff0d5b tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:45.853039 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-93895372-e380-4fdc-b9e5-e3ca58ff0d5b tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:45.853779 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-93895372-e380-4fdc-b9e5-e3ca58ff0d5b tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:45.854619 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-93895372-e380-4fdc-b9e5-e3ca58ff0d5b tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:45.855227 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-93895372-e380-4fdc-b9e5-e3ca58ff0d5b tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:45.949336 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=8 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:13:46.022334 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-07eaf2d9-166c-4871-8f05-15e98495fdb0 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f911026e35d40a480094376c6556d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f66705b4a0f4711ba14d9ceb5699bd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:46.035306 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-07eaf2d9-166c-4871-8f05-15e98495fdb0 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] 10.222.0.61 "GET /compute/v2.1/servers/18dc9f32-b72a-4f4f-9153-a6a54f9d21b8" status: 200 len: 1316 microversion: 2.1 time: 0.419667 Aug 31 16:13:46.036410 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1935/3877] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:45 2022] GET /compute/v2.1/servers/18dc9f32-b72a-4f4f-9153-a6a54f9d21b8 => generated 1316 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:46.045061 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c3f31a59-c708-4c3a-9c11-0ab51b141b7a tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:46.046904 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c3f31a59-c708-4c3a-9c11-0ab51b141b7a tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] [instance: b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:46.069597 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c3f31a59-c708-4c3a-9c11-0ab51b141b7a tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:46.070885 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c3f31a59-c708-4c3a-9c11-0ab51b141b7a tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:46.072026 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c3f31a59-c708-4c3a-9c11-0ab51b141b7a tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:46.073452 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c3f31a59-c708-4c3a-9c11-0ab51b141b7a tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:46.074662 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c3f31a59-c708-4c3a-9c11-0ab51b141b7a tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:46.075710 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c3f31a59-c708-4c3a-9c11-0ab51b141b7a tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:46.128766 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-93895372-e380-4fdc-b9e5-e3ca58ff0d5b tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48ee960c38f4d0584ea5ce34579279f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a957b6585e74a31b5bc5f66441c33e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:46.172011 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-93895372-e380-4fdc-b9e5-e3ca58ff0d5b tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "GET /compute/v2.1/servers/c6bfb382-b9a8-4bf0-b868-ee5f51f9daac" status: 200 len: 1506 microversion: 2.1 time: 0.326809 Aug 31 16:13:46.183923 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1943/3878] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:45 2022] GET /compute/v2.1/servers/c6bfb382-b9a8-4bf0-b868-ee5f51f9daac => generated 1506 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:46.394767 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c3f31a59-c708-4c3a-9c11-0ab51b141b7a tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce4e5c281c4432782d96b94323cdcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0b14e6533a4396b15f9c08657d924f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:46.402935 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c3f31a59-c708-4c3a-9c11-0ab51b141b7a tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] 10.222.0.61 "GET /compute/v2.1/servers/b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd" status: 200 len: 1316 microversion: 2.1 time: 0.364685 Aug 31 16:13:46.403521 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1936/3879] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:46 2022] GET /compute/v2.1/servers/b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd => generated 1316 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:46.717375 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e38b0d26-7ce1-4165-8cf4-c44c1f8da91e tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:46.718138 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e38b0d26-7ce1-4165-8cf4-c44c1f8da91e tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 73b19398-0c2c-42ea-8b4a-86e223c090ff] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:46.728084 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e38b0d26-7ce1-4165-8cf4-c44c1f8da91e tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:46.728663 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e38b0d26-7ce1-4165-8cf4-c44c1f8da91e tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:46.729106 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e38b0d26-7ce1-4165-8cf4-c44c1f8da91e tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:46.729874 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e38b0d26-7ce1-4165-8cf4-c44c1f8da91e tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:46.730557 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e38b0d26-7ce1-4165-8cf4-c44c1f8da91e tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:46.731457 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e38b0d26-7ce1-4165-8cf4-c44c1f8da91e tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:46.977444 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e38b0d26-7ce1-4165-8cf4-c44c1f8da91e tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:46.988889 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e38b0d26-7ce1-4165-8cf4-c44c1f8da91e tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/73b19398-0c2c-42ea-8b4a-86e223c090ff" status: 200 len: 1309 microversion: 2.1 time: 0.275892 Aug 31 16:13:46.989798 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1944/3880] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:46 2022] GET /compute/v2.1/servers/73b19398-0c2c-42ea-8b4a-86e223c090ff => generated 1309 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:47.072054 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6141cf46-7c76-475c-aad5-4fb09e60606b tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:47.073441 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6141cf46-7c76-475c-aad5-4fb09e60606b tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] [instance: 18dc9f32-b72a-4f4f-9153-a6a54f9d21b8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:47.105897 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6141cf46-7c76-475c-aad5-4fb09e60606b tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:47.106689 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6141cf46-7c76-475c-aad5-4fb09e60606b tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:47.107241 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6141cf46-7c76-475c-aad5-4fb09e60606b tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:47.108341 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6141cf46-7c76-475c-aad5-4fb09e60606b tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:47.110286 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6141cf46-7c76-475c-aad5-4fb09e60606b tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:47.110849 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6141cf46-7c76-475c-aad5-4fb09e60606b tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:47.218023 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-bdc79937-7d5f-437c-9b72-65f51e1599ba tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:47.220859 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-bdc79937-7d5f-437c-9b72-65f51e1599ba tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: c6bfb382-b9a8-4bf0-b868-ee5f51f9daac] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:47.234815 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bdc79937-7d5f-437c-9b72-65f51e1599ba tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:47.235674 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bdc79937-7d5f-437c-9b72-65f51e1599ba tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:47.236374 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bdc79937-7d5f-437c-9b72-65f51e1599ba tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:47.238024 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bdc79937-7d5f-437c-9b72-65f51e1599ba tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:47.238686 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bdc79937-7d5f-437c-9b72-65f51e1599ba tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:47.239452 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bdc79937-7d5f-437c-9b72-65f51e1599ba tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:47.607901 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-6141cf46-7c76-475c-aad5-4fb09e60606b tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f911026e35d40a480094376c6556d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f66705b4a0f4711ba14d9ceb5699bd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:47.631761 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6141cf46-7c76-475c-aad5-4fb09e60606b tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] 10.222.0.61 "GET /compute/v2.1/servers/18dc9f32-b72a-4f4f-9153-a6a54f9d21b8" status: 200 len: 1316 microversion: 2.1 time: 0.576158 Aug 31 16:13:47.637371 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1937/3881] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:47 2022] GET /compute/v2.1/servers/18dc9f32-b72a-4f4f-9153-a6a54f9d21b8 => generated 1316 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:47.656268 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4eb7b44a-b2c7-4cf3-9dcb-0a126ccc6d5b tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:47.665071 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4eb7b44a-b2c7-4cf3-9dcb-0a126ccc6d5b tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] [instance: b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:47.680014 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4eb7b44a-b2c7-4cf3-9dcb-0a126ccc6d5b tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:47.681165 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4eb7b44a-b2c7-4cf3-9dcb-0a126ccc6d5b tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:47.682195 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4eb7b44a-b2c7-4cf3-9dcb-0a126ccc6d5b tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:47.683759 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4eb7b44a-b2c7-4cf3-9dcb-0a126ccc6d5b tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:47.685298 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4eb7b44a-b2c7-4cf3-9dcb-0a126ccc6d5b tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:47.686347 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4eb7b44a-b2c7-4cf3-9dcb-0a126ccc6d5b tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:47.821751 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-bdc79937-7d5f-437c-9b72-65f51e1599ba tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48ee960c38f4d0584ea5ce34579279f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a957b6585e74a31b5bc5f66441c33e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:47.852978 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-bdc79937-7d5f-437c-9b72-65f51e1599ba tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "GET /compute/v2.1/servers/c6bfb382-b9a8-4bf0-b868-ee5f51f9daac" status: 200 len: 1506 microversion: 2.1 time: 0.643865 Aug 31 16:13:47.868662 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1945/3882] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:47 2022] GET /compute/v2.1/servers/c6bfb382-b9a8-4bf0-b868-ee5f51f9daac => generated 1506 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:13:48.020433 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-aa915b90-7fa0-495a-b009-0619d02b794b tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:48.021348 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-aa915b90-7fa0-495a-b009-0619d02b794b tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 73b19398-0c2c-42ea-8b4a-86e223c090ff] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:48.028377 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-aa915b90-7fa0-495a-b009-0619d02b794b tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:48.030293 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-aa915b90-7fa0-495a-b009-0619d02b794b tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:48.030940 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-aa915b90-7fa0-495a-b009-0619d02b794b tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:48.031729 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-aa915b90-7fa0-495a-b009-0619d02b794b tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:48.032203 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-aa915b90-7fa0-495a-b009-0619d02b794b tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:48.032652 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-aa915b90-7fa0-495a-b009-0619d02b794b tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:48.051467 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-4eb7b44a-b2c7-4cf3-9dcb-0a126ccc6d5b tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce4e5c281c4432782d96b94323cdcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0b14e6533a4396b15f9c08657d924f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:48.069946 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4eb7b44a-b2c7-4cf3-9dcb-0a126ccc6d5b tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] 10.222.0.61 "GET /compute/v2.1/servers/b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd" status: 200 len: 1503 microversion: 2.1 time: 0.421726 Aug 31 16:13:48.075769 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1938/3883] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:47 2022] GET /compute/v2.1/servers/b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd => generated 1503 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:48.115631 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-15e68382-7126-4be9-8574-838dd2e2c127 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:48.116560 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-15e68382-7126-4be9-8574-838dd2e2c127 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] [instance: b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:48.123168 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-15e68382-7126-4be9-8574-838dd2e2c127 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:48.124194 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-15e68382-7126-4be9-8574-838dd2e2c127 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:48.124869 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-15e68382-7126-4be9-8574-838dd2e2c127 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:48.125860 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-15e68382-7126-4be9-8574-838dd2e2c127 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:48.127141 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-15e68382-7126-4be9-8574-838dd2e2c127 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:48.128403 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-15e68382-7126-4be9-8574-838dd2e2c127 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:48.225436 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-15e68382-7126-4be9-8574-838dd2e2c127 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '3ce4e5c281c4432782d96b94323cdcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0b14e6533a4396b15f9c08657d924f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:48.233784 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-15e68382-7126-4be9-8574-838dd2e2c127 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] 10.222.0.61 "GET /compute/v2.1/servers/b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd/os-instance-actions/req-53d6cf1c-3fab-4433-9f71-5ea13be5c21b" status: 200 len: 313 microversion: 2.1 time: 0.122433 Aug 31 16:13:48.238849 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1939/3884] 10.222.0.61 () {58 vars in 1419 bytes} [Wed Aug 31 16:13:48 2022] GET /compute/v2.1/servers/b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd/os-instance-actions/req-53d6cf1c-3fab-4433-9f71-5ea13be5c21b => generated 313 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:13:48.261730 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3e09b379-fee3-4d8d-b455-8530e3e66887 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:13:48.267756 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3e09b379-fee3-4d8d-b455-8530e3e66887 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] [instance: b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:48.296182 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-aa915b90-7fa0-495a-b009-0619d02b794b tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:48.297507 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3e09b379-fee3-4d8d-b455-8530e3e66887 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:48.301413 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3e09b379-fee3-4d8d-b455-8530e3e66887 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:48.302130 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3e09b379-fee3-4d8d-b455-8530e3e66887 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:48.303664 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3e09b379-fee3-4d8d-b455-8530e3e66887 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:48.306018 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3e09b379-fee3-4d8d-b455-8530e3e66887 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:48.306842 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3e09b379-fee3-4d8d-b455-8530e3e66887 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:48.310472 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-aa915b90-7fa0-495a-b009-0619d02b794b tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/73b19398-0c2c-42ea-8b4a-86e223c090ff" status: 200 len: 1309 microversion: 2.1 time: 0.296768 Aug 31 16:13:48.322959 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1946/3885] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:48 2022] GET /compute/v2.1/servers/73b19398-0c2c-42ea-8b4a-86e223c090ff => generated 1309 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:48.449028 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3e09b379-fee3-4d8d-b455-8530e3e66887 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] 10.222.0.61 "POST /compute/v2.1/servers/b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd/action" status: 202 len: 0 microversion: 2.1 time: 0.193127 Aug 31 16:13:48.449873 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1940/3886] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:13:48 2022] POST /compute/v2.1/servers/b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd/action => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:13:48.467144 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e6c4f835-bb31-4d17-a4b8-e59112c4e5f9 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:48.467888 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e6c4f835-bb31-4d17-a4b8-e59112c4e5f9 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] [instance: b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:48.477628 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e6c4f835-bb31-4d17-a4b8-e59112c4e5f9 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:48.478134 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e6c4f835-bb31-4d17-a4b8-e59112c4e5f9 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:48.478824 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e6c4f835-bb31-4d17-a4b8-e59112c4e5f9 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:48.479606 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e6c4f835-bb31-4d17-a4b8-e59112c4e5f9 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:48.480696 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e6c4f835-bb31-4d17-a4b8-e59112c4e5f9 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:48.481295 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e6c4f835-bb31-4d17-a4b8-e59112c4e5f9 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:48.678402 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6569a3e3-1ce6-465b-8162-7466595b80c7 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:48.679181 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6569a3e3-1ce6-465b-8162-7466595b80c7 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] [instance: 18dc9f32-b72a-4f4f-9153-a6a54f9d21b8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:48.689056 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6569a3e3-1ce6-465b-8162-7466595b80c7 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:48.689554 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6569a3e3-1ce6-465b-8162-7466595b80c7 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:48.691700 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6569a3e3-1ce6-465b-8162-7466595b80c7 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:48.692663 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6569a3e3-1ce6-465b-8162-7466595b80c7 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:48.694203 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6569a3e3-1ce6-465b-8162-7466595b80c7 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:48.694903 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6569a3e3-1ce6-465b-8162-7466595b80c7 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:48.800634 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e6c4f835-bb31-4d17-a4b8-e59112c4e5f9 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce4e5c281c4432782d96b94323cdcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0b14e6533a4396b15f9c08657d924f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:48.818649 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e6c4f835-bb31-4d17-a4b8-e59112c4e5f9 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] 10.222.0.61 "GET /compute/v2.1/servers/b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd" status: 200 len: 1505 microversion: 2.1 time: 0.362728 Aug 31 16:13:48.821420 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1947/3887] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:48 2022] GET /compute/v2.1/servers/b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd => generated 1505 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:48.883302 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5da788a5-81d7-4ed9-9e6b-d7413db4906f tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:48.885273 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5da788a5-81d7-4ed9-9e6b-d7413db4906f tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: c6bfb382-b9a8-4bf0-b868-ee5f51f9daac] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:48.904892 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5da788a5-81d7-4ed9-9e6b-d7413db4906f tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:48.910772 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5da788a5-81d7-4ed9-9e6b-d7413db4906f tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:48.912303 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5da788a5-81d7-4ed9-9e6b-d7413db4906f tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:48.918298 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5da788a5-81d7-4ed9-9e6b-d7413db4906f tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:48.919142 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5da788a5-81d7-4ed9-9e6b-d7413db4906f tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:48.920522 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5da788a5-81d7-4ed9-9e6b-d7413db4906f tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:49.114849 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-6569a3e3-1ce6-465b-8162-7466595b80c7 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f911026e35d40a480094376c6556d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f66705b4a0f4711ba14d9ceb5699bd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:49.141817 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6569a3e3-1ce6-465b-8162-7466595b80c7 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] 10.222.0.61 "GET /compute/v2.1/servers/18dc9f32-b72a-4f4f-9153-a6a54f9d21b8" status: 200 len: 1316 microversion: 2.1 time: 0.470247 Aug 31 16:13:49.144229 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1941/3888] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:48 2022] GET /compute/v2.1/servers/18dc9f32-b72a-4f4f-9153-a6a54f9d21b8 => generated 1316 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:49.278393 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5da788a5-81d7-4ed9-9e6b-d7413db4906f tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48ee960c38f4d0584ea5ce34579279f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a957b6585e74a31b5bc5f66441c33e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:49.304470 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5da788a5-81d7-4ed9-9e6b-d7413db4906f tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "GET /compute/v2.1/servers/c6bfb382-b9a8-4bf0-b868-ee5f51f9daac" status: 200 len: 1506 microversion: 2.1 time: 0.427988 Aug 31 16:13:49.305147 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1948/3889] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:48 2022] GET /compute/v2.1/servers/c6bfb382-b9a8-4bf0-b868-ee5f51f9daac => generated 1506 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:13:49.337315 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-000392cc-2462-424c-9614-abbe13438732 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:49.337853 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-000392cc-2462-424c-9614-abbe13438732 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 73b19398-0c2c-42ea-8b4a-86e223c090ff] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:49.348180 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-000392cc-2462-424c-9614-abbe13438732 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:49.348683 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-000392cc-2462-424c-9614-abbe13438732 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:49.349121 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-000392cc-2462-424c-9614-abbe13438732 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:49.350097 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-000392cc-2462-424c-9614-abbe13438732 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:49.350558 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-000392cc-2462-424c-9614-abbe13438732 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:49.350999 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-000392cc-2462-424c-9614-abbe13438732 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:49.780034 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-000392cc-2462-424c-9614-abbe13438732 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:49.789921 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-000392cc-2462-424c-9614-abbe13438732 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/73b19398-0c2c-42ea-8b4a-86e223c090ff" status: 200 len: 1309 microversion: 2.1 time: 0.456918 Aug 31 16:13:49.820134 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1942/3890] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:49 2022] GET /compute/v2.1/servers/73b19398-0c2c-42ea-8b4a-86e223c090ff => generated 1309 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:49.853403 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-938d9ee3-653f-484f-9b44-8f673d9c86a0 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:49.855432 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-938d9ee3-653f-484f-9b44-8f673d9c86a0 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] [instance: b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:49.869177 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-938d9ee3-653f-484f-9b44-8f673d9c86a0 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:49.869950 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-938d9ee3-653f-484f-9b44-8f673d9c86a0 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:49.870586 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-938d9ee3-653f-484f-9b44-8f673d9c86a0 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:49.871521 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-938d9ee3-653f-484f-9b44-8f673d9c86a0 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:49.872151 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-938d9ee3-653f-484f-9b44-8f673d9c86a0 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:49.872751 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-938d9ee3-653f-484f-9b44-8f673d9c86a0 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:50.169689 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ed2847e2-3591-410c-9395-51b6e28961a3 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:50.170562 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ed2847e2-3591-410c-9395-51b6e28961a3 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] [instance: 18dc9f32-b72a-4f4f-9153-a6a54f9d21b8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:50.183039 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:13:50.188947 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ed2847e2-3591-410c-9395-51b6e28961a3 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:50.189641 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ed2847e2-3591-410c-9395-51b6e28961a3 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:50.203740 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ed2847e2-3591-410c-9395-51b6e28961a3 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:50.205115 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ed2847e2-3591-410c-9395-51b6e28961a3 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:50.205583 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ed2847e2-3591-410c-9395-51b6e28961a3 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:50.207125 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ed2847e2-3591-410c-9395-51b6e28961a3 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:50.273413 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-938d9ee3-653f-484f-9b44-8f673d9c86a0 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce4e5c281c4432782d96b94323cdcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0b14e6533a4396b15f9c08657d924f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:50.298002 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-938d9ee3-653f-484f-9b44-8f673d9c86a0 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] 10.222.0.61 "GET /compute/v2.1/servers/b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd" status: 200 len: 1505 microversion: 2.1 time: 0.442754 Aug 31 16:13:50.299111 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1949/3891] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:49 2022] GET /compute/v2.1/servers/b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd => generated 1505 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:50.329423 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-cee01e47-ef07-40da-b1b6-cae381b398e5 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:50.330367 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-cee01e47-ef07-40da-b1b6-cae381b398e5 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: c6bfb382-b9a8-4bf0-b868-ee5f51f9daac] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:50.340782 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cee01e47-ef07-40da-b1b6-cae381b398e5 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:50.341470 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cee01e47-ef07-40da-b1b6-cae381b398e5 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:50.342080 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cee01e47-ef07-40da-b1b6-cae381b398e5 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:50.343078 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cee01e47-ef07-40da-b1b6-cae381b398e5 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:50.343818 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cee01e47-ef07-40da-b1b6-cae381b398e5 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:50.344704 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cee01e47-ef07-40da-b1b6-cae381b398e5 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:51.042049 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ed2847e2-3591-410c-9395-51b6e28961a3 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f911026e35d40a480094376c6556d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f66705b4a0f4711ba14d9ceb5699bd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:51.043398 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-cee01e47-ef07-40da-b1b6-cae381b398e5 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48ee960c38f4d0584ea5ce34579279f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a957b6585e74a31b5bc5f66441c33e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:51.055775 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-cee01e47-ef07-40da-b1b6-cae381b398e5 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "GET /compute/v2.1/servers/c6bfb382-b9a8-4bf0-b868-ee5f51f9daac" status: 200 len: 1506 microversion: 2.1 time: 0.730389 Aug 31 16:13:51.061762 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ed2847e2-3591-410c-9395-51b6e28961a3 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] 10.222.0.61 "GET /compute/v2.1/servers/18dc9f32-b72a-4f4f-9153-a6a54f9d21b8" status: 200 len: 1316 microversion: 2.1 time: 0.895862 Aug 31 16:13:51.065988 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1943/3892] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:50 2022] GET /compute/v2.1/servers/18dc9f32-b72a-4f4f-9153-a6a54f9d21b8 => generated 1316 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:51.068562 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1950/3893] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:50 2022] GET /compute/v2.1/servers/c6bfb382-b9a8-4bf0-b868-ee5f51f9daac => generated 1506 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:13:51.086164 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f1231535-3b72-493e-9fc1-d0f01a4a91af tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:51.087119 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f1231535-3b72-493e-9fc1-d0f01a4a91af tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 73b19398-0c2c-42ea-8b4a-86e223c090ff] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:51.104731 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f1231535-3b72-493e-9fc1-d0f01a4a91af tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:51.106769 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f1231535-3b72-493e-9fc1-d0f01a4a91af tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:51.106769 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f1231535-3b72-493e-9fc1-d0f01a4a91af tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:51.108053 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f1231535-3b72-493e-9fc1-d0f01a4a91af tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:51.108870 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f1231535-3b72-493e-9fc1-d0f01a4a91af tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:51.109667 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f1231535-3b72-493e-9fc1-d0f01a4a91af tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:51.254310 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:13:51.324836 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-39da5189-2fdf-41ab-a9af-3c3987d1dfc6 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:51.325672 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-39da5189-2fdf-41ab-a9af-3c3987d1dfc6 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] [instance: b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:51.333585 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-39da5189-2fdf-41ab-a9af-3c3987d1dfc6 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:51.334392 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-39da5189-2fdf-41ab-a9af-3c3987d1dfc6 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:51.334791 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-39da5189-2fdf-41ab-a9af-3c3987d1dfc6 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:51.335548 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-39da5189-2fdf-41ab-a9af-3c3987d1dfc6 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:51.336465 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-39da5189-2fdf-41ab-a9af-3c3987d1dfc6 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:51.336895 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-39da5189-2fdf-41ab-a9af-3c3987d1dfc6 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:51.579647 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f1231535-3b72-493e-9fc1-d0f01a4a91af tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:51.597831 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f1231535-3b72-493e-9fc1-d0f01a4a91af tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/73b19398-0c2c-42ea-8b4a-86e223c090ff" status: 200 len: 1309 microversion: 2.1 time: 0.528016 Aug 31 16:13:51.599771 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1944/3894] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:51 2022] GET /compute/v2.1/servers/73b19398-0c2c-42ea-8b4a-86e223c090ff => generated 1309 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:51.648984 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-c075f87e-4231-4344-b79a-a6d55e8bb146 req-4daa51fb-0982-445d-8278-8d96acf54cf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18dc9f32-b72a-4f4f-9153-a6a54f9d21b8", "name": "network-vif-plugged", "status": "completed", "tag": "02a0fc93-d351-4671-91b7-b1c1440a5fc6"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:13:51.668800 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-c075f87e-4231-4344-b79a-a6d55e8bb146 req-4daa51fb-0982-445d-8278-8d96acf54cf7 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:51.669978 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-c075f87e-4231-4344-b79a-a6d55e8bb146 req-4daa51fb-0982-445d-8278-8d96acf54cf7 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:51.670545 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-c075f87e-4231-4344-b79a-a6d55e8bb146 req-4daa51fb-0982-445d-8278-8d96acf54cf7 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:51.702580 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-c075f87e-4231-4344-b79a-a6d55e8bb146 req-4daa51fb-0982-445d-8278-8d96acf54cf7 service nova] Creating event network-vif-plugged:02a0fc93-d351-4671-91b7-b1c1440a5fc6 for instance 18dc9f32-b72a-4f4f-9153-a6a54f9d21b8 on n-h2-850499-9 Aug 31 16:13:51.710594 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-c075f87e-4231-4344-b79a-a6d55e8bb146 req-4daa51fb-0982-445d-8278-8d96acf54cf7 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065651 Aug 31 16:13:51.712495 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1945/3895] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:13:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:13:51.815705 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-39da5189-2fdf-41ab-a9af-3c3987d1dfc6 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce4e5c281c4432782d96b94323cdcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0b14e6533a4396b15f9c08657d924f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:51.837532 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-39da5189-2fdf-41ab-a9af-3c3987d1dfc6 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] 10.222.0.61 "GET /compute/v2.1/servers/b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd" status: 200 len: 1503 microversion: 2.1 time: 0.510278 Aug 31 16:13:51.838957 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1951/3896] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:51 2022] GET /compute/v2.1/servers/b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd => generated 1503 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:13:51.865016 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-01af680f-593f-4c97-98ff-b31251232262 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Calling method '.version_select at 0x7f5ae3ea4310>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:51.866693 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-01af680f-593f-4c97-98ff-b31251232262 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] [instance: b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:51.874947 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=8 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:13:51.880327 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-01af680f-593f-4c97-98ff-b31251232262 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:51.881594 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-01af680f-593f-4c97-98ff-b31251232262 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:51.882551 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-01af680f-593f-4c97-98ff-b31251232262 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:51.885201 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-01af680f-593f-4c97-98ff-b31251232262 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:51.886348 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-01af680f-593f-4c97-98ff-b31251232262 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:51.887403 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-01af680f-593f-4c97-98ff-b31251232262 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:51.955112 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-01af680f-593f-4c97-98ff-b31251232262 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] 10.222.0.61 "GET /compute/v2.1/servers/b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.096181 Aug 31 16:13:51.957454 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1946/3897] 10.222.0.61 () {58 vars in 1296 bytes} [Wed Aug 31 16:13:51 2022] GET /compute/v2.1/servers/b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd/os-instance-actions => generated 611 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:13:51.972090 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-484bf65d-fd7d-458f-94e6-260d19d6cec7 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:51.973498 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-484bf65d-fd7d-458f-94e6-260d19d6cec7 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] [instance: b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:51.982845 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-484bf65d-fd7d-458f-94e6-260d19d6cec7 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:51.983691 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-484bf65d-fd7d-458f-94e6-260d19d6cec7 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:51.984284 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-484bf65d-fd7d-458f-94e6-260d19d6cec7 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:51.985275 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-484bf65d-fd7d-458f-94e6-260d19d6cec7 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:51.985918 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-484bf65d-fd7d-458f-94e6-260d19d6cec7 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:51.986485 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-484bf65d-fd7d-458f-94e6-260d19d6cec7 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:52.054636 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-484bf65d-fd7d-458f-94e6-260d19d6cec7 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] [instance: b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:13:52.082978 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6bd79415-7b23-4ef4-b61c-8530d09ed38f tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:52.084217 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6bd79415-7b23-4ef4-b61c-8530d09ed38f tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: c6bfb382-b9a8-4bf0-b868-ee5f51f9daac] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:52.099143 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6bd79415-7b23-4ef4-b61c-8530d09ed38f tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:52.100400 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6bd79415-7b23-4ef4-b61c-8530d09ed38f tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:52.101451 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6bd79415-7b23-4ef4-b61c-8530d09ed38f tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:52.103391 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6bd79415-7b23-4ef4-b61c-8530d09ed38f tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:52.104983 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6bd79415-7b23-4ef4-b61c-8530d09ed38f tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:52.106327 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6bd79415-7b23-4ef4-b61c-8530d09ed38f tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:52.214838 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-484bf65d-fd7d-458f-94e6-260d19d6cec7 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] 10.222.0.61 "DELETE /compute/v2.1/servers/b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd" status: 204 len: 0 microversion: 2.1 time: 0.247666 Aug 31 16:13:52.216372 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1952/3898] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:13:51 2022] DELETE /compute/v2.1/servers/b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:13:52.226532 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d5748284-87f7-4e38-b27a-139a3cde26a4 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:52.227660 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d5748284-87f7-4e38-b27a-139a3cde26a4 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] [instance: 18dc9f32-b72a-4f4f-9153-a6a54f9d21b8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:52.239312 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d5748284-87f7-4e38-b27a-139a3cde26a4 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:52.240177 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d5748284-87f7-4e38-b27a-139a3cde26a4 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:52.240809 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d5748284-87f7-4e38-b27a-139a3cde26a4 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:52.241852 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d5748284-87f7-4e38-b27a-139a3cde26a4 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:52.242521 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d5748284-87f7-4e38-b27a-139a3cde26a4 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:52.243437 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d5748284-87f7-4e38-b27a-139a3cde26a4 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:52.505163 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-6bd79415-7b23-4ef4-b61c-8530d09ed38f tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48ee960c38f4d0584ea5ce34579279f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a957b6585e74a31b5bc5f66441c33e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:52.526288 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6bd79415-7b23-4ef4-b61c-8530d09ed38f tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "GET /compute/v2.1/servers/c6bfb382-b9a8-4bf0-b868-ee5f51f9daac" status: 200 len: 1506 microversion: 2.1 time: 0.447478 Aug 31 16:13:52.528529 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1947/3899] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:52 2022] GET /compute/v2.1/servers/c6bfb382-b9a8-4bf0-b868-ee5f51f9daac => generated 1506 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:52.535780 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-124028f8-eb74-41d0-b10c-38dc4fd9971e tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:52.536993 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-124028f8-eb74-41d0-b10c-38dc4fd9971e tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] [instance: b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:52.545466 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-124028f8-eb74-41d0-b10c-38dc4fd9971e tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:52.546380 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-124028f8-eb74-41d0-b10c-38dc4fd9971e tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:52.547606 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-124028f8-eb74-41d0-b10c-38dc4fd9971e tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:52.548484 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-124028f8-eb74-41d0-b10c-38dc4fd9971e tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:52.549111 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-124028f8-eb74-41d0-b10c-38dc4fd9971e tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:52.550569 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-124028f8-eb74-41d0-b10c-38dc4fd9971e tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:52.554532 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d5748284-87f7-4e38-b27a-139a3cde26a4 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f911026e35d40a480094376c6556d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f66705b4a0f4711ba14d9ceb5699bd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:52.572510 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d5748284-87f7-4e38-b27a-139a3cde26a4 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] 10.222.0.61 "GET /compute/v2.1/servers/18dc9f32-b72a-4f4f-9153-a6a54f9d21b8" status: 200 len: 1316 microversion: 2.1 time: 0.353437 Aug 31 16:13:52.592396 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1953/3900] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:52 2022] GET /compute/v2.1/servers/18dc9f32-b72a-4f4f-9153-a6a54f9d21b8 => generated 1316 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:52.632115 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a424c682-4823-4d24-9c4c-da74062a45b5 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:52.633417 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a424c682-4823-4d24-9c4c-da74062a45b5 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 73b19398-0c2c-42ea-8b4a-86e223c090ff] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:52.642421 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a424c682-4823-4d24-9c4c-da74062a45b5 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:52.644792 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a424c682-4823-4d24-9c4c-da74062a45b5 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:52.645535 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a424c682-4823-4d24-9c4c-da74062a45b5 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:52.646853 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a424c682-4823-4d24-9c4c-da74062a45b5 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:52.647665 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a424c682-4823-4d24-9c4c-da74062a45b5 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:52.648330 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a424c682-4823-4d24-9c4c-da74062a45b5 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:52.880141 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-124028f8-eb74-41d0-b10c-38dc4fd9971e tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce4e5c281c4432782d96b94323cdcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0b14e6533a4396b15f9c08657d924f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:52.892886 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-124028f8-eb74-41d0-b10c-38dc4fd9971e tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] 10.222.0.61 "GET /compute/v2.1/servers/b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd" status: 200 len: 1509 microversion: 2.1 time: 0.362152 Aug 31 16:13:52.911532 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1948/3901] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:52 2022] GET /compute/v2.1/servers/b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd => generated 1509 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:52.948144 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a424c682-4823-4d24-9c4c-da74062a45b5 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:52.956925 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a424c682-4823-4d24-9c4c-da74062a45b5 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/73b19398-0c2c-42ea-8b4a-86e223c090ff" status: 200 len: 1309 microversion: 2.1 time: 0.330273 Aug 31 16:13:52.961521 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1954/3902] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:52 2022] GET /compute/v2.1/servers/73b19398-0c2c-42ea-8b4a-86e223c090ff => generated 1309 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:13:53.550163 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-81f9a85b-74e2-4e63-ab6d-714aba099db1 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:53.551736 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-81f9a85b-74e2-4e63-ab6d-714aba099db1 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: c6bfb382-b9a8-4bf0-b868-ee5f51f9daac] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:53.563060 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-81f9a85b-74e2-4e63-ab6d-714aba099db1 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:53.564109 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-81f9a85b-74e2-4e63-ab6d-714aba099db1 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:53.564503 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-81f9a85b-74e2-4e63-ab6d-714aba099db1 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:53.565322 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-81f9a85b-74e2-4e63-ab6d-714aba099db1 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:53.566372 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-81f9a85b-74e2-4e63-ab6d-714aba099db1 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:53.567338 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-81f9a85b-74e2-4e63-ab6d-714aba099db1 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:53.607079 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2e4c5754-b856-47c9-8a11-01a937dff1dc tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:53.608416 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2e4c5754-b856-47c9-8a11-01a937dff1dc tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] [instance: 18dc9f32-b72a-4f4f-9153-a6a54f9d21b8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:53.619454 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2e4c5754-b856-47c9-8a11-01a937dff1dc tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:53.620413 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2e4c5754-b856-47c9-8a11-01a937dff1dc tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:53.621054 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2e4c5754-b856-47c9-8a11-01a937dff1dc tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:53.622127 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2e4c5754-b856-47c9-8a11-01a937dff1dc tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:53.622766 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2e4c5754-b856-47c9-8a11-01a937dff1dc tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:53.623523 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2e4c5754-b856-47c9-8a11-01a937dff1dc tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:53.632441 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:13:53.837899 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-81f9a85b-74e2-4e63-ab6d-714aba099db1 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48ee960c38f4d0584ea5ce34579279f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a957b6585e74a31b5bc5f66441c33e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:53.849052 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-81f9a85b-74e2-4e63-ab6d-714aba099db1 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "GET /compute/v2.1/servers/c6bfb382-b9a8-4bf0-b868-ee5f51f9daac" status: 200 len: 1506 microversion: 2.1 time: 0.303352 Aug 31 16:13:53.849759 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1949/3903] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:53 2022] GET /compute/v2.1/servers/c6bfb382-b9a8-4bf0-b868-ee5f51f9daac => generated 1506 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:53.854855 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-9c0548fa-c93d-48f3-a7c1-ad438cdad76b req-753c5817-74f9-41a1-9487-832370c60f83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73b19398-0c2c-42ea-8b4a-86e223c090ff", "name": "network-vif-plugged", "status": "completed", "tag": "3d8c281c-2a4b-431f-87ce-34a3fa52e6c4"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:13:53.867451 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2e4c5754-b856-47c9-8a11-01a937dff1dc tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f911026e35d40a480094376c6556d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f66705b4a0f4711ba14d9ceb5699bd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:53.867994 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-9c0548fa-c93d-48f3-a7c1-ad438cdad76b req-753c5817-74f9-41a1-9487-832370c60f83 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:53.868684 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-9c0548fa-c93d-48f3-a7c1-ad438cdad76b req-753c5817-74f9-41a1-9487-832370c60f83 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:53.869243 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-9c0548fa-c93d-48f3-a7c1-ad438cdad76b req-753c5817-74f9-41a1-9487-832370c60f83 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:53.880465 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2e4c5754-b856-47c9-8a11-01a937dff1dc tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] 10.222.0.61 "GET /compute/v2.1/servers/18dc9f32-b72a-4f4f-9153-a6a54f9d21b8" status: 200 len: 1316 microversion: 2.1 time: 0.279237 Aug 31 16:13:53.881169 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1955/3904] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:53 2022] GET /compute/v2.1/servers/18dc9f32-b72a-4f4f-9153-a6a54f9d21b8 => generated 1316 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:13:53.883894 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-9c0548fa-c93d-48f3-a7c1-ad438cdad76b req-753c5817-74f9-41a1-9487-832370c60f83 service nova] Creating event network-vif-plugged:3d8c281c-2a4b-431f-87ce-34a3fa52e6c4 for instance 73b19398-0c2c-42ea-8b4a-86e223c090ff on n-h1-850499-9 Aug 31 16:13:53.889329 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-9c0548fa-c93d-48f3-a7c1-ad438cdad76b req-753c5817-74f9-41a1-9487-832370c60f83 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038050 Aug 31 16:13:53.890450 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1950/3905] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:13:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:13:53.937301 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-94e4e11f-20dd-462a-82c8-52a2cd21dfa5 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:53.938163 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-94e4e11f-20dd-462a-82c8-52a2cd21dfa5 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] [instance: b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:53.947476 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-94e4e11f-20dd-462a-82c8-52a2cd21dfa5 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:53.948036 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-94e4e11f-20dd-462a-82c8-52a2cd21dfa5 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:53.948480 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-94e4e11f-20dd-462a-82c8-52a2cd21dfa5 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:53.949211 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-94e4e11f-20dd-462a-82c8-52a2cd21dfa5 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:53.949854 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-94e4e11f-20dd-462a-82c8-52a2cd21dfa5 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:53.950307 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-94e4e11f-20dd-462a-82c8-52a2cd21dfa5 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:53.974448 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:13:54.121636 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-94e4e11f-20dd-462a-82c8-52a2cd21dfa5 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce4e5c281c4432782d96b94323cdcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0b14e6533a4396b15f9c08657d924f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:54.132420 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-94e4e11f-20dd-462a-82c8-52a2cd21dfa5 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] 10.222.0.61 "GET /compute/v2.1/servers/b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd" status: 200 len: 1509 microversion: 2.1 time: 0.200847 Aug 31 16:13:54.133215 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1951/3906] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:53 2022] GET /compute/v2.1/servers/b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd => generated 1509 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:13:54.139001 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f2c5276a-76df-483b-85b1-60c7f0c9e84b tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:54.139931 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f2c5276a-76df-483b-85b1-60c7f0c9e84b tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 73b19398-0c2c-42ea-8b4a-86e223c090ff] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:54.147981 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f2c5276a-76df-483b-85b1-60c7f0c9e84b tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:54.148848 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f2c5276a-76df-483b-85b1-60c7f0c9e84b tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:54.149698 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f2c5276a-76df-483b-85b1-60c7f0c9e84b tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:54.150967 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f2c5276a-76df-483b-85b1-60c7f0c9e84b tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:54.152391 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f2c5276a-76df-483b-85b1-60c7f0c9e84b tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:54.153363 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f2c5276a-76df-483b-85b1-60c7f0c9e84b tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:54.199484 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-45ecffd2-15d1-4ed6-897c-634cdc9e1766 tempest-FloatingIPDetailsNegativeTestJSON-1990946119 tempest-FloatingIPDetailsNegativeTestJSON-1990946119-project] Calling method '.version_select at 0x7f5ae8475940>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:54.280475 n-d-850499-9 devstack@n-api.service[122257]: DEBUG neutronclient.v2_0.client [None req-45ecffd2-15d1-4ed6-897c-634cdc9e1766 tempest-FloatingIPDetailsNegativeTestJSON-1990946119 tempest-FloatingIPDetailsNegativeTestJSON-1990946119-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP e6a0d581-4a88-4d68-933a-cdc3711b3051 could not be found", "detail": ""}} {{(pid=122257) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 31 16:13:54.282108 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-45ecffd2-15d1-4ed6-897c-634cdc9e1766 tempest-FloatingIPDetailsNegativeTestJSON-1990946119 tempest-FloatingIPDetailsNegativeTestJSON-1990946119-project] HTTP exception thrown: Floating IP not found for ID e6a0d581-4a88-4d68-933a-cdc3711b3051 Aug 31 16:13:54.288210 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-45ecffd2-15d1-4ed6-897c-634cdc9e1766 tempest-FloatingIPDetailsNegativeTestJSON-1990946119 tempest-FloatingIPDetailsNegativeTestJSON-1990946119-project] Request method failure captured: Aug 31 16:13:54.288210 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/os-floating-ips/e6a0d581-4a88-4d68-933a-cdc3711b3051 HTTP/1.1 Aug 31 16:13:54.288210 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:13:54.288210 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:13:54.288210 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:13:54.288210 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:13:54.288210 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:13:54.288210 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:13:54.288210 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:13:54.288210 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:13:54.288210 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4jBrj7Vi5yTFH9VXa6r_x9H3a4NZsFuHNupTDkrAs5ncdmlP9CCmCFyGFyZonJHcZmpd0IiZ8rgxAoVz05WNuuvdDttr7YKdxeKcJK4I3tqds8QRvXs3yzduhXLWsvgp-hGVaqZNqI1nAjogZdN61qiF6BYioudcSChy7IZbSzjHXI Aug 31 16:13:54.288210 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:13:54.288210 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:13:54.288210 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:13:54.288210 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:13:54.288210 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:13:54.288210 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:13:54.288210 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 63ac16126be14a9daaa9c2157905adc2 Aug 31 16:13:54.288210 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-1990946119 Aug 31 16:13:54.288210 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:13:54.288210 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:13:54.288210 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/63ac16126be14a9daaa9c2157905adc2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/63ac16126be14a9daaa9c2157905adc2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_63ac16126be14a9daaa9c2157905adc2", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/63ac16126be14a9daaa9c2157905adc2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:13:54.288210 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-1990946119 Aug 31 16:13:54.288210 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 63ac16126be14a9daaa9c2157905adc2 Aug 31 16:13:54.288210 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-1990946119 Aug 31 16:13:54.288210 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-1990946119-project Aug 31 16:13:54.288210 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:13:54.288210 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:13:54.288210 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 63fc0bb5f4e143be8d251beb35e6bcc0 Aug 31 16:13:54.288210 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-1990946119-project Aug 31 16:13:54.288210 n-d-850499-9 devstack@n-api.service[122257]: method: Aug 31 16:13:54.288210 n-d-850499-9 devstack@n-api.service[122257]: exception: Floating IP not found for ID e6a0d581-4a88-4d68-933a-cdc3711b3051 Aug 31 16:13:54.288210 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': 'e6a0d581-4a88-4d68-933a-cdc3711b3051'} Aug 31 16:13:54.288210 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:13:54.288210 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:54.288210 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 31 16:13:54.288210 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 31 16:13:54.288210 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:13:54.288210 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:13:54.288210 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 31 16:13:54.288210 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 31 16:13:54.288210 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:13:54.288210 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:13:54.288210 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 31 16:13:54.288210 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 31 16:13:54.288210 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:13:54.288210 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:13:54.288210 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 31 16:13:54.288210 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 31 16:13:54.288210 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:13:54.288210 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:13:54.288210 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 31 16:13:54.288210 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 31 16:13:54.288210 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:13:54.288210 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:13:54.288210 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 31 16:13:54.288210 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 31 16:13:54.288210 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 31 16:13:54.288210 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 31 16:13:54.288210 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP e6a0d581-4a88-4d68-933a-cdc3711b3051 could not be found Aug 31 16:13:54.294358 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4f6b84a4-09f1-4971-a0c8-e8a8eacdd51e'] Aug 31 16:13:54.294358 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:13:54.294358 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:13:54.294358 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:13:54.294358 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:54.294358 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Aug 31 16:13:54.294358 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 31 16:13:54.294358 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 31 16:13:54.294358 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 31 16:13:54.294358 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID e6a0d581-4a88-4d68-933a-cdc3711b3051. Aug 31 16:13:54.294358 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:13:54.294358 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:13:54.294358 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:13:54.294358 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:54.294358 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:13:54.294358 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:13:54.294358 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:13:54.294358 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:13:54.294358 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:13:54.294358 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:13:54.294358 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:13:54.294358 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:13:54.294358 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Aug 31 16:13:54.294358 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 31 16:13:54.294358 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID e6a0d581-4a88-4d68-933a-cdc3711b3051 Aug 31 16:13:54.294358 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:13:54.294358 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:13:54.294358 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:13:54.294358 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:54.294358 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:13:54.294358 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:13:54.294358 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:13:54.294358 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:13:54.294358 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID e6a0d581-4a88-4d68-933a-cdc3711b3051 Aug 31 16:13:54.294358 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:13:54.294358 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-45ecffd2-15d1-4ed6-897c-634cdc9e1766 tempest-FloatingIPDetailsNegativeTestJSON-1990946119 tempest-FloatingIPDetailsNegativeTestJSON-1990946119-project] Returning 404 to user: Floating IP not found for ID e6a0d581-4a88-4d68-933a-cdc3711b3051 {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:13:54.294358 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-45ecffd2-15d1-4ed6-897c-634cdc9e1766 tempest-FloatingIPDetailsNegativeTestJSON-1990946119 tempest-FloatingIPDetailsNegativeTestJSON-1990946119-project] 10.222.0.61 "GET /compute/v2.1/os-floating-ips/e6a0d581-4a88-4d68-933a-cdc3711b3051" status: 404 len: 111 microversion: 2.1 time: 0.395192 Aug 31 16:13:54.294358 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1956/3907] 10.222.0.61 () {58 vars in 1260 bytes} [Wed Aug 31 16:13:53 2022] GET /compute/v2.1/os-floating-ips/e6a0d581-4a88-4d68-933a-cdc3711b3051 => generated 111 bytes in 410 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:13:54.390655 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f2c5276a-76df-483b-85b1-60c7f0c9e84b tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:54.400158 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f2c5276a-76df-483b-85b1-60c7f0c9e84b tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/73b19398-0c2c-42ea-8b4a-86e223c090ff" status: 200 len: 1309 microversion: 2.1 time: 0.265491 Aug 31 16:13:54.400843 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1952/3908] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:54 2022] GET /compute/v2.1/servers/73b19398-0c2c-42ea-8b4a-86e223c090ff => generated 1309 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:54.878872 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-bc56d586-9f19-4200-8e73-3ccdb2d2f4b5 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:54.880959 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-bc56d586-9f19-4200-8e73-3ccdb2d2f4b5 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: c6bfb382-b9a8-4bf0-b868-ee5f51f9daac] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:54.899427 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bc56d586-9f19-4200-8e73-3ccdb2d2f4b5 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:54.900162 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bc56d586-9f19-4200-8e73-3ccdb2d2f4b5 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:54.901139 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bc56d586-9f19-4200-8e73-3ccdb2d2f4b5 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:54.903391 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bc56d586-9f19-4200-8e73-3ccdb2d2f4b5 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:54.903391 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bc56d586-9f19-4200-8e73-3ccdb2d2f4b5 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:54.903879 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bc56d586-9f19-4200-8e73-3ccdb2d2f4b5 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:54.922482 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-662abccb-577e-48a0-b6f5-4a4f82d92bfb tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:54.926363 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-662abccb-577e-48a0-b6f5-4a4f82d92bfb tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] [instance: 18dc9f32-b72a-4f4f-9153-a6a54f9d21b8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:54.944852 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-662abccb-577e-48a0-b6f5-4a4f82d92bfb tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:54.946336 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-662abccb-577e-48a0-b6f5-4a4f82d92bfb tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:54.947645 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-662abccb-577e-48a0-b6f5-4a4f82d92bfb tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:54.949310 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-662abccb-577e-48a0-b6f5-4a4f82d92bfb tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:54.950368 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-662abccb-577e-48a0-b6f5-4a4f82d92bfb tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:54.951516 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-662abccb-577e-48a0-b6f5-4a4f82d92bfb tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:55.153604 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-bc56d586-9f19-4200-8e73-3ccdb2d2f4b5 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48ee960c38f4d0584ea5ce34579279f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a957b6585e74a31b5bc5f66441c33e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:55.163323 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-bc56d586-9f19-4200-8e73-3ccdb2d2f4b5 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "GET /compute/v2.1/servers/c6bfb382-b9a8-4bf0-b868-ee5f51f9daac" status: 200 len: 1506 microversion: 2.1 time: 0.292974 Aug 31 16:13:55.164568 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1957/3909] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:54 2022] GET /compute/v2.1/servers/c6bfb382-b9a8-4bf0-b868-ee5f51f9daac => generated 1506 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:55.169667 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-346678ff-c683-426b-b6f8-3b46d00380e0 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:55.171229 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-346678ff-c683-426b-b6f8-3b46d00380e0 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] [instance: b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:55.179342 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-346678ff-c683-426b-b6f8-3b46d00380e0 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:55.181034 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-346678ff-c683-426b-b6f8-3b46d00380e0 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:55.183053 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-346678ff-c683-426b-b6f8-3b46d00380e0 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:55.184855 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-346678ff-c683-426b-b6f8-3b46d00380e0 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:55.185596 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-346678ff-c683-426b-b6f8-3b46d00380e0 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:55.186270 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-346678ff-c683-426b-b6f8-3b46d00380e0 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:55.211689 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-662abccb-577e-48a0-b6f5-4a4f82d92bfb tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f911026e35d40a480094376c6556d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f66705b4a0f4711ba14d9ceb5699bd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:55.227698 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-662abccb-577e-48a0-b6f5-4a4f82d92bfb tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] 10.222.0.61 "GET /compute/v2.1/servers/18dc9f32-b72a-4f4f-9153-a6a54f9d21b8" status: 200 len: 1316 microversion: 2.1 time: 0.313079 Aug 31 16:13:55.228777 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1953/3910] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:54 2022] GET /compute/v2.1/servers/18dc9f32-b72a-4f4f-9153-a6a54f9d21b8 => generated 1316 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:55.429565 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b9f480c1-c0d5-4dcc-8b75-830ce99c6ebe tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:55.430187 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b9f480c1-c0d5-4dcc-8b75-830ce99c6ebe tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 73b19398-0c2c-42ea-8b4a-86e223c090ff] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:55.436909 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b9f480c1-c0d5-4dcc-8b75-830ce99c6ebe tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:55.437412 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b9f480c1-c0d5-4dcc-8b75-830ce99c6ebe tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:55.437853 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b9f480c1-c0d5-4dcc-8b75-830ce99c6ebe tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:55.438571 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b9f480c1-c0d5-4dcc-8b75-830ce99c6ebe tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:55.439038 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b9f480c1-c0d5-4dcc-8b75-830ce99c6ebe tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:55.439473 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b9f480c1-c0d5-4dcc-8b75-830ce99c6ebe tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:55.459406 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-346678ff-c683-426b-b6f8-3b46d00380e0 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce4e5c281c4432782d96b94323cdcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0b14e6533a4396b15f9c08657d924f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:55.478524 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-346678ff-c683-426b-b6f8-3b46d00380e0 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] 10.222.0.61 "GET /compute/v2.1/servers/b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd" status: 200 len: 1509 microversion: 2.1 time: 0.311774 Aug 31 16:13:55.480414 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1958/3911] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:55 2022] GET /compute/v2.1/servers/b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd => generated 1509 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:55.761915 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b9f480c1-c0d5-4dcc-8b75-830ce99c6ebe tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:55.786485 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b9f480c1-c0d5-4dcc-8b75-830ce99c6ebe tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/73b19398-0c2c-42ea-8b4a-86e223c090ff" status: 200 len: 1309 microversion: 2.1 time: 0.363176 Aug 31 16:13:55.787798 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1954/3912] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:55 2022] GET /compute/v2.1/servers/73b19398-0c2c-42ea-8b4a-86e223c090ff => generated 1309 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:56.195489 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2f5008a5-4936-4b79-ac3e-695b6ed2c9c6 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:56.196346 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2f5008a5-4936-4b79-ac3e-695b6ed2c9c6 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: c6bfb382-b9a8-4bf0-b868-ee5f51f9daac] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:56.209275 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2f5008a5-4936-4b79-ac3e-695b6ed2c9c6 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:56.209825 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2f5008a5-4936-4b79-ac3e-695b6ed2c9c6 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:56.212176 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2f5008a5-4936-4b79-ac3e-695b6ed2c9c6 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:56.213117 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2f5008a5-4936-4b79-ac3e-695b6ed2c9c6 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:56.213806 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2f5008a5-4936-4b79-ac3e-695b6ed2c9c6 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:56.214396 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2f5008a5-4936-4b79-ac3e-695b6ed2c9c6 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:56.251707 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2a712564-4b8c-4741-8ade-73ec9d3638c7 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:56.253013 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2a712564-4b8c-4741-8ade-73ec9d3638c7 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] [instance: 18dc9f32-b72a-4f4f-9153-a6a54f9d21b8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:56.267730 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2a712564-4b8c-4741-8ade-73ec9d3638c7 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:56.268663 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2a712564-4b8c-4741-8ade-73ec9d3638c7 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:56.269311 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2a712564-4b8c-4741-8ade-73ec9d3638c7 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:56.270254 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2a712564-4b8c-4741-8ade-73ec9d3638c7 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:56.270907 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2a712564-4b8c-4741-8ade-73ec9d3638c7 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:56.271532 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2a712564-4b8c-4741-8ade-73ec9d3638c7 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:56.573714 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2f5008a5-4936-4b79-ac3e-695b6ed2c9c6 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48ee960c38f4d0584ea5ce34579279f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a957b6585e74a31b5bc5f66441c33e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:56.583021 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2f5008a5-4936-4b79-ac3e-695b6ed2c9c6 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "GET /compute/v2.1/servers/c6bfb382-b9a8-4bf0-b868-ee5f51f9daac" status: 200 len: 1506 microversion: 2.1 time: 0.391644 Aug 31 16:13:56.584148 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1959/3913] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:56 2022] GET /compute/v2.1/servers/c6bfb382-b9a8-4bf0-b868-ee5f51f9daac => generated 1506 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:56.592198 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9d102ec8-cdbb-4a76-a380-d74e00401299 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:56.593466 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9d102ec8-cdbb-4a76-a380-d74e00401299 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] [instance: b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:56.616290 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9d102ec8-cdbb-4a76-a380-d74e00401299 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:56.617560 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9d102ec8-cdbb-4a76-a380-d74e00401299 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:56.618622 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9d102ec8-cdbb-4a76-a380-d74e00401299 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:56.620280 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9d102ec8-cdbb-4a76-a380-d74e00401299 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:56.621231 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9d102ec8-cdbb-4a76-a380-d74e00401299 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:56.622332 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9d102ec8-cdbb-4a76-a380-d74e00401299 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:56.700063 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-2a712564-4b8c-4741-8ade-73ec9d3638c7 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f911026e35d40a480094376c6556d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f66705b4a0f4711ba14d9ceb5699bd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:56.715003 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2a712564-4b8c-4741-8ade-73ec9d3638c7 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] 10.222.0.61 "GET /compute/v2.1/servers/18dc9f32-b72a-4f4f-9153-a6a54f9d21b8" status: 200 len: 1504 microversion: 2.1 time: 0.467319 Aug 31 16:13:56.717126 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1955/3914] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:56 2022] GET /compute/v2.1/servers/18dc9f32-b72a-4f4f-9153-a6a54f9d21b8 => generated 1504 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:13:56.754957 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5be0959a-a5b1-4cee-bf47-17b3cd649eeb tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2108013832"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:13:56.755669 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5be0959a-a5b1-4cee-bf47-17b3cd649eeb tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] [instance: 18dc9f32-b72a-4f4f-9153-a6a54f9d21b8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:56.773309 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5be0959a-a5b1-4cee-bf47-17b3cd649eeb tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:56.773846 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5be0959a-a5b1-4cee-bf47-17b3cd649eeb tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:56.774299 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5be0959a-a5b1-4cee-bf47-17b3cd649eeb tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:56.776025 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5be0959a-a5b1-4cee-bf47-17b3cd649eeb tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:56.776593 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5be0959a-a5b1-4cee-bf47-17b3cd649eeb tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:56.779264 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5be0959a-a5b1-4cee-bf47-17b3cd649eeb tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:56.806287 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9d102ec8-cdbb-4a76-a380-d74e00401299 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce4e5c281c4432782d96b94323cdcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0b14e6533a4396b15f9c08657d924f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:56.837700 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9d102ec8-cdbb-4a76-a380-d74e00401299 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] 10.222.0.61 "GET /compute/v2.1/servers/b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd" status: 200 len: 1467 microversion: 2.1 time: 0.246361 Aug 31 16:13:56.843576 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1960/3915] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:56 2022] GET /compute/v2.1/servers/b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd => generated 1467 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:56.863974 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-65badd3a-42e3-4260-8d52-0c6a32fb9f1e tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:56.864801 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-65badd3a-42e3-4260-8d52-0c6a32fb9f1e tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 73b19398-0c2c-42ea-8b4a-86e223c090ff] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:56.873384 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-65badd3a-42e3-4260-8d52-0c6a32fb9f1e tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:56.881911 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-65badd3a-42e3-4260-8d52-0c6a32fb9f1e tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:56.883464 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-65badd3a-42e3-4260-8d52-0c6a32fb9f1e tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:56.884646 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-65badd3a-42e3-4260-8d52-0c6a32fb9f1e tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:56.885333 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-65badd3a-42e3-4260-8d52-0c6a32fb9f1e tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:56.885997 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-65badd3a-42e3-4260-8d52-0c6a32fb9f1e tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:57.160564 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.network.security_group_api [None req-5be0959a-a5b1-4cee-bf47-17b3cd649eeb tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Adding security group 328934f9-57a6-4657-91ba-7e2d53259ae7 to port 02a0fc93-d351-4671-91b7-b1c1440a5fc6 Aug 31 16:13:57.334451 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-65badd3a-42e3-4260-8d52-0c6a32fb9f1e tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:57.366181 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-65badd3a-42e3-4260-8d52-0c6a32fb9f1e tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/73b19398-0c2c-42ea-8b4a-86e223c090ff" status: 200 len: 1491 microversion: 2.1 time: 0.517100 Aug 31 16:13:57.377105 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1961/3916] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:56 2022] GET /compute/v2.1/servers/73b19398-0c2c-42ea-8b4a-86e223c090ff => generated 1491 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:57.405561 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-aacf0a32-2dcd-4dcc-93bd-1114348d0a17 req-971c4359-6b54-4901-8585-d0c3fa15ea02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd", "name": "network-vif-deleted", "tag": "1e0e4551-0c34-4d8d-ab3b-8543a1afdcca"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:13:57.420958 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-aacf0a32-2dcd-4dcc-93bd-1114348d0a17 req-971c4359-6b54-4901-8585-d0c3fa15ea02 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:57.421771 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-aacf0a32-2dcd-4dcc-93bd-1114348d0a17 req-971c4359-6b54-4901-8585-d0c3fa15ea02 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:57.422397 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-aacf0a32-2dcd-4dcc-93bd-1114348d0a17 req-971c4359-6b54-4901-8585-d0c3fa15ea02 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:57.437758 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-aacf0a32-2dcd-4dcc-93bd-1114348d0a17 req-971c4359-6b54-4901-8585-d0c3fa15ea02 service nova] Creating event network-vif-deleted:1e0e4551-0c34-4d8d-ab3b-8543a1afdcca for instance b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd on n-h2-850499-9 Aug 31 16:13:57.446706 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-aacf0a32-2dcd-4dcc-93bd-1114348d0a17 req-971c4359-6b54-4901-8585-d0c3fa15ea02 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067109 Aug 31 16:13:57.447996 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1962/3917] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:13:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:13:57.455408 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4538c8f5-5744-45e8-9c09-440ab5d6d4ee tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:13:57.458871 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4538c8f5-5744-45e8-9c09-440ab5d6d4ee tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 73b19398-0c2c-42ea-8b4a-86e223c090ff] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:57.466793 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4538c8f5-5744-45e8-9c09-440ab5d6d4ee tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:57.467786 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4538c8f5-5744-45e8-9c09-440ab5d6d4ee tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:57.468525 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4538c8f5-5744-45e8-9c09-440ab5d6d4ee tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:57.470331 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4538c8f5-5744-45e8-9c09-440ab5d6d4ee tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:57.471161 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4538c8f5-5744-45e8-9c09-440ab5d6d4ee tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:57.472504 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4538c8f5-5744-45e8-9c09-440ab5d6d4ee tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:57.594760 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4538c8f5-5744-45e8-9c09-440ab5d6d4ee tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "PUT /compute/v2.1/servers/73b19398-0c2c-42ea-8b4a-86e223c090ff" status: 200 len: 1086 microversion: 2.1 time: 0.142611 Aug 31 16:13:57.608023 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1963/3918] 10.222.0.61 () {60 vars in 1256 bytes} [Wed Aug 31 16:13:57 2022] PUT /compute/v2.1/servers/73b19398-0c2c-42ea-8b4a-86e223c090ff => generated 1086 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:57.629743 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a1f837f3-34b3-4d97-8d79-87cb350cac9c tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:57.630671 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a1f837f3-34b3-4d97-8d79-87cb350cac9c tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: c6bfb382-b9a8-4bf0-b868-ee5f51f9daac] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:57.640660 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a1f837f3-34b3-4d97-8d79-87cb350cac9c tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:57.641247 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a1f837f3-34b3-4d97-8d79-87cb350cac9c tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:57.641704 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a1f837f3-34b3-4d97-8d79-87cb350cac9c tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:57.642447 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a1f837f3-34b3-4d97-8d79-87cb350cac9c tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:57.644318 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a1f837f3-34b3-4d97-8d79-87cb350cac9c tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:57.644767 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a1f837f3-34b3-4d97-8d79-87cb350cac9c tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:57.953256 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5be0959a-a5b1-4cee-bf47-17b3cd649eeb tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] 10.222.0.61 "POST /compute/v2.1/servers/18dc9f32-b72a-4f4f-9153-a6a54f9d21b8/action" status: 202 len: 0 microversion: 2.1 time: 1.218288 Aug 31 16:13:57.956755 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1956/3919] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:13:56 2022] POST /compute/v2.1/servers/18dc9f32-b72a-4f4f-9153-a6a54f9d21b8/action => generated 0 bytes in 1224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 16:13:57.973168 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2a2cc683-cf9f-4107-937f-5a8055cb758d tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:57.975005 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2a2cc683-cf9f-4107-937f-5a8055cb758d tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 73b19398-0c2c-42ea-8b4a-86e223c090ff] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:57.998402 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2a2cc683-cf9f-4107-937f-5a8055cb758d tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:58.005186 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2a2cc683-cf9f-4107-937f-5a8055cb758d tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:58.006561 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2a2cc683-cf9f-4107-937f-5a8055cb758d tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:58.010719 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2a2cc683-cf9f-4107-937f-5a8055cb758d tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:58.014156 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2a2cc683-cf9f-4107-937f-5a8055cb758d tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:58.014957 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2a2cc683-cf9f-4107-937f-5a8055cb758d tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:58.069750 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a1f837f3-34b3-4d97-8d79-87cb350cac9c tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48ee960c38f4d0584ea5ce34579279f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a957b6585e74a31b5bc5f66441c33e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:58.087730 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a1f837f3-34b3-4d97-8d79-87cb350cac9c tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "GET /compute/v2.1/servers/c6bfb382-b9a8-4bf0-b868-ee5f51f9daac" status: 200 len: 1506 microversion: 2.1 time: 0.476806 Aug 31 16:13:58.093379 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1964/3920] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:57 2022] GET /compute/v2.1/servers/c6bfb382-b9a8-4bf0-b868-ee5f51f9daac => generated 1506 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:58.101684 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-22b50bb2-83b6-4d1b-bafc-2b7fd7fcdbf2 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:58.102821 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-22b50bb2-83b6-4d1b-bafc-2b7fd7fcdbf2 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] [instance: b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:58.111340 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-22b50bb2-83b6-4d1b-bafc-2b7fd7fcdbf2 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:58.114120 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-22b50bb2-83b6-4d1b-bafc-2b7fd7fcdbf2 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:58.114614 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-22b50bb2-83b6-4d1b-bafc-2b7fd7fcdbf2 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:58.115718 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-22b50bb2-83b6-4d1b-bafc-2b7fd7fcdbf2 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:58.116525 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-22b50bb2-83b6-4d1b-bafc-2b7fd7fcdbf2 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:58.117134 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-22b50bb2-83b6-4d1b-bafc-2b7fd7fcdbf2 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:58.198772 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-22b50bb2-83b6-4d1b-bafc-2b7fd7fcdbf2 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:58.199668 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-22b50bb2-83b6-4d1b-bafc-2b7fd7fcdbf2 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:58.200230 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-22b50bb2-83b6-4d1b-bafc-2b7fd7fcdbf2 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:58.201082 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-22b50bb2-83b6-4d1b-bafc-2b7fd7fcdbf2 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lazy-loading 'fault' on Instance uuid b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:13:58.300168 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-2a2cc683-cf9f-4107-937f-5a8055cb758d tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:58.311329 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2a2cc683-cf9f-4107-937f-5a8055cb758d tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/73b19398-0c2c-42ea-8b4a-86e223c090ff" status: 200 len: 1512 microversion: 2.1 time: 0.352886 Aug 31 16:13:58.315819 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1957/3921] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:57 2022] GET /compute/v2.1/servers/73b19398-0c2c-42ea-8b4a-86e223c090ff => generated 1512 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:58.321091 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-22b50bb2-83b6-4d1b-bafc-2b7fd7fcdbf2 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce4e5c281c4432782d96b94323cdcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db0b14e6533a4396b15f9c08657d924f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:58.333511 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5d80d841-f17f-4bde-99b4-62beae1f4c61 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Calling method '.version_select at 0x7f5ae3eb1f70>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:58.356427 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-22b50bb2-83b6-4d1b-bafc-2b7fd7fcdbf2 tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] 10.222.0.61 "GET /compute/v2.1/servers/b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd" status: 200 len: 1306 microversion: 2.1 time: 0.259805 Aug 31 16:13:58.360069 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1965/3922] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:58 2022] GET /compute/v2.1/servers/b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd => generated 1306 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:58.384488 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-bb69e096-a620-40bd-a13f-5a6d35b057d7 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:58.385468 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-bb69e096-a620-40bd-a13f-5a6d35b057d7 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 73b19398-0c2c-42ea-8b4a-86e223c090ff] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:58.401765 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bb69e096-a620-40bd-a13f-5a6d35b057d7 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:58.402536 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bb69e096-a620-40bd-a13f-5a6d35b057d7 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:58.404146 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bb69e096-a620-40bd-a13f-5a6d35b057d7 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:58.405280 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bb69e096-a620-40bd-a13f-5a6d35b057d7 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:58.405951 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bb69e096-a620-40bd-a13f-5a6d35b057d7 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:58.406583 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bb69e096-a620-40bd-a13f-5a6d35b057d7 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:58.673167 n-d-850499-9 devstack@n-api.service[122256]: DEBUG neutronclient.v2_0.client [None req-5d80d841-f17f-4bde-99b4-62beae1f4c61 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 328934f9-57a6-4657-91ba-7e2d53259ae7 in use.", "detail": ""}} {{(pid=122256) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 31 16:13:58.675101 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-5d80d841-f17f-4bde-99b4-62beae1f4c61 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] HTTP exception thrown: Security Group 328934f9-57a6-4657-91ba-7e2d53259ae7 in use. Aug 31 16:13:58.675101 n-d-850499-9 devstack@n-api.service[122256]: Neutron server returns request_ids: ['req-91a476ff-e6f6-46e7-bdd8-0f07a92a99be'] Aug 31 16:13:58.679723 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5d80d841-f17f-4bde-99b4-62beae1f4c61 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Request method failure captured: Aug 31 16:13:58.679723 n-d-850499-9 devstack@n-api.service[122256]: request: DELETE /compute/v2.1/os-security-groups/328934f9-57a6-4657-91ba-7e2d53259ae7 HTTP/1.1 Aug 31 16:13:58.679723 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:13:58.679723 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:13:58.679723 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:13:58.679723 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:13:58.679723 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:13:58.679723 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:13:58.679723 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:13:58.679723 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:13:58.679723 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4iB3ZSM042t6H57DKQNRNkGdMmN-dpZ1iYL7Qp9DB5vaoQM-CcEpndp_H4eJtfFInIhXcNSw2oPrel3OUzJ_33XKrMtGya3pa2oH-wP6jy1-79FFGtwCTUUJYiIziOxflBbp14Trh2dPFGd_PM4hgPBygRYcEqBhkOx0cf9zQWBZvc Aug 31 16:13:58.679723 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:13:58.679723 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:13:58.679723 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:13:58.679723 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:13:58.679723 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:13:58.679723 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:13:58.679723 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 9f66705b4a0f4711ba14d9ceb5699bd1 Aug 31 16:13:58.679723 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-SecurityGroupsTestJSON-269266309 Aug 31 16:13:58.679723 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:13:58.679723 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:13:58.679723 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9f66705b4a0f4711ba14d9ceb5699bd1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9f66705b4a0f4711ba14d9ceb5699bd1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9f66705b4a0f4711ba14d9ceb5699bd1", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9f66705b4a0f4711ba14d9ceb5699bd1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:13:58.679723 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-SecurityGroupsTestJSON-269266309 Aug 31 16:13:58.679723 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 9f66705b4a0f4711ba14d9ceb5699bd1 Aug 31 16:13:58.679723 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-269266309 Aug 31 16:13:58.679723 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-SecurityGroupsTestJSON-269266309-project Aug 31 16:13:58.679723 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:13:58.679723 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:13:58.679723 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 5f911026e35d40a480094376c6556d03 Aug 31 16:13:58.679723 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-SecurityGroupsTestJSON-269266309-project Aug 31 16:13:58.679723 n-d-850499-9 devstack@n-api.service[122256]: method: Aug 31 16:13:58.679723 n-d-850499-9 devstack@n-api.service[122256]: exception: Security Group 328934f9-57a6-4657-91ba-7e2d53259ae7 in use. Aug 31 16:13:58.679723 n-d-850499-9 devstack@n-api.service[122256]: Neutron server returns request_ids: ['req-91a476ff-e6f6-46e7-bdd8-0f07a92a99be'] Aug 31 16:13:58.679723 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '328934f9-57a6-4657-91ba-7e2d53259ae7'} Aug 31 16:13:58.679723 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:13:58.679723 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:58.679723 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 31 16:13:58.679723 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 31 16:13:58.679723 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:13:58.679723 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:13:58.679723 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 31 16:13:58.679723 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 31 16:13:58.679723 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:13:58.679723 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:13:58.679723 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 31 16:13:58.679723 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 31 16:13:58.679723 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:13:58.679723 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:13:58.679723 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 31 16:13:58.679723 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 31 16:13:58.679723 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:13:58.679723 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:13:58.679723 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 31 16:13:58.679723 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 31 16:13:58.679723 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:13:58.679723 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:13:58.679723 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 31 16:13:58.679723 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 31 16:13:58.679723 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 31 16:13:58.679723 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 31 16:13:58.679723 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 328934f9-57a6-4657-91ba-7e2d53259ae7 in use. Aug 31 16:13:58.684171 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-91a476ff-e6f6-46e7-bdd8-0f07a92a99be'] Aug 31 16:13:58.684171 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:13:58.684171 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:13:58.684171 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:13:58.684171 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:58.684171 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 31 16:13:58.684171 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 31 16:13:58.684171 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 31 16:13:58.684171 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 31 16:13:58.684171 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 328934f9-57a6-4657-91ba-7e2d53259ae7 in use. Aug 31 16:13:58.684171 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-91a476ff-e6f6-46e7-bdd8-0f07a92a99be'] Aug 31 16:13:58.684171 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:13:58.684171 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:13:58.684171 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:13:58.684171 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:58.684171 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:13:58.684171 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:13:58.684171 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:13:58.684171 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:13:58.684171 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:13:58.684171 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:13:58.684171 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:13:58.684171 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:13:58.684171 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 31 16:13:58.684171 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 31 16:13:58.684171 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 328934f9-57a6-4657-91ba-7e2d53259ae7 in use. Aug 31 16:13:58.684171 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-91a476ff-e6f6-46e7-bdd8-0f07a92a99be'] Aug 31 16:13:58.684171 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:13:58.684171 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:13:58.684171 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:13:58.684171 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:58.684171 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:13:58.684171 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:13:58.684171 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:13:58.684171 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:13:58.684171 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 328934f9-57a6-4657-91ba-7e2d53259ae7 in use. Aug 31 16:13:58.684171 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-91a476ff-e6f6-46e7-bdd8-0f07a92a99be'] Aug 31 16:13:58.684171 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:13:58.698383 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5d80d841-f17f-4bde-99b4-62beae1f4c61 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Returning 400 to user: Security Group 328934f9-57a6-4657-91ba-7e2d53259ae7 in use. Aug 31 16:13:58.698383 n-d-850499-9 devstack@n-api.service[122256]: Neutron server returns request_ids: ['req-91a476ff-e6f6-46e7-bdd8-0f07a92a99be'] {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:13:58.698383 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5d80d841-f17f-4bde-99b4-62beae1f4c61 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/328934f9-57a6-4657-91ba-7e2d53259ae7" status: 400 len: 185 microversion: 2.1 time: 0.371817 Aug 31 16:13:58.698383 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1958/3923] 10.222.0.61 () {58 vars in 1272 bytes} [Wed Aug 31 16:13:58 2022] DELETE /compute/v2.1/os-security-groups/328934f9-57a6-4657-91ba-7e2d53259ae7 => generated 185 bytes in 375 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:13:58.704546 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6e6c14f8-ed00-4e97-893b-139a2205fab6 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:13:58.710356 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6e6c14f8-ed00-4e97-893b-139a2205fab6 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] [instance: 18dc9f32-b72a-4f4f-9153-a6a54f9d21b8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:58.717964 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6e6c14f8-ed00-4e97-893b-139a2205fab6 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:58.718851 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6e6c14f8-ed00-4e97-893b-139a2205fab6 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:58.719799 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6e6c14f8-ed00-4e97-893b-139a2205fab6 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:58.720733 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6e6c14f8-ed00-4e97-893b-139a2205fab6 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:58.720862 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-bb69e096-a620-40bd-a13f-5a6d35b057d7 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:58.721573 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6e6c14f8-ed00-4e97-893b-139a2205fab6 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:58.722232 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6e6c14f8-ed00-4e97-893b-139a2205fab6 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:58.739254 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-bb69e096-a620-40bd-a13f-5a6d35b057d7 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/73b19398-0c2c-42ea-8b4a-86e223c090ff" status: 200 len: 1512 microversion: 2.1 time: 0.377208 Aug 31 16:13:58.741061 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1966/3924] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:58 2022] GET /compute/v2.1/servers/73b19398-0c2c-42ea-8b4a-86e223c090ff => generated 1512 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:58.765085 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-442faed2-2ae6-47a8-881e-5b1d7f2d59a8 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:58.765761 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-442faed2-2ae6-47a8-881e-5b1d7f2d59a8 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 73b19398-0c2c-42ea-8b4a-86e223c090ff] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:58.776008 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-442faed2-2ae6-47a8-881e-5b1d7f2d59a8 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:58.776673 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-442faed2-2ae6-47a8-881e-5b1d7f2d59a8 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:58.777436 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-442faed2-2ae6-47a8-881e-5b1d7f2d59a8 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:58.778371 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-442faed2-2ae6-47a8-881e-5b1d7f2d59a8 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:58.778935 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-442faed2-2ae6-47a8-881e-5b1d7f2d59a8 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:58.779471 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-442faed2-2ae6-47a8-881e-5b1d7f2d59a8 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:58.821861 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-442faed2-2ae6-47a8-881e-5b1d7f2d59a8 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 73b19398-0c2c-42ea-8b4a-86e223c090ff] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:13:58.871365 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6e6c14f8-ed00-4e97-893b-139a2205fab6 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] 10.222.0.61 "POST /compute/v2.1/servers/18dc9f32-b72a-4f4f-9153-a6a54f9d21b8/action" status: 202 len: 0 microversion: 2.1 time: 0.167251 Aug 31 16:13:58.872578 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1959/3925] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:13:58 2022] POST /compute/v2.1/servers/18dc9f32-b72a-4f4f-9153-a6a54f9d21b8/action => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:13:58.884069 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-aeeb88ec-a50a-4e11-bd66-02f8e0d22514 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:58.890146 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-aeeb88ec-a50a-4e11-bd66-02f8e0d22514 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] [instance: 18dc9f32-b72a-4f4f-9153-a6a54f9d21b8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:58.900675 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aeeb88ec-a50a-4e11-bd66-02f8e0d22514 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:58.901497 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aeeb88ec-a50a-4e11-bd66-02f8e0d22514 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:58.914244 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aeeb88ec-a50a-4e11-bd66-02f8e0d22514 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:58.916839 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aeeb88ec-a50a-4e11-bd66-02f8e0d22514 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:58.917390 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aeeb88ec-a50a-4e11-bd66-02f8e0d22514 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:58.917846 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aeeb88ec-a50a-4e11-bd66-02f8e0d22514 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:59.059367 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-442faed2-2ae6-47a8-881e-5b1d7f2d59a8 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "DELETE /compute/v2.1/servers/73b19398-0c2c-42ea-8b4a-86e223c090ff" status: 204 len: 0 microversion: 2.1 time: 0.297890 Aug 31 16:13:59.061263 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1967/3926] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:13:58 2022] DELETE /compute/v2.1/servers/73b19398-0c2c-42ea-8b4a-86e223c090ff => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 16:13:59.079314 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f89dd2fb-0915-4d62-b2ac-fb1e832670d0 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:59.080209 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f89dd2fb-0915-4d62-b2ac-fb1e832670d0 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 73b19398-0c2c-42ea-8b4a-86e223c090ff] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:59.098743 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f89dd2fb-0915-4d62-b2ac-fb1e832670d0 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:59.099715 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f89dd2fb-0915-4d62-b2ac-fb1e832670d0 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:59.101006 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f89dd2fb-0915-4d62-b2ac-fb1e832670d0 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:59.102140 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f89dd2fb-0915-4d62-b2ac-fb1e832670d0 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:59.104383 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f89dd2fb-0915-4d62-b2ac-fb1e832670d0 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:59.109667 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f89dd2fb-0915-4d62-b2ac-fb1e832670d0 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:59.374367 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-aeeb88ec-a50a-4e11-bd66-02f8e0d22514 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f911026e35d40a480094376c6556d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f66705b4a0f4711ba14d9ceb5699bd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:59.387286 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-aeeb88ec-a50a-4e11-bd66-02f8e0d22514 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] 10.222.0.61 "GET /compute/v2.1/servers/18dc9f32-b72a-4f4f-9153-a6a54f9d21b8" status: 200 len: 1575 microversion: 2.1 time: 0.509981 Aug 31 16:13:59.388104 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1960/3927] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:58 2022] GET /compute/v2.1/servers/18dc9f32-b72a-4f4f-9153-a6a54f9d21b8 => generated 1575 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:59.393600 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8f9c55a1-ad6a-4aad-8dda-b6ed7ea2e8a7 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:59.394569 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8f9c55a1-ad6a-4aad-8dda-b6ed7ea2e8a7 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: c6bfb382-b9a8-4bf0-b868-ee5f51f9daac] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:59.401242 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8f9c55a1-ad6a-4aad-8dda-b6ed7ea2e8a7 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:59.402045 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8f9c55a1-ad6a-4aad-8dda-b6ed7ea2e8a7 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:59.402869 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8f9c55a1-ad6a-4aad-8dda-b6ed7ea2e8a7 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:59.404277 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8f9c55a1-ad6a-4aad-8dda-b6ed7ea2e8a7 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:59.404957 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8f9c55a1-ad6a-4aad-8dda-b6ed7ea2e8a7 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:59.405703 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8f9c55a1-ad6a-4aad-8dda-b6ed7ea2e8a7 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:59.592352 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f89dd2fb-0915-4d62-b2ac-fb1e832670d0 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:59.606494 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f89dd2fb-0915-4d62-b2ac-fb1e832670d0 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/73b19398-0c2c-42ea-8b4a-86e223c090ff" status: 200 len: 1518 microversion: 2.1 time: 0.538164 Aug 31 16:13:59.620490 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1968/3928] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:59 2022] GET /compute/v2.1/servers/73b19398-0c2c-42ea-8b4a-86e223c090ff => generated 1518 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:13:59.632093 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e9d1eccf-a869-4ae9-9152-0537a614d54b tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:59.636407 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e9d1eccf-a869-4ae9-9152-0537a614d54b tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] [instance: b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:59.646209 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e9d1eccf-a869-4ae9-9152-0537a614d54b tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:59.646634 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e9d1eccf-a869-4ae9-9152-0537a614d54b tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:59.648170 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e9d1eccf-a869-4ae9-9152-0537a614d54b tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:59.649195 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e9d1eccf-a869-4ae9-9152-0537a614d54b tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:59.649958 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e9d1eccf-a869-4ae9-9152-0537a614d54b tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:59.651113 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e9d1eccf-a869-4ae9-9152-0537a614d54b tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:59.677212 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-e9d1eccf-a869-4ae9-9152-0537a614d54b tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] HTTP exception thrown: Instance b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd could not be found. Aug 31 16:13:59.678959 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e9d1eccf-a869-4ae9-9152-0537a614d54b tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Request method failure captured: Aug 31 16:13:59.678959 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd HTTP/1.1 Aug 31 16:13:59.678959 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:13:59.678959 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:13:59.678959 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:13:59.678959 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:13:59.678959 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:13:59.678959 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:13:59.678959 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:13:59.678959 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:13:59.678959 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4ieIESqMSRSI34AZE1lWr9ij9u35-n0OOrprPf7PCeyIM1ASL9ebK05DKl-uypIH4W7eIvArtiTdlKnj9dyd7oQvJGcEt9Vc40gBiOOtDuxW4lmtl7FWjURAl9-ZS1GtzajQD9e7ioUXrP3c7F2cweUKEhlNHS3ELvyJA2Yj9mla3s Aug 31 16:13:59.678959 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:13:59.678959 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:13:59.678959 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:13:59.678959 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:13:59.678959 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:13:59.678959 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:13:59.678959 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: db0b14e6533a4396b15f9c08657d924f Aug 31 16:13:59.678959 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-InstanceActionsTestJSON-1187330643 Aug 31 16:13:59.678959 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:13:59.678959 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:13:59.678959 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/db0b14e6533a4396b15f9c08657d924f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/db0b14e6533a4396b15f9c08657d924f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_db0b14e6533a4396b15f9c08657d924f", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/db0b14e6533a4396b15f9c08657d924f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:13:59.678959 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-InstanceActionsTestJSON-1187330643 Aug 31 16:13:59.678959 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: db0b14e6533a4396b15f9c08657d924f Aug 31 16:13:59.678959 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-InstanceActionsTestJSON-1187330643 Aug 31 16:13:59.678959 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-InstanceActionsTestJSON-1187330643-project Aug 31 16:13:59.678959 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:13:59.678959 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:13:59.678959 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 3ce4e5c281c4432782d96b94323cdcc9 Aug 31 16:13:59.678959 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-InstanceActionsTestJSON-1187330643-project Aug 31 16:13:59.678959 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:13:59.678959 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd could not be found. Aug 31 16:13:59.678959 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': 'b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd'} Aug 31 16:13:59.678959 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:13:59.678959 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:59.678959 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:13:59.678959 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:13:59.678959 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:13:59.678959 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:13:59.678959 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:13:59.678959 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:13:59.678959 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:13:59.678959 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:13:59.678959 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd could not be found. Aug 31 16:13:59.678959 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:13:59.678959 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:13:59.678959 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:13:59.678959 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:59.678959 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:13:59.678959 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:13:59.678959 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:13:59.678959 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:13:59.678959 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:13:59.678959 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:13:59.678959 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:13:59.678959 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:13:59.678959 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:13:59.678959 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:13:59.678959 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:13:59.678959 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:13:59.678959 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd could not be found. Aug 31 16:13:59.678959 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:13:59.678959 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:13:59.678959 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:13:59.684187 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:59.684187 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:13:59.684187 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:13:59.684187 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:13:59.684187 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:13:59.684187 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd could not be found. Aug 31 16:13:59.684187 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:13:59.684187 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e9d1eccf-a869-4ae9-9152-0537a614d54b tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] Returning 404 to user: Instance b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:13:59.684187 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e9d1eccf-a869-4ae9-9152-0537a614d54b tempest-InstanceActionsTestJSON-1187330643 tempest-InstanceActionsTestJSON-1187330643-project] 10.222.0.61 "GET /compute/v2.1/servers/b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd" status: 404 len: 111 microversion: 2.1 time: 0.058724 Aug 31 16:13:59.684187 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1969/3929] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:59 2022] GET /compute/v2.1/servers/b9a6c1e0-ade5-4e9b-ab35-19ea26f11edd => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:13:59.687302 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-bc0c2cb1-6988-42be-bb6c-b46a8a22f3ac req-75077256-a874-4789-9148-06cff615ae4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18dc9f32-b72a-4f4f-9153-a6a54f9d21b8", "tag": "02a0fc93-d351-4671-91b7-b1c1440a5fc6"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:13:59.703168 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-bc0c2cb1-6988-42be-bb6c-b46a8a22f3ac req-75077256-a874-4789-9148-06cff615ae4f service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:59.703876 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-bc0c2cb1-6988-42be-bb6c-b46a8a22f3ac req-75077256-a874-4789-9148-06cff615ae4f service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:59.704321 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-bc0c2cb1-6988-42be-bb6c-b46a8a22f3ac req-75077256-a874-4789-9148-06cff615ae4f service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:59.720046 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-bc0c2cb1-6988-42be-bb6c-b46a8a22f3ac req-75077256-a874-4789-9148-06cff615ae4f service nova] Creating event network-changed:02a0fc93-d351-4671-91b7-b1c1440a5fc6 for instance 18dc9f32-b72a-4f4f-9153-a6a54f9d21b8 on n-h2-850499-9 Aug 31 16:13:59.727480 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-bc0c2cb1-6988-42be-bb6c-b46a8a22f3ac req-75077256-a874-4789-9148-06cff615ae4f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044378 Aug 31 16:13:59.728592 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1970/3930] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:13:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:13:59.740356 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8f9c55a1-ad6a-4aad-8dda-b6ed7ea2e8a7 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48ee960c38f4d0584ea5ce34579279f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a957b6585e74a31b5bc5f66441c33e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:59.749703 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8f9c55a1-ad6a-4aad-8dda-b6ed7ea2e8a7 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "GET /compute/v2.1/servers/c6bfb382-b9a8-4bf0-b868-ee5f51f9daac" status: 200 len: 1506 microversion: 2.1 time: 0.360217 Aug 31 16:13:59.750330 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1961/3931] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:59 2022] GET /compute/v2.1/servers/c6bfb382-b9a8-4bf0-b868-ee5f51f9daac => generated 1506 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:00.430861 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-025f5ac6-bc99-412a-95db-1841e79f3c71 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:00.431755 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-025f5ac6-bc99-412a-95db-1841e79f3c71 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] [instance: 18dc9f32-b72a-4f4f-9153-a6a54f9d21b8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:00.453709 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-025f5ac6-bc99-412a-95db-1841e79f3c71 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:00.453709 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-025f5ac6-bc99-412a-95db-1841e79f3c71 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:00.453709 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-025f5ac6-bc99-412a-95db-1841e79f3c71 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:00.458835 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-025f5ac6-bc99-412a-95db-1841e79f3c71 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:00.459645 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-025f5ac6-bc99-412a-95db-1841e79f3c71 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:00.460187 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-025f5ac6-bc99-412a-95db-1841e79f3c71 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:00.646081 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4ffbdad9-623b-4bdd-843d-afa645f6b78a tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:00.647614 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4ffbdad9-623b-4bdd-843d-afa645f6b78a tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 73b19398-0c2c-42ea-8b4a-86e223c090ff] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:00.655589 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4ffbdad9-623b-4bdd-843d-afa645f6b78a tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:00.656463 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4ffbdad9-623b-4bdd-843d-afa645f6b78a tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:00.657252 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4ffbdad9-623b-4bdd-843d-afa645f6b78a tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:00.657975 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4ffbdad9-623b-4bdd-843d-afa645f6b78a tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:00.659366 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4ffbdad9-623b-4bdd-843d-afa645f6b78a tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:00.660241 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4ffbdad9-623b-4bdd-843d-afa645f6b78a tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:00.821114 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-025f5ac6-bc99-412a-95db-1841e79f3c71 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f911026e35d40a480094376c6556d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f66705b4a0f4711ba14d9ceb5699bd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:00.830027 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-025f5ac6-bc99-412a-95db-1841e79f3c71 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] 10.222.0.61 "GET /compute/v2.1/servers/18dc9f32-b72a-4f4f-9153-a6a54f9d21b8" status: 200 len: 1580 microversion: 2.1 time: 0.405088 Aug 31 16:14:00.834833 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1971/3932] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:00 2022] GET /compute/v2.1/servers/18dc9f32-b72a-4f4f-9153-a6a54f9d21b8 => generated 1580 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:00.843125 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-54f8420e-67c7-4734-81cc-08aef513785d tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:00.845869 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-54f8420e-67c7-4734-81cc-08aef513785d tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] [instance: af6da672-bcfb-433b-b868-3dd1dd3e4770] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:00.855315 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-54f8420e-67c7-4734-81cc-08aef513785d tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:00.856126 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-54f8420e-67c7-4734-81cc-08aef513785d tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:00.857232 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-54f8420e-67c7-4734-81cc-08aef513785d tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:00.859639 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-54f8420e-67c7-4734-81cc-08aef513785d tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:00.860475 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-54f8420e-67c7-4734-81cc-08aef513785d tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:00.861185 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-54f8420e-67c7-4734-81cc-08aef513785d tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:00.869976 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:14:00.909389 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-54f8420e-67c7-4734-81cc-08aef513785d tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] [instance: af6da672-bcfb-433b-b868-3dd1dd3e4770] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:14:00.933423 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-4ffbdad9-623b-4bdd-843d-afa645f6b78a tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:00.946190 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4ffbdad9-623b-4bdd-843d-afa645f6b78a tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/73b19398-0c2c-42ea-8b4a-86e223c090ff" status: 200 len: 1518 microversion: 2.1 time: 0.310745 Aug 31 16:14:00.947380 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1962/3933] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:00 2022] GET /compute/v2.1/servers/73b19398-0c2c-42ea-8b4a-86e223c090ff => generated 1518 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:00.960686 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1393bf2a-0b08-4eb2-aeff-5f74bc04a2cb tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:00.963724 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1393bf2a-0b08-4eb2-aeff-5f74bc04a2cb tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: c6bfb382-b9a8-4bf0-b868-ee5f51f9daac] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:00.993755 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1393bf2a-0b08-4eb2-aeff-5f74bc04a2cb tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:00.994561 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1393bf2a-0b08-4eb2-aeff-5f74bc04a2cb tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:00.998855 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1393bf2a-0b08-4eb2-aeff-5f74bc04a2cb tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:01.000556 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1393bf2a-0b08-4eb2-aeff-5f74bc04a2cb tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:01.001650 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1393bf2a-0b08-4eb2-aeff-5f74bc04a2cb tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:01.003627 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1393bf2a-0b08-4eb2-aeff-5f74bc04a2cb tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:01.074521 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-54f8420e-67c7-4734-81cc-08aef513785d tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] 10.222.0.61 "DELETE /compute/v2.1/servers/af6da672-bcfb-433b-b868-3dd1dd3e4770" status: 204 len: 0 microversion: 2.1 time: 0.237058 Aug 31 16:14:01.076669 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1972/3934] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:14:00 2022] DELETE /compute/v2.1/servers/af6da672-bcfb-433b-b868-3dd1dd3e4770 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:14:01.090673 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c4a51e13-33f6-4f27-83c0-b6d84487d886 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:01.098446 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c4a51e13-33f6-4f27-83c0-b6d84487d886 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] [instance: af6da672-bcfb-433b-b868-3dd1dd3e4770] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:01.118210 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c4a51e13-33f6-4f27-83c0-b6d84487d886 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:01.119641 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c4a51e13-33f6-4f27-83c0-b6d84487d886 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:01.120713 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c4a51e13-33f6-4f27-83c0-b6d84487d886 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:01.139943 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c4a51e13-33f6-4f27-83c0-b6d84487d886 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:01.141770 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c4a51e13-33f6-4f27-83c0-b6d84487d886 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:01.144608 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c4a51e13-33f6-4f27-83c0-b6d84487d886 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:01.252783 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1393bf2a-0b08-4eb2-aeff-5f74bc04a2cb tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48ee960c38f4d0584ea5ce34579279f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a957b6585e74a31b5bc5f66441c33e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:01.264601 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1393bf2a-0b08-4eb2-aeff-5f74bc04a2cb tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "GET /compute/v2.1/servers/c6bfb382-b9a8-4bf0-b868-ee5f51f9daac" status: 200 len: 1506 microversion: 2.1 time: 0.315358 Aug 31 16:14:01.265593 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1963/3935] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:00 2022] GET /compute/v2.1/servers/c6bfb382-b9a8-4bf0-b868-ee5f51f9daac => generated 1506 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:01.513171 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-578ff4f2-ba70-4cec-a77c-0b49e79dae96 tempest-KeyPairsNegativeTestJSON-1356891054 tempest-KeyPairsNegativeTestJSON-1356891054-project] Action: 'create', calling method: .version_select at 0x7f5ae3e0ed30>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNSqZILKqjAyQkDNfmaWOvC7uPsStW/kcqD4E92VVcvBjBID+RhWsFXtnWiJIicQrjEC6bApV/1fMHuu7hjsXN3grIHk3hZCrhRz8sMURmRlTr6LD6hH59oX1gqmih2B3g=="}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:14:01.524727 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-578ff4f2-ba70-4cec-a77c-0b49e79dae96 tempest-KeyPairsNegativeTestJSON-1356891054 tempest-KeyPairsNegativeTestJSON-1356891054-project] Request method failure captured: Aug 31 16:14:01.524727 n-d-850499-9 devstack@n-api.service[122256]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 31 16:14:01.524727 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:14:01.524727 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:14:01.524727 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:14:01.524727 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 257 Aug 31 16:14:01.524727 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:14:01.524727 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:14:01.524727 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:14:01.524727 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:14:01.524727 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4jIePxATxCjJas_Nzop5UWsnsc5b-mqF1_jhOnqMEu4bPb00nOEB2Dm3Zkd9qMEN6DU-32QLGSZDn9ygQxgA0kW02XopnLDWFYYZWkbx_5h829aflF_BcvYra8O9bjKC3PbSaE0WnCsZSpAMl_Tlww2btyhaJU0Jv3nrcIJ2dqKi0M Aug 31 16:14:01.524727 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:14:01.524727 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:14:01.524727 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:14:01.524727 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:14:01.524727 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:14:01.524727 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:14:01.524727 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: d9bf084be077475492075cc6444d269e Aug 31 16:14:01.524727 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1356891054 Aug 31 16:14:01.524727 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:14:01.524727 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:14:01.524727 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d9bf084be077475492075cc6444d269e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/d9bf084be077475492075cc6444d269e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_d9bf084be077475492075cc6444d269e", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d9bf084be077475492075cc6444d269e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:14:01.524727 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1356891054 Aug 31 16:14:01.524727 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: d9bf084be077475492075cc6444d269e Aug 31 16:14:01.524727 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1356891054 Aug 31 16:14:01.524727 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-KeyPairsNegativeTestJSON-1356891054-project Aug 31 16:14:01.524727 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:14:01.524727 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:14:01.524727 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 10283b72258b47318cbd2bbe6d009703 Aug 31 16:14:01.524727 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1356891054-project Aug 31 16:14:01.524727 n-d-850499-9 devstack@n-api.service[122256]: Aug 31 16:14:01.524727 n-d-850499-9 devstack@n-api.service[122256]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNSqZILKqjAyQkDNfmaWOvC7uPsStW/kcqD4E92VVcvBjBID+RhWsFXtnWiJIicQrjEC6bApV/1fMHuu7hjsXN3grIHk3hZCrhRz8sMURmRlTr6LD6hH59oX1gqmih2B3g=="}} Aug 31 16:14:01.524727 n-d-850499-9 devstack@n-api.service[122256]: method: Aug 31 16:14:01.524727 n-d-850499-9 devstack@n-api.service[122256]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 31 16:14:01.524727 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNSqZILKqjAyQkDNfmaWOvC7uPsStW/kcqD4E92VVcvBjBID+RhWsFXtnWiJIicQrjEC6bApV/1fMHuu7hjsXN3grIHk3hZCrhRz8sMURmRlTr6LD6hH59oX1gqmih2B3g=='}}} Aug 31 16:14:01.524727 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:14:01.524727 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:01.524727 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 31 16:14:01.524727 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 31 16:14:01.524727 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Aug 31 16:14:01.524727 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Aug 31 16:14:01.524727 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Aug 31 16:14:01.524727 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Aug 31 16:14:01.524727 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 31 16:14:01.524727 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:14:01.524727 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 31 16:14:01.524727 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:14:01.524727 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:01.524727 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 16:14:01.524727 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 16:14:01.524727 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 16:14:01.524727 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise error Aug 31 16:14:01.524727 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Aug 31 16:14:01.524727 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:14:01.524727 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Aug 31 16:14:01.524727 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Aug 31 16:14:01.524727 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Aug 31 16:14:01.524727 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi 'minLength': 1, Aug 31 16:14:01.524727 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 31 16:14:01.524727 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:14:01.524727 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Aug 31 16:14:01.524727 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Aug 31 16:14:01.524727 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:14:01.529787 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:14:01.529787 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:14:01.529787 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:01.529787 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:14:01.529787 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:14:01.529787 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:14:01.529787 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:14:01.529787 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:14:01.529787 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:14:01.529787 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:14:01.529787 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:14:01.529787 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:14:01.529787 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:14:01.529787 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 16:14:01.529787 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 16:14:01.529787 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 16:14:01.529787 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 16:14:01.529787 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 16:14:01.529787 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 16:14:01.529787 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 31 16:14:01.529787 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:14:01.529787 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:14:01.529787 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:14:01.529787 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:01.529787 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:14:01.529787 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:14:01.529787 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 16:14:01.529787 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 16:14:01.529787 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 31 16:14:01.529787 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:14:01.534571 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-578ff4f2-ba70-4cec-a77c-0b49e79dae96 tempest-KeyPairsNegativeTestJSON-1356891054 tempest-KeyPairsNegativeTestJSON-1356891054-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:14:01.535517 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-578ff4f2-ba70-4cec-a77c-0b49e79dae96 tempest-KeyPairsNegativeTestJSON-1356891054 tempest-KeyPairsNegativeTestJSON-1356891054-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.267685 Aug 31 16:14:01.536111 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1964/3936] 10.222.0.61 () {60 vars in 1159 bytes} [Wed Aug 31 16:14:01 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 269 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:14:01.555572 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-890754a9-6a14-4bfc-b4a3-5373ecd890da tempest-KeyPairsNegativeTestJSON-1356891054 tempest-KeyPairsNegativeTestJSON-1356891054-project] Action: 'create', calling method: .version_select at 0x7f5ae3e1a3a0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1732986005", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:14:01.582629 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-890754a9-6a14-4bfc-b4a3-5373ecd890da tempest-KeyPairsNegativeTestJSON-1356891054 tempest-KeyPairsNegativeTestJSON-1356891054-project] Getting quotas for project d9bf084be077475492075cc6444d269e. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:14:01.593832 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-890754a9-6a14-4bfc-b4a3-5373ecd890da tempest-KeyPairsNegativeTestJSON-1356891054 tempest-KeyPairsNegativeTestJSON-1356891054-project] Getting quotas for user 10283b72258b47318cbd2bbe6d009703 and project d9bf084be077475492075cc6444d269e. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:14:01.617788 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-890754a9-6a14-4bfc-b4a3-5373ecd890da tempest-KeyPairsNegativeTestJSON-1356891054 tempest-KeyPairsNegativeTestJSON-1356891054-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 31 16:14:01.658047 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-890754a9-6a14-4bfc-b4a3-5373ecd890da tempest-KeyPairsNegativeTestJSON-1356891054 tempest-KeyPairsNegativeTestJSON-1356891054-project] Request method failure captured: Aug 31 16:14:01.658047 n-d-850499-9 devstack@n-api.service[122256]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 31 16:14:01.658047 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:14:01.658047 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:14:01.658047 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:14:01.658047 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 2167 Aug 31 16:14:01.658047 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:14:01.658047 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:14:01.658047 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:14:01.658047 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:14:01.658047 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4jIePxATxCjJas_Nzop5UWsnsc5b-mqF1_jhOnqMEu4bPb00nOEB2Dm3Zkd9qMEN6DU-32QLGSZDn9ygQxgA0kW02XopnLDWFYYZWkbx_5h829aflF_BcvYra8O9bjKC3PbSaE0WnCsZSpAMl_Tlww2btyhaJU0Jv3nrcIJ2dqKi0M Aug 31 16:14:01.658047 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:14:01.658047 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:14:01.658047 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:14:01.658047 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:14:01.658047 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:14:01.658047 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:14:01.658047 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: d9bf084be077475492075cc6444d269e Aug 31 16:14:01.658047 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1356891054 Aug 31 16:14:01.658047 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:14:01.658047 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:14:01.658047 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d9bf084be077475492075cc6444d269e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/d9bf084be077475492075cc6444d269e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_d9bf084be077475492075cc6444d269e", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d9bf084be077475492075cc6444d269e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:14:01.658047 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1356891054 Aug 31 16:14:01.658047 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: d9bf084be077475492075cc6444d269e Aug 31 16:14:01.658047 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1356891054 Aug 31 16:14:01.658047 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-KeyPairsNegativeTestJSON-1356891054-project Aug 31 16:14:01.658047 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:14:01.658047 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:14:01.658047 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 10283b72258b47318cbd2bbe6d009703 Aug 31 16:14:01.658047 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1356891054-project Aug 31 16:14:01.658047 n-d-850499-9 devstack@n-api.service[122256]: Aug 31 16:14:01.658047 n-d-850499-9 devstack@n-api.service[122256]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1732986005", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Aug 31 16:14:01.658047 n-d-850499-9 devstack@n-api.service[122256]: method: Aug 31 16:14:01.658047 n-d-850499-9 devstack@n-api.service[122256]: exception: Keypair data is invalid: failed to generate fingerprint Aug 31 16:14:01.665638 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1732986005', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Aug 31 16:14:01.665638 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:14:01.665638 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:01.665638 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 31 16:14:01.665638 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 31 16:14:01.665638 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Aug 31 16:14:01.665638 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Aug 31 16:14:01.665638 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Aug 31 16:14:01.665638 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:14:01.665638 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:14:01.665638 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:14:01.665638 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:01.665638 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 31 16:14:01.665638 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 31 16:14:01.665638 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 31 16:14:01.665638 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 31 16:14:01.665638 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 16:14:01.665638 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 31 16:14:01.665638 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 16:14:01.665638 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise self.value Aug 31 16:14:01.665638 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 31 16:14:01.665638 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 31 16:14:01.665638 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6772, in import_key_pair Aug 31 16:14:01.665638 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 31 16:14:01.665638 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6845, in _generate_fingerprint Aug 31 16:14:01.665638 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 31 16:14:01.665638 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 31 16:14:01.665638 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 31 16:14:01.665638 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 31 16:14:01.665638 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:14:01.665638 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:14:01.665638 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:14:01.665638 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:01.665638 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:14:01.665638 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:14:01.665638 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:14:01.665638 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:14:01.665638 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:14:01.665638 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:14:01.665638 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:14:01.665638 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:14:01.669511 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:14:01.669511 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:14:01.669511 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:14:01.669511 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:14:01.669511 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 31 16:14:01.669511 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 31 16:14:01.669511 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 31 16:14:01.669511 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 31 16:14:01.669511 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 31 16:14:01.669511 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:14:01.669511 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:14:01.669511 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:14:01.669511 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:01.669511 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:14:01.669511 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:14:01.669511 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:14:01.669511 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:14:01.669511 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 31 16:14:01.669511 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:14:01.669511 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-890754a9-6a14-4bfc-b4a3-5373ecd890da tempest-KeyPairsNegativeTestJSON-1356891054 tempest-KeyPairsNegativeTestJSON-1356891054-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:14:01.669511 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-890754a9-6a14-4bfc-b4a3-5373ecd890da tempest-KeyPairsNegativeTestJSON-1356891054 tempest-KeyPairsNegativeTestJSON-1356891054-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.113130 Aug 31 16:14:01.676007 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1965/3937] 10.222.0.61 () {60 vars in 1160 bytes} [Wed Aug 31 16:14:01 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 124 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 31 16:14:01.694269 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-752dca97-239b-42bc-857a-0a0dff97117f tempest-KeyPairsNegativeTestJSON-1356891054 tempest-KeyPairsNegativeTestJSON-1356891054-project] Action: 'create', calling method: .version_select at 0x7f5ae3e0e8b0>, body: {"keypair": {"name": "tempest-keypair-1300287050", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANTqFPJafId1Wl42XdmIWLkTg+sOPBNNq8cMnewvixZPiXi2ajrKlT9MF4t2s5aNtC8w7z9ZVdBcUVibwtUt4qHAmKu9q3JfJRxK3Mbhhw92V+VVPuCc9q+uEe0XIyTFw=="}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:14:01.718171 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-752dca97-239b-42bc-857a-0a0dff97117f tempest-KeyPairsNegativeTestJSON-1356891054 tempest-KeyPairsNegativeTestJSON-1356891054-project] Getting quotas for project d9bf084be077475492075cc6444d269e. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:14:01.725378 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c4a51e13-33f6-4f27-83c0-b6d84487d886 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea74590916f437b9722321f420ca2a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805e39cb57794a138813c776b889741f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:01.727623 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-752dca97-239b-42bc-857a-0a0dff97117f tempest-KeyPairsNegativeTestJSON-1356891054 tempest-KeyPairsNegativeTestJSON-1356891054-project] Getting quotas for user 10283b72258b47318cbd2bbe6d009703 and project d9bf084be077475492075cc6444d269e. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:14:01.740686 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c4a51e13-33f6-4f27-83c0-b6d84487d886 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] 10.222.0.61 "GET /compute/v2.1/servers/af6da672-bcfb-433b-b868-3dd1dd3e4770" status: 200 len: 1665 microversion: 2.1 time: 0.659298 Aug 31 16:14:01.741288 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1973/3938] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:01 2022] GET /compute/v2.1/servers/af6da672-bcfb-433b-b868-3dd1dd3e4770 => generated 1665 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:14:01.775139 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-752dca97-239b-42bc-857a-0a0dff97117f tempest-KeyPairsNegativeTestJSON-1356891054 tempest-KeyPairsNegativeTestJSON-1356891054-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.089407 Aug 31 16:14:01.776267 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1966/3939] 10.222.0.61 () {60 vars in 1159 bytes} [Wed Aug 31 16:14:01 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:14:01.793736 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-45cae938-9f8b-40d9-9746-abe0d319ad23 tempest-KeyPairsNegativeTestJSON-1356891054 tempest-KeyPairsNegativeTestJSON-1356891054-project] Action: 'create', calling method: .version_select at 0x7f5ae857b3a0>, body: {"keypair": {"name": "tempest-keypair-1300287050", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBqJ9SzNbSqLlTuobx/EdpFZ1cr1UVvPgfen8P8cDVOuioU1enKIHJPHunVjNP3uw+CE137fwh33FDFaQgRfowRqPlGUcYZJF3kb/jlfJ6tdx+wPWBSWPC6tp/kPFFc7hg=="}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:14:01.821397 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-45cae938-9f8b-40d9-9746-abe0d319ad23 tempest-KeyPairsNegativeTestJSON-1356891054 tempest-KeyPairsNegativeTestJSON-1356891054-project] Getting quotas for project d9bf084be077475492075cc6444d269e. Resources: {'key_pairs'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:14:01.829665 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-45cae938-9f8b-40d9-9746-abe0d319ad23 tempest-KeyPairsNegativeTestJSON-1356891054 tempest-KeyPairsNegativeTestJSON-1356891054-project] Getting quotas for user 10283b72258b47318cbd2bbe6d009703 and project d9bf084be077475492075cc6444d269e. Resources: {'key_pairs'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:14:01.854962 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-815c9f80-6b18-4ae7-bf3d-455215bff2d9 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:01.858963 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-815c9f80-6b18-4ae7-bf3d-455215bff2d9 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] [instance: 18dc9f32-b72a-4f4f-9153-a6a54f9d21b8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:01.866389 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-45cae938-9f8b-40d9-9746-abe0d319ad23 tempest-KeyPairsNegativeTestJSON-1356891054 tempest-KeyPairsNegativeTestJSON-1356891054-project] HTTP exception thrown: Key pair 'tempest-keypair-1300287050' already exists. Aug 31 16:14:01.873308 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-815c9f80-6b18-4ae7-bf3d-455215bff2d9 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:01.874401 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-815c9f80-6b18-4ae7-bf3d-455215bff2d9 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:01.875239 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-815c9f80-6b18-4ae7-bf3d-455215bff2d9 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:01.877246 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-45cae938-9f8b-40d9-9746-abe0d319ad23 tempest-KeyPairsNegativeTestJSON-1356891054 tempest-KeyPairsNegativeTestJSON-1356891054-project] Request method failure captured: Aug 31 16:14:01.877246 n-d-850499-9 devstack@n-api.service[122257]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 31 16:14:01.877246 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:14:01.877246 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:14:01.877246 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:14:01.877246 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 273 Aug 31 16:14:01.877246 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:14:01.877246 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:14:01.877246 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:14:01.877246 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:14:01.877246 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4jIePxATxCjJas_Nzop5UWsnsc5b-mqF1_jhOnqMEu4bPb00nOEB2Dm3Zkd9qMEN6DU-32QLGSZDn9ygQxgA0kW02XopnLDWFYYZWkbx_5h829aflF_BcvYra8O9bjKC3PbSaE0WnCsZSpAMl_Tlww2btyhaJU0Jv3nrcIJ2dqKi0M Aug 31 16:14:01.877246 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:14:01.877246 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:14:01.877246 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:14:01.877246 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:14:01.877246 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:14:01.877246 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:14:01.877246 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: d9bf084be077475492075cc6444d269e Aug 31 16:14:01.877246 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1356891054 Aug 31 16:14:01.877246 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:14:01.877246 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:14:01.877246 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d9bf084be077475492075cc6444d269e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/d9bf084be077475492075cc6444d269e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_d9bf084be077475492075cc6444d269e", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d9bf084be077475492075cc6444d269e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:14:01.877246 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1356891054 Aug 31 16:14:01.877246 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: d9bf084be077475492075cc6444d269e Aug 31 16:14:01.877246 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1356891054 Aug 31 16:14:01.877246 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-KeyPairsNegativeTestJSON-1356891054-project Aug 31 16:14:01.877246 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:14:01.877246 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:14:01.877246 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 10283b72258b47318cbd2bbe6d009703 Aug 31 16:14:01.877246 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1356891054-project Aug 31 16:14:01.877246 n-d-850499-9 devstack@n-api.service[122257]: Aug 31 16:14:01.877246 n-d-850499-9 devstack@n-api.service[122257]: {"keypair": {"name": "tempest-keypair-1300287050", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBqJ9SzNbSqLlTuobx/EdpFZ1cr1UVvPgfen8P8cDVOuioU1enKIHJPHunVjNP3uw+CE137fwh33FDFaQgRfowRqPlGUcYZJF3kb/jlfJ6tdx+wPWBSWPC6tp/kPFFc7hg=="}} Aug 31 16:14:01.877246 n-d-850499-9 devstack@n-api.service[122257]: method: Aug 31 16:14:01.877246 n-d-850499-9 devstack@n-api.service[122257]: exception: Key pair 'tempest-keypair-1300287050' already exists. Aug 31 16:14:01.877246 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-1300287050', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBqJ9SzNbSqLlTuobx/EdpFZ1cr1UVvPgfen8P8cDVOuioU1enKIHJPHunVjNP3uw+CE137fwh33FDFaQgRfowRqPlGUcYZJF3kb/jlfJ6tdx+wPWBSWPC6tp/kPFFc7hg=='}}} Aug 31 16:14:01.877246 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:14:01.877246 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:01.877246 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 16:14:01.877246 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 31 16:14:01.877246 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 16:14:01.877246 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 31 16:14:01.877246 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 16:14:01.877246 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 31 16:14:01.877246 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 16:14:01.877246 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 31 16:14:01.877246 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 16:14:01.877246 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 16:14:01.877246 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 16:14:01.877246 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi result.read() Aug 31 16:14:01.877246 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 16:14:01.877246 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 31 16:14:01.877246 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 16:14:01.877246 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 31 16:14:01.877246 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 16:14:01.877246 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 31 16:14:01.877246 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 16:14:01.877246 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 31 16:14:01.877246 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '10283b72258b47318cbd2bbe6d009703-tempest-keypair-1300287050' for key 'key_pairs.uniq_key_pairs0user_id0name'") Aug 31 16:14:01.877246 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:14:01.883903 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 31 16:14:01.883903 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:14:01.883903 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:01.883903 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Aug 31 16:14:01.883903 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi kp.save(context.session) Aug 31 16:14:01.883903 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 31 16:14:01.883903 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi session.flush() Aug 31 16:14:01.883903 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 31 16:14:01.883903 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 31 16:14:01.883903 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 31 16:14:01.883903 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 31 16:14:01.883903 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 31 16:14:01.883903 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 31 16:14:01.883903 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 16:14:01.883903 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception Aug 31 16:14:01.883903 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 31 16:14:01.883903 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 31 16:14:01.883903 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 31 16:14:01.883903 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 31 16:14:01.883903 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 31 16:14:01.883903 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 31 16:14:01.883903 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 31 16:14:01.883903 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 31 16:14:01.883903 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 31 16:14:01.883903 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 31 16:14:01.883903 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 31 16:14:01.883903 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 31 16:14:01.883903 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 31 16:14:01.883903 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 31 16:14:01.883903 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 31 16:14:01.883903 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 31 16:14:01.883903 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 31 16:14:01.883903 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 31 16:14:01.883903 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 31 16:14:01.883903 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 31 16:14:01.883903 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 16:14:01.883903 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception Aug 31 16:14:01.883903 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 16:14:01.883903 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 31 16:14:01.883903 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 16:14:01.883903 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 31 16:14:01.883903 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 16:14:01.883903 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 31 16:14:01.883903 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 16:14:01.883903 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 31 16:14:01.883903 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 16:14:01.883903 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 16:14:01.883903 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 16:14:01.883903 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi result.read() Aug 31 16:14:01.883903 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 16:14:01.883903 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 31 16:14:01.883903 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 16:14:01.883903 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 31 16:14:01.883903 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 16:14:01.883903 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 31 16:14:01.883903 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 16:14:01.893899 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 31 16:14:01.893899 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '10283b72258b47318cbd2bbe6d009703-tempest-keypair-1300287050' for key 'key_pairs.uniq_key_pairs0user_id0name'") Aug 31 16:14:01.893899 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Aug 31 16:14:01.893899 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 31, 16, 14, 1, 854440), 'updated_at': None, 'name': 'tempest-keypair-1300287050', 'user_id': '10283b72258b47318cbd2bbe6d009703', 'fingerprint': '83:58:73:c7:c9:19:55:19:d2:c6:5a:62:2d:89:b5:55', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBqJ9SzNbSqLlTuobx/EdpFZ1cr1UVvPgfen8P8cDVOuioU1enKIHJPHunVjNP3uw+CE137fwh33FDFaQgRfowRqPlGUcYZJF3kb/jlfJ6tdx+wPWBSWPC6tp/kPFFc7hg==', 'type': 'ssh'}] Aug 31 16:14:01.893899 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 31 16:14:01.893899 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:14:01.893899 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:14:01.893899 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:14:01.893899 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:01.893899 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 31 16:14:01.893899 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 31 16:14:01.893899 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 31 16:14:01.893899 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 31 16:14:01.893899 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 16:14:01.893899 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 31 16:14:01.893899 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 16:14:01.893899 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise self.value Aug 31 16:14:01.893899 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 31 16:14:01.893899 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 31 16:14:01.893899 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6775, in import_key_pair Aug 31 16:14:01.893899 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi keypair.create() Aug 31 16:14:01.893899 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 31 16:14:01.893899 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 31 16:14:01.893899 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Aug 31 16:14:01.893899 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self._create() Aug 31 16:14:01.893899 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Aug 31 16:14:01.893899 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Aug 31 16:14:01.893899 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Aug 31 16:14:01.893899 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Aug 31 16:14:01.893899 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 31 16:14:01.893899 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 31 16:14:01.893899 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Aug 31 16:14:01.893899 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Aug 31 16:14:01.893899 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-1300287050' already exists. Aug 31 16:14:01.893899 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:14:01.893899 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:14:01.893899 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:14:01.893899 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:01.893899 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:14:01.893899 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:14:01.893899 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:14:01.893899 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:14:01.893899 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:14:01.893899 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:14:01.893899 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:14:01.893899 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:14:01.893899 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:14:01.893899 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:14:01.893899 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:14:01.893899 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:14:01.893899 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 31 16:14:01.893899 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 31 16:14:01.893899 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Aug 31 16:14:01.893899 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Aug 31 16:14:01.893899 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-1300287050' already exists. Aug 31 16:14:01.900140 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:14:01.900140 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:14:01.900140 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:14:01.900140 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:01.900140 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:14:01.900140 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:14:01.900140 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:14:01.900140 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:14:01.900140 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-1300287050' already exists. Aug 31 16:14:01.900140 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:14:01.900140 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-45cae938-9f8b-40d9-9746-abe0d319ad23 tempest-KeyPairsNegativeTestJSON-1356891054 tempest-KeyPairsNegativeTestJSON-1356891054-project] Returning 409 to user: Key pair 'tempest-keypair-1300287050' already exists. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:14:01.900140 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-45cae938-9f8b-40d9-9746-abe0d319ad23 tempest-KeyPairsNegativeTestJSON-1356891054 tempest-KeyPairsNegativeTestJSON-1356891054-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 409 len: 105 microversion: 2.1 time: 0.089679 Aug 31 16:14:01.901098 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-815c9f80-6b18-4ae7-bf3d-455215bff2d9 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:01.901098 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-815c9f80-6b18-4ae7-bf3d-455215bff2d9 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:01.901098 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-815c9f80-6b18-4ae7-bf3d-455215bff2d9 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:01.901388 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1974/3940] 10.222.0.61 () {60 vars in 1159 bytes} [Wed Aug 31 16:14:01 2022] POST /compute/v2.1/os-keypairs => generated 105 bytes in 106 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 31 16:14:01.910164 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-23441bc7-28d3-45a9-a2c7-92216b741624 tempest-KeyPairsNegativeTestJSON-1356891054 tempest-KeyPairsNegativeTestJSON-1356891054-project] Calling method '.version_select at 0x7f5ae83d7040>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:01.967597 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-23441bc7-28d3-45a9-a2c7-92216b741624 tempest-KeyPairsNegativeTestJSON-1356891054 tempest-KeyPairsNegativeTestJSON-1356891054-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1300287050" status: 202 len: 0 microversion: 2.1 time: 0.062351 Aug 31 16:14:01.972567 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1975/3941] 10.222.0.61 () {58 vars in 1221 bytes} [Wed Aug 31 16:14:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1300287050 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:14:01.983300 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-80984eb0-5579-4af6-ab97-aee5bd9a8069 tempest-KeyPairsNegativeTestJSON-1356891054 tempest-KeyPairsNegativeTestJSON-1356891054-project] Action: 'create', calling method: .version_select at 0x7f5ae3cf88b0>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL8v4BBKGzfcVZFOvGiIUYWK0vYMj81kQ+twjO8xGjRWpi+YhGl3s3dBn1+S4DbbgJYK+Z4Mnv9L1VZdBASqk1a+s/4D38uzoSogSVV+Yp/gXx/tJTgE4h17s4BXF6nSmA=="}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:14:01.997516 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-80984eb0-5579-4af6-ab97-aee5bd9a8069 tempest-KeyPairsNegativeTestJSON-1356891054 tempest-KeyPairsNegativeTestJSON-1356891054-project] Request method failure captured: Aug 31 16:14:01.997516 n-d-850499-9 devstack@n-api.service[122257]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 31 16:14:01.997516 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:14:01.997516 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:14:01.997516 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:14:01.997516 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 247 Aug 31 16:14:01.997516 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:14:01.997516 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:14:01.997516 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:14:01.997516 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:14:01.997516 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4jIePxATxCjJas_Nzop5UWsnsc5b-mqF1_jhOnqMEu4bPb00nOEB2Dm3Zkd9qMEN6DU-32QLGSZDn9ygQxgA0kW02XopnLDWFYYZWkbx_5h829aflF_BcvYra8O9bjKC3PbSaE0WnCsZSpAMl_Tlww2btyhaJU0Jv3nrcIJ2dqKi0M Aug 31 16:14:01.997516 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:14:01.997516 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:14:01.997516 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:14:01.997516 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:14:01.997516 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:14:01.997516 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:14:01.997516 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: d9bf084be077475492075cc6444d269e Aug 31 16:14:01.997516 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1356891054 Aug 31 16:14:01.997516 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:14:01.997516 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:14:01.997516 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d9bf084be077475492075cc6444d269e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/d9bf084be077475492075cc6444d269e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_d9bf084be077475492075cc6444d269e", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d9bf084be077475492075cc6444d269e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:14:01.997516 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1356891054 Aug 31 16:14:01.997516 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: d9bf084be077475492075cc6444d269e Aug 31 16:14:01.997516 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1356891054 Aug 31 16:14:01.997516 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-KeyPairsNegativeTestJSON-1356891054-project Aug 31 16:14:01.997516 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:14:01.997516 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:14:01.997516 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 10283b72258b47318cbd2bbe6d009703 Aug 31 16:14:01.997516 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1356891054-project Aug 31 16:14:01.997516 n-d-850499-9 devstack@n-api.service[122257]: Aug 31 16:14:01.997516 n-d-850499-9 devstack@n-api.service[122257]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL8v4BBKGzfcVZFOvGiIUYWK0vYMj81kQ+twjO8xGjRWpi+YhGl3s3dBn1+S4DbbgJYK+Z4Mnv9L1VZdBASqk1a+s/4D38uzoSogSVV+Yp/gXx/tJTgE4h17s4BXF6nSmA=="}} Aug 31 16:14:01.997516 n-d-850499-9 devstack@n-api.service[122257]: method: Aug 31 16:14:01.997516 n-d-850499-9 devstack@n-api.service[122257]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 31 16:14:01.997516 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL8v4BBKGzfcVZFOvGiIUYWK0vYMj81kQ+twjO8xGjRWpi+YhGl3s3dBn1+S4DbbgJYK+Z4Mnv9L1VZdBASqk1a+s/4D38uzoSogSVV+Yp/gXx/tJTgE4h17s4BXF6nSmA=='}}} Aug 31 16:14:01.997516 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:14:01.997516 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:01.997516 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 16:14:01.997516 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 16:14:01.997516 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 16:14:01.997516 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise error Aug 31 16:14:01.997516 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 31 16:14:01.997516 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:14:01.997516 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Aug 31 16:14:01.997516 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 31 16:14:01.997516 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:14:01.997516 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi On instance['keypair']: Aug 31 16:14:01.997516 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi '' Aug 31 16:14:01.997516 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:14:01.997516 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:14:01.997516 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:14:01.997516 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:01.997516 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:14:01.997516 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:14:01.997516 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:14:01.997516 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:14:01.997516 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:14:01.997516 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:14:01.997516 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:14:01.997516 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:14:01.997516 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:14:01.997516 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:14:01.997516 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 16:14:01.997516 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 16:14:02.002756 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 16:14:02.002756 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 16:14:02.002756 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 16:14:02.002756 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 16:14:02.002756 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 31 16:14:02.002756 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:14:02.002756 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:14:02.002756 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:14:02.002756 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:02.002756 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:14:02.002756 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:14:02.002756 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 16:14:02.002756 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 16:14:02.002756 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 31 16:14:02.002756 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:14:02.002756 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-80984eb0-5579-4af6-ab97-aee5bd9a8069 tempest-KeyPairsNegativeTestJSON-1356891054 tempest-KeyPairsNegativeTestJSON-1356891054-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:14:02.002756 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-80984eb0-5579-4af6-ab97-aee5bd9a8069 tempest-KeyPairsNegativeTestJSON-1356891054 tempest-KeyPairsNegativeTestJSON-1356891054-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.020937 Aug 31 16:14:02.002756 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1976/3942] 10.222.0.61 () {60 vars in 1159 bytes} [Wed Aug 31 16:14:01 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:14:02.007676 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2a68b012-4617-42f5-82d8-7ee49d36c2ed tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:02.008425 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2a68b012-4617-42f5-82d8-7ee49d36c2ed tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 73b19398-0c2c-42ea-8b4a-86e223c090ff] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:02.016017 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2a68b012-4617-42f5-82d8-7ee49d36c2ed tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:02.016520 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2a68b012-4617-42f5-82d8-7ee49d36c2ed tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:02.017288 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2a68b012-4617-42f5-82d8-7ee49d36c2ed tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:02.018949 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2a68b012-4617-42f5-82d8-7ee49d36c2ed tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:02.019600 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2a68b012-4617-42f5-82d8-7ee49d36c2ed tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:02.020047 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2a68b012-4617-42f5-82d8-7ee49d36c2ed tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:02.218224 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-815c9f80-6b18-4ae7-bf3d-455215bff2d9 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f911026e35d40a480094376c6556d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f66705b4a0f4711ba14d9ceb5699bd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:02.235995 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-815c9f80-6b18-4ae7-bf3d-455215bff2d9 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] 10.222.0.61 "GET /compute/v2.1/servers/18dc9f32-b72a-4f4f-9153-a6a54f9d21b8" status: 200 len: 1573 microversion: 2.1 time: 0.385738 Aug 31 16:14:02.247167 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2a68b012-4617-42f5-82d8-7ee49d36c2ed tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:02.252744 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1967/3943] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:01 2022] GET /compute/v2.1/servers/18dc9f32-b72a-4f4f-9153-a6a54f9d21b8 => generated 1573 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:02.276298 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b11ce002-aed2-4035-bee0-0eb37396046f tempest-KeyPairsNegativeTestJSON-1356891054 tempest-KeyPairsNegativeTestJSON-1356891054-project] Action: 'create', calling method: .version_select at 0x7f5ae3e0e1f0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-322521659", "public_key": " "}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:14:02.282776 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2a68b012-4617-42f5-82d8-7ee49d36c2ed tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/73b19398-0c2c-42ea-8b4a-86e223c090ff" status: 200 len: 1518 microversion: 2.1 time: 0.280614 Aug 31 16:14:02.283387 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1977/3944] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:02 2022] GET /compute/v2.1/servers/73b19398-0c2c-42ea-8b4a-86e223c090ff => generated 1518 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:02.290233 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d60638db-816b-4da3-9878-8bc9cfb5b185 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1670130029"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:14:02.291371 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d60638db-816b-4da3-9878-8bc9cfb5b185 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] [instance: 18dc9f32-b72a-4f4f-9153-a6a54f9d21b8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:02.300313 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=3,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:14:02.306151 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d60638db-816b-4da3-9878-8bc9cfb5b185 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:02.307326 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d60638db-816b-4da3-9878-8bc9cfb5b185 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:02.308397 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d60638db-816b-4da3-9878-8bc9cfb5b185 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:02.310192 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d60638db-816b-4da3-9878-8bc9cfb5b185 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:02.311434 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d60638db-816b-4da3-9878-8bc9cfb5b185 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:02.312783 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-b11ce002-aed2-4035-bee0-0eb37396046f tempest-KeyPairsNegativeTestJSON-1356891054 tempest-KeyPairsNegativeTestJSON-1356891054-project] Getting quotas for project d9bf084be077475492075cc6444d269e. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:14:02.319905 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d60638db-816b-4da3-9878-8bc9cfb5b185 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:02.341735 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-b11ce002-aed2-4035-bee0-0eb37396046f tempest-KeyPairsNegativeTestJSON-1356891054 tempest-KeyPairsNegativeTestJSON-1356891054-project] Getting quotas for user 10283b72258b47318cbd2bbe6d009703 and project d9bf084be077475492075cc6444d269e. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:14:02.406242 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-b11ce002-aed2-4035-bee0-0eb37396046f tempest-KeyPairsNegativeTestJSON-1356891054 tempest-KeyPairsNegativeTestJSON-1356891054-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 31 16:14:02.408291 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b11ce002-aed2-4035-bee0-0eb37396046f tempest-KeyPairsNegativeTestJSON-1356891054 tempest-KeyPairsNegativeTestJSON-1356891054-project] Request method failure captured: Aug 31 16:14:02.408291 n-d-850499-9 devstack@n-api.service[122256]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 31 16:14:02.408291 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:14:02.408291 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:14:02.408291 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:14:02.408291 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 94 Aug 31 16:14:02.408291 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:14:02.408291 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:14:02.408291 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:14:02.408291 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:14:02.408291 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4jIePxATxCjJas_Nzop5UWsnsc5b-mqF1_jhOnqMEu4bPb00nOEB2Dm3Zkd9qMEN6DU-32QLGSZDn9ygQxgA0kW02XopnLDWFYYZWkbx_5h829aflF_BcvYra8O9bjKC3PbSaE0WnCsZSpAMl_Tlww2btyhaJU0Jv3nrcIJ2dqKi0M Aug 31 16:14:02.408291 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:14:02.408291 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:14:02.408291 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:14:02.408291 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:14:02.408291 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:14:02.408291 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:14:02.408291 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: d9bf084be077475492075cc6444d269e Aug 31 16:14:02.408291 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1356891054 Aug 31 16:14:02.408291 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:14:02.408291 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:14:02.408291 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d9bf084be077475492075cc6444d269e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/d9bf084be077475492075cc6444d269e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_d9bf084be077475492075cc6444d269e", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d9bf084be077475492075cc6444d269e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:14:02.408291 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1356891054 Aug 31 16:14:02.408291 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: d9bf084be077475492075cc6444d269e Aug 31 16:14:02.408291 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1356891054 Aug 31 16:14:02.408291 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-KeyPairsNegativeTestJSON-1356891054-project Aug 31 16:14:02.408291 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:14:02.408291 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:14:02.408291 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 10283b72258b47318cbd2bbe6d009703 Aug 31 16:14:02.408291 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1356891054-project Aug 31 16:14:02.408291 n-d-850499-9 devstack@n-api.service[122256]: Aug 31 16:14:02.408291 n-d-850499-9 devstack@n-api.service[122256]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-322521659", "public_key": " "}} Aug 31 16:14:02.408291 n-d-850499-9 devstack@n-api.service[122256]: method: Aug 31 16:14:02.408291 n-d-850499-9 devstack@n-api.service[122256]: exception: Keypair data is invalid: failed to generate fingerprint Aug 31 16:14:02.408291 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-322521659', 'public_key': ' '}}} Aug 31 16:14:02.408291 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:14:02.408291 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:02.408291 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 31 16:14:02.408291 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 31 16:14:02.408291 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Aug 31 16:14:02.408291 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Aug 31 16:14:02.408291 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Aug 31 16:14:02.408291 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:14:02.408291 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:14:02.408291 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:14:02.408291 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:02.408291 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 31 16:14:02.408291 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 31 16:14:02.408291 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 31 16:14:02.408291 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 31 16:14:02.408291 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 16:14:02.408291 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 31 16:14:02.408291 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 16:14:02.408291 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise self.value Aug 31 16:14:02.408291 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 31 16:14:02.408291 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 31 16:14:02.408291 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6772, in import_key_pair Aug 31 16:14:02.408291 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 31 16:14:02.408291 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6845, in _generate_fingerprint Aug 31 16:14:02.408291 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 31 16:14:02.408291 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 31 16:14:02.408291 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 31 16:14:02.408291 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 31 16:14:02.408291 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:14:02.408291 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:14:02.408291 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:14:02.413903 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:02.413903 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:14:02.413903 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:14:02.413903 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:14:02.413903 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:14:02.413903 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:14:02.413903 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:14:02.413903 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:14:02.413903 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:14:02.413903 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:14:02.413903 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:14:02.413903 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:14:02.413903 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:14:02.413903 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 31 16:14:02.413903 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 31 16:14:02.413903 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 31 16:14:02.413903 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 31 16:14:02.413903 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 31 16:14:02.413903 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:14:02.413903 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:14:02.413903 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:14:02.413903 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:02.413903 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:14:02.413903 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:14:02.413903 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:14:02.413903 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:14:02.413903 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 31 16:14:02.413903 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:14:02.418307 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b11ce002-aed2-4035-bee0-0eb37396046f tempest-KeyPairsNegativeTestJSON-1356891054 tempest-KeyPairsNegativeTestJSON-1356891054-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:14:02.419702 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b11ce002-aed2-4035-bee0-0eb37396046f tempest-KeyPairsNegativeTestJSON-1356891054 tempest-KeyPairsNegativeTestJSON-1356891054-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.156645 Aug 31 16:14:02.421415 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1968/3945] 10.222.0.61 () {60 vars in 1158 bytes} [Wed Aug 31 16:14:02 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 161 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 31 16:14:02.436297 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ec4d7762-71ce-4384-93a6-89694f7191d2 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:02.438993 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ec4d7762-71ce-4384-93a6-89694f7191d2 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: c6bfb382-b9a8-4bf0-b868-ee5f51f9daac] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:02.472920 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ec4d7762-71ce-4384-93a6-89694f7191d2 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:02.478694 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ec4d7762-71ce-4384-93a6-89694f7191d2 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:02.481359 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ec4d7762-71ce-4384-93a6-89694f7191d2 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:02.483219 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ec4d7762-71ce-4384-93a6-89694f7191d2 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:02.492544 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ec4d7762-71ce-4384-93a6-89694f7191d2 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:02.493741 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ec4d7762-71ce-4384-93a6-89694f7191d2 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:02.681260 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.network.security_group_api [None req-d60638db-816b-4da3-9878-8bc9cfb5b185 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Adding security group 8cd634f0-69a7-4c2b-837c-ebd93f5569cd to port 02a0fc93-d351-4671-91b7-b1c1440a5fc6 Aug 31 16:14:02.932809 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ec4d7762-71ce-4384-93a6-89694f7191d2 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48ee960c38f4d0584ea5ce34579279f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a957b6585e74a31b5bc5f66441c33e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:02.952596 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ec4d7762-71ce-4384-93a6-89694f7191d2 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "GET /compute/v2.1/servers/c6bfb382-b9a8-4bf0-b868-ee5f51f9daac" status: 200 len: 1506 microversion: 2.1 time: 0.529823 Aug 31 16:14:02.968135 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1969/3946] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:02 2022] GET /compute/v2.1/servers/c6bfb382-b9a8-4bf0-b868-ee5f51f9daac => generated 1506 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:02.976014 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-4c92069d-bea6-48de-9540-4ef1fac42ec0 req-b75e47e0-f462-41e8-b746-874e27336814 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73b19398-0c2c-42ea-8b4a-86e223c090ff", "name": "network-vif-deleted", "tag": "3d8c281c-2a4b-431f-87ce-34a3fa52e6c4"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:14:02.985740 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-4c92069d-bea6-48de-9540-4ef1fac42ec0 req-b75e47e0-f462-41e8-b746-874e27336814 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:02.986544 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-4c92069d-bea6-48de-9540-4ef1fac42ec0 req-b75e47e0-f462-41e8-b746-874e27336814 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:02.987172 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-4c92069d-bea6-48de-9540-4ef1fac42ec0 req-b75e47e0-f462-41e8-b746-874e27336814 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:03.008460 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-4c92069d-bea6-48de-9540-4ef1fac42ec0 req-b75e47e0-f462-41e8-b746-874e27336814 service nova] Creating event network-vif-deleted:3d8c281c-2a4b-431f-87ce-34a3fa52e6c4 for instance 73b19398-0c2c-42ea-8b4a-86e223c090ff on n-h1-850499-9 Aug 31 16:14:03.014228 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-4c92069d-bea6-48de-9540-4ef1fac42ec0 req-b75e47e0-f462-41e8-b746-874e27336814 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044611 Aug 31 16:14:03.015563 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1970/3947] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:14:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:14:03.030078 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-bfb8f5b5-3239-4161-a13d-43f85abeec22 tempest-KeyPairsNegativeTestJSON-1356891054 tempest-KeyPairsNegativeTestJSON-1356891054-project] Action: 'create', calling method: .version_select at 0x7f5ae3e0ef70>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDa40BNW0Ax9gDkpWDi1Ik7YbFTvkeXyxqJtO5WfCZR/3Gwwljp3wrbHZZvpz9mDhQbN99hkEN6+Dzg0Gekw1eG3HPxYvKfcNJOOVb4wVqhdrWRXTzCcmPiyVygy1Jh+hw=="}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:14:03.033236 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-bfb8f5b5-3239-4161-a13d-43f85abeec22 tempest-KeyPairsNegativeTestJSON-1356891054 tempest-KeyPairsNegativeTestJSON-1356891054-project] Request method failure captured: Aug 31 16:14:03.033236 n-d-850499-9 devstack@n-api.service[122256]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 31 16:14:03.033236 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:14:03.033236 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:14:03.033236 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:14:03.033236 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 507 Aug 31 16:14:03.033236 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:14:03.033236 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:14:03.033236 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:14:03.033236 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:14:03.033236 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4jIePxATxCjJas_Nzop5UWsnsc5b-mqF1_jhOnqMEu4bPb00nOEB2Dm3Zkd9qMEN6DU-32QLGSZDn9ygQxgA0kW02XopnLDWFYYZWkbx_5h829aflF_BcvYra8O9bjKC3PbSaE0WnCsZSpAMl_Tlww2btyhaJU0Jv3nrcIJ2dqKi0M Aug 31 16:14:03.033236 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:14:03.033236 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:14:03.033236 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:14:03.033236 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:14:03.033236 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:14:03.033236 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:14:03.033236 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: d9bf084be077475492075cc6444d269e Aug 31 16:14:03.033236 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1356891054 Aug 31 16:14:03.033236 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:14:03.033236 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:14:03.033236 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d9bf084be077475492075cc6444d269e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/d9bf084be077475492075cc6444d269e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_d9bf084be077475492075cc6444d269e", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d9bf084be077475492075cc6444d269e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:14:03.033236 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1356891054 Aug 31 16:14:03.033236 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: d9bf084be077475492075cc6444d269e Aug 31 16:14:03.033236 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1356891054 Aug 31 16:14:03.033236 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-KeyPairsNegativeTestJSON-1356891054-project Aug 31 16:14:03.033236 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:14:03.033236 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:14:03.033236 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 10283b72258b47318cbd2bbe6d009703 Aug 31 16:14:03.033236 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1356891054-project Aug 31 16:14:03.033236 n-d-850499-9 devstack@n-api.service[122256]: Aug 31 16:14:03.033236 n-d-850499-9 devstack@n-api.service[122256]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDa40BNW0Ax9gDkpWDi1Ik7YbFTvkeXyxqJtO5WfCZR/3Gwwljp3wrbHZZvpz9mDhQbN99hkEN6+Dzg0Gekw1eG3HPxYvKfcNJOOVb4wVqhdrWRXTzCcmPiyVygy1Jh+hw=="}} Aug 31 16:14:03.033236 n-d-850499-9 devstack@n-api.service[122256]: method: Aug 31 16:14:03.033236 n-d-850499-9 devstack@n-api.service[122256]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 31 16:14:03.033236 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDa40BNW0Ax9gDkpWDi1Ik7YbFTvkeXyxqJtO5WfCZR/3Gwwljp3wrbHZZvpz9mDhQbN99hkEN6+Dzg0Gekw1eG3HPxYvKfcNJOOVb4wVqhdrWRXTzCcmPiyVygy1Jh+hw=='}}} Aug 31 16:14:03.033236 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:14:03.033236 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:03.033236 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 16:14:03.033236 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 16:14:03.033236 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 16:14:03.033236 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise error Aug 31 16:14:03.033236 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 31 16:14:03.033236 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:14:03.033236 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Aug 31 16:14:03.033236 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 31 16:14:03.033236 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:14:03.033236 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi On instance['keypair']: Aug 31 16:14:03.033236 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Aug 31 16:14:03.036811 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:14:03.036811 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:14:03.036811 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:14:03.036811 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:03.036811 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:14:03.036811 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:14:03.036811 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:14:03.036811 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:14:03.036811 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:14:03.036811 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:14:03.036811 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:14:03.036811 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:14:03.036811 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:14:03.036811 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:14:03.036811 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 16:14:03.036811 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 16:14:03.036811 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 16:14:03.036811 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 16:14:03.036811 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 16:14:03.036811 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 16:14:03.036811 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 31 16:14:03.036811 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:14:03.036811 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:14:03.036811 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:14:03.036811 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:03.036811 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:14:03.036811 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:14:03.036811 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 16:14:03.036811 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 16:14:03.036811 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 31 16:14:03.036811 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:14:03.036811 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-bfb8f5b5-3239-4161-a13d-43f85abeec22 tempest-KeyPairsNegativeTestJSON-1356891054 tempest-KeyPairsNegativeTestJSON-1356891054-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:14:03.036811 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-bfb8f5b5-3239-4161-a13d-43f85abeec22 tempest-KeyPairsNegativeTestJSON-1356891054 tempest-KeyPairsNegativeTestJSON-1356891054-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.017723 Aug 31 16:14:03.036811 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1971/3948] 10.222.0.61 () {60 vars in 1159 bytes} [Wed Aug 31 16:14:03 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:14:03.049629 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8cf54bc2-0299-4892-8801-3d1559d3ae5a tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:03.049629 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8cf54bc2-0299-4892-8801-3d1559d3ae5a tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] [instance: af6da672-bcfb-433b-b868-3dd1dd3e4770] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:03.067465 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8cf54bc2-0299-4892-8801-3d1559d3ae5a tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:03.068955 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8cf54bc2-0299-4892-8801-3d1559d3ae5a tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:03.069820 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8cf54bc2-0299-4892-8801-3d1559d3ae5a tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:03.070811 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8cf54bc2-0299-4892-8801-3d1559d3ae5a tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:03.072357 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8cf54bc2-0299-4892-8801-3d1559d3ae5a tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:03.073058 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8cf54bc2-0299-4892-8801-3d1559d3ae5a tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:03.624146 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8cf54bc2-0299-4892-8801-3d1559d3ae5a tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea74590916f437b9722321f420ca2a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805e39cb57794a138813c776b889741f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:03.640188 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8cf54bc2-0299-4892-8801-3d1559d3ae5a tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] 10.222.0.61 "GET /compute/v2.1/servers/af6da672-bcfb-433b-b868-3dd1dd3e4770" status: 200 len: 1665 microversion: 2.1 time: 0.602839 Aug 31 16:14:03.648903 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1972/3949] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:03 2022] GET /compute/v2.1/servers/af6da672-bcfb-433b-b868-3dd1dd3e4770 => generated 1665 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:03.648903 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a2b2a72f-7f88-4619-8a50-3bd6bfed766f tempest-KeyPairsNegativeTestJSON-1356891054 tempest-KeyPairsNegativeTestJSON-1356891054-project] Action: 'create', calling method: .version_select at 0x7f5ae3e16c10>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-819390570", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:14:03.672210 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-a2b2a72f-7f88-4619-8a50-3bd6bfed766f tempest-KeyPairsNegativeTestJSON-1356891054 tempest-KeyPairsNegativeTestJSON-1356891054-project] Getting quotas for project d9bf084be077475492075cc6444d269e. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:14:03.678636 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-a2b2a72f-7f88-4619-8a50-3bd6bfed766f tempest-KeyPairsNegativeTestJSON-1356891054 tempest-KeyPairsNegativeTestJSON-1356891054-project] Getting quotas for user 10283b72258b47318cbd2bbe6d009703 and project d9bf084be077475492075cc6444d269e. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:14:03.698853 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-a2b2a72f-7f88-4619-8a50-3bd6bfed766f tempest-KeyPairsNegativeTestJSON-1356891054 tempest-KeyPairsNegativeTestJSON-1356891054-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 31 16:14:03.700819 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a2b2a72f-7f88-4619-8a50-3bd6bfed766f tempest-KeyPairsNegativeTestJSON-1356891054 tempest-KeyPairsNegativeTestJSON-1356891054-project] Request method failure captured: Aug 31 16:14:03.700819 n-d-850499-9 devstack@n-api.service[122256]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 31 16:14:03.700819 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:14:03.700819 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:14:03.700819 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:14:03.700819 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 117 Aug 31 16:14:03.700819 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:14:03.700819 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:14:03.700819 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:14:03.700819 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:14:03.700819 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4jIePxATxCjJas_Nzop5UWsnsc5b-mqF1_jhOnqMEu4bPb00nOEB2Dm3Zkd9qMEN6DU-32QLGSZDn9ygQxgA0kW02XopnLDWFYYZWkbx_5h829aflF_BcvYra8O9bjKC3PbSaE0WnCsZSpAMl_Tlww2btyhaJU0Jv3nrcIJ2dqKi0M Aug 31 16:14:03.700819 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:14:03.700819 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:14:03.700819 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:14:03.700819 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:14:03.700819 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:14:03.700819 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:14:03.700819 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: d9bf084be077475492075cc6444d269e Aug 31 16:14:03.700819 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1356891054 Aug 31 16:14:03.700819 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:14:03.700819 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:14:03.700819 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d9bf084be077475492075cc6444d269e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/d9bf084be077475492075cc6444d269e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_d9bf084be077475492075cc6444d269e", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d9bf084be077475492075cc6444d269e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:14:03.700819 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1356891054 Aug 31 16:14:03.700819 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: d9bf084be077475492075cc6444d269e Aug 31 16:14:03.700819 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1356891054 Aug 31 16:14:03.700819 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-KeyPairsNegativeTestJSON-1356891054-project Aug 31 16:14:03.700819 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:14:03.700819 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:14:03.700819 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 10283b72258b47318cbd2bbe6d009703 Aug 31 16:14:03.700819 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1356891054-project Aug 31 16:14:03.700819 n-d-850499-9 devstack@n-api.service[122256]: Aug 31 16:14:03.700819 n-d-850499-9 devstack@n-api.service[122256]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-819390570", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Aug 31 16:14:03.700819 n-d-850499-9 devstack@n-api.service[122256]: method: Aug 31 16:14:03.700819 n-d-850499-9 devstack@n-api.service[122256]: exception: Keypair data is invalid: failed to generate fingerprint Aug 31 16:14:03.700819 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-819390570', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Aug 31 16:14:03.700819 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:14:03.700819 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:03.700819 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 31 16:14:03.700819 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 31 16:14:03.700819 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Aug 31 16:14:03.700819 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Aug 31 16:14:03.700819 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Aug 31 16:14:03.700819 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Aug 31 16:14:03.700819 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Aug 31 16:14:03.700819 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Aug 31 16:14:03.700819 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Aug 31 16:14:03.700819 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:14:03.700819 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:14:03.700819 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:14:03.700819 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:03.700819 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 31 16:14:03.700819 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 31 16:14:03.700819 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 31 16:14:03.700819 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 31 16:14:03.700819 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 16:14:03.700819 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 31 16:14:03.700819 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 16:14:03.700819 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise self.value Aug 31 16:14:03.700819 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 31 16:14:03.700819 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 31 16:14:03.700819 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6772, in import_key_pair Aug 31 16:14:03.700819 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 31 16:14:03.700819 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6845, in _generate_fingerprint Aug 31 16:14:03.700819 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 31 16:14:03.705521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 31 16:14:03.705521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 31 16:14:03.705521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 31 16:14:03.705521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:14:03.705521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:14:03.705521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:14:03.705521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:03.705521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:14:03.705521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:14:03.705521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:14:03.705521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:14:03.705521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:14:03.705521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:14:03.705521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:14:03.705521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:14:03.705521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:14:03.705521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:14:03.705521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:14:03.705521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:14:03.705521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 31 16:14:03.705521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 31 16:14:03.705521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 31 16:14:03.705521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 31 16:14:03.705521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 31 16:14:03.705521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:14:03.705521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:14:03.705521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:14:03.705521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:03.705521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:14:03.705521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:14:03.705521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:14:03.705521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:14:03.705521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 31 16:14:03.705521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:14:03.711577 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a2b2a72f-7f88-4619-8a50-3bd6bfed766f tempest-KeyPairsNegativeTestJSON-1356891054 tempest-KeyPairsNegativeTestJSON-1356891054-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:14:03.713399 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a2b2a72f-7f88-4619-8a50-3bd6bfed766f tempest-KeyPairsNegativeTestJSON-1356891054 tempest-KeyPairsNegativeTestJSON-1356891054-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.068152 Aug 31 16:14:03.714722 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1973/3950] 10.222.0.61 () {60 vars in 1159 bytes} [Wed Aug 31 16:14:03 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 70 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 31 16:14:03.726213 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4ec83b5a-8ba2-4792-b0b5-cf96fbd15776 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:03.727002 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4ec83b5a-8ba2-4792-b0b5-cf96fbd15776 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 73b19398-0c2c-42ea-8b4a-86e223c090ff] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:03.739695 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4ec83b5a-8ba2-4792-b0b5-cf96fbd15776 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:03.741329 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4ec83b5a-8ba2-4792-b0b5-cf96fbd15776 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:03.742400 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4ec83b5a-8ba2-4792-b0b5-cf96fbd15776 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:03.744044 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4ec83b5a-8ba2-4792-b0b5-cf96fbd15776 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:03.745152 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4ec83b5a-8ba2-4792-b0b5-cf96fbd15776 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:03.746194 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4ec83b5a-8ba2-4792-b0b5-cf96fbd15776 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:03.771056 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-4ec83b5a-8ba2-4792-b0b5-cf96fbd15776 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] HTTP exception thrown: Instance 73b19398-0c2c-42ea-8b4a-86e223c090ff could not be found. Aug 31 16:14:03.774349 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4ec83b5a-8ba2-4792-b0b5-cf96fbd15776 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Request method failure captured: Aug 31 16:14:03.774349 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/73b19398-0c2c-42ea-8b4a-86e223c090ff HTTP/1.1 Aug 31 16:14:03.774349 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:14:03.774349 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:14:03.774349 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:14:03.774349 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:14:03.774349 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:14:03.774349 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:14:03.774349 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:14:03.774349 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:14:03.774349 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4gQXSNpx7T-s6ANX8A4XIz6BgCizm9VWKy6e0KLRI2pxjPOEzPLkRnoXGF3D-Jh3OWl1h65DNjP8YomYmS0bGyt_8avVSC7qeEvUleLImq7o7EhFYQT7JAMgMioD10eCPOZ7QHRsEPDslLrPXcQD5t1iAsH1xyWK7dbpfjoYLGjDpU Aug 31 16:14:03.774349 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:14:03.774349 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:14:03.774349 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:14:03.774349 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:14:03.774349 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:14:03.774349 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:14:03.774349 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 5299955053c842b6aa02e058f4b1c0cb Aug 31 16:14:03.774349 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ServersTestJSON-1028152372 Aug 31 16:14:03.774349 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:14:03.774349 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:14:03.774349 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5299955053c842b6aa02e058f4b1c0cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5299955053c842b6aa02e058f4b1c0cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5299955053c842b6aa02e058f4b1c0cb", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5299955053c842b6aa02e058f4b1c0cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:14:03.774349 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ServersTestJSON-1028152372 Aug 31 16:14:03.774349 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 5299955053c842b6aa02e058f4b1c0cb Aug 31 16:14:03.774349 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ServersTestJSON-1028152372 Aug 31 16:14:03.774349 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ServersTestJSON-1028152372-project Aug 31 16:14:03.774349 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:14:03.774349 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:14:03.774349 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 6e707652819c497bbdf94f85f39c447a Aug 31 16:14:03.774349 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ServersTestJSON-1028152372-project Aug 31 16:14:03.774349 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:14:03.774349 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance 73b19398-0c2c-42ea-8b4a-86e223c090ff could not be found. Aug 31 16:14:03.774349 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '73b19398-0c2c-42ea-8b4a-86e223c090ff'} Aug 31 16:14:03.774349 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:14:03.774349 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:03.774349 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:14:03.774349 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:14:03.774349 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:14:03.774349 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:14:03.774349 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:14:03.774349 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:14:03.774349 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:14:03.774349 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:14:03.774349 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73b19398-0c2c-42ea-8b4a-86e223c090ff could not be found. Aug 31 16:14:03.774349 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:14:03.774349 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:14:03.774349 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:14:03.774349 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:03.774349 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:14:03.774349 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:14:03.774349 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:14:03.774349 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:14:03.774349 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:14:03.774349 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:14:03.774349 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:14:03.774349 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:14:03.774349 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:14:03.774349 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:14:03.774349 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:14:03.774349 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:14:03.774349 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73b19398-0c2c-42ea-8b4a-86e223c090ff could not be found. Aug 31 16:14:03.774349 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:14:03.774349 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:14:03.774349 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:14:03.781638 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:03.781638 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:14:03.781638 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:14:03.781638 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:14:03.781638 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:14:03.781638 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73b19398-0c2c-42ea-8b4a-86e223c090ff could not be found. Aug 31 16:14:03.781638 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:14:03.784883 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4ec83b5a-8ba2-4792-b0b5-cf96fbd15776 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Returning 404 to user: Instance 73b19398-0c2c-42ea-8b4a-86e223c090ff could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:14:03.786928 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4ec83b5a-8ba2-4792-b0b5-cf96fbd15776 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/73b19398-0c2c-42ea-8b4a-86e223c090ff" status: 404 len: 111 microversion: 2.1 time: 0.070374 Aug 31 16:14:03.788169 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1974/3951] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:03 2022] GET /compute/v2.1/servers/73b19398-0c2c-42ea-8b4a-86e223c090ff => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:14:03.800188 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3d2f216d-edde-4ebf-8dea-f11f05e75866 tempest-KeyPairsNegativeTestJSON-1356891054 tempest-KeyPairsNegativeTestJSON-1356891054-project] Calling method '.version_select at 0x7f5ae3eb1dc0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:03.820000 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-3d2f216d-edde-4ebf-8dea-f11f05e75866 tempest-KeyPairsNegativeTestJSON-1356891054 tempest-KeyPairsNegativeTestJSON-1356891054-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-1604196240 not found for user 10283b72258b47318cbd2bbe6d009703 Aug 31 16:14:03.824875 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3d2f216d-edde-4ebf-8dea-f11f05e75866 tempest-KeyPairsNegativeTestJSON-1356891054 tempest-KeyPairsNegativeTestJSON-1356891054-project] Request method failure captured: Aug 31 16:14:03.824875 n-d-850499-9 devstack@n-api.service[122256]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1604196240 HTTP/1.1 Aug 31 16:14:03.824875 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:14:03.824875 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:14:03.824875 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:14:03.824875 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:14:03.824875 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:14:03.824875 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:14:03.824875 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:14:03.824875 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:14:03.824875 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4jIePxATxCjJas_Nzop5UWsnsc5b-mqF1_jhOnqMEu4bPb00nOEB2Dm3Zkd9qMEN6DU-32QLGSZDn9ygQxgA0kW02XopnLDWFYYZWkbx_5h829aflF_BcvYra8O9bjKC3PbSaE0WnCsZSpAMl_Tlww2btyhaJU0Jv3nrcIJ2dqKi0M Aug 31 16:14:03.824875 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:14:03.824875 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:14:03.824875 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:14:03.824875 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:14:03.824875 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:14:03.824875 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:14:03.824875 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: d9bf084be077475492075cc6444d269e Aug 31 16:14:03.824875 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1356891054 Aug 31 16:14:03.824875 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:14:03.824875 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:14:03.824875 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d9bf084be077475492075cc6444d269e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/d9bf084be077475492075cc6444d269e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_d9bf084be077475492075cc6444d269e", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d9bf084be077475492075cc6444d269e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:14:03.824875 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1356891054 Aug 31 16:14:03.824875 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: d9bf084be077475492075cc6444d269e Aug 31 16:14:03.824875 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1356891054 Aug 31 16:14:03.824875 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-KeyPairsNegativeTestJSON-1356891054-project Aug 31 16:14:03.824875 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:14:03.824875 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:14:03.824875 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 10283b72258b47318cbd2bbe6d009703 Aug 31 16:14:03.824875 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1356891054-project Aug 31 16:14:03.824875 n-d-850499-9 devstack@n-api.service[122256]: method: Aug 31 16:14:03.824875 n-d-850499-9 devstack@n-api.service[122256]: exception: Keypair tempest-keypair-non-existent-1604196240 not found for user 10283b72258b47318cbd2bbe6d009703 Aug 31 16:14:03.824875 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': 'tempest-keypair-non-existent-1604196240'} Aug 31 16:14:03.824875 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:14:03.824875 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:03.824875 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Aug 31 16:14:03.824875 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Aug 31 16:14:03.824875 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 31 16:14:03.824875 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 31 16:14:03.824875 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 16:14:03.824875 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 31 16:14:03.824875 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 16:14:03.824875 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise self.value Aug 31 16:14:03.824875 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 31 16:14:03.824875 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 31 16:14:03.824875 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6859, in delete_key_pair Aug 31 16:14:03.824875 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Aug 31 16:14:03.824875 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6880, in get_key_pair Aug 31 16:14:03.824875 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Aug 31 16:14:03.824875 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 16:14:03.824875 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 16:14:03.824875 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Aug 31 16:14:03.824875 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Aug 31 16:14:03.824875 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Aug 31 16:14:03.824875 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Aug 31 16:14:03.824875 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 31 16:14:03.824875 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 31 16:14:03.824875 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Aug 31 16:14:03.824875 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Aug 31 16:14:03.824875 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-1604196240 not found for user 10283b72258b47318cbd2bbe6d009703 Aug 31 16:14:03.824875 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:14:03.824875 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:14:03.836285 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:14:03.836285 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:03.836285 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:14:03.836285 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:14:03.836285 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:14:03.836285 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:14:03.836285 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:14:03.836285 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:14:03.836285 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 31 16:14:03.836285 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:14:03.836285 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:14:03.836285 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:14:03.836285 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Aug 31 16:14:03.836285 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self._delete(req, id) Aug 31 16:14:03.836285 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Aug 31 16:14:03.836285 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Aug 31 16:14:03.836285 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-1604196240 not found for user 10283b72258b47318cbd2bbe6d009703 Aug 31 16:14:03.836285 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:14:03.836285 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:14:03.836285 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:14:03.836285 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:03.836285 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:14:03.836285 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:14:03.836285 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:14:03.836285 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:14:03.836285 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-1604196240 not found for user 10283b72258b47318cbd2bbe6d009703 Aug 31 16:14:03.836285 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:14:03.841018 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d60638db-816b-4da3-9878-8bc9cfb5b185 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] 10.222.0.61 "POST /compute/v2.1/servers/18dc9f32-b72a-4f4f-9153-a6a54f9d21b8/action" status: 202 len: 0 microversion: 2.1 time: 1.541931 Aug 31 16:14:03.841018 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1978/3952] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:14:02 2022] POST /compute/v2.1/servers/18dc9f32-b72a-4f4f-9153-a6a54f9d21b8/action => generated 0 bytes in 1545 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:14:03.841018 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-21c3ee57-4e19-472c-8104-4f28f0acd520 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Calling method '.version_select at 0x7f5ae3cf8700>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:03.844607 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3d2f216d-edde-4ebf-8dea-f11f05e75866 tempest-KeyPairsNegativeTestJSON-1356891054 tempest-KeyPairsNegativeTestJSON-1356891054-project] Returning 404 to user: Keypair tempest-keypair-non-existent-1604196240 not found for user 10283b72258b47318cbd2bbe6d009703 {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:14:03.845732 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3d2f216d-edde-4ebf-8dea-f11f05e75866 tempest-KeyPairsNegativeTestJSON-1356891054 tempest-KeyPairsNegativeTestJSON-1356891054-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1604196240" status: 404 len: 145 microversion: 2.1 time: 0.056295 Aug 31 16:14:03.848351 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1975/3953] 10.222.0.61 () {58 vars in 1260 bytes} [Wed Aug 31 16:14:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1604196240 => generated 145 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:14:03.859630 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-d2ecdab6-7754-43cd-b1d1-e0e2c80b1cc5 req-d7410d4c-df4e-4431-9134-de31555cb232 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18dc9f32-b72a-4f4f-9153-a6a54f9d21b8", "tag": "02a0fc93-d351-4671-91b7-b1c1440a5fc6"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:14:03.873050 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-d2ecdab6-7754-43cd-b1d1-e0e2c80b1cc5 req-d7410d4c-df4e-4431-9134-de31555cb232 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:03.873873 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-d2ecdab6-7754-43cd-b1d1-e0e2c80b1cc5 req-d7410d4c-df4e-4431-9134-de31555cb232 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:03.874548 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-d2ecdab6-7754-43cd-b1d1-e0e2c80b1cc5 req-d7410d4c-df4e-4431-9134-de31555cb232 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:03.891161 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-d2ecdab6-7754-43cd-b1d1-e0e2c80b1cc5 req-d7410d4c-df4e-4431-9134-de31555cb232 service nova] Creating event network-changed:02a0fc93-d351-4671-91b7-b1c1440a5fc6 for instance 18dc9f32-b72a-4f4f-9153-a6a54f9d21b8 on n-h2-850499-9 Aug 31 16:14:03.903396 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-d2ecdab6-7754-43cd-b1d1-e0e2c80b1cc5 req-d7410d4c-df4e-4431-9134-de31555cb232 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047462 Aug 31 16:14:03.904993 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1976/3954] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:14:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:14:03.982902 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c7a7a97c-8922-458d-af36-cf3903e849bc tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:03.984695 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c7a7a97c-8922-458d-af36-cf3903e849bc tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: c6bfb382-b9a8-4bf0-b868-ee5f51f9daac] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:04.015281 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c7a7a97c-8922-458d-af36-cf3903e849bc tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:04.032923 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c7a7a97c-8922-458d-af36-cf3903e849bc tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:04.034609 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c7a7a97c-8922-458d-af36-cf3903e849bc tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:04.039211 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c7a7a97c-8922-458d-af36-cf3903e849bc tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:04.040080 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c7a7a97c-8922-458d-af36-cf3903e849bc tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:04.045391 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c7a7a97c-8922-458d-af36-cf3903e849bc tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:04.084295 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:14:04.709894 n-d-850499-9 devstack@n-api.service[122257]: DEBUG neutronclient.v2_0.client [None req-21c3ee57-4e19-472c-8104-4f28f0acd520 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 8cd634f0-69a7-4c2b-837c-ebd93f5569cd in use.", "detail": ""}} {{(pid=122257) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 31 16:14:04.711320 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-21c3ee57-4e19-472c-8104-4f28f0acd520 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] HTTP exception thrown: Security Group 8cd634f0-69a7-4c2b-837c-ebd93f5569cd in use. Aug 31 16:14:04.711320 n-d-850499-9 devstack@n-api.service[122257]: Neutron server returns request_ids: ['req-f0c58553-deda-496c-8ff2-19b67f1f2bfb'] Aug 31 16:14:04.714237 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-21c3ee57-4e19-472c-8104-4f28f0acd520 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Request method failure captured: Aug 31 16:14:04.714237 n-d-850499-9 devstack@n-api.service[122257]: request: DELETE /compute/v2.1/os-security-groups/8cd634f0-69a7-4c2b-837c-ebd93f5569cd HTTP/1.1 Aug 31 16:14:04.714237 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:14:04.714237 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:14:04.714237 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:14:04.714237 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:14:04.714237 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:14:04.714237 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:14:04.714237 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:14:04.714237 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:14:04.714237 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4iB3ZSM042t6H57DKQNRNkGdMmN-dpZ1iYL7Qp9DB5vaoQM-CcEpndp_H4eJtfFInIhXcNSw2oPrel3OUzJ_33XKrMtGya3pa2oH-wP6jy1-79FFGtwCTUUJYiIziOxflBbp14Trh2dPFGd_PM4hgPBygRYcEqBhkOx0cf9zQWBZvc Aug 31 16:14:04.714237 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:14:04.714237 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:14:04.714237 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:14:04.714237 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:14:04.714237 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:14:04.714237 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:14:04.714237 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 9f66705b4a0f4711ba14d9ceb5699bd1 Aug 31 16:14:04.714237 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-SecurityGroupsTestJSON-269266309 Aug 31 16:14:04.714237 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:14:04.714237 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:14:04.714237 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9f66705b4a0f4711ba14d9ceb5699bd1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9f66705b4a0f4711ba14d9ceb5699bd1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9f66705b4a0f4711ba14d9ceb5699bd1", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9f66705b4a0f4711ba14d9ceb5699bd1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:14:04.714237 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-SecurityGroupsTestJSON-269266309 Aug 31 16:14:04.714237 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 9f66705b4a0f4711ba14d9ceb5699bd1 Aug 31 16:14:04.714237 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-269266309 Aug 31 16:14:04.714237 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-SecurityGroupsTestJSON-269266309-project Aug 31 16:14:04.714237 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:14:04.714237 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:14:04.714237 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 5f911026e35d40a480094376c6556d03 Aug 31 16:14:04.714237 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-SecurityGroupsTestJSON-269266309-project Aug 31 16:14:04.714237 n-d-850499-9 devstack@n-api.service[122257]: method: Aug 31 16:14:04.714237 n-d-850499-9 devstack@n-api.service[122257]: exception: Security Group 8cd634f0-69a7-4c2b-837c-ebd93f5569cd in use. Aug 31 16:14:04.714237 n-d-850499-9 devstack@n-api.service[122257]: Neutron server returns request_ids: ['req-f0c58553-deda-496c-8ff2-19b67f1f2bfb'] Aug 31 16:14:04.714237 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '8cd634f0-69a7-4c2b-837c-ebd93f5569cd'} Aug 31 16:14:04.714237 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:14:04.714237 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:04.714237 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 31 16:14:04.714237 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 31 16:14:04.714237 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:14:04.714237 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:14:04.714237 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 31 16:14:04.714237 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 31 16:14:04.714237 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:14:04.714237 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:14:04.714237 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 31 16:14:04.714237 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 31 16:14:04.714237 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:14:04.714237 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:14:04.714237 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 31 16:14:04.714237 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 31 16:14:04.714237 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:14:04.714237 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:14:04.714237 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 31 16:14:04.714237 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 31 16:14:04.714237 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:14:04.714237 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:14:04.714237 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 31 16:14:04.714237 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 31 16:14:04.714237 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 31 16:14:04.714237 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 31 16:14:04.714237 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 8cd634f0-69a7-4c2b-837c-ebd93f5569cd in use. Aug 31 16:14:04.723089 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f0c58553-deda-496c-8ff2-19b67f1f2bfb'] Aug 31 16:14:04.723089 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:14:04.723089 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:14:04.723089 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:14:04.723089 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:04.723089 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 31 16:14:04.723089 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 31 16:14:04.723089 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 31 16:14:04.723089 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 31 16:14:04.723089 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 8cd634f0-69a7-4c2b-837c-ebd93f5569cd in use. Aug 31 16:14:04.723089 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f0c58553-deda-496c-8ff2-19b67f1f2bfb'] Aug 31 16:14:04.723089 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:14:04.723089 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:14:04.723089 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:14:04.723089 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:04.723089 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:14:04.723089 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:14:04.723089 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:14:04.723089 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:14:04.723089 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:14:04.723089 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:14:04.723089 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:14:04.723089 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:14:04.723089 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 31 16:14:04.723089 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 31 16:14:04.723089 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 8cd634f0-69a7-4c2b-837c-ebd93f5569cd in use. Aug 31 16:14:04.723089 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f0c58553-deda-496c-8ff2-19b67f1f2bfb'] Aug 31 16:14:04.723089 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:14:04.723089 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:14:04.723089 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:14:04.723089 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:04.723089 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:14:04.723089 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:14:04.723089 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:14:04.723089 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:14:04.723089 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 8cd634f0-69a7-4c2b-837c-ebd93f5569cd in use. Aug 31 16:14:04.723089 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f0c58553-deda-496c-8ff2-19b67f1f2bfb'] Aug 31 16:14:04.723089 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:14:04.723089 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-21c3ee57-4e19-472c-8104-4f28f0acd520 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Returning 400 to user: Security Group 8cd634f0-69a7-4c2b-837c-ebd93f5569cd in use. Aug 31 16:14:04.723089 n-d-850499-9 devstack@n-api.service[122257]: Neutron server returns request_ids: ['req-f0c58553-deda-496c-8ff2-19b67f1f2bfb'] {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:14:04.723089 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-21c3ee57-4e19-472c-8104-4f28f0acd520 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/8cd634f0-69a7-4c2b-837c-ebd93f5569cd" status: 400 len: 185 microversion: 2.1 time: 0.882675 Aug 31 16:14:04.723089 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1979/3955] 10.222.0.61 () {58 vars in 1272 bytes} [Wed Aug 31 16:14:03 2022] DELETE /compute/v2.1/os-security-groups/8cd634f0-69a7-4c2b-837c-ebd93f5569cd => generated 185 bytes in 888 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:14:04.735950 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-46153930-fee1-4bd2-a58d-5113884dcec2 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-784059149", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "networks": [{"uuid": "e418f255-318f-476c-a353-8d292b5f7798"}]}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:14:04.799878 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c7a7a97c-8922-458d-af36-cf3903e849bc tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48ee960c38f4d0584ea5ce34579279f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a957b6585e74a31b5bc5f66441c33e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:04.815997 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c7a7a97c-8922-458d-af36-cf3903e849bc tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "GET /compute/v2.1/servers/c6bfb382-b9a8-4bf0-b868-ee5f51f9daac" status: 200 len: 1506 microversion: 2.1 time: 0.837584 Aug 31 16:14:04.839880 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1977/3956] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:03 2022] GET /compute/v2.1/servers/c6bfb382-b9a8-4bf0-b868-ee5f51f9daac => generated 1506 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:04.884863 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-46153930-fee1-4bd2-a58d-5113884dcec2 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] validate_networks() for [('e418f255-318f-476c-a353-8d292b5f7798', None, None, None, None, None)] {{(pid=122257) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:14:04.891962 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b910aa50-e8e6-4072-9a46-c07164cb28b0 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:04.893885 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b910aa50-e8e6-4072-9a46-c07164cb28b0 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] [instance: af6da672-bcfb-433b-b868-3dd1dd3e4770] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:04.908077 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b910aa50-e8e6-4072-9a46-c07164cb28b0 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:04.909626 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b910aa50-e8e6-4072-9a46-c07164cb28b0 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:04.910243 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b910aa50-e8e6-4072-9a46-c07164cb28b0 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:04.911934 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b910aa50-e8e6-4072-9a46-c07164cb28b0 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:04.912980 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b910aa50-e8e6-4072-9a46-c07164cb28b0 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:04.913909 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b910aa50-e8e6-4072-9a46-c07164cb28b0 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:05.598968 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b910aa50-e8e6-4072-9a46-c07164cb28b0 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea74590916f437b9722321f420ca2a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805e39cb57794a138813c776b889741f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:05.636334 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b910aa50-e8e6-4072-9a46-c07164cb28b0 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] 10.222.0.61 "GET /compute/v2.1/servers/af6da672-bcfb-433b-b868-3dd1dd3e4770" status: 200 len: 1665 microversion: 2.1 time: 0.783337 Aug 31 16:14:05.637702 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1978/3957] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:04 2022] GET /compute/v2.1/servers/af6da672-bcfb-433b-b868-3dd1dd3e4770 => generated 1665 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:05.674520 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e9eb2082-4d48-4dc4-b2cd-96b65524b7bc tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:05.675332 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e9eb2082-4d48-4dc4-b2cd-96b65524b7bc tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] [instance: 18dc9f32-b72a-4f4f-9153-a6a54f9d21b8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:05.694592 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:14:05.698494 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e9eb2082-4d48-4dc4-b2cd-96b65524b7bc tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:05.710401 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e9eb2082-4d48-4dc4-b2cd-96b65524b7bc tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:05.711103 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e9eb2082-4d48-4dc4-b2cd-96b65524b7bc tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:05.712189 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e9eb2082-4d48-4dc4-b2cd-96b65524b7bc tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:05.724420 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e9eb2082-4d48-4dc4-b2cd-96b65524b7bc tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:05.725035 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e9eb2082-4d48-4dc4-b2cd-96b65524b7bc tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:05.807814 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e9eb2082-4d48-4dc4-b2cd-96b65524b7bc tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] [instance: 18dc9f32-b72a-4f4f-9153-a6a54f9d21b8] Going to try to terminate instance {{(pid=122256) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:14:06.009715 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e9eb2082-4d48-4dc4-b2cd-96b65524b7bc tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] 10.222.0.61 "DELETE /compute/v2.1/servers/18dc9f32-b72a-4f4f-9153-a6a54f9d21b8" status: 204 len: 0 microversion: 2.1 time: 0.368531 Aug 31 16:14:06.011327 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1979/3958] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:14:05 2022] DELETE /compute/v2.1/servers/18dc9f32-b72a-4f4f-9153-a6a54f9d21b8 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:14:06.023990 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-36c47f65-ae45-4663-a95b-8174347c1c05 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:06.027010 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-36c47f65-ae45-4663-a95b-8174347c1c05 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: c6bfb382-b9a8-4bf0-b868-ee5f51f9daac] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:06.046220 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-36c47f65-ae45-4663-a95b-8174347c1c05 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:06.048490 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-36c47f65-ae45-4663-a95b-8174347c1c05 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:06.049476 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-36c47f65-ae45-4663-a95b-8174347c1c05 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:06.050658 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-36c47f65-ae45-4663-a95b-8174347c1c05 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:06.053330 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-36c47f65-ae45-4663-a95b-8174347c1c05 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:06.057809 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-36c47f65-ae45-4663-a95b-8174347c1c05 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:06.926020 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-36c47f65-ae45-4663-a95b-8174347c1c05 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48ee960c38f4d0584ea5ce34579279f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a957b6585e74a31b5bc5f66441c33e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:06.934285 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-36c47f65-ae45-4663-a95b-8174347c1c05 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "GET /compute/v2.1/servers/c6bfb382-b9a8-4bf0-b868-ee5f51f9daac" status: 200 len: 1506 microversion: 2.1 time: 0.920534 Aug 31 16:14:06.936406 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1980/3959] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:06 2022] GET /compute/v2.1/servers/c6bfb382-b9a8-4bf0-b868-ee5f51f9daac => generated 1506 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:06.950296 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-46153930-fee1-4bd2-a58d-5113884dcec2 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:14:06.951130 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-aa2fa121-f1f0-4820-a8be-9c13825918d5 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:06.951656 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-46153930-fee1-4bd2-a58d-5113884dcec2 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:14:06.952227 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-46153930-fee1-4bd2-a58d-5113884dcec2 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:14:06.953102 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-46153930-fee1-4bd2-a58d-5113884dcec2 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:14:06.953788 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-46153930-fee1-4bd2-a58d-5113884dcec2 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:14:06.955636 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-aa2fa121-f1f0-4820-a8be-9c13825918d5 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] [instance: 18dc9f32-b72a-4f4f-9153-a6a54f9d21b8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:06.963203 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aa2fa121-f1f0-4820-a8be-9c13825918d5 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:06.964113 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aa2fa121-f1f0-4820-a8be-9c13825918d5 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:06.964793 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aa2fa121-f1f0-4820-a8be-9c13825918d5 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:06.965721 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aa2fa121-f1f0-4820-a8be-9c13825918d5 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:06.966405 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aa2fa121-f1f0-4820-a8be-9c13825918d5 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:06.967048 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aa2fa121-f1f0-4820-a8be-9c13825918d5 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:06.973975 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-46153930-fee1-4bd2-a58d-5113884dcec2 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:06.974544 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-46153930-fee1-4bd2-a58d-5113884dcec2 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:06.975007 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-46153930-fee1-4bd2-a58d-5113884dcec2 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:06.976204 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-46153930-fee1-4bd2-a58d-5113884dcec2 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:06.977041 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-46153930-fee1-4bd2-a58d-5113884dcec2 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:06.977968 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-46153930-fee1-4bd2-a58d-5113884dcec2 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:07.005214 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-46153930-fee1-4bd2-a58d-5113884dcec2 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Getting quotas for project 5299955053c842b6aa02e058f4b1c0cb. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:14:07.012815 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-46153930-fee1-4bd2-a58d-5113884dcec2 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Getting quotas for user 6e707652819c497bbdf94f85f39c447a and project 5299955053c842b6aa02e058f4b1c0cb. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:14:07.027409 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-46153930-fee1-4bd2-a58d-5113884dcec2 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Going to run 1 instances... {{(pid=122257) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:14:07.029798 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-46153930-fee1-4bd2-a58d-5113884dcec2 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: d78f1dfc-6152-4180-84be-f6a84b75dbc2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:14:07.097519 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-46153930-fee1-4bd2-a58d-5113884dcec2 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.373446 Aug 31 16:14:07.106529 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1980/3960] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:14:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 2384 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:14:07.114468 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7f2cebe5-4be2-4f65-8588-f9b243c368c3 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:07.115667 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7f2cebe5-4be2-4f65-8588-f9b243c368c3 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] [instance: af6da672-bcfb-433b-b868-3dd1dd3e4770] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:07.126602 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7f2cebe5-4be2-4f65-8588-f9b243c368c3 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:07.128292 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7f2cebe5-4be2-4f65-8588-f9b243c368c3 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:07.128920 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7f2cebe5-4be2-4f65-8588-f9b243c368c3 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:07.129847 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7f2cebe5-4be2-4f65-8588-f9b243c368c3 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:07.130481 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7f2cebe5-4be2-4f65-8588-f9b243c368c3 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:07.131068 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7f2cebe5-4be2-4f65-8588-f9b243c368c3 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:07.242527 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7f2cebe5-4be2-4f65-8588-f9b243c368c3 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea74590916f437b9722321f420ca2a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805e39cb57794a138813c776b889741f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:07.264578 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7f2cebe5-4be2-4f65-8588-f9b243c368c3 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] 10.222.0.61 "GET /compute/v2.1/servers/af6da672-bcfb-433b-b868-3dd1dd3e4770" status: 200 len: 1597 microversion: 2.1 time: 0.156666 Aug 31 16:14:07.268005 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1981/3961] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:07 2022] GET /compute/v2.1/servers/af6da672-bcfb-433b-b868-3dd1dd3e4770 => generated 1597 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:07.277161 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ce89ffa7-296f-4ac1-b520-8ec8d032bbfb tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:07.277759 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ce89ffa7-296f-4ac1-b520-8ec8d032bbfb tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: d78f1dfc-6152-4180-84be-f6a84b75dbc2] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:07.464573 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ce89ffa7-296f-4ac1-b520-8ec8d032bbfb tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:07.476705 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ce89ffa7-296f-4ac1-b520-8ec8d032bbfb tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/d78f1dfc-6152-4180-84be-f6a84b75dbc2" status: 200 len: 1208 microversion: 2.1 time: 0.207071 Aug 31 16:14:07.478578 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1982/3962] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:07 2022] GET /compute/v2.1/servers/d78f1dfc-6152-4180-84be-f6a84b75dbc2 => generated 1208 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:07.489000 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-aa2fa121-f1f0-4820-a8be-9c13825918d5 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f911026e35d40a480094376c6556d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f66705b4a0f4711ba14d9ceb5699bd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:07.501644 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-aa2fa121-f1f0-4820-a8be-9c13825918d5 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] 10.222.0.61 "GET /compute/v2.1/servers/18dc9f32-b72a-4f4f-9153-a6a54f9d21b8" status: 200 len: 1648 microversion: 2.1 time: 0.560693 Aug 31 16:14:07.503681 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-a04c6d79-c994-4b05-9d36-f5735a31d5b3 req-cc4a5276-1798-4409-bb2e-71e531103ae8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af6da672-bcfb-433b-b868-3dd1dd3e4770", "name": "network-vif-deleted", "tag": "aa1f0e1c-7d31-43c6-bd52-1902f678ccdb"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:14:07.505187 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1981/3963] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:06 2022] GET /compute/v2.1/servers/18dc9f32-b72a-4f4f-9153-a6a54f9d21b8 => generated 1648 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:07.517213 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-a04c6d79-c994-4b05-9d36-f5735a31d5b3 req-cc4a5276-1798-4409-bb2e-71e531103ae8 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:07.518221 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-a04c6d79-c994-4b05-9d36-f5735a31d5b3 req-cc4a5276-1798-4409-bb2e-71e531103ae8 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:07.518921 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-a04c6d79-c994-4b05-9d36-f5735a31d5b3 req-cc4a5276-1798-4409-bb2e-71e531103ae8 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:07.531803 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-a04c6d79-c994-4b05-9d36-f5735a31d5b3 req-cc4a5276-1798-4409-bb2e-71e531103ae8 service nova] Creating event network-vif-deleted:aa1f0e1c-7d31-43c6-bd52-1902f678ccdb for instance af6da672-bcfb-433b-b868-3dd1dd3e4770 on n-h2-850499-9 Aug 31 16:14:07.538528 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-a04c6d79-c994-4b05-9d36-f5735a31d5b3 req-cc4a5276-1798-4409-bb2e-71e531103ae8 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058429 Aug 31 16:14:07.540207 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1983/3964] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:14:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:14:07.969363 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-585da6a3-f3a2-4f11-bd6a-1527a486eb49 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:07.977038 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-585da6a3-f3a2-4f11-bd6a-1527a486eb49 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: c6bfb382-b9a8-4bf0-b868-ee5f51f9daac] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:08.003735 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-585da6a3-f3a2-4f11-bd6a-1527a486eb49 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:08.007607 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-585da6a3-f3a2-4f11-bd6a-1527a486eb49 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:08.008422 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-585da6a3-f3a2-4f11-bd6a-1527a486eb49 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:08.016242 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-585da6a3-f3a2-4f11-bd6a-1527a486eb49 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:08.017133 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-585da6a3-f3a2-4f11-bd6a-1527a486eb49 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:08.023638 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-585da6a3-f3a2-4f11-bd6a-1527a486eb49 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:08.300067 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c429096a-57ba-4d91-9d56-d2022fc05f1e tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:08.301814 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c429096a-57ba-4d91-9d56-d2022fc05f1e tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] [instance: af6da672-bcfb-433b-b868-3dd1dd3e4770] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:08.315561 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c429096a-57ba-4d91-9d56-d2022fc05f1e tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:08.317336 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c429096a-57ba-4d91-9d56-d2022fc05f1e tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:08.318299 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c429096a-57ba-4d91-9d56-d2022fc05f1e tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:08.319517 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c429096a-57ba-4d91-9d56-d2022fc05f1e tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:08.320484 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c429096a-57ba-4d91-9d56-d2022fc05f1e tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:08.321417 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c429096a-57ba-4d91-9d56-d2022fc05f1e tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:08.388801 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c429096a-57ba-4d91-9d56-d2022fc05f1e tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:08.405973 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c429096a-57ba-4d91-9d56-d2022fc05f1e tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:08.406944 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c429096a-57ba-4d91-9d56-d2022fc05f1e tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:08.409038 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-c429096a-57ba-4d91-9d56-d2022fc05f1e tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Lazy-loading 'fault' on Instance uuid af6da672-bcfb-433b-b868-3dd1dd3e4770 {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:14:08.711933 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c429096a-57ba-4d91-9d56-d2022fc05f1e tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea74590916f437b9722321f420ca2a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805e39cb57794a138813c776b889741f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:08.723014 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c429096a-57ba-4d91-9d56-d2022fc05f1e tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] 10.222.0.61 "GET /compute/v2.1/servers/af6da672-bcfb-433b-b868-3dd1dd3e4770" status: 200 len: 1314 microversion: 2.1 time: 0.428184 Aug 31 16:14:08.724692 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1984/3965] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:08 2022] GET /compute/v2.1/servers/af6da672-bcfb-433b-b868-3dd1dd3e4770 => generated 1314 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:14:08.733678 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ab1a5bf3-4d66-4749-9f16-8c681fb1dd39 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:08.735205 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ab1a5bf3-4d66-4749-9f16-8c681fb1dd39 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: d78f1dfc-6152-4180-84be-f6a84b75dbc2] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:08.749063 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ab1a5bf3-4d66-4749-9f16-8c681fb1dd39 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:08.773010 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ab1a5bf3-4d66-4749-9f16-8c681fb1dd39 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:08.774627 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ab1a5bf3-4d66-4749-9f16-8c681fb1dd39 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:08.775592 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ab1a5bf3-4d66-4749-9f16-8c681fb1dd39 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:08.776237 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ab1a5bf3-4d66-4749-9f16-8c681fb1dd39 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:08.776973 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ab1a5bf3-4d66-4749-9f16-8c681fb1dd39 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:08.867518 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-585da6a3-f3a2-4f11-bd6a-1527a486eb49 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48ee960c38f4d0584ea5ce34579279f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a957b6585e74a31b5bc5f66441c33e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:08.885659 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-585da6a3-f3a2-4f11-bd6a-1527a486eb49 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "GET /compute/v2.1/servers/c6bfb382-b9a8-4bf0-b868-ee5f51f9daac" status: 200 len: 1506 microversion: 2.1 time: 0.924383 Aug 31 16:14:08.891665 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1982/3966] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:07 2022] GET /compute/v2.1/servers/c6bfb382-b9a8-4bf0-b868-ee5f51f9daac => generated 1506 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:14:08.907616 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-829276ea-1fed-4ea9-8cfd-0f3856cd9d06 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:08.908213 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-829276ea-1fed-4ea9-8cfd-0f3856cd9d06 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] [instance: 18dc9f32-b72a-4f4f-9153-a6a54f9d21b8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:08.935715 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-829276ea-1fed-4ea9-8cfd-0f3856cd9d06 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:08.941477 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-829276ea-1fed-4ea9-8cfd-0f3856cd9d06 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:08.943863 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-829276ea-1fed-4ea9-8cfd-0f3856cd9d06 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:08.944819 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-829276ea-1fed-4ea9-8cfd-0f3856cd9d06 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:08.946101 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-829276ea-1fed-4ea9-8cfd-0f3856cd9d06 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:08.947085 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-829276ea-1fed-4ea9-8cfd-0f3856cd9d06 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:09.087805 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ab1a5bf3-4d66-4749-9f16-8c681fb1dd39 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:09.100852 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ab1a5bf3-4d66-4749-9f16-8c681fb1dd39 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/d78f1dfc-6152-4180-84be-f6a84b75dbc2" status: 200 len: 1260 microversion: 2.1 time: 0.373896 Aug 31 16:14:09.120177 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1985/3967] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:08 2022] GET /compute/v2.1/servers/d78f1dfc-6152-4180-84be-f6a84b75dbc2 => generated 1260 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:09.601169 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-829276ea-1fed-4ea9-8cfd-0f3856cd9d06 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f911026e35d40a480094376c6556d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f66705b4a0f4711ba14d9ceb5699bd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:09.615022 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-829276ea-1fed-4ea9-8cfd-0f3856cd9d06 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] 10.222.0.61 "GET /compute/v2.1/servers/18dc9f32-b72a-4f4f-9153-a6a54f9d21b8" status: 200 len: 1648 microversion: 2.1 time: 0.721754 Aug 31 16:14:09.620321 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1983/3968] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:08 2022] GET /compute/v2.1/servers/18dc9f32-b72a-4f4f-9153-a6a54f9d21b8 => generated 1648 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:09.747468 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5f9c5230-02d7-481c-81ba-163963d336a7 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:09.748962 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5f9c5230-02d7-481c-81ba-163963d336a7 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] [instance: af6da672-bcfb-433b-b868-3dd1dd3e4770] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:09.757517 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5f9c5230-02d7-481c-81ba-163963d336a7 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:09.758634 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5f9c5230-02d7-481c-81ba-163963d336a7 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:09.760094 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5f9c5230-02d7-481c-81ba-163963d336a7 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:09.761433 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5f9c5230-02d7-481c-81ba-163963d336a7 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:09.762243 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5f9c5230-02d7-481c-81ba-163963d336a7 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:09.763027 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5f9c5230-02d7-481c-81ba-163963d336a7 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:09.782553 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-5f9c5230-02d7-481c-81ba-163963d336a7 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] HTTP exception thrown: Instance af6da672-bcfb-433b-b868-3dd1dd3e4770 could not be found. Aug 31 16:14:09.786210 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5f9c5230-02d7-481c-81ba-163963d336a7 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Request method failure captured: Aug 31 16:14:09.786210 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/af6da672-bcfb-433b-b868-3dd1dd3e4770 HTTP/1.1 Aug 31 16:14:09.786210 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:14:09.786210 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:14:09.786210 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:14:09.786210 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:14:09.786210 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:14:09.786210 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:14:09.786210 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:14:09.786210 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:14:09.786210 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4hNLgTMNHh-q45Ht_xO9F03VVPvKLLFWmzHDcWDAPdpju900KiU49mxgVQXSx-odmoaJf7miL-_U9Ru54ULmwLGN5ljYck-HQNBBirZqZbZIbmXFtUkKfmBWd3o0xerBpeMRZt9hh4DS96BxGjHJxUFWxGjlNY4LrAt_0veZ9QzgWs Aug 31 16:14:09.786210 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:14:09.786210 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:14:09.786210 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:14:09.786210 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:14:09.786210 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:14:09.786210 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:14:09.786210 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 805e39cb57794a138813c776b889741f Aug 31 16:14:09.786210 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ServersTestFqdnHostnames-546554686 Aug 31 16:14:09.786210 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:14:09.786210 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:14:09.786210 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/805e39cb57794a138813c776b889741f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/805e39cb57794a138813c776b889741f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_805e39cb57794a138813c776b889741f", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/805e39cb57794a138813c776b889741f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:14:09.786210 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ServersTestFqdnHostnames-546554686 Aug 31 16:14:09.786210 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 805e39cb57794a138813c776b889741f Aug 31 16:14:09.786210 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-546554686 Aug 31 16:14:09.786210 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ServersTestFqdnHostnames-546554686-project Aug 31 16:14:09.786210 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:14:09.786210 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:14:09.786210 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 9ea74590916f437b9722321f420ca2a8 Aug 31 16:14:09.786210 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ServersTestFqdnHostnames-546554686-project Aug 31 16:14:09.786210 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:14:09.786210 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance af6da672-bcfb-433b-b868-3dd1dd3e4770 could not be found. Aug 31 16:14:09.786210 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': 'af6da672-bcfb-433b-b868-3dd1dd3e4770'} Aug 31 16:14:09.786210 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:14:09.786210 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:09.786210 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:14:09.786210 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:14:09.786210 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:14:09.786210 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:14:09.786210 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:14:09.786210 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:14:09.786210 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:14:09.786210 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:14:09.786210 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af6da672-bcfb-433b-b868-3dd1dd3e4770 could not be found. Aug 31 16:14:09.786210 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:14:09.786210 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:14:09.786210 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:14:09.786210 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:09.786210 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:14:09.786210 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:14:09.786210 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:14:09.786210 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:14:09.786210 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:14:09.786210 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:14:09.786210 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:14:09.786210 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:14:09.786210 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:14:09.786210 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:14:09.786210 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:14:09.786210 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:14:09.786210 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af6da672-bcfb-433b-b868-3dd1dd3e4770 could not be found. Aug 31 16:14:09.786210 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:14:09.786210 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:14:09.786210 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:14:09.791675 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:09.791675 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:14:09.791675 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:14:09.791675 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:14:09.791675 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:14:09.791675 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af6da672-bcfb-433b-b868-3dd1dd3e4770 could not be found. Aug 31 16:14:09.791675 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:14:09.794160 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5f9c5230-02d7-481c-81ba-163963d336a7 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Returning 404 to user: Instance af6da672-bcfb-433b-b868-3dd1dd3e4770 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:14:09.795375 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5f9c5230-02d7-481c-81ba-163963d336a7 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] 10.222.0.61 "GET /compute/v2.1/servers/af6da672-bcfb-433b-b868-3dd1dd3e4770" status: 404 len: 111 microversion: 2.1 time: 0.052078 Aug 31 16:14:09.796556 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1986/3969] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:09 2022] GET /compute/v2.1/servers/af6da672-bcfb-433b-b868-3dd1dd3e4770 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 16:14:09.819053 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-00f6eda0-2e90-48a4-ad45-08c2b7c78b23 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] Calling method '.version_select at 0x7f5ae3edd1f0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:09.878669 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-00f6eda0-2e90-48a4-ad45-08c2b7c78b23 tempest-ServersTestFqdnHostnames-546554686 tempest-ServersTestFqdnHostnames-546554686-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-84006608" status: 202 len: 0 microversion: 2.1 time: 0.072120 Aug 31 16:14:09.882224 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1984/3970] 10.222.0.61 () {58 vars in 1215 bytes} [Wed Aug 31 16:14:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-84006608 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:14:09.916357 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b41980c4-2826-4643-9893-0aaaebb4e884 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:09.920431 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b41980c4-2826-4643-9893-0aaaebb4e884 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: c6bfb382-b9a8-4bf0-b868-ee5f51f9daac] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:09.945516 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b41980c4-2826-4643-9893-0aaaebb4e884 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:09.947036 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b41980c4-2826-4643-9893-0aaaebb4e884 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:09.948064 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b41980c4-2826-4643-9893-0aaaebb4e884 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:09.951726 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b41980c4-2826-4643-9893-0aaaebb4e884 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:09.954533 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b41980c4-2826-4643-9893-0aaaebb4e884 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:09.956203 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b41980c4-2826-4643-9893-0aaaebb4e884 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:10.129255 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-eadab969-26a7-4901-8755-8bdc5b4526c5 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:10.132196 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-eadab969-26a7-4901-8755-8bdc5b4526c5 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: d78f1dfc-6152-4180-84be-f6a84b75dbc2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:10.203895 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eadab969-26a7-4901-8755-8bdc5b4526c5 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:10.205799 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eadab969-26a7-4901-8755-8bdc5b4526c5 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.038s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:10.206874 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eadab969-26a7-4901-8755-8bdc5b4526c5 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:10.212218 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eadab969-26a7-4901-8755-8bdc5b4526c5 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:10.213513 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eadab969-26a7-4901-8755-8bdc5b4526c5 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:10.215397 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eadab969-26a7-4901-8755-8bdc5b4526c5 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:10.692251 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-eadab969-26a7-4901-8755-8bdc5b4526c5 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:10.723557 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-eadab969-26a7-4901-8755-8bdc5b4526c5 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/d78f1dfc-6152-4180-84be-f6a84b75dbc2" status: 200 len: 1266 microversion: 2.1 time: 0.600053 Aug 31 16:14:10.726065 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1985/3971] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:10 2022] GET /compute/v2.1/servers/d78f1dfc-6152-4180-84be-f6a84b75dbc2 => generated 1266 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:14:10.732299 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1489f6ee-9cad-4a52-a130-7fb5338144a5 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:10.740213 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1489f6ee-9cad-4a52-a130-7fb5338144a5 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] [instance: 18dc9f32-b72a-4f4f-9153-a6a54f9d21b8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:10.760355 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1489f6ee-9cad-4a52-a130-7fb5338144a5 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:10.761374 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1489f6ee-9cad-4a52-a130-7fb5338144a5 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:10.764412 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1489f6ee-9cad-4a52-a130-7fb5338144a5 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:10.765782 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1489f6ee-9cad-4a52-a130-7fb5338144a5 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:10.766540 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1489f6ee-9cad-4a52-a130-7fb5338144a5 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:10.767114 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1489f6ee-9cad-4a52-a130-7fb5338144a5 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:10.960226 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b41980c4-2826-4643-9893-0aaaebb4e884 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48ee960c38f4d0584ea5ce34579279f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a957b6585e74a31b5bc5f66441c33e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:10.990213 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b41980c4-2826-4643-9893-0aaaebb4e884 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "GET /compute/v2.1/servers/c6bfb382-b9a8-4bf0-b868-ee5f51f9daac" status: 200 len: 1506 microversion: 2.1 time: 1.081712 Aug 31 16:14:11.003529 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1987/3972] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:09 2022] GET /compute/v2.1/servers/c6bfb382-b9a8-4bf0-b868-ee5f51f9daac => generated 1506 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:11.195267 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1489f6ee-9cad-4a52-a130-7fb5338144a5 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f911026e35d40a480094376c6556d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f66705b4a0f4711ba14d9ceb5699bd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:11.231260 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1489f6ee-9cad-4a52-a130-7fb5338144a5 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] 10.222.0.61 "GET /compute/v2.1/servers/18dc9f32-b72a-4f4f-9153-a6a54f9d21b8" status: 200 len: 1468 microversion: 2.1 time: 0.504032 Aug 31 16:14:11.250098 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-778dfa46-2955-47f0-91b1-dd8cb92dfff2 req-8e235029-73b4-4d11-ac30-aebbf54c4b0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18dc9f32-b72a-4f4f-9153-a6a54f9d21b8", "name": "network-vif-deleted", "tag": "02a0fc93-d351-4671-91b7-b1c1440a5fc6"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:14:11.255647 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1986/3973] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:10 2022] GET /compute/v2.1/servers/18dc9f32-b72a-4f4f-9153-a6a54f9d21b8 => generated 1468 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:11.270273 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-778dfa46-2955-47f0-91b1-dd8cb92dfff2 req-8e235029-73b4-4d11-ac30-aebbf54c4b0e service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:11.271359 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-778dfa46-2955-47f0-91b1-dd8cb92dfff2 req-8e235029-73b4-4d11-ac30-aebbf54c4b0e service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:11.275725 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-778dfa46-2955-47f0-91b1-dd8cb92dfff2 req-8e235029-73b4-4d11-ac30-aebbf54c4b0e service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:11.321738 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-778dfa46-2955-47f0-91b1-dd8cb92dfff2 req-8e235029-73b4-4d11-ac30-aebbf54c4b0e service nova] Creating event network-vif-deleted:02a0fc93-d351-4671-91b7-b1c1440a5fc6 for instance 18dc9f32-b72a-4f4f-9153-a6a54f9d21b8 on n-h2-850499-9 Aug 31 16:14:11.329870 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-778dfa46-2955-47f0-91b1-dd8cb92dfff2 req-8e235029-73b4-4d11-ac30-aebbf54c4b0e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084011 Aug 31 16:14:11.331385 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1988/3974] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:14:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:14:11.756221 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-331f7284-eadb-4bab-a343-51e373c0c8f3 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:11.756901 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-331f7284-eadb-4bab-a343-51e373c0c8f3 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: d78f1dfc-6152-4180-84be-f6a84b75dbc2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:11.781027 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-331f7284-eadb-4bab-a343-51e373c0c8f3 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:11.782062 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-331f7284-eadb-4bab-a343-51e373c0c8f3 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:11.786662 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-331f7284-eadb-4bab-a343-51e373c0c8f3 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:11.791698 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-331f7284-eadb-4bab-a343-51e373c0c8f3 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:11.795095 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-331f7284-eadb-4bab-a343-51e373c0c8f3 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:11.797183 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-331f7284-eadb-4bab-a343-51e373c0c8f3 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:12.018947 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8157274c-53a7-42e8-a2d4-408575ce2c3c tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:12.019696 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8157274c-53a7-42e8-a2d4-408575ce2c3c tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: c6bfb382-b9a8-4bf0-b868-ee5f51f9daac] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:12.036935 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8157274c-53a7-42e8-a2d4-408575ce2c3c tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:12.037448 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8157274c-53a7-42e8-a2d4-408575ce2c3c tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:12.037897 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8157274c-53a7-42e8-a2d4-408575ce2c3c tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:12.038619 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8157274c-53a7-42e8-a2d4-408575ce2c3c tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:12.039087 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8157274c-53a7-42e8-a2d4-408575ce2c3c tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:12.039555 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8157274c-53a7-42e8-a2d4-408575ce2c3c tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:12.828798 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-331f7284-eadb-4bab-a343-51e373c0c8f3 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:12.845344 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-331f7284-eadb-4bab-a343-51e373c0c8f3 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/d78f1dfc-6152-4180-84be-f6a84b75dbc2" status: 200 len: 1266 microversion: 2.1 time: 1.093390 Aug 31 16:14:12.846926 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1987/3975] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:11 2022] GET /compute/v2.1/servers/d78f1dfc-6152-4180-84be-f6a84b75dbc2 => generated 1266 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:12.852759 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-bf64718f-9f3c-4ec4-88f3-be606643520e tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:12.853564 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-bf64718f-9f3c-4ec4-88f3-be606643520e tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] [instance: 18dc9f32-b72a-4f4f-9153-a6a54f9d21b8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:12.874156 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bf64718f-9f3c-4ec4-88f3-be606643520e tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:12.874655 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bf64718f-9f3c-4ec4-88f3-be606643520e tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:12.875287 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bf64718f-9f3c-4ec4-88f3-be606643520e tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:12.876370 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bf64718f-9f3c-4ec4-88f3-be606643520e tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:12.876698 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bf64718f-9f3c-4ec4-88f3-be606643520e tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:12.877156 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bf64718f-9f3c-4ec4-88f3-be606643520e tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:12.895370 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-bf64718f-9f3c-4ec4-88f3-be606643520e tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] HTTP exception thrown: Instance 18dc9f32-b72a-4f4f-9153-a6a54f9d21b8 could not be found. Aug 31 16:14:12.897402 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-bf64718f-9f3c-4ec4-88f3-be606643520e tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Request method failure captured: Aug 31 16:14:12.897402 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/18dc9f32-b72a-4f4f-9153-a6a54f9d21b8 HTTP/1.1 Aug 31 16:14:12.897402 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:14:12.897402 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:14:12.897402 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:14:12.897402 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:14:12.897402 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:14:12.897402 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:14:12.897402 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:14:12.897402 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:14:12.897402 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4iB3ZSM042t6H57DKQNRNkGdMmN-dpZ1iYL7Qp9DB5vaoQM-CcEpndp_H4eJtfFInIhXcNSw2oPrel3OUzJ_33XKrMtGya3pa2oH-wP6jy1-79FFGtwCTUUJYiIziOxflBbp14Trh2dPFGd_PM4hgPBygRYcEqBhkOx0cf9zQWBZvc Aug 31 16:14:12.897402 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:14:12.897402 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:14:12.897402 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:14:12.897402 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:14:12.897402 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:14:12.897402 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:14:12.897402 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 9f66705b4a0f4711ba14d9ceb5699bd1 Aug 31 16:14:12.897402 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-SecurityGroupsTestJSON-269266309 Aug 31 16:14:12.897402 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:14:12.897402 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:14:12.897402 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9f66705b4a0f4711ba14d9ceb5699bd1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9f66705b4a0f4711ba14d9ceb5699bd1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9f66705b4a0f4711ba14d9ceb5699bd1", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9f66705b4a0f4711ba14d9ceb5699bd1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:14:12.897402 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-SecurityGroupsTestJSON-269266309 Aug 31 16:14:12.897402 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 9f66705b4a0f4711ba14d9ceb5699bd1 Aug 31 16:14:12.897402 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-269266309 Aug 31 16:14:12.897402 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-SecurityGroupsTestJSON-269266309-project Aug 31 16:14:12.897402 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:14:12.897402 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:14:12.897402 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 5f911026e35d40a480094376c6556d03 Aug 31 16:14:12.897402 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-SecurityGroupsTestJSON-269266309-project Aug 31 16:14:12.897402 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:14:12.897402 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance 18dc9f32-b72a-4f4f-9153-a6a54f9d21b8 could not be found. Aug 31 16:14:12.897402 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '18dc9f32-b72a-4f4f-9153-a6a54f9d21b8'} Aug 31 16:14:12.897402 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:14:12.897402 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:12.897402 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:14:12.897402 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:14:12.897402 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:14:12.897402 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:14:12.897402 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:14:12.897402 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:14:12.897402 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:14:12.897402 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:14:12.897402 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18dc9f32-b72a-4f4f-9153-a6a54f9d21b8 could not be found. Aug 31 16:14:12.897402 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:14:12.897402 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:14:12.897402 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:14:12.897402 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:12.897402 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:14:12.897402 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:14:12.897402 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:14:12.897402 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:14:12.897402 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:14:12.897402 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:14:12.897402 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:14:12.897402 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:14:12.897402 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:14:12.897402 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:14:12.897402 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:14:12.897402 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:14:12.897402 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18dc9f32-b72a-4f4f-9153-a6a54f9d21b8 could not be found. Aug 31 16:14:12.897402 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:14:12.897402 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:14:12.897402 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:14:12.902663 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:12.902663 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:14:12.902663 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:14:12.902663 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:14:12.902663 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:14:12.902663 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18dc9f32-b72a-4f4f-9153-a6a54f9d21b8 could not be found. Aug 31 16:14:12.902663 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:14:12.902663 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-bf64718f-9f3c-4ec4-88f3-be606643520e tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Returning 404 to user: Instance 18dc9f32-b72a-4f4f-9153-a6a54f9d21b8 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:14:12.902663 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-bf64718f-9f3c-4ec4-88f3-be606643520e tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] 10.222.0.61 "GET /compute/v2.1/servers/18dc9f32-b72a-4f4f-9153-a6a54f9d21b8" status: 404 len: 111 microversion: 2.1 time: 0.050966 Aug 31 16:14:12.902663 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1988/3976] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:12 2022] GET /compute/v2.1/servers/18dc9f32-b72a-4f4f-9153-a6a54f9d21b8 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:14:12.911533 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-400e9806-9e34-44e0-8116-51ebbe073847 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Calling method '.version_select at 0x7f5ae3de5280>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:13.227681 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8157274c-53a7-42e8-a2d4-408575ce2c3c tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48ee960c38f4d0584ea5ce34579279f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a957b6585e74a31b5bc5f66441c33e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:13.245940 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8157274c-53a7-42e8-a2d4-408575ce2c3c tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "GET /compute/v2.1/servers/c6bfb382-b9a8-4bf0-b868-ee5f51f9daac" status: 200 len: 1506 microversion: 2.1 time: 1.233308 Aug 31 16:14:13.248464 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1989/3977] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:12 2022] GET /compute/v2.1/servers/c6bfb382-b9a8-4bf0-b868-ee5f51f9daac => generated 1506 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:13.688088 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=16 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:14:13.866306 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0dca782b-3c04-4041-a4dd-98de2002d2b1 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:13.867084 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0dca782b-3c04-4041-a4dd-98de2002d2b1 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: d78f1dfc-6152-4180-84be-f6a84b75dbc2] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:13.882415 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0dca782b-3c04-4041-a4dd-98de2002d2b1 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:13.882925 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0dca782b-3c04-4041-a4dd-98de2002d2b1 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:13.883367 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0dca782b-3c04-4041-a4dd-98de2002d2b1 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:13.884150 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0dca782b-3c04-4041-a4dd-98de2002d2b1 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:13.884604 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0dca782b-3c04-4041-a4dd-98de2002d2b1 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:13.885031 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0dca782b-3c04-4041-a4dd-98de2002d2b1 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:14.005058 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-400e9806-9e34-44e0-8116-51ebbe073847 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/328934f9-57a6-4657-91ba-7e2d53259ae7" status: 202 len: 0 microversion: 2.1 time: 1.100004 Aug 31 16:14:14.007472 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1989/3978] 10.222.0.61 () {58 vars in 1272 bytes} [Wed Aug 31 16:14:12 2022] DELETE /compute/v2.1/os-security-groups/328934f9-57a6-4657-91ba-7e2d53259ae7 => generated 0 bytes in 1103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:14:14.022828 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f67da7f6-3fac-4d67-bc40-f9f7e7ccd548 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Calling method '.version_select at 0x7f5ae3de5d30>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:14.126638 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0dca782b-3c04-4041-a4dd-98de2002d2b1 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:14.144118 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0dca782b-3c04-4041-a4dd-98de2002d2b1 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/d78f1dfc-6152-4180-84be-f6a84b75dbc2" status: 200 len: 1266 microversion: 2.1 time: 0.277110 Aug 31 16:14:14.145370 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1990/3979] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:13 2022] GET /compute/v2.1/servers/d78f1dfc-6152-4180-84be-f6a84b75dbc2 => generated 1266 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:14:14.280599 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-231dd6dd-9e82-4b71-910d-9d649584caa8 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:14.281452 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-231dd6dd-9e82-4b71-910d-9d649584caa8 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: c6bfb382-b9a8-4bf0-b868-ee5f51f9daac] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:14.296443 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-231dd6dd-9e82-4b71-910d-9d649584caa8 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:14.307194 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-231dd6dd-9e82-4b71-910d-9d649584caa8 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:14.309107 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-231dd6dd-9e82-4b71-910d-9d649584caa8 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:14.310300 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-231dd6dd-9e82-4b71-910d-9d649584caa8 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:14.311144 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-231dd6dd-9e82-4b71-910d-9d649584caa8 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:14.313140 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-231dd6dd-9e82-4b71-910d-9d649584caa8 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:15.494255 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f67da7f6-3fac-4d67-bc40-f9f7e7ccd548 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/8cd634f0-69a7-4c2b-837c-ebd93f5569cd" status: 202 len: 0 microversion: 2.1 time: 1.480730 Aug 31 16:14:15.495720 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1990/3980] 10.222.0.61 () {58 vars in 1272 bytes} [Wed Aug 31 16:14:14 2022] DELETE /compute/v2.1/os-security-groups/8cd634f0-69a7-4c2b-837c-ebd93f5569cd => generated 0 bytes in 1483 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:14:15.508202 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-40e7f4b7-b69c-40ac-a970-2176a1338318 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:15.510078 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-40e7f4b7-b69c-40ac-a970-2176a1338318 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: d78f1dfc-6152-4180-84be-f6a84b75dbc2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:15.531088 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-40e7f4b7-b69c-40ac-a970-2176a1338318 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:15.532083 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-40e7f4b7-b69c-40ac-a970-2176a1338318 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:15.533043 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-40e7f4b7-b69c-40ac-a970-2176a1338318 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:15.537317 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-40e7f4b7-b69c-40ac-a970-2176a1338318 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:15.539345 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-40e7f4b7-b69c-40ac-a970-2176a1338318 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:15.542297 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-40e7f4b7-b69c-40ac-a970-2176a1338318 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:15.638355 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-231dd6dd-9e82-4b71-910d-9d649584caa8 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48ee960c38f4d0584ea5ce34579279f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a957b6585e74a31b5bc5f66441c33e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:15.650680 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-231dd6dd-9e82-4b71-910d-9d649584caa8 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "GET /compute/v2.1/servers/c6bfb382-b9a8-4bf0-b868-ee5f51f9daac" status: 200 len: 1486 microversion: 2.1 time: 1.374794 Aug 31 16:14:15.655430 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1991/3981] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:14 2022] GET /compute/v2.1/servers/c6bfb382-b9a8-4bf0-b868-ee5f51f9daac => generated 1486 bytes in 1380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:15.665177 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-fcdff694-d9c0-4295-822e-a6c122b65db6 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Action: 'create', calling method: .version_select at 0x7f5ae857b3a0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-49525127", "description": "tempest-description-1470774146"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:14:16.132065 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-40e7f4b7-b69c-40ac-a970-2176a1338318 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:16.154250 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-40e7f4b7-b69c-40ac-a970-2176a1338318 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/d78f1dfc-6152-4180-84be-f6a84b75dbc2" status: 200 len: 1308 microversion: 2.1 time: 0.652801 Aug 31 16:14:16.168125 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1991/3982] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:15 2022] GET /compute/v2.1/servers/d78f1dfc-6152-4180-84be-f6a84b75dbc2 => generated 1308 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:16.178863 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2ef7862f-7d8a-48b4-9f68-3b89a319f495 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1438176047", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:14:16.281042 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-2ef7862f-7d8a-48b4-9f68-3b89a319f495 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] validate_networks() for [('082559a5-13c4-4b91-860a-8530721dd584', None, None, None, None, None)] {{(pid=122256) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:14:16.848203 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-fcdff694-d9c0-4295-822e-a6c122b65db6 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] 10.222.0.61 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 1.187679 Aug 31 16:14:16.850627 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1992/3983] 10.222.0.61 () {60 vars in 1180 bytes} [Wed Aug 31 16:14:15 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:14:16.875004 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5ed6e2ba-4edc-4ce9-a230-7266d4624738 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Action: 'update', calling method: .version_select at 0x7f5ae3c82820>, body: {"security_group": {"name": "tempest-sg-hth-260330785", "description": "tempest-description-hth-1814162209"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:14:16.995476 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:14:17.470126 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=12 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:14:18.170831 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5ed6e2ba-4edc-4ce9-a230-7266d4624738 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] 10.222.0.61 "PUT /compute/v2.1/os-security-groups/dc7ffefe-5ef5-4752-8fe3-8839772e9e4e" status: 200 len: 217 microversion: 2.1 time: 1.311441 Aug 31 16:14:18.172572 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1993/3984] 10.222.0.61 () {60 vars in 1290 bytes} [Wed Aug 31 16:14:16 2022] PUT /compute/v2.1/os-security-groups/dc7ffefe-5ef5-4752-8fe3-8839772e9e4e => generated 217 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:14:18.179535 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e80598ef-23c4-4470-8395-f2f1f5e8fa74 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:18.179535 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e80598ef-23c4-4470-8395-f2f1f5e8fa74 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: d78f1dfc-6152-4180-84be-f6a84b75dbc2] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:18.188650 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e80598ef-23c4-4470-8395-f2f1f5e8fa74 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:18.190694 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e80598ef-23c4-4470-8395-f2f1f5e8fa74 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:18.190694 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e80598ef-23c4-4470-8395-f2f1f5e8fa74 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:18.191563 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e80598ef-23c4-4470-8395-f2f1f5e8fa74 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:18.192243 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e80598ef-23c4-4470-8395-f2f1f5e8fa74 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:18.192896 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e80598ef-23c4-4470-8395-f2f1f5e8fa74 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:18.634762 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-2ef7862f-7d8a-48b4-9f68-3b89a319f495 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:14:18.635478 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-2ef7862f-7d8a-48b4-9f68-3b89a319f495 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:14:18.636017 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-2ef7862f-7d8a-48b4-9f68-3b89a319f495 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:14:18.636444 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-2ef7862f-7d8a-48b4-9f68-3b89a319f495 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:14:18.636868 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-2ef7862f-7d8a-48b4-9f68-3b89a319f495 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:14:18.651453 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2ef7862f-7d8a-48b4-9f68-3b89a319f495 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:18.658823 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2ef7862f-7d8a-48b4-9f68-3b89a319f495 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:18.658823 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2ef7862f-7d8a-48b4-9f68-3b89a319f495 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:18.658823 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2ef7862f-7d8a-48b4-9f68-3b89a319f495 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:18.658823 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2ef7862f-7d8a-48b4-9f68-3b89a319f495 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:18.658823 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2ef7862f-7d8a-48b4-9f68-3b89a319f495 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:18.679835 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-2ef7862f-7d8a-48b4-9f68-3b89a319f495 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Getting quotas for project 4a957b6585e74a31b5bc5f66441c33e3. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:14:18.685978 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-2ef7862f-7d8a-48b4-9f68-3b89a319f495 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Getting quotas for user d48ee960c38f4d0584ea5ce34579279f and project 4a957b6585e74a31b5bc5f66441c33e3. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:14:18.702603 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2ef7862f-7d8a-48b4-9f68-3b89a319f495 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Going to run 1 instances... {{(pid=122256) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:14:18.705170 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2ef7862f-7d8a-48b4-9f68-3b89a319f495 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: e3625fdf-7e50-4ba1-99dc-6ae7473fc706] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:14:18.716197 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e80598ef-23c4-4470-8395-f2f1f5e8fa74 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:18.728754 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e80598ef-23c4-4470-8395-f2f1f5e8fa74 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/d78f1dfc-6152-4180-84be-f6a84b75dbc2" status: 200 len: 1308 microversion: 2.1 time: 0.554192 Aug 31 16:14:18.729650 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1994/3985] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:18 2022] GET /compute/v2.1/servers/d78f1dfc-6152-4180-84be-f6a84b75dbc2 => generated 1308 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:18.766899 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2ef7862f-7d8a-48b4-9f68-3b89a319f495 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.597286 Aug 31 16:14:18.769106 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1992/3986] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:14:16 2022] POST /compute/v2.1/servers => generated 383 bytes in 2600 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:14:18.778106 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c467ffda-6257-4e83-863c-f96d6feba183 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Calling method '.version_select at 0x7f5ae867e160>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:18.884245 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a4a4226b-97c1-4a8e-829c-b2c0aad98384 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-1702546762", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "f2a143f1-c524-416f-955a-6b4a048e42a7"}]}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:14:18.955935 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c467ffda-6257-4e83-863c-f96d6feba183 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] 10.222.0.61 "GET /compute/v2.1/os-security-groups/dc7ffefe-5ef5-4752-8fe3-8839772e9e4e" status: 200 len: 217 microversion: 2.1 time: 0.185662 Aug 31 16:14:18.956751 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1993/3987] 10.222.0.61 () {58 vars in 1269 bytes} [Wed Aug 31 16:14:18 2022] GET /compute/v2.1/os-security-groups/dc7ffefe-5ef5-4752-8fe3-8839772e9e4e => generated 217 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:14:18.973435 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e90cf375-8ff2-4b8a-a9bb-ad052552ce24 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:18.974329 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e90cf375-8ff2-4b8a-a9bb-ad052552ce24 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: e3625fdf-7e50-4ba1-99dc-6ae7473fc706] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:18.977401 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-a4a4226b-97c1-4a8e-829c-b2c0aad98384 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] validate_networks() for [('f2a143f1-c524-416f-955a-6b4a048e42a7', None, None, None, None, None)] {{(pid=122257) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:14:19.228025 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e90cf375-8ff2-4b8a-a9bb-ad052552ce24 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48ee960c38f4d0584ea5ce34579279f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a957b6585e74a31b5bc5f66441c33e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:19.239213 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e90cf375-8ff2-4b8a-a9bb-ad052552ce24 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706" status: 200 len: 1214 microversion: 2.1 time: 0.281584 Aug 31 16:14:19.241095 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1994/3988] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:18 2022] GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706 => generated 1214 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:19.249562 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6339e9da-1e20-4bf7-97bc-d585d2cf38b4 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Calling method '.version_select at 0x7f5ae3eb1c10>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:20.988919 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6339e9da-1e20-4bf7-97bc-d585d2cf38b4 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/dc7ffefe-5ef5-4752-8fe3-8839772e9e4e" status: 202 len: 0 microversion: 2.1 time: 1.746313 Aug 31 16:14:20.993322 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1995/3989] 10.222.0.61 () {58 vars in 1272 bytes} [Wed Aug 31 16:14:19 2022] DELETE /compute/v2.1/os-security-groups/dc7ffefe-5ef5-4752-8fe3-8839772e9e4e => generated 0 bytes in 1751 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:14:20.998619 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-96b25e2e-d3f3-426a-a5a2-c79cd06e7f2b req-0c668c3a-849b-4183-9e8e-d12e9847c52a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d78f1dfc-6152-4180-84be-f6a84b75dbc2", "tag": "1fd435b6-e20e-4b7a-93c8-aa966480c41d"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:14:21.047891 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-96b25e2e-d3f3-426a-a5a2-c79cd06e7f2b req-0c668c3a-849b-4183-9e8e-d12e9847c52a service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:21.050974 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-96b25e2e-d3f3-426a-a5a2-c79cd06e7f2b req-0c668c3a-849b-4183-9e8e-d12e9847c52a service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:21.055194 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-96b25e2e-d3f3-426a-a5a2-c79cd06e7f2b req-0c668c3a-849b-4183-9e8e-d12e9847c52a service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:21.086238 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-96b25e2e-d3f3-426a-a5a2-c79cd06e7f2b req-0c668c3a-849b-4183-9e8e-d12e9847c52a service nova] Creating event network-changed:1fd435b6-e20e-4b7a-93c8-aa966480c41d for instance d78f1dfc-6152-4180-84be-f6a84b75dbc2 on n-h2-850499-9 Aug 31 16:14:21.110462 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-96b25e2e-d3f3-426a-a5a2-c79cd06e7f2b req-0c668c3a-849b-4183-9e8e-d12e9847c52a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115504 Aug 31 16:14:21.125281 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1996/3990] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:14:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:14:21.145208 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0278335c-d9ae-4d29-ba75-22df6b83e028 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:21.148586 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0278335c-d9ae-4d29-ba75-22df6b83e028 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: d78f1dfc-6152-4180-84be-f6a84b75dbc2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:21.158788 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0278335c-d9ae-4d29-ba75-22df6b83e028 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:21.159712 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0278335c-d9ae-4d29-ba75-22df6b83e028 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:21.160353 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0278335c-d9ae-4d29-ba75-22df6b83e028 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:21.162100 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0278335c-d9ae-4d29-ba75-22df6b83e028 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:21.162838 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0278335c-d9ae-4d29-ba75-22df6b83e028 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:21.164525 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0278335c-d9ae-4d29-ba75-22df6b83e028 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:22.080522 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-a4a4226b-97c1-4a8e-829c-b2c0aad98384 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:14:22.081544 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-a4a4226b-97c1-4a8e-829c-b2c0aad98384 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:14:22.082213 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-a4a4226b-97c1-4a8e-829c-b2c0aad98384 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:14:22.082812 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-a4a4226b-97c1-4a8e-829c-b2c0aad98384 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:14:22.083415 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-a4a4226b-97c1-4a8e-829c-b2c0aad98384 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:14:22.103196 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a4a4226b-97c1-4a8e-829c-b2c0aad98384 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:22.105225 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a4a4226b-97c1-4a8e-829c-b2c0aad98384 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:22.107796 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a4a4226b-97c1-4a8e-829c-b2c0aad98384 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:22.108862 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a4a4226b-97c1-4a8e-829c-b2c0aad98384 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:22.109573 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a4a4226b-97c1-4a8e-829c-b2c0aad98384 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:22.110201 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a4a4226b-97c1-4a8e-829c-b2c0aad98384 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:22.180069 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-a4a4226b-97c1-4a8e-829c-b2c0aad98384 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Getting quotas for project eeac74d3027d4080be26bf3aadab4c0a. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:14:22.202200 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-a4a4226b-97c1-4a8e-829c-b2c0aad98384 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Getting quotas for user 07d6eee711fe4194a4db63c801f78561 and project eeac74d3027d4080be26bf3aadab4c0a. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:14:22.245081 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a4a4226b-97c1-4a8e-829c-b2c0aad98384 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Going to run 2 instances... {{(pid=122257) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:14:22.247917 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a4a4226b-97c1-4a8e-829c-b2c0aad98384 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] [instance: 1ba6c72d-ec62-431a-908b-484701a473b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:14:22.290700 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-0278335c-d9ae-4d29-ba75-22df6b83e028 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:22.304311 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0278335c-d9ae-4d29-ba75-22df6b83e028 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/d78f1dfc-6152-4180-84be-f6a84b75dbc2" status: 200 len: 1308 microversion: 2.1 time: 1.177305 Aug 31 16:14:22.305489 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1997/3991] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:21 2022] GET /compute/v2.1/servers/d78f1dfc-6152-4180-84be-f6a84b75dbc2 => generated 1308 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:22.315167 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-62a68af6-266f-4d91-a979-5e74439a073d tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:22.323905 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-62a68af6-266f-4d91-a979-5e74439a073d tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: e3625fdf-7e50-4ba1-99dc-6ae7473fc706] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:22.343288 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-62a68af6-266f-4d91-a979-5e74439a073d tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:22.343867 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-62a68af6-266f-4d91-a979-5e74439a073d tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:22.344720 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-62a68af6-266f-4d91-a979-5e74439a073d tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:22.346466 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-62a68af6-266f-4d91-a979-5e74439a073d tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:22.347309 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-62a68af6-266f-4d91-a979-5e74439a073d tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:22.347982 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-62a68af6-266f-4d91-a979-5e74439a073d tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:22.351321 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a4a4226b-97c1-4a8e-829c-b2c0aad98384 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] [instance: 1ceba728-a215-4f85-a8c1-9c79311861e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=1ba6c72d-ec62-431a-908b-484701a473b6,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:14:22.489116 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a4a4226b-97c1-4a8e-829c-b2c0aad98384 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.757727 Aug 31 16:14:22.489800 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1995/3992] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:14:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 3759 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:14:22.502215 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-530dec60-5f15-49b7-900f-cece8af2ac91 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:22.507970 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-530dec60-5f15-49b7-900f-cece8af2ac91 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] [instance: 18dc9f32-b72a-4f4f-9153-a6a54f9d21b8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:22.538372 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-530dec60-5f15-49b7-900f-cece8af2ac91 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:22.539381 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-530dec60-5f15-49b7-900f-cece8af2ac91 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:22.540044 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-530dec60-5f15-49b7-900f-cece8af2ac91 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:22.541626 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-530dec60-5f15-49b7-900f-cece8af2ac91 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:22.542305 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-530dec60-5f15-49b7-900f-cece8af2ac91 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:22.543602 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-530dec60-5f15-49b7-900f-cece8af2ac91 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:22.572029 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-62a68af6-266f-4d91-a979-5e74439a073d tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48ee960c38f4d0584ea5ce34579279f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a957b6585e74a31b5bc5f66441c33e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:22.582302 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-62a68af6-266f-4d91-a979-5e74439a073d tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706" status: 200 len: 1272 microversion: 2.1 time: 0.271128 Aug 31 16:14:22.592952 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1998/3993] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:22 2022] GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706 => generated 1272 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:22.614861 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-530dec60-5f15-49b7-900f-cece8af2ac91 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] HTTP exception thrown: Instance 18dc9f32-b72a-4f4f-9153-a6a54f9d21b8 could not be found. Aug 31 16:14:22.617030 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-77250642-d6e8-4c16-bf83-882636007484 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:22.621884 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-530dec60-5f15-49b7-900f-cece8af2ac91 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Request method failure captured: Aug 31 16:14:22.621884 n-d-850499-9 devstack@n-api.service[122257]: request: DELETE /compute/v2.1/servers/18dc9f32-b72a-4f4f-9153-a6a54f9d21b8 HTTP/1.1 Aug 31 16:14:22.621884 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:14:22.621884 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:14:22.621884 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:14:22.621884 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:14:22.621884 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:14:22.621884 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:14:22.621884 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:14:22.621884 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:14:22.621884 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4iB3ZSM042t6H57DKQNRNkGdMmN-dpZ1iYL7Qp9DB5vaoQM-CcEpndp_H4eJtfFInIhXcNSw2oPrel3OUzJ_33XKrMtGya3pa2oH-wP6jy1-79FFGtwCTUUJYiIziOxflBbp14Trh2dPFGd_PM4hgPBygRYcEqBhkOx0cf9zQWBZvc Aug 31 16:14:22.621884 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:14:22.621884 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:14:22.621884 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:14:22.621884 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:14:22.621884 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:14:22.621884 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:14:22.621884 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 9f66705b4a0f4711ba14d9ceb5699bd1 Aug 31 16:14:22.621884 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-SecurityGroupsTestJSON-269266309 Aug 31 16:14:22.621884 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:14:22.621884 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:14:22.621884 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9f66705b4a0f4711ba14d9ceb5699bd1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9f66705b4a0f4711ba14d9ceb5699bd1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9f66705b4a0f4711ba14d9ceb5699bd1", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9f66705b4a0f4711ba14d9ceb5699bd1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:14:22.621884 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-SecurityGroupsTestJSON-269266309 Aug 31 16:14:22.621884 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 9f66705b4a0f4711ba14d9ceb5699bd1 Aug 31 16:14:22.621884 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-269266309 Aug 31 16:14:22.621884 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-SecurityGroupsTestJSON-269266309-project Aug 31 16:14:22.621884 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:14:22.621884 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:14:22.621884 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 5f911026e35d40a480094376c6556d03 Aug 31 16:14:22.621884 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-SecurityGroupsTestJSON-269266309-project Aug 31 16:14:22.621884 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:14:22.621884 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance 18dc9f32-b72a-4f4f-9153-a6a54f9d21b8 could not be found. Aug 31 16:14:22.621884 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '18dc9f32-b72a-4f4f-9153-a6a54f9d21b8'} Aug 31 16:14:22.621884 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:14:22.621884 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:22.621884 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:14:22.621884 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:14:22.621884 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:14:22.621884 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:14:22.621884 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:14:22.621884 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:14:22.621884 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:14:22.621884 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:14:22.621884 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18dc9f32-b72a-4f4f-9153-a6a54f9d21b8 could not be found. Aug 31 16:14:22.621884 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:14:22.621884 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:14:22.621884 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:14:22.621884 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:22.621884 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:14:22.621884 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:14:22.621884 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:14:22.621884 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:14:22.621884 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:14:22.621884 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:14:22.621884 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:14:22.621884 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:14:22.621884 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:14:22.621884 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:14:22.621884 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:14:22.621884 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:14:22.621884 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:14:22.621884 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:14:22.628065 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18dc9f32-b72a-4f4f-9153-a6a54f9d21b8 could not be found. Aug 31 16:14:22.628065 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:14:22.628065 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:14:22.628065 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:14:22.628065 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:22.628065 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:14:22.628065 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:14:22.628065 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:14:22.628065 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:14:22.628065 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18dc9f32-b72a-4f4f-9153-a6a54f9d21b8 could not be found. Aug 31 16:14:22.628065 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:14:22.636433 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-77250642-d6e8-4c16-bf83-882636007484 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '07d6eee711fe4194a4db63c801f78561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeac74d3027d4080be26bf3aadab4c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:22.641362 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-530dec60-5f15-49b7-900f-cece8af2ac91 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Returning 404 to user: Instance 18dc9f32-b72a-4f4f-9153-a6a54f9d21b8 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:14:22.644186 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-530dec60-5f15-49b7-900f-cece8af2ac91 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] 10.222.0.61 "DELETE /compute/v2.1/servers/18dc9f32-b72a-4f4f-9153-a6a54f9d21b8" status: 404 len: 111 microversion: 2.1 time: 0.146113 Aug 31 16:14:22.648941 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1996/3994] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:14:22 2022] DELETE /compute/v2.1/servers/18dc9f32-b72a-4f4f-9153-a6a54f9d21b8 => generated 111 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:14:22.654466 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-77250642-d6e8-4c16-bf83-882636007484 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Searching by: {'deleted': False, 'project_id': 'eeac74d3027d4080be26bf3aadab4c0a'} {{(pid=122256) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 16:14:22.658525 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a558ab6f-0ab2-44ef-b60e-d385107a8a92 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:22.667024 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a558ab6f-0ab2-44ef-b60e-d385107a8a92 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] [instance: 18dc9f32-b72a-4f4f-9153-a6a54f9d21b8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:22.701621 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a558ab6f-0ab2-44ef-b60e-d385107a8a92 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:22.702751 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a558ab6f-0ab2-44ef-b60e-d385107a8a92 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:22.703207 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a558ab6f-0ab2-44ef-b60e-d385107a8a92 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:22.703985 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a558ab6f-0ab2-44ef-b60e-d385107a8a92 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:22.704456 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a558ab6f-0ab2-44ef-b60e-d385107a8a92 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:22.705546 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a558ab6f-0ab2-44ef-b60e-d385107a8a92 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:22.720957 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-77250642-d6e8-4c16-bf83-882636007484 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:22.728154 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-77250642-d6e8-4c16-bf83-882636007484 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:22.728658 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-77250642-d6e8-4c16-bf83-882636007484 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:22.729502 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-77250642-d6e8-4c16-bf83-882636007484 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:22.730110 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-77250642-d6e8-4c16-bf83-882636007484 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:22.730435 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-77250642-d6e8-4c16-bf83-882636007484 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:22.762135 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-a558ab6f-0ab2-44ef-b60e-d385107a8a92 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] HTTP exception thrown: Instance 18dc9f32-b72a-4f4f-9153-a6a54f9d21b8 could not be found. Aug 31 16:14:22.764068 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a558ab6f-0ab2-44ef-b60e-d385107a8a92 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Request method failure captured: Aug 31 16:14:22.764068 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/18dc9f32-b72a-4f4f-9153-a6a54f9d21b8 HTTP/1.1 Aug 31 16:14:22.764068 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:14:22.764068 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:14:22.764068 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:14:22.764068 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:14:22.764068 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:14:22.764068 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:14:22.764068 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:14:22.764068 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:14:22.764068 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4iB3ZSM042t6H57DKQNRNkGdMmN-dpZ1iYL7Qp9DB5vaoQM-CcEpndp_H4eJtfFInIhXcNSw2oPrel3OUzJ_33XKrMtGya3pa2oH-wP6jy1-79FFGtwCTUUJYiIziOxflBbp14Trh2dPFGd_PM4hgPBygRYcEqBhkOx0cf9zQWBZvc Aug 31 16:14:22.764068 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:14:22.764068 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:14:22.764068 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:14:22.764068 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:14:22.764068 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:14:22.764068 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:14:22.764068 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 9f66705b4a0f4711ba14d9ceb5699bd1 Aug 31 16:14:22.764068 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-SecurityGroupsTestJSON-269266309 Aug 31 16:14:22.764068 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:14:22.764068 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:14:22.764068 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9f66705b4a0f4711ba14d9ceb5699bd1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9f66705b4a0f4711ba14d9ceb5699bd1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9f66705b4a0f4711ba14d9ceb5699bd1", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9f66705b4a0f4711ba14d9ceb5699bd1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:14:22.764068 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-SecurityGroupsTestJSON-269266309 Aug 31 16:14:22.764068 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 9f66705b4a0f4711ba14d9ceb5699bd1 Aug 31 16:14:22.764068 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-269266309 Aug 31 16:14:22.764068 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-SecurityGroupsTestJSON-269266309-project Aug 31 16:14:22.764068 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:14:22.764068 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:14:22.764068 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 5f911026e35d40a480094376c6556d03 Aug 31 16:14:22.764068 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-SecurityGroupsTestJSON-269266309-project Aug 31 16:14:22.764068 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:14:22.764068 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance 18dc9f32-b72a-4f4f-9153-a6a54f9d21b8 could not be found. Aug 31 16:14:22.764068 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '18dc9f32-b72a-4f4f-9153-a6a54f9d21b8'} Aug 31 16:14:22.764068 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:14:22.764068 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:22.764068 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:14:22.764068 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:14:22.764068 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:14:22.764068 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:14:22.764068 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:14:22.764068 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:14:22.764068 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:14:22.764068 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:14:22.764068 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18dc9f32-b72a-4f4f-9153-a6a54f9d21b8 could not be found. Aug 31 16:14:22.764068 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:14:22.764068 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:14:22.764068 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:14:22.764068 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:22.764068 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:14:22.764068 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:14:22.764068 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:14:22.764068 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:14:22.764068 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:14:22.764068 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:14:22.764068 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:14:22.764068 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:14:22.764068 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:14:22.764068 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:14:22.764068 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:14:22.764068 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:14:22.764068 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18dc9f32-b72a-4f4f-9153-a6a54f9d21b8 could not be found. Aug 31 16:14:22.764068 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:14:22.764068 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:14:22.764068 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:14:22.769373 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:22.769373 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:14:22.769373 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:14:22.769373 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:14:22.769373 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:14:22.769373 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18dc9f32-b72a-4f4f-9153-a6a54f9d21b8 could not be found. Aug 31 16:14:22.769373 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:14:22.775081 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a558ab6f-0ab2-44ef-b60e-d385107a8a92 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Returning 404 to user: Instance 18dc9f32-b72a-4f4f-9153-a6a54f9d21b8 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:14:22.777322 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a558ab6f-0ab2-44ef-b60e-d385107a8a92 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] 10.222.0.61 "GET /compute/v2.1/servers/18dc9f32-b72a-4f4f-9153-a6a54f9d21b8" status: 404 len: 111 microversion: 2.1 time: 0.125210 Aug 31 16:14:22.778553 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1997/3995] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:22 2022] GET /compute/v2.1/servers/18dc9f32-b72a-4f4f-9153-a6a54f9d21b8 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:14:22.789332 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2627019d-be39-4406-8f5e-0fc7323e3a4c tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Calling method '.version_select at 0x7f5ae857b670>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:22.791070 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-77250642-d6e8-4c16-bf83-882636007484 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] 10.222.0.61 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.196734 Aug 31 16:14:22.798467 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 1999/3996] 10.222.0.61 () {58 vars in 1125 bytes} [Wed Aug 31 16:14:22 2022] GET /compute/v2.1/servers => generated 677 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:14:22.804997 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-cc13f1a7-93bb-4514-b386-549ff6712532 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:22.805880 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-cc13f1a7-93bb-4514-b386-549ff6712532 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] [instance: 1ceba728-a215-4f85-a8c1-9c79311861e1] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:22.859997 n-d-850499-9 devstack@n-api.service[122257]: DEBUG neutronclient.v2_0.client [None req-2627019d-be39-4406-8f5e-0fc7323e3a4c tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 8cd634f0-69a7-4c2b-837c-ebd93f5569cd does not exist", "detail": ""}} {{(pid=122257) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 31 16:14:22.861549 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.security_group_api [None req-2627019d-be39-4406-8f5e-0fc7323e3a4c tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Neutron security group 8cd634f0-69a7-4c2b-837c-ebd93f5569cd not found {{(pid=122257) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 31 16:14:22.863452 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-2627019d-be39-4406-8f5e-0fc7323e3a4c tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] HTTP exception thrown: Security group 8cd634f0-69a7-4c2b-837c-ebd93f5569cd does not exist Aug 31 16:14:22.863452 n-d-850499-9 devstack@n-api.service[122257]: Neutron server returns request_ids: ['req-f4a41f85-207b-4a5c-b84c-3ef1a73b613c'] Aug 31 16:14:22.867425 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2627019d-be39-4406-8f5e-0fc7323e3a4c tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Request method failure captured: Aug 31 16:14:22.867425 n-d-850499-9 devstack@n-api.service[122257]: request: DELETE /compute/v2.1/os-security-groups/8cd634f0-69a7-4c2b-837c-ebd93f5569cd HTTP/1.1 Aug 31 16:14:22.867425 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:14:22.867425 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:14:22.867425 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:14:22.867425 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:14:22.867425 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:14:22.867425 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:14:22.867425 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:14:22.867425 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:14:22.867425 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4iB3ZSM042t6H57DKQNRNkGdMmN-dpZ1iYL7Qp9DB5vaoQM-CcEpndp_H4eJtfFInIhXcNSw2oPrel3OUzJ_33XKrMtGya3pa2oH-wP6jy1-79FFGtwCTUUJYiIziOxflBbp14Trh2dPFGd_PM4hgPBygRYcEqBhkOx0cf9zQWBZvc Aug 31 16:14:22.867425 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:14:22.867425 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:14:22.867425 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:14:22.867425 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:14:22.867425 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:14:22.867425 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:14:22.867425 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 9f66705b4a0f4711ba14d9ceb5699bd1 Aug 31 16:14:22.867425 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-SecurityGroupsTestJSON-269266309 Aug 31 16:14:22.867425 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:14:22.867425 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:14:22.867425 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9f66705b4a0f4711ba14d9ceb5699bd1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9f66705b4a0f4711ba14d9ceb5699bd1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9f66705b4a0f4711ba14d9ceb5699bd1", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9f66705b4a0f4711ba14d9ceb5699bd1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:14:22.867425 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-SecurityGroupsTestJSON-269266309 Aug 31 16:14:22.867425 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 9f66705b4a0f4711ba14d9ceb5699bd1 Aug 31 16:14:22.867425 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-269266309 Aug 31 16:14:22.867425 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-SecurityGroupsTestJSON-269266309-project Aug 31 16:14:22.867425 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:14:22.867425 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:14:22.867425 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 5f911026e35d40a480094376c6556d03 Aug 31 16:14:22.867425 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-SecurityGroupsTestJSON-269266309-project Aug 31 16:14:22.867425 n-d-850499-9 devstack@n-api.service[122257]: method: Aug 31 16:14:22.867425 n-d-850499-9 devstack@n-api.service[122257]: exception: Security group 8cd634f0-69a7-4c2b-837c-ebd93f5569cd does not exist Aug 31 16:14:22.867425 n-d-850499-9 devstack@n-api.service[122257]: Neutron server returns request_ids: ['req-f4a41f85-207b-4a5c-b84c-3ef1a73b613c'] Aug 31 16:14:22.867425 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '8cd634f0-69a7-4c2b-837c-ebd93f5569cd'} Aug 31 16:14:22.867425 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:14:22.867425 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:22.867425 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 31 16:14:22.867425 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 31 16:14:22.867425 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:14:22.867425 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:14:22.867425 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 31 16:14:22.867425 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 31 16:14:22.867425 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:14:22.867425 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:14:22.867425 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 31 16:14:22.867425 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 31 16:14:22.867425 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:14:22.867425 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:14:22.867425 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 31 16:14:22.867425 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 31 16:14:22.867425 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:14:22.867425 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:14:22.867425 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 31 16:14:22.867425 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 31 16:14:22.867425 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:14:22.867425 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:14:22.867425 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 31 16:14:22.867425 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 31 16:14:22.867425 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 31 16:14:22.867425 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 31 16:14:22.867425 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 8cd634f0-69a7-4c2b-837c-ebd93f5569cd does not exist Aug 31 16:14:22.873543 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f4a41f85-207b-4a5c-b84c-3ef1a73b613c'] Aug 31 16:14:22.873543 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:14:22.873543 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:14:22.873543 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:14:22.873543 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:22.873543 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 31 16:14:22.873543 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 31 16:14:22.873543 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 31 16:14:22.873543 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 31 16:14:22.873543 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 8cd634f0-69a7-4c2b-837c-ebd93f5569cd does not exist Aug 31 16:14:22.873543 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f4a41f85-207b-4a5c-b84c-3ef1a73b613c'] Aug 31 16:14:22.873543 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:14:22.873543 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:14:22.873543 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:14:22.873543 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:22.873543 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:14:22.873543 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:14:22.873543 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:14:22.873543 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:14:22.873543 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:14:22.873543 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:14:22.873543 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:14:22.873543 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:14:22.873543 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 31 16:14:22.873543 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 31 16:14:22.873543 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 8cd634f0-69a7-4c2b-837c-ebd93f5569cd does not exist Aug 31 16:14:22.873543 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f4a41f85-207b-4a5c-b84c-3ef1a73b613c'] Aug 31 16:14:22.873543 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:14:22.873543 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:14:22.873543 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:14:22.873543 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:22.873543 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:14:22.873543 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:14:22.873543 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:14:22.873543 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:14:22.873543 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 8cd634f0-69a7-4c2b-837c-ebd93f5569cd does not exist Aug 31 16:14:22.873543 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f4a41f85-207b-4a5c-b84c-3ef1a73b613c'] Aug 31 16:14:22.873543 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:14:22.881203 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2627019d-be39-4406-8f5e-0fc7323e3a4c tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Returning 404 to user: Security group 8cd634f0-69a7-4c2b-837c-ebd93f5569cd does not exist Aug 31 16:14:22.881203 n-d-850499-9 devstack@n-api.service[122257]: Neutron server returns request_ids: ['req-f4a41f85-207b-4a5c-b84c-3ef1a73b613c'] {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:14:22.882980 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2627019d-be39-4406-8f5e-0fc7323e3a4c tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/8cd634f0-69a7-4c2b-837c-ebd93f5569cd" status: 404 len: 194 microversion: 2.1 time: 0.097469 Aug 31 16:14:22.884704 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1998/3997] 10.222.0.61 () {58 vars in 1272 bytes} [Wed Aug 31 16:14:22 2022] DELETE /compute/v2.1/os-security-groups/8cd634f0-69a7-4c2b-837c-ebd93f5569cd => generated 194 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:14:22.906837 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1d61ce78-7911-40e0-b359-de61e13527fd tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Calling method '.version_select at 0x7f5ae856b4c0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:23.010830 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-cc13f1a7-93bb-4514-b386-549ff6712532 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d6eee711fe4194a4db63c801f78561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeac74d3027d4080be26bf3aadab4c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:23.021728 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-cc13f1a7-93bb-4514-b386-549ff6712532 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] 10.222.0.61 "GET /compute/v2.1/servers/1ceba728-a215-4f85-a8c1-9c79311861e1" status: 200 len: 1220 microversion: 2.1 time: 0.220800 Aug 31 16:14:23.041185 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2000/3998] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:22 2022] GET /compute/v2.1/servers/1ceba728-a215-4f85-a8c1-9c79311861e1 => generated 1220 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:23.054334 n-d-850499-9 devstack@n-api.service[122257]: DEBUG neutronclient.v2_0.client [None req-1d61ce78-7911-40e0-b359-de61e13527fd tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 328934f9-57a6-4657-91ba-7e2d53259ae7 does not exist", "detail": ""}} {{(pid=122257) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 31 16:14:23.055067 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.security_group_api [None req-1d61ce78-7911-40e0-b359-de61e13527fd tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Neutron security group 328934f9-57a6-4657-91ba-7e2d53259ae7 not found {{(pid=122257) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 31 16:14:23.055849 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-1d61ce78-7911-40e0-b359-de61e13527fd tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] HTTP exception thrown: Security group 328934f9-57a6-4657-91ba-7e2d53259ae7 does not exist Aug 31 16:14:23.055849 n-d-850499-9 devstack@n-api.service[122257]: Neutron server returns request_ids: ['req-2c318941-1f7c-4c40-a6c5-d87ecc91494d'] Aug 31 16:14:23.058717 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1d61ce78-7911-40e0-b359-de61e13527fd tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Request method failure captured: Aug 31 16:14:23.058717 n-d-850499-9 devstack@n-api.service[122257]: request: DELETE /compute/v2.1/os-security-groups/328934f9-57a6-4657-91ba-7e2d53259ae7 HTTP/1.1 Aug 31 16:14:23.058717 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:14:23.058717 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:14:23.058717 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:14:23.058717 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:14:23.058717 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:14:23.058717 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:14:23.058717 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:14:23.058717 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:14:23.058717 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4iB3ZSM042t6H57DKQNRNkGdMmN-dpZ1iYL7Qp9DB5vaoQM-CcEpndp_H4eJtfFInIhXcNSw2oPrel3OUzJ_33XKrMtGya3pa2oH-wP6jy1-79FFGtwCTUUJYiIziOxflBbp14Trh2dPFGd_PM4hgPBygRYcEqBhkOx0cf9zQWBZvc Aug 31 16:14:23.058717 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:14:23.058717 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:14:23.058717 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:14:23.058717 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:14:23.058717 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:14:23.058717 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:14:23.058717 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 9f66705b4a0f4711ba14d9ceb5699bd1 Aug 31 16:14:23.058717 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-SecurityGroupsTestJSON-269266309 Aug 31 16:14:23.058717 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:14:23.058717 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:14:23.058717 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9f66705b4a0f4711ba14d9ceb5699bd1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9f66705b4a0f4711ba14d9ceb5699bd1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9f66705b4a0f4711ba14d9ceb5699bd1", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9f66705b4a0f4711ba14d9ceb5699bd1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:14:23.058717 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-SecurityGroupsTestJSON-269266309 Aug 31 16:14:23.058717 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 9f66705b4a0f4711ba14d9ceb5699bd1 Aug 31 16:14:23.058717 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-269266309 Aug 31 16:14:23.058717 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-SecurityGroupsTestJSON-269266309-project Aug 31 16:14:23.058717 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:14:23.058717 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:14:23.058717 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 5f911026e35d40a480094376c6556d03 Aug 31 16:14:23.058717 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-SecurityGroupsTestJSON-269266309-project Aug 31 16:14:23.058717 n-d-850499-9 devstack@n-api.service[122257]: method: Aug 31 16:14:23.058717 n-d-850499-9 devstack@n-api.service[122257]: exception: Security group 328934f9-57a6-4657-91ba-7e2d53259ae7 does not exist Aug 31 16:14:23.058717 n-d-850499-9 devstack@n-api.service[122257]: Neutron server returns request_ids: ['req-2c318941-1f7c-4c40-a6c5-d87ecc91494d'] Aug 31 16:14:23.058717 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '328934f9-57a6-4657-91ba-7e2d53259ae7'} Aug 31 16:14:23.058717 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:14:23.058717 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:23.058717 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 31 16:14:23.058717 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 31 16:14:23.058717 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:14:23.058717 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:14:23.058717 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 31 16:14:23.058717 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 31 16:14:23.058717 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:14:23.058717 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:14:23.058717 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 31 16:14:23.058717 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 31 16:14:23.058717 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:14:23.058717 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:14:23.058717 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 31 16:14:23.058717 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 31 16:14:23.058717 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:14:23.058717 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:14:23.058717 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 31 16:14:23.058717 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 31 16:14:23.058717 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:14:23.058717 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:14:23.058717 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 31 16:14:23.058717 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 31 16:14:23.058717 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 31 16:14:23.058717 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 31 16:14:23.058717 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 328934f9-57a6-4657-91ba-7e2d53259ae7 does not exist Aug 31 16:14:23.074982 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2c318941-1f7c-4c40-a6c5-d87ecc91494d'] Aug 31 16:14:23.074982 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:14:23.074982 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:14:23.074982 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:14:23.074982 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:23.074982 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 31 16:14:23.074982 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 31 16:14:23.074982 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 31 16:14:23.074982 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 31 16:14:23.074982 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 328934f9-57a6-4657-91ba-7e2d53259ae7 does not exist Aug 31 16:14:23.074982 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2c318941-1f7c-4c40-a6c5-d87ecc91494d'] Aug 31 16:14:23.074982 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:14:23.074982 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:14:23.074982 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:14:23.074982 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:23.074982 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:14:23.074982 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:14:23.074982 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:14:23.074982 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:14:23.074982 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:14:23.074982 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:14:23.074982 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:14:23.074982 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:14:23.074982 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 31 16:14:23.074982 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 31 16:14:23.074982 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 328934f9-57a6-4657-91ba-7e2d53259ae7 does not exist Aug 31 16:14:23.074982 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2c318941-1f7c-4c40-a6c5-d87ecc91494d'] Aug 31 16:14:23.074982 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:14:23.074982 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:14:23.074982 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:14:23.074982 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:23.074982 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:14:23.074982 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:14:23.074982 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:14:23.074982 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:14:23.074982 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 328934f9-57a6-4657-91ba-7e2d53259ae7 does not exist Aug 31 16:14:23.074982 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2c318941-1f7c-4c40-a6c5-d87ecc91494d'] Aug 31 16:14:23.074982 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:14:23.074982 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1d61ce78-7911-40e0-b359-de61e13527fd tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Returning 404 to user: Security group 328934f9-57a6-4657-91ba-7e2d53259ae7 does not exist Aug 31 16:14:23.074982 n-d-850499-9 devstack@n-api.service[122257]: Neutron server returns request_ids: ['req-2c318941-1f7c-4c40-a6c5-d87ecc91494d'] {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:14:23.074982 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1d61ce78-7911-40e0-b359-de61e13527fd tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/328934f9-57a6-4657-91ba-7e2d53259ae7" status: 404 len: 194 microversion: 2.1 time: 0.172451 Aug 31 16:14:23.074982 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 1999/3999] 10.222.0.61 () {58 vars in 1272 bytes} [Wed Aug 31 16:14:22 2022] DELETE /compute/v2.1/os-security-groups/328934f9-57a6-4657-91ba-7e2d53259ae7 => generated 194 bytes in 177 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:14:23.085100 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4daedc8a-7228-4445-9a75-9c1763728562 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Calling method '.version_select at 0x7f5ae3e0e670>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:23.271057 n-d-850499-9 devstack@n-api.service[122256]: DEBUG neutronclient.v2_0.client [None req-4daedc8a-7228-4445-9a75-9c1763728562 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 33cd3db7-9234-4312-b6e8-1dd9f95aaa81 does not exist", "detail": ""}} {{(pid=122256) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 31 16:14:23.272293 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.security_group_api [None req-4daedc8a-7228-4445-9a75-9c1763728562 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Neutron security group 33cd3db7-9234-4312-b6e8-1dd9f95aaa81 not found {{(pid=122256) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 31 16:14:23.272887 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-4daedc8a-7228-4445-9a75-9c1763728562 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] HTTP exception thrown: Security group 33cd3db7-9234-4312-b6e8-1dd9f95aaa81 does not exist Aug 31 16:14:23.272887 n-d-850499-9 devstack@n-api.service[122256]: Neutron server returns request_ids: ['req-2e9f16e8-7d36-4719-b4a9-9a64cb3941b7'] Aug 31 16:14:23.274869 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4daedc8a-7228-4445-9a75-9c1763728562 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Request method failure captured: Aug 31 16:14:23.274869 n-d-850499-9 devstack@n-api.service[122256]: request: DELETE /compute/v2.1/os-security-groups/33cd3db7-9234-4312-b6e8-1dd9f95aaa81 HTTP/1.1 Aug 31 16:14:23.274869 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:14:23.274869 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:14:23.274869 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:14:23.274869 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:14:23.274869 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:14:23.274869 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:14:23.274869 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:14:23.274869 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:14:23.274869 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4iB3ZSM042t6H57DKQNRNkGdMmN-dpZ1iYL7Qp9DB5vaoQM-CcEpndp_H4eJtfFInIhXcNSw2oPrel3OUzJ_33XKrMtGya3pa2oH-wP6jy1-79FFGtwCTUUJYiIziOxflBbp14Trh2dPFGd_PM4hgPBygRYcEqBhkOx0cf9zQWBZvc Aug 31 16:14:23.274869 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:14:23.274869 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:14:23.274869 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:14:23.274869 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:14:23.274869 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:14:23.274869 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:14:23.274869 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 9f66705b4a0f4711ba14d9ceb5699bd1 Aug 31 16:14:23.274869 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-SecurityGroupsTestJSON-269266309 Aug 31 16:14:23.274869 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:14:23.274869 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:14:23.274869 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9f66705b4a0f4711ba14d9ceb5699bd1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9f66705b4a0f4711ba14d9ceb5699bd1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9f66705b4a0f4711ba14d9ceb5699bd1", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9f66705b4a0f4711ba14d9ceb5699bd1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:14:23.274869 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-SecurityGroupsTestJSON-269266309 Aug 31 16:14:23.274869 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 9f66705b4a0f4711ba14d9ceb5699bd1 Aug 31 16:14:23.274869 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-269266309 Aug 31 16:14:23.274869 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-SecurityGroupsTestJSON-269266309-project Aug 31 16:14:23.274869 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:14:23.274869 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:14:23.274869 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 5f911026e35d40a480094376c6556d03 Aug 31 16:14:23.274869 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-SecurityGroupsTestJSON-269266309-project Aug 31 16:14:23.274869 n-d-850499-9 devstack@n-api.service[122256]: method: Aug 31 16:14:23.274869 n-d-850499-9 devstack@n-api.service[122256]: exception: Security group 33cd3db7-9234-4312-b6e8-1dd9f95aaa81 does not exist Aug 31 16:14:23.274869 n-d-850499-9 devstack@n-api.service[122256]: Neutron server returns request_ids: ['req-2e9f16e8-7d36-4719-b4a9-9a64cb3941b7'] Aug 31 16:14:23.274869 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '33cd3db7-9234-4312-b6e8-1dd9f95aaa81'} Aug 31 16:14:23.274869 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:14:23.274869 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:23.274869 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 31 16:14:23.274869 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 31 16:14:23.274869 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:14:23.274869 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:14:23.274869 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 31 16:14:23.274869 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 31 16:14:23.274869 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:14:23.274869 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:14:23.274869 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 31 16:14:23.274869 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 31 16:14:23.274869 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:14:23.274869 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:14:23.274869 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 31 16:14:23.274869 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 31 16:14:23.274869 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:14:23.274869 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:14:23.274869 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 31 16:14:23.274869 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 31 16:14:23.274869 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:14:23.274869 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:14:23.274869 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 31 16:14:23.274869 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 31 16:14:23.274869 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 31 16:14:23.274869 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 31 16:14:23.274869 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 33cd3db7-9234-4312-b6e8-1dd9f95aaa81 does not exist Aug 31 16:14:23.281030 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2e9f16e8-7d36-4719-b4a9-9a64cb3941b7'] Aug 31 16:14:23.281030 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:14:23.281030 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:14:23.281030 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:14:23.281030 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:23.281030 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 31 16:14:23.281030 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 31 16:14:23.281030 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 31 16:14:23.281030 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 31 16:14:23.281030 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 33cd3db7-9234-4312-b6e8-1dd9f95aaa81 does not exist Aug 31 16:14:23.281030 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2e9f16e8-7d36-4719-b4a9-9a64cb3941b7'] Aug 31 16:14:23.281030 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:14:23.281030 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:14:23.281030 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:14:23.281030 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:23.281030 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:14:23.281030 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:14:23.281030 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:14:23.281030 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:14:23.281030 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:14:23.281030 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:14:23.281030 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:14:23.281030 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:14:23.281030 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 31 16:14:23.281030 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 31 16:14:23.281030 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 33cd3db7-9234-4312-b6e8-1dd9f95aaa81 does not exist Aug 31 16:14:23.281030 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2e9f16e8-7d36-4719-b4a9-9a64cb3941b7'] Aug 31 16:14:23.281030 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:14:23.281030 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:14:23.281030 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:14:23.281030 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:23.281030 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:14:23.281030 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:14:23.281030 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:14:23.281030 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:14:23.281030 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 33cd3db7-9234-4312-b6e8-1dd9f95aaa81 does not exist Aug 31 16:14:23.281030 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2e9f16e8-7d36-4719-b4a9-9a64cb3941b7'] Aug 31 16:14:23.281030 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:14:23.281030 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4daedc8a-7228-4445-9a75-9c1763728562 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Returning 404 to user: Security group 33cd3db7-9234-4312-b6e8-1dd9f95aaa81 does not exist Aug 31 16:14:23.281030 n-d-850499-9 devstack@n-api.service[122256]: Neutron server returns request_ids: ['req-2e9f16e8-7d36-4719-b4a9-9a64cb3941b7'] {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:14:23.281030 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4daedc8a-7228-4445-9a75-9c1763728562 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/33cd3db7-9234-4312-b6e8-1dd9f95aaa81" status: 404 len: 194 microversion: 2.1 time: 0.205579 Aug 31 16:14:23.281030 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2001/4000] 10.222.0.61 () {58 vars in 1272 bytes} [Wed Aug 31 16:14:23 2022] DELETE /compute/v2.1/os-security-groups/33cd3db7-9234-4312-b6e8-1dd9f95aaa81 => generated 194 bytes in 207 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:14:23.295814 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9bd4dd0a-2a53-4cb6-9b50-14b6559d492d tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Calling method '.version_select at 0x7f5ae857bd30>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:23.327068 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7772906e-82fb-445f-8d09-70cce364b71b tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:23.332227 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7772906e-82fb-445f-8d09-70cce364b71b tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: d78f1dfc-6152-4180-84be-f6a84b75dbc2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:23.371577 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7772906e-82fb-445f-8d09-70cce364b71b tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:23.372766 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7772906e-82fb-445f-8d09-70cce364b71b tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:23.373367 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7772906e-82fb-445f-8d09-70cce364b71b tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:23.374263 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7772906e-82fb-445f-8d09-70cce364b71b tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:23.375255 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7772906e-82fb-445f-8d09-70cce364b71b tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:23.375837 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7772906e-82fb-445f-8d09-70cce364b71b tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:23.677165 n-d-850499-9 devstack@n-api.service[122257]: DEBUG neutronclient.v2_0.client [None req-9bd4dd0a-2a53-4cb6-9b50-14b6559d492d tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 234eeda0-f780-4a41-ae00-ef033e1b5f8f does not exist", "detail": ""}} {{(pid=122257) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 31 16:14:23.677763 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.security_group_api [None req-9bd4dd0a-2a53-4cb6-9b50-14b6559d492d tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Neutron security group 234eeda0-f780-4a41-ae00-ef033e1b5f8f not found {{(pid=122257) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 31 16:14:23.678555 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-9bd4dd0a-2a53-4cb6-9b50-14b6559d492d tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] HTTP exception thrown: Security group 234eeda0-f780-4a41-ae00-ef033e1b5f8f does not exist Aug 31 16:14:23.678555 n-d-850499-9 devstack@n-api.service[122257]: Neutron server returns request_ids: ['req-18b62673-6e3d-4345-b566-6177270c47df'] Aug 31 16:14:23.680495 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9bd4dd0a-2a53-4cb6-9b50-14b6559d492d tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Request method failure captured: Aug 31 16:14:23.680495 n-d-850499-9 devstack@n-api.service[122257]: request: DELETE /compute/v2.1/os-security-groups/234eeda0-f780-4a41-ae00-ef033e1b5f8f HTTP/1.1 Aug 31 16:14:23.680495 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:14:23.680495 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:14:23.680495 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:14:23.680495 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:14:23.680495 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:14:23.680495 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:14:23.680495 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:14:23.680495 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:14:23.680495 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4iB3ZSM042t6H57DKQNRNkGdMmN-dpZ1iYL7Qp9DB5vaoQM-CcEpndp_H4eJtfFInIhXcNSw2oPrel3OUzJ_33XKrMtGya3pa2oH-wP6jy1-79FFGtwCTUUJYiIziOxflBbp14Trh2dPFGd_PM4hgPBygRYcEqBhkOx0cf9zQWBZvc Aug 31 16:14:23.680495 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:14:23.680495 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:14:23.680495 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:14:23.680495 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:14:23.680495 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:14:23.680495 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:14:23.680495 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 9f66705b4a0f4711ba14d9ceb5699bd1 Aug 31 16:14:23.680495 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-SecurityGroupsTestJSON-269266309 Aug 31 16:14:23.680495 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:14:23.680495 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:14:23.680495 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9f66705b4a0f4711ba14d9ceb5699bd1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9f66705b4a0f4711ba14d9ceb5699bd1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9f66705b4a0f4711ba14d9ceb5699bd1", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9f66705b4a0f4711ba14d9ceb5699bd1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:14:23.680495 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-SecurityGroupsTestJSON-269266309 Aug 31 16:14:23.680495 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 9f66705b4a0f4711ba14d9ceb5699bd1 Aug 31 16:14:23.680495 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-269266309 Aug 31 16:14:23.680495 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-SecurityGroupsTestJSON-269266309-project Aug 31 16:14:23.680495 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:14:23.680495 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:14:23.680495 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 5f911026e35d40a480094376c6556d03 Aug 31 16:14:23.680495 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-SecurityGroupsTestJSON-269266309-project Aug 31 16:14:23.680495 n-d-850499-9 devstack@n-api.service[122257]: method: Aug 31 16:14:23.680495 n-d-850499-9 devstack@n-api.service[122257]: exception: Security group 234eeda0-f780-4a41-ae00-ef033e1b5f8f does not exist Aug 31 16:14:23.680495 n-d-850499-9 devstack@n-api.service[122257]: Neutron server returns request_ids: ['req-18b62673-6e3d-4345-b566-6177270c47df'] Aug 31 16:14:23.680495 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '234eeda0-f780-4a41-ae00-ef033e1b5f8f'} Aug 31 16:14:23.680495 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:14:23.680495 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:23.680495 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 31 16:14:23.680495 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 31 16:14:23.680495 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:14:23.680495 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:14:23.680495 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 31 16:14:23.680495 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 31 16:14:23.680495 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:14:23.680495 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:14:23.680495 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 31 16:14:23.680495 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 31 16:14:23.680495 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:14:23.680495 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:14:23.680495 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 31 16:14:23.680495 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 31 16:14:23.680495 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:14:23.680495 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:14:23.680495 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 31 16:14:23.680495 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 31 16:14:23.680495 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:14:23.680495 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:14:23.680495 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 31 16:14:23.680495 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 31 16:14:23.680495 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 31 16:14:23.680495 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 31 16:14:23.680495 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 234eeda0-f780-4a41-ae00-ef033e1b5f8f does not exist Aug 31 16:14:23.692867 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-18b62673-6e3d-4345-b566-6177270c47df'] Aug 31 16:14:23.692867 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:14:23.692867 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:14:23.692867 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:14:23.692867 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:23.692867 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 31 16:14:23.692867 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 31 16:14:23.692867 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 31 16:14:23.692867 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 31 16:14:23.692867 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 234eeda0-f780-4a41-ae00-ef033e1b5f8f does not exist Aug 31 16:14:23.692867 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-18b62673-6e3d-4345-b566-6177270c47df'] Aug 31 16:14:23.692867 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:14:23.692867 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:14:23.692867 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:14:23.692867 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:23.692867 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:14:23.692867 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:14:23.692867 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:14:23.692867 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:14:23.692867 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:14:23.692867 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:14:23.692867 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:14:23.692867 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:14:23.692867 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 31 16:14:23.692867 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 31 16:14:23.692867 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 234eeda0-f780-4a41-ae00-ef033e1b5f8f does not exist Aug 31 16:14:23.692867 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-18b62673-6e3d-4345-b566-6177270c47df'] Aug 31 16:14:23.692867 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:14:23.692867 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:14:23.692867 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:14:23.692867 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:23.692867 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:14:23.692867 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:14:23.692867 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:14:23.692867 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:14:23.692867 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 234eeda0-f780-4a41-ae00-ef033e1b5f8f does not exist Aug 31 16:14:23.692867 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-18b62673-6e3d-4345-b566-6177270c47df'] Aug 31 16:14:23.692867 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:14:23.692867 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9bd4dd0a-2a53-4cb6-9b50-14b6559d492d tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Returning 404 to user: Security group 234eeda0-f780-4a41-ae00-ef033e1b5f8f does not exist Aug 31 16:14:23.692867 n-d-850499-9 devstack@n-api.service[122257]: Neutron server returns request_ids: ['req-18b62673-6e3d-4345-b566-6177270c47df'] {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:14:23.692867 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9bd4dd0a-2a53-4cb6-9b50-14b6559d492d tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/234eeda0-f780-4a41-ae00-ef033e1b5f8f" status: 404 len: 194 microversion: 2.1 time: 0.393741 Aug 31 16:14:23.692867 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2000/4001] 10.222.0.61 () {58 vars in 1272 bytes} [Wed Aug 31 16:14:23 2022] DELETE /compute/v2.1/os-security-groups/234eeda0-f780-4a41-ae00-ef033e1b5f8f => generated 194 bytes in 404 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:14:23.705823 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e04fe512-7ddd-4dd2-88cc-473809ddca1f tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:23.705823 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e04fe512-7ddd-4dd2-88cc-473809ddca1f tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: e3625fdf-7e50-4ba1-99dc-6ae7473fc706] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:23.718621 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e04fe512-7ddd-4dd2-88cc-473809ddca1f tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:23.719402 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e04fe512-7ddd-4dd2-88cc-473809ddca1f tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:23.719888 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e04fe512-7ddd-4dd2-88cc-473809ddca1f tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:23.720661 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e04fe512-7ddd-4dd2-88cc-473809ddca1f tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:23.722006 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e04fe512-7ddd-4dd2-88cc-473809ddca1f tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:23.723315 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e04fe512-7ddd-4dd2-88cc-473809ddca1f tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:24.069708 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e04fe512-7ddd-4dd2-88cc-473809ddca1f tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48ee960c38f4d0584ea5ce34579279f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a957b6585e74a31b5bc5f66441c33e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:24.073473 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:14:24.092944 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e04fe512-7ddd-4dd2-88cc-473809ddca1f tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706" status: 200 len: 1272 microversion: 2.1 time: 0.404676 Aug 31 16:14:24.095013 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2001/4002] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:23 2022] GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706 => generated 1272 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:24.102588 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e07e5c83-4a09-420e-ba47-fe35268681e8 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Calling method '.version_select at 0x7f5aed1069d0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:24.166371 n-d-850499-9 devstack@n-api.service[122257]: DEBUG neutronclient.v2_0.client [None req-e07e5c83-4a09-420e-ba47-fe35268681e8 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 57f38355-04f6-4a74-ad78-f56fabb05161 does not exist", "detail": ""}} {{(pid=122257) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 31 16:14:24.167392 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.security_group_api [None req-e07e5c83-4a09-420e-ba47-fe35268681e8 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Neutron security group 57f38355-04f6-4a74-ad78-f56fabb05161 not found {{(pid=122257) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 31 16:14:24.168175 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-e07e5c83-4a09-420e-ba47-fe35268681e8 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] HTTP exception thrown: Security group 57f38355-04f6-4a74-ad78-f56fabb05161 does not exist Aug 31 16:14:24.168175 n-d-850499-9 devstack@n-api.service[122257]: Neutron server returns request_ids: ['req-53eac5aa-ef35-49ab-a36a-559d8d1d5279'] Aug 31 16:14:24.170462 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e07e5c83-4a09-420e-ba47-fe35268681e8 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Request method failure captured: Aug 31 16:14:24.170462 n-d-850499-9 devstack@n-api.service[122257]: request: DELETE /compute/v2.1/os-security-groups/57f38355-04f6-4a74-ad78-f56fabb05161 HTTP/1.1 Aug 31 16:14:24.170462 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:14:24.170462 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:14:24.170462 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:14:24.170462 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:14:24.170462 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:14:24.170462 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:14:24.170462 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:14:24.170462 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:14:24.170462 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4iB3ZSM042t6H57DKQNRNkGdMmN-dpZ1iYL7Qp9DB5vaoQM-CcEpndp_H4eJtfFInIhXcNSw2oPrel3OUzJ_33XKrMtGya3pa2oH-wP6jy1-79FFGtwCTUUJYiIziOxflBbp14Trh2dPFGd_PM4hgPBygRYcEqBhkOx0cf9zQWBZvc Aug 31 16:14:24.170462 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:14:24.170462 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:14:24.170462 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:14:24.170462 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:14:24.170462 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:14:24.170462 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:14:24.170462 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 9f66705b4a0f4711ba14d9ceb5699bd1 Aug 31 16:14:24.170462 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-SecurityGroupsTestJSON-269266309 Aug 31 16:14:24.170462 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:14:24.170462 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:14:24.170462 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9f66705b4a0f4711ba14d9ceb5699bd1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9f66705b4a0f4711ba14d9ceb5699bd1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9f66705b4a0f4711ba14d9ceb5699bd1", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9f66705b4a0f4711ba14d9ceb5699bd1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:14:24.170462 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-SecurityGroupsTestJSON-269266309 Aug 31 16:14:24.170462 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 9f66705b4a0f4711ba14d9ceb5699bd1 Aug 31 16:14:24.170462 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-269266309 Aug 31 16:14:24.170462 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-SecurityGroupsTestJSON-269266309-project Aug 31 16:14:24.170462 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:14:24.170462 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:14:24.170462 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 5f911026e35d40a480094376c6556d03 Aug 31 16:14:24.170462 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-SecurityGroupsTestJSON-269266309-project Aug 31 16:14:24.170462 n-d-850499-9 devstack@n-api.service[122257]: method: Aug 31 16:14:24.170462 n-d-850499-9 devstack@n-api.service[122257]: exception: Security group 57f38355-04f6-4a74-ad78-f56fabb05161 does not exist Aug 31 16:14:24.170462 n-d-850499-9 devstack@n-api.service[122257]: Neutron server returns request_ids: ['req-53eac5aa-ef35-49ab-a36a-559d8d1d5279'] Aug 31 16:14:24.170462 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '57f38355-04f6-4a74-ad78-f56fabb05161'} Aug 31 16:14:24.170462 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:14:24.170462 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:24.170462 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 31 16:14:24.170462 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 31 16:14:24.170462 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:14:24.170462 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:14:24.170462 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 31 16:14:24.170462 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 31 16:14:24.170462 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:14:24.170462 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:14:24.170462 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 31 16:14:24.170462 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 31 16:14:24.170462 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:14:24.170462 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:14:24.170462 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 31 16:14:24.170462 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 31 16:14:24.170462 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:14:24.170462 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:14:24.170462 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 31 16:14:24.170462 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 31 16:14:24.170462 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:14:24.170462 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:14:24.170462 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 31 16:14:24.170462 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 31 16:14:24.170462 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 31 16:14:24.170462 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 31 16:14:24.170462 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 57f38355-04f6-4a74-ad78-f56fabb05161 does not exist Aug 31 16:14:24.176440 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-53eac5aa-ef35-49ab-a36a-559d8d1d5279'] Aug 31 16:14:24.176440 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:14:24.176440 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:14:24.176440 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:14:24.176440 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:24.176440 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 31 16:14:24.176440 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 31 16:14:24.176440 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 31 16:14:24.176440 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 31 16:14:24.176440 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 57f38355-04f6-4a74-ad78-f56fabb05161 does not exist Aug 31 16:14:24.176440 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-53eac5aa-ef35-49ab-a36a-559d8d1d5279'] Aug 31 16:14:24.176440 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:14:24.176440 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:14:24.176440 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:14:24.176440 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:24.176440 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:14:24.176440 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:14:24.176440 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:14:24.176440 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:14:24.176440 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:14:24.176440 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:14:24.176440 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:14:24.176440 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:14:24.176440 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 31 16:14:24.176440 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 31 16:14:24.176440 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 57f38355-04f6-4a74-ad78-f56fabb05161 does not exist Aug 31 16:14:24.176440 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-53eac5aa-ef35-49ab-a36a-559d8d1d5279'] Aug 31 16:14:24.176440 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:14:24.176440 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:14:24.176440 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:14:24.176440 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:24.176440 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:14:24.176440 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:14:24.176440 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:14:24.176440 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:14:24.176440 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 57f38355-04f6-4a74-ad78-f56fabb05161 does not exist Aug 31 16:14:24.176440 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-53eac5aa-ef35-49ab-a36a-559d8d1d5279'] Aug 31 16:14:24.176440 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:14:24.181878 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e07e5c83-4a09-420e-ba47-fe35268681e8 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Returning 404 to user: Security group 57f38355-04f6-4a74-ad78-f56fabb05161 does not exist Aug 31 16:14:24.181878 n-d-850499-9 devstack@n-api.service[122257]: Neutron server returns request_ids: ['req-53eac5aa-ef35-49ab-a36a-559d8d1d5279'] {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:14:24.187220 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e07e5c83-4a09-420e-ba47-fe35268681e8 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/57f38355-04f6-4a74-ad78-f56fabb05161" status: 404 len: 194 microversion: 2.1 time: 0.090343 Aug 31 16:14:24.188097 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2002/4003] 10.222.0.61 () {58 vars in 1272 bytes} [Wed Aug 31 16:14:24 2022] DELETE /compute/v2.1/os-security-groups/57f38355-04f6-4a74-ad78-f56fabb05161 => generated 194 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:14:24.204379 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-91e193d5-b38a-411d-a71b-328df58d468b tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:24.205057 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-91e193d5-b38a-411d-a71b-328df58d468b tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] [instance: 1ceba728-a215-4f85-a8c1-9c79311861e1] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:24.229504 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-91e193d5-b38a-411d-a71b-328df58d468b tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:24.230013 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-91e193d5-b38a-411d-a71b-328df58d468b tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:24.230605 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-91e193d5-b38a-411d-a71b-328df58d468b tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:24.231332 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-91e193d5-b38a-411d-a71b-328df58d468b tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:24.231827 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-91e193d5-b38a-411d-a71b-328df58d468b tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:24.232258 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-91e193d5-b38a-411d-a71b-328df58d468b tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:24.293811 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7772906e-82fb-445f-8d09-70cce364b71b tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:24.339209 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7772906e-82fb-445f-8d09-70cce364b71b tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/d78f1dfc-6152-4180-84be-f6a84b75dbc2" status: 200 len: 1308 microversion: 2.1 time: 1.015937 Aug 31 16:14:24.356717 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-91e193d5-b38a-411d-a71b-328df58d468b tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d6eee711fe4194a4db63c801f78561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeac74d3027d4080be26bf3aadab4c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:24.368427 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-91e193d5-b38a-411d-a71b-328df58d468b tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] 10.222.0.61 "GET /compute/v2.1/servers/1ceba728-a215-4f85-a8c1-9c79311861e1" status: 200 len: 1224 microversion: 2.1 time: 0.178911 Aug 31 16:14:24.384376 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2003/4004] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:24 2022] GET /compute/v2.1/servers/1ceba728-a215-4f85-a8c1-9c79311861e1 => generated 1224 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:24.385172 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2002/4005] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:23 2022] GET /compute/v2.1/servers/d78f1dfc-6152-4180-84be-f6a84b75dbc2 => generated 1308 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:24.393774 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-cf0e43cf-ddcd-45b5-8f13-06b1a1c29766 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Calling method '.version_select at 0x7f5ae3d3d820>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:24.440539 n-d-850499-9 devstack@n-api.service[122257]: DEBUG neutronclient.v2_0.client [None req-cf0e43cf-ddcd-45b5-8f13-06b1a1c29766 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 313afc90-4263-4b1e-a4db-fa99cc503f78 does not exist", "detail": ""}} {{(pid=122257) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 31 16:14:24.441250 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.security_group_api [None req-cf0e43cf-ddcd-45b5-8f13-06b1a1c29766 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Neutron security group 313afc90-4263-4b1e-a4db-fa99cc503f78 not found {{(pid=122257) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 31 16:14:24.441780 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-cf0e43cf-ddcd-45b5-8f13-06b1a1c29766 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] HTTP exception thrown: Security group 313afc90-4263-4b1e-a4db-fa99cc503f78 does not exist Aug 31 16:14:24.441780 n-d-850499-9 devstack@n-api.service[122257]: Neutron server returns request_ids: ['req-1bde9804-3d1c-431a-8344-29849da6bc49'] Aug 31 16:14:24.443831 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-cf0e43cf-ddcd-45b5-8f13-06b1a1c29766 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Request method failure captured: Aug 31 16:14:24.443831 n-d-850499-9 devstack@n-api.service[122257]: request: DELETE /compute/v2.1/os-security-groups/313afc90-4263-4b1e-a4db-fa99cc503f78 HTTP/1.1 Aug 31 16:14:24.443831 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:14:24.443831 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:14:24.443831 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:14:24.443831 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:14:24.443831 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:14:24.443831 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:14:24.443831 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:14:24.443831 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:14:24.443831 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4iB3ZSM042t6H57DKQNRNkGdMmN-dpZ1iYL7Qp9DB5vaoQM-CcEpndp_H4eJtfFInIhXcNSw2oPrel3OUzJ_33XKrMtGya3pa2oH-wP6jy1-79FFGtwCTUUJYiIziOxflBbp14Trh2dPFGd_PM4hgPBygRYcEqBhkOx0cf9zQWBZvc Aug 31 16:14:24.443831 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:14:24.443831 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:14:24.443831 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:14:24.443831 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:14:24.443831 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:14:24.443831 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:14:24.443831 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 9f66705b4a0f4711ba14d9ceb5699bd1 Aug 31 16:14:24.443831 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-SecurityGroupsTestJSON-269266309 Aug 31 16:14:24.443831 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:14:24.443831 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:14:24.443831 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9f66705b4a0f4711ba14d9ceb5699bd1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9f66705b4a0f4711ba14d9ceb5699bd1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9f66705b4a0f4711ba14d9ceb5699bd1", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9f66705b4a0f4711ba14d9ceb5699bd1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:14:24.443831 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-SecurityGroupsTestJSON-269266309 Aug 31 16:14:24.443831 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 9f66705b4a0f4711ba14d9ceb5699bd1 Aug 31 16:14:24.443831 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-269266309 Aug 31 16:14:24.443831 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-SecurityGroupsTestJSON-269266309-project Aug 31 16:14:24.443831 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:14:24.443831 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:14:24.443831 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 5f911026e35d40a480094376c6556d03 Aug 31 16:14:24.443831 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-SecurityGroupsTestJSON-269266309-project Aug 31 16:14:24.443831 n-d-850499-9 devstack@n-api.service[122257]: method: Aug 31 16:14:24.443831 n-d-850499-9 devstack@n-api.service[122257]: exception: Security group 313afc90-4263-4b1e-a4db-fa99cc503f78 does not exist Aug 31 16:14:24.443831 n-d-850499-9 devstack@n-api.service[122257]: Neutron server returns request_ids: ['req-1bde9804-3d1c-431a-8344-29849da6bc49'] Aug 31 16:14:24.443831 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '313afc90-4263-4b1e-a4db-fa99cc503f78'} Aug 31 16:14:24.443831 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:14:24.443831 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:24.443831 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 31 16:14:24.443831 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 31 16:14:24.443831 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:14:24.443831 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:14:24.443831 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 31 16:14:24.443831 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 31 16:14:24.443831 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:14:24.443831 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:14:24.443831 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 31 16:14:24.443831 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 31 16:14:24.443831 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:14:24.443831 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:14:24.443831 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 31 16:14:24.443831 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 31 16:14:24.443831 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:14:24.443831 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:14:24.443831 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 31 16:14:24.443831 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 31 16:14:24.443831 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:14:24.443831 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:14:24.443831 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 31 16:14:24.443831 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 31 16:14:24.443831 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 31 16:14:24.443831 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 31 16:14:24.443831 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 313afc90-4263-4b1e-a4db-fa99cc503f78 does not exist Aug 31 16:14:24.452398 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1bde9804-3d1c-431a-8344-29849da6bc49'] Aug 31 16:14:24.452398 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:14:24.452398 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:14:24.452398 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:14:24.452398 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:24.452398 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 31 16:14:24.452398 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 31 16:14:24.452398 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 31 16:14:24.452398 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 31 16:14:24.452398 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 313afc90-4263-4b1e-a4db-fa99cc503f78 does not exist Aug 31 16:14:24.452398 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1bde9804-3d1c-431a-8344-29849da6bc49'] Aug 31 16:14:24.452398 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:14:24.452398 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:14:24.452398 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:14:24.452398 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:24.452398 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:14:24.452398 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:14:24.452398 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:14:24.452398 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:14:24.452398 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:14:24.452398 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:14:24.452398 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:14:24.452398 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:14:24.452398 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 31 16:14:24.452398 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 31 16:14:24.452398 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 313afc90-4263-4b1e-a4db-fa99cc503f78 does not exist Aug 31 16:14:24.452398 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1bde9804-3d1c-431a-8344-29849da6bc49'] Aug 31 16:14:24.452398 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:14:24.452398 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:14:24.452398 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:14:24.452398 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:24.452398 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:14:24.452398 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:14:24.452398 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:14:24.452398 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:14:24.452398 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 313afc90-4263-4b1e-a4db-fa99cc503f78 does not exist Aug 31 16:14:24.452398 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1bde9804-3d1c-431a-8344-29849da6bc49'] Aug 31 16:14:24.452398 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:14:24.452398 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-cf0e43cf-ddcd-45b5-8f13-06b1a1c29766 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Returning 404 to user: Security group 313afc90-4263-4b1e-a4db-fa99cc503f78 does not exist Aug 31 16:14:24.452398 n-d-850499-9 devstack@n-api.service[122257]: Neutron server returns request_ids: ['req-1bde9804-3d1c-431a-8344-29849da6bc49'] {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:14:24.452398 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-cf0e43cf-ddcd-45b5-8f13-06b1a1c29766 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/313afc90-4263-4b1e-a4db-fa99cc503f78" status: 404 len: 194 microversion: 2.1 time: 0.056415 Aug 31 16:14:24.452398 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2004/4006] 10.222.0.61 () {58 vars in 1272 bytes} [Wed Aug 31 16:14:24 2022] DELETE /compute/v2.1/os-security-groups/313afc90-4263-4b1e-a4db-fa99cc503f78 => generated 194 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:14:24.462500 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3bac1d29-9c8a-42d1-9f75-4dc3028214e7 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:24.464646 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3bac1d29-9c8a-42d1-9f75-4dc3028214e7 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] [instance: 73e59de1-a2a7-4fa3-b397-2c2c76ba1139] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:24.486583 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3bac1d29-9c8a-42d1-9f75-4dc3028214e7 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:24.491233 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3bac1d29-9c8a-42d1-9f75-4dc3028214e7 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:24.494121 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3bac1d29-9c8a-42d1-9f75-4dc3028214e7 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:24.499807 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3bac1d29-9c8a-42d1-9f75-4dc3028214e7 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:24.500639 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3bac1d29-9c8a-42d1-9f75-4dc3028214e7 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:24.501325 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3bac1d29-9c8a-42d1-9f75-4dc3028214e7 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:24.516144 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:14:24.626122 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3bac1d29-9c8a-42d1-9f75-4dc3028214e7 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] [instance: 73e59de1-a2a7-4fa3-b397-2c2c76ba1139] Going to try to terminate instance {{(pid=122256) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:14:24.832045 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3bac1d29-9c8a-42d1-9f75-4dc3028214e7 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] 10.222.0.61 "DELETE /compute/v2.1/servers/73e59de1-a2a7-4fa3-b397-2c2c76ba1139" status: 204 len: 0 microversion: 2.1 time: 0.371063 Aug 31 16:14:24.842137 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2003/4007] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:14:24 2022] DELETE /compute/v2.1/servers/73e59de1-a2a7-4fa3-b397-2c2c76ba1139 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:14:24.864304 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-bf9b4c22-4dd3-4f75-b093-564060325077 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:24.884638 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-bf9b4c22-4dd3-4f75-b093-564060325077 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] [instance: 73e59de1-a2a7-4fa3-b397-2c2c76ba1139] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:24.956460 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bf9b4c22-4dd3-4f75-b093-564060325077 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:24.958197 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bf9b4c22-4dd3-4f75-b093-564060325077 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:24.959300 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bf9b4c22-4dd3-4f75-b093-564060325077 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:24.963163 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bf9b4c22-4dd3-4f75-b093-564060325077 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:24.964555 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bf9b4c22-4dd3-4f75-b093-564060325077 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:24.966265 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bf9b4c22-4dd3-4f75-b093-564060325077 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:25.117792 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-40893fb9-576a-44e5-92a0-0d0c2c1262c8 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:25.118403 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-40893fb9-576a-44e5-92a0-0d0c2c1262c8 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: e3625fdf-7e50-4ba1-99dc-6ae7473fc706] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:25.136353 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-40893fb9-576a-44e5-92a0-0d0c2c1262c8 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:25.137147 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-40893fb9-576a-44e5-92a0-0d0c2c1262c8 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:25.138016 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-40893fb9-576a-44e5-92a0-0d0c2c1262c8 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:25.139022 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-40893fb9-576a-44e5-92a0-0d0c2c1262c8 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:25.139721 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-40893fb9-576a-44e5-92a0-0d0c2c1262c8 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:25.140398 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-40893fb9-576a-44e5-92a0-0d0c2c1262c8 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:25.321410 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-40893fb9-576a-44e5-92a0-0d0c2c1262c8 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48ee960c38f4d0584ea5ce34579279f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a957b6585e74a31b5bc5f66441c33e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:25.334893 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-40893fb9-576a-44e5-92a0-0d0c2c1262c8 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706" status: 200 len: 1272 microversion: 2.1 time: 0.221953 Aug 31 16:14:25.354143 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2004/4008] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:25 2022] GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706 => generated 1272 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:14:25.371730 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-bf226bbe-788e-41be-b306-f9d36c15e186 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:25.374063 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-bf226bbe-788e-41be-b306-f9d36c15e186 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: d78f1dfc-6152-4180-84be-f6a84b75dbc2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:25.382518 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bf226bbe-788e-41be-b306-f9d36c15e186 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:25.387643 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bf226bbe-788e-41be-b306-f9d36c15e186 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:25.388448 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bf226bbe-788e-41be-b306-f9d36c15e186 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:25.389204 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bf226bbe-788e-41be-b306-f9d36c15e186 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:25.396283 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bf226bbe-788e-41be-b306-f9d36c15e186 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:25.397020 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bf226bbe-788e-41be-b306-f9d36c15e186 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:25.943338 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-bf9b4c22-4dd3-4f75-b093-564060325077 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f911026e35d40a480094376c6556d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f66705b4a0f4711ba14d9ceb5699bd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:25.982616 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-bf9b4c22-4dd3-4f75-b093-564060325077 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] 10.222.0.61 "GET /compute/v2.1/servers/73e59de1-a2a7-4fa3-b397-2c2c76ba1139" status: 200 len: 1645 microversion: 2.1 time: 1.137434 Aug 31 16:14:25.985538 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2005/4009] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:24 2022] GET /compute/v2.1/servers/73e59de1-a2a7-4fa3-b397-2c2c76ba1139 => generated 1645 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:26.005236 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5214d2c6-e8fe-4d51-8d5f-43cc41631fb1 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:26.006557 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5214d2c6-e8fe-4d51-8d5f-43cc41631fb1 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] [instance: 1ceba728-a215-4f85-a8c1-9c79311861e1] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:26.026346 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5214d2c6-e8fe-4d51-8d5f-43cc41631fb1 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:26.028103 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5214d2c6-e8fe-4d51-8d5f-43cc41631fb1 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:26.030345 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5214d2c6-e8fe-4d51-8d5f-43cc41631fb1 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:26.035168 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5214d2c6-e8fe-4d51-8d5f-43cc41631fb1 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:26.036329 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5214d2c6-e8fe-4d51-8d5f-43cc41631fb1 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:26.037055 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5214d2c6-e8fe-4d51-8d5f-43cc41631fb1 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:26.203658 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-bf226bbe-788e-41be-b306-f9d36c15e186 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:26.223881 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-bf226bbe-788e-41be-b306-f9d36c15e186 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/d78f1dfc-6152-4180-84be-f6a84b75dbc2" status: 200 len: 1308 microversion: 2.1 time: 0.856731 Aug 31 16:14:26.225100 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2005/4010] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:25 2022] GET /compute/v2.1/servers/d78f1dfc-6152-4180-84be-f6a84b75dbc2 => generated 1308 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:14:26.268612 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5214d2c6-e8fe-4d51-8d5f-43cc41631fb1 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d6eee711fe4194a4db63c801f78561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeac74d3027d4080be26bf3aadab4c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:26.303237 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5214d2c6-e8fe-4d51-8d5f-43cc41631fb1 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] 10.222.0.61 "GET /compute/v2.1/servers/1ceba728-a215-4f85-a8c1-9c79311861e1" status: 200 len: 1224 microversion: 2.1 time: 0.314955 Aug 31 16:14:26.326685 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2006/4011] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:25 2022] GET /compute/v2.1/servers/1ceba728-a215-4f85-a8c1-9c79311861e1 => generated 1224 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:26.366189 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d4a4c59e-9ef2-442b-84b6-ab3a49644c44 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:26.370250 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d4a4c59e-9ef2-442b-84b6-ab3a49644c44 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: e3625fdf-7e50-4ba1-99dc-6ae7473fc706] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:26.439812 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d4a4c59e-9ef2-442b-84b6-ab3a49644c44 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:26.444790 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d4a4c59e-9ef2-442b-84b6-ab3a49644c44 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:26.446115 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d4a4c59e-9ef2-442b-84b6-ab3a49644c44 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:26.459191 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d4a4c59e-9ef2-442b-84b6-ab3a49644c44 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:26.459191 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d4a4c59e-9ef2-442b-84b6-ab3a49644c44 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:26.459191 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d4a4c59e-9ef2-442b-84b6-ab3a49644c44 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:26.742678 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d4a4c59e-9ef2-442b-84b6-ab3a49644c44 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48ee960c38f4d0584ea5ce34579279f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a957b6585e74a31b5bc5f66441c33e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:26.774431 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d4a4c59e-9ef2-442b-84b6-ab3a49644c44 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706" status: 200 len: 1272 microversion: 2.1 time: 0.415072 Aug 31 16:14:26.779836 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2006/4012] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:26 2022] GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706 => generated 1272 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:27.021498 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3e3b4340-c3e6-47bb-8eb6-c58fcc1c98b1 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:27.026059 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3e3b4340-c3e6-47bb-8eb6-c58fcc1c98b1 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] [instance: 73e59de1-a2a7-4fa3-b397-2c2c76ba1139] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:27.065044 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3e3b4340-c3e6-47bb-8eb6-c58fcc1c98b1 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:27.069311 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3e3b4340-c3e6-47bb-8eb6-c58fcc1c98b1 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:27.075658 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3e3b4340-c3e6-47bb-8eb6-c58fcc1c98b1 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:27.079232 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3e3b4340-c3e6-47bb-8eb6-c58fcc1c98b1 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:27.081465 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3e3b4340-c3e6-47bb-8eb6-c58fcc1c98b1 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:27.086639 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3e3b4340-c3e6-47bb-8eb6-c58fcc1c98b1 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:27.267256 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-034d0bb7-42cf-4dfa-8084-02b1b4899362 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:27.268833 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-034d0bb7-42cf-4dfa-8084-02b1b4899362 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: d78f1dfc-6152-4180-84be-f6a84b75dbc2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:27.281737 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-034d0bb7-42cf-4dfa-8084-02b1b4899362 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:27.282564 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-034d0bb7-42cf-4dfa-8084-02b1b4899362 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:27.285790 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-034d0bb7-42cf-4dfa-8084-02b1b4899362 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:27.286804 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-034d0bb7-42cf-4dfa-8084-02b1b4899362 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:27.288636 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-034d0bb7-42cf-4dfa-8084-02b1b4899362 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:27.291289 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-034d0bb7-42cf-4dfa-8084-02b1b4899362 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:29.384219 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-034d0bb7-42cf-4dfa-8084-02b1b4899362 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:29.411107 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-034d0bb7-42cf-4dfa-8084-02b1b4899362 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/d78f1dfc-6152-4180-84be-f6a84b75dbc2" status: 200 len: 1308 microversion: 2.1 time: 2.148811 Aug 31 16:14:29.411816 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2007/4013] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:27 2022] GET /compute/v2.1/servers/d78f1dfc-6152-4180-84be-f6a84b75dbc2 => generated 1308 bytes in 2150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:14:29.417218 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7fa98b90-e3cb-413f-a7ef-b7fff644c831 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:29.418062 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7fa98b90-e3cb-413f-a7ef-b7fff644c831 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] [instance: 1ceba728-a215-4f85-a8c1-9c79311861e1] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:29.425568 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7fa98b90-e3cb-413f-a7ef-b7fff644c831 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:29.426820 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7fa98b90-e3cb-413f-a7ef-b7fff644c831 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:29.427862 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7fa98b90-e3cb-413f-a7ef-b7fff644c831 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:29.428866 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7fa98b90-e3cb-413f-a7ef-b7fff644c831 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:29.430151 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7fa98b90-e3cb-413f-a7ef-b7fff644c831 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:29.430778 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7fa98b90-e3cb-413f-a7ef-b7fff644c831 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:29.638084 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3e3b4340-c3e6-47bb-8eb6-c58fcc1c98b1 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f911026e35d40a480094376c6556d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f66705b4a0f4711ba14d9ceb5699bd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:29.671846 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3e3b4340-c3e6-47bb-8eb6-c58fcc1c98b1 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] 10.222.0.61 "GET /compute/v2.1/servers/73e59de1-a2a7-4fa3-b397-2c2c76ba1139" status: 200 len: 1645 microversion: 2.1 time: 2.661344 Aug 31 16:14:29.684148 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7fa98b90-e3cb-413f-a7ef-b7fff644c831 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d6eee711fe4194a4db63c801f78561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeac74d3027d4080be26bf3aadab4c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:29.692573 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2007/4014] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:27 2022] GET /compute/v2.1/servers/73e59de1-a2a7-4fa3-b397-2c2c76ba1139 => generated 1645 bytes in 2683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:29.703066 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c70bab5e-d22f-4c25-9cc9-c0c68baab82c tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:29.703987 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c70bab5e-d22f-4c25-9cc9-c0c68baab82c tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: e3625fdf-7e50-4ba1-99dc-6ae7473fc706] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:29.717622 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c70bab5e-d22f-4c25-9cc9-c0c68baab82c tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:29.718292 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c70bab5e-d22f-4c25-9cc9-c0c68baab82c tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:29.719564 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c70bab5e-d22f-4c25-9cc9-c0c68baab82c tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:29.721255 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c70bab5e-d22f-4c25-9cc9-c0c68baab82c tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:29.722226 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c70bab5e-d22f-4c25-9cc9-c0c68baab82c tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:29.722949 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c70bab5e-d22f-4c25-9cc9-c0c68baab82c tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:29.730350 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7fa98b90-e3cb-413f-a7ef-b7fff644c831 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] 10.222.0.61 "GET /compute/v2.1/servers/1ceba728-a215-4f85-a8c1-9c79311861e1" status: 200 len: 1278 microversion: 2.1 time: 0.317038 Aug 31 16:14:29.752997 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2008/4015] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:29 2022] GET /compute/v2.1/servers/1ceba728-a215-4f85-a8c1-9c79311861e1 => generated 1278 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:29.875862 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-71eba472-38c5-4f8b-9234-f8fe1eae0361 req-cc1505cd-4da6-48d3-9f5c-225ff683d17f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ba6c72d-ec62-431a-908b-484701a473b6", "tag": "bd74bc62-31c3-4a60-b249-3c3265c49161"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:14:29.900658 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-71eba472-38c5-4f8b-9234-f8fe1eae0361 req-cc1505cd-4da6-48d3-9f5c-225ff683d17f service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:29.901720 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-71eba472-38c5-4f8b-9234-f8fe1eae0361 req-cc1505cd-4da6-48d3-9f5c-225ff683d17f service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:29.911568 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-71eba472-38c5-4f8b-9234-f8fe1eae0361 req-cc1505cd-4da6-48d3-9f5c-225ff683d17f service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:29.956880 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-71eba472-38c5-4f8b-9234-f8fe1eae0361 req-cc1505cd-4da6-48d3-9f5c-225ff683d17f service nova] Creating event network-changed:bd74bc62-31c3-4a60-b249-3c3265c49161 for instance 1ba6c72d-ec62-431a-908b-484701a473b6 on n-h1-850499-9 Aug 31 16:14:29.967563 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-71eba472-38c5-4f8b-9234-f8fe1eae0361 req-cc1505cd-4da6-48d3-9f5c-225ff683d17f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097274 Aug 31 16:14:29.971288 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2009/4016] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:14:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:14:30.064992 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-af15597e-7f05-46bd-9bb3-730c9c7558ae req-34dbfbc3-62d9-46ed-ad88-852ac9e0af4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d78f1dfc-6152-4180-84be-f6a84b75dbc2", "name": "network-vif-plugged", "status": "completed", "tag": "1fd435b6-e20e-4b7a-93c8-aa966480c41d"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:14:30.069461 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c70bab5e-d22f-4c25-9cc9-c0c68baab82c tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48ee960c38f4d0584ea5ce34579279f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a957b6585e74a31b5bc5f66441c33e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:30.079270 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-af15597e-7f05-46bd-9bb3-730c9c7558ae req-34dbfbc3-62d9-46ed-ad88-852ac9e0af4e service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:30.080723 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-af15597e-7f05-46bd-9bb3-730c9c7558ae req-34dbfbc3-62d9-46ed-ad88-852ac9e0af4e service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:30.081693 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-af15597e-7f05-46bd-9bb3-730c9c7558ae req-34dbfbc3-62d9-46ed-ad88-852ac9e0af4e service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:30.082215 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c70bab5e-d22f-4c25-9cc9-c0c68baab82c tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706" status: 200 len: 1272 microversion: 2.1 time: 0.388344 Aug 31 16:14:30.085430 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2008/4017] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:29 2022] GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706 => generated 1272 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:30.097828 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-af15597e-7f05-46bd-9bb3-730c9c7558ae req-34dbfbc3-62d9-46ed-ad88-852ac9e0af4e service nova] Creating event network-vif-plugged:1fd435b6-e20e-4b7a-93c8-aa966480c41d for instance d78f1dfc-6152-4180-84be-f6a84b75dbc2 on n-h2-850499-9 Aug 31 16:14:30.106064 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-af15597e-7f05-46bd-9bb3-730c9c7558ae req-34dbfbc3-62d9-46ed-ad88-852ac9e0af4e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048694 Aug 31 16:14:30.108743 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2010/4018] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:14:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:14:30.448257 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-42515e1a-12d2-4702-a2f0-855e57922c1a tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:30.448911 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-42515e1a-12d2-4702-a2f0-855e57922c1a tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: d78f1dfc-6152-4180-84be-f6a84b75dbc2] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:30.463925 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-42515e1a-12d2-4702-a2f0-855e57922c1a tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:30.464469 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-42515e1a-12d2-4702-a2f0-855e57922c1a tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:30.464977 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-42515e1a-12d2-4702-a2f0-855e57922c1a tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:30.465774 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-42515e1a-12d2-4702-a2f0-855e57922c1a tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:30.466245 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-42515e1a-12d2-4702-a2f0-855e57922c1a tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:30.466686 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-42515e1a-12d2-4702-a2f0-855e57922c1a tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:30.736628 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4b47338a-0d94-4c41-9f65-66b08a814b43 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:30.737464 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4b47338a-0d94-4c41-9f65-66b08a814b43 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] [instance: 73e59de1-a2a7-4fa3-b397-2c2c76ba1139] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:30.763928 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4b47338a-0d94-4c41-9f65-66b08a814b43 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:30.764831 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4b47338a-0d94-4c41-9f65-66b08a814b43 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:30.765634 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4b47338a-0d94-4c41-9f65-66b08a814b43 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:30.766918 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4b47338a-0d94-4c41-9f65-66b08a814b43 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:30.786946 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4b47338a-0d94-4c41-9f65-66b08a814b43 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:30.787415 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4b47338a-0d94-4c41-9f65-66b08a814b43 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:31.625300 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-42515e1a-12d2-4702-a2f0-855e57922c1a tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:31.728710 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-42515e1a-12d2-4702-a2f0-855e57922c1a tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/d78f1dfc-6152-4180-84be-f6a84b75dbc2" status: 200 len: 1308 microversion: 2.1 time: 1.283547 Aug 31 16:14:31.730262 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2009/4019] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:30 2022] GET /compute/v2.1/servers/d78f1dfc-6152-4180-84be-f6a84b75dbc2 => generated 1308 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:31.753000 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5bcaf743-6edc-4dbb-af5b-cfa25d6ad296 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:31.757865 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5bcaf743-6edc-4dbb-af5b-cfa25d6ad296 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] [instance: 1ceba728-a215-4f85-a8c1-9c79311861e1] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:31.773077 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5bcaf743-6edc-4dbb-af5b-cfa25d6ad296 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:31.774000 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5bcaf743-6edc-4dbb-af5b-cfa25d6ad296 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:31.774896 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5bcaf743-6edc-4dbb-af5b-cfa25d6ad296 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:31.776182 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5bcaf743-6edc-4dbb-af5b-cfa25d6ad296 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:31.777086 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5bcaf743-6edc-4dbb-af5b-cfa25d6ad296 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:31.779715 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5bcaf743-6edc-4dbb-af5b-cfa25d6ad296 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:32.156008 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:14:32.231474 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=6 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:14:32.283083 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-4b47338a-0d94-4c41-9f65-66b08a814b43 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f911026e35d40a480094376c6556d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f66705b4a0f4711ba14d9ceb5699bd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:32.295153 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4b47338a-0d94-4c41-9f65-66b08a814b43 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] 10.222.0.61 "GET /compute/v2.1/servers/73e59de1-a2a7-4fa3-b397-2c2c76ba1139" status: 200 len: 1645 microversion: 2.1 time: 1.562654 Aug 31 16:14:32.308401 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2011/4020] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:30 2022] GET /compute/v2.1/servers/73e59de1-a2a7-4fa3-b397-2c2c76ba1139 => generated 1645 bytes in 1577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:14:32.313798 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3b44b96e-9381-4cb5-ad78-c1dffc7d9bb8 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1671747927", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "networks": [{"uuid": "364a25a0-2ba0-41b6-af8d-f39f66d3efd4"}, {"uuid": "fc712461-ba84-40bd-817a-d831694bac72"}, {"uuid": "364a25a0-2ba0-41b6-af8d-f39f66d3efd4"}]}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:14:32.431617 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-3b44b96e-9381-4cb5-ad78-c1dffc7d9bb8 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] validate_networks() for [('364a25a0-2ba0-41b6-af8d-f39f66d3efd4', None, None, None, None, None), ('fc712461-ba84-40bd-817a-d831694bac72', None, None, None, None, None), ('364a25a0-2ba0-41b6-af8d-f39f66d3efd4', None, None, None, None, None)] {{(pid=122256) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:14:32.756915 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=4 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:14:33.016930 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=10 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:14:33.153319 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5bcaf743-6edc-4dbb-af5b-cfa25d6ad296 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d6eee711fe4194a4db63c801f78561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeac74d3027d4080be26bf3aadab4c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:33.162720 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5bcaf743-6edc-4dbb-af5b-cfa25d6ad296 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] 10.222.0.61 "GET /compute/v2.1/servers/1ceba728-a215-4f85-a8c1-9c79311861e1" status: 200 len: 1320 microversion: 2.1 time: 1.430838 Aug 31 16:14:33.173381 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2010/4021] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:31 2022] GET /compute/v2.1/servers/1ceba728-a215-4f85-a8c1-9c79311861e1 => generated 1320 bytes in 1442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:33.179156 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7ee41644-6813-40b3-a4d2-dfcf770f8dd4 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:33.179642 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7ee41644-6813-40b3-a4d2-dfcf770f8dd4 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: e3625fdf-7e50-4ba1-99dc-6ae7473fc706] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:33.195663 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=9 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:14:33.197224 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7ee41644-6813-40b3-a4d2-dfcf770f8dd4 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:33.197856 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7ee41644-6813-40b3-a4d2-dfcf770f8dd4 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:33.198293 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7ee41644-6813-40b3-a4d2-dfcf770f8dd4 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:33.198999 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7ee41644-6813-40b3-a4d2-dfcf770f8dd4 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:33.199557 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7ee41644-6813-40b3-a4d2-dfcf770f8dd4 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:33.199962 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7ee41644-6813-40b3-a4d2-dfcf770f8dd4 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:34.287024 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7ee41644-6813-40b3-a4d2-dfcf770f8dd4 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48ee960c38f4d0584ea5ce34579279f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a957b6585e74a31b5bc5f66441c33e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:34.306233 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7ee41644-6813-40b3-a4d2-dfcf770f8dd4 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706" status: 200 len: 1314 microversion: 2.1 time: 1.131378 Aug 31 16:14:34.321041 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2011/4022] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:33 2022] GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706 => generated 1314 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:34.336094 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-5a23c19a-2210-4e79-8dc2-3154ba49760c req-bf342c39-b630-4116-84b6-7aba35063555 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73e59de1-a2a7-4fa3-b397-2c2c76ba1139", "name": "network-vif-deleted", "tag": "ecd8bce9-b4ed-48ce-8f0c-42438836ce20"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:14:34.365651 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-5a23c19a-2210-4e79-8dc2-3154ba49760c req-bf342c39-b630-4116-84b6-7aba35063555 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:34.370350 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-5a23c19a-2210-4e79-8dc2-3154ba49760c req-bf342c39-b630-4116-84b6-7aba35063555 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:34.371183 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-5a23c19a-2210-4e79-8dc2-3154ba49760c req-bf342c39-b630-4116-84b6-7aba35063555 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:34.402479 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-5a23c19a-2210-4e79-8dc2-3154ba49760c req-bf342c39-b630-4116-84b6-7aba35063555 service nova] Creating event network-vif-deleted:ecd8bce9-b4ed-48ce-8f0c-42438836ce20 for instance 73e59de1-a2a7-4fa3-b397-2c2c76ba1139 on n-h2-850499-9 Aug 31 16:14:34.414126 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-5a23c19a-2210-4e79-8dc2-3154ba49760c req-bf342c39-b630-4116-84b6-7aba35063555 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091650 Aug 31 16:14:34.414752 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2012/4023] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:14:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:14:34.430945 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8ce031f1-beb0-4fdf-ad4c-170c0c4348f0 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:34.432780 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8ce031f1-beb0-4fdf-ad4c-170c0c4348f0 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: d78f1dfc-6152-4180-84be-f6a84b75dbc2] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:34.453574 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8ce031f1-beb0-4fdf-ad4c-170c0c4348f0 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:34.454157 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8ce031f1-beb0-4fdf-ad4c-170c0c4348f0 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:34.455184 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8ce031f1-beb0-4fdf-ad4c-170c0c4348f0 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:34.462338 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8ce031f1-beb0-4fdf-ad4c-170c0c4348f0 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:34.462841 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8ce031f1-beb0-4fdf-ad4c-170c0c4348f0 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:34.463296 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8ce031f1-beb0-4fdf-ad4c-170c0c4348f0 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:35.321956 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8ce031f1-beb0-4fdf-ad4c-170c0c4348f0 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:35.334419 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8ce031f1-beb0-4fdf-ad4c-170c0c4348f0 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/d78f1dfc-6152-4180-84be-f6a84b75dbc2" status: 200 len: 1489 microversion: 2.1 time: 0.912928 Aug 31 16:14:35.335402 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2013/4024] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:34 2022] GET /compute/v2.1/servers/d78f1dfc-6152-4180-84be-f6a84b75dbc2 => generated 1489 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:35.340353 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7d0df7b1-6eba-4437-ae7d-2982657ee707 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:35.341576 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7d0df7b1-6eba-4437-ae7d-2982657ee707 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] [instance: 73e59de1-a2a7-4fa3-b397-2c2c76ba1139] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:35.349185 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7d0df7b1-6eba-4437-ae7d-2982657ee707 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:35.350079 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7d0df7b1-6eba-4437-ae7d-2982657ee707 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:35.350759 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7d0df7b1-6eba-4437-ae7d-2982657ee707 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:35.352038 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7d0df7b1-6eba-4437-ae7d-2982657ee707 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:35.352729 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7d0df7b1-6eba-4437-ae7d-2982657ee707 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:35.353421 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7d0df7b1-6eba-4437-ae7d-2982657ee707 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:35.374334 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-7d0df7b1-6eba-4437-ae7d-2982657ee707 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] HTTP exception thrown: Instance 73e59de1-a2a7-4fa3-b397-2c2c76ba1139 could not be found. Aug 31 16:14:35.376932 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7d0df7b1-6eba-4437-ae7d-2982657ee707 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Request method failure captured: Aug 31 16:14:35.376932 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/73e59de1-a2a7-4fa3-b397-2c2c76ba1139 HTTP/1.1 Aug 31 16:14:35.376932 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:14:35.376932 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:14:35.376932 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:14:35.376932 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:14:35.376932 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:14:35.376932 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:14:35.376932 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:14:35.376932 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:14:35.376932 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4iB3ZSM042t6H57DKQNRNkGdMmN-dpZ1iYL7Qp9DB5vaoQM-CcEpndp_H4eJtfFInIhXcNSw2oPrel3OUzJ_33XKrMtGya3pa2oH-wP6jy1-79FFGtwCTUUJYiIziOxflBbp14Trh2dPFGd_PM4hgPBygRYcEqBhkOx0cf9zQWBZvc Aug 31 16:14:35.376932 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:14:35.376932 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:14:35.376932 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:14:35.376932 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:14:35.376932 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:14:35.376932 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:14:35.376932 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 9f66705b4a0f4711ba14d9ceb5699bd1 Aug 31 16:14:35.376932 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-SecurityGroupsTestJSON-269266309 Aug 31 16:14:35.376932 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:14:35.376932 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:14:35.376932 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9f66705b4a0f4711ba14d9ceb5699bd1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9f66705b4a0f4711ba14d9ceb5699bd1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9f66705b4a0f4711ba14d9ceb5699bd1", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9f66705b4a0f4711ba14d9ceb5699bd1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:14:35.376932 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-SecurityGroupsTestJSON-269266309 Aug 31 16:14:35.376932 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 9f66705b4a0f4711ba14d9ceb5699bd1 Aug 31 16:14:35.376932 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-269266309 Aug 31 16:14:35.376932 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-SecurityGroupsTestJSON-269266309-project Aug 31 16:14:35.376932 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:14:35.376932 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:14:35.376932 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 5f911026e35d40a480094376c6556d03 Aug 31 16:14:35.376932 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-SecurityGroupsTestJSON-269266309-project Aug 31 16:14:35.376932 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:14:35.376932 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance 73e59de1-a2a7-4fa3-b397-2c2c76ba1139 could not be found. Aug 31 16:14:35.376932 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '73e59de1-a2a7-4fa3-b397-2c2c76ba1139'} Aug 31 16:14:35.376932 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:14:35.376932 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:35.376932 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:14:35.376932 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:14:35.376932 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:14:35.376932 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:14:35.376932 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:14:35.376932 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:14:35.376932 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:14:35.376932 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:14:35.376932 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73e59de1-a2a7-4fa3-b397-2c2c76ba1139 could not be found. Aug 31 16:14:35.376932 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:14:35.376932 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:14:35.376932 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:14:35.376932 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:35.376932 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:14:35.376932 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:14:35.376932 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:14:35.376932 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:14:35.376932 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:14:35.376932 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:14:35.376932 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:14:35.376932 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:14:35.376932 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:14:35.376932 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:14:35.376932 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:14:35.376932 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:14:35.376932 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73e59de1-a2a7-4fa3-b397-2c2c76ba1139 could not be found. Aug 31 16:14:35.376932 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:14:35.376932 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:14:35.376932 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:14:35.381364 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:35.381364 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:14:35.381364 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:14:35.381364 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:14:35.381364 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:14:35.381364 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73e59de1-a2a7-4fa3-b397-2c2c76ba1139 could not be found. Aug 31 16:14:35.381364 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:14:35.383855 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7d0df7b1-6eba-4437-ae7d-2982657ee707 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Returning 404 to user: Instance 73e59de1-a2a7-4fa3-b397-2c2c76ba1139 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:14:35.385042 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7d0df7b1-6eba-4437-ae7d-2982657ee707 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] 10.222.0.61 "GET /compute/v2.1/servers/73e59de1-a2a7-4fa3-b397-2c2c76ba1139" status: 404 len: 111 microversion: 2.1 time: 0.048277 Aug 31 16:14:35.395030 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2014/4025] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:35 2022] GET /compute/v2.1/servers/73e59de1-a2a7-4fa3-b397-2c2c76ba1139 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:14:35.400837 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-28edac6d-936a-4ccd-9ed4-ca99ba2d2ed4 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:35.401580 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-28edac6d-936a-4ccd-9ed4-ca99ba2d2ed4 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] [instance: 1ceba728-a215-4f85-a8c1-9c79311861e1] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:35.409081 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-28edac6d-936a-4ccd-9ed4-ca99ba2d2ed4 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:35.411215 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-28edac6d-936a-4ccd-9ed4-ca99ba2d2ed4 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:35.411811 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-28edac6d-936a-4ccd-9ed4-ca99ba2d2ed4 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:35.412659 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-28edac6d-936a-4ccd-9ed4-ca99ba2d2ed4 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:35.413230 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-28edac6d-936a-4ccd-9ed4-ca99ba2d2ed4 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:35.413754 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-28edac6d-936a-4ccd-9ed4-ca99ba2d2ed4 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:36.003706 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-28edac6d-936a-4ccd-9ed4-ca99ba2d2ed4 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d6eee711fe4194a4db63c801f78561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeac74d3027d4080be26bf3aadab4c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:36.015919 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-28edac6d-936a-4ccd-9ed4-ca99ba2d2ed4 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] 10.222.0.61 "GET /compute/v2.1/servers/1ceba728-a215-4f85-a8c1-9c79311861e1" status: 200 len: 1320 microversion: 2.1 time: 0.619105 Aug 31 16:14:36.018933 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2015/4026] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:35 2022] GET /compute/v2.1/servers/1ceba728-a215-4f85-a8c1-9c79311861e1 => generated 1320 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:36.029466 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-daff78e5-59b5-4131-8d22-5c1443f0cd0b tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:36.031665 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-daff78e5-59b5-4131-8d22-5c1443f0cd0b tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: e3625fdf-7e50-4ba1-99dc-6ae7473fc706] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:36.041719 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-daff78e5-59b5-4131-8d22-5c1443f0cd0b tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:36.042379 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-daff78e5-59b5-4131-8d22-5c1443f0cd0b tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:36.043197 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-daff78e5-59b5-4131-8d22-5c1443f0cd0b tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:36.044217 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-daff78e5-59b5-4131-8d22-5c1443f0cd0b tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:36.044758 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-daff78e5-59b5-4131-8d22-5c1443f0cd0b tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:36.045264 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-daff78e5-59b5-4131-8d22-5c1443f0cd0b tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:36.727740 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-daff78e5-59b5-4131-8d22-5c1443f0cd0b tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48ee960c38f4d0584ea5ce34579279f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a957b6585e74a31b5bc5f66441c33e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:36.736225 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-daff78e5-59b5-4131-8d22-5c1443f0cd0b tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706" status: 200 len: 1314 microversion: 2.1 time: 0.716282 Aug 31 16:14:36.736915 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2016/4027] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:36 2022] GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706 => generated 1314 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:36.741694 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-dc621da4-c9e8-4632-a56a-a056210118d6 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-889768684"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:14:36.744225 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-dc621da4-c9e8-4632-a56a-a056210118d6 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: d78f1dfc-6152-4180-84be-f6a84b75dbc2] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:36.750822 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dc621da4-c9e8-4632-a56a-a056210118d6 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:36.752048 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dc621da4-c9e8-4632-a56a-a056210118d6 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:36.752497 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dc621da4-c9e8-4632-a56a-a056210118d6 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:36.753988 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dc621da4-c9e8-4632-a56a-a056210118d6 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:36.754452 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dc621da4-c9e8-4632-a56a-a056210118d6 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:36.754920 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dc621da4-c9e8-4632-a56a-a056210118d6 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:36.833842 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-dc621da4-c9e8-4632-a56a-a056210118d6 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "PUT /compute/v2.1/servers/d78f1dfc-6152-4180-84be-f6a84b75dbc2" status: 200 len: 1074 microversion: 2.1 time: 0.095862 Aug 31 16:14:36.834825 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2017/4028] 10.222.0.61 () {60 vars in 1256 bytes} [Wed Aug 31 16:14:36 2022] PUT /compute/v2.1/servers/d78f1dfc-6152-4180-84be-f6a84b75dbc2 => generated 1074 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:36.846808 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c00a4001-db46-4d54-b8a9-b5ed92bff219 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Calling method '.version_select at 0x7f5ae857b550>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:37.784424 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-3b44b96e-9381-4cb5-ad78-c1dffc7d9bb8 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:14:37.785997 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-3b44b96e-9381-4cb5-ad78-c1dffc7d9bb8 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:14:37.786878 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-3b44b96e-9381-4cb5-ad78-c1dffc7d9bb8 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:14:37.787403 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-3b44b96e-9381-4cb5-ad78-c1dffc7d9bb8 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:14:37.787860 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-3b44b96e-9381-4cb5-ad78-c1dffc7d9bb8 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:14:37.789990 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:14:37.801183 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3b44b96e-9381-4cb5-ad78-c1dffc7d9bb8 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:37.801688 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3b44b96e-9381-4cb5-ad78-c1dffc7d9bb8 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:37.802147 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3b44b96e-9381-4cb5-ad78-c1dffc7d9bb8 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:37.802887 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3b44b96e-9381-4cb5-ad78-c1dffc7d9bb8 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:37.804555 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3b44b96e-9381-4cb5-ad78-c1dffc7d9bb8 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:37.804555 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3b44b96e-9381-4cb5-ad78-c1dffc7d9bb8 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:37.829229 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-3b44b96e-9381-4cb5-ad78-c1dffc7d9bb8 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Getting quotas for project aada201b2fd64fdc81a69f826e7c607b. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:14:37.837059 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-3b44b96e-9381-4cb5-ad78-c1dffc7d9bb8 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Getting quotas for user 860ac4e423cf410d9bbc354c77ba864c and project aada201b2fd64fdc81a69f826e7c607b. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:14:37.852424 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3b44b96e-9381-4cb5-ad78-c1dffc7d9bb8 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Going to run 1 instances... {{(pid=122256) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:14:37.854918 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3b44b96e-9381-4cb5-ad78-c1dffc7d9bb8 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] [instance: 644d0221-94ca-4873-8fe0-ab72c4d7d68b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:14:37.916544 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3b44b96e-9381-4cb5-ad78-c1dffc7d9bb8 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.606644 Aug 31 16:14:37.920820 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2012/4029] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:14:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 5611 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:14:37.935467 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-07411398-8574-4989-b860-8638e78cade6 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:37.939911 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-07411398-8574-4989-b860-8638e78cade6 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] [instance: f04eb48d-000e-4c3b-8799-a4d3cdacf0e2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:37.961531 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-07411398-8574-4989-b860-8638e78cade6 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:37.963319 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-07411398-8574-4989-b860-8638e78cade6 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:37.982946 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-07411398-8574-4989-b860-8638e78cade6 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:37.986843 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-07411398-8574-4989-b860-8638e78cade6 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:37.988564 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-07411398-8574-4989-b860-8638e78cade6 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:37.992702 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-07411398-8574-4989-b860-8638e78cade6 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:38.047165 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c00a4001-db46-4d54-b8a9-b5ed92bff219 tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/9fe326bd-2dae-4d04-a40b-035d70314400" status: 202 len: 0 microversion: 2.1 time: 1.210585 Aug 31 16:14:38.048721 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2018/4030] 10.222.0.61 () {58 vars in 1272 bytes} [Wed Aug 31 16:14:36 2022] DELETE /compute/v2.1/os-security-groups/9fe326bd-2dae-4d04-a40b-035d70314400 => generated 0 bytes in 1213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:14:38.054109 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-2deab68c-c14f-461e-9706-7ec5d49d0ff7 req-eb37342d-4cbb-4b23-902b-f44ea84bf0a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3625fdf-7e50-4ba1-99dc-6ae7473fc706", "tag": "7e3f67e3-533f-4eab-9333-7f35c6d050e3"}, {"name": "network-changed", "server_uuid": "1ceba728-a215-4f85-a8c1-9c79311861e1", "tag": "5bf874cc-d939-4c79-b6fd-ad858ba41246"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:14:38.063556 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-07411398-8574-4989-b860-8638e78cade6 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] 10.222.0.61 "GET /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2/ips" status: 200 len: 146 microversion: 2.1 time: 0.140700 Aug 31 16:14:38.075810 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-2deab68c-c14f-461e-9706-7ec5d49d0ff7 req-eb37342d-4cbb-4b23-902b-f44ea84bf0a6 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:38.079294 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-2deab68c-c14f-461e-9706-7ec5d49d0ff7 req-eb37342d-4cbb-4b23-902b-f44ea84bf0a6 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:38.080071 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-2deab68c-c14f-461e-9706-7ec5d49d0ff7 req-eb37342d-4cbb-4b23-902b-f44ea84bf0a6 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:38.082034 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2013/4031] 10.222.0.61 () {58 vars in 1248 bytes} [Wed Aug 31 16:14:37 2022] GET /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2/ips => generated 146 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:14:38.094566 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c7d3df18-b619-4ae8-9cad-61781fe3ceb3 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:38.100641 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-2deab68c-c14f-461e-9706-7ec5d49d0ff7 req-eb37342d-4cbb-4b23-902b-f44ea84bf0a6 service nova] Creating event network-changed:7e3f67e3-533f-4eab-9333-7f35c6d050e3 for instance e3625fdf-7e50-4ba1-99dc-6ae7473fc706 on n-h2-850499-9 Aug 31 16:14:38.101048 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c7d3df18-b619-4ae8-9cad-61781fe3ceb3 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: d78f1dfc-6152-4180-84be-f6a84b75dbc2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:38.101674 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-2deab68c-c14f-461e-9706-7ec5d49d0ff7 req-eb37342d-4cbb-4b23-902b-f44ea84bf0a6 service nova] Creating event network-changed:5bf874cc-d939-4c79-b6fd-ad858ba41246 for instance 1ceba728-a215-4f85-a8c1-9c79311861e1 on n-h2-850499-9 Aug 31 16:14:38.110529 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c7d3df18-b619-4ae8-9cad-61781fe3ceb3 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:38.111516 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-2deab68c-c14f-461e-9706-7ec5d49d0ff7 req-eb37342d-4cbb-4b23-902b-f44ea84bf0a6 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.060414 Aug 31 16:14:38.113475 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c7d3df18-b619-4ae8-9cad-61781fe3ceb3 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:38.114036 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2019/4032] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:14:38 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:14:38.114536 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c7d3df18-b619-4ae8-9cad-61781fe3ceb3 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:38.115482 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c7d3df18-b619-4ae8-9cad-61781fe3ceb3 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:38.116237 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c7d3df18-b619-4ae8-9cad-61781fe3ceb3 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:38.117380 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c7d3df18-b619-4ae8-9cad-61781fe3ceb3 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:38.129478 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-cd8547eb-d19e-4df6-a6fa-58c3de5f563c tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:38.130208 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-cd8547eb-d19e-4df6-a6fa-58c3de5f563c tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] [instance: 1ceba728-a215-4f85-a8c1-9c79311861e1] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:38.151253 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cd8547eb-d19e-4df6-a6fa-58c3de5f563c tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:38.152118 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cd8547eb-d19e-4df6-a6fa-58c3de5f563c tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:38.152675 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cd8547eb-d19e-4df6-a6fa-58c3de5f563c tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:38.153951 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cd8547eb-d19e-4df6-a6fa-58c3de5f563c tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:38.154531 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cd8547eb-d19e-4df6-a6fa-58c3de5f563c tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:38.155170 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cd8547eb-d19e-4df6-a6fa-58c3de5f563c tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:38.462683 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-cd8547eb-d19e-4df6-a6fa-58c3de5f563c tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d6eee711fe4194a4db63c801f78561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeac74d3027d4080be26bf3aadab4c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:38.480145 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-cd8547eb-d19e-4df6-a6fa-58c3de5f563c tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] 10.222.0.61 "GET /compute/v2.1/servers/1ceba728-a215-4f85-a8c1-9c79311861e1" status: 200 len: 1320 microversion: 2.1 time: 0.361443 Aug 31 16:14:38.484235 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2020/4033] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:38 2022] GET /compute/v2.1/servers/1ceba728-a215-4f85-a8c1-9c79311861e1 => generated 1320 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:38.495735 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-f42f2df3-2330-49b8-8728-67008aefd02b req-386e83ca-f104-46c3-ae2e-6de81ffce918 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ba6c72d-ec62-431a-908b-484701a473b6", "name": "network-vif-plugged", "status": "completed", "tag": "bd74bc62-31c3-4a60-b249-3c3265c49161"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:14:38.519351 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c7d3df18-b619-4ae8-9cad-61781fe3ceb3 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:38.521939 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-f42f2df3-2330-49b8-8728-67008aefd02b req-386e83ca-f104-46c3-ae2e-6de81ffce918 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:38.523426 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-f42f2df3-2330-49b8-8728-67008aefd02b req-386e83ca-f104-46c3-ae2e-6de81ffce918 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:38.524440 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-f42f2df3-2330-49b8-8728-67008aefd02b req-386e83ca-f104-46c3-ae2e-6de81ffce918 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:38.532094 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c7d3df18-b619-4ae8-9cad-61781fe3ceb3 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/d78f1dfc-6152-4180-84be-f6a84b75dbc2" status: 200 len: 1500 microversion: 2.1 time: 0.448021 Aug 31 16:14:38.549647 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2014/4034] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:38 2022] GET /compute/v2.1/servers/d78f1dfc-6152-4180-84be-f6a84b75dbc2 => generated 1500 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:38.559406 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-bbe1bb35-d346-4b85-8658-739416e0885a tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:38.559811 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-f42f2df3-2330-49b8-8728-67008aefd02b req-386e83ca-f104-46c3-ae2e-6de81ffce918 service nova] Creating event network-vif-plugged:bd74bc62-31c3-4a60-b249-3c3265c49161 for instance 1ba6c72d-ec62-431a-908b-484701a473b6 on n-h1-850499-9 Aug 31 16:14:38.560456 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-bbe1bb35-d346-4b85-8658-739416e0885a tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: e3625fdf-7e50-4ba1-99dc-6ae7473fc706] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:38.575479 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-f42f2df3-2330-49b8-8728-67008aefd02b req-386e83ca-f104-46c3-ae2e-6de81ffce918 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086347 Aug 31 16:14:38.576375 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bbe1bb35-d346-4b85-8658-739416e0885a tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:38.577268 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bbe1bb35-d346-4b85-8658-739416e0885a tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:38.577820 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bbe1bb35-d346-4b85-8658-739416e0885a tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:38.579089 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bbe1bb35-d346-4b85-8658-739416e0885a tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:38.580659 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2021/4035] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:14:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:14:38.581242 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bbe1bb35-d346-4b85-8658-739416e0885a tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:38.581791 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bbe1bb35-d346-4b85-8658-739416e0885a tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:38.607493 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3dc318bc-e542-45d6-86a8-d4882d9a1b16 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:38.608705 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3dc318bc-e542-45d6-86a8-d4882d9a1b16 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] [instance: 644d0221-94ca-4873-8fe0-ab72c4d7d68b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:38.740203 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3dc318bc-e542-45d6-86a8-d4882d9a1b16 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860ac4e423cf410d9bbc354c77ba864c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aada201b2fd64fdc81a69f826e7c607b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:38.749489 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3dc318bc-e542-45d6-86a8-d4882d9a1b16 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] 10.222.0.61 "GET /compute/v2.1/servers/644d0221-94ca-4873-8fe0-ab72c4d7d68b" status: 200 len: 1213 microversion: 2.1 time: 0.167314 Aug 31 16:14:38.753452 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2022/4036] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:38 2022] GET /compute/v2.1/servers/644d0221-94ca-4873-8fe0-ab72c4d7d68b => generated 1213 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:38.770104 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ad13445f-b1d6-4c93-95cc-2d0180187d1f tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] Calling method '.version_select at 0x7f5ae3d18280>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:39.023028 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-bbe1bb35-d346-4b85-8658-739416e0885a tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48ee960c38f4d0584ea5ce34579279f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a957b6585e74a31b5bc5f66441c33e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:39.035605 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-bbe1bb35-d346-4b85-8658-739416e0885a tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706" status: 200 len: 1314 microversion: 2.1 time: 0.484515 Aug 31 16:14:39.038340 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2015/4037] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:38 2022] GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706 => generated 1314 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:39.044023 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-fba0edd0-a7fe-4972-a016-963cd1853dc6 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:39.045177 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-fba0edd0-a7fe-4972-a016-963cd1853dc6 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: d78f1dfc-6152-4180-84be-f6a84b75dbc2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:39.061919 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fba0edd0-a7fe-4972-a016-963cd1853dc6 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:39.064958 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fba0edd0-a7fe-4972-a016-963cd1853dc6 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:39.065649 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fba0edd0-a7fe-4972-a016-963cd1853dc6 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:39.066708 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fba0edd0-a7fe-4972-a016-963cd1853dc6 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:39.067373 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fba0edd0-a7fe-4972-a016-963cd1853dc6 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:39.068152 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fba0edd0-a7fe-4972-a016-963cd1853dc6 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:39.383034 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ad13445f-b1d6-4c93-95cc-2d0180187d1f tempest-SecurityGroupsTestJSON-269266309 tempest-SecurityGroupsTestJSON-269266309-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/04319d74-a60e-4e6f-af5f-d260e6e5b69d" status: 202 len: 0 microversion: 2.1 time: 0.627921 Aug 31 16:14:39.388310 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2023/4038] 10.222.0.61 () {58 vars in 1272 bytes} [Wed Aug 31 16:14:38 2022] DELETE /compute/v2.1/os-security-groups/04319d74-a60e-4e6f-af5f-d260e6e5b69d => generated 0 bytes in 633 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:14:39.505215 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-045a3b5f-58dc-4c07-8866-d6220f3035f9 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:39.506153 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-045a3b5f-58dc-4c07-8866-d6220f3035f9 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] [instance: 1ceba728-a215-4f85-a8c1-9c79311861e1] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:39.526306 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-045a3b5f-58dc-4c07-8866-d6220f3035f9 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:39.527448 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-045a3b5f-58dc-4c07-8866-d6220f3035f9 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:39.529851 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-045a3b5f-58dc-4c07-8866-d6220f3035f9 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:39.530803 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-045a3b5f-58dc-4c07-8866-d6220f3035f9 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:39.531675 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-045a3b5f-58dc-4c07-8866-d6220f3035f9 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:39.533896 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-045a3b5f-58dc-4c07-8866-d6220f3035f9 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:39.606655 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-fba0edd0-a7fe-4972-a016-963cd1853dc6 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:39.629431 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-fba0edd0-a7fe-4972-a016-963cd1853dc6 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/d78f1dfc-6152-4180-84be-f6a84b75dbc2" status: 200 len: 1500 microversion: 2.1 time: 0.589713 Aug 31 16:14:39.645488 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2016/4039] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:39 2022] GET /compute/v2.1/servers/d78f1dfc-6152-4180-84be-f6a84b75dbc2 => generated 1500 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:39.692245 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-72a4f9b7-8174-4383-a8c3-12b52740010b tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:14:39.701303 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-72a4f9b7-8174-4383-a8c3-12b52740010b tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:39.702850 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-72a4f9b7-8174-4383-a8c3-12b52740010b tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:39.708067 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-72a4f9b7-8174-4383-a8c3-12b52740010b tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:39.764500 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-72a4f9b7-8174-4383-a8c3-12b52740010b tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: d78f1dfc-6152-4180-84be-f6a84b75dbc2] Going to try to stop instance {{(pid=122256) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 31 16:14:39.843493 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-72a4f9b7-8174-4383-a8c3-12b52740010b tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "POST /compute/v2.1/servers/d78f1dfc-6152-4180-84be-f6a84b75dbc2/action" status: 202 len: 0 microversion: 2.1 time: 0.162044 Aug 31 16:14:39.845085 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2017/4040] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:14:39 2022] POST /compute/v2.1/servers/d78f1dfc-6152-4180-84be-f6a84b75dbc2/action => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 16:14:39.859628 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1ccd2167-c1a8-4037-9b42-f25f4feb5fa2 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:39.861783 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1ccd2167-c1a8-4037-9b42-f25f4feb5fa2 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] [instance: 644d0221-94ca-4873-8fe0-ab72c4d7d68b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:39.887666 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1ccd2167-c1a8-4037-9b42-f25f4feb5fa2 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:39.888680 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1ccd2167-c1a8-4037-9b42-f25f4feb5fa2 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:39.889216 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1ccd2167-c1a8-4037-9b42-f25f4feb5fa2 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:39.889869 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1ccd2167-c1a8-4037-9b42-f25f4feb5fa2 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:39.890732 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1ccd2167-c1a8-4037-9b42-f25f4feb5fa2 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:39.891476 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1ccd2167-c1a8-4037-9b42-f25f4feb5fa2 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:39.946988 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-045a3b5f-58dc-4c07-8866-d6220f3035f9 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d6eee711fe4194a4db63c801f78561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeac74d3027d4080be26bf3aadab4c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:39.959084 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-045a3b5f-58dc-4c07-8866-d6220f3035f9 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] 10.222.0.61 "GET /compute/v2.1/servers/1ceba728-a215-4f85-a8c1-9c79311861e1" status: 200 len: 1320 microversion: 2.1 time: 0.459800 Aug 31 16:14:39.959712 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2024/4041] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:39 2022] GET /compute/v2.1/servers/1ceba728-a215-4f85-a8c1-9c79311861e1 => generated 1320 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:14:39.976399 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-986df182-327f-4311-8ffe-3b13065c4441 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:39.980435 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-986df182-327f-4311-8ffe-3b13065c4441 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: d78f1dfc-6152-4180-84be-f6a84b75dbc2] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:39.990443 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-986df182-327f-4311-8ffe-3b13065c4441 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:39.990890 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-986df182-327f-4311-8ffe-3b13065c4441 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:39.992294 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-986df182-327f-4311-8ffe-3b13065c4441 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:39.993943 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-986df182-327f-4311-8ffe-3b13065c4441 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:40.000791 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-986df182-327f-4311-8ffe-3b13065c4441 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:40.001229 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-986df182-327f-4311-8ffe-3b13065c4441 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:40.039580 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:14:40.042843 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1ccd2167-c1a8-4037-9b42-f25f4feb5fa2 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860ac4e423cf410d9bbc354c77ba864c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aada201b2fd64fdc81a69f826e7c607b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:40.055935 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1ccd2167-c1a8-4037-9b42-f25f4feb5fa2 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] 10.222.0.61 "GET /compute/v2.1/servers/644d0221-94ca-4873-8fe0-ab72c4d7d68b" status: 200 len: 1209 microversion: 2.1 time: 0.209038 Aug 31 16:14:40.058795 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2018/4042] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:39 2022] GET /compute/v2.1/servers/644d0221-94ca-4873-8fe0-ab72c4d7d68b => generated 1209 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:40.082760 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6ef39b04-d730-44a7-94f4-392c17d7a546 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:40.083764 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6ef39b04-d730-44a7-94f4-392c17d7a546 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: e3625fdf-7e50-4ba1-99dc-6ae7473fc706] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:40.102895 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6ef39b04-d730-44a7-94f4-392c17d7a546 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:40.105686 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6ef39b04-d730-44a7-94f4-392c17d7a546 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:40.107629 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6ef39b04-d730-44a7-94f4-392c17d7a546 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:40.117049 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6ef39b04-d730-44a7-94f4-392c17d7a546 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:40.122341 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6ef39b04-d730-44a7-94f4-392c17d7a546 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:40.122926 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6ef39b04-d730-44a7-94f4-392c17d7a546 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:40.156275 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:14:40.524286 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-986df182-327f-4311-8ffe-3b13065c4441 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:40.550195 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-986df182-327f-4311-8ffe-3b13065c4441 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/d78f1dfc-6152-4180-84be-f6a84b75dbc2" status: 200 len: 1510 microversion: 2.1 time: 0.584044 Aug 31 16:14:40.566934 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2025/4043] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:39 2022] GET /compute/v2.1/servers/d78f1dfc-6152-4180-84be-f6a84b75dbc2 => generated 1510 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:40.780240 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-6ef39b04-d730-44a7-94f4-392c17d7a546 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48ee960c38f4d0584ea5ce34579279f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a957b6585e74a31b5bc5f66441c33e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:40.815637 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6ef39b04-d730-44a7-94f4-392c17d7a546 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706" status: 200 len: 1314 microversion: 2.1 time: 0.753648 Aug 31 16:14:40.837604 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2019/4044] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:40 2022] GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706 => generated 1314 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:40.992177 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-01f73673-d32d-450c-a540-b36836191437 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:40.993047 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-01f73673-d32d-450c-a540-b36836191437 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] [instance: 1ceba728-a215-4f85-a8c1-9c79311861e1] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:40.999806 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-01f73673-d32d-450c-a540-b36836191437 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:41.000592 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-01f73673-d32d-450c-a540-b36836191437 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:41.001042 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-01f73673-d32d-450c-a540-b36836191437 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:41.002517 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-01f73673-d32d-450c-a540-b36836191437 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:41.002982 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-01f73673-d32d-450c-a540-b36836191437 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:41.003414 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-01f73673-d32d-450c-a540-b36836191437 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:41.093298 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-61f4a98d-292c-4b54-869f-d39abb3c79bb tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:41.095474 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-61f4a98d-292c-4b54-869f-d39abb3c79bb tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] [instance: 644d0221-94ca-4873-8fe0-ab72c4d7d68b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:41.114336 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-61f4a98d-292c-4b54-869f-d39abb3c79bb tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:41.115237 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-61f4a98d-292c-4b54-869f-d39abb3c79bb tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:41.115873 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-61f4a98d-292c-4b54-869f-d39abb3c79bb tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:41.121177 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-61f4a98d-292c-4b54-869f-d39abb3c79bb tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:41.123605 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-61f4a98d-292c-4b54-869f-d39abb3c79bb tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:41.125695 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-61f4a98d-292c-4b54-869f-d39abb3c79bb tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:41.281579 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-61f4a98d-292c-4b54-869f-d39abb3c79bb tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860ac4e423cf410d9bbc354c77ba864c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aada201b2fd64fdc81a69f826e7c607b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:41.300420 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-61f4a98d-292c-4b54-869f-d39abb3c79bb tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] 10.222.0.61 "GET /compute/v2.1/servers/644d0221-94ca-4873-8fe0-ab72c4d7d68b" status: 200 len: 1265 microversion: 2.1 time: 0.211682 Aug 31 16:14:41.301311 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2020/4045] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:41 2022] GET /compute/v2.1/servers/644d0221-94ca-4873-8fe0-ab72c4d7d68b => generated 1265 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:14:41.462273 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-01f73673-d32d-450c-a540-b36836191437 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d6eee711fe4194a4db63c801f78561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeac74d3027d4080be26bf3aadab4c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:41.485191 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-01f73673-d32d-450c-a540-b36836191437 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] 10.222.0.61 "GET /compute/v2.1/servers/1ceba728-a215-4f85-a8c1-9c79311861e1" status: 200 len: 1320 microversion: 2.1 time: 0.504998 Aug 31 16:14:41.488038 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2026/4046] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:40 2022] GET /compute/v2.1/servers/1ceba728-a215-4f85-a8c1-9c79311861e1 => generated 1320 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:41.585672 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-28b8bc10-bc9a-43ff-91ca-f8a989c3341e tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:41.586287 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-28b8bc10-bc9a-43ff-91ca-f8a989c3341e tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: d78f1dfc-6152-4180-84be-f6a84b75dbc2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:41.596175 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-28b8bc10-bc9a-43ff-91ca-f8a989c3341e tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:41.596668 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-28b8bc10-bc9a-43ff-91ca-f8a989c3341e tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:41.609045 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-28b8bc10-bc9a-43ff-91ca-f8a989c3341e tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:41.609841 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-28b8bc10-bc9a-43ff-91ca-f8a989c3341e tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:41.610583 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-28b8bc10-bc9a-43ff-91ca-f8a989c3341e tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:41.611111 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-28b8bc10-bc9a-43ff-91ca-f8a989c3341e tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:41.657308 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a18b570b-b20e-4958-af98-f3048620bf2b tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "349bdd50-2aed-4cb8-a78d-257ee19108c0"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:14:41.666309 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a18b570b-b20e-4958-af98-f3048620bf2b tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] [instance: f04eb48d-000e-4c3b-8799-a4d3cdacf0e2] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:41.688664 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a18b570b-b20e-4958-af98-f3048620bf2b tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:41.692263 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a18b570b-b20e-4958-af98-f3048620bf2b tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:41.692956 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a18b570b-b20e-4958-af98-f3048620bf2b tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:41.697058 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a18b570b-b20e-4958-af98-f3048620bf2b tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:41.697970 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a18b570b-b20e-4958-af98-f3048620bf2b tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:41.698617 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a18b570b-b20e-4958-af98-f3048620bf2b tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:42.148961 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-28b8bc10-bc9a-43ff-91ca-f8a989c3341e tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:42.160554 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-28b8bc10-bc9a-43ff-91ca-f8a989c3341e tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/d78f1dfc-6152-4180-84be-f6a84b75dbc2" status: 200 len: 1510 microversion: 2.1 time: 0.578627 Aug 31 16:14:42.161161 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2021/4047] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:41 2022] GET /compute/v2.1/servers/d78f1dfc-6152-4180-84be-f6a84b75dbc2 => generated 1510 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:42.171065 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7fa0c5a1-3975-4711-b25f-c135aaa7771f tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:42.176434 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7fa0c5a1-3975-4711-b25f-c135aaa7771f tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: e3625fdf-7e50-4ba1-99dc-6ae7473fc706] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:42.186458 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7fa0c5a1-3975-4711-b25f-c135aaa7771f tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:42.188534 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7fa0c5a1-3975-4711-b25f-c135aaa7771f tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:42.190393 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7fa0c5a1-3975-4711-b25f-c135aaa7771f tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:42.191355 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7fa0c5a1-3975-4711-b25f-c135aaa7771f tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:42.192910 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7fa0c5a1-3975-4711-b25f-c135aaa7771f tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:42.194287 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7fa0c5a1-3975-4711-b25f-c135aaa7771f tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:42.323722 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a18b570b-b20e-4958-af98-f3048620bf2b tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] 10.222.0.61 "POST /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.673655 Aug 31 16:14:42.333045 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2027/4048] 10.222.0.61 () {60 vars in 1323 bytes} [Wed Aug 31 16:14:41 2022] POST /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2/os-volume_attachments => generated 194 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:14:42.348714 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-89b60dd5-80fb-4a90-b2c5-d22038879212 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:42.355907 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-89b60dd5-80fb-4a90-b2c5-d22038879212 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] [instance: 644d0221-94ca-4873-8fe0-ab72c4d7d68b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:42.374313 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-89b60dd5-80fb-4a90-b2c5-d22038879212 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:42.375478 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-89b60dd5-80fb-4a90-b2c5-d22038879212 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:42.376364 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-89b60dd5-80fb-4a90-b2c5-d22038879212 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:42.378108 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-89b60dd5-80fb-4a90-b2c5-d22038879212 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:42.379664 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-89b60dd5-80fb-4a90-b2c5-d22038879212 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:42.380365 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-89b60dd5-80fb-4a90-b2c5-d22038879212 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:42.750589 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-89b60dd5-80fb-4a90-b2c5-d22038879212 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860ac4e423cf410d9bbc354c77ba864c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aada201b2fd64fdc81a69f826e7c607b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:42.769023 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-89b60dd5-80fb-4a90-b2c5-d22038879212 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] 10.222.0.61 "GET /compute/v2.1/servers/644d0221-94ca-4873-8fe0-ab72c4d7d68b" status: 200 len: 1271 microversion: 2.1 time: 0.425773 Aug 31 16:14:42.769807 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2028/4049] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:42 2022] GET /compute/v2.1/servers/644d0221-94ca-4873-8fe0-ab72c4d7d68b => generated 1271 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:42.794457 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e5d5ea28-29b6-4b03-a12b-3e2b35d9d720 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:42.803638 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e5d5ea28-29b6-4b03-a12b-3e2b35d9d720 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] [instance: 1ceba728-a215-4f85-a8c1-9c79311861e1] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:42.817581 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e5d5ea28-29b6-4b03-a12b-3e2b35d9d720 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:42.823180 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e5d5ea28-29b6-4b03-a12b-3e2b35d9d720 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:42.824067 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e5d5ea28-29b6-4b03-a12b-3e2b35d9d720 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:42.825143 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e5d5ea28-29b6-4b03-a12b-3e2b35d9d720 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:42.825798 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e5d5ea28-29b6-4b03-a12b-3e2b35d9d720 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:42.827386 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e5d5ea28-29b6-4b03-a12b-3e2b35d9d720 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:43.122835 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7fa0c5a1-3975-4711-b25f-c135aaa7771f tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48ee960c38f4d0584ea5ce34579279f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a957b6585e74a31b5bc5f66441c33e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:43.137397 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7fa0c5a1-3975-4711-b25f-c135aaa7771f tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706" status: 200 len: 1314 microversion: 2.1 time: 0.974950 Aug 31 16:14:43.159772 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2022/4050] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:42 2022] GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706 => generated 1314 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:43.183252 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d0bd2cdb-4a4f-4658-af97-dca0275d4a5e tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:43.186055 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d0bd2cdb-4a4f-4658-af97-dca0275d4a5e tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: d78f1dfc-6152-4180-84be-f6a84b75dbc2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:43.206604 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d0bd2cdb-4a4f-4658-af97-dca0275d4a5e tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:43.208760 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d0bd2cdb-4a4f-4658-af97-dca0275d4a5e tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:43.210856 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d0bd2cdb-4a4f-4658-af97-dca0275d4a5e tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:43.215581 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d0bd2cdb-4a4f-4658-af97-dca0275d4a5e tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:43.217134 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d0bd2cdb-4a4f-4658-af97-dca0275d4a5e tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:43.219069 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d0bd2cdb-4a4f-4658-af97-dca0275d4a5e tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:43.444002 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e5d5ea28-29b6-4b03-a12b-3e2b35d9d720 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d6eee711fe4194a4db63c801f78561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeac74d3027d4080be26bf3aadab4c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:43.522776 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e5d5ea28-29b6-4b03-a12b-3e2b35d9d720 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] 10.222.0.61 "GET /compute/v2.1/servers/1ceba728-a215-4f85-a8c1-9c79311861e1" status: 200 len: 1320 microversion: 2.1 time: 0.749046 Aug 31 16:14:43.526348 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2029/4051] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:42 2022] GET /compute/v2.1/servers/1ceba728-a215-4f85-a8c1-9c79311861e1 => generated 1320 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:43.722324 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d0bd2cdb-4a4f-4658-af97-dca0275d4a5e tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:43.734799 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d0bd2cdb-4a4f-4658-af97-dca0275d4a5e tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/d78f1dfc-6152-4180-84be-f6a84b75dbc2" status: 200 len: 1510 microversion: 2.1 time: 0.554662 Aug 31 16:14:43.737282 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2023/4052] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:43 2022] GET /compute/v2.1/servers/d78f1dfc-6152-4180-84be-f6a84b75dbc2 => generated 1510 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:43.799759 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-43c2a265-7f1d-472e-9111-fab135fe66fc tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:43.801163 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-43c2a265-7f1d-472e-9111-fab135fe66fc tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] [instance: 644d0221-94ca-4873-8fe0-ab72c4d7d68b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:43.817062 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-43c2a265-7f1d-472e-9111-fab135fe66fc tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:43.817724 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-43c2a265-7f1d-472e-9111-fab135fe66fc tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:43.818679 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-43c2a265-7f1d-472e-9111-fab135fe66fc tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:43.836070 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-43c2a265-7f1d-472e-9111-fab135fe66fc tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:43.836727 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-43c2a265-7f1d-472e-9111-fab135fe66fc tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:43.837280 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-43c2a265-7f1d-472e-9111-fab135fe66fc tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:44.168324 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-564e09ba-3246-4c2f-8bca-408072034642 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:44.169119 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-564e09ba-3246-4c2f-8bca-408072034642 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: e3625fdf-7e50-4ba1-99dc-6ae7473fc706] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:44.188068 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-564e09ba-3246-4c2f-8bca-408072034642 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:44.189702 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-564e09ba-3246-4c2f-8bca-408072034642 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:44.190460 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-564e09ba-3246-4c2f-8bca-408072034642 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:44.191783 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-564e09ba-3246-4c2f-8bca-408072034642 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:44.198104 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-564e09ba-3246-4c2f-8bca-408072034642 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:44.199013 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-564e09ba-3246-4c2f-8bca-408072034642 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:44.778389 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-43c2a265-7f1d-472e-9111-fab135fe66fc tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860ac4e423cf410d9bbc354c77ba864c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aada201b2fd64fdc81a69f826e7c607b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:44.790005 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-43c2a265-7f1d-472e-9111-fab135fe66fc tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] 10.222.0.61 "GET /compute/v2.1/servers/644d0221-94ca-4873-8fe0-ab72c4d7d68b" status: 200 len: 1313 microversion: 2.1 time: 0.995310 Aug 31 16:14:44.809311 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2030/4053] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:43 2022] GET /compute/v2.1/servers/644d0221-94ca-4873-8fe0-ab72c4d7d68b => generated 1313 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:44.817215 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0a257632-7cbc-4a1d-b6eb-1495cce7899a tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:44.818788 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0a257632-7cbc-4a1d-b6eb-1495cce7899a tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] [instance: 1ceba728-a215-4f85-a8c1-9c79311861e1] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:44.825885 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0a257632-7cbc-4a1d-b6eb-1495cce7899a tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:44.827432 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0a257632-7cbc-4a1d-b6eb-1495cce7899a tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:44.828104 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0a257632-7cbc-4a1d-b6eb-1495cce7899a tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:44.829013 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0a257632-7cbc-4a1d-b6eb-1495cce7899a tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:44.830433 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0a257632-7cbc-4a1d-b6eb-1495cce7899a tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:44.831059 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0a257632-7cbc-4a1d-b6eb-1495cce7899a tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:45.371419 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-564e09ba-3246-4c2f-8bca-408072034642 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48ee960c38f4d0584ea5ce34579279f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a957b6585e74a31b5bc5f66441c33e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:45.396770 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-564e09ba-3246-4c2f-8bca-408072034642 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706" status: 200 len: 1314 microversion: 2.1 time: 1.230582 Aug 31 16:14:45.397979 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2024/4054] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:44 2022] GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706 => generated 1314 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:14:45.406623 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d023178c-186b-4264-a6e1-e7f8af483341 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:45.409320 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d023178c-186b-4264-a6e1-e7f8af483341 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: d78f1dfc-6152-4180-84be-f6a84b75dbc2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:45.417439 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0a257632-7cbc-4a1d-b6eb-1495cce7899a tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d6eee711fe4194a4db63c801f78561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeac74d3027d4080be26bf3aadab4c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:45.422293 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d023178c-186b-4264-a6e1-e7f8af483341 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:45.425631 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d023178c-186b-4264-a6e1-e7f8af483341 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:45.429711 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d023178c-186b-4264-a6e1-e7f8af483341 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:45.430604 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d023178c-186b-4264-a6e1-e7f8af483341 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:45.431891 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d023178c-186b-4264-a6e1-e7f8af483341 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:45.432716 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d023178c-186b-4264-a6e1-e7f8af483341 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:45.435546 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0a257632-7cbc-4a1d-b6eb-1495cce7899a tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] 10.222.0.61 "GET /compute/v2.1/servers/1ceba728-a215-4f85-a8c1-9c79311861e1" status: 200 len: 1320 microversion: 2.1 time: 0.623688 Aug 31 16:14:45.467893 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2031/4055] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:44 2022] GET /compute/v2.1/servers/1ceba728-a215-4f85-a8c1-9c79311861e1 => generated 1320 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:45.816079 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ad83f21f-c683-4f60-904f-15eb58db24f1 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:45.817443 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ad83f21f-c683-4f60-904f-15eb58db24f1 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] [instance: 644d0221-94ca-4873-8fe0-ab72c4d7d68b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:45.824969 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ad83f21f-c683-4f60-904f-15eb58db24f1 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:45.825964 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ad83f21f-c683-4f60-904f-15eb58db24f1 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:45.826787 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ad83f21f-c683-4f60-904f-15eb58db24f1 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:45.828332 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ad83f21f-c683-4f60-904f-15eb58db24f1 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:45.829115 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ad83f21f-c683-4f60-904f-15eb58db24f1 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:45.830720 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ad83f21f-c683-4f60-904f-15eb58db24f1 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:45.892468 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d023178c-186b-4264-a6e1-e7f8af483341 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:45.912316 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d023178c-186b-4264-a6e1-e7f8af483341 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/d78f1dfc-6152-4180-84be-f6a84b75dbc2" status: 200 len: 1510 microversion: 2.1 time: 0.512860 Aug 31 16:14:45.914150 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2025/4056] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:45 2022] GET /compute/v2.1/servers/d78f1dfc-6152-4180-84be-f6a84b75dbc2 => generated 1510 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:46.420476 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-46629d97-f566-4366-8d0b-c9856003c727 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:46.421825 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-46629d97-f566-4366-8d0b-c9856003c727 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: e3625fdf-7e50-4ba1-99dc-6ae7473fc706] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:46.441162 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-46629d97-f566-4366-8d0b-c9856003c727 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:46.444071 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-46629d97-f566-4366-8d0b-c9856003c727 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:46.445957 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-46629d97-f566-4366-8d0b-c9856003c727 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:46.448581 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-46629d97-f566-4366-8d0b-c9856003c727 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:46.451418 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-46629d97-f566-4366-8d0b-c9856003c727 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:46.452579 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-46629d97-f566-4366-8d0b-c9856003c727 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:46.543940 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ad83f21f-c683-4f60-904f-15eb58db24f1 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860ac4e423cf410d9bbc354c77ba864c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aada201b2fd64fdc81a69f826e7c607b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:46.569290 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ad83f21f-c683-4f60-904f-15eb58db24f1 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] 10.222.0.61 "GET /compute/v2.1/servers/644d0221-94ca-4873-8fe0-ab72c4d7d68b" status: 200 len: 1313 microversion: 2.1 time: 0.758357 Aug 31 16:14:46.592904 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2032/4057] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:45 2022] GET /compute/v2.1/servers/644d0221-94ca-4873-8fe0-ab72c4d7d68b => generated 1313 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:14:46.604540 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-269bef68-aedc-46df-a07f-cdf64b7a7a4c tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:46.607060 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-269bef68-aedc-46df-a07f-cdf64b7a7a4c tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] [instance: 1ceba728-a215-4f85-a8c1-9c79311861e1] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:46.632295 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-269bef68-aedc-46df-a07f-cdf64b7a7a4c tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:46.633046 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-269bef68-aedc-46df-a07f-cdf64b7a7a4c tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:46.633671 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-269bef68-aedc-46df-a07f-cdf64b7a7a4c tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:46.634891 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-269bef68-aedc-46df-a07f-cdf64b7a7a4c tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:46.635587 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-269bef68-aedc-46df-a07f-cdf64b7a7a4c tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:46.636201 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-269bef68-aedc-46df-a07f-cdf64b7a7a4c tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:47.232544 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-46629d97-f566-4366-8d0b-c9856003c727 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48ee960c38f4d0584ea5ce34579279f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a957b6585e74a31b5bc5f66441c33e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:47.264248 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-46629d97-f566-4366-8d0b-c9856003c727 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706" status: 200 len: 1314 microversion: 2.1 time: 0.848579 Aug 31 16:14:47.279555 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2026/4058] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:46 2022] GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706 => generated 1314 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:14:47.279555 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-83d8f3a9-8cb9-43e0-94f7-a273f67f6465 req-dd5ee01b-a941-4261-82b4-14409f34fa74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3625fdf-7e50-4ba1-99dc-6ae7473fc706", "name": "network-vif-plugged", "status": "completed", "tag": "7e3f67e3-533f-4eab-9333-7f35c6d050e3"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:14:47.309048 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-83d8f3a9-8cb9-43e0-94f7-a273f67f6465 req-dd5ee01b-a941-4261-82b4-14409f34fa74 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:47.309701 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-83d8f3a9-8cb9-43e0-94f7-a273f67f6465 req-dd5ee01b-a941-4261-82b4-14409f34fa74 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:47.310327 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-83d8f3a9-8cb9-43e0-94f7-a273f67f6465 req-dd5ee01b-a941-4261-82b4-14409f34fa74 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:47.341461 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-83d8f3a9-8cb9-43e0-94f7-a273f67f6465 req-dd5ee01b-a941-4261-82b4-14409f34fa74 service nova] Creating event network-vif-plugged:7e3f67e3-533f-4eab-9333-7f35c6d050e3 for instance e3625fdf-7e50-4ba1-99dc-6ae7473fc706 on n-h2-850499-9 Aug 31 16:14:47.354851 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-83d8f3a9-8cb9-43e0-94f7-a273f67f6465 req-dd5ee01b-a941-4261-82b4-14409f34fa74 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085670 Aug 31 16:14:47.356231 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2027/4059] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:14:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:14:47.375555 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-23cb0daf-2613-44c2-8443-77ada3e62bd6 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:47.376572 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-23cb0daf-2613-44c2-8443-77ada3e62bd6 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: d78f1dfc-6152-4180-84be-f6a84b75dbc2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:47.381452 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-269bef68-aedc-46df-a07f-cdf64b7a7a4c tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d6eee711fe4194a4db63c801f78561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeac74d3027d4080be26bf3aadab4c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:47.386791 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-23cb0daf-2613-44c2-8443-77ada3e62bd6 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:47.392049 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-23cb0daf-2613-44c2-8443-77ada3e62bd6 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:47.393116 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-23cb0daf-2613-44c2-8443-77ada3e62bd6 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:47.394315 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-23cb0daf-2613-44c2-8443-77ada3e62bd6 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:47.395170 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-23cb0daf-2613-44c2-8443-77ada3e62bd6 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:47.398922 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-23cb0daf-2613-44c2-8443-77ada3e62bd6 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:47.425837 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-269bef68-aedc-46df-a07f-cdf64b7a7a4c tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] 10.222.0.61 "GET /compute/v2.1/servers/1ceba728-a215-4f85-a8c1-9c79311861e1" status: 200 len: 1320 microversion: 2.1 time: 0.830758 Aug 31 16:14:47.426984 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2033/4060] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:46 2022] GET /compute/v2.1/servers/1ceba728-a215-4f85-a8c1-9c79311861e1 => generated 1320 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:47.601475 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-597a7ffa-d562-4bf9-9def-463016e04e61 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:47.602250 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-597a7ffa-d562-4bf9-9def-463016e04e61 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] [instance: 644d0221-94ca-4873-8fe0-ab72c4d7d68b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:47.618093 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-597a7ffa-d562-4bf9-9def-463016e04e61 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:47.618748 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-597a7ffa-d562-4bf9-9def-463016e04e61 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:47.621077 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-597a7ffa-d562-4bf9-9def-463016e04e61 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:47.622122 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-597a7ffa-d562-4bf9-9def-463016e04e61 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:47.622841 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-597a7ffa-d562-4bf9-9def-463016e04e61 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:47.623557 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-597a7ffa-d562-4bf9-9def-463016e04e61 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:47.815742 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:14:47.846886 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=6 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:14:48.185816 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-23cb0daf-2613-44c2-8443-77ada3e62bd6 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:48.208603 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-23cb0daf-2613-44c2-8443-77ada3e62bd6 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/d78f1dfc-6152-4180-84be-f6a84b75dbc2" status: 200 len: 1510 microversion: 2.1 time: 0.849894 Aug 31 16:14:48.209229 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2028/4061] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:47 2022] GET /compute/v2.1/servers/d78f1dfc-6152-4180-84be-f6a84b75dbc2 => generated 1510 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:48.432046 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-597a7ffa-d562-4bf9-9def-463016e04e61 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860ac4e423cf410d9bbc354c77ba864c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aada201b2fd64fdc81a69f826e7c607b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:48.459916 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-597a7ffa-d562-4bf9-9def-463016e04e61 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] 10.222.0.61 "GET /compute/v2.1/servers/644d0221-94ca-4873-8fe0-ab72c4d7d68b" status: 200 len: 1334 microversion: 2.1 time: 0.860659 Aug 31 16:14:48.473041 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2034/4062] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:47 2022] GET /compute/v2.1/servers/644d0221-94ca-4873-8fe0-ab72c4d7d68b => generated 1334 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:48.490921 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1bffbeb9-6deb-4a81-b953-ff589afec16f tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:48.495599 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1bffbeb9-6deb-4a81-b953-ff589afec16f tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: e3625fdf-7e50-4ba1-99dc-6ae7473fc706] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:48.520305 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1bffbeb9-6deb-4a81-b953-ff589afec16f tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:48.521346 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1bffbeb9-6deb-4a81-b953-ff589afec16f tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:48.522244 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1bffbeb9-6deb-4a81-b953-ff589afec16f tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:48.523254 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1bffbeb9-6deb-4a81-b953-ff589afec16f tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:48.524373 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1bffbeb9-6deb-4a81-b953-ff589afec16f tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:48.525356 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1bffbeb9-6deb-4a81-b953-ff589afec16f tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:48.670438 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9f2fa57f-2ef1-42be-b468-1495dd4f0980 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Action: 'create', calling method: .version_select at 0x7f5ae3e165e0>, body: {"keypair": {"name": "tempest-keypair-1037646336", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKGQz5s5//E6tAw92cqKgt5cI+ZkTahUc+HtwS3uq8twlENUFGJkozd1+bfCb273qfxOk7wuKZ3MC8MPrKRhZ0c4Q+zCEBIq2XHC5KiRlYJKDhmCLjt3vHMx0rd9YjNSfA=="}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:14:48.732598 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-9f2fa57f-2ef1-42be-b468-1495dd4f0980 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Getting quotas for project f8fa87d9431f4253b8425593a2150359. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:14:48.748211 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:14:48.756849 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-9f2fa57f-2ef1-42be-b468-1495dd4f0980 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Getting quotas for user a105ab564f304fa7a2ceba07418a22bc and project f8fa87d9431f4253b8425593a2150359. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:14:48.856252 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9f2fa57f-2ef1-42be-b468-1495dd4f0980 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.594533 Aug 31 16:14:48.861711 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2029/4063] 10.222.0.61 () {60 vars in 1159 bytes} [Wed Aug 31 16:14:48 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:14:48.895724 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-52fe3315-1a56-4212-9ab4-e8c4baaad6e8 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:48.897757 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-52fe3315-1a56-4212-9ab4-e8c4baaad6e8 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] [instance: 1ceba728-a215-4f85-a8c1-9c79311861e1] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:48.914216 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-52fe3315-1a56-4212-9ab4-e8c4baaad6e8 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:48.915607 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-52fe3315-1a56-4212-9ab4-e8c4baaad6e8 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:48.916320 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-52fe3315-1a56-4212-9ab4-e8c4baaad6e8 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:48.919738 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-52fe3315-1a56-4212-9ab4-e8c4baaad6e8 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:48.925909 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-52fe3315-1a56-4212-9ab4-e8c4baaad6e8 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:48.927076 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-52fe3315-1a56-4212-9ab4-e8c4baaad6e8 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:48.930852 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-1bffbeb9-6deb-4a81-b953-ff589afec16f tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48ee960c38f4d0584ea5ce34579279f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a957b6585e74a31b5bc5f66441c33e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:48.965572 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1bffbeb9-6deb-4a81-b953-ff589afec16f tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706" status: 200 len: 1314 microversion: 2.1 time: 0.487202 Aug 31 16:14:48.966910 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2035/4064] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:48 2022] GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706 => generated 1314 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:49.209114 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-52fe3315-1a56-4212-9ab4-e8c4baaad6e8 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d6eee711fe4194a4db63c801f78561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeac74d3027d4080be26bf3aadab4c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:49.242212 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-52fe3315-1a56-4212-9ab4-e8c4baaad6e8 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] 10.222.0.61 "GET /compute/v2.1/servers/1ceba728-a215-4f85-a8c1-9c79311861e1" status: 200 len: 1320 microversion: 2.1 time: 0.378706 Aug 31 16:14:49.243400 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2030/4065] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:48 2022] GET /compute/v2.1/servers/1ceba728-a215-4f85-a8c1-9c79311861e1 => generated 1320 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:49.243637 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e015f123-b932-436c-8cbf-8b1b269805f0 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:49.245320 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e015f123-b932-436c-8cbf-8b1b269805f0 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: d78f1dfc-6152-4180-84be-f6a84b75dbc2] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:49.271570 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e015f123-b932-436c-8cbf-8b1b269805f0 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:49.272917 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e015f123-b932-436c-8cbf-8b1b269805f0 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:49.276901 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e015f123-b932-436c-8cbf-8b1b269805f0 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:49.280832 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e015f123-b932-436c-8cbf-8b1b269805f0 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:49.289215 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e015f123-b932-436c-8cbf-8b1b269805f0 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:49.292119 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e015f123-b932-436c-8cbf-8b1b269805f0 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:49.484684 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d979a5ef-71bb-4bc4-b39b-0840afc21c4d tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:49.486611 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d979a5ef-71bb-4bc4-b39b-0840afc21c4d tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] [instance: 644d0221-94ca-4873-8fe0-ab72c4d7d68b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:49.506757 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d979a5ef-71bb-4bc4-b39b-0840afc21c4d tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:49.512400 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d979a5ef-71bb-4bc4-b39b-0840afc21c4d tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:49.513484 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d979a5ef-71bb-4bc4-b39b-0840afc21c4d tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:49.514900 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d979a5ef-71bb-4bc4-b39b-0840afc21c4d tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:49.515945 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d979a5ef-71bb-4bc4-b39b-0840afc21c4d tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:49.516681 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d979a5ef-71bb-4bc4-b39b-0840afc21c4d tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:49.619658 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e015f123-b932-436c-8cbf-8b1b269805f0 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:49.636225 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e015f123-b932-436c-8cbf-8b1b269805f0 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/d78f1dfc-6152-4180-84be-f6a84b75dbc2" status: 200 len: 1510 microversion: 2.1 time: 0.405583 Aug 31 16:14:49.638043 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2036/4066] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:49 2022] GET /compute/v2.1/servers/d78f1dfc-6152-4180-84be-f6a84b75dbc2 => generated 1510 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:49.932298 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d979a5ef-71bb-4bc4-b39b-0840afc21c4d tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860ac4e423cf410d9bbc354c77ba864c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aada201b2fd64fdc81a69f826e7c607b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:49.953852 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d979a5ef-71bb-4bc4-b39b-0840afc21c4d tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] 10.222.0.61 "GET /compute/v2.1/servers/644d0221-94ca-4873-8fe0-ab72c4d7d68b" status: 200 len: 1334 microversion: 2.1 time: 0.473830 Aug 31 16:14:49.962185 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2031/4067] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:49 2022] GET /compute/v2.1/servers/644d0221-94ca-4873-8fe0-ab72c4d7d68b => generated 1334 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:49.998666 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1c45ace5-2d8a-4c7d-a1a7-ab1ed06c5446 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:49.999752 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1c45ace5-2d8a-4c7d-a1a7-ab1ed06c5446 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: e3625fdf-7e50-4ba1-99dc-6ae7473fc706] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:50.018170 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1c45ace5-2d8a-4c7d-a1a7-ab1ed06c5446 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:50.018723 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1c45ace5-2d8a-4c7d-a1a7-ab1ed06c5446 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:50.019189 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1c45ace5-2d8a-4c7d-a1a7-ab1ed06c5446 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:50.020144 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1c45ace5-2d8a-4c7d-a1a7-ab1ed06c5446 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:50.020620 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1c45ace5-2d8a-4c7d-a1a7-ab1ed06c5446 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:50.021062 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1c45ace5-2d8a-4c7d-a1a7-ab1ed06c5446 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:50.277144 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-90b9f8f7-412f-4787-bca7-fd12f67ed34b tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:50.278175 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-90b9f8f7-412f-4787-bca7-fd12f67ed34b tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] [instance: 1ceba728-a215-4f85-a8c1-9c79311861e1] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:50.298545 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-90b9f8f7-412f-4787-bca7-fd12f67ed34b tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:50.303374 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-90b9f8f7-412f-4787-bca7-fd12f67ed34b tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:50.306758 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-90b9f8f7-412f-4787-bca7-fd12f67ed34b tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:50.308343 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-90b9f8f7-412f-4787-bca7-fd12f67ed34b tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:50.314250 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-90b9f8f7-412f-4787-bca7-fd12f67ed34b tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:50.315377 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-90b9f8f7-412f-4787-bca7-fd12f67ed34b tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:50.387843 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-1c45ace5-2d8a-4c7d-a1a7-ab1ed06c5446 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48ee960c38f4d0584ea5ce34579279f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a957b6585e74a31b5bc5f66441c33e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:50.408125 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1c45ace5-2d8a-4c7d-a1a7-ab1ed06c5446 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706" status: 200 len: 1314 microversion: 2.1 time: 0.415231 Aug 31 16:14:50.420585 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2037/4068] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:49 2022] GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706 => generated 1314 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:50.661823 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-12959085-24b5-4000-a796-aa22ef04eaec tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:50.663687 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-12959085-24b5-4000-a796-aa22ef04eaec tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: d78f1dfc-6152-4180-84be-f6a84b75dbc2] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:50.678545 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-12959085-24b5-4000-a796-aa22ef04eaec tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:50.679467 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-12959085-24b5-4000-a796-aa22ef04eaec tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:50.683894 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-12959085-24b5-4000-a796-aa22ef04eaec tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:50.687990 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-12959085-24b5-4000-a796-aa22ef04eaec tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:50.695205 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-12959085-24b5-4000-a796-aa22ef04eaec tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:50.696214 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-12959085-24b5-4000-a796-aa22ef04eaec tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:50.933378 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-90b9f8f7-412f-4787-bca7-fd12f67ed34b tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d6eee711fe4194a4db63c801f78561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeac74d3027d4080be26bf3aadab4c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:50.965350 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-90b9f8f7-412f-4787-bca7-fd12f67ed34b tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] 10.222.0.61 "GET /compute/v2.1/servers/1ceba728-a215-4f85-a8c1-9c79311861e1" status: 200 len: 1320 microversion: 2.1 time: 0.691784 Aug 31 16:14:50.966340 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2032/4069] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:50 2022] GET /compute/v2.1/servers/1ceba728-a215-4f85-a8c1-9c79311861e1 => generated 1320 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:50.985774 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2e9975ca-b370-44bb-ab3d-61dec95a4961 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:50.989366 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2e9975ca-b370-44bb-ab3d-61dec95a4961 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] [instance: 644d0221-94ca-4873-8fe0-ab72c4d7d68b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:51.009895 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2e9975ca-b370-44bb-ab3d-61dec95a4961 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:51.010456 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2e9975ca-b370-44bb-ab3d-61dec95a4961 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:51.010959 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2e9975ca-b370-44bb-ab3d-61dec95a4961 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:51.011716 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2e9975ca-b370-44bb-ab3d-61dec95a4961 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:51.018200 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2e9975ca-b370-44bb-ab3d-61dec95a4961 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:51.019301 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2e9975ca-b370-44bb-ab3d-61dec95a4961 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:51.208658 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-12959085-24b5-4000-a796-aa22ef04eaec tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:51.225825 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-12959085-24b5-4000-a796-aa22ef04eaec tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/d78f1dfc-6152-4180-84be-f6a84b75dbc2" status: 200 len: 1510 microversion: 2.1 time: 0.569775 Aug 31 16:14:51.226847 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2038/4070] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:50 2022] GET /compute/v2.1/servers/d78f1dfc-6152-4180-84be-f6a84b75dbc2 => generated 1510 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:51.411307 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-2e9975ca-b370-44bb-ab3d-61dec95a4961 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860ac4e423cf410d9bbc354c77ba864c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aada201b2fd64fdc81a69f826e7c607b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:51.420383 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2e9975ca-b370-44bb-ab3d-61dec95a4961 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] 10.222.0.61 "GET /compute/v2.1/servers/644d0221-94ca-4873-8fe0-ab72c4d7d68b" status: 200 len: 1355 microversion: 2.1 time: 0.439096 Aug 31 16:14:51.427553 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2033/4071] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:50 2022] GET /compute/v2.1/servers/644d0221-94ca-4873-8fe0-ab72c4d7d68b => generated 1355 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:51.446051 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1760c755-f6f1-4db2-8126-b0eac888aed2 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:51.446874 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1760c755-f6f1-4db2-8126-b0eac888aed2 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: e3625fdf-7e50-4ba1-99dc-6ae7473fc706] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:51.461919 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1760c755-f6f1-4db2-8126-b0eac888aed2 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:51.465579 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1760c755-f6f1-4db2-8126-b0eac888aed2 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:51.466192 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1760c755-f6f1-4db2-8126-b0eac888aed2 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:51.469558 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1760c755-f6f1-4db2-8126-b0eac888aed2 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:51.472140 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1760c755-f6f1-4db2-8126-b0eac888aed2 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:51.473720 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1760c755-f6f1-4db2-8126-b0eac888aed2 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:51.989062 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-1760c755-f6f1-4db2-8126-b0eac888aed2 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48ee960c38f4d0584ea5ce34579279f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a957b6585e74a31b5bc5f66441c33e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:51.996500 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6e2ed606-bcad-4dba-8550-2dcc942aed71 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:51.997361 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6e2ed606-bcad-4dba-8550-2dcc942aed71 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] [instance: 1ceba728-a215-4f85-a8c1-9c79311861e1] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:52.003200 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1760c755-f6f1-4db2-8126-b0eac888aed2 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706" status: 200 len: 1500 microversion: 2.1 time: 0.561274 Aug 31 16:14:52.004650 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2039/4072] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:51 2022] GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706 => generated 1500 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:52.025199 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6e2ed606-bcad-4dba-8550-2dcc942aed71 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:52.025840 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6e2ed606-bcad-4dba-8550-2dcc942aed71 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:52.026291 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6e2ed606-bcad-4dba-8550-2dcc942aed71 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:52.032078 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6e2ed606-bcad-4dba-8550-2dcc942aed71 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:52.033033 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6e2ed606-bcad-4dba-8550-2dcc942aed71 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:52.033485 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6e2ed606-bcad-4dba-8550-2dcc942aed71 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:52.040866 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8063c97f-e0d8-4cf6-9725-443a76256b15 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:14:52.068670 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8063c97f-e0d8-4cf6-9725-443a76256b15 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: e3625fdf-7e50-4ba1-99dc-6ae7473fc706] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:52.096302 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8063c97f-e0d8-4cf6-9725-443a76256b15 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:52.096576 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8063c97f-e0d8-4cf6-9725-443a76256b15 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:52.097027 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8063c97f-e0d8-4cf6-9725-443a76256b15 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:52.097761 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8063c97f-e0d8-4cf6-9725-443a76256b15 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:52.098221 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8063c97f-e0d8-4cf6-9725-443a76256b15 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:52.098652 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8063c97f-e0d8-4cf6-9725-443a76256b15 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:52.139589 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-8063c97f-e0d8-4cf6-9725-443a76256b15 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lazy-loading 'flavor' on Instance uuid e3625fdf-7e50-4ba1-99dc-6ae7473fc706 {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:14:52.158760 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:14:52.263814 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8063c97f-e0d8-4cf6-9725-443a76256b15 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "POST /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706/action" status: 200 len: 32 microversion: 2.1 time: 0.239057 Aug 31 16:14:52.265452 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2040/4073] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:14:52 2022] POST /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706/action => generated 32 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 16:14:52.273665 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7eecd545-c7d0-4bd1-a26d-bbe074b96bf8 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:52.274503 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7eecd545-c7d0-4bd1-a26d-bbe074b96bf8 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: d78f1dfc-6152-4180-84be-f6a84b75dbc2] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:52.284521 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7eecd545-c7d0-4bd1-a26d-bbe074b96bf8 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:52.285308 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7eecd545-c7d0-4bd1-a26d-bbe074b96bf8 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:52.286384 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7eecd545-c7d0-4bd1-a26d-bbe074b96bf8 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:52.287244 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7eecd545-c7d0-4bd1-a26d-bbe074b96bf8 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:52.288254 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7eecd545-c7d0-4bd1-a26d-bbe074b96bf8 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:52.288804 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7eecd545-c7d0-4bd1-a26d-bbe074b96bf8 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:52.655168 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-6e2ed606-bcad-4dba-8550-2dcc942aed71 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d6eee711fe4194a4db63c801f78561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeac74d3027d4080be26bf3aadab4c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:52.670552 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6e2ed606-bcad-4dba-8550-2dcc942aed71 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] 10.222.0.61 "GET /compute/v2.1/servers/1ceba728-a215-4f85-a8c1-9c79311861e1" status: 200 len: 1320 microversion: 2.1 time: 0.680990 Aug 31 16:14:52.672117 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2034/4074] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:51 2022] GET /compute/v2.1/servers/1ceba728-a215-4f85-a8c1-9c79311861e1 => generated 1320 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:52.682968 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-04c03172-32a5-4f38-807d-74c2d95149f5 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:52.695213 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-04c03172-32a5-4f38-807d-74c2d95149f5 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: e3625fdf-7e50-4ba1-99dc-6ae7473fc706] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:52.695213 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-04c03172-32a5-4f38-807d-74c2d95149f5 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:52.695213 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-04c03172-32a5-4f38-807d-74c2d95149f5 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:52.695213 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-04c03172-32a5-4f38-807d-74c2d95149f5 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:52.695213 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-04c03172-32a5-4f38-807d-74c2d95149f5 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:52.695213 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-04c03172-32a5-4f38-807d-74c2d95149f5 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:52.695213 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-04c03172-32a5-4f38-807d-74c2d95149f5 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:53.091646 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7eecd545-c7d0-4bd1-a26d-bbe074b96bf8 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:53.106959 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7eecd545-c7d0-4bd1-a26d-bbe074b96bf8 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/d78f1dfc-6152-4180-84be-f6a84b75dbc2" status: 200 len: 1510 microversion: 2.1 time: 0.838007 Aug 31 16:14:53.109047 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2041/4075] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:52 2022] GET /compute/v2.1/servers/d78f1dfc-6152-4180-84be-f6a84b75dbc2 => generated 1510 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:53.130926 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-0f5dfc08-7ebc-4dd6-986a-80dcea426c99 req-53b133ae-34c0-4520-add8-3835fb77be03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "644d0221-94ca-4873-8fe0-ab72c4d7d68b", "tag": "427ff9a1-aa4b-4fb5-908e-3122c7b9617d"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:14:53.150533 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-0f5dfc08-7ebc-4dd6-986a-80dcea426c99 req-53b133ae-34c0-4520-add8-3835fb77be03 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:53.151229 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-0f5dfc08-7ebc-4dd6-986a-80dcea426c99 req-53b133ae-34c0-4520-add8-3835fb77be03 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:53.151923 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-0f5dfc08-7ebc-4dd6-986a-80dcea426c99 req-53b133ae-34c0-4520-add8-3835fb77be03 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:53.171356 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-0f5dfc08-7ebc-4dd6-986a-80dcea426c99 req-53b133ae-34c0-4520-add8-3835fb77be03 service nova] Creating event network-changed:427ff9a1-aa4b-4fb5-908e-3122c7b9617d for instance 644d0221-94ca-4873-8fe0-ab72c4d7d68b on n-h1-850499-9 Aug 31 16:14:53.179215 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-0f5dfc08-7ebc-4dd6-986a-80dcea426c99 req-53b133ae-34c0-4520-add8-3835fb77be03 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068318 Aug 31 16:14:53.180771 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2042/4076] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:14:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:14:53.191618 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c38b740f-08f3-4998-a585-1b9c6598fed3 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:53.193279 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c38b740f-08f3-4998-a585-1b9c6598fed3 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] [instance: 644d0221-94ca-4873-8fe0-ab72c4d7d68b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:53.201457 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c38b740f-08f3-4998-a585-1b9c6598fed3 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:53.202335 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c38b740f-08f3-4998-a585-1b9c6598fed3 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:53.202968 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c38b740f-08f3-4998-a585-1b9c6598fed3 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:53.205221 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c38b740f-08f3-4998-a585-1b9c6598fed3 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:53.206353 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c38b740f-08f3-4998-a585-1b9c6598fed3 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:53.207765 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c38b740f-08f3-4998-a585-1b9c6598fed3 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:53.898344 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-04c03172-32a5-4f38-807d-74c2d95149f5 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48ee960c38f4d0584ea5ce34579279f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a957b6585e74a31b5bc5f66441c33e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:53.919158 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-04c03172-32a5-4f38-807d-74c2d95149f5 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706" status: 200 len: 1506 microversion: 2.1 time: 1.245200 Aug 31 16:14:53.921298 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2035/4077] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:52 2022] GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706 => generated 1506 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:53.930157 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-cff5d308-c081-4641-bbfa-9513443626b8 req-611b4b91-a179-4ff9-917a-2c44543d535b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ceba728-a215-4f85-a8c1-9c79311861e1", "name": "network-vif-plugged", "status": "completed", "tag": "5bf874cc-d939-4c79-b6fd-ad858ba41246"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:14:53.946696 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-cff5d308-c081-4641-bbfa-9513443626b8 req-611b4b91-a179-4ff9-917a-2c44543d535b service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:53.947267 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-cff5d308-c081-4641-bbfa-9513443626b8 req-611b4b91-a179-4ff9-917a-2c44543d535b service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:53.947794 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-cff5d308-c081-4641-bbfa-9513443626b8 req-611b4b91-a179-4ff9-917a-2c44543d535b service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:53.968384 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-cff5d308-c081-4641-bbfa-9513443626b8 req-611b4b91-a179-4ff9-917a-2c44543d535b service nova] Creating event network-vif-plugged:5bf874cc-d939-4c79-b6fd-ad858ba41246 for instance 1ceba728-a215-4f85-a8c1-9c79311861e1 on n-h2-850499-9 Aug 31 16:14:53.978288 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-cff5d308-c081-4641-bbfa-9513443626b8 req-611b4b91-a179-4ff9-917a-2c44543d535b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052046 Aug 31 16:14:53.980220 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2036/4078] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:14:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:14:53.998818 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-bbe4ae1a-744d-47d1-a1a0-9310fb7da34b tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:54.000033 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-bbe4ae1a-744d-47d1-a1a0-9310fb7da34b tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] [instance: 1ceba728-a215-4f85-a8c1-9c79311861e1] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:54.002602 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c38b740f-08f3-4998-a585-1b9c6598fed3 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860ac4e423cf410d9bbc354c77ba864c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aada201b2fd64fdc81a69f826e7c607b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:54.018976 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bbe4ae1a-744d-47d1-a1a0-9310fb7da34b tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:54.022095 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bbe4ae1a-744d-47d1-a1a0-9310fb7da34b tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:54.022642 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bbe4ae1a-744d-47d1-a1a0-9310fb7da34b tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:54.024291 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bbe4ae1a-744d-47d1-a1a0-9310fb7da34b tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:54.025487 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bbe4ae1a-744d-47d1-a1a0-9310fb7da34b tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:54.026766 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bbe4ae1a-744d-47d1-a1a0-9310fb7da34b tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:54.034755 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c38b740f-08f3-4998-a585-1b9c6598fed3 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] 10.222.0.61 "GET /compute/v2.1/servers/644d0221-94ca-4873-8fe0-ab72c4d7d68b" status: 200 len: 1355 microversion: 2.1 time: 0.851403 Aug 31 16:14:54.037714 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2043/4079] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:53 2022] GET /compute/v2.1/servers/644d0221-94ca-4873-8fe0-ab72c4d7d68b => generated 1355 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:54.133346 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-24fb1fee-8c69-41e3-a5a0-9aa747478559 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:54.134346 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-24fb1fee-8c69-41e3-a5a0-9aa747478559 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: d78f1dfc-6152-4180-84be-f6a84b75dbc2] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:54.152504 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-24fb1fee-8c69-41e3-a5a0-9aa747478559 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:54.153014 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-24fb1fee-8c69-41e3-a5a0-9aa747478559 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:54.153996 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-24fb1fee-8c69-41e3-a5a0-9aa747478559 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:54.154900 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-24fb1fee-8c69-41e3-a5a0-9aa747478559 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:54.155588 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-24fb1fee-8c69-41e3-a5a0-9aa747478559 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:54.156437 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-24fb1fee-8c69-41e3-a5a0-9aa747478559 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:54.742237 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-bbe4ae1a-744d-47d1-a1a0-9310fb7da34b tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d6eee711fe4194a4db63c801f78561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeac74d3027d4080be26bf3aadab4c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:54.755631 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-bbe4ae1a-744d-47d1-a1a0-9310fb7da34b tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] 10.222.0.61 "GET /compute/v2.1/servers/1ceba728-a215-4f85-a8c1-9c79311861e1" status: 200 len: 1320 microversion: 2.1 time: 0.773334 Aug 31 16:14:54.756562 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2037/4080] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:53 2022] GET /compute/v2.1/servers/1ceba728-a215-4f85-a8c1-9c79311861e1 => generated 1320 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:54.904797 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-24fb1fee-8c69-41e3-a5a0-9aa747478559 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:54.926069 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-24fb1fee-8c69-41e3-a5a0-9aa747478559 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/d78f1dfc-6152-4180-84be-f6a84b75dbc2" status: 200 len: 1510 microversion: 2.1 time: 0.796476 Aug 31 16:14:54.929467 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2044/4081] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:54 2022] GET /compute/v2.1/servers/d78f1dfc-6152-4180-84be-f6a84b75dbc2 => generated 1510 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:14:54.943302 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f8d78439-e8a7-4ee1-a45a-74a6b608821b tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:54.943969 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f8d78439-e8a7-4ee1-a45a-74a6b608821b tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: e3625fdf-7e50-4ba1-99dc-6ae7473fc706] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:54.955607 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f8d78439-e8a7-4ee1-a45a-74a6b608821b tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:54.959424 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f8d78439-e8a7-4ee1-a45a-74a6b608821b tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:54.960005 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f8d78439-e8a7-4ee1-a45a-74a6b608821b tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:54.960854 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f8d78439-e8a7-4ee1-a45a-74a6b608821b tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:54.962683 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f8d78439-e8a7-4ee1-a45a-74a6b608821b tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:54.963394 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f8d78439-e8a7-4ee1-a45a-74a6b608821b tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:55.003021 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=100 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:14:55.061695 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c87dfe18-9a5f-4f14-ab60-dcba5793ddf4 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:55.062538 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c87dfe18-9a5f-4f14-ab60-dcba5793ddf4 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] [instance: 644d0221-94ca-4873-8fe0-ab72c4d7d68b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:55.086684 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c87dfe18-9a5f-4f14-ab60-dcba5793ddf4 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:55.088725 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c87dfe18-9a5f-4f14-ab60-dcba5793ddf4 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:55.093780 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c87dfe18-9a5f-4f14-ab60-dcba5793ddf4 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:55.097478 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c87dfe18-9a5f-4f14-ab60-dcba5793ddf4 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:55.101809 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c87dfe18-9a5f-4f14-ab60-dcba5793ddf4 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:55.104153 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c87dfe18-9a5f-4f14-ab60-dcba5793ddf4 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:55.227042 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f8d78439-e8a7-4ee1-a45a-74a6b608821b tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48ee960c38f4d0584ea5ce34579279f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a957b6585e74a31b5bc5f66441c33e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:55.237065 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f8d78439-e8a7-4ee1-a45a-74a6b608821b tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706" status: 200 len: 1506 microversion: 2.1 time: 0.298991 Aug 31 16:14:55.238446 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2038/4082] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:54 2022] GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706 => generated 1506 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:55.245001 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3b3340cc-d82f-4141-bfc5-51321b4b4ecb tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-944729671", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "41cc840d-a352-47ac-85b3-b767061353cc"}], "security_groups": [{"name": "tempest-securitygroup--432115448"}], "key_name": "tempest-keypair-1037646336", "user_data": "}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:14:55.536373 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-3b3340cc-d82f-4141-bfc5-51321b4b4ecb tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] validate_networks() for [('41cc840d-a352-47ac-85b3-b767061353cc', None, None, None, None, None)] {{(pid=122256) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:14:55.574225 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c87dfe18-9a5f-4f14-ab60-dcba5793ddf4 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860ac4e423cf410d9bbc354c77ba864c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aada201b2fd64fdc81a69f826e7c607b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:55.591808 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c87dfe18-9a5f-4f14-ab60-dcba5793ddf4 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] 10.222.0.61 "GET /compute/v2.1/servers/644d0221-94ca-4873-8fe0-ab72c4d7d68b" status: 200 len: 1355 microversion: 2.1 time: 0.534133 Aug 31 16:14:55.593479 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2045/4083] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:55 2022] GET /compute/v2.1/servers/644d0221-94ca-4873-8fe0-ab72c4d7d68b => generated 1355 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:55.604122 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-751d80e3-56d5-4b98-896f-3e8b89542755 req-a6a52bed-baec-4acb-8b42-e2f7e34d5af5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "644d0221-94ca-4873-8fe0-ab72c4d7d68b", "tag": "baeb1fd4-d97f-4ce2-b2c6-d38018e8c8a1"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:14:55.622041 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-751d80e3-56d5-4b98-896f-3e8b89542755 req-a6a52bed-baec-4acb-8b42-e2f7e34d5af5 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:55.622789 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-751d80e3-56d5-4b98-896f-3e8b89542755 req-a6a52bed-baec-4acb-8b42-e2f7e34d5af5 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:55.624725 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-751d80e3-56d5-4b98-896f-3e8b89542755 req-a6a52bed-baec-4acb-8b42-e2f7e34d5af5 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:55.648165 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-751d80e3-56d5-4b98-896f-3e8b89542755 req-a6a52bed-baec-4acb-8b42-e2f7e34d5af5 service nova] Creating event network-changed:baeb1fd4-d97f-4ce2-b2c6-d38018e8c8a1 for instance 644d0221-94ca-4873-8fe0-ab72c4d7d68b on n-h1-850499-9 Aug 31 16:14:55.656936 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-751d80e3-56d5-4b98-896f-3e8b89542755 req-a6a52bed-baec-4acb-8b42-e2f7e34d5af5 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060962 Aug 31 16:14:55.659420 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2046/4084] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:14:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:14:55.782031 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8b6f23ba-4627-4fb1-b09a-d2729f56fe44 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:55.783111 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8b6f23ba-4627-4fb1-b09a-d2729f56fe44 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] [instance: 1ceba728-a215-4f85-a8c1-9c79311861e1] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:55.795035 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b6f23ba-4627-4fb1-b09a-d2729f56fe44 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:55.795541 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b6f23ba-4627-4fb1-b09a-d2729f56fe44 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:55.796213 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b6f23ba-4627-4fb1-b09a-d2729f56fe44 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:55.796930 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b6f23ba-4627-4fb1-b09a-d2729f56fe44 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:55.798213 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b6f23ba-4627-4fb1-b09a-d2729f56fe44 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:55.799133 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b6f23ba-4627-4fb1-b09a-d2729f56fe44 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:56.135400 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8b6f23ba-4627-4fb1-b09a-d2729f56fe44 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d6eee711fe4194a4db63c801f78561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeac74d3027d4080be26bf3aadab4c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:56.150295 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8b6f23ba-4627-4fb1-b09a-d2729f56fe44 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] 10.222.0.61 "GET /compute/v2.1/servers/1ceba728-a215-4f85-a8c1-9c79311861e1" status: 200 len: 1320 microversion: 2.1 time: 0.371414 Aug 31 16:14:56.152033 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2047/4085] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:55 2022] GET /compute/v2.1/servers/1ceba728-a215-4f85-a8c1-9c79311861e1 => generated 1320 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:56.188725 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-22ac1b4a-a119-442e-b067-701c255cc319 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:56.189889 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-22ac1b4a-a119-442e-b067-701c255cc319 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: d78f1dfc-6152-4180-84be-f6a84b75dbc2] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:56.211674 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-22ac1b4a-a119-442e-b067-701c255cc319 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:56.216591 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-22ac1b4a-a119-442e-b067-701c255cc319 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:56.218309 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-22ac1b4a-a119-442e-b067-701c255cc319 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:56.221655 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-22ac1b4a-a119-442e-b067-701c255cc319 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:56.222364 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-22ac1b4a-a119-442e-b067-701c255cc319 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:56.224025 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-22ac1b4a-a119-442e-b067-701c255cc319 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:56.417214 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-3b3340cc-d82f-4141-bfc5-51321b4b4ecb tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:14:56.417720 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-3b3340cc-d82f-4141-bfc5-51321b4b4ecb tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:14:56.418101 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-3b3340cc-d82f-4141-bfc5-51321b4b4ecb tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:14:56.418512 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-3b3340cc-d82f-4141-bfc5-51321b4b4ecb tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:14:56.418924 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-3b3340cc-d82f-4141-bfc5-51321b4b4ecb tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:14:56.430126 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3b3340cc-d82f-4141-bfc5-51321b4b4ecb tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:56.430902 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3b3340cc-d82f-4141-bfc5-51321b4b4ecb tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:56.431342 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3b3340cc-d82f-4141-bfc5-51321b4b4ecb tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:56.432103 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3b3340cc-d82f-4141-bfc5-51321b4b4ecb tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:56.432565 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3b3340cc-d82f-4141-bfc5-51321b4b4ecb tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:56.432967 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3b3340cc-d82f-4141-bfc5-51321b4b4ecb tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:56.455730 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-3b3340cc-d82f-4141-bfc5-51321b4b4ecb tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Getting quotas for project f8fa87d9431f4253b8425593a2150359. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:14:56.462197 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-3b3340cc-d82f-4141-bfc5-51321b4b4ecb tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Getting quotas for user a105ab564f304fa7a2ceba07418a22bc and project f8fa87d9431f4253b8425593a2150359. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:14:56.483146 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3b3340cc-d82f-4141-bfc5-51321b4b4ecb tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Going to run 1 instances... {{(pid=122256) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:14:56.486573 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3b3340cc-d82f-4141-bfc5-51321b4b4ecb tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:14:56.542844 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3b3340cc-d82f-4141-bfc5-51321b4b4ecb tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.302255 Aug 31 16:14:56.544218 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2039/4086] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:14:55 2022] POST /compute/v2.1/servers => generated 408 bytes in 1305 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:14:56.549844 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-448e2662-5bf2-48c1-92dd-0674ef4c005e tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:56.550455 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-448e2662-5bf2-48c1-92dd-0674ef4c005e tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: e3625fdf-7e50-4ba1-99dc-6ae7473fc706] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:56.557446 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-448e2662-5bf2-48c1-92dd-0674ef4c005e tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:56.558221 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-448e2662-5bf2-48c1-92dd-0674ef4c005e tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:56.558970 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-448e2662-5bf2-48c1-92dd-0674ef4c005e tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:56.560198 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-448e2662-5bf2-48c1-92dd-0674ef4c005e tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:56.560833 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-448e2662-5bf2-48c1-92dd-0674ef4c005e tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:56.561434 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-448e2662-5bf2-48c1-92dd-0674ef4c005e tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:56.573289 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-22ac1b4a-a119-442e-b067-701c255cc319 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:56.585243 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-22ac1b4a-a119-442e-b067-701c255cc319 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/d78f1dfc-6152-4180-84be-f6a84b75dbc2" status: 200 len: 1510 microversion: 2.1 time: 0.431222 Aug 31 16:14:56.585864 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2048/4087] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:56 2022] GET /compute/v2.1/servers/d78f1dfc-6152-4180-84be-f6a84b75dbc2 => generated 1510 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:56.615627 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2f1599e9-15f5-45a5-b107-7915b2c49315 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:56.616690 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2f1599e9-15f5-45a5-b107-7915b2c49315 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:56.733528 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2f1599e9-15f5-45a5-b107-7915b2c49315 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:56.744755 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2f1599e9-15f5-45a5-b107-7915b2c49315 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1238 microversion: 2.1 time: 0.157856 Aug 31 16:14:56.759201 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2049/4088] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:56 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1238 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:56.764581 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c0f15118-ef18-411d-8751-eec465c29532 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:56.764986 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c0f15118-ef18-411d-8751-eec465c29532 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] [instance: 644d0221-94ca-4873-8fe0-ab72c4d7d68b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:56.782158 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c0f15118-ef18-411d-8751-eec465c29532 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:56.783302 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c0f15118-ef18-411d-8751-eec465c29532 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:56.783784 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c0f15118-ef18-411d-8751-eec465c29532 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:56.784512 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c0f15118-ef18-411d-8751-eec465c29532 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:56.784976 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c0f15118-ef18-411d-8751-eec465c29532 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:56.785452 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c0f15118-ef18-411d-8751-eec465c29532 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:56.908147 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-448e2662-5bf2-48c1-92dd-0674ef4c005e tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48ee960c38f4d0584ea5ce34579279f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a957b6585e74a31b5bc5f66441c33e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:56.924620 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-448e2662-5bf2-48c1-92dd-0674ef4c005e tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706" status: 200 len: 1506 microversion: 2.1 time: 0.378920 Aug 31 16:14:56.935595 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2040/4089] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:56 2022] GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706 => generated 1506 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:57.004112 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c0f15118-ef18-411d-8751-eec465c29532 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860ac4e423cf410d9bbc354c77ba864c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aada201b2fd64fdc81a69f826e7c607b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:57.013338 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c0f15118-ef18-411d-8751-eec465c29532 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] 10.222.0.61 "GET /compute/v2.1/servers/644d0221-94ca-4873-8fe0-ab72c4d7d68b" status: 200 len: 1355 microversion: 2.1 time: 0.252929 Aug 31 16:14:57.013929 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2050/4090] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:56 2022] GET /compute/v2.1/servers/644d0221-94ca-4873-8fe0-ab72c4d7d68b => generated 1355 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:57.175541 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-bdee3fc2-2c0b-4b80-bcc0-7ea3728d256f tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:57.176186 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-bdee3fc2-2c0b-4b80-bcc0-7ea3728d256f tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] [instance: 1ceba728-a215-4f85-a8c1-9c79311861e1] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:57.183394 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bdee3fc2-2c0b-4b80-bcc0-7ea3728d256f tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:57.184145 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bdee3fc2-2c0b-4b80-bcc0-7ea3728d256f tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:57.184573 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bdee3fc2-2c0b-4b80-bcc0-7ea3728d256f tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:57.185283 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bdee3fc2-2c0b-4b80-bcc0-7ea3728d256f tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:57.185893 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bdee3fc2-2c0b-4b80-bcc0-7ea3728d256f tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:57.186392 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bdee3fc2-2c0b-4b80-bcc0-7ea3728d256f tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:57.431454 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-bdee3fc2-2c0b-4b80-bcc0-7ea3728d256f tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d6eee711fe4194a4db63c801f78561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeac74d3027d4080be26bf3aadab4c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:57.440370 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-bdee3fc2-2c0b-4b80-bcc0-7ea3728d256f tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] 10.222.0.61 "GET /compute/v2.1/servers/1ceba728-a215-4f85-a8c1-9c79311861e1" status: 200 len: 1508 microversion: 2.1 time: 0.269790 Aug 31 16:14:57.441113 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2041/4091] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:57 2022] GET /compute/v2.1/servers/1ceba728-a215-4f85-a8c1-9c79311861e1 => generated 1508 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:57.461899 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c4fcd8ca-131a-45bc-9b6d-a90bbde30b6f tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:57.462772 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c4fcd8ca-131a-45bc-9b6d-a90bbde30b6f tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] [instance: 1ba6c72d-ec62-431a-908b-484701a473b6] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:57.471715 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c4fcd8ca-131a-45bc-9b6d-a90bbde30b6f tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:57.473043 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c4fcd8ca-131a-45bc-9b6d-a90bbde30b6f tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:57.473695 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c4fcd8ca-131a-45bc-9b6d-a90bbde30b6f tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:57.474616 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c4fcd8ca-131a-45bc-9b6d-a90bbde30b6f tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:57.475261 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c4fcd8ca-131a-45bc-9b6d-a90bbde30b6f tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:57.475723 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c4fcd8ca-131a-45bc-9b6d-a90bbde30b6f tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:57.614010 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d2b66cf5-9d07-473b-8f6c-093d3fbebd11 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:57.614885 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d2b66cf5-9d07-473b-8f6c-093d3fbebd11 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: d78f1dfc-6152-4180-84be-f6a84b75dbc2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:57.620634 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d2b66cf5-9d07-473b-8f6c-093d3fbebd11 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:57.621133 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d2b66cf5-9d07-473b-8f6c-093d3fbebd11 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:57.621575 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d2b66cf5-9d07-473b-8f6c-093d3fbebd11 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:57.622277 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d2b66cf5-9d07-473b-8f6c-093d3fbebd11 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:57.622967 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d2b66cf5-9d07-473b-8f6c-093d3fbebd11 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:57.623399 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d2b66cf5-9d07-473b-8f6c-093d3fbebd11 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:57.840132 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c4fcd8ca-131a-45bc-9b6d-a90bbde30b6f tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d6eee711fe4194a4db63c801f78561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeac74d3027d4080be26bf3aadab4c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:57.848749 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c4fcd8ca-131a-45bc-9b6d-a90bbde30b6f tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] 10.222.0.61 "GET /compute/v2.1/servers/1ba6c72d-ec62-431a-908b-484701a473b6" status: 200 len: 1509 microversion: 2.1 time: 0.390631 Aug 31 16:14:57.863573 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2051/4092] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:57 2022] GET /compute/v2.1/servers/1ba6c72d-ec62-431a-908b-484701a473b6 => generated 1509 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:57.868582 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-5447e2bb-05dd-40d6-8ff9-3246d2731dfd req-5d6cf47a-1c9c-491c-a59e-394458a3f186 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "644d0221-94ca-4873-8fe0-ab72c4d7d68b", "tag": "5c8444dd-5b7e-4108-baa8-a2bcb7f17154"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:14:57.890656 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-5447e2bb-05dd-40d6-8ff9-3246d2731dfd req-5d6cf47a-1c9c-491c-a59e-394458a3f186 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:57.894063 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-5447e2bb-05dd-40d6-8ff9-3246d2731dfd req-5d6cf47a-1c9c-491c-a59e-394458a3f186 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:57.894798 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-5447e2bb-05dd-40d6-8ff9-3246d2731dfd req-5d6cf47a-1c9c-491c-a59e-394458a3f186 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:57.918840 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-5447e2bb-05dd-40d6-8ff9-3246d2731dfd req-5d6cf47a-1c9c-491c-a59e-394458a3f186 service nova] Creating event network-changed:5c8444dd-5b7e-4108-baa8-a2bcb7f17154 for instance 644d0221-94ca-4873-8fe0-ab72c4d7d68b on n-h1-850499-9 Aug 31 16:14:57.925718 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-5447e2bb-05dd-40d6-8ff9-3246d2731dfd req-5d6cf47a-1c9c-491c-a59e-394458a3f186 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060802 Aug 31 16:14:57.926666 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2052/4093] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:14:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:14:57.934007 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-62c15a47-542a-4fee-9f2e-a1aad26aae54 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:57.935029 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-62c15a47-542a-4fee-9f2e-a1aad26aae54 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:57.942346 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-62c15a47-542a-4fee-9f2e-a1aad26aae54 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:57.943277 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-62c15a47-542a-4fee-9f2e-a1aad26aae54 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:57.943870 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-62c15a47-542a-4fee-9f2e-a1aad26aae54 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:57.944692 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-62c15a47-542a-4fee-9f2e-a1aad26aae54 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:57.945233 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-62c15a47-542a-4fee-9f2e-a1aad26aae54 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:57.945730 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-62c15a47-542a-4fee-9f2e-a1aad26aae54 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:57.990282 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d2b66cf5-9d07-473b-8f6c-093d3fbebd11 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:57.999266 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d2b66cf5-9d07-473b-8f6c-093d3fbebd11 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/d78f1dfc-6152-4180-84be-f6a84b75dbc2" status: 200 len: 1510 microversion: 2.1 time: 0.389844 Aug 31 16:14:58.000428 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2042/4094] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:57 2022] GET /compute/v2.1/servers/d78f1dfc-6152-4180-84be-f6a84b75dbc2 => generated 1510 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:14:58.010538 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e81cbf49-2c20-4c21-8a82-52f603594ffc tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:58.012614 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e81cbf49-2c20-4c21-8a82-52f603594ffc tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] [instance: 1ba6c72d-ec62-431a-908b-484701a473b6] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:58.016452 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:14:58.022637 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e81cbf49-2c20-4c21-8a82-52f603594ffc tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:58.023244 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e81cbf49-2c20-4c21-8a82-52f603594ffc tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:58.023931 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e81cbf49-2c20-4c21-8a82-52f603594ffc tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:58.024819 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e81cbf49-2c20-4c21-8a82-52f603594ffc tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:58.025396 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e81cbf49-2c20-4c21-8a82-52f603594ffc tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:58.025992 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e81cbf49-2c20-4c21-8a82-52f603594ffc tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:58.050701 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-62c15a47-542a-4fee-9f2e-a1aad26aae54 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:58.059875 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-62c15a47-542a-4fee-9f2e-a1aad26aae54 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1290 microversion: 2.1 time: 0.131418 Aug 31 16:14:58.060923 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2053/4095] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:57 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1290 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:58.066639 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1f82ffb6-3c78-43b9-af47-849f5d2dc508 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:58.067950 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1f82ffb6-3c78-43b9-af47-849f5d2dc508 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: e3625fdf-7e50-4ba1-99dc-6ae7473fc706] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:58.074465 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1f82ffb6-3c78-43b9-af47-849f5d2dc508 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:58.075664 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1f82ffb6-3c78-43b9-af47-849f5d2dc508 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:58.076614 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1f82ffb6-3c78-43b9-af47-849f5d2dc508 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:58.077705 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1f82ffb6-3c78-43b9-af47-849f5d2dc508 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:58.078405 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1f82ffb6-3c78-43b9-af47-849f5d2dc508 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:58.080368 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1f82ffb6-3c78-43b9-af47-849f5d2dc508 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:58.102987 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e81cbf49-2c20-4c21-8a82-52f603594ffc tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] [instance: 1ba6c72d-ec62-431a-908b-484701a473b6] Going to try to terminate instance {{(pid=122256) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:14:58.245443 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e81cbf49-2c20-4c21-8a82-52f603594ffc tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] 10.222.0.61 "DELETE /compute/v2.1/servers/1ba6c72d-ec62-431a-908b-484701a473b6" status: 204 len: 0 microversion: 2.1 time: 0.238894 Aug 31 16:14:58.246064 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2043/4096] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:14:58 2022] DELETE /compute/v2.1/servers/1ba6c72d-ec62-431a-908b-484701a473b6 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:14:58.254149 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b31a3d65-dc22-49e4-a8da-aa4711afe72e tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:58.254856 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b31a3d65-dc22-49e4-a8da-aa4711afe72e tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] [instance: 644d0221-94ca-4873-8fe0-ab72c4d7d68b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:58.263983 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b31a3d65-dc22-49e4-a8da-aa4711afe72e tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:58.264772 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b31a3d65-dc22-49e4-a8da-aa4711afe72e tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:58.265321 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b31a3d65-dc22-49e4-a8da-aa4711afe72e tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:58.267727 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b31a3d65-dc22-49e4-a8da-aa4711afe72e tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:58.268566 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b31a3d65-dc22-49e4-a8da-aa4711afe72e tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:58.269326 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b31a3d65-dc22-49e4-a8da-aa4711afe72e tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:58.415589 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-1f82ffb6-3c78-43b9-af47-849f5d2dc508 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48ee960c38f4d0584ea5ce34579279f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a957b6585e74a31b5bc5f66441c33e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:58.436832 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1f82ffb6-3c78-43b9-af47-849f5d2dc508 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706" status: 200 len: 1506 microversion: 2.1 time: 0.373356 Aug 31 16:14:58.441269 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2054/4097] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:58 2022] GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706 => generated 1506 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:58.447805 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-22072126-6b72-43cd-ba4a-42423a31d1c7 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:58.448524 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-22072126-6b72-43cd-ba4a-42423a31d1c7 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] [instance: 1ceba728-a215-4f85-a8c1-9c79311861e1] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:58.459755 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-22072126-6b72-43cd-ba4a-42423a31d1c7 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:58.460469 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-22072126-6b72-43cd-ba4a-42423a31d1c7 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:58.461089 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-22072126-6b72-43cd-ba4a-42423a31d1c7 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:58.462021 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-22072126-6b72-43cd-ba4a-42423a31d1c7 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:58.462484 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-22072126-6b72-43cd-ba4a-42423a31d1c7 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:58.462910 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-22072126-6b72-43cd-ba4a-42423a31d1c7 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:58.497281 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-22072126-6b72-43cd-ba4a-42423a31d1c7 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] [instance: 1ceba728-a215-4f85-a8c1-9c79311861e1] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:14:58.577728 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b31a3d65-dc22-49e4-a8da-aa4711afe72e tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860ac4e423cf410d9bbc354c77ba864c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aada201b2fd64fdc81a69f826e7c607b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:58.587138 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b31a3d65-dc22-49e4-a8da-aa4711afe72e tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] 10.222.0.61 "GET /compute/v2.1/servers/644d0221-94ca-4873-8fe0-ab72c4d7d68b" status: 200 len: 1355 microversion: 2.1 time: 0.339581 Aug 31 16:14:58.588145 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2044/4098] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:58 2022] GET /compute/v2.1/servers/644d0221-94ca-4873-8fe0-ab72c4d7d68b => generated 1355 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:58.595227 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-22072126-6b72-43cd-ba4a-42423a31d1c7 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] 10.222.0.61 "DELETE /compute/v2.1/servers/1ceba728-a215-4f85-a8c1-9c79311861e1" status: 204 len: 0 microversion: 2.1 time: 0.150887 Aug 31 16:14:58.596942 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2055/4099] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:14:58 2022] DELETE /compute/v2.1/servers/1ceba728-a215-4f85-a8c1-9c79311861e1 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:14:58.744388 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-23adf346-cf80-4638-9253-66708150b2c4 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-1798447320", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "f2a143f1-c524-416f-955a-6b4a048e42a7"}]}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:14:58.811949 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-23adf346-cf80-4638-9253-66708150b2c4 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] validate_networks() for [('f2a143f1-c524-416f-955a-6b4a048e42a7', None, None, None, None, None)] {{(pid=122256) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:14:59.023919 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4bf8a2d2-9df3-4016-bc2a-8b60df8bc5b0 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:59.025046 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4bf8a2d2-9df3-4016-bc2a-8b60df8bc5b0 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: d78f1dfc-6152-4180-84be-f6a84b75dbc2] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:59.031411 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4bf8a2d2-9df3-4016-bc2a-8b60df8bc5b0 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:59.032632 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4bf8a2d2-9df3-4016-bc2a-8b60df8bc5b0 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:59.033704 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4bf8a2d2-9df3-4016-bc2a-8b60df8bc5b0 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:59.034593 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4bf8a2d2-9df3-4016-bc2a-8b60df8bc5b0 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:59.035674 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4bf8a2d2-9df3-4016-bc2a-8b60df8bc5b0 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:59.036199 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4bf8a2d2-9df3-4016-bc2a-8b60df8bc5b0 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:59.732445 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-4bf8a2d2-9df3-4016-bc2a-8b60df8bc5b0 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:59.738920 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:14:59.748802 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4bf8a2d2-9df3-4016-bc2a-8b60df8bc5b0 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/d78f1dfc-6152-4180-84be-f6a84b75dbc2" status: 200 len: 1510 microversion: 2.1 time: 0.729341 Aug 31 16:14:59.763525 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2056/4100] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:59 2022] GET /compute/v2.1/servers/d78f1dfc-6152-4180-84be-f6a84b75dbc2 => generated 1510 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:59.763525 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-85738766-8085-45a6-be08-30974590ebe6 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:59.763525 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-85738766-8085-45a6-be08-30974590ebe6 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:59.774027 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-85738766-8085-45a6-be08-30974590ebe6 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:59.774942 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-85738766-8085-45a6-be08-30974590ebe6 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:59.775448 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-85738766-8085-45a6-be08-30974590ebe6 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:59.776192 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-85738766-8085-45a6-be08-30974590ebe6 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:59.776840 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-85738766-8085-45a6-be08-30974590ebe6 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:59.777267 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-85738766-8085-45a6-be08-30974590ebe6 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:59.940330 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-85738766-8085-45a6-be08-30974590ebe6 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:59.949707 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-85738766-8085-45a6-be08-30974590ebe6 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1298 microversion: 2.1 time: 0.198161 Aug 31 16:14:59.950910 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2057/4101] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:59 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1298 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:59.956907 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-521d1334-f113-4557-b948-94a09ae1ff4d tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:59.957523 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-521d1334-f113-4557-b948-94a09ae1ff4d tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: e3625fdf-7e50-4ba1-99dc-6ae7473fc706] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:59.963041 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:14:59.965453 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-521d1334-f113-4557-b948-94a09ae1ff4d tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:59.965955 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-521d1334-f113-4557-b948-94a09ae1ff4d tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:59.966395 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-521d1334-f113-4557-b948-94a09ae1ff4d tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:59.967543 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-521d1334-f113-4557-b948-94a09ae1ff4d tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:59.967681 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-521d1334-f113-4557-b948-94a09ae1ff4d tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:59.968028 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-521d1334-f113-4557-b948-94a09ae1ff4d tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:59.995295 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-23adf346-cf80-4638-9253-66708150b2c4 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:14:59.996659 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-23adf346-cf80-4638-9253-66708150b2c4 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:14:59.997396 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-23adf346-cf80-4638-9253-66708150b2c4 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:14:59.997969 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-23adf346-cf80-4638-9253-66708150b2c4 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:14:59.998667 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-23adf346-cf80-4638-9253-66708150b2c4 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:15:00.026749 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-23adf346-cf80-4638-9253-66708150b2c4 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:00.027855 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-23adf346-cf80-4638-9253-66708150b2c4 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:00.028522 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-23adf346-cf80-4638-9253-66708150b2c4 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:00.029721 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-23adf346-cf80-4638-9253-66708150b2c4 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:00.030372 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-23adf346-cf80-4638-9253-66708150b2c4 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:00.030955 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-23adf346-cf80-4638-9253-66708150b2c4 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:00.088358 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-23adf346-cf80-4638-9253-66708150b2c4 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Getting quotas for project eeac74d3027d4080be26bf3aadab4c0a. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:15:00.098024 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-23adf346-cf80-4638-9253-66708150b2c4 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Getting quotas for user 07d6eee711fe4194a4db63c801f78561 and project eeac74d3027d4080be26bf3aadab4c0a. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:15:00.115403 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-23adf346-cf80-4638-9253-66708150b2c4 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Going to run 2 instances... {{(pid=122256) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:15:00.119934 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-23adf346-cf80-4638-9253-66708150b2c4 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] [instance: cc727258-60c5-45b0-8c8c-179f621f6732] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:15:00.162287 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-23adf346-cf80-4638-9253-66708150b2c4 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] [instance: 64136c5d-b1e6-4263-a450-3308b0b4f69b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=cc727258-60c5-45b0-8c8c-179f621f6732,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:15:00.210949 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-521d1334-f113-4557-b948-94a09ae1ff4d tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48ee960c38f4d0584ea5ce34579279f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a957b6585e74a31b5bc5f66441c33e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:00.224960 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-521d1334-f113-4557-b948-94a09ae1ff4d tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706" status: 200 len: 1506 microversion: 2.1 time: 0.272561 Aug 31 16:15:00.225552 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2058/4102] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:59 2022] GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706 => generated 1506 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:00.231461 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-13d062c7-1354-4a21-b0bb-b21fb730dc01 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:00.232404 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-13d062c7-1354-4a21-b0bb-b21fb730dc01 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] [instance: 644d0221-94ca-4873-8fe0-ab72c4d7d68b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:00.239254 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-13d062c7-1354-4a21-b0bb-b21fb730dc01 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:00.240026 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-13d062c7-1354-4a21-b0bb-b21fb730dc01 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:00.240679 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-13d062c7-1354-4a21-b0bb-b21fb730dc01 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:00.241598 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-13d062c7-1354-4a21-b0bb-b21fb730dc01 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:00.242121 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-23adf346-cf80-4638-9253-66708150b2c4 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.501594 Aug 31 16:15:00.242441 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-13d062c7-1354-4a21-b0bb-b21fb730dc01 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:00.243042 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-13d062c7-1354-4a21-b0bb-b21fb730dc01 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:00.243178 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2045/4103] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:14:58 2022] POST /compute/v2.1/servers => generated 32 bytes in 1503 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 31 16:15:00.253607 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-82f3beec-b226-4ffc-8d0a-a5a4f12c6ca0 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:00.258833 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-82f3beec-b226-4ffc-8d0a-a5a4f12c6ca0 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '07d6eee711fe4194a4db63c801f78561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeac74d3027d4080be26bf3aadab4c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:00.259899 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-82f3beec-b226-4ffc-8d0a-a5a4f12c6ca0 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Searching by: {'deleted': False, 'project_id': 'eeac74d3027d4080be26bf3aadab4c0a'} {{(pid=122256) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 16:15:00.284997 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-82f3beec-b226-4ffc-8d0a-a5a4f12c6ca0 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:00.285848 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-82f3beec-b226-4ffc-8d0a-a5a4f12c6ca0 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:00.286510 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-82f3beec-b226-4ffc-8d0a-a5a4f12c6ca0 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:00.287488 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-82f3beec-b226-4ffc-8d0a-a5a4f12c6ca0 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:00.288038 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-82f3beec-b226-4ffc-8d0a-a5a4f12c6ca0 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:00.288529 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-82f3beec-b226-4ffc-8d0a-a5a4f12c6ca0 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:00.321730 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.multi_cell_list [None req-82f3beec-b226-4ffc-8d0a-a5a4f12c6ca0 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=122256) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 31 16:15:00.357692 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-82f3beec-b226-4ffc-8d0a-a5a4f12c6ca0 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] 10.222.0.61 "GET /compute/v2.1/servers" status: 200 len: 1337 microversion: 2.1 time: 0.109210 Aug 31 16:15:00.366735 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2046/4104] 10.222.0.61 () {58 vars in 1125 bytes} [Wed Aug 31 16:15:00 2022] GET /compute/v2.1/servers => generated 1337 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:00.373018 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2924d0cd-1cc5-469e-8ce3-6772a75fb2e3 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:00.373688 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2924d0cd-1cc5-469e-8ce3-6772a75fb2e3 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] [instance: 64136c5d-b1e6-4263-a450-3308b0b4f69b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:00.541831 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-2924d0cd-1cc5-469e-8ce3-6772a75fb2e3 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d6eee711fe4194a4db63c801f78561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeac74d3027d4080be26bf3aadab4c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:00.575889 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2924d0cd-1cc5-469e-8ce3-6772a75fb2e3 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] 10.222.0.61 "GET /compute/v2.1/servers/64136c5d-b1e6-4263-a450-3308b0b4f69b" status: 200 len: 1218 microversion: 2.1 time: 0.183539 Aug 31 16:15:00.578270 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2047/4105] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:00 2022] GET /compute/v2.1/servers/64136c5d-b1e6-4263-a450-3308b0b4f69b => generated 1218 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:00.685082 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-13d062c7-1354-4a21-b0bb-b21fb730dc01 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860ac4e423cf410d9bbc354c77ba864c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aada201b2fd64fdc81a69f826e7c607b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:00.704740 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-13d062c7-1354-4a21-b0bb-b21fb730dc01 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] 10.222.0.61 "GET /compute/v2.1/servers/644d0221-94ca-4873-8fe0-ab72c4d7d68b" status: 200 len: 1355 microversion: 2.1 time: 0.476158 Aug 31 16:15:00.707124 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2059/4106] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:00 2022] GET /compute/v2.1/servers/644d0221-94ca-4873-8fe0-ab72c4d7d68b => generated 1355 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:00.772217 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c8f32aeb-cdf4-4072-9cd8-507cfc255f55 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:00.773424 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c8f32aeb-cdf4-4072-9cd8-507cfc255f55 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: d78f1dfc-6152-4180-84be-f6a84b75dbc2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:00.780247 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c8f32aeb-cdf4-4072-9cd8-507cfc255f55 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:00.781203 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c8f32aeb-cdf4-4072-9cd8-507cfc255f55 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:00.781726 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c8f32aeb-cdf4-4072-9cd8-507cfc255f55 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:00.783936 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c8f32aeb-cdf4-4072-9cd8-507cfc255f55 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:00.784610 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c8f32aeb-cdf4-4072-9cd8-507cfc255f55 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:00.787629 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c8f32aeb-cdf4-4072-9cd8-507cfc255f55 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:00.968065 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c8f32aeb-cdf4-4072-9cd8-507cfc255f55 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:00.972789 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-125cb213-f883-44d8-bca8-5ddf7de45995 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:00.973410 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-125cb213-f883-44d8-bca8-5ddf7de45995 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:00.978460 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c8f32aeb-cdf4-4072-9cd8-507cfc255f55 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/d78f1dfc-6152-4180-84be-f6a84b75dbc2" status: 200 len: 1510 microversion: 2.1 time: 0.210340 Aug 31 16:15:00.979372 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2048/4107] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:00 2022] GET /compute/v2.1/servers/d78f1dfc-6152-4180-84be-f6a84b75dbc2 => generated 1510 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:00.986112 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-125cb213-f883-44d8-bca8-5ddf7de45995 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:00.986527 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-125cb213-f883-44d8-bca8-5ddf7de45995 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:00.986964 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-125cb213-f883-44d8-bca8-5ddf7de45995 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:00.987704 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-125cb213-f883-44d8-bca8-5ddf7de45995 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:00.988350 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-125cb213-f883-44d8-bca8-5ddf7de45995 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:00.988778 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-125cb213-f883-44d8-bca8-5ddf7de45995 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:01.056633 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-125cb213-f883-44d8-bca8-5ddf7de45995 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:01.073952 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-125cb213-f883-44d8-bca8-5ddf7de45995 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1296 microversion: 2.1 time: 0.097607 Aug 31 16:15:01.075080 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2060/4108] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:00 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1296 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:01.250761 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2257d713-b571-4de4-a75b-6c7398606b06 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:01.253090 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2257d713-b571-4de4-a75b-6c7398606b06 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: e3625fdf-7e50-4ba1-99dc-6ae7473fc706] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:01.262876 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2257d713-b571-4de4-a75b-6c7398606b06 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:01.264003 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2257d713-b571-4de4-a75b-6c7398606b06 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:01.264665 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2257d713-b571-4de4-a75b-6c7398606b06 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:01.266749 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2257d713-b571-4de4-a75b-6c7398606b06 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:01.267446 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2257d713-b571-4de4-a75b-6c7398606b06 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:01.268122 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2257d713-b571-4de4-a75b-6c7398606b06 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:01.576173 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-2257d713-b571-4de4-a75b-6c7398606b06 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48ee960c38f4d0584ea5ce34579279f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a957b6585e74a31b5bc5f66441c33e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:01.592783 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2257d713-b571-4de4-a75b-6c7398606b06 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706" status: 200 len: 1506 microversion: 2.1 time: 0.348871 Aug 31 16:15:01.594616 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2049/4109] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:01 2022] GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706 => generated 1506 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:01.604422 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-24f762fd-fc80-4da5-9222-a609cafa161e tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:01.605207 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-24f762fd-fc80-4da5-9222-a609cafa161e tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] [instance: 64136c5d-b1e6-4263-a450-3308b0b4f69b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:01.632399 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-24f762fd-fc80-4da5-9222-a609cafa161e tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:01.632902 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-24f762fd-fc80-4da5-9222-a609cafa161e tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:01.643544 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-24f762fd-fc80-4da5-9222-a609cafa161e tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:01.644612 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-24f762fd-fc80-4da5-9222-a609cafa161e tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:01.648250 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-24f762fd-fc80-4da5-9222-a609cafa161e tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:01.649812 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-24f762fd-fc80-4da5-9222-a609cafa161e tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:01.731711 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-83f88875-c251-4676-8573-62c4938e23fc tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:01.732730 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-83f88875-c251-4676-8573-62c4938e23fc tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] [instance: 644d0221-94ca-4873-8fe0-ab72c4d7d68b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:01.745979 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-83f88875-c251-4676-8573-62c4938e23fc tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:01.751575 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-83f88875-c251-4676-8573-62c4938e23fc tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:01.753823 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-83f88875-c251-4676-8573-62c4938e23fc tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:01.756744 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-83f88875-c251-4676-8573-62c4938e23fc tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:01.758685 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-83f88875-c251-4676-8573-62c4938e23fc tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:01.763441 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-83f88875-c251-4676-8573-62c4938e23fc tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:01.851358 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-24f762fd-fc80-4da5-9222-a609cafa161e tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d6eee711fe4194a4db63c801f78561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeac74d3027d4080be26bf3aadab4c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:01.868402 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-24f762fd-fc80-4da5-9222-a609cafa161e tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] 10.222.0.61 "GET /compute/v2.1/servers/64136c5d-b1e6-4263-a450-3308b0b4f69b" status: 200 len: 1270 microversion: 2.1 time: 0.269643 Aug 31 16:15:01.869012 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2061/4110] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:01 2022] GET /compute/v2.1/servers/64136c5d-b1e6-4263-a450-3308b0b4f69b => generated 1270 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:02.002429 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8431d87c-cf25-4bbb-a8b4-db0270b2e923 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:02.003228 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8431d87c-cf25-4bbb-a8b4-db0270b2e923 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: d78f1dfc-6152-4180-84be-f6a84b75dbc2] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:02.010879 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8431d87c-cf25-4bbb-a8b4-db0270b2e923 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:02.012007 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8431d87c-cf25-4bbb-a8b4-db0270b2e923 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:02.013172 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8431d87c-cf25-4bbb-a8b4-db0270b2e923 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:02.014468 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8431d87c-cf25-4bbb-a8b4-db0270b2e923 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:02.015811 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8431d87c-cf25-4bbb-a8b4-db0270b2e923 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:02.018193 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8431d87c-cf25-4bbb-a8b4-db0270b2e923 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:02.411383 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-83f88875-c251-4676-8573-62c4938e23fc tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860ac4e423cf410d9bbc354c77ba864c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aada201b2fd64fdc81a69f826e7c607b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:02.429094 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-83f88875-c251-4676-8573-62c4938e23fc tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] 10.222.0.61 "GET /compute/v2.1/servers/644d0221-94ca-4873-8fe0-ab72c4d7d68b" status: 200 len: 1355 microversion: 2.1 time: 0.698459 Aug 31 16:15:02.430213 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2050/4111] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:01 2022] GET /compute/v2.1/servers/644d0221-94ca-4873-8fe0-ab72c4d7d68b => generated 1355 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:15:02.461326 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3d329787-b4ad-401b-82a6-8e36cfdadb8e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:02.462656 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3d329787-b4ad-401b-82a6-8e36cfdadb8e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:02.489272 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3d329787-b4ad-401b-82a6-8e36cfdadb8e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:02.496685 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3d329787-b4ad-401b-82a6-8e36cfdadb8e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:02.498913 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3d329787-b4ad-401b-82a6-8e36cfdadb8e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:02.506988 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3d329787-b4ad-401b-82a6-8e36cfdadb8e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:02.507881 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3d329787-b4ad-401b-82a6-8e36cfdadb8e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:02.509154 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3d329787-b4ad-401b-82a6-8e36cfdadb8e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:02.659298 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3d329787-b4ad-401b-82a6-8e36cfdadb8e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:02.693374 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3d329787-b4ad-401b-82a6-8e36cfdadb8e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1296 microversion: 2.1 time: 0.261565 Aug 31 16:15:02.693962 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2051/4112] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:02 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1296 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:02.726526 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-bfa759ff-5325-4f9a-af41-077e90a76608 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:02.727626 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-bfa759ff-5325-4f9a-af41-077e90a76608 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: e3625fdf-7e50-4ba1-99dc-6ae7473fc706] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:02.739319 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8431d87c-cf25-4bbb-a8b4-db0270b2e923 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:02.756614 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8431d87c-cf25-4bbb-a8b4-db0270b2e923 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/d78f1dfc-6152-4180-84be-f6a84b75dbc2" status: 200 len: 1510 microversion: 2.1 time: 0.753425 Aug 31 16:15:02.757904 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2062/4113] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:01 2022] GET /compute/v2.1/servers/d78f1dfc-6152-4180-84be-f6a84b75dbc2 => generated 1510 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:02.772484 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bfa759ff-5325-4f9a-af41-077e90a76608 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:02.773257 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bfa759ff-5325-4f9a-af41-077e90a76608 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:02.773994 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bfa759ff-5325-4f9a-af41-077e90a76608 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:02.774897 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bfa759ff-5325-4f9a-af41-077e90a76608 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:02.776818 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bfa759ff-5325-4f9a-af41-077e90a76608 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:02.777956 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bfa759ff-5325-4f9a-af41-077e90a76608 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:02.892887 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-282cf16d-22b7-4156-a357-30cfd52b5bd0 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:02.893350 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-282cf16d-22b7-4156-a357-30cfd52b5bd0 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] [instance: 64136c5d-b1e6-4263-a450-3308b0b4f69b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:02.915345 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-282cf16d-22b7-4156-a357-30cfd52b5bd0 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:02.916176 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-282cf16d-22b7-4156-a357-30cfd52b5bd0 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:02.917495 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-282cf16d-22b7-4156-a357-30cfd52b5bd0 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:02.918546 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-282cf16d-22b7-4156-a357-30cfd52b5bd0 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:02.924414 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-282cf16d-22b7-4156-a357-30cfd52b5bd0 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:02.925111 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-282cf16d-22b7-4156-a357-30cfd52b5bd0 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:03.234403 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-282cf16d-22b7-4156-a357-30cfd52b5bd0 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d6eee711fe4194a4db63c801f78561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeac74d3027d4080be26bf3aadab4c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:03.248183 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-282cf16d-22b7-4156-a357-30cfd52b5bd0 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] 10.222.0.61 "GET /compute/v2.1/servers/64136c5d-b1e6-4263-a450-3308b0b4f69b" status: 200 len: 1278 microversion: 2.1 time: 0.359846 Aug 31 16:15:03.252648 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2063/4114] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:02 2022] GET /compute/v2.1/servers/64136c5d-b1e6-4263-a450-3308b0b4f69b => generated 1278 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:03.264559 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-acd70f3b-a9a7-46af-a718-ea3127df9c24 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:15:03.303238 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-acd70f3b-a9a7-46af-a718-ea3127df9c24 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:03.305488 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-acd70f3b-a9a7-46af-a718-ea3127df9c24 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:03.306000 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-acd70f3b-a9a7-46af-a718-ea3127df9c24 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:03.363555 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-acd70f3b-a9a7-46af-a718-ea3127df9c24 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] [instance: f04eb48d-000e-4c3b-8799-a4d3cdacf0e2] Going to try to stop instance {{(pid=122257) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 31 16:15:03.498952 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-acd70f3b-a9a7-46af-a718-ea3127df9c24 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] 10.222.0.61 "POST /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2/action" status: 202 len: 0 microversion: 2.1 time: 0.242073 Aug 31 16:15:03.500528 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2064/4115] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:15:03 2022] POST /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2/action => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:15:03.513721 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d273efa5-94dc-4033-acd2-7d5c724ff930 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:03.517376 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d273efa5-94dc-4033-acd2-7d5c724ff930 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] [instance: 644d0221-94ca-4873-8fe0-ab72c4d7d68b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:03.541979 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d273efa5-94dc-4033-acd2-7d5c724ff930 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:03.542560 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d273efa5-94dc-4033-acd2-7d5c724ff930 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:03.543019 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d273efa5-94dc-4033-acd2-7d5c724ff930 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:03.543776 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d273efa5-94dc-4033-acd2-7d5c724ff930 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:03.544425 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d273efa5-94dc-4033-acd2-7d5c724ff930 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:03.548729 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d273efa5-94dc-4033-acd2-7d5c724ff930 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:04.054359 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-bfa759ff-5325-4f9a-af41-077e90a76608 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48ee960c38f4d0584ea5ce34579279f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a957b6585e74a31b5bc5f66441c33e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:04.066832 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-bfa759ff-5325-4f9a-af41-077e90a76608 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706" status: 200 len: 1506 microversion: 2.1 time: 1.364560 Aug 31 16:15:04.070278 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2052/4116] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:02 2022] GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706 => generated 1506 bytes in 1376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:04.096872 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-534f6ce2-1f01-492f-9b2e-1df8125c0184 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:04.101109 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-534f6ce2-1f01-492f-9b2e-1df8125c0184 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] [instance: f04eb48d-000e-4c3b-8799-a4d3cdacf0e2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:04.114120 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-534f6ce2-1f01-492f-9b2e-1df8125c0184 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:04.114627 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-534f6ce2-1f01-492f-9b2e-1df8125c0184 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:04.121111 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-534f6ce2-1f01-492f-9b2e-1df8125c0184 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:04.122105 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-534f6ce2-1f01-492f-9b2e-1df8125c0184 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:04.122755 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-534f6ce2-1f01-492f-9b2e-1df8125c0184 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:04.123356 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-534f6ce2-1f01-492f-9b2e-1df8125c0184 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:05.396721 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d273efa5-94dc-4033-acd2-7d5c724ff930 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860ac4e423cf410d9bbc354c77ba864c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aada201b2fd64fdc81a69f826e7c607b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:05.416119 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d273efa5-94dc-4033-acd2-7d5c724ff930 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] 10.222.0.61 "GET /compute/v2.1/servers/644d0221-94ca-4873-8fe0-ab72c4d7d68b" status: 200 len: 1355 microversion: 2.1 time: 1.913456 Aug 31 16:15:05.428521 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2065/4117] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:03 2022] GET /compute/v2.1/servers/644d0221-94ca-4873-8fe0-ab72c4d7d68b => generated 1355 bytes in 1927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:05.446334 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-db16cc86-fc44-4773-aef9-679c7989dbca tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:05.450839 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-db16cc86-fc44-4773-aef9-679c7989dbca tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:05.478543 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-db16cc86-fc44-4773-aef9-679c7989dbca tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:05.480333 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-db16cc86-fc44-4773-aef9-679c7989dbca tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:05.481462 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-db16cc86-fc44-4773-aef9-679c7989dbca tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:05.482404 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-db16cc86-fc44-4773-aef9-679c7989dbca tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:05.483054 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-db16cc86-fc44-4773-aef9-679c7989dbca tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:05.483745 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-db16cc86-fc44-4773-aef9-679c7989dbca tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:05.501531 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-534f6ce2-1f01-492f-9b2e-1df8125c0184 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed06378eb9b446680b5a3156a14941d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511432a7dee4bec9d1093c9d95b3734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:05.517331 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-534f6ce2-1f01-492f-9b2e-1df8125c0184 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] 10.222.0.61 "GET /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2" status: 200 len: 1722 microversion: 2.1 time: 1.430652 Aug 31 16:15:05.527386 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2053/4118] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:04 2022] GET /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2 => generated 1722 bytes in 1457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:05.533126 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f9991b84-dc4d-44f7-a012-8ca91068f7aa tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:05.534297 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f9991b84-dc4d-44f7-a012-8ca91068f7aa tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: d78f1dfc-6152-4180-84be-f6a84b75dbc2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:05.550299 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f9991b84-dc4d-44f7-a012-8ca91068f7aa tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:05.551636 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f9991b84-dc4d-44f7-a012-8ca91068f7aa tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:05.553400 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f9991b84-dc4d-44f7-a012-8ca91068f7aa tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:05.554156 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f9991b84-dc4d-44f7-a012-8ca91068f7aa tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:05.554627 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f9991b84-dc4d-44f7-a012-8ca91068f7aa tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:05.555058 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f9991b84-dc4d-44f7-a012-8ca91068f7aa tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:06.118685 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-db16cc86-fc44-4773-aef9-679c7989dbca tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:06.127160 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-db16cc86-fc44-4773-aef9-679c7989dbca tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1363 microversion: 2.1 time: 0.697090 Aug 31 16:15:06.134040 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2066/4119] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:05 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1363 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:06.139227 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-7a04ccb2-d185-4a7e-9fe1-0a35c29311dc req-a650496d-de94-4d39-94bd-7e8bed51be88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ceba728-a215-4f85-a8c1-9c79311861e1", "name": "network-vif-deleted", "tag": "5bf874cc-d939-4c79-b6fd-ad858ba41246"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:15:06.153087 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-7a04ccb2-d185-4a7e-9fe1-0a35c29311dc req-a650496d-de94-4d39-94bd-7e8bed51be88 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:06.153857 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-7a04ccb2-d185-4a7e-9fe1-0a35c29311dc req-a650496d-de94-4d39-94bd-7e8bed51be88 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:06.154480 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-7a04ccb2-d185-4a7e-9fe1-0a35c29311dc req-a650496d-de94-4d39-94bd-7e8bed51be88 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:06.164775 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f9991b84-dc4d-44f7-a012-8ca91068f7aa tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:06.181837 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f9991b84-dc4d-44f7-a012-8ca91068f7aa tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/d78f1dfc-6152-4180-84be-f6a84b75dbc2" status: 200 len: 1487 microversion: 2.1 time: 0.652933 Aug 31 16:15:06.183026 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-7a04ccb2-d185-4a7e-9fe1-0a35c29311dc req-a650496d-de94-4d39-94bd-7e8bed51be88 service nova] Creating event network-vif-deleted:5bf874cc-d939-4c79-b6fd-ad858ba41246 for instance 1ceba728-a215-4f85-a8c1-9c79311861e1 on n-h2-850499-9 Aug 31 16:15:06.186602 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2054/4120] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:05 2022] GET /compute/v2.1/servers/d78f1dfc-6152-4180-84be-f6a84b75dbc2 => generated 1487 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:06.194037 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-033a3e88-6791-463e-b402-644bca45b6ee tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:06.196374 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-033a3e88-6791-463e-b402-644bca45b6ee tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] [instance: 64136c5d-b1e6-4263-a450-3308b0b4f69b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:06.199780 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-7a04ccb2-d185-4a7e-9fe1-0a35c29311dc req-a650496d-de94-4d39-94bd-7e8bed51be88 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063626 Aug 31 16:15:06.200958 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2067/4121] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:15:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:15:06.208286 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-f96ceccf-023a-4e2a-9f80-d83b48a9a90b req-ca41b044-ef40-4680-bb7d-ff1920f71428 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ba6c72d-ec62-431a-908b-484701a473b6", "name": "network-vif-deleted", "tag": "bd74bc62-31c3-4a60-b249-3c3265c49161"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:15:06.229873 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-033a3e88-6791-463e-b402-644bca45b6ee tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:06.230948 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-033a3e88-6791-463e-b402-644bca45b6ee tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:06.231597 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-033a3e88-6791-463e-b402-644bca45b6ee tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:06.232913 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-033a3e88-6791-463e-b402-644bca45b6ee tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:06.233547 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-033a3e88-6791-463e-b402-644bca45b6ee tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:06.234358 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-033a3e88-6791-463e-b402-644bca45b6ee tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:06.258049 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-f96ceccf-023a-4e2a-9f80-d83b48a9a90b req-ca41b044-ef40-4680-bb7d-ff1920f71428 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:06.261585 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-f96ceccf-023a-4e2a-9f80-d83b48a9a90b req-ca41b044-ef40-4680-bb7d-ff1920f71428 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:06.262249 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-f96ceccf-023a-4e2a-9f80-d83b48a9a90b req-ca41b044-ef40-4680-bb7d-ff1920f71428 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:06.300852 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-f96ceccf-023a-4e2a-9f80-d83b48a9a90b req-ca41b044-ef40-4680-bb7d-ff1920f71428 service nova] Creating event network-vif-deleted:bd74bc62-31c3-4a60-b249-3c3265c49161 for instance 1ba6c72d-ec62-431a-908b-484701a473b6 on n-h1-850499-9 Aug 31 16:15:06.306658 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-f96ceccf-023a-4e2a-9f80-d83b48a9a90b req-ca41b044-ef40-4680-bb7d-ff1920f71428 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102859 Aug 31 16:15:06.307876 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2068/4122] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:15:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:15:06.314624 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-fad66937-b68d-4814-abc2-3afc54468a80 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:06.315593 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-fad66937-b68d-4814-abc2-3afc54468a80 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: e3625fdf-7e50-4ba1-99dc-6ae7473fc706] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:06.322776 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fad66937-b68d-4814-abc2-3afc54468a80 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:06.324155 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fad66937-b68d-4814-abc2-3afc54468a80 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:06.324809 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fad66937-b68d-4814-abc2-3afc54468a80 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:06.327200 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fad66937-b68d-4814-abc2-3afc54468a80 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:06.328358 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fad66937-b68d-4814-abc2-3afc54468a80 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:06.329538 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fad66937-b68d-4814-abc2-3afc54468a80 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:06.333086 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:15:06.484544 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-033a3e88-6791-463e-b402-644bca45b6ee tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d6eee711fe4194a4db63c801f78561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeac74d3027d4080be26bf3aadab4c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:06.496621 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-033a3e88-6791-463e-b402-644bca45b6ee tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] 10.222.0.61 "GET /compute/v2.1/servers/64136c5d-b1e6-4263-a450-3308b0b4f69b" status: 200 len: 1276 microversion: 2.1 time: 0.308736 Aug 31 16:15:06.498206 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2055/4123] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:06 2022] GET /compute/v2.1/servers/64136c5d-b1e6-4263-a450-3308b0b4f69b => generated 1276 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:06.695692 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d7c8689d-76fb-42e6-a39b-1e4a5b7f0343 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-702076509", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "networks": [{"uuid": "3a4287aa-151a-44bc-986d-c22141911de9"}]}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:15:06.738612 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:15:06.759661 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-fad66937-b68d-4814-abc2-3afc54468a80 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48ee960c38f4d0584ea5ce34579279f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a957b6585e74a31b5bc5f66441c33e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:06.777266 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-d7c8689d-76fb-42e6-a39b-1e4a5b7f0343 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] validate_networks() for [('3a4287aa-151a-44bc-986d-c22141911de9', None, None, None, None, None)] {{(pid=122256) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:15:06.781764 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-fad66937-b68d-4814-abc2-3afc54468a80 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706" status: 200 len: 1506 microversion: 2.1 time: 0.467869 Aug 31 16:15:06.785824 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2069/4124] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:06 2022] GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706 => generated 1506 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:06.791326 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6fa6d74f-b06c-4b31-ae5f-2af431baee2d tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1131802353"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:15:06.801685 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6fa6d74f-b06c-4b31-ae5f-2af431baee2d tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: d78f1dfc-6152-4180-84be-f6a84b75dbc2] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:06.808848 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6fa6d74f-b06c-4b31-ae5f-2af431baee2d tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:06.809351 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6fa6d74f-b06c-4b31-ae5f-2af431baee2d tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:06.809936 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6fa6d74f-b06c-4b31-ae5f-2af431baee2d tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:06.810676 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6fa6d74f-b06c-4b31-ae5f-2af431baee2d tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:06.811261 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6fa6d74f-b06c-4b31-ae5f-2af431baee2d tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:06.811825 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6fa6d74f-b06c-4b31-ae5f-2af431baee2d tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:06.919879 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6fa6d74f-b06c-4b31-ae5f-2af431baee2d tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "PUT /compute/v2.1/servers/d78f1dfc-6152-4180-84be-f6a84b75dbc2" status: 200 len: 1061 microversion: 2.1 time: 0.132351 Aug 31 16:15:06.928030 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2070/4125] 10.222.0.61 () {60 vars in 1256 bytes} [Wed Aug 31 16:15:06 2022] PUT /compute/v2.1/servers/d78f1dfc-6152-4180-84be-f6a84b75dbc2 => generated 1061 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:06.942665 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c3534d54-5d33-464d-a0eb-b2baff7cbc82 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:06.943298 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c3534d54-5d33-464d-a0eb-b2baff7cbc82 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] [instance: 644d0221-94ca-4873-8fe0-ab72c4d7d68b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:06.950194 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c3534d54-5d33-464d-a0eb-b2baff7cbc82 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:06.950953 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c3534d54-5d33-464d-a0eb-b2baff7cbc82 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:06.952580 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c3534d54-5d33-464d-a0eb-b2baff7cbc82 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:06.953555 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c3534d54-5d33-464d-a0eb-b2baff7cbc82 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:06.955210 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c3534d54-5d33-464d-a0eb-b2baff7cbc82 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:06.955900 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c3534d54-5d33-464d-a0eb-b2baff7cbc82 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:07.505846 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c3534d54-5d33-464d-a0eb-b2baff7cbc82 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860ac4e423cf410d9bbc354c77ba864c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aada201b2fd64fdc81a69f826e7c607b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:07.516003 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c3534d54-5d33-464d-a0eb-b2baff7cbc82 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] 10.222.0.61 "GET /compute/v2.1/servers/644d0221-94ca-4873-8fe0-ab72c4d7d68b" status: 200 len: 1355 microversion: 2.1 time: 0.585415 Aug 31 16:15:07.527308 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2071/4126] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:06 2022] GET /compute/v2.1/servers/644d0221-94ca-4873-8fe0-ab72c4d7d68b => generated 1355 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:07.534722 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2c0040be-e538-4c9c-9412-eb5aad35cd3c tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:07.536607 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2c0040be-e538-4c9c-9412-eb5aad35cd3c tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] [instance: f04eb48d-000e-4c3b-8799-a4d3cdacf0e2] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:07.543368 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2c0040be-e538-4c9c-9412-eb5aad35cd3c tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:07.544122 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2c0040be-e538-4c9c-9412-eb5aad35cd3c tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:07.544660 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2c0040be-e538-4c9c-9412-eb5aad35cd3c tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:07.545725 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2c0040be-e538-4c9c-9412-eb5aad35cd3c tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:07.546201 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2c0040be-e538-4c9c-9412-eb5aad35cd3c tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:07.546754 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2c0040be-e538-4c9c-9412-eb5aad35cd3c tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:08.502489 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2c0040be-e538-4c9c-9412-eb5aad35cd3c tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed06378eb9b446680b5a3156a14941d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511432a7dee4bec9d1093c9d95b3734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:08.518711 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2c0040be-e538-4c9c-9412-eb5aad35cd3c tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] 10.222.0.61 "GET /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2" status: 200 len: 1722 microversion: 2.1 time: 0.989915 Aug 31 16:15:08.536568 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2072/4127] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:07 2022] GET /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2 => generated 1722 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:08.542345 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4a554709-f98d-4278-a52d-9d00687d5713 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:08.543327 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4a554709-f98d-4278-a52d-9d00687d5713 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: d78f1dfc-6152-4180-84be-f6a84b75dbc2] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:08.553047 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4a554709-f98d-4278-a52d-9d00687d5713 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:08.561559 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4a554709-f98d-4278-a52d-9d00687d5713 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:08.563116 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4a554709-f98d-4278-a52d-9d00687d5713 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:08.566927 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4a554709-f98d-4278-a52d-9d00687d5713 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:08.567696 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4a554709-f98d-4278-a52d-9d00687d5713 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:08.568577 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4a554709-f98d-4278-a52d-9d00687d5713 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:08.574864 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:15:08.695928 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-d7c8689d-76fb-42e6-a39b-1e4a5b7f0343 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:15:08.697100 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-d7c8689d-76fb-42e6-a39b-1e4a5b7f0343 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:15:08.697754 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-d7c8689d-76fb-42e6-a39b-1e4a5b7f0343 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:15:08.698429 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-d7c8689d-76fb-42e6-a39b-1e4a5b7f0343 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:15:08.699235 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-d7c8689d-76fb-42e6-a39b-1e4a5b7f0343 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:15:08.710501 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d7c8689d-76fb-42e6-a39b-1e4a5b7f0343 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:08.711303 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d7c8689d-76fb-42e6-a39b-1e4a5b7f0343 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:08.711797 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d7c8689d-76fb-42e6-a39b-1e4a5b7f0343 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:08.712699 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d7c8689d-76fb-42e6-a39b-1e4a5b7f0343 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:08.713286 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d7c8689d-76fb-42e6-a39b-1e4a5b7f0343 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:08.713720 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d7c8689d-76fb-42e6-a39b-1e4a5b7f0343 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:08.735801 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-d7c8689d-76fb-42e6-a39b-1e4a5b7f0343 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Getting quotas for project 62d2222a956a4888967e21647e26b310. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:15:08.743322 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-d7c8689d-76fb-42e6-a39b-1e4a5b7f0343 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Getting quotas for user fb261f2061164b49a8d496b16647dd2c and project 62d2222a956a4888967e21647e26b310. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:15:08.757909 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d7c8689d-76fb-42e6-a39b-1e4a5b7f0343 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Going to run 1 instances... {{(pid=122256) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:15:08.760560 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d7c8689d-76fb-42e6-a39b-1e4a5b7f0343 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: c4ef985e-0861-4c5d-88eb-d8ad053a8f54] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:15:08.816717 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d7c8689d-76fb-42e6-a39b-1e4a5b7f0343 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.317236 Aug 31 16:15:08.818020 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2056/4128] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:15:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 2319 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:15:08.823573 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5812b971-64a1-4ed5-b92c-d65331c980cc tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:08.824522 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5812b971-64a1-4ed5-b92c-d65331c980cc tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:08.832977 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5812b971-64a1-4ed5-b92c-d65331c980cc tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:08.834346 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5812b971-64a1-4ed5-b92c-d65331c980cc tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:08.834771 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5812b971-64a1-4ed5-b92c-d65331c980cc tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:08.835725 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5812b971-64a1-4ed5-b92c-d65331c980cc tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:08.837210 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5812b971-64a1-4ed5-b92c-d65331c980cc tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:08.837655 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5812b971-64a1-4ed5-b92c-d65331c980cc tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:09.102442 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-4a554709-f98d-4278-a52d-9d00687d5713 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:09.115266 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4a554709-f98d-4278-a52d-9d00687d5713 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/d78f1dfc-6152-4180-84be-f6a84b75dbc2" status: 200 len: 1488 microversion: 2.1 time: 0.577029 Aug 31 16:15:09.116932 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2073/4129] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:08 2022] GET /compute/v2.1/servers/d78f1dfc-6152-4180-84be-f6a84b75dbc2 => generated 1488 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:09.123563 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e8cd5c2c-6bdb-475f-b968-55498d71b0df tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:09.124527 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e8cd5c2c-6bdb-475f-b968-55498d71b0df tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] [instance: 64136c5d-b1e6-4263-a450-3308b0b4f69b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:09.137561 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e8cd5c2c-6bdb-475f-b968-55498d71b0df tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:09.137561 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e8cd5c2c-6bdb-475f-b968-55498d71b0df tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:09.139197 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e8cd5c2c-6bdb-475f-b968-55498d71b0df tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:09.140666 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e8cd5c2c-6bdb-475f-b968-55498d71b0df tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:09.140892 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e8cd5c2c-6bdb-475f-b968-55498d71b0df tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:09.141775 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e8cd5c2c-6bdb-475f-b968-55498d71b0df tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:09.525784 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5812b971-64a1-4ed5-b92c-d65331c980cc tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:09.535282 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5812b971-64a1-4ed5-b92c-d65331c980cc tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1363 microversion: 2.1 time: 0.715645 Aug 31 16:15:09.541803 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2057/4130] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:08 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1363 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:09.541803 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-325581f9-eb0e-43c0-afe0-35a906346d66 req-05d19aac-c506-444b-8175-6032b3a75543 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "644d0221-94ca-4873-8fe0-ab72c4d7d68b", "name": "network-vif-plugged", "status": "completed", "tag": "baeb1fd4-d97f-4ce2-b2c6-d38018e8c8a1"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:15:09.554428 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-325581f9-eb0e-43c0-afe0-35a906346d66 req-05d19aac-c506-444b-8175-6032b3a75543 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:09.554989 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-325581f9-eb0e-43c0-afe0-35a906346d66 req-05d19aac-c506-444b-8175-6032b3a75543 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:09.555529 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-325581f9-eb0e-43c0-afe0-35a906346d66 req-05d19aac-c506-444b-8175-6032b3a75543 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:09.567141 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-325581f9-eb0e-43c0-afe0-35a906346d66 req-05d19aac-c506-444b-8175-6032b3a75543 service nova] Creating event network-vif-plugged:baeb1fd4-d97f-4ce2-b2c6-d38018e8c8a1 for instance 644d0221-94ca-4873-8fe0-ab72c4d7d68b on n-h1-850499-9 Aug 31 16:15:09.573960 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-325581f9-eb0e-43c0-afe0-35a906346d66 req-05d19aac-c506-444b-8175-6032b3a75543 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036529 Aug 31 16:15:09.574658 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2058/4131] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:15:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:15:09.581986 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-200ebc76-fc79-49b2-8042-6ed2dadf8d0c tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:09.582166 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-200ebc76-fc79-49b2-8042-6ed2dadf8d0c tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: e3625fdf-7e50-4ba1-99dc-6ae7473fc706] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:09.588361 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-200ebc76-fc79-49b2-8042-6ed2dadf8d0c tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:09.588855 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-200ebc76-fc79-49b2-8042-6ed2dadf8d0c tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:09.589395 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-200ebc76-fc79-49b2-8042-6ed2dadf8d0c tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:09.590246 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-200ebc76-fc79-49b2-8042-6ed2dadf8d0c tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:09.590727 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-200ebc76-fc79-49b2-8042-6ed2dadf8d0c tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:09.591147 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-200ebc76-fc79-49b2-8042-6ed2dadf8d0c tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:09.759234 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e8cd5c2c-6bdb-475f-b968-55498d71b0df tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d6eee711fe4194a4db63c801f78561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeac74d3027d4080be26bf3aadab4c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:09.768710 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e8cd5c2c-6bdb-475f-b968-55498d71b0df tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] 10.222.0.61 "GET /compute/v2.1/servers/64136c5d-b1e6-4263-a450-3308b0b4f69b" status: 200 len: 1318 microversion: 2.1 time: 0.650415 Aug 31 16:15:09.769593 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2074/4132] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:09 2022] GET /compute/v2.1/servers/64136c5d-b1e6-4263-a450-3308b0b4f69b => generated 1318 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:09.774726 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-bfb7557d-8b75-44cb-b757-7adddc066a8f tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:09.775360 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-bfb7557d-8b75-44cb-b757-7adddc066a8f tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] [instance: 644d0221-94ca-4873-8fe0-ab72c4d7d68b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:09.782600 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bfb7557d-8b75-44cb-b757-7adddc066a8f tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:09.782945 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bfb7557d-8b75-44cb-b757-7adddc066a8f tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:09.784161 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bfb7557d-8b75-44cb-b757-7adddc066a8f tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:09.785423 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bfb7557d-8b75-44cb-b757-7adddc066a8f tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:09.786750 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bfb7557d-8b75-44cb-b757-7adddc066a8f tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:09.787540 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bfb7557d-8b75-44cb-b757-7adddc066a8f tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:10.187751 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-200ebc76-fc79-49b2-8042-6ed2dadf8d0c tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48ee960c38f4d0584ea5ce34579279f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a957b6585e74a31b5bc5f66441c33e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:10.201055 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-200ebc76-fc79-49b2-8042-6ed2dadf8d0c tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706" status: 200 len: 1506 microversion: 2.1 time: 0.624003 Aug 31 16:15:10.201949 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2059/4133] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:09 2022] GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706 => generated 1506 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:10.208864 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-fde4dda1-4da2-4703-afa8-261bf015f303 req-566cbeac-9547-4bc9-b80c-0e69c8a24a10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42ccbb85-9677-4cb9-879a-dc280cda020c", "tag": "44b19fab-a1b0-47af-8c78-4bab130a016b"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:15:10.224906 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-fde4dda1-4da2-4703-afa8-261bf015f303 req-566cbeac-9547-4bc9-b80c-0e69c8a24a10 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:10.225546 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-fde4dda1-4da2-4703-afa8-261bf015f303 req-566cbeac-9547-4bc9-b80c-0e69c8a24a10 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:10.226170 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-fde4dda1-4da2-4703-afa8-261bf015f303 req-566cbeac-9547-4bc9-b80c-0e69c8a24a10 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:10.240965 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-fde4dda1-4da2-4703-afa8-261bf015f303 req-566cbeac-9547-4bc9-b80c-0e69c8a24a10 service nova] Creating event network-changed:44b19fab-a1b0-47af-8c78-4bab130a016b for instance 42ccbb85-9677-4cb9-879a-dc280cda020c on n-h2-850499-9 Aug 31 16:15:10.245977 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-fde4dda1-4da2-4703-afa8-261bf015f303 req-566cbeac-9547-4bc9-b80c-0e69c8a24a10 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042028 Aug 31 16:15:10.246780 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2060/4134] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:15:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:15:10.252858 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-05ee7226-78b0-41a6-b4bc-f51ca21d33c9 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:10.253568 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-05ee7226-78b0-41a6-b4bc-f51ca21d33c9 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: c4ef985e-0861-4c5d-88eb-d8ad053a8f54] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:10.261421 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-05ee7226-78b0-41a6-b4bc-f51ca21d33c9 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:10.262143 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-05ee7226-78b0-41a6-b4bc-f51ca21d33c9 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:10.263071 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-05ee7226-78b0-41a6-b4bc-f51ca21d33c9 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:10.263800 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-05ee7226-78b0-41a6-b4bc-f51ca21d33c9 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:10.264264 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-05ee7226-78b0-41a6-b4bc-f51ca21d33c9 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:10.264692 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-05ee7226-78b0-41a6-b4bc-f51ca21d33c9 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:10.405933 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-bfb7557d-8b75-44cb-b757-7adddc066a8f tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860ac4e423cf410d9bbc354c77ba864c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aada201b2fd64fdc81a69f826e7c607b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:10.415768 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-bfb7557d-8b75-44cb-b757-7adddc066a8f tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] 10.222.0.61 "GET /compute/v2.1/servers/644d0221-94ca-4873-8fe0-ab72c4d7d68b" status: 200 len: 1355 microversion: 2.1 time: 0.644915 Aug 31 16:15:10.428039 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2075/4135] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:09 2022] GET /compute/v2.1/servers/644d0221-94ca-4873-8fe0-ab72c4d7d68b => generated 1355 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:10.435860 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-881da620-431b-4a1e-a7d2-80d03eca0735 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:10.436618 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-881da620-431b-4a1e-a7d2-80d03eca0735 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: d78f1dfc-6152-4180-84be-f6a84b75dbc2] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:10.446013 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-881da620-431b-4a1e-a7d2-80d03eca0735 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:10.446833 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-881da620-431b-4a1e-a7d2-80d03eca0735 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:10.447594 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-881da620-431b-4a1e-a7d2-80d03eca0735 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:10.448751 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-881da620-431b-4a1e-a7d2-80d03eca0735 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:10.449215 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-881da620-431b-4a1e-a7d2-80d03eca0735 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:10.449642 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-881da620-431b-4a1e-a7d2-80d03eca0735 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:10.458535 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-05ee7226-78b0-41a6-b4bc-f51ca21d33c9 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb261f2061164b49a8d496b16647dd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d2222a956a4888967e21647e26b310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:10.467892 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-05ee7226-78b0-41a6-b4bc-f51ca21d33c9 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "GET /compute/v2.1/servers/c4ef985e-0861-4c5d-88eb-d8ad053a8f54" status: 200 len: 1269 microversion: 2.1 time: 0.219901 Aug 31 16:15:10.480161 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2061/4136] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:10 2022] GET /compute/v2.1/servers/c4ef985e-0861-4c5d-88eb-d8ad053a8f54 => generated 1269 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:10.488919 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c598f11d-18dc-49d9-ac5f-3273166e1da3 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:10.489988 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c598f11d-18dc-49d9-ac5f-3273166e1da3 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] [instance: f04eb48d-000e-4c3b-8799-a4d3cdacf0e2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:10.496744 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c598f11d-18dc-49d9-ac5f-3273166e1da3 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:10.497444 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c598f11d-18dc-49d9-ac5f-3273166e1da3 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:10.497924 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c598f11d-18dc-49d9-ac5f-3273166e1da3 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:10.498589 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c598f11d-18dc-49d9-ac5f-3273166e1da3 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:10.499043 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c598f11d-18dc-49d9-ac5f-3273166e1da3 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:10.501110 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c598f11d-18dc-49d9-ac5f-3273166e1da3 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:10.818308 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-881da620-431b-4a1e-a7d2-80d03eca0735 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:10.829082 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c598f11d-18dc-49d9-ac5f-3273166e1da3 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed06378eb9b446680b5a3156a14941d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511432a7dee4bec9d1093c9d95b3734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:10.829957 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-881da620-431b-4a1e-a7d2-80d03eca0735 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/d78f1dfc-6152-4180-84be-f6a84b75dbc2" status: 200 len: 1488 microversion: 2.1 time: 0.400686 Aug 31 16:15:10.831183 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2076/4137] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:10 2022] GET /compute/v2.1/servers/d78f1dfc-6152-4180-84be-f6a84b75dbc2 => generated 1488 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:10.837351 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5979015c-b052-46fc-9066-c60e297b6d3b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:10.838087 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5979015c-b052-46fc-9066-c60e297b6d3b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:10.841640 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c598f11d-18dc-49d9-ac5f-3273166e1da3 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] 10.222.0.61 "GET /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2" status: 200 len: 1722 microversion: 2.1 time: 0.360065 Aug 31 16:15:10.842891 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2062/4138] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:10 2022] GET /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2 => generated 1722 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:10.852326 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-fb6c8954-9026-495f-af6d-ba6bb69479c8 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:10.853231 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-fb6c8954-9026-495f-af6d-ba6bb69479c8 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] [instance: 64136c5d-b1e6-4263-a450-3308b0b4f69b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:10.861179 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5979015c-b052-46fc-9066-c60e297b6d3b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:10.862387 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5979015c-b052-46fc-9066-c60e297b6d3b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:10.863621 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5979015c-b052-46fc-9066-c60e297b6d3b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:10.864666 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fb6c8954-9026-495f-af6d-ba6bb69479c8 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:10.865027 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5979015c-b052-46fc-9066-c60e297b6d3b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:10.865302 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fb6c8954-9026-495f-af6d-ba6bb69479c8 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:10.865760 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fb6c8954-9026-495f-af6d-ba6bb69479c8 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:10.866189 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5979015c-b052-46fc-9066-c60e297b6d3b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:10.866999 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fb6c8954-9026-495f-af6d-ba6bb69479c8 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:10.867275 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5979015c-b052-46fc-9066-c60e297b6d3b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:10.867914 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fb6c8954-9026-495f-af6d-ba6bb69479c8 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:10.868359 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fb6c8954-9026-495f-af6d-ba6bb69479c8 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:11.170379 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-fb6c8954-9026-495f-af6d-ba6bb69479c8 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d6eee711fe4194a4db63c801f78561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeac74d3027d4080be26bf3aadab4c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:11.174937 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5979015c-b052-46fc-9066-c60e297b6d3b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:11.179150 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-fb6c8954-9026-495f-af6d-ba6bb69479c8 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] 10.222.0.61 "GET /compute/v2.1/servers/64136c5d-b1e6-4263-a450-3308b0b4f69b" status: 200 len: 1318 microversion: 2.1 time: 0.334874 Aug 31 16:15:11.179835 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2063/4139] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:10 2022] GET /compute/v2.1/servers/64136c5d-b1e6-4263-a450-3308b0b4f69b => generated 1318 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:11.183399 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5979015c-b052-46fc-9066-c60e297b6d3b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1363 microversion: 2.1 time: 0.350693 Aug 31 16:15:11.189084 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2077/4140] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:10 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1363 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:11.190479 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0a3520d8-c8f3-4442-b828-3592c55cef2d tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:11.191611 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0a3520d8-c8f3-4442-b828-3592c55cef2d tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: d78f1dfc-6152-4180-84be-f6a84b75dbc2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:11.200332 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0a3520d8-c8f3-4442-b828-3592c55cef2d tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:11.200758 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0a3520d8-c8f3-4442-b828-3592c55cef2d tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:11.201197 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0a3520d8-c8f3-4442-b828-3592c55cef2d tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:11.201906 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0a3520d8-c8f3-4442-b828-3592c55cef2d tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:11.202364 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0a3520d8-c8f3-4442-b828-3592c55cef2d tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:11.202787 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0a3520d8-c8f3-4442-b828-3592c55cef2d tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:11.222821 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c63f0296-d1df-4376-ab08-c8cd19bc9cf0 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:11.223793 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c63f0296-d1df-4376-ab08-c8cd19bc9cf0 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: e3625fdf-7e50-4ba1-99dc-6ae7473fc706] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:11.229781 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c63f0296-d1df-4376-ab08-c8cd19bc9cf0 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:11.230272 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c63f0296-d1df-4376-ab08-c8cd19bc9cf0 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:11.230704 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c63f0296-d1df-4376-ab08-c8cd19bc9cf0 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:11.230972 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0a3520d8-c8f3-4442-b828-3592c55cef2d tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: d78f1dfc-6152-4180-84be-f6a84b75dbc2] Going to try to terminate instance {{(pid=122256) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:15:11.231971 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c63f0296-d1df-4376-ab08-c8cd19bc9cf0 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:11.232602 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c63f0296-d1df-4376-ab08-c8cd19bc9cf0 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:11.233199 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c63f0296-d1df-4376-ab08-c8cd19bc9cf0 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:11.352583 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0a3520d8-c8f3-4442-b828-3592c55cef2d tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "DELETE /compute/v2.1/servers/d78f1dfc-6152-4180-84be-f6a84b75dbc2" status: 204 len: 0 microversion: 2.1 time: 0.171012 Aug 31 16:15:11.356819 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2064/4141] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:15:11 2022] DELETE /compute/v2.1/servers/d78f1dfc-6152-4180-84be-f6a84b75dbc2 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:15:11.369567 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9a49c00a-fcfc-43d7-a294-45b22fcfb467 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:11.370810 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9a49c00a-fcfc-43d7-a294-45b22fcfb467 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: d78f1dfc-6152-4180-84be-f6a84b75dbc2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:11.378035 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9a49c00a-fcfc-43d7-a294-45b22fcfb467 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:11.378961 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9a49c00a-fcfc-43d7-a294-45b22fcfb467 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:11.379411 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9a49c00a-fcfc-43d7-a294-45b22fcfb467 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:11.380255 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9a49c00a-fcfc-43d7-a294-45b22fcfb467 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:11.380750 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9a49c00a-fcfc-43d7-a294-45b22fcfb467 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:11.381209 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9a49c00a-fcfc-43d7-a294-45b22fcfb467 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:11.925748 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c63f0296-d1df-4376-ab08-c8cd19bc9cf0 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48ee960c38f4d0584ea5ce34579279f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a957b6585e74a31b5bc5f66441c33e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:11.936780 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c63f0296-d1df-4376-ab08-c8cd19bc9cf0 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706" status: 200 len: 1506 microversion: 2.1 time: 0.717878 Aug 31 16:15:11.952232 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2078/4142] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:11 2022] GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706 => generated 1506 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:15:11.958783 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e901fa31-900a-4a2c-a5c2-ff20e3780f50 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:11.959803 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e901fa31-900a-4a2c-a5c2-ff20e3780f50 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] [instance: 644d0221-94ca-4873-8fe0-ab72c4d7d68b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:11.966333 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e901fa31-900a-4a2c-a5c2-ff20e3780f50 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:11.967295 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e901fa31-900a-4a2c-a5c2-ff20e3780f50 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:11.968046 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e901fa31-900a-4a2c-a5c2-ff20e3780f50 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:11.968997 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e901fa31-900a-4a2c-a5c2-ff20e3780f50 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:11.969980 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e901fa31-900a-4a2c-a5c2-ff20e3780f50 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:11.970627 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e901fa31-900a-4a2c-a5c2-ff20e3780f50 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:11.990084 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-9a49c00a-fcfc-43d7-a294-45b22fcfb467 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:11.999053 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9a49c00a-fcfc-43d7-a294-45b22fcfb467 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/d78f1dfc-6152-4180-84be-f6a84b75dbc2" status: 200 len: 1494 microversion: 2.1 time: 0.640288 Aug 31 16:15:12.001232 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2065/4143] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:11 2022] GET /compute/v2.1/servers/d78f1dfc-6152-4180-84be-f6a84b75dbc2 => generated 1494 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:12.006544 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-185e18c6-0820-49d8-b349-8e64e4567dfb tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:12.007650 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-185e18c6-0820-49d8-b349-8e64e4567dfb tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: c4ef985e-0861-4c5d-88eb-d8ad053a8f54] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:12.030621 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-185e18c6-0820-49d8-b349-8e64e4567dfb tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:12.031245 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-185e18c6-0820-49d8-b349-8e64e4567dfb tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:12.031849 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-185e18c6-0820-49d8-b349-8e64e4567dfb tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:12.032644 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-185e18c6-0820-49d8-b349-8e64e4567dfb tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:12.033340 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-185e18c6-0820-49d8-b349-8e64e4567dfb tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:12.033839 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-185e18c6-0820-49d8-b349-8e64e4567dfb tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:12.309827 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e901fa31-900a-4a2c-a5c2-ff20e3780f50 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860ac4e423cf410d9bbc354c77ba864c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aada201b2fd64fdc81a69f826e7c607b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:12.319375 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e901fa31-900a-4a2c-a5c2-ff20e3780f50 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] 10.222.0.61 "GET /compute/v2.1/servers/644d0221-94ca-4873-8fe0-ab72c4d7d68b" status: 200 len: 1355 microversion: 2.1 time: 0.365422 Aug 31 16:15:12.331790 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2079/4144] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:11 2022] GET /compute/v2.1/servers/644d0221-94ca-4873-8fe0-ab72c4d7d68b => generated 1355 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:12.331790 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-39201837-cb04-4feb-8970-58b25018f659 req-711d5c1d-a44c-4865-8ca4-c99af17222b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "644d0221-94ca-4873-8fe0-ab72c4d7d68b", "name": "network-vif-plugged", "status": "completed", "tag": "427ff9a1-aa4b-4fb5-908e-3122c7b9617d"}, {"server_uuid": "644d0221-94ca-4873-8fe0-ab72c4d7d68b", "name": "network-vif-plugged", "status": "completed", "tag": "5c8444dd-5b7e-4108-baa8-a2bcb7f17154"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:15:12.338390 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-39201837-cb04-4feb-8970-58b25018f659 req-711d5c1d-a44c-4865-8ca4-c99af17222b5 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:12.338966 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-39201837-cb04-4feb-8970-58b25018f659 req-711d5c1d-a44c-4865-8ca4-c99af17222b5 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:12.339474 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-39201837-cb04-4feb-8970-58b25018f659 req-711d5c1d-a44c-4865-8ca4-c99af17222b5 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:12.354663 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-185e18c6-0820-49d8-b349-8e64e4567dfb tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb261f2061164b49a8d496b16647dd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d2222a956a4888967e21647e26b310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:12.355224 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-39201837-cb04-4feb-8970-58b25018f659 req-711d5c1d-a44c-4865-8ca4-c99af17222b5 service nova] Creating event network-vif-plugged:427ff9a1-aa4b-4fb5-908e-3122c7b9617d for instance 644d0221-94ca-4873-8fe0-ab72c4d7d68b on n-h1-850499-9 Aug 31 16:15:12.355389 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-39201837-cb04-4feb-8970-58b25018f659 req-711d5c1d-a44c-4865-8ca4-c99af17222b5 service nova] Creating event network-vif-plugged:5c8444dd-5b7e-4108-baa8-a2bcb7f17154 for instance 644d0221-94ca-4873-8fe0-ab72c4d7d68b on n-h1-850499-9 Aug 31 16:15:12.361986 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-39201837-cb04-4feb-8970-58b25018f659 req-711d5c1d-a44c-4865-8ca4-c99af17222b5 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.040050 Aug 31 16:15:12.362578 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-185e18c6-0820-49d8-b349-8e64e4567dfb tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "GET /compute/v2.1/servers/c4ef985e-0861-4c5d-88eb-d8ad053a8f54" status: 200 len: 1317 microversion: 2.1 time: 0.360034 Aug 31 16:15:12.363446 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2066/4145] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:12 2022] GET /compute/v2.1/servers/c4ef985e-0861-4c5d-88eb-d8ad053a8f54 => generated 1317 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:12.366802 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2080/4146] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:15:12 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:15:12.369775 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8af7bffb-7980-4892-a7ef-c13c04b14a00 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:12.370854 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8af7bffb-7980-4892-a7ef-c13c04b14a00 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] [instance: f04eb48d-000e-4c3b-8799-a4d3cdacf0e2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:12.371915 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-7fea0edf-b0af-4fd9-94e8-d36d2058dcd9 req-619e0a48-64c5-406e-8450-555c34b2ba7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4ef985e-0861-4c5d-88eb-d8ad053a8f54", "tag": "e616625c-3e6f-4ab3-a8fe-75faeba8be2a"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:15:12.378198 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8af7bffb-7980-4892-a7ef-c13c04b14a00 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:12.378772 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8af7bffb-7980-4892-a7ef-c13c04b14a00 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:12.379276 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8af7bffb-7980-4892-a7ef-c13c04b14a00 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:12.380288 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8af7bffb-7980-4892-a7ef-c13c04b14a00 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:12.380968 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8af7bffb-7980-4892-a7ef-c13c04b14a00 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:12.381464 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8af7bffb-7980-4892-a7ef-c13c04b14a00 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:12.383893 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-7fea0edf-b0af-4fd9-94e8-d36d2058dcd9 req-619e0a48-64c5-406e-8450-555c34b2ba7b service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:12.384414 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-7fea0edf-b0af-4fd9-94e8-d36d2058dcd9 req-619e0a48-64c5-406e-8450-555c34b2ba7b service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:12.384855 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-7fea0edf-b0af-4fd9-94e8-d36d2058dcd9 req-619e0a48-64c5-406e-8450-555c34b2ba7b service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:12.404263 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-7fea0edf-b0af-4fd9-94e8-d36d2058dcd9 req-619e0a48-64c5-406e-8450-555c34b2ba7b service nova] Creating event network-changed:e616625c-3e6f-4ab3-a8fe-75faeba8be2a for instance c4ef985e-0861-4c5d-88eb-d8ad053a8f54 on n-h1-850499-9 Aug 31 16:15:12.409544 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-7fea0edf-b0af-4fd9-94e8-d36d2058dcd9 req-619e0a48-64c5-406e-8450-555c34b2ba7b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041364 Aug 31 16:15:12.410173 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2081/4147] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:15:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:15:12.417779 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-007b9325-0371-47a8-a91a-0a98a6f57164 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:12.418489 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-007b9325-0371-47a8-a91a-0a98a6f57164 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] [instance: 64136c5d-b1e6-4263-a450-3308b0b4f69b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:12.425442 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-007b9325-0371-47a8-a91a-0a98a6f57164 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:12.425941 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-007b9325-0371-47a8-a91a-0a98a6f57164 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:12.426384 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-007b9325-0371-47a8-a91a-0a98a6f57164 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:12.427093 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-007b9325-0371-47a8-a91a-0a98a6f57164 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:12.427610 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-007b9325-0371-47a8-a91a-0a98a6f57164 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:12.428045 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-007b9325-0371-47a8-a91a-0a98a6f57164 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:12.626378 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8af7bffb-7980-4892-a7ef-c13c04b14a00 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed06378eb9b446680b5a3156a14941d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511432a7dee4bec9d1093c9d95b3734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:12.634892 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8af7bffb-7980-4892-a7ef-c13c04b14a00 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] 10.222.0.61 "GET /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2" status: 200 len: 1722 microversion: 2.1 time: 0.270134 Aug 31 16:15:12.635489 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2067/4148] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:12 2022] GET /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2 => generated 1722 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:12.643448 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-007b9325-0371-47a8-a91a-0a98a6f57164 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d6eee711fe4194a4db63c801f78561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeac74d3027d4080be26bf3aadab4c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:12.653805 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-007b9325-0371-47a8-a91a-0a98a6f57164 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] 10.222.0.61 "GET /compute/v2.1/servers/64136c5d-b1e6-4263-a450-3308b0b4f69b" status: 200 len: 1318 microversion: 2.1 time: 0.242222 Aug 31 16:15:12.654384 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2082/4149] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:12 2022] GET /compute/v2.1/servers/64136c5d-b1e6-4263-a450-3308b0b4f69b => generated 1318 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:12.656662 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-854cb492-fb4c-4b21-b050-6940eef8acae tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:12.658429 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-854cb492-fb4c-4b21-b050-6940eef8acae tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:12.664175 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-c05459bc-f270-4ab8-b9d1-0ae8b0cd943b req-64789a88-f33c-4bfa-aa64-a67e10b0a175 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64136c5d-b1e6-4263-a450-3308b0b4f69b", "tag": "389d797b-d29f-45f1-8814-cae5984b364d"}, {"name": "network-changed", "server_uuid": "cc727258-60c5-45b0-8c8c-179f621f6732", "tag": "b9e5ca45-edcc-4cac-97b5-859f04131031"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:15:12.675147 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-854cb492-fb4c-4b21-b050-6940eef8acae tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:12.675708 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-854cb492-fb4c-4b21-b050-6940eef8acae tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:12.676151 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-854cb492-fb4c-4b21-b050-6940eef8acae tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:12.676860 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-854cb492-fb4c-4b21-b050-6940eef8acae tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:12.677318 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-854cb492-fb4c-4b21-b050-6940eef8acae tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:12.677621 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-c05459bc-f270-4ab8-b9d1-0ae8b0cd943b req-64789a88-f33c-4bfa-aa64-a67e10b0a175 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:12.677742 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-854cb492-fb4c-4b21-b050-6940eef8acae tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:12.678110 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-c05459bc-f270-4ab8-b9d1-0ae8b0cd943b req-64789a88-f33c-4bfa-aa64-a67e10b0a175 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:12.678549 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-c05459bc-f270-4ab8-b9d1-0ae8b0cd943b req-64789a88-f33c-4bfa-aa64-a67e10b0a175 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:12.691926 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-c05459bc-f270-4ab8-b9d1-0ae8b0cd943b req-64789a88-f33c-4bfa-aa64-a67e10b0a175 service nova] Creating event network-changed:389d797b-d29f-45f1-8814-cae5984b364d for instance 64136c5d-b1e6-4263-a450-3308b0b4f69b on n-h2-850499-9 Aug 31 16:15:12.692450 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-c05459bc-f270-4ab8-b9d1-0ae8b0cd943b req-64789a88-f33c-4bfa-aa64-a67e10b0a175 service nova] Creating event network-changed:b9e5ca45-edcc-4cac-97b5-859f04131031 for instance cc727258-60c5-45b0-8c8c-179f621f6732 on n-h1-850499-9 Aug 31 16:15:12.700686 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-c05459bc-f270-4ab8-b9d1-0ae8b0cd943b req-64789a88-f33c-4bfa-aa64-a67e10b0a175 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.040004 Aug 31 16:15:12.701289 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2083/4150] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:15:12 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:15:12.815981 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-854cb492-fb4c-4b21-b050-6940eef8acae tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:12.823593 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-854cb492-fb4c-4b21-b050-6940eef8acae tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1363 microversion: 2.1 time: 0.176232 Aug 31 16:15:12.824171 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2068/4151] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:12 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1363 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:12.959374 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5830c868-6d43-45c9-9aee-673fb9cde5d7 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:12.960146 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5830c868-6d43-45c9-9aee-673fb9cde5d7 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: e3625fdf-7e50-4ba1-99dc-6ae7473fc706] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:12.966402 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5830c868-6d43-45c9-9aee-673fb9cde5d7 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:12.966883 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5830c868-6d43-45c9-9aee-673fb9cde5d7 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:12.967410 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5830c868-6d43-45c9-9aee-673fb9cde5d7 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:12.968121 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5830c868-6d43-45c9-9aee-673fb9cde5d7 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:12.968576 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5830c868-6d43-45c9-9aee-673fb9cde5d7 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:12.968999 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5830c868-6d43-45c9-9aee-673fb9cde5d7 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:13.022255 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-91663c80-9301-42b5-b93a-c11c0738d56a tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:13.022995 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-91663c80-9301-42b5-b93a-c11c0738d56a tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: d78f1dfc-6152-4180-84be-f6a84b75dbc2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:13.029511 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-91663c80-9301-42b5-b93a-c11c0738d56a tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:13.030009 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-91663c80-9301-42b5-b93a-c11c0738d56a tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:13.030450 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-91663c80-9301-42b5-b93a-c11c0738d56a tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:13.031161 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-91663c80-9301-42b5-b93a-c11c0738d56a tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:13.031655 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-91663c80-9301-42b5-b93a-c11c0738d56a tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:13.032362 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-91663c80-9301-42b5-b93a-c11c0738d56a tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:13.136317 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5830c868-6d43-45c9-9aee-673fb9cde5d7 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48ee960c38f4d0584ea5ce34579279f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a957b6585e74a31b5bc5f66441c33e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:13.144213 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5830c868-6d43-45c9-9aee-673fb9cde5d7 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706" status: 200 len: 1506 microversion: 2.1 time: 0.189193 Aug 31 16:15:13.144795 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2084/4152] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:12 2022] GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706 => generated 1506 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:13.198151 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-91663c80-9301-42b5-b93a-c11c0738d56a tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:13.206307 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-91663c80-9301-42b5-b93a-c11c0738d56a tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/d78f1dfc-6152-4180-84be-f6a84b75dbc2" status: 200 len: 1494 microversion: 2.1 time: 0.188017 Aug 31 16:15:13.206888 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2069/4153] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:13 2022] GET /compute/v2.1/servers/d78f1dfc-6152-4180-84be-f6a84b75dbc2 => generated 1494 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:15:13.345337 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d08aeefa-0fce-415a-8c3f-218b05117148 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:13.345990 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d08aeefa-0fce-415a-8c3f-218b05117148 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] [instance: 644d0221-94ca-4873-8fe0-ab72c4d7d68b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:13.352173 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d08aeefa-0fce-415a-8c3f-218b05117148 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:13.352661 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d08aeefa-0fce-415a-8c3f-218b05117148 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:13.353132 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d08aeefa-0fce-415a-8c3f-218b05117148 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:13.353868 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d08aeefa-0fce-415a-8c3f-218b05117148 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:13.354328 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d08aeefa-0fce-415a-8c3f-218b05117148 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:13.354759 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d08aeefa-0fce-415a-8c3f-218b05117148 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:13.389942 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-097f2265-a89b-4680-ae39-59aeec434f8a tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:13.390672 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-097f2265-a89b-4680-ae39-59aeec434f8a tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: c4ef985e-0861-4c5d-88eb-d8ad053a8f54] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:13.395179 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=2,nova_api:INSERT=9 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:15:13.398941 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-097f2265-a89b-4680-ae39-59aeec434f8a tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:13.399639 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-097f2265-a89b-4680-ae39-59aeec434f8a tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:13.400087 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-097f2265-a89b-4680-ae39-59aeec434f8a tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:13.400799 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-097f2265-a89b-4680-ae39-59aeec434f8a tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:13.401260 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-097f2265-a89b-4680-ae39-59aeec434f8a tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:13.401694 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-097f2265-a89b-4680-ae39-59aeec434f8a tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:13.572362 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d08aeefa-0fce-415a-8c3f-218b05117148 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860ac4e423cf410d9bbc354c77ba864c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aada201b2fd64fdc81a69f826e7c607b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:13.582225 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d08aeefa-0fce-415a-8c3f-218b05117148 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] 10.222.0.61 "GET /compute/v2.1/servers/644d0221-94ca-4873-8fe0-ab72c4d7d68b" status: 200 len: 1355 microversion: 2.1 time: 0.241396 Aug 31 16:15:13.582860 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2085/4154] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:13 2022] GET /compute/v2.1/servers/644d0221-94ca-4873-8fe0-ab72c4d7d68b => generated 1355 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:13.602379 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-097f2265-a89b-4680-ae39-59aeec434f8a tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb261f2061164b49a8d496b16647dd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d2222a956a4888967e21647e26b310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:13.611441 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-097f2265-a89b-4680-ae39-59aeec434f8a tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "GET /compute/v2.1/servers/c4ef985e-0861-4c5d-88eb-d8ad053a8f54" status: 200 len: 1317 microversion: 2.1 time: 0.231231 Aug 31 16:15:13.612260 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2070/4155] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:13 2022] GET /compute/v2.1/servers/c4ef985e-0861-4c5d-88eb-d8ad053a8f54 => generated 1317 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:15:13.656931 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a67af064-f3b3-487e-8c13-de99073ac37f tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:13.657744 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a67af064-f3b3-487e-8c13-de99073ac37f tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] [instance: f04eb48d-000e-4c3b-8799-a4d3cdacf0e2] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:13.664721 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a67af064-f3b3-487e-8c13-de99073ac37f tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:13.665504 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a67af064-f3b3-487e-8c13-de99073ac37f tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:13.665947 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a67af064-f3b3-487e-8c13-de99073ac37f tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:13.666666 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a67af064-f3b3-487e-8c13-de99073ac37f tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:13.667131 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a67af064-f3b3-487e-8c13-de99073ac37f tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:13.667701 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a67af064-f3b3-487e-8c13-de99073ac37f tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:13.677946 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3edf662a-9416-49f7-9bd3-1942689720e2 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:13.678573 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3edf662a-9416-49f7-9bd3-1942689720e2 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] [instance: 64136c5d-b1e6-4263-a450-3308b0b4f69b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:13.684886 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3edf662a-9416-49f7-9bd3-1942689720e2 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:13.685286 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3edf662a-9416-49f7-9bd3-1942689720e2 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:13.685730 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3edf662a-9416-49f7-9bd3-1942689720e2 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:13.686502 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3edf662a-9416-49f7-9bd3-1942689720e2 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:13.686972 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3edf662a-9416-49f7-9bd3-1942689720e2 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:13.687409 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3edf662a-9416-49f7-9bd3-1942689720e2 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:13.962507 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a67af064-f3b3-487e-8c13-de99073ac37f tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed06378eb9b446680b5a3156a14941d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511432a7dee4bec9d1093c9d95b3734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:13.969885 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3edf662a-9416-49f7-9bd3-1942689720e2 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d6eee711fe4194a4db63c801f78561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeac74d3027d4080be26bf3aadab4c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:13.972781 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a67af064-f3b3-487e-8c13-de99073ac37f tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] 10.222.0.61 "GET /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2" status: 200 len: 1722 microversion: 2.1 time: 0.319961 Aug 31 16:15:13.974216 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2086/4156] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:13 2022] GET /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2 => generated 1722 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:13.979227 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-bd63f945-4806-41b5-a30a-ca0f143b9542 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:13.982291 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-bd63f945-4806-41b5-a30a-ca0f143b9542 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:13.982459 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3edf662a-9416-49f7-9bd3-1942689720e2 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] 10.222.0.61 "GET /compute/v2.1/servers/64136c5d-b1e6-4263-a450-3308b0b4f69b" status: 200 len: 1318 microversion: 2.1 time: 0.308414 Aug 31 16:15:13.982459 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2071/4157] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:13 2022] GET /compute/v2.1/servers/64136c5d-b1e6-4263-a450-3308b0b4f69b => generated 1318 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:15:13.988337 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bd63f945-4806-41b5-a30a-ca0f143b9542 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:13.990334 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bd63f945-4806-41b5-a30a-ca0f143b9542 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:13.990334 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bd63f945-4806-41b5-a30a-ca0f143b9542 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:13.990334 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bd63f945-4806-41b5-a30a-ca0f143b9542 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:13.990888 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bd63f945-4806-41b5-a30a-ca0f143b9542 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:13.991331 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bd63f945-4806-41b5-a30a-ca0f143b9542 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:14.124323 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-bd63f945-4806-41b5-a30a-ca0f143b9542 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:14.132443 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-bd63f945-4806-41b5-a30a-ca0f143b9542 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1363 microversion: 2.1 time: 0.157142 Aug 31 16:15:14.133144 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2087/4158] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:13 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:14.164892 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-75ad9754-d8a4-4c14-86f5-cae60191ad0d tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:14.165510 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-75ad9754-d8a4-4c14-86f5-cae60191ad0d tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: e3625fdf-7e50-4ba1-99dc-6ae7473fc706] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:14.171556 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-75ad9754-d8a4-4c14-86f5-cae60191ad0d tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:14.172048 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-75ad9754-d8a4-4c14-86f5-cae60191ad0d tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:14.173182 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-75ad9754-d8a4-4c14-86f5-cae60191ad0d tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:14.173893 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-75ad9754-d8a4-4c14-86f5-cae60191ad0d tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:14.174355 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-75ad9754-d8a4-4c14-86f5-cae60191ad0d tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:14.174787 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-75ad9754-d8a4-4c14-86f5-cae60191ad0d tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:14.190646 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:15:14.228084 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-19e8fbb9-32b8-44a7-a9fd-f9f7b852dbaa tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:14.228696 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-19e8fbb9-32b8-44a7-a9fd-f9f7b852dbaa tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: d78f1dfc-6152-4180-84be-f6a84b75dbc2] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:14.236489 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-19e8fbb9-32b8-44a7-a9fd-f9f7b852dbaa tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:14.237255 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-19e8fbb9-32b8-44a7-a9fd-f9f7b852dbaa tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:14.237730 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-19e8fbb9-32b8-44a7-a9fd-f9f7b852dbaa tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:14.239488 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-19e8fbb9-32b8-44a7-a9fd-f9f7b852dbaa tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:14.239984 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-19e8fbb9-32b8-44a7-a9fd-f9f7b852dbaa tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:14.240415 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-19e8fbb9-32b8-44a7-a9fd-f9f7b852dbaa tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:14.354099 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-75ad9754-d8a4-4c14-86f5-cae60191ad0d tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48ee960c38f4d0584ea5ce34579279f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a957b6585e74a31b5bc5f66441c33e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:14.364032 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-75ad9754-d8a4-4c14-86f5-cae60191ad0d tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706" status: 200 len: 1506 microversion: 2.1 time: 0.202845 Aug 31 16:15:14.364626 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2072/4159] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:14 2022] GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706 => generated 1506 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:14.399645 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-19e8fbb9-32b8-44a7-a9fd-f9f7b852dbaa tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:14.408333 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-19e8fbb9-32b8-44a7-a9fd-f9f7b852dbaa tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/d78f1dfc-6152-4180-84be-f6a84b75dbc2" status: 200 len: 1494 microversion: 2.1 time: 0.184094 Aug 31 16:15:14.408912 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2088/4160] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:14 2022] GET /compute/v2.1/servers/d78f1dfc-6152-4180-84be-f6a84b75dbc2 => generated 1494 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:15:14.603942 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-746f174d-5f08-46cc-b2cd-3c056ed61a61 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:14.604561 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-746f174d-5f08-46cc-b2cd-3c056ed61a61 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] [instance: 644d0221-94ca-4873-8fe0-ab72c4d7d68b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:14.611823 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-746f174d-5f08-46cc-b2cd-3c056ed61a61 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:14.612683 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-746f174d-5f08-46cc-b2cd-3c056ed61a61 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:14.612821 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-746f174d-5f08-46cc-b2cd-3c056ed61a61 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:14.613503 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-746f174d-5f08-46cc-b2cd-3c056ed61a61 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:14.614006 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-746f174d-5f08-46cc-b2cd-3c056ed61a61 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:14.614440 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-746f174d-5f08-46cc-b2cd-3c056ed61a61 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:14.635529 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-05995df6-dd88-4ef7-9aef-84cde455dec5 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:14.636152 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-05995df6-dd88-4ef7-9aef-84cde455dec5 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: c4ef985e-0861-4c5d-88eb-d8ad053a8f54] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:14.642657 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-05995df6-dd88-4ef7-9aef-84cde455dec5 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:14.643464 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-05995df6-dd88-4ef7-9aef-84cde455dec5 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:14.643970 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-05995df6-dd88-4ef7-9aef-84cde455dec5 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:14.644673 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-05995df6-dd88-4ef7-9aef-84cde455dec5 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:14.645139 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-05995df6-dd88-4ef7-9aef-84cde455dec5 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:14.645574 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-05995df6-dd88-4ef7-9aef-84cde455dec5 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:14.830744 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-746f174d-5f08-46cc-b2cd-3c056ed61a61 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860ac4e423cf410d9bbc354c77ba864c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aada201b2fd64fdc81a69f826e7c607b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:14.834107 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-05995df6-dd88-4ef7-9aef-84cde455dec5 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb261f2061164b49a8d496b16647dd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d2222a956a4888967e21647e26b310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:14.839846 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-746f174d-5f08-46cc-b2cd-3c056ed61a61 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] 10.222.0.61 "GET /compute/v2.1/servers/644d0221-94ca-4873-8fe0-ab72c4d7d68b" status: 200 len: 1355 microversion: 2.1 time: 0.239718 Aug 31 16:15:14.840676 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2073/4161] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:14 2022] GET /compute/v2.1/servers/644d0221-94ca-4873-8fe0-ab72c4d7d68b => generated 1355 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:15:14.848141 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-05995df6-dd88-4ef7-9aef-84cde455dec5 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "GET /compute/v2.1/servers/c4ef985e-0861-4c5d-88eb-d8ad053a8f54" status: 200 len: 1317 microversion: 2.1 time: 0.216355 Aug 31 16:15:14.848971 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2089/4162] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:14 2022] GET /compute/v2.1/servers/c4ef985e-0861-4c5d-88eb-d8ad053a8f54 => generated 1317 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:15:14.997351 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9bfac988-af11-432e-a679-33c0ca654bfc tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:14.997967 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9bfac988-af11-432e-a679-33c0ca654bfc tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] [instance: f04eb48d-000e-4c3b-8799-a4d3cdacf0e2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:15.010326 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2f97fc85-53bc-4db9-a7ef-39bfd41cee7d tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:15.011078 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2f97fc85-53bc-4db9-a7ef-39bfd41cee7d tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] [instance: 64136c5d-b1e6-4263-a450-3308b0b4f69b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:15.015341 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9bfac988-af11-432e-a679-33c0ca654bfc tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:15.015889 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9bfac988-af11-432e-a679-33c0ca654bfc tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:15.018876 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9bfac988-af11-432e-a679-33c0ca654bfc tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:15.019916 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9bfac988-af11-432e-a679-33c0ca654bfc tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:15.020397 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9bfac988-af11-432e-a679-33c0ca654bfc tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:15.020852 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9bfac988-af11-432e-a679-33c0ca654bfc tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:15.027200 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2f97fc85-53bc-4db9-a7ef-39bfd41cee7d tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:15.029825 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2f97fc85-53bc-4db9-a7ef-39bfd41cee7d tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:15.030480 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2f97fc85-53bc-4db9-a7ef-39bfd41cee7d tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:15.031408 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2f97fc85-53bc-4db9-a7ef-39bfd41cee7d tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:15.035142 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2f97fc85-53bc-4db9-a7ef-39bfd41cee7d tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:15.035809 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2f97fc85-53bc-4db9-a7ef-39bfd41cee7d tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:15.276984 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-9bfac988-af11-432e-a679-33c0ca654bfc tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed06378eb9b446680b5a3156a14941d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511432a7dee4bec9d1093c9d95b3734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:15.278691 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2f97fc85-53bc-4db9-a7ef-39bfd41cee7d tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d6eee711fe4194a4db63c801f78561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeac74d3027d4080be26bf3aadab4c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:15.287216 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9bfac988-af11-432e-a679-33c0ca654bfc tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] 10.222.0.61 "GET /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2" status: 200 len: 1722 microversion: 2.1 time: 0.293792 Aug 31 16:15:15.287850 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2074/4163] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:14 2022] GET /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2 => generated 1722 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:15.302126 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2f97fc85-53bc-4db9-a7ef-39bfd41cee7d tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] 10.222.0.61 "GET /compute/v2.1/servers/64136c5d-b1e6-4263-a450-3308b0b4f69b" status: 200 len: 1318 microversion: 2.1 time: 0.287997 Aug 31 16:15:15.302126 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2090/4164] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:14 2022] GET /compute/v2.1/servers/64136c5d-b1e6-4263-a450-3308b0b4f69b => generated 1318 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:15.302126 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-acfbd0a6-7009-47d9-b774-4e2fd42beaea tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:15.302126 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-acfbd0a6-7009-47d9-b774-4e2fd42beaea tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:15.302126 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-acfbd0a6-7009-47d9-b774-4e2fd42beaea tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:15.302126 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-acfbd0a6-7009-47d9-b774-4e2fd42beaea tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:15.302688 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-acfbd0a6-7009-47d9-b774-4e2fd42beaea tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:15.303344 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-acfbd0a6-7009-47d9-b774-4e2fd42beaea tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:15.304003 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-acfbd0a6-7009-47d9-b774-4e2fd42beaea tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:15.304445 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-acfbd0a6-7009-47d9-b774-4e2fd42beaea tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:15.386292 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e2314f15-3d83-40c6-a8d6-aa8a42ba52f4 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:15.387161 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e2314f15-3d83-40c6-a8d6-aa8a42ba52f4 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: e3625fdf-7e50-4ba1-99dc-6ae7473fc706] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:15.395367 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e2314f15-3d83-40c6-a8d6-aa8a42ba52f4 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:15.396705 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e2314f15-3d83-40c6-a8d6-aa8a42ba52f4 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:15.397224 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e2314f15-3d83-40c6-a8d6-aa8a42ba52f4 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:15.398059 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e2314f15-3d83-40c6-a8d6-aa8a42ba52f4 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:15.398651 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e2314f15-3d83-40c6-a8d6-aa8a42ba52f4 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:15.399149 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e2314f15-3d83-40c6-a8d6-aa8a42ba52f4 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:15.875554 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-acfbd0a6-7009-47d9-b774-4e2fd42beaea tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:15.879951 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=100 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:15:15.885094 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-acfbd0a6-7009-47d9-b774-4e2fd42beaea tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1363 microversion: 2.1 time: 0.595225 Aug 31 16:15:15.885929 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2091/4165] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:15 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1363 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:15.891538 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-cd274b1d-8cc5-4110-b68b-5eaefb972b62 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:15.892105 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-cd274b1d-8cc5-4110-b68b-5eaefb972b62 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: d78f1dfc-6152-4180-84be-f6a84b75dbc2] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:15.898615 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cd274b1d-8cc5-4110-b68b-5eaefb972b62 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:15.899112 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cd274b1d-8cc5-4110-b68b-5eaefb972b62 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:15.899592 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cd274b1d-8cc5-4110-b68b-5eaefb972b62 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:15.900386 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cd274b1d-8cc5-4110-b68b-5eaefb972b62 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:15.900920 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cd274b1d-8cc5-4110-b68b-5eaefb972b62 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:15.901378 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cd274b1d-8cc5-4110-b68b-5eaefb972b62 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:16.108181 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e2314f15-3d83-40c6-a8d6-aa8a42ba52f4 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48ee960c38f4d0584ea5ce34579279f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a957b6585e74a31b5bc5f66441c33e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:16.119344 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e2314f15-3d83-40c6-a8d6-aa8a42ba52f4 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706" status: 200 len: 1506 microversion: 2.1 time: 0.736992 Aug 31 16:15:16.120355 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2075/4166] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:15 2022] GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706 => generated 1506 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:15:16.125940 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1738a205-0ca9-434b-abc8-ca5fc6d65d21 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:16.125940 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1738a205-0ca9-434b-abc8-ca5fc6d65d21 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] [instance: 644d0221-94ca-4873-8fe0-ab72c4d7d68b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:16.134280 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1738a205-0ca9-434b-abc8-ca5fc6d65d21 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:16.134874 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1738a205-0ca9-434b-abc8-ca5fc6d65d21 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:16.135371 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1738a205-0ca9-434b-abc8-ca5fc6d65d21 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:16.136197 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1738a205-0ca9-434b-abc8-ca5fc6d65d21 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:16.136691 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1738a205-0ca9-434b-abc8-ca5fc6d65d21 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:16.137182 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1738a205-0ca9-434b-abc8-ca5fc6d65d21 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:16.880735 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-cd274b1d-8cc5-4110-b68b-5eaefb972b62 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:16.888625 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-cd274b1d-8cc5-4110-b68b-5eaefb972b62 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/d78f1dfc-6152-4180-84be-f6a84b75dbc2" status: 200 len: 1494 microversion: 2.1 time: 1.001693 Aug 31 16:15:16.889217 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2092/4167] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:15 2022] GET /compute/v2.1/servers/d78f1dfc-6152-4180-84be-f6a84b75dbc2 => generated 1494 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:16.893627 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-62130126-2804-49c0-b5b5-c9c735b020d6 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:16.894342 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-62130126-2804-49c0-b5b5-c9c735b020d6 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: c4ef985e-0861-4c5d-88eb-d8ad053a8f54] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:16.902857 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-62130126-2804-49c0-b5b5-c9c735b020d6 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:16.903162 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-62130126-2804-49c0-b5b5-c9c735b020d6 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:16.903680 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-62130126-2804-49c0-b5b5-c9c735b020d6 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:16.904415 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-62130126-2804-49c0-b5b5-c9c735b020d6 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:16.904851 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-62130126-2804-49c0-b5b5-c9c735b020d6 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:16.905274 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-62130126-2804-49c0-b5b5-c9c735b020d6 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:17.070995 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1738a205-0ca9-434b-abc8-ca5fc6d65d21 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860ac4e423cf410d9bbc354c77ba864c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aada201b2fd64fdc81a69f826e7c607b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:17.079048 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1738a205-0ca9-434b-abc8-ca5fc6d65d21 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] 10.222.0.61 "GET /compute/v2.1/servers/644d0221-94ca-4873-8fe0-ab72c4d7d68b" status: 200 len: 1355 microversion: 2.1 time: 0.957710 Aug 31 16:15:17.080750 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2076/4168] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:16 2022] GET /compute/v2.1/servers/644d0221-94ca-4873-8fe0-ab72c4d7d68b => generated 1355 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:17.098010 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-95f02241-e181-4861-a615-6f81b5f4e16a tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:17.098675 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-95f02241-e181-4861-a615-6f81b5f4e16a tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] [instance: f04eb48d-000e-4c3b-8799-a4d3cdacf0e2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:17.105106 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-95f02241-e181-4861-a615-6f81b5f4e16a tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:17.105857 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-95f02241-e181-4861-a615-6f81b5f4e16a tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:17.106305 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-95f02241-e181-4861-a615-6f81b5f4e16a tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:17.107150 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-95f02241-e181-4861-a615-6f81b5f4e16a tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:17.107687 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-95f02241-e181-4861-a615-6f81b5f4e16a tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:17.108128 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-95f02241-e181-4861-a615-6f81b5f4e16a tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:17.356404 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-62130126-2804-49c0-b5b5-c9c735b020d6 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb261f2061164b49a8d496b16647dd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d2222a956a4888967e21647e26b310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:17.366558 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-62130126-2804-49c0-b5b5-c9c735b020d6 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "GET /compute/v2.1/servers/c4ef985e-0861-4c5d-88eb-d8ad053a8f54" status: 200 len: 1317 microversion: 2.1 time: 0.476252 Aug 31 16:15:17.367169 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2093/4169] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:16 2022] GET /compute/v2.1/servers/c4ef985e-0861-4c5d-88eb-d8ad053a8f54 => generated 1317 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:17.375444 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-44c3a320-5056-4d71-a72a-41019df002ab tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:17.375444 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-44c3a320-5056-4d71-a72a-41019df002ab tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] [instance: 64136c5d-b1e6-4263-a450-3308b0b4f69b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:17.382581 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-44c3a320-5056-4d71-a72a-41019df002ab tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:17.383155 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-44c3a320-5056-4d71-a72a-41019df002ab tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:17.383909 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-44c3a320-5056-4d71-a72a-41019df002ab tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:17.384708 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-44c3a320-5056-4d71-a72a-41019df002ab tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:17.385181 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-44c3a320-5056-4d71-a72a-41019df002ab tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:17.385617 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-44c3a320-5056-4d71-a72a-41019df002ab tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:17.458613 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-95f02241-e181-4861-a615-6f81b5f4e16a tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed06378eb9b446680b5a3156a14941d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511432a7dee4bec9d1093c9d95b3734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:17.468505 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-95f02241-e181-4861-a615-6f81b5f4e16a tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] 10.222.0.61 "GET /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2" status: 200 len: 1699 microversion: 2.1 time: 0.375028 Aug 31 16:15:17.474022 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2077/4170] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:17 2022] GET /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2 => generated 1699 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:17.478848 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-44411a08-094a-42bf-9b37-7cd3e2c7805e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:17.479271 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-44411a08-094a-42bf-9b37-7cd3e2c7805e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:17.487116 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-44411a08-094a-42bf-9b37-7cd3e2c7805e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:17.487949 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-44411a08-094a-42bf-9b37-7cd3e2c7805e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:17.488395 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-44411a08-094a-42bf-9b37-7cd3e2c7805e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:17.489117 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-44411a08-094a-42bf-9b37-7cd3e2c7805e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:17.489580 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-44411a08-094a-42bf-9b37-7cd3e2c7805e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:17.493014 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-44411a08-094a-42bf-9b37-7cd3e2c7805e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:17.721979 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-44c3a320-5056-4d71-a72a-41019df002ab tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d6eee711fe4194a4db63c801f78561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeac74d3027d4080be26bf3aadab4c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:17.730759 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-44c3a320-5056-4d71-a72a-41019df002ab tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] 10.222.0.61 "GET /compute/v2.1/servers/64136c5d-b1e6-4263-a450-3308b0b4f69b" status: 200 len: 1318 microversion: 2.1 time: 0.362484 Aug 31 16:15:17.748003 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2094/4171] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:17 2022] GET /compute/v2.1/servers/64136c5d-b1e6-4263-a450-3308b0b4f69b => generated 1318 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:17.754212 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6e93098e-fabb-4145-b32f-dc86ba386d5b tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:17.755239 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6e93098e-fabb-4145-b32f-dc86ba386d5b tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: e3625fdf-7e50-4ba1-99dc-6ae7473fc706] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:17.758391 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-44411a08-094a-42bf-9b37-7cd3e2c7805e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:17.761759 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6e93098e-fabb-4145-b32f-dc86ba386d5b tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:17.762393 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6e93098e-fabb-4145-b32f-dc86ba386d5b tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:17.762830 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6e93098e-fabb-4145-b32f-dc86ba386d5b tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:17.763802 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6e93098e-fabb-4145-b32f-dc86ba386d5b tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:17.764425 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6e93098e-fabb-4145-b32f-dc86ba386d5b tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:17.765145 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6e93098e-fabb-4145-b32f-dc86ba386d5b tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:17.768562 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-44411a08-094a-42bf-9b37-7cd3e2c7805e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1363 microversion: 2.1 time: 0.293546 Aug 31 16:15:17.780517 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2078/4172] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:17 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1363 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:17.790687 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-98d6f41e-c3c4-4d0e-891d-78f90363754d tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:15:17.799239 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-98d6f41e-c3c4-4d0e-891d-78f90363754d tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:17.800994 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-98d6f41e-c3c4-4d0e-891d-78f90363754d tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:17.802002 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-98d6f41e-c3c4-4d0e-891d-78f90363754d tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:17.842299 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-98d6f41e-c3c4-4d0e-891d-78f90363754d tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] [instance: f04eb48d-000e-4c3b-8799-a4d3cdacf0e2] Going to try to start instance {{(pid=122256) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 31 16:15:17.907670 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-98d6f41e-c3c4-4d0e-891d-78f90363754d tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] 10.222.0.61 "POST /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2/action" status: 202 len: 0 microversion: 2.1 time: 0.125014 Aug 31 16:15:17.908447 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2079/4173] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:15:17 2022] POST /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:15:17.914197 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-14ebcb8c-f46b-40c1-bca5-8fd26da6f40e req-fbf60c62-7fb0-418b-a530-082317a14bfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc727258-60c5-45b0-8c8c-179f621f6732", "name": "network-vif-plugged", "status": "completed", "tag": "b9e5ca45-edcc-4cac-97b5-859f04131031"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:15:17.924440 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-14ebcb8c-f46b-40c1-bca5-8fd26da6f40e req-fbf60c62-7fb0-418b-a530-082317a14bfd service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:17.925072 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-14ebcb8c-f46b-40c1-bca5-8fd26da6f40e req-fbf60c62-7fb0-418b-a530-082317a14bfd service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:17.925513 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-14ebcb8c-f46b-40c1-bca5-8fd26da6f40e req-fbf60c62-7fb0-418b-a530-082317a14bfd service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:17.937619 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-14ebcb8c-f46b-40c1-bca5-8fd26da6f40e req-fbf60c62-7fb0-418b-a530-082317a14bfd service nova] Creating event network-vif-plugged:b9e5ca45-edcc-4cac-97b5-859f04131031 for instance cc727258-60c5-45b0-8c8c-179f621f6732 on n-h1-850499-9 Aug 31 16:15:17.943071 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-14ebcb8c-f46b-40c1-bca5-8fd26da6f40e req-fbf60c62-7fb0-418b-a530-082317a14bfd service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033268 Aug 31 16:15:17.943884 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2080/4174] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:15:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:15:17.948927 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-269e4e01-bdef-417b-aa03-c2c534beb55c req-dd223489-204b-4261-ae96-67bc87f4e5df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d78f1dfc-6152-4180-84be-f6a84b75dbc2", "name": "network-vif-deleted", "tag": "1fd435b6-e20e-4b7a-93c8-aa966480c41d"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:15:17.963018 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-6e93098e-fabb-4145-b32f-dc86ba386d5b tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48ee960c38f4d0584ea5ce34579279f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a957b6585e74a31b5bc5f66441c33e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:17.970313 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-269e4e01-bdef-417b-aa03-c2c534beb55c req-dd223489-204b-4261-ae96-67bc87f4e5df service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:17.970912 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-269e4e01-bdef-417b-aa03-c2c534beb55c req-dd223489-204b-4261-ae96-67bc87f4e5df service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:17.971417 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-269e4e01-bdef-417b-aa03-c2c534beb55c req-dd223489-204b-4261-ae96-67bc87f4e5df service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:17.972249 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6e93098e-fabb-4145-b32f-dc86ba386d5b tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706" status: 200 len: 1506 microversion: 2.1 time: 0.222861 Aug 31 16:15:17.973162 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2095/4175] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:17 2022] GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706 => generated 1506 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:17.977723 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-46d98ea7-6ddf-45d0-a3e8-26f225bb7f48 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:17.978537 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-46d98ea7-6ddf-45d0-a3e8-26f225bb7f48 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: d78f1dfc-6152-4180-84be-f6a84b75dbc2] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:17.985996 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-46d98ea7-6ddf-45d0-a3e8-26f225bb7f48 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:17.986915 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-46d98ea7-6ddf-45d0-a3e8-26f225bb7f48 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:17.987386 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-46d98ea7-6ddf-45d0-a3e8-26f225bb7f48 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:17.988112 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-46d98ea7-6ddf-45d0-a3e8-26f225bb7f48 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:17.988575 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-46d98ea7-6ddf-45d0-a3e8-26f225bb7f48 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:17.989005 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-46d98ea7-6ddf-45d0-a3e8-26f225bb7f48 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:17.991703 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-269e4e01-bdef-417b-aa03-c2c534beb55c req-dd223489-204b-4261-ae96-67bc87f4e5df service nova] Creating event network-vif-deleted:1fd435b6-e20e-4b7a-93c8-aa966480c41d for instance d78f1dfc-6152-4180-84be-f6a84b75dbc2 on n-h2-850499-9 Aug 31 16:15:18.000807 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-269e4e01-bdef-417b-aa03-c2c534beb55c req-dd223489-204b-4261-ae96-67bc87f4e5df service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055612 Aug 31 16:15:18.002281 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2081/4176] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:15:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:15:18.007391 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2693735b-0ff6-4c22-8326-31f24993a0ec tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:18.008116 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2693735b-0ff6-4c22-8326-31f24993a0ec tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] [instance: f04eb48d-000e-4c3b-8799-a4d3cdacf0e2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:18.014722 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2693735b-0ff6-4c22-8326-31f24993a0ec tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:18.015211 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2693735b-0ff6-4c22-8326-31f24993a0ec tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:18.015684 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2693735b-0ff6-4c22-8326-31f24993a0ec tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:18.016388 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2693735b-0ff6-4c22-8326-31f24993a0ec tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:18.016841 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2693735b-0ff6-4c22-8326-31f24993a0ec tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:18.018015 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2693735b-0ff6-4c22-8326-31f24993a0ec tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:18.059883 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-46d98ea7-6ddf-45d0-a3e8-26f225bb7f48 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:18.068702 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-46d98ea7-6ddf-45d0-a3e8-26f225bb7f48 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/d78f1dfc-6152-4180-84be-f6a84b75dbc2" status: 200 len: 1452 microversion: 2.1 time: 0.094431 Aug 31 16:15:18.069301 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2096/4177] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:17 2022] GET /compute/v2.1/servers/d78f1dfc-6152-4180-84be-f6a84b75dbc2 => generated 1452 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:18.100372 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1afa5d63-af3c-4d2a-bd1a-16b822754307 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:18.101032 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1afa5d63-af3c-4d2a-bd1a-16b822754307 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] [instance: 644d0221-94ca-4873-8fe0-ab72c4d7d68b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:18.107201 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1afa5d63-af3c-4d2a-bd1a-16b822754307 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:18.107903 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1afa5d63-af3c-4d2a-bd1a-16b822754307 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:18.108177 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1afa5d63-af3c-4d2a-bd1a-16b822754307 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:18.108881 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1afa5d63-af3c-4d2a-bd1a-16b822754307 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:18.109336 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1afa5d63-af3c-4d2a-bd1a-16b822754307 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:18.109761 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1afa5d63-af3c-4d2a-bd1a-16b822754307 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:18.192508 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-2693735b-0ff6-4c22-8326-31f24993a0ec tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed06378eb9b446680b5a3156a14941d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511432a7dee4bec9d1093c9d95b3734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:18.200645 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2693735b-0ff6-4c22-8326-31f24993a0ec tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] 10.222.0.61 "GET /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2" status: 200 len: 1708 microversion: 2.1 time: 0.197096 Aug 31 16:15:18.201215 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2082/4178] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:18 2022] GET /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2 => generated 1708 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:18.271007 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-1afa5d63-af3c-4d2a-bd1a-16b822754307 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860ac4e423cf410d9bbc354c77ba864c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aada201b2fd64fdc81a69f826e7c607b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:18.278823 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1afa5d63-af3c-4d2a-bd1a-16b822754307 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] 10.222.0.61 "GET /compute/v2.1/servers/644d0221-94ca-4873-8fe0-ab72c4d7d68b" status: 200 len: 1355 microversion: 2.1 time: 0.182374 Aug 31 16:15:18.279396 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2097/4179] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:18 2022] GET /compute/v2.1/servers/644d0221-94ca-4873-8fe0-ab72c4d7d68b => generated 1355 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:15:18.388575 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-634987a9-d473-4cb6-86da-3c3eff5a0909 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:18.389451 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-634987a9-d473-4cb6-86da-3c3eff5a0909 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: c4ef985e-0861-4c5d-88eb-d8ad053a8f54] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:18.398660 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-634987a9-d473-4cb6-86da-3c3eff5a0909 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:18.399189 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-634987a9-d473-4cb6-86da-3c3eff5a0909 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:18.399665 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-634987a9-d473-4cb6-86da-3c3eff5a0909 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:18.400376 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-634987a9-d473-4cb6-86da-3c3eff5a0909 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:18.400833 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-634987a9-d473-4cb6-86da-3c3eff5a0909 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:18.401258 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-634987a9-d473-4cb6-86da-3c3eff5a0909 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:18.532267 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-634987a9-d473-4cb6-86da-3c3eff5a0909 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb261f2061164b49a8d496b16647dd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d2222a956a4888967e21647e26b310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:18.540869 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-634987a9-d473-4cb6-86da-3c3eff5a0909 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "GET /compute/v2.1/servers/c4ef985e-0861-4c5d-88eb-d8ad053a8f54" status: 200 len: 1317 microversion: 2.1 time: 0.156162 Aug 31 16:15:18.541443 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2083/4180] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:18 2022] GET /compute/v2.1/servers/c4ef985e-0861-4c5d-88eb-d8ad053a8f54 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:15:18.756563 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b6971148-478b-4045-a09d-0535711b607d tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:18.757320 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b6971148-478b-4045-a09d-0535711b607d tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] [instance: 64136c5d-b1e6-4263-a450-3308b0b4f69b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:18.764238 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b6971148-478b-4045-a09d-0535711b607d tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:18.764989 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b6971148-478b-4045-a09d-0535711b607d tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:18.765625 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b6971148-478b-4045-a09d-0535711b607d tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:18.766832 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b6971148-478b-4045-a09d-0535711b607d tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:18.767823 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b6971148-478b-4045-a09d-0535711b607d tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:18.768433 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b6971148-478b-4045-a09d-0535711b607d tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:18.793568 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-78759eed-fa82-427e-bf99-da0393288f96 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:18.795132 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-78759eed-fa82-427e-bf99-da0393288f96 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:18.802825 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=8 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:15:18.804733 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=24 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:15:18.807066 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-78759eed-fa82-427e-bf99-da0393288f96 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:18.808304 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-78759eed-fa82-427e-bf99-da0393288f96 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:18.810126 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-78759eed-fa82-427e-bf99-da0393288f96 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:18.812348 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-78759eed-fa82-427e-bf99-da0393288f96 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:18.813098 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-78759eed-fa82-427e-bf99-da0393288f96 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:18.814689 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-78759eed-fa82-427e-bf99-da0393288f96 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:19.159032 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b6971148-478b-4045-a09d-0535711b607d tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d6eee711fe4194a4db63c801f78561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeac74d3027d4080be26bf3aadab4c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:19.168536 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b6971148-478b-4045-a09d-0535711b607d tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] 10.222.0.61 "GET /compute/v2.1/servers/64136c5d-b1e6-4263-a450-3308b0b4f69b" status: 200 len: 1318 microversion: 2.1 time: 0.417979 Aug 31 16:15:19.178674 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-78759eed-fa82-427e-bf99-da0393288f96 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:19.179224 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2098/4181] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:18 2022] GET /compute/v2.1/servers/64136c5d-b1e6-4263-a450-3308b0b4f69b => generated 1318 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:19.186474 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-67d2468c-c8ae-4285-9625-92a7230b2397 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:19.187122 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-67d2468c-c8ae-4285-9625-92a7230b2397 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: e3625fdf-7e50-4ba1-99dc-6ae7473fc706] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:19.194405 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-67d2468c-c8ae-4285-9625-92a7230b2397 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:19.194912 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-67d2468c-c8ae-4285-9625-92a7230b2397 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:19.195345 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-67d2468c-c8ae-4285-9625-92a7230b2397 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:19.196083 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-67d2468c-c8ae-4285-9625-92a7230b2397 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:19.196561 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-67d2468c-c8ae-4285-9625-92a7230b2397 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:19.196783 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-78759eed-fa82-427e-bf99-da0393288f96 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1363 microversion: 2.1 time: 0.405519 Aug 31 16:15:19.196969 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-67d2468c-c8ae-4285-9625-92a7230b2397 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:19.197633 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2084/4182] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:18 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1363 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:19.206465 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-688576cd-1629-4992-9952-cc909a8fb3c6 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:19.207088 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-688576cd-1629-4992-9952-cc909a8fb3c6 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: d78f1dfc-6152-4180-84be-f6a84b75dbc2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:19.223001 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-688576cd-1629-4992-9952-cc909a8fb3c6 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:19.223536 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-688576cd-1629-4992-9952-cc909a8fb3c6 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:19.223981 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-688576cd-1629-4992-9952-cc909a8fb3c6 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:19.224702 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-688576cd-1629-4992-9952-cc909a8fb3c6 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:19.225163 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-688576cd-1629-4992-9952-cc909a8fb3c6 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:19.225592 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-688576cd-1629-4992-9952-cc909a8fb3c6 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:19.416649 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-688576cd-1629-4992-9952-cc909a8fb3c6 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:19.424519 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-688576cd-1629-4992-9952-cc909a8fb3c6 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/d78f1dfc-6152-4180-84be-f6a84b75dbc2" status: 200 len: 1452 microversion: 2.1 time: 0.226092 Aug 31 16:15:19.425114 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2085/4183] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:19 2022] GET /compute/v2.1/servers/d78f1dfc-6152-4180-84be-f6a84b75dbc2 => generated 1452 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:19.429581 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a74406df-a364-4242-be59-34a5a89eeb91 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:19.430182 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a74406df-a364-4242-be59-34a5a89eeb91 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] [instance: f04eb48d-000e-4c3b-8799-a4d3cdacf0e2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:19.436020 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a74406df-a364-4242-be59-34a5a89eeb91 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:19.436517 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a74406df-a364-4242-be59-34a5a89eeb91 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:19.437171 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a74406df-a364-4242-be59-34a5a89eeb91 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:19.438090 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a74406df-a364-4242-be59-34a5a89eeb91 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:19.438775 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a74406df-a364-4242-be59-34a5a89eeb91 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:19.439825 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a74406df-a364-4242-be59-34a5a89eeb91 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:19.581841 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-67d2468c-c8ae-4285-9625-92a7230b2397 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48ee960c38f4d0584ea5ce34579279f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a957b6585e74a31b5bc5f66441c33e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:19.589821 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-67d2468c-c8ae-4285-9625-92a7230b2397 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706" status: 200 len: 1506 microversion: 2.1 time: 0.409279 Aug 31 16:15:19.603607 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2099/4184] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:19 2022] GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706 => generated 1506 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:19.603607 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c2baf590-b4c6-47c3-b12b-db2108e4b3e8 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:19.603607 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c2baf590-b4c6-47c3-b12b-db2108e4b3e8 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] [instance: 644d0221-94ca-4873-8fe0-ab72c4d7d68b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:19.603607 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c2baf590-b4c6-47c3-b12b-db2108e4b3e8 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:19.603607 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c2baf590-b4c6-47c3-b12b-db2108e4b3e8 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:19.603607 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c2baf590-b4c6-47c3-b12b-db2108e4b3e8 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:19.604318 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c2baf590-b4c6-47c3-b12b-db2108e4b3e8 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:19.604628 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c2baf590-b4c6-47c3-b12b-db2108e4b3e8 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:19.605522 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c2baf590-b4c6-47c3-b12b-db2108e4b3e8 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:19.634953 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a74406df-a364-4242-be59-34a5a89eeb91 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed06378eb9b446680b5a3156a14941d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511432a7dee4bec9d1093c9d95b3734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:19.644432 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a74406df-a364-4242-be59-34a5a89eeb91 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] 10.222.0.61 "GET /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2" status: 200 len: 1708 microversion: 2.1 time: 0.218315 Aug 31 16:15:19.653264 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2086/4185] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:19 2022] GET /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2 => generated 1708 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:19.653264 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b484b8ee-68a3-4f4f-bbd9-7fca5396c393 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:19.653264 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b484b8ee-68a3-4f4f-bbd9-7fca5396c393 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: c4ef985e-0861-4c5d-88eb-d8ad053a8f54] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:19.659295 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b484b8ee-68a3-4f4f-bbd9-7fca5396c393 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:19.659819 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b484b8ee-68a3-4f4f-bbd9-7fca5396c393 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:19.660254 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b484b8ee-68a3-4f4f-bbd9-7fca5396c393 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:19.660956 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b484b8ee-68a3-4f4f-bbd9-7fca5396c393 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:19.661410 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b484b8ee-68a3-4f4f-bbd9-7fca5396c393 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:19.661830 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b484b8ee-68a3-4f4f-bbd9-7fca5396c393 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:19.848462 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c2baf590-b4c6-47c3-b12b-db2108e4b3e8 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860ac4e423cf410d9bbc354c77ba864c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aada201b2fd64fdc81a69f826e7c607b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:19.856324 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c2baf590-b4c6-47c3-b12b-db2108e4b3e8 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] 10.222.0.61 "GET /compute/v2.1/servers/644d0221-94ca-4873-8fe0-ab72c4d7d68b" status: 200 len: 1803 microversion: 2.1 time: 0.264598 Aug 31 16:15:19.856922 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2100/4186] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:19 2022] GET /compute/v2.1/servers/644d0221-94ca-4873-8fe0-ab72c4d7d68b => generated 1803 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:19.878871 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f285b575-e390-4a46-8236-5a48d371664e tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:19.880038 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f285b575-e390-4a46-8236-5a48d371664e tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] [instance: 644d0221-94ca-4873-8fe0-ab72c4d7d68b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:19.882316 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b484b8ee-68a3-4f4f-bbd9-7fca5396c393 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb261f2061164b49a8d496b16647dd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d2222a956a4888967e21647e26b310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:19.886091 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f285b575-e390-4a46-8236-5a48d371664e tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:19.886592 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f285b575-e390-4a46-8236-5a48d371664e tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:19.887036 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f285b575-e390-4a46-8236-5a48d371664e tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:19.887902 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f285b575-e390-4a46-8236-5a48d371664e tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:19.888367 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f285b575-e390-4a46-8236-5a48d371664e tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:19.888800 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f285b575-e390-4a46-8236-5a48d371664e tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:19.890191 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b484b8ee-68a3-4f4f-bbd9-7fca5396c393 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "GET /compute/v2.1/servers/c4ef985e-0861-4c5d-88eb-d8ad053a8f54" status: 200 len: 1317 microversion: 2.1 time: 0.244226 Aug 31 16:15:19.890766 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2087/4187] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:19 2022] GET /compute/v2.1/servers/c4ef985e-0861-4c5d-88eb-d8ad053a8f54 => generated 1317 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:19.915283 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f285b575-e390-4a46-8236-5a48d371664e tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] 10.222.0.61 "GET /compute/v2.1/servers/644d0221-94ca-4873-8fe0-ab72c4d7d68b/ips" status: 200 len: 216 microversion: 2.1 time: 0.040982 Aug 31 16:15:19.915896 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2101/4188] 10.222.0.61 () {58 vars in 1248 bytes} [Wed Aug 31 16:15:19 2022] GET /compute/v2.1/servers/644d0221-94ca-4873-8fe0-ab72c4d7d68b/ips => generated 216 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:15:19.927093 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ec200127-d350-47b4-933e-8c82d48bf38a tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:19.927608 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ec200127-d350-47b4-933e-8c82d48bf38a tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] [instance: 644d0221-94ca-4873-8fe0-ab72c4d7d68b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:19.933594 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ec200127-d350-47b4-933e-8c82d48bf38a tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:19.934073 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ec200127-d350-47b4-933e-8c82d48bf38a tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:19.934509 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ec200127-d350-47b4-933e-8c82d48bf38a tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:19.935209 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ec200127-d350-47b4-933e-8c82d48bf38a tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:19.935842 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ec200127-d350-47b4-933e-8c82d48bf38a tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:19.936264 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ec200127-d350-47b4-933e-8c82d48bf38a tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:19.962748 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-1c1e3ba6-8a1c-490b-989d-cfb47224375b req-62395137-c2ae-4480-8c93-b9d52b166226 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42ccbb85-9677-4cb9-879a-dc280cda020c", "name": "network-vif-plugged", "status": "completed", "tag": "44b19fab-a1b0-47af-8c78-4bab130a016b"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:15:19.964103 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ec200127-d350-47b4-933e-8c82d48bf38a tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] [instance: 644d0221-94ca-4873-8fe0-ab72c4d7d68b] Going to try to terminate instance {{(pid=122256) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:15:19.973636 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-1c1e3ba6-8a1c-490b-989d-cfb47224375b req-62395137-c2ae-4480-8c93-b9d52b166226 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:19.974124 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-1c1e3ba6-8a1c-490b-989d-cfb47224375b req-62395137-c2ae-4480-8c93-b9d52b166226 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:19.974562 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-1c1e3ba6-8a1c-490b-989d-cfb47224375b req-62395137-c2ae-4480-8c93-b9d52b166226 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:19.985959 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-1c1e3ba6-8a1c-490b-989d-cfb47224375b req-62395137-c2ae-4480-8c93-b9d52b166226 service nova] Creating event network-vif-plugged:44b19fab-a1b0-47af-8c78-4bab130a016b for instance 42ccbb85-9677-4cb9-879a-dc280cda020c on n-h2-850499-9 Aug 31 16:15:19.992180 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-1c1e3ba6-8a1c-490b-989d-cfb47224375b req-62395137-c2ae-4480-8c93-b9d52b166226 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033411 Aug 31 16:15:19.993104 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2102/4189] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:15:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:15:19.994927 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:15:20.052881 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ec200127-d350-47b4-933e-8c82d48bf38a tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] 10.222.0.61 "DELETE /compute/v2.1/servers/644d0221-94ca-4873-8fe0-ab72c4d7d68b" status: 204 len: 0 microversion: 2.1 time: 0.129384 Aug 31 16:15:20.053595 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2088/4190] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:15:19 2022] DELETE /compute/v2.1/servers/644d0221-94ca-4873-8fe0-ab72c4d7d68b => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:15:20.062534 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2f7c469a-3e31-4e9a-9f22-6e14dff39a93 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:20.063314 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2f7c469a-3e31-4e9a-9f22-6e14dff39a93 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] [instance: 644d0221-94ca-4873-8fe0-ab72c4d7d68b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:20.070220 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2f7c469a-3e31-4e9a-9f22-6e14dff39a93 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:20.070719 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2f7c469a-3e31-4e9a-9f22-6e14dff39a93 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:20.071173 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2f7c469a-3e31-4e9a-9f22-6e14dff39a93 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:20.072110 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2f7c469a-3e31-4e9a-9f22-6e14dff39a93 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:20.072974 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2f7c469a-3e31-4e9a-9f22-6e14dff39a93 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:20.073790 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2f7c469a-3e31-4e9a-9f22-6e14dff39a93 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:20.190849 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-594ab006-94e8-4bf9-9d51-4d09cc3fa2c2 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:20.192268 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-594ab006-94e8-4bf9-9d51-4d09cc3fa2c2 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] [instance: 64136c5d-b1e6-4263-a450-3308b0b4f69b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:20.198851 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-594ab006-94e8-4bf9-9d51-4d09cc3fa2c2 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:20.199345 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-594ab006-94e8-4bf9-9d51-4d09cc3fa2c2 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:20.199808 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-594ab006-94e8-4bf9-9d51-4d09cc3fa2c2 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:20.200509 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-594ab006-94e8-4bf9-9d51-4d09cc3fa2c2 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:20.200958 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-594ab006-94e8-4bf9-9d51-4d09cc3fa2c2 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:20.201385 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-594ab006-94e8-4bf9-9d51-4d09cc3fa2c2 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:20.224406 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2f7c469a-3e31-4e9a-9f22-6e14dff39a93 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860ac4e423cf410d9bbc354c77ba864c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aada201b2fd64fdc81a69f826e7c607b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:20.232225 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2f7c469a-3e31-4e9a-9f22-6e14dff39a93 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] 10.222.0.61 "GET /compute/v2.1/servers/644d0221-94ca-4873-8fe0-ab72c4d7d68b" status: 200 len: 1809 microversion: 2.1 time: 0.173827 Aug 31 16:15:20.232806 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2103/4191] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:20 2022] GET /compute/v2.1/servers/644d0221-94ca-4873-8fe0-ab72c4d7d68b => generated 1809 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:20.248849 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-27eea59d-079c-4101-8813-59b32f1c122d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:20.249469 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-27eea59d-079c-4101-8813-59b32f1c122d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:20.256516 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-27eea59d-079c-4101-8813-59b32f1c122d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:20.257011 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-27eea59d-079c-4101-8813-59b32f1c122d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:20.257452 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-27eea59d-079c-4101-8813-59b32f1c122d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:20.258156 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-27eea59d-079c-4101-8813-59b32f1c122d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:20.258618 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-27eea59d-079c-4101-8813-59b32f1c122d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:20.259056 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-27eea59d-079c-4101-8813-59b32f1c122d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:20.401118 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-594ab006-94e8-4bf9-9d51-4d09cc3fa2c2 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d6eee711fe4194a4db63c801f78561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeac74d3027d4080be26bf3aadab4c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:20.410158 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-594ab006-94e8-4bf9-9d51-4d09cc3fa2c2 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] 10.222.0.61 "GET /compute/v2.1/servers/64136c5d-b1e6-4263-a450-3308b0b4f69b" status: 200 len: 1318 microversion: 2.1 time: 0.224004 Aug 31 16:15:20.424097 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2089/4192] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:20 2022] GET /compute/v2.1/servers/64136c5d-b1e6-4263-a450-3308b0b4f69b => generated 1318 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:15:20.447014 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-091bd041-d4f8-4b2a-90b5-12c6fc9da21d tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:20.452268 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-091bd041-d4f8-4b2a-90b5-12c6fc9da21d tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: d78f1dfc-6152-4180-84be-f6a84b75dbc2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:20.452785 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-27eea59d-079c-4101-8813-59b32f1c122d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:20.464462 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-091bd041-d4f8-4b2a-90b5-12c6fc9da21d tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:20.465231 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-091bd041-d4f8-4b2a-90b5-12c6fc9da21d tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:20.465839 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-091bd041-d4f8-4b2a-90b5-12c6fc9da21d tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:20.466400 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-27eea59d-079c-4101-8813-59b32f1c122d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1363 microversion: 2.1 time: 0.221149 Aug 31 16:15:20.466901 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-091bd041-d4f8-4b2a-90b5-12c6fc9da21d tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:20.467522 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2104/4193] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:20 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1363 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:20.467785 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-091bd041-d4f8-4b2a-90b5-12c6fc9da21d tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:20.468405 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-091bd041-d4f8-4b2a-90b5-12c6fc9da21d tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:20.542433 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-091bd041-d4f8-4b2a-90b5-12c6fc9da21d tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:20.552332 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-091bd041-d4f8-4b2a-90b5-12c6fc9da21d tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/d78f1dfc-6152-4180-84be-f6a84b75dbc2" status: 200 len: 1452 microversion: 2.1 time: 0.109150 Aug 31 16:15:20.553311 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2090/4194] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:20 2022] GET /compute/v2.1/servers/d78f1dfc-6152-4180-84be-f6a84b75dbc2 => generated 1452 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:15:20.614986 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-fcb018a3-0177-4cc1-abcd-fbccefcd7bea tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:20.615544 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-fcb018a3-0177-4cc1-abcd-fbccefcd7bea tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: e3625fdf-7e50-4ba1-99dc-6ae7473fc706] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:20.621861 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fcb018a3-0177-4cc1-abcd-fbccefcd7bea tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:20.622590 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fcb018a3-0177-4cc1-abcd-fbccefcd7bea tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:20.623043 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fcb018a3-0177-4cc1-abcd-fbccefcd7bea tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:20.623780 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fcb018a3-0177-4cc1-abcd-fbccefcd7bea tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:20.624278 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fcb018a3-0177-4cc1-abcd-fbccefcd7bea tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:20.624710 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fcb018a3-0177-4cc1-abcd-fbccefcd7bea tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:20.666248 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-24cf6e15-72e2-48a2-bc20-799f22dca9e1 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:20.666929 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-24cf6e15-72e2-48a2-bc20-799f22dca9e1 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] [instance: f04eb48d-000e-4c3b-8799-a4d3cdacf0e2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:20.672825 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-24cf6e15-72e2-48a2-bc20-799f22dca9e1 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:20.674096 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-24cf6e15-72e2-48a2-bc20-799f22dca9e1 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:20.674605 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-24cf6e15-72e2-48a2-bc20-799f22dca9e1 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:20.675246 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-24cf6e15-72e2-48a2-bc20-799f22dca9e1 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:20.675739 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-24cf6e15-72e2-48a2-bc20-799f22dca9e1 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:20.676163 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-24cf6e15-72e2-48a2-bc20-799f22dca9e1 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:21.089356 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-fcb018a3-0177-4cc1-abcd-fbccefcd7bea tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48ee960c38f4d0584ea5ce34579279f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a957b6585e74a31b5bc5f66441c33e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:21.098032 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-fcb018a3-0177-4cc1-abcd-fbccefcd7bea tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706" status: 200 len: 1506 microversion: 2.1 time: 0.490492 Aug 31 16:15:21.098638 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2105/4195] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:20 2022] GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706 => generated 1506 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:21.104483 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-78d8b02b-4d17-4665-ae86-fb4f810a69e9 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:21.105105 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-78d8b02b-4d17-4665-ae86-fb4f810a69e9 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: c4ef985e-0861-4c5d-88eb-d8ad053a8f54] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:21.108930 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-24cf6e15-72e2-48a2-bc20-799f22dca9e1 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed06378eb9b446680b5a3156a14941d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511432a7dee4bec9d1093c9d95b3734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:21.112567 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-78d8b02b-4d17-4665-ae86-fb4f810a69e9 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:21.113091 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-78d8b02b-4d17-4665-ae86-fb4f810a69e9 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:21.113533 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-78d8b02b-4d17-4665-ae86-fb4f810a69e9 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:21.114247 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-78d8b02b-4d17-4665-ae86-fb4f810a69e9 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:21.114704 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-78d8b02b-4d17-4665-ae86-fb4f810a69e9 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:21.115141 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-78d8b02b-4d17-4665-ae86-fb4f810a69e9 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:21.119234 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-24cf6e15-72e2-48a2-bc20-799f22dca9e1 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] 10.222.0.61 "GET /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2" status: 200 len: 1708 microversion: 2.1 time: 0.456849 Aug 31 16:15:21.119978 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2091/4196] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:20 2022] GET /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2 => generated 1708 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:15:21.253860 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-78d8b02b-4d17-4665-ae86-fb4f810a69e9 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb261f2061164b49a8d496b16647dd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d2222a956a4888967e21647e26b310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:21.254416 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-786cfde2-2651-4954-a427-53b2a2809a66 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:21.254774 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-786cfde2-2651-4954-a427-53b2a2809a66 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] [instance: 644d0221-94ca-4873-8fe0-ab72c4d7d68b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:21.261219 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-786cfde2-2651-4954-a427-53b2a2809a66 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:21.261846 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-786cfde2-2651-4954-a427-53b2a2809a66 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:21.262447 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-786cfde2-2651-4954-a427-53b2a2809a66 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:21.263338 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-786cfde2-2651-4954-a427-53b2a2809a66 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:21.263888 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-786cfde2-2651-4954-a427-53b2a2809a66 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:21.264040 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-78d8b02b-4d17-4665-ae86-fb4f810a69e9 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "GET /compute/v2.1/servers/c4ef985e-0861-4c5d-88eb-d8ad053a8f54" status: 200 len: 1317 microversion: 2.1 time: 0.163739 Aug 31 16:15:21.264717 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-786cfde2-2651-4954-a427-53b2a2809a66 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:21.264888 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2106/4197] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:21 2022] GET /compute/v2.1/servers/c4ef985e-0861-4c5d-88eb-d8ad053a8f54 => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:21.418797 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-786cfde2-2651-4954-a427-53b2a2809a66 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860ac4e423cf410d9bbc354c77ba864c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aada201b2fd64fdc81a69f826e7c607b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:21.426628 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-786cfde2-2651-4954-a427-53b2a2809a66 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] 10.222.0.61 "GET /compute/v2.1/servers/644d0221-94ca-4873-8fe0-ab72c4d7d68b" status: 200 len: 1809 microversion: 2.1 time: 0.176569 Aug 31 16:15:21.427943 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2092/4198] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:21 2022] GET /compute/v2.1/servers/644d0221-94ca-4873-8fe0-ab72c4d7d68b => generated 1809 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:21.432436 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a0c4c0c7-f84d-4110-889a-9ef0c16baf2a tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:21.433288 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a0c4c0c7-f84d-4110-889a-9ef0c16baf2a tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] [instance: 64136c5d-b1e6-4263-a450-3308b0b4f69b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:21.440421 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a0c4c0c7-f84d-4110-889a-9ef0c16baf2a tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:21.440926 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a0c4c0c7-f84d-4110-889a-9ef0c16baf2a tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:21.441372 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a0c4c0c7-f84d-4110-889a-9ef0c16baf2a tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:21.442084 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a0c4c0c7-f84d-4110-889a-9ef0c16baf2a tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:21.442548 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a0c4c0c7-f84d-4110-889a-9ef0c16baf2a tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:21.442985 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a0c4c0c7-f84d-4110-889a-9ef0c16baf2a tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:21.488580 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d67aa39a-2622-4e04-bcde-792f89a4b89a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:21.489366 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d67aa39a-2622-4e04-bcde-792f89a4b89a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:21.495593 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d67aa39a-2622-4e04-bcde-792f89a4b89a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:21.496098 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d67aa39a-2622-4e04-bcde-792f89a4b89a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:21.496535 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d67aa39a-2622-4e04-bcde-792f89a4b89a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:21.497249 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d67aa39a-2622-4e04-bcde-792f89a4b89a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:21.497710 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d67aa39a-2622-4e04-bcde-792f89a4b89a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:21.498142 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d67aa39a-2622-4e04-bcde-792f89a4b89a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:21.647231 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a0c4c0c7-f84d-4110-889a-9ef0c16baf2a tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d6eee711fe4194a4db63c801f78561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeac74d3027d4080be26bf3aadab4c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:21.655598 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a0c4c0c7-f84d-4110-889a-9ef0c16baf2a tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] 10.222.0.61 "GET /compute/v2.1/servers/64136c5d-b1e6-4263-a450-3308b0b4f69b" status: 200 len: 1318 microversion: 2.1 time: 0.227371 Aug 31 16:15:21.656869 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2107/4199] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:21 2022] GET /compute/v2.1/servers/64136c5d-b1e6-4263-a450-3308b0b4f69b => generated 1318 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:15:21.662165 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2369a8e2-5058-4b95-ab47-b03d041cec4f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:21.662795 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2369a8e2-5058-4b95-ab47-b03d041cec4f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: d78f1dfc-6152-4180-84be-f6a84b75dbc2] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:21.666807 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=100 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:15:21.670756 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2369a8e2-5058-4b95-ab47-b03d041cec4f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:21.671257 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2369a8e2-5058-4b95-ab47-b03d041cec4f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:21.671733 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2369a8e2-5058-4b95-ab47-b03d041cec4f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:21.672445 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2369a8e2-5058-4b95-ab47-b03d041cec4f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:21.672946 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2369a8e2-5058-4b95-ab47-b03d041cec4f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:21.674121 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2369a8e2-5058-4b95-ab47-b03d041cec4f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:21.677858 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d67aa39a-2622-4e04-bcde-792f89a4b89a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:21.685725 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d67aa39a-2622-4e04-bcde-792f89a4b89a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1363 microversion: 2.1 time: 0.201867 Aug 31 16:15:21.686300 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2093/4200] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:21 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1363 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:15:21.708093 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2369a8e2-5058-4b95-ab47-b03d041cec4f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:21.708509 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2369a8e2-5058-4b95-ab47-b03d041cec4f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:21.708954 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2369a8e2-5058-4b95-ab47-b03d041cec4f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:21.709407 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-2369a8e2-5058-4b95-ab47-b03d041cec4f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lazy-loading 'fault' on Instance uuid d78f1dfc-6152-4180-84be-f6a84b75dbc2 {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:15:21.750124 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2369a8e2-5058-4b95-ab47-b03d041cec4f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:21.758087 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2369a8e2-5058-4b95-ab47-b03d041cec4f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/d78f1dfc-6152-4180-84be-f6a84b75dbc2" status: 200 len: 1310 microversion: 2.1 time: 0.100792 Aug 31 16:15:21.758669 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2108/4201] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:21 2022] GET /compute/v2.1/servers/d78f1dfc-6152-4180-84be-f6a84b75dbc2 => generated 1310 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:22.016548 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-86151f01-1998-4f63-b49c-dec3bf970eeb req-1a93b01d-93f4-4a77-aa92-2e0106e81823 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4ef985e-0861-4c5d-88eb-d8ad053a8f54", "name": "network-vif-plugged", "status": "completed", "tag": "e616625c-3e6f-4ab3-a8fe-75faeba8be2a"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:15:22.028693 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-86151f01-1998-4f63-b49c-dec3bf970eeb req-1a93b01d-93f4-4a77-aa92-2e0106e81823 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:22.029472 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-86151f01-1998-4f63-b49c-dec3bf970eeb req-1a93b01d-93f4-4a77-aa92-2e0106e81823 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:22.030103 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-86151f01-1998-4f63-b49c-dec3bf970eeb req-1a93b01d-93f4-4a77-aa92-2e0106e81823 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:22.043160 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-86151f01-1998-4f63-b49c-dec3bf970eeb req-1a93b01d-93f4-4a77-aa92-2e0106e81823 service nova] Creating event network-vif-plugged:e616625c-3e6f-4ab3-a8fe-75faeba8be2a for instance c4ef985e-0861-4c5d-88eb-d8ad053a8f54 on n-h1-850499-9 Aug 31 16:15:22.049004 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-86151f01-1998-4f63-b49c-dec3bf970eeb req-1a93b01d-93f4-4a77-aa92-2e0106e81823 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035583 Aug 31 16:15:22.052594 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2094/4202] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:15:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:15:22.120583 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0df1c1bc-bd74-4599-832e-674a3374e7d7 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:22.121342 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0df1c1bc-bd74-4599-832e-674a3374e7d7 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: e3625fdf-7e50-4ba1-99dc-6ae7473fc706] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:22.129517 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0df1c1bc-bd74-4599-832e-674a3374e7d7 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:22.130148 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0df1c1bc-bd74-4599-832e-674a3374e7d7 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:22.130659 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0df1c1bc-bd74-4599-832e-674a3374e7d7 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:22.131482 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0df1c1bc-bd74-4599-832e-674a3374e7d7 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:22.132041 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0df1c1bc-bd74-4599-832e-674a3374e7d7 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:22.132545 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0df1c1bc-bd74-4599-832e-674a3374e7d7 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:22.138611 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=100 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:15:22.142238 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-cbeb3ef2-8915-4982-be2b-0672f6def259 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:22.143490 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-cbeb3ef2-8915-4982-be2b-0672f6def259 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] [instance: f04eb48d-000e-4c3b-8799-a4d3cdacf0e2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:22.150861 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cbeb3ef2-8915-4982-be2b-0672f6def259 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:22.151458 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cbeb3ef2-8915-4982-be2b-0672f6def259 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:22.151985 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cbeb3ef2-8915-4982-be2b-0672f6def259 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:22.153085 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cbeb3ef2-8915-4982-be2b-0672f6def259 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:22.153620 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cbeb3ef2-8915-4982-be2b-0672f6def259 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:22.154166 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cbeb3ef2-8915-4982-be2b-0672f6def259 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:22.815902 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-cbeb3ef2-8915-4982-be2b-0672f6def259 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed06378eb9b446680b5a3156a14941d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511432a7dee4bec9d1093c9d95b3734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:22.827303 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-cbeb3ef2-8915-4982-be2b-0672f6def259 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] 10.222.0.61 "GET /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2" status: 200 len: 1708 microversion: 2.1 time: 0.690261 Aug 31 16:15:22.836184 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0df1c1bc-bd74-4599-832e-674a3374e7d7 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48ee960c38f4d0584ea5ce34579279f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a957b6585e74a31b5bc5f66441c33e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:22.840923 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2095/4203] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:22 2022] GET /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2 => generated 1708 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:15:22.844163 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0df1c1bc-bd74-4599-832e-674a3374e7d7 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706" status: 200 len: 1506 microversion: 2.1 time: 0.727823 Aug 31 16:15:22.849201 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f31f0148-3ee2-4ece-9d8a-f283494ab94d tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:22.849821 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f31f0148-3ee2-4ece-9d8a-f283494ab94d tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: c4ef985e-0861-4c5d-88eb-d8ad053a8f54] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:22.856364 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f31f0148-3ee2-4ece-9d8a-f283494ab94d tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:22.856851 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f31f0148-3ee2-4ece-9d8a-f283494ab94d tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:22.857288 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f31f0148-3ee2-4ece-9d8a-f283494ab94d tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:22.858195 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f31f0148-3ee2-4ece-9d8a-f283494ab94d tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:22.858613 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f31f0148-3ee2-4ece-9d8a-f283494ab94d tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:22.859230 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f31f0148-3ee2-4ece-9d8a-f283494ab94d tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:22.861557 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2109/4204] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:22 2022] GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706 => generated 1506 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:22.868713 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-81b999c2-f9ce-45c3-a92a-561b753de841 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:22.869539 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-81b999c2-f9ce-45c3-a92a-561b753de841 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] [instance: 644d0221-94ca-4873-8fe0-ab72c4d7d68b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:22.877991 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-81b999c2-f9ce-45c3-a92a-561b753de841 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:22.878641 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-81b999c2-f9ce-45c3-a92a-561b753de841 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:22.879696 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-81b999c2-f9ce-45c3-a92a-561b753de841 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:22.880979 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-81b999c2-f9ce-45c3-a92a-561b753de841 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:22.882254 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-81b999c2-f9ce-45c3-a92a-561b753de841 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:22.882820 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-81b999c2-f9ce-45c3-a92a-561b753de841 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:23.243831 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f31f0148-3ee2-4ece-9d8a-f283494ab94d tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb261f2061164b49a8d496b16647dd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d2222a956a4888967e21647e26b310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:23.261237 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f31f0148-3ee2-4ece-9d8a-f283494ab94d tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "GET /compute/v2.1/servers/c4ef985e-0861-4c5d-88eb-d8ad053a8f54" status: 200 len: 1317 microversion: 2.1 time: 0.418939 Aug 31 16:15:23.262019 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2096/4205] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:22 2022] GET /compute/v2.1/servers/c4ef985e-0861-4c5d-88eb-d8ad053a8f54 => generated 1317 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:23.266715 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d08609d9-34f5-4b17-a0f9-9d110c3ef5fc tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:23.267404 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d08609d9-34f5-4b17-a0f9-9d110c3ef5fc tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] [instance: 64136c5d-b1e6-4263-a450-3308b0b4f69b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:23.280285 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-81b999c2-f9ce-45c3-a92a-561b753de841 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860ac4e423cf410d9bbc354c77ba864c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aada201b2fd64fdc81a69f826e7c607b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:23.286344 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d08609d9-34f5-4b17-a0f9-9d110c3ef5fc tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:23.287654 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d08609d9-34f5-4b17-a0f9-9d110c3ef5fc tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:23.288257 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d08609d9-34f5-4b17-a0f9-9d110c3ef5fc tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:23.289186 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d08609d9-34f5-4b17-a0f9-9d110c3ef5fc tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:23.289836 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d08609d9-34f5-4b17-a0f9-9d110c3ef5fc tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:23.291126 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d08609d9-34f5-4b17-a0f9-9d110c3ef5fc tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:23.295020 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-81b999c2-f9ce-45c3-a92a-561b753de841 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] 10.222.0.61 "GET /compute/v2.1/servers/644d0221-94ca-4873-8fe0-ab72c4d7d68b" status: 200 len: 1788 microversion: 2.1 time: 0.432178 Aug 31 16:15:23.296306 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2110/4206] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:22 2022] GET /compute/v2.1/servers/644d0221-94ca-4873-8fe0-ab72c4d7d68b => generated 1788 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:23.304272 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-90529dbf-dc17-4a75-85b4-7edc2bd0a3e5 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:23.306864 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-90529dbf-dc17-4a75-85b4-7edc2bd0a3e5 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:23.314638 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-90529dbf-dc17-4a75-85b4-7edc2bd0a3e5 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:23.315281 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-90529dbf-dc17-4a75-85b4-7edc2bd0a3e5 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:23.316025 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-90529dbf-dc17-4a75-85b4-7edc2bd0a3e5 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:23.317027 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-90529dbf-dc17-4a75-85b4-7edc2bd0a3e5 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:23.317730 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-90529dbf-dc17-4a75-85b4-7edc2bd0a3e5 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:23.318452 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-90529dbf-dc17-4a75-85b4-7edc2bd0a3e5 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:23.734648 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d08609d9-34f5-4b17-a0f9-9d110c3ef5fc tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d6eee711fe4194a4db63c801f78561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeac74d3027d4080be26bf3aadab4c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:23.744106 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d08609d9-34f5-4b17-a0f9-9d110c3ef5fc tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] 10.222.0.61 "GET /compute/v2.1/servers/64136c5d-b1e6-4263-a450-3308b0b4f69b" status: 200 len: 1318 microversion: 2.1 time: 0.480945 Aug 31 16:15:23.758731 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2097/4207] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:23 2022] GET /compute/v2.1/servers/64136c5d-b1e6-4263-a450-3308b0b4f69b => generated 1318 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:23.763937 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2aff4cf7-2298-42c3-a01d-f8517710c51e tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:23.764566 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2aff4cf7-2298-42c3-a01d-f8517710c51e tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: d78f1dfc-6152-4180-84be-f6a84b75dbc2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:23.772077 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2aff4cf7-2298-42c3-a01d-f8517710c51e tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:23.772582 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2aff4cf7-2298-42c3-a01d-f8517710c51e tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:23.773229 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2aff4cf7-2298-42c3-a01d-f8517710c51e tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:23.774148 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2aff4cf7-2298-42c3-a01d-f8517710c51e tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:23.787151 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2aff4cf7-2298-42c3-a01d-f8517710c51e tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:23.787993 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2aff4cf7-2298-42c3-a01d-f8517710c51e tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:23.793307 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-90529dbf-dc17-4a75-85b4-7edc2bd0a3e5 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:23.817153 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-2aff4cf7-2298-42c3-a01d-f8517710c51e tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] HTTP exception thrown: Instance d78f1dfc-6152-4180-84be-f6a84b75dbc2 could not be found. Aug 31 16:15:23.821205 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2aff4cf7-2298-42c3-a01d-f8517710c51e tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Request method failure captured: Aug 31 16:15:23.821205 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/d78f1dfc-6152-4180-84be-f6a84b75dbc2 HTTP/1.1 Aug 31 16:15:23.821205 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:15:23.821205 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:15:23.821205 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:15:23.821205 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:15:23.821205 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:15:23.821205 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:15:23.821205 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:15:23.821205 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:15:23.821205 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4gQXSNpx7T-s6ANX8A4XIz6BgCizm9VWKy6e0KLRI2pxjPOEzPLkRnoXGF3D-Jh3OWl1h65DNjP8YomYmS0bGyt_8avVSC7qeEvUleLImq7o7EhFYQT7JAMgMioD10eCPOZ7QHRsEPDslLrPXcQD5t1iAsH1xyWK7dbpfjoYLGjDpU Aug 31 16:15:23.821205 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:15:23.821205 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:15:23.821205 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:15:23.821205 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:15:23.821205 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:15:23.821205 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:15:23.821205 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 5299955053c842b6aa02e058f4b1c0cb Aug 31 16:15:23.821205 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ServersTestJSON-1028152372 Aug 31 16:15:23.821205 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:15:23.821205 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:15:23.821205 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5299955053c842b6aa02e058f4b1c0cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5299955053c842b6aa02e058f4b1c0cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5299955053c842b6aa02e058f4b1c0cb", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5299955053c842b6aa02e058f4b1c0cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:15:23.821205 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ServersTestJSON-1028152372 Aug 31 16:15:23.821205 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 5299955053c842b6aa02e058f4b1c0cb Aug 31 16:15:23.821205 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ServersTestJSON-1028152372 Aug 31 16:15:23.821205 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ServersTestJSON-1028152372-project Aug 31 16:15:23.821205 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:15:23.821205 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:15:23.821205 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 6e707652819c497bbdf94f85f39c447a Aug 31 16:15:23.821205 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ServersTestJSON-1028152372-project Aug 31 16:15:23.821205 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:15:23.821205 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance d78f1dfc-6152-4180-84be-f6a84b75dbc2 could not be found. Aug 31 16:15:23.821205 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': 'd78f1dfc-6152-4180-84be-f6a84b75dbc2'} Aug 31 16:15:23.821205 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:15:23.821205 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:23.821205 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:15:23.821205 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:15:23.821205 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:15:23.821205 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:15:23.821205 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:15:23.821205 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:15:23.821205 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:15:23.821205 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:15:23.821205 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d78f1dfc-6152-4180-84be-f6a84b75dbc2 could not be found. Aug 31 16:15:23.821205 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:15:23.821205 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:15:23.821205 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:15:23.821205 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:23.821205 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:15:23.821205 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:15:23.821205 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:15:23.821205 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:15:23.821205 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:15:23.821205 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:15:23.821205 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:15:23.821205 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:15:23.821205 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:15:23.821205 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:15:23.821205 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:15:23.821205 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:15:23.821205 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d78f1dfc-6152-4180-84be-f6a84b75dbc2 could not be found. Aug 31 16:15:23.821205 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:15:23.821205 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:15:23.821205 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:15:23.827218 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:23.827218 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:15:23.827218 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:15:23.827218 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:15:23.827218 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:15:23.827218 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d78f1dfc-6152-4180-84be-f6a84b75dbc2 could not be found. Aug 31 16:15:23.827218 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:15:23.829067 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2aff4cf7-2298-42c3-a01d-f8517710c51e tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Returning 404 to user: Instance d78f1dfc-6152-4180-84be-f6a84b75dbc2 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:15:23.830680 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2aff4cf7-2298-42c3-a01d-f8517710c51e tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/d78f1dfc-6152-4180-84be-f6a84b75dbc2" status: 404 len: 111 microversion: 2.1 time: 0.070277 Aug 31 16:15:23.831821 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2098/4208] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:23 2022] GET /compute/v2.1/servers/d78f1dfc-6152-4180-84be-f6a84b75dbc2 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:15:23.837476 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-09e4c4ea-64b3-4899-ae51-9b292d76cead req-66a35717-3da9-4d14-a5bc-93e90d081556 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "644d0221-94ca-4873-8fe0-ab72c4d7d68b", "name": "network-vif-deleted", "tag": "baeb1fd4-d97f-4ce2-b2c6-d38018e8c8a1"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:15:23.837840 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-90529dbf-dc17-4a75-85b4-7edc2bd0a3e5 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1549 microversion: 2.1 time: 0.537356 Aug 31 16:15:23.841771 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2111/4209] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:23 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1549 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:23.851041 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-09e4c4ea-64b3-4899-ae51-9b292d76cead req-66a35717-3da9-4d14-a5bc-93e90d081556 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:23.852712 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-09e4c4ea-64b3-4899-ae51-9b292d76cead req-66a35717-3da9-4d14-a5bc-93e90d081556 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:23.853346 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-09e4c4ea-64b3-4899-ae51-9b292d76cead req-66a35717-3da9-4d14-a5bc-93e90d081556 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:23.872581 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-08db8046-3267-4f17-92f9-76f6244c5d8b tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:23.873973 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-09e4c4ea-64b3-4899-ae51-9b292d76cead req-66a35717-3da9-4d14-a5bc-93e90d081556 service nova] Creating event network-vif-deleted:baeb1fd4-d97f-4ce2-b2c6-d38018e8c8a1 for instance 644d0221-94ca-4873-8fe0-ab72c4d7d68b on n-h1-850499-9 Aug 31 16:15:23.876893 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-08db8046-3267-4f17-92f9-76f6244c5d8b tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: d78f1dfc-6152-4180-84be-f6a84b75dbc2] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:23.883030 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-09e4c4ea-64b3-4899-ae51-9b292d76cead req-66a35717-3da9-4d14-a5bc-93e90d081556 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049473 Aug 31 16:15:23.884799 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2099/4210] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:15:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:15:23.894367 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-16e8249d-a09c-4611-b5ea-b7c9ceaad7cd tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:23.895353 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-16e8249d-a09c-4611-b5ea-b7c9ceaad7cd tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] [instance: f04eb48d-000e-4c3b-8799-a4d3cdacf0e2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:23.903271 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-16e8249d-a09c-4611-b5ea-b7c9ceaad7cd tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:23.904125 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-16e8249d-a09c-4611-b5ea-b7c9ceaad7cd tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:23.904761 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-16e8249d-a09c-4611-b5ea-b7c9ceaad7cd tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:23.905670 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-16e8249d-a09c-4611-b5ea-b7c9ceaad7cd tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:23.906207 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-08db8046-3267-4f17-92f9-76f6244c5d8b tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:23.906721 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-16e8249d-a09c-4611-b5ea-b7c9ceaad7cd tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:23.906862 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-08db8046-3267-4f17-92f9-76f6244c5d8b tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:23.908485 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-16e8249d-a09c-4611-b5ea-b7c9ceaad7cd tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:23.909646 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-08db8046-3267-4f17-92f9-76f6244c5d8b tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:23.910462 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-08db8046-3267-4f17-92f9-76f6244c5d8b tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:23.910951 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-08db8046-3267-4f17-92f9-76f6244c5d8b tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:23.916830 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-08db8046-3267-4f17-92f9-76f6244c5d8b tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:23.950894 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-08db8046-3267-4f17-92f9-76f6244c5d8b tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] HTTP exception thrown: Instance d78f1dfc-6152-4180-84be-f6a84b75dbc2 could not be found. Aug 31 16:15:23.952670 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-08db8046-3267-4f17-92f9-76f6244c5d8b tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Request method failure captured: Aug 31 16:15:23.952670 n-d-850499-9 devstack@n-api.service[122257]: request: DELETE /compute/v2.1/servers/d78f1dfc-6152-4180-84be-f6a84b75dbc2 HTTP/1.1 Aug 31 16:15:23.952670 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:15:23.952670 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:15:23.952670 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:15:23.952670 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:15:23.952670 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:15:23.952670 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:15:23.952670 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:15:23.952670 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:15:23.952670 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4gQXSNpx7T-s6ANX8A4XIz6BgCizm9VWKy6e0KLRI2pxjPOEzPLkRnoXGF3D-Jh3OWl1h65DNjP8YomYmS0bGyt_8avVSC7qeEvUleLImq7o7EhFYQT7JAMgMioD10eCPOZ7QHRsEPDslLrPXcQD5t1iAsH1xyWK7dbpfjoYLGjDpU Aug 31 16:15:23.952670 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:15:23.952670 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:15:23.952670 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:15:23.952670 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:15:23.952670 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:15:23.952670 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:15:23.952670 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 5299955053c842b6aa02e058f4b1c0cb Aug 31 16:15:23.952670 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ServersTestJSON-1028152372 Aug 31 16:15:23.952670 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:15:23.952670 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:15:23.952670 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5299955053c842b6aa02e058f4b1c0cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5299955053c842b6aa02e058f4b1c0cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5299955053c842b6aa02e058f4b1c0cb", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5299955053c842b6aa02e058f4b1c0cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:15:23.952670 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ServersTestJSON-1028152372 Aug 31 16:15:23.952670 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 5299955053c842b6aa02e058f4b1c0cb Aug 31 16:15:23.952670 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ServersTestJSON-1028152372 Aug 31 16:15:23.952670 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ServersTestJSON-1028152372-project Aug 31 16:15:23.952670 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:15:23.952670 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:15:23.952670 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 6e707652819c497bbdf94f85f39c447a Aug 31 16:15:23.952670 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ServersTestJSON-1028152372-project Aug 31 16:15:23.952670 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:15:23.952670 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance d78f1dfc-6152-4180-84be-f6a84b75dbc2 could not be found. Aug 31 16:15:23.952670 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': 'd78f1dfc-6152-4180-84be-f6a84b75dbc2'} Aug 31 16:15:23.952670 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:15:23.952670 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:23.952670 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:15:23.952670 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:15:23.952670 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:15:23.952670 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:15:23.952670 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:15:23.952670 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:15:23.952670 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:15:23.952670 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:15:23.952670 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d78f1dfc-6152-4180-84be-f6a84b75dbc2 could not be found. Aug 31 16:15:23.952670 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:15:23.952670 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:15:23.952670 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:15:23.952670 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:23.952670 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:15:23.952670 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:15:23.952670 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:15:23.952670 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:15:23.952670 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:15:23.952670 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:15:23.952670 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:15:23.952670 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:15:23.952670 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:15:23.952670 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:15:23.952670 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:15:23.952670 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:15:23.952670 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:15:23.952670 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:15:23.952670 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d78f1dfc-6152-4180-84be-f6a84b75dbc2 could not be found. Aug 31 16:15:23.959779 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:15:23.959779 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:15:23.959779 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:15:23.959779 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:23.959779 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:15:23.959779 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:15:23.959779 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:15:23.959779 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:15:23.959779 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d78f1dfc-6152-4180-84be-f6a84b75dbc2 could not be found. Aug 31 16:15:23.959779 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:15:23.959779 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-08db8046-3267-4f17-92f9-76f6244c5d8b tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Returning 404 to user: Instance d78f1dfc-6152-4180-84be-f6a84b75dbc2 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:15:23.959779 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-08db8046-3267-4f17-92f9-76f6244c5d8b tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "DELETE /compute/v2.1/servers/d78f1dfc-6152-4180-84be-f6a84b75dbc2" status: 404 len: 111 microversion: 2.1 time: 0.109702 Aug 31 16:15:23.959779 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2112/4211] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:15:23 2022] DELETE /compute/v2.1/servers/d78f1dfc-6152-4180-84be-f6a84b75dbc2 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:15:23.965992 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4036ef4c-bf9b-40e7-a920-ee69325e1f93 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:23.966506 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4036ef4c-bf9b-40e7-a920-ee69325e1f93 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:23.975782 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4036ef4c-bf9b-40e7-a920-ee69325e1f93 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:23.976294 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4036ef4c-bf9b-40e7-a920-ee69325e1f93 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:23.976745 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4036ef4c-bf9b-40e7-a920-ee69325e1f93 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:23.977475 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4036ef4c-bf9b-40e7-a920-ee69325e1f93 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:23.978007 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4036ef4c-bf9b-40e7-a920-ee69325e1f93 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:23.978449 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4036ef4c-bf9b-40e7-a920-ee69325e1f93 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:24.214678 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4036ef4c-bf9b-40e7-a920-ee69325e1f93 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.257033 Aug 31 16:15:24.223707 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2113/4212] 10.222.0.61 () {58 vars in 1275 bytes} [Wed Aug 31 16:15:23 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c/os-interface => generated 284 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:15:24.229456 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b6743acf-d932-4257-8977-c074fbe4b320 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:24.230070 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b6743acf-d932-4257-8977-c074fbe4b320 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: e3625fdf-7e50-4ba1-99dc-6ae7473fc706] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:24.237497 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b6743acf-d932-4257-8977-c074fbe4b320 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:24.238228 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b6743acf-d932-4257-8977-c074fbe4b320 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:24.238666 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b6743acf-d932-4257-8977-c074fbe4b320 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:24.239664 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b6743acf-d932-4257-8977-c074fbe4b320 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:24.240124 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b6743acf-d932-4257-8977-c074fbe4b320 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:24.240727 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b6743acf-d932-4257-8977-c074fbe4b320 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:24.321543 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-16e8249d-a09c-4611-b5ea-b7c9ceaad7cd tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed06378eb9b446680b5a3156a14941d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511432a7dee4bec9d1093c9d95b3734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:24.334670 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-16e8249d-a09c-4611-b5ea-b7c9ceaad7cd tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] 10.222.0.61 "GET /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2" status: 200 len: 1708 microversion: 2.1 time: 0.447173 Aug 31 16:15:24.351455 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2100/4213] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:23 2022] GET /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2 => generated 1708 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:24.358972 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b7d183cf-72ff-43fe-9f35-caa6cd2949b4 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:24.361058 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b7d183cf-72ff-43fe-9f35-caa6cd2949b4 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: d78f1dfc-6152-4180-84be-f6a84b75dbc2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:24.368703 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b7d183cf-72ff-43fe-9f35-caa6cd2949b4 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:24.369455 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b7d183cf-72ff-43fe-9f35-caa6cd2949b4 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:24.370005 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b7d183cf-72ff-43fe-9f35-caa6cd2949b4 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:24.370827 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b7d183cf-72ff-43fe-9f35-caa6cd2949b4 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:24.371419 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b7d183cf-72ff-43fe-9f35-caa6cd2949b4 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:24.371985 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b7d183cf-72ff-43fe-9f35-caa6cd2949b4 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:24.398587 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-b7d183cf-72ff-43fe-9f35-caa6cd2949b4 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] HTTP exception thrown: Instance d78f1dfc-6152-4180-84be-f6a84b75dbc2 could not be found. Aug 31 16:15:24.400889 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b7d183cf-72ff-43fe-9f35-caa6cd2949b4 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Request method failure captured: Aug 31 16:15:24.400889 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/d78f1dfc-6152-4180-84be-f6a84b75dbc2 HTTP/1.1 Aug 31 16:15:24.400889 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:15:24.400889 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:15:24.400889 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:15:24.400889 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:15:24.400889 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:15:24.400889 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:15:24.400889 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:15:24.400889 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:15:24.400889 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4gQXSNpx7T-s6ANX8A4XIz6BgCizm9VWKy6e0KLRI2pxjPOEzPLkRnoXGF3D-Jh3OWl1h65DNjP8YomYmS0bGyt_8avVSC7qeEvUleLImq7o7EhFYQT7JAMgMioD10eCPOZ7QHRsEPDslLrPXcQD5t1iAsH1xyWK7dbpfjoYLGjDpU Aug 31 16:15:24.400889 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:15:24.400889 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:15:24.400889 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:15:24.400889 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:15:24.400889 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:15:24.400889 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:15:24.400889 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 5299955053c842b6aa02e058f4b1c0cb Aug 31 16:15:24.400889 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ServersTestJSON-1028152372 Aug 31 16:15:24.400889 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:15:24.400889 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:15:24.400889 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5299955053c842b6aa02e058f4b1c0cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5299955053c842b6aa02e058f4b1c0cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5299955053c842b6aa02e058f4b1c0cb", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5299955053c842b6aa02e058f4b1c0cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:15:24.400889 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ServersTestJSON-1028152372 Aug 31 16:15:24.400889 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 5299955053c842b6aa02e058f4b1c0cb Aug 31 16:15:24.400889 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ServersTestJSON-1028152372 Aug 31 16:15:24.400889 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ServersTestJSON-1028152372-project Aug 31 16:15:24.400889 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:15:24.400889 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:15:24.400889 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 6e707652819c497bbdf94f85f39c447a Aug 31 16:15:24.400889 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ServersTestJSON-1028152372-project Aug 31 16:15:24.400889 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:15:24.400889 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance d78f1dfc-6152-4180-84be-f6a84b75dbc2 could not be found. Aug 31 16:15:24.400889 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': 'd78f1dfc-6152-4180-84be-f6a84b75dbc2'} Aug 31 16:15:24.400889 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:15:24.400889 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:24.400889 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:15:24.400889 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:15:24.400889 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:15:24.400889 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:15:24.400889 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:15:24.400889 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:15:24.400889 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:15:24.400889 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:15:24.400889 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d78f1dfc-6152-4180-84be-f6a84b75dbc2 could not be found. Aug 31 16:15:24.400889 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:15:24.400889 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:15:24.400889 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:15:24.400889 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:24.400889 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:15:24.400889 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:15:24.400889 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:15:24.400889 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:15:24.400889 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:15:24.400889 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:15:24.400889 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:15:24.400889 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:15:24.400889 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:15:24.400889 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:15:24.400889 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:15:24.400889 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:15:24.400889 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d78f1dfc-6152-4180-84be-f6a84b75dbc2 could not be found. Aug 31 16:15:24.400889 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:15:24.400889 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:15:24.400889 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:15:24.405829 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:24.405829 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:15:24.405829 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:15:24.405829 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:15:24.405829 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:15:24.405829 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d78f1dfc-6152-4180-84be-f6a84b75dbc2 could not be found. Aug 31 16:15:24.405829 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:15:24.411842 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b7d183cf-72ff-43fe-9f35-caa6cd2949b4 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Returning 404 to user: Instance d78f1dfc-6152-4180-84be-f6a84b75dbc2 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:15:24.413180 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b7d183cf-72ff-43fe-9f35-caa6cd2949b4 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/d78f1dfc-6152-4180-84be-f6a84b75dbc2" status: 404 len: 111 microversion: 2.1 time: 0.060226 Aug 31 16:15:24.414085 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2101/4214] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:24 2022] GET /compute/v2.1/servers/d78f1dfc-6152-4180-84be-f6a84b75dbc2 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:15:24.461738 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b6743acf-d932-4257-8977-c074fbe4b320 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48ee960c38f4d0584ea5ce34579279f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a957b6585e74a31b5bc5f66441c33e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:24.473680 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b6743acf-d932-4257-8977-c074fbe4b320 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706" status: 200 len: 1506 microversion: 2.1 time: 0.248276 Aug 31 16:15:24.488888 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2114/4215] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:24 2022] GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706 => generated 1506 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:24.496000 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c898ade1-d2e7-49a7-92f2-ac495b2a58e3 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:24.496923 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c898ade1-d2e7-49a7-92f2-ac495b2a58e3 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: c4ef985e-0861-4c5d-88eb-d8ad053a8f54] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:24.505571 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c898ade1-d2e7-49a7-92f2-ac495b2a58e3 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:24.506885 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c898ade1-d2e7-49a7-92f2-ac495b2a58e3 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:24.507526 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c898ade1-d2e7-49a7-92f2-ac495b2a58e3 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:24.510674 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c898ade1-d2e7-49a7-92f2-ac495b2a58e3 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:24.511346 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c898ade1-d2e7-49a7-92f2-ac495b2a58e3 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:24.511979 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c898ade1-d2e7-49a7-92f2-ac495b2a58e3 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:24.627688 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-74584b59-0c88-47d3-ab9d-a3600b3d4044 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:24.628770 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-74584b59-0c88-47d3-ab9d-a3600b3d4044 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] [instance: fa0932e8-1aa4-4d1a-b653-14be35568f3d] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:24.637066 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-74584b59-0c88-47d3-ab9d-a3600b3d4044 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:24.637819 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-74584b59-0c88-47d3-ab9d-a3600b3d4044 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:24.638683 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-74584b59-0c88-47d3-ab9d-a3600b3d4044 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:24.639700 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-74584b59-0c88-47d3-ab9d-a3600b3d4044 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:24.640482 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-74584b59-0c88-47d3-ab9d-a3600b3d4044 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:24.641008 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-74584b59-0c88-47d3-ab9d-a3600b3d4044 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:24.673261 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-74584b59-0c88-47d3-ab9d-a3600b3d4044 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] [instance: fa0932e8-1aa4-4d1a-b653-14be35568f3d] Going to try to terminate instance {{(pid=122256) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:15:24.803046 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-74584b59-0c88-47d3-ab9d-a3600b3d4044 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] 10.222.0.61 "DELETE /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d" status: 204 len: 0 microversion: 2.32 time: 0.387309 Aug 31 16:15:24.804399 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2102/4216] 10.222.0.61 () {60 vars in 1280 bytes} [Wed Aug 31 16:15:24 2022] DELETE /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d => generated 0 bytes in 389 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 16:15:24.812407 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1e952732-413a-4d94-abc2-fd01ce5c113d tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:24.814288 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1e952732-413a-4d94-abc2-fd01ce5c113d tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] [instance: 644d0221-94ca-4873-8fe0-ab72c4d7d68b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:24.822047 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1e952732-413a-4d94-abc2-fd01ce5c113d tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:24.822768 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1e952732-413a-4d94-abc2-fd01ce5c113d tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:24.823371 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1e952732-413a-4d94-abc2-fd01ce5c113d tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:24.824114 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1e952732-413a-4d94-abc2-fd01ce5c113d tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:24.825078 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1e952732-413a-4d94-abc2-fd01ce5c113d tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:24.825078 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1e952732-413a-4d94-abc2-fd01ce5c113d tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:24.867540 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c898ade1-d2e7-49a7-92f2-ac495b2a58e3 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb261f2061164b49a8d496b16647dd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d2222a956a4888967e21647e26b310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:24.887064 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c898ade1-d2e7-49a7-92f2-ac495b2a58e3 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "GET /compute/v2.1/servers/c4ef985e-0861-4c5d-88eb-d8ad053a8f54" status: 200 len: 1317 microversion: 2.1 time: 0.395401 Aug 31 16:15:24.893296 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2115/4217] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:24 2022] GET /compute/v2.1/servers/c4ef985e-0861-4c5d-88eb-d8ad053a8f54 => generated 1317 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:24.904467 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-25cd72bc-11e5-4cc1-ab4b-056989ea47d6 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:24.904467 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-25cd72bc-11e5-4cc1-ab4b-056989ea47d6 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 73b19398-0c2c-42ea-8b4a-86e223c090ff] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:24.908638 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-25cd72bc-11e5-4cc1-ab4b-056989ea47d6 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:24.910273 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-25cd72bc-11e5-4cc1-ab4b-056989ea47d6 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:24.910959 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-25cd72bc-11e5-4cc1-ab4b-056989ea47d6 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:24.912096 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-25cd72bc-11e5-4cc1-ab4b-056989ea47d6 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:24.912774 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-25cd72bc-11e5-4cc1-ab4b-056989ea47d6 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:24.913512 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-25cd72bc-11e5-4cc1-ab4b-056989ea47d6 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:24.938219 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-25cd72bc-11e5-4cc1-ab4b-056989ea47d6 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] HTTP exception thrown: Instance 73b19398-0c2c-42ea-8b4a-86e223c090ff could not be found. Aug 31 16:15:24.940993 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-25cd72bc-11e5-4cc1-ab4b-056989ea47d6 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Request method failure captured: Aug 31 16:15:24.940993 n-d-850499-9 devstack@n-api.service[122257]: request: DELETE /compute/v2.1/servers/73b19398-0c2c-42ea-8b4a-86e223c090ff HTTP/1.1 Aug 31 16:15:24.940993 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:15:24.940993 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:15:24.940993 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:15:24.940993 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:15:24.940993 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:15:24.940993 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:15:24.940993 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:15:24.940993 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:15:24.940993 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4gQXSNpx7T-s6ANX8A4XIz6BgCizm9VWKy6e0KLRI2pxjPOEzPLkRnoXGF3D-Jh3OWl1h65DNjP8YomYmS0bGyt_8avVSC7qeEvUleLImq7o7EhFYQT7JAMgMioD10eCPOZ7QHRsEPDslLrPXcQD5t1iAsH1xyWK7dbpfjoYLGjDpU Aug 31 16:15:24.940993 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:15:24.940993 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:15:24.940993 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:15:24.940993 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:15:24.940993 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:15:24.940993 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:15:24.940993 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 5299955053c842b6aa02e058f4b1c0cb Aug 31 16:15:24.940993 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ServersTestJSON-1028152372 Aug 31 16:15:24.940993 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:15:24.940993 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:15:24.940993 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5299955053c842b6aa02e058f4b1c0cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5299955053c842b6aa02e058f4b1c0cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5299955053c842b6aa02e058f4b1c0cb", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5299955053c842b6aa02e058f4b1c0cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:15:24.940993 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ServersTestJSON-1028152372 Aug 31 16:15:24.940993 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 5299955053c842b6aa02e058f4b1c0cb Aug 31 16:15:24.940993 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ServersTestJSON-1028152372 Aug 31 16:15:24.940993 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ServersTestJSON-1028152372-project Aug 31 16:15:24.940993 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:15:24.940993 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:15:24.940993 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 6e707652819c497bbdf94f85f39c447a Aug 31 16:15:24.940993 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ServersTestJSON-1028152372-project Aug 31 16:15:24.940993 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:15:24.940993 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance 73b19398-0c2c-42ea-8b4a-86e223c090ff could not be found. Aug 31 16:15:24.940993 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '73b19398-0c2c-42ea-8b4a-86e223c090ff'} Aug 31 16:15:24.940993 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:15:24.940993 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:24.940993 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:15:24.940993 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:15:24.940993 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:15:24.940993 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:15:24.940993 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:15:24.940993 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:15:24.940993 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:15:24.940993 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:15:24.940993 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73b19398-0c2c-42ea-8b4a-86e223c090ff could not be found. Aug 31 16:15:24.940993 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:15:24.940993 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:15:24.940993 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:15:24.940993 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:24.940993 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:15:24.940993 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:15:24.940993 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:15:24.940993 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:15:24.940993 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:15:24.940993 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:15:24.940993 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:15:24.940993 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:15:24.940993 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:15:24.940993 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:15:24.940993 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:15:24.940993 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:15:24.940993 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:15:24.940993 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:15:24.940993 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73b19398-0c2c-42ea-8b4a-86e223c090ff could not be found. Aug 31 16:15:24.946611 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:15:24.946611 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:15:24.946611 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:15:24.946611 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:24.946611 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:15:24.946611 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:15:24.946611 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:15:24.946611 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:15:24.946611 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73b19398-0c2c-42ea-8b4a-86e223c090ff could not be found. Aug 31 16:15:24.946611 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:15:24.957954 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-25cd72bc-11e5-4cc1-ab4b-056989ea47d6 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Returning 404 to user: Instance 73b19398-0c2c-42ea-8b4a-86e223c090ff could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:15:24.960385 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-25cd72bc-11e5-4cc1-ab4b-056989ea47d6 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "DELETE /compute/v2.1/servers/73b19398-0c2c-42ea-8b4a-86e223c090ff" status: 404 len: 111 microversion: 2.1 time: 0.064909 Aug 31 16:15:24.961193 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2116/4218] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:15:24 2022] DELETE /compute/v2.1/servers/73b19398-0c2c-42ea-8b4a-86e223c090ff => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:15:24.972466 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9b9c0db9-142d-47fc-bc0d-071c72627647 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:24.975719 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9b9c0db9-142d-47fc-bc0d-071c72627647 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] [instance: 64136c5d-b1e6-4263-a450-3308b0b4f69b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:24.993063 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9b9c0db9-142d-47fc-bc0d-071c72627647 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:24.994027 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9b9c0db9-142d-47fc-bc0d-071c72627647 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:24.994699 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9b9c0db9-142d-47fc-bc0d-071c72627647 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:24.995682 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9b9c0db9-142d-47fc-bc0d-071c72627647 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:24.996400 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9b9c0db9-142d-47fc-bc0d-071c72627647 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:24.997057 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9b9c0db9-142d-47fc-bc0d-071c72627647 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:25.000717 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1e952732-413a-4d94-abc2-fd01ce5c113d tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860ac4e423cf410d9bbc354c77ba864c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aada201b2fd64fdc81a69f826e7c607b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:25.017805 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1e952732-413a-4d94-abc2-fd01ce5c113d tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] 10.222.0.61 "GET /compute/v2.1/servers/644d0221-94ca-4873-8fe0-ab72c4d7d68b" status: 200 len: 1568 microversion: 2.1 time: 0.211287 Aug 31 16:15:25.021622 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2103/4219] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:24 2022] GET /compute/v2.1/servers/644d0221-94ca-4873-8fe0-ab72c4d7d68b => generated 1568 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:25.032876 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e4b6545f-d668-4fe3-ac14-19f4c66ea7eb tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:25.033768 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e4b6545f-d668-4fe3-ac14-19f4c66ea7eb tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] [instance: fa0932e8-1aa4-4d1a-b653-14be35568f3d] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:25.053470 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e4b6545f-d668-4fe3-ac14-19f4c66ea7eb tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:25.053967 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e4b6545f-d668-4fe3-ac14-19f4c66ea7eb tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:25.054412 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e4b6545f-d668-4fe3-ac14-19f4c66ea7eb tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:25.055151 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e4b6545f-d668-4fe3-ac14-19f4c66ea7eb tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:25.055693 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e4b6545f-d668-4fe3-ac14-19f4c66ea7eb tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:25.056384 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e4b6545f-d668-4fe3-ac14-19f4c66ea7eb tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:25.347886 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9b9c0db9-142d-47fc-bc0d-071c72627647 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d6eee711fe4194a4db63c801f78561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeac74d3027d4080be26bf3aadab4c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:25.359797 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9b9c0db9-142d-47fc-bc0d-071c72627647 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] 10.222.0.61 "GET /compute/v2.1/servers/64136c5d-b1e6-4263-a450-3308b0b4f69b" status: 200 len: 1318 microversion: 2.1 time: 0.397109 Aug 31 16:15:25.361246 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2117/4220] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:24 2022] GET /compute/v2.1/servers/64136c5d-b1e6-4263-a450-3308b0b4f69b => generated 1318 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:25.366515 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6905e658-48a8-4562-84a6-65661ca10920 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:25.367130 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6905e658-48a8-4562-84a6-65661ca10920 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 73b19398-0c2c-42ea-8b4a-86e223c090ff] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:25.373171 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6905e658-48a8-4562-84a6-65661ca10920 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:25.373662 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6905e658-48a8-4562-84a6-65661ca10920 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:25.374109 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6905e658-48a8-4562-84a6-65661ca10920 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:25.374814 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6905e658-48a8-4562-84a6-65661ca10920 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:25.375273 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6905e658-48a8-4562-84a6-65661ca10920 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:25.375730 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6905e658-48a8-4562-84a6-65661ca10920 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:25.392683 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-6905e658-48a8-4562-84a6-65661ca10920 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] HTTP exception thrown: Instance 73b19398-0c2c-42ea-8b4a-86e223c090ff could not be found. Aug 31 16:15:25.395262 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6905e658-48a8-4562-84a6-65661ca10920 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Request method failure captured: Aug 31 16:15:25.395262 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/73b19398-0c2c-42ea-8b4a-86e223c090ff HTTP/1.1 Aug 31 16:15:25.395262 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:15:25.395262 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:15:25.395262 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:15:25.395262 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:15:25.395262 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:15:25.395262 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:15:25.395262 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:15:25.395262 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:15:25.395262 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4gQXSNpx7T-s6ANX8A4XIz6BgCizm9VWKy6e0KLRI2pxjPOEzPLkRnoXGF3D-Jh3OWl1h65DNjP8YomYmS0bGyt_8avVSC7qeEvUleLImq7o7EhFYQT7JAMgMioD10eCPOZ7QHRsEPDslLrPXcQD5t1iAsH1xyWK7dbpfjoYLGjDpU Aug 31 16:15:25.395262 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:15:25.395262 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:15:25.395262 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:15:25.395262 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:15:25.395262 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:15:25.395262 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:15:25.395262 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 5299955053c842b6aa02e058f4b1c0cb Aug 31 16:15:25.395262 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ServersTestJSON-1028152372 Aug 31 16:15:25.395262 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:15:25.395262 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:15:25.395262 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5299955053c842b6aa02e058f4b1c0cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5299955053c842b6aa02e058f4b1c0cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5299955053c842b6aa02e058f4b1c0cb", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5299955053c842b6aa02e058f4b1c0cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:15:25.395262 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ServersTestJSON-1028152372 Aug 31 16:15:25.395262 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 5299955053c842b6aa02e058f4b1c0cb Aug 31 16:15:25.395262 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ServersTestJSON-1028152372 Aug 31 16:15:25.395262 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ServersTestJSON-1028152372-project Aug 31 16:15:25.395262 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:15:25.395262 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:15:25.395262 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 6e707652819c497bbdf94f85f39c447a Aug 31 16:15:25.395262 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ServersTestJSON-1028152372-project Aug 31 16:15:25.395262 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:15:25.395262 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance 73b19398-0c2c-42ea-8b4a-86e223c090ff could not be found. Aug 31 16:15:25.395262 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '73b19398-0c2c-42ea-8b4a-86e223c090ff'} Aug 31 16:15:25.395262 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:15:25.395262 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:25.395262 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:15:25.395262 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:15:25.395262 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:15:25.395262 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:15:25.395262 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:15:25.395262 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:15:25.395262 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:15:25.395262 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:15:25.395262 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73b19398-0c2c-42ea-8b4a-86e223c090ff could not be found. Aug 31 16:15:25.395262 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:15:25.395262 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:15:25.395262 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:15:25.395262 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:25.395262 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:15:25.395262 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:15:25.395262 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:15:25.395262 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:15:25.395262 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:15:25.395262 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:15:25.395262 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:15:25.395262 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:15:25.395262 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:15:25.395262 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:15:25.395262 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:15:25.395262 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:15:25.395262 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73b19398-0c2c-42ea-8b4a-86e223c090ff could not be found. Aug 31 16:15:25.395262 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:15:25.395262 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:15:25.395262 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:15:25.400749 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:25.400749 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:15:25.400749 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:15:25.400749 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:15:25.400749 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:15:25.400749 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73b19398-0c2c-42ea-8b4a-86e223c090ff could not be found. Aug 31 16:15:25.400749 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:15:25.400749 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6905e658-48a8-4562-84a6-65661ca10920 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Returning 404 to user: Instance 73b19398-0c2c-42ea-8b4a-86e223c090ff could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:15:25.400749 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6905e658-48a8-4562-84a6-65661ca10920 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/73b19398-0c2c-42ea-8b4a-86e223c090ff" status: 404 len: 111 microversion: 2.1 time: 0.033925 Aug 31 16:15:25.401530 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e4b6545f-d668-4fe3-ac14-19f4c66ea7eb tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:25.401663 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2118/4221] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:25 2022] GET /compute/v2.1/servers/73b19398-0c2c-42ea-8b4a-86e223c090ff => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:15:25.405596 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a8ed4d74-8322-41e4-818b-6de63f307505 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:25.406214 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a8ed4d74-8322-41e4-818b-6de63f307505 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] [instance: f04eb48d-000e-4c3b-8799-a4d3cdacf0e2] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:25.411318 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e4b6545f-d668-4fe3-ac14-19f4c66ea7eb tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:25.413136 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e4b6545f-d668-4fe3-ac14-19f4c66ea7eb tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:25.414163 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a8ed4d74-8322-41e4-818b-6de63f307505 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:25.414537 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e4b6545f-d668-4fe3-ac14-19f4c66ea7eb tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] 10.222.0.61 "GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d" status: 200 len: 2957 microversion: 2.32 time: 0.391365 Aug 31 16:15:25.414651 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a8ed4d74-8322-41e4-818b-6de63f307505 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:25.415259 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a8ed4d74-8322-41e4-818b-6de63f307505 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:25.415556 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2104/4222] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:15:25 2022] GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d => generated 2957 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:15:25.416475 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a8ed4d74-8322-41e4-818b-6de63f307505 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:25.417098 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a8ed4d74-8322-41e4-818b-6de63f307505 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:25.417531 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a8ed4d74-8322-41e4-818b-6de63f307505 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:25.420148 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-94fb12bb-dd15-4069-a7f4-708a27958f30 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:25.420834 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-94fb12bb-dd15-4069-a7f4-708a27958f30 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 3bf38c6a-3419-4b05-a06c-ccf8d89397f7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:25.427661 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-94fb12bb-dd15-4069-a7f4-708a27958f30 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:25.428476 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-94fb12bb-dd15-4069-a7f4-708a27958f30 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:25.429075 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-94fb12bb-dd15-4069-a7f4-708a27958f30 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:25.430163 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-94fb12bb-dd15-4069-a7f4-708a27958f30 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:25.431077 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-94fb12bb-dd15-4069-a7f4-708a27958f30 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:25.432118 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-94fb12bb-dd15-4069-a7f4-708a27958f30 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:25.448043 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-94fb12bb-dd15-4069-a7f4-708a27958f30 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] HTTP exception thrown: Instance 3bf38c6a-3419-4b05-a06c-ccf8d89397f7 could not be found. Aug 31 16:15:25.449900 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-94fb12bb-dd15-4069-a7f4-708a27958f30 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Request method failure captured: Aug 31 16:15:25.449900 n-d-850499-9 devstack@n-api.service[122256]: request: DELETE /compute/v2.1/servers/3bf38c6a-3419-4b05-a06c-ccf8d89397f7 HTTP/1.1 Aug 31 16:15:25.449900 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:15:25.449900 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:15:25.449900 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:15:25.449900 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:15:25.449900 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:15:25.449900 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:15:25.449900 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:15:25.449900 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:15:25.449900 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4gQXSNpx7T-s6ANX8A4XIz6BgCizm9VWKy6e0KLRI2pxjPOEzPLkRnoXGF3D-Jh3OWl1h65DNjP8YomYmS0bGyt_8avVSC7qeEvUleLImq7o7EhFYQT7JAMgMioD10eCPOZ7QHRsEPDslLrPXcQD5t1iAsH1xyWK7dbpfjoYLGjDpU Aug 31 16:15:25.449900 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:15:25.449900 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:15:25.449900 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:15:25.449900 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:15:25.449900 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:15:25.449900 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:15:25.449900 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 5299955053c842b6aa02e058f4b1c0cb Aug 31 16:15:25.449900 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ServersTestJSON-1028152372 Aug 31 16:15:25.449900 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:15:25.449900 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:15:25.449900 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5299955053c842b6aa02e058f4b1c0cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5299955053c842b6aa02e058f4b1c0cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5299955053c842b6aa02e058f4b1c0cb", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5299955053c842b6aa02e058f4b1c0cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:15:25.449900 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ServersTestJSON-1028152372 Aug 31 16:15:25.449900 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 5299955053c842b6aa02e058f4b1c0cb Aug 31 16:15:25.449900 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ServersTestJSON-1028152372 Aug 31 16:15:25.449900 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ServersTestJSON-1028152372-project Aug 31 16:15:25.449900 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:15:25.449900 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:15:25.449900 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 6e707652819c497bbdf94f85f39c447a Aug 31 16:15:25.449900 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ServersTestJSON-1028152372-project Aug 31 16:15:25.449900 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:15:25.449900 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance 3bf38c6a-3419-4b05-a06c-ccf8d89397f7 could not be found. Aug 31 16:15:25.449900 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '3bf38c6a-3419-4b05-a06c-ccf8d89397f7'} Aug 31 16:15:25.449900 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:15:25.449900 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:25.449900 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:15:25.449900 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:15:25.449900 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:15:25.449900 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:15:25.449900 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:15:25.449900 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:15:25.449900 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:15:25.449900 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:15:25.449900 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bf38c6a-3419-4b05-a06c-ccf8d89397f7 could not be found. Aug 31 16:15:25.449900 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:15:25.449900 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:15:25.449900 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:15:25.449900 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:25.449900 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:15:25.449900 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:15:25.449900 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:15:25.449900 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:15:25.449900 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:15:25.449900 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:15:25.449900 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:15:25.449900 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:15:25.449900 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:15:25.449900 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:15:25.449900 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:15:25.449900 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:15:25.449900 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:15:25.449900 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:15:25.449900 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bf38c6a-3419-4b05-a06c-ccf8d89397f7 could not be found. Aug 31 16:15:25.456153 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:15:25.456153 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:15:25.456153 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:15:25.456153 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:25.456153 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:15:25.456153 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:15:25.456153 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:15:25.456153 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:15:25.456153 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bf38c6a-3419-4b05-a06c-ccf8d89397f7 could not be found. Aug 31 16:15:25.456153 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:15:25.456153 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-94fb12bb-dd15-4069-a7f4-708a27958f30 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Returning 404 to user: Instance 3bf38c6a-3419-4b05-a06c-ccf8d89397f7 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:15:25.456153 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-94fb12bb-dd15-4069-a7f4-708a27958f30 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "DELETE /compute/v2.1/servers/3bf38c6a-3419-4b05-a06c-ccf8d89397f7" status: 404 len: 111 microversion: 2.1 time: 0.034794 Aug 31 16:15:25.456153 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2105/4223] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:15:25 2022] DELETE /compute/v2.1/servers/3bf38c6a-3419-4b05-a06c-ccf8d89397f7 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:15:25.463061 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-97f5a6e8-f063-41a5-af35-dbfeda0d5518 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:25.463709 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-97f5a6e8-f063-41a5-af35-dbfeda0d5518 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 3bf38c6a-3419-4b05-a06c-ccf8d89397f7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:25.470086 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-97f5a6e8-f063-41a5-af35-dbfeda0d5518 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:25.470589 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-97f5a6e8-f063-41a5-af35-dbfeda0d5518 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:25.471857 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-97f5a6e8-f063-41a5-af35-dbfeda0d5518 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:25.473915 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-97f5a6e8-f063-41a5-af35-dbfeda0d5518 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:25.474517 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-97f5a6e8-f063-41a5-af35-dbfeda0d5518 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:25.475050 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-97f5a6e8-f063-41a5-af35-dbfeda0d5518 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:25.480374 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:15:25.492008 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-97f5a6e8-f063-41a5-af35-dbfeda0d5518 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] HTTP exception thrown: Instance 3bf38c6a-3419-4b05-a06c-ccf8d89397f7 could not be found. Aug 31 16:15:25.493907 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-97f5a6e8-f063-41a5-af35-dbfeda0d5518 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Request method failure captured: Aug 31 16:15:25.493907 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/3bf38c6a-3419-4b05-a06c-ccf8d89397f7 HTTP/1.1 Aug 31 16:15:25.493907 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:15:25.493907 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:15:25.493907 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:15:25.493907 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:15:25.493907 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:15:25.493907 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:15:25.493907 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:15:25.493907 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:15:25.493907 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4gQXSNpx7T-s6ANX8A4XIz6BgCizm9VWKy6e0KLRI2pxjPOEzPLkRnoXGF3D-Jh3OWl1h65DNjP8YomYmS0bGyt_8avVSC7qeEvUleLImq7o7EhFYQT7JAMgMioD10eCPOZ7QHRsEPDslLrPXcQD5t1iAsH1xyWK7dbpfjoYLGjDpU Aug 31 16:15:25.493907 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:15:25.493907 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:15:25.493907 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:15:25.493907 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:15:25.493907 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:15:25.493907 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:15:25.493907 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 5299955053c842b6aa02e058f4b1c0cb Aug 31 16:15:25.493907 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ServersTestJSON-1028152372 Aug 31 16:15:25.493907 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:15:25.493907 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:15:25.493907 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5299955053c842b6aa02e058f4b1c0cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5299955053c842b6aa02e058f4b1c0cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5299955053c842b6aa02e058f4b1c0cb", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5299955053c842b6aa02e058f4b1c0cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:15:25.493907 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ServersTestJSON-1028152372 Aug 31 16:15:25.493907 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 5299955053c842b6aa02e058f4b1c0cb Aug 31 16:15:25.493907 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ServersTestJSON-1028152372 Aug 31 16:15:25.493907 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ServersTestJSON-1028152372-project Aug 31 16:15:25.493907 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:15:25.493907 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:15:25.493907 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 6e707652819c497bbdf94f85f39c447a Aug 31 16:15:25.493907 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ServersTestJSON-1028152372-project Aug 31 16:15:25.493907 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:15:25.493907 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance 3bf38c6a-3419-4b05-a06c-ccf8d89397f7 could not be found. Aug 31 16:15:25.493907 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '3bf38c6a-3419-4b05-a06c-ccf8d89397f7'} Aug 31 16:15:25.493907 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:15:25.493907 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:25.493907 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:15:25.493907 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:15:25.493907 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:15:25.493907 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:15:25.493907 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:15:25.493907 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:15:25.493907 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:15:25.493907 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:15:25.493907 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bf38c6a-3419-4b05-a06c-ccf8d89397f7 could not be found. Aug 31 16:15:25.493907 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:15:25.493907 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:15:25.493907 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:15:25.493907 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:25.493907 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:15:25.493907 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:15:25.493907 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:15:25.493907 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:15:25.493907 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:15:25.493907 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:15:25.493907 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:15:25.493907 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:15:25.493907 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:15:25.493907 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:15:25.493907 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:15:25.493907 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:15:25.493907 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bf38c6a-3419-4b05-a06c-ccf8d89397f7 could not be found. Aug 31 16:15:25.493907 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:15:25.493907 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:15:25.493907 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:15:25.504548 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:25.504548 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:15:25.504548 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:15:25.504548 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:15:25.504548 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:15:25.504548 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bf38c6a-3419-4b05-a06c-ccf8d89397f7 could not be found. Aug 31 16:15:25.504548 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:15:25.504548 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-97f5a6e8-f063-41a5-af35-dbfeda0d5518 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Returning 404 to user: Instance 3bf38c6a-3419-4b05-a06c-ccf8d89397f7 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:15:25.504548 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-97f5a6e8-f063-41a5-af35-dbfeda0d5518 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/3bf38c6a-3419-4b05-a06c-ccf8d89397f7" status: 404 len: 111 microversion: 2.1 time: 0.040112 Aug 31 16:15:25.504548 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2106/4224] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:25 2022] GET /compute/v2.1/servers/3bf38c6a-3419-4b05-a06c-ccf8d89397f7 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:15:25.504548 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6cba08a9-fc87-4195-a11a-22b706835ca7 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:25.504548 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6cba08a9-fc87-4195-a11a-22b706835ca7 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: e3625fdf-7e50-4ba1-99dc-6ae7473fc706] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:25.511489 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6cba08a9-fc87-4195-a11a-22b706835ca7 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:25.512005 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6cba08a9-fc87-4195-a11a-22b706835ca7 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:25.512762 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6cba08a9-fc87-4195-a11a-22b706835ca7 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:25.513147 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6cba08a9-fc87-4195-a11a-22b706835ca7 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:25.513608 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6cba08a9-fc87-4195-a11a-22b706835ca7 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:25.514041 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6cba08a9-fc87-4195-a11a-22b706835ca7 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:25.680814 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a8ed4d74-8322-41e4-818b-6de63f307505 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed06378eb9b446680b5a3156a14941d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511432a7dee4bec9d1093c9d95b3734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:25.702051 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a8ed4d74-8322-41e4-818b-6de63f307505 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] 10.222.0.61 "GET /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2" status: 200 len: 1708 microversion: 2.1 time: 0.297836 Aug 31 16:15:25.716556 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2119/4225] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:25 2022] GET /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2 => generated 1708 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:25.726245 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7130fc7b-821b-4ef7-970b-bf3f806123e2 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:25.727865 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7130fc7b-821b-4ef7-970b-bf3f806123e2 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: ce9f8f4c-9d4e-48c0-bd66-1c409e91bf5a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:25.736838 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7130fc7b-821b-4ef7-970b-bf3f806123e2 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:25.738148 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7130fc7b-821b-4ef7-970b-bf3f806123e2 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:25.738814 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7130fc7b-821b-4ef7-970b-bf3f806123e2 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:25.740272 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7130fc7b-821b-4ef7-970b-bf3f806123e2 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:25.741350 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7130fc7b-821b-4ef7-970b-bf3f806123e2 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:25.741951 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7130fc7b-821b-4ef7-970b-bf3f806123e2 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:25.760649 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-7130fc7b-821b-4ef7-970b-bf3f806123e2 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] HTTP exception thrown: Instance ce9f8f4c-9d4e-48c0-bd66-1c409e91bf5a could not be found. Aug 31 16:15:25.762324 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7130fc7b-821b-4ef7-970b-bf3f806123e2 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Request method failure captured: Aug 31 16:15:25.762324 n-d-850499-9 devstack@n-api.service[122257]: request: DELETE /compute/v2.1/servers/ce9f8f4c-9d4e-48c0-bd66-1c409e91bf5a HTTP/1.1 Aug 31 16:15:25.762324 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:15:25.762324 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:15:25.762324 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:15:25.762324 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:15:25.762324 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:15:25.762324 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:15:25.762324 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:15:25.762324 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:15:25.762324 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4gQXSNpx7T-s6ANX8A4XIz6BgCizm9VWKy6e0KLRI2pxjPOEzPLkRnoXGF3D-Jh3OWl1h65DNjP8YomYmS0bGyt_8avVSC7qeEvUleLImq7o7EhFYQT7JAMgMioD10eCPOZ7QHRsEPDslLrPXcQD5t1iAsH1xyWK7dbpfjoYLGjDpU Aug 31 16:15:25.762324 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:15:25.762324 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:15:25.762324 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:15:25.762324 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:15:25.762324 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:15:25.762324 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:15:25.762324 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 5299955053c842b6aa02e058f4b1c0cb Aug 31 16:15:25.762324 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ServersTestJSON-1028152372 Aug 31 16:15:25.762324 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:15:25.762324 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:15:25.762324 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5299955053c842b6aa02e058f4b1c0cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5299955053c842b6aa02e058f4b1c0cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5299955053c842b6aa02e058f4b1c0cb", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5299955053c842b6aa02e058f4b1c0cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:15:25.762324 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ServersTestJSON-1028152372 Aug 31 16:15:25.762324 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 5299955053c842b6aa02e058f4b1c0cb Aug 31 16:15:25.762324 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ServersTestJSON-1028152372 Aug 31 16:15:25.762324 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ServersTestJSON-1028152372-project Aug 31 16:15:25.762324 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:15:25.762324 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:15:25.762324 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 6e707652819c497bbdf94f85f39c447a Aug 31 16:15:25.762324 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ServersTestJSON-1028152372-project Aug 31 16:15:25.762324 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:15:25.762324 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance ce9f8f4c-9d4e-48c0-bd66-1c409e91bf5a could not be found. Aug 31 16:15:25.762324 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': 'ce9f8f4c-9d4e-48c0-bd66-1c409e91bf5a'} Aug 31 16:15:25.762324 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:15:25.762324 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:25.762324 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:15:25.762324 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:15:25.762324 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:15:25.762324 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:15:25.762324 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:15:25.762324 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:15:25.762324 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:15:25.762324 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:15:25.762324 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce9f8f4c-9d4e-48c0-bd66-1c409e91bf5a could not be found. Aug 31 16:15:25.762324 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:15:25.762324 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:15:25.762324 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:15:25.762324 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:25.762324 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:15:25.762324 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:15:25.762324 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:15:25.762324 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:15:25.762324 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:15:25.762324 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:15:25.762324 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:15:25.762324 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:15:25.762324 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:15:25.762324 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:15:25.762324 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:15:25.762324 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:15:25.762324 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:15:25.762324 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:15:25.762324 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce9f8f4c-9d4e-48c0-bd66-1c409e91bf5a could not be found. Aug 31 16:15:25.769039 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:15:25.769039 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:15:25.769039 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:15:25.769039 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:25.769039 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:15:25.769039 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:15:25.769039 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:15:25.769039 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:15:25.769039 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce9f8f4c-9d4e-48c0-bd66-1c409e91bf5a could not be found. Aug 31 16:15:25.769039 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:15:25.769039 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7130fc7b-821b-4ef7-970b-bf3f806123e2 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Returning 404 to user: Instance ce9f8f4c-9d4e-48c0-bd66-1c409e91bf5a could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:15:25.769039 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7130fc7b-821b-4ef7-970b-bf3f806123e2 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "DELETE /compute/v2.1/servers/ce9f8f4c-9d4e-48c0-bd66-1c409e91bf5a" status: 404 len: 111 microversion: 2.1 time: 0.045698 Aug 31 16:15:25.769039 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2120/4226] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:15:25 2022] DELETE /compute/v2.1/servers/ce9f8f4c-9d4e-48c0-bd66-1c409e91bf5a => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:15:25.774273 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-aaac5321-fc22-4616-afc9-c1ec5e0a415c tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:25.774900 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-aaac5321-fc22-4616-afc9-c1ec5e0a415c tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: ce9f8f4c-9d4e-48c0-bd66-1c409e91bf5a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:25.783349 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-aaac5321-fc22-4616-afc9-c1ec5e0a415c tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:25.784063 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-aaac5321-fc22-4616-afc9-c1ec5e0a415c tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:25.784522 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-aaac5321-fc22-4616-afc9-c1ec5e0a415c tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:25.785435 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-aaac5321-fc22-4616-afc9-c1ec5e0a415c tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:25.785906 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-aaac5321-fc22-4616-afc9-c1ec5e0a415c tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:25.786344 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-aaac5321-fc22-4616-afc9-c1ec5e0a415c tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:25.796480 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-6cba08a9-fc87-4195-a11a-22b706835ca7 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48ee960c38f4d0584ea5ce34579279f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a957b6585e74a31b5bc5f66441c33e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:25.812296 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6cba08a9-fc87-4195-a11a-22b706835ca7 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706" status: 200 len: 1506 microversion: 2.1 time: 0.308460 Aug 31 16:15:25.812949 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2107/4227] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:25 2022] GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706 => generated 1506 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:25.814573 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-aaac5321-fc22-4616-afc9-c1ec5e0a415c tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] HTTP exception thrown: Instance ce9f8f4c-9d4e-48c0-bd66-1c409e91bf5a could not be found. Aug 31 16:15:25.816554 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-aaac5321-fc22-4616-afc9-c1ec5e0a415c tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Request method failure captured: Aug 31 16:15:25.816554 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/ce9f8f4c-9d4e-48c0-bd66-1c409e91bf5a HTTP/1.1 Aug 31 16:15:25.816554 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:15:25.816554 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:15:25.816554 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:15:25.816554 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:15:25.816554 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:15:25.816554 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:15:25.816554 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:15:25.816554 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:15:25.816554 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4gQXSNpx7T-s6ANX8A4XIz6BgCizm9VWKy6e0KLRI2pxjPOEzPLkRnoXGF3D-Jh3OWl1h65DNjP8YomYmS0bGyt_8avVSC7qeEvUleLImq7o7EhFYQT7JAMgMioD10eCPOZ7QHRsEPDslLrPXcQD5t1iAsH1xyWK7dbpfjoYLGjDpU Aug 31 16:15:25.816554 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:15:25.816554 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:15:25.816554 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:15:25.816554 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:15:25.816554 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:15:25.816554 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:15:25.816554 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 5299955053c842b6aa02e058f4b1c0cb Aug 31 16:15:25.816554 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ServersTestJSON-1028152372 Aug 31 16:15:25.816554 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:15:25.816554 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:15:25.816554 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5299955053c842b6aa02e058f4b1c0cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5299955053c842b6aa02e058f4b1c0cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5299955053c842b6aa02e058f4b1c0cb", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5299955053c842b6aa02e058f4b1c0cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:15:25.816554 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ServersTestJSON-1028152372 Aug 31 16:15:25.816554 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 5299955053c842b6aa02e058f4b1c0cb Aug 31 16:15:25.816554 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ServersTestJSON-1028152372 Aug 31 16:15:25.816554 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ServersTestJSON-1028152372-project Aug 31 16:15:25.816554 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:15:25.816554 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:15:25.816554 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 6e707652819c497bbdf94f85f39c447a Aug 31 16:15:25.816554 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ServersTestJSON-1028152372-project Aug 31 16:15:25.816554 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:15:25.816554 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance ce9f8f4c-9d4e-48c0-bd66-1c409e91bf5a could not be found. Aug 31 16:15:25.816554 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': 'ce9f8f4c-9d4e-48c0-bd66-1c409e91bf5a'} Aug 31 16:15:25.816554 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:15:25.816554 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:25.816554 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:15:25.816554 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:15:25.816554 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:15:25.816554 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:15:25.816554 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:15:25.816554 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:15:25.816554 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:15:25.816554 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:15:25.816554 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce9f8f4c-9d4e-48c0-bd66-1c409e91bf5a could not be found. Aug 31 16:15:25.816554 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:15:25.816554 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:15:25.816554 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:15:25.816554 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:25.816554 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:15:25.816554 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:15:25.816554 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:15:25.816554 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:15:25.816554 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:15:25.816554 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:15:25.816554 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:15:25.816554 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:15:25.816554 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:15:25.816554 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:15:25.816554 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:15:25.816554 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:15:25.816554 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce9f8f4c-9d4e-48c0-bd66-1c409e91bf5a could not be found. Aug 31 16:15:25.816554 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:15:25.816554 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:15:25.816554 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:15:25.821231 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:25.821231 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:15:25.821231 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:15:25.821231 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:15:25.821231 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:15:25.821231 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce9f8f4c-9d4e-48c0-bd66-1c409e91bf5a could not be found. Aug 31 16:15:25.821231 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:15:25.823417 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-aaac5321-fc22-4616-afc9-c1ec5e0a415c tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Returning 404 to user: Instance ce9f8f4c-9d4e-48c0-bd66-1c409e91bf5a could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:15:25.824555 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-aaac5321-fc22-4616-afc9-c1ec5e0a415c tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/ce9f8f4c-9d4e-48c0-bd66-1c409e91bf5a" status: 404 len: 111 microversion: 2.1 time: 0.054786 Aug 31 16:15:25.825354 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2121/4228] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:25 2022] GET /compute/v2.1/servers/ce9f8f4c-9d4e-48c0-bd66-1c409e91bf5a => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:15:25.834061 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1959e603-8bad-49e4-b8cb-c1c957695fbc tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:25.834639 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1959e603-8bad-49e4-b8cb-c1c957695fbc tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 8e287ae9-272b-4148-a159-790187f5d8a3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:25.840932 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1959e603-8bad-49e4-b8cb-c1c957695fbc tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:25.841436 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1959e603-8bad-49e4-b8cb-c1c957695fbc tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:25.841877 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1959e603-8bad-49e4-b8cb-c1c957695fbc tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:25.842593 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1959e603-8bad-49e4-b8cb-c1c957695fbc tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:25.843052 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1959e603-8bad-49e4-b8cb-c1c957695fbc tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:25.843482 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1959e603-8bad-49e4-b8cb-c1c957695fbc tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:25.859782 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-1959e603-8bad-49e4-b8cb-c1c957695fbc tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] HTTP exception thrown: Instance 8e287ae9-272b-4148-a159-790187f5d8a3 could not be found. Aug 31 16:15:25.862142 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1959e603-8bad-49e4-b8cb-c1c957695fbc tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Request method failure captured: Aug 31 16:15:25.862142 n-d-850499-9 devstack@n-api.service[122256]: request: DELETE /compute/v2.1/servers/8e287ae9-272b-4148-a159-790187f5d8a3 HTTP/1.1 Aug 31 16:15:25.862142 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:15:25.862142 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:15:25.862142 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:15:25.862142 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:15:25.862142 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:15:25.862142 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:15:25.862142 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:15:25.862142 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:15:25.862142 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4gQXSNpx7T-s6ANX8A4XIz6BgCizm9VWKy6e0KLRI2pxjPOEzPLkRnoXGF3D-Jh3OWl1h65DNjP8YomYmS0bGyt_8avVSC7qeEvUleLImq7o7EhFYQT7JAMgMioD10eCPOZ7QHRsEPDslLrPXcQD5t1iAsH1xyWK7dbpfjoYLGjDpU Aug 31 16:15:25.862142 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:15:25.862142 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:15:25.862142 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:15:25.862142 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:15:25.862142 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:15:25.862142 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:15:25.862142 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 5299955053c842b6aa02e058f4b1c0cb Aug 31 16:15:25.862142 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ServersTestJSON-1028152372 Aug 31 16:15:25.862142 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:15:25.862142 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:15:25.862142 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5299955053c842b6aa02e058f4b1c0cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5299955053c842b6aa02e058f4b1c0cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5299955053c842b6aa02e058f4b1c0cb", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5299955053c842b6aa02e058f4b1c0cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:15:25.862142 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ServersTestJSON-1028152372 Aug 31 16:15:25.862142 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 5299955053c842b6aa02e058f4b1c0cb Aug 31 16:15:25.862142 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ServersTestJSON-1028152372 Aug 31 16:15:25.862142 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ServersTestJSON-1028152372-project Aug 31 16:15:25.862142 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:15:25.862142 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:15:25.862142 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 6e707652819c497bbdf94f85f39c447a Aug 31 16:15:25.862142 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ServersTestJSON-1028152372-project Aug 31 16:15:25.862142 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:15:25.862142 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance 8e287ae9-272b-4148-a159-790187f5d8a3 could not be found. Aug 31 16:15:25.862142 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '8e287ae9-272b-4148-a159-790187f5d8a3'} Aug 31 16:15:25.862142 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:15:25.862142 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:25.862142 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:15:25.862142 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:15:25.862142 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:15:25.862142 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:15:25.862142 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:15:25.862142 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:15:25.862142 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:15:25.862142 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:15:25.862142 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e287ae9-272b-4148-a159-790187f5d8a3 could not be found. Aug 31 16:15:25.862142 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:15:25.862142 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:15:25.862142 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:15:25.862142 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:25.862142 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:15:25.862142 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:15:25.862142 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:15:25.862142 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:15:25.862142 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:15:25.862142 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:15:25.862142 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:15:25.862142 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:15:25.862142 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:15:25.862142 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:15:25.862142 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:15:25.862142 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:15:25.862142 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:15:25.862142 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:15:25.862142 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e287ae9-272b-4148-a159-790187f5d8a3 could not be found. Aug 31 16:15:25.867593 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:15:25.867593 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:15:25.867593 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:15:25.867593 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:25.867593 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:15:25.867593 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:15:25.867593 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:15:25.867593 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:15:25.867593 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e287ae9-272b-4148-a159-790187f5d8a3 could not be found. Aug 31 16:15:25.867593 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:15:25.867593 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1959e603-8bad-49e4-b8cb-c1c957695fbc tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Returning 404 to user: Instance 8e287ae9-272b-4148-a159-790187f5d8a3 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:15:25.867593 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1959e603-8bad-49e4-b8cb-c1c957695fbc tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "DELETE /compute/v2.1/servers/8e287ae9-272b-4148-a159-790187f5d8a3" status: 404 len: 111 microversion: 2.1 time: 0.033823 Aug 31 16:15:25.867593 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2108/4229] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:15:25 2022] DELETE /compute/v2.1/servers/8e287ae9-272b-4148-a159-790187f5d8a3 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:15:25.873321 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0e7984dd-926b-458b-bba6-c456a4f9848f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:25.873946 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0e7984dd-926b-458b-bba6-c456a4f9848f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 8e287ae9-272b-4148-a159-790187f5d8a3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:25.881095 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0e7984dd-926b-458b-bba6-c456a4f9848f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:25.881598 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0e7984dd-926b-458b-bba6-c456a4f9848f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:25.882041 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0e7984dd-926b-458b-bba6-c456a4f9848f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:25.882754 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0e7984dd-926b-458b-bba6-c456a4f9848f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:25.883216 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0e7984dd-926b-458b-bba6-c456a4f9848f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:25.883681 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0e7984dd-926b-458b-bba6-c456a4f9848f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:25.899217 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-0e7984dd-926b-458b-bba6-c456a4f9848f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] HTTP exception thrown: Instance 8e287ae9-272b-4148-a159-790187f5d8a3 could not be found. Aug 31 16:15:25.901517 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0e7984dd-926b-458b-bba6-c456a4f9848f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Request method failure captured: Aug 31 16:15:25.901517 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/8e287ae9-272b-4148-a159-790187f5d8a3 HTTP/1.1 Aug 31 16:15:25.901517 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:15:25.901517 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:15:25.901517 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:15:25.901517 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:15:25.901517 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:15:25.901517 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:15:25.901517 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:15:25.901517 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:15:25.901517 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4gQXSNpx7T-s6ANX8A4XIz6BgCizm9VWKy6e0KLRI2pxjPOEzPLkRnoXGF3D-Jh3OWl1h65DNjP8YomYmS0bGyt_8avVSC7qeEvUleLImq7o7EhFYQT7JAMgMioD10eCPOZ7QHRsEPDslLrPXcQD5t1iAsH1xyWK7dbpfjoYLGjDpU Aug 31 16:15:25.901517 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:15:25.901517 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:15:25.901517 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:15:25.901517 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:15:25.901517 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:15:25.901517 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:15:25.901517 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 5299955053c842b6aa02e058f4b1c0cb Aug 31 16:15:25.901517 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ServersTestJSON-1028152372 Aug 31 16:15:25.901517 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:15:25.901517 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:15:25.901517 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5299955053c842b6aa02e058f4b1c0cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5299955053c842b6aa02e058f4b1c0cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5299955053c842b6aa02e058f4b1c0cb", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5299955053c842b6aa02e058f4b1c0cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:15:25.901517 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ServersTestJSON-1028152372 Aug 31 16:15:25.901517 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 5299955053c842b6aa02e058f4b1c0cb Aug 31 16:15:25.901517 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ServersTestJSON-1028152372 Aug 31 16:15:25.901517 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ServersTestJSON-1028152372-project Aug 31 16:15:25.901517 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:15:25.901517 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:15:25.901517 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 6e707652819c497bbdf94f85f39c447a Aug 31 16:15:25.901517 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ServersTestJSON-1028152372-project Aug 31 16:15:25.901517 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:15:25.901517 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance 8e287ae9-272b-4148-a159-790187f5d8a3 could not be found. Aug 31 16:15:25.901517 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '8e287ae9-272b-4148-a159-790187f5d8a3'} Aug 31 16:15:25.901517 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:15:25.901517 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:25.901517 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:15:25.901517 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:15:25.901517 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:15:25.901517 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:15:25.901517 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:15:25.901517 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:15:25.901517 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:15:25.901517 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:15:25.901517 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e287ae9-272b-4148-a159-790187f5d8a3 could not be found. Aug 31 16:15:25.901517 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:15:25.901517 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:15:25.901517 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:15:25.901517 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:25.901517 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:15:25.901517 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:15:25.901517 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:15:25.901517 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:15:25.901517 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:15:25.901517 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:15:25.901517 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:15:25.901517 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:15:25.901517 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:15:25.901517 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:15:25.901517 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:15:25.901517 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:15:25.901517 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e287ae9-272b-4148-a159-790187f5d8a3 could not be found. Aug 31 16:15:25.901517 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:15:25.901517 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:15:25.901517 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:15:25.910776 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:25.910776 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:15:25.910776 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:15:25.910776 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:15:25.910776 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:15:25.910776 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e287ae9-272b-4148-a159-790187f5d8a3 could not be found. Aug 31 16:15:25.910776 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:15:25.910776 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0e7984dd-926b-458b-bba6-c456a4f9848f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Returning 404 to user: Instance 8e287ae9-272b-4148-a159-790187f5d8a3 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:15:25.911381 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-5900e5e7-fc5e-4a8c-81f1-f855c143726a req-ca0861c5-6bc2-400b-855b-f9bf9c7d78d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "644d0221-94ca-4873-8fe0-ab72c4d7d68b", "name": "network-vif-deleted", "tag": "427ff9a1-aa4b-4fb5-908e-3122c7b9617d"}, {"server_uuid": "644d0221-94ca-4873-8fe0-ab72c4d7d68b", "name": "network-vif-deleted", "tag": "5c8444dd-5b7e-4108-baa8-a2bcb7f17154"}, {"name": "network-changed", "server_uuid": "42ccbb85-9677-4cb9-879a-dc280cda020c", "tag": "44b19fab-a1b0-47af-8c78-4bab130a016b"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:15:25.912367 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0e7984dd-926b-458b-bba6-c456a4f9848f tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/8e287ae9-272b-4148-a159-790187f5d8a3" status: 404 len: 111 microversion: 2.1 time: 0.033775 Aug 31 16:15:25.912367 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2122/4230] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:25 2022] GET /compute/v2.1/servers/8e287ae9-272b-4148-a159-790187f5d8a3 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 16:15:25.912367 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b36097fc-a5ab-4353-a2c6-9c4571de3387 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:25.912367 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b36097fc-a5ab-4353-a2c6-9c4571de3387 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 519c7ca0-6d6b-4250-9b7b-8d5b6ef3b6b4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:25.918647 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b36097fc-a5ab-4353-a2c6-9c4571de3387 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:25.918979 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-5900e5e7-fc5e-4a8c-81f1-f855c143726a req-ca0861c5-6bc2-400b-855b-f9bf9c7d78d2 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:25.919152 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b36097fc-a5ab-4353-a2c6-9c4571de3387 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:25.919615 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b36097fc-a5ab-4353-a2c6-9c4571de3387 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:25.919791 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-5900e5e7-fc5e-4a8c-81f1-f855c143726a req-ca0861c5-6bc2-400b-855b-f9bf9c7d78d2 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:25.920169 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-5900e5e7-fc5e-4a8c-81f1-f855c143726a req-ca0861c5-6bc2-400b-855b-f9bf9c7d78d2 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:25.920331 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b36097fc-a5ab-4353-a2c6-9c4571de3387 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:25.920794 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b36097fc-a5ab-4353-a2c6-9c4571de3387 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:25.921348 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b36097fc-a5ab-4353-a2c6-9c4571de3387 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:25.937888 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-b36097fc-a5ab-4353-a2c6-9c4571de3387 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] HTTP exception thrown: Instance 519c7ca0-6d6b-4250-9b7b-8d5b6ef3b6b4 could not be found. Aug 31 16:15:25.937888 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b36097fc-a5ab-4353-a2c6-9c4571de3387 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Request method failure captured: Aug 31 16:15:25.937888 n-d-850499-9 devstack@n-api.service[122257]: request: DELETE /compute/v2.1/servers/519c7ca0-6d6b-4250-9b7b-8d5b6ef3b6b4 HTTP/1.1 Aug 31 16:15:25.937888 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:15:25.937888 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:15:25.937888 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:15:25.937888 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:15:25.937888 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:15:25.937888 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:15:25.937888 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:15:25.937888 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:15:25.937888 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4gQXSNpx7T-s6ANX8A4XIz6BgCizm9VWKy6e0KLRI2pxjPOEzPLkRnoXGF3D-Jh3OWl1h65DNjP8YomYmS0bGyt_8avVSC7qeEvUleLImq7o7EhFYQT7JAMgMioD10eCPOZ7QHRsEPDslLrPXcQD5t1iAsH1xyWK7dbpfjoYLGjDpU Aug 31 16:15:25.937888 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:15:25.937888 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:15:25.937888 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:15:25.937888 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:15:25.937888 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:15:25.937888 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:15:25.937888 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 5299955053c842b6aa02e058f4b1c0cb Aug 31 16:15:25.937888 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ServersTestJSON-1028152372 Aug 31 16:15:25.937888 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:15:25.937888 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:15:25.937888 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5299955053c842b6aa02e058f4b1c0cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5299955053c842b6aa02e058f4b1c0cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5299955053c842b6aa02e058f4b1c0cb", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5299955053c842b6aa02e058f4b1c0cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:15:25.937888 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ServersTestJSON-1028152372 Aug 31 16:15:25.937888 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 5299955053c842b6aa02e058f4b1c0cb Aug 31 16:15:25.937888 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ServersTestJSON-1028152372 Aug 31 16:15:25.937888 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ServersTestJSON-1028152372-project Aug 31 16:15:25.937888 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:15:25.937888 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:15:25.937888 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 6e707652819c497bbdf94f85f39c447a Aug 31 16:15:25.937888 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ServersTestJSON-1028152372-project Aug 31 16:15:25.937888 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:15:25.937888 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance 519c7ca0-6d6b-4250-9b7b-8d5b6ef3b6b4 could not be found. Aug 31 16:15:25.937888 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '519c7ca0-6d6b-4250-9b7b-8d5b6ef3b6b4'} Aug 31 16:15:25.937888 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:15:25.937888 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:25.937888 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:15:25.937888 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:15:25.937888 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:15:25.937888 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:15:25.937888 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:15:25.937888 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:15:25.937888 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:15:25.937888 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:15:25.937888 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 519c7ca0-6d6b-4250-9b7b-8d5b6ef3b6b4 could not be found. Aug 31 16:15:25.937888 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:15:25.937888 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:15:25.937888 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:15:25.937888 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:25.937888 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:15:25.937888 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:15:25.937888 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:15:25.937888 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:15:25.937888 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:15:25.937888 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:15:25.937888 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:15:25.937888 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:15:25.937888 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:15:25.937888 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:15:25.937888 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:15:25.937888 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:15:25.950190 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:15:25.950190 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:15:25.950190 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 519c7ca0-6d6b-4250-9b7b-8d5b6ef3b6b4 could not be found. Aug 31 16:15:25.950190 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:15:25.950190 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:15:25.950190 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:15:25.950190 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:25.950190 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:15:25.950190 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:15:25.950190 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:15:25.950190 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:15:25.950190 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 519c7ca0-6d6b-4250-9b7b-8d5b6ef3b6b4 could not be found. Aug 31 16:15:25.950190 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:15:25.950190 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b36097fc-a5ab-4353-a2c6-9c4571de3387 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Returning 404 to user: Instance 519c7ca0-6d6b-4250-9b7b-8d5b6ef3b6b4 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:15:25.950190 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b36097fc-a5ab-4353-a2c6-9c4571de3387 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "DELETE /compute/v2.1/servers/519c7ca0-6d6b-4250-9b7b-8d5b6ef3b6b4" status: 404 len: 111 microversion: 2.1 time: 0.031954 Aug 31 16:15:25.950190 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2123/4231] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:15:25 2022] DELETE /compute/v2.1/servers/519c7ca0-6d6b-4250-9b7b-8d5b6ef3b6b4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 16:15:25.950190 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8d2d308f-4ff4-4a0c-8bed-4bc05f319c67 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:25.950190 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8d2d308f-4ff4-4a0c-8bed-4bc05f319c67 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: c4ef985e-0861-4c5d-88eb-d8ad053a8f54] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:25.952824 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-5900e5e7-fc5e-4a8c-81f1-f855c143726a req-ca0861c5-6bc2-400b-855b-f9bf9c7d78d2 service nova] Creating event network-vif-deleted:427ff9a1-aa4b-4fb5-908e-3122c7b9617d for instance 644d0221-94ca-4873-8fe0-ab72c4d7d68b on n-h1-850499-9 Aug 31 16:15:25.952824 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-5900e5e7-fc5e-4a8c-81f1-f855c143726a req-ca0861c5-6bc2-400b-855b-f9bf9c7d78d2 service nova] Creating event network-vif-deleted:5c8444dd-5b7e-4108-baa8-a2bcb7f17154 for instance 644d0221-94ca-4873-8fe0-ab72c4d7d68b on n-h1-850499-9 Aug 31 16:15:25.952824 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-5900e5e7-fc5e-4a8c-81f1-f855c143726a req-ca0861c5-6bc2-400b-855b-f9bf9c7d78d2 service nova] Creating event network-changed:44b19fab-a1b0-47af-8c78-4bab130a016b for instance 42ccbb85-9677-4cb9-879a-dc280cda020c on n-h2-850499-9 Aug 31 16:15:25.953260 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8d2d308f-4ff4-4a0c-8bed-4bc05f319c67 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:25.953427 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8d2d308f-4ff4-4a0c-8bed-4bc05f319c67 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:25.953875 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8d2d308f-4ff4-4a0c-8bed-4bc05f319c67 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:25.955434 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8d2d308f-4ff4-4a0c-8bed-4bc05f319c67 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:25.956146 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8d2d308f-4ff4-4a0c-8bed-4bc05f319c67 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:25.956536 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8d2d308f-4ff4-4a0c-8bed-4bc05f319c67 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:25.961890 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-5900e5e7-fc5e-4a8c-81f1-f855c143726a req-ca0861c5-6bc2-400b-855b-f9bf9c7d78d2 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 521 microversion: 2.1 time: 0.064285 Aug 31 16:15:25.962653 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2109/4232] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:15:25 2022] POST /compute/v2.1/os-server-external-events => generated 521 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:15:25.972303 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3d2e5fbc-ce45-4a1c-b0dc-63078ac3e0fe tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:25.973242 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3d2e5fbc-ce45-4a1c-b0dc-63078ac3e0fe tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 519c7ca0-6d6b-4250-9b7b-8d5b6ef3b6b4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:25.981761 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3d2e5fbc-ce45-4a1c-b0dc-63078ac3e0fe tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:25.982661 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3d2e5fbc-ce45-4a1c-b0dc-63078ac3e0fe tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:25.984210 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3d2e5fbc-ce45-4a1c-b0dc-63078ac3e0fe tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:25.985466 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3d2e5fbc-ce45-4a1c-b0dc-63078ac3e0fe tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:25.985972 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3d2e5fbc-ce45-4a1c-b0dc-63078ac3e0fe tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:25.987722 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3d2e5fbc-ce45-4a1c-b0dc-63078ac3e0fe tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:26.003965 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-3d2e5fbc-ce45-4a1c-b0dc-63078ac3e0fe tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] HTTP exception thrown: Instance 519c7ca0-6d6b-4250-9b7b-8d5b6ef3b6b4 could not be found. Aug 31 16:15:26.006947 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3d2e5fbc-ce45-4a1c-b0dc-63078ac3e0fe tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Request method failure captured: Aug 31 16:15:26.006947 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/519c7ca0-6d6b-4250-9b7b-8d5b6ef3b6b4 HTTP/1.1 Aug 31 16:15:26.006947 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:15:26.006947 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:15:26.006947 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:15:26.006947 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:15:26.006947 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:15:26.006947 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:15:26.006947 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:15:26.006947 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:15:26.006947 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4gQXSNpx7T-s6ANX8A4XIz6BgCizm9VWKy6e0KLRI2pxjPOEzPLkRnoXGF3D-Jh3OWl1h65DNjP8YomYmS0bGyt_8avVSC7qeEvUleLImq7o7EhFYQT7JAMgMioD10eCPOZ7QHRsEPDslLrPXcQD5t1iAsH1xyWK7dbpfjoYLGjDpU Aug 31 16:15:26.006947 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:15:26.006947 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:15:26.006947 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:15:26.006947 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:15:26.006947 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:15:26.006947 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:15:26.006947 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 5299955053c842b6aa02e058f4b1c0cb Aug 31 16:15:26.006947 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ServersTestJSON-1028152372 Aug 31 16:15:26.006947 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:15:26.006947 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:15:26.006947 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5299955053c842b6aa02e058f4b1c0cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5299955053c842b6aa02e058f4b1c0cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5299955053c842b6aa02e058f4b1c0cb", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5299955053c842b6aa02e058f4b1c0cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:15:26.006947 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ServersTestJSON-1028152372 Aug 31 16:15:26.006947 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 5299955053c842b6aa02e058f4b1c0cb Aug 31 16:15:26.006947 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ServersTestJSON-1028152372 Aug 31 16:15:26.006947 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ServersTestJSON-1028152372-project Aug 31 16:15:26.006947 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:15:26.006947 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:15:26.006947 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 6e707652819c497bbdf94f85f39c447a Aug 31 16:15:26.006947 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ServersTestJSON-1028152372-project Aug 31 16:15:26.006947 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:15:26.006947 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance 519c7ca0-6d6b-4250-9b7b-8d5b6ef3b6b4 could not be found. Aug 31 16:15:26.006947 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '519c7ca0-6d6b-4250-9b7b-8d5b6ef3b6b4'} Aug 31 16:15:26.006947 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:15:26.006947 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:26.006947 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:15:26.006947 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:15:26.006947 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:15:26.006947 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:15:26.006947 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:15:26.006947 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:15:26.006947 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:15:26.006947 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:15:26.006947 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 519c7ca0-6d6b-4250-9b7b-8d5b6ef3b6b4 could not be found. Aug 31 16:15:26.006947 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:15:26.006947 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:15:26.006947 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:15:26.006947 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:26.006947 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:15:26.006947 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:15:26.006947 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:15:26.006947 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:15:26.006947 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:15:26.006947 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:15:26.006947 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:15:26.006947 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:15:26.006947 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:15:26.006947 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:15:26.006947 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:15:26.006947 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:15:26.006947 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 519c7ca0-6d6b-4250-9b7b-8d5b6ef3b6b4 could not be found. Aug 31 16:15:26.006947 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:15:26.006947 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:15:26.006947 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:15:26.012271 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:26.012271 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:15:26.012271 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:15:26.012271 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:15:26.012271 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:15:26.012271 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 519c7ca0-6d6b-4250-9b7b-8d5b6ef3b6b4 could not be found. Aug 31 16:15:26.012271 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:15:26.012271 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3d2e5fbc-ce45-4a1c-b0dc-63078ac3e0fe tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Returning 404 to user: Instance 519c7ca0-6d6b-4250-9b7b-8d5b6ef3b6b4 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:15:26.013002 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3d2e5fbc-ce45-4a1c-b0dc-63078ac3e0fe tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/519c7ca0-6d6b-4250-9b7b-8d5b6ef3b6b4" status: 404 len: 111 microversion: 2.1 time: 0.047695 Aug 31 16:15:26.017432 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2110/4233] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:25 2022] GET /compute/v2.1/servers/519c7ca0-6d6b-4250-9b7b-8d5b6ef3b6b4 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:15:26.030706 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ef6471a5-8784-47eb-a6f0-99823a220c50 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:26.031065 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ef6471a5-8784-47eb-a6f0-99823a220c50 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: d291088a-652f-4c17-8e1e-c54e91c2c1f2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:26.042003 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ef6471a5-8784-47eb-a6f0-99823a220c50 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:26.043557 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ef6471a5-8784-47eb-a6f0-99823a220c50 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:26.044049 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ef6471a5-8784-47eb-a6f0-99823a220c50 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:26.044792 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ef6471a5-8784-47eb-a6f0-99823a220c50 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:26.045263 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ef6471a5-8784-47eb-a6f0-99823a220c50 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:26.046298 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ef6471a5-8784-47eb-a6f0-99823a220c50 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:26.067722 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-ef6471a5-8784-47eb-a6f0-99823a220c50 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] HTTP exception thrown: Instance d291088a-652f-4c17-8e1e-c54e91c2c1f2 could not be found. Aug 31 16:15:26.069735 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ef6471a5-8784-47eb-a6f0-99823a220c50 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Request method failure captured: Aug 31 16:15:26.069735 n-d-850499-9 devstack@n-api.service[122256]: request: DELETE /compute/v2.1/servers/d291088a-652f-4c17-8e1e-c54e91c2c1f2 HTTP/1.1 Aug 31 16:15:26.069735 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:15:26.069735 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:15:26.069735 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:15:26.069735 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:15:26.069735 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:15:26.069735 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:15:26.069735 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:15:26.069735 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:15:26.069735 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4gQXSNpx7T-s6ANX8A4XIz6BgCizm9VWKy6e0KLRI2pxjPOEzPLkRnoXGF3D-Jh3OWl1h65DNjP8YomYmS0bGyt_8avVSC7qeEvUleLImq7o7EhFYQT7JAMgMioD10eCPOZ7QHRsEPDslLrPXcQD5t1iAsH1xyWK7dbpfjoYLGjDpU Aug 31 16:15:26.069735 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:15:26.069735 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:15:26.069735 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:15:26.069735 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:15:26.069735 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:15:26.069735 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:15:26.069735 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 5299955053c842b6aa02e058f4b1c0cb Aug 31 16:15:26.069735 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ServersTestJSON-1028152372 Aug 31 16:15:26.069735 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:15:26.069735 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:15:26.069735 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5299955053c842b6aa02e058f4b1c0cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5299955053c842b6aa02e058f4b1c0cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5299955053c842b6aa02e058f4b1c0cb", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5299955053c842b6aa02e058f4b1c0cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:15:26.069735 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ServersTestJSON-1028152372 Aug 31 16:15:26.069735 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 5299955053c842b6aa02e058f4b1c0cb Aug 31 16:15:26.069735 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ServersTestJSON-1028152372 Aug 31 16:15:26.069735 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ServersTestJSON-1028152372-project Aug 31 16:15:26.069735 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:15:26.069735 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:15:26.069735 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 6e707652819c497bbdf94f85f39c447a Aug 31 16:15:26.069735 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ServersTestJSON-1028152372-project Aug 31 16:15:26.069735 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:15:26.069735 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance d291088a-652f-4c17-8e1e-c54e91c2c1f2 could not be found. Aug 31 16:15:26.069735 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': 'd291088a-652f-4c17-8e1e-c54e91c2c1f2'} Aug 31 16:15:26.069735 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:15:26.069735 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:26.069735 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:15:26.069735 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:15:26.069735 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:15:26.069735 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:15:26.069735 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:15:26.069735 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:15:26.069735 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:15:26.069735 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:15:26.069735 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d291088a-652f-4c17-8e1e-c54e91c2c1f2 could not be found. Aug 31 16:15:26.069735 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:15:26.069735 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:15:26.069735 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:15:26.069735 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:26.069735 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:15:26.069735 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:15:26.069735 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:15:26.069735 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:15:26.069735 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:15:26.069735 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:15:26.069735 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:15:26.069735 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:15:26.069735 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:15:26.069735 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:15:26.069735 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:15:26.069735 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:15:26.069735 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:15:26.069735 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:15:26.069735 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d291088a-652f-4c17-8e1e-c54e91c2c1f2 could not be found. Aug 31 16:15:26.075137 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:15:26.075137 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:15:26.075137 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:15:26.075137 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:26.075137 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:15:26.075137 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:15:26.075137 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:15:26.075137 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:15:26.075137 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d291088a-652f-4c17-8e1e-c54e91c2c1f2 could not be found. Aug 31 16:15:26.075137 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:15:26.076732 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ef6471a5-8784-47eb-a6f0-99823a220c50 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Returning 404 to user: Instance d291088a-652f-4c17-8e1e-c54e91c2c1f2 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:15:26.077143 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ef6471a5-8784-47eb-a6f0-99823a220c50 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "DELETE /compute/v2.1/servers/d291088a-652f-4c17-8e1e-c54e91c2c1f2" status: 404 len: 111 microversion: 2.1 time: 0.055779 Aug 31 16:15:26.081543 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2111/4234] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:15:26 2022] DELETE /compute/v2.1/servers/d291088a-652f-4c17-8e1e-c54e91c2c1f2 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:15:26.089303 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4bf9a8c8-3df6-45bd-9930-155b9e351de5 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:26.090475 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4bf9a8c8-3df6-45bd-9930-155b9e351de5 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] [instance: 644d0221-94ca-4873-8fe0-ab72c4d7d68b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:26.099816 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4bf9a8c8-3df6-45bd-9930-155b9e351de5 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:26.100425 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4bf9a8c8-3df6-45bd-9930-155b9e351de5 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:26.101655 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4bf9a8c8-3df6-45bd-9930-155b9e351de5 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:26.102487 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4bf9a8c8-3df6-45bd-9930-155b9e351de5 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:26.103224 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4bf9a8c8-3df6-45bd-9930-155b9e351de5 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:26.103913 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4bf9a8c8-3df6-45bd-9930-155b9e351de5 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:26.121498 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-4bf9a8c8-3df6-45bd-9930-155b9e351de5 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] HTTP exception thrown: Instance 644d0221-94ca-4873-8fe0-ab72c4d7d68b could not be found. Aug 31 16:15:26.124175 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4bf9a8c8-3df6-45bd-9930-155b9e351de5 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Request method failure captured: Aug 31 16:15:26.124175 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/644d0221-94ca-4873-8fe0-ab72c4d7d68b HTTP/1.1 Aug 31 16:15:26.124175 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:15:26.124175 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:15:26.124175 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:15:26.124175 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:15:26.124175 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:15:26.124175 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:15:26.124175 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:15:26.124175 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:15:26.124175 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4jh2cLL9PyKqIDaLUuGdlir4zNr-WSNFs6WawJIF6lQvbO50QOdA1i_zk3b5cz_0EU7fu1GgcjfYn-PicIMoMNhd0PvpbUd_2WXjTNiTLZrS2pSMlXm-I_qeMHnHjwTM-mAUN8vF4LVqJBdMAu6R9hvSd_Qz_zwHY66WKZn6eV6pBI Aug 31 16:15:26.124175 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:15:26.124175 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:15:26.124175 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:15:26.124175 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:15:26.124175 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:15:26.124175 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:15:26.124175 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: aada201b2fd64fdc81a69f826e7c607b Aug 31 16:15:26.124175 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ServersTestMultiNic-285520906 Aug 31 16:15:26.124175 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:15:26.124175 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:15:26.124175 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/aada201b2fd64fdc81a69f826e7c607b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/aada201b2fd64fdc81a69f826e7c607b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_aada201b2fd64fdc81a69f826e7c607b", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/aada201b2fd64fdc81a69f826e7c607b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:15:26.124175 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ServersTestMultiNic-285520906 Aug 31 16:15:26.124175 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: aada201b2fd64fdc81a69f826e7c607b Aug 31 16:15:26.124175 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ServersTestMultiNic-285520906 Aug 31 16:15:26.124175 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ServersTestMultiNic-285520906-project Aug 31 16:15:26.124175 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:15:26.124175 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:15:26.124175 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 860ac4e423cf410d9bbc354c77ba864c Aug 31 16:15:26.124175 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ServersTestMultiNic-285520906-project Aug 31 16:15:26.124175 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:15:26.124175 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance 644d0221-94ca-4873-8fe0-ab72c4d7d68b could not be found. Aug 31 16:15:26.124175 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '644d0221-94ca-4873-8fe0-ab72c4d7d68b'} Aug 31 16:15:26.124175 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:15:26.124175 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:26.124175 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:15:26.124175 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:15:26.124175 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:15:26.124175 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:15:26.124175 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:15:26.124175 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:15:26.124175 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:15:26.124175 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:15:26.124175 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 644d0221-94ca-4873-8fe0-ab72c4d7d68b could not be found. Aug 31 16:15:26.124175 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:15:26.124175 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:15:26.124175 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:15:26.124175 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:26.124175 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:15:26.124175 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:15:26.124175 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:15:26.124175 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:15:26.124175 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:15:26.124175 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:15:26.124175 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:15:26.124175 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:15:26.124175 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:15:26.124175 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:15:26.124175 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:15:26.124175 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:15:26.124175 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 644d0221-94ca-4873-8fe0-ab72c4d7d68b could not be found. Aug 31 16:15:26.124175 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:15:26.124175 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:15:26.124175 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:15:26.129928 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:26.129928 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:15:26.129928 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:15:26.129928 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:15:26.129928 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:15:26.129928 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 644d0221-94ca-4873-8fe0-ab72c4d7d68b could not be found. Aug 31 16:15:26.129928 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:15:26.129928 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4bf9a8c8-3df6-45bd-9930-155b9e351de5 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Returning 404 to user: Instance 644d0221-94ca-4873-8fe0-ab72c4d7d68b could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:15:26.129928 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4bf9a8c8-3df6-45bd-9930-155b9e351de5 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] 10.222.0.61 "GET /compute/v2.1/servers/644d0221-94ca-4873-8fe0-ab72c4d7d68b" status: 404 len: 111 microversion: 2.1 time: 0.046936 Aug 31 16:15:26.129928 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2112/4235] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:26 2022] GET /compute/v2.1/servers/644d0221-94ca-4873-8fe0-ab72c4d7d68b => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:15:26.132507 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-dd7833fe-cfc5-431c-88e5-381d921eb56a tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:26.133367 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-dd7833fe-cfc5-431c-88e5-381d921eb56a tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: d291088a-652f-4c17-8e1e-c54e91c2c1f2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:26.140705 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dd7833fe-cfc5-431c-88e5-381d921eb56a tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:26.142200 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dd7833fe-cfc5-431c-88e5-381d921eb56a tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:26.143207 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dd7833fe-cfc5-431c-88e5-381d921eb56a tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:26.144167 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dd7833fe-cfc5-431c-88e5-381d921eb56a tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:26.144811 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dd7833fe-cfc5-431c-88e5-381d921eb56a tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:26.145445 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dd7833fe-cfc5-431c-88e5-381d921eb56a tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:26.158260 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8d2d308f-4ff4-4a0c-8bed-4bc05f319c67 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb261f2061164b49a8d496b16647dd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d2222a956a4888967e21647e26b310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:26.166251 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-dd7833fe-cfc5-431c-88e5-381d921eb56a tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] HTTP exception thrown: Instance d291088a-652f-4c17-8e1e-c54e91c2c1f2 could not be found. Aug 31 16:15:26.168186 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-dd7833fe-cfc5-431c-88e5-381d921eb56a tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Request method failure captured: Aug 31 16:15:26.168186 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/d291088a-652f-4c17-8e1e-c54e91c2c1f2 HTTP/1.1 Aug 31 16:15:26.168186 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:15:26.168186 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:15:26.168186 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:15:26.168186 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:15:26.168186 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:15:26.168186 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:15:26.168186 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:15:26.168186 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:15:26.168186 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4gQXSNpx7T-s6ANX8A4XIz6BgCizm9VWKy6e0KLRI2pxjPOEzPLkRnoXGF3D-Jh3OWl1h65DNjP8YomYmS0bGyt_8avVSC7qeEvUleLImq7o7EhFYQT7JAMgMioD10eCPOZ7QHRsEPDslLrPXcQD5t1iAsH1xyWK7dbpfjoYLGjDpU Aug 31 16:15:26.168186 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:15:26.168186 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:15:26.168186 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:15:26.168186 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:15:26.168186 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:15:26.168186 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:15:26.168186 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 5299955053c842b6aa02e058f4b1c0cb Aug 31 16:15:26.168186 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ServersTestJSON-1028152372 Aug 31 16:15:26.168186 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:15:26.168186 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:15:26.168186 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5299955053c842b6aa02e058f4b1c0cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5299955053c842b6aa02e058f4b1c0cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5299955053c842b6aa02e058f4b1c0cb", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5299955053c842b6aa02e058f4b1c0cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:15:26.168186 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ServersTestJSON-1028152372 Aug 31 16:15:26.168186 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 5299955053c842b6aa02e058f4b1c0cb Aug 31 16:15:26.168186 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ServersTestJSON-1028152372 Aug 31 16:15:26.168186 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ServersTestJSON-1028152372-project Aug 31 16:15:26.168186 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:15:26.168186 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:15:26.168186 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 6e707652819c497bbdf94f85f39c447a Aug 31 16:15:26.168186 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ServersTestJSON-1028152372-project Aug 31 16:15:26.168186 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:15:26.168186 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance d291088a-652f-4c17-8e1e-c54e91c2c1f2 could not be found. Aug 31 16:15:26.168186 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': 'd291088a-652f-4c17-8e1e-c54e91c2c1f2'} Aug 31 16:15:26.168186 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:15:26.168186 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:26.168186 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:15:26.168186 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:15:26.168186 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:15:26.168186 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:15:26.168186 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:15:26.168186 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:15:26.168186 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:15:26.168186 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:15:26.168186 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d291088a-652f-4c17-8e1e-c54e91c2c1f2 could not be found. Aug 31 16:15:26.168186 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:15:26.168186 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:15:26.168186 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:15:26.168186 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:26.168186 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:15:26.168186 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:15:26.168186 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:15:26.168186 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:15:26.168186 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:15:26.168186 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:15:26.168186 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:15:26.168186 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:15:26.168186 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:15:26.168186 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:15:26.168186 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:15:26.168186 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:15:26.168186 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d291088a-652f-4c17-8e1e-c54e91c2c1f2 could not be found. Aug 31 16:15:26.168186 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:15:26.168186 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:15:26.168186 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:15:26.175128 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:26.175128 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:15:26.175128 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:15:26.175128 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:15:26.175128 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:15:26.175128 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d291088a-652f-4c17-8e1e-c54e91c2c1f2 could not be found. Aug 31 16:15:26.175128 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:15:26.175128 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-dd7833fe-cfc5-431c-88e5-381d921eb56a tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Returning 404 to user: Instance d291088a-652f-4c17-8e1e-c54e91c2c1f2 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:15:26.175128 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-dd7833fe-cfc5-431c-88e5-381d921eb56a tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/d291088a-652f-4c17-8e1e-c54e91c2c1f2" status: 404 len: 111 microversion: 2.1 time: 0.041655 Aug 31 16:15:26.175128 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2113/4236] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:26 2022] GET /compute/v2.1/servers/d291088a-652f-4c17-8e1e-c54e91c2c1f2 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:15:26.176875 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8d2d308f-4ff4-4a0c-8bed-4bc05f319c67 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "GET /compute/v2.1/servers/c4ef985e-0861-4c5d-88eb-d8ad053a8f54" status: 200 len: 1507 microversion: 2.1 time: 0.229898 Aug 31 16:15:26.176875 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2124/4237] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:25 2022] GET /compute/v2.1/servers/c4ef985e-0861-4c5d-88eb-d8ad053a8f54 => generated 1507 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:26.192769 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-48541e0a-237d-41c9-b2cf-06b1f8770bd3 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:26.194491 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-48541e0a-237d-41c9-b2cf-06b1f8770bd3 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 3de9f9a4-15c5-4bd9-a187-07d36cf9fb03] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:26.195569 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-cdb7ef4f-5775-4db3-ac71-b0eeddf205b4 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:26.197192 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:15:26.197370 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-cdb7ef4f-5775-4db3-ac71-b0eeddf205b4 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: c4ef985e-0861-4c5d-88eb-d8ad053a8f54] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:26.208148 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-48541e0a-237d-41c9-b2cf-06b1f8770bd3 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:26.210524 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-48541e0a-237d-41c9-b2cf-06b1f8770bd3 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:26.210824 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-48541e0a-237d-41c9-b2cf-06b1f8770bd3 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:26.211814 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-48541e0a-237d-41c9-b2cf-06b1f8770bd3 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:26.212291 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-48541e0a-237d-41c9-b2cf-06b1f8770bd3 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:26.212779 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-48541e0a-237d-41c9-b2cf-06b1f8770bd3 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:26.213119 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cdb7ef4f-5775-4db3-ac71-b0eeddf205b4 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:26.213807 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cdb7ef4f-5775-4db3-ac71-b0eeddf205b4 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:26.214559 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cdb7ef4f-5775-4db3-ac71-b0eeddf205b4 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:26.215672 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cdb7ef4f-5775-4db3-ac71-b0eeddf205b4 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:26.216371 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cdb7ef4f-5775-4db3-ac71-b0eeddf205b4 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:26.217210 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cdb7ef4f-5775-4db3-ac71-b0eeddf205b4 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:26.248540 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-48541e0a-237d-41c9-b2cf-06b1f8770bd3 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 3de9f9a4-15c5-4bd9-a187-07d36cf9fb03] Going to try to terminate instance {{(pid=122256) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:15:26.372969 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-48541e0a-237d-41c9-b2cf-06b1f8770bd3 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "DELETE /compute/v2.1/servers/3de9f9a4-15c5-4bd9-a187-07d36cf9fb03" status: 204 len: 0 microversion: 2.1 time: 0.196723 Aug 31 16:15:26.374567 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2114/4238] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:15:26 2022] DELETE /compute/v2.1/servers/3de9f9a4-15c5-4bd9-a187-07d36cf9fb03 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 16:15:26.383582 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-d2ba234e-907f-47ae-a561-3749588d0292 req-701bafa2-03e4-425c-9f43-92f0a4581586 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64136c5d-b1e6-4263-a450-3308b0b4f69b", "name": "network-vif-plugged", "status": "completed", "tag": "389d797b-d29f-45f1-8814-cae5984b364d"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:15:26.394450 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-d2ba234e-907f-47ae-a561-3749588d0292 req-701bafa2-03e4-425c-9f43-92f0a4581586 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:26.395360 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-d2ba234e-907f-47ae-a561-3749588d0292 req-701bafa2-03e4-425c-9f43-92f0a4581586 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:26.396049 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-d2ba234e-907f-47ae-a561-3749588d0292 req-701bafa2-03e4-425c-9f43-92f0a4581586 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:26.410323 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-d2ba234e-907f-47ae-a561-3749588d0292 req-701bafa2-03e4-425c-9f43-92f0a4581586 service nova] Creating event network-vif-plugged:389d797b-d29f-45f1-8814-cae5984b364d for instance 64136c5d-b1e6-4263-a450-3308b0b4f69b on n-h2-850499-9 Aug 31 16:15:26.415967 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-d2ba234e-907f-47ae-a561-3749588d0292 req-701bafa2-03e4-425c-9f43-92f0a4581586 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039315 Aug 31 16:15:26.416841 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2115/4239] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:15:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:15:26.424193 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-008107c6-5387-40e1-81ff-174305b6287d tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:26.425578 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-008107c6-5387-40e1-81ff-174305b6287d tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] [instance: 64136c5d-b1e6-4263-a450-3308b0b4f69b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:26.433098 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-008107c6-5387-40e1-81ff-174305b6287d tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:26.433912 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-008107c6-5387-40e1-81ff-174305b6287d tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:26.434565 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-008107c6-5387-40e1-81ff-174305b6287d tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:26.434851 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-cdb7ef4f-5775-4db3-ac71-b0eeddf205b4 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb261f2061164b49a8d496b16647dd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d2222a956a4888967e21647e26b310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:26.437185 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-008107c6-5387-40e1-81ff-174305b6287d tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:26.438012 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-008107c6-5387-40e1-81ff-174305b6287d tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:26.439169 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-008107c6-5387-40e1-81ff-174305b6287d tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:26.456091 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-cdb7ef4f-5775-4db3-ac71-b0eeddf205b4 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "GET /compute/v2.1/servers/c4ef985e-0861-4c5d-88eb-d8ad053a8f54" status: 200 len: 1507 microversion: 2.1 time: 0.256509 Aug 31 16:15:26.457908 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2125/4240] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:26 2022] GET /compute/v2.1/servers/c4ef985e-0861-4c5d-88eb-d8ad053a8f54 => generated 1507 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:15:26.465613 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8562bdb5-3758-4490-a0c6-8cb2e981608c tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:26.466891 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8562bdb5-3758-4490-a0c6-8cb2e981608c tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 3de9f9a4-15c5-4bd9-a187-07d36cf9fb03] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:26.475729 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8562bdb5-3758-4490-a0c6-8cb2e981608c tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:26.481912 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8562bdb5-3758-4490-a0c6-8cb2e981608c tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:26.485321 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8562bdb5-3758-4490-a0c6-8cb2e981608c tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:26.488332 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8562bdb5-3758-4490-a0c6-8cb2e981608c tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:26.489212 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8562bdb5-3758-4490-a0c6-8cb2e981608c tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:26.490477 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8562bdb5-3758-4490-a0c6-8cb2e981608c tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:26.738551 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8562bdb5-3758-4490-a0c6-8cb2e981608c tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:26.752989 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8562bdb5-3758-4490-a0c6-8cb2e981608c tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/3de9f9a4-15c5-4bd9-a187-07d36cf9fb03" status: 200 len: 1480 microversion: 2.1 time: 0.293675 Aug 31 16:15:26.754230 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2126/4241] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:26 2022] GET /compute/v2.1/servers/3de9f9a4-15c5-4bd9-a187-07d36cf9fb03 => generated 1480 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:26.754871 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-008107c6-5387-40e1-81ff-174305b6287d tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d6eee711fe4194a4db63c801f78561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeac74d3027d4080be26bf3aadab4c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:26.759734 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3d5c9a68-abd0-499d-8466-f096e0bfbd90 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:26.760878 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3d5c9a68-abd0-499d-8466-f096e0bfbd90 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] [instance: fa0932e8-1aa4-4d1a-b653-14be35568f3d] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:26.767988 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3d5c9a68-abd0-499d-8466-f096e0bfbd90 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:26.768868 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3d5c9a68-abd0-499d-8466-f096e0bfbd90 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:26.769539 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3d5c9a68-abd0-499d-8466-f096e0bfbd90 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:26.770567 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3d5c9a68-abd0-499d-8466-f096e0bfbd90 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:26.771380 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3d5c9a68-abd0-499d-8466-f096e0bfbd90 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:26.771991 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3d5c9a68-abd0-499d-8466-f096e0bfbd90 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:26.777177 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-008107c6-5387-40e1-81ff-174305b6287d tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] 10.222.0.61 "GET /compute/v2.1/servers/64136c5d-b1e6-4263-a450-3308b0b4f69b" status: 200 len: 1318 microversion: 2.1 time: 0.358849 Aug 31 16:15:26.777768 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2116/4242] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:26 2022] GET /compute/v2.1/servers/64136c5d-b1e6-4263-a450-3308b0b4f69b => generated 1318 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:26.791765 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-064c1895-7c24-40ba-878f-58f8a3ccf076 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "OS-DCF:diskConfig": "AUTO"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:15:26.796000 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-064c1895-7c24-40ba-878f-58f8a3ccf076 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: c4ef985e-0861-4c5d-88eb-d8ad053a8f54] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:26.807004 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-064c1895-7c24-40ba-878f-58f8a3ccf076 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:26.807532 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-064c1895-7c24-40ba-878f-58f8a3ccf076 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:26.808497 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-064c1895-7c24-40ba-878f-58f8a3ccf076 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:26.808699 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-064c1895-7c24-40ba-878f-58f8a3ccf076 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:26.812221 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-064c1895-7c24-40ba-878f-58f8a3ccf076 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:26.813399 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-064c1895-7c24-40ba-878f-58f8a3ccf076 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:26.939860 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-064c1895-7c24-40ba-878f-58f8a3ccf076 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:15:26.940609 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-064c1895-7c24-40ba-878f-58f8a3ccf076 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:15:26.940809 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-064c1895-7c24-40ba-878f-58f8a3ccf076 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:15:26.941227 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-064c1895-7c24-40ba-878f-58f8a3ccf076 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:15:26.941644 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-064c1895-7c24-40ba-878f-58f8a3ccf076 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:15:27.025877 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-064c1895-7c24-40ba-878f-58f8a3ccf076 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: c4ef985e-0861-4c5d-88eb-d8ad053a8f54] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:27.034755 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-064c1895-7c24-40ba-878f-58f8a3ccf076 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:27.035859 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-064c1895-7c24-40ba-878f-58f8a3ccf076 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:27.036789 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-064c1895-7c24-40ba-878f-58f8a3ccf076 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:27.037750 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-064c1895-7c24-40ba-878f-58f8a3ccf076 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:27.038557 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-064c1895-7c24-40ba-878f-58f8a3ccf076 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:27.039487 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-064c1895-7c24-40ba-878f-58f8a3ccf076 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:27.080662 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-064c1895-7c24-40ba-878f-58f8a3ccf076 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "POST /compute/v2.1/servers/c4ef985e-0861-4c5d-88eb-d8ad053a8f54/action" status: 202 len: 1109 microversion: 2.1 time: 0.300624 Aug 31 16:15:27.082217 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2117/4243] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:15:26 2022] POST /compute/v2.1/servers/c4ef985e-0861-4c5d-88eb-d8ad053a8f54/action => generated 1109 bytes in 303 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 31 16:15:27.087840 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8f14431d-4f96-48a7-9cba-a8b0d859bea5 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:27.088908 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8f14431d-4f96-48a7-9cba-a8b0d859bea5 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] [instance: f04eb48d-000e-4c3b-8799-a4d3cdacf0e2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:27.105937 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8f14431d-4f96-48a7-9cba-a8b0d859bea5 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:27.106729 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8f14431d-4f96-48a7-9cba-a8b0d859bea5 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:27.107437 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8f14431d-4f96-48a7-9cba-a8b0d859bea5 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:27.110005 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8f14431d-4f96-48a7-9cba-a8b0d859bea5 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:27.111478 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8f14431d-4f96-48a7-9cba-a8b0d859bea5 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:27.114100 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8f14431d-4f96-48a7-9cba-a8b0d859bea5 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:27.538373 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3d5c9a68-abd0-499d-8466-f096e0bfbd90 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:27.549232 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3d5c9a68-abd0-499d-8466-f096e0bfbd90 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:27.550819 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3d5c9a68-abd0-499d-8466-f096e0bfbd90 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:27.552295 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3d5c9a68-abd0-499d-8466-f096e0bfbd90 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] 10.222.0.61 "GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d" status: 200 len: 2957 microversion: 2.32 time: 0.796611 Aug 31 16:15:27.553114 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2127/4244] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:15:26 2022] GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d => generated 2957 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:15:27.572982 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7ce3f7e3-9792-4bf8-b841-5ab2b4e10ef4 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:27.577076 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8f14431d-4f96-48a7-9cba-a8b0d859bea5 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed06378eb9b446680b5a3156a14941d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511432a7dee4bec9d1093c9d95b3734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:27.577264 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7ce3f7e3-9792-4bf8-b841-5ab2b4e10ef4 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: e3625fdf-7e50-4ba1-99dc-6ae7473fc706] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:27.583705 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7ce3f7e3-9792-4bf8-b841-5ab2b4e10ef4 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:27.584278 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7ce3f7e3-9792-4bf8-b841-5ab2b4e10ef4 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:27.584801 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7ce3f7e3-9792-4bf8-b841-5ab2b4e10ef4 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:27.585232 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8f14431d-4f96-48a7-9cba-a8b0d859bea5 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] 10.222.0.61 "GET /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2" status: 200 len: 1712 microversion: 2.1 time: 0.501664 Aug 31 16:15:27.585627 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7ce3f7e3-9792-4bf8-b841-5ab2b4e10ef4 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:27.587535 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7ce3f7e3-9792-4bf8-b841-5ab2b4e10ef4 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:27.587696 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2118/4245] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:27 2022] GET /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2 => generated 1712 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:27.587807 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7ce3f7e3-9792-4bf8-b841-5ab2b4e10ef4 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:27.601429 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7e76f37a-b800-4793-a52f-7b628c0b0adc tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:27.602345 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7e76f37a-b800-4793-a52f-7b628c0b0adc tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: c4ef985e-0861-4c5d-88eb-d8ad053a8f54] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:27.608704 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7e76f37a-b800-4793-a52f-7b628c0b0adc tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:27.609433 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7e76f37a-b800-4793-a52f-7b628c0b0adc tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:27.610011 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7e76f37a-b800-4793-a52f-7b628c0b0adc tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:27.611426 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7e76f37a-b800-4793-a52f-7b628c0b0adc tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:27.611921 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7e76f37a-b800-4793-a52f-7b628c0b0adc tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:27.612524 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7e76f37a-b800-4793-a52f-7b628c0b0adc tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:27.877888 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7ce3f7e3-9792-4bf8-b841-5ab2b4e10ef4 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48ee960c38f4d0584ea5ce34579279f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a957b6585e74a31b5bc5f66441c33e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:27.885989 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7ce3f7e3-9792-4bf8-b841-5ab2b4e10ef4 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706" status: 200 len: 1506 microversion: 2.1 time: 0.316956 Aug 31 16:15:27.886708 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2128/4246] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:27 2022] GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706 => generated 1506 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:27.891527 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c0c259a6-a5b5-498b-b752-8cac216bdb07 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:27.892530 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c0c259a6-a5b5-498b-b752-8cac216bdb07 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 3de9f9a4-15c5-4bd9-a187-07d36cf9fb03] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:27.900401 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c0c259a6-a5b5-498b-b752-8cac216bdb07 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:27.901234 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c0c259a6-a5b5-498b-b752-8cac216bdb07 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:27.901915 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c0c259a6-a5b5-498b-b752-8cac216bdb07 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:27.902850 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c0c259a6-a5b5-498b-b752-8cac216bdb07 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:27.903542 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c0c259a6-a5b5-498b-b752-8cac216bdb07 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:27.904199 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c0c259a6-a5b5-498b-b752-8cac216bdb07 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:27.922340 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7e76f37a-b800-4793-a52f-7b628c0b0adc tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb261f2061164b49a8d496b16647dd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d2222a956a4888967e21647e26b310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:27.933985 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7e76f37a-b800-4793-a52f-7b628c0b0adc tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "GET /compute/v2.1/servers/c4ef985e-0861-4c5d-88eb-d8ad053a8f54" status: 200 len: 1514 microversion: 2.1 time: 0.346697 Aug 31 16:15:27.935248 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2119/4247] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:27 2022] GET /compute/v2.1/servers/c4ef985e-0861-4c5d-88eb-d8ad053a8f54 => generated 1514 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:27.940587 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f34e1af7-9e97-4b55-aaa2-9c8a404fcb9c tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:27.941921 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f34e1af7-9e97-4b55-aaa2-9c8a404fcb9c tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] [instance: 64136c5d-b1e6-4263-a450-3308b0b4f69b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:27.956768 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f34e1af7-9e97-4b55-aaa2-9c8a404fcb9c tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:27.957167 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f34e1af7-9e97-4b55-aaa2-9c8a404fcb9c tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:27.958075 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f34e1af7-9e97-4b55-aaa2-9c8a404fcb9c tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:27.959579 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f34e1af7-9e97-4b55-aaa2-9c8a404fcb9c tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:27.960061 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f34e1af7-9e97-4b55-aaa2-9c8a404fcb9c tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:27.960497 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f34e1af7-9e97-4b55-aaa2-9c8a404fcb9c tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:28.309300 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c0c259a6-a5b5-498b-b752-8cac216bdb07 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:28.322932 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c0c259a6-a5b5-498b-b752-8cac216bdb07 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/3de9f9a4-15c5-4bd9-a187-07d36cf9fb03" status: 200 len: 1480 microversion: 2.1 time: 0.434918 Aug 31 16:15:28.324072 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2129/4248] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:27 2022] GET /compute/v2.1/servers/3de9f9a4-15c5-4bd9-a187-07d36cf9fb03 => generated 1480 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:28.431028 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f34e1af7-9e97-4b55-aaa2-9c8a404fcb9c tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d6eee711fe4194a4db63c801f78561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeac74d3027d4080be26bf3aadab4c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:28.442353 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f34e1af7-9e97-4b55-aaa2-9c8a404fcb9c tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] 10.222.0.61 "GET /compute/v2.1/servers/64136c5d-b1e6-4263-a450-3308b0b4f69b" status: 200 len: 1318 microversion: 2.1 time: 0.505611 Aug 31 16:15:28.442951 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2120/4249] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:27 2022] GET /compute/v2.1/servers/64136c5d-b1e6-4263-a450-3308b0b4f69b => generated 1318 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:28.586164 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-cd58135c-c283-45cf-af36-f29fe0870fbe tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:28.587049 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-cd58135c-c283-45cf-af36-f29fe0870fbe tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] [instance: fa0932e8-1aa4-4d1a-b653-14be35568f3d] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:28.597300 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cd58135c-c283-45cf-af36-f29fe0870fbe tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:28.597846 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cd58135c-c283-45cf-af36-f29fe0870fbe tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:28.598315 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cd58135c-c283-45cf-af36-f29fe0870fbe tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:28.599082 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cd58135c-c283-45cf-af36-f29fe0870fbe tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:28.599774 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cd58135c-c283-45cf-af36-f29fe0870fbe tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:28.600209 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cd58135c-c283-45cf-af36-f29fe0870fbe tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:28.915364 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f0fa35ad-04a1-4a64-81ae-e9f023582a06 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:28.916058 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f0fa35ad-04a1-4a64-81ae-e9f023582a06 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: e3625fdf-7e50-4ba1-99dc-6ae7473fc706] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:28.922111 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f0fa35ad-04a1-4a64-81ae-e9f023582a06 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:28.922595 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f0fa35ad-04a1-4a64-81ae-e9f023582a06 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:28.923089 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f0fa35ad-04a1-4a64-81ae-e9f023582a06 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:28.923917 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f0fa35ad-04a1-4a64-81ae-e9f023582a06 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:28.924373 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f0fa35ad-04a1-4a64-81ae-e9f023582a06 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:28.924803 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f0fa35ad-04a1-4a64-81ae-e9f023582a06 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:29.344787 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-cd58135c-c283-45cf-af36-f29fe0870fbe tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:29.348760 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=100 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:15:29.355691 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-cd58135c-c283-45cf-af36-f29fe0870fbe tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:29.357166 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-cd58135c-c283-45cf-af36-f29fe0870fbe tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:29.358437 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-cd58135c-c283-45cf-af36-f29fe0870fbe tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] 10.222.0.61 "GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d" status: 200 len: 2957 microversion: 2.32 time: 0.777767 Aug 31 16:15:29.359003 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2130/4250] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:15:28 2022] GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d => generated 2957 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:15:29.363715 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-30b71713-0cae-46f2-a254-e6f157078ead tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:29.364321 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-30b71713-0cae-46f2-a254-e6f157078ead tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: c4ef985e-0861-4c5d-88eb-d8ad053a8f54] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:29.370412 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-30b71713-0cae-46f2-a254-e6f157078ead tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:29.370791 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-30b71713-0cae-46f2-a254-e6f157078ead tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:29.371229 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-30b71713-0cae-46f2-a254-e6f157078ead tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:29.371959 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-30b71713-0cae-46f2-a254-e6f157078ead tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:29.372423 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-30b71713-0cae-46f2-a254-e6f157078ead tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:29.372844 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-30b71713-0cae-46f2-a254-e6f157078ead tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:29.429485 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f0fa35ad-04a1-4a64-81ae-e9f023582a06 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48ee960c38f4d0584ea5ce34579279f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a957b6585e74a31b5bc5f66441c33e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:29.438351 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f0fa35ad-04a1-4a64-81ae-e9f023582a06 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706" status: 200 len: 1506 microversion: 2.1 time: 0.527482 Aug 31 16:15:29.439985 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2121/4251] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:28 2022] GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706 => generated 1506 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:15:29.444659 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0c6378fe-7b49-44d3-b83c-125af3646622 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:29.445480 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0c6378fe-7b49-44d3-b83c-125af3646622 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 3de9f9a4-15c5-4bd9-a187-07d36cf9fb03] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:29.458216 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0c6378fe-7b49-44d3-b83c-125af3646622 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:29.458717 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0c6378fe-7b49-44d3-b83c-125af3646622 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:29.459151 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0c6378fe-7b49-44d3-b83c-125af3646622 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:29.459881 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0c6378fe-7b49-44d3-b83c-125af3646622 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:29.460513 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0c6378fe-7b49-44d3-b83c-125af3646622 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:29.460947 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0c6378fe-7b49-44d3-b83c-125af3646622 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:29.817940 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-30b71713-0cae-46f2-a254-e6f157078ead tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb261f2061164b49a8d496b16647dd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d2222a956a4888967e21647e26b310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:29.828914 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-30b71713-0cae-46f2-a254-e6f157078ead tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "GET /compute/v2.1/servers/c4ef985e-0861-4c5d-88eb-d8ad053a8f54" status: 200 len: 1514 microversion: 2.1 time: 0.468551 Aug 31 16:15:29.830884 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2131/4252] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:29 2022] GET /compute/v2.1/servers/c4ef985e-0861-4c5d-88eb-d8ad053a8f54 => generated 1514 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:29.836780 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7faf768c-5f6c-4b84-a7ed-d792ad6a00bd tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:29.837928 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7faf768c-5f6c-4b84-a7ed-d792ad6a00bd tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] [instance: 64136c5d-b1e6-4263-a450-3308b0b4f69b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:29.838846 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-0c6378fe-7b49-44d3-b83c-125af3646622 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e707652819c497bbdf94f85f39c447a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5299955053c842b6aa02e058f4b1c0cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:29.847993 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0c6378fe-7b49-44d3-b83c-125af3646622 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/3de9f9a4-15c5-4bd9-a187-07d36cf9fb03" status: 200 len: 1480 microversion: 2.1 time: 0.406607 Aug 31 16:15:29.860476 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7faf768c-5f6c-4b84-a7ed-d792ad6a00bd tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:29.860476 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7faf768c-5f6c-4b84-a7ed-d792ad6a00bd tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:29.860476 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7faf768c-5f6c-4b84-a7ed-d792ad6a00bd tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:29.860476 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7faf768c-5f6c-4b84-a7ed-d792ad6a00bd tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:29.860476 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7faf768c-5f6c-4b84-a7ed-d792ad6a00bd tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:29.860476 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7faf768c-5f6c-4b84-a7ed-d792ad6a00bd tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:29.861042 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2122/4253] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:29 2022] GET /compute/v2.1/servers/3de9f9a4-15c5-4bd9-a187-07d36cf9fb03 => generated 1480 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:29.961618 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-97e84771-4f56-4d12-8600-b9f7da1d3e66 req-6b9c770a-7979-44d9-9ce8-00358cfd6c28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3de9f9a4-15c5-4bd9-a187-07d36cf9fb03", "name": "network-vif-deleted", "tag": "aaaa54d4-97ee-443d-9dbc-56512afbfca7"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:15:29.971959 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-97e84771-4f56-4d12-8600-b9f7da1d3e66 req-6b9c770a-7979-44d9-9ce8-00358cfd6c28 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:29.972498 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-97e84771-4f56-4d12-8600-b9f7da1d3e66 req-6b9c770a-7979-44d9-9ce8-00358cfd6c28 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:29.972933 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-97e84771-4f56-4d12-8600-b9f7da1d3e66 req-6b9c770a-7979-44d9-9ce8-00358cfd6c28 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:29.984900 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-97e84771-4f56-4d12-8600-b9f7da1d3e66 req-6b9c770a-7979-44d9-9ce8-00358cfd6c28 service nova] Creating event network-vif-deleted:aaaa54d4-97ee-443d-9dbc-56512afbfca7 for instance 3de9f9a4-15c5-4bd9-a187-07d36cf9fb03 on n-h1-850499-9 Aug 31 16:15:29.990537 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-97e84771-4f56-4d12-8600-b9f7da1d3e66 req-6b9c770a-7979-44d9-9ce8-00358cfd6c28 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032461 Aug 31 16:15:29.991158 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2123/4254] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:15:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:15:30.127577 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7faf768c-5f6c-4b84-a7ed-d792ad6a00bd tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d6eee711fe4194a4db63c801f78561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeac74d3027d4080be26bf3aadab4c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:30.148250 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7faf768c-5f6c-4b84-a7ed-d792ad6a00bd tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] 10.222.0.61 "GET /compute/v2.1/servers/64136c5d-b1e6-4263-a450-3308b0b4f69b" status: 200 len: 1318 microversion: 2.1 time: 0.315635 Aug 31 16:15:30.148856 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2132/4255] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:29 2022] GET /compute/v2.1/servers/64136c5d-b1e6-4263-a450-3308b0b4f69b => generated 1318 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:30.386748 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-79bff723-9a87-4870-8192-17abdabbe048 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:30.387350 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-79bff723-9a87-4870-8192-17abdabbe048 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] [instance: fa0932e8-1aa4-4d1a-b653-14be35568f3d] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:30.395184 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-79bff723-9a87-4870-8192-17abdabbe048 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:30.396029 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-79bff723-9a87-4870-8192-17abdabbe048 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:30.396667 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-79bff723-9a87-4870-8192-17abdabbe048 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:30.397584 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-79bff723-9a87-4870-8192-17abdabbe048 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:30.398220 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-79bff723-9a87-4870-8192-17abdabbe048 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:30.398835 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-79bff723-9a87-4870-8192-17abdabbe048 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:30.473857 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-160fa072-5139-4a9e-b43a-1345ed697a43 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:30.474497 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-160fa072-5139-4a9e-b43a-1345ed697a43 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: e3625fdf-7e50-4ba1-99dc-6ae7473fc706] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:30.481420 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-160fa072-5139-4a9e-b43a-1345ed697a43 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:30.481926 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-160fa072-5139-4a9e-b43a-1345ed697a43 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:30.482367 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-160fa072-5139-4a9e-b43a-1345ed697a43 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:30.483233 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-160fa072-5139-4a9e-b43a-1345ed697a43 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:30.483728 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-160fa072-5139-4a9e-b43a-1345ed697a43 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:30.484163 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-160fa072-5139-4a9e-b43a-1345ed697a43 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:30.696745 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-79bff723-9a87-4870-8192-17abdabbe048 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:30.711966 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-79bff723-9a87-4870-8192-17abdabbe048 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:30.713785 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-79bff723-9a87-4870-8192-17abdabbe048 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:30.715305 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-79bff723-9a87-4870-8192-17abdabbe048 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] 10.222.0.61 "GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d" status: 200 len: 2957 microversion: 2.32 time: 0.334247 Aug 31 16:15:30.728388 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2124/4256] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:15:30 2022] GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d => generated 2957 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:15:30.768079 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-160fa072-5139-4a9e-b43a-1345ed697a43 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48ee960c38f4d0584ea5ce34579279f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a957b6585e74a31b5bc5f66441c33e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:30.781180 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-160fa072-5139-4a9e-b43a-1345ed697a43 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706" status: 200 len: 1506 microversion: 2.1 time: 0.318536 Aug 31 16:15:30.785228 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2133/4257] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:30 2022] GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706 => generated 1506 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:30.853168 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-752ae17c-8caf-4743-9599-dbd47953f68e tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:30.853925 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-752ae17c-8caf-4743-9599-dbd47953f68e tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: c4ef985e-0861-4c5d-88eb-d8ad053a8f54] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:30.862453 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-752ae17c-8caf-4743-9599-dbd47953f68e tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:30.863273 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-752ae17c-8caf-4743-9599-dbd47953f68e tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:30.863941 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-752ae17c-8caf-4743-9599-dbd47953f68e tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:30.864911 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-752ae17c-8caf-4743-9599-dbd47953f68e tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:30.865906 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-752ae17c-8caf-4743-9599-dbd47953f68e tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:30.866655 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-752ae17c-8caf-4743-9599-dbd47953f68e tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:30.872960 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:15:30.878409 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0043e976-0a62-4810-a015-c85c0f8b86c4 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:30.879619 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0043e976-0a62-4810-a015-c85c0f8b86c4 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] [instance: 3de9f9a4-15c5-4bd9-a187-07d36cf9fb03] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:30.894485 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0043e976-0a62-4810-a015-c85c0f8b86c4 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:30.895379 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0043e976-0a62-4810-a015-c85c0f8b86c4 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:30.896140 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0043e976-0a62-4810-a015-c85c0f8b86c4 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:30.897217 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0043e976-0a62-4810-a015-c85c0f8b86c4 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:30.898044 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0043e976-0a62-4810-a015-c85c0f8b86c4 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:30.898480 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0043e976-0a62-4810-a015-c85c0f8b86c4 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:30.920797 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-0043e976-0a62-4810-a015-c85c0f8b86c4 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] HTTP exception thrown: Instance 3de9f9a4-15c5-4bd9-a187-07d36cf9fb03 could not be found. Aug 31 16:15:30.922678 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0043e976-0a62-4810-a015-c85c0f8b86c4 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Request method failure captured: Aug 31 16:15:30.922678 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/3de9f9a4-15c5-4bd9-a187-07d36cf9fb03 HTTP/1.1 Aug 31 16:15:30.922678 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:15:30.922678 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:15:30.922678 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:15:30.922678 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:15:30.922678 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:15:30.922678 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:15:30.922678 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:15:30.922678 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:15:30.922678 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4gQXSNpx7T-s6ANX8A4XIz6BgCizm9VWKy6e0KLRI2pxjPOEzPLkRnoXGF3D-Jh3OWl1h65DNjP8YomYmS0bGyt_8avVSC7qeEvUleLImq7o7EhFYQT7JAMgMioD10eCPOZ7QHRsEPDslLrPXcQD5t1iAsH1xyWK7dbpfjoYLGjDpU Aug 31 16:15:30.922678 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:15:30.922678 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:15:30.922678 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:15:30.922678 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:15:30.922678 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:15:30.922678 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:15:30.922678 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 5299955053c842b6aa02e058f4b1c0cb Aug 31 16:15:30.922678 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ServersTestJSON-1028152372 Aug 31 16:15:30.922678 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:15:30.922678 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:15:30.922678 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5299955053c842b6aa02e058f4b1c0cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5299955053c842b6aa02e058f4b1c0cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5299955053c842b6aa02e058f4b1c0cb", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5299955053c842b6aa02e058f4b1c0cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:15:30.922678 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ServersTestJSON-1028152372 Aug 31 16:15:30.922678 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 5299955053c842b6aa02e058f4b1c0cb Aug 31 16:15:30.922678 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ServersTestJSON-1028152372 Aug 31 16:15:30.922678 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ServersTestJSON-1028152372-project Aug 31 16:15:30.922678 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:15:30.922678 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:15:30.922678 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 6e707652819c497bbdf94f85f39c447a Aug 31 16:15:30.922678 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ServersTestJSON-1028152372-project Aug 31 16:15:30.922678 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:15:30.922678 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance 3de9f9a4-15c5-4bd9-a187-07d36cf9fb03 could not be found. Aug 31 16:15:30.922678 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '3de9f9a4-15c5-4bd9-a187-07d36cf9fb03'} Aug 31 16:15:30.922678 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:15:30.922678 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:30.922678 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:15:30.922678 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:15:30.922678 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:15:30.922678 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:15:30.922678 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:15:30.922678 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:15:30.922678 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:15:30.922678 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:15:30.922678 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3de9f9a4-15c5-4bd9-a187-07d36cf9fb03 could not be found. Aug 31 16:15:30.922678 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:15:30.922678 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:15:30.922678 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:15:30.922678 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:30.922678 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:15:30.922678 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:15:30.922678 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:15:30.922678 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:15:30.922678 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:15:30.922678 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:15:30.922678 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:15:30.922678 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:15:30.922678 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:15:30.922678 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:15:30.922678 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:15:30.922678 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:15:30.922678 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3de9f9a4-15c5-4bd9-a187-07d36cf9fb03 could not be found. Aug 31 16:15:30.922678 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:15:30.922678 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:15:30.922678 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:15:30.928343 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:30.928343 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:15:30.928343 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:15:30.928343 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:15:30.928343 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:15:30.928343 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3de9f9a4-15c5-4bd9-a187-07d36cf9fb03 could not be found. Aug 31 16:15:30.928343 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:15:30.928343 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0043e976-0a62-4810-a015-c85c0f8b86c4 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] Returning 404 to user: Instance 3de9f9a4-15c5-4bd9-a187-07d36cf9fb03 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:15:30.928343 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0043e976-0a62-4810-a015-c85c0f8b86c4 tempest-ServersTestJSON-1028152372 tempest-ServersTestJSON-1028152372-project] 10.222.0.61 "GET /compute/v2.1/servers/3de9f9a4-15c5-4bd9-a187-07d36cf9fb03" status: 404 len: 111 microversion: 2.1 time: 0.056482 Aug 31 16:15:30.930581 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2134/4258] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:30 2022] GET /compute/v2.1/servers/3de9f9a4-15c5-4bd9-a187-07d36cf9fb03 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 16:15:31.181375 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-46be0236-f775-453e-9e0e-71928ca649a4 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:31.182925 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-46be0236-f775-453e-9e0e-71928ca649a4 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] [instance: 64136c5d-b1e6-4263-a450-3308b0b4f69b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:31.194611 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-46be0236-f775-453e-9e0e-71928ca649a4 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:31.195409 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-46be0236-f775-453e-9e0e-71928ca649a4 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:31.196415 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-46be0236-f775-453e-9e0e-71928ca649a4 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:31.197788 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-46be0236-f775-453e-9e0e-71928ca649a4 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:31.198968 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-46be0236-f775-453e-9e0e-71928ca649a4 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:31.200948 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-46be0236-f775-453e-9e0e-71928ca649a4 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:31.273314 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-752ae17c-8caf-4743-9599-dbd47953f68e tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb261f2061164b49a8d496b16647dd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d2222a956a4888967e21647e26b310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:31.283463 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-752ae17c-8caf-4743-9599-dbd47953f68e tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "GET /compute/v2.1/servers/c4ef985e-0861-4c5d-88eb-d8ad053a8f54" status: 200 len: 1514 microversion: 2.1 time: 0.436434 Aug 31 16:15:31.287918 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2125/4259] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:30 2022] GET /compute/v2.1/servers/c4ef985e-0861-4c5d-88eb-d8ad053a8f54 => generated 1514 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:15:31.742311 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-cff5dd60-ab22-49da-a1c1-fe6108cc425e tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:31.743015 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-cff5dd60-ab22-49da-a1c1-fe6108cc425e tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] [instance: fa0932e8-1aa4-4d1a-b653-14be35568f3d] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:31.750837 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cff5dd60-ab22-49da-a1c1-fe6108cc425e tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:31.752326 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cff5dd60-ab22-49da-a1c1-fe6108cc425e tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:31.753116 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cff5dd60-ab22-49da-a1c1-fe6108cc425e tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:31.754075 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cff5dd60-ab22-49da-a1c1-fe6108cc425e tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:31.754789 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cff5dd60-ab22-49da-a1c1-fe6108cc425e tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:31.755423 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cff5dd60-ab22-49da-a1c1-fe6108cc425e tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:32.160099 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-46be0236-f775-453e-9e0e-71928ca649a4 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d6eee711fe4194a4db63c801f78561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeac74d3027d4080be26bf3aadab4c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:32.168710 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-46be0236-f775-453e-9e0e-71928ca649a4 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] 10.222.0.61 "GET /compute/v2.1/servers/64136c5d-b1e6-4263-a450-3308b0b4f69b" status: 200 len: 1318 microversion: 2.1 time: 0.997447 Aug 31 16:15:32.169583 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2135/4260] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:31 2022] GET /compute/v2.1/servers/64136c5d-b1e6-4263-a450-3308b0b4f69b => generated 1318 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:15:32.175093 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8fc04dfe-a3e1-48eb-a2c1-27b4fc01c6ce tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:32.176109 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8fc04dfe-a3e1-48eb-a2c1-27b4fc01c6ce tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: e3625fdf-7e50-4ba1-99dc-6ae7473fc706] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:32.182416 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8fc04dfe-a3e1-48eb-a2c1-27b4fc01c6ce tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:32.183141 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8fc04dfe-a3e1-48eb-a2c1-27b4fc01c6ce tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:32.183814 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8fc04dfe-a3e1-48eb-a2c1-27b4fc01c6ce tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:32.184859 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8fc04dfe-a3e1-48eb-a2c1-27b4fc01c6ce tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:32.185524 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8fc04dfe-a3e1-48eb-a2c1-27b4fc01c6ce tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:32.186298 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8fc04dfe-a3e1-48eb-a2c1-27b4fc01c6ce tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:32.601544 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-cff5dd60-ab22-49da-a1c1-fe6108cc425e tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:32.611416 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-cff5dd60-ab22-49da-a1c1-fe6108cc425e tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:32.613050 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-cff5dd60-ab22-49da-a1c1-fe6108cc425e tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:32.614341 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-cff5dd60-ab22-49da-a1c1-fe6108cc425e tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] 10.222.0.61 "GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d" status: 200 len: 2957 microversion: 2.32 time: 0.876003 Aug 31 16:15:32.624553 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2126/4261] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:15:31 2022] GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d => generated 2957 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:15:32.624553 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-95bd26b0-9bd6-4de1-a2af-1e452dd72cb3 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:32.624553 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-95bd26b0-9bd6-4de1-a2af-1e452dd72cb3 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: c4ef985e-0861-4c5d-88eb-d8ad053a8f54] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:32.645696 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-95bd26b0-9bd6-4de1-a2af-1e452dd72cb3 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:32.646295 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-95bd26b0-9bd6-4de1-a2af-1e452dd72cb3 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:32.646806 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-95bd26b0-9bd6-4de1-a2af-1e452dd72cb3 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:32.647649 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-95bd26b0-9bd6-4de1-a2af-1e452dd72cb3 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:32.648185 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-95bd26b0-9bd6-4de1-a2af-1e452dd72cb3 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:32.648684 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-95bd26b0-9bd6-4de1-a2af-1e452dd72cb3 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:32.971397 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8fc04dfe-a3e1-48eb-a2c1-27b4fc01c6ce tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48ee960c38f4d0584ea5ce34579279f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a957b6585e74a31b5bc5f66441c33e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:32.981239 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8fc04dfe-a3e1-48eb-a2c1-27b4fc01c6ce tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706" status: 200 len: 1506 microversion: 2.1 time: 0.810438 Aug 31 16:15:32.988004 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2136/4262] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:32 2022] GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706 => generated 1506 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:33.146011 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-95bd26b0-9bd6-4de1-a2af-1e452dd72cb3 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb261f2061164b49a8d496b16647dd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d2222a956a4888967e21647e26b310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:33.153764 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-95bd26b0-9bd6-4de1-a2af-1e452dd72cb3 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "GET /compute/v2.1/servers/c4ef985e-0861-4c5d-88eb-d8ad053a8f54" status: 200 len: 1514 microversion: 2.1 time: 0.537323 Aug 31 16:15:33.154332 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2127/4263] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:32 2022] GET /compute/v2.1/servers/c4ef985e-0861-4c5d-88eb-d8ad053a8f54 => generated 1514 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:33.196300 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-757ddd77-0e16-4a91-8a12-21cfceda8952 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:33.197037 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-757ddd77-0e16-4a91-8a12-21cfceda8952 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] [instance: 64136c5d-b1e6-4263-a450-3308b0b4f69b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:33.205975 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-757ddd77-0e16-4a91-8a12-21cfceda8952 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:33.206785 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-757ddd77-0e16-4a91-8a12-21cfceda8952 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:33.207344 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-757ddd77-0e16-4a91-8a12-21cfceda8952 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:33.208246 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-757ddd77-0e16-4a91-8a12-21cfceda8952 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:33.208813 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-757ddd77-0e16-4a91-8a12-21cfceda8952 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:33.209334 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-757ddd77-0e16-4a91-8a12-21cfceda8952 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:33.389573 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-798ec96b-0af9-4f22-82f9-1fb445abab30 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1711394199", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "networks": [{"uuid": "8b803306-ae63-4ff2-b35d-c7479039e509"}, {"uuid": "833bb7e2-f935-4be5-8147-89c08ac1ea12"}]}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:15:33.481268 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-798ec96b-0af9-4f22-82f9-1fb445abab30 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] validate_networks() for [('8b803306-ae63-4ff2-b35d-c7479039e509', None, None, None, None, None), ('833bb7e2-f935-4be5-8147-89c08ac1ea12', None, None, None, None, None)] {{(pid=122256) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:15:33.608635 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-757ddd77-0e16-4a91-8a12-21cfceda8952 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d6eee711fe4194a4db63c801f78561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeac74d3027d4080be26bf3aadab4c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:33.619996 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-757ddd77-0e16-4a91-8a12-21cfceda8952 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] 10.222.0.61 "GET /compute/v2.1/servers/64136c5d-b1e6-4263-a450-3308b0b4f69b" status: 200 len: 1507 microversion: 2.1 time: 0.429093 Aug 31 16:15:33.620971 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2137/4264] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:33 2022] GET /compute/v2.1/servers/64136c5d-b1e6-4263-a450-3308b0b4f69b => generated 1507 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:33.643816 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-503b3c30-a95b-45d5-be11-863c0bd519a4 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:33.645491 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-503b3c30-a95b-45d5-be11-863c0bd519a4 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] [instance: fa0932e8-1aa4-4d1a-b653-14be35568f3d] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:33.655362 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-503b3c30-a95b-45d5-be11-863c0bd519a4 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:33.656175 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-503b3c30-a95b-45d5-be11-863c0bd519a4 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:33.656792 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-503b3c30-a95b-45d5-be11-863c0bd519a4 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:33.658397 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-503b3c30-a95b-45d5-be11-863c0bd519a4 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:33.659795 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-503b3c30-a95b-45d5-be11-863c0bd519a4 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:33.660319 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-503b3c30-a95b-45d5-be11-863c0bd519a4 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:34.653595 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-503b3c30-a95b-45d5-be11-863c0bd519a4 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:34.669530 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-503b3c30-a95b-45d5-be11-863c0bd519a4 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:34.671959 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-503b3c30-a95b-45d5-be11-863c0bd519a4 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:34.674602 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-503b3c30-a95b-45d5-be11-863c0bd519a4 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] 10.222.0.61 "GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d" status: 200 len: 2957 microversion: 2.32 time: 1.035035 Aug 31 16:15:34.695908 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2138/4265] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:15:33 2022] GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d => generated 2957 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:15:34.703262 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-41bd3698-f6d8-4145-8e13-0eca0b85ea2b tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:34.705149 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-41bd3698-f6d8-4145-8e13-0eca0b85ea2b tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] [instance: cc727258-60c5-45b0-8c8c-179f621f6732] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:34.714831 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-41bd3698-f6d8-4145-8e13-0eca0b85ea2b tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:34.715532 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-41bd3698-f6d8-4145-8e13-0eca0b85ea2b tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:34.716872 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-41bd3698-f6d8-4145-8e13-0eca0b85ea2b tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:34.718344 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-41bd3698-f6d8-4145-8e13-0eca0b85ea2b tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:34.718906 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-41bd3698-f6d8-4145-8e13-0eca0b85ea2b tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:34.719852 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-41bd3698-f6d8-4145-8e13-0eca0b85ea2b tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:35.382877 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-41bd3698-f6d8-4145-8e13-0eca0b85ea2b tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d6eee711fe4194a4db63c801f78561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeac74d3027d4080be26bf3aadab4c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:35.398460 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-41bd3698-f6d8-4145-8e13-0eca0b85ea2b tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] 10.222.0.61 "GET /compute/v2.1/servers/cc727258-60c5-45b0-8c8c-179f621f6732" status: 200 len: 1506 microversion: 2.1 time: 0.700895 Aug 31 16:15:35.399129 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2139/4266] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:34 2022] GET /compute/v2.1/servers/cc727258-60c5-45b0-8c8c-179f621f6732 => generated 1506 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:35.410587 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6a7f9ec1-60b1-47c1-9319-4c1c80c17ed2 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:35.411679 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6a7f9ec1-60b1-47c1-9319-4c1c80c17ed2 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: e3625fdf-7e50-4ba1-99dc-6ae7473fc706] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:35.425166 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6a7f9ec1-60b1-47c1-9319-4c1c80c17ed2 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:35.425940 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6a7f9ec1-60b1-47c1-9319-4c1c80c17ed2 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:35.426603 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6a7f9ec1-60b1-47c1-9319-4c1c80c17ed2 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:35.427515 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6a7f9ec1-60b1-47c1-9319-4c1c80c17ed2 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:35.428167 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6a7f9ec1-60b1-47c1-9319-4c1c80c17ed2 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:35.428813 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6a7f9ec1-60b1-47c1-9319-4c1c80c17ed2 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:36.085361 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-6a7f9ec1-60b1-47c1-9319-4c1c80c17ed2 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48ee960c38f4d0584ea5ce34579279f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a957b6585e74a31b5bc5f66441c33e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:36.095449 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6a7f9ec1-60b1-47c1-9319-4c1c80c17ed2 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706" status: 200 len: 1486 microversion: 2.1 time: 0.694293 Aug 31 16:15:36.102181 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2140/4267] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:35 2022] GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706 => generated 1486 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:36.109127 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7c3c25c5-7c12-40e5-abf9-5031a5455567 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:36.109992 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7c3c25c5-7c12-40e5-abf9-5031a5455567 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: c4ef985e-0861-4c5d-88eb-d8ad053a8f54] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:36.118155 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7c3c25c5-7c12-40e5-abf9-5031a5455567 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:36.118902 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7c3c25c5-7c12-40e5-abf9-5031a5455567 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:36.119335 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7c3c25c5-7c12-40e5-abf9-5031a5455567 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:36.120304 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7c3c25c5-7c12-40e5-abf9-5031a5455567 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:36.120762 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7c3c25c5-7c12-40e5-abf9-5031a5455567 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:36.121187 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7c3c25c5-7c12-40e5-abf9-5031a5455567 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:36.514764 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-798ec96b-0af9-4f22-82f9-1fb445abab30 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:15:36.515276 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-798ec96b-0af9-4f22-82f9-1fb445abab30 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:15:36.515689 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-798ec96b-0af9-4f22-82f9-1fb445abab30 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:15:36.516103 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-798ec96b-0af9-4f22-82f9-1fb445abab30 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:15:36.517225 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-798ec96b-0af9-4f22-82f9-1fb445abab30 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:15:36.527428 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-798ec96b-0af9-4f22-82f9-1fb445abab30 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:36.527960 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-798ec96b-0af9-4f22-82f9-1fb445abab30 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:36.528403 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-798ec96b-0af9-4f22-82f9-1fb445abab30 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:36.529146 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-798ec96b-0af9-4f22-82f9-1fb445abab30 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:36.529663 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-798ec96b-0af9-4f22-82f9-1fb445abab30 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:36.530069 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-798ec96b-0af9-4f22-82f9-1fb445abab30 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:36.548730 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-798ec96b-0af9-4f22-82f9-1fb445abab30 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Getting quotas for project aada201b2fd64fdc81a69f826e7c607b. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:15:36.554265 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-798ec96b-0af9-4f22-82f9-1fb445abab30 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Getting quotas for user 860ac4e423cf410d9bbc354c77ba864c and project aada201b2fd64fdc81a69f826e7c607b. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:15:36.567705 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-798ec96b-0af9-4f22-82f9-1fb445abab30 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Going to run 1 instances... {{(pid=122256) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:15:36.570042 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-798ec96b-0af9-4f22-82f9-1fb445abab30 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] [instance: 32192367-aeac-41db-8669-4f3611612ad8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:15:36.619614 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-798ec96b-0af9-4f22-82f9-1fb445abab30 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.234290 Aug 31 16:15:36.620582 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2128/4268] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:15:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 3236 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:15:36.625337 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-3e3664c5-6721-4f98-91eb-08b519b9f6f4 req-1b9ab372-7e0f-4530-8fc8-4b6f2191eaf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa0932e8-1aa4-4d1a-b653-14be35568f3d", "name": "network-vif-unplugged", "status": "completed", "tag": "1acb52ee-181f-4844-aa80-9a93a9c9b7ae"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:15:36.636772 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-3e3664c5-6721-4f98-91eb-08b519b9f6f4 req-1b9ab372-7e0f-4530-8fc8-4b6f2191eaf9 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:36.637182 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-3e3664c5-6721-4f98-91eb-08b519b9f6f4 req-1b9ab372-7e0f-4530-8fc8-4b6f2191eaf9 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:36.637610 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-3e3664c5-6721-4f98-91eb-08b519b9f6f4 req-1b9ab372-7e0f-4530-8fc8-4b6f2191eaf9 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:36.653635 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-3e3664c5-6721-4f98-91eb-08b519b9f6f4 req-1b9ab372-7e0f-4530-8fc8-4b6f2191eaf9 service nova] Creating event network-vif-unplugged:1acb52ee-181f-4844-aa80-9a93a9c9b7ae for instance fa0932e8-1aa4-4d1a-b653-14be35568f3d on n-h2-850499-9 Aug 31 16:15:36.669756 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-3e3664c5-6721-4f98-91eb-08b519b9f6f4 req-1b9ab372-7e0f-4530-8fc8-4b6f2191eaf9 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047401 Aug 31 16:15:36.670954 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2129/4269] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:15:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:15:36.679886 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f874fff0-d828-485e-bc5c-46c62b5661b7 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:36.680753 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f874fff0-d828-485e-bc5c-46c62b5661b7 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] [instance: cc727258-60c5-45b0-8c8c-179f621f6732] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:36.691225 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f874fff0-d828-485e-bc5c-46c62b5661b7 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:36.692155 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f874fff0-d828-485e-bc5c-46c62b5661b7 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:36.693171 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f874fff0-d828-485e-bc5c-46c62b5661b7 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:36.694418 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f874fff0-d828-485e-bc5c-46c62b5661b7 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:36.695037 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f874fff0-d828-485e-bc5c-46c62b5661b7 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:36.695674 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f874fff0-d828-485e-bc5c-46c62b5661b7 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:36.732813 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f874fff0-d828-485e-bc5c-46c62b5661b7 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] [instance: cc727258-60c5-45b0-8c8c-179f621f6732] Going to try to terminate instance {{(pid=122256) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:15:37.065165 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7c3c25c5-7c12-40e5-abf9-5031a5455567 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb261f2061164b49a8d496b16647dd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d2222a956a4888967e21647e26b310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:37.083053 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7c3c25c5-7c12-40e5-abf9-5031a5455567 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "GET /compute/v2.1/servers/c4ef985e-0861-4c5d-88eb-d8ad053a8f54" status: 200 len: 1514 microversion: 2.1 time: 0.977561 Aug 31 16:15:37.087179 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2141/4270] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:36 2022] GET /compute/v2.1/servers/c4ef985e-0861-4c5d-88eb-d8ad053a8f54 => generated 1514 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:37.095519 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-11c47322-63f4-4d75-991b-6f7291e2a265 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:37.097554 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-11c47322-63f4-4d75-991b-6f7291e2a265 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] [instance: fa0932e8-1aa4-4d1a-b653-14be35568f3d] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:37.109060 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-11c47322-63f4-4d75-991b-6f7291e2a265 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:37.109971 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-11c47322-63f4-4d75-991b-6f7291e2a265 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:37.110841 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-11c47322-63f4-4d75-991b-6f7291e2a265 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:37.112623 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-11c47322-63f4-4d75-991b-6f7291e2a265 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:37.113392 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-11c47322-63f4-4d75-991b-6f7291e2a265 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:37.113926 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-11c47322-63f4-4d75-991b-6f7291e2a265 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:37.167193 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f874fff0-d828-485e-bc5c-46c62b5661b7 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] 10.222.0.61 "DELETE /compute/v2.1/servers/cc727258-60c5-45b0-8c8c-179f621f6732" status: 204 len: 0 microversion: 2.1 time: 0.494454 Aug 31 16:15:37.167823 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2130/4271] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:15:36 2022] DELETE /compute/v2.1/servers/cc727258-60c5-45b0-8c8c-179f621f6732 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:15:37.173956 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0aad554c-cdb3-458f-83c2-38b372501bd8 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:15:37.174667 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0aad554c-cdb3-458f-83c2-38b372501bd8 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: e3625fdf-7e50-4ba1-99dc-6ae7473fc706] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:37.181376 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0aad554c-cdb3-458f-83c2-38b372501bd8 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:37.181970 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0aad554c-cdb3-458f-83c2-38b372501bd8 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:37.182640 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0aad554c-cdb3-458f-83c2-38b372501bd8 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:37.183359 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0aad554c-cdb3-458f-83c2-38b372501bd8 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:37.183853 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0aad554c-cdb3-458f-83c2-38b372501bd8 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:37.184284 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0aad554c-cdb3-458f-83c2-38b372501bd8 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:37.266147 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0aad554c-cdb3-458f-83c2-38b372501bd8 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "POST /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706/action" status: 202 len: 0 microversion: 2.1 time: 0.096904 Aug 31 16:15:37.268133 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2131/4272] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:15:37 2022] POST /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:15:37.272568 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8c792e41-7298-4d6b-8051-46737ec96a94 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:37.273267 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8c792e41-7298-4d6b-8051-46737ec96a94 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] [instance: 32192367-aeac-41db-8669-4f3611612ad8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:37.280027 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8c792e41-7298-4d6b-8051-46737ec96a94 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:37.281158 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8c792e41-7298-4d6b-8051-46737ec96a94 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:37.281618 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8c792e41-7298-4d6b-8051-46737ec96a94 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:37.282946 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8c792e41-7298-4d6b-8051-46737ec96a94 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:37.283535 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8c792e41-7298-4d6b-8051-46737ec96a94 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:37.284190 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8c792e41-7298-4d6b-8051-46737ec96a94 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:37.483409 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8c792e41-7298-4d6b-8051-46737ec96a94 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860ac4e423cf410d9bbc354c77ba864c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aada201b2fd64fdc81a69f826e7c607b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:37.494525 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8c792e41-7298-4d6b-8051-46737ec96a94 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] 10.222.0.61 "GET /compute/v2.1/servers/32192367-aeac-41db-8669-4f3611612ad8" status: 200 len: 1217 microversion: 2.1 time: 0.225508 Aug 31 16:15:37.495677 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2132/4273] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:37 2022] GET /compute/v2.1/servers/32192367-aeac-41db-8669-4f3611612ad8 => generated 1217 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:37.501483 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-97cc1c4b-f81b-4428-8a32-10144c378b49 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:37.502318 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-97cc1c4b-f81b-4428-8a32-10144c378b49 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] [instance: 64136c5d-b1e6-4263-a450-3308b0b4f69b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:37.515774 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-97cc1c4b-f81b-4428-8a32-10144c378b49 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:37.517320 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-97cc1c4b-f81b-4428-8a32-10144c378b49 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:37.517799 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-97cc1c4b-f81b-4428-8a32-10144c378b49 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:37.518644 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-97cc1c4b-f81b-4428-8a32-10144c378b49 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:37.519391 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-97cc1c4b-f81b-4428-8a32-10144c378b49 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:37.519959 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-97cc1c4b-f81b-4428-8a32-10144c378b49 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:37.547063 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-97cc1c4b-f81b-4428-8a32-10144c378b49 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] [instance: 64136c5d-b1e6-4263-a450-3308b0b4f69b] Going to try to terminate instance {{(pid=122256) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:15:37.644690 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-97cc1c4b-f81b-4428-8a32-10144c378b49 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] 10.222.0.61 "DELETE /compute/v2.1/servers/64136c5d-b1e6-4263-a450-3308b0b4f69b" status: 204 len: 0 microversion: 2.1 time: 0.146529 Aug 31 16:15:37.645968 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2133/4274] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:15:37 2022] DELETE /compute/v2.1/servers/64136c5d-b1e6-4263-a450-3308b0b4f69b => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:15:37.651731 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9fd50a1d-ee75-4764-9ac0-ecdf6cf879e9 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:37.652567 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9fd50a1d-ee75-4764-9ac0-ecdf6cf879e9 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: e3625fdf-7e50-4ba1-99dc-6ae7473fc706] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:37.660103 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9fd50a1d-ee75-4764-9ac0-ecdf6cf879e9 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:37.661099 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9fd50a1d-ee75-4764-9ac0-ecdf6cf879e9 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:37.661383 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9fd50a1d-ee75-4764-9ac0-ecdf6cf879e9 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:37.662281 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9fd50a1d-ee75-4764-9ac0-ecdf6cf879e9 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:37.663018 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9fd50a1d-ee75-4764-9ac0-ecdf6cf879e9 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:37.663697 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9fd50a1d-ee75-4764-9ac0-ecdf6cf879e9 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:37.732157 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-11c47322-63f4-4d75-991b-6f7291e2a265 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:37.743899 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-11c47322-63f4-4d75-991b-6f7291e2a265 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:37.745388 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-11c47322-63f4-4d75-991b-6f7291e2a265 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:37.746666 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-11c47322-63f4-4d75-991b-6f7291e2a265 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] 10.222.0.61 "GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d" status: 200 len: 2936 microversion: 2.32 time: 0.657265 Aug 31 16:15:37.747262 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2142/4275] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:15:37 2022] GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d => generated 2936 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:15:37.765944 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c928119a-1d05-49c3-a5fa-57b593e06c2a tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:37.767267 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c928119a-1d05-49c3-a5fa-57b593e06c2a tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] [instance: cc727258-60c5-45b0-8c8c-179f621f6732] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:37.776119 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c928119a-1d05-49c3-a5fa-57b593e06c2a tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:37.776675 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c928119a-1d05-49c3-a5fa-57b593e06c2a tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:37.777832 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c928119a-1d05-49c3-a5fa-57b593e06c2a tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:37.778577 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c928119a-1d05-49c3-a5fa-57b593e06c2a tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:37.779165 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c928119a-1d05-49c3-a5fa-57b593e06c2a tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:37.784080 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c928119a-1d05-49c3-a5fa-57b593e06c2a tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:38.124984 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-9fd50a1d-ee75-4764-9ac0-ecdf6cf879e9 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48ee960c38f4d0584ea5ce34579279f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a957b6585e74a31b5bc5f66441c33e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:38.140813 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9fd50a1d-ee75-4764-9ac0-ecdf6cf879e9 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706" status: 200 len: 1494 microversion: 2.1 time: 0.493098 Aug 31 16:15:38.155189 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c928119a-1d05-49c3-a5fa-57b593e06c2a tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d6eee711fe4194a4db63c801f78561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeac74d3027d4080be26bf3aadab4c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:38.174041 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2134/4276] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:37 2022] GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706 => generated 1494 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:38.189424 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c928119a-1d05-49c3-a5fa-57b593e06c2a tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] 10.222.0.61 "GET /compute/v2.1/servers/cc727258-60c5-45b0-8c8c-179f621f6732" status: 200 len: 1512 microversion: 2.1 time: 0.440815 Aug 31 16:15:38.197258 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c74b5774-4b58-4750-8643-549d8680b8d5 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:38.199198 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2143/4277] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:37 2022] GET /compute/v2.1/servers/cc727258-60c5-45b0-8c8c-179f621f6732 => generated 1512 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:38.200206 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c74b5774-4b58-4750-8643-549d8680b8d5 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: c4ef985e-0861-4c5d-88eb-d8ad053a8f54] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:38.223545 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c74b5774-4b58-4750-8643-549d8680b8d5 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:38.226547 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c74b5774-4b58-4750-8643-549d8680b8d5 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:38.227336 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c74b5774-4b58-4750-8643-549d8680b8d5 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:38.229079 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c74b5774-4b58-4750-8643-549d8680b8d5 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:38.229830 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c74b5774-4b58-4750-8643-549d8680b8d5 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:38.230470 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c74b5774-4b58-4750-8643-549d8680b8d5 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:38.439424 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c74b5774-4b58-4750-8643-549d8680b8d5 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb261f2061164b49a8d496b16647dd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d2222a956a4888967e21647e26b310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:38.449785 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c74b5774-4b58-4750-8643-549d8680b8d5 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "GET /compute/v2.1/servers/c4ef985e-0861-4c5d-88eb-d8ad053a8f54" status: 200 len: 1514 microversion: 2.1 time: 0.274143 Aug 31 16:15:38.463043 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2135/4278] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:38 2022] GET /compute/v2.1/servers/c4ef985e-0861-4c5d-88eb-d8ad053a8f54 => generated 1514 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:38.519116 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b7761caf-2c23-45c0-993a-1e8ac8ce324a tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:38.520558 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b7761caf-2c23-45c0-993a-1e8ac8ce324a tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] [instance: 32192367-aeac-41db-8669-4f3611612ad8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:38.539473 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b7761caf-2c23-45c0-993a-1e8ac8ce324a tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:38.540825 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b7761caf-2c23-45c0-993a-1e8ac8ce324a tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:38.541608 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b7761caf-2c23-45c0-993a-1e8ac8ce324a tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:38.542710 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b7761caf-2c23-45c0-993a-1e8ac8ce324a tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:38.543410 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b7761caf-2c23-45c0-993a-1e8ac8ce324a tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:38.544625 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b7761caf-2c23-45c0-993a-1e8ac8ce324a tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:38.635367 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b7761caf-2c23-45c0-993a-1e8ac8ce324a tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860ac4e423cf410d9bbc354c77ba864c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aada201b2fd64fdc81a69f826e7c607b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:38.648803 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b7761caf-2c23-45c0-993a-1e8ac8ce324a tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] 10.222.0.61 "GET /compute/v2.1/servers/32192367-aeac-41db-8669-4f3611612ad8" status: 200 len: 1217 microversion: 2.1 time: 0.135412 Aug 31 16:15:38.655933 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2144/4279] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:38 2022] GET /compute/v2.1/servers/32192367-aeac-41db-8669-4f3611612ad8 => generated 1217 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:38.710826 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-d2de89a3-a26b-431e-b22d-74bd7cb25890 req-59d40501-578f-47e2-adea-4addc69da528 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa0932e8-1aa4-4d1a-b653-14be35568f3d", "name": "network-vif-unplugged", "status": "completed", "tag": "10959604-b4b5-4638-81b1-024cf0563917"}, {"server_uuid": "fa0932e8-1aa4-4d1a-b653-14be35568f3d", "name": "network-vif-unplugged", "status": "completed", "tag": "b9b65d25-b9da-474a-88d8-821f34d0be4e"}, {"server_uuid": "fa0932e8-1aa4-4d1a-b653-14be35568f3d", "name": "network-vif-unplugged", "status": "completed", "tag": "0f58cd66-acb5-4926-a732-c7608df7b8da"}, {"server_uuid": "fa0932e8-1aa4-4d1a-b653-14be35568f3d", "name": "network-vif-unplugged", "status": "completed", "tag": "fd6970db-5a6c-4005-91a0-c09d46e9fd47"}, {"server_uuid": "fa0932e8-1aa4-4d1a-b653-14be35568f3d", "name": "network-vif-unplugged", "status": "completed", "tag": "887de267-2677-4f4b-8c82-d09ad6ad6fde"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:15:38.724703 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-d2de89a3-a26b-431e-b22d-74bd7cb25890 req-59d40501-578f-47e2-adea-4addc69da528 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:38.725533 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-d2de89a3-a26b-431e-b22d-74bd7cb25890 req-59d40501-578f-47e2-adea-4addc69da528 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:38.726158 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-d2de89a3-a26b-431e-b22d-74bd7cb25890 req-59d40501-578f-47e2-adea-4addc69da528 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:38.740178 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-d2de89a3-a26b-431e-b22d-74bd7cb25890 req-59d40501-578f-47e2-adea-4addc69da528 service nova] Creating event network-vif-unplugged:10959604-b4b5-4638-81b1-024cf0563917 for instance fa0932e8-1aa4-4d1a-b653-14be35568f3d on n-h2-850499-9 Aug 31 16:15:38.741028 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-d2de89a3-a26b-431e-b22d-74bd7cb25890 req-59d40501-578f-47e2-adea-4addc69da528 service nova] Creating event network-vif-unplugged:b9b65d25-b9da-474a-88d8-821f34d0be4e for instance fa0932e8-1aa4-4d1a-b653-14be35568f3d on n-h2-850499-9 Aug 31 16:15:38.741730 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-d2de89a3-a26b-431e-b22d-74bd7cb25890 req-59d40501-578f-47e2-adea-4addc69da528 service nova] Creating event network-vif-unplugged:0f58cd66-acb5-4926-a732-c7608df7b8da for instance fa0932e8-1aa4-4d1a-b653-14be35568f3d on n-h2-850499-9 Aug 31 16:15:38.742416 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-d2de89a3-a26b-431e-b22d-74bd7cb25890 req-59d40501-578f-47e2-adea-4addc69da528 service nova] Creating event network-vif-unplugged:fd6970db-5a6c-4005-91a0-c09d46e9fd47 for instance fa0932e8-1aa4-4d1a-b653-14be35568f3d on n-h2-850499-9 Aug 31 16:15:38.743098 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-d2de89a3-a26b-431e-b22d-74bd7cb25890 req-59d40501-578f-47e2-adea-4addc69da528 service nova] Creating event network-vif-unplugged:887de267-2677-4f4b-8c82-d09ad6ad6fde for instance fa0932e8-1aa4-4d1a-b653-14be35568f3d on n-h2-850499-9 Aug 31 16:15:38.749956 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-d2de89a3-a26b-431e-b22d-74bd7cb25890 req-59d40501-578f-47e2-adea-4addc69da528 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 877 microversion: 2.1 time: 0.042922 Aug 31 16:15:38.751411 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2136/4280] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:15:38 2022] POST /compute/v2.1/os-server-external-events => generated 877 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:15:38.780168 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8bee3e50-13da-4d9e-8172-be3bed3f26db tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:38.781375 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8bee3e50-13da-4d9e-8172-be3bed3f26db tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] [instance: fa0932e8-1aa4-4d1a-b653-14be35568f3d] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:38.792108 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8bee3e50-13da-4d9e-8172-be3bed3f26db tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:38.793010 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8bee3e50-13da-4d9e-8172-be3bed3f26db tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:38.793699 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8bee3e50-13da-4d9e-8172-be3bed3f26db tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:38.794713 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8bee3e50-13da-4d9e-8172-be3bed3f26db tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:38.795263 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8bee3e50-13da-4d9e-8172-be3bed3f26db tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:38.795794 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8bee3e50-13da-4d9e-8172-be3bed3f26db tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:39.071311 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8bee3e50-13da-4d9e-8172-be3bed3f26db tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:39.094228 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8bee3e50-13da-4d9e-8172-be3bed3f26db tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:39.100152 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8bee3e50-13da-4d9e-8172-be3bed3f26db tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:39.101509 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8bee3e50-13da-4d9e-8172-be3bed3f26db tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] 10.222.0.61 "GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d" status: 200 len: 2915 microversion: 2.32 time: 0.327586 Aug 31 16:15:39.102119 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2145/4281] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:15:38 2022] GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d => generated 2915 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:15:39.201540 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ccf0a415-34dc-4feb-b11f-95673b7d6230 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:39.202642 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ccf0a415-34dc-4feb-b11f-95673b7d6230 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: e3625fdf-7e50-4ba1-99dc-6ae7473fc706] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:39.210591 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ccf0a415-34dc-4feb-b11f-95673b7d6230 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:39.211153 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ccf0a415-34dc-4feb-b11f-95673b7d6230 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:39.212248 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ccf0a415-34dc-4feb-b11f-95673b7d6230 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:39.213173 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ccf0a415-34dc-4feb-b11f-95673b7d6230 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:39.213871 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ccf0a415-34dc-4feb-b11f-95673b7d6230 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:39.214367 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ccf0a415-34dc-4feb-b11f-95673b7d6230 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:39.225127 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-fdb926b0-2919-41a1-8f54-b202ab005403 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:39.227157 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-fdb926b0-2919-41a1-8f54-b202ab005403 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] [instance: cc727258-60c5-45b0-8c8c-179f621f6732] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:39.237355 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fdb926b0-2919-41a1-8f54-b202ab005403 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:39.238781 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fdb926b0-2919-41a1-8f54-b202ab005403 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:39.239998 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fdb926b0-2919-41a1-8f54-b202ab005403 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:39.241591 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fdb926b0-2919-41a1-8f54-b202ab005403 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:39.243636 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fdb926b0-2919-41a1-8f54-b202ab005403 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:39.246879 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fdb926b0-2919-41a1-8f54-b202ab005403 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:39.531977 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ccf0a415-34dc-4feb-b11f-95673b7d6230 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48ee960c38f4d0584ea5ce34579279f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a957b6585e74a31b5bc5f66441c33e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:39.541022 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ccf0a415-34dc-4feb-b11f-95673b7d6230 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706" status: 200 len: 1494 microversion: 2.1 time: 0.343649 Aug 31 16:15:39.541614 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2137/4282] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:39 2022] GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706 => generated 1494 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:39.546427 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-514bdba7-3aa5-46db-aef7-9a6ca137cc5d tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:39.551749 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-514bdba7-3aa5-46db-aef7-9a6ca137cc5d tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: c4ef985e-0861-4c5d-88eb-d8ad053a8f54] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:39.563600 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-514bdba7-3aa5-46db-aef7-9a6ca137cc5d tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:39.564580 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-514bdba7-3aa5-46db-aef7-9a6ca137cc5d tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:39.565041 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-514bdba7-3aa5-46db-aef7-9a6ca137cc5d tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:39.565788 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-514bdba7-3aa5-46db-aef7-9a6ca137cc5d tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:39.566257 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-514bdba7-3aa5-46db-aef7-9a6ca137cc5d tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:39.566697 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-514bdba7-3aa5-46db-aef7-9a6ca137cc5d tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:39.643632 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-fdb926b0-2919-41a1-8f54-b202ab005403 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d6eee711fe4194a4db63c801f78561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeac74d3027d4080be26bf3aadab4c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:39.677263 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-fdb926b0-2919-41a1-8f54-b202ab005403 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] 10.222.0.61 "GET /compute/v2.1/servers/cc727258-60c5-45b0-8c8c-179f621f6732" status: 200 len: 1512 microversion: 2.1 time: 0.459561 Aug 31 16:15:39.678020 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2146/4283] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:39 2022] GET /compute/v2.1/servers/cc727258-60c5-45b0-8c8c-179f621f6732 => generated 1512 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:39.686679 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5bc089cb-47d9-4085-9fb3-942ca913ca26 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:39.686679 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5bc089cb-47d9-4085-9fb3-942ca913ca26 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] [instance: 32192367-aeac-41db-8669-4f3611612ad8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:39.694915 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5bc089cb-47d9-4085-9fb3-942ca913ca26 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:39.695705 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5bc089cb-47d9-4085-9fb3-942ca913ca26 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:39.696321 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5bc089cb-47d9-4085-9fb3-942ca913ca26 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:39.697256 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5bc089cb-47d9-4085-9fb3-942ca913ca26 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:39.697893 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5bc089cb-47d9-4085-9fb3-942ca913ca26 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:39.698492 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5bc089cb-47d9-4085-9fb3-942ca913ca26 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:40.025452 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5bc089cb-47d9-4085-9fb3-942ca913ca26 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860ac4e423cf410d9bbc354c77ba864c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aada201b2fd64fdc81a69f826e7c607b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:40.046793 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5bc089cb-47d9-4085-9fb3-942ca913ca26 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] 10.222.0.61 "GET /compute/v2.1/servers/32192367-aeac-41db-8669-4f3611612ad8" status: 200 len: 1273 microversion: 2.1 time: 0.366964 Aug 31 16:15:40.047297 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2147/4284] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:39 2022] GET /compute/v2.1/servers/32192367-aeac-41db-8669-4f3611612ad8 => generated 1273 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:40.129659 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-97c626bd-c784-471a-95ad-1b83464c135c tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:40.131130 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-97c626bd-c784-471a-95ad-1b83464c135c tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] [instance: fa0932e8-1aa4-4d1a-b653-14be35568f3d] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:40.133244 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-514bdba7-3aa5-46db-aef7-9a6ca137cc5d tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb261f2061164b49a8d496b16647dd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d2222a956a4888967e21647e26b310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:40.143232 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-97c626bd-c784-471a-95ad-1b83464c135c tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:40.144551 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-97c626bd-c784-471a-95ad-1b83464c135c tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:40.145347 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-97c626bd-c784-471a-95ad-1b83464c135c tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:40.146381 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-97c626bd-c784-471a-95ad-1b83464c135c tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:40.147053 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-97c626bd-c784-471a-95ad-1b83464c135c tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:40.147718 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-97c626bd-c784-471a-95ad-1b83464c135c tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:40.152602 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-514bdba7-3aa5-46db-aef7-9a6ca137cc5d tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "GET /compute/v2.1/servers/c4ef985e-0861-4c5d-88eb-d8ad053a8f54" status: 200 len: 1514 microversion: 2.1 time: 0.609384 Aug 31 16:15:40.153934 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2138/4285] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:39 2022] GET /compute/v2.1/servers/c4ef985e-0861-4c5d-88eb-d8ad053a8f54 => generated 1514 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:40.156440 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=100 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:15:40.567840 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7c0bae72-41f7-4359-8d21-a1193b2cca09 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:40.568892 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7c0bae72-41f7-4359-8d21-a1193b2cca09 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: e3625fdf-7e50-4ba1-99dc-6ae7473fc706] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:40.581725 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7c0bae72-41f7-4359-8d21-a1193b2cca09 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:40.590213 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7c0bae72-41f7-4359-8d21-a1193b2cca09 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:40.590892 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7c0bae72-41f7-4359-8d21-a1193b2cca09 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:40.591859 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7c0bae72-41f7-4359-8d21-a1193b2cca09 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:40.592507 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7c0bae72-41f7-4359-8d21-a1193b2cca09 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:40.593119 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7c0bae72-41f7-4359-8d21-a1193b2cca09 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:40.614902 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:15:41.024478 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-97c626bd-c784-471a-95ad-1b83464c135c tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:41.060252 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-97c626bd-c784-471a-95ad-1b83464c135c tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:41.062441 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-97c626bd-c784-471a-95ad-1b83464c135c tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:41.068115 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-97c626bd-c784-471a-95ad-1b83464c135c tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] 10.222.0.61 "GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d" status: 200 len: 2915 microversion: 2.32 time: 0.942383 Aug 31 16:15:41.072641 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2148/4286] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:15:40 2022] GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d => generated 2915 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:15:41.080687 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d8b1cc24-df93-4523-a6a4-ab06860e8b75 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:41.082078 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d8b1cc24-df93-4523-a6a4-ab06860e8b75 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] [instance: cc727258-60c5-45b0-8c8c-179f621f6732] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:41.092373 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d8b1cc24-df93-4523-a6a4-ab06860e8b75 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:41.093312 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d8b1cc24-df93-4523-a6a4-ab06860e8b75 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:41.094047 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d8b1cc24-df93-4523-a6a4-ab06860e8b75 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:41.096109 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d8b1cc24-df93-4523-a6a4-ab06860e8b75 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:41.096908 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d8b1cc24-df93-4523-a6a4-ab06860e8b75 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:41.097758 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d8b1cc24-df93-4523-a6a4-ab06860e8b75 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:41.234895 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d8b1cc24-df93-4523-a6a4-ab06860e8b75 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:41.237439 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d8b1cc24-df93-4523-a6a4-ab06860e8b75 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:41.240089 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d8b1cc24-df93-4523-a6a4-ab06860e8b75 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:41.242052 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-d8b1cc24-df93-4523-a6a4-ab06860e8b75 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lazy-loading 'fault' on Instance uuid cc727258-60c5-45b0-8c8c-179f621f6732 {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:15:41.664328 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d8b1cc24-df93-4523-a6a4-ab06860e8b75 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d6eee711fe4194a4db63c801f78561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeac74d3027d4080be26bf3aadab4c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:41.680942 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d8b1cc24-df93-4523-a6a4-ab06860e8b75 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] 10.222.0.61 "GET /compute/v2.1/servers/cc727258-60c5-45b0-8c8c-179f621f6732" status: 200 len: 1308 microversion: 2.1 time: 0.606307 Aug 31 16:15:41.697453 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2149/4287] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:41 2022] GET /compute/v2.1/servers/cc727258-60c5-45b0-8c8c-179f621f6732 => generated 1308 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:41.705568 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-e04099b4-4585-4bfc-9452-f0867f10e91a req-7e15279f-615f-4c72-8348-76c39ee3b7e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc727258-60c5-45b0-8c8c-179f621f6732", "name": "network-vif-deleted", "tag": "b9e5ca45-edcc-4cac-97b5-859f04131031"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:15:41.709477 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7c0bae72-41f7-4359-8d21-a1193b2cca09 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48ee960c38f4d0584ea5ce34579279f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a957b6585e74a31b5bc5f66441c33e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:41.723691 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-e04099b4-4585-4bfc-9452-f0867f10e91a req-7e15279f-615f-4c72-8348-76c39ee3b7e2 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:41.724697 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-e04099b4-4585-4bfc-9452-f0867f10e91a req-7e15279f-615f-4c72-8348-76c39ee3b7e2 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:41.725252 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7c0bae72-41f7-4359-8d21-a1193b2cca09 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706" status: 200 len: 1494 microversion: 2.1 time: 1.164890 Aug 31 16:15:41.725997 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-e04099b4-4585-4bfc-9452-f0867f10e91a req-7e15279f-615f-4c72-8348-76c39ee3b7e2 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:41.726538 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2139/4288] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:40 2022] GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706 => generated 1494 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:41.742648 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-e04099b4-4585-4bfc-9452-f0867f10e91a req-7e15279f-615f-4c72-8348-76c39ee3b7e2 service nova] Creating event network-vif-deleted:b9e5ca45-edcc-4cac-97b5-859f04131031 for instance cc727258-60c5-45b0-8c8c-179f621f6732 on n-h1-850499-9 Aug 31 16:15:41.749901 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-84463378-d1bb-4ab3-b3f9-297cee5519d0 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:41.750544 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-84463378-d1bb-4ab3-b3f9-297cee5519d0 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] [instance: 32192367-aeac-41db-8669-4f3611612ad8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:41.752077 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-e04099b4-4585-4bfc-9452-f0867f10e91a req-7e15279f-615f-4c72-8348-76c39ee3b7e2 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052503 Aug 31 16:15:41.753327 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2150/4289] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:15:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:15:41.759695 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-afb6ea5b-45eb-4685-a2c8-e1727058700d tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:41.760692 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-afb6ea5b-45eb-4685-a2c8-e1727058700d tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: c4ef985e-0861-4c5d-88eb-d8ad053a8f54] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:41.770087 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-afb6ea5b-45eb-4685-a2c8-e1727058700d tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:41.770392 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-84463378-d1bb-4ab3-b3f9-297cee5519d0 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:41.770600 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-afb6ea5b-45eb-4685-a2c8-e1727058700d tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:41.770911 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-84463378-d1bb-4ab3-b3f9-297cee5519d0 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:41.771042 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-afb6ea5b-45eb-4685-a2c8-e1727058700d tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:41.771361 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-84463378-d1bb-4ab3-b3f9-297cee5519d0 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:41.771895 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-afb6ea5b-45eb-4685-a2c8-e1727058700d tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:41.772118 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-84463378-d1bb-4ab3-b3f9-297cee5519d0 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:41.772359 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-afb6ea5b-45eb-4685-a2c8-e1727058700d tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:41.772585 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-84463378-d1bb-4ab3-b3f9-297cee5519d0 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:41.773022 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-84463378-d1bb-4ab3-b3f9-297cee5519d0 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:41.773632 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-afb6ea5b-45eb-4685-a2c8-e1727058700d tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:42.372828 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-afb6ea5b-45eb-4685-a2c8-e1727058700d tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb261f2061164b49a8d496b16647dd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d2222a956a4888967e21647e26b310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:42.381873 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-84463378-d1bb-4ab3-b3f9-297cee5519d0 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860ac4e423cf410d9bbc354c77ba864c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aada201b2fd64fdc81a69f826e7c607b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:42.397583 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-84463378-d1bb-4ab3-b3f9-297cee5519d0 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] 10.222.0.61 "GET /compute/v2.1/servers/32192367-aeac-41db-8669-4f3611612ad8" status: 200 len: 1313 microversion: 2.1 time: 0.666146 Aug 31 16:15:42.402396 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2140/4290] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:41 2022] GET /compute/v2.1/servers/32192367-aeac-41db-8669-4f3611612ad8 => generated 1313 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:42.404629 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-afb6ea5b-45eb-4685-a2c8-e1727058700d tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "GET /compute/v2.1/servers/c4ef985e-0861-4c5d-88eb-d8ad053a8f54" status: 200 len: 1514 microversion: 2.1 time: 0.647730 Aug 31 16:15:42.407877 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2151/4291] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:41 2022] GET /compute/v2.1/servers/c4ef985e-0861-4c5d-88eb-d8ad053a8f54 => generated 1514 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:42.411041 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f6f88832-134a-41c3-aa84-f945b8e07cc9 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:42.412076 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f6f88832-134a-41c3-aa84-f945b8e07cc9 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] [instance: fa0932e8-1aa4-4d1a-b653-14be35568f3d] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:42.424358 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f6f88832-134a-41c3-aa84-f945b8e07cc9 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:42.425546 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f6f88832-134a-41c3-aa84-f945b8e07cc9 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:42.428329 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f6f88832-134a-41c3-aa84-f945b8e07cc9 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:42.433664 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f6f88832-134a-41c3-aa84-f945b8e07cc9 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:42.434483 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f6f88832-134a-41c3-aa84-f945b8e07cc9 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:42.437319 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f6f88832-134a-41c3-aa84-f945b8e07cc9 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:42.708450 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-224235be-96f7-44ed-87d7-3bd015c2e5e3 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:42.709435 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-224235be-96f7-44ed-87d7-3bd015c2e5e3 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] [instance: cc727258-60c5-45b0-8c8c-179f621f6732] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:42.722772 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-224235be-96f7-44ed-87d7-3bd015c2e5e3 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:42.723280 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-224235be-96f7-44ed-87d7-3bd015c2e5e3 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:42.723761 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-224235be-96f7-44ed-87d7-3bd015c2e5e3 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:42.724480 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-224235be-96f7-44ed-87d7-3bd015c2e5e3 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:42.727772 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-224235be-96f7-44ed-87d7-3bd015c2e5e3 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:42.728502 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-224235be-96f7-44ed-87d7-3bd015c2e5e3 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:42.772738 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-224235be-96f7-44ed-87d7-3bd015c2e5e3 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] HTTP exception thrown: Instance cc727258-60c5-45b0-8c8c-179f621f6732 could not be found. Aug 31 16:15:42.775468 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-224235be-96f7-44ed-87d7-3bd015c2e5e3 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Request method failure captured: Aug 31 16:15:42.775468 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/cc727258-60c5-45b0-8c8c-179f621f6732 HTTP/1.1 Aug 31 16:15:42.775468 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:15:42.775468 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:15:42.775468 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:15:42.775468 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:15:42.775468 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:15:42.775468 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:15:42.775468 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:15:42.775468 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:15:42.775468 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4jZ4shyezHrBeP8FJcOkz3PDb_MNpojrxZHAsdo3LvMfTq5-qKQk3lmaTI_pro9krPPSWHw14LXUt-GCS1v9UHUwQt2pN08KX_k84LCjJDOm61qxkVcz9-q8GaTDLbpizBeoNlC0sQWV-M58Of2_QAOx_JUufmFtToQ5WeVN7FSAns Aug 31 16:15:42.775468 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:15:42.775468 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:15:42.775468 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:15:42.775468 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:15:42.775468 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:15:42.775468 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:15:42.775468 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: eeac74d3027d4080be26bf3aadab4c0a Aug 31 16:15:42.775468 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-MultipleCreateTestJSON-1098505367 Aug 31 16:15:42.775468 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:15:42.775468 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:15:42.775468 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/eeac74d3027d4080be26bf3aadab4c0a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/eeac74d3027d4080be26bf3aadab4c0a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_eeac74d3027d4080be26bf3aadab4c0a", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/eeac74d3027d4080be26bf3aadab4c0a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:15:42.775468 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-MultipleCreateTestJSON-1098505367 Aug 31 16:15:42.775468 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: eeac74d3027d4080be26bf3aadab4c0a Aug 31 16:15:42.775468 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1098505367 Aug 31 16:15:42.775468 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-MultipleCreateTestJSON-1098505367-project Aug 31 16:15:42.775468 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:15:42.775468 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:15:42.775468 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 07d6eee711fe4194a4db63c801f78561 Aug 31 16:15:42.775468 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-MultipleCreateTestJSON-1098505367-project Aug 31 16:15:42.775468 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:15:42.775468 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance cc727258-60c5-45b0-8c8c-179f621f6732 could not be found. Aug 31 16:15:42.775468 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': 'cc727258-60c5-45b0-8c8c-179f621f6732'} Aug 31 16:15:42.775468 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:15:42.775468 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:42.775468 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:15:42.775468 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:15:42.775468 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:15:42.775468 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:15:42.775468 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:15:42.775468 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:15:42.775468 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:15:42.775468 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:15:42.775468 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc727258-60c5-45b0-8c8c-179f621f6732 could not be found. Aug 31 16:15:42.775468 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:15:42.775468 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:15:42.775468 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:15:42.775468 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:42.775468 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:15:42.775468 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:15:42.775468 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:15:42.775468 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:15:42.775468 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:15:42.775468 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:15:42.775468 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:15:42.775468 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:15:42.775468 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:15:42.775468 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:15:42.775468 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:15:42.775468 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:15:42.775468 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc727258-60c5-45b0-8c8c-179f621f6732 could not be found. Aug 31 16:15:42.775468 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:15:42.775468 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:15:42.775468 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:15:42.785210 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:42.785210 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:15:42.785210 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:15:42.785210 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:15:42.785210 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:15:42.785210 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc727258-60c5-45b0-8c8c-179f621f6732 could not be found. Aug 31 16:15:42.785210 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:15:42.794213 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-224235be-96f7-44ed-87d7-3bd015c2e5e3 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Returning 404 to user: Instance cc727258-60c5-45b0-8c8c-179f621f6732 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:15:42.804114 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-224235be-96f7-44ed-87d7-3bd015c2e5e3 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] 10.222.0.61 "GET /compute/v2.1/servers/cc727258-60c5-45b0-8c8c-179f621f6732" status: 404 len: 111 microversion: 2.1 time: 0.096319 Aug 31 16:15:42.804885 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2152/4292] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:42 2022] GET /compute/v2.1/servers/cc727258-60c5-45b0-8c8c-179f621f6732 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:15:42.810113 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-bb42ad6d-dd4e-4d0d-a285-d63b6a240a6a tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:42.810835 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-bb42ad6d-dd4e-4d0d-a285-d63b6a240a6a tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: e3625fdf-7e50-4ba1-99dc-6ae7473fc706] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:42.833809 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bb42ad6d-dd4e-4d0d-a285-d63b6a240a6a tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:42.836541 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bb42ad6d-dd4e-4d0d-a285-d63b6a240a6a tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:42.838318 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bb42ad6d-dd4e-4d0d-a285-d63b6a240a6a tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:42.840068 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bb42ad6d-dd4e-4d0d-a285-d63b6a240a6a tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:42.842065 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bb42ad6d-dd4e-4d0d-a285-d63b6a240a6a tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:42.842589 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bb42ad6d-dd4e-4d0d-a285-d63b6a240a6a tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:43.024487 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f6f88832-134a-41c3-aa84-f945b8e07cc9 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:43.041238 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f6f88832-134a-41c3-aa84-f945b8e07cc9 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:43.048311 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f6f88832-134a-41c3-aa84-f945b8e07cc9 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:43.056195 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f6f88832-134a-41c3-aa84-f945b8e07cc9 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] 10.222.0.61 "GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d" status: 200 len: 2868 microversion: 2.32 time: 0.652050 Aug 31 16:15:43.059451 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2141/4293] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:15:42 2022] GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d => generated 2868 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:15:43.075047 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3e690cab-72c9-45a3-87b9-6553ed1a6c5a tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:43.085249 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3e690cab-72c9-45a3-87b9-6553ed1a6c5a tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] [instance: 64136c5d-b1e6-4263-a450-3308b0b4f69b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:43.099867 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3e690cab-72c9-45a3-87b9-6553ed1a6c5a tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:43.102118 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3e690cab-72c9-45a3-87b9-6553ed1a6c5a tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:43.103162 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3e690cab-72c9-45a3-87b9-6553ed1a6c5a tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:43.104915 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3e690cab-72c9-45a3-87b9-6553ed1a6c5a tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:43.106089 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3e690cab-72c9-45a3-87b9-6553ed1a6c5a tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:43.112782 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3e690cab-72c9-45a3-87b9-6553ed1a6c5a tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:43.319000 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3e690cab-72c9-45a3-87b9-6553ed1a6c5a tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d6eee711fe4194a4db63c801f78561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeac74d3027d4080be26bf3aadab4c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:43.340141 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3e690cab-72c9-45a3-87b9-6553ed1a6c5a tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] 10.222.0.61 "GET /compute/v2.1/servers/64136c5d-b1e6-4263-a450-3308b0b4f69b" status: 200 len: 1471 microversion: 2.1 time: 0.278195 Aug 31 16:15:43.341983 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2142/4294] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:43 2022] GET /compute/v2.1/servers/64136c5d-b1e6-4263-a450-3308b0b4f69b => generated 1471 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:43.380633 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-bb42ad6d-dd4e-4d0d-a285-d63b6a240a6a tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48ee960c38f4d0584ea5ce34579279f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a957b6585e74a31b5bc5f66441c33e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:43.394641 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-bb42ad6d-dd4e-4d0d-a285-d63b6a240a6a tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706" status: 200 len: 1494 microversion: 2.1 time: 0.588032 Aug 31 16:15:43.396456 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2153/4295] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:42 2022] GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706 => generated 1494 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:43.424371 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-95b8e279-7359-4f2f-a320-6c3055239ec3 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:43.428555 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-95b8e279-7359-4f2f-a320-6c3055239ec3 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] [instance: 32192367-aeac-41db-8669-4f3611612ad8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:43.436759 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-95b8e279-7359-4f2f-a320-6c3055239ec3 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:43.437252 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-95b8e279-7359-4f2f-a320-6c3055239ec3 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:43.437690 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-95b8e279-7359-4f2f-a320-6c3055239ec3 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:43.439120 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-95b8e279-7359-4f2f-a320-6c3055239ec3 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:43.439598 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-95b8e279-7359-4f2f-a320-6c3055239ec3 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:43.440211 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-95b8e279-7359-4f2f-a320-6c3055239ec3 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:43.442326 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f870bda2-dc13-4025-af41-6ad37201aa24 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:43.443218 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f870bda2-dc13-4025-af41-6ad37201aa24 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: c4ef985e-0861-4c5d-88eb-d8ad053a8f54] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:43.451936 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f870bda2-dc13-4025-af41-6ad37201aa24 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:43.452533 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f870bda2-dc13-4025-af41-6ad37201aa24 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:43.453077 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f870bda2-dc13-4025-af41-6ad37201aa24 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:43.454435 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f870bda2-dc13-4025-af41-6ad37201aa24 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:43.455254 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f870bda2-dc13-4025-af41-6ad37201aa24 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:43.455915 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f870bda2-dc13-4025-af41-6ad37201aa24 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:43.835415 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-95b8e279-7359-4f2f-a320-6c3055239ec3 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860ac4e423cf410d9bbc354c77ba864c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aada201b2fd64fdc81a69f826e7c607b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:43.847557 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-95b8e279-7359-4f2f-a320-6c3055239ec3 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] 10.222.0.61 "GET /compute/v2.1/servers/32192367-aeac-41db-8669-4f3611612ad8" status: 200 len: 1334 microversion: 2.1 time: 0.427741 Aug 31 16:15:43.848178 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2143/4296] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:43 2022] GET /compute/v2.1/servers/32192367-aeac-41db-8669-4f3611612ad8 => generated 1334 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:15:43.859379 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-a149be52-b87b-45de-b458-2addcbf6f6be req-3b9d6b86-c3f6-4ba2-94d5-66465c4ae370 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32192367-aeac-41db-8669-4f3611612ad8", "tag": "c901ee03-7fa2-42b1-a495-ddb34d68393f"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:15:43.876967 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-a149be52-b87b-45de-b458-2addcbf6f6be req-3b9d6b86-c3f6-4ba2-94d5-66465c4ae370 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:43.877888 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-a149be52-b87b-45de-b458-2addcbf6f6be req-3b9d6b86-c3f6-4ba2-94d5-66465c4ae370 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:43.878914 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-a149be52-b87b-45de-b458-2addcbf6f6be req-3b9d6b86-c3f6-4ba2-94d5-66465c4ae370 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:43.886078 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f870bda2-dc13-4025-af41-6ad37201aa24 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb261f2061164b49a8d496b16647dd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d2222a956a4888967e21647e26b310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:43.893293 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-a149be52-b87b-45de-b458-2addcbf6f6be req-3b9d6b86-c3f6-4ba2-94d5-66465c4ae370 service nova] Creating event network-changed:c901ee03-7fa2-42b1-a495-ddb34d68393f for instance 32192367-aeac-41db-8669-4f3611612ad8 on n-h1-850499-9 Aug 31 16:15:43.905370 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-a149be52-b87b-45de-b458-2addcbf6f6be req-3b9d6b86-c3f6-4ba2-94d5-66465c4ae370 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055931 Aug 31 16:15:43.906608 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2144/4297] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:15:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:15:43.922443 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-ce324afc-ef47-44bc-b05f-efdb54688e8a req-1b46c950-e0ea-47ae-a871-5d557b256c4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa0932e8-1aa4-4d1a-b653-14be35568f3d", "name": "network-vif-deleted", "tag": "1acb52ee-181f-4844-aa80-9a93a9c9b7ae"}, {"server_uuid": "64136c5d-b1e6-4263-a450-3308b0b4f69b", "name": "network-vif-deleted", "tag": "389d797b-d29f-45f1-8814-cae5984b364d"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:15:43.927162 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f870bda2-dc13-4025-af41-6ad37201aa24 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "GET /compute/v2.1/servers/c4ef985e-0861-4c5d-88eb-d8ad053a8f54" status: 200 len: 1514 microversion: 2.1 time: 0.490126 Aug 31 16:15:43.933717 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2154/4298] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:43 2022] GET /compute/v2.1/servers/c4ef985e-0861-4c5d-88eb-d8ad053a8f54 => generated 1514 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:15:43.942681 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-ce324afc-ef47-44bc-b05f-efdb54688e8a req-1b46c950-e0ea-47ae-a871-5d557b256c4a service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:43.943978 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-ce324afc-ef47-44bc-b05f-efdb54688e8a req-1b46c950-e0ea-47ae-a871-5d557b256c4a service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:43.944674 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-ce324afc-ef47-44bc-b05f-efdb54688e8a req-1b46c950-e0ea-47ae-a871-5d557b256c4a service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:43.981548 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-ce324afc-ef47-44bc-b05f-efdb54688e8a req-1b46c950-e0ea-47ae-a871-5d557b256c4a service nova] Creating event network-vif-deleted:1acb52ee-181f-4844-aa80-9a93a9c9b7ae for instance fa0932e8-1aa4-4d1a-b653-14be35568f3d on n-h2-850499-9 Aug 31 16:15:43.982668 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-ce324afc-ef47-44bc-b05f-efdb54688e8a req-1b46c950-e0ea-47ae-a871-5d557b256c4a service nova] Creating event network-vif-deleted:389d797b-d29f-45f1-8814-cae5984b364d for instance 64136c5d-b1e6-4263-a450-3308b0b4f69b on n-h2-850499-9 Aug 31 16:15:44.013574 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-ce324afc-ef47-44bc-b05f-efdb54688e8a req-1b46c950-e0ea-47ae-a871-5d557b256c4a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.091679 Aug 31 16:15:44.015699 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2145/4299] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:15:43 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:15:44.088804 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9905d15b-5fb6-4c37-9d5a-3dce87dfb839 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:44.090409 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9905d15b-5fb6-4c37-9d5a-3dce87dfb839 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] [instance: fa0932e8-1aa4-4d1a-b653-14be35568f3d] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:44.102352 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9905d15b-5fb6-4c37-9d5a-3dce87dfb839 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:44.102786 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9905d15b-5fb6-4c37-9d5a-3dce87dfb839 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:44.103353 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9905d15b-5fb6-4c37-9d5a-3dce87dfb839 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:44.103959 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9905d15b-5fb6-4c37-9d5a-3dce87dfb839 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:44.104422 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9905d15b-5fb6-4c37-9d5a-3dce87dfb839 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:44.104868 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9905d15b-5fb6-4c37-9d5a-3dce87dfb839 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:44.366184 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f077ad42-4c0f-4743-b1a2-eae9a81f356a tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:44.366892 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f077ad42-4c0f-4743-b1a2-eae9a81f356a tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] [instance: 64136c5d-b1e6-4263-a450-3308b0b4f69b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:44.369771 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:15:44.381149 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f077ad42-4c0f-4743-b1a2-eae9a81f356a tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:44.382819 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f077ad42-4c0f-4743-b1a2-eae9a81f356a tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:44.383779 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f077ad42-4c0f-4743-b1a2-eae9a81f356a tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:44.384722 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f077ad42-4c0f-4743-b1a2-eae9a81f356a tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:44.385413 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f077ad42-4c0f-4743-b1a2-eae9a81f356a tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:44.386200 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f077ad42-4c0f-4743-b1a2-eae9a81f356a tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:44.561249 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f077ad42-4c0f-4743-b1a2-eae9a81f356a tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d6eee711fe4194a4db63c801f78561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeac74d3027d4080be26bf3aadab4c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:44.569748 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9905d15b-5fb6-4c37-9d5a-3dce87dfb839 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:44.573132 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f077ad42-4c0f-4743-b1a2-eae9a81f356a tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] 10.222.0.61 "GET /compute/v2.1/servers/64136c5d-b1e6-4263-a450-3308b0b4f69b" status: 200 len: 1471 microversion: 2.1 time: 0.211185 Aug 31 16:15:44.574690 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2146/4300] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:44 2022] GET /compute/v2.1/servers/64136c5d-b1e6-4263-a450-3308b0b4f69b => generated 1471 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:44.582580 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-90735a8d-f3a0-43f3-aefb-7f1a402b623c tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:44.583933 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-90735a8d-f3a0-43f3-aefb-7f1a402b623c tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: e3625fdf-7e50-4ba1-99dc-6ae7473fc706] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:44.593234 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9905d15b-5fb6-4c37-9d5a-3dce87dfb839 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:44.595939 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-90735a8d-f3a0-43f3-aefb-7f1a402b623c tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:44.596959 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9905d15b-5fb6-4c37-9d5a-3dce87dfb839 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:44.597113 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-90735a8d-f3a0-43f3-aefb-7f1a402b623c tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:44.597851 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-90735a8d-f3a0-43f3-aefb-7f1a402b623c tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:44.598700 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-90735a8d-f3a0-43f3-aefb-7f1a402b623c tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:44.599158 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9905d15b-5fb6-4c37-9d5a-3dce87dfb839 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] 10.222.0.61 "GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d" status: 200 len: 2821 microversion: 2.32 time: 0.516073 Aug 31 16:15:44.599302 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-90735a8d-f3a0-43f3-aefb-7f1a402b623c tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:44.599644 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-90735a8d-f3a0-43f3-aefb-7f1a402b623c tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:44.600805 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2155/4301] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:15:44 2022] GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d => generated 2821 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:15:44.765803 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-90735a8d-f3a0-43f3-aefb-7f1a402b623c tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48ee960c38f4d0584ea5ce34579279f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a957b6585e74a31b5bc5f66441c33e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:44.775097 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-90735a8d-f3a0-43f3-aefb-7f1a402b623c tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706" status: 200 len: 1494 microversion: 2.1 time: 0.199083 Aug 31 16:15:44.775703 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2147/4302] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:44 2022] GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706 => generated 1494 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:44.881211 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-df056da8-0964-42f6-acfe-fd693baa161a tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:44.881954 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-df056da8-0964-42f6-acfe-fd693baa161a tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] [instance: 32192367-aeac-41db-8669-4f3611612ad8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:44.885125 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=100 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:15:44.892209 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-df056da8-0964-42f6-acfe-fd693baa161a tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:44.892579 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-df056da8-0964-42f6-acfe-fd693baa161a tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:44.893093 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-df056da8-0964-42f6-acfe-fd693baa161a tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:44.893899 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-df056da8-0964-42f6-acfe-fd693baa161a tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:44.894693 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-df056da8-0964-42f6-acfe-fd693baa161a tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:44.895249 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-df056da8-0964-42f6-acfe-fd693baa161a tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:44.962365 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ac900a60-b625-40e0-9474-0c7aca40fc50 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:44.963283 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ac900a60-b625-40e0-9474-0c7aca40fc50 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: c4ef985e-0861-4c5d-88eb-d8ad053a8f54] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:44.973631 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ac900a60-b625-40e0-9474-0c7aca40fc50 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:44.974966 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ac900a60-b625-40e0-9474-0c7aca40fc50 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:44.976124 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ac900a60-b625-40e0-9474-0c7aca40fc50 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:44.981187 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ac900a60-b625-40e0-9474-0c7aca40fc50 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:44.982119 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ac900a60-b625-40e0-9474-0c7aca40fc50 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:44.982780 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ac900a60-b625-40e0-9474-0c7aca40fc50 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:45.201834 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-df056da8-0964-42f6-acfe-fd693baa161a tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860ac4e423cf410d9bbc354c77ba864c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aada201b2fd64fdc81a69f826e7c607b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:45.221323 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-df056da8-0964-42f6-acfe-fd693baa161a tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] 10.222.0.61 "GET /compute/v2.1/servers/32192367-aeac-41db-8669-4f3611612ad8" status: 200 len: 1334 microversion: 2.1 time: 0.344559 Aug 31 16:15:45.222297 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2156/4303] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:44 2022] GET /compute/v2.1/servers/32192367-aeac-41db-8669-4f3611612ad8 => generated 1334 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:45.434864 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ac900a60-b625-40e0-9474-0c7aca40fc50 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb261f2061164b49a8d496b16647dd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d2222a956a4888967e21647e26b310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:45.465523 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ac900a60-b625-40e0-9474-0c7aca40fc50 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "GET /compute/v2.1/servers/c4ef985e-0861-4c5d-88eb-d8ad053a8f54" status: 200 len: 1514 microversion: 2.1 time: 0.507642 Aug 31 16:15:45.468101 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2148/4304] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:44 2022] GET /compute/v2.1/servers/c4ef985e-0861-4c5d-88eb-d8ad053a8f54 => generated 1514 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:45.599792 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0f85260b-5dbb-42bb-907f-3018587425ca tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:45.602059 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0f85260b-5dbb-42bb-907f-3018587425ca tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] [instance: 64136c5d-b1e6-4263-a450-3308b0b4f69b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:45.613728 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0f85260b-5dbb-42bb-907f-3018587425ca tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:45.615287 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0f85260b-5dbb-42bb-907f-3018587425ca tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:45.616477 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0f85260b-5dbb-42bb-907f-3018587425ca tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:45.618082 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0f85260b-5dbb-42bb-907f-3018587425ca tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:45.619283 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0f85260b-5dbb-42bb-907f-3018587425ca tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:45.621166 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0f85260b-5dbb-42bb-907f-3018587425ca tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:45.630674 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7971a819-ab3f-4140-a992-b291fd330409 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:45.634248 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7971a819-ab3f-4140-a992-b291fd330409 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] [instance: fa0932e8-1aa4-4d1a-b653-14be35568f3d] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:45.648761 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7971a819-ab3f-4140-a992-b291fd330409 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:45.649579 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7971a819-ab3f-4140-a992-b291fd330409 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:45.650196 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7971a819-ab3f-4140-a992-b291fd330409 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:45.653029 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7971a819-ab3f-4140-a992-b291fd330409 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:45.658908 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7971a819-ab3f-4140-a992-b291fd330409 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:45.660094 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7971a819-ab3f-4140-a992-b291fd330409 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:45.711731 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0f85260b-5dbb-42bb-907f-3018587425ca tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:45.715741 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0f85260b-5dbb-42bb-907f-3018587425ca tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:45.716761 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0f85260b-5dbb-42bb-907f-3018587425ca tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:45.717946 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-0f85260b-5dbb-42bb-907f-3018587425ca tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lazy-loading 'fault' on Instance uuid 64136c5d-b1e6-4263-a450-3308b0b4f69b {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:15:45.830457 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0f85260b-5dbb-42bb-907f-3018587425ca tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d6eee711fe4194a4db63c801f78561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeac74d3027d4080be26bf3aadab4c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:45.842473 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0f85260b-5dbb-42bb-907f-3018587425ca tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] 10.222.0.61 "GET /compute/v2.1/servers/64136c5d-b1e6-4263-a450-3308b0b4f69b" status: 200 len: 1308 microversion: 2.1 time: 0.250268 Aug 31 16:15:45.863677 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2157/4305] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:45 2022] GET /compute/v2.1/servers/64136c5d-b1e6-4263-a450-3308b0b4f69b => generated 1308 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:45.870874 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-86f1240d-5dba-4ee7-a6b1-d3d8223152ec tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:45.872767 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-86f1240d-5dba-4ee7-a6b1-d3d8223152ec tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: e3625fdf-7e50-4ba1-99dc-6ae7473fc706] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:45.886959 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-86f1240d-5dba-4ee7-a6b1-d3d8223152ec tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:45.888001 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-86f1240d-5dba-4ee7-a6b1-d3d8223152ec tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:45.888674 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-86f1240d-5dba-4ee7-a6b1-d3d8223152ec tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:45.889922 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-86f1240d-5dba-4ee7-a6b1-d3d8223152ec tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:45.890572 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-86f1240d-5dba-4ee7-a6b1-d3d8223152ec tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:45.891176 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-86f1240d-5dba-4ee7-a6b1-d3d8223152ec tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:46.135649 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7971a819-ab3f-4140-a992-b291fd330409 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:46.151571 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7971a819-ab3f-4140-a992-b291fd330409 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:46.155777 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7971a819-ab3f-4140-a992-b291fd330409 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:46.158260 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7971a819-ab3f-4140-a992-b291fd330409 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] 10.222.0.61 "GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d" status: 200 len: 2707 microversion: 2.32 time: 0.536820 Aug 31 16:15:46.178250 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2149/4306] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:15:45 2022] GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d => generated 2707 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:15:46.184771 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-4bc40d70-16c1-4348-8dcc-abb01390fc62 req-49416bf7-9789-435b-8253-57780eff0b09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa0932e8-1aa4-4d1a-b653-14be35568f3d", "name": "network-vif-deleted", "tag": "0f58cd66-acb5-4926-a732-c7608df7b8da"}, {"server_uuid": "fa0932e8-1aa4-4d1a-b653-14be35568f3d", "name": "network-vif-deleted", "tag": "887de267-2677-4f4b-8c82-d09ad6ad6fde"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:15:46.196484 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-4bc40d70-16c1-4348-8dcc-abb01390fc62 req-49416bf7-9789-435b-8253-57780eff0b09 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:46.196797 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-86f1240d-5dba-4ee7-a6b1-d3d8223152ec tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48ee960c38f4d0584ea5ce34579279f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a957b6585e74a31b5bc5f66441c33e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:46.197444 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-4bc40d70-16c1-4348-8dcc-abb01390fc62 req-49416bf7-9789-435b-8253-57780eff0b09 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:46.198120 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-4bc40d70-16c1-4348-8dcc-abb01390fc62 req-49416bf7-9789-435b-8253-57780eff0b09 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:46.214140 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-86f1240d-5dba-4ee7-a6b1-d3d8223152ec tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706" status: 200 len: 1500 microversion: 2.1 time: 0.349211 Aug 31 16:15:46.215538 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2158/4307] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:45 2022] GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706 => generated 1500 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:46.216060 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-4bc40d70-16c1-4348-8dcc-abb01390fc62 req-49416bf7-9789-435b-8253-57780eff0b09 service nova] Creating event network-vif-deleted:0f58cd66-acb5-4926-a732-c7608df7b8da for instance fa0932e8-1aa4-4d1a-b653-14be35568f3d on n-h2-850499-9 Aug 31 16:15:46.216680 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-4bc40d70-16c1-4348-8dcc-abb01390fc62 req-49416bf7-9789-435b-8253-57780eff0b09 service nova] Creating event network-vif-deleted:887de267-2677-4f4b-8c82-d09ad6ad6fde for instance fa0932e8-1aa4-4d1a-b653-14be35568f3d on n-h2-850499-9 Aug 31 16:15:46.223217 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-4bc40d70-16c1-4348-8dcc-abb01390fc62 req-49416bf7-9789-435b-8253-57780eff0b09 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.043154 Aug 31 16:15:46.224559 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2150/4308] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:15:46 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:15:46.246692 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f035872d-8003-4f8e-8f0c-41cd880d7110 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:46.247363 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f035872d-8003-4f8e-8f0c-41cd880d7110 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: e3625fdf-7e50-4ba1-99dc-6ae7473fc706] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:46.247908 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-47f7584b-fa5f-48d2-8915-c5f4b15faa01 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:46.248788 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-47f7584b-fa5f-48d2-8915-c5f4b15faa01 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] [instance: 32192367-aeac-41db-8669-4f3611612ad8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:46.255079 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f035872d-8003-4f8e-8f0c-41cd880d7110 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:46.255970 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f035872d-8003-4f8e-8f0c-41cd880d7110 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:46.256836 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f035872d-8003-4f8e-8f0c-41cd880d7110 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:46.258010 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f035872d-8003-4f8e-8f0c-41cd880d7110 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:46.258682 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f035872d-8003-4f8e-8f0c-41cd880d7110 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:46.259314 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f035872d-8003-4f8e-8f0c-41cd880d7110 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:46.261925 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-47f7584b-fa5f-48d2-8915-c5f4b15faa01 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:46.262516 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-47f7584b-fa5f-48d2-8915-c5f4b15faa01 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:46.263050 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-47f7584b-fa5f-48d2-8915-c5f4b15faa01 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:46.263933 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-47f7584b-fa5f-48d2-8915-c5f4b15faa01 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:46.264615 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-47f7584b-fa5f-48d2-8915-c5f4b15faa01 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:46.265222 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-47f7584b-fa5f-48d2-8915-c5f4b15faa01 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:46.299184 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f035872d-8003-4f8e-8f0c-41cd880d7110 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: e3625fdf-7e50-4ba1-99dc-6ae7473fc706] Going to try to terminate instance {{(pid=122256) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:15:46.431810 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f035872d-8003-4f8e-8f0c-41cd880d7110 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "DELETE /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706" status: 204 len: 0 microversion: 2.1 time: 0.189962 Aug 31 16:15:46.433582 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2151/4309] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:15:46 2022] DELETE /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:15:46.440903 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-c8783932-6632-4bfa-9499-1a86d3fb8cf1 req-8ffa8029-4fbe-495f-8cd9-2651e73800f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32192367-aeac-41db-8669-4f3611612ad8", "tag": "8bd24ff8-7cfc-4a5a-8304-9a7a21c3ff0d"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:15:46.461739 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-c8783932-6632-4bfa-9499-1a86d3fb8cf1 req-8ffa8029-4fbe-495f-8cd9-2651e73800f5 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:46.462224 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-c8783932-6632-4bfa-9499-1a86d3fb8cf1 req-8ffa8029-4fbe-495f-8cd9-2651e73800f5 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:46.462856 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-c8783932-6632-4bfa-9499-1a86d3fb8cf1 req-8ffa8029-4fbe-495f-8cd9-2651e73800f5 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:46.482486 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-c8783932-6632-4bfa-9499-1a86d3fb8cf1 req-8ffa8029-4fbe-495f-8cd9-2651e73800f5 service nova] Creating event network-changed:8bd24ff8-7cfc-4a5a-8304-9a7a21c3ff0d for instance 32192367-aeac-41db-8669-4f3611612ad8 on n-h1-850499-9 Aug 31 16:15:46.494894 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-c8783932-6632-4bfa-9499-1a86d3fb8cf1 req-8ffa8029-4fbe-495f-8cd9-2651e73800f5 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059304 Aug 31 16:15:46.496109 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2152/4310] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:15:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:15:46.531032 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-07c18059-dbea-4582-88b7-2b4eb9e39831 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:46.535899 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-07c18059-dbea-4582-88b7-2b4eb9e39831 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: e3625fdf-7e50-4ba1-99dc-6ae7473fc706] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:46.541267 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:15:46.573296 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=6 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:15:46.584648 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-07c18059-dbea-4582-88b7-2b4eb9e39831 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:46.586216 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-07c18059-dbea-4582-88b7-2b4eb9e39831 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:46.586900 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-07c18059-dbea-4582-88b7-2b4eb9e39831 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:46.587917 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-07c18059-dbea-4582-88b7-2b4eb9e39831 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:46.590032 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-07c18059-dbea-4582-88b7-2b4eb9e39831 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:46.592204 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-07c18059-dbea-4582-88b7-2b4eb9e39831 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:46.849868 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-47f7584b-fa5f-48d2-8915-c5f4b15faa01 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860ac4e423cf410d9bbc354c77ba864c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aada201b2fd64fdc81a69f826e7c607b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:46.864366 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-47f7584b-fa5f-48d2-8915-c5f4b15faa01 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] 10.222.0.61 "GET /compute/v2.1/servers/32192367-aeac-41db-8669-4f3611612ad8" status: 200 len: 1334 microversion: 2.1 time: 0.623033 Aug 31 16:15:46.865633 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2159/4311] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:46 2022] GET /compute/v2.1/servers/32192367-aeac-41db-8669-4f3611612ad8 => generated 1334 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:46.872008 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-db13d6c9-3152-4c04-8034-3e3e0573b5d8 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:46.873413 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-db13d6c9-3152-4c04-8034-3e3e0573b5d8 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: c4ef985e-0861-4c5d-88eb-d8ad053a8f54] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:46.883616 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-db13d6c9-3152-4c04-8034-3e3e0573b5d8 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:46.885105 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-db13d6c9-3152-4c04-8034-3e3e0573b5d8 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:46.886301 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-db13d6c9-3152-4c04-8034-3e3e0573b5d8 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:46.887234 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-db13d6c9-3152-4c04-8034-3e3e0573b5d8 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:46.887909 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-db13d6c9-3152-4c04-8034-3e3e0573b5d8 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:46.888512 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-db13d6c9-3152-4c04-8034-3e3e0573b5d8 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:46.937683 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-07c18059-dbea-4582-88b7-2b4eb9e39831 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48ee960c38f4d0584ea5ce34579279f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a957b6585e74a31b5bc5f66441c33e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:46.947244 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-07c18059-dbea-4582-88b7-2b4eb9e39831 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706" status: 200 len: 1506 microversion: 2.1 time: 0.449177 Aug 31 16:15:46.948540 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2153/4312] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:46 2022] GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706 => generated 1506 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:46.955022 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c24fa09f-a38e-4307-a738-679df507054f tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:46.955896 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c24fa09f-a38e-4307-a738-679df507054f tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] [instance: 64136c5d-b1e6-4263-a450-3308b0b4f69b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:46.962974 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c24fa09f-a38e-4307-a738-679df507054f tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:46.963738 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c24fa09f-a38e-4307-a738-679df507054f tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:46.964349 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c24fa09f-a38e-4307-a738-679df507054f tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:46.965227 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c24fa09f-a38e-4307-a738-679df507054f tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:46.965856 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c24fa09f-a38e-4307-a738-679df507054f tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:46.966494 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c24fa09f-a38e-4307-a738-679df507054f tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:47.011255 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c24fa09f-a38e-4307-a738-679df507054f tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:47.011795 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c24fa09f-a38e-4307-a738-679df507054f tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:47.012511 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c24fa09f-a38e-4307-a738-679df507054f tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:47.012988 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-c24fa09f-a38e-4307-a738-679df507054f tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lazy-loading 'fault' on Instance uuid 64136c5d-b1e6-4263-a450-3308b0b4f69b {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:15:47.119234 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c24fa09f-a38e-4307-a738-679df507054f tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d6eee711fe4194a4db63c801f78561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeac74d3027d4080be26bf3aadab4c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:47.130436 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c24fa09f-a38e-4307-a738-679df507054f tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] 10.222.0.61 "GET /compute/v2.1/servers/64136c5d-b1e6-4263-a450-3308b0b4f69b" status: 200 len: 1308 microversion: 2.1 time: 0.180049 Aug 31 16:15:47.130436 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2154/4313] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:46 2022] GET /compute/v2.1/servers/64136c5d-b1e6-4263-a450-3308b0b4f69b => generated 1308 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:47.186405 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-dcab9caf-204e-4dc2-88d7-af3d2350b178 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:47.186990 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-dcab9caf-204e-4dc2-88d7-af3d2350b178 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] [instance: fa0932e8-1aa4-4d1a-b653-14be35568f3d] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:47.197893 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dcab9caf-204e-4dc2-88d7-af3d2350b178 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:47.204108 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dcab9caf-204e-4dc2-88d7-af3d2350b178 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:47.204577 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dcab9caf-204e-4dc2-88d7-af3d2350b178 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:47.205546 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dcab9caf-204e-4dc2-88d7-af3d2350b178 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:47.206027 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dcab9caf-204e-4dc2-88d7-af3d2350b178 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:47.206465 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dcab9caf-204e-4dc2-88d7-af3d2350b178 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:47.295142 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-db13d6c9-3152-4c04-8034-3e3e0573b5d8 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb261f2061164b49a8d496b16647dd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d2222a956a4888967e21647e26b310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:47.304179 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-db13d6c9-3152-4c04-8034-3e3e0573b5d8 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "GET /compute/v2.1/servers/c4ef985e-0861-4c5d-88eb-d8ad053a8f54" status: 200 len: 1514 microversion: 2.1 time: 0.437228 Aug 31 16:15:47.304862 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2160/4314] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:46 2022] GET /compute/v2.1/servers/c4ef985e-0861-4c5d-88eb-d8ad053a8f54 => generated 1514 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:47.468909 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-dcab9caf-204e-4dc2-88d7-af3d2350b178 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:47.480797 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-dcab9caf-204e-4dc2-88d7-af3d2350b178 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:47.487332 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-dcab9caf-204e-4dc2-88d7-af3d2350b178 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:47.488990 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-dcab9caf-204e-4dc2-88d7-af3d2350b178 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] 10.222.0.61 "GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d" status: 200 len: 2432 microversion: 2.32 time: 0.307171 Aug 31 16:15:47.489775 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2155/4315] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:15:47 2022] GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d => generated 2432 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:15:47.905463 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-24722959-1658-47b7-b25a-6701caec6821 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:47.906891 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-24722959-1658-47b7-b25a-6701caec6821 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] [instance: 32192367-aeac-41db-8669-4f3611612ad8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:47.916450 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-24722959-1658-47b7-b25a-6701caec6821 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:47.917290 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-24722959-1658-47b7-b25a-6701caec6821 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:47.919312 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-24722959-1658-47b7-b25a-6701caec6821 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:47.920974 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-24722959-1658-47b7-b25a-6701caec6821 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:47.922726 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-24722959-1658-47b7-b25a-6701caec6821 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:47.923466 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-24722959-1658-47b7-b25a-6701caec6821 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:47.971246 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-feacfaee-1dda-48af-9ec6-07336f40b75b tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:47.971997 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-feacfaee-1dda-48af-9ec6-07336f40b75b tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: e3625fdf-7e50-4ba1-99dc-6ae7473fc706] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:47.984177 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-feacfaee-1dda-48af-9ec6-07336f40b75b tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:47.987149 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-feacfaee-1dda-48af-9ec6-07336f40b75b tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:47.987732 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-feacfaee-1dda-48af-9ec6-07336f40b75b tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:47.988703 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-feacfaee-1dda-48af-9ec6-07336f40b75b tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:47.989276 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-feacfaee-1dda-48af-9ec6-07336f40b75b tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:47.989802 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-feacfaee-1dda-48af-9ec6-07336f40b75b tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:48.676371 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-feacfaee-1dda-48af-9ec6-07336f40b75b tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48ee960c38f4d0584ea5ce34579279f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a957b6585e74a31b5bc5f66441c33e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:48.682468 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:15:48.686461 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-24722959-1658-47b7-b25a-6701caec6821 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860ac4e423cf410d9bbc354c77ba864c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aada201b2fd64fdc81a69f826e7c607b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:48.693145 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-feacfaee-1dda-48af-9ec6-07336f40b75b tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706" status: 200 len: 1506 microversion: 2.1 time: 0.726844 Aug 31 16:15:48.708296 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2156/4316] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:47 2022] GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706 => generated 1506 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:15:48.712111 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-24722959-1658-47b7-b25a-6701caec6821 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] 10.222.0.61 "GET /compute/v2.1/servers/32192367-aeac-41db-8669-4f3611612ad8" status: 200 len: 1334 microversion: 2.1 time: 0.828030 Aug 31 16:15:48.715159 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ce690dd9-8078-4f4f-9854-ff920dc94edd tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:48.716024 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ce690dd9-8078-4f4f-9854-ff920dc94edd tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] [instance: 64136c5d-b1e6-4263-a450-3308b0b4f69b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:48.721319 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2161/4317] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:47 2022] GET /compute/v2.1/servers/32192367-aeac-41db-8669-4f3611612ad8 => generated 1334 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:48.728450 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ce690dd9-8078-4f4f-9854-ff920dc94edd tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:48.729248 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ce690dd9-8078-4f4f-9854-ff920dc94edd tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:48.729874 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ce690dd9-8078-4f4f-9854-ff920dc94edd tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:48.730790 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ce690dd9-8078-4f4f-9854-ff920dc94edd tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:48.731423 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ce690dd9-8078-4f4f-9854-ff920dc94edd tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:48.732060 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ce690dd9-8078-4f4f-9854-ff920dc94edd tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:48.739571 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-953952c3-dcbf-4453-a765-76c604bfb00f tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:48.740304 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-953952c3-dcbf-4453-a765-76c604bfb00f tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: c4ef985e-0861-4c5d-88eb-d8ad053a8f54] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:48.753653 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-953952c3-dcbf-4453-a765-76c604bfb00f tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:48.754158 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-953952c3-dcbf-4453-a765-76c604bfb00f tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:48.754600 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-953952c3-dcbf-4453-a765-76c604bfb00f tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:48.755319 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-953952c3-dcbf-4453-a765-76c604bfb00f tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:48.755826 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-953952c3-dcbf-4453-a765-76c604bfb00f tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:48.756351 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-953952c3-dcbf-4453-a765-76c604bfb00f tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:48.773238 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ce690dd9-8078-4f4f-9854-ff920dc94edd tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:48.774087 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ce690dd9-8078-4f4f-9854-ff920dc94edd tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:48.774744 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ce690dd9-8078-4f4f-9854-ff920dc94edd tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:48.775420 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-ce690dd9-8078-4f4f-9854-ff920dc94edd tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lazy-loading 'fault' on Instance uuid 64136c5d-b1e6-4263-a450-3308b0b4f69b {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:15:48.836426 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ce690dd9-8078-4f4f-9854-ff920dc94edd tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d6eee711fe4194a4db63c801f78561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeac74d3027d4080be26bf3aadab4c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:48.849182 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ce690dd9-8078-4f4f-9854-ff920dc94edd tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] 10.222.0.61 "GET /compute/v2.1/servers/64136c5d-b1e6-4263-a450-3308b0b4f69b" status: 200 len: 1308 microversion: 2.1 time: 0.139429 Aug 31 16:15:48.850831 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2157/4318] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:48 2022] GET /compute/v2.1/servers/64136c5d-b1e6-4263-a450-3308b0b4f69b => generated 1308 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:48.856560 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-adec39fd-bf0b-4e82-b84e-73faccde7106 req-9b76f3fc-1106-4d34-bc4a-5a1b0d8bce9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa0932e8-1aa4-4d1a-b653-14be35568f3d", "name": "network-vif-deleted", "tag": "b9b65d25-b9da-474a-88d8-821f34d0be4e"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:15:48.869274 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-adec39fd-bf0b-4e82-b84e-73faccde7106 req-9b76f3fc-1106-4d34-bc4a-5a1b0d8bce9e service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:48.870054 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-adec39fd-bf0b-4e82-b84e-73faccde7106 req-9b76f3fc-1106-4d34-bc4a-5a1b0d8bce9e service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:48.871315 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-adec39fd-bf0b-4e82-b84e-73faccde7106 req-9b76f3fc-1106-4d34-bc4a-5a1b0d8bce9e service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:48.888156 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-adec39fd-bf0b-4e82-b84e-73faccde7106 req-9b76f3fc-1106-4d34-bc4a-5a1b0d8bce9e service nova] Creating event network-vif-deleted:b9b65d25-b9da-474a-88d8-821f34d0be4e for instance fa0932e8-1aa4-4d1a-b653-14be35568f3d on n-h2-850499-9 Aug 31 16:15:48.894928 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-adec39fd-bf0b-4e82-b84e-73faccde7106 req-9b76f3fc-1106-4d34-bc4a-5a1b0d8bce9e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042043 Aug 31 16:15:48.895797 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2158/4319] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:15:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:15:48.907277 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4d622f05-11be-4d9b-98e3-d7709a7e4aa1 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:48.908437 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4d622f05-11be-4d9b-98e3-d7709a7e4aa1 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] [instance: fa0932e8-1aa4-4d1a-b653-14be35568f3d] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:48.917516 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4d622f05-11be-4d9b-98e3-d7709a7e4aa1 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:48.918475 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4d622f05-11be-4d9b-98e3-d7709a7e4aa1 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:48.919524 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4d622f05-11be-4d9b-98e3-d7709a7e4aa1 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:48.920676 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4d622f05-11be-4d9b-98e3-d7709a7e4aa1 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:48.921496 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4d622f05-11be-4d9b-98e3-d7709a7e4aa1 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:48.922154 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4d622f05-11be-4d9b-98e3-d7709a7e4aa1 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:49.134030 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-4d622f05-11be-4d9b-98e3-d7709a7e4aa1 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:49.144891 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-4d622f05-11be-4d9b-98e3-d7709a7e4aa1 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:49.160243 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-4d622f05-11be-4d9b-98e3-d7709a7e4aa1 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:49.162631 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4d622f05-11be-4d9b-98e3-d7709a7e4aa1 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] 10.222.0.61 "GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d" status: 200 len: 2385 microversion: 2.32 time: 0.260848 Aug 31 16:15:49.163836 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2159/4320] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:15:48 2022] GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d => generated 2385 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:15:49.345517 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-953952c3-dcbf-4453-a765-76c604bfb00f tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb261f2061164b49a8d496b16647dd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d2222a956a4888967e21647e26b310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:49.359432 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-953952c3-dcbf-4453-a765-76c604bfb00f tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "GET /compute/v2.1/servers/c4ef985e-0861-4c5d-88eb-d8ad053a8f54" status: 200 len: 1514 microversion: 2.1 time: 0.629387 Aug 31 16:15:49.361071 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2162/4321] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:48 2022] GET /compute/v2.1/servers/c4ef985e-0861-4c5d-88eb-d8ad053a8f54 => generated 1514 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:49.714540 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ab55273c-19fb-41d6-b910-ca2560225c05 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:49.715868 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ab55273c-19fb-41d6-b910-ca2560225c05 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: e3625fdf-7e50-4ba1-99dc-6ae7473fc706] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:49.723629 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ab55273c-19fb-41d6-b910-ca2560225c05 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:49.726082 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ab55273c-19fb-41d6-b910-ca2560225c05 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:49.726721 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ab55273c-19fb-41d6-b910-ca2560225c05 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:49.727914 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ab55273c-19fb-41d6-b910-ca2560225c05 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:49.728621 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ab55273c-19fb-41d6-b910-ca2560225c05 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:49.729059 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ab55273c-19fb-41d6-b910-ca2560225c05 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:49.738310 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-79141ca2-5a94-4b62-a6a0-489eff2edd7a tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:49.739053 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-79141ca2-5a94-4b62-a6a0-489eff2edd7a tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] [instance: 32192367-aeac-41db-8669-4f3611612ad8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:49.745717 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-79141ca2-5a94-4b62-a6a0-489eff2edd7a tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:49.746479 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-79141ca2-5a94-4b62-a6a0-489eff2edd7a tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:49.747341 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-79141ca2-5a94-4b62-a6a0-489eff2edd7a tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:49.748602 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-79141ca2-5a94-4b62-a6a0-489eff2edd7a tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:49.749330 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-79141ca2-5a94-4b62-a6a0-489eff2edd7a tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:49.750072 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-79141ca2-5a94-4b62-a6a0-489eff2edd7a tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:50.272590 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ab55273c-19fb-41d6-b910-ca2560225c05 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48ee960c38f4d0584ea5ce34579279f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a957b6585e74a31b5bc5f66441c33e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:50.294432 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ab55273c-19fb-41d6-b910-ca2560225c05 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706" status: 200 len: 1506 microversion: 2.1 time: 0.583999 Aug 31 16:15:50.302216 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-79141ca2-5a94-4b62-a6a0-489eff2edd7a tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860ac4e423cf410d9bbc354c77ba864c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aada201b2fd64fdc81a69f826e7c607b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:50.310035 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2160/4322] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:49 2022] GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706 => generated 1506 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:50.316049 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7febdcb8-d376-44cb-ad67-663ce54e7742 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:50.318442 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7febdcb8-d376-44cb-ad67-663ce54e7742 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] [instance: 64136c5d-b1e6-4263-a450-3308b0b4f69b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:50.322902 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-79141ca2-5a94-4b62-a6a0-489eff2edd7a tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] 10.222.0.61 "GET /compute/v2.1/servers/32192367-aeac-41db-8669-4f3611612ad8" status: 200 len: 1334 microversion: 2.1 time: 0.589511 Aug 31 16:15:50.325140 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2163/4323] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:49 2022] GET /compute/v2.1/servers/32192367-aeac-41db-8669-4f3611612ad8 => generated 1334 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:50.340198 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2137c758-468f-4f5a-b6f4-fc90e69cfb0d tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:50.342527 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2137c758-468f-4f5a-b6f4-fc90e69cfb0d tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] [instance: fa0932e8-1aa4-4d1a-b653-14be35568f3d] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:50.351880 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7febdcb8-d376-44cb-ad67-663ce54e7742 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:50.352667 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7febdcb8-d376-44cb-ad67-663ce54e7742 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:50.353284 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7febdcb8-d376-44cb-ad67-663ce54e7742 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:50.354175 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7febdcb8-d376-44cb-ad67-663ce54e7742 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:50.354812 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7febdcb8-d376-44cb-ad67-663ce54e7742 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:50.355596 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7febdcb8-d376-44cb-ad67-663ce54e7742 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:50.359305 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2137c758-468f-4f5a-b6f4-fc90e69cfb0d tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:50.360790 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2137c758-468f-4f5a-b6f4-fc90e69cfb0d tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:50.361630 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2137c758-468f-4f5a-b6f4-fc90e69cfb0d tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:50.362547 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2137c758-468f-4f5a-b6f4-fc90e69cfb0d tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:50.363948 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2137c758-468f-4f5a-b6f4-fc90e69cfb0d tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:50.366342 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2137c758-468f-4f5a-b6f4-fc90e69cfb0d tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:50.435989 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7febdcb8-d376-44cb-ad67-663ce54e7742 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:50.436904 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7febdcb8-d376-44cb-ad67-663ce54e7742 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:50.437645 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7febdcb8-d376-44cb-ad67-663ce54e7742 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:50.439380 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-7febdcb8-d376-44cb-ad67-663ce54e7742 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lazy-loading 'fault' on Instance uuid 64136c5d-b1e6-4263-a450-3308b0b4f69b {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:15:50.523852 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7febdcb8-d376-44cb-ad67-663ce54e7742 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d6eee711fe4194a4db63c801f78561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeac74d3027d4080be26bf3aadab4c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:50.537435 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7febdcb8-d376-44cb-ad67-663ce54e7742 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] 10.222.0.61 "GET /compute/v2.1/servers/64136c5d-b1e6-4263-a450-3308b0b4f69b" status: 200 len: 1308 microversion: 2.1 time: 0.225836 Aug 31 16:15:50.541087 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2161/4324] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:50 2022] GET /compute/v2.1/servers/64136c5d-b1e6-4263-a450-3308b0b4f69b => generated 1308 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:50.564257 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a090d41d-3843-4660-8068-a30db2fda386 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:50.564257 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a090d41d-3843-4660-8068-a30db2fda386 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: c4ef985e-0861-4c5d-88eb-d8ad053a8f54] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:50.576671 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a090d41d-3843-4660-8068-a30db2fda386 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:50.577872 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a090d41d-3843-4660-8068-a30db2fda386 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:50.582108 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a090d41d-3843-4660-8068-a30db2fda386 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:50.582574 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a090d41d-3843-4660-8068-a30db2fda386 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:50.583163 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a090d41d-3843-4660-8068-a30db2fda386 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:50.583886 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a090d41d-3843-4660-8068-a30db2fda386 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:50.726562 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2137c758-468f-4f5a-b6f4-fc90e69cfb0d tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:50.741891 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2137c758-468f-4f5a-b6f4-fc90e69cfb0d tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:50.747619 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2137c758-468f-4f5a-b6f4-fc90e69cfb0d tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:50.751853 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2137c758-468f-4f5a-b6f4-fc90e69cfb0d tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] 10.222.0.61 "GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d" status: 200 len: 2385 microversion: 2.32 time: 0.423352 Aug 31 16:15:50.768178 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2164/4325] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:15:50 2022] GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d => generated 2385 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:15:51.071010 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a090d41d-3843-4660-8068-a30db2fda386 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb261f2061164b49a8d496b16647dd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d2222a956a4888967e21647e26b310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:51.088814 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a090d41d-3843-4660-8068-a30db2fda386 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "GET /compute/v2.1/servers/c4ef985e-0861-4c5d-88eb-d8ad053a8f54" status: 200 len: 1514 microversion: 2.1 time: 0.546518 Aug 31 16:15:51.120437 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2162/4326] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:50 2022] GET /compute/v2.1/servers/c4ef985e-0861-4c5d-88eb-d8ad053a8f54 => generated 1514 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:51.341951 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4034820c-6d88-4cf4-8cb8-578e852c11f4 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:51.344835 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4034820c-6d88-4cf4-8cb8-578e852c11f4 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: e3625fdf-7e50-4ba1-99dc-6ae7473fc706] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:51.367692 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5a471565-4326-417a-bdf2-d0bf55b704b4 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:51.369373 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5a471565-4326-417a-bdf2-d0bf55b704b4 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] [instance: 32192367-aeac-41db-8669-4f3611612ad8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:51.382959 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4034820c-6d88-4cf4-8cb8-578e852c11f4 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:51.386429 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5a471565-4326-417a-bdf2-d0bf55b704b4 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:51.387769 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4034820c-6d88-4cf4-8cb8-578e852c11f4 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:51.388755 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5a471565-4326-417a-bdf2-d0bf55b704b4 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:51.389651 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5a471565-4326-417a-bdf2-d0bf55b704b4 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:51.390493 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4034820c-6d88-4cf4-8cb8-578e852c11f4 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:51.392377 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4034820c-6d88-4cf4-8cb8-578e852c11f4 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:51.392765 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5a471565-4326-417a-bdf2-d0bf55b704b4 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:51.393439 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4034820c-6d88-4cf4-8cb8-578e852c11f4 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:51.394261 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5a471565-4326-417a-bdf2-d0bf55b704b4 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:51.394920 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4034820c-6d88-4cf4-8cb8-578e852c11f4 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:51.395526 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5a471565-4326-417a-bdf2-d0bf55b704b4 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:51.437199 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=100 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:15:51.848521 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5a471565-4326-417a-bdf2-d0bf55b704b4 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860ac4e423cf410d9bbc354c77ba864c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aada201b2fd64fdc81a69f826e7c607b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:51.865707 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5a471565-4326-417a-bdf2-d0bf55b704b4 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] 10.222.0.61 "GET /compute/v2.1/servers/32192367-aeac-41db-8669-4f3611612ad8" status: 200 len: 1334 microversion: 2.1 time: 0.506267 Aug 31 16:15:51.869815 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2163/4327] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:51 2022] GET /compute/v2.1/servers/32192367-aeac-41db-8669-4f3611612ad8 => generated 1334 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:15:51.887342 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3b635a8f-4c14-472b-9974-4f35e922e548 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:51.889701 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3b635a8f-4c14-472b-9974-4f35e922e548 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] [instance: 64136c5d-b1e6-4263-a450-3308b0b4f69b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:51.930837 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-4034820c-6d88-4cf4-8cb8-578e852c11f4 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48ee960c38f4d0584ea5ce34579279f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a957b6585e74a31b5bc5f66441c33e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:51.940602 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4034820c-6d88-4cf4-8cb8-578e852c11f4 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706" status: 200 len: 1506 microversion: 2.1 time: 0.609643 Aug 31 16:15:51.951699 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3b635a8f-4c14-472b-9974-4f35e922e548 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:51.951699 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3b635a8f-4c14-472b-9974-4f35e922e548 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:51.951699 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3b635a8f-4c14-472b-9974-4f35e922e548 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:51.951699 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3b635a8f-4c14-472b-9974-4f35e922e548 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:51.951699 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3b635a8f-4c14-472b-9974-4f35e922e548 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:51.951699 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3b635a8f-4c14-472b-9974-4f35e922e548 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:51.959804 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2165/4328] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:51 2022] GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706 => generated 1506 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:15:51.971067 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-12447d45-23f6-4d73-a340-9f909f099b82 req-0843af0d-b40d-45a5-a01b-7da56a9748fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa0932e8-1aa4-4d1a-b653-14be35568f3d", "name": "network-vif-deleted", "tag": "10959604-b4b5-4638-81b1-024cf0563917"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:15:52.003612 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-12447d45-23f6-4d73-a340-9f909f099b82 req-0843af0d-b40d-45a5-a01b-7da56a9748fb service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:52.004116 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-12447d45-23f6-4d73-a340-9f909f099b82 req-0843af0d-b40d-45a5-a01b-7da56a9748fb service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:52.004562 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-12447d45-23f6-4d73-a340-9f909f099b82 req-0843af0d-b40d-45a5-a01b-7da56a9748fb service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:52.006021 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-3b635a8f-4c14-472b-9974-4f35e922e548 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] HTTP exception thrown: Instance 64136c5d-b1e6-4263-a450-3308b0b4f69b could not be found. Aug 31 16:15:52.018471 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3b635a8f-4c14-472b-9974-4f35e922e548 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Request method failure captured: Aug 31 16:15:52.018471 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/64136c5d-b1e6-4263-a450-3308b0b4f69b HTTP/1.1 Aug 31 16:15:52.018471 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:15:52.018471 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:15:52.018471 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:15:52.018471 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:15:52.018471 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:15:52.018471 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:15:52.018471 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:15:52.018471 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:15:52.018471 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4jZ4shyezHrBeP8FJcOkz3PDb_MNpojrxZHAsdo3LvMfTq5-qKQk3lmaTI_pro9krPPSWHw14LXUt-GCS1v9UHUwQt2pN08KX_k84LCjJDOm61qxkVcz9-q8GaTDLbpizBeoNlC0sQWV-M58Of2_QAOx_JUufmFtToQ5WeVN7FSAns Aug 31 16:15:52.018471 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:15:52.018471 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:15:52.018471 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:15:52.018471 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:15:52.018471 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:15:52.018471 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:15:52.018471 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: eeac74d3027d4080be26bf3aadab4c0a Aug 31 16:15:52.018471 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-MultipleCreateTestJSON-1098505367 Aug 31 16:15:52.018471 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:15:52.018471 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:15:52.018471 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/eeac74d3027d4080be26bf3aadab4c0a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/eeac74d3027d4080be26bf3aadab4c0a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_eeac74d3027d4080be26bf3aadab4c0a", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/eeac74d3027d4080be26bf3aadab4c0a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:15:52.018471 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-MultipleCreateTestJSON-1098505367 Aug 31 16:15:52.018471 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: eeac74d3027d4080be26bf3aadab4c0a Aug 31 16:15:52.018471 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1098505367 Aug 31 16:15:52.018471 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-MultipleCreateTestJSON-1098505367-project Aug 31 16:15:52.018471 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:15:52.018471 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:15:52.018471 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 07d6eee711fe4194a4db63c801f78561 Aug 31 16:15:52.018471 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-MultipleCreateTestJSON-1098505367-project Aug 31 16:15:52.018471 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:15:52.018471 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance 64136c5d-b1e6-4263-a450-3308b0b4f69b could not be found. Aug 31 16:15:52.018471 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '64136c5d-b1e6-4263-a450-3308b0b4f69b'} Aug 31 16:15:52.018471 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:15:52.018471 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:52.018471 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:15:52.018471 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:15:52.018471 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:15:52.018471 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:15:52.018471 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:15:52.018471 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:15:52.018471 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:15:52.018471 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:15:52.018471 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64136c5d-b1e6-4263-a450-3308b0b4f69b could not be found. Aug 31 16:15:52.018471 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:15:52.018471 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:15:52.018471 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:15:52.018471 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:52.018471 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:15:52.018471 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:15:52.018471 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:15:52.018471 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:15:52.018471 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:15:52.018471 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:15:52.018471 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:15:52.018471 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:15:52.018471 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:15:52.018471 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:15:52.018471 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:15:52.018471 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:15:52.018471 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64136c5d-b1e6-4263-a450-3308b0b4f69b could not be found. Aug 31 16:15:52.018471 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:15:52.018471 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:15:52.018471 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:15:52.024702 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:52.024702 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:15:52.024702 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:15:52.024702 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:15:52.024702 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:15:52.024702 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64136c5d-b1e6-4263-a450-3308b0b4f69b could not be found. Aug 31 16:15:52.024702 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:15:52.032607 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3b635a8f-4c14-472b-9974-4f35e922e548 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] Returning 404 to user: Instance 64136c5d-b1e6-4263-a450-3308b0b4f69b could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:15:52.034224 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3b635a8f-4c14-472b-9974-4f35e922e548 tempest-MultipleCreateTestJSON-1098505367 tempest-MultipleCreateTestJSON-1098505367-project] 10.222.0.61 "GET /compute/v2.1/servers/64136c5d-b1e6-4263-a450-3308b0b4f69b" status: 404 len: 111 microversion: 2.1 time: 0.162402 Aug 31 16:15:52.037588 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2164/4329] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:51 2022] GET /compute/v2.1/servers/64136c5d-b1e6-4263-a450-3308b0b4f69b => generated 111 bytes in 166 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:15:52.049708 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-52265a0c-3dda-4760-aadb-b5a627c71cfd tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:52.050620 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-52265a0c-3dda-4760-aadb-b5a627c71cfd tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] [instance: fa0932e8-1aa4-4d1a-b653-14be35568f3d] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:52.054314 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-12447d45-23f6-4d73-a340-9f909f099b82 req-0843af0d-b40d-45a5-a01b-7da56a9748fb service nova] Creating event network-vif-deleted:10959604-b4b5-4638-81b1-024cf0563917 for instance fa0932e8-1aa4-4d1a-b653-14be35568f3d on n-h2-850499-9 Aug 31 16:15:52.066325 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-52265a0c-3dda-4760-aadb-b5a627c71cfd tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:52.067891 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-52265a0c-3dda-4760-aadb-b5a627c71cfd tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:52.068765 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-12447d45-23f6-4d73-a340-9f909f099b82 req-0843af0d-b40d-45a5-a01b-7da56a9748fb service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107530 Aug 31 16:15:52.069386 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2166/4330] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:15:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:15:52.080185 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-52265a0c-3dda-4760-aadb-b5a627c71cfd tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:52.087259 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-52265a0c-3dda-4760-aadb-b5a627c71cfd tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:52.089960 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-52265a0c-3dda-4760-aadb-b5a627c71cfd tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:52.090886 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-52265a0c-3dda-4760-aadb-b5a627c71cfd tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:52.111410 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b7a13fa5-1ff2-4dd0-b941-f5cd08be6c33 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:52.112177 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b7a13fa5-1ff2-4dd0-b941-f5cd08be6c33 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: c4ef985e-0861-4c5d-88eb-d8ad053a8f54] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:52.129656 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b7a13fa5-1ff2-4dd0-b941-f5cd08be6c33 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:52.130178 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b7a13fa5-1ff2-4dd0-b941-f5cd08be6c33 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:52.130628 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b7a13fa5-1ff2-4dd0-b941-f5cd08be6c33 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:52.131359 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b7a13fa5-1ff2-4dd0-b941-f5cd08be6c33 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:52.131849 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b7a13fa5-1ff2-4dd0-b941-f5cd08be6c33 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:52.132356 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b7a13fa5-1ff2-4dd0-b941-f5cd08be6c33 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:52.324949 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-52265a0c-3dda-4760-aadb-b5a627c71cfd tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:52.355875 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-52265a0c-3dda-4760-aadb-b5a627c71cfd tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:52.361620 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-52265a0c-3dda-4760-aadb-b5a627c71cfd tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:52.363800 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-52265a0c-3dda-4760-aadb-b5a627c71cfd tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] 10.222.0.61 "GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d" status: 200 len: 1604 microversion: 2.32 time: 0.324499 Aug 31 16:15:52.367089 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2165/4331] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:15:52 2022] GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d => generated 1604 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:15:52.542814 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b7a13fa5-1ff2-4dd0-b941-f5cd08be6c33 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb261f2061164b49a8d496b16647dd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d2222a956a4888967e21647e26b310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:52.550953 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b7a13fa5-1ff2-4dd0-b941-f5cd08be6c33 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "GET /compute/v2.1/servers/c4ef985e-0861-4c5d-88eb-d8ad053a8f54" status: 200 len: 1514 microversion: 2.1 time: 0.444267 Aug 31 16:15:52.551557 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2167/4332] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:52 2022] GET /compute/v2.1/servers/c4ef985e-0861-4c5d-88eb-d8ad053a8f54 => generated 1514 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:15:52.901029 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b157bf1a-6287-4520-a332-ebe4e5a98118 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:52.901673 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b157bf1a-6287-4520-a332-ebe4e5a98118 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] [instance: 32192367-aeac-41db-8669-4f3611612ad8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:52.932003 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b157bf1a-6287-4520-a332-ebe4e5a98118 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:52.936583 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b157bf1a-6287-4520-a332-ebe4e5a98118 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:52.939854 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b157bf1a-6287-4520-a332-ebe4e5a98118 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:52.945817 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b157bf1a-6287-4520-a332-ebe4e5a98118 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:52.949794 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b157bf1a-6287-4520-a332-ebe4e5a98118 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:52.950320 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b157bf1a-6287-4520-a332-ebe4e5a98118 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:52.965854 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8bf8ac9a-31ec-4ba7-b146-cb3cf5a615ad tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:52.967077 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8bf8ac9a-31ec-4ba7-b146-cb3cf5a615ad tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: e3625fdf-7e50-4ba1-99dc-6ae7473fc706] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:52.986502 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8bf8ac9a-31ec-4ba7-b146-cb3cf5a615ad tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:52.988773 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8bf8ac9a-31ec-4ba7-b146-cb3cf5a615ad tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:52.989525 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8bf8ac9a-31ec-4ba7-b146-cb3cf5a615ad tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:52.996037 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8bf8ac9a-31ec-4ba7-b146-cb3cf5a615ad tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:52.997172 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8bf8ac9a-31ec-4ba7-b146-cb3cf5a615ad tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:52.998470 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8bf8ac9a-31ec-4ba7-b146-cb3cf5a615ad tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:53.161794 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8bf8ac9a-31ec-4ba7-b146-cb3cf5a615ad tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48ee960c38f4d0584ea5ce34579279f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a957b6585e74a31b5bc5f66441c33e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:53.180400 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8bf8ac9a-31ec-4ba7-b146-cb3cf5a615ad tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706" status: 200 len: 1464 microversion: 2.1 time: 0.218176 Aug 31 16:15:53.183428 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2168/4333] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:52 2022] GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706 => generated 1464 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:15:53.296684 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b157bf1a-6287-4520-a332-ebe4e5a98118 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860ac4e423cf410d9bbc354c77ba864c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aada201b2fd64fdc81a69f826e7c607b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:53.309019 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b157bf1a-6287-4520-a332-ebe4e5a98118 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] 10.222.0.61 "GET /compute/v2.1/servers/32192367-aeac-41db-8669-4f3611612ad8" status: 200 len: 1334 microversion: 2.1 time: 0.415519 Aug 31 16:15:53.311277 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2166/4334] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:52 2022] GET /compute/v2.1/servers/32192367-aeac-41db-8669-4f3611612ad8 => generated 1334 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:53.400452 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a2f9b330-a881-4c85-b969-c695d894cc82 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:53.401162 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a2f9b330-a881-4c85-b969-c695d894cc82 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] [instance: fa0932e8-1aa4-4d1a-b653-14be35568f3d] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:53.408912 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a2f9b330-a881-4c85-b969-c695d894cc82 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:53.409849 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a2f9b330-a881-4c85-b969-c695d894cc82 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:53.410482 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a2f9b330-a881-4c85-b969-c695d894cc82 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:53.411364 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a2f9b330-a881-4c85-b969-c695d894cc82 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:53.412027 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a2f9b330-a881-4c85-b969-c695d894cc82 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:53.412653 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a2f9b330-a881-4c85-b969-c695d894cc82 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:53.539292 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a2f9b330-a881-4c85-b969-c695d894cc82 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:53.552538 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a2f9b330-a881-4c85-b969-c695d894cc82 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:53.554141 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a2f9b330-a881-4c85-b969-c695d894cc82 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:53.556118 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a2f9b330-a881-4c85-b969-c695d894cc82 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] 10.222.0.61 "GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d" status: 200 len: 1604 microversion: 2.32 time: 0.162349 Aug 31 16:15:53.574715 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2169/4335] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:15:53 2022] GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d => generated 1604 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:15:53.574944 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-57908f32-3166-406c-b0a7-185eadc57ed8 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:53.575422 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-57908f32-3166-406c-b0a7-185eadc57ed8 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: c4ef985e-0861-4c5d-88eb-d8ad053a8f54] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:53.586708 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-57908f32-3166-406c-b0a7-185eadc57ed8 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:53.587224 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-57908f32-3166-406c-b0a7-185eadc57ed8 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:53.587709 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-57908f32-3166-406c-b0a7-185eadc57ed8 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:53.588435 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-57908f32-3166-406c-b0a7-185eadc57ed8 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:53.589147 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-57908f32-3166-406c-b0a7-185eadc57ed8 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:53.589723 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-57908f32-3166-406c-b0a7-185eadc57ed8 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:53.911336 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-57908f32-3166-406c-b0a7-185eadc57ed8 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb261f2061164b49a8d496b16647dd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d2222a956a4888967e21647e26b310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:53.924624 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-57908f32-3166-406c-b0a7-185eadc57ed8 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "GET /compute/v2.1/servers/c4ef985e-0861-4c5d-88eb-d8ad053a8f54" status: 200 len: 1514 microversion: 2.1 time: 0.353981 Aug 31 16:15:53.925224 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2167/4336] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:53 2022] GET /compute/v2.1/servers/c4ef985e-0861-4c5d-88eb-d8ad053a8f54 => generated 1514 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:15:54.121114 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-4552d7dd-f763-4041-8b5c-de2c5abc95c2 req-914f3797-6dfe-4dd0-a740-3d3ead90c88a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3625fdf-7e50-4ba1-99dc-6ae7473fc706", "name": "network-vif-deleted", "tag": "7e3f67e3-533f-4eab-9333-7f35c6d050e3"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:15:54.150508 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-4552d7dd-f763-4041-8b5c-de2c5abc95c2 req-914f3797-6dfe-4dd0-a740-3d3ead90c88a service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:54.151492 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-4552d7dd-f763-4041-8b5c-de2c5abc95c2 req-914f3797-6dfe-4dd0-a740-3d3ead90c88a service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:54.152377 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-4552d7dd-f763-4041-8b5c-de2c5abc95c2 req-914f3797-6dfe-4dd0-a740-3d3ead90c88a service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:54.178750 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-4552d7dd-f763-4041-8b5c-de2c5abc95c2 req-914f3797-6dfe-4dd0-a740-3d3ead90c88a service nova] Creating event network-vif-deleted:7e3f67e3-533f-4eab-9333-7f35c6d050e3 for instance e3625fdf-7e50-4ba1-99dc-6ae7473fc706 on n-h2-850499-9 Aug 31 16:15:54.190542 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-4552d7dd-f763-4041-8b5c-de2c5abc95c2 req-914f3797-6dfe-4dd0-a740-3d3ead90c88a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074198 Aug 31 16:15:54.194639 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2170/4337] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:15:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:15:54.210585 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4f54636d-7f35-4249-b225-f1caa5a33ac3 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:54.211861 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4f54636d-7f35-4249-b225-f1caa5a33ac3 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: e3625fdf-7e50-4ba1-99dc-6ae7473fc706] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:54.228992 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4f54636d-7f35-4249-b225-f1caa5a33ac3 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:54.229523 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4f54636d-7f35-4249-b225-f1caa5a33ac3 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:54.229977 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4f54636d-7f35-4249-b225-f1caa5a33ac3 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:54.231024 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4f54636d-7f35-4249-b225-f1caa5a33ac3 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:54.231751 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4f54636d-7f35-4249-b225-f1caa5a33ac3 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:54.236245 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4f54636d-7f35-4249-b225-f1caa5a33ac3 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:54.259794 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-4f54636d-7f35-4249-b225-f1caa5a33ac3 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] HTTP exception thrown: Instance e3625fdf-7e50-4ba1-99dc-6ae7473fc706 could not be found. Aug 31 16:15:54.272159 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4f54636d-7f35-4249-b225-f1caa5a33ac3 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Request method failure captured: Aug 31 16:15:54.272159 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706 HTTP/1.1 Aug 31 16:15:54.272159 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:15:54.272159 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:15:54.272159 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:15:54.272159 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:15:54.272159 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:15:54.272159 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:15:54.272159 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:15:54.272159 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:15:54.272159 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4iP7f4yyaiNhGw8LqfdICITi06VYWCkoEp-cDk48FsYLmtYqszpDY1S97aGq5FfakGxIhzp6qBgenB8Q_0lkWFeXLcQ1h-P1yh_rwJ1bmVKd9nuMajOjHjX3JoUs15xvdogPNU8eYIYF9-RmjTDiCuYhws7FRWrtSpphaLjnZnzmkY Aug 31 16:15:54.272159 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:15:54.272159 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:15:54.272159 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:15:54.272159 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:15:54.272159 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:15:54.272159 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:15:54.272159 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 4a957b6585e74a31b5bc5f66441c33e3 Aug 31 16:15:54.272159 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ServerRescueTestJSON-1703273155 Aug 31 16:15:54.272159 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:15:54.272159 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:15:54.272159 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4a957b6585e74a31b5bc5f66441c33e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/4a957b6585e74a31b5bc5f66441c33e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_4a957b6585e74a31b5bc5f66441c33e3", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4a957b6585e74a31b5bc5f66441c33e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:15:54.272159 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ServerRescueTestJSON-1703273155 Aug 31 16:15:54.272159 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 4a957b6585e74a31b5bc5f66441c33e3 Aug 31 16:15:54.272159 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ServerRescueTestJSON-1703273155 Aug 31 16:15:54.272159 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ServerRescueTestJSON-1703273155-project Aug 31 16:15:54.272159 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:15:54.272159 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:15:54.272159 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: d48ee960c38f4d0584ea5ce34579279f Aug 31 16:15:54.272159 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ServerRescueTestJSON-1703273155-project Aug 31 16:15:54.272159 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:15:54.272159 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance e3625fdf-7e50-4ba1-99dc-6ae7473fc706 could not be found. Aug 31 16:15:54.272159 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': 'e3625fdf-7e50-4ba1-99dc-6ae7473fc706'} Aug 31 16:15:54.272159 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:15:54.272159 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:54.272159 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:15:54.272159 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:15:54.272159 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:15:54.272159 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:15:54.272159 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:15:54.272159 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:15:54.272159 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:15:54.272159 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:15:54.272159 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3625fdf-7e50-4ba1-99dc-6ae7473fc706 could not be found. Aug 31 16:15:54.272159 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:15:54.272159 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:15:54.272159 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:15:54.272159 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:54.272159 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:15:54.272159 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:15:54.272159 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:15:54.272159 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:15:54.272159 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:15:54.272159 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:15:54.272159 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:15:54.272159 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:15:54.272159 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:15:54.272159 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:15:54.272159 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:15:54.272159 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:15:54.272159 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3625fdf-7e50-4ba1-99dc-6ae7473fc706 could not be found. Aug 31 16:15:54.272159 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:15:54.272159 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:15:54.272159 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:15:54.277546 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:54.277546 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:15:54.277546 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:15:54.277546 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:15:54.277546 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:15:54.277546 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3625fdf-7e50-4ba1-99dc-6ae7473fc706 could not be found. Aug 31 16:15:54.277546 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:15:54.277546 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4f54636d-7f35-4249-b225-f1caa5a33ac3 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Returning 404 to user: Instance e3625fdf-7e50-4ba1-99dc-6ae7473fc706 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:15:54.277546 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4f54636d-7f35-4249-b225-f1caa5a33ac3 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706" status: 404 len: 111 microversion: 2.1 time: 0.069031 Aug 31 16:15:54.277546 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2168/4338] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:54 2022] GET /compute/v2.1/servers/e3625fdf-7e50-4ba1-99dc-6ae7473fc706 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:15:54.287944 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-345bb4e4-08ab-4251-b98e-5ffff3d39600 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:54.288687 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-345bb4e4-08ab-4251-b98e-5ffff3d39600 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: c6bfb382-b9a8-4bf0-b868-ee5f51f9daac] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:54.304447 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-345bb4e4-08ab-4251-b98e-5ffff3d39600 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:54.311521 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-345bb4e4-08ab-4251-b98e-5ffff3d39600 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:54.312128 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-345bb4e4-08ab-4251-b98e-5ffff3d39600 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:54.313434 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-345bb4e4-08ab-4251-b98e-5ffff3d39600 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:54.314181 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-345bb4e4-08ab-4251-b98e-5ffff3d39600 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:54.314947 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-345bb4e4-08ab-4251-b98e-5ffff3d39600 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:54.334243 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-34131118-c729-433b-b6ab-43af3758e50e tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:54.335077 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-34131118-c729-433b-b6ab-43af3758e50e tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] [instance: 32192367-aeac-41db-8669-4f3611612ad8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:54.354608 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-34131118-c729-433b-b6ab-43af3758e50e tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:54.355144 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-34131118-c729-433b-b6ab-43af3758e50e tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:54.355627 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-34131118-c729-433b-b6ab-43af3758e50e tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:54.356825 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-34131118-c729-433b-b6ab-43af3758e50e tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:54.357305 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-34131118-c729-433b-b6ab-43af3758e50e tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:54.357751 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-34131118-c729-433b-b6ab-43af3758e50e tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:54.396965 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-345bb4e4-08ab-4251-b98e-5ffff3d39600 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: c6bfb382-b9a8-4bf0-b868-ee5f51f9daac] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:15:54.535434 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-345bb4e4-08ab-4251-b98e-5ffff3d39600 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "DELETE /compute/v2.1/servers/c6bfb382-b9a8-4bf0-b868-ee5f51f9daac" status: 204 len: 0 microversion: 2.1 time: 0.252598 Aug 31 16:15:54.540778 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2171/4339] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:15:54 2022] DELETE /compute/v2.1/servers/c6bfb382-b9a8-4bf0-b868-ee5f51f9daac => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:15:54.562617 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4f2592e5-5b66-4653-9ae1-1b1c8291c267 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:54.567093 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4f2592e5-5b66-4653-9ae1-1b1c8291c267 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: c6bfb382-b9a8-4bf0-b868-ee5f51f9daac] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:54.585615 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4f2592e5-5b66-4653-9ae1-1b1c8291c267 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:54.586409 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4f2592e5-5b66-4653-9ae1-1b1c8291c267 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:54.588348 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4f2592e5-5b66-4653-9ae1-1b1c8291c267 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:54.589364 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4f2592e5-5b66-4653-9ae1-1b1c8291c267 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:54.596519 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4f2592e5-5b66-4653-9ae1-1b1c8291c267 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:54.597396 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4f2592e5-5b66-4653-9ae1-1b1c8291c267 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:55.239597 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-4f2592e5-5b66-4653-9ae1-1b1c8291c267 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48ee960c38f4d0584ea5ce34579279f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a957b6585e74a31b5bc5f66441c33e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:55.258153 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4f2592e5-5b66-4653-9ae1-1b1c8291c267 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "GET /compute/v2.1/servers/c6bfb382-b9a8-4bf0-b868-ee5f51f9daac" status: 200 len: 1492 microversion: 2.1 time: 0.711275 Aug 31 16:15:55.278573 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2172/4340] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:54 2022] GET /compute/v2.1/servers/c6bfb382-b9a8-4bf0-b868-ee5f51f9daac => generated 1492 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:55.288402 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-34131118-c729-433b-b6ab-43af3758e50e tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860ac4e423cf410d9bbc354c77ba864c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aada201b2fd64fdc81a69f826e7c607b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:55.296915 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-588ca589-e715-4df6-8504-cbc784cbfc12 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:55.298233 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-588ca589-e715-4df6-8504-cbc784cbfc12 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] [instance: fa0932e8-1aa4-4d1a-b653-14be35568f3d] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:55.309607 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-34131118-c729-433b-b6ab-43af3758e50e tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] 10.222.0.61 "GET /compute/v2.1/servers/32192367-aeac-41db-8669-4f3611612ad8" status: 200 len: 1334 microversion: 2.1 time: 0.979374 Aug 31 16:15:55.310281 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-588ca589-e715-4df6-8504-cbc784cbfc12 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:55.311068 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-588ca589-e715-4df6-8504-cbc784cbfc12 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:55.312062 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-588ca589-e715-4df6-8504-cbc784cbfc12 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:55.313264 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-588ca589-e715-4df6-8504-cbc784cbfc12 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:55.315650 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-588ca589-e715-4df6-8504-cbc784cbfc12 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:55.316508 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-588ca589-e715-4df6-8504-cbc784cbfc12 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:55.321222 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2169/4341] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:54 2022] GET /compute/v2.1/servers/32192367-aeac-41db-8669-4f3611612ad8 => generated 1334 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:55.349995 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-8f5a09cf-3f48-43f1-80bf-0ebf47c6424f req-0614f9ce-b556-452d-969b-ee13aa4e0af0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32192367-aeac-41db-8669-4f3611612ad8", "name": "network-vif-plugged", "status": "completed", "tag": "c901ee03-7fa2-42b1-a495-ddb34d68393f"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:15:55.370113 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-8f5a09cf-3f48-43f1-80bf-0ebf47c6424f req-0614f9ce-b556-452d-969b-ee13aa4e0af0 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:55.370981 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-8f5a09cf-3f48-43f1-80bf-0ebf47c6424f req-0614f9ce-b556-452d-969b-ee13aa4e0af0 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:55.371893 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-8f5a09cf-3f48-43f1-80bf-0ebf47c6424f req-0614f9ce-b556-452d-969b-ee13aa4e0af0 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:55.412542 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-8f5a09cf-3f48-43f1-80bf-0ebf47c6424f req-0614f9ce-b556-452d-969b-ee13aa4e0af0 service nova] Creating event network-vif-plugged:c901ee03-7fa2-42b1-a495-ddb34d68393f for instance 32192367-aeac-41db-8669-4f3611612ad8 on n-h1-850499-9 Aug 31 16:15:55.425918 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-8f5a09cf-3f48-43f1-80bf-0ebf47c6424f req-0614f9ce-b556-452d-969b-ee13aa4e0af0 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101843 Aug 31 16:15:55.435598 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2170/4342] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:15:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:15:55.449373 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7c3e261f-4812-4ac2-a27f-3adc68f28788 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:55.451040 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7c3e261f-4812-4ac2-a27f-3adc68f28788 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: c4ef985e-0861-4c5d-88eb-d8ad053a8f54] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:55.468832 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7c3e261f-4812-4ac2-a27f-3adc68f28788 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:55.470472 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7c3e261f-4812-4ac2-a27f-3adc68f28788 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:55.472185 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7c3e261f-4812-4ac2-a27f-3adc68f28788 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:55.474648 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7c3e261f-4812-4ac2-a27f-3adc68f28788 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:55.475957 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7c3e261f-4812-4ac2-a27f-3adc68f28788 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:55.477012 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7c3e261f-4812-4ac2-a27f-3adc68f28788 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:55.526614 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-588ca589-e715-4df6-8504-cbc784cbfc12 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:55.539609 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-588ca589-e715-4df6-8504-cbc784cbfc12 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:55.541256 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-588ca589-e715-4df6-8504-cbc784cbfc12 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:55.543076 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-588ca589-e715-4df6-8504-cbc784cbfc12 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] 10.222.0.61 "GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d" status: 200 len: 1604 microversion: 2.32 time: 0.262321 Aug 31 16:15:55.551371 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2173/4343] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:15:55 2022] GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d => generated 1604 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:15:55.801974 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7c3e261f-4812-4ac2-a27f-3adc68f28788 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb261f2061164b49a8d496b16647dd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d2222a956a4888967e21647e26b310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:55.831061 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7c3e261f-4812-4ac2-a27f-3adc68f28788 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "GET /compute/v2.1/servers/c4ef985e-0861-4c5d-88eb-d8ad053a8f54" status: 200 len: 1514 microversion: 2.1 time: 0.393033 Aug 31 16:15:55.842596 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2171/4344] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:55 2022] GET /compute/v2.1/servers/c4ef985e-0861-4c5d-88eb-d8ad053a8f54 => generated 1514 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:56.307455 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a121426d-7949-43ec-9273-6e9cc60ed3e3 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:56.309012 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a121426d-7949-43ec-9273-6e9cc60ed3e3 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: c6bfb382-b9a8-4bf0-b868-ee5f51f9daac] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:56.328241 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a121426d-7949-43ec-9273-6e9cc60ed3e3 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:56.329989 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a121426d-7949-43ec-9273-6e9cc60ed3e3 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:56.331670 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a121426d-7949-43ec-9273-6e9cc60ed3e3 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:56.336364 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a121426d-7949-43ec-9273-6e9cc60ed3e3 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:56.338138 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a121426d-7949-43ec-9273-6e9cc60ed3e3 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:56.339105 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a121426d-7949-43ec-9273-6e9cc60ed3e3 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:56.347484 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2d902cdb-530d-4cc0-98d6-fde1513ee799 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:56.348411 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2d902cdb-530d-4cc0-98d6-fde1513ee799 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] [instance: 32192367-aeac-41db-8669-4f3611612ad8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:56.370242 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2d902cdb-530d-4cc0-98d6-fde1513ee799 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:56.372347 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2d902cdb-530d-4cc0-98d6-fde1513ee799 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:56.377047 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2d902cdb-530d-4cc0-98d6-fde1513ee799 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:56.378315 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2d902cdb-530d-4cc0-98d6-fde1513ee799 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:56.379378 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2d902cdb-530d-4cc0-98d6-fde1513ee799 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:56.383063 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2d902cdb-530d-4cc0-98d6-fde1513ee799 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:57.251171 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a121426d-7949-43ec-9273-6e9cc60ed3e3 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48ee960c38f4d0584ea5ce34579279f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a957b6585e74a31b5bc5f66441c33e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:57.259492 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a121426d-7949-43ec-9273-6e9cc60ed3e3 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "GET /compute/v2.1/servers/c6bfb382-b9a8-4bf0-b868-ee5f51f9daac" status: 200 len: 1492 microversion: 2.1 time: 0.961044 Aug 31 16:15:57.260116 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2174/4345] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:56 2022] GET /compute/v2.1/servers/c6bfb382-b9a8-4bf0-b868-ee5f51f9daac => generated 1492 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:57.276249 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-072942a9-55cd-4e64-91a7-e541149bece7 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:57.277404 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-072942a9-55cd-4e64-91a7-e541149bece7 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] [instance: fa0932e8-1aa4-4d1a-b653-14be35568f3d] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:57.286675 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-072942a9-55cd-4e64-91a7-e541149bece7 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:57.287561 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-072942a9-55cd-4e64-91a7-e541149bece7 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:57.288507 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-072942a9-55cd-4e64-91a7-e541149bece7 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:57.289460 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-072942a9-55cd-4e64-91a7-e541149bece7 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:57.290174 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-072942a9-55cd-4e64-91a7-e541149bece7 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:57.290935 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-072942a9-55cd-4e64-91a7-e541149bece7 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:57.501790 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-072942a9-55cd-4e64-91a7-e541149bece7 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:57.522183 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-072942a9-55cd-4e64-91a7-e541149bece7 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:57.523745 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-072942a9-55cd-4e64-91a7-e541149bece7 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:57.525005 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-072942a9-55cd-4e64-91a7-e541149bece7 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] 10.222.0.61 "GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d" status: 200 len: 1604 microversion: 2.32 time: 0.263937 Aug 31 16:15:57.532133 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2175/4346] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:15:57 2022] GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d => generated 1604 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:15:57.555729 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e0177c81-09f1-4cd7-9477-84af5d5b664f tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:57.556371 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e0177c81-09f1-4cd7-9477-84af5d5b664f tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: c4ef985e-0861-4c5d-88eb-d8ad053a8f54] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:57.567150 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e0177c81-09f1-4cd7-9477-84af5d5b664f tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:57.567701 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e0177c81-09f1-4cd7-9477-84af5d5b664f tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:57.572111 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e0177c81-09f1-4cd7-9477-84af5d5b664f tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:57.572969 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e0177c81-09f1-4cd7-9477-84af5d5b664f tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:57.573474 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e0177c81-09f1-4cd7-9477-84af5d5b664f tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:57.573986 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e0177c81-09f1-4cd7-9477-84af5d5b664f tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:57.582085 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-2d902cdb-530d-4cc0-98d6-fde1513ee799 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860ac4e423cf410d9bbc354c77ba864c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aada201b2fd64fdc81a69f826e7c607b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:57.602588 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2d902cdb-530d-4cc0-98d6-fde1513ee799 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] 10.222.0.61 "GET /compute/v2.1/servers/32192367-aeac-41db-8669-4f3611612ad8" status: 200 len: 1334 microversion: 2.1 time: 1.259700 Aug 31 16:15:57.605577 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2172/4347] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:56 2022] GET /compute/v2.1/servers/32192367-aeac-41db-8669-4f3611612ad8 => generated 1334 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:57.617921 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-530135ab-700e-4e3d-9b89-8bcb1bcec02a req-38639a0b-2319-4762-b086-914aae35d6e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32192367-aeac-41db-8669-4f3611612ad8", "name": "network-vif-plugged", "status": "completed", "tag": "8bd24ff8-7cfc-4a5a-8304-9a7a21c3ff0d"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:15:57.646137 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-530135ab-700e-4e3d-9b89-8bcb1bcec02a req-38639a0b-2319-4762-b086-914aae35d6e4 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:57.646654 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-530135ab-700e-4e3d-9b89-8bcb1bcec02a req-38639a0b-2319-4762-b086-914aae35d6e4 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:57.647094 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-530135ab-700e-4e3d-9b89-8bcb1bcec02a req-38639a0b-2319-4762-b086-914aae35d6e4 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:57.687108 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-530135ab-700e-4e3d-9b89-8bcb1bcec02a req-38639a0b-2319-4762-b086-914aae35d6e4 service nova] Creating event network-vif-plugged:8bd24ff8-7cfc-4a5a-8304-9a7a21c3ff0d for instance 32192367-aeac-41db-8669-4f3611612ad8 on n-h1-850499-9 Aug 31 16:15:57.712007 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-530135ab-700e-4e3d-9b89-8bcb1bcec02a req-38639a0b-2319-4762-b086-914aae35d6e4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104010 Aug 31 16:15:57.713075 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2173/4348] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:15:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:15:57.888313 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e0177c81-09f1-4cd7-9477-84af5d5b664f tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb261f2061164b49a8d496b16647dd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d2222a956a4888967e21647e26b310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:57.936468 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e0177c81-09f1-4cd7-9477-84af5d5b664f tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "GET /compute/v2.1/servers/c4ef985e-0861-4c5d-88eb-d8ad053a8f54" status: 200 len: 1514 microversion: 2.1 time: 0.374033 Aug 31 16:15:57.941942 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2176/4349] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:57 2022] GET /compute/v2.1/servers/c4ef985e-0861-4c5d-88eb-d8ad053a8f54 => generated 1514 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:58.297730 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-876708c2-8a17-4ef5-8dc8-6e05a2578339 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:58.298843 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-876708c2-8a17-4ef5-8dc8-6e05a2578339 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: c6bfb382-b9a8-4bf0-b868-ee5f51f9daac] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:58.307600 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-876708c2-8a17-4ef5-8dc8-6e05a2578339 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:58.315368 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-876708c2-8a17-4ef5-8dc8-6e05a2578339 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:58.316217 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-876708c2-8a17-4ef5-8dc8-6e05a2578339 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:58.317443 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-876708c2-8a17-4ef5-8dc8-6e05a2578339 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:58.318162 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-876708c2-8a17-4ef5-8dc8-6e05a2578339 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:58.318833 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-876708c2-8a17-4ef5-8dc8-6e05a2578339 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:58.565075 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-be6ef5ad-9b15-4333-804c-46758ad5b0bb tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:58.566110 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-be6ef5ad-9b15-4333-804c-46758ad5b0bb tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] [instance: fa0932e8-1aa4-4d1a-b653-14be35568f3d] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:58.585417 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-be6ef5ad-9b15-4333-804c-46758ad5b0bb tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:58.586081 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-be6ef5ad-9b15-4333-804c-46758ad5b0bb tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:58.586543 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-be6ef5ad-9b15-4333-804c-46758ad5b0bb tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:58.587335 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-be6ef5ad-9b15-4333-804c-46758ad5b0bb tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:58.595598 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-be6ef5ad-9b15-4333-804c-46758ad5b0bb tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:58.595850 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-be6ef5ad-9b15-4333-804c-46758ad5b0bb tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:58.891985 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-be6ef5ad-9b15-4333-804c-46758ad5b0bb tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:58.912749 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-876708c2-8a17-4ef5-8dc8-6e05a2578339 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48ee960c38f4d0584ea5ce34579279f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a957b6585e74a31b5bc5f66441c33e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:58.925902 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-be6ef5ad-9b15-4333-804c-46758ad5b0bb tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:58.926236 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-876708c2-8a17-4ef5-8dc8-6e05a2578339 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "GET /compute/v2.1/servers/c6bfb382-b9a8-4bf0-b868-ee5f51f9daac" status: 200 len: 1492 microversion: 2.1 time: 0.638506 Aug 31 16:15:58.927442 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-be6ef5ad-9b15-4333-804c-46758ad5b0bb tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:58.928083 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2174/4350] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:58 2022] GET /compute/v2.1/servers/c6bfb382-b9a8-4bf0-b868-ee5f51f9daac => generated 1492 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:58.928724 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-be6ef5ad-9b15-4333-804c-46758ad5b0bb tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] 10.222.0.61 "GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d" status: 200 len: 1604 microversion: 2.32 time: 0.373000 Aug 31 16:15:58.935313 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2177/4351] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:15:58 2022] GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d => generated 1604 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:15:58.946997 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6d4b989f-473f-4726-94b0-0dfcf805cd98 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:58.948884 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6d4b989f-473f-4726-94b0-0dfcf805cd98 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] [instance: 32192367-aeac-41db-8669-4f3611612ad8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:58.964738 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-bec583bf-7601-40cd-9172-358508f0ae2d tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:58.965681 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-bec583bf-7601-40cd-9172-358508f0ae2d tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: c4ef985e-0861-4c5d-88eb-d8ad053a8f54] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:58.972570 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6d4b989f-473f-4726-94b0-0dfcf805cd98 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:58.976880 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bec583bf-7601-40cd-9172-358508f0ae2d tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:58.977108 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6d4b989f-473f-4726-94b0-0dfcf805cd98 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:58.977748 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6d4b989f-473f-4726-94b0-0dfcf805cd98 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:58.978413 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bec583bf-7601-40cd-9172-358508f0ae2d tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:58.980088 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6d4b989f-473f-4726-94b0-0dfcf805cd98 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:58.980633 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bec583bf-7601-40cd-9172-358508f0ae2d tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:58.981510 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bec583bf-7601-40cd-9172-358508f0ae2d tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:58.982159 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6d4b989f-473f-4726-94b0-0dfcf805cd98 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:58.982788 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6d4b989f-473f-4726-94b0-0dfcf805cd98 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:58.983451 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bec583bf-7601-40cd-9172-358508f0ae2d tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:58.987033 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bec583bf-7601-40cd-9172-358508f0ae2d tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:59.483205 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-6d4b989f-473f-4726-94b0-0dfcf805cd98 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860ac4e423cf410d9bbc354c77ba864c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aada201b2fd64fdc81a69f826e7c607b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:59.486702 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-bec583bf-7601-40cd-9172-358508f0ae2d tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb261f2061164b49a8d496b16647dd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d2222a956a4888967e21647e26b310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:59.503371 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6d4b989f-473f-4726-94b0-0dfcf805cd98 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] 10.222.0.61 "GET /compute/v2.1/servers/32192367-aeac-41db-8669-4f3611612ad8" status: 200 len: 1334 microversion: 2.1 time: 0.566463 Aug 31 16:15:59.505001 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2175/4352] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:58 2022] GET /compute/v2.1/servers/32192367-aeac-41db-8669-4f3611612ad8 => generated 1334 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:59.507408 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-bec583bf-7601-40cd-9172-358508f0ae2d tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "GET /compute/v2.1/servers/c4ef985e-0861-4c5d-88eb-d8ad053a8f54" status: 200 len: 1520 microversion: 2.1 time: 0.546524 Aug 31 16:15:59.513827 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2178/4353] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:58 2022] GET /compute/v2.1/servers/c4ef985e-0861-4c5d-88eb-d8ad053a8f54 => generated 1520 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:15:59.808890 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-e2cab4de-6353-49c6-b650-a4498cd804ef req-23e9bb04-d9bf-4696-a024-2ba9e1c0ed98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6bfb382-b9a8-4bf0-b868-ee5f51f9daac", "name": "network-vif-deleted", "tag": "36afac70-65f8-4bf7-b126-7e6e5c89bdd6"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:15:59.829514 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-e2cab4de-6353-49c6-b650-a4498cd804ef req-23e9bb04-d9bf-4696-a024-2ba9e1c0ed98 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:59.830022 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-e2cab4de-6353-49c6-b650-a4498cd804ef req-23e9bb04-d9bf-4696-a024-2ba9e1c0ed98 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:59.830472 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-e2cab4de-6353-49c6-b650-a4498cd804ef req-23e9bb04-d9bf-4696-a024-2ba9e1c0ed98 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:59.862907 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=100 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:15:59.873184 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-e2cab4de-6353-49c6-b650-a4498cd804ef req-23e9bb04-d9bf-4696-a024-2ba9e1c0ed98 service nova] Creating event network-vif-deleted:36afac70-65f8-4bf7-b126-7e6e5c89bdd6 for instance c6bfb382-b9a8-4bf0-b868-ee5f51f9daac on n-h1-850499-9 Aug 31 16:15:59.889795 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-e2cab4de-6353-49c6-b650-a4498cd804ef req-23e9bb04-d9bf-4696-a024-2ba9e1c0ed98 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084512 Aug 31 16:15:59.891798 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2176/4354] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:15:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:15:59.962759 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b4afd361-98e3-44bc-b243-0f066e889ec1 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:59.963517 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b4afd361-98e3-44bc-b243-0f066e889ec1 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: c6bfb382-b9a8-4bf0-b868-ee5f51f9daac] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:59.965210 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c6d89079-ac83-4f28-bd0c-5fa8f7476a68 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:59.966473 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c6d89079-ac83-4f28-bd0c-5fa8f7476a68 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] [instance: fa0932e8-1aa4-4d1a-b653-14be35568f3d] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:59.975403 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c6d89079-ac83-4f28-bd0c-5fa8f7476a68 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:59.983971 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b4afd361-98e3-44bc-b243-0f066e889ec1 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:59.984233 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c6d89079-ac83-4f28-bd0c-5fa8f7476a68 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:59.984686 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c6d89079-ac83-4f28-bd0c-5fa8f7476a68 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:59.985548 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b4afd361-98e3-44bc-b243-0f066e889ec1 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:59.985839 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c6d89079-ac83-4f28-bd0c-5fa8f7476a68 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:59.986343 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c6d89079-ac83-4f28-bd0c-5fa8f7476a68 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:59.986792 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c6d89079-ac83-4f28-bd0c-5fa8f7476a68 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:59.989988 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b4afd361-98e3-44bc-b243-0f066e889ec1 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:59.996872 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b4afd361-98e3-44bc-b243-0f066e889ec1 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:59.999805 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b4afd361-98e3-44bc-b243-0f066e889ec1 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:00.001725 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b4afd361-98e3-44bc-b243-0f066e889ec1 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:00.153743 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c6d89079-ac83-4f28-bd0c-5fa8f7476a68 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:00.200662 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c6d89079-ac83-4f28-bd0c-5fa8f7476a68 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:00.200662 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c6d89079-ac83-4f28-bd0c-5fa8f7476a68 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:00.200662 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c6d89079-ac83-4f28-bd0c-5fa8f7476a68 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] 10.222.0.61 "GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d" status: 200 len: 1604 microversion: 2.32 time: 0.239361 Aug 31 16:16:00.202191 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2177/4355] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:15:59 2022] GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d => generated 1604 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:16:00.233415 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b4afd361-98e3-44bc-b243-0f066e889ec1 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48ee960c38f4d0584ea5ce34579279f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a957b6585e74a31b5bc5f66441c33e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:00.243913 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b4afd361-98e3-44bc-b243-0f066e889ec1 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "GET /compute/v2.1/servers/c6bfb382-b9a8-4bf0-b868-ee5f51f9daac" status: 200 len: 1450 microversion: 2.1 time: 0.289204 Aug 31 16:16:00.260313 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2179/4356] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:59 2022] GET /compute/v2.1/servers/c6bfb382-b9a8-4bf0-b868-ee5f51f9daac => generated 1450 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:00.533764 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-69b34c44-6edd-41c5-85c8-c725bb589462 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:00.534401 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-69b34c44-6edd-41c5-85c8-c725bb589462 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] [instance: 32192367-aeac-41db-8669-4f3611612ad8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:00.544199 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-92086e1e-3ec6-44c9-81ad-c2cc107cbf41 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:00.545028 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-92086e1e-3ec6-44c9-81ad-c2cc107cbf41 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: c4ef985e-0861-4c5d-88eb-d8ad053a8f54] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:00.553615 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-69b34c44-6edd-41c5-85c8-c725bb589462 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:00.555520 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-69b34c44-6edd-41c5-85c8-c725bb589462 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:00.556004 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-69b34c44-6edd-41c5-85c8-c725bb589462 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:00.557196 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-92086e1e-3ec6-44c9-81ad-c2cc107cbf41 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:00.558473 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-69b34c44-6edd-41c5-85c8-c725bb589462 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:00.558991 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-69b34c44-6edd-41c5-85c8-c725bb589462 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:00.560034 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-69b34c44-6edd-41c5-85c8-c725bb589462 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:00.560302 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-92086e1e-3ec6-44c9-81ad-c2cc107cbf41 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:00.560897 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-92086e1e-3ec6-44c9-81ad-c2cc107cbf41 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:00.566711 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-92086e1e-3ec6-44c9-81ad-c2cc107cbf41 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:00.568271 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-92086e1e-3ec6-44c9-81ad-c2cc107cbf41 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:00.569008 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-92086e1e-3ec6-44c9-81ad-c2cc107cbf41 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:00.990895 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-69b34c44-6edd-41c5-85c8-c725bb589462 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860ac4e423cf410d9bbc354c77ba864c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aada201b2fd64fdc81a69f826e7c607b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:01.003467 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-69b34c44-6edd-41c5-85c8-c725bb589462 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] 10.222.0.61 "GET /compute/v2.1/servers/32192367-aeac-41db-8669-4f3611612ad8" status: 200 len: 1334 microversion: 2.1 time: 0.474786 Aug 31 16:16:01.004817 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2178/4357] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:00 2022] GET /compute/v2.1/servers/32192367-aeac-41db-8669-4f3611612ad8 => generated 1334 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:01.016933 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-650b4d92-1778-46f3-b999-ec1edf45d8cc req-4db5bd90-43d4-4738-96d2-71654362919c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4ef985e-0861-4c5d-88eb-d8ad053a8f54", "name": "network-vif-unplugged", "status": "completed", "tag": "e616625c-3e6f-4ab3-a8fe-75faeba8be2a"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:16:01.051309 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-650b4d92-1778-46f3-b999-ec1edf45d8cc req-4db5bd90-43d4-4738-96d2-71654362919c service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:01.052076 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-650b4d92-1778-46f3-b999-ec1edf45d8cc req-4db5bd90-43d4-4738-96d2-71654362919c service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:01.052532 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-650b4d92-1778-46f3-b999-ec1edf45d8cc req-4db5bd90-43d4-4738-96d2-71654362919c service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:01.078921 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-650b4d92-1778-46f3-b999-ec1edf45d8cc req-4db5bd90-43d4-4738-96d2-71654362919c service nova] Creating event network-vif-unplugged:e616625c-3e6f-4ab3-a8fe-75faeba8be2a for instance c4ef985e-0861-4c5d-88eb-d8ad053a8f54 on n-h1-850499-9 Aug 31 16:16:01.096308 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-650b4d92-1778-46f3-b999-ec1edf45d8cc req-4db5bd90-43d4-4738-96d2-71654362919c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.090043 Aug 31 16:16:01.096945 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2179/4358] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:16:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:16:01.228862 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d5ce8de4-9849-43f3-89b2-41db7a867037 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:01.229473 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d5ce8de4-9849-43f3-89b2-41db7a867037 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] [instance: fa0932e8-1aa4-4d1a-b653-14be35568f3d] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:01.240048 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d5ce8de4-9849-43f3-89b2-41db7a867037 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:01.242060 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d5ce8de4-9849-43f3-89b2-41db7a867037 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:01.243779 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d5ce8de4-9849-43f3-89b2-41db7a867037 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:01.244909 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d5ce8de4-9849-43f3-89b2-41db7a867037 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:01.246045 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d5ce8de4-9849-43f3-89b2-41db7a867037 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:01.246644 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d5ce8de4-9849-43f3-89b2-41db7a867037 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:01.281290 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-92086e1e-3ec6-44c9-81ad-c2cc107cbf41 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb261f2061164b49a8d496b16647dd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d2222a956a4888967e21647e26b310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:01.301468 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-92086e1e-3ec6-44c9-81ad-c2cc107cbf41 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "GET /compute/v2.1/servers/c4ef985e-0861-4c5d-88eb-d8ad053a8f54" status: 200 len: 1520 microversion: 2.1 time: 0.756431 Aug 31 16:16:01.302992 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2180/4359] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:00 2022] GET /compute/v2.1/servers/c4ef985e-0861-4c5d-88eb-d8ad053a8f54 => generated 1520 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:01.310761 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b0455e53-f7ff-4f93-bb30-55afe42524d5 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:01.311937 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b0455e53-f7ff-4f93-bb30-55afe42524d5 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: c6bfb382-b9a8-4bf0-b868-ee5f51f9daac] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:01.329483 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b0455e53-f7ff-4f93-bb30-55afe42524d5 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:01.331142 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b0455e53-f7ff-4f93-bb30-55afe42524d5 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:01.335348 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b0455e53-f7ff-4f93-bb30-55afe42524d5 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:01.339243 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b0455e53-f7ff-4f93-bb30-55afe42524d5 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:01.340160 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b0455e53-f7ff-4f93-bb30-55afe42524d5 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:01.340814 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b0455e53-f7ff-4f93-bb30-55afe42524d5 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:01.613075 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d5ce8de4-9849-43f3-89b2-41db7a867037 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:01.638921 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d5ce8de4-9849-43f3-89b2-41db7a867037 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:01.640894 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d5ce8de4-9849-43f3-89b2-41db7a867037 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:01.643990 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d5ce8de4-9849-43f3-89b2-41db7a867037 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] 10.222.0.61 "GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d" status: 200 len: 1604 microversion: 2.32 time: 0.419544 Aug 31 16:16:01.650829 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2180/4360] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:16:01 2022] GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d => generated 1604 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:16:02.033474 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-393ac2fe-5532-4f17-bbe7-7ee1a650ed6b tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:02.034531 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-393ac2fe-5532-4f17-bbe7-7ee1a650ed6b tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] [instance: 32192367-aeac-41db-8669-4f3611612ad8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:02.054250 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-393ac2fe-5532-4f17-bbe7-7ee1a650ed6b tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:02.056816 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-393ac2fe-5532-4f17-bbe7-7ee1a650ed6b tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:02.057442 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-393ac2fe-5532-4f17-bbe7-7ee1a650ed6b tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:02.072250 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-393ac2fe-5532-4f17-bbe7-7ee1a650ed6b tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:02.077559 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-393ac2fe-5532-4f17-bbe7-7ee1a650ed6b tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:02.080285 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-393ac2fe-5532-4f17-bbe7-7ee1a650ed6b tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:02.478180 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b0455e53-f7ff-4f93-bb30-55afe42524d5 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48ee960c38f4d0584ea5ce34579279f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a957b6585e74a31b5bc5f66441c33e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:02.487979 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:16:02.524171 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b0455e53-f7ff-4f93-bb30-55afe42524d5 tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "GET /compute/v2.1/servers/c6bfb382-b9a8-4bf0-b868-ee5f51f9daac" status: 200 len: 1450 microversion: 2.1 time: 1.208820 Aug 31 16:16:02.537318 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2181/4361] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:01 2022] GET /compute/v2.1/servers/c6bfb382-b9a8-4bf0-b868-ee5f51f9daac => generated 1450 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:02.562100 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7f1d3747-ddd1-47ff-a119-8fc1ea3f25c7 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:02.566129 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7f1d3747-ddd1-47ff-a119-8fc1ea3f25c7 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: c4ef985e-0861-4c5d-88eb-d8ad053a8f54] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:02.598269 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7f1d3747-ddd1-47ff-a119-8fc1ea3f25c7 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:02.602210 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7f1d3747-ddd1-47ff-a119-8fc1ea3f25c7 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:02.602815 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7f1d3747-ddd1-47ff-a119-8fc1ea3f25c7 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:02.607406 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7f1d3747-ddd1-47ff-a119-8fc1ea3f25c7 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:02.612308 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7f1d3747-ddd1-47ff-a119-8fc1ea3f25c7 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:02.612802 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7f1d3747-ddd1-47ff-a119-8fc1ea3f25c7 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:02.762691 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-393ac2fe-5532-4f17-bbe7-7ee1a650ed6b tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860ac4e423cf410d9bbc354c77ba864c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aada201b2fd64fdc81a69f826e7c607b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:02.789517 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-393ac2fe-5532-4f17-bbe7-7ee1a650ed6b tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] 10.222.0.61 "GET /compute/v2.1/servers/32192367-aeac-41db-8669-4f3611612ad8" status: 200 len: 1334 microversion: 2.1 time: 0.764119 Aug 31 16:16:02.792084 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2181/4362] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:02 2022] GET /compute/v2.1/servers/32192367-aeac-41db-8669-4f3611612ad8 => generated 1334 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:02.804411 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-88e8c880-5c6f-41e9-b449-32778eb0eb7a tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:02.810011 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-88e8c880-5c6f-41e9-b449-32778eb0eb7a tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] [instance: fa0932e8-1aa4-4d1a-b653-14be35568f3d] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:02.856141 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-88e8c880-5c6f-41e9-b449-32778eb0eb7a tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:02.858874 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-88e8c880-5c6f-41e9-b449-32778eb0eb7a tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:02.861981 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-88e8c880-5c6f-41e9-b449-32778eb0eb7a tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:02.863681 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-88e8c880-5c6f-41e9-b449-32778eb0eb7a tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:02.864423 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-88e8c880-5c6f-41e9-b449-32778eb0eb7a tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:02.866384 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-88e8c880-5c6f-41e9-b449-32778eb0eb7a tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:03.076612 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-88e8c880-5c6f-41e9-b449-32778eb0eb7a tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:03.103325 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-88e8c880-5c6f-41e9-b449-32778eb0eb7a tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:03.109203 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-88e8c880-5c6f-41e9-b449-32778eb0eb7a tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:03.111118 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-88e8c880-5c6f-41e9-b449-32778eb0eb7a tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] 10.222.0.61 "GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d" status: 200 len: 1604 microversion: 2.32 time: 0.317720 Aug 31 16:16:03.135528 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2182/4363] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:16:02 2022] GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d => generated 1604 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:16:03.158910 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7f1d3747-ddd1-47ff-a119-8fc1ea3f25c7 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb261f2061164b49a8d496b16647dd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d2222a956a4888967e21647e26b310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:03.170156 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7f1d3747-ddd1-47ff-a119-8fc1ea3f25c7 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "GET /compute/v2.1/servers/c4ef985e-0861-4c5d-88eb-d8ad053a8f54" status: 200 len: 1520 microversion: 2.1 time: 0.631618 Aug 31 16:16:03.171443 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2182/4364] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:02 2022] GET /compute/v2.1/servers/c4ef985e-0861-4c5d-88eb-d8ad053a8f54 => generated 1520 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:03.559916 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-edf95044-f19e-49d6-8539-91e719897c7a tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:03.559916 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-edf95044-f19e-49d6-8539-91e719897c7a tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] [instance: c6bfb382-b9a8-4bf0-b868-ee5f51f9daac] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:03.586509 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-edf95044-f19e-49d6-8539-91e719897c7a tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:03.588189 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-edf95044-f19e-49d6-8539-91e719897c7a tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:03.588667 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-edf95044-f19e-49d6-8539-91e719897c7a tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:03.589410 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-edf95044-f19e-49d6-8539-91e719897c7a tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:03.589884 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-edf95044-f19e-49d6-8539-91e719897c7a tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:03.590319 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-edf95044-f19e-49d6-8539-91e719897c7a tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:03.637455 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-edf95044-f19e-49d6-8539-91e719897c7a tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] HTTP exception thrown: Instance c6bfb382-b9a8-4bf0-b868-ee5f51f9daac could not be found. Aug 31 16:16:03.641948 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-edf95044-f19e-49d6-8539-91e719897c7a tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Request method failure captured: Aug 31 16:16:03.641948 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/c6bfb382-b9a8-4bf0-b868-ee5f51f9daac HTTP/1.1 Aug 31 16:16:03.641948 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:16:03.641948 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:16:03.641948 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:16:03.641948 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:16:03.641948 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:16:03.641948 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:16:03.641948 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:16:03.641948 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:16:03.641948 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4iP7f4yyaiNhGw8LqfdICITi06VYWCkoEp-cDk48FsYLmtYqszpDY1S97aGq5FfakGxIhzp6qBgenB8Q_0lkWFeXLcQ1h-P1yh_rwJ1bmVKd9nuMajOjHjX3JoUs15xvdogPNU8eYIYF9-RmjTDiCuYhws7FRWrtSpphaLjnZnzmkY Aug 31 16:16:03.641948 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:16:03.641948 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:16:03.641948 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:16:03.641948 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:16:03.641948 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:16:03.641948 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:16:03.641948 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 4a957b6585e74a31b5bc5f66441c33e3 Aug 31 16:16:03.641948 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ServerRescueTestJSON-1703273155 Aug 31 16:16:03.641948 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:16:03.641948 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:16:03.641948 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4a957b6585e74a31b5bc5f66441c33e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/4a957b6585e74a31b5bc5f66441c33e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_4a957b6585e74a31b5bc5f66441c33e3", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4a957b6585e74a31b5bc5f66441c33e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:16:03.641948 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ServerRescueTestJSON-1703273155 Aug 31 16:16:03.641948 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 4a957b6585e74a31b5bc5f66441c33e3 Aug 31 16:16:03.641948 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ServerRescueTestJSON-1703273155 Aug 31 16:16:03.641948 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ServerRescueTestJSON-1703273155-project Aug 31 16:16:03.641948 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:16:03.641948 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:16:03.641948 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: d48ee960c38f4d0584ea5ce34579279f Aug 31 16:16:03.641948 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ServerRescueTestJSON-1703273155-project Aug 31 16:16:03.641948 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:16:03.641948 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance c6bfb382-b9a8-4bf0-b868-ee5f51f9daac could not be found. Aug 31 16:16:03.641948 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': 'c6bfb382-b9a8-4bf0-b868-ee5f51f9daac'} Aug 31 16:16:03.641948 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:16:03.641948 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:03.641948 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:16:03.641948 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:16:03.641948 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:16:03.641948 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:16:03.641948 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:16:03.641948 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:16:03.641948 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:16:03.641948 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:16:03.641948 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6bfb382-b9a8-4bf0-b868-ee5f51f9daac could not be found. Aug 31 16:16:03.641948 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:16:03.641948 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:03.641948 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:16:03.641948 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:03.641948 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:03.641948 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:03.641948 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:16:03.641948 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:16:03.641948 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:16:03.641948 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:16:03.641948 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:16:03.641948 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:16:03.641948 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:16:03.641948 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:16:03.641948 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:16:03.641948 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:16:03.641948 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6bfb382-b9a8-4bf0-b868-ee5f51f9daac could not be found. Aug 31 16:16:03.641948 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:16:03.641948 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:03.641948 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:16:03.645047 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:03.645047 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:03.645047 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:03.645047 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:16:03.645047 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:16:03.645047 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6bfb382-b9a8-4bf0-b868-ee5f51f9daac could not be found. Aug 31 16:16:03.645047 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:16:03.646668 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-edf95044-f19e-49d6-8539-91e719897c7a tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] Returning 404 to user: Instance c6bfb382-b9a8-4bf0-b868-ee5f51f9daac could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:16:03.648751 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-edf95044-f19e-49d6-8539-91e719897c7a tempest-ServerRescueTestJSON-1703273155 tempest-ServerRescueTestJSON-1703273155-project] 10.222.0.61 "GET /compute/v2.1/servers/c6bfb382-b9a8-4bf0-b868-ee5f51f9daac" status: 404 len: 111 microversion: 2.1 time: 0.102339 Aug 31 16:16:03.656089 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2183/4365] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:03 2022] GET /compute/v2.1/servers/c6bfb382-b9a8-4bf0-b868-ee5f51f9daac => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:16:03.819861 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-792423f1-96b2-4508-b8aa-14dba4b387d8 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:03.820940 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-792423f1-96b2-4508-b8aa-14dba4b387d8 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] [instance: 32192367-aeac-41db-8669-4f3611612ad8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:03.838773 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-792423f1-96b2-4508-b8aa-14dba4b387d8 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:03.842780 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-792423f1-96b2-4508-b8aa-14dba4b387d8 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:03.843745 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-792423f1-96b2-4508-b8aa-14dba4b387d8 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:03.847138 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-792423f1-96b2-4508-b8aa-14dba4b387d8 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:03.849414 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-792423f1-96b2-4508-b8aa-14dba4b387d8 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:03.858826 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-792423f1-96b2-4508-b8aa-14dba4b387d8 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:04.150534 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-80d063d9-e656-46fb-b497-0584c976dc64 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:04.151257 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-80d063d9-e656-46fb-b497-0584c976dc64 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] [instance: fa0932e8-1aa4-4d1a-b653-14be35568f3d] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:04.172813 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-80d063d9-e656-46fb-b497-0584c976dc64 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:04.173448 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-80d063d9-e656-46fb-b497-0584c976dc64 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:04.173893 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-80d063d9-e656-46fb-b497-0584c976dc64 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:04.182689 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-80d063d9-e656-46fb-b497-0584c976dc64 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:04.183219 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-80d063d9-e656-46fb-b497-0584c976dc64 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:04.183709 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-80d063d9-e656-46fb-b497-0584c976dc64 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:04.292976 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-792423f1-96b2-4508-b8aa-14dba4b387d8 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860ac4e423cf410d9bbc354c77ba864c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aada201b2fd64fdc81a69f826e7c607b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:04.310216 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-792423f1-96b2-4508-b8aa-14dba4b387d8 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] 10.222.0.61 "GET /compute/v2.1/servers/32192367-aeac-41db-8669-4f3611612ad8" status: 200 len: 1667 microversion: 2.1 time: 0.496984 Aug 31 16:16:04.310935 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2183/4366] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:03 2022] GET /compute/v2.1/servers/32192367-aeac-41db-8669-4f3611612ad8 => generated 1667 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:04.327871 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c23d96aa-d793-478f-b5c4-d8a2288c2182 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:04.330115 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c23d96aa-d793-478f-b5c4-d8a2288c2182 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: c4ef985e-0861-4c5d-88eb-d8ad053a8f54] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:04.348754 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c23d96aa-d793-478f-b5c4-d8a2288c2182 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:04.349497 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c23d96aa-d793-478f-b5c4-d8a2288c2182 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:04.350091 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c23d96aa-d793-478f-b5c4-d8a2288c2182 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:04.351343 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c23d96aa-d793-478f-b5c4-d8a2288c2182 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:04.351999 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c23d96aa-d793-478f-b5c4-d8a2288c2182 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:04.355780 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c23d96aa-d793-478f-b5c4-d8a2288c2182 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:04.410114 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-80d063d9-e656-46fb-b497-0584c976dc64 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:04.433749 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-80d063d9-e656-46fb-b497-0584c976dc64 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:04.435394 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-80d063d9-e656-46fb-b497-0584c976dc64 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:04.436701 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-80d063d9-e656-46fb-b497-0584c976dc64 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] 10.222.0.61 "GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d" status: 200 len: 1604 microversion: 2.32 time: 0.292017 Aug 31 16:16:04.437282 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2184/4367] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:16:04 2022] GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d => generated 1604 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:16:04.451890 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0b48cbeb-71cf-48e9-97d8-897f4d801903 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:04.457729 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0b48cbeb-71cf-48e9-97d8-897f4d801903 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] [instance: 32192367-aeac-41db-8669-4f3611612ad8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:04.482113 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0b48cbeb-71cf-48e9-97d8-897f4d801903 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:04.485368 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0b48cbeb-71cf-48e9-97d8-897f4d801903 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:04.495634 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0b48cbeb-71cf-48e9-97d8-897f4d801903 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:04.496483 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0b48cbeb-71cf-48e9-97d8-897f4d801903 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:04.496974 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0b48cbeb-71cf-48e9-97d8-897f4d801903 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:04.497420 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0b48cbeb-71cf-48e9-97d8-897f4d801903 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:04.539887 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0b48cbeb-71cf-48e9-97d8-897f4d801903 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] 10.222.0.61 "GET /compute/v2.1/servers/32192367-aeac-41db-8669-4f3611612ad8/ips" status: 200 len: 177 microversion: 2.1 time: 0.082835 Aug 31 16:16:04.539887 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2185/4368] 10.222.0.61 () {58 vars in 1248 bytes} [Wed Aug 31 16:16:04 2022] GET /compute/v2.1/servers/32192367-aeac-41db-8669-4f3611612ad8/ips => generated 177 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:16:04.972017 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c23d96aa-d793-478f-b5c4-d8a2288c2182 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb261f2061164b49a8d496b16647dd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d2222a956a4888967e21647e26b310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:04.983883 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c23d96aa-d793-478f-b5c4-d8a2288c2182 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "GET /compute/v2.1/servers/c4ef985e-0861-4c5d-88eb-d8ad053a8f54" status: 200 len: 1520 microversion: 2.1 time: 0.671198 Aug 31 16:16:04.984314 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2184/4369] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:04 2022] GET /compute/v2.1/servers/c4ef985e-0861-4c5d-88eb-d8ad053a8f54 => generated 1520 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:04.989630 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8000093b-8bbe-4c00-b1f2-d3f539aa7c18 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:04.990152 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8000093b-8bbe-4c00-b1f2-d3f539aa7c18 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] [instance: 32192367-aeac-41db-8669-4f3611612ad8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:05.008542 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8000093b-8bbe-4c00-b1f2-d3f539aa7c18 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:05.009213 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8000093b-8bbe-4c00-b1f2-d3f539aa7c18 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:05.009786 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8000093b-8bbe-4c00-b1f2-d3f539aa7c18 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:05.013929 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8000093b-8bbe-4c00-b1f2-d3f539aa7c18 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:05.014652 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8000093b-8bbe-4c00-b1f2-d3f539aa7c18 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:05.015317 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8000093b-8bbe-4c00-b1f2-d3f539aa7c18 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:05.131975 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8000093b-8bbe-4c00-b1f2-d3f539aa7c18 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] [instance: 32192367-aeac-41db-8669-4f3611612ad8] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:16:05.165872 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-37c4b338-8753-4034-a3cd-6d93e854309d tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-1139045579", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "networks": [{"uuid": "be81a3ca-87c0-4317-b622-8dd913974d2d"}]}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:16:05.330433 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-37c4b338-8753-4034-a3cd-6d93e854309d tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] validate_networks() for [('be81a3ca-87c0-4317-b622-8dd913974d2d', None, None, None, None, None)] {{(pid=122256) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:16:05.383177 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8000093b-8bbe-4c00-b1f2-d3f539aa7c18 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] 10.222.0.61 "DELETE /compute/v2.1/servers/32192367-aeac-41db-8669-4f3611612ad8" status: 204 len: 0 microversion: 2.1 time: 0.396879 Aug 31 16:16:05.383888 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2185/4370] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:16:04 2022] DELETE /compute/v2.1/servers/32192367-aeac-41db-8669-4f3611612ad8 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:16:05.396631 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7b643c01-d330-4e9f-ab6a-ef3ae72efe75 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:05.408689 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7b643c01-d330-4e9f-ab6a-ef3ae72efe75 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] [instance: 32192367-aeac-41db-8669-4f3611612ad8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:05.417681 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7b643c01-d330-4e9f-ab6a-ef3ae72efe75 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:05.418577 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7b643c01-d330-4e9f-ab6a-ef3ae72efe75 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:05.419309 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7b643c01-d330-4e9f-ab6a-ef3ae72efe75 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:05.420328 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7b643c01-d330-4e9f-ab6a-ef3ae72efe75 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:05.421008 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7b643c01-d330-4e9f-ab6a-ef3ae72efe75 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:05.427323 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7b643c01-d330-4e9f-ab6a-ef3ae72efe75 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:05.789300 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7b643c01-d330-4e9f-ab6a-ef3ae72efe75 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860ac4e423cf410d9bbc354c77ba864c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aada201b2fd64fdc81a69f826e7c607b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:05.804679 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7b643c01-d330-4e9f-ab6a-ef3ae72efe75 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] 10.222.0.61 "GET /compute/v2.1/servers/32192367-aeac-41db-8669-4f3611612ad8" status: 200 len: 1673 microversion: 2.1 time: 0.415673 Aug 31 16:16:05.819532 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2186/4371] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:05 2022] GET /compute/v2.1/servers/32192367-aeac-41db-8669-4f3611612ad8 => generated 1673 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:16:05.826053 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4dfa709f-d528-4477-8ed7-e34927963e5d tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:05.826737 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4dfa709f-d528-4477-8ed7-e34927963e5d tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] [instance: fa0932e8-1aa4-4d1a-b653-14be35568f3d] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:05.834144 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4dfa709f-d528-4477-8ed7-e34927963e5d tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:05.834886 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4dfa709f-d528-4477-8ed7-e34927963e5d tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:05.835550 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4dfa709f-d528-4477-8ed7-e34927963e5d tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:05.836446 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4dfa709f-d528-4477-8ed7-e34927963e5d tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:05.837488 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4dfa709f-d528-4477-8ed7-e34927963e5d tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:05.838407 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4dfa709f-d528-4477-8ed7-e34927963e5d tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:05.990009 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-4dfa709f-d528-4477-8ed7-e34927963e5d tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:06.025989 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-4dfa709f-d528-4477-8ed7-e34927963e5d tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:06.028635 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-4dfa709f-d528-4477-8ed7-e34927963e5d tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:06.030616 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4dfa709f-d528-4477-8ed7-e34927963e5d tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] 10.222.0.61 "GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d" status: 200 len: 1604 microversion: 2.32 time: 0.209484 Aug 31 16:16:06.039805 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2187/4372] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:16:05 2022] GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d => generated 1604 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:16:06.053691 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2d129f6e-7bc5-4b63-a672-073178420879 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:06.062477 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2d129f6e-7bc5-4b63-a672-073178420879 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: c4ef985e-0861-4c5d-88eb-d8ad053a8f54] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:06.074118 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2d129f6e-7bc5-4b63-a672-073178420879 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:06.074628 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2d129f6e-7bc5-4b63-a672-073178420879 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:06.079624 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2d129f6e-7bc5-4b63-a672-073178420879 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:06.083243 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2d129f6e-7bc5-4b63-a672-073178420879 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:06.083778 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2d129f6e-7bc5-4b63-a672-073178420879 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:06.084229 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2d129f6e-7bc5-4b63-a672-073178420879 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:06.619134 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2d129f6e-7bc5-4b63-a672-073178420879 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb261f2061164b49a8d496b16647dd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d2222a956a4888967e21647e26b310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:06.634273 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2d129f6e-7bc5-4b63-a672-073178420879 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "GET /compute/v2.1/servers/c4ef985e-0861-4c5d-88eb-d8ad053a8f54" status: 200 len: 1520 microversion: 2.1 time: 0.593061 Aug 31 16:16:06.634879 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2188/4373] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:06 2022] GET /compute/v2.1/servers/c4ef985e-0861-4c5d-88eb-d8ad053a8f54 => generated 1520 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:06.838831 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c2633a82-739b-4d56-974d-91862b1facea tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:06.841716 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c2633a82-739b-4d56-974d-91862b1facea tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] [instance: 32192367-aeac-41db-8669-4f3611612ad8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:06.845719 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-37c4b338-8753-4034-a3cd-6d93e854309d tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:16:06.846865 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-37c4b338-8753-4034-a3cd-6d93e854309d tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:16:06.847893 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-37c4b338-8753-4034-a3cd-6d93e854309d tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:16:06.848484 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-37c4b338-8753-4034-a3cd-6d93e854309d tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:16:06.849187 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-37c4b338-8753-4034-a3cd-6d93e854309d tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:16:06.874881 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c2633a82-739b-4d56-974d-91862b1facea tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:06.877947 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c2633a82-739b-4d56-974d-91862b1facea tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:06.879623 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-37c4b338-8753-4034-a3cd-6d93e854309d tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:06.879764 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c2633a82-739b-4d56-974d-91862b1facea tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:06.881912 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c2633a82-739b-4d56-974d-91862b1facea tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:06.882423 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c2633a82-739b-4d56-974d-91862b1facea tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:06.882671 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-37c4b338-8753-4034-a3cd-6d93e854309d tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:06.884042 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c2633a82-739b-4d56-974d-91862b1facea tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:06.884900 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-37c4b338-8753-4034-a3cd-6d93e854309d tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:06.889074 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-37c4b338-8753-4034-a3cd-6d93e854309d tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:06.889879 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-37c4b338-8753-4034-a3cd-6d93e854309d tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:06.895092 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-37c4b338-8753-4034-a3cd-6d93e854309d tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:06.959810 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-37c4b338-8753-4034-a3cd-6d93e854309d tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Getting quotas for project ddc0aa4c03f84f5691d4e7b8c5da75e7. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:16:06.974748 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-37c4b338-8753-4034-a3cd-6d93e854309d tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Getting quotas for user b09abc9573e94951b69e871170cbcf0d and project ddc0aa4c03f84f5691d4e7b8c5da75e7. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:16:06.983223 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:16:07.007918 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-37c4b338-8753-4034-a3cd-6d93e854309d tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Going to run 1 instances... {{(pid=122256) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:16:07.012347 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-37c4b338-8753-4034-a3cd-6d93e854309d tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] [instance: 8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:16:07.160197 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-37c4b338-8753-4034-a3cd-6d93e854309d tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.625691 Aug 31 16:16:07.170394 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2186/4374] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:16:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 2637 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:16:07.183601 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-c0ca8d07-8a8a-4ca1-b3e4-138a461ff329 req-27e9ecbd-99b3-4818-89c7-46a24fe876c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4ef985e-0861-4c5d-88eb-d8ad053a8f54", "name": "network-vif-plugged", "status": "completed", "tag": "e616625c-3e6f-4ab3-a8fe-75faeba8be2a"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:16:07.217889 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-c0ca8d07-8a8a-4ca1-b3e4-138a461ff329 req-27e9ecbd-99b3-4818-89c7-46a24fe876c9 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:07.218627 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-c0ca8d07-8a8a-4ca1-b3e4-138a461ff329 req-27e9ecbd-99b3-4818-89c7-46a24fe876c9 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:07.219344 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-c0ca8d07-8a8a-4ca1-b3e4-138a461ff329 req-27e9ecbd-99b3-4818-89c7-46a24fe876c9 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:07.234014 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-c0ca8d07-8a8a-4ca1-b3e4-138a461ff329 req-27e9ecbd-99b3-4818-89c7-46a24fe876c9 service nova] Creating event network-vif-plugged:e616625c-3e6f-4ab3-a8fe-75faeba8be2a for instance c4ef985e-0861-4c5d-88eb-d8ad053a8f54 on n-h1-850499-9 Aug 31 16:16:07.243981 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-c0ca8d07-8a8a-4ca1-b3e4-138a461ff329 req-27e9ecbd-99b3-4818-89c7-46a24fe876c9 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069423 Aug 31 16:16:07.244813 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2187/4375] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:16:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:16:07.250619 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0b1ad996-2537-4f2f-a53c-fb3d588b37ff tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:07.251687 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0b1ad996-2537-4f2f-a53c-fb3d588b37ff tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] [instance: fa0932e8-1aa4-4d1a-b653-14be35568f3d] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:07.259196 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0b1ad996-2537-4f2f-a53c-fb3d588b37ff tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:07.259938 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0b1ad996-2537-4f2f-a53c-fb3d588b37ff tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:07.260520 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0b1ad996-2537-4f2f-a53c-fb3d588b37ff tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:07.261519 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0b1ad996-2537-4f2f-a53c-fb3d588b37ff tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:07.262298 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0b1ad996-2537-4f2f-a53c-fb3d588b37ff tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:07.262929 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0b1ad996-2537-4f2f-a53c-fb3d588b37ff tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:08.319104 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c2633a82-739b-4d56-974d-91862b1facea tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860ac4e423cf410d9bbc354c77ba864c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aada201b2fd64fdc81a69f826e7c607b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:08.331770 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c2633a82-739b-4d56-974d-91862b1facea tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] 10.222.0.61 "GET /compute/v2.1/servers/32192367-aeac-41db-8669-4f3611612ad8" status: 200 len: 1673 microversion: 2.1 time: 1.504206 Aug 31 16:16:08.347071 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2189/4376] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:06 2022] GET /compute/v2.1/servers/32192367-aeac-41db-8669-4f3611612ad8 => generated 1673 bytes in 1524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:08.353358 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5ba13bbc-568e-43eb-a9ae-151814e1085e tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:08.354598 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5ba13bbc-568e-43eb-a9ae-151814e1085e tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] [instance: 8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:08.369551 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5ba13bbc-568e-43eb-a9ae-151814e1085e tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:08.370457 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5ba13bbc-568e-43eb-a9ae-151814e1085e tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:08.371079 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5ba13bbc-568e-43eb-a9ae-151814e1085e tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:08.372011 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5ba13bbc-568e-43eb-a9ae-151814e1085e tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:08.372927 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5ba13bbc-568e-43eb-a9ae-151814e1085e tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:08.373568 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5ba13bbc-568e-43eb-a9ae-151814e1085e tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:08.395403 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-0b1ad996-2537-4f2f-a53c-fb3d588b37ff tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:08.405352 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-0b1ad996-2537-4f2f-a53c-fb3d588b37ff tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:08.407569 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-0b1ad996-2537-4f2f-a53c-fb3d588b37ff tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:08.425133 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0b1ad996-2537-4f2f-a53c-fb3d588b37ff tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] 10.222.0.61 "GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d" status: 200 len: 1604 microversion: 2.32 time: 1.178668 Aug 31 16:16:08.426351 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2188/4377] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:16:07 2022] GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d => generated 1604 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:16:08.431442 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3c5d8d61-31b1-440c-8a7e-61f32f1d9653 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:08.432142 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3c5d8d61-31b1-440c-8a7e-61f32f1d9653 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: c4ef985e-0861-4c5d-88eb-d8ad053a8f54] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:08.445243 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3c5d8d61-31b1-440c-8a7e-61f32f1d9653 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:08.445756 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3c5d8d61-31b1-440c-8a7e-61f32f1d9653 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:08.446272 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3c5d8d61-31b1-440c-8a7e-61f32f1d9653 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:08.447136 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3c5d8d61-31b1-440c-8a7e-61f32f1d9653 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:08.450539 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3c5d8d61-31b1-440c-8a7e-61f32f1d9653 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:08.451807 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3c5d8d61-31b1-440c-8a7e-61f32f1d9653 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:08.623993 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5ba13bbc-568e-43eb-a9ae-151814e1085e tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09abc9573e94951b69e871170cbcf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc0aa4c03f84f5691d4e7b8c5da75e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:08.637620 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5ba13bbc-568e-43eb-a9ae-151814e1085e tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] 10.222.0.61 "GET /compute/v2.1/servers/8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21" status: 200 len: 1224 microversion: 2.1 time: 0.289037 Aug 31 16:16:08.646096 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2190/4378] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:08 2022] GET /compute/v2.1/servers/8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21 => generated 1224 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:09.311355 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3c5d8d61-31b1-440c-8a7e-61f32f1d9653 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb261f2061164b49a8d496b16647dd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d2222a956a4888967e21647e26b310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:09.338741 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3c5d8d61-31b1-440c-8a7e-61f32f1d9653 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "GET /compute/v2.1/servers/c4ef985e-0861-4c5d-88eb-d8ad053a8f54" status: 200 len: 1520 microversion: 2.1 time: 0.910646 Aug 31 16:16:09.369591 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ad5e1087-02de-4e98-8b1a-a4d4d9c81d45 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:09.370224 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ad5e1087-02de-4e98-8b1a-a4d4d9c81d45 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] [instance: 32192367-aeac-41db-8669-4f3611612ad8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:09.378082 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2189/4379] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:08 2022] GET /compute/v2.1/servers/c4ef985e-0861-4c5d-88eb-d8ad053a8f54 => generated 1520 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:09.389003 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ad5e1087-02de-4e98-8b1a-a4d4d9c81d45 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:09.408839 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ad5e1087-02de-4e98-8b1a-a4d4d9c81d45 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:09.409700 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ad5e1087-02de-4e98-8b1a-a4d4d9c81d45 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:09.416900 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ad5e1087-02de-4e98-8b1a-a4d4d9c81d45 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:09.417713 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ad5e1087-02de-4e98-8b1a-a4d4d9c81d45 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:09.425806 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ad5e1087-02de-4e98-8b1a-a4d4d9c81d45 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:09.469803 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6cefda43-58bf-48c6-baab-66f294521aca tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:09.471394 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6cefda43-58bf-48c6-baab-66f294521aca tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] [instance: fa0932e8-1aa4-4d1a-b653-14be35568f3d] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:09.487720 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6cefda43-58bf-48c6-baab-66f294521aca tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:09.489128 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6cefda43-58bf-48c6-baab-66f294521aca tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:09.492350 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6cefda43-58bf-48c6-baab-66f294521aca tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:09.493852 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6cefda43-58bf-48c6-baab-66f294521aca tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:09.499657 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6cefda43-58bf-48c6-baab-66f294521aca tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:09.502750 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6cefda43-58bf-48c6-baab-66f294521aca tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:10.035431 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-6cefda43-58bf-48c6-baab-66f294521aca tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:10.054248 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-6cefda43-58bf-48c6-baab-66f294521aca tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:10.057535 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-6cefda43-58bf-48c6-baab-66f294521aca tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:10.059470 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6cefda43-58bf-48c6-baab-66f294521aca tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] 10.222.0.61 "GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d" status: 200 len: 1604 microversion: 2.32 time: 0.595402 Aug 31 16:16:10.060238 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2190/4380] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:16:09 2022] GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d => generated 1604 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:16:10.086623 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b468cf0b-79f1-4450-8b46-f78926f3321d tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:10.092743 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b468cf0b-79f1-4450-8b46-f78926f3321d tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] [instance: 8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:10.108161 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b468cf0b-79f1-4450-8b46-f78926f3321d tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:10.108952 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b468cf0b-79f1-4450-8b46-f78926f3321d tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:10.109630 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b468cf0b-79f1-4450-8b46-f78926f3321d tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:10.117464 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b468cf0b-79f1-4450-8b46-f78926f3321d tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:10.118206 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b468cf0b-79f1-4450-8b46-f78926f3321d tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:10.123050 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b468cf0b-79f1-4450-8b46-f78926f3321d tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:10.266718 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b468cf0b-79f1-4450-8b46-f78926f3321d tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09abc9573e94951b69e871170cbcf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc0aa4c03f84f5691d4e7b8c5da75e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:10.283277 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b468cf0b-79f1-4450-8b46-f78926f3321d tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] 10.222.0.61 "GET /compute/v2.1/servers/8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21" status: 200 len: 1286 microversion: 2.1 time: 0.220464 Aug 31 16:16:10.283801 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2191/4381] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:10 2022] GET /compute/v2.1/servers/8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21 => generated 1286 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:10.289022 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-7c6862ad-9fff-4e07-b625-a9d88b584188 req-417eb958-0702-4aac-b10f-557d4ed87989 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32192367-aeac-41db-8669-4f3611612ad8", "name": "network-vif-deleted", "tag": "c901ee03-7fa2-42b1-a495-ddb34d68393f"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:16:10.326341 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-7c6862ad-9fff-4e07-b625-a9d88b584188 req-417eb958-0702-4aac-b10f-557d4ed87989 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:10.332936 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-7c6862ad-9fff-4e07-b625-a9d88b584188 req-417eb958-0702-4aac-b10f-557d4ed87989 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:10.338807 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-7c6862ad-9fff-4e07-b625-a9d88b584188 req-417eb958-0702-4aac-b10f-557d4ed87989 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:10.370652 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-7c6862ad-9fff-4e07-b625-a9d88b584188 req-417eb958-0702-4aac-b10f-557d4ed87989 service nova] Creating event network-vif-deleted:c901ee03-7fa2-42b1-a495-ddb34d68393f for instance 32192367-aeac-41db-8669-4f3611612ad8 on n-h1-850499-9 Aug 31 16:16:10.403360 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-7c6862ad-9fff-4e07-b625-a9d88b584188 req-417eb958-0702-4aac-b10f-557d4ed87989 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115756 Aug 31 16:16:10.408962 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2192/4382] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:16:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:16:10.436792 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2ceafbfb-d547-4ff9-8e9a-9709c406d070 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:10.447828 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2ceafbfb-d547-4ff9-8e9a-9709c406d070 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: c4ef985e-0861-4c5d-88eb-d8ad053a8f54] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:10.481337 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2ceafbfb-d547-4ff9-8e9a-9709c406d070 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:10.483167 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2ceafbfb-d547-4ff9-8e9a-9709c406d070 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:10.485653 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2ceafbfb-d547-4ff9-8e9a-9709c406d070 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:10.494281 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2ceafbfb-d547-4ff9-8e9a-9709c406d070 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:10.495325 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2ceafbfb-d547-4ff9-8e9a-9709c406d070 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:10.510973 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2ceafbfb-d547-4ff9-8e9a-9709c406d070 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:11.253154 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-2ceafbfb-d547-4ff9-8e9a-9709c406d070 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb261f2061164b49a8d496b16647dd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d2222a956a4888967e21647e26b310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:11.283650 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2ceafbfb-d547-4ff9-8e9a-9709c406d070 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "GET /compute/v2.1/servers/c4ef985e-0861-4c5d-88eb-d8ad053a8f54" status: 200 len: 1505 microversion: 2.1 time: 0.872264 Aug 31 16:16:11.292539 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2193/4383] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:10 2022] GET /compute/v2.1/servers/c4ef985e-0861-4c5d-88eb-d8ad053a8f54 => generated 1505 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:11.300750 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ad5e1087-02de-4e98-8b1a-a4d4d9c81d45 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860ac4e423cf410d9bbc354c77ba864c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aada201b2fd64fdc81a69f826e7c607b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:11.319290 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-04b1afa5-336a-4959-935b-33b448688984 req-3fd80dd1-b405-4747-a431-5617e2f0e732 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32192367-aeac-41db-8669-4f3611612ad8", "name": "network-vif-unplugged", "status": "completed", "tag": "8bd24ff8-7cfc-4a5a-8304-9a7a21c3ff0d"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:16:11.338045 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ad5e1087-02de-4e98-8b1a-a4d4d9c81d45 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] 10.222.0.61 "GET /compute/v2.1/servers/32192367-aeac-41db-8669-4f3611612ad8" status: 200 len: 1652 microversion: 2.1 time: 1.986618 Aug 31 16:16:11.344284 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2191/4384] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:09 2022] GET /compute/v2.1/servers/32192367-aeac-41db-8669-4f3611612ad8 => generated 1652 bytes in 1993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:11.350445 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b371e7de-b4b9-4b5e-b915-a35b31caf99e tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:11.361060 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b371e7de-b4b9-4b5e-b915-a35b31caf99e tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] [instance: fa0932e8-1aa4-4d1a-b653-14be35568f3d] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:11.385839 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b371e7de-b4b9-4b5e-b915-a35b31caf99e tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:11.393787 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-04b1afa5-336a-4959-935b-33b448688984 req-3fd80dd1-b405-4747-a431-5617e2f0e732 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:11.397130 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b371e7de-b4b9-4b5e-b915-a35b31caf99e tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:11.397624 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b371e7de-b4b9-4b5e-b915-a35b31caf99e tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:11.398407 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b371e7de-b4b9-4b5e-b915-a35b31caf99e tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:11.398913 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b371e7de-b4b9-4b5e-b915-a35b31caf99e tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:11.399339 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b371e7de-b4b9-4b5e-b915-a35b31caf99e tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:11.401184 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-04b1afa5-336a-4959-935b-33b448688984 req-3fd80dd1-b405-4747-a431-5617e2f0e732 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:11.403579 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-04b1afa5-336a-4959-935b-33b448688984 req-3fd80dd1-b405-4747-a431-5617e2f0e732 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:11.476429 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-04b1afa5-336a-4959-935b-33b448688984 req-3fd80dd1-b405-4747-a431-5617e2f0e732 service nova] Creating event network-vif-unplugged:8bd24ff8-7cfc-4a5a-8304-9a7a21c3ff0d for instance 32192367-aeac-41db-8669-4f3611612ad8 on n-h1-850499-9 Aug 31 16:16:11.494164 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-04b1afa5-336a-4959-935b-33b448688984 req-3fd80dd1-b405-4747-a431-5617e2f0e732 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.199587 Aug 31 16:16:11.494766 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2194/4385] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:16:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:16:11.515235 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a220717a-6312-4f43-99b4-e9eff220c59c tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:11.539854 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a220717a-6312-4f43-99b4-e9eff220c59c tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: c4ef985e-0861-4c5d-88eb-d8ad053a8f54] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:11.563953 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a220717a-6312-4f43-99b4-e9eff220c59c tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:11.570089 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a220717a-6312-4f43-99b4-e9eff220c59c tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:11.570885 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a220717a-6312-4f43-99b4-e9eff220c59c tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:11.572139 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a220717a-6312-4f43-99b4-e9eff220c59c tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:11.572936 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a220717a-6312-4f43-99b4-e9eff220c59c tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:11.573673 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a220717a-6312-4f43-99b4-e9eff220c59c tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:11.751976 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b371e7de-b4b9-4b5e-b915-a35b31caf99e tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:11.762007 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b371e7de-b4b9-4b5e-b915-a35b31caf99e tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:11.773436 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b371e7de-b4b9-4b5e-b915-a35b31caf99e tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:11.775779 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b371e7de-b4b9-4b5e-b915-a35b31caf99e tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] 10.222.0.61 "GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d" status: 200 len: 1604 microversion: 2.32 time: 0.428563 Aug 31 16:16:11.776558 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2192/4386] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:16:11 2022] GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d => generated 1604 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:16:11.796650 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6f9b3ec0-4f42-49a3-9273-7fc2db5912a3 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:11.798117 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6f9b3ec0-4f42-49a3-9273-7fc2db5912a3 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] [instance: 8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:11.817146 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6f9b3ec0-4f42-49a3-9273-7fc2db5912a3 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:11.818097 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6f9b3ec0-4f42-49a3-9273-7fc2db5912a3 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:11.821816 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6f9b3ec0-4f42-49a3-9273-7fc2db5912a3 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:11.830512 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6f9b3ec0-4f42-49a3-9273-7fc2db5912a3 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:11.833593 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6f9b3ec0-4f42-49a3-9273-7fc2db5912a3 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:11.834454 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6f9b3ec0-4f42-49a3-9273-7fc2db5912a3 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:12.071859 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-6f9b3ec0-4f42-49a3-9273-7fc2db5912a3 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09abc9573e94951b69e871170cbcf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc0aa4c03f84f5691d4e7b8c5da75e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:12.085290 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6f9b3ec0-4f42-49a3-9273-7fc2db5912a3 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] 10.222.0.61 "GET /compute/v2.1/servers/8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21" status: 200 len: 1286 microversion: 2.1 time: 0.307257 Aug 31 16:16:12.090415 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2193/4387] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:11 2022] GET /compute/v2.1/servers/8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21 => generated 1286 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:12.264414 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a220717a-6312-4f43-99b4-e9eff220c59c tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb261f2061164b49a8d496b16647dd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d2222a956a4888967e21647e26b310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:12.288547 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a220717a-6312-4f43-99b4-e9eff220c59c tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "GET /compute/v2.1/servers/c4ef985e-0861-4c5d-88eb-d8ad053a8f54" status: 200 len: 1505 microversion: 2.1 time: 0.788033 Aug 31 16:16:12.298338 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2195/4388] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:11 2022] GET /compute/v2.1/servers/c4ef985e-0861-4c5d-88eb-d8ad053a8f54 => generated 1505 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:12.348569 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8a1465f0-3cf2-4ce0-a048-0e9e73327ead tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:12.349766 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8a1465f0-3cf2-4ce0-a048-0e9e73327ead tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: c4ef985e-0861-4c5d-88eb-d8ad053a8f54] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:12.371613 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8a1465f0-3cf2-4ce0-a048-0e9e73327ead tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:12.379882 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8a1465f0-3cf2-4ce0-a048-0e9e73327ead tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:12.386606 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-bbddafa8-b8f4-4778-98b5-aeb767133165 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:12.387606 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-bbddafa8-b8f4-4778-98b5-aeb767133165 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] [instance: 32192367-aeac-41db-8669-4f3611612ad8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:12.394909 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8a1465f0-3cf2-4ce0-a048-0e9e73327ead tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:12.398206 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8a1465f0-3cf2-4ce0-a048-0e9e73327ead tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:12.398923 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8a1465f0-3cf2-4ce0-a048-0e9e73327ead tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:12.404249 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8a1465f0-3cf2-4ce0-a048-0e9e73327ead tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:12.409768 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bbddafa8-b8f4-4778-98b5-aeb767133165 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:12.410652 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bbddafa8-b8f4-4778-98b5-aeb767133165 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:12.416262 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bbddafa8-b8f4-4778-98b5-aeb767133165 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:12.420763 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bbddafa8-b8f4-4778-98b5-aeb767133165 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:12.425378 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bbddafa8-b8f4-4778-98b5-aeb767133165 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:12.429537 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bbddafa8-b8f4-4778-98b5-aeb767133165 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:12.531400 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8a1465f0-3cf2-4ce0-a048-0e9e73327ead tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: c4ef985e-0861-4c5d-88eb-d8ad053a8f54] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:16:12.769115 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8a1465f0-3cf2-4ce0-a048-0e9e73327ead tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "DELETE /compute/v2.1/servers/c4ef985e-0861-4c5d-88eb-d8ad053a8f54" status: 204 len: 0 microversion: 2.1 time: 0.426288 Aug 31 16:16:12.771952 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2194/4389] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:16:12 2022] DELETE /compute/v2.1/servers/c4ef985e-0861-4c5d-88eb-d8ad053a8f54 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:16:12.819004 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2e189f82-7ef7-40f8-aab1-3acee348ebba tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:12.820845 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2e189f82-7ef7-40f8-aab1-3acee348ebba tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] [instance: fa0932e8-1aa4-4d1a-b653-14be35568f3d] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:12.844203 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2e189f82-7ef7-40f8-aab1-3acee348ebba tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:12.846077 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2e189f82-7ef7-40f8-aab1-3acee348ebba tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:12.848794 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2e189f82-7ef7-40f8-aab1-3acee348ebba tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:12.853642 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2e189f82-7ef7-40f8-aab1-3acee348ebba tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:12.856771 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2e189f82-7ef7-40f8-aab1-3acee348ebba tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:12.857545 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2e189f82-7ef7-40f8-aab1-3acee348ebba tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:12.882785 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:16:13.131618 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-bbddafa8-b8f4-4778-98b5-aeb767133165 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860ac4e423cf410d9bbc354c77ba864c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aada201b2fd64fdc81a69f826e7c607b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:13.164566 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-bbddafa8-b8f4-4778-98b5-aeb767133165 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] 10.222.0.61 "GET /compute/v2.1/servers/32192367-aeac-41db-8669-4f3611612ad8" status: 200 len: 1453 microversion: 2.1 time: 0.782272 Aug 31 16:16:13.180756 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2196/4390] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:12 2022] GET /compute/v2.1/servers/32192367-aeac-41db-8669-4f3611612ad8 => generated 1453 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:13.195556 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b0f94861-1bec-4ca6-b882-a8d235fcfe2d tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-891179578", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "networks": [{"uuid": "3a4287aa-151a-44bc-986d-c22141911de9"}]}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:16:13.343413 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-b0f94861-1bec-4ca6-b882-a8d235fcfe2d tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] validate_networks() for [('3a4287aa-151a-44bc-986d-c22141911de9', None, None, None, None, None)] {{(pid=122256) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:16:13.431028 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2e189f82-7ef7-40f8-aab1-3acee348ebba tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:13.460306 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2e189f82-7ef7-40f8-aab1-3acee348ebba tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:13.474553 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2e189f82-7ef7-40f8-aab1-3acee348ebba tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:13.482634 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2e189f82-7ef7-40f8-aab1-3acee348ebba tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] 10.222.0.61 "GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d" status: 200 len: 1604 microversion: 2.32 time: 0.678776 Aug 31 16:16:13.483412 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2195/4391] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:16:12 2022] GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d => generated 1604 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:16:13.494316 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8a105994-30b7-4658-b7af-5b86817b330f tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:13.496862 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8a105994-30b7-4658-b7af-5b86817b330f tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] [instance: 8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:13.508577 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:16:13.513845 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8a105994-30b7-4658-b7af-5b86817b330f tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:13.514634 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8a105994-30b7-4658-b7af-5b86817b330f tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:13.515328 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8a105994-30b7-4658-b7af-5b86817b330f tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:13.517134 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8a105994-30b7-4658-b7af-5b86817b330f tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:13.526174 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8a105994-30b7-4658-b7af-5b86817b330f tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:13.527128 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8a105994-30b7-4658-b7af-5b86817b330f tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:13.720605 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8a105994-30b7-4658-b7af-5b86817b330f tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09abc9573e94951b69e871170cbcf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc0aa4c03f84f5691d4e7b8c5da75e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:13.734778 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8a105994-30b7-4658-b7af-5b86817b330f tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] 10.222.0.61 "GET /compute/v2.1/servers/8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21" status: 200 len: 1286 microversion: 2.1 time: 0.249550 Aug 31 16:16:13.736214 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2196/4392] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:13 2022] GET /compute/v2.1/servers/8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21 => generated 1286 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:13.755211 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-e375672a-e042-4c8c-b672-88983175994f req-0fadb6c4-5b61-46bb-a162-512fd5d6a073 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32192367-aeac-41db-8669-4f3611612ad8", "name": "network-vif-deleted", "tag": "8bd24ff8-7cfc-4a5a-8304-9a7a21c3ff0d"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:16:13.787904 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-e375672a-e042-4c8c-b672-88983175994f req-0fadb6c4-5b61-46bb-a162-512fd5d6a073 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:13.788898 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-e375672a-e042-4c8c-b672-88983175994f req-0fadb6c4-5b61-46bb-a162-512fd5d6a073 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:13.789608 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-e375672a-e042-4c8c-b672-88983175994f req-0fadb6c4-5b61-46bb-a162-512fd5d6a073 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:13.813115 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-e375672a-e042-4c8c-b672-88983175994f req-0fadb6c4-5b61-46bb-a162-512fd5d6a073 service nova] Creating event network-vif-deleted:8bd24ff8-7cfc-4a5a-8304-9a7a21c3ff0d for instance 32192367-aeac-41db-8669-4f3611612ad8 on n-h1-850499-9 Aug 31 16:16:13.830751 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-e375672a-e042-4c8c-b672-88983175994f req-0fadb6c4-5b61-46bb-a162-512fd5d6a073 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092963 Aug 31 16:16:13.832223 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2197/4393] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:16:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:16:14.195151 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b5f1bc12-cf41-4236-8649-0efd02eac5b5 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:14.196397 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b5f1bc12-cf41-4236-8649-0efd02eac5b5 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] [instance: 32192367-aeac-41db-8669-4f3611612ad8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:14.210094 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b5f1bc12-cf41-4236-8649-0efd02eac5b5 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:14.211125 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b5f1bc12-cf41-4236-8649-0efd02eac5b5 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:14.211944 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b5f1bc12-cf41-4236-8649-0efd02eac5b5 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:14.214813 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b5f1bc12-cf41-4236-8649-0efd02eac5b5 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:14.215677 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b5f1bc12-cf41-4236-8649-0efd02eac5b5 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:14.216881 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b5f1bc12-cf41-4236-8649-0efd02eac5b5 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:14.298737 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b5f1bc12-cf41-4236-8649-0efd02eac5b5 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:14.299220 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b5f1bc12-cf41-4236-8649-0efd02eac5b5 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:14.299795 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b5f1bc12-cf41-4236-8649-0efd02eac5b5 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:14.300346 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-b5f1bc12-cf41-4236-8649-0efd02eac5b5 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lazy-loading 'fault' on Instance uuid 32192367-aeac-41db-8669-4f3611612ad8 {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:16:14.430684 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b5f1bc12-cf41-4236-8649-0efd02eac5b5 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860ac4e423cf410d9bbc354c77ba864c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aada201b2fd64fdc81a69f826e7c607b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:14.453865 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b5f1bc12-cf41-4236-8649-0efd02eac5b5 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] 10.222.0.61 "GET /compute/v2.1/servers/32192367-aeac-41db-8669-4f3611612ad8" status: 200 len: 1303 microversion: 2.1 time: 0.263854 Aug 31 16:16:14.455623 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2198/4394] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:14 2022] GET /compute/v2.1/servers/32192367-aeac-41db-8669-4f3611612ad8 => generated 1303 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:14.519960 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a977f72d-2ab7-4ff6-b7ff-223d97281c77 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:14.520606 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a977f72d-2ab7-4ff6-b7ff-223d97281c77 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] [instance: fa0932e8-1aa4-4d1a-b653-14be35568f3d] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:14.537528 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a977f72d-2ab7-4ff6-b7ff-223d97281c77 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:14.541068 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a977f72d-2ab7-4ff6-b7ff-223d97281c77 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:14.542845 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a977f72d-2ab7-4ff6-b7ff-223d97281c77 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:14.544362 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a977f72d-2ab7-4ff6-b7ff-223d97281c77 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:14.545508 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a977f72d-2ab7-4ff6-b7ff-223d97281c77 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:14.546454 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a977f72d-2ab7-4ff6-b7ff-223d97281c77 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:14.962041 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a977f72d-2ab7-4ff6-b7ff-223d97281c77 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:14.992813 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a977f72d-2ab7-4ff6-b7ff-223d97281c77 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:14.996739 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a977f72d-2ab7-4ff6-b7ff-223d97281c77 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:15.002833 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a977f72d-2ab7-4ff6-b7ff-223d97281c77 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] 10.222.0.61 "GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d" status: 200 len: 1604 microversion: 2.32 time: 0.490883 Aug 31 16:16:15.019736 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2199/4395] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:16:14 2022] GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d => generated 1604 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:16:15.019736 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-81929088-9e2d-47ac-9692-e428e1799018 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:15.019736 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-81929088-9e2d-47ac-9692-e428e1799018 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] [instance: 8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:15.038374 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-81929088-9e2d-47ac-9692-e428e1799018 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:15.039612 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-81929088-9e2d-47ac-9692-e428e1799018 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:15.041385 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-81929088-9e2d-47ac-9692-e428e1799018 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:15.042258 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-81929088-9e2d-47ac-9692-e428e1799018 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:15.046223 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-81929088-9e2d-47ac-9692-e428e1799018 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:15.048696 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-81929088-9e2d-47ac-9692-e428e1799018 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:16.084630 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-81929088-9e2d-47ac-9692-e428e1799018 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09abc9573e94951b69e871170cbcf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc0aa4c03f84f5691d4e7b8c5da75e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:16.098032 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-81929088-9e2d-47ac-9692-e428e1799018 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] 10.222.0.61 "GET /compute/v2.1/servers/8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21" status: 200 len: 1328 microversion: 2.1 time: 1.089795 Aug 31 16:16:16.098396 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2200/4396] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:15 2022] GET /compute/v2.1/servers/8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21 => generated 1328 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:16.115775 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-21302ebb-ee53-4a6c-9c46-39ba048d8606 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:16.116418 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-21302ebb-ee53-4a6c-9c46-39ba048d8606 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] [instance: 32192367-aeac-41db-8669-4f3611612ad8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:16.131263 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-21302ebb-ee53-4a6c-9c46-39ba048d8606 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:16.132143 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-21302ebb-ee53-4a6c-9c46-39ba048d8606 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:16.132742 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-21302ebb-ee53-4a6c-9c46-39ba048d8606 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:16.133774 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-21302ebb-ee53-4a6c-9c46-39ba048d8606 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:16.134394 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-21302ebb-ee53-4a6c-9c46-39ba048d8606 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:16.143661 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-21302ebb-ee53-4a6c-9c46-39ba048d8606 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:16.175826 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-21302ebb-ee53-4a6c-9c46-39ba048d8606 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] HTTP exception thrown: Instance 32192367-aeac-41db-8669-4f3611612ad8 could not be found. Aug 31 16:16:16.180556 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-21302ebb-ee53-4a6c-9c46-39ba048d8606 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Request method failure captured: Aug 31 16:16:16.180556 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/32192367-aeac-41db-8669-4f3611612ad8 HTTP/1.1 Aug 31 16:16:16.180556 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:16:16.180556 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:16:16.180556 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:16:16.180556 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:16:16.180556 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:16:16.180556 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:16:16.180556 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:16:16.180556 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:16:16.180556 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4jh2cLL9PyKqIDaLUuGdlir4zNr-WSNFs6WawJIF6lQvbO50QOdA1i_zk3b5cz_0EU7fu1GgcjfYn-PicIMoMNhd0PvpbUd_2WXjTNiTLZrS2pSMlXm-I_qeMHnHjwTM-mAUN8vF4LVqJBdMAu6R9hvSd_Qz_zwHY66WKZn6eV6pBI Aug 31 16:16:16.180556 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:16:16.180556 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:16:16.180556 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:16:16.180556 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:16:16.180556 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:16:16.180556 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:16:16.180556 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: aada201b2fd64fdc81a69f826e7c607b Aug 31 16:16:16.180556 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ServersTestMultiNic-285520906 Aug 31 16:16:16.180556 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:16:16.180556 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:16:16.180556 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/aada201b2fd64fdc81a69f826e7c607b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/aada201b2fd64fdc81a69f826e7c607b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_aada201b2fd64fdc81a69f826e7c607b", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/aada201b2fd64fdc81a69f826e7c607b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:16:16.180556 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ServersTestMultiNic-285520906 Aug 31 16:16:16.180556 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: aada201b2fd64fdc81a69f826e7c607b Aug 31 16:16:16.180556 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ServersTestMultiNic-285520906 Aug 31 16:16:16.180556 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ServersTestMultiNic-285520906-project Aug 31 16:16:16.180556 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:16:16.180556 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:16:16.180556 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 860ac4e423cf410d9bbc354c77ba864c Aug 31 16:16:16.180556 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ServersTestMultiNic-285520906-project Aug 31 16:16:16.180556 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:16:16.180556 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance 32192367-aeac-41db-8669-4f3611612ad8 could not be found. Aug 31 16:16:16.180556 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '32192367-aeac-41db-8669-4f3611612ad8'} Aug 31 16:16:16.180556 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:16:16.180556 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:16.180556 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:16:16.180556 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:16:16.180556 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:16:16.180556 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:16:16.180556 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:16:16.180556 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:16:16.180556 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:16:16.180556 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:16:16.180556 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32192367-aeac-41db-8669-4f3611612ad8 could not be found. Aug 31 16:16:16.180556 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:16:16.180556 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:16.180556 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:16:16.180556 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:16.180556 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:16.180556 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:16.180556 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:16:16.180556 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:16:16.180556 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:16:16.180556 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:16:16.180556 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:16:16.180556 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:16:16.180556 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:16:16.180556 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:16:16.180556 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:16:16.180556 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:16:16.180556 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32192367-aeac-41db-8669-4f3611612ad8 could not be found. Aug 31 16:16:16.180556 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:16:16.180556 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:16.180556 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:16:16.184227 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:16.184227 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:16.184227 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:16.184227 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:16:16.184227 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:16:16.184227 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32192367-aeac-41db-8669-4f3611612ad8 could not be found. Aug 31 16:16:16.184227 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:16:16.185989 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-21302ebb-ee53-4a6c-9c46-39ba048d8606 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Returning 404 to user: Instance 32192367-aeac-41db-8669-4f3611612ad8 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:16:16.188491 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-21302ebb-ee53-4a6c-9c46-39ba048d8606 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] 10.222.0.61 "GET /compute/v2.1/servers/32192367-aeac-41db-8669-4f3611612ad8" status: 404 len: 111 microversion: 2.1 time: 0.088781 Aug 31 16:16:16.192378 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2201/4397] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:16 2022] GET /compute/v2.1/servers/32192367-aeac-41db-8669-4f3611612ad8 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:16:16.205244 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-17da3f1f-a5a4-42af-9cb6-d6f365453e5e tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:16.207858 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-17da3f1f-a5a4-42af-9cb6-d6f365453e5e tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] [instance: fa0932e8-1aa4-4d1a-b653-14be35568f3d] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:16.222994 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-17da3f1f-a5a4-42af-9cb6-d6f365453e5e tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:16.223526 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-17da3f1f-a5a4-42af-9cb6-d6f365453e5e tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:16.228165 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-17da3f1f-a5a4-42af-9cb6-d6f365453e5e tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:16.229271 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-17da3f1f-a5a4-42af-9cb6-d6f365453e5e tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:16.229994 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-17da3f1f-a5a4-42af-9cb6-d6f365453e5e tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:16.236288 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-17da3f1f-a5a4-42af-9cb6-d6f365453e5e tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:16.286280 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-b0f94861-1bec-4ca6-b882-a8d235fcfe2d tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:16:16.286874 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-b0f94861-1bec-4ca6-b882-a8d235fcfe2d tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:16:16.287269 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-b0f94861-1bec-4ca6-b882-a8d235fcfe2d tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:16:16.287966 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-b0f94861-1bec-4ca6-b882-a8d235fcfe2d tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:16:16.288636 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-b0f94861-1bec-4ca6-b882-a8d235fcfe2d tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:16:16.310137 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b0f94861-1bec-4ca6-b882-a8d235fcfe2d tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:16.311017 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b0f94861-1bec-4ca6-b882-a8d235fcfe2d tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:16.311728 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b0f94861-1bec-4ca6-b882-a8d235fcfe2d tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:16.312911 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b0f94861-1bec-4ca6-b882-a8d235fcfe2d tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:16.314705 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b0f94861-1bec-4ca6-b882-a8d235fcfe2d tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:16.315054 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b0f94861-1bec-4ca6-b882-a8d235fcfe2d tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:16.359212 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-b0f94861-1bec-4ca6-b882-a8d235fcfe2d tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Getting quotas for project 62d2222a956a4888967e21647e26b310. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:16:16.367316 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-b0f94861-1bec-4ca6-b882-a8d235fcfe2d tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Getting quotas for user fb261f2061164b49a8d496b16647dd2c and project 62d2222a956a4888967e21647e26b310. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:16:16.384877 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b0f94861-1bec-4ca6-b882-a8d235fcfe2d tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Going to run 1 instances... {{(pid=122256) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:16:16.397799 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b0f94861-1bec-4ca6-b882-a8d235fcfe2d tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: 9b9170ad-8804-4603-b35b-f7a3d2c4af62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:16:16.436830 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-17da3f1f-a5a4-42af-9cb6-d6f365453e5e tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:16.479446 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-17da3f1f-a5a4-42af-9cb6-d6f365453e5e tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:16.483712 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-17da3f1f-a5a4-42af-9cb6-d6f365453e5e tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:16.490121 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-17da3f1f-a5a4-42af-9cb6-d6f365453e5e tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] 10.222.0.61 "GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d" status: 200 len: 1604 microversion: 2.32 time: 0.294510 Aug 31 16:16:16.494028 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2202/4398] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:16:16 2022] GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d => generated 1604 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:16:16.503939 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b0f94861-1bec-4ca6-b882-a8d235fcfe2d tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.321877 Aug 31 16:16:16.515529 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2197/4399] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:16:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 3334 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:16:16.519819 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b2c97b5d-340d-4b44-8ffd-941516ce8dbd tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:16.520463 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b2c97b5d-340d-4b44-8ffd-941516ce8dbd tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: 9b9170ad-8804-4603-b35b-f7a3d2c4af62] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:16.800787 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b2c97b5d-340d-4b44-8ffd-941516ce8dbd tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb261f2061164b49a8d496b16647dd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d2222a956a4888967e21647e26b310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:16.817787 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b2c97b5d-340d-4b44-8ffd-941516ce8dbd tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "GET /compute/v2.1/servers/9b9170ad-8804-4603-b35b-f7a3d2c4af62" status: 200 len: 1217 microversion: 2.1 time: 0.302826 Aug 31 16:16:16.818418 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2203/4400] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:16 2022] GET /compute/v2.1/servers/9b9170ad-8804-4603-b35b-f7a3d2c4af62 => generated 1217 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:17.136704 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-53643044-bc18-418d-a86c-916f16896a31 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:17.141787 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-53643044-bc18-418d-a86c-916f16896a31 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] [instance: 8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:17.181951 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-53643044-bc18-418d-a86c-916f16896a31 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:17.186322 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-53643044-bc18-418d-a86c-916f16896a31 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:17.198418 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-53643044-bc18-418d-a86c-916f16896a31 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:17.212165 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-53643044-bc18-418d-a86c-916f16896a31 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:17.213411 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-53643044-bc18-418d-a86c-916f16896a31 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:17.221437 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-53643044-bc18-418d-a86c-916f16896a31 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:17.291193 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=100 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:16:17.522954 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ac495d77-9c99-4f99-aeae-5c171ba3b27a tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:17.524148 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ac495d77-9c99-4f99-aeae-5c171ba3b27a tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] [instance: fa0932e8-1aa4-4d1a-b653-14be35568f3d] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:17.541748 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ac495d77-9c99-4f99-aeae-5c171ba3b27a tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:17.541748 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ac495d77-9c99-4f99-aeae-5c171ba3b27a tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:17.542102 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ac495d77-9c99-4f99-aeae-5c171ba3b27a tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:17.551899 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ac495d77-9c99-4f99-aeae-5c171ba3b27a tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:17.552672 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ac495d77-9c99-4f99-aeae-5c171ba3b27a tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:17.553272 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ac495d77-9c99-4f99-aeae-5c171ba3b27a tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:18.021647 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ac495d77-9c99-4f99-aeae-5c171ba3b27a tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:18.039328 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ac495d77-9c99-4f99-aeae-5c171ba3b27a tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:18.040853 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ac495d77-9c99-4f99-aeae-5c171ba3b27a tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:18.042080 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ac495d77-9c99-4f99-aeae-5c171ba3b27a tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] 10.222.0.61 "GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d" status: 200 len: 1604 microversion: 2.32 time: 0.524108 Aug 31 16:16:18.064750 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2204/4401] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:16:17 2022] GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d => generated 1604 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:16:18.073133 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a7866205-b971-4848-936e-a652b4bb362c tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:18.074052 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a7866205-b971-4848-936e-a652b4bb362c tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: 9b9170ad-8804-4603-b35b-f7a3d2c4af62] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:18.080442 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-53643044-bc18-418d-a86c-916f16896a31 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09abc9573e94951b69e871170cbcf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc0aa4c03f84f5691d4e7b8c5da75e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:18.095719 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a7866205-b971-4848-936e-a652b4bb362c tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:18.097351 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a7866205-b971-4848-936e-a652b4bb362c tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:18.098499 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a7866205-b971-4848-936e-a652b4bb362c tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:18.106790 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a7866205-b971-4848-936e-a652b4bb362c tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:18.107364 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a7866205-b971-4848-936e-a652b4bb362c tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:18.108386 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-53643044-bc18-418d-a86c-916f16896a31 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] 10.222.0.61 "GET /compute/v2.1/servers/8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21" status: 200 len: 1328 microversion: 2.1 time: 0.981683 Aug 31 16:16:18.108943 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a7866205-b971-4848-936e-a652b4bb362c tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:18.119892 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2198/4402] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:17 2022] GET /compute/v2.1/servers/8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21 => generated 1328 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:18.328815 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a7866205-b971-4848-936e-a652b4bb362c tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb261f2061164b49a8d496b16647dd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d2222a956a4888967e21647e26b310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:18.341574 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a7866205-b971-4848-936e-a652b4bb362c tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "GET /compute/v2.1/servers/9b9170ad-8804-4603-b35b-f7a3d2c4af62" status: 200 len: 1213 microversion: 2.1 time: 0.275364 Aug 31 16:16:18.354688 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2205/4403] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:18 2022] GET /compute/v2.1/servers/9b9170ad-8804-4603-b35b-f7a3d2c4af62 => generated 1213 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:18.665595 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-99ffb9c6-9bfc-4f82-8378-157c9703658b req-b882614b-ee5c-4db2-9d49-56dbf678c01d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4ef985e-0861-4c5d-88eb-d8ad053a8f54", "name": "network-vif-deleted", "tag": "e616625c-3e6f-4ab3-a8fe-75faeba8be2a"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:16:18.695086 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-99ffb9c6-9bfc-4f82-8378-157c9703658b req-b882614b-ee5c-4db2-9d49-56dbf678c01d service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:18.696306 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-99ffb9c6-9bfc-4f82-8378-157c9703658b req-b882614b-ee5c-4db2-9d49-56dbf678c01d service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:18.697722 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-99ffb9c6-9bfc-4f82-8378-157c9703658b req-b882614b-ee5c-4db2-9d49-56dbf678c01d service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:18.729617 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-99ffb9c6-9bfc-4f82-8378-157c9703658b req-b882614b-ee5c-4db2-9d49-56dbf678c01d service nova] Creating event network-vif-deleted:e616625c-3e6f-4ab3-a8fe-75faeba8be2a for instance c4ef985e-0861-4c5d-88eb-d8ad053a8f54 on n-h1-850499-9 Aug 31 16:16:18.742674 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-99ffb9c6-9bfc-4f82-8378-157c9703658b req-b882614b-ee5c-4db2-9d49-56dbf678c01d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082851 Aug 31 16:16:18.745624 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2199/4404] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:16:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:16:19.081702 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-843732d0-bb44-4f94-a409-3a5b48f7e5e5 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:19.082522 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-843732d0-bb44-4f94-a409-3a5b48f7e5e5 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] [instance: fa0932e8-1aa4-4d1a-b653-14be35568f3d] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:19.122266 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-843732d0-bb44-4f94-a409-3a5b48f7e5e5 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:19.122840 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-843732d0-bb44-4f94-a409-3a5b48f7e5e5 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:19.123318 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-843732d0-bb44-4f94-a409-3a5b48f7e5e5 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:19.124443 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-843732d0-bb44-4f94-a409-3a5b48f7e5e5 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:19.125088 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-843732d0-bb44-4f94-a409-3a5b48f7e5e5 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:19.135963 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-843732d0-bb44-4f94-a409-3a5b48f7e5e5 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:19.142380 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d09642f9-cfd7-4356-951d-1dc4e53756b9 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:19.143462 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d09642f9-cfd7-4356-951d-1dc4e53756b9 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] [instance: 8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:19.169391 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d09642f9-cfd7-4356-951d-1dc4e53756b9 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:19.171421 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d09642f9-cfd7-4356-951d-1dc4e53756b9 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:19.172932 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d09642f9-cfd7-4356-951d-1dc4e53756b9 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:19.184859 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d09642f9-cfd7-4356-951d-1dc4e53756b9 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:19.185798 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d09642f9-cfd7-4356-951d-1dc4e53756b9 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:19.186579 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d09642f9-cfd7-4356-951d-1dc4e53756b9 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:19.862753 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-843732d0-bb44-4f94-a409-3a5b48f7e5e5 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:19.932144 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-843732d0-bb44-4f94-a409-3a5b48f7e5e5 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:19.934610 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-843732d0-bb44-4f94-a409-3a5b48f7e5e5 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51c2d1cf18074bfda706dc2d5713b4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e7010151a7457b9ff7574126683b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:19.936099 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-843732d0-bb44-4f94-a409-3a5b48f7e5e5 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] 10.222.0.61 "GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d" status: 200 len: 1604 microversion: 2.32 time: 0.862971 Aug 31 16:16:19.938296 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2206/4405] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:16:19 2022] GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d => generated 1604 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:16:19.944116 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-990da83d-3189-431a-9e74-44d366edceca tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:19.945114 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-990da83d-3189-431a-9e74-44d366edceca tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: 9b9170ad-8804-4603-b35b-f7a3d2c4af62] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:19.955603 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-990da83d-3189-431a-9e74-44d366edceca tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:19.956555 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-990da83d-3189-431a-9e74-44d366edceca tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:19.957224 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-990da83d-3189-431a-9e74-44d366edceca tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:19.958198 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-990da83d-3189-431a-9e74-44d366edceca tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:19.961412 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-990da83d-3189-431a-9e74-44d366edceca tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:19.962252 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-990da83d-3189-431a-9e74-44d366edceca tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:20.155024 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d09642f9-cfd7-4356-951d-1dc4e53756b9 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09abc9573e94951b69e871170cbcf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc0aa4c03f84f5691d4e7b8c5da75e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:20.203619 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d09642f9-cfd7-4356-951d-1dc4e53756b9 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] 10.222.0.61 "GET /compute/v2.1/servers/8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21" status: 200 len: 1328 microversion: 2.1 time: 1.064471 Aug 31 16:16:20.222620 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2200/4406] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:19 2022] GET /compute/v2.1/servers/8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21 => generated 1328 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:20.234508 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-990da83d-3189-431a-9e74-44d366edceca tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb261f2061164b49a8d496b16647dd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d2222a956a4888967e21647e26b310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:20.271400 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-990da83d-3189-431a-9e74-44d366edceca tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "GET /compute/v2.1/servers/9b9170ad-8804-4603-b35b-f7a3d2c4af62" status: 200 len: 1275 microversion: 2.1 time: 0.330239 Aug 31 16:16:20.283791 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2207/4407] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:19 2022] GET /compute/v2.1/servers/9b9170ad-8804-4603-b35b-f7a3d2c4af62 => generated 1275 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:20.783221 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-f0b47d4c-4940-431d-825e-b6d794d255c1 req-665c7e8f-2826-47f5-bb9d-79746d8f89ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21", "tag": "8aa3dc6a-0289-4f40-b5a9-892ca074cf0d"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:16:20.803939 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-f0b47d4c-4940-431d-825e-b6d794d255c1 req-665c7e8f-2826-47f5-bb9d-79746d8f89ce service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:20.804668 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-f0b47d4c-4940-431d-825e-b6d794d255c1 req-665c7e8f-2826-47f5-bb9d-79746d8f89ce service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:20.812368 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-f0b47d4c-4940-431d-825e-b6d794d255c1 req-665c7e8f-2826-47f5-bb9d-79746d8f89ce service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:20.830285 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-f0b47d4c-4940-431d-825e-b6d794d255c1 req-665c7e8f-2826-47f5-bb9d-79746d8f89ce service nova] Creating event network-changed:8aa3dc6a-0289-4f40-b5a9-892ca074cf0d for instance 8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21 on n-h2-850499-9 Aug 31 16:16:20.836529 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-f0b47d4c-4940-431d-825e-b6d794d255c1 req-665c7e8f-2826-47f5-bb9d-79746d8f89ce service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057093 Aug 31 16:16:20.839117 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2201/4408] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:16:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:16:20.970212 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3a2f2595-55c5-44d3-9923-afdd15750987 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:20.971100 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3a2f2595-55c5-44d3-9923-afdd15750987 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] [instance: fa0932e8-1aa4-4d1a-b653-14be35568f3d] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:20.985503 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3a2f2595-55c5-44d3-9923-afdd15750987 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:20.986060 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3a2f2595-55c5-44d3-9923-afdd15750987 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:20.986521 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3a2f2595-55c5-44d3-9923-afdd15750987 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:20.987277 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3a2f2595-55c5-44d3-9923-afdd15750987 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:20.990553 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3a2f2595-55c5-44d3-9923-afdd15750987 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:20.992256 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3a2f2595-55c5-44d3-9923-afdd15750987 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:21.027210 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-3a2f2595-55c5-44d3-9923-afdd15750987 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] HTTP exception thrown: Instance fa0932e8-1aa4-4d1a-b653-14be35568f3d could not be found. Aug 31 16:16:21.035814 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3a2f2595-55c5-44d3-9923-afdd15750987 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Request method failure captured: Aug 31 16:16:21.035814 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d HTTP/1.1 Aug 31 16:16:21.035814 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:16:21.035814 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:16:21.035814 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:16:21.035814 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:16:21.035814 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:16:21.035814 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:16:21.035814 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:16:21.035814 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:16:21.035814 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4eSNKrxXiQsYgH2l5iloXmDd-LUH_jMXH-6Yin9uj-RxVmADOPBKBL0tRR0yQoSUC83bkN_vZmO0oaKf07rxDpnidHOCl5EkJgFnwXipodLJHW-vc71rrdRGeoXRDqRPB2VJqOpdqVPRbvmXIyGj3TVBFObra9Q8ieYBj2Cp-0Cyss Aug 31 16:16:21.035814 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:16:21.035814 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:16:21.035814 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:16:21.035814 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:16:21.035814 n-d-850499-9 devstack@n-api.service[122257]: X-Openstack-Nova-Api-Version: 2.32 Aug 31 16:16:21.035814 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:16:21.035814 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:16:21.035814 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 68e7010151a7457b9ff7574126683b32 Aug 31 16:16:21.035814 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-TaggedBootDevicesTest-953904043 Aug 31 16:16:21.035814 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:16:21.035814 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:16:21.035814 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/68e7010151a7457b9ff7574126683b32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/68e7010151a7457b9ff7574126683b32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_68e7010151a7457b9ff7574126683b32", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/68e7010151a7457b9ff7574126683b32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:16:21.035814 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-TaggedBootDevicesTest-953904043 Aug 31 16:16:21.035814 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 68e7010151a7457b9ff7574126683b32 Aug 31 16:16:21.035814 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-TaggedBootDevicesTest-953904043 Aug 31 16:16:21.035814 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-TaggedBootDevicesTest-953904043-project Aug 31 16:16:21.035814 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:16:21.035814 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:16:21.035814 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 51c2d1cf18074bfda706dc2d5713b4f2 Aug 31 16:16:21.035814 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-TaggedBootDevicesTest-953904043-project Aug 31 16:16:21.035814 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:16:21.035814 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance fa0932e8-1aa4-4d1a-b653-14be35568f3d could not be found. Aug 31 16:16:21.035814 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': 'fa0932e8-1aa4-4d1a-b653-14be35568f3d'} Aug 31 16:16:21.035814 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:16:21.035814 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:21.035814 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:16:21.035814 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:16:21.035814 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:16:21.035814 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:16:21.035814 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:16:21.035814 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:16:21.035814 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:16:21.035814 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:16:21.035814 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa0932e8-1aa4-4d1a-b653-14be35568f3d could not be found. Aug 31 16:16:21.035814 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:16:21.035814 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:21.035814 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:16:21.035814 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:21.035814 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:21.035814 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:21.035814 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:16:21.035814 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:16:21.035814 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:16:21.035814 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:16:21.035814 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:16:21.035814 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:16:21.035814 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:16:21.035814 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:16:21.035814 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:16:21.035814 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:16:21.035814 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa0932e8-1aa4-4d1a-b653-14be35568f3d could not be found. Aug 31 16:16:21.035814 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:16:21.035814 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:21.035814 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:16:21.040903 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:21.040903 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:21.040903 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:21.040903 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:16:21.040903 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:16:21.040903 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa0932e8-1aa4-4d1a-b653-14be35568f3d could not be found. Aug 31 16:16:21.040903 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:16:21.040903 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3a2f2595-55c5-44d3-9923-afdd15750987 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Returning 404 to user: Instance fa0932e8-1aa4-4d1a-b653-14be35568f3d could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:16:21.045586 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3a2f2595-55c5-44d3-9923-afdd15750987 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] 10.222.0.61 "GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d" status: 404 len: 111 microversion: 2.32 time: 0.081162 Aug 31 16:16:21.054622 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2208/4409] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:16:20 2022] GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:16:21.061432 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f631ad33-9f4a-4c7e-b08f-4b8e23c6c518 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Calling method '.version_select at 0x7f5ae3ec33a0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:21.099018 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f631ad33-9f4a-4c7e-b08f-4b8e23c6c518 tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1688734994" status: 204 len: 0 microversion: 2.32 time: 0.042031 Aug 31 16:16:21.104396 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2202/4410] 10.222.0.61 () {60 vars in 1262 bytes} [Wed Aug 31 16:16:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1688734994 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 31 16:16:21.231039 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5115d03d-13b4-4b09-98e7-fb324d0beed0 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:21.231886 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5115d03d-13b4-4b09-98e7-fb324d0beed0 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] [instance: 8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:21.242205 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5115d03d-13b4-4b09-98e7-fb324d0beed0 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:21.243708 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5115d03d-13b4-4b09-98e7-fb324d0beed0 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:21.245095 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5115d03d-13b4-4b09-98e7-fb324d0beed0 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:21.246057 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5115d03d-13b4-4b09-98e7-fb324d0beed0 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:21.246750 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5115d03d-13b4-4b09-98e7-fb324d0beed0 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:21.247871 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5115d03d-13b4-4b09-98e7-fb324d0beed0 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:21.297588 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-761619cd-5e7f-4cc4-9381-c164ef89555d tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:21.300152 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-761619cd-5e7f-4cc4-9381-c164ef89555d tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: 9b9170ad-8804-4603-b35b-f7a3d2c4af62] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:21.342108 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-761619cd-5e7f-4cc4-9381-c164ef89555d tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:21.343978 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-761619cd-5e7f-4cc4-9381-c164ef89555d tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:21.345280 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-761619cd-5e7f-4cc4-9381-c164ef89555d tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:21.351408 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-761619cd-5e7f-4cc4-9381-c164ef89555d tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:21.352788 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-761619cd-5e7f-4cc4-9381-c164ef89555d tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:21.353824 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-761619cd-5e7f-4cc4-9381-c164ef89555d tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:22.326840 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5115d03d-13b4-4b09-98e7-fb324d0beed0 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09abc9573e94951b69e871170cbcf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc0aa4c03f84f5691d4e7b8c5da75e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:22.370078 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-761619cd-5e7f-4cc4-9381-c164ef89555d tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb261f2061164b49a8d496b16647dd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d2222a956a4888967e21647e26b310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:22.381486 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-761619cd-5e7f-4cc4-9381-c164ef89555d tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "GET /compute/v2.1/servers/9b9170ad-8804-4603-b35b-f7a3d2c4af62" status: 200 len: 1317 microversion: 2.1 time: 1.088239 Aug 31 16:16:22.383475 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2203/4411] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:21 2022] GET /compute/v2.1/servers/9b9170ad-8804-4603-b35b-f7a3d2c4af62 => generated 1317 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:22.384426 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5115d03d-13b4-4b09-98e7-fb324d0beed0 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] 10.222.0.61 "GET /compute/v2.1/servers/8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21" status: 200 len: 1328 microversion: 2.1 time: 1.161843 Aug 31 16:16:22.390006 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2209/4412] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:21 2022] GET /compute/v2.1/servers/8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21 => generated 1328 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:22.722192 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-922836f1-db74-49e6-ad54-05e93d8c2202 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-2011994577", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "networks": [{"uuid": "9d68561a-1591-4401-9391-9c95215b56e4"}]}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:16:22.871540 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-922836f1-db74-49e6-ad54-05e93d8c2202 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] validate_networks() for [('9d68561a-1591-4401-9391-9c95215b56e4', None, None, None, None, None)] {{(pid=122256) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:16:23.409635 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c81ddb32-1aa4-406b-821c-cdce39a323af tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:23.410542 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c81ddb32-1aa4-406b-821c-cdce39a323af tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: 9b9170ad-8804-4603-b35b-f7a3d2c4af62] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:23.435785 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c81ddb32-1aa4-406b-821c-cdce39a323af tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:23.440596 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c81ddb32-1aa4-406b-821c-cdce39a323af tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:23.441514 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c81ddb32-1aa4-406b-821c-cdce39a323af tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:23.446661 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c81ddb32-1aa4-406b-821c-cdce39a323af tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:23.450264 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c81ddb32-1aa4-406b-821c-cdce39a323af tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:23.451587 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c81ddb32-1aa4-406b-821c-cdce39a323af tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:24.128757 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c81ddb32-1aa4-406b-821c-cdce39a323af tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb261f2061164b49a8d496b16647dd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d2222a956a4888967e21647e26b310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:24.148002 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c81ddb32-1aa4-406b-821c-cdce39a323af tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "GET /compute/v2.1/servers/9b9170ad-8804-4603-b35b-f7a3d2c4af62" status: 200 len: 1317 microversion: 2.1 time: 0.743829 Aug 31 16:16:24.149305 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2210/4413] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:23 2022] GET /compute/v2.1/servers/9b9170ad-8804-4603-b35b-f7a3d2c4af62 => generated 1317 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:24.161979 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-950d70f1-ef09-452d-b5b3-98d129373e95 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:24.167134 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-950d70f1-ef09-452d-b5b3-98d129373e95 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] [instance: 8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:24.178619 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-950d70f1-ef09-452d-b5b3-98d129373e95 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:24.179802 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-950d70f1-ef09-452d-b5b3-98d129373e95 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:24.189685 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-950d70f1-ef09-452d-b5b3-98d129373e95 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:24.191365 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-950d70f1-ef09-452d-b5b3-98d129373e95 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:24.192408 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-950d70f1-ef09-452d-b5b3-98d129373e95 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:24.193381 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-950d70f1-ef09-452d-b5b3-98d129373e95 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:24.647242 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-950d70f1-ef09-452d-b5b3-98d129373e95 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09abc9573e94951b69e871170cbcf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc0aa4c03f84f5691d4e7b8c5da75e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:24.660891 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-950d70f1-ef09-452d-b5b3-98d129373e95 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] 10.222.0.61 "GET /compute/v2.1/servers/8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21" status: 200 len: 1328 microversion: 2.1 time: 0.509138 Aug 31 16:16:24.663062 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2211/4414] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:24 2022] GET /compute/v2.1/servers/8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21 => generated 1328 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:24.676159 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ab860c68-0900-4406-87d1-d06301379157 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:24.676897 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ab860c68-0900-4406-87d1-d06301379157 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] [instance: f04eb48d-000e-4c3b-8799-a4d3cdacf0e2] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:24.697876 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ab860c68-0900-4406-87d1-d06301379157 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:24.698746 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ab860c68-0900-4406-87d1-d06301379157 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:24.700265 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ab860c68-0900-4406-87d1-d06301379157 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:24.706284 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ab860c68-0900-4406-87d1-d06301379157 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:24.709482 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ab860c68-0900-4406-87d1-d06301379157 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:24.710578 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ab860c68-0900-4406-87d1-d06301379157 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:24.911181 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-ab860c68-0900-4406-87d1-d06301379157 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lazy-loading 'services' on Instance uuid f04eb48d-000e-4c3b-8799-a4d3cdacf0e2 {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:16:25.050089 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-922836f1-db74-49e6-ad54-05e93d8c2202 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:16:25.051719 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-922836f1-db74-49e6-ad54-05e93d8c2202 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:16:25.052822 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-922836f1-db74-49e6-ad54-05e93d8c2202 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:16:25.053763 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-922836f1-db74-49e6-ad54-05e93d8c2202 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:16:25.054753 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-922836f1-db74-49e6-ad54-05e93d8c2202 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:16:25.057819 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ab860c68-0900-4406-87d1-d06301379157 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] 10.222.0.61 "DELETE /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2/os-volume_attachments/349bdd50-2aed-4cb8-a78d-257ee19108c0" status: 202 len: 0 microversion: 2.1 time: 0.389953 Aug 31 16:16:25.064538 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2212/4415] 10.222.0.61 () {58 vars in 1416 bytes} [Wed Aug 31 16:16:24 2022] DELETE /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2/os-volume_attachments/349bdd50-2aed-4cb8-a78d-257ee19108c0 => generated 0 bytes in 396 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:16:25.089705 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-889e8656-88a2-49c7-a5b4-3091117016ef tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:25.091802 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-889e8656-88a2-49c7-a5b4-3091117016ef tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] [instance: 32192367-aeac-41db-8669-4f3611612ad8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:25.130988 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-889e8656-88a2-49c7-a5b4-3091117016ef tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:25.138060 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-922836f1-db74-49e6-ad54-05e93d8c2202 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:25.139325 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-922836f1-db74-49e6-ad54-05e93d8c2202 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:25.147161 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-889e8656-88a2-49c7-a5b4-3091117016ef tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:25.151208 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-889e8656-88a2-49c7-a5b4-3091117016ef tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:25.152234 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-922836f1-db74-49e6-ad54-05e93d8c2202 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:25.158077 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-922836f1-db74-49e6-ad54-05e93d8c2202 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:25.159402 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-922836f1-db74-49e6-ad54-05e93d8c2202 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:25.161512 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-922836f1-db74-49e6-ad54-05e93d8c2202 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:25.162840 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-889e8656-88a2-49c7-a5b4-3091117016ef tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:25.167453 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-889e8656-88a2-49c7-a5b4-3091117016ef tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:25.167936 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-889e8656-88a2-49c7-a5b4-3091117016ef tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:25.247570 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-889e8656-88a2-49c7-a5b4-3091117016ef tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] HTTP exception thrown: Instance 32192367-aeac-41db-8669-4f3611612ad8 could not be found. Aug 31 16:16:25.249288 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-889e8656-88a2-49c7-a5b4-3091117016ef tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Request method failure captured: Aug 31 16:16:25.249288 n-d-850499-9 devstack@n-api.service[122257]: request: DELETE /compute/v2.1/servers/32192367-aeac-41db-8669-4f3611612ad8 HTTP/1.1 Aug 31 16:16:25.249288 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:16:25.249288 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:16:25.249288 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:16:25.249288 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:16:25.249288 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:16:25.249288 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:16:25.249288 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:16:25.249288 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:16:25.249288 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4jh2cLL9PyKqIDaLUuGdlir4zNr-WSNFs6WawJIF6lQvbO50QOdA1i_zk3b5cz_0EU7fu1GgcjfYn-PicIMoMNhd0PvpbUd_2WXjTNiTLZrS2pSMlXm-I_qeMHnHjwTM-mAUN8vF4LVqJBdMAu6R9hvSd_Qz_zwHY66WKZn6eV6pBI Aug 31 16:16:25.249288 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:16:25.249288 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:16:25.249288 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:16:25.249288 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:16:25.249288 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:16:25.249288 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:16:25.249288 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: aada201b2fd64fdc81a69f826e7c607b Aug 31 16:16:25.249288 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ServersTestMultiNic-285520906 Aug 31 16:16:25.249288 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:16:25.249288 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:16:25.249288 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/aada201b2fd64fdc81a69f826e7c607b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/aada201b2fd64fdc81a69f826e7c607b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_aada201b2fd64fdc81a69f826e7c607b", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/aada201b2fd64fdc81a69f826e7c607b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:16:25.249288 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ServersTestMultiNic-285520906 Aug 31 16:16:25.249288 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: aada201b2fd64fdc81a69f826e7c607b Aug 31 16:16:25.249288 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ServersTestMultiNic-285520906 Aug 31 16:16:25.249288 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ServersTestMultiNic-285520906-project Aug 31 16:16:25.249288 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:16:25.249288 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:16:25.249288 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 860ac4e423cf410d9bbc354c77ba864c Aug 31 16:16:25.249288 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ServersTestMultiNic-285520906-project Aug 31 16:16:25.249288 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:16:25.249288 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance 32192367-aeac-41db-8669-4f3611612ad8 could not be found. Aug 31 16:16:25.249288 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '32192367-aeac-41db-8669-4f3611612ad8'} Aug 31 16:16:25.249288 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:16:25.249288 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:25.249288 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:16:25.249288 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:16:25.249288 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:16:25.249288 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:16:25.249288 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:16:25.249288 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:16:25.249288 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:16:25.249288 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:16:25.249288 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32192367-aeac-41db-8669-4f3611612ad8 could not be found. Aug 31 16:16:25.249288 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:16:25.249288 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:25.249288 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:16:25.249288 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:25.249288 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:25.249288 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:25.249288 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:16:25.249288 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:16:25.249288 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:16:25.249288 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:16:25.249288 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:16:25.249288 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:16:25.249288 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:16:25.249288 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:16:25.249288 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:16:25.249288 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:16:25.249288 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:16:25.249288 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:16:25.252507 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32192367-aeac-41db-8669-4f3611612ad8 could not be found. Aug 31 16:16:25.252507 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:16:25.252507 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:25.252507 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:16:25.252507 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:25.252507 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:25.252507 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:25.252507 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:16:25.252507 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:16:25.252507 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32192367-aeac-41db-8669-4f3611612ad8 could not be found. Aug 31 16:16:25.252507 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:16:25.254017 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-889e8656-88a2-49c7-a5b4-3091117016ef tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Returning 404 to user: Instance 32192367-aeac-41db-8669-4f3611612ad8 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:16:25.255194 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-889e8656-88a2-49c7-a5b4-3091117016ef tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] 10.222.0.61 "DELETE /compute/v2.1/servers/32192367-aeac-41db-8669-4f3611612ad8" status: 404 len: 111 microversion: 2.1 time: 0.193550 Aug 31 16:16:25.256927 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2213/4416] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:16:25 2022] DELETE /compute/v2.1/servers/32192367-aeac-41db-8669-4f3611612ad8 => generated 111 bytes in 197 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:16:25.262412 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-922836f1-db74-49e6-ad54-05e93d8c2202 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Getting quotas for project 25e974933e564e5da170dfe26fe921c3. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:16:25.269558 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-772e38ee-dafb-4d88-b87b-cf2b8a57d36f tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:25.270188 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-772e38ee-dafb-4d88-b87b-cf2b8a57d36f tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: 9b9170ad-8804-4603-b35b-f7a3d2c4af62] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:25.309307 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-772e38ee-dafb-4d88-b87b-cf2b8a57d36f tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:25.317020 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-772e38ee-dafb-4d88-b87b-cf2b8a57d36f tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:25.317723 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-772e38ee-dafb-4d88-b87b-cf2b8a57d36f tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:25.319046 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-772e38ee-dafb-4d88-b87b-cf2b8a57d36f tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:25.320297 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-772e38ee-dafb-4d88-b87b-cf2b8a57d36f tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:25.320884 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-772e38ee-dafb-4d88-b87b-cf2b8a57d36f tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:25.330289 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-922836f1-db74-49e6-ad54-05e93d8c2202 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Getting quotas for user a598a2bec3e34c239c9fad419545eb52 and project 25e974933e564e5da170dfe26fe921c3. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:16:25.379006 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:16:25.394581 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-922836f1-db74-49e6-ad54-05e93d8c2202 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Going to run 1 instances... {{(pid=122256) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:16:25.419089 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-922836f1-db74-49e6-ad54-05e93d8c2202 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] [instance: 0807b71a-b3ab-4bad-a3b4-a00fc39dedb6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:16:25.575597 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-922836f1-db74-49e6-ad54-05e93d8c2202 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.188828 Aug 31 16:16:25.576705 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2204/4417] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:16:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 3192 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:16:25.587488 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-cc038014-28af-4ee0-af67-e7121b92caf8 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:25.588851 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-cc038014-28af-4ee0-af67-e7121b92caf8 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] [instance: 32192367-aeac-41db-8669-4f3611612ad8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:25.601378 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cc038014-28af-4ee0-af67-e7121b92caf8 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:25.602738 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cc038014-28af-4ee0-af67-e7121b92caf8 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:25.603871 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cc038014-28af-4ee0-af67-e7121b92caf8 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:25.605483 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cc038014-28af-4ee0-af67-e7121b92caf8 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:25.606457 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cc038014-28af-4ee0-af67-e7121b92caf8 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:25.607258 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cc038014-28af-4ee0-af67-e7121b92caf8 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:25.669393 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-cc038014-28af-4ee0-af67-e7121b92caf8 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] HTTP exception thrown: Instance 32192367-aeac-41db-8669-4f3611612ad8 could not be found. Aug 31 16:16:25.676632 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-cc038014-28af-4ee0-af67-e7121b92caf8 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Request method failure captured: Aug 31 16:16:25.676632 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/32192367-aeac-41db-8669-4f3611612ad8 HTTP/1.1 Aug 31 16:16:25.676632 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:16:25.676632 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:16:25.676632 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:16:25.676632 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:16:25.676632 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:16:25.676632 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:16:25.676632 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:16:25.676632 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:16:25.676632 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4jh2cLL9PyKqIDaLUuGdlir4zNr-WSNFs6WawJIF6lQvbO50QOdA1i_zk3b5cz_0EU7fu1GgcjfYn-PicIMoMNhd0PvpbUd_2WXjTNiTLZrS2pSMlXm-I_qeMHnHjwTM-mAUN8vF4LVqJBdMAu6R9hvSd_Qz_zwHY66WKZn6eV6pBI Aug 31 16:16:25.676632 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:16:25.676632 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:16:25.676632 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:16:25.676632 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:16:25.676632 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:16:25.676632 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:16:25.676632 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: aada201b2fd64fdc81a69f826e7c607b Aug 31 16:16:25.676632 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ServersTestMultiNic-285520906 Aug 31 16:16:25.676632 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:16:25.676632 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:16:25.676632 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/aada201b2fd64fdc81a69f826e7c607b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/aada201b2fd64fdc81a69f826e7c607b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_aada201b2fd64fdc81a69f826e7c607b", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/aada201b2fd64fdc81a69f826e7c607b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:16:25.676632 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ServersTestMultiNic-285520906 Aug 31 16:16:25.676632 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: aada201b2fd64fdc81a69f826e7c607b Aug 31 16:16:25.676632 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ServersTestMultiNic-285520906 Aug 31 16:16:25.676632 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ServersTestMultiNic-285520906-project Aug 31 16:16:25.676632 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:16:25.676632 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:16:25.676632 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 860ac4e423cf410d9bbc354c77ba864c Aug 31 16:16:25.676632 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ServersTestMultiNic-285520906-project Aug 31 16:16:25.676632 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:16:25.676632 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance 32192367-aeac-41db-8669-4f3611612ad8 could not be found. Aug 31 16:16:25.676632 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '32192367-aeac-41db-8669-4f3611612ad8'} Aug 31 16:16:25.676632 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:16:25.676632 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:25.676632 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:16:25.676632 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:16:25.676632 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:16:25.676632 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:16:25.676632 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:16:25.676632 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:16:25.676632 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:16:25.676632 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:16:25.676632 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32192367-aeac-41db-8669-4f3611612ad8 could not be found. Aug 31 16:16:25.676632 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:16:25.676632 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:25.676632 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:16:25.676632 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:25.676632 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:25.676632 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:25.676632 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:16:25.676632 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:16:25.676632 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:16:25.676632 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:16:25.676632 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:16:25.676632 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:16:25.676632 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:16:25.676632 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:16:25.676632 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:16:25.676632 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:16:25.676632 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32192367-aeac-41db-8669-4f3611612ad8 could not be found. Aug 31 16:16:25.676632 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:16:25.676632 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:25.676632 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:16:25.682814 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:25.682814 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:25.682814 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:25.682814 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:16:25.682814 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:16:25.682814 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32192367-aeac-41db-8669-4f3611612ad8 could not be found. Aug 31 16:16:25.682814 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:16:25.689464 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-cc038014-28af-4ee0-af67-e7121b92caf8 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Returning 404 to user: Instance 32192367-aeac-41db-8669-4f3611612ad8 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:16:25.694257 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-cc038014-28af-4ee0-af67-e7121b92caf8 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] 10.222.0.61 "GET /compute/v2.1/servers/32192367-aeac-41db-8669-4f3611612ad8" status: 404 len: 111 microversion: 2.1 time: 0.114986 Aug 31 16:16:25.699981 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2205/4418] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:25 2022] GET /compute/v2.1/servers/32192367-aeac-41db-8669-4f3611612ad8 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:16:25.725126 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b098a4d7-564b-487f-a516-86d9c623a70b tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:25.726802 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b098a4d7-564b-487f-a516-86d9c623a70b tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] [instance: 0807b71a-b3ab-4bad-a3b4-a00fc39dedb6] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:26.077990 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b098a4d7-564b-487f-a516-86d9c623a70b tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a598a2bec3e34c239c9fad419545eb52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25e974933e564e5da170dfe26fe921c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:26.116712 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b098a4d7-564b-487f-a516-86d9c623a70b tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] 10.222.0.61 "GET /compute/v2.1/servers/0807b71a-b3ab-4bad-a3b4-a00fc39dedb6" status: 200 len: 1225 microversion: 2.1 time: 0.411286 Aug 31 16:16:26.120489 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2206/4419] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:25 2022] GET /compute/v2.1/servers/0807b71a-b3ab-4bad-a3b4-a00fc39dedb6 => generated 1225 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:26.137940 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1a59acbf-6e23-4706-9f8f-1c0e569112f3 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:26.138580 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1a59acbf-6e23-4706-9f8f-1c0e569112f3 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] [instance: 8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:26.184753 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1a59acbf-6e23-4706-9f8f-1c0e569112f3 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:26.185488 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1a59acbf-6e23-4706-9f8f-1c0e569112f3 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:26.195006 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1a59acbf-6e23-4706-9f8f-1c0e569112f3 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:26.199326 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1a59acbf-6e23-4706-9f8f-1c0e569112f3 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:26.203715 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1a59acbf-6e23-4706-9f8f-1c0e569112f3 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:26.221540 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1a59acbf-6e23-4706-9f8f-1c0e569112f3 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:26.805897 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:16:27.550797 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-772e38ee-dafb-4d88-b87b-cf2b8a57d36f tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb261f2061164b49a8d496b16647dd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d2222a956a4888967e21647e26b310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:27.596249 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-772e38ee-dafb-4d88-b87b-cf2b8a57d36f tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "GET /compute/v2.1/servers/9b9170ad-8804-4603-b35b-f7a3d2c4af62" status: 200 len: 1317 microversion: 2.1 time: 2.331039 Aug 31 16:16:27.627189 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2214/4420] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:25 2022] GET /compute/v2.1/servers/9b9170ad-8804-4603-b35b-f7a3d2c4af62 => generated 1317 bytes in 2367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:27.653084 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f999c1d2-2771-4832-a1cc-2d68162aa219 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:27.655194 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f999c1d2-2771-4832-a1cc-2d68162aa219 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] [instance: 644d0221-94ca-4873-8fe0-ab72c4d7d68b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:27.686306 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f999c1d2-2771-4832-a1cc-2d68162aa219 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:27.689472 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f999c1d2-2771-4832-a1cc-2d68162aa219 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:27.690064 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f999c1d2-2771-4832-a1cc-2d68162aa219 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:27.690907 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f999c1d2-2771-4832-a1cc-2d68162aa219 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:27.694820 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f999c1d2-2771-4832-a1cc-2d68162aa219 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:27.695655 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f999c1d2-2771-4832-a1cc-2d68162aa219 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:27.737230 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-f999c1d2-2771-4832-a1cc-2d68162aa219 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] HTTP exception thrown: Instance 644d0221-94ca-4873-8fe0-ab72c4d7d68b could not be found. Aug 31 16:16:27.746671 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f999c1d2-2771-4832-a1cc-2d68162aa219 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Request method failure captured: Aug 31 16:16:27.746671 n-d-850499-9 devstack@n-api.service[122257]: request: DELETE /compute/v2.1/servers/644d0221-94ca-4873-8fe0-ab72c4d7d68b HTTP/1.1 Aug 31 16:16:27.746671 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:16:27.746671 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:16:27.746671 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:16:27.746671 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:16:27.746671 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:16:27.746671 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:16:27.746671 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:16:27.746671 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:16:27.746671 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4jh2cLL9PyKqIDaLUuGdlir4zNr-WSNFs6WawJIF6lQvbO50QOdA1i_zk3b5cz_0EU7fu1GgcjfYn-PicIMoMNhd0PvpbUd_2WXjTNiTLZrS2pSMlXm-I_qeMHnHjwTM-mAUN8vF4LVqJBdMAu6R9hvSd_Qz_zwHY66WKZn6eV6pBI Aug 31 16:16:27.746671 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:16:27.746671 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:16:27.746671 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:16:27.746671 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:16:27.746671 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:16:27.746671 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:16:27.746671 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: aada201b2fd64fdc81a69f826e7c607b Aug 31 16:16:27.746671 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ServersTestMultiNic-285520906 Aug 31 16:16:27.746671 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:16:27.746671 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:16:27.746671 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/aada201b2fd64fdc81a69f826e7c607b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/aada201b2fd64fdc81a69f826e7c607b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_aada201b2fd64fdc81a69f826e7c607b", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/aada201b2fd64fdc81a69f826e7c607b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:16:27.746671 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ServersTestMultiNic-285520906 Aug 31 16:16:27.746671 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: aada201b2fd64fdc81a69f826e7c607b Aug 31 16:16:27.746671 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ServersTestMultiNic-285520906 Aug 31 16:16:27.746671 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ServersTestMultiNic-285520906-project Aug 31 16:16:27.746671 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:16:27.746671 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:16:27.746671 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 860ac4e423cf410d9bbc354c77ba864c Aug 31 16:16:27.746671 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ServersTestMultiNic-285520906-project Aug 31 16:16:27.746671 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:16:27.746671 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance 644d0221-94ca-4873-8fe0-ab72c4d7d68b could not be found. Aug 31 16:16:27.746671 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '644d0221-94ca-4873-8fe0-ab72c4d7d68b'} Aug 31 16:16:27.746671 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:16:27.746671 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:27.746671 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:16:27.746671 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:16:27.746671 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:16:27.746671 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:16:27.746671 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:16:27.746671 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:16:27.746671 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:16:27.746671 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:16:27.746671 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 644d0221-94ca-4873-8fe0-ab72c4d7d68b could not be found. Aug 31 16:16:27.746671 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:16:27.746671 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:27.746671 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:16:27.746671 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:27.746671 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:27.746671 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:27.746671 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:16:27.746671 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:16:27.746671 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:16:27.746671 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:16:27.746671 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:16:27.746671 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:16:27.746671 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:16:27.746671 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:16:27.746671 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:16:27.746671 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:16:27.746671 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:16:27.746671 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:16:27.750052 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 644d0221-94ca-4873-8fe0-ab72c4d7d68b could not be found. Aug 31 16:16:27.750052 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:16:27.750052 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:27.750052 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:16:27.750052 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:27.750052 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:27.750052 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:27.750052 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:16:27.750052 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:16:27.750052 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 644d0221-94ca-4873-8fe0-ab72c4d7d68b could not be found. Aug 31 16:16:27.750052 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:16:27.752732 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f999c1d2-2771-4832-a1cc-2d68162aa219 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Returning 404 to user: Instance 644d0221-94ca-4873-8fe0-ab72c4d7d68b could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:16:27.754161 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1a59acbf-6e23-4706-9f8f-1c0e569112f3 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09abc9573e94951b69e871170cbcf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc0aa4c03f84f5691d4e7b8c5da75e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:27.755523 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f999c1d2-2771-4832-a1cc-2d68162aa219 tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] 10.222.0.61 "DELETE /compute/v2.1/servers/644d0221-94ca-4873-8fe0-ab72c4d7d68b" status: 404 len: 111 microversion: 2.1 time: 0.126458 Aug 31 16:16:27.758984 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2215/4421] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:16:27 2022] DELETE /compute/v2.1/servers/644d0221-94ca-4873-8fe0-ab72c4d7d68b => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:16:27.790086 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1a59acbf-6e23-4706-9f8f-1c0e569112f3 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] 10.222.0.61 "GET /compute/v2.1/servers/8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21" status: 200 len: 1328 microversion: 2.1 time: 1.666004 Aug 31 16:16:27.800283 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2207/4422] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:26 2022] GET /compute/v2.1/servers/8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21 => generated 1328 bytes in 1673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:27.811965 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3466474b-0fac-433e-a9a8-c99df0ff6aa7 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:27.812999 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3466474b-0fac-433e-a9a8-c99df0ff6aa7 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] [instance: 0807b71a-b3ab-4bad-a3b4-a00fc39dedb6] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:27.833244 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3466474b-0fac-433e-a9a8-c99df0ff6aa7 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:27.835665 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3466474b-0fac-433e-a9a8-c99df0ff6aa7 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:27.836488 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3466474b-0fac-433e-a9a8-c99df0ff6aa7 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:27.844259 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3466474b-0fac-433e-a9a8-c99df0ff6aa7 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:27.845808 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3466474b-0fac-433e-a9a8-c99df0ff6aa7 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:27.846696 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3466474b-0fac-433e-a9a8-c99df0ff6aa7 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:27.965125 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-0bc6abb6-0aea-4fcc-ba19-47c080f27841 req-5d786132-4cbf-4fdb-9d5f-e5fcb507a5d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b9170ad-8804-4603-b35b-f7a3d2c4af62", "tag": "36e7a186-ebb0-4a76-af6a-cd120bd63d63"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:16:28.055616 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-0bc6abb6-0aea-4fcc-ba19-47c080f27841 req-5d786132-4cbf-4fdb-9d5f-e5fcb507a5d0 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:28.056738 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-0bc6abb6-0aea-4fcc-ba19-47c080f27841 req-5d786132-4cbf-4fdb-9d5f-e5fcb507a5d0 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:28.057583 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-0bc6abb6-0aea-4fcc-ba19-47c080f27841 req-5d786132-4cbf-4fdb-9d5f-e5fcb507a5d0 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:28.087009 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-0bc6abb6-0aea-4fcc-ba19-47c080f27841 req-5d786132-4cbf-4fdb-9d5f-e5fcb507a5d0 service nova] Creating event network-changed:36e7a186-ebb0-4a76-af6a-cd120bd63d63 for instance 9b9170ad-8804-4603-b35b-f7a3d2c4af62 on n-h1-850499-9 Aug 31 16:16:28.101652 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-0bc6abb6-0aea-4fcc-ba19-47c080f27841 req-5d786132-4cbf-4fdb-9d5f-e5fcb507a5d0 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.338594 Aug 31 16:16:28.103133 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2216/4423] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:16:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:16:28.127145 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6bf1dffe-0458-4148-b244-e9cb90f5814d tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:28.140691 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6bf1dffe-0458-4148-b244-e9cb90f5814d tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] [instance: 644d0221-94ca-4873-8fe0-ab72c4d7d68b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:28.173207 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6bf1dffe-0458-4148-b244-e9cb90f5814d tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:28.174369 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6bf1dffe-0458-4148-b244-e9cb90f5814d tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:28.176301 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6bf1dffe-0458-4148-b244-e9cb90f5814d tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:28.178358 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6bf1dffe-0458-4148-b244-e9cb90f5814d tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:28.180228 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6bf1dffe-0458-4148-b244-e9cb90f5814d tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:28.181836 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6bf1dffe-0458-4148-b244-e9cb90f5814d tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:28.257171 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-6bf1dffe-0458-4148-b244-e9cb90f5814d tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] HTTP exception thrown: Instance 644d0221-94ca-4873-8fe0-ab72c4d7d68b could not be found. Aug 31 16:16:28.265277 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6bf1dffe-0458-4148-b244-e9cb90f5814d tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Request method failure captured: Aug 31 16:16:28.265277 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/644d0221-94ca-4873-8fe0-ab72c4d7d68b HTTP/1.1 Aug 31 16:16:28.265277 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:16:28.265277 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:16:28.265277 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:16:28.265277 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:16:28.265277 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:16:28.265277 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:16:28.265277 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:16:28.265277 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:16:28.265277 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4jh2cLL9PyKqIDaLUuGdlir4zNr-WSNFs6WawJIF6lQvbO50QOdA1i_zk3b5cz_0EU7fu1GgcjfYn-PicIMoMNhd0PvpbUd_2WXjTNiTLZrS2pSMlXm-I_qeMHnHjwTM-mAUN8vF4LVqJBdMAu6R9hvSd_Qz_zwHY66WKZn6eV6pBI Aug 31 16:16:28.265277 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:16:28.265277 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:16:28.265277 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:16:28.265277 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:16:28.265277 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:16:28.265277 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:16:28.265277 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: aada201b2fd64fdc81a69f826e7c607b Aug 31 16:16:28.265277 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ServersTestMultiNic-285520906 Aug 31 16:16:28.265277 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:16:28.265277 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:16:28.265277 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/aada201b2fd64fdc81a69f826e7c607b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/aada201b2fd64fdc81a69f826e7c607b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_aada201b2fd64fdc81a69f826e7c607b", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/aada201b2fd64fdc81a69f826e7c607b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:16:28.265277 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ServersTestMultiNic-285520906 Aug 31 16:16:28.265277 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: aada201b2fd64fdc81a69f826e7c607b Aug 31 16:16:28.265277 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ServersTestMultiNic-285520906 Aug 31 16:16:28.265277 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ServersTestMultiNic-285520906-project Aug 31 16:16:28.265277 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:16:28.265277 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:16:28.265277 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 860ac4e423cf410d9bbc354c77ba864c Aug 31 16:16:28.265277 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ServersTestMultiNic-285520906-project Aug 31 16:16:28.265277 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:16:28.265277 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance 644d0221-94ca-4873-8fe0-ab72c4d7d68b could not be found. Aug 31 16:16:28.265277 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '644d0221-94ca-4873-8fe0-ab72c4d7d68b'} Aug 31 16:16:28.265277 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:16:28.265277 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:28.265277 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:16:28.265277 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:16:28.265277 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:16:28.265277 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:16:28.265277 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:16:28.265277 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:16:28.265277 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:16:28.265277 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:16:28.265277 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 644d0221-94ca-4873-8fe0-ab72c4d7d68b could not be found. Aug 31 16:16:28.265277 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:16:28.265277 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:28.265277 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:16:28.265277 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:28.265277 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:28.265277 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:28.265277 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:16:28.265277 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:16:28.265277 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:16:28.265277 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:16:28.265277 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:16:28.265277 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:16:28.265277 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:16:28.265277 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:16:28.265277 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:16:28.265277 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:16:28.265277 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 644d0221-94ca-4873-8fe0-ab72c4d7d68b could not be found. Aug 31 16:16:28.265277 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:16:28.265277 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:28.265277 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:16:28.272792 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:28.272792 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:28.272792 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:28.272792 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:16:28.272792 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:16:28.272792 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 644d0221-94ca-4873-8fe0-ab72c4d7d68b could not be found. Aug 31 16:16:28.272792 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:16:28.275953 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6bf1dffe-0458-4148-b244-e9cb90f5814d tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] Returning 404 to user: Instance 644d0221-94ca-4873-8fe0-ab72c4d7d68b could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:16:28.279214 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6bf1dffe-0458-4148-b244-e9cb90f5814d tempest-ServersTestMultiNic-285520906 tempest-ServersTestMultiNic-285520906-project] 10.222.0.61 "GET /compute/v2.1/servers/644d0221-94ca-4873-8fe0-ab72c4d7d68b" status: 404 len: 111 microversion: 2.1 time: 0.172830 Aug 31 16:16:28.281571 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2217/4424] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:28 2022] GET /compute/v2.1/servers/644d0221-94ca-4873-8fe0-ab72c4d7d68b => generated 111 bytes in 177 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:16:28.362294 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3466474b-0fac-433e-a9a8-c99df0ff6aa7 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a598a2bec3e34c239c9fad419545eb52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25e974933e564e5da170dfe26fe921c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:28.390385 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3466474b-0fac-433e-a9a8-c99df0ff6aa7 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] 10.222.0.61 "GET /compute/v2.1/servers/0807b71a-b3ab-4bad-a3b4-a00fc39dedb6" status: 200 len: 1221 microversion: 2.1 time: 0.594114 Aug 31 16:16:28.426060 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2208/4425] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:27 2022] GET /compute/v2.1/servers/0807b71a-b3ab-4bad-a3b4-a00fc39dedb6 => generated 1221 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:28.690409 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ac8c30eb-8357-4c58-9de9-214d3c53e457 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:28.691739 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ac8c30eb-8357-4c58-9de9-214d3c53e457 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: 9b9170ad-8804-4603-b35b-f7a3d2c4af62] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:28.762247 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ac8c30eb-8357-4c58-9de9-214d3c53e457 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:28.763104 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ac8c30eb-8357-4c58-9de9-214d3c53e457 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:28.763923 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ac8c30eb-8357-4c58-9de9-214d3c53e457 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:28.777670 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ac8c30eb-8357-4c58-9de9-214d3c53e457 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:28.780426 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ac8c30eb-8357-4c58-9de9-214d3c53e457 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:28.781460 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ac8c30eb-8357-4c58-9de9-214d3c53e457 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:28.824053 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9444deef-8aec-47d8-86d6-49968effce32 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:28.826021 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9444deef-8aec-47d8-86d6-49968effce32 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] [instance: 8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:28.856977 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9444deef-8aec-47d8-86d6-49968effce32 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:28.864522 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9444deef-8aec-47d8-86d6-49968effce32 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:28.865903 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9444deef-8aec-47d8-86d6-49968effce32 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:28.867722 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9444deef-8aec-47d8-86d6-49968effce32 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:28.875085 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9444deef-8aec-47d8-86d6-49968effce32 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:28.888884 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9444deef-8aec-47d8-86d6-49968effce32 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:30.872006 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-9444deef-8aec-47d8-86d6-49968effce32 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09abc9573e94951b69e871170cbcf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc0aa4c03f84f5691d4e7b8c5da75e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:30.881562 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9444deef-8aec-47d8-86d6-49968effce32 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] 10.222.0.61 "GET /compute/v2.1/servers/8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21" status: 200 len: 1328 microversion: 2.1 time: 2.064909 Aug 31 16:16:30.886577 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2209/4426] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:28 2022] GET /compute/v2.1/servers/8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21 => generated 1328 bytes in 2072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:16:30.898138 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-43ec261e-e524-4b49-9d6e-5f9a764059f9 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:30.904477 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-43ec261e-e524-4b49-9d6e-5f9a764059f9 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] [instance: 0807b71a-b3ab-4bad-a3b4-a00fc39dedb6] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:30.912515 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-43ec261e-e524-4b49-9d6e-5f9a764059f9 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:30.913180 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-43ec261e-e524-4b49-9d6e-5f9a764059f9 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:30.913695 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-43ec261e-e524-4b49-9d6e-5f9a764059f9 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:30.914848 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-43ec261e-e524-4b49-9d6e-5f9a764059f9 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:30.915854 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-43ec261e-e524-4b49-9d6e-5f9a764059f9 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:30.916896 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-43ec261e-e524-4b49-9d6e-5f9a764059f9 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:30.982292 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ac8c30eb-8357-4c58-9de9-214d3c53e457 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb261f2061164b49a8d496b16647dd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d2222a956a4888967e21647e26b310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:30.992898 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ac8c30eb-8357-4c58-9de9-214d3c53e457 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "GET /compute/v2.1/servers/9b9170ad-8804-4603-b35b-f7a3d2c4af62" status: 200 len: 1317 microversion: 2.1 time: 2.340705 Aug 31 16:16:30.993918 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2218/4427] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:28 2022] GET /compute/v2.1/servers/9b9170ad-8804-4603-b35b-f7a3d2c4af62 => generated 1317 bytes in 2343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:31.108876 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-43ec261e-e524-4b49-9d6e-5f9a764059f9 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a598a2bec3e34c239c9fad419545eb52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25e974933e564e5da170dfe26fe921c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:31.125765 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-43ec261e-e524-4b49-9d6e-5f9a764059f9 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] 10.222.0.61 "GET /compute/v2.1/servers/0807b71a-b3ab-4bad-a3b4-a00fc39dedb6" status: 200 len: 1283 microversion: 2.1 time: 0.234459 Aug 31 16:16:31.126947 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2210/4428] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:30 2022] GET /compute/v2.1/servers/0807b71a-b3ab-4bad-a3b4-a00fc39dedb6 => generated 1283 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:31.912414 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-77d472be-2ec3-4245-9bf4-cd8f50c7bec4 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:31.915961 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-77d472be-2ec3-4245-9bf4-cd8f50c7bec4 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] [instance: 8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:31.932991 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-605641ab-e31d-4166-b6c8-79221173101c tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:31.940116 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-605641ab-e31d-4166-b6c8-79221173101c tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] [instance: fa0932e8-1aa4-4d1a-b653-14be35568f3d] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:31.985877 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-77d472be-2ec3-4245-9bf4-cd8f50c7bec4 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:31.988082 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-77d472be-2ec3-4245-9bf4-cd8f50c7bec4 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:31.990496 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-605641ab-e31d-4166-b6c8-79221173101c tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:31.991061 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-77d472be-2ec3-4245-9bf4-cd8f50c7bec4 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:31.993673 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-77d472be-2ec3-4245-9bf4-cd8f50c7bec4 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:31.997796 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-77d472be-2ec3-4245-9bf4-cd8f50c7bec4 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:31.998663 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-77d472be-2ec3-4245-9bf4-cd8f50c7bec4 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:32.001446 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-605641ab-e31d-4166-b6c8-79221173101c tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:32.006600 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-605641ab-e31d-4166-b6c8-79221173101c tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:32.017494 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-605641ab-e31d-4166-b6c8-79221173101c tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:32.020426 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-605641ab-e31d-4166-b6c8-79221173101c tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:32.022004 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-605641ab-e31d-4166-b6c8-79221173101c tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:32.090655 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-605641ab-e31d-4166-b6c8-79221173101c tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] HTTP exception thrown: Instance fa0932e8-1aa4-4d1a-b653-14be35568f3d could not be found. Aug 31 16:16:32.099183 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-605641ab-e31d-4166-b6c8-79221173101c tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Request method failure captured: Aug 31 16:16:32.099183 n-d-850499-9 devstack@n-api.service[122256]: request: DELETE /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d HTTP/1.1 Aug 31 16:16:32.099183 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:16:32.099183 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:16:32.099183 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:16:32.099183 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:16:32.099183 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:16:32.099183 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:16:32.099183 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:16:32.099183 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:16:32.099183 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4eSNKrxXiQsYgH2l5iloXmDd-LUH_jMXH-6Yin9uj-RxVmADOPBKBL0tRR0yQoSUC83bkN_vZmO0oaKf07rxDpnidHOCl5EkJgFnwXipodLJHW-vc71rrdRGeoXRDqRPB2VJqOpdqVPRbvmXIyGj3TVBFObra9Q8ieYBj2Cp-0Cyss Aug 31 16:16:32.099183 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:16:32.099183 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:16:32.099183 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:16:32.099183 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:16:32.099183 n-d-850499-9 devstack@n-api.service[122256]: X-Openstack-Nova-Api-Version: 2.32 Aug 31 16:16:32.099183 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:16:32.099183 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:16:32.099183 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 68e7010151a7457b9ff7574126683b32 Aug 31 16:16:32.099183 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-TaggedBootDevicesTest-953904043 Aug 31 16:16:32.099183 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:16:32.099183 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:16:32.099183 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/68e7010151a7457b9ff7574126683b32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/68e7010151a7457b9ff7574126683b32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_68e7010151a7457b9ff7574126683b32", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/68e7010151a7457b9ff7574126683b32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:16:32.099183 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-TaggedBootDevicesTest-953904043 Aug 31 16:16:32.099183 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 68e7010151a7457b9ff7574126683b32 Aug 31 16:16:32.099183 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-TaggedBootDevicesTest-953904043 Aug 31 16:16:32.099183 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-TaggedBootDevicesTest-953904043-project Aug 31 16:16:32.099183 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:16:32.099183 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:16:32.099183 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 51c2d1cf18074bfda706dc2d5713b4f2 Aug 31 16:16:32.099183 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-TaggedBootDevicesTest-953904043-project Aug 31 16:16:32.099183 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:16:32.099183 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance fa0932e8-1aa4-4d1a-b653-14be35568f3d could not be found. Aug 31 16:16:32.099183 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': 'fa0932e8-1aa4-4d1a-b653-14be35568f3d'} Aug 31 16:16:32.099183 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:16:32.099183 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:32.099183 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:16:32.099183 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:16:32.099183 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:16:32.099183 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:16:32.099183 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:16:32.099183 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:16:32.099183 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:16:32.099183 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:16:32.099183 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa0932e8-1aa4-4d1a-b653-14be35568f3d could not be found. Aug 31 16:16:32.099183 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:16:32.099183 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:32.099183 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:16:32.099183 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:32.099183 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:32.099183 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:32.099183 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:16:32.099183 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:16:32.099183 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:16:32.099183 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:16:32.099183 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:16:32.099183 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:16:32.099183 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:16:32.099183 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:16:32.099183 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:16:32.099183 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:16:32.099183 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:16:32.099183 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:16:32.105593 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa0932e8-1aa4-4d1a-b653-14be35568f3d could not be found. Aug 31 16:16:32.105593 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:16:32.105593 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:32.105593 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:16:32.105593 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:32.105593 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:32.105593 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:32.105593 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:16:32.105593 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:16:32.105593 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa0932e8-1aa4-4d1a-b653-14be35568f3d could not be found. Aug 31 16:16:32.105593 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:16:32.109568 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-605641ab-e31d-4166-b6c8-79221173101c tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Returning 404 to user: Instance fa0932e8-1aa4-4d1a-b653-14be35568f3d could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:16:32.119639 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-605641ab-e31d-4166-b6c8-79221173101c tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] 10.222.0.61 "DELETE /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d" status: 404 len: 111 microversion: 2.32 time: 0.196088 Aug 31 16:16:32.121553 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2211/4429] 10.222.0.61 () {60 vars in 1280 bytes} [Wed Aug 31 16:16:31 2022] DELETE /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d => generated 111 bytes in 200 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:16:32.143965 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-451fdf55-0589-454a-bf96-6324b825d096 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:32.148064 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-451fdf55-0589-454a-bf96-6324b825d096 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: 9b9170ad-8804-4603-b35b-f7a3d2c4af62] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:32.178313 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-451fdf55-0589-454a-bf96-6324b825d096 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:32.181921 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-451fdf55-0589-454a-bf96-6324b825d096 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:32.182970 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-451fdf55-0589-454a-bf96-6324b825d096 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:32.186135 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-451fdf55-0589-454a-bf96-6324b825d096 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:32.188587 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-451fdf55-0589-454a-bf96-6324b825d096 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:32.189341 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-451fdf55-0589-454a-bf96-6324b825d096 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:32.713592 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-451fdf55-0589-454a-bf96-6324b825d096 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb261f2061164b49a8d496b16647dd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d2222a956a4888967e21647e26b310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:32.731451 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-451fdf55-0589-454a-bf96-6324b825d096 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "GET /compute/v2.1/servers/9b9170ad-8804-4603-b35b-f7a3d2c4af62" status: 200 len: 1317 microversion: 2.1 time: 0.606860 Aug 31 16:16:32.736544 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2212/4430] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:32 2022] GET /compute/v2.1/servers/9b9170ad-8804-4603-b35b-f7a3d2c4af62 => generated 1317 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:32.751939 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e80e8243-56a6-446b-9875-296edbeb755f tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:32.753445 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e80e8243-56a6-446b-9875-296edbeb755f tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] [instance: fa0932e8-1aa4-4d1a-b653-14be35568f3d] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:32.776992 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e80e8243-56a6-446b-9875-296edbeb755f tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:32.777543 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e80e8243-56a6-446b-9875-296edbeb755f tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:32.777961 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e80e8243-56a6-446b-9875-296edbeb755f tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:32.779180 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e80e8243-56a6-446b-9875-296edbeb755f tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:32.779704 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e80e8243-56a6-446b-9875-296edbeb755f tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:32.782311 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e80e8243-56a6-446b-9875-296edbeb755f tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:32.817553 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-e80e8243-56a6-446b-9875-296edbeb755f tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] HTTP exception thrown: Instance fa0932e8-1aa4-4d1a-b653-14be35568f3d could not be found. Aug 31 16:16:32.820016 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e80e8243-56a6-446b-9875-296edbeb755f tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Request method failure captured: Aug 31 16:16:32.820016 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d HTTP/1.1 Aug 31 16:16:32.820016 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:16:32.820016 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:16:32.820016 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:16:32.820016 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:16:32.820016 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:16:32.820016 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:16:32.820016 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:16:32.820016 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:16:32.820016 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4eSNKrxXiQsYgH2l5iloXmDd-LUH_jMXH-6Yin9uj-RxVmADOPBKBL0tRR0yQoSUC83bkN_vZmO0oaKf07rxDpnidHOCl5EkJgFnwXipodLJHW-vc71rrdRGeoXRDqRPB2VJqOpdqVPRbvmXIyGj3TVBFObra9Q8ieYBj2Cp-0Cyss Aug 31 16:16:32.820016 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:16:32.820016 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:16:32.820016 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:16:32.820016 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:16:32.820016 n-d-850499-9 devstack@n-api.service[122256]: X-Openstack-Nova-Api-Version: 2.32 Aug 31 16:16:32.820016 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:16:32.820016 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:16:32.820016 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 68e7010151a7457b9ff7574126683b32 Aug 31 16:16:32.820016 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-TaggedBootDevicesTest-953904043 Aug 31 16:16:32.820016 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:16:32.820016 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:16:32.820016 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/68e7010151a7457b9ff7574126683b32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/68e7010151a7457b9ff7574126683b32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_68e7010151a7457b9ff7574126683b32", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/68e7010151a7457b9ff7574126683b32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:16:32.820016 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-TaggedBootDevicesTest-953904043 Aug 31 16:16:32.820016 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 68e7010151a7457b9ff7574126683b32 Aug 31 16:16:32.820016 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-TaggedBootDevicesTest-953904043 Aug 31 16:16:32.820016 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-TaggedBootDevicesTest-953904043-project Aug 31 16:16:32.820016 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:16:32.820016 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:16:32.820016 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 51c2d1cf18074bfda706dc2d5713b4f2 Aug 31 16:16:32.820016 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-TaggedBootDevicesTest-953904043-project Aug 31 16:16:32.820016 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:16:32.820016 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance fa0932e8-1aa4-4d1a-b653-14be35568f3d could not be found. Aug 31 16:16:32.820016 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': 'fa0932e8-1aa4-4d1a-b653-14be35568f3d'} Aug 31 16:16:32.820016 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:16:32.820016 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:32.820016 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:16:32.820016 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:16:32.820016 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:16:32.820016 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:16:32.820016 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:16:32.820016 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:16:32.820016 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:16:32.820016 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:16:32.820016 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa0932e8-1aa4-4d1a-b653-14be35568f3d could not be found. Aug 31 16:16:32.820016 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:16:32.820016 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:32.820016 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:16:32.820016 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:32.820016 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:32.820016 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:32.820016 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:16:32.820016 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:16:32.820016 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:16:32.820016 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:16:32.820016 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:16:32.820016 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:16:32.820016 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:16:32.820016 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:16:32.820016 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:16:32.820016 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:16:32.820016 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa0932e8-1aa4-4d1a-b653-14be35568f3d could not be found. Aug 31 16:16:32.820016 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:16:32.820016 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:32.820016 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:16:32.824567 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:32.824567 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:32.824567 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:32.824567 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:16:32.824567 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:16:32.824567 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa0932e8-1aa4-4d1a-b653-14be35568f3d could not be found. Aug 31 16:16:32.824567 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:16:32.826109 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e80e8243-56a6-446b-9875-296edbeb755f tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] Returning 404 to user: Instance fa0932e8-1aa4-4d1a-b653-14be35568f3d could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:16:32.827297 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e80e8243-56a6-446b-9875-296edbeb755f tempest-TaggedBootDevicesTest-953904043 tempest-TaggedBootDevicesTest-953904043-project] 10.222.0.61 "GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d" status: 404 len: 111 microversion: 2.32 time: 0.089437 Aug 31 16:16:32.829131 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2213/4431] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:16:32 2022] GET /compute/v2.1/servers/fa0932e8-1aa4-4d1a-b653-14be35568f3d => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:16:32.867728 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b3331e24-b349-4782-8636-2a3aafbad4dd tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:32.882361 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b3331e24-b349-4782-8636-2a3aafbad4dd tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] [instance: 0807b71a-b3ab-4bad-a3b4-a00fc39dedb6] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:32.892600 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b3331e24-b349-4782-8636-2a3aafbad4dd tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:32.893328 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b3331e24-b349-4782-8636-2a3aafbad4dd tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:32.893799 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b3331e24-b349-4782-8636-2a3aafbad4dd tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:32.894717 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b3331e24-b349-4782-8636-2a3aafbad4dd tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:32.895201 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b3331e24-b349-4782-8636-2a3aafbad4dd tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:32.895767 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b3331e24-b349-4782-8636-2a3aafbad4dd tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:32.897041 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-77d472be-2ec3-4245-9bf4-cd8f50c7bec4 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09abc9573e94951b69e871170cbcf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc0aa4c03f84f5691d4e7b8c5da75e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:32.913065 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-77d472be-2ec3-4245-9bf4-cd8f50c7bec4 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] 10.222.0.61 "GET /compute/v2.1/servers/8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21" status: 200 len: 1328 microversion: 2.1 time: 1.008740 Aug 31 16:16:32.929473 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2219/4432] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:31 2022] GET /compute/v2.1/servers/8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21 => generated 1328 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:33.183478 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b3331e24-b349-4782-8636-2a3aafbad4dd tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a598a2bec3e34c239c9fad419545eb52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25e974933e564e5da170dfe26fe921c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:33.209456 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b3331e24-b349-4782-8636-2a3aafbad4dd tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] 10.222.0.61 "GET /compute/v2.1/servers/0807b71a-b3ab-4bad-a3b4-a00fc39dedb6" status: 200 len: 1283 microversion: 2.1 time: 0.359643 Aug 31 16:16:33.210651 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2214/4433] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:32 2022] GET /compute/v2.1/servers/0807b71a-b3ab-4bad-a3b4-a00fc39dedb6 => generated 1283 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:33.338528 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-ca181fb6-64c4-41c1-b78b-7ad11ba5a24f req-3d40d005-0eb4-4157-bc18-0c7743376f2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21", "name": "network-vif-plugged", "status": "completed", "tag": "8aa3dc6a-0289-4f40-b5a9-892ca074cf0d"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:16:33.365365 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-ca181fb6-64c4-41c1-b78b-7ad11ba5a24f req-3d40d005-0eb4-4157-bc18-0c7743376f2a service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:33.365855 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-ca181fb6-64c4-41c1-b78b-7ad11ba5a24f req-3d40d005-0eb4-4157-bc18-0c7743376f2a service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:33.366294 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-ca181fb6-64c4-41c1-b78b-7ad11ba5a24f req-3d40d005-0eb4-4157-bc18-0c7743376f2a service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:33.398311 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-ca181fb6-64c4-41c1-b78b-7ad11ba5a24f req-3d40d005-0eb4-4157-bc18-0c7743376f2a service nova] Creating event network-vif-plugged:8aa3dc6a-0289-4f40-b5a9-892ca074cf0d for instance 8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21 on n-h2-850499-9 Aug 31 16:16:33.416976 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-ca181fb6-64c4-41c1-b78b-7ad11ba5a24f req-3d40d005-0eb4-4157-bc18-0c7743376f2a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085013 Aug 31 16:16:33.417597 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2220/4434] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:16:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:16:33.775669 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-48bb0977-5bd6-4614-aeac-94574779b56a tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:33.781425 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-48bb0977-5bd6-4614-aeac-94574779b56a tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: 9b9170ad-8804-4603-b35b-f7a3d2c4af62] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:33.797805 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-48bb0977-5bd6-4614-aeac-94574779b56a tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:33.798501 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-48bb0977-5bd6-4614-aeac-94574779b56a tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:33.801294 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-48bb0977-5bd6-4614-aeac-94574779b56a tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:33.802812 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-48bb0977-5bd6-4614-aeac-94574779b56a tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:33.804828 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-48bb0977-5bd6-4614-aeac-94574779b56a tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:33.805587 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-48bb0977-5bd6-4614-aeac-94574779b56a tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:33.946267 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4dede8b6-e37a-4528-a990-f8187e8a9796 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:33.947260 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4dede8b6-e37a-4528-a990-f8187e8a9796 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] [instance: 8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:33.961462 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4dede8b6-e37a-4528-a990-f8187e8a9796 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:33.962282 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4dede8b6-e37a-4528-a990-f8187e8a9796 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:33.968405 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4dede8b6-e37a-4528-a990-f8187e8a9796 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:33.970180 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4dede8b6-e37a-4528-a990-f8187e8a9796 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:33.970833 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4dede8b6-e37a-4528-a990-f8187e8a9796 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:33.971440 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4dede8b6-e37a-4528-a990-f8187e8a9796 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:34.491182 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-48bb0977-5bd6-4614-aeac-94574779b56a tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb261f2061164b49a8d496b16647dd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d2222a956a4888967e21647e26b310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:34.525298 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-48bb0977-5bd6-4614-aeac-94574779b56a tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "GET /compute/v2.1/servers/9b9170ad-8804-4603-b35b-f7a3d2c4af62" status: 200 len: 1317 microversion: 2.1 time: 0.763757 Aug 31 16:16:34.539799 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2215/4435] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:33 2022] GET /compute/v2.1/servers/9b9170ad-8804-4603-b35b-f7a3d2c4af62 => generated 1317 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:34.549960 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-efc1c4ab-16c6-42ff-902d-0c12cff405ec tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:34.551092 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-efc1c4ab-16c6-42ff-902d-0c12cff405ec tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] [instance: 0807b71a-b3ab-4bad-a3b4-a00fc39dedb6] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:34.586871 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-efc1c4ab-16c6-42ff-902d-0c12cff405ec tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:34.589016 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-efc1c4ab-16c6-42ff-902d-0c12cff405ec tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:34.589516 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-efc1c4ab-16c6-42ff-902d-0c12cff405ec tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:34.590277 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-efc1c4ab-16c6-42ff-902d-0c12cff405ec tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:34.590749 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-efc1c4ab-16c6-42ff-902d-0c12cff405ec tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:34.591187 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-efc1c4ab-16c6-42ff-902d-0c12cff405ec tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:35.204139 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=6 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:16:35.513767 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-4dede8b6-e37a-4528-a990-f8187e8a9796 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09abc9573e94951b69e871170cbcf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc0aa4c03f84f5691d4e7b8c5da75e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:35.541326 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4dede8b6-e37a-4528-a990-f8187e8a9796 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] 10.222.0.61 "GET /compute/v2.1/servers/8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21" status: 200 len: 1328 microversion: 2.1 time: 1.604922 Aug 31 16:16:35.541928 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2221/4436] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:33 2022] GET /compute/v2.1/servers/8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21 => generated 1328 bytes in 1607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:35.572732 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-046a62c9-0059-4c4c-a786-be236b6ff7a8 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:16:35.587789 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-046a62c9-0059-4c4c-a786-be236b6ff7a8 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:35.588584 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-046a62c9-0059-4c4c-a786-be236b6ff7a8 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:35.589212 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-046a62c9-0059-4c4c-a786-be236b6ff7a8 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:35.617551 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-046a62c9-0059-4c4c-a786-be236b6ff7a8 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] [instance: f04eb48d-000e-4c3b-8799-a4d3cdacf0e2] Going to try to stop instance {{(pid=122257) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 31 16:16:35.679917 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-046a62c9-0059-4c4c-a786-be236b6ff7a8 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] 10.222.0.61 "POST /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2/action" status: 202 len: 0 microversion: 2.1 time: 0.127808 Aug 31 16:16:35.681167 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2222/4437] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:16:35 2022] POST /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:16:35.710507 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f07211c5-c3d0-490c-b954-d4ac544e3124 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:35.711714 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f07211c5-c3d0-490c-b954-d4ac544e3124 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: 9b9170ad-8804-4603-b35b-f7a3d2c4af62] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:35.724308 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f07211c5-c3d0-490c-b954-d4ac544e3124 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:35.725187 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f07211c5-c3d0-490c-b954-d4ac544e3124 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:35.725827 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f07211c5-c3d0-490c-b954-d4ac544e3124 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:35.726939 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f07211c5-c3d0-490c-b954-d4ac544e3124 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:35.727688 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f07211c5-c3d0-490c-b954-d4ac544e3124 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:35.728357 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f07211c5-c3d0-490c-b954-d4ac544e3124 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:35.779571 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-efc1c4ab-16c6-42ff-902d-0c12cff405ec tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a598a2bec3e34c239c9fad419545eb52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25e974933e564e5da170dfe26fe921c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:35.790970 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-efc1c4ab-16c6-42ff-902d-0c12cff405ec tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] 10.222.0.61 "GET /compute/v2.1/servers/0807b71a-b3ab-4bad-a3b4-a00fc39dedb6" status: 200 len: 1325 microversion: 2.1 time: 1.257497 Aug 31 16:16:35.809358 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2216/4438] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:34 2022] GET /compute/v2.1/servers/0807b71a-b3ab-4bad-a3b4-a00fc39dedb6 => generated 1325 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:35.820893 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3c97ee23-42d4-4df2-8e5f-138cc7f04b06 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:35.829009 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3c97ee23-42d4-4df2-8e5f-138cc7f04b06 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] [instance: f04eb48d-000e-4c3b-8799-a4d3cdacf0e2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:35.831676 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:DELETE=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:16:35.851268 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3c97ee23-42d4-4df2-8e5f-138cc7f04b06 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:35.852055 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3c97ee23-42d4-4df2-8e5f-138cc7f04b06 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:35.853166 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3c97ee23-42d4-4df2-8e5f-138cc7f04b06 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:35.854059 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3c97ee23-42d4-4df2-8e5f-138cc7f04b06 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:35.854670 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3c97ee23-42d4-4df2-8e5f-138cc7f04b06 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:35.855257 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3c97ee23-42d4-4df2-8e5f-138cc7f04b06 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:36.088977 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=20 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:16:36.277001 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3c97ee23-42d4-4df2-8e5f-138cc7f04b06 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed06378eb9b446680b5a3156a14941d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511432a7dee4bec9d1093c9d95b3734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:36.295840 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3c97ee23-42d4-4df2-8e5f-138cc7f04b06 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] 10.222.0.61 "GET /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2" status: 200 len: 1676 microversion: 2.1 time: 0.484973 Aug 31 16:16:36.297565 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2217/4439] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:35 2022] GET /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2 => generated 1676 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:36.536706 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f07211c5-c3d0-490c-b954-d4ac544e3124 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb261f2061164b49a8d496b16647dd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d2222a956a4888967e21647e26b310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:36.550371 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f07211c5-c3d0-490c-b954-d4ac544e3124 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "GET /compute/v2.1/servers/9b9170ad-8804-4603-b35b-f7a3d2c4af62" status: 200 len: 1317 microversion: 2.1 time: 0.867627 Aug 31 16:16:36.555339 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2223/4440] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:35 2022] GET /compute/v2.1/servers/9b9170ad-8804-4603-b35b-f7a3d2c4af62 => generated 1317 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:36.565052 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-293d27c4-1f7d-4a3c-9d1f-d15278a5ad6f tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:36.565727 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-293d27c4-1f7d-4a3c-9d1f-d15278a5ad6f tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] [instance: 8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:36.583942 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-293d27c4-1f7d-4a3c-9d1f-d15278a5ad6f tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:36.584460 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-293d27c4-1f7d-4a3c-9d1f-d15278a5ad6f tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:36.597169 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-293d27c4-1f7d-4a3c-9d1f-d15278a5ad6f tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:36.598322 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-293d27c4-1f7d-4a3c-9d1f-d15278a5ad6f tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:36.602726 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-293d27c4-1f7d-4a3c-9d1f-d15278a5ad6f tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:36.603256 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-293d27c4-1f7d-4a3c-9d1f-d15278a5ad6f tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:36.731205 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-17b8b417-1bee-4af0-a279-1e4537535f82 req-745f5a79-35a1-448b-a1d7-296a0a766bdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b9170ad-8804-4603-b35b-f7a3d2c4af62", "name": "network-vif-plugged", "status": "completed", "tag": "36e7a186-ebb0-4a76-af6a-cd120bd63d63"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:16:36.753229 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-17b8b417-1bee-4af0-a279-1e4537535f82 req-745f5a79-35a1-448b-a1d7-296a0a766bdd service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:36.753735 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-17b8b417-1bee-4af0-a279-1e4537535f82 req-745f5a79-35a1-448b-a1d7-296a0a766bdd service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:36.754410 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-17b8b417-1bee-4af0-a279-1e4537535f82 req-745f5a79-35a1-448b-a1d7-296a0a766bdd service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:36.797629 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-17b8b417-1bee-4af0-a279-1e4537535f82 req-745f5a79-35a1-448b-a1d7-296a0a766bdd service nova] Creating event network-vif-plugged:36e7a186-ebb0-4a76-af6a-cd120bd63d63 for instance 9b9170ad-8804-4603-b35b-f7a3d2c4af62 on n-h1-850499-9 Aug 31 16:16:36.816357 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-17b8b417-1bee-4af0-a279-1e4537535f82 req-745f5a79-35a1-448b-a1d7-296a0a766bdd service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084507 Aug 31 16:16:36.819133 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2224/4441] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:16:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:16:36.836350 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-aa184892-8111-4fc6-929a-1c76f488d903 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:36.837373 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-aa184892-8111-4fc6-929a-1c76f488d903 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] [instance: 0807b71a-b3ab-4bad-a3b4-a00fc39dedb6] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:36.863728 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-aa184892-8111-4fc6-929a-1c76f488d903 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:36.863728 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-aa184892-8111-4fc6-929a-1c76f488d903 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:36.863728 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-aa184892-8111-4fc6-929a-1c76f488d903 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:36.872433 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-aa184892-8111-4fc6-929a-1c76f488d903 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:36.873231 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-aa184892-8111-4fc6-929a-1c76f488d903 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:36.873983 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-aa184892-8111-4fc6-929a-1c76f488d903 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:37.183660 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-293d27c4-1f7d-4a3c-9d1f-d15278a5ad6f tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09abc9573e94951b69e871170cbcf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc0aa4c03f84f5691d4e7b8c5da75e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:37.201139 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-293d27c4-1f7d-4a3c-9d1f-d15278a5ad6f tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] 10.222.0.61 "GET /compute/v2.1/servers/8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21" status: 200 len: 1526 microversion: 2.1 time: 0.642569 Aug 31 16:16:37.201728 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2218/4442] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:36 2022] GET /compute/v2.1/servers/8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21 => generated 1526 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:37.227308 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-30bdcf06-8cfe-4ff1-8a2f-d9e4d13c3868 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:37.230357 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-30bdcf06-8cfe-4ff1-8a2f-d9e4d13c3868 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] [instance: 8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:37.245217 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-30bdcf06-8cfe-4ff1-8a2f-d9e4d13c3868 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:37.251914 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-30bdcf06-8cfe-4ff1-8a2f-d9e4d13c3868 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:37.252666 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-30bdcf06-8cfe-4ff1-8a2f-d9e4d13c3868 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:37.254425 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-30bdcf06-8cfe-4ff1-8a2f-d9e4d13c3868 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:37.258864 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-30bdcf06-8cfe-4ff1-8a2f-d9e4d13c3868 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:37.260049 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-30bdcf06-8cfe-4ff1-8a2f-d9e4d13c3868 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:37.547121 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-aa184892-8111-4fc6-929a-1c76f488d903 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a598a2bec3e34c239c9fad419545eb52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25e974933e564e5da170dfe26fe921c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:37.556709 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-aa184892-8111-4fc6-929a-1c76f488d903 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] 10.222.0.61 "GET /compute/v2.1/servers/0807b71a-b3ab-4bad-a3b4-a00fc39dedb6" status: 200 len: 1325 microversion: 2.1 time: 0.735081 Aug 31 16:16:37.557789 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2225/4443] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:36 2022] GET /compute/v2.1/servers/0807b71a-b3ab-4bad-a3b4-a00fc39dedb6 => generated 1325 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:37.578895 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a45fa798-96a4-473d-8ebb-417d2505cf08 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:37.579648 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a45fa798-96a4-473d-8ebb-417d2505cf08 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] [instance: f04eb48d-000e-4c3b-8799-a4d3cdacf0e2] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:37.596781 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a45fa798-96a4-473d-8ebb-417d2505cf08 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:37.598073 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a45fa798-96a4-473d-8ebb-417d2505cf08 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:37.598736 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a45fa798-96a4-473d-8ebb-417d2505cf08 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:37.600152 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a45fa798-96a4-473d-8ebb-417d2505cf08 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:37.600940 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a45fa798-96a4-473d-8ebb-417d2505cf08 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:37.601636 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a45fa798-96a4-473d-8ebb-417d2505cf08 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:37.776584 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-30bdcf06-8cfe-4ff1-8a2f-d9e4d13c3868 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09abc9573e94951b69e871170cbcf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc0aa4c03f84f5691d4e7b8c5da75e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:37.798043 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-30bdcf06-8cfe-4ff1-8a2f-d9e4d13c3868 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] 10.222.0.61 "GET /compute/v2.1/servers/8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21" status: 200 len: 1526 microversion: 2.1 time: 0.570999 Aug 31 16:16:37.799430 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2219/4444] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:37 2022] GET /compute/v2.1/servers/8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21 => generated 1526 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:37.812955 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f198f3f4-b695-4c57-83d2-8d1ba95d4979 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:37.813852 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f198f3f4-b695-4c57-83d2-8d1ba95d4979 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: 9b9170ad-8804-4603-b35b-f7a3d2c4af62] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:37.824667 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f198f3f4-b695-4c57-83d2-8d1ba95d4979 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:37.825117 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f198f3f4-b695-4c57-83d2-8d1ba95d4979 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:37.825546 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f198f3f4-b695-4c57-83d2-8d1ba95d4979 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:37.826283 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f198f3f4-b695-4c57-83d2-8d1ba95d4979 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:37.826742 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f198f3f4-b695-4c57-83d2-8d1ba95d4979 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:37.827180 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f198f3f4-b695-4c57-83d2-8d1ba95d4979 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:38.110171 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a45fa798-96a4-473d-8ebb-417d2505cf08 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed06378eb9b446680b5a3156a14941d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511432a7dee4bec9d1093c9d95b3734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:38.121876 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a45fa798-96a4-473d-8ebb-417d2505cf08 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] 10.222.0.61 "GET /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2" status: 200 len: 1676 microversion: 2.1 time: 0.562532 Aug 31 16:16:38.126418 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2226/4445] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:37 2022] GET /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2 => generated 1676 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:38.131267 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-9b99137c-1e2e-4a2f-9040-87e10c53452c req-f67c6188-be97-45f5-afdc-3880fb33497d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0807b71a-b3ab-4bad-a3b4-a00fc39dedb6", "tag": "5d3f634d-786f-418e-87e5-1b6e9210479b"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:16:38.156125 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-9b99137c-1e2e-4a2f-9040-87e10c53452c req-f67c6188-be97-45f5-afdc-3880fb33497d service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:38.156858 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-9b99137c-1e2e-4a2f-9040-87e10c53452c req-f67c6188-be97-45f5-afdc-3880fb33497d service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:38.157050 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-9b99137c-1e2e-4a2f-9040-87e10c53452c req-f67c6188-be97-45f5-afdc-3880fb33497d service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:38.195676 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-9b99137c-1e2e-4a2f-9040-87e10c53452c req-f67c6188-be97-45f5-afdc-3880fb33497d service nova] Creating event network-changed:5d3f634d-786f-418e-87e5-1b6e9210479b for instance 0807b71a-b3ab-4bad-a3b4-a00fc39dedb6 on n-h2-850499-9 Aug 31 16:16:38.201909 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-9b99137c-1e2e-4a2f-9040-87e10c53452c req-f67c6188-be97-45f5-afdc-3880fb33497d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074016 Aug 31 16:16:38.204149 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2227/4446] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:16:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:16:38.415148 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f198f3f4-b695-4c57-83d2-8d1ba95d4979 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb261f2061164b49a8d496b16647dd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d2222a956a4888967e21647e26b310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:38.433142 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f198f3f4-b695-4c57-83d2-8d1ba95d4979 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "GET /compute/v2.1/servers/9b9170ad-8804-4603-b35b-f7a3d2c4af62" status: 200 len: 1317 microversion: 2.1 time: 0.629895 Aug 31 16:16:38.437115 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2220/4447] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:37 2022] GET /compute/v2.1/servers/9b9170ad-8804-4603-b35b-f7a3d2c4af62 => generated 1317 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:38.582489 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ba5ec9b0-cb47-4657-b965-b6808f932a2a tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:38.583126 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ba5ec9b0-cb47-4657-b965-b6808f932a2a tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] [instance: 0807b71a-b3ab-4bad-a3b4-a00fc39dedb6] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:38.609284 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ba5ec9b0-cb47-4657-b965-b6808f932a2a tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:38.611091 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ba5ec9b0-cb47-4657-b965-b6808f932a2a tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:38.613810 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ba5ec9b0-cb47-4657-b965-b6808f932a2a tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:38.616851 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ba5ec9b0-cb47-4657-b965-b6808f932a2a tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:38.617371 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ba5ec9b0-cb47-4657-b965-b6808f932a2a tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:38.621131 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ba5ec9b0-cb47-4657-b965-b6808f932a2a tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:38.697719 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-39086cd1-32fd-4404-beb6-d5e403cb6d69 tempest-ServersNegativeTestMultiTenantJSON-108136532 tempest-ServersNegativeTestMultiTenantJSON-108136532-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:38.700116 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-39086cd1-32fd-4404-beb6-d5e403cb6d69 tempest-ServersNegativeTestMultiTenantJSON-108136532 tempest-ServersNegativeTestMultiTenantJSON-108136532-project] [instance: 8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:38.724813 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-39086cd1-32fd-4404-beb6-d5e403cb6d69 tempest-ServersNegativeTestMultiTenantJSON-108136532 tempest-ServersNegativeTestMultiTenantJSON-108136532-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:38.725796 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-39086cd1-32fd-4404-beb6-d5e403cb6d69 tempest-ServersNegativeTestMultiTenantJSON-108136532 tempest-ServersNegativeTestMultiTenantJSON-108136532-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:38.726684 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-39086cd1-32fd-4404-beb6-d5e403cb6d69 tempest-ServersNegativeTestMultiTenantJSON-108136532 tempest-ServersNegativeTestMultiTenantJSON-108136532-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:38.729248 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-39086cd1-32fd-4404-beb6-d5e403cb6d69 tempest-ServersNegativeTestMultiTenantJSON-108136532 tempest-ServersNegativeTestMultiTenantJSON-108136532-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:38.729780 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=100 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:16:38.740657 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-39086cd1-32fd-4404-beb6-d5e403cb6d69 tempest-ServersNegativeTestMultiTenantJSON-108136532 tempest-ServersNegativeTestMultiTenantJSON-108136532-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:38.744485 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-39086cd1-32fd-4404-beb6-d5e403cb6d69 tempest-ServersNegativeTestMultiTenantJSON-108136532 tempest-ServersNegativeTestMultiTenantJSON-108136532-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:38.801985 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-39086cd1-32fd-4404-beb6-d5e403cb6d69 tempest-ServersNegativeTestMultiTenantJSON-108136532 tempest-ServersNegativeTestMultiTenantJSON-108136532-project] HTTP exception thrown: Instance 8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21 could not be found. Aug 31 16:16:38.804953 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-39086cd1-32fd-4404-beb6-d5e403cb6d69 tempest-ServersNegativeTestMultiTenantJSON-108136532 tempest-ServersNegativeTestMultiTenantJSON-108136532-project] Request method failure captured: Aug 31 16:16:38.804953 n-d-850499-9 devstack@n-api.service[122257]: request: DELETE /compute/v2.1/servers/8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21 HTTP/1.1 Aug 31 16:16:38.804953 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:16:38.804953 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:16:38.804953 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:16:38.804953 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:16:38.804953 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:16:38.804953 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:16:38.804953 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:16:38.804953 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:16:38.804953 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4lE9dS4lgpi6n8asMOiM-qEIpOuW647EYo6xZS09eg5F_xo_P1TDhPp9uw5WWYMJH-63sI1RjTLosJQZSvzF1SqK-LJ4FAww9r4ByU66axP1vl-OJVcWvNEvprXwIBnpae40lG0lfduxIgBjlNoka7gBWr4_CCBQjXEmsKWsVkbzVE Aug 31 16:16:38.804953 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:16:38.804953 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:16:38.804953 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:16:38.804953 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:16:38.804953 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:16:38.804953 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:16:38.804953 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: e9c0a87d2c7247418a8f5fc9ac28a443 Aug 31 16:16:38.804953 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-108136532 Aug 31 16:16:38.804953 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:16:38.804953 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:16:38.804953 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e9c0a87d2c7247418a8f5fc9ac28a443"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/e9c0a87d2c7247418a8f5fc9ac28a443"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_e9c0a87d2c7247418a8f5fc9ac28a443", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e9c0a87d2c7247418a8f5fc9ac28a443"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:16:38.804953 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-108136532 Aug 31 16:16:38.804953 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: e9c0a87d2c7247418a8f5fc9ac28a443 Aug 31 16:16:38.804953 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-108136532 Aug 31 16:16:38.804953 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ServersNegativeTestMultiTenantJSON-108136532-project Aug 31 16:16:38.804953 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:16:38.804953 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:16:38.804953 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 9a90856484574c91be53bd21c97e1094 Aug 31 16:16:38.804953 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-108136532-project Aug 31 16:16:38.804953 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:16:38.804953 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance 8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21 could not be found. Aug 31 16:16:38.804953 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21'} Aug 31 16:16:38.804953 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:16:38.804953 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:38.804953 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:16:38.804953 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:16:38.804953 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:16:38.804953 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:16:38.804953 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:16:38.804953 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:16:38.804953 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:16:38.804953 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:16:38.804953 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21 could not be found. Aug 31 16:16:38.804953 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:16:38.804953 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:38.804953 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:16:38.804953 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:38.804953 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:38.804953 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:38.804953 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:16:38.804953 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:16:38.804953 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:16:38.804953 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:16:38.804953 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:16:38.804953 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:16:38.804953 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:16:38.804953 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:16:38.804953 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:16:38.804953 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:16:38.804953 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:16:38.804953 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:16:38.808948 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21 could not be found. Aug 31 16:16:38.808948 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:16:38.808948 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:38.808948 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:16:38.808948 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:38.808948 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:38.808948 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:38.808948 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:16:38.808948 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:16:38.808948 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21 could not be found. Aug 31 16:16:38.808948 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:16:38.808948 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-39086cd1-32fd-4404-beb6-d5e403cb6d69 tempest-ServersNegativeTestMultiTenantJSON-108136532 tempest-ServersNegativeTestMultiTenantJSON-108136532-project] Returning 404 to user: Instance 8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:16:38.808948 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-39086cd1-32fd-4404-beb6-d5e403cb6d69 tempest-ServersNegativeTestMultiTenantJSON-108136532 tempest-ServersNegativeTestMultiTenantJSON-108136532-project] 10.222.0.61 "DELETE /compute/v2.1/servers/8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21" status: 404 len: 111 microversion: 2.1 time: 0.600847 Aug 31 16:16:38.820769 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2228/4448] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:16:38 2022] DELETE /compute/v2.1/servers/8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21 => generated 111 bytes in 615 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:16:38.831447 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-fb421c0d-1924-46a8-b1bc-c9d34f396fd7 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:38.839731 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-fb421c0d-1924-46a8-b1bc-c9d34f396fd7 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] [instance: 8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:38.897131 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fb421c0d-1924-46a8-b1bc-c9d34f396fd7 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:38.899135 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fb421c0d-1924-46a8-b1bc-c9d34f396fd7 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:38.899911 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fb421c0d-1924-46a8-b1bc-c9d34f396fd7 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:38.903365 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fb421c0d-1924-46a8-b1bc-c9d34f396fd7 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:38.905076 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fb421c0d-1924-46a8-b1bc-c9d34f396fd7 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:38.907027 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fb421c0d-1924-46a8-b1bc-c9d34f396fd7 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:39.778748 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ba5ec9b0-cb47-4657-b965-b6808f932a2a tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a598a2bec3e34c239c9fad419545eb52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25e974933e564e5da170dfe26fe921c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:39.790136 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ba5ec9b0-cb47-4657-b965-b6808f932a2a tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] 10.222.0.61 "GET /compute/v2.1/servers/0807b71a-b3ab-4bad-a3b4-a00fc39dedb6" status: 200 len: 1325 microversion: 2.1 time: 1.215607 Aug 31 16:16:39.791087 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2221/4449] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:38 2022] GET /compute/v2.1/servers/0807b71a-b3ab-4bad-a3b4-a00fc39dedb6 => generated 1325 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:16:39.804547 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-07cec9eb-6bb7-4f1d-a142-c0a03df82c12 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:39.805170 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-07cec9eb-6bb7-4f1d-a142-c0a03df82c12 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] [instance: f04eb48d-000e-4c3b-8799-a4d3cdacf0e2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:39.816229 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-07cec9eb-6bb7-4f1d-a142-c0a03df82c12 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:39.817112 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-07cec9eb-6bb7-4f1d-a142-c0a03df82c12 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:39.817756 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-07cec9eb-6bb7-4f1d-a142-c0a03df82c12 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:39.818677 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-07cec9eb-6bb7-4f1d-a142-c0a03df82c12 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:39.819423 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-07cec9eb-6bb7-4f1d-a142-c0a03df82c12 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:39.820290 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-07cec9eb-6bb7-4f1d-a142-c0a03df82c12 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:40.345278 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-fb421c0d-1924-46a8-b1bc-c9d34f396fd7 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09abc9573e94951b69e871170cbcf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc0aa4c03f84f5691d4e7b8c5da75e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:40.358133 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-fb421c0d-1924-46a8-b1bc-c9d34f396fd7 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] 10.222.0.61 "GET /compute/v2.1/servers/8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21" status: 200 len: 1526 microversion: 2.1 time: 1.536004 Aug 31 16:16:40.359409 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2229/4450] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:38 2022] GET /compute/v2.1/servers/8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21 => generated 1526 bytes in 1538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:40.365318 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5a53d899-2435-4892-8547-298f27d4be9b tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:40.366171 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5a53d899-2435-4892-8547-298f27d4be9b tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: 9b9170ad-8804-4603-b35b-f7a3d2c4af62] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:40.378113 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5a53d899-2435-4892-8547-298f27d4be9b tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:40.379345 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5a53d899-2435-4892-8547-298f27d4be9b tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:40.379978 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5a53d899-2435-4892-8547-298f27d4be9b tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:40.380969 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5a53d899-2435-4892-8547-298f27d4be9b tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:40.382043 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5a53d899-2435-4892-8547-298f27d4be9b tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:40.382678 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5a53d899-2435-4892-8547-298f27d4be9b tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:41.155854 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5a53d899-2435-4892-8547-298f27d4be9b tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb261f2061164b49a8d496b16647dd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d2222a956a4888967e21647e26b310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:41.175161 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5a53d899-2435-4892-8547-298f27d4be9b tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "GET /compute/v2.1/servers/9b9170ad-8804-4603-b35b-f7a3d2c4af62" status: 200 len: 1508 microversion: 2.1 time: 0.814145 Aug 31 16:16:41.196128 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-07cec9eb-6bb7-4f1d-a142-c0a03df82c12 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed06378eb9b446680b5a3156a14941d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511432a7dee4bec9d1093c9d95b3734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:41.205495 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2230/4451] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:40 2022] GET /compute/v2.1/servers/9b9170ad-8804-4603-b35b-f7a3d2c4af62 => generated 1508 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:41.215352 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-dfdc44d1-6c97-49f0-b954-daf0a6ccb3b1 tempest-ServersNegativeTestMultiTenantJSON-108136532 tempest-ServersNegativeTestMultiTenantJSON-108136532-project] Action: 'update', calling method: >, body: {"server": {"name": "8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21_new"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:16:41.222639 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-07cec9eb-6bb7-4f1d-a142-c0a03df82c12 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] 10.222.0.61 "GET /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2" status: 200 len: 1676 microversion: 2.1 time: 1.421639 Aug 31 16:16:41.245708 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2222/4452] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:39 2022] GET /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2 => generated 1676 bytes in 1452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:41.250865 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-967d582b-36fe-4c6f-b804-ef9fe38977c9 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:41.251767 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-967d582b-36fe-4c6f-b804-ef9fe38977c9 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] [instance: 0807b71a-b3ab-4bad-a3b4-a00fc39dedb6] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:41.259435 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-dfdc44d1-6c97-49f0-b954-daf0a6ccb3b1 tempest-ServersNegativeTestMultiTenantJSON-108136532 tempest-ServersNegativeTestMultiTenantJSON-108136532-project] [instance: 8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:41.278397 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-967d582b-36fe-4c6f-b804-ef9fe38977c9 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:41.283654 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dfdc44d1-6c97-49f0-b954-daf0a6ccb3b1 tempest-ServersNegativeTestMultiTenantJSON-108136532 tempest-ServersNegativeTestMultiTenantJSON-108136532-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:41.284156 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dfdc44d1-6c97-49f0-b954-daf0a6ccb3b1 tempest-ServersNegativeTestMultiTenantJSON-108136532 tempest-ServersNegativeTestMultiTenantJSON-108136532-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:41.284644 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dfdc44d1-6c97-49f0-b954-daf0a6ccb3b1 tempest-ServersNegativeTestMultiTenantJSON-108136532 tempest-ServersNegativeTestMultiTenantJSON-108136532-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:41.290769 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-967d582b-36fe-4c6f-b804-ef9fe38977c9 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:41.292036 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-967d582b-36fe-4c6f-b804-ef9fe38977c9 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:41.293039 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dfdc44d1-6c97-49f0-b954-daf0a6ccb3b1 tempest-ServersNegativeTestMultiTenantJSON-108136532 tempest-ServersNegativeTestMultiTenantJSON-108136532-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:41.293548 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dfdc44d1-6c97-49f0-b954-daf0a6ccb3b1 tempest-ServersNegativeTestMultiTenantJSON-108136532 tempest-ServersNegativeTestMultiTenantJSON-108136532-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:41.293999 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dfdc44d1-6c97-49f0-b954-daf0a6ccb3b1 tempest-ServersNegativeTestMultiTenantJSON-108136532 tempest-ServersNegativeTestMultiTenantJSON-108136532-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:41.298386 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-967d582b-36fe-4c6f-b804-ef9fe38977c9 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:41.301900 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-967d582b-36fe-4c6f-b804-ef9fe38977c9 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:41.305096 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-967d582b-36fe-4c6f-b804-ef9fe38977c9 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:41.331467 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-dfdc44d1-6c97-49f0-b954-daf0a6ccb3b1 tempest-ServersNegativeTestMultiTenantJSON-108136532 tempest-ServersNegativeTestMultiTenantJSON-108136532-project] HTTP exception thrown: Instance 8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21 could not be found. Aug 31 16:16:41.335974 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-dfdc44d1-6c97-49f0-b954-daf0a6ccb3b1 tempest-ServersNegativeTestMultiTenantJSON-108136532 tempest-ServersNegativeTestMultiTenantJSON-108136532-project] Request method failure captured: Aug 31 16:16:41.335974 n-d-850499-9 devstack@n-api.service[122257]: request: PUT /compute/v2.1/servers/8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21 HTTP/1.1 Aug 31 16:16:41.335974 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:16:41.335974 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:16:41.335974 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:16:41.335974 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 64 Aug 31 16:16:41.335974 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:16:41.335974 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:16:41.335974 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:16:41.335974 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:16:41.335974 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4lE9dS4lgpi6n8asMOiM-qEIpOuW647EYo6xZS09eg5F_xo_P1TDhPp9uw5WWYMJH-63sI1RjTLosJQZSvzF1SqK-LJ4FAww9r4ByU66axP1vl-OJVcWvNEvprXwIBnpae40lG0lfduxIgBjlNoka7gBWr4_CCBQjXEmsKWsVkbzVE Aug 31 16:16:41.335974 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:16:41.335974 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:16:41.335974 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:16:41.335974 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:16:41.335974 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:16:41.335974 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:16:41.335974 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: e9c0a87d2c7247418a8f5fc9ac28a443 Aug 31 16:16:41.335974 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-108136532 Aug 31 16:16:41.335974 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:16:41.335974 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:16:41.335974 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e9c0a87d2c7247418a8f5fc9ac28a443"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/e9c0a87d2c7247418a8f5fc9ac28a443"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_e9c0a87d2c7247418a8f5fc9ac28a443", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e9c0a87d2c7247418a8f5fc9ac28a443"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:16:41.335974 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-108136532 Aug 31 16:16:41.335974 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: e9c0a87d2c7247418a8f5fc9ac28a443 Aug 31 16:16:41.335974 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-108136532 Aug 31 16:16:41.335974 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ServersNegativeTestMultiTenantJSON-108136532-project Aug 31 16:16:41.335974 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:16:41.335974 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:16:41.335974 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 9a90856484574c91be53bd21c97e1094 Aug 31 16:16:41.335974 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-108136532-project Aug 31 16:16:41.335974 n-d-850499-9 devstack@n-api.service[122257]: Aug 31 16:16:41.335974 n-d-850499-9 devstack@n-api.service[122257]: {"server": {"name": "8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21_new"}} Aug 31 16:16:41.335974 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:16:41.335974 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance 8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21 could not be found. Aug 31 16:16:41.335974 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21', 'body': {'server': {'name': '8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21_new'}}} Aug 31 16:16:41.335974 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:16:41.335974 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:41.335974 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:16:41.335974 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:16:41.335974 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:16:41.335974 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:16:41.335974 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:16:41.335974 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:16:41.335974 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:16:41.335974 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:16:41.335974 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21 could not be found. Aug 31 16:16:41.335974 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:16:41.335974 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:41.335974 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:16:41.335974 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:41.335974 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:41.335974 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:41.335974 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:16:41.335974 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:16:41.335974 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:16:41.335974 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:16:41.335974 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:16:41.335974 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:16:41.335974 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:16:41.335974 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:16:41.335974 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:16:41.335974 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:16:41.335974 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 31 16:16:41.339237 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Aug 31 16:16:41.339237 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Aug 31 16:16:41.339237 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:16:41.339237 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:16:41.339237 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:16:41.339237 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:16:41.339237 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21 could not be found. Aug 31 16:16:41.339237 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:16:41.339237 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:41.339237 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:16:41.339237 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:41.339237 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:41.339237 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:41.339237 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:16:41.339237 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:16:41.339237 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21 could not be found. Aug 31 16:16:41.339237 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:16:41.345146 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-dfdc44d1-6c97-49f0-b954-daf0a6ccb3b1 tempest-ServersNegativeTestMultiTenantJSON-108136532 tempest-ServersNegativeTestMultiTenantJSON-108136532-project] Returning 404 to user: Instance 8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:16:41.346336 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-dfdc44d1-6c97-49f0-b954-daf0a6ccb3b1 tempest-ServersNegativeTestMultiTenantJSON-108136532 tempest-ServersNegativeTestMultiTenantJSON-108136532-project] 10.222.0.61 "PUT /compute/v2.1/servers/8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21" status: 404 len: 111 microversion: 2.1 time: 0.138911 Aug 31 16:16:41.349854 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2231/4453] 10.222.0.61 () {60 vars in 1256 bytes} [Wed Aug 31 16:16:41 2022] PUT /compute/v2.1/servers/8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21 => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:16:41.355754 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2da50027-e483-43ea-916f-5dee44481e6a tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:41.356585 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2da50027-e483-43ea-916f-5dee44481e6a tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: 9b9170ad-8804-4603-b35b-f7a3d2c4af62] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:41.383259 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2da50027-e483-43ea-916f-5dee44481e6a tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:41.384128 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2da50027-e483-43ea-916f-5dee44481e6a tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:41.384765 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2da50027-e483-43ea-916f-5dee44481e6a tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:41.386225 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2da50027-e483-43ea-916f-5dee44481e6a tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:41.388231 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2da50027-e483-43ea-916f-5dee44481e6a tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:41.391718 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2da50027-e483-43ea-916f-5dee44481e6a tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:41.808180 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-967d582b-36fe-4c6f-b804-ef9fe38977c9 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a598a2bec3e34c239c9fad419545eb52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25e974933e564e5da170dfe26fe921c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:41.819064 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-967d582b-36fe-4c6f-b804-ef9fe38977c9 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] 10.222.0.61 "GET /compute/v2.1/servers/0807b71a-b3ab-4bad-a3b4-a00fc39dedb6" status: 200 len: 1325 microversion: 2.1 time: 0.572116 Aug 31 16:16:41.819687 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2223/4454] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:41 2022] GET /compute/v2.1/servers/0807b71a-b3ab-4bad-a3b4-a00fc39dedb6 => generated 1325 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:41.838665 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a32df8e6-eb33-4587-a831-bba79a5115ba tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:41.839470 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a32df8e6-eb33-4587-a831-bba79a5115ba tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] [instance: 8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:41.846953 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a32df8e6-eb33-4587-a831-bba79a5115ba tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:41.847878 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a32df8e6-eb33-4587-a831-bba79a5115ba tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:41.848550 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a32df8e6-eb33-4587-a831-bba79a5115ba tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:41.849475 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a32df8e6-eb33-4587-a831-bba79a5115ba tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:41.850133 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a32df8e6-eb33-4587-a831-bba79a5115ba tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:41.850763 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a32df8e6-eb33-4587-a831-bba79a5115ba tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:41.883107 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a32df8e6-eb33-4587-a831-bba79a5115ba tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] [instance: 8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21] Going to try to terminate instance {{(pid=122256) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:16:41.961694 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2da50027-e483-43ea-916f-5dee44481e6a tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb261f2061164b49a8d496b16647dd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d2222a956a4888967e21647e26b310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:41.976410 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2da50027-e483-43ea-916f-5dee44481e6a tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "GET /compute/v2.1/servers/9b9170ad-8804-4603-b35b-f7a3d2c4af62" status: 200 len: 1508 microversion: 2.1 time: 0.625123 Aug 31 16:16:41.978090 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2232/4455] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:41 2022] GET /compute/v2.1/servers/9b9170ad-8804-4603-b35b-f7a3d2c4af62 => generated 1508 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:42.010900 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a32df8e6-eb33-4587-a831-bba79a5115ba tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] 10.222.0.61 "DELETE /compute/v2.1/servers/8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21" status: 204 len: 0 microversion: 2.1 time: 0.176058 Aug 31 16:16:42.015443 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2224/4456] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:16:41 2022] DELETE /compute/v2.1/servers/8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:16:42.019867 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6c47d54c-2d18-4034-88b6-4d97618fdfb8 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:16:42.025695 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6c47d54c-2d18-4034-88b6-4d97618fdfb8 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: 9b9170ad-8804-4603-b35b-f7a3d2c4af62] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:42.027332 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-850aea4e-cb27-4ae4-87d9-d1b293baac90 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:42.032267 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-850aea4e-cb27-4ae4-87d9-d1b293baac90 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] [instance: 8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:42.037307 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6c47d54c-2d18-4034-88b6-4d97618fdfb8 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:42.041750 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6c47d54c-2d18-4034-88b6-4d97618fdfb8 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:42.042591 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6c47d54c-2d18-4034-88b6-4d97618fdfb8 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:42.044216 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6c47d54c-2d18-4034-88b6-4d97618fdfb8 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:42.045011 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6c47d54c-2d18-4034-88b6-4d97618fdfb8 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:42.048485 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-850aea4e-cb27-4ae4-87d9-d1b293baac90 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:42.050114 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6c47d54c-2d18-4034-88b6-4d97618fdfb8 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:42.051184 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-850aea4e-cb27-4ae4-87d9-d1b293baac90 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:42.052546 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-850aea4e-cb27-4ae4-87d9-d1b293baac90 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:42.054063 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-850aea4e-cb27-4ae4-87d9-d1b293baac90 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:42.056664 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-850aea4e-cb27-4ae4-87d9-d1b293baac90 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:42.057232 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-850aea4e-cb27-4ae4-87d9-d1b293baac90 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:42.301665 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6c47d54c-2d18-4034-88b6-4d97618fdfb8 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "PUT /compute/v2.1/servers/9b9170ad-8804-4603-b35b-f7a3d2c4af62" status: 200 len: 1080 microversion: 2.1 time: 0.302373 Aug 31 16:16:42.305134 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2233/4457] 10.222.0.61 () {60 vars in 1256 bytes} [Wed Aug 31 16:16:41 2022] PUT /compute/v2.1/servers/9b9170ad-8804-4603-b35b-f7a3d2c4af62 => generated 1080 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:42.319608 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8c4ef341-5566-4b35-84e0-cf38e9b49bae tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:42.321198 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8c4ef341-5566-4b35-84e0-cf38e9b49bae tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] [instance: f04eb48d-000e-4c3b-8799-a4d3cdacf0e2] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:42.340447 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8c4ef341-5566-4b35-84e0-cf38e9b49bae tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:42.341203 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8c4ef341-5566-4b35-84e0-cf38e9b49bae tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:42.341932 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8c4ef341-5566-4b35-84e0-cf38e9b49bae tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:42.343563 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8c4ef341-5566-4b35-84e0-cf38e9b49bae tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:42.349764 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8c4ef341-5566-4b35-84e0-cf38e9b49bae tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:42.351113 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8c4ef341-5566-4b35-84e0-cf38e9b49bae tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:42.658907 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-850aea4e-cb27-4ae4-87d9-d1b293baac90 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09abc9573e94951b69e871170cbcf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc0aa4c03f84f5691d4e7b8c5da75e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:42.674503 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-850aea4e-cb27-4ae4-87d9-d1b293baac90 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] 10.222.0.61 "GET /compute/v2.1/servers/8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21" status: 200 len: 1532 microversion: 2.1 time: 0.656300 Aug 31 16:16:42.675457 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2225/4458] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:42 2022] GET /compute/v2.1/servers/8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21 => generated 1532 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:42.687247 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f4190361-e340-4a7f-9eb0-9c7ed01a933b tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:42.687906 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f4190361-e340-4a7f-9eb0-9c7ed01a933b tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: 9b9170ad-8804-4603-b35b-f7a3d2c4af62] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:42.711268 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f4190361-e340-4a7f-9eb0-9c7ed01a933b tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:42.711810 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f4190361-e340-4a7f-9eb0-9c7ed01a933b tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:42.712258 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f4190361-e340-4a7f-9eb0-9c7ed01a933b tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:42.713057 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f4190361-e340-4a7f-9eb0-9c7ed01a933b tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:42.713687 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f4190361-e340-4a7f-9eb0-9c7ed01a933b tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:42.714266 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f4190361-e340-4a7f-9eb0-9c7ed01a933b tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:42.737749 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8c4ef341-5566-4b35-84e0-cf38e9b49bae tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed06378eb9b446680b5a3156a14941d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511432a7dee4bec9d1093c9d95b3734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:42.746123 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:16:42.751141 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8c4ef341-5566-4b35-84e0-cf38e9b49bae tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] 10.222.0.61 "GET /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2" status: 200 len: 1676 microversion: 2.1 time: 0.443263 Aug 31 16:16:42.765016 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2234/4459] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:42 2022] GET /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2 => generated 1676 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:42.769820 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8c4ef341-5566-4b35-84e0-cf38e9b49bae tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:42.771907 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8c4ef341-5566-4b35-84e0-cf38e9b49bae tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] 10.222.0.61 "GET /compute//" status: 200 len: 377 microversion: - time: 0.004565 Aug 31 16:16:42.772558 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2235/4460] 10.222.0.61 () {56 vars in 886 bytes} [Wed Aug 31 16:16:42 2022] GET /compute/ => generated 377 bytes in 7 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 31 16:16:42.856532 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-83ad0659-389b-4c8f-95df-f56cce993bcf tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:42.861078 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-83ad0659-389b-4c8f-95df-f56cce993bcf tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] [instance: 0807b71a-b3ab-4bad-a3b4-a00fc39dedb6] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:42.871163 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-83ad0659-389b-4c8f-95df-f56cce993bcf tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:42.872020 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-83ad0659-389b-4c8f-95df-f56cce993bcf tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:42.872649 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-83ad0659-389b-4c8f-95df-f56cce993bcf tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:42.873541 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-83ad0659-389b-4c8f-95df-f56cce993bcf tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:42.874771 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-83ad0659-389b-4c8f-95df-f56cce993bcf tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:42.875371 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-83ad0659-389b-4c8f-95df-f56cce993bcf tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:43.302631 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f4190361-e340-4a7f-9eb0-9c7ed01a933b tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb261f2061164b49a8d496b16647dd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d2222a956a4888967e21647e26b310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:43.314845 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f4190361-e340-4a7f-9eb0-9c7ed01a933b tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "GET /compute/v2.1/servers/9b9170ad-8804-4603-b35b-f7a3d2c4af62" status: 200 len: 1506 microversion: 2.1 time: 0.636182 Aug 31 16:16:43.316977 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2226/4461] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:42 2022] GET /compute/v2.1/servers/9b9170ad-8804-4603-b35b-f7a3d2c4af62 => generated 1506 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:43.343439 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2176375e-26be-4244-8802-bb5f461ca93d tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:43.344120 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2176375e-26be-4244-8802-bb5f461ca93d tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: 9b9170ad-8804-4603-b35b-f7a3d2c4af62] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:43.358307 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2176375e-26be-4244-8802-bb5f461ca93d tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:43.361435 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2176375e-26be-4244-8802-bb5f461ca93d tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:43.361652 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-83ad0659-389b-4c8f-95df-f56cce993bcf tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a598a2bec3e34c239c9fad419545eb52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25e974933e564e5da170dfe26fe921c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:43.362139 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2176375e-26be-4244-8802-bb5f461ca93d tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:43.362996 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2176375e-26be-4244-8802-bb5f461ca93d tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:43.368693 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2176375e-26be-4244-8802-bb5f461ca93d tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:43.369598 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2176375e-26be-4244-8802-bb5f461ca93d tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:43.380709 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-83ad0659-389b-4c8f-95df-f56cce993bcf tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] 10.222.0.61 "GET /compute/v2.1/servers/0807b71a-b3ab-4bad-a3b4-a00fc39dedb6" status: 200 len: 1325 microversion: 2.1 time: 0.538441 Aug 31 16:16:43.381757 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2236/4462] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:42 2022] GET /compute/v2.1/servers/0807b71a-b3ab-4bad-a3b4-a00fc39dedb6 => generated 1325 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:43.709061 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ea0e03c7-b76a-489a-a4dd-edb958ce6d4a tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:43.710023 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ea0e03c7-b76a-489a-a4dd-edb958ce6d4a tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] [instance: 8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:43.721103 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=84 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:16:43.725341 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ea0e03c7-b76a-489a-a4dd-edb958ce6d4a tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:43.725908 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ea0e03c7-b76a-489a-a4dd-edb958ce6d4a tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:43.726322 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ea0e03c7-b76a-489a-a4dd-edb958ce6d4a tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:43.727063 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ea0e03c7-b76a-489a-a4dd-edb958ce6d4a tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:43.727534 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ea0e03c7-b76a-489a-a4dd-edb958ce6d4a tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:43.727972 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ea0e03c7-b76a-489a-a4dd-edb958ce6d4a tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:43.776438 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-2176375e-26be-4244-8802-bb5f461ca93d tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb261f2061164b49a8d496b16647dd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d2222a956a4888967e21647e26b310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:43.796934 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2176375e-26be-4244-8802-bb5f461ca93d tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "GET /compute/v2.1/servers/9b9170ad-8804-4603-b35b-f7a3d2c4af62" status: 200 len: 1506 microversion: 2.1 time: 0.457695 Aug 31 16:16:43.814403 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2227/4463] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:43 2022] GET /compute/v2.1/servers/9b9170ad-8804-4603-b35b-f7a3d2c4af62 => generated 1506 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:43.820126 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-70a50430-1489-4f2d-bf7d-3f136b251b87 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:43.821337 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-70a50430-1489-4f2d-bf7d-3f136b251b87 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] [instance: f04eb48d-000e-4c3b-8799-a4d3cdacf0e2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:43.829636 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-70a50430-1489-4f2d-bf7d-3f136b251b87 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:43.830547 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-70a50430-1489-4f2d-bf7d-3f136b251b87 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:43.831132 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-70a50430-1489-4f2d-bf7d-3f136b251b87 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:43.832136 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-70a50430-1489-4f2d-bf7d-3f136b251b87 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:43.832747 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-70a50430-1489-4f2d-bf7d-3f136b251b87 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:43.833317 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-70a50430-1489-4f2d-bf7d-3f136b251b87 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:44.195493 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ea0e03c7-b76a-489a-a4dd-edb958ce6d4a tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09abc9573e94951b69e871170cbcf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc0aa4c03f84f5691d4e7b8c5da75e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:44.206539 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ea0e03c7-b76a-489a-a4dd-edb958ce6d4a tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] 10.222.0.61 "GET /compute/v2.1/servers/8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21" status: 200 len: 1532 microversion: 2.1 time: 0.501512 Aug 31 16:16:44.211927 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2237/4464] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:43 2022] GET /compute/v2.1/servers/8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21 => generated 1532 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:16:44.216986 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-df50bef1-2e35-445d-9f07-928452083852 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:16:44.229074 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-df50bef1-2e35-445d-9f07-928452083852 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: 9b9170ad-8804-4603-b35b-f7a3d2c4af62] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:44.240803 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-70a50430-1489-4f2d-bf7d-3f136b251b87 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed06378eb9b446680b5a3156a14941d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511432a7dee4bec9d1093c9d95b3734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:44.249740 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-70a50430-1489-4f2d-bf7d-3f136b251b87 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] 10.222.0.61 "GET /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2" status: 200 len: 1676 microversion: 2.1 time: 0.433545 Aug 31 16:16:44.256582 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2228/4465] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:43 2022] GET /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2 => generated 1676 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:44.263364 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-df50bef1-2e35-445d-9f07-928452083852 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:44.264120 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-df50bef1-2e35-445d-9f07-928452083852 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:44.265117 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-df50bef1-2e35-445d-9f07-928452083852 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:44.269616 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-df50bef1-2e35-445d-9f07-928452083852 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:44.270127 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-df50bef1-2e35-445d-9f07-928452083852 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:44.271786 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-df50bef1-2e35-445d-9f07-928452083852 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:44.409881 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4ab3ff7f-43d4-49c9-916a-9b41eead0713 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:44.410407 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4ab3ff7f-43d4-49c9-916a-9b41eead0713 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] [instance: 0807b71a-b3ab-4bad-a3b4-a00fc39dedb6] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:44.424948 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4ab3ff7f-43d4-49c9-916a-9b41eead0713 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:44.425460 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4ab3ff7f-43d4-49c9-916a-9b41eead0713 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:44.428037 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4ab3ff7f-43d4-49c9-916a-9b41eead0713 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:44.428806 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4ab3ff7f-43d4-49c9-916a-9b41eead0713 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:44.429285 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4ab3ff7f-43d4-49c9-916a-9b41eead0713 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:44.429727 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4ab3ff7f-43d4-49c9-916a-9b41eead0713 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:44.477524 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-df50bef1-2e35-445d-9f07-928452083852 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:16:44.478379 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-df50bef1-2e35-445d-9f07-928452083852 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:16:44.478671 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-df50bef1-2e35-445d-9f07-928452083852 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:16:44.484816 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-df50bef1-2e35-445d-9f07-928452083852 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:16:44.486347 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-df50bef1-2e35-445d-9f07-928452083852 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:16:44.689186 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-df50bef1-2e35-445d-9f07-928452083852 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: 9b9170ad-8804-4603-b35b-f7a3d2c4af62] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:44.721535 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-df50bef1-2e35-445d-9f07-928452083852 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:44.722052 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-df50bef1-2e35-445d-9f07-928452083852 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:44.722508 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-df50bef1-2e35-445d-9f07-928452083852 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:44.723255 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-df50bef1-2e35-445d-9f07-928452083852 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:44.723771 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-df50bef1-2e35-445d-9f07-928452083852 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:44.724218 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-df50bef1-2e35-445d-9f07-928452083852 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:44.805393 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-df50bef1-2e35-445d-9f07-928452083852 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "POST /compute/v2.1/servers/9b9170ad-8804-4603-b35b-f7a3d2c4af62/action" status: 202 len: 1112 microversion: 2.1 time: 0.591856 Aug 31 16:16:44.818935 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2238/4466] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:16:44 2022] POST /compute/v2.1/servers/9b9170ad-8804-4603-b35b-f7a3d2c4af62/action => generated 1112 bytes in 606 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 31 16:16:44.834440 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c43a7d67-4b06-408d-a1d6-781b9b212923 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:44.842197 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c43a7d67-4b06-408d-a1d6-781b9b212923 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: 9b9170ad-8804-4603-b35b-f7a3d2c4af62] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:44.874676 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c43a7d67-4b06-408d-a1d6-781b9b212923 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:44.874959 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c43a7d67-4b06-408d-a1d6-781b9b212923 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:44.876136 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c43a7d67-4b06-408d-a1d6-781b9b212923 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:44.877649 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c43a7d67-4b06-408d-a1d6-781b9b212923 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:44.878678 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c43a7d67-4b06-408d-a1d6-781b9b212923 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:44.879698 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c43a7d67-4b06-408d-a1d6-781b9b212923 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:45.863979 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-4ab3ff7f-43d4-49c9-916a-9b41eead0713 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a598a2bec3e34c239c9fad419545eb52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25e974933e564e5da170dfe26fe921c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:45.877374 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4ab3ff7f-43d4-49c9-916a-9b41eead0713 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] 10.222.0.61 "GET /compute/v2.1/servers/0807b71a-b3ab-4bad-a3b4-a00fc39dedb6" status: 200 len: 1325 microversion: 2.1 time: 1.472060 Aug 31 16:16:45.882968 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2229/4467] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:44 2022] GET /compute/v2.1/servers/0807b71a-b3ab-4bad-a3b4-a00fc39dedb6 => generated 1325 bytes in 1478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:16:45.897778 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1ca67223-82c5-4784-9f5e-b095dbe4b2a5 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:45.899154 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1ca67223-82c5-4784-9f5e-b095dbe4b2a5 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] [instance: 8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:45.922368 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1ca67223-82c5-4784-9f5e-b095dbe4b2a5 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:45.922950 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1ca67223-82c5-4784-9f5e-b095dbe4b2a5 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:45.923408 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1ca67223-82c5-4784-9f5e-b095dbe4b2a5 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:45.924212 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1ca67223-82c5-4784-9f5e-b095dbe4b2a5 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:45.924704 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1ca67223-82c5-4784-9f5e-b095dbe4b2a5 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:45.925121 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1ca67223-82c5-4784-9f5e-b095dbe4b2a5 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:46.183910 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c43a7d67-4b06-408d-a1d6-781b9b212923 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb261f2061164b49a8d496b16647dd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d2222a956a4888967e21647e26b310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:46.194970 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c43a7d67-4b06-408d-a1d6-781b9b212923 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "GET /compute/v2.1/servers/9b9170ad-8804-4603-b35b-f7a3d2c4af62" status: 200 len: 1517 microversion: 2.1 time: 1.368908 Aug 31 16:16:46.200263 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2239/4468] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:44 2022] GET /compute/v2.1/servers/9b9170ad-8804-4603-b35b-f7a3d2c4af62 => generated 1517 bytes in 1375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:46.210518 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-77c24e2e-93c5-4181-ba53-4ca939a9b12d tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:46.214102 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-77c24e2e-93c5-4181-ba53-4ca939a9b12d tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] [instance: f04eb48d-000e-4c3b-8799-a4d3cdacf0e2] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:46.228475 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-77c24e2e-93c5-4181-ba53-4ca939a9b12d tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:46.236394 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-77c24e2e-93c5-4181-ba53-4ca939a9b12d tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:46.237217 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-77c24e2e-93c5-4181-ba53-4ca939a9b12d tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:46.238266 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-77c24e2e-93c5-4181-ba53-4ca939a9b12d tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:46.240788 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-77c24e2e-93c5-4181-ba53-4ca939a9b12d tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:46.246186 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-77c24e2e-93c5-4181-ba53-4ca939a9b12d tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:46.712152 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1ca67223-82c5-4784-9f5e-b095dbe4b2a5 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09abc9573e94951b69e871170cbcf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc0aa4c03f84f5691d4e7b8c5da75e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:46.724975 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1ca67223-82c5-4784-9f5e-b095dbe4b2a5 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] 10.222.0.61 "GET /compute/v2.1/servers/8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21" status: 200 len: 1532 microversion: 2.1 time: 0.840551 Aug 31 16:16:46.739604 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2230/4469] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:45 2022] GET /compute/v2.1/servers/8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21 => generated 1532 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:46.899359 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2cb8bbc9-0e27-42b0-8d8d-be32c6741647 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:46.900021 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2cb8bbc9-0e27-42b0-8d8d-be32c6741647 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] [instance: 0807b71a-b3ab-4bad-a3b4-a00fc39dedb6] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:46.913246 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2cb8bbc9-0e27-42b0-8d8d-be32c6741647 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:46.918052 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2cb8bbc9-0e27-42b0-8d8d-be32c6741647 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:46.918888 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2cb8bbc9-0e27-42b0-8d8d-be32c6741647 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:46.926611 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2cb8bbc9-0e27-42b0-8d8d-be32c6741647 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:46.927618 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2cb8bbc9-0e27-42b0-8d8d-be32c6741647 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:46.929943 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2cb8bbc9-0e27-42b0-8d8d-be32c6741647 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:47.034396 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-77c24e2e-93c5-4181-ba53-4ca939a9b12d tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed06378eb9b446680b5a3156a14941d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511432a7dee4bec9d1093c9d95b3734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:47.053426 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-77c24e2e-93c5-4181-ba53-4ca939a9b12d tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] 10.222.0.61 "GET /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2" status: 200 len: 1653 microversion: 2.1 time: 0.851685 Aug 31 16:16:47.071620 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2240/4470] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:46 2022] GET /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2 => generated 1653 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:47.084043 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-05847bc3-66f4-4df7-962c-cfd403d943fe tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:16:47.104447 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-05847bc3-66f4-4df7-962c-cfd403d943fe tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:47.105007 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-05847bc3-66f4-4df7-962c-cfd403d943fe tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:47.105483 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-05847bc3-66f4-4df7-962c-cfd403d943fe tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:47.231862 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-05847bc3-66f4-4df7-962c-cfd403d943fe tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] [instance: f04eb48d-000e-4c3b-8799-a4d3cdacf0e2] Going to try to start instance {{(pid=122257) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 31 16:16:47.373698 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-05847bc3-66f4-4df7-962c-cfd403d943fe tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] 10.222.0.61 "POST /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2/action" status: 202 len: 0 microversion: 2.1 time: 0.293026 Aug 31 16:16:47.379719 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2241/4471] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:16:47 2022] POST /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2/action => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 16:16:47.404696 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6d2b3400-c913-462b-b918-262d5a715bfa tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:47.405237 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6d2b3400-c913-462b-b918-262d5a715bfa tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: 9b9170ad-8804-4603-b35b-f7a3d2c4af62] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:47.418521 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6d2b3400-c913-462b-b918-262d5a715bfa tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:47.419255 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6d2b3400-c913-462b-b918-262d5a715bfa tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:47.421973 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6d2b3400-c913-462b-b918-262d5a715bfa tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:47.423172 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6d2b3400-c913-462b-b918-262d5a715bfa tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:47.425045 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6d2b3400-c913-462b-b918-262d5a715bfa tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:47.428232 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6d2b3400-c913-462b-b918-262d5a715bfa tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:49.060630 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-2cb8bbc9-0e27-42b0-8d8d-be32c6741647 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a598a2bec3e34c239c9fad419545eb52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25e974933e564e5da170dfe26fe921c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:49.100755 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2cb8bbc9-0e27-42b0-8d8d-be32c6741647 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] 10.222.0.61 "GET /compute/v2.1/servers/0807b71a-b3ab-4bad-a3b4-a00fc39dedb6" status: 200 len: 1325 microversion: 2.1 time: 2.205472 Aug 31 16:16:49.103909 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2231/4472] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:46 2022] GET /compute/v2.1/servers/0807b71a-b3ab-4bad-a3b4-a00fc39dedb6 => generated 1325 bytes in 2209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:49.125855 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-27e5814d-c91c-4cda-a56d-7ba1fa90d07a tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:49.129271 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-27e5814d-c91c-4cda-a56d-7ba1fa90d07a tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] [instance: f04eb48d-000e-4c3b-8799-a4d3cdacf0e2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:49.149038 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-27e5814d-c91c-4cda-a56d-7ba1fa90d07a tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:49.149554 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-27e5814d-c91c-4cda-a56d-7ba1fa90d07a tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:49.150007 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-27e5814d-c91c-4cda-a56d-7ba1fa90d07a tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:49.150747 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-27e5814d-c91c-4cda-a56d-7ba1fa90d07a tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:49.151209 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-27e5814d-c91c-4cda-a56d-7ba1fa90d07a tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:49.156726 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-27e5814d-c91c-4cda-a56d-7ba1fa90d07a tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:49.447361 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-6d2b3400-c913-462b-b918-262d5a715bfa tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb261f2061164b49a8d496b16647dd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d2222a956a4888967e21647e26b310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:49.471362 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6d2b3400-c913-462b-b918-262d5a715bfa tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "GET /compute/v2.1/servers/9b9170ad-8804-4603-b35b-f7a3d2c4af62" status: 200 len: 1517 microversion: 2.1 time: 2.088753 Aug 31 16:16:49.473404 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2242/4473] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:47 2022] GET /compute/v2.1/servers/9b9170ad-8804-4603-b35b-f7a3d2c4af62 => generated 1517 bytes in 2093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:49.646703 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-25298c1e-60ff-41f6-8174-303000c0041d req-cf1fd8f0-040e-4160-a922-fb90f6e65df3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21", "name": "network-vif-unplugged", "status": "completed", "tag": "8aa3dc6a-0289-4f40-b5a9-892ca074cf0d"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:16:49.658208 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-25298c1e-60ff-41f6-8174-303000c0041d req-cf1fd8f0-040e-4160-a922-fb90f6e65df3 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:49.658704 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-25298c1e-60ff-41f6-8174-303000c0041d req-cf1fd8f0-040e-4160-a922-fb90f6e65df3 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:49.659139 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-25298c1e-60ff-41f6-8174-303000c0041d req-cf1fd8f0-040e-4160-a922-fb90f6e65df3 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:49.672432 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-25298c1e-60ff-41f6-8174-303000c0041d req-cf1fd8f0-040e-4160-a922-fb90f6e65df3 service nova] Creating event network-vif-unplugged:8aa3dc6a-0289-4f40-b5a9-892ca074cf0d for instance 8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21 on n-h2-850499-9 Aug 31 16:16:49.679359 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-25298c1e-60ff-41f6-8174-303000c0041d req-cf1fd8f0-040e-4160-a922-fb90f6e65df3 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.204325 Aug 31 16:16:49.680332 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2243/4474] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:16:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:16:49.688030 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4070363c-595d-43c5-8d8c-f4910823e242 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:49.689186 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4070363c-595d-43c5-8d8c-f4910823e242 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] [instance: 8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:49.714626 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4070363c-595d-43c5-8d8c-f4910823e242 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:49.723657 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4070363c-595d-43c5-8d8c-f4910823e242 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:49.728066 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4070363c-595d-43c5-8d8c-f4910823e242 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:49.731686 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4070363c-595d-43c5-8d8c-f4910823e242 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:49.734315 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4070363c-595d-43c5-8d8c-f4910823e242 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:49.738285 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4070363c-595d-43c5-8d8c-f4910823e242 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:50.770510 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-27e5814d-c91c-4cda-a56d-7ba1fa90d07a tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed06378eb9b446680b5a3156a14941d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511432a7dee4bec9d1093c9d95b3734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:50.789109 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-27e5814d-c91c-4cda-a56d-7ba1fa90d07a tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] 10.222.0.61 "GET /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2" status: 200 len: 1662 microversion: 2.1 time: 1.682379 Aug 31 16:16:50.794665 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2232/4475] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:49 2022] GET /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2 => generated 1662 bytes in 1690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:50.815659 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-50a30452-6756-445f-8e96-7e0655248605 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:50.817319 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-50a30452-6756-445f-8e96-7e0655248605 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] [instance: 0807b71a-b3ab-4bad-a3b4-a00fc39dedb6] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:50.847410 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-50a30452-6756-445f-8e96-7e0655248605 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:50.849379 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-50a30452-6756-445f-8e96-7e0655248605 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:50.850489 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-50a30452-6756-445f-8e96-7e0655248605 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:50.852355 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-50a30452-6756-445f-8e96-7e0655248605 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:50.853021 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-50a30452-6756-445f-8e96-7e0655248605 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:50.853670 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-50a30452-6756-445f-8e96-7e0655248605 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:50.891638 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-4070363c-595d-43c5-8d8c-f4910823e242 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b09abc9573e94951b69e871170cbcf0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc0aa4c03f84f5691d4e7b8c5da75e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:50.906444 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4070363c-595d-43c5-8d8c-f4910823e242 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] 10.222.0.61 "GET /compute/v2.1/servers/8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21" status: 200 len: 1532 microversion: 2.1 time: 1.224491 Aug 31 16:16:50.927012 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2244/4476] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:49 2022] GET /compute/v2.1/servers/8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21 => generated 1532 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:50.934794 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5a6a0368-f405-42ca-8bdf-ca5aff0c925c tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:50.935417 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5a6a0368-f405-42ca-8bdf-ca5aff0c925c tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: 9b9170ad-8804-4603-b35b-f7a3d2c4af62] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:50.980004 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5a6a0368-f405-42ca-8bdf-ca5aff0c925c tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:50.983782 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5a6a0368-f405-42ca-8bdf-ca5aff0c925c tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:50.988381 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5a6a0368-f405-42ca-8bdf-ca5aff0c925c tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:50.992597 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5a6a0368-f405-42ca-8bdf-ca5aff0c925c tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:50.993534 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5a6a0368-f405-42ca-8bdf-ca5aff0c925c tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:50.994773 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5a6a0368-f405-42ca-8bdf-ca5aff0c925c tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:51.459250 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-50a30452-6756-445f-8e96-7e0655248605 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a598a2bec3e34c239c9fad419545eb52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25e974933e564e5da170dfe26fe921c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:51.481240 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-50a30452-6756-445f-8e96-7e0655248605 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] 10.222.0.61 "GET /compute/v2.1/servers/0807b71a-b3ab-4bad-a3b4-a00fc39dedb6" status: 200 len: 1325 microversion: 2.1 time: 0.679162 Aug 31 16:16:51.485243 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2233/4477] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:50 2022] GET /compute/v2.1/servers/0807b71a-b3ab-4bad-a3b4-a00fc39dedb6 => generated 1325 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:51.512401 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-3750218a-bafd-4005-bef8-003d55987829 req-c10ddf30-743d-4f8e-bc99-8e7b5666369b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21", "name": "network-vif-deleted", "tag": "8aa3dc6a-0289-4f40-b5a9-892ca074cf0d"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:16:51.544168 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-3750218a-bafd-4005-bef8-003d55987829 req-c10ddf30-743d-4f8e-bc99-8e7b5666369b service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:51.559313 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-3750218a-bafd-4005-bef8-003d55987829 req-c10ddf30-743d-4f8e-bc99-8e7b5666369b service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:51.560438 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-3750218a-bafd-4005-bef8-003d55987829 req-c10ddf30-743d-4f8e-bc99-8e7b5666369b service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:51.579158 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-3750218a-bafd-4005-bef8-003d55987829 req-c10ddf30-743d-4f8e-bc99-8e7b5666369b service nova] Creating event network-vif-deleted:8aa3dc6a-0289-4f40-b5a9-892ca074cf0d for instance 8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21 on n-h2-850499-9 Aug 31 16:16:51.587520 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-3750218a-bafd-4005-bef8-003d55987829 req-c10ddf30-743d-4f8e-bc99-8e7b5666369b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100397 Aug 31 16:16:51.589575 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2234/4478] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:16:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:16:51.626749 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5a6a0368-f405-42ca-8bdf-ca5aff0c925c tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb261f2061164b49a8d496b16647dd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d2222a956a4888967e21647e26b310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:51.641122 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5a6a0368-f405-42ca-8bdf-ca5aff0c925c tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "GET /compute/v2.1/servers/9b9170ad-8804-4603-b35b-f7a3d2c4af62" status: 200 len: 1517 microversion: 2.1 time: 0.708766 Aug 31 16:16:51.642202 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2245/4479] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:50 2022] GET /compute/v2.1/servers/9b9170ad-8804-4603-b35b-f7a3d2c4af62 => generated 1517 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:51.716453 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-ea8ff1d0-c464-4d73-9c42-021e2812a997 req-1088e044-223e-4313-83ba-103553e1f519 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0807b71a-b3ab-4bad-a3b4-a00fc39dedb6", "name": "network-vif-plugged", "status": "completed", "tag": "5d3f634d-786f-418e-87e5-1b6e9210479b"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:16:51.762141 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-ea8ff1d0-c464-4d73-9c42-021e2812a997 req-1088e044-223e-4313-83ba-103553e1f519 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:51.763353 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-ea8ff1d0-c464-4d73-9c42-021e2812a997 req-1088e044-223e-4313-83ba-103553e1f519 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:51.764905 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-ea8ff1d0-c464-4d73-9c42-021e2812a997 req-1088e044-223e-4313-83ba-103553e1f519 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:51.825941 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9950e471-49c1-41f4-a0ea-c346677f5cc6 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:51.834466 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9950e471-49c1-41f4-a0ea-c346677f5cc6 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] [instance: f04eb48d-000e-4c3b-8799-a4d3cdacf0e2] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:51.856444 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-ea8ff1d0-c464-4d73-9c42-021e2812a997 req-1088e044-223e-4313-83ba-103553e1f519 service nova] Creating event network-vif-plugged:5d3f634d-786f-418e-87e5-1b6e9210479b for instance 0807b71a-b3ab-4bad-a3b4-a00fc39dedb6 on n-h2-850499-9 Aug 31 16:16:51.868154 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9950e471-49c1-41f4-a0ea-c346677f5cc6 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:51.869190 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9950e471-49c1-41f4-a0ea-c346677f5cc6 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:51.872452 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9950e471-49c1-41f4-a0ea-c346677f5cc6 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:51.877265 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9950e471-49c1-41f4-a0ea-c346677f5cc6 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:51.877770 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9950e471-49c1-41f4-a0ea-c346677f5cc6 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:51.878295 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9950e471-49c1-41f4-a0ea-c346677f5cc6 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:51.886956 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-ea8ff1d0-c464-4d73-9c42-021e2812a997 req-1088e044-223e-4313-83ba-103553e1f519 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.189744 Aug 31 16:16:51.892095 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2235/4480] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:16:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:16:51.946502 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-07424c9f-7f31-4e2b-8396-0c1fac7fb009 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:51.947802 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-07424c9f-7f31-4e2b-8396-0c1fac7fb009 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] [instance: 8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:51.963012 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-07424c9f-7f31-4e2b-8396-0c1fac7fb009 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:51.965245 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-07424c9f-7f31-4e2b-8396-0c1fac7fb009 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:51.966351 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-07424c9f-7f31-4e2b-8396-0c1fac7fb009 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:51.968306 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-07424c9f-7f31-4e2b-8396-0c1fac7fb009 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:51.969481 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-07424c9f-7f31-4e2b-8396-0c1fac7fb009 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:51.971028 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-07424c9f-7f31-4e2b-8396-0c1fac7fb009 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:52.001252 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-07424c9f-7f31-4e2b-8396-0c1fac7fb009 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] HTTP exception thrown: Instance 8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21 could not be found. Aug 31 16:16:52.004092 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-07424c9f-7f31-4e2b-8396-0c1fac7fb009 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Request method failure captured: Aug 31 16:16:52.004092 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21 HTTP/1.1 Aug 31 16:16:52.004092 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:16:52.004092 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:16:52.004092 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:16:52.004092 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:16:52.004092 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:16:52.004092 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:16:52.004092 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:16:52.004092 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:16:52.004092 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4k4OBziEDBRGFXR_ik5TgbZk2SL1HXVq58_EM-eIIUZfRDhBDNDioiiTqVPIF8W1uO8apCHrqPIc9TwXdg9YYnDbcstrcayEbrDsJ8pLiC3ZVaP2Aiqe9QBz_-WXSb8qsCFi36LjK9GEP5ndSsnA01QzF9ybwIklxROA0yOVWKEEmI Aug 31 16:16:52.004092 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:16:52.004092 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:16:52.004092 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:16:52.004092 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:16:52.004092 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:16:52.004092 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:16:52.004092 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: ddc0aa4c03f84f5691d4e7b8c5da75e7 Aug 31 16:16:52.004092 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-384526727 Aug 31 16:16:52.004092 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:16:52.004092 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:16:52.004092 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ddc0aa4c03f84f5691d4e7b8c5da75e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ddc0aa4c03f84f5691d4e7b8c5da75e7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ddc0aa4c03f84f5691d4e7b8c5da75e7", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ddc0aa4c03f84f5691d4e7b8c5da75e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:16:52.004092 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-384526727 Aug 31 16:16:52.004092 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: ddc0aa4c03f84f5691d4e7b8c5da75e7 Aug 31 16:16:52.004092 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-384526727 Aug 31 16:16:52.004092 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ServersNegativeTestMultiTenantJSON-384526727-project Aug 31 16:16:52.004092 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:16:52.004092 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:16:52.004092 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: b09abc9573e94951b69e871170cbcf0d Aug 31 16:16:52.004092 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-384526727-project Aug 31 16:16:52.004092 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:16:52.004092 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance 8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21 could not be found. Aug 31 16:16:52.004092 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21'} Aug 31 16:16:52.004092 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:16:52.004092 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:52.004092 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:16:52.004092 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:16:52.004092 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:16:52.004092 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:16:52.004092 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:16:52.004092 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:16:52.004092 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:16:52.004092 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:16:52.004092 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21 could not be found. Aug 31 16:16:52.004092 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:16:52.004092 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:52.004092 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:16:52.004092 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:52.004092 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:52.004092 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:52.004092 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:16:52.004092 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:16:52.004092 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:16:52.004092 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:16:52.004092 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:16:52.004092 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:16:52.004092 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:16:52.004092 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:16:52.004092 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:16:52.004092 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:16:52.004092 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21 could not be found. Aug 31 16:16:52.004092 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:16:52.014896 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:52.014896 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:16:52.014896 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:52.014896 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:52.014896 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:52.014896 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:16:52.014896 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:16:52.014896 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21 could not be found. Aug 31 16:16:52.014896 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:16:52.014896 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-07424c9f-7f31-4e2b-8396-0c1fac7fb009 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] Returning 404 to user: Instance 8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:16:52.014896 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-07424c9f-7f31-4e2b-8396-0c1fac7fb009 tempest-ServersNegativeTestMultiTenantJSON-384526727 tempest-ServersNegativeTestMultiTenantJSON-384526727-project] 10.222.0.61 "GET /compute/v2.1/servers/8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21" status: 404 len: 111 microversion: 2.1 time: 0.073985 Aug 31 16:16:52.014896 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2236/4481] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:51 2022] GET /compute/v2.1/servers/8bcdaadd-d4d3-480a-8f7d-a006d9ac2f21 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:16:52.316326 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9950e471-49c1-41f4-a0ea-c346677f5cc6 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed06378eb9b446680b5a3156a14941d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511432a7dee4bec9d1093c9d95b3734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:52.342196 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9950e471-49c1-41f4-a0ea-c346677f5cc6 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] 10.222.0.61 "GET /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2" status: 200 len: 1662 microversion: 2.1 time: 0.525464 Aug 31 16:16:52.344631 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2246/4482] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:51 2022] GET /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2 => generated 1662 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:52.513339 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2573310d-03a7-4c47-b154-bcd8a01ef289 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:52.514052 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2573310d-03a7-4c47-b154-bcd8a01ef289 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] [instance: 0807b71a-b3ab-4bad-a3b4-a00fc39dedb6] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:52.531965 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2573310d-03a7-4c47-b154-bcd8a01ef289 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:52.537818 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2573310d-03a7-4c47-b154-bcd8a01ef289 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:52.543894 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2573310d-03a7-4c47-b154-bcd8a01ef289 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:52.544851 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2573310d-03a7-4c47-b154-bcd8a01ef289 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:52.546054 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2573310d-03a7-4c47-b154-bcd8a01ef289 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:52.546626 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2573310d-03a7-4c47-b154-bcd8a01ef289 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:52.679969 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b7fcf101-4701-45ae-8854-b2cc06757ae6 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:52.680858 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b7fcf101-4701-45ae-8854-b2cc06757ae6 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: 9b9170ad-8804-4603-b35b-f7a3d2c4af62] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:52.694234 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b7fcf101-4701-45ae-8854-b2cc06757ae6 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:52.697377 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b7fcf101-4701-45ae-8854-b2cc06757ae6 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:52.699565 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b7fcf101-4701-45ae-8854-b2cc06757ae6 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:52.700678 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b7fcf101-4701-45ae-8854-b2cc06757ae6 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:52.704297 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b7fcf101-4701-45ae-8854-b2cc06757ae6 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:52.706061 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b7fcf101-4701-45ae-8854-b2cc06757ae6 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:52.988627 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-2573310d-03a7-4c47-b154-bcd8a01ef289 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a598a2bec3e34c239c9fad419545eb52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25e974933e564e5da170dfe26fe921c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:53.005294 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2573310d-03a7-4c47-b154-bcd8a01ef289 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] 10.222.0.61 "GET /compute/v2.1/servers/0807b71a-b3ab-4bad-a3b4-a00fc39dedb6" status: 200 len: 1325 microversion: 2.1 time: 0.494638 Aug 31 16:16:53.008001 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2237/4483] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:52 2022] GET /compute/v2.1/servers/0807b71a-b3ab-4bad-a3b4-a00fc39dedb6 => generated 1325 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:53.180856 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b7fcf101-4701-45ae-8854-b2cc06757ae6 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb261f2061164b49a8d496b16647dd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d2222a956a4888967e21647e26b310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:53.191549 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b7fcf101-4701-45ae-8854-b2cc06757ae6 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "GET /compute/v2.1/servers/9b9170ad-8804-4603-b35b-f7a3d2c4af62" status: 200 len: 1517 microversion: 2.1 time: 0.515609 Aug 31 16:16:53.200287 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2247/4484] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:52 2022] GET /compute/v2.1/servers/9b9170ad-8804-4603-b35b-f7a3d2c4af62 => generated 1517 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:16:53.388820 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-75c75466-19f5-4c5c-99d0-559627e558f8 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:53.390506 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-75c75466-19f5-4c5c-99d0-559627e558f8 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] [instance: f04eb48d-000e-4c3b-8799-a4d3cdacf0e2] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:53.412091 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-75c75466-19f5-4c5c-99d0-559627e558f8 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:53.415841 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-75c75466-19f5-4c5c-99d0-559627e558f8 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:53.415841 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-75c75466-19f5-4c5c-99d0-559627e558f8 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:53.415841 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-75c75466-19f5-4c5c-99d0-559627e558f8 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:53.415841 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-75c75466-19f5-4c5c-99d0-559627e558f8 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:53.416900 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-75c75466-19f5-4c5c-99d0-559627e558f8 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:53.694016 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-36109e16-3e4d-4c0d-b796-95577beb07bd tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-1815495263", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "networks": [{"uuid": "6e03fe0d-eaab-4c65-97ce-af66d7fd5a41"}]}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:16:53.734863 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-75c75466-19f5-4c5c-99d0-559627e558f8 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed06378eb9b446680b5a3156a14941d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511432a7dee4bec9d1093c9d95b3734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:53.747402 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-75c75466-19f5-4c5c-99d0-559627e558f8 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] 10.222.0.61 "GET /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2" status: 200 len: 1666 microversion: 2.1 time: 0.364572 Aug 31 16:16:53.754771 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2248/4485] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:53 2022] GET /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2 => generated 1666 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:16:53.792034 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-36109e16-3e4d-4c0d-b796-95577beb07bd tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] validate_networks() for [('6e03fe0d-eaab-4c65-97ce-af66d7fd5a41', None, None, None, None, None)] {{(pid=122256) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:16:54.040868 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6c7800dc-f11b-4f0d-b46d-78276fb0d3ca tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:54.042804 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6c7800dc-f11b-4f0d-b46d-78276fb0d3ca tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] [instance: 0807b71a-b3ab-4bad-a3b4-a00fc39dedb6] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:54.064118 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6c7800dc-f11b-4f0d-b46d-78276fb0d3ca tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:54.065717 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6c7800dc-f11b-4f0d-b46d-78276fb0d3ca tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:54.068683 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6c7800dc-f11b-4f0d-b46d-78276fb0d3ca tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:54.075849 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6c7800dc-f11b-4f0d-b46d-78276fb0d3ca tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:54.080552 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6c7800dc-f11b-4f0d-b46d-78276fb0d3ca tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:54.081798 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6c7800dc-f11b-4f0d-b46d-78276fb0d3ca tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:54.575444 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-6c7800dc-f11b-4f0d-b46d-78276fb0d3ca tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a598a2bec3e34c239c9fad419545eb52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25e974933e564e5da170dfe26fe921c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:54.587446 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6c7800dc-f11b-4f0d-b46d-78276fb0d3ca tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] 10.222.0.61 "GET /compute/v2.1/servers/0807b71a-b3ab-4bad-a3b4-a00fc39dedb6" status: 200 len: 1325 microversion: 2.1 time: 0.556214 Aug 31 16:16:54.589412 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2249/4486] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:54 2022] GET /compute/v2.1/servers/0807b71a-b3ab-4bad-a3b4-a00fc39dedb6 => generated 1325 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:16:54.618367 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f43c9a40-2bab-4a81-a95d-88b88a5ff894 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:54.619016 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f43c9a40-2bab-4a81-a95d-88b88a5ff894 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: 9b9170ad-8804-4603-b35b-f7a3d2c4af62] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:54.643231 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f43c9a40-2bab-4a81-a95d-88b88a5ff894 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:54.643827 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f43c9a40-2bab-4a81-a95d-88b88a5ff894 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:54.644315 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f43c9a40-2bab-4a81-a95d-88b88a5ff894 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:54.646664 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f43c9a40-2bab-4a81-a95d-88b88a5ff894 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:54.647135 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f43c9a40-2bab-4a81-a95d-88b88a5ff894 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:54.647662 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f43c9a40-2bab-4a81-a95d-88b88a5ff894 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:54.711260 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:16:54.770932 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-36109e16-3e4d-4c0d-b796-95577beb07bd tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:16:54.771568 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-36109e16-3e4d-4c0d-b796-95577beb07bd tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:16:54.771965 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-36109e16-3e4d-4c0d-b796-95577beb07bd tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:16:54.772458 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-36109e16-3e4d-4c0d-b796-95577beb07bd tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:16:54.772955 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-36109e16-3e4d-4c0d-b796-95577beb07bd tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:16:54.794452 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-36109e16-3e4d-4c0d-b796-95577beb07bd tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:54.794862 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-36109e16-3e4d-4c0d-b796-95577beb07bd tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:54.795310 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-36109e16-3e4d-4c0d-b796-95577beb07bd tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:54.796934 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-36109e16-3e4d-4c0d-b796-95577beb07bd tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:54.797332 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-36109e16-3e4d-4c0d-b796-95577beb07bd tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:54.797770 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-36109e16-3e4d-4c0d-b796-95577beb07bd tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:54.823268 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:16:54.864859 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-36109e16-3e4d-4c0d-b796-95577beb07bd tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Getting quotas for project 3cd86cc078484761bca68f912acb3368. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:16:54.879896 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-36109e16-3e4d-4c0d-b796-95577beb07bd tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Getting quotas for user db871eae8b444ac1bb654ee687c84c3e and project 3cd86cc078484761bca68f912acb3368. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:16:54.915658 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-36109e16-3e4d-4c0d-b796-95577beb07bd tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Going to run 1 instances... {{(pid=122256) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:16:54.922662 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-36109e16-3e4d-4c0d-b796-95577beb07bd tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] [instance: f1973c46-6ab5-4e0c-b188-9398faafa842] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:16:54.948564 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f43c9a40-2bab-4a81-a95d-88b88a5ff894 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb261f2061164b49a8d496b16647dd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d2222a956a4888967e21647e26b310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:54.967694 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f43c9a40-2bab-4a81-a95d-88b88a5ff894 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "GET /compute/v2.1/servers/9b9170ad-8804-4603-b35b-f7a3d2c4af62" status: 200 len: 1517 microversion: 2.1 time: 0.376432 Aug 31 16:16:54.983956 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2250/4487] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:54 2022] GET /compute/v2.1/servers/9b9170ad-8804-4603-b35b-f7a3d2c4af62 => generated 1517 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:54.996906 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-36109e16-3e4d-4c0d-b796-95577beb07bd tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 1.985164 Aug 31 16:16:54.997874 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2238/4488] 10.222.0.61 () {62 vars in 1188 bytes} [Wed Aug 31 16:16:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1987 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 31 16:16:55.010341 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-85c29d27-8e54-42b3-9608-8071556b633e tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:55.010691 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-85c29d27-8e54-42b3-9608-8071556b633e tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] [instance: f1973c46-6ab5-4e0c-b188-9398faafa842] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:55.113039 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-85c29d27-8e54-42b3-9608-8071556b633e tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db871eae8b444ac1bb654ee687c84c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd86cc078484761bca68f912acb3368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:55.127369 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-85c29d27-8e54-42b3-9608-8071556b633e tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db871eae8b444ac1bb654ee687c84c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd86cc078484761bca68f912acb3368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:55.129456 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-85c29d27-8e54-42b3-9608-8071556b633e tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db871eae8b444ac1bb654ee687c84c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd86cc078484761bca68f912acb3368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:55.131635 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-85c29d27-8e54-42b3-9608-8071556b633e tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] 10.222.0.61 "GET /compute/v2.1/servers/f1973c46-6ab5-4e0c-b188-9398faafa842" status: 200 len: 1259 microversion: 2.21 time: 0.124700 Aug 31 16:16:55.165027 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2251/4489] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:16:55 2022] GET /compute/v2.1/servers/f1973c46-6ab5-4e0c-b188-9398faafa842 => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:16:55.616384 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4305c13e-ab9f-47b1-b4c8-453f804698a5 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:55.617231 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4305c13e-ab9f-47b1-b4c8-453f804698a5 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] [instance: 0807b71a-b3ab-4bad-a3b4-a00fc39dedb6] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:55.635398 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4305c13e-ab9f-47b1-b4c8-453f804698a5 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:55.641385 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4305c13e-ab9f-47b1-b4c8-453f804698a5 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:55.643942 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4305c13e-ab9f-47b1-b4c8-453f804698a5 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:55.645199 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4305c13e-ab9f-47b1-b4c8-453f804698a5 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:55.647017 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4305c13e-ab9f-47b1-b4c8-453f804698a5 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:55.649985 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4305c13e-ab9f-47b1-b4c8-453f804698a5 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:56.003459 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-4305c13e-ab9f-47b1-b4c8-453f804698a5 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a598a2bec3e34c239c9fad419545eb52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25e974933e564e5da170dfe26fe921c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:56.007558 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6f07361a-6bfd-45e9-8f4b-2dd9f7997050 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:56.009534 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6f07361a-6bfd-45e9-8f4b-2dd9f7997050 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: 9b9170ad-8804-4603-b35b-f7a3d2c4af62] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:56.043095 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4305c13e-ab9f-47b1-b4c8-453f804698a5 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] 10.222.0.61 "GET /compute/v2.1/servers/0807b71a-b3ab-4bad-a3b4-a00fc39dedb6" status: 200 len: 1522 microversion: 2.1 time: 0.432076 Aug 31 16:16:56.051381 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2239/4490] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:55 2022] GET /compute/v2.1/servers/0807b71a-b3ab-4bad-a3b4-a00fc39dedb6 => generated 1522 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:56.054126 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6f07361a-6bfd-45e9-8f4b-2dd9f7997050 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:56.054857 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6f07361a-6bfd-45e9-8f4b-2dd9f7997050 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:56.058816 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6f07361a-6bfd-45e9-8f4b-2dd9f7997050 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:56.060889 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6f07361a-6bfd-45e9-8f4b-2dd9f7997050 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:56.062749 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6f07361a-6bfd-45e9-8f4b-2dd9f7997050 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:56.064186 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6f07361a-6bfd-45e9-8f4b-2dd9f7997050 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:56.077849 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-13f61a2d-e9e0-4896-8771-dbfd6ef66b51 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:56.078372 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-13f61a2d-e9e0-4896-8771-dbfd6ef66b51 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] [instance: 0807b71a-b3ab-4bad-a3b4-a00fc39dedb6] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:56.106706 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-13f61a2d-e9e0-4896-8771-dbfd6ef66b51 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:56.109338 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-13f61a2d-e9e0-4896-8771-dbfd6ef66b51 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:56.113072 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-13f61a2d-e9e0-4896-8771-dbfd6ef66b51 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:56.141376 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-13f61a2d-e9e0-4896-8771-dbfd6ef66b51 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:56.142052 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-13f61a2d-e9e0-4896-8771-dbfd6ef66b51 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:56.143001 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-13f61a2d-e9e0-4896-8771-dbfd6ef66b51 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:56.236516 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-13f61a2d-e9e0-4896-8771-dbfd6ef66b51 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] HTTP exception thrown: Instance is not a member of specified network Aug 31 16:16:56.248519 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-13f61a2d-e9e0-4896-8771-dbfd6ef66b51 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Request method failure captured: Aug 31 16:16:56.248519 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/0807b71a-b3ab-4bad-a3b4-a00fc39dedb6/ips/invalid HTTP/1.1 Aug 31 16:16:56.248519 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:16:56.248519 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:16:56.248519 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:16:56.248519 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:16:56.248519 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:16:56.248519 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:16:56.248519 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:16:56.248519 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:16:56.248519 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4lUiF3fArFupsBNozGrkCztImIkiOpgKyawMawFrQnV_GvFmfIfobdvsKSLHxCShbYFrW7Xqf5jAcqvTK5cDUgGhCFjxAxViWSRK12pguoU95ebMEp-iajQcYHGenEKhYYzQ1CxvvrfMWIQC69MzIMAClH21iObCVOqPfbFjzKYOgY Aug 31 16:16:56.248519 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:16:56.248519 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:16:56.248519 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:16:56.248519 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:16:56.248519 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:16:56.248519 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:16:56.248519 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 25e974933e564e5da170dfe26fe921c3 Aug 31 16:16:56.248519 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-145318871 Aug 31 16:16:56.248519 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:16:56.248519 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:16:56.248519 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/25e974933e564e5da170dfe26fe921c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/25e974933e564e5da170dfe26fe921c3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_25e974933e564e5da170dfe26fe921c3", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/25e974933e564e5da170dfe26fe921c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:16:56.248519 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-145318871 Aug 31 16:16:56.248519 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 25e974933e564e5da170dfe26fe921c3 Aug 31 16:16:56.248519 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-145318871 Aug 31 16:16:56.248519 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ServerAddressesNegativeTestJSON-145318871-project Aug 31 16:16:56.248519 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:16:56.248519 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:16:56.248519 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: a598a2bec3e34c239c9fad419545eb52 Aug 31 16:16:56.248519 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-145318871-project Aug 31 16:16:56.248519 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:16:56.248519 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance is not a member of specified network Aug 31 16:16:56.248519 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'server_id': '0807b71a-b3ab-4bad-a3b4-a00fc39dedb6', 'id': 'invalid'} Aug 31 16:16:56.248519 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:16:56.248519 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:56.248519 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:56.248519 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:56.248519 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:16:56.248519 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:16:56.248519 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:16:56.248519 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:16:56.248519 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Aug 31 16:16:56.248519 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 31 16:16:56.248519 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Aug 31 16:16:56.248519 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:16:56.248519 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:56.248519 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:16:56.248519 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:56.248519 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:56.248519 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:56.248519 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:16:56.248519 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:16:56.248519 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Aug 31 16:16:56.248519 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:16:56.255486 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-13f61a2d-e9e0-4896-8771-dbfd6ef66b51 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Returning 404 to user: Instance is not a member of specified network {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:16:56.257201 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-13f61a2d-e9e0-4896-8771-dbfd6ef66b51 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] 10.222.0.61 "GET /compute/v2.1/servers/0807b71a-b3ab-4bad-a3b4-a00fc39dedb6/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.184053 Aug 31 16:16:56.292047 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2240/4491] 10.222.0.61 () {58 vars in 1272 bytes} [Wed Aug 31 16:16:56 2022] GET /compute/v2.1/servers/0807b71a-b3ab-4bad-a3b4-a00fc39dedb6/ips/invalid => generated 91 bytes in 220 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 31 16:16:56.307545 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-148733b3-4262-47a1-ae27-16c0fc31e166 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:56.350094 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-148733b3-4262-47a1-ae27-16c0fc31e166 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:56.373863 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-148733b3-4262-47a1-ae27-16c0fc31e166 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:56.375247 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-148733b3-4262-47a1-ae27-16c0fc31e166 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:56.375953 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-148733b3-4262-47a1-ae27-16c0fc31e166 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:56.377368 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-148733b3-4262-47a1-ae27-16c0fc31e166 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:56.378786 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-148733b3-4262-47a1-ae27-16c0fc31e166 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:56.379474 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-148733b3-4262-47a1-ae27-16c0fc31e166 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:56.769410 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-6f07361a-6bfd-45e9-8f4b-2dd9f7997050 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb261f2061164b49a8d496b16647dd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d2222a956a4888967e21647e26b310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:56.797301 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6f07361a-6bfd-45e9-8f4b-2dd9f7997050 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "GET /compute/v2.1/servers/9b9170ad-8804-4603-b35b-f7a3d2c4af62" status: 200 len: 1517 microversion: 2.1 time: 0.810629 Aug 31 16:16:56.798498 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2252/4492] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:55 2022] GET /compute/v2.1/servers/9b9170ad-8804-4603-b35b-f7a3d2c4af62 => generated 1517 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:56.805510 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f923000a-e411-4ccd-9d36-05c317715f29 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:56.806716 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-148733b3-4262-47a1-ae27-16c0fc31e166 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:56.811787 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f923000a-e411-4ccd-9d36-05c317715f29 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] [instance: f1973c46-6ab5-4e0c-b188-9398faafa842] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:56.824776 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f923000a-e411-4ccd-9d36-05c317715f29 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:56.827147 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f923000a-e411-4ccd-9d36-05c317715f29 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:56.833685 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f923000a-e411-4ccd-9d36-05c317715f29 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:56.834569 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f923000a-e411-4ccd-9d36-05c317715f29 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:56.835041 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f923000a-e411-4ccd-9d36-05c317715f29 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:56.835877 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f923000a-e411-4ccd-9d36-05c317715f29 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:56.837456 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-148733b3-4262-47a1-ae27-16c0fc31e166 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1668 microversion: 2.1 time: 0.538730 Aug 31 16:16:56.843558 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2241/4493] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:56 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1668 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:56.846924 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-cc627d19-ae2b-4c61-8c97-f1259281b9da tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:56.848019 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-cc627d19-ae2b-4c61-8c97-f1259281b9da tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Failed to fetch instance by id 999 {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 31 16:16:56.848783 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-cc627d19-ae2b-4c61-8c97-f1259281b9da tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] HTTP exception thrown: Instance 999 could not be found. Aug 31 16:16:56.852751 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-cc627d19-ae2b-4c61-8c97-f1259281b9da tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Request method failure captured: Aug 31 16:16:56.852751 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Aug 31 16:16:56.852751 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:16:56.852751 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:16:56.852751 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:16:56.852751 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:16:56.852751 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:16:56.852751 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:16:56.852751 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:16:56.852751 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:16:56.852751 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4lUiF3fArFupsBNozGrkCztImIkiOpgKyawMawFrQnV_GvFmfIfobdvsKSLHxCShbYFrW7Xqf5jAcqvTK5cDUgGhCFjxAxViWSRK12pguoU95ebMEp-iajQcYHGenEKhYYzQ1CxvvrfMWIQC69MzIMAClH21iObCVOqPfbFjzKYOgY Aug 31 16:16:56.852751 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:16:56.852751 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:16:56.852751 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:16:56.852751 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:16:56.852751 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:16:56.852751 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:16:56.852751 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 25e974933e564e5da170dfe26fe921c3 Aug 31 16:16:56.852751 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-145318871 Aug 31 16:16:56.852751 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:16:56.852751 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:16:56.852751 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/25e974933e564e5da170dfe26fe921c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/25e974933e564e5da170dfe26fe921c3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_25e974933e564e5da170dfe26fe921c3", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/25e974933e564e5da170dfe26fe921c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:16:56.852751 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-145318871 Aug 31 16:16:56.852751 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 25e974933e564e5da170dfe26fe921c3 Aug 31 16:16:56.852751 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-145318871 Aug 31 16:16:56.852751 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ServerAddressesNegativeTestJSON-145318871-project Aug 31 16:16:56.852751 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:16:56.852751 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:16:56.852751 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: a598a2bec3e34c239c9fad419545eb52 Aug 31 16:16:56.852751 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-145318871-project Aug 31 16:16:56.852751 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:16:56.852751 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance 999 could not be found. Aug 31 16:16:56.852751 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'server_id': '999'} Aug 31 16:16:56.852751 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:16:56.852751 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:56.852751 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:16:56.852751 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:16:56.852751 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 31 16:16:56.852751 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 31 16:16:56.852751 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Aug 31 16:16:56.852751 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:16:56.852751 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:56.852751 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:16:56.852751 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:56.852751 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:56.852751 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:56.852751 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:16:56.852751 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:16:56.852751 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:16:56.852751 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:16:56.852751 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Aug 31 16:16:56.852751 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Aug 31 16:16:56.852751 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:16:56.852751 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:16:56.852751 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Aug 31 16:16:56.852751 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:16:56.852751 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:56.852751 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:16:56.852751 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:56.852751 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:56.852751 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:56.852751 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:16:56.852751 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:16:56.852751 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Aug 31 16:16:56.852751 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:16:56.860787 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-cc627d19-ae2b-4c61-8c97-f1259281b9da tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Returning 404 to user: Instance 999 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:16:56.863379 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-cc627d19-ae2b-4c61-8c97-f1259281b9da tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] 10.222.0.61 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.018967 Aug 31 16:16:56.864774 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2242/4494] 10.222.0.61 () {58 vars in 1149 bytes} [Wed Aug 31 16:16:56 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 31 16:16:56.888763 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b6e5c901-a65f-4982-9107-2a5d1db8dfc6 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:56.896836 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b6e5c901-a65f-4982-9107-2a5d1db8dfc6 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:56.914882 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b6e5c901-a65f-4982-9107-2a5d1db8dfc6 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:56.916304 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b6e5c901-a65f-4982-9107-2a5d1db8dfc6 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:56.917154 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b6e5c901-a65f-4982-9107-2a5d1db8dfc6 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:56.920556 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b6e5c901-a65f-4982-9107-2a5d1db8dfc6 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:56.953614 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b6e5c901-a65f-4982-9107-2a5d1db8dfc6 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:56.953614 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b6e5c901-a65f-4982-9107-2a5d1db8dfc6 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:57.028998 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f923000a-e411-4ccd-9d36-05c317715f29 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db871eae8b444ac1bb654ee687c84c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd86cc078484761bca68f912acb3368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:57.051659 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f923000a-e411-4ccd-9d36-05c317715f29 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db871eae8b444ac1bb654ee687c84c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd86cc078484761bca68f912acb3368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:57.053247 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f923000a-e411-4ccd-9d36-05c317715f29 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db871eae8b444ac1bb654ee687c84c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd86cc078484761bca68f912acb3368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:57.054909 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f923000a-e411-4ccd-9d36-05c317715f29 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] 10.222.0.61 "GET /compute/v2.1/servers/f1973c46-6ab5-4e0c-b188-9398faafa842" status: 200 len: 1311 microversion: 2.21 time: 0.254901 Aug 31 16:16:57.089337 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2253/4495] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:16:56 2022] GET /compute/v2.1/servers/f1973c46-6ab5-4e0c-b188-9398faafa842 => generated 1311 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:16:57.111055 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c28960f6-32de-4bc2-83a5-c64fc011de92 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:57.111592 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c28960f6-32de-4bc2-83a5-c64fc011de92 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] [instance: 0807b71a-b3ab-4bad-a3b4-a00fc39dedb6] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:57.137436 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c28960f6-32de-4bc2-83a5-c64fc011de92 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:57.139000 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c28960f6-32de-4bc2-83a5-c64fc011de92 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:57.142712 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c28960f6-32de-4bc2-83a5-c64fc011de92 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:57.146712 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c28960f6-32de-4bc2-83a5-c64fc011de92 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:57.148851 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c28960f6-32de-4bc2-83a5-c64fc011de92 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:57.151356 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c28960f6-32de-4bc2-83a5-c64fc011de92 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:57.284998 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c28960f6-32de-4bc2-83a5-c64fc011de92 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] [instance: 0807b71a-b3ab-4bad-a3b4-a00fc39dedb6] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:16:57.477527 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c28960f6-32de-4bc2-83a5-c64fc011de92 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] 10.222.0.61 "DELETE /compute/v2.1/servers/0807b71a-b3ab-4bad-a3b4-a00fc39dedb6" status: 204 len: 0 microversion: 2.1 time: 0.385477 Aug 31 16:16:57.479074 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2254/4496] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:16:57 2022] DELETE /compute/v2.1/servers/0807b71a-b3ab-4bad-a3b4-a00fc39dedb6 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:16:57.497912 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-06f66ff7-fec6-49b0-b47a-692d2dfdd771 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:57.499903 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-06f66ff7-fec6-49b0-b47a-692d2dfdd771 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] [instance: 0807b71a-b3ab-4bad-a3b4-a00fc39dedb6] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:57.508591 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-06f66ff7-fec6-49b0-b47a-692d2dfdd771 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:57.510276 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-06f66ff7-fec6-49b0-b47a-692d2dfdd771 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:57.511160 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-06f66ff7-fec6-49b0-b47a-692d2dfdd771 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:57.512388 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-06f66ff7-fec6-49b0-b47a-692d2dfdd771 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:57.513988 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-06f66ff7-fec6-49b0-b47a-692d2dfdd771 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:57.514775 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-06f66ff7-fec6-49b0-b47a-692d2dfdd771 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:57.554336 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b6e5c901-a65f-4982-9107-2a5d1db8dfc6 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:57.579166 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b6e5c901-a65f-4982-9107-2a5d1db8dfc6 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1668 microversion: 2.1 time: 0.712715 Aug 31 16:16:57.590378 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2243/4497] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:56 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1668 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:57.617193 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9d9742ee-6048-4cfd-9c8a-b35d3898b47f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:57.626032 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9d9742ee-6048-4cfd-9c8a-b35d3898b47f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:57.647218 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9d9742ee-6048-4cfd-9c8a-b35d3898b47f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:57.650410 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9d9742ee-6048-4cfd-9c8a-b35d3898b47f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:57.651210 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9d9742ee-6048-4cfd-9c8a-b35d3898b47f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:57.653308 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9d9742ee-6048-4cfd-9c8a-b35d3898b47f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:57.656739 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9d9742ee-6048-4cfd-9c8a-b35d3898b47f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:57.657689 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9d9742ee-6048-4cfd-9c8a-b35d3898b47f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:57.955145 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-06f66ff7-fec6-49b0-b47a-692d2dfdd771 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a598a2bec3e34c239c9fad419545eb52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25e974933e564e5da170dfe26fe921c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:57.968183 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-06f66ff7-fec6-49b0-b47a-692d2dfdd771 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] 10.222.0.61 "GET /compute/v2.1/servers/0807b71a-b3ab-4bad-a3b4-a00fc39dedb6" status: 200 len: 1528 microversion: 2.1 time: 0.479846 Aug 31 16:16:57.968374 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2255/4498] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:57 2022] GET /compute/v2.1/servers/0807b71a-b3ab-4bad-a3b4-a00fc39dedb6 => generated 1528 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:57.977283 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1671fb3c-4deb-4fc1-a6b1-c71117c6457d tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:57.978334 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1671fb3c-4deb-4fc1-a6b1-c71117c6457d tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: 9b9170ad-8804-4603-b35b-f7a3d2c4af62] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:57.986635 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1671fb3c-4deb-4fc1-a6b1-c71117c6457d tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:57.987138 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1671fb3c-4deb-4fc1-a6b1-c71117c6457d tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:57.987615 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1671fb3c-4deb-4fc1-a6b1-c71117c6457d tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:57.988562 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1671fb3c-4deb-4fc1-a6b1-c71117c6457d tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:57.992100 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1671fb3c-4deb-4fc1-a6b1-c71117c6457d tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:57.992100 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1671fb3c-4deb-4fc1-a6b1-c71117c6457d tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:58.024184 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-9d9742ee-6048-4cfd-9c8a-b35d3898b47f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:58.033986 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9d9742ee-6048-4cfd-9c8a-b35d3898b47f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1668 microversion: 2.1 time: 0.422924 Aug 31 16:16:58.035197 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2244/4499] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:57 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1668 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:58.056427 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3e9ad334-0936-4dab-87cc-c07ebf73ae83 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-25642945"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:16:58.059043 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3e9ad334-0936-4dab-87cc-c07ebf73ae83 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:58.066090 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3e9ad334-0936-4dab-87cc-c07ebf73ae83 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:58.066892 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3e9ad334-0936-4dab-87cc-c07ebf73ae83 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:58.067524 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3e9ad334-0936-4dab-87cc-c07ebf73ae83 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:58.068430 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3e9ad334-0936-4dab-87cc-c07ebf73ae83 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:58.069094 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3e9ad334-0936-4dab-87cc-c07ebf73ae83 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:58.069700 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3e9ad334-0936-4dab-87cc-c07ebf73ae83 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:58.273379 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-1671fb3c-4deb-4fc1-a6b1-c71117c6457d tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb261f2061164b49a8d496b16647dd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d2222a956a4888967e21647e26b310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:58.288241 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1671fb3c-4deb-4fc1-a6b1-c71117c6457d tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "GET /compute/v2.1/servers/9b9170ad-8804-4603-b35b-f7a3d2c4af62" status: 200 len: 1517 microversion: 2.1 time: 0.318104 Aug 31 16:16:58.303042 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2256/4500] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:57 2022] GET /compute/v2.1/servers/9b9170ad-8804-4603-b35b-f7a3d2c4af62 => generated 1517 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:58.316989 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-10e69b57-4114-4474-a11d-0cf6a9495c8f tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:58.317660 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-10e69b57-4114-4474-a11d-0cf6a9495c8f tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] [instance: f1973c46-6ab5-4e0c-b188-9398faafa842] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:58.345887 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-10e69b57-4114-4474-a11d-0cf6a9495c8f tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:58.351682 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-10e69b57-4114-4474-a11d-0cf6a9495c8f tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:58.352449 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-10e69b57-4114-4474-a11d-0cf6a9495c8f tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:58.353375 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-10e69b57-4114-4474-a11d-0cf6a9495c8f tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:58.354013 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-10e69b57-4114-4474-a11d-0cf6a9495c8f tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:58.354607 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-10e69b57-4114-4474-a11d-0cf6a9495c8f tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:58.474257 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3e9ad334-0936-4dab-87cc-c07ebf73ae83 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "POST /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c/action" status: 202 len: 0 microversion: 2.1 time: 0.421627 Aug 31 16:16:58.480790 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2245/4501] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:16:58 2022] POST /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c/action => generated 0 bytes in 429 msecs (HTTP/1.1 202) 10 headers in 456 bytes (2 switches on core 0) Aug 31 16:16:58.495963 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-10e69b57-4114-4474-a11d-0cf6a9495c8f tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db871eae8b444ac1bb654ee687c84c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd86cc078484761bca68f912acb3368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:58.507222 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-10e69b57-4114-4474-a11d-0cf6a9495c8f tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db871eae8b444ac1bb654ee687c84c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd86cc078484761bca68f912acb3368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:58.509151 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-10e69b57-4114-4474-a11d-0cf6a9495c8f tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db871eae8b444ac1bb654ee687c84c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd86cc078484761bca68f912acb3368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:58.510507 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-10e69b57-4114-4474-a11d-0cf6a9495c8f tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] 10.222.0.61 "GET /compute/v2.1/servers/f1973c46-6ab5-4e0c-b188-9398faafa842" status: 200 len: 1329 microversion: 2.21 time: 0.205551 Aug 31 16:16:58.511237 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2257/4502] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:16:58 2022] GET /compute/v2.1/servers/f1973c46-6ab5-4e0c-b188-9398faafa842 => generated 1329 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:16:58.991490 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6761420f-ec81-466c-b76a-5690ae1904f4 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:58.992131 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6761420f-ec81-466c-b76a-5690ae1904f4 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] [instance: 0807b71a-b3ab-4bad-a3b4-a00fc39dedb6] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:59.009250 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6761420f-ec81-466c-b76a-5690ae1904f4 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:59.009765 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6761420f-ec81-466c-b76a-5690ae1904f4 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:59.010225 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6761420f-ec81-466c-b76a-5690ae1904f4 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:59.010966 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6761420f-ec81-466c-b76a-5690ae1904f4 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:59.011431 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6761420f-ec81-466c-b76a-5690ae1904f4 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:59.011893 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6761420f-ec81-466c-b76a-5690ae1904f4 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:59.310899 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e5018f2e-afd1-4111-b6aa-8ac667da015a tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:59.312433 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e5018f2e-afd1-4111-b6aa-8ac667da015a tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: 9b9170ad-8804-4603-b35b-f7a3d2c4af62] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:59.320993 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e5018f2e-afd1-4111-b6aa-8ac667da015a tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:59.321754 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e5018f2e-afd1-4111-b6aa-8ac667da015a tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:59.322394 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e5018f2e-afd1-4111-b6aa-8ac667da015a tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:59.323336 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e5018f2e-afd1-4111-b6aa-8ac667da015a tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:59.324019 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e5018f2e-afd1-4111-b6aa-8ac667da015a tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:59.324647 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e5018f2e-afd1-4111-b6aa-8ac667da015a tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:59.785939 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-6761420f-ec81-466c-b76a-5690ae1904f4 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a598a2bec3e34c239c9fad419545eb52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25e974933e564e5da170dfe26fe921c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:59.794144 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6761420f-ec81-466c-b76a-5690ae1904f4 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] 10.222.0.61 "GET /compute/v2.1/servers/0807b71a-b3ab-4bad-a3b4-a00fc39dedb6" status: 200 len: 1528 microversion: 2.1 time: 0.807931 Aug 31 16:16:59.795222 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2246/4503] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:58 2022] GET /compute/v2.1/servers/0807b71a-b3ab-4bad-a3b4-a00fc39dedb6 => generated 1528 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:59.802776 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5636fc66-2bb6-4301-887f-ddf62e3ff921 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:59.803839 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5636fc66-2bb6-4301-887f-ddf62e3ff921 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] [instance: f1973c46-6ab5-4e0c-b188-9398faafa842] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:59.813668 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5636fc66-2bb6-4301-887f-ddf62e3ff921 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:59.815083 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5636fc66-2bb6-4301-887f-ddf62e3ff921 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:59.816395 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5636fc66-2bb6-4301-887f-ddf62e3ff921 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:59.818201 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5636fc66-2bb6-4301-887f-ddf62e3ff921 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:59.819492 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5636fc66-2bb6-4301-887f-ddf62e3ff921 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:59.820659 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5636fc66-2bb6-4301-887f-ddf62e3ff921 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:00.030602 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5636fc66-2bb6-4301-887f-ddf62e3ff921 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db871eae8b444ac1bb654ee687c84c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd86cc078484761bca68f912acb3368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:00.050313 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5636fc66-2bb6-4301-887f-ddf62e3ff921 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db871eae8b444ac1bb654ee687c84c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd86cc078484761bca68f912acb3368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:00.055665 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5636fc66-2bb6-4301-887f-ddf62e3ff921 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db871eae8b444ac1bb654ee687c84c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd86cc078484761bca68f912acb3368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:00.059412 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5636fc66-2bb6-4301-887f-ddf62e3ff921 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] 10.222.0.61 "GET /compute/v2.1/servers/f1973c46-6ab5-4e0c-b188-9398faafa842" status: 200 len: 1317 microversion: 2.21 time: 0.260172 Aug 31 16:17:00.081308 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2247/4504] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:16:59 2022] GET /compute/v2.1/servers/f1973c46-6ab5-4e0c-b188-9398faafa842 => generated 1317 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:17:00.248304 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e5018f2e-afd1-4111-b6aa-8ac667da015a tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb261f2061164b49a8d496b16647dd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d2222a956a4888967e21647e26b310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:00.310487 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e5018f2e-afd1-4111-b6aa-8ac667da015a tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "GET /compute/v2.1/servers/9b9170ad-8804-4603-b35b-f7a3d2c4af62" status: 200 len: 1517 microversion: 2.1 time: 1.001632 Aug 31 16:17:00.316795 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2258/4505] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:59 2022] GET /compute/v2.1/servers/9b9170ad-8804-4603-b35b-f7a3d2c4af62 => generated 1517 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:00.822909 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1c5983a5-c80d-4c21-8faf-23df5e472bb9 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:00.824604 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1c5983a5-c80d-4c21-8faf-23df5e472bb9 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] [instance: 0807b71a-b3ab-4bad-a3b4-a00fc39dedb6] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:00.836830 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1c5983a5-c80d-4c21-8faf-23df5e472bb9 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:00.837980 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1c5983a5-c80d-4c21-8faf-23df5e472bb9 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:00.839041 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1c5983a5-c80d-4c21-8faf-23df5e472bb9 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:00.841826 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1c5983a5-c80d-4c21-8faf-23df5e472bb9 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:00.842906 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1c5983a5-c80d-4c21-8faf-23df5e472bb9 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:00.844301 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1c5983a5-c80d-4c21-8faf-23df5e472bb9 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:01.088805 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-bae3e90b-e61e-487f-945a-b54745714e15 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:01.091092 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-bae3e90b-e61e-487f-945a-b54745714e15 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] [instance: f1973c46-6ab5-4e0c-b188-9398faafa842] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:01.106667 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bae3e90b-e61e-487f-945a-b54745714e15 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:01.108162 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bae3e90b-e61e-487f-945a-b54745714e15 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:01.109369 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bae3e90b-e61e-487f-945a-b54745714e15 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:01.111357 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bae3e90b-e61e-487f-945a-b54745714e15 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:01.112260 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bae3e90b-e61e-487f-945a-b54745714e15 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:01.113056 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bae3e90b-e61e-487f-945a-b54745714e15 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:01.288364 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1c5983a5-c80d-4c21-8faf-23df5e472bb9 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a598a2bec3e34c239c9fad419545eb52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25e974933e564e5da170dfe26fe921c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:01.346284 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1c5983a5-c80d-4c21-8faf-23df5e472bb9 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] 10.222.0.61 "GET /compute/v2.1/servers/0807b71a-b3ab-4bad-a3b4-a00fc39dedb6" status: 200 len: 1528 microversion: 2.1 time: 0.531256 Aug 31 16:17:01.348336 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2248/4506] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:00 2022] GET /compute/v2.1/servers/0807b71a-b3ab-4bad-a3b4-a00fc39dedb6 => generated 1528 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:01.368625 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-bb418c60-cebe-4240-92ad-55ad88f930e3 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:01.372028 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-bb418c60-cebe-4240-92ad-55ad88f930e3 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: 9b9170ad-8804-4603-b35b-f7a3d2c4af62] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:01.401112 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bb418c60-cebe-4240-92ad-55ad88f930e3 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:01.401944 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bb418c60-cebe-4240-92ad-55ad88f930e3 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:01.402595 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bb418c60-cebe-4240-92ad-55ad88f930e3 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:01.403492 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bb418c60-cebe-4240-92ad-55ad88f930e3 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:01.404189 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bb418c60-cebe-4240-92ad-55ad88f930e3 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:01.405615 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bb418c60-cebe-4240-92ad-55ad88f930e3 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:01.881160 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-bae3e90b-e61e-487f-945a-b54745714e15 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db871eae8b444ac1bb654ee687c84c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd86cc078484761bca68f912acb3368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:01.909589 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-bae3e90b-e61e-487f-945a-b54745714e15 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db871eae8b444ac1bb654ee687c84c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd86cc078484761bca68f912acb3368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:01.913584 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-bae3e90b-e61e-487f-945a-b54745714e15 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db871eae8b444ac1bb654ee687c84c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd86cc078484761bca68f912acb3368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:01.916188 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-bae3e90b-e61e-487f-945a-b54745714e15 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] 10.222.0.61 "GET /compute/v2.1/servers/f1973c46-6ab5-4e0c-b188-9398faafa842" status: 200 len: 1359 microversion: 2.21 time: 0.831218 Aug 31 16:17:01.918146 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2259/4507] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:17:01 2022] GET /compute/v2.1/servers/f1973c46-6ab5-4e0c-b188-9398faafa842 => generated 1359 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:17:01.929669 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-7d5dfa44-e4f7-4e40-8062-1ec9888366d8 req-663684a2-8c5e-4148-b33e-b0e08101b739 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0807b71a-b3ab-4bad-a3b4-a00fc39dedb6", "name": "network-vif-deleted", "tag": "5d3f634d-786f-418e-87e5-1b6e9210479b"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:17:01.951111 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-7d5dfa44-e4f7-4e40-8062-1ec9888366d8 req-663684a2-8c5e-4148-b33e-b0e08101b739 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:01.959540 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-7d5dfa44-e4f7-4e40-8062-1ec9888366d8 req-663684a2-8c5e-4148-b33e-b0e08101b739 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:01.960021 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-7d5dfa44-e4f7-4e40-8062-1ec9888366d8 req-663684a2-8c5e-4148-b33e-b0e08101b739 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:01.984042 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-7d5dfa44-e4f7-4e40-8062-1ec9888366d8 req-663684a2-8c5e-4148-b33e-b0e08101b739 service nova] Creating event network-vif-deleted:5d3f634d-786f-418e-87e5-1b6e9210479b for instance 0807b71a-b3ab-4bad-a3b4-a00fc39dedb6 on n-h2-850499-9 Aug 31 16:17:01.994516 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-7d5dfa44-e4f7-4e40-8062-1ec9888366d8 req-663684a2-8c5e-4148-b33e-b0e08101b739 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074403 Aug 31 16:17:01.996841 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2260/4508] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:17:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:17:02.108685 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-bb418c60-cebe-4240-92ad-55ad88f930e3 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb261f2061164b49a8d496b16647dd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d2222a956a4888967e21647e26b310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:02.121921 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-bb418c60-cebe-4240-92ad-55ad88f930e3 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "GET /compute/v2.1/servers/9b9170ad-8804-4603-b35b-f7a3d2c4af62" status: 200 len: 1517 microversion: 2.1 time: 0.771622 Aug 31 16:17:02.122717 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2249/4509] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:01 2022] GET /compute/v2.1/servers/9b9170ad-8804-4603-b35b-f7a3d2c4af62 => generated 1517 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:02.372361 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8f2fc124-81d8-43ce-97d9-2156d69e7d40 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:02.374522 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8f2fc124-81d8-43ce-97d9-2156d69e7d40 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] [instance: 0807b71a-b3ab-4bad-a3b4-a00fc39dedb6] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:02.390590 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8f2fc124-81d8-43ce-97d9-2156d69e7d40 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:02.391595 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8f2fc124-81d8-43ce-97d9-2156d69e7d40 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:02.393866 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8f2fc124-81d8-43ce-97d9-2156d69e7d40 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:02.394966 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8f2fc124-81d8-43ce-97d9-2156d69e7d40 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:02.396802 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8f2fc124-81d8-43ce-97d9-2156d69e7d40 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:02.399780 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8f2fc124-81d8-43ce-97d9-2156d69e7d40 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:02.511824 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8f2fc124-81d8-43ce-97d9-2156d69e7d40 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:02.512783 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8f2fc124-81d8-43ce-97d9-2156d69e7d40 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:02.513593 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8f2fc124-81d8-43ce-97d9-2156d69e7d40 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:02.522287 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-8f2fc124-81d8-43ce-97d9-2156d69e7d40 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Lazy-loading 'fault' on Instance uuid 0807b71a-b3ab-4bad-a3b4-a00fc39dedb6 {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:17:02.641556 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8f2fc124-81d8-43ce-97d9-2156d69e7d40 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a598a2bec3e34c239c9fad419545eb52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25e974933e564e5da170dfe26fe921c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:02.700810 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8f2fc124-81d8-43ce-97d9-2156d69e7d40 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] 10.222.0.61 "GET /compute/v2.1/servers/0807b71a-b3ab-4bad-a3b4-a00fc39dedb6" status: 200 len: 1315 microversion: 2.1 time: 0.334159 Aug 31 16:17:02.709125 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2261/4510] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:02 2022] GET /compute/v2.1/servers/0807b71a-b3ab-4bad-a3b4-a00fc39dedb6 => generated 1315 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:02.973678 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2bd4fc49-ec88-42be-91bb-afbe78e81e99 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:02.976524 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2bd4fc49-ec88-42be-91bb-afbe78e81e99 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] [instance: f1973c46-6ab5-4e0c-b188-9398faafa842] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:02.989013 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2bd4fc49-ec88-42be-91bb-afbe78e81e99 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:02.990394 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2bd4fc49-ec88-42be-91bb-afbe78e81e99 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:02.991474 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2bd4fc49-ec88-42be-91bb-afbe78e81e99 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:02.993086 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2bd4fc49-ec88-42be-91bb-afbe78e81e99 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:02.994224 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2bd4fc49-ec88-42be-91bb-afbe78e81e99 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:02.995312 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2bd4fc49-ec88-42be-91bb-afbe78e81e99 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:03.153686 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a130fd44-7f19-4311-b953-a5b80b0e87f7 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:03.157051 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a130fd44-7f19-4311-b953-a5b80b0e87f7 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: 9b9170ad-8804-4603-b35b-f7a3d2c4af62] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:03.187963 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a130fd44-7f19-4311-b953-a5b80b0e87f7 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:03.192705 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a130fd44-7f19-4311-b953-a5b80b0e87f7 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:03.193557 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a130fd44-7f19-4311-b953-a5b80b0e87f7 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:03.195620 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a130fd44-7f19-4311-b953-a5b80b0e87f7 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:03.197350 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a130fd44-7f19-4311-b953-a5b80b0e87f7 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:03.200267 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a130fd44-7f19-4311-b953-a5b80b0e87f7 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:03.513251 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-2bd4fc49-ec88-42be-91bb-afbe78e81e99 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db871eae8b444ac1bb654ee687c84c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd86cc078484761bca68f912acb3368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:03.547967 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-2bd4fc49-ec88-42be-91bb-afbe78e81e99 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db871eae8b444ac1bb654ee687c84c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd86cc078484761bca68f912acb3368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:03.556642 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-2bd4fc49-ec88-42be-91bb-afbe78e81e99 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db871eae8b444ac1bb654ee687c84c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd86cc078484761bca68f912acb3368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:03.562601 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2bd4fc49-ec88-42be-91bb-afbe78e81e99 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] 10.222.0.61 "GET /compute/v2.1/servers/f1973c46-6ab5-4e0c-b188-9398faafa842" status: 200 len: 1359 microversion: 2.21 time: 0.594213 Aug 31 16:17:03.565408 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2250/4511] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:17:02 2022] GET /compute/v2.1/servers/f1973c46-6ab5-4e0c-b188-9398faafa842 => generated 1359 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:17:03.574103 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a130fd44-7f19-4311-b953-a5b80b0e87f7 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb261f2061164b49a8d496b16647dd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d2222a956a4888967e21647e26b310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:03.597242 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a130fd44-7f19-4311-b953-a5b80b0e87f7 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "GET /compute/v2.1/servers/9b9170ad-8804-4603-b35b-f7a3d2c4af62" status: 200 len: 1523 microversion: 2.1 time: 0.451242 Aug 31 16:17:03.598439 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2262/4512] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:03 2022] GET /compute/v2.1/servers/9b9170ad-8804-4603-b35b-f7a3d2c4af62 => generated 1523 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:03.753607 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-17610698-73a4-46a3-805c-5dce534c9d82 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:03.755265 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-17610698-73a4-46a3-805c-5dce534c9d82 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] [instance: 0807b71a-b3ab-4bad-a3b4-a00fc39dedb6] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:03.779179 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-17610698-73a4-46a3-805c-5dce534c9d82 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:03.781638 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-17610698-73a4-46a3-805c-5dce534c9d82 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:03.783394 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-17610698-73a4-46a3-805c-5dce534c9d82 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:03.785599 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-17610698-73a4-46a3-805c-5dce534c9d82 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:03.788761 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-17610698-73a4-46a3-805c-5dce534c9d82 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:03.789878 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-17610698-73a4-46a3-805c-5dce534c9d82 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:03.822158 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-17610698-73a4-46a3-805c-5dce534c9d82 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] HTTP exception thrown: Instance 0807b71a-b3ab-4bad-a3b4-a00fc39dedb6 could not be found. Aug 31 16:17:03.834243 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-17610698-73a4-46a3-805c-5dce534c9d82 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Request method failure captured: Aug 31 16:17:03.834243 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/0807b71a-b3ab-4bad-a3b4-a00fc39dedb6 HTTP/1.1 Aug 31 16:17:03.834243 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:17:03.834243 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:17:03.834243 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:17:03.834243 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:17:03.834243 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:17:03.834243 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:17:03.834243 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:17:03.834243 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:17:03.834243 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4lUiF3fArFupsBNozGrkCztImIkiOpgKyawMawFrQnV_GvFmfIfobdvsKSLHxCShbYFrW7Xqf5jAcqvTK5cDUgGhCFjxAxViWSRK12pguoU95ebMEp-iajQcYHGenEKhYYzQ1CxvvrfMWIQC69MzIMAClH21iObCVOqPfbFjzKYOgY Aug 31 16:17:03.834243 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:17:03.834243 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:17:03.834243 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:17:03.834243 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:17:03.834243 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:17:03.834243 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:17:03.834243 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 25e974933e564e5da170dfe26fe921c3 Aug 31 16:17:03.834243 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-145318871 Aug 31 16:17:03.834243 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:17:03.834243 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:17:03.834243 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/25e974933e564e5da170dfe26fe921c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/25e974933e564e5da170dfe26fe921c3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_25e974933e564e5da170dfe26fe921c3", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/25e974933e564e5da170dfe26fe921c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:17:03.834243 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-145318871 Aug 31 16:17:03.834243 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 25e974933e564e5da170dfe26fe921c3 Aug 31 16:17:03.834243 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-145318871 Aug 31 16:17:03.834243 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ServerAddressesNegativeTestJSON-145318871-project Aug 31 16:17:03.834243 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:17:03.834243 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:17:03.834243 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: a598a2bec3e34c239c9fad419545eb52 Aug 31 16:17:03.834243 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-145318871-project Aug 31 16:17:03.834243 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:17:03.834243 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance 0807b71a-b3ab-4bad-a3b4-a00fc39dedb6 could not be found. Aug 31 16:17:03.834243 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '0807b71a-b3ab-4bad-a3b4-a00fc39dedb6'} Aug 31 16:17:03.834243 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:17:03.834243 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:17:03.834243 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:17:03.834243 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:17:03.834243 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:17:03.834243 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:17:03.834243 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:17:03.834243 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:17:03.834243 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:17:03.834243 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:17:03.834243 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0807b71a-b3ab-4bad-a3b4-a00fc39dedb6 could not be found. Aug 31 16:17:03.834243 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:17:03.834243 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:17:03.834243 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:17:03.834243 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:17:03.834243 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:17:03.834243 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:17:03.834243 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:17:03.834243 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:17:03.834243 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:17:03.834243 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:17:03.834243 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:17:03.834243 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:17:03.834243 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:17:03.834243 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:17:03.834243 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:17:03.834243 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:17:03.834243 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0807b71a-b3ab-4bad-a3b4-a00fc39dedb6 could not be found. Aug 31 16:17:03.834243 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:17:03.834243 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:17:03.845434 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:17:03.845434 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:17:03.845434 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:17:03.845434 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:17:03.845434 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:17:03.845434 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:17:03.845434 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0807b71a-b3ab-4bad-a3b4-a00fc39dedb6 could not be found. Aug 31 16:17:03.845434 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:17:03.845434 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-17610698-73a4-46a3-805c-5dce534c9d82 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] Returning 404 to user: Instance 0807b71a-b3ab-4bad-a3b4-a00fc39dedb6 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:17:03.845434 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-17610698-73a4-46a3-805c-5dce534c9d82 tempest-ServerAddressesNegativeTestJSON-145318871 tempest-ServerAddressesNegativeTestJSON-145318871-project] 10.222.0.61 "GET /compute/v2.1/servers/0807b71a-b3ab-4bad-a3b4-a00fc39dedb6" status: 404 len: 111 microversion: 2.1 time: 0.092890 Aug 31 16:17:03.845434 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2251/4513] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:03 2022] GET /compute/v2.1/servers/0807b71a-b3ab-4bad-a3b4-a00fc39dedb6 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:17:04.053768 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-fd9f58f6-4978-4b61-8b69-0a5f4a7edd1c req-976d1b96-8ef9-41e5-a2b9-5fb021357d3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1973c46-6ab5-4e0c-b188-9398faafa842", "tag": "ee5f5354-7806-4239-bc32-168c5f8d7892"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:17:04.078052 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-fd9f58f6-4978-4b61-8b69-0a5f4a7edd1c req-976d1b96-8ef9-41e5-a2b9-5fb021357d3d service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:04.079602 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-fd9f58f6-4978-4b61-8b69-0a5f4a7edd1c req-976d1b96-8ef9-41e5-a2b9-5fb021357d3d service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:04.080682 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-fd9f58f6-4978-4b61-8b69-0a5f4a7edd1c req-976d1b96-8ef9-41e5-a2b9-5fb021357d3d service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:04.153895 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-fd9f58f6-4978-4b61-8b69-0a5f4a7edd1c req-976d1b96-8ef9-41e5-a2b9-5fb021357d3d service nova] Creating event network-changed:ee5f5354-7806-4239-bc32-168c5f8d7892 for instance f1973c46-6ab5-4e0c-b188-9398faafa842 on n-h2-850499-9 Aug 31 16:17:04.166318 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-fd9f58f6-4978-4b61-8b69-0a5f4a7edd1c req-976d1b96-8ef9-41e5-a2b9-5fb021357d3d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126928 Aug 31 16:17:04.169499 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2263/4514] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:17:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:17:04.596272 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ef10f735-7d14-4c2f-9b08-478f1fbd7f9f tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:04.597038 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ef10f735-7d14-4c2f-9b08-478f1fbd7f9f tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] [instance: f1973c46-6ab5-4e0c-b188-9398faafa842] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:04.612415 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-e7712c6f-d9ab-4248-a519-48e71bae71f8 req-1b32608a-9803-43b3-88a4-8042c1912d33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b9170ad-8804-4603-b35b-f7a3d2c4af62", "name": "network-vif-unplugged", "status": "completed", "tag": "36e7a186-ebb0-4a76-af6a-cd120bd63d63"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:17:04.626865 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ef10f735-7d14-4c2f-9b08-478f1fbd7f9f tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:04.627371 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ef10f735-7d14-4c2f-9b08-478f1fbd7f9f tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:04.627853 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ef10f735-7d14-4c2f-9b08-478f1fbd7f9f tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:04.628575 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ef10f735-7d14-4c2f-9b08-478f1fbd7f9f tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:04.629037 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ef10f735-7d14-4c2f-9b08-478f1fbd7f9f tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:04.629469 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ef10f735-7d14-4c2f-9b08-478f1fbd7f9f tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:04.647189 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-e7712c6f-d9ab-4248-a519-48e71bae71f8 req-1b32608a-9803-43b3-88a4-8042c1912d33 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:04.650045 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-e7712c6f-d9ab-4248-a519-48e71bae71f8 req-1b32608a-9803-43b3-88a4-8042c1912d33 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:04.651972 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-e7712c6f-d9ab-4248-a519-48e71bae71f8 req-1b32608a-9803-43b3-88a4-8042c1912d33 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:04.688528 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-e7712c6f-d9ab-4248-a519-48e71bae71f8 req-1b32608a-9803-43b3-88a4-8042c1912d33 service nova] Creating event network-vif-unplugged:36e7a186-ebb0-4a76-af6a-cd120bd63d63 for instance 9b9170ad-8804-4603-b35b-f7a3d2c4af62 on n-h1-850499-9 Aug 31 16:17:04.715308 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-e7712c6f-d9ab-4248-a519-48e71bae71f8 req-1b32608a-9803-43b3-88a4-8042c1912d33 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.107956 Aug 31 16:17:04.716736 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2264/4515] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:17:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:17:04.725068 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0d2ce85d-296a-4c23-8bb2-bbe82682ac14 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:04.726188 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0d2ce85d-296a-4c23-8bb2-bbe82682ac14 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: 9b9170ad-8804-4603-b35b-f7a3d2c4af62] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:04.737299 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0d2ce85d-296a-4c23-8bb2-bbe82682ac14 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:04.738466 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0d2ce85d-296a-4c23-8bb2-bbe82682ac14 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:04.739658 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0d2ce85d-296a-4c23-8bb2-bbe82682ac14 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:04.741465 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0d2ce85d-296a-4c23-8bb2-bbe82682ac14 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:04.742648 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0d2ce85d-296a-4c23-8bb2-bbe82682ac14 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:04.743647 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0d2ce85d-296a-4c23-8bb2-bbe82682ac14 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:04.824101 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:17:04.899400 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=6 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:17:05.122928 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:17:05.175052 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ef10f735-7d14-4c2f-9b08-478f1fbd7f9f tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db871eae8b444ac1bb654ee687c84c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd86cc078484761bca68f912acb3368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:05.192836 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ef10f735-7d14-4c2f-9b08-478f1fbd7f9f tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db871eae8b444ac1bb654ee687c84c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd86cc078484761bca68f912acb3368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:05.194833 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ef10f735-7d14-4c2f-9b08-478f1fbd7f9f tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db871eae8b444ac1bb654ee687c84c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd86cc078484761bca68f912acb3368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:05.196189 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ef10f735-7d14-4c2f-9b08-478f1fbd7f9f tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] 10.222.0.61 "GET /compute/v2.1/servers/f1973c46-6ab5-4e0c-b188-9398faafa842" status: 200 len: 1359 microversion: 2.21 time: 0.606524 Aug 31 16:17:05.198472 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2252/4516] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:17:04 2022] GET /compute/v2.1/servers/f1973c46-6ab5-4e0c-b188-9398faafa842 => generated 1359 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:17:05.239302 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0d2ce85d-296a-4c23-8bb2-bbe82682ac14 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb261f2061164b49a8d496b16647dd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d2222a956a4888967e21647e26b310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:05.251659 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0d2ce85d-296a-4c23-8bb2-bbe82682ac14 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "GET /compute/v2.1/servers/9b9170ad-8804-4603-b35b-f7a3d2c4af62" status: 200 len: 1523 microversion: 2.1 time: 0.532912 Aug 31 16:17:05.252430 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2265/4517] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:04 2022] GET /compute/v2.1/servers/9b9170ad-8804-4603-b35b-f7a3d2c4af62 => generated 1523 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:06.226650 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-716d649f-724d-41b5-a886-5cc2e476658f tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:06.227332 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-716d649f-724d-41b5-a886-5cc2e476658f tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] [instance: f1973c46-6ab5-4e0c-b188-9398faafa842] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:06.246955 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:17:06.250030 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-716d649f-724d-41b5-a886-5cc2e476658f tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:06.253649 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-716d649f-724d-41b5-a886-5cc2e476658f tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:06.254291 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-716d649f-724d-41b5-a886-5cc2e476658f tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:06.255256 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-716d649f-724d-41b5-a886-5cc2e476658f tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:06.257357 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-716d649f-724d-41b5-a886-5cc2e476658f tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:06.261829 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-716d649f-724d-41b5-a886-5cc2e476658f tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:06.276985 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5e196a9d-fc36-4aac-aa23-0736e03f9e52 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:06.277788 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5e196a9d-fc36-4aac-aa23-0736e03f9e52 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: 9b9170ad-8804-4603-b35b-f7a3d2c4af62] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:06.289318 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5e196a9d-fc36-4aac-aa23-0736e03f9e52 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:06.289663 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5e196a9d-fc36-4aac-aa23-0736e03f9e52 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:06.292468 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5e196a9d-fc36-4aac-aa23-0736e03f9e52 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:06.293932 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5e196a9d-fc36-4aac-aa23-0736e03f9e52 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:06.295988 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5e196a9d-fc36-4aac-aa23-0736e03f9e52 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:06.296557 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5e196a9d-fc36-4aac-aa23-0736e03f9e52 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:06.999722 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-716d649f-724d-41b5-a886-5cc2e476658f tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db871eae8b444ac1bb654ee687c84c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd86cc078484761bca68f912acb3368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:07.018063 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-716d649f-724d-41b5-a886-5cc2e476658f tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db871eae8b444ac1bb654ee687c84c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd86cc078484761bca68f912acb3368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:07.022305 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-716d649f-724d-41b5-a886-5cc2e476658f tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db871eae8b444ac1bb654ee687c84c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd86cc078484761bca68f912acb3368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:07.027161 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-716d649f-724d-41b5-a886-5cc2e476658f tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] 10.222.0.61 "GET /compute/v2.1/servers/f1973c46-6ab5-4e0c-b188-9398faafa842" status: 200 len: 1359 microversion: 2.21 time: 0.806682 Aug 31 16:17:07.028379 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2253/4518] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:17:06 2022] GET /compute/v2.1/servers/f1973c46-6ab5-4e0c-b188-9398faafa842 => generated 1359 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:17:07.074560 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5e196a9d-fc36-4aac-aa23-0736e03f9e52 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb261f2061164b49a8d496b16647dd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d2222a956a4888967e21647e26b310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:07.090871 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5e196a9d-fc36-4aac-aa23-0736e03f9e52 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "GET /compute/v2.1/servers/9b9170ad-8804-4603-b35b-f7a3d2c4af62" status: 200 len: 1523 microversion: 2.1 time: 0.817966 Aug 31 16:17:07.109548 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2266/4519] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:06 2022] GET /compute/v2.1/servers/9b9170ad-8804-4603-b35b-f7a3d2c4af62 => generated 1523 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:08.054648 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-794d8154-8173-4519-8101-1c9f22f2a950 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:08.055204 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-794d8154-8173-4519-8101-1c9f22f2a950 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] [instance: f1973c46-6ab5-4e0c-b188-9398faafa842] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:08.074930 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-794d8154-8173-4519-8101-1c9f22f2a950 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:08.077071 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-794d8154-8173-4519-8101-1c9f22f2a950 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:08.079945 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-794d8154-8173-4519-8101-1c9f22f2a950 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:08.083792 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-794d8154-8173-4519-8101-1c9f22f2a950 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:08.097446 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-794d8154-8173-4519-8101-1c9f22f2a950 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:08.098310 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-794d8154-8173-4519-8101-1c9f22f2a950 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:08.115749 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-704deed0-ce15-4d9a-85e0-f97c17a47717 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:08.116961 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-704deed0-ce15-4d9a-85e0-f97c17a47717 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: 9b9170ad-8804-4603-b35b-f7a3d2c4af62] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:08.146373 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-704deed0-ce15-4d9a-85e0-f97c17a47717 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:08.154057 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-704deed0-ce15-4d9a-85e0-f97c17a47717 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:08.155338 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-704deed0-ce15-4d9a-85e0-f97c17a47717 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:08.159478 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-704deed0-ce15-4d9a-85e0-f97c17a47717 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:08.164568 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-704deed0-ce15-4d9a-85e0-f97c17a47717 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:08.166440 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-704deed0-ce15-4d9a-85e0-f97c17a47717 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:08.720987 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-794d8154-8173-4519-8101-1c9f22f2a950 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db871eae8b444ac1bb654ee687c84c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd86cc078484761bca68f912acb3368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:08.744823 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-794d8154-8173-4519-8101-1c9f22f2a950 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db871eae8b444ac1bb654ee687c84c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd86cc078484761bca68f912acb3368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:08.756938 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-794d8154-8173-4519-8101-1c9f22f2a950 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db871eae8b444ac1bb654ee687c84c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd86cc078484761bca68f912acb3368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:08.758767 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-794d8154-8173-4519-8101-1c9f22f2a950 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] 10.222.0.61 "GET /compute/v2.1/servers/f1973c46-6ab5-4e0c-b188-9398faafa842" status: 200 len: 1359 microversion: 2.21 time: 0.711338 Aug 31 16:17:08.760755 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2254/4520] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:17:08 2022] GET /compute/v2.1/servers/f1973c46-6ab5-4e0c-b188-9398faafa842 => generated 1359 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:17:08.941934 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-704deed0-ce15-4d9a-85e0-f97c17a47717 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb261f2061164b49a8d496b16647dd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d2222a956a4888967e21647e26b310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:08.946847 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:17:08.962154 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-704deed0-ce15-4d9a-85e0-f97c17a47717 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "GET /compute/v2.1/servers/9b9170ad-8804-4603-b35b-f7a3d2c4af62" status: 200 len: 1523 microversion: 2.1 time: 0.850634 Aug 31 16:17:08.963962 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2267/4521] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:08 2022] GET /compute/v2.1/servers/9b9170ad-8804-4603-b35b-f7a3d2c4af62 => generated 1523 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:09.788218 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ca2a9e81-090c-441e-b14f-3deaf42ba60d tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:09.788815 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ca2a9e81-090c-441e-b14f-3deaf42ba60d tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] [instance: f1973c46-6ab5-4e0c-b188-9398faafa842] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:09.801466 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ca2a9e81-090c-441e-b14f-3deaf42ba60d tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:09.802195 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ca2a9e81-090c-441e-b14f-3deaf42ba60d tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:09.802782 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ca2a9e81-090c-441e-b14f-3deaf42ba60d tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:09.805112 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ca2a9e81-090c-441e-b14f-3deaf42ba60d tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:09.806649 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ca2a9e81-090c-441e-b14f-3deaf42ba60d tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:09.807360 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ca2a9e81-090c-441e-b14f-3deaf42ba60d tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:09.986636 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-dd1b527c-50db-4831-b4e4-b16dc8953fc3 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:09.988067 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-dd1b527c-50db-4831-b4e4-b16dc8953fc3 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: 9b9170ad-8804-4603-b35b-f7a3d2c4af62] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:10.002242 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dd1b527c-50db-4831-b4e4-b16dc8953fc3 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:10.002749 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dd1b527c-50db-4831-b4e4-b16dc8953fc3 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:10.003194 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dd1b527c-50db-4831-b4e4-b16dc8953fc3 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:10.003962 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dd1b527c-50db-4831-b4e4-b16dc8953fc3 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:10.004429 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dd1b527c-50db-4831-b4e4-b16dc8953fc3 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:10.004868 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dd1b527c-50db-4831-b4e4-b16dc8953fc3 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:10.400646 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ca2a9e81-090c-441e-b14f-3deaf42ba60d tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db871eae8b444ac1bb654ee687c84c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd86cc078484761bca68f912acb3368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:10.414945 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ca2a9e81-090c-441e-b14f-3deaf42ba60d tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db871eae8b444ac1bb654ee687c84c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd86cc078484761bca68f912acb3368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:10.425334 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ca2a9e81-090c-441e-b14f-3deaf42ba60d tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db871eae8b444ac1bb654ee687c84c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd86cc078484761bca68f912acb3368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:10.429473 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ca2a9e81-090c-441e-b14f-3deaf42ba60d tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] 10.222.0.61 "GET /compute/v2.1/servers/f1973c46-6ab5-4e0c-b188-9398faafa842" status: 200 len: 1359 microversion: 2.21 time: 0.643781 Aug 31 16:17:10.452580 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2255/4522] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:17:09 2022] GET /compute/v2.1/servers/f1973c46-6ab5-4e0c-b188-9398faafa842 => generated 1359 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:17:10.815920 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-dd1b527c-50db-4831-b4e4-b16dc8953fc3 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb261f2061164b49a8d496b16647dd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d2222a956a4888967e21647e26b310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:10.877448 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-dd1b527c-50db-4831-b4e4-b16dc8953fc3 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "GET /compute/v2.1/servers/9b9170ad-8804-4603-b35b-f7a3d2c4af62" status: 200 len: 1523 microversion: 2.1 time: 0.892870 Aug 31 16:17:10.881985 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2268/4523] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:09 2022] GET /compute/v2.1/servers/9b9170ad-8804-4603-b35b-f7a3d2c4af62 => generated 1523 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:11.463043 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7fc6813d-f688-4f2b-a5b6-c9c66c324c15 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:11.463775 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7fc6813d-f688-4f2b-a5b6-c9c66c324c15 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] [instance: f1973c46-6ab5-4e0c-b188-9398faafa842] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:11.483849 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7fc6813d-f688-4f2b-a5b6-c9c66c324c15 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:11.484332 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7fc6813d-f688-4f2b-a5b6-c9c66c324c15 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:11.484838 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7fc6813d-f688-4f2b-a5b6-c9c66c324c15 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:11.485582 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7fc6813d-f688-4f2b-a5b6-c9c66c324c15 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:11.486045 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7fc6813d-f688-4f2b-a5b6-c9c66c324c15 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:11.486480 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7fc6813d-f688-4f2b-a5b6-c9c66c324c15 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:11.491142 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:17:11.901688 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7c8f605b-b34c-403e-a9f5-2ec9ec31570e tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:11.902727 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7c8f605b-b34c-403e-a9f5-2ec9ec31570e tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: 9b9170ad-8804-4603-b35b-f7a3d2c4af62] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:11.924133 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7c8f605b-b34c-403e-a9f5-2ec9ec31570e tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:11.925259 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7c8f605b-b34c-403e-a9f5-2ec9ec31570e tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:11.925924 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7c8f605b-b34c-403e-a9f5-2ec9ec31570e tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:11.926930 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7c8f605b-b34c-403e-a9f5-2ec9ec31570e tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:11.927563 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7c8f605b-b34c-403e-a9f5-2ec9ec31570e tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:11.928083 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7c8f605b-b34c-403e-a9f5-2ec9ec31570e tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:12.436908 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7fc6813d-f688-4f2b-a5b6-c9c66c324c15 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db871eae8b444ac1bb654ee687c84c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd86cc078484761bca68f912acb3368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:12.447653 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7fc6813d-f688-4f2b-a5b6-c9c66c324c15 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db871eae8b444ac1bb654ee687c84c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd86cc078484761bca68f912acb3368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:12.458700 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7fc6813d-f688-4f2b-a5b6-c9c66c324c15 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db871eae8b444ac1bb654ee687c84c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd86cc078484761bca68f912acb3368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:12.460545 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7fc6813d-f688-4f2b-a5b6-c9c66c324c15 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] 10.222.0.61 "GET /compute/v2.1/servers/f1973c46-6ab5-4e0c-b188-9398faafa842" status: 200 len: 1359 microversion: 2.21 time: 1.010526 Aug 31 16:17:12.468920 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2256/4524] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:17:11 2022] GET /compute/v2.1/servers/f1973c46-6ab5-4e0c-b188-9398faafa842 => generated 1359 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:17:12.474704 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-6dfe576d-91a0-493c-b081-0e7b4c589f7a req-ae64229e-c166-4a1b-bc2e-44af6d889211 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b9170ad-8804-4603-b35b-f7a3d2c4af62", "name": "network-vif-plugged", "status": "completed", "tag": "36e7a186-ebb0-4a76-af6a-cd120bd63d63"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:17:12.507154 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-6dfe576d-91a0-493c-b081-0e7b4c589f7a req-ae64229e-c166-4a1b-bc2e-44af6d889211 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:12.508093 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-6dfe576d-91a0-493c-b081-0e7b4c589f7a req-ae64229e-c166-4a1b-bc2e-44af6d889211 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:12.508720 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-6dfe576d-91a0-493c-b081-0e7b4c589f7a req-ae64229e-c166-4a1b-bc2e-44af6d889211 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:12.541688 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-6dfe576d-91a0-493c-b081-0e7b4c589f7a req-ae64229e-c166-4a1b-bc2e-44af6d889211 service nova] Creating event network-vif-plugged:36e7a186-ebb0-4a76-af6a-cd120bd63d63 for instance 9b9170ad-8804-4603-b35b-f7a3d2c4af62 on n-h1-850499-9 Aug 31 16:17:12.548494 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-6dfe576d-91a0-493c-b081-0e7b4c589f7a req-ae64229e-c166-4a1b-bc2e-44af6d889211 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076970 Aug 31 16:17:12.549808 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2257/4525] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:17:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:17:12.799696 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7c8f605b-b34c-403e-a9f5-2ec9ec31570e tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb261f2061164b49a8d496b16647dd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d2222a956a4888967e21647e26b310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:12.829854 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7c8f605b-b34c-403e-a9f5-2ec9ec31570e tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "GET /compute/v2.1/servers/9b9170ad-8804-4603-b35b-f7a3d2c4af62" status: 200 len: 1523 microversion: 2.1 time: 0.927410 Aug 31 16:17:12.843558 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2269/4526] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:11 2022] GET /compute/v2.1/servers/9b9170ad-8804-4603-b35b-f7a3d2c4af62 => generated 1523 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:13.526687 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-57e0ea3c-e449-4a50-95d9-49cc8e5a29b8 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:13.529832 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-57e0ea3c-e449-4a50-95d9-49cc8e5a29b8 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] [instance: f1973c46-6ab5-4e0c-b188-9398faafa842] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:13.591188 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-57e0ea3c-e449-4a50-95d9-49cc8e5a29b8 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:13.595018 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-57e0ea3c-e449-4a50-95d9-49cc8e5a29b8 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:13.602283 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-57e0ea3c-e449-4a50-95d9-49cc8e5a29b8 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:13.606175 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-57e0ea3c-e449-4a50-95d9-49cc8e5a29b8 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:13.613581 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-57e0ea3c-e449-4a50-95d9-49cc8e5a29b8 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:13.614891 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-57e0ea3c-e449-4a50-95d9-49cc8e5a29b8 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:13.860289 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f3f1e717-30b8-4619-aa69-25c4c968c4e4 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:13.861001 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f3f1e717-30b8-4619-aa69-25c4c968c4e4 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: 9b9170ad-8804-4603-b35b-f7a3d2c4af62] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:13.886303 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:17:13.889654 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f3f1e717-30b8-4619-aa69-25c4c968c4e4 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:13.890237 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f3f1e717-30b8-4619-aa69-25c4c968c4e4 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:13.891043 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f3f1e717-30b8-4619-aa69-25c4c968c4e4 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:13.892345 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f3f1e717-30b8-4619-aa69-25c4c968c4e4 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:13.900095 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f3f1e717-30b8-4619-aa69-25c4c968c4e4 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:13.900987 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f3f1e717-30b8-4619-aa69-25c4c968c4e4 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:14.124079 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-57e0ea3c-e449-4a50-95d9-49cc8e5a29b8 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db871eae8b444ac1bb654ee687c84c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd86cc078484761bca68f912acb3368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:14.137257 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-57e0ea3c-e449-4a50-95d9-49cc8e5a29b8 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db871eae8b444ac1bb654ee687c84c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd86cc078484761bca68f912acb3368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:14.138868 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-57e0ea3c-e449-4a50-95d9-49cc8e5a29b8 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db871eae8b444ac1bb654ee687c84c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd86cc078484761bca68f912acb3368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:14.148631 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-57e0ea3c-e449-4a50-95d9-49cc8e5a29b8 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] 10.222.0.61 "GET /compute/v2.1/servers/f1973c46-6ab5-4e0c-b188-9398faafa842" status: 200 len: 1359 microversion: 2.21 time: 0.631738 Aug 31 16:17:14.149241 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2258/4527] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:17:13 2022] GET /compute/v2.1/servers/f1973c46-6ab5-4e0c-b188-9398faafa842 => generated 1359 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:17:14.361537 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f3f1e717-30b8-4619-aa69-25c4c968c4e4 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb261f2061164b49a8d496b16647dd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d2222a956a4888967e21647e26b310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:14.382926 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f3f1e717-30b8-4619-aa69-25c4c968c4e4 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "GET /compute/v2.1/servers/9b9170ad-8804-4603-b35b-f7a3d2c4af62" status: 200 len: 1523 microversion: 2.1 time: 0.530307 Aug 31 16:17:14.385302 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2270/4528] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:13 2022] GET /compute/v2.1/servers/9b9170ad-8804-4603-b35b-f7a3d2c4af62 => generated 1523 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:14.719994 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-b34f1d0f-d243-4719-9b34-91f394fa839a req-449e5a48-158e-4ddc-9bbb-075969d186bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42ccbb85-9677-4cb9-879a-dc280cda020c", "name": "network-vif-plugged", "status": "completed", "tag": "44b19fab-a1b0-47af-8c78-4bab130a016b"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:17:14.752051 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-b34f1d0f-d243-4719-9b34-91f394fa839a req-449e5a48-158e-4ddc-9bbb-075969d186bb service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:14.752535 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-b34f1d0f-d243-4719-9b34-91f394fa839a req-449e5a48-158e-4ddc-9bbb-075969d186bb service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:14.756480 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-b34f1d0f-d243-4719-9b34-91f394fa839a req-449e5a48-158e-4ddc-9bbb-075969d186bb service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:14.805507 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-b34f1d0f-d243-4719-9b34-91f394fa839a req-449e5a48-158e-4ddc-9bbb-075969d186bb service nova] Creating event network-vif-plugged:44b19fab-a1b0-47af-8c78-4bab130a016b for instance 42ccbb85-9677-4cb9-879a-dc280cda020c on n-h2-850499-9 Aug 31 16:17:14.827723 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-b34f1d0f-d243-4719-9b34-91f394fa839a req-449e5a48-158e-4ddc-9bbb-075969d186bb service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112892 Aug 31 16:17:14.835984 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2259/4529] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:17:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:17:15.181379 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a8b60620-ba03-4365-aa5a-e0e87fee688b tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:15.182826 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a8b60620-ba03-4365-aa5a-e0e87fee688b tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] [instance: f1973c46-6ab5-4e0c-b188-9398faafa842] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:15.233384 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a8b60620-ba03-4365-aa5a-e0e87fee688b tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:15.234449 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a8b60620-ba03-4365-aa5a-e0e87fee688b tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:15.235224 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a8b60620-ba03-4365-aa5a-e0e87fee688b tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:15.238811 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a8b60620-ba03-4365-aa5a-e0e87fee688b tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:15.240448 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a8b60620-ba03-4365-aa5a-e0e87fee688b tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:15.241219 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a8b60620-ba03-4365-aa5a-e0e87fee688b tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:15.444369 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8173dd81-62fb-4f5f-a65c-6754f78ac871 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:15.451411 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8173dd81-62fb-4f5f-a65c-6754f78ac871 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: 9b9170ad-8804-4603-b35b-f7a3d2c4af62] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:15.512315 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8173dd81-62fb-4f5f-a65c-6754f78ac871 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:15.513341 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8173dd81-62fb-4f5f-a65c-6754f78ac871 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:15.517493 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8173dd81-62fb-4f5f-a65c-6754f78ac871 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:15.517493 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8173dd81-62fb-4f5f-a65c-6754f78ac871 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:15.517493 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8173dd81-62fb-4f5f-a65c-6754f78ac871 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:15.517493 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8173dd81-62fb-4f5f-a65c-6754f78ac871 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:15.700896 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a8b60620-ba03-4365-aa5a-e0e87fee688b tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db871eae8b444ac1bb654ee687c84c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd86cc078484761bca68f912acb3368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:15.727790 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a8b60620-ba03-4365-aa5a-e0e87fee688b tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db871eae8b444ac1bb654ee687c84c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd86cc078484761bca68f912acb3368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:15.735114 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a8b60620-ba03-4365-aa5a-e0e87fee688b tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db871eae8b444ac1bb654ee687c84c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd86cc078484761bca68f912acb3368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:15.736333 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a8b60620-ba03-4365-aa5a-e0e87fee688b tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] 10.222.0.61 "GET /compute/v2.1/servers/f1973c46-6ab5-4e0c-b188-9398faafa842" status: 200 len: 1359 microversion: 2.21 time: 0.562720 Aug 31 16:17:15.744772 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2271/4530] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:17:15 2022] GET /compute/v2.1/servers/f1973c46-6ab5-4e0c-b188-9398faafa842 => generated 1359 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:17:15.946425 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8173dd81-62fb-4f5f-a65c-6754f78ac871 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb261f2061164b49a8d496b16647dd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d2222a956a4888967e21647e26b310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:15.958800 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8173dd81-62fb-4f5f-a65c-6754f78ac871 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "GET /compute/v2.1/servers/9b9170ad-8804-4603-b35b-f7a3d2c4af62" status: 200 len: 1508 microversion: 2.1 time: 0.547641 Aug 31 16:17:15.959932 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2260/4531] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:15 2022] GET /compute/v2.1/servers/9b9170ad-8804-4603-b35b-f7a3d2c4af62 => generated 1508 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:15.982198 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-fecc8b03-2678-4270-a4a8-cdec47a90bab tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:15.983714 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-fecc8b03-2678-4270-a4a8-cdec47a90bab tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: 9b9170ad-8804-4603-b35b-f7a3d2c4af62] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:15.991804 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fecc8b03-2678-4270-a4a8-cdec47a90bab tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:15.992407 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fecc8b03-2678-4270-a4a8-cdec47a90bab tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:15.992949 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fecc8b03-2678-4270-a4a8-cdec47a90bab tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:15.993985 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fecc8b03-2678-4270-a4a8-cdec47a90bab tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:15.994616 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fecc8b03-2678-4270-a4a8-cdec47a90bab tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:15.996069 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fecc8b03-2678-4270-a4a8-cdec47a90bab tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:16.196663 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-fecc8b03-2678-4270-a4a8-cdec47a90bab tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb261f2061164b49a8d496b16647dd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d2222a956a4888967e21647e26b310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:16.210496 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-fecc8b03-2678-4270-a4a8-cdec47a90bab tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "GET /compute/v2.1/servers/9b9170ad-8804-4603-b35b-f7a3d2c4af62" status: 200 len: 1508 microversion: 2.1 time: 0.231976 Aug 31 16:17:16.211638 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2272/4532] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:15 2022] GET /compute/v2.1/servers/9b9170ad-8804-4603-b35b-f7a3d2c4af62 => generated 1508 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:16.240673 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-dacbe140-16f0-41a3-8cec-f7962838d6de tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:16.241846 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-dacbe140-16f0-41a3-8cec-f7962838d6de tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: 9b9170ad-8804-4603-b35b-f7a3d2c4af62] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:16.249678 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dacbe140-16f0-41a3-8cec-f7962838d6de tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:16.250518 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dacbe140-16f0-41a3-8cec-f7962838d6de tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:16.251159 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dacbe140-16f0-41a3-8cec-f7962838d6de tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:16.252117 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dacbe140-16f0-41a3-8cec-f7962838d6de tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:16.252844 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dacbe140-16f0-41a3-8cec-f7962838d6de tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:16.253473 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dacbe140-16f0-41a3-8cec-f7962838d6de tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:16.304098 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-dacbe140-16f0-41a3-8cec-f7962838d6de tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: 9b9170ad-8804-4603-b35b-f7a3d2c4af62] Going to try to terminate instance {{(pid=122256) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:17:16.501948 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-dacbe140-16f0-41a3-8cec-f7962838d6de tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "DELETE /compute/v2.1/servers/9b9170ad-8804-4603-b35b-f7a3d2c4af62" status: 204 len: 0 microversion: 2.1 time: 0.268274 Aug 31 16:17:16.502734 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2261/4533] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:17:16 2022] DELETE /compute/v2.1/servers/9b9170ad-8804-4603-b35b-f7a3d2c4af62 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:17:16.767359 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e9c8282c-2d7c-4dcf-bae4-ef846ce9bbba tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:16.768250 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e9c8282c-2d7c-4dcf-bae4-ef846ce9bbba tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] [instance: f1973c46-6ab5-4e0c-b188-9398faafa842] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:16.778810 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e9c8282c-2d7c-4dcf-bae4-ef846ce9bbba tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:16.779583 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e9c8282c-2d7c-4dcf-bae4-ef846ce9bbba tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:16.783419 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e9c8282c-2d7c-4dcf-bae4-ef846ce9bbba tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:16.784660 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e9c8282c-2d7c-4dcf-bae4-ef846ce9bbba tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:16.785382 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e9c8282c-2d7c-4dcf-bae4-ef846ce9bbba tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:16.786431 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a4ce4e47-7be0-42f7-937d-d04d0f6efb61 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1154670773", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "networks": [{"uuid": "3a4287aa-151a-44bc-986d-c22141911de9"}]}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:17:16.786899 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e9c8282c-2d7c-4dcf-bae4-ef846ce9bbba tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:16.970889 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-a4ce4e47-7be0-42f7-937d-d04d0f6efb61 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] validate_networks() for [('3a4287aa-151a-44bc-986d-c22141911de9', None, None, None, None, None)] {{(pid=122256) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:17:17.337984 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e9c8282c-2d7c-4dcf-bae4-ef846ce9bbba tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db871eae8b444ac1bb654ee687c84c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd86cc078484761bca68f912acb3368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:17.372131 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e9c8282c-2d7c-4dcf-bae4-ef846ce9bbba tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db871eae8b444ac1bb654ee687c84c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd86cc078484761bca68f912acb3368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:17.387971 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e9c8282c-2d7c-4dcf-bae4-ef846ce9bbba tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db871eae8b444ac1bb654ee687c84c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd86cc078484761bca68f912acb3368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:17.393497 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e9c8282c-2d7c-4dcf-bae4-ef846ce9bbba tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] 10.222.0.61 "GET /compute/v2.1/servers/f1973c46-6ab5-4e0c-b188-9398faafa842" status: 200 len: 1359 microversion: 2.21 time: 0.628643 Aug 31 16:17:17.395401 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2273/4534] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:17:16 2022] GET /compute/v2.1/servers/f1973c46-6ab5-4e0c-b188-9398faafa842 => generated 1359 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:17:17.410507 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-7d55a9b0-cb30-48c3-8220-d472419bc3ae req-1a5c440b-620c-4308-b983-3776b2d80aec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1973c46-6ab5-4e0c-b188-9398faafa842", "name": "network-vif-plugged", "status": "completed", "tag": "ee5f5354-7806-4239-bc32-168c5f8d7892"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:17:17.458151 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-7d55a9b0-cb30-48c3-8220-d472419bc3ae req-1a5c440b-620c-4308-b983-3776b2d80aec service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:17.458950 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-7d55a9b0-cb30-48c3-8220-d472419bc3ae req-1a5c440b-620c-4308-b983-3776b2d80aec service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:17.459856 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-7d55a9b0-cb30-48c3-8220-d472419bc3ae req-1a5c440b-620c-4308-b983-3776b2d80aec service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:17.491637 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-7d55a9b0-cb30-48c3-8220-d472419bc3ae req-1a5c440b-620c-4308-b983-3776b2d80aec service nova] Creating event network-vif-plugged:ee5f5354-7806-4239-bc32-168c5f8d7892 for instance f1973c46-6ab5-4e0c-b188-9398faafa842 on n-h2-850499-9 Aug 31 16:17:17.520816 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-7d55a9b0-cb30-48c3-8220-d472419bc3ae req-1a5c440b-620c-4308-b983-3776b2d80aec service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121696 Aug 31 16:17:17.522876 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2274/4535] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:17:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:17:18.419606 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d88629eb-3b0d-41c4-b844-3eccb9729af6 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:18.421478 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d88629eb-3b0d-41c4-b844-3eccb9729af6 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] [instance: f1973c46-6ab5-4e0c-b188-9398faafa842] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:18.439760 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d88629eb-3b0d-41c4-b844-3eccb9729af6 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:18.440684 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d88629eb-3b0d-41c4-b844-3eccb9729af6 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:18.441650 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d88629eb-3b0d-41c4-b844-3eccb9729af6 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:18.442593 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d88629eb-3b0d-41c4-b844-3eccb9729af6 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:18.443288 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d88629eb-3b0d-41c4-b844-3eccb9729af6 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:18.443911 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d88629eb-3b0d-41c4-b844-3eccb9729af6 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:18.752850 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-a4ce4e47-7be0-42f7-937d-d04d0f6efb61 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:17:18.753538 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-a4ce4e47-7be0-42f7-937d-d04d0f6efb61 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:17:18.756047 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-a4ce4e47-7be0-42f7-937d-d04d0f6efb61 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:17:18.756970 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-a4ce4e47-7be0-42f7-937d-d04d0f6efb61 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:17:18.757948 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-a4ce4e47-7be0-42f7-937d-d04d0f6efb61 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:17:18.787467 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a4ce4e47-7be0-42f7-937d-d04d0f6efb61 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:18.788300 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a4ce4e47-7be0-42f7-937d-d04d0f6efb61 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:18.788965 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a4ce4e47-7be0-42f7-937d-d04d0f6efb61 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:18.790127 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a4ce4e47-7be0-42f7-937d-d04d0f6efb61 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:18.790772 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a4ce4e47-7be0-42f7-937d-d04d0f6efb61 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:18.791710 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a4ce4e47-7be0-42f7-937d-d04d0f6efb61 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:18.821733 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-a4ce4e47-7be0-42f7-937d-d04d0f6efb61 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Getting quotas for project 62d2222a956a4888967e21647e26b310. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:17:18.836849 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-a4ce4e47-7be0-42f7-937d-d04d0f6efb61 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Getting quotas for user fb261f2061164b49a8d496b16647dd2c and project 62d2222a956a4888967e21647e26b310. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:17:18.870804 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a4ce4e47-7be0-42f7-937d-d04d0f6efb61 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Going to run 1 instances... {{(pid=122256) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:17:18.876561 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a4ce4e47-7be0-42f7-937d-d04d0f6efb61 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: 265869f7-4238-4886-9dac-e22be12e3bc8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:17:19.031459 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a4ce4e47-7be0-42f7-937d-d04d0f6efb61 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.249008 Aug 31 16:17:19.036752 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2262/4536] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:17:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 2255 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:17:19.059762 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-56799b40-2f45-4348-a6f6-95ad8eaf18db tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:19.062241 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-56799b40-2f45-4348-a6f6-95ad8eaf18db tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: 265869f7-4238-4886-9dac-e22be12e3bc8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:19.096039 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d88629eb-3b0d-41c4-b844-3eccb9729af6 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db871eae8b444ac1bb654ee687c84c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd86cc078484761bca68f912acb3368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:19.136833 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d88629eb-3b0d-41c4-b844-3eccb9729af6 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db871eae8b444ac1bb654ee687c84c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd86cc078484761bca68f912acb3368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:19.143422 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d88629eb-3b0d-41c4-b844-3eccb9729af6 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db871eae8b444ac1bb654ee687c84c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd86cc078484761bca68f912acb3368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:19.148734 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d88629eb-3b0d-41c4-b844-3eccb9729af6 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] 10.222.0.61 "GET /compute/v2.1/servers/f1973c46-6ab5-4e0c-b188-9398faafa842" status: 200 len: 1359 microversion: 2.21 time: 0.734569 Aug 31 16:17:19.164996 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2275/4537] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:17:18 2022] GET /compute/v2.1/servers/f1973c46-6ab5-4e0c-b188-9398faafa842 => generated 1359 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:17:19.249404 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-56799b40-2f45-4348-a6f6-95ad8eaf18db tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb261f2061164b49a8d496b16647dd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d2222a956a4888967e21647e26b310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:19.272971 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-56799b40-2f45-4348-a6f6-95ad8eaf18db tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "GET /compute/v2.1/servers/265869f7-4238-4886-9dac-e22be12e3bc8" status: 200 len: 1218 microversion: 2.1 time: 0.227111 Aug 31 16:17:19.284693 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2263/4538] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:19 2022] GET /compute/v2.1/servers/265869f7-4238-4886-9dac-e22be12e3bc8 => generated 1218 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:19.707828 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8b758111-e8e9-4b4a-af34-93756243147a tempest-ExtensionsTest-389330890 tempest-ExtensionsTest-389330890-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:19.710314 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8b758111-e8e9-4b4a-af34-93756243147a tempest-ExtensionsTest-389330890 tempest-ExtensionsTest-389330890-project] 10.222.0.61 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.544222 Aug 31 16:17:19.711235 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2276/4539] 10.222.0.61 () {58 vars in 1170 bytes} [Wed Aug 31 16:17:19 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:17:19.737353 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-4e1bbd07-63b7-49d6-8f65-04fc5d945c6c req-e0d33e85-3ea6-4573-916d-c1463e99613c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b9170ad-8804-4603-b35b-f7a3d2c4af62", "name": "network-vif-deleted", "tag": "36e7a186-ebb0-4a76-af6a-cd120bd63d63"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:17:19.781649 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-4e1bbd07-63b7-49d6-8f65-04fc5d945c6c req-e0d33e85-3ea6-4573-916d-c1463e99613c service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:19.793011 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-4e1bbd07-63b7-49d6-8f65-04fc5d945c6c req-e0d33e85-3ea6-4573-916d-c1463e99613c service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:19.793011 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-4e1bbd07-63b7-49d6-8f65-04fc5d945c6c req-e0d33e85-3ea6-4573-916d-c1463e99613c service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:19.839632 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-4e1bbd07-63b7-49d6-8f65-04fc5d945c6c req-e0d33e85-3ea6-4573-916d-c1463e99613c service nova] Creating event network-vif-deleted:36e7a186-ebb0-4a76-af6a-cd120bd63d63 for instance 9b9170ad-8804-4603-b35b-f7a3d2c4af62 on n-h1-850499-9 Aug 31 16:17:19.861150 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-4e1bbd07-63b7-49d6-8f65-04fc5d945c6c req-e0d33e85-3ea6-4573-916d-c1463e99613c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139958 Aug 31 16:17:19.862295 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2277/4540] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:17:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:17:19.874966 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3bed837d-d810-4506-9095-fea173627661 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-1072263652", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "networks": "none"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:17:19.877209 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-28569883-d59e-4eec-b737-182d729f8ef4 tempest-ExtensionsTest-389330890 tempest-ExtensionsTest-389330890-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:19.885863 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-28569883-d59e-4eec-b737-182d729f8ef4 tempest-ExtensionsTest-389330890 tempest-ExtensionsTest-389330890-project] 10.222.0.61 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.022066 Aug 31 16:17:19.886849 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2278/4541] 10.222.0.61 () {58 vars in 1134 bytes} [Wed Aug 31 16:17:19 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 16:17:20.098009 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-3bed837d-d810-4506-9095-fea173627661 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:17:20.098448 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-3bed837d-d810-4506-9095-fea173627661 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:17:20.099414 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-3bed837d-d810-4506-9095-fea173627661 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:17:20.099865 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-3bed837d-d810-4506-9095-fea173627661 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:17:20.100284 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-3bed837d-d810-4506-9095-fea173627661 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:17:20.143959 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3bed837d-d810-4506-9095-fea173627661 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:20.161456 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3bed837d-d810-4506-9095-fea173627661 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:20.162282 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3bed837d-d810-4506-9095-fea173627661 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:20.169151 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3bed837d-d810-4506-9095-fea173627661 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:20.170026 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3bed837d-d810-4506-9095-fea173627661 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:20.173327 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3bed837d-d810-4506-9095-fea173627661 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:20.200836 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e2d172bc-462c-46e6-90fc-227d64a325aa tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:20.203643 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e2d172bc-462c-46e6-90fc-227d64a325aa tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] [instance: f1973c46-6ab5-4e0c-b188-9398faafa842] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:20.234772 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e2d172bc-462c-46e6-90fc-227d64a325aa tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:20.242674 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e2d172bc-462c-46e6-90fc-227d64a325aa tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:20.250827 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e2d172bc-462c-46e6-90fc-227d64a325aa tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:20.261931 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e2d172bc-462c-46e6-90fc-227d64a325aa tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:20.263156 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e2d172bc-462c-46e6-90fc-227d64a325aa tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:20.267314 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e2d172bc-462c-46e6-90fc-227d64a325aa tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:20.315239 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-3bed837d-d810-4506-9095-fea173627661 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Getting quotas for project 9d7ab6f24815407880276db1a6d76d27. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:17:20.344642 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-3bed837d-d810-4506-9095-fea173627661 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Getting quotas for user 07ab61302b87448b84838a1be274b445 and project 9d7ab6f24815407880276db1a6d76d27. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:17:20.419516 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3bed837d-d810-4506-9095-fea173627661 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Going to run 1 instances... {{(pid=122256) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:17:20.422932 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3bed837d-d810-4506-9095-fea173627661 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] [instance: d2d88bec-63be-4b0c-8497-e34d1bbb790f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:17:20.694266 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3bed837d-d810-4506-9095-fea173627661 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 1.272120 Aug 31 16:17:20.700868 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2264/4542] 10.222.0.61 () {62 vars in 1188 bytes} [Wed Aug 31 16:17:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1279 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 31 16:17:20.736059 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3eb8ab80-3e92-44c9-bbcf-49976ae86d5f tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:20.736953 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3eb8ab80-3e92-44c9-bbcf-49976ae86d5f tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: 265869f7-4238-4886-9dac-e22be12e3bc8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:20.745697 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3eb8ab80-3e92-44c9-bbcf-49976ae86d5f tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:20.746655 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3eb8ab80-3e92-44c9-bbcf-49976ae86d5f tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:20.747374 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3eb8ab80-3e92-44c9-bbcf-49976ae86d5f tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:20.749038 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3eb8ab80-3e92-44c9-bbcf-49976ae86d5f tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:20.749896 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3eb8ab80-3e92-44c9-bbcf-49976ae86d5f tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:20.750491 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3eb8ab80-3e92-44c9-bbcf-49976ae86d5f tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:21.241205 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3eb8ab80-3e92-44c9-bbcf-49976ae86d5f tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb261f2061164b49a8d496b16647dd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d2222a956a4888967e21647e26b310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:21.274950 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3eb8ab80-3e92-44c9-bbcf-49976ae86d5f tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "GET /compute/v2.1/servers/265869f7-4238-4886-9dac-e22be12e3bc8" status: 200 len: 1222 microversion: 2.1 time: 0.566097 Aug 31 16:17:21.280090 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2265/4543] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:20 2022] GET /compute/v2.1/servers/265869f7-4238-4886-9dac-e22be12e3bc8 => generated 1222 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:21.301333 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f81a2b79-6f91-46cd-bb33-cb0e4449e899 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:21.305400 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f81a2b79-6f91-46cd-bb33-cb0e4449e899 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] [instance: d2d88bec-63be-4b0c-8497-e34d1bbb790f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:21.631427 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f81a2b79-6f91-46cd-bb33-cb0e4449e899 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07ab61302b87448b84838a1be274b445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7ab6f24815407880276db1a6d76d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:21.641138 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f81a2b79-6f91-46cd-bb33-cb0e4449e899 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07ab61302b87448b84838a1be274b445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7ab6f24815407880276db1a6d76d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:21.643709 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f81a2b79-6f91-46cd-bb33-cb0e4449e899 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07ab61302b87448b84838a1be274b445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7ab6f24815407880276db1a6d76d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:21.653842 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f81a2b79-6f91-46cd-bb33-cb0e4449e899 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] 10.222.0.61 "GET /compute/v2.1/servers/d2d88bec-63be-4b0c-8497-e34d1bbb790f" status: 200 len: 1278 microversion: 2.54 time: 0.371201 Aug 31 16:17:21.662188 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2266/4544] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:17:21 2022] GET /compute/v2.1/servers/d2d88bec-63be-4b0c-8497-e34d1bbb790f => generated 1278 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:17:21.850294 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e2d172bc-462c-46e6-90fc-227d64a325aa tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db871eae8b444ac1bb654ee687c84c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd86cc078484761bca68f912acb3368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:21.862787 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e2d172bc-462c-46e6-90fc-227d64a325aa tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db871eae8b444ac1bb654ee687c84c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd86cc078484761bca68f912acb3368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:21.865942 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e2d172bc-462c-46e6-90fc-227d64a325aa tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db871eae8b444ac1bb654ee687c84c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd86cc078484761bca68f912acb3368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:21.873376 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e2d172bc-462c-46e6-90fc-227d64a325aa tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] 10.222.0.61 "GET /compute/v2.1/servers/f1973c46-6ab5-4e0c-b188-9398faafa842" status: 200 len: 1359 microversion: 2.21 time: 1.678846 Aug 31 16:17:21.876394 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2279/4545] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:17:20 2022] GET /compute/v2.1/servers/f1973c46-6ab5-4e0c-b188-9398faafa842 => generated 1359 bytes in 1683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:17:22.304912 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-95420764-211c-433b-892b-211a27c59627 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:22.306359 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-95420764-211c-433b-892b-211a27c59627 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: 265869f7-4238-4886-9dac-e22be12e3bc8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:22.327586 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-95420764-211c-433b-892b-211a27c59627 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:22.333377 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-95420764-211c-433b-892b-211a27c59627 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:22.339832 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-95420764-211c-433b-892b-211a27c59627 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:22.341298 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-95420764-211c-433b-892b-211a27c59627 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:22.345597 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-95420764-211c-433b-892b-211a27c59627 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:22.346439 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-95420764-211c-433b-892b-211a27c59627 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:22.690895 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5178691f-1755-4573-ad59-6c82a7cc24dd tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:22.692136 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5178691f-1755-4573-ad59-6c82a7cc24dd tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] [instance: d2d88bec-63be-4b0c-8497-e34d1bbb790f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:22.705318 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5178691f-1755-4573-ad59-6c82a7cc24dd tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:22.706529 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5178691f-1755-4573-ad59-6c82a7cc24dd tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:22.707405 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5178691f-1755-4573-ad59-6c82a7cc24dd tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:22.708484 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5178691f-1755-4573-ad59-6c82a7cc24dd tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:22.709495 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5178691f-1755-4573-ad59-6c82a7cc24dd tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:22.710684 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5178691f-1755-4573-ad59-6c82a7cc24dd tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:22.850851 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-95420764-211c-433b-892b-211a27c59627 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb261f2061164b49a8d496b16647dd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d2222a956a4888967e21647e26b310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:22.860746 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-95420764-211c-433b-892b-211a27c59627 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "GET /compute/v2.1/servers/265869f7-4238-4886-9dac-e22be12e3bc8" status: 200 len: 1276 microversion: 2.1 time: 0.560001 Aug 31 16:17:22.871630 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2267/4546] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:22 2022] GET /compute/v2.1/servers/265869f7-4238-4886-9dac-e22be12e3bc8 => generated 1276 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:22.917392 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1d53838a-84bc-4543-bacf-cea16f7aa482 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:22.918917 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1d53838a-84bc-4543-bacf-cea16f7aa482 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] [instance: f1973c46-6ab5-4e0c-b188-9398faafa842] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:22.931841 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1d53838a-84bc-4543-bacf-cea16f7aa482 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:22.932363 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1d53838a-84bc-4543-bacf-cea16f7aa482 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:22.932821 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1d53838a-84bc-4543-bacf-cea16f7aa482 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:22.933560 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1d53838a-84bc-4543-bacf-cea16f7aa482 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:22.942757 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5178691f-1755-4573-ad59-6c82a7cc24dd tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07ab61302b87448b84838a1be274b445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7ab6f24815407880276db1a6d76d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:22.956516 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1d53838a-84bc-4543-bacf-cea16f7aa482 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:22.957092 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1d53838a-84bc-4543-bacf-cea16f7aa482 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:22.962322 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5178691f-1755-4573-ad59-6c82a7cc24dd tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07ab61302b87448b84838a1be274b445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7ab6f24815407880276db1a6d76d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:22.965398 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5178691f-1755-4573-ad59-6c82a7cc24dd tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07ab61302b87448b84838a1be274b445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7ab6f24815407880276db1a6d76d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:22.973637 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5178691f-1755-4573-ad59-6c82a7cc24dd tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] 10.222.0.61 "GET /compute/v2.1/servers/d2d88bec-63be-4b0c-8497-e34d1bbb790f" status: 200 len: 1330 microversion: 2.54 time: 0.281105 Aug 31 16:17:22.976821 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2280/4547] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:17:22 2022] GET /compute/v2.1/servers/d2d88bec-63be-4b0c-8497-e34d1bbb790f => generated 1330 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:17:23.422112 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1d53838a-84bc-4543-bacf-cea16f7aa482 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db871eae8b444ac1bb654ee687c84c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd86cc078484761bca68f912acb3368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:23.441420 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1d53838a-84bc-4543-bacf-cea16f7aa482 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db871eae8b444ac1bb654ee687c84c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd86cc078484761bca68f912acb3368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:23.464708 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1d53838a-84bc-4543-bacf-cea16f7aa482 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db871eae8b444ac1bb654ee687c84c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd86cc078484761bca68f912acb3368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:23.466557 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1d53838a-84bc-4543-bacf-cea16f7aa482 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] 10.222.0.61 "GET /compute/v2.1/servers/f1973c46-6ab5-4e0c-b188-9398faafa842" status: 200 len: 1551 microversion: 2.21 time: 0.552881 Aug 31 16:17:23.495150 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2268/4548] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:17:22 2022] GET /compute/v2.1/servers/f1973c46-6ab5-4e0c-b188-9398faafa842 => generated 1551 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:17:23.506983 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2c1f9344-5de5-45ae-a52e-27da32fc741c tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:23.507522 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2c1f9344-5de5-45ae-a52e-27da32fc741c tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] [instance: f1973c46-6ab5-4e0c-b188-9398faafa842] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:23.523309 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2c1f9344-5de5-45ae-a52e-27da32fc741c tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:23.525654 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2c1f9344-5de5-45ae-a52e-27da32fc741c tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:23.526283 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2c1f9344-5de5-45ae-a52e-27da32fc741c tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:23.530328 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2c1f9344-5de5-45ae-a52e-27da32fc741c tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:23.532770 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2c1f9344-5de5-45ae-a52e-27da32fc741c tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:23.533390 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2c1f9344-5de5-45ae-a52e-27da32fc741c tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:23.637799 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2c1f9344-5de5-45ae-a52e-27da32fc741c tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] [instance: f1973c46-6ab5-4e0c-b188-9398faafa842] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:17:23.909850 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ad4ba102-b0c8-4735-af3d-153ac679afa8 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:23.910553 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ad4ba102-b0c8-4735-af3d-153ac679afa8 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: 265869f7-4238-4886-9dac-e22be12e3bc8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:23.917068 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2c1f9344-5de5-45ae-a52e-27da32fc741c tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] 10.222.0.61 "DELETE /compute/v2.1/servers/f1973c46-6ab5-4e0c-b188-9398faafa842" status: 204 len: 0 microversion: 2.21 time: 0.413100 Aug 31 16:17:23.923340 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2281/4549] 10.222.0.61 () {60 vars in 1280 bytes} [Wed Aug 31 16:17:23 2022] DELETE /compute/v2.1/servers/f1973c46-6ab5-4e0c-b188-9398faafa842 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 16:17:23.940467 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ad4ba102-b0c8-4735-af3d-153ac679afa8 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:23.942952 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ad4ba102-b0c8-4735-af3d-153ac679afa8 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:23.945196 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-af7c435c-023c-4973-9dd2-49128b2b6dcc tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:23.946831 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ad4ba102-b0c8-4735-af3d-153ac679afa8 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:23.948344 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ad4ba102-b0c8-4735-af3d-153ac679afa8 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:23.951853 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ad4ba102-b0c8-4735-af3d-153ac679afa8 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:23.953141 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ad4ba102-b0c8-4735-af3d-153ac679afa8 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:23.953761 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-af7c435c-023c-4973-9dd2-49128b2b6dcc tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] [instance: f1973c46-6ab5-4e0c-b188-9398faafa842] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:23.984345 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-af7c435c-023c-4973-9dd2-49128b2b6dcc tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:23.986383 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-af7c435c-023c-4973-9dd2-49128b2b6dcc tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:23.988313 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-af7c435c-023c-4973-9dd2-49128b2b6dcc tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:23.989786 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-af7c435c-023c-4973-9dd2-49128b2b6dcc tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:23.991889 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-af7c435c-023c-4973-9dd2-49128b2b6dcc tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:23.993960 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-af7c435c-023c-4973-9dd2-49128b2b6dcc tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:24.728284 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-af7c435c-023c-4973-9dd2-49128b2b6dcc tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db871eae8b444ac1bb654ee687c84c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd86cc078484761bca68f912acb3368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:24.744011 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-af7c435c-023c-4973-9dd2-49128b2b6dcc tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db871eae8b444ac1bb654ee687c84c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd86cc078484761bca68f912acb3368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:24.746327 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-af7c435c-023c-4973-9dd2-49128b2b6dcc tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db871eae8b444ac1bb654ee687c84c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd86cc078484761bca68f912acb3368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:24.750216 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ad4ba102-b0c8-4735-af3d-153ac679afa8 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb261f2061164b49a8d496b16647dd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d2222a956a4888967e21647e26b310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:24.765147 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ad4ba102-b0c8-4735-af3d-153ac679afa8 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "GET /compute/v2.1/servers/265869f7-4238-4886-9dac-e22be12e3bc8" status: 200 len: 1318 microversion: 2.1 time: 0.867665 Aug 31 16:17:24.766508 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-af7c435c-023c-4973-9dd2-49128b2b6dcc tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] 10.222.0.61 "GET /compute/v2.1/servers/f1973c46-6ab5-4e0c-b188-9398faafa842" status: 200 len: 1557 microversion: 2.21 time: 0.834362 Aug 31 16:17:24.769406 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2269/4550] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:23 2022] GET /compute/v2.1/servers/265869f7-4238-4886-9dac-e22be12e3bc8 => generated 1318 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:24.795969 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2282/4551] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:17:23 2022] GET /compute/v2.1/servers/f1973c46-6ab5-4e0c-b188-9398faafa842 => generated 1557 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:17:24.809011 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c58e0b33-4962-472d-a5a0-f831f559170a tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:24.820864 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c58e0b33-4962-472d-a5a0-f831f559170a tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] [instance: d2d88bec-63be-4b0c-8497-e34d1bbb790f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:24.854790 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c58e0b33-4962-472d-a5a0-f831f559170a tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:24.855709 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c58e0b33-4962-472d-a5a0-f831f559170a tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:24.856501 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c58e0b33-4962-472d-a5a0-f831f559170a tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:24.860997 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c58e0b33-4962-472d-a5a0-f831f559170a tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:24.861858 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c58e0b33-4962-472d-a5a0-f831f559170a tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:24.862647 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c58e0b33-4962-472d-a5a0-f831f559170a tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:25.565547 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c58e0b33-4962-472d-a5a0-f831f559170a tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07ab61302b87448b84838a1be274b445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7ab6f24815407880276db1a6d76d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:25.585452 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c58e0b33-4962-472d-a5a0-f831f559170a tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07ab61302b87448b84838a1be274b445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7ab6f24815407880276db1a6d76d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:25.593352 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c58e0b33-4962-472d-a5a0-f831f559170a tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07ab61302b87448b84838a1be274b445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7ab6f24815407880276db1a6d76d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:25.598663 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c58e0b33-4962-472d-a5a0-f831f559170a tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] 10.222.0.61 "GET /compute/v2.1/servers/d2d88bec-63be-4b0c-8497-e34d1bbb790f" status: 200 len: 1336 microversion: 2.54 time: 0.827570 Aug 31 16:17:25.618360 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2270/4552] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:17:24 2022] GET /compute/v2.1/servers/d2d88bec-63be-4b0c-8497-e34d1bbb790f => generated 1336 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:17:25.814555 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-440c2a9b-5375-46da-80a7-1c49c28818a2 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:25.815849 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-440c2a9b-5375-46da-80a7-1c49c28818a2 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: 265869f7-4238-4886-9dac-e22be12e3bc8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:25.816109 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-aef6ed08-b9af-491f-a340-9774488c8737 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:25.818079 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-aef6ed08-b9af-491f-a340-9774488c8737 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] [instance: f1973c46-6ab5-4e0c-b188-9398faafa842] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:25.846706 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aef6ed08-b9af-491f-a340-9774488c8737 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:25.850255 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aef6ed08-b9af-491f-a340-9774488c8737 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:25.851406 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-440c2a9b-5375-46da-80a7-1c49c28818a2 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:25.852255 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-440c2a9b-5375-46da-80a7-1c49c28818a2 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:25.852977 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aef6ed08-b9af-491f-a340-9774488c8737 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:25.856136 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aef6ed08-b9af-491f-a340-9774488c8737 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:25.856387 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-440c2a9b-5375-46da-80a7-1c49c28818a2 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:25.857491 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-440c2a9b-5375-46da-80a7-1c49c28818a2 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:25.866209 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aef6ed08-b9af-491f-a340-9774488c8737 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:25.867144 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aef6ed08-b9af-491f-a340-9774488c8737 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:25.867637 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-440c2a9b-5375-46da-80a7-1c49c28818a2 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:25.869189 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-440c2a9b-5375-46da-80a7-1c49c28818a2 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:27.004413 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-aef6ed08-b9af-491f-a340-9774488c8737 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db871eae8b444ac1bb654ee687c84c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd86cc078484761bca68f912acb3368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:27.058689 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-aef6ed08-b9af-491f-a340-9774488c8737 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db871eae8b444ac1bb654ee687c84c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd86cc078484761bca68f912acb3368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:27.065772 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-aef6ed08-b9af-491f-a340-9774488c8737 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db871eae8b444ac1bb654ee687c84c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd86cc078484761bca68f912acb3368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:27.071605 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-aef6ed08-b9af-491f-a340-9774488c8737 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] 10.222.0.61 "GET /compute/v2.1/servers/f1973c46-6ab5-4e0c-b188-9398faafa842" status: 200 len: 1557 microversion: 2.21 time: 1.264887 Aug 31 16:17:27.114055 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2271/4553] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:17:25 2022] GET /compute/v2.1/servers/f1973c46-6ab5-4e0c-b188-9398faafa842 => generated 1557 bytes in 1308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:17:27.115707 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-aef6ed08-b9af-491f-a340-9774488c8737 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:27.133006 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-aef6ed08-b9af-491f-a340-9774488c8737 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] 10.222.0.61 "GET /compute//" status: 200 len: 377 microversion: - time: 0.008009 Aug 31 16:17:27.148140 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2272/4554] 10.222.0.61 () {56 vars in 886 bytes} [Wed Aug 31 16:17:27 2022] GET /compute/ => generated 377 bytes in 32 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 31 16:17:27.158111 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8f01d678-d2c5-4d93-adf4-dc3afda71e74 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:27.160366 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8f01d678-d2c5-4d93-adf4-dc3afda71e74 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] [instance: d2d88bec-63be-4b0c-8497-e34d1bbb790f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:27.178193 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8f01d678-d2c5-4d93-adf4-dc3afda71e74 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:27.179826 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8f01d678-d2c5-4d93-adf4-dc3afda71e74 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:27.180982 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8f01d678-d2c5-4d93-adf4-dc3afda71e74 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:27.182464 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8f01d678-d2c5-4d93-adf4-dc3afda71e74 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:27.183476 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8f01d678-d2c5-4d93-adf4-dc3afda71e74 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:27.184433 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8f01d678-d2c5-4d93-adf4-dc3afda71e74 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:27.211102 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-440c2a9b-5375-46da-80a7-1c49c28818a2 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb261f2061164b49a8d496b16647dd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d2222a956a4888967e21647e26b310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:27.220333 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-440c2a9b-5375-46da-80a7-1c49c28818a2 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "GET /compute/v2.1/servers/265869f7-4238-4886-9dac-e22be12e3bc8" status: 200 len: 1318 microversion: 2.1 time: 1.416819 Aug 31 16:17:27.220952 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2283/4555] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:25 2022] GET /compute/v2.1/servers/265869f7-4238-4886-9dac-e22be12e3bc8 => generated 1318 bytes in 1418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:27.222158 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-440c2a9b-5375-46da-80a7-1c49c28818a2 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:27.223222 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-440c2a9b-5375-46da-80a7-1c49c28818a2 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.001417 Aug 31 16:17:27.240601 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2284/4556] 10.222.0.61 () {54 vars in 1035 bytes} [Wed Aug 31 16:17:27 2022] GET /compute/v2/ => generated 379 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Aug 31 16:17:27.264828 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-440c2a9b-5375-46da-80a7-1c49c28818a2 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:27.266221 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-440c2a9b-5375-46da-80a7-1c49c28818a2 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.004330 Aug 31 16:17:27.287943 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2285/4557] 10.222.0.61 () {54 vars in 1041 bytes} [Wed Aug 31 16:17:27 2022] GET /compute/v2.1/ => generated 388 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:17:27.289751 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-440c2a9b-5375-46da-80a7-1c49c28818a2 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:27.290777 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-440c2a9b-5375-46da-80a7-1c49c28818a2 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001649 Aug 31 16:17:27.305795 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2286/4558] 10.222.0.61 () {56 vars in 886 bytes} [Wed Aug 31 16:17:27 2022] GET /compute/ => generated 377 bytes in 17 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 31 16:17:27.570424 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8f01d678-d2c5-4d93-adf4-dc3afda71e74 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07ab61302b87448b84838a1be274b445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7ab6f24815407880276db1a6d76d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:27.603993 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8f01d678-d2c5-4d93-adf4-dc3afda71e74 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07ab61302b87448b84838a1be274b445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7ab6f24815407880276db1a6d76d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:27.607421 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8f01d678-d2c5-4d93-adf4-dc3afda71e74 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07ab61302b87448b84838a1be274b445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7ab6f24815407880276db1a6d76d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:27.610379 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8f01d678-d2c5-4d93-adf4-dc3afda71e74 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] 10.222.0.61 "GET /compute/v2.1/servers/d2d88bec-63be-4b0c-8497-e34d1bbb790f" status: 200 len: 1336 microversion: 2.54 time: 0.460151 Aug 31 16:17:27.611888 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2273/4559] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:17:27 2022] GET /compute/v2.1/servers/d2d88bec-63be-4b0c-8497-e34d1bbb790f => generated 1336 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:17:28.105884 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0294df6e-6f3a-46de-b14e-2ef2ed401311 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:28.106604 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0294df6e-6f3a-46de-b14e-2ef2ed401311 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] [instance: f1973c46-6ab5-4e0c-b188-9398faafa842] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:28.116636 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0294df6e-6f3a-46de-b14e-2ef2ed401311 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:28.124106 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0294df6e-6f3a-46de-b14e-2ef2ed401311 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:28.124918 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0294df6e-6f3a-46de-b14e-2ef2ed401311 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:28.145403 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0294df6e-6f3a-46de-b14e-2ef2ed401311 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:28.146891 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0294df6e-6f3a-46de-b14e-2ef2ed401311 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:28.149409 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0294df6e-6f3a-46de-b14e-2ef2ed401311 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:28.246880 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-101ed375-3582-4ed9-82e4-fa03d6ce05c0 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:28.248763 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-101ed375-3582-4ed9-82e4-fa03d6ce05c0 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: 265869f7-4238-4886-9dac-e22be12e3bc8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:28.284655 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-101ed375-3582-4ed9-82e4-fa03d6ce05c0 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:28.286449 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-101ed375-3582-4ed9-82e4-fa03d6ce05c0 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:28.288576 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-101ed375-3582-4ed9-82e4-fa03d6ce05c0 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:28.293194 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-101ed375-3582-4ed9-82e4-fa03d6ce05c0 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:28.300243 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-101ed375-3582-4ed9-82e4-fa03d6ce05c0 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:28.304586 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-101ed375-3582-4ed9-82e4-fa03d6ce05c0 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:28.979899 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0294df6e-6f3a-46de-b14e-2ef2ed401311 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db871eae8b444ac1bb654ee687c84c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd86cc078484761bca68f912acb3368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:29.048712 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-101ed375-3582-4ed9-82e4-fa03d6ce05c0 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb261f2061164b49a8d496b16647dd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d2222a956a4888967e21647e26b310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:29.057828 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-101ed375-3582-4ed9-82e4-fa03d6ce05c0 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "GET /compute/v2.1/servers/265869f7-4238-4886-9dac-e22be12e3bc8" status: 200 len: 1318 microversion: 2.1 time: 0.815248 Aug 31 16:17:29.063246 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0294df6e-6f3a-46de-b14e-2ef2ed401311 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db871eae8b444ac1bb654ee687c84c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd86cc078484761bca68f912acb3368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:29.064264 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2274/4560] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:28 2022] GET /compute/v2.1/servers/265869f7-4238-4886-9dac-e22be12e3bc8 => generated 1318 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:17:29.072649 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-42acbadf-8de2-421e-b99a-0005ec5e9332 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:29.076395 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-42acbadf-8de2-421e-b99a-0005ec5e9332 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] [instance: d2d88bec-63be-4b0c-8497-e34d1bbb790f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:29.079923 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0294df6e-6f3a-46de-b14e-2ef2ed401311 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db871eae8b444ac1bb654ee687c84c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd86cc078484761bca68f912acb3368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:29.081311 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0294df6e-6f3a-46de-b14e-2ef2ed401311 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] 10.222.0.61 "GET /compute/v2.1/servers/f1973c46-6ab5-4e0c-b188-9398faafa842" status: 200 len: 1557 microversion: 2.21 time: 0.979811 Aug 31 16:17:29.086425 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2287/4561] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:17:28 2022] GET /compute/v2.1/servers/f1973c46-6ab5-4e0c-b188-9398faafa842 => generated 1557 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:17:29.115867 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42acbadf-8de2-421e-b99a-0005ec5e9332 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:29.116865 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42acbadf-8de2-421e-b99a-0005ec5e9332 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:29.121282 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42acbadf-8de2-421e-b99a-0005ec5e9332 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:29.123443 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42acbadf-8de2-421e-b99a-0005ec5e9332 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:29.127720 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42acbadf-8de2-421e-b99a-0005ec5e9332 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:29.131942 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42acbadf-8de2-421e-b99a-0005ec5e9332 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:29.278023 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-b7774999-0dd2-4336-bbfc-fe62ff3c4b3d req-3321531f-6060-4de3-9ce6-61c98f577e0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1973c46-6ab5-4e0c-b188-9398faafa842", "name": "network-vif-deleted", "tag": "ee5f5354-7806-4239-bc32-168c5f8d7892"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:17:29.314425 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-b7774999-0dd2-4336-bbfc-fe62ff3c4b3d req-3321531f-6060-4de3-9ce6-61c98f577e0c service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:29.329921 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-b7774999-0dd2-4336-bbfc-fe62ff3c4b3d req-3321531f-6060-4de3-9ce6-61c98f577e0c service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:29.331824 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-b7774999-0dd2-4336-bbfc-fe62ff3c4b3d req-3321531f-6060-4de3-9ce6-61c98f577e0c service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:29.384251 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-b7774999-0dd2-4336-bbfc-fe62ff3c4b3d req-3321531f-6060-4de3-9ce6-61c98f577e0c service nova] Creating event network-vif-deleted:ee5f5354-7806-4239-bc32-168c5f8d7892 for instance f1973c46-6ab5-4e0c-b188-9398faafa842 on n-h2-850499-9 Aug 31 16:17:29.407580 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-b7774999-0dd2-4336-bbfc-fe62ff3c4b3d req-3321531f-6060-4de3-9ce6-61c98f577e0c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136878 Aug 31 16:17:29.411118 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2288/4562] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:17:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:17:29.622308 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-42acbadf-8de2-421e-b99a-0005ec5e9332 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07ab61302b87448b84838a1be274b445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7ab6f24815407880276db1a6d76d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:29.655953 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-42acbadf-8de2-421e-b99a-0005ec5e9332 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07ab61302b87448b84838a1be274b445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7ab6f24815407880276db1a6d76d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:29.664544 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-42acbadf-8de2-421e-b99a-0005ec5e9332 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07ab61302b87448b84838a1be274b445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7ab6f24815407880276db1a6d76d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:29.691689 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-42acbadf-8de2-421e-b99a-0005ec5e9332 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] 10.222.0.61 "GET /compute/v2.1/servers/d2d88bec-63be-4b0c-8497-e34d1bbb790f" status: 200 len: 1357 microversion: 2.54 time: 0.625643 Aug 31 16:17:29.694743 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2275/4563] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:17:29 2022] GET /compute/v2.1/servers/d2d88bec-63be-4b0c-8497-e34d1bbb790f => generated 1357 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:17:29.730279 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ac53958f-03e2-4edd-a4e3-d4db9020e7ec tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Action: 'create', calling method: .version_select at 0x7f5ae84e6c10>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-1872269434", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ3bKs679VJPxYsSIRbLSaQ/JTQ0dDx3EyX0v7FF9ffrMCaFOP1wUQQE5k+GGB2iABGmKP5OmpCoVmLpxEAyJiszY/O9R7uNi8vxv5BBVaLcUZroWK89Q3NhpX3HUzFgRg=="}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:17:29.900085 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-ac53958f-03e2-4edd-a4e3-d4db9020e7ec tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Getting quotas for project 9d7ab6f24815407880276db1a6d76d27. Resources: {'key_pairs'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:17:30.007905 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-ac53958f-03e2-4edd-a4e3-d4db9020e7ec tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Getting quotas for user 07ab61302b87448b84838a1be274b445 and project 9d7ab6f24815407880276db1a6d76d27. Resources: {'key_pairs'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:17:30.106187 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1be5cdb0-91ad-4442-ad22-8afa6a5274a2 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:30.108385 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1be5cdb0-91ad-4442-ad22-8afa6a5274a2 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: 265869f7-4238-4886-9dac-e22be12e3bc8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:30.150822 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ac53958f-03e2-4edd-a4e3-d4db9020e7ec tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.54 time: 0.428945 Aug 31 16:17:30.163394 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1be5cdb0-91ad-4442-ad22-8afa6a5274a2 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:30.165137 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2289/4564] 10.222.0.61 () {62 vars in 1200 bytes} [Wed Aug 31 16:17:29 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 446 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 31 16:17:30.178026 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1be5cdb0-91ad-4442-ad22-8afa6a5274a2 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:30.179363 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1be5cdb0-91ad-4442-ad22-8afa6a5274a2 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:30.180925 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1be5cdb0-91ad-4442-ad22-8afa6a5274a2 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:30.192420 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1be5cdb0-91ad-4442-ad22-8afa6a5274a2 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:30.197490 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1be5cdb0-91ad-4442-ad22-8afa6a5274a2 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:30.215613 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-125c4509-eec6-41b1-8759-5995f5f0ae64 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:30.218268 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-125c4509-eec6-41b1-8759-5995f5f0ae64 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] [instance: f1973c46-6ab5-4e0c-b188-9398faafa842] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:30.250570 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-125c4509-eec6-41b1-8759-5995f5f0ae64 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:30.251739 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-125c4509-eec6-41b1-8759-5995f5f0ae64 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:30.252831 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-125c4509-eec6-41b1-8759-5995f5f0ae64 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:30.257724 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-125c4509-eec6-41b1-8759-5995f5f0ae64 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:30.259171 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-125c4509-eec6-41b1-8759-5995f5f0ae64 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:30.260241 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-125c4509-eec6-41b1-8759-5995f5f0ae64 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:30.321735 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=4 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:17:30.421716 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-125c4509-eec6-41b1-8759-5995f5f0ae64 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:30.425154 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-125c4509-eec6-41b1-8759-5995f5f0ae64 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:30.426201 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-125c4509-eec6-41b1-8759-5995f5f0ae64 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:30.428368 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-125c4509-eec6-41b1-8759-5995f5f0ae64 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lazy-loading 'fault' on Instance uuid f1973c46-6ab5-4e0c-b188-9398faafa842 {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:17:30.447635 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:17:31.493401 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-125c4509-eec6-41b1-8759-5995f5f0ae64 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db871eae8b444ac1bb654ee687c84c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd86cc078484761bca68f912acb3368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:31.559314 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-125c4509-eec6-41b1-8759-5995f5f0ae64 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db871eae8b444ac1bb654ee687c84c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd86cc078484761bca68f912acb3368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:31.574836 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-125c4509-eec6-41b1-8759-5995f5f0ae64 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db871eae8b444ac1bb654ee687c84c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cd86cc078484761bca68f912acb3368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:31.604893 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-125c4509-eec6-41b1-8759-5995f5f0ae64 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] 10.222.0.61 "GET /compute/v2.1/servers/f1973c46-6ab5-4e0c-b188-9398faafa842" status: 200 len: 1349 microversion: 2.21 time: 1.426100 Aug 31 16:17:31.614906 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2290/4565] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:17:30 2022] GET /compute/v2.1/servers/f1973c46-6ab5-4e0c-b188-9398faafa842 => generated 1349 bytes in 1443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:17:31.639698 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=16 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:17:31.641598 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-f670d557-436b-4993-8643-e6309106bc36 req-e409c4a8-619a-45b6-80ad-56fad3d408b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "265869f7-4238-4886-9dac-e22be12e3bc8", "tag": "32189a24-db9e-4a75-87da-0e3f8a583e30"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:17:31.684193 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-f670d557-436b-4993-8643-e6309106bc36 req-e409c4a8-619a-45b6-80ad-56fad3d408b4 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:31.687292 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-f670d557-436b-4993-8643-e6309106bc36 req-e409c4a8-619a-45b6-80ad-56fad3d408b4 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:31.688826 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1be5cdb0-91ad-4442-ad22-8afa6a5274a2 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb261f2061164b49a8d496b16647dd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d2222a956a4888967e21647e26b310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:31.694065 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:17:31.694378 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-f670d557-436b-4993-8643-e6309106bc36 req-e409c4a8-619a-45b6-80ad-56fad3d408b4 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:31.715110 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1be5cdb0-91ad-4442-ad22-8afa6a5274a2 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "GET /compute/v2.1/servers/265869f7-4238-4886-9dac-e22be12e3bc8" status: 200 len: 1318 microversion: 2.1 time: 1.616471 Aug 31 16:17:31.721116 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2276/4566] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:30 2022] GET /compute/v2.1/servers/265869f7-4238-4886-9dac-e22be12e3bc8 => generated 1318 bytes in 1624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:17:31.741648 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-467c999d-5951-49c1-9fc8-83e9a832de9c tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-1872269434", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:17:31.750886 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-467c999d-5951-49c1-9fc8-83e9a832de9c tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] [instance: d2d88bec-63be-4b0c-8497-e34d1bbb790f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:31.758088 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-f670d557-436b-4993-8643-e6309106bc36 req-e409c4a8-619a-45b6-80ad-56fad3d408b4 service nova] Creating event network-changed:32189a24-db9e-4a75-87da-0e3f8a583e30 for instance 265869f7-4238-4886-9dac-e22be12e3bc8 on n-h1-850499-9 Aug 31 16:17:31.772175 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-f670d557-436b-4993-8643-e6309106bc36 req-e409c4a8-619a-45b6-80ad-56fad3d408b4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155174 Aug 31 16:17:31.778413 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-467c999d-5951-49c1-9fc8-83e9a832de9c tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:31.784628 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2291/4567] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:17:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:17:31.786417 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-467c999d-5951-49c1-9fc8-83e9a832de9c tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:31.787480 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-467c999d-5951-49c1-9fc8-83e9a832de9c tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:31.790088 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-467c999d-5951-49c1-9fc8-83e9a832de9c tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:31.793246 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-467c999d-5951-49c1-9fc8-83e9a832de9c tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:31.795048 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-467c999d-5951-49c1-9fc8-83e9a832de9c tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:32.059400 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-467c999d-5951-49c1-9fc8-83e9a832de9c tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:17:32.060916 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-467c999d-5951-49c1-9fc8-83e9a832de9c tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:17:32.061639 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-467c999d-5951-49c1-9fc8-83e9a832de9c tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:17:32.062513 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-467c999d-5951-49c1-9fc8-83e9a832de9c tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:17:32.063360 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-467c999d-5951-49c1-9fc8-83e9a832de9c tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:17:32.241080 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-467c999d-5951-49c1-9fc8-83e9a832de9c tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] [instance: d2d88bec-63be-4b0c-8497-e34d1bbb790f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:32.275893 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-467c999d-5951-49c1-9fc8-83e9a832de9c tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:32.282131 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-467c999d-5951-49c1-9fc8-83e9a832de9c tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:32.283198 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-467c999d-5951-49c1-9fc8-83e9a832de9c tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:32.288425 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-467c999d-5951-49c1-9fc8-83e9a832de9c tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:32.291308 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-467c999d-5951-49c1-9fc8-83e9a832de9c tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:32.297565 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-467c999d-5951-49c1-9fc8-83e9a832de9c tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:32.478041 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-467c999d-5951-49c1-9fc8-83e9a832de9c tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] 10.222.0.61 "POST /compute/v2.1/servers/d2d88bec-63be-4b0c-8497-e34d1bbb790f/action" status: 202 len: 1140 microversion: 2.54 time: 0.751012 Aug 31 16:17:32.480913 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2277/4568] 10.222.0.61 () {62 vars in 1320 bytes} [Wed Aug 31 16:17:31 2022] POST /compute/v2.1/servers/d2d88bec-63be-4b0c-8497-e34d1bbb790f/action => generated 1140 bytes in 759 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 31 16:17:32.521663 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-39f3a7a1-86d2-4255-b2b1-618b62093fc0 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:32.530052 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-39f3a7a1-86d2-4255-b2b1-618b62093fc0 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] [instance: d2d88bec-63be-4b0c-8497-e34d1bbb790f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:32.567154 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-39f3a7a1-86d2-4255-b2b1-618b62093fc0 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:32.574530 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-39f3a7a1-86d2-4255-b2b1-618b62093fc0 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:32.576320 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-39f3a7a1-86d2-4255-b2b1-618b62093fc0 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:32.582135 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-39f3a7a1-86d2-4255-b2b1-618b62093fc0 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:32.585173 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-39f3a7a1-86d2-4255-b2b1-618b62093fc0 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:32.588882 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-39f3a7a1-86d2-4255-b2b1-618b62093fc0 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:32.644593 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e7858f82-4927-4e37-914a-ef3f0f539fbb tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:32.648495 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e7858f82-4927-4e37-914a-ef3f0f539fbb tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] [instance: f1973c46-6ab5-4e0c-b188-9398faafa842] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:32.680633 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e7858f82-4927-4e37-914a-ef3f0f539fbb tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:32.684054 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e7858f82-4927-4e37-914a-ef3f0f539fbb tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:32.686675 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e7858f82-4927-4e37-914a-ef3f0f539fbb tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:32.688642 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e7858f82-4927-4e37-914a-ef3f0f539fbb tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:32.696742 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e7858f82-4927-4e37-914a-ef3f0f539fbb tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:32.698818 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e7858f82-4927-4e37-914a-ef3f0f539fbb tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:32.777951 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-e7858f82-4927-4e37-914a-ef3f0f539fbb tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] HTTP exception thrown: Instance f1973c46-6ab5-4e0c-b188-9398faafa842 could not be found. Aug 31 16:17:32.791862 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e7858f82-4927-4e37-914a-ef3f0f539fbb tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Request method failure captured: Aug 31 16:17:32.791862 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/f1973c46-6ab5-4e0c-b188-9398faafa842 HTTP/1.1 Aug 31 16:17:32.791862 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:17:32.791862 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:17:32.791862 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:17:32.791862 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:17:32.791862 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:17:32.791862 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:17:32.791862 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:17:32.791862 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:17:32.791862 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4l0eze0rmKcvlj8oKpbzsk9KNbUbWWNCuFWJO1Bp3JT-jLyZqkGfoHff69rq182Si7d4NSCHBQ9P2PVFeC3ZvQm6iZ9VgIj6qqAgqVLlug9xeWgA2xbADoLkXN1aZw-wHI5u5TtmzXykrrPRG24dzznlpr8ggkeNITbJnFZfq1JpPM Aug 31 16:17:32.791862 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:17:32.791862 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:17:32.791862 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:17:32.791862 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:17:32.791862 n-d-850499-9 devstack@n-api.service[122256]: X-Openstack-Nova-Api-Version: 2.21 Aug 31 16:17:32.791862 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:17:32.791862 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:17:32.791862 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 3cd86cc078484761bca68f912acb3368 Aug 31 16:17:32.791862 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-InstanceActionsV221TestJSON-969483862 Aug 31 16:17:32.791862 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:17:32.791862 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:17:32.791862 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/3cd86cc078484761bca68f912acb3368"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/3cd86cc078484761bca68f912acb3368"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_3cd86cc078484761bca68f912acb3368", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/3cd86cc078484761bca68f912acb3368"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:17:32.791862 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-InstanceActionsV221TestJSON-969483862 Aug 31 16:17:32.791862 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 3cd86cc078484761bca68f912acb3368 Aug 31 16:17:32.791862 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-969483862 Aug 31 16:17:32.791862 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-InstanceActionsV221TestJSON-969483862-project Aug 31 16:17:32.791862 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:17:32.791862 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:17:32.791862 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: db871eae8b444ac1bb654ee687c84c3e Aug 31 16:17:32.791862 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-InstanceActionsV221TestJSON-969483862-project Aug 31 16:17:32.791862 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:17:32.791862 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance f1973c46-6ab5-4e0c-b188-9398faafa842 could not be found. Aug 31 16:17:32.791862 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': 'f1973c46-6ab5-4e0c-b188-9398faafa842'} Aug 31 16:17:32.791862 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:17:32.791862 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:17:32.791862 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:17:32.791862 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:17:32.791862 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:17:32.791862 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:17:32.791862 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:17:32.791862 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:17:32.791862 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:17:32.791862 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:17:32.791862 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1973c46-6ab5-4e0c-b188-9398faafa842 could not be found. Aug 31 16:17:32.791862 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:17:32.791862 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:17:32.791862 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:17:32.791862 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:17:32.791862 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:17:32.791862 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:17:32.791862 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:17:32.791862 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:17:32.791862 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:17:32.791862 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:17:32.791862 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:17:32.791862 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:17:32.791862 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:17:32.791862 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:17:32.791862 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:17:32.791862 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:17:32.791862 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1973c46-6ab5-4e0c-b188-9398faafa842 could not be found. Aug 31 16:17:32.791862 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:17:32.791862 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:17:32.800103 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:17:32.800103 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:17:32.800103 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:17:32.800103 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:17:32.800103 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:17:32.800103 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:17:32.800103 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1973c46-6ab5-4e0c-b188-9398faafa842 could not be found. Aug 31 16:17:32.800103 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:17:32.803346 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e7858f82-4927-4e37-914a-ef3f0f539fbb tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Returning 404 to user: Instance f1973c46-6ab5-4e0c-b188-9398faafa842 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:17:32.806971 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e7858f82-4927-4e37-914a-ef3f0f539fbb tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] 10.222.0.61 "GET /compute/v2.1/servers/f1973c46-6ab5-4e0c-b188-9398faafa842" status: 404 len: 111 microversion: 2.21 time: 0.170085 Aug 31 16:17:32.815884 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2278/4569] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:17:32 2022] GET /compute/v2.1/servers/f1973c46-6ab5-4e0c-b188-9398faafa842 => generated 111 bytes in 180 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:17:32.833966 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b7aeb59e-ea54-4f03-ad0e-91cf8e3e57ea tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:32.836993 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b7aeb59e-ea54-4f03-ad0e-91cf8e3e57ea tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: 265869f7-4238-4886-9dac-e22be12e3bc8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:32.870664 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b7aeb59e-ea54-4f03-ad0e-91cf8e3e57ea tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:32.871658 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b7aeb59e-ea54-4f03-ad0e-91cf8e3e57ea tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:32.872419 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b7aeb59e-ea54-4f03-ad0e-91cf8e3e57ea tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:32.873547 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b7aeb59e-ea54-4f03-ad0e-91cf8e3e57ea tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:32.929851 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b7aeb59e-ea54-4f03-ad0e-91cf8e3e57ea tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:32.929851 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b7aeb59e-ea54-4f03-ad0e-91cf8e3e57ea tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:32.952872 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-39f3a7a1-86d2-4255-b2b1-618b62093fc0 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07ab61302b87448b84838a1be274b445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7ab6f24815407880276db1a6d76d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:32.975577 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-39f3a7a1-86d2-4255-b2b1-618b62093fc0 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07ab61302b87448b84838a1be274b445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7ab6f24815407880276db1a6d76d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:32.976384 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-39f3a7a1-86d2-4255-b2b1-618b62093fc0 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07ab61302b87448b84838a1be274b445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7ab6f24815407880276db1a6d76d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:32.978282 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-39f3a7a1-86d2-4255-b2b1-618b62093fc0 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] 10.222.0.61 "GET /compute/v2.1/servers/d2d88bec-63be-4b0c-8497-e34d1bbb790f" status: 200 len: 1409 microversion: 2.54 time: 0.466191 Aug 31 16:17:32.979345 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2292/4570] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:17:32 2022] GET /compute/v2.1/servers/d2d88bec-63be-4b0c-8497-e34d1bbb790f => generated 1409 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:17:32.985866 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-79648865-20ad-47b4-b473-a9fa8bb68860 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Calling method '.version_select at 0x7f5ae8cf6280>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:32.987033 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-79648865-20ad-47b4-b473-a9fa8bb68860 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] [instance: f1973c46-6ab5-4e0c-b188-9398faafa842] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:32.997915 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-79648865-20ad-47b4-b473-a9fa8bb68860 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:32.998895 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-79648865-20ad-47b4-b473-a9fa8bb68860 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:32.999546 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-79648865-20ad-47b4-b473-a9fa8bb68860 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:33.000828 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-79648865-20ad-47b4-b473-a9fa8bb68860 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:33.001522 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-79648865-20ad-47b4-b473-a9fa8bb68860 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:33.002031 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-79648865-20ad-47b4-b473-a9fa8bb68860 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:33.146526 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-79648865-20ad-47b4-b473-a9fa8bb68860 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] 10.222.0.61 "GET /compute/v2.1/servers/f1973c46-6ab5-4e0c-b188-9398faafa842/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.165743 Aug 31 16:17:33.147391 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2293/4571] 10.222.0.61 () {60 vars in 1337 bytes} [Wed Aug 31 16:17:32 2022] GET /compute/v2.1/servers/f1973c46-6ab5-4e0c-b188-9398faafa842/os-instance-actions => generated 611 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 16:17:33.175682 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-80a2718a-c11b-4c3a-8fac-aa069fb0da21 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:33.175990 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-80a2718a-c11b-4c3a-8fac-aa069fb0da21 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] [instance: f1973c46-6ab5-4e0c-b188-9398faafa842] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:33.193028 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-80a2718a-c11b-4c3a-8fac-aa069fb0da21 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:33.193878 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-80a2718a-c11b-4c3a-8fac-aa069fb0da21 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:33.194725 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-80a2718a-c11b-4c3a-8fac-aa069fb0da21 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:33.195907 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-80a2718a-c11b-4c3a-8fac-aa069fb0da21 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:33.199746 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-80a2718a-c11b-4c3a-8fac-aa069fb0da21 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:33.200485 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-80a2718a-c11b-4c3a-8fac-aa069fb0da21 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:33.241747 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-80a2718a-c11b-4c3a-8fac-aa069fb0da21 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] HTTP exception thrown: Instance f1973c46-6ab5-4e0c-b188-9398faafa842 could not be found. Aug 31 16:17:33.246890 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-80a2718a-c11b-4c3a-8fac-aa069fb0da21 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Request method failure captured: Aug 31 16:17:33.246890 n-d-850499-9 devstack@n-api.service[122257]: request: DELETE /compute/v2.1/servers/f1973c46-6ab5-4e0c-b188-9398faafa842 HTTP/1.1 Aug 31 16:17:33.246890 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:17:33.246890 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:17:33.246890 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:17:33.246890 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:17:33.246890 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:17:33.246890 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:17:33.246890 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:17:33.246890 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:17:33.246890 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4l0eze0rmKcvlj8oKpbzsk9KNbUbWWNCuFWJO1Bp3JT-jLyZqkGfoHff69rq182Si7d4NSCHBQ9P2PVFeC3ZvQm6iZ9VgIj6qqAgqVLlug9xeWgA2xbADoLkXN1aZw-wHI5u5TtmzXykrrPRG24dzznlpr8ggkeNITbJnFZfq1JpPM Aug 31 16:17:33.246890 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:17:33.246890 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:17:33.246890 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:17:33.246890 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:17:33.246890 n-d-850499-9 devstack@n-api.service[122257]: X-Openstack-Nova-Api-Version: 2.21 Aug 31 16:17:33.246890 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:17:33.246890 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:17:33.246890 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 3cd86cc078484761bca68f912acb3368 Aug 31 16:17:33.246890 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-InstanceActionsV221TestJSON-969483862 Aug 31 16:17:33.246890 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:17:33.246890 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:17:33.246890 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/3cd86cc078484761bca68f912acb3368"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/3cd86cc078484761bca68f912acb3368"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_3cd86cc078484761bca68f912acb3368", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/3cd86cc078484761bca68f912acb3368"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:17:33.246890 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-InstanceActionsV221TestJSON-969483862 Aug 31 16:17:33.246890 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 3cd86cc078484761bca68f912acb3368 Aug 31 16:17:33.246890 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-969483862 Aug 31 16:17:33.246890 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-InstanceActionsV221TestJSON-969483862-project Aug 31 16:17:33.246890 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:17:33.246890 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:17:33.246890 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: db871eae8b444ac1bb654ee687c84c3e Aug 31 16:17:33.246890 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-InstanceActionsV221TestJSON-969483862-project Aug 31 16:17:33.246890 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:17:33.246890 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance f1973c46-6ab5-4e0c-b188-9398faafa842 could not be found. Aug 31 16:17:33.246890 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': 'f1973c46-6ab5-4e0c-b188-9398faafa842'} Aug 31 16:17:33.246890 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:17:33.246890 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:17:33.246890 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:17:33.246890 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:17:33.246890 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:17:33.246890 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:17:33.246890 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:17:33.246890 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:17:33.246890 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:17:33.246890 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:17:33.246890 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1973c46-6ab5-4e0c-b188-9398faafa842 could not be found. Aug 31 16:17:33.246890 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:17:33.246890 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:17:33.246890 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:17:33.246890 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:17:33.246890 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:17:33.246890 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:17:33.246890 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:17:33.246890 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:17:33.246890 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:17:33.246890 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:17:33.246890 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:17:33.246890 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:17:33.246890 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:17:33.246890 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:17:33.246890 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:17:33.246890 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:17:33.246890 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:17:33.246890 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:17:33.253025 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1973c46-6ab5-4e0c-b188-9398faafa842 could not be found. Aug 31 16:17:33.253025 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:17:33.253025 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:17:33.253025 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:17:33.253025 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:17:33.253025 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:17:33.253025 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:17:33.253025 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:17:33.253025 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:17:33.253025 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1973c46-6ab5-4e0c-b188-9398faafa842 could not be found. Aug 31 16:17:33.253025 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:17:33.253025 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-80a2718a-c11b-4c3a-8fac-aa069fb0da21 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Returning 404 to user: Instance f1973c46-6ab5-4e0c-b188-9398faafa842 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:17:33.260077 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-80a2718a-c11b-4c3a-8fac-aa069fb0da21 tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] 10.222.0.61 "DELETE /compute/v2.1/servers/f1973c46-6ab5-4e0c-b188-9398faafa842" status: 404 len: 111 microversion: 2.21 time: 0.092534 Aug 31 16:17:33.260077 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2294/4572] 10.222.0.61 () {60 vars in 1280 bytes} [Wed Aug 31 16:17:33 2022] DELETE /compute/v2.1/servers/f1973c46-6ab5-4e0c-b188-9398faafa842 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:17:33.277995 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-05f36e65-60ee-4a3f-b337-b6f85deb96db tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:33.278642 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-05f36e65-60ee-4a3f-b337-b6f85deb96db tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] [instance: f1973c46-6ab5-4e0c-b188-9398faafa842] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:33.299174 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-05f36e65-60ee-4a3f-b337-b6f85deb96db tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:33.300117 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-05f36e65-60ee-4a3f-b337-b6f85deb96db tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:33.301164 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-05f36e65-60ee-4a3f-b337-b6f85deb96db tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:33.302738 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-05f36e65-60ee-4a3f-b337-b6f85deb96db tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:33.303603 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-05f36e65-60ee-4a3f-b337-b6f85deb96db tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:33.304527 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-05f36e65-60ee-4a3f-b337-b6f85deb96db tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:33.354689 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-05f36e65-60ee-4a3f-b337-b6f85deb96db tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] HTTP exception thrown: Instance f1973c46-6ab5-4e0c-b188-9398faafa842 could not be found. Aug 31 16:17:33.358266 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-05f36e65-60ee-4a3f-b337-b6f85deb96db tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Request method failure captured: Aug 31 16:17:33.358266 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/f1973c46-6ab5-4e0c-b188-9398faafa842 HTTP/1.1 Aug 31 16:17:33.358266 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:17:33.358266 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:17:33.358266 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:17:33.358266 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:17:33.358266 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:17:33.358266 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:17:33.358266 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:17:33.358266 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:17:33.358266 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4l0eze0rmKcvlj8oKpbzsk9KNbUbWWNCuFWJO1Bp3JT-jLyZqkGfoHff69rq182Si7d4NSCHBQ9P2PVFeC3ZvQm6iZ9VgIj6qqAgqVLlug9xeWgA2xbADoLkXN1aZw-wHI5u5TtmzXykrrPRG24dzznlpr8ggkeNITbJnFZfq1JpPM Aug 31 16:17:33.358266 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:17:33.358266 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:17:33.358266 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:17:33.358266 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:17:33.358266 n-d-850499-9 devstack@n-api.service[122257]: X-Openstack-Nova-Api-Version: 2.21 Aug 31 16:17:33.358266 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:17:33.358266 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:17:33.358266 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 3cd86cc078484761bca68f912acb3368 Aug 31 16:17:33.358266 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-InstanceActionsV221TestJSON-969483862 Aug 31 16:17:33.358266 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:17:33.358266 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:17:33.358266 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/3cd86cc078484761bca68f912acb3368"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/3cd86cc078484761bca68f912acb3368"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_3cd86cc078484761bca68f912acb3368", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/3cd86cc078484761bca68f912acb3368"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:17:33.358266 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-InstanceActionsV221TestJSON-969483862 Aug 31 16:17:33.358266 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 3cd86cc078484761bca68f912acb3368 Aug 31 16:17:33.358266 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-969483862 Aug 31 16:17:33.358266 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-InstanceActionsV221TestJSON-969483862-project Aug 31 16:17:33.358266 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:17:33.358266 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:17:33.358266 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: db871eae8b444ac1bb654ee687c84c3e Aug 31 16:17:33.358266 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-InstanceActionsV221TestJSON-969483862-project Aug 31 16:17:33.358266 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:17:33.358266 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance f1973c46-6ab5-4e0c-b188-9398faafa842 could not be found. Aug 31 16:17:33.358266 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': 'f1973c46-6ab5-4e0c-b188-9398faafa842'} Aug 31 16:17:33.358266 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:17:33.358266 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:17:33.358266 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:17:33.358266 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:17:33.358266 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:17:33.358266 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:17:33.358266 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:17:33.358266 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:17:33.358266 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:17:33.358266 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:17:33.358266 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1973c46-6ab5-4e0c-b188-9398faafa842 could not be found. Aug 31 16:17:33.358266 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:17:33.358266 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:17:33.358266 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:17:33.358266 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:17:33.358266 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:17:33.358266 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:17:33.358266 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:17:33.358266 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:17:33.358266 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:17:33.358266 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:17:33.358266 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:17:33.358266 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:17:33.358266 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:17:33.358266 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:17:33.358266 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:17:33.358266 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:17:33.358266 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1973c46-6ab5-4e0c-b188-9398faafa842 could not be found. Aug 31 16:17:33.358266 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:17:33.358266 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:17:33.362953 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:17:33.362953 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:17:33.362953 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:17:33.362953 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:17:33.362953 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:17:33.362953 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:17:33.362953 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1973c46-6ab5-4e0c-b188-9398faafa842 could not be found. Aug 31 16:17:33.362953 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:17:33.365275 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-05f36e65-60ee-4a3f-b337-b6f85deb96db tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] Returning 404 to user: Instance f1973c46-6ab5-4e0c-b188-9398faafa842 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:17:33.366661 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-05f36e65-60ee-4a3f-b337-b6f85deb96db tempest-InstanceActionsV221TestJSON-969483862 tempest-InstanceActionsV221TestJSON-969483862-project] 10.222.0.61 "GET /compute/v2.1/servers/f1973c46-6ab5-4e0c-b188-9398faafa842" status: 404 len: 111 microversion: 2.21 time: 0.105353 Aug 31 16:17:33.371563 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2295/4573] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:17:33 2022] GET /compute/v2.1/servers/f1973c46-6ab5-4e0c-b188-9398faafa842 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:17:33.443513 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b7aeb59e-ea54-4f03-ad0e-91cf8e3e57ea tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb261f2061164b49a8d496b16647dd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d2222a956a4888967e21647e26b310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:33.511438 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b7aeb59e-ea54-4f03-ad0e-91cf8e3e57ea tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "GET /compute/v2.1/servers/265869f7-4238-4886-9dac-e22be12e3bc8" status: 200 len: 1318 microversion: 2.1 time: 0.686383 Aug 31 16:17:33.514523 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2279/4574] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:32 2022] GET /compute/v2.1/servers/265869f7-4238-4886-9dac-e22be12e3bc8 => generated 1318 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:34.035958 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-48fe4a23-d69d-4092-a46d-a76de3abd105 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:34.045410 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-48fe4a23-d69d-4092-a46d-a76de3abd105 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] [instance: d2d88bec-63be-4b0c-8497-e34d1bbb790f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:34.092359 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-48fe4a23-d69d-4092-a46d-a76de3abd105 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:34.095442 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-48fe4a23-d69d-4092-a46d-a76de3abd105 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:34.101398 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-48fe4a23-d69d-4092-a46d-a76de3abd105 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:34.105636 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-48fe4a23-d69d-4092-a46d-a76de3abd105 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:34.110398 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-48fe4a23-d69d-4092-a46d-a76de3abd105 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:34.112341 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-48fe4a23-d69d-4092-a46d-a76de3abd105 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:34.536008 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-46d6bd16-a982-43ed-a766-9097e401db07 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:34.536647 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-46d6bd16-a982-43ed-a766-9097e401db07 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: 265869f7-4238-4886-9dac-e22be12e3bc8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:34.556478 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-46d6bd16-a982-43ed-a766-9097e401db07 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:34.557396 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-46d6bd16-a982-43ed-a766-9097e401db07 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:34.562661 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-46d6bd16-a982-43ed-a766-9097e401db07 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:34.587831 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-46d6bd16-a982-43ed-a766-9097e401db07 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:34.597337 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-46d6bd16-a982-43ed-a766-9097e401db07 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:34.599829 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-46d6bd16-a982-43ed-a766-9097e401db07 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:34.694116 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-48fe4a23-d69d-4092-a46d-a76de3abd105 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07ab61302b87448b84838a1be274b445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7ab6f24815407880276db1a6d76d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:34.765352 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-48fe4a23-d69d-4092-a46d-a76de3abd105 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07ab61302b87448b84838a1be274b445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7ab6f24815407880276db1a6d76d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:34.768715 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-48fe4a23-d69d-4092-a46d-a76de3abd105 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07ab61302b87448b84838a1be274b445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7ab6f24815407880276db1a6d76d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:34.802032 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-48fe4a23-d69d-4092-a46d-a76de3abd105 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] 10.222.0.61 "GET /compute/v2.1/servers/d2d88bec-63be-4b0c-8497-e34d1bbb790f" status: 200 len: 1409 microversion: 2.54 time: 0.784590 Aug 31 16:17:34.803057 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2296/4575] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:17:34 2022] GET /compute/v2.1/servers/d2d88bec-63be-4b0c-8497-e34d1bbb790f => generated 1409 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:17:34.992220 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-46d6bd16-a982-43ed-a766-9097e401db07 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb261f2061164b49a8d496b16647dd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d2222a956a4888967e21647e26b310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:35.013896 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-46d6bd16-a982-43ed-a766-9097e401db07 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "GET /compute/v2.1/servers/265869f7-4238-4886-9dac-e22be12e3bc8" status: 200 len: 1318 microversion: 2.1 time: 0.478673 Aug 31 16:17:35.017809 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2280/4576] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:34 2022] GET /compute/v2.1/servers/265869f7-4238-4886-9dac-e22be12e3bc8 => generated 1318 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:35.833695 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0c15db29-3f36-4fd6-9e73-79389a5195e6 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:35.834582 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0c15db29-3f36-4fd6-9e73-79389a5195e6 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] [instance: d2d88bec-63be-4b0c-8497-e34d1bbb790f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:35.853460 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0c15db29-3f36-4fd6-9e73-79389a5195e6 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:35.854234 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0c15db29-3f36-4fd6-9e73-79389a5195e6 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:35.854952 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0c15db29-3f36-4fd6-9e73-79389a5195e6 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:35.855753 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0c15db29-3f36-4fd6-9e73-79389a5195e6 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:35.856273 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0c15db29-3f36-4fd6-9e73-79389a5195e6 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:35.856788 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0c15db29-3f36-4fd6-9e73-79389a5195e6 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:36.048096 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1f84328b-0723-4875-92e5-bf16dd8341d5 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:36.048895 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1f84328b-0723-4875-92e5-bf16dd8341d5 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: 265869f7-4238-4886-9dac-e22be12e3bc8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:36.070771 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1f84328b-0723-4875-92e5-bf16dd8341d5 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:36.071275 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1f84328b-0723-4875-92e5-bf16dd8341d5 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:36.071935 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1f84328b-0723-4875-92e5-bf16dd8341d5 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:36.073166 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1f84328b-0723-4875-92e5-bf16dd8341d5 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:36.074347 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1f84328b-0723-4875-92e5-bf16dd8341d5 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:36.076062 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1f84328b-0723-4875-92e5-bf16dd8341d5 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:36.130941 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0c15db29-3f36-4fd6-9e73-79389a5195e6 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07ab61302b87448b84838a1be274b445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7ab6f24815407880276db1a6d76d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:36.146358 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0c15db29-3f36-4fd6-9e73-79389a5195e6 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07ab61302b87448b84838a1be274b445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7ab6f24815407880276db1a6d76d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:36.153520 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0c15db29-3f36-4fd6-9e73-79389a5195e6 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07ab61302b87448b84838a1be274b445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7ab6f24815407880276db1a6d76d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:36.158476 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0c15db29-3f36-4fd6-9e73-79389a5195e6 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] 10.222.0.61 "GET /compute/v2.1/servers/d2d88bec-63be-4b0c-8497-e34d1bbb790f" status: 200 len: 1409 microversion: 2.54 time: 0.328813 Aug 31 16:17:36.159593 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2297/4577] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:17:35 2022] GET /compute/v2.1/servers/d2d88bec-63be-4b0c-8497-e34d1bbb790f => generated 1409 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:17:37.005885 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1f84328b-0723-4875-92e5-bf16dd8341d5 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb261f2061164b49a8d496b16647dd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d2222a956a4888967e21647e26b310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:37.014506 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1f84328b-0723-4875-92e5-bf16dd8341d5 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "GET /compute/v2.1/servers/265869f7-4238-4886-9dac-e22be12e3bc8" status: 200 len: 1318 microversion: 2.1 time: 0.970807 Aug 31 16:17:37.030455 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2281/4578] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:36 2022] GET /compute/v2.1/servers/265869f7-4238-4886-9dac-e22be12e3bc8 => generated 1318 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:37.189535 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-07d99cb5-cf5c-4199-8c21-88a99bac3f57 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:37.191064 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-07d99cb5-cf5c-4199-8c21-88a99bac3f57 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] [instance: d2d88bec-63be-4b0c-8497-e34d1bbb790f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:37.207542 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-07d99cb5-cf5c-4199-8c21-88a99bac3f57 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:37.211309 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-07d99cb5-cf5c-4199-8c21-88a99bac3f57 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:37.223799 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-07d99cb5-cf5c-4199-8c21-88a99bac3f57 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:37.226010 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-07d99cb5-cf5c-4199-8c21-88a99bac3f57 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:37.230846 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-07d99cb5-cf5c-4199-8c21-88a99bac3f57 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:37.231616 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-07d99cb5-cf5c-4199-8c21-88a99bac3f57 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:37.534305 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-07d99cb5-cf5c-4199-8c21-88a99bac3f57 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07ab61302b87448b84838a1be274b445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7ab6f24815407880276db1a6d76d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:37.562958 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-07d99cb5-cf5c-4199-8c21-88a99bac3f57 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07ab61302b87448b84838a1be274b445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7ab6f24815407880276db1a6d76d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:37.566193 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-07d99cb5-cf5c-4199-8c21-88a99bac3f57 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07ab61302b87448b84838a1be274b445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7ab6f24815407880276db1a6d76d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:37.569844 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-07d99cb5-cf5c-4199-8c21-88a99bac3f57 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] 10.222.0.61 "GET /compute/v2.1/servers/d2d88bec-63be-4b0c-8497-e34d1bbb790f" status: 200 len: 1409 microversion: 2.54 time: 0.384851 Aug 31 16:17:37.572903 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2298/4579] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:17:37 2022] GET /compute/v2.1/servers/d2d88bec-63be-4b0c-8497-e34d1bbb790f => generated 1409 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:17:38.038058 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-05ca6fc2-5d23-49a4-8db8-6d77955e8218 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:38.038780 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-05ca6fc2-5d23-49a4-8db8-6d77955e8218 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: 265869f7-4238-4886-9dac-e22be12e3bc8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:38.056077 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-05ca6fc2-5d23-49a4-8db8-6d77955e8218 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:38.056702 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-05ca6fc2-5d23-49a4-8db8-6d77955e8218 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:38.068014 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-05ca6fc2-5d23-49a4-8db8-6d77955e8218 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:38.069492 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-05ca6fc2-5d23-49a4-8db8-6d77955e8218 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:38.070359 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-05ca6fc2-5d23-49a4-8db8-6d77955e8218 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:38.075997 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-05ca6fc2-5d23-49a4-8db8-6d77955e8218 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:38.203848 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-681496d1-1909-4348-a15a-71ce2f9fca2d tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-1436788084", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "networks": [{"uuid": "c0146b11-fe07-4412-93cf-626ad947bf58"}]}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:17:38.276962 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:17:38.473336 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-681496d1-1909-4348-a15a-71ce2f9fca2d tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] validate_networks() for [('c0146b11-fe07-4412-93cf-626ad947bf58', None, None, None, None, None)] {{(pid=122256) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:17:38.954704 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-05ca6fc2-5d23-49a4-8db8-6d77955e8218 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb261f2061164b49a8d496b16647dd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d2222a956a4888967e21647e26b310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:39.013709 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-05ca6fc2-5d23-49a4-8db8-6d77955e8218 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "GET /compute/v2.1/servers/265869f7-4238-4886-9dac-e22be12e3bc8" status: 200 len: 1318 microversion: 2.1 time: 0.967203 Aug 31 16:17:39.015863 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2299/4580] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:38 2022] GET /compute/v2.1/servers/265869f7-4238-4886-9dac-e22be12e3bc8 => generated 1318 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:17:39.045749 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-fb4302e4-50b9-4aa3-9cf8-e0c2434de2bb tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:39.058800 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-fb4302e4-50b9-4aa3-9cf8-e0c2434de2bb tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] [instance: d2d88bec-63be-4b0c-8497-e34d1bbb790f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:39.094356 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fb4302e4-50b9-4aa3-9cf8-e0c2434de2bb tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:39.107540 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fb4302e4-50b9-4aa3-9cf8-e0c2434de2bb tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:39.116737 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fb4302e4-50b9-4aa3-9cf8-e0c2434de2bb tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:39.120858 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fb4302e4-50b9-4aa3-9cf8-e0c2434de2bb tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:39.124726 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fb4302e4-50b9-4aa3-9cf8-e0c2434de2bb tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:39.127025 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fb4302e4-50b9-4aa3-9cf8-e0c2434de2bb tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:39.412615 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-fb4302e4-50b9-4aa3-9cf8-e0c2434de2bb tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07ab61302b87448b84838a1be274b445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7ab6f24815407880276db1a6d76d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:39.435553 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-fb4302e4-50b9-4aa3-9cf8-e0c2434de2bb tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07ab61302b87448b84838a1be274b445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7ab6f24815407880276db1a6d76d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:39.438122 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-fb4302e4-50b9-4aa3-9cf8-e0c2434de2bb tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07ab61302b87448b84838a1be274b445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7ab6f24815407880276db1a6d76d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:39.442291 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-fb4302e4-50b9-4aa3-9cf8-e0c2434de2bb tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] 10.222.0.61 "GET /compute/v2.1/servers/d2d88bec-63be-4b0c-8497-e34d1bbb790f" status: 200 len: 1409 microversion: 2.54 time: 0.419348 Aug 31 16:17:39.456336 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2300/4581] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:17:39 2022] GET /compute/v2.1/servers/d2d88bec-63be-4b0c-8497-e34d1bbb790f => generated 1409 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:17:39.464782 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-d4e1e036-6bd2-4ca9-90d2-c9eea40a554b req-00c9032f-c040-4998-8b63-b5fdd63d237a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "265869f7-4238-4886-9dac-e22be12e3bc8", "name": "network-vif-plugged", "status": "completed", "tag": "32189a24-db9e-4a75-87da-0e3f8a583e30"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:17:39.477975 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-d4e1e036-6bd2-4ca9-90d2-c9eea40a554b req-00c9032f-c040-4998-8b63-b5fdd63d237a service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:39.478482 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-d4e1e036-6bd2-4ca9-90d2-c9eea40a554b req-00c9032f-c040-4998-8b63-b5fdd63d237a service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:39.478929 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-d4e1e036-6bd2-4ca9-90d2-c9eea40a554b req-00c9032f-c040-4998-8b63-b5fdd63d237a service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:39.510620 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-d4e1e036-6bd2-4ca9-90d2-c9eea40a554b req-00c9032f-c040-4998-8b63-b5fdd63d237a service nova] Creating event network-vif-plugged:32189a24-db9e-4a75-87da-0e3f8a583e30 for instance 265869f7-4238-4886-9dac-e22be12e3bc8 on n-h1-850499-9 Aug 31 16:17:39.530930 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-d4e1e036-6bd2-4ca9-90d2-c9eea40a554b req-00c9032f-c040-4998-8b63-b5fdd63d237a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070284 Aug 31 16:17:39.535024 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2301/4582] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:17:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:17:39.814383 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-681496d1-1909-4348-a15a-71ce2f9fca2d tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:17:39.816307 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-681496d1-1909-4348-a15a-71ce2f9fca2d tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:17:39.817948 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-681496d1-1909-4348-a15a-71ce2f9fca2d tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:17:39.818925 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-681496d1-1909-4348-a15a-71ce2f9fca2d tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:17:39.819959 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-681496d1-1909-4348-a15a-71ce2f9fca2d tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:17:39.840447 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-681496d1-1909-4348-a15a-71ce2f9fca2d tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:39.841635 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-681496d1-1909-4348-a15a-71ce2f9fca2d tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:39.842617 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-681496d1-1909-4348-a15a-71ce2f9fca2d tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:39.844223 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-681496d1-1909-4348-a15a-71ce2f9fca2d tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:39.845592 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-681496d1-1909-4348-a15a-71ce2f9fca2d tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:39.847246 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-681496d1-1909-4348-a15a-71ce2f9fca2d tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:39.892361 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-681496d1-1909-4348-a15a-71ce2f9fca2d tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Getting quotas for project 2113ab47146243cb85d6d57bc608131a. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:17:39.905078 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-681496d1-1909-4348-a15a-71ce2f9fca2d tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Getting quotas for user 0f8941ad0e6d4f9bab797d0f3a213c09 and project 2113ab47146243cb85d6d57bc608131a. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:17:39.939251 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-681496d1-1909-4348-a15a-71ce2f9fca2d tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Going to run 1 instances... {{(pid=122256) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:17:39.944464 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-681496d1-1909-4348-a15a-71ce2f9fca2d tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] [instance: 336a246f-7f3e-4073-b8bc-c35be2fa56a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:17:40.051549 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b338d18d-d04e-4e37-b7c7-edf38ee9dcb9 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:40.060275 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b338d18d-d04e-4e37-b7c7-edf38ee9dcb9 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: 265869f7-4238-4886-9dac-e22be12e3bc8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:40.071621 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=4 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:17:40.107946 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b338d18d-d04e-4e37-b7c7-edf38ee9dcb9 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:40.109769 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b338d18d-d04e-4e37-b7c7-edf38ee9dcb9 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:40.110810 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b338d18d-d04e-4e37-b7c7-edf38ee9dcb9 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:40.116073 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b338d18d-d04e-4e37-b7c7-edf38ee9dcb9 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:40.117425 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b338d18d-d04e-4e37-b7c7-edf38ee9dcb9 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:40.118422 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b338d18d-d04e-4e37-b7c7-edf38ee9dcb9 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:40.132876 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-681496d1-1909-4348-a15a-71ce2f9fca2d tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.232055 Aug 31 16:17:40.137158 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2282/4583] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:17:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 2240 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:17:40.157524 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d475782f-5a2f-4d89-92a9-c3088f3c9e19 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:40.174322 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d475782f-5a2f-4d89-92a9-c3088f3c9e19 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] [instance: 336a246f-7f3e-4073-b8bc-c35be2fa56a4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:41.450901 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d475782f-5a2f-4d89-92a9-c3088f3c9e19 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8941ad0e6d4f9bab797d0f3a213c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2113ab47146243cb85d6d57bc608131a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:41.496319 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d475782f-5a2f-4d89-92a9-c3088f3c9e19 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] 10.222.0.61 "GET /compute/v2.1/servers/336a246f-7f3e-4073-b8bc-c35be2fa56a4" status: 200 len: 1217 microversion: 2.1 time: 1.347969 Aug 31 16:17:41.497431 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2283/4584] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:40 2022] GET /compute/v2.1/servers/336a246f-7f3e-4073-b8bc-c35be2fa56a4 => generated 1217 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:41.542463 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8ee4a9fa-337f-4575-ba54-69d85ac4e6d8 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:41.543539 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8ee4a9fa-337f-4575-ba54-69d85ac4e6d8 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] [instance: d2d88bec-63be-4b0c-8497-e34d1bbb790f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:41.606265 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8ee4a9fa-337f-4575-ba54-69d85ac4e6d8 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:41.608984 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8ee4a9fa-337f-4575-ba54-69d85ac4e6d8 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:41.613057 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8ee4a9fa-337f-4575-ba54-69d85ac4e6d8 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:41.616453 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8ee4a9fa-337f-4575-ba54-69d85ac4e6d8 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:41.621591 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8ee4a9fa-337f-4575-ba54-69d85ac4e6d8 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:41.622927 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8ee4a9fa-337f-4575-ba54-69d85ac4e6d8 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:41.937501 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8ee4a9fa-337f-4575-ba54-69d85ac4e6d8 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07ab61302b87448b84838a1be274b445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7ab6f24815407880276db1a6d76d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:41.950858 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8ee4a9fa-337f-4575-ba54-69d85ac4e6d8 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07ab61302b87448b84838a1be274b445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7ab6f24815407880276db1a6d76d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:41.957960 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8ee4a9fa-337f-4575-ba54-69d85ac4e6d8 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07ab61302b87448b84838a1be274b445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7ab6f24815407880276db1a6d76d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:41.961573 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8ee4a9fa-337f-4575-ba54-69d85ac4e6d8 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] 10.222.0.61 "GET /compute/v2.1/servers/d2d88bec-63be-4b0c-8497-e34d1bbb790f" status: 200 len: 1409 microversion: 2.54 time: 0.451813 Aug 31 16:17:41.968708 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2284/4585] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:17:41 2022] GET /compute/v2.1/servers/d2d88bec-63be-4b0c-8497-e34d1bbb790f => generated 1409 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:17:42.066459 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b338d18d-d04e-4e37-b7c7-edf38ee9dcb9 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb261f2061164b49a8d496b16647dd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d2222a956a4888967e21647e26b310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:42.080963 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b338d18d-d04e-4e37-b7c7-edf38ee9dcb9 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "GET /compute/v2.1/servers/265869f7-4238-4886-9dac-e22be12e3bc8" status: 200 len: 1318 microversion: 2.1 time: 2.041523 Aug 31 16:17:42.086058 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2302/4586] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:40 2022] GET /compute/v2.1/servers/265869f7-4238-4886-9dac-e22be12e3bc8 => generated 1318 bytes in 2048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:17:42.534101 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-010fd042-b4c2-4e64-ad4e-ee06b4694213 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:42.534723 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-010fd042-b4c2-4e64-ad4e-ee06b4694213 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] [instance: 336a246f-7f3e-4073-b8bc-c35be2fa56a4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:42.545100 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-010fd042-b4c2-4e64-ad4e-ee06b4694213 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:42.545932 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-010fd042-b4c2-4e64-ad4e-ee06b4694213 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:42.546714 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-010fd042-b4c2-4e64-ad4e-ee06b4694213 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:42.547899 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-010fd042-b4c2-4e64-ad4e-ee06b4694213 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:42.549122 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-010fd042-b4c2-4e64-ad4e-ee06b4694213 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:42.550006 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-010fd042-b4c2-4e64-ad4e-ee06b4694213 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:42.775561 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-010fd042-b4c2-4e64-ad4e-ee06b4694213 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8941ad0e6d4f9bab797d0f3a213c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2113ab47146243cb85d6d57bc608131a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:42.786746 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-010fd042-b4c2-4e64-ad4e-ee06b4694213 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] 10.222.0.61 "GET /compute/v2.1/servers/336a246f-7f3e-4073-b8bc-c35be2fa56a4" status: 200 len: 1269 microversion: 2.1 time: 0.263367 Aug 31 16:17:42.793956 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2285/4587] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:42 2022] GET /compute/v2.1/servers/336a246f-7f3e-4073-b8bc-c35be2fa56a4 => generated 1269 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:42.992253 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-fd60a18b-a54d-435f-8ea1-70220ca46254 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:42.993078 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-fd60a18b-a54d-435f-8ea1-70220ca46254 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] [instance: d2d88bec-63be-4b0c-8497-e34d1bbb790f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:43.022616 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fd60a18b-a54d-435f-8ea1-70220ca46254 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:43.029119 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fd60a18b-a54d-435f-8ea1-70220ca46254 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:43.030170 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fd60a18b-a54d-435f-8ea1-70220ca46254 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:43.033141 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fd60a18b-a54d-435f-8ea1-70220ca46254 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:43.034148 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fd60a18b-a54d-435f-8ea1-70220ca46254 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:43.035636 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fd60a18b-a54d-435f-8ea1-70220ca46254 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:43.144335 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1ec95c0d-35d0-4942-bbb0-81ffb1a8b6e4 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:43.148794 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1ec95c0d-35d0-4942-bbb0-81ffb1a8b6e4 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: 265869f7-4238-4886-9dac-e22be12e3bc8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:43.204376 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1ec95c0d-35d0-4942-bbb0-81ffb1a8b6e4 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:43.204863 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1ec95c0d-35d0-4942-bbb0-81ffb1a8b6e4 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:43.222173 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1ec95c0d-35d0-4942-bbb0-81ffb1a8b6e4 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:43.227314 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1ec95c0d-35d0-4942-bbb0-81ffb1a8b6e4 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:43.232951 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1ec95c0d-35d0-4942-bbb0-81ffb1a8b6e4 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:43.233421 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1ec95c0d-35d0-4942-bbb0-81ffb1a8b6e4 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:43.472127 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-fd60a18b-a54d-435f-8ea1-70220ca46254 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07ab61302b87448b84838a1be274b445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7ab6f24815407880276db1a6d76d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:43.506708 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-fd60a18b-a54d-435f-8ea1-70220ca46254 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07ab61302b87448b84838a1be274b445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7ab6f24815407880276db1a6d76d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:43.516917 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-fd60a18b-a54d-435f-8ea1-70220ca46254 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07ab61302b87448b84838a1be274b445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7ab6f24815407880276db1a6d76d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:43.522133 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-fd60a18b-a54d-435f-8ea1-70220ca46254 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] 10.222.0.61 "GET /compute/v2.1/servers/d2d88bec-63be-4b0c-8497-e34d1bbb790f" status: 200 len: 1409 microversion: 2.54 time: 0.536812 Aug 31 16:17:43.527727 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2303/4588] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:17:42 2022] GET /compute/v2.1/servers/d2d88bec-63be-4b0c-8497-e34d1bbb790f => generated 1409 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:17:43.829448 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-57ae068a-5cb1-4de8-833c-7ee7cd5d3f97 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:43.830349 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-57ae068a-5cb1-4de8-833c-7ee7cd5d3f97 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] [instance: 336a246f-7f3e-4073-b8bc-c35be2fa56a4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:43.838477 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-57ae068a-5cb1-4de8-833c-7ee7cd5d3f97 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:43.839279 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-57ae068a-5cb1-4de8-833c-7ee7cd5d3f97 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:43.839995 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-57ae068a-5cb1-4de8-833c-7ee7cd5d3f97 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:43.868216 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-57ae068a-5cb1-4de8-833c-7ee7cd5d3f97 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:43.869366 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-57ae068a-5cb1-4de8-833c-7ee7cd5d3f97 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:43.870079 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-57ae068a-5cb1-4de8-833c-7ee7cd5d3f97 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:44.616686 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-57ae068a-5cb1-4de8-833c-7ee7cd5d3f97 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8941ad0e6d4f9bab797d0f3a213c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2113ab47146243cb85d6d57bc608131a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:44.649287 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-57ae068a-5cb1-4de8-833c-7ee7cd5d3f97 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] 10.222.0.61 "GET /compute/v2.1/servers/336a246f-7f3e-4073-b8bc-c35be2fa56a4" status: 200 len: 1275 microversion: 2.1 time: 0.825397 Aug 31 16:17:44.668738 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2304/4589] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:43 2022] GET /compute/v2.1/servers/336a246f-7f3e-4073-b8bc-c35be2fa56a4 => generated 1275 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:44.688807 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-011f07a2-bce5-4f17-b885-2190c72229d7 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:44.689829 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-011f07a2-bce5-4f17-b885-2190c72229d7 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] [instance: d2d88bec-63be-4b0c-8497-e34d1bbb790f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:44.710282 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:17:44.716833 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-011f07a2-bce5-4f17-b885-2190c72229d7 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:44.718111 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-011f07a2-bce5-4f17-b885-2190c72229d7 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:44.718993 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-011f07a2-bce5-4f17-b885-2190c72229d7 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:44.720717 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-011f07a2-bce5-4f17-b885-2190c72229d7 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:44.721722 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-011f07a2-bce5-4f17-b885-2190c72229d7 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:44.722799 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-011f07a2-bce5-4f17-b885-2190c72229d7 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:44.820254 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1ec95c0d-35d0-4942-bbb0-81ffb1a8b6e4 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb261f2061164b49a8d496b16647dd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d2222a956a4888967e21647e26b310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:44.830177 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1ec95c0d-35d0-4942-bbb0-81ffb1a8b6e4 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "GET /compute/v2.1/servers/265869f7-4238-4886-9dac-e22be12e3bc8" status: 200 len: 1508 microversion: 2.1 time: 1.715577 Aug 31 16:17:44.831396 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2286/4590] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:43 2022] GET /compute/v2.1/servers/265869f7-4238-4886-9dac-e22be12e3bc8 => generated 1508 bytes in 1723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:44.876072 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-798c348e-f088-43ef-8f2e-cab3d0081a96 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:44.876996 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-798c348e-f088-43ef-8f2e-cab3d0081a96 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: 265869f7-4238-4886-9dac-e22be12e3bc8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:44.900018 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-798c348e-f088-43ef-8f2e-cab3d0081a96 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:44.901148 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-798c348e-f088-43ef-8f2e-cab3d0081a96 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:44.906374 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-798c348e-f088-43ef-8f2e-cab3d0081a96 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:44.908160 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-798c348e-f088-43ef-8f2e-cab3d0081a96 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:44.909000 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-798c348e-f088-43ef-8f2e-cab3d0081a96 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:44.909733 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-798c348e-f088-43ef-8f2e-cab3d0081a96 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:45.076838 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-011f07a2-bce5-4f17-b885-2190c72229d7 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07ab61302b87448b84838a1be274b445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7ab6f24815407880276db1a6d76d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:45.102966 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-011f07a2-bce5-4f17-b885-2190c72229d7 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07ab61302b87448b84838a1be274b445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7ab6f24815407880276db1a6d76d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:45.109892 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-011f07a2-bce5-4f17-b885-2190c72229d7 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07ab61302b87448b84838a1be274b445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7ab6f24815407880276db1a6d76d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:45.119484 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-011f07a2-bce5-4f17-b885-2190c72229d7 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] 10.222.0.61 "GET /compute/v2.1/servers/d2d88bec-63be-4b0c-8497-e34d1bbb790f" status: 200 len: 1409 microversion: 2.54 time: 0.451235 Aug 31 16:17:45.122027 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2305/4591] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:17:44 2022] GET /compute/v2.1/servers/d2d88bec-63be-4b0c-8497-e34d1bbb790f => generated 1409 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:17:45.479197 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-798c348e-f088-43ef-8f2e-cab3d0081a96 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb261f2061164b49a8d496b16647dd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d2222a956a4888967e21647e26b310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:45.504141 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-798c348e-f088-43ef-8f2e-cab3d0081a96 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "GET /compute/v2.1/servers/265869f7-4238-4886-9dac-e22be12e3bc8" status: 200 len: 1508 microversion: 2.1 time: 0.632933 Aug 31 16:17:45.514690 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2287/4592] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:44 2022] GET /compute/v2.1/servers/265869f7-4238-4886-9dac-e22be12e3bc8 => generated 1508 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:45.534626 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7aead3a2-0f33-441f-a9a2-01cd9b932618 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:17:45.545357 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7aead3a2-0f33-441f-a9a2-01cd9b932618 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: 265869f7-4238-4886-9dac-e22be12e3bc8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:45.590489 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7aead3a2-0f33-441f-a9a2-01cd9b932618 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:45.592419 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7aead3a2-0f33-441f-a9a2-01cd9b932618 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:45.593553 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7aead3a2-0f33-441f-a9a2-01cd9b932618 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:45.598783 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7aead3a2-0f33-441f-a9a2-01cd9b932618 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:45.600602 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7aead3a2-0f33-441f-a9a2-01cd9b932618 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:45.601619 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7aead3a2-0f33-441f-a9a2-01cd9b932618 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:45.698655 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2257af9a-17ac-4601-9f43-b2726e0f8a0f tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:45.700020 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2257af9a-17ac-4601-9f43-b2726e0f8a0f tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] [instance: 336a246f-7f3e-4073-b8bc-c35be2fa56a4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:45.746459 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2257af9a-17ac-4601-9f43-b2726e0f8a0f tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:45.751570 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2257af9a-17ac-4601-9f43-b2726e0f8a0f tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:45.753845 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2257af9a-17ac-4601-9f43-b2726e0f8a0f tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:45.770545 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2257af9a-17ac-4601-9f43-b2726e0f8a0f tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:45.782144 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2257af9a-17ac-4601-9f43-b2726e0f8a0f tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:45.783042 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2257af9a-17ac-4601-9f43-b2726e0f8a0f tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:45.847356 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7aead3a2-0f33-441f-a9a2-01cd9b932618 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "PUT /compute/v2.1/servers/265869f7-4238-4886-9dac-e22be12e3bc8" status: 200 len: 1080 microversion: 2.1 time: 0.319033 Aug 31 16:17:45.865993 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2306/4593] 10.222.0.61 () {60 vars in 1256 bytes} [Wed Aug 31 16:17:45 2022] PUT /compute/v2.1/servers/265869f7-4238-4886-9dac-e22be12e3bc8 => generated 1080 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:17:45.886292 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a17622a3-2ecf-4662-9a93-900b68ffbf52 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:45.887549 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a17622a3-2ecf-4662-9a93-900b68ffbf52 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: 265869f7-4238-4886-9dac-e22be12e3bc8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:45.910177 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a17622a3-2ecf-4662-9a93-900b68ffbf52 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:45.911403 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a17622a3-2ecf-4662-9a93-900b68ffbf52 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:45.913403 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a17622a3-2ecf-4662-9a93-900b68ffbf52 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:45.923582 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a17622a3-2ecf-4662-9a93-900b68ffbf52 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:45.924911 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a17622a3-2ecf-4662-9a93-900b68ffbf52 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:45.926359 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a17622a3-2ecf-4662-9a93-900b68ffbf52 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:46.009401 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-2257af9a-17ac-4601-9f43-b2726e0f8a0f tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8941ad0e6d4f9bab797d0f3a213c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2113ab47146243cb85d6d57bc608131a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:46.045198 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2257af9a-17ac-4601-9f43-b2726e0f8a0f tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] 10.222.0.61 "GET /compute/v2.1/servers/336a246f-7f3e-4073-b8bc-c35be2fa56a4" status: 200 len: 1275 microversion: 2.1 time: 0.364936 Aug 31 16:17:46.063243 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2288/4594] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:45 2022] GET /compute/v2.1/servers/336a246f-7f3e-4073-b8bc-c35be2fa56a4 => generated 1275 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:17:46.161630 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-75bc0689-c6b3-40f1-a333-4e30d1e6a449 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:46.162414 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-75bc0689-c6b3-40f1-a333-4e30d1e6a449 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] [instance: d2d88bec-63be-4b0c-8497-e34d1bbb790f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:46.188961 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-75bc0689-c6b3-40f1-a333-4e30d1e6a449 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:46.190153 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-75bc0689-c6b3-40f1-a333-4e30d1e6a449 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:46.191912 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-75bc0689-c6b3-40f1-a333-4e30d1e6a449 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:46.194759 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-75bc0689-c6b3-40f1-a333-4e30d1e6a449 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:46.197514 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-75bc0689-c6b3-40f1-a333-4e30d1e6a449 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:46.200674 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-75bc0689-c6b3-40f1-a333-4e30d1e6a449 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:46.415228 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-75bc0689-c6b3-40f1-a333-4e30d1e6a449 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07ab61302b87448b84838a1be274b445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7ab6f24815407880276db1a6d76d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:46.454953 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-75bc0689-c6b3-40f1-a333-4e30d1e6a449 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07ab61302b87448b84838a1be274b445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7ab6f24815407880276db1a6d76d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:46.456778 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-75bc0689-c6b3-40f1-a333-4e30d1e6a449 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07ab61302b87448b84838a1be274b445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7ab6f24815407880276db1a6d76d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:46.465760 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-75bc0689-c6b3-40f1-a333-4e30d1e6a449 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] 10.222.0.61 "GET /compute/v2.1/servers/d2d88bec-63be-4b0c-8497-e34d1bbb790f" status: 200 len: 1409 microversion: 2.54 time: 0.309029 Aug 31 16:17:46.466222 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a17622a3-2ecf-4662-9a93-900b68ffbf52 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb261f2061164b49a8d496b16647dd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d2222a956a4888967e21647e26b310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:46.467214 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2289/4595] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:17:46 2022] GET /compute/v2.1/servers/d2d88bec-63be-4b0c-8497-e34d1bbb790f => generated 1409 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:17:46.496262 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a17622a3-2ecf-4662-9a93-900b68ffbf52 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "GET /compute/v2.1/servers/265869f7-4238-4886-9dac-e22be12e3bc8" status: 200 len: 1506 microversion: 2.1 time: 0.616958 Aug 31 16:17:46.501276 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2307/4596] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:45 2022] GET /compute/v2.1/servers/265869f7-4238-4886-9dac-e22be12e3bc8 => generated 1506 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:17:46.536505 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-441c34ae-c07b-4857-861c-9f93b77444b0 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:46.537287 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-441c34ae-c07b-4857-861c-9f93b77444b0 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: 265869f7-4238-4886-9dac-e22be12e3bc8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:46.564447 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-441c34ae-c07b-4857-861c-9f93b77444b0 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:46.564964 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-441c34ae-c07b-4857-861c-9f93b77444b0 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:46.565446 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-441c34ae-c07b-4857-861c-9f93b77444b0 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:46.566475 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-441c34ae-c07b-4857-861c-9f93b77444b0 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:46.566723 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-441c34ae-c07b-4857-861c-9f93b77444b0 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:46.586541 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-441c34ae-c07b-4857-861c-9f93b77444b0 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:47.071111 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-44c7c557-5475-4054-b438-619c78b6b8ad tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:47.072029 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-44c7c557-5475-4054-b438-619c78b6b8ad tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] [instance: 336a246f-7f3e-4073-b8bc-c35be2fa56a4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:47.089622 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-441c34ae-c07b-4857-861c-9f93b77444b0 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb261f2061164b49a8d496b16647dd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d2222a956a4888967e21647e26b310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:47.096974 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-44c7c557-5475-4054-b438-619c78b6b8ad tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:47.097740 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-44c7c557-5475-4054-b438-619c78b6b8ad tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:47.098536 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-44c7c557-5475-4054-b438-619c78b6b8ad tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:47.099625 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-44c7c557-5475-4054-b438-619c78b6b8ad tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:47.100986 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-44c7c557-5475-4054-b438-619c78b6b8ad tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:47.101532 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-44c7c557-5475-4054-b438-619c78b6b8ad tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:47.104544 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-441c34ae-c07b-4857-861c-9f93b77444b0 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "GET /compute/v2.1/servers/265869f7-4238-4886-9dac-e22be12e3bc8" status: 200 len: 1506 microversion: 2.1 time: 0.577132 Aug 31 16:17:47.118711 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2290/4597] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:46 2022] GET /compute/v2.1/servers/265869f7-4238-4886-9dac-e22be12e3bc8 => generated 1506 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:47.154783 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-49d7b454-1536-48a8-be67-9b6b8ae1f71e tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:17:47.165290 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-49d7b454-1536-48a8-be67-9b6b8ae1f71e tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: 265869f7-4238-4886-9dac-e22be12e3bc8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:47.193539 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-49d7b454-1536-48a8-be67-9b6b8ae1f71e tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:47.196912 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-49d7b454-1536-48a8-be67-9b6b8ae1f71e tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:47.199069 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-49d7b454-1536-48a8-be67-9b6b8ae1f71e tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:47.204766 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-49d7b454-1536-48a8-be67-9b6b8ae1f71e tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:47.207230 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-49d7b454-1536-48a8-be67-9b6b8ae1f71e tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:47.210046 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-49d7b454-1536-48a8-be67-9b6b8ae1f71e tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:47.421819 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-49d7b454-1536-48a8-be67-9b6b8ae1f71e tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "PUT /compute/v2.1/servers/265869f7-4238-4886-9dac-e22be12e3bc8" status: 200 len: 1082 microversion: 2.1 time: 0.295871 Aug 31 16:17:47.423990 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2291/4598] 10.222.0.61 () {60 vars in 1256 bytes} [Wed Aug 31 16:17:47 2022] PUT /compute/v2.1/servers/265869f7-4238-4886-9dac-e22be12e3bc8 => generated 1082 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:47.441590 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-12646fb0-3cb9-4c93-853a-e413a2dda00f tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:47.442148 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-12646fb0-3cb9-4c93-853a-e413a2dda00f tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: 265869f7-4238-4886-9dac-e22be12e3bc8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:47.450945 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-12646fb0-3cb9-4c93-853a-e413a2dda00f tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:47.451729 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-12646fb0-3cb9-4c93-853a-e413a2dda00f tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:47.452400 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-12646fb0-3cb9-4c93-853a-e413a2dda00f tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:47.453327 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-12646fb0-3cb9-4c93-853a-e413a2dda00f tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:47.453952 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-12646fb0-3cb9-4c93-853a-e413a2dda00f tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:47.454604 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-12646fb0-3cb9-4c93-853a-e413a2dda00f tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:47.465211 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-44c7c557-5475-4054-b438-619c78b6b8ad tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8941ad0e6d4f9bab797d0f3a213c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2113ab47146243cb85d6d57bc608131a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:47.489934 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-44c7c557-5475-4054-b438-619c78b6b8ad tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] 10.222.0.61 "GET /compute/v2.1/servers/336a246f-7f3e-4073-b8bc-c35be2fa56a4" status: 200 len: 1317 microversion: 2.1 time: 0.423266 Aug 31 16:17:47.504446 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2308/4599] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:47 2022] GET /compute/v2.1/servers/336a246f-7f3e-4073-b8bc-c35be2fa56a4 => generated 1317 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:17:47.526583 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-266bd1a5-751b-40c0-a80e-bb22fd2839d2 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:47.533905 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-266bd1a5-751b-40c0-a80e-bb22fd2839d2 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] [instance: d2d88bec-63be-4b0c-8497-e34d1bbb790f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:47.546944 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-266bd1a5-751b-40c0-a80e-bb22fd2839d2 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:47.547646 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-266bd1a5-751b-40c0-a80e-bb22fd2839d2 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:47.548431 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-266bd1a5-751b-40c0-a80e-bb22fd2839d2 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:47.549414 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-266bd1a5-751b-40c0-a80e-bb22fd2839d2 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:47.550543 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-266bd1a5-751b-40c0-a80e-bb22fd2839d2 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:47.551189 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-266bd1a5-751b-40c0-a80e-bb22fd2839d2 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:47.558497 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:17:47.737332 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-266bd1a5-751b-40c0-a80e-bb22fd2839d2 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07ab61302b87448b84838a1be274b445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7ab6f24815407880276db1a6d76d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:47.774623 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-266bd1a5-751b-40c0-a80e-bb22fd2839d2 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07ab61302b87448b84838a1be274b445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7ab6f24815407880276db1a6d76d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:47.781201 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-266bd1a5-751b-40c0-a80e-bb22fd2839d2 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07ab61302b87448b84838a1be274b445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7ab6f24815407880276db1a6d76d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:47.787675 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-266bd1a5-751b-40c0-a80e-bb22fd2839d2 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] 10.222.0.61 "GET /compute/v2.1/servers/d2d88bec-63be-4b0c-8497-e34d1bbb790f" status: 200 len: 1409 microversion: 2.54 time: 0.280411 Aug 31 16:17:47.788648 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2309/4600] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:17:47 2022] GET /compute/v2.1/servers/d2d88bec-63be-4b0c-8497-e34d1bbb790f => generated 1409 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:17:47.806874 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-87b92323-a9d6-40a7-8947-bdec08f1accc tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:47.808064 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-87b92323-a9d6-40a7-8947-bdec08f1accc tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:47.827960 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-87b92323-a9d6-40a7-8947-bdec08f1accc tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:47.828776 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-87b92323-a9d6-40a7-8947-bdec08f1accc tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:47.829620 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-87b92323-a9d6-40a7-8947-bdec08f1accc tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:47.831480 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-87b92323-a9d6-40a7-8947-bdec08f1accc tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:47.834597 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-87b92323-a9d6-40a7-8947-bdec08f1accc tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:47.835387 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-87b92323-a9d6-40a7-8947-bdec08f1accc tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:47.991619 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-12646fb0-3cb9-4c93-853a-e413a2dda00f tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb261f2061164b49a8d496b16647dd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d2222a956a4888967e21647e26b310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:48.009537 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:17:48.020650 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-12646fb0-3cb9-4c93-853a-e413a2dda00f tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "GET /compute/v2.1/servers/265869f7-4238-4886-9dac-e22be12e3bc8" status: 200 len: 1508 microversion: 2.1 time: 0.582630 Aug 31 16:17:48.037654 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2292/4601] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:47 2022] GET /compute/v2.1/servers/265869f7-4238-4886-9dac-e22be12e3bc8 => generated 1508 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:48.049627 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6d93e87a-2eb2-44ed-8581-333788f1302f tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:48.050719 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6d93e87a-2eb2-44ed-8581-333788f1302f tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: 265869f7-4238-4886-9dac-e22be12e3bc8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:48.086347 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6d93e87a-2eb2-44ed-8581-333788f1302f tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:48.093008 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6d93e87a-2eb2-44ed-8581-333788f1302f tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:48.095984 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6d93e87a-2eb2-44ed-8581-333788f1302f tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:48.097665 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6d93e87a-2eb2-44ed-8581-333788f1302f tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:48.102251 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6d93e87a-2eb2-44ed-8581-333788f1302f tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:48.102947 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6d93e87a-2eb2-44ed-8581-333788f1302f tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:48.461247 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-87b92323-a9d6-40a7-8947-bdec08f1accc tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:48.480754 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-87b92323-a9d6-40a7-8947-bdec08f1accc tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1668 microversion: 2.1 time: 0.689835 Aug 31 16:17:48.482190 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2310/4602] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:47 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1668 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:48.518113 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7aab5d02-f0cb-4ddc-a1af-716701ae9124 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-355798276"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:17:48.523317 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7aab5d02-f0cb-4ddc-a1af-716701ae9124 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:48.532719 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7aab5d02-f0cb-4ddc-a1af-716701ae9124 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:48.533758 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7aab5d02-f0cb-4ddc-a1af-716701ae9124 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:48.534301 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7aab5d02-f0cb-4ddc-a1af-716701ae9124 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:48.536578 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7aab5d02-f0cb-4ddc-a1af-716701ae9124 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:48.537190 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7aab5d02-f0cb-4ddc-a1af-716701ae9124 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:48.538232 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7aab5d02-f0cb-4ddc-a1af-716701ae9124 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:48.613841 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-6d93e87a-2eb2-44ed-8581-333788f1302f tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb261f2061164b49a8d496b16647dd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d2222a956a4888967e21647e26b310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:48.641917 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6d93e87a-2eb2-44ed-8581-333788f1302f tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "GET /compute/v2.1/servers/265869f7-4238-4886-9dac-e22be12e3bc8" status: 200 len: 1508 microversion: 2.1 time: 0.600609 Aug 31 16:17:48.648472 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2293/4603] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:48 2022] GET /compute/v2.1/servers/265869f7-4238-4886-9dac-e22be12e3bc8 => generated 1508 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:48.663401 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a77bee24-378c-4e36-8558-0c7606ab2c23 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:48.664530 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a77bee24-378c-4e36-8558-0c7606ab2c23 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] [instance: 336a246f-7f3e-4073-b8bc-c35be2fa56a4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:48.681287 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a77bee24-378c-4e36-8558-0c7606ab2c23 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:48.682509 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a77bee24-378c-4e36-8558-0c7606ab2c23 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:48.683523 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a77bee24-378c-4e36-8558-0c7606ab2c23 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:48.685413 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a77bee24-378c-4e36-8558-0c7606ab2c23 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:48.687157 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a77bee24-378c-4e36-8558-0c7606ab2c23 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:48.688411 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a77bee24-378c-4e36-8558-0c7606ab2c23 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:48.965278 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7aab5d02-f0cb-4ddc-a1af-716701ae9124 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "POST /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c/action" status: 202 len: 0 microversion: 2.1 time: 0.452920 Aug 31 16:17:48.972787 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2311/4604] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:17:48 2022] POST /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c/action => generated 0 bytes in 456 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 31 16:17:48.977057 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c51c75bb-0d32-4e68-a4e0-03b6d6d9fabf tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:48.978082 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c51c75bb-0d32-4e68-a4e0-03b6d6d9fabf tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: 265869f7-4238-4886-9dac-e22be12e3bc8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:48.991593 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c51c75bb-0d32-4e68-a4e0-03b6d6d9fabf tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:48.992761 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c51c75bb-0d32-4e68-a4e0-03b6d6d9fabf tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:48.993359 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c51c75bb-0d32-4e68-a4e0-03b6d6d9fabf tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:48.994287 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c51c75bb-0d32-4e68-a4e0-03b6d6d9fabf tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:48.995311 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c51c75bb-0d32-4e68-a4e0-03b6d6d9fabf tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:48.995940 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c51c75bb-0d32-4e68-a4e0-03b6d6d9fabf tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:49.042841 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c51c75bb-0d32-4e68-a4e0-03b6d6d9fabf tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: 265869f7-4238-4886-9dac-e22be12e3bc8] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:17:49.048752 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a77bee24-378c-4e36-8558-0c7606ab2c23 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8941ad0e6d4f9bab797d0f3a213c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2113ab47146243cb85d6d57bc608131a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:49.066187 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a77bee24-378c-4e36-8558-0c7606ab2c23 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] 10.222.0.61 "GET /compute/v2.1/servers/336a246f-7f3e-4073-b8bc-c35be2fa56a4" status: 200 len: 1317 microversion: 2.1 time: 0.414187 Aug 31 16:17:49.067733 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2294/4605] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:48 2022] GET /compute/v2.1/servers/336a246f-7f3e-4073-b8bc-c35be2fa56a4 => generated 1317 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:49.085097 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-53390b57-dc63-40da-a8ff-1eb15609ed81 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:49.086081 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-53390b57-dc63-40da-a8ff-1eb15609ed81 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] [instance: d2d88bec-63be-4b0c-8497-e34d1bbb790f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:49.099842 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-53390b57-dc63-40da-a8ff-1eb15609ed81 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:49.101186 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-53390b57-dc63-40da-a8ff-1eb15609ed81 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:49.101710 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-53390b57-dc63-40da-a8ff-1eb15609ed81 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:49.102534 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-53390b57-dc63-40da-a8ff-1eb15609ed81 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:49.108258 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-53390b57-dc63-40da-a8ff-1eb15609ed81 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:49.108887 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-53390b57-dc63-40da-a8ff-1eb15609ed81 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:49.229626 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-53390b57-dc63-40da-a8ff-1eb15609ed81 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07ab61302b87448b84838a1be274b445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7ab6f24815407880276db1a6d76d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:49.246328 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c51c75bb-0d32-4e68-a4e0-03b6d6d9fabf tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "DELETE /compute/v2.1/servers/265869f7-4238-4886-9dac-e22be12e3bc8" status: 204 len: 0 microversion: 2.1 time: 0.277065 Aug 31 16:17:49.258232 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2312/4606] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:17:48 2022] DELETE /compute/v2.1/servers/265869f7-4238-4886-9dac-e22be12e3bc8 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:17:49.267097 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f1a64474-894b-442a-8393-d8621a595853 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:49.268822 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f1a64474-894b-442a-8393-d8621a595853 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: 265869f7-4238-4886-9dac-e22be12e3bc8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:49.274633 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-53390b57-dc63-40da-a8ff-1eb15609ed81 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07ab61302b87448b84838a1be274b445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7ab6f24815407880276db1a6d76d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:49.284747 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f1a64474-894b-442a-8393-d8621a595853 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:49.284747 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f1a64474-894b-442a-8393-d8621a595853 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:49.284747 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f1a64474-894b-442a-8393-d8621a595853 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:49.285127 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-53390b57-dc63-40da-a8ff-1eb15609ed81 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07ab61302b87448b84838a1be274b445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7ab6f24815407880276db1a6d76d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:49.285269 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f1a64474-894b-442a-8393-d8621a595853 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:49.285411 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f1a64474-894b-442a-8393-d8621a595853 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:49.286211 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f1a64474-894b-442a-8393-d8621a595853 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:49.290471 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-53390b57-dc63-40da-a8ff-1eb15609ed81 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] 10.222.0.61 "GET /compute/v2.1/servers/d2d88bec-63be-4b0c-8497-e34d1bbb790f" status: 200 len: 1409 microversion: 2.54 time: 0.219475 Aug 31 16:17:49.295601 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2295/4607] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:17:49 2022] GET /compute/v2.1/servers/d2d88bec-63be-4b0c-8497-e34d1bbb790f => generated 1409 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:17:49.318674 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-523ca69b-38fc-4d48-a7b4-c5eb83d529fb req-3af8f1ed-7aa0-44cf-b450-46f355a7a4a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "336a246f-7f3e-4073-b8bc-c35be2fa56a4", "tag": "f2c2b358-fae2-4e68-b84d-93afa20b9c7d"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:17:49.347711 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f1a64474-894b-442a-8393-d8621a595853 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: 265869f7-4238-4886-9dac-e22be12e3bc8] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:17:49.360309 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-523ca69b-38fc-4d48-a7b4-c5eb83d529fb req-3af8f1ed-7aa0-44cf-b450-46f355a7a4a4 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:49.365168 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-523ca69b-38fc-4d48-a7b4-c5eb83d529fb req-3af8f1ed-7aa0-44cf-b450-46f355a7a4a4 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:49.365701 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-523ca69b-38fc-4d48-a7b4-c5eb83d529fb req-3af8f1ed-7aa0-44cf-b450-46f355a7a4a4 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:49.392828 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-523ca69b-38fc-4d48-a7b4-c5eb83d529fb req-3af8f1ed-7aa0-44cf-b450-46f355a7a4a4 service nova] Creating event network-changed:f2c2b358-fae2-4e68-b84d-93afa20b9c7d for instance 336a246f-7f3e-4073-b8bc-c35be2fa56a4 on n-h2-850499-9 Aug 31 16:17:49.408708 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-523ca69b-38fc-4d48-a7b4-c5eb83d529fb req-3af8f1ed-7aa0-44cf-b450-46f355a7a4a4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102906 Aug 31 16:17:49.410591 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2296/4608] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:17:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:17:49.455607 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.compute.api [None req-f1a64474-894b-442a-8393-d8621a595853 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: 265869f7-4238-4886-9dac-e22be12e3bc8] Instance is already in deleting state, ignoring this request Aug 31 16:17:49.457016 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f1a64474-894b-442a-8393-d8621a595853 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "DELETE /compute/v2.1/servers/265869f7-4238-4886-9dac-e22be12e3bc8" status: 204 len: 0 microversion: 2.1 time: 0.196741 Aug 31 16:17:49.460210 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2313/4609] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:17:49 2022] DELETE /compute/v2.1/servers/265869f7-4238-4886-9dac-e22be12e3bc8 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:17:49.472322 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-dea45140-7f05-4dee-bed9-943a0e55f6ea tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:49.473948 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-dea45140-7f05-4dee-bed9-943a0e55f6ea tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: 265869f7-4238-4886-9dac-e22be12e3bc8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:49.481995 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dea45140-7f05-4dee-bed9-943a0e55f6ea tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:49.483468 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dea45140-7f05-4dee-bed9-943a0e55f6ea tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:49.484219 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dea45140-7f05-4dee-bed9-943a0e55f6ea tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:49.485795 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dea45140-7f05-4dee-bed9-943a0e55f6ea tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:49.486776 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dea45140-7f05-4dee-bed9-943a0e55f6ea tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:49.487413 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dea45140-7f05-4dee-bed9-943a0e55f6ea tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:49.848310 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-dea45140-7f05-4dee-bed9-943a0e55f6ea tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb261f2061164b49a8d496b16647dd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d2222a956a4888967e21647e26b310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:49.860909 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-dea45140-7f05-4dee-bed9-943a0e55f6ea tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "GET /compute/v2.1/servers/265869f7-4238-4886-9dac-e22be12e3bc8" status: 200 len: 1514 microversion: 2.1 time: 0.393663 Aug 31 16:17:49.861502 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2297/4610] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:49 2022] GET /compute/v2.1/servers/265869f7-4238-4886-9dac-e22be12e3bc8 => generated 1514 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:49.874910 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ac503cf4-3651-4b81-be5f-84206b99db04 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:49.877240 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ac503cf4-3651-4b81-be5f-84206b99db04 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] [instance: f04eb48d-000e-4c3b-8799-a4d3cdacf0e2] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:49.887065 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ac503cf4-3651-4b81-be5f-84206b99db04 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:49.889436 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ac503cf4-3651-4b81-be5f-84206b99db04 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:49.890927 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ac503cf4-3651-4b81-be5f-84206b99db04 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:49.892080 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ac503cf4-3651-4b81-be5f-84206b99db04 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:49.893620 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ac503cf4-3651-4b81-be5f-84206b99db04 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:49.898674 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ac503cf4-3651-4b81-be5f-84206b99db04 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:49.945698 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ac503cf4-3651-4b81-be5f-84206b99db04 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] 10.222.0.61 "GET /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.075709 Aug 31 16:17:49.946945 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2314/4611] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 16:17:49 2022] GET /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2/os-volume_attachments => generated 25 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 31 16:17:50.076917 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f123b029-eb48-4d77-9427-e27dd3d8f143 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:50.077994 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f123b029-eb48-4d77-9427-e27dd3d8f143 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] [instance: f04eb48d-000e-4c3b-8799-a4d3cdacf0e2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:50.080532 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:17:50.091766 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9dcab771-564e-41e8-91af-7f9e85926171 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:50.092671 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9dcab771-564e-41e8-91af-7f9e85926171 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] [instance: 336a246f-7f3e-4073-b8bc-c35be2fa56a4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:50.107973 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f123b029-eb48-4d77-9427-e27dd3d8f143 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:50.108886 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f123b029-eb48-4d77-9427-e27dd3d8f143 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:50.109637 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f123b029-eb48-4d77-9427-e27dd3d8f143 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:50.111129 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f123b029-eb48-4d77-9427-e27dd3d8f143 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:50.123526 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9dcab771-564e-41e8-91af-7f9e85926171 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:50.124414 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9dcab771-564e-41e8-91af-7f9e85926171 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:50.125178 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9dcab771-564e-41e8-91af-7f9e85926171 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:50.126515 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9dcab771-564e-41e8-91af-7f9e85926171 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:50.128721 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f123b029-eb48-4d77-9427-e27dd3d8f143 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:50.129411 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f123b029-eb48-4d77-9427-e27dd3d8f143 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:50.134608 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9dcab771-564e-41e8-91af-7f9e85926171 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:50.140024 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9dcab771-564e-41e8-91af-7f9e85926171 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:50.234850 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f123b029-eb48-4d77-9427-e27dd3d8f143 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] [instance: f04eb48d-000e-4c3b-8799-a4d3cdacf0e2] Going to try to terminate instance {{(pid=122256) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:17:50.400473 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f123b029-eb48-4d77-9427-e27dd3d8f143 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] 10.222.0.61 "DELETE /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2" status: 204 len: 0 microversion: 2.1 time: 0.327098 Aug 31 16:17:50.407581 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2298/4612] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:17:50 2022] DELETE /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 16:17:50.427181 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d18bd1cc-7e0e-4c3b-a065-a5f239cedb6f tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:50.432158 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d18bd1cc-7e0e-4c3b-a065-a5f239cedb6f tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] [instance: d2d88bec-63be-4b0c-8497-e34d1bbb790f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:50.463364 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d18bd1cc-7e0e-4c3b-a065-a5f239cedb6f tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:50.464270 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d18bd1cc-7e0e-4c3b-a065-a5f239cedb6f tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:50.465316 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d18bd1cc-7e0e-4c3b-a065-a5f239cedb6f tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:50.468430 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d18bd1cc-7e0e-4c3b-a065-a5f239cedb6f tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:50.470118 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d18bd1cc-7e0e-4c3b-a065-a5f239cedb6f tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:50.471170 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d18bd1cc-7e0e-4c3b-a065-a5f239cedb6f tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:50.682961 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d18bd1cc-7e0e-4c3b-a065-a5f239cedb6f tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07ab61302b87448b84838a1be274b445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7ab6f24815407880276db1a6d76d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:50.703519 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d18bd1cc-7e0e-4c3b-a065-a5f239cedb6f tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07ab61302b87448b84838a1be274b445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7ab6f24815407880276db1a6d76d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:50.705705 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d18bd1cc-7e0e-4c3b-a065-a5f239cedb6f tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07ab61302b87448b84838a1be274b445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7ab6f24815407880276db1a6d76d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:50.707164 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d18bd1cc-7e0e-4c3b-a065-a5f239cedb6f tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] 10.222.0.61 "GET /compute/v2.1/servers/d2d88bec-63be-4b0c-8497-e34d1bbb790f" status: 200 len: 1409 microversion: 2.54 time: 0.303399 Aug 31 16:17:50.715610 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2299/4613] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:17:50 2022] GET /compute/v2.1/servers/d2d88bec-63be-4b0c-8497-e34d1bbb790f => generated 1409 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:17:50.738520 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7459d2a4-b04c-43c5-9b54-381a24c33926 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:50.743161 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7459d2a4-b04c-43c5-9b54-381a24c33926 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] [instance: f04eb48d-000e-4c3b-8799-a4d3cdacf0e2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:50.763989 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7459d2a4-b04c-43c5-9b54-381a24c33926 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:50.768572 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7459d2a4-b04c-43c5-9b54-381a24c33926 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:50.770553 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7459d2a4-b04c-43c5-9b54-381a24c33926 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:50.782027 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7459d2a4-b04c-43c5-9b54-381a24c33926 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:50.783519 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7459d2a4-b04c-43c5-9b54-381a24c33926 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:50.786065 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7459d2a4-b04c-43c5-9b54-381a24c33926 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:50.822974 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9dcab771-564e-41e8-91af-7f9e85926171 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8941ad0e6d4f9bab797d0f3a213c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2113ab47146243cb85d6d57bc608131a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:50.836283 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9dcab771-564e-41e8-91af-7f9e85926171 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] 10.222.0.61 "GET /compute/v2.1/servers/336a246f-7f3e-4073-b8bc-c35be2fa56a4" status: 200 len: 1317 microversion: 2.1 time: 0.746455 Aug 31 16:17:50.837530 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2315/4614] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:50 2022] GET /compute/v2.1/servers/336a246f-7f3e-4073-b8bc-c35be2fa56a4 => generated 1317 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:17:50.888353 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c905f7f1-e054-4494-ba70-881346c6e95e tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:50.889884 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c905f7f1-e054-4494-ba70-881346c6e95e tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: 265869f7-4238-4886-9dac-e22be12e3bc8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:50.904680 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c905f7f1-e054-4494-ba70-881346c6e95e tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:50.907399 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c905f7f1-e054-4494-ba70-881346c6e95e tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:50.908701 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c905f7f1-e054-4494-ba70-881346c6e95e tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:50.910539 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c905f7f1-e054-4494-ba70-881346c6e95e tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:50.911608 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c905f7f1-e054-4494-ba70-881346c6e95e tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:50.912733 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c905f7f1-e054-4494-ba70-881346c6e95e tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:51.323669 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7459d2a4-b04c-43c5-9b54-381a24c33926 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed06378eb9b446680b5a3156a14941d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511432a7dee4bec9d1093c9d95b3734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:51.389041 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7459d2a4-b04c-43c5-9b54-381a24c33926 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] 10.222.0.61 "GET /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2" status: 200 len: 1672 microversion: 2.1 time: 0.671175 Aug 31 16:17:51.390688 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2300/4615] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:50 2022] GET /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2 => generated 1672 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:51.433756 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-cfdf6d05-3d1d-41ce-b43c-9cd1959a111b req-2ff425c2-ade0-434f-8e13-e4d5543faedc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42ccbb85-9677-4cb9-879a-dc280cda020c", "name": "network-vif-unplugged", "status": "completed", "tag": "44b19fab-a1b0-47af-8c78-4bab130a016b"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:17:51.498340 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-cfdf6d05-3d1d-41ce-b43c-9cd1959a111b req-2ff425c2-ade0-434f-8e13-e4d5543faedc service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:51.498476 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-cfdf6d05-3d1d-41ce-b43c-9cd1959a111b req-2ff425c2-ade0-434f-8e13-e4d5543faedc service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:51.502764 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-cfdf6d05-3d1d-41ce-b43c-9cd1959a111b req-2ff425c2-ade0-434f-8e13-e4d5543faedc service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:51.519925 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=8 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:17:51.562141 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-cfdf6d05-3d1d-41ce-b43c-9cd1959a111b req-2ff425c2-ade0-434f-8e13-e4d5543faedc service nova] Creating event network-vif-unplugged:44b19fab-a1b0-47af-8c78-4bab130a016b for instance 42ccbb85-9677-4cb9-879a-dc280cda020c on n-h2-850499-9 Aug 31 16:17:51.570015 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-cfdf6d05-3d1d-41ce-b43c-9cd1959a111b req-2ff425c2-ade0-434f-8e13-e4d5543faedc service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.176108 Aug 31 16:17:51.571133 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2301/4616] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:17:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:17:51.658821 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c905f7f1-e054-4494-ba70-881346c6e95e tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb261f2061164b49a8d496b16647dd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d2222a956a4888967e21647e26b310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:51.676403 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c905f7f1-e054-4494-ba70-881346c6e95e tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "GET /compute/v2.1/servers/265869f7-4238-4886-9dac-e22be12e3bc8" status: 200 len: 1514 microversion: 2.1 time: 0.793460 Aug 31 16:17:51.677868 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2316/4617] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:50 2022] GET /compute/v2.1/servers/265869f7-4238-4886-9dac-e22be12e3bc8 => generated 1514 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:17:51.755856 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b1339547-3272-46eb-b265-6ceeee64fc43 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:51.756538 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b1339547-3272-46eb-b265-6ceeee64fc43 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] [instance: d2d88bec-63be-4b0c-8497-e34d1bbb790f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:51.770703 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b1339547-3272-46eb-b265-6ceeee64fc43 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:51.778939 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b1339547-3272-46eb-b265-6ceeee64fc43 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:51.783633 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b1339547-3272-46eb-b265-6ceeee64fc43 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:51.785919 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b1339547-3272-46eb-b265-6ceeee64fc43 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:51.788507 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b1339547-3272-46eb-b265-6ceeee64fc43 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:51.790192 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b1339547-3272-46eb-b265-6ceeee64fc43 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:51.881675 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a92a9ef2-78bf-468a-abef-72108d698fa2 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:51.886327 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a92a9ef2-78bf-468a-abef-72108d698fa2 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] [instance: 336a246f-7f3e-4073-b8bc-c35be2fa56a4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:51.916502 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a92a9ef2-78bf-468a-abef-72108d698fa2 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:51.919900 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a92a9ef2-78bf-468a-abef-72108d698fa2 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:51.921033 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a92a9ef2-78bf-468a-abef-72108d698fa2 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:51.924006 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a92a9ef2-78bf-468a-abef-72108d698fa2 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:51.930646 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a92a9ef2-78bf-468a-abef-72108d698fa2 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:51.931575 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a92a9ef2-78bf-468a-abef-72108d698fa2 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:51.985441 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b1339547-3272-46eb-b265-6ceeee64fc43 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07ab61302b87448b84838a1be274b445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7ab6f24815407880276db1a6d76d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:52.012345 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b1339547-3272-46eb-b265-6ceeee64fc43 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07ab61302b87448b84838a1be274b445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7ab6f24815407880276db1a6d76d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:52.018376 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b1339547-3272-46eb-b265-6ceeee64fc43 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07ab61302b87448b84838a1be274b445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7ab6f24815407880276db1a6d76d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:52.022827 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b1339547-3272-46eb-b265-6ceeee64fc43 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] 10.222.0.61 "GET /compute/v2.1/servers/d2d88bec-63be-4b0c-8497-e34d1bbb790f" status: 200 len: 1409 microversion: 2.54 time: 0.269560 Aug 31 16:17:52.024130 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2302/4618] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:17:51 2022] GET /compute/v2.1/servers/d2d88bec-63be-4b0c-8497-e34d1bbb790f => generated 1409 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:17:52.298189 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a92a9ef2-78bf-468a-abef-72108d698fa2 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8941ad0e6d4f9bab797d0f3a213c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2113ab47146243cb85d6d57bc608131a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:52.321731 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a92a9ef2-78bf-468a-abef-72108d698fa2 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] 10.222.0.61 "GET /compute/v2.1/servers/336a246f-7f3e-4073-b8bc-c35be2fa56a4" status: 200 len: 1317 microversion: 2.1 time: 0.451945 Aug 31 16:17:52.324160 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2317/4619] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:51 2022] GET /compute/v2.1/servers/336a246f-7f3e-4073-b8bc-c35be2fa56a4 => generated 1317 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:52.424224 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-85ffba54-134d-49df-9c32-558c85aca21a tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:52.426491 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-85ffba54-134d-49df-9c32-558c85aca21a tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] [instance: f04eb48d-000e-4c3b-8799-a4d3cdacf0e2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:52.451088 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-85ffba54-134d-49df-9c32-558c85aca21a tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:52.451630 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-85ffba54-134d-49df-9c32-558c85aca21a tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:52.452298 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-85ffba54-134d-49df-9c32-558c85aca21a tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:52.463805 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-85ffba54-134d-49df-9c32-558c85aca21a tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:52.465064 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-85ffba54-134d-49df-9c32-558c85aca21a tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:52.465600 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-85ffba54-134d-49df-9c32-558c85aca21a tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:52.722130 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c38ad7e8-62c7-414e-a986-dc5d992be2e1 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:52.727319 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c38ad7e8-62c7-414e-a986-dc5d992be2e1 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: 265869f7-4238-4886-9dac-e22be12e3bc8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:52.757219 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c38ad7e8-62c7-414e-a986-dc5d992be2e1 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:52.758029 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c38ad7e8-62c7-414e-a986-dc5d992be2e1 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:52.758650 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c38ad7e8-62c7-414e-a986-dc5d992be2e1 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:52.764780 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c38ad7e8-62c7-414e-a986-dc5d992be2e1 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:52.765462 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c38ad7e8-62c7-414e-a986-dc5d992be2e1 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:52.766368 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c38ad7e8-62c7-414e-a986-dc5d992be2e1 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:52.987016 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-85ffba54-134d-49df-9c32-558c85aca21a tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed06378eb9b446680b5a3156a14941d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511432a7dee4bec9d1093c9d95b3734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:53.007157 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-85ffba54-134d-49df-9c32-558c85aca21a tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] 10.222.0.61 "GET /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2" status: 200 len: 1672 microversion: 2.1 time: 0.594653 Aug 31 16:17:53.009577 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2303/4620] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:52 2022] GET /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2 => generated 1672 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:53.088717 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-335d0f3e-8551-4f30-94bc-45891201f25c tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:53.091748 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-335d0f3e-8551-4f30-94bc-45891201f25c tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] [instance: d2d88bec-63be-4b0c-8497-e34d1bbb790f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:53.116759 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-335d0f3e-8551-4f30-94bc-45891201f25c tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:53.118009 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-335d0f3e-8551-4f30-94bc-45891201f25c tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:53.119001 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-335d0f3e-8551-4f30-94bc-45891201f25c tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:53.120475 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-335d0f3e-8551-4f30-94bc-45891201f25c tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:53.121500 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-335d0f3e-8551-4f30-94bc-45891201f25c tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:53.123074 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-335d0f3e-8551-4f30-94bc-45891201f25c tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:53.426439 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c38ad7e8-62c7-414e-a986-dc5d992be2e1 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb261f2061164b49a8d496b16647dd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d2222a956a4888967e21647e26b310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:53.476436 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-335d0f3e-8551-4f30-94bc-45891201f25c tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07ab61302b87448b84838a1be274b445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7ab6f24815407880276db1a6d76d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:53.495805 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c38ad7e8-62c7-414e-a986-dc5d992be2e1 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "GET /compute/v2.1/servers/265869f7-4238-4886-9dac-e22be12e3bc8" status: 200 len: 1514 microversion: 2.1 time: 0.780340 Aug 31 16:17:53.499697 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2318/4621] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:52 2022] GET /compute/v2.1/servers/265869f7-4238-4886-9dac-e22be12e3bc8 => generated 1514 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:17:53.547596 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-335d0f3e-8551-4f30-94bc-45891201f25c tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07ab61302b87448b84838a1be274b445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7ab6f24815407880276db1a6d76d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:53.550416 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-49e31fa3-3592-4ef5-83e9-2b04f6353b5f tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:53.551333 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-335d0f3e-8551-4f30-94bc-45891201f25c tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07ab61302b87448b84838a1be274b445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7ab6f24815407880276db1a6d76d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:53.552216 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-49e31fa3-3592-4ef5-83e9-2b04f6353b5f tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] [instance: 336a246f-7f3e-4073-b8bc-c35be2fa56a4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:53.553817 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-335d0f3e-8551-4f30-94bc-45891201f25c tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] 10.222.0.61 "GET /compute/v2.1/servers/d2d88bec-63be-4b0c-8497-e34d1bbb790f" status: 200 len: 1409 microversion: 2.54 time: 0.474426 Aug 31 16:17:53.567847 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2304/4622] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:17:53 2022] GET /compute/v2.1/servers/d2d88bec-63be-4b0c-8497-e34d1bbb790f => generated 1409 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:17:53.568051 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-49e31fa3-3592-4ef5-83e9-2b04f6353b5f tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:53.568051 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-49e31fa3-3592-4ef5-83e9-2b04f6353b5f tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:53.568051 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-49e31fa3-3592-4ef5-83e9-2b04f6353b5f tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:53.568761 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-49e31fa3-3592-4ef5-83e9-2b04f6353b5f tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:53.570043 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-49e31fa3-3592-4ef5-83e9-2b04f6353b5f tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:53.571051 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-49e31fa3-3592-4ef5-83e9-2b04f6353b5f tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:53.939164 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-49e31fa3-3592-4ef5-83e9-2b04f6353b5f tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8941ad0e6d4f9bab797d0f3a213c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2113ab47146243cb85d6d57bc608131a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:53.970623 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-49e31fa3-3592-4ef5-83e9-2b04f6353b5f tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] 10.222.0.61 "GET /compute/v2.1/servers/336a246f-7f3e-4073-b8bc-c35be2fa56a4" status: 200 len: 1317 microversion: 2.1 time: 0.431098 Aug 31 16:17:53.972328 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2319/4623] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:53 2022] GET /compute/v2.1/servers/336a246f-7f3e-4073-b8bc-c35be2fa56a4 => generated 1317 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:54.056487 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-618cfddc-6268-4b2c-abcc-fd11a7b8868f tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:54.060952 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-618cfddc-6268-4b2c-abcc-fd11a7b8868f tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] [instance: f04eb48d-000e-4c3b-8799-a4d3cdacf0e2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:54.085759 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-618cfddc-6268-4b2c-abcc-fd11a7b8868f tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:54.086891 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-618cfddc-6268-4b2c-abcc-fd11a7b8868f tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:54.088034 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-618cfddc-6268-4b2c-abcc-fd11a7b8868f tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:54.089598 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-618cfddc-6268-4b2c-abcc-fd11a7b8868f tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:54.090456 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-618cfddc-6268-4b2c-abcc-fd11a7b8868f tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:54.091809 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-618cfddc-6268-4b2c-abcc-fd11a7b8868f tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:54.550753 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3b9e6f45-c0e9-413a-b7f6-0a580904ee9a tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:54.551315 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3b9e6f45-c0e9-413a-b7f6-0a580904ee9a tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: 265869f7-4238-4886-9dac-e22be12e3bc8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:54.585870 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3b9e6f45-c0e9-413a-b7f6-0a580904ee9a tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:54.586621 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3b9e6f45-c0e9-413a-b7f6-0a580904ee9a tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:54.596321 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3b9e6f45-c0e9-413a-b7f6-0a580904ee9a tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:54.598173 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3b9e6f45-c0e9-413a-b7f6-0a580904ee9a tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:54.598992 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3b9e6f45-c0e9-413a-b7f6-0a580904ee9a tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:54.600762 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3b9e6f45-c0e9-413a-b7f6-0a580904ee9a tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:54.762325 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-618cfddc-6268-4b2c-abcc-fd11a7b8868f tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed06378eb9b446680b5a3156a14941d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511432a7dee4bec9d1093c9d95b3734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:54.833357 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-618cfddc-6268-4b2c-abcc-fd11a7b8868f tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] 10.222.0.61 "GET /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2" status: 200 len: 1672 microversion: 2.1 time: 0.778848 Aug 31 16:17:54.838640 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3b9e6f45-c0e9-413a-b7f6-0a580904ee9a tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb261f2061164b49a8d496b16647dd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62d2222a956a4888967e21647e26b310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:54.858075 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2305/4624] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:54 2022] GET /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2 => generated 1672 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:54.886319 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3b9e6f45-c0e9-413a-b7f6-0a580904ee9a tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "GET /compute/v2.1/servers/265869f7-4238-4886-9dac-e22be12e3bc8" status: 200 len: 1472 microversion: 2.1 time: 0.340637 Aug 31 16:17:54.886940 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b1cfc297-c391-40ef-b8f2-37a9666c9aea tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:54.888025 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2320/4625] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:54 2022] GET /compute/v2.1/servers/265869f7-4238-4886-9dac-e22be12e3bc8 => generated 1472 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:54.890806 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b1cfc297-c391-40ef-b8f2-37a9666c9aea tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] [instance: d2d88bec-63be-4b0c-8497-e34d1bbb790f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:54.928333 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b1cfc297-c391-40ef-b8f2-37a9666c9aea tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:54.929480 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b1cfc297-c391-40ef-b8f2-37a9666c9aea tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:54.930102 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b1cfc297-c391-40ef-b8f2-37a9666c9aea tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:54.931351 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b1cfc297-c391-40ef-b8f2-37a9666c9aea tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:54.932211 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b1cfc297-c391-40ef-b8f2-37a9666c9aea tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:54.936254 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b1cfc297-c391-40ef-b8f2-37a9666c9aea tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:54.954588 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-e1aadf27-b95d-433c-ba02-a3d2c41e6782 req-f214c258-cfe9-4887-bcbf-9db59b93a98e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "265869f7-4238-4886-9dac-e22be12e3bc8", "name": "network-vif-deleted", "tag": "32189a24-db9e-4a75-87da-0e3f8a583e30"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:17:55.010810 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-e1aadf27-b95d-433c-ba02-a3d2c41e6782 req-f214c258-cfe9-4887-bcbf-9db59b93a98e service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:55.017084 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-e1aadf27-b95d-433c-ba02-a3d2c41e6782 req-f214c258-cfe9-4887-bcbf-9db59b93a98e service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:55.020963 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-e1aadf27-b95d-433c-ba02-a3d2c41e6782 req-f214c258-cfe9-4887-bcbf-9db59b93a98e service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:55.103534 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-e1aadf27-b95d-433c-ba02-a3d2c41e6782 req-f214c258-cfe9-4887-bcbf-9db59b93a98e service nova] Creating event network-vif-deleted:32189a24-db9e-4a75-87da-0e3f8a583e30 for instance 265869f7-4238-4886-9dac-e22be12e3bc8 on n-h1-850499-9 Aug 31 16:17:55.116508 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-e1aadf27-b95d-433c-ba02-a3d2c41e6782 req-f214c258-cfe9-4887-bcbf-9db59b93a98e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.210860 Aug 31 16:17:55.118578 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2321/4626] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:17:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:17:55.134267 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0ab94916-6c22-4241-947f-e757e8ef4da3 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:55.137343 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0ab94916-6c22-4241-947f-e757e8ef4da3 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] [instance: 336a246f-7f3e-4073-b8bc-c35be2fa56a4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:55.151922 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0ab94916-6c22-4241-947f-e757e8ef4da3 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:55.154507 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0ab94916-6c22-4241-947f-e757e8ef4da3 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:55.157266 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0ab94916-6c22-4241-947f-e757e8ef4da3 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:55.159180 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0ab94916-6c22-4241-947f-e757e8ef4da3 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:55.161669 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0ab94916-6c22-4241-947f-e757e8ef4da3 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:55.162745 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0ab94916-6c22-4241-947f-e757e8ef4da3 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:55.175195 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:17:55.203180 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b1cfc297-c391-40ef-b8f2-37a9666c9aea tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07ab61302b87448b84838a1be274b445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7ab6f24815407880276db1a6d76d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:55.229482 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b1cfc297-c391-40ef-b8f2-37a9666c9aea tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07ab61302b87448b84838a1be274b445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7ab6f24815407880276db1a6d76d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:55.235048 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b1cfc297-c391-40ef-b8f2-37a9666c9aea tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07ab61302b87448b84838a1be274b445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7ab6f24815407880276db1a6d76d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:55.236640 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b1cfc297-c391-40ef-b8f2-37a9666c9aea tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] 10.222.0.61 "GET /compute/v2.1/servers/d2d88bec-63be-4b0c-8497-e34d1bbb790f" status: 200 len: 1409 microversion: 2.54 time: 0.370818 Aug 31 16:17:55.240174 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2306/4627] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:17:54 2022] GET /compute/v2.1/servers/d2d88bec-63be-4b0c-8497-e34d1bbb790f => generated 1409 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:17:55.888296 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-306c7dcc-271d-4183-80a2-8bd1344d7f2d tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:55.901863 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-306c7dcc-271d-4183-80a2-8bd1344d7f2d tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] [instance: f04eb48d-000e-4c3b-8799-a4d3cdacf0e2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:55.937568 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-306c7dcc-271d-4183-80a2-8bd1344d7f2d tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:55.938348 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-306c7dcc-271d-4183-80a2-8bd1344d7f2d tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:55.939022 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-306c7dcc-271d-4183-80a2-8bd1344d7f2d tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:55.940085 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-306c7dcc-271d-4183-80a2-8bd1344d7f2d tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:55.940768 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-306c7dcc-271d-4183-80a2-8bd1344d7f2d tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:55.941409 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-306c7dcc-271d-4183-80a2-8bd1344d7f2d tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:56.471178 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0ab94916-6c22-4241-947f-e757e8ef4da3 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8941ad0e6d4f9bab797d0f3a213c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2113ab47146243cb85d6d57bc608131a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:56.530211 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0ab94916-6c22-4241-947f-e757e8ef4da3 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] 10.222.0.61 "GET /compute/v2.1/servers/336a246f-7f3e-4073-b8bc-c35be2fa56a4" status: 200 len: 1317 microversion: 2.1 time: 1.409350 Aug 31 16:17:56.535481 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2322/4628] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:55 2022] GET /compute/v2.1/servers/336a246f-7f3e-4073-b8bc-c35be2fa56a4 => generated 1317 bytes in 1416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:56.549613 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-da0e7f48-9de0-48cb-95ab-92872ebeae60 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:56.550280 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-da0e7f48-9de0-48cb-95ab-92872ebeae60 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: 265869f7-4238-4886-9dac-e22be12e3bc8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:56.566262 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-306c7dcc-271d-4183-80a2-8bd1344d7f2d tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed06378eb9b446680b5a3156a14941d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511432a7dee4bec9d1093c9d95b3734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:56.583597 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-306c7dcc-271d-4183-80a2-8bd1344d7f2d tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] 10.222.0.61 "GET /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2" status: 200 len: 1605 microversion: 2.1 time: 0.702385 Aug 31 16:17:56.586867 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2307/4629] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:55 2022] GET /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2 => generated 1605 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:56.604209 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-da0e7f48-9de0-48cb-95ab-92872ebeae60 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:56.604209 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-da0e7f48-9de0-48cb-95ab-92872ebeae60 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:56.604209 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-da0e7f48-9de0-48cb-95ab-92872ebeae60 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:56.604209 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-da0e7f48-9de0-48cb-95ab-92872ebeae60 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:56.604209 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-da0e7f48-9de0-48cb-95ab-92872ebeae60 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:56.604209 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-da0e7f48-9de0-48cb-95ab-92872ebeae60 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:56.619680 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-924b1fe0-5fff-4f4a-9e62-28a9ab09109c tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:56.619680 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-924b1fe0-5fff-4f4a-9e62-28a9ab09109c tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] [instance: d2d88bec-63be-4b0c-8497-e34d1bbb790f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:56.642088 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-924b1fe0-5fff-4f4a-9e62-28a9ab09109c tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:56.642616 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-924b1fe0-5fff-4f4a-9e62-28a9ab09109c tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:56.643065 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-924b1fe0-5fff-4f4a-9e62-28a9ab09109c tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:56.643829 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-924b1fe0-5fff-4f4a-9e62-28a9ab09109c tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:56.644293 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-924b1fe0-5fff-4f4a-9e62-28a9ab09109c tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:56.663783 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-924b1fe0-5fff-4f4a-9e62-28a9ab09109c tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:56.670866 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-da0e7f48-9de0-48cb-95ab-92872ebeae60 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] HTTP exception thrown: Instance 265869f7-4238-4886-9dac-e22be12e3bc8 could not be found. Aug 31 16:17:56.678169 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-da0e7f48-9de0-48cb-95ab-92872ebeae60 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Request method failure captured: Aug 31 16:17:56.678169 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/265869f7-4238-4886-9dac-e22be12e3bc8 HTTP/1.1 Aug 31 16:17:56.678169 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:17:56.678169 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:17:56.678169 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:17:56.678169 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:17:56.678169 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:17:56.678169 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:17:56.678169 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:17:56.678169 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:17:56.678169 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4kJ9yVqelI6PQAP4FyN0hYG4BotG6rZ9Z51UAn-F92EU3M7eWOhPt2iG9q-k1BREc_wm4mDe6cuQ9GsGtYKrnUD04l3E_Uui3yP_ZoFjmvMJLCje0PjV-8LgPYmd5bbG0FUp0h-96TJ9tSbn3KzFHs5OcFSd_Xo7VSkCP4R-6GZRnY Aug 31 16:17:56.678169 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:17:56.678169 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:17:56.678169 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:17:56.678169 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:17:56.678169 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:17:56.678169 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:17:56.678169 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 62d2222a956a4888967e21647e26b310 Aug 31 16:17:56.678169 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1537523141 Aug 31 16:17:56.678169 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:17:56.678169 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:17:56.678169 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/62d2222a956a4888967e21647e26b310"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/62d2222a956a4888967e21647e26b310"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_62d2222a956a4888967e21647e26b310", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/62d2222a956a4888967e21647e26b310"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:17:56.678169 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ServerDiskConfigTestJSON-1537523141 Aug 31 16:17:56.678169 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 62d2222a956a4888967e21647e26b310 Aug 31 16:17:56.678169 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1537523141 Aug 31 16:17:56.678169 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ServerDiskConfigTestJSON-1537523141-project Aug 31 16:17:56.678169 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:17:56.678169 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:17:56.678169 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: fb261f2061164b49a8d496b16647dd2c Aug 31 16:17:56.678169 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ServerDiskConfigTestJSON-1537523141-project Aug 31 16:17:56.678169 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:17:56.678169 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance 265869f7-4238-4886-9dac-e22be12e3bc8 could not be found. Aug 31 16:17:56.678169 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '265869f7-4238-4886-9dac-e22be12e3bc8'} Aug 31 16:17:56.678169 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:17:56.678169 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:17:56.678169 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:17:56.678169 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:17:56.678169 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:17:56.678169 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:17:56.678169 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:17:56.678169 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:17:56.678169 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:17:56.678169 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:17:56.678169 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 265869f7-4238-4886-9dac-e22be12e3bc8 could not be found. Aug 31 16:17:56.678169 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:17:56.678169 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:17:56.678169 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:17:56.678169 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:17:56.678169 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:17:56.678169 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:17:56.678169 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:17:56.678169 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:17:56.678169 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:17:56.678169 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:17:56.678169 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:17:56.678169 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:17:56.678169 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:17:56.678169 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:17:56.678169 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:17:56.678169 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:17:56.678169 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 265869f7-4238-4886-9dac-e22be12e3bc8 could not be found. Aug 31 16:17:56.678169 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:17:56.678169 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:17:56.678169 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:17:56.693370 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:17:56.693370 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:17:56.693370 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:17:56.693370 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:17:56.693370 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:17:56.693370 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 265869f7-4238-4886-9dac-e22be12e3bc8 could not be found. Aug 31 16:17:56.693370 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:17:56.693370 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-da0e7f48-9de0-48cb-95ab-92872ebeae60 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Returning 404 to user: Instance 265869f7-4238-4886-9dac-e22be12e3bc8 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:17:56.693370 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-da0e7f48-9de0-48cb-95ab-92872ebeae60 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "GET /compute/v2.1/servers/265869f7-4238-4886-9dac-e22be12e3bc8" status: 404 len: 111 microversion: 2.1 time: 0.147205 Aug 31 16:17:56.695469 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2323/4630] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:56 2022] GET /compute/v2.1/servers/265869f7-4238-4886-9dac-e22be12e3bc8 => generated 111 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:17:56.717476 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c0b14ceb-3af9-41c1-bf3d-b6d81bbbaa3e tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:56.717835 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c0b14ceb-3af9-41c1-bf3d-b6d81bbbaa3e tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: 9b9170ad-8804-4603-b35b-f7a3d2c4af62] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:56.734807 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c0b14ceb-3af9-41c1-bf3d-b6d81bbbaa3e tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:56.736126 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c0b14ceb-3af9-41c1-bf3d-b6d81bbbaa3e tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:56.739991 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c0b14ceb-3af9-41c1-bf3d-b6d81bbbaa3e tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:56.740924 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c0b14ceb-3af9-41c1-bf3d-b6d81bbbaa3e tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:56.741598 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c0b14ceb-3af9-41c1-bf3d-b6d81bbbaa3e tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:56.744368 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c0b14ceb-3af9-41c1-bf3d-b6d81bbbaa3e tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:56.786627 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-c0b14ceb-3af9-41c1-bf3d-b6d81bbbaa3e tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] HTTP exception thrown: Instance 9b9170ad-8804-4603-b35b-f7a3d2c4af62 could not be found. Aug 31 16:17:56.788373 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c0b14ceb-3af9-41c1-bf3d-b6d81bbbaa3e tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Request method failure captured: Aug 31 16:17:56.788373 n-d-850499-9 devstack@n-api.service[122257]: request: DELETE /compute/v2.1/servers/9b9170ad-8804-4603-b35b-f7a3d2c4af62 HTTP/1.1 Aug 31 16:17:56.788373 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:17:56.788373 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:17:56.788373 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:17:56.788373 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:17:56.788373 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:17:56.788373 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:17:56.788373 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:17:56.788373 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:17:56.788373 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4kJ9yVqelI6PQAP4FyN0hYG4BotG6rZ9Z51UAn-F92EU3M7eWOhPt2iG9q-k1BREc_wm4mDe6cuQ9GsGtYKrnUD04l3E_Uui3yP_ZoFjmvMJLCje0PjV-8LgPYmd5bbG0FUp0h-96TJ9tSbn3KzFHs5OcFSd_Xo7VSkCP4R-6GZRnY Aug 31 16:17:56.788373 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:17:56.788373 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:17:56.788373 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:17:56.788373 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:17:56.788373 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:17:56.788373 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:17:56.788373 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 62d2222a956a4888967e21647e26b310 Aug 31 16:17:56.788373 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1537523141 Aug 31 16:17:56.788373 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:17:56.788373 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:17:56.788373 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/62d2222a956a4888967e21647e26b310"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/62d2222a956a4888967e21647e26b310"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_62d2222a956a4888967e21647e26b310", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/62d2222a956a4888967e21647e26b310"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:17:56.788373 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ServerDiskConfigTestJSON-1537523141 Aug 31 16:17:56.788373 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 62d2222a956a4888967e21647e26b310 Aug 31 16:17:56.788373 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1537523141 Aug 31 16:17:56.788373 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ServerDiskConfigTestJSON-1537523141-project Aug 31 16:17:56.788373 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:17:56.788373 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:17:56.788373 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: fb261f2061164b49a8d496b16647dd2c Aug 31 16:17:56.788373 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ServerDiskConfigTestJSON-1537523141-project Aug 31 16:17:56.788373 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:17:56.788373 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance 9b9170ad-8804-4603-b35b-f7a3d2c4af62 could not be found. Aug 31 16:17:56.788373 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '9b9170ad-8804-4603-b35b-f7a3d2c4af62'} Aug 31 16:17:56.788373 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:17:56.788373 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:17:56.788373 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:17:56.788373 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:17:56.788373 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:17:56.788373 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:17:56.788373 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:17:56.788373 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:17:56.788373 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:17:56.788373 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:17:56.788373 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b9170ad-8804-4603-b35b-f7a3d2c4af62 could not be found. Aug 31 16:17:56.788373 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:17:56.788373 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:17:56.788373 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:17:56.788373 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:17:56.788373 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:17:56.788373 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:17:56.788373 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:17:56.788373 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:17:56.788373 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:17:56.788373 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:17:56.788373 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:17:56.788373 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:17:56.788373 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:17:56.788373 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:17:56.788373 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:17:56.788373 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:17:56.788373 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:17:56.788373 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:17:56.792359 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b9170ad-8804-4603-b35b-f7a3d2c4af62 could not be found. Aug 31 16:17:56.792359 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:17:56.792359 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:17:56.792359 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:17:56.792359 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:17:56.792359 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:17:56.792359 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:17:56.792359 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:17:56.792359 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:17:56.792359 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b9170ad-8804-4603-b35b-f7a3d2c4af62 could not be found. Aug 31 16:17:56.792359 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:17:56.792359 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c0b14ceb-3af9-41c1-bf3d-b6d81bbbaa3e tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Returning 404 to user: Instance 9b9170ad-8804-4603-b35b-f7a3d2c4af62 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:17:56.793169 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c0b14ceb-3af9-41c1-bf3d-b6d81bbbaa3e tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "DELETE /compute/v2.1/servers/9b9170ad-8804-4603-b35b-f7a3d2c4af62" status: 404 len: 111 microversion: 2.1 time: 0.095635 Aug 31 16:17:56.798230 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2324/4631] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:17:56 2022] DELETE /compute/v2.1/servers/9b9170ad-8804-4603-b35b-f7a3d2c4af62 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:17:56.805301 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-08a186bf-b805-4380-8d98-78db992ccada tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:56.806344 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-08a186bf-b805-4380-8d98-78db992ccada tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: 9b9170ad-8804-4603-b35b-f7a3d2c4af62] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:56.814078 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-08a186bf-b805-4380-8d98-78db992ccada tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:56.814593 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-08a186bf-b805-4380-8d98-78db992ccada tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:56.815128 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-08a186bf-b805-4380-8d98-78db992ccada tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:56.815962 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-08a186bf-b805-4380-8d98-78db992ccada tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:56.816503 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-08a186bf-b805-4380-8d98-78db992ccada tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:56.817010 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-08a186bf-b805-4380-8d98-78db992ccada tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:56.837290 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-08a186bf-b805-4380-8d98-78db992ccada tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] HTTP exception thrown: Instance 9b9170ad-8804-4603-b35b-f7a3d2c4af62 could not be found. Aug 31 16:17:56.841708 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-08a186bf-b805-4380-8d98-78db992ccada tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Request method failure captured: Aug 31 16:17:56.841708 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/9b9170ad-8804-4603-b35b-f7a3d2c4af62 HTTP/1.1 Aug 31 16:17:56.841708 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:17:56.841708 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:17:56.841708 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:17:56.841708 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:17:56.841708 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:17:56.841708 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:17:56.841708 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:17:56.841708 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:17:56.841708 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4kJ9yVqelI6PQAP4FyN0hYG4BotG6rZ9Z51UAn-F92EU3M7eWOhPt2iG9q-k1BREc_wm4mDe6cuQ9GsGtYKrnUD04l3E_Uui3yP_ZoFjmvMJLCje0PjV-8LgPYmd5bbG0FUp0h-96TJ9tSbn3KzFHs5OcFSd_Xo7VSkCP4R-6GZRnY Aug 31 16:17:56.841708 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:17:56.841708 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:17:56.841708 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:17:56.841708 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:17:56.841708 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:17:56.841708 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:17:56.841708 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 62d2222a956a4888967e21647e26b310 Aug 31 16:17:56.841708 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1537523141 Aug 31 16:17:56.841708 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:17:56.841708 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:17:56.841708 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/62d2222a956a4888967e21647e26b310"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/62d2222a956a4888967e21647e26b310"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_62d2222a956a4888967e21647e26b310", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/62d2222a956a4888967e21647e26b310"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:17:56.841708 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ServerDiskConfigTestJSON-1537523141 Aug 31 16:17:56.841708 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 62d2222a956a4888967e21647e26b310 Aug 31 16:17:56.841708 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1537523141 Aug 31 16:17:56.841708 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ServerDiskConfigTestJSON-1537523141-project Aug 31 16:17:56.841708 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:17:56.841708 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:17:56.841708 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: fb261f2061164b49a8d496b16647dd2c Aug 31 16:17:56.841708 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ServerDiskConfigTestJSON-1537523141-project Aug 31 16:17:56.841708 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:17:56.841708 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance 9b9170ad-8804-4603-b35b-f7a3d2c4af62 could not be found. Aug 31 16:17:56.841708 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '9b9170ad-8804-4603-b35b-f7a3d2c4af62'} Aug 31 16:17:56.841708 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:17:56.841708 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:17:56.841708 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:17:56.841708 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:17:56.841708 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:17:56.841708 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:17:56.841708 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:17:56.841708 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:17:56.841708 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:17:56.841708 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:17:56.841708 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b9170ad-8804-4603-b35b-f7a3d2c4af62 could not be found. Aug 31 16:17:56.841708 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:17:56.841708 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:17:56.841708 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:17:56.841708 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:17:56.841708 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:17:56.841708 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:17:56.841708 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:17:56.841708 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:17:56.841708 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:17:56.841708 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:17:56.841708 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:17:56.841708 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:17:56.841708 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:17:56.841708 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:17:56.841708 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:17:56.841708 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:17:56.841708 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b9170ad-8804-4603-b35b-f7a3d2c4af62 could not be found. Aug 31 16:17:56.841708 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:17:56.841708 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:17:56.841708 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:17:56.850590 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:17:56.850590 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:17:56.850590 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:17:56.850590 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:17:56.850590 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:17:56.850590 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b9170ad-8804-4603-b35b-f7a3d2c4af62 could not be found. Aug 31 16:17:56.850590 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:17:56.850590 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-08a186bf-b805-4380-8d98-78db992ccada tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Returning 404 to user: Instance 9b9170ad-8804-4603-b35b-f7a3d2c4af62 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:17:56.850590 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-08a186bf-b805-4380-8d98-78db992ccada tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "GET /compute/v2.1/servers/9b9170ad-8804-4603-b35b-f7a3d2c4af62" status: 404 len: 111 microversion: 2.1 time: 0.050557 Aug 31 16:17:56.857979 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2325/4632] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:56 2022] GET /compute/v2.1/servers/9b9170ad-8804-4603-b35b-f7a3d2c4af62 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:17:56.888447 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-61b1aaea-376b-4bbb-ba44-bbae6cc40777 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:56.890715 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-61b1aaea-376b-4bbb-ba44-bbae6cc40777 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: c4ef985e-0861-4c5d-88eb-d8ad053a8f54] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:56.922656 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-61b1aaea-376b-4bbb-ba44-bbae6cc40777 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:56.923531 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-61b1aaea-376b-4bbb-ba44-bbae6cc40777 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:56.924302 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-61b1aaea-376b-4bbb-ba44-bbae6cc40777 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:56.926258 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-61b1aaea-376b-4bbb-ba44-bbae6cc40777 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:56.928461 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-61b1aaea-376b-4bbb-ba44-bbae6cc40777 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:56.931381 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-61b1aaea-376b-4bbb-ba44-bbae6cc40777 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:56.963217 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-61b1aaea-376b-4bbb-ba44-bbae6cc40777 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] HTTP exception thrown: Instance c4ef985e-0861-4c5d-88eb-d8ad053a8f54 could not be found. Aug 31 16:17:56.967330 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-61b1aaea-376b-4bbb-ba44-bbae6cc40777 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Request method failure captured: Aug 31 16:17:56.967330 n-d-850499-9 devstack@n-api.service[122257]: request: DELETE /compute/v2.1/servers/c4ef985e-0861-4c5d-88eb-d8ad053a8f54 HTTP/1.1 Aug 31 16:17:56.967330 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:17:56.967330 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:17:56.967330 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:17:56.967330 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:17:56.967330 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:17:56.967330 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:17:56.967330 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:17:56.967330 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:17:56.967330 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4kJ9yVqelI6PQAP4FyN0hYG4BotG6rZ9Z51UAn-F92EU3M7eWOhPt2iG9q-k1BREc_wm4mDe6cuQ9GsGtYKrnUD04l3E_Uui3yP_ZoFjmvMJLCje0PjV-8LgPYmd5bbG0FUp0h-96TJ9tSbn3KzFHs5OcFSd_Xo7VSkCP4R-6GZRnY Aug 31 16:17:56.967330 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:17:56.967330 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:17:56.967330 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:17:56.967330 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:17:56.967330 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:17:56.967330 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:17:56.967330 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 62d2222a956a4888967e21647e26b310 Aug 31 16:17:56.967330 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1537523141 Aug 31 16:17:56.967330 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:17:56.967330 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:17:56.967330 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/62d2222a956a4888967e21647e26b310"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/62d2222a956a4888967e21647e26b310"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_62d2222a956a4888967e21647e26b310", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/62d2222a956a4888967e21647e26b310"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:17:56.967330 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ServerDiskConfigTestJSON-1537523141 Aug 31 16:17:56.967330 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 62d2222a956a4888967e21647e26b310 Aug 31 16:17:56.967330 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1537523141 Aug 31 16:17:56.967330 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ServerDiskConfigTestJSON-1537523141-project Aug 31 16:17:56.967330 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:17:56.967330 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:17:56.967330 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: fb261f2061164b49a8d496b16647dd2c Aug 31 16:17:56.967330 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ServerDiskConfigTestJSON-1537523141-project Aug 31 16:17:56.967330 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:17:56.967330 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance c4ef985e-0861-4c5d-88eb-d8ad053a8f54 could not be found. Aug 31 16:17:56.967330 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': 'c4ef985e-0861-4c5d-88eb-d8ad053a8f54'} Aug 31 16:17:56.967330 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:17:56.967330 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:17:56.967330 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:17:56.967330 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:17:56.967330 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:17:56.967330 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:17:56.967330 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:17:56.967330 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:17:56.967330 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:17:56.967330 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:17:56.967330 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4ef985e-0861-4c5d-88eb-d8ad053a8f54 could not be found. Aug 31 16:17:56.967330 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:17:56.967330 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:17:56.967330 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:17:56.967330 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:17:56.967330 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:17:56.967330 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:17:56.967330 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:17:56.967330 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:17:56.967330 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:17:56.967330 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:17:56.967330 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:17:56.967330 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:17:56.967330 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:17:56.967330 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:17:56.967330 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:17:56.967330 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:17:56.967330 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:17:56.967330 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:17:56.979830 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4ef985e-0861-4c5d-88eb-d8ad053a8f54 could not be found. Aug 31 16:17:56.979830 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:17:56.979830 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:17:56.979830 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:17:56.979830 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:17:56.979830 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:17:56.979830 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:17:56.979830 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:17:56.979830 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:17:56.979830 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4ef985e-0861-4c5d-88eb-d8ad053a8f54 could not be found. Aug 31 16:17:56.979830 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:17:56.990208 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-924b1fe0-5fff-4f4a-9e62-28a9ab09109c tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07ab61302b87448b84838a1be274b445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7ab6f24815407880276db1a6d76d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:56.998315 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-61b1aaea-376b-4bbb-ba44-bbae6cc40777 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Returning 404 to user: Instance c4ef985e-0861-4c5d-88eb-d8ad053a8f54 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:17:57.003289 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-61b1aaea-376b-4bbb-ba44-bbae6cc40777 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "DELETE /compute/v2.1/servers/c4ef985e-0861-4c5d-88eb-d8ad053a8f54" status: 404 len: 111 microversion: 2.1 time: 0.135506 Aug 31 16:17:57.009106 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2326/4633] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:17:56 2022] DELETE /compute/v2.1/servers/c4ef985e-0861-4c5d-88eb-d8ad053a8f54 => generated 111 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:17:57.026026 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-81837c3d-22fb-40c3-9de6-3c2f2af07ab8 req-644001dd-0fd8-46f5-a350-e66a44d2a012 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f04eb48d-000e-4c3b-8799-a4d3cdacf0e2", "name": "network-vif-deleted", "tag": "e50b9368-8cb7-4eff-9832-0a103ac0abdc"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:17:57.027131 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-924b1fe0-5fff-4f4a-9e62-28a9ab09109c tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07ab61302b87448b84838a1be274b445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7ab6f24815407880276db1a6d76d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:57.033484 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-924b1fe0-5fff-4f4a-9e62-28a9ab09109c tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07ab61302b87448b84838a1be274b445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7ab6f24815407880276db1a6d76d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:57.042305 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-924b1fe0-5fff-4f4a-9e62-28a9ab09109c tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] 10.222.0.61 "GET /compute/v2.1/servers/d2d88bec-63be-4b0c-8497-e34d1bbb790f" status: 200 len: 1409 microversion: 2.54 time: 0.450135 Aug 31 16:17:57.047976 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2308/4634] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:17:56 2022] GET /compute/v2.1/servers/d2d88bec-63be-4b0c-8497-e34d1bbb790f => generated 1409 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:17:57.066915 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-61b3f1df-9f73-4dcd-8f1b-8b8615423b53 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:57.074730 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-81837c3d-22fb-40c3-9de6-3c2f2af07ab8 req-644001dd-0fd8-46f5-a350-e66a44d2a012 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:57.076421 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-61b3f1df-9f73-4dcd-8f1b-8b8615423b53 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] [instance: c4ef985e-0861-4c5d-88eb-d8ad053a8f54] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:57.079049 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-81837c3d-22fb-40c3-9de6-3c2f2af07ab8 req-644001dd-0fd8-46f5-a350-e66a44d2a012 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:57.083814 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-81837c3d-22fb-40c3-9de6-3c2f2af07ab8 req-644001dd-0fd8-46f5-a350-e66a44d2a012 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:57.112156 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-61b3f1df-9f73-4dcd-8f1b-8b8615423b53 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:57.116271 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-61b3f1df-9f73-4dcd-8f1b-8b8615423b53 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:57.120838 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-61b3f1df-9f73-4dcd-8f1b-8b8615423b53 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:57.125728 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-61b3f1df-9f73-4dcd-8f1b-8b8615423b53 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:57.130976 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-61b3f1df-9f73-4dcd-8f1b-8b8615423b53 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:57.132483 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-61b3f1df-9f73-4dcd-8f1b-8b8615423b53 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:57.144594 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:17:57.161308 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-81837c3d-22fb-40c3-9de6-3c2f2af07ab8 req-644001dd-0fd8-46f5-a350-e66a44d2a012 service nova] Creating event network-vif-deleted:e50b9368-8cb7-4eff-9832-0a103ac0abdc for instance f04eb48d-000e-4c3b-8799-a4d3cdacf0e2 on n-h1-850499-9 Aug 31 16:17:57.175035 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-81837c3d-22fb-40c3-9de6-3c2f2af07ab8 req-644001dd-0fd8-46f5-a350-e66a44d2a012 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162805 Aug 31 16:17:57.177267 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2327/4635] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:17:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:17:57.223112 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-61b3f1df-9f73-4dcd-8f1b-8b8615423b53 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] HTTP exception thrown: Instance c4ef985e-0861-4c5d-88eb-d8ad053a8f54 could not be found. Aug 31 16:17:57.231886 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-61b3f1df-9f73-4dcd-8f1b-8b8615423b53 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Request method failure captured: Aug 31 16:17:57.231886 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/c4ef985e-0861-4c5d-88eb-d8ad053a8f54 HTTP/1.1 Aug 31 16:17:57.231886 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:17:57.231886 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:17:57.231886 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:17:57.231886 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:17:57.231886 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:17:57.231886 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:17:57.231886 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:17:57.231886 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:17:57.231886 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4kJ9yVqelI6PQAP4FyN0hYG4BotG6rZ9Z51UAn-F92EU3M7eWOhPt2iG9q-k1BREc_wm4mDe6cuQ9GsGtYKrnUD04l3E_Uui3yP_ZoFjmvMJLCje0PjV-8LgPYmd5bbG0FUp0h-96TJ9tSbn3KzFHs5OcFSd_Xo7VSkCP4R-6GZRnY Aug 31 16:17:57.231886 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:17:57.231886 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:17:57.231886 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:17:57.231886 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:17:57.231886 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:17:57.231886 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:17:57.231886 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 62d2222a956a4888967e21647e26b310 Aug 31 16:17:57.231886 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1537523141 Aug 31 16:17:57.231886 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:17:57.231886 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:17:57.231886 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/62d2222a956a4888967e21647e26b310"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/62d2222a956a4888967e21647e26b310"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_62d2222a956a4888967e21647e26b310", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/62d2222a956a4888967e21647e26b310"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:17:57.231886 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ServerDiskConfigTestJSON-1537523141 Aug 31 16:17:57.231886 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 62d2222a956a4888967e21647e26b310 Aug 31 16:17:57.231886 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1537523141 Aug 31 16:17:57.231886 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ServerDiskConfigTestJSON-1537523141-project Aug 31 16:17:57.231886 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:17:57.231886 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:17:57.231886 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: fb261f2061164b49a8d496b16647dd2c Aug 31 16:17:57.231886 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ServerDiskConfigTestJSON-1537523141-project Aug 31 16:17:57.231886 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:17:57.231886 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance c4ef985e-0861-4c5d-88eb-d8ad053a8f54 could not be found. Aug 31 16:17:57.231886 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': 'c4ef985e-0861-4c5d-88eb-d8ad053a8f54'} Aug 31 16:17:57.231886 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:17:57.231886 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:17:57.231886 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:17:57.231886 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:17:57.231886 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:17:57.231886 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:17:57.231886 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:17:57.231886 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:17:57.231886 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:17:57.231886 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:17:57.231886 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4ef985e-0861-4c5d-88eb-d8ad053a8f54 could not be found. Aug 31 16:17:57.231886 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:17:57.231886 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:17:57.231886 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:17:57.231886 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:17:57.231886 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:17:57.231886 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:17:57.231886 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:17:57.231886 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:17:57.231886 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:17:57.231886 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:17:57.231886 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:17:57.231886 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:17:57.231886 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:17:57.231886 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:17:57.231886 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:17:57.231886 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:17:57.231886 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4ef985e-0861-4c5d-88eb-d8ad053a8f54 could not be found. Aug 31 16:17:57.231886 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:17:57.231886 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:17:57.231886 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:17:57.239455 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:17:57.239455 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:17:57.239455 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:17:57.239455 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:17:57.239455 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:17:57.239455 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4ef985e-0861-4c5d-88eb-d8ad053a8f54 could not be found. Aug 31 16:17:57.239455 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:17:57.239455 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-61b3f1df-9f73-4dcd-8f1b-8b8615423b53 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] Returning 404 to user: Instance c4ef985e-0861-4c5d-88eb-d8ad053a8f54 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:17:57.241259 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-61b3f1df-9f73-4dcd-8f1b-8b8615423b53 tempest-ServerDiskConfigTestJSON-1537523141 tempest-ServerDiskConfigTestJSON-1537523141-project] 10.222.0.61 "GET /compute/v2.1/servers/c4ef985e-0861-4c5d-88eb-d8ad053a8f54" status: 404 len: 111 microversion: 2.1 time: 0.189226 Aug 31 16:17:57.244878 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2309/4636] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:57 2022] GET /compute/v2.1/servers/c4ef985e-0861-4c5d-88eb-d8ad053a8f54 => generated 111 bytes in 195 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:17:57.561480 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-876f3f2b-dc5e-4be2-94e7-93f038db47ec tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:57.562531 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-876f3f2b-dc5e-4be2-94e7-93f038db47ec tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] [instance: 336a246f-7f3e-4073-b8bc-c35be2fa56a4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:57.593794 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-876f3f2b-dc5e-4be2-94e7-93f038db47ec tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:57.596251 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-876f3f2b-dc5e-4be2-94e7-93f038db47ec tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:57.598285 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-876f3f2b-dc5e-4be2-94e7-93f038db47ec tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:57.601164 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-876f3f2b-dc5e-4be2-94e7-93f038db47ec tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:57.602268 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-876f3f2b-dc5e-4be2-94e7-93f038db47ec tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:57.604684 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-876f3f2b-dc5e-4be2-94e7-93f038db47ec tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:57.647690 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0c761a15-1c7f-42f5-9fe6-7b764a71a022 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:57.648566 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0c761a15-1c7f-42f5-9fe6-7b764a71a022 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] [instance: f04eb48d-000e-4c3b-8799-a4d3cdacf0e2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:57.685384 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0c761a15-1c7f-42f5-9fe6-7b764a71a022 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:57.702479 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0c761a15-1c7f-42f5-9fe6-7b764a71a022 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:57.704120 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0c761a15-1c7f-42f5-9fe6-7b764a71a022 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:57.707342 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0c761a15-1c7f-42f5-9fe6-7b764a71a022 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:57.711952 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0c761a15-1c7f-42f5-9fe6-7b764a71a022 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:57.713924 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0c761a15-1c7f-42f5-9fe6-7b764a71a022 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:57.869441 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0c761a15-1c7f-42f5-9fe6-7b764a71a022 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:57.878118 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0c761a15-1c7f-42f5-9fe6-7b764a71a022 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:57.878836 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0c761a15-1c7f-42f5-9fe6-7b764a71a022 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:57.880541 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-0c761a15-1c7f-42f5-9fe6-7b764a71a022 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lazy-loading 'fault' on Instance uuid f04eb48d-000e-4c3b-8799-a4d3cdacf0e2 {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:17:58.356600 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-0c761a15-1c7f-42f5-9fe6-7b764a71a022 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed06378eb9b446680b5a3156a14941d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511432a7dee4bec9d1093c9d95b3734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:58.384770 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0c761a15-1c7f-42f5-9fe6-7b764a71a022 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] 10.222.0.61 "GET /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2" status: 200 len: 1326 microversion: 2.1 time: 0.760336 Aug 31 16:17:58.401496 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2310/4637] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:57 2022] GET /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2 => generated 1326 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:58.418367 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2e53f978-37f3-4ba1-9c2b-24afc5a11078 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:58.420063 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2e53f978-37f3-4ba1-9c2b-24afc5a11078 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] [instance: d2d88bec-63be-4b0c-8497-e34d1bbb790f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:58.436873 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2e53f978-37f3-4ba1-9c2b-24afc5a11078 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:58.438166 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2e53f978-37f3-4ba1-9c2b-24afc5a11078 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:58.439215 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2e53f978-37f3-4ba1-9c2b-24afc5a11078 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:58.440749 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2e53f978-37f3-4ba1-9c2b-24afc5a11078 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:58.441800 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2e53f978-37f3-4ba1-9c2b-24afc5a11078 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:58.443187 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2e53f978-37f3-4ba1-9c2b-24afc5a11078 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:58.490335 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-876f3f2b-dc5e-4be2-94e7-93f038db47ec tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8941ad0e6d4f9bab797d0f3a213c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2113ab47146243cb85d6d57bc608131a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:58.504219 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-876f3f2b-dc5e-4be2-94e7-93f038db47ec tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] 10.222.0.61 "GET /compute/v2.1/servers/336a246f-7f3e-4073-b8bc-c35be2fa56a4" status: 200 len: 1317 microversion: 2.1 time: 0.949083 Aug 31 16:17:58.506371 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2328/4638] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:57 2022] GET /compute/v2.1/servers/336a246f-7f3e-4073-b8bc-c35be2fa56a4 => generated 1317 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:58.622284 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-2e53f978-37f3-4ba1-9c2b-24afc5a11078 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07ab61302b87448b84838a1be274b445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7ab6f24815407880276db1a6d76d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:58.716908 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-2e53f978-37f3-4ba1-9c2b-24afc5a11078 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07ab61302b87448b84838a1be274b445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7ab6f24815407880276db1a6d76d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:58.748265 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-2e53f978-37f3-4ba1-9c2b-24afc5a11078 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07ab61302b87448b84838a1be274b445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7ab6f24815407880276db1a6d76d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:58.758715 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2e53f978-37f3-4ba1-9c2b-24afc5a11078 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] 10.222.0.61 "GET /compute/v2.1/servers/d2d88bec-63be-4b0c-8497-e34d1bbb790f" status: 200 len: 1409 microversion: 2.54 time: 0.350351 Aug 31 16:17:58.817300 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2311/4639] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:17:58 2022] GET /compute/v2.1/servers/d2d88bec-63be-4b0c-8497-e34d1bbb790f => generated 1409 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:17:59.418242 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c014a37d-ee19-427b-b78d-20558bb2a9db tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:59.420574 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c014a37d-ee19-427b-b78d-20558bb2a9db tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] [instance: f04eb48d-000e-4c3b-8799-a4d3cdacf0e2] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:59.441455 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c014a37d-ee19-427b-b78d-20558bb2a9db tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:59.442840 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c014a37d-ee19-427b-b78d-20558bb2a9db tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:59.445159 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c014a37d-ee19-427b-b78d-20558bb2a9db tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:59.448283 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c014a37d-ee19-427b-b78d-20558bb2a9db tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:59.451884 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c014a37d-ee19-427b-b78d-20558bb2a9db tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:59.453786 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c014a37d-ee19-427b-b78d-20558bb2a9db tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:59.495663 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-c014a37d-ee19-427b-b78d-20558bb2a9db tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] HTTP exception thrown: Instance f04eb48d-000e-4c3b-8799-a4d3cdacf0e2 could not be found. Aug 31 16:17:59.505214 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c014a37d-ee19-427b-b78d-20558bb2a9db tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Request method failure captured: Aug 31 16:17:59.505214 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2 HTTP/1.1 Aug 31 16:17:59.505214 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:17:59.505214 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:17:59.505214 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:17:59.505214 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:17:59.505214 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:17:59.505214 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:17:59.505214 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:17:59.505214 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:17:59.505214 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4h75u7LzyI3LiTRnaMEtEGh_oKNi1Al59H9ZBkna-ug3rHwVRzVYTJjImD5IWMxWPmOM60UDHY8-wFzVIU5mmc62NrV2ywLM1HILKrGBC3OkZ2zojw8iZAqohy1LHuIy22Zt-21nf1lXy0v98jU9OvxTkFTMT27YgwY79kYAuiRpls Aug 31 16:17:59.505214 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:17:59.505214 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:17:59.505214 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:17:59.505214 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:17:59.505214 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:17:59.505214 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:17:59.505214 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 3511432a7dee4bec9d1093c9d95b3734 Aug 31 16:17:59.505214 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-AttachVolumeTestJSON-172185859 Aug 31 16:17:59.505214 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:17:59.505214 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:17:59.505214 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/3511432a7dee4bec9d1093c9d95b3734"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/3511432a7dee4bec9d1093c9d95b3734"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_3511432a7dee4bec9d1093c9d95b3734", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/3511432a7dee4bec9d1093c9d95b3734"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:17:59.505214 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-AttachVolumeTestJSON-172185859 Aug 31 16:17:59.505214 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 3511432a7dee4bec9d1093c9d95b3734 Aug 31 16:17:59.505214 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-AttachVolumeTestJSON-172185859 Aug 31 16:17:59.505214 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-AttachVolumeTestJSON-172185859-project Aug 31 16:17:59.505214 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:17:59.505214 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:17:59.505214 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 4ed06378eb9b446680b5a3156a14941d Aug 31 16:17:59.505214 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-AttachVolumeTestJSON-172185859-project Aug 31 16:17:59.505214 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:17:59.505214 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance f04eb48d-000e-4c3b-8799-a4d3cdacf0e2 could not be found. Aug 31 16:17:59.505214 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': 'f04eb48d-000e-4c3b-8799-a4d3cdacf0e2'} Aug 31 16:17:59.505214 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:17:59.505214 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:17:59.505214 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:17:59.505214 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:17:59.505214 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:17:59.505214 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:17:59.505214 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:17:59.505214 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:17:59.505214 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:17:59.505214 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:17:59.505214 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f04eb48d-000e-4c3b-8799-a4d3cdacf0e2 could not be found. Aug 31 16:17:59.505214 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:17:59.505214 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:17:59.505214 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:17:59.505214 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:17:59.505214 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:17:59.505214 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:17:59.505214 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:17:59.505214 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:17:59.505214 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:17:59.505214 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:17:59.505214 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:17:59.505214 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:17:59.505214 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:17:59.505214 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:17:59.505214 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:17:59.505214 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:17:59.505214 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f04eb48d-000e-4c3b-8799-a4d3cdacf0e2 could not be found. Aug 31 16:17:59.505214 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:17:59.505214 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:17:59.505214 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:17:59.510471 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:17:59.510471 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:17:59.510471 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:17:59.510471 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:17:59.510471 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:17:59.510471 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f04eb48d-000e-4c3b-8799-a4d3cdacf0e2 could not be found. Aug 31 16:17:59.510471 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:17:59.515461 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c014a37d-ee19-427b-b78d-20558bb2a9db tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Returning 404 to user: Instance f04eb48d-000e-4c3b-8799-a4d3cdacf0e2 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:17:59.517559 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c014a37d-ee19-427b-b78d-20558bb2a9db tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] 10.222.0.61 "GET /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2" status: 404 len: 111 microversion: 2.1 time: 0.106147 Aug 31 16:17:59.521441 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2329/4640] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:59 2022] GET /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:17:59.531306 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3d078d71-7472-4d54-ac7a-5dd1fb41cacb tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:59.531939 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3d078d71-7472-4d54-ac7a-5dd1fb41cacb tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] [instance: 336a246f-7f3e-4073-b8bc-c35be2fa56a4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:59.532868 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b17ef366-50a7-42d1-b220-5b7e74fc5ee5 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Calling method '.version_select at 0x7f5ae8d02550>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:59.562884 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3d078d71-7472-4d54-ac7a-5dd1fb41cacb tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:59.568006 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3d078d71-7472-4d54-ac7a-5dd1fb41cacb tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:59.568829 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3d078d71-7472-4d54-ac7a-5dd1fb41cacb tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:59.573725 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3d078d71-7472-4d54-ac7a-5dd1fb41cacb tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:59.575783 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3d078d71-7472-4d54-ac7a-5dd1fb41cacb tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:59.577451 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3d078d71-7472-4d54-ac7a-5dd1fb41cacb tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:59.605980 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b17ef366-50a7-42d1-b220-5b7e74fc5ee5 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-596488238" status: 202 len: 0 microversion: 2.1 time: 0.078703 Aug 31 16:17:59.606676 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2330/4641] 10.222.0.61 () {58 vars in 1218 bytes} [Wed Aug 31 16:17:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-596488238 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:17:59.827853 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5fc5398f-e91d-426b-abbd-62ee44bfa1a9 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:59.828502 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5fc5398f-e91d-426b-abbd-62ee44bfa1a9 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] [instance: d2d88bec-63be-4b0c-8497-e34d1bbb790f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:59.835698 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5fc5398f-e91d-426b-abbd-62ee44bfa1a9 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:59.836214 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5fc5398f-e91d-426b-abbd-62ee44bfa1a9 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:59.837247 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5fc5398f-e91d-426b-abbd-62ee44bfa1a9 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:59.838039 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5fc5398f-e91d-426b-abbd-62ee44bfa1a9 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:59.838514 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5fc5398f-e91d-426b-abbd-62ee44bfa1a9 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:59.838958 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5fc5398f-e91d-426b-abbd-62ee44bfa1a9 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:00.176449 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5fc5398f-e91d-426b-abbd-62ee44bfa1a9 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07ab61302b87448b84838a1be274b445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7ab6f24815407880276db1a6d76d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:00.205856 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5fc5398f-e91d-426b-abbd-62ee44bfa1a9 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07ab61302b87448b84838a1be274b445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7ab6f24815407880276db1a6d76d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:00.215800 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5fc5398f-e91d-426b-abbd-62ee44bfa1a9 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07ab61302b87448b84838a1be274b445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7ab6f24815407880276db1a6d76d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:00.218313 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5fc5398f-e91d-426b-abbd-62ee44bfa1a9 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] 10.222.0.61 "GET /compute/v2.1/servers/d2d88bec-63be-4b0c-8497-e34d1bbb790f" status: 200 len: 1409 microversion: 2.54 time: 0.395481 Aug 31 16:18:00.224448 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2331/4642] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:17:59 2022] GET /compute/v2.1/servers/d2d88bec-63be-4b0c-8497-e34d1bbb790f => generated 1409 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:18:00.313340 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3d078d71-7472-4d54-ac7a-5dd1fb41cacb tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8941ad0e6d4f9bab797d0f3a213c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2113ab47146243cb85d6d57bc608131a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:00.341169 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3d078d71-7472-4d54-ac7a-5dd1fb41cacb tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] 10.222.0.61 "GET /compute/v2.1/servers/336a246f-7f3e-4073-b8bc-c35be2fa56a4" status: 200 len: 1317 microversion: 2.1 time: 0.813549 Aug 31 16:18:00.342277 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2312/4643] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:59 2022] GET /compute/v2.1/servers/336a246f-7f3e-4073-b8bc-c35be2fa56a4 => generated 1317 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:18:01.281731 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-352a6b9f-6946-4405-aa6f-ad03604114e1 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:01.283152 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-352a6b9f-6946-4405-aa6f-ad03604114e1 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] [instance: d2d88bec-63be-4b0c-8497-e34d1bbb790f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:01.300937 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-352a6b9f-6946-4405-aa6f-ad03604114e1 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:01.302034 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-352a6b9f-6946-4405-aa6f-ad03604114e1 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:01.302660 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-352a6b9f-6946-4405-aa6f-ad03604114e1 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:01.304085 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-352a6b9f-6946-4405-aa6f-ad03604114e1 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:01.306332 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-352a6b9f-6946-4405-aa6f-ad03604114e1 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:01.306975 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-352a6b9f-6946-4405-aa6f-ad03604114e1 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:01.381426 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3e8909ad-3449-43fc-96f2-ef6759eeaa00 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:01.385642 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3e8909ad-3449-43fc-96f2-ef6759eeaa00 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] [instance: 336a246f-7f3e-4073-b8bc-c35be2fa56a4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:01.426987 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3e8909ad-3449-43fc-96f2-ef6759eeaa00 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:01.428685 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3e8909ad-3449-43fc-96f2-ef6759eeaa00 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:01.429783 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3e8909ad-3449-43fc-96f2-ef6759eeaa00 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:01.431746 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3e8909ad-3449-43fc-96f2-ef6759eeaa00 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:01.432844 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3e8909ad-3449-43fc-96f2-ef6759eeaa00 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:01.433873 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3e8909ad-3449-43fc-96f2-ef6759eeaa00 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:01.718659 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-352a6b9f-6946-4405-aa6f-ad03604114e1 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07ab61302b87448b84838a1be274b445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7ab6f24815407880276db1a6d76d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:01.736384 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-352a6b9f-6946-4405-aa6f-ad03604114e1 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07ab61302b87448b84838a1be274b445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7ab6f24815407880276db1a6d76d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:01.744626 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-352a6b9f-6946-4405-aa6f-ad03604114e1 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07ab61302b87448b84838a1be274b445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7ab6f24815407880276db1a6d76d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:01.750627 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-352a6b9f-6946-4405-aa6f-ad03604114e1 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] 10.222.0.61 "GET /compute/v2.1/servers/d2d88bec-63be-4b0c-8497-e34d1bbb790f" status: 200 len: 1415 microversion: 2.54 time: 0.475148 Aug 31 16:18:01.753558 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2332/4644] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:18:01 2022] GET /compute/v2.1/servers/d2d88bec-63be-4b0c-8497-e34d1bbb790f => generated 1415 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:18:02.258035 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3e8909ad-3449-43fc-96f2-ef6759eeaa00 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8941ad0e6d4f9bab797d0f3a213c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2113ab47146243cb85d6d57bc608131a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:02.288784 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3e8909ad-3449-43fc-96f2-ef6759eeaa00 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] 10.222.0.61 "GET /compute/v2.1/servers/336a246f-7f3e-4073-b8bc-c35be2fa56a4" status: 200 len: 1317 microversion: 2.1 time: 0.922461 Aug 31 16:18:02.298103 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7c9743a9-a7e5-4dcd-84a6-96bbbc28b9ea tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Action: 'create', calling method: .version_select at 0x7f5ae8d02280>, body: {"keypair": {"name": "tempest-keypair-549669063", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAwLlBTUzOeP9IZ9XKyOvWVzg5eYZfIWO/Y3RlYwLPTZoWhBPLC8TTt7Pnz93nbZX3PWqUdhWrMi2JqQ3KHONrJ0dthW8aaFyTH2z1FxhIOK1pV7aK3uM4AWrBcYIFctcg=="}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:18:02.302216 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2313/4645] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:01 2022] GET /compute/v2.1/servers/336a246f-7f3e-4073-b8bc-c35be2fa56a4 => generated 1317 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:18:02.402726 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-7c9743a9-a7e5-4dcd-84a6-96bbbc28b9ea tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Getting quotas for project 3511432a7dee4bec9d1093c9d95b3734. Resources: {'key_pairs'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:18:02.429816 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-7c9743a9-a7e5-4dcd-84a6-96bbbc28b9ea tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Getting quotas for user 4ed06378eb9b446680b5a3156a14941d and project 3511432a7dee4bec9d1093c9d95b3734. Resources: {'key_pairs'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:18:02.472871 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-6965c205-e6e2-4aa2-b3f8-d60cf63d6603 req-414e74eb-d6a2-4c16-85d1-a7b283355938 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "336a246f-7f3e-4073-b8bc-c35be2fa56a4", "name": "network-vif-plugged", "status": "completed", "tag": "f2c2b358-fae2-4e68-b84d-93afa20b9c7d"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:18:02.504105 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-6965c205-e6e2-4aa2-b3f8-d60cf63d6603 req-414e74eb-d6a2-4c16-85d1-a7b283355938 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:02.505117 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-6965c205-e6e2-4aa2-b3f8-d60cf63d6603 req-414e74eb-d6a2-4c16-85d1-a7b283355938 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:02.506522 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-6965c205-e6e2-4aa2-b3f8-d60cf63d6603 req-414e74eb-d6a2-4c16-85d1-a7b283355938 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:02.527290 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7c9743a9-a7e5-4dcd-84a6-96bbbc28b9ea tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.237090 Aug 31 16:18:02.543133 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2333/4646] 10.222.0.61 () {60 vars in 1159 bytes} [Wed Aug 31 16:18:02 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:18:02.558043 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-6965c205-e6e2-4aa2-b3f8-d60cf63d6603 req-414e74eb-d6a2-4c16-85d1-a7b283355938 service nova] Creating event network-vif-plugged:f2c2b358-fae2-4e68-b84d-93afa20b9c7d for instance 336a246f-7f3e-4073-b8bc-c35be2fa56a4 on n-h2-850499-9 Aug 31 16:18:02.577336 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-6965c205-e6e2-4aa2-b3f8-d60cf63d6603 req-414e74eb-d6a2-4c16-85d1-a7b283355938 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118108 Aug 31 16:18:02.578872 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2314/4647] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:18:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:18:02.796472 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e8bc0057-7986-4d0e-ba39-b80aa34866b6 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:02.803333 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e8bc0057-7986-4d0e-ba39-b80aa34866b6 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] [instance: d2d88bec-63be-4b0c-8497-e34d1bbb790f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:02.836447 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e8bc0057-7986-4d0e-ba39-b80aa34866b6 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:02.837638 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e8bc0057-7986-4d0e-ba39-b80aa34866b6 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:02.838627 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e8bc0057-7986-4d0e-ba39-b80aa34866b6 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:02.841383 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e8bc0057-7986-4d0e-ba39-b80aa34866b6 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:02.857784 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e8bc0057-7986-4d0e-ba39-b80aa34866b6 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:02.858861 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e8bc0057-7986-4d0e-ba39-b80aa34866b6 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:03.113573 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e8bc0057-7986-4d0e-ba39-b80aa34866b6 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07ab61302b87448b84838a1be274b445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7ab6f24815407880276db1a6d76d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:03.148330 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e8bc0057-7986-4d0e-ba39-b80aa34866b6 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07ab61302b87448b84838a1be274b445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7ab6f24815407880276db1a6d76d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:03.152531 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e8bc0057-7986-4d0e-ba39-b80aa34866b6 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07ab61302b87448b84838a1be274b445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7ab6f24815407880276db1a6d76d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:03.157126 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e8bc0057-7986-4d0e-ba39-b80aa34866b6 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] 10.222.0.61 "GET /compute/v2.1/servers/d2d88bec-63be-4b0c-8497-e34d1bbb790f" status: 200 len: 1415 microversion: 2.54 time: 0.371218 Aug 31 16:18:03.163364 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2315/4648] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:18:02 2022] GET /compute/v2.1/servers/d2d88bec-63be-4b0c-8497-e34d1bbb790f => generated 1415 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:18:03.349036 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-42112132-da46-4c84-87b6-b93ab7f82831 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:03.350059 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-42112132-da46-4c84-87b6-b93ab7f82831 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] [instance: 336a246f-7f3e-4073-b8bc-c35be2fa56a4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:03.361418 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42112132-da46-4c84-87b6-b93ab7f82831 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:03.362676 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42112132-da46-4c84-87b6-b93ab7f82831 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:03.365487 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42112132-da46-4c84-87b6-b93ab7f82831 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:03.367235 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42112132-da46-4c84-87b6-b93ab7f82831 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:03.369367 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42112132-da46-4c84-87b6-b93ab7f82831 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:03.373493 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42112132-da46-4c84-87b6-b93ab7f82831 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:03.632402 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c339f204-28b0-4d35-9aef-3ec880b54f57 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-26024097", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "networks": [{"uuid": "b946ae1c-39bc-4c3d-a644-5b869cde3f95"}]}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:18:03.880201 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-c339f204-28b0-4d35-9aef-3ec880b54f57 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] validate_networks() for [('b946ae1c-39bc-4c3d-a644-5b869cde3f95', None, None, None, None, None)] {{(pid=122257) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:18:03.974013 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-42112132-da46-4c84-87b6-b93ab7f82831 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8941ad0e6d4f9bab797d0f3a213c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2113ab47146243cb85d6d57bc608131a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:03.987998 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-42112132-da46-4c84-87b6-b93ab7f82831 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] 10.222.0.61 "GET /compute/v2.1/servers/336a246f-7f3e-4073-b8bc-c35be2fa56a4" status: 200 len: 1317 microversion: 2.1 time: 0.654167 Aug 31 16:18:03.990131 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2316/4649] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:03 2022] GET /compute/v2.1/servers/336a246f-7f3e-4073-b8bc-c35be2fa56a4 => generated 1317 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:18:04.200137 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-359fe97d-341c-4875-9f85-b52b5bec4af4 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:04.201350 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-359fe97d-341c-4875-9f85-b52b5bec4af4 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] [instance: d2d88bec-63be-4b0c-8497-e34d1bbb790f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:04.225100 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-359fe97d-341c-4875-9f85-b52b5bec4af4 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:04.228716 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-359fe97d-341c-4875-9f85-b52b5bec4af4 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:04.230005 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-359fe97d-341c-4875-9f85-b52b5bec4af4 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:04.231648 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-359fe97d-341c-4875-9f85-b52b5bec4af4 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:04.236544 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-359fe97d-341c-4875-9f85-b52b5bec4af4 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:04.237855 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-359fe97d-341c-4875-9f85-b52b5bec4af4 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:04.616396 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-359fe97d-341c-4875-9f85-b52b5bec4af4 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07ab61302b87448b84838a1be274b445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7ab6f24815407880276db1a6d76d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:04.644242 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-359fe97d-341c-4875-9f85-b52b5bec4af4 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07ab61302b87448b84838a1be274b445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7ab6f24815407880276db1a6d76d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:04.647208 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-359fe97d-341c-4875-9f85-b52b5bec4af4 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07ab61302b87448b84838a1be274b445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7ab6f24815407880276db1a6d76d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:04.658485 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-359fe97d-341c-4875-9f85-b52b5bec4af4 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] 10.222.0.61 "GET /compute/v2.1/servers/d2d88bec-63be-4b0c-8497-e34d1bbb790f" status: 200 len: 1415 microversion: 2.54 time: 0.466836 Aug 31 16:18:04.672172 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2317/4650] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:18:04 2022] GET /compute/v2.1/servers/d2d88bec-63be-4b0c-8497-e34d1bbb790f => generated 1415 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:18:04.694278 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-96ed2120-8212-4ba5-a4c6-3af697691b6f req-ca6b9088-1a01-4d26-bbcc-9ff43b404c16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42ccbb85-9677-4cb9-879a-dc280cda020c", "name": "network-vif-plugged", "status": "completed", "tag": "44b19fab-a1b0-47af-8c78-4bab130a016b"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:18:04.758665 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-96ed2120-8212-4ba5-a4c6-3af697691b6f req-ca6b9088-1a01-4d26-bbcc-9ff43b404c16 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:04.759556 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-96ed2120-8212-4ba5-a4c6-3af697691b6f req-ca6b9088-1a01-4d26-bbcc-9ff43b404c16 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:04.760288 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-96ed2120-8212-4ba5-a4c6-3af697691b6f req-ca6b9088-1a01-4d26-bbcc-9ff43b404c16 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:04.859933 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-96ed2120-8212-4ba5-a4c6-3af697691b6f req-ca6b9088-1a01-4d26-bbcc-9ff43b404c16 service nova] Creating event network-vif-plugged:44b19fab-a1b0-47af-8c78-4bab130a016b for instance 42ccbb85-9677-4cb9-879a-dc280cda020c on n-h2-850499-9 Aug 31 16:18:04.887686 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-96ed2120-8212-4ba5-a4c6-3af697691b6f req-ca6b9088-1a01-4d26-bbcc-9ff43b404c16 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.207090 Aug 31 16:18:04.900356 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2318/4651] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:18:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:18:05.035917 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-fcbea2fd-d809-4484-829a-afbc42ea07fc tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:05.045675 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-fcbea2fd-d809-4484-829a-afbc42ea07fc tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] [instance: 336a246f-7f3e-4073-b8bc-c35be2fa56a4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:05.065993 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fcbea2fd-d809-4484-829a-afbc42ea07fc tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:05.067053 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fcbea2fd-d809-4484-829a-afbc42ea07fc tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:05.068320 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fcbea2fd-d809-4484-829a-afbc42ea07fc tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:05.070020 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fcbea2fd-d809-4484-829a-afbc42ea07fc tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:05.071215 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fcbea2fd-d809-4484-829a-afbc42ea07fc tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:05.072370 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fcbea2fd-d809-4484-829a-afbc42ea07fc tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:05.909334 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-c339f204-28b0-4d35-9aef-3ec880b54f57 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:18:05.910686 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-c339f204-28b0-4d35-9aef-3ec880b54f57 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:18:05.911862 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-c339f204-28b0-4d35-9aef-3ec880b54f57 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:18:05.912968 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-c339f204-28b0-4d35-9aef-3ec880b54f57 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:18:05.914004 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-c339f204-28b0-4d35-9aef-3ec880b54f57 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:18:05.957487 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c339f204-28b0-4d35-9aef-3ec880b54f57 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:05.958881 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c339f204-28b0-4d35-9aef-3ec880b54f57 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:05.961347 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c339f204-28b0-4d35-9aef-3ec880b54f57 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:05.964257 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c339f204-28b0-4d35-9aef-3ec880b54f57 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:05.971962 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c339f204-28b0-4d35-9aef-3ec880b54f57 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:05.987088 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c339f204-28b0-4d35-9aef-3ec880b54f57 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:06.088160 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-c339f204-28b0-4d35-9aef-3ec880b54f57 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Getting quotas for project e2f3ca3734da4d979112fb6145158b6b. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:18:06.127741 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-c339f204-28b0-4d35-9aef-3ec880b54f57 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Getting quotas for user 04f09f1b00bb4d859869dec5d973feaf and project e2f3ca3734da4d979112fb6145158b6b. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:18:06.189065 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c339f204-28b0-4d35-9aef-3ec880b54f57 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Going to run 1 instances... {{(pid=122257) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:18:06.191895 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c339f204-28b0-4d35-9aef-3ec880b54f57 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] [instance: d940519e-c387-4d22-904d-36b409572e81] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:18:06.298106 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c339f204-28b0-4d35-9aef-3ec880b54f57 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.730953 Aug 31 16:18:06.314254 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2334/4652] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:18:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 3750 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:18:06.321531 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-74c98b64-c28e-4db2-a54c-08e7bc24a7eb tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:06.322468 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-74c98b64-c28e-4db2-a54c-08e7bc24a7eb tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] [instance: d2d88bec-63be-4b0c-8497-e34d1bbb790f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:06.338295 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-74c98b64-c28e-4db2-a54c-08e7bc24a7eb tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:06.341495 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-74c98b64-c28e-4db2-a54c-08e7bc24a7eb tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:06.342252 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-74c98b64-c28e-4db2-a54c-08e7bc24a7eb tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:06.343246 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-74c98b64-c28e-4db2-a54c-08e7bc24a7eb tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:06.344008 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-74c98b64-c28e-4db2-a54c-08e7bc24a7eb tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:06.345222 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-74c98b64-c28e-4db2-a54c-08e7bc24a7eb tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:06.705579 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-fcbea2fd-d809-4484-829a-afbc42ea07fc tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8941ad0e6d4f9bab797d0f3a213c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2113ab47146243cb85d6d57bc608131a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:06.743367 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-fcbea2fd-d809-4484-829a-afbc42ea07fc tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] 10.222.0.61 "GET /compute/v2.1/servers/336a246f-7f3e-4073-b8bc-c35be2fa56a4" status: 200 len: 1317 microversion: 2.1 time: 1.719935 Aug 31 16:18:06.747907 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2319/4653] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:05 2022] GET /compute/v2.1/servers/336a246f-7f3e-4073-b8bc-c35be2fa56a4 => generated 1317 bytes in 1728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:18:06.759191 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ce7d763f-26dc-4101-bd38-b4b7220affed tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:06.800403 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ce7d763f-26dc-4101-bd38-b4b7220affed tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] [instance: d940519e-c387-4d22-904d-36b409572e81] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:06.812205 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-74c98b64-c28e-4db2-a54c-08e7bc24a7eb tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07ab61302b87448b84838a1be274b445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7ab6f24815407880276db1a6d76d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:06.838461 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:18:06.846386 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-74c98b64-c28e-4db2-a54c-08e7bc24a7eb tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07ab61302b87448b84838a1be274b445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7ab6f24815407880276db1a6d76d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:06.854203 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-74c98b64-c28e-4db2-a54c-08e7bc24a7eb tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07ab61302b87448b84838a1be274b445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7ab6f24815407880276db1a6d76d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:06.866374 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-74c98b64-c28e-4db2-a54c-08e7bc24a7eb tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] 10.222.0.61 "GET /compute/v2.1/servers/d2d88bec-63be-4b0c-8497-e34d1bbb790f" status: 200 len: 1400 microversion: 2.54 time: 0.541303 Aug 31 16:18:06.867369 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2335/4654] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:18:06 2022] GET /compute/v2.1/servers/d2d88bec-63be-4b0c-8497-e34d1bbb790f => generated 1400 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:18:06.901693 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2171cdeb-85aa-434f-86d5-bf1f5d027444 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Calling method '.version_select at 0x7f5ae8ec58b0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:06.966348 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2171cdeb-85aa-434f-86d5-bf1f5d027444 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1872269434" status: 204 len: 0 microversion: 2.54 time: 0.069514 Aug 31 16:18:06.971465 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2336/4655] 10.222.0.61 () {60 vars in 1319 bytes} [Wed Aug 31 16:18:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1872269434 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 31 16:18:06.997521 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-43c20727-7167-415d-9ee0-c8c9c9f29162 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:06.998505 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-43c20727-7167-415d-9ee0-c8c9c9f29162 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] [instance: d2d88bec-63be-4b0c-8497-e34d1bbb790f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:07.031875 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-43c20727-7167-415d-9ee0-c8c9c9f29162 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:07.032706 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-43c20727-7167-415d-9ee0-c8c9c9f29162 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:07.033437 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-43c20727-7167-415d-9ee0-c8c9c9f29162 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:07.046496 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-43c20727-7167-415d-9ee0-c8c9c9f29162 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:07.048500 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-43c20727-7167-415d-9ee0-c8c9c9f29162 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:07.048973 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-43c20727-7167-415d-9ee0-c8c9c9f29162 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:07.304468 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-43c20727-7167-415d-9ee0-c8c9c9f29162 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] [instance: d2d88bec-63be-4b0c-8497-e34d1bbb790f] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:18:07.598397 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:18:07.726533 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-43c20727-7167-415d-9ee0-c8c9c9f29162 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] 10.222.0.61 "DELETE /compute/v2.1/servers/d2d88bec-63be-4b0c-8497-e34d1bbb790f" status: 204 len: 0 microversion: 2.54 time: 0.737776 Aug 31 16:18:07.733699 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2337/4656] 10.222.0.61 () {60 vars in 1280 bytes} [Wed Aug 31 16:18:06 2022] DELETE /compute/v2.1/servers/d2d88bec-63be-4b0c-8497-e34d1bbb790f => generated 0 bytes in 745 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 16:18:07.754898 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4cd3b454-759f-4343-ba47-829e4013a6d2 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:07.756376 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4cd3b454-759f-4343-ba47-829e4013a6d2 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] [instance: d2d88bec-63be-4b0c-8497-e34d1bbb790f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:07.774569 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4cd3b454-759f-4343-ba47-829e4013a6d2 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:07.812877 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4cd3b454-759f-4343-ba47-829e4013a6d2 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:07.815751 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4cd3b454-759f-4343-ba47-829e4013a6d2 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:07.823818 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4cd3b454-759f-4343-ba47-829e4013a6d2 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:07.825324 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4cd3b454-759f-4343-ba47-829e4013a6d2 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:07.829247 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4cd3b454-759f-4343-ba47-829e4013a6d2 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:09.222852 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ce7d763f-26dc-4101-bd38-b4b7220affed tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f09f1b00bb4d859869dec5d973feaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f3ca3734da4d979112fb6145158b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:09.240677 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ce7d763f-26dc-4101-bd38-b4b7220affed tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] 10.222.0.61 "GET /compute/v2.1/servers/d940519e-c387-4d22-904d-36b409572e81" status: 200 len: 1223 microversion: 2.1 time: 2.491275 Aug 31 16:18:09.243968 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2320/4657] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:06 2022] GET /compute/v2.1/servers/d940519e-c387-4d22-904d-36b409572e81 => generated 1223 bytes in 2495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:18:09.260784 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3247a88f-ae06-4f2f-9a97-952dd44ffca8 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:09.263688 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3247a88f-ae06-4f2f-9a97-952dd44ffca8 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] [instance: 336a246f-7f3e-4073-b8bc-c35be2fa56a4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:09.267105 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-4cd3b454-759f-4343-ba47-829e4013a6d2 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07ab61302b87448b84838a1be274b445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7ab6f24815407880276db1a6d76d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:09.289722 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3247a88f-ae06-4f2f-9a97-952dd44ffca8 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:09.289982 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3247a88f-ae06-4f2f-9a97-952dd44ffca8 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:09.291889 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3247a88f-ae06-4f2f-9a97-952dd44ffca8 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:09.292858 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3247a88f-ae06-4f2f-9a97-952dd44ffca8 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:09.299564 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3247a88f-ae06-4f2f-9a97-952dd44ffca8 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:09.300580 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3247a88f-ae06-4f2f-9a97-952dd44ffca8 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:09.356852 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-4cd3b454-759f-4343-ba47-829e4013a6d2 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07ab61302b87448b84838a1be274b445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7ab6f24815407880276db1a6d76d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:09.368121 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-4cd3b454-759f-4343-ba47-829e4013a6d2 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07ab61302b87448b84838a1be274b445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7ab6f24815407880276db1a6d76d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:09.373010 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4cd3b454-759f-4343-ba47-829e4013a6d2 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] 10.222.0.61 "GET /compute/v2.1/servers/d2d88bec-63be-4b0c-8497-e34d1bbb790f" status: 200 len: 1406 microversion: 2.54 time: 1.629915 Aug 31 16:18:09.391384 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2338/4658] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:18:07 2022] GET /compute/v2.1/servers/d2d88bec-63be-4b0c-8497-e34d1bbb790f => generated 1406 bytes in 1657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:18:09.941783 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3247a88f-ae06-4f2f-9a97-952dd44ffca8 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8941ad0e6d4f9bab797d0f3a213c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2113ab47146243cb85d6d57bc608131a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:09.956400 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3247a88f-ae06-4f2f-9a97-952dd44ffca8 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] 10.222.0.61 "GET /compute/v2.1/servers/336a246f-7f3e-4073-b8bc-c35be2fa56a4" status: 200 len: 1506 microversion: 2.1 time: 0.708922 Aug 31 16:18:09.959262 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2321/4659] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:09 2022] GET /compute/v2.1/servers/336a246f-7f3e-4073-b8bc-c35be2fa56a4 => generated 1506 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:18:10.029937 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-485a3b29-00a1-4d1b-b3bf-f583be30e0a1 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:10.035291 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-485a3b29-00a1-4d1b-b3bf-f583be30e0a1 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] [instance: 336a246f-7f3e-4073-b8bc-c35be2fa56a4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:10.071339 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-485a3b29-00a1-4d1b-b3bf-f583be30e0a1 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:10.072196 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-485a3b29-00a1-4d1b-b3bf-f583be30e0a1 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:10.075626 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-485a3b29-00a1-4d1b-b3bf-f583be30e0a1 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:10.079414 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-485a3b29-00a1-4d1b-b3bf-f583be30e0a1 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:10.082114 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-485a3b29-00a1-4d1b-b3bf-f583be30e0a1 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:10.084484 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-485a3b29-00a1-4d1b-b3bf-f583be30e0a1 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:10.188666 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-485a3b29-00a1-4d1b-b3bf-f583be30e0a1 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] 10.222.0.61 "GET /compute/v2.1/servers/336a246f-7f3e-4073-b8bc-c35be2fa56a4/ips" status: 200 len: 109 microversion: 2.1 time: 0.176398 Aug 31 16:18:10.211614 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2339/4660] 10.222.0.61 () {58 vars in 1248 bytes} [Wed Aug 31 16:18:10 2022] GET /compute/v2.1/servers/336a246f-7f3e-4073-b8bc-c35be2fa56a4/ips => generated 109 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:18:10.242986 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9f39e98e-0eaf-43c6-9553-f17ffe02cdba tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:10.245939 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9f39e98e-0eaf-43c6-9553-f17ffe02cdba tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] [instance: 336a246f-7f3e-4073-b8bc-c35be2fa56a4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:10.274265 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9f39e98e-0eaf-43c6-9553-f17ffe02cdba tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:10.275841 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9f39e98e-0eaf-43c6-9553-f17ffe02cdba tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:10.279322 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1cdd89a6-05de-45ed-9977-6c616ebaf104 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:10.280187 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1cdd89a6-05de-45ed-9977-6c616ebaf104 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] [instance: d940519e-c387-4d22-904d-36b409572e81] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:10.280736 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9f39e98e-0eaf-43c6-9553-f17ffe02cdba tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:10.282486 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9f39e98e-0eaf-43c6-9553-f17ffe02cdba tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:10.283686 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9f39e98e-0eaf-43c6-9553-f17ffe02cdba tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:10.284861 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9f39e98e-0eaf-43c6-9553-f17ffe02cdba tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:10.311693 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1cdd89a6-05de-45ed-9977-6c616ebaf104 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:10.311693 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1cdd89a6-05de-45ed-9977-6c616ebaf104 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:10.314955 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1cdd89a6-05de-45ed-9977-6c616ebaf104 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:10.319157 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1cdd89a6-05de-45ed-9977-6c616ebaf104 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:10.319757 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1cdd89a6-05de-45ed-9977-6c616ebaf104 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:10.329578 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1cdd89a6-05de-45ed-9977-6c616ebaf104 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:10.376712 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9f39e98e-0eaf-43c6-9553-f17ffe02cdba tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] 10.222.0.61 "GET /compute/v2.1/servers/336a246f-7f3e-4073-b8bc-c35be2fa56a4/ips" status: 200 len: 109 microversion: 2.1 time: 0.160931 Aug 31 16:18:10.390701 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2322/4661] 10.222.0.61 () {58 vars in 1248 bytes} [Wed Aug 31 16:18:10 2022] GET /compute/v2.1/servers/336a246f-7f3e-4073-b8bc-c35be2fa56a4/ips => generated 109 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:18:10.409929 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-06e6986c-153a-46df-9e39-b946fd69d3e0 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:10.411624 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-06e6986c-153a-46df-9e39-b946fd69d3e0 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] [instance: 336a246f-7f3e-4073-b8bc-c35be2fa56a4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:10.429738 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-06e6986c-153a-46df-9e39-b946fd69d3e0 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:10.435671 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-06e6986c-153a-46df-9e39-b946fd69d3e0 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:10.436732 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-06e6986c-153a-46df-9e39-b946fd69d3e0 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:10.438187 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-06e6986c-153a-46df-9e39-b946fd69d3e0 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:10.439186 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-06e6986c-153a-46df-9e39-b946fd69d3e0 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:10.440338 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-06e6986c-153a-46df-9e39-b946fd69d3e0 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:10.515032 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-06e6986c-153a-46df-9e39-b946fd69d3e0 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] 10.222.0.61 "GET /compute/v2.1/servers/336a246f-7f3e-4073-b8bc-c35be2fa56a4/ips/tempest-ServerAddressesTestJSON-1725786907-network" status: 200 len: 94 microversion: 2.1 time: 0.115721 Aug 31 16:18:10.526955 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2323/4662] 10.222.0.61 () {58 vars in 1401 bytes} [Wed Aug 31 16:18:10 2022] GET /compute/v2.1/servers/336a246f-7f3e-4073-b8bc-c35be2fa56a4/ips/tempest-ServerAddressesTestJSON-1725786907-network => generated 94 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 16:18:10.537981 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2d5da9c3-11f2-49d0-9111-8b651a0e1e2f tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:10.540845 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2d5da9c3-11f2-49d0-9111-8b651a0e1e2f tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] [instance: d2d88bec-63be-4b0c-8497-e34d1bbb790f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:10.553770 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2d5da9c3-11f2-49d0-9111-8b651a0e1e2f tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:10.560547 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2d5da9c3-11f2-49d0-9111-8b651a0e1e2f tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:10.561294 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2d5da9c3-11f2-49d0-9111-8b651a0e1e2f tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:10.562210 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2d5da9c3-11f2-49d0-9111-8b651a0e1e2f tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:10.562865 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2d5da9c3-11f2-49d0-9111-8b651a0e1e2f tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:10.563450 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2d5da9c3-11f2-49d0-9111-8b651a0e1e2f tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:10.607372 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-1cdd89a6-05de-45ed-9977-6c616ebaf104 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f09f1b00bb4d859869dec5d973feaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f3ca3734da4d979112fb6145158b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:10.626147 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1cdd89a6-05de-45ed-9977-6c616ebaf104 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] 10.222.0.61 "GET /compute/v2.1/servers/d940519e-c387-4d22-904d-36b409572e81" status: 200 len: 1275 microversion: 2.1 time: 0.352401 Aug 31 16:18:10.637932 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2340/4663] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:10 2022] GET /compute/v2.1/servers/d940519e-c387-4d22-904d-36b409572e81 => generated 1275 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:18:10.656046 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e2ac3e09-8dd7-47b8-a6d5-58b4b5a1d126 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:10.661031 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e2ac3e09-8dd7-47b8-a6d5-58b4b5a1d126 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] [instance: 336a246f-7f3e-4073-b8bc-c35be2fa56a4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:10.714299 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e2ac3e09-8dd7-47b8-a6d5-58b4b5a1d126 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:10.731770 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e2ac3e09-8dd7-47b8-a6d5-58b4b5a1d126 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:10.734298 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e2ac3e09-8dd7-47b8-a6d5-58b4b5a1d126 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:10.737396 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e2ac3e09-8dd7-47b8-a6d5-58b4b5a1d126 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:10.739571 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e2ac3e09-8dd7-47b8-a6d5-58b4b5a1d126 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:10.740730 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e2ac3e09-8dd7-47b8-a6d5-58b4b5a1d126 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:10.845289 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-2d5da9c3-11f2-49d0-9111-8b651a0e1e2f tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07ab61302b87448b84838a1be274b445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7ab6f24815407880276db1a6d76d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:10.873315 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e2ac3e09-8dd7-47b8-a6d5-58b4b5a1d126 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] [instance: 336a246f-7f3e-4073-b8bc-c35be2fa56a4] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:18:10.875155 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-2d5da9c3-11f2-49d0-9111-8b651a0e1e2f tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07ab61302b87448b84838a1be274b445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7ab6f24815407880276db1a6d76d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:10.898607 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-2d5da9c3-11f2-49d0-9111-8b651a0e1e2f tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07ab61302b87448b84838a1be274b445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7ab6f24815407880276db1a6d76d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:10.901049 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2d5da9c3-11f2-49d0-9111-8b651a0e1e2f tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] 10.222.0.61 "GET /compute/v2.1/servers/d2d88bec-63be-4b0c-8497-e34d1bbb790f" status: 200 len: 1406 microversion: 2.54 time: 0.372722 Aug 31 16:18:10.902137 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2324/4664] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:18:10 2022] GET /compute/v2.1/servers/d2d88bec-63be-4b0c-8497-e34d1bbb790f => generated 1406 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:18:11.168962 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e2ac3e09-8dd7-47b8-a6d5-58b4b5a1d126 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] 10.222.0.61 "DELETE /compute/v2.1/servers/336a246f-7f3e-4073-b8bc-c35be2fa56a4" status: 204 len: 0 microversion: 2.1 time: 0.528156 Aug 31 16:18:11.170253 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2341/4665] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:18:10 2022] DELETE /compute/v2.1/servers/336a246f-7f3e-4073-b8bc-c35be2fa56a4 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:18:11.181420 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e06b2e1e-1fb8-43ef-a480-52432687a074 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:11.182556 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e06b2e1e-1fb8-43ef-a480-52432687a074 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] [instance: 336a246f-7f3e-4073-b8bc-c35be2fa56a4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:11.201960 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e06b2e1e-1fb8-43ef-a480-52432687a074 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:11.207668 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e06b2e1e-1fb8-43ef-a480-52432687a074 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:11.208751 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e06b2e1e-1fb8-43ef-a480-52432687a074 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:11.210466 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e06b2e1e-1fb8-43ef-a480-52432687a074 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:11.223993 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e06b2e1e-1fb8-43ef-a480-52432687a074 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:11.229868 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e06b2e1e-1fb8-43ef-a480-52432687a074 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:11.676289 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7b6b6b7c-e7f4-46c7-b71f-9f9db0ac6d7d tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:11.685028 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7b6b6b7c-e7f4-46c7-b71f-9f9db0ac6d7d tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] [instance: d940519e-c387-4d22-904d-36b409572e81] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:11.728508 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7b6b6b7c-e7f4-46c7-b71f-9f9db0ac6d7d tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:11.732018 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7b6b6b7c-e7f4-46c7-b71f-9f9db0ac6d7d tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:11.735939 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7b6b6b7c-e7f4-46c7-b71f-9f9db0ac6d7d tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:11.738362 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7b6b6b7c-e7f4-46c7-b71f-9f9db0ac6d7d tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:11.742138 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7b6b6b7c-e7f4-46c7-b71f-9f9db0ac6d7d tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:11.744948 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7b6b6b7c-e7f4-46c7-b71f-9f9db0ac6d7d tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:12.292991 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7b6b6b7c-e7f4-46c7-b71f-9f9db0ac6d7d tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f09f1b00bb4d859869dec5d973feaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f3ca3734da4d979112fb6145158b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:12.322058 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7b6b6b7c-e7f4-46c7-b71f-9f9db0ac6d7d tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] 10.222.0.61 "GET /compute/v2.1/servers/d940519e-c387-4d22-904d-36b409572e81" status: 200 len: 1283 microversion: 2.1 time: 0.660283 Aug 31 16:18:12.332383 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2342/4666] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:11 2022] GET /compute/v2.1/servers/d940519e-c387-4d22-904d-36b409572e81 => generated 1283 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:18:12.346632 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e06b2e1e-1fb8-43ef-a480-52432687a074 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8941ad0e6d4f9bab797d0f3a213c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2113ab47146243cb85d6d57bc608131a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:12.369300 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5a420e86-3c04-428e-9870-e6a245a78967 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:12.389262 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5a420e86-3c04-428e-9870-e6a245a78967 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] [instance: d2d88bec-63be-4b0c-8497-e34d1bbb790f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:12.393032 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e06b2e1e-1fb8-43ef-a480-52432687a074 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] 10.222.0.61 "GET /compute/v2.1/servers/336a246f-7f3e-4073-b8bc-c35be2fa56a4" status: 200 len: 1512 microversion: 2.1 time: 1.217377 Aug 31 16:18:12.408664 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2325/4667] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:11 2022] GET /compute/v2.1/servers/336a246f-7f3e-4073-b8bc-c35be2fa56a4 => generated 1512 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:18:12.419181 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5a420e86-3c04-428e-9870-e6a245a78967 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:12.420190 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5a420e86-3c04-428e-9870-e6a245a78967 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:12.420883 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5a420e86-3c04-428e-9870-e6a245a78967 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:12.421893 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5a420e86-3c04-428e-9870-e6a245a78967 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:12.423349 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5a420e86-3c04-428e-9870-e6a245a78967 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:12.427917 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5a420e86-3c04-428e-9870-e6a245a78967 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:12.471849 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:18:12.495988 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5a420e86-3c04-428e-9870-e6a245a78967 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:12.498426 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5a420e86-3c04-428e-9870-e6a245a78967 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:12.503483 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5a420e86-3c04-428e-9870-e6a245a78967 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:12.505673 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-5a420e86-3c04-428e-9870-e6a245a78967 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lazy-loading 'fault' on Instance uuid d2d88bec-63be-4b0c-8497-e34d1bbb790f {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:18:12.669120 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5a420e86-3c04-428e-9870-e6a245a78967 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07ab61302b87448b84838a1be274b445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7ab6f24815407880276db1a6d76d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:12.688763 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5a420e86-3c04-428e-9870-e6a245a78967 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07ab61302b87448b84838a1be274b445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7ab6f24815407880276db1a6d76d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:12.698426 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5a420e86-3c04-428e-9870-e6a245a78967 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07ab61302b87448b84838a1be274b445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7ab6f24815407880276db1a6d76d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:12.701830 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5a420e86-3c04-428e-9870-e6a245a78967 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] 10.222.0.61 "GET /compute/v2.1/servers/d2d88bec-63be-4b0c-8497-e34d1bbb790f" status: 200 len: 1411 microversion: 2.54 time: 0.367430 Aug 31 16:18:12.708293 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2343/4668] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:18:12 2022] GET /compute/v2.1/servers/d2d88bec-63be-4b0c-8497-e34d1bbb790f => generated 1411 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:18:13.132934 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-76f84316-a154-4594-b7c5-82688d304f7a tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-50160032", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "73549f6f-0b06-4956-9c44-ea3ca5b7ecda"}], "security_groups": [{"name": "tempest-securitygroup--68529419"}], "key_name": "tempest-keypair-549669063", "user_data": "}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:18:13.368402 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0fcd5a5d-304f-46e7-b01a-9e5ba943cb80 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:13.369630 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0fcd5a5d-304f-46e7-b01a-9e5ba943cb80 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] [instance: d940519e-c387-4d22-904d-36b409572e81] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:13.441229 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0fcd5a5d-304f-46e7-b01a-9e5ba943cb80 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:13.442880 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0fcd5a5d-304f-46e7-b01a-9e5ba943cb80 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:13.445849 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0fcd5a5d-304f-46e7-b01a-9e5ba943cb80 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:13.450632 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0fcd5a5d-304f-46e7-b01a-9e5ba943cb80 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:13.451741 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0fcd5a5d-304f-46e7-b01a-9e5ba943cb80 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:13.452489 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0fcd5a5d-304f-46e7-b01a-9e5ba943cb80 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:14.457612 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0fcd5a5d-304f-46e7-b01a-9e5ba943cb80 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f09f1b00bb4d859869dec5d973feaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f3ca3734da4d979112fb6145158b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:14.470489 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0fcd5a5d-304f-46e7-b01a-9e5ba943cb80 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] 10.222.0.61 "GET /compute/v2.1/servers/d940519e-c387-4d22-904d-36b409572e81" status: 200 len: 1281 microversion: 2.1 time: 1.125700 Aug 31 16:18:14.471090 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2344/4669] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:13 2022] GET /compute/v2.1/servers/d940519e-c387-4d22-904d-36b409572e81 => generated 1281 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:18:14.493534 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e9f4407e-f1fa-4ab2-986f-0f306a41afc2 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:14.497461 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e9f4407e-f1fa-4ab2-986f-0f306a41afc2 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] [instance: 336a246f-7f3e-4073-b8bc-c35be2fa56a4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:14.515231 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e9f4407e-f1fa-4ab2-986f-0f306a41afc2 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:14.516596 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e9f4407e-f1fa-4ab2-986f-0f306a41afc2 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:14.517297 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e9f4407e-f1fa-4ab2-986f-0f306a41afc2 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:14.528473 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e9f4407e-f1fa-4ab2-986f-0f306a41afc2 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:14.530859 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e9f4407e-f1fa-4ab2-986f-0f306a41afc2 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:14.534329 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e9f4407e-f1fa-4ab2-986f-0f306a41afc2 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:15.294756 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e9f4407e-f1fa-4ab2-986f-0f306a41afc2 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8941ad0e6d4f9bab797d0f3a213c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2113ab47146243cb85d6d57bc608131a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:15.308432 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e9f4407e-f1fa-4ab2-986f-0f306a41afc2 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] 10.222.0.61 "GET /compute/v2.1/servers/336a246f-7f3e-4073-b8bc-c35be2fa56a4" status: 200 len: 1512 microversion: 2.1 time: 0.832129 Aug 31 16:18:15.318758 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2345/4670] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:14 2022] GET /compute/v2.1/servers/336a246f-7f3e-4073-b8bc-c35be2fa56a4 => generated 1512 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:18:15.333684 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d872787f-1277-4c27-b623-dfe276d170e3 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:15.334941 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d872787f-1277-4c27-b623-dfe276d170e3 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] [instance: d2d88bec-63be-4b0c-8497-e34d1bbb790f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:15.362929 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-76f84316-a154-4594-b7c5-82688d304f7a tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] validate_networks() for [('73549f6f-0b06-4956-9c44-ea3ca5b7ecda', None, None, None, None, None)] {{(pid=122256) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:18:15.366610 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d872787f-1277-4c27-b623-dfe276d170e3 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:15.367331 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d872787f-1277-4c27-b623-dfe276d170e3 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:15.367825 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d872787f-1277-4c27-b623-dfe276d170e3 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:15.368567 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d872787f-1277-4c27-b623-dfe276d170e3 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:15.373227 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d872787f-1277-4c27-b623-dfe276d170e3 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:15.373770 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d872787f-1277-4c27-b623-dfe276d170e3 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:15.402810 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-d872787f-1277-4c27-b623-dfe276d170e3 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] HTTP exception thrown: Instance d2d88bec-63be-4b0c-8497-e34d1bbb790f could not be found. Aug 31 16:18:15.404616 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d872787f-1277-4c27-b623-dfe276d170e3 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Request method failure captured: Aug 31 16:18:15.404616 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/d2d88bec-63be-4b0c-8497-e34d1bbb790f HTTP/1.1 Aug 31 16:18:15.404616 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:18:15.404616 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:18:15.404616 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:18:15.404616 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:18:15.404616 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:18:15.404616 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:18:15.404616 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:18:15.404616 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:18:15.404616 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4mOurBU2bPAQCxRYBGqofTdAOpGPk1iiI7iZ5rQzOjC2BoRcnLdCQNGuF6p4wFvXsNqHO5RiB0FSbToJ6BC12tcQW7SJEc561rtOEK9R-eY2M0s97sXpO9ir1Q9H_TjunQufhivaLWtz5Tk8DJdLA6OtoZAyAiPGLfKPsHw6wSyjUI Aug 31 16:18:15.404616 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:18:15.404616 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:18:15.404616 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:18:15.404616 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:18:15.404616 n-d-850499-9 devstack@n-api.service[122257]: X-Openstack-Nova-Api-Version: 2.54 Aug 31 16:18:15.404616 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:18:15.404616 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:18:15.404616 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 9d7ab6f24815407880276db1a6d76d27 Aug 31 16:18:15.404616 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ServerShowV254Test-1705660232 Aug 31 16:18:15.404616 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:18:15.404616 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:18:15.404616 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9d7ab6f24815407880276db1a6d76d27"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9d7ab6f24815407880276db1a6d76d27"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9d7ab6f24815407880276db1a6d76d27", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9d7ab6f24815407880276db1a6d76d27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:18:15.404616 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ServerShowV254Test-1705660232 Aug 31 16:18:15.404616 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 9d7ab6f24815407880276db1a6d76d27 Aug 31 16:18:15.404616 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ServerShowV254Test-1705660232 Aug 31 16:18:15.404616 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ServerShowV254Test-1705660232-project Aug 31 16:18:15.404616 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:18:15.404616 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:18:15.404616 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 07ab61302b87448b84838a1be274b445 Aug 31 16:18:15.404616 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ServerShowV254Test-1705660232-project Aug 31 16:18:15.404616 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:18:15.404616 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance d2d88bec-63be-4b0c-8497-e34d1bbb790f could not be found. Aug 31 16:18:15.404616 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': 'd2d88bec-63be-4b0c-8497-e34d1bbb790f'} Aug 31 16:18:15.404616 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:18:15.404616 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:18:15.404616 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:18:15.404616 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:18:15.404616 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:18:15.404616 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:18:15.404616 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:18:15.404616 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:18:15.404616 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:18:15.404616 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:18:15.404616 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2d88bec-63be-4b0c-8497-e34d1bbb790f could not be found. Aug 31 16:18:15.404616 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:18:15.404616 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:18:15.404616 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:18:15.404616 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:18:15.404616 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:18:15.404616 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:18:15.404616 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:18:15.404616 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:18:15.404616 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:18:15.404616 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:18:15.404616 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:18:15.404616 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:18:15.404616 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:18:15.404616 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:18:15.404616 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:18:15.404616 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:18:15.404616 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2d88bec-63be-4b0c-8497-e34d1bbb790f could not be found. Aug 31 16:18:15.404616 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:18:15.404616 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:18:15.404616 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:18:15.412118 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:18:15.412118 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:18:15.412118 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:18:15.412118 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:18:15.412118 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:18:15.412118 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2d88bec-63be-4b0c-8497-e34d1bbb790f could not be found. Aug 31 16:18:15.412118 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:18:15.412118 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d872787f-1277-4c27-b623-dfe276d170e3 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] Returning 404 to user: Instance d2d88bec-63be-4b0c-8497-e34d1bbb790f could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:18:15.412118 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d872787f-1277-4c27-b623-dfe276d170e3 tempest-ServerShowV254Test-1705660232 tempest-ServerShowV254Test-1705660232-project] 10.222.0.61 "GET /compute/v2.1/servers/d2d88bec-63be-4b0c-8497-e34d1bbb790f" status: 404 len: 111 microversion: 2.54 time: 0.085521 Aug 31 16:18:15.412118 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2346/4671] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:18:15 2022] GET /compute/v2.1/servers/d2d88bec-63be-4b0c-8497-e34d1bbb790f => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:18:15.509123 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4ced0d22-cf7e-4c77-8e50-33548ddf5492 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:15.510530 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4ced0d22-cf7e-4c77-8e50-33548ddf5492 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] [instance: d940519e-c387-4d22-904d-36b409572e81] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:15.525025 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4ced0d22-cf7e-4c77-8e50-33548ddf5492 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:15.529224 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4ced0d22-cf7e-4c77-8e50-33548ddf5492 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:15.532996 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4ced0d22-cf7e-4c77-8e50-33548ddf5492 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:15.534663 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4ced0d22-cf7e-4c77-8e50-33548ddf5492 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:15.540361 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4ced0d22-cf7e-4c77-8e50-33548ddf5492 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:15.541664 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4ced0d22-cf7e-4c77-8e50-33548ddf5492 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:16.034687 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:18:16.173979 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=10 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:18:16.781340 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-4ced0d22-cf7e-4c77-8e50-33548ddf5492 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f09f1b00bb4d859869dec5d973feaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f3ca3734da4d979112fb6145158b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:16.804496 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4ced0d22-cf7e-4c77-8e50-33548ddf5492 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] 10.222.0.61 "GET /compute/v2.1/servers/d940519e-c387-4d22-904d-36b409572e81" status: 200 len: 1323 microversion: 2.1 time: 1.299974 Aug 31 16:18:16.820133 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2347/4672] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:15 2022] GET /compute/v2.1/servers/d940519e-c387-4d22-904d-36b409572e81 => generated 1323 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:18:16.827639 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f76a1e1c-f95e-4925-b15b-85b74acc7ffd tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:16.828827 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f76a1e1c-f95e-4925-b15b-85b74acc7ffd tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] [instance: 336a246f-7f3e-4073-b8bc-c35be2fa56a4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:16.851491 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f76a1e1c-f95e-4925-b15b-85b74acc7ffd tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:16.856035 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f76a1e1c-f95e-4925-b15b-85b74acc7ffd tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:16.857185 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f76a1e1c-f95e-4925-b15b-85b74acc7ffd tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:16.860042 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f76a1e1c-f95e-4925-b15b-85b74acc7ffd tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:16.864385 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f76a1e1c-f95e-4925-b15b-85b74acc7ffd tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:16.865334 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f76a1e1c-f95e-4925-b15b-85b74acc7ffd tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:18.209007 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-76f84316-a154-4594-b7c5-82688d304f7a tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:18:18.211545 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-76f84316-a154-4594-b7c5-82688d304f7a tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:18:18.212484 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-76f84316-a154-4594-b7c5-82688d304f7a tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:18:18.213506 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-76f84316-a154-4594-b7c5-82688d304f7a tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:18:18.214487 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-76f84316-a154-4594-b7c5-82688d304f7a tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:18:18.266828 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-76f84316-a154-4594-b7c5-82688d304f7a tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:18.276081 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-76f84316-a154-4594-b7c5-82688d304f7a tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:18.290202 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-76f84316-a154-4594-b7c5-82688d304f7a tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:18.291298 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-76f84316-a154-4594-b7c5-82688d304f7a tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:18.291996 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-76f84316-a154-4594-b7c5-82688d304f7a tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:18.292630 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-76f84316-a154-4594-b7c5-82688d304f7a tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:18.402518 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-76f84316-a154-4594-b7c5-82688d304f7a tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Getting quotas for project 3511432a7dee4bec9d1093c9d95b3734. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:18:18.438064 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f76a1e1c-f95e-4925-b15b-85b74acc7ffd tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8941ad0e6d4f9bab797d0f3a213c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2113ab47146243cb85d6d57bc608131a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:18.451046 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-76f84316-a154-4594-b7c5-82688d304f7a tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Getting quotas for user 4ed06378eb9b446680b5a3156a14941d and project 3511432a7dee4bec9d1093c9d95b3734. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:18:18.484198 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f76a1e1c-f95e-4925-b15b-85b74acc7ffd tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] 10.222.0.61 "GET /compute/v2.1/servers/336a246f-7f3e-4073-b8bc-c35be2fa56a4" status: 200 len: 1512 microversion: 2.1 time: 1.650935 Aug 31 16:18:18.485453 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2348/4673] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:16 2022] GET /compute/v2.1/servers/336a246f-7f3e-4073-b8bc-c35be2fa56a4 => generated 1512 bytes in 1664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:18:18.508423 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6cb9816c-b143-4575-a798-e9dbbf656971 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:18.509896 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6cb9816c-b143-4575-a798-e9dbbf656971 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] [instance: d940519e-c387-4d22-904d-36b409572e81] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:18.533382 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-76f84316-a154-4594-b7c5-82688d304f7a tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Going to run 1 instances... {{(pid=122256) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:18:18.536050 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-76f84316-a154-4594-b7c5-82688d304f7a tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] [instance: cca485b3-25f2-4a77-a23a-bb9758586ce7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:18:18.536969 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6cb9816c-b143-4575-a798-e9dbbf656971 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:18.537896 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6cb9816c-b143-4575-a798-e9dbbf656971 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:18.538820 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6cb9816c-b143-4575-a798-e9dbbf656971 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:18.539834 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6cb9816c-b143-4575-a798-e9dbbf656971 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:18.541835 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6cb9816c-b143-4575-a798-e9dbbf656971 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:18.544881 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6cb9816c-b143-4575-a798-e9dbbf656971 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:18.779346 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-76f84316-a154-4594-b7c5-82688d304f7a tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 5.658710 Aug 31 16:18:18.790253 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2326/4674] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:18:13 2022] POST /compute/v2.1/servers => generated 400 bytes in 5671 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:18:19.195950 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-37007ea3-50a7-4f4e-becd-bafe063ec5e8 req-a95ec215-8bff-44a3-83c8-d1a4ecfadd41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d940519e-c387-4d22-904d-36b409572e81", "tag": "00262e2b-bbe8-42c0-accb-326fffad9f54"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:18:19.257968 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-37007ea3-50a7-4f4e-becd-bafe063ec5e8 req-a95ec215-8bff-44a3-83c8-d1a4ecfadd41 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:19.262634 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-37007ea3-50a7-4f4e-becd-bafe063ec5e8 req-a95ec215-8bff-44a3-83c8-d1a4ecfadd41 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:19.264150 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-37007ea3-50a7-4f4e-becd-bafe063ec5e8 req-a95ec215-8bff-44a3-83c8-d1a4ecfadd41 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:19.337935 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-37007ea3-50a7-4f4e-becd-bafe063ec5e8 req-a95ec215-8bff-44a3-83c8-d1a4ecfadd41 service nova] Creating event network-changed:00262e2b-bbe8-42c0-accb-326fffad9f54 for instance d940519e-c387-4d22-904d-36b409572e81 on n-h1-850499-9 Aug 31 16:18:19.367885 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-37007ea3-50a7-4f4e-becd-bafe063ec5e8 req-a95ec215-8bff-44a3-83c8-d1a4ecfadd41 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.575176 Aug 31 16:18:19.379310 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2327/4675] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:18:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:18:19.426985 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-f8363347-a45f-4953-991e-dbf45310cdf0 req-ae356f02-0684-4a8c-a691-07fc69bb990b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "336a246f-7f3e-4073-b8bc-c35be2fa56a4", "name": "network-vif-deleted", "tag": "f2c2b358-fae2-4e68-b84d-93afa20b9c7d"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:18:19.514253 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-f8363347-a45f-4953-991e-dbf45310cdf0 req-ae356f02-0684-4a8c-a691-07fc69bb990b service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:19.515027 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-f8363347-a45f-4953-991e-dbf45310cdf0 req-ae356f02-0684-4a8c-a691-07fc69bb990b service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:19.516317 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-f8363347-a45f-4953-991e-dbf45310cdf0 req-ae356f02-0684-4a8c-a691-07fc69bb990b service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:19.574930 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-f8363347-a45f-4953-991e-dbf45310cdf0 req-ae356f02-0684-4a8c-a691-07fc69bb990b service nova] Creating event network-vif-deleted:f2c2b358-fae2-4e68-b84d-93afa20b9c7d for instance 336a246f-7f3e-4073-b8bc-c35be2fa56a4 on n-h2-850499-9 Aug 31 16:18:19.600188 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-f8363347-a45f-4953-991e-dbf45310cdf0 req-ae356f02-0684-4a8c-a691-07fc69bb990b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.217506 Aug 31 16:18:19.603073 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2328/4676] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:18:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:18:19.626829 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2f45a992-a0dd-4832-8ae4-9af43b4c5fc9 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:19.628562 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2f45a992-a0dd-4832-8ae4-9af43b4c5fc9 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] [instance: cca485b3-25f2-4a77-a23a-bb9758586ce7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:19.877760 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-6cb9816c-b143-4575-a798-e9dbbf656971 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f09f1b00bb4d859869dec5d973feaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f3ca3734da4d979112fb6145158b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:19.911330 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6cb9816c-b143-4575-a798-e9dbbf656971 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] 10.222.0.61 "GET /compute/v2.1/servers/d940519e-c387-4d22-904d-36b409572e81" status: 200 len: 1323 microversion: 2.1 time: 1.421582 Aug 31 16:18:19.916822 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2349/4677] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:18 2022] GET /compute/v2.1/servers/d940519e-c387-4d22-904d-36b409572e81 => generated 1323 bytes in 1428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:18:19.954413 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4490c784-681f-4899-8b45-1a111e15ff61 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:19.962906 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4490c784-681f-4899-8b45-1a111e15ff61 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] [instance: 336a246f-7f3e-4073-b8bc-c35be2fa56a4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:19.996148 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4490c784-681f-4899-8b45-1a111e15ff61 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:20.001569 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4490c784-681f-4899-8b45-1a111e15ff61 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:20.003783 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4490c784-681f-4899-8b45-1a111e15ff61 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:20.006054 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4490c784-681f-4899-8b45-1a111e15ff61 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:20.008366 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4490c784-681f-4899-8b45-1a111e15ff61 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:20.010268 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4490c784-681f-4899-8b45-1a111e15ff61 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:20.054484 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-2f45a992-a0dd-4832-8ae4-9af43b4c5fc9 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed06378eb9b446680b5a3156a14941d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511432a7dee4bec9d1093c9d95b3734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:20.065081 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2f45a992-a0dd-4832-8ae4-9af43b4c5fc9 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] 10.222.0.61 "GET /compute/v2.1/servers/cca485b3-25f2-4a77-a23a-bb9758586ce7" status: 200 len: 1235 microversion: 2.1 time: 0.460048 Aug 31 16:18:20.084857 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2329/4678] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:19 2022] GET /compute/v2.1/servers/cca485b3-25f2-4a77-a23a-bb9758586ce7 => generated 1235 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:18:20.085640 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-4490c784-681f-4899-8b45-1a111e15ff61 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] HTTP exception thrown: Instance 336a246f-7f3e-4073-b8bc-c35be2fa56a4 could not be found. Aug 31 16:18:20.088005 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4490c784-681f-4899-8b45-1a111e15ff61 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Request method failure captured: Aug 31 16:18:20.088005 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/336a246f-7f3e-4073-b8bc-c35be2fa56a4 HTTP/1.1 Aug 31 16:18:20.088005 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:18:20.088005 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:18:20.088005 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:18:20.088005 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:18:20.088005 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:18:20.088005 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:18:20.088005 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:18:20.088005 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:18:20.088005 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4mh2VqvxKS4UNahDKF-BBy_szkMHP9ZoDbApb8z_mj73DycV1Q-rnpQtWpNDMTorv2aG-GjGRYzJmyZ0iC28c7syU0B9mEdHJxRevCHnJpYoph0YLOrhjmtuDT1Eezm1Ki0nyM8gPjDIV5iUHYF-5wyW8ig3VTn3TdmhwhKeTblXiU Aug 31 16:18:20.088005 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:18:20.088005 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:18:20.088005 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:18:20.088005 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:18:20.088005 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:18:20.088005 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:18:20.088005 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 2113ab47146243cb85d6d57bc608131a Aug 31 16:18:20.088005 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ServerAddressesTestJSON-906053131 Aug 31 16:18:20.088005 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:18:20.088005 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:18:20.088005 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2113ab47146243cb85d6d57bc608131a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/2113ab47146243cb85d6d57bc608131a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_2113ab47146243cb85d6d57bc608131a", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2113ab47146243cb85d6d57bc608131a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:18:20.088005 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ServerAddressesTestJSON-906053131 Aug 31 16:18:20.088005 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 2113ab47146243cb85d6d57bc608131a Aug 31 16:18:20.088005 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ServerAddressesTestJSON-906053131 Aug 31 16:18:20.088005 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ServerAddressesTestJSON-906053131-project Aug 31 16:18:20.088005 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:18:20.088005 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:18:20.088005 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 0f8941ad0e6d4f9bab797d0f3a213c09 Aug 31 16:18:20.088005 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ServerAddressesTestJSON-906053131-project Aug 31 16:18:20.088005 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:18:20.088005 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance 336a246f-7f3e-4073-b8bc-c35be2fa56a4 could not be found. Aug 31 16:18:20.088005 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '336a246f-7f3e-4073-b8bc-c35be2fa56a4'} Aug 31 16:18:20.088005 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:18:20.088005 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:18:20.088005 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:18:20.088005 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:18:20.088005 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:18:20.088005 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:18:20.088005 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:18:20.088005 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:18:20.088005 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:18:20.088005 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:18:20.088005 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 336a246f-7f3e-4073-b8bc-c35be2fa56a4 could not be found. Aug 31 16:18:20.088005 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:18:20.088005 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:18:20.088005 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:18:20.088005 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:18:20.088005 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:18:20.088005 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:18:20.088005 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:18:20.088005 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:18:20.088005 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:18:20.088005 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:18:20.088005 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:18:20.088005 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:18:20.088005 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:18:20.088005 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:18:20.088005 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:18:20.088005 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:18:20.088005 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 336a246f-7f3e-4073-b8bc-c35be2fa56a4 could not be found. Aug 31 16:18:20.088005 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:18:20.088005 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:18:20.088005 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:18:20.092535 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:18:20.092535 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:18:20.092535 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:18:20.092535 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:18:20.092535 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:18:20.092535 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 336a246f-7f3e-4073-b8bc-c35be2fa56a4 could not be found. Aug 31 16:18:20.092535 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:18:20.096447 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4490c784-681f-4899-8b45-1a111e15ff61 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] Returning 404 to user: Instance 336a246f-7f3e-4073-b8bc-c35be2fa56a4 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:18:20.097466 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4490c784-681f-4899-8b45-1a111e15ff61 tempest-ServerAddressesTestJSON-906053131 tempest-ServerAddressesTestJSON-906053131-project] 10.222.0.61 "GET /compute/v2.1/servers/336a246f-7f3e-4073-b8bc-c35be2fa56a4" status: 404 len: 111 microversion: 2.1 time: 0.174878 Aug 31 16:18:20.103486 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2350/4679] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:19 2022] GET /compute/v2.1/servers/336a246f-7f3e-4073-b8bc-c35be2fa56a4 => generated 111 bytes in 181 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:18:20.952702 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e538fc72-f8e0-4c98-8a63-ab3de5d922e2 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:20.954613 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e538fc72-f8e0-4c98-8a63-ab3de5d922e2 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] [instance: d940519e-c387-4d22-904d-36b409572e81] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:20.992615 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e538fc72-f8e0-4c98-8a63-ab3de5d922e2 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:21.005541 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e538fc72-f8e0-4c98-8a63-ab3de5d922e2 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:21.009659 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e538fc72-f8e0-4c98-8a63-ab3de5d922e2 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:21.013821 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e538fc72-f8e0-4c98-8a63-ab3de5d922e2 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:21.015856 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e538fc72-f8e0-4c98-8a63-ab3de5d922e2 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:21.016327 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e538fc72-f8e0-4c98-8a63-ab3de5d922e2 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:21.097047 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8b91403e-3bb3-45ae-ab51-6c9240bcb82a tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:21.097679 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8b91403e-3bb3-45ae-ab51-6c9240bcb82a tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] [instance: cca485b3-25f2-4a77-a23a-bb9758586ce7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:21.127324 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b91403e-3bb3-45ae-ab51-6c9240bcb82a tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:21.127803 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b91403e-3bb3-45ae-ab51-6c9240bcb82a tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:21.128283 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b91403e-3bb3-45ae-ab51-6c9240bcb82a tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:21.129028 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b91403e-3bb3-45ae-ab51-6c9240bcb82a tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:21.129514 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b91403e-3bb3-45ae-ab51-6c9240bcb82a tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:21.129958 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b91403e-3bb3-45ae-ab51-6c9240bcb82a tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:21.591948 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8b91403e-3bb3-45ae-ab51-6c9240bcb82a tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed06378eb9b446680b5a3156a14941d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511432a7dee4bec9d1093c9d95b3734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:21.612279 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8b91403e-3bb3-45ae-ab51-6c9240bcb82a tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] 10.222.0.61 "GET /compute/v2.1/servers/cca485b3-25f2-4a77-a23a-bb9758586ce7" status: 200 len: 1287 microversion: 2.1 time: 0.521838 Aug 31 16:18:21.628335 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2351/4680] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:21 2022] GET /compute/v2.1/servers/cca485b3-25f2-4a77-a23a-bb9758586ce7 => generated 1287 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:18:22.436840 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e538fc72-f8e0-4c98-8a63-ab3de5d922e2 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f09f1b00bb4d859869dec5d973feaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f3ca3734da4d979112fb6145158b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:22.517132 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e538fc72-f8e0-4c98-8a63-ab3de5d922e2 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] 10.222.0.61 "GET /compute/v2.1/servers/d940519e-c387-4d22-904d-36b409572e81" status: 200 len: 1323 microversion: 2.1 time: 1.570612 Aug 31 16:18:22.550373 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2330/4681] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:20 2022] GET /compute/v2.1/servers/d940519e-c387-4d22-904d-36b409572e81 => generated 1323 bytes in 1606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:18:22.654658 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7e44cd60-34fc-4e99-af89-3f5efdc1251c tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:22.655627 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7e44cd60-34fc-4e99-af89-3f5efdc1251c tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] [instance: cca485b3-25f2-4a77-a23a-bb9758586ce7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:22.685214 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7e44cd60-34fc-4e99-af89-3f5efdc1251c tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:22.685934 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7e44cd60-34fc-4e99-af89-3f5efdc1251c tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:22.686574 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7e44cd60-34fc-4e99-af89-3f5efdc1251c tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:22.704066 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7e44cd60-34fc-4e99-af89-3f5efdc1251c tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:22.704900 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7e44cd60-34fc-4e99-af89-3f5efdc1251c tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:22.705548 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7e44cd60-34fc-4e99-af89-3f5efdc1251c tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:23.575835 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0c9445db-30c0-409e-964e-fb426db49ec0 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:23.577209 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0c9445db-30c0-409e-964e-fb426db49ec0 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] [instance: d940519e-c387-4d22-904d-36b409572e81] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:23.588832 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0c9445db-30c0-409e-964e-fb426db49ec0 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:23.592246 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0c9445db-30c0-409e-964e-fb426db49ec0 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:23.592718 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0c9445db-30c0-409e-964e-fb426db49ec0 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:23.593505 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0c9445db-30c0-409e-964e-fb426db49ec0 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:23.593987 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0c9445db-30c0-409e-964e-fb426db49ec0 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:23.604360 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0c9445db-30c0-409e-964e-fb426db49ec0 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:24.511062 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7e44cd60-34fc-4e99-af89-3f5efdc1251c tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed06378eb9b446680b5a3156a14941d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511432a7dee4bec9d1093c9d95b3734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:24.525923 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7e44cd60-34fc-4e99-af89-3f5efdc1251c tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] 10.222.0.61 "GET /compute/v2.1/servers/cca485b3-25f2-4a77-a23a-bb9758586ce7" status: 200 len: 1293 microversion: 2.1 time: 1.877656 Aug 31 16:18:24.542569 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2352/4682] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:22 2022] GET /compute/v2.1/servers/cca485b3-25f2-4a77-a23a-bb9758586ce7 => generated 1293 bytes in 1895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:18:25.168350 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-0c9445db-30c0-409e-964e-fb426db49ec0 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f09f1b00bb4d859869dec5d973feaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f3ca3734da4d979112fb6145158b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:25.212212 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0c9445db-30c0-409e-964e-fb426db49ec0 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] 10.222.0.61 "GET /compute/v2.1/servers/d940519e-c387-4d22-904d-36b409572e81" status: 200 len: 1323 microversion: 2.1 time: 1.641053 Aug 31 16:18:25.219622 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2331/4683] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:23 2022] GET /compute/v2.1/servers/d940519e-c387-4d22-904d-36b409572e81 => generated 1323 bytes in 1649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:18:25.550340 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-71dedf5d-485b-400f-929d-667cd72fb238 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:25.550712 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-71dedf5d-485b-400f-929d-667cd72fb238 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] [instance: cca485b3-25f2-4a77-a23a-bb9758586ce7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:25.568807 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-71dedf5d-485b-400f-929d-667cd72fb238 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:25.570714 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-71dedf5d-485b-400f-929d-667cd72fb238 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:25.571429 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-71dedf5d-485b-400f-929d-667cd72fb238 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:25.572464 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-71dedf5d-485b-400f-929d-667cd72fb238 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:25.573099 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-71dedf5d-485b-400f-929d-667cd72fb238 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:25.573778 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-71dedf5d-485b-400f-929d-667cd72fb238 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:25.611880 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=100 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:18:25.814781 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-71dedf5d-485b-400f-929d-667cd72fb238 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed06378eb9b446680b5a3156a14941d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511432a7dee4bec9d1093c9d95b3734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:25.860956 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-71dedf5d-485b-400f-929d-667cd72fb238 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] 10.222.0.61 "GET /compute/v2.1/servers/cca485b3-25f2-4a77-a23a-bb9758586ce7" status: 200 len: 1293 microversion: 2.1 time: 0.311318 Aug 31 16:18:25.865472 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2332/4684] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:25 2022] GET /compute/v2.1/servers/cca485b3-25f2-4a77-a23a-bb9758586ce7 => generated 1293 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:18:26.271287 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-894a9630-511b-47bf-b724-561a757f7201 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:26.274186 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-894a9630-511b-47bf-b724-561a757f7201 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] [instance: d940519e-c387-4d22-904d-36b409572e81] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:26.338669 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-894a9630-511b-47bf-b724-561a757f7201 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:26.340122 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-894a9630-511b-47bf-b724-561a757f7201 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:26.340762 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-894a9630-511b-47bf-b724-561a757f7201 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:26.343022 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-894a9630-511b-47bf-b724-561a757f7201 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:26.351245 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-894a9630-511b-47bf-b724-561a757f7201 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:26.360922 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-894a9630-511b-47bf-b724-561a757f7201 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:26.588033 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0212f3e5-8532-4aa5-a45b-46f12bb22e1e tempest-VolumesGetTestJSON-1742897735 tempest-VolumesGetTestJSON-1742897735-project] Action: 'create', calling method: .version_select at 0x7f5ae8371ca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-2074646744", "metadata": {"Type": "work"}}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:18:27.038083 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-894a9630-511b-47bf-b724-561a757f7201 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f09f1b00bb4d859869dec5d973feaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f3ca3734da4d979112fb6145158b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:27.063370 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-894a9630-511b-47bf-b724-561a757f7201 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] 10.222.0.61 "GET /compute/v2.1/servers/d940519e-c387-4d22-904d-36b409572e81" status: 200 len: 1323 microversion: 2.1 time: 0.826270 Aug 31 16:18:27.067031 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2333/4685] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:26 2022] GET /compute/v2.1/servers/d940519e-c387-4d22-904d-36b409572e81 => generated 1323 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:18:27.090747 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c30216ad-b2a5-4bb5-adb6-a5225d490e35 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:27.097127 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c30216ad-b2a5-4bb5-adb6-a5225d490e35 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] [instance: cca485b3-25f2-4a77-a23a-bb9758586ce7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:27.155670 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c30216ad-b2a5-4bb5-adb6-a5225d490e35 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:27.156666 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c30216ad-b2a5-4bb5-adb6-a5225d490e35 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:27.162580 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c30216ad-b2a5-4bb5-adb6-a5225d490e35 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:27.172108 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c30216ad-b2a5-4bb5-adb6-a5225d490e35 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:27.173212 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c30216ad-b2a5-4bb5-adb6-a5225d490e35 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:27.175405 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c30216ad-b2a5-4bb5-adb6-a5225d490e35 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:27.638500 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c30216ad-b2a5-4bb5-adb6-a5225d490e35 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed06378eb9b446680b5a3156a14941d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511432a7dee4bec9d1093c9d95b3734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:27.655989 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c30216ad-b2a5-4bb5-adb6-a5225d490e35 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] 10.222.0.61 "GET /compute/v2.1/servers/cca485b3-25f2-4a77-a23a-bb9758586ce7" status: 200 len: 1293 microversion: 2.1 time: 0.586329 Aug 31 16:18:27.672236 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2334/4686] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:27 2022] GET /compute/v2.1/servers/cca485b3-25f2-4a77-a23a-bb9758586ce7 => generated 1293 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:18:27.795017 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0212f3e5-8532-4aa5-a45b-46f12bb22e1e tempest-VolumesGetTestJSON-1742897735 tempest-VolumesGetTestJSON-1742897735-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 2.288166 Aug 31 16:18:27.796779 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2353/4687] 10.222.0.61 () {60 vars in 1156 bytes} [Wed Aug 31 16:18:25 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 2291 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 31 16:18:27.814459 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d06179bd-7873-4922-bdc2-4cd133488a14 tempest-VolumesGetTestJSON-1742897735 tempest-VolumesGetTestJSON-1742897735-project] Calling method '.version_select at 0x7f5aed1d9790>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:27.970959 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d06179bd-7873-4922-bdc2-4cd133488a14 tempest-VolumesGetTestJSON-1742897735 tempest-VolumesGetTestJSON-1742897735-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/d658eda0-391a-4c44-a715-72c235a28ced" status: 200 len: 353 microversion: 2.1 time: 0.164293 Aug 31 16:18:27.971888 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2335/4688] 10.222.0.61 () {58 vars in 1245 bytes} [Wed Aug 31 16:18:27 2022] GET /compute/v2.1/os-volumes/d658eda0-391a-4c44-a715-72c235a28ced => generated 353 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:18:28.097710 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-82f711fc-6885-4770-8da1-a76a89de7612 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:28.098694 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-82f711fc-6885-4770-8da1-a76a89de7612 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] [instance: d940519e-c387-4d22-904d-36b409572e81] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:28.110369 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-82f711fc-6885-4770-8da1-a76a89de7612 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:28.111685 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-82f711fc-6885-4770-8da1-a76a89de7612 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:28.114104 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-82f711fc-6885-4770-8da1-a76a89de7612 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:28.115139 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-82f711fc-6885-4770-8da1-a76a89de7612 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:28.117122 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-82f711fc-6885-4770-8da1-a76a89de7612 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:28.117827 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-82f711fc-6885-4770-8da1-a76a89de7612 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:28.358057 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:18:28.366865 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-d11fe021-bc85-4e26-aaad-dfd5cbc8c8f5 req-05e0e0c1-d012-4b74-9b61-d3bbe1af32d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d940519e-c387-4d22-904d-36b409572e81", "name": "network-vif-plugged", "status": "completed", "tag": "00262e2b-bbe8-42c0-accb-326fffad9f54"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:18:28.408767 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-d11fe021-bc85-4e26-aaad-dfd5cbc8c8f5 req-05e0e0c1-d012-4b74-9b61-d3bbe1af32d6 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:28.410936 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-d11fe021-bc85-4e26-aaad-dfd5cbc8c8f5 req-05e0e0c1-d012-4b74-9b61-d3bbe1af32d6 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:28.413680 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-d11fe021-bc85-4e26-aaad-dfd5cbc8c8f5 req-05e0e0c1-d012-4b74-9b61-d3bbe1af32d6 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:28.473434 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-d11fe021-bc85-4e26-aaad-dfd5cbc8c8f5 req-05e0e0c1-d012-4b74-9b61-d3bbe1af32d6 service nova] Creating event network-vif-plugged:00262e2b-bbe8-42c0-accb-326fffad9f54 for instance d940519e-c387-4d22-904d-36b409572e81 on n-h1-850499-9 Aug 31 16:18:28.500991 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-d11fe021-bc85-4e26-aaad-dfd5cbc8c8f5 req-05e0e0c1-d012-4b74-9b61-d3bbe1af32d6 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143345 Aug 31 16:18:28.514388 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2336/4689] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:18:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 31 16:18:28.725175 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-fda3e4e4-2f64-48de-b13f-b7b40a58c533 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:28.740403 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-fda3e4e4-2f64-48de-b13f-b7b40a58c533 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] [instance: cca485b3-25f2-4a77-a23a-bb9758586ce7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:28.764299 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fda3e4e4-2f64-48de-b13f-b7b40a58c533 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:28.782119 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fda3e4e4-2f64-48de-b13f-b7b40a58c533 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:28.782762 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fda3e4e4-2f64-48de-b13f-b7b40a58c533 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:28.783686 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fda3e4e4-2f64-48de-b13f-b7b40a58c533 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:28.784279 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fda3e4e4-2f64-48de-b13f-b7b40a58c533 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:28.784982 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fda3e4e4-2f64-48de-b13f-b7b40a58c533 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:30.064263 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=10 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:18:30.553562 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-82f711fc-6885-4770-8da1-a76a89de7612 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f09f1b00bb4d859869dec5d973feaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f3ca3734da4d979112fb6145158b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:30.624738 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-82f711fc-6885-4770-8da1-a76a89de7612 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] 10.222.0.61 "GET /compute/v2.1/servers/d940519e-c387-4d22-904d-36b409572e81" status: 200 len: 1323 microversion: 2.1 time: 2.530879 Aug 31 16:18:30.635058 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2354/4690] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:28 2022] GET /compute/v2.1/servers/d940519e-c387-4d22-904d-36b409572e81 => generated 1323 bytes in 2542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:18:30.642880 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b01f60f4-eb22-4c0f-9440-9786e7709a64 tempest-VolumesGetTestJSON-1742897735 tempest-VolumesGetTestJSON-1742897735-project] Calling method '.version_select at 0x7f5aed214700>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:30.848933 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b01f60f4-eb22-4c0f-9440-9786e7709a64 tempest-VolumesGetTestJSON-1742897735 tempest-VolumesGetTestJSON-1742897735-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/d658eda0-391a-4c44-a715-72c235a28ced" status: 200 len: 353 microversion: 2.1 time: 0.210618 Aug 31 16:18:30.850928 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2355/4691] 10.222.0.61 () {58 vars in 1245 bytes} [Wed Aug 31 16:18:30 2022] GET /compute/v2.1/os-volumes/d658eda0-391a-4c44-a715-72c235a28ced => generated 353 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:18:31.183177 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-fda3e4e4-2f64-48de-b13f-b7b40a58c533 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed06378eb9b446680b5a3156a14941d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511432a7dee4bec9d1093c9d95b3734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:31.203769 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-fda3e4e4-2f64-48de-b13f-b7b40a58c533 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] 10.222.0.61 "GET /compute/v2.1/servers/cca485b3-25f2-4a77-a23a-bb9758586ce7" status: 200 len: 1359 microversion: 2.1 time: 2.495474 Aug 31 16:18:31.227006 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2337/4692] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:28 2022] GET /compute/v2.1/servers/cca485b3-25f2-4a77-a23a-bb9758586ce7 => generated 1359 bytes in 2519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:18:31.668430 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9f1ef27a-7d7c-45a0-b2b4-80a12c9ea4d8 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:31.671339 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9f1ef27a-7d7c-45a0-b2b4-80a12c9ea4d8 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] [instance: d940519e-c387-4d22-904d-36b409572e81] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:31.706500 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9f1ef27a-7d7c-45a0-b2b4-80a12c9ea4d8 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:31.710975 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9f1ef27a-7d7c-45a0-b2b4-80a12c9ea4d8 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:31.713977 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9f1ef27a-7d7c-45a0-b2b4-80a12c9ea4d8 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:31.723912 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9f1ef27a-7d7c-45a0-b2b4-80a12c9ea4d8 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:31.743896 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9f1ef27a-7d7c-45a0-b2b4-80a12c9ea4d8 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:31.750809 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9f1ef27a-7d7c-45a0-b2b4-80a12c9ea4d8 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:31.866968 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a513d7da-b63b-455b-b1e8-d15dc02212ba tempest-VolumesGetTestJSON-1742897735 tempest-VolumesGetTestJSON-1742897735-project] Calling method '.version_select at 0x7f5ae8d79280>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:31.975030 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a513d7da-b63b-455b-b1e8-d15dc02212ba tempest-VolumesGetTestJSON-1742897735 tempest-VolumesGetTestJSON-1742897735-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/d658eda0-391a-4c44-a715-72c235a28ced" status: 200 len: 354 microversion: 2.1 time: 0.113737 Aug 31 16:18:31.975895 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2338/4693] 10.222.0.61 () {58 vars in 1245 bytes} [Wed Aug 31 16:18:31 2022] GET /compute/v2.1/os-volumes/d658eda0-391a-4c44-a715-72c235a28ced => generated 354 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:18:31.989047 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3b8529c7-206f-4b3d-b6eb-e3e53e388801 tempest-VolumesGetTestJSON-1742897735 tempest-VolumesGetTestJSON-1742897735-project] Calling method '.version_select at 0x7f5ae8e37940>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:32.082397 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3b8529c7-206f-4b3d-b6eb-e3e53e388801 tempest-VolumesGetTestJSON-1742897735 tempest-VolumesGetTestJSON-1742897735-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/d658eda0-391a-4c44-a715-72c235a28ced" status: 200 len: 354 microversion: 2.1 time: 0.096354 Aug 31 16:18:32.084211 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2339/4694] 10.222.0.61 () {58 vars in 1245 bytes} [Wed Aug 31 16:18:31 2022] GET /compute/v2.1/os-volumes/d658eda0-391a-4c44-a715-72c235a28ced => generated 354 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:18:32.108820 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6be936b1-0a13-49c7-80c7-c7de90c041e9 tempest-VolumesGetTestJSON-1742897735 tempest-VolumesGetTestJSON-1742897735-project] Calling method '.version_select at 0x7f5ae8e37160>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:32.278784 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6be936b1-0a13-49c7-80c7-c7de90c041e9 tempest-VolumesGetTestJSON-1742897735 tempest-VolumesGetTestJSON-1742897735-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/d658eda0-391a-4c44-a715-72c235a28ced" status: 202 len: 0 microversion: 2.1 time: 0.176374 Aug 31 16:18:32.281926 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2340/4695] 10.222.0.61 () {58 vars in 1248 bytes} [Wed Aug 31 16:18:32 2022] DELETE /compute/v2.1/os-volumes/d658eda0-391a-4c44-a715-72c235a28ced => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 16:18:32.340771 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-eb667877-5933-4706-85cf-5a8e592f85f3 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:32.341401 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-eb667877-5933-4706-85cf-5a8e592f85f3 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] [instance: cca485b3-25f2-4a77-a23a-bb9758586ce7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:32.391181 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eb667877-5933-4706-85cf-5a8e592f85f3 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:32.391833 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eb667877-5933-4706-85cf-5a8e592f85f3 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:32.392196 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eb667877-5933-4706-85cf-5a8e592f85f3 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:32.392925 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eb667877-5933-4706-85cf-5a8e592f85f3 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:32.393386 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eb667877-5933-4706-85cf-5a8e592f85f3 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:32.393856 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eb667877-5933-4706-85cf-5a8e592f85f3 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:32.841141 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9f1ef27a-7d7c-45a0-b2b4-80a12c9ea4d8 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f09f1b00bb4d859869dec5d973feaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f3ca3734da4d979112fb6145158b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:32.872000 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9f1ef27a-7d7c-45a0-b2b4-80a12c9ea4d8 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] 10.222.0.61 "GET /compute/v2.1/servers/d940519e-c387-4d22-904d-36b409572e81" status: 200 len: 1520 microversion: 2.1 time: 1.207837 Aug 31 16:18:32.874650 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2356/4696] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:31 2022] GET /compute/v2.1/servers/d940519e-c387-4d22-904d-36b409572e81 => generated 1520 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:18:32.888953 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c72ceffd-5119-4bfd-b069-8f0217af0b0c tempest-VolumesGetTestJSON-1742897735 tempest-VolumesGetTestJSON-1742897735-project] Calling method '.version_select at 0x7f5aed214700>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:33.048804 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-eb667877-5933-4706-85cf-5a8e592f85f3 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed06378eb9b446680b5a3156a14941d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511432a7dee4bec9d1093c9d95b3734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:33.060660 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-eb667877-5933-4706-85cf-5a8e592f85f3 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] 10.222.0.61 "GET /compute/v2.1/servers/cca485b3-25f2-4a77-a23a-bb9758586ce7" status: 200 len: 1359 microversion: 2.1 time: 0.775339 Aug 31 16:18:33.080532 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2341/4697] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:32 2022] GET /compute/v2.1/servers/cca485b3-25f2-4a77-a23a-bb9758586ce7 => generated 1359 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:18:33.098210 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-225ad9de-8d2f-4edb-aeca-a705aa96692b tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:33.098830 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-225ad9de-8d2f-4edb-aeca-a705aa96692b tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] [instance: d940519e-c387-4d22-904d-36b409572e81] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:33.143264 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-225ad9de-8d2f-4edb-aeca-a705aa96692b tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:33.143655 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-225ad9de-8d2f-4edb-aeca-a705aa96692b tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:33.144287 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-225ad9de-8d2f-4edb-aeca-a705aa96692b tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:33.145188 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-225ad9de-8d2f-4edb-aeca-a705aa96692b tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:33.147247 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-225ad9de-8d2f-4edb-aeca-a705aa96692b tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:33.150465 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-225ad9de-8d2f-4edb-aeca-a705aa96692b tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:33.170702 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c72ceffd-5119-4bfd-b069-8f0217af0b0c tempest-VolumesGetTestJSON-1742897735 tempest-VolumesGetTestJSON-1742897735-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/d658eda0-391a-4c44-a715-72c235a28ced" status: 200 len: 353 microversion: 2.1 time: 0.294809 Aug 31 16:18:33.172272 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2357/4698] 10.222.0.61 () {58 vars in 1245 bytes} [Wed Aug 31 16:18:32 2022] GET /compute/v2.1/os-volumes/d658eda0-391a-4c44-a715-72c235a28ced => generated 353 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:18:33.272734 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-225ad9de-8d2f-4edb-aeca-a705aa96692b tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] HTTP exception thrown: Action 999 not found Aug 31 16:18:33.289787 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-225ad9de-8d2f-4edb-aeca-a705aa96692b tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Request method failure captured: Aug 31 16:18:33.289787 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/d940519e-c387-4d22-904d-36b409572e81/os-instance-actions/999 HTTP/1.1 Aug 31 16:18:33.289787 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:18:33.289787 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:18:33.289787 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:18:33.289787 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:18:33.289787 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:18:33.289787 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:18:33.289787 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:18:33.289787 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:18:33.289787 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4m6Vwp5zabSqss1y8M8JyjWpx917QSaqaWPOidb4kjNETPIxeRGTa2LiSz7h0DRqkPHf4MGCgOXLQyboY5iuNivYy97MOZNeqvJ9A14QA3wVPc6J7VdAr5vB1CTrT0dmvIOuv1nk2KIcaGgRYuytrEd1xyRz6u_tT-_r8tb-kiU3Ho Aug 31 16:18:33.289787 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:18:33.289787 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:18:33.289787 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:18:33.289787 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:18:33.289787 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:18:33.289787 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:18:33.289787 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: e2f3ca3734da4d979112fb6145158b6b Aug 31 16:18:33.289787 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1933355458 Aug 31 16:18:33.289787 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:18:33.289787 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:18:33.289787 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e2f3ca3734da4d979112fb6145158b6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/e2f3ca3734da4d979112fb6145158b6b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_e2f3ca3734da4d979112fb6145158b6b", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e2f3ca3734da4d979112fb6145158b6b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:18:33.289787 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1933355458 Aug 31 16:18:33.289787 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: e2f3ca3734da4d979112fb6145158b6b Aug 31 16:18:33.289787 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1933355458 Aug 31 16:18:33.289787 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-InstanceActionsNegativeTestJSON-1933355458-project Aug 31 16:18:33.289787 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:18:33.289787 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:18:33.289787 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 04f09f1b00bb4d859869dec5d973feaf Aug 31 16:18:33.289787 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1933355458-project Aug 31 16:18:33.289787 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:18:33.289787 n-d-850499-9 devstack@n-api.service[122256]: exception: Action 999 not found Aug 31 16:18:33.289787 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'server_id': 'd940519e-c387-4d22-904d-36b409572e81', 'id': '999'} Aug 31 16:18:33.289787 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:18:33.289787 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:18:33.289787 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:18:33.289787 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:18:33.289787 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:18:33.289787 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:18:33.289787 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:18:33.289787 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:18:33.289787 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Aug 31 16:18:33.289787 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 31 16:18:33.289787 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Aug 31 16:18:33.289787 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:18:33.289787 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:18:33.289787 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:18:33.289787 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:18:33.289787 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:18:33.289787 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:18:33.289787 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:18:33.289787 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:18:33.289787 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Aug 31 16:18:33.289787 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:18:33.301198 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-225ad9de-8d2f-4edb-aeca-a705aa96692b tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Returning 404 to user: Action 999 not found {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:18:33.303199 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-225ad9de-8d2f-4edb-aeca-a705aa96692b tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] 10.222.0.61 "GET /compute/v2.1/servers/d940519e-c387-4d22-904d-36b409572e81/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.221403 Aug 31 16:18:33.304713 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2342/4699] 10.222.0.61 () {58 vars in 1308 bytes} [Wed Aug 31 16:18:33 2022] GET /compute/v2.1/servers/d940519e-c387-4d22-904d-36b409572e81/os-instance-actions/999 => generated 66 bytes in 224 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 31 16:18:33.318141 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ea50b0b5-0422-4c71-8832-dcd5477b7e9c tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Calling method '.version_select at 0x7f5aed34d820>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:33.319858 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ea50b0b5-0422-4c71-8832-dcd5477b7e9c tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] [instance: bdc01c1f-6ab3-4cdd-bd5b-028d117f1cc2] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:33.330255 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-ea50b0b5-0422-4c71-8832-dcd5477b7e9c tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] HTTP exception thrown: Instance bdc01c1f-6ab3-4cdd-bd5b-028d117f1cc2 could not be found. Aug 31 16:18:33.336888 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ea50b0b5-0422-4c71-8832-dcd5477b7e9c tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Request method failure captured: Aug 31 16:18:33.336888 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/bdc01c1f-6ab3-4cdd-bd5b-028d117f1cc2/os-instance-actions HTTP/1.1 Aug 31 16:18:33.336888 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:18:33.336888 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:18:33.336888 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:18:33.336888 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:18:33.336888 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:18:33.336888 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:18:33.336888 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:18:33.336888 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:18:33.336888 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4m6Vwp5zabSqss1y8M8JyjWpx917QSaqaWPOidb4kjNETPIxeRGTa2LiSz7h0DRqkPHf4MGCgOXLQyboY5iuNivYy97MOZNeqvJ9A14QA3wVPc6J7VdAr5vB1CTrT0dmvIOuv1nk2KIcaGgRYuytrEd1xyRz6u_tT-_r8tb-kiU3Ho Aug 31 16:18:33.336888 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:18:33.336888 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:18:33.336888 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:18:33.336888 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:18:33.336888 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:18:33.336888 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:18:33.336888 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: e2f3ca3734da4d979112fb6145158b6b Aug 31 16:18:33.336888 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1933355458 Aug 31 16:18:33.336888 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:18:33.336888 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:18:33.336888 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e2f3ca3734da4d979112fb6145158b6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/e2f3ca3734da4d979112fb6145158b6b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_e2f3ca3734da4d979112fb6145158b6b", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e2f3ca3734da4d979112fb6145158b6b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:18:33.336888 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1933355458 Aug 31 16:18:33.336888 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: e2f3ca3734da4d979112fb6145158b6b Aug 31 16:18:33.336888 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1933355458 Aug 31 16:18:33.336888 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-InstanceActionsNegativeTestJSON-1933355458-project Aug 31 16:18:33.336888 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:18:33.336888 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:18:33.336888 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 04f09f1b00bb4d859869dec5d973feaf Aug 31 16:18:33.336888 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1933355458-project Aug 31 16:18:33.336888 n-d-850499-9 devstack@n-api.service[122257]: method: Aug 31 16:18:33.336888 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance bdc01c1f-6ab3-4cdd-bd5b-028d117f1cc2 could not be found. Aug 31 16:18:33.336888 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'server_id': 'bdc01c1f-6ab3-4cdd-bd5b-028d117f1cc2'} Aug 31 16:18:33.336888 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:18:33.336888 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:18:33.336888 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:18:33.336888 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:18:33.336888 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:18:33.336888 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:18:33.336888 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 31 16:18:33.336888 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 31 16:18:33.336888 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdc01c1f-6ab3-4cdd-bd5b-028d117f1cc2 could not be found. Aug 31 16:18:33.336888 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:18:33.336888 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:18:33.336888 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:18:33.336888 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:18:33.336888 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:18:33.336888 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:18:33.336888 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:18:33.336888 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:18:33.336888 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:18:33.336888 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:18:33.336888 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:18:33.336888 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:18:33.336888 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Aug 31 16:18:33.336888 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Aug 31 16:18:33.336888 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:18:33.336888 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:18:33.336888 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Aug 31 16:18:33.336888 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Aug 31 16:18:33.336888 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:18:33.336888 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:18:33.346848 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdc01c1f-6ab3-4cdd-bd5b-028d117f1cc2 could not be found. Aug 31 16:18:33.346848 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:18:33.346848 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:18:33.346848 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:18:33.346848 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:18:33.346848 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:18:33.346848 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:18:33.346848 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:18:33.346848 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:18:33.346848 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdc01c1f-6ab3-4cdd-bd5b-028d117f1cc2 could not be found. Aug 31 16:18:33.346848 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:18:33.346848 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ea50b0b5-0422-4c71-8832-dcd5477b7e9c tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Returning 404 to user: Instance bdc01c1f-6ab3-4cdd-bd5b-028d117f1cc2 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:18:33.346848 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ea50b0b5-0422-4c71-8832-dcd5477b7e9c tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] 10.222.0.61 "GET /compute/v2.1/servers/bdc01c1f-6ab3-4cdd-bd5b-028d117f1cc2/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.023203 Aug 31 16:18:33.351853 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-75db6f2d-8924-4843-894d-6c3ac0392163 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:33.352567 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-75db6f2d-8924-4843-894d-6c3ac0392163 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] [instance: d940519e-c387-4d22-904d-36b409572e81] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:33.360369 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2358/4700] 10.222.0.61 () {58 vars in 1296 bytes} [Wed Aug 31 16:18:33 2022] GET /compute/v2.1/servers/bdc01c1f-6ab3-4cdd-bd5b-028d117f1cc2/os-instance-actions => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:18:33.364952 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-75db6f2d-8924-4843-894d-6c3ac0392163 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:33.368049 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-75db6f2d-8924-4843-894d-6c3ac0392163 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:33.368958 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-75db6f2d-8924-4843-894d-6c3ac0392163 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:33.369943 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-75db6f2d-8924-4843-894d-6c3ac0392163 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:33.370585 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-75db6f2d-8924-4843-894d-6c3ac0392163 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:33.372390 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-75db6f2d-8924-4843-894d-6c3ac0392163 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:33.473768 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-75db6f2d-8924-4843-894d-6c3ac0392163 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] [instance: d940519e-c387-4d22-904d-36b409572e81] Going to try to terminate instance {{(pid=122256) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:18:33.860114 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-75db6f2d-8924-4843-894d-6c3ac0392163 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] 10.222.0.61 "DELETE /compute/v2.1/servers/d940519e-c387-4d22-904d-36b409572e81" status: 204 len: 0 microversion: 2.1 time: 0.511465 Aug 31 16:18:33.869953 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2343/4701] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:18:33 2022] DELETE /compute/v2.1/servers/d940519e-c387-4d22-904d-36b409572e81 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:18:33.884193 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-684cd2ed-a5b6-41bc-9e41-16fb3484dd90 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:33.885083 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-684cd2ed-a5b6-41bc-9e41-16fb3484dd90 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] [instance: d940519e-c387-4d22-904d-36b409572e81] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:33.944761 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-684cd2ed-a5b6-41bc-9e41-16fb3484dd90 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:33.945274 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-684cd2ed-a5b6-41bc-9e41-16fb3484dd90 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:33.945710 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-684cd2ed-a5b6-41bc-9e41-16fb3484dd90 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:33.954192 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-684cd2ed-a5b6-41bc-9e41-16fb3484dd90 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:33.955262 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-684cd2ed-a5b6-41bc-9e41-16fb3484dd90 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:33.956134 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-684cd2ed-a5b6-41bc-9e41-16fb3484dd90 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:34.128244 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c1a3f7bc-d726-454b-a2b0-054b9cdb9dd1 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:34.129469 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c1a3f7bc-d726-454b-a2b0-054b9cdb9dd1 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] [instance: cca485b3-25f2-4a77-a23a-bb9758586ce7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:34.149061 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c1a3f7bc-d726-454b-a2b0-054b9cdb9dd1 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:34.154574 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c1a3f7bc-d726-454b-a2b0-054b9cdb9dd1 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:34.161200 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c1a3f7bc-d726-454b-a2b0-054b9cdb9dd1 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:34.162311 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c1a3f7bc-d726-454b-a2b0-054b9cdb9dd1 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:34.165319 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c1a3f7bc-d726-454b-a2b0-054b9cdb9dd1 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:34.167133 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c1a3f7bc-d726-454b-a2b0-054b9cdb9dd1 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:35.828676 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c1a3f7bc-d726-454b-a2b0-054b9cdb9dd1 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed06378eb9b446680b5a3156a14941d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511432a7dee4bec9d1093c9d95b3734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:35.841539 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c1a3f7bc-d726-454b-a2b0-054b9cdb9dd1 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] 10.222.0.61 "GET /compute/v2.1/servers/cca485b3-25f2-4a77-a23a-bb9758586ce7" status: 200 len: 1359 microversion: 2.1 time: 1.732317 Aug 31 16:18:35.845755 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2344/4702] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:34 2022] GET /compute/v2.1/servers/cca485b3-25f2-4a77-a23a-bb9758586ce7 => generated 1359 bytes in 1738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:18:35.860024 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e716a152-eb0e-4f87-adf6-f7c4936f654d tempest-VolumesGetTestJSON-1742897735 tempest-VolumesGetTestJSON-1742897735-project] Calling method '.version_select at 0x7f5ae91cdf70>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:35.941639 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-684cd2ed-a5b6-41bc-9e41-16fb3484dd90 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f09f1b00bb4d859869dec5d973feaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f3ca3734da4d979112fb6145158b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:35.963710 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-684cd2ed-a5b6-41bc-9e41-16fb3484dd90 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] 10.222.0.61 "GET /compute/v2.1/servers/d940519e-c387-4d22-904d-36b409572e81" status: 200 len: 1526 microversion: 2.1 time: 2.085533 Aug 31 16:18:35.976080 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2359/4703] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:33 2022] GET /compute/v2.1/servers/d940519e-c387-4d22-904d-36b409572e81 => generated 1526 bytes in 2099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:18:35.983222 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-51073162-7086-43ff-a48f-7ef17ccda0a0 req-c0fd2064-8c21-4dfd-86ac-448c07e7fa97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cca485b3-25f2-4a77-a23a-bb9758586ce7", "tag": "7da488eb-1222-4197-97d6-7569af34909a"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:18:36.044864 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-51073162-7086-43ff-a48f-7ef17ccda0a0 req-c0fd2064-8c21-4dfd-86ac-448c07e7fa97 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:36.045892 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-51073162-7086-43ff-a48f-7ef17ccda0a0 req-c0fd2064-8c21-4dfd-86ac-448c07e7fa97 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:36.052780 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-51073162-7086-43ff-a48f-7ef17ccda0a0 req-c0fd2064-8c21-4dfd-86ac-448c07e7fa97 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:36.069181 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e716a152-eb0e-4f87-adf6-f7c4936f654d tempest-VolumesGetTestJSON-1742897735 tempest-VolumesGetTestJSON-1742897735-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/d658eda0-391a-4c44-a715-72c235a28ced" status: 200 len: 353 microversion: 2.1 time: 0.221279 Aug 31 16:18:36.070275 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2345/4704] 10.222.0.61 () {58 vars in 1245 bytes} [Wed Aug 31 16:18:35 2022] GET /compute/v2.1/os-volumes/d658eda0-391a-4c44-a715-72c235a28ced => generated 353 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:18:36.087000 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-51073162-7086-43ff-a48f-7ef17ccda0a0 req-c0fd2064-8c21-4dfd-86ac-448c07e7fa97 service nova] Creating event network-changed:7da488eb-1222-4197-97d6-7569af34909a for instance cca485b3-25f2-4a77-a23a-bb9758586ce7 on n-h2-850499-9 Aug 31 16:18:36.144382 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-51073162-7086-43ff-a48f-7ef17ccda0a0 req-c0fd2064-8c21-4dfd-86ac-448c07e7fa97 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.166693 Aug 31 16:18:36.149678 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2360/4705] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:18:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:18:36.868923 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f5d90b75-a56a-43a1-b4ae-34b8711eb5a3 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:36.869761 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f5d90b75-a56a-43a1-b4ae-34b8711eb5a3 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] [instance: cca485b3-25f2-4a77-a23a-bb9758586ce7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:36.910436 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f5d90b75-a56a-43a1-b4ae-34b8711eb5a3 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:36.914446 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f5d90b75-a56a-43a1-b4ae-34b8711eb5a3 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:36.919562 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f5d90b75-a56a-43a1-b4ae-34b8711eb5a3 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:36.929406 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f5d90b75-a56a-43a1-b4ae-34b8711eb5a3 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:36.930484 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f5d90b75-a56a-43a1-b4ae-34b8711eb5a3 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:36.933956 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f5d90b75-a56a-43a1-b4ae-34b8711eb5a3 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:36.990956 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e5560118-7dbc-4bda-8c46-915de6d44d57 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:36.992006 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e5560118-7dbc-4bda-8c46-915de6d44d57 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] [instance: d940519e-c387-4d22-904d-36b409572e81] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:37.026601 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e5560118-7dbc-4bda-8c46-915de6d44d57 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:37.027693 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e5560118-7dbc-4bda-8c46-915de6d44d57 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:37.029086 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e5560118-7dbc-4bda-8c46-915de6d44d57 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:37.032420 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e5560118-7dbc-4bda-8c46-915de6d44d57 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:37.033557 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e5560118-7dbc-4bda-8c46-915de6d44d57 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:37.037874 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e5560118-7dbc-4bda-8c46-915de6d44d57 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:38.346842 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f5d90b75-a56a-43a1-b4ae-34b8711eb5a3 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed06378eb9b446680b5a3156a14941d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511432a7dee4bec9d1093c9d95b3734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:38.367997 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f5d90b75-a56a-43a1-b4ae-34b8711eb5a3 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] 10.222.0.61 "GET /compute/v2.1/servers/cca485b3-25f2-4a77-a23a-bb9758586ce7" status: 200 len: 1359 microversion: 2.1 time: 1.504116 Aug 31 16:18:38.389103 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e5560118-7dbc-4bda-8c46-915de6d44d57 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f09f1b00bb4d859869dec5d973feaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f3ca3734da4d979112fb6145158b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:38.398046 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2346/4706] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:36 2022] GET /compute/v2.1/servers/cca485b3-25f2-4a77-a23a-bb9758586ce7 => generated 1359 bytes in 1517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:18:38.406624 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e5560118-7dbc-4bda-8c46-915de6d44d57 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] 10.222.0.61 "GET /compute/v2.1/servers/d940519e-c387-4d22-904d-36b409572e81" status: 200 len: 1526 microversion: 2.1 time: 1.418310 Aug 31 16:18:38.424805 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2361/4707] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:36 2022] GET /compute/v2.1/servers/d940519e-c387-4d22-904d-36b409572e81 => generated 1526 bytes in 1438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:18:38.426446 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-47ab517b-f2fe-404a-9f88-1f4cc6959323 tempest-VolumesGetTestJSON-1742897735 tempest-VolumesGetTestJSON-1742897735-project] Calling method '.version_select at 0x7f5ae3f37040>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:38.528418 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-47ab517b-f2fe-404a-9f88-1f4cc6959323 tempest-VolumesGetTestJSON-1742897735 tempest-VolumesGetTestJSON-1742897735-project] HTTP exception thrown: Volume d658eda0-391a-4c44-a715-72c235a28ced could not be found. Aug 31 16:18:38.538751 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-47ab517b-f2fe-404a-9f88-1f4cc6959323 tempest-VolumesGetTestJSON-1742897735 tempest-VolumesGetTestJSON-1742897735-project] Request method failure captured: Aug 31 16:18:38.538751 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/os-volumes/d658eda0-391a-4c44-a715-72c235a28ced HTTP/1.1 Aug 31 16:18:38.538751 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:18:38.538751 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:18:38.538751 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:18:38.538751 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:18:38.538751 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:18:38.538751 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:18:38.538751 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:18:38.538751 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:18:38.538751 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4nRZYezwSa7eg7kNQSJzONOvfozHUqNdWmxHYqVA_ETbbFeUD01YDaXn7rpOFA9UEkO59aAeAXLvb5R70841I7o-_6BjkpyQoxhU9-fJl4-4g1oPZ6QHS81o3ZZKBWHZG30sWeFhkV7oXJKSBu7zuqDzH7WDpAzFQ5ov_iOp_7dCa8 Aug 31 16:18:38.538751 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:18:38.538751 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:18:38.538751 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:18:38.538751 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:18:38.538751 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:18:38.538751 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:18:38.538751 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 0153fa79a98d4f3c8a8c7af1d3f9a37d Aug 31 16:18:38.538751 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-VolumesGetTestJSON-1742897735 Aug 31 16:18:38.538751 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:18:38.538751 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:18:38.538751 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0153fa79a98d4f3c8a8c7af1d3f9a37d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/0153fa79a98d4f3c8a8c7af1d3f9a37d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_0153fa79a98d4f3c8a8c7af1d3f9a37d", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0153fa79a98d4f3c8a8c7af1d3f9a37d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:18:38.538751 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-VolumesGetTestJSON-1742897735 Aug 31 16:18:38.538751 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 0153fa79a98d4f3c8a8c7af1d3f9a37d Aug 31 16:18:38.538751 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-VolumesGetTestJSON-1742897735 Aug 31 16:18:38.538751 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-VolumesGetTestJSON-1742897735-project Aug 31 16:18:38.538751 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:18:38.538751 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:18:38.538751 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 17526b953bc94071ad51b4a3640bde2a Aug 31 16:18:38.538751 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-VolumesGetTestJSON-1742897735-project Aug 31 16:18:38.538751 n-d-850499-9 devstack@n-api.service[122256]: method: Aug 31 16:18:38.538751 n-d-850499-9 devstack@n-api.service[122256]: exception: Volume d658eda0-391a-4c44-a715-72c235a28ced could not be found. Aug 31 16:18:38.538751 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': 'd658eda0-391a-4c44-a715-72c235a28ced'} Aug 31 16:18:38.538751 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:18:38.538751 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:18:38.538751 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 16:18:38.538751 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 16:18:38.538751 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 16:18:38.538751 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 16:18:38.538751 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 16:18:38.538751 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 16:18:38.538751 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 16:18:38.538751 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 16:18:38.538751 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 16:18:38.538751 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 16:18:38.538751 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 16:18:38.538751 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 16:18:38.538751 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 16:18:38.538751 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 16:18:38.538751 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d658eda0-391a-4c44-a715-72c235a28ced could not be found. (HTTP 404) (Request-ID: req-12ac2e41-3e4f-40b9-b67e-eaa47d7b822d) Aug 31 16:18:38.538751 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:18:38.538751 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:18:38.538751 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:18:38.538751 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:18:38.538751 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 31 16:18:38.538751 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 31 16:18:38.538751 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 16:18:38.538751 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 16:18:38.538751 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 16:18:38.538751 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 16:18:38.538751 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 16:18:38.538751 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 16:18:38.538751 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 16:18:38.547101 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 16:18:38.547101 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 16:18:38.547101 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 16:18:38.547101 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 16:18:38.547101 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 16:18:38.547101 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 16:18:38.547101 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 16:18:38.547101 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 16:18:38.547101 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 16:18:38.547101 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 16:18:38.547101 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 16:18:38.547101 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 16:18:38.547101 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 16:18:38.547101 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d658eda0-391a-4c44-a715-72c235a28ced could not be found. Aug 31 16:18:38.547101 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:18:38.547101 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:18:38.547101 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:18:38.547101 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:18:38.547101 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:18:38.547101 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:18:38.547101 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:18:38.547101 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:18:38.547101 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:18:38.547101 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:18:38.547101 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:18:38.547101 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:18:38.547101 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 31 16:18:38.547101 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:18:38.547101 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d658eda0-391a-4c44-a715-72c235a28ced could not be found. Aug 31 16:18:38.547101 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:18:38.547101 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:18:38.547101 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:18:38.547101 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:18:38.547101 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:18:38.547101 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:18:38.547101 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:18:38.547101 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:18:38.547101 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d658eda0-391a-4c44-a715-72c235a28ced could not be found. Aug 31 16:18:38.547101 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:18:38.555271 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-47ab517b-f2fe-404a-9f88-1f4cc6959323 tempest-VolumesGetTestJSON-1742897735 tempest-VolumesGetTestJSON-1742897735-project] Returning 404 to user: Volume d658eda0-391a-4c44-a715-72c235a28ced could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:18:38.559975 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-47ab517b-f2fe-404a-9f88-1f4cc6959323 tempest-VolumesGetTestJSON-1742897735 tempest-VolumesGetTestJSON-1742897735-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/d658eda0-391a-4c44-a715-72c235a28ced" status: 404 len: 109 microversion: 2.1 time: 0.155297 Aug 31 16:18:38.562348 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2347/4708] 10.222.0.61 () {58 vars in 1245 bytes} [Wed Aug 31 16:18:38 2022] GET /compute/v2.1/os-volumes/d658eda0-391a-4c44-a715-72c235a28ced => generated 109 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:18:39.406968 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4562598d-5b3a-4441-82f5-2a1fffd8ecf9 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:39.408875 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4562598d-5b3a-4441-82f5-2a1fffd8ecf9 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] [instance: cca485b3-25f2-4a77-a23a-bb9758586ce7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:39.411044 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:18:39.431365 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4562598d-5b3a-4441-82f5-2a1fffd8ecf9 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:39.431939 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4562598d-5b3a-4441-82f5-2a1fffd8ecf9 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:39.432395 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4562598d-5b3a-4441-82f5-2a1fffd8ecf9 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:39.437076 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4562598d-5b3a-4441-82f5-2a1fffd8ecf9 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:39.437920 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4562598d-5b3a-4441-82f5-2a1fffd8ecf9 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:39.439559 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4562598d-5b3a-4441-82f5-2a1fffd8ecf9 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:40.528145 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-4562598d-5b3a-4441-82f5-2a1fffd8ecf9 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed06378eb9b446680b5a3156a14941d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511432a7dee4bec9d1093c9d95b3734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:40.544586 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4562598d-5b3a-4441-82f5-2a1fffd8ecf9 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] 10.222.0.61 "GET /compute/v2.1/servers/cca485b3-25f2-4a77-a23a-bb9758586ce7" status: 200 len: 1359 microversion: 2.1 time: 1.157968 Aug 31 16:18:40.553753 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2348/4709] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:39 2022] GET /compute/v2.1/servers/cca485b3-25f2-4a77-a23a-bb9758586ce7 => generated 1359 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:18:40.578315 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-fd62db88-439e-4bbd-88d8-7bd87c6fc448 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:40.582129 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-fd62db88-439e-4bbd-88d8-7bd87c6fc448 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] [instance: d940519e-c387-4d22-904d-36b409572e81] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:40.604664 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fd62db88-439e-4bbd-88d8-7bd87c6fc448 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:40.625256 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fd62db88-439e-4bbd-88d8-7bd87c6fc448 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:40.629810 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fd62db88-439e-4bbd-88d8-7bd87c6fc448 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:40.631367 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fd62db88-439e-4bbd-88d8-7bd87c6fc448 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:40.633212 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fd62db88-439e-4bbd-88d8-7bd87c6fc448 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:40.640540 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fd62db88-439e-4bbd-88d8-7bd87c6fc448 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:40.692244 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7c4a9746-34d8-4039-a161-933869b1fb84 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-261866614", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "networks": [{"uuid": "706e1621-ec9f-48f3-a3dc-537f25436af0"}]}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:18:40.734220 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:18:40.819121 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fd62db88-439e-4bbd-88d8-7bd87c6fc448 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:40.820845 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fd62db88-439e-4bbd-88d8-7bd87c6fc448 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:40.822483 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fd62db88-439e-4bbd-88d8-7bd87c6fc448 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:40.826493 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-7c4a9746-34d8-4039-a161-933869b1fb84 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] validate_networks() for [('706e1621-ec9f-48f3-a3dc-537f25436af0', None, None, None, None, None)] {{(pid=122257) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:18:40.827911 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-fd62db88-439e-4bbd-88d8-7bd87c6fc448 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Lazy-loading 'fault' on Instance uuid d940519e-c387-4d22-904d-36b409572e81 {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:18:42.147281 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-fd62db88-439e-4bbd-88d8-7bd87c6fc448 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f09f1b00bb4d859869dec5d973feaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f3ca3734da4d979112fb6145158b6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:42.220231 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-fd62db88-439e-4bbd-88d8-7bd87c6fc448 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] 10.222.0.61 "GET /compute/v2.1/servers/d940519e-c387-4d22-904d-36b409572e81" status: 200 len: 1313 microversion: 2.1 time: 1.646085 Aug 31 16:18:42.228083 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2349/4710] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:40 2022] GET /compute/v2.1/servers/d940519e-c387-4d22-904d-36b409572e81 => generated 1313 bytes in 1673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:18:42.277686 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-efc22c58-71c9-4fc8-9349-fe266b9973e2 req-d2d208de-9ef4-43eb-9cb1-fa0ed75ac6bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d940519e-c387-4d22-904d-36b409572e81", "name": "network-vif-deleted", "tag": "00262e2b-bbe8-42c0-accb-326fffad9f54"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:18:42.342530 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-efc22c58-71c9-4fc8-9349-fe266b9973e2 req-d2d208de-9ef4-43eb-9cb1-fa0ed75ac6bd service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:42.342987 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-efc22c58-71c9-4fc8-9349-fe266b9973e2 req-d2d208de-9ef4-43eb-9cb1-fa0ed75ac6bd service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:42.343453 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-efc22c58-71c9-4fc8-9349-fe266b9973e2 req-d2d208de-9ef4-43eb-9cb1-fa0ed75ac6bd service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:42.424725 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-efc22c58-71c9-4fc8-9349-fe266b9973e2 req-d2d208de-9ef4-43eb-9cb1-fa0ed75ac6bd service nova] Creating event network-vif-deleted:00262e2b-bbe8-42c0-accb-326fffad9f54 for instance d940519e-c387-4d22-904d-36b409572e81 on n-h1-850499-9 Aug 31 16:18:42.478267 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-efc22c58-71c9-4fc8-9349-fe266b9973e2 req-d2d208de-9ef4-43eb-9cb1-fa0ed75ac6bd service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.239033 Aug 31 16:18:42.479073 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2350/4711] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:18:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:18:42.496182 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-52d0dda2-a4ea-4bb5-9f98-25cf4f9708f7 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:42.515029 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-52d0dda2-a4ea-4bb5-9f98-25cf4f9708f7 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] [instance: cca485b3-25f2-4a77-a23a-bb9758586ce7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:42.535235 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-52d0dda2-a4ea-4bb5-9f98-25cf4f9708f7 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:42.535784 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-52d0dda2-a4ea-4bb5-9f98-25cf4f9708f7 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:42.543162 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-52d0dda2-a4ea-4bb5-9f98-25cf4f9708f7 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:42.544245 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-52d0dda2-a4ea-4bb5-9f98-25cf4f9708f7 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:42.545497 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-52d0dda2-a4ea-4bb5-9f98-25cf4f9708f7 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:42.545497 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-52d0dda2-a4ea-4bb5-9f98-25cf4f9708f7 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:43.162077 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-52d0dda2-a4ea-4bb5-9f98-25cf4f9708f7 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed06378eb9b446680b5a3156a14941d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511432a7dee4bec9d1093c9d95b3734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:43.177550 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-52d0dda2-a4ea-4bb5-9f98-25cf4f9708f7 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] 10.222.0.61 "GET /compute/v2.1/servers/cca485b3-25f2-4a77-a23a-bb9758586ce7" status: 200 len: 1359 microversion: 2.1 time: 0.688668 Aug 31 16:18:43.178532 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2351/4712] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:42 2022] GET /compute/v2.1/servers/cca485b3-25f2-4a77-a23a-bb9758586ce7 => generated 1359 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:18:43.183994 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5e0b5cbe-22a7-4528-b43d-232f35936f8d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:43.198849 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5e0b5cbe-22a7-4528-b43d-232f35936f8d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:43.205643 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5e0b5cbe-22a7-4528-b43d-232f35936f8d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:43.206320 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5e0b5cbe-22a7-4528-b43d-232f35936f8d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:43.206858 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5e0b5cbe-22a7-4528-b43d-232f35936f8d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:43.207867 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5e0b5cbe-22a7-4528-b43d-232f35936f8d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:43.210670 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5e0b5cbe-22a7-4528-b43d-232f35936f8d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:43.211230 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5e0b5cbe-22a7-4528-b43d-232f35936f8d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:44.521697 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5e0b5cbe-22a7-4528-b43d-232f35936f8d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:44.536337 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-7c4a9746-34d8-4039-a161-933869b1fb84 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:18:44.537172 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-7c4a9746-34d8-4039-a161-933869b1fb84 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:18:44.537365 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-7c4a9746-34d8-4039-a161-933869b1fb84 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:18:44.537689 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-7c4a9746-34d8-4039-a161-933869b1fb84 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:18:44.538245 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-7c4a9746-34d8-4039-a161-933869b1fb84 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:18:44.558021 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5e0b5cbe-22a7-4528-b43d-232f35936f8d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1681 microversion: 2.1 time: 1.375611 Aug 31 16:18:44.563703 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2352/4713] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:43 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1681 bytes in 1384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:18:44.578983 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7c4a9746-34d8-4039-a161-933869b1fb84 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:44.579493 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7c4a9746-34d8-4039-a161-933869b1fb84 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:44.581584 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7c4a9746-34d8-4039-a161-933869b1fb84 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:44.584255 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7c4a9746-34d8-4039-a161-933869b1fb84 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:44.584780 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7c4a9746-34d8-4039-a161-933869b1fb84 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:44.585231 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7c4a9746-34d8-4039-a161-933869b1fb84 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:44.590744 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-080953a4-ef09-4579-be70-1dcb38b39de2 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:44.592586 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-080953a4-ef09-4579-be70-1dcb38b39de2 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] [instance: d940519e-c387-4d22-904d-36b409572e81] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:44.624005 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-080953a4-ef09-4579-be70-1dcb38b39de2 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:44.625636 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-080953a4-ef09-4579-be70-1dcb38b39de2 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:44.626676 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-080953a4-ef09-4579-be70-1dcb38b39de2 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:44.628268 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=77 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:18:44.630360 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-080953a4-ef09-4579-be70-1dcb38b39de2 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:44.633242 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-080953a4-ef09-4579-be70-1dcb38b39de2 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:44.637961 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-080953a4-ef09-4579-be70-1dcb38b39de2 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:44.664841 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-7c4a9746-34d8-4039-a161-933869b1fb84 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Getting quotas for project b8db628b412c4fcb95f7950d6f49aff4. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:18:44.681443 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-7c4a9746-34d8-4039-a161-933869b1fb84 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Getting quotas for user dd0d5e01f90f4102b404558bc7687267 and project b8db628b412c4fcb95f7950d6f49aff4. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:18:44.686403 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-080953a4-ef09-4579-be70-1dcb38b39de2 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] HTTP exception thrown: Instance d940519e-c387-4d22-904d-36b409572e81 could not be found. Aug 31 16:18:44.690071 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-080953a4-ef09-4579-be70-1dcb38b39de2 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Request method failure captured: Aug 31 16:18:44.690071 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/d940519e-c387-4d22-904d-36b409572e81 HTTP/1.1 Aug 31 16:18:44.690071 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:18:44.690071 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:18:44.690071 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:18:44.690071 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:18:44.690071 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:18:44.690071 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:18:44.690071 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:18:44.690071 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:18:44.690071 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4m6Vwp5zabSqss1y8M8JyjWpx917QSaqaWPOidb4kjNETPIxeRGTa2LiSz7h0DRqkPHf4MGCgOXLQyboY5iuNivYy97MOZNeqvJ9A14QA3wVPc6J7VdAr5vB1CTrT0dmvIOuv1nk2KIcaGgRYuytrEd1xyRz6u_tT-_r8tb-kiU3Ho Aug 31 16:18:44.690071 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:18:44.690071 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:18:44.690071 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:18:44.690071 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:18:44.690071 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:18:44.690071 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:18:44.690071 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: e2f3ca3734da4d979112fb6145158b6b Aug 31 16:18:44.690071 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1933355458 Aug 31 16:18:44.690071 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:18:44.690071 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:18:44.690071 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e2f3ca3734da4d979112fb6145158b6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/e2f3ca3734da4d979112fb6145158b6b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_e2f3ca3734da4d979112fb6145158b6b", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e2f3ca3734da4d979112fb6145158b6b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:18:44.690071 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1933355458 Aug 31 16:18:44.690071 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: e2f3ca3734da4d979112fb6145158b6b Aug 31 16:18:44.690071 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1933355458 Aug 31 16:18:44.690071 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-InstanceActionsNegativeTestJSON-1933355458-project Aug 31 16:18:44.690071 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:18:44.690071 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:18:44.690071 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 04f09f1b00bb4d859869dec5d973feaf Aug 31 16:18:44.690071 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1933355458-project Aug 31 16:18:44.690071 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:18:44.690071 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance d940519e-c387-4d22-904d-36b409572e81 could not be found. Aug 31 16:18:44.690071 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': 'd940519e-c387-4d22-904d-36b409572e81'} Aug 31 16:18:44.690071 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:18:44.690071 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:18:44.690071 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:18:44.690071 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:18:44.690071 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:18:44.690071 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:18:44.690071 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:18:44.690071 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:18:44.690071 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:18:44.690071 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:18:44.690071 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d940519e-c387-4d22-904d-36b409572e81 could not be found. Aug 31 16:18:44.690071 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:18:44.690071 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:18:44.690071 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:18:44.690071 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:18:44.690071 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:18:44.690071 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:18:44.690071 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:18:44.690071 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:18:44.690071 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:18:44.690071 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:18:44.690071 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:18:44.690071 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:18:44.690071 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:18:44.690071 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:18:44.690071 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:18:44.690071 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:18:44.690071 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d940519e-c387-4d22-904d-36b409572e81 could not be found. Aug 31 16:18:44.690071 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:18:44.690071 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:18:44.699540 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:18:44.699540 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:18:44.699540 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:18:44.699540 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:18:44.699540 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:18:44.699540 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:18:44.699540 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d940519e-c387-4d22-904d-36b409572e81 could not be found. Aug 31 16:18:44.699540 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:18:44.703980 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-080953a4-ef09-4579-be70-1dcb38b39de2 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] Returning 404 to user: Instance d940519e-c387-4d22-904d-36b409572e81 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:18:44.707271 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-080953a4-ef09-4579-be70-1dcb38b39de2 tempest-InstanceActionsNegativeTestJSON-1933355458 tempest-InstanceActionsNegativeTestJSON-1933355458-project] 10.222.0.61 "GET /compute/v2.1/servers/d940519e-c387-4d22-904d-36b409572e81" status: 404 len: 111 microversion: 2.1 time: 0.137806 Aug 31 16:18:44.708525 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2353/4714] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:44 2022] GET /compute/v2.1/servers/d940519e-c387-4d22-904d-36b409572e81 => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:18:44.729139 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5d63b2f0-2bf1-47c5-afee-bb6e687fcee3 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:44.730835 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5d63b2f0-2bf1-47c5-afee-bb6e687fcee3 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] [instance: cca485b3-25f2-4a77-a23a-bb9758586ce7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:44.748296 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5d63b2f0-2bf1-47c5-afee-bb6e687fcee3 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:44.750302 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5d63b2f0-2bf1-47c5-afee-bb6e687fcee3 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:44.751117 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7c4a9746-34d8-4039-a161-933869b1fb84 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Going to run 1 instances... {{(pid=122257) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:18:44.751598 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5d63b2f0-2bf1-47c5-afee-bb6e687fcee3 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:44.753259 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5d63b2f0-2bf1-47c5-afee-bb6e687fcee3 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:44.754304 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5d63b2f0-2bf1-47c5-afee-bb6e687fcee3 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:44.755272 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5d63b2f0-2bf1-47c5-afee-bb6e687fcee3 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:44.755803 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7c4a9746-34d8-4039-a161-933869b1fb84 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] [instance: f8d3c4cc-b7c4-41ae-a5a6-a36958469d5b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:18:44.954745 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7c4a9746-34d8-4039-a161-933869b1fb84 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.733305 Aug 31 16:18:44.956134 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2362/4715] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:18:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 5738 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:18:44.993985 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3a518d1e-b5ea-4c1a-9bf2-dd80d22cf444 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:44.995710 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3a518d1e-b5ea-4c1a-9bf2-dd80d22cf444 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] [instance: f8d3c4cc-b7c4-41ae-a5a6-a36958469d5b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:45.161971 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3a518d1e-b5ea-4c1a-9bf2-dd80d22cf444 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d5e01f90f4102b404558bc7687267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8db628b412c4fcb95f7950d6f49aff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:45.181408 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3a518d1e-b5ea-4c1a-9bf2-dd80d22cf444 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d3c4cc-b7c4-41ae-a5a6-a36958469d5b" status: 200 len: 1215 microversion: 2.1 time: 0.212627 Aug 31 16:18:45.185212 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2363/4716] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:44 2022] GET /compute/v2.1/servers/f8d3c4cc-b7c4-41ae-a5a6-a36958469d5b => generated 1215 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:18:45.614311 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e8aadcd8-dcb3-4763-aa1b-e806da944239 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:45.615038 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e8aadcd8-dcb3-4763-aa1b-e806da944239 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:45.626804 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e8aadcd8-dcb3-4763-aa1b-e806da944239 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:45.627262 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e8aadcd8-dcb3-4763-aa1b-e806da944239 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:45.630131 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e8aadcd8-dcb3-4763-aa1b-e806da944239 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:45.631006 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e8aadcd8-dcb3-4763-aa1b-e806da944239 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:45.632763 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e8aadcd8-dcb3-4763-aa1b-e806da944239 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:45.633467 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e8aadcd8-dcb3-4763-aa1b-e806da944239 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:46.360157 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e8aadcd8-dcb3-4763-aa1b-e806da944239 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:46.409594 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e8aadcd8-dcb3-4763-aa1b-e806da944239 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1668 microversion: 2.1 time: 0.800058 Aug 31 16:18:46.419552 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2364/4717] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:45 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1668 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:18:46.455695 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a326c8d9-1c4e-48e1-bfea-0fff686f2f53 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:46.460544 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a326c8d9-1c4e-48e1-bfea-0fff686f2f53 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] [instance: f8d3c4cc-b7c4-41ae-a5a6-a36958469d5b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:46.489415 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a326c8d9-1c4e-48e1-bfea-0fff686f2f53 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:46.490384 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a326c8d9-1c4e-48e1-bfea-0fff686f2f53 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:46.493761 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a326c8d9-1c4e-48e1-bfea-0fff686f2f53 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:46.496840 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a326c8d9-1c4e-48e1-bfea-0fff686f2f53 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:46.502396 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a326c8d9-1c4e-48e1-bfea-0fff686f2f53 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:46.504859 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a326c8d9-1c4e-48e1-bfea-0fff686f2f53 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:46.656329 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5d63b2f0-2bf1-47c5-afee-bb6e687fcee3 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed06378eb9b446680b5a3156a14941d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511432a7dee4bec9d1093c9d95b3734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:46.659924 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:18:46.678875 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5d63b2f0-2bf1-47c5-afee-bb6e687fcee3 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] 10.222.0.61 "GET /compute/v2.1/servers/cca485b3-25f2-4a77-a23a-bb9758586ce7" status: 200 len: 1359 microversion: 2.1 time: 1.966466 Aug 31 16:18:46.680114 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2354/4718] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:44 2022] GET /compute/v2.1/servers/cca485b3-25f2-4a77-a23a-bb9758586ce7 => generated 1359 bytes in 1971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:18:46.717684 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-63fd3cd3-0b07-45f0-bcec-82b70f61c431 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-1733157720"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:18:46.726819 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-63fd3cd3-0b07-45f0-bcec-82b70f61c431 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:46.746029 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-63fd3cd3-0b07-45f0-bcec-82b70f61c431 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:46.746541 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-63fd3cd3-0b07-45f0-bcec-82b70f61c431 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:46.747192 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-63fd3cd3-0b07-45f0-bcec-82b70f61c431 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:46.747966 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-63fd3cd3-0b07-45f0-bcec-82b70f61c431 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:46.748441 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-63fd3cd3-0b07-45f0-bcec-82b70f61c431 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:46.748877 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-63fd3cd3-0b07-45f0-bcec-82b70f61c431 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:46.873537 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a326c8d9-1c4e-48e1-bfea-0fff686f2f53 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d5e01f90f4102b404558bc7687267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8db628b412c4fcb95f7950d6f49aff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:46.903058 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a326c8d9-1c4e-48e1-bfea-0fff686f2f53 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d3c4cc-b7c4-41ae-a5a6-a36958469d5b" status: 200 len: 1267 microversion: 2.1 time: 0.480922 Aug 31 16:18:46.910158 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2365/4719] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:46 2022] GET /compute/v2.1/servers/f8d3c4cc-b7c4-41ae-a5a6-a36958469d5b => generated 1267 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:18:46.939001 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-08e237ca-515e-4f83-a287-8dd05ce789cc req-44d7f730-2b44-432b-93b8-98d5b64af71e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cca485b3-25f2-4a77-a23a-bb9758586ce7", "name": "network-vif-plugged", "status": "completed", "tag": "7da488eb-1222-4197-97d6-7569af34909a"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:18:46.967129 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-08e237ca-515e-4f83-a287-8dd05ce789cc req-44d7f730-2b44-432b-93b8-98d5b64af71e service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:46.968264 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-08e237ca-515e-4f83-a287-8dd05ce789cc req-44d7f730-2b44-432b-93b8-98d5b64af71e service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:46.969277 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-08e237ca-515e-4f83-a287-8dd05ce789cc req-44d7f730-2b44-432b-93b8-98d5b64af71e service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:47.023178 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-08e237ca-515e-4f83-a287-8dd05ce789cc req-44d7f730-2b44-432b-93b8-98d5b64af71e service nova] Creating event network-vif-plugged:7da488eb-1222-4197-97d6-7569af34909a for instance cca485b3-25f2-4a77-a23a-bb9758586ce7 on n-h2-850499-9 Aug 31 16:18:47.034108 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-08e237ca-515e-4f83-a287-8dd05ce789cc req-44d7f730-2b44-432b-93b8-98d5b64af71e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120531 Aug 31 16:18:47.035071 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2366/4720] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:18:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:18:47.460153 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-63fd3cd3-0b07-45f0-bcec-82b70f61c431 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "POST /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c/action" status: 202 len: 0 microversion: 2.1 time: 0.758790 Aug 31 16:18:47.464740 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2355/4721] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:18:46 2022] POST /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c/action => generated 0 bytes in 784 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 31 16:18:47.473966 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-fc452940-7912-4e72-90b1-1a1efc41822c tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:47.475011 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-fc452940-7912-4e72-90b1-1a1efc41822c tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:47.494507 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fc452940-7912-4e72-90b1-1a1efc41822c tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:47.500166 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fc452940-7912-4e72-90b1-1a1efc41822c tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:47.501654 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fc452940-7912-4e72-90b1-1a1efc41822c tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:47.512254 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fc452940-7912-4e72-90b1-1a1efc41822c tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:47.513477 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fc452940-7912-4e72-90b1-1a1efc41822c tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:47.514217 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fc452940-7912-4e72-90b1-1a1efc41822c tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:47.716616 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b9fbc92b-35c5-46de-9560-e10a09116d70 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:47.718083 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b9fbc92b-35c5-46de-9560-e10a09116d70 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] [instance: cca485b3-25f2-4a77-a23a-bb9758586ce7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:47.734730 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b9fbc92b-35c5-46de-9560-e10a09116d70 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:47.737449 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b9fbc92b-35c5-46de-9560-e10a09116d70 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:47.740713 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b9fbc92b-35c5-46de-9560-e10a09116d70 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:47.741679 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b9fbc92b-35c5-46de-9560-e10a09116d70 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:47.742230 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b9fbc92b-35c5-46de-9560-e10a09116d70 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:47.742724 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b9fbc92b-35c5-46de-9560-e10a09116d70 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:48.181449 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-fc452940-7912-4e72-90b1-1a1efc41822c tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:48.201788 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-fc452940-7912-4e72-90b1-1a1efc41822c tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1678 microversion: 2.1 time: 0.735564 Aug 31 16:18:48.203357 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2367/4722] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:47 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1678 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:18:48.212119 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e2d48180-be46-4da9-9758-f4e54ac2246e tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:48.213817 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e2d48180-be46-4da9-9758-f4e54ac2246e tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] [instance: f8d3c4cc-b7c4-41ae-a5a6-a36958469d5b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:48.225786 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e2d48180-be46-4da9-9758-f4e54ac2246e tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:48.226882 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e2d48180-be46-4da9-9758-f4e54ac2246e tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:48.227401 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e2d48180-be46-4da9-9758-f4e54ac2246e tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:48.228563 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e2d48180-be46-4da9-9758-f4e54ac2246e tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:48.229260 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e2d48180-be46-4da9-9758-f4e54ac2246e tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:48.230872 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e2d48180-be46-4da9-9758-f4e54ac2246e tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:48.252126 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b9fbc92b-35c5-46de-9560-e10a09116d70 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed06378eb9b446680b5a3156a14941d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511432a7dee4bec9d1093c9d95b3734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:48.270987 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b9fbc92b-35c5-46de-9560-e10a09116d70 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] 10.222.0.61 "GET /compute/v2.1/servers/cca485b3-25f2-4a77-a23a-bb9758586ce7" status: 200 len: 1359 microversion: 2.1 time: 0.559636 Aug 31 16:18:48.274122 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2356/4723] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:47 2022] GET /compute/v2.1/servers/cca485b3-25f2-4a77-a23a-bb9758586ce7 => generated 1359 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:18:48.331730 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e2d48180-be46-4da9-9758-f4e54ac2246e tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d5e01f90f4102b404558bc7687267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8db628b412c4fcb95f7950d6f49aff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:48.366272 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e2d48180-be46-4da9-9758-f4e54ac2246e tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d3c4cc-b7c4-41ae-a5a6-a36958469d5b" status: 200 len: 1273 microversion: 2.1 time: 0.161345 Aug 31 16:18:48.387714 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2368/4724] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:48 2022] GET /compute/v2.1/servers/f8d3c4cc-b7c4-41ae-a5a6-a36958469d5b => generated 1273 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:18:49.080165 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-50233efb-3230-4321-a4a2-f1f074c9f1b0 req-d7fa6791-b91f-4f2d-b52e-1d3134ed6fd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42ccbb85-9677-4cb9-879a-dc280cda020c", "name": "network-vif-unplugged", "status": "completed", "tag": "44b19fab-a1b0-47af-8c78-4bab130a016b"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:18:49.104036 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-50233efb-3230-4321-a4a2-f1f074c9f1b0 req-d7fa6791-b91f-4f2d-b52e-1d3134ed6fd2 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:49.104947 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-50233efb-3230-4321-a4a2-f1f074c9f1b0 req-d7fa6791-b91f-4f2d-b52e-1d3134ed6fd2 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:49.105607 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-50233efb-3230-4321-a4a2-f1f074c9f1b0 req-d7fa6791-b91f-4f2d-b52e-1d3134ed6fd2 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:49.150890 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-50233efb-3230-4321-a4a2-f1f074c9f1b0 req-d7fa6791-b91f-4f2d-b52e-1d3134ed6fd2 service nova] Creating event network-vif-unplugged:44b19fab-a1b0-47af-8c78-4bab130a016b for instance 42ccbb85-9677-4cb9-879a-dc280cda020c on n-h2-850499-9 Aug 31 16:18:49.163550 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-50233efb-3230-4321-a4a2-f1f074c9f1b0 req-d7fa6791-b91f-4f2d-b52e-1d3134ed6fd2 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.087625 Aug 31 16:18:49.166812 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2357/4725] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:18:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:18:49.232568 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5187465f-6414-4c83-a124-d7e419131719 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:49.235239 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5187465f-6414-4c83-a124-d7e419131719 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:49.260606 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5187465f-6414-4c83-a124-d7e419131719 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:49.264079 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5187465f-6414-4c83-a124-d7e419131719 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:49.265618 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5187465f-6414-4c83-a124-d7e419131719 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:49.267290 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5187465f-6414-4c83-a124-d7e419131719 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:49.270308 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5187465f-6414-4c83-a124-d7e419131719 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:49.273375 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5187465f-6414-4c83-a124-d7e419131719 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:49.298659 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-20205aa6-7dda-433a-b37f-25882dc22791 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:49.299379 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-20205aa6-7dda-433a-b37f-25882dc22791 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] [instance: cca485b3-25f2-4a77-a23a-bb9758586ce7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:49.312618 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-20205aa6-7dda-433a-b37f-25882dc22791 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:49.312618 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-20205aa6-7dda-433a-b37f-25882dc22791 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:49.313191 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-20205aa6-7dda-433a-b37f-25882dc22791 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:49.316096 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-20205aa6-7dda-433a-b37f-25882dc22791 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:49.316584 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-20205aa6-7dda-433a-b37f-25882dc22791 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:49.317031 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-20205aa6-7dda-433a-b37f-25882dc22791 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:49.824416 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5187465f-6414-4c83-a124-d7e419131719 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:49.847704 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5187465f-6414-4c83-a124-d7e419131719 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1678 microversion: 2.1 time: 0.619334 Aug 31 16:18:49.867313 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2369/4726] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:49 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1678 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:18:49.884238 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-20205aa6-7dda-433a-b37f-25882dc22791 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed06378eb9b446680b5a3156a14941d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511432a7dee4bec9d1093c9d95b3734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:49.892006 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-435eed13-068f-469c-96cb-fe173865bd58 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:49.894571 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-20205aa6-7dda-433a-b37f-25882dc22791 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] 10.222.0.61 "GET /compute/v2.1/servers/cca485b3-25f2-4a77-a23a-bb9758586ce7" status: 200 len: 1359 microversion: 2.1 time: 0.603318 Aug 31 16:18:49.895178 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2358/4727] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:49 2022] GET /compute/v2.1/servers/cca485b3-25f2-4a77-a23a-bb9758586ce7 => generated 1359 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:18:49.897589 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-435eed13-068f-469c-96cb-fe173865bd58 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] [instance: f8d3c4cc-b7c4-41ae-a5a6-a36958469d5b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:49.924007 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-435eed13-068f-469c-96cb-fe173865bd58 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:49.925507 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-435eed13-068f-469c-96cb-fe173865bd58 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:49.927755 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-435eed13-068f-469c-96cb-fe173865bd58 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:49.930659 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-435eed13-068f-469c-96cb-fe173865bd58 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:49.933553 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-435eed13-068f-469c-96cb-fe173865bd58 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:49.935241 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-435eed13-068f-469c-96cb-fe173865bd58 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:50.417563 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-435eed13-068f-469c-96cb-fe173865bd58 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d5e01f90f4102b404558bc7687267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8db628b412c4fcb95f7950d6f49aff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:50.439581 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-435eed13-068f-469c-96cb-fe173865bd58 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d3c4cc-b7c4-41ae-a5a6-a36958469d5b" status: 200 len: 1315 microversion: 2.1 time: 0.567224 Aug 31 16:18:50.451567 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2370/4728] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:49 2022] GET /compute/v2.1/servers/f8d3c4cc-b7c4-41ae-a5a6-a36958469d5b => generated 1315 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:18:50.873423 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a44a611c-d72f-4512-be8b-8522d9529b17 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:50.874825 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a44a611c-d72f-4512-be8b-8522d9529b17 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:50.892049 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a44a611c-d72f-4512-be8b-8522d9529b17 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:50.895723 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a44a611c-d72f-4512-be8b-8522d9529b17 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:50.896646 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a44a611c-d72f-4512-be8b-8522d9529b17 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:50.898582 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a44a611c-d72f-4512-be8b-8522d9529b17 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:50.899772 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a44a611c-d72f-4512-be8b-8522d9529b17 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:50.903597 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a44a611c-d72f-4512-be8b-8522d9529b17 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:50.924348 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c0f25201-db33-4570-9c7d-e70d96c6d2f7 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:50.925526 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c0f25201-db33-4570-9c7d-e70d96c6d2f7 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] [instance: cca485b3-25f2-4a77-a23a-bb9758586ce7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:50.946803 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c0f25201-db33-4570-9c7d-e70d96c6d2f7 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:50.950902 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c0f25201-db33-4570-9c7d-e70d96c6d2f7 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:50.952337 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c0f25201-db33-4570-9c7d-e70d96c6d2f7 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:50.955664 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c0f25201-db33-4570-9c7d-e70d96c6d2f7 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:50.958800 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c0f25201-db33-4570-9c7d-e70d96c6d2f7 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:50.960897 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c0f25201-db33-4570-9c7d-e70d96c6d2f7 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:51.351391 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a44a611c-d72f-4512-be8b-8522d9529b17 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:51.368788 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a44a611c-d72f-4512-be8b-8522d9529b17 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1678 microversion: 2.1 time: 0.500336 Aug 31 16:18:51.369912 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2359/4729] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:50 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1678 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:18:51.462929 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-74891f69-7210-4e8e-87af-9907e80419b6 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:51.464472 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-74891f69-7210-4e8e-87af-9907e80419b6 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] [instance: f8d3c4cc-b7c4-41ae-a5a6-a36958469d5b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:51.476159 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-74891f69-7210-4e8e-87af-9907e80419b6 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:51.477345 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-74891f69-7210-4e8e-87af-9907e80419b6 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:51.479167 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-74891f69-7210-4e8e-87af-9907e80419b6 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:51.480345 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-74891f69-7210-4e8e-87af-9907e80419b6 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:51.483666 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-74891f69-7210-4e8e-87af-9907e80419b6 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:51.484430 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-74891f69-7210-4e8e-87af-9907e80419b6 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:51.607086 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c0f25201-db33-4570-9c7d-e70d96c6d2f7 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed06378eb9b446680b5a3156a14941d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511432a7dee4bec9d1093c9d95b3734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:51.617049 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c0f25201-db33-4570-9c7d-e70d96c6d2f7 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] 10.222.0.61 "GET /compute/v2.1/servers/cca485b3-25f2-4a77-a23a-bb9758586ce7" status: 200 len: 1546 microversion: 2.1 time: 0.697450 Aug 31 16:18:51.622636 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2371/4730] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:50 2022] GET /compute/v2.1/servers/cca485b3-25f2-4a77-a23a-bb9758586ce7 => generated 1546 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:18:51.656120 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d48480c2-e9c7-46ea-878a-ae9f4f1b35a6 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:51.658592 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d48480c2-e9c7-46ea-878a-ae9f4f1b35a6 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] [instance: cca485b3-25f2-4a77-a23a-bb9758586ce7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:51.681772 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d48480c2-e9c7-46ea-878a-ae9f4f1b35a6 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:51.684382 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d48480c2-e9c7-46ea-878a-ae9f4f1b35a6 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:51.688668 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d48480c2-e9c7-46ea-878a-ae9f4f1b35a6 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:51.691062 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d48480c2-e9c7-46ea-878a-ae9f4f1b35a6 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:51.694618 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d48480c2-e9c7-46ea-878a-ae9f4f1b35a6 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:51.695568 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d48480c2-e9c7-46ea-878a-ae9f4f1b35a6 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:52.216872 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d48480c2-e9c7-46ea-878a-ae9f4f1b35a6 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] 10.222.0.61 "GET /compute/v2.1/servers/cca485b3-25f2-4a77-a23a-bb9758586ce7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.568041 Aug 31 16:18:52.218385 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2372/4731] 10.222.0.61 () {58 vars in 1275 bytes} [Wed Aug 31 16:18:51 2022] GET /compute/v2.1/servers/cca485b3-25f2-4a77-a23a-bb9758586ce7/os-interface => generated 285 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:18:52.395598 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-59d2d86e-ef6d-48ff-a5af-4660ddaa8c7c tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:52.396433 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-59d2d86e-ef6d-48ff-a5af-4660ddaa8c7c tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:52.419539 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-59d2d86e-ef6d-48ff-a5af-4660ddaa8c7c tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:52.423737 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-59d2d86e-ef6d-48ff-a5af-4660ddaa8c7c tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:52.428762 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-59d2d86e-ef6d-48ff-a5af-4660ddaa8c7c tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:52.429947 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-59d2d86e-ef6d-48ff-a5af-4660ddaa8c7c tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:52.430669 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-59d2d86e-ef6d-48ff-a5af-4660ddaa8c7c tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:52.431367 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-59d2d86e-ef6d-48ff-a5af-4660ddaa8c7c tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:52.437192 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-74891f69-7210-4e8e-87af-9907e80419b6 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d5e01f90f4102b404558bc7687267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8db628b412c4fcb95f7950d6f49aff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:52.466025 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-74891f69-7210-4e8e-87af-9907e80419b6 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d3c4cc-b7c4-41ae-a5a6-a36958469d5b" status: 200 len: 1315 microversion: 2.1 time: 1.007577 Aug 31 16:18:52.469409 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2360/4732] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:51 2022] GET /compute/v2.1/servers/f8d3c4cc-b7c4-41ae-a5a6-a36958469d5b => generated 1315 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:18:53.494718 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ce7c2131-8399-4364-8f54-07700018302a tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:53.497466 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ce7c2131-8399-4364-8f54-07700018302a tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] [instance: f8d3c4cc-b7c4-41ae-a5a6-a36958469d5b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:53.512566 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ce7c2131-8399-4364-8f54-07700018302a tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:53.523691 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ce7c2131-8399-4364-8f54-07700018302a tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:53.526673 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ce7c2131-8399-4364-8f54-07700018302a tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:53.528837 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ce7c2131-8399-4364-8f54-07700018302a tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:53.530513 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ce7c2131-8399-4364-8f54-07700018302a tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:53.539094 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ce7c2131-8399-4364-8f54-07700018302a tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:54.628675 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:18:54.771325 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ce7c2131-8399-4364-8f54-07700018302a tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d5e01f90f4102b404558bc7687267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8db628b412c4fcb95f7950d6f49aff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:54.785686 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ce7c2131-8399-4364-8f54-07700018302a tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d3c4cc-b7c4-41ae-a5a6-a36958469d5b" status: 200 len: 1315 microversion: 2.1 time: 1.295366 Aug 31 16:18:54.790624 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2361/4733] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:53 2022] GET /compute/v2.1/servers/f8d3c4cc-b7c4-41ae-a5a6-a36958469d5b => generated 1315 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:18:54.827117 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-e174c0a7-91aa-4745-8bcc-746ef3f14911 req-552f774f-41c5-47dc-9a54-63a291d19bca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8d3c4cc-b7c4-41ae-a5a6-a36958469d5b", "tag": "b971fce6-6fb5-4f29-a599-4304f44e3be2"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:18:54.865446 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-59d2d86e-ef6d-48ff-a5af-4660ddaa8c7c tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:54.881201 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-59d2d86e-ef6d-48ff-a5af-4660ddaa8c7c tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1686 microversion: 2.1 time: 2.490989 Aug 31 16:18:54.883733 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2373/4734] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:52 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1686 bytes in 2495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:18:54.911484 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-e174c0a7-91aa-4745-8bcc-746ef3f14911 req-552f774f-41c5-47dc-9a54-63a291d19bca service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:54.912509 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-e174c0a7-91aa-4745-8bcc-746ef3f14911 req-552f774f-41c5-47dc-9a54-63a291d19bca service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:54.913244 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-e174c0a7-91aa-4745-8bcc-746ef3f14911 req-552f774f-41c5-47dc-9a54-63a291d19bca service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:54.981782 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-e174c0a7-91aa-4745-8bcc-746ef3f14911 req-552f774f-41c5-47dc-9a54-63a291d19bca service nova] Creating event network-changed:b971fce6-6fb5-4f29-a599-4304f44e3be2 for instance f8d3c4cc-b7c4-41ae-a5a6-a36958469d5b on n-h1-850499-9 Aug 31 16:18:55.003759 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-e174c0a7-91aa-4745-8bcc-746ef3f14911 req-552f774f-41c5-47dc-9a54-63a291d19bca service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.204620 Aug 31 16:18:55.005625 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2362/4735] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:18:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:18:55.827133 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7551d5c6-b44a-4b92-96e5-901ccfd35ffb tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:55.827868 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7551d5c6-b44a-4b92-96e5-901ccfd35ffb tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] [instance: f8d3c4cc-b7c4-41ae-a5a6-a36958469d5b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:55.844480 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=8 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:18:55.847664 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7551d5c6-b44a-4b92-96e5-901ccfd35ffb tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:55.853106 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7551d5c6-b44a-4b92-96e5-901ccfd35ffb tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:55.863187 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7551d5c6-b44a-4b92-96e5-901ccfd35ffb tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:55.864875 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7551d5c6-b44a-4b92-96e5-901ccfd35ffb tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:55.865675 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7551d5c6-b44a-4b92-96e5-901ccfd35ffb tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:55.870772 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7551d5c6-b44a-4b92-96e5-901ccfd35ffb tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:55.920739 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ca4dcbe9-0716-4a83-82d4-32871cd25ea0 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:55.922520 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ca4dcbe9-0716-4a83-82d4-32871cd25ea0 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:55.942563 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ca4dcbe9-0716-4a83-82d4-32871cd25ea0 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:55.944611 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ca4dcbe9-0716-4a83-82d4-32871cd25ea0 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:55.945873 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ca4dcbe9-0716-4a83-82d4-32871cd25ea0 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:55.948688 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ca4dcbe9-0716-4a83-82d4-32871cd25ea0 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:55.949381 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ca4dcbe9-0716-4a83-82d4-32871cd25ea0 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:55.950686 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ca4dcbe9-0716-4a83-82d4-32871cd25ea0 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:57.057395 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7551d5c6-b44a-4b92-96e5-901ccfd35ffb tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d5e01f90f4102b404558bc7687267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8db628b412c4fcb95f7950d6f49aff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:57.071689 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7551d5c6-b44a-4b92-96e5-901ccfd35ffb tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d3c4cc-b7c4-41ae-a5a6-a36958469d5b" status: 200 len: 1315 microversion: 2.1 time: 1.248589 Aug 31 16:18:57.072656 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2374/4736] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:55 2022] GET /compute/v2.1/servers/f8d3c4cc-b7c4-41ae-a5a6-a36958469d5b => generated 1315 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:18:57.080012 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-c8a70e53-ebcb-4f61-ac04-37af68fa916d req-7869bdb3-bfff-47b6-b69a-60da775c0895 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42ccbb85-9677-4cb9-879a-dc280cda020c", "name": "network-vif-plugged", "status": "completed", "tag": "44b19fab-a1b0-47af-8c78-4bab130a016b"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:18:57.095763 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-c8a70e53-ebcb-4f61-ac04-37af68fa916d req-7869bdb3-bfff-47b6-b69a-60da775c0895 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:57.096703 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-c8a70e53-ebcb-4f61-ac04-37af68fa916d req-7869bdb3-bfff-47b6-b69a-60da775c0895 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:57.097950 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-c8a70e53-ebcb-4f61-ac04-37af68fa916d req-7869bdb3-bfff-47b6-b69a-60da775c0895 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:57.113684 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ca4dcbe9-0716-4a83-82d4-32871cd25ea0 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:57.117601 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-c8a70e53-ebcb-4f61-ac04-37af68fa916d req-7869bdb3-bfff-47b6-b69a-60da775c0895 service nova] Creating event network-vif-plugged:44b19fab-a1b0-47af-8c78-4bab130a016b for instance 42ccbb85-9677-4cb9-879a-dc280cda020c on n-h2-850499-9 Aug 31 16:18:57.124681 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-c8a70e53-ebcb-4f61-ac04-37af68fa916d req-7869bdb3-bfff-47b6-b69a-60da775c0895 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049134 Aug 31 16:18:57.125884 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2375/4737] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:18:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:18:57.149723 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ca4dcbe9-0716-4a83-82d4-32871cd25ea0 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1686 microversion: 2.1 time: 1.235037 Aug 31 16:18:57.150930 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2363/4738] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:55 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1686 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:18:57.906389 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-9314734a-ce72-4ae7-a38b-6c370b0269c9 req-ceb3ba25-8f2c-43eb-ac74-95370f5c9665 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cca485b3-25f2-4a77-a23a-bb9758586ce7", "tag": "7da488eb-1222-4197-97d6-7569af34909a"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:18:57.972055 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-9314734a-ce72-4ae7-a38b-6c370b0269c9 req-ceb3ba25-8f2c-43eb-ac74-95370f5c9665 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:57.973038 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-9314734a-ce72-4ae7-a38b-6c370b0269c9 req-ceb3ba25-8f2c-43eb-ac74-95370f5c9665 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:57.973633 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-9314734a-ce72-4ae7-a38b-6c370b0269c9 req-ceb3ba25-8f2c-43eb-ac74-95370f5c9665 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:58.007442 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-9314734a-ce72-4ae7-a38b-6c370b0269c9 req-ceb3ba25-8f2c-43eb-ac74-95370f5c9665 service nova] Creating event network-changed:7da488eb-1222-4197-97d6-7569af34909a for instance cca485b3-25f2-4a77-a23a-bb9758586ce7 on n-h2-850499-9 Aug 31 16:18:58.027910 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-9314734a-ce72-4ae7-a38b-6c370b0269c9 req-ceb3ba25-8f2c-43eb-ac74-95370f5c9665 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137181 Aug 31 16:18:58.030608 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2376/4739] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:18:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:18:58.098805 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-98e52a52-91d9-4900-8a27-54550ac19b56 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:58.100117 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-98e52a52-91d9-4900-8a27-54550ac19b56 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] [instance: f8d3c4cc-b7c4-41ae-a5a6-a36958469d5b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:58.123268 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-98e52a52-91d9-4900-8a27-54550ac19b56 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:58.125933 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-98e52a52-91d9-4900-8a27-54550ac19b56 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:58.128088 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-98e52a52-91d9-4900-8a27-54550ac19b56 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:58.130836 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-98e52a52-91d9-4900-8a27-54550ac19b56 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:58.132511 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-98e52a52-91d9-4900-8a27-54550ac19b56 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:58.135031 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-98e52a52-91d9-4900-8a27-54550ac19b56 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:58.179040 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8425831a-ab13-42ae-85e5-b3cf9819f6bd tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:58.181381 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8425831a-ab13-42ae-85e5-b3cf9819f6bd tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:58.200083 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8425831a-ab13-42ae-85e5-b3cf9819f6bd tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:58.201162 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8425831a-ab13-42ae-85e5-b3cf9819f6bd tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:58.202089 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8425831a-ab13-42ae-85e5-b3cf9819f6bd tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:58.203963 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8425831a-ab13-42ae-85e5-b3cf9819f6bd tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:58.205699 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8425831a-ab13-42ae-85e5-b3cf9819f6bd tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:58.207073 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8425831a-ab13-42ae-85e5-b3cf9819f6bd tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:58.898541 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-98e52a52-91d9-4900-8a27-54550ac19b56 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d5e01f90f4102b404558bc7687267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8db628b412c4fcb95f7950d6f49aff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:58.913844 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-98e52a52-91d9-4900-8a27-54550ac19b56 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d3c4cc-b7c4-41ae-a5a6-a36958469d5b" status: 200 len: 1315 microversion: 2.1 time: 0.819229 Aug 31 16:18:58.914721 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2364/4740] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:58 2022] GET /compute/v2.1/servers/f8d3c4cc-b7c4-41ae-a5a6-a36958469d5b => generated 1315 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:18:58.919758 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8425831a-ab13-42ae-85e5-b3cf9819f6bd tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:58.930553 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8425831a-ab13-42ae-85e5-b3cf9819f6bd tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1686 microversion: 2.1 time: 0.760914 Aug 31 16:18:58.936095 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2377/4741] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:58 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1686 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:18:59.943192 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-82cb53b5-61ac-4c84-af6a-07d00bb0baf8 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:59.945506 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-82cb53b5-61ac-4c84-af6a-07d00bb0baf8 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] [instance: f8d3c4cc-b7c4-41ae-a5a6-a36958469d5b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:59.961477 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f5c4d400-3bd1-4c1d-a1d3-d1ffe2b63ddb tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:59.962740 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f5c4d400-3bd1-4c1d-a1d3-d1ffe2b63ddb tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:59.975233 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f5c4d400-3bd1-4c1d-a1d3-d1ffe2b63ddb tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:59.992265 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f5c4d400-3bd1-4c1d-a1d3-d1ffe2b63ddb tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:59.992978 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f5c4d400-3bd1-4c1d-a1d3-d1ffe2b63ddb tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:59.994139 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f5c4d400-3bd1-4c1d-a1d3-d1ffe2b63ddb tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:00.008253 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-82cb53b5-61ac-4c84-af6a-07d00bb0baf8 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:00.009053 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-82cb53b5-61ac-4c84-af6a-07d00bb0baf8 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:00.009749 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-82cb53b5-61ac-4c84-af6a-07d00bb0baf8 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:00.011416 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-82cb53b5-61ac-4c84-af6a-07d00bb0baf8 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:00.015286 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f5c4d400-3bd1-4c1d-a1d3-d1ffe2b63ddb tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:00.020260 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f5c4d400-3bd1-4c1d-a1d3-d1ffe2b63ddb tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:00.032528 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-82cb53b5-61ac-4c84-af6a-07d00bb0baf8 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:00.040629 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-82cb53b5-61ac-4c84-af6a-07d00bb0baf8 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:01.689284 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f5c4d400-3bd1-4c1d-a1d3-d1ffe2b63ddb tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:01.713037 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f5c4d400-3bd1-4c1d-a1d3-d1ffe2b63ddb tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1681 microversion: 2.1 time: 1.755330 Aug 31 16:19:01.723416 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2378/4742] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:59 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1681 bytes in 1766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:19:02.754623 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3a3f4f46-b9b2-478f-92d6-88bddfe8f2a5 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:02.755280 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3a3f4f46-b9b2-478f-92d6-88bddfe8f2a5 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:02.794541 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3a3f4f46-b9b2-478f-92d6-88bddfe8f2a5 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:02.800541 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3a3f4f46-b9b2-478f-92d6-88bddfe8f2a5 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:02.800999 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3a3f4f46-b9b2-478f-92d6-88bddfe8f2a5 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:02.802049 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3a3f4f46-b9b2-478f-92d6-88bddfe8f2a5 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:02.802749 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3a3f4f46-b9b2-478f-92d6-88bddfe8f2a5 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:02.822305 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3a3f4f46-b9b2-478f-92d6-88bddfe8f2a5 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:04.054632 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-82cb53b5-61ac-4c84-af6a-07d00bb0baf8 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d5e01f90f4102b404558bc7687267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8db628b412c4fcb95f7950d6f49aff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:04.101562 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-82cb53b5-61ac-4c84-af6a-07d00bb0baf8 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d3c4cc-b7c4-41ae-a5a6-a36958469d5b" status: 200 len: 1315 microversion: 2.1 time: 4.164239 Aug 31 16:19:04.118569 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2365/4743] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:59 2022] GET /compute/v2.1/servers/f8d3c4cc-b7c4-41ae-a5a6-a36958469d5b => generated 1315 bytes in 4182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:19:04.154120 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-57b415cc-fe7d-42c0-ba1b-a77dc3ff4e83 req-06f2221a-207d-4bd2-8f9a-e02ee1446e16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8d3c4cc-b7c4-41ae-a5a6-a36958469d5b", "name": "network-vif-plugged", "status": "completed", "tag": "b971fce6-6fb5-4f29-a599-4304f44e3be2"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:19:04.237328 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-57b415cc-fe7d-42c0-ba1b-a77dc3ff4e83 req-06f2221a-207d-4bd2-8f9a-e02ee1446e16 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:04.238596 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-57b415cc-fe7d-42c0-ba1b-a77dc3ff4e83 req-06f2221a-207d-4bd2-8f9a-e02ee1446e16 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:04.239577 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-57b415cc-fe7d-42c0-ba1b-a77dc3ff4e83 req-06f2221a-207d-4bd2-8f9a-e02ee1446e16 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:04.306977 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-57b415cc-fe7d-42c0-ba1b-a77dc3ff4e83 req-06f2221a-207d-4bd2-8f9a-e02ee1446e16 service nova] Creating event network-vif-plugged:b971fce6-6fb5-4f29-a599-4304f44e3be2 for instance f8d3c4cc-b7c4-41ae-a5a6-a36958469d5b on n-h1-850499-9 Aug 31 16:19:04.319621 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-57b415cc-fe7d-42c0-ba1b-a77dc3ff4e83 req-06f2221a-207d-4bd2-8f9a-e02ee1446e16 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.198098 Aug 31 16:19:04.334938 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2366/4744] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:19:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:19:04.503955 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3a3f4f46-b9b2-478f-92d6-88bddfe8f2a5 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:04.518693 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3a3f4f46-b9b2-478f-92d6-88bddfe8f2a5 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1681 microversion: 2.1 time: 1.769112 Aug 31 16:19:04.527648 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2379/4745] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:02 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1681 bytes in 1779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:19:05.173210 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a7cd292c-27e2-4f18-a58a-d8381d521716 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:05.180522 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a7cd292c-27e2-4f18-a58a-d8381d521716 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] [instance: f8d3c4cc-b7c4-41ae-a5a6-a36958469d5b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:05.246079 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a7cd292c-27e2-4f18-a58a-d8381d521716 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:05.256363 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a7cd292c-27e2-4f18-a58a-d8381d521716 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:05.267679 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a7cd292c-27e2-4f18-a58a-d8381d521716 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:05.273505 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a7cd292c-27e2-4f18-a58a-d8381d521716 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:05.282796 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a7cd292c-27e2-4f18-a58a-d8381d521716 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:05.285528 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a7cd292c-27e2-4f18-a58a-d8381d521716 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:05.547756 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e4dcc0af-da8e-4471-a71b-b2326262367c tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:05.549075 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e4dcc0af-da8e-4471-a71b-b2326262367c tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:05.573859 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e4dcc0af-da8e-4471-a71b-b2326262367c tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:05.578186 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e4dcc0af-da8e-4471-a71b-b2326262367c tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:05.579113 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e4dcc0af-da8e-4471-a71b-b2326262367c tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:05.583322 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e4dcc0af-da8e-4471-a71b-b2326262367c tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:05.586855 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e4dcc0af-da8e-4471-a71b-b2326262367c tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:05.589274 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e4dcc0af-da8e-4471-a71b-b2326262367c tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:06.327435 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a7cd292c-27e2-4f18-a58a-d8381d521716 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d5e01f90f4102b404558bc7687267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8db628b412c4fcb95f7950d6f49aff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:06.345373 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a7cd292c-27e2-4f18-a58a-d8381d521716 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d3c4cc-b7c4-41ae-a5a6-a36958469d5b" status: 200 len: 1315 microversion: 2.1 time: 1.203608 Aug 31 16:19:06.348412 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2367/4746] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:05 2022] GET /compute/v2.1/servers/f8d3c4cc-b7c4-41ae-a5a6-a36958469d5b => generated 1315 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:19:06.488298 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e4dcc0af-da8e-4471-a71b-b2326262367c tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:06.516909 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e4dcc0af-da8e-4471-a71b-b2326262367c tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1681 microversion: 2.1 time: 0.973536 Aug 31 16:19:06.521544 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2380/4747] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:05 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1681 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:19:07.382800 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-55a917eb-e550-4b71-80d2-469782e891e1 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:07.384342 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-55a917eb-e550-4b71-80d2-469782e891e1 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] [instance: f8d3c4cc-b7c4-41ae-a5a6-a36958469d5b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:07.394315 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-55a917eb-e550-4b71-80d2-469782e891e1 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:07.395138 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-55a917eb-e550-4b71-80d2-469782e891e1 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:07.396013 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-55a917eb-e550-4b71-80d2-469782e891e1 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:07.396947 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-55a917eb-e550-4b71-80d2-469782e891e1 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:07.397572 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-55a917eb-e550-4b71-80d2-469782e891e1 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:07.401652 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-55a917eb-e550-4b71-80d2-469782e891e1 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:07.546631 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d460b2b9-6c83-4630-b166-9c16a909051b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:07.550165 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d460b2b9-6c83-4630-b166-9c16a909051b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:07.591137 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d460b2b9-6c83-4630-b166-9c16a909051b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:07.595940 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d460b2b9-6c83-4630-b166-9c16a909051b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:07.597239 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d460b2b9-6c83-4630-b166-9c16a909051b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:07.599875 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d460b2b9-6c83-4630-b166-9c16a909051b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:07.610226 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d460b2b9-6c83-4630-b166-9c16a909051b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:07.611699 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d460b2b9-6c83-4630-b166-9c16a909051b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:08.294208 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-55a917eb-e550-4b71-80d2-469782e891e1 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d5e01f90f4102b404558bc7687267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8db628b412c4fcb95f7950d6f49aff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:08.326934 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-55a917eb-e550-4b71-80d2-469782e891e1 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d3c4cc-b7c4-41ae-a5a6-a36958469d5b" status: 200 len: 1504 microversion: 2.1 time: 0.946781 Aug 31 16:19:08.328345 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2368/4748] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:07 2022] GET /compute/v2.1/servers/f8d3c4cc-b7c4-41ae-a5a6-a36958469d5b => generated 1504 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:19:08.359935 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c5f75807-6c6d-4dd2-a49d-397bcc4ebf6c tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:08.362533 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c5f75807-6c6d-4dd2-a49d-397bcc4ebf6c tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] [instance: f8d3c4cc-b7c4-41ae-a5a6-a36958469d5b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:08.383460 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c5f75807-6c6d-4dd2-a49d-397bcc4ebf6c tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:08.386706 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c5f75807-6c6d-4dd2-a49d-397bcc4ebf6c tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:08.387355 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c5f75807-6c6d-4dd2-a49d-397bcc4ebf6c tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:08.389142 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c5f75807-6c6d-4dd2-a49d-397bcc4ebf6c tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:08.389645 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c5f75807-6c6d-4dd2-a49d-397bcc4ebf6c tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:08.390098 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c5f75807-6c6d-4dd2-a49d-397bcc4ebf6c tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:08.483143 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d460b2b9-6c83-4630-b166-9c16a909051b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:08.515693 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d460b2b9-6c83-4630-b166-9c16a909051b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1681 microversion: 2.1 time: 0.973150 Aug 31 16:19:08.517775 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2381/4749] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:07 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1681 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:19:08.653525 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c5f75807-6c6d-4dd2-a49d-397bcc4ebf6c tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] 10.222.0.61 "DELETE /compute/v2.1/servers/f8d3c4cc-b7c4-41ae-a5a6-a36958469d5b/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.303080 Aug 31 16:19:08.658430 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2369/4750] 10.222.0.61 () {58 vars in 1296 bytes} [Wed Aug 31 16:19:08 2022] DELETE /compute/v2.1/servers/f8d3c4cc-b7c4-41ae-a5a6-a36958469d5b/os-server-password => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:19:08.675284 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f2e7e6e8-9ebd-4d29-849d-cd876bedd0e4 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:08.686095 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f2e7e6e8-9ebd-4d29-849d-cd876bedd0e4 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] [instance: f8d3c4cc-b7c4-41ae-a5a6-a36958469d5b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:08.735796 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f2e7e6e8-9ebd-4d29-849d-cd876bedd0e4 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:08.744218 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f2e7e6e8-9ebd-4d29-849d-cd876bedd0e4 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:08.747448 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f2e7e6e8-9ebd-4d29-849d-cd876bedd0e4 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:08.750006 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f2e7e6e8-9ebd-4d29-849d-cd876bedd0e4 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:08.754623 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f2e7e6e8-9ebd-4d29-849d-cd876bedd0e4 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:08.762375 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f2e7e6e8-9ebd-4d29-849d-cd876bedd0e4 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:08.884694 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f2e7e6e8-9ebd-4d29-849d-cd876bedd0e4 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d3c4cc-b7c4-41ae-a5a6-a36958469d5b/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.218957 Aug 31 16:19:08.888663 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2382/4751] 10.222.0.61 () {58 vars in 1293 bytes} [Wed Aug 31 16:19:08 2022] GET /compute/v2.1/servers/f8d3c4cc-b7c4-41ae-a5a6-a36958469d5b/os-server-password => generated 16 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 31 16:19:08.913002 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-73d3cd4c-621b-4bfe-9be3-c40911de2e8a tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:08.922517 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-73d3cd4c-621b-4bfe-9be3-c40911de2e8a tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] [instance: f8d3c4cc-b7c4-41ae-a5a6-a36958469d5b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:08.972785 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-73d3cd4c-621b-4bfe-9be3-c40911de2e8a tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:08.976352 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-73d3cd4c-621b-4bfe-9be3-c40911de2e8a tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:08.979723 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-73d3cd4c-621b-4bfe-9be3-c40911de2e8a tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:08.989020 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-73d3cd4c-621b-4bfe-9be3-c40911de2e8a tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:08.990313 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-73d3cd4c-621b-4bfe-9be3-c40911de2e8a tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:08.991397 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-73d3cd4c-621b-4bfe-9be3-c40911de2e8a tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:09.075224 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-73d3cd4c-621b-4bfe-9be3-c40911de2e8a tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] [instance: f8d3c4cc-b7c4-41ae-a5a6-a36958469d5b] Going to try to terminate instance {{(pid=122256) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:19:09.087623 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=5 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:19:09.450923 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-73d3cd4c-621b-4bfe-9be3-c40911de2e8a tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] 10.222.0.61 "DELETE /compute/v2.1/servers/f8d3c4cc-b7c4-41ae-a5a6-a36958469d5b" status: 204 len: 0 microversion: 2.1 time: 0.536503 Aug 31 16:19:09.462234 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2370/4752] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:19:08 2022] DELETE /compute/v2.1/servers/f8d3c4cc-b7c4-41ae-a5a6-a36958469d5b => generated 0 bytes in 560 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:19:09.489371 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f1ea523f-4d32-4455-be18-fea5b8c3dcc1 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:09.490138 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f1ea523f-4d32-4455-be18-fea5b8c3dcc1 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] [instance: f8d3c4cc-b7c4-41ae-a5a6-a36958469d5b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:09.507857 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f1ea523f-4d32-4455-be18-fea5b8c3dcc1 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:09.508378 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f1ea523f-4d32-4455-be18-fea5b8c3dcc1 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:09.508838 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f1ea523f-4d32-4455-be18-fea5b8c3dcc1 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:09.509642 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f1ea523f-4d32-4455-be18-fea5b8c3dcc1 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:09.510086 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f1ea523f-4d32-4455-be18-fea5b8c3dcc1 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:09.511194 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f1ea523f-4d32-4455-be18-fea5b8c3dcc1 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:09.594108 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b806396f-568a-482e-a6fb-68420736cc58 tempest-ServerGroup264TestJSON-1124432712 tempest-ServerGroup264TestJSON-1124432712-project] Action: 'create', calling method: .version_select at 0x7f5ae8e34ee0>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:19:09.705169 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-b806396f-568a-482e-a6fb-68420736cc58 tempest-ServerGroup264TestJSON-1124432712 tempest-ServerGroup264TestJSON-1124432712-project] Getting quotas for project aa07334377084a0ea3460e215f523a3c. Resources: {'server_groups'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:19:09.742642 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-b806396f-568a-482e-a6fb-68420736cc58 tempest-ServerGroup264TestJSON-1124432712 tempest-ServerGroup264TestJSON-1124432712-project] Getting quotas for user 18bebc46fa9440d2ac9e6cd37eff7273 and project aa07334377084a0ea3460e215f523a3c. Resources: {'server_groups'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:19:09.891772 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f1ea523f-4d32-4455-be18-fea5b8c3dcc1 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d5e01f90f4102b404558bc7687267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8db628b412c4fcb95f7950d6f49aff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:09.936163 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f1ea523f-4d32-4455-be18-fea5b8c3dcc1 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d3c4cc-b7c4-41ae-a5a6-a36958469d5b" status: 200 len: 1510 microversion: 2.1 time: 0.468056 Aug 31 16:19:09.937716 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2371/4753] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:09 2022] GET /compute/v2.1/servers/f8d3c4cc-b7c4-41ae-a5a6-a36958469d5b => generated 1510 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:19:09.966945 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-fb0f96e6-1892-4d97-bed9-b06814ec1bb5 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:09.972395 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-b806396f-568a-482e-a6fb-68420736cc58 tempest-ServerGroup264TestJSON-1124432712 tempest-ServerGroup264TestJSON-1124432712-project] Getting quotas for project aa07334377084a0ea3460e215f523a3c. Resources: {'server_groups'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:19:09.973923 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-fb0f96e6-1892-4d97-bed9-b06814ec1bb5 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:09.980619 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:19:09.985739 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-b806396f-568a-482e-a6fb-68420736cc58 tempest-ServerGroup264TestJSON-1124432712 tempest-ServerGroup264TestJSON-1124432712-project] Getting quotas for user 18bebc46fa9440d2ac9e6cd37eff7273 and project aa07334377084a0ea3460e215f523a3c. Resources: {'server_groups'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:19:09.996372 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fb0f96e6-1892-4d97-bed9-b06814ec1bb5 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:09.997051 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fb0f96e6-1892-4d97-bed9-b06814ec1bb5 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:09.997699 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fb0f96e6-1892-4d97-bed9-b06814ec1bb5 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:09.998941 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fb0f96e6-1892-4d97-bed9-b06814ec1bb5 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:09.999420 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fb0f96e6-1892-4d97-bed9-b06814ec1bb5 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:10.002745 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fb0f96e6-1892-4d97-bed9-b06814ec1bb5 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:10.057504 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b806396f-568a-482e-a6fb-68420736cc58 tempest-ServerGroup264TestJSON-1124432712 tempest-ServerGroup264TestJSON-1124432712-project] 10.222.0.61 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.920987 Aug 31 16:19:10.071883 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2383/4754] 10.222.0.61 () {62 vars in 1214 bytes} [Wed Aug 31 16:19:09 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 16:19:10.093573 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-973d0e97-0d08-4970-90e1-42bfc6f05c31 tempest-ServerGroup264TestJSON-1124432712 tempest-ServerGroup264TestJSON-1124432712-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:10.139356 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-973d0e97-0d08-4970-90e1-42bfc6f05c31 tempest-ServerGroup264TestJSON-1124432712 tempest-ServerGroup264TestJSON-1124432712-project] 10.222.0.61 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.061300 Aug 31 16:19:10.141482 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2384/4755] 10.222.0.61 () {60 vars in 1193 bytes} [Wed Aug 31 16:19:10 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 16:19:10.156263 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ecc6f216-b28b-49db-bf96-2cc78db6421b tempest-ServerGroup264TestJSON-1124432712 tempest-ServerGroup264TestJSON-1124432712-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:10.188829 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ecc6f216-b28b-49db-bf96-2cc78db6421b tempest-ServerGroup264TestJSON-1124432712 tempest-ServerGroup264TestJSON-1124432712-project] 10.222.0.61 "GET /compute/v2.1/os-server-groups/42aaccc9-f3ef-49a4-8ab8-e83b69320551" status: 200 len: 235 microversion: 2.64 time: 0.039403 Aug 31 16:19:10.196075 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2385/4756] 10.222.0.61 () {60 vars in 1304 bytes} [Wed Aug 31 16:19:10 2022] GET /compute/v2.1/os-server-groups/42aaccc9-f3ef-49a4-8ab8-e83b69320551 => generated 235 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 16:19:10.219910 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7b6009df-543d-4f3c-bab8-a8bd1748e0ca tempest-ServerGroup264TestJSON-1124432712 tempest-ServerGroup264TestJSON-1124432712-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:10.301037 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7b6009df-543d-4f3c-bab8-a8bd1748e0ca tempest-ServerGroup264TestJSON-1124432712 tempest-ServerGroup264TestJSON-1124432712-project] 10.222.0.61 "DELETE /compute/v2.1/os-server-groups/42aaccc9-f3ef-49a4-8ab8-e83b69320551" status: 204 len: 0 microversion: 2.64 time: 0.095015 Aug 31 16:19:10.303857 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2386/4757] 10.222.0.61 () {60 vars in 1307 bytes} [Wed Aug 31 16:19:10 2022] DELETE /compute/v2.1/os-server-groups/42aaccc9-f3ef-49a4-8ab8-e83b69320551 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 16:19:10.324378 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1a5d1d82-a423-4653-b083-d82888eb0d4a tempest-ServerGroup264TestJSON-1124432712 tempest-ServerGroup264TestJSON-1124432712-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:10.350179 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-1a5d1d82-a423-4653-b083-d82888eb0d4a tempest-ServerGroup264TestJSON-1124432712 tempest-ServerGroup264TestJSON-1124432712-project] HTTP exception thrown: Instance group 42aaccc9-f3ef-49a4-8ab8-e83b69320551 could not be found. Aug 31 16:19:10.372864 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1a5d1d82-a423-4653-b083-d82888eb0d4a tempest-ServerGroup264TestJSON-1124432712 tempest-ServerGroup264TestJSON-1124432712-project] Request method failure captured: Aug 31 16:19:10.372864 n-d-850499-9 devstack@n-api.service[122257]: request: DELETE /compute/v2.1/os-server-groups/42aaccc9-f3ef-49a4-8ab8-e83b69320551 HTTP/1.1 Aug 31 16:19:10.372864 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:19:10.372864 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:19:10.372864 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:19:10.372864 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:19:10.372864 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:19:10.372864 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:19:10.372864 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:19:10.372864 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:19:10.372864 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4n8qUVNYlxVx0EpIAb_a5YvbDnh00uqHCH7U-H1Ow9A2GxjiuRSof4E5RXgyZ7YkVo_Vop7slAGN6OAaxRM8d-FM7lvFie5W8ifI30IdSG5jrtfh3prwCnL3SjdIS-XHEys1jKXmEzL_gQ6RJhdMYDw3j_r1RdfShJdox7uHYo7bBA Aug 31 16:19:10.372864 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:19:10.372864 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:19:10.372864 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:19:10.372864 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:19:10.372864 n-d-850499-9 devstack@n-api.service[122257]: X-Openstack-Nova-Api-Version: 2.64 Aug 31 16:19:10.372864 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:19:10.372864 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:19:10.372864 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: aa07334377084a0ea3460e215f523a3c Aug 31 16:19:10.372864 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ServerGroup264TestJSON-1124432712 Aug 31 16:19:10.372864 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:19:10.372864 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:19:10.372864 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/aa07334377084a0ea3460e215f523a3c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/aa07334377084a0ea3460e215f523a3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_aa07334377084a0ea3460e215f523a3c", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/aa07334377084a0ea3460e215f523a3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:19:10.372864 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ServerGroup264TestJSON-1124432712 Aug 31 16:19:10.372864 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: aa07334377084a0ea3460e215f523a3c Aug 31 16:19:10.372864 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ServerGroup264TestJSON-1124432712 Aug 31 16:19:10.372864 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ServerGroup264TestJSON-1124432712-project Aug 31 16:19:10.372864 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:19:10.372864 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:19:10.372864 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 18bebc46fa9440d2ac9e6cd37eff7273 Aug 31 16:19:10.372864 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ServerGroup264TestJSON-1124432712-project Aug 31 16:19:10.372864 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:19:10.372864 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance group 42aaccc9-f3ef-49a4-8ab8-e83b69320551 could not be found. Aug 31 16:19:10.372864 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '42aaccc9-f3ef-49a4-8ab8-e83b69320551'} Aug 31 16:19:10.372864 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:19:10.372864 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:19:10.372864 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 31 16:19:10.372864 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 31 16:19:10.372864 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 16:19:10.372864 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 16:19:10.372864 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 31 16:19:10.372864 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 31 16:19:10.372864 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 31 16:19:10.372864 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 31 16:19:10.372864 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 31 16:19:10.372864 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 31 16:19:10.372864 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 42aaccc9-f3ef-49a4-8ab8-e83b69320551 could not be found. Aug 31 16:19:10.372864 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:19:10.372864 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:19:10.372864 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:19:10.372864 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:19:10.372864 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:19:10.372864 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:19:10.372864 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:19:10.372864 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:19:10.372864 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:19:10.372864 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:19:10.372864 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 31 16:19:10.372864 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:19:10.372864 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 42aaccc9-f3ef-49a4-8ab8-e83b69320551 could not be found. Aug 31 16:19:10.372864 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:19:10.372864 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:19:10.372864 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:19:10.372864 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:19:10.393007 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:19:10.393007 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:19:10.393007 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:19:10.393007 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:19:10.393007 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 42aaccc9-f3ef-49a4-8ab8-e83b69320551 could not be found. Aug 31 16:19:10.393007 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:19:10.393007 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1a5d1d82-a423-4653-b083-d82888eb0d4a tempest-ServerGroup264TestJSON-1124432712 tempest-ServerGroup264TestJSON-1124432712-project] Returning 404 to user: Instance group 42aaccc9-f3ef-49a4-8ab8-e83b69320551 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:19:10.393007 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1a5d1d82-a423-4653-b083-d82888eb0d4a tempest-ServerGroup264TestJSON-1124432712 tempest-ServerGroup264TestJSON-1124432712-project] 10.222.0.61 "DELETE /compute/v2.1/os-server-groups/42aaccc9-f3ef-49a4-8ab8-e83b69320551" status: 404 len: 117 microversion: 2.64 time: 0.060669 Aug 31 16:19:10.393007 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2387/4758] 10.222.0.61 () {60 vars in 1307 bytes} [Wed Aug 31 16:19:10 2022] DELETE /compute/v2.1/os-server-groups/42aaccc9-f3ef-49a4-8ab8-e83b69320551 => generated 117 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:19:10.748739 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-fb0f96e6-1892-4d97-bed9-b06814ec1bb5 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:10.774976 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-fb0f96e6-1892-4d97-bed9-b06814ec1bb5 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1681 microversion: 2.1 time: 0.835711 Aug 31 16:19:10.777979 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2372/4759] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:09 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1681 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:19:10.975972 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b48f9c6b-6b94-4809-a4ae-a49c6940307d tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:10.977522 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b48f9c6b-6b94-4809-a4ae-a49c6940307d tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] [instance: f8d3c4cc-b7c4-41ae-a5a6-a36958469d5b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:10.996538 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=5,nova_api:DELETE=3 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:19:11.030464 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b48f9c6b-6b94-4809-a4ae-a49c6940307d tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:11.034856 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b48f9c6b-6b94-4809-a4ae-a49c6940307d tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:11.043898 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b48f9c6b-6b94-4809-a4ae-a49c6940307d tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:11.046314 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b48f9c6b-6b94-4809-a4ae-a49c6940307d tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:11.047133 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b48f9c6b-6b94-4809-a4ae-a49c6940307d tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:11.048273 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b48f9c6b-6b94-4809-a4ae-a49c6940307d tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:11.058900 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=100 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:19:11.819601 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ce9bcd37-4e71-42ed-83dd-24dc07b2fe63 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:11.820742 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ce9bcd37-4e71-42ed-83dd-24dc07b2fe63 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:11.842237 n-d-850499-9 devstack@n-api.service[122256]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 16:19:11.842481 n-d-850499-9 devstack@n-api.service[122256]: Wed Aug 31 16:19:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c (ip 10.222.0.61) !!! Aug 31 16:19:11.846367 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ce9bcd37-4e71-42ed-83dd-24dc07b2fe63 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:11.846888 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ce9bcd37-4e71-42ed-83dd-24dc07b2fe63 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:11.847336 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ce9bcd37-4e71-42ed-83dd-24dc07b2fe63 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:11.852229 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ce9bcd37-4e71-42ed-83dd-24dc07b2fe63 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:11.852804 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ce9bcd37-4e71-42ed-83dd-24dc07b2fe63 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:11.855848 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ce9bcd37-4e71-42ed-83dd-24dc07b2fe63 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:12.173719 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b48f9c6b-6b94-4809-a4ae-a49c6940307d tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d5e01f90f4102b404558bc7687267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8db628b412c4fcb95f7950d6f49aff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:12.206620 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b48f9c6b-6b94-4809-a4ae-a49c6940307d tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d3c4cc-b7c4-41ae-a5a6-a36958469d5b" status: 200 len: 1510 microversion: 2.1 time: 1.235108 Aug 31 16:19:12.212462 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2388/4760] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:10 2022] GET /compute/v2.1/servers/f8d3c4cc-b7c4-41ae-a5a6-a36958469d5b => generated 1510 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:19:12.628809 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ce9bcd37-4e71-42ed-83dd-24dc07b2fe63 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:12.656874 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ce9bcd37-4e71-42ed-83dd-24dc07b2fe63 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1681 microversion: 2.1 time: 0.845543 Aug 31 16:19:12.662997 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2373/4761] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:11 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1681 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:19:13.240824 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8619cb53-a998-4f97-bd98-58a03399af6e tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:13.241993 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8619cb53-a998-4f97-bd98-58a03399af6e tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] [instance: f8d3c4cc-b7c4-41ae-a5a6-a36958469d5b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:13.275322 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8619cb53-a998-4f97-bd98-58a03399af6e tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:13.281574 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8619cb53-a998-4f97-bd98-58a03399af6e tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:13.282694 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8619cb53-a998-4f97-bd98-58a03399af6e tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:13.285383 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8619cb53-a998-4f97-bd98-58a03399af6e tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:13.287668 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8619cb53-a998-4f97-bd98-58a03399af6e tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:13.293659 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8619cb53-a998-4f97-bd98-58a03399af6e tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:13.689769 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-280a049a-7fae-4b91-ae5a-4b343d1d40c9 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:13.691411 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-280a049a-7fae-4b91-ae5a-4b343d1d40c9 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:13.728589 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-280a049a-7fae-4b91-ae5a-4b343d1d40c9 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:13.730041 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-280a049a-7fae-4b91-ae5a-4b343d1d40c9 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:13.730795 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-280a049a-7fae-4b91-ae5a-4b343d1d40c9 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:13.734187 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-280a049a-7fae-4b91-ae5a-4b343d1d40c9 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:13.741953 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-280a049a-7fae-4b91-ae5a-4b343d1d40c9 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:13.742715 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-280a049a-7fae-4b91-ae5a-4b343d1d40c9 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:16.314757 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8619cb53-a998-4f97-bd98-58a03399af6e tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d5e01f90f4102b404558bc7687267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8db628b412c4fcb95f7950d6f49aff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:16.327844 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8619cb53-a998-4f97-bd98-58a03399af6e tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d3c4cc-b7c4-41ae-a5a6-a36958469d5b" status: 200 len: 1510 microversion: 2.1 time: 3.092811 Aug 31 16:19:16.331490 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2389/4762] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:13 2022] GET /compute/v2.1/servers/f8d3c4cc-b7c4-41ae-a5a6-a36958469d5b => generated 1510 bytes in 3100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:19:16.356337 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-2ff78794-60c5-424d-8cab-3d250eebbbb9 req-3f8044c2-0bd6-4f6c-ad6e-9db7b9df2f8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8d3c4cc-b7c4-41ae-a5a6-a36958469d5b", "name": "network-vif-deleted", "tag": "b971fce6-6fb5-4f29-a599-4304f44e3be2"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:19:16.383248 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-2ff78794-60c5-424d-8cab-3d250eebbbb9 req-3f8044c2-0bd6-4f6c-ad6e-9db7b9df2f8c service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:16.383375 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-2ff78794-60c5-424d-8cab-3d250eebbbb9 req-3f8044c2-0bd6-4f6c-ad6e-9db7b9df2f8c service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:16.383748 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-2ff78794-60c5-424d-8cab-3d250eebbbb9 req-3f8044c2-0bd6-4f6c-ad6e-9db7b9df2f8c service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:16.424075 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-2ff78794-60c5-424d-8cab-3d250eebbbb9 req-3f8044c2-0bd6-4f6c-ad6e-9db7b9df2f8c service nova] Creating event network-vif-deleted:b971fce6-6fb5-4f29-a599-4304f44e3be2 for instance f8d3c4cc-b7c4-41ae-a5a6-a36958469d5b on n-h1-850499-9 Aug 31 16:19:16.457677 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-2ff78794-60c5-424d-8cab-3d250eebbbb9 req-3f8044c2-0bd6-4f6c-ad6e-9db7b9df2f8c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109071 Aug 31 16:19:16.463672 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2390/4763] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:19:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:19:16.622349 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-280a049a-7fae-4b91-ae5a-4b343d1d40c9 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:16.637604 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-280a049a-7fae-4b91-ae5a-4b343d1d40c9 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1681 microversion: 2.1 time: 2.952190 Aug 31 16:19:16.638610 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2374/4764] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:13 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1681 bytes in 2955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:19:17.352235 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a614832c-0884-4fca-90e8-70dbd180d384 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:17.352954 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a614832c-0884-4fca-90e8-70dbd180d384 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] [instance: f8d3c4cc-b7c4-41ae-a5a6-a36958469d5b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:17.380454 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a614832c-0884-4fca-90e8-70dbd180d384 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:17.383739 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a614832c-0884-4fca-90e8-70dbd180d384 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:17.389435 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a614832c-0884-4fca-90e8-70dbd180d384 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:17.398885 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a614832c-0884-4fca-90e8-70dbd180d384 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:17.404898 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a614832c-0884-4fca-90e8-70dbd180d384 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:17.405864 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a614832c-0884-4fca-90e8-70dbd180d384 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:17.449836 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-a614832c-0884-4fca-90e8-70dbd180d384 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] HTTP exception thrown: Instance f8d3c4cc-b7c4-41ae-a5a6-a36958469d5b could not be found. Aug 31 16:19:17.451890 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a614832c-0884-4fca-90e8-70dbd180d384 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Request method failure captured: Aug 31 16:19:17.451890 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/f8d3c4cc-b7c4-41ae-a5a6-a36958469d5b HTTP/1.1 Aug 31 16:19:17.451890 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:19:17.451890 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:19:17.451890 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:19:17.451890 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:19:17.451890 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:19:17.451890 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:19:17.451890 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:19:17.451890 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:19:17.451890 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4neymWr5MaKaP3Krd-fwNPihwhUg_I5F0utiT_6vhvBw2YLY3I3Y4swzYR49HU4AvA_6fJFLLkKB3fHFyh4ZKB2dKpGOElolJTwzUH0r8qCLW8okZSB4pPq_6wl0qhVYSspueRy7wEseI-iLv8m2kvWBZQvmlAEPK6U05Ob6dWOLP8 Aug 31 16:19:17.451890 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:19:17.451890 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:19:17.451890 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:19:17.451890 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:19:17.451890 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:19:17.451890 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:19:17.451890 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: b8db628b412c4fcb95f7950d6f49aff4 Aug 31 16:19:17.451890 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ServerPasswordTestJSON-2045547958 Aug 31 16:19:17.451890 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:19:17.451890 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:19:17.451890 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b8db628b412c4fcb95f7950d6f49aff4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/b8db628b412c4fcb95f7950d6f49aff4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_b8db628b412c4fcb95f7950d6f49aff4", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b8db628b412c4fcb95f7950d6f49aff4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:19:17.451890 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ServerPasswordTestJSON-2045547958 Aug 31 16:19:17.451890 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: b8db628b412c4fcb95f7950d6f49aff4 Aug 31 16:19:17.451890 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ServerPasswordTestJSON-2045547958 Aug 31 16:19:17.451890 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ServerPasswordTestJSON-2045547958-project Aug 31 16:19:17.451890 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:19:17.451890 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:19:17.451890 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: dd0d5e01f90f4102b404558bc7687267 Aug 31 16:19:17.451890 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ServerPasswordTestJSON-2045547958-project Aug 31 16:19:17.451890 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:19:17.451890 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance f8d3c4cc-b7c4-41ae-a5a6-a36958469d5b could not be found. Aug 31 16:19:17.451890 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': 'f8d3c4cc-b7c4-41ae-a5a6-a36958469d5b'} Aug 31 16:19:17.451890 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:19:17.451890 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:19:17.451890 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:19:17.451890 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:19:17.451890 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:19:17.451890 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:19:17.451890 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:19:17.451890 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:19:17.451890 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:19:17.451890 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:19:17.451890 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8d3c4cc-b7c4-41ae-a5a6-a36958469d5b could not be found. Aug 31 16:19:17.451890 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:19:17.451890 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:19:17.451890 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:19:17.451890 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:19:17.451890 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:19:17.451890 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:19:17.451890 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:19:17.451890 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:19:17.451890 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:19:17.451890 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:19:17.451890 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:19:17.451890 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:19:17.451890 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:19:17.451890 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:19:17.451890 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:19:17.451890 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:19:17.451890 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8d3c4cc-b7c4-41ae-a5a6-a36958469d5b could not be found. Aug 31 16:19:17.451890 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:19:17.451890 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:19:17.451890 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:19:17.456636 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:19:17.456636 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:19:17.456636 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:19:17.456636 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:19:17.456636 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:19:17.456636 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8d3c4cc-b7c4-41ae-a5a6-a36958469d5b could not be found. Aug 31 16:19:17.456636 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:19:17.458015 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a614832c-0884-4fca-90e8-70dbd180d384 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] Returning 404 to user: Instance f8d3c4cc-b7c4-41ae-a5a6-a36958469d5b could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:19:17.459790 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a614832c-0884-4fca-90e8-70dbd180d384 tempest-ServerPasswordTestJSON-2045547958 tempest-ServerPasswordTestJSON-2045547958-project] 10.222.0.61 "GET /compute/v2.1/servers/f8d3c4cc-b7c4-41ae-a5a6-a36958469d5b" status: 404 len: 111 microversion: 2.1 time: 0.112495 Aug 31 16:19:17.472751 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2391/4765] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:17 2022] GET /compute/v2.1/servers/f8d3c4cc-b7c4-41ae-a5a6-a36958469d5b => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:19:17.663046 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f897a353-d689-4da3-8886-eef204698514 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:17.663885 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f897a353-d689-4da3-8886-eef204698514 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:17.684995 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f897a353-d689-4da3-8886-eef204698514 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:17.686010 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f897a353-d689-4da3-8886-eef204698514 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:17.688109 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f897a353-d689-4da3-8886-eef204698514 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:17.692352 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f897a353-d689-4da3-8886-eef204698514 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:17.693037 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f897a353-d689-4da3-8886-eef204698514 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:17.693739 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f897a353-d689-4da3-8886-eef204698514 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:19.036698 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f897a353-d689-4da3-8886-eef204698514 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:19.084388 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f897a353-d689-4da3-8886-eef204698514 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1681 microversion: 2.1 time: 1.425392 Aug 31 16:19:19.095547 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2375/4766] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:17 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1681 bytes in 1437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:19:20.138410 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6298aeba-9be6-4b79-a50c-e14e4ce8a904 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:20.140569 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6298aeba-9be6-4b79-a50c-e14e4ce8a904 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:20.157931 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=8 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:19:20.197446 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6298aeba-9be6-4b79-a50c-e14e4ce8a904 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:20.198748 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6298aeba-9be6-4b79-a50c-e14e4ce8a904 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:20.202131 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6298aeba-9be6-4b79-a50c-e14e4ce8a904 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:20.204106 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6298aeba-9be6-4b79-a50c-e14e4ce8a904 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:20.211927 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6298aeba-9be6-4b79-a50c-e14e4ce8a904 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:20.217704 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6298aeba-9be6-4b79-a50c-e14e4ce8a904 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:23.170402 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-6298aeba-9be6-4b79-a50c-e14e4ce8a904 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:23.249020 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6298aeba-9be6-4b79-a50c-e14e4ce8a904 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1681 microversion: 2.1 time: 3.116698 Aug 31 16:19:23.257043 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2392/4767] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:20 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1681 bytes in 3126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:19:24.300262 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1ad8af87-c360-4329-a2c3-70a0f1998ec6 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:24.301307 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1ad8af87-c360-4329-a2c3-70a0f1998ec6 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:24.324223 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1ad8af87-c360-4329-a2c3-70a0f1998ec6 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:24.325390 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1ad8af87-c360-4329-a2c3-70a0f1998ec6 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:24.326500 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1ad8af87-c360-4329-a2c3-70a0f1998ec6 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:24.328172 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1ad8af87-c360-4329-a2c3-70a0f1998ec6 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:24.330316 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1ad8af87-c360-4329-a2c3-70a0f1998ec6 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:24.331487 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1ad8af87-c360-4329-a2c3-70a0f1998ec6 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:24.847016 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1ad8af87-c360-4329-a2c3-70a0f1998ec6 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:24.876133 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1ad8af87-c360-4329-a2c3-70a0f1998ec6 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1681 microversion: 2.1 time: 0.585128 Aug 31 16:19:24.883105 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2376/4768] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:24 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1681 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:19:25.919773 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-457a4002-7863-456f-b6b8-52e42add0176 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:25.920805 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-457a4002-7863-456f-b6b8-52e42add0176 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:25.944809 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-457a4002-7863-456f-b6b8-52e42add0176 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:25.947463 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-457a4002-7863-456f-b6b8-52e42add0176 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:25.952883 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-457a4002-7863-456f-b6b8-52e42add0176 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:25.957745 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-457a4002-7863-456f-b6b8-52e42add0176 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:25.960119 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-457a4002-7863-456f-b6b8-52e42add0176 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:25.963406 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-457a4002-7863-456f-b6b8-52e42add0176 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:27.245239 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-457a4002-7863-456f-b6b8-52e42add0176 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:27.266878 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-457a4002-7863-456f-b6b8-52e42add0176 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1681 microversion: 2.1 time: 1.350464 Aug 31 16:19:27.270536 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2393/4769] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:25 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1681 bytes in 1358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:19:27.704000 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a0b3e3a3-2b3c-424e-8557-d3c88c4b540a tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-429758923", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "networks": "none"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:19:27.906032 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-a0b3e3a3-2b3c-424e-8557-d3c88c4b540a tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:19:27.906917 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-a0b3e3a3-2b3c-424e-8557-d3c88c4b540a tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:19:27.907799 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-a0b3e3a3-2b3c-424e-8557-d3c88c4b540a tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:19:27.908398 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-a0b3e3a3-2b3c-424e-8557-d3c88c4b540a tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:19:27.908984 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-a0b3e3a3-2b3c-424e-8557-d3c88c4b540a tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:19:27.926520 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a0b3e3a3-2b3c-424e-8557-d3c88c4b540a tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:27.929460 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a0b3e3a3-2b3c-424e-8557-d3c88c4b540a tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:27.931627 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a0b3e3a3-2b3c-424e-8557-d3c88c4b540a tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:27.936491 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a0b3e3a3-2b3c-424e-8557-d3c88c4b540a tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:27.938465 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a0b3e3a3-2b3c-424e-8557-d3c88c4b540a tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:27.942656 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a0b3e3a3-2b3c-424e-8557-d3c88c4b540a tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:27.997293 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-a0b3e3a3-2b3c-424e-8557-d3c88c4b540a tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Getting quotas for project e713a65903474cc28584721f2780841e. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:19:28.012968 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-a0b3e3a3-2b3c-424e-8557-d3c88c4b540a tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Getting quotas for user c697cf3c2d6d4edb93426d828c10d6f6 and project e713a65903474cc28584721f2780841e. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:19:28.066078 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a0b3e3a3-2b3c-424e-8557-d3c88c4b540a tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Going to run 1 instances... {{(pid=122256) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:19:28.069073 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a0b3e3a3-2b3c-424e-8557-d3c88c4b540a tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] [instance: 5c468688-561a-4642-86f1-84b822674e33] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:19:28.297116 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a0b3e3a3-2b3c-424e-8557-d3c88c4b540a tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.886708 Aug 31 16:19:28.298779 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b6f73346-8e0f-4e65-b054-399e5ebff3d7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:28.300251 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b6f73346-8e0f-4e65-b054-399e5ebff3d7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:28.300838 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2377/4770] 10.222.0.61 () {62 vars in 1188 bytes} [Wed Aug 31 16:19:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 898 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 31 16:19:28.316274 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4e57c8a0-edc1-484f-90ff-30a52df6011a tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:28.316940 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4e57c8a0-edc1-484f-90ff-30a52df6011a tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] [instance: 5c468688-561a-4642-86f1-84b822674e33] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:28.322960 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b6f73346-8e0f-4e65-b054-399e5ebff3d7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:28.325322 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b6f73346-8e0f-4e65-b054-399e5ebff3d7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:28.327022 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b6f73346-8e0f-4e65-b054-399e5ebff3d7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:28.329224 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b6f73346-8e0f-4e65-b054-399e5ebff3d7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:28.333454 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b6f73346-8e0f-4e65-b054-399e5ebff3d7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:28.335141 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b6f73346-8e0f-4e65-b054-399e5ebff3d7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:28.819972 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-4e57c8a0-edc1-484f-90ff-30a52df6011a tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c697cf3c2d6d4edb93426d828c10d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e713a65903474cc28584721f2780841e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:28.833998 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-4e57c8a0-edc1-484f-90ff-30a52df6011a tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c697cf3c2d6d4edb93426d828c10d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e713a65903474cc28584721f2780841e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:28.837597 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-4e57c8a0-edc1-484f-90ff-30a52df6011a tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c697cf3c2d6d4edb93426d828c10d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e713a65903474cc28584721f2780841e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:28.841337 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4e57c8a0-edc1-484f-90ff-30a52df6011a tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] 10.222.0.61 "GET /compute/v2.1/servers/5c468688-561a-4642-86f1-84b822674e33" status: 200 len: 1277 microversion: 2.57 time: 0.534632 Aug 31 16:19:28.846336 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2378/4771] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:19:28 2022] GET /compute/v2.1/servers/5c468688-561a-4642-86f1-84b822674e33 => generated 1277 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:19:29.599851 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b6f73346-8e0f-4e65-b054-399e5ebff3d7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:29.609606 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b6f73346-8e0f-4e65-b054-399e5ebff3d7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1681 microversion: 2.1 time: 1.316499 Aug 31 16:19:29.627597 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2394/4772] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:28 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1681 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:19:29.873071 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-44e4f4b9-99b7-49c7-a6a9-9c5efceccdff tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:29.873887 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-44e4f4b9-99b7-49c7-a6a9-9c5efceccdff tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] [instance: 5c468688-561a-4642-86f1-84b822674e33] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:29.902783 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-44e4f4b9-99b7-49c7-a6a9-9c5efceccdff tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:29.907651 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-44e4f4b9-99b7-49c7-a6a9-9c5efceccdff tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:29.913685 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-44e4f4b9-99b7-49c7-a6a9-9c5efceccdff tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:29.916694 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-44e4f4b9-99b7-49c7-a6a9-9c5efceccdff tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:29.919158 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-44e4f4b9-99b7-49c7-a6a9-9c5efceccdff tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:29.920256 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-44e4f4b9-99b7-49c7-a6a9-9c5efceccdff tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:30.101337 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-44e4f4b9-99b7-49c7-a6a9-9c5efceccdff tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c697cf3c2d6d4edb93426d828c10d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e713a65903474cc28584721f2780841e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:30.116068 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-44e4f4b9-99b7-49c7-a6a9-9c5efceccdff tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c697cf3c2d6d4edb93426d828c10d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e713a65903474cc28584721f2780841e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:30.119886 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-44e4f4b9-99b7-49c7-a6a9-9c5efceccdff tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c697cf3c2d6d4edb93426d828c10d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e713a65903474cc28584721f2780841e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:30.124668 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-44e4f4b9-99b7-49c7-a6a9-9c5efceccdff tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] 10.222.0.61 "GET /compute/v2.1/servers/5c468688-561a-4642-86f1-84b822674e33" status: 200 len: 1281 microversion: 2.57 time: 0.255280 Aug 31 16:19:30.126617 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2379/4773] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:19:29 2022] GET /compute/v2.1/servers/5c468688-561a-4642-86f1-84b822674e33 => generated 1281 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:19:30.642582 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-84a6441a-4670-4844-a144-0a3d39b8248a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:30.643203 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-84a6441a-4670-4844-a144-0a3d39b8248a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:30.679926 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-84a6441a-4670-4844-a144-0a3d39b8248a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:30.683138 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-84a6441a-4670-4844-a144-0a3d39b8248a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:30.683976 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-84a6441a-4670-4844-a144-0a3d39b8248a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:30.702255 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-84a6441a-4670-4844-a144-0a3d39b8248a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:30.704042 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-84a6441a-4670-4844-a144-0a3d39b8248a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:30.707650 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-84a6441a-4670-4844-a144-0a3d39b8248a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:31.111271 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-84a6441a-4670-4844-a144-0a3d39b8248a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:31.133510 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-84a6441a-4670-4844-a144-0a3d39b8248a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1681 microversion: 2.1 time: 0.496230 Aug 31 16:19:31.134117 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2395/4774] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:30 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1681 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:19:31.162859 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c93fea83-4103-461d-8427-6a0ce369723b tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:31.175092 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c93fea83-4103-461d-8427-6a0ce369723b tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] [instance: 5c468688-561a-4642-86f1-84b822674e33] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:31.202903 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c93fea83-4103-461d-8427-6a0ce369723b tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:31.208425 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c93fea83-4103-461d-8427-6a0ce369723b tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:31.209178 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c93fea83-4103-461d-8427-6a0ce369723b tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:31.216613 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c93fea83-4103-461d-8427-6a0ce369723b tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:31.217483 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c93fea83-4103-461d-8427-6a0ce369723b tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:31.218195 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c93fea83-4103-461d-8427-6a0ce369723b tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:31.460929 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c93fea83-4103-461d-8427-6a0ce369723b tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c697cf3c2d6d4edb93426d828c10d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e713a65903474cc28584721f2780841e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:31.476137 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c93fea83-4103-461d-8427-6a0ce369723b tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c697cf3c2d6d4edb93426d828c10d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e713a65903474cc28584721f2780841e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:31.481625 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c93fea83-4103-461d-8427-6a0ce369723b tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c697cf3c2d6d4edb93426d828c10d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e713a65903474cc28584721f2780841e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:31.483248 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c93fea83-4103-461d-8427-6a0ce369723b tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] 10.222.0.61 "GET /compute/v2.1/servers/5c468688-561a-4642-86f1-84b822674e33" status: 200 len: 1337 microversion: 2.57 time: 0.329468 Aug 31 16:19:31.486617 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2380/4775] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:19:31 2022] GET /compute/v2.1/servers/5c468688-561a-4642-86f1-84b822674e33 => generated 1337 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:19:32.162065 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a492c990-1c4f-4096-a73b-dbef2f9510c5 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:32.162694 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a492c990-1c4f-4096-a73b-dbef2f9510c5 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:32.193465 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a492c990-1c4f-4096-a73b-dbef2f9510c5 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:32.195168 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a492c990-1c4f-4096-a73b-dbef2f9510c5 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:32.195947 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a492c990-1c4f-4096-a73b-dbef2f9510c5 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:32.200072 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a492c990-1c4f-4096-a73b-dbef2f9510c5 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:32.200854 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a492c990-1c4f-4096-a73b-dbef2f9510c5 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:32.202573 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a492c990-1c4f-4096-a73b-dbef2f9510c5 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:32.522237 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-05b948b9-8d4b-4b96-ba10-6b7d2bbe0d97 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:32.523240 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-05b948b9-8d4b-4b96-ba10-6b7d2bbe0d97 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] [instance: 5c468688-561a-4642-86f1-84b822674e33] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:32.536718 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-05b948b9-8d4b-4b96-ba10-6b7d2bbe0d97 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:32.539065 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-05b948b9-8d4b-4b96-ba10-6b7d2bbe0d97 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:32.543622 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-05b948b9-8d4b-4b96-ba10-6b7d2bbe0d97 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:32.544931 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-05b948b9-8d4b-4b96-ba10-6b7d2bbe0d97 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:32.545431 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-05b948b9-8d4b-4b96-ba10-6b7d2bbe0d97 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:32.545878 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-05b948b9-8d4b-4b96-ba10-6b7d2bbe0d97 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:32.668955 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a492c990-1c4f-4096-a73b-dbef2f9510c5 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:32.683629 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a492c990-1c4f-4096-a73b-dbef2f9510c5 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1681 microversion: 2.1 time: 0.525749 Aug 31 16:19:32.684243 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2396/4776] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:32 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1681 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:19:32.719596 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-05b948b9-8d4b-4b96-ba10-6b7d2bbe0d97 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c697cf3c2d6d4edb93426d828c10d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e713a65903474cc28584721f2780841e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:32.760045 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-05b948b9-8d4b-4b96-ba10-6b7d2bbe0d97 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c697cf3c2d6d4edb93426d828c10d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e713a65903474cc28584721f2780841e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:32.769225 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-05b948b9-8d4b-4b96-ba10-6b7d2bbe0d97 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c697cf3c2d6d4edb93426d828c10d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e713a65903474cc28584721f2780841e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:32.774202 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-05b948b9-8d4b-4b96-ba10-6b7d2bbe0d97 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] 10.222.0.61 "GET /compute/v2.1/servers/5c468688-561a-4642-86f1-84b822674e33" status: 200 len: 1335 microversion: 2.57 time: 0.252934 Aug 31 16:19:32.779961 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2381/4777] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:19:32 2022] GET /compute/v2.1/servers/5c468688-561a-4642-86f1-84b822674e33 => generated 1335 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:19:33.726329 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3e5ec97b-a4aa-415b-9b66-d2f47e1b6abf tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:33.733646 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3e5ec97b-a4aa-415b-9b66-d2f47e1b6abf tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:33.762614 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3e5ec97b-a4aa-415b-9b66-d2f47e1b6abf tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:33.779194 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3e5ec97b-a4aa-415b-9b66-d2f47e1b6abf tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:33.784304 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3e5ec97b-a4aa-415b-9b66-d2f47e1b6abf tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:33.786179 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3e5ec97b-a4aa-415b-9b66-d2f47e1b6abf tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:33.787394 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3e5ec97b-a4aa-415b-9b66-d2f47e1b6abf tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:33.789944 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3e5ec97b-a4aa-415b-9b66-d2f47e1b6abf tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:33.812627 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0e6946d1-9b52-4b14-8790-dc459ed568c8 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:33.813949 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0e6946d1-9b52-4b14-8790-dc459ed568c8 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] [instance: 5c468688-561a-4642-86f1-84b822674e33] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:33.842052 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0e6946d1-9b52-4b14-8790-dc459ed568c8 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:33.842835 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0e6946d1-9b52-4b14-8790-dc459ed568c8 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:33.845261 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0e6946d1-9b52-4b14-8790-dc459ed568c8 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:33.848289 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0e6946d1-9b52-4b14-8790-dc459ed568c8 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:33.856150 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0e6946d1-9b52-4b14-8790-dc459ed568c8 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:33.857368 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0e6946d1-9b52-4b14-8790-dc459ed568c8 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:34.171800 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-0e6946d1-9b52-4b14-8790-dc459ed568c8 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c697cf3c2d6d4edb93426d828c10d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e713a65903474cc28584721f2780841e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:34.285062 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-0e6946d1-9b52-4b14-8790-dc459ed568c8 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c697cf3c2d6d4edb93426d828c10d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e713a65903474cc28584721f2780841e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:34.288248 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-0e6946d1-9b52-4b14-8790-dc459ed568c8 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c697cf3c2d6d4edb93426d828c10d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e713a65903474cc28584721f2780841e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:34.293914 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0e6946d1-9b52-4b14-8790-dc459ed568c8 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] 10.222.0.61 "GET /compute/v2.1/servers/5c468688-561a-4642-86f1-84b822674e33" status: 200 len: 1335 microversion: 2.57 time: 0.485736 Aug 31 16:19:34.300811 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2382/4778] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:19:33 2022] GET /compute/v2.1/servers/5c468688-561a-4642-86f1-84b822674e33 => generated 1335 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:19:34.554158 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3e5ec97b-a4aa-415b-9b66-d2f47e1b6abf tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:34.574597 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3e5ec97b-a4aa-415b-9b66-d2f47e1b6abf tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1681 microversion: 2.1 time: 0.863764 Aug 31 16:19:34.575411 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2397/4779] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:33 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1681 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:19:35.329572 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8a38da99-5bef-44f7-b79c-066239d65a99 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:35.330866 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8a38da99-5bef-44f7-b79c-066239d65a99 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] [instance: 5c468688-561a-4642-86f1-84b822674e33] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:35.347895 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8a38da99-5bef-44f7-b79c-066239d65a99 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:35.352218 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8a38da99-5bef-44f7-b79c-066239d65a99 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:35.353000 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8a38da99-5bef-44f7-b79c-066239d65a99 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:35.354451 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8a38da99-5bef-44f7-b79c-066239d65a99 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:35.368848 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8a38da99-5bef-44f7-b79c-066239d65a99 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:35.369957 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8a38da99-5bef-44f7-b79c-066239d65a99 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:35.797880 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8a38da99-5bef-44f7-b79c-066239d65a99 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c697cf3c2d6d4edb93426d828c10d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e713a65903474cc28584721f2780841e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:35.826254 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8a38da99-5bef-44f7-b79c-066239d65a99 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c697cf3c2d6d4edb93426d828c10d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e713a65903474cc28584721f2780841e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:35.836682 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8a38da99-5bef-44f7-b79c-066239d65a99 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c697cf3c2d6d4edb93426d828c10d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e713a65903474cc28584721f2780841e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:35.845774 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8a38da99-5bef-44f7-b79c-066239d65a99 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] 10.222.0.61 "GET /compute/v2.1/servers/5c468688-561a-4642-86f1-84b822674e33" status: 200 len: 1335 microversion: 2.57 time: 0.519054 Aug 31 16:19:35.848906 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2398/4780] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:19:35 2022] GET /compute/v2.1/servers/5c468688-561a-4642-86f1-84b822674e33 => generated 1335 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:19:35.854880 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2c068001-ab19-41fb-9d1d-fe85c3f7ed26 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:35.863865 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2c068001-ab19-41fb-9d1d-fe85c3f7ed26 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:35.889990 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2c068001-ab19-41fb-9d1d-fe85c3f7ed26 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:35.892426 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2c068001-ab19-41fb-9d1d-fe85c3f7ed26 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:35.893245 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2c068001-ab19-41fb-9d1d-fe85c3f7ed26 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:35.896061 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2c068001-ab19-41fb-9d1d-fe85c3f7ed26 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:35.898257 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2c068001-ab19-41fb-9d1d-fe85c3f7ed26 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:35.900779 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2c068001-ab19-41fb-9d1d-fe85c3f7ed26 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:36.295596 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7bf81109-e13c-467b-b54f-2ba55b3b617e tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1086379888", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:19:36.468944 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-7bf81109-e13c-467b-b54f-2ba55b3b617e tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] validate_networks() for [('ecb57796-dd35-451a-aaf0-a8940d6c9197', None, None, None, None, None)] {{(pid=122256) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:19:36.791462 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2c068001-ab19-41fb-9d1d-fe85c3f7ed26 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:36.831900 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2c068001-ab19-41fb-9d1d-fe85c3f7ed26 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1681 microversion: 2.1 time: 0.980013 Aug 31 16:19:36.845781 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2399/4781] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:35 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1681 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:19:36.886157 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3cccce59-30d6-427d-91a2-07052b91e317 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:36.891583 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3cccce59-30d6-427d-91a2-07052b91e317 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] [instance: 5c468688-561a-4642-86f1-84b822674e33] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:36.920653 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3cccce59-30d6-427d-91a2-07052b91e317 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:36.920653 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3cccce59-30d6-427d-91a2-07052b91e317 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:36.920653 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3cccce59-30d6-427d-91a2-07052b91e317 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:36.920653 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3cccce59-30d6-427d-91a2-07052b91e317 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:36.920653 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3cccce59-30d6-427d-91a2-07052b91e317 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:36.921402 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3cccce59-30d6-427d-91a2-07052b91e317 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:37.171530 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3cccce59-30d6-427d-91a2-07052b91e317 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c697cf3c2d6d4edb93426d828c10d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e713a65903474cc28584721f2780841e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:37.197092 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3cccce59-30d6-427d-91a2-07052b91e317 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c697cf3c2d6d4edb93426d828c10d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e713a65903474cc28584721f2780841e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:37.209151 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3cccce59-30d6-427d-91a2-07052b91e317 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c697cf3c2d6d4edb93426d828c10d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e713a65903474cc28584721f2780841e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:37.217060 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3cccce59-30d6-427d-91a2-07052b91e317 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] 10.222.0.61 "GET /compute/v2.1/servers/5c468688-561a-4642-86f1-84b822674e33" status: 200 len: 1356 microversion: 2.57 time: 0.339677 Aug 31 16:19:37.218965 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2400/4782] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:19:36 2022] GET /compute/v2.1/servers/5c468688-561a-4642-86f1-84b822674e33 => generated 1356 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:19:37.269466 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d212d5ac-78af-4085-aa42-06bf8428f981 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:19:37.281909 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d212d5ac-78af-4085-aa42-06bf8428f981 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] [instance: 5c468688-561a-4642-86f1-84b822674e33] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:37.291090 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d212d5ac-78af-4085-aa42-06bf8428f981 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:37.291365 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d212d5ac-78af-4085-aa42-06bf8428f981 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:37.292138 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d212d5ac-78af-4085-aa42-06bf8428f981 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:37.294021 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d212d5ac-78af-4085-aa42-06bf8428f981 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:37.294848 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d212d5ac-78af-4085-aa42-06bf8428f981 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:37.295543 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d212d5ac-78af-4085-aa42-06bf8428f981 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:37.570861 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-d212d5ac-78af-4085-aa42-06bf8428f981 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:19:37.575784 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-d212d5ac-78af-4085-aa42-06bf8428f981 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:19:37.578521 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-d212d5ac-78af-4085-aa42-06bf8428f981 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:19:37.581379 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-d212d5ac-78af-4085-aa42-06bf8428f981 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:19:37.582563 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-d212d5ac-78af-4085-aa42-06bf8428f981 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:19:37.831905 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d212d5ac-78af-4085-aa42-06bf8428f981 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] [instance: 5c468688-561a-4642-86f1-84b822674e33] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:37.852646 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d212d5ac-78af-4085-aa42-06bf8428f981 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:37.853532 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d212d5ac-78af-4085-aa42-06bf8428f981 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:37.854761 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d212d5ac-78af-4085-aa42-06bf8428f981 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:37.855700 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d212d5ac-78af-4085-aa42-06bf8428f981 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:37.861765 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d212d5ac-78af-4085-aa42-06bf8428f981 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:37.864488 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d212d5ac-78af-4085-aa42-06bf8428f981 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:37.964374 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:19:37.974050 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d212d5ac-78af-4085-aa42-06bf8428f981 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] 10.222.0.61 "POST /compute/v2.1/servers/5c468688-561a-4642-86f1-84b822674e33/action" status: 202 len: 1137 microversion: 2.57 time: 0.712746 Aug 31 16:19:38.005602 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2401/4783] 10.222.0.61 () {62 vars in 1320 bytes} [Wed Aug 31 16:19:37 2022] POST /compute/v2.1/servers/5c468688-561a-4642-86f1-84b822674e33/action => generated 1137 bytes in 746 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Aug 31 16:19:38.028163 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-987bb4c6-fde4-4789-8ba5-9d4a6d73d8f0 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:38.030574 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-987bb4c6-fde4-4789-8ba5-9d4a6d73d8f0 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:38.050329 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-987bb4c6-fde4-4789-8ba5-9d4a6d73d8f0 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:38.051228 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-987bb4c6-fde4-4789-8ba5-9d4a6d73d8f0 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:38.052012 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-987bb4c6-fde4-4789-8ba5-9d4a6d73d8f0 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:38.053845 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-987bb4c6-fde4-4789-8ba5-9d4a6d73d8f0 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:38.054900 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-987bb4c6-fde4-4789-8ba5-9d4a6d73d8f0 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:38.058787 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-987bb4c6-fde4-4789-8ba5-9d4a6d73d8f0 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:38.832162 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=8 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:19:39.507788 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-987bb4c6-fde4-4789-8ba5-9d4a6d73d8f0 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:39.522250 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-987bb4c6-fde4-4789-8ba5-9d4a6d73d8f0 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1668 microversion: 2.1 time: 1.511271 Aug 31 16:19:39.525624 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2402/4784] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:38 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1668 bytes in 1519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:19:39.543891 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1bc6910c-8a86-41a5-8f7e-4868f45e3eaa tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:39.545912 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1bc6910c-8a86-41a5-8f7e-4868f45e3eaa tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] [instance: 5c468688-561a-4642-86f1-84b822674e33] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:39.561739 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1bc6910c-8a86-41a5-8f7e-4868f45e3eaa tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:39.562598 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1bc6910c-8a86-41a5-8f7e-4868f45e3eaa tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:39.564231 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1bc6910c-8a86-41a5-8f7e-4868f45e3eaa tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:39.566962 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1bc6910c-8a86-41a5-8f7e-4868f45e3eaa tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:39.568810 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1bc6910c-8a86-41a5-8f7e-4868f45e3eaa tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:39.570197 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1bc6910c-8a86-41a5-8f7e-4868f45e3eaa tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:39.704209 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-7bf81109-e13c-467b-b54f-2ba55b3b617e tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:19:39.705018 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-7bf81109-e13c-467b-b54f-2ba55b3b617e tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:19:39.705622 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-7bf81109-e13c-467b-b54f-2ba55b3b617e tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:19:39.706187 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-7bf81109-e13c-467b-b54f-2ba55b3b617e tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:19:39.706929 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-7bf81109-e13c-467b-b54f-2ba55b3b617e tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:19:39.745860 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7bf81109-e13c-467b-b54f-2ba55b3b617e tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:39.746697 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7bf81109-e13c-467b-b54f-2ba55b3b617e tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:39.747443 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7bf81109-e13c-467b-b54f-2ba55b3b617e tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:39.754008 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7bf81109-e13c-467b-b54f-2ba55b3b617e tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:39.755221 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7bf81109-e13c-467b-b54f-2ba55b3b617e tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:39.756017 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7bf81109-e13c-467b-b54f-2ba55b3b617e tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:39.793058 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:19:39.800196 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-1bc6910c-8a86-41a5-8f7e-4868f45e3eaa tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c697cf3c2d6d4edb93426d828c10d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e713a65903474cc28584721f2780841e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:39.863764 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-1bc6910c-8a86-41a5-8f7e-4868f45e3eaa tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c697cf3c2d6d4edb93426d828c10d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e713a65903474cc28584721f2780841e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:39.887159 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-1bc6910c-8a86-41a5-8f7e-4868f45e3eaa tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c697cf3c2d6d4edb93426d828c10d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e713a65903474cc28584721f2780841e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:39.889291 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1bc6910c-8a86-41a5-8f7e-4868f45e3eaa tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] 10.222.0.61 "GET /compute/v2.1/servers/5c468688-561a-4642-86f1-84b822674e33" status: 200 len: 1365 microversion: 2.57 time: 0.360906 Aug 31 16:19:39.890275 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2403/4785] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:19:39 2022] GET /compute/v2.1/servers/5c468688-561a-4642-86f1-84b822674e33 => generated 1365 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:19:39.918835 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-7bf81109-e13c-467b-b54f-2ba55b3b617e tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Getting quotas for project 9f784a8f91774261843e5819cdc6058a. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:19:39.930265 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-7bf81109-e13c-467b-b54f-2ba55b3b617e tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Getting quotas for user 133688fe60724d979e0bbccf65a28b4d and project 9f784a8f91774261843e5819cdc6058a. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:19:39.936125 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-4cff2b00-a5ad-421b-b13c-ab9ce794511f req-9c114979-61fa-4f71-b060-0fa28d907752 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42ccbb85-9677-4cb9-879a-dc280cda020c", "name": "network-vif-unplugged", "status": "completed", "tag": "44b19fab-a1b0-47af-8c78-4bab130a016b"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:19:39.989878 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-4cff2b00-a5ad-421b-b13c-ab9ce794511f req-9c114979-61fa-4f71-b060-0fa28d907752 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:39.990693 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-4cff2b00-a5ad-421b-b13c-ab9ce794511f req-9c114979-61fa-4f71-b060-0fa28d907752 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:39.991397 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-4cff2b00-a5ad-421b-b13c-ab9ce794511f req-9c114979-61fa-4f71-b060-0fa28d907752 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:39.998436 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:19:40.011493 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7bf81109-e13c-467b-b54f-2ba55b3b617e tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Going to run 1 instances... {{(pid=122256) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:19:40.029283 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7bf81109-e13c-467b-b54f-2ba55b3b617e tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] [instance: 41e57122-c82d-4f6d-af4f-fca28da61d70] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:19:40.062544 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-4cff2b00-a5ad-421b-b13c-ab9ce794511f req-9c114979-61fa-4f71-b060-0fa28d907752 service nova] Creating event network-vif-unplugged:44b19fab-a1b0-47af-8c78-4bab130a016b for instance 42ccbb85-9677-4cb9-879a-dc280cda020c on n-h2-850499-9 Aug 31 16:19:40.081179 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-4cff2b00-a5ad-421b-b13c-ab9ce794511f req-9c114979-61fa-4f71-b060-0fa28d907752 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.174159 Aug 31 16:19:40.084216 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2404/4786] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:19:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:19:40.099393 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-cc8c459d-6389-45aa-9bcc-5bd770cf2fed tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:40.100748 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-cc8c459d-6389-45aa-9bcc-5bd770cf2fed tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:40.110817 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cc8c459d-6389-45aa-9bcc-5bd770cf2fed tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:40.111597 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cc8c459d-6389-45aa-9bcc-5bd770cf2fed tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:40.123946 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:19:40.128579 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cc8c459d-6389-45aa-9bcc-5bd770cf2fed tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:40.136444 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cc8c459d-6389-45aa-9bcc-5bd770cf2fed tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:40.138928 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cc8c459d-6389-45aa-9bcc-5bd770cf2fed tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:40.140898 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cc8c459d-6389-45aa-9bcc-5bd770cf2fed tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:40.227463 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7bf81109-e13c-467b-b54f-2ba55b3b617e tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.928777 Aug 31 16:19:40.246558 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2383/4787] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:19:35 2022] POST /compute/v2.1/servers => generated 383 bytes in 4943 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:19:40.263979 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-873197bc-8161-40e5-b3b9-fa9c5584ef48 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:40.265030 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-873197bc-8161-40e5-b3b9-fa9c5584ef48 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] [instance: 41e57122-c82d-4f6d-af4f-fca28da61d70] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:40.573576 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-873197bc-8161-40e5-b3b9-fa9c5584ef48 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133688fe60724d979e0bbccf65a28b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f784a8f91774261843e5819cdc6058a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:40.582848 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-873197bc-8161-40e5-b3b9-fa9c5584ef48 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] 10.222.0.61 "GET /compute/v2.1/servers/41e57122-c82d-4f6d-af4f-fca28da61d70" status: 200 len: 1223 microversion: 2.1 time: 0.334557 Aug 31 16:19:40.584126 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2384/4788] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:40 2022] GET /compute/v2.1/servers/41e57122-c82d-4f6d-af4f-fca28da61d70 => generated 1223 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:19:40.891233 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-cc8c459d-6389-45aa-9bcc-5bd770cf2fed tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:40.902268 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-cc8c459d-6389-45aa-9bcc-5bd770cf2fed tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1668 microversion: 2.1 time: 0.815614 Aug 31 16:19:40.905522 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2405/4789] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:40 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1668 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:19:40.947998 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7945ae19-0345-487a-bd34-49a97b5d629d tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:40.949727 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7945ae19-0345-487a-bd34-49a97b5d629d tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] [instance: 5c468688-561a-4642-86f1-84b822674e33] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:40.972462 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7945ae19-0345-487a-bd34-49a97b5d629d tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:40.974339 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7945ae19-0345-487a-bd34-49a97b5d629d tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:40.975672 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7945ae19-0345-487a-bd34-49a97b5d629d tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:40.979448 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7945ae19-0345-487a-bd34-49a97b5d629d tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:40.981564 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7945ae19-0345-487a-bd34-49a97b5d629d tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:40.984916 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7945ae19-0345-487a-bd34-49a97b5d629d tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:41.198572 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7945ae19-0345-487a-bd34-49a97b5d629d tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c697cf3c2d6d4edb93426d828c10d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e713a65903474cc28584721f2780841e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:41.215531 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7945ae19-0345-487a-bd34-49a97b5d629d tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c697cf3c2d6d4edb93426d828c10d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e713a65903474cc28584721f2780841e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:41.217061 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7945ae19-0345-487a-bd34-49a97b5d629d tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c697cf3c2d6d4edb93426d828c10d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e713a65903474cc28584721f2780841e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:41.229011 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7945ae19-0345-487a-bd34-49a97b5d629d tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] 10.222.0.61 "GET /compute/v2.1/servers/5c468688-561a-4642-86f1-84b822674e33" status: 200 len: 1365 microversion: 2.57 time: 0.285156 Aug 31 16:19:41.232155 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2385/4790] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:19:40 2022] GET /compute/v2.1/servers/5c468688-561a-4642-86f1-84b822674e33 => generated 1365 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:19:41.619677 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0d1f7c40-9092-46eb-8ee4-7840829c810e tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:41.620501 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0d1f7c40-9092-46eb-8ee4-7840829c810e tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] [instance: 41e57122-c82d-4f6d-af4f-fca28da61d70] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:41.628318 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=40 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:19:41.648087 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0d1f7c40-9092-46eb-8ee4-7840829c810e tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:41.651671 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0d1f7c40-9092-46eb-8ee4-7840829c810e tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:41.654841 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0d1f7c40-9092-46eb-8ee4-7840829c810e tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:41.655894 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0d1f7c40-9092-46eb-8ee4-7840829c810e tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:41.657968 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0d1f7c40-9092-46eb-8ee4-7840829c810e tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:41.659738 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0d1f7c40-9092-46eb-8ee4-7840829c810e tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:42.097482 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0d1f7c40-9092-46eb-8ee4-7840829c810e tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133688fe60724d979e0bbccf65a28b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f784a8f91774261843e5819cdc6058a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:42.110089 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0d1f7c40-9092-46eb-8ee4-7840829c810e tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] 10.222.0.61 "GET /compute/v2.1/servers/41e57122-c82d-4f6d-af4f-fca28da61d70" status: 200 len: 1227 microversion: 2.1 time: 0.510233 Aug 31 16:19:42.114094 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2406/4791] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:41 2022] GET /compute/v2.1/servers/41e57122-c82d-4f6d-af4f-fca28da61d70 => generated 1227 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:19:42.267986 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-acf67b9e-400e-484e-b1c9-0a2118808ec5 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:42.270731 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-acf67b9e-400e-484e-b1c9-0a2118808ec5 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] [instance: 5c468688-561a-4642-86f1-84b822674e33] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:42.311335 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-acf67b9e-400e-484e-b1c9-0a2118808ec5 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:42.312455 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-acf67b9e-400e-484e-b1c9-0a2118808ec5 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:42.313122 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-acf67b9e-400e-484e-b1c9-0a2118808ec5 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:42.314478 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-acf67b9e-400e-484e-b1c9-0a2118808ec5 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:42.315141 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-acf67b9e-400e-484e-b1c9-0a2118808ec5 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:42.315980 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-acf67b9e-400e-484e-b1c9-0a2118808ec5 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:42.608494 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-acf67b9e-400e-484e-b1c9-0a2118808ec5 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c697cf3c2d6d4edb93426d828c10d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e713a65903474cc28584721f2780841e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:42.627860 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-acf67b9e-400e-484e-b1c9-0a2118808ec5 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c697cf3c2d6d4edb93426d828c10d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e713a65903474cc28584721f2780841e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:42.640322 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-acf67b9e-400e-484e-b1c9-0a2118808ec5 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c697cf3c2d6d4edb93426d828c10d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e713a65903474cc28584721f2780841e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:42.646767 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-acf67b9e-400e-484e-b1c9-0a2118808ec5 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] 10.222.0.61 "GET /compute/v2.1/servers/5c468688-561a-4642-86f1-84b822674e33" status: 200 len: 1365 microversion: 2.57 time: 0.386750 Aug 31 16:19:42.648852 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2386/4792] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:19:42 2022] GET /compute/v2.1/servers/5c468688-561a-4642-86f1-84b822674e33 => generated 1365 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:19:43.143448 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b6ecf901-25cf-4636-b98b-11c6bd08d57e tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:43.144485 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b6ecf901-25cf-4636-b98b-11c6bd08d57e tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] [instance: 41e57122-c82d-4f6d-af4f-fca28da61d70] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:43.176204 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b6ecf901-25cf-4636-b98b-11c6bd08d57e tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:43.177018 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b6ecf901-25cf-4636-b98b-11c6bd08d57e tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:43.177771 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b6ecf901-25cf-4636-b98b-11c6bd08d57e tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:43.184437 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b6ecf901-25cf-4636-b98b-11c6bd08d57e tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:43.184437 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b6ecf901-25cf-4636-b98b-11c6bd08d57e tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:43.185718 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b6ecf901-25cf-4636-b98b-11c6bd08d57e tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:43.579801 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b6ecf901-25cf-4636-b98b-11c6bd08d57e tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133688fe60724d979e0bbccf65a28b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f784a8f91774261843e5819cdc6058a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:43.590604 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b6ecf901-25cf-4636-b98b-11c6bd08d57e tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] 10.222.0.61 "GET /compute/v2.1/servers/41e57122-c82d-4f6d-af4f-fca28da61d70" status: 200 len: 1293 microversion: 2.1 time: 0.453745 Aug 31 16:19:43.593947 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2407/4793] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:43 2022] GET /compute/v2.1/servers/41e57122-c82d-4f6d-af4f-fca28da61d70 => generated 1293 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:19:43.677907 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5e662c31-7420-4d67-9358-b5743920e24f tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:43.679594 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5e662c31-7420-4d67-9358-b5743920e24f tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] [instance: 5c468688-561a-4642-86f1-84b822674e33] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:43.711434 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5e662c31-7420-4d67-9358-b5743920e24f tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:43.718278 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5e662c31-7420-4d67-9358-b5743920e24f tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:43.726098 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5e662c31-7420-4d67-9358-b5743920e24f tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:43.730206 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5e662c31-7420-4d67-9358-b5743920e24f tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:43.731446 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5e662c31-7420-4d67-9358-b5743920e24f tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:43.732563 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5e662c31-7420-4d67-9358-b5743920e24f tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:43.981378 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5e662c31-7420-4d67-9358-b5743920e24f tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c697cf3c2d6d4edb93426d828c10d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e713a65903474cc28584721f2780841e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:44.008419 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5e662c31-7420-4d67-9358-b5743920e24f tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c697cf3c2d6d4edb93426d828c10d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e713a65903474cc28584721f2780841e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:44.020276 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5e662c31-7420-4d67-9358-b5743920e24f tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c697cf3c2d6d4edb93426d828c10d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e713a65903474cc28584721f2780841e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:44.022932 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5e662c31-7420-4d67-9358-b5743920e24f tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] 10.222.0.61 "GET /compute/v2.1/servers/5c468688-561a-4642-86f1-84b822674e33" status: 200 len: 1365 microversion: 2.57 time: 0.352541 Aug 31 16:19:44.024308 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2387/4794] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:19:43 2022] GET /compute/v2.1/servers/5c468688-561a-4642-86f1-84b822674e33 => generated 1365 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:19:44.252870 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-60d53925-626f-4e04-9c70-17f866e688ac tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:44.255834 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-60d53925-626f-4e04-9c70-17f866e688ac tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:44.273378 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-60d53925-626f-4e04-9c70-17f866e688ac tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:44.274649 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-60d53925-626f-4e04-9c70-17f866e688ac tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:44.276237 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-60d53925-626f-4e04-9c70-17f866e688ac tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:44.278226 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-60d53925-626f-4e04-9c70-17f866e688ac tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:44.280463 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-60d53925-626f-4e04-9c70-17f866e688ac tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:44.281933 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-60d53925-626f-4e04-9c70-17f866e688ac tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:44.629757 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c1612009-5ed9-4cf6-a63e-b26a5f23cf9f tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:44.630503 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c1612009-5ed9-4cf6-a63e-b26a5f23cf9f tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] [instance: 41e57122-c82d-4f6d-af4f-fca28da61d70] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:44.640130 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c1612009-5ed9-4cf6-a63e-b26a5f23cf9f tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:44.644001 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c1612009-5ed9-4cf6-a63e-b26a5f23cf9f tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:44.644814 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c1612009-5ed9-4cf6-a63e-b26a5f23cf9f tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:44.646776 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c1612009-5ed9-4cf6-a63e-b26a5f23cf9f tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:44.648098 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c1612009-5ed9-4cf6-a63e-b26a5f23cf9f tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:44.650536 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c1612009-5ed9-4cf6-a63e-b26a5f23cf9f tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:44.789256 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-60d53925-626f-4e04-9c70-17f866e688ac tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:44.813523 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-60d53925-626f-4e04-9c70-17f866e688ac tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1668 microversion: 2.1 time: 0.572468 Aug 31 16:19:44.814396 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2408/4795] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:44 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1668 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:19:44.847565 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-928c7662-5081-4b52-bc1d-9832e59d58a7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:44.849090 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-928c7662-5081-4b52-bc1d-9832e59d58a7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:44.863183 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-928c7662-5081-4b52-bc1d-9832e59d58a7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:44.863828 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-928c7662-5081-4b52-bc1d-9832e59d58a7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:44.864276 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-928c7662-5081-4b52-bc1d-9832e59d58a7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:44.865122 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-928c7662-5081-4b52-bc1d-9832e59d58a7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:44.865658 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-928c7662-5081-4b52-bc1d-9832e59d58a7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:44.866103 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-928c7662-5081-4b52-bc1d-9832e59d58a7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:44.884293 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c1612009-5ed9-4cf6-a63e-b26a5f23cf9f tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133688fe60724d979e0bbccf65a28b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f784a8f91774261843e5819cdc6058a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:44.903410 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c1612009-5ed9-4cf6-a63e-b26a5f23cf9f tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] 10.222.0.61 "GET /compute/v2.1/servers/41e57122-c82d-4f6d-af4f-fca28da61d70" status: 200 len: 1281 microversion: 2.1 time: 0.277364 Aug 31 16:19:44.904498 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2388/4796] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:44 2022] GET /compute/v2.1/servers/41e57122-c82d-4f6d-af4f-fca28da61d70 => generated 1281 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:19:45.051419 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c5d79e76-920e-41b1-b9df-f07e3d0f260b tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:45.052316 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c5d79e76-920e-41b1-b9df-f07e3d0f260b tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] [instance: 5c468688-561a-4642-86f1-84b822674e33] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:45.070869 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c5d79e76-920e-41b1-b9df-f07e3d0f260b tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:45.073746 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c5d79e76-920e-41b1-b9df-f07e3d0f260b tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:45.074794 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c5d79e76-920e-41b1-b9df-f07e3d0f260b tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:45.076739 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c5d79e76-920e-41b1-b9df-f07e3d0f260b tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:45.077902 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c5d79e76-920e-41b1-b9df-f07e3d0f260b tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:45.079585 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c5d79e76-920e-41b1-b9df-f07e3d0f260b tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:45.308338 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c5d79e76-920e-41b1-b9df-f07e3d0f260b tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c697cf3c2d6d4edb93426d828c10d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e713a65903474cc28584721f2780841e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:45.333958 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c5d79e76-920e-41b1-b9df-f07e3d0f260b tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c697cf3c2d6d4edb93426d828c10d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e713a65903474cc28584721f2780841e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:45.344196 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c5d79e76-920e-41b1-b9df-f07e3d0f260b tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c697cf3c2d6d4edb93426d828c10d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e713a65903474cc28584721f2780841e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:45.353410 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c5d79e76-920e-41b1-b9df-f07e3d0f260b tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] 10.222.0.61 "GET /compute/v2.1/servers/5c468688-561a-4642-86f1-84b822674e33" status: 200 len: 1365 microversion: 2.57 time: 0.306117 Aug 31 16:19:45.356574 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2389/4797] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:19:45 2022] GET /compute/v2.1/servers/5c468688-561a-4642-86f1-84b822674e33 => generated 1365 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:19:45.536368 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-928c7662-5081-4b52-bc1d-9832e59d58a7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:45.555651 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-928c7662-5081-4b52-bc1d-9832e59d58a7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1668 microversion: 2.1 time: 0.716024 Aug 31 16:19:45.559845 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2409/4798] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:44 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1668 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:19:45.594089 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-14ece599-f9a2-4009-81fb-1a060962fb1c tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:45.597340 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-14ece599-f9a2-4009-81fb-1a060962fb1c tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:45.613064 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-14ece599-f9a2-4009-81fb-1a060962fb1c tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:45.613706 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-14ece599-f9a2-4009-81fb-1a060962fb1c tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:45.614430 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-14ece599-f9a2-4009-81fb-1a060962fb1c tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:45.615354 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-14ece599-f9a2-4009-81fb-1a060962fb1c tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:45.616037 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-14ece599-f9a2-4009-81fb-1a060962fb1c tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:45.616647 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-14ece599-f9a2-4009-81fb-1a060962fb1c tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:45.939943 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b03b2b2c-9d83-48d2-8e36-b48762e7f74c tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:45.940572 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b03b2b2c-9d83-48d2-8e36-b48762e7f74c tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] [instance: 41e57122-c82d-4f6d-af4f-fca28da61d70] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:45.955659 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b03b2b2c-9d83-48d2-8e36-b48762e7f74c tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:45.959592 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b03b2b2c-9d83-48d2-8e36-b48762e7f74c tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:45.960898 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b03b2b2c-9d83-48d2-8e36-b48762e7f74c tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:45.967212 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b03b2b2c-9d83-48d2-8e36-b48762e7f74c tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:45.968092 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b03b2b2c-9d83-48d2-8e36-b48762e7f74c tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:45.969221 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b03b2b2c-9d83-48d2-8e36-b48762e7f74c tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:46.117955 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-14ece599-f9a2-4009-81fb-1a060962fb1c tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:46.156704 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-14ece599-f9a2-4009-81fb-1a060962fb1c tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1668 microversion: 2.1 time: 0.568666 Aug 31 16:19:46.178577 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2390/4799] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:45 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1668 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:19:46.213331 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a73c3ac2-a80d-4653-aba0-9537e10c487a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:19:46.220881 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a73c3ac2-a80d-4653-aba0-9537e10c487a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:46.228342 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a73c3ac2-a80d-4653-aba0-9537e10c487a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:46.230245 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a73c3ac2-a80d-4653-aba0-9537e10c487a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:46.231221 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a73c3ac2-a80d-4653-aba0-9537e10c487a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:46.232392 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a73c3ac2-a80d-4653-aba0-9537e10c487a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:46.233414 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a73c3ac2-a80d-4653-aba0-9537e10c487a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:46.234108 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a73c3ac2-a80d-4653-aba0-9537e10c487a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:46.364676 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a73c3ac2-a80d-4653-aba0-9537e10c487a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "POST /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c/action" status: 202 len: 0 microversion: 2.1 time: 0.160702 Aug 31 16:19:46.366049 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2391/4800] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:19:46 2022] POST /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c/action => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:19:46.385919 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-eb914b6b-322a-4a26-b25f-bfa5e85430fb tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:46.388796 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-eb914b6b-322a-4a26-b25f-bfa5e85430fb tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:46.406142 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eb914b6b-322a-4a26-b25f-bfa5e85430fb tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:46.410263 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eb914b6b-322a-4a26-b25f-bfa5e85430fb tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:46.413980 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eb914b6b-322a-4a26-b25f-bfa5e85430fb tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:46.417082 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eb914b6b-322a-4a26-b25f-bfa5e85430fb tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:46.418040 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eb914b6b-322a-4a26-b25f-bfa5e85430fb tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:46.418581 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eb914b6b-322a-4a26-b25f-bfa5e85430fb tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:47.396875 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b03b2b2c-9d83-48d2-8e36-b48762e7f74c tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133688fe60724d979e0bbccf65a28b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f784a8f91774261843e5819cdc6058a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:47.443610 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b03b2b2c-9d83-48d2-8e36-b48762e7f74c tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] 10.222.0.61 "GET /compute/v2.1/servers/41e57122-c82d-4f6d-af4f-fca28da61d70" status: 200 len: 1323 microversion: 2.1 time: 1.505130 Aug 31 16:19:47.446090 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2410/4801] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:45 2022] GET /compute/v2.1/servers/41e57122-c82d-4f6d-af4f-fca28da61d70 => generated 1323 bytes in 1512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:19:47.482217 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d479cec7-a16c-445e-99ac-c997eca6fdbb tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:47.483898 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d479cec7-a16c-445e-99ac-c997eca6fdbb tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] [instance: 5c468688-561a-4642-86f1-84b822674e33] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:47.514512 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d479cec7-a16c-445e-99ac-c997eca6fdbb tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:47.515358 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d479cec7-a16c-445e-99ac-c997eca6fdbb tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:47.516065 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d479cec7-a16c-445e-99ac-c997eca6fdbb tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:47.517390 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d479cec7-a16c-445e-99ac-c997eca6fdbb tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:47.518280 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d479cec7-a16c-445e-99ac-c997eca6fdbb tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:47.518887 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d479cec7-a16c-445e-99ac-c997eca6fdbb tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:47.888005 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d479cec7-a16c-445e-99ac-c997eca6fdbb tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c697cf3c2d6d4edb93426d828c10d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e713a65903474cc28584721f2780841e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:47.910276 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d479cec7-a16c-445e-99ac-c997eca6fdbb tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c697cf3c2d6d4edb93426d828c10d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e713a65903474cc28584721f2780841e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:47.914375 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d479cec7-a16c-445e-99ac-c997eca6fdbb tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c697cf3c2d6d4edb93426d828c10d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e713a65903474cc28584721f2780841e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:47.915981 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d479cec7-a16c-445e-99ac-c997eca6fdbb tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] 10.222.0.61 "GET /compute/v2.1/servers/5c468688-561a-4642-86f1-84b822674e33" status: 200 len: 1365 microversion: 2.57 time: 0.466509 Aug 31 16:19:47.919414 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2411/4802] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:19:47 2022] GET /compute/v2.1/servers/5c468688-561a-4642-86f1-84b822674e33 => generated 1365 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:19:48.146245 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-eb914b6b-322a-4a26-b25f-bfa5e85430fb tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:48.160850 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-eb914b6b-322a-4a26-b25f-bfa5e85430fb tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1670 microversion: 2.1 time: 1.787853 Aug 31 16:19:48.175804 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2392/4803] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:46 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1670 bytes in 1805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:19:48.471986 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ba00584b-516a-43c7-b786-0032b0b95629 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:48.474858 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ba00584b-516a-43c7-b786-0032b0b95629 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] [instance: 41e57122-c82d-4f6d-af4f-fca28da61d70] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:48.515656 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ba00584b-516a-43c7-b786-0032b0b95629 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:48.516179 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ba00584b-516a-43c7-b786-0032b0b95629 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:48.516635 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ba00584b-516a-43c7-b786-0032b0b95629 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:48.532377 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ba00584b-516a-43c7-b786-0032b0b95629 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:48.532894 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ba00584b-516a-43c7-b786-0032b0b95629 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:48.533341 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ba00584b-516a-43c7-b786-0032b0b95629 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:48.967960 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b691a967-dcae-4c0c-a389-e2c95694bf36 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:48.972013 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b691a967-dcae-4c0c-a389-e2c95694bf36 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] [instance: 5c468688-561a-4642-86f1-84b822674e33] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:48.990640 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b691a967-dcae-4c0c-a389-e2c95694bf36 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:48.991943 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b691a967-dcae-4c0c-a389-e2c95694bf36 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:48.992844 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b691a967-dcae-4c0c-a389-e2c95694bf36 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:48.994904 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b691a967-dcae-4c0c-a389-e2c95694bf36 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:48.997087 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b691a967-dcae-4c0c-a389-e2c95694bf36 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:48.999265 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b691a967-dcae-4c0c-a389-e2c95694bf36 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:49.197333 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b691a967-dcae-4c0c-a389-e2c95694bf36 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c697cf3c2d6d4edb93426d828c10d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e713a65903474cc28584721f2780841e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:49.225434 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b691a967-dcae-4c0c-a389-e2c95694bf36 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c697cf3c2d6d4edb93426d828c10d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e713a65903474cc28584721f2780841e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:49.232053 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b691a967-dcae-4c0c-a389-e2c95694bf36 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c697cf3c2d6d4edb93426d828c10d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e713a65903474cc28584721f2780841e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:49.235306 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b691a967-dcae-4c0c-a389-e2c95694bf36 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] 10.222.0.61 "GET /compute/v2.1/servers/5c468688-561a-4642-86f1-84b822674e33" status: 200 len: 1365 microversion: 2.57 time: 0.279031 Aug 31 16:19:49.238019 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2393/4804] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:19:48 2022] GET /compute/v2.1/servers/5c468688-561a-4642-86f1-84b822674e33 => generated 1365 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:19:49.422428 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ba00584b-516a-43c7-b786-0032b0b95629 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133688fe60724d979e0bbccf65a28b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f784a8f91774261843e5819cdc6058a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:49.436411 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ba00584b-516a-43c7-b786-0032b0b95629 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] 10.222.0.61 "GET /compute/v2.1/servers/41e57122-c82d-4f6d-af4f-fca28da61d70" status: 200 len: 1323 microversion: 2.1 time: 0.972796 Aug 31 16:19:49.444403 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2412/4805] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:48 2022] GET /compute/v2.1/servers/41e57122-c82d-4f6d-af4f-fca28da61d70 => generated 1323 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:19:49.720280 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-97e3d104-88f4-4f88-9324-843619ea9ab9 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:49.721275 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-97e3d104-88f4-4f88-9324-843619ea9ab9 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:49.730742 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-97e3d104-88f4-4f88-9324-843619ea9ab9 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:49.737074 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-97e3d104-88f4-4f88-9324-843619ea9ab9 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:49.737767 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-97e3d104-88f4-4f88-9324-843619ea9ab9 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:49.739266 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-97e3d104-88f4-4f88-9324-843619ea9ab9 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:49.741804 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-97e3d104-88f4-4f88-9324-843619ea9ab9 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:49.742417 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-97e3d104-88f4-4f88-9324-843619ea9ab9 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:49.802375 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:19:50.171345 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-97e3d104-88f4-4f88-9324-843619ea9ab9 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:50.186251 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-97e3d104-88f4-4f88-9324-843619ea9ab9 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1670 microversion: 2.1 time: 0.946453 Aug 31 16:19:50.187194 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2394/4806] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:49 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1670 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:19:50.283369 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-bae85c88-ec6c-42f1-ba1e-b98d444a3087 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:50.287080 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-bae85c88-ec6c-42f1-ba1e-b98d444a3087 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] [instance: 5c468688-561a-4642-86f1-84b822674e33] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:50.307158 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bae85c88-ec6c-42f1-ba1e-b98d444a3087 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:50.310339 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bae85c88-ec6c-42f1-ba1e-b98d444a3087 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:50.311340 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bae85c88-ec6c-42f1-ba1e-b98d444a3087 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:50.313354 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bae85c88-ec6c-42f1-ba1e-b98d444a3087 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:50.314446 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bae85c88-ec6c-42f1-ba1e-b98d444a3087 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:50.315708 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bae85c88-ec6c-42f1-ba1e-b98d444a3087 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:50.478826 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-00944a28-9196-4aab-9b96-49d9dcf8366d tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:50.480193 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-00944a28-9196-4aab-9b96-49d9dcf8366d tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] [instance: 41e57122-c82d-4f6d-af4f-fca28da61d70] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:50.502654 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-00944a28-9196-4aab-9b96-49d9dcf8366d tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:50.504018 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-00944a28-9196-4aab-9b96-49d9dcf8366d tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:50.505832 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-00944a28-9196-4aab-9b96-49d9dcf8366d tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:50.510016 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-00944a28-9196-4aab-9b96-49d9dcf8366d tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:50.513009 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-00944a28-9196-4aab-9b96-49d9dcf8366d tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:50.513553 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-00944a28-9196-4aab-9b96-49d9dcf8366d tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:50.584101 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=8 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:19:50.768238 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-bae85c88-ec6c-42f1-ba1e-b98d444a3087 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c697cf3c2d6d4edb93426d828c10d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e713a65903474cc28584721f2780841e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:50.810477 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-bae85c88-ec6c-42f1-ba1e-b98d444a3087 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c697cf3c2d6d4edb93426d828c10d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e713a65903474cc28584721f2780841e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:50.822578 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-bae85c88-ec6c-42f1-ba1e-b98d444a3087 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c697cf3c2d6d4edb93426d828c10d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e713a65903474cc28584721f2780841e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:50.825664 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-bae85c88-ec6c-42f1-ba1e-b98d444a3087 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] 10.222.0.61 "GET /compute/v2.1/servers/5c468688-561a-4642-86f1-84b822674e33" status: 200 len: 1365 microversion: 2.57 time: 0.552922 Aug 31 16:19:50.828617 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2413/4807] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:19:50 2022] GET /compute/v2.1/servers/5c468688-561a-4642-86f1-84b822674e33 => generated 1365 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:19:51.057538 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-06ccfa18-da4b-4df7-983f-6eb11e926358 req-0e25ce2f-a42d-4c99-84c1-9460e6259924 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41e57122-c82d-4f6d-af4f-fca28da61d70", "tag": "aa5919c1-b206-4c36-9030-7581ac0cc0e8"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:19:51.085868 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-06ccfa18-da4b-4df7-983f-6eb11e926358 req-0e25ce2f-a42d-4c99-84c1-9460e6259924 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:51.088235 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-06ccfa18-da4b-4df7-983f-6eb11e926358 req-0e25ce2f-a42d-4c99-84c1-9460e6259924 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:51.088927 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-06ccfa18-da4b-4df7-983f-6eb11e926358 req-0e25ce2f-a42d-4c99-84c1-9460e6259924 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:51.119158 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-06ccfa18-da4b-4df7-983f-6eb11e926358 req-0e25ce2f-a42d-4c99-84c1-9460e6259924 service nova] Creating event network-changed:aa5919c1-b206-4c36-9030-7581ac0cc0e8 for instance 41e57122-c82d-4f6d-af4f-fca28da61d70 on n-h2-850499-9 Aug 31 16:19:51.135114 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-06ccfa18-da4b-4df7-983f-6eb11e926358 req-0e25ce2f-a42d-4c99-84c1-9460e6259924 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079300 Aug 31 16:19:51.138999 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2414/4808] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:19:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:19:51.238692 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b9ffd98b-d70c-4149-a119-f34d2068b566 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:51.241055 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b9ffd98b-d70c-4149-a119-f34d2068b566 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:51.254598 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b9ffd98b-d70c-4149-a119-f34d2068b566 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:51.256449 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b9ffd98b-d70c-4149-a119-f34d2068b566 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:51.259873 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b9ffd98b-d70c-4149-a119-f34d2068b566 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:51.261819 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b9ffd98b-d70c-4149-a119-f34d2068b566 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:51.263342 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b9ffd98b-d70c-4149-a119-f34d2068b566 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:51.265454 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b9ffd98b-d70c-4149-a119-f34d2068b566 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:51.284486 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-00944a28-9196-4aab-9b96-49d9dcf8366d tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133688fe60724d979e0bbccf65a28b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f784a8f91774261843e5819cdc6058a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:51.299472 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-00944a28-9196-4aab-9b96-49d9dcf8366d tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] 10.222.0.61 "GET /compute/v2.1/servers/41e57122-c82d-4f6d-af4f-fca28da61d70" status: 200 len: 1323 microversion: 2.1 time: 0.826043 Aug 31 16:19:51.302474 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2395/4809] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:50 2022] GET /compute/v2.1/servers/41e57122-c82d-4f6d-af4f-fca28da61d70 => generated 1323 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:19:51.718562 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b9ffd98b-d70c-4149-a119-f34d2068b566 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:51.746205 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b9ffd98b-d70c-4149-a119-f34d2068b566 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1668 microversion: 2.1 time: 0.525402 Aug 31 16:19:51.776463 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2415/4810] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:51 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1668 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:19:51.795641 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b480e6a8-1866-4cc0-a886-75d4292a164a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:19:51.799245 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b480e6a8-1866-4cc0-a886-75d4292a164a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:51.826046 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b480e6a8-1866-4cc0-a886-75d4292a164a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:51.826837 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b480e6a8-1866-4cc0-a886-75d4292a164a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:51.831547 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b480e6a8-1866-4cc0-a886-75d4292a164a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:51.832941 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b480e6a8-1866-4cc0-a886-75d4292a164a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:51.836621 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b480e6a8-1866-4cc0-a886-75d4292a164a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:51.837657 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b480e6a8-1866-4cc0-a886-75d4292a164a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:51.862821 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-cf394ffa-0f0f-41a7-96fb-3c71556976bd tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:51.864764 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-cf394ffa-0f0f-41a7-96fb-3c71556976bd tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] [instance: 5c468688-561a-4642-86f1-84b822674e33] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:51.880743 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cf394ffa-0f0f-41a7-96fb-3c71556976bd tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:51.881558 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cf394ffa-0f0f-41a7-96fb-3c71556976bd tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:51.882175 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cf394ffa-0f0f-41a7-96fb-3c71556976bd tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:51.883065 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cf394ffa-0f0f-41a7-96fb-3c71556976bd tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:51.886888 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cf394ffa-0f0f-41a7-96fb-3c71556976bd tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:51.887611 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cf394ffa-0f0f-41a7-96fb-3c71556976bd tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:51.914468 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b480e6a8-1866-4cc0-a886-75d4292a164a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "POST /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c/action" status: 200 len: 324 microversion: 2.1 time: 0.127972 Aug 31 16:19:51.916260 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2396/4811] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:19:51 2022] POST /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c/action => generated 324 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:19:51.934024 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a77816e0-6915-4393-a149-0ce6cbfa543d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:51.935418 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a77816e0-6915-4393-a149-0ce6cbfa543d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:51.945679 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a77816e0-6915-4393-a149-0ce6cbfa543d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:51.961092 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a77816e0-6915-4393-a149-0ce6cbfa543d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:51.963679 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a77816e0-6915-4393-a149-0ce6cbfa543d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:51.964651 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a77816e0-6915-4393-a149-0ce6cbfa543d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:51.966270 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a77816e0-6915-4393-a149-0ce6cbfa543d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:51.967027 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a77816e0-6915-4393-a149-0ce6cbfa543d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:52.050392 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-cf394ffa-0f0f-41a7-96fb-3c71556976bd tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c697cf3c2d6d4edb93426d828c10d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e713a65903474cc28584721f2780841e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:52.068126 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-cf394ffa-0f0f-41a7-96fb-3c71556976bd tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c697cf3c2d6d4edb93426d828c10d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e713a65903474cc28584721f2780841e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:52.073895 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-cf394ffa-0f0f-41a7-96fb-3c71556976bd tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c697cf3c2d6d4edb93426d828c10d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e713a65903474cc28584721f2780841e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:52.075869 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-cf394ffa-0f0f-41a7-96fb-3c71556976bd tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] 10.222.0.61 "GET /compute/v2.1/servers/5c468688-561a-4642-86f1-84b822674e33" status: 200 len: 1365 microversion: 2.57 time: 0.219990 Aug 31 16:19:52.079400 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2416/4812] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:19:51 2022] GET /compute/v2.1/servers/5c468688-561a-4642-86f1-84b822674e33 => generated 1365 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:19:52.350563 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-56fcf019-1627-4bf1-a36a-17e1acdf1e2e tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:52.353179 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-56fcf019-1627-4bf1-a36a-17e1acdf1e2e tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] [instance: 41e57122-c82d-4f6d-af4f-fca28da61d70] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:52.380724 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-56fcf019-1627-4bf1-a36a-17e1acdf1e2e tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:52.382200 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-56fcf019-1627-4bf1-a36a-17e1acdf1e2e tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:52.383766 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-56fcf019-1627-4bf1-a36a-17e1acdf1e2e tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:52.385548 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-56fcf019-1627-4bf1-a36a-17e1acdf1e2e tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:52.386863 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-56fcf019-1627-4bf1-a36a-17e1acdf1e2e tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:52.388383 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-56fcf019-1627-4bf1-a36a-17e1acdf1e2e tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:52.938709 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a77816e0-6915-4393-a149-0ce6cbfa543d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:52.960078 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a77816e0-6915-4393-a149-0ce6cbfa543d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1668 microversion: 2.1 time: 1.032661 Aug 31 16:19:52.961094 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2397/4813] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:51 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1668 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:19:52.986302 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e93cc7e2-7d50-4bf6-9da6-299b73a029ec tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:52.987489 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e93cc7e2-7d50-4bf6-9da6-299b73a029ec tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:52.999240 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e93cc7e2-7d50-4bf6-9da6-299b73a029ec tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:53.001163 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e93cc7e2-7d50-4bf6-9da6-299b73a029ec tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:53.001743 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e93cc7e2-7d50-4bf6-9da6-299b73a029ec tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:53.002780 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e93cc7e2-7d50-4bf6-9da6-299b73a029ec tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:53.003273 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e93cc7e2-7d50-4bf6-9da6-299b73a029ec tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:53.006745 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e93cc7e2-7d50-4bf6-9da6-299b73a029ec tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:53.374689 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-56fcf019-1627-4bf1-a36a-17e1acdf1e2e tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133688fe60724d979e0bbccf65a28b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f784a8f91774261843e5819cdc6058a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:53.398928 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-56fcf019-1627-4bf1-a36a-17e1acdf1e2e tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] 10.222.0.61 "GET /compute/v2.1/servers/41e57122-c82d-4f6d-af4f-fca28da61d70" status: 200 len: 1323 microversion: 2.1 time: 1.061692 Aug 31 16:19:53.399565 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2417/4814] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:52 2022] GET /compute/v2.1/servers/41e57122-c82d-4f6d-af4f-fca28da61d70 => generated 1323 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:19:53.407125 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8c5a56a9-5629-4ed4-b15b-86ad8290f060 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:53.412579 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8c5a56a9-5629-4ed4-b15b-86ad8290f060 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] [instance: 5c468688-561a-4642-86f1-84b822674e33] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:53.427986 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8c5a56a9-5629-4ed4-b15b-86ad8290f060 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:53.428682 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8c5a56a9-5629-4ed4-b15b-86ad8290f060 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:53.429295 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8c5a56a9-5629-4ed4-b15b-86ad8290f060 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:53.430481 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8c5a56a9-5629-4ed4-b15b-86ad8290f060 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:53.431023 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8c5a56a9-5629-4ed4-b15b-86ad8290f060 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:53.431460 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8c5a56a9-5629-4ed4-b15b-86ad8290f060 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:53.652831 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e93cc7e2-7d50-4bf6-9da6-299b73a029ec tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:53.683641 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e93cc7e2-7d50-4bf6-9da6-299b73a029ec tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1668 microversion: 2.1 time: 0.701718 Aug 31 16:19:53.690826 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8c5a56a9-5629-4ed4-b15b-86ad8290f060 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c697cf3c2d6d4edb93426d828c10d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e713a65903474cc28584721f2780841e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:53.698056 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2398/4815] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:52 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1668 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:19:53.716821 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-16025627-267f-4ced-9a90-47b02acfc4ac tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:53.720964 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-16025627-267f-4ced-9a90-47b02acfc4ac tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:53.723421 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8c5a56a9-5629-4ed4-b15b-86ad8290f060 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c697cf3c2d6d4edb93426d828c10d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e713a65903474cc28584721f2780841e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:53.728613 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8c5a56a9-5629-4ed4-b15b-86ad8290f060 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c697cf3c2d6d4edb93426d828c10d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e713a65903474cc28584721f2780841e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:53.730005 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8c5a56a9-5629-4ed4-b15b-86ad8290f060 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] 10.222.0.61 "GET /compute/v2.1/servers/5c468688-561a-4642-86f1-84b822674e33" status: 200 len: 1365 microversion: 2.57 time: 0.329156 Aug 31 16:19:53.734497 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2418/4816] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:19:53 2022] GET /compute/v2.1/servers/5c468688-561a-4642-86f1-84b822674e33 => generated 1365 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:19:53.758879 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-16025627-267f-4ced-9a90-47b02acfc4ac tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:53.768737 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-16025627-267f-4ced-9a90-47b02acfc4ac tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:53.769865 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-16025627-267f-4ced-9a90-47b02acfc4ac tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:53.772394 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-16025627-267f-4ced-9a90-47b02acfc4ac tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:53.773918 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-16025627-267f-4ced-9a90-47b02acfc4ac tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:53.774399 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-16025627-267f-4ced-9a90-47b02acfc4ac tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:54.329648 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-16025627-267f-4ced-9a90-47b02acfc4ac tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:54.362282 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-16025627-267f-4ced-9a90-47b02acfc4ac tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1668 microversion: 2.1 time: 0.654576 Aug 31 16:19:54.363874 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2399/4817] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:53 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1668 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:19:54.385565 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-89f13c70-75ae-4707-a5b5-595e2636bc2a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:54.386599 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-89f13c70-75ae-4707-a5b5-595e2636bc2a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:54.400615 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-89f13c70-75ae-4707-a5b5-595e2636bc2a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:54.400889 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-89f13c70-75ae-4707-a5b5-595e2636bc2a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:54.410360 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-89f13c70-75ae-4707-a5b5-595e2636bc2a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:54.411400 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-89f13c70-75ae-4707-a5b5-595e2636bc2a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:54.411930 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-89f13c70-75ae-4707-a5b5-595e2636bc2a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:54.412381 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-89f13c70-75ae-4707-a5b5-595e2636bc2a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:54.446728 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-de6cd2cb-4dbd-4d10-aff0-e86817e9e920 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:54.457225 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-de6cd2cb-4dbd-4d10-aff0-e86817e9e920 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] [instance: 41e57122-c82d-4f6d-af4f-fca28da61d70] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:54.474144 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-de6cd2cb-4dbd-4d10-aff0-e86817e9e920 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:54.477297 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-de6cd2cb-4dbd-4d10-aff0-e86817e9e920 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:54.477297 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-de6cd2cb-4dbd-4d10-aff0-e86817e9e920 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:54.477297 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-de6cd2cb-4dbd-4d10-aff0-e86817e9e920 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:54.477297 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-de6cd2cb-4dbd-4d10-aff0-e86817e9e920 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:54.477297 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-de6cd2cb-4dbd-4d10-aff0-e86817e9e920 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:55.092158 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-de6cd2cb-4dbd-4d10-aff0-e86817e9e920 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133688fe60724d979e0bbccf65a28b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f784a8f91774261843e5819cdc6058a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:55.096956 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:19:55.141447 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-de6cd2cb-4dbd-4d10-aff0-e86817e9e920 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] 10.222.0.61 "GET /compute/v2.1/servers/41e57122-c82d-4f6d-af4f-fca28da61d70" status: 200 len: 1323 microversion: 2.1 time: 0.706097 Aug 31 16:19:55.142671 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2400/4818] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:54 2022] GET /compute/v2.1/servers/41e57122-c82d-4f6d-af4f-fca28da61d70 => generated 1323 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:19:55.147889 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ac5949bb-c0fe-4ad3-b7bc-796599b9221d tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:55.148940 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ac5949bb-c0fe-4ad3-b7bc-796599b9221d tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] [instance: 5c468688-561a-4642-86f1-84b822674e33] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:55.158490 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ac5949bb-c0fe-4ad3-b7bc-796599b9221d tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:55.160133 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ac5949bb-c0fe-4ad3-b7bc-796599b9221d tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:55.175154 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ac5949bb-c0fe-4ad3-b7bc-796599b9221d tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:55.176843 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ac5949bb-c0fe-4ad3-b7bc-796599b9221d tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:55.179189 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ac5949bb-c0fe-4ad3-b7bc-796599b9221d tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:55.179941 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ac5949bb-c0fe-4ad3-b7bc-796599b9221d tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:55.268443 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-89f13c70-75ae-4707-a5b5-595e2636bc2a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:55.283738 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-89f13c70-75ae-4707-a5b5-595e2636bc2a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1668 microversion: 2.1 time: 0.902433 Aug 31 16:19:55.295992 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2419/4819] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:54 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1668 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:19:55.511002 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ac5949bb-c0fe-4ad3-b7bc-796599b9221d tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c697cf3c2d6d4edb93426d828c10d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e713a65903474cc28584721f2780841e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:55.547298 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-56ea9b69-b655-47db-87c6-4cedce136614 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1858308494", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "networks": [{"uuid": "41cc840d-a352-47ac-85b3-b767061353cc"}]}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:19:55.548502 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ac5949bb-c0fe-4ad3-b7bc-796599b9221d tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c697cf3c2d6d4edb93426d828c10d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e713a65903474cc28584721f2780841e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:55.558306 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ac5949bb-c0fe-4ad3-b7bc-796599b9221d tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c697cf3c2d6d4edb93426d828c10d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e713a65903474cc28584721f2780841e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:55.564250 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ac5949bb-c0fe-4ad3-b7bc-796599b9221d tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] 10.222.0.61 "GET /compute/v2.1/servers/5c468688-561a-4642-86f1-84b822674e33" status: 200 len: 1365 microversion: 2.57 time: 0.419319 Aug 31 16:19:55.566806 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2401/4820] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:19:55 2022] GET /compute/v2.1/servers/5c468688-561a-4642-86f1-84b822674e33 => generated 1365 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:19:55.697646 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-56ea9b69-b655-47db-87c6-4cedce136614 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] validate_networks() for [('41cc840d-a352-47ac-85b3-b767061353cc', None, None, None, None, None)] {{(pid=122257) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:19:56.193616 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ab3aeac5-0cf2-4346-8cc1-8bf25fc354ae tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:56.203339 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ab3aeac5-0cf2-4346-8cc1-8bf25fc354ae tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] [instance: 41e57122-c82d-4f6d-af4f-fca28da61d70] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:56.220730 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ab3aeac5-0cf2-4346-8cc1-8bf25fc354ae tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:56.223133 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ab3aeac5-0cf2-4346-8cc1-8bf25fc354ae tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:56.224168 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ab3aeac5-0cf2-4346-8cc1-8bf25fc354ae tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:56.225629 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ab3aeac5-0cf2-4346-8cc1-8bf25fc354ae tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:56.229160 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ab3aeac5-0cf2-4346-8cc1-8bf25fc354ae tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:56.230557 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ab3aeac5-0cf2-4346-8cc1-8bf25fc354ae tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:57.454735 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ab3aeac5-0cf2-4346-8cc1-8bf25fc354ae tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133688fe60724d979e0bbccf65a28b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f784a8f91774261843e5819cdc6058a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:57.485858 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ab3aeac5-0cf2-4346-8cc1-8bf25fc354ae tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] 10.222.0.61 "GET /compute/v2.1/servers/41e57122-c82d-4f6d-af4f-fca28da61d70" status: 200 len: 1323 microversion: 2.1 time: 1.301556 Aug 31 16:19:57.488779 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2402/4821] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:56 2022] GET /compute/v2.1/servers/41e57122-c82d-4f6d-af4f-fca28da61d70 => generated 1323 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:19:57.501461 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-376c9db7-c798-4292-afcf-615264229041 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:57.506792 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-376c9db7-c798-4292-afcf-615264229041 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] [instance: 5c468688-561a-4642-86f1-84b822674e33] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:57.522308 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-376c9db7-c798-4292-afcf-615264229041 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:57.524048 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-376c9db7-c798-4292-afcf-615264229041 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:57.525343 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-376c9db7-c798-4292-afcf-615264229041 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:57.526643 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-376c9db7-c798-4292-afcf-615264229041 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:57.527557 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-376c9db7-c798-4292-afcf-615264229041 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:57.528283 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-376c9db7-c798-4292-afcf-615264229041 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:58.358343 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-376c9db7-c798-4292-afcf-615264229041 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c697cf3c2d6d4edb93426d828c10d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e713a65903474cc28584721f2780841e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:58.375649 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-376c9db7-c798-4292-afcf-615264229041 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c697cf3c2d6d4edb93426d828c10d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e713a65903474cc28584721f2780841e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:58.380522 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-376c9db7-c798-4292-afcf-615264229041 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c697cf3c2d6d4edb93426d828c10d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e713a65903474cc28584721f2780841e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:58.382530 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-376c9db7-c798-4292-afcf-615264229041 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] 10.222.0.61 "GET /compute/v2.1/servers/5c468688-561a-4642-86f1-84b822674e33" status: 200 len: 1365 microversion: 2.57 time: 0.891621 Aug 31 16:19:58.384134 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2403/4822] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:19:57 2022] GET /compute/v2.1/servers/5c468688-561a-4642-86f1-84b822674e33 => generated 1365 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:19:58.513904 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b79ab8e3-592a-4e47-ba01-fd256fca0607 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:58.514966 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b79ab8e3-592a-4e47-ba01-fd256fca0607 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] [instance: 41e57122-c82d-4f6d-af4f-fca28da61d70] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:58.528229 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b79ab8e3-592a-4e47-ba01-fd256fca0607 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:58.530768 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b79ab8e3-592a-4e47-ba01-fd256fca0607 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:58.531292 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b79ab8e3-592a-4e47-ba01-fd256fca0607 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:58.532079 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b79ab8e3-592a-4e47-ba01-fd256fca0607 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:58.532555 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b79ab8e3-592a-4e47-ba01-fd256fca0607 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:58.532982 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b79ab8e3-592a-4e47-ba01-fd256fca0607 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:58.810826 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-56ea9b69-b655-47db-87c6-4cedce136614 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:19:58.812606 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-56ea9b69-b655-47db-87c6-4cedce136614 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:19:58.813718 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-56ea9b69-b655-47db-87c6-4cedce136614 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:19:58.817571 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-56ea9b69-b655-47db-87c6-4cedce136614 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:19:58.819315 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-56ea9b69-b655-47db-87c6-4cedce136614 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:19:58.869078 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-56ea9b69-b655-47db-87c6-4cedce136614 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:58.869563 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-56ea9b69-b655-47db-87c6-4cedce136614 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:58.872358 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-56ea9b69-b655-47db-87c6-4cedce136614 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:58.876458 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-56ea9b69-b655-47db-87c6-4cedce136614 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:58.877213 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-56ea9b69-b655-47db-87c6-4cedce136614 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:58.877737 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-56ea9b69-b655-47db-87c6-4cedce136614 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:58.915225 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-56ea9b69-b655-47db-87c6-4cedce136614 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Getting quotas for project f8fa87d9431f4253b8425593a2150359. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:19:58.925192 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-56ea9b69-b655-47db-87c6-4cedce136614 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Getting quotas for user a105ab564f304fa7a2ceba07418a22bc and project f8fa87d9431f4253b8425593a2150359. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:19:58.957412 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-56ea9b69-b655-47db-87c6-4cedce136614 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Going to run 1 instances... {{(pid=122257) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:19:58.960114 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-56ea9b69-b655-47db-87c6-4cedce136614 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 2459bf91-9279-46ab-be03-9de04e8cb3f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:19:59.076283 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-56ea9b69-b655-47db-87c6-4cedce136614 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.537334 Aug 31 16:19:59.077751 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2420/4823] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:19:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 3540 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:19:59.127851 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b7d1bb41-bdc4-4814-b092-d51a54825de2 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:59.128651 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b7d1bb41-bdc4-4814-b092-d51a54825de2 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 2459bf91-9279-46ab-be03-9de04e8cb3f4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:59.182717 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b79ab8e3-592a-4e47-ba01-fd256fca0607 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133688fe60724d979e0bbccf65a28b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f784a8f91774261843e5819cdc6058a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:59.212998 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b79ab8e3-592a-4e47-ba01-fd256fca0607 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] 10.222.0.61 "GET /compute/v2.1/servers/41e57122-c82d-4f6d-af4f-fca28da61d70" status: 200 len: 1323 microversion: 2.1 time: 0.705610 Aug 31 16:19:59.231240 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2404/4824] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:58 2022] GET /compute/v2.1/servers/41e57122-c82d-4f6d-af4f-fca28da61d70 => generated 1323 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:19:59.307772 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b7d1bb41-bdc4-4814-b092-d51a54825de2 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:59.326425 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b7d1bb41-bdc4-4814-b092-d51a54825de2 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/2459bf91-9279-46ab-be03-9de04e8cb3f4" status: 200 len: 1215 microversion: 2.1 time: 0.229842 Aug 31 16:19:59.328832 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2421/4825] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:59 2022] GET /compute/v2.1/servers/2459bf91-9279-46ab-be03-9de04e8cb3f4 => generated 1215 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:19:59.431963 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-95e30b6f-6089-4f5b-906c-d7144e286cc6 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:59.432960 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-95e30b6f-6089-4f5b-906c-d7144e286cc6 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] [instance: 5c468688-561a-4642-86f1-84b822674e33] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:59.457253 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-95e30b6f-6089-4f5b-906c-d7144e286cc6 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:59.458056 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-95e30b6f-6089-4f5b-906c-d7144e286cc6 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:59.458742 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-95e30b6f-6089-4f5b-906c-d7144e286cc6 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:59.461168 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-95e30b6f-6089-4f5b-906c-d7144e286cc6 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:59.462412 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-95e30b6f-6089-4f5b-906c-d7144e286cc6 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:59.467033 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-95e30b6f-6089-4f5b-906c-d7144e286cc6 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:59.697156 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-95e30b6f-6089-4f5b-906c-d7144e286cc6 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c697cf3c2d6d4edb93426d828c10d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e713a65903474cc28584721f2780841e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:59.780991 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-95e30b6f-6089-4f5b-906c-d7144e286cc6 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c697cf3c2d6d4edb93426d828c10d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e713a65903474cc28584721f2780841e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:59.812172 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-95e30b6f-6089-4f5b-906c-d7144e286cc6 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c697cf3c2d6d4edb93426d828c10d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e713a65903474cc28584721f2780841e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:59.822964 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-95e30b6f-6089-4f5b-906c-d7144e286cc6 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] 10.222.0.61 "GET /compute/v2.1/servers/5c468688-561a-4642-86f1-84b822674e33" status: 200 len: 1365 microversion: 2.57 time: 0.392880 Aug 31 16:19:59.824978 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2405/4826] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:19:59 2022] GET /compute/v2.1/servers/5c468688-561a-4642-86f1-84b822674e33 => generated 1365 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:20:00.247467 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5f3a49ca-b48e-4aaf-bc4b-9a2c8d1b84f4 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:00.249037 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5f3a49ca-b48e-4aaf-bc4b-9a2c8d1b84f4 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] [instance: 41e57122-c82d-4f6d-af4f-fca28da61d70] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:00.263028 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5f3a49ca-b48e-4aaf-bc4b-9a2c8d1b84f4 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:00.264904 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5f3a49ca-b48e-4aaf-bc4b-9a2c8d1b84f4 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:00.266344 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5f3a49ca-b48e-4aaf-bc4b-9a2c8d1b84f4 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:00.267648 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5f3a49ca-b48e-4aaf-bc4b-9a2c8d1b84f4 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:00.268566 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5f3a49ca-b48e-4aaf-bc4b-9a2c8d1b84f4 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:00.269994 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5f3a49ca-b48e-4aaf-bc4b-9a2c8d1b84f4 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:00.370464 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0c177d4f-f332-442b-8366-87cc4bd933a9 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:00.374507 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0c177d4f-f332-442b-8366-87cc4bd933a9 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 2459bf91-9279-46ab-be03-9de04e8cb3f4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:00.413825 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0c177d4f-f332-442b-8366-87cc4bd933a9 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:00.414620 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0c177d4f-f332-442b-8366-87cc4bd933a9 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:00.416726 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0c177d4f-f332-442b-8366-87cc4bd933a9 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:00.420006 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0c177d4f-f332-442b-8366-87cc4bd933a9 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:00.423955 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0c177d4f-f332-442b-8366-87cc4bd933a9 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:00.430451 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0c177d4f-f332-442b-8366-87cc4bd933a9 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:00.659759 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-0c177d4f-f332-442b-8366-87cc4bd933a9 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:00.673336 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0c177d4f-f332-442b-8366-87cc4bd933a9 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/2459bf91-9279-46ab-be03-9de04e8cb3f4" status: 200 len: 1219 microversion: 2.1 time: 0.310914 Aug 31 16:20:00.675232 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2406/4827] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:00 2022] GET /compute/v2.1/servers/2459bf91-9279-46ab-be03-9de04e8cb3f4 => generated 1219 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:00.801117 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5f3a49ca-b48e-4aaf-bc4b-9a2c8d1b84f4 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133688fe60724d979e0bbccf65a28b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f784a8f91774261843e5819cdc6058a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:00.810427 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5f3a49ca-b48e-4aaf-bc4b-9a2c8d1b84f4 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] 10.222.0.61 "GET /compute/v2.1/servers/41e57122-c82d-4f6d-af4f-fca28da61d70" status: 200 len: 1323 microversion: 2.1 time: 0.570466 Aug 31 16:20:00.823952 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2422/4828] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:00 2022] GET /compute/v2.1/servers/41e57122-c82d-4f6d-af4f-fca28da61d70 => generated 1323 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:00.849571 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7abf05fc-a806-4eb6-990a-1a134424ed40 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:00.850344 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7abf05fc-a806-4eb6-990a-1a134424ed40 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] [instance: 5c468688-561a-4642-86f1-84b822674e33] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:00.861566 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7abf05fc-a806-4eb6-990a-1a134424ed40 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:00.862097 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7abf05fc-a806-4eb6-990a-1a134424ed40 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:00.862547 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7abf05fc-a806-4eb6-990a-1a134424ed40 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:00.863270 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7abf05fc-a806-4eb6-990a-1a134424ed40 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:00.864403 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7abf05fc-a806-4eb6-990a-1a134424ed40 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:00.864919 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7abf05fc-a806-4eb6-990a-1a134424ed40 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:01.092116 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7abf05fc-a806-4eb6-990a-1a134424ed40 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c697cf3c2d6d4edb93426d828c10d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e713a65903474cc28584721f2780841e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:01.109753 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7abf05fc-a806-4eb6-990a-1a134424ed40 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c697cf3c2d6d4edb93426d828c10d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e713a65903474cc28584721f2780841e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:01.115545 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7abf05fc-a806-4eb6-990a-1a134424ed40 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c697cf3c2d6d4edb93426d828c10d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e713a65903474cc28584721f2780841e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:01.119920 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7abf05fc-a806-4eb6-990a-1a134424ed40 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] 10.222.0.61 "GET /compute/v2.1/servers/5c468688-561a-4642-86f1-84b822674e33" status: 200 len: 1365 microversion: 2.57 time: 0.274759 Aug 31 16:20:01.122501 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2407/4829] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:20:00 2022] GET /compute/v2.1/servers/5c468688-561a-4642-86f1-84b822674e33 => generated 1365 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:20:01.709741 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0e3570eb-3c42-44ec-b808-495359e8700f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:01.710448 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0e3570eb-3c42-44ec-b808-495359e8700f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 2459bf91-9279-46ab-be03-9de04e8cb3f4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:01.745326 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0e3570eb-3c42-44ec-b808-495359e8700f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:01.746243 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0e3570eb-3c42-44ec-b808-495359e8700f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:01.747051 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0e3570eb-3c42-44ec-b808-495359e8700f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:01.748151 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0e3570eb-3c42-44ec-b808-495359e8700f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:01.750918 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0e3570eb-3c42-44ec-b808-495359e8700f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:01.754284 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0e3570eb-3c42-44ec-b808-495359e8700f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:01.972659 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-0e3570eb-3c42-44ec-b808-495359e8700f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:02.013220 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0e3570eb-3c42-44ec-b808-495359e8700f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/2459bf91-9279-46ab-be03-9de04e8cb3f4" status: 200 len: 1275 microversion: 2.1 time: 0.311159 Aug 31 16:20:02.018019 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2408/4830] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:01 2022] GET /compute/v2.1/servers/2459bf91-9279-46ab-be03-9de04e8cb3f4 => generated 1275 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:02.045777 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-57fc8cc6-d779-4834-ae01-55119a882cca tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:02.047559 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-57fc8cc6-d779-4834-ae01-55119a882cca tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] [instance: 41e57122-c82d-4f6d-af4f-fca28da61d70] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:02.088513 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-57fc8cc6-d779-4834-ae01-55119a882cca tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:02.100392 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-57fc8cc6-d779-4834-ae01-55119a882cca tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:02.102089 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-57fc8cc6-d779-4834-ae01-55119a882cca tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:02.105009 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-57fc8cc6-d779-4834-ae01-55119a882cca tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:02.108541 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-57fc8cc6-d779-4834-ae01-55119a882cca tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:02.113105 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-57fc8cc6-d779-4834-ae01-55119a882cca tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:02.222046 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6dfc4acc-967a-4188-bba9-c36813a41b82 tempest-PortsAdminExtendedAttrsIpV6TestJSON-376332918 tempest-PortsAdminExtendedAttrsIpV6TestJSON-376332918-project-admin] Calling method '.version_select at 0x7f5ae841d0d0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:02.224284 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6dfc4acc-967a-4188-bba9-c36813a41b82 tempest-PortsAdminExtendedAttrsIpV6TestJSON-376332918 tempest-PortsAdminExtendedAttrsIpV6TestJSON-376332918-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:02.224867 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6dfc4acc-967a-4188-bba9-c36813a41b82 tempest-PortsAdminExtendedAttrsIpV6TestJSON-376332918 tempest-PortsAdminExtendedAttrsIpV6TestJSON-376332918-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:02.225325 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6dfc4acc-967a-4188-bba9-c36813a41b82 tempest-PortsAdminExtendedAttrsIpV6TestJSON-376332918 tempest-PortsAdminExtendedAttrsIpV6TestJSON-376332918-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:02.267002 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6dfc4acc-967a-4188-bba9-c36813a41b82 tempest-PortsAdminExtendedAttrsIpV6TestJSON-376332918 tempest-PortsAdminExtendedAttrsIpV6TestJSON-376332918-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:02.267538 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6dfc4acc-967a-4188-bba9-c36813a41b82 tempest-PortsAdminExtendedAttrsIpV6TestJSON-376332918 tempest-PortsAdminExtendedAttrsIpV6TestJSON-376332918-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:02.268914 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6dfc4acc-967a-4188-bba9-c36813a41b82 tempest-PortsAdminExtendedAttrsIpV6TestJSON-376332918 tempest-PortsAdminExtendedAttrsIpV6TestJSON-376332918-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:02.297932 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6dfc4acc-967a-4188-bba9-c36813a41b82 tempest-PortsAdminExtendedAttrsIpV6TestJSON-376332918 tempest-PortsAdminExtendedAttrsIpV6TestJSON-376332918-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:02.300495 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6dfc4acc-967a-4188-bba9-c36813a41b82 tempest-PortsAdminExtendedAttrsIpV6TestJSON-376332918 tempest-PortsAdminExtendedAttrsIpV6TestJSON-376332918-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:02.303673 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6dfc4acc-967a-4188-bba9-c36813a41b82 tempest-PortsAdminExtendedAttrsIpV6TestJSON-376332918 tempest-PortsAdminExtendedAttrsIpV6TestJSON-376332918-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:02.333691 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=100 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:20:02.338070 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6dfc4acc-967a-4188-bba9-c36813a41b82 tempest-PortsAdminExtendedAttrsIpV6TestJSON-376332918 tempest-PortsAdminExtendedAttrsIpV6TestJSON-376332918-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.692177 Aug 31 16:20:02.349485 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2423/4831] 10.222.0.61 () {58 vars in 1146 bytes} [Wed Aug 31 16:20:01 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:20:02.365108 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a28f376d-4f71-4fdd-8600-5524abc6fe72 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:02.374816 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a28f376d-4f71-4fdd-8600-5524abc6fe72 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] [instance: 5c468688-561a-4642-86f1-84b822674e33] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:02.382433 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a28f376d-4f71-4fdd-8600-5524abc6fe72 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:02.382942 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a28f376d-4f71-4fdd-8600-5524abc6fe72 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:02.383395 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a28f376d-4f71-4fdd-8600-5524abc6fe72 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:02.408394 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a28f376d-4f71-4fdd-8600-5524abc6fe72 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:02.409265 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a28f376d-4f71-4fdd-8600-5524abc6fe72 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:02.409364 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a28f376d-4f71-4fdd-8600-5524abc6fe72 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:02.600168 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a28f376d-4f71-4fdd-8600-5524abc6fe72 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c697cf3c2d6d4edb93426d828c10d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e713a65903474cc28584721f2780841e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:02.635147 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a28f376d-4f71-4fdd-8600-5524abc6fe72 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c697cf3c2d6d4edb93426d828c10d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e713a65903474cc28584721f2780841e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:02.639440 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a28f376d-4f71-4fdd-8600-5524abc6fe72 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c697cf3c2d6d4edb93426d828c10d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e713a65903474cc28584721f2780841e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:02.642833 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a28f376d-4f71-4fdd-8600-5524abc6fe72 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] 10.222.0.61 "GET /compute/v2.1/servers/5c468688-561a-4642-86f1-84b822674e33" status: 200 len: 1365 microversion: 2.57 time: 0.291871 Aug 31 16:20:02.658292 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2424/4832] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:20:02 2022] GET /compute/v2.1/servers/5c468688-561a-4642-86f1-84b822674e33 => generated 1365 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:20:02.704335 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-57fc8cc6-d779-4834-ae01-55119a882cca tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133688fe60724d979e0bbccf65a28b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f784a8f91774261843e5819cdc6058a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:02.707956 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-598d90d3-44d4-421e-ad58-4f3fc1b32a3a req-4419e48b-b5ea-4887-80f7-f540be4f8253 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41e57122-c82d-4f6d-af4f-fca28da61d70", "name": "network-vif-plugged", "status": "completed", "tag": "aa5919c1-b206-4c36-9030-7581ac0cc0e8"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:20:02.728420 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-57fc8cc6-d779-4834-ae01-55119a882cca tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] 10.222.0.61 "GET /compute/v2.1/servers/41e57122-c82d-4f6d-af4f-fca28da61d70" status: 200 len: 1323 microversion: 2.1 time: 0.701466 Aug 31 16:20:02.729831 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2409/4833] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:02 2022] GET /compute/v2.1/servers/41e57122-c82d-4f6d-af4f-fca28da61d70 => generated 1323 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:02.733215 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-598d90d3-44d4-421e-ad58-4f3fc1b32a3a req-4419e48b-b5ea-4887-80f7-f540be4f8253 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:02.734635 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-598d90d3-44d4-421e-ad58-4f3fc1b32a3a req-4419e48b-b5ea-4887-80f7-f540be4f8253 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:02.735726 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-598d90d3-44d4-421e-ad58-4f3fc1b32a3a req-4419e48b-b5ea-4887-80f7-f540be4f8253 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:02.779005 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-598d90d3-44d4-421e-ad58-4f3fc1b32a3a req-4419e48b-b5ea-4887-80f7-f540be4f8253 service nova] Creating event network-vif-plugged:aa5919c1-b206-4c36-9030-7581ac0cc0e8 for instance 41e57122-c82d-4f6d-af4f-fca28da61d70 on n-h2-850499-9 Aug 31 16:20:02.802505 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-598d90d3-44d4-421e-ad58-4f3fc1b32a3a req-4419e48b-b5ea-4887-80f7-f540be4f8253 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129173 Aug 31 16:20:02.808954 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2425/4834] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:20:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:20:03.047419 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-df9f8d91-c7a7-4628-984d-f4b517c702c7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:03.059569 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-df9f8d91-c7a7-4628-984d-f4b517c702c7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 2459bf91-9279-46ab-be03-9de04e8cb3f4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:03.084722 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-df9f8d91-c7a7-4628-984d-f4b517c702c7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:03.086091 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-df9f8d91-c7a7-4628-984d-f4b517c702c7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:03.087292 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-df9f8d91-c7a7-4628-984d-f4b517c702c7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:03.088578 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-df9f8d91-c7a7-4628-984d-f4b517c702c7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:03.089483 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-df9f8d91-c7a7-4628-984d-f4b517c702c7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:03.092466 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-df9f8d91-c7a7-4628-984d-f4b517c702c7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:03.197688 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-df9f8d91-c7a7-4628-984d-f4b517c702c7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:03.210787 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-df9f8d91-c7a7-4628-984d-f4b517c702c7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/2459bf91-9279-46ab-be03-9de04e8cb3f4" status: 200 len: 1273 microversion: 2.1 time: 0.173513 Aug 31 16:20:03.214549 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2426/4835] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:03 2022] GET /compute/v2.1/servers/2459bf91-9279-46ab-be03-9de04e8cb3f4 => generated 1273 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:03.619960 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4396fbfb-2f72-4152-8814-8b4d586ffa47 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-108939264", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:20:03.702127 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f8e98bce-6a77-41d9-bb40-f4d17948178c tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:03.702770 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f8e98bce-6a77-41d9-bb40-f4d17948178c tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] [instance: 5c468688-561a-4642-86f1-84b822674e33] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:03.728714 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f8e98bce-6a77-41d9-bb40-f4d17948178c tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:03.729521 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f8e98bce-6a77-41d9-bb40-f4d17948178c tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:03.730260 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f8e98bce-6a77-41d9-bb40-f4d17948178c tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:03.732215 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f8e98bce-6a77-41d9-bb40-f4d17948178c tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:03.733087 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f8e98bce-6a77-41d9-bb40-f4d17948178c tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:03.734340 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f8e98bce-6a77-41d9-bb40-f4d17948178c tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:03.755238 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-4396fbfb-2f72-4152-8814-8b4d586ffa47 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] validate_networks() for [('a463fe70-889a-47e0-8a58-628ef29cd494', None, None, None, None, None)] {{(pid=122256) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:20:03.853915 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f8e98bce-6a77-41d9-bb40-f4d17948178c tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c697cf3c2d6d4edb93426d828c10d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e713a65903474cc28584721f2780841e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:03.863815 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f8e98bce-6a77-41d9-bb40-f4d17948178c tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c697cf3c2d6d4edb93426d828c10d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e713a65903474cc28584721f2780841e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:03.865893 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f8e98bce-6a77-41d9-bb40-f4d17948178c tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c697cf3c2d6d4edb93426d828c10d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e713a65903474cc28584721f2780841e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:03.867670 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f8e98bce-6a77-41d9-bb40-f4d17948178c tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] 10.222.0.61 "GET /compute/v2.1/servers/5c468688-561a-4642-86f1-84b822674e33" status: 200 len: 1365 microversion: 2.57 time: 0.171741 Aug 31 16:20:03.885119 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2427/4836] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:20:03 2022] GET /compute/v2.1/servers/5c468688-561a-4642-86f1-84b822674e33 => generated 1365 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:20:03.900010 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7cf27129-08f8-4666-bbc8-c28687cc2b41 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:03.901246 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7cf27129-08f8-4666-bbc8-c28687cc2b41 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] [instance: 41e57122-c82d-4f6d-af4f-fca28da61d70] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:03.916271 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7cf27129-08f8-4666-bbc8-c28687cc2b41 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:03.917981 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7cf27129-08f8-4666-bbc8-c28687cc2b41 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:03.919924 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7cf27129-08f8-4666-bbc8-c28687cc2b41 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:03.921709 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7cf27129-08f8-4666-bbc8-c28687cc2b41 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:03.923028 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7cf27129-08f8-4666-bbc8-c28687cc2b41 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:03.924165 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7cf27129-08f8-4666-bbc8-c28687cc2b41 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:04.938974 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7cf27129-08f8-4666-bbc8-c28687cc2b41 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133688fe60724d979e0bbccf65a28b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f784a8f91774261843e5819cdc6058a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:04.989314 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7cf27129-08f8-4666-bbc8-c28687cc2b41 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] 10.222.0.61 "GET /compute/v2.1/servers/41e57122-c82d-4f6d-af4f-fca28da61d70" status: 200 len: 1323 microversion: 2.1 time: 1.098262 Aug 31 16:20:04.994172 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2428/4837] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:03 2022] GET /compute/v2.1/servers/41e57122-c82d-4f6d-af4f-fca28da61d70 => generated 1323 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:05.016428 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-46d0016c-eca7-4870-b443-75798671ff90 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:05.022294 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-46d0016c-eca7-4870-b443-75798671ff90 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 2459bf91-9279-46ab-be03-9de04e8cb3f4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:05.054791 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-46d0016c-eca7-4870-b443-75798671ff90 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:05.057065 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-46d0016c-eca7-4870-b443-75798671ff90 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:05.057761 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-46d0016c-eca7-4870-b443-75798671ff90 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:05.065281 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-46d0016c-eca7-4870-b443-75798671ff90 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:05.066400 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-46d0016c-eca7-4870-b443-75798671ff90 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:05.067148 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-46d0016c-eca7-4870-b443-75798671ff90 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:05.913973 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-46d0016c-eca7-4870-b443-75798671ff90 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:05.935889 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-46d0016c-eca7-4870-b443-75798671ff90 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/2459bf91-9279-46ab-be03-9de04e8cb3f4" status: 200 len: 1315 microversion: 2.1 time: 0.939042 Aug 31 16:20:05.938284 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2429/4838] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:04 2022] GET /compute/v2.1/servers/2459bf91-9279-46ab-be03-9de04e8cb3f4 => generated 1315 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:05.946600 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-dc79979f-f4dc-4a05-9b7c-d78974d90813 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:05.948231 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-dc79979f-f4dc-4a05-9b7c-d78974d90813 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] [instance: 5c468688-561a-4642-86f1-84b822674e33] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:05.967658 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dc79979f-f4dc-4a05-9b7c-d78974d90813 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:05.968512 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dc79979f-f4dc-4a05-9b7c-d78974d90813 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:05.972509 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dc79979f-f4dc-4a05-9b7c-d78974d90813 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:05.976961 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dc79979f-f4dc-4a05-9b7c-d78974d90813 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:05.978359 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dc79979f-f4dc-4a05-9b7c-d78974d90813 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:05.979174 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dc79979f-f4dc-4a05-9b7c-d78974d90813 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:06.210361 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-4396fbfb-2f72-4152-8814-8b4d586ffa47 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:20:06.211191 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-4396fbfb-2f72-4152-8814-8b4d586ffa47 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:20:06.211353 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-4396fbfb-2f72-4152-8814-8b4d586ffa47 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:20:06.211787 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-4396fbfb-2f72-4152-8814-8b4d586ffa47 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:20:06.212772 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-4396fbfb-2f72-4152-8814-8b4d586ffa47 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:20:06.224094 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-dc79979f-f4dc-4a05-9b7c-d78974d90813 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c697cf3c2d6d4edb93426d828c10d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e713a65903474cc28584721f2780841e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:06.238864 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4396fbfb-2f72-4152-8814-8b4d586ffa47 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:06.240404 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-dc79979f-f4dc-4a05-9b7c-d78974d90813 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c697cf3c2d6d4edb93426d828c10d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e713a65903474cc28584721f2780841e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:06.242296 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4396fbfb-2f72-4152-8814-8b4d586ffa47 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:06.242892 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4396fbfb-2f72-4152-8814-8b4d586ffa47 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:06.244355 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-dc79979f-f4dc-4a05-9b7c-d78974d90813 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c697cf3c2d6d4edb93426d828c10d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e713a65903474cc28584721f2780841e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:06.245383 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4396fbfb-2f72-4152-8814-8b4d586ffa47 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:06.245938 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4396fbfb-2f72-4152-8814-8b4d586ffa47 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:06.246872 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-dc79979f-f4dc-4a05-9b7c-d78974d90813 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] 10.222.0.61 "GET /compute/v2.1/servers/5c468688-561a-4642-86f1-84b822674e33" status: 200 len: 1371 microversion: 2.57 time: 0.306587 Aug 31 16:20:06.247744 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4396fbfb-2f72-4152-8814-8b4d586ffa47 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:06.252596 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2430/4839] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:20:05 2022] GET /compute/v2.1/servers/5c468688-561a-4642-86f1-84b822674e33 => generated 1371 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:20:06.263781 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-369cad91-b6ae-45c1-ac16-af0ef7055816 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:06.269299 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-369cad91-b6ae-45c1-ac16-af0ef7055816 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] [instance: 41e57122-c82d-4f6d-af4f-fca28da61d70] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:06.285945 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-369cad91-b6ae-45c1-ac16-af0ef7055816 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:06.289475 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-369cad91-b6ae-45c1-ac16-af0ef7055816 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:06.291342 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-369cad91-b6ae-45c1-ac16-af0ef7055816 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:06.294329 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-369cad91-b6ae-45c1-ac16-af0ef7055816 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:06.296315 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-369cad91-b6ae-45c1-ac16-af0ef7055816 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:06.299125 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-369cad91-b6ae-45c1-ac16-af0ef7055816 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:06.311038 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-4396fbfb-2f72-4152-8814-8b4d586ffa47 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Getting quotas for project e014d4e4da5e47ff9a1261e7730034ac. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:20:06.326294 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-4396fbfb-2f72-4152-8814-8b4d586ffa47 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Getting quotas for user e4744703b964435bbead751ca884d1ae and project e014d4e4da5e47ff9a1261e7730034ac. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:20:06.364888 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4396fbfb-2f72-4152-8814-8b4d586ffa47 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Going to run 1 instances... {{(pid=122256) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:20:06.370333 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4396fbfb-2f72-4152-8814-8b4d586ffa47 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: ffc6f828-c8ec-4fd6-b69e-9c0230692009] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:20:06.446099 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4396fbfb-2f72-4152-8814-8b4d586ffa47 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.564951 Aug 31 16:20:06.447621 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2410/4840] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:20:02 2022] POST /compute/v2.1/servers => generated 383 bytes in 3567 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:20:06.460989 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-df5ad0bd-046f-4fbd-874d-e55dcab41b85 req-d8407de3-f543-4b9f-924d-c11c1ccf0883 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2459bf91-9279-46ab-be03-9de04e8cb3f4", "tag": "5aee3413-65c3-47d2-8e17-0db097d25bd7"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:20:06.476390 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-df5ad0bd-046f-4fbd-874d-e55dcab41b85 req-d8407de3-f543-4b9f-924d-c11c1ccf0883 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:06.477541 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-df5ad0bd-046f-4fbd-874d-e55dcab41b85 req-d8407de3-f543-4b9f-924d-c11c1ccf0883 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:06.478753 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-df5ad0bd-046f-4fbd-874d-e55dcab41b85 req-d8407de3-f543-4b9f-924d-c11c1ccf0883 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:06.516367 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-df5ad0bd-046f-4fbd-874d-e55dcab41b85 req-d8407de3-f543-4b9f-924d-c11c1ccf0883 service nova] Creating event network-changed:5aee3413-65c3-47d2-8e17-0db097d25bd7 for instance 2459bf91-9279-46ab-be03-9de04e8cb3f4 on n-h1-850499-9 Aug 31 16:20:06.523791 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-df5ad0bd-046f-4fbd-874d-e55dcab41b85 req-d8407de3-f543-4b9f-924d-c11c1ccf0883 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074456 Aug 31 16:20:06.525898 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2411/4841] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:20:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:20:06.545186 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c44a9203-d89e-4cfa-99ef-56d9da163c8a tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:06.547175 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c44a9203-d89e-4cfa-99ef-56d9da163c8a tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: ffc6f828-c8ec-4fd6-b69e-9c0230692009] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:06.645895 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-369cad91-b6ae-45c1-ac16-af0ef7055816 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133688fe60724d979e0bbccf65a28b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f784a8f91774261843e5819cdc6058a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:06.667156 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-369cad91-b6ae-45c1-ac16-af0ef7055816 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] 10.222.0.61 "GET /compute/v2.1/servers/41e57122-c82d-4f6d-af4f-fca28da61d70" status: 200 len: 1517 microversion: 2.1 time: 0.412543 Aug 31 16:20:06.668100 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2431/4842] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:06 2022] GET /compute/v2.1/servers/41e57122-c82d-4f6d-af4f-fca28da61d70 => generated 1517 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:06.711295 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-88b680dd-3032-443b-8d66-46548cb431a6 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:20:06.722754 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-88b680dd-3032-443b-8d66-46548cb431a6 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] [instance: 41e57122-c82d-4f6d-af4f-fca28da61d70] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:06.741019 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-88b680dd-3032-443b-8d66-46548cb431a6 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:06.742057 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-88b680dd-3032-443b-8d66-46548cb431a6 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:06.743224 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-88b680dd-3032-443b-8d66-46548cb431a6 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:06.746411 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-88b680dd-3032-443b-8d66-46548cb431a6 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:06.747856 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-88b680dd-3032-443b-8d66-46548cb431a6 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:06.749032 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-88b680dd-3032-443b-8d66-46548cb431a6 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:06.762544 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c44a9203-d89e-4cfa-99ef-56d9da163c8a tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4744703b964435bbead751ca884d1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e014d4e4da5e47ff9a1261e7730034ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:06.774833 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c44a9203-d89e-4cfa-99ef-56d9da163c8a tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/ffc6f828-c8ec-4fd6-b69e-9c0230692009" status: 200 len: 1221 microversion: 2.1 time: 0.246340 Aug 31 16:20:06.791969 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2412/4843] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:06 2022] GET /compute/v2.1/servers/ffc6f828-c8ec-4fd6-b69e-9c0230692009 => generated 1221 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:06.840291 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-88b680dd-3032-443b-8d66-46548cb431a6 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lazy-loading 'flavor' on Instance uuid 41e57122-c82d-4f6d-af4f-fca28da61d70 {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:20:06.966572 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-04f1dde5-30c6-44b1-bf85-fad2e30ba023 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:06.966572 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-04f1dde5-30c6-44b1-bf85-fad2e30ba023 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 2459bf91-9279-46ab-be03-9de04e8cb3f4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:07.012201 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-04f1dde5-30c6-44b1-bf85-fad2e30ba023 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:07.013248 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-04f1dde5-30c6-44b1-bf85-fad2e30ba023 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:07.014862 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-04f1dde5-30c6-44b1-bf85-fad2e30ba023 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:07.017504 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-04f1dde5-30c6-44b1-bf85-fad2e30ba023 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:07.018024 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-04f1dde5-30c6-44b1-bf85-fad2e30ba023 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:07.020180 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-04f1dde5-30c6-44b1-bf85-fad2e30ba023 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:07.113982 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-88b680dd-3032-443b-8d66-46548cb431a6 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] 10.222.0.61 "POST /compute/v2.1/servers/41e57122-c82d-4f6d-af4f-fca28da61d70/action" status: 200 len: 32 microversion: 2.1 time: 0.418588 Aug 31 16:20:07.115153 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2432/4844] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:20:06 2022] POST /compute/v2.1/servers/41e57122-c82d-4f6d-af4f-fca28da61d70/action => generated 32 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 16:20:07.129323 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6fd5f2e0-cb87-4b9b-92ce-8faedbcde522 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2039550539", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:20:07.266017 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-6fd5f2e0-cb87-4b9b-92ce-8faedbcde522 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] validate_networks() for [('a463fe70-889a-47e0-8a58-628ef29cd494', None, None, None, None, None)] {{(pid=122257) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:20:08.426291 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-04f1dde5-30c6-44b1-bf85-fad2e30ba023 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:08.458659 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-04f1dde5-30c6-44b1-bf85-fad2e30ba023 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/2459bf91-9279-46ab-be03-9de04e8cb3f4" status: 200 len: 1315 microversion: 2.1 time: 1.485972 Aug 31 16:20:08.460056 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2413/4845] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:06 2022] GET /compute/v2.1/servers/2459bf91-9279-46ab-be03-9de04e8cb3f4 => generated 1315 bytes in 1501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:08.474336 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-270682f3-5f11-4c39-a030-32f62c661cb8 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:08.476847 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-270682f3-5f11-4c39-a030-32f62c661cb8 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] [instance: 41e57122-c82d-4f6d-af4f-fca28da61d70] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:08.513220 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-270682f3-5f11-4c39-a030-32f62c661cb8 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:08.514145 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-270682f3-5f11-4c39-a030-32f62c661cb8 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:08.514780 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-270682f3-5f11-4c39-a030-32f62c661cb8 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:08.515957 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-270682f3-5f11-4c39-a030-32f62c661cb8 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:08.516680 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-270682f3-5f11-4c39-a030-32f62c661cb8 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:08.517348 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-270682f3-5f11-4c39-a030-32f62c661cb8 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:08.904520 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:20:09.023309 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-270682f3-5f11-4c39-a030-32f62c661cb8 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133688fe60724d979e0bbccf65a28b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f784a8f91774261843e5819cdc6058a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:09.044048 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-270682f3-5f11-4c39-a030-32f62c661cb8 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] 10.222.0.61 "GET /compute/v2.1/servers/41e57122-c82d-4f6d-af4f-fca28da61d70" status: 200 len: 1523 microversion: 2.1 time: 0.580660 Aug 31 16:20:09.044975 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2414/4846] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:08 2022] GET /compute/v2.1/servers/41e57122-c82d-4f6d-af4f-fca28da61d70 => generated 1523 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:09.075853 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f919d6d2-e46e-4e04-8175-66aa925f9804 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:09.079108 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f919d6d2-e46e-4e04-8175-66aa925f9804 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] [instance: 5c468688-561a-4642-86f1-84b822674e33] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:09.092053 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f919d6d2-e46e-4e04-8175-66aa925f9804 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:09.094555 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f919d6d2-e46e-4e04-8175-66aa925f9804 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:09.096517 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f919d6d2-e46e-4e04-8175-66aa925f9804 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:09.099831 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f919d6d2-e46e-4e04-8175-66aa925f9804 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:09.101400 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f919d6d2-e46e-4e04-8175-66aa925f9804 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:09.103181 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f919d6d2-e46e-4e04-8175-66aa925f9804 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:09.262781 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f919d6d2-e46e-4e04-8175-66aa925f9804 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c697cf3c2d6d4edb93426d828c10d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e713a65903474cc28584721f2780841e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:09.272536 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f919d6d2-e46e-4e04-8175-66aa925f9804 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c697cf3c2d6d4edb93426d828c10d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e713a65903474cc28584721f2780841e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:09.274055 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f919d6d2-e46e-4e04-8175-66aa925f9804 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c697cf3c2d6d4edb93426d828c10d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e713a65903474cc28584721f2780841e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:09.275577 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f919d6d2-e46e-4e04-8175-66aa925f9804 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] 10.222.0.61 "GET /compute/v2.1/servers/5c468688-561a-4642-86f1-84b822674e33" status: 200 len: 1371 microversion: 2.57 time: 0.228849 Aug 31 16:20:09.276344 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2415/4847] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:20:09 2022] GET /compute/v2.1/servers/5c468688-561a-4642-86f1-84b822674e33 => generated 1371 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:20:09.312728 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=8 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:20:09.365995 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-6fd5f2e0-cb87-4b9b-92ce-8faedbcde522 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:20:09.367075 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-6fd5f2e0-cb87-4b9b-92ce-8faedbcde522 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:20:09.369034 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-6fd5f2e0-cb87-4b9b-92ce-8faedbcde522 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:20:09.370130 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-6fd5f2e0-cb87-4b9b-92ce-8faedbcde522 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:20:09.371172 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-6fd5f2e0-cb87-4b9b-92ce-8faedbcde522 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:20:09.390968 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6fd5f2e0-cb87-4b9b-92ce-8faedbcde522 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:09.392209 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6fd5f2e0-cb87-4b9b-92ce-8faedbcde522 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:09.393266 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6fd5f2e0-cb87-4b9b-92ce-8faedbcde522 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:09.394901 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6fd5f2e0-cb87-4b9b-92ce-8faedbcde522 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:09.396104 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6fd5f2e0-cb87-4b9b-92ce-8faedbcde522 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:09.397253 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6fd5f2e0-cb87-4b9b-92ce-8faedbcde522 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:09.498388 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7b9805d8-279e-4502-b7af-b543b4a6166b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:09.499381 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7b9805d8-279e-4502-b7af-b543b4a6166b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 2459bf91-9279-46ab-be03-9de04e8cb3f4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:09.506305 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-6fd5f2e0-cb87-4b9b-92ce-8faedbcde522 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Getting quotas for project e014d4e4da5e47ff9a1261e7730034ac. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:20:09.516541 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7b9805d8-279e-4502-b7af-b543b4a6166b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:09.519820 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7b9805d8-279e-4502-b7af-b543b4a6166b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:09.521258 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7b9805d8-279e-4502-b7af-b543b4a6166b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:09.522711 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7b9805d8-279e-4502-b7af-b543b4a6166b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:09.526315 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7b9805d8-279e-4502-b7af-b543b4a6166b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:09.527568 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7b9805d8-279e-4502-b7af-b543b4a6166b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:09.547979 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-6fd5f2e0-cb87-4b9b-92ce-8faedbcde522 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Getting quotas for user e4744703b964435bbead751ca884d1ae and project e014d4e4da5e47ff9a1261e7730034ac. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:20:09.625212 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6fd5f2e0-cb87-4b9b-92ce-8faedbcde522 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Going to run 1 instances... {{(pid=122257) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:20:09.629560 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6fd5f2e0-cb87-4b9b-92ce-8faedbcde522 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: 238b044c-ec15-4c03-88da-d90f9b1ec116] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:20:09.834053 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6fd5f2e0-cb87-4b9b-92ce-8faedbcde522 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.716835 Aug 31 16:20:09.849181 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2433/4848] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:20:07 2022] POST /compute/v2.1/servers => generated 383 bytes in 2733 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:20:09.865670 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4aff2dd3-9471-4aae-9ddc-4baca19fa1f7 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:09.871592 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4aff2dd3-9471-4aae-9ddc-4baca19fa1f7 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: 238b044c-ec15-4c03-88da-d90f9b1ec116] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:10.283433 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-4aff2dd3-9471-4aae-9ddc-4baca19fa1f7 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4744703b964435bbead751ca884d1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e014d4e4da5e47ff9a1261e7730034ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:10.298155 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4aff2dd3-9471-4aae-9ddc-4baca19fa1f7 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/238b044c-ec15-4c03-88da-d90f9b1ec116" status: 200 len: 1222 microversion: 2.1 time: 0.444102 Aug 31 16:20:10.298815 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2434/4849] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:09 2022] GET /compute/v2.1/servers/238b044c-ec15-4c03-88da-d90f9b1ec116 => generated 1222 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:10.327488 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a30ba168-4930-4d28-ac7e-6a5ce1697dcc tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:10.330741 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a30ba168-4930-4d28-ac7e-6a5ce1697dcc tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] [instance: 41e57122-c82d-4f6d-af4f-fca28da61d70] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:10.355223 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a30ba168-4930-4d28-ac7e-6a5ce1697dcc tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:10.356922 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a30ba168-4930-4d28-ac7e-6a5ce1697dcc tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:10.359556 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a30ba168-4930-4d28-ac7e-6a5ce1697dcc tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:10.360566 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a30ba168-4930-4d28-ac7e-6a5ce1697dcc tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:10.361837 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a30ba168-4930-4d28-ac7e-6a5ce1697dcc tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:10.362792 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a30ba168-4930-4d28-ac7e-6a5ce1697dcc tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:10.501591 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7b9805d8-279e-4502-b7af-b543b4a6166b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:10.513081 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7b9805d8-279e-4502-b7af-b543b4a6166b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/2459bf91-9279-46ab-be03-9de04e8cb3f4" status: 200 len: 1315 microversion: 2.1 time: 1.019016 Aug 31 16:20:10.530501 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2416/4850] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:09 2022] GET /compute/v2.1/servers/2459bf91-9279-46ab-be03-9de04e8cb3f4 => generated 1315 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:10.536879 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-87e9749a-29ec-4ead-9eee-683d6c977446 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:10.538163 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-87e9749a-29ec-4ead-9eee-683d6c977446 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] [instance: 5c468688-561a-4642-86f1-84b822674e33] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:10.541303 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=82 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:20:10.550708 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-87e9749a-29ec-4ead-9eee-683d6c977446 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:10.551486 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-87e9749a-29ec-4ead-9eee-683d6c977446 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:10.552143 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-87e9749a-29ec-4ead-9eee-683d6c977446 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:10.554504 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-87e9749a-29ec-4ead-9eee-683d6c977446 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:10.555270 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-87e9749a-29ec-4ead-9eee-683d6c977446 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:10.556051 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-87e9749a-29ec-4ead-9eee-683d6c977446 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:10.731087 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-87e9749a-29ec-4ead-9eee-683d6c977446 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c697cf3c2d6d4edb93426d828c10d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e713a65903474cc28584721f2780841e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:10.753645 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-87e9749a-29ec-4ead-9eee-683d6c977446 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c697cf3c2d6d4edb93426d828c10d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e713a65903474cc28584721f2780841e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:10.757768 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-87e9749a-29ec-4ead-9eee-683d6c977446 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c697cf3c2d6d4edb93426d828c10d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e713a65903474cc28584721f2780841e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:10.762348 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-87e9749a-29ec-4ead-9eee-683d6c977446 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] 10.222.0.61 "GET /compute/v2.1/servers/5c468688-561a-4642-86f1-84b822674e33" status: 200 len: 1356 microversion: 2.57 time: 0.230274 Aug 31 16:20:10.764293 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2417/4851] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:20:10 2022] GET /compute/v2.1/servers/5c468688-561a-4642-86f1-84b822674e33 => generated 1356 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:20:10.805713 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4cd132e5-dd3e-4697-b1ee-8f93593f89ef tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:10.806461 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4cd132e5-dd3e-4697-b1ee-8f93593f89ef tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] [instance: 5c468688-561a-4642-86f1-84b822674e33] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:10.819071 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4cd132e5-dd3e-4697-b1ee-8f93593f89ef tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:10.820239 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4cd132e5-dd3e-4697-b1ee-8f93593f89ef tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:10.821018 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4cd132e5-dd3e-4697-b1ee-8f93593f89ef tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:10.821838 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4cd132e5-dd3e-4697-b1ee-8f93593f89ef tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:10.823444 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4cd132e5-dd3e-4697-b1ee-8f93593f89ef tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:10.824305 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4cd132e5-dd3e-4697-b1ee-8f93593f89ef tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:10.882021 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a30ba168-4930-4d28-ac7e-6a5ce1697dcc tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133688fe60724d979e0bbccf65a28b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f784a8f91774261843e5819cdc6058a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:10.903779 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a30ba168-4930-4d28-ac7e-6a5ce1697dcc tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] 10.222.0.61 "GET /compute/v2.1/servers/41e57122-c82d-4f6d-af4f-fca28da61d70" status: 200 len: 1523 microversion: 2.1 time: 0.602832 Aug 31 16:20:10.907979 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2435/4852] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:10 2022] GET /compute/v2.1/servers/41e57122-c82d-4f6d-af4f-fca28da61d70 => generated 1523 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:10.916219 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4cd132e5-dd3e-4697-b1ee-8f93593f89ef tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] [instance: 5c468688-561a-4642-86f1-84b822674e33] Going to try to terminate instance {{(pid=122256) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:20:11.025040 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:20:11.153505 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4cd132e5-dd3e-4697-b1ee-8f93593f89ef tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] 10.222.0.61 "DELETE /compute/v2.1/servers/5c468688-561a-4642-86f1-84b822674e33" status: 204 len: 0 microversion: 2.57 time: 0.350982 Aug 31 16:20:11.154922 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2418/4853] 10.222.0.61 () {60 vars in 1280 bytes} [Wed Aug 31 16:20:10 2022] DELETE /compute/v2.1/servers/5c468688-561a-4642-86f1-84b822674e33 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 16:20:11.172593 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-463c3a16-19fe-4551-9b8d-3fd45d6dc1cd tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:11.177451 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-463c3a16-19fe-4551-9b8d-3fd45d6dc1cd tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] [instance: 5c468688-561a-4642-86f1-84b822674e33] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:11.195279 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-463c3a16-19fe-4551-9b8d-3fd45d6dc1cd tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:11.201238 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-463c3a16-19fe-4551-9b8d-3fd45d6dc1cd tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:11.204753 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-463c3a16-19fe-4551-9b8d-3fd45d6dc1cd tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:11.205723 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-463c3a16-19fe-4551-9b8d-3fd45d6dc1cd tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:11.206745 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-463c3a16-19fe-4551-9b8d-3fd45d6dc1cd tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:11.210305 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-463c3a16-19fe-4551-9b8d-3fd45d6dc1cd tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:11.349734 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8d5b1edb-cc1c-47dc-88f5-6a61cac34bc0 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:11.351277 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8d5b1edb-cc1c-47dc-88f5-6a61cac34bc0 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: 238b044c-ec15-4c03-88da-d90f9b1ec116] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:11.369740 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8d5b1edb-cc1c-47dc-88f5-6a61cac34bc0 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:11.371371 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8d5b1edb-cc1c-47dc-88f5-6a61cac34bc0 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:11.372153 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8d5b1edb-cc1c-47dc-88f5-6a61cac34bc0 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:11.373084 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8d5b1edb-cc1c-47dc-88f5-6a61cac34bc0 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:11.373771 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8d5b1edb-cc1c-47dc-88f5-6a61cac34bc0 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:11.374711 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8d5b1edb-cc1c-47dc-88f5-6a61cac34bc0 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:11.457922 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-463c3a16-19fe-4551-9b8d-3fd45d6dc1cd tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c697cf3c2d6d4edb93426d828c10d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e713a65903474cc28584721f2780841e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:11.495688 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-463c3a16-19fe-4551-9b8d-3fd45d6dc1cd tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c697cf3c2d6d4edb93426d828c10d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e713a65903474cc28584721f2780841e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:11.502889 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-463c3a16-19fe-4551-9b8d-3fd45d6dc1cd tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c697cf3c2d6d4edb93426d828c10d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e713a65903474cc28584721f2780841e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:11.505606 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-463c3a16-19fe-4551-9b8d-3fd45d6dc1cd tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] 10.222.0.61 "GET /compute/v2.1/servers/5c468688-561a-4642-86f1-84b822674e33" status: 200 len: 1362 microversion: 2.57 time: 0.340866 Aug 31 16:20:11.511588 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2436/4854] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:20:11 2022] GET /compute/v2.1/servers/5c468688-561a-4642-86f1-84b822674e33 => generated 1362 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:20:11.538419 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c18beba1-e2ad-4efd-9341-9633c623cb6a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:11.539193 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c18beba1-e2ad-4efd-9341-9633c623cb6a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 2459bf91-9279-46ab-be03-9de04e8cb3f4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:11.548832 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c18beba1-e2ad-4efd-9341-9633c623cb6a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:11.549693 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c18beba1-e2ad-4efd-9341-9633c623cb6a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:11.550375 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c18beba1-e2ad-4efd-9341-9633c623cb6a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:11.551304 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c18beba1-e2ad-4efd-9341-9633c623cb6a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:11.552014 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c18beba1-e2ad-4efd-9341-9633c623cb6a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:11.552673 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c18beba1-e2ad-4efd-9341-9633c623cb6a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:11.570272 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8d5b1edb-cc1c-47dc-88f5-6a61cac34bc0 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4744703b964435bbead751ca884d1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e014d4e4da5e47ff9a1261e7730034ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:11.583237 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8d5b1edb-cc1c-47dc-88f5-6a61cac34bc0 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/238b044c-ec15-4c03-88da-d90f9b1ec116" status: 200 len: 1218 microversion: 2.1 time: 0.238371 Aug 31 16:20:11.584249 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2419/4855] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:11 2022] GET /compute/v2.1/servers/238b044c-ec15-4c03-88da-d90f9b1ec116 => generated 1218 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:20:11.899920 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c18beba1-e2ad-4efd-9341-9633c623cb6a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:11.914570 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c18beba1-e2ad-4efd-9341-9633c623cb6a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/2459bf91-9279-46ab-be03-9de04e8cb3f4" status: 200 len: 1315 microversion: 2.1 time: 0.380228 Aug 31 16:20:11.915975 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2437/4856] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:11 2022] GET /compute/v2.1/servers/2459bf91-9279-46ab-be03-9de04e8cb3f4 => generated 1315 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:11.934152 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f4d9ce98-e295-484c-8ce7-92fdcd02c881 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:11.935024 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f4d9ce98-e295-484c-8ce7-92fdcd02c881 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] [instance: 41e57122-c82d-4f6d-af4f-fca28da61d70] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:11.942436 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f4d9ce98-e295-484c-8ce7-92fdcd02c881 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:11.943350 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f4d9ce98-e295-484c-8ce7-92fdcd02c881 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:11.944220 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f4d9ce98-e295-484c-8ce7-92fdcd02c881 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:11.945462 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f4d9ce98-e295-484c-8ce7-92fdcd02c881 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:11.946641 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f4d9ce98-e295-484c-8ce7-92fdcd02c881 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:11.947395 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f4d9ce98-e295-484c-8ce7-92fdcd02c881 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:12.537233 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-77268286-6f59-4919-ad24-4345ede79ce1 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:12.537857 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-77268286-6f59-4919-ad24-4345ede79ce1 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] [instance: 5c468688-561a-4642-86f1-84b822674e33] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:12.540535 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:20:12.548258 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-77268286-6f59-4919-ad24-4345ede79ce1 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:12.548761 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-77268286-6f59-4919-ad24-4345ede79ce1 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:12.559749 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-77268286-6f59-4919-ad24-4345ede79ce1 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:12.559927 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-77268286-6f59-4919-ad24-4345ede79ce1 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:12.560412 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-77268286-6f59-4919-ad24-4345ede79ce1 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:12.560715 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-77268286-6f59-4919-ad24-4345ede79ce1 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:12.810230 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-77268286-6f59-4919-ad24-4345ede79ce1 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c697cf3c2d6d4edb93426d828c10d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e713a65903474cc28584721f2780841e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:12.824345 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-77268286-6f59-4919-ad24-4345ede79ce1 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c697cf3c2d6d4edb93426d828c10d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e713a65903474cc28584721f2780841e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:12.862981 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-77268286-6f59-4919-ad24-4345ede79ce1 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c697cf3c2d6d4edb93426d828c10d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e713a65903474cc28584721f2780841e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:12.862981 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-77268286-6f59-4919-ad24-4345ede79ce1 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] 10.222.0.61 "GET /compute/v2.1/servers/5c468688-561a-4642-86f1-84b822674e33" status: 200 len: 1362 microversion: 2.57 time: 0.315707 Aug 31 16:20:12.862981 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2438/4857] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:20:12 2022] GET /compute/v2.1/servers/5c468688-561a-4642-86f1-84b822674e33 => generated 1362 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:20:12.862981 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7ffb0587-d36f-4c3d-b559-3fdd054f4e7c tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:12.862981 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7ffb0587-d36f-4c3d-b559-3fdd054f4e7c tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: 238b044c-ec15-4c03-88da-d90f9b1ec116] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:12.866642 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7ffb0587-d36f-4c3d-b559-3fdd054f4e7c tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:12.867146 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7ffb0587-d36f-4c3d-b559-3fdd054f4e7c tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:12.867723 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7ffb0587-d36f-4c3d-b559-3fdd054f4e7c tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:12.868650 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7ffb0587-d36f-4c3d-b559-3fdd054f4e7c tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:12.869114 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7ffb0587-d36f-4c3d-b559-3fdd054f4e7c tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:12.869548 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7ffb0587-d36f-4c3d-b559-3fdd054f4e7c tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:12.878297 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f4d9ce98-e295-484c-8ce7-92fdcd02c881 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133688fe60724d979e0bbccf65a28b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f784a8f91774261843e5819cdc6058a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:12.889149 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f4d9ce98-e295-484c-8ce7-92fdcd02c881 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] 10.222.0.61 "GET /compute/v2.1/servers/41e57122-c82d-4f6d-af4f-fca28da61d70" status: 200 len: 1523 microversion: 2.1 time: 0.960889 Aug 31 16:20:12.890683 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2420/4858] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:11 2022] GET /compute/v2.1/servers/41e57122-c82d-4f6d-af4f-fca28da61d70 => generated 1523 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:12.942211 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c7401bf4-ecfc-410d-9926-d9cb01ab225c tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:12.943322 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c7401bf4-ecfc-410d-9926-d9cb01ab225c tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 2459bf91-9279-46ab-be03-9de04e8cb3f4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:12.953545 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c7401bf4-ecfc-410d-9926-d9cb01ab225c tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:12.954056 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c7401bf4-ecfc-410d-9926-d9cb01ab225c tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:12.954499 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c7401bf4-ecfc-410d-9926-d9cb01ab225c tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:12.955429 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c7401bf4-ecfc-410d-9926-d9cb01ab225c tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:12.956968 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c7401bf4-ecfc-410d-9926-d9cb01ab225c tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:12.957803 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c7401bf4-ecfc-410d-9926-d9cb01ab225c tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:13.010061 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7ffb0587-d36f-4c3d-b559-3fdd054f4e7c tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4744703b964435bbead751ca884d1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e014d4e4da5e47ff9a1261e7730034ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:13.020032 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7ffb0587-d36f-4c3d-b559-3fdd054f4e7c tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/238b044c-ec15-4c03-88da-d90f9b1ec116" status: 200 len: 1218 microversion: 2.1 time: 0.169349 Aug 31 16:20:13.037675 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2439/4859] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:12 2022] GET /compute/v2.1/servers/238b044c-ec15-4c03-88da-d90f9b1ec116 => generated 1218 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:13.341403 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c7401bf4-ecfc-410d-9926-d9cb01ab225c tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:13.375977 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c7401bf4-ecfc-410d-9926-d9cb01ab225c tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/2459bf91-9279-46ab-be03-9de04e8cb3f4" status: 200 len: 1315 microversion: 2.1 time: 0.440664 Aug 31 16:20:13.385337 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2421/4860] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:12 2022] GET /compute/v2.1/servers/2459bf91-9279-46ab-be03-9de04e8cb3f4 => generated 1315 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:13.884139 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-232fcde7-9ba6-44c7-b8ef-2a0ce44beda6 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:13.885521 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-232fcde7-9ba6-44c7-b8ef-2a0ce44beda6 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] [instance: 5c468688-561a-4642-86f1-84b822674e33] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:13.900734 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-232fcde7-9ba6-44c7-b8ef-2a0ce44beda6 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:13.901738 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-232fcde7-9ba6-44c7-b8ef-2a0ce44beda6 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:13.907529 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-232fcde7-9ba6-44c7-b8ef-2a0ce44beda6 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:13.907529 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-232fcde7-9ba6-44c7-b8ef-2a0ce44beda6 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:13.907529 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-232fcde7-9ba6-44c7-b8ef-2a0ce44beda6 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:13.907529 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-232fcde7-9ba6-44c7-b8ef-2a0ce44beda6 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:13.919134 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e72645f9-16c0-4ebe-b002-1040a0ffaffd tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:13.925774 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e72645f9-16c0-4ebe-b002-1040a0ffaffd tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] [instance: 41e57122-c82d-4f6d-af4f-fca28da61d70] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:13.937851 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e72645f9-16c0-4ebe-b002-1040a0ffaffd tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:13.939526 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e72645f9-16c0-4ebe-b002-1040a0ffaffd tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:13.940595 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e72645f9-16c0-4ebe-b002-1040a0ffaffd tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:13.941811 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e72645f9-16c0-4ebe-b002-1040a0ffaffd tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:13.942832 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e72645f9-16c0-4ebe-b002-1040a0ffaffd tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:13.944584 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e72645f9-16c0-4ebe-b002-1040a0ffaffd tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:14.126719 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-232fcde7-9ba6-44c7-b8ef-2a0ce44beda6 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c697cf3c2d6d4edb93426d828c10d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e713a65903474cc28584721f2780841e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:14.134865 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:20:14.157468 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-232fcde7-9ba6-44c7-b8ef-2a0ce44beda6 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c697cf3c2d6d4edb93426d828c10d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e713a65903474cc28584721f2780841e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:14.163015 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-232fcde7-9ba6-44c7-b8ef-2a0ce44beda6 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c697cf3c2d6d4edb93426d828c10d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e713a65903474cc28584721f2780841e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:14.165693 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-232fcde7-9ba6-44c7-b8ef-2a0ce44beda6 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] 10.222.0.61 "GET /compute/v2.1/servers/5c468688-561a-4642-86f1-84b822674e33" status: 200 len: 1362 microversion: 2.57 time: 0.288927 Aug 31 16:20:14.167891 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2440/4861] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:20:13 2022] GET /compute/v2.1/servers/5c468688-561a-4642-86f1-84b822674e33 => generated 1362 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:20:14.174748 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-34c88170-de51-4e84-96e1-03eef8a2fb1d tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:14.175642 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-34c88170-de51-4e84-96e1-03eef8a2fb1d tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: 238b044c-ec15-4c03-88da-d90f9b1ec116] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:14.184112 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-34c88170-de51-4e84-96e1-03eef8a2fb1d tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:14.184828 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-34c88170-de51-4e84-96e1-03eef8a2fb1d tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:14.185452 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-34c88170-de51-4e84-96e1-03eef8a2fb1d tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:14.186339 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-34c88170-de51-4e84-96e1-03eef8a2fb1d tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:14.186959 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-34c88170-de51-4e84-96e1-03eef8a2fb1d tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:14.187586 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-34c88170-de51-4e84-96e1-03eef8a2fb1d tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:14.423991 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e72645f9-16c0-4ebe-b002-1040a0ffaffd tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133688fe60724d979e0bbccf65a28b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f784a8f91774261843e5819cdc6058a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:14.425728 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-34c88170-de51-4e84-96e1-03eef8a2fb1d tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4744703b964435bbead751ca884d1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e014d4e4da5e47ff9a1261e7730034ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:14.433244 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e72645f9-16c0-4ebe-b002-1040a0ffaffd tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] 10.222.0.61 "GET /compute/v2.1/servers/41e57122-c82d-4f6d-af4f-fca28da61d70" status: 200 len: 1523 microversion: 2.1 time: 0.521853 Aug 31 16:20:14.434471 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2422/4862] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:13 2022] GET /compute/v2.1/servers/41e57122-c82d-4f6d-af4f-fca28da61d70 => generated 1523 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:20:14.439356 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a996dd05-56d9-40e1-b838-c720a4bc527c tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:14.439994 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a996dd05-56d9-40e1-b838-c720a4bc527c tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 2459bf91-9279-46ab-be03-9de04e8cb3f4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:14.450439 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a996dd05-56d9-40e1-b838-c720a4bc527c tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:14.450944 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a996dd05-56d9-40e1-b838-c720a4bc527c tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:14.451380 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a996dd05-56d9-40e1-b838-c720a4bc527c tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:14.452220 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a996dd05-56d9-40e1-b838-c720a4bc527c tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:14.452710 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a996dd05-56d9-40e1-b838-c720a4bc527c tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:14.453142 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a996dd05-56d9-40e1-b838-c720a4bc527c tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:14.487708 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-34c88170-de51-4e84-96e1-03eef8a2fb1d tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/238b044c-ec15-4c03-88da-d90f9b1ec116" status: 200 len: 1274 microversion: 2.1 time: 0.316185 Aug 31 16:20:14.497544 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2441/4863] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:14 2022] GET /compute/v2.1/servers/238b044c-ec15-4c03-88da-d90f9b1ec116 => generated 1274 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:14.994026 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a996dd05-56d9-40e1-b838-c720a4bc527c tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:15.028196 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a996dd05-56d9-40e1-b838-c720a4bc527c tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/2459bf91-9279-46ab-be03-9de04e8cb3f4" status: 200 len: 1315 microversion: 2.1 time: 0.591918 Aug 31 16:20:15.030872 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2423/4864] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:14 2022] GET /compute/v2.1/servers/2459bf91-9279-46ab-be03-9de04e8cb3f4 => generated 1315 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:15.219668 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a3527c79-db48-4fee-845e-1d2a6647fc0b tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:15.224172 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a3527c79-db48-4fee-845e-1d2a6647fc0b tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] [instance: 5c468688-561a-4642-86f1-84b822674e33] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:15.245844 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a3527c79-db48-4fee-845e-1d2a6647fc0b tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:15.247425 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a3527c79-db48-4fee-845e-1d2a6647fc0b tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:15.248859 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a3527c79-db48-4fee-845e-1d2a6647fc0b tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:15.251800 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a3527c79-db48-4fee-845e-1d2a6647fc0b tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:15.253067 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a3527c79-db48-4fee-845e-1d2a6647fc0b tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:15.254703 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a3527c79-db48-4fee-845e-1d2a6647fc0b tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:15.312943 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-fa14b154-a33f-4969-97c1-fa9bd1a5fc02 req-5358d8e1-b011-4b4b-845d-20241dfd4443 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffc6f828-c8ec-4fd6-b69e-9c0230692009", "tag": "1f21436d-5375-4ec2-b60e-3ee54c0e8a00"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:20:15.333352 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-fa14b154-a33f-4969-97c1-fa9bd1a5fc02 req-5358d8e1-b011-4b4b-845d-20241dfd4443 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:15.333848 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-fa14b154-a33f-4969-97c1-fa9bd1a5fc02 req-5358d8e1-b011-4b4b-845d-20241dfd4443 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:15.334293 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-fa14b154-a33f-4969-97c1-fa9bd1a5fc02 req-5358d8e1-b011-4b4b-845d-20241dfd4443 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:15.352500 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-fa14b154-a33f-4969-97c1-fa9bd1a5fc02 req-5358d8e1-b011-4b4b-845d-20241dfd4443 service nova] Creating event network-changed:1f21436d-5375-4ec2-b60e-3ee54c0e8a00 for instance ffc6f828-c8ec-4fd6-b69e-9c0230692009 on n-h2-850499-9 Aug 31 16:20:15.361827 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-fa14b154-a33f-4969-97c1-fa9bd1a5fc02 req-5358d8e1-b011-4b4b-845d-20241dfd4443 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052322 Aug 31 16:20:15.363268 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2424/4865] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:20:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:20:15.409399 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a3527c79-db48-4fee-845e-1d2a6647fc0b tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c697cf3c2d6d4edb93426d828c10d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e713a65903474cc28584721f2780841e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:15.444981 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a3527c79-db48-4fee-845e-1d2a6647fc0b tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c697cf3c2d6d4edb93426d828c10d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e713a65903474cc28584721f2780841e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:15.454740 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a3527c79-db48-4fee-845e-1d2a6647fc0b tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c697cf3c2d6d4edb93426d828c10d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e713a65903474cc28584721f2780841e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:15.460332 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a3527c79-db48-4fee-845e-1d2a6647fc0b tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] 10.222.0.61 "GET /compute/v2.1/servers/5c468688-561a-4642-86f1-84b822674e33" status: 200 len: 1362 microversion: 2.57 time: 0.254934 Aug 31 16:20:15.491544 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2442/4866] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:20:15 2022] GET /compute/v2.1/servers/5c468688-561a-4642-86f1-84b822674e33 => generated 1362 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:20:15.491999 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9e48330f-2fb8-4723-bf03-c3b78317e5c6 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:15.491999 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9e48330f-2fb8-4723-bf03-c3b78317e5c6 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] [instance: 41e57122-c82d-4f6d-af4f-fca28da61d70] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:15.491999 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9e48330f-2fb8-4723-bf03-c3b78317e5c6 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:15.494314 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9e48330f-2fb8-4723-bf03-c3b78317e5c6 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:15.496077 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9e48330f-2fb8-4723-bf03-c3b78317e5c6 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:15.497498 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9e48330f-2fb8-4723-bf03-c3b78317e5c6 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:15.498226 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9e48330f-2fb8-4723-bf03-c3b78317e5c6 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:15.498889 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9e48330f-2fb8-4723-bf03-c3b78317e5c6 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:15.525383 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-35d9f3ec-255e-4dfc-a88c-2f960c10374b tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:15.526256 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-35d9f3ec-255e-4dfc-a88c-2f960c10374b tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: 238b044c-ec15-4c03-88da-d90f9b1ec116] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:15.541628 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-35d9f3ec-255e-4dfc-a88c-2f960c10374b tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:15.542591 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-35d9f3ec-255e-4dfc-a88c-2f960c10374b tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:15.543950 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-35d9f3ec-255e-4dfc-a88c-2f960c10374b tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:15.550821 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-35d9f3ec-255e-4dfc-a88c-2f960c10374b tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:15.552441 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-35d9f3ec-255e-4dfc-a88c-2f960c10374b tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:15.553582 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-35d9f3ec-255e-4dfc-a88c-2f960c10374b tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:16.030835 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-35d9f3ec-255e-4dfc-a88c-2f960c10374b tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4744703b964435bbead751ca884d1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e014d4e4da5e47ff9a1261e7730034ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:16.048238 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-35d9f3ec-255e-4dfc-a88c-2f960c10374b tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/238b044c-ec15-4c03-88da-d90f9b1ec116" status: 200 len: 1282 microversion: 2.1 time: 0.529003 Aug 31 16:20:16.050205 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2443/4867] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:15 2022] GET /compute/v2.1/servers/238b044c-ec15-4c03-88da-d90f9b1ec116 => generated 1282 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:20:16.090119 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e557ca59-47c8-47f3-b447-b32c8809a6af tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:16.092080 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e557ca59-47c8-47f3-b447-b32c8809a6af tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 2459bf91-9279-46ab-be03-9de04e8cb3f4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:16.104672 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e557ca59-47c8-47f3-b447-b32c8809a6af tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:16.106232 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e557ca59-47c8-47f3-b447-b32c8809a6af tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:16.107710 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e557ca59-47c8-47f3-b447-b32c8809a6af tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:16.109357 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e557ca59-47c8-47f3-b447-b32c8809a6af tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:16.110592 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e557ca59-47c8-47f3-b447-b32c8809a6af tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:16.112075 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e557ca59-47c8-47f3-b447-b32c8809a6af tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:16.283644 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:20:16.770274 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=8 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:20:16.810220 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-9e48330f-2fb8-4723-bf03-c3b78317e5c6 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133688fe60724d979e0bbccf65a28b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f784a8f91774261843e5819cdc6058a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:16.839896 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9e48330f-2fb8-4723-bf03-c3b78317e5c6 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] 10.222.0.61 "GET /compute/v2.1/servers/41e57122-c82d-4f6d-af4f-fca28da61d70" status: 200 len: 1523 microversion: 2.1 time: 1.374050 Aug 31 16:20:16.843369 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2425/4868] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:15 2022] GET /compute/v2.1/servers/41e57122-c82d-4f6d-af4f-fca28da61d70 => generated 1523 bytes in 1382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:20:16.849952 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-cc118479-e0b6-4172-b5ad-2360b452e122 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:16.853014 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-cc118479-e0b6-4172-b5ad-2360b452e122 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] [instance: 5c468688-561a-4642-86f1-84b822674e33] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:16.869778 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cc118479-e0b6-4172-b5ad-2360b452e122 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:16.871186 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cc118479-e0b6-4172-b5ad-2360b452e122 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:16.871947 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cc118479-e0b6-4172-b5ad-2360b452e122 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:16.873414 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cc118479-e0b6-4172-b5ad-2360b452e122 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:16.874061 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cc118479-e0b6-4172-b5ad-2360b452e122 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:16.877070 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cc118479-e0b6-4172-b5ad-2360b452e122 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:16.972552 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cc118479-e0b6-4172-b5ad-2360b452e122 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:16.975210 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cc118479-e0b6-4172-b5ad-2360b452e122 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:16.976475 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cc118479-e0b6-4172-b5ad-2360b452e122 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:16.977912 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-cc118479-e0b6-4172-b5ad-2360b452e122 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lazy-loading 'fault' on Instance uuid 5c468688-561a-4642-86f1-84b822674e33 {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:20:17.583256 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e557ca59-47c8-47f3-b447-b32c8809a6af tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:17.607412 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e557ca59-47c8-47f3-b447-b32c8809a6af tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/2459bf91-9279-46ab-be03-9de04e8cb3f4" status: 200 len: 1315 microversion: 2.1 time: 1.532041 Aug 31 16:20:17.610332 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2444/4869] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:16 2022] GET /compute/v2.1/servers/2459bf91-9279-46ab-be03-9de04e8cb3f4 => generated 1315 bytes in 1538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:17.620181 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d060d661-b74f-4ea3-b38f-10e6254d9d8c tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:17.636715 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d060d661-b74f-4ea3-b38f-10e6254d9d8c tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: 238b044c-ec15-4c03-88da-d90f9b1ec116] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:17.644869 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d060d661-b74f-4ea3-b38f-10e6254d9d8c tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:17.645905 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d060d661-b74f-4ea3-b38f-10e6254d9d8c tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:17.646515 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d060d661-b74f-4ea3-b38f-10e6254d9d8c tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:17.647476 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d060d661-b74f-4ea3-b38f-10e6254d9d8c tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:17.683330 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d060d661-b74f-4ea3-b38f-10e6254d9d8c tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:17.685241 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d060d661-b74f-4ea3-b38f-10e6254d9d8c tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.037s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:17.811591 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-cc118479-e0b6-4172-b5ad-2360b452e122 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c697cf3c2d6d4edb93426d828c10d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e713a65903474cc28584721f2780841e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:17.831308 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-cc118479-e0b6-4172-b5ad-2360b452e122 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c697cf3c2d6d4edb93426d828c10d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e713a65903474cc28584721f2780841e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:17.834592 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-cc118479-e0b6-4172-b5ad-2360b452e122 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c697cf3c2d6d4edb93426d828c10d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e713a65903474cc28584721f2780841e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:17.842794 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-cc118479-e0b6-4172-b5ad-2360b452e122 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] 10.222.0.61 "GET /compute/v2.1/servers/5c468688-561a-4642-86f1-84b822674e33" status: 200 len: 1367 microversion: 2.57 time: 0.994582 Aug 31 16:20:17.844612 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2426/4870] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:20:16 2022] GET /compute/v2.1/servers/5c468688-561a-4642-86f1-84b822674e33 => generated 1367 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:20:17.869284 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-9c1b46e2-602a-432b-898a-05579204bd86 req-34a03f83-e665-401f-b0ae-6fdcfd218e14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2459bf91-9279-46ab-be03-9de04e8cb3f4", "name": "network-vif-plugged", "status": "completed", "tag": "5aee3413-65c3-47d2-8e17-0db097d25bd7"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:20:17.915687 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-9c1b46e2-602a-432b-898a-05579204bd86 req-34a03f83-e665-401f-b0ae-6fdcfd218e14 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:17.917996 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-9c1b46e2-602a-432b-898a-05579204bd86 req-34a03f83-e665-401f-b0ae-6fdcfd218e14 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:17.919542 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-9c1b46e2-602a-432b-898a-05579204bd86 req-34a03f83-e665-401f-b0ae-6fdcfd218e14 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:17.947050 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d060d661-b74f-4ea3-b38f-10e6254d9d8c tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4744703b964435bbead751ca884d1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e014d4e4da5e47ff9a1261e7730034ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:17.959432 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-9c1b46e2-602a-432b-898a-05579204bd86 req-34a03f83-e665-401f-b0ae-6fdcfd218e14 service nova] Creating event network-vif-plugged:5aee3413-65c3-47d2-8e17-0db097d25bd7 for instance 2459bf91-9279-46ab-be03-9de04e8cb3f4 on n-h1-850499-9 Aug 31 16:20:17.981093 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d060d661-b74f-4ea3-b38f-10e6254d9d8c tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/238b044c-ec15-4c03-88da-d90f9b1ec116" status: 200 len: 1280 microversion: 2.1 time: 0.353753 Aug 31 16:20:17.981093 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2445/4871] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:17 2022] GET /compute/v2.1/servers/238b044c-ec15-4c03-88da-d90f9b1ec116 => generated 1280 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:17.988764 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-9c1b46e2-602a-432b-898a-05579204bd86 req-34a03f83-e665-401f-b0ae-6fdcfd218e14 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140776 Aug 31 16:20:17.994471 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ac60d9ed-c7bc-4df7-b3f3-73e9e1550364 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:17.994675 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ac60d9ed-c7bc-4df7-b3f3-73e9e1550364 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] [instance: 41e57122-c82d-4f6d-af4f-fca28da61d70] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:17.998788 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2427/4872] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:20:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:20:18.001270 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ac60d9ed-c7bc-4df7-b3f3-73e9e1550364 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:18.001828 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ac60d9ed-c7bc-4df7-b3f3-73e9e1550364 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:18.002455 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ac60d9ed-c7bc-4df7-b3f3-73e9e1550364 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:18.003429 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ac60d9ed-c7bc-4df7-b3f3-73e9e1550364 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:18.004121 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ac60d9ed-c7bc-4df7-b3f3-73e9e1550364 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:18.005014 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ac60d9ed-c7bc-4df7-b3f3-73e9e1550364 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:18.641772 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-52de2b88-ca6d-4725-a1b8-a995b099e64a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:18.642375 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-52de2b88-ca6d-4725-a1b8-a995b099e64a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 2459bf91-9279-46ab-be03-9de04e8cb3f4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:18.651547 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-52de2b88-ca6d-4725-a1b8-a995b099e64a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:18.652442 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-52de2b88-ca6d-4725-a1b8-a995b099e64a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:18.653108 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-52de2b88-ca6d-4725-a1b8-a995b099e64a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:18.655021 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-52de2b88-ca6d-4725-a1b8-a995b099e64a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:18.655864 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-52de2b88-ca6d-4725-a1b8-a995b099e64a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:18.656054 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ac60d9ed-c7bc-4df7-b3f3-73e9e1550364 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133688fe60724d979e0bbccf65a28b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f784a8f91774261843e5819cdc6058a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:18.657119 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-52de2b88-ca6d-4725-a1b8-a995b099e64a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:18.674709 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ac60d9ed-c7bc-4df7-b3f3-73e9e1550364 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] 10.222.0.61 "GET /compute/v2.1/servers/41e57122-c82d-4f6d-af4f-fca28da61d70" status: 200 len: 1523 microversion: 2.1 time: 0.689207 Aug 31 16:20:18.684948 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2446/4873] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:17 2022] GET /compute/v2.1/servers/41e57122-c82d-4f6d-af4f-fca28da61d70 => generated 1523 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:18.896830 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e6972b4d-6cd3-4c0f-94fa-4ed77c8d2911 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:18.901518 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e6972b4d-6cd3-4c0f-94fa-4ed77c8d2911 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] [instance: 5c468688-561a-4642-86f1-84b822674e33] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:18.913810 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e6972b4d-6cd3-4c0f-94fa-4ed77c8d2911 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:18.916894 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e6972b4d-6cd3-4c0f-94fa-4ed77c8d2911 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:18.918868 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e6972b4d-6cd3-4c0f-94fa-4ed77c8d2911 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:18.919920 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e6972b4d-6cd3-4c0f-94fa-4ed77c8d2911 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:18.920622 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e6972b4d-6cd3-4c0f-94fa-4ed77c8d2911 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:18.921337 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e6972b4d-6cd3-4c0f-94fa-4ed77c8d2911 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:18.955524 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-e6972b4d-6cd3-4c0f-94fa-4ed77c8d2911 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] HTTP exception thrown: Instance 5c468688-561a-4642-86f1-84b822674e33 could not be found. Aug 31 16:20:18.958572 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e6972b4d-6cd3-4c0f-94fa-4ed77c8d2911 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Request method failure captured: Aug 31 16:20:18.958572 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/5c468688-561a-4642-86f1-84b822674e33 HTTP/1.1 Aug 31 16:20:18.958572 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:20:18.958572 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:20:18.958572 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:20:18.958572 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:20:18.958572 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:20:18.958572 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:20:18.958572 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:20:18.958572 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:20:18.958572 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4oPM5UD3diPLlI50d6ZvGCrTzuvKdwtektTNlK2Vx1dd5yVWScdcizi_TFU50F8MoW8GjP6F0tnei3jprJEhqe8qwzx4aVbKKkaGWARLMGPdU1kvxdHGeDIxhI0-gIYX3AhFu4vJvFrt3FBDkmc75YrIy40ORdJjOuZC5WJ7rwrnNo Aug 31 16:20:18.958572 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:20:18.958572 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:20:18.958572 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:20:18.958572 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:20:18.958572 n-d-850499-9 devstack@n-api.service[122257]: X-Openstack-Nova-Api-Version: 2.57 Aug 31 16:20:18.958572 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:20:18.958572 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:20:18.958572 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: e713a65903474cc28584721f2780841e Aug 31 16:20:18.958572 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ServerShowV257Test-76810223 Aug 31 16:20:18.958572 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:20:18.958572 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:20:18.958572 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e713a65903474cc28584721f2780841e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/e713a65903474cc28584721f2780841e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_e713a65903474cc28584721f2780841e", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e713a65903474cc28584721f2780841e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:20:18.958572 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ServerShowV257Test-76810223 Aug 31 16:20:18.958572 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: e713a65903474cc28584721f2780841e Aug 31 16:20:18.958572 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ServerShowV257Test-76810223 Aug 31 16:20:18.958572 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ServerShowV257Test-76810223-project Aug 31 16:20:18.958572 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:20:18.958572 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:20:18.958572 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: c697cf3c2d6d4edb93426d828c10d6f6 Aug 31 16:20:18.958572 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ServerShowV257Test-76810223-project Aug 31 16:20:18.958572 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:20:18.958572 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance 5c468688-561a-4642-86f1-84b822674e33 could not be found. Aug 31 16:20:18.958572 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '5c468688-561a-4642-86f1-84b822674e33'} Aug 31 16:20:18.958572 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:20:18.958572 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:20:18.958572 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:20:18.958572 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:20:18.958572 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:20:18.958572 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:20:18.958572 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:20:18.958572 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:20:18.958572 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:20:18.958572 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:20:18.958572 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c468688-561a-4642-86f1-84b822674e33 could not be found. Aug 31 16:20:18.958572 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:20:18.958572 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:20:18.958572 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:20:18.958572 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:20:18.958572 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:20:18.958572 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:20:18.958572 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:20:18.958572 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:20:18.958572 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:20:18.958572 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:20:18.958572 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:20:18.958572 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:20:18.958572 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:20:18.958572 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:20:18.958572 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:20:18.958572 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:20:18.958572 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c468688-561a-4642-86f1-84b822674e33 could not be found. Aug 31 16:20:18.958572 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:20:18.958572 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:20:18.958572 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:20:18.965465 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:20:18.965465 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:20:18.965465 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:20:18.965465 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:20:18.965465 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:20:18.965465 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c468688-561a-4642-86f1-84b822674e33 could not be found. Aug 31 16:20:18.965465 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:20:18.967453 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e6972b4d-6cd3-4c0f-94fa-4ed77c8d2911 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] Returning 404 to user: Instance 5c468688-561a-4642-86f1-84b822674e33 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:20:18.970361 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e6972b4d-6cd3-4c0f-94fa-4ed77c8d2911 tempest-ServerShowV257Test-76810223 tempest-ServerShowV257Test-76810223-project] 10.222.0.61 "GET /compute/v2.1/servers/5c468688-561a-4642-86f1-84b822674e33" status: 404 len: 111 microversion: 2.57 time: 0.077855 Aug 31 16:20:18.971402 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2447/4874] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:20:18 2022] GET /compute/v2.1/servers/5c468688-561a-4642-86f1-84b822674e33 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 31 16:20:18.994573 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-52de2b88-ca6d-4725-a1b8-a995b099e64a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:19.001646 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-00887251-ed18-4ae9-8bc1-b25074b3a005 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:19.011086 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-00887251-ed18-4ae9-8bc1-b25074b3a005 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: 238b044c-ec15-4c03-88da-d90f9b1ec116] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:19.018630 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-52de2b88-ca6d-4725-a1b8-a995b099e64a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/2459bf91-9279-46ab-be03-9de04e8cb3f4" status: 200 len: 1315 microversion: 2.1 time: 0.381986 Aug 31 16:20:19.024247 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2428/4875] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:18 2022] GET /compute/v2.1/servers/2459bf91-9279-46ab-be03-9de04e8cb3f4 => generated 1315 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:20:19.032186 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-00887251-ed18-4ae9-8bc1-b25074b3a005 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:19.032724 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-00887251-ed18-4ae9-8bc1-b25074b3a005 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:19.033186 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-00887251-ed18-4ae9-8bc1-b25074b3a005 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:19.033977 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-00887251-ed18-4ae9-8bc1-b25074b3a005 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:19.034451 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-00887251-ed18-4ae9-8bc1-b25074b3a005 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:19.034892 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-00887251-ed18-4ae9-8bc1-b25074b3a005 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:19.154184 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-00887251-ed18-4ae9-8bc1-b25074b3a005 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4744703b964435bbead751ca884d1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e014d4e4da5e47ff9a1261e7730034ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:19.172222 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-00887251-ed18-4ae9-8bc1-b25074b3a005 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/238b044c-ec15-4c03-88da-d90f9b1ec116" status: 200 len: 1280 microversion: 2.1 time: 0.177425 Aug 31 16:20:19.173186 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2448/4876] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:18 2022] GET /compute/v2.1/servers/238b044c-ec15-4c03-88da-d90f9b1ec116 => generated 1280 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:20:19.708055 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1b62bad9-4c72-4859-9914-6630cb64df02 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:19.709093 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1b62bad9-4c72-4859-9914-6630cb64df02 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] [instance: 41e57122-c82d-4f6d-af4f-fca28da61d70] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:19.767366 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1b62bad9-4c72-4859-9914-6630cb64df02 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:19.769465 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1b62bad9-4c72-4859-9914-6630cb64df02 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:19.772353 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1b62bad9-4c72-4859-9914-6630cb64df02 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:19.781849 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1b62bad9-4c72-4859-9914-6630cb64df02 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:19.784011 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1b62bad9-4c72-4859-9914-6630cb64df02 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:19.787165 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1b62bad9-4c72-4859-9914-6630cb64df02 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:20.054493 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-66f20189-9990-4411-b78a-429405f7d144 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:20.057486 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-66f20189-9990-4411-b78a-429405f7d144 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 2459bf91-9279-46ab-be03-9de04e8cb3f4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:20.060442 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:20:20.073505 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-66f20189-9990-4411-b78a-429405f7d144 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:20.074148 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-66f20189-9990-4411-b78a-429405f7d144 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:20.074690 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-66f20189-9990-4411-b78a-429405f7d144 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:20.075725 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-66f20189-9990-4411-b78a-429405f7d144 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:20.076415 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-66f20189-9990-4411-b78a-429405f7d144 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:20.077047 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-66f20189-9990-4411-b78a-429405f7d144 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:20.290298 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=8 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:20:20.728480 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-66f20189-9990-4411-b78a-429405f7d144 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:20.749902 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-66f20189-9990-4411-b78a-429405f7d144 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/2459bf91-9279-46ab-be03-9de04e8cb3f4" status: 200 len: 1502 microversion: 2.1 time: 0.695465 Aug 31 16:20:20.752038 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2449/4877] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:20 2022] GET /compute/v2.1/servers/2459bf91-9279-46ab-be03-9de04e8cb3f4 => generated 1502 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:20.767741 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-87fba651-35ba-4a8b-9d66-16dbd23ab4d5 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:20.772091 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1b62bad9-4c72-4859-9914-6630cb64df02 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133688fe60724d979e0bbccf65a28b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f784a8f91774261843e5819cdc6058a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:20.778073 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-87fba651-35ba-4a8b-9d66-16dbd23ab4d5 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: 238b044c-ec15-4c03-88da-d90f9b1ec116] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:20.788157 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1b62bad9-4c72-4859-9914-6630cb64df02 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] 10.222.0.61 "GET /compute/v2.1/servers/41e57122-c82d-4f6d-af4f-fca28da61d70" status: 200 len: 1523 microversion: 2.1 time: 1.089229 Aug 31 16:20:20.789170 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2429/4878] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:19 2022] GET /compute/v2.1/servers/41e57122-c82d-4f6d-af4f-fca28da61d70 => generated 1523 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:20.802962 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-fac60afa-46ad-4370-a71b-5fa2f502b6d7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:20:20.805526 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-87fba651-35ba-4a8b-9d66-16dbd23ab4d5 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:20.810208 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-87fba651-35ba-4a8b-9d66-16dbd23ab4d5 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:20.812461 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-87fba651-35ba-4a8b-9d66-16dbd23ab4d5 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:20.814278 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-87fba651-35ba-4a8b-9d66-16dbd23ab4d5 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:20.815420 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-87fba651-35ba-4a8b-9d66-16dbd23ab4d5 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:20.817370 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-87fba651-35ba-4a8b-9d66-16dbd23ab4d5 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:20.822555 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fac60afa-46ad-4370-a71b-5fa2f502b6d7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:20.823067 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fac60afa-46ad-4370-a71b-5fa2f502b6d7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:20.823552 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fac60afa-46ad-4370-a71b-5fa2f502b6d7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:20.914011 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-fac60afa-46ad-4370-a71b-5fa2f502b6d7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 2459bf91-9279-46ab-be03-9de04e8cb3f4] Going to try to stop instance {{(pid=122256) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 31 16:20:21.031766 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-fac60afa-46ad-4370-a71b-5fa2f502b6d7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "POST /compute/v2.1/servers/2459bf91-9279-46ab-be03-9de04e8cb3f4/action" status: 202 len: 0 microversion: 2.1 time: 0.238987 Aug 31 16:20:21.032850 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2430/4879] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:20:20 2022] POST /compute/v2.1/servers/2459bf91-9279-46ab-be03-9de04e8cb3f4/action => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:20:21.056825 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c2062283-ea04-4cca-9f79-f645078054b3 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:21.060578 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c2062283-ea04-4cca-9f79-f645078054b3 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 2459bf91-9279-46ab-be03-9de04e8cb3f4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:21.088454 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c2062283-ea04-4cca-9f79-f645078054b3 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:21.089251 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c2062283-ea04-4cca-9f79-f645078054b3 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:21.089965 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c2062283-ea04-4cca-9f79-f645078054b3 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:21.093893 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c2062283-ea04-4cca-9f79-f645078054b3 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:21.095419 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c2062283-ea04-4cca-9f79-f645078054b3 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:21.097599 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c2062283-ea04-4cca-9f79-f645078054b3 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:21.496450 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-87fba651-35ba-4a8b-9d66-16dbd23ab4d5 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4744703b964435bbead751ca884d1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e014d4e4da5e47ff9a1261e7730034ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:21.518551 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-87fba651-35ba-4a8b-9d66-16dbd23ab4d5 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/238b044c-ec15-4c03-88da-d90f9b1ec116" status: 200 len: 1322 microversion: 2.1 time: 0.759156 Aug 31 16:20:21.521236 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2450/4880] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:20 2022] GET /compute/v2.1/servers/238b044c-ec15-4c03-88da-d90f9b1ec116 => generated 1322 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:21.708859 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c2062283-ea04-4cca-9f79-f645078054b3 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:21.728275 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c2062283-ea04-4cca-9f79-f645078054b3 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/2459bf91-9279-46ab-be03-9de04e8cb3f4" status: 200 len: 1512 microversion: 2.1 time: 0.685813 Aug 31 16:20:21.729251 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2431/4881] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:21 2022] GET /compute/v2.1/servers/2459bf91-9279-46ab-be03-9de04e8cb3f4 => generated 1512 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:21.819867 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4ce8a86e-c4e9-4602-8ba7-40fa4a031a1f tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:21.821352 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4ce8a86e-c4e9-4602-8ba7-40fa4a031a1f tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] [instance: 41e57122-c82d-4f6d-af4f-fca28da61d70] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:21.842609 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4ce8a86e-c4e9-4602-8ba7-40fa4a031a1f tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:21.848337 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4ce8a86e-c4e9-4602-8ba7-40fa4a031a1f tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:21.852848 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4ce8a86e-c4e9-4602-8ba7-40fa4a031a1f tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:21.856683 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4ce8a86e-c4e9-4602-8ba7-40fa4a031a1f tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:21.859474 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4ce8a86e-c4e9-4602-8ba7-40fa4a031a1f tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:21.862197 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4ce8a86e-c4e9-4602-8ba7-40fa4a031a1f tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:22.386639 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-4ce8a86e-c4e9-4602-8ba7-40fa4a031a1f tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133688fe60724d979e0bbccf65a28b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f784a8f91774261843e5819cdc6058a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:22.416399 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4ce8a86e-c4e9-4602-8ba7-40fa4a031a1f tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] 10.222.0.61 "GET /compute/v2.1/servers/41e57122-c82d-4f6d-af4f-fca28da61d70" status: 200 len: 1523 microversion: 2.1 time: 0.591573 Aug 31 16:20:22.417516 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2451/4882] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:21 2022] GET /compute/v2.1/servers/41e57122-c82d-4f6d-af4f-fca28da61d70 => generated 1523 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:22.572210 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e160cf75-dc24-47a3-a536-8ee1c070a45c tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:22.574832 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e160cf75-dc24-47a3-a536-8ee1c070a45c tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: 238b044c-ec15-4c03-88da-d90f9b1ec116] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:22.590470 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e160cf75-dc24-47a3-a536-8ee1c070a45c tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:22.592711 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e160cf75-dc24-47a3-a536-8ee1c070a45c tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:22.594047 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e160cf75-dc24-47a3-a536-8ee1c070a45c tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:22.596163 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e160cf75-dc24-47a3-a536-8ee1c070a45c tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:22.597326 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e160cf75-dc24-47a3-a536-8ee1c070a45c tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:22.599786 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e160cf75-dc24-47a3-a536-8ee1c070a45c tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:22.667927 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-01fcc2e9-9729-4b2f-8ccc-01200ff08630 req-81cf05c6-4fe7-4d3e-b614-077680cfdb2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "238b044c-ec15-4c03-88da-d90f9b1ec116", "tag": "d2825fd5-c211-4535-9a3d-64610db4b69a"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:20:22.697289 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-01fcc2e9-9729-4b2f-8ccc-01200ff08630 req-81cf05c6-4fe7-4d3e-b614-077680cfdb2e service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:22.698795 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-01fcc2e9-9729-4b2f-8ccc-01200ff08630 req-81cf05c6-4fe7-4d3e-b614-077680cfdb2e service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:22.700762 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-01fcc2e9-9729-4b2f-8ccc-01200ff08630 req-81cf05c6-4fe7-4d3e-b614-077680cfdb2e service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:22.729515 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-01fcc2e9-9729-4b2f-8ccc-01200ff08630 req-81cf05c6-4fe7-4d3e-b614-077680cfdb2e service nova] Creating event network-changed:d2825fd5-c211-4535-9a3d-64610db4b69a for instance 238b044c-ec15-4c03-88da-d90f9b1ec116 on n-h1-850499-9 Aug 31 16:20:22.740068 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-01fcc2e9-9729-4b2f-8ccc-01200ff08630 req-81cf05c6-4fe7-4d3e-b614-077680cfdb2e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078646 Aug 31 16:20:22.741175 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2452/4883] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:20:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:20:22.753538 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ff4c002f-6a53-41e9-b090-05e781dc5b1e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:22.754819 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ff4c002f-6a53-41e9-b090-05e781dc5b1e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 2459bf91-9279-46ab-be03-9de04e8cb3f4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:22.764835 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ff4c002f-6a53-41e9-b090-05e781dc5b1e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:22.766242 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ff4c002f-6a53-41e9-b090-05e781dc5b1e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:22.767700 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ff4c002f-6a53-41e9-b090-05e781dc5b1e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:22.769902 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ff4c002f-6a53-41e9-b090-05e781dc5b1e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:22.771086 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ff4c002f-6a53-41e9-b090-05e781dc5b1e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:22.772173 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ff4c002f-6a53-41e9-b090-05e781dc5b1e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:24.369951 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ff4c002f-6a53-41e9-b090-05e781dc5b1e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:24.403350 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ff4c002f-6a53-41e9-b090-05e781dc5b1e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/2459bf91-9279-46ab-be03-9de04e8cb3f4" status: 200 len: 1512 microversion: 2.1 time: 1.654928 Aug 31 16:20:24.415549 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2453/4884] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:22 2022] GET /compute/v2.1/servers/2459bf91-9279-46ab-be03-9de04e8cb3f4 => generated 1512 bytes in 1657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:24.415549 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f435eafc-8e51-4e76-81c0-a267d23ed407 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:24.415549 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f435eafc-8e51-4e76-81c0-a267d23ed407 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] [instance: 41e57122-c82d-4f6d-af4f-fca28da61d70] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:24.424976 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f435eafc-8e51-4e76-81c0-a267d23ed407 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:24.425618 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f435eafc-8e51-4e76-81c0-a267d23ed407 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:24.427189 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f435eafc-8e51-4e76-81c0-a267d23ed407 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:24.429402 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f435eafc-8e51-4e76-81c0-a267d23ed407 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:24.431835 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f435eafc-8e51-4e76-81c0-a267d23ed407 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:24.432756 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f435eafc-8e51-4e76-81c0-a267d23ed407 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:24.575161 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e160cf75-dc24-47a3-a536-8ee1c070a45c tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4744703b964435bbead751ca884d1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e014d4e4da5e47ff9a1261e7730034ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:24.590129 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e160cf75-dc24-47a3-a536-8ee1c070a45c tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/238b044c-ec15-4c03-88da-d90f9b1ec116" status: 200 len: 1322 microversion: 2.1 time: 2.029728 Aug 31 16:20:24.591358 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2432/4885] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:22 2022] GET /compute/v2.1/servers/238b044c-ec15-4c03-88da-d90f9b1ec116 => generated 1322 bytes in 2033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:24.612930 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-909fc2fe-be0e-4d1b-a099-4a8267ed13b5 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:24.613837 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-909fc2fe-be0e-4d1b-a099-4a8267ed13b5 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] [instance: cca485b3-25f2-4a77-a23a-bb9758586ce7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:24.633770 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-909fc2fe-be0e-4d1b-a099-4a8267ed13b5 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:24.635044 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-909fc2fe-be0e-4d1b-a099-4a8267ed13b5 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:24.645217 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-909fc2fe-be0e-4d1b-a099-4a8267ed13b5 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:24.646919 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-909fc2fe-be0e-4d1b-a099-4a8267ed13b5 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:24.647493 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-909fc2fe-be0e-4d1b-a099-4a8267ed13b5 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:24.649343 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-909fc2fe-be0e-4d1b-a099-4a8267ed13b5 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:24.744052 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-909fc2fe-be0e-4d1b-a099-4a8267ed13b5 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] 10.222.0.61 "GET /compute/v2.1/servers/cca485b3-25f2-4a77-a23a-bb9758586ce7/ips" status: 200 len: 147 microversion: 2.1 time: 0.149494 Aug 31 16:20:24.744741 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2433/4886] 10.222.0.61 () {58 vars in 1248 bytes} [Wed Aug 31 16:20:24 2022] GET /compute/v2.1/servers/cca485b3-25f2-4a77-a23a-bb9758586ce7/ips => generated 147 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:20:25.321632 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f435eafc-8e51-4e76-81c0-a267d23ed407 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133688fe60724d979e0bbccf65a28b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f784a8f91774261843e5819cdc6058a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:25.340495 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f435eafc-8e51-4e76-81c0-a267d23ed407 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] 10.222.0.61 "GET /compute/v2.1/servers/41e57122-c82d-4f6d-af4f-fca28da61d70" status: 200 len: 1523 microversion: 2.1 time: 0.930685 Aug 31 16:20:25.359375 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2454/4887] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:24 2022] GET /compute/v2.1/servers/41e57122-c82d-4f6d-af4f-fca28da61d70 => generated 1523 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:25.461321 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-31178891-49fc-43da-b237-0936812f6341 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:25.466018 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-31178891-49fc-43da-b237-0936812f6341 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 2459bf91-9279-46ab-be03-9de04e8cb3f4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:25.503010 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-31178891-49fc-43da-b237-0936812f6341 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:25.512215 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-31178891-49fc-43da-b237-0936812f6341 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:25.514151 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-31178891-49fc-43da-b237-0936812f6341 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:25.526028 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-31178891-49fc-43da-b237-0936812f6341 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:25.528784 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-31178891-49fc-43da-b237-0936812f6341 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:25.538682 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-31178891-49fc-43da-b237-0936812f6341 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:25.624439 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e1f3b9bd-7746-4b76-945a-a77f529bc4c6 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:25.625384 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e1f3b9bd-7746-4b76-945a-a77f529bc4c6 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: 238b044c-ec15-4c03-88da-d90f9b1ec116] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:25.640247 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e1f3b9bd-7746-4b76-945a-a77f529bc4c6 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:25.644563 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e1f3b9bd-7746-4b76-945a-a77f529bc4c6 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:25.648678 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e1f3b9bd-7746-4b76-945a-a77f529bc4c6 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:25.662205 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e1f3b9bd-7746-4b76-945a-a77f529bc4c6 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:25.665072 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e1f3b9bd-7746-4b76-945a-a77f529bc4c6 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:25.666586 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e1f3b9bd-7746-4b76-945a-a77f529bc4c6 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:27.267649 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-31178891-49fc-43da-b237-0936812f6341 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:27.300691 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-31178891-49fc-43da-b237-0936812f6341 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/2459bf91-9279-46ab-be03-9de04e8cb3f4" status: 200 len: 1512 microversion: 2.1 time: 1.865221 Aug 31 16:20:27.316282 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2434/4888] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:25 2022] GET /compute/v2.1/servers/2459bf91-9279-46ab-be03-9de04e8cb3f4 => generated 1512 bytes in 1877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:20:27.325907 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1f54240a-20da-401e-abb4-bc7ba4faf2f0 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:27.327994 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1f54240a-20da-401e-abb4-bc7ba4faf2f0 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] [instance: 41e57122-c82d-4f6d-af4f-fca28da61d70] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:27.352724 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1f54240a-20da-401e-abb4-bc7ba4faf2f0 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:27.356871 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1f54240a-20da-401e-abb4-bc7ba4faf2f0 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:27.361775 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1f54240a-20da-401e-abb4-bc7ba4faf2f0 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:27.365313 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1f54240a-20da-401e-abb4-bc7ba4faf2f0 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:27.368886 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1f54240a-20da-401e-abb4-bc7ba4faf2f0 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:27.370554 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1f54240a-20da-401e-abb4-bc7ba4faf2f0 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:27.391471 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:20:28.053479 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e1f3b9bd-7746-4b76-945a-a77f529bc4c6 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4744703b964435bbead751ca884d1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e014d4e4da5e47ff9a1261e7730034ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:28.097374 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e1f3b9bd-7746-4b76-945a-a77f529bc4c6 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/238b044c-ec15-4c03-88da-d90f9b1ec116" status: 200 len: 1322 microversion: 2.1 time: 2.472464 Aug 31 16:20:28.100659 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2455/4889] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:25 2022] GET /compute/v2.1/servers/238b044c-ec15-4c03-88da-d90f9b1ec116 => generated 1322 bytes in 2483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:28.137993 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-603c5f92-08fe-457d-bdc0-d995e1c21d99 req-93584ade-a2e1-4527-bfdb-6571c47b737c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffc6f828-c8ec-4fd6-b69e-9c0230692009", "name": "network-vif-plugged", "status": "completed", "tag": "1f21436d-5375-4ec2-b60e-3ee54c0e8a00"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:20:28.182162 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-603c5f92-08fe-457d-bdc0-d995e1c21d99 req-93584ade-a2e1-4527-bfdb-6571c47b737c service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:28.192418 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-603c5f92-08fe-457d-bdc0-d995e1c21d99 req-93584ade-a2e1-4527-bfdb-6571c47b737c service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:28.199648 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-603c5f92-08fe-457d-bdc0-d995e1c21d99 req-93584ade-a2e1-4527-bfdb-6571c47b737c service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:28.234884 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-603c5f92-08fe-457d-bdc0-d995e1c21d99 req-93584ade-a2e1-4527-bfdb-6571c47b737c service nova] Creating event network-vif-plugged:1f21436d-5375-4ec2-b60e-3ee54c0e8a00 for instance ffc6f828-c8ec-4fd6-b69e-9c0230692009 on n-h2-850499-9 Aug 31 16:20:28.248503 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-603c5f92-08fe-457d-bdc0-d995e1c21d99 req-93584ade-a2e1-4527-bfdb-6571c47b737c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142257 Aug 31 16:20:28.253442 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2456/4890] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:20:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:20:28.348439 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-da3b22c7-1a92-4d15-ac25-fd40cc3bc8e3 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:28.351004 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-da3b22c7-1a92-4d15-ac25-fd40cc3bc8e3 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 2459bf91-9279-46ab-be03-9de04e8cb3f4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:28.375844 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-da3b22c7-1a92-4d15-ac25-fd40cc3bc8e3 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:28.377291 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-da3b22c7-1a92-4d15-ac25-fd40cc3bc8e3 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:28.379233 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-da3b22c7-1a92-4d15-ac25-fd40cc3bc8e3 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:28.382427 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-da3b22c7-1a92-4d15-ac25-fd40cc3bc8e3 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:28.383725 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-da3b22c7-1a92-4d15-ac25-fd40cc3bc8e3 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:28.384547 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-da3b22c7-1a92-4d15-ac25-fd40cc3bc8e3 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:28.494467 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1f54240a-20da-401e-abb4-bc7ba4faf2f0 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133688fe60724d979e0bbccf65a28b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f784a8f91774261843e5819cdc6058a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:28.523898 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1f54240a-20da-401e-abb4-bc7ba4faf2f0 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] 10.222.0.61 "GET /compute/v2.1/servers/41e57122-c82d-4f6d-af4f-fca28da61d70" status: 200 len: 1523 microversion: 2.1 time: 1.217262 Aug 31 16:20:28.526141 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2435/4891] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:27 2022] GET /compute/v2.1/servers/41e57122-c82d-4f6d-af4f-fca28da61d70 => generated 1523 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:29.129862 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c1767922-cd53-4922-a108-528cfaf42ebf tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bbabe112-a1f7-415e-822a-7a959b48657c"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:20:29.143810 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c1767922-cd53-4922-a108-528cfaf42ebf tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] [instance: cca485b3-25f2-4a77-a23a-bb9758586ce7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:29.161099 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c1767922-cd53-4922-a108-528cfaf42ebf tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:29.161603 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c1767922-cd53-4922-a108-528cfaf42ebf tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:29.162304 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c1767922-cd53-4922-a108-528cfaf42ebf tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:29.163628 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c1767922-cd53-4922-a108-528cfaf42ebf tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:29.164922 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c1767922-cd53-4922-a108-528cfaf42ebf tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:29.165601 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c1767922-cd53-4922-a108-528cfaf42ebf tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:29.287099 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-da3b22c7-1a92-4d15-ac25-fd40cc3bc8e3 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:29.327069 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-da3b22c7-1a92-4d15-ac25-fd40cc3bc8e3 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/2459bf91-9279-46ab-be03-9de04e8cb3f4" status: 200 len: 1512 microversion: 2.1 time: 0.986232 Aug 31 16:20:29.346564 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2457/4892] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:28 2022] GET /compute/v2.1/servers/2459bf91-9279-46ab-be03-9de04e8cb3f4 => generated 1512 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:20:29.370502 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-181892ed-347c-4066-86d7-6b4874a4d763 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:29.372443 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-181892ed-347c-4066-86d7-6b4874a4d763 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: 238b044c-ec15-4c03-88da-d90f9b1ec116] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:29.388370 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-181892ed-347c-4066-86d7-6b4874a4d763 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:29.389915 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-181892ed-347c-4066-86d7-6b4874a4d763 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:29.390932 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-181892ed-347c-4066-86d7-6b4874a4d763 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:29.393087 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-181892ed-347c-4066-86d7-6b4874a4d763 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:29.395137 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-181892ed-347c-4066-86d7-6b4874a4d763 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:29.396159 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-181892ed-347c-4066-86d7-6b4874a4d763 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:30.181884 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-181892ed-347c-4066-86d7-6b4874a4d763 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4744703b964435bbead751ca884d1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e014d4e4da5e47ff9a1261e7730034ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:30.197507 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-181892ed-347c-4066-86d7-6b4874a4d763 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/238b044c-ec15-4c03-88da-d90f9b1ec116" status: 200 len: 1322 microversion: 2.1 time: 0.835276 Aug 31 16:20:30.221777 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2458/4893] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:29 2022] GET /compute/v2.1/servers/238b044c-ec15-4c03-88da-d90f9b1ec116 => generated 1322 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:30.240071 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7a69518b-d36b-4417-8f6f-9380b1630601 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:30.241834 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7a69518b-d36b-4417-8f6f-9380b1630601 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] [instance: 41e57122-c82d-4f6d-af4f-fca28da61d70] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:30.255630 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7a69518b-d36b-4417-8f6f-9380b1630601 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:30.257065 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7a69518b-d36b-4417-8f6f-9380b1630601 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:30.261510 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7a69518b-d36b-4417-8f6f-9380b1630601 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:30.266402 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7a69518b-d36b-4417-8f6f-9380b1630601 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:30.267027 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7a69518b-d36b-4417-8f6f-9380b1630601 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:30.267692 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7a69518b-d36b-4417-8f6f-9380b1630601 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:30.315074 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=100 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:20:30.674960 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7a69518b-d36b-4417-8f6f-9380b1630601 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133688fe60724d979e0bbccf65a28b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f784a8f91774261843e5819cdc6058a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:30.684676 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7a69518b-d36b-4417-8f6f-9380b1630601 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] 10.222.0.61 "GET /compute/v2.1/servers/41e57122-c82d-4f6d-af4f-fca28da61d70" status: 200 len: 1523 microversion: 2.1 time: 0.460964 Aug 31 16:20:30.687741 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2459/4894] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:30 2022] GET /compute/v2.1/servers/41e57122-c82d-4f6d-af4f-fca28da61d70 => generated 1523 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:30.705272 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-69dfbc5f-a13a-4982-87b0-e488905217f6 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:30.706198 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-69dfbc5f-a13a-4982-87b0-e488905217f6 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 2459bf91-9279-46ab-be03-9de04e8cb3f4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:30.721239 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-69dfbc5f-a13a-4982-87b0-e488905217f6 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:30.722024 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-69dfbc5f-a13a-4982-87b0-e488905217f6 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:30.725891 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-69dfbc5f-a13a-4982-87b0-e488905217f6 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:30.728340 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-69dfbc5f-a13a-4982-87b0-e488905217f6 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:30.729479 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-69dfbc5f-a13a-4982-87b0-e488905217f6 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:30.730504 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-69dfbc5f-a13a-4982-87b0-e488905217f6 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:30.885823 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c1767922-cd53-4922-a108-528cfaf42ebf tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] 10.222.0.61 "POST /compute/v2.1/servers/cca485b3-25f2-4a77-a23a-bb9758586ce7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.764985 Aug 31 16:20:30.886751 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2436/4895] 10.222.0.61 () {60 vars in 1323 bytes} [Wed Aug 31 16:20:29 2022] POST /compute/v2.1/servers/cca485b3-25f2-4a77-a23a-bb9758586ce7/os-volume_attachments => generated 194 bytes in 1768 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:20:31.252191 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3d0b9874-f132-4966-998d-f2ff9e54ba9d tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:31.253986 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3d0b9874-f132-4966-998d-f2ff9e54ba9d tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: 238b044c-ec15-4c03-88da-d90f9b1ec116] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:31.290386 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3d0b9874-f132-4966-998d-f2ff9e54ba9d tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:31.293635 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3d0b9874-f132-4966-998d-f2ff9e54ba9d tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:31.296313 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3d0b9874-f132-4966-998d-f2ff9e54ba9d tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:31.297908 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3d0b9874-f132-4966-998d-f2ff9e54ba9d tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:31.299079 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3d0b9874-f132-4966-998d-f2ff9e54ba9d tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:31.310398 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3d0b9874-f132-4966-998d-f2ff9e54ba9d tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:31.539796 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-69dfbc5f-a13a-4982-87b0-e488905217f6 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:31.576015 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-69dfbc5f-a13a-4982-87b0-e488905217f6 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/2459bf91-9279-46ab-be03-9de04e8cb3f4" status: 200 len: 1512 microversion: 2.1 time: 0.884500 Aug 31 16:20:31.581071 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2460/4896] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:30 2022] GET /compute/v2.1/servers/2459bf91-9279-46ab-be03-9de04e8cb3f4 => generated 1512 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:31.717885 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6336314a-fa4c-463c-a152-2800a55084aa tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:31.720659 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6336314a-fa4c-463c-a152-2800a55084aa tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] [instance: 41e57122-c82d-4f6d-af4f-fca28da61d70] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:31.746394 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6336314a-fa4c-463c-a152-2800a55084aa tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:31.747251 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6336314a-fa4c-463c-a152-2800a55084aa tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:31.748067 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6336314a-fa4c-463c-a152-2800a55084aa tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:31.749351 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6336314a-fa4c-463c-a152-2800a55084aa tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:31.750141 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6336314a-fa4c-463c-a152-2800a55084aa tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:31.755542 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6336314a-fa4c-463c-a152-2800a55084aa tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:31.865547 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3d0b9874-f132-4966-998d-f2ff9e54ba9d tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4744703b964435bbead751ca884d1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e014d4e4da5e47ff9a1261e7730034ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:31.896389 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3d0b9874-f132-4966-998d-f2ff9e54ba9d tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/238b044c-ec15-4c03-88da-d90f9b1ec116" status: 200 len: 1322 microversion: 2.1 time: 0.651509 Aug 31 16:20:31.901495 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2437/4897] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:31 2022] GET /compute/v2.1/servers/238b044c-ec15-4c03-88da-d90f9b1ec116 => generated 1322 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:32.182880 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-6336314a-fa4c-463c-a152-2800a55084aa tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133688fe60724d979e0bbccf65a28b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f784a8f91774261843e5819cdc6058a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:32.197224 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6336314a-fa4c-463c-a152-2800a55084aa tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] 10.222.0.61 "GET /compute/v2.1/servers/41e57122-c82d-4f6d-af4f-fca28da61d70" status: 200 len: 1523 microversion: 2.1 time: 0.486632 Aug 31 16:20:32.203559 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2461/4898] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:31 2022] GET /compute/v2.1/servers/41e57122-c82d-4f6d-af4f-fca28da61d70 => generated 1523 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:20:32.614705 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e6617c20-38cb-46de-aa6e-a1b88e2d0ac4 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:32.616309 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e6617c20-38cb-46de-aa6e-a1b88e2d0ac4 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 2459bf91-9279-46ab-be03-9de04e8cb3f4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:32.631836 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e6617c20-38cb-46de-aa6e-a1b88e2d0ac4 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:32.633106 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e6617c20-38cb-46de-aa6e-a1b88e2d0ac4 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:32.634173 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e6617c20-38cb-46de-aa6e-a1b88e2d0ac4 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:32.635854 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e6617c20-38cb-46de-aa6e-a1b88e2d0ac4 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:32.636834 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e6617c20-38cb-46de-aa6e-a1b88e2d0ac4 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:32.638156 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e6617c20-38cb-46de-aa6e-a1b88e2d0ac4 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:32.923348 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9300745a-5c83-4e18-a3a6-8172c5e44f61 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:32.924755 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9300745a-5c83-4e18-a3a6-8172c5e44f61 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: 238b044c-ec15-4c03-88da-d90f9b1ec116] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:32.934822 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9300745a-5c83-4e18-a3a6-8172c5e44f61 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:32.936403 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9300745a-5c83-4e18-a3a6-8172c5e44f61 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:32.937612 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9300745a-5c83-4e18-a3a6-8172c5e44f61 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:32.939412 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9300745a-5c83-4e18-a3a6-8172c5e44f61 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:32.941128 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9300745a-5c83-4e18-a3a6-8172c5e44f61 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:32.942444 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9300745a-5c83-4e18-a3a6-8172c5e44f61 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:33.218547 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e6617c20-38cb-46de-aa6e-a1b88e2d0ac4 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:33.232717 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e6617c20-38cb-46de-aa6e-a1b88e2d0ac4 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/2459bf91-9279-46ab-be03-9de04e8cb3f4" status: 200 len: 1512 microversion: 2.1 time: 0.625561 Aug 31 16:20:33.233330 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2438/4899] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:32 2022] GET /compute/v2.1/servers/2459bf91-9279-46ab-be03-9de04e8cb3f4 => generated 1512 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:33.344763 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9300745a-5c83-4e18-a3a6-8172c5e44f61 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4744703b964435bbead751ca884d1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e014d4e4da5e47ff9a1261e7730034ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:33.346431 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b36d9d93-d9ed-43fa-87ce-8630de1025c5 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:33.347139 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b36d9d93-d9ed-43fa-87ce-8630de1025c5 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] [instance: 41e57122-c82d-4f6d-af4f-fca28da61d70] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:33.356492 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b36d9d93-d9ed-43fa-87ce-8630de1025c5 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:33.360075 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b36d9d93-d9ed-43fa-87ce-8630de1025c5 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:33.365082 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b36d9d93-d9ed-43fa-87ce-8630de1025c5 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:33.367935 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b36d9d93-d9ed-43fa-87ce-8630de1025c5 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:33.371534 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b36d9d93-d9ed-43fa-87ce-8630de1025c5 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:33.380269 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b36d9d93-d9ed-43fa-87ce-8630de1025c5 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:33.380480 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9300745a-5c83-4e18-a3a6-8172c5e44f61 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/238b044c-ec15-4c03-88da-d90f9b1ec116" status: 200 len: 1322 microversion: 2.1 time: 0.460664 Aug 31 16:20:33.398840 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2462/4900] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:32 2022] GET /compute/v2.1/servers/238b044c-ec15-4c03-88da-d90f9b1ec116 => generated 1322 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:34.147761 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b36d9d93-d9ed-43fa-87ce-8630de1025c5 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133688fe60724d979e0bbccf65a28b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f784a8f91774261843e5819cdc6058a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:34.181748 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b36d9d93-d9ed-43fa-87ce-8630de1025c5 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] 10.222.0.61 "GET /compute/v2.1/servers/41e57122-c82d-4f6d-af4f-fca28da61d70" status: 200 len: 1523 microversion: 2.1 time: 0.839686 Aug 31 16:20:34.185935 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2439/4901] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:33 2022] GET /compute/v2.1/servers/41e57122-c82d-4f6d-af4f-fca28da61d70 => generated 1523 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:20:34.275148 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-13c2d758-a306-4848-9355-4e93b77f6112 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:34.276670 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-13c2d758-a306-4848-9355-4e93b77f6112 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 2459bf91-9279-46ab-be03-9de04e8cb3f4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:34.292981 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-13c2d758-a306-4848-9355-4e93b77f6112 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:34.298887 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-13c2d758-a306-4848-9355-4e93b77f6112 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:34.299943 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-13c2d758-a306-4848-9355-4e93b77f6112 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:34.303390 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-13c2d758-a306-4848-9355-4e93b77f6112 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:34.307799 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-13c2d758-a306-4848-9355-4e93b77f6112 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:34.308708 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-13c2d758-a306-4848-9355-4e93b77f6112 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:34.429045 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-36c2ad5a-6809-490a-a9d2-2591c419edbb tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:34.438554 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-36c2ad5a-6809-490a-a9d2-2591c419edbb tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: 238b044c-ec15-4c03-88da-d90f9b1ec116] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:34.466797 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-36c2ad5a-6809-490a-a9d2-2591c419edbb tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:34.467219 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-36c2ad5a-6809-490a-a9d2-2591c419edbb tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:34.471652 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-36c2ad5a-6809-490a-a9d2-2591c419edbb tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:34.478291 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-36c2ad5a-6809-490a-a9d2-2591c419edbb tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:34.479476 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-36c2ad5a-6809-490a-a9d2-2591c419edbb tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:34.480331 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-36c2ad5a-6809-490a-a9d2-2591c419edbb tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:36.250976 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-13c2d758-a306-4848-9355-4e93b77f6112 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:36.294073 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-13c2d758-a306-4848-9355-4e93b77f6112 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/2459bf91-9279-46ab-be03-9de04e8cb3f4" status: 200 len: 1512 microversion: 2.1 time: 2.008118 Aug 31 16:20:36.295273 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2463/4902] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:34 2022] GET /compute/v2.1/servers/2459bf91-9279-46ab-be03-9de04e8cb3f4 => generated 1512 bytes in 2026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:36.343994 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-aa109507-8d4f-4fa4-8e0b-5fecb8fa8920 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:36.345346 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-aa109507-8d4f-4fa4-8e0b-5fecb8fa8920 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] [instance: 41e57122-c82d-4f6d-af4f-fca28da61d70] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:36.387095 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-aa109507-8d4f-4fa4-8e0b-5fecb8fa8920 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:36.391519 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-36c2ad5a-6809-490a-a9d2-2591c419edbb tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4744703b964435bbead751ca884d1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e014d4e4da5e47ff9a1261e7730034ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:36.394292 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-aa109507-8d4f-4fa4-8e0b-5fecb8fa8920 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:36.404122 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-aa109507-8d4f-4fa4-8e0b-5fecb8fa8920 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:36.406709 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-aa109507-8d4f-4fa4-8e0b-5fecb8fa8920 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:36.410294 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-aa109507-8d4f-4fa4-8e0b-5fecb8fa8920 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:36.413431 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-aa109507-8d4f-4fa4-8e0b-5fecb8fa8920 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:36.417043 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-36c2ad5a-6809-490a-a9d2-2591c419edbb tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/238b044c-ec15-4c03-88da-d90f9b1ec116" status: 200 len: 1322 microversion: 2.1 time: 1.997273 Aug 31 16:20:36.450214 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2440/4903] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:34 2022] GET /compute/v2.1/servers/238b044c-ec15-4c03-88da-d90f9b1ec116 => generated 1322 bytes in 2032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:36.460393 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-dea0005b-7374-4241-a6d9-69b96b2c67c5 req-f197ed7b-2bf5-4ad8-ba29-8bec183863e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "238b044c-ec15-4c03-88da-d90f9b1ec116", "name": "network-vif-plugged", "status": "completed", "tag": "d2825fd5-c211-4535-9a3d-64610db4b69a"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:20:36.508998 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-dea0005b-7374-4241-a6d9-69b96b2c67c5 req-f197ed7b-2bf5-4ad8-ba29-8bec183863e1 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:36.509806 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-dea0005b-7374-4241-a6d9-69b96b2c67c5 req-f197ed7b-2bf5-4ad8-ba29-8bec183863e1 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:36.510588 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-dea0005b-7374-4241-a6d9-69b96b2c67c5 req-f197ed7b-2bf5-4ad8-ba29-8bec183863e1 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:36.554180 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-dea0005b-7374-4241-a6d9-69b96b2c67c5 req-f197ed7b-2bf5-4ad8-ba29-8bec183863e1 service nova] Creating event network-vif-plugged:d2825fd5-c211-4535-9a3d-64610db4b69a for instance 238b044c-ec15-4c03-88da-d90f9b1ec116 on n-h1-850499-9 Aug 31 16:20:36.568078 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-dea0005b-7374-4241-a6d9-69b96b2c67c5 req-f197ed7b-2bf5-4ad8-ba29-8bec183863e1 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115660 Aug 31 16:20:36.573091 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2441/4904] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:20:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:20:37.079561 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-aa109507-8d4f-4fa4-8e0b-5fecb8fa8920 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133688fe60724d979e0bbccf65a28b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f784a8f91774261843e5819cdc6058a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:37.112797 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-aa109507-8d4f-4fa4-8e0b-5fecb8fa8920 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] 10.222.0.61 "GET /compute/v2.1/servers/41e57122-c82d-4f6d-af4f-fca28da61d70" status: 200 len: 1523 microversion: 2.1 time: 0.781103 Aug 31 16:20:37.113411 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2464/4905] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:36 2022] GET /compute/v2.1/servers/41e57122-c82d-4f6d-af4f-fca28da61d70 => generated 1523 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:37.342069 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-54a6ae5b-4341-4683-9a5c-665f360f06be tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:37.351349 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-54a6ae5b-4341-4683-9a5c-665f360f06be tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 2459bf91-9279-46ab-be03-9de04e8cb3f4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:37.368476 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-54a6ae5b-4341-4683-9a5c-665f360f06be tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:37.369934 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-54a6ae5b-4341-4683-9a5c-665f360f06be tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:37.373260 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-54a6ae5b-4341-4683-9a5c-665f360f06be tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:37.375056 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-54a6ae5b-4341-4683-9a5c-665f360f06be tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:37.388769 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-54a6ae5b-4341-4683-9a5c-665f360f06be tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:37.390046 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-54a6ae5b-4341-4683-9a5c-665f360f06be tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:37.466003 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3aa5eb9f-4a97-480e-bf0d-6caddbbf87d7 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:37.466731 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3aa5eb9f-4a97-480e-bf0d-6caddbbf87d7 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: 238b044c-ec15-4c03-88da-d90f9b1ec116] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:37.500956 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3aa5eb9f-4a97-480e-bf0d-6caddbbf87d7 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:37.501897 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3aa5eb9f-4a97-480e-bf0d-6caddbbf87d7 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:37.502697 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3aa5eb9f-4a97-480e-bf0d-6caddbbf87d7 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:37.510113 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3aa5eb9f-4a97-480e-bf0d-6caddbbf87d7 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:37.510796 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3aa5eb9f-4a97-480e-bf0d-6caddbbf87d7 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:37.511289 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3aa5eb9f-4a97-480e-bf0d-6caddbbf87d7 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:38.153909 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3aa5eb9f-4a97-480e-bf0d-6caddbbf87d7 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4744703b964435bbead751ca884d1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e014d4e4da5e47ff9a1261e7730034ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:38.202102 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3aa5eb9f-4a97-480e-bf0d-6caddbbf87d7 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/238b044c-ec15-4c03-88da-d90f9b1ec116" status: 200 len: 1322 microversion: 2.1 time: 0.739312 Aug 31 16:20:38.203936 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2465/4906] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:37 2022] GET /compute/v2.1/servers/238b044c-ec15-4c03-88da-d90f9b1ec116 => generated 1322 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:38.232839 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-03d4325b-ed88-4409-95c5-b1d4c366e0f0 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:38.236858 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-03d4325b-ed88-4409-95c5-b1d4c366e0f0 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] [instance: 41e57122-c82d-4f6d-af4f-fca28da61d70] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:38.297419 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-54a6ae5b-4341-4683-9a5c-665f360f06be tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:38.327816 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-54a6ae5b-4341-4683-9a5c-665f360f06be tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/2459bf91-9279-46ab-be03-9de04e8cb3f4" status: 200 len: 1512 microversion: 2.1 time: 0.991383 Aug 31 16:20:38.329108 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2442/4907] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:37 2022] GET /compute/v2.1/servers/2459bf91-9279-46ab-be03-9de04e8cb3f4 => generated 1512 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:38.352760 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-03d4325b-ed88-4409-95c5-b1d4c366e0f0 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:38.353634 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-03d4325b-ed88-4409-95c5-b1d4c366e0f0 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:38.354206 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-03d4325b-ed88-4409-95c5-b1d4c366e0f0 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:38.355148 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-03d4325b-ed88-4409-95c5-b1d4c366e0f0 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:38.358605 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-03d4325b-ed88-4409-95c5-b1d4c366e0f0 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:38.359478 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-03d4325b-ed88-4409-95c5-b1d4c366e0f0 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:38.946871 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-03d4325b-ed88-4409-95c5-b1d4c366e0f0 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133688fe60724d979e0bbccf65a28b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f784a8f91774261843e5819cdc6058a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:38.968991 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-03d4325b-ed88-4409-95c5-b1d4c366e0f0 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] 10.222.0.61 "GET /compute/v2.1/servers/41e57122-c82d-4f6d-af4f-fca28da61d70" status: 200 len: 1523 microversion: 2.1 time: 0.763337 Aug 31 16:20:38.975942 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2466/4908] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:38 2022] GET /compute/v2.1/servers/41e57122-c82d-4f6d-af4f-fca28da61d70 => generated 1523 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:39.236515 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ea76d0f7-329a-4a6a-95f8-816e501b4992 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:39.237763 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ea76d0f7-329a-4a6a-95f8-816e501b4992 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: 238b044c-ec15-4c03-88da-d90f9b1ec116] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:39.273642 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ea76d0f7-329a-4a6a-95f8-816e501b4992 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:39.274495 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ea76d0f7-329a-4a6a-95f8-816e501b4992 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:39.275334 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ea76d0f7-329a-4a6a-95f8-816e501b4992 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:39.276742 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ea76d0f7-329a-4a6a-95f8-816e501b4992 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:39.277618 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ea76d0f7-329a-4a6a-95f8-816e501b4992 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:39.278402 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ea76d0f7-329a-4a6a-95f8-816e501b4992 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:39.355533 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-29cfabb7-ab9f-45a4-bea4-8b909166aff7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:39.356194 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-29cfabb7-ab9f-45a4-bea4-8b909166aff7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 2459bf91-9279-46ab-be03-9de04e8cb3f4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:39.413556 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-29cfabb7-ab9f-45a4-bea4-8b909166aff7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:39.414982 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-29cfabb7-ab9f-45a4-bea4-8b909166aff7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:39.417443 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-29cfabb7-ab9f-45a4-bea4-8b909166aff7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:39.420823 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-29cfabb7-ab9f-45a4-bea4-8b909166aff7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:39.424396 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-29cfabb7-ab9f-45a4-bea4-8b909166aff7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:39.425474 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-29cfabb7-ab9f-45a4-bea4-8b909166aff7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:40.181855 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ea76d0f7-329a-4a6a-95f8-816e501b4992 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4744703b964435bbead751ca884d1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e014d4e4da5e47ff9a1261e7730034ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:40.197186 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ea76d0f7-329a-4a6a-95f8-816e501b4992 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/238b044c-ec15-4c03-88da-d90f9b1ec116" status: 200 len: 1517 microversion: 2.1 time: 0.973203 Aug 31 16:20:40.198020 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2443/4909] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:39 2022] GET /compute/v2.1/servers/238b044c-ec15-4c03-88da-d90f9b1ec116 => generated 1517 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:20:40.214577 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5c3eba93-9474-48f8-a68a-68e7d672e616 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:40.224704 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5c3eba93-9474-48f8-a68a-68e7d672e616 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] [instance: 41e57122-c82d-4f6d-af4f-fca28da61d70] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:40.239609 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-29cfabb7-ab9f-45a4-bea4-8b909166aff7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:40.253283 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5c3eba93-9474-48f8-a68a-68e7d672e616 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:40.255257 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5c3eba93-9474-48f8-a68a-68e7d672e616 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:40.255719 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-29cfabb7-ab9f-45a4-bea4-8b909166aff7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/2459bf91-9279-46ab-be03-9de04e8cb3f4" status: 200 len: 1512 microversion: 2.1 time: 0.905484 Aug 31 16:20:40.256108 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5c3eba93-9474-48f8-a68a-68e7d672e616 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:40.256861 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5c3eba93-9474-48f8-a68a-68e7d672e616 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:40.257438 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5c3eba93-9474-48f8-a68a-68e7d672e616 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:40.258056 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5c3eba93-9474-48f8-a68a-68e7d672e616 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:40.273677 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2467/4910] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:39 2022] GET /compute/v2.1/servers/2459bf91-9279-46ab-be03-9de04e8cb3f4 => generated 1512 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:40.292675 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8966d09f-d828-4883-b918-30af5463b6b8 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:20:40.294845 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8966d09f-d828-4883-b918-30af5463b6b8 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: 238b044c-ec15-4c03-88da-d90f9b1ec116] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:40.315635 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8966d09f-d828-4883-b918-30af5463b6b8 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:40.316642 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8966d09f-d828-4883-b918-30af5463b6b8 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:40.320300 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8966d09f-d828-4883-b918-30af5463b6b8 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:40.324011 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8966d09f-d828-4883-b918-30af5463b6b8 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:40.325905 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8966d09f-d828-4883-b918-30af5463b6b8 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:40.326525 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8966d09f-d828-4883-b918-30af5463b6b8 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:40.406264 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-8966d09f-d828-4883-b918-30af5463b6b8 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lazy-loading 'flavor' on Instance uuid 238b044c-ec15-4c03-88da-d90f9b1ec116 {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:20:40.717773 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8966d09f-d828-4883-b918-30af5463b6b8 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "POST /compute/v2.1/servers/238b044c-ec15-4c03-88da-d90f9b1ec116/action" status: 200 len: 32 microversion: 2.1 time: 0.441466 Aug 31 16:20:40.729994 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2468/4911] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:20:40 2022] POST /compute/v2.1/servers/238b044c-ec15-4c03-88da-d90f9b1ec116/action => generated 32 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 16:20:40.765730 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ee5c10e6-6d33-4959-a868-6cb7aa1474cf tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:40.778101 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ee5c10e6-6d33-4959-a868-6cb7aa1474cf tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: 238b044c-ec15-4c03-88da-d90f9b1ec116] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:40.852282 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ee5c10e6-6d33-4959-a868-6cb7aa1474cf tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:40.853134 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ee5c10e6-6d33-4959-a868-6cb7aa1474cf tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:40.858796 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ee5c10e6-6d33-4959-a868-6cb7aa1474cf tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:40.859828 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ee5c10e6-6d33-4959-a868-6cb7aa1474cf tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:40.860471 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ee5c10e6-6d33-4959-a868-6cb7aa1474cf tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:40.864539 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ee5c10e6-6d33-4959-a868-6cb7aa1474cf tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:41.422221 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5c3eba93-9474-48f8-a68a-68e7d672e616 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133688fe60724d979e0bbccf65a28b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f784a8f91774261843e5819cdc6058a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:41.448982 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5c3eba93-9474-48f8-a68a-68e7d672e616 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] 10.222.0.61 "GET /compute/v2.1/servers/41e57122-c82d-4f6d-af4f-fca28da61d70" status: 200 len: 1523 microversion: 2.1 time: 1.244793 Aug 31 16:20:41.451188 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2444/4912] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:40 2022] GET /compute/v2.1/servers/41e57122-c82d-4f6d-af4f-fca28da61d70 => generated 1523 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:41.489056 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-84acd69b-c05a-4df2-8a28-2442441c1073 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:41.504530 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-84acd69b-c05a-4df2-8a28-2442441c1073 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 2459bf91-9279-46ab-be03-9de04e8cb3f4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:41.545831 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:20:41.556890 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-84acd69b-c05a-4df2-8a28-2442441c1073 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:41.561890 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-84acd69b-c05a-4df2-8a28-2442441c1073 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:41.562726 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-84acd69b-c05a-4df2-8a28-2442441c1073 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:41.566665 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-84acd69b-c05a-4df2-8a28-2442441c1073 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:41.567453 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-84acd69b-c05a-4df2-8a28-2442441c1073 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:41.568366 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-84acd69b-c05a-4df2-8a28-2442441c1073 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:41.662884 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ee5c10e6-6d33-4959-a868-6cb7aa1474cf tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4744703b964435bbead751ca884d1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e014d4e4da5e47ff9a1261e7730034ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:41.684158 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ee5c10e6-6d33-4959-a868-6cb7aa1474cf tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/238b044c-ec15-4c03-88da-d90f9b1ec116" status: 200 len: 1523 microversion: 2.1 time: 0.946541 Aug 31 16:20:41.690206 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2469/4913] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:40 2022] GET /compute/v2.1/servers/238b044c-ec15-4c03-88da-d90f9b1ec116 => generated 1523 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:20:42.530407 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-84acd69b-c05a-4df2-8a28-2442441c1073 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:42.549709 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-84acd69b-c05a-4df2-8a28-2442441c1073 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/2459bf91-9279-46ab-be03-9de04e8cb3f4" status: 200 len: 1512 microversion: 2.1 time: 1.094595 Aug 31 16:20:42.555759 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2445/4914] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:41 2022] GET /compute/v2.1/servers/2459bf91-9279-46ab-be03-9de04e8cb3f4 => generated 1512 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:42.577390 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1c9e3132-2582-49d1-8594-be5204eba3d9 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:42.578293 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1c9e3132-2582-49d1-8594-be5204eba3d9 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] [instance: 41e57122-c82d-4f6d-af4f-fca28da61d70] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:42.602061 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1c9e3132-2582-49d1-8594-be5204eba3d9 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:42.602663 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1c9e3132-2582-49d1-8594-be5204eba3d9 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:42.603115 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1c9e3132-2582-49d1-8594-be5204eba3d9 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:42.618474 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1c9e3132-2582-49d1-8594-be5204eba3d9 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:42.620917 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1c9e3132-2582-49d1-8594-be5204eba3d9 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:42.627284 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1c9e3132-2582-49d1-8594-be5204eba3d9 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:42.867755 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-236b25c4-cd3b-49a6-9f87-9491cdff581f tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Action: 'create', calling method: .version_select at 0x7f5ae3cac5e0>, body: {"keypair": {"name": "tempest-keypair-595158291", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFLkt7sX2qslvQPdQi+qlPT610am/Efga7RYUbnmhhpukHa/aXyd7jewlwJr+DZBpfwvJIRzJPHxojh99LdDemE5OtFhuzz4xSPTBRKcGMzqoA1lizggyR73qQqJieIPsA=="}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:20:42.881580 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=64 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:20:42.902492 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-236b25c4-cd3b-49a6-9f87-9491cdff581f tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Getting quotas for project 1c81cbf4a36943d78740dec7e7e1b4d9. Resources: {'key_pairs'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:20:42.913043 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-236b25c4-cd3b-49a6-9f87-9491cdff581f tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Getting quotas for user 6ef5541e135d48348fbb4419b29417e7 and project 1c81cbf4a36943d78740dec7e7e1b4d9. Resources: {'key_pairs'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:20:42.978116 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-236b25c4-cd3b-49a6-9f87-9491cdff581f tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.506830 Aug 31 16:20:42.980317 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2470/4915] 10.222.0.61 () {62 vars in 1200 bytes} [Wed Aug 31 16:20:42 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 510 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 31 16:20:42.995719 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-058ead29-1476-40e7-98f9-537fd5ed2b0b tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:42.996686 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-058ead29-1476-40e7-98f9-537fd5ed2b0b tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: 238b044c-ec15-4c03-88da-d90f9b1ec116] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:43.010779 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-058ead29-1476-40e7-98f9-537fd5ed2b0b tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:43.013476 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-058ead29-1476-40e7-98f9-537fd5ed2b0b tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:43.013973 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-058ead29-1476-40e7-98f9-537fd5ed2b0b tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:43.014719 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-058ead29-1476-40e7-98f9-537fd5ed2b0b tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:43.015194 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-058ead29-1476-40e7-98f9-537fd5ed2b0b tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:43.019023 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-058ead29-1476-40e7-98f9-537fd5ed2b0b tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:43.843347 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-058ead29-1476-40e7-98f9-537fd5ed2b0b tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4744703b964435bbead751ca884d1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e014d4e4da5e47ff9a1261e7730034ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:43.873959 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-058ead29-1476-40e7-98f9-537fd5ed2b0b tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/238b044c-ec15-4c03-88da-d90f9b1ec116" status: 200 len: 1523 microversion: 2.1 time: 0.891947 Aug 31 16:20:43.880994 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1c9e3132-2582-49d1-8594-be5204eba3d9 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133688fe60724d979e0bbccf65a28b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f784a8f91774261843e5819cdc6058a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:43.900831 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2471/4916] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:42 2022] GET /compute/v2.1/servers/238b044c-ec15-4c03-88da-d90f9b1ec116 => generated 1523 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:43.911774 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-611ff685-e7d2-4c2e-82fb-723a6b188102 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:43.916687 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-611ff685-e7d2-4c2e-82fb-723a6b188102 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 2459bf91-9279-46ab-be03-9de04e8cb3f4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:43.933982 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1c9e3132-2582-49d1-8594-be5204eba3d9 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] 10.222.0.61 "GET /compute/v2.1/servers/41e57122-c82d-4f6d-af4f-fca28da61d70" status: 200 len: 1523 microversion: 2.1 time: 1.369509 Aug 31 16:20:43.934334 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-611ff685-e7d2-4c2e-82fb-723a6b188102 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:43.935525 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-611ff685-e7d2-4c2e-82fb-723a6b188102 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:43.936742 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2446/4917] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:42 2022] GET /compute/v2.1/servers/41e57122-c82d-4f6d-af4f-fca28da61d70 => generated 1523 bytes in 1380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:43.937670 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-611ff685-e7d2-4c2e-82fb-723a6b188102 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:43.938761 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-611ff685-e7d2-4c2e-82fb-723a6b188102 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:43.942211 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-611ff685-e7d2-4c2e-82fb-723a6b188102 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:43.943905 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-611ff685-e7d2-4c2e-82fb-723a6b188102 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:44.955762 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-855dfa81-ea04-4e9a-b364-b3f7958719db tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:44.956675 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-855dfa81-ea04-4e9a-b364-b3f7958719db tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: 238b044c-ec15-4c03-88da-d90f9b1ec116] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:44.965024 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-855dfa81-ea04-4e9a-b364-b3f7958719db tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:44.965534 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-855dfa81-ea04-4e9a-b364-b3f7958719db tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:44.966617 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-855dfa81-ea04-4e9a-b364-b3f7958719db tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:44.968530 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-855dfa81-ea04-4e9a-b364-b3f7958719db tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:44.969156 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-855dfa81-ea04-4e9a-b364-b3f7958719db tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:44.969763 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-855dfa81-ea04-4e9a-b364-b3f7958719db tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:45.148938 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-611ff685-e7d2-4c2e-82fb-723a6b188102 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:45.175238 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-611ff685-e7d2-4c2e-82fb-723a6b188102 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/2459bf91-9279-46ab-be03-9de04e8cb3f4" status: 200 len: 1512 microversion: 2.1 time: 1.273099 Aug 31 16:20:45.183068 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2472/4918] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:43 2022] GET /compute/v2.1/servers/2459bf91-9279-46ab-be03-9de04e8cb3f4 => generated 1512 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:45.203119 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-16084868-7ba4-404d-be6d-74b0bc5c0251 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:45.204260 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-16084868-7ba4-404d-be6d-74b0bc5c0251 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] [instance: 41e57122-c82d-4f6d-af4f-fca28da61d70] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:45.228980 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-16084868-7ba4-404d-be6d-74b0bc5c0251 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:45.229868 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-16084868-7ba4-404d-be6d-74b0bc5c0251 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:45.230739 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-16084868-7ba4-404d-be6d-74b0bc5c0251 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:45.231695 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-16084868-7ba4-404d-be6d-74b0bc5c0251 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:45.232397 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-16084868-7ba4-404d-be6d-74b0bc5c0251 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:45.233066 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-16084868-7ba4-404d-be6d-74b0bc5c0251 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:46.010843 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-16084868-7ba4-404d-be6d-74b0bc5c0251 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133688fe60724d979e0bbccf65a28b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f784a8f91774261843e5819cdc6058a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:46.029111 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-16084868-7ba4-404d-be6d-74b0bc5c0251 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] 10.222.0.61 "GET /compute/v2.1/servers/41e57122-c82d-4f6d-af4f-fca28da61d70" status: 200 len: 1523 microversion: 2.1 time: 0.840741 Aug 31 16:20:46.029716 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2473/4919] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:45 2022] GET /compute/v2.1/servers/41e57122-c82d-4f6d-af4f-fca28da61d70 => generated 1523 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:46.057901 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-855dfa81-ea04-4e9a-b364-b3f7958719db tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4744703b964435bbead751ca884d1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e014d4e4da5e47ff9a1261e7730034ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:46.073560 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-855dfa81-ea04-4e9a-b364-b3f7958719db tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/238b044c-ec15-4c03-88da-d90f9b1ec116" status: 200 len: 1523 microversion: 2.1 time: 1.155658 Aug 31 16:20:46.076248 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2447/4920] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:44 2022] GET /compute/v2.1/servers/238b044c-ec15-4c03-88da-d90f9b1ec116 => generated 1523 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:20:46.223862 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-43bc467d-3ddc-4819-b5f4-e55b553bf72f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:46.223862 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-43bc467d-3ddc-4819-b5f4-e55b553bf72f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 2459bf91-9279-46ab-be03-9de04e8cb3f4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:46.250226 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-43bc467d-3ddc-4819-b5f4-e55b553bf72f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:46.255017 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-43bc467d-3ddc-4819-b5f4-e55b553bf72f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:46.256282 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-43bc467d-3ddc-4819-b5f4-e55b553bf72f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:46.258070 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-43bc467d-3ddc-4819-b5f4-e55b553bf72f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:46.261146 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-43bc467d-3ddc-4819-b5f4-e55b553bf72f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:46.261879 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-43bc467d-3ddc-4819-b5f4-e55b553bf72f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:47.064640 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2dd92d43-27ea-4be2-91cb-3549d94554f0 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:47.065805 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2dd92d43-27ea-4be2-91cb-3549d94554f0 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] [instance: 41e57122-c82d-4f6d-af4f-fca28da61d70] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:47.084929 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2dd92d43-27ea-4be2-91cb-3549d94554f0 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:47.087048 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2dd92d43-27ea-4be2-91cb-3549d94554f0 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:47.088198 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2dd92d43-27ea-4be2-91cb-3549d94554f0 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:47.089312 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2dd92d43-27ea-4be2-91cb-3549d94554f0 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:47.089990 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2dd92d43-27ea-4be2-91cb-3549d94554f0 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:47.092073 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2dd92d43-27ea-4be2-91cb-3549d94554f0 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:47.220840 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-43bc467d-3ddc-4819-b5f4-e55b553bf72f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:47.240688 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-43bc467d-3ddc-4819-b5f4-e55b553bf72f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/2459bf91-9279-46ab-be03-9de04e8cb3f4" status: 200 len: 1512 microversion: 2.1 time: 1.025079 Aug 31 16:20:47.245327 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2474/4921] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:46 2022] GET /compute/v2.1/servers/2459bf91-9279-46ab-be03-9de04e8cb3f4 => generated 1512 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:47.272559 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f7af1de2-171c-44f0-b2e4-800edaffbe6b tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:47.277460 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f7af1de2-171c-44f0-b2e4-800edaffbe6b tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: 238b044c-ec15-4c03-88da-d90f9b1ec116] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:47.291563 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f7af1de2-171c-44f0-b2e4-800edaffbe6b tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:47.292293 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f7af1de2-171c-44f0-b2e4-800edaffbe6b tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:47.293035 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f7af1de2-171c-44f0-b2e4-800edaffbe6b tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:47.294217 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f7af1de2-171c-44f0-b2e4-800edaffbe6b tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:47.294989 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f7af1de2-171c-44f0-b2e4-800edaffbe6b tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:47.295732 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f7af1de2-171c-44f0-b2e4-800edaffbe6b tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:47.366830 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:20:48.233382 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f7af1de2-171c-44f0-b2e4-800edaffbe6b tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4744703b964435bbead751ca884d1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e014d4e4da5e47ff9a1261e7730034ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:48.247529 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f7af1de2-171c-44f0-b2e4-800edaffbe6b tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/238b044c-ec15-4c03-88da-d90f9b1ec116" status: 200 len: 1523 microversion: 2.1 time: 0.983856 Aug 31 16:20:48.248622 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2475/4922] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:47 2022] GET /compute/v2.1/servers/238b044c-ec15-4c03-88da-d90f9b1ec116 => generated 1523 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:48.279188 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-2dd92d43-27ea-4be2-91cb-3549d94554f0 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133688fe60724d979e0bbccf65a28b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f784a8f91774261843e5819cdc6058a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:48.315976 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3230a4ba-9187-40c7-abb8-dae924c7af3f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:48.317345 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3230a4ba-9187-40c7-abb8-dae924c7af3f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 2459bf91-9279-46ab-be03-9de04e8cb3f4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:48.326856 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3230a4ba-9187-40c7-abb8-dae924c7af3f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:48.327698 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3230a4ba-9187-40c7-abb8-dae924c7af3f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:48.340919 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3230a4ba-9187-40c7-abb8-dae924c7af3f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:48.342663 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3230a4ba-9187-40c7-abb8-dae924c7af3f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:48.343776 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3230a4ba-9187-40c7-abb8-dae924c7af3f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:48.344859 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3230a4ba-9187-40c7-abb8-dae924c7af3f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:48.351740 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2dd92d43-27ea-4be2-91cb-3549d94554f0 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] 10.222.0.61 "GET /compute/v2.1/servers/41e57122-c82d-4f6d-af4f-fca28da61d70" status: 200 len: 1523 microversion: 2.1 time: 1.291417 Aug 31 16:20:48.354675 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2448/4923] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:47 2022] GET /compute/v2.1/servers/41e57122-c82d-4f6d-af4f-fca28da61d70 => generated 1523 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:49.026991 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3230a4ba-9187-40c7-abb8-dae924c7af3f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:49.049051 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3230a4ba-9187-40c7-abb8-dae924c7af3f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/2459bf91-9279-46ab-be03-9de04e8cb3f4" status: 200 len: 1489 microversion: 2.1 time: 0.757478 Aug 31 16:20:49.050944 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2476/4924] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:48 2022] GET /compute/v2.1/servers/2459bf91-9279-46ab-be03-9de04e8cb3f4 => generated 1489 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:49.088157 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5ba53000-ac1d-4ec3-be72-6a7e0be4be56 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:20:49.091318 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5ba53000-ac1d-4ec3-be72-6a7e0be4be56 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:49.122345 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5ba53000-ac1d-4ec3-be72-6a7e0be4be56 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:49.123862 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5ba53000-ac1d-4ec3-be72-6a7e0be4be56 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:49.125252 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5ba53000-ac1d-4ec3-be72-6a7e0be4be56 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:49.126318 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5ba53000-ac1d-4ec3-be72-6a7e0be4be56 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:49.127091 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5ba53000-ac1d-4ec3-be72-6a7e0be4be56 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:49.127983 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5ba53000-ac1d-4ec3-be72-6a7e0be4be56 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:49.242525 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5ba53000-ac1d-4ec3-be72-6a7e0be4be56 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "POST /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c/action" status: 200 len: 185 microversion: 2.1 time: 0.163880 Aug 31 16:20:49.246742 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2449/4925] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:20:49 2022] POST /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c/action => generated 185 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:20:49.282979 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-354647ff-ad5d-4dd3-871b-2269c1373fd3 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:49.284824 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f2a952e1-3721-46e8-a9b1-6400b6dfe022 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:49.289924 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f2a952e1-3721-46e8-a9b1-6400b6dfe022 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:49.291729 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-354647ff-ad5d-4dd3-871b-2269c1373fd3 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: 238b044c-ec15-4c03-88da-d90f9b1ec116] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:49.315324 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f2a952e1-3721-46e8-a9b1-6400b6dfe022 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:49.316913 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-354647ff-ad5d-4dd3-871b-2269c1373fd3 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:49.317381 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f2a952e1-3721-46e8-a9b1-6400b6dfe022 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:49.318414 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-354647ff-ad5d-4dd3-871b-2269c1373fd3 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:49.319382 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f2a952e1-3721-46e8-a9b1-6400b6dfe022 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:49.323219 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f2a952e1-3721-46e8-a9b1-6400b6dfe022 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:49.323900 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-354647ff-ad5d-4dd3-871b-2269c1373fd3 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:49.324970 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f2a952e1-3721-46e8-a9b1-6400b6dfe022 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:49.326555 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-354647ff-ad5d-4dd3-871b-2269c1373fd3 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:49.327718 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f2a952e1-3721-46e8-a9b1-6400b6dfe022 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:49.328883 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-354647ff-ad5d-4dd3-871b-2269c1373fd3 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:49.332756 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-354647ff-ad5d-4dd3-871b-2269c1373fd3 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:49.830390 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f2a952e1-3721-46e8-a9b1-6400b6dfe022 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:49.844379 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f2a952e1-3721-46e8-a9b1-6400b6dfe022 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1668 microversion: 2.1 time: 0.587752 Aug 31 16:20:49.850365 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-354647ff-ad5d-4dd3-871b-2269c1373fd3 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4744703b964435bbead751ca884d1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e014d4e4da5e47ff9a1261e7730034ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:49.860571 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-354647ff-ad5d-4dd3-871b-2269c1373fd3 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/238b044c-ec15-4c03-88da-d90f9b1ec116" status: 200 len: 1523 microversion: 2.1 time: 0.583819 Aug 31 16:20:49.862000 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2477/4926] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:49 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1668 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:49.874324 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-322a4022-ea17-4b2d-9aae-93ea52cdcbcc tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:49.875068 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-322a4022-ea17-4b2d-9aae-93ea52cdcbcc tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] [instance: 41e57122-c82d-4f6d-af4f-fca28da61d70] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:49.879848 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2450/4927] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:49 2022] GET /compute/v2.1/servers/238b044c-ec15-4c03-88da-d90f9b1ec116 => generated 1523 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:49.882649 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-322a4022-ea17-4b2d-9aae-93ea52cdcbcc tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:49.883471 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-322a4022-ea17-4b2d-9aae-93ea52cdcbcc tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:49.884148 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-322a4022-ea17-4b2d-9aae-93ea52cdcbcc tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:49.884999 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-322a4022-ea17-4b2d-9aae-93ea52cdcbcc tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:49.885560 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-322a4022-ea17-4b2d-9aae-93ea52cdcbcc tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:49.886247 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-322a4022-ea17-4b2d-9aae-93ea52cdcbcc tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:49.893975 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c84de3eb-4a44-45ab-bb59-b446c0c7b8c4 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:49.894670 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c84de3eb-4a44-45ab-bb59-b446c0c7b8c4 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:49.910471 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c84de3eb-4a44-45ab-bb59-b446c0c7b8c4 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:49.910992 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c84de3eb-4a44-45ab-bb59-b446c0c7b8c4 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:49.911442 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c84de3eb-4a44-45ab-bb59-b446c0c7b8c4 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:49.912210 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c84de3eb-4a44-45ab-bb59-b446c0c7b8c4 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:49.912835 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c84de3eb-4a44-45ab-bb59-b446c0c7b8c4 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:49.913523 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c84de3eb-4a44-45ab-bb59-b446c0c7b8c4 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:49.974383 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:20:50.366028 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-322a4022-ea17-4b2d-9aae-93ea52cdcbcc tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133688fe60724d979e0bbccf65a28b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f784a8f91774261843e5819cdc6058a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:50.378117 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-322a4022-ea17-4b2d-9aae-93ea52cdcbcc tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] 10.222.0.61 "GET /compute/v2.1/servers/41e57122-c82d-4f6d-af4f-fca28da61d70" status: 200 len: 1503 microversion: 2.1 time: 0.513794 Aug 31 16:20:50.379861 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2478/4928] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:49 2022] GET /compute/v2.1/servers/41e57122-c82d-4f6d-af4f-fca28da61d70 => generated 1503 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:50.398857 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c84de3eb-4a44-45ab-bb59-b446c0c7b8c4 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:50.404592 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0c1a655e-f44b-43dd-a1ff-3455a85c6281 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Action: 'create', calling method: .version_select at 0x7f5ae3bbe5e0>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-938810892", "description": "tempest-description-780464909"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:20:50.410362 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c84de3eb-4a44-45ab-bb59-b446c0c7b8c4 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1668 microversion: 2.1 time: 0.529057 Aug 31 16:20:50.411207 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2451/4929] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:49 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1668 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:50.446916 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-00635582-2d8b-409c-9de5-bccae4d8b5a3 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:50.448232 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-00635582-2d8b-409c-9de5-bccae4d8b5a3 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:50.469235 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-00635582-2d8b-409c-9de5-bccae4d8b5a3 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:50.470771 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-00635582-2d8b-409c-9de5-bccae4d8b5a3 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:50.472274 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-00635582-2d8b-409c-9de5-bccae4d8b5a3 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:50.473778 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-00635582-2d8b-409c-9de5-bccae4d8b5a3 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:50.474598 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-00635582-2d8b-409c-9de5-bccae4d8b5a3 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:50.475492 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-00635582-2d8b-409c-9de5-bccae4d8b5a3 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:50.915785 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-00635582-2d8b-409c-9de5-bccae4d8b5a3 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:50.930412 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-00635582-2d8b-409c-9de5-bccae4d8b5a3 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1668 microversion: 2.1 time: 0.490708 Aug 31 16:20:50.941483 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2452/4930] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:50 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1668 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:20:50.952212 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-75d93b58-d29c-42de-a191-0e6fab316340 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:50.956369 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-75d93b58-d29c-42de-a191-0e6fab316340 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: 238b044c-ec15-4c03-88da-d90f9b1ec116] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:50.969462 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-75d93b58-d29c-42de-a191-0e6fab316340 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:50.970562 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-75d93b58-d29c-42de-a191-0e6fab316340 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:50.981734 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-75d93b58-d29c-42de-a191-0e6fab316340 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:50.982709 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-75d93b58-d29c-42de-a191-0e6fab316340 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:50.983215 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-75d93b58-d29c-42de-a191-0e6fab316340 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:50.983711 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-75d93b58-d29c-42de-a191-0e6fab316340 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:51.117621 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0c1a655e-f44b-43dd-a1ff-3455a85c6281 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] 10.222.0.61 "POST /compute/v2.1/os-security-groups" status: 200 len: 249 microversion: 2.1 time: 0.719917 Aug 31 16:20:51.119543 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2479/4931] 10.222.0.61 () {60 vars in 1180 bytes} [Wed Aug 31 16:20:50 2022] POST /compute/v2.1/os-security-groups => generated 249 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:20:51.125650 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d823a8fc-e10b-4561-ad11-411e82e1f2d7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:51.129520 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d823a8fc-e10b-4561-ad11-411e82e1f2d7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:51.146149 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d823a8fc-e10b-4561-ad11-411e82e1f2d7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:51.147279 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d823a8fc-e10b-4561-ad11-411e82e1f2d7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:51.148934 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d823a8fc-e10b-4561-ad11-411e82e1f2d7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:51.155640 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d823a8fc-e10b-4561-ad11-411e82e1f2d7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:51.158636 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d823a8fc-e10b-4561-ad11-411e82e1f2d7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:51.160728 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d823a8fc-e10b-4561-ad11-411e82e1f2d7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:51.592167 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-75d93b58-d29c-42de-a191-0e6fab316340 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4744703b964435bbead751ca884d1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e014d4e4da5e47ff9a1261e7730034ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:51.619971 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-75d93b58-d29c-42de-a191-0e6fab316340 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/238b044c-ec15-4c03-88da-d90f9b1ec116" status: 200 len: 1523 microversion: 2.1 time: 0.675717 Aug 31 16:20:51.622453 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2453/4932] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:50 2022] GET /compute/v2.1/servers/238b044c-ec15-4c03-88da-d90f9b1ec116 => generated 1523 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:51.630358 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a92a897c-5b09-4439-a4c5-a22899f9a944 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-938810892"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:20:51.631190 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a92a897c-5b09-4439-a4c5-a22899f9a944 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] [instance: 41e57122-c82d-4f6d-af4f-fca28da61d70] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:51.658010 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a92a897c-5b09-4439-a4c5-a22899f9a944 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:51.658969 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a92a897c-5b09-4439-a4c5-a22899f9a944 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:51.661094 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a92a897c-5b09-4439-a4c5-a22899f9a944 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:51.663837 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a92a897c-5b09-4439-a4c5-a22899f9a944 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:51.665033 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a92a897c-5b09-4439-a4c5-a22899f9a944 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:51.667158 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a92a897c-5b09-4439-a4c5-a22899f9a944 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:51.755362 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d823a8fc-e10b-4561-ad11-411e82e1f2d7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:51.765170 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d823a8fc-e10b-4561-ad11-411e82e1f2d7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1668 microversion: 2.1 time: 0.643980 Aug 31 16:20:51.788025 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2480/4933] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:51 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1668 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:51.941904 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6e7af7f6-f76f-4c68-aa53-ce2dcc409745 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1451907014", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bf979fdf-6d8e-4f7d-940c-521a4ddcf886"}], "security_groups": [{"name": "tempest-securitygroup--1189923078"}], "key_name": "tempest-keypair-595158291", "user_data": "}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:20:52.435407 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.network.security_group_api [None req-a92a897c-5b09-4439-a4c5-a22899f9a944 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Adding security group f47fd7a8-d105-4256-ad9c-cb2a1b50d2d4 to port aa5919c1-b206-4c36-9030-7581ac0cc0e8 Aug 31 16:20:52.566549 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-6e7af7f6-f76f-4c68-aa53-ce2dcc409745 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] validate_networks() for [('bf979fdf-6d8e-4f7d-940c-521a4ddcf886', None, None, None, None, None)] {{(pid=122257) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:20:52.927989 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=4 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:20:53.856331 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a92a897c-5b09-4439-a4c5-a22899f9a944 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] 10.222.0.61 "POST /compute/v2.1/servers/41e57122-c82d-4f6d-af4f-fca28da61d70/action" status: 202 len: 0 microversion: 2.1 time: 2.231790 Aug 31 16:20:53.859745 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2454/4934] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:20:51 2022] POST /compute/v2.1/servers/41e57122-c82d-4f6d-af4f-fca28da61d70/action => generated 0 bytes in 2234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:20:53.873507 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-abe2c4a2-7738-48fa-ad1c-528b8f3279ef tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-553221931", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "networks": [{"uuid": "41cc840d-a352-47ac-85b3-b767061353cc"}]}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:20:54.065181 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-abe2c4a2-7738-48fa-ad1c-528b8f3279ef tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] validate_networks() for [('41cc840d-a352-47ac-85b3-b767061353cc', None, None, None, None, None)] {{(pid=122256) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:20:54.410081 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-6e7af7f6-f76f-4c68-aa53-ce2dcc409745 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:20:54.410992 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-6e7af7f6-f76f-4c68-aa53-ce2dcc409745 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:20:54.411931 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-6e7af7f6-f76f-4c68-aa53-ce2dcc409745 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:20:54.412699 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-6e7af7f6-f76f-4c68-aa53-ce2dcc409745 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:20:54.414368 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-6e7af7f6-f76f-4c68-aa53-ce2dcc409745 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:20:54.458716 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6e7af7f6-f76f-4c68-aa53-ce2dcc409745 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:54.460567 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6e7af7f6-f76f-4c68-aa53-ce2dcc409745 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:54.466235 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6e7af7f6-f76f-4c68-aa53-ce2dcc409745 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:54.467931 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6e7af7f6-f76f-4c68-aa53-ce2dcc409745 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:54.469064 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6e7af7f6-f76f-4c68-aa53-ce2dcc409745 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:54.472831 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6e7af7f6-f76f-4c68-aa53-ce2dcc409745 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:54.536769 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-6e7af7f6-f76f-4c68-aa53-ce2dcc409745 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Getting quotas for project 1c81cbf4a36943d78740dec7e7e1b4d9. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:20:54.549263 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-6e7af7f6-f76f-4c68-aa53-ce2dcc409745 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Getting quotas for user 6ef5541e135d48348fbb4419b29417e7 and project 1c81cbf4a36943d78740dec7e7e1b4d9. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:20:54.572376 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6e7af7f6-f76f-4c68-aa53-ce2dcc409745 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Going to run 1 instances... {{(pid=122257) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:20:54.575530 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6e7af7f6-f76f-4c68-aa53-ce2dcc409745 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:20:54.693103 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6e7af7f6-f76f-4c68-aa53-ce2dcc409745 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.756221 Aug 31 16:20:54.696897 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2481/4935] 10.222.0.61 () {62 vars in 1188 bytes} [Wed Aug 31 16:20:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 2761 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 31 16:20:54.724061 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b6e830f8-8c41-4ea7-9eaf-05ccc29203d2 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:54.730209 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b6e830f8-8c41-4ea7-9eaf-05ccc29203d2 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] [instance: cca485b3-25f2-4a77-a23a-bb9758586ce7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:54.760454 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b6e830f8-8c41-4ea7-9eaf-05ccc29203d2 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:54.762075 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b6e830f8-8c41-4ea7-9eaf-05ccc29203d2 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:54.763825 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b6e830f8-8c41-4ea7-9eaf-05ccc29203d2 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:54.776607 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b6e830f8-8c41-4ea7-9eaf-05ccc29203d2 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:54.777296 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b6e830f8-8c41-4ea7-9eaf-05ccc29203d2 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:54.778447 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b6e830f8-8c41-4ea7-9eaf-05ccc29203d2 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:54.891490 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b6e830f8-8c41-4ea7-9eaf-05ccc29203d2 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] 10.222.0.61 "GET /compute/v2.1/servers/cca485b3-25f2-4a77-a23a-bb9758586ce7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.190376 Aug 31 16:20:54.901585 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2482/4936] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 16:20:54 2022] GET /compute/v2.1/servers/cca485b3-25f2-4a77-a23a-bb9758586ce7/os-volume_attachments => generated 197 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:20:54.916217 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f17ba827-4a06-4daf-9b7d-28bfc2ffa1de tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:54.918000 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f17ba827-4a06-4daf-9b7d-28bfc2ffa1de tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: 238b044c-ec15-4c03-88da-d90f9b1ec116] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:54.927975 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f17ba827-4a06-4daf-9b7d-28bfc2ffa1de tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:54.928605 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f17ba827-4a06-4daf-9b7d-28bfc2ffa1de tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:54.929316 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f17ba827-4a06-4daf-9b7d-28bfc2ffa1de tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:54.930356 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f17ba827-4a06-4daf-9b7d-28bfc2ffa1de tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:54.931682 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f17ba827-4a06-4daf-9b7d-28bfc2ffa1de tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:54.932248 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f17ba827-4a06-4daf-9b7d-28bfc2ffa1de tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:55.299753 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f17ba827-4a06-4daf-9b7d-28bfc2ffa1de tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4744703b964435bbead751ca884d1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e014d4e4da5e47ff9a1261e7730034ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:55.332326 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f17ba827-4a06-4daf-9b7d-28bfc2ffa1de tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/238b044c-ec15-4c03-88da-d90f9b1ec116" status: 200 len: 1523 microversion: 2.1 time: 0.421182 Aug 31 16:20:55.334025 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2483/4937] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:54 2022] GET /compute/v2.1/servers/238b044c-ec15-4c03-88da-d90f9b1ec116 => generated 1523 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:55.359627 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0d425e0f-dde1-44b6-8ab4-c2ec6291bd58 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-938810892"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:20:55.360328 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0d425e0f-dde1-44b6-8ab4-c2ec6291bd58 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] [instance: 41e57122-c82d-4f6d-af4f-fca28da61d70] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:55.396032 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0d425e0f-dde1-44b6-8ab4-c2ec6291bd58 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:55.396748 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0d425e0f-dde1-44b6-8ab4-c2ec6291bd58 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:55.397939 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0d425e0f-dde1-44b6-8ab4-c2ec6291bd58 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:55.399005 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0d425e0f-dde1-44b6-8ab4-c2ec6291bd58 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:55.418500 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0d425e0f-dde1-44b6-8ab4-c2ec6291bd58 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:55.419344 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0d425e0f-dde1-44b6-8ab4-c2ec6291bd58 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:55.654715 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-abe2c4a2-7738-48fa-ad1c-528b8f3279ef tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:20:55.655228 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-abe2c4a2-7738-48fa-ad1c-528b8f3279ef tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:20:55.664829 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-abe2c4a2-7738-48fa-ad1c-528b8f3279ef tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:20:55.665380 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-abe2c4a2-7738-48fa-ad1c-528b8f3279ef tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:20:55.665816 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-abe2c4a2-7738-48fa-ad1c-528b8f3279ef tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:20:55.693858 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-abe2c4a2-7738-48fa-ad1c-528b8f3279ef tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:55.694916 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-abe2c4a2-7738-48fa-ad1c-528b8f3279ef tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:55.697720 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-abe2c4a2-7738-48fa-ad1c-528b8f3279ef tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:55.698714 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-abe2c4a2-7738-48fa-ad1c-528b8f3279ef tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:55.700944 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-abe2c4a2-7738-48fa-ad1c-528b8f3279ef tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:55.702309 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-abe2c4a2-7738-48fa-ad1c-528b8f3279ef tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:55.765962 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-abe2c4a2-7738-48fa-ad1c-528b8f3279ef tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Getting quotas for project f8fa87d9431f4253b8425593a2150359. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:20:55.785056 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-abe2c4a2-7738-48fa-ad1c-528b8f3279ef tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Getting quotas for user a105ab564f304fa7a2ceba07418a22bc and project f8fa87d9431f4253b8425593a2150359. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:20:55.825971 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-abe2c4a2-7738-48fa-ad1c-528b8f3279ef tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Going to run 1 instances... {{(pid=122256) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:20:55.831238 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-abe2c4a2-7738-48fa-ad1c-528b8f3279ef tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: ef42ce7c-829a-47f8-8d9f-68eac68ec20b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:20:55.921538 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.network.security_group_api [None req-0d425e0f-dde1-44b6-8ab4-c2ec6291bd58 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Removing security group f47fd7a8-d105-4256-ad9c-cb2a1b50d2d4 from port aa5919c1-b206-4c36-9030-7581ac0cc0e8 Aug 31 16:20:56.010566 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-abe2c4a2-7738-48fa-ad1c-528b8f3279ef tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.150598 Aug 31 16:20:56.028081 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2455/4938] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:20:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 2170 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:20:56.038787 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-85770fcb-aaeb-422e-923a-06b7d69a403b req-c5616a09-1bbb-40ec-8310-1b6e0b0d8731 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41e57122-c82d-4f6d-af4f-fca28da61d70", "tag": "aa5919c1-b206-4c36-9030-7581ac0cc0e8"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:20:56.093054 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-85770fcb-aaeb-422e-923a-06b7d69a403b req-c5616a09-1bbb-40ec-8310-1b6e0b0d8731 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:56.093657 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-85770fcb-aaeb-422e-923a-06b7d69a403b req-c5616a09-1bbb-40ec-8310-1b6e0b0d8731 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:56.094233 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-85770fcb-aaeb-422e-923a-06b7d69a403b req-c5616a09-1bbb-40ec-8310-1b6e0b0d8731 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:56.138856 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-85770fcb-aaeb-422e-923a-06b7d69a403b req-c5616a09-1bbb-40ec-8310-1b6e0b0d8731 service nova] Creating event network-changed:aa5919c1-b206-4c36-9030-7581ac0cc0e8 for instance 41e57122-c82d-4f6d-af4f-fca28da61d70 on n-h2-850499-9 Aug 31 16:20:56.162613 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-85770fcb-aaeb-422e-923a-06b7d69a403b req-c5616a09-1bbb-40ec-8310-1b6e0b0d8731 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133093 Aug 31 16:20:56.163897 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2456/4939] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:20:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:20:56.188497 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0ce39843-1c48-4867-bdea-6e7f389ae84b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:56.189213 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0ce39843-1c48-4867-bdea-6e7f389ae84b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:56.208153 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0ce39843-1c48-4867-bdea-6e7f389ae84b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:56.209295 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0ce39843-1c48-4867-bdea-6e7f389ae84b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:56.211743 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0ce39843-1c48-4867-bdea-6e7f389ae84b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:56.213645 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0ce39843-1c48-4867-bdea-6e7f389ae84b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:56.217563 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0ce39843-1c48-4867-bdea-6e7f389ae84b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:56.218298 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0ce39843-1c48-4867-bdea-6e7f389ae84b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:56.583789 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-0ce39843-1c48-4867-bdea-6e7f389ae84b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:56.597613 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-0ce39843-1c48-4867-bdea-6e7f389ae84b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:56.605027 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-0ce39843-1c48-4867-bdea-6e7f389ae84b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:56.606219 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0ce39843-1c48-4867-bdea-6e7f389ae84b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5" status: 200 len: 1277 microversion: 2.20 time: 0.441217 Aug 31 16:20:56.606787 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2457/4940] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:20:56 2022] GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5 => generated 1277 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:20:56.622697 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-704c5720-6084-4689-b66c-445122e6d688 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:56.623735 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-704c5720-6084-4689-b66c-445122e6d688 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] [instance: cca485b3-25f2-4a77-a23a-bb9758586ce7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:56.644156 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-704c5720-6084-4689-b66c-445122e6d688 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:56.644721 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-704c5720-6084-4689-b66c-445122e6d688 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:56.645186 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-704c5720-6084-4689-b66c-445122e6d688 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:56.646039 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-704c5720-6084-4689-b66c-445122e6d688 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:56.646488 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-704c5720-6084-4689-b66c-445122e6d688 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:56.646995 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-704c5720-6084-4689-b66c-445122e6d688 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:56.726198 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-704c5720-6084-4689-b66c-445122e6d688 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] 10.222.0.61 "GET /compute/v2.1/servers/cca485b3-25f2-4a77-a23a-bb9758586ce7/os-volume_attachments/bbabe112-a1f7-415e-822a-7a959b48657c" status: 200 len: 194 microversion: 2.1 time: 0.114237 Aug 31 16:20:56.732904 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2458/4941] 10.222.0.61 () {58 vars in 1413 bytes} [Wed Aug 31 16:20:56 2022] GET /compute/v2.1/servers/cca485b3-25f2-4a77-a23a-bb9758586ce7/os-volume_attachments/bbabe112-a1f7-415e-822a-7a959b48657c => generated 194 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:20:56.739054 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7763fdc0-9ca0-4356-a15c-676cae1ce57e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:56.739982 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7763fdc0-9ca0-4356-a15c-676cae1ce57e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: ef42ce7c-829a-47f8-8d9f-68eac68ec20b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:56.884785 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7763fdc0-9ca0-4356-a15c-676cae1ce57e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:56.906879 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7763fdc0-9ca0-4356-a15c-676cae1ce57e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/ef42ce7c-829a-47f8-8d9f-68eac68ec20b" status: 200 len: 1214 microversion: 2.1 time: 0.172487 Aug 31 16:20:56.923611 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2459/4942] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:56 2022] GET /compute/v2.1/servers/ef42ce7c-829a-47f8-8d9f-68eac68ec20b => generated 1214 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:56.944124 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ae551cf1-3b5e-42a1-a6e9-027076d67355 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:56.945568 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ae551cf1-3b5e-42a1-a6e9-027076d67355 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: 238b044c-ec15-4c03-88da-d90f9b1ec116] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:56.970188 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ae551cf1-3b5e-42a1-a6e9-027076d67355 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:56.970859 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ae551cf1-3b5e-42a1-a6e9-027076d67355 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:56.971472 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ae551cf1-3b5e-42a1-a6e9-027076d67355 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:56.972509 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ae551cf1-3b5e-42a1-a6e9-027076d67355 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:56.973748 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ae551cf1-3b5e-42a1-a6e9-027076d67355 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:56.974773 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ae551cf1-3b5e-42a1-a6e9-027076d67355 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:58.357855 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0d425e0f-dde1-44b6-8ab4-c2ec6291bd58 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] 10.222.0.61 "POST /compute/v2.1/servers/41e57122-c82d-4f6d-af4f-fca28da61d70/action" status: 202 len: 0 microversion: 2.1 time: 3.022587 Aug 31 16:20:58.364849 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2484/4943] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:20:55 2022] POST /compute/v2.1/servers/41e57122-c82d-4f6d-af4f-fca28da61d70/action => generated 0 bytes in 3030 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:20:58.381228 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-29b315a5-df93-4e90-a738-2366e845d8a8 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:58.385477 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-29b315a5-df93-4e90-a738-2366e845d8a8 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:58.433708 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-29b315a5-df93-4e90-a738-2366e845d8a8 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:58.436830 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-29b315a5-df93-4e90-a738-2366e845d8a8 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:58.438947 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-29b315a5-df93-4e90-a738-2366e845d8a8 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:58.443724 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-29b315a5-df93-4e90-a738-2366e845d8a8 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:58.447347 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-29b315a5-df93-4e90-a738-2366e845d8a8 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:58.448326 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-29b315a5-df93-4e90-a738-2366e845d8a8 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:58.562761 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ae551cf1-3b5e-42a1-a6e9-027076d67355 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4744703b964435bbead751ca884d1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e014d4e4da5e47ff9a1261e7730034ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:58.575663 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ae551cf1-3b5e-42a1-a6e9-027076d67355 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/238b044c-ec15-4c03-88da-d90f9b1ec116" status: 200 len: 1523 microversion: 2.1 time: 1.663574 Aug 31 16:20:58.576727 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2460/4944] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:56 2022] GET /compute/v2.1/servers/238b044c-ec15-4c03-88da-d90f9b1ec116 => generated 1523 bytes in 1665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:58.581918 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-86689f8f-404b-4a40-a74c-fb90b9285df6 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:58.582734 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-86689f8f-404b-4a40-a74c-fb90b9285df6 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: ef42ce7c-829a-47f8-8d9f-68eac68ec20b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:58.590287 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-86689f8f-404b-4a40-a74c-fb90b9285df6 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:58.591085 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-86689f8f-404b-4a40-a74c-fb90b9285df6 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:58.591858 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-86689f8f-404b-4a40-a74c-fb90b9285df6 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:58.592827 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-86689f8f-404b-4a40-a74c-fb90b9285df6 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:58.594148 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-86689f8f-404b-4a40-a74c-fb90b9285df6 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:58.594768 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-86689f8f-404b-4a40-a74c-fb90b9285df6 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:58.757320 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-29b315a5-df93-4e90-a738-2366e845d8a8 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:58.766925 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-29b315a5-df93-4e90-a738-2366e845d8a8 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:58.776671 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-29b315a5-df93-4e90-a738-2366e845d8a8 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:58.778105 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-29b315a5-df93-4e90-a738-2366e845d8a8 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5" status: 200 len: 1339 microversion: 2.20 time: 0.412124 Aug 31 16:20:58.778878 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2485/4945] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:20:58 2022] GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5 => generated 1339 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:20:58.787677 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e59ffd60-ae7b-49f6-a972-199f1cd1e91a tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Action: 'create', calling method: .version_select at 0x7f5ae8d12a60>, body: {"pool": null} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:20:58.838896 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-86689f8f-404b-4a40-a74c-fb90b9285df6 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:58.854450 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-86689f8f-404b-4a40-a74c-fb90b9285df6 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/ef42ce7c-829a-47f8-8d9f-68eac68ec20b" status: 200 len: 1284 microversion: 2.1 time: 0.276264 Aug 31 16:20:58.870343 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2461/4946] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:58 2022] GET /compute/v2.1/servers/ef42ce7c-829a-47f8-8d9f-68eac68ec20b => generated 1284 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:58.875453 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-3c4fa1da-0c5d-47c0-b3cc-c3af1e27610b req-741ecb80-c9b7-4b1d-94ce-7de538adc7a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41e57122-c82d-4f6d-af4f-fca28da61d70", "tag": "aa5919c1-b206-4c36-9030-7581ac0cc0e8"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:20:58.894164 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-3c4fa1da-0c5d-47c0-b3cc-c3af1e27610b req-741ecb80-c9b7-4b1d-94ce-7de538adc7a1 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:58.894649 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-3c4fa1da-0c5d-47c0-b3cc-c3af1e27610b req-741ecb80-c9b7-4b1d-94ce-7de538adc7a1 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:58.895084 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-3c4fa1da-0c5d-47c0-b3cc-c3af1e27610b req-741ecb80-c9b7-4b1d-94ce-7de538adc7a1 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:58.930223 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-3c4fa1da-0c5d-47c0-b3cc-c3af1e27610b req-741ecb80-c9b7-4b1d-94ce-7de538adc7a1 service nova] Creating event network-changed:aa5919c1-b206-4c36-9030-7581ac0cc0e8 for instance 41e57122-c82d-4f6d-af4f-fca28da61d70 on n-h2-850499-9 Aug 31 16:20:58.942724 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-3c4fa1da-0c5d-47c0-b3cc-c3af1e27610b req-741ecb80-c9b7-4b1d-94ce-7de538adc7a1 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070667 Aug 31 16:20:58.943640 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2462/4947] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:20:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:20:59.605345 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-71fcc84e-056e-4ae6-961e-083a84b29020 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e419b10e-7f7a-4171-a02b-aedda98107c8"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:20:59.608826 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-71fcc84e-056e-4ae6-961e-083a84b29020 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] [instance: cca485b3-25f2-4a77-a23a-bb9758586ce7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:59.615792 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-71fcc84e-056e-4ae6-961e-083a84b29020 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:59.616800 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-71fcc84e-056e-4ae6-961e-083a84b29020 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:59.617419 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-71fcc84e-056e-4ae6-961e-083a84b29020 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:59.618484 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-71fcc84e-056e-4ae6-961e-083a84b29020 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:59.618935 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-71fcc84e-056e-4ae6-961e-083a84b29020 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:59.619550 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-71fcc84e-056e-4ae6-961e-083a84b29020 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:00.087489 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-71fcc84e-056e-4ae6-961e-083a84b29020 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] 10.222.0.61 "POST /compute/v2.1/servers/cca485b3-25f2-4a77-a23a-bb9758586ce7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.486059 Aug 31 16:21:00.115697 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2463/4948] 10.222.0.61 () {60 vars in 1323 bytes} [Wed Aug 31 16:20:59 2022] POST /compute/v2.1/servers/cca485b3-25f2-4a77-a23a-bb9758586ce7/os-volume_attachments => generated 194 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:21:00.153956 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-bfe4a48f-5f8c-4839-8e2c-7f7bd7ffdd9a tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:00.158574 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-bfe4a48f-5f8c-4839-8e2c-7f7bd7ffdd9a tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: 238b044c-ec15-4c03-88da-d90f9b1ec116] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:00.177679 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bfe4a48f-5f8c-4839-8e2c-7f7bd7ffdd9a tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:00.178929 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bfe4a48f-5f8c-4839-8e2c-7f7bd7ffdd9a tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:00.185803 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bfe4a48f-5f8c-4839-8e2c-7f7bd7ffdd9a tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:00.202498 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bfe4a48f-5f8c-4839-8e2c-7f7bd7ffdd9a tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:00.204393 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bfe4a48f-5f8c-4839-8e2c-7f7bd7ffdd9a tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:00.205128 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bfe4a48f-5f8c-4839-8e2c-7f7bd7ffdd9a tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:00.860639 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-bfe4a48f-5f8c-4839-8e2c-7f7bd7ffdd9a tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4744703b964435bbead751ca884d1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e014d4e4da5e47ff9a1261e7730034ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:00.877096 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-bfe4a48f-5f8c-4839-8e2c-7f7bd7ffdd9a tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/238b044c-ec15-4c03-88da-d90f9b1ec116" status: 200 len: 1523 microversion: 2.1 time: 0.756279 Aug 31 16:21:00.878245 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2464/4949] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:21:00 2022] GET /compute/v2.1/servers/238b044c-ec15-4c03-88da-d90f9b1ec116 => generated 1523 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:21:00.912770 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a31e4d44-e12a-4740-9344-dddd4127b182 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:00.915357 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a31e4d44-e12a-4740-9344-dddd4127b182 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:00.929295 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a31e4d44-e12a-4740-9344-dddd4127b182 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:00.930977 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a31e4d44-e12a-4740-9344-dddd4127b182 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:00.932594 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a31e4d44-e12a-4740-9344-dddd4127b182 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:00.934878 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a31e4d44-e12a-4740-9344-dddd4127b182 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:00.935401 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a31e4d44-e12a-4740-9344-dddd4127b182 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:00.937041 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a31e4d44-e12a-4740-9344-dddd4127b182 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:01.173837 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a31e4d44-e12a-4740-9344-dddd4127b182 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:01.206868 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a31e4d44-e12a-4740-9344-dddd4127b182 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:01.210488 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a31e4d44-e12a-4740-9344-dddd4127b182 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:01.222015 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a31e4d44-e12a-4740-9344-dddd4127b182 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5" status: 200 len: 1339 microversion: 2.20 time: 0.316092 Aug 31 16:21:01.233950 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2465/4950] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:21:00 2022] GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5 => generated 1339 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:21:01.241624 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3022e18a-187a-402d-8063-c9dab7398b7e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:01.241943 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3022e18a-187a-402d-8063-c9dab7398b7e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: ef42ce7c-829a-47f8-8d9f-68eac68ec20b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:01.257101 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3022e18a-187a-402d-8063-c9dab7398b7e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:01.257101 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3022e18a-187a-402d-8063-c9dab7398b7e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:01.257528 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3022e18a-187a-402d-8063-c9dab7398b7e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:01.262029 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3022e18a-187a-402d-8063-c9dab7398b7e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:01.262683 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3022e18a-187a-402d-8063-c9dab7398b7e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:01.263149 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3022e18a-187a-402d-8063-c9dab7398b7e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:02.280787 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3022e18a-187a-402d-8063-c9dab7398b7e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:02.311664 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3022e18a-187a-402d-8063-c9dab7398b7e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/ef42ce7c-829a-47f8-8d9f-68eac68ec20b" status: 200 len: 1314 microversion: 2.1 time: 1.072279 Aug 31 16:21:02.326291 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2466/4951] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:21:01 2022] GET /compute/v2.1/servers/ef42ce7c-829a-47f8-8d9f-68eac68ec20b => generated 1314 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:21:02.343166 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-98623f41-a8bb-419a-81a8-dbedadb39bea tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:02.344320 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-98623f41-a8bb-419a-81a8-dbedadb39bea tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: 238b044c-ec15-4c03-88da-d90f9b1ec116] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:02.354059 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-98623f41-a8bb-419a-81a8-dbedadb39bea tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:02.354849 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-98623f41-a8bb-419a-81a8-dbedadb39bea tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:02.355408 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-98623f41-a8bb-419a-81a8-dbedadb39bea tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:02.356283 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-98623f41-a8bb-419a-81a8-dbedadb39bea tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:02.362159 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-98623f41-a8bb-419a-81a8-dbedadb39bea tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:02.362792 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-98623f41-a8bb-419a-81a8-dbedadb39bea tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:02.825344 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-98623f41-a8bb-419a-81a8-dbedadb39bea tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4744703b964435bbead751ca884d1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e014d4e4da5e47ff9a1261e7730034ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:02.836298 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-98623f41-a8bb-419a-81a8-dbedadb39bea tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/238b044c-ec15-4c03-88da-d90f9b1ec116" status: 200 len: 1523 microversion: 2.1 time: 0.508631 Aug 31 16:21:02.837838 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2467/4952] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:21:02 2022] GET /compute/v2.1/servers/238b044c-ec15-4c03-88da-d90f9b1ec116 => generated 1523 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:21:02.843794 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-10166372-a5ca-43b7-b27d-9591485fd68b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:02.844846 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-10166372-a5ca-43b7-b27d-9591485fd68b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:02.862581 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-10166372-a5ca-43b7-b27d-9591485fd68b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:02.864817 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-10166372-a5ca-43b7-b27d-9591485fd68b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:02.866708 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-10166372-a5ca-43b7-b27d-9591485fd68b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:02.868015 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-10166372-a5ca-43b7-b27d-9591485fd68b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:02.869031 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-10166372-a5ca-43b7-b27d-9591485fd68b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:02.869740 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-10166372-a5ca-43b7-b27d-9591485fd68b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:03.344339 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-10166372-a5ca-43b7-b27d-9591485fd68b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:03.363488 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-10166372-a5ca-43b7-b27d-9591485fd68b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:03.365631 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-10166372-a5ca-43b7-b27d-9591485fd68b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:03.380454 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-10166372-a5ca-43b7-b27d-9591485fd68b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5" status: 200 len: 1407 microversion: 2.20 time: 0.528627 Aug 31 16:21:03.381535 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2468/4953] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:21:02 2022] GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5 => generated 1407 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:21:03.387273 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-881b63f8-0f3c-45fd-8aef-2c181499eb58 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:03.388270 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-881b63f8-0f3c-45fd-8aef-2c181499eb58 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: ef42ce7c-829a-47f8-8d9f-68eac68ec20b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:03.401318 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-881b63f8-0f3c-45fd-8aef-2c181499eb58 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:03.404198 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-881b63f8-0f3c-45fd-8aef-2c181499eb58 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:03.410471 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-881b63f8-0f3c-45fd-8aef-2c181499eb58 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:03.411459 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-881b63f8-0f3c-45fd-8aef-2c181499eb58 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:03.412350 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-881b63f8-0f3c-45fd-8aef-2c181499eb58 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:03.413079 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-881b63f8-0f3c-45fd-8aef-2c181499eb58 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:04.019885 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-881b63f8-0f3c-45fd-8aef-2c181499eb58 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:04.032790 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-881b63f8-0f3c-45fd-8aef-2c181499eb58 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/ef42ce7c-829a-47f8-8d9f-68eac68ec20b" status: 200 len: 1314 microversion: 2.1 time: 0.649889 Aug 31 16:21:04.035138 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2469/4954] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:21:03 2022] GET /compute/v2.1/servers/ef42ce7c-829a-47f8-8d9f-68eac68ec20b => generated 1314 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:21:04.044201 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f12de8d5-74a9-44f1-b9ab-bd06403d4c07 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:04.045156 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f12de8d5-74a9-44f1-b9ab-bd06403d4c07 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: 238b044c-ec15-4c03-88da-d90f9b1ec116] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:04.054801 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f12de8d5-74a9-44f1-b9ab-bd06403d4c07 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:04.058002 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f12de8d5-74a9-44f1-b9ab-bd06403d4c07 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:04.061769 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f12de8d5-74a9-44f1-b9ab-bd06403d4c07 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:04.064552 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f12de8d5-74a9-44f1-b9ab-bd06403d4c07 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:04.065283 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f12de8d5-74a9-44f1-b9ab-bd06403d4c07 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:04.068197 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f12de8d5-74a9-44f1-b9ab-bd06403d4c07 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:04.080699 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:21:04.381848 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f12de8d5-74a9-44f1-b9ab-bd06403d4c07 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4744703b964435bbead751ca884d1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e014d4e4da5e47ff9a1261e7730034ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:04.418092 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f12de8d5-74a9-44f1-b9ab-bd06403d4c07 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/238b044c-ec15-4c03-88da-d90f9b1ec116" status: 200 len: 1503 microversion: 2.1 time: 0.381539 Aug 31 16:21:04.419014 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2470/4955] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:21:04 2022] GET /compute/v2.1/servers/238b044c-ec15-4c03-88da-d90f9b1ec116 => generated 1503 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:21:04.424116 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f5246065-1c5f-433f-a260-64a1d6562b43 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:04.424731 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f5246065-1c5f-433f-a260-64a1d6562b43 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:04.442442 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f5246065-1c5f-433f-a260-64a1d6562b43 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:04.442951 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f5246065-1c5f-433f-a260-64a1d6562b43 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:04.443397 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f5246065-1c5f-433f-a260-64a1d6562b43 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:04.444189 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f5246065-1c5f-433f-a260-64a1d6562b43 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:04.444657 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f5246065-1c5f-433f-a260-64a1d6562b43 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:04.445221 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f5246065-1c5f-433f-a260-64a1d6562b43 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:04.519552 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:21:04.559948 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=6 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:21:04.762218 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e59ffd60-ae7b-49f6-a972-199f1cd1e91a tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] 10.222.0.61 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 5.982010 Aug 31 16:21:04.771367 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2486/4956] 10.222.0.61 () {60 vars in 1170 bytes} [Wed Aug 31 16:20:58 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 5992 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:21:04.779256 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ce5f9cfe-0cb8-4999-b222-44cad02b5946 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:04.780175 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ce5f9cfe-0cb8-4999-b222-44cad02b5946 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: ffc6f828-c8ec-4fd6-b69e-9c0230692009] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:04.806666 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ce5f9cfe-0cb8-4999-b222-44cad02b5946 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:04.808114 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ce5f9cfe-0cb8-4999-b222-44cad02b5946 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:04.808722 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ce5f9cfe-0cb8-4999-b222-44cad02b5946 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:04.812749 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ce5f9cfe-0cb8-4999-b222-44cad02b5946 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:04.814529 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ce5f9cfe-0cb8-4999-b222-44cad02b5946 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:04.815347 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ce5f9cfe-0cb8-4999-b222-44cad02b5946 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:05.029469 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f5246065-1c5f-433f-a260-64a1d6562b43 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:05.047435 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f5246065-1c5f-433f-a260-64a1d6562b43 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:05.052032 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f5246065-1c5f-433f-a260-64a1d6562b43 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:05.058553 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f5246065-1c5f-433f-a260-64a1d6562b43 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5" status: 200 len: 1407 microversion: 2.20 time: 0.636980 Aug 31 16:21:05.094485 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2471/4957] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:21:04 2022] GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5 => generated 1407 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:21:05.113605 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-861f1dbc-f3be-4cd4-b813-83d6c55932da req-9a7f27fe-e3a1-4530-a9e0-a0f0682c30d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85a0286b-2e02-4ecb-a63d-0b4a61048ab5", "tag": "b2e423e8-4d65-4e9c-90c7-27d4697688c2"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:21:05.140191 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-861f1dbc-f3be-4cd4-b813-83d6c55932da req-9a7f27fe-e3a1-4530-a9e0-a0f0682c30d3 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:05.141651 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-861f1dbc-f3be-4cd4-b813-83d6c55932da req-9a7f27fe-e3a1-4530-a9e0-a0f0682c30d3 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:05.142270 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-861f1dbc-f3be-4cd4-b813-83d6c55932da req-9a7f27fe-e3a1-4530-a9e0-a0f0682c30d3 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:05.162796 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-861f1dbc-f3be-4cd4-b813-83d6c55932da req-9a7f27fe-e3a1-4530-a9e0-a0f0682c30d3 service nova] Creating event network-changed:b2e423e8-4d65-4e9c-90c7-27d4697688c2 for instance 85a0286b-2e02-4ecb-a63d-0b4a61048ab5 on n-h1-850499-9 Aug 31 16:21:05.177673 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-861f1dbc-f3be-4cd4-b813-83d6c55932da req-9a7f27fe-e3a1-4530-a9e0-a0f0682c30d3 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074926 Aug 31 16:21:05.180888 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2472/4958] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:21:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:21:05.198824 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-16757f13-2190-4068-80cc-fb8d0e4e1325 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.6.74"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:21:05.205384 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-16757f13-2190-4068-80cc-fb8d0e4e1325 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] [instance: 41e57122-c82d-4f6d-af4f-fca28da61d70] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:05.221305 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-16757f13-2190-4068-80cc-fb8d0e4e1325 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:05.223388 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-16757f13-2190-4068-80cc-fb8d0e4e1325 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:05.224556 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-16757f13-2190-4068-80cc-fb8d0e4e1325 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:05.227191 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-16757f13-2190-4068-80cc-fb8d0e4e1325 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:05.228820 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-16757f13-2190-4068-80cc-fb8d0e4e1325 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:05.229856 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-16757f13-2190-4068-80cc-fb8d0e4e1325 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:05.279576 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-16757f13-2190-4068-80cc-fb8d0e4e1325 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Acquiring lock "refresh_cache-41e57122-c82d-4f6d-af4f-fca28da61d70" {{(pid=122256) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 31 16:21:05.280359 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-16757f13-2190-4068-80cc-fb8d0e4e1325 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Acquired lock "refresh_cache-41e57122-c82d-4f6d-af4f-fca28da61d70" {{(pid=122256) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 31 16:21:05.729153 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:21:05.856837 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ce5f9cfe-0cb8-4999-b222-44cad02b5946 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4744703b964435bbead751ca884d1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e014d4e4da5e47ff9a1261e7730034ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:05.865407 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ce5f9cfe-0cb8-4999-b222-44cad02b5946 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/ffc6f828-c8ec-4fd6-b69e-9c0230692009" status: 200 len: 1516 microversion: 2.1 time: 1.092468 Aug 31 16:21:05.866548 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2487/4959] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:21:04 2022] GET /compute/v2.1/servers/ffc6f828-c8ec-4fd6-b69e-9c0230692009 => generated 1516 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:21:05.888066 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c7c281f4-2e9c-44ce-a4a0-51c45b083123 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:05.888953 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c7c281f4-2e9c-44ce-a4a0-51c45b083123 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: ef42ce7c-829a-47f8-8d9f-68eac68ec20b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:05.895685 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c7c281f4-2e9c-44ce-a4a0-51c45b083123 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:05.896437 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c7c281f4-2e9c-44ce-a4a0-51c45b083123 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:05.897040 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c7c281f4-2e9c-44ce-a4a0-51c45b083123 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:05.898108 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c7c281f4-2e9c-44ce-a4a0-51c45b083123 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:05.898737 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c7c281f4-2e9c-44ce-a4a0-51c45b083123 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:05.899340 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c7c281f4-2e9c-44ce-a4a0-51c45b083123 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:06.606807 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c7c281f4-2e9c-44ce-a4a0-51c45b083123 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:06.619126 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c7c281f4-2e9c-44ce-a4a0-51c45b083123 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/ef42ce7c-829a-47f8-8d9f-68eac68ec20b" status: 200 len: 1314 microversion: 2.1 time: 0.751401 Aug 31 16:21:06.648124 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2488/4960] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:21:05 2022] GET /compute/v2.1/servers/ef42ce7c-829a-47f8-8d9f-68eac68ec20b => generated 1314 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:21:06.662259 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-deece64f-9367-4412-b2e6-d62d7596a3c4 req-94568a79-1830-42fd-bf79-5e5a5cc9c302 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef42ce7c-829a-47f8-8d9f-68eac68ec20b", "tag": "1040a73e-2d3a-4ec7-8b73-8203c0395cca"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:21:06.673045 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-deece64f-9367-4412-b2e6-d62d7596a3c4 req-94568a79-1830-42fd-bf79-5e5a5cc9c302 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:06.673834 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-deece64f-9367-4412-b2e6-d62d7596a3c4 req-94568a79-1830-42fd-bf79-5e5a5cc9c302 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:06.674446 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-deece64f-9367-4412-b2e6-d62d7596a3c4 req-94568a79-1830-42fd-bf79-5e5a5cc9c302 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:06.690251 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-deece64f-9367-4412-b2e6-d62d7596a3c4 req-94568a79-1830-42fd-bf79-5e5a5cc9c302 service nova] Creating event network-changed:1040a73e-2d3a-4ec7-8b73-8203c0395cca for instance ef42ce7c-829a-47f8-8d9f-68eac68ec20b on n-h1-850499-9 Aug 31 16:21:06.701719 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-deece64f-9367-4412-b2e6-d62d7596a3c4 req-94568a79-1830-42fd-bf79-5e5a5cc9c302 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051728 Aug 31 16:21:06.703513 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2489/4961] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:21:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:21:06.709237 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-57b5c849-a7ee-4558-aeb8-5213f2539dcb tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:21:06.712638 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-57b5c849-a7ee-4558-aeb8-5213f2539dcb tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: e4c45853-b7a8-4a32-a7e6-95e31f42b927] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:06.740934 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-57b5c849-a7ee-4558-aeb8-5213f2539dcb tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] HTTP exception thrown: Instance e4c45853-b7a8-4a32-a7e6-95e31f42b927 could not be found. Aug 31 16:21:06.748656 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-57b5c849-a7ee-4558-aeb8-5213f2539dcb tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Request method failure captured: Aug 31 16:21:06.748656 n-d-850499-9 devstack@n-api.service[122257]: request: POST /compute/v2.1/servers/e4c45853-b7a8-4a32-a7e6-95e31f42b927/action HTTP/1.1 Aug 31 16:21:06.748656 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:21:06.748656 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:21:06.748656 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:21:06.748656 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 14 Aug 31 16:21:06.748656 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:21:06.748656 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:21:06.748656 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:21:06.748656 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:21:06.748656 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4oy7qo0hac0I9IpX9ONeLQn5FXZxTJLjhjMB-WYHPcUUf61xQVdU4TOXEJINvaGC5c5Wjhk9pb4p_bnOvsu8HLsM1WUDttS1HJeEirzVfdDQ2PqvMBOo0UbRSxhckjuHlfQOCH8lv8yi1i-W11nad5j2vdw9RWWfX0Cd51S12MLuko Aug 31 16:21:06.748656 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:21:06.748656 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:21:06.748656 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:21:06.748656 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:21:06.748656 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:21:06.748656 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:21:06.748656 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: e014d4e4da5e47ff9a1261e7730034ac Aug 31 16:21:06.748656 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1963116327 Aug 31 16:21:06.748656 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:21:06.748656 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:21:06.748656 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e014d4e4da5e47ff9a1261e7730034ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/e014d4e4da5e47ff9a1261e7730034ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_e014d4e4da5e47ff9a1261e7730034ac", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e014d4e4da5e47ff9a1261e7730034ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:21:06.748656 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1963116327 Aug 31 16:21:06.748656 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: e014d4e4da5e47ff9a1261e7730034ac Aug 31 16:21:06.748656 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1963116327 Aug 31 16:21:06.748656 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ServerRescueNegativeTestJSON-1963116327-project Aug 31 16:21:06.748656 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:21:06.748656 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:21:06.748656 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: e4744703b964435bbead751ca884d1ae Aug 31 16:21:06.748656 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1963116327-project Aug 31 16:21:06.748656 n-d-850499-9 devstack@n-api.service[122257]: Aug 31 16:21:06.748656 n-d-850499-9 devstack@n-api.service[122257]: {"rescue": {}} Aug 31 16:21:06.748656 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:21:06.748656 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance e4c45853-b7a8-4a32-a7e6-95e31f42b927 could not be found. Aug 31 16:21:06.748656 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': 'e4c45853-b7a8-4a32-a7e6-95e31f42b927', 'body': {'rescue': {}}} Aug 31 16:21:06.748656 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:21:06.748656 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:21:06.748656 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:21:06.748656 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:21:06.748656 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:21:06.748656 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:21:06.748656 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 31 16:21:06.748656 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 31 16:21:06.748656 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4c45853-b7a8-4a32-a7e6-95e31f42b927 could not be found. Aug 31 16:21:06.748656 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:21:06.748656 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:21:06.748656 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:21:06.748656 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:21:06.748656 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:21:06.748656 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:21:06.748656 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:21:06.748656 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:21:06.748656 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:21:06.748656 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:21:06.748656 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:21:06.748656 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:21:06.748656 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Aug 31 16:21:06.748656 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 31 16:21:06.748656 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:21:06.748656 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:21:06.748656 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4c45853-b7a8-4a32-a7e6-95e31f42b927 could not be found. Aug 31 16:21:06.748656 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:21:06.748656 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:21:06.748656 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:21:06.748656 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:21:06.753482 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:21:06.753482 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:21:06.753482 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:21:06.753482 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:21:06.753482 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4c45853-b7a8-4a32-a7e6-95e31f42b927 could not be found. Aug 31 16:21:06.753482 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:21:06.754753 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-57b5c849-a7ee-4558-aeb8-5213f2539dcb tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Returning 404 to user: Instance e4c45853-b7a8-4a32-a7e6-95e31f42b927 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:21:06.755860 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-57b5c849-a7ee-4558-aeb8-5213f2539dcb tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "POST /compute/v2.1/servers/e4c45853-b7a8-4a32-a7e6-95e31f42b927/action" status: 404 len: 111 microversion: 2.1 time: 0.051639 Aug 31 16:21:06.762996 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2490/4962] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:21:06 2022] POST /compute/v2.1/servers/e4c45853-b7a8-4a32-a7e6-95e31f42b927/action => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:21:06.768650 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ddad61e1-1c3e-458e-98ba-bdcbc24e1764 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:06.769632 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ddad61e1-1c3e-458e-98ba-bdcbc24e1764 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:06.777741 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ddad61e1-1c3e-458e-98ba-bdcbc24e1764 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:06.778627 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ddad61e1-1c3e-458e-98ba-bdcbc24e1764 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:06.779303 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ddad61e1-1c3e-458e-98ba-bdcbc24e1764 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:06.780318 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ddad61e1-1c3e-458e-98ba-bdcbc24e1764 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:06.780995 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ddad61e1-1c3e-458e-98ba-bdcbc24e1764 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:06.781663 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ddad61e1-1c3e-458e-98ba-bdcbc24e1764 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:06.906169 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=8 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:21:07.103569 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ddad61e1-1c3e-458e-98ba-bdcbc24e1764 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:07.114769 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ddad61e1-1c3e-458e-98ba-bdcbc24e1764 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:07.118956 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ddad61e1-1c3e-458e-98ba-bdcbc24e1764 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:07.130552 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ddad61e1-1c3e-458e-98ba-bdcbc24e1764 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5" status: 200 len: 1407 microversion: 2.20 time: 0.365923 Aug 31 16:21:07.131352 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2491/4963] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:21:06 2022] GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5 => generated 1407 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:21:07.152498 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7bd00cf4-ec59-4568-89d6-5a5fe06a002c tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:21:07.153337 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7bd00cf4-ec59-4568-89d6-5a5fe06a002c tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: ffc6f828-c8ec-4fd6-b69e-9c0230692009] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:07.160760 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7bd00cf4-ec59-4568-89d6-5a5fe06a002c tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:07.161573 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7bd00cf4-ec59-4568-89d6-5a5fe06a002c tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:07.162258 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7bd00cf4-ec59-4568-89d6-5a5fe06a002c tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:07.163298 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7bd00cf4-ec59-4568-89d6-5a5fe06a002c tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:07.164417 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7bd00cf4-ec59-4568-89d6-5a5fe06a002c tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:07.165096 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7bd00cf4-ec59-4568-89d6-5a5fe06a002c tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:07.263418 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7bd00cf4-ec59-4568-89d6-5a5fe06a002c tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "POST /compute/v2.1/servers/ffc6f828-c8ec-4fd6-b69e-9c0230692009/action" status: 202 len: 0 microversion: 2.1 time: 0.116935 Aug 31 16:21:07.265383 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2492/4964] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:21:07 2022] POST /compute/v2.1/servers/ffc6f828-c8ec-4fd6-b69e-9c0230692009/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:21:07.291189 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-26b9e69a-e62c-4ad6-a648-f51e8c922517 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:07.292290 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-26b9e69a-e62c-4ad6-a648-f51e8c922517 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: ffc6f828-c8ec-4fd6-b69e-9c0230692009] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:07.304195 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-26b9e69a-e62c-4ad6-a648-f51e8c922517 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:07.305328 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-26b9e69a-e62c-4ad6-a648-f51e8c922517 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:07.306257 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-26b9e69a-e62c-4ad6-a648-f51e8c922517 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:07.308633 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-26b9e69a-e62c-4ad6-a648-f51e8c922517 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:07.309658 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-26b9e69a-e62c-4ad6-a648-f51e8c922517 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:07.310625 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-26b9e69a-e62c-4ad6-a648-f51e8c922517 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:07.664732 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-26b9e69a-e62c-4ad6-a648-f51e8c922517 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4744703b964435bbead751ca884d1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e014d4e4da5e47ff9a1261e7730034ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:07.681300 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-26b9e69a-e62c-4ad6-a648-f51e8c922517 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/ffc6f828-c8ec-4fd6-b69e-9c0230692009" status: 200 len: 1521 microversion: 2.1 time: 0.407699 Aug 31 16:21:07.683052 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2493/4965] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:21:07 2022] GET /compute/v2.1/servers/ffc6f828-c8ec-4fd6-b69e-9c0230692009 => generated 1521 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:21:07.690592 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2ce757fe-6a76-4421-81c5-607ba1d3c8ea tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:07.691882 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2ce757fe-6a76-4421-81c5-607ba1d3c8ea tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: ef42ce7c-829a-47f8-8d9f-68eac68ec20b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:07.703486 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2ce757fe-6a76-4421-81c5-607ba1d3c8ea tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:07.705405 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2ce757fe-6a76-4421-81c5-607ba1d3c8ea tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:07.706313 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2ce757fe-6a76-4421-81c5-607ba1d3c8ea tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:07.707880 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2ce757fe-6a76-4421-81c5-607ba1d3c8ea tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:07.708923 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2ce757fe-6a76-4421-81c5-607ba1d3c8ea tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:07.709877 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2ce757fe-6a76-4421-81c5-607ba1d3c8ea tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:08.038524 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2ce757fe-6a76-4421-81c5-607ba1d3c8ea tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:08.053230 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2ce757fe-6a76-4421-81c5-607ba1d3c8ea tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/ef42ce7c-829a-47f8-8d9f-68eac68ec20b" status: 200 len: 1314 microversion: 2.1 time: 0.368426 Aug 31 16:21:08.054980 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2494/4966] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:21:07 2022] GET /compute/v2.1/servers/ef42ce7c-829a-47f8-8d9f-68eac68ec20b => generated 1314 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:21:08.157026 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c3636959-3dac-4edf-a22e-c4b5c446925e tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:08.158033 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c3636959-3dac-4edf-a22e-c4b5c446925e tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:08.166215 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c3636959-3dac-4edf-a22e-c4b5c446925e tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:08.167696 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c3636959-3dac-4edf-a22e-c4b5c446925e tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:08.168455 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c3636959-3dac-4edf-a22e-c4b5c446925e tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:08.169451 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c3636959-3dac-4edf-a22e-c4b5c446925e tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:08.170291 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c3636959-3dac-4edf-a22e-c4b5c446925e tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:08.172376 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c3636959-3dac-4edf-a22e-c4b5c446925e tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:08.177137 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-16757f13-2190-4068-80cc-fb8d0e4e1325 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] [instance: 41e57122-c82d-4f6d-af4f-fca28da61d70] Building network info cache for instance {{(pid=122256) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 31 16:21:08.217331 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:21:08.859441 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c3636959-3dac-4edf-a22e-c4b5c446925e tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:08.882595 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c3636959-3dac-4edf-a22e-c4b5c446925e tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:08.885094 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c3636959-3dac-4edf-a22e-c4b5c446925e tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:08.886849 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c3636959-3dac-4edf-a22e-c4b5c446925e tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5" status: 200 len: 1407 microversion: 2.20 time: 0.734075 Aug 31 16:21:08.887748 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2495/4967] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:21:08 2022] GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5 => generated 1407 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:21:08.893187 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-a0f461f9-6abe-4d8e-8287-c8eadbc3fe36 req-b45c62af-88a2-4bbb-a35a-9a922da7cb57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41e57122-c82d-4f6d-af4f-fca28da61d70", "tag": "aa5919c1-b206-4c36-9030-7581ac0cc0e8"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:21:08.914356 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-a0f461f9-6abe-4d8e-8287-c8eadbc3fe36 req-b45c62af-88a2-4bbb-a35a-9a922da7cb57 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:08.915006 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-a0f461f9-6abe-4d8e-8287-c8eadbc3fe36 req-b45c62af-88a2-4bbb-a35a-9a922da7cb57 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:08.916866 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-a0f461f9-6abe-4d8e-8287-c8eadbc3fe36 req-b45c62af-88a2-4bbb-a35a-9a922da7cb57 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:08.937606 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-a0f461f9-6abe-4d8e-8287-c8eadbc3fe36 req-b45c62af-88a2-4bbb-a35a-9a922da7cb57 service nova] Creating event network-changed:aa5919c1-b206-4c36-9030-7581ac0cc0e8 for instance 41e57122-c82d-4f6d-af4f-fca28da61d70 on n-h2-850499-9 Aug 31 16:21:08.947649 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-a0f461f9-6abe-4d8e-8287-c8eadbc3fe36 req-b45c62af-88a2-4bbb-a35a-9a922da7cb57 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057761 Aug 31 16:21:08.949064 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2496/4968] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:21:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:21:08.956800 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3e8134f7-00bc-401a-926a-00a1f3d4258f tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:08.957921 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3e8134f7-00bc-401a-926a-00a1f3d4258f tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: ffc6f828-c8ec-4fd6-b69e-9c0230692009] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:08.968356 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3e8134f7-00bc-401a-926a-00a1f3d4258f tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:08.968983 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3e8134f7-00bc-401a-926a-00a1f3d4258f tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:08.969582 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3e8134f7-00bc-401a-926a-00a1f3d4258f tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:08.971929 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3e8134f7-00bc-401a-926a-00a1f3d4258f tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:08.972522 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3e8134f7-00bc-401a-926a-00a1f3d4258f tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:08.973060 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3e8134f7-00bc-401a-926a-00a1f3d4258f tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:10.459201 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3e8134f7-00bc-401a-926a-00a1f3d4258f tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4744703b964435bbead751ca884d1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e014d4e4da5e47ff9a1261e7730034ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:10.483873 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3e8134f7-00bc-401a-926a-00a1f3d4258f tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/ffc6f828-c8ec-4fd6-b69e-9c0230692009" status: 200 len: 1501 microversion: 2.1 time: 1.519787 Aug 31 16:21:10.484853 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2497/4969] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:21:08 2022] GET /compute/v2.1/servers/ffc6f828-c8ec-4fd6-b69e-9c0230692009 => generated 1501 bytes in 1535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:21:10.501022 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-10085ebd-b810-45ae-85b1-6a9994a9d581 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:10.505027 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-10085ebd-b810-45ae-85b1-6a9994a9d581 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: ef42ce7c-829a-47f8-8d9f-68eac68ec20b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:10.515883 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-10085ebd-b810-45ae-85b1-6a9994a9d581 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:10.517018 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-10085ebd-b810-45ae-85b1-6a9994a9d581 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:10.517793 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-10085ebd-b810-45ae-85b1-6a9994a9d581 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:10.518798 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-10085ebd-b810-45ae-85b1-6a9994a9d581 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:10.519530 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-10085ebd-b810-45ae-85b1-6a9994a9d581 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:10.520196 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-10085ebd-b810-45ae-85b1-6a9994a9d581 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:11.138537 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-10085ebd-b810-45ae-85b1-6a9994a9d581 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:11.156602 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-10085ebd-b810-45ae-85b1-6a9994a9d581 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/ef42ce7c-829a-47f8-8d9f-68eac68ec20b" status: 200 len: 1314 microversion: 2.1 time: 0.669360 Aug 31 16:21:11.171286 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2498/4970] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:21:10 2022] GET /compute/v2.1/servers/ef42ce7c-829a-47f8-8d9f-68eac68ec20b => generated 1314 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:21:11.176552 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-be88df15-f489-4e79-8237-04fdd33ce787 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:11.177400 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-be88df15-f489-4e79-8237-04fdd33ce787 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:11.196204 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-be88df15-f489-4e79-8237-04fdd33ce787 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:11.196701 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-be88df15-f489-4e79-8237-04fdd33ce787 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:11.197323 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-be88df15-f489-4e79-8237-04fdd33ce787 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:11.198204 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-be88df15-f489-4e79-8237-04fdd33ce787 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:11.199038 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-be88df15-f489-4e79-8237-04fdd33ce787 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:11.199659 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-be88df15-f489-4e79-8237-04fdd33ce787 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:11.709196 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-16757f13-2190-4068-80cc-fb8d0e4e1325 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] [instance: 41e57122-c82d-4f6d-af4f-fca28da61d70] Updating instance_info_cache with network_info: [{"id": "aa5919c1-b206-4c36-9030-7581ac0cc0e8", "address": "fa:16:3e:13:79:22", "network": {"id": "ecb57796-dd35-451a-aaf0-a8940d6c9197", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-547372757-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.6.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "9f784a8f91774261843e5819cdc6058a", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapaa5919c1-b2", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122256) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 31 16:21:11.721868 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-16757f13-2190-4068-80cc-fb8d0e4e1325 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Releasing lock "refresh_cache-41e57122-c82d-4f6d-af4f-fca28da61d70" {{(pid=122256) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 31 16:21:11.724447 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-16757f13-2190-4068-80cc-fb8d0e4e1325 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] 10.222.0.61 "POST /compute/v2.1/servers/41e57122-c82d-4f6d-af4f-fca28da61d70/action" status: 202 len: 0 microversion: 2.1 time: 6.539009 Aug 31 16:21:11.726467 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2473/4971] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:21:05 2022] POST /compute/v2.1/servers/41e57122-c82d-4f6d-af4f-fca28da61d70/action => generated 0 bytes in 6544 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 31 16:21:11.737339 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-23801e45-5495-4c2a-8ffc-fef394117c9d tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:21:11.745765 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-23801e45-5495-4c2a-8ffc-fef394117c9d tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: ffc6f828-c8ec-4fd6-b69e-9c0230692009] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:11.764762 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:21:11.775002 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-23801e45-5495-4c2a-8ffc-fef394117c9d tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:11.777761 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-23801e45-5495-4c2a-8ffc-fef394117c9d tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:11.779889 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-23801e45-5495-4c2a-8ffc-fef394117c9d tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:11.784713 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-23801e45-5495-4c2a-8ffc-fef394117c9d tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:11.785694 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-23801e45-5495-4c2a-8ffc-fef394117c9d tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:11.788444 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-23801e45-5495-4c2a-8ffc-fef394117c9d tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:11.849792 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-23801e45-5495-4c2a-8ffc-fef394117c9d tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lazy-loading 'flavor' on Instance uuid ffc6f828-c8ec-4fd6-b69e-9c0230692009 {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:21:11.877154 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-23801e45-5495-4c2a-8ffc-fef394117c9d tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] HTTP exception thrown: Cannot 'rescue' instance ffc6f828-c8ec-4fd6-b69e-9c0230692009 while it is in vm_state paused Aug 31 16:21:11.880758 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-23801e45-5495-4c2a-8ffc-fef394117c9d tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Request method failure captured: Aug 31 16:21:11.880758 n-d-850499-9 devstack@n-api.service[122256]: request: POST /compute/v2.1/servers/ffc6f828-c8ec-4fd6-b69e-9c0230692009/action HTTP/1.1 Aug 31 16:21:11.880758 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:21:11.880758 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:21:11.880758 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:21:11.880758 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 14 Aug 31 16:21:11.880758 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:21:11.880758 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:21:11.880758 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:21:11.880758 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:21:11.880758 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4oy7qo0hac0I9IpX9ONeLQn5FXZxTJLjhjMB-WYHPcUUf61xQVdU4TOXEJINvaGC5c5Wjhk9pb4p_bnOvsu8HLsM1WUDttS1HJeEirzVfdDQ2PqvMBOo0UbRSxhckjuHlfQOCH8lv8yi1i-W11nad5j2vdw9RWWfX0Cd51S12MLuko Aug 31 16:21:11.880758 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:21:11.880758 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:21:11.880758 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:21:11.880758 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:21:11.880758 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:21:11.880758 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:21:11.880758 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: e014d4e4da5e47ff9a1261e7730034ac Aug 31 16:21:11.880758 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1963116327 Aug 31 16:21:11.880758 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:21:11.880758 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:21:11.880758 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e014d4e4da5e47ff9a1261e7730034ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/e014d4e4da5e47ff9a1261e7730034ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_e014d4e4da5e47ff9a1261e7730034ac", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e014d4e4da5e47ff9a1261e7730034ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:21:11.880758 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1963116327 Aug 31 16:21:11.880758 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: e014d4e4da5e47ff9a1261e7730034ac Aug 31 16:21:11.880758 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1963116327 Aug 31 16:21:11.880758 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ServerRescueNegativeTestJSON-1963116327-project Aug 31 16:21:11.880758 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:21:11.880758 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:21:11.880758 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: e4744703b964435bbead751ca884d1ae Aug 31 16:21:11.880758 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1963116327-project Aug 31 16:21:11.880758 n-d-850499-9 devstack@n-api.service[122256]: Aug 31 16:21:11.880758 n-d-850499-9 devstack@n-api.service[122256]: {"rescue": {}} Aug 31 16:21:11.880758 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:21:11.880758 n-d-850499-9 devstack@n-api.service[122256]: exception: Cannot 'rescue' instance ffc6f828-c8ec-4fd6-b69e-9c0230692009 while it is in vm_state paused Aug 31 16:21:11.880758 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': 'ffc6f828-c8ec-4fd6-b69e-9c0230692009', 'body': {'rescue': {}}} Aug 31 16:21:11.880758 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:21:11.880758 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:21:11.880758 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Aug 31 16:21:11.880758 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Aug 31 16:21:11.880758 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Aug 31 16:21:11.880758 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 31 16:21:11.880758 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 16:21:11.880758 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 16:21:11.880758 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 31 16:21:11.880758 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 31 16:21:11.880758 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ffc6f828-c8ec-4fd6-b69e-9c0230692009 in vm_state paused. Cannot rescue while the instance is in this state. Aug 31 16:21:11.880758 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:21:11.880758 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:21:11.880758 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:21:11.880758 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:21:11.880758 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:21:11.880758 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:21:11.880758 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:21:11.880758 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:21:11.880758 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:21:11.880758 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:21:11.880758 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:21:11.880758 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:21:11.880758 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Aug 31 16:21:11.880758 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Aug 31 16:21:11.880758 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 31 16:21:11.880758 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 31 16:21:11.880758 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance ffc6f828-c8ec-4fd6-b69e-9c0230692009 while it is in vm_state paused Aug 31 16:21:11.880758 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:21:11.888022 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:21:11.888022 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:21:11.888022 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:21:11.888022 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:21:11.888022 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:21:11.888022 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:21:11.888022 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:21:11.888022 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance ffc6f828-c8ec-4fd6-b69e-9c0230692009 while it is in vm_state paused Aug 31 16:21:11.888022 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:21:11.891413 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-23801e45-5495-4c2a-8ffc-fef394117c9d tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Returning 409 to user: Cannot 'rescue' instance ffc6f828-c8ec-4fd6-b69e-9c0230692009 while it is in vm_state paused {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:21:11.893256 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-23801e45-5495-4c2a-8ffc-fef394117c9d tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "POST /compute/v2.1/servers/ffc6f828-c8ec-4fd6-b69e-9c0230692009/action" status: 409 len: 144 microversion: 2.1 time: 0.164935 Aug 31 16:21:11.894668 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2474/4972] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:21:11 2022] POST /compute/v2.1/servers/ffc6f828-c8ec-4fd6-b69e-9c0230692009/action => generated 144 bytes in 167 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 31 16:21:11.903217 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-dd1adec7-48fa-4f74-8b18-3a4bf6d2cfcc tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.6.74"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:21:12.074910 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-be88df15-f489-4e79-8237-04fdd33ce787 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:12.093844 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-be88df15-f489-4e79-8237-04fdd33ce787 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:12.098275 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-be88df15-f489-4e79-8237-04fdd33ce787 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:12.106347 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-be88df15-f489-4e79-8237-04fdd33ce787 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5" status: 200 len: 1407 microversion: 2.20 time: 0.933230 Aug 31 16:21:12.107396 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2499/4973] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:21:11 2022] GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5 => generated 1407 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:21:12.129681 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-204bc64d-4387-4763-b21c-ba6833759d2c tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:21:12.129681 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-204bc64d-4387-4763-b21c-ba6833759d2c tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: ffc6f828-c8ec-4fd6-b69e-9c0230692009] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:12.143150 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-204bc64d-4387-4763-b21c-ba6833759d2c tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:12.145126 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-204bc64d-4387-4763-b21c-ba6833759d2c tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:12.145904 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-204bc64d-4387-4763-b21c-ba6833759d2c tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:12.147856 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-204bc64d-4387-4763-b21c-ba6833759d2c tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:12.149620 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-204bc64d-4387-4763-b21c-ba6833759d2c tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:12.165570 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-204bc64d-4387-4763-b21c-ba6833759d2c tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:12.334046 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-204bc64d-4387-4763-b21c-ba6833759d2c tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "POST /compute/v2.1/servers/ffc6f828-c8ec-4fd6-b69e-9c0230692009/action" status: 202 len: 0 microversion: 2.1 time: 0.220614 Aug 31 16:21:12.337044 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2500/4974] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:21:12 2022] POST /compute/v2.1/servers/ffc6f828-c8ec-4fd6-b69e-9c0230692009/action => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:21:12.344578 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0fcd95ec-5a39-4960-a93a-2a7ad8ec4fd7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:12.346320 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0fcd95ec-5a39-4960-a93a-2a7ad8ec4fd7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: ef42ce7c-829a-47f8-8d9f-68eac68ec20b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:12.357100 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0fcd95ec-5a39-4960-a93a-2a7ad8ec4fd7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:12.358359 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0fcd95ec-5a39-4960-a93a-2a7ad8ec4fd7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:12.359374 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0fcd95ec-5a39-4960-a93a-2a7ad8ec4fd7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:12.360436 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0fcd95ec-5a39-4960-a93a-2a7ad8ec4fd7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:12.361114 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0fcd95ec-5a39-4960-a93a-2a7ad8ec4fd7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:12.361731 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0fcd95ec-5a39-4960-a93a-2a7ad8ec4fd7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:12.887857 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-dd1adec7-48fa-4f74-8b18-3a4bf6d2cfcc tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] [instance: 41e57122-c82d-4f6d-af4f-fca28da61d70] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:12.909034 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0fcd95ec-5a39-4960-a93a-2a7ad8ec4fd7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:12.918462 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dd1adec7-48fa-4f74-8b18-3a4bf6d2cfcc tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:12.918962 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dd1adec7-48fa-4f74-8b18-3a4bf6d2cfcc tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:12.919412 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dd1adec7-48fa-4f74-8b18-3a4bf6d2cfcc tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:12.924299 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0fcd95ec-5a39-4960-a93a-2a7ad8ec4fd7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/ef42ce7c-829a-47f8-8d9f-68eac68ec20b" status: 200 len: 1314 microversion: 2.1 time: 0.585633 Aug 31 16:21:12.924903 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2501/4975] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:21:12 2022] GET /compute/v2.1/servers/ef42ce7c-829a-47f8-8d9f-68eac68ec20b => generated 1314 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:21:12.930020 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2ab5fcf1-81fc-4ac1-8b9c-905fc8dba149 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:12.930716 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2ab5fcf1-81fc-4ac1-8b9c-905fc8dba149 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: ffc6f828-c8ec-4fd6-b69e-9c0230692009] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:12.934046 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dd1adec7-48fa-4f74-8b18-3a4bf6d2cfcc tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:12.934584 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dd1adec7-48fa-4f74-8b18-3a4bf6d2cfcc tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:12.935060 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dd1adec7-48fa-4f74-8b18-3a4bf6d2cfcc tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:12.947616 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=4 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:21:12.956178 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2ab5fcf1-81fc-4ac1-8b9c-905fc8dba149 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:12.957677 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2ab5fcf1-81fc-4ac1-8b9c-905fc8dba149 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:12.958559 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2ab5fcf1-81fc-4ac1-8b9c-905fc8dba149 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:12.959632 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2ab5fcf1-81fc-4ac1-8b9c-905fc8dba149 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:12.964249 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2ab5fcf1-81fc-4ac1-8b9c-905fc8dba149 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:12.964972 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2ab5fcf1-81fc-4ac1-8b9c-905fc8dba149 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:13.633015 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2ab5fcf1-81fc-4ac1-8b9c-905fc8dba149 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4744703b964435bbead751ca884d1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e014d4e4da5e47ff9a1261e7730034ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:13.648720 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2ab5fcf1-81fc-4ac1-8b9c-905fc8dba149 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/ffc6f828-c8ec-4fd6-b69e-9c0230692009" status: 200 len: 1516 microversion: 2.1 time: 0.722751 Aug 31 16:21:13.650046 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2502/4976] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:21:12 2022] GET /compute/v2.1/servers/ffc6f828-c8ec-4fd6-b69e-9c0230692009 => generated 1516 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:21:13.667355 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b78b01f2-d2ea-40e6-b3ea-edae5ac77d5a tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:13.668299 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b78b01f2-d2ea-40e6-b3ea-edae5ac77d5a tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:13.675197 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b78b01f2-d2ea-40e6-b3ea-edae5ac77d5a tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:13.676047 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b78b01f2-d2ea-40e6-b3ea-edae5ac77d5a tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:13.691490 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b78b01f2-d2ea-40e6-b3ea-edae5ac77d5a tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:13.696772 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b78b01f2-d2ea-40e6-b3ea-edae5ac77d5a tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:13.697849 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b78b01f2-d2ea-40e6-b3ea-edae5ac77d5a tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:13.698295 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b78b01f2-d2ea-40e6-b3ea-edae5ac77d5a tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:13.969722 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dd1adec7-48fa-4f74-8b18-3a4bf6d2cfcc tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Acquiring lock "refresh_cache-41e57122-c82d-4f6d-af4f-fca28da61d70" {{(pid=122256) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 31 16:21:13.970748 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dd1adec7-48fa-4f74-8b18-3a4bf6d2cfcc tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Acquired lock "refresh_cache-41e57122-c82d-4f6d-af4f-fca28da61d70" {{(pid=122256) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 31 16:21:15.076807 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b78b01f2-d2ea-40e6-b3ea-edae5ac77d5a tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:15.098771 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b78b01f2-d2ea-40e6-b3ea-edae5ac77d5a tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:15.106174 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b78b01f2-d2ea-40e6-b3ea-edae5ac77d5a tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:15.109476 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b78b01f2-d2ea-40e6-b3ea-edae5ac77d5a tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5" status: 200 len: 1407 microversion: 2.20 time: 1.456036 Aug 31 16:21:15.110123 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2503/4977] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:21:13 2022] GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5 => generated 1407 bytes in 1459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:21:15.122550 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7cb450b8-3ee6-42ab-8ef0-09c3648c4993 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:15.123170 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7cb450b8-3ee6-42ab-8ef0-09c3648c4993 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: ef42ce7c-829a-47f8-8d9f-68eac68ec20b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:15.142605 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7cb450b8-3ee6-42ab-8ef0-09c3648c4993 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:15.143111 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7cb450b8-3ee6-42ab-8ef0-09c3648c4993 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:15.143571 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7cb450b8-3ee6-42ab-8ef0-09c3648c4993 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:15.144292 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7cb450b8-3ee6-42ab-8ef0-09c3648c4993 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:15.144753 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7cb450b8-3ee6-42ab-8ef0-09c3648c4993 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:15.149822 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7cb450b8-3ee6-42ab-8ef0-09c3648c4993 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:15.820890 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7cb450b8-3ee6-42ab-8ef0-09c3648c4993 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:15.835565 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7cb450b8-3ee6-42ab-8ef0-09c3648c4993 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/ef42ce7c-829a-47f8-8d9f-68eac68ec20b" status: 200 len: 1314 microversion: 2.1 time: 0.723938 Aug 31 16:21:15.852897 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2504/4978] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:21:15 2022] GET /compute/v2.1/servers/ef42ce7c-829a-47f8-8d9f-68eac68ec20b => generated 1314 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:21:15.858789 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-23e3582c-7bd8-4e84-a201-60183ef27599 req-2f1b7b21-c28f-42c4-af19-7aa1efd16f11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85a0286b-2e02-4ecb-a63d-0b4a61048ab5", "name": "network-vif-plugged", "status": "completed", "tag": "b2e423e8-4d65-4e9c-90c7-27d4697688c2"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:21:15.870555 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-23e3582c-7bd8-4e84-a201-60183ef27599 req-2f1b7b21-c28f-42c4-af19-7aa1efd16f11 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:15.871376 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-23e3582c-7bd8-4e84-a201-60183ef27599 req-2f1b7b21-c28f-42c4-af19-7aa1efd16f11 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:15.872005 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-23e3582c-7bd8-4e84-a201-60183ef27599 req-2f1b7b21-c28f-42c4-af19-7aa1efd16f11 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:15.885681 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-23e3582c-7bd8-4e84-a201-60183ef27599 req-2f1b7b21-c28f-42c4-af19-7aa1efd16f11 service nova] Creating event network-vif-plugged:b2e423e8-4d65-4e9c-90c7-27d4697688c2 for instance 85a0286b-2e02-4ecb-a63d-0b4a61048ab5 on n-h1-850499-9 Aug 31 16:21:15.892528 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-23e3582c-7bd8-4e84-a201-60183ef27599 req-2f1b7b21-c28f-42c4-af19-7aa1efd16f11 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037917 Aug 31 16:21:15.894445 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2505/4979] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:21:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:21:15.901289 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d01266b2-dd5b-4a31-bb42-20f74abb92a3 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:15.904420 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d01266b2-dd5b-4a31-bb42-20f74abb92a3 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] [instance: cca485b3-25f2-4a77-a23a-bb9758586ce7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:15.921868 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d01266b2-dd5b-4a31-bb42-20f74abb92a3 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:15.922693 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d01266b2-dd5b-4a31-bb42-20f74abb92a3 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:15.923471 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d01266b2-dd5b-4a31-bb42-20f74abb92a3 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:15.924653 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d01266b2-dd5b-4a31-bb42-20f74abb92a3 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:15.925394 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d01266b2-dd5b-4a31-bb42-20f74abb92a3 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:15.926626 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d01266b2-dd5b-4a31-bb42-20f74abb92a3 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:16.009870 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d01266b2-dd5b-4a31-bb42-20f74abb92a3 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] 10.222.0.61 "GET /compute/v2.1/servers/cca485b3-25f2-4a77-a23a-bb9758586ce7/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.113846 Aug 31 16:21:16.016178 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2506/4980] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 16:21:15 2022] GET /compute/v2.1/servers/cca485b3-25f2-4a77-a23a-bb9758586ce7/os-volume_attachments => generated 371 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:21:16.136777 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-257c919a-60d2-4c42-bbef-30f4a53ccb20 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:16.137583 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-257c919a-60d2-4c42-bbef-30f4a53ccb20 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:16.152810 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-257c919a-60d2-4c42-bbef-30f4a53ccb20 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:16.152810 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-257c919a-60d2-4c42-bbef-30f4a53ccb20 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:16.152810 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-257c919a-60d2-4c42-bbef-30f4a53ccb20 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:16.153317 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-257c919a-60d2-4c42-bbef-30f4a53ccb20 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:16.155455 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-257c919a-60d2-4c42-bbef-30f4a53ccb20 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:16.165979 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-257c919a-60d2-4c42-bbef-30f4a53ccb20 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:16.665607 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-257c919a-60d2-4c42-bbef-30f4a53ccb20 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:16.675421 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-257c919a-60d2-4c42-bbef-30f4a53ccb20 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:16.676920 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-257c919a-60d2-4c42-bbef-30f4a53ccb20 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:16.678700 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-257c919a-60d2-4c42-bbef-30f4a53ccb20 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5" status: 200 len: 1407 microversion: 2.20 time: 0.546943 Aug 31 16:21:16.697488 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2507/4981] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:21:16 2022] GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5 => generated 1407 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:21:16.704817 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2a582045-ab41-4013-b218-591b8012b745 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:16.705562 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2a582045-ab41-4013-b218-591b8012b745 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] [instance: cca485b3-25f2-4a77-a23a-bb9758586ce7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:16.715175 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2a582045-ab41-4013-b218-591b8012b745 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:16.717051 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2a582045-ab41-4013-b218-591b8012b745 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:16.718063 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2a582045-ab41-4013-b218-591b8012b745 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:16.719429 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2a582045-ab41-4013-b218-591b8012b745 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:16.721266 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2a582045-ab41-4013-b218-591b8012b745 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:16.722338 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2a582045-ab41-4013-b218-591b8012b745 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:16.772651 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2a582045-ab41-4013-b218-591b8012b745 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] 10.222.0.61 "GET /compute/v2.1/servers/cca485b3-25f2-4a77-a23a-bb9758586ce7/os-volume_attachments/bbabe112-a1f7-415e-822a-7a959b48657c" status: 200 len: 194 microversion: 2.1 time: 0.072819 Aug 31 16:21:16.785410 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2508/4982] 10.222.0.61 () {58 vars in 1413 bytes} [Wed Aug 31 16:21:16 2022] GET /compute/v2.1/servers/cca485b3-25f2-4a77-a23a-bb9758586ce7/os-volume_attachments/bbabe112-a1f7-415e-822a-7a959b48657c => generated 194 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:21:16.790985 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-945d74ee-20ac-4d44-b009-8e6d2155dbed tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:21:16.793269 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-945d74ee-20ac-4d44-b009-8e6d2155dbed tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: ffc6f828-c8ec-4fd6-b69e-9c0230692009] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:16.800569 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-945d74ee-20ac-4d44-b009-8e6d2155dbed tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:16.801343 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-945d74ee-20ac-4d44-b009-8e6d2155dbed tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:16.801975 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-945d74ee-20ac-4d44-b009-8e6d2155dbed tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:16.802864 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-945d74ee-20ac-4d44-b009-8e6d2155dbed tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:16.804255 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-945d74ee-20ac-4d44-b009-8e6d2155dbed tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:16.805138 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-945d74ee-20ac-4d44-b009-8e6d2155dbed tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:16.831935 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-945d74ee-20ac-4d44-b009-8e6d2155dbed tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lazy-loading 'flavor' on Instance uuid ffc6f828-c8ec-4fd6-b69e-9c0230692009 {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:21:16.938559 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-945d74ee-20ac-4d44-b009-8e6d2155dbed tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "POST /compute/v2.1/servers/ffc6f828-c8ec-4fd6-b69e-9c0230692009/action" status: 200 len: 32 microversion: 2.1 time: 0.153012 Aug 31 16:21:16.939536 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2509/4983] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:21:16 2022] POST /compute/v2.1/servers/ffc6f828-c8ec-4fd6-b69e-9c0230692009/action => generated 32 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 16:21:16.963263 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-639d6f35-20f9-4649-bd16-6ad28ecc4b22 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:16.964690 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-639d6f35-20f9-4649-bd16-6ad28ecc4b22 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] [instance: cca485b3-25f2-4a77-a23a-bb9758586ce7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:16.977363 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-639d6f35-20f9-4649-bd16-6ad28ecc4b22 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:16.978736 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-639d6f35-20f9-4649-bd16-6ad28ecc4b22 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:16.979362 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-639d6f35-20f9-4649-bd16-6ad28ecc4b22 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:16.980502 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-639d6f35-20f9-4649-bd16-6ad28ecc4b22 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:16.981375 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-639d6f35-20f9-4649-bd16-6ad28ecc4b22 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:16.982676 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-639d6f35-20f9-4649-bd16-6ad28ecc4b22 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:17.001074 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:21:17.104615 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-639d6f35-20f9-4649-bd16-6ad28ecc4b22 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lazy-loading 'services' on Instance uuid cca485b3-25f2-4a77-a23a-bb9758586ce7 {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:21:17.266217 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-639d6f35-20f9-4649-bd16-6ad28ecc4b22 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] 10.222.0.61 "DELETE /compute/v2.1/servers/cca485b3-25f2-4a77-a23a-bb9758586ce7/os-volume_attachments/bbabe112-a1f7-415e-822a-7a959b48657c" status: 202 len: 0 microversion: 2.1 time: 0.324479 Aug 31 16:21:17.267094 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2510/4984] 10.222.0.61 () {58 vars in 1416 bytes} [Wed Aug 31 16:21:16 2022] DELETE /compute/v2.1/servers/cca485b3-25f2-4a77-a23a-bb9758586ce7/os-volume_attachments/bbabe112-a1f7-415e-822a-7a959b48657c => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:21:17.283365 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b9e5fea2-cd81-46b1-9e33-d630f6a399d1 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:17.287931 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b9e5fea2-cd81-46b1-9e33-d630f6a399d1 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: ef42ce7c-829a-47f8-8d9f-68eac68ec20b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:17.309925 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b9e5fea2-cd81-46b1-9e33-d630f6a399d1 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:17.311102 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b9e5fea2-cd81-46b1-9e33-d630f6a399d1 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:17.311967 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b9e5fea2-cd81-46b1-9e33-d630f6a399d1 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:17.316169 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b9e5fea2-cd81-46b1-9e33-d630f6a399d1 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:17.317494 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b9e5fea2-cd81-46b1-9e33-d630f6a399d1 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:17.320576 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b9e5fea2-cd81-46b1-9e33-d630f6a399d1 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:17.394496 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-dd1adec7-48fa-4f74-8b18-3a4bf6d2cfcc tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] [instance: 41e57122-c82d-4f6d-af4f-fca28da61d70] Building network info cache for instance {{(pid=122256) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 31 16:21:17.913975 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b9e5fea2-cd81-46b1-9e33-d630f6a399d1 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:17.925692 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b9e5fea2-cd81-46b1-9e33-d630f6a399d1 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/ef42ce7c-829a-47f8-8d9f-68eac68ec20b" status: 200 len: 1314 microversion: 2.1 time: 0.655364 Aug 31 16:21:17.930128 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2511/4985] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:21:17 2022] GET /compute/v2.1/servers/ef42ce7c-829a-47f8-8d9f-68eac68ec20b => generated 1314 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:21:17.936561 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-04cdff1f-87e0-4ca7-a9a9-af03a60775ee tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:17.941635 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-04cdff1f-87e0-4ca7-a9a9-af03a60775ee tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: ffc6f828-c8ec-4fd6-b69e-9c0230692009] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:17.959755 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-04cdff1f-87e0-4ca7-a9a9-af03a60775ee tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:17.960489 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-04cdff1f-87e0-4ca7-a9a9-af03a60775ee tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:17.961430 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-04cdff1f-87e0-4ca7-a9a9-af03a60775ee tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:17.962425 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-04cdff1f-87e0-4ca7-a9a9-af03a60775ee tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:17.963205 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-04cdff1f-87e0-4ca7-a9a9-af03a60775ee tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:17.963827 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-04cdff1f-87e0-4ca7-a9a9-af03a60775ee tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:19.020373 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-04cdff1f-87e0-4ca7-a9a9-af03a60775ee tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4744703b964435bbead751ca884d1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e014d4e4da5e47ff9a1261e7730034ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:19.031149 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-04cdff1f-87e0-4ca7-a9a9-af03a60775ee tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/ffc6f828-c8ec-4fd6-b69e-9c0230692009" status: 200 len: 1522 microversion: 2.1 time: 1.099631 Aug 31 16:21:19.031773 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2512/4986] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:21:17 2022] GET /compute/v2.1/servers/ffc6f828-c8ec-4fd6-b69e-9c0230692009 => generated 1522 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:21:19.052009 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-c1c10f5a-35dd-4e80-b8db-50705109a02b req-f3cc44d8-f725-42bb-bf0c-ea87259facb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41e57122-c82d-4f6d-af4f-fca28da61d70", "tag": "aa5919c1-b206-4c36-9030-7581ac0cc0e8"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:21:19.081421 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-c1c10f5a-35dd-4e80-b8db-50705109a02b req-f3cc44d8-f725-42bb-bf0c-ea87259facb4 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:19.081910 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-c1c10f5a-35dd-4e80-b8db-50705109a02b req-f3cc44d8-f725-42bb-bf0c-ea87259facb4 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:19.082347 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-c1c10f5a-35dd-4e80-b8db-50705109a02b req-f3cc44d8-f725-42bb-bf0c-ea87259facb4 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:19.111029 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-c1c10f5a-35dd-4e80-b8db-50705109a02b req-f3cc44d8-f725-42bb-bf0c-ea87259facb4 service nova] Creating event network-changed:aa5919c1-b206-4c36-9030-7581ac0cc0e8 for instance 41e57122-c82d-4f6d-af4f-fca28da61d70 on n-h2-850499-9 Aug 31 16:21:19.117998 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-c1c10f5a-35dd-4e80-b8db-50705109a02b req-f3cc44d8-f725-42bb-bf0c-ea87259facb4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076742 Aug 31 16:21:19.119680 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2513/4987] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:21:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:21:19.126222 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c39c5e0c-ff91-442d-8185-53eb6790f2fe tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:19.127401 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c39c5e0c-ff91-442d-8185-53eb6790f2fe tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:19.142365 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c39c5e0c-ff91-442d-8185-53eb6790f2fe tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:19.145461 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c39c5e0c-ff91-442d-8185-53eb6790f2fe tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:19.147561 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c39c5e0c-ff91-442d-8185-53eb6790f2fe tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:19.151475 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c39c5e0c-ff91-442d-8185-53eb6790f2fe tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:19.152228 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c39c5e0c-ff91-442d-8185-53eb6790f2fe tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:19.155779 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c39c5e0c-ff91-442d-8185-53eb6790f2fe tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:21.075175 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-dd1adec7-48fa-4f74-8b18-3a4bf6d2cfcc tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] [instance: 41e57122-c82d-4f6d-af4f-fca28da61d70] Updating instance_info_cache with network_info: [{"id": "aa5919c1-b206-4c36-9030-7581ac0cc0e8", "address": "fa:16:3e:13:79:22", "network": {"id": "ecb57796-dd35-451a-aaf0-a8940d6c9197", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-547372757-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "9f784a8f91774261843e5819cdc6058a", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapaa5919c1-b2", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122256) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 31 16:21:21.112062 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dd1adec7-48fa-4f74-8b18-3a4bf6d2cfcc tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Releasing lock "refresh_cache-41e57122-c82d-4f6d-af4f-fca28da61d70" {{(pid=122256) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 31 16:21:21.126906 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-dd1adec7-48fa-4f74-8b18-3a4bf6d2cfcc tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] 10.222.0.61 "POST /compute/v2.1/servers/41e57122-c82d-4f6d-af4f-fca28da61d70/action" status: 202 len: 0 microversion: 2.1 time: 9.230423 Aug 31 16:21:21.133981 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2475/4988] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:21:11 2022] POST /compute/v2.1/servers/41e57122-c82d-4f6d-af4f-fca28da61d70/action => generated 0 bytes in 9238 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 31 16:21:21.142268 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-0d8242c6-2d32-4ecf-b0eb-ec21f4aef9b0 req-dcc4f5b7-bdce-4dfa-9139-ba3146dd9332 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef42ce7c-829a-47f8-8d9f-68eac68ec20b", "name": "network-vif-plugged", "status": "completed", "tag": "1040a73e-2d3a-4ec7-8b73-8203c0395cca"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:21:21.156250 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-0d8242c6-2d32-4ecf-b0eb-ec21f4aef9b0 req-dcc4f5b7-bdce-4dfa-9139-ba3146dd9332 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:21.157070 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-0d8242c6-2d32-4ecf-b0eb-ec21f4aef9b0 req-dcc4f5b7-bdce-4dfa-9139-ba3146dd9332 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:21.157781 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-0d8242c6-2d32-4ecf-b0eb-ec21f4aef9b0 req-dcc4f5b7-bdce-4dfa-9139-ba3146dd9332 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:21.175238 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-0d8242c6-2d32-4ecf-b0eb-ec21f4aef9b0 req-dcc4f5b7-bdce-4dfa-9139-ba3146dd9332 service nova] Creating event network-vif-plugged:1040a73e-2d3a-4ec7-8b73-8203c0395cca for instance ef42ce7c-829a-47f8-8d9f-68eac68ec20b on n-h1-850499-9 Aug 31 16:21:21.181864 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-0d8242c6-2d32-4ecf-b0eb-ec21f4aef9b0 req-dcc4f5b7-bdce-4dfa-9139-ba3146dd9332 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043794 Aug 31 16:21:21.187681 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2476/4989] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:21:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:21:21.193572 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9df8a232-7716-48ce-9c39-26b19b0eebd5 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:21.194768 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9df8a232-7716-48ce-9c39-26b19b0eebd5 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: ef42ce7c-829a-47f8-8d9f-68eac68ec20b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:21.203054 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9df8a232-7716-48ce-9c39-26b19b0eebd5 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:21.204175 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9df8a232-7716-48ce-9c39-26b19b0eebd5 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:21.204717 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9df8a232-7716-48ce-9c39-26b19b0eebd5 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:21.205732 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9df8a232-7716-48ce-9c39-26b19b0eebd5 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:21.206564 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9df8a232-7716-48ce-9c39-26b19b0eebd5 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:21.208394 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9df8a232-7716-48ce-9c39-26b19b0eebd5 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:21.280754 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c39c5e0c-ff91-442d-8185-53eb6790f2fe tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:21.321324 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c39c5e0c-ff91-442d-8185-53eb6790f2fe tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:21.323978 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c39c5e0c-ff91-442d-8185-53eb6790f2fe tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:21.329527 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c39c5e0c-ff91-442d-8185-53eb6790f2fe tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5" status: 200 len: 1600 microversion: 2.20 time: 2.208035 Aug 31 16:21:21.345944 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2514/4990] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:21:19 2022] GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5 => generated 1600 bytes in 2225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:21:21.407096 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-577d7d38-ffe5-4d37-ba1d-898e69991f79 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:21.408365 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-577d7d38-ffe5-4d37-ba1d-898e69991f79 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: ffc6f828-c8ec-4fd6-b69e-9c0230692009] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:21.420707 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-577d7d38-ffe5-4d37-ba1d-898e69991f79 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:21.421383 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-577d7d38-ffe5-4d37-ba1d-898e69991f79 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:21.422201 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-577d7d38-ffe5-4d37-ba1d-898e69991f79 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:21.423157 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-577d7d38-ffe5-4d37-ba1d-898e69991f79 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:21.425062 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-577d7d38-ffe5-4d37-ba1d-898e69991f79 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:21.426704 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-577d7d38-ffe5-4d37-ba1d-898e69991f79 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:22.047809 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-577d7d38-ffe5-4d37-ba1d-898e69991f79 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4744703b964435bbead751ca884d1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e014d4e4da5e47ff9a1261e7730034ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:22.061802 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-577d7d38-ffe5-4d37-ba1d-898e69991f79 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/ffc6f828-c8ec-4fd6-b69e-9c0230692009" status: 200 len: 1522 microversion: 2.1 time: 0.714662 Aug 31 16:21:22.062410 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2515/4991] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:21:21 2022] GET /compute/v2.1/servers/ffc6f828-c8ec-4fd6-b69e-9c0230692009 => generated 1522 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:21:22.075805 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-275451ed-9c17-48c4-8a56-3e87892ed07e tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Calling method '.version_select at 0x7f5ae3c678b0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:22.465573 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-9df8a232-7716-48ce-9c39-26b19b0eebd5 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:22.495882 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9df8a232-7716-48ce-9c39-26b19b0eebd5 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/ef42ce7c-829a-47f8-8d9f-68eac68ec20b" status: 200 len: 1314 microversion: 2.1 time: 1.306200 Aug 31 16:21:22.496966 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2477/4992] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:21:21 2022] GET /compute/v2.1/servers/ef42ce7c-829a-47f8-8d9f-68eac68ec20b => generated 1314 bytes in 1308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:21:22.514335 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2034403b-3743-4c1f-81ff-158acf06a712 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:22.515117 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2034403b-3743-4c1f-81ff-158acf06a712 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:22.526241 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2034403b-3743-4c1f-81ff-158acf06a712 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:22.532317 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2034403b-3743-4c1f-81ff-158acf06a712 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:22.533214 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2034403b-3743-4c1f-81ff-158acf06a712 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:22.534218 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2034403b-3743-4c1f-81ff-158acf06a712 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:22.536397 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2034403b-3743-4c1f-81ff-158acf06a712 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:22.537778 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2034403b-3743-4c1f-81ff-158acf06a712 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:23.145461 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2034403b-3743-4c1f-81ff-158acf06a712 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.644900 Aug 31 16:21:23.148054 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2478/4993] 10.222.0.61 () {60 vars in 1316 bytes} [Wed Aug 31 16:21:22 2022] GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5/os-interface => generated 285 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 16:21:23.160408 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e1700ba6-fb9c-4d20-85f7-74de5d3e7abd tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:23.161749 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e1700ba6-fb9c-4d20-85f7-74de5d3e7abd tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: ffc6f828-c8ec-4fd6-b69e-9c0230692009] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:23.169364 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e1700ba6-fb9c-4d20-85f7-74de5d3e7abd tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:23.174358 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e1700ba6-fb9c-4d20-85f7-74de5d3e7abd tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:23.181937 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e1700ba6-fb9c-4d20-85f7-74de5d3e7abd tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:23.182879 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e1700ba6-fb9c-4d20-85f7-74de5d3e7abd tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:23.183377 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e1700ba6-fb9c-4d20-85f7-74de5d3e7abd tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:23.183898 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e1700ba6-fb9c-4d20-85f7-74de5d3e7abd tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:24.168929 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e1700ba6-fb9c-4d20-85f7-74de5d3e7abd tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4744703b964435bbead751ca884d1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e014d4e4da5e47ff9a1261e7730034ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:24.191741 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e1700ba6-fb9c-4d20-85f7-74de5d3e7abd tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/ffc6f828-c8ec-4fd6-b69e-9c0230692009" status: 200 len: 1522 microversion: 2.1 time: 1.041843 Aug 31 16:21:24.193250 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2479/4994] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:21:23 2022] GET /compute/v2.1/servers/ffc6f828-c8ec-4fd6-b69e-9c0230692009 => generated 1522 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:21:24.245984 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-34107ce7-9aae-42cc-ac66-131e2293b4a2 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:24.256405 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-34107ce7-9aae-42cc-ac66-131e2293b4a2 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: ef42ce7c-829a-47f8-8d9f-68eac68ec20b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:24.281307 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-34107ce7-9aae-42cc-ac66-131e2293b4a2 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:24.281614 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-34107ce7-9aae-42cc-ac66-131e2293b4a2 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:24.282061 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-34107ce7-9aae-42cc-ac66-131e2293b4a2 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:24.290564 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-34107ce7-9aae-42cc-ac66-131e2293b4a2 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:24.291076 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-34107ce7-9aae-42cc-ac66-131e2293b4a2 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:24.291565 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-34107ce7-9aae-42cc-ac66-131e2293b4a2 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:24.846106 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-34107ce7-9aae-42cc-ac66-131e2293b4a2 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:24.864612 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-34107ce7-9aae-42cc-ac66-131e2293b4a2 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/ef42ce7c-829a-47f8-8d9f-68eac68ec20b" status: 200 len: 1314 microversion: 2.1 time: 0.669082 Aug 31 16:21:24.865315 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2480/4995] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:21:24 2022] GET /compute/v2.1/servers/ef42ce7c-829a-47f8-8d9f-68eac68ec20b => generated 1314 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:21:25.216419 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-bca31a63-6d4b-469a-90a9-00b3e9b86faa tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:25.217733 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-bca31a63-6d4b-469a-90a9-00b3e9b86faa tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: ffc6f828-c8ec-4fd6-b69e-9c0230692009] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:25.237772 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bca31a63-6d4b-469a-90a9-00b3e9b86faa tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:25.238564 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bca31a63-6d4b-469a-90a9-00b3e9b86faa tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:25.239193 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bca31a63-6d4b-469a-90a9-00b3e9b86faa tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:25.240124 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bca31a63-6d4b-469a-90a9-00b3e9b86faa tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:25.241277 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bca31a63-6d4b-469a-90a9-00b3e9b86faa tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:25.241870 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bca31a63-6d4b-469a-90a9-00b3e9b86faa tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:26.059332 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-bca31a63-6d4b-469a-90a9-00b3e9b86faa tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4744703b964435bbead751ca884d1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e014d4e4da5e47ff9a1261e7730034ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:26.069087 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-bca31a63-6d4b-469a-90a9-00b3e9b86faa tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/ffc6f828-c8ec-4fd6-b69e-9c0230692009" status: 200 len: 1522 microversion: 2.1 time: 0.857264 Aug 31 16:21:26.070444 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2481/4996] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:21:25 2022] GET /compute/v2.1/servers/ffc6f828-c8ec-4fd6-b69e-9c0230692009 => generated 1522 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:21:26.075586 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6fb7ae3e-02c9-4b42-b082-b4075cbc466a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:26.076320 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6fb7ae3e-02c9-4b42-b082-b4075cbc466a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: ef42ce7c-829a-47f8-8d9f-68eac68ec20b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:26.084912 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6fb7ae3e-02c9-4b42-b082-b4075cbc466a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:26.086114 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6fb7ae3e-02c9-4b42-b082-b4075cbc466a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:26.087653 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6fb7ae3e-02c9-4b42-b082-b4075cbc466a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:26.088613 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6fb7ae3e-02c9-4b42-b082-b4075cbc466a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:26.089235 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6fb7ae3e-02c9-4b42-b082-b4075cbc466a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:26.089957 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6fb7ae3e-02c9-4b42-b082-b4075cbc466a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:26.850998 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-6fb7ae3e-02c9-4b42-b082-b4075cbc466a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:26.862513 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6fb7ae3e-02c9-4b42-b082-b4075cbc466a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/ef42ce7c-829a-47f8-8d9f-68eac68ec20b" status: 200 len: 1501 microversion: 2.1 time: 0.790638 Aug 31 16:21:26.879849 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2482/4997] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:21:26 2022] GET /compute/v2.1/servers/ef42ce7c-829a-47f8-8d9f-68eac68ec20b => generated 1501 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:21:26.886531 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-af2cc0b2-fa3d-4739-bff8-1696ad725ae9 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:26.887310 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-af2cc0b2-fa3d-4739-bff8-1696ad725ae9 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] [instance: cca485b3-25f2-4a77-a23a-bb9758586ce7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:26.895520 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-af2cc0b2-fa3d-4739-bff8-1696ad725ae9 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:26.896248 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-af2cc0b2-fa3d-4739-bff8-1696ad725ae9 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:26.897484 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-af2cc0b2-fa3d-4739-bff8-1696ad725ae9 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:26.898424 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-af2cc0b2-fa3d-4739-bff8-1696ad725ae9 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:26.899794 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-af2cc0b2-fa3d-4739-bff8-1696ad725ae9 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:26.914128 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-af2cc0b2-fa3d-4739-bff8-1696ad725ae9 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:26.963820 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-af2cc0b2-fa3d-4739-bff8-1696ad725ae9 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] 10.222.0.61 "GET /compute/v2.1/servers/cca485b3-25f2-4a77-a23a-bb9758586ce7/os-volume_attachments/e419b10e-7f7a-4171-a02b-aedda98107c8" status: 200 len: 194 microversion: 2.1 time: 0.082443 Aug 31 16:21:26.965154 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2483/4998] 10.222.0.61 () {58 vars in 1413 bytes} [Wed Aug 31 16:21:26 2022] GET /compute/v2.1/servers/cca485b3-25f2-4a77-a23a-bb9758586ce7/os-volume_attachments/e419b10e-7f7a-4171-a02b-aedda98107c8 => generated 194 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:21:26.971611 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b33125f2-7eb8-434c-b00b-c0fbb4eda0ed tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:21:26.976445 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b33125f2-7eb8-434c-b00b-c0fbb4eda0ed tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: ef42ce7c-829a-47f8-8d9f-68eac68ec20b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:26.985037 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b33125f2-7eb8-434c-b00b-c0fbb4eda0ed tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:26.985856 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b33125f2-7eb8-434c-b00b-c0fbb4eda0ed tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:26.986463 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b33125f2-7eb8-434c-b00b-c0fbb4eda0ed tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:26.987452 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b33125f2-7eb8-434c-b00b-c0fbb4eda0ed tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:26.988121 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b33125f2-7eb8-434c-b00b-c0fbb4eda0ed tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:26.989835 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b33125f2-7eb8-434c-b00b-c0fbb4eda0ed tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:27.072331 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b33125f2-7eb8-434c-b00b-c0fbb4eda0ed tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "POST /compute/v2.1/servers/ef42ce7c-829a-47f8-8d9f-68eac68ec20b/action" status: 200 len: 14 microversion: 2.1 time: 0.105553 Aug 31 16:21:27.073436 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2484/4999] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:21:26 2022] POST /compute/v2.1/servers/ef42ce7c-829a-47f8-8d9f-68eac68ec20b/action => generated 14 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 16:21:27.078891 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-71c86e45-824e-4631-936a-70e8d751d1cd tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:27.080982 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-71c86e45-824e-4631-936a-70e8d751d1cd tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] [instance: cca485b3-25f2-4a77-a23a-bb9758586ce7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:27.094029 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-71c86e45-824e-4631-936a-70e8d751d1cd tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:27.094540 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-71c86e45-824e-4631-936a-70e8d751d1cd tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:27.095236 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-71c86e45-824e-4631-936a-70e8d751d1cd tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:27.101307 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-71c86e45-824e-4631-936a-70e8d751d1cd tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:27.101819 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-71c86e45-824e-4631-936a-70e8d751d1cd tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:27.102275 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-71c86e45-824e-4631-936a-70e8d751d1cd tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:27.251311 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-71c86e45-824e-4631-936a-70e8d751d1cd tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lazy-loading 'services' on Instance uuid cca485b3-25f2-4a77-a23a-bb9758586ce7 {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:21:27.403893 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-71c86e45-824e-4631-936a-70e8d751d1cd tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] 10.222.0.61 "DELETE /compute/v2.1/servers/cca485b3-25f2-4a77-a23a-bb9758586ce7/os-volume_attachments/e419b10e-7f7a-4171-a02b-aedda98107c8" status: 202 len: 0 microversion: 2.1 time: 0.328949 Aug 31 16:21:27.406564 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2485/5000] 10.222.0.61 () {58 vars in 1416 bytes} [Wed Aug 31 16:21:27 2022] DELETE /compute/v2.1/servers/cca485b3-25f2-4a77-a23a-bb9758586ce7/os-volume_attachments/e419b10e-7f7a-4171-a02b-aedda98107c8 => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:21:27.440484 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8f2a4b67-c2ec-402a-924f-ab31551a5ec3 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:27.441569 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8f2a4b67-c2ec-402a-924f-ab31551a5ec3 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: ffc6f828-c8ec-4fd6-b69e-9c0230692009] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:27.456831 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8f2a4b67-c2ec-402a-924f-ab31551a5ec3 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:27.457764 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8f2a4b67-c2ec-402a-924f-ab31551a5ec3 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:27.459620 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8f2a4b67-c2ec-402a-924f-ab31551a5ec3 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:27.460797 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8f2a4b67-c2ec-402a-924f-ab31551a5ec3 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:27.461550 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8f2a4b67-c2ec-402a-924f-ab31551a5ec3 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:27.462532 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8f2a4b67-c2ec-402a-924f-ab31551a5ec3 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:27.508928 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:21:27.703100 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-275451ed-9c17-48c4-8a56-3e87892ed07e tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] 10.222.0.61 "DELETE /compute/v2.1/os-floating-ips/98666275-b8e4-431e-9b1b-979ac5946dbb" status: 202 len: 0 microversion: 2.1 time: 5.635748 Aug 31 16:21:27.704411 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2516/5001] 10.222.0.61 () {58 vars in 1263 bytes} [Wed Aug 31 16:21:22 2022] DELETE /compute/v2.1/os-floating-ips/98666275-b8e4-431e-9b1b-979ac5946dbb => generated 0 bytes in 5641 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:21:27.714089 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9cddcf90-b437-4ddb-8488-23fa63c61d3f tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Calling method '.version_select at 0x7f5ae3b775e0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:28.003571 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8f2a4b67-c2ec-402a-924f-ab31551a5ec3 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4744703b964435bbead751ca884d1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e014d4e4da5e47ff9a1261e7730034ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:28.016402 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8f2a4b67-c2ec-402a-924f-ab31551a5ec3 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/ffc6f828-c8ec-4fd6-b69e-9c0230692009" status: 200 len: 1522 microversion: 2.1 time: 0.607586 Aug 31 16:21:28.017424 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2486/5002] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:21:27 2022] GET /compute/v2.1/servers/ffc6f828-c8ec-4fd6-b69e-9c0230692009 => generated 1522 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:21:28.086809 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-dce8c69d-8a0a-4066-87f9-9b4562b65c9e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:21:28.089798 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-dce8c69d-8a0a-4066-87f9-9b4562b65c9e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: ef42ce7c-829a-47f8-8d9f-68eac68ec20b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:28.097601 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dce8c69d-8a0a-4066-87f9-9b4562b65c9e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:28.098500 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dce8c69d-8a0a-4066-87f9-9b4562b65c9e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:28.099103 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dce8c69d-8a0a-4066-87f9-9b4562b65c9e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:28.100749 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dce8c69d-8a0a-4066-87f9-9b4562b65c9e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:28.101451 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dce8c69d-8a0a-4066-87f9-9b4562b65c9e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:28.102090 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dce8c69d-8a0a-4066-87f9-9b4562b65c9e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:28.173527 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-dce8c69d-8a0a-4066-87f9-9b4562b65c9e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "POST /compute/v2.1/servers/ef42ce7c-829a-47f8-8d9f-68eac68ec20b/action" status: 200 len: 14 microversion: 2.1 time: 0.091946 Aug 31 16:21:28.175452 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2487/5003] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:21:28 2022] POST /compute/v2.1/servers/ef42ce7c-829a-47f8-8d9f-68eac68ec20b/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 16:21:29.068697 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9cddcf90-b437-4ddb-8488-23fa63c61d3f tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/f47fd7a8-d105-4256-ad9c-cb2a1b50d2d4" status: 202 len: 0 microversion: 2.1 time: 1.359298 Aug 31 16:21:29.072322 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2517/5004] 10.222.0.61 () {58 vars in 1272 bytes} [Wed Aug 31 16:21:27 2022] DELETE /compute/v2.1/os-security-groups/f47fd7a8-d105-4256-ad9c-cb2a1b50d2d4 => generated 0 bytes in 1364 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 16:21:29.082048 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f7a1367a-89ef-4373-9cb0-f683be3c2e8c tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:29.083437 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f7a1367a-89ef-4373-9cb0-f683be3c2e8c tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: ffc6f828-c8ec-4fd6-b69e-9c0230692009] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:29.108151 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f7a1367a-89ef-4373-9cb0-f683be3c2e8c tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:29.110898 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f7a1367a-89ef-4373-9cb0-f683be3c2e8c tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:29.113207 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f7a1367a-89ef-4373-9cb0-f683be3c2e8c tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:29.114763 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f7a1367a-89ef-4373-9cb0-f683be3c2e8c tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:29.116108 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f7a1367a-89ef-4373-9cb0-f683be3c2e8c tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:29.118369 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f7a1367a-89ef-4373-9cb0-f683be3c2e8c tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:29.273484 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-ad130151-4c1a-47e1-9870-54c1a78abb7a req-2a8df853-63a8-4500-afc5-a46e4b43b244 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85a0286b-2e02-4ecb-a63d-0b4a61048ab5", "tag": "b2e423e8-4d65-4e9c-90c7-27d4697688c2"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:21:29.307285 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-ad130151-4c1a-47e1-9870-54c1a78abb7a req-2a8df853-63a8-4500-afc5-a46e4b43b244 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:29.309895 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-ad130151-4c1a-47e1-9870-54c1a78abb7a req-2a8df853-63a8-4500-afc5-a46e4b43b244 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:29.310438 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-ad130151-4c1a-47e1-9870-54c1a78abb7a req-2a8df853-63a8-4500-afc5-a46e4b43b244 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:29.336908 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-ad130151-4c1a-47e1-9870-54c1a78abb7a req-2a8df853-63a8-4500-afc5-a46e4b43b244 service nova] Creating event network-changed:b2e423e8-4d65-4e9c-90c7-27d4697688c2 for instance 85a0286b-2e02-4ecb-a63d-0b4a61048ab5 on n-h1-850499-9 Aug 31 16:21:29.353217 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-ad130151-4c1a-47e1-9870-54c1a78abb7a req-2a8df853-63a8-4500-afc5-a46e4b43b244 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.414665 Aug 31 16:21:29.354714 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2488/5005] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:21:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:21:29.366938 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0364c6bf-0ed9-4c28-9eb2-faf7bcf5c7c7 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:29.368216 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0364c6bf-0ed9-4c28-9eb2-faf7bcf5c7c7 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] [instance: 41e57122-c82d-4f6d-af4f-fca28da61d70] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:29.378571 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0364c6bf-0ed9-4c28-9eb2-faf7bcf5c7c7 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:29.379574 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0364c6bf-0ed9-4c28-9eb2-faf7bcf5c7c7 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:29.380895 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0364c6bf-0ed9-4c28-9eb2-faf7bcf5c7c7 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:29.381809 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0364c6bf-0ed9-4c28-9eb2-faf7bcf5c7c7 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:29.382435 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0364c6bf-0ed9-4c28-9eb2-faf7bcf5c7c7 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:29.383252 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0364c6bf-0ed9-4c28-9eb2-faf7bcf5c7c7 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:29.437097 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0364c6bf-0ed9-4c28-9eb2-faf7bcf5c7c7 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] [instance: 41e57122-c82d-4f6d-af4f-fca28da61d70] Going to try to terminate instance {{(pid=122256) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:21:29.600428 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0364c6bf-0ed9-4c28-9eb2-faf7bcf5c7c7 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] 10.222.0.61 "DELETE /compute/v2.1/servers/41e57122-c82d-4f6d-af4f-fca28da61d70" status: 204 len: 0 microversion: 2.1 time: 0.243490 Aug 31 16:21:29.601557 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2489/5006] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:21:29 2022] DELETE /compute/v2.1/servers/41e57122-c82d-4f6d-af4f-fca28da61d70 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:21:29.611035 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-74a67bf4-7f5d-42d0-a95e-7426ad2582f1 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:21:29.616650 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-74a67bf4-7f5d-42d0-a95e-7426ad2582f1 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: ef42ce7c-829a-47f8-8d9f-68eac68ec20b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:29.629289 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-74a67bf4-7f5d-42d0-a95e-7426ad2582f1 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:29.631301 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-74a67bf4-7f5d-42d0-a95e-7426ad2582f1 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:29.634462 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-74a67bf4-7f5d-42d0-a95e-7426ad2582f1 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:29.635479 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-74a67bf4-7f5d-42d0-a95e-7426ad2582f1 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:29.636657 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-74a67bf4-7f5d-42d0-a95e-7426ad2582f1 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:29.637533 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-74a67bf4-7f5d-42d0-a95e-7426ad2582f1 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:29.745509 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-74a67bf4-7f5d-42d0-a95e-7426ad2582f1 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "POST /compute/v2.1/servers/ef42ce7c-829a-47f8-8d9f-68eac68ec20b/action" status: 200 len: 14 microversion: 2.1 time: 0.142400 Aug 31 16:21:29.746564 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2490/5007] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:21:29 2022] POST /compute/v2.1/servers/ef42ce7c-829a-47f8-8d9f-68eac68ec20b/action => generated 14 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 16:21:29.756853 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-75ea3749-f437-42d2-b30e-333a77b7ae68 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:29.760224 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-75ea3749-f437-42d2-b30e-333a77b7ae68 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] [instance: 41e57122-c82d-4f6d-af4f-fca28da61d70] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:29.785636 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-75ea3749-f437-42d2-b30e-333a77b7ae68 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:29.787264 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-75ea3749-f437-42d2-b30e-333a77b7ae68 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:29.788666 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-75ea3749-f437-42d2-b30e-333a77b7ae68 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:29.789444 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-75ea3749-f437-42d2-b30e-333a77b7ae68 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:29.791739 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-75ea3749-f437-42d2-b30e-333a77b7ae68 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:29.791739 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-75ea3749-f437-42d2-b30e-333a77b7ae68 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:30.149647 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-75ea3749-f437-42d2-b30e-333a77b7ae68 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133688fe60724d979e0bbccf65a28b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f784a8f91774261843e5819cdc6058a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:30.159787 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-75ea3749-f437-42d2-b30e-333a77b7ae68 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] 10.222.0.61 "GET /compute/v2.1/servers/41e57122-c82d-4f6d-af4f-fca28da61d70" status: 200 len: 1509 microversion: 2.1 time: 0.411718 Aug 31 16:21:30.163558 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2491/5008] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:21:29 2022] GET /compute/v2.1/servers/41e57122-c82d-4f6d-af4f-fca28da61d70 => generated 1509 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:21:30.192677 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f7a1367a-89ef-4373-9cb0-f683be3c2e8c tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4744703b964435bbead751ca884d1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e014d4e4da5e47ff9a1261e7730034ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:30.205751 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f7a1367a-89ef-4373-9cb0-f683be3c2e8c tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/ffc6f828-c8ec-4fd6-b69e-9c0230692009" status: 200 len: 1522 microversion: 2.1 time: 1.124598 Aug 31 16:21:30.207924 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2518/5009] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:21:29 2022] GET /compute/v2.1/servers/ffc6f828-c8ec-4fd6-b69e-9c0230692009 => generated 1522 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:21:30.759203 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e4d3e19d-bfde-4861-a09f-4d2ea335673d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:21:30.762891 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e4d3e19d-bfde-4861-a09f-4d2ea335673d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: ef42ce7c-829a-47f8-8d9f-68eac68ec20b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:30.788698 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e4d3e19d-bfde-4861-a09f-4d2ea335673d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:30.791986 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e4d3e19d-bfde-4861-a09f-4d2ea335673d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:30.795284 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e4d3e19d-bfde-4861-a09f-4d2ea335673d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:30.796944 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e4d3e19d-bfde-4861-a09f-4d2ea335673d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:30.797685 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e4d3e19d-bfde-4861-a09f-4d2ea335673d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:30.799914 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e4d3e19d-bfde-4861-a09f-4d2ea335673d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:30.940807 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e4d3e19d-bfde-4861-a09f-4d2ea335673d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "POST /compute/v2.1/servers/ef42ce7c-829a-47f8-8d9f-68eac68ec20b/action" status: 200 len: 14 microversion: 2.1 time: 0.186949 Aug 31 16:21:30.945393 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2492/5010] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:21:30 2022] POST /compute/v2.1/servers/ef42ce7c-829a-47f8-8d9f-68eac68ec20b/action => generated 14 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 31 16:21:31.202618 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c2df2b1e-d8d5-4a86-88b3-458d5b3fb4fe tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:31.206316 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c2df2b1e-d8d5-4a86-88b3-458d5b3fb4fe tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] [instance: 41e57122-c82d-4f6d-af4f-fca28da61d70] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:31.229643 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c2df2b1e-d8d5-4a86-88b3-458d5b3fb4fe tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:31.231602 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c2df2b1e-d8d5-4a86-88b3-458d5b3fb4fe tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:31.233383 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-56104657-4364-40f3-bb6d-dc190d55edc1 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:31.234040 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c2df2b1e-d8d5-4a86-88b3-458d5b3fb4fe tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:31.234174 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-56104657-4364-40f3-bb6d-dc190d55edc1 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: ffc6f828-c8ec-4fd6-b69e-9c0230692009] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:31.235055 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c2df2b1e-d8d5-4a86-88b3-458d5b3fb4fe tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:31.238189 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c2df2b1e-d8d5-4a86-88b3-458d5b3fb4fe tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:31.239088 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c2df2b1e-d8d5-4a86-88b3-458d5b3fb4fe tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:31.257374 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-56104657-4364-40f3-bb6d-dc190d55edc1 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:31.257880 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-56104657-4364-40f3-bb6d-dc190d55edc1 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:31.261822 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-56104657-4364-40f3-bb6d-dc190d55edc1 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:31.263449 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-56104657-4364-40f3-bb6d-dc190d55edc1 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:31.265543 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-56104657-4364-40f3-bb6d-dc190d55edc1 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:31.266175 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-56104657-4364-40f3-bb6d-dc190d55edc1 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:32.022516 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-56104657-4364-40f3-bb6d-dc190d55edc1 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4744703b964435bbead751ca884d1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e014d4e4da5e47ff9a1261e7730034ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:32.042049 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-56104657-4364-40f3-bb6d-dc190d55edc1 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/ffc6f828-c8ec-4fd6-b69e-9c0230692009" status: 200 len: 1522 microversion: 2.1 time: 0.812650 Aug 31 16:21:32.067810 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2493/5011] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:21:31 2022] GET /compute/v2.1/servers/ffc6f828-c8ec-4fd6-b69e-9c0230692009 => generated 1522 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:21:32.067810 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-871fd57d-5e9a-46a7-b9eb-82c07929f03b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:21:32.076103 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-871fd57d-5e9a-46a7-b9eb-82c07929f03b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: ef42ce7c-829a-47f8-8d9f-68eac68ec20b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:32.083186 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-871fd57d-5e9a-46a7-b9eb-82c07929f03b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:32.084306 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-871fd57d-5e9a-46a7-b9eb-82c07929f03b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:32.084788 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-871fd57d-5e9a-46a7-b9eb-82c07929f03b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:32.085552 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-871fd57d-5e9a-46a7-b9eb-82c07929f03b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:32.089748 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-871fd57d-5e9a-46a7-b9eb-82c07929f03b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:32.090316 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-871fd57d-5e9a-46a7-b9eb-82c07929f03b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:32.094720 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c2df2b1e-d8d5-4a86-88b3-458d5b3fb4fe tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133688fe60724d979e0bbccf65a28b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f784a8f91774261843e5819cdc6058a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:32.107801 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c2df2b1e-d8d5-4a86-88b3-458d5b3fb4fe tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] 10.222.0.61 "GET /compute/v2.1/servers/41e57122-c82d-4f6d-af4f-fca28da61d70" status: 200 len: 1509 microversion: 2.1 time: 0.921024 Aug 31 16:21:32.126036 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2519/5012] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:21:31 2022] GET /compute/v2.1/servers/41e57122-c82d-4f6d-af4f-fca28da61d70 => generated 1509 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:21:32.200931 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-871fd57d-5e9a-46a7-b9eb-82c07929f03b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "POST /compute/v2.1/servers/ef42ce7c-829a-47f8-8d9f-68eac68ec20b/action" status: 200 len: 14 microversion: 2.1 time: 0.143430 Aug 31 16:21:32.201603 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2494/5013] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:21:32 2022] POST /compute/v2.1/servers/ef42ce7c-829a-47f8-8d9f-68eac68ec20b/action => generated 14 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 16:21:33.068812 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a2b26511-3d66-4224-aa52-b5a22f236180 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:33.071264 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a2b26511-3d66-4224-aa52-b5a22f236180 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: ffc6f828-c8ec-4fd6-b69e-9c0230692009] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:33.083622 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a2b26511-3d66-4224-aa52-b5a22f236180 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:33.088340 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a2b26511-3d66-4224-aa52-b5a22f236180 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:33.089037 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a2b26511-3d66-4224-aa52-b5a22f236180 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:33.089966 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a2b26511-3d66-4224-aa52-b5a22f236180 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:33.090599 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a2b26511-3d66-4224-aa52-b5a22f236180 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:33.091200 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a2b26511-3d66-4224-aa52-b5a22f236180 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:33.141640 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8545a223-2e7e-4432-a051-95af94f9a323 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:33.142407 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8545a223-2e7e-4432-a051-95af94f9a323 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] [instance: 41e57122-c82d-4f6d-af4f-fca28da61d70] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:33.159183 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8545a223-2e7e-4432-a051-95af94f9a323 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:33.160169 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8545a223-2e7e-4432-a051-95af94f9a323 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:33.160635 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8545a223-2e7e-4432-a051-95af94f9a323 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:33.164544 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8545a223-2e7e-4432-a051-95af94f9a323 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:33.165054 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8545a223-2e7e-4432-a051-95af94f9a323 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:33.165513 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8545a223-2e7e-4432-a051-95af94f9a323 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:34.182757 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a2b26511-3d66-4224-aa52-b5a22f236180 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4744703b964435bbead751ca884d1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e014d4e4da5e47ff9a1261e7730034ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:34.197735 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a2b26511-3d66-4224-aa52-b5a22f236180 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/ffc6f828-c8ec-4fd6-b69e-9c0230692009" status: 200 len: 1522 microversion: 2.1 time: 1.130943 Aug 31 16:21:34.201170 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2520/5014] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:21:33 2022] GET /compute/v2.1/servers/ffc6f828-c8ec-4fd6-b69e-9c0230692009 => generated 1522 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:21:34.226630 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c9218b95-cad9-4418-b353-051f0eae20aa tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:21:34.236292 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c9218b95-cad9-4418-b353-051f0eae20aa tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: ef42ce7c-829a-47f8-8d9f-68eac68ec20b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:34.269185 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c9218b95-cad9-4418-b353-051f0eae20aa tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:34.269767 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c9218b95-cad9-4418-b353-051f0eae20aa tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:34.270220 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c9218b95-cad9-4418-b353-051f0eae20aa tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:34.272609 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c9218b95-cad9-4418-b353-051f0eae20aa tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:34.273147 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c9218b95-cad9-4418-b353-051f0eae20aa tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:34.273597 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c9218b95-cad9-4418-b353-051f0eae20aa tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:34.338754 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8545a223-2e7e-4432-a051-95af94f9a323 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133688fe60724d979e0bbccf65a28b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f784a8f91774261843e5819cdc6058a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:34.368037 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8545a223-2e7e-4432-a051-95af94f9a323 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] 10.222.0.61 "GET /compute/v2.1/servers/41e57122-c82d-4f6d-af4f-fca28da61d70" status: 200 len: 1509 microversion: 2.1 time: 1.226009 Aug 31 16:21:34.368689 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2495/5015] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:21:33 2022] GET /compute/v2.1/servers/41e57122-c82d-4f6d-af4f-fca28da61d70 => generated 1509 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:21:34.424154 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c9218b95-cad9-4418-b353-051f0eae20aa tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "POST /compute/v2.1/servers/ef42ce7c-829a-47f8-8d9f-68eac68ec20b/action" status: 200 len: 14 microversion: 2.1 time: 0.221420 Aug 31 16:21:34.425516 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2521/5016] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:21:34 2022] POST /compute/v2.1/servers/ef42ce7c-829a-47f8-8d9f-68eac68ec20b/action => generated 14 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 16:21:35.218669 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1005e90e-e271-45e0-a061-7f7cd77342fe tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:35.219293 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1005e90e-e271-45e0-a061-7f7cd77342fe tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: ffc6f828-c8ec-4fd6-b69e-9c0230692009] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:35.233534 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1005e90e-e271-45e0-a061-7f7cd77342fe tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:35.233534 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1005e90e-e271-45e0-a061-7f7cd77342fe tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:35.233861 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1005e90e-e271-45e0-a061-7f7cd77342fe tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:35.238591 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1005e90e-e271-45e0-a061-7f7cd77342fe tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:35.239172 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1005e90e-e271-45e0-a061-7f7cd77342fe tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:35.239656 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1005e90e-e271-45e0-a061-7f7cd77342fe tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:35.310000 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-a9b6c5af-2a3f-41c0-84bb-b934ef7cb776 req-41c19ca9-cb0d-4235-a9a3-5aaef3f60765 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41e57122-c82d-4f6d-af4f-fca28da61d70", "name": "network-vif-deleted", "tag": "aa5919c1-b206-4c36-9030-7581ac0cc0e8"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:21:35.335452 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-a9b6c5af-2a3f-41c0-84bb-b934ef7cb776 req-41c19ca9-cb0d-4235-a9a3-5aaef3f60765 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:35.356350 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-a9b6c5af-2a3f-41c0-84bb-b934ef7cb776 req-41c19ca9-cb0d-4235-a9a3-5aaef3f60765 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:35.357165 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-a9b6c5af-2a3f-41c0-84bb-b934ef7cb776 req-41c19ca9-cb0d-4235-a9a3-5aaef3f60765 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:35.423933 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-a9b6c5af-2a3f-41c0-84bb-b934ef7cb776 req-41c19ca9-cb0d-4235-a9a3-5aaef3f60765 service nova] Creating event network-vif-deleted:aa5919c1-b206-4c36-9030-7581ac0cc0e8 for instance 41e57122-c82d-4f6d-af4f-fca28da61d70 on n-h2-850499-9 Aug 31 16:21:35.431540 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-a9b6c5af-2a3f-41c0-84bb-b934ef7cb776 req-41c19ca9-cb0d-4235-a9a3-5aaef3f60765 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125873 Aug 31 16:21:35.443674 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2522/5017] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:21:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:21:35.465776 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-aaf71d88-9f2d-4bf3-bdc8-767abe163fab tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:35.470358 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-aaf71d88-9f2d-4bf3-bdc8-767abe163fab tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] [instance: 41e57122-c82d-4f6d-af4f-fca28da61d70] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:35.491861 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-aaf71d88-9f2d-4bf3-bdc8-767abe163fab tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:35.505400 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-aaf71d88-9f2d-4bf3-bdc8-767abe163fab tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:35.509266 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-aaf71d88-9f2d-4bf3-bdc8-767abe163fab tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:35.511960 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-aaf71d88-9f2d-4bf3-bdc8-767abe163fab tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:35.513637 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-aaf71d88-9f2d-4bf3-bdc8-767abe163fab tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:35.515803 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-aaf71d88-9f2d-4bf3-bdc8-767abe163fab tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:35.729698 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-aaf71d88-9f2d-4bf3-bdc8-767abe163fab tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133688fe60724d979e0bbccf65a28b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f784a8f91774261843e5819cdc6058a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:35.741858 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1005e90e-e271-45e0-a061-7f7cd77342fe tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4744703b964435bbead751ca884d1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e014d4e4da5e47ff9a1261e7730034ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:35.779121 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-aaf71d88-9f2d-4bf3-bdc8-767abe163fab tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] 10.222.0.61 "GET /compute/v2.1/servers/41e57122-c82d-4f6d-af4f-fca28da61d70" status: 200 len: 1294 microversion: 2.1 time: 0.333186 Aug 31 16:21:35.784112 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2523/5018] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:21:35 2022] GET /compute/v2.1/servers/41e57122-c82d-4f6d-af4f-fca28da61d70 => generated 1294 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:21:35.798125 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1005e90e-e271-45e0-a061-7f7cd77342fe tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/ffc6f828-c8ec-4fd6-b69e-9c0230692009" status: 200 len: 1502 microversion: 2.1 time: 0.564296 Aug 31 16:21:35.800446 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2496/5019] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:21:35 2022] GET /compute/v2.1/servers/ffc6f828-c8ec-4fd6-b69e-9c0230692009 => generated 1502 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:21:35.806270 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ef7807bd-281c-4019-9234-611373c2b5b0 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:21:35.809701 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ef7807bd-281c-4019-9234-611373c2b5b0 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: ef42ce7c-829a-47f8-8d9f-68eac68ec20b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:35.810597 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-49fda5bf-ab83-48f1-bb49-df39db0cd367 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "29927b8d-6121-4ee5-8008-2ffe1dbb812c"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:21:35.812938 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-49fda5bf-ab83-48f1-bb49-df39db0cd367 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: ffc6f828-c8ec-4fd6-b69e-9c0230692009] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:35.828917 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ef7807bd-281c-4019-9234-611373c2b5b0 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:35.830357 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ef7807bd-281c-4019-9234-611373c2b5b0 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:35.831195 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ef7807bd-281c-4019-9234-611373c2b5b0 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:35.831836 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-49fda5bf-ab83-48f1-bb49-df39db0cd367 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:35.832424 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-49fda5bf-ab83-48f1-bb49-df39db0cd367 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:35.832791 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-49fda5bf-ab83-48f1-bb49-df39db0cd367 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:35.833110 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ef7807bd-281c-4019-9234-611373c2b5b0 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:35.833496 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-49fda5bf-ab83-48f1-bb49-df39db0cd367 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:35.834757 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-49fda5bf-ab83-48f1-bb49-df39db0cd367 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:35.834957 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-49fda5bf-ab83-48f1-bb49-df39db0cd367 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:35.835584 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ef7807bd-281c-4019-9234-611373c2b5b0 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:35.836336 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ef7807bd-281c-4019-9234-611373c2b5b0 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:35.885955 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-49fda5bf-ab83-48f1-bb49-df39db0cd367 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] HTTP exception thrown: Cannot 'attach_volume' instance ffc6f828-c8ec-4fd6-b69e-9c0230692009 while it is in vm_state rescued Aug 31 16:21:35.887724 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-49fda5bf-ab83-48f1-bb49-df39db0cd367 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Request method failure captured: Aug 31 16:21:35.887724 n-d-850499-9 devstack@n-api.service[122256]: request: POST /compute/v2.1/servers/ffc6f828-c8ec-4fd6-b69e-9c0230692009/os-volume_attachments HTTP/1.1 Aug 31 16:21:35.887724 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:21:35.887724 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:21:35.887724 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:21:35.887724 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 74 Aug 31 16:21:35.887724 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:21:35.887724 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:21:35.887724 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:21:35.887724 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:21:35.887724 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4oy7qo0hac0I9IpX9ONeLQn5FXZxTJLjhjMB-WYHPcUUf61xQVdU4TOXEJINvaGC5c5Wjhk9pb4p_bnOvsu8HLsM1WUDttS1HJeEirzVfdDQ2PqvMBOo0UbRSxhckjuHlfQOCH8lv8yi1i-W11nad5j2vdw9RWWfX0Cd51S12MLuko Aug 31 16:21:35.887724 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:21:35.887724 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:21:35.887724 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:21:35.887724 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:21:35.887724 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:21:35.887724 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:21:35.887724 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: e014d4e4da5e47ff9a1261e7730034ac Aug 31 16:21:35.887724 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1963116327 Aug 31 16:21:35.887724 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:21:35.887724 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:21:35.887724 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e014d4e4da5e47ff9a1261e7730034ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/e014d4e4da5e47ff9a1261e7730034ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_e014d4e4da5e47ff9a1261e7730034ac", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e014d4e4da5e47ff9a1261e7730034ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:21:35.887724 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1963116327 Aug 31 16:21:35.887724 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: e014d4e4da5e47ff9a1261e7730034ac Aug 31 16:21:35.887724 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1963116327 Aug 31 16:21:35.887724 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ServerRescueNegativeTestJSON-1963116327-project Aug 31 16:21:35.887724 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:21:35.887724 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:21:35.887724 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: e4744703b964435bbead751ca884d1ae Aug 31 16:21:35.887724 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1963116327-project Aug 31 16:21:35.887724 n-d-850499-9 devstack@n-api.service[122256]: Aug 31 16:21:35.887724 n-d-850499-9 devstack@n-api.service[122256]: {"volumeAttachment": {"volumeId": "29927b8d-6121-4ee5-8008-2ffe1dbb812c"}} Aug 31 16:21:35.887724 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:21:35.887724 n-d-850499-9 devstack@n-api.service[122256]: exception: Cannot 'attach_volume' instance ffc6f828-c8ec-4fd6-b69e-9c0230692009 while it is in vm_state rescued Aug 31 16:21:35.887724 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'server_id': 'ffc6f828-c8ec-4fd6-b69e-9c0230692009', 'body': {'volumeAttachment': {'volumeId': '29927b8d-6121-4ee5-8008-2ffe1dbb812c'}}} Aug 31 16:21:35.887724 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:21:35.887724 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:21:35.887724 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 31 16:21:35.887724 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 31 16:21:35.887724 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 16:21:35.887724 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 16:21:35.887724 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 31 16:21:35.887724 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 31 16:21:35.887724 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ffc6f828-c8ec-4fd6-b69e-9c0230692009 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 31 16:21:35.887724 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:21:35.887724 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:21:35.887724 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:21:35.887724 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:21:35.887724 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:21:35.887724 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:21:35.887724 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:21:35.887724 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:21:35.887724 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:21:35.887724 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:21:35.887724 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:21:35.887724 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:21:35.887724 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:21:35.887724 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:21:35.887724 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:21:35.887724 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:21:35.887724 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 31 16:21:35.887724 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 31 16:21:35.892618 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 31 16:21:35.892618 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 31 16:21:35.892618 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance ffc6f828-c8ec-4fd6-b69e-9c0230692009 while it is in vm_state rescued Aug 31 16:21:35.892618 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:21:35.892618 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:21:35.892618 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:21:35.892618 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:21:35.892618 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:21:35.892618 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:21:35.892618 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:21:35.892618 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:21:35.892618 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance ffc6f828-c8ec-4fd6-b69e-9c0230692009 while it is in vm_state rescued Aug 31 16:21:35.892618 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:21:35.892618 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-49fda5bf-ab83-48f1-bb49-df39db0cd367 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Returning 409 to user: Cannot 'attach_volume' instance ffc6f828-c8ec-4fd6-b69e-9c0230692009 while it is in vm_state rescued {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:21:35.892618 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-49fda5bf-ab83-48f1-bb49-df39db0cd367 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "POST /compute/v2.1/servers/ffc6f828-c8ec-4fd6-b69e-9c0230692009/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.082801 Aug 31 16:21:35.903914 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2497/5020] 10.222.0.61 () {60 vars in 1323 bytes} [Wed Aug 31 16:21:35 2022] POST /compute/v2.1/servers/ffc6f828-c8ec-4fd6-b69e-9c0230692009/os-volume_attachments => generated 152 bytes in 98 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 31 16:21:35.909167 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-95273f70-3bba-44e1-b187-04cf0c767643 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:21:35.909682 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-95273f70-3bba-44e1-b187-04cf0c767643 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: ffc6f828-c8ec-4fd6-b69e-9c0230692009] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:35.923213 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-95273f70-3bba-44e1-b187-04cf0c767643 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:35.923749 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-95273f70-3bba-44e1-b187-04cf0c767643 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:35.924197 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-95273f70-3bba-44e1-b187-04cf0c767643 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:35.924909 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-95273f70-3bba-44e1-b187-04cf0c767643 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:35.925371 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-95273f70-3bba-44e1-b187-04cf0c767643 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:35.925804 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-95273f70-3bba-44e1-b187-04cf0c767643 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:35.968773 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ef7807bd-281c-4019-9234-611373c2b5b0 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "POST /compute/v2.1/servers/ef42ce7c-829a-47f8-8d9f-68eac68ec20b/action" status: 200 len: 14 microversion: 2.1 time: 0.167892 Aug 31 16:21:35.975670 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2524/5021] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:21:35 2022] POST /compute/v2.1/servers/ef42ce7c-829a-47f8-8d9f-68eac68ec20b/action => generated 14 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 16:21:36.104294 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-95273f70-3bba-44e1-b187-04cf0c767643 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "POST /compute/v2.1/servers/ffc6f828-c8ec-4fd6-b69e-9c0230692009/action" status: 202 len: 0 microversion: 2.1 time: 0.198918 Aug 31 16:21:36.107906 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2498/5022] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:21:35 2022] POST /compute/v2.1/servers/ffc6f828-c8ec-4fd6-b69e-9c0230692009/action => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:21:36.114325 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-503dad82-eac8-45e9-994b-a444d5afe237 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:36.115273 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-503dad82-eac8-45e9-994b-a444d5afe237 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: ffc6f828-c8ec-4fd6-b69e-9c0230692009] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:36.129952 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-503dad82-eac8-45e9-994b-a444d5afe237 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:36.131256 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-503dad82-eac8-45e9-994b-a444d5afe237 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:36.135798 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-503dad82-eac8-45e9-994b-a444d5afe237 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:36.137182 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-503dad82-eac8-45e9-994b-a444d5afe237 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:36.137912 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-503dad82-eac8-45e9-994b-a444d5afe237 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:36.140075 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-503dad82-eac8-45e9-994b-a444d5afe237 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:36.807601 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ca06093f-340b-4137-975b-97a99eaaebf9 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:36.808626 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ca06093f-340b-4137-975b-97a99eaaebf9 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] [instance: 41e57122-c82d-4f6d-af4f-fca28da61d70] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:36.814520 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-503dad82-eac8-45e9-994b-a444d5afe237 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4744703b964435bbead751ca884d1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e014d4e4da5e47ff9a1261e7730034ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:36.816188 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ca06093f-340b-4137-975b-97a99eaaebf9 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:36.816697 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ca06093f-340b-4137-975b-97a99eaaebf9 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:36.817138 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ca06093f-340b-4137-975b-97a99eaaebf9 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:36.818867 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ca06093f-340b-4137-975b-97a99eaaebf9 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:36.819958 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ca06093f-340b-4137-975b-97a99eaaebf9 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:36.820613 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ca06093f-340b-4137-975b-97a99eaaebf9 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:36.826725 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-503dad82-eac8-45e9-994b-a444d5afe237 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/ffc6f828-c8ec-4fd6-b69e-9c0230692009" status: 200 len: 1510 microversion: 2.1 time: 0.716673 Aug 31 16:21:36.839192 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-ca06093f-340b-4137-975b-97a99eaaebf9 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] HTTP exception thrown: Instance 41e57122-c82d-4f6d-af4f-fca28da61d70 could not be found. Aug 31 16:21:36.840919 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ca06093f-340b-4137-975b-97a99eaaebf9 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Request method failure captured: Aug 31 16:21:36.840919 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/41e57122-c82d-4f6d-af4f-fca28da61d70 HTTP/1.1 Aug 31 16:21:36.840919 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:21:36.840919 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:21:36.840919 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:21:36.840919 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:21:36.840919 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:21:36.840919 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:21:36.840919 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:21:36.840919 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:21:36.840919 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4oWvDxIrI898l4wukPXc9S2zfeSzImTPRHUeA-mWTt-7_XFck8mTJUDR884EU0K_IgcUP4GOY9sIKCcO0qfbSXNVB9YJgHXG098AcEHYFT0QwHjPJ29SgEYx3GfviglnuIkDVoPockOww5k_tEgXcfhKlEbXmBvXGGIjgrGPeyW7PU Aug 31 16:21:36.840919 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:21:36.840919 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:21:36.840919 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:21:36.840919 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:21:36.840919 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:21:36.840919 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:21:36.840919 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 9f784a8f91774261843e5819cdc6058a Aug 31 16:21:36.840919 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-65832642 Aug 31 16:21:36.840919 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:21:36.840919 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:21:36.840919 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9f784a8f91774261843e5819cdc6058a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9f784a8f91774261843e5819cdc6058a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9f784a8f91774261843e5819cdc6058a", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9f784a8f91774261843e5819cdc6058a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:21:36.840919 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-65832642 Aug 31 16:21:36.840919 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 9f784a8f91774261843e5819cdc6058a Aug 31 16:21:36.840919 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-65832642 Aug 31 16:21:36.840919 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ServerRescueTestJSONUnderV235-65832642-project Aug 31 16:21:36.840919 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:21:36.840919 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:21:36.840919 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 133688fe60724d979e0bbccf65a28b4d Aug 31 16:21:36.840919 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-65832642-project Aug 31 16:21:36.840919 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:21:36.840919 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance 41e57122-c82d-4f6d-af4f-fca28da61d70 could not be found. Aug 31 16:21:36.840919 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '41e57122-c82d-4f6d-af4f-fca28da61d70'} Aug 31 16:21:36.840919 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:21:36.840919 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:21:36.840919 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:21:36.840919 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:21:36.840919 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:21:36.840919 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:21:36.840919 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:21:36.840919 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:21:36.840919 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:21:36.840919 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:21:36.840919 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41e57122-c82d-4f6d-af4f-fca28da61d70 could not be found. Aug 31 16:21:36.840919 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:21:36.840919 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:21:36.840919 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:21:36.840919 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:21:36.840919 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:21:36.840919 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:21:36.840919 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:21:36.840919 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:21:36.840919 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:21:36.840919 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:21:36.840919 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:21:36.840919 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:21:36.840919 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:21:36.840919 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:21:36.840919 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:21:36.840919 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:21:36.840919 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41e57122-c82d-4f6d-af4f-fca28da61d70 could not be found. Aug 31 16:21:36.840919 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:21:36.840919 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:21:36.845852 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:21:36.845852 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:21:36.845852 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:21:36.845852 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:21:36.845852 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:21:36.845852 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:21:36.845852 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41e57122-c82d-4f6d-af4f-fca28da61d70 could not be found. Aug 31 16:21:36.845852 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:21:36.845852 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ca06093f-340b-4137-975b-97a99eaaebf9 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] Returning 404 to user: Instance 41e57122-c82d-4f6d-af4f-fca28da61d70 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:21:36.845852 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ca06093f-340b-4137-975b-97a99eaaebf9 tempest-ServerRescueTestJSONUnderV235-65832642 tempest-ServerRescueTestJSONUnderV235-65832642-project] 10.222.0.61 "GET /compute/v2.1/servers/41e57122-c82d-4f6d-af4f-fca28da61d70" status: 404 len: 111 microversion: 2.1 time: 0.040640 Aug 31 16:21:36.847846 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2525/5023] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:21:36 2022] GET /compute/v2.1/servers/ffc6f828-c8ec-4fd6-b69e-9c0230692009 => generated 1510 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:21:36.848439 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2499/5024] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:21:36 2022] GET /compute/v2.1/servers/41e57122-c82d-4f6d-af4f-fca28da61d70 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 16:21:36.981131 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-fec275a2-53e9-4be2-b68e-0e5c35cc9ba1 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:21:36.983780 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-fec275a2-53e9-4be2-b68e-0e5c35cc9ba1 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: ef42ce7c-829a-47f8-8d9f-68eac68ec20b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:36.992449 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fec275a2-53e9-4be2-b68e-0e5c35cc9ba1 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:36.993356 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fec275a2-53e9-4be2-b68e-0e5c35cc9ba1 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:36.994030 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fec275a2-53e9-4be2-b68e-0e5c35cc9ba1 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:36.994838 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fec275a2-53e9-4be2-b68e-0e5c35cc9ba1 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:36.995365 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fec275a2-53e9-4be2-b68e-0e5c35cc9ba1 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:36.995895 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fec275a2-53e9-4be2-b68e-0e5c35cc9ba1 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:37.073832 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-fec275a2-53e9-4be2-b68e-0e5c35cc9ba1 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "POST /compute/v2.1/servers/ef42ce7c-829a-47f8-8d9f-68eac68ec20b/action" status: 200 len: 14 microversion: 2.1 time: 0.095771 Aug 31 16:21:37.075229 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2526/5025] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:21:36 2022] POST /compute/v2.1/servers/ef42ce7c-829a-47f8-8d9f-68eac68ec20b/action => generated 14 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 31 16:21:37.824153 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-98dd0cd3-6e90-4dc9-914a-e259bdd02c5b tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:37.836500 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-98dd0cd3-6e90-4dc9-914a-e259bdd02c5b tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] [instance: cca485b3-25f2-4a77-a23a-bb9758586ce7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:37.850101 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-98dd0cd3-6e90-4dc9-914a-e259bdd02c5b tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:37.850942 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-98dd0cd3-6e90-4dc9-914a-e259bdd02c5b tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:37.851600 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-98dd0cd3-6e90-4dc9-914a-e259bdd02c5b tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:37.852270 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9436d5f3-32cb-4eae-b105-17319abdde51 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:37.853171 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9436d5f3-32cb-4eae-b105-17319abdde51 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: ffc6f828-c8ec-4fd6-b69e-9c0230692009] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:37.854326 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-98dd0cd3-6e90-4dc9-914a-e259bdd02c5b tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:37.855077 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-98dd0cd3-6e90-4dc9-914a-e259bdd02c5b tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:37.855848 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-98dd0cd3-6e90-4dc9-914a-e259bdd02c5b tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:37.864791 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9436d5f3-32cb-4eae-b105-17319abdde51 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:37.865427 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9436d5f3-32cb-4eae-b105-17319abdde51 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:37.865936 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9436d5f3-32cb-4eae-b105-17319abdde51 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:37.866649 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9436d5f3-32cb-4eae-b105-17319abdde51 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:37.867119 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9436d5f3-32cb-4eae-b105-17319abdde51 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:37.867620 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9436d5f3-32cb-4eae-b105-17319abdde51 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:37.896548 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-98dd0cd3-6e90-4dc9-914a-e259bdd02c5b tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] 10.222.0.61 "GET /compute/v2.1/servers/cca485b3-25f2-4a77-a23a-bb9758586ce7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.076141 Aug 31 16:21:37.904134 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2500/5026] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 16:21:37 2022] GET /compute/v2.1/servers/cca485b3-25f2-4a77-a23a-bb9758586ce7/os-volume_attachments => generated 25 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 16:21:38.050082 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-31b909de-59fa-42ce-a60c-7c613bbe1294 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:38.053112 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-31b909de-59fa-42ce-a60c-7c613bbe1294 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] [instance: cca485b3-25f2-4a77-a23a-bb9758586ce7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:38.059806 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-31b909de-59fa-42ce-a60c-7c613bbe1294 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:38.060703 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-31b909de-59fa-42ce-a60c-7c613bbe1294 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:38.061387 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-31b909de-59fa-42ce-a60c-7c613bbe1294 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:38.063026 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-31b909de-59fa-42ce-a60c-7c613bbe1294 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:38.063780 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-31b909de-59fa-42ce-a60c-7c613bbe1294 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:38.064300 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-31b909de-59fa-42ce-a60c-7c613bbe1294 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:38.101678 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-31b909de-59fa-42ce-a60c-7c613bbe1294 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] 10.222.0.61 "GET /compute/v2.1/servers/cca485b3-25f2-4a77-a23a-bb9758586ce7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055665 Aug 31 16:21:38.102624 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2501/5027] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 16:21:38 2022] GET /compute/v2.1/servers/cca485b3-25f2-4a77-a23a-bb9758586ce7/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 31 16:21:38.114846 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ac5f160e-945e-4386-8a9e-1999cca866b1 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:21:38.118685 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ac5f160e-945e-4386-8a9e-1999cca866b1 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: ef42ce7c-829a-47f8-8d9f-68eac68ec20b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:38.126786 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ac5f160e-945e-4386-8a9e-1999cca866b1 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:38.127762 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ac5f160e-945e-4386-8a9e-1999cca866b1 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:38.128432 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ac5f160e-945e-4386-8a9e-1999cca866b1 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:38.129595 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ac5f160e-945e-4386-8a9e-1999cca866b1 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:38.130334 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ac5f160e-945e-4386-8a9e-1999cca866b1 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:38.132129 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ac5f160e-945e-4386-8a9e-1999cca866b1 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:38.248375 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ac5f160e-945e-4386-8a9e-1999cca866b1 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "POST /compute/v2.1/servers/ef42ce7c-829a-47f8-8d9f-68eac68ec20b/action" status: 200 len: 8204 microversion: 2.1 time: 0.141915 Aug 31 16:21:38.250694 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2502/5028] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:21:38 2022] POST /compute/v2.1/servers/ef42ce7c-829a-47f8-8d9f-68eac68ec20b/action => generated 8204 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:21:38.261059 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d5eeb4ad-34ce-4a96-8307-14dce6ac7bbd tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:38.261652 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d5eeb4ad-34ce-4a96-8307-14dce6ac7bbd tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] [instance: cca485b3-25f2-4a77-a23a-bb9758586ce7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:38.273102 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d5eeb4ad-34ce-4a96-8307-14dce6ac7bbd tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:38.274457 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d5eeb4ad-34ce-4a96-8307-14dce6ac7bbd tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:38.275457 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d5eeb4ad-34ce-4a96-8307-14dce6ac7bbd tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:38.277379 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d5eeb4ad-34ce-4a96-8307-14dce6ac7bbd tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:38.278759 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d5eeb4ad-34ce-4a96-8307-14dce6ac7bbd tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:38.279816 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d5eeb4ad-34ce-4a96-8307-14dce6ac7bbd tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:38.325549 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d5eeb4ad-34ce-4a96-8307-14dce6ac7bbd tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] [instance: cca485b3-25f2-4a77-a23a-bb9758586ce7] Going to try to terminate instance {{(pid=122256) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:21:38.332743 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:21:38.455299 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d5eeb4ad-34ce-4a96-8307-14dce6ac7bbd tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] 10.222.0.61 "DELETE /compute/v2.1/servers/cca485b3-25f2-4a77-a23a-bb9758586ce7" status: 204 len: 0 microversion: 2.1 time: 0.202640 Aug 31 16:21:38.459921 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2503/5029] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:21:38 2022] DELETE /compute/v2.1/servers/cca485b3-25f2-4a77-a23a-bb9758586ce7 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:21:38.466047 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0a577056-be05-4ae1-b059-4434bf1fe6e1 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:38.468410 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0a577056-be05-4ae1-b059-4434bf1fe6e1 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:38.478267 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0a577056-be05-4ae1-b059-4434bf1fe6e1 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:38.480227 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0a577056-be05-4ae1-b059-4434bf1fe6e1 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:38.480686 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0a577056-be05-4ae1-b059-4434bf1fe6e1 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:38.481437 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0a577056-be05-4ae1-b059-4434bf1fe6e1 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:38.482056 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0a577056-be05-4ae1-b059-4434bf1fe6e1 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:38.482493 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0a577056-be05-4ae1-b059-4434bf1fe6e1 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:38.816474 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9436d5f3-32cb-4eae-b105-17319abdde51 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4744703b964435bbead751ca884d1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e014d4e4da5e47ff9a1261e7730034ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:38.830772 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9436d5f3-32cb-4eae-b105-17319abdde51 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/ffc6f828-c8ec-4fd6-b69e-9c0230692009" status: 200 len: 1510 microversion: 2.1 time: 0.984264 Aug 31 16:21:38.846864 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2527/5030] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:21:37 2022] GET /compute/v2.1/servers/ffc6f828-c8ec-4fd6-b69e-9c0230692009 => generated 1510 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:21:38.853493 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-239bfd9c-3b6a-4234-bfe9-3c21279f4a5b tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:38.854232 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-239bfd9c-3b6a-4234-bfe9-3c21279f4a5b tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] [instance: cca485b3-25f2-4a77-a23a-bb9758586ce7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:38.863283 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-239bfd9c-3b6a-4234-bfe9-3c21279f4a5b tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:38.864232 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-239bfd9c-3b6a-4234-bfe9-3c21279f4a5b tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:38.865661 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-239bfd9c-3b6a-4234-bfe9-3c21279f4a5b tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:38.866940 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-239bfd9c-3b6a-4234-bfe9-3c21279f4a5b tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:38.867935 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-239bfd9c-3b6a-4234-bfe9-3c21279f4a5b tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:38.868552 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-239bfd9c-3b6a-4234-bfe9-3c21279f4a5b tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:39.049290 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-0a577056-be05-4ae1-b059-4434bf1fe6e1 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:39.066801 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0a577056-be05-4ae1-b059-4434bf1fe6e1 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1668 microversion: 2.1 time: 0.604263 Aug 31 16:21:39.074617 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2504/5031] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:21:38 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1668 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:21:39.093011 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2744294d-e8da-4a53-81e6-e97cc2ba4e7e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:39.093938 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2744294d-e8da-4a53-81e6-e97cc2ba4e7e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:39.101642 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2744294d-e8da-4a53-81e6-e97cc2ba4e7e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:39.102440 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2744294d-e8da-4a53-81e6-e97cc2ba4e7e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:39.103041 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2744294d-e8da-4a53-81e6-e97cc2ba4e7e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:39.103974 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2744294d-e8da-4a53-81e6-e97cc2ba4e7e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:39.104673 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2744294d-e8da-4a53-81e6-e97cc2ba4e7e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:39.105316 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2744294d-e8da-4a53-81e6-e97cc2ba4e7e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:39.303394 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-239bfd9c-3b6a-4234-bfe9-3c21279f4a5b tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed06378eb9b446680b5a3156a14941d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511432a7dee4bec9d1093c9d95b3734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:39.321949 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-239bfd9c-3b6a-4234-bfe9-3c21279f4a5b tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] 10.222.0.61 "GET /compute/v2.1/servers/cca485b3-25f2-4a77-a23a-bb9758586ce7" status: 200 len: 1671 microversion: 2.1 time: 0.473752 Aug 31 16:21:39.322877 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2528/5032] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:21:38 2022] GET /compute/v2.1/servers/cca485b3-25f2-4a77-a23a-bb9758586ce7 => generated 1671 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:21:39.527406 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-2744294d-e8da-4a53-81e6-e97cc2ba4e7e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:39.542399 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2744294d-e8da-4a53-81e6-e97cc2ba4e7e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1668 microversion: 2.1 time: 0.453256 Aug 31 16:21:39.544825 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2505/5033] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:21:39 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1668 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:21:39.578720 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-670c32ea-cb14-439b-819e-99138f5f8ae4 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:39.580523 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-670c32ea-cb14-439b-819e-99138f5f8ae4 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:39.592983 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-670c32ea-cb14-439b-819e-99138f5f8ae4 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:39.596622 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-670c32ea-cb14-439b-819e-99138f5f8ae4 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:39.597781 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-670c32ea-cb14-439b-819e-99138f5f8ae4 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:39.599652 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-670c32ea-cb14-439b-819e-99138f5f8ae4 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:39.601574 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-670c32ea-cb14-439b-819e-99138f5f8ae4 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:39.602583 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-670c32ea-cb14-439b-819e-99138f5f8ae4 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:39.860635 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4707f2ad-e5c1-4b54-b27a-3347c60e7858 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:39.862229 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4707f2ad-e5c1-4b54-b27a-3347c60e7858 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: ffc6f828-c8ec-4fd6-b69e-9c0230692009] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:39.878322 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4707f2ad-e5c1-4b54-b27a-3347c60e7858 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:39.879388 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4707f2ad-e5c1-4b54-b27a-3347c60e7858 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:39.879972 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4707f2ad-e5c1-4b54-b27a-3347c60e7858 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:39.881798 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4707f2ad-e5c1-4b54-b27a-3347c60e7858 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:39.882508 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4707f2ad-e5c1-4b54-b27a-3347c60e7858 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:39.883229 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4707f2ad-e5c1-4b54-b27a-3347c60e7858 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:39.973280 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-670c32ea-cb14-439b-819e-99138f5f8ae4 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:39.981227 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-670c32ea-cb14-439b-819e-99138f5f8ae4 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1668 microversion: 2.1 time: 0.409025 Aug 31 16:21:39.982716 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2529/5034] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:21:39 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1668 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:21:40.003308 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-cfb14f56-7d62-468a-a327-c4e5bb3f4af7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:40.004591 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-cfb14f56-7d62-468a-a327-c4e5bb3f4af7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:40.019185 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cfb14f56-7d62-468a-a327-c4e5bb3f4af7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:40.019840 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cfb14f56-7d62-468a-a327-c4e5bb3f4af7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:40.020487 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cfb14f56-7d62-468a-a327-c4e5bb3f4af7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:40.023829 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cfb14f56-7d62-468a-a327-c4e5bb3f4af7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:40.024567 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cfb14f56-7d62-468a-a327-c4e5bb3f4af7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:40.025198 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cfb14f56-7d62-468a-a327-c4e5bb3f4af7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:40.412643 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-4707f2ad-e5c1-4b54-b27a-3347c60e7858 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4744703b964435bbead751ca884d1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e014d4e4da5e47ff9a1261e7730034ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:40.424364 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4707f2ad-e5c1-4b54-b27a-3347c60e7858 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/ffc6f828-c8ec-4fd6-b69e-9c0230692009" status: 200 len: 1510 microversion: 2.1 time: 0.569733 Aug 31 16:21:40.425301 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2506/5035] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:21:39 2022] GET /compute/v2.1/servers/ffc6f828-c8ec-4fd6-b69e-9c0230692009 => generated 1510 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:21:40.438286 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-924d37cb-073b-41cc-9bcd-7616a84c7c26 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:40.438984 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-924d37cb-073b-41cc-9bcd-7616a84c7c26 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] [instance: cca485b3-25f2-4a77-a23a-bb9758586ce7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:40.453515 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-924d37cb-073b-41cc-9bcd-7616a84c7c26 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:40.454100 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-924d37cb-073b-41cc-9bcd-7616a84c7c26 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:40.454557 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-924d37cb-073b-41cc-9bcd-7616a84c7c26 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:40.455350 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-924d37cb-073b-41cc-9bcd-7616a84c7c26 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:40.455895 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-924d37cb-073b-41cc-9bcd-7616a84c7c26 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:40.456384 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-924d37cb-073b-41cc-9bcd-7616a84c7c26 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:40.557723 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-cfb14f56-7d62-468a-a327-c4e5bb3f4af7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:40.563762 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:21:40.572347 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-cfb14f56-7d62-468a-a327-c4e5bb3f4af7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1668 microversion: 2.1 time: 0.574012 Aug 31 16:21:40.572944 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2530/5036] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:21:39 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1668 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:21:40.604219 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-fef5f791-0814-4a5c-8655-b1fd699f697a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:21:40.607190 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-fef5f791-0814-4a5c-8655-b1fd699f697a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:40.623874 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fef5f791-0814-4a5c-8655-b1fd699f697a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:40.624355 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fef5f791-0814-4a5c-8655-b1fd699f697a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:40.624814 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fef5f791-0814-4a5c-8655-b1fd699f697a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:40.625549 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fef5f791-0814-4a5c-8655-b1fd699f697a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:40.626021 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fef5f791-0814-4a5c-8655-b1fd699f697a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:40.626461 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fef5f791-0814-4a5c-8655-b1fd699f697a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:40.707942 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-fef5f791-0814-4a5c-8655-b1fd699f697a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Locking {{(pid=122257) lock /opt/stack/nova/nova/compute/api.py:4843}} Aug 31 16:21:40.803608 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-fef5f791-0814-4a5c-8655-b1fd699f697a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "POST /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c/action" status: 202 len: 0 microversion: 2.1 time: 0.213237 Aug 31 16:21:40.805106 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2531/5037] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:21:40 2022] POST /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c/action => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 16:21:40.841494 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2e91be25-5d09-497d-9196-e65ca6479225 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:40.842161 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2e91be25-5d09-497d-9196-e65ca6479225 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:40.862207 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2e91be25-5d09-497d-9196-e65ca6479225 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:40.863199 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2e91be25-5d09-497d-9196-e65ca6479225 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:40.870069 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2e91be25-5d09-497d-9196-e65ca6479225 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:40.879344 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2e91be25-5d09-497d-9196-e65ca6479225 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:40.880157 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2e91be25-5d09-497d-9196-e65ca6479225 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:40.881728 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2e91be25-5d09-497d-9196-e65ca6479225 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:41.157790 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-924d37cb-073b-41cc-9bcd-7616a84c7c26 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed06378eb9b446680b5a3156a14941d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511432a7dee4bec9d1093c9d95b3734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:41.167196 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-924d37cb-073b-41cc-9bcd-7616a84c7c26 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] 10.222.0.61 "GET /compute/v2.1/servers/cca485b3-25f2-4a77-a23a-bb9758586ce7" status: 200 len: 1671 microversion: 2.1 time: 0.740736 Aug 31 16:21:41.168141 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2507/5038] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:21:40 2022] GET /compute/v2.1/servers/cca485b3-25f2-4a77-a23a-bb9758586ce7 => generated 1671 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:21:41.466059 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4ca533c7-589a-4f47-8eba-cbdbca38a2bb tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:41.467058 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4ca533c7-589a-4f47-8eba-cbdbca38a2bb tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: ffc6f828-c8ec-4fd6-b69e-9c0230692009] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:41.483919 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4ca533c7-589a-4f47-8eba-cbdbca38a2bb tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:41.485021 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4ca533c7-589a-4f47-8eba-cbdbca38a2bb tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:41.485150 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2e91be25-5d09-497d-9196-e65ca6479225 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:41.485922 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4ca533c7-589a-4f47-8eba-cbdbca38a2bb tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:41.487539 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4ca533c7-589a-4f47-8eba-cbdbca38a2bb tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:41.489443 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4ca533c7-589a-4f47-8eba-cbdbca38a2bb tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:41.490754 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4ca533c7-589a-4f47-8eba-cbdbca38a2bb tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:41.519026 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2e91be25-5d09-497d-9196-e65ca6479225 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1668 microversion: 2.1 time: 0.709304 Aug 31 16:21:41.519998 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2532/5039] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:21:40 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1668 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:21:41.558554 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-eeed02c4-4114-49c2-a4e2-918831b69035 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:21:41.570361 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eeed02c4-4114-49c2-a4e2-918831b69035 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:41.571174 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eeed02c4-4114-49c2-a4e2-918831b69035 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:41.571815 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eeed02c4-4114-49c2-a4e2-918831b69035 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:41.620243 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-eeed02c4-4114-49c2-a4e2-918831b69035 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] HTTP exception thrown: Instance 42ccbb85-9677-4cb9-879a-dc280cda020c is locked Aug 31 16:21:41.625204 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-eeed02c4-4114-49c2-a4e2-918831b69035 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Request method failure captured: Aug 31 16:21:41.625204 n-d-850499-9 devstack@n-api.service[122257]: request: POST /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c/action HTTP/1.1 Aug 31 16:21:41.625204 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:21:41.625204 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:21:41.625204 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:21:41.625204 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 15 Aug 31 16:21:41.625204 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:21:41.625204 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:21:41.625204 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:21:41.625204 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:21:41.625204 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4j4GoXu7a8XS8mokW4AeC842NZnj-uoRrLPe-ymerVUxYrezcAXYukQXkT8IqkMd2mshHtGlo5ORTm-xBrHOK9WFT9PPtSJjPDhKzFxYnOsxBAuHO1I5hUh0kdjx0f_1YsWDM7F8Lwt5dwXM7gNYQ4IaAaTeuNJuCJE3SFroPGrfPQ Aug 31 16:21:41.625204 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:21:41.625204 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:21:41.625204 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:21:41.625204 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:21:41.625204 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:21:41.625204 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:21:41.625204 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: f8fa87d9431f4253b8425593a2150359 Aug 31 16:21:41.625204 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ServerActionsTestJSON-1302460756 Aug 31 16:21:41.625204 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:21:41.625204 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:21:41.625204 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f8fa87d9431f4253b8425593a2150359"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f8fa87d9431f4253b8425593a2150359"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f8fa87d9431f4253b8425593a2150359", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f8fa87d9431f4253b8425593a2150359"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:21:41.625204 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ServerActionsTestJSON-1302460756 Aug 31 16:21:41.625204 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: f8fa87d9431f4253b8425593a2150359 Aug 31 16:21:41.625204 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ServerActionsTestJSON-1302460756 Aug 31 16:21:41.625204 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ServerActionsTestJSON-1302460756-project Aug 31 16:21:41.625204 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:21:41.625204 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:21:41.625204 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: a105ab564f304fa7a2ceba07418a22bc Aug 31 16:21:41.625204 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ServerActionsTestJSON-1302460756-project Aug 31 16:21:41.625204 n-d-850499-9 devstack@n-api.service[122257]: Aug 31 16:21:41.625204 n-d-850499-9 devstack@n-api.service[122257]: {"os-stop": {}} Aug 31 16:21:41.625204 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:21:41.625204 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance 42ccbb85-9677-4cb9-879a-dc280cda020c is locked Aug 31 16:21:41.625204 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '42ccbb85-9677-4cb9-879a-dc280cda020c', 'body': {'os-stop': {}}} Aug 31 16:21:41.625204 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:21:41.625204 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:21:41.625204 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1446, in _stop_server Aug 31 16:21:41.625204 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Aug 31 16:21:41.625204 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Aug 31 16:21:41.625204 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Aug 31 16:21:41.625204 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 42ccbb85-9677-4cb9-879a-dc280cda020c is locked Aug 31 16:21:41.625204 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:21:41.625204 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:21:41.625204 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:21:41.625204 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:21:41.625204 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:21:41.625204 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:21:41.625204 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:21:41.625204 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:21:41.625204 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:21:41.625204 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:21:41.625204 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1448, in _stop_server Aug 31 16:21:41.625204 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Aug 31 16:21:41.625204 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 42ccbb85-9677-4cb9-879a-dc280cda020c is locked Aug 31 16:21:41.625204 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:21:41.625204 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:21:41.625204 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:21:41.625204 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:21:41.625204 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:21:41.625204 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:21:41.625204 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:21:41.625204 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:21:41.625204 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42ccbb85-9677-4cb9-879a-dc280cda020c is locked Aug 31 16:21:41.625204 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:21:41.631722 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-eeed02c4-4114-49c2-a4e2-918831b69035 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Returning 409 to user: Instance 42ccbb85-9677-4cb9-879a-dc280cda020c is locked {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:21:41.633764 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-eeed02c4-4114-49c2-a4e2-918831b69035 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "POST /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c/action" status: 409 len: 107 microversion: 2.1 time: 0.083493 Aug 31 16:21:41.634945 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2533/5040] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:21:41 2022] POST /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c/action => generated 107 bytes in 86 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 31 16:21:41.643973 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5b71fcc5-76f3-4e2b-be4b-0c386fc86f54 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:21:41.644812 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5b71fcc5-76f3-4e2b-be4b-0c386fc86f54 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:41.656921 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b71fcc5-76f3-4e2b-be4b-0c386fc86f54 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:41.657515 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b71fcc5-76f3-4e2b-be4b-0c386fc86f54 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:41.660022 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b71fcc5-76f3-4e2b-be4b-0c386fc86f54 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:41.661384 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b71fcc5-76f3-4e2b-be4b-0c386fc86f54 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:41.664312 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b71fcc5-76f3-4e2b-be4b-0c386fc86f54 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:41.664684 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b71fcc5-76f3-4e2b-be4b-0c386fc86f54 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:41.722683 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5b71fcc5-76f3-4e2b-be4b-0c386fc86f54 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Unlocking {{(pid=122257) unlock /opt/stack/nova/nova/compute/api.py:4872}} Aug 31 16:21:41.791781 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5b71fcc5-76f3-4e2b-be4b-0c386fc86f54 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "POST /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c/action" status: 202 len: 0 microversion: 2.1 time: 0.151906 Aug 31 16:21:41.796316 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2534/5041] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:21:41 2022] POST /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c/action => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:21:41.802736 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8d93e7b8-0905-4725-9603-5aaa38fd00fb tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:21:41.810599 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8d93e7b8-0905-4725-9603-5aaa38fd00fb tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:41.811362 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8d93e7b8-0905-4725-9603-5aaa38fd00fb tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:41.812000 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8d93e7b8-0905-4725-9603-5aaa38fd00fb tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:41.848582 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8d93e7b8-0905-4725-9603-5aaa38fd00fb tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Going to try to stop instance {{(pid=122257) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 31 16:21:41.930874 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8d93e7b8-0905-4725-9603-5aaa38fd00fb tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "POST /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c/action" status: 202 len: 0 microversion: 2.1 time: 0.132783 Aug 31 16:21:41.934513 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2535/5042] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:21:41 2022] POST /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:21:41.942636 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7626e24b-a2f3-4845-8227-4b3430405783 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:41.945091 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7626e24b-a2f3-4845-8227-4b3430405783 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:41.958235 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7626e24b-a2f3-4845-8227-4b3430405783 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:41.959533 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7626e24b-a2f3-4845-8227-4b3430405783 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:41.960637 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7626e24b-a2f3-4845-8227-4b3430405783 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:41.962187 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7626e24b-a2f3-4845-8227-4b3430405783 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:41.963085 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7626e24b-a2f3-4845-8227-4b3430405783 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:41.964661 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7626e24b-a2f3-4845-8227-4b3430405783 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:42.585255 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-4ca533c7-589a-4f47-8eba-cbdbca38a2bb tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4744703b964435bbead751ca884d1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e014d4e4da5e47ff9a1261e7730034ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:42.608946 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4ca533c7-589a-4f47-8eba-cbdbca38a2bb tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/ffc6f828-c8ec-4fd6-b69e-9c0230692009" status: 200 len: 1510 microversion: 2.1 time: 1.161647 Aug 31 16:21:42.610579 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2508/5043] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:21:41 2022] GET /compute/v2.1/servers/ffc6f828-c8ec-4fd6-b69e-9c0230692009 => generated 1510 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:21:42.628353 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b1708fba-9077-47b0-8b1f-99c52e8f07af tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:42.629546 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b1708fba-9077-47b0-8b1f-99c52e8f07af tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] [instance: cca485b3-25f2-4a77-a23a-bb9758586ce7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:42.636621 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:21:42.650836 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b1708fba-9077-47b0-8b1f-99c52e8f07af tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:42.652104 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b1708fba-9077-47b0-8b1f-99c52e8f07af tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:42.653042 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b1708fba-9077-47b0-8b1f-99c52e8f07af tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:42.656432 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b1708fba-9077-47b0-8b1f-99c52e8f07af tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:42.660742 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b1708fba-9077-47b0-8b1f-99c52e8f07af tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:42.662243 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b1708fba-9077-47b0-8b1f-99c52e8f07af tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:42.751528 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7626e24b-a2f3-4845-8227-4b3430405783 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:42.767921 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7626e24b-a2f3-4845-8227-4b3430405783 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1678 microversion: 2.1 time: 0.831285 Aug 31 16:21:42.784175 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2536/5044] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:21:41 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1678 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:21:43.312407 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b1708fba-9077-47b0-8b1f-99c52e8f07af tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed06378eb9b446680b5a3156a14941d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511432a7dee4bec9d1093c9d95b3734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:43.345197 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b1708fba-9077-47b0-8b1f-99c52e8f07af tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] 10.222.0.61 "GET /compute/v2.1/servers/cca485b3-25f2-4a77-a23a-bb9758586ce7" status: 200 len: 1671 microversion: 2.1 time: 0.732220 Aug 31 16:21:43.350386 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2509/5045] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:21:42 2022] GET /compute/v2.1/servers/cca485b3-25f2-4a77-a23a-bb9758586ce7 => generated 1671 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:21:43.649530 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8e0ce4ee-0b9b-4945-8f5e-915b86bf1900 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:43.650865 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8e0ce4ee-0b9b-4945-8f5e-915b86bf1900 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: ffc6f828-c8ec-4fd6-b69e-9c0230692009] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:43.658188 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=66 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:21:43.669288 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8e0ce4ee-0b9b-4945-8f5e-915b86bf1900 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:43.670540 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8e0ce4ee-0b9b-4945-8f5e-915b86bf1900 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:43.671652 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8e0ce4ee-0b9b-4945-8f5e-915b86bf1900 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:43.673224 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8e0ce4ee-0b9b-4945-8f5e-915b86bf1900 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:43.674236 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8e0ce4ee-0b9b-4945-8f5e-915b86bf1900 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:43.675305 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8e0ce4ee-0b9b-4945-8f5e-915b86bf1900 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:43.799749 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c5ef7ca9-2cb1-4ea5-bffb-44abdbb0b268 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:43.804124 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c5ef7ca9-2cb1-4ea5-bffb-44abdbb0b268 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:43.821037 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c5ef7ca9-2cb1-4ea5-bffb-44abdbb0b268 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:43.822722 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c5ef7ca9-2cb1-4ea5-bffb-44abdbb0b268 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:43.823451 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c5ef7ca9-2cb1-4ea5-bffb-44abdbb0b268 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:43.824714 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c5ef7ca9-2cb1-4ea5-bffb-44abdbb0b268 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:43.825335 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c5ef7ca9-2cb1-4ea5-bffb-44abdbb0b268 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:43.825919 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c5ef7ca9-2cb1-4ea5-bffb-44abdbb0b268 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:44.251223 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8e0ce4ee-0b9b-4945-8f5e-915b86bf1900 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4744703b964435bbead751ca884d1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e014d4e4da5e47ff9a1261e7730034ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:44.274812 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8e0ce4ee-0b9b-4945-8f5e-915b86bf1900 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/ffc6f828-c8ec-4fd6-b69e-9c0230692009" status: 200 len: 1516 microversion: 2.1 time: 0.631746 Aug 31 16:21:44.292400 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2537/5046] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:21:43 2022] GET /compute/v2.1/servers/ffc6f828-c8ec-4fd6-b69e-9c0230692009 => generated 1516 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:21:44.367001 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c5ef7ca9-2cb1-4ea5-bffb-44abdbb0b268 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:44.382307 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c5ef7ca9-2cb1-4ea5-bffb-44abdbb0b268 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1678 microversion: 2.1 time: 0.589178 Aug 31 16:21:44.386187 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2510/5047] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:21:43 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1678 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:21:44.403794 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-dec453bd-01ad-4bfd-afb1-3981054d0f03 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:44.404715 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-dec453bd-01ad-4bfd-afb1-3981054d0f03 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] [instance: cca485b3-25f2-4a77-a23a-bb9758586ce7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:44.418322 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dec453bd-01ad-4bfd-afb1-3981054d0f03 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:44.425569 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dec453bd-01ad-4bfd-afb1-3981054d0f03 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:44.431078 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dec453bd-01ad-4bfd-afb1-3981054d0f03 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:44.433526 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dec453bd-01ad-4bfd-afb1-3981054d0f03 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:44.435226 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dec453bd-01ad-4bfd-afb1-3981054d0f03 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:44.435856 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dec453bd-01ad-4bfd-afb1-3981054d0f03 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:45.091128 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-dec453bd-01ad-4bfd-afb1-3981054d0f03 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed06378eb9b446680b5a3156a14941d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511432a7dee4bec9d1093c9d95b3734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:45.108239 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-dec453bd-01ad-4bfd-afb1-3981054d0f03 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] 10.222.0.61 "GET /compute/v2.1/servers/cca485b3-25f2-4a77-a23a-bb9758586ce7" status: 200 len: 1671 microversion: 2.1 time: 0.724587 Aug 31 16:21:45.119595 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2538/5048] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:21:44 2022] GET /compute/v2.1/servers/cca485b3-25f2-4a77-a23a-bb9758586ce7 => generated 1671 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:21:45.314934 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-31517c16-ed5e-40ba-9190-cb99b84e8045 req-bc16347e-8280-4ea6-b85e-8a204bc99f7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cca485b3-25f2-4a77-a23a-bb9758586ce7", "name": "network-vif-unplugged", "status": "completed", "tag": "7da488eb-1222-4197-97d6-7569af34909a"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:21:45.339150 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-31517c16-ed5e-40ba-9190-cb99b84e8045 req-bc16347e-8280-4ea6-b85e-8a204bc99f7b service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:45.339608 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-31517c16-ed5e-40ba-9190-cb99b84e8045 req-bc16347e-8280-4ea6-b85e-8a204bc99f7b service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:45.340057 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-31517c16-ed5e-40ba-9190-cb99b84e8045 req-bc16347e-8280-4ea6-b85e-8a204bc99f7b service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:45.377141 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-31517c16-ed5e-40ba-9190-cb99b84e8045 req-bc16347e-8280-4ea6-b85e-8a204bc99f7b service nova] Creating event network-vif-unplugged:7da488eb-1222-4197-97d6-7569af34909a for instance cca485b3-25f2-4a77-a23a-bb9758586ce7 on n-h2-850499-9 Aug 31 16:21:45.403131 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-31517c16-ed5e-40ba-9190-cb99b84e8045 req-bc16347e-8280-4ea6-b85e-8a204bc99f7b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.091967 Aug 31 16:21:45.408915 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9541997d-0342-4688-bb87-c927af9df5a8 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:45.409538 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9541997d-0342-4688-bb87-c927af9df5a8 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:45.419887 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9541997d-0342-4688-bb87-c927af9df5a8 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:45.420183 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2511/5049] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:21:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:21:45.423711 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9541997d-0342-4688-bb87-c927af9df5a8 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:45.424378 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9541997d-0342-4688-bb87-c927af9df5a8 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:45.425297 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9541997d-0342-4688-bb87-c927af9df5a8 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:45.428323 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9541997d-0342-4688-bb87-c927af9df5a8 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:45.429163 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9541997d-0342-4688-bb87-c927af9df5a8 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:46.134289 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9c6a8326-0113-430a-8bfe-fc24a569f375 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:46.135068 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9c6a8326-0113-430a-8bfe-fc24a569f375 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] [instance: cca485b3-25f2-4a77-a23a-bb9758586ce7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:46.150696 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9c6a8326-0113-430a-8bfe-fc24a569f375 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:46.151215 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9c6a8326-0113-430a-8bfe-fc24a569f375 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:46.166085 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9c6a8326-0113-430a-8bfe-fc24a569f375 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:46.166883 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9c6a8326-0113-430a-8bfe-fc24a569f375 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:46.172717 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9c6a8326-0113-430a-8bfe-fc24a569f375 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:46.173188 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9c6a8326-0113-430a-8bfe-fc24a569f375 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:46.476789 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9541997d-0342-4688-bb87-c927af9df5a8 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:46.499268 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9541997d-0342-4688-bb87-c927af9df5a8 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1678 microversion: 2.1 time: 1.093929 Aug 31 16:21:46.514996 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2539/5050] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:21:45 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1678 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:21:46.774794 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-9c6a8326-0113-430a-8bfe-fc24a569f375 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed06378eb9b446680b5a3156a14941d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511432a7dee4bec9d1093c9d95b3734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:46.799660 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9c6a8326-0113-430a-8bfe-fc24a569f375 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] 10.222.0.61 "GET /compute/v2.1/servers/cca485b3-25f2-4a77-a23a-bb9758586ce7" status: 200 len: 1605 microversion: 2.1 time: 0.669158 Aug 31 16:21:46.809287 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2512/5051] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:21:46 2022] GET /compute/v2.1/servers/cca485b3-25f2-4a77-a23a-bb9758586ce7 => generated 1605 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:21:47.288338 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-aa0644b4-c968-4933-a89e-96af73cce3e9 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Action: 'create', calling method: .version_select at 0x7f5ae3bbe670>, body: {"keypair": {"name": "tempest-keypair-1797165354", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOR0N1Ux/mzdRGzRwHizp9eC4gAQN8DGzD3N5BHBBWRP6er0Xsh9lCH/dF1i0CRzD9domapoBSlyVmXU0JYSl7nIfG36enJBpLgiCldcPxI4ZVQMVFI311YVt3GN8/H15w=="}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:21:47.343671 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-aa0644b4-c968-4933-a89e-96af73cce3e9 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Getting quotas for project e014d4e4da5e47ff9a1261e7730034ac. Resources: {'key_pairs'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:21:47.352881 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-aa0644b4-c968-4933-a89e-96af73cce3e9 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Getting quotas for user e4744703b964435bbead751ca884d1ae and project e014d4e4da5e47ff9a1261e7730034ac. Resources: {'key_pairs'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:21:47.408094 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-aa0644b4-c968-4933-a89e-96af73cce3e9 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.124964 Aug 31 16:21:47.416014 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2540/5052] 10.222.0.61 () {60 vars in 1159 bytes} [Wed Aug 31 16:21:47 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:21:47.491877 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-df6d0d03-f64c-4427-bc5e-e2f1a0e13883 req-d7a5380c-628e-4e5a-9c67-319dabf136c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cca485b3-25f2-4a77-a23a-bb9758586ce7", "name": "network-vif-deleted", "tag": "7da488eb-1222-4197-97d6-7569af34909a"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:21:47.517430 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-df6d0d03-f64c-4427-bc5e-e2f1a0e13883 req-d7a5380c-628e-4e5a-9c67-319dabf136c7 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:47.518181 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-df6d0d03-f64c-4427-bc5e-e2f1a0e13883 req-d7a5380c-628e-4e5a-9c67-319dabf136c7 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:47.518694 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-df6d0d03-f64c-4427-bc5e-e2f1a0e13883 req-d7a5380c-628e-4e5a-9c67-319dabf136c7 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:47.537500 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-bb1b52ee-6e4c-48c2-a465-fd7868434810 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:47.547250 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-bb1b52ee-6e4c-48c2-a465-fd7868434810 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:47.554740 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-df6d0d03-f64c-4427-bc5e-e2f1a0e13883 req-d7a5380c-628e-4e5a-9c67-319dabf136c7 service nova] Creating event network-vif-deleted:7da488eb-1222-4197-97d6-7569af34909a for instance cca485b3-25f2-4a77-a23a-bb9758586ce7 on n-h2-850499-9 Aug 31 16:21:47.567885 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-df6d0d03-f64c-4427-bc5e-e2f1a0e13883 req-d7a5380c-628e-4e5a-9c67-319dabf136c7 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075303 Aug 31 16:21:47.568284 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bb1b52ee-6e4c-48c2-a465-fd7868434810 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:47.568885 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bb1b52ee-6e4c-48c2-a465-fd7868434810 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:47.569368 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bb1b52ee-6e4c-48c2-a465-fd7868434810 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:47.569855 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2513/5053] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:21:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:21:47.570108 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bb1b52ee-6e4c-48c2-a465-fd7868434810 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:47.570577 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bb1b52ee-6e4c-48c2-a465-fd7868434810 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:47.571014 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bb1b52ee-6e4c-48c2-a465-fd7868434810 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:47.823341 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-15855dc9-5287-483d-bd6a-0c1ecf56cebd tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:47.824840 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-15855dc9-5287-483d-bd6a-0c1ecf56cebd tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] [instance: cca485b3-25f2-4a77-a23a-bb9758586ce7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:47.838488 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-15855dc9-5287-483d-bd6a-0c1ecf56cebd tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:47.839768 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-15855dc9-5287-483d-bd6a-0c1ecf56cebd tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:47.847209 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-15855dc9-5287-483d-bd6a-0c1ecf56cebd tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:47.850583 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-15855dc9-5287-483d-bd6a-0c1ecf56cebd tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:47.850943 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-15855dc9-5287-483d-bd6a-0c1ecf56cebd tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:47.855678 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-15855dc9-5287-483d-bd6a-0c1ecf56cebd tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:47.903862 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-15855dc9-5287-483d-bd6a-0c1ecf56cebd tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:47.904366 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-15855dc9-5287-483d-bd6a-0c1ecf56cebd tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:47.904810 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-15855dc9-5287-483d-bd6a-0c1ecf56cebd tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:47.905411 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-15855dc9-5287-483d-bd6a-0c1ecf56cebd tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lazy-loading 'fault' on Instance uuid cca485b3-25f2-4a77-a23a-bb9758586ce7 {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:21:48.048167 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-15855dc9-5287-483d-bd6a-0c1ecf56cebd tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed06378eb9b446680b5a3156a14941d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3511432a7dee4bec9d1093c9d95b3734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:48.060006 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-15855dc9-5287-483d-bd6a-0c1ecf56cebd tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] 10.222.0.61 "GET /compute/v2.1/servers/cca485b3-25f2-4a77-a23a-bb9758586ce7" status: 200 len: 1325 microversion: 2.1 time: 0.241297 Aug 31 16:21:48.072243 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2514/5054] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:21:47 2022] GET /compute/v2.1/servers/cca485b3-25f2-4a77-a23a-bb9758586ce7 => generated 1325 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:21:48.282577 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-bb1b52ee-6e4c-48c2-a465-fd7868434810 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:48.320145 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-bb1b52ee-6e4c-48c2-a465-fd7868434810 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1678 microversion: 2.1 time: 0.787690 Aug 31 16:21:48.323111 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2541/5055] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:21:47 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1678 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:21:49.082251 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c34fffc5-e0ca-4d53-bcf4-62d9d04171fa tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:49.084179 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c34fffc5-e0ca-4d53-bcf4-62d9d04171fa tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] [instance: cca485b3-25f2-4a77-a23a-bb9758586ce7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:49.091321 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c34fffc5-e0ca-4d53-bcf4-62d9d04171fa tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:49.092092 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c34fffc5-e0ca-4d53-bcf4-62d9d04171fa tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:49.092696 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c34fffc5-e0ca-4d53-bcf4-62d9d04171fa tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:49.093563 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c34fffc5-e0ca-4d53-bcf4-62d9d04171fa tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:49.094185 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c34fffc5-e0ca-4d53-bcf4-62d9d04171fa tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:49.094776 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c34fffc5-e0ca-4d53-bcf4-62d9d04171fa tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:49.115048 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-c34fffc5-e0ca-4d53-bcf4-62d9d04171fa tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] HTTP exception thrown: Instance cca485b3-25f2-4a77-a23a-bb9758586ce7 could not be found. Aug 31 16:21:49.118083 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c34fffc5-e0ca-4d53-bcf4-62d9d04171fa tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Request method failure captured: Aug 31 16:21:49.118083 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/cca485b3-25f2-4a77-a23a-bb9758586ce7 HTTP/1.1 Aug 31 16:21:49.118083 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:21:49.118083 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:21:49.118083 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:21:49.118083 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:21:49.118083 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:21:49.118083 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:21:49.118083 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:21:49.118083 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:21:49.118083 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4h75u7LzyI3LiTRnaMEtEGh_oKNi1Al59H9ZBkna-ug3rHwVRzVYTJjImD5IWMxWPmOM60UDHY8-wFzVIU5mmc62NrV2ywLM1HILKrGBC3OkZ2zojw8iZAqohy1LHuIy22Zt-21nf1lXy0v98jU9OvxTkFTMT27YgwY79kYAuiRpls Aug 31 16:21:49.118083 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:21:49.118083 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:21:49.118083 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:21:49.118083 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:21:49.118083 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:21:49.118083 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:21:49.118083 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 3511432a7dee4bec9d1093c9d95b3734 Aug 31 16:21:49.118083 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-AttachVolumeTestJSON-172185859 Aug 31 16:21:49.118083 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:21:49.118083 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:21:49.118083 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/3511432a7dee4bec9d1093c9d95b3734"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/3511432a7dee4bec9d1093c9d95b3734"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_3511432a7dee4bec9d1093c9d95b3734", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/3511432a7dee4bec9d1093c9d95b3734"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:21:49.118083 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-AttachVolumeTestJSON-172185859 Aug 31 16:21:49.118083 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 3511432a7dee4bec9d1093c9d95b3734 Aug 31 16:21:49.118083 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-AttachVolumeTestJSON-172185859 Aug 31 16:21:49.118083 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-AttachVolumeTestJSON-172185859-project Aug 31 16:21:49.118083 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:21:49.118083 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:21:49.118083 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 4ed06378eb9b446680b5a3156a14941d Aug 31 16:21:49.118083 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-AttachVolumeTestJSON-172185859-project Aug 31 16:21:49.118083 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:21:49.118083 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance cca485b3-25f2-4a77-a23a-bb9758586ce7 could not be found. Aug 31 16:21:49.118083 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': 'cca485b3-25f2-4a77-a23a-bb9758586ce7'} Aug 31 16:21:49.118083 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:21:49.118083 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:21:49.118083 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:21:49.118083 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:21:49.118083 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:21:49.118083 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:21:49.118083 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:21:49.118083 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:21:49.118083 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:21:49.118083 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:21:49.118083 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cca485b3-25f2-4a77-a23a-bb9758586ce7 could not be found. Aug 31 16:21:49.118083 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:21:49.118083 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:21:49.118083 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:21:49.118083 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:21:49.118083 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:21:49.118083 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:21:49.118083 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:21:49.118083 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:21:49.118083 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:21:49.118083 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:21:49.118083 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:21:49.118083 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:21:49.118083 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:21:49.118083 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:21:49.118083 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:21:49.118083 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:21:49.118083 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cca485b3-25f2-4a77-a23a-bb9758586ce7 could not be found. Aug 31 16:21:49.118083 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:21:49.118083 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:21:49.118083 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:21:49.126441 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:21:49.126441 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:21:49.126441 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:21:49.126441 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:21:49.126441 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:21:49.126441 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cca485b3-25f2-4a77-a23a-bb9758586ce7 could not be found. Aug 31 16:21:49.126441 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:21:49.128917 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c34fffc5-e0ca-4d53-bcf4-62d9d04171fa tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Returning 404 to user: Instance cca485b3-25f2-4a77-a23a-bb9758586ce7 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:21:49.130772 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c34fffc5-e0ca-4d53-bcf4-62d9d04171fa tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] 10.222.0.61 "GET /compute/v2.1/servers/cca485b3-25f2-4a77-a23a-bb9758586ce7" status: 404 len: 111 microversion: 2.1 time: 0.052149 Aug 31 16:21:49.132472 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2515/5056] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:21:49 2022] GET /compute/v2.1/servers/cca485b3-25f2-4a77-a23a-bb9758586ce7 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:21:49.142351 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1fd37fae-3bdd-4258-9165-0096095052f5 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Calling method '.version_select at 0x7f5ae3b84160>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:49.165655 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1fd37fae-3bdd-4258-9165-0096095052f5 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-549669063" status: 202 len: 0 microversion: 2.1 time: 0.028056 Aug 31 16:21:49.170519 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2542/5057] 10.222.0.61 () {58 vars in 1218 bytes} [Wed Aug 31 16:21:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-549669063 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:21:49.345334 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-847bb037-10ed-4195-a303-7e0b431e9c25 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:49.345956 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-847bb037-10ed-4195-a303-7e0b431e9c25 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:49.353492 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-847bb037-10ed-4195-a303-7e0b431e9c25 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:49.354006 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-847bb037-10ed-4195-a303-7e0b431e9c25 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:49.354449 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-847bb037-10ed-4195-a303-7e0b431e9c25 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:49.355159 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-847bb037-10ed-4195-a303-7e0b431e9c25 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:49.355648 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-847bb037-10ed-4195-a303-7e0b431e9c25 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:49.356095 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-847bb037-10ed-4195-a303-7e0b431e9c25 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:50.128711 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-847bb037-10ed-4195-a303-7e0b431e9c25 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:50.159444 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-847bb037-10ed-4195-a303-7e0b431e9c25 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1678 microversion: 2.1 time: 0.804804 Aug 31 16:21:50.161133 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2516/5058] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:21:49 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1678 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:21:51.187233 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6500f41e-aef2-40df-9e6b-9c59cb26a9e4 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:51.188816 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6500f41e-aef2-40df-9e6b-9c59cb26a9e4 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:51.211949 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6500f41e-aef2-40df-9e6b-9c59cb26a9e4 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:51.212603 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6500f41e-aef2-40df-9e6b-9c59cb26a9e4 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:51.220882 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6500f41e-aef2-40df-9e6b-9c59cb26a9e4 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:51.222259 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6500f41e-aef2-40df-9e6b-9c59cb26a9e4 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:51.225010 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6500f41e-aef2-40df-9e6b-9c59cb26a9e4 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:51.227626 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6500f41e-aef2-40df-9e6b-9c59cb26a9e4 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:52.327130 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-6500f41e-aef2-40df-9e6b-9c59cb26a9e4 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:52.330772 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=5,nova_cell1:UPDATE=9 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:21:52.384609 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6500f41e-aef2-40df-9e6b-9c59cb26a9e4 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1678 microversion: 2.1 time: 1.200996 Aug 31 16:21:52.421762 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2543/5059] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:21:51 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1678 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:21:53.470304 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9da902c2-8b90-4436-b8af-8d33790484d7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:53.470960 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9da902c2-8b90-4436-b8af-8d33790484d7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:53.496538 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9da902c2-8b90-4436-b8af-8d33790484d7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:53.497078 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9da902c2-8b90-4436-b8af-8d33790484d7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:53.497504 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9da902c2-8b90-4436-b8af-8d33790484d7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:53.498234 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9da902c2-8b90-4436-b8af-8d33790484d7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:53.498878 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9da902c2-8b90-4436-b8af-8d33790484d7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:53.499113 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9da902c2-8b90-4436-b8af-8d33790484d7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:54.042666 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-fb70f078-c518-43d3-8e62-9c9bd5ca21b0 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1050456035", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a463fe70-889a-47e0-8a58-628ef29cd494"}], "security_groups": [{"name": "tempest-securitygroup--969500129"}], "key_name": "tempest-keypair-1797165354", "user_data": "}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:21:54.561305 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-fb70f078-c518-43d3-8e62-9c9bd5ca21b0 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] validate_networks() for [('a463fe70-889a-47e0-8a58-628ef29cd494', None, None, None, None, None)] {{(pid=122257) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:21:54.780727 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-9da902c2-8b90-4436-b8af-8d33790484d7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:54.814271 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9da902c2-8b90-4436-b8af-8d33790484d7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1678 microversion: 2.1 time: 1.365168 Aug 31 16:21:54.815875 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2517/5060] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:21:53 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1678 bytes in 1368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:21:55.841989 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d60ac4e4-d35d-493f-ad23-aeae7fe80c0d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:55.843838 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d60ac4e4-d35d-493f-ad23-aeae7fe80c0d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:55.868637 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d60ac4e4-d35d-493f-ad23-aeae7fe80c0d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:55.869630 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d60ac4e4-d35d-493f-ad23-aeae7fe80c0d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:55.870337 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d60ac4e4-d35d-493f-ad23-aeae7fe80c0d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:55.871335 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d60ac4e4-d35d-493f-ad23-aeae7fe80c0d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:55.872223 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d60ac4e4-d35d-493f-ad23-aeae7fe80c0d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:55.872918 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d60ac4e4-d35d-493f-ad23-aeae7fe80c0d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:56.032211 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-fb70f078-c518-43d3-8e62-9c9bd5ca21b0 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:21:56.032885 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-fb70f078-c518-43d3-8e62-9c9bd5ca21b0 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:21:56.033661 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-fb70f078-c518-43d3-8e62-9c9bd5ca21b0 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:21:56.034219 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-fb70f078-c518-43d3-8e62-9c9bd5ca21b0 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:21:56.034754 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-fb70f078-c518-43d3-8e62-9c9bd5ca21b0 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:21:56.054612 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fb70f078-c518-43d3-8e62-9c9bd5ca21b0 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:56.054862 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fb70f078-c518-43d3-8e62-9c9bd5ca21b0 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:56.055492 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fb70f078-c518-43d3-8e62-9c9bd5ca21b0 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:56.056812 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fb70f078-c518-43d3-8e62-9c9bd5ca21b0 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:56.057528 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fb70f078-c518-43d3-8e62-9c9bd5ca21b0 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:56.058419 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fb70f078-c518-43d3-8e62-9c9bd5ca21b0 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:56.110401 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-fb70f078-c518-43d3-8e62-9c9bd5ca21b0 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Getting quotas for project e014d4e4da5e47ff9a1261e7730034ac. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:21:56.131436 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-fb70f078-c518-43d3-8e62-9c9bd5ca21b0 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Getting quotas for user e4744703b964435bbead751ca884d1ae and project e014d4e4da5e47ff9a1261e7730034ac. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:21:56.159985 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-fb70f078-c518-43d3-8e62-9c9bd5ca21b0 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Going to run 1 instances... {{(pid=122257) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:21:56.165140 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-fb70f078-c518-43d3-8e62-9c9bd5ca21b0 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: d1c50fa6-2d8a-4707-9ee7-448ea57be62b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:21:56.359089 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-fb70f078-c518-43d3-8e62-9c9bd5ca21b0 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 2.323814 Aug 31 16:21:56.362778 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2544/5061] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:21:54 2022] POST /compute/v2.1/servers => generated 408 bytes in 2329 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 16:21:56.370938 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d60ac4e4-d35d-493f-ad23-aeae7fe80c0d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:56.391160 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d60ac4e4-d35d-493f-ad23-aeae7fe80c0d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1655 microversion: 2.1 time: 0.553079 Aug 31 16:21:56.392395 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2518/5062] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:21:55 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1655 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:21:56.437913 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-fd88dfe4-203d-45f9-b703-8ab80ccc7e66 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:56.438381 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-fd88dfe4-203d-45f9-b703-8ab80ccc7e66 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: d1c50fa6-2d8a-4707-9ee7-448ea57be62b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:56.456951 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-59d98506-9d68-4007-9b08-4f9d846f704b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:21:56.481440 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-59d98506-9d68-4007-9b08-4f9d846f704b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:56.482204 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-59d98506-9d68-4007-9b08-4f9d846f704b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:56.482671 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-59d98506-9d68-4007-9b08-4f9d846f704b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:56.563294 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-59d98506-9d68-4007-9b08-4f9d846f704b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Going to try to start instance {{(pid=122256) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 31 16:21:56.632709 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-fd88dfe4-203d-45f9-b703-8ab80ccc7e66 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4744703b964435bbead751ca884d1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e014d4e4da5e47ff9a1261e7730034ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:56.652328 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-fd88dfe4-203d-45f9-b703-8ab80ccc7e66 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b" status: 200 len: 1246 microversion: 2.1 time: 0.269073 Aug 31 16:21:56.665270 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2545/5063] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:21:56 2022] GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b => generated 1246 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:21:56.687623 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:21:56.720863 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-59d98506-9d68-4007-9b08-4f9d846f704b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "POST /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c/action" status: 202 len: 0 microversion: 2.1 time: 0.280630 Aug 31 16:21:56.722233 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2519/5064] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:21:56 2022] POST /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c/action => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:21:56.733054 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-65c0b01b-46db-4f3d-91ce-78341a762467 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:56.735007 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-65c0b01b-46db-4f3d-91ce-78341a762467 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:56.749881 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-65c0b01b-46db-4f3d-91ce-78341a762467 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:56.750547 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-65c0b01b-46db-4f3d-91ce-78341a762467 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:56.751157 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-65c0b01b-46db-4f3d-91ce-78341a762467 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:56.753207 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-65c0b01b-46db-4f3d-91ce-78341a762467 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:56.754313 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-65c0b01b-46db-4f3d-91ce-78341a762467 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:56.758223 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-65c0b01b-46db-4f3d-91ce-78341a762467 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:57.678335 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-59431ea7-a714-44f6-9be8-bf09e5acf089 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:57.685575 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-59431ea7-a714-44f6-9be8-bf09e5acf089 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: d1c50fa6-2d8a-4707-9ee7-448ea57be62b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:59.343003 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-59431ea7-a714-44f6-9be8-bf09e5acf089 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4744703b964435bbead751ca884d1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e014d4e4da5e47ff9a1261e7730034ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:59.369047 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-59431ea7-a714-44f6-9be8-bf09e5acf089 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b" status: 200 len: 1246 microversion: 2.1 time: 1.700336 Aug 31 16:21:59.383048 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2520/5065] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:21:57 2022] GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b => generated 1246 bytes in 1715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:22:00.096926 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-65c0b01b-46db-4f3d-91ce-78341a762467 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:00.130658 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-65c0b01b-46db-4f3d-91ce-78341a762467 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1664 microversion: 2.1 time: 3.395925 Aug 31 16:22:00.131979 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2546/5066] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:21:56 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1664 bytes in 3404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:22:00.390977 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9d91346c-1356-400f-bee2-b0798579a011 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:00.392267 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9d91346c-1356-400f-bee2-b0798579a011 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: d1c50fa6-2d8a-4707-9ee7-448ea57be62b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:00.404397 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9d91346c-1356-400f-bee2-b0798579a011 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:00.406735 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9d91346c-1356-400f-bee2-b0798579a011 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:00.409730 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9d91346c-1356-400f-bee2-b0798579a011 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:00.410858 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9d91346c-1356-400f-bee2-b0798579a011 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:00.412389 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9d91346c-1356-400f-bee2-b0798579a011 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:00.414259 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9d91346c-1356-400f-bee2-b0798579a011 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:00.658024 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-9d91346c-1356-400f-bee2-b0798579a011 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4744703b964435bbead751ca884d1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e014d4e4da5e47ff9a1261e7730034ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:00.667289 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9d91346c-1356-400f-bee2-b0798579a011 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b" status: 200 len: 1304 microversion: 2.1 time: 0.280614 Aug 31 16:22:00.667954 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2521/5067] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:22:00 2022] GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b => generated 1304 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:22:01.159420 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-bd4dd771-eb04-4ac7-a5ac-92a450bfcecf tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:01.160151 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-bd4dd771-eb04-4ac7-a5ac-92a450bfcecf tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:01.170393 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bd4dd771-eb04-4ac7-a5ac-92a450bfcecf tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:01.170902 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bd4dd771-eb04-4ac7-a5ac-92a450bfcecf tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:01.171349 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bd4dd771-eb04-4ac7-a5ac-92a450bfcecf tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:01.172140 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bd4dd771-eb04-4ac7-a5ac-92a450bfcecf tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:01.172567 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bd4dd771-eb04-4ac7-a5ac-92a450bfcecf tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:01.173002 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bd4dd771-eb04-4ac7-a5ac-92a450bfcecf tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:01.690746 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-bd4dd771-eb04-4ac7-a5ac-92a450bfcecf tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:01.697483 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8250bdb1-493d-4dd5-934d-014f0ece6230 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:01.698127 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8250bdb1-493d-4dd5-934d-014f0ece6230 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: d1c50fa6-2d8a-4707-9ee7-448ea57be62b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:01.714560 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-bd4dd771-eb04-4ac7-a5ac-92a450bfcecf tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1664 microversion: 2.1 time: 0.559447 Aug 31 16:22:01.715164 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2547/5068] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:22:01 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1664 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:22:01.723342 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8250bdb1-493d-4dd5-934d-014f0ece6230 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:01.733128 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8250bdb1-493d-4dd5-934d-014f0ece6230 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:01.733867 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8250bdb1-493d-4dd5-934d-014f0ece6230 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:01.734840 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8250bdb1-493d-4dd5-934d-014f0ece6230 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:01.735492 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8250bdb1-493d-4dd5-934d-014f0ece6230 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:01.736204 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8250bdb1-493d-4dd5-934d-014f0ece6230 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:02.025904 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8250bdb1-493d-4dd5-934d-014f0ece6230 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4744703b964435bbead751ca884d1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e014d4e4da5e47ff9a1261e7730034ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:02.038279 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8250bdb1-493d-4dd5-934d-014f0ece6230 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b" status: 200 len: 1304 microversion: 2.1 time: 0.344996 Aug 31 16:22:02.058981 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2522/5069] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:22:01 2022] GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b => generated 1304 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:22:02.745745 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-465cb191-11dd-47de-993e-fbd1d24e7f4e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:02.746978 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-465cb191-11dd-47de-993e-fbd1d24e7f4e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:02.765876 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-465cb191-11dd-47de-993e-fbd1d24e7f4e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:02.766178 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-465cb191-11dd-47de-993e-fbd1d24e7f4e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:02.766582 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-465cb191-11dd-47de-993e-fbd1d24e7f4e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:02.767328 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-465cb191-11dd-47de-993e-fbd1d24e7f4e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:02.767826 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-465cb191-11dd-47de-993e-fbd1d24e7f4e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:02.768270 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-465cb191-11dd-47de-993e-fbd1d24e7f4e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:03.075089 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8f3d8586-5c82-40fb-9da9-2f3865a0d143 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:03.084000 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8f3d8586-5c82-40fb-9da9-2f3865a0d143 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: d1c50fa6-2d8a-4707-9ee7-448ea57be62b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:03.112088 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8f3d8586-5c82-40fb-9da9-2f3865a0d143 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:03.112855 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8f3d8586-5c82-40fb-9da9-2f3865a0d143 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:03.116104 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8f3d8586-5c82-40fb-9da9-2f3865a0d143 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:03.118932 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8f3d8586-5c82-40fb-9da9-2f3865a0d143 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:03.120608 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8f3d8586-5c82-40fb-9da9-2f3865a0d143 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:03.121146 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8f3d8586-5c82-40fb-9da9-2f3865a0d143 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:03.460096 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-465cb191-11dd-47de-993e-fbd1d24e7f4e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:03.495795 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-465cb191-11dd-47de-993e-fbd1d24e7f4e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1668 microversion: 2.1 time: 0.760554 Aug 31 16:22:03.496584 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2548/5070] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:22:02 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1668 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:22:03.524038 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-83c2c2bd-0772-4531-a95f-2bfd48db3037 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:03.525495 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-83c2c2bd-0772-4531-a95f-2bfd48db3037 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:03.529944 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8f3d8586-5c82-40fb-9da9-2f3865a0d143 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4744703b964435bbead751ca884d1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e014d4e4da5e47ff9a1261e7730034ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:03.537213 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-83c2c2bd-0772-4531-a95f-2bfd48db3037 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:03.541413 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8f3d8586-5c82-40fb-9da9-2f3865a0d143 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b" status: 200 len: 1304 microversion: 2.1 time: 0.474910 Aug 31 16:22:03.544271 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2523/5071] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:22:03 2022] GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b => generated 1304 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:22:03.556750 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-83c2c2bd-0772-4531-a95f-2bfd48db3037 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:03.561879 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-83c2c2bd-0772-4531-a95f-2bfd48db3037 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:03.564574 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-83c2c2bd-0772-4531-a95f-2bfd48db3037 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:03.565197 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-83c2c2bd-0772-4531-a95f-2bfd48db3037 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:03.566489 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-83c2c2bd-0772-4531-a95f-2bfd48db3037 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:04.085625 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-83c2c2bd-0772-4531-a95f-2bfd48db3037 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:04.103484 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-83c2c2bd-0772-4531-a95f-2bfd48db3037 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1668 microversion: 2.1 time: 0.583647 Aug 31 16:22:04.108435 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2549/5072] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:22:03 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1668 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:22:04.135331 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-bd8d7370-48ff-44dd-92c6-c2bb5537bba8 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:22:04.136000 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-bd8d7370-48ff-44dd-92c6-c2bb5537bba8 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:04.153908 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bd8d7370-48ff-44dd-92c6-c2bb5537bba8 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:04.158888 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bd8d7370-48ff-44dd-92c6-c2bb5537bba8 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:04.159536 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bd8d7370-48ff-44dd-92c6-c2bb5537bba8 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:04.160302 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bd8d7370-48ff-44dd-92c6-c2bb5537bba8 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:04.160918 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bd8d7370-48ff-44dd-92c6-c2bb5537bba8 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:04.161294 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bd8d7370-48ff-44dd-92c6-c2bb5537bba8 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:04.309548 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-bd8d7370-48ff-44dd-92c6-c2bb5537bba8 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Unlocking {{(pid=122256) unlock /opt/stack/nova/nova/compute/api.py:4872}} Aug 31 16:22:04.391864 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-89538b3c-8893-42ee-8824-0f4bc4d62f6c tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:04.392999 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-89538b3c-8893-42ee-8824-0f4bc4d62f6c tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] [instance: cca485b3-25f2-4a77-a23a-bb9758586ce7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:04.420515 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-89538b3c-8893-42ee-8824-0f4bc4d62f6c tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:04.423907 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-89538b3c-8893-42ee-8824-0f4bc4d62f6c tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:04.427100 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-89538b3c-8893-42ee-8824-0f4bc4d62f6c tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:04.430240 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-89538b3c-8893-42ee-8824-0f4bc4d62f6c tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:04.432665 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-89538b3c-8893-42ee-8824-0f4bc4d62f6c tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:04.437516 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-89538b3c-8893-42ee-8824-0f4bc4d62f6c tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:04.472607 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-bd8d7370-48ff-44dd-92c6-c2bb5537bba8 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "POST /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c/action" status: 202 len: 0 microversion: 2.1 time: 0.342959 Aug 31 16:22:04.484018 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2524/5073] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:22:04 2022] POST /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c/action => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:22:04.493037 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a6baae1b-9535-4123-9e94-6ae609a14ad9 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:04.493598 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a6baae1b-9535-4123-9e94-6ae609a14ad9 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:04.493746 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-89538b3c-8893-42ee-8824-0f4bc4d62f6c tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] HTTP exception thrown: Instance cca485b3-25f2-4a77-a23a-bb9758586ce7 could not be found. Aug 31 16:22:04.501699 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-89538b3c-8893-42ee-8824-0f4bc4d62f6c tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Request method failure captured: Aug 31 16:22:04.501699 n-d-850499-9 devstack@n-api.service[122257]: request: DELETE /compute/v2.1/servers/cca485b3-25f2-4a77-a23a-bb9758586ce7 HTTP/1.1 Aug 31 16:22:04.501699 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:22:04.501699 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:22:04.501699 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:22:04.501699 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:22:04.501699 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:22:04.501699 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:22:04.501699 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:22:04.501699 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:22:04.501699 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4h75u7LzyI3LiTRnaMEtEGh_oKNi1Al59H9ZBkna-ug3rHwVRzVYTJjImD5IWMxWPmOM60UDHY8-wFzVIU5mmc62NrV2ywLM1HILKrGBC3OkZ2zojw8iZAqohy1LHuIy22Zt-21nf1lXy0v98jU9OvxTkFTMT27YgwY79kYAuiRpls Aug 31 16:22:04.501699 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:22:04.501699 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:22:04.501699 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:22:04.501699 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:22:04.501699 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:22:04.501699 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:22:04.501699 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 3511432a7dee4bec9d1093c9d95b3734 Aug 31 16:22:04.501699 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-AttachVolumeTestJSON-172185859 Aug 31 16:22:04.501699 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:22:04.501699 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:22:04.501699 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/3511432a7dee4bec9d1093c9d95b3734"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/3511432a7dee4bec9d1093c9d95b3734"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_3511432a7dee4bec9d1093c9d95b3734", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/3511432a7dee4bec9d1093c9d95b3734"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:22:04.501699 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-AttachVolumeTestJSON-172185859 Aug 31 16:22:04.501699 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 3511432a7dee4bec9d1093c9d95b3734 Aug 31 16:22:04.501699 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-AttachVolumeTestJSON-172185859 Aug 31 16:22:04.501699 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-AttachVolumeTestJSON-172185859-project Aug 31 16:22:04.501699 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:22:04.501699 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:22:04.501699 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 4ed06378eb9b446680b5a3156a14941d Aug 31 16:22:04.501699 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-AttachVolumeTestJSON-172185859-project Aug 31 16:22:04.501699 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:22:04.501699 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance cca485b3-25f2-4a77-a23a-bb9758586ce7 could not be found. Aug 31 16:22:04.501699 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': 'cca485b3-25f2-4a77-a23a-bb9758586ce7'} Aug 31 16:22:04.501699 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:22:04.501699 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:22:04.501699 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:22:04.501699 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:22:04.501699 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:22:04.501699 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:22:04.501699 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:22:04.501699 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:22:04.501699 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:22:04.501699 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:22:04.501699 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cca485b3-25f2-4a77-a23a-bb9758586ce7 could not be found. Aug 31 16:22:04.501699 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:22:04.501699 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:22:04.501699 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:22:04.501699 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:22:04.501699 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:22:04.501699 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:22:04.501699 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:22:04.501699 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:22:04.501699 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:22:04.501699 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:22:04.501699 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:22:04.501699 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:22:04.501699 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:22:04.501699 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:22:04.501699 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:22:04.501699 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:22:04.501699 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:22:04.501699 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:22:04.506695 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cca485b3-25f2-4a77-a23a-bb9758586ce7 could not be found. Aug 31 16:22:04.506695 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:22:04.506695 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:22:04.506695 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:22:04.506695 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:22:04.506695 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:22:04.506695 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:22:04.506695 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:22:04.506695 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:22:04.506695 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cca485b3-25f2-4a77-a23a-bb9758586ce7 could not be found. Aug 31 16:22:04.506695 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:22:04.508744 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-89538b3c-8893-42ee-8824-0f4bc4d62f6c tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Returning 404 to user: Instance cca485b3-25f2-4a77-a23a-bb9758586ce7 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:22:04.509998 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-89538b3c-8893-42ee-8824-0f4bc4d62f6c tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] 10.222.0.61 "DELETE /compute/v2.1/servers/cca485b3-25f2-4a77-a23a-bb9758586ce7" status: 404 len: 111 microversion: 2.1 time: 0.125440 Aug 31 16:22:04.511138 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2550/5074] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:22:04 2022] DELETE /compute/v2.1/servers/cca485b3-25f2-4a77-a23a-bb9758586ce7 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:22:04.514720 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a6baae1b-9535-4123-9e94-6ae609a14ad9 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:04.515228 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a6baae1b-9535-4123-9e94-6ae609a14ad9 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:04.515702 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a6baae1b-9535-4123-9e94-6ae609a14ad9 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:04.518532 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a6baae1b-9535-4123-9e94-6ae609a14ad9 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:04.524623 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a6baae1b-9535-4123-9e94-6ae609a14ad9 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:04.525140 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a6baae1b-9535-4123-9e94-6ae609a14ad9 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:04.525423 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-94b58d21-91bf-4fb6-a78a-cc6246ea08be tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:04.526358 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-94b58d21-91bf-4fb6-a78a-cc6246ea08be tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] [instance: cca485b3-25f2-4a77-a23a-bb9758586ce7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:04.548125 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-94b58d21-91bf-4fb6-a78a-cc6246ea08be tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:04.549045 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-94b58d21-91bf-4fb6-a78a-cc6246ea08be tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:04.549703 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-94b58d21-91bf-4fb6-a78a-cc6246ea08be tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:04.550662 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-94b58d21-91bf-4fb6-a78a-cc6246ea08be tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:04.551330 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-94b58d21-91bf-4fb6-a78a-cc6246ea08be tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:04.552083 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-94b58d21-91bf-4fb6-a78a-cc6246ea08be tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:04.581776 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-94b58d21-91bf-4fb6-a78a-cc6246ea08be tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] HTTP exception thrown: Instance cca485b3-25f2-4a77-a23a-bb9758586ce7 could not be found. Aug 31 16:22:04.583842 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-94b58d21-91bf-4fb6-a78a-cc6246ea08be tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Request method failure captured: Aug 31 16:22:04.583842 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/cca485b3-25f2-4a77-a23a-bb9758586ce7 HTTP/1.1 Aug 31 16:22:04.583842 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:22:04.583842 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:22:04.583842 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:22:04.583842 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:22:04.583842 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:22:04.583842 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:22:04.583842 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:22:04.583842 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:22:04.583842 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4h75u7LzyI3LiTRnaMEtEGh_oKNi1Al59H9ZBkna-ug3rHwVRzVYTJjImD5IWMxWPmOM60UDHY8-wFzVIU5mmc62NrV2ywLM1HILKrGBC3OkZ2zojw8iZAqohy1LHuIy22Zt-21nf1lXy0v98jU9OvxTkFTMT27YgwY79kYAuiRpls Aug 31 16:22:04.583842 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:22:04.583842 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:22:04.583842 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:22:04.583842 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:22:04.583842 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:22:04.583842 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:22:04.583842 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 3511432a7dee4bec9d1093c9d95b3734 Aug 31 16:22:04.583842 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-AttachVolumeTestJSON-172185859 Aug 31 16:22:04.583842 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:22:04.583842 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:22:04.583842 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/3511432a7dee4bec9d1093c9d95b3734"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/3511432a7dee4bec9d1093c9d95b3734"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_3511432a7dee4bec9d1093c9d95b3734", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/3511432a7dee4bec9d1093c9d95b3734"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:22:04.583842 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-AttachVolumeTestJSON-172185859 Aug 31 16:22:04.583842 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 3511432a7dee4bec9d1093c9d95b3734 Aug 31 16:22:04.583842 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-AttachVolumeTestJSON-172185859 Aug 31 16:22:04.583842 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-AttachVolumeTestJSON-172185859-project Aug 31 16:22:04.583842 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:22:04.583842 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:22:04.583842 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 4ed06378eb9b446680b5a3156a14941d Aug 31 16:22:04.583842 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-AttachVolumeTestJSON-172185859-project Aug 31 16:22:04.583842 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:22:04.583842 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance cca485b3-25f2-4a77-a23a-bb9758586ce7 could not be found. Aug 31 16:22:04.583842 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': 'cca485b3-25f2-4a77-a23a-bb9758586ce7'} Aug 31 16:22:04.583842 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:22:04.583842 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:22:04.583842 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:22:04.583842 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:22:04.583842 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:22:04.583842 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:22:04.583842 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:22:04.583842 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:22:04.583842 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:22:04.583842 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:22:04.583842 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cca485b3-25f2-4a77-a23a-bb9758586ce7 could not be found. Aug 31 16:22:04.583842 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:22:04.583842 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:22:04.583842 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:22:04.583842 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:22:04.583842 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:22:04.583842 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:22:04.583842 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:22:04.583842 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:22:04.583842 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:22:04.583842 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:22:04.583842 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:22:04.583842 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:22:04.583842 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:22:04.583842 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:22:04.583842 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:22:04.583842 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:22:04.583842 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cca485b3-25f2-4a77-a23a-bb9758586ce7 could not be found. Aug 31 16:22:04.583842 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:22:04.583842 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:22:04.583842 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:22:04.593116 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:22:04.593116 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:22:04.593116 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:22:04.593116 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:22:04.593116 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:22:04.593116 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cca485b3-25f2-4a77-a23a-bb9758586ce7 could not be found. Aug 31 16:22:04.593116 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:22:04.593116 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-94b58d21-91bf-4fb6-a78a-cc6246ea08be tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Returning 404 to user: Instance cca485b3-25f2-4a77-a23a-bb9758586ce7 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:22:04.593116 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-94b58d21-91bf-4fb6-a78a-cc6246ea08be tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] 10.222.0.61 "GET /compute/v2.1/servers/cca485b3-25f2-4a77-a23a-bb9758586ce7" status: 404 len: 111 microversion: 2.1 time: 0.072967 Aug 31 16:22:04.593116 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2551/5075] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:22:04 2022] GET /compute/v2.1/servers/cca485b3-25f2-4a77-a23a-bb9758586ce7 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:22:04.618995 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-062d36ff-8e11-434d-b9dd-e472bf01a442 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:04.619664 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-062d36ff-8e11-434d-b9dd-e472bf01a442 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: d1c50fa6-2d8a-4707-9ee7-448ea57be62b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:04.648177 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-062d36ff-8e11-434d-b9dd-e472bf01a442 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:04.648693 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-062d36ff-8e11-434d-b9dd-e472bf01a442 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:04.649144 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-062d36ff-8e11-434d-b9dd-e472bf01a442 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:04.650011 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-062d36ff-8e11-434d-b9dd-e472bf01a442 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:04.650562 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-062d36ff-8e11-434d-b9dd-e472bf01a442 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:04.655287 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-062d36ff-8e11-434d-b9dd-e472bf01a442 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:05.884748 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-062d36ff-8e11-434d-b9dd-e472bf01a442 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4744703b964435bbead751ca884d1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e014d4e4da5e47ff9a1261e7730034ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:05.901459 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-062d36ff-8e11-434d-b9dd-e472bf01a442 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b" status: 200 len: 1371 microversion: 2.1 time: 1.306391 Aug 31 16:22:05.902944 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2552/5076] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:22:04 2022] GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b => generated 1371 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:22:05.984283 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a6baae1b-9535-4123-9e94-6ae609a14ad9 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:05.999746 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a6baae1b-9535-4123-9e94-6ae609a14ad9 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1668 microversion: 2.1 time: 1.511297 Aug 31 16:22:06.007128 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2525/5077] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:22:04 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1668 bytes in 1520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:22:06.028606 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ebc97a1d-5532-491b-898e-e5b212b93602 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:06.029772 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ebc97a1d-5532-491b-898e-e5b212b93602 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:06.043735 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ebc97a1d-5532-491b-898e-e5b212b93602 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:06.045147 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ebc97a1d-5532-491b-898e-e5b212b93602 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:06.047296 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ebc97a1d-5532-491b-898e-e5b212b93602 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:06.048877 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ebc97a1d-5532-491b-898e-e5b212b93602 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:06.051654 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ebc97a1d-5532-491b-898e-e5b212b93602 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:06.055804 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ebc97a1d-5532-491b-898e-e5b212b93602 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:06.133977 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:22:06.504543 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ebc97a1d-5532-491b-898e-e5b212b93602 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:06.551813 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ebc97a1d-5532-491b-898e-e5b212b93602 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1668 microversion: 2.1 time: 0.527622 Aug 31 16:22:06.577909 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2553/5078] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:22:06 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1668 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:22:06.581937 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5aa5e089-cfad-4c6f-b53e-9c7f4322dd1f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:06.583243 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5aa5e089-cfad-4c6f-b53e-9c7f4322dd1f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:06.594602 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5aa5e089-cfad-4c6f-b53e-9c7f4322dd1f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:06.606631 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5aa5e089-cfad-4c6f-b53e-9c7f4322dd1f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:06.609191 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5aa5e089-cfad-4c6f-b53e-9c7f4322dd1f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:06.615618 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5aa5e089-cfad-4c6f-b53e-9c7f4322dd1f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:06.620356 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5aa5e089-cfad-4c6f-b53e-9c7f4322dd1f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:06.621072 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5aa5e089-cfad-4c6f-b53e-9c7f4322dd1f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:06.692924 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-5b76e8e8-b47c-4dd8-80ba-349569b687a5 req-afe62e6a-5c52-4f0c-9176-7cb1213c4a9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1c50fa6-2d8a-4707-9ee7-448ea57be62b", "tag": "cd30456c-29c0-40f3-baeb-7b819e58a733"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:22:06.698617 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=12 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:22:06.727701 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-5b76e8e8-b47c-4dd8-80ba-349569b687a5 req-afe62e6a-5c52-4f0c-9176-7cb1213c4a9e service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:06.728663 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-5b76e8e8-b47c-4dd8-80ba-349569b687a5 req-afe62e6a-5c52-4f0c-9176-7cb1213c4a9e service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:06.729310 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-5b76e8e8-b47c-4dd8-80ba-349569b687a5 req-afe62e6a-5c52-4f0c-9176-7cb1213c4a9e service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:06.754445 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-5b76e8e8-b47c-4dd8-80ba-349569b687a5 req-afe62e6a-5c52-4f0c-9176-7cb1213c4a9e service nova] Creating event network-changed:cd30456c-29c0-40f3-baeb-7b819e58a733 for instance d1c50fa6-2d8a-4707-9ee7-448ea57be62b on n-h2-850499-9 Aug 31 16:22:06.769507 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-5b76e8e8-b47c-4dd8-80ba-349569b687a5 req-afe62e6a-5c52-4f0c-9176-7cb1213c4a9e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081476 Aug 31 16:22:06.771088 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2554/5079] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:22:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:22:06.930457 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9e46c8bf-d8a8-4f35-8934-6826b55c5d98 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:06.931489 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9e46c8bf-d8a8-4f35-8934-6826b55c5d98 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: d1c50fa6-2d8a-4707-9ee7-448ea57be62b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:06.949609 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9e46c8bf-d8a8-4f35-8934-6826b55c5d98 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:06.950395 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9e46c8bf-d8a8-4f35-8934-6826b55c5d98 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:06.952679 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9e46c8bf-d8a8-4f35-8934-6826b55c5d98 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:06.954803 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9e46c8bf-d8a8-4f35-8934-6826b55c5d98 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:06.956066 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9e46c8bf-d8a8-4f35-8934-6826b55c5d98 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:06.960495 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9e46c8bf-d8a8-4f35-8934-6826b55c5d98 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:07.459227 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5aa5e089-cfad-4c6f-b53e-9c7f4322dd1f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:07.465457 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9e46c8bf-d8a8-4f35-8934-6826b55c5d98 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4744703b964435bbead751ca884d1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e014d4e4da5e47ff9a1261e7730034ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:07.482562 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5aa5e089-cfad-4c6f-b53e-9c7f4322dd1f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1668 microversion: 2.1 time: 0.907403 Aug 31 16:22:07.482804 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9e46c8bf-d8a8-4f35-8934-6826b55c5d98 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b" status: 200 len: 1371 microversion: 2.1 time: 0.558669 Aug 31 16:22:07.483683 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2526/5080] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:22:06 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1668 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:22:07.496153 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2555/5081] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:22:06 2022] GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b => generated 1371 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:22:07.512650 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c3e5d42a-e257-48ad-bfc2-2b0abf2abd9d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:22:07.513305 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c3e5d42a-e257-48ad-bfc2-2b0abf2abd9d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:07.531381 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c3e5d42a-e257-48ad-bfc2-2b0abf2abd9d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:07.531735 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c3e5d42a-e257-48ad-bfc2-2b0abf2abd9d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:07.532814 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c3e5d42a-e257-48ad-bfc2-2b0abf2abd9d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:07.536593 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c3e5d42a-e257-48ad-bfc2-2b0abf2abd9d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:07.538379 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c3e5d42a-e257-48ad-bfc2-2b0abf2abd9d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:07.539123 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c3e5d42a-e257-48ad-bfc2-2b0abf2abd9d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:07.704625 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c3e5d42a-e257-48ad-bfc2-2b0abf2abd9d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "POST /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c/action" status: 202 len: 0 microversion: 2.1 time: 0.196525 Aug 31 16:22:07.706089 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2527/5082] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:22:07 2022] POST /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c/action => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:22:07.714918 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f004fd8d-e727-46f6-af04-48cc4b5546f6 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:07.716264 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f004fd8d-e727-46f6-af04-48cc4b5546f6 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:07.726457 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f004fd8d-e727-46f6-af04-48cc4b5546f6 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:07.728655 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f004fd8d-e727-46f6-af04-48cc4b5546f6 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:07.732174 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f004fd8d-e727-46f6-af04-48cc4b5546f6 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:07.733352 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f004fd8d-e727-46f6-af04-48cc4b5546f6 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:07.734257 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f004fd8d-e727-46f6-af04-48cc4b5546f6 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:07.736572 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f004fd8d-e727-46f6-af04-48cc4b5546f6 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:08.449392 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f004fd8d-e727-46f6-af04-48cc4b5546f6 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:08.461710 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f004fd8d-e727-46f6-af04-48cc4b5546f6 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1673 microversion: 2.1 time: 0.751233 Aug 31 16:22:08.472393 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2556/5083] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:22:07 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1673 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:22:08.510334 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a496e9a2-dbe1-444d-8359-da6b1e9c1e7c tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:08.511406 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a496e9a2-dbe1-444d-8359-da6b1e9c1e7c tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: d1c50fa6-2d8a-4707-9ee7-448ea57be62b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:08.534134 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a496e9a2-dbe1-444d-8359-da6b1e9c1e7c tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:08.534805 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a496e9a2-dbe1-444d-8359-da6b1e9c1e7c tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:08.535269 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a496e9a2-dbe1-444d-8359-da6b1e9c1e7c tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:08.536657 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a496e9a2-dbe1-444d-8359-da6b1e9c1e7c tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:08.537129 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a496e9a2-dbe1-444d-8359-da6b1e9c1e7c tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:08.540439 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a496e9a2-dbe1-444d-8359-da6b1e9c1e7c tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:08.838644 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a496e9a2-dbe1-444d-8359-da6b1e9c1e7c tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4744703b964435bbead751ca884d1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e014d4e4da5e47ff9a1261e7730034ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:08.855750 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a496e9a2-dbe1-444d-8359-da6b1e9c1e7c tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b" status: 200 len: 1371 microversion: 2.1 time: 0.349720 Aug 31 16:22:08.859911 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2528/5084] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:22:08 2022] GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b => generated 1371 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:22:09.509239 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e718a84f-5d05-4559-9d7c-2ef5d6b4e1de tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:09.510533 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e718a84f-5d05-4559-9d7c-2ef5d6b4e1de tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:09.519683 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e718a84f-5d05-4559-9d7c-2ef5d6b4e1de tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:09.521098 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e718a84f-5d05-4559-9d7c-2ef5d6b4e1de tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:09.521846 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e718a84f-5d05-4559-9d7c-2ef5d6b4e1de tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:09.522953 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e718a84f-5d05-4559-9d7c-2ef5d6b4e1de tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:09.523623 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e718a84f-5d05-4559-9d7c-2ef5d6b4e1de tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:09.524223 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e718a84f-5d05-4559-9d7c-2ef5d6b4e1de tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:09.877435 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e718a84f-5d05-4559-9d7c-2ef5d6b4e1de tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:09.882944 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b63e4a47-0dc1-483f-a976-b1043b0f7a19 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:09.884768 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b63e4a47-0dc1-483f-a976-b1043b0f7a19 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: d1c50fa6-2d8a-4707-9ee7-448ea57be62b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:09.900175 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:22:09.902482 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e718a84f-5d05-4559-9d7c-2ef5d6b4e1de tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1653 microversion: 2.1 time: 0.397993 Aug 31 16:22:09.903005 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b63e4a47-0dc1-483f-a976-b1043b0f7a19 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:09.905682 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2557/5085] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:22:09 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1653 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:22:09.911942 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b63e4a47-0dc1-483f-a976-b1043b0f7a19 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:09.912420 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b63e4a47-0dc1-483f-a976-b1043b0f7a19 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:09.913195 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b63e4a47-0dc1-483f-a976-b1043b0f7a19 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:09.913900 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b63e4a47-0dc1-483f-a976-b1043b0f7a19 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:09.914597 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b63e4a47-0dc1-483f-a976-b1043b0f7a19 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:09.933998 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-04d2a9a0-1053-4d52-b772-f5068c516e11 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:22:09.934628 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-04d2a9a0-1053-4d52-b772-f5068c516e11 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:09.977435 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-04d2a9a0-1053-4d52-b772-f5068c516e11 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:09.983296 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-04d2a9a0-1053-4d52-b772-f5068c516e11 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:09.985640 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-04d2a9a0-1053-4d52-b772-f5068c516e11 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:09.997179 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-04d2a9a0-1053-4d52-b772-f5068c516e11 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:09.999632 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-04d2a9a0-1053-4d52-b772-f5068c516e11 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:10.001670 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-04d2a9a0-1053-4d52-b772-f5068c516e11 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:10.223233 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-04d2a9a0-1053-4d52-b772-f5068c516e11 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "POST /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c/action" status: 202 len: 0 microversion: 2.1 time: 0.294226 Aug 31 16:22:10.227726 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2558/5086] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:22:09 2022] POST /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c/action => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 16:22:10.233255 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-897d42a2-410b-4a5f-b42f-81a413d61dba tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:10.233964 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-897d42a2-410b-4a5f-b42f-81a413d61dba tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:10.257120 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-897d42a2-410b-4a5f-b42f-81a413d61dba tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:10.257632 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-897d42a2-410b-4a5f-b42f-81a413d61dba tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:10.258084 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-897d42a2-410b-4a5f-b42f-81a413d61dba tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:10.258808 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-897d42a2-410b-4a5f-b42f-81a413d61dba tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:10.259269 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-897d42a2-410b-4a5f-b42f-81a413d61dba tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:10.259727 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-897d42a2-410b-4a5f-b42f-81a413d61dba tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:10.527728 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b63e4a47-0dc1-483f-a976-b1043b0f7a19 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4744703b964435bbead751ca884d1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e014d4e4da5e47ff9a1261e7730034ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:10.553702 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b63e4a47-0dc1-483f-a976-b1043b0f7a19 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b" status: 200 len: 1371 microversion: 2.1 time: 0.676882 Aug 31 16:22:10.555322 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2529/5087] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:22:09 2022] GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b => generated 1371 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:22:10.684929 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-897d42a2-410b-4a5f-b42f-81a413d61dba tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:10.706437 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-897d42a2-410b-4a5f-b42f-81a413d61dba tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1660 microversion: 2.1 time: 0.477319 Aug 31 16:22:10.707047 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2559/5088] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:22:10 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1660 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:22:11.489487 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8765f303-4bc7-4b52-83b2-d0bba9aec274 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:11.490270 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8765f303-4bc7-4b52-83b2-d0bba9aec274 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] [instance: f04eb48d-000e-4c3b-8799-a4d3cdacf0e2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:11.517910 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8765f303-4bc7-4b52-83b2-d0bba9aec274 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:11.530767 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8765f303-4bc7-4b52-83b2-d0bba9aec274 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:11.534482 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8765f303-4bc7-4b52-83b2-d0bba9aec274 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:11.540326 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8765f303-4bc7-4b52-83b2-d0bba9aec274 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:11.542888 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8765f303-4bc7-4b52-83b2-d0bba9aec274 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:11.544389 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8765f303-4bc7-4b52-83b2-d0bba9aec274 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:11.583299 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6d91b332-44a9-484d-b07b-b2c32d6941f4 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:11.584057 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6d91b332-44a9-484d-b07b-b2c32d6941f4 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: d1c50fa6-2d8a-4707-9ee7-448ea57be62b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:11.592115 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-8765f303-4bc7-4b52-83b2-d0bba9aec274 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] HTTP exception thrown: Instance f04eb48d-000e-4c3b-8799-a4d3cdacf0e2 could not be found. Aug 31 16:22:11.595387 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6d91b332-44a9-484d-b07b-b2c32d6941f4 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:11.600277 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6d91b332-44a9-484d-b07b-b2c32d6941f4 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:11.601017 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6d91b332-44a9-484d-b07b-b2c32d6941f4 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:11.602030 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6d91b332-44a9-484d-b07b-b2c32d6941f4 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:11.607596 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6d91b332-44a9-484d-b07b-b2c32d6941f4 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:11.608561 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6d91b332-44a9-484d-b07b-b2c32d6941f4 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:11.625860 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8765f303-4bc7-4b52-83b2-d0bba9aec274 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Request method failure captured: Aug 31 16:22:11.625860 n-d-850499-9 devstack@n-api.service[122256]: request: DELETE /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2 HTTP/1.1 Aug 31 16:22:11.625860 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:22:11.625860 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:22:11.625860 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:22:11.625860 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:22:11.625860 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:22:11.625860 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:22:11.625860 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:22:11.625860 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:22:11.625860 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4h75u7LzyI3LiTRnaMEtEGh_oKNi1Al59H9ZBkna-ug3rHwVRzVYTJjImD5IWMxWPmOM60UDHY8-wFzVIU5mmc62NrV2ywLM1HILKrGBC3OkZ2zojw8iZAqohy1LHuIy22Zt-21nf1lXy0v98jU9OvxTkFTMT27YgwY79kYAuiRpls Aug 31 16:22:11.625860 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:22:11.625860 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:22:11.625860 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:22:11.625860 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:22:11.625860 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:22:11.625860 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:22:11.625860 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 3511432a7dee4bec9d1093c9d95b3734 Aug 31 16:22:11.625860 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-AttachVolumeTestJSON-172185859 Aug 31 16:22:11.625860 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:22:11.625860 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:22:11.625860 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/3511432a7dee4bec9d1093c9d95b3734"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/3511432a7dee4bec9d1093c9d95b3734"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_3511432a7dee4bec9d1093c9d95b3734", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/3511432a7dee4bec9d1093c9d95b3734"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:22:11.625860 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-AttachVolumeTestJSON-172185859 Aug 31 16:22:11.625860 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 3511432a7dee4bec9d1093c9d95b3734 Aug 31 16:22:11.625860 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-AttachVolumeTestJSON-172185859 Aug 31 16:22:11.625860 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-AttachVolumeTestJSON-172185859-project Aug 31 16:22:11.625860 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:22:11.625860 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:22:11.625860 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 4ed06378eb9b446680b5a3156a14941d Aug 31 16:22:11.625860 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-AttachVolumeTestJSON-172185859-project Aug 31 16:22:11.625860 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:22:11.625860 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance f04eb48d-000e-4c3b-8799-a4d3cdacf0e2 could not be found. Aug 31 16:22:11.625860 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': 'f04eb48d-000e-4c3b-8799-a4d3cdacf0e2'} Aug 31 16:22:11.625860 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:22:11.625860 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:22:11.625860 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:22:11.625860 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:22:11.625860 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:22:11.625860 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:22:11.625860 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:22:11.625860 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:22:11.625860 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:22:11.625860 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:22:11.625860 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f04eb48d-000e-4c3b-8799-a4d3cdacf0e2 could not be found. Aug 31 16:22:11.625860 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:22:11.625860 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:22:11.625860 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:22:11.625860 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:22:11.625860 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:22:11.625860 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:22:11.625860 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:22:11.625860 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:22:11.625860 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:22:11.625860 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:22:11.625860 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:22:11.625860 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:22:11.625860 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:22:11.625860 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:22:11.625860 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:22:11.625860 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:22:11.625860 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:22:11.625860 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:22:11.630656 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f04eb48d-000e-4c3b-8799-a4d3cdacf0e2 could not be found. Aug 31 16:22:11.630656 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:22:11.630656 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:22:11.630656 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:22:11.630656 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:22:11.630656 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:22:11.630656 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:22:11.630656 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:22:11.630656 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:22:11.630656 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f04eb48d-000e-4c3b-8799-a4d3cdacf0e2 could not be found. Aug 31 16:22:11.630656 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:22:11.630656 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8765f303-4bc7-4b52-83b2-d0bba9aec274 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Returning 404 to user: Instance f04eb48d-000e-4c3b-8799-a4d3cdacf0e2 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:22:11.632032 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8765f303-4bc7-4b52-83b2-d0bba9aec274 tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] 10.222.0.61 "DELETE /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2" status: 404 len: 111 microversion: 2.1 time: 0.147753 Aug 31 16:22:11.641498 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2530/5089] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:22:11 2022] DELETE /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2 => generated 111 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:22:11.666150 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-017d4527-b9c7-482e-91e7-6fcd92be288a tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:11.666849 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-017d4527-b9c7-482e-91e7-6fcd92be288a tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] [instance: f04eb48d-000e-4c3b-8799-a4d3cdacf0e2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:11.701648 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-017d4527-b9c7-482e-91e7-6fcd92be288a tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:11.702671 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-017d4527-b9c7-482e-91e7-6fcd92be288a tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:11.704928 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-017d4527-b9c7-482e-91e7-6fcd92be288a tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:11.706708 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-017d4527-b9c7-482e-91e7-6fcd92be288a tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:11.708407 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-017d4527-b9c7-482e-91e7-6fcd92be288a tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:11.711824 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-017d4527-b9c7-482e-91e7-6fcd92be288a tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:11.735665 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-017d4527-b9c7-482e-91e7-6fcd92be288a tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] HTTP exception thrown: Instance f04eb48d-000e-4c3b-8799-a4d3cdacf0e2 could not be found. Aug 31 16:22:11.737580 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-017d4527-b9c7-482e-91e7-6fcd92be288a tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Request method failure captured: Aug 31 16:22:11.737580 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2 HTTP/1.1 Aug 31 16:22:11.737580 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:22:11.737580 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:22:11.737580 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:22:11.737580 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:22:11.737580 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:22:11.737580 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:22:11.737580 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:22:11.737580 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:22:11.737580 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4h75u7LzyI3LiTRnaMEtEGh_oKNi1Al59H9ZBkna-ug3rHwVRzVYTJjImD5IWMxWPmOM60UDHY8-wFzVIU5mmc62NrV2ywLM1HILKrGBC3OkZ2zojw8iZAqohy1LHuIy22Zt-21nf1lXy0v98jU9OvxTkFTMT27YgwY79kYAuiRpls Aug 31 16:22:11.737580 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:22:11.737580 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:22:11.737580 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:22:11.737580 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:22:11.737580 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:22:11.737580 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:22:11.737580 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 3511432a7dee4bec9d1093c9d95b3734 Aug 31 16:22:11.737580 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-AttachVolumeTestJSON-172185859 Aug 31 16:22:11.737580 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:22:11.737580 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:22:11.737580 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/3511432a7dee4bec9d1093c9d95b3734"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/3511432a7dee4bec9d1093c9d95b3734"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_3511432a7dee4bec9d1093c9d95b3734", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/3511432a7dee4bec9d1093c9d95b3734"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:22:11.737580 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-AttachVolumeTestJSON-172185859 Aug 31 16:22:11.737580 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 3511432a7dee4bec9d1093c9d95b3734 Aug 31 16:22:11.737580 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-AttachVolumeTestJSON-172185859 Aug 31 16:22:11.737580 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-AttachVolumeTestJSON-172185859-project Aug 31 16:22:11.737580 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:22:11.737580 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:22:11.737580 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 4ed06378eb9b446680b5a3156a14941d Aug 31 16:22:11.737580 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-AttachVolumeTestJSON-172185859-project Aug 31 16:22:11.737580 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:22:11.737580 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance f04eb48d-000e-4c3b-8799-a4d3cdacf0e2 could not be found. Aug 31 16:22:11.737580 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': 'f04eb48d-000e-4c3b-8799-a4d3cdacf0e2'} Aug 31 16:22:11.737580 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:22:11.737580 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:22:11.737580 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:22:11.737580 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:22:11.737580 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:22:11.737580 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:22:11.737580 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:22:11.737580 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:22:11.737580 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:22:11.737580 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:22:11.737580 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f04eb48d-000e-4c3b-8799-a4d3cdacf0e2 could not be found. Aug 31 16:22:11.737580 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:22:11.737580 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:22:11.737580 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:22:11.737580 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:22:11.737580 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:22:11.737580 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:22:11.737580 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:22:11.737580 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:22:11.737580 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:22:11.737580 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:22:11.737580 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:22:11.737580 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:22:11.737580 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:22:11.737580 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:22:11.737580 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:22:11.737580 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:22:11.737580 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f04eb48d-000e-4c3b-8799-a4d3cdacf0e2 could not be found. Aug 31 16:22:11.737580 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:22:11.737580 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:22:11.737580 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:22:11.743475 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:22:11.743475 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:22:11.743475 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:22:11.743475 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:22:11.743475 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:22:11.743475 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f04eb48d-000e-4c3b-8799-a4d3cdacf0e2 could not be found. Aug 31 16:22:11.743475 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:22:11.747613 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-017d4527-b9c7-482e-91e7-6fcd92be288a tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] Returning 404 to user: Instance f04eb48d-000e-4c3b-8799-a4d3cdacf0e2 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:22:11.749974 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-017d4527-b9c7-482e-91e7-6fcd92be288a tempest-AttachVolumeTestJSON-172185859 tempest-AttachVolumeTestJSON-172185859-project] 10.222.0.61 "GET /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2" status: 404 len: 111 microversion: 2.1 time: 0.106244 Aug 31 16:22:11.750760 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2531/5090] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:22:11 2022] GET /compute/v2.1/servers/f04eb48d-000e-4c3b-8799-a4d3cdacf0e2 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:22:11.757304 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e0e7a1cc-bf4a-4924-8e76-c15dc41b7dc6 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:11.757952 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e0e7a1cc-bf4a-4924-8e76-c15dc41b7dc6 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:11.765006 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e0e7a1cc-bf4a-4924-8e76-c15dc41b7dc6 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:11.765529 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e0e7a1cc-bf4a-4924-8e76-c15dc41b7dc6 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:11.766168 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e0e7a1cc-bf4a-4924-8e76-c15dc41b7dc6 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:11.778379 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e0e7a1cc-bf4a-4924-8e76-c15dc41b7dc6 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:11.780164 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e0e7a1cc-bf4a-4924-8e76-c15dc41b7dc6 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:11.783086 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e0e7a1cc-bf4a-4924-8e76-c15dc41b7dc6 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:13.003654 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-6d91b332-44a9-484d-b07b-b2c32d6941f4 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4744703b964435bbead751ca884d1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e014d4e4da5e47ff9a1261e7730034ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:13.016576 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6d91b332-44a9-484d-b07b-b2c32d6941f4 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b" status: 200 len: 1371 microversion: 2.1 time: 1.437717 Aug 31 16:22:13.018520 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2560/5091] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:22:11 2022] GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b => generated 1371 bytes in 1441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:22:13.170635 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e0e7a1cc-bf4a-4924-8e76-c15dc41b7dc6 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:13.181180 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e0e7a1cc-bf4a-4924-8e76-c15dc41b7dc6 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1660 microversion: 2.1 time: 1.429174 Aug 31 16:22:13.195721 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2532/5092] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:22:11 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1660 bytes in 1444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:22:14.045885 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9ce2863a-2bac-4c6f-a7c8-ef920c962919 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:14.046520 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9ce2863a-2bac-4c6f-a7c8-ef920c962919 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: d1c50fa6-2d8a-4707-9ee7-448ea57be62b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:14.059924 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:22:14.063795 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9ce2863a-2bac-4c6f-a7c8-ef920c962919 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:14.064401 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9ce2863a-2bac-4c6f-a7c8-ef920c962919 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:14.064856 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9ce2863a-2bac-4c6f-a7c8-ef920c962919 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:14.069527 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9ce2863a-2bac-4c6f-a7c8-ef920c962919 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:14.070187 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9ce2863a-2bac-4c6f-a7c8-ef920c962919 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:14.070734 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9ce2863a-2bac-4c6f-a7c8-ef920c962919 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:14.205271 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-bcc52e7a-25ca-4aed-a70a-450991e78fdf tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:14.205975 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-bcc52e7a-25ca-4aed-a70a-450991e78fdf tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:14.210179 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=52 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:22:14.214695 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bcc52e7a-25ca-4aed-a70a-450991e78fdf tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:14.215603 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bcc52e7a-25ca-4aed-a70a-450991e78fdf tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:14.216206 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bcc52e7a-25ca-4aed-a70a-450991e78fdf tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:14.224637 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bcc52e7a-25ca-4aed-a70a-450991e78fdf tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:14.226491 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bcc52e7a-25ca-4aed-a70a-450991e78fdf tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:14.241965 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bcc52e7a-25ca-4aed-a70a-450991e78fdf tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:15.061476 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9ce2863a-2bac-4c6f-a7c8-ef920c962919 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4744703b964435bbead751ca884d1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e014d4e4da5e47ff9a1261e7730034ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:15.084468 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9ce2863a-2bac-4c6f-a7c8-ef920c962919 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b" status: 200 len: 1371 microversion: 2.1 time: 1.042680 Aug 31 16:22:15.093037 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2561/5093] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:22:14 2022] GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b => generated 1371 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:22:15.229077 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-bcc52e7a-25ca-4aed-a70a-450991e78fdf tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:15.237585 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-bcc52e7a-25ca-4aed-a70a-450991e78fdf tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1668 microversion: 2.1 time: 1.036204 Aug 31 16:22:15.257874 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2533/5094] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:22:14 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1668 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:22:15.263595 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-06299a1f-45c4-468c-af58-b8615464a10f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:15.271214 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-06299a1f-45c4-468c-af58-b8615464a10f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:15.288828 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-06299a1f-45c4-468c-af58-b8615464a10f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:15.289268 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-06299a1f-45c4-468c-af58-b8615464a10f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:15.289898 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-06299a1f-45c4-468c-af58-b8615464a10f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:15.290840 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-06299a1f-45c4-468c-af58-b8615464a10f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:15.291484 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-06299a1f-45c4-468c-af58-b8615464a10f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:15.292148 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-06299a1f-45c4-468c-af58-b8615464a10f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:15.436360 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-48c85546-ce9f-4925-989d-c7ede8841555 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1827520940", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "networks": [{"uuid": "fa24e0ec-4a58-4400-9cf4-a0201375c33e"}]}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:22:15.591744 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-48c85546-ce9f-4925-989d-c7ede8841555 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] validate_networks() for [('fa24e0ec-4a58-4400-9cf4-a0201375c33e', None, None, None, None, None)] {{(pid=122257) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:22:16.189312 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-06299a1f-45c4-468c-af58-b8615464a10f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:16.198152 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-06299a1f-45c4-468c-af58-b8615464a10f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1668 microversion: 2.1 time: 0.938667 Aug 31 16:22:16.218393 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2534/5095] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:22:15 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1668 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:22:16.625116 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-2bc47b35-7699-44d4-af3c-0f8825cb426e req-1da3b633-8892-4adf-9668-922adcc52ba3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1c50fa6-2d8a-4707-9ee7-448ea57be62b", "name": "network-vif-plugged", "status": "completed", "tag": "cd30456c-29c0-40f3-baeb-7b819e58a733"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:22:16.649447 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-2bc47b35-7699-44d4-af3c-0f8825cb426e req-1da3b633-8892-4adf-9668-922adcc52ba3 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:16.651923 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-2bc47b35-7699-44d4-af3c-0f8825cb426e req-1da3b633-8892-4adf-9668-922adcc52ba3 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:16.653900 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-2bc47b35-7699-44d4-af3c-0f8825cb426e req-1da3b633-8892-4adf-9668-922adcc52ba3 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:16.668374 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:22:16.693023 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-2bc47b35-7699-44d4-af3c-0f8825cb426e req-1da3b633-8892-4adf-9668-922adcc52ba3 service nova] Creating event network-vif-plugged:cd30456c-29c0-40f3-baeb-7b819e58a733 for instance d1c50fa6-2d8a-4707-9ee7-448ea57be62b on n-h2-850499-9 Aug 31 16:22:16.704411 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-2bc47b35-7699-44d4-af3c-0f8825cb426e req-1da3b633-8892-4adf-9668-922adcc52ba3 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.482967 Aug 31 16:22:16.709424 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2535/5096] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:22:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:22:16.731837 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f9b4da0e-300e-4bdd-8d1e-a1afa965800f tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:16.732994 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f9b4da0e-300e-4bdd-8d1e-a1afa965800f tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: d1c50fa6-2d8a-4707-9ee7-448ea57be62b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:16.751886 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f9b4da0e-300e-4bdd-8d1e-a1afa965800f tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:16.755020 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f9b4da0e-300e-4bdd-8d1e-a1afa965800f tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:16.756063 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f9b4da0e-300e-4bdd-8d1e-a1afa965800f tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:16.757200 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f9b4da0e-300e-4bdd-8d1e-a1afa965800f tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:16.757923 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f9b4da0e-300e-4bdd-8d1e-a1afa965800f tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:16.761240 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f9b4da0e-300e-4bdd-8d1e-a1afa965800f tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:17.448465 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-48c85546-ce9f-4925-989d-c7ede8841555 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:22:17.450797 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-48c85546-ce9f-4925-989d-c7ede8841555 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:22:17.452584 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-48c85546-ce9f-4925-989d-c7ede8841555 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:22:17.455639 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-48c85546-ce9f-4925-989d-c7ede8841555 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:22:17.456773 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-48c85546-ce9f-4925-989d-c7ede8841555 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:22:17.515451 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-48c85546-ce9f-4925-989d-c7ede8841555 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:17.516557 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-48c85546-ce9f-4925-989d-c7ede8841555 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:17.517574 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-48c85546-ce9f-4925-989d-c7ede8841555 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:17.520366 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-48c85546-ce9f-4925-989d-c7ede8841555 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:17.522196 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-48c85546-ce9f-4925-989d-c7ede8841555 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:17.523542 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-48c85546-ce9f-4925-989d-c7ede8841555 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:17.542631 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f9b4da0e-300e-4bdd-8d1e-a1afa965800f tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4744703b964435bbead751ca884d1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e014d4e4da5e47ff9a1261e7730034ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:17.563884 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f9b4da0e-300e-4bdd-8d1e-a1afa965800f tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b" status: 200 len: 1371 microversion: 2.1 time: 0.848319 Aug 31 16:22:17.580049 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2536/5097] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:22:16 2022] GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b => generated 1371 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:22:17.586282 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d47482f9-b1d8-4afe-80c7-81db98f532bf tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:17.587156 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-48c85546-ce9f-4925-989d-c7ede8841555 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Getting quotas for project 014522b19dc349a691e1f6b131229974. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:22:17.600018 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-48c85546-ce9f-4925-989d-c7ede8841555 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Getting quotas for user c042c43cc2aa4000a147fae62c261e86 and project 014522b19dc349a691e1f6b131229974. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:22:17.600594 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d47482f9-b1d8-4afe-80c7-81db98f532bf tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:17.620282 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d47482f9-b1d8-4afe-80c7-81db98f532bf tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:17.621131 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d47482f9-b1d8-4afe-80c7-81db98f532bf tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:17.622034 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d47482f9-b1d8-4afe-80c7-81db98f532bf tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:17.623141 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d47482f9-b1d8-4afe-80c7-81db98f532bf tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:17.623947 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d47482f9-b1d8-4afe-80c7-81db98f532bf tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:17.624658 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d47482f9-b1d8-4afe-80c7-81db98f532bf tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:17.636324 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-48c85546-ce9f-4925-989d-c7ede8841555 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Going to run 1 instances... {{(pid=122257) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:22:17.642096 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-48c85546-ce9f-4925-989d-c7ede8841555 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:22:17.768974 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-48c85546-ce9f-4925-989d-c7ede8841555 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.673873 Aug 31 16:22:17.771723 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2562/5098] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:22:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 2678 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:22:17.814058 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4925f608-a75b-44e3-86e6-3e5cbc93ce13 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:17.815975 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4925f608-a75b-44e3-86e6-3e5cbc93ce13 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:18.268819 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-4925f608-a75b-44e3-86e6-3e5cbc93ce13 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:18.281398 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4925f608-a75b-44e3-86e6-3e5cbc93ce13 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1217 microversion: 2.1 time: 0.498916 Aug 31 16:22:18.299252 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2563/5099] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:22:17 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1217 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:22:18.575141 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d47482f9-b1d8-4afe-80c7-81db98f532bf tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:18.590546 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c4c4ddba-96bd-400d-bdd5-7d3e485da252 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:18.592404 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c4c4ddba-96bd-400d-bdd5-7d3e485da252 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: d1c50fa6-2d8a-4707-9ee7-448ea57be62b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:18.599271 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d47482f9-b1d8-4afe-80c7-81db98f532bf tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1668 microversion: 2.1 time: 1.017710 Aug 31 16:22:18.600649 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2537/5100] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:22:17 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1668 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:22:18.623034 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e837dbec-4af5-411b-83e9-ccf0a2faa42e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:18.624732 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c4c4ddba-96bd-400d-bdd5-7d3e485da252 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:18.625322 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c4c4ddba-96bd-400d-bdd5-7d3e485da252 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:18.626699 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c4c4ddba-96bd-400d-bdd5-7d3e485da252 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:18.627471 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c4c4ddba-96bd-400d-bdd5-7d3e485da252 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:18.631303 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e837dbec-4af5-411b-83e9-ccf0a2faa42e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:18.638380 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c4c4ddba-96bd-400d-bdd5-7d3e485da252 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:18.639276 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c4c4ddba-96bd-400d-bdd5-7d3e485da252 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:18.641939 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e837dbec-4af5-411b-83e9-ccf0a2faa42e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:18.643063 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e837dbec-4af5-411b-83e9-ccf0a2faa42e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:18.644052 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e837dbec-4af5-411b-83e9-ccf0a2faa42e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:18.645826 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e837dbec-4af5-411b-83e9-ccf0a2faa42e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:18.647904 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e837dbec-4af5-411b-83e9-ccf0a2faa42e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:18.649288 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e837dbec-4af5-411b-83e9-ccf0a2faa42e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:19.631770 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e837dbec-4af5-411b-83e9-ccf0a2faa42e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:19.659383 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e837dbec-4af5-411b-83e9-ccf0a2faa42e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1668 microversion: 2.1 time: 1.040289 Aug 31 16:22:19.665645 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2538/5101] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:22:18 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1668 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:22:19.688521 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7eaf1eb4-3c76-419f-923b-25b0cd0f1822 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:19.689573 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7eaf1eb4-3c76-419f-923b-25b0cd0f1822 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:19.710912 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7eaf1eb4-3c76-419f-923b-25b0cd0f1822 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:19.715565 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7eaf1eb4-3c76-419f-923b-25b0cd0f1822 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:19.716283 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7eaf1eb4-3c76-419f-923b-25b0cd0f1822 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:19.717207 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7eaf1eb4-3c76-419f-923b-25b0cd0f1822 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:19.720445 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7eaf1eb4-3c76-419f-923b-25b0cd0f1822 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:19.723702 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7eaf1eb4-3c76-419f-923b-25b0cd0f1822 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:20.154684 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c4c4ddba-96bd-400d-bdd5-7d3e485da252 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4744703b964435bbead751ca884d1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e014d4e4da5e47ff9a1261e7730034ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:20.155388 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7eaf1eb4-3c76-419f-923b-25b0cd0f1822 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:20.163432 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:22:20.167258 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c4c4ddba-96bd-400d-bdd5-7d3e485da252 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b" status: 200 len: 1371 microversion: 2.1 time: 1.581141 Aug 31 16:22:20.168036 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2564/5102] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:22:18 2022] GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b => generated 1371 bytes in 1586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:22:20.168346 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7eaf1eb4-3c76-419f-923b-25b0cd0f1822 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1269 microversion: 2.1 time: 0.500548 Aug 31 16:22:20.188538 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2539/5103] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:22:19 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1269 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:22:20.189334 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-89c89f5e-e217-47d5-b218-7ddfd2f6649d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:20.190248 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-89c89f5e-e217-47d5-b218-7ddfd2f6649d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:20.210154 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-89c89f5e-e217-47d5-b218-7ddfd2f6649d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:20.210914 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-89c89f5e-e217-47d5-b218-7ddfd2f6649d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:20.212170 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-89c89f5e-e217-47d5-b218-7ddfd2f6649d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:20.213111 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-89c89f5e-e217-47d5-b218-7ddfd2f6649d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:20.213801 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-89c89f5e-e217-47d5-b218-7ddfd2f6649d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:20.214400 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-89c89f5e-e217-47d5-b218-7ddfd2f6649d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:21.129997 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-89c89f5e-e217-47d5-b218-7ddfd2f6649d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:21.164470 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-89c89f5e-e217-47d5-b218-7ddfd2f6649d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1668 microversion: 2.1 time: 0.993877 Aug 31 16:22:21.194163 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5db1a67f-582f-4f62-a3a7-0eda13c91bc0 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:21.195732 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5db1a67f-582f-4f62-a3a7-0eda13c91bc0 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:21.207526 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2565/5104] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:22:20 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1668 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:22:21.214354 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5db1a67f-582f-4f62-a3a7-0eda13c91bc0 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:21.216355 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-71e91202-f222-43b8-afe4-8c8b71d9071d tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:21.217010 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5db1a67f-582f-4f62-a3a7-0eda13c91bc0 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:21.217472 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-71e91202-f222-43b8-afe4-8c8b71d9071d tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: d1c50fa6-2d8a-4707-9ee7-448ea57be62b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:21.220411 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5db1a67f-582f-4f62-a3a7-0eda13c91bc0 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:21.226779 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5db1a67f-582f-4f62-a3a7-0eda13c91bc0 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:21.228034 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5db1a67f-582f-4f62-a3a7-0eda13c91bc0 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:21.236594 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5db1a67f-582f-4f62-a3a7-0eda13c91bc0 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:21.247238 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-71e91202-f222-43b8-afe4-8c8b71d9071d tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:21.248100 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-71e91202-f222-43b8-afe4-8c8b71d9071d tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:21.258747 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-71e91202-f222-43b8-afe4-8c8b71d9071d tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:21.261455 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-71e91202-f222-43b8-afe4-8c8b71d9071d tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:21.263101 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-71e91202-f222-43b8-afe4-8c8b71d9071d tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:21.264520 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-71e91202-f222-43b8-afe4-8c8b71d9071d tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:21.574014 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5db1a67f-582f-4f62-a3a7-0eda13c91bc0 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:21.585629 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5db1a67f-582f-4f62-a3a7-0eda13c91bc0 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1287 microversion: 2.1 time: 0.396635 Aug 31 16:22:21.586613 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2540/5105] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:22:21 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1287 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:22:21.592401 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-369b1a51-4d36-4cf6-8978-d9688704f97b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:21.593834 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-369b1a51-4d36-4cf6-8978-d9688704f97b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:21.608172 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-369b1a51-4d36-4cf6-8978-d9688704f97b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:21.609617 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-369b1a51-4d36-4cf6-8978-d9688704f97b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:21.610287 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-369b1a51-4d36-4cf6-8978-d9688704f97b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:21.611406 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-369b1a51-4d36-4cf6-8978-d9688704f97b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:21.612221 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-369b1a51-4d36-4cf6-8978-d9688704f97b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:21.615626 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-369b1a51-4d36-4cf6-8978-d9688704f97b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:22.395210 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-369b1a51-4d36-4cf6-8978-d9688704f97b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:22.406207 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-369b1a51-4d36-4cf6-8978-d9688704f97b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1668 microversion: 2.1 time: 0.817604 Aug 31 16:22:22.411770 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2541/5106] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:22:21 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1668 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:22:22.458068 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-71e91202-f222-43b8-afe4-8c8b71d9071d tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4744703b964435bbead751ca884d1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e014d4e4da5e47ff9a1261e7730034ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:22.470609 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-71e91202-f222-43b8-afe4-8c8b71d9071d tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b" status: 200 len: 1566 microversion: 2.1 time: 1.260784 Aug 31 16:22:22.472440 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2566/5107] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:22:21 2022] GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b => generated 1566 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:22:22.494952 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5a633688-face-44ef-96dc-3bef8a6e7334 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:22.495437 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5a633688-face-44ef-96dc-3bef8a6e7334 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: d1c50fa6-2d8a-4707-9ee7-448ea57be62b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:22.512670 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5a633688-face-44ef-96dc-3bef8a6e7334 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:22.513448 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5a633688-face-44ef-96dc-3bef8a6e7334 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:22.514065 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5a633688-face-44ef-96dc-3bef8a6e7334 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:22.514994 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5a633688-face-44ef-96dc-3bef8a6e7334 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:22.516439 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5a633688-face-44ef-96dc-3bef8a6e7334 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:22.516941 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5a633688-face-44ef-96dc-3bef8a6e7334 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:22.611968 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-831d8f59-ad3c-459a-9bc4-5205945a94e1 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:22.618326 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-831d8f59-ad3c-459a-9bc4-5205945a94e1 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:22.638662 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-831d8f59-ad3c-459a-9bc4-5205945a94e1 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:22.641704 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-831d8f59-ad3c-459a-9bc4-5205945a94e1 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:22.643063 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-831d8f59-ad3c-459a-9bc4-5205945a94e1 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:22.645579 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-831d8f59-ad3c-459a-9bc4-5205945a94e1 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:22.646905 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-831d8f59-ad3c-459a-9bc4-5205945a94e1 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:22.647922 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-831d8f59-ad3c-459a-9bc4-5205945a94e1 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:22.970113 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-831d8f59-ad3c-459a-9bc4-5205945a94e1 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:22.994268 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-831d8f59-ad3c-459a-9bc4-5205945a94e1 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1275 microversion: 2.1 time: 0.384164 Aug 31 16:22:23.012908 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2567/5108] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:22:22 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1275 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:22:23.169218 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5a633688-face-44ef-96dc-3bef8a6e7334 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.679407 Aug 31 16:22:23.178954 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2542/5109] 10.222.0.61 () {58 vars in 1275 bytes} [Wed Aug 31 16:22:22 2022] GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b/os-interface => generated 285 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:22:24.016799 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9c693a8f-1870-4f8e-b0b7-76651ad6f5bc tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:24.019044 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9c693a8f-1870-4f8e-b0b7-76651ad6f5bc tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:24.032981 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9c693a8f-1870-4f8e-b0b7-76651ad6f5bc tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:24.033685 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9c693a8f-1870-4f8e-b0b7-76651ad6f5bc tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:24.034692 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9c693a8f-1870-4f8e-b0b7-76651ad6f5bc tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:24.036200 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9c693a8f-1870-4f8e-b0b7-76651ad6f5bc tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:24.036833 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9c693a8f-1870-4f8e-b0b7-76651ad6f5bc tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:24.037431 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9c693a8f-1870-4f8e-b0b7-76651ad6f5bc tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:25.055133 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9c693a8f-1870-4f8e-b0b7-76651ad6f5bc tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:25.068314 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9c693a8f-1870-4f8e-b0b7-76651ad6f5bc tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1317 microversion: 2.1 time: 1.055901 Aug 31 16:22:25.071054 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2568/5110] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:22:24 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1317 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:22:26.095233 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-35f6b612-f132-4f52-816e-963190681490 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:26.095917 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-35f6b612-f132-4f52-816e-963190681490 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:26.134170 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-35f6b612-f132-4f52-816e-963190681490 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:26.134763 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-35f6b612-f132-4f52-816e-963190681490 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:26.135353 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-35f6b612-f132-4f52-816e-963190681490 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:26.136475 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-35f6b612-f132-4f52-816e-963190681490 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:26.136888 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-35f6b612-f132-4f52-816e-963190681490 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:26.139825 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-35f6b612-f132-4f52-816e-963190681490 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:27.297309 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-35f6b612-f132-4f52-816e-963190681490 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:27.305591 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-35f6b612-f132-4f52-816e-963190681490 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1317 microversion: 2.1 time: 1.216546 Aug 31 16:22:27.316423 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2543/5111] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:22:26 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1317 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:22:28.331241 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-47afded6-dcc0-40eb-81c5-4de94cb29ecb tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:28.332553 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-47afded6-dcc0-40eb-81c5-4de94cb29ecb tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:28.335639 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:22:28.341602 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=8 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:22:28.351373 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-47afded6-dcc0-40eb-81c5-4de94cb29ecb tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:28.353436 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-47afded6-dcc0-40eb-81c5-4de94cb29ecb tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:28.354187 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-47afded6-dcc0-40eb-81c5-4de94cb29ecb tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:28.355212 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-47afded6-dcc0-40eb-81c5-4de94cb29ecb tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:28.355939 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-47afded6-dcc0-40eb-81c5-4de94cb29ecb tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:28.356638 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-47afded6-dcc0-40eb-81c5-4de94cb29ecb tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:29.752801 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-a795c2d8-5da1-41c1-8c14-e27058585354 req-29040173-ea8e-4b1f-ab1b-8e2d43bff821 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1c50fa6-2d8a-4707-9ee7-448ea57be62b", "tag": "cd30456c-29c0-40f3-baeb-7b819e58a733"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:22:29.778139 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-a795c2d8-5da1-41c1-8c14-e27058585354 req-29040173-ea8e-4b1f-ab1b-8e2d43bff821 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:29.778634 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-a795c2d8-5da1-41c1-8c14-e27058585354 req-29040173-ea8e-4b1f-ab1b-8e2d43bff821 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:29.779087 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-a795c2d8-5da1-41c1-8c14-e27058585354 req-29040173-ea8e-4b1f-ab1b-8e2d43bff821 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:29.806096 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-a795c2d8-5da1-41c1-8c14-e27058585354 req-29040173-ea8e-4b1f-ab1b-8e2d43bff821 service nova] Creating event network-changed:cd30456c-29c0-40f3-baeb-7b819e58a733 for instance d1c50fa6-2d8a-4707-9ee7-448ea57be62b on n-h2-850499-9 Aug 31 16:22:29.814544 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-a795c2d8-5da1-41c1-8c14-e27058585354 req-29040173-ea8e-4b1f-ab1b-8e2d43bff821 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065341 Aug 31 16:22:29.815761 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2544/5112] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:22:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:22:30.199281 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-47afded6-dcc0-40eb-81c5-4de94cb29ecb tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:30.211490 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-47afded6-dcc0-40eb-81c5-4de94cb29ecb tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1317 microversion: 2.1 time: 1.883706 Aug 31 16:22:30.212945 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2569/5113] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:22:28 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1317 bytes in 1887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:22:31.235472 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3a83b15f-a7b1-4eb7-8316-91afd100a3a8 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:31.237016 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3a83b15f-a7b1-4eb7-8316-91afd100a3a8 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:31.244946 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3a83b15f-a7b1-4eb7-8316-91afd100a3a8 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:31.245920 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3a83b15f-a7b1-4eb7-8316-91afd100a3a8 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:31.246619 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3a83b15f-a7b1-4eb7-8316-91afd100a3a8 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:31.247663 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3a83b15f-a7b1-4eb7-8316-91afd100a3a8 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:31.248370 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3a83b15f-a7b1-4eb7-8316-91afd100a3a8 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:31.249175 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3a83b15f-a7b1-4eb7-8316-91afd100a3a8 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:31.891212 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-e498ca06-dc9d-40bb-9a3c-8eb4c0d64f0c req-039e8c4c-fee5-4f33-b9e4-24a0c01019fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22082563-385d-41a9-baa5-6fb277278505", "tag": "01a10893-04bb-4b06-9640-8c6578bca1fc"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:22:31.912162 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-e498ca06-dc9d-40bb-9a3c-8eb4c0d64f0c req-039e8c4c-fee5-4f33-b9e4-24a0c01019fa service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:31.913345 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-e498ca06-dc9d-40bb-9a3c-8eb4c0d64f0c req-039e8c4c-fee5-4f33-b9e4-24a0c01019fa service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:31.914338 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-e498ca06-dc9d-40bb-9a3c-8eb4c0d64f0c req-039e8c4c-fee5-4f33-b9e4-24a0c01019fa service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:31.940088 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-e498ca06-dc9d-40bb-9a3c-8eb4c0d64f0c req-039e8c4c-fee5-4f33-b9e4-24a0c01019fa service nova] Creating event network-changed:01a10893-04bb-4b06-9640-8c6578bca1fc for instance 22082563-385d-41a9-baa5-6fb277278505 on n-h2-850499-9 Aug 31 16:22:31.946914 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-e498ca06-dc9d-40bb-9a3c-8eb4c0d64f0c req-039e8c4c-fee5-4f33-b9e4-24a0c01019fa service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060575 Aug 31 16:22:31.948391 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2570/5114] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:22:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:22:31.993361 n-d-850499-9 devstack@n-api.service[122256]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 16:22:31.993522 n-d-850499-9 devstack@n-api.service[122256]: Wed Aug 31 16:22:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 (ip 10.222.0.61) !!! Aug 31 16:22:32.493590 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3a83b15f-a7b1-4eb7-8316-91afd100a3a8 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:32.515938 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3a83b15f-a7b1-4eb7-8316-91afd100a3a8 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1317 microversion: 2.1 time: 1.285997 Aug 31 16:22:32.535463 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2545/5115] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:22:31 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1317 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:22:33.554915 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a77eed82-68fc-4b6f-8c17-c43b0c074b45 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:33.555738 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a77eed82-68fc-4b6f-8c17-c43b0c074b45 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:33.569422 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a77eed82-68fc-4b6f-8c17-c43b0c074b45 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:33.569848 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a77eed82-68fc-4b6f-8c17-c43b0c074b45 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:33.570603 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a77eed82-68fc-4b6f-8c17-c43b0c074b45 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:33.579520 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a77eed82-68fc-4b6f-8c17-c43b0c074b45 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:33.580291 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a77eed82-68fc-4b6f-8c17-c43b0c074b45 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:33.581083 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a77eed82-68fc-4b6f-8c17-c43b0c074b45 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:33.992437 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a77eed82-68fc-4b6f-8c17-c43b0c074b45 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:34.011707 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a77eed82-68fc-4b6f-8c17-c43b0c074b45 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1317 microversion: 2.1 time: 0.468896 Aug 31 16:22:34.025493 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2571/5116] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:22:33 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1317 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:22:35.033100 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9e0d9e8f-2c67-40e4-a42f-17ee85bc627f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:35.034325 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9e0d9e8f-2c67-40e4-a42f-17ee85bc627f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:35.042462 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9e0d9e8f-2c67-40e4-a42f-17ee85bc627f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:35.043215 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9e0d9e8f-2c67-40e4-a42f-17ee85bc627f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:35.043890 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9e0d9e8f-2c67-40e4-a42f-17ee85bc627f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:35.044770 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9e0d9e8f-2c67-40e4-a42f-17ee85bc627f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:35.045398 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9e0d9e8f-2c67-40e4-a42f-17ee85bc627f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:35.045992 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9e0d9e8f-2c67-40e4-a42f-17ee85bc627f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:35.485085 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-9e0d9e8f-2c67-40e4-a42f-17ee85bc627f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:35.502700 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9e0d9e8f-2c67-40e4-a42f-17ee85bc627f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1317 microversion: 2.1 time: 0.473261 Aug 31 16:22:35.504839 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2546/5117] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:22:35 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1317 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:22:36.526505 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-96440521-5499-4e7c-b343-ffc6b500c94e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:36.527809 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-96440521-5499-4e7c-b343-ffc6b500c94e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:36.550243 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-96440521-5499-4e7c-b343-ffc6b500c94e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:36.552569 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-96440521-5499-4e7c-b343-ffc6b500c94e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:36.553253 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-96440521-5499-4e7c-b343-ffc6b500c94e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:36.554412 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-96440521-5499-4e7c-b343-ffc6b500c94e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:36.555107 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-96440521-5499-4e7c-b343-ffc6b500c94e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:36.555742 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-96440521-5499-4e7c-b343-ffc6b500c94e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:37.054578 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-96440521-5499-4e7c-b343-ffc6b500c94e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:37.072446 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-96440521-5499-4e7c-b343-ffc6b500c94e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1317 microversion: 2.1 time: 0.550229 Aug 31 16:22:37.073078 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2572/5118] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:22:36 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1317 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:22:38.099584 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1fc07dca-8d14-427d-95f8-e7b075115b22 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:38.101574 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1fc07dca-8d14-427d-95f8-e7b075115b22 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:38.122655 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1fc07dca-8d14-427d-95f8-e7b075115b22 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:38.125223 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1fc07dca-8d14-427d-95f8-e7b075115b22 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:38.125690 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1fc07dca-8d14-427d-95f8-e7b075115b22 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:38.126967 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1fc07dca-8d14-427d-95f8-e7b075115b22 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:38.127607 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1fc07dca-8d14-427d-95f8-e7b075115b22 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:38.128070 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1fc07dca-8d14-427d-95f8-e7b075115b22 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:38.148220 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7ec0fc81-097d-4f0f-b19d-e0da5166de54 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Action: 'create', calling method: .version_select at 0x7f5ae3d0c1f0>, body: {"keypair": {"name": "tempest-keypair-1691197990", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOK70iMsOMcuxsaZWpbZgmUxFQe+NlHfOa+Izc7U/47GKU4cP2KroI7eA3AUjRuWM7v7BGK2gkgF8N9F3A7bKpSQAPZiSOpxLiosGJwyYpuq1fpDjQlL6wdf6CGMuPeM0g=="}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:22:38.183136 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-7ec0fc81-097d-4f0f-b19d-e0da5166de54 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Getting quotas for project 79d9ba3589a24faaac930a35742ce834. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:22:38.203661 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-7ec0fc81-097d-4f0f-b19d-e0da5166de54 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Getting quotas for user 133363b2b12d4730994557ee24f08879 and project 79d9ba3589a24faaac930a35742ce834. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:22:38.246077 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7ec0fc81-097d-4f0f-b19d-e0da5166de54 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.319443 Aug 31 16:22:38.247181 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2547/5119] 10.222.0.61 () {60 vars in 1159 bytes} [Wed Aug 31 16:22:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:22:38.461775 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-1fc07dca-8d14-427d-95f8-e7b075115b22 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:38.474673 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1fc07dca-8d14-427d-95f8-e7b075115b22 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1317 microversion: 2.1 time: 0.381641 Aug 31 16:22:38.488315 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2573/5120] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:22:38 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1317 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:22:39.500263 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-55d13d85-59ba-472a-86d5-d1959b206795 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:39.500910 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-55d13d85-59ba-472a-86d5-d1959b206795 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:39.513855 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-55d13d85-59ba-472a-86d5-d1959b206795 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:39.514388 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-55d13d85-59ba-472a-86d5-d1959b206795 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:39.515228 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-55d13d85-59ba-472a-86d5-d1959b206795 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:39.518603 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-55d13d85-59ba-472a-86d5-d1959b206795 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:39.519692 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-55d13d85-59ba-472a-86d5-d1959b206795 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:39.522870 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-55d13d85-59ba-472a-86d5-d1959b206795 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:39.976008 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-55d13d85-59ba-472a-86d5-d1959b206795 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:40.007261 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-55d13d85-59ba-472a-86d5-d1959b206795 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1317 microversion: 2.1 time: 0.510848 Aug 31 16:22:40.024311 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2548/5121] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:22:39 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1317 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:22:40.572700 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e44eea1e-87d2-4261-9a8d-13b79d9fc648 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:40.573258 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e44eea1e-87d2-4261-9a8d-13b79d9fc648 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:40.582460 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e44eea1e-87d2-4261-9a8d-13b79d9fc648 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:40.583071 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e44eea1e-87d2-4261-9a8d-13b79d9fc648 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:40.583865 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e44eea1e-87d2-4261-9a8d-13b79d9fc648 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:40.587798 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e44eea1e-87d2-4261-9a8d-13b79d9fc648 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:40.588293 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e44eea1e-87d2-4261-9a8d-13b79d9fc648 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:40.589015 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e44eea1e-87d2-4261-9a8d-13b79d9fc648 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:40.632693 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e44eea1e-87d2-4261-9a8d-13b79d9fc648 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5/ips" status: 200 len: 153 microversion: 2.20 time: 0.064695 Aug 31 16:22:40.636102 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2574/5122] 10.222.0.61 () {60 vars in 1289 bytes} [Wed Aug 31 16:22:40 2022] GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5/ips => generated 153 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 16:22:41.030897 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ca9e8df3-eb4a-4db0-9970-66a8287bbbd5 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:41.031797 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ca9e8df3-eb4a-4db0-9970-66a8287bbbd5 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:41.043304 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ca9e8df3-eb4a-4db0-9970-66a8287bbbd5 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:41.045829 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ca9e8df3-eb4a-4db0-9970-66a8287bbbd5 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:41.046303 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ca9e8df3-eb4a-4db0-9970-66a8287bbbd5 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:41.052324 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ca9e8df3-eb4a-4db0-9970-66a8287bbbd5 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:41.053115 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ca9e8df3-eb4a-4db0-9970-66a8287bbbd5 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:41.053740 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ca9e8df3-eb4a-4db0-9970-66a8287bbbd5 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:41.896345 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-9fe139a9-247c-4cef-86dc-cbc9ac820d2f req-b9a33974-5517-4301-935c-00de70f07a06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22082563-385d-41a9-baa5-6fb277278505", "name": "network-vif-plugged", "status": "completed", "tag": "01a10893-04bb-4b06-9640-8c6578bca1fc"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:22:41.927850 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-9fe139a9-247c-4cef-86dc-cbc9ac820d2f req-b9a33974-5517-4301-935c-00de70f07a06 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:41.928589 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-9fe139a9-247c-4cef-86dc-cbc9ac820d2f req-b9a33974-5517-4301-935c-00de70f07a06 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:41.929166 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-9fe139a9-247c-4cef-86dc-cbc9ac820d2f req-b9a33974-5517-4301-935c-00de70f07a06 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:41.957233 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-9fe139a9-247c-4cef-86dc-cbc9ac820d2f req-b9a33974-5517-4301-935c-00de70f07a06 service nova] Creating event network-vif-plugged:01a10893-04bb-4b06-9640-8c6578bca1fc for instance 22082563-385d-41a9-baa5-6fb277278505 on n-h2-850499-9 Aug 31 16:22:41.979981 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-9fe139a9-247c-4cef-86dc-cbc9ac820d2f req-b9a33974-5517-4301-935c-00de70f07a06 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081401 Aug 31 16:22:41.981211 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2575/5123] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:22:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:22:42.312681 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-46ead077-3b21-44f4-8421-43582115276b tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-609151457", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "11b1617b-14c9-40d6-9f52-0ad0c12edada"}], "security_groups": [{"name": "tempest-securitygroup--1755021745"}], "key_name": "tempest-keypair-1691197990", "user_data": "}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:22:42.789891 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ca9e8df3-eb4a-4db0-9970-66a8287bbbd5 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:42.821131 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ca9e8df3-eb4a-4db0-9970-66a8287bbbd5 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1317 microversion: 2.1 time: 1.780314 Aug 31 16:22:42.825781 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2549/5124] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:22:41 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1317 bytes in 1799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:22:42.877253 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-46ead077-3b21-44f4-8421-43582115276b tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] validate_networks() for [('11b1617b-14c9-40d6-9f52-0ad0c12edada', None, None, None, None, None)] {{(pid=122257) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:22:43.875046 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c744e0b7-1b2c-4ebc-a532-f6bc0ec873f9 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:43.877739 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c744e0b7-1b2c-4ebc-a532-f6bc0ec873f9 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:43.892284 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c744e0b7-1b2c-4ebc-a532-f6bc0ec873f9 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:43.893496 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c744e0b7-1b2c-4ebc-a532-f6bc0ec873f9 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:43.896296 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c744e0b7-1b2c-4ebc-a532-f6bc0ec873f9 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:43.899357 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c744e0b7-1b2c-4ebc-a532-f6bc0ec873f9 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:43.902550 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c744e0b7-1b2c-4ebc-a532-f6bc0ec873f9 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:43.903655 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c744e0b7-1b2c-4ebc-a532-f6bc0ec873f9 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:44.260889 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-46ead077-3b21-44f4-8421-43582115276b tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:22:44.263258 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-46ead077-3b21-44f4-8421-43582115276b tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:22:44.264313 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-46ead077-3b21-44f4-8421-43582115276b tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:22:44.265019 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-46ead077-3b21-44f4-8421-43582115276b tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:22:44.265713 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-46ead077-3b21-44f4-8421-43582115276b tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:22:44.278588 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:22:44.293347 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-46ead077-3b21-44f4-8421-43582115276b tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:44.294933 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-46ead077-3b21-44f4-8421-43582115276b tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:44.295328 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-46ead077-3b21-44f4-8421-43582115276b tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:44.297635 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-46ead077-3b21-44f4-8421-43582115276b tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:44.298568 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-46ead077-3b21-44f4-8421-43582115276b tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:44.299742 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-46ead077-3b21-44f4-8421-43582115276b tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:44.335232 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-46ead077-3b21-44f4-8421-43582115276b tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Getting quotas for project 79d9ba3589a24faaac930a35742ce834. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:22:44.335485 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c744e0b7-1b2c-4ebc-a532-f6bc0ec873f9 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:44.343657 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-46ead077-3b21-44f4-8421-43582115276b tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Getting quotas for user 133363b2b12d4730994557ee24f08879 and project 79d9ba3589a24faaac930a35742ce834. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:22:44.362428 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c744e0b7-1b2c-4ebc-a532-f6bc0ec873f9 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1317 microversion: 2.1 time: 0.504533 Aug 31 16:22:44.380718 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2550/5125] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:22:43 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1317 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:22:44.380718 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4c7d6d04-e5d1-4e1f-a566-b66ee4d6f9a2 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:22:44.380718 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4c7d6d04-e5d1-4e1f-a566-b66ee4d6f9a2 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:44.382751 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:22:44.401722 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4c7d6d04-e5d1-4e1f-a566-b66ee4d6f9a2 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:44.402459 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4c7d6d04-e5d1-4e1f-a566-b66ee4d6f9a2 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:44.403249 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4c7d6d04-e5d1-4e1f-a566-b66ee4d6f9a2 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:44.404243 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4c7d6d04-e5d1-4e1f-a566-b66ee4d6f9a2 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:44.404928 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4c7d6d04-e5d1-4e1f-a566-b66ee4d6f9a2 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:44.405570 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4c7d6d04-e5d1-4e1f-a566-b66ee4d6f9a2 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:44.415187 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-46ead077-3b21-44f4-8421-43582115276b tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Going to run 1 instances... {{(pid=122257) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:22:44.423811 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-46ead077-3b21-44f4-8421-43582115276b tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 6e139adf-20d3-4d88-941f-fe9a45276ad5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:22:44.458534 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-4c7d6d04-e5d1-4e1f-a566-b66ee4d6f9a2 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lazy-loading 'flavor' on Instance uuid 85a0286b-2e02-4ecb-a63d-0b4a61048ab5 {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:22:44.633146 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-46ead077-3b21-44f4-8421-43582115276b tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.326304 Aug 31 16:22:44.637936 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2576/5126] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:22:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 2332 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:22:44.669219 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-28f37591-649e-4a3f-802f-d3d54bc83ce1 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:44.674588 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-28f37591-649e-4a3f-802f-d3d54bc83ce1 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 6e139adf-20d3-4d88-941f-fe9a45276ad5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:44.836831 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-28f37591-649e-4a3f-802f-d3d54bc83ce1 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133363b2b12d4730994557ee24f08879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d9ba3589a24faaac930a35742ce834', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:44.855211 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-28f37591-649e-4a3f-802f-d3d54bc83ce1 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/6e139adf-20d3-4d88-941f-fe9a45276ad5" status: 200 len: 1241 microversion: 2.1 time: 0.202354 Aug 31 16:22:44.868591 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2577/5127] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:22:44 2022] GET /compute/v2.1/servers/6e139adf-20d3-4d88-941f-fe9a45276ad5 => generated 1241 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:22:45.093242 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4c7d6d04-e5d1-4e1f-a566-b66ee4d6f9a2 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "POST /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5/action" status: 202 len: 0 microversion: 2.20 time: 0.724441 Aug 31 16:22:45.114279 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4a6614d7-1d2c-4ff1-9067-c62e80349c00 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:45.115125 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4a6614d7-1d2c-4ff1-9067-c62e80349c00 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:45.121397 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2551/5128] 10.222.0.61 () {62 vars in 1319 bytes} [Wed Aug 31 16:22:44 2022] POST /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5/action => generated 0 bytes in 754 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:22:45.144236 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4a6614d7-1d2c-4ff1-9067-c62e80349c00 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:45.145117 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4a6614d7-1d2c-4ff1-9067-c62e80349c00 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:45.145740 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4a6614d7-1d2c-4ff1-9067-c62e80349c00 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:45.146682 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4a6614d7-1d2c-4ff1-9067-c62e80349c00 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:45.147624 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4a6614d7-1d2c-4ff1-9067-c62e80349c00 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:45.149323 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4a6614d7-1d2c-4ff1-9067-c62e80349c00 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:45.405108 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-02492230-776f-4925-a26d-7dc13a08033a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:45.406682 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-02492230-776f-4925-a26d-7dc13a08033a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:45.433410 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-02492230-776f-4925-a26d-7dc13a08033a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:45.434410 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-02492230-776f-4925-a26d-7dc13a08033a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:45.437659 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-02492230-776f-4925-a26d-7dc13a08033a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:45.438617 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-02492230-776f-4925-a26d-7dc13a08033a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:45.440738 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-02492230-776f-4925-a26d-7dc13a08033a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:45.442458 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-02492230-776f-4925-a26d-7dc13a08033a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:45.469809 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-4a6614d7-1d2c-4ff1-9067-c62e80349c00 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:45.487758 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-4a6614d7-1d2c-4ff1-9067-c62e80349c00 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:45.490172 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-4a6614d7-1d2c-4ff1-9067-c62e80349c00 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:45.494621 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4a6614d7-1d2c-4ff1-9067-c62e80349c00 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5" status: 200 len: 1725 microversion: 2.20 time: 0.384972 Aug 31 16:22:45.496054 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2578/5129] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:22:45 2022] GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5 => generated 1725 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:22:45.499120 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:22:45.807896 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-02492230-776f-4925-a26d-7dc13a08033a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:45.835008 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-02492230-776f-4925-a26d-7dc13a08033a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1504 microversion: 2.1 time: 0.435162 Aug 31 16:22:45.836662 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2552/5130] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:22:45 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1504 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:22:45.883173 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4195de26-c674-4d50-8ba3-c3c20d0d65e2 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:45.884132 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4195de26-c674-4d50-8ba3-c3c20d0d65e2 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 6e139adf-20d3-4d88-941f-fe9a45276ad5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:45.890925 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4195de26-c674-4d50-8ba3-c3c20d0d65e2 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:45.898346 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4195de26-c674-4d50-8ba3-c3c20d0d65e2 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:45.899044 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4195de26-c674-4d50-8ba3-c3c20d0d65e2 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:45.900114 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4195de26-c674-4d50-8ba3-c3c20d0d65e2 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:45.902099 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4195de26-c674-4d50-8ba3-c3c20d0d65e2 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:45.902877 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4195de26-c674-4d50-8ba3-c3c20d0d65e2 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:45.989754 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-26655763-2b0f-4c38-a42e-535be820d174 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1011643896", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "networks": [{"uuid": "fa24e0ec-4a58-4400-9cf4-a0201375c33e"}]}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:22:46.056340 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-4195de26-c674-4d50-8ba3-c3c20d0d65e2 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133363b2b12d4730994557ee24f08879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d9ba3589a24faaac930a35742ce834', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:46.073515 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4195de26-c674-4d50-8ba3-c3c20d0d65e2 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/6e139adf-20d3-4d88-941f-fe9a45276ad5" status: 200 len: 1237 microversion: 2.1 time: 0.193868 Aug 31 16:22:46.075082 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2579/5131] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:22:45 2022] GET /compute/v2.1/servers/6e139adf-20d3-4d88-941f-fe9a45276ad5 => generated 1237 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:22:46.117267 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-26655763-2b0f-4c38-a42e-535be820d174 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] validate_networks() for [('fa24e0ec-4a58-4400-9cf4-a0201375c33e', None, None, None, None, None)] {{(pid=122256) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:22:46.526938 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-42e8d4f6-2686-414b-bad6-ab99715041ae tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:46.528435 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-42e8d4f6-2686-414b-bad6-ab99715041ae tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:46.564877 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-42e8d4f6-2686-414b-bad6-ab99715041ae tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:46.567727 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-42e8d4f6-2686-414b-bad6-ab99715041ae tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:46.568395 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-42e8d4f6-2686-414b-bad6-ab99715041ae tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:46.570916 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-42e8d4f6-2686-414b-bad6-ab99715041ae tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:46.572763 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-42e8d4f6-2686-414b-bad6-ab99715041ae tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:46.574194 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-42e8d4f6-2686-414b-bad6-ab99715041ae tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:47.337032 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-42e8d4f6-2686-414b-bad6-ab99715041ae tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:47.350391 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-42e8d4f6-2686-414b-bad6-ab99715041ae tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:47.357257 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-42e8d4f6-2686-414b-bad6-ab99715041ae tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:47.358609 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-42e8d4f6-2686-414b-bad6-ab99715041ae tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5" status: 200 len: 1725 microversion: 2.20 time: 0.838464 Aug 31 16:22:47.363881 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2580/5132] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:22:46 2022] GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5 => generated 1725 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:22:47.369271 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f0dbed28-c518-4b2b-8fba-c229c758a97d tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:47.369897 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f0dbed28-c518-4b2b-8fba-c229c758a97d tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 6e139adf-20d3-4d88-941f-fe9a45276ad5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:47.404941 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f0dbed28-c518-4b2b-8fba-c229c758a97d tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:47.405778 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f0dbed28-c518-4b2b-8fba-c229c758a97d tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:47.406545 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f0dbed28-c518-4b2b-8fba-c229c758a97d tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:47.407548 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f0dbed28-c518-4b2b-8fba-c229c758a97d tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:47.412763 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f0dbed28-c518-4b2b-8fba-c229c758a97d tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:47.413533 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f0dbed28-c518-4b2b-8fba-c229c758a97d tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:47.645866 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f0dbed28-c518-4b2b-8fba-c229c758a97d tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133363b2b12d4730994557ee24f08879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d9ba3589a24faaac930a35742ce834', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:47.666320 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-26655763-2b0f-4c38-a42e-535be820d174 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:22:47.667066 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-26655763-2b0f-4c38-a42e-535be820d174 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:22:47.668821 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-26655763-2b0f-4c38-a42e-535be820d174 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:22:47.670098 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-26655763-2b0f-4c38-a42e-535be820d174 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:22:47.671354 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-26655763-2b0f-4c38-a42e-535be820d174 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:22:47.680368 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f0dbed28-c518-4b2b-8fba-c229c758a97d tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/6e139adf-20d3-4d88-941f-fe9a45276ad5" status: 200 len: 1299 microversion: 2.1 time: 0.314736 Aug 31 16:22:47.681340 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2581/5133] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:22:47 2022] GET /compute/v2.1/servers/6e139adf-20d3-4d88-941f-fe9a45276ad5 => generated 1299 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:22:47.699915 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-26655763-2b0f-4c38-a42e-535be820d174 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:47.700425 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-26655763-2b0f-4c38-a42e-535be820d174 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:47.700865 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-26655763-2b0f-4c38-a42e-535be820d174 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:47.701613 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-26655763-2b0f-4c38-a42e-535be820d174 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:47.702080 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-26655763-2b0f-4c38-a42e-535be820d174 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:47.702521 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-26655763-2b0f-4c38-a42e-535be820d174 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:47.735490 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-26655763-2b0f-4c38-a42e-535be820d174 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Getting quotas for project 014522b19dc349a691e1f6b131229974. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:22:47.746063 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-26655763-2b0f-4c38-a42e-535be820d174 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Getting quotas for user c042c43cc2aa4000a147fae62c261e86 and project 014522b19dc349a691e1f6b131229974. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:22:47.764273 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-26655763-2b0f-4c38-a42e-535be820d174 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Going to run 1 instances... {{(pid=122256) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:22:47.767037 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-26655763-2b0f-4c38-a42e-535be820d174 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 4399d570-dda9-4a5a-921c-d76d95f0a6f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:22:47.844308 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-26655763-2b0f-4c38-a42e-535be820d174 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.858464 Aug 31 16:22:47.845263 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2553/5134] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:22:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1861 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:22:47.863173 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d4fea71b-ee4b-4986-b228-3a4712c55c47 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:47.863851 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d4fea71b-ee4b-4986-b228-3a4712c55c47 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 4399d570-dda9-4a5a-921c-d76d95f0a6f5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:48.403680 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-49ecf19f-0d70-4b2f-a4a6-aab0ff355660 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:48.404579 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-49ecf19f-0d70-4b2f-a4a6-aab0ff355660 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:48.413948 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d4fea71b-ee4b-4986-b228-3a4712c55c47 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:48.415092 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-49ecf19f-0d70-4b2f-a4a6-aab0ff355660 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:48.415907 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-49ecf19f-0d70-4b2f-a4a6-aab0ff355660 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:48.418968 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-49ecf19f-0d70-4b2f-a4a6-aab0ff355660 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:48.420072 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-49ecf19f-0d70-4b2f-a4a6-aab0ff355660 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:48.423140 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-49ecf19f-0d70-4b2f-a4a6-aab0ff355660 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:48.424078 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-49ecf19f-0d70-4b2f-a4a6-aab0ff355660 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:48.430317 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d4fea71b-ee4b-4986-b228-3a4712c55c47 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/4399d570-dda9-4a5a-921c-d76d95f0a6f5" status: 200 len: 1217 microversion: 2.1 time: 0.576674 Aug 31 16:22:48.432153 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2582/5135] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:22:47 2022] GET /compute/v2.1/servers/4399d570-dda9-4a5a-921c-d76d95f0a6f5 => generated 1217 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:22:48.719333 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8bead9c9-cdad-4c7b-b18a-2d6c9b865ae8 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:48.720397 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8bead9c9-cdad-4c7b-b18a-2d6c9b865ae8 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 6e139adf-20d3-4d88-941f-fe9a45276ad5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:48.772902 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8bead9c9-cdad-4c7b-b18a-2d6c9b865ae8 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:48.774234 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8bead9c9-cdad-4c7b-b18a-2d6c9b865ae8 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:48.775347 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8bead9c9-cdad-4c7b-b18a-2d6c9b865ae8 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:48.776633 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8bead9c9-cdad-4c7b-b18a-2d6c9b865ae8 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:48.780959 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8bead9c9-cdad-4c7b-b18a-2d6c9b865ae8 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:48.782825 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8bead9c9-cdad-4c7b-b18a-2d6c9b865ae8 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:48.923642 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8bead9c9-cdad-4c7b-b18a-2d6c9b865ae8 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133363b2b12d4730994557ee24f08879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d9ba3589a24faaac930a35742ce834', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:48.936508 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8bead9c9-cdad-4c7b-b18a-2d6c9b865ae8 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/6e139adf-20d3-4d88-941f-fe9a45276ad5" status: 200 len: 1299 microversion: 2.1 time: 0.222359 Aug 31 16:22:48.937814 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2583/5136] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:22:48 2022] GET /compute/v2.1/servers/6e139adf-20d3-4d88-941f-fe9a45276ad5 => generated 1299 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:22:48.946486 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-49ecf19f-0d70-4b2f-a4a6-aab0ff355660 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:48.960183 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-49ecf19f-0d70-4b2f-a4a6-aab0ff355660 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:48.962016 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-49ecf19f-0d70-4b2f-a4a6-aab0ff355660 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:48.963584 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-49ecf19f-0d70-4b2f-a4a6-aab0ff355660 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5" status: 200 len: 1725 microversion: 2.20 time: 0.566203 Aug 31 16:22:48.980150 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2554/5137] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:22:48 2022] GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5 => generated 1725 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:22:49.460929 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-65533725-b1de-426f-b6c8-32fd5ac12599 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:49.463187 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-65533725-b1de-426f-b6c8-32fd5ac12599 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 4399d570-dda9-4a5a-921c-d76d95f0a6f5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:49.475338 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-65533725-b1de-426f-b6c8-32fd5ac12599 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:49.476253 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-65533725-b1de-426f-b6c8-32fd5ac12599 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:49.476978 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-65533725-b1de-426f-b6c8-32fd5ac12599 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:49.478461 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-65533725-b1de-426f-b6c8-32fd5ac12599 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:49.479060 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-65533725-b1de-426f-b6c8-32fd5ac12599 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:49.479526 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-65533725-b1de-426f-b6c8-32fd5ac12599 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:49.608554 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-65533725-b1de-426f-b6c8-32fd5ac12599 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:49.648207 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-65533725-b1de-426f-b6c8-32fd5ac12599 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/4399d570-dda9-4a5a-921c-d76d95f0a6f5" status: 200 len: 1269 microversion: 2.1 time: 0.194003 Aug 31 16:22:49.671295 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2584/5138] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:22:49 2022] GET /compute/v2.1/servers/4399d570-dda9-4a5a-921c-d76d95f0a6f5 => generated 1269 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:22:49.966157 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-431efb1b-5a8d-4cfa-809c-5e6b37f00711 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:49.968910 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-431efb1b-5a8d-4cfa-809c-5e6b37f00711 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 6e139adf-20d3-4d88-941f-fe9a45276ad5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:49.979087 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-431efb1b-5a8d-4cfa-809c-5e6b37f00711 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:49.981424 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-431efb1b-5a8d-4cfa-809c-5e6b37f00711 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:49.981992 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-431efb1b-5a8d-4cfa-809c-5e6b37f00711 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:49.982814 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-431efb1b-5a8d-4cfa-809c-5e6b37f00711 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:49.983303 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-431efb1b-5a8d-4cfa-809c-5e6b37f00711 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:49.984387 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-431efb1b-5a8d-4cfa-809c-5e6b37f00711 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:49.990327 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8408a43b-3534-4d4b-a10a-85e5f6b8e220 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:49.990952 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8408a43b-3534-4d4b-a10a-85e5f6b8e220 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:50.007608 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8408a43b-3534-4d4b-a10a-85e5f6b8e220 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:50.008389 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8408a43b-3534-4d4b-a10a-85e5f6b8e220 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:50.010120 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8408a43b-3534-4d4b-a10a-85e5f6b8e220 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:50.011526 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8408a43b-3534-4d4b-a10a-85e5f6b8e220 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:50.012185 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8408a43b-3534-4d4b-a10a-85e5f6b8e220 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:50.016215 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8408a43b-3534-4d4b-a10a-85e5f6b8e220 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:50.821160 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-431efb1b-5a8d-4cfa-809c-5e6b37f00711 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133363b2b12d4730994557ee24f08879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d9ba3589a24faaac930a35742ce834', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:50.833480 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-431efb1b-5a8d-4cfa-809c-5e6b37f00711 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/6e139adf-20d3-4d88-941f-fe9a45276ad5" status: 200 len: 1367 microversion: 2.1 time: 0.878522 Aug 31 16:22:50.834746 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2555/5139] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:22:49 2022] GET /compute/v2.1/servers/6e139adf-20d3-4d88-941f-fe9a45276ad5 => generated 1367 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:22:50.844701 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-31eb1772-c8e3-4149-af06-1a58a5fac41b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:50.846445 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-31eb1772-c8e3-4149-af06-1a58a5fac41b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 4399d570-dda9-4a5a-921c-d76d95f0a6f5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:50.876857 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-31eb1772-c8e3-4149-af06-1a58a5fac41b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:50.877512 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8408a43b-3534-4d4b-a10a-85e5f6b8e220 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:50.878149 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-31eb1772-c8e3-4149-af06-1a58a5fac41b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:50.878905 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-31eb1772-c8e3-4149-af06-1a58a5fac41b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:50.879892 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-31eb1772-c8e3-4149-af06-1a58a5fac41b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:50.880765 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-31eb1772-c8e3-4149-af06-1a58a5fac41b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:50.881695 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=100 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:22:50.882300 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-31eb1772-c8e3-4149-af06-1a58a5fac41b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:50.902510 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8408a43b-3534-4d4b-a10a-85e5f6b8e220 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:50.904315 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8408a43b-3534-4d4b-a10a-85e5f6b8e220 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:50.916789 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8408a43b-3534-4d4b-a10a-85e5f6b8e220 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5" status: 200 len: 1725 microversion: 2.20 time: 0.931431 Aug 31 16:22:50.929603 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2585/5140] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:22:49 2022] GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5 => generated 1725 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:22:51.026562 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-31eb1772-c8e3-4149-af06-1a58a5fac41b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:51.058275 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-31eb1772-c8e3-4149-af06-1a58a5fac41b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/4399d570-dda9-4a5a-921c-d76d95f0a6f5" status: 200 len: 1275 microversion: 2.1 time: 0.220187 Aug 31 16:22:51.077644 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2556/5141] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:22:50 2022] GET /compute/v2.1/servers/4399d570-dda9-4a5a-921c-d76d95f0a6f5 => generated 1275 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:22:51.869237 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b96fac34-1020-4ccd-8470-ba3192fa9d42 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:51.872166 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b96fac34-1020-4ccd-8470-ba3192fa9d42 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 6e139adf-20d3-4d88-941f-fe9a45276ad5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:51.891245 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b96fac34-1020-4ccd-8470-ba3192fa9d42 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:51.892058 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b96fac34-1020-4ccd-8470-ba3192fa9d42 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:51.892666 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b96fac34-1020-4ccd-8470-ba3192fa9d42 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:51.894002 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b96fac34-1020-4ccd-8470-ba3192fa9d42 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:51.894681 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b96fac34-1020-4ccd-8470-ba3192fa9d42 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:51.895288 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b96fac34-1020-4ccd-8470-ba3192fa9d42 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:51.948682 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-24d8ff93-dee6-4c93-9dff-ce287952e1c8 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:51.949638 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-24d8ff93-dee6-4c93-9dff-ce287952e1c8 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:51.961703 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-24d8ff93-dee6-4c93-9dff-ce287952e1c8 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:51.962468 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-24d8ff93-dee6-4c93-9dff-ce287952e1c8 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:51.963107 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-24d8ff93-dee6-4c93-9dff-ce287952e1c8 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:51.965327 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-24d8ff93-dee6-4c93-9dff-ce287952e1c8 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:51.967242 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-24d8ff93-dee6-4c93-9dff-ce287952e1c8 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:51.968210 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-24d8ff93-dee6-4c93-9dff-ce287952e1c8 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:52.589043 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b96fac34-1020-4ccd-8470-ba3192fa9d42 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133363b2b12d4730994557ee24f08879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d9ba3589a24faaac930a35742ce834', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:52.604019 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b96fac34-1020-4ccd-8470-ba3192fa9d42 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/6e139adf-20d3-4d88-941f-fe9a45276ad5" status: 200 len: 1367 microversion: 2.1 time: 0.751515 Aug 31 16:22:52.604942 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2586/5142] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:22:51 2022] GET /compute/v2.1/servers/6e139adf-20d3-4d88-941f-fe9a45276ad5 => generated 1367 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:22:52.628662 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e53931d0-3a91-4d20-a631-0e3245984510 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:52.629514 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e53931d0-3a91-4d20-a631-0e3245984510 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 4399d570-dda9-4a5a-921c-d76d95f0a6f5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:52.637542 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e53931d0-3a91-4d20-a631-0e3245984510 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:52.638689 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e53931d0-3a91-4d20-a631-0e3245984510 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:52.639668 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e53931d0-3a91-4d20-a631-0e3245984510 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:52.640828 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e53931d0-3a91-4d20-a631-0e3245984510 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:52.641585 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e53931d0-3a91-4d20-a631-0e3245984510 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:52.642279 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e53931d0-3a91-4d20-a631-0e3245984510 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:52.755989 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-24d8ff93-dee6-4c93-9dff-ce287952e1c8 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:52.776680 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-24d8ff93-dee6-4c93-9dff-ce287952e1c8 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:52.778632 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-24d8ff93-dee6-4c93-9dff-ce287952e1c8 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:52.789127 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-24d8ff93-dee6-4c93-9dff-ce287952e1c8 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5" status: 200 len: 1725 microversion: 2.20 time: 0.848697 Aug 31 16:22:52.791752 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2557/5143] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:22:51 2022] GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5 => generated 1725 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:22:52.798090 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-d9e214bd-7fa9-4ef4-9a18-49c658c4e8ba req-031a15ae-4809-42cf-a3e4-9c30e62b7eb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e139adf-20d3-4d88-941f-fe9a45276ad5", "tag": "329b15f2-26ad-48cd-a95e-e8b610ce8985"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:22:52.837547 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-d9e214bd-7fa9-4ef4-9a18-49c658c4e8ba req-031a15ae-4809-42cf-a3e4-9c30e62b7eb0 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:52.838354 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-d9e214bd-7fa9-4ef4-9a18-49c658c4e8ba req-031a15ae-4809-42cf-a3e4-9c30e62b7eb0 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:52.838961 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-d9e214bd-7fa9-4ef4-9a18-49c658c4e8ba req-031a15ae-4809-42cf-a3e4-9c30e62b7eb0 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:52.858231 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-d9e214bd-7fa9-4ef4-9a18-49c658c4e8ba req-031a15ae-4809-42cf-a3e4-9c30e62b7eb0 service nova] Creating event network-changed:329b15f2-26ad-48cd-a95e-e8b610ce8985 for instance 6e139adf-20d3-4d88-941f-fe9a45276ad5 on n-h1-850499-9 Aug 31 16:22:52.876764 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-d9e214bd-7fa9-4ef4-9a18-49c658c4e8ba req-031a15ae-4809-42cf-a3e4-9c30e62b7eb0 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082238 Aug 31 16:22:52.878035 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2558/5144] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:22:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:22:53.124629 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e53931d0-3a91-4d20-a631-0e3245984510 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:53.137364 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e53931d0-3a91-4d20-a631-0e3245984510 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/4399d570-dda9-4a5a-921c-d76d95f0a6f5" status: 200 len: 1317 microversion: 2.1 time: 0.518036 Aug 31 16:22:53.139973 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2587/5145] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:22:52 2022] GET /compute/v2.1/servers/4399d570-dda9-4a5a-921c-d76d95f0a6f5 => generated 1317 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:22:53.634129 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-623166ca-2688-4129-88a5-a5e49a75ac48 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:53.645661 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-623166ca-2688-4129-88a5-a5e49a75ac48 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 6e139adf-20d3-4d88-941f-fe9a45276ad5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:53.660396 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-623166ca-2688-4129-88a5-a5e49a75ac48 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:53.661566 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-623166ca-2688-4129-88a5-a5e49a75ac48 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:53.678022 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-623166ca-2688-4129-88a5-a5e49a75ac48 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:53.679839 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-623166ca-2688-4129-88a5-a5e49a75ac48 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:53.684768 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-623166ca-2688-4129-88a5-a5e49a75ac48 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:53.692878 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-623166ca-2688-4129-88a5-a5e49a75ac48 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:53.824100 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-517acf0c-b0a8-4e51-9ec4-9d07b44bf3c2 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:53.825525 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-517acf0c-b0a8-4e51-9ec4-9d07b44bf3c2 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:53.836957 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-517acf0c-b0a8-4e51-9ec4-9d07b44bf3c2 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:53.838979 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-517acf0c-b0a8-4e51-9ec4-9d07b44bf3c2 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:53.841163 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-517acf0c-b0a8-4e51-9ec4-9d07b44bf3c2 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:53.842171 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-517acf0c-b0a8-4e51-9ec4-9d07b44bf3c2 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:53.845338 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-517acf0c-b0a8-4e51-9ec4-9d07b44bf3c2 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:53.846172 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-517acf0c-b0a8-4e51-9ec4-9d07b44bf3c2 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:54.322739 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:22:54.435478 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-623166ca-2688-4129-88a5-a5e49a75ac48 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133363b2b12d4730994557ee24f08879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d9ba3589a24faaac930a35742ce834', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:54.456766 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-623166ca-2688-4129-88a5-a5e49a75ac48 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/6e139adf-20d3-4d88-941f-fe9a45276ad5" status: 200 len: 1367 microversion: 2.1 time: 0.829818 Aug 31 16:22:54.457755 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2559/5146] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:22:53 2022] GET /compute/v2.1/servers/6e139adf-20d3-4d88-941f-fe9a45276ad5 => generated 1367 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:22:54.463269 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e79adcf4-9e3f-4595-ac2b-d978eb237e6f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:54.464178 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e79adcf4-9e3f-4595-ac2b-d978eb237e6f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 4399d570-dda9-4a5a-921c-d76d95f0a6f5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:54.470804 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e79adcf4-9e3f-4595-ac2b-d978eb237e6f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:54.471745 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e79adcf4-9e3f-4595-ac2b-d978eb237e6f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:54.472712 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e79adcf4-9e3f-4595-ac2b-d978eb237e6f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:54.473533 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e79adcf4-9e3f-4595-ac2b-d978eb237e6f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:54.474152 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e79adcf4-9e3f-4595-ac2b-d978eb237e6f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:54.474661 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e79adcf4-9e3f-4595-ac2b-d978eb237e6f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:54.483934 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-517acf0c-b0a8-4e51-9ec4-9d07b44bf3c2 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:54.501016 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-517acf0c-b0a8-4e51-9ec4-9d07b44bf3c2 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:54.503297 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-517acf0c-b0a8-4e51-9ec4-9d07b44bf3c2 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:54.508917 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-517acf0c-b0a8-4e51-9ec4-9d07b44bf3c2 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5" status: 200 len: 1725 microversion: 2.20 time: 0.690790 Aug 31 16:22:54.510310 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2588/5147] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:22:53 2022] GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5 => generated 1725 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:22:54.895970 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e79adcf4-9e3f-4595-ac2b-d978eb237e6f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:54.916670 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e79adcf4-9e3f-4595-ac2b-d978eb237e6f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/4399d570-dda9-4a5a-921c-d76d95f0a6f5" status: 200 len: 1317 microversion: 2.1 time: 0.454599 Aug 31 16:22:54.917185 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2560/5148] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:22:54 2022] GET /compute/v2.1/servers/4399d570-dda9-4a5a-921c-d76d95f0a6f5 => generated 1317 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:22:55.336046 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-d79408a4-ab32-41c8-b56d-e61a26e3e4f6 req-cdf79887-ea9f-4c35-b531-142252f400bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4399d570-dda9-4a5a-921c-d76d95f0a6f5", "tag": "3153b546-2cab-4c6c-b241-83f394054c0e"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:22:55.357010 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-d79408a4-ab32-41c8-b56d-e61a26e3e4f6 req-cdf79887-ea9f-4c35-b531-142252f400bb service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:55.358234 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-d79408a4-ab32-41c8-b56d-e61a26e3e4f6 req-cdf79887-ea9f-4c35-b531-142252f400bb service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:55.358944 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-d79408a4-ab32-41c8-b56d-e61a26e3e4f6 req-cdf79887-ea9f-4c35-b531-142252f400bb service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:55.375370 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-d79408a4-ab32-41c8-b56d-e61a26e3e4f6 req-cdf79887-ea9f-4c35-b531-142252f400bb service nova] Creating event network-changed:3153b546-2cab-4c6c-b241-83f394054c0e for instance 4399d570-dda9-4a5a-921c-d76d95f0a6f5 on n-h2-850499-9 Aug 31 16:22:55.403000 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-d79408a4-ab32-41c8-b56d-e61a26e3e4f6 req-cdf79887-ea9f-4c35-b531-142252f400bb service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080950 Aug 31 16:22:55.405721 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2589/5149] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:22:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:22:55.479824 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ff10f5db-dd4b-48f7-8ea9-c532f0c6815f tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:55.481244 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ff10f5db-dd4b-48f7-8ea9-c532f0c6815f tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 6e139adf-20d3-4d88-941f-fe9a45276ad5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:55.500821 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ff10f5db-dd4b-48f7-8ea9-c532f0c6815f tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:55.502068 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ff10f5db-dd4b-48f7-8ea9-c532f0c6815f tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:55.503491 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ff10f5db-dd4b-48f7-8ea9-c532f0c6815f tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:55.504798 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ff10f5db-dd4b-48f7-8ea9-c532f0c6815f tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:55.505309 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ff10f5db-dd4b-48f7-8ea9-c532f0c6815f tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:55.505985 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ff10f5db-dd4b-48f7-8ea9-c532f0c6815f tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:55.542037 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-447777ff-5e27-4406-af7a-247885c343b9 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:55.542771 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-447777ff-5e27-4406-af7a-247885c343b9 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:55.567308 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-447777ff-5e27-4406-af7a-247885c343b9 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:55.569483 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-447777ff-5e27-4406-af7a-247885c343b9 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:55.570196 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-447777ff-5e27-4406-af7a-247885c343b9 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:55.571142 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-447777ff-5e27-4406-af7a-247885c343b9 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:55.571831 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-447777ff-5e27-4406-af7a-247885c343b9 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:55.572465 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-447777ff-5e27-4406-af7a-247885c343b9 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:56.101939 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-447777ff-5e27-4406-af7a-247885c343b9 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:56.118153 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-447777ff-5e27-4406-af7a-247885c343b9 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:56.119753 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ff10f5db-dd4b-48f7-8ea9-c532f0c6815f tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133363b2b12d4730994557ee24f08879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d9ba3589a24faaac930a35742ce834', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:56.121646 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-447777ff-5e27-4406-af7a-247885c343b9 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:56.124334 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-447777ff-5e27-4406-af7a-247885c343b9 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5" status: 200 len: 1725 microversion: 2.20 time: 0.590011 Aug 31 16:22:56.125838 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2590/5150] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:22:55 2022] GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5 => generated 1725 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:22:56.131900 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e601bd98-9b52-41a4-844e-95aea3d64a00 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:56.133039 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e601bd98-9b52-41a4-844e-95aea3d64a00 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 4399d570-dda9-4a5a-921c-d76d95f0a6f5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:56.134702 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ff10f5db-dd4b-48f7-8ea9-c532f0c6815f tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/6e139adf-20d3-4d88-941f-fe9a45276ad5" status: 200 len: 1367 microversion: 2.1 time: 0.659296 Aug 31 16:22:56.135310 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2561/5151] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:22:55 2022] GET /compute/v2.1/servers/6e139adf-20d3-4d88-941f-fe9a45276ad5 => generated 1367 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:22:56.156529 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e601bd98-9b52-41a4-844e-95aea3d64a00 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:56.157553 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e601bd98-9b52-41a4-844e-95aea3d64a00 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:56.158072 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e601bd98-9b52-41a4-844e-95aea3d64a00 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:56.159183 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e601bd98-9b52-41a4-844e-95aea3d64a00 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:56.159917 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e601bd98-9b52-41a4-844e-95aea3d64a00 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:56.161928 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e601bd98-9b52-41a4-844e-95aea3d64a00 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:56.723407 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e601bd98-9b52-41a4-844e-95aea3d64a00 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:56.765833 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e601bd98-9b52-41a4-844e-95aea3d64a00 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/4399d570-dda9-4a5a-921c-d76d95f0a6f5" status: 200 len: 1317 microversion: 2.1 time: 0.637876 Aug 31 16:22:56.770474 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2591/5152] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:22:56 2022] GET /compute/v2.1/servers/4399d570-dda9-4a5a-921c-d76d95f0a6f5 => generated 1317 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:22:57.153489 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c1983738-0b6b-4297-9587-7e59b890d133 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:57.154296 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c1983738-0b6b-4297-9587-7e59b890d133 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:57.159685 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ca44c68e-3aa1-43b9-82ea-bdd2c890c099 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:57.161206 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ca44c68e-3aa1-43b9-82ea-bdd2c890c099 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 6e139adf-20d3-4d88-941f-fe9a45276ad5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:57.172757 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ca44c68e-3aa1-43b9-82ea-bdd2c890c099 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:57.173612 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ca44c68e-3aa1-43b9-82ea-bdd2c890c099 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:57.174346 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ca44c68e-3aa1-43b9-82ea-bdd2c890c099 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:57.175405 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c1983738-0b6b-4297-9587-7e59b890d133 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:57.175621 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ca44c68e-3aa1-43b9-82ea-bdd2c890c099 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:57.176204 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c1983738-0b6b-4297-9587-7e59b890d133 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:57.176413 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ca44c68e-3aa1-43b9-82ea-bdd2c890c099 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:57.176736 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c1983738-0b6b-4297-9587-7e59b890d133 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:57.177195 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ca44c68e-3aa1-43b9-82ea-bdd2c890c099 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:57.177471 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c1983738-0b6b-4297-9587-7e59b890d133 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:57.177943 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c1983738-0b6b-4297-9587-7e59b890d133 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:57.178384 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c1983738-0b6b-4297-9587-7e59b890d133 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:57.564009 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ca44c68e-3aa1-43b9-82ea-bdd2c890c099 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133363b2b12d4730994557ee24f08879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d9ba3589a24faaac930a35742ce834', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:57.576734 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ca44c68e-3aa1-43b9-82ea-bdd2c890c099 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/6e139adf-20d3-4d88-941f-fe9a45276ad5" status: 200 len: 1367 microversion: 2.1 time: 0.421421 Aug 31 16:22:57.578409 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2592/5153] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:22:57 2022] GET /compute/v2.1/servers/6e139adf-20d3-4d88-941f-fe9a45276ad5 => generated 1367 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:22:57.579425 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c1983738-0b6b-4297-9587-7e59b890d133 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:57.603408 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c1983738-0b6b-4297-9587-7e59b890d133 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:57.609757 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c1983738-0b6b-4297-9587-7e59b890d133 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:57.611475 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c1983738-0b6b-4297-9587-7e59b890d133 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5" status: 200 len: 1725 microversion: 2.20 time: 0.462454 Aug 31 16:22:57.614844 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2562/5154] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:22:57 2022] GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5 => generated 1725 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:22:57.797184 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8cfed326-99a5-49fe-a162-7c802cff42e7 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:57.798706 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8cfed326-99a5-49fe-a162-7c802cff42e7 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 4399d570-dda9-4a5a-921c-d76d95f0a6f5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:57.806603 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8cfed326-99a5-49fe-a162-7c802cff42e7 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:57.807419 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8cfed326-99a5-49fe-a162-7c802cff42e7 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:57.808077 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8cfed326-99a5-49fe-a162-7c802cff42e7 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:57.809162 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8cfed326-99a5-49fe-a162-7c802cff42e7 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:57.809806 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8cfed326-99a5-49fe-a162-7c802cff42e7 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:57.811094 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8cfed326-99a5-49fe-a162-7c802cff42e7 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:58.265369 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8cfed326-99a5-49fe-a162-7c802cff42e7 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:58.280174 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8cfed326-99a5-49fe-a162-7c802cff42e7 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/4399d570-dda9-4a5a-921c-d76d95f0a6f5" status: 200 len: 1317 microversion: 2.1 time: 0.494924 Aug 31 16:22:58.282546 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2593/5155] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:22:57 2022] GET /compute/v2.1/servers/4399d570-dda9-4a5a-921c-d76d95f0a6f5 => generated 1317 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:22:58.618413 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-41efccde-9db8-4b82-9589-2ede57fa86b6 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:58.620095 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-41efccde-9db8-4b82-9589-2ede57fa86b6 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 6e139adf-20d3-4d88-941f-fe9a45276ad5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:58.622482 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:22:58.624238 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=10 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:22:58.634073 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-41efccde-9db8-4b82-9589-2ede57fa86b6 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:58.635672 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-41efccde-9db8-4b82-9589-2ede57fa86b6 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:58.636759 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-41efccde-9db8-4b82-9589-2ede57fa86b6 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:58.639186 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-41efccde-9db8-4b82-9589-2ede57fa86b6 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:58.641660 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-41efccde-9db8-4b82-9589-2ede57fa86b6 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:58.643101 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-41efccde-9db8-4b82-9589-2ede57fa86b6 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:58.649763 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5b1244d1-574e-4051-b219-0613f5570b0c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:58.649763 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5b1244d1-574e-4051-b219-0613f5570b0c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:58.668611 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=10 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:22:58.672968 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b1244d1-574e-4051-b219-0613f5570b0c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:58.674331 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b1244d1-574e-4051-b219-0613f5570b0c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:58.675377 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b1244d1-574e-4051-b219-0613f5570b0c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:58.677194 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b1244d1-574e-4051-b219-0613f5570b0c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:58.678541 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b1244d1-574e-4051-b219-0613f5570b0c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:58.679663 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b1244d1-574e-4051-b219-0613f5570b0c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:58.943147 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-41efccde-9db8-4b82-9589-2ede57fa86b6 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133363b2b12d4730994557ee24f08879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d9ba3589a24faaac930a35742ce834', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:58.959967 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5b1244d1-574e-4051-b219-0613f5570b0c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:58.966120 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-41efccde-9db8-4b82-9589-2ede57fa86b6 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/6e139adf-20d3-4d88-941f-fe9a45276ad5" status: 200 len: 1367 microversion: 2.1 time: 0.352375 Aug 31 16:22:58.969314 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2563/5156] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:22:58 2022] GET /compute/v2.1/servers/6e139adf-20d3-4d88-941f-fe9a45276ad5 => generated 1367 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:22:58.989659 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5b1244d1-574e-4051-b219-0613f5570b0c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:58.993607 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5b1244d1-574e-4051-b219-0613f5570b0c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:58.995553 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5b1244d1-574e-4051-b219-0613f5570b0c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5" status: 200 len: 1746 microversion: 2.20 time: 0.356100 Aug 31 16:22:59.011556 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2594/5157] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:22:58 2022] GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5 => generated 1746 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:22:59.306951 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5e4467f0-cb58-42f9-b27a-b3f693da713a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:59.308008 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5e4467f0-cb58-42f9-b27a-b3f693da713a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 4399d570-dda9-4a5a-921c-d76d95f0a6f5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:59.324943 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5e4467f0-cb58-42f9-b27a-b3f693da713a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:59.325394 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5e4467f0-cb58-42f9-b27a-b3f693da713a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:59.328101 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5e4467f0-cb58-42f9-b27a-b3f693da713a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:59.333561 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5e4467f0-cb58-42f9-b27a-b3f693da713a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:59.339357 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5e4467f0-cb58-42f9-b27a-b3f693da713a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:59.340163 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5e4467f0-cb58-42f9-b27a-b3f693da713a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:59.655812 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5e4467f0-cb58-42f9-b27a-b3f693da713a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:59.666679 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5e4467f0-cb58-42f9-b27a-b3f693da713a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/4399d570-dda9-4a5a-921c-d76d95f0a6f5" status: 200 len: 1317 microversion: 2.1 time: 0.365752 Aug 31 16:22:59.679987 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2564/5158] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:22:59 2022] GET /compute/v2.1/servers/4399d570-dda9-4a5a-921c-d76d95f0a6f5 => generated 1317 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:22:59.994906 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7cdca0f6-e516-4322-97e0-c3afaa5924c0 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:59.995774 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7cdca0f6-e516-4322-97e0-c3afaa5924c0 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 6e139adf-20d3-4d88-941f-fe9a45276ad5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:00.009097 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7cdca0f6-e516-4322-97e0-c3afaa5924c0 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:00.009930 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7cdca0f6-e516-4322-97e0-c3afaa5924c0 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:00.010923 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7cdca0f6-e516-4322-97e0-c3afaa5924c0 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:00.011897 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7cdca0f6-e516-4322-97e0-c3afaa5924c0 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:00.012372 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7cdca0f6-e516-4322-97e0-c3afaa5924c0 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:00.013009 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7cdca0f6-e516-4322-97e0-c3afaa5924c0 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:00.030680 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-827d5b2e-831b-4c8c-aa7b-22cb44a9d7c3 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:00.031657 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-827d5b2e-831b-4c8c-aa7b-22cb44a9d7c3 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:00.038684 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-827d5b2e-831b-4c8c-aa7b-22cb44a9d7c3 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:00.039779 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-827d5b2e-831b-4c8c-aa7b-22cb44a9d7c3 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:00.040492 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-827d5b2e-831b-4c8c-aa7b-22cb44a9d7c3 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:00.041464 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-827d5b2e-831b-4c8c-aa7b-22cb44a9d7c3 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:00.041923 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-827d5b2e-831b-4c8c-aa7b-22cb44a9d7c3 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:00.042352 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-827d5b2e-831b-4c8c-aa7b-22cb44a9d7c3 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:00.294813 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7cdca0f6-e516-4322-97e0-c3afaa5924c0 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133363b2b12d4730994557ee24f08879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d9ba3589a24faaac930a35742ce834', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:00.303530 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7cdca0f6-e516-4322-97e0-c3afaa5924c0 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/6e139adf-20d3-4d88-941f-fe9a45276ad5" status: 200 len: 1367 microversion: 2.1 time: 0.315223 Aug 31 16:23:00.315999 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2595/5159] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:22:59 2022] GET /compute/v2.1/servers/6e139adf-20d3-4d88-941f-fe9a45276ad5 => generated 1367 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:23:00.592735 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-827d5b2e-831b-4c8c-aa7b-22cb44a9d7c3 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:00.607620 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-827d5b2e-831b-4c8c-aa7b-22cb44a9d7c3 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:00.610500 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-827d5b2e-831b-4c8c-aa7b-22cb44a9d7c3 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:00.613371 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-827d5b2e-831b-4c8c-aa7b-22cb44a9d7c3 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5" status: 200 len: 1746 microversion: 2.20 time: 0.587242 Aug 31 16:23:00.631603 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2565/5160] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:23:00 2022] GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5 => generated 1746 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:23:00.691328 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ad0c716a-1c85-4de5-8349-233847466e3e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:00.692190 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ad0c716a-1c85-4de5-8349-233847466e3e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 4399d570-dda9-4a5a-921c-d76d95f0a6f5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:00.709083 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ad0c716a-1c85-4de5-8349-233847466e3e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:00.710085 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ad0c716a-1c85-4de5-8349-233847466e3e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:00.711266 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ad0c716a-1c85-4de5-8349-233847466e3e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:00.713042 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ad0c716a-1c85-4de5-8349-233847466e3e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:00.715840 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ad0c716a-1c85-4de5-8349-233847466e3e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:00.716494 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ad0c716a-1c85-4de5-8349-233847466e3e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:01.267403 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ad0c716a-1c85-4de5-8349-233847466e3e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:01.276712 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ad0c716a-1c85-4de5-8349-233847466e3e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/4399d570-dda9-4a5a-921c-d76d95f0a6f5" status: 200 len: 1317 microversion: 2.1 time: 0.590913 Aug 31 16:23:01.277409 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2596/5161] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:23:00 2022] GET /compute/v2.1/servers/4399d570-dda9-4a5a-921c-d76d95f0a6f5 => generated 1317 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:23:01.329103 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-784e17ad-bf41-49c0-b19e-ae7f1433ce98 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:01.332099 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-784e17ad-bf41-49c0-b19e-ae7f1433ce98 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 6e139adf-20d3-4d88-941f-fe9a45276ad5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:01.358927 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-784e17ad-bf41-49c0-b19e-ae7f1433ce98 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:01.364366 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-784e17ad-bf41-49c0-b19e-ae7f1433ce98 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:01.371584 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-784e17ad-bf41-49c0-b19e-ae7f1433ce98 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:01.373551 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-784e17ad-bf41-49c0-b19e-ae7f1433ce98 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:01.374679 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-784e17ad-bf41-49c0-b19e-ae7f1433ce98 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:01.375972 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-784e17ad-bf41-49c0-b19e-ae7f1433ce98 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:01.637646 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-303b66d0-844d-4c46-a39a-5377cfdb2134 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:01.638268 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-303b66d0-844d-4c46-a39a-5377cfdb2134 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:01.645980 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-303b66d0-844d-4c46-a39a-5377cfdb2134 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:01.647719 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-303b66d0-844d-4c46-a39a-5377cfdb2134 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:01.648466 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-303b66d0-844d-4c46-a39a-5377cfdb2134 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:01.649543 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-303b66d0-844d-4c46-a39a-5377cfdb2134 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:01.650290 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-303b66d0-844d-4c46-a39a-5377cfdb2134 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:01.651456 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-303b66d0-844d-4c46-a39a-5377cfdb2134 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:01.815984 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-784e17ad-bf41-49c0-b19e-ae7f1433ce98 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133363b2b12d4730994557ee24f08879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d9ba3589a24faaac930a35742ce834', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:01.832814 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-784e17ad-bf41-49c0-b19e-ae7f1433ce98 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/6e139adf-20d3-4d88-941f-fe9a45276ad5" status: 200 len: 1367 microversion: 2.1 time: 0.511154 Aug 31 16:23:01.834666 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2566/5162] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:23:01 2022] GET /compute/v2.1/servers/6e139adf-20d3-4d88-941f-fe9a45276ad5 => generated 1367 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:23:01.978812 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-303b66d0-844d-4c46-a39a-5377cfdb2134 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:01.991531 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-303b66d0-844d-4c46-a39a-5377cfdb2134 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:01.993489 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-303b66d0-844d-4c46-a39a-5377cfdb2134 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:01.994872 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-303b66d0-844d-4c46-a39a-5377cfdb2134 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5" status: 200 len: 1746 microversion: 2.20 time: 0.361267 Aug 31 16:23:01.999633 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2597/5163] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:23:01 2022] GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5 => generated 1746 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:23:02.304592 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f0480596-6364-49c4-b51a-15e8da833947 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:02.305377 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f0480596-6364-49c4-b51a-15e8da833947 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 4399d570-dda9-4a5a-921c-d76d95f0a6f5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:02.314371 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f0480596-6364-49c4-b51a-15e8da833947 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:02.316260 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f0480596-6364-49c4-b51a-15e8da833947 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:02.317399 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f0480596-6364-49c4-b51a-15e8da833947 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:02.328100 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f0480596-6364-49c4-b51a-15e8da833947 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:02.329007 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f0480596-6364-49c4-b51a-15e8da833947 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:02.329796 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f0480596-6364-49c4-b51a-15e8da833947 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:02.536527 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f0480596-6364-49c4-b51a-15e8da833947 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:02.546545 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f0480596-6364-49c4-b51a-15e8da833947 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/4399d570-dda9-4a5a-921c-d76d95f0a6f5" status: 200 len: 1317 microversion: 2.1 time: 0.244698 Aug 31 16:23:02.561057 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2567/5164] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:23:02 2022] GET /compute/v2.1/servers/4399d570-dda9-4a5a-921c-d76d95f0a6f5 => generated 1317 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:23:02.868042 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c6af435f-0cdd-43eb-b410-276abc6ba740 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:02.869525 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c6af435f-0cdd-43eb-b410-276abc6ba740 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 6e139adf-20d3-4d88-941f-fe9a45276ad5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:02.881397 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c6af435f-0cdd-43eb-b410-276abc6ba740 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:02.882106 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c6af435f-0cdd-43eb-b410-276abc6ba740 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:02.882656 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c6af435f-0cdd-43eb-b410-276abc6ba740 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:02.883481 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c6af435f-0cdd-43eb-b410-276abc6ba740 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:02.884814 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c6af435f-0cdd-43eb-b410-276abc6ba740 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:02.885364 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c6af435f-0cdd-43eb-b410-276abc6ba740 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:03.024241 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-53a6dd75-1eb7-4c51-8437-a71e374cca64 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:03.025194 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-53a6dd75-1eb7-4c51-8437-a71e374cca64 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:03.038370 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-53a6dd75-1eb7-4c51-8437-a71e374cca64 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:03.039154 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-53a6dd75-1eb7-4c51-8437-a71e374cca64 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:03.039836 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-53a6dd75-1eb7-4c51-8437-a71e374cca64 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:03.041639 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-53a6dd75-1eb7-4c51-8437-a71e374cca64 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:03.042776 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-53a6dd75-1eb7-4c51-8437-a71e374cca64 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:03.043642 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-53a6dd75-1eb7-4c51-8437-a71e374cca64 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:03.275013 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c6af435f-0cdd-43eb-b410-276abc6ba740 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133363b2b12d4730994557ee24f08879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d9ba3589a24faaac930a35742ce834', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:03.301316 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c6af435f-0cdd-43eb-b410-276abc6ba740 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/6e139adf-20d3-4d88-941f-fe9a45276ad5" status: 200 len: 1367 microversion: 2.1 time: 0.444052 Aug 31 16:23:03.318162 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2598/5165] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:23:02 2022] GET /compute/v2.1/servers/6e139adf-20d3-4d88-941f-fe9a45276ad5 => generated 1367 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:23:03.449482 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-53a6dd75-1eb7-4c51-8437-a71e374cca64 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:03.470493 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-53a6dd75-1eb7-4c51-8437-a71e374cca64 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:03.473386 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-53a6dd75-1eb7-4c51-8437-a71e374cca64 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:03.475447 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-53a6dd75-1eb7-4c51-8437-a71e374cca64 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5" status: 200 len: 1746 microversion: 2.20 time: 0.457320 Aug 31 16:23:03.498941 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2568/5166] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:23:03 2022] GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5 => generated 1746 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:23:03.561059 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-ed1c3bd7-21e2-4242-ad49-05ef03778d9c req-80697d54-f50a-4afc-b4d0-9987f8029493 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e139adf-20d3-4d88-941f-fe9a45276ad5", "name": "network-vif-plugged", "status": "completed", "tag": "329b15f2-26ad-48cd-a95e-e8b610ce8985"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:23:03.575177 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e37a389f-8303-4715-895b-4c3db975fcd0 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:03.576142 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e37a389f-8303-4715-895b-4c3db975fcd0 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 4399d570-dda9-4a5a-921c-d76d95f0a6f5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:03.587083 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-ed1c3bd7-21e2-4242-ad49-05ef03778d9c req-80697d54-f50a-4afc-b4d0-9987f8029493 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:03.588079 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-ed1c3bd7-21e2-4242-ad49-05ef03778d9c req-80697d54-f50a-4afc-b4d0-9987f8029493 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:03.590134 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-ed1c3bd7-21e2-4242-ad49-05ef03778d9c req-80697d54-f50a-4afc-b4d0-9987f8029493 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:03.599640 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e37a389f-8303-4715-895b-4c3db975fcd0 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:03.600540 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e37a389f-8303-4715-895b-4c3db975fcd0 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:03.602322 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e37a389f-8303-4715-895b-4c3db975fcd0 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:03.606405 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e37a389f-8303-4715-895b-4c3db975fcd0 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:03.607133 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e37a389f-8303-4715-895b-4c3db975fcd0 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:03.610171 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e37a389f-8303-4715-895b-4c3db975fcd0 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:03.629752 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-ed1c3bd7-21e2-4242-ad49-05ef03778d9c req-80697d54-f50a-4afc-b4d0-9987f8029493 service nova] Creating event network-vif-plugged:329b15f2-26ad-48cd-a95e-e8b610ce8985 for instance 6e139adf-20d3-4d88-941f-fe9a45276ad5 on n-h1-850499-9 Aug 31 16:23:03.640924 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-ed1c3bd7-21e2-4242-ad49-05ef03778d9c req-80697d54-f50a-4afc-b4d0-9987f8029493 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083792 Aug 31 16:23:03.642428 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2599/5167] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:23:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:23:04.157335 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e37a389f-8303-4715-895b-4c3db975fcd0 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:04.177202 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e37a389f-8303-4715-895b-4c3db975fcd0 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/4399d570-dda9-4a5a-921c-d76d95f0a6f5" status: 200 len: 1317 microversion: 2.1 time: 0.606332 Aug 31 16:23:04.178964 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2569/5168] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:23:03 2022] GET /compute/v2.1/servers/4399d570-dda9-4a5a-921c-d76d95f0a6f5 => generated 1317 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:23:04.327178 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-bbba922f-75de-4b2e-a4b3-1eb178a30ba8 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:04.327940 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-bbba922f-75de-4b2e-a4b3-1eb178a30ba8 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 6e139adf-20d3-4d88-941f-fe9a45276ad5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:04.363366 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bbba922f-75de-4b2e-a4b3-1eb178a30ba8 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:04.371768 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bbba922f-75de-4b2e-a4b3-1eb178a30ba8 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:04.372252 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bbba922f-75de-4b2e-a4b3-1eb178a30ba8 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:04.373019 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bbba922f-75de-4b2e-a4b3-1eb178a30ba8 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:04.373516 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bbba922f-75de-4b2e-a4b3-1eb178a30ba8 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:04.373949 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bbba922f-75de-4b2e-a4b3-1eb178a30ba8 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:04.515626 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a7b458c7-4067-4bfc-96c5-cdb6e55dcaa8 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:04.516436 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a7b458c7-4067-4bfc-96c5-cdb6e55dcaa8 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:04.541194 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a7b458c7-4067-4bfc-96c5-cdb6e55dcaa8 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:04.541748 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a7b458c7-4067-4bfc-96c5-cdb6e55dcaa8 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:04.542341 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a7b458c7-4067-4bfc-96c5-cdb6e55dcaa8 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:04.543980 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a7b458c7-4067-4bfc-96c5-cdb6e55dcaa8 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:04.544761 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a7b458c7-4067-4bfc-96c5-cdb6e55dcaa8 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:04.545372 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a7b458c7-4067-4bfc-96c5-cdb6e55dcaa8 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:04.616430 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=100 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:23:04.787449 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-bbba922f-75de-4b2e-a4b3-1eb178a30ba8 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133363b2b12d4730994557ee24f08879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d9ba3589a24faaac930a35742ce834', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:04.815061 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-bbba922f-75de-4b2e-a4b3-1eb178a30ba8 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/6e139adf-20d3-4d88-941f-fe9a45276ad5" status: 200 len: 1367 microversion: 2.1 time: 0.490841 Aug 31 16:23:04.816089 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2600/5169] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:23:04 2022] GET /compute/v2.1/servers/6e139adf-20d3-4d88-941f-fe9a45276ad5 => generated 1367 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:23:04.918794 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a7b458c7-4067-4bfc-96c5-cdb6e55dcaa8 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:04.929261 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a7b458c7-4067-4bfc-96c5-cdb6e55dcaa8 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:04.932013 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a7b458c7-4067-4bfc-96c5-cdb6e55dcaa8 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:04.933468 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a7b458c7-4067-4bfc-96c5-cdb6e55dcaa8 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5" status: 200 len: 1741 microversion: 2.20 time: 0.425711 Aug 31 16:23:04.948143 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2570/5170] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:23:04 2022] GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5 => generated 1741 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:23:05.205280 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1cc744b2-5a42-4d59-a79d-dffb9638604a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:05.207917 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1cc744b2-5a42-4d59-a79d-dffb9638604a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 4399d570-dda9-4a5a-921c-d76d95f0a6f5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:05.252040 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1cc744b2-5a42-4d59-a79d-dffb9638604a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:05.254028 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1cc744b2-5a42-4d59-a79d-dffb9638604a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:05.257494 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1cc744b2-5a42-4d59-a79d-dffb9638604a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:05.258863 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1cc744b2-5a42-4d59-a79d-dffb9638604a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:05.261751 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1cc744b2-5a42-4d59-a79d-dffb9638604a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:05.262846 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1cc744b2-5a42-4d59-a79d-dffb9638604a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:05.713932 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-1cc744b2-5a42-4d59-a79d-dffb9638604a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:05.748375 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1cc744b2-5a42-4d59-a79d-dffb9638604a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/4399d570-dda9-4a5a-921c-d76d95f0a6f5" status: 200 len: 1317 microversion: 2.1 time: 0.546819 Aug 31 16:23:05.758611 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2601/5171] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:23:05 2022] GET /compute/v2.1/servers/4399d570-dda9-4a5a-921c-d76d95f0a6f5 => generated 1317 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:23:05.852112 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-f391faa0-ac0c-409b-8f16-32bfebe1ba01 req-d55abdfc-d5cc-4c90-a4fe-c7e5f3029d2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85a0286b-2e02-4ecb-a63d-0b4a61048ab5", "name": "network-vif-plugged", "status": "completed", "tag": "b2e423e8-4d65-4e9c-90c7-27d4697688c2"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:23:05.852378 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-dc2efb8b-2b08-4191-934e-3e0b535ca90a tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:05.853434 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-dc2efb8b-2b08-4191-934e-3e0b535ca90a tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 6e139adf-20d3-4d88-941f-fe9a45276ad5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:05.871436 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dc2efb8b-2b08-4191-934e-3e0b535ca90a tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:05.872662 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dc2efb8b-2b08-4191-934e-3e0b535ca90a tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:05.873757 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dc2efb8b-2b08-4191-934e-3e0b535ca90a tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:05.875583 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dc2efb8b-2b08-4191-934e-3e0b535ca90a tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:05.877014 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dc2efb8b-2b08-4191-934e-3e0b535ca90a tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:05.878173 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dc2efb8b-2b08-4191-934e-3e0b535ca90a tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:05.901043 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-f391faa0-ac0c-409b-8f16-32bfebe1ba01 req-d55abdfc-d5cc-4c90-a4fe-c7e5f3029d2e service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:05.903116 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-f391faa0-ac0c-409b-8f16-32bfebe1ba01 req-d55abdfc-d5cc-4c90-a4fe-c7e5f3029d2e service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:05.906908 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-f391faa0-ac0c-409b-8f16-32bfebe1ba01 req-d55abdfc-d5cc-4c90-a4fe-c7e5f3029d2e service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:05.958904 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-f391faa0-ac0c-409b-8f16-32bfebe1ba01 req-d55abdfc-d5cc-4c90-a4fe-c7e5f3029d2e service nova] Creating event network-vif-plugged:b2e423e8-4d65-4e9c-90c7-27d4697688c2 for instance 85a0286b-2e02-4ecb-a63d-0b4a61048ab5 on n-h1-850499-9 Aug 31 16:23:05.986175 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-f391faa0-ac0c-409b-8f16-32bfebe1ba01 req-d55abdfc-d5cc-4c90-a4fe-c7e5f3029d2e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141707 Aug 31 16:23:05.988163 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2602/5172] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:23:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:23:06.012149 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0857c26b-900d-4e29-83e1-4d823bda28dd tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:06.014079 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0857c26b-900d-4e29-83e1-4d823bda28dd tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:06.035854 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0857c26b-900d-4e29-83e1-4d823bda28dd tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:06.045830 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0857c26b-900d-4e29-83e1-4d823bda28dd tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:06.046986 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0857c26b-900d-4e29-83e1-4d823bda28dd tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:06.048616 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0857c26b-900d-4e29-83e1-4d823bda28dd tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:06.050269 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0857c26b-900d-4e29-83e1-4d823bda28dd tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:06.051341 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0857c26b-900d-4e29-83e1-4d823bda28dd tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:06.540837 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0857c26b-900d-4e29-83e1-4d823bda28dd tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:06.585819 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0857c26b-900d-4e29-83e1-4d823bda28dd tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:06.589022 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0857c26b-900d-4e29-83e1-4d823bda28dd tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:06.594559 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0857c26b-900d-4e29-83e1-4d823bda28dd tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5" status: 200 len: 1741 microversion: 2.20 time: 0.604004 Aug 31 16:23:06.601271 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2603/5173] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:23:05 2022] GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5 => generated 1741 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:23:06.781773 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6c7e5cf2-2e2c-4faa-8593-e7a8b21b261b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:06.782878 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6c7e5cf2-2e2c-4faa-8593-e7a8b21b261b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 4399d570-dda9-4a5a-921c-d76d95f0a6f5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:06.795794 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6c7e5cf2-2e2c-4faa-8593-e7a8b21b261b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:06.800962 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6c7e5cf2-2e2c-4faa-8593-e7a8b21b261b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:06.801680 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6c7e5cf2-2e2c-4faa-8593-e7a8b21b261b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:06.802636 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6c7e5cf2-2e2c-4faa-8593-e7a8b21b261b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:06.806452 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6c7e5cf2-2e2c-4faa-8593-e7a8b21b261b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:06.807248 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6c7e5cf2-2e2c-4faa-8593-e7a8b21b261b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:06.840180 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-dc2efb8b-2b08-4191-934e-3e0b535ca90a tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133363b2b12d4730994557ee24f08879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d9ba3589a24faaac930a35742ce834', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:06.845872 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=100 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:23:06.929502 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-dc2efb8b-2b08-4191-934e-3e0b535ca90a tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/6e139adf-20d3-4d88-941f-fe9a45276ad5" status: 200 len: 1558 microversion: 2.1 time: 1.085787 Aug 31 16:23:06.948778 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2571/5174] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:23:05 2022] GET /compute/v2.1/servers/6e139adf-20d3-4d88-941f-fe9a45276ad5 => generated 1558 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:23:06.995367 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4a25b9ea-2487-4a3a-bebc-d1afe072cfb1 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:06.996297 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4a25b9ea-2487-4a3a-bebc-d1afe072cfb1 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 6e139adf-20d3-4d88-941f-fe9a45276ad5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:07.014065 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4a25b9ea-2487-4a3a-bebc-d1afe072cfb1 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:07.014065 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4a25b9ea-2487-4a3a-bebc-d1afe072cfb1 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:07.014065 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4a25b9ea-2487-4a3a-bebc-d1afe072cfb1 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:07.014065 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4a25b9ea-2487-4a3a-bebc-d1afe072cfb1 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:07.014065 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4a25b9ea-2487-4a3a-bebc-d1afe072cfb1 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:07.015107 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4a25b9ea-2487-4a3a-bebc-d1afe072cfb1 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:07.285502 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4a25b9ea-2487-4a3a-bebc-d1afe072cfb1 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/6e139adf-20d3-4d88-941f-fe9a45276ad5/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.306563 Aug 31 16:23:07.286774 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2572/5175] 10.222.0.61 () {58 vars in 1275 bytes} [Wed Aug 31 16:23:06 2022] GET /compute/v2.1/servers/6e139adf-20d3-4d88-941f-fe9a45276ad5/os-interface => generated 285 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:23:07.409055 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-6c7e5cf2-2e2c-4faa-8593-e7a8b21b261b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:07.434116 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6c7e5cf2-2e2c-4faa-8593-e7a8b21b261b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/4399d570-dda9-4a5a-921c-d76d95f0a6f5" status: 200 len: 1317 microversion: 2.1 time: 0.657715 Aug 31 16:23:07.435704 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2604/5176] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:23:06 2022] GET /compute/v2.1/servers/4399d570-dda9-4a5a-921c-d76d95f0a6f5 => generated 1317 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:23:07.658241 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-537d8c9c-c13e-4cd8-bffb-7d8f8ba25e04 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:07.659672 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-537d8c9c-c13e-4cd8-bffb-7d8f8ba25e04 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:07.677604 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-537d8c9c-c13e-4cd8-bffb-7d8f8ba25e04 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:07.678425 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-537d8c9c-c13e-4cd8-bffb-7d8f8ba25e04 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:07.679037 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-537d8c9c-c13e-4cd8-bffb-7d8f8ba25e04 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:07.683730 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-537d8c9c-c13e-4cd8-bffb-7d8f8ba25e04 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:07.687638 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-537d8c9c-c13e-4cd8-bffb-7d8f8ba25e04 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:07.689867 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-537d8c9c-c13e-4cd8-bffb-7d8f8ba25e04 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:08.167804 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-b8e431d3-bf64-4b7a-91bd-72bd6c24b1d6 req-42e450d4-a512-44ff-bfb1-11e1f73f2da1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4399d570-dda9-4a5a-921c-d76d95f0a6f5", "name": "network-vif-plugged", "status": "completed", "tag": "3153b546-2cab-4c6c-b241-83f394054c0e"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:23:08.209333 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-b8e431d3-bf64-4b7a-91bd-72bd6c24b1d6 req-42e450d4-a512-44ff-bfb1-11e1f73f2da1 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:08.210438 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-b8e431d3-bf64-4b7a-91bd-72bd6c24b1d6 req-42e450d4-a512-44ff-bfb1-11e1f73f2da1 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:08.211137 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-b8e431d3-bf64-4b7a-91bd-72bd6c24b1d6 req-42e450d4-a512-44ff-bfb1-11e1f73f2da1 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:08.241223 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-b8e431d3-bf64-4b7a-91bd-72bd6c24b1d6 req-42e450d4-a512-44ff-bfb1-11e1f73f2da1 service nova] Creating event network-vif-plugged:3153b546-2cab-4c6c-b241-83f394054c0e for instance 4399d570-dda9-4a5a-921c-d76d95f0a6f5 on n-h2-850499-9 Aug 31 16:23:08.271355 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-b8e431d3-bf64-4b7a-91bd-72bd6c24b1d6 req-42e450d4-a512-44ff-bfb1-11e1f73f2da1 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105046 Aug 31 16:23:08.278203 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2605/5177] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:23:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:23:08.482215 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3e2bef48-3582-4926-9919-13af7f7c1f77 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:08.483561 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3e2bef48-3582-4926-9919-13af7f7c1f77 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 4399d570-dda9-4a5a-921c-d76d95f0a6f5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:08.511191 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3e2bef48-3582-4926-9919-13af7f7c1f77 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:08.512243 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3e2bef48-3582-4926-9919-13af7f7c1f77 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:08.514289 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3e2bef48-3582-4926-9919-13af7f7c1f77 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:08.525079 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3e2bef48-3582-4926-9919-13af7f7c1f77 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:08.526662 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3e2bef48-3582-4926-9919-13af7f7c1f77 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:08.527879 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3e2bef48-3582-4926-9919-13af7f7c1f77 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:09.265292 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-537d8c9c-c13e-4cd8-bffb-7d8f8ba25e04 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:09.275211 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-537d8c9c-c13e-4cd8-bffb-7d8f8ba25e04 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:09.281382 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-537d8c9c-c13e-4cd8-bffb-7d8f8ba25e04 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:09.282648 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-537d8c9c-c13e-4cd8-bffb-7d8f8ba25e04 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5" status: 200 len: 1741 microversion: 2.20 time: 1.629871 Aug 31 16:23:09.297349 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2573/5178] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:23:07 2022] GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5 => generated 1741 bytes in 1636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:23:09.397973 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3e2bef48-3582-4926-9919-13af7f7c1f77 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:09.413445 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3e2bef48-3582-4926-9919-13af7f7c1f77 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/4399d570-dda9-4a5a-921c-d76d95f0a6f5" status: 200 len: 1317 microversion: 2.1 time: 0.954026 Aug 31 16:23:09.431382 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2606/5179] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:23:08 2022] GET /compute/v2.1/servers/4399d570-dda9-4a5a-921c-d76d95f0a6f5 => generated 1317 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:23:10.322130 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-51b99dc6-205a-487f-a633-2fcef3132b40 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:10.323435 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-51b99dc6-205a-487f-a633-2fcef3132b40 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:10.337304 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-51b99dc6-205a-487f-a633-2fcef3132b40 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:10.339552 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-51b99dc6-205a-487f-a633-2fcef3132b40 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:10.342625 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-51b99dc6-205a-487f-a633-2fcef3132b40 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:10.343662 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-51b99dc6-205a-487f-a633-2fcef3132b40 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:10.345531 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-51b99dc6-205a-487f-a633-2fcef3132b40 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:10.347418 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-51b99dc6-205a-487f-a633-2fcef3132b40 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:10.444530 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-01f0a3e5-1792-4cec-8f64-2667bf413b99 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:10.445518 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-01f0a3e5-1792-4cec-8f64-2667bf413b99 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 4399d570-dda9-4a5a-921c-d76d95f0a6f5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:10.466107 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-01f0a3e5-1792-4cec-8f64-2667bf413b99 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:10.467001 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-01f0a3e5-1792-4cec-8f64-2667bf413b99 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:10.473319 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-01f0a3e5-1792-4cec-8f64-2667bf413b99 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:10.474646 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-01f0a3e5-1792-4cec-8f64-2667bf413b99 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:10.475426 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-01f0a3e5-1792-4cec-8f64-2667bf413b99 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:10.478997 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-01f0a3e5-1792-4cec-8f64-2667bf413b99 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:11.329915 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-51b99dc6-205a-487f-a633-2fcef3132b40 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:11.352055 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-51b99dc6-205a-487f-a633-2fcef3132b40 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:11.353580 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-51b99dc6-205a-487f-a633-2fcef3132b40 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:11.354801 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-51b99dc6-205a-487f-a633-2fcef3132b40 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5" status: 200 len: 1741 microversion: 2.20 time: 1.037922 Aug 31 16:23:11.355376 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2574/5180] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:23:10 2022] GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5 => generated 1741 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:23:11.445089 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-767e1c69-70ce-4bf0-a486-dd959249449e req-38ca88f1-ec2f-4f3e-ac2f-54e55d802c1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e139adf-20d3-4d88-941f-fe9a45276ad5", "tag": "329b15f2-26ad-48cd-a95e-e8b610ce8985"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:23:11.479963 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-767e1c69-70ce-4bf0-a486-dd959249449e req-38ca88f1-ec2f-4f3e-ac2f-54e55d802c1b service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:11.480464 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-767e1c69-70ce-4bf0-a486-dd959249449e req-38ca88f1-ec2f-4f3e-ac2f-54e55d802c1b service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:11.480908 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-767e1c69-70ce-4bf0-a486-dd959249449e req-38ca88f1-ec2f-4f3e-ac2f-54e55d802c1b service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:11.548735 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-767e1c69-70ce-4bf0-a486-dd959249449e req-38ca88f1-ec2f-4f3e-ac2f-54e55d802c1b service nova] Creating event network-changed:329b15f2-26ad-48cd-a95e-e8b610ce8985 for instance 6e139adf-20d3-4d88-941f-fe9a45276ad5 on n-h1-850499-9 Aug 31 16:23:11.558541 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-01f0a3e5-1792-4cec-8f64-2667bf413b99 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:11.559847 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-767e1c69-70ce-4bf0-a486-dd959249449e req-38ca88f1-ec2f-4f3e-ac2f-54e55d802c1b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118418 Aug 31 16:23:11.561348 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2575/5181] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:23:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:23:11.597045 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-01f0a3e5-1792-4cec-8f64-2667bf413b99 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/4399d570-dda9-4a5a-921c-d76d95f0a6f5" status: 200 len: 1317 microversion: 2.1 time: 1.161534 Aug 31 16:23:11.620314 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2607/5182] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:23:10 2022] GET /compute/v2.1/servers/4399d570-dda9-4a5a-921c-d76d95f0a6f5 => generated 1317 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:23:12.406939 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-201e29a9-9a22-4408-8626-90f106c1ea21 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:12.407970 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-201e29a9-9a22-4408-8626-90f106c1ea21 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:12.429064 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-201e29a9-9a22-4408-8626-90f106c1ea21 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:12.430028 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-201e29a9-9a22-4408-8626-90f106c1ea21 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:12.431428 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-201e29a9-9a22-4408-8626-90f106c1ea21 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:12.433184 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-201e29a9-9a22-4408-8626-90f106c1ea21 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:12.434398 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-201e29a9-9a22-4408-8626-90f106c1ea21 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:12.435542 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-201e29a9-9a22-4408-8626-90f106c1ea21 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:12.620939 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-16f7982f-bf75-44d4-a417-3a54577dca6b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:12.621499 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-16f7982f-bf75-44d4-a417-3a54577dca6b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 4399d570-dda9-4a5a-921c-d76d95f0a6f5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:12.644325 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-16f7982f-bf75-44d4-a417-3a54577dca6b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:12.644829 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-16f7982f-bf75-44d4-a417-3a54577dca6b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:12.645275 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-16f7982f-bf75-44d4-a417-3a54577dca6b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:12.645998 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-16f7982f-bf75-44d4-a417-3a54577dca6b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:12.646463 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-16f7982f-bf75-44d4-a417-3a54577dca6b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:12.646901 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-16f7982f-bf75-44d4-a417-3a54577dca6b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:13.991278 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-201e29a9-9a22-4408-8626-90f106c1ea21 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:14.007818 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-201e29a9-9a22-4408-8626-90f106c1ea21 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:14.011057 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-201e29a9-9a22-4408-8626-90f106c1ea21 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:14.013228 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-201e29a9-9a22-4408-8626-90f106c1ea21 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5" status: 200 len: 1741 microversion: 2.20 time: 1.628245 Aug 31 16:23:14.014375 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-16f7982f-bf75-44d4-a417-3a54577dca6b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:14.017349 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2576/5183] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:23:12 2022] GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5 => generated 1741 bytes in 1633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:23:14.024952 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-16f7982f-bf75-44d4-a417-3a54577dca6b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/4399d570-dda9-4a5a-921c-d76d95f0a6f5" status: 200 len: 1504 microversion: 2.1 time: 1.409344 Aug 31 16:23:14.030548 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2608/5184] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:23:12 2022] GET /compute/v2.1/servers/4399d570-dda9-4a5a-921c-d76d95f0a6f5 => generated 1504 bytes in 1416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:23:14.056725 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-904a4f11-2859-4093-82e6-25d6ce52b59e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:14.057676 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-904a4f11-2859-4093-82e6-25d6ce52b59e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 4399d570-dda9-4a5a-921c-d76d95f0a6f5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:14.088398 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-904a4f11-2859-4093-82e6-25d6ce52b59e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:14.090704 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-904a4f11-2859-4093-82e6-25d6ce52b59e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:14.094537 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-904a4f11-2859-4093-82e6-25d6ce52b59e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:14.096217 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-904a4f11-2859-4093-82e6-25d6ce52b59e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:14.098498 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-904a4f11-2859-4093-82e6-25d6ce52b59e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:14.100554 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-904a4f11-2859-4093-82e6-25d6ce52b59e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:14.177884 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-904a4f11-2859-4093-82e6-25d6ce52b59e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 4399d570-dda9-4a5a-921c-d76d95f0a6f5] Going to try to terminate instance {{(pid=122256) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:23:14.373252 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-904a4f11-2859-4093-82e6-25d6ce52b59e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "DELETE /compute/v2.1/servers/4399d570-dda9-4a5a-921c-d76d95f0a6f5" status: 204 len: 0 microversion: 2.1 time: 0.321092 Aug 31 16:23:14.374350 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2577/5185] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:23:14 2022] DELETE /compute/v2.1/servers/4399d570-dda9-4a5a-921c-d76d95f0a6f5 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:23:14.383837 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-af8c9051-25d8-4cae-be56-b13b3a96ba17 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:14.384472 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-af8c9051-25d8-4cae-be56-b13b3a96ba17 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 4399d570-dda9-4a5a-921c-d76d95f0a6f5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:14.387260 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:23:14.402648 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-af8c9051-25d8-4cae-be56-b13b3a96ba17 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:14.404153 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-af8c9051-25d8-4cae-be56-b13b3a96ba17 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:14.405520 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-af8c9051-25d8-4cae-be56-b13b3a96ba17 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:14.408002 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-af8c9051-25d8-4cae-be56-b13b3a96ba17 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:14.410094 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-af8c9051-25d8-4cae-be56-b13b3a96ba17 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:14.411875 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-af8c9051-25d8-4cae-be56-b13b3a96ba17 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:15.051648 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-90c0a3bf-d346-4d35-9030-e86570a3f4fa tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:15.053761 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-90c0a3bf-d346-4d35-9030-e86570a3f4fa tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:15.064172 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:23:15.075217 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-90c0a3bf-d346-4d35-9030-e86570a3f4fa tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:15.076627 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-90c0a3bf-d346-4d35-9030-e86570a3f4fa tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:15.079213 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-90c0a3bf-d346-4d35-9030-e86570a3f4fa tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:15.080258 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-90c0a3bf-d346-4d35-9030-e86570a3f4fa tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:15.082035 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-90c0a3bf-d346-4d35-9030-e86570a3f4fa tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:15.085491 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-90c0a3bf-d346-4d35-9030-e86570a3f4fa tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:15.313348 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-af8c9051-25d8-4cae-be56-b13b3a96ba17 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:15.325434 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-af8c9051-25d8-4cae-be56-b13b3a96ba17 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/4399d570-dda9-4a5a-921c-d76d95f0a6f5" status: 200 len: 1510 microversion: 2.1 time: 0.946493 Aug 31 16:23:15.334873 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2609/5186] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:23:14 2022] GET /compute/v2.1/servers/4399d570-dda9-4a5a-921c-d76d95f0a6f5 => generated 1510 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:23:15.691067 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-90c0a3bf-d346-4d35-9030-e86570a3f4fa tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:15.706439 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-90c0a3bf-d346-4d35-9030-e86570a3f4fa tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:15.712862 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-90c0a3bf-d346-4d35-9030-e86570a3f4fa tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:15.720197 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-90c0a3bf-d346-4d35-9030-e86570a3f4fa tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5" status: 200 len: 1741 microversion: 2.20 time: 0.674173 Aug 31 16:23:15.726801 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2578/5187] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:23:15 2022] GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5 => generated 1741 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:23:16.364441 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-cb7af6fa-e762-4932-b17c-1e79b49facac tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:16.367053 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-cb7af6fa-e762-4932-b17c-1e79b49facac tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 4399d570-dda9-4a5a-921c-d76d95f0a6f5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:16.394818 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cb7af6fa-e762-4932-b17c-1e79b49facac tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:16.397352 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cb7af6fa-e762-4932-b17c-1e79b49facac tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:16.399480 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cb7af6fa-e762-4932-b17c-1e79b49facac tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:16.400693 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cb7af6fa-e762-4932-b17c-1e79b49facac tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:16.405246 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cb7af6fa-e762-4932-b17c-1e79b49facac tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:16.405896 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cb7af6fa-e762-4932-b17c-1e79b49facac tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:16.758504 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8a840932-cea2-4826-83a7-e69157c7bb7f tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:16.759488 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8a840932-cea2-4826-83a7-e69157c7bb7f tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:16.781222 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8a840932-cea2-4826-83a7-e69157c7bb7f tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:16.781903 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8a840932-cea2-4826-83a7-e69157c7bb7f tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:16.782546 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8a840932-cea2-4826-83a7-e69157c7bb7f tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:16.783976 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8a840932-cea2-4826-83a7-e69157c7bb7f tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:16.784544 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8a840932-cea2-4826-83a7-e69157c7bb7f tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:16.785093 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8a840932-cea2-4826-83a7-e69157c7bb7f tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:16.828467 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-cb7af6fa-e762-4932-b17c-1e79b49facac tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:16.841182 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-cb7af6fa-e762-4932-b17c-1e79b49facac tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/4399d570-dda9-4a5a-921c-d76d95f0a6f5" status: 200 len: 1510 microversion: 2.1 time: 0.483809 Aug 31 16:23:16.851799 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2610/5188] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:23:16 2022] GET /compute/v2.1/servers/4399d570-dda9-4a5a-921c-d76d95f0a6f5 => generated 1510 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:23:17.102795 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8a840932-cea2-4826-83a7-e69157c7bb7f tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:17.122184 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8a840932-cea2-4826-83a7-e69157c7bb7f tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:17.123378 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8a840932-cea2-4826-83a7-e69157c7bb7f tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:17.135783 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8a840932-cea2-4826-83a7-e69157c7bb7f tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5" status: 200 len: 1741 microversion: 2.20 time: 0.384734 Aug 31 16:23:17.139329 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2579/5189] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:23:16 2022] GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5 => generated 1741 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:23:17.880669 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3f4af2ce-5861-415d-94f3-80c716165441 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:17.882360 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3f4af2ce-5861-415d-94f3-80c716165441 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 4399d570-dda9-4a5a-921c-d76d95f0a6f5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:17.902765 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3f4af2ce-5861-415d-94f3-80c716165441 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:17.907865 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3f4af2ce-5861-415d-94f3-80c716165441 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:17.908971 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3f4af2ce-5861-415d-94f3-80c716165441 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:17.911102 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3f4af2ce-5861-415d-94f3-80c716165441 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:17.914548 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3f4af2ce-5861-415d-94f3-80c716165441 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:17.917794 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3f4af2ce-5861-415d-94f3-80c716165441 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:18.096440 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-ec5b1036-d304-4b75-a35b-c736c5eb45c8 req-fe5d9002-cbee-4b5f-a938-ca0f9e16738d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4399d570-dda9-4a5a-921c-d76d95f0a6f5", "name": "network-vif-deleted", "tag": "3153b546-2cab-4c6c-b241-83f394054c0e"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:23:18.120135 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-ec5b1036-d304-4b75-a35b-c736c5eb45c8 req-fe5d9002-cbee-4b5f-a938-ca0f9e16738d service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:18.120622 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-ec5b1036-d304-4b75-a35b-c736c5eb45c8 req-fe5d9002-cbee-4b5f-a938-ca0f9e16738d service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:18.122864 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-ec5b1036-d304-4b75-a35b-c736c5eb45c8 req-fe5d9002-cbee-4b5f-a938-ca0f9e16738d service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:18.131472 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3f4af2ce-5861-415d-94f3-80c716165441 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:18.139947 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3f4af2ce-5861-415d-94f3-80c716165441 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/4399d570-dda9-4a5a-921c-d76d95f0a6f5" status: 200 len: 1468 microversion: 2.1 time: 0.265908 Aug 31 16:23:18.143026 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2611/5190] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:23:17 2022] GET /compute/v2.1/servers/4399d570-dda9-4a5a-921c-d76d95f0a6f5 => generated 1468 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:23:18.165037 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-ec5b1036-d304-4b75-a35b-c736c5eb45c8 req-fe5d9002-cbee-4b5f-a938-ca0f9e16738d service nova] Creating event network-vif-deleted:3153b546-2cab-4c6c-b241-83f394054c0e for instance 4399d570-dda9-4a5a-921c-d76d95f0a6f5 on n-h2-850499-9 Aug 31 16:23:18.166910 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-69dda07c-2953-471f-8697-e57dc80fd974 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:18.169787 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-69dda07c-2953-471f-8697-e57dc80fd974 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:18.175956 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-ec5b1036-d304-4b75-a35b-c736c5eb45c8 req-fe5d9002-cbee-4b5f-a938-ca0f9e16738d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084054 Aug 31 16:23:18.177437 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-69dda07c-2953-471f-8697-e57dc80fd974 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:18.178141 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-69dda07c-2953-471f-8697-e57dc80fd974 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:18.178758 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-69dda07c-2953-471f-8697-e57dc80fd974 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:18.179668 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-69dda07c-2953-471f-8697-e57dc80fd974 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:18.179800 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2580/5191] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:23:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:23:18.180385 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-69dda07c-2953-471f-8697-e57dc80fd974 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:18.181182 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-69dda07c-2953-471f-8697-e57dc80fd974 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:18.435007 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-69dda07c-2953-471f-8697-e57dc80fd974 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:18.457110 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-69dda07c-2953-471f-8697-e57dc80fd974 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:18.458919 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-69dda07c-2953-471f-8697-e57dc80fd974 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:18.460642 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-69dda07c-2953-471f-8697-e57dc80fd974 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5" status: 200 len: 1741 microversion: 2.20 time: 0.297840 Aug 31 16:23:18.461698 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2612/5192] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:23:18 2022] GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5 => generated 1741 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:23:19.166762 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a0bfb7a0-1f2b-49e3-b3ec-2fa47b1312d5 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:19.168175 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a0bfb7a0-1f2b-49e3-b3ec-2fa47b1312d5 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 4399d570-dda9-4a5a-921c-d76d95f0a6f5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:19.178037 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a0bfb7a0-1f2b-49e3-b3ec-2fa47b1312d5 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:19.180136 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a0bfb7a0-1f2b-49e3-b3ec-2fa47b1312d5 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:19.182211 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a0bfb7a0-1f2b-49e3-b3ec-2fa47b1312d5 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:19.183696 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a0bfb7a0-1f2b-49e3-b3ec-2fa47b1312d5 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:19.186187 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a0bfb7a0-1f2b-49e3-b3ec-2fa47b1312d5 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:19.186823 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a0bfb7a0-1f2b-49e3-b3ec-2fa47b1312d5 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:19.281218 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a0bfb7a0-1f2b-49e3-b3ec-2fa47b1312d5 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:19.282025 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a0bfb7a0-1f2b-49e3-b3ec-2fa47b1312d5 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:19.282697 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a0bfb7a0-1f2b-49e3-b3ec-2fa47b1312d5 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:19.283429 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-a0bfb7a0-1f2b-49e3-b3ec-2fa47b1312d5 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lazy-loading 'fault' on Instance uuid 4399d570-dda9-4a5a-921c-d76d95f0a6f5 {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:23:19.490643 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5517321d-039b-4a04-9cb6-040425b758a4 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:19.491979 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5517321d-039b-4a04-9cb6-040425b758a4 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:19.525541 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5517321d-039b-4a04-9cb6-040425b758a4 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:19.528127 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5517321d-039b-4a04-9cb6-040425b758a4 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:19.528832 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5517321d-039b-4a04-9cb6-040425b758a4 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:19.532501 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5517321d-039b-4a04-9cb6-040425b758a4 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:19.534813 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5517321d-039b-4a04-9cb6-040425b758a4 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:19.537068 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5517321d-039b-4a04-9cb6-040425b758a4 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:19.582317 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a0bfb7a0-1f2b-49e3-b3ec-2fa47b1312d5 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:19.593978 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a0bfb7a0-1f2b-49e3-b3ec-2fa47b1312d5 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/4399d570-dda9-4a5a-921c-d76d95f0a6f5" status: 200 len: 1307 microversion: 2.1 time: 0.432070 Aug 31 16:23:19.596293 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2581/5193] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:23:19 2022] GET /compute/v2.1/servers/4399d570-dda9-4a5a-921c-d76d95f0a6f5 => generated 1307 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:23:20.106455 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5517321d-039b-4a04-9cb6-040425b758a4 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:20.122923 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5517321d-039b-4a04-9cb6-040425b758a4 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:20.124481 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5517321d-039b-4a04-9cb6-040425b758a4 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:20.125714 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5517321d-039b-4a04-9cb6-040425b758a4 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5" status: 200 len: 1741 microversion: 2.20 time: 0.639223 Aug 31 16:23:20.126295 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2613/5194] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:23:19 2022] GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5 => generated 1741 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:23:20.625246 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-804a0c3f-cfc5-48f9-a8f6-2affc0d8f5d7 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:20.631260 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-804a0c3f-cfc5-48f9-a8f6-2affc0d8f5d7 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 4399d570-dda9-4a5a-921c-d76d95f0a6f5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:20.657379 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-804a0c3f-cfc5-48f9-a8f6-2affc0d8f5d7 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:20.665053 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-804a0c3f-cfc5-48f9-a8f6-2affc0d8f5d7 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:20.666172 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-804a0c3f-cfc5-48f9-a8f6-2affc0d8f5d7 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:20.667828 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-804a0c3f-cfc5-48f9-a8f6-2affc0d8f5d7 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:20.671840 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-804a0c3f-cfc5-48f9-a8f6-2affc0d8f5d7 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:20.672754 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-804a0c3f-cfc5-48f9-a8f6-2affc0d8f5d7 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:20.749544 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-804a0c3f-cfc5-48f9-a8f6-2affc0d8f5d7 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] HTTP exception thrown: Instance 4399d570-dda9-4a5a-921c-d76d95f0a6f5 could not be found. Aug 31 16:23:20.751673 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-804a0c3f-cfc5-48f9-a8f6-2affc0d8f5d7 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Request method failure captured: Aug 31 16:23:20.751673 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/4399d570-dda9-4a5a-921c-d76d95f0a6f5 HTTP/1.1 Aug 31 16:23:20.751673 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:23:20.751673 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:23:20.751673 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:23:20.751673 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:23:20.751673 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:23:20.751673 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:23:20.751673 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:23:20.751673 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:23:20.751673 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4q2NcJzZutw3Y6jF4GnmJD1H1MzSLIbHjRxunPVSp6uKTRmCePfT1DyksG9QgDfSYnSoM0q9vOxO3sqZKoJ5PA2HppEXRHLLn8jTh4ccTKQ6q8SYb3pqui6kOFW5_PmtYr9N0lihJC0EStA4OYRI4QsHOxwmGiiVscbhBZpLyiKmV0 Aug 31 16:23:20.751673 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:23:20.751673 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:23:20.751673 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:23:20.751673 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:23:20.751673 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:23:20.751673 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:23:20.751673 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 014522b19dc349a691e1f6b131229974 Aug 31 16:23:20.751673 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:23:20.751673 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:23:20.751673 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:23:20.751673 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/014522b19dc349a691e1f6b131229974"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/014522b19dc349a691e1f6b131229974"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_014522b19dc349a691e1f6b131229974", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/014522b19dc349a691e1f6b131229974"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:23:20.751673 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:23:20.751673 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 014522b19dc349a691e1f6b131229974 Aug 31 16:23:20.751673 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:23:20.751673 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ServersNegativeTestJSON-918151355-project Aug 31 16:23:20.751673 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:23:20.751673 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:23:20.751673 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: c042c43cc2aa4000a147fae62c261e86 Aug 31 16:23:20.751673 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ServersNegativeTestJSON-918151355-project Aug 31 16:23:20.751673 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:23:20.751673 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance 4399d570-dda9-4a5a-921c-d76d95f0a6f5 could not be found. Aug 31 16:23:20.751673 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '4399d570-dda9-4a5a-921c-d76d95f0a6f5'} Aug 31 16:23:20.751673 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:23:20.751673 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:23:20.751673 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:23:20.751673 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:23:20.751673 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:23:20.751673 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:23:20.751673 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:23:20.751673 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:23:20.751673 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:23:20.751673 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:23:20.751673 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4399d570-dda9-4a5a-921c-d76d95f0a6f5 could not be found. Aug 31 16:23:20.751673 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:23:20.751673 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:23:20.751673 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:23:20.751673 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:23:20.751673 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:23:20.751673 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:23:20.751673 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:23:20.751673 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:23:20.751673 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:23:20.751673 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:23:20.751673 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:23:20.751673 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:23:20.751673 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:23:20.751673 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:23:20.751673 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:23:20.751673 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:23:20.751673 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4399d570-dda9-4a5a-921c-d76d95f0a6f5 could not be found. Aug 31 16:23:20.751673 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:23:20.751673 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:23:20.751673 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:23:20.757694 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:23:20.757694 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:23:20.757694 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:23:20.757694 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:23:20.757694 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:23:20.757694 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4399d570-dda9-4a5a-921c-d76d95f0a6f5 could not be found. Aug 31 16:23:20.757694 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:23:20.761502 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-804a0c3f-cfc5-48f9-a8f6-2affc0d8f5d7 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Returning 404 to user: Instance 4399d570-dda9-4a5a-921c-d76d95f0a6f5 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:23:20.770157 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-804a0c3f-cfc5-48f9-a8f6-2affc0d8f5d7 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/4399d570-dda9-4a5a-921c-d76d95f0a6f5" status: 404 len: 111 microversion: 2.1 time: 0.151882 Aug 31 16:23:20.771130 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2582/5195] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:23:20 2022] GET /compute/v2.1/servers/4399d570-dda9-4a5a-921c-d76d95f0a6f5 => generated 111 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:23:20.780927 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3a703711-934b-4f94-bbc5-38918e898248 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:20.784222 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3a703711-934b-4f94-bbc5-38918e898248 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:20.800608 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3a703711-934b-4f94-bbc5-38918e898248 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:20.802816 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3a703711-934b-4f94-bbc5-38918e898248 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:20.805763 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3a703711-934b-4f94-bbc5-38918e898248 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:20.806837 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3a703711-934b-4f94-bbc5-38918e898248 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:20.809154 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3a703711-934b-4f94-bbc5-38918e898248 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:20.809939 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3a703711-934b-4f94-bbc5-38918e898248 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:21.164112 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4237b3f9-90e9-4092-8e4f-e3c1c5481745 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:21.165377 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4237b3f9-90e9-4092-8e4f-e3c1c5481745 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:21.181483 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4237b3f9-90e9-4092-8e4f-e3c1c5481745 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:21.184158 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4237b3f9-90e9-4092-8e4f-e3c1c5481745 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:21.184896 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4237b3f9-90e9-4092-8e4f-e3c1c5481745 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:21.185735 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4237b3f9-90e9-4092-8e4f-e3c1c5481745 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:21.188851 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4237b3f9-90e9-4092-8e4f-e3c1c5481745 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:21.190428 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4237b3f9-90e9-4092-8e4f-e3c1c5481745 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:21.692890 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3a703711-934b-4f94-bbc5-38918e898248 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:21.708515 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3a703711-934b-4f94-bbc5-38918e898248 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1504 microversion: 2.1 time: 0.928216 Aug 31 16:23:21.709435 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2614/5196] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:23:20 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1504 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:23:21.735689 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-4237b3f9-90e9-4092-8e4f-e3c1c5481745 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:21.757224 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-4237b3f9-90e9-4092-8e4f-e3c1c5481745 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:21.763386 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-4237b3f9-90e9-4092-8e4f-e3c1c5481745 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:21.766473 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4237b3f9-90e9-4092-8e4f-e3c1c5481745 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5" status: 200 len: 1741 microversion: 2.20 time: 0.616777 Aug 31 16:23:21.789987 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2583/5197] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:23:21 2022] GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5 => generated 1741 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:23:21.867062 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3bf44144-9f5b-4df2-9dd1-1bca2c457cfb tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "networks": [{"uuid": "fa24e0ec-4a58-4400-9cf4-a0201375c33e"}]}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:23:21.875898 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3bf44144-9f5b-4df2-9dd1-1bca2c457cfb tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Request method failure captured: Aug 31 16:23:21.875898 n-d-850499-9 devstack@n-api.service[122257]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 31 16:23:21.875898 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:23:21.875898 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:23:21.875898 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:23:21.875898 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 163 Aug 31 16:23:21.875898 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:23:21.875898 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:23:21.875898 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:23:21.875898 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:23:21.875898 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4q2NcJzZutw3Y6jF4GnmJD1H1MzSLIbHjRxunPVSp6uKTRmCePfT1DyksG9QgDfSYnSoM0q9vOxO3sqZKoJ5PA2HppEXRHLLn8jTh4ccTKQ6q8SYb3pqui6kOFW5_PmtYr9N0lihJC0EStA4OYRI4QsHOxwmGiiVscbhBZpLyiKmV0 Aug 31 16:23:21.875898 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:23:21.875898 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:23:21.875898 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:23:21.875898 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:23:21.875898 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:23:21.875898 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:23:21.875898 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 014522b19dc349a691e1f6b131229974 Aug 31 16:23:21.875898 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:23:21.875898 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:23:21.875898 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:23:21.875898 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/014522b19dc349a691e1f6b131229974"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/014522b19dc349a691e1f6b131229974"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_014522b19dc349a691e1f6b131229974", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/014522b19dc349a691e1f6b131229974"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:23:21.875898 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:23:21.875898 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 014522b19dc349a691e1f6b131229974 Aug 31 16:23:21.875898 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:23:21.875898 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ServersNegativeTestJSON-918151355-project Aug 31 16:23:21.875898 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:23:21.875898 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:23:21.875898 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: c042c43cc2aa4000a147fae62c261e86 Aug 31 16:23:21.875898 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ServersNegativeTestJSON-918151355-project Aug 31 16:23:21.875898 n-d-850499-9 devstack@n-api.service[122257]: Aug 31 16:23:21.875898 n-d-850499-9 devstack@n-api.service[122257]: {"server": {"name": 12345, "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "networks": [{"uuid": "fa24e0ec-4a58-4400-9cf4-a0201375c33e"}]}} Aug 31 16:23:21.875898 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:23:21.875898 n-d-850499-9 devstack@n-api.service[122257]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 31 16:23:21.875898 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'body': {'server': {'name': 12345, 'imageRef': 'b9c36d42-ed46-4bf5-ad18-1df45cbd0413', 'flavorRef': '452', 'networks': [{'uuid': 'fa24e0ec-4a58-4400-9cf4-a0201375c33e'}]}}} Aug 31 16:23:21.875898 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:23:21.875898 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:23:21.875898 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 16:23:21.875898 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 16:23:21.875898 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 16:23:21.875898 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise error Aug 31 16:23:21.875898 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Aug 31 16:23:21.875898 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:23:21.875898 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Aug 31 16:23:21.875898 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 31 16:23:21.875898 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:23:21.875898 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 31 16:23:21.875898 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi 12345 Aug 31 16:23:21.875898 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:23:21.875898 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:23:21.875898 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:23:21.875898 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:23:21.875898 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:23:21.875898 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:23:21.875898 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:23:21.875898 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:23:21.875898 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:23:21.875898 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:23:21.875898 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:23:21.875898 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:23:21.875898 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 16:23:21.875898 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 16:23:21.875898 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 16:23:21.875898 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 16:23:21.875898 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 16:23:21.881396 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 16:23:21.881396 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 31 16:23:21.881396 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:23:21.881396 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:23:21.881396 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:23:21.881396 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:23:21.881396 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:23:21.881396 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:23:21.881396 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 16:23:21.881396 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 16:23:21.881396 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 31 16:23:21.881396 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:23:21.881396 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3bf44144-9f5b-4df2-9dd1-1bca2c457cfb tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:23:21.881396 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3bf44144-9f5b-4df2-9dd1-1bca2c457cfb tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.019779 Aug 31 16:23:21.888124 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2615/5198] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:23:21 2022] POST /compute/v2.1/servers => generated 127 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:23:21.890453 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-bdc52add-f53e-4179-8d2c-ba2d61818220 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:21.891643 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-bdc52add-f53e-4179-8d2c-ba2d61818220 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:21.918675 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bdc52add-f53e-4179-8d2c-ba2d61818220 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:21.922771 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bdc52add-f53e-4179-8d2c-ba2d61818220 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:21.926501 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bdc52add-f53e-4179-8d2c-ba2d61818220 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:21.932182 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bdc52add-f53e-4179-8d2c-ba2d61818220 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:21.935435 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bdc52add-f53e-4179-8d2c-ba2d61818220 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:21.939017 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bdc52add-f53e-4179-8d2c-ba2d61818220 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:22.713840 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-bdc52add-f53e-4179-8d2c-ba2d61818220 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:22.727909 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-bdc52add-f53e-4179-8d2c-ba2d61818220 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1504 microversion: 2.1 time: 0.841878 Aug 31 16:23:22.735193 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2584/5199] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:23:21 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1504 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:23:22.764181 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-fa414ff6-bfc7-46d6-b638-919450042402 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:22.765326 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-fa414ff6-bfc7-46d6-b638-919450042402 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:22.781064 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fa414ff6-bfc7-46d6-b638-919450042402 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:22.781794 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fa414ff6-bfc7-46d6-b638-919450042402 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:22.782351 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fa414ff6-bfc7-46d6-b638-919450042402 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:22.783741 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fa414ff6-bfc7-46d6-b638-919450042402 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:22.786768 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fa414ff6-bfc7-46d6-b638-919450042402 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:22.787357 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fa414ff6-bfc7-46d6-b638-919450042402 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:22.798131 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-eefe752f-919f-4bf7-9892-40d8d1a4dfcc tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:22.799451 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-eefe752f-919f-4bf7-9892-40d8d1a4dfcc tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:22.814639 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eefe752f-919f-4bf7-9892-40d8d1a4dfcc tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:22.824388 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eefe752f-919f-4bf7-9892-40d8d1a4dfcc tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:22.825311 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eefe752f-919f-4bf7-9892-40d8d1a4dfcc tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:22.826700 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eefe752f-919f-4bf7-9892-40d8d1a4dfcc tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:22.832884 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eefe752f-919f-4bf7-9892-40d8d1a4dfcc tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:22.834239 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eefe752f-919f-4bf7-9892-40d8d1a4dfcc tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:23.795248 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-eefe752f-919f-4bf7-9892-40d8d1a4dfcc tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:23.813197 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-eefe752f-919f-4bf7-9892-40d8d1a4dfcc tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:23.823961 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-eefe752f-919f-4bf7-9892-40d8d1a4dfcc tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:23.825704 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-eefe752f-919f-4bf7-9892-40d8d1a4dfcc tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5" status: 200 len: 1741 microversion: 2.20 time: 1.031441 Aug 31 16:23:23.827004 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2585/5200] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:23:22 2022] GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5 => generated 1741 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:23:23.841300 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-fa414ff6-bfc7-46d6-b638-919450042402 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:23.866105 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-fa414ff6-bfc7-46d6-b638-919450042402 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1504 microversion: 2.1 time: 1.103628 Aug 31 16:23:23.877165 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2616/5201] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:23:22 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1504 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:23:24.851280 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-eebaa843-f06e-4d6a-b4ae-2160c6f98dba tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:24.851808 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-eebaa843-f06e-4d6a-b4ae-2160c6f98dba tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:24.868933 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eebaa843-f06e-4d6a-b4ae-2160c6f98dba tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:24.869505 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eebaa843-f06e-4d6a-b4ae-2160c6f98dba tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:24.869950 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eebaa843-f06e-4d6a-b4ae-2160c6f98dba tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:24.884451 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eebaa843-f06e-4d6a-b4ae-2160c6f98dba tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:24.884969 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eebaa843-f06e-4d6a-b4ae-2160c6f98dba tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:24.887667 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eebaa843-f06e-4d6a-b4ae-2160c6f98dba tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:25.679248 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-eebaa843-f06e-4d6a-b4ae-2160c6f98dba tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:25.715076 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-eebaa843-f06e-4d6a-b4ae-2160c6f98dba tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:25.746565 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-eebaa843-f06e-4d6a-b4ae-2160c6f98dba tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:25.752827 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-eebaa843-f06e-4d6a-b4ae-2160c6f98dba tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5" status: 200 len: 1741 microversion: 2.20 time: 0.903208 Aug 31 16:23:25.756750 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2586/5202] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:23:24 2022] GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5 => generated 1741 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:23:26.788557 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4a7d4d1f-79bb-4809-9843-5da3328a09fb tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:26.789999 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4a7d4d1f-79bb-4809-9843-5da3328a09fb tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:26.812402 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4a7d4d1f-79bb-4809-9843-5da3328a09fb tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:26.814447 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4a7d4d1f-79bb-4809-9843-5da3328a09fb tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:26.819352 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4a7d4d1f-79bb-4809-9843-5da3328a09fb tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:26.821903 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4a7d4d1f-79bb-4809-9843-5da3328a09fb tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:26.826727 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4a7d4d1f-79bb-4809-9843-5da3328a09fb tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:26.827289 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4a7d4d1f-79bb-4809-9843-5da3328a09fb tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:27.424803 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f23eeb0a-8488-4461-8d3d-458cd0cf0353 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1305918094", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "e2dff2d0-2c53-4893-bcee-8e5fcb4471f1", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "fa24e0ec-4a58-4400-9cf4-a0201375c33e"}]}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:23:27.599934 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-f23eeb0a-8488-4461-8d3d-458cd0cf0353 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] HTTP exception thrown: Block Device e2dff2d0-2c53-4893-bcee-8e5fcb4471f1 is not bootable. Aug 31 16:23:27.608835 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f23eeb0a-8488-4461-8d3d-458cd0cf0353 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Request method failure captured: Aug 31 16:23:27.608835 n-d-850499-9 devstack@n-api.service[122256]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 31 16:23:27.608835 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:23:27.608835 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:23:27.608835 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:23:27.608835 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 358 Aug 31 16:23:27.608835 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:23:27.608835 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:23:27.608835 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:23:27.608835 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:23:27.608835 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4q2NcJzZutw3Y6jF4GnmJD1H1MzSLIbHjRxunPVSp6uKTRmCePfT1DyksG9QgDfSYnSoM0q9vOxO3sqZKoJ5PA2HppEXRHLLn8jTh4ccTKQ6q8SYb3pqui6kOFW5_PmtYr9N0lihJC0EStA4OYRI4QsHOxwmGiiVscbhBZpLyiKmV0 Aug 31 16:23:27.608835 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:23:27.608835 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:23:27.608835 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:23:27.608835 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:23:27.608835 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:23:27.608835 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:23:27.608835 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 014522b19dc349a691e1f6b131229974 Aug 31 16:23:27.608835 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:23:27.608835 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:23:27.608835 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:23:27.608835 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/014522b19dc349a691e1f6b131229974"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/014522b19dc349a691e1f6b131229974"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_014522b19dc349a691e1f6b131229974", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/014522b19dc349a691e1f6b131229974"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:23:27.608835 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:23:27.608835 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 014522b19dc349a691e1f6b131229974 Aug 31 16:23:27.608835 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:23:27.608835 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ServersNegativeTestJSON-918151355-project Aug 31 16:23:27.608835 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:23:27.608835 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:23:27.608835 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: c042c43cc2aa4000a147fae62c261e86 Aug 31 16:23:27.608835 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ServersNegativeTestJSON-918151355-project Aug 31 16:23:27.608835 n-d-850499-9 devstack@n-api.service[122256]: Aug 31 16:23:27.608835 n-d-850499-9 devstack@n-api.service[122256]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1305918094", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "e2dff2d0-2c53-4893-bcee-8e5fcb4471f1", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "fa24e0ec-4a58-4400-9cf4-a0201375c33e"}]}} Aug 31 16:23:27.608835 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:23:27.608835 n-d-850499-9 devstack@n-api.service[122256]: exception: Block Device e2dff2d0-2c53-4893-bcee-8e5fcb4471f1 is not bootable. Aug 31 16:23:27.608835 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1305918094', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': 'e2dff2d0-2c53-4893-bcee-8e5fcb4471f1'}], 'networks': [{'uuid': 'fa24e0ec-4a58-4400-9cf4-a0201375c33e'}]}}} Aug 31 16:23:27.608835 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:23:27.608835 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:23:27.608835 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 31 16:23:27.608835 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 31 16:23:27.608835 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 31 16:23:27.608835 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 31 16:23:27.608835 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Aug 31 16:23:27.608835 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Aug 31 16:23:27.608835 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Aug 31 16:23:27.608835 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Aug 31 16:23:27.608835 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device e2dff2d0-2c53-4893-bcee-8e5fcb4471f1 is not bootable. Aug 31 16:23:27.608835 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:23:27.608835 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:23:27.608835 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:23:27.608835 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:23:27.608835 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:23:27.608835 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:23:27.608835 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:23:27.608835 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:23:27.608835 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:23:27.608835 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:23:27.608835 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:23:27.608835 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:23:27.608835 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:23:27.614850 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:23:27.614850 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:23:27.614850 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:23:27.614850 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 31 16:23:27.614850 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 31 16:23:27.614850 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 31 16:23:27.614850 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device e2dff2d0-2c53-4893-bcee-8e5fcb4471f1 is not bootable. Aug 31 16:23:27.614850 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:23:27.614850 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:23:27.614850 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:23:27.614850 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:23:27.614850 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:23:27.614850 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:23:27.614850 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:23:27.614850 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:23:27.614850 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device e2dff2d0-2c53-4893-bcee-8e5fcb4471f1 is not bootable. Aug 31 16:23:27.614850 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:23:27.614850 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f23eeb0a-8488-4461-8d3d-458cd0cf0353 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Returning 400 to user: Block Device e2dff2d0-2c53-4893-bcee-8e5fcb4471f1 is not bootable. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:23:27.614850 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f23eeb0a-8488-4461-8d3d-458cd0cf0353 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.190810 Aug 31 16:23:27.616427 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2587/5203] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:23:27 2022] POST /compute/v2.1/servers => generated 110 bytes in 196 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 31 16:23:27.620075 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e352b73f-baa6-4dd2-9eac-2d771a5536fb tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:27.621085 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e352b73f-baa6-4dd2-9eac-2d771a5536fb tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:27.637979 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e352b73f-baa6-4dd2-9eac-2d771a5536fb tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:27.639293 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e352b73f-baa6-4dd2-9eac-2d771a5536fb tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:27.641064 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e352b73f-baa6-4dd2-9eac-2d771a5536fb tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:27.644440 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e352b73f-baa6-4dd2-9eac-2d771a5536fb tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:27.645553 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e352b73f-baa6-4dd2-9eac-2d771a5536fb tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:27.646203 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e352b73f-baa6-4dd2-9eac-2d771a5536fb tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:27.691405 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-4a7d4d1f-79bb-4809-9843-5da3328a09fb tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:27.701479 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:23:27.712116 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-4a7d4d1f-79bb-4809-9843-5da3328a09fb tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:27.715636 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-4a7d4d1f-79bb-4809-9843-5da3328a09fb tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:27.720640 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4a7d4d1f-79bb-4809-9843-5da3328a09fb tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5" status: 200 len: 1741 microversion: 2.20 time: 0.937354 Aug 31 16:23:27.723673 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2617/5204] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:23:26 2022] GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5 => generated 1741 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:23:28.753645 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-80674109-1455-4948-b57e-84bea6b7d533 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:28.755746 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-80674109-1455-4948-b57e-84bea6b7d533 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:28.781510 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-80674109-1455-4948-b57e-84bea6b7d533 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:28.782503 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-80674109-1455-4948-b57e-84bea6b7d533 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:28.785013 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-80674109-1455-4948-b57e-84bea6b7d533 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:28.786645 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-80674109-1455-4948-b57e-84bea6b7d533 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:28.789376 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-80674109-1455-4948-b57e-84bea6b7d533 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:28.790432 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-80674109-1455-4948-b57e-84bea6b7d533 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:29.078089 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e352b73f-baa6-4dd2-9eac-2d771a5536fb tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:29.088825 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e352b73f-baa6-4dd2-9eac-2d771a5536fb tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1504 microversion: 2.1 time: 1.472019 Aug 31 16:23:29.089430 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2588/5205] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:23:27 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1504 bytes in 1474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:23:29.119276 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4b3c86b6-981d-4f6b-8d39-a320580f8882 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:29.119930 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4b3c86b6-981d-4f6b-8d39-a320580f8882 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:29.169473 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4b3c86b6-981d-4f6b-8d39-a320580f8882 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:29.170812 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4b3c86b6-981d-4f6b-8d39-a320580f8882 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:29.171888 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4b3c86b6-981d-4f6b-8d39-a320580f8882 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:29.173397 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4b3c86b6-981d-4f6b-8d39-a320580f8882 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:29.177614 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4b3c86b6-981d-4f6b-8d39-a320580f8882 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:29.180049 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4b3c86b6-981d-4f6b-8d39-a320580f8882 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:29.741642 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-80674109-1455-4948-b57e-84bea6b7d533 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:29.757325 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-80674109-1455-4948-b57e-84bea6b7d533 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:29.769554 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-80674109-1455-4948-b57e-84bea6b7d533 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:29.771778 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-80674109-1455-4948-b57e-84bea6b7d533 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5" status: 200 len: 1741 microversion: 2.20 time: 1.024897 Aug 31 16:23:29.775075 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2618/5206] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:23:28 2022] GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5 => generated 1741 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:23:30.111927 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-4b3c86b6-981d-4f6b-8d39-a320580f8882 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:30.135451 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4b3c86b6-981d-4f6b-8d39-a320580f8882 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1504 microversion: 2.1 time: 1.019783 Aug 31 16:23:30.149169 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2589/5207] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:23:29 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1504 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:23:30.805212 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d65bbf85-2f33-422f-ada4-15b8badba021 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:30.806154 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d65bbf85-2f33-422f-ada4-15b8badba021 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:30.825510 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d65bbf85-2f33-422f-ada4-15b8badba021 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:30.826416 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d65bbf85-2f33-422f-ada4-15b8badba021 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:30.827141 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d65bbf85-2f33-422f-ada4-15b8badba021 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:30.828134 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d65bbf85-2f33-422f-ada4-15b8badba021 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:30.828831 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d65bbf85-2f33-422f-ada4-15b8badba021 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:30.829853 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d65bbf85-2f33-422f-ada4-15b8badba021 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:31.095643 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d65bbf85-2f33-422f-ada4-15b8badba021 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:31.104757 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d65bbf85-2f33-422f-ada4-15b8badba021 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:31.111591 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d65bbf85-2f33-422f-ada4-15b8badba021 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:31.115906 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d65bbf85-2f33-422f-ada4-15b8badba021 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5" status: 200 len: 1741 microversion: 2.20 time: 0.316700 Aug 31 16:23:31.133270 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2619/5208] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:23:30 2022] GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5 => generated 1741 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:23:32.146318 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-fabfa758-653a-4cfb-a690-7094276e31be tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:32.146965 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-fabfa758-653a-4cfb-a690-7094276e31be tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:32.162064 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fabfa758-653a-4cfb-a690-7094276e31be tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:32.163799 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fabfa758-653a-4cfb-a690-7094276e31be tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:32.165066 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fabfa758-653a-4cfb-a690-7094276e31be tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:32.166604 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fabfa758-653a-4cfb-a690-7094276e31be tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:32.168869 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fabfa758-653a-4cfb-a690-7094276e31be tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:32.169496 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fabfa758-653a-4cfb-a690-7094276e31be tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:32.583753 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-fabfa758-653a-4cfb-a690-7094276e31be tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:32.602731 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-fabfa758-653a-4cfb-a690-7094276e31be tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:32.604271 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-fabfa758-653a-4cfb-a690-7094276e31be tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:32.605683 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-fabfa758-653a-4cfb-a690-7094276e31be tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5" status: 200 len: 1723 microversion: 2.20 time: 0.464853 Aug 31 16:23:32.623381 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2590/5209] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:23:32 2022] GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5 => generated 1723 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:23:33.355947 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-183d3664-5d4a-45c0-add8-361503be140a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-848169787", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "destination_type": "local"}, {"source_type": "volume", "uuid": "9a46d508-e772-4a24-8a36-69b2e4328d8b", "destination_type": "invalid"}], "networks": [{"uuid": "fa24e0ec-4a58-4400-9cf4-a0201375c33e"}]}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:23:33.360355 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-183d3664-5d4a-45c0-add8-361503be140a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Request method failure captured: Aug 31 16:23:33.360355 n-d-850499-9 devstack@n-api.service[122257]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 31 16:23:33.360355 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:23:33.360355 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:23:33.360355 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:23:33.360355 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 494 Aug 31 16:23:33.360355 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:23:33.360355 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:23:33.360355 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:23:33.360355 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:23:33.360355 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4q2NcJzZutw3Y6jF4GnmJD1H1MzSLIbHjRxunPVSp6uKTRmCePfT1DyksG9QgDfSYnSoM0q9vOxO3sqZKoJ5PA2HppEXRHLLn8jTh4ccTKQ6q8SYb3pqui6kOFW5_PmtYr9N0lihJC0EStA4OYRI4QsHOxwmGiiVscbhBZpLyiKmV0 Aug 31 16:23:33.360355 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:23:33.360355 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:23:33.360355 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:23:33.360355 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:23:33.360355 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:23:33.360355 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:23:33.360355 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 014522b19dc349a691e1f6b131229974 Aug 31 16:23:33.360355 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:23:33.360355 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:23:33.360355 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:23:33.360355 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/014522b19dc349a691e1f6b131229974"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/014522b19dc349a691e1f6b131229974"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_014522b19dc349a691e1f6b131229974", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/014522b19dc349a691e1f6b131229974"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:23:33.360355 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:23:33.360355 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 014522b19dc349a691e1f6b131229974 Aug 31 16:23:33.360355 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:23:33.360355 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ServersNegativeTestJSON-918151355-project Aug 31 16:23:33.360355 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:23:33.360355 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:23:33.360355 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: c042c43cc2aa4000a147fae62c261e86 Aug 31 16:23:33.360355 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ServersNegativeTestJSON-918151355-project Aug 31 16:23:33.360355 n-d-850499-9 devstack@n-api.service[122257]: Aug 31 16:23:33.360355 n-d-850499-9 devstack@n-api.service[122257]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-848169787", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "destination_type": "local"}, {"source_type": "volume", "uuid": "9a46d508-e772-4a24-8a36-69b2e4328d8b", "destination_type": "invalid"}], "networks": [{"uuid": "fa24e0ec-4a58-4400-9cf4-a0201375c33e"}]}} Aug 31 16:23:33.360355 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:23:33.360355 n-d-850499-9 devstack@n-api.service[122257]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 31 16:23:33.360355 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-848169787', 'imageRef': 'b9c36d42-ed46-4bf5-ad18-1df45cbd0413', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': 'b9c36d42-ed46-4bf5-ad18-1df45cbd0413', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '9a46d508-e772-4a24-8a36-69b2e4328d8b', 'destination_type': 'invalid'}], 'networks': [{'uuid': 'fa24e0ec-4a58-4400-9cf4-a0201375c33e'}]}}} Aug 31 16:23:33.360355 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:23:33.360355 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:23:33.360355 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 16:23:33.360355 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 16:23:33.360355 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 16:23:33.360355 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise error Aug 31 16:23:33.360355 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Aug 31 16:23:33.360355 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:23:33.360355 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Aug 31 16:23:33.360355 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Aug 31 16:23:33.360355 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:23:33.360355 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Aug 31 16:23:33.360355 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi 'invalid' Aug 31 16:23:33.360355 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:23:33.360355 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:23:33.360355 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:23:33.360355 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:23:33.360355 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:23:33.360355 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:23:33.360355 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:23:33.360355 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:23:33.360355 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:23:33.360355 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:23:33.365456 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:23:33.365456 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:23:33.365456 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 16:23:33.365456 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 16:23:33.365456 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 16:23:33.365456 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 16:23:33.365456 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 16:23:33.365456 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 16:23:33.365456 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 31 16:23:33.365456 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:23:33.365456 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:23:33.365456 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:23:33.365456 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:23:33.365456 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:23:33.365456 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:23:33.365456 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 16:23:33.365456 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 16:23:33.365456 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 31 16:23:33.365456 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:23:33.370456 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-183d3664-5d4a-45c0-add8-361503be140a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:23:33.371993 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-183d3664-5d4a-45c0-add8-361503be140a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.019980 Aug 31 16:23:33.373313 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2620/5210] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:23:33 2022] POST /compute/v2.1/servers => generated 155 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:23:33.381930 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b99b8e93-eac5-479a-9c2c-037e79769a48 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:33.382557 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b99b8e93-eac5-479a-9c2c-037e79769a48 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:33.393962 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b99b8e93-eac5-479a-9c2c-037e79769a48 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:33.394473 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b99b8e93-eac5-479a-9c2c-037e79769a48 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:33.397149 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b99b8e93-eac5-479a-9c2c-037e79769a48 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:33.399075 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b99b8e93-eac5-479a-9c2c-037e79769a48 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:33.399477 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b99b8e93-eac5-479a-9c2c-037e79769a48 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:33.399956 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b99b8e93-eac5-479a-9c2c-037e79769a48 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:33.634910 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9fc6f4ad-cbc7-421b-bd53-e127e9c2c12f tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:33.635895 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9fc6f4ad-cbc7-421b-bd53-e127e9c2c12f tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:33.657057 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9fc6f4ad-cbc7-421b-bd53-e127e9c2c12f tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:33.662746 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9fc6f4ad-cbc7-421b-bd53-e127e9c2c12f tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:33.666518 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9fc6f4ad-cbc7-421b-bd53-e127e9c2c12f tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:33.667812 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9fc6f4ad-cbc7-421b-bd53-e127e9c2c12f tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:33.670706 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9fc6f4ad-cbc7-421b-bd53-e127e9c2c12f tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:33.672795 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9fc6f4ad-cbc7-421b-bd53-e127e9c2c12f tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:33.691391 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b99b8e93-eac5-479a-9c2c-037e79769a48 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:33.719673 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b99b8e93-eac5-479a-9c2c-037e79769a48 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1504 microversion: 2.1 time: 0.341244 Aug 31 16:23:33.725278 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2591/5211] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:23:33 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1504 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:23:33.752055 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3ecffa0a-3beb-4656-8f5a-807e919e4353 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:33.754379 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3ecffa0a-3beb-4656-8f5a-807e919e4353 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:33.761818 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3ecffa0a-3beb-4656-8f5a-807e919e4353 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:33.762903 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3ecffa0a-3beb-4656-8f5a-807e919e4353 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:33.763530 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3ecffa0a-3beb-4656-8f5a-807e919e4353 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:33.765011 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3ecffa0a-3beb-4656-8f5a-807e919e4353 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:33.765666 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3ecffa0a-3beb-4656-8f5a-807e919e4353 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:33.766304 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3ecffa0a-3beb-4656-8f5a-807e919e4353 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:33.964494 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9fc6f4ad-cbc7-421b-bd53-e127e9c2c12f tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:33.977028 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9fc6f4ad-cbc7-421b-bd53-e127e9c2c12f tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:33.984764 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9fc6f4ad-cbc7-421b-bd53-e127e9c2c12f tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:33.986191 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9fc6f4ad-cbc7-421b-bd53-e127e9c2c12f tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5" status: 200 len: 1723 microversion: 2.20 time: 0.359783 Aug 31 16:23:34.001233 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2621/5212] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:23:33 2022] GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5 => generated 1723 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:23:34.043718 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3ecffa0a-3beb-4656-8f5a-807e919e4353 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:34.056632 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3ecffa0a-3beb-4656-8f5a-807e919e4353 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1504 microversion: 2.1 time: 0.309289 Aug 31 16:23:34.057601 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2592/5213] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:23:33 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1504 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:23:34.172112 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3bef0d06-433c-41b9-a05b-f593b2afb497 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-98540884", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "fa24e0ec-4a58-4400-9cf4-a0201375c33e"}]}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:23:34.174662 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3bef0d06-433c-41b9-a05b-f593b2afb497 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Request method failure captured: Aug 31 16:23:34.174662 n-d-850499-9 devstack@n-api.service[122257]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 31 16:23:34.174662 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:23:34.174662 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:23:34.174662 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:23:34.174662 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 490 Aug 31 16:23:34.174662 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:23:34.174662 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:23:34.174662 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:23:34.174662 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:23:34.174662 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4q2NcJzZutw3Y6jF4GnmJD1H1MzSLIbHjRxunPVSp6uKTRmCePfT1DyksG9QgDfSYnSoM0q9vOxO3sqZKoJ5PA2HppEXRHLLn8jTh4ccTKQ6q8SYb3pqui6kOFW5_PmtYr9N0lihJC0EStA4OYRI4QsHOxwmGiiVscbhBZpLyiKmV0 Aug 31 16:23:34.174662 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:23:34.174662 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:23:34.174662 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:23:34.174662 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:23:34.174662 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:23:34.174662 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:23:34.174662 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 014522b19dc349a691e1f6b131229974 Aug 31 16:23:34.174662 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:23:34.174662 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:23:34.174662 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:23:34.174662 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/014522b19dc349a691e1f6b131229974"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/014522b19dc349a691e1f6b131229974"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_014522b19dc349a691e1f6b131229974", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/014522b19dc349a691e1f6b131229974"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:23:34.174662 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:23:34.174662 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 014522b19dc349a691e1f6b131229974 Aug 31 16:23:34.174662 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:23:34.174662 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ServersNegativeTestJSON-918151355-project Aug 31 16:23:34.174662 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:23:34.174662 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:23:34.174662 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: c042c43cc2aa4000a147fae62c261e86 Aug 31 16:23:34.174662 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ServersNegativeTestJSON-918151355-project Aug 31 16:23:34.174662 n-d-850499-9 devstack@n-api.service[122257]: Aug 31 16:23:34.174662 n-d-850499-9 devstack@n-api.service[122257]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-98540884", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "fa24e0ec-4a58-4400-9cf4-a0201375c33e"}]}} Aug 31 16:23:34.174662 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:23:34.174662 n-d-850499-9 devstack@n-api.service[122257]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 31 16:23:34.174662 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-98540884', 'imageRef': 'b9c36d42-ed46-4bf5-ad18-1df45cbd0413', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': 'fa24e0ec-4a58-4400-9cf4-a0201375c33e'}]}}} Aug 31 16:23:34.174662 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:23:34.174662 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:23:34.174662 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 16:23:34.174662 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 16:23:34.174662 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 16:23:34.174662 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise error Aug 31 16:23:34.174662 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 31 16:23:34.174662 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:23:34.174662 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Aug 31 16:23:34.174662 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Aug 31 16:23:34.174662 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:23:34.174662 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Aug 31 16:23:34.179039 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Aug 31 16:23:34.179039 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:23:34.179039 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:23:34.179039 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:23:34.179039 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:23:34.179039 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:23:34.179039 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:23:34.179039 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:23:34.179039 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:23:34.179039 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:23:34.179039 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:23:34.179039 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:23:34.179039 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:23:34.179039 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 16:23:34.179039 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 16:23:34.179039 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 16:23:34.179039 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 16:23:34.179039 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 16:23:34.179039 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 16:23:34.179039 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 31 16:23:34.179039 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:23:34.179039 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:23:34.179039 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:23:34.179039 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:23:34.179039 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:23:34.179039 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:23:34.179039 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 16:23:34.179039 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 16:23:34.179039 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 31 16:23:34.179039 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:23:34.183923 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3bef0d06-433c-41b9-a05b-f593b2afb497 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:23:34.185646 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3bef0d06-433c-41b9-a05b-f593b2afb497 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.022060 Aug 31 16:23:34.198472 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-41beabfc-c40c-4c01-ac99-d19d745dd34d tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:34.200070 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-41beabfc-c40c-4c01-ac99-d19d745dd34d tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:34.205458 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2622/5214] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:23:34 2022] POST /compute/v2.1/servers => generated 624 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:23:34.210415 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-41beabfc-c40c-4c01-ac99-d19d745dd34d tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:34.211761 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-41beabfc-c40c-4c01-ac99-d19d745dd34d tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:34.212880 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-41beabfc-c40c-4c01-ac99-d19d745dd34d tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:34.214020 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-41beabfc-c40c-4c01-ac99-d19d745dd34d tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:34.214793 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-41beabfc-c40c-4c01-ac99-d19d745dd34d tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:34.215478 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-41beabfc-c40c-4c01-ac99-d19d745dd34d tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:34.587127 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-41beabfc-c40c-4c01-ac99-d19d745dd34d tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:34.604881 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-41beabfc-c40c-4c01-ac99-d19d745dd34d tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1504 microversion: 2.1 time: 0.412998 Aug 31 16:23:34.606301 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2593/5215] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:23:34 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1504 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:23:34.659969 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3462fd2a-9828-45a3-962c-c9152ae851d9 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:34.661838 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3462fd2a-9828-45a3-962c-c9152ae851d9 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:34.699018 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3462fd2a-9828-45a3-962c-c9152ae851d9 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:34.703126 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3462fd2a-9828-45a3-962c-c9152ae851d9 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:34.704108 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3462fd2a-9828-45a3-962c-c9152ae851d9 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:34.707116 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3462fd2a-9828-45a3-962c-c9152ae851d9 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:34.709320 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3462fd2a-9828-45a3-962c-c9152ae851d9 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:34.711266 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3462fd2a-9828-45a3-962c-c9152ae851d9 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:35.018736 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-fa6b1bd1-fca0-4235-bc8c-ad92d6b0b7a5 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:35.019783 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-fa6b1bd1-fca0-4235-bc8c-ad92d6b0b7a5 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:35.031723 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fa6b1bd1-fca0-4235-bc8c-ad92d6b0b7a5 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:35.032521 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fa6b1bd1-fca0-4235-bc8c-ad92d6b0b7a5 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:35.034513 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fa6b1bd1-fca0-4235-bc8c-ad92d6b0b7a5 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:35.036627 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fa6b1bd1-fca0-4235-bc8c-ad92d6b0b7a5 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:35.037363 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fa6b1bd1-fca0-4235-bc8c-ad92d6b0b7a5 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:35.040117 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fa6b1bd1-fca0-4235-bc8c-ad92d6b0b7a5 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:35.232969 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3462fd2a-9828-45a3-962c-c9152ae851d9 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:35.245423 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3462fd2a-9828-45a3-962c-c9152ae851d9 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1504 microversion: 2.1 time: 0.592021 Aug 31 16:23:35.248408 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2623/5216] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:23:34 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1504 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:23:35.258046 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-851f9cb6-2d31-47b1-bb8d-14b27439d14a req-7f7767b0-9704-42e7-89d6-3461bc8071d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85a0286b-2e02-4ecb-a63d-0b4a61048ab5", "name": "network-vif-unplugged", "status": "completed", "tag": "b2e423e8-4d65-4e9c-90c7-27d4697688c2"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:23:35.300606 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-851f9cb6-2d31-47b1-bb8d-14b27439d14a req-7f7767b0-9704-42e7-89d6-3461bc8071d0 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:35.301477 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-851f9cb6-2d31-47b1-bb8d-14b27439d14a req-7f7767b0-9704-42e7-89d6-3461bc8071d0 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:35.302314 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-851f9cb6-2d31-47b1-bb8d-14b27439d14a req-7f7767b0-9704-42e7-89d6-3461bc8071d0 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:35.320047 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.compute.server_external_events [req-851f9cb6-2d31-47b1-bb8d-14b27439d14a req-7f7767b0-9704-42e7-89d6-3461bc8071d0 service nova] Unable to find a host for instance 85a0286b-2e02-4ecb-a63d-0b4a61048ab5. Dropping event network-vif-unplugged {{(pid=122257) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 31 16:23:35.321332 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-851f9cb6-2d31-47b1-bb8d-14b27439d14a req-7f7767b0-9704-42e7-89d6-3461bc8071d0 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.070174 Aug 31 16:23:35.322643 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2624/5217] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:23:35 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 72 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 31 16:23:35.421057 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7e20eaa3-e27a-4305-8f04-4e60d693464a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "networks": [{"uuid": "fa24e0ec-4a58-4400-9cf4-a0201375c33e"}]}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:23:35.433693 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7e20eaa3-e27a-4305-8f04-4e60d693464a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Request method failure captured: Aug 31 16:23:35.433693 n-d-850499-9 devstack@n-api.service[122257]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 31 16:23:35.433693 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:23:35.433693 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:23:35.433693 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:23:35.433693 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 416 Aug 31 16:23:35.433693 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:23:35.433693 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:23:35.433693 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:23:35.433693 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:23:35.433693 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4q2NcJzZutw3Y6jF4GnmJD1H1MzSLIbHjRxunPVSp6uKTRmCePfT1DyksG9QgDfSYnSoM0q9vOxO3sqZKoJ5PA2HppEXRHLLn8jTh4ccTKQ6q8SYb3pqui6kOFW5_PmtYr9N0lihJC0EStA4OYRI4QsHOxwmGiiVscbhBZpLyiKmV0 Aug 31 16:23:35.433693 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:23:35.433693 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:23:35.433693 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:23:35.433693 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:23:35.433693 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:23:35.433693 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:23:35.433693 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 014522b19dc349a691e1f6b131229974 Aug 31 16:23:35.433693 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:23:35.433693 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:23:35.433693 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:23:35.433693 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/014522b19dc349a691e1f6b131229974"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/014522b19dc349a691e1f6b131229974"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_014522b19dc349a691e1f6b131229974", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/014522b19dc349a691e1f6b131229974"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:23:35.433693 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:23:35.433693 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 014522b19dc349a691e1f6b131229974 Aug 31 16:23:35.433693 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:23:35.433693 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ServersNegativeTestJSON-918151355-project Aug 31 16:23:35.433693 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:23:35.433693 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:23:35.433693 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: c042c43cc2aa4000a147fae62c261e86 Aug 31 16:23:35.433693 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ServersNegativeTestJSON-918151355-project Aug 31 16:23:35.433693 n-d-850499-9 devstack@n-api.service[122257]: Aug 31 16:23:35.433693 n-d-850499-9 devstack@n-api.service[122257]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "networks": [{"uuid": "fa24e0ec-4a58-4400-9cf4-a0201375c33e"}]}} Aug 31 16:23:35.433693 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:23:35.433693 n-d-850499-9 devstack@n-api.service[122257]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 31 16:23:35.433693 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': 'b9c36d42-ed46-4bf5-ad18-1df45cbd0413', 'flavorRef': '452', 'networks': [{'uuid': 'fa24e0ec-4a58-4400-9cf4-a0201375c33e'}]}}} Aug 31 16:23:35.433693 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:23:35.433693 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:23:35.433693 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 16:23:35.433693 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 16:23:35.433693 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 16:23:35.433693 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise error Aug 31 16:23:35.433693 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 31 16:23:35.433693 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:23:35.433693 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Aug 31 16:23:35.433693 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 31 16:23:35.433693 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:23:35.433693 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 31 16:23:35.433693 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 31 16:23:35.433693 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:23:35.433693 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:23:35.441971 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:23:35.441971 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:23:35.441971 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:23:35.441971 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:23:35.441971 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:23:35.441971 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:23:35.441971 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:23:35.441971 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:23:35.441971 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:23:35.441971 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:23:35.441971 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 16:23:35.441971 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 16:23:35.441971 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 16:23:35.441971 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 16:23:35.441971 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 16:23:35.441971 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 16:23:35.441971 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 31 16:23:35.441971 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:23:35.441971 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:23:35.441971 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:23:35.441971 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:23:35.441971 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:23:35.441971 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:23:35.441971 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 16:23:35.441971 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 16:23:35.441971 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 31 16:23:35.441971 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:23:35.458608 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7e20eaa3-e27a-4305-8f04-4e60d693464a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:23:35.458608 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7e20eaa3-e27a-4305-8f04-4e60d693464a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.057708 Aug 31 16:23:35.458608 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2625/5218] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:23:35 2022] POST /compute/v2.1/servers => generated 619 bytes in 66 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:23:35.458608 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9e095505-b35e-4316-9533-b4312453fc6a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:35.471697 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9e095505-b35e-4316-9533-b4312453fc6a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:35.483251 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9e095505-b35e-4316-9533-b4312453fc6a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:35.484085 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9e095505-b35e-4316-9533-b4312453fc6a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:35.484807 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9e095505-b35e-4316-9533-b4312453fc6a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:35.486541 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9e095505-b35e-4316-9533-b4312453fc6a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:35.487380 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9e095505-b35e-4316-9533-b4312453fc6a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:35.488140 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9e095505-b35e-4316-9533-b4312453fc6a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:35.530802 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=100 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:23:35.825477 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9e095505-b35e-4316-9533-b4312453fc6a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:35.841823 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9e095505-b35e-4316-9533-b4312453fc6a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1504 microversion: 2.1 time: 0.389362 Aug 31 16:23:35.842489 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2626/5219] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:23:35 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1504 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:23:35.850925 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-fa6b1bd1-fca0-4235-bc8c-ad92d6b0b7a5 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:35.866469 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-fa6b1bd1-fca0-4235-bc8c-ad92d6b0b7a5 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:35.868496 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-fa6b1bd1-fca0-4235-bc8c-ad92d6b0b7a5 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:35.881619 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9ef81970-b13b-4cc4-81eb-1a52066117d8 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:35.881619 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9ef81970-b13b-4cc4-81eb-1a52066117d8 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:35.885304 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-fa6b1bd1-fca0-4235-bc8c-ad92d6b0b7a5 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5" status: 200 len: 1726 microversion: 2.20 time: 0.870908 Aug 31 16:23:35.893738 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2594/5220] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:23:35 2022] GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5 => generated 1726 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:23:35.898615 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9ef81970-b13b-4cc4-81eb-1a52066117d8 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:35.899550 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9ef81970-b13b-4cc4-81eb-1a52066117d8 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:35.900294 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9ef81970-b13b-4cc4-81eb-1a52066117d8 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:35.901300 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9ef81970-b13b-4cc4-81eb-1a52066117d8 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:35.902261 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9ef81970-b13b-4cc4-81eb-1a52066117d8 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:35.903175 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9ef81970-b13b-4cc4-81eb-1a52066117d8 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:35.970891 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f3d5811f-7a72-4208-b379-5c9eac272be8 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "db18a078-30aa-45c3-bdf2-7d82a3e5c081"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:23:35.982361 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f3d5811f-7a72-4208-b379-5c9eac272be8 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:36.012343 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f3d5811f-7a72-4208-b379-5c9eac272be8 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:36.014443 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f3d5811f-7a72-4208-b379-5c9eac272be8 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:36.015012 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f3d5811f-7a72-4208-b379-5c9eac272be8 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:36.019810 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f3d5811f-7a72-4208-b379-5c9eac272be8 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:36.020664 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f3d5811f-7a72-4208-b379-5c9eac272be8 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:36.021370 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f3d5811f-7a72-4208-b379-5c9eac272be8 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:36.565841 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9ef81970-b13b-4cc4-81eb-1a52066117d8 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:36.582015 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9ef81970-b13b-4cc4-81eb-1a52066117d8 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1504 microversion: 2.1 time: 0.708649 Aug 31 16:23:36.583035 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2627/5221] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:23:35 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1504 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:23:36.591153 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-83e835ec-bb41-4a68-887e-03801734c5f1 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:23:36.602713 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-83e835ec-bb41-4a68-887e-03801734c5f1 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:36.610927 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-83e835ec-bb41-4a68-887e-03801734c5f1 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:36.611847 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-83e835ec-bb41-4a68-887e-03801734c5f1 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:36.612724 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-83e835ec-bb41-4a68-887e-03801734c5f1 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:36.613987 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-83e835ec-bb41-4a68-887e-03801734c5f1 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:36.615108 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-83e835ec-bb41-4a68-887e-03801734c5f1 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:36.616031 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-83e835ec-bb41-4a68-887e-03801734c5f1 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:36.702575 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f3d5811f-7a72-4208-b379-5c9eac272be8 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "POST /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.747182 Aug 31 16:23:36.704014 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2595/5222] 10.222.0.61 () {62 vars in 1364 bytes} [Wed Aug 31 16:23:35 2022] POST /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5/os-volume_attachments => generated 188 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 16:23:36.722040 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-22e246fb-4d5e-4b71-a9b7-79a15e0cc038 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2049040337", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": -1, "networks": [{"uuid": "fa24e0ec-4a58-4400-9cf4-a0201375c33e"}]}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:23:36.777581 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-22e246fb-4d5e-4b71-a9b7-79a15e0cc038 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] HTTP exception thrown: Flavor -1 could not be found. Aug 31 16:23:36.787662 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-22e246fb-4d5e-4b71-a9b7-79a15e0cc038 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Request method failure captured: Aug 31 16:23:36.787662 n-d-850499-9 devstack@n-api.service[122256]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 31 16:23:36.787662 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:23:36.787662 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:23:36.787662 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:23:36.787662 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 206 Aug 31 16:23:36.787662 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:23:36.787662 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:23:36.787662 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:23:36.787662 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:23:36.787662 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4q2NcJzZutw3Y6jF4GnmJD1H1MzSLIbHjRxunPVSp6uKTRmCePfT1DyksG9QgDfSYnSoM0q9vOxO3sqZKoJ5PA2HppEXRHLLn8jTh4ccTKQ6q8SYb3pqui6kOFW5_PmtYr9N0lihJC0EStA4OYRI4QsHOxwmGiiVscbhBZpLyiKmV0 Aug 31 16:23:36.787662 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:23:36.787662 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:23:36.787662 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:23:36.787662 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:23:36.787662 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:23:36.787662 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:23:36.787662 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 014522b19dc349a691e1f6b131229974 Aug 31 16:23:36.787662 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:23:36.787662 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:23:36.787662 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:23:36.787662 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/014522b19dc349a691e1f6b131229974"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/014522b19dc349a691e1f6b131229974"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_014522b19dc349a691e1f6b131229974", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/014522b19dc349a691e1f6b131229974"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:23:36.787662 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:23:36.787662 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 014522b19dc349a691e1f6b131229974 Aug 31 16:23:36.787662 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:23:36.787662 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ServersNegativeTestJSON-918151355-project Aug 31 16:23:36.787662 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:23:36.787662 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:23:36.787662 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: c042c43cc2aa4000a147fae62c261e86 Aug 31 16:23:36.787662 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ServersNegativeTestJSON-918151355-project Aug 31 16:23:36.787662 n-d-850499-9 devstack@n-api.service[122256]: Aug 31 16:23:36.787662 n-d-850499-9 devstack@n-api.service[122256]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2049040337", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": -1, "networks": [{"uuid": "fa24e0ec-4a58-4400-9cf4-a0201375c33e"}]}} Aug 31 16:23:36.787662 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:23:36.787662 n-d-850499-9 devstack@n-api.service[122256]: exception: Flavor -1 could not be found. Aug 31 16:23:36.787662 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2049040337', 'imageRef': 'b9c36d42-ed46-4bf5-ad18-1df45cbd0413', 'flavorRef': -1, 'networks': [{'uuid': 'fa24e0ec-4a58-4400-9cf4-a0201375c33e'}]}}} Aug 31 16:23:36.787662 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:23:36.787662 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:23:36.787662 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Aug 31 16:23:36.787662 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Aug 31 16:23:36.787662 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 16:23:36.787662 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 16:23:36.787662 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 16:23:36.787662 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 16:23:36.787662 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 16:23:36.787662 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 16:23:36.787662 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 16:23:36.787662 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:23:36.787662 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 16:23:36.787662 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 16:23:36.787662 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Aug 31 16:23:36.787662 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:23:36.787662 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:23:36.787662 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:23:36.787662 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:23:36.787662 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:23:36.787662 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:23:36.787662 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:23:36.787662 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:23:36.787662 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:23:36.787662 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:23:36.787662 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:23:36.787662 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:23:36.797391 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:23:36.797391 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:23:36.797391 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:23:36.797391 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:23:36.797391 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 31 16:23:36.797391 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 31 16:23:36.797391 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 31 16:23:36.797391 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Aug 31 16:23:36.797391 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:23:36.797391 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:23:36.797391 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:23:36.797391 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:23:36.797391 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:23:36.797391 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:23:36.797391 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:23:36.797391 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:23:36.797391 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Aug 31 16:23:36.797391 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:23:36.802276 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-22e246fb-4d5e-4b71-a9b7-79a15e0cc038 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:23:36.803863 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-22e246fb-4d5e-4b71-a9b7-79a15e0cc038 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.098670 Aug 31 16:23:36.809736 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2596/5223] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:23:36 2022] POST /compute/v2.1/servers => generated 73 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 31 16:23:36.846303 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ae594aad-234e-44cb-a7e2-f09872ca46ea tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:36.848765 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ae594aad-234e-44cb-a7e2-f09872ca46ea tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:36.906091 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ae594aad-234e-44cb-a7e2-f09872ca46ea tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:36.906834 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ae594aad-234e-44cb-a7e2-f09872ca46ea tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:36.907443 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ae594aad-234e-44cb-a7e2-f09872ca46ea tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:36.913322 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ae594aad-234e-44cb-a7e2-f09872ca46ea tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:36.914611 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ae594aad-234e-44cb-a7e2-f09872ca46ea tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:36.916825 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ae594aad-234e-44cb-a7e2-f09872ca46ea tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:36.955670 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-83e835ec-bb41-4a68-887e-03801734c5f1 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "POST /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c/action" status: 202 len: 0 microversion: 2.1 time: 0.369994 Aug 31 16:23:36.961870 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2628/5224] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:23:36 2022] POST /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c/action => generated 0 bytes in 378 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:23:36.996143 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5ecd863c-12f1-4eb8-87ae-974ad209abcf tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:37.012054 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5ecd863c-12f1-4eb8-87ae-974ad209abcf tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:37.025409 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5ecd863c-12f1-4eb8-87ae-974ad209abcf tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:37.051601 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5ecd863c-12f1-4eb8-87ae-974ad209abcf tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:37.058534 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5ecd863c-12f1-4eb8-87ae-974ad209abcf tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:37.058534 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5ecd863c-12f1-4eb8-87ae-974ad209abcf tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:37.058534 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5ecd863c-12f1-4eb8-87ae-974ad209abcf tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:37.058534 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5ecd863c-12f1-4eb8-87ae-974ad209abcf tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:37.534764 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5ecd863c-12f1-4eb8-87ae-974ad209abcf tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:37.552066 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5ecd863c-12f1-4eb8-87ae-974ad209abcf tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1670 microversion: 2.1 time: 0.578677 Aug 31 16:23:37.556589 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2629/5225] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:23:36 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1670 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:23:37.569857 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4c2b2550-5c98-4ab7-ba39-03dc60fa1b97 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:23:37.573081 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4c2b2550-5c98-4ab7-ba39-03dc60fa1b97 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:37.592947 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ae594aad-234e-44cb-a7e2-f09872ca46ea tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:37.597591 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4c2b2550-5c98-4ab7-ba39-03dc60fa1b97 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:37.598239 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4c2b2550-5c98-4ab7-ba39-03dc60fa1b97 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:37.598774 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4c2b2550-5c98-4ab7-ba39-03dc60fa1b97 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:37.599958 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4c2b2550-5c98-4ab7-ba39-03dc60fa1b97 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:37.600644 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4c2b2550-5c98-4ab7-ba39-03dc60fa1b97 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:37.602228 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4c2b2550-5c98-4ab7-ba39-03dc60fa1b97 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:37.615268 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ae594aad-234e-44cb-a7e2-f09872ca46ea tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1504 microversion: 2.1 time: 0.800573 Aug 31 16:23:37.618015 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2597/5226] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:23:36 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1504 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:23:37.653940 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2e1d2c3d-3905-4393-81be-2122401b3f9e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:37.654995 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2e1d2c3d-3905-4393-81be-2122401b3f9e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:37.667290 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2e1d2c3d-3905-4393-81be-2122401b3f9e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:37.668263 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2e1d2c3d-3905-4393-81be-2122401b3f9e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:37.669150 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2e1d2c3d-3905-4393-81be-2122401b3f9e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:37.670135 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2e1d2c3d-3905-4393-81be-2122401b3f9e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:37.671439 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2e1d2c3d-3905-4393-81be-2122401b3f9e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:37.672153 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2e1d2c3d-3905-4393-81be-2122401b3f9e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:37.738307 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4c2b2550-5c98-4ab7-ba39-03dc60fa1b97 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122257) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 31 16:23:38.225728 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4c2b2550-5c98-4ab7-ba39-03dc60fa1b97 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "POST /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5/action" status: 202 len: 0 microversion: 2.20 time: 0.666477 Aug 31 16:23:38.231456 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2630/5227] 10.222.0.61 () {62 vars in 1319 bytes} [Wed Aug 31 16:23:37 2022] POST /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5/action => generated 0 bytes in 672 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:23:38.244429 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c639d5ad-a76b-4239-b336-5769c6ded7d0 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:38.246991 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c639d5ad-a76b-4239-b336-5769c6ded7d0 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:38.247161 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-2e1d2c3d-3905-4393-81be-2122401b3f9e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:38.275806 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c639d5ad-a76b-4239-b336-5769c6ded7d0 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:38.276504 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c639d5ad-a76b-4239-b336-5769c6ded7d0 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:38.278401 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2e1d2c3d-3905-4393-81be-2122401b3f9e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1504 microversion: 2.1 time: 0.632331 Aug 31 16:23:38.292660 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c639d5ad-a76b-4239-b336-5769c6ded7d0 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:38.293275 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2598/5228] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:23:37 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1504 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:23:38.293401 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c639d5ad-a76b-4239-b336-5769c6ded7d0 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:38.293401 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c639d5ad-a76b-4239-b336-5769c6ded7d0 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:38.293401 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c639d5ad-a76b-4239-b336-5769c6ded7d0 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:38.404272 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e0ec2bcd-5c57-4a74-a8f4-41f1e1de59d1 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-236872914", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "fa24e0ec-4a58-4400-9cf4-a0201375c33e"}]}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:23:38.414849 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e0ec2bcd-5c57-4a74-a8f4-41f1e1de59d1 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Request method failure captured: Aug 31 16:23:38.414849 n-d-850499-9 devstack@n-api.service[122256]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 31 16:23:38.414849 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:23:38.414849 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:23:38.414849 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:23:38.414849 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 172 Aug 31 16:23:38.414849 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:23:38.414849 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:23:38.414849 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:23:38.414849 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:23:38.414849 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4q2NcJzZutw3Y6jF4GnmJD1H1MzSLIbHjRxunPVSp6uKTRmCePfT1DyksG9QgDfSYnSoM0q9vOxO3sqZKoJ5PA2HppEXRHLLn8jTh4ccTKQ6q8SYb3pqui6kOFW5_PmtYr9N0lihJC0EStA4OYRI4QsHOxwmGiiVscbhBZpLyiKmV0 Aug 31 16:23:38.414849 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:23:38.414849 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:23:38.414849 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:23:38.414849 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:23:38.414849 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:23:38.414849 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:23:38.414849 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 014522b19dc349a691e1f6b131229974 Aug 31 16:23:38.414849 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:23:38.414849 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:23:38.414849 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:23:38.414849 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/014522b19dc349a691e1f6b131229974"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/014522b19dc349a691e1f6b131229974"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_014522b19dc349a691e1f6b131229974", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/014522b19dc349a691e1f6b131229974"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:23:38.414849 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:23:38.414849 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 014522b19dc349a691e1f6b131229974 Aug 31 16:23:38.414849 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:23:38.414849 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ServersNegativeTestJSON-918151355-project Aug 31 16:23:38.414849 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:23:38.414849 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:23:38.414849 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: c042c43cc2aa4000a147fae62c261e86 Aug 31 16:23:38.414849 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ServersNegativeTestJSON-918151355-project Aug 31 16:23:38.414849 n-d-850499-9 devstack@n-api.service[122256]: Aug 31 16:23:38.414849 n-d-850499-9 devstack@n-api.service[122256]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-236872914", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "fa24e0ec-4a58-4400-9cf4-a0201375c33e"}]}} Aug 31 16:23:38.414849 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:23:38.414849 n-d-850499-9 devstack@n-api.service[122256]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 31 16:23:38.414849 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-236872914', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': 'fa24e0ec-4a58-4400-9cf4-a0201375c33e'}]}}} Aug 31 16:23:38.414849 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:23:38.414849 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:23:38.414849 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 16:23:38.414849 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 16:23:38.414849 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 16:23:38.414849 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise error Aug 31 16:23:38.414849 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Aug 31 16:23:38.414849 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:23:38.414849 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Aug 31 16:23:38.414849 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Aug 31 16:23:38.414849 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Aug 31 16:23:38.414849 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:23:38.414849 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 31 16:23:38.414849 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi -1 Aug 31 16:23:38.414849 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:23:38.414849 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:23:38.414849 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:23:38.414849 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:23:38.414849 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:23:38.414849 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:23:38.414849 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:23:38.414849 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:23:38.414849 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:23:38.414849 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:23:38.414849 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:23:38.414849 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:23:38.414849 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 16:23:38.414849 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 16:23:38.414849 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 16:23:38.414849 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 16:23:38.424688 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 16:23:38.424688 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 16:23:38.424688 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 31 16:23:38.424688 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:23:38.424688 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:23:38.424688 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:23:38.424688 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:23:38.424688 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:23:38.424688 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:23:38.424688 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 16:23:38.424688 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 16:23:38.424688 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 31 16:23:38.424688 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:23:38.429593 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e0ec2bcd-5c57-4a74-a8f4-41f1e1de59d1 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:23:38.431885 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e0ec2bcd-5c57-4a74-a8f4-41f1e1de59d1 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.034055 Aug 31 16:23:38.433159 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2599/5229] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:23:38 2022] POST /compute/v2.1/servers => generated 145 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:23:38.441684 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8c948971-f0e0-4f73-a23a-0496656566cb tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:38.442715 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8c948971-f0e0-4f73-a23a-0496656566cb tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:38.453223 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8c948971-f0e0-4f73-a23a-0496656566cb tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:38.454024 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8c948971-f0e0-4f73-a23a-0496656566cb tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:38.454885 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8c948971-f0e0-4f73-a23a-0496656566cb tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:38.455987 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8c948971-f0e0-4f73-a23a-0496656566cb tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:38.456699 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8c948971-f0e0-4f73-a23a-0496656566cb tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:38.457382 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8c948971-f0e0-4f73-a23a-0496656566cb tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:38.746418 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c639d5ad-a76b-4239-b336-5769c6ded7d0 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:38.765815 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c639d5ad-a76b-4239-b336-5769c6ded7d0 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:38.769225 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c639d5ad-a76b-4239-b336-5769c6ded7d0 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:38.770867 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c639d5ad-a76b-4239-b336-5769c6ded7d0 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5" status: 200 len: 1752 microversion: 2.20 time: 0.538007 Aug 31 16:23:38.786875 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2631/5230] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:23:38 2022] GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5 => generated 1752 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:23:38.794138 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7489102e-8d1c-4813-9988-0dceabbd6a2e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:38.795359 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7489102e-8d1c-4813-9988-0dceabbd6a2e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:38.830655 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7489102e-8d1c-4813-9988-0dceabbd6a2e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:38.831694 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7489102e-8d1c-4813-9988-0dceabbd6a2e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:38.832834 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7489102e-8d1c-4813-9988-0dceabbd6a2e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:38.834638 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7489102e-8d1c-4813-9988-0dceabbd6a2e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:38.835450 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7489102e-8d1c-4813-9988-0dceabbd6a2e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:38.836315 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7489102e-8d1c-4813-9988-0dceabbd6a2e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:38.995880 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8c948971-f0e0-4f73-a23a-0496656566cb tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:39.005637 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8c948971-f0e0-4f73-a23a-0496656566cb tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1504 microversion: 2.1 time: 0.568445 Aug 31 16:23:39.006813 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2600/5231] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:23:38 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1504 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:23:39.029963 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-18d427af-e59a-4c81-b647-93d97ea0639b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:39.031167 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-18d427af-e59a-4c81-b647-93d97ea0639b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:39.047682 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-18d427af-e59a-4c81-b647-93d97ea0639b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:39.051168 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-18d427af-e59a-4c81-b647-93d97ea0639b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:39.052041 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-18d427af-e59a-4c81-b647-93d97ea0639b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:39.059523 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-18d427af-e59a-4c81-b647-93d97ea0639b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:39.060434 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-18d427af-e59a-4c81-b647-93d97ea0639b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:39.061212 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-18d427af-e59a-4c81-b647-93d97ea0639b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:39.767887 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7489102e-8d1c-4813-9988-0dceabbd6a2e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:39.785848 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7489102e-8d1c-4813-9988-0dceabbd6a2e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1670 microversion: 2.1 time: 0.997581 Aug 31 16:23:39.796804 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2632/5232] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:23:38 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1670 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:23:39.816387 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5c04b00a-6690-4fbc-842d-003321f2bc7b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:39.818809 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5c04b00a-6690-4fbc-842d-003321f2bc7b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:39.834891 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5c04b00a-6690-4fbc-842d-003321f2bc7b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:39.835408 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5c04b00a-6690-4fbc-842d-003321f2bc7b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:39.835890 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5c04b00a-6690-4fbc-842d-003321f2bc7b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:39.836626 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5c04b00a-6690-4fbc-842d-003321f2bc7b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:39.837087 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5c04b00a-6690-4fbc-842d-003321f2bc7b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:39.842897 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5c04b00a-6690-4fbc-842d-003321f2bc7b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:39.975809 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-18d427af-e59a-4c81-b647-93d97ea0639b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:39.997966 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-18d427af-e59a-4c81-b647-93d97ea0639b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1504 microversion: 2.1 time: 0.973284 Aug 31 16:23:39.998870 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2601/5233] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:23:39 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1504 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:23:40.266329 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b1d07743-50fc-46c5-ad72-bdc5e20d0831 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1522413117", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:23:40.272779 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-b1d07743-50fc-46c5-ad72-bdc5e20d0831 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 31 16:23:40.276029 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b1d07743-50fc-46c5-ad72-bdc5e20d0831 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Request method failure captured: Aug 31 16:23:40.276029 n-d-850499-9 devstack@n-api.service[122256]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 31 16:23:40.276029 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:23:40.276029 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:23:40.276029 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:23:40.276029 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 216 Aug 31 16:23:40.276029 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:23:40.276029 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:23:40.276029 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:23:40.276029 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:23:40.276029 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4q2NcJzZutw3Y6jF4GnmJD1H1MzSLIbHjRxunPVSp6uKTRmCePfT1DyksG9QgDfSYnSoM0q9vOxO3sqZKoJ5PA2HppEXRHLLn8jTh4ccTKQ6q8SYb3pqui6kOFW5_PmtYr9N0lihJC0EStA4OYRI4QsHOxwmGiiVscbhBZpLyiKmV0 Aug 31 16:23:40.276029 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:23:40.276029 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:23:40.276029 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:23:40.276029 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:23:40.276029 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:23:40.276029 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:23:40.276029 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 014522b19dc349a691e1f6b131229974 Aug 31 16:23:40.276029 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:23:40.276029 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:23:40.276029 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:23:40.276029 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/014522b19dc349a691e1f6b131229974"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/014522b19dc349a691e1f6b131229974"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_014522b19dc349a691e1f6b131229974", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/014522b19dc349a691e1f6b131229974"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:23:40.276029 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:23:40.276029 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 014522b19dc349a691e1f6b131229974 Aug 31 16:23:40.276029 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:23:40.276029 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ServersNegativeTestJSON-918151355-project Aug 31 16:23:40.276029 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:23:40.276029 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:23:40.276029 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: c042c43cc2aa4000a147fae62c261e86 Aug 31 16:23:40.276029 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ServersNegativeTestJSON-918151355-project Aug 31 16:23:40.276029 n-d-850499-9 devstack@n-api.service[122256]: Aug 31 16:23:40.276029 n-d-850499-9 devstack@n-api.service[122256]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1522413117", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Aug 31 16:23:40.276029 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:23:40.276029 n-d-850499-9 devstack@n-api.service[122256]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 31 16:23:40.276029 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1522413117', 'imageRef': 'b9c36d42-ed46-4bf5-ad18-1df45cbd0413', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Aug 31 16:23:40.276029 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:23:40.276029 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:23:40.276029 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:23:40.276029 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:23:40.276029 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:23:40.276029 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:23:40.276029 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:23:40.276029 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:23:40.276029 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:23:40.276029 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:23:40.276029 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:23:40.276029 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:23:40.276029 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:23:40.276029 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:23:40.276029 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 31 16:23:40.276029 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Aug 31 16:23:40.276029 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Aug 31 16:23:40.276029 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Aug 31 16:23:40.276029 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Aug 31 16:23:40.276029 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Aug 31 16:23:40.276029 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self._validate_network_id( Aug 31 16:23:40.276029 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Aug 31 16:23:40.276029 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 31 16:23:40.276029 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 31 16:23:40.276029 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:23:40.276029 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:23:40.276029 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:23:40.282031 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:23:40.282031 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:23:40.282031 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:23:40.282031 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:23:40.282031 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:23:40.282031 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 31 16:23:40.282031 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:23:40.286981 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b1d07743-50fc-46c5-ad72-bdc5e20d0831 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:23:40.288575 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b1d07743-50fc-46c5-ad72-bdc5e20d0831 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.027890 Aug 31 16:23:40.289687 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2602/5234] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:23:40 2022] POST /compute/v2.1/servers => generated 123 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:23:40.307421 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-48cf7f77-8f1a-40ce-a09f-f13dfb30c610 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:40.313164 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-48cf7f77-8f1a-40ce-a09f-f13dfb30c610 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:40.340848 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-48cf7f77-8f1a-40ce-a09f-f13dfb30c610 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:40.343593 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-48cf7f77-8f1a-40ce-a09f-f13dfb30c610 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:40.344076 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-48cf7f77-8f1a-40ce-a09f-f13dfb30c610 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:40.345496 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-48cf7f77-8f1a-40ce-a09f-f13dfb30c610 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:40.347835 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-48cf7f77-8f1a-40ce-a09f-f13dfb30c610 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:40.349378 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-48cf7f77-8f1a-40ce-a09f-f13dfb30c610 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:40.373295 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5c04b00a-6690-4fbc-842d-003321f2bc7b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:40.412485 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5c04b00a-6690-4fbc-842d-003321f2bc7b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:40.417973 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5c04b00a-6690-4fbc-842d-003321f2bc7b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:40.419939 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5c04b00a-6690-4fbc-842d-003321f2bc7b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5" status: 200 len: 1752 microversion: 2.20 time: 0.622990 Aug 31 16:23:40.421639 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2633/5235] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:23:39 2022] GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5 => generated 1752 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:23:40.797436 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-48cf7f77-8f1a-40ce-a09f-f13dfb30c610 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:40.820441 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-48cf7f77-8f1a-40ce-a09f-f13dfb30c610 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1504 microversion: 2.1 time: 0.516957 Aug 31 16:23:40.825684 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2603/5236] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:23:40 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1504 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:23:40.832542 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-10fccca7-c362-4d11-ac1b-7d98069a29ba tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:40.838158 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-10fccca7-c362-4d11-ac1b-7d98069a29ba tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:40.855729 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c61bf82d-f68f-4e6c-9d16-bef33e98bd4f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:40.857305 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c61bf82d-f68f-4e6c-9d16-bef33e98bd4f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:40.857811 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-10fccca7-c362-4d11-ac1b-7d98069a29ba tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:40.858387 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-10fccca7-c362-4d11-ac1b-7d98069a29ba tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:40.858899 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-10fccca7-c362-4d11-ac1b-7d98069a29ba tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:40.866882 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-10fccca7-c362-4d11-ac1b-7d98069a29ba tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:40.867799 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-10fccca7-c362-4d11-ac1b-7d98069a29ba tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:40.869440 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-10fccca7-c362-4d11-ac1b-7d98069a29ba tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:40.873271 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c61bf82d-f68f-4e6c-9d16-bef33e98bd4f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:40.873749 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c61bf82d-f68f-4e6c-9d16-bef33e98bd4f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:40.875712 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c61bf82d-f68f-4e6c-9d16-bef33e98bd4f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:40.877449 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c61bf82d-f68f-4e6c-9d16-bef33e98bd4f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:40.878176 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c61bf82d-f68f-4e6c-9d16-bef33e98bd4f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:40.880030 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c61bf82d-f68f-4e6c-9d16-bef33e98bd4f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:41.553997 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-10fccca7-c362-4d11-ac1b-7d98069a29ba tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:41.567813 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-10fccca7-c362-4d11-ac1b-7d98069a29ba tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1668 microversion: 2.1 time: 0.744012 Aug 31 16:23:41.581661 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2634/5237] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:23:40 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1668 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:23:41.598011 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-620fc43c-a4a0-42d8-b154-0e9c08d033a4 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:41.606151 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-620fc43c-a4a0-42d8-b154-0e9c08d033a4 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:41.618592 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-620fc43c-a4a0-42d8-b154-0e9c08d033a4 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:41.623016 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-620fc43c-a4a0-42d8-b154-0e9c08d033a4 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:41.623890 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-620fc43c-a4a0-42d8-b154-0e9c08d033a4 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:41.625210 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-620fc43c-a4a0-42d8-b154-0e9c08d033a4 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:41.628192 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-620fc43c-a4a0-42d8-b154-0e9c08d033a4 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:41.628986 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-620fc43c-a4a0-42d8-b154-0e9c08d033a4 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:41.716064 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c61bf82d-f68f-4e6c-9d16-bef33e98bd4f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:41.734916 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c61bf82d-f68f-4e6c-9d16-bef33e98bd4f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1504 microversion: 2.1 time: 0.878071 Aug 31 16:23:41.737524 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2604/5238] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:23:40 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1504 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:23:42.040196 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-856984da-6ab1-4ea0-9976-4c8241c4e239 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1060589753", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "key_name": "tempest-key-1827335653", "networks": [{"uuid": "fa24e0ec-4a58-4400-9cf4-a0201375c33e"}]}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:23:42.063490 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-620fc43c-a4a0-42d8-b154-0e9c08d033a4 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:42.078772 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-620fc43c-a4a0-42d8-b154-0e9c08d033a4 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:42.092480 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-620fc43c-a4a0-42d8-b154-0e9c08d033a4 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:42.097409 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-620fc43c-a4a0-42d8-b154-0e9c08d033a4 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5" status: 200 len: 1754 microversion: 2.20 time: 0.500580 Aug 31 16:23:42.098404 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2635/5239] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:23:41 2022] GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5 => generated 1754 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:23:42.178321 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-856984da-6ab1-4ea0-9976-4c8241c4e239 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] validate_networks() for [('fa24e0ec-4a58-4400-9cf4-a0201375c33e', None, None, None, None, None)] {{(pid=122256) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:23:43.127077 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e720d089-132c-457b-b16f-79dabec771a2 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:43.127977 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e720d089-132c-457b-b16f-79dabec771a2 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:43.132479 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-856984da-6ab1-4ea0-9976-4c8241c4e239 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] HTTP exception thrown: Invalid key_name provided. Aug 31 16:23:43.134489 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-856984da-6ab1-4ea0-9976-4c8241c4e239 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Request method failure captured: Aug 31 16:23:43.134489 n-d-850499-9 devstack@n-api.service[122256]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 31 16:23:43.134489 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:23:43.134489 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:23:43.134489 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:23:43.134489 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 247 Aug 31 16:23:43.134489 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:23:43.134489 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:23:43.134489 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:23:43.134489 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:23:43.134489 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4q2NcJzZutw3Y6jF4GnmJD1H1MzSLIbHjRxunPVSp6uKTRmCePfT1DyksG9QgDfSYnSoM0q9vOxO3sqZKoJ5PA2HppEXRHLLn8jTh4ccTKQ6q8SYb3pqui6kOFW5_PmtYr9N0lihJC0EStA4OYRI4QsHOxwmGiiVscbhBZpLyiKmV0 Aug 31 16:23:43.134489 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:23:43.134489 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:23:43.134489 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:23:43.134489 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:23:43.134489 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:23:43.134489 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:23:43.134489 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 014522b19dc349a691e1f6b131229974 Aug 31 16:23:43.134489 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:23:43.134489 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:23:43.134489 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:23:43.134489 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/014522b19dc349a691e1f6b131229974"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/014522b19dc349a691e1f6b131229974"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_014522b19dc349a691e1f6b131229974", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/014522b19dc349a691e1f6b131229974"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:23:43.134489 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:23:43.134489 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 014522b19dc349a691e1f6b131229974 Aug 31 16:23:43.134489 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:23:43.134489 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ServersNegativeTestJSON-918151355-project Aug 31 16:23:43.134489 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:23:43.134489 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:23:43.134489 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: c042c43cc2aa4000a147fae62c261e86 Aug 31 16:23:43.134489 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ServersNegativeTestJSON-918151355-project Aug 31 16:23:43.134489 n-d-850499-9 devstack@n-api.service[122256]: Aug 31 16:23:43.134489 n-d-850499-9 devstack@n-api.service[122256]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1060589753", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "key_name": "tempest-key-1827335653", "networks": [{"uuid": "fa24e0ec-4a58-4400-9cf4-a0201375c33e"}]}} Aug 31 16:23:43.134489 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:23:43.134489 n-d-850499-9 devstack@n-api.service[122256]: exception: Invalid key_name provided. Aug 31 16:23:43.134489 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1060589753', 'imageRef': 'b9c36d42-ed46-4bf5-ad18-1df45cbd0413', 'flavorRef': '452', 'key_name': 'tempest-key-1827335653', 'networks': [{'uuid': 'fa24e0ec-4a58-4400-9cf4-a0201375c33e'}]}}} Aug 31 16:23:43.134489 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:23:43.134489 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:23:43.134489 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 31 16:23:43.134489 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 31 16:23:43.134489 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 31 16:23:43.134489 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 31 16:23:43.134489 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Aug 31 16:23:43.134489 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 31 16:23:43.134489 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Aug 31 16:23:43.134489 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Aug 31 16:23:43.134489 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 16:23:43.134489 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 16:23:43.134489 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Aug 31 16:23:43.134489 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Aug 31 16:23:43.134489 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Aug 31 16:23:43.134489 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Aug 31 16:23:43.134489 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 31 16:23:43.134489 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 31 16:23:43.134489 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Aug 31 16:23:43.134489 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Aug 31 16:23:43.134489 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-1827335653 not found for user c042c43cc2aa4000a147fae62c261e86 Aug 31 16:23:43.134489 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:23:43.134489 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:23:43.134489 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:23:43.134489 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:23:43.134489 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:23:43.140511 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:23:43.140511 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:23:43.140511 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:23:43.140511 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:23:43.140511 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:23:43.140511 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:23:43.140511 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:23:43.140511 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:23:43.140511 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:23:43.140511 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:23:43.140511 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:23:43.140511 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 31 16:23:43.140511 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Aug 31 16:23:43.140511 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 31 16:23:43.140511 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Aug 31 16:23:43.140511 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:23:43.140511 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:23:43.140511 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:23:43.140511 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:23:43.140511 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:23:43.140511 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:23:43.140511 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:23:43.140511 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:23:43.140511 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Aug 31 16:23:43.140511 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:23:43.145654 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-856984da-6ab1-4ea0-9976-4c8241c4e239 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Returning 400 to user: Invalid key_name provided. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:23:43.147625 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-856984da-6ab1-4ea0-9976-4c8241c4e239 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 1.117534 Aug 31 16:23:43.151013 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e720d089-132c-457b-b16f-79dabec771a2 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:43.153351 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2605/5240] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:23:42 2022] POST /compute/v2.1/servers => generated 70 bytes in 1124 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 31 16:23:43.154084 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e720d089-132c-457b-b16f-79dabec771a2 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:43.154738 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e720d089-132c-457b-b16f-79dabec771a2 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:43.164308 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e720d089-132c-457b-b16f-79dabec771a2 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:43.166222 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e720d089-132c-457b-b16f-79dabec771a2 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:43.167057 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e720d089-132c-457b-b16f-79dabec771a2 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:43.185220 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-59e5a41c-0d4a-4218-a6e0-9855ad468978 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:43.187714 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-59e5a41c-0d4a-4218-a6e0-9855ad468978 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:43.210578 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-59e5a41c-0d4a-4218-a6e0-9855ad468978 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:43.211728 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-59e5a41c-0d4a-4218-a6e0-9855ad468978 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:43.212407 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-59e5a41c-0d4a-4218-a6e0-9855ad468978 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:43.213540 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-59e5a41c-0d4a-4218-a6e0-9855ad468978 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:43.218964 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-59e5a41c-0d4a-4218-a6e0-9855ad468978 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:43.220632 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-59e5a41c-0d4a-4218-a6e0-9855ad468978 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:43.270593 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:23:44.314886 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-59e5a41c-0d4a-4218-a6e0-9855ad468978 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:44.342592 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-59e5a41c-0d4a-4218-a6e0-9855ad468978 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1504 microversion: 2.1 time: 1.186422 Aug 31 16:23:44.343199 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2606/5241] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:23:43 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1504 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:23:44.355216 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e720d089-132c-457b-b16f-79dabec771a2 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:44.366700 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e720d089-132c-457b-b16f-79dabec771a2 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:44.378614 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1c2a5942-877c-47b5-b202-380fb788e18b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:44.379260 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1c2a5942-877c-47b5-b202-380fb788e18b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:44.379612 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e720d089-132c-457b-b16f-79dabec771a2 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:44.381117 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e720d089-132c-457b-b16f-79dabec771a2 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5" status: 200 len: 1754 microversion: 2.20 time: 1.258803 Aug 31 16:23:44.382743 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2636/5242] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:23:43 2022] GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5 => generated 1754 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:23:44.398480 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1c2a5942-877c-47b5-b202-380fb788e18b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:44.400262 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1c2a5942-877c-47b5-b202-380fb788e18b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:44.400763 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1c2a5942-877c-47b5-b202-380fb788e18b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:44.402902 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1c2a5942-877c-47b5-b202-380fb788e18b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:44.404957 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1c2a5942-877c-47b5-b202-380fb788e18b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:44.406566 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1c2a5942-877c-47b5-b202-380fb788e18b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:45.085600 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1c2a5942-877c-47b5-b202-380fb788e18b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:45.109409 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1c2a5942-877c-47b5-b202-380fb788e18b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1504 microversion: 2.1 time: 0.739464 Aug 31 16:23:45.110744 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2607/5243] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:23:44 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1504 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:23:45.336074 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-eed31106-3f54-4278-8d24-843bc4f4a7a4 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-265414242", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "fa24e0ec-4a58-4400-9cf4-a0201375c33e"}]}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:23:45.412521 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8309886b-d8de-4421-b749-ce6597e67808 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:45.413317 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8309886b-d8de-4421-b749-ce6597e67808 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:45.422214 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:23:45.428042 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=60 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:23:45.434691 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8309886b-d8de-4421-b749-ce6597e67808 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:45.435405 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8309886b-d8de-4421-b749-ce6597e67808 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:45.436074 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8309886b-d8de-4421-b749-ce6597e67808 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:45.437309 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8309886b-d8de-4421-b749-ce6597e67808 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:45.440203 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8309886b-d8de-4421-b749-ce6597e67808 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:45.444360 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8309886b-d8de-4421-b749-ce6597e67808 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:46.127823 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.security_group_api [None req-eed31106-3f54-4278-8d24-843bc4f4a7a4 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Neutron security group does_not_exist not found {{(pid=122257) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Aug 31 16:23:46.128646 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-eed31106-3f54-4278-8d24-843bc4f4a7a4 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Aug 31 16:23:46.137815 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-eed31106-3f54-4278-8d24-843bc4f4a7a4 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Request method failure captured: Aug 31 16:23:46.137815 n-d-850499-9 devstack@n-api.service[122257]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 31 16:23:46.137815 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:23:46.137815 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:23:46.137815 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:23:46.137815 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 257 Aug 31 16:23:46.137815 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:23:46.137815 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:23:46.137815 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:23:46.137815 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:23:46.137815 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4q2NcJzZutw3Y6jF4GnmJD1H1MzSLIbHjRxunPVSp6uKTRmCePfT1DyksG9QgDfSYnSoM0q9vOxO3sqZKoJ5PA2HppEXRHLLn8jTh4ccTKQ6q8SYb3pqui6kOFW5_PmtYr9N0lihJC0EStA4OYRI4QsHOxwmGiiVscbhBZpLyiKmV0 Aug 31 16:23:46.137815 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:23:46.137815 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:23:46.137815 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:23:46.137815 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:23:46.137815 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:23:46.137815 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:23:46.137815 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 014522b19dc349a691e1f6b131229974 Aug 31 16:23:46.137815 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:23:46.137815 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:23:46.137815 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:23:46.137815 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/014522b19dc349a691e1f6b131229974"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/014522b19dc349a691e1f6b131229974"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_014522b19dc349a691e1f6b131229974", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/014522b19dc349a691e1f6b131229974"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:23:46.137815 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:23:46.137815 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 014522b19dc349a691e1f6b131229974 Aug 31 16:23:46.137815 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:23:46.137815 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ServersNegativeTestJSON-918151355-project Aug 31 16:23:46.137815 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:23:46.137815 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:23:46.137815 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: c042c43cc2aa4000a147fae62c261e86 Aug 31 16:23:46.137815 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ServersNegativeTestJSON-918151355-project Aug 31 16:23:46.137815 n-d-850499-9 devstack@n-api.service[122257]: Aug 31 16:23:46.137815 n-d-850499-9 devstack@n-api.service[122257]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-265414242", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "fa24e0ec-4a58-4400-9cf4-a0201375c33e"}]}} Aug 31 16:23:46.137815 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:23:46.137815 n-d-850499-9 devstack@n-api.service[122257]: exception: Unable to find security_group with name or id 'does_not_exist' Aug 31 16:23:46.137815 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-265414242', 'imageRef': 'b9c36d42-ed46-4bf5-ad18-1df45cbd0413', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': 'fa24e0ec-4a58-4400-9cf4-a0201375c33e'}]}}} Aug 31 16:23:46.137815 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:23:46.137815 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:23:46.137815 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Aug 31 16:23:46.137815 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Aug 31 16:23:46.137815 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:23:46.137815 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:23:46.137815 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Aug 31 16:23:46.137815 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Aug 31 16:23:46.137815 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Aug 31 16:23:46.137815 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:23:46.137815 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:23:46.137815 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:23:46.137815 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:23:46.137815 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Aug 31 16:23:46.137815 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Aug 31 16:23:46.137815 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:23:46.137815 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:23:46.137815 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Aug 31 16:23:46.137815 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Aug 31 16:23:46.137815 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Aug 31 16:23:46.137815 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:23:46.137815 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:23:46.137815 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:23:46.137815 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:23:46.137815 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Aug 31 16:23:46.137815 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Aug 31 16:23:46.143485 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Aug 31 16:23:46.143485 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Aug 31 16:23:46.143485 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Aug 31 16:23:46.143485 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Aug 31 16:23:46.143485 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:23:46.143485 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:23:46.143485 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Aug 31 16:23:46.143485 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Aug 31 16:23:46.143485 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Aug 31 16:23:46.143485 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:23:46.143485 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:23:46.143485 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:23:46.143485 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:23:46.143485 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 31 16:23:46.143485 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 31 16:23:46.143485 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 31 16:23:46.143485 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 31 16:23:46.143485 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Aug 31 16:23:46.143485 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 31 16:23:46.143485 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Aug 31 16:23:46.143485 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Aug 31 16:23:46.143485 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Aug 31 16:23:46.143485 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Aug 31 16:23:46.143485 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Aug 31 16:23:46.143485 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 31 16:23:46.143485 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Aug 31 16:23:46.143485 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:23:46.143485 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:23:46.143485 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:23:46.143485 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:23:46.143485 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:23:46.143485 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:23:46.143485 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:23:46.143485 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:23:46.143485 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:23:46.143485 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:23:46.143485 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:23:46.143485 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:23:46.143485 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:23:46.143485 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:23:46.143485 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:23:46.143485 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:23:46.143485 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 31 16:23:46.143485 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 31 16:23:46.143485 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 31 16:23:46.143485 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Aug 31 16:23:46.143485 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:23:46.143485 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:23:46.143485 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:23:46.143485 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:23:46.143485 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:23:46.143485 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:23:46.143485 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:23:46.143485 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:23:46.143485 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Aug 31 16:23:46.143485 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:23:46.163213 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-eed31106-3f54-4278-8d24-843bc4f4a7a4 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:23:46.166809 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-eed31106-3f54-4278-8d24-843bc4f4a7a4 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.844254 Aug 31 16:23:46.173610 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2637/5244] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:23:45 2022] POST /compute/v2.1/servers => generated 106 bytes in 853 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:23:46.182431 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-17fd8e8a-46fe-4929-b992-b609a82d6587 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:46.185803 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-17fd8e8a-46fe-4929-b992-b609a82d6587 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:46.199575 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-17fd8e8a-46fe-4929-b992-b609a82d6587 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:46.202017 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-17fd8e8a-46fe-4929-b992-b609a82d6587 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:46.203237 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-17fd8e8a-46fe-4929-b992-b609a82d6587 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:46.208279 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-17fd8e8a-46fe-4929-b992-b609a82d6587 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:46.209664 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-17fd8e8a-46fe-4929-b992-b609a82d6587 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:46.210844 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-17fd8e8a-46fe-4929-b992-b609a82d6587 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:46.492309 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8309886b-d8de-4421-b749-ce6597e67808 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:46.507284 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8309886b-d8de-4421-b749-ce6597e67808 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:46.510732 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8309886b-d8de-4421-b749-ce6597e67808 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:46.513122 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8309886b-d8de-4421-b749-ce6597e67808 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5" status: 200 len: 1754 microversion: 2.20 time: 1.110149 Aug 31 16:23:46.516798 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2608/5245] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:23:45 2022] GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5 => generated 1754 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:23:46.710229 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-17fd8e8a-46fe-4929-b992-b609a82d6587 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:46.727766 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-17fd8e8a-46fe-4929-b992-b609a82d6587 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1504 microversion: 2.1 time: 0.552432 Aug 31 16:23:46.730007 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2638/5246] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:23:46 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1504 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:23:46.756636 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-db14a464-cecd-4fb2-a14d-2a66fdcda4ba tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:46.757790 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-db14a464-cecd-4fb2-a14d-2a66fdcda4ba tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:46.788903 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-db14a464-cecd-4fb2-a14d-2a66fdcda4ba tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:46.790210 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-db14a464-cecd-4fb2-a14d-2a66fdcda4ba tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:46.791232 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-db14a464-cecd-4fb2-a14d-2a66fdcda4ba tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:46.792458 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-db14a464-cecd-4fb2-a14d-2a66fdcda4ba tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:46.794580 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-db14a464-cecd-4fb2-a14d-2a66fdcda4ba tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:46.795587 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-db14a464-cecd-4fb2-a14d-2a66fdcda4ba tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:47.293211 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-db14a464-cecd-4fb2-a14d-2a66fdcda4ba tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:47.323622 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-db14a464-cecd-4fb2-a14d-2a66fdcda4ba tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1504 microversion: 2.1 time: 0.576764 Aug 31 16:23:47.335810 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2609/5247] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:23:46 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1504 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:23:47.353090 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-225ecf73-d6c5-4e8b-85a1-43c354f478b1 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:47.353325 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-225ecf73-d6c5-4e8b-85a1-43c354f478b1 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 950bc6d6-e16c-4518-ad55-155aacdbe00a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:47.359795 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-225ecf73-d6c5-4e8b-85a1-43c354f478b1 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] HTTP exception thrown: Instance 950bc6d6-e16c-4518-ad55-155aacdbe00a could not be found. Aug 31 16:23:47.368345 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-225ecf73-d6c5-4e8b-85a1-43c354f478b1 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Request method failure captured: Aug 31 16:23:47.368345 n-d-850499-9 devstack@n-api.service[122257]: request: DELETE /compute/v2.1/servers/950bc6d6-e16c-4518-ad55-155aacdbe00a HTTP/1.1 Aug 31 16:23:47.368345 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:23:47.368345 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:23:47.368345 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:23:47.368345 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:23:47.368345 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:23:47.368345 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:23:47.368345 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:23:47.368345 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:23:47.368345 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4q2NcJzZutw3Y6jF4GnmJD1H1MzSLIbHjRxunPVSp6uKTRmCePfT1DyksG9QgDfSYnSoM0q9vOxO3sqZKoJ5PA2HppEXRHLLn8jTh4ccTKQ6q8SYb3pqui6kOFW5_PmtYr9N0lihJC0EStA4OYRI4QsHOxwmGiiVscbhBZpLyiKmV0 Aug 31 16:23:47.368345 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:23:47.368345 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:23:47.368345 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:23:47.368345 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:23:47.368345 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:23:47.368345 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:23:47.368345 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 014522b19dc349a691e1f6b131229974 Aug 31 16:23:47.368345 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:23:47.368345 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:23:47.368345 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:23:47.368345 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/014522b19dc349a691e1f6b131229974"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/014522b19dc349a691e1f6b131229974"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_014522b19dc349a691e1f6b131229974", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/014522b19dc349a691e1f6b131229974"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:23:47.368345 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:23:47.368345 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 014522b19dc349a691e1f6b131229974 Aug 31 16:23:47.368345 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:23:47.368345 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ServersNegativeTestJSON-918151355-project Aug 31 16:23:47.368345 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:23:47.368345 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:23:47.368345 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: c042c43cc2aa4000a147fae62c261e86 Aug 31 16:23:47.368345 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ServersNegativeTestJSON-918151355-project Aug 31 16:23:47.368345 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:23:47.368345 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance 950bc6d6-e16c-4518-ad55-155aacdbe00a could not be found. Aug 31 16:23:47.368345 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '950bc6d6-e16c-4518-ad55-155aacdbe00a'} Aug 31 16:23:47.368345 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:23:47.368345 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:23:47.368345 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:23:47.368345 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:23:47.368345 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:23:47.368345 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:23:47.368345 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 31 16:23:47.368345 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 31 16:23:47.368345 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 950bc6d6-e16c-4518-ad55-155aacdbe00a could not be found. Aug 31 16:23:47.368345 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:23:47.368345 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:23:47.368345 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:23:47.368345 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:23:47.368345 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:23:47.368345 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:23:47.368345 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:23:47.368345 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:23:47.368345 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:23:47.368345 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:23:47.368345 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:23:47.368345 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:23:47.368345 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:23:47.368345 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:23:47.368345 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:23:47.368345 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:23:47.368345 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:23:47.368345 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:23:47.368345 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 950bc6d6-e16c-4518-ad55-155aacdbe00a could not be found. Aug 31 16:23:47.368345 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:23:47.368345 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:23:47.372623 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:23:47.372623 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:23:47.372623 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:23:47.372623 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:23:47.372623 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:23:47.372623 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:23:47.372623 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 950bc6d6-e16c-4518-ad55-155aacdbe00a could not be found. Aug 31 16:23:47.372623 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:23:47.372623 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-225ecf73-d6c5-4e8b-85a1-43c354f478b1 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Returning 404 to user: Instance 950bc6d6-e16c-4518-ad55-155aacdbe00a could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:23:47.375406 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-225ecf73-d6c5-4e8b-85a1-43c354f478b1 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "DELETE /compute/v2.1/servers/950bc6d6-e16c-4518-ad55-155aacdbe00a" status: 404 len: 111 microversion: 2.1 time: 0.022283 Aug 31 16:23:47.380231 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2639/5248] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:23:47 2022] DELETE /compute/v2.1/servers/950bc6d6-e16c-4518-ad55-155aacdbe00a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:23:47.410592 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-423949b1-b5e3-4328-8154-b6ec2f40a8cb tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:47.410592 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-423949b1-b5e3-4328-8154-b6ec2f40a8cb tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:47.429986 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-423949b1-b5e3-4328-8154-b6ec2f40a8cb tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:47.430498 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-423949b1-b5e3-4328-8154-b6ec2f40a8cb tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:47.430940 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-423949b1-b5e3-4328-8154-b6ec2f40a8cb tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:47.431711 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-423949b1-b5e3-4328-8154-b6ec2f40a8cb tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:47.432175 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-423949b1-b5e3-4328-8154-b6ec2f40a8cb tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:47.432607 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-423949b1-b5e3-4328-8154-b6ec2f40a8cb tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:47.540076 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-dc21160d-01b8-438f-91d3-724e3e41c2e9 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:47.541134 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-dc21160d-01b8-438f-91d3-724e3e41c2e9 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:47.565444 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dc21160d-01b8-438f-91d3-724e3e41c2e9 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:47.566638 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dc21160d-01b8-438f-91d3-724e3e41c2e9 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:47.567946 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dc21160d-01b8-438f-91d3-724e3e41c2e9 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:47.568901 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dc21160d-01b8-438f-91d3-724e3e41c2e9 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:47.569837 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dc21160d-01b8-438f-91d3-724e3e41c2e9 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:47.570826 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dc21160d-01b8-438f-91d3-724e3e41c2e9 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:48.306691 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-dc21160d-01b8-438f-91d3-724e3e41c2e9 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:48.321250 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-dc21160d-01b8-438f-91d3-724e3e41c2e9 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:48.333096 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-dc21160d-01b8-438f-91d3-724e3e41c2e9 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:48.339221 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-dc21160d-01b8-438f-91d3-724e3e41c2e9 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5" status: 200 len: 1754 microversion: 2.20 time: 0.803268 Aug 31 16:23:48.343921 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2640/5249] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:23:47 2022] GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5 => generated 1754 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:23:48.381710 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-423949b1-b5e3-4328-8154-b6ec2f40a8cb tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:48.432794 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-423949b1-b5e3-4328-8154-b6ec2f40a8cb tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1504 microversion: 2.1 time: 1.050058 Aug 31 16:23:48.434917 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2610/5250] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:23:47 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1504 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:23:48.471185 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d59e6c39-d138-4667-92aa-44de5bb76986 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:48.484420 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d59e6c39-d138-4667-92aa-44de5bb76986 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:48.492092 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d59e6c39-d138-4667-92aa-44de5bb76986 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:48.492587 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d59e6c39-d138-4667-92aa-44de5bb76986 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:48.493218 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d59e6c39-d138-4667-92aa-44de5bb76986 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:48.494191 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d59e6c39-d138-4667-92aa-44de5bb76986 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:48.494829 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d59e6c39-d138-4667-92aa-44de5bb76986 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:48.495551 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d59e6c39-d138-4667-92aa-44de5bb76986 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:49.040600 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d59e6c39-d138-4667-92aa-44de5bb76986 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:49.064577 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d59e6c39-d138-4667-92aa-44de5bb76986 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1504 microversion: 2.1 time: 0.598786 Aug 31 16:23:49.069797 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2641/5251] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:23:48 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1504 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:23:49.115423 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-fc846077-4357-4c0d-ba9d-7051f7c58b21 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:49.119026 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-fc846077-4357-4c0d-ba9d-7051f7c58b21 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Failed to fetch instance by id 9223372036854775808 {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 31 16:23:49.119907 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-fc846077-4357-4c0d-ba9d-7051f7c58b21 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Aug 31 16:23:49.122188 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-fc846077-4357-4c0d-ba9d-7051f7c58b21 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Request method failure captured: Aug 31 16:23:49.122188 n-d-850499-9 devstack@n-api.service[122256]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Aug 31 16:23:49.122188 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:23:49.122188 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:23:49.122188 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:23:49.122188 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:23:49.122188 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:23:49.122188 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:23:49.122188 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:23:49.122188 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:23:49.122188 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4q2NcJzZutw3Y6jF4GnmJD1H1MzSLIbHjRxunPVSp6uKTRmCePfT1DyksG9QgDfSYnSoM0q9vOxO3sqZKoJ5PA2HppEXRHLLn8jTh4ccTKQ6q8SYb3pqui6kOFW5_PmtYr9N0lihJC0EStA4OYRI4QsHOxwmGiiVscbhBZpLyiKmV0 Aug 31 16:23:49.122188 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:23:49.122188 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:23:49.122188 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:23:49.122188 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:23:49.122188 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:23:49.122188 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:23:49.122188 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 014522b19dc349a691e1f6b131229974 Aug 31 16:23:49.122188 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:23:49.122188 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:23:49.122188 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:23:49.122188 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/014522b19dc349a691e1f6b131229974"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/014522b19dc349a691e1f6b131229974"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_014522b19dc349a691e1f6b131229974", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/014522b19dc349a691e1f6b131229974"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:23:49.122188 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:23:49.122188 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 014522b19dc349a691e1f6b131229974 Aug 31 16:23:49.122188 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:23:49.122188 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ServersNegativeTestJSON-918151355-project Aug 31 16:23:49.122188 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:23:49.122188 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:23:49.122188 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: c042c43cc2aa4000a147fae62c261e86 Aug 31 16:23:49.122188 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ServersNegativeTestJSON-918151355-project Aug 31 16:23:49.122188 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:23:49.122188 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance 9223372036854775808 could not be found. Aug 31 16:23:49.122188 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '9223372036854775808'} Aug 31 16:23:49.122188 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:23:49.122188 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:23:49.122188 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:23:49.122188 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:23:49.122188 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 31 16:23:49.122188 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 31 16:23:49.122188 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Aug 31 16:23:49.122188 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:23:49.122188 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:23:49.122188 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:23:49.122188 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:23:49.122188 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:23:49.122188 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:23:49.122188 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:23:49.122188 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:23:49.122188 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:23:49.122188 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:23:49.122188 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:23:49.122188 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:23:49.122188 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:23:49.122188 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:23:49.122188 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:23:49.122188 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:23:49.122188 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:23:49.122188 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:23:49.122188 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Aug 31 16:23:49.122188 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:23:49.122188 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:23:49.122188 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:23:49.122188 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:23:49.122188 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:23:49.128030 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:23:49.128030 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:23:49.128030 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:23:49.128030 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Aug 31 16:23:49.128030 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:23:49.129623 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-fc846077-4357-4c0d-ba9d-7051f7c58b21 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:23:49.130966 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-fc846077-4357-4c0d-ba9d-7051f7c58b21 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.032758 Aug 31 16:23:49.132097 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2611/5252] 10.222.0.61 () {58 vars in 1188 bytes} [Wed Aug 31 16:23:49 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 31 16:23:49.140297 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0ce5ffb6-3d96-4b5b-98eb-8df40c7d9039 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:49.140871 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0ce5ffb6-3d96-4b5b-98eb-8df40c7d9039 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:49.154138 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0ce5ffb6-3d96-4b5b-98eb-8df40c7d9039 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:49.154650 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0ce5ffb6-3d96-4b5b-98eb-8df40c7d9039 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:49.155103 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0ce5ffb6-3d96-4b5b-98eb-8df40c7d9039 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:49.159830 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0ce5ffb6-3d96-4b5b-98eb-8df40c7d9039 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:49.160487 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0ce5ffb6-3d96-4b5b-98eb-8df40c7d9039 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:49.160946 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0ce5ffb6-3d96-4b5b-98eb-8df40c7d9039 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:49.378892 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8e733ae1-135c-4260-b9c8-72d9f6c9fdc3 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:49.379977 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8e733ae1-135c-4260-b9c8-72d9f6c9fdc3 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:49.388619 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8e733ae1-135c-4260-b9c8-72d9f6c9fdc3 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:49.390954 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8e733ae1-135c-4260-b9c8-72d9f6c9fdc3 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:49.393840 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8e733ae1-135c-4260-b9c8-72d9f6c9fdc3 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:49.395042 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8e733ae1-135c-4260-b9c8-72d9f6c9fdc3 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:49.395884 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8e733ae1-135c-4260-b9c8-72d9f6c9fdc3 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:49.400038 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8e733ae1-135c-4260-b9c8-72d9f6c9fdc3 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:50.488804 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0ce5ffb6-3d96-4b5b-98eb-8df40c7d9039 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:50.502650 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0ce5ffb6-3d96-4b5b-98eb-8df40c7d9039 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1504 microversion: 2.1 time: 1.366143 Aug 31 16:23:50.520823 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2642/5253] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:23:49 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1504 bytes in 1385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:23:50.553333 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-247f46d3-348f-497f-8507-dbbf5a90f572 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:50.555084 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-247f46d3-348f-497f-8507-dbbf5a90f572 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:50.566657 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8e733ae1-135c-4260-b9c8-72d9f6c9fdc3 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:50.590185 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-247f46d3-348f-497f-8507-dbbf5a90f572 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:50.593131 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-247f46d3-348f-497f-8507-dbbf5a90f572 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:50.597528 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-247f46d3-348f-497f-8507-dbbf5a90f572 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:50.599433 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-247f46d3-348f-497f-8507-dbbf5a90f572 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:50.601136 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8e733ae1-135c-4260-b9c8-72d9f6c9fdc3 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:50.604192 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8e733ae1-135c-4260-b9c8-72d9f6c9fdc3 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:50.607961 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8e733ae1-135c-4260-b9c8-72d9f6c9fdc3 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5" status: 200 len: 1754 microversion: 2.20 time: 1.233559 Aug 31 16:23:50.612137 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2612/5254] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:23:49 2022] GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5 => generated 1754 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:23:50.628687 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-247f46d3-348f-497f-8507-dbbf5a90f572 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:50.632403 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-247f46d3-348f-497f-8507-dbbf5a90f572 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:50.667477 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:23:51.055835 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-247f46d3-348f-497f-8507-dbbf5a90f572 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:51.074979 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-247f46d3-348f-497f-8507-dbbf5a90f572 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1504 microversion: 2.1 time: 0.547025 Aug 31 16:23:51.077229 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2643/5255] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:23:50 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1504 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:23:51.116246 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-49316df3-40c2-4f3d-8b2b-7ab7f8c72543 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:51.117246 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-49316df3-40c2-4f3d-8b2b-7ab7f8c72543 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Failed to fetch instance by id -1 {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 31 16:23:51.118239 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-49316df3-40c2-4f3d-8b2b-7ab7f8c72543 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] HTTP exception thrown: Instance -1 could not be found. Aug 31 16:23:51.120434 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-49316df3-40c2-4f3d-8b2b-7ab7f8c72543 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Request method failure captured: Aug 31 16:23:51.120434 n-d-850499-9 devstack@n-api.service[122256]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Aug 31 16:23:51.120434 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:23:51.120434 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:23:51.120434 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:23:51.120434 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:23:51.120434 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:23:51.120434 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:23:51.120434 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:23:51.120434 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:23:51.120434 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4q2NcJzZutw3Y6jF4GnmJD1H1MzSLIbHjRxunPVSp6uKTRmCePfT1DyksG9QgDfSYnSoM0q9vOxO3sqZKoJ5PA2HppEXRHLLn8jTh4ccTKQ6q8SYb3pqui6kOFW5_PmtYr9N0lihJC0EStA4OYRI4QsHOxwmGiiVscbhBZpLyiKmV0 Aug 31 16:23:51.120434 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:23:51.120434 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:23:51.120434 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:23:51.120434 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:23:51.120434 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:23:51.120434 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:23:51.120434 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 014522b19dc349a691e1f6b131229974 Aug 31 16:23:51.120434 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:23:51.120434 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:23:51.120434 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:23:51.120434 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/014522b19dc349a691e1f6b131229974"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/014522b19dc349a691e1f6b131229974"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_014522b19dc349a691e1f6b131229974", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/014522b19dc349a691e1f6b131229974"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:23:51.120434 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:23:51.120434 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 014522b19dc349a691e1f6b131229974 Aug 31 16:23:51.120434 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:23:51.120434 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ServersNegativeTestJSON-918151355-project Aug 31 16:23:51.120434 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:23:51.120434 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:23:51.120434 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: c042c43cc2aa4000a147fae62c261e86 Aug 31 16:23:51.120434 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ServersNegativeTestJSON-918151355-project Aug 31 16:23:51.120434 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:23:51.120434 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance -1 could not be found. Aug 31 16:23:51.120434 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '-1'} Aug 31 16:23:51.120434 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:23:51.120434 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:23:51.120434 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:23:51.120434 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:23:51.120434 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 31 16:23:51.120434 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 31 16:23:51.120434 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Aug 31 16:23:51.120434 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:23:51.120434 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:23:51.120434 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:23:51.120434 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:23:51.120434 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:23:51.120434 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:23:51.120434 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:23:51.120434 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:23:51.120434 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:23:51.120434 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:23:51.120434 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:23:51.120434 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:23:51.120434 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:23:51.120434 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:23:51.120434 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:23:51.120434 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:23:51.120434 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:23:51.120434 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:23:51.120434 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Aug 31 16:23:51.120434 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:23:51.120434 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:23:51.120434 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:23:51.120434 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:23:51.120434 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:23:51.120434 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:23:51.125481 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:23:51.125481 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:23:51.125481 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Aug 31 16:23:51.125481 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:23:51.130218 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-49316df3-40c2-4f3d-8b2b-7ab7f8c72543 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Returning 404 to user: Instance -1 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:23:51.134631 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-49316df3-40c2-4f3d-8b2b-7ab7f8c72543 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.023388 Aug 31 16:23:51.139817 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2613/5256] 10.222.0.61 () {58 vars in 1137 bytes} [Wed Aug 31 16:23:51 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 31 16:23:51.152919 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5042f786-83fe-4f86-accb-def9e4f5d1a7 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:51.154169 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5042f786-83fe-4f86-accb-def9e4f5d1a7 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:51.173830 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5042f786-83fe-4f86-accb-def9e4f5d1a7 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:51.174344 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5042f786-83fe-4f86-accb-def9e4f5d1a7 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:51.174909 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5042f786-83fe-4f86-accb-def9e4f5d1a7 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:51.176197 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5042f786-83fe-4f86-accb-def9e4f5d1a7 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:51.177051 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5042f786-83fe-4f86-accb-def9e4f5d1a7 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:51.178683 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5042f786-83fe-4f86-accb-def9e4f5d1a7 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:51.557995 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5042f786-83fe-4f86-accb-def9e4f5d1a7 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:51.576538 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5042f786-83fe-4f86-accb-def9e4f5d1a7 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1504 microversion: 2.1 time: 0.431350 Aug 31 16:23:51.578758 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2644/5257] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:23:51 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1504 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:23:51.614491 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-907a47e1-d899-4fe8-8e6f-c3f4848b056d tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:51.615281 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-907a47e1-d899-4fe8-8e6f-c3f4848b056d tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:51.635525 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-907a47e1-d899-4fe8-8e6f-c3f4848b056d tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:51.636202 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-907a47e1-d899-4fe8-8e6f-c3f4848b056d tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:51.636751 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-907a47e1-d899-4fe8-8e6f-c3f4848b056d tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:51.637973 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-907a47e1-d899-4fe8-8e6f-c3f4848b056d tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:51.638552 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-907a47e1-d899-4fe8-8e6f-c3f4848b056d tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:51.639143 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-907a47e1-d899-4fe8-8e6f-c3f4848b056d tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:51.654456 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2edc6f58-4f23-41f5-87fb-5e0a8552ffa6 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:51.655236 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2edc6f58-4f23-41f5-87fb-5e0a8552ffa6 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:51.682937 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2edc6f58-4f23-41f5-87fb-5e0a8552ffa6 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:51.686162 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2edc6f58-4f23-41f5-87fb-5e0a8552ffa6 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:51.689800 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2edc6f58-4f23-41f5-87fb-5e0a8552ffa6 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:51.693496 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2edc6f58-4f23-41f5-87fb-5e0a8552ffa6 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:51.697007 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2edc6f58-4f23-41f5-87fb-5e0a8552ffa6 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:51.699150 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2edc6f58-4f23-41f5-87fb-5e0a8552ffa6 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:52.385860 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-907a47e1-d899-4fe8-8e6f-c3f4848b056d tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:52.390224 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2edc6f58-4f23-41f5-87fb-5e0a8552ffa6 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:52.412828 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-907a47e1-d899-4fe8-8e6f-c3f4848b056d tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1504 microversion: 2.1 time: 0.801146 Aug 31 16:23:52.414257 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2614/5258] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:23:51 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1504 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:23:52.415636 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2edc6f58-4f23-41f5-87fb-5e0a8552ffa6 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:52.417456 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2edc6f58-4f23-41f5-87fb-5e0a8552ffa6 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:52.418923 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2edc6f58-4f23-41f5-87fb-5e0a8552ffa6 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5" status: 200 len: 1754 microversion: 2.20 time: 0.770095 Aug 31 16:23:52.436365 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2645/5259] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:23:51 2022] GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5 => generated 1754 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:23:52.456269 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e063a98f-4d8b-4e46-8288-12596fd8ebfc tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:23:52.457091 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e063a98f-4d8b-4e46-8288-12596fd8ebfc tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: b3c0e19d-2ac5-484e-9b57-fa18de103bc3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:52.464249 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-e063a98f-4d8b-4e46-8288-12596fd8ebfc tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] HTTP exception thrown: Instance b3c0e19d-2ac5-484e-9b57-fa18de103bc3 could not be found. Aug 31 16:23:52.480191 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e063a98f-4d8b-4e46-8288-12596fd8ebfc tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Request method failure captured: Aug 31 16:23:52.480191 n-d-850499-9 devstack@n-api.service[122256]: request: POST /compute/v2.1/servers/b3c0e19d-2ac5-484e-9b57-fa18de103bc3/action HTTP/1.1 Aug 31 16:23:52.480191 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:23:52.480191 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:23:52.480191 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:23:52.480191 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 19 Aug 31 16:23:52.480191 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:23:52.480191 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:23:52.480191 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:23:52.480191 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:23:52.480191 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4q2NcJzZutw3Y6jF4GnmJD1H1MzSLIbHjRxunPVSp6uKTRmCePfT1DyksG9QgDfSYnSoM0q9vOxO3sqZKoJ5PA2HppEXRHLLn8jTh4ccTKQ6q8SYb3pqui6kOFW5_PmtYr9N0lihJC0EStA4OYRI4QsHOxwmGiiVscbhBZpLyiKmV0 Aug 31 16:23:52.480191 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:23:52.480191 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:23:52.480191 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:23:52.480191 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:23:52.480191 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:23:52.480191 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:23:52.480191 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 014522b19dc349a691e1f6b131229974 Aug 31 16:23:52.480191 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:23:52.480191 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:23:52.480191 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:23:52.480191 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/014522b19dc349a691e1f6b131229974"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/014522b19dc349a691e1f6b131229974"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_014522b19dc349a691e1f6b131229974", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/014522b19dc349a691e1f6b131229974"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:23:52.480191 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:23:52.480191 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 014522b19dc349a691e1f6b131229974 Aug 31 16:23:52.480191 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:23:52.480191 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ServersNegativeTestJSON-918151355-project Aug 31 16:23:52.480191 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:23:52.480191 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:23:52.480191 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: c042c43cc2aa4000a147fae62c261e86 Aug 31 16:23:52.480191 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ServersNegativeTestJSON-918151355-project Aug 31 16:23:52.480191 n-d-850499-9 devstack@n-api.service[122256]: Aug 31 16:23:52.480191 n-d-850499-9 devstack@n-api.service[122256]: {"forceDelete": {}} Aug 31 16:23:52.480191 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:23:52.480191 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance b3c0e19d-2ac5-484e-9b57-fa18de103bc3 could not be found. Aug 31 16:23:52.480191 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': 'b3c0e19d-2ac5-484e-9b57-fa18de103bc3', 'body': {'forceDelete': {}}} Aug 31 16:23:52.480191 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:23:52.480191 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:23:52.480191 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:23:52.480191 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:23:52.480191 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:23:52.480191 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:23:52.480191 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 31 16:23:52.480191 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 31 16:23:52.480191 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3c0e19d-2ac5-484e-9b57-fa18de103bc3 could not be found. Aug 31 16:23:52.480191 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:23:52.480191 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:23:52.480191 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:23:52.480191 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:23:52.480191 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:23:52.480191 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:23:52.480191 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:23:52.480191 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:23:52.480191 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:23:52.480191 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:23:52.480191 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Aug 31 16:23:52.480191 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 31 16:23:52.480191 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:23:52.480191 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:23:52.480191 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3c0e19d-2ac5-484e-9b57-fa18de103bc3 could not be found. Aug 31 16:23:52.480191 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:23:52.480191 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:23:52.480191 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:23:52.480191 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:23:52.480191 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:23:52.480191 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:23:52.484494 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:23:52.484494 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:23:52.484494 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3c0e19d-2ac5-484e-9b57-fa18de103bc3 could not be found. Aug 31 16:23:52.484494 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:23:52.484494 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e063a98f-4d8b-4e46-8288-12596fd8ebfc tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Returning 404 to user: Instance b3c0e19d-2ac5-484e-9b57-fa18de103bc3 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:23:52.484494 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e063a98f-4d8b-4e46-8288-12596fd8ebfc tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "POST /compute/v2.1/servers/b3c0e19d-2ac5-484e-9b57-fa18de103bc3/action" status: 404 len: 111 microversion: 2.1 time: 0.039070 Aug 31 16:23:52.484997 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2615/5260] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:23:52 2022] POST /compute/v2.1/servers/b3c0e19d-2ac5-484e-9b57-fa18de103bc3/action => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 16:23:52.495052 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8b490b97-b7ac-4e5c-a1dc-8f1650e3827a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:52.495706 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8b490b97-b7ac-4e5c-a1dc-8f1650e3827a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:52.512687 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b490b97-b7ac-4e5c-a1dc-8f1650e3827a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:52.513355 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b490b97-b7ac-4e5c-a1dc-8f1650e3827a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:52.518203 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b490b97-b7ac-4e5c-a1dc-8f1650e3827a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:52.520378 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b490b97-b7ac-4e5c-a1dc-8f1650e3827a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:52.533642 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b490b97-b7ac-4e5c-a1dc-8f1650e3827a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:52.536623 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b490b97-b7ac-4e5c-a1dc-8f1650e3827a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:52.840219 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8b490b97-b7ac-4e5c-a1dc-8f1650e3827a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:52.866093 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8b490b97-b7ac-4e5c-a1dc-8f1650e3827a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1504 microversion: 2.1 time: 0.373802 Aug 31 16:23:52.869428 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2646/5261] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:23:52 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1504 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:23:52.941722 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-25599f2e-df6c-46a9-9628-e553dad9fb05 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:52.947974 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-25599f2e-df6c-46a9-9628-e553dad9fb05 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:52.966666 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-25599f2e-df6c-46a9-9628-e553dad9fb05 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:52.969069 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-25599f2e-df6c-46a9-9628-e553dad9fb05 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:52.971354 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-25599f2e-df6c-46a9-9628-e553dad9fb05 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:52.972701 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-25599f2e-df6c-46a9-9628-e553dad9fb05 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:52.973339 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-25599f2e-df6c-46a9-9628-e553dad9fb05 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:52.974287 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-25599f2e-df6c-46a9-9628-e553dad9fb05 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:53.458278 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-bdbf6d92-3359-4798-82b9-7e0696c65dd6 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:53.459060 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-bdbf6d92-3359-4798-82b9-7e0696c65dd6 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:53.486595 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bdbf6d92-3359-4798-82b9-7e0696c65dd6 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:53.487946 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bdbf6d92-3359-4798-82b9-7e0696c65dd6 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:53.488801 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bdbf6d92-3359-4798-82b9-7e0696c65dd6 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:53.490047 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bdbf6d92-3359-4798-82b9-7e0696c65dd6 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:53.491215 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bdbf6d92-3359-4798-82b9-7e0696c65dd6 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:53.492283 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bdbf6d92-3359-4798-82b9-7e0696c65dd6 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:53.514886 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-25599f2e-df6c-46a9-9628-e553dad9fb05 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:53.557724 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-25599f2e-df6c-46a9-9628-e553dad9fb05 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1504 microversion: 2.1 time: 0.648064 Aug 31 16:23:53.559831 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2616/5262] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:23:52 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1504 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:23:53.599944 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-72e3b102-7dda-4e50-a564-de2d87e9ae02 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:23:53.606773 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-72e3b102-7dda-4e50-a564-de2d87e9ae02 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: bfe7285a-2fdf-4fc8-a088-232603df00df] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:53.623758 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-72e3b102-7dda-4e50-a564-de2d87e9ae02 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] HTTP exception thrown: Instance bfe7285a-2fdf-4fc8-a088-232603df00df could not be found. Aug 31 16:23:53.628885 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-72e3b102-7dda-4e50-a564-de2d87e9ae02 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Request method failure captured: Aug 31 16:23:53.628885 n-d-850499-9 devstack@n-api.service[122256]: request: POST /compute/v2.1/servers/bfe7285a-2fdf-4fc8-a088-232603df00df/action HTTP/1.1 Aug 31 16:23:53.628885 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:23:53.628885 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:23:53.628885 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:23:53.628885 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 39 Aug 31 16:23:53.628885 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:23:53.628885 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:23:53.628885 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:23:53.628885 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:23:53.628885 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4q2NcJzZutw3Y6jF4GnmJD1H1MzSLIbHjRxunPVSp6uKTRmCePfT1DyksG9QgDfSYnSoM0q9vOxO3sqZKoJ5PA2HppEXRHLLn8jTh4ccTKQ6q8SYb3pqui6kOFW5_PmtYr9N0lihJC0EStA4OYRI4QsHOxwmGiiVscbhBZpLyiKmV0 Aug 31 16:23:53.628885 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:23:53.628885 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:23:53.628885 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:23:53.628885 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:23:53.628885 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:23:53.628885 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:23:53.628885 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 014522b19dc349a691e1f6b131229974 Aug 31 16:23:53.628885 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:23:53.628885 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:23:53.628885 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:23:53.628885 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/014522b19dc349a691e1f6b131229974"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/014522b19dc349a691e1f6b131229974"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_014522b19dc349a691e1f6b131229974", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/014522b19dc349a691e1f6b131229974"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:23:53.628885 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:23:53.628885 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 014522b19dc349a691e1f6b131229974 Aug 31 16:23:53.628885 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:23:53.628885 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ServersNegativeTestJSON-918151355-project Aug 31 16:23:53.628885 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:23:53.628885 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:23:53.628885 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: c042c43cc2aa4000a147fae62c261e86 Aug 31 16:23:53.628885 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ServersNegativeTestJSON-918151355-project Aug 31 16:23:53.628885 n-d-850499-9 devstack@n-api.service[122256]: Aug 31 16:23:53.628885 n-d-850499-9 devstack@n-api.service[122256]: {"os-getConsoleOutput": {"length": 10}} Aug 31 16:23:53.628885 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:23:53.628885 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance bfe7285a-2fdf-4fc8-a088-232603df00df could not be found. Aug 31 16:23:53.628885 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': 'bfe7285a-2fdf-4fc8-a088-232603df00df', 'body': {'os-getConsoleOutput': {'length': 10}}} Aug 31 16:23:53.628885 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:23:53.628885 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:23:53.628885 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:23:53.628885 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:23:53.628885 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:23:53.628885 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:23:53.628885 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 31 16:23:53.628885 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 31 16:23:53.628885 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfe7285a-2fdf-4fc8-a088-232603df00df could not be found. Aug 31 16:23:53.628885 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:23:53.628885 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:23:53.628885 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:23:53.628885 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:23:53.628885 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:23:53.628885 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:23:53.628885 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:23:53.628885 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:23:53.628885 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:23:53.628885 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:23:53.628885 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:23:53.628885 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:23:53.628885 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Aug 31 16:23:53.628885 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 31 16:23:53.628885 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:23:53.628885 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:23:53.628885 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfe7285a-2fdf-4fc8-a088-232603df00df could not be found. Aug 31 16:23:53.628885 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:23:53.628885 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:23:53.628885 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:23:53.628885 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:23:53.643135 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:23:53.643135 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:23:53.643135 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:23:53.643135 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:23:53.643135 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfe7285a-2fdf-4fc8-a088-232603df00df could not be found. Aug 31 16:23:53.643135 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:23:53.643135 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-72e3b102-7dda-4e50-a564-de2d87e9ae02 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Returning 404 to user: Instance bfe7285a-2fdf-4fc8-a088-232603df00df could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:23:53.643135 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-72e3b102-7dda-4e50-a564-de2d87e9ae02 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "POST /compute/v2.1/servers/bfe7285a-2fdf-4fc8-a088-232603df00df/action" status: 404 len: 111 microversion: 2.1 time: 0.046883 Aug 31 16:23:53.643135 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2617/5263] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:23:53 2022] POST /compute/v2.1/servers/bfe7285a-2fdf-4fc8-a088-232603df00df/action => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:23:53.657621 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-25588412-6a3d-46a8-a17e-5836c30f6df5 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:53.659832 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-25588412-6a3d-46a8-a17e-5836c30f6df5 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:53.709908 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-25588412-6a3d-46a8-a17e-5836c30f6df5 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:53.712661 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-25588412-6a3d-46a8-a17e-5836c30f6df5 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:53.714483 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-25588412-6a3d-46a8-a17e-5836c30f6df5 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:53.721915 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-25588412-6a3d-46a8-a17e-5836c30f6df5 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:53.723441 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-25588412-6a3d-46a8-a17e-5836c30f6df5 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:53.725076 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-25588412-6a3d-46a8-a17e-5836c30f6df5 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:54.203391 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-bdbf6d92-3359-4798-82b9-7e0696c65dd6 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:54.223313 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-bdbf6d92-3359-4798-82b9-7e0696c65dd6 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:54.228391 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-bdbf6d92-3359-4798-82b9-7e0696c65dd6 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:54.231195 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-bdbf6d92-3359-4798-82b9-7e0696c65dd6 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5" status: 200 len: 1810 microversion: 2.20 time: 0.789270 Aug 31 16:23:54.232896 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2647/5264] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:23:53 2022] GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5 => generated 1810 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:23:54.370231 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-25588412-6a3d-46a8-a17e-5836c30f6df5 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:54.393208 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-25588412-6a3d-46a8-a17e-5836c30f6df5 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1504 microversion: 2.1 time: 0.745681 Aug 31 16:23:54.421451 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2618/5265] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:23:53 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1504 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:23:54.457632 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-de16f23e-98c2-4740-80ef-1f245bf66a62 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:54.458653 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-de16f23e-98c2-4740-80ef-1f245bf66a62 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:54.484381 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-de16f23e-98c2-4740-80ef-1f245bf66a62 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:54.485245 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-de16f23e-98c2-4740-80ef-1f245bf66a62 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:54.486055 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-de16f23e-98c2-4740-80ef-1f245bf66a62 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:54.486862 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-de16f23e-98c2-4740-80ef-1f245bf66a62 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:54.487334 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-de16f23e-98c2-4740-80ef-1f245bf66a62 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:54.488026 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-de16f23e-98c2-4740-80ef-1f245bf66a62 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:55.019958 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-de16f23e-98c2-4740-80ef-1f245bf66a62 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:55.030786 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-de16f23e-98c2-4740-80ef-1f245bf66a62 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1504 microversion: 2.1 time: 0.581170 Aug 31 16:23:55.054057 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2648/5266] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:23:54 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1504 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:23:55.054576 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-32ce0668-900c-437c-9b65-f19fa3a7d9a5 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:55.056107 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-32ce0668-900c-437c-9b65-f19fa3a7d9a5 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: bbc57eac-553b-4eaf-a7e7-da7aaac9f1aa] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:55.069117 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-32ce0668-900c-437c-9b65-f19fa3a7d9a5 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] HTTP exception thrown: Instance bbc57eac-553b-4eaf-a7e7-da7aaac9f1aa could not be found. Aug 31 16:23:55.072698 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-32ce0668-900c-437c-9b65-f19fa3a7d9a5 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Request method failure captured: Aug 31 16:23:55.072698 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/bbc57eac-553b-4eaf-a7e7-da7aaac9f1aa HTTP/1.1 Aug 31 16:23:55.072698 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:23:55.072698 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:23:55.072698 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:23:55.072698 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:23:55.072698 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:23:55.072698 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:23:55.072698 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:23:55.072698 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:23:55.072698 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4q2NcJzZutw3Y6jF4GnmJD1H1MzSLIbHjRxunPVSp6uKTRmCePfT1DyksG9QgDfSYnSoM0q9vOxO3sqZKoJ5PA2HppEXRHLLn8jTh4ccTKQ6q8SYb3pqui6kOFW5_PmtYr9N0lihJC0EStA4OYRI4QsHOxwmGiiVscbhBZpLyiKmV0 Aug 31 16:23:55.072698 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:23:55.072698 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:23:55.072698 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:23:55.072698 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:23:55.072698 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:23:55.072698 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:23:55.072698 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 014522b19dc349a691e1f6b131229974 Aug 31 16:23:55.072698 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:23:55.072698 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:23:55.072698 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:23:55.072698 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/014522b19dc349a691e1f6b131229974"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/014522b19dc349a691e1f6b131229974"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_014522b19dc349a691e1f6b131229974", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/014522b19dc349a691e1f6b131229974"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:23:55.072698 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:23:55.072698 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 014522b19dc349a691e1f6b131229974 Aug 31 16:23:55.072698 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:23:55.072698 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ServersNegativeTestJSON-918151355-project Aug 31 16:23:55.072698 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:23:55.072698 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:23:55.072698 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: c042c43cc2aa4000a147fae62c261e86 Aug 31 16:23:55.072698 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ServersNegativeTestJSON-918151355-project Aug 31 16:23:55.072698 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:23:55.072698 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance bbc57eac-553b-4eaf-a7e7-da7aaac9f1aa could not be found. Aug 31 16:23:55.072698 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': 'bbc57eac-553b-4eaf-a7e7-da7aaac9f1aa'} Aug 31 16:23:55.072698 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:23:55.072698 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:23:55.072698 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:23:55.072698 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:23:55.072698 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:23:55.072698 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:23:55.072698 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 31 16:23:55.072698 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 31 16:23:55.072698 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbc57eac-553b-4eaf-a7e7-da7aaac9f1aa could not be found. Aug 31 16:23:55.072698 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:23:55.072698 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:23:55.072698 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:23:55.072698 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:23:55.072698 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:23:55.072698 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:23:55.072698 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:23:55.072698 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:23:55.072698 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:23:55.072698 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:23:55.072698 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:23:55.072698 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:23:55.072698 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:23:55.072698 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:23:55.072698 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:23:55.072698 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:23:55.072698 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbc57eac-553b-4eaf-a7e7-da7aaac9f1aa could not be found. Aug 31 16:23:55.072698 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:23:55.072698 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:23:55.072698 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:23:55.072698 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:23:55.072698 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:23:55.087041 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:23:55.087041 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:23:55.087041 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:23:55.087041 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbc57eac-553b-4eaf-a7e7-da7aaac9f1aa could not be found. Aug 31 16:23:55.087041 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:23:55.087041 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-32ce0668-900c-437c-9b65-f19fa3a7d9a5 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Returning 404 to user: Instance bbc57eac-553b-4eaf-a7e7-da7aaac9f1aa could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:23:55.088968 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-32ce0668-900c-437c-9b65-f19fa3a7d9a5 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/bbc57eac-553b-4eaf-a7e7-da7aaac9f1aa" status: 404 len: 111 microversion: 2.1 time: 0.038473 Aug 31 16:23:55.093586 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2619/5267] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:23:55 2022] GET /compute/v2.1/servers/bbc57eac-553b-4eaf-a7e7-da7aaac9f1aa => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 16:23:55.105206 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-864f8ee0-5581-4733-b323-e1d653433548 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:55.106589 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-864f8ee0-5581-4733-b323-e1d653433548 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:55.125004 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-864f8ee0-5581-4733-b323-e1d653433548 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:55.127008 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-864f8ee0-5581-4733-b323-e1d653433548 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:55.128703 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-864f8ee0-5581-4733-b323-e1d653433548 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:55.130501 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-864f8ee0-5581-4733-b323-e1d653433548 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:55.133346 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-864f8ee0-5581-4733-b323-e1d653433548 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:55.135107 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-864f8ee0-5581-4733-b323-e1d653433548 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:55.268520 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-88ca4b89-2c83-4bbe-8b0f-a34dd6d9bf4f tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:55.269540 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-88ca4b89-2c83-4bbe-8b0f-a34dd6d9bf4f tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:55.278714 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-88ca4b89-2c83-4bbe-8b0f-a34dd6d9bf4f tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:55.279856 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-88ca4b89-2c83-4bbe-8b0f-a34dd6d9bf4f tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:55.280583 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-88ca4b89-2c83-4bbe-8b0f-a34dd6d9bf4f tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:55.281600 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-88ca4b89-2c83-4bbe-8b0f-a34dd6d9bf4f tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:55.282905 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-88ca4b89-2c83-4bbe-8b0f-a34dd6d9bf4f tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:55.283632 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-88ca4b89-2c83-4bbe-8b0f-a34dd6d9bf4f tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:55.773568 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-864f8ee0-5581-4733-b323-e1d653433548 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:55.806770 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-864f8ee0-5581-4733-b323-e1d653433548 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1504 microversion: 2.1 time: 0.711120 Aug 31 16:23:55.832914 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2649/5268] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:23:55 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1504 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:23:55.867525 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-aed60501-e864-4872-b293-2369fe32c10e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:55.870873 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-aed60501-e864-4872-b293-2369fe32c10e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:55.886517 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-aed60501-e864-4872-b293-2369fe32c10e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:55.887777 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-aed60501-e864-4872-b293-2369fe32c10e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:55.888965 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-aed60501-e864-4872-b293-2369fe32c10e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:55.891109 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-aed60501-e864-4872-b293-2369fe32c10e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:55.893485 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-aed60501-e864-4872-b293-2369fe32c10e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:55.894691 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-aed60501-e864-4872-b293-2369fe32c10e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:55.902830 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-88ca4b89-2c83-4bbe-8b0f-a34dd6d9bf4f tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:55.913833 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-88ca4b89-2c83-4bbe-8b0f-a34dd6d9bf4f tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:55.915925 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-88ca4b89-2c83-4bbe-8b0f-a34dd6d9bf4f tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:55.917551 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-88ca4b89-2c83-4bbe-8b0f-a34dd6d9bf4f tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5" status: 200 len: 1810 microversion: 2.20 time: 0.653523 Aug 31 16:23:55.918685 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2620/5269] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:23:55 2022] GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5 => generated 1810 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:23:56.504832 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-aed60501-e864-4872-b293-2369fe32c10e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:56.520971 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-aed60501-e864-4872-b293-2369fe32c10e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1504 microversion: 2.1 time: 0.663784 Aug 31 16:23:56.522805 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2650/5270] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:23:55 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1504 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:23:56.605910 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-916b516d-506c-47ea-95a8-e3b972111bdc req-5579cc6b-8f95-4c49-95e0-8c1c94b09a04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85a0286b-2e02-4ecb-a63d-0b4a61048ab5", "tag": "b2e423e8-4d65-4e9c-90c7-27d4697688c2"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:23:56.645979 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-916b516d-506c-47ea-95a8-e3b972111bdc req-5579cc6b-8f95-4c49-95e0-8c1c94b09a04 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:56.647355 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-916b516d-506c-47ea-95a8-e3b972111bdc req-5579cc6b-8f95-4c49-95e0-8c1c94b09a04 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:56.648598 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-916b516d-506c-47ea-95a8-e3b972111bdc req-5579cc6b-8f95-4c49-95e0-8c1c94b09a04 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:56.676776 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9bc2c41d-7f9a-4119-a73d-fe4d990293ce tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-517640453", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "fa24e0ec-4a58-4400-9cf4-a0201375c33e"}]}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:23:56.692755 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-916b516d-506c-47ea-95a8-e3b972111bdc req-5579cc6b-8f95-4c49-95e0-8c1c94b09a04 service nova] Creating event network-changed:b2e423e8-4d65-4e9c-90c7-27d4697688c2 for instance 85a0286b-2e02-4ecb-a63d-0b4a61048ab5 on n-h2-850499-9 Aug 31 16:23:56.711779 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9bc2c41d-7f9a-4119-a73d-fe4d990293ce tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Request method failure captured: Aug 31 16:23:56.711779 n-d-850499-9 devstack@n-api.service[122257]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 31 16:23:56.711779 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:23:56.711779 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:23:56.711779 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:23:56.711779 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 237 Aug 31 16:23:56.711779 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:23:56.711779 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:23:56.711779 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:23:56.711779 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:23:56.711779 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4q2NcJzZutw3Y6jF4GnmJD1H1MzSLIbHjRxunPVSp6uKTRmCePfT1DyksG9QgDfSYnSoM0q9vOxO3sqZKoJ5PA2HppEXRHLLn8jTh4ccTKQ6q8SYb3pqui6kOFW5_PmtYr9N0lihJC0EStA4OYRI4QsHOxwmGiiVscbhBZpLyiKmV0 Aug 31 16:23:56.711779 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:23:56.711779 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:23:56.711779 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:23:56.711779 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:23:56.711779 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:23:56.711779 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:23:56.711779 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 014522b19dc349a691e1f6b131229974 Aug 31 16:23:56.711779 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:23:56.711779 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:23:56.711779 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:23:56.711779 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/014522b19dc349a691e1f6b131229974"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/014522b19dc349a691e1f6b131229974"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_014522b19dc349a691e1f6b131229974", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/014522b19dc349a691e1f6b131229974"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:23:56.711779 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:23:56.711779 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 014522b19dc349a691e1f6b131229974 Aug 31 16:23:56.711779 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:23:56.711779 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ServersNegativeTestJSON-918151355-project Aug 31 16:23:56.711779 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:23:56.711779 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:23:56.711779 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: c042c43cc2aa4000a147fae62c261e86 Aug 31 16:23:56.711779 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ServersNegativeTestJSON-918151355-project Aug 31 16:23:56.711779 n-d-850499-9 devstack@n-api.service[122257]: Aug 31 16:23:56.711779 n-d-850499-9 devstack@n-api.service[122257]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-517640453", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "fa24e0ec-4a58-4400-9cf4-a0201375c33e"}]}} Aug 31 16:23:56.711779 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:23:56.711779 n-d-850499-9 devstack@n-api.service[122257]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 31 16:23:56.711779 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-517640453', 'imageRef': 'b9c36d42-ed46-4bf5-ad18-1df45cbd0413', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': 'fa24e0ec-4a58-4400-9cf4-a0201375c33e'}]}}} Aug 31 16:23:56.711779 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:23:56.711779 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:23:56.711779 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 31 16:23:56.711779 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 31 16:23:56.711779 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 236, in is_ipv4 Aug 31 16:23:56.711779 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Aug 31 16:23:56.711779 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Aug 31 16:23:56.711779 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Aug 31 16:23:56.711779 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Aug 31 16:23:56.711779 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Aug 31 16:23:56.711779 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Aug 31 16:23:56.711779 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:23:56.711779 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 31 16:23:56.711779 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:23:56.711779 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:23:56.711779 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 16:23:56.711779 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 16:23:56.711779 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 16:23:56.711779 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise error Aug 31 16:23:56.711779 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Aug 31 16:23:56.711779 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:23:56.711779 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Aug 31 16:23:56.711779 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Aug 31 16:23:56.711779 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:23:56.711779 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 31 16:23:56.711779 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Aug 31 16:23:56.711779 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:23:56.711779 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:23:56.711779 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:23:56.711779 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:23:56.724462 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:23:56.724462 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:23:56.724462 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:23:56.724462 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:23:56.724462 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:23:56.724462 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:23:56.724462 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:23:56.724462 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:23:56.724462 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 16:23:56.724462 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 16:23:56.724462 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 16:23:56.724462 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 16:23:56.724462 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 16:23:56.724462 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 16:23:56.724462 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 31 16:23:56.724462 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:23:56.724462 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:23:56.724462 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:23:56.724462 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:23:56.724462 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:23:56.724462 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:23:56.724462 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 16:23:56.724462 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 16:23:56.724462 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 31 16:23:56.724462 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:23:56.729920 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-916b516d-506c-47ea-95a8-e3b972111bdc req-5579cc6b-8f95-4c49-95e0-8c1c94b09a04 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112920 Aug 31 16:23:56.730753 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9bc2c41d-7f9a-4119-a73d-fe4d990293ce tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:23:56.730753 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9bc2c41d-7f9a-4119-a73d-fe4d990293ce tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.044706 Aug 31 16:23:56.731271 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2621/5271] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:23:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:23:56.731881 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2651/5272] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:23:56 2022] POST /compute/v2.1/servers => generated 139 bytes in 47 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 31 16:23:56.736495 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3805ab75-880d-4da5-b254-96bf747cb53c tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:56.739798 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3805ab75-880d-4da5-b254-96bf747cb53c tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:56.772581 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3805ab75-880d-4da5-b254-96bf747cb53c tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:56.773463 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3805ab75-880d-4da5-b254-96bf747cb53c tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:56.774271 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3805ab75-880d-4da5-b254-96bf747cb53c tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:56.775636 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3805ab75-880d-4da5-b254-96bf747cb53c tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:56.776498 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3805ab75-880d-4da5-b254-96bf747cb53c tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:56.777470 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3805ab75-880d-4da5-b254-96bf747cb53c tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:56.952753 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ea2f5371-951f-40ad-93f3-2c6e529ba8be tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:56.953966 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ea2f5371-951f-40ad-93f3-2c6e529ba8be tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:56.977319 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ea2f5371-951f-40ad-93f3-2c6e529ba8be tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:56.978151 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ea2f5371-951f-40ad-93f3-2c6e529ba8be tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:56.979125 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ea2f5371-951f-40ad-93f3-2c6e529ba8be tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:56.980310 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ea2f5371-951f-40ad-93f3-2c6e529ba8be tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:56.981037 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ea2f5371-951f-40ad-93f3-2c6e529ba8be tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:56.981640 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ea2f5371-951f-40ad-93f3-2c6e529ba8be tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:57.677123 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3805ab75-880d-4da5-b254-96bf747cb53c tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:57.692726 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3805ab75-880d-4da5-b254-96bf747cb53c tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1504 microversion: 2.1 time: 0.970500 Aug 31 16:23:57.693660 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2622/5273] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:23:56 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1504 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:23:57.747395 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b5bfddcf-0bfa-4051-97b7-e6a1032c91e2 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:57.748941 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b5bfddcf-0bfa-4051-97b7-e6a1032c91e2 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:57.763109 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b5bfddcf-0bfa-4051-97b7-e6a1032c91e2 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:57.764375 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b5bfddcf-0bfa-4051-97b7-e6a1032c91e2 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:57.765482 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b5bfddcf-0bfa-4051-97b7-e6a1032c91e2 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:57.768373 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b5bfddcf-0bfa-4051-97b7-e6a1032c91e2 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:57.769550 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b5bfddcf-0bfa-4051-97b7-e6a1032c91e2 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:57.770601 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b5bfddcf-0bfa-4051-97b7-e6a1032c91e2 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:57.816796 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ea2f5371-951f-40ad-93f3-2c6e529ba8be tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:57.845937 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ea2f5371-951f-40ad-93f3-2c6e529ba8be tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:57.847611 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ea2f5371-951f-40ad-93f3-2c6e529ba8be tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:57.851890 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ea2f5371-951f-40ad-93f3-2c6e529ba8be tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5" status: 200 len: 1810 microversion: 2.20 time: 0.905930 Aug 31 16:23:57.857577 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2652/5274] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:23:56 2022] GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5 => generated 1810 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:23:58.903914 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c023b716-9f2b-4eaf-a7e6-0fc0acd85754 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:58.908257 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c023b716-9f2b-4eaf-a7e6-0fc0acd85754 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:58.913079 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b5bfddcf-0bfa-4051-97b7-e6a1032c91e2 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:58.932872 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b5bfddcf-0bfa-4051-97b7-e6a1032c91e2 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1504 microversion: 2.1 time: 1.198202 Aug 31 16:23:58.938323 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c023b716-9f2b-4eaf-a7e6-0fc0acd85754 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:58.939320 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c023b716-9f2b-4eaf-a7e6-0fc0acd85754 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:58.940031 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2623/5275] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:23:57 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1504 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:23:58.940469 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c023b716-9f2b-4eaf-a7e6-0fc0acd85754 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:58.941297 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c023b716-9f2b-4eaf-a7e6-0fc0acd85754 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:58.941847 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c023b716-9f2b-4eaf-a7e6-0fc0acd85754 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:58.943807 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c023b716-9f2b-4eaf-a7e6-0fc0acd85754 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:59.099706 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0152b21e-e3a6-43b9-b84e-8a100c2de9d6 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-56728349", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "fa24e0ec-4a58-4400-9cf4-a0201375c33e"}]}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:23:59.107064 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0152b21e-e3a6-43b9-b84e-8a100c2de9d6 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Request method failure captured: Aug 31 16:23:59.107064 n-d-850499-9 devstack@n-api.service[122256]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 31 16:23:59.107064 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:23:59.107064 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:23:59.107064 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:23:59.107064 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 233 Aug 31 16:23:59.107064 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:23:59.107064 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:23:59.107064 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:23:59.107064 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:23:59.107064 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4q2NcJzZutw3Y6jF4GnmJD1H1MzSLIbHjRxunPVSp6uKTRmCePfT1DyksG9QgDfSYnSoM0q9vOxO3sqZKoJ5PA2HppEXRHLLn8jTh4ccTKQ6q8SYb3pqui6kOFW5_PmtYr9N0lihJC0EStA4OYRI4QsHOxwmGiiVscbhBZpLyiKmV0 Aug 31 16:23:59.107064 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:23:59.107064 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:23:59.107064 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:23:59.107064 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:23:59.107064 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:23:59.107064 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:23:59.107064 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 014522b19dc349a691e1f6b131229974 Aug 31 16:23:59.107064 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:23:59.107064 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:23:59.107064 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:23:59.107064 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/014522b19dc349a691e1f6b131229974"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/014522b19dc349a691e1f6b131229974"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_014522b19dc349a691e1f6b131229974", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/014522b19dc349a691e1f6b131229974"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:23:59.107064 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:23:59.107064 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 014522b19dc349a691e1f6b131229974 Aug 31 16:23:59.107064 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:23:59.107064 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ServersNegativeTestJSON-918151355-project Aug 31 16:23:59.107064 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:23:59.107064 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:23:59.107064 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: c042c43cc2aa4000a147fae62c261e86 Aug 31 16:23:59.107064 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ServersNegativeTestJSON-918151355-project Aug 31 16:23:59.107064 n-d-850499-9 devstack@n-api.service[122256]: Aug 31 16:23:59.107064 n-d-850499-9 devstack@n-api.service[122256]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-56728349", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "fa24e0ec-4a58-4400-9cf4-a0201375c33e"}]}} Aug 31 16:23:59.107064 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:23:59.107064 n-d-850499-9 devstack@n-api.service[122256]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 31 16:23:59.107064 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-56728349', 'imageRef': 'b9c36d42-ed46-4bf5-ad18-1df45cbd0413', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': 'fa24e0ec-4a58-4400-9cf4-a0201375c33e'}]}}} Aug 31 16:23:59.107064 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:23:59.107064 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:23:59.107064 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 31 16:23:59.107064 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 31 16:23:59.107064 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 243, in is_ipv6 Aug 31 16:23:59.107064 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Aug 31 16:23:59.107064 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Aug 31 16:23:59.107064 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Aug 31 16:23:59.107064 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Aug 31 16:23:59.107064 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Aug 31 16:23:59.107064 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Aug 31 16:23:59.107064 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:23:59.107064 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 31 16:23:59.107064 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:23:59.107064 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:23:59.107064 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 16:23:59.107064 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 16:23:59.107064 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 16:23:59.107064 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise error Aug 31 16:23:59.107064 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Aug 31 16:23:59.107064 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:23:59.107064 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Aug 31 16:23:59.107064 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Aug 31 16:23:59.107064 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:23:59.107064 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 31 16:23:59.107064 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi 'notvalid' Aug 31 16:23:59.107064 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:23:59.107064 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:23:59.107064 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:23:59.107064 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:23:59.113734 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:23:59.113734 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:23:59.113734 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:23:59.113734 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:23:59.113734 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:23:59.113734 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:23:59.113734 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:23:59.113734 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:23:59.113734 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 16:23:59.113734 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 16:23:59.113734 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 16:23:59.113734 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 16:23:59.113734 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 16:23:59.113734 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 16:23:59.113734 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 31 16:23:59.113734 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:23:59.113734 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:23:59.113734 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:23:59.113734 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:23:59.113734 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:23:59.113734 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:23:59.113734 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 16:23:59.113734 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 16:23:59.113734 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 31 16:23:59.113734 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:23:59.116964 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0152b21e-e3a6-43b9-b84e-8a100c2de9d6 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:23:59.118064 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0152b21e-e3a6-43b9-b84e-8a100c2de9d6 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.025536 Aug 31 16:23:59.122224 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2624/5276] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:23:59 2022] POST /compute/v2.1/servers => generated 133 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:23:59.133950 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2ec6299d-697c-4648-9169-d07fd5820fb0 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:59.134597 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2ec6299d-697c-4648-9169-d07fd5820fb0 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:59.150175 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2ec6299d-697c-4648-9169-d07fd5820fb0 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:59.150787 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2ec6299d-697c-4648-9169-d07fd5820fb0 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:59.151251 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2ec6299d-697c-4648-9169-d07fd5820fb0 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:59.152023 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2ec6299d-697c-4648-9169-d07fd5820fb0 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:59.152503 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2ec6299d-697c-4648-9169-d07fd5820fb0 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:59.152944 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2ec6299d-697c-4648-9169-d07fd5820fb0 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:59.624315 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-2ec6299d-697c-4648-9169-d07fd5820fb0 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:59.643520 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c023b716-9f2b-4eaf-a7e6-0fc0acd85754 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:59.673866 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c023b716-9f2b-4eaf-a7e6-0fc0acd85754 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:59.675900 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2ec6299d-697c-4648-9169-d07fd5820fb0 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1504 microversion: 2.1 time: 0.546859 Aug 31 16:23:59.676155 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c023b716-9f2b-4eaf-a7e6-0fc0acd85754 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:59.677357 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c023b716-9f2b-4eaf-a7e6-0fc0acd85754 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5" status: 200 len: 1810 microversion: 2.20 time: 0.782270 Aug 31 16:23:59.677926 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2653/5277] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:23:58 2022] GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5 => generated 1810 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:23:59.691536 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2625/5278] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:23:59 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1504 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:23:59.708814 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-37ac4994-1e6e-4f43-9d47-c2fc9f56f2f6 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:59.713104 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-37ac4994-1e6e-4f43-9d47-c2fc9f56f2f6 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:59.725820 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-37ac4994-1e6e-4f43-9d47-c2fc9f56f2f6 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:59.727529 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-37ac4994-1e6e-4f43-9d47-c2fc9f56f2f6 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:59.737367 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-37ac4994-1e6e-4f43-9d47-c2fc9f56f2f6 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:59.738559 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-37ac4994-1e6e-4f43-9d47-c2fc9f56f2f6 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:59.740414 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-37ac4994-1e6e-4f43-9d47-c2fc9f56f2f6 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:59.741130 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-37ac4994-1e6e-4f43-9d47-c2fc9f56f2f6 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:59.991163 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-37ac4994-1e6e-4f43-9d47-c2fc9f56f2f6 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:59.999941 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-37ac4994-1e6e-4f43-9d47-c2fc9f56f2f6 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1504 microversion: 2.1 time: 0.297530 Aug 31 16:24:00.020126 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2654/5279] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:23:59 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1504 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:00.028997 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-cc4441ee-8f03-45e8-a7e1-bf21d9a73bd2 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:24:00.030645 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-cc4441ee-8f03-45e8-a7e1-bf21d9a73bd2 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 50c853c6-1fd8-4373-9722-d48cbd372ee7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:00.051210 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-cc4441ee-8f03-45e8-a7e1-bf21d9a73bd2 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] HTTP exception thrown: Instance 50c853c6-1fd8-4373-9722-d48cbd372ee7 could not be found. Aug 31 16:24:00.059484 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-cc4441ee-8f03-45e8-a7e1-bf21d9a73bd2 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Request method failure captured: Aug 31 16:24:00.059484 n-d-850499-9 devstack@n-api.service[122256]: request: POST /compute/v2.1/servers/50c853c6-1fd8-4373-9722-d48cbd372ee7/action HTTP/1.1 Aug 31 16:24:00.059484 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:24:00.059484 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:24:00.059484 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:24:00.059484 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 13 Aug 31 16:24:00.059484 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:24:00.059484 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:24:00.059484 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:24:00.059484 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:24:00.059484 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4q2NcJzZutw3Y6jF4GnmJD1H1MzSLIbHjRxunPVSp6uKTRmCePfT1DyksG9QgDfSYnSoM0q9vOxO3sqZKoJ5PA2HppEXRHLLn8jTh4ccTKQ6q8SYb3pqui6kOFW5_PmtYr9N0lihJC0EStA4OYRI4QsHOxwmGiiVscbhBZpLyiKmV0 Aug 31 16:24:00.059484 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:24:00.059484 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:24:00.059484 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:24:00.059484 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:24:00.059484 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:24:00.059484 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:24:00.059484 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 014522b19dc349a691e1f6b131229974 Aug 31 16:24:00.059484 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:24:00.059484 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:24:00.059484 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:24:00.059484 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/014522b19dc349a691e1f6b131229974"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/014522b19dc349a691e1f6b131229974"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_014522b19dc349a691e1f6b131229974", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/014522b19dc349a691e1f6b131229974"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:24:00.059484 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:24:00.059484 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 014522b19dc349a691e1f6b131229974 Aug 31 16:24:00.059484 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:24:00.059484 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ServersNegativeTestJSON-918151355-project Aug 31 16:24:00.059484 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:24:00.059484 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:24:00.059484 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: c042c43cc2aa4000a147fae62c261e86 Aug 31 16:24:00.059484 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ServersNegativeTestJSON-918151355-project Aug 31 16:24:00.059484 n-d-850499-9 devstack@n-api.service[122256]: Aug 31 16:24:00.059484 n-d-850499-9 devstack@n-api.service[122256]: {"pause": {}} Aug 31 16:24:00.059484 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:24:00.059484 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance 50c853c6-1fd8-4373-9722-d48cbd372ee7 could not be found. Aug 31 16:24:00.059484 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '50c853c6-1fd8-4373-9722-d48cbd372ee7', 'body': {'pause': {}}} Aug 31 16:24:00.059484 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:24:00.059484 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:24:00.059484 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:24:00.059484 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:24:00.059484 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:24:00.059484 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:24:00.059484 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 31 16:24:00.059484 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 31 16:24:00.059484 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50c853c6-1fd8-4373-9722-d48cbd372ee7 could not be found. Aug 31 16:24:00.059484 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:24:00.059484 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:24:00.059484 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:24:00.059484 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:24:00.059484 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:24:00.059484 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:24:00.059484 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:24:00.059484 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:24:00.059484 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:24:00.059484 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:24:00.059484 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Aug 31 16:24:00.059484 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Aug 31 16:24:00.059484 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:24:00.059484 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:24:00.059484 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50c853c6-1fd8-4373-9722-d48cbd372ee7 could not be found. Aug 31 16:24:00.059484 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:24:00.059484 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:24:00.059484 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:24:00.059484 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:24:00.059484 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:24:00.059484 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:24:00.067087 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:24:00.067087 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:24:00.067087 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50c853c6-1fd8-4373-9722-d48cbd372ee7 could not be found. Aug 31 16:24:00.067087 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:24:00.069256 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-cc4441ee-8f03-45e8-a7e1-bf21d9a73bd2 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Returning 404 to user: Instance 50c853c6-1fd8-4373-9722-d48cbd372ee7 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:24:00.071089 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-cc4441ee-8f03-45e8-a7e1-bf21d9a73bd2 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "POST /compute/v2.1/servers/50c853c6-1fd8-4373-9722-d48cbd372ee7/action" status: 404 len: 111 microversion: 2.1 time: 0.049063 Aug 31 16:24:00.077008 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2626/5280] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:24:00 2022] POST /compute/v2.1/servers/50c853c6-1fd8-4373-9722-d48cbd372ee7/action => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:24:00.084745 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-10d23756-5ca9-4ed3-a63f-85ecb7504ce6 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:00.085641 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-10d23756-5ca9-4ed3-a63f-85ecb7504ce6 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:00.096050 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-10d23756-5ca9-4ed3-a63f-85ecb7504ce6 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:00.096945 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-10d23756-5ca9-4ed3-a63f-85ecb7504ce6 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:00.097577 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-10d23756-5ca9-4ed3-a63f-85ecb7504ce6 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:00.098516 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-10d23756-5ca9-4ed3-a63f-85ecb7504ce6 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:00.099319 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-10d23756-5ca9-4ed3-a63f-85ecb7504ce6 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:00.100477 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-10d23756-5ca9-4ed3-a63f-85ecb7504ce6 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:00.599901 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-10d23756-5ca9-4ed3-a63f-85ecb7504ce6 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:00.644458 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-10d23756-5ca9-4ed3-a63f-85ecb7504ce6 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1504 microversion: 2.1 time: 0.564952 Aug 31 16:24:00.649865 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2655/5281] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:00 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1504 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:00.705175 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-20f20c77-90be-4fbf-978e-6ef44f9db4b8 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:00.706371 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-20f20c77-90be-4fbf-978e-6ef44f9db4b8 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:00.738379 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-33dd0534-2e1b-41d2-a1b1-ecbd1c6e071a tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:00.752563 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-33dd0534-2e1b-41d2-a1b1-ecbd1c6e071a tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:00.799287 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-20f20c77-90be-4fbf-978e-6ef44f9db4b8 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:00.809991 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-20f20c77-90be-4fbf-978e-6ef44f9db4b8 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:00.817028 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-33dd0534-2e1b-41d2-a1b1-ecbd1c6e071a tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:00.817679 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-20f20c77-90be-4fbf-978e-6ef44f9db4b8 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:00.820587 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-20f20c77-90be-4fbf-978e-6ef44f9db4b8 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:00.821382 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-33dd0534-2e1b-41d2-a1b1-ecbd1c6e071a tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:00.822613 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-33dd0534-2e1b-41d2-a1b1-ecbd1c6e071a tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:00.824117 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-20f20c77-90be-4fbf-978e-6ef44f9db4b8 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:00.825906 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-33dd0534-2e1b-41d2-a1b1-ecbd1c6e071a tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:00.827223 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-20f20c77-90be-4fbf-978e-6ef44f9db4b8 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:00.828672 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-33dd0534-2e1b-41d2-a1b1-ecbd1c6e071a tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:00.838922 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-33dd0534-2e1b-41d2-a1b1-ecbd1c6e071a tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:02.309747 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-20f20c77-90be-4fbf-978e-6ef44f9db4b8 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:02.332253 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-33dd0534-2e1b-41d2-a1b1-ecbd1c6e071a tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:02.358848 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-33dd0534-2e1b-41d2-a1b1-ecbd1c6e071a tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:02.360682 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-20f20c77-90be-4fbf-978e-6ef44f9db4b8 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1504 microversion: 2.1 time: 1.669920 Aug 31 16:24:02.362170 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2627/5282] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:00 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1504 bytes in 1673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:02.366507 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-33dd0534-2e1b-41d2-a1b1-ecbd1c6e071a tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:02.368312 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-33dd0534-2e1b-41d2-a1b1-ecbd1c6e071a tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5" status: 200 len: 1810 microversion: 2.20 time: 1.652453 Aug 31 16:24:02.383873 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2656/5283] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:24:00 2022] GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5 => generated 1810 bytes in 1669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:24:02.407471 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-00b88e85-1e13-4787-a8a6-1720887d263e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:24:02.408716 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-00b88e85-1e13-4787-a8a6-1720887d263e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:02.419231 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-00b88e85-1e13-4787-a8a6-1720887d263e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:02.420065 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-00b88e85-1e13-4787-a8a6-1720887d263e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:02.420536 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-00b88e85-1e13-4787-a8a6-1720887d263e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:02.421268 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-00b88e85-1e13-4787-a8a6-1720887d263e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:02.421739 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-00b88e85-1e13-4787-a8a6-1720887d263e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:02.422205 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-00b88e85-1e13-4787-a8a6-1720887d263e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:02.738545 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-00b88e85-1e13-4787-a8a6-1720887d263e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "POST /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505/action" status: 202 len: 0 microversion: 2.1 time: 0.343747 Aug 31 16:24:02.753197 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2628/5284] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:24:02 2022] POST /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505/action => generated 0 bytes in 368 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 16:24:02.766804 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-bc9a1c31-7b15-43ab-a381-3e11ebc3230e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:02.770726 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-bc9a1c31-7b15-43ab-a381-3e11ebc3230e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:02.802280 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bc9a1c31-7b15-43ab-a381-3e11ebc3230e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:02.811649 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bc9a1c31-7b15-43ab-a381-3e11ebc3230e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:02.812409 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bc9a1c31-7b15-43ab-a381-3e11ebc3230e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:02.813643 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bc9a1c31-7b15-43ab-a381-3e11ebc3230e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:02.814426 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bc9a1c31-7b15-43ab-a381-3e11ebc3230e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:02.815010 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bc9a1c31-7b15-43ab-a381-3e11ebc3230e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:03.413320 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ac2f3009-7e5a-4eae-a2fd-b57ea27ae444 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:03.414521 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ac2f3009-7e5a-4eae-a2fd-b57ea27ae444 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:03.426564 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-bc9a1c31-7b15-43ab-a381-3e11ebc3230e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:03.472822 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-bc9a1c31-7b15-43ab-a381-3e11ebc3230e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1509 microversion: 2.1 time: 0.714801 Aug 31 16:24:03.473912 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2657/5285] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:02 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1509 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:24:03.504025 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ac2f3009-7e5a-4eae-a2fd-b57ea27ae444 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:03.504954 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ac2f3009-7e5a-4eae-a2fd-b57ea27ae444 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:03.505814 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ac2f3009-7e5a-4eae-a2fd-b57ea27ae444 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:03.506980 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ac2f3009-7e5a-4eae-a2fd-b57ea27ae444 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:03.507830 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ac2f3009-7e5a-4eae-a2fd-b57ea27ae444 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:03.523809 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ac2f3009-7e5a-4eae-a2fd-b57ea27ae444 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:03.977965 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ac2f3009-7e5a-4eae-a2fd-b57ea27ae444 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:03.981921 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:24:03.998031 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ac2f3009-7e5a-4eae-a2fd-b57ea27ae444 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:04.003092 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ac2f3009-7e5a-4eae-a2fd-b57ea27ae444 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:04.005766 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ac2f3009-7e5a-4eae-a2fd-b57ea27ae444 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5" status: 200 len: 1810 microversion: 2.20 time: 0.601587 Aug 31 16:24:04.007558 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2629/5286] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:24:03 2022] GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5 => generated 1810 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:24:04.518552 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-54e2b38a-9182-4b8b-a43d-e70cd859bd90 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:04.527752 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-54e2b38a-9182-4b8b-a43d-e70cd859bd90 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:04.559876 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-54e2b38a-9182-4b8b-a43d-e70cd859bd90 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:04.560765 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-54e2b38a-9182-4b8b-a43d-e70cd859bd90 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:04.561547 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-54e2b38a-9182-4b8b-a43d-e70cd859bd90 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:04.569411 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-54e2b38a-9182-4b8b-a43d-e70cd859bd90 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:04.570563 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-54e2b38a-9182-4b8b-a43d-e70cd859bd90 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:04.571661 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-54e2b38a-9182-4b8b-a43d-e70cd859bd90 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:05.056598 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9756b027-1886-401f-af2d-fabf7fdd4cce tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:05.057729 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9756b027-1886-401f-af2d-fabf7fdd4cce tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:05.118983 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9756b027-1886-401f-af2d-fabf7fdd4cce tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:05.122475 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9756b027-1886-401f-af2d-fabf7fdd4cce tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:05.125006 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9756b027-1886-401f-af2d-fabf7fdd4cce tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:05.130577 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9756b027-1886-401f-af2d-fabf7fdd4cce tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:05.134590 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9756b027-1886-401f-af2d-fabf7fdd4cce tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:05.136000 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9756b027-1886-401f-af2d-fabf7fdd4cce tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:05.375004 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-54e2b38a-9182-4b8b-a43d-e70cd859bd90 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:05.429814 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-54e2b38a-9182-4b8b-a43d-e70cd859bd90 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1489 microversion: 2.1 time: 0.920221 Aug 31 16:24:05.436924 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2658/5287] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:04 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1489 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:05.485856 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c3a92c44-f49e-436d-942e-6ae40fd55e29 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:24:05.497628 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c3a92c44-f49e-436d-942e-6ae40fd55e29 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:05.524859 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c3a92c44-f49e-436d-942e-6ae40fd55e29 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:05.526276 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c3a92c44-f49e-436d-942e-6ae40fd55e29 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:05.526962 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c3a92c44-f49e-436d-942e-6ae40fd55e29 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:05.528520 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c3a92c44-f49e-436d-942e-6ae40fd55e29 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:05.529628 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c3a92c44-f49e-436d-942e-6ae40fd55e29 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:05.530641 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c3a92c44-f49e-436d-942e-6ae40fd55e29 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:05.679816 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-c3a92c44-f49e-436d-942e-6ae40fd55e29 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] HTTP exception thrown: Cannot 'pause' instance 22082563-385d-41a9-baa5-6fb277278505 while it is in vm_state paused Aug 31 16:24:05.694880 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c3a92c44-f49e-436d-942e-6ae40fd55e29 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Request method failure captured: Aug 31 16:24:05.694880 n-d-850499-9 devstack@n-api.service[122257]: request: POST /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505/action HTTP/1.1 Aug 31 16:24:05.694880 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:24:05.694880 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:24:05.694880 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:24:05.694880 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 13 Aug 31 16:24:05.694880 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:24:05.694880 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:24:05.694880 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:24:05.694880 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:24:05.694880 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4q2NcJzZutw3Y6jF4GnmJD1H1MzSLIbHjRxunPVSp6uKTRmCePfT1DyksG9QgDfSYnSoM0q9vOxO3sqZKoJ5PA2HppEXRHLLn8jTh4ccTKQ6q8SYb3pqui6kOFW5_PmtYr9N0lihJC0EStA4OYRI4QsHOxwmGiiVscbhBZpLyiKmV0 Aug 31 16:24:05.694880 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:24:05.694880 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:24:05.694880 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:24:05.694880 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:24:05.694880 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:24:05.694880 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:24:05.694880 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 014522b19dc349a691e1f6b131229974 Aug 31 16:24:05.694880 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:24:05.694880 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:24:05.694880 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:24:05.694880 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/014522b19dc349a691e1f6b131229974"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/014522b19dc349a691e1f6b131229974"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_014522b19dc349a691e1f6b131229974", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/014522b19dc349a691e1f6b131229974"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:24:05.694880 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:24:05.694880 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 014522b19dc349a691e1f6b131229974 Aug 31 16:24:05.694880 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:24:05.694880 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ServersNegativeTestJSON-918151355-project Aug 31 16:24:05.694880 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:24:05.694880 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:24:05.694880 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: c042c43cc2aa4000a147fae62c261e86 Aug 31 16:24:05.694880 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ServersNegativeTestJSON-918151355-project Aug 31 16:24:05.694880 n-d-850499-9 devstack@n-api.service[122257]: Aug 31 16:24:05.694880 n-d-850499-9 devstack@n-api.service[122257]: {"pause": {}} Aug 31 16:24:05.694880 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:24:05.694880 n-d-850499-9 devstack@n-api.service[122257]: exception: Cannot 'pause' instance 22082563-385d-41a9-baa5-6fb277278505 while it is in vm_state paused Aug 31 16:24:05.694880 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '22082563-385d-41a9-baa5-6fb277278505', 'body': {'pause': {}}} Aug 31 16:24:05.694880 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:24:05.694880 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:24:05.694880 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Aug 31 16:24:05.694880 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Aug 31 16:24:05.694880 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 16:24:05.694880 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 16:24:05.694880 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 31 16:24:05.694880 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 31 16:24:05.694880 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 22082563-385d-41a9-baa5-6fb277278505 in vm_state paused. Cannot pause while the instance is in this state. Aug 31 16:24:05.694880 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:24:05.694880 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:24:05.694880 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:24:05.694880 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:24:05.694880 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:24:05.694880 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:24:05.694880 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:24:05.694880 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:24:05.694880 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:24:05.694880 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:24:05.694880 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Aug 31 16:24:05.694880 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 31 16:24:05.694880 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 31 16:24:05.694880 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 31 16:24:05.694880 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 22082563-385d-41a9-baa5-6fb277278505 while it is in vm_state paused Aug 31 16:24:05.694880 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:24:05.694880 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:24:05.694880 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:24:05.694880 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:24:05.694880 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:24:05.702316 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:24:05.702316 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:24:05.702316 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:24:05.702316 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 22082563-385d-41a9-baa5-6fb277278505 while it is in vm_state paused Aug 31 16:24:05.702316 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:24:05.708416 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c3a92c44-f49e-436d-942e-6ae40fd55e29 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Returning 409 to user: Cannot 'pause' instance 22082563-385d-41a9-baa5-6fb277278505 while it is in vm_state paused {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:24:05.710876 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c3a92c44-f49e-436d-942e-6ae40fd55e29 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "POST /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505/action" status: 409 len: 143 microversion: 2.1 time: 0.235739 Aug 31 16:24:05.712714 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2659/5288] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:24:05 2022] POST /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505/action => generated 143 bytes in 239 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 31 16:24:05.737749 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-628ed7d2-6c3f-4eba-9897-80271f7b6b28 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:24:05.738776 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-628ed7d2-6c3f-4eba-9897-80271f7b6b28 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:05.747316 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-628ed7d2-6c3f-4eba-9897-80271f7b6b28 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:05.748285 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-628ed7d2-6c3f-4eba-9897-80271f7b6b28 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:05.748978 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-628ed7d2-6c3f-4eba-9897-80271f7b6b28 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:05.750076 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-628ed7d2-6c3f-4eba-9897-80271f7b6b28 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:05.750967 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-628ed7d2-6c3f-4eba-9897-80271f7b6b28 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:05.751732 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-628ed7d2-6c3f-4eba-9897-80271f7b6b28 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:05.873396 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=100 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:24:05.928565 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-628ed7d2-6c3f-4eba-9897-80271f7b6b28 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "POST /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505/action" status: 202 len: 0 microversion: 2.1 time: 0.198729 Aug 31 16:24:05.938218 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2660/5289] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:24:05 2022] POST /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505/action => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:24:05.965846 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e5edb865-e268-4ec2-b1bb-f10295fd9964 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:05.967295 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e5edb865-e268-4ec2-b1bb-f10295fd9964 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:05.996615 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e5edb865-e268-4ec2-b1bb-f10295fd9964 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:06.004511 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e5edb865-e268-4ec2-b1bb-f10295fd9964 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:06.005441 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e5edb865-e268-4ec2-b1bb-f10295fd9964 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:06.006784 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e5edb865-e268-4ec2-b1bb-f10295fd9964 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:06.007693 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e5edb865-e268-4ec2-b1bb-f10295fd9964 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:06.015308 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e5edb865-e268-4ec2-b1bb-f10295fd9964 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:06.358418 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-9756b027-1886-401f-af2d-fabf7fdd4cce tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:06.438188 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-9756b027-1886-401f-af2d-fabf7fdd4cce tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:06.445256 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-9756b027-1886-401f-af2d-fabf7fdd4cce tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:06.459803 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9756b027-1886-401f-af2d-fabf7fdd4cce tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5" status: 200 len: 1810 microversion: 2.20 time: 1.412674 Aug 31 16:24:06.463265 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2630/5290] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:24:05 2022] GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5 => generated 1810 bytes in 1418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:24:06.623482 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e5edb865-e268-4ec2-b1bb-f10295fd9964 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:06.638980 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e5edb865-e268-4ec2-b1bb-f10295fd9964 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1496 microversion: 2.1 time: 0.697456 Aug 31 16:24:06.640783 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2661/5291] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:05 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1496 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:07.492449 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-db5e0336-5c4a-4551-9542-7ce50ee3c5b2 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:07.493946 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-db5e0336-5c4a-4551-9542-7ce50ee3c5b2 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:07.513083 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-db5e0336-5c4a-4551-9542-7ce50ee3c5b2 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:07.513737 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-db5e0336-5c4a-4551-9542-7ce50ee3c5b2 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:07.514328 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-db5e0336-5c4a-4551-9542-7ce50ee3c5b2 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:07.515520 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-db5e0336-5c4a-4551-9542-7ce50ee3c5b2 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:07.523393 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-db5e0336-5c4a-4551-9542-7ce50ee3c5b2 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:07.524038 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-db5e0336-5c4a-4551-9542-7ce50ee3c5b2 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:07.684732 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-19b31618-fd68-41f3-af0e-8e1a4181c243 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:07.692736 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-19b31618-fd68-41f3-af0e-8e1a4181c243 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:07.723092 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-19b31618-fd68-41f3-af0e-8e1a4181c243 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:07.724276 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-19b31618-fd68-41f3-af0e-8e1a4181c243 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:07.726388 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-19b31618-fd68-41f3-af0e-8e1a4181c243 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:07.740306 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-19b31618-fd68-41f3-af0e-8e1a4181c243 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:07.741359 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-19b31618-fd68-41f3-af0e-8e1a4181c243 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:07.742250 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-19b31618-fd68-41f3-af0e-8e1a4181c243 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:08.481736 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-db5e0336-5c4a-4551-9542-7ce50ee3c5b2 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:08.502930 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-db5e0336-5c4a-4551-9542-7ce50ee3c5b2 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:08.510460 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-db5e0336-5c4a-4551-9542-7ce50ee3c5b2 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:08.514324 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-db5e0336-5c4a-4551-9542-7ce50ee3c5b2 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5" status: 200 len: 1810 microversion: 2.20 time: 1.028021 Aug 31 16:24:08.525543 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-19b31618-fd68-41f3-af0e-8e1a4181c243 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:08.535093 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2631/5292] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:24:07 2022] GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5 => generated 1810 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:24:08.542485 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-19b31618-fd68-41f3-af0e-8e1a4181c243 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1504 microversion: 2.1 time: 0.874631 Aug 31 16:24:08.555562 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2662/5293] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:07 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1504 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:24:08.588484 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c9847af5-5a08-4251-811e-6740c75af45e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:08.594442 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c9847af5-5a08-4251-811e-6740c75af45e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:08.629140 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c9847af5-5a08-4251-811e-6740c75af45e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:08.632719 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c9847af5-5a08-4251-811e-6740c75af45e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:08.635396 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c9847af5-5a08-4251-811e-6740c75af45e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:08.636714 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c9847af5-5a08-4251-811e-6740c75af45e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:08.643444 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c9847af5-5a08-4251-811e-6740c75af45e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:08.644185 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c9847af5-5a08-4251-811e-6740c75af45e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:09.570937 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ba8861a1-9fb3-4da9-b658-d078edf0f358 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:09.572551 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ba8861a1-9fb3-4da9-b658-d078edf0f358 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:09.600117 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ba8861a1-9fb3-4da9-b658-d078edf0f358 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:09.600868 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ba8861a1-9fb3-4da9-b658-d078edf0f358 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:09.601324 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ba8861a1-9fb3-4da9-b658-d078edf0f358 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:09.602937 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ba8861a1-9fb3-4da9-b658-d078edf0f358 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:09.603657 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ba8861a1-9fb3-4da9-b658-d078edf0f358 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:09.604475 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ba8861a1-9fb3-4da9-b658-d078edf0f358 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:10.078961 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c9847af5-5a08-4251-811e-6740c75af45e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:10.100052 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c9847af5-5a08-4251-811e-6740c75af45e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1504 microversion: 2.1 time: 1.522202 Aug 31 16:24:10.100951 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2632/5294] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:08 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1504 bytes in 1527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:10.132976 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5617346f-1d74-4d71-8a7f-3ccf56607d7d tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:24:10.135671 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5617346f-1d74-4d71-8a7f-3ccf56607d7d tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 4399d570-dda9-4a5a-921c-d76d95f0a6f5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:10.146082 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5617346f-1d74-4d71-8a7f-3ccf56607d7d tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:10.146591 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5617346f-1d74-4d71-8a7f-3ccf56607d7d tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:10.147046 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5617346f-1d74-4d71-8a7f-3ccf56607d7d tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:10.147869 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5617346f-1d74-4d71-8a7f-3ccf56607d7d tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:10.148341 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5617346f-1d74-4d71-8a7f-3ccf56607d7d tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:10.148894 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5617346f-1d74-4d71-8a7f-3ccf56607d7d tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:10.216489 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-5617346f-1d74-4d71-8a7f-3ccf56607d7d tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] HTTP exception thrown: Instance 4399d570-dda9-4a5a-921c-d76d95f0a6f5 could not be found. Aug 31 16:24:10.226521 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5617346f-1d74-4d71-8a7f-3ccf56607d7d tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Request method failure captured: Aug 31 16:24:10.226521 n-d-850499-9 devstack@n-api.service[122256]: request: POST /compute/v2.1/servers/4399d570-dda9-4a5a-921c-d76d95f0a6f5/action HTTP/1.1 Aug 31 16:24:10.226521 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:24:10.226521 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:24:10.226521 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:24:10.226521 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 28 Aug 31 16:24:10.226521 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:24:10.226521 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:24:10.226521 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:24:10.226521 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:24:10.226521 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4q2NcJzZutw3Y6jF4GnmJD1H1MzSLIbHjRxunPVSp6uKTRmCePfT1DyksG9QgDfSYnSoM0q9vOxO3sqZKoJ5PA2HppEXRHLLn8jTh4ccTKQ6q8SYb3pqui6kOFW5_PmtYr9N0lihJC0EStA4OYRI4QsHOxwmGiiVscbhBZpLyiKmV0 Aug 31 16:24:10.226521 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:24:10.226521 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:24:10.226521 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:24:10.226521 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:24:10.226521 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:24:10.226521 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:24:10.226521 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 014522b19dc349a691e1f6b131229974 Aug 31 16:24:10.226521 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:24:10.226521 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:24:10.226521 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:24:10.226521 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/014522b19dc349a691e1f6b131229974"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/014522b19dc349a691e1f6b131229974"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_014522b19dc349a691e1f6b131229974", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/014522b19dc349a691e1f6b131229974"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:24:10.226521 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:24:10.226521 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 014522b19dc349a691e1f6b131229974 Aug 31 16:24:10.226521 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:24:10.226521 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ServersNegativeTestJSON-918151355-project Aug 31 16:24:10.226521 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:24:10.226521 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:24:10.226521 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: c042c43cc2aa4000a147fae62c261e86 Aug 31 16:24:10.226521 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ServersNegativeTestJSON-918151355-project Aug 31 16:24:10.226521 n-d-850499-9 devstack@n-api.service[122256]: Aug 31 16:24:10.226521 n-d-850499-9 devstack@n-api.service[122256]: {"reboot": {"type": "SOFT"}} Aug 31 16:24:10.226521 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:24:10.226521 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance 4399d570-dda9-4a5a-921c-d76d95f0a6f5 could not be found. Aug 31 16:24:10.226521 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '4399d570-dda9-4a5a-921c-d76d95f0a6f5', 'body': {'reboot': {'type': 'SOFT'}}} Aug 31 16:24:10.226521 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:24:10.226521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:24:10.226521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:24:10.226521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:24:10.226521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:24:10.226521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:24:10.226521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:24:10.226521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:24:10.226521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:24:10.226521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:24:10.226521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4399d570-dda9-4a5a-921c-d76d95f0a6f5 could not be found. Aug 31 16:24:10.226521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:24:10.226521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:24:10.226521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:24:10.226521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:24:10.226521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:24:10.226521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:24:10.226521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:24:10.226521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:24:10.226521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:24:10.226521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:24:10.226521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:24:10.226521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:24:10.226521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Aug 31 16:24:10.226521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 31 16:24:10.226521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:24:10.226521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:24:10.226521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:24:10.226521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:24:10.232719 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4399d570-dda9-4a5a-921c-d76d95f0a6f5 could not be found. Aug 31 16:24:10.232719 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:24:10.232719 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:24:10.232719 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:24:10.232719 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:24:10.232719 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:24:10.232719 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:24:10.232719 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:24:10.232719 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:24:10.232719 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4399d570-dda9-4a5a-921c-d76d95f0a6f5 could not be found. Aug 31 16:24:10.232719 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:24:10.235385 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5617346f-1d74-4d71-8a7f-3ccf56607d7d tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Returning 404 to user: Instance 4399d570-dda9-4a5a-921c-d76d95f0a6f5 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:24:10.236665 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5617346f-1d74-4d71-8a7f-3ccf56607d7d tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "POST /compute/v2.1/servers/4399d570-dda9-4a5a-921c-d76d95f0a6f5/action" status: 404 len: 111 microversion: 2.1 time: 0.111717 Aug 31 16:24:10.237824 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2633/5295] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:24:10 2022] POST /compute/v2.1/servers/4399d570-dda9-4a5a-921c-d76d95f0a6f5/action => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 16:24:10.254452 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ba8861a1-9fb3-4da9-b658-d078edf0f358 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:10.266575 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3b9dacf3-e86c-449a-ba18-d9a55109f233 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:10.268308 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3b9dacf3-e86c-449a-ba18-d9a55109f233 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:10.294062 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ba8861a1-9fb3-4da9-b658-d078edf0f358 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:10.299030 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3b9dacf3-e86c-449a-ba18-d9a55109f233 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:10.304329 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3b9dacf3-e86c-449a-ba18-d9a55109f233 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:10.305111 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3b9dacf3-e86c-449a-ba18-d9a55109f233 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:10.306451 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ba8861a1-9fb3-4da9-b658-d078edf0f358 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:10.311736 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3b9dacf3-e86c-449a-ba18-d9a55109f233 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:10.314562 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ba8861a1-9fb3-4da9-b658-d078edf0f358 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5" status: 200 len: 1810 microversion: 2.20 time: 0.752991 Aug 31 16:24:10.315822 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3b9dacf3-e86c-449a-ba18-d9a55109f233 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:10.316963 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3b9dacf3-e86c-449a-ba18-d9a55109f233 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:10.349685 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2663/5296] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:24:09 2022] GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5 => generated 1810 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:24:10.846833 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3b9dacf3-e86c-449a-ba18-d9a55109f233 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:10.867464 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3b9dacf3-e86c-449a-ba18-d9a55109f233 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1504 microversion: 2.1 time: 0.624741 Aug 31 16:24:10.871468 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2634/5297] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:10 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1504 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:10.895771 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-56f5aefa-14f8-460e-bb46-da9856cce624 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:10.896664 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-56f5aefa-14f8-460e-bb46-da9856cce624 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:10.930461 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-56f5aefa-14f8-460e-bb46-da9856cce624 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:10.934047 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-56f5aefa-14f8-460e-bb46-da9856cce624 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:10.935177 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-56f5aefa-14f8-460e-bb46-da9856cce624 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:10.936758 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-56f5aefa-14f8-460e-bb46-da9856cce624 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:10.937847 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-56f5aefa-14f8-460e-bb46-da9856cce624 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:10.938843 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-56f5aefa-14f8-460e-bb46-da9856cce624 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:11.307487 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3c663043-201f-42a0-a84e-ac46e4d21cc1 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f775e3fd-3bb1-468f-8a57-c9c7fea1f913"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:24:11.311377 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3c663043-201f-42a0-a84e-ac46e4d21cc1 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: d1c50fa6-2d8a-4707-9ee7-448ea57be62b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:11.331631 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3c663043-201f-42a0-a84e-ac46e4d21cc1 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:11.334382 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3c663043-201f-42a0-a84e-ac46e4d21cc1 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:11.348780 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3c663043-201f-42a0-a84e-ac46e4d21cc1 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:11.350295 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3c663043-201f-42a0-a84e-ac46e4d21cc1 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:11.352831 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3c663043-201f-42a0-a84e-ac46e4d21cc1 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:11.352831 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3c663043-201f-42a0-a84e-ac46e4d21cc1 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:11.518363 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-56f5aefa-14f8-460e-bb46-da9856cce624 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:11.535402 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-56f5aefa-14f8-460e-bb46-da9856cce624 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1504 microversion: 2.1 time: 0.641290 Aug 31 16:24:11.537758 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2664/5298] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:10 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1504 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:11.549730 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4a64983b-d44e-453a-ac6f-bad9a3943f36 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:11.551052 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4a64983b-d44e-453a-ac6f-bad9a3943f36 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:11.565523 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4a64983b-d44e-453a-ac6f-bad9a3943f36 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:11.567985 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4a64983b-d44e-453a-ac6f-bad9a3943f36 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:11.580572 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4a64983b-d44e-453a-ac6f-bad9a3943f36 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:11.586059 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4a64983b-d44e-453a-ac6f-bad9a3943f36 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:11.587069 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4a64983b-d44e-453a-ac6f-bad9a3943f36 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:11.587919 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4a64983b-d44e-453a-ac6f-bad9a3943f36 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:12.155669 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-4a64983b-d44e-453a-ac6f-bad9a3943f36 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:12.218160 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-4a64983b-d44e-453a-ac6f-bad9a3943f36 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:12.220649 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3c663043-201f-42a0-a84e-ac46e4d21cc1 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "POST /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.924044 Aug 31 16:24:12.230322 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-4a64983b-d44e-453a-ac6f-bad9a3943f36 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:12.238506 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4a64983b-d44e-453a-ac6f-bad9a3943f36 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5" status: 200 len: 1810 microversion: 2.20 time: 0.697002 Aug 31 16:24:12.242198 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2665/5299] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:24:11 2022] GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5 => generated 1810 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:24:12.247360 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2635/5300] 10.222.0.61 () {60 vars in 1323 bytes} [Wed Aug 31 16:24:11 2022] POST /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b/os-volume_attachments => generated 194 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:24:12.272518 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3a1191d5-669b-4755-9a99-bf8db9e8e6b2 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:24:12.280794 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3a1191d5-669b-4755-9a99-bf8db9e8e6b2 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 4f44ec16-0541-47e4-827e-400eed68b70c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:12.300030 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-3a1191d5-669b-4755-9a99-bf8db9e8e6b2 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] HTTP exception thrown: Instance 4f44ec16-0541-47e4-827e-400eed68b70c could not be found. Aug 31 16:24:12.302215 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3a1191d5-669b-4755-9a99-bf8db9e8e6b2 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Request method failure captured: Aug 31 16:24:12.302215 n-d-850499-9 devstack@n-api.service[122257]: request: POST /compute/v2.1/servers/4f44ec16-0541-47e4-827e-400eed68b70c/action HTTP/1.1 Aug 31 16:24:12.302215 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:24:12.302215 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:24:12.302215 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:24:12.302215 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 28 Aug 31 16:24:12.302215 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:24:12.302215 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:24:12.302215 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:24:12.302215 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:24:12.302215 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4q2NcJzZutw3Y6jF4GnmJD1H1MzSLIbHjRxunPVSp6uKTRmCePfT1DyksG9QgDfSYnSoM0q9vOxO3sqZKoJ5PA2HppEXRHLLn8jTh4ccTKQ6q8SYb3pqui6kOFW5_PmtYr9N0lihJC0EStA4OYRI4QsHOxwmGiiVscbhBZpLyiKmV0 Aug 31 16:24:12.302215 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:24:12.302215 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:24:12.302215 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:24:12.302215 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:24:12.302215 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:24:12.302215 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:24:12.302215 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 014522b19dc349a691e1f6b131229974 Aug 31 16:24:12.302215 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:24:12.302215 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:24:12.302215 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:24:12.302215 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/014522b19dc349a691e1f6b131229974"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/014522b19dc349a691e1f6b131229974"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_014522b19dc349a691e1f6b131229974", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/014522b19dc349a691e1f6b131229974"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:24:12.302215 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:24:12.302215 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 014522b19dc349a691e1f6b131229974 Aug 31 16:24:12.302215 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:24:12.302215 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ServersNegativeTestJSON-918151355-project Aug 31 16:24:12.302215 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:24:12.302215 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:24:12.302215 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: c042c43cc2aa4000a147fae62c261e86 Aug 31 16:24:12.302215 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ServersNegativeTestJSON-918151355-project Aug 31 16:24:12.302215 n-d-850499-9 devstack@n-api.service[122257]: Aug 31 16:24:12.302215 n-d-850499-9 devstack@n-api.service[122257]: {"reboot": {"type": "SOFT"}} Aug 31 16:24:12.302215 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:24:12.302215 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance 4f44ec16-0541-47e4-827e-400eed68b70c could not be found. Aug 31 16:24:12.302215 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '4f44ec16-0541-47e4-827e-400eed68b70c', 'body': {'reboot': {'type': 'SOFT'}}} Aug 31 16:24:12.302215 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:24:12.302215 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:24:12.302215 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:24:12.302215 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:24:12.302215 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:24:12.302215 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:24:12.302215 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 31 16:24:12.302215 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 31 16:24:12.302215 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f44ec16-0541-47e4-827e-400eed68b70c could not be found. Aug 31 16:24:12.302215 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:24:12.302215 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:24:12.302215 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:24:12.302215 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:24:12.302215 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:24:12.302215 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:24:12.302215 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:24:12.302215 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:24:12.302215 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:24:12.302215 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:24:12.302215 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:24:12.302215 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:24:12.302215 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Aug 31 16:24:12.302215 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 31 16:24:12.302215 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:24:12.302215 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:24:12.302215 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:24:12.302215 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:24:12.302215 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f44ec16-0541-47e4-827e-400eed68b70c could not be found. Aug 31 16:24:12.302215 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:24:12.307920 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:24:12.307920 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:24:12.307920 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:24:12.307920 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:24:12.307920 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:24:12.307920 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:24:12.307920 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:24:12.307920 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f44ec16-0541-47e4-827e-400eed68b70c could not be found. Aug 31 16:24:12.307920 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:24:12.313077 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3a1191d5-669b-4755-9a99-bf8db9e8e6b2 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Returning 404 to user: Instance 4f44ec16-0541-47e4-827e-400eed68b70c could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:24:12.314473 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3a1191d5-669b-4755-9a99-bf8db9e8e6b2 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "POST /compute/v2.1/servers/4f44ec16-0541-47e4-827e-400eed68b70c/action" status: 404 len: 111 microversion: 2.1 time: 0.065436 Aug 31 16:24:12.315292 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2666/5301] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:24:12 2022] POST /compute/v2.1/servers/4f44ec16-0541-47e4-827e-400eed68b70c/action => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:24:12.351731 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4d3543b6-2da8-4429-a3c6-cabf6bcbe350 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:12.352991 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4d3543b6-2da8-4429-a3c6-cabf6bcbe350 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:12.405067 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4d3543b6-2da8-4429-a3c6-cabf6bcbe350 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:12.409578 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4d3543b6-2da8-4429-a3c6-cabf6bcbe350 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:12.410950 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4d3543b6-2da8-4429-a3c6-cabf6bcbe350 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:12.411730 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4d3543b6-2da8-4429-a3c6-cabf6bcbe350 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:12.412261 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4d3543b6-2da8-4429-a3c6-cabf6bcbe350 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:12.422002 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4d3543b6-2da8-4429-a3c6-cabf6bcbe350 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:13.280035 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-67f97851-0cb3-48d7-846d-72fe64be593b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:13.286571 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-67f97851-0cb3-48d7-846d-72fe64be593b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:13.358381 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-67f97851-0cb3-48d7-846d-72fe64be593b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:13.364598 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-67f97851-0cb3-48d7-846d-72fe64be593b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:13.374160 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-67f97851-0cb3-48d7-846d-72fe64be593b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:13.377222 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-67f97851-0cb3-48d7-846d-72fe64be593b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:13.378602 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-67f97851-0cb3-48d7-846d-72fe64be593b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:13.381023 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-67f97851-0cb3-48d7-846d-72fe64be593b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:13.566723 n-d-850499-9 devstack@n-api.service[122257]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 16:24:13.566991 n-d-850499-9 devstack@n-api.service[122257]: Wed Aug 31 16:24:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5 (ip 10.222.0.61) !!! Aug 31 16:24:13.794934 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-4d3543b6-2da8-4429-a3c6-cabf6bcbe350 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:13.814506 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4d3543b6-2da8-4429-a3c6-cabf6bcbe350 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1504 microversion: 2.1 time: 1.492248 Aug 31 16:24:13.828246 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2636/5302] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:12 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1504 bytes in 1508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:24:13.855605 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e2dcc6a0-d19a-4806-8142-95c646e78cd1 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:13.856818 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e2dcc6a0-d19a-4806-8142-95c646e78cd1 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:13.897217 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e2dcc6a0-d19a-4806-8142-95c646e78cd1 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:13.900078 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e2dcc6a0-d19a-4806-8142-95c646e78cd1 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:13.903969 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e2dcc6a0-d19a-4806-8142-95c646e78cd1 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:13.905742 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e2dcc6a0-d19a-4806-8142-95c646e78cd1 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:13.912762 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e2dcc6a0-d19a-4806-8142-95c646e78cd1 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:13.914717 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e2dcc6a0-d19a-4806-8142-95c646e78cd1 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:13.923266 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-67f97851-0cb3-48d7-846d-72fe64be593b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:13.939272 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-67f97851-0cb3-48d7-846d-72fe64be593b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:13.941232 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-67f97851-0cb3-48d7-846d-72fe64be593b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:13.942785 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-67f97851-0cb3-48d7-846d-72fe64be593b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5" status: 200 len: 1810 microversion: 2.20 time: 0.671868 Aug 31 16:24:13.945708 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2667/5303] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:24:13 2022] GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5 => generated 1810 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:24:14.287749 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e2dcc6a0-d19a-4806-8142-95c646e78cd1 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:14.309140 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e2dcc6a0-d19a-4806-8142-95c646e78cd1 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1504 microversion: 2.1 time: 0.469008 Aug 31 16:24:14.325358 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2637/5304] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:13 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1504 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:14.339626 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6ad6e275-6514-451a-989c-01988f66312a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:24:14.340444 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6ad6e275-6514-451a-989c-01988f66312a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 4399d570-dda9-4a5a-921c-d76d95f0a6f5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:14.356979 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6ad6e275-6514-451a-989c-01988f66312a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:14.358037 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6ad6e275-6514-451a-989c-01988f66312a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:14.365048 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6ad6e275-6514-451a-989c-01988f66312a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:14.366638 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6ad6e275-6514-451a-989c-01988f66312a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:14.367817 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6ad6e275-6514-451a-989c-01988f66312a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:14.368777 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6ad6e275-6514-451a-989c-01988f66312a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:14.413377 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-6ad6e275-6514-451a-989c-01988f66312a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] HTTP exception thrown: Instance 4399d570-dda9-4a5a-921c-d76d95f0a6f5 could not be found. Aug 31 16:24:14.416651 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6ad6e275-6514-451a-989c-01988f66312a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Request method failure captured: Aug 31 16:24:14.416651 n-d-850499-9 devstack@n-api.service[122257]: request: POST /compute/v2.1/servers/4399d570-dda9-4a5a-921c-d76d95f0a6f5/action HTTP/1.1 Aug 31 16:24:14.416651 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:24:14.416651 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:24:14.416651 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:24:14.416651 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 65 Aug 31 16:24:14.416651 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:24:14.416651 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:24:14.416651 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:24:14.416651 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:24:14.416651 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4q2NcJzZutw3Y6jF4GnmJD1H1MzSLIbHjRxunPVSp6uKTRmCePfT1DyksG9QgDfSYnSoM0q9vOxO3sqZKoJ5PA2HppEXRHLLn8jTh4ccTKQ6q8SYb3pqui6kOFW5_PmtYr9N0lihJC0EStA4OYRI4QsHOxwmGiiVscbhBZpLyiKmV0 Aug 31 16:24:14.416651 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:24:14.416651 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:24:14.416651 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:24:14.416651 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:24:14.416651 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:24:14.416651 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:24:14.416651 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 014522b19dc349a691e1f6b131229974 Aug 31 16:24:14.416651 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:24:14.416651 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:24:14.416651 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:24:14.416651 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/014522b19dc349a691e1f6b131229974"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/014522b19dc349a691e1f6b131229974"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_014522b19dc349a691e1f6b131229974", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/014522b19dc349a691e1f6b131229974"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:24:14.416651 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:24:14.416651 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 014522b19dc349a691e1f6b131229974 Aug 31 16:24:14.416651 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:24:14.416651 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ServersNegativeTestJSON-918151355-project Aug 31 16:24:14.416651 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:24:14.416651 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:24:14.416651 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: c042c43cc2aa4000a147fae62c261e86 Aug 31 16:24:14.416651 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ServersNegativeTestJSON-918151355-project Aug 31 16:24:14.416651 n-d-850499-9 devstack@n-api.service[122257]: Aug 31 16:24:14.416651 n-d-850499-9 devstack@n-api.service[122257]: {"rebuild": {"imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413"}} Aug 31 16:24:14.416651 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:24:14.416651 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance 4399d570-dda9-4a5a-921c-d76d95f0a6f5 could not be found. Aug 31 16:24:14.416651 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '4399d570-dda9-4a5a-921c-d76d95f0a6f5', 'body': {'rebuild': {'imageRef': 'b9c36d42-ed46-4bf5-ad18-1df45cbd0413'}}} Aug 31 16:24:14.416651 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:24:14.416651 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:24:14.416651 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:24:14.416651 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:24:14.416651 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:24:14.416651 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:24:14.416651 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:24:14.416651 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:24:14.416651 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:24:14.416651 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:24:14.416651 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4399d570-dda9-4a5a-921c-d76d95f0a6f5 could not be found. Aug 31 16:24:14.416651 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:24:14.416651 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:24:14.416651 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:24:14.416651 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:24:14.416651 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:24:14.416651 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:24:14.416651 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:24:14.416651 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:24:14.416651 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:24:14.416651 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:24:14.416651 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:24:14.416651 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:24:14.416651 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:24:14.416651 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:24:14.416651 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:24:14.416651 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:24:14.416651 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 31 16:24:14.416651 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Aug 31 16:24:14.422898 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 31 16:24:14.422898 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:24:14.422898 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:24:14.422898 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:24:14.422898 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:24:14.422898 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4399d570-dda9-4a5a-921c-d76d95f0a6f5 could not be found. Aug 31 16:24:14.422898 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:24:14.422898 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:24:14.422898 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:24:14.422898 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:24:14.422898 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:24:14.422898 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:24:14.422898 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:24:14.422898 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:24:14.422898 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4399d570-dda9-4a5a-921c-d76d95f0a6f5 could not be found. Aug 31 16:24:14.422898 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:24:14.422898 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6ad6e275-6514-451a-989c-01988f66312a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Returning 404 to user: Instance 4399d570-dda9-4a5a-921c-d76d95f0a6f5 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:24:14.435205 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6ad6e275-6514-451a-989c-01988f66312a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "POST /compute/v2.1/servers/4399d570-dda9-4a5a-921c-d76d95f0a6f5/action" status: 404 len: 111 microversion: 2.1 time: 0.103723 Aug 31 16:24:14.439072 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2668/5305] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:24:14 2022] POST /compute/v2.1/servers/4399d570-dda9-4a5a-921c-d76d95f0a6f5/action => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:24:14.452335 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1d449b33-5751-40d9-8f30-6bd1ca5799c5 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:14.453534 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1d449b33-5751-40d9-8f30-6bd1ca5799c5 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:14.518766 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1d449b33-5751-40d9-8f30-6bd1ca5799c5 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:14.522007 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1d449b33-5751-40d9-8f30-6bd1ca5799c5 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:14.524083 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1d449b33-5751-40d9-8f30-6bd1ca5799c5 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:14.526731 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1d449b33-5751-40d9-8f30-6bd1ca5799c5 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:14.529943 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1d449b33-5751-40d9-8f30-6bd1ca5799c5 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:14.532876 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1d449b33-5751-40d9-8f30-6bd1ca5799c5 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:14.993090 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3f5ceced-bd2c-44a7-b94a-3cd3bcbe18bb tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:14.995274 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3f5ceced-bd2c-44a7-b94a-3cd3bcbe18bb tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:15.030609 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3f5ceced-bd2c-44a7-b94a-3cd3bcbe18bb tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:15.033862 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3f5ceced-bd2c-44a7-b94a-3cd3bcbe18bb tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:15.035067 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3f5ceced-bd2c-44a7-b94a-3cd3bcbe18bb tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:15.037002 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3f5ceced-bd2c-44a7-b94a-3cd3bcbe18bb tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:15.039389 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3f5ceced-bd2c-44a7-b94a-3cd3bcbe18bb tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:15.040747 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3f5ceced-bd2c-44a7-b94a-3cd3bcbe18bb tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:15.822246 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1d449b33-5751-40d9-8f30-6bd1ca5799c5 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:15.855658 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1d449b33-5751-40d9-8f30-6bd1ca5799c5 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1504 microversion: 2.1 time: 1.404351 Aug 31 16:24:15.856846 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2638/5306] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:14 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1504 bytes in 1413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:24:15.866301 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3f5ceced-bd2c-44a7-b94a-3cd3bcbe18bb tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:15.899912 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3f5ceced-bd2c-44a7-b94a-3cd3bcbe18bb tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:15.901525 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8b34b230-935c-4cb9-b6ce-243e7e9203b0 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:15.905916 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8b34b230-935c-4cb9-b6ce-243e7e9203b0 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:15.908708 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3f5ceced-bd2c-44a7-b94a-3cd3bcbe18bb tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:15.912095 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3f5ceced-bd2c-44a7-b94a-3cd3bcbe18bb tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5" status: 200 len: 1810 microversion: 2.20 time: 0.925767 Aug 31 16:24:15.914592 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2669/5307] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:24:14 2022] GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5 => generated 1810 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:24:15.924273 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=56 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:24:15.931817 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8b34b230-935c-4cb9-b6ce-243e7e9203b0 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:15.934197 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8b34b230-935c-4cb9-b6ce-243e7e9203b0 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:15.936785 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8b34b230-935c-4cb9-b6ce-243e7e9203b0 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:15.951275 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8b34b230-935c-4cb9-b6ce-243e7e9203b0 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:15.956932 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8b34b230-935c-4cb9-b6ce-243e7e9203b0 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:15.971747 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8b34b230-935c-4cb9-b6ce-243e7e9203b0 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:16.430686 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8b34b230-935c-4cb9-b6ce-243e7e9203b0 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:16.474021 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8b34b230-935c-4cb9-b6ce-243e7e9203b0 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1504 microversion: 2.1 time: 0.582617 Aug 31 16:24:16.514665 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2639/5308] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:15 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1504 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:24:16.523962 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6946de61-5ceb-4acf-b35b-24514517ed19 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:24:16.530383 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6946de61-5ceb-4acf-b35b-24514517ed19 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 5151770f-df92-4e2d-a593-fed960fc1a95] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:16.539854 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=64 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:24:16.560511 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-6946de61-5ceb-4acf-b35b-24514517ed19 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] HTTP exception thrown: Instance 5151770f-df92-4e2d-a593-fed960fc1a95 could not be found. Aug 31 16:24:16.587883 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6946de61-5ceb-4acf-b35b-24514517ed19 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Request method failure captured: Aug 31 16:24:16.587883 n-d-850499-9 devstack@n-api.service[122257]: request: POST /compute/v2.1/servers/5151770f-df92-4e2d-a593-fed960fc1a95/action HTTP/1.1 Aug 31 16:24:16.587883 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:24:16.587883 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:24:16.587883 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:24:16.587883 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 65 Aug 31 16:24:16.587883 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:24:16.587883 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:24:16.587883 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:24:16.587883 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:24:16.587883 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4q2NcJzZutw3Y6jF4GnmJD1H1MzSLIbHjRxunPVSp6uKTRmCePfT1DyksG9QgDfSYnSoM0q9vOxO3sqZKoJ5PA2HppEXRHLLn8jTh4ccTKQ6q8SYb3pqui6kOFW5_PmtYr9N0lihJC0EStA4OYRI4QsHOxwmGiiVscbhBZpLyiKmV0 Aug 31 16:24:16.587883 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:24:16.587883 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:24:16.587883 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:24:16.587883 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:24:16.587883 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:24:16.587883 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:24:16.587883 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 014522b19dc349a691e1f6b131229974 Aug 31 16:24:16.587883 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:24:16.587883 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:24:16.587883 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:24:16.587883 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/014522b19dc349a691e1f6b131229974"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/014522b19dc349a691e1f6b131229974"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_014522b19dc349a691e1f6b131229974", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/014522b19dc349a691e1f6b131229974"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:24:16.587883 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:24:16.587883 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 014522b19dc349a691e1f6b131229974 Aug 31 16:24:16.587883 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:24:16.587883 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ServersNegativeTestJSON-918151355-project Aug 31 16:24:16.587883 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:24:16.587883 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:24:16.587883 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: c042c43cc2aa4000a147fae62c261e86 Aug 31 16:24:16.587883 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ServersNegativeTestJSON-918151355-project Aug 31 16:24:16.587883 n-d-850499-9 devstack@n-api.service[122257]: Aug 31 16:24:16.587883 n-d-850499-9 devstack@n-api.service[122257]: {"rebuild": {"imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413"}} Aug 31 16:24:16.587883 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:24:16.587883 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance 5151770f-df92-4e2d-a593-fed960fc1a95 could not be found. Aug 31 16:24:16.587883 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '5151770f-df92-4e2d-a593-fed960fc1a95', 'body': {'rebuild': {'imageRef': 'b9c36d42-ed46-4bf5-ad18-1df45cbd0413'}}} Aug 31 16:24:16.587883 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:24:16.587883 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:24:16.587883 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:24:16.587883 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:24:16.587883 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:24:16.587883 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:24:16.587883 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 31 16:24:16.587883 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 31 16:24:16.587883 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5151770f-df92-4e2d-a593-fed960fc1a95 could not be found. Aug 31 16:24:16.587883 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:24:16.587883 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:24:16.587883 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:24:16.587883 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:24:16.587883 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:24:16.587883 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:24:16.587883 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:24:16.587883 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:24:16.587883 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:24:16.587883 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:24:16.587883 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:24:16.587883 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:24:16.587883 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:24:16.587883 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:24:16.587883 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:24:16.587883 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:24:16.587883 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 31 16:24:16.587883 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Aug 31 16:24:16.587883 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 31 16:24:16.587883 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:24:16.598793 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:24:16.598793 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:24:16.598793 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:24:16.598793 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5151770f-df92-4e2d-a593-fed960fc1a95 could not be found. Aug 31 16:24:16.598793 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:24:16.598793 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:24:16.598793 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:24:16.598793 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:24:16.598793 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:24:16.598793 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:24:16.598793 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:24:16.598793 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:24:16.598793 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5151770f-df92-4e2d-a593-fed960fc1a95 could not be found. Aug 31 16:24:16.598793 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:24:16.607470 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6946de61-5ceb-4acf-b35b-24514517ed19 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Returning 404 to user: Instance 5151770f-df92-4e2d-a593-fed960fc1a95 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:24:16.615526 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6946de61-5ceb-4acf-b35b-24514517ed19 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "POST /compute/v2.1/servers/5151770f-df92-4e2d-a593-fed960fc1a95/action" status: 404 len: 111 microversion: 2.1 time: 0.098647 Aug 31 16:24:16.624330 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2670/5309] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:24:16 2022] POST /compute/v2.1/servers/5151770f-df92-4e2d-a593-fed960fc1a95/action => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 16:24:16.636199 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-047f9614-e643-4641-a089-cdb0f1e6bfc4 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:16.642785 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-047f9614-e643-4641-a089-cdb0f1e6bfc4 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:16.700062 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-047f9614-e643-4641-a089-cdb0f1e6bfc4 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:16.705063 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-047f9614-e643-4641-a089-cdb0f1e6bfc4 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:16.706004 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-047f9614-e643-4641-a089-cdb0f1e6bfc4 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:16.711876 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-047f9614-e643-4641-a089-cdb0f1e6bfc4 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:16.717261 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-047f9614-e643-4641-a089-cdb0f1e6bfc4 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:16.718096 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-047f9614-e643-4641-a089-cdb0f1e6bfc4 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:16.965415 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0e4bb60d-a97e-48d8-a3ed-9811ed775cbd tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:16.971118 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0e4bb60d-a97e-48d8-a3ed-9811ed775cbd tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:16.998154 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0e4bb60d-a97e-48d8-a3ed-9811ed775cbd tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:16.999631 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0e4bb60d-a97e-48d8-a3ed-9811ed775cbd tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:17.001502 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0e4bb60d-a97e-48d8-a3ed-9811ed775cbd tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:17.005267 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0e4bb60d-a97e-48d8-a3ed-9811ed775cbd tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:17.007688 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0e4bb60d-a97e-48d8-a3ed-9811ed775cbd tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:17.009986 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0e4bb60d-a97e-48d8-a3ed-9811ed775cbd tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:17.386702 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-047f9614-e643-4641-a089-cdb0f1e6bfc4 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:17.400245 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-047f9614-e643-4641-a089-cdb0f1e6bfc4 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1504 microversion: 2.1 time: 0.770037 Aug 31 16:24:17.400979 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2640/5310] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:16 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1504 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:17.438434 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0af1a144-4871-4a69-9519-ea0ade9f2d00 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:17.439182 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0af1a144-4871-4a69-9519-ea0ade9f2d00 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:17.451932 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0af1a144-4871-4a69-9519-ea0ade9f2d00 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:17.452492 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0af1a144-4871-4a69-9519-ea0ade9f2d00 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:17.453516 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0af1a144-4871-4a69-9519-ea0ade9f2d00 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:17.458717 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0af1a144-4871-4a69-9519-ea0ade9f2d00 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:17.459414 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0af1a144-4871-4a69-9519-ea0ade9f2d00 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:17.460057 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0af1a144-4871-4a69-9519-ea0ade9f2d00 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:17.929678 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0e4bb60d-a97e-48d8-a3ed-9811ed775cbd tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:17.947017 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0e4bb60d-a97e-48d8-a3ed-9811ed775cbd tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:17.949011 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0e4bb60d-a97e-48d8-a3ed-9811ed775cbd tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:17.950085 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0e4bb60d-a97e-48d8-a3ed-9811ed775cbd tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5" status: 200 len: 1810 microversion: 2.20 time: 1.008276 Aug 31 16:24:17.950862 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2671/5311] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:24:16 2022] GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5 => generated 1810 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:24:18.272505 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-0af1a144-4871-4a69-9519-ea0ade9f2d00 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:18.309790 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0af1a144-4871-4a69-9519-ea0ade9f2d00 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1504 microversion: 2.1 time: 0.873726 Aug 31 16:24:18.311582 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2641/5312] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:17 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1504 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:18.339477 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-59fee980-6089-4a96-b6f9-55628ed51355 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:24:18.342324 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-59fee980-6089-4a96-b6f9-55628ed51355 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 41f6470f-1274-436d-93ca-2a58937291e4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:18.397358 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-59fee980-6089-4a96-b6f9-55628ed51355 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] HTTP exception thrown: Instance 41f6470f-1274-436d-93ca-2a58937291e4 could not be found. Aug 31 16:24:18.402049 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-59fee980-6089-4a96-b6f9-55628ed51355 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Request method failure captured: Aug 31 16:24:18.402049 n-d-850499-9 devstack@n-api.service[122257]: request: POST /compute/v2.1/servers/41f6470f-1274-436d-93ca-2a58937291e4/action HTTP/1.1 Aug 31 16:24:18.402049 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:24:18.402049 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:24:18.402049 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:24:18.402049 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 15 Aug 31 16:24:18.402049 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:24:18.402049 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:24:18.402049 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:24:18.402049 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:24:18.402049 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4q2NcJzZutw3Y6jF4GnmJD1H1MzSLIbHjRxunPVSp6uKTRmCePfT1DyksG9QgDfSYnSoM0q9vOxO3sqZKoJ5PA2HppEXRHLLn8jTh4ccTKQ6q8SYb3pqui6kOFW5_PmtYr9N0lihJC0EStA4OYRI4QsHOxwmGiiVscbhBZpLyiKmV0 Aug 31 16:24:18.402049 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:24:18.402049 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:24:18.402049 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:24:18.402049 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:24:18.402049 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:24:18.402049 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:24:18.402049 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 014522b19dc349a691e1f6b131229974 Aug 31 16:24:18.402049 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:24:18.402049 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:24:18.402049 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:24:18.402049 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/014522b19dc349a691e1f6b131229974"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/014522b19dc349a691e1f6b131229974"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_014522b19dc349a691e1f6b131229974", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/014522b19dc349a691e1f6b131229974"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:24:18.402049 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:24:18.402049 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 014522b19dc349a691e1f6b131229974 Aug 31 16:24:18.402049 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:24:18.402049 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ServersNegativeTestJSON-918151355-project Aug 31 16:24:18.402049 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:24:18.402049 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:24:18.402049 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: c042c43cc2aa4000a147fae62c261e86 Aug 31 16:24:18.402049 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ServersNegativeTestJSON-918151355-project Aug 31 16:24:18.402049 n-d-850499-9 devstack@n-api.service[122257]: Aug 31 16:24:18.402049 n-d-850499-9 devstack@n-api.service[122257]: {"restore": {}} Aug 31 16:24:18.402049 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:24:18.402049 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance 41f6470f-1274-436d-93ca-2a58937291e4 could not be found. Aug 31 16:24:18.402049 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '41f6470f-1274-436d-93ca-2a58937291e4', 'body': {'restore': {}}} Aug 31 16:24:18.402049 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:24:18.402049 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:24:18.402049 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:24:18.402049 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:24:18.402049 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:24:18.402049 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:24:18.402049 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 31 16:24:18.402049 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 31 16:24:18.402049 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41f6470f-1274-436d-93ca-2a58937291e4 could not be found. Aug 31 16:24:18.402049 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:24:18.402049 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:24:18.402049 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:24:18.402049 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:24:18.402049 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:24:18.402049 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:24:18.402049 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:24:18.402049 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:24:18.402049 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:24:18.402049 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:24:18.402049 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Aug 31 16:24:18.402049 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 31 16:24:18.402049 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:24:18.402049 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:24:18.402049 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41f6470f-1274-436d-93ca-2a58937291e4 could not be found. Aug 31 16:24:18.402049 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:24:18.402049 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:24:18.402049 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:24:18.402049 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:24:18.402049 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:24:18.402049 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:24:18.409798 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:24:18.409798 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:24:18.409798 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41f6470f-1274-436d-93ca-2a58937291e4 could not be found. Aug 31 16:24:18.409798 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:24:18.415224 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-59fee980-6089-4a96-b6f9-55628ed51355 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Returning 404 to user: Instance 41f6470f-1274-436d-93ca-2a58937291e4 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:24:18.418762 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-59fee980-6089-4a96-b6f9-55628ed51355 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "POST /compute/v2.1/servers/41f6470f-1274-436d-93ca-2a58937291e4/action" status: 404 len: 111 microversion: 2.1 time: 0.088477 Aug 31 16:24:18.423608 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2672/5313] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:24:18 2022] POST /compute/v2.1/servers/41f6470f-1274-436d-93ca-2a58937291e4/action => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:24:18.440133 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f7fd90ce-5bbd-446e-ba9a-2a172796364b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:18.441644 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f7fd90ce-5bbd-446e-ba9a-2a172796364b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:18.474912 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f7fd90ce-5bbd-446e-ba9a-2a172796364b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:18.475613 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f7fd90ce-5bbd-446e-ba9a-2a172796364b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:18.476294 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f7fd90ce-5bbd-446e-ba9a-2a172796364b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:18.477200 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f7fd90ce-5bbd-446e-ba9a-2a172796364b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:18.477916 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f7fd90ce-5bbd-446e-ba9a-2a172796364b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:18.485170 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f7fd90ce-5bbd-446e-ba9a-2a172796364b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:18.985011 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3c4c2ba2-a52f-467c-ba29-e2ae7358cdc0 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:18.986442 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3c4c2ba2-a52f-467c-ba29-e2ae7358cdc0 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:19.007394 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3c4c2ba2-a52f-467c-ba29-e2ae7358cdc0 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:19.008166 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3c4c2ba2-a52f-467c-ba29-e2ae7358cdc0 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:19.008840 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3c4c2ba2-a52f-467c-ba29-e2ae7358cdc0 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:19.010330 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3c4c2ba2-a52f-467c-ba29-e2ae7358cdc0 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:19.011030 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3c4c2ba2-a52f-467c-ba29-e2ae7358cdc0 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:19.011963 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3c4c2ba2-a52f-467c-ba29-e2ae7358cdc0 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:19.608043 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f7fd90ce-5bbd-446e-ba9a-2a172796364b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:19.644617 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f7fd90ce-5bbd-446e-ba9a-2a172796364b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1504 microversion: 2.1 time: 1.214291 Aug 31 16:24:19.645364 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2642/5314] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:18 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1504 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:19.679665 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f926c8ad-efe0-4706-bf55-bd4c6defbed9 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:19.687279 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f926c8ad-efe0-4706-bf55-bd4c6defbed9 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:19.710458 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f926c8ad-efe0-4706-bf55-bd4c6defbed9 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:19.711206 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f926c8ad-efe0-4706-bf55-bd4c6defbed9 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:19.711628 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f926c8ad-efe0-4706-bf55-bd4c6defbed9 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:19.716345 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f926c8ad-efe0-4706-bf55-bd4c6defbed9 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:19.716992 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f926c8ad-efe0-4706-bf55-bd4c6defbed9 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:19.717526 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f926c8ad-efe0-4706-bf55-bd4c6defbed9 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:19.804451 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3c4c2ba2-a52f-467c-ba29-e2ae7358cdc0 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:19.850185 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3c4c2ba2-a52f-467c-ba29-e2ae7358cdc0 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:19.854260 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3c4c2ba2-a52f-467c-ba29-e2ae7358cdc0 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:19.880564 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3c4c2ba2-a52f-467c-ba29-e2ae7358cdc0 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5" status: 200 len: 1810 microversion: 2.20 time: 0.888848 Aug 31 16:24:19.882605 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2673/5315] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:24:18 2022] GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5 => generated 1810 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:24:20.915814 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9434c920-23f0-4582-8e64-74c97571a0ca tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:20.917001 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9434c920-23f0-4582-8e64-74c97571a0ca tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:20.946492 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9434c920-23f0-4582-8e64-74c97571a0ca tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:20.947601 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9434c920-23f0-4582-8e64-74c97571a0ca tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:20.948249 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9434c920-23f0-4582-8e64-74c97571a0ca tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:20.949493 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9434c920-23f0-4582-8e64-74c97571a0ca tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:20.953555 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9434c920-23f0-4582-8e64-74c97571a0ca tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:20.956065 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9434c920-23f0-4582-8e64-74c97571a0ca tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:21.519125 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f926c8ad-efe0-4706-bf55-bd4c6defbed9 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:21.533556 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f926c8ad-efe0-4706-bf55-bd4c6defbed9 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1504 microversion: 2.1 time: 1.861980 Aug 31 16:24:21.553064 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2643/5316] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:19 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1504 bytes in 1868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:21.579354 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b33e5026-57cf-44fd-b34e-672cac90c5e3 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:24:21.580774 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b33e5026-57cf-44fd-b34e-672cac90c5e3 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:21.591274 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b33e5026-57cf-44fd-b34e-672cac90c5e3 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:21.592215 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b33e5026-57cf-44fd-b34e-672cac90c5e3 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:21.592869 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b33e5026-57cf-44fd-b34e-672cac90c5e3 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:21.593918 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b33e5026-57cf-44fd-b34e-672cac90c5e3 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:21.595032 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b33e5026-57cf-44fd-b34e-672cac90c5e3 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:21.595845 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b33e5026-57cf-44fd-b34e-672cac90c5e3 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:21.631333 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-b33e5026-57cf-44fd-b34e-672cac90c5e3 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] HTTP exception thrown: Cannot 'restore' instance 22082563-385d-41a9-baa5-6fb277278505 while it is in vm_state active Aug 31 16:24:21.634046 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b33e5026-57cf-44fd-b34e-672cac90c5e3 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Request method failure captured: Aug 31 16:24:21.634046 n-d-850499-9 devstack@n-api.service[122256]: request: POST /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505/action HTTP/1.1 Aug 31 16:24:21.634046 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:24:21.634046 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:24:21.634046 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:24:21.634046 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 15 Aug 31 16:24:21.634046 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:24:21.634046 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:24:21.634046 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:24:21.634046 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:24:21.634046 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4q2NcJzZutw3Y6jF4GnmJD1H1MzSLIbHjRxunPVSp6uKTRmCePfT1DyksG9QgDfSYnSoM0q9vOxO3sqZKoJ5PA2HppEXRHLLn8jTh4ccTKQ6q8SYb3pqui6kOFW5_PmtYr9N0lihJC0EStA4OYRI4QsHOxwmGiiVscbhBZpLyiKmV0 Aug 31 16:24:21.634046 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:24:21.634046 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:24:21.634046 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:24:21.634046 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:24:21.634046 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:24:21.634046 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:24:21.634046 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 014522b19dc349a691e1f6b131229974 Aug 31 16:24:21.634046 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:24:21.634046 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:24:21.634046 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:24:21.634046 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/014522b19dc349a691e1f6b131229974"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/014522b19dc349a691e1f6b131229974"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_014522b19dc349a691e1f6b131229974", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/014522b19dc349a691e1f6b131229974"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:24:21.634046 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:24:21.634046 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 014522b19dc349a691e1f6b131229974 Aug 31 16:24:21.634046 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:24:21.634046 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ServersNegativeTestJSON-918151355-project Aug 31 16:24:21.634046 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:24:21.634046 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:24:21.634046 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: c042c43cc2aa4000a147fae62c261e86 Aug 31 16:24:21.634046 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ServersNegativeTestJSON-918151355-project Aug 31 16:24:21.634046 n-d-850499-9 devstack@n-api.service[122256]: Aug 31 16:24:21.634046 n-d-850499-9 devstack@n-api.service[122256]: {"restore": {}} Aug 31 16:24:21.634046 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:24:21.634046 n-d-850499-9 devstack@n-api.service[122256]: exception: Cannot 'restore' instance 22082563-385d-41a9-baa5-6fb277278505 while it is in vm_state active Aug 31 16:24:21.634046 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '22082563-385d-41a9-baa5-6fb277278505', 'body': {'restore': {}}} Aug 31 16:24:21.634046 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:24:21.634046 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:24:21.634046 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Aug 31 16:24:21.634046 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Aug 31 16:24:21.634046 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 16:24:21.634046 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 16:24:21.634046 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 31 16:24:21.634046 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 31 16:24:21.634046 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 22082563-385d-41a9-baa5-6fb277278505 in vm_state active. Cannot restore while the instance is in this state. Aug 31 16:24:21.634046 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:24:21.634046 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:24:21.634046 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:24:21.634046 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:24:21.634046 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:24:21.634046 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:24:21.634046 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:24:21.634046 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:24:21.634046 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:24:21.634046 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:24:21.634046 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Aug 31 16:24:21.634046 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 31 16:24:21.634046 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 31 16:24:21.634046 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 31 16:24:21.634046 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 22082563-385d-41a9-baa5-6fb277278505 while it is in vm_state active Aug 31 16:24:21.634046 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:24:21.634046 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:24:21.634046 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:24:21.634046 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:24:21.634046 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:24:21.638833 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:24:21.638833 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:24:21.638833 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:24:21.638833 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 22082563-385d-41a9-baa5-6fb277278505 while it is in vm_state active Aug 31 16:24:21.638833 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:24:21.641742 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b33e5026-57cf-44fd-b34e-672cac90c5e3 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Returning 409 to user: Cannot 'restore' instance 22082563-385d-41a9-baa5-6fb277278505 while it is in vm_state active {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:24:21.643149 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b33e5026-57cf-44fd-b34e-672cac90c5e3 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "POST /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505/action" status: 409 len: 145 microversion: 2.1 time: 0.075716 Aug 31 16:24:21.647758 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2644/5317] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:24:21 2022] POST /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505/action => generated 145 bytes in 81 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 31 16:24:21.656380 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8cd7541f-0b11-40e1-92af-4b697a3d72ef tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:21.657703 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8cd7541f-0b11-40e1-92af-4b697a3d72ef tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:21.683918 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8cd7541f-0b11-40e1-92af-4b697a3d72ef tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:21.690089 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8cd7541f-0b11-40e1-92af-4b697a3d72ef tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:21.697299 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8cd7541f-0b11-40e1-92af-4b697a3d72ef tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:21.700042 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8cd7541f-0b11-40e1-92af-4b697a3d72ef tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:21.700969 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8cd7541f-0b11-40e1-92af-4b697a3d72ef tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:21.701960 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8cd7541f-0b11-40e1-92af-4b697a3d72ef tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:22.146395 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9434c920-23f0-4582-8e64-74c97571a0ca tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:22.171175 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9434c920-23f0-4582-8e64-74c97571a0ca tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:22.184347 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9434c920-23f0-4582-8e64-74c97571a0ca tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:22.186294 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9434c920-23f0-4582-8e64-74c97571a0ca tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5" status: 200 len: 1810 microversion: 2.20 time: 1.275530 Aug 31 16:24:22.240056 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2674/5318] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:24:20 2022] GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5 => generated 1810 bytes in 1330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:24:22.337667 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8cd7541f-0b11-40e1-92af-4b697a3d72ef tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:22.360776 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8cd7541f-0b11-40e1-92af-4b697a3d72ef tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1504 microversion: 2.1 time: 0.711344 Aug 31 16:24:22.387529 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2645/5319] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:21 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1504 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:22.409466 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-cbeff1f5-65e6-4d8f-a6dd-e1db702f28b7 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:22.410103 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-cbeff1f5-65e6-4d8f-a6dd-e1db702f28b7 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:22.419761 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cbeff1f5-65e6-4d8f-a6dd-e1db702f28b7 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:22.420282 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cbeff1f5-65e6-4d8f-a6dd-e1db702f28b7 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:22.424834 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cbeff1f5-65e6-4d8f-a6dd-e1db702f28b7 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:22.425704 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cbeff1f5-65e6-4d8f-a6dd-e1db702f28b7 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:22.426221 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cbeff1f5-65e6-4d8f-a6dd-e1db702f28b7 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:22.426676 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cbeff1f5-65e6-4d8f-a6dd-e1db702f28b7 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:23.217945 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-cbeff1f5-65e6-4d8f-a6dd-e1db702f28b7 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:23.233647 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-cbeff1f5-65e6-4d8f-a6dd-e1db702f28b7 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1504 microversion: 2.1 time: 0.830206 Aug 31 16:24:23.234650 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2675/5320] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:22 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1504 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:23.244663 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1bda1415-eab6-44c7-ac95-77e5f466bee7 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:23.246823 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1bda1415-eab6-44c7-ac95-77e5f466bee7 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:23.266040 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-83a4e6c7-85ec-4ce2-a886-f106cc0a3183 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:24:23.268079 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-83a4e6c7-85ec-4ce2-a886-f106cc0a3183 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 38268b50-7294-4eb3-a747-f1f3818f317a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:23.271975 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1bda1415-eab6-44c7-ac95-77e5f466bee7 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:23.274614 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1bda1415-eab6-44c7-ac95-77e5f466bee7 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:23.276599 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1bda1415-eab6-44c7-ac95-77e5f466bee7 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:23.279395 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1bda1415-eab6-44c7-ac95-77e5f466bee7 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:23.280835 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1bda1415-eab6-44c7-ac95-77e5f466bee7 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:23.285012 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1bda1415-eab6-44c7-ac95-77e5f466bee7 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:23.289409 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-83a4e6c7-85ec-4ce2-a886-f106cc0a3183 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] HTTP exception thrown: Instance 38268b50-7294-4eb3-a747-f1f3818f317a could not be found. Aug 31 16:24:23.296574 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-83a4e6c7-85ec-4ce2-a886-f106cc0a3183 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Request method failure captured: Aug 31 16:24:23.296574 n-d-850499-9 devstack@n-api.service[122257]: request: POST /compute/v2.1/servers/38268b50-7294-4eb3-a747-f1f3818f317a/action HTTP/1.1 Aug 31 16:24:23.296574 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:24:23.296574 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:24:23.296574 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:24:23.296574 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 14 Aug 31 16:24:23.296574 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:24:23.296574 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:24:23.296574 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:24:23.296574 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:24:23.296574 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4q2NcJzZutw3Y6jF4GnmJD1H1MzSLIbHjRxunPVSp6uKTRmCePfT1DyksG9QgDfSYnSoM0q9vOxO3sqZKoJ5PA2HppEXRHLLn8jTh4ccTKQ6q8SYb3pqui6kOFW5_PmtYr9N0lihJC0EStA4OYRI4QsHOxwmGiiVscbhBZpLyiKmV0 Aug 31 16:24:23.296574 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:24:23.296574 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:24:23.296574 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:24:23.296574 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:24:23.296574 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:24:23.296574 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:24:23.296574 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 014522b19dc349a691e1f6b131229974 Aug 31 16:24:23.296574 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:24:23.296574 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:24:23.296574 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:24:23.296574 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/014522b19dc349a691e1f6b131229974"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/014522b19dc349a691e1f6b131229974"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_014522b19dc349a691e1f6b131229974", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/014522b19dc349a691e1f6b131229974"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:24:23.296574 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:24:23.296574 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 014522b19dc349a691e1f6b131229974 Aug 31 16:24:23.296574 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:24:23.296574 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ServersNegativeTestJSON-918151355-project Aug 31 16:24:23.296574 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:24:23.296574 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:24:23.296574 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: c042c43cc2aa4000a147fae62c261e86 Aug 31 16:24:23.296574 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ServersNegativeTestJSON-918151355-project Aug 31 16:24:23.296574 n-d-850499-9 devstack@n-api.service[122257]: Aug 31 16:24:23.296574 n-d-850499-9 devstack@n-api.service[122257]: {"resume": {}} Aug 31 16:24:23.296574 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:24:23.296574 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance 38268b50-7294-4eb3-a747-f1f3818f317a could not be found. Aug 31 16:24:23.296574 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '38268b50-7294-4eb3-a747-f1f3818f317a', 'body': {'resume': {}}} Aug 31 16:24:23.296574 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:24:23.296574 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:24:23.296574 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:24:23.296574 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:24:23.296574 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:24:23.296574 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:24:23.296574 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 31 16:24:23.296574 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 31 16:24:23.296574 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38268b50-7294-4eb3-a747-f1f3818f317a could not be found. Aug 31 16:24:23.296574 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:24:23.296574 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:24:23.296574 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:24:23.296574 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:24:23.296574 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:24:23.296574 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:24:23.296574 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:24:23.296574 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:24:23.296574 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:24:23.296574 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:24:23.296574 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Aug 31 16:24:23.296574 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Aug 31 16:24:23.296574 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:24:23.296574 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:24:23.296574 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38268b50-7294-4eb3-a747-f1f3818f317a could not be found. Aug 31 16:24:23.296574 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:24:23.296574 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:24:23.296574 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:24:23.296574 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:24:23.296574 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:24:23.296574 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:24:23.305288 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:24:23.305288 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:24:23.305288 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38268b50-7294-4eb3-a747-f1f3818f317a could not be found. Aug 31 16:24:23.305288 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:24:23.305888 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:24:23.309844 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-83a4e6c7-85ec-4ce2-a886-f106cc0a3183 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Returning 404 to user: Instance 38268b50-7294-4eb3-a747-f1f3818f317a could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:24:23.311691 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-83a4e6c7-85ec-4ce2-a886-f106cc0a3183 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "POST /compute/v2.1/servers/38268b50-7294-4eb3-a747-f1f3818f317a/action" status: 404 len: 111 microversion: 2.1 time: 0.055550 Aug 31 16:24:23.314924 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2676/5321] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:24:23 2022] POST /compute/v2.1/servers/38268b50-7294-4eb3-a747-f1f3818f317a/action => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:24:23.334400 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-735d26b3-495e-4b6d-979e-5ac191d6ce81 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:23.340499 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-735d26b3-495e-4b6d-979e-5ac191d6ce81 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:23.372707 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-735d26b3-495e-4b6d-979e-5ac191d6ce81 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:23.373499 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-735d26b3-495e-4b6d-979e-5ac191d6ce81 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:23.374212 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-735d26b3-495e-4b6d-979e-5ac191d6ce81 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:23.376215 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-735d26b3-495e-4b6d-979e-5ac191d6ce81 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:23.381370 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-735d26b3-495e-4b6d-979e-5ac191d6ce81 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:23.383682 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-735d26b3-495e-4b6d-979e-5ac191d6ce81 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:24.283417 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1bda1415-eab6-44c7-ac95-77e5f466bee7 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:24.339017 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1bda1415-eab6-44c7-ac95-77e5f466bee7 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:24.345452 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1bda1415-eab6-44c7-ac95-77e5f466bee7 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:24.352105 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1bda1415-eab6-44c7-ac95-77e5f466bee7 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5" status: 200 len: 1810 microversion: 2.20 time: 1.111950 Aug 31 16:24:24.355800 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2646/5322] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:24:23 2022] GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5 => generated 1810 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:24:24.416078 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-735d26b3-495e-4b6d-979e-5ac191d6ce81 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:24.431813 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-735d26b3-495e-4b6d-979e-5ac191d6ce81 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1504 microversion: 2.1 time: 1.110908 Aug 31 16:24:24.432426 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2677/5323] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:23 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1504 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:24.466703 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d9fb117e-ad8d-4e30-b7cf-7fd6f3c1dfe1 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:24.467325 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c7e2a884-544e-4763-a7c7-072f6764d44c tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:24.469132 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d9fb117e-ad8d-4e30-b7cf-7fd6f3c1dfe1 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:24.470636 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c7e2a884-544e-4763-a7c7-072f6764d44c tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 6e139adf-20d3-4d88-941f-fe9a45276ad5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:24.502410 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d9fb117e-ad8d-4e30-b7cf-7fd6f3c1dfe1 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:24.503402 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d9fb117e-ad8d-4e30-b7cf-7fd6f3c1dfe1 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:24.509392 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d9fb117e-ad8d-4e30-b7cf-7fd6f3c1dfe1 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:24.510726 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d9fb117e-ad8d-4e30-b7cf-7fd6f3c1dfe1 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:24.516017 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c7e2a884-544e-4763-a7c7-072f6764d44c tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:24.517221 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d9fb117e-ad8d-4e30-b7cf-7fd6f3c1dfe1 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:24.518220 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c7e2a884-544e-4763-a7c7-072f6764d44c tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:24.518903 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d9fb117e-ad8d-4e30-b7cf-7fd6f3c1dfe1 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:24.519485 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c7e2a884-544e-4763-a7c7-072f6764d44c tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:24.527882 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c7e2a884-544e-4763-a7c7-072f6764d44c tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:24.529882 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c7e2a884-544e-4763-a7c7-072f6764d44c tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:24.532465 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c7e2a884-544e-4763-a7c7-072f6764d44c tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:24.591998 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c7e2a884-544e-4763-a7c7-072f6764d44c tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/6e139adf-20d3-4d88-941f-fe9a45276ad5/ips" status: 200 len: 151 microversion: 2.1 time: 0.147948 Aug 31 16:24:24.594290 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2647/5324] 10.222.0.61 () {58 vars in 1248 bytes} [Wed Aug 31 16:24:24 2022] GET /compute/v2.1/servers/6e139adf-20d3-4d88-941f-fe9a45276ad5/ips => generated 151 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:24:25.405068 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-10a63901-5b4e-4213-a1ff-3379184bff47 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:25.407438 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-10a63901-5b4e-4213-a1ff-3379184bff47 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:25.436666 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-10a63901-5b4e-4213-a1ff-3379184bff47 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:25.438894 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-10a63901-5b4e-4213-a1ff-3379184bff47 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:25.442137 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-10a63901-5b4e-4213-a1ff-3379184bff47 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:25.445262 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-10a63901-5b4e-4213-a1ff-3379184bff47 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:25.450164 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-10a63901-5b4e-4213-a1ff-3379184bff47 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:25.451604 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-10a63901-5b4e-4213-a1ff-3379184bff47 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:25.497892 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d9fb117e-ad8d-4e30-b7cf-7fd6f3c1dfe1 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:25.510421 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d9fb117e-ad8d-4e30-b7cf-7fd6f3c1dfe1 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1504 microversion: 2.1 time: 1.047543 Aug 31 16:24:25.520849 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2678/5325] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:24 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1504 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:24:25.559826 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e5263024-7c66-438b-bf15-a14ea3eccf11 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:24:25.562101 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e5263024-7c66-438b-bf15-a14ea3eccf11 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:25.580880 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e5263024-7c66-438b-bf15-a14ea3eccf11 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:25.584849 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e5263024-7c66-438b-bf15-a14ea3eccf11 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:25.585693 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e5263024-7c66-438b-bf15-a14ea3eccf11 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:25.586703 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e5263024-7c66-438b-bf15-a14ea3eccf11 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:25.588393 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e5263024-7c66-438b-bf15-a14ea3eccf11 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:25.589220 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e5263024-7c66-438b-bf15-a14ea3eccf11 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:25.701313 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-e5263024-7c66-438b-bf15-a14ea3eccf11 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] HTTP exception thrown: Cannot 'resume' instance 22082563-385d-41a9-baa5-6fb277278505 while it is in vm_state active Aug 31 16:24:25.716086 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e5263024-7c66-438b-bf15-a14ea3eccf11 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Request method failure captured: Aug 31 16:24:25.716086 n-d-850499-9 devstack@n-api.service[122257]: request: POST /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505/action HTTP/1.1 Aug 31 16:24:25.716086 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:24:25.716086 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:24:25.716086 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:24:25.716086 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 14 Aug 31 16:24:25.716086 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:24:25.716086 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:24:25.716086 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:24:25.716086 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:24:25.716086 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4q2NcJzZutw3Y6jF4GnmJD1H1MzSLIbHjRxunPVSp6uKTRmCePfT1DyksG9QgDfSYnSoM0q9vOxO3sqZKoJ5PA2HppEXRHLLn8jTh4ccTKQ6q8SYb3pqui6kOFW5_PmtYr9N0lihJC0EStA4OYRI4QsHOxwmGiiVscbhBZpLyiKmV0 Aug 31 16:24:25.716086 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:24:25.716086 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:24:25.716086 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:24:25.716086 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:24:25.716086 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:24:25.716086 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:24:25.716086 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 014522b19dc349a691e1f6b131229974 Aug 31 16:24:25.716086 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:24:25.716086 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:24:25.716086 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:24:25.716086 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/014522b19dc349a691e1f6b131229974"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/014522b19dc349a691e1f6b131229974"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_014522b19dc349a691e1f6b131229974", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/014522b19dc349a691e1f6b131229974"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:24:25.716086 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:24:25.716086 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 014522b19dc349a691e1f6b131229974 Aug 31 16:24:25.716086 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:24:25.716086 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ServersNegativeTestJSON-918151355-project Aug 31 16:24:25.716086 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:24:25.716086 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:24:25.716086 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: c042c43cc2aa4000a147fae62c261e86 Aug 31 16:24:25.716086 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ServersNegativeTestJSON-918151355-project Aug 31 16:24:25.716086 n-d-850499-9 devstack@n-api.service[122257]: Aug 31 16:24:25.716086 n-d-850499-9 devstack@n-api.service[122257]: {"resume": {}} Aug 31 16:24:25.716086 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:24:25.716086 n-d-850499-9 devstack@n-api.service[122257]: exception: Cannot 'resume' instance 22082563-385d-41a9-baa5-6fb277278505 while it is in vm_state active Aug 31 16:24:25.716086 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '22082563-385d-41a9-baa5-6fb277278505', 'body': {'resume': {}}} Aug 31 16:24:25.716086 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:24:25.716086 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:24:25.716086 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Aug 31 16:24:25.716086 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Aug 31 16:24:25.716086 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 16:24:25.716086 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 16:24:25.716086 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Aug 31 16:24:25.716086 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 31 16:24:25.716086 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 31 16:24:25.716086 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 31 16:24:25.716086 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 22082563-385d-41a9-baa5-6fb277278505 in vm_state active. Cannot resume while the instance is in this state. Aug 31 16:24:25.716086 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:24:25.716086 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:24:25.716086 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:24:25.716086 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:24:25.716086 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:24:25.716086 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:24:25.716086 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:24:25.716086 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:24:25.716086 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:24:25.716086 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:24:25.716086 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Aug 31 16:24:25.716086 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 31 16:24:25.716086 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 31 16:24:25.716086 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 31 16:24:25.716086 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 22082563-385d-41a9-baa5-6fb277278505 while it is in vm_state active Aug 31 16:24:25.716086 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:24:25.716086 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:24:25.716086 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:24:25.722865 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:24:25.722865 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:24:25.722865 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:24:25.722865 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:24:25.722865 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:24:25.722865 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 22082563-385d-41a9-baa5-6fb277278505 while it is in vm_state active Aug 31 16:24:25.722865 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:24:25.722865 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e5263024-7c66-438b-bf15-a14ea3eccf11 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Returning 409 to user: Cannot 'resume' instance 22082563-385d-41a9-baa5-6fb277278505 while it is in vm_state active {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:24:25.732376 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e5263024-7c66-438b-bf15-a14ea3eccf11 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "POST /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505/action" status: 409 len: 144 microversion: 2.1 time: 0.180976 Aug 31 16:24:25.733175 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2679/5326] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:24:25 2022] POST /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505/action => generated 144 bytes in 196 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 31 16:24:25.745923 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-58459bb4-6409-4300-b876-41a442b45596 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:25.746918 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-58459bb4-6409-4300-b876-41a442b45596 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:25.777485 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-58459bb4-6409-4300-b876-41a442b45596 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:25.777997 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-58459bb4-6409-4300-b876-41a442b45596 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:25.778449 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-58459bb4-6409-4300-b876-41a442b45596 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:25.779194 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-58459bb4-6409-4300-b876-41a442b45596 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:25.779702 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-58459bb4-6409-4300-b876-41a442b45596 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:25.780140 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-58459bb4-6409-4300-b876-41a442b45596 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:26.684975 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-10a63901-5b4e-4213-a1ff-3379184bff47 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:26.708354 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-10a63901-5b4e-4213-a1ff-3379184bff47 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:26.714855 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-10a63901-5b4e-4213-a1ff-3379184bff47 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:26.721397 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-10a63901-5b4e-4213-a1ff-3379184bff47 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5" status: 200 len: 1810 microversion: 2.20 time: 1.321722 Aug 31 16:24:26.742349 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2648/5327] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:24:25 2022] GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5 => generated 1810 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:24:27.539744 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-58459bb4-6409-4300-b876-41a442b45596 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:27.565199 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-58459bb4-6409-4300-b876-41a442b45596 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1504 microversion: 2.1 time: 1.826483 Aug 31 16:24:27.576468 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2680/5328] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:25 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1504 bytes in 1839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:27.601262 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b967b598-4c43-4643-abc4-251d7f5e7bae tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:27.608788 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b967b598-4c43-4643-abc4-251d7f5e7bae tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:27.618789 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b967b598-4c43-4643-abc4-251d7f5e7bae tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:27.619470 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b967b598-4c43-4643-abc4-251d7f5e7bae tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:27.620057 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b967b598-4c43-4643-abc4-251d7f5e7bae tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:27.620917 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b967b598-4c43-4643-abc4-251d7f5e7bae tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:27.621494 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b967b598-4c43-4643-abc4-251d7f5e7bae tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:27.622607 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b967b598-4c43-4643-abc4-251d7f5e7bae tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:27.777528 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a9c83bcc-36b6-43f5-b8b3-24849c87c0ef tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:27.778159 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a9c83bcc-36b6-43f5-b8b3-24849c87c0ef tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:27.791366 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a9c83bcc-36b6-43f5-b8b3-24849c87c0ef tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:27.792135 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a9c83bcc-36b6-43f5-b8b3-24849c87c0ef tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:27.792790 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a9c83bcc-36b6-43f5-b8b3-24849c87c0ef tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:27.796158 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a9c83bcc-36b6-43f5-b8b3-24849c87c0ef tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:27.796947 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a9c83bcc-36b6-43f5-b8b3-24849c87c0ef tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:27.797577 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a9c83bcc-36b6-43f5-b8b3-24849c87c0ef tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:28.474420 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b967b598-4c43-4643-abc4-251d7f5e7bae tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:28.487174 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b967b598-4c43-4643-abc4-251d7f5e7bae tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1504 microversion: 2.1 time: 0.890783 Aug 31 16:24:28.488644 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2649/5329] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:27 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1504 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:24:28.525700 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a9c83bcc-36b6-43f5-b8b3-24849c87c0ef tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:28.557969 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a578d0b3-9d59-4f85-9b5d-2ddaee2cf229 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5552f8fd-f71f-4429-a5c2-8f7fd2fcde72"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:24:28.559918 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:24:28.562829 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a578d0b3-9d59-4f85-9b5d-2ddaee2cf229 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 6e139adf-20d3-4d88-941f-fe9a45276ad5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:28.570511 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a9c83bcc-36b6-43f5-b8b3-24849c87c0ef tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:28.578237 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a9c83bcc-36b6-43f5-b8b3-24849c87c0ef tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:28.582427 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a578d0b3-9d59-4f85-9b5d-2ddaee2cf229 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:28.583430 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a9c83bcc-36b6-43f5-b8b3-24849c87c0ef tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5" status: 200 len: 1810 microversion: 2.20 time: 0.806316 Aug 31 16:24:28.584187 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a578d0b3-9d59-4f85-9b5d-2ddaee2cf229 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:28.584979 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a578d0b3-9d59-4f85-9b5d-2ddaee2cf229 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:28.585378 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2681/5330] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:24:27 2022] GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5 => generated 1810 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:24:28.586249 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a578d0b3-9d59-4f85-9b5d-2ddaee2cf229 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:28.586941 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a578d0b3-9d59-4f85-9b5d-2ddaee2cf229 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:28.587640 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a578d0b3-9d59-4f85-9b5d-2ddaee2cf229 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:28.771696 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7aed8756-2b86-40e2-bd91-72a70068aeb1 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "networks": [{"uuid": "fa24e0ec-4a58-4400-9cf4-a0201375c33e"}]}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:24:28.775842 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7aed8756-2b86-40e2-bd91-72a70068aeb1 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Request method failure captured: Aug 31 16:24:28.775842 n-d-850499-9 devstack@n-api.service[122257]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 31 16:24:28.775842 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:24:28.775842 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:24:28.775842 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:24:28.775842 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 160 Aug 31 16:24:28.775842 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:24:28.775842 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:24:28.775842 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:24:28.775842 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:24:28.775842 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4q2NcJzZutw3Y6jF4GnmJD1H1MzSLIbHjRxunPVSp6uKTRmCePfT1DyksG9QgDfSYnSoM0q9vOxO3sqZKoJ5PA2HppEXRHLLn8jTh4ccTKQ6q8SYb3pqui6kOFW5_PmtYr9N0lihJC0EStA4OYRI4QsHOxwmGiiVscbhBZpLyiKmV0 Aug 31 16:24:28.775842 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:24:28.775842 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:24:28.775842 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:24:28.775842 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:24:28.775842 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:24:28.775842 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:24:28.775842 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 014522b19dc349a691e1f6b131229974 Aug 31 16:24:28.775842 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:24:28.775842 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:24:28.775842 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:24:28.775842 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/014522b19dc349a691e1f6b131229974"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/014522b19dc349a691e1f6b131229974"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_014522b19dc349a691e1f6b131229974", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/014522b19dc349a691e1f6b131229974"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:24:28.775842 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:24:28.775842 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 014522b19dc349a691e1f6b131229974 Aug 31 16:24:28.775842 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:24:28.775842 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ServersNegativeTestJSON-918151355-project Aug 31 16:24:28.775842 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:24:28.775842 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:24:28.775842 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: c042c43cc2aa4000a147fae62c261e86 Aug 31 16:24:28.775842 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ServersNegativeTestJSON-918151355-project Aug 31 16:24:28.775842 n-d-850499-9 devstack@n-api.service[122257]: Aug 31 16:24:28.775842 n-d-850499-9 devstack@n-api.service[122257]: {"server": {"name": "", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "networks": [{"uuid": "fa24e0ec-4a58-4400-9cf4-a0201375c33e"}]}} Aug 31 16:24:28.775842 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:24:28.775842 n-d-850499-9 devstack@n-api.service[122257]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 31 16:24:28.775842 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'body': {'server': {'name': '', 'imageRef': 'b9c36d42-ed46-4bf5-ad18-1df45cbd0413', 'flavorRef': '452', 'networks': [{'uuid': 'fa24e0ec-4a58-4400-9cf4-a0201375c33e'}]}}} Aug 31 16:24:28.775842 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:24:28.775842 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:24:28.775842 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 16:24:28.775842 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 16:24:28.775842 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 16:24:28.775842 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise error Aug 31 16:24:28.775842 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 31 16:24:28.775842 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:24:28.775842 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Aug 31 16:24:28.775842 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 31 16:24:28.775842 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:24:28.775842 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 31 16:24:28.775842 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi '' Aug 31 16:24:28.775842 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:24:28.775842 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:24:28.775842 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:24:28.775842 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:24:28.775842 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:24:28.775842 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:24:28.775842 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:24:28.775842 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:24:28.775842 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:24:28.775842 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:24:28.775842 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:24:28.775842 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:24:28.775842 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 16:24:28.775842 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 16:24:28.775842 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 16:24:28.775842 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 16:24:28.775842 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 16:24:28.781707 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 16:24:28.781707 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 31 16:24:28.781707 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:24:28.781707 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:24:28.781707 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:24:28.781707 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:24:28.781707 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:24:28.781707 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:24:28.781707 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 16:24:28.781707 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 16:24:28.781707 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 31 16:24:28.781707 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:24:28.781707 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7aed8756-2b86-40e2-bd91-72a70068aeb1 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:24:28.781707 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7aed8756-2b86-40e2-bd91-72a70068aeb1 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.013595 Aug 31 16:24:28.781707 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2682/5331] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:24:28 2022] POST /compute/v2.1/servers => generated 108 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 31 16:24:28.803808 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3184cd71-47d8-4e5b-8b19-8ff497183985 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:28.804498 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3184cd71-47d8-4e5b-8b19-8ff497183985 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:28.821806 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3184cd71-47d8-4e5b-8b19-8ff497183985 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:28.825820 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3184cd71-47d8-4e5b-8b19-8ff497183985 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:28.830249 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3184cd71-47d8-4e5b-8b19-8ff497183985 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:28.831818 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3184cd71-47d8-4e5b-8b19-8ff497183985 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:28.832445 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3184cd71-47d8-4e5b-8b19-8ff497183985 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:28.833008 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3184cd71-47d8-4e5b-8b19-8ff497183985 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:29.046370 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a578d0b3-9d59-4f85-9b5d-2ddaee2cf229 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "POST /compute/v2.1/servers/6e139adf-20d3-4d88-941f-fe9a45276ad5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.487711 Aug 31 16:24:29.049798 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2650/5332] 10.222.0.61 () {60 vars in 1323 bytes} [Wed Aug 31 16:24:28 2022] POST /compute/v2.1/servers/6e139adf-20d3-4d88-941f-fe9a45276ad5/os-volume_attachments => generated 194 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:24:29.095106 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3184cd71-47d8-4e5b-8b19-8ff497183985 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:29.106915 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3184cd71-47d8-4e5b-8b19-8ff497183985 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1504 microversion: 2.1 time: 0.322524 Aug 31 16:24:29.112032 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2683/5333] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:28 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1504 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:29.139451 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-734c342a-f6a5-4a94-8cc5-7ba64c380b8b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:29.140824 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-734c342a-f6a5-4a94-8cc5-7ba64c380b8b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:29.157366 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-734c342a-f6a5-4a94-8cc5-7ba64c380b8b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:29.159329 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-734c342a-f6a5-4a94-8cc5-7ba64c380b8b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:29.159904 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-734c342a-f6a5-4a94-8cc5-7ba64c380b8b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:29.163209 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-734c342a-f6a5-4a94-8cc5-7ba64c380b8b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:29.164610 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-734c342a-f6a5-4a94-8cc5-7ba64c380b8b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:29.165791 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-734c342a-f6a5-4a94-8cc5-7ba64c380b8b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:29.528798 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-734c342a-f6a5-4a94-8cc5-7ba64c380b8b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:29.556943 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-734c342a-f6a5-4a94-8cc5-7ba64c380b8b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1504 microversion: 2.1 time: 0.427419 Aug 31 16:24:29.563068 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2651/5334] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:29 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1504 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:29.583931 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-006b3305-1253-4235-8680-8aa8a4b142e2 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:24:29.585321 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-006b3305-1253-4235-8680-8aa8a4b142e2 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 8322b782-7db4-4498-81c7-a0d4233666f6] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:29.623294 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0d4f1e69-983b-4b7e-925e-fe21c1beddd6 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:29.623956 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0d4f1e69-983b-4b7e-925e-fe21c1beddd6 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:29.631079 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-006b3305-1253-4235-8680-8aa8a4b142e2 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] HTTP exception thrown: Instance 8322b782-7db4-4498-81c7-a0d4233666f6 could not be found. Aug 31 16:24:29.634160 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0d4f1e69-983b-4b7e-925e-fe21c1beddd6 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:29.634890 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0d4f1e69-983b-4b7e-925e-fe21c1beddd6 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:29.635566 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0d4f1e69-983b-4b7e-925e-fe21c1beddd6 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:29.636592 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0d4f1e69-983b-4b7e-925e-fe21c1beddd6 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:29.637247 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0d4f1e69-983b-4b7e-925e-fe21c1beddd6 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:29.637858 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0d4f1e69-983b-4b7e-925e-fe21c1beddd6 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:29.651225 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-006b3305-1253-4235-8680-8aa8a4b142e2 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Request method failure captured: Aug 31 16:24:29.651225 n-d-850499-9 devstack@n-api.service[122257]: request: POST /compute/v2.1/servers/8322b782-7db4-4498-81c7-a0d4233666f6/action HTTP/1.1 Aug 31 16:24:29.651225 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:24:29.651225 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:24:29.651225 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:24:29.651225 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 14 Aug 31 16:24:29.651225 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:24:29.651225 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:24:29.651225 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:24:29.651225 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:24:29.651225 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4q2NcJzZutw3Y6jF4GnmJD1H1MzSLIbHjRxunPVSp6uKTRmCePfT1DyksG9QgDfSYnSoM0q9vOxO3sqZKoJ5PA2HppEXRHLLn8jTh4ccTKQ6q8SYb3pqui6kOFW5_PmtYr9N0lihJC0EStA4OYRI4QsHOxwmGiiVscbhBZpLyiKmV0 Aug 31 16:24:29.651225 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:24:29.651225 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:24:29.651225 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:24:29.651225 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:24:29.651225 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:24:29.651225 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:24:29.651225 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 014522b19dc349a691e1f6b131229974 Aug 31 16:24:29.651225 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:24:29.651225 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:24:29.651225 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:24:29.651225 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/014522b19dc349a691e1f6b131229974"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/014522b19dc349a691e1f6b131229974"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_014522b19dc349a691e1f6b131229974", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/014522b19dc349a691e1f6b131229974"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:24:29.651225 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:24:29.651225 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 014522b19dc349a691e1f6b131229974 Aug 31 16:24:29.651225 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:24:29.651225 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ServersNegativeTestJSON-918151355-project Aug 31 16:24:29.651225 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:24:29.651225 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:24:29.651225 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: c042c43cc2aa4000a147fae62c261e86 Aug 31 16:24:29.651225 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ServersNegativeTestJSON-918151355-project Aug 31 16:24:29.651225 n-d-850499-9 devstack@n-api.service[122257]: Aug 31 16:24:29.651225 n-d-850499-9 devstack@n-api.service[122257]: {"shelve": {}} Aug 31 16:24:29.651225 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:24:29.651225 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance 8322b782-7db4-4498-81c7-a0d4233666f6 could not be found. Aug 31 16:24:29.651225 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '8322b782-7db4-4498-81c7-a0d4233666f6', 'body': {'shelve': {}}} Aug 31 16:24:29.651225 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:24:29.651225 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:24:29.651225 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:24:29.651225 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:24:29.651225 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:24:29.651225 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:24:29.651225 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 31 16:24:29.651225 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 31 16:24:29.651225 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8322b782-7db4-4498-81c7-a0d4233666f6 could not be found. Aug 31 16:24:29.651225 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:24:29.651225 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:24:29.651225 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:24:29.651225 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:24:29.651225 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:24:29.651225 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:24:29.651225 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:24:29.651225 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:24:29.651225 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:24:29.651225 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:24:29.651225 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Aug 31 16:24:29.651225 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 31 16:24:29.651225 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:24:29.651225 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:24:29.651225 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8322b782-7db4-4498-81c7-a0d4233666f6 could not be found. Aug 31 16:24:29.651225 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:24:29.651225 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:24:29.651225 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:24:29.651225 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:24:29.651225 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:24:29.651225 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:24:29.657393 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:24:29.657393 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:24:29.657393 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8322b782-7db4-4498-81c7-a0d4233666f6 could not be found. Aug 31 16:24:29.657393 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:24:29.658690 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-006b3305-1253-4235-8680-8aa8a4b142e2 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Returning 404 to user: Instance 8322b782-7db4-4498-81c7-a0d4233666f6 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:24:29.659804 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-006b3305-1253-4235-8680-8aa8a4b142e2 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "POST /compute/v2.1/servers/8322b782-7db4-4498-81c7-a0d4233666f6/action" status: 404 len: 111 microversion: 2.1 time: 0.080248 Aug 31 16:24:29.664196 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2684/5335] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:24:29 2022] POST /compute/v2.1/servers/8322b782-7db4-4498-81c7-a0d4233666f6/action => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:24:29.669571 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4d14f1be-5eb4-474d-937f-4ee1467c9195 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:29.670481 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4d14f1be-5eb4-474d-937f-4ee1467c9195 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:29.685187 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4d14f1be-5eb4-474d-937f-4ee1467c9195 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:29.689368 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4d14f1be-5eb4-474d-937f-4ee1467c9195 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:29.692094 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4d14f1be-5eb4-474d-937f-4ee1467c9195 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:29.695022 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4d14f1be-5eb4-474d-937f-4ee1467c9195 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:29.695780 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4d14f1be-5eb4-474d-937f-4ee1467c9195 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:29.696401 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4d14f1be-5eb4-474d-937f-4ee1467c9195 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:30.560088 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-0d4f1e69-983b-4b7e-925e-fe21c1beddd6 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:30.587194 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-4d14f1be-5eb4-474d-937f-4ee1467c9195 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:30.590962 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-0d4f1e69-983b-4b7e-925e-fe21c1beddd6 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:30.595087 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-0d4f1e69-983b-4b7e-925e-fe21c1beddd6 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:30.597293 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0d4f1e69-983b-4b7e-925e-fe21c1beddd6 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5" status: 200 len: 1810 microversion: 2.20 time: 0.978709 Aug 31 16:24:30.599358 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2652/5336] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:24:29 2022] GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5 => generated 1810 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:24:30.610043 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4d14f1be-5eb4-474d-937f-4ee1467c9195 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1504 microversion: 2.1 time: 0.943777 Aug 31 16:24:30.611550 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2685/5337] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:29 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1504 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:30.646130 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c2b9dc81-e6a0-43eb-b65e-f659c371a108 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:30.657739 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c2b9dc81-e6a0-43eb-b65e-f659c371a108 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:30.677811 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c2b9dc81-e6a0-43eb-b65e-f659c371a108 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:30.680406 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c2b9dc81-e6a0-43eb-b65e-f659c371a108 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:30.682234 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c2b9dc81-e6a0-43eb-b65e-f659c371a108 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:30.688265 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c2b9dc81-e6a0-43eb-b65e-f659c371a108 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:30.689034 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c2b9dc81-e6a0-43eb-b65e-f659c371a108 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:30.689526 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c2b9dc81-e6a0-43eb-b65e-f659c371a108 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:31.156984 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c2b9dc81-e6a0-43eb-b65e-f659c371a108 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:31.181108 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c2b9dc81-e6a0-43eb-b65e-f659c371a108 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1504 microversion: 2.1 time: 0.541785 Aug 31 16:24:31.182613 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2653/5338] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:30 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1504 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:31.226985 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5291b8f9-538f-4748-803e-d002102e7258 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:24:31.232768 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5291b8f9-538f-4748-803e-d002102e7258 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:31.261411 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5291b8f9-538f-4748-803e-d002102e7258 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:31.263137 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5291b8f9-538f-4748-803e-d002102e7258 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:31.263724 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5291b8f9-538f-4748-803e-d002102e7258 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:31.264519 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5291b8f9-538f-4748-803e-d002102e7258 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:31.265003 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5291b8f9-538f-4748-803e-d002102e7258 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:31.265976 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5291b8f9-538f-4748-803e-d002102e7258 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:31.315940 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-5291b8f9-538f-4748-803e-d002102e7258 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lazy-loading 'flavor' on Instance uuid 22082563-385d-41a9-baa5-6fb277278505 {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:24:31.638469 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7d657c48-ae1a-4398-9c6f-eea455a300c0 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:31.639304 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7d657c48-ae1a-4398-9c6f-eea455a300c0 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:31.651281 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7d657c48-ae1a-4398-9c6f-eea455a300c0 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:31.651891 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7d657c48-ae1a-4398-9c6f-eea455a300c0 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:31.652486 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7d657c48-ae1a-4398-9c6f-eea455a300c0 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:31.655708 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7d657c48-ae1a-4398-9c6f-eea455a300c0 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:31.657369 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7d657c48-ae1a-4398-9c6f-eea455a300c0 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:31.666397 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7d657c48-ae1a-4398-9c6f-eea455a300c0 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:31.823228 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5291b8f9-538f-4748-803e-d002102e7258 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "POST /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505/action" status: 202 len: 0 microversion: 2.1 time: 0.613215 Aug 31 16:24:31.826197 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2686/5339] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:24:31 2022] POST /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505/action => generated 0 bytes in 618 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:24:31.868251 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-95123ad7-7d7e-496d-b82b-59f20fae7f93 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:31.879093 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-95123ad7-7d7e-496d-b82b-59f20fae7f93 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:31.923425 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-95123ad7-7d7e-496d-b82b-59f20fae7f93 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:31.924812 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-95123ad7-7d7e-496d-b82b-59f20fae7f93 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:31.927660 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-95123ad7-7d7e-496d-b82b-59f20fae7f93 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:31.933353 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-95123ad7-7d7e-496d-b82b-59f20fae7f93 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:31.934898 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-95123ad7-7d7e-496d-b82b-59f20fae7f93 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:31.936192 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-95123ad7-7d7e-496d-b82b-59f20fae7f93 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:32.167049 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7d657c48-ae1a-4398-9c6f-eea455a300c0 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:32.177627 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7d657c48-ae1a-4398-9c6f-eea455a300c0 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:32.184912 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7d657c48-ae1a-4398-9c6f-eea455a300c0 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:32.187483 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7d657c48-ae1a-4398-9c6f-eea455a300c0 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5" status: 200 len: 1810 microversion: 2.20 time: 0.553634 Aug 31 16:24:32.192398 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2654/5340] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:24:31 2022] GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5 => generated 1810 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:24:32.506593 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-95123ad7-7d7e-496d-b82b-59f20fae7f93 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:32.532238 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-95123ad7-7d7e-496d-b82b-59f20fae7f93 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1510 microversion: 2.1 time: 0.696968 Aug 31 16:24:32.559912 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2687/5341] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:31 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1510 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:33.220382 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-fb7d1912-da0e-4969-891f-7687142f061b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:33.220946 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-fb7d1912-da0e-4969-891f-7687142f061b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:33.232633 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fb7d1912-da0e-4969-891f-7687142f061b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:33.236586 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fb7d1912-da0e-4969-891f-7687142f061b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:33.238792 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fb7d1912-da0e-4969-891f-7687142f061b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:33.240965 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fb7d1912-da0e-4969-891f-7687142f061b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:33.243183 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fb7d1912-da0e-4969-891f-7687142f061b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:33.243934 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fb7d1912-da0e-4969-891f-7687142f061b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:33.588693 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-fc37d112-5146-48ee-983d-dc0c10ebb13f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:33.589970 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-fc37d112-5146-48ee-983d-dc0c10ebb13f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:33.600100 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fc37d112-5146-48ee-983d-dc0c10ebb13f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:33.601067 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fc37d112-5146-48ee-983d-dc0c10ebb13f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:33.601810 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fc37d112-5146-48ee-983d-dc0c10ebb13f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:33.602940 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fc37d112-5146-48ee-983d-dc0c10ebb13f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:33.603753 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fc37d112-5146-48ee-983d-dc0c10ebb13f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:33.604932 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fc37d112-5146-48ee-983d-dc0c10ebb13f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:33.727199 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-fb7d1912-da0e-4969-891f-7687142f061b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:33.743791 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-fb7d1912-da0e-4969-891f-7687142f061b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:33.745370 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-fb7d1912-da0e-4969-891f-7687142f061b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:33.753849 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-fb7d1912-da0e-4969-891f-7687142f061b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5" status: 200 len: 1810 microversion: 2.20 time: 0.532081 Aug 31 16:24:33.761096 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2655/5342] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:24:33 2022] GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5 => generated 1810 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:24:34.036363 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-fc37d112-5146-48ee-983d-dc0c10ebb13f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:34.054198 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-840a63f3-2097-4ace-b59c-1c76fbf48ac5 req-f8d7e8b0-f53c-4402-9263-71a9c59aac4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85a0286b-2e02-4ecb-a63d-0b4a61048ab5", "name": "network-vif-plugged", "status": "completed", "tag": "b2e423e8-4d65-4e9c-90c7-27d4697688c2"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:24:34.074144 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-fc37d112-5146-48ee-983d-dc0c10ebb13f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1510 microversion: 2.1 time: 0.493413 Aug 31 16:24:34.074781 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2688/5343] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:33 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1510 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:34.085657 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-840a63f3-2097-4ace-b59c-1c76fbf48ac5 req-f8d7e8b0-f53c-4402-9263-71a9c59aac4a service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:34.086537 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-840a63f3-2097-4ace-b59c-1c76fbf48ac5 req-f8d7e8b0-f53c-4402-9263-71a9c59aac4a service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:34.087187 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-840a63f3-2097-4ace-b59c-1c76fbf48ac5 req-f8d7e8b0-f53c-4402-9263-71a9c59aac4a service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:34.126945 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-840a63f3-2097-4ace-b59c-1c76fbf48ac5 req-f8d7e8b0-f53c-4402-9263-71a9c59aac4a service nova] Creating event network-vif-plugged:b2e423e8-4d65-4e9c-90c7-27d4697688c2 for instance 85a0286b-2e02-4ecb-a63d-0b4a61048ab5 on n-h2-850499-9 Aug 31 16:24:34.147005 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-840a63f3-2097-4ace-b59c-1c76fbf48ac5 req-f8d7e8b0-f53c-4402-9263-71a9c59aac4a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103516 Aug 31 16:24:34.151591 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2656/5344] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:24:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:24:34.402106 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8fcd2a59-28be-4384-8a3d-da40ddcaa86c tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:24:34.414750 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8fcd2a59-28be-4384-8a3d-da40ddcaa86c tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: d1c50fa6-2d8a-4707-9ee7-448ea57be62b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:34.430906 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8fcd2a59-28be-4384-8a3d-da40ddcaa86c tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:34.432243 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8fcd2a59-28be-4384-8a3d-da40ddcaa86c tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:34.434310 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8fcd2a59-28be-4384-8a3d-da40ddcaa86c tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:34.441067 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8fcd2a59-28be-4384-8a3d-da40ddcaa86c tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:34.442062 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8fcd2a59-28be-4384-8a3d-da40ddcaa86c tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:34.443157 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8fcd2a59-28be-4384-8a3d-da40ddcaa86c tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:34.542087 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-8fcd2a59-28be-4384-8a3d-da40ddcaa86c tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lazy-loading 'flavor' on Instance uuid d1c50fa6-2d8a-4707-9ee7-448ea57be62b {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:24:34.788035 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-16577c5b-5233-49df-b883-316c665f44d0 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:34.788914 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-16577c5b-5233-49df-b883-316c665f44d0 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:34.809070 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-16577c5b-5233-49df-b883-316c665f44d0 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:34.811649 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-16577c5b-5233-49df-b883-316c665f44d0 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:34.815389 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-16577c5b-5233-49df-b883-316c665f44d0 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:34.818653 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-16577c5b-5233-49df-b883-316c665f44d0 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:34.820327 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-16577c5b-5233-49df-b883-316c665f44d0 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:34.822383 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-16577c5b-5233-49df-b883-316c665f44d0 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:35.138622 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8fcd2a59-28be-4384-8a3d-da40ddcaa86c tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "POST /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b/action" status: 200 len: 32 microversion: 2.1 time: 0.746781 Aug 31 16:24:35.146016 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2689/5345] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:24:34 2022] POST /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b/action => generated 32 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 16:24:35.154799 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c7197127-7c50-4e50-b992-03b4e425d08a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:35.163825 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c7197127-7c50-4e50-b992-03b4e425d08a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:35.194281 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c7197127-7c50-4e50-b992-03b4e425d08a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:35.199406 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c7197127-7c50-4e50-b992-03b4e425d08a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:35.200084 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c7197127-7c50-4e50-b992-03b4e425d08a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:35.201135 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c7197127-7c50-4e50-b992-03b4e425d08a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:35.202266 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c7197127-7c50-4e50-b992-03b4e425d08a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:35.203229 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c7197127-7c50-4e50-b992-03b4e425d08a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:35.438932 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-16577c5b-5233-49df-b883-316c665f44d0 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:35.452818 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-16577c5b-5233-49df-b883-316c665f44d0 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:35.456498 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-16577c5b-5233-49df-b883-316c665f44d0 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:35.461181 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-16577c5b-5233-49df-b883-316c665f44d0 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5" status: 200 len: 1810 microversion: 2.20 time: 0.678827 Aug 31 16:24:35.463481 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2657/5346] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:24:34 2022] GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5 => generated 1810 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:24:35.472906 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-80c62612-15fc-428a-9ecd-b6365b70b902 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:35.485480 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-80c62612-15fc-428a-9ecd-b6365b70b902 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: d1c50fa6-2d8a-4707-9ee7-448ea57be62b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:35.494256 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-80c62612-15fc-428a-9ecd-b6365b70b902 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:35.494793 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-80c62612-15fc-428a-9ecd-b6365b70b902 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:35.495243 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-80c62612-15fc-428a-9ecd-b6365b70b902 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:35.496000 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-80c62612-15fc-428a-9ecd-b6365b70b902 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:35.496519 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-80c62612-15fc-428a-9ecd-b6365b70b902 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:35.497116 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-80c62612-15fc-428a-9ecd-b6365b70b902 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:35.649545 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c7197127-7c50-4e50-b992-03b4e425d08a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:35.674354 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c7197127-7c50-4e50-b992-03b4e425d08a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1510 microversion: 2.1 time: 0.521734 Aug 31 16:24:35.693132 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2690/5347] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:35 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1510 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:35.782442 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-80c62612-15fc-428a-9ecd-b6365b70b902 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4744703b964435bbead751ca884d1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e014d4e4da5e47ff9a1261e7730034ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:35.806524 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-80c62612-15fc-428a-9ecd-b6365b70b902 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b" status: 200 len: 1736 microversion: 2.1 time: 0.341315 Aug 31 16:24:35.807065 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2658/5348] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:35 2022] GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b => generated 1736 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:36.489998 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-bb7d3319-f032-48a3-b09a-c30d0112d53d tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:36.491089 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-bb7d3319-f032-48a3-b09a-c30d0112d53d tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:36.506953 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bb7d3319-f032-48a3-b09a-c30d0112d53d tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:36.511301 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bb7d3319-f032-48a3-b09a-c30d0112d53d tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:36.511868 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bb7d3319-f032-48a3-b09a-c30d0112d53d tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:36.521408 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bb7d3319-f032-48a3-b09a-c30d0112d53d tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:36.522265 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bb7d3319-f032-48a3-b09a-c30d0112d53d tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:36.523267 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bb7d3319-f032-48a3-b09a-c30d0112d53d tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:36.703460 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-070f9136-734c-4dd6-a362-75c5b4bfa08f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:36.704623 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-070f9136-734c-4dd6-a362-75c5b4bfa08f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:36.720104 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-070f9136-734c-4dd6-a362-75c5b4bfa08f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:36.722618 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-070f9136-734c-4dd6-a362-75c5b4bfa08f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:36.723134 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-070f9136-734c-4dd6-a362-75c5b4bfa08f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:36.723930 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-070f9136-734c-4dd6-a362-75c5b4bfa08f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:36.727100 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-070f9136-734c-4dd6-a362-75c5b4bfa08f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:36.727714 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-070f9136-734c-4dd6-a362-75c5b4bfa08f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:37.353940 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-bb7d3319-f032-48a3-b09a-c30d0112d53d tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:37.373622 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-bb7d3319-f032-48a3-b09a-c30d0112d53d tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:37.395448 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-bb7d3319-f032-48a3-b09a-c30d0112d53d tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:37.411549 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-bb7d3319-f032-48a3-b09a-c30d0112d53d tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5" status: 200 len: 1810 microversion: 2.20 time: 0.920045 Aug 31 16:24:37.412457 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2691/5349] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:24:36 2022] GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5 => generated 1810 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:24:37.433916 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-cd19c6fc-ec83-4445-aba0-f018d247beb2 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:37.435297 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-cd19c6fc-ec83-4445-aba0-f018d247beb2 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: d1c50fa6-2d8a-4707-9ee7-448ea57be62b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:37.442500 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-070f9136-734c-4dd6-a362-75c5b4bfa08f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:37.456656 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-070f9136-734c-4dd6-a362-75c5b4bfa08f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1510 microversion: 2.1 time: 0.759161 Aug 31 16:24:37.486381 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2659/5350] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:36 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1510 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:37.495264 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cd19c6fc-ec83-4445-aba0-f018d247beb2 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:37.495849 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cd19c6fc-ec83-4445-aba0-f018d247beb2 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:37.496265 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cd19c6fc-ec83-4445-aba0-f018d247beb2 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:37.497012 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cd19c6fc-ec83-4445-aba0-f018d247beb2 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:37.497486 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cd19c6fc-ec83-4445-aba0-f018d247beb2 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:37.497928 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cd19c6fc-ec83-4445-aba0-f018d247beb2 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:38.013045 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-cd19c6fc-ec83-4445-aba0-f018d247beb2 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4744703b964435bbead751ca884d1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e014d4e4da5e47ff9a1261e7730034ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:38.026161 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-cd19c6fc-ec83-4445-aba0-f018d247beb2 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b" status: 200 len: 1736 microversion: 2.1 time: 0.611909 Aug 31 16:24:38.036424 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2692/5351] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:37 2022] GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b => generated 1736 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:38.448868 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6c20a063-34b5-4330-bbcc-e190a0dac7d5 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:38.450205 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6c20a063-34b5-4330-bbcc-e190a0dac7d5 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:38.460717 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6c20a063-34b5-4330-bbcc-e190a0dac7d5 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:38.461229 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6c20a063-34b5-4330-bbcc-e190a0dac7d5 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:38.461823 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6c20a063-34b5-4330-bbcc-e190a0dac7d5 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:38.464987 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6c20a063-34b5-4330-bbcc-e190a0dac7d5 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:38.465576 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6c20a063-34b5-4330-bbcc-e190a0dac7d5 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:38.466029 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6c20a063-34b5-4330-bbcc-e190a0dac7d5 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:38.484868 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d4020da3-d7b2-42ac-a2f7-0ef79b715e27 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:38.485674 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d4020da3-d7b2-42ac-a2f7-0ef79b715e27 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:38.506092 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d4020da3-d7b2-42ac-a2f7-0ef79b715e27 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:38.506092 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d4020da3-d7b2-42ac-a2f7-0ef79b715e27 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:38.506092 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d4020da3-d7b2-42ac-a2f7-0ef79b715e27 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:38.506092 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d4020da3-d7b2-42ac-a2f7-0ef79b715e27 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:38.506092 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d4020da3-d7b2-42ac-a2f7-0ef79b715e27 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:38.506092 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d4020da3-d7b2-42ac-a2f7-0ef79b715e27 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:38.959818 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d4020da3-d7b2-42ac-a2f7-0ef79b715e27 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:38.965630 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-6c20a063-34b5-4330-bbcc-e190a0dac7d5 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:38.987301 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d4020da3-d7b2-42ac-a2f7-0ef79b715e27 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1510 microversion: 2.1 time: 0.508227 Aug 31 16:24:38.991043 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2693/5352] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:38 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1510 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:24:39.025835 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-6c20a063-34b5-4330-bbcc-e190a0dac7d5 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:39.028735 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-6c20a063-34b5-4330-bbcc-e190a0dac7d5 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:39.030185 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6c20a063-34b5-4330-bbcc-e190a0dac7d5 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5" status: 200 len: 1810 microversion: 2.20 time: 0.589878 Aug 31 16:24:39.031658 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2660/5353] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:24:38 2022] GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5 => generated 1810 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:24:39.058758 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-894dca39-d4f6-4541-b627-5b6ccbb220c0 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:39.059471 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-894dca39-d4f6-4541-b627-5b6ccbb220c0 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: d1c50fa6-2d8a-4707-9ee7-448ea57be62b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:39.072257 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-894dca39-d4f6-4541-b627-5b6ccbb220c0 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:39.076326 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-894dca39-d4f6-4541-b627-5b6ccbb220c0 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:39.076921 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-894dca39-d4f6-4541-b627-5b6ccbb220c0 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:39.078382 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-894dca39-d4f6-4541-b627-5b6ccbb220c0 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:39.078941 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-894dca39-d4f6-4541-b627-5b6ccbb220c0 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:39.079608 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-894dca39-d4f6-4541-b627-5b6ccbb220c0 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:39.286207 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-894dca39-d4f6-4541-b627-5b6ccbb220c0 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4744703b964435bbead751ca884d1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e014d4e4da5e47ff9a1261e7730034ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:39.295463 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-894dca39-d4f6-4541-b627-5b6ccbb220c0 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b" status: 200 len: 1736 microversion: 2.1 time: 0.240741 Aug 31 16:24:39.297402 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2694/5354] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:39 2022] GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b => generated 1736 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:40.014832 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e52f9f54-048e-429b-9f74-2d6867777e8f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:40.016351 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e52f9f54-048e-429b-9f74-2d6867777e8f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:40.026262 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e52f9f54-048e-429b-9f74-2d6867777e8f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:40.026919 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e52f9f54-048e-429b-9f74-2d6867777e8f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:40.027845 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e52f9f54-048e-429b-9f74-2d6867777e8f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:40.028556 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e52f9f54-048e-429b-9f74-2d6867777e8f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:40.032170 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e52f9f54-048e-429b-9f74-2d6867777e8f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:40.033316 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e52f9f54-048e-429b-9f74-2d6867777e8f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:40.064699 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-28c88510-99ad-49e2-9a22-f084b61eb1c9 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:40.065656 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-28c88510-99ad-49e2-9a22-f084b61eb1c9 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:40.087933 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-28c88510-99ad-49e2-9a22-f084b61eb1c9 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:40.090800 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-28c88510-99ad-49e2-9a22-f084b61eb1c9 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:40.092298 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-28c88510-99ad-49e2-9a22-f084b61eb1c9 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:40.098064 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-28c88510-99ad-49e2-9a22-f084b61eb1c9 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:40.099803 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-28c88510-99ad-49e2-9a22-f084b61eb1c9 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:40.100692 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-28c88510-99ad-49e2-9a22-f084b61eb1c9 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:40.424728 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e52f9f54-048e-429b-9f74-2d6867777e8f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:40.435907 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e52f9f54-048e-429b-9f74-2d6867777e8f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1510 microversion: 2.1 time: 0.425309 Aug 31 16:24:40.437507 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2661/5355] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:40 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1510 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:40.444670 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7a1a6e78-7fa8-42fe-93f1-ba8a922f2963 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:40.445979 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7a1a6e78-7fa8-42fe-93f1-ba8a922f2963 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: d1c50fa6-2d8a-4707-9ee7-448ea57be62b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:40.464674 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7a1a6e78-7fa8-42fe-93f1-ba8a922f2963 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:40.465386 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7a1a6e78-7fa8-42fe-93f1-ba8a922f2963 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:40.465988 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7a1a6e78-7fa8-42fe-93f1-ba8a922f2963 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:40.466930 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7a1a6e78-7fa8-42fe-93f1-ba8a922f2963 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:40.468684 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7a1a6e78-7fa8-42fe-93f1-ba8a922f2963 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:40.469473 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7a1a6e78-7fa8-42fe-93f1-ba8a922f2963 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:40.489795 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-28c88510-99ad-49e2-9a22-f084b61eb1c9 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:40.511001 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-28c88510-99ad-49e2-9a22-f084b61eb1c9 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:40.516746 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-28c88510-99ad-49e2-9a22-f084b61eb1c9 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:40.517232 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:24:40.521271 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-28c88510-99ad-49e2-9a22-f084b61eb1c9 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5" status: 200 len: 1797 microversion: 2.20 time: 0.462905 Aug 31 16:24:40.540165 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2695/5356] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:24:40 2022] GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5 => generated 1797 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:24:40.728756 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7a1a6e78-7fa8-42fe-93f1-ba8a922f2963 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4744703b964435bbead751ca884d1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e014d4e4da5e47ff9a1261e7730034ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:40.745849 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7a1a6e78-7fa8-42fe-93f1-ba8a922f2963 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b" status: 200 len: 1736 microversion: 2.1 time: 0.305908 Aug 31 16:24:40.758670 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2662/5357] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:40 2022] GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b => generated 1736 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:41.477706 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-db7506bb-e7af-4458-8b3a-13531dadc0be tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:41.478347 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-db7506bb-e7af-4458-8b3a-13531dadc0be tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:41.491817 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-db7506bb-e7af-4458-8b3a-13531dadc0be tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:41.492619 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-db7506bb-e7af-4458-8b3a-13531dadc0be tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:41.493241 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-db7506bb-e7af-4458-8b3a-13531dadc0be tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:41.494234 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-db7506bb-e7af-4458-8b3a-13531dadc0be tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:41.494917 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-db7506bb-e7af-4458-8b3a-13531dadc0be tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:41.495763 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-db7506bb-e7af-4458-8b3a-13531dadc0be tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:41.535022 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:24:41.781717 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6bf210de-222f-4405-950c-b5fdf134a110 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:41.782338 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6bf210de-222f-4405-950c-b5fdf134a110 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: d1c50fa6-2d8a-4707-9ee7-448ea57be62b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:41.802032 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6bf210de-222f-4405-950c-b5fdf134a110 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:41.802803 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6bf210de-222f-4405-950c-b5fdf134a110 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:41.803459 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6bf210de-222f-4405-950c-b5fdf134a110 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:41.804410 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6bf210de-222f-4405-950c-b5fdf134a110 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:41.805056 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6bf210de-222f-4405-950c-b5fdf134a110 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:41.805666 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6bf210de-222f-4405-950c-b5fdf134a110 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:41.851815 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-db7506bb-e7af-4458-8b3a-13531dadc0be tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:41.865498 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-db7506bb-e7af-4458-8b3a-13531dadc0be tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1510 microversion: 2.1 time: 0.393530 Aug 31 16:24:41.870544 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2696/5358] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:41 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1510 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:42.102609 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-6bf210de-222f-4405-950c-b5fdf134a110 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4744703b964435bbead751ca884d1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e014d4e4da5e47ff9a1261e7730034ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:42.124096 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6bf210de-222f-4405-950c-b5fdf134a110 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b" status: 200 len: 1736 microversion: 2.1 time: 0.345682 Aug 31 16:24:42.126505 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2663/5359] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:41 2022] GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b => generated 1736 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:42.897236 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2e54b613-1fbf-48cd-a7ae-b78dbfda74cb tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:42.899450 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2e54b613-1fbf-48cd-a7ae-b78dbfda74cb tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:42.913337 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2e54b613-1fbf-48cd-a7ae-b78dbfda74cb tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:42.916988 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2e54b613-1fbf-48cd-a7ae-b78dbfda74cb tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:42.917788 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2e54b613-1fbf-48cd-a7ae-b78dbfda74cb tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:42.923437 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2e54b613-1fbf-48cd-a7ae-b78dbfda74cb tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:42.923972 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2e54b613-1fbf-48cd-a7ae-b78dbfda74cb tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:42.924410 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2e54b613-1fbf-48cd-a7ae-b78dbfda74cb tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:43.162149 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6c700e6c-bec7-4e19-9dc5-416e123b46db tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:43.163143 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6c700e6c-bec7-4e19-9dc5-416e123b46db tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: d1c50fa6-2d8a-4707-9ee7-448ea57be62b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:43.197102 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6c700e6c-bec7-4e19-9dc5-416e123b46db tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:43.197623 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6c700e6c-bec7-4e19-9dc5-416e123b46db tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:43.198077 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6c700e6c-bec7-4e19-9dc5-416e123b46db tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:43.200458 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6c700e6c-bec7-4e19-9dc5-416e123b46db tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:43.201037 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6c700e6c-bec7-4e19-9dc5-416e123b46db tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:43.201754 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6c700e6c-bec7-4e19-9dc5-416e123b46db tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:43.417503 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2e54b613-1fbf-48cd-a7ae-b78dbfda74cb tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:43.429436 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2e54b613-1fbf-48cd-a7ae-b78dbfda74cb tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1510 microversion: 2.1 time: 0.539571 Aug 31 16:24:43.445856 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2697/5360] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:42 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1510 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:44.303529 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-6c700e6c-bec7-4e19-9dc5-416e123b46db tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4744703b964435bbead751ca884d1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e014d4e4da5e47ff9a1261e7730034ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:44.315522 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6c700e6c-bec7-4e19-9dc5-416e123b46db tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b" status: 200 len: 1736 microversion: 2.1 time: 1.163122 Aug 31 16:24:44.316165 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2664/5361] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:43 2022] GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b => generated 1736 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:44.461207 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f15552ba-bba5-4a6a-9c74-70ac012f8af7 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:44.461923 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f15552ba-bba5-4a6a-9c74-70ac012f8af7 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:44.471931 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f15552ba-bba5-4a6a-9c74-70ac012f8af7 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:44.472432 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f15552ba-bba5-4a6a-9c74-70ac012f8af7 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:44.472882 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f15552ba-bba5-4a6a-9c74-70ac012f8af7 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:44.473607 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f15552ba-bba5-4a6a-9c74-70ac012f8af7 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:44.474073 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f15552ba-bba5-4a6a-9c74-70ac012f8af7 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:44.474509 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f15552ba-bba5-4a6a-9c74-70ac012f8af7 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:44.535788 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4bcdca1d-9cb5-4fb7-b52d-82a0579f3b3c tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Action: 'create', calling method: .version_select at 0x7f5ae3c42dc0>, body: {"keypair": {"name": "tempest-keypair-832706107", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPUuhj9ROBCCgpTSolGF6dgpAq64P846doNnFvVshT7if7aSA5U3axiIhdszbFguiFijweCcF5Y9byqIMVtkYCSHI5292bZGm1EmVlLBH0IkiIf7AsVMXH+yzx177vaNKQ=="}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:24:44.579048 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-4bcdca1d-9cb5-4fb7-b52d-82a0579f3b3c tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Getting quotas for project 79d9ba3589a24faaac930a35742ce834. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:24:44.587685 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-4bcdca1d-9cb5-4fb7-b52d-82a0579f3b3c tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Getting quotas for user 133363b2b12d4730994557ee24f08879 and project 79d9ba3589a24faaac930a35742ce834. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:24:44.623967 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4bcdca1d-9cb5-4fb7-b52d-82a0579f3b3c tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.092923 Aug 31 16:24:44.625528 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2665/5362] 10.222.0.61 () {60 vars in 1159 bytes} [Wed Aug 31 16:24:44 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:24:44.918778 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f15552ba-bba5-4a6a-9c74-70ac012f8af7 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:44.948891 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f15552ba-bba5-4a6a-9c74-70ac012f8af7 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1510 microversion: 2.1 time: 0.492177 Aug 31 16:24:44.967201 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2698/5363] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:44 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1510 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:45.341818 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b56eeaaa-12a7-455e-9cda-e699f983c407 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:45.343451 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b56eeaaa-12a7-455e-9cda-e699f983c407 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: d1c50fa6-2d8a-4707-9ee7-448ea57be62b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:45.363784 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b56eeaaa-12a7-455e-9cda-e699f983c407 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:45.364934 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b56eeaaa-12a7-455e-9cda-e699f983c407 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:45.365820 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b56eeaaa-12a7-455e-9cda-e699f983c407 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:45.367133 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b56eeaaa-12a7-455e-9cda-e699f983c407 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:45.368052 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b56eeaaa-12a7-455e-9cda-e699f983c407 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:45.369030 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b56eeaaa-12a7-455e-9cda-e699f983c407 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:45.757971 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b56eeaaa-12a7-455e-9cda-e699f983c407 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4744703b964435bbead751ca884d1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e014d4e4da5e47ff9a1261e7730034ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:45.777391 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b56eeaaa-12a7-455e-9cda-e699f983c407 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b" status: 200 len: 1736 microversion: 2.1 time: 0.442797 Aug 31 16:24:45.791219 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2666/5364] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:45 2022] GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b => generated 1736 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:24:45.973450 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-17bb062f-709f-4073-8f1e-19021163c0ed tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:45.974076 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-17bb062f-709f-4073-8f1e-19021163c0ed tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:45.990515 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-17bb062f-709f-4073-8f1e-19021163c0ed tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:45.991085 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-17bb062f-709f-4073-8f1e-19021163c0ed tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:45.991635 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-17bb062f-709f-4073-8f1e-19021163c0ed tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:45.992470 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-17bb062f-709f-4073-8f1e-19021163c0ed tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:45.993802 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-17bb062f-709f-4073-8f1e-19021163c0ed tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:45.996343 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-17bb062f-709f-4073-8f1e-19021163c0ed tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:46.343875 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-17bb062f-709f-4073-8f1e-19021163c0ed tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:46.362578 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-17bb062f-709f-4073-8f1e-19021163c0ed tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1510 microversion: 2.1 time: 0.392496 Aug 31 16:24:46.364127 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2699/5365] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:45 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1510 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:46.811640 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7e4acf37-9ec2-4709-bb81-c29b57381e7e tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:46.814410 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7e4acf37-9ec2-4709-bb81-c29b57381e7e tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: d1c50fa6-2d8a-4707-9ee7-448ea57be62b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:46.840955 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:24:46.845059 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7e4acf37-9ec2-4709-bb81-c29b57381e7e tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:46.848177 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7e4acf37-9ec2-4709-bb81-c29b57381e7e tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:46.848999 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7e4acf37-9ec2-4709-bb81-c29b57381e7e tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:46.851530 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7e4acf37-9ec2-4709-bb81-c29b57381e7e tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:46.853378 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7e4acf37-9ec2-4709-bb81-c29b57381e7e tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:46.855929 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7e4acf37-9ec2-4709-bb81-c29b57381e7e tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:47.165234 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7e4acf37-9ec2-4709-bb81-c29b57381e7e tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4744703b964435bbead751ca884d1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e014d4e4da5e47ff9a1261e7730034ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:47.185247 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7e4acf37-9ec2-4709-bb81-c29b57381e7e tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b" status: 200 len: 1736 microversion: 2.1 time: 0.378736 Aug 31 16:24:47.188980 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2667/5366] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:46 2022] GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b => generated 1736 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:47.386948 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c0cc7d67-b535-4d38-b79e-767b45eb7033 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:47.388389 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c0cc7d67-b535-4d38-b79e-767b45eb7033 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:47.402492 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=58 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:24:47.414080 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c0cc7d67-b535-4d38-b79e-767b45eb7033 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:47.415165 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c0cc7d67-b535-4d38-b79e-767b45eb7033 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:47.416070 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c0cc7d67-b535-4d38-b79e-767b45eb7033 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:47.417159 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c0cc7d67-b535-4d38-b79e-767b45eb7033 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:47.419959 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c0cc7d67-b535-4d38-b79e-767b45eb7033 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:47.427603 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c0cc7d67-b535-4d38-b79e-767b45eb7033 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:47.759381 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c0cc7d67-b535-4d38-b79e-767b45eb7033 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:47.786827 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c0cc7d67-b535-4d38-b79e-767b45eb7033 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1510 microversion: 2.1 time: 0.403134 Aug 31 16:24:47.788758 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2700/5367] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:47 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1510 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:48.213354 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-48a91502-976f-470c-9e29-f1c35dfbfb34 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:48.215398 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-48a91502-976f-470c-9e29-f1c35dfbfb34 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: d1c50fa6-2d8a-4707-9ee7-448ea57be62b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:48.236596 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-48a91502-976f-470c-9e29-f1c35dfbfb34 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:48.241934 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-48a91502-976f-470c-9e29-f1c35dfbfb34 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:48.244820 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-48a91502-976f-470c-9e29-f1c35dfbfb34 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:48.245816 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-48a91502-976f-470c-9e29-f1c35dfbfb34 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:48.251381 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-48a91502-976f-470c-9e29-f1c35dfbfb34 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:48.252470 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-48a91502-976f-470c-9e29-f1c35dfbfb34 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:48.297975 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-948d8784-0637-4ec2-8c60-26e4036a3c6b tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-424444096", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "11b1617b-14c9-40d6-9f52-0ad0c12edada"}], "security_groups": [{"name": "tempest-securitygroup--300469823"}], "key_name": "tempest-keypair-832706107", "user_data": "}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:24:48.572527 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-948d8784-0637-4ec2-8c60-26e4036a3c6b tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] validate_networks() for [('11b1617b-14c9-40d6-9f52-0ad0c12edada', None, None, None, None, None)] {{(pid=122257) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:24:48.581089 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-48a91502-976f-470c-9e29-f1c35dfbfb34 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4744703b964435bbead751ca884d1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e014d4e4da5e47ff9a1261e7730034ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:48.593495 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-48a91502-976f-470c-9e29-f1c35dfbfb34 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b" status: 200 len: 1736 microversion: 2.1 time: 0.386877 Aug 31 16:24:48.595115 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2668/5368] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:48 2022] GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b => generated 1736 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:48.819559 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5d357a80-bc28-4f1c-8835-e07f969bb946 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:48.820258 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5d357a80-bc28-4f1c-8835-e07f969bb946 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:48.826992 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5d357a80-bc28-4f1c-8835-e07f969bb946 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:48.828249 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5d357a80-bc28-4f1c-8835-e07f969bb946 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:48.829018 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5d357a80-bc28-4f1c-8835-e07f969bb946 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:48.829887 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5d357a80-bc28-4f1c-8835-e07f969bb946 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:48.830496 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5d357a80-bc28-4f1c-8835-e07f969bb946 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:48.831048 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5d357a80-bc28-4f1c-8835-e07f969bb946 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:49.121967 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5d357a80-bc28-4f1c-8835-e07f969bb946 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:49.146015 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5d357a80-bc28-4f1c-8835-e07f969bb946 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1510 microversion: 2.1 time: 0.330762 Aug 31 16:24:49.148059 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2669/5369] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:48 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1510 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:24:49.297836 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-948d8784-0637-4ec2-8c60-26e4036a3c6b tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:24:49.299688 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-948d8784-0637-4ec2-8c60-26e4036a3c6b tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:24:49.300672 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-948d8784-0637-4ec2-8c60-26e4036a3c6b tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:24:49.302336 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-948d8784-0637-4ec2-8c60-26e4036a3c6b tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:24:49.303121 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-948d8784-0637-4ec2-8c60-26e4036a3c6b tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:24:49.319565 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-948d8784-0637-4ec2-8c60-26e4036a3c6b tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:49.320456 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-948d8784-0637-4ec2-8c60-26e4036a3c6b tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:49.322230 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-948d8784-0637-4ec2-8c60-26e4036a3c6b tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:49.324955 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-948d8784-0637-4ec2-8c60-26e4036a3c6b tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:49.326680 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-948d8784-0637-4ec2-8c60-26e4036a3c6b tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:49.334839 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-948d8784-0637-4ec2-8c60-26e4036a3c6b tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:49.362989 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-948d8784-0637-4ec2-8c60-26e4036a3c6b tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Getting quotas for project 79d9ba3589a24faaac930a35742ce834. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:24:49.370785 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-948d8784-0637-4ec2-8c60-26e4036a3c6b tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Getting quotas for user 133363b2b12d4730994557ee24f08879 and project 79d9ba3589a24faaac930a35742ce834. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:24:49.396042 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-948d8784-0637-4ec2-8c60-26e4036a3c6b tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Going to run 1 instances... {{(pid=122257) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:24:49.398561 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-948d8784-0637-4ec2-8c60-26e4036a3c6b tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: b92e2d45-4596-4f2b-8a5c-8fd5f0084630] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:24:49.464587 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-948d8784-0637-4ec2-8c60-26e4036a3c6b tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.173609 Aug 31 16:24:49.474776 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2701/5370] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:24:48 2022] POST /compute/v2.1/servers => generated 401 bytes in 1186 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 16:24:49.484156 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-08123699-2477-48e5-9c61-f21d2239be53 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:49.485751 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-08123699-2477-48e5-9c61-f21d2239be53 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: b92e2d45-4596-4f2b-8a5c-8fd5f0084630] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:49.590376 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-08123699-2477-48e5-9c61-f21d2239be53 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133363b2b12d4730994557ee24f08879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d9ba3589a24faaac930a35742ce834', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:49.600364 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-08123699-2477-48e5-9c61-f21d2239be53 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/b92e2d45-4596-4f2b-8a5c-8fd5f0084630" status: 200 len: 1240 microversion: 2.1 time: 0.122309 Aug 31 16:24:49.601324 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2670/5371] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:49 2022] GET /compute/v2.1/servers/b92e2d45-4596-4f2b-8a5c-8fd5f0084630 => generated 1240 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:49.630151 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4229911c-a410-437f-a803-8384eeb15423 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:49.632057 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4229911c-a410-437f-a803-8384eeb15423 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: d1c50fa6-2d8a-4707-9ee7-448ea57be62b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:49.657549 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4229911c-a410-437f-a803-8384eeb15423 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:49.658060 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4229911c-a410-437f-a803-8384eeb15423 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:49.658506 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4229911c-a410-437f-a803-8384eeb15423 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:49.659236 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4229911c-a410-437f-a803-8384eeb15423 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:49.659736 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4229911c-a410-437f-a803-8384eeb15423 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:49.660170 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4229911c-a410-437f-a803-8384eeb15423 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:50.093759 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-4229911c-a410-437f-a803-8384eeb15423 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4744703b964435bbead751ca884d1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e014d4e4da5e47ff9a1261e7730034ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:50.109845 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4229911c-a410-437f-a803-8384eeb15423 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b" status: 200 len: 1736 microversion: 2.1 time: 0.487381 Aug 31 16:24:50.115041 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2702/5372] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:49 2022] GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b => generated 1736 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:24:50.168373 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-61c73f37-fc5d-438c-b5e0-ce67adefe273 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:50.169906 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-61c73f37-fc5d-438c-b5e0-ce67adefe273 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:50.600947 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-61c73f37-fc5d-438c-b5e0-ce67adefe273 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:50.603010 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-61c73f37-fc5d-438c-b5e0-ce67adefe273 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:50.604460 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-61c73f37-fc5d-438c-b5e0-ce67adefe273 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:50.606003 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-61c73f37-fc5d-438c-b5e0-ce67adefe273 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:50.607070 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-61c73f37-fc5d-438c-b5e0-ce67adefe273 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:50.609290 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-61c73f37-fc5d-438c-b5e0-ce67adefe273 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:50.628862 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-23948913-59bb-4ce4-b6a8-ebabc0ab1670 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:50.632619 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-23948913-59bb-4ce4-b6a8-ebabc0ab1670 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: b92e2d45-4596-4f2b-8a5c-8fd5f0084630] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:50.653851 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-23948913-59bb-4ce4-b6a8-ebabc0ab1670 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:50.656215 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-23948913-59bb-4ce4-b6a8-ebabc0ab1670 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:50.656965 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-23948913-59bb-4ce4-b6a8-ebabc0ab1670 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:50.661237 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-23948913-59bb-4ce4-b6a8-ebabc0ab1670 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:50.662653 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-23948913-59bb-4ce4-b6a8-ebabc0ab1670 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:50.664387 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-23948913-59bb-4ce4-b6a8-ebabc0ab1670 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:50.929259 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-23948913-59bb-4ce4-b6a8-ebabc0ab1670 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133363b2b12d4730994557ee24f08879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d9ba3589a24faaac930a35742ce834', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:50.945060 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-23948913-59bb-4ce4-b6a8-ebabc0ab1670 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/b92e2d45-4596-4f2b-8a5c-8fd5f0084630" status: 200 len: 1292 microversion: 2.1 time: 0.323118 Aug 31 16:24:50.947828 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2703/5373] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:50 2022] GET /compute/v2.1/servers/b92e2d45-4596-4f2b-8a5c-8fd5f0084630 => generated 1292 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:50.997227 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-61c73f37-fc5d-438c-b5e0-ce67adefe273 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:51.007667 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-61c73f37-fc5d-438c-b5e0-ce67adefe273 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1510 microversion: 2.1 time: 0.843042 Aug 31 16:24:51.008640 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2671/5374] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:50 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1510 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:51.136915 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-05b6397d-4b96-4a8e-8dea-1275e43b4e63 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:51.138430 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-05b6397d-4b96-4a8e-8dea-1275e43b4e63 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: d1c50fa6-2d8a-4707-9ee7-448ea57be62b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:51.147081 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-05b6397d-4b96-4a8e-8dea-1275e43b4e63 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:51.148172 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-05b6397d-4b96-4a8e-8dea-1275e43b4e63 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:51.149131 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-05b6397d-4b96-4a8e-8dea-1275e43b4e63 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:51.150519 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-05b6397d-4b96-4a8e-8dea-1275e43b4e63 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:51.152291 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-05b6397d-4b96-4a8e-8dea-1275e43b4e63 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:51.154921 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-05b6397d-4b96-4a8e-8dea-1275e43b4e63 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:51.936793 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-05b6397d-4b96-4a8e-8dea-1275e43b4e63 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4744703b964435bbead751ca884d1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e014d4e4da5e47ff9a1261e7730034ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:51.946120 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-05b6397d-4b96-4a8e-8dea-1275e43b4e63 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b" status: 200 len: 1736 microversion: 2.1 time: 0.813559 Aug 31 16:24:51.947427 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2704/5375] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:51 2022] GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b => generated 1736 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:51.976064 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5d51419c-12ca-454e-9c44-22f1c59f10f9 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:51.977987 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5d51419c-12ca-454e-9c44-22f1c59f10f9 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: b92e2d45-4596-4f2b-8a5c-8fd5f0084630] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:51.988649 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5d51419c-12ca-454e-9c44-22f1c59f10f9 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:51.989989 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5d51419c-12ca-454e-9c44-22f1c59f10f9 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:51.990904 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5d51419c-12ca-454e-9c44-22f1c59f10f9 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:51.992704 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5d51419c-12ca-454e-9c44-22f1c59f10f9 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:51.993637 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5d51419c-12ca-454e-9c44-22f1c59f10f9 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:51.994506 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5d51419c-12ca-454e-9c44-22f1c59f10f9 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:52.033374 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8ad55417-e75b-4aea-993c-63d10f786290 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:52.034095 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8ad55417-e75b-4aea-993c-63d10f786290 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:52.045673 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8ad55417-e75b-4aea-993c-63d10f786290 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:52.046583 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8ad55417-e75b-4aea-993c-63d10f786290 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:52.047344 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8ad55417-e75b-4aea-993c-63d10f786290 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:52.048816 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8ad55417-e75b-4aea-993c-63d10f786290 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:52.051409 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8ad55417-e75b-4aea-993c-63d10f786290 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:52.052179 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8ad55417-e75b-4aea-993c-63d10f786290 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:52.218758 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5d51419c-12ca-454e-9c44-22f1c59f10f9 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133363b2b12d4730994557ee24f08879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d9ba3589a24faaac930a35742ce834', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:52.227230 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5d51419c-12ca-454e-9c44-22f1c59f10f9 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/b92e2d45-4596-4f2b-8a5c-8fd5f0084630" status: 200 len: 1298 microversion: 2.1 time: 0.259470 Aug 31 16:24:52.227862 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2672/5376] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:51 2022] GET /compute/v2.1/servers/b92e2d45-4596-4f2b-8a5c-8fd5f0084630 => generated 1298 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:52.560120 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8ad55417-e75b-4aea-993c-63d10f786290 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:52.576220 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8ad55417-e75b-4aea-993c-63d10f786290 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1510 microversion: 2.1 time: 0.549611 Aug 31 16:24:52.578141 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2705/5377] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:52 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1510 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:52.970137 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-76399f75-361d-45ee-ac95-f700b13121e2 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:52.970755 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-76399f75-361d-45ee-ac95-f700b13121e2 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: d1c50fa6-2d8a-4707-9ee7-448ea57be62b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:52.986848 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-76399f75-361d-45ee-ac95-f700b13121e2 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:52.989289 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-76399f75-361d-45ee-ac95-f700b13121e2 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:52.990012 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-76399f75-361d-45ee-ac95-f700b13121e2 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:52.991149 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-76399f75-361d-45ee-ac95-f700b13121e2 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:52.991864 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-76399f75-361d-45ee-ac95-f700b13121e2 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:52.992472 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-76399f75-361d-45ee-ac95-f700b13121e2 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:53.252973 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f6ab6cc5-e455-4096-843c-528606870143 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:53.253792 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f6ab6cc5-e455-4096-843c-528606870143 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: b92e2d45-4596-4f2b-8a5c-8fd5f0084630] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:53.264775 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f6ab6cc5-e455-4096-843c-528606870143 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:53.265770 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f6ab6cc5-e455-4096-843c-528606870143 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:53.266330 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f6ab6cc5-e455-4096-843c-528606870143 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:53.267176 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f6ab6cc5-e455-4096-843c-528606870143 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:53.269663 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f6ab6cc5-e455-4096-843c-528606870143 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:53.270450 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f6ab6cc5-e455-4096-843c-528606870143 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:53.445627 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-76399f75-361d-45ee-ac95-f700b13121e2 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4744703b964435bbead751ca884d1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e014d4e4da5e47ff9a1261e7730034ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:53.462243 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-76399f75-361d-45ee-ac95-f700b13121e2 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b" status: 200 len: 1736 microversion: 2.1 time: 0.496155 Aug 31 16:24:53.463262 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2673/5378] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:52 2022] GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b => generated 1736 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:53.470213 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f6ab6cc5-e455-4096-843c-528606870143 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133363b2b12d4730994557ee24f08879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d9ba3589a24faaac930a35742ce834', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:53.487831 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f6ab6cc5-e455-4096-843c-528606870143 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/b92e2d45-4596-4f2b-8a5c-8fd5f0084630" status: 200 len: 1298 microversion: 2.1 time: 0.239780 Aug 31 16:24:53.488787 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2706/5379] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:53 2022] GET /compute/v2.1/servers/b92e2d45-4596-4f2b-8a5c-8fd5f0084630 => generated 1298 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:24:53.610544 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-dd84ad4f-94cc-4b85-aa6f-2828582a4129 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:53.611181 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-dd84ad4f-94cc-4b85-aa6f-2828582a4129 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:53.629959 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dd84ad4f-94cc-4b85-aa6f-2828582a4129 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:53.630979 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dd84ad4f-94cc-4b85-aa6f-2828582a4129 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:53.630979 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dd84ad4f-94cc-4b85-aa6f-2828582a4129 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:53.631681 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dd84ad4f-94cc-4b85-aa6f-2828582a4129 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:53.632147 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dd84ad4f-94cc-4b85-aa6f-2828582a4129 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:53.632783 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dd84ad4f-94cc-4b85-aa6f-2828582a4129 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:54.114083 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-dd84ad4f-94cc-4b85-aa6f-2828582a4129 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:54.129892 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-dd84ad4f-94cc-4b85-aa6f-2828582a4129 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1510 microversion: 2.1 time: 0.523465 Aug 31 16:24:54.133035 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2674/5380] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:53 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1510 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:54.490874 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-57e35d81-16eb-4620-95e3-f4dc554a1475 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:54.492205 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-57e35d81-16eb-4620-95e3-f4dc554a1475 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: d1c50fa6-2d8a-4707-9ee7-448ea57be62b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:54.499689 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-57e35d81-16eb-4620-95e3-f4dc554a1475 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:54.500734 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-57e35d81-16eb-4620-95e3-f4dc554a1475 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:54.501520 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-57e35d81-16eb-4620-95e3-f4dc554a1475 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:54.502475 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-57e35d81-16eb-4620-95e3-f4dc554a1475 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:54.502952 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-57e35d81-16eb-4620-95e3-f4dc554a1475 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:54.503600 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-57e35d81-16eb-4620-95e3-f4dc554a1475 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:54.518667 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-eab3bfb4-3577-42d1-ad4b-34c358234e3d tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:54.519640 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-eab3bfb4-3577-42d1-ad4b-34c358234e3d tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: b92e2d45-4596-4f2b-8a5c-8fd5f0084630] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:54.529152 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eab3bfb4-3577-42d1-ad4b-34c358234e3d tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:54.534515 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eab3bfb4-3577-42d1-ad4b-34c358234e3d tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:54.536031 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eab3bfb4-3577-42d1-ad4b-34c358234e3d tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:54.540712 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eab3bfb4-3577-42d1-ad4b-34c358234e3d tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:54.542146 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eab3bfb4-3577-42d1-ad4b-34c358234e3d tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:54.542611 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eab3bfb4-3577-42d1-ad4b-34c358234e3d tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:54.970324 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-57e35d81-16eb-4620-95e3-f4dc554a1475 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4744703b964435bbead751ca884d1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e014d4e4da5e47ff9a1261e7730034ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:54.984424 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-57e35d81-16eb-4620-95e3-f4dc554a1475 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b" status: 200 len: 1736 microversion: 2.1 time: 0.501580 Aug 31 16:24:54.988771 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2707/5381] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:54 2022] GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b => generated 1736 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:54.990042 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-eab3bfb4-3577-42d1-ad4b-34c358234e3d tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133363b2b12d4730994557ee24f08879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d9ba3589a24faaac930a35742ce834', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:54.998414 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-eab3bfb4-3577-42d1-ad4b-34c358234e3d tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/b92e2d45-4596-4f2b-8a5c-8fd5f0084630" status: 200 len: 1365 microversion: 2.1 time: 0.486727 Aug 31 16:24:55.000286 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2675/5382] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:54 2022] GET /compute/v2.1/servers/b92e2d45-4596-4f2b-8a5c-8fd5f0084630 => generated 1365 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:55.157866 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-95531cb1-aea1-4b40-8aae-b91efa8bad18 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:55.158723 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-95531cb1-aea1-4b40-8aae-b91efa8bad18 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:55.179106 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-95531cb1-aea1-4b40-8aae-b91efa8bad18 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:55.180827 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-95531cb1-aea1-4b40-8aae-b91efa8bad18 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:55.182609 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-95531cb1-aea1-4b40-8aae-b91efa8bad18 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:55.184643 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-95531cb1-aea1-4b40-8aae-b91efa8bad18 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:55.186180 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-95531cb1-aea1-4b40-8aae-b91efa8bad18 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:55.190325 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-95531cb1-aea1-4b40-8aae-b91efa8bad18 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:55.479307 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-95531cb1-aea1-4b40-8aae-b91efa8bad18 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:55.493119 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-95531cb1-aea1-4b40-8aae-b91efa8bad18 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1531 microversion: 2.1 time: 0.339867 Aug 31 16:24:55.503964 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2708/5383] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:55 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1531 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:55.605923 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-d90b3fcf-3ce3-46fa-9362-1791f264a1e1 req-50e8715c-a158-4fd8-a0de-c2062a793c67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b92e2d45-4596-4f2b-8a5c-8fd5f0084630", "tag": "b35ba8d8-fd10-45c4-89d9-1e04f3301266"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:24:55.626518 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-d90b3fcf-3ce3-46fa-9362-1791f264a1e1 req-50e8715c-a158-4fd8-a0de-c2062a793c67 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:55.627792 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-d90b3fcf-3ce3-46fa-9362-1791f264a1e1 req-50e8715c-a158-4fd8-a0de-c2062a793c67 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:55.628928 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-d90b3fcf-3ce3-46fa-9362-1791f264a1e1 req-50e8715c-a158-4fd8-a0de-c2062a793c67 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:55.663142 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-d90b3fcf-3ce3-46fa-9362-1791f264a1e1 req-50e8715c-a158-4fd8-a0de-c2062a793c67 service nova] Creating event network-changed:b35ba8d8-fd10-45c4-89d9-1e04f3301266 for instance b92e2d45-4596-4f2b-8a5c-8fd5f0084630 on n-h1-850499-9 Aug 31 16:24:55.679661 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-d90b3fcf-3ce3-46fa-9362-1791f264a1e1 req-50e8715c-a158-4fd8-a0de-c2062a793c67 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079905 Aug 31 16:24:55.680425 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2676/5384] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:24:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:24:56.010402 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0c5f8f82-3a7b-4ff6-b835-3b02c74191e0 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:56.011305 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0c5f8f82-3a7b-4ff6-b835-3b02c74191e0 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: d1c50fa6-2d8a-4707-9ee7-448ea57be62b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:56.024214 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0c5f8f82-3a7b-4ff6-b835-3b02c74191e0 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:56.024756 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0c5f8f82-3a7b-4ff6-b835-3b02c74191e0 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:56.026347 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0c5f8f82-3a7b-4ff6-b835-3b02c74191e0 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:56.027478 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0c5f8f82-3a7b-4ff6-b835-3b02c74191e0 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:56.028232 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0c5f8f82-3a7b-4ff6-b835-3b02c74191e0 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:56.029017 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0c5f8f82-3a7b-4ff6-b835-3b02c74191e0 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:56.032309 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9024c62c-08d0-44cf-904e-d170cb5b9d0e tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:56.033229 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9024c62c-08d0-44cf-904e-d170cb5b9d0e tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: b92e2d45-4596-4f2b-8a5c-8fd5f0084630] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:56.045878 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9024c62c-08d0-44cf-904e-d170cb5b9d0e tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:56.047795 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9024c62c-08d0-44cf-904e-d170cb5b9d0e tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:56.048537 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9024c62c-08d0-44cf-904e-d170cb5b9d0e tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:56.049543 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9024c62c-08d0-44cf-904e-d170cb5b9d0e tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:56.050254 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9024c62c-08d0-44cf-904e-d170cb5b9d0e tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:56.050926 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9024c62c-08d0-44cf-904e-d170cb5b9d0e tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:56.455469 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-9024c62c-08d0-44cf-904e-d170cb5b9d0e tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133363b2b12d4730994557ee24f08879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d9ba3589a24faaac930a35742ce834', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:56.459648 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9024c62c-08d0-44cf-904e-d170cb5b9d0e tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/b92e2d45-4596-4f2b-8a5c-8fd5f0084630" status: 200 len: 1365 microversion: 2.1 time: 0.435267 Aug 31 16:24:56.460463 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2677/5385] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:56 2022] GET /compute/v2.1/servers/b92e2d45-4596-4f2b-8a5c-8fd5f0084630 => generated 1365 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:24:56.465390 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0c5f8f82-3a7b-4ff6-b835-3b02c74191e0 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4744703b964435bbead751ca884d1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e014d4e4da5e47ff9a1261e7730034ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:56.475939 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0c5f8f82-3a7b-4ff6-b835-3b02c74191e0 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b" status: 200 len: 1736 microversion: 2.1 time: 0.469832 Aug 31 16:24:56.477024 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2709/5386] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:56 2022] GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b => generated 1736 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:56.533929 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4d80b910-9a4b-4675-bc6a-35e8149b80d7 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:56.534845 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4d80b910-9a4b-4675-bc6a-35e8149b80d7 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:56.541345 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4d80b910-9a4b-4675-bc6a-35e8149b80d7 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:56.542117 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4d80b910-9a4b-4675-bc6a-35e8149b80d7 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:56.542748 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4d80b910-9a4b-4675-bc6a-35e8149b80d7 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:56.543708 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4d80b910-9a4b-4675-bc6a-35e8149b80d7 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:56.544235 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4d80b910-9a4b-4675-bc6a-35e8149b80d7 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:56.544671 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4d80b910-9a4b-4675-bc6a-35e8149b80d7 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:56.898314 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-4d80b910-9a4b-4675-bc6a-35e8149b80d7 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:56.914262 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4d80b910-9a4b-4675-bc6a-35e8149b80d7 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1531 microversion: 2.1 time: 0.384849 Aug 31 16:24:56.915125 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2678/5387] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:56 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1531 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:57.491744 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-34644e13-f8fb-4745-b70e-4637757b3cc0 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:57.492729 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-34644e13-f8fb-4745-b70e-4637757b3cc0 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: b92e2d45-4596-4f2b-8a5c-8fd5f0084630] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:57.500691 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-34644e13-f8fb-4745-b70e-4637757b3cc0 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:57.501193 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-34644e13-f8fb-4745-b70e-4637757b3cc0 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:57.501637 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-34644e13-f8fb-4745-b70e-4637757b3cc0 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:57.502359 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-34644e13-f8fb-4745-b70e-4637757b3cc0 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:57.502835 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-34644e13-f8fb-4745-b70e-4637757b3cc0 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:57.503238 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-34644e13-f8fb-4745-b70e-4637757b3cc0 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:57.512651 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-272fd473-9ae7-4171-8848-86376cc01787 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:57.516641 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-272fd473-9ae7-4171-8848-86376cc01787 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: d1c50fa6-2d8a-4707-9ee7-448ea57be62b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:57.531051 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-272fd473-9ae7-4171-8848-86376cc01787 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:57.531808 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-272fd473-9ae7-4171-8848-86376cc01787 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:57.532261 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-272fd473-9ae7-4171-8848-86376cc01787 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:57.533004 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-272fd473-9ae7-4171-8848-86376cc01787 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:57.533493 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-272fd473-9ae7-4171-8848-86376cc01787 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:57.534257 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-272fd473-9ae7-4171-8848-86376cc01787 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:57.738044 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-34644e13-f8fb-4745-b70e-4637757b3cc0 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133363b2b12d4730994557ee24f08879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d9ba3589a24faaac930a35742ce834', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:57.746846 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-34644e13-f8fb-4745-b70e-4637757b3cc0 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/b92e2d45-4596-4f2b-8a5c-8fd5f0084630" status: 200 len: 1365 microversion: 2.1 time: 0.263535 Aug 31 16:24:57.747743 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2710/5388] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:57 2022] GET /compute/v2.1/servers/b92e2d45-4596-4f2b-8a5c-8fd5f0084630 => generated 1365 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:57.792930 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-272fd473-9ae7-4171-8848-86376cc01787 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4744703b964435bbead751ca884d1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e014d4e4da5e47ff9a1261e7730034ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:57.804599 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-272fd473-9ae7-4171-8848-86376cc01787 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b" status: 200 len: 1736 microversion: 2.1 time: 0.307172 Aug 31 16:24:57.805537 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2679/5389] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:57 2022] GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b => generated 1736 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:57.943901 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-252bebd9-8871-4a11-806e-fbbec3112915 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:57.946167 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-252bebd9-8871-4a11-806e-fbbec3112915 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:57.957502 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-252bebd9-8871-4a11-806e-fbbec3112915 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:57.961674 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-252bebd9-8871-4a11-806e-fbbec3112915 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:57.962917 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-252bebd9-8871-4a11-806e-fbbec3112915 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:57.964726 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-252bebd9-8871-4a11-806e-fbbec3112915 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:57.966149 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-252bebd9-8871-4a11-806e-fbbec3112915 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:57.968712 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-252bebd9-8871-4a11-806e-fbbec3112915 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:58.019533 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-10bd3995-08df-49f0-b283-6eed00ae3dd0 req-6c7f15e4-4ed9-40d2-921c-82362358f89f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22082563-385d-41a9-baa5-6fb277278505", "name": "network-vif-plugged", "status": "completed", "tag": "01a10893-04bb-4b06-9640-8c6578bca1fc"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:24:58.047338 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-10bd3995-08df-49f0-b283-6eed00ae3dd0 req-6c7f15e4-4ed9-40d2-921c-82362358f89f service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:58.048146 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-10bd3995-08df-49f0-b283-6eed00ae3dd0 req-6c7f15e4-4ed9-40d2-921c-82362358f89f service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:58.048856 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-10bd3995-08df-49f0-b283-6eed00ae3dd0 req-6c7f15e4-4ed9-40d2-921c-82362358f89f service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:58.064455 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-10bd3995-08df-49f0-b283-6eed00ae3dd0 req-6c7f15e4-4ed9-40d2-921c-82362358f89f service nova] Creating event network-vif-plugged:01a10893-04bb-4b06-9640-8c6578bca1fc for instance 22082563-385d-41a9-baa5-6fb277278505 on n-h2-850499-9 Aug 31 16:24:58.071179 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-10bd3995-08df-49f0-b283-6eed00ae3dd0 req-6c7f15e4-4ed9-40d2-921c-82362358f89f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060489 Aug 31 16:24:58.071976 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2680/5390] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:24:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:24:58.209898 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-252bebd9-8871-4a11-806e-fbbec3112915 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:58.220657 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-252bebd9-8871-4a11-806e-fbbec3112915 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1531 microversion: 2.1 time: 0.286190 Aug 31 16:24:58.227807 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2711/5391] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:57 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1531 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:24:58.770498 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-bedb6ff4-cdba-4874-8b99-0cad96c74626 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:58.771237 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-bedb6ff4-cdba-4874-8b99-0cad96c74626 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: b92e2d45-4596-4f2b-8a5c-8fd5f0084630] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:58.795865 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bedb6ff4-cdba-4874-8b99-0cad96c74626 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:58.795865 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bedb6ff4-cdba-4874-8b99-0cad96c74626 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:58.795865 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bedb6ff4-cdba-4874-8b99-0cad96c74626 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:58.795865 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bedb6ff4-cdba-4874-8b99-0cad96c74626 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:58.796839 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bedb6ff4-cdba-4874-8b99-0cad96c74626 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:58.797297 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bedb6ff4-cdba-4874-8b99-0cad96c74626 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:58.841469 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ee2f848c-8883-4e17-a4a1-4f9871bd1875 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:58.842146 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ee2f848c-8883-4e17-a4a1-4f9871bd1875 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: d1c50fa6-2d8a-4707-9ee7-448ea57be62b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:58.861659 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ee2f848c-8883-4e17-a4a1-4f9871bd1875 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:58.862161 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ee2f848c-8883-4e17-a4a1-4f9871bd1875 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:58.862616 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ee2f848c-8883-4e17-a4a1-4f9871bd1875 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:58.863355 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ee2f848c-8883-4e17-a4a1-4f9871bd1875 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:58.863861 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ee2f848c-8883-4e17-a4a1-4f9871bd1875 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:58.864307 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ee2f848c-8883-4e17-a4a1-4f9871bd1875 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:59.347491 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:24:59.383214 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=6 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:24:59.600369 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=6 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:24:59.644896 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ee2f848c-8883-4e17-a4a1-4f9871bd1875 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4744703b964435bbead751ca884d1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e014d4e4da5e47ff9a1261e7730034ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:59.663352 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ee2f848c-8883-4e17-a4a1-4f9871bd1875 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b" status: 200 len: 1736 microversion: 2.1 time: 0.827534 Aug 31 16:24:59.674912 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-bedb6ff4-cdba-4874-8b99-0cad96c74626 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133363b2b12d4730994557ee24f08879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d9ba3589a24faaac930a35742ce834', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:59.680045 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2712/5392] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:58 2022] GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b => generated 1736 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:59.698576 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9ae80b84-36de-472d-82ba-d9779f239088 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:59.700644 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9ae80b84-36de-472d-82ba-d9779f239088 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:59.703660 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-bedb6ff4-cdba-4874-8b99-0cad96c74626 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/b92e2d45-4596-4f2b-8a5c-8fd5f0084630" status: 200 len: 1365 microversion: 2.1 time: 0.937078 Aug 31 16:24:59.705030 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2681/5393] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:58 2022] GET /compute/v2.1/servers/b92e2d45-4596-4f2b-8a5c-8fd5f0084630 => generated 1365 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:59.715167 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9ae80b84-36de-472d-82ba-d9779f239088 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:59.718182 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9ae80b84-36de-472d-82ba-d9779f239088 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:59.719972 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9ae80b84-36de-472d-82ba-d9779f239088 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:59.721887 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9ae80b84-36de-472d-82ba-d9779f239088 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:59.723201 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9ae80b84-36de-472d-82ba-d9779f239088 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:59.724062 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9ae80b84-36de-472d-82ba-d9779f239088 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:00.239361 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9ae80b84-36de-472d-82ba-d9779f239088 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:00.245484 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=100 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:25:00.258654 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9ae80b84-36de-472d-82ba-d9779f239088 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1531 microversion: 2.1 time: 0.575839 Aug 31 16:25:00.263470 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2713/5394] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:59 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1531 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:00.700131 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-61e338fd-940e-41c6-979e-7a7a976df95c tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:00.701104 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-61e338fd-940e-41c6-979e-7a7a976df95c tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: d1c50fa6-2d8a-4707-9ee7-448ea57be62b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:00.717996 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-61e338fd-940e-41c6-979e-7a7a976df95c tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:00.720184 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-61e338fd-940e-41c6-979e-7a7a976df95c tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:00.720965 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-61e338fd-940e-41c6-979e-7a7a976df95c tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:00.722348 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-61e338fd-940e-41c6-979e-7a7a976df95c tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:00.723993 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-61e338fd-940e-41c6-979e-7a7a976df95c tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:00.724766 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-61e338fd-940e-41c6-979e-7a7a976df95c tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:00.731121 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1262385c-031b-44aa-9438-10871a1d2a95 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:00.732245 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1262385c-031b-44aa-9438-10871a1d2a95 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: b92e2d45-4596-4f2b-8a5c-8fd5f0084630] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:00.751247 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1262385c-031b-44aa-9438-10871a1d2a95 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:00.756596 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1262385c-031b-44aa-9438-10871a1d2a95 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:00.757464 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1262385c-031b-44aa-9438-10871a1d2a95 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:00.758458 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1262385c-031b-44aa-9438-10871a1d2a95 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:00.760102 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1262385c-031b-44aa-9438-10871a1d2a95 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:00.760326 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=100 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:25:00.761479 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1262385c-031b-44aa-9438-10871a1d2a95 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:01.035473 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-1262385c-031b-44aa-9438-10871a1d2a95 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133363b2b12d4730994557ee24f08879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d9ba3589a24faaac930a35742ce834', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:01.057398 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-61e338fd-940e-41c6-979e-7a7a976df95c tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4744703b964435bbead751ca884d1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e014d4e4da5e47ff9a1261e7730034ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:01.074888 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-61e338fd-940e-41c6-979e-7a7a976df95c tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b" status: 200 len: 1716 microversion: 2.1 time: 0.383492 Aug 31 16:25:01.075603 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2682/5395] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:00 2022] GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b => generated 1716 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:01.077866 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1262385c-031b-44aa-9438-10871a1d2a95 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/b92e2d45-4596-4f2b-8a5c-8fd5f0084630" status: 200 len: 1365 microversion: 2.1 time: 0.353737 Aug 31 16:25:01.093119 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2714/5396] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:00 2022] GET /compute/v2.1/servers/b92e2d45-4596-4f2b-8a5c-8fd5f0084630 => generated 1365 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:25:01.272270 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-daa91cf8-d5f0-4aad-8d3a-f61cd188da3d tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:01.272886 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-daa91cf8-d5f0-4aad-8d3a-f61cd188da3d tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: d1c50fa6-2d8a-4707-9ee7-448ea57be62b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:01.281471 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-daa91cf8-d5f0-4aad-8d3a-f61cd188da3d tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:01.281993 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-daa91cf8-d5f0-4aad-8d3a-f61cd188da3d tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:01.282445 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-daa91cf8-d5f0-4aad-8d3a-f61cd188da3d tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:01.288720 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5c2fea30-5561-412e-9487-03d7d8c32210 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:01.289341 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5c2fea30-5561-412e-9487-03d7d8c32210 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:01.294576 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-daa91cf8-d5f0-4aad-8d3a-f61cd188da3d tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:01.296444 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-daa91cf8-d5f0-4aad-8d3a-f61cd188da3d tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:01.298386 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5c2fea30-5561-412e-9487-03d7d8c32210 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:01.299341 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-daa91cf8-d5f0-4aad-8d3a-f61cd188da3d tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:01.300200 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5c2fea30-5561-412e-9487-03d7d8c32210 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:01.303224 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5c2fea30-5561-412e-9487-03d7d8c32210 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:01.304442 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5c2fea30-5561-412e-9487-03d7d8c32210 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:01.304990 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5c2fea30-5561-412e-9487-03d7d8c32210 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:01.307812 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5c2fea30-5561-412e-9487-03d7d8c32210 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:01.508763 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-daa91cf8-d5f0-4aad-8d3a-f61cd188da3d tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] HTTP exception thrown: Cannot 'detach_volume' instance d1c50fa6-2d8a-4707-9ee7-448ea57be62b while it is in vm_state rescued Aug 31 16:25:01.513558 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-daa91cf8-d5f0-4aad-8d3a-f61cd188da3d tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Request method failure captured: Aug 31 16:25:01.513558 n-d-850499-9 devstack@n-api.service[122256]: request: DELETE /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b/os-volume_attachments/f775e3fd-3bb1-468f-8a57-c9c7fea1f913 HTTP/1.1 Aug 31 16:25:01.513558 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:25:01.513558 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:25:01.513558 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:25:01.513558 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:25:01.513558 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:25:01.513558 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:25:01.513558 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:25:01.513558 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:25:01.513558 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4oy7qo0hac0I9IpX9ONeLQn5FXZxTJLjhjMB-WYHPcUUf61xQVdU4TOXEJINvaGC5c5Wjhk9pb4p_bnOvsu8HLsM1WUDttS1HJeEirzVfdDQ2PqvMBOo0UbRSxhckjuHlfQOCH8lv8yi1i-W11nad5j2vdw9RWWfX0Cd51S12MLuko Aug 31 16:25:01.513558 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:25:01.513558 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:25:01.513558 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:25:01.513558 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:25:01.513558 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:25:01.513558 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:25:01.513558 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: e014d4e4da5e47ff9a1261e7730034ac Aug 31 16:25:01.513558 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1963116327 Aug 31 16:25:01.513558 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:25:01.513558 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:25:01.513558 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e014d4e4da5e47ff9a1261e7730034ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/e014d4e4da5e47ff9a1261e7730034ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_e014d4e4da5e47ff9a1261e7730034ac", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e014d4e4da5e47ff9a1261e7730034ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:25:01.513558 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1963116327 Aug 31 16:25:01.513558 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: e014d4e4da5e47ff9a1261e7730034ac Aug 31 16:25:01.513558 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1963116327 Aug 31 16:25:01.513558 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ServerRescueNegativeTestJSON-1963116327-project Aug 31 16:25:01.513558 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:25:01.513558 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:25:01.513558 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: e4744703b964435bbead751ca884d1ae Aug 31 16:25:01.513558 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1963116327-project Aug 31 16:25:01.513558 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:25:01.513558 n-d-850499-9 devstack@n-api.service[122256]: exception: Cannot 'detach_volume' instance d1c50fa6-2d8a-4707-9ee7-448ea57be62b while it is in vm_state rescued Aug 31 16:25:01.513558 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'server_id': 'd1c50fa6-2d8a-4707-9ee7-448ea57be62b', 'id': 'f775e3fd-3bb1-468f-8a57-c9c7fea1f913'} Aug 31 16:25:01.513558 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:25:01.513558 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:25:01.513558 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 31 16:25:01.513558 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 31 16:25:01.513558 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 16:25:01.513558 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 16:25:01.513558 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 31 16:25:01.513558 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 31 16:25:01.513558 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d1c50fa6-2d8a-4707-9ee7-448ea57be62b in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 31 16:25:01.513558 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:25:01.513558 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:25:01.513558 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:25:01.513558 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:25:01.513558 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:25:01.513558 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:25:01.513558 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:25:01.513558 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:25:01.513558 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:25:01.513558 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:25:01.513558 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 31 16:25:01.513558 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 31 16:25:01.513558 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 31 16:25:01.513558 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 31 16:25:01.513558 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance d1c50fa6-2d8a-4707-9ee7-448ea57be62b while it is in vm_state rescued Aug 31 16:25:01.513558 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:25:01.513558 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:25:01.513558 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:25:01.513558 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:25:01.520767 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:25:01.520767 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:25:01.520767 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:25:01.520767 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:25:01.520767 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance d1c50fa6-2d8a-4707-9ee7-448ea57be62b while it is in vm_state rescued Aug 31 16:25:01.520767 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:25:01.520767 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-daa91cf8-d5f0-4aad-8d3a-f61cd188da3d tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Returning 409 to user: Cannot 'detach_volume' instance d1c50fa6-2d8a-4707-9ee7-448ea57be62b while it is in vm_state rescued {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:25:01.520767 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-daa91cf8-d5f0-4aad-8d3a-f61cd188da3d tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "DELETE /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b/os-volume_attachments/f775e3fd-3bb1-468f-8a57-c9c7fea1f913" status: 409 len: 152 microversion: 2.1 time: 0.248397 Aug 31 16:25:01.532200 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2683/5397] 10.222.0.61 () {58 vars in 1416 bytes} [Wed Aug 31 16:25:01 2022] DELETE /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b/os-volume_attachments/f775e3fd-3bb1-468f-8a57-c9c7fea1f913 => generated 152 bytes in 265 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 31 16:25:01.549948 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a72fe09d-817c-40e7-badc-5c5b2730f314 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:25:01.550509 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a72fe09d-817c-40e7-badc-5c5b2730f314 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: d1c50fa6-2d8a-4707-9ee7-448ea57be62b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:01.582833 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a72fe09d-817c-40e7-badc-5c5b2730f314 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:01.589590 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a72fe09d-817c-40e7-badc-5c5b2730f314 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:01.592774 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a72fe09d-817c-40e7-badc-5c5b2730f314 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:01.595372 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a72fe09d-817c-40e7-badc-5c5b2730f314 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:01.602347 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a72fe09d-817c-40e7-badc-5c5b2730f314 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:01.603726 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a72fe09d-817c-40e7-badc-5c5b2730f314 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:01.695455 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5c2fea30-5561-412e-9487-03d7d8c32210 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:01.710181 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5c2fea30-5561-412e-9487-03d7d8c32210 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1531 microversion: 2.1 time: 0.425646 Aug 31 16:25:01.711085 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2715/5398] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:01 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1531 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:25:01.820654 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a72fe09d-817c-40e7-badc-5c5b2730f314 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "POST /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b/action" status: 202 len: 0 microversion: 2.1 time: 0.281811 Aug 31 16:25:01.822686 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2684/5399] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:25:01 2022] POST /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b/action => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:25:01.837062 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6699c793-3329-4934-8270-c681471b09ff tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:01.837690 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6699c793-3329-4934-8270-c681471b09ff tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: d1c50fa6-2d8a-4707-9ee7-448ea57be62b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:01.864229 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6699c793-3329-4934-8270-c681471b09ff tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:01.867466 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6699c793-3329-4934-8270-c681471b09ff tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:01.870316 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6699c793-3329-4934-8270-c681471b09ff tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:01.875549 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6699c793-3329-4934-8270-c681471b09ff tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:01.877421 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6699c793-3329-4934-8270-c681471b09ff tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:01.878797 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6699c793-3329-4934-8270-c681471b09ff tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:02.118071 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d2ca2d56-b7d9-429a-8fb1-585e32aab3fd tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:02.118781 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d2ca2d56-b7d9-429a-8fb1-585e32aab3fd tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: b92e2d45-4596-4f2b-8a5c-8fd5f0084630] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:02.131797 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d2ca2d56-b7d9-429a-8fb1-585e32aab3fd tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:02.132591 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d2ca2d56-b7d9-429a-8fb1-585e32aab3fd tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:02.133299 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d2ca2d56-b7d9-429a-8fb1-585e32aab3fd tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:02.134191 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d2ca2d56-b7d9-429a-8fb1-585e32aab3fd tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:02.134820 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d2ca2d56-b7d9-429a-8fb1-585e32aab3fd tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:02.135430 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d2ca2d56-b7d9-429a-8fb1-585e32aab3fd tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:02.381044 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-6699c793-3329-4934-8270-c681471b09ff tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4744703b964435bbead751ca884d1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e014d4e4da5e47ff9a1261e7730034ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:02.400543 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6699c793-3329-4934-8270-c681471b09ff tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b" status: 200 len: 1724 microversion: 2.1 time: 0.568736 Aug 31 16:25:02.415580 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2716/5400] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:01 2022] GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b => generated 1724 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:02.598055 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d2ca2d56-b7d9-429a-8fb1-585e32aab3fd tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133363b2b12d4730994557ee24f08879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d9ba3589a24faaac930a35742ce834', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:02.618463 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d2ca2d56-b7d9-429a-8fb1-585e32aab3fd tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/b92e2d45-4596-4f2b-8a5c-8fd5f0084630" status: 200 len: 1365 microversion: 2.1 time: 0.504891 Aug 31 16:25:02.623133 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2685/5401] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:02 2022] GET /compute/v2.1/servers/b92e2d45-4596-4f2b-8a5c-8fd5f0084630 => generated 1365 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:02.742442 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2be03f3e-355f-45c8-8ce9-d24bc8ef2dfb tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:02.743344 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2be03f3e-355f-45c8-8ce9-d24bc8ef2dfb tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:02.750981 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2be03f3e-355f-45c8-8ce9-d24bc8ef2dfb tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:02.751615 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2be03f3e-355f-45c8-8ce9-d24bc8ef2dfb tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:02.752133 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2be03f3e-355f-45c8-8ce9-d24bc8ef2dfb tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:02.752931 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2be03f3e-355f-45c8-8ce9-d24bc8ef2dfb tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:02.753489 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2be03f3e-355f-45c8-8ce9-d24bc8ef2dfb tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:02.754026 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2be03f3e-355f-45c8-8ce9-d24bc8ef2dfb tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:03.069830 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2be03f3e-355f-45c8-8ce9-d24bc8ef2dfb tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:03.088120 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2be03f3e-355f-45c8-8ce9-d24bc8ef2dfb tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1531 microversion: 2.1 time: 0.348057 Aug 31 16:25:03.104403 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2717/5402] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:02 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1531 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:03.423021 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-463e2dc3-1b6c-4707-ae48-268cc3467022 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:03.424550 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-463e2dc3-1b6c-4707-ae48-268cc3467022 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: d1c50fa6-2d8a-4707-9ee7-448ea57be62b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:03.433589 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-463e2dc3-1b6c-4707-ae48-268cc3467022 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:03.436068 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-463e2dc3-1b6c-4707-ae48-268cc3467022 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:03.438589 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-463e2dc3-1b6c-4707-ae48-268cc3467022 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:03.439694 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-463e2dc3-1b6c-4707-ae48-268cc3467022 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:03.442721 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-463e2dc3-1b6c-4707-ae48-268cc3467022 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:03.445396 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-463e2dc3-1b6c-4707-ae48-268cc3467022 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:03.660890 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-feef4242-0ffc-4705-861c-dcdea9ff8b62 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:03.661681 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-feef4242-0ffc-4705-861c-dcdea9ff8b62 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:03.676156 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-feef4242-0ffc-4705-861c-dcdea9ff8b62 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:03.677814 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-feef4242-0ffc-4705-861c-dcdea9ff8b62 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:03.678280 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-feef4242-0ffc-4705-861c-dcdea9ff8b62 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:03.679024 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-feef4242-0ffc-4705-861c-dcdea9ff8b62 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:03.679523 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-feef4242-0ffc-4705-861c-dcdea9ff8b62 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:03.679965 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-feef4242-0ffc-4705-861c-dcdea9ff8b62 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:04.164310 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-feef4242-0ffc-4705-861c-dcdea9ff8b62 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:04.185117 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-feef4242-0ffc-4705-861c-dcdea9ff8b62 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1668 microversion: 2.1 time: 1.015175 Aug 31 16:25:04.202078 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2686/5403] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:03 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1668 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:04.205637 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9c5e140c-b76c-49e5-9969-23ea529046bd tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:04.206677 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9c5e140c-b76c-49e5-9969-23ea529046bd tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: b92e2d45-4596-4f2b-8a5c-8fd5f0084630] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:04.240341 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9c5e140c-b76c-49e5-9969-23ea529046bd tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:04.246708 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9c5e140c-b76c-49e5-9969-23ea529046bd tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:04.246936 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9c5e140c-b76c-49e5-9969-23ea529046bd tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:04.253323 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9c5e140c-b76c-49e5-9969-23ea529046bd tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:04.269332 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9c5e140c-b76c-49e5-9969-23ea529046bd tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:04.273790 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9c5e140c-b76c-49e5-9969-23ea529046bd tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:04.314707 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-463e2dc3-1b6c-4707-ae48-268cc3467022 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4744703b964435bbead751ca884d1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e014d4e4da5e47ff9a1261e7730034ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:04.329805 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-463e2dc3-1b6c-4707-ae48-268cc3467022 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b" status: 200 len: 1724 microversion: 2.1 time: 0.911238 Aug 31 16:25:04.331718 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2718/5404] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:03 2022] GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b => generated 1724 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:25:04.346058 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-0977f66c-6f63-42b9-b537-ac74aff52983 req-f17bcd0b-9733-4efd-8cfc-fc60af81dfb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b92e2d45-4596-4f2b-8a5c-8fd5f0084630", "name": "network-vif-plugged", "status": "completed", "tag": "b35ba8d8-fd10-45c4-89d9-1e04f3301266"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:25:04.373661 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-0977f66c-6f63-42b9-b537-ac74aff52983 req-f17bcd0b-9733-4efd-8cfc-fc60af81dfb9 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:04.374447 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-0977f66c-6f63-42b9-b537-ac74aff52983 req-f17bcd0b-9733-4efd-8cfc-fc60af81dfb9 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:04.375040 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-0977f66c-6f63-42b9-b537-ac74aff52983 req-f17bcd0b-9733-4efd-8cfc-fc60af81dfb9 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:04.406700 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-0977f66c-6f63-42b9-b537-ac74aff52983 req-f17bcd0b-9733-4efd-8cfc-fc60af81dfb9 service nova] Creating event network-vif-plugged:b35ba8d8-fd10-45c4-89d9-1e04f3301266 for instance b92e2d45-4596-4f2b-8a5c-8fd5f0084630 on n-h1-850499-9 Aug 31 16:25:04.413658 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-0977f66c-6f63-42b9-b537-ac74aff52983 req-f17bcd0b-9733-4efd-8cfc-fc60af81dfb9 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080415 Aug 31 16:25:04.415139 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2719/5405] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:25:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:25:04.425689 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5f51641a-a14f-4f1b-a7c3-90231c53d051 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:04.427055 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5f51641a-a14f-4f1b-a7c3-90231c53d051 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:04.436106 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5f51641a-a14f-4f1b-a7c3-90231c53d051 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:04.437279 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5f51641a-a14f-4f1b-a7c3-90231c53d051 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:04.438570 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5f51641a-a14f-4f1b-a7c3-90231c53d051 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:04.440134 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5f51641a-a14f-4f1b-a7c3-90231c53d051 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:04.440887 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5f51641a-a14f-4f1b-a7c3-90231c53d051 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:04.441521 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5f51641a-a14f-4f1b-a7c3-90231c53d051 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:04.804037 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-9c5e140c-b76c-49e5-9969-23ea529046bd tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133363b2b12d4730994557ee24f08879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d9ba3589a24faaac930a35742ce834', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:04.818438 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9c5e140c-b76c-49e5-9969-23ea529046bd tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/b92e2d45-4596-4f2b-8a5c-8fd5f0084630" status: 200 len: 1365 microversion: 2.1 time: 0.623308 Aug 31 16:25:04.820293 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2687/5406] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:04 2022] GET /compute/v2.1/servers/b92e2d45-4596-4f2b-8a5c-8fd5f0084630 => generated 1365 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:04.839808 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9c4e7bd6-04f0-4bf4-8e5c-3441256b8f78 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:04.840762 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9c4e7bd6-04f0-4bf4-8e5c-3441256b8f78 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:04.856552 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9c4e7bd6-04f0-4bf4-8e5c-3441256b8f78 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:04.857760 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9c4e7bd6-04f0-4bf4-8e5c-3441256b8f78 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:04.859036 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9c4e7bd6-04f0-4bf4-8e5c-3441256b8f78 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:04.860244 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9c4e7bd6-04f0-4bf4-8e5c-3441256b8f78 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:04.862091 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9c4e7bd6-04f0-4bf4-8e5c-3441256b8f78 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:04.862953 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9c4e7bd6-04f0-4bf4-8e5c-3441256b8f78 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:04.944482 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5f51641a-a14f-4f1b-a7c3-90231c53d051 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:04.965358 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5f51641a-a14f-4f1b-a7c3-90231c53d051 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1526 microversion: 2.1 time: 0.547123 Aug 31 16:25:04.972709 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2720/5407] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:04 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1526 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:05.157562 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-9c4e7bd6-04f0-4bf4-8e5c-3441256b8f78 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:05.182211 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9c4e7bd6-04f0-4bf4-8e5c-3441256b8f78 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1668 microversion: 2.1 time: 0.354877 Aug 31 16:25:05.184014 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2688/5408] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:04 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1668 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:05.213127 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-65f7b9b7-abba-47b8-82f5-e7de580d9588 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:05.213848 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-65f7b9b7-abba-47b8-82f5-e7de580d9588 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:05.221126 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-65f7b9b7-abba-47b8-82f5-e7de580d9588 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:05.221731 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-65f7b9b7-abba-47b8-82f5-e7de580d9588 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:05.222249 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-65f7b9b7-abba-47b8-82f5-e7de580d9588 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:05.223050 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-65f7b9b7-abba-47b8-82f5-e7de580d9588 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:05.223612 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-65f7b9b7-abba-47b8-82f5-e7de580d9588 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:05.224326 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-65f7b9b7-abba-47b8-82f5-e7de580d9588 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:05.366255 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-14f9f63d-8b26-4216-9d43-a2dc921a5888 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:05.371958 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-14f9f63d-8b26-4216-9d43-a2dc921a5888 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: d1c50fa6-2d8a-4707-9ee7-448ea57be62b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:05.383009 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-14f9f63d-8b26-4216-9d43-a2dc921a5888 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:05.383631 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-14f9f63d-8b26-4216-9d43-a2dc921a5888 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:05.384150 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-14f9f63d-8b26-4216-9d43-a2dc921a5888 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:05.385120 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-14f9f63d-8b26-4216-9d43-a2dc921a5888 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:05.385942 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-14f9f63d-8b26-4216-9d43-a2dc921a5888 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:05.386618 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-14f9f63d-8b26-4216-9d43-a2dc921a5888 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:05.426313 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-65f7b9b7-abba-47b8-82f5-e7de580d9588 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:05.438222 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-65f7b9b7-abba-47b8-82f5-e7de580d9588 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1668 microversion: 2.1 time: 0.229519 Aug 31 16:25:05.455366 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2721/5409] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:05 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1668 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:05.469992 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-982c9d98-bf7f-470e-8392-3fe06a88a5b2 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:05.470636 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-982c9d98-bf7f-470e-8392-3fe06a88a5b2 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:05.477190 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-982c9d98-bf7f-470e-8392-3fe06a88a5b2 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:05.478515 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-982c9d98-bf7f-470e-8392-3fe06a88a5b2 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:05.478515 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-982c9d98-bf7f-470e-8392-3fe06a88a5b2 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:05.479028 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-982c9d98-bf7f-470e-8392-3fe06a88a5b2 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:05.479559 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-982c9d98-bf7f-470e-8392-3fe06a88a5b2 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:05.480008 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-982c9d98-bf7f-470e-8392-3fe06a88a5b2 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:05.661831 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-14f9f63d-8b26-4216-9d43-a2dc921a5888 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4744703b964435bbead751ca884d1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e014d4e4da5e47ff9a1261e7730034ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:05.678651 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-14f9f63d-8b26-4216-9d43-a2dc921a5888 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b" status: 200 len: 1724 microversion: 2.1 time: 0.315732 Aug 31 16:25:05.695941 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2689/5410] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:05 2022] GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b => generated 1724 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:25:05.711473 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-982c9d98-bf7f-470e-8392-3fe06a88a5b2 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:05.725434 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-982c9d98-bf7f-470e-8392-3fe06a88a5b2 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1668 microversion: 2.1 time: 0.266951 Aug 31 16:25:05.726941 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2722/5411] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:05 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1668 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:05.862840 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-98a89ab4-065c-4a8b-a8e8-ef6b1d8b2a7e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-32381620", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "networks": [{"uuid": "41cc840d-a352-47ac-85b3-b767061353cc"}]}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:25:05.865180 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5e48d14f-ed07-4c89-b76b-e64121b87478 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:05.866015 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5e48d14f-ed07-4c89-b76b-e64121b87478 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: b92e2d45-4596-4f2b-8a5c-8fd5f0084630] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:05.872618 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5e48d14f-ed07-4c89-b76b-e64121b87478 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:05.873545 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5e48d14f-ed07-4c89-b76b-e64121b87478 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:05.874320 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5e48d14f-ed07-4c89-b76b-e64121b87478 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:05.875383 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5e48d14f-ed07-4c89-b76b-e64121b87478 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:05.876333 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5e48d14f-ed07-4c89-b76b-e64121b87478 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:05.876999 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5e48d14f-ed07-4c89-b76b-e64121b87478 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:05.971214 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-98a89ab4-065c-4a8b-a8e8-ef6b1d8b2a7e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] validate_networks() for [('41cc840d-a352-47ac-85b3-b767061353cc', None, None, None, None, None)] {{(pid=122257) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:25:06.227334 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5e48d14f-ed07-4c89-b76b-e64121b87478 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133363b2b12d4730994557ee24f08879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d9ba3589a24faaac930a35742ce834', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:06.241191 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5e48d14f-ed07-4c89-b76b-e64121b87478 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/b92e2d45-4596-4f2b-8a5c-8fd5f0084630" status: 200 len: 1365 microversion: 2.1 time: 0.387675 Aug 31 16:25:06.243870 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2690/5412] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:05 2022] GET /compute/v2.1/servers/b92e2d45-4596-4f2b-8a5c-8fd5f0084630 => generated 1365 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:06.259063 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1a83780a-5b67-48c2-99e1-0ecf9548b0ca tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:06.274279 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1a83780a-5b67-48c2-99e1-0ecf9548b0ca tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:06.290269 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1a83780a-5b67-48c2-99e1-0ecf9548b0ca tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:06.291340 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1a83780a-5b67-48c2-99e1-0ecf9548b0ca tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:06.297622 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1a83780a-5b67-48c2-99e1-0ecf9548b0ca tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:06.298856 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1a83780a-5b67-48c2-99e1-0ecf9548b0ca tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:06.299592 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1a83780a-5b67-48c2-99e1-0ecf9548b0ca tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:06.300229 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1a83780a-5b67-48c2-99e1-0ecf9548b0ca tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:06.818822 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1a83780a-5b67-48c2-99e1-0ecf9548b0ca tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:06.834349 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1a83780a-5b67-48c2-99e1-0ecf9548b0ca tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1526 microversion: 2.1 time: 0.589071 Aug 31 16:25:06.836872 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2691/5413] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:06 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1526 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:06.865978 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c6c2e888-68d1-41c7-a8f4-169cabb1840b tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:06.867254 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c6c2e888-68d1-41c7-a8f4-169cabb1840b tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: d1c50fa6-2d8a-4707-9ee7-448ea57be62b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:06.874692 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c6c2e888-68d1-41c7-a8f4-169cabb1840b tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:06.883529 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c6c2e888-68d1-41c7-a8f4-169cabb1840b tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:06.884266 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c6c2e888-68d1-41c7-a8f4-169cabb1840b tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:06.885275 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c6c2e888-68d1-41c7-a8f4-169cabb1840b tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:06.885951 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c6c2e888-68d1-41c7-a8f4-169cabb1840b tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:06.887261 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c6c2e888-68d1-41c7-a8f4-169cabb1840b tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:07.290833 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-98a89ab4-065c-4a8b-a8e8-ef6b1d8b2a7e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:25:07.291974 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-98a89ab4-065c-4a8b-a8e8-ef6b1d8b2a7e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:25:07.293102 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-98a89ab4-065c-4a8b-a8e8-ef6b1d8b2a7e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:25:07.293885 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-98a89ab4-065c-4a8b-a8e8-ef6b1d8b2a7e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:25:07.294791 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-98a89ab4-065c-4a8b-a8e8-ef6b1d8b2a7e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:25:07.316946 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-98a89ab4-065c-4a8b-a8e8-ef6b1d8b2a7e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:07.318901 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-98a89ab4-065c-4a8b-a8e8-ef6b1d8b2a7e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:07.319674 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-98a89ab4-065c-4a8b-a8e8-ef6b1d8b2a7e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:07.322921 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-98a89ab4-065c-4a8b-a8e8-ef6b1d8b2a7e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:07.325724 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-98a89ab4-065c-4a8b-a8e8-ef6b1d8b2a7e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:07.327024 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-98a89ab4-065c-4a8b-a8e8-ef6b1d8b2a7e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:07.376867 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c6c2e888-68d1-41c7-a8f4-169cabb1840b tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4744703b964435bbead751ca884d1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e014d4e4da5e47ff9a1261e7730034ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:07.406702 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-98a89ab4-065c-4a8b-a8e8-ef6b1d8b2a7e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Getting quotas for project f8fa87d9431f4253b8425593a2150359. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:25:07.413906 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c6c2e888-68d1-41c7-a8f4-169cabb1840b tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b" status: 200 len: 1724 microversion: 2.1 time: 0.572595 Aug 31 16:25:07.417382 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2692/5414] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:06 2022] GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b => generated 1724 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:07.429428 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d5313f07-8697-4644-aacf-a25cd2ee3f69 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:07.433894 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d5313f07-8697-4644-aacf-a25cd2ee3f69 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: b92e2d45-4596-4f2b-8a5c-8fd5f0084630] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:07.451410 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d5313f07-8697-4644-aacf-a25cd2ee3f69 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:07.453888 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-98a89ab4-065c-4a8b-a8e8-ef6b1d8b2a7e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Getting quotas for user a105ab564f304fa7a2ceba07418a22bc and project f8fa87d9431f4253b8425593a2150359. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:25:07.462553 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d5313f07-8697-4644-aacf-a25cd2ee3f69 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:07.463339 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d5313f07-8697-4644-aacf-a25cd2ee3f69 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:07.464432 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d5313f07-8697-4644-aacf-a25cd2ee3f69 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:07.468513 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d5313f07-8697-4644-aacf-a25cd2ee3f69 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:07.471748 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d5313f07-8697-4644-aacf-a25cd2ee3f69 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:07.534410 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-98a89ab4-065c-4a8b-a8e8-ef6b1d8b2a7e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Going to run 1 instances... {{(pid=122257) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:25:07.544253 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-98a89ab4-065c-4a8b-a8e8-ef6b1d8b2a7e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 90d3311f-d4dc-4100-924a-963372dfcc88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:25:07.616694 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-98a89ab4-065c-4a8b-a8e8-ef6b1d8b2a7e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.759029 Aug 31 16:25:07.618155 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2723/5415] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:25:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1761 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:25:07.640422 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-02963cd0-3da2-4179-ae73-66bead6f49a9 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:07.643820 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-02963cd0-3da2-4179-ae73-66bead6f49a9 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 90d3311f-d4dc-4100-924a-963372dfcc88] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:07.852129 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-02963cd0-3da2-4179-ae73-66bead6f49a9 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:07.863876 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-02963cd0-3da2-4179-ae73-66bead6f49a9 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/90d3311f-d4dc-4100-924a-963372dfcc88" status: 200 len: 1213 microversion: 2.1 time: 0.237803 Aug 31 16:25:07.867106 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2724/5416] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:07 2022] GET /compute/v2.1/servers/90d3311f-d4dc-4100-924a-963372dfcc88 => generated 1213 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:07.876473 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-12fcf32e-c1cd-460a-a185-d8287703cf44 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:07.877294 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-12fcf32e-c1cd-460a-a185-d8287703cf44 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:07.887661 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-12fcf32e-c1cd-460a-a185-d8287703cf44 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:07.888405 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-12fcf32e-c1cd-460a-a185-d8287703cf44 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:07.889167 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-12fcf32e-c1cd-460a-a185-d8287703cf44 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:07.890108 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-12fcf32e-c1cd-460a-a185-d8287703cf44 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:07.890751 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-12fcf32e-c1cd-460a-a185-d8287703cf44 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:07.891664 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-12fcf32e-c1cd-460a-a185-d8287703cf44 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:08.192371 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d5313f07-8697-4644-aacf-a25cd2ee3f69 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133363b2b12d4730994557ee24f08879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d9ba3589a24faaac930a35742ce834', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:08.211789 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d5313f07-8697-4644-aacf-a25cd2ee3f69 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/b92e2d45-4596-4f2b-8a5c-8fd5f0084630" status: 200 len: 1556 microversion: 2.1 time: 0.787183 Aug 31 16:25:08.215614 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2693/5417] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:07 2022] GET /compute/v2.1/servers/b92e2d45-4596-4f2b-8a5c-8fd5f0084630 => generated 1556 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:08.254719 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-68b45f1e-0105-4839-8d6c-a1e0e7a54dff tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:08.255534 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-68b45f1e-0105-4839-8d6c-a1e0e7a54dff tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: b92e2d45-4596-4f2b-8a5c-8fd5f0084630] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:08.280366 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-68b45f1e-0105-4839-8d6c-a1e0e7a54dff tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:08.283728 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-68b45f1e-0105-4839-8d6c-a1e0e7a54dff tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:08.286040 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-68b45f1e-0105-4839-8d6c-a1e0e7a54dff tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:08.290686 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-68b45f1e-0105-4839-8d6c-a1e0e7a54dff tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:08.292048 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-68b45f1e-0105-4839-8d6c-a1e0e7a54dff tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:08.293864 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-68b45f1e-0105-4839-8d6c-a1e0e7a54dff tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:08.721804 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-12fcf32e-c1cd-460a-a185-d8287703cf44 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:08.748944 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-12fcf32e-c1cd-460a-a185-d8287703cf44 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1526 microversion: 2.1 time: 0.877447 Aug 31 16:25:08.753134 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2725/5418] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:07 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1526 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:08.773071 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d80a48a3-c7f0-4e49-8592-f458584ac508 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:08.774737 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d80a48a3-c7f0-4e49-8592-f458584ac508 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: d1c50fa6-2d8a-4707-9ee7-448ea57be62b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:08.777497 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-68b45f1e-0105-4839-8d6c-a1e0e7a54dff tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/b92e2d45-4596-4f2b-8a5c-8fd5f0084630/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.532812 Aug 31 16:25:08.778920 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2694/5419] 10.222.0.61 () {58 vars in 1275 bytes} [Wed Aug 31 16:25:08 2022] GET /compute/v2.1/servers/b92e2d45-4596-4f2b-8a5c-8fd5f0084630/os-interface => generated 285 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:25:08.808314 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d80a48a3-c7f0-4e49-8592-f458584ac508 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:08.809843 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d80a48a3-c7f0-4e49-8592-f458584ac508 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:08.811162 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d80a48a3-c7f0-4e49-8592-f458584ac508 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:08.814465 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d80a48a3-c7f0-4e49-8592-f458584ac508 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:08.816170 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d80a48a3-c7f0-4e49-8592-f458584ac508 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:08.817863 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d80a48a3-c7f0-4e49-8592-f458584ac508 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:08.903924 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a739b2a8-9ba0-4c4d-9548-a30a83ca4a56 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:08.904610 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a739b2a8-9ba0-4c4d-9548-a30a83ca4a56 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 90d3311f-d4dc-4100-924a-963372dfcc88] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:08.925665 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a739b2a8-9ba0-4c4d-9548-a30a83ca4a56 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:08.927332 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a739b2a8-9ba0-4c4d-9548-a30a83ca4a56 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:08.928341 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a739b2a8-9ba0-4c4d-9548-a30a83ca4a56 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:08.931263 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a739b2a8-9ba0-4c4d-9548-a30a83ca4a56 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:08.934635 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a739b2a8-9ba0-4c4d-9548-a30a83ca4a56 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:08.937812 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a739b2a8-9ba0-4c4d-9548-a30a83ca4a56 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:09.147782 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a739b2a8-9ba0-4c4d-9548-a30a83ca4a56 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:09.170771 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a739b2a8-9ba0-4c4d-9548-a30a83ca4a56 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/90d3311f-d4dc-4100-924a-963372dfcc88" status: 200 len: 1217 microversion: 2.1 time: 0.270688 Aug 31 16:25:09.172241 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2695/5420] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:08 2022] GET /compute/v2.1/servers/90d3311f-d4dc-4100-924a-963372dfcc88 => generated 1217 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:25:09.783970 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-fa530542-93cd-43ae-9585-d8f4561dc35d tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:09.785324 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-fa530542-93cd-43ae-9585-d8f4561dc35d tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:09.805677 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fa530542-93cd-43ae-9585-d8f4561dc35d tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:09.806702 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fa530542-93cd-43ae-9585-d8f4561dc35d tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:09.808592 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fa530542-93cd-43ae-9585-d8f4561dc35d tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:09.809539 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fa530542-93cd-43ae-9585-d8f4561dc35d tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:09.810364 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fa530542-93cd-43ae-9585-d8f4561dc35d tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:09.815975 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fa530542-93cd-43ae-9585-d8f4561dc35d tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:09.852959 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d80a48a3-c7f0-4e49-8592-f458584ac508 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4744703b964435bbead751ca884d1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e014d4e4da5e47ff9a1261e7730034ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:09.884870 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d80a48a3-c7f0-4e49-8592-f458584ac508 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b" status: 200 len: 1730 microversion: 2.1 time: 1.118178 Aug 31 16:25:09.888065 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2726/5421] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:08 2022] GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b => generated 1730 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:09.914092 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4f084e15-065e-4ff5-b839-8b33b09549fa tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:09.915316 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4f084e15-065e-4ff5-b839-8b33b09549fa tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: d1c50fa6-2d8a-4707-9ee7-448ea57be62b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:09.945714 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4f084e15-065e-4ff5-b839-8b33b09549fa tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:09.948556 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4f084e15-065e-4ff5-b839-8b33b09549fa tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:09.954013 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4f084e15-065e-4ff5-b839-8b33b09549fa tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:09.955779 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4f084e15-065e-4ff5-b839-8b33b09549fa tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:09.969201 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4f084e15-065e-4ff5-b839-8b33b09549fa tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:09.970249 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4f084e15-065e-4ff5-b839-8b33b09549fa tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:10.876875 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4f084e15-065e-4ff5-b839-8b33b09549fa tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.967152 Aug 31 16:25:10.894373 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2727/5422] 10.222.0.61 () {58 vars in 1275 bytes} [Wed Aug 31 16:25:09 2022] GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b/os-interface => generated 285 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:25:10.909354 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5edc7c82-9196-4675-8cfc-2b970a3b2229 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:10.910489 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5edc7c82-9196-4675-8cfc-2b970a3b2229 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 90d3311f-d4dc-4100-924a-963372dfcc88] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:10.925891 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5edc7c82-9196-4675-8cfc-2b970a3b2229 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:10.926682 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5edc7c82-9196-4675-8cfc-2b970a3b2229 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:10.929079 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5edc7c82-9196-4675-8cfc-2b970a3b2229 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:10.932765 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5edc7c82-9196-4675-8cfc-2b970a3b2229 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:10.934249 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5edc7c82-9196-4675-8cfc-2b970a3b2229 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:10.935371 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5edc7c82-9196-4675-8cfc-2b970a3b2229 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:11.542757 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5edc7c82-9196-4675-8cfc-2b970a3b2229 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:11.552978 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5edc7c82-9196-4675-8cfc-2b970a3b2229 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/90d3311f-d4dc-4100-924a-963372dfcc88" status: 200 len: 1273 microversion: 2.1 time: 0.655066 Aug 31 16:25:11.557569 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2728/5423] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:10 2022] GET /compute/v2.1/servers/90d3311f-d4dc-4100-924a-963372dfcc88 => generated 1273 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:11.677040 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-fa530542-93cd-43ae-9585-d8f4561dc35d tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:11.706050 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-fa530542-93cd-43ae-9585-d8f4561dc35d tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1526 microversion: 2.1 time: 1.934422 Aug 31 16:25:11.723453 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2696/5424] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:09 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1526 bytes in 1940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:12.586830 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-730ce301-b3e4-43b3-8183-527741994bb7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:12.588007 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-730ce301-b3e4-43b3-8183-527741994bb7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 90d3311f-d4dc-4100-924a-963372dfcc88] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:12.606300 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-730ce301-b3e4-43b3-8183-527741994bb7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:12.608151 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-730ce301-b3e4-43b3-8183-527741994bb7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:12.609283 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-730ce301-b3e4-43b3-8183-527741994bb7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:12.611212 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-730ce301-b3e4-43b3-8183-527741994bb7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:12.612753 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-730ce301-b3e4-43b3-8183-527741994bb7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:12.613948 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-730ce301-b3e4-43b3-8183-527741994bb7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:12.740106 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3d66d6d8-5c84-4daf-85f9-c25a4226b0b2 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:12.741193 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3d66d6d8-5c84-4daf-85f9-c25a4226b0b2 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:12.764468 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3d66d6d8-5c84-4daf-85f9-c25a4226b0b2 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:12.768961 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3d66d6d8-5c84-4daf-85f9-c25a4226b0b2 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:12.771810 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3d66d6d8-5c84-4daf-85f9-c25a4226b0b2 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:12.776175 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3d66d6d8-5c84-4daf-85f9-c25a4226b0b2 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:12.778234 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3d66d6d8-5c84-4daf-85f9-c25a4226b0b2 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:12.782569 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3d66d6d8-5c84-4daf-85f9-c25a4226b0b2 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:13.234553 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-730ce301-b3e4-43b3-8183-527741994bb7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:13.255161 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-730ce301-b3e4-43b3-8183-527741994bb7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/90d3311f-d4dc-4100-924a-963372dfcc88" status: 200 len: 1271 microversion: 2.1 time: 0.676710 Aug 31 16:25:13.259434 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2729/5425] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:12 2022] GET /compute/v2.1/servers/90d3311f-d4dc-4100-924a-963372dfcc88 => generated 1271 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:13.410784 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-2bd0b95d-d9fe-4d1c-9c23-0c0b126f65ae req-10bc3aa0-a4b1-4573-b3ca-eb105a0ac789 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b92e2d45-4596-4f2b-8a5c-8fd5f0084630", "tag": "b35ba8d8-fd10-45c4-89d9-1e04f3301266"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:25:13.450956 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-2bd0b95d-d9fe-4d1c-9c23-0c0b126f65ae req-10bc3aa0-a4b1-4573-b3ca-eb105a0ac789 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:13.455482 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-2bd0b95d-d9fe-4d1c-9c23-0c0b126f65ae req-10bc3aa0-a4b1-4573-b3ca-eb105a0ac789 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:13.456569 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-2bd0b95d-d9fe-4d1c-9c23-0c0b126f65ae req-10bc3aa0-a4b1-4573-b3ca-eb105a0ac789 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:13.531275 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-2bd0b95d-d9fe-4d1c-9c23-0c0b126f65ae req-10bc3aa0-a4b1-4573-b3ca-eb105a0ac789 service nova] Creating event network-changed:b35ba8d8-fd10-45c4-89d9-1e04f3301266 for instance b92e2d45-4596-4f2b-8a5c-8fd5f0084630 on n-h1-850499-9 Aug 31 16:25:13.545454 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-2bd0b95d-d9fe-4d1c-9c23-0c0b126f65ae req-10bc3aa0-a4b1-4573-b3ca-eb105a0ac789 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142331 Aug 31 16:25:13.550906 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2730/5426] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:25:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:25:14.357187 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-2c7508c4-2fc0-45ca-aae4-bde758500092 req-e5322fef-b3d4-43b0-819f-51c33cee0651 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1c50fa6-2d8a-4707-9ee7-448ea57be62b", "tag": "cd30456c-29c0-40f3-baeb-7b819e58a733"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:25:14.380299 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3d66d6d8-5c84-4daf-85f9-c25a4226b0b2 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:14.398547 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3d66d6d8-5c84-4daf-85f9-c25a4226b0b2 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1526 microversion: 2.1 time: 1.663364 Aug 31 16:25:14.399157 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2697/5427] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:12 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1526 bytes in 1665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:14.411827 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-2c7508c4-2fc0-45ca-aae4-bde758500092 req-e5322fef-b3d4-43b0-819f-51c33cee0651 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:14.412680 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-2c7508c4-2fc0-45ca-aae4-bde758500092 req-e5322fef-b3d4-43b0-819f-51c33cee0651 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:14.413391 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-2c7508c4-2fc0-45ca-aae4-bde758500092 req-e5322fef-b3d4-43b0-819f-51c33cee0651 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:14.457967 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-2c7508c4-2fc0-45ca-aae4-bde758500092 req-e5322fef-b3d4-43b0-819f-51c33cee0651 service nova] Creating event network-changed:cd30456c-29c0-40f3-baeb-7b819e58a733 for instance d1c50fa6-2d8a-4707-9ee7-448ea57be62b on n-h2-850499-9 Aug 31 16:25:14.461432 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f3f658d7-1cc1-40fa-891e-ec1531a8b955 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:14.469451 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f3f658d7-1cc1-40fa-891e-ec1531a8b955 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 90d3311f-d4dc-4100-924a-963372dfcc88] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:14.484930 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-2c7508c4-2fc0-45ca-aae4-bde758500092 req-e5322fef-b3d4-43b0-819f-51c33cee0651 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.870929 Aug 31 16:25:14.486445 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2731/5428] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:25:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:25:14.524902 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f3f658d7-1cc1-40fa-891e-ec1531a8b955 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:14.526943 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f3f658d7-1cc1-40fa-891e-ec1531a8b955 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:14.535479 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f3f658d7-1cc1-40fa-891e-ec1531a8b955 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:14.561908 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f3f658d7-1cc1-40fa-891e-ec1531a8b955 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:14.566769 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f3f658d7-1cc1-40fa-891e-ec1531a8b955 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:14.567467 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f3f658d7-1cc1-40fa-891e-ec1531a8b955 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:14.651322 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:25:15.261540 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f3f658d7-1cc1-40fa-891e-ec1531a8b955 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:15.310447 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f3f658d7-1cc1-40fa-891e-ec1531a8b955 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/90d3311f-d4dc-4100-924a-963372dfcc88" status: 200 len: 1271 microversion: 2.1 time: 0.909808 Aug 31 16:25:15.324974 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2698/5429] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:14 2022] GET /compute/v2.1/servers/90d3311f-d4dc-4100-924a-963372dfcc88 => generated 1271 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:15.446776 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b7f888e6-bae1-4d8a-a484-2f7c1c87f967 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:15.453402 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b7f888e6-bae1-4d8a-a484-2f7c1c87f967 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:15.500621 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b7f888e6-bae1-4d8a-a484-2f7c1c87f967 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:15.506452 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b7f888e6-bae1-4d8a-a484-2f7c1c87f967 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:15.507750 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b7f888e6-bae1-4d8a-a484-2f7c1c87f967 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:15.512158 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b7f888e6-bae1-4d8a-a484-2f7c1c87f967 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:15.513486 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b7f888e6-bae1-4d8a-a484-2f7c1c87f967 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:15.517779 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b7f888e6-bae1-4d8a-a484-2f7c1c87f967 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:16.362906 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-61c53b78-5294-4c94-adbe-ce1ce49017b5 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:16.383192 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-61c53b78-5294-4c94-adbe-ce1ce49017b5 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 90d3311f-d4dc-4100-924a-963372dfcc88] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:16.434865 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-61c53b78-5294-4c94-adbe-ce1ce49017b5 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:16.441373 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-61c53b78-5294-4c94-adbe-ce1ce49017b5 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:16.442864 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-61c53b78-5294-4c94-adbe-ce1ce49017b5 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:16.449604 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-61c53b78-5294-4c94-adbe-ce1ce49017b5 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:16.452027 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-61c53b78-5294-4c94-adbe-ce1ce49017b5 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:16.455034 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-61c53b78-5294-4c94-adbe-ce1ce49017b5 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:17.346532 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:25:17.522273 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b7f888e6-bae1-4d8a-a484-2f7c1c87f967 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:17.565890 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b7f888e6-bae1-4d8a-a484-2f7c1c87f967 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1526 microversion: 2.1 time: 2.135813 Aug 31 16:25:17.575609 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2732/5430] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:15 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1526 bytes in 2147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:17.637865 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-1453bd24-5d12-49c9-bc85-e96dfeaf6d84 req-f85fbda5-1d15-4ff0-91d2-5acd787f55cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1c50fa6-2d8a-4707-9ee7-448ea57be62b", "tag": "cd30456c-29c0-40f3-baeb-7b819e58a733"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:25:17.659291 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:25:17.666416 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-1453bd24-5d12-49c9-bc85-e96dfeaf6d84 req-f85fbda5-1d15-4ff0-91d2-5acd787f55cb service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:17.667336 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-1453bd24-5d12-49c9-bc85-e96dfeaf6d84 req-f85fbda5-1d15-4ff0-91d2-5acd787f55cb service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:17.668000 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-1453bd24-5d12-49c9-bc85-e96dfeaf6d84 req-f85fbda5-1d15-4ff0-91d2-5acd787f55cb service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:17.701857 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-1453bd24-5d12-49c9-bc85-e96dfeaf6d84 req-f85fbda5-1d15-4ff0-91d2-5acd787f55cb service nova] Creating event network-changed:cd30456c-29c0-40f3-baeb-7b819e58a733 for instance d1c50fa6-2d8a-4707-9ee7-448ea57be62b on n-h2-850499-9 Aug 31 16:25:17.714385 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-1453bd24-5d12-49c9-bc85-e96dfeaf6d84 req-f85fbda5-1d15-4ff0-91d2-5acd787f55cb service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087741 Aug 31 16:25:17.715215 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2733/5431] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:25:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:25:17.982892 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-61c53b78-5294-4c94-adbe-ce1ce49017b5 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:18.033402 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-61c53b78-5294-4c94-adbe-ce1ce49017b5 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/90d3311f-d4dc-4100-924a-963372dfcc88" status: 200 len: 1313 microversion: 2.1 time: 1.673159 Aug 31 16:25:18.037071 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2699/5432] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:16 2022] GET /compute/v2.1/servers/90d3311f-d4dc-4100-924a-963372dfcc88 => generated 1313 bytes in 1686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:18.623642 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ec5277b1-e88d-4956-b98e-89c950ce013b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:18.625323 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ec5277b1-e88d-4956-b98e-89c950ce013b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:18.633352 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=8 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:25:18.637070 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ec5277b1-e88d-4956-b98e-89c950ce013b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:18.637859 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ec5277b1-e88d-4956-b98e-89c950ce013b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:18.639212 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ec5277b1-e88d-4956-b98e-89c950ce013b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:18.641570 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ec5277b1-e88d-4956-b98e-89c950ce013b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:18.642735 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ec5277b1-e88d-4956-b98e-89c950ce013b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:18.643810 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ec5277b1-e88d-4956-b98e-89c950ce013b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:19.059338 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-25804392-69e7-4d13-915d-580e2dd92d26 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:19.061356 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-25804392-69e7-4d13-915d-580e2dd92d26 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 90d3311f-d4dc-4100-924a-963372dfcc88] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:19.064568 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=68 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:25:19.085202 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-25804392-69e7-4d13-915d-580e2dd92d26 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:19.094238 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-25804392-69e7-4d13-915d-580e2dd92d26 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:19.097023 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-25804392-69e7-4d13-915d-580e2dd92d26 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:19.100640 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-25804392-69e7-4d13-915d-580e2dd92d26 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:19.108744 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-25804392-69e7-4d13-915d-580e2dd92d26 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:19.115629 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-25804392-69e7-4d13-915d-580e2dd92d26 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:20.570128 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ec5277b1-e88d-4956-b98e-89c950ce013b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:20.586456 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ec5277b1-e88d-4956-b98e-89c950ce013b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1526 microversion: 2.1 time: 1.990643 Aug 31 16:25:20.595785 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2734/5433] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:18 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1526 bytes in 2002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:20.691629 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-25804392-69e7-4d13-915d-580e2dd92d26 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:20.730615 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-25804392-69e7-4d13-915d-580e2dd92d26 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/90d3311f-d4dc-4100-924a-963372dfcc88" status: 200 len: 1313 microversion: 2.1 time: 1.674640 Aug 31 16:25:20.737458 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2700/5434] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:19 2022] GET /compute/v2.1/servers/90d3311f-d4dc-4100-924a-963372dfcc88 => generated 1313 bytes in 1683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:25:21.632993 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c2163d1e-bfc1-439f-ab00-bf05027c4148 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:21.634661 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c2163d1e-bfc1-439f-ab00-bf05027c4148 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:21.678569 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c2163d1e-bfc1-439f-ab00-bf05027c4148 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:21.681904 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c2163d1e-bfc1-439f-ab00-bf05027c4148 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:21.682733 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c2163d1e-bfc1-439f-ab00-bf05027c4148 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:21.685081 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c2163d1e-bfc1-439f-ab00-bf05027c4148 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:21.686028 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c2163d1e-bfc1-439f-ab00-bf05027c4148 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:21.686864 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c2163d1e-bfc1-439f-ab00-bf05027c4148 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:21.778565 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-39d392e8-ddcd-4386-ad53-d15b38a304f7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:21.785296 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-39d392e8-ddcd-4386-ad53-d15b38a304f7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 90d3311f-d4dc-4100-924a-963372dfcc88] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:21.791340 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=100 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:25:21.824297 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-39d392e8-ddcd-4386-ad53-d15b38a304f7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:21.829569 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-39d392e8-ddcd-4386-ad53-d15b38a304f7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:21.831843 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-39d392e8-ddcd-4386-ad53-d15b38a304f7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:21.834173 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-39d392e8-ddcd-4386-ad53-d15b38a304f7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:21.839402 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-39d392e8-ddcd-4386-ad53-d15b38a304f7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:21.840513 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-39d392e8-ddcd-4386-ad53-d15b38a304f7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:23.606893 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-39d392e8-ddcd-4386-ad53-d15b38a304f7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:23.633613 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-39d392e8-ddcd-4386-ad53-d15b38a304f7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/90d3311f-d4dc-4100-924a-963372dfcc88" status: 200 len: 1313 microversion: 2.1 time: 1.862331 Aug 31 16:25:23.636632 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2701/5435] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:21 2022] GET /compute/v2.1/servers/90d3311f-d4dc-4100-924a-963372dfcc88 => generated 1313 bytes in 1866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:23.710958 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-60f03b8b-3b5f-4925-89bc-65c60dc9aeef req-054bfa7b-f3d5-4c6f-9c2a-a15182d5697c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90d3311f-d4dc-4100-924a-963372dfcc88", "tag": "3bcdc13f-0bd3-4e94-8657-4188531f839a"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:25:23.792246 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-60f03b8b-3b5f-4925-89bc-65c60dc9aeef req-054bfa7b-f3d5-4c6f-9c2a-a15182d5697c service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:23.793609 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-60f03b8b-3b5f-4925-89bc-65c60dc9aeef req-054bfa7b-f3d5-4c6f-9c2a-a15182d5697c service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:23.795935 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-60f03b8b-3b5f-4925-89bc-65c60dc9aeef req-054bfa7b-f3d5-4c6f-9c2a-a15182d5697c service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:23.867474 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-60f03b8b-3b5f-4925-89bc-65c60dc9aeef req-054bfa7b-f3d5-4c6f-9c2a-a15182d5697c service nova] Creating event network-changed:3bcdc13f-0bd3-4e94-8657-4188531f839a for instance 90d3311f-d4dc-4100-924a-963372dfcc88 on n-h2-850499-9 Aug 31 16:25:23.901989 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-60f03b8b-3b5f-4925-89bc-65c60dc9aeef req-054bfa7b-f3d5-4c6f-9c2a-a15182d5697c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.262957 Aug 31 16:25:23.903118 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2702/5436] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:25:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:25:23.916240 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c2163d1e-bfc1-439f-ab00-bf05027c4148 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:23.948317 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c2163d1e-bfc1-439f-ab00-bf05027c4148 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1526 microversion: 2.1 time: 2.313882 Aug 31 16:25:23.954851 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2735/5437] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:21 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1526 bytes in 2330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:24.675457 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6c3200f6-6e54-4a5e-b190-6e0c852230be tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:24.699422 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6c3200f6-6e54-4a5e-b190-6e0c852230be tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 90d3311f-d4dc-4100-924a-963372dfcc88] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:24.766469 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6c3200f6-6e54-4a5e-b190-6e0c852230be tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:24.770474 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6c3200f6-6e54-4a5e-b190-6e0c852230be tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:24.775995 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6c3200f6-6e54-4a5e-b190-6e0c852230be tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:24.780990 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6c3200f6-6e54-4a5e-b190-6e0c852230be tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:24.782983 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6c3200f6-6e54-4a5e-b190-6e0c852230be tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:24.783752 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6c3200f6-6e54-4a5e-b190-6e0c852230be tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:24.997519 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e7ca5e73-c633-4652-9d10-5f9127f1adb8 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:25.003020 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e7ca5e73-c633-4652-9d10-5f9127f1adb8 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:25.018177 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e7ca5e73-c633-4652-9d10-5f9127f1adb8 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:25.018590 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e7ca5e73-c633-4652-9d10-5f9127f1adb8 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:25.040803 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e7ca5e73-c633-4652-9d10-5f9127f1adb8 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:25.043577 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e7ca5e73-c633-4652-9d10-5f9127f1adb8 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:25.048787 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e7ca5e73-c633-4652-9d10-5f9127f1adb8 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:25.065479 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e7ca5e73-c633-4652-9d10-5f9127f1adb8 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:25.261688 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-6c3200f6-6e54-4a5e-b190-6e0c852230be tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:25.275953 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6c3200f6-6e54-4a5e-b190-6e0c852230be tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/90d3311f-d4dc-4100-924a-963372dfcc88" status: 200 len: 1313 microversion: 2.1 time: 0.610866 Aug 31 16:25:25.276919 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2703/5438] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:24 2022] GET /compute/v2.1/servers/90d3311f-d4dc-4100-924a-963372dfcc88 => generated 1313 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:25.680066 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e7ca5e73-c633-4652-9d10-5f9127f1adb8 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:25.704262 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e7ca5e73-c633-4652-9d10-5f9127f1adb8 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1526 microversion: 2.1 time: 0.705787 Aug 31 16:25:25.705801 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2736/5439] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:24 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1526 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:26.305276 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0a4c37a2-e5bf-4e16-a192-2d15de18a937 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:26.308760 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0a4c37a2-e5bf-4e16-a192-2d15de18a937 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 90d3311f-d4dc-4100-924a-963372dfcc88] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:26.340743 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0a4c37a2-e5bf-4e16-a192-2d15de18a937 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:26.342379 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0a4c37a2-e5bf-4e16-a192-2d15de18a937 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:26.344389 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0a4c37a2-e5bf-4e16-a192-2d15de18a937 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:26.346123 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0a4c37a2-e5bf-4e16-a192-2d15de18a937 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:26.347237 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0a4c37a2-e5bf-4e16-a192-2d15de18a937 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:26.348452 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0a4c37a2-e5bf-4e16-a192-2d15de18a937 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:26.665408 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-0a4c37a2-e5bf-4e16-a192-2d15de18a937 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:26.681057 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0a4c37a2-e5bf-4e16-a192-2d15de18a937 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/90d3311f-d4dc-4100-924a-963372dfcc88" status: 200 len: 1313 microversion: 2.1 time: 0.383977 Aug 31 16:25:26.702601 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2704/5440] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:26 2022] GET /compute/v2.1/servers/90d3311f-d4dc-4100-924a-963372dfcc88 => generated 1313 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:26.765014 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-39931842-27d9-48c9-b42f-5a4a9016c972 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:26.776399 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-39931842-27d9-48c9-b42f-5a4a9016c972 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:26.857020 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-39931842-27d9-48c9-b42f-5a4a9016c972 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:26.860259 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-39931842-27d9-48c9-b42f-5a4a9016c972 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:26.861373 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-39931842-27d9-48c9-b42f-5a4a9016c972 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:26.863006 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-39931842-27d9-48c9-b42f-5a4a9016c972 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:26.864181 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-39931842-27d9-48c9-b42f-5a4a9016c972 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:26.865693 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-39931842-27d9-48c9-b42f-5a4a9016c972 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:27.439934 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-39931842-27d9-48c9-b42f-5a4a9016c972 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:27.451310 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-39931842-27d9-48c9-b42f-5a4a9016c972 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1526 microversion: 2.1 time: 0.704381 Aug 31 16:25:27.453768 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2737/5441] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:26 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1526 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:27.727351 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-dd874d65-488b-4c6f-a044-1269b1483448 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:27.728981 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-dd874d65-488b-4c6f-a044-1269b1483448 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 90d3311f-d4dc-4100-924a-963372dfcc88] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:27.738092 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dd874d65-488b-4c6f-a044-1269b1483448 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:27.738762 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dd874d65-488b-4c6f-a044-1269b1483448 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:27.739216 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dd874d65-488b-4c6f-a044-1269b1483448 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:27.740005 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dd874d65-488b-4c6f-a044-1269b1483448 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:27.740725 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dd874d65-488b-4c6f-a044-1269b1483448 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:27.741226 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dd874d65-488b-4c6f-a044-1269b1483448 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:28.232208 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-dd874d65-488b-4c6f-a044-1269b1483448 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:28.257232 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-dd874d65-488b-4c6f-a044-1269b1483448 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/90d3311f-d4dc-4100-924a-963372dfcc88" status: 200 len: 1313 microversion: 2.1 time: 0.553740 Aug 31 16:25:28.270065 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2705/5442] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:27 2022] GET /compute/v2.1/servers/90d3311f-d4dc-4100-924a-963372dfcc88 => generated 1313 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:28.481034 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-65ae4306-803c-4b71-83cf-992822a6d1f4 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:28.482219 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-65ae4306-803c-4b71-83cf-992822a6d1f4 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:28.494029 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-65ae4306-803c-4b71-83cf-992822a6d1f4 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:28.495251 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-65ae4306-803c-4b71-83cf-992822a6d1f4 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:28.499736 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-65ae4306-803c-4b71-83cf-992822a6d1f4 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:28.500892 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-65ae4306-803c-4b71-83cf-992822a6d1f4 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:28.501584 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-65ae4306-803c-4b71-83cf-992822a6d1f4 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:28.502227 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-65ae4306-803c-4b71-83cf-992822a6d1f4 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:29.315734 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4f448506-4ad0-4c2a-a26d-91bb26334c32 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:29.317758 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4f448506-4ad0-4c2a-a26d-91bb26334c32 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 90d3311f-d4dc-4100-924a-963372dfcc88] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:29.334241 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4f448506-4ad0-4c2a-a26d-91bb26334c32 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:29.335526 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4f448506-4ad0-4c2a-a26d-91bb26334c32 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:29.337163 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4f448506-4ad0-4c2a-a26d-91bb26334c32 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:29.340153 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4f448506-4ad0-4c2a-a26d-91bb26334c32 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:29.340653 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4f448506-4ad0-4c2a-a26d-91bb26334c32 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:29.341109 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4f448506-4ad0-4c2a-a26d-91bb26334c32 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:29.966154 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-65ae4306-803c-4b71-83cf-992822a6d1f4 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:30.021955 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-65ae4306-803c-4b71-83cf-992822a6d1f4 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1526 microversion: 2.1 time: 1.546725 Aug 31 16:25:30.023391 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2738/5443] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:28 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1526 bytes in 1549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:30.312251 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-4f448506-4ad0-4c2a-a26d-91bb26334c32 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:30.328295 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4f448506-4ad0-4c2a-a26d-91bb26334c32 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/90d3311f-d4dc-4100-924a-963372dfcc88" status: 200 len: 1313 microversion: 2.1 time: 1.023650 Aug 31 16:25:30.336068 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2706/5444] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:29 2022] GET /compute/v2.1/servers/90d3311f-d4dc-4100-924a-963372dfcc88 => generated 1313 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:31.066721 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-805e1b54-24ba-4f64-b4d0-c8e8050b2762 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:31.077193 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-805e1b54-24ba-4f64-b4d0-c8e8050b2762 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:31.149437 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-805e1b54-24ba-4f64-b4d0-c8e8050b2762 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:31.160003 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-805e1b54-24ba-4f64-b4d0-c8e8050b2762 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:31.170644 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-805e1b54-24ba-4f64-b4d0-c8e8050b2762 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:31.172522 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-805e1b54-24ba-4f64-b4d0-c8e8050b2762 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:31.177399 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-805e1b54-24ba-4f64-b4d0-c8e8050b2762 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:31.180647 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-805e1b54-24ba-4f64-b4d0-c8e8050b2762 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:31.384739 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-23f67307-9150-47c9-824d-eb477927b729 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:31.386528 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-23f67307-9150-47c9-824d-eb477927b729 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 90d3311f-d4dc-4100-924a-963372dfcc88] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:31.437172 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-23f67307-9150-47c9-824d-eb477927b729 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:31.438409 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-23f67307-9150-47c9-824d-eb477927b729 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:31.439530 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-23f67307-9150-47c9-824d-eb477927b729 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:31.440940 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-23f67307-9150-47c9-824d-eb477927b729 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:31.442115 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-23f67307-9150-47c9-824d-eb477927b729 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:31.443100 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-23f67307-9150-47c9-824d-eb477927b729 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:33.249774 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-805e1b54-24ba-4f64-b4d0-c8e8050b2762 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:33.275995 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-805e1b54-24ba-4f64-b4d0-c8e8050b2762 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1526 microversion: 2.1 time: 2.217777 Aug 31 16:25:33.285850 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2739/5445] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:31 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1526 bytes in 2229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:33.689594 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-23f67307-9150-47c9-824d-eb477927b729 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:33.714817 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-23f67307-9150-47c9-824d-eb477927b729 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/90d3311f-d4dc-4100-924a-963372dfcc88" status: 200 len: 1313 microversion: 2.1 time: 2.337677 Aug 31 16:25:33.732271 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2707/5446] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:31 2022] GET /compute/v2.1/servers/90d3311f-d4dc-4100-924a-963372dfcc88 => generated 1313 bytes in 2356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:34.308403 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-50ad588f-47cd-47c0-9e7c-d7a2b0ad343f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:34.310772 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-50ad588f-47cd-47c0-9e7c-d7a2b0ad343f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:34.350101 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-50ad588f-47cd-47c0-9e7c-d7a2b0ad343f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:34.351256 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-50ad588f-47cd-47c0-9e7c-d7a2b0ad343f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:34.352682 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-50ad588f-47cd-47c0-9e7c-d7a2b0ad343f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:34.358570 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-50ad588f-47cd-47c0-9e7c-d7a2b0ad343f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:34.360219 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-50ad588f-47cd-47c0-9e7c-d7a2b0ad343f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:34.361342 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-50ad588f-47cd-47c0-9e7c-d7a2b0ad343f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:34.666412 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-18d787ad-c755-489f-a28d-c5bd5d534d30 req-63e7c2a4-9d1d-4f8c-a47c-ffb9421727b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90d3311f-d4dc-4100-924a-963372dfcc88", "name": "network-vif-plugged", "status": "completed", "tag": "3bcdc13f-0bd3-4e94-8657-4188531f839a"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:25:34.722690 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-50ad588f-47cd-47c0-9e7c-d7a2b0ad343f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:34.742597 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-50ad588f-47cd-47c0-9e7c-d7a2b0ad343f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1526 microversion: 2.1 time: 0.438713 Aug 31 16:25:34.749136 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2740/5447] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:34 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1526 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:34.757845 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-18d787ad-c755-489f-a28d-c5bd5d534d30 req-63e7c2a4-9d1d-4f8c-a47c-ffb9421727b7 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:34.761001 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f965eba6-a9e6-460e-8c09-a13eb2bc7cf4 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:34.761893 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f965eba6-a9e6-460e-8c09-a13eb2bc7cf4 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 90d3311f-d4dc-4100-924a-963372dfcc88] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:34.766070 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-18d787ad-c755-489f-a28d-c5bd5d534d30 req-63e7c2a4-9d1d-4f8c-a47c-ffb9421727b7 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:34.768182 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-18d787ad-c755-489f-a28d-c5bd5d534d30 req-63e7c2a4-9d1d-4f8c-a47c-ffb9421727b7 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:34.785444 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f965eba6-a9e6-460e-8c09-a13eb2bc7cf4 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:34.788231 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f965eba6-a9e6-460e-8c09-a13eb2bc7cf4 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:34.788924 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f965eba6-a9e6-460e-8c09-a13eb2bc7cf4 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:34.792218 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f965eba6-a9e6-460e-8c09-a13eb2bc7cf4 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:34.792937 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f965eba6-a9e6-460e-8c09-a13eb2bc7cf4 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:34.793601 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f965eba6-a9e6-460e-8c09-a13eb2bc7cf4 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:34.843667 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-18d787ad-c755-489f-a28d-c5bd5d534d30 req-63e7c2a4-9d1d-4f8c-a47c-ffb9421727b7 service nova] Creating event network-vif-plugged:3bcdc13f-0bd3-4e94-8657-4188531f839a for instance 90d3311f-d4dc-4100-924a-963372dfcc88 on n-h2-850499-9 Aug 31 16:25:34.910886 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-18d787ad-c755-489f-a28d-c5bd5d534d30 req-63e7c2a4-9d1d-4f8c-a47c-ffb9421727b7 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.247993 Aug 31 16:25:34.915305 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2708/5448] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:25:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:25:35.161715 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f965eba6-a9e6-460e-8c09-a13eb2bc7cf4 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:35.194314 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f965eba6-a9e6-460e-8c09-a13eb2bc7cf4 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/90d3311f-d4dc-4100-924a-963372dfcc88" status: 200 len: 1313 microversion: 2.1 time: 0.438028 Aug 31 16:25:35.194930 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2741/5449] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:34 2022] GET /compute/v2.1/servers/90d3311f-d4dc-4100-924a-963372dfcc88 => generated 1313 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:25:35.806062 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f9c096a1-34b4-496f-aac8-9f5947cc6feb tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:35.819134 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f9c096a1-34b4-496f-aac8-9f5947cc6feb tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:35.858358 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f9c096a1-34b4-496f-aac8-9f5947cc6feb tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:35.863088 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f9c096a1-34b4-496f-aac8-9f5947cc6feb tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:35.863914 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f9c096a1-34b4-496f-aac8-9f5947cc6feb tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:35.865198 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f9c096a1-34b4-496f-aac8-9f5947cc6feb tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:35.866024 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f9c096a1-34b4-496f-aac8-9f5947cc6feb tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:35.866773 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f9c096a1-34b4-496f-aac8-9f5947cc6feb tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:36.223612 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-fad7b98a-93e8-4a10-8b4e-05bac52418c0 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:36.225023 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-fad7b98a-93e8-4a10-8b4e-05bac52418c0 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 90d3311f-d4dc-4100-924a-963372dfcc88] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:36.240258 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fad7b98a-93e8-4a10-8b4e-05bac52418c0 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:36.245894 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fad7b98a-93e8-4a10-8b4e-05bac52418c0 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:36.250368 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fad7b98a-93e8-4a10-8b4e-05bac52418c0 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:36.251707 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fad7b98a-93e8-4a10-8b4e-05bac52418c0 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:36.254957 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fad7b98a-93e8-4a10-8b4e-05bac52418c0 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:36.258179 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fad7b98a-93e8-4a10-8b4e-05bac52418c0 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:36.392012 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f9c096a1-34b4-496f-aac8-9f5947cc6feb tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:36.414562 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f9c096a1-34b4-496f-aac8-9f5947cc6feb tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1526 microversion: 2.1 time: 0.615680 Aug 31 16:25:36.434789 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2709/5450] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:35 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1526 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:36.849722 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-fad7b98a-93e8-4a10-8b4e-05bac52418c0 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:36.861383 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-fad7b98a-93e8-4a10-8b4e-05bac52418c0 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/90d3311f-d4dc-4100-924a-963372dfcc88" status: 200 len: 1313 microversion: 2.1 time: 0.641863 Aug 31 16:25:36.870089 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2742/5451] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:36 2022] GET /compute/v2.1/servers/90d3311f-d4dc-4100-924a-963372dfcc88 => generated 1313 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:25:37.460698 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3e8cb711-6715-4155-a1e5-8831b4dac1fb tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:37.465839 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3e8cb711-6715-4155-a1e5-8831b4dac1fb tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:37.477316 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3e8cb711-6715-4155-a1e5-8831b4dac1fb tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:37.478675 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3e8cb711-6715-4155-a1e5-8831b4dac1fb tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:37.479847 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3e8cb711-6715-4155-a1e5-8831b4dac1fb tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:37.480783 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3e8cb711-6715-4155-a1e5-8831b4dac1fb tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:37.481494 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3e8cb711-6715-4155-a1e5-8831b4dac1fb tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:37.482346 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3e8cb711-6715-4155-a1e5-8831b4dac1fb tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:37.867306 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3e8cb711-6715-4155-a1e5-8831b4dac1fb tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:37.908671 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-37997550-8267-4952-90d1-9cac3087121b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:37.914119 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-37997550-8267-4952-90d1-9cac3087121b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 90d3311f-d4dc-4100-924a-963372dfcc88] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:37.919246 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3e8cb711-6715-4155-a1e5-8831b4dac1fb tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1526 microversion: 2.1 time: 0.479769 Aug 31 16:25:37.953189 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2710/5452] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:37 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1526 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:37.965665 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-37997550-8267-4952-90d1-9cac3087121b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:37.979185 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-37997550-8267-4952-90d1-9cac3087121b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:37.980158 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-37997550-8267-4952-90d1-9cac3087121b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:37.981628 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-37997550-8267-4952-90d1-9cac3087121b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:37.992928 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-37997550-8267-4952-90d1-9cac3087121b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:37.994043 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-37997550-8267-4952-90d1-9cac3087121b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:38.502430 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-37997550-8267-4952-90d1-9cac3087121b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:38.523264 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-37997550-8267-4952-90d1-9cac3087121b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/90d3311f-d4dc-4100-924a-963372dfcc88" status: 200 len: 1313 microversion: 2.1 time: 0.621429 Aug 31 16:25:38.536003 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2743/5453] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:37 2022] GET /compute/v2.1/servers/90d3311f-d4dc-4100-924a-963372dfcc88 => generated 1313 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:38.955446 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c39cdac1-2445-488e-9ab3-febb91deea1e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:38.963185 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c39cdac1-2445-488e-9ab3-febb91deea1e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:38.980330 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c39cdac1-2445-488e-9ab3-febb91deea1e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:38.988186 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c39cdac1-2445-488e-9ab3-febb91deea1e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:38.991049 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c39cdac1-2445-488e-9ab3-febb91deea1e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:38.991049 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c39cdac1-2445-488e-9ab3-febb91deea1e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:38.991049 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c39cdac1-2445-488e-9ab3-febb91deea1e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:38.991049 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c39cdac1-2445-488e-9ab3-febb91deea1e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:39.400250 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c39cdac1-2445-488e-9ab3-febb91deea1e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:39.400250 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c39cdac1-2445-488e-9ab3-febb91deea1e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1526 microversion: 2.1 time: 0.428347 Aug 31 16:25:39.400250 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2711/5454] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:38 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1526 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:39.552754 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1ca2f1db-6143-4bed-920a-414068437583 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:39.554184 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1ca2f1db-6143-4bed-920a-414068437583 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 90d3311f-d4dc-4100-924a-963372dfcc88] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:39.581420 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1ca2f1db-6143-4bed-920a-414068437583 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:39.615478 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1ca2f1db-6143-4bed-920a-414068437583 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:39.619601 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1ca2f1db-6143-4bed-920a-414068437583 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:39.620705 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1ca2f1db-6143-4bed-920a-414068437583 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:39.621361 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1ca2f1db-6143-4bed-920a-414068437583 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:39.621838 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1ca2f1db-6143-4bed-920a-414068437583 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:40.098287 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-1ca2f1db-6143-4bed-920a-414068437583 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:40.115492 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1ca2f1db-6143-4bed-920a-414068437583 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/90d3311f-d4dc-4100-924a-963372dfcc88" status: 200 len: 1500 microversion: 2.1 time: 0.567652 Aug 31 16:25:40.137685 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2744/5455] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:39 2022] GET /compute/v2.1/servers/90d3311f-d4dc-4100-924a-963372dfcc88 => generated 1500 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:25:40.153292 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0956bb25-c2e0-4a7f-8e17-52fa6277e5a7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:25:40.155483 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0956bb25-c2e0-4a7f-8e17-52fa6277e5a7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 90d3311f-d4dc-4100-924a-963372dfcc88] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:40.174162 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0956bb25-c2e0-4a7f-8e17-52fa6277e5a7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:40.174940 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0956bb25-c2e0-4a7f-8e17-52fa6277e5a7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:40.175917 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0956bb25-c2e0-4a7f-8e17-52fa6277e5a7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:40.176840 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0956bb25-c2e0-4a7f-8e17-52fa6277e5a7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:40.177515 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0956bb25-c2e0-4a7f-8e17-52fa6277e5a7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:40.179546 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0956bb25-c2e0-4a7f-8e17-52fa6277e5a7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:40.440795 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5b38a2fe-467a-4979-8223-a8d3dbe19fb7 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:40.441717 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5b38a2fe-467a-4979-8223-a8d3dbe19fb7 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:40.501387 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b38a2fe-467a-4979-8223-a8d3dbe19fb7 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:40.512272 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b38a2fe-467a-4979-8223-a8d3dbe19fb7 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:40.513327 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b38a2fe-467a-4979-8223-a8d3dbe19fb7 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:40.514539 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b38a2fe-467a-4979-8223-a8d3dbe19fb7 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:40.515439 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b38a2fe-467a-4979-8223-a8d3dbe19fb7 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:40.527615 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b38a2fe-467a-4979-8223-a8d3dbe19fb7 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:40.675750 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.network.security_group_api [None req-0956bb25-c2e0-4a7f-8e17-52fa6277e5a7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Removing security group 3be41b9f-4ddc-4555-82b3-ffb573178523 from port 3bcdc13f-0bd3-4e94-8657-4188531f839a Aug 31 16:25:41.183157 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5b38a2fe-467a-4979-8223-a8d3dbe19fb7 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:41.204019 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5b38a2fe-467a-4979-8223-a8d3dbe19fb7 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1526 microversion: 2.1 time: 0.768897 Aug 31 16:25:41.215387 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2745/5456] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:40 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1526 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:42.242027 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9983734f-ba02-4516-b7a7-784fefa48f8a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:42.243312 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9983734f-ba02-4516-b7a7-784fefa48f8a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:42.252644 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0956bb25-c2e0-4a7f-8e17-52fa6277e5a7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "POST /compute/v2.1/servers/90d3311f-d4dc-4100-924a-963372dfcc88/action" status: 202 len: 0 microversion: 2.1 time: 2.105878 Aug 31 16:25:42.253596 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2712/5457] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:25:40 2022] POST /compute/v2.1/servers/90d3311f-d4dc-4100-924a-963372dfcc88/action => generated 0 bytes in 2107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:25:42.262563 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ca539954-982d-4806-a1da-33559ad34a50 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:42.264061 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ca539954-982d-4806-a1da-33559ad34a50 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 90d3311f-d4dc-4100-924a-963372dfcc88] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:42.270381 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9983734f-ba02-4516-b7a7-784fefa48f8a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:42.273796 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9983734f-ba02-4516-b7a7-784fefa48f8a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:42.276422 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9983734f-ba02-4516-b7a7-784fefa48f8a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:42.280535 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9983734f-ba02-4516-b7a7-784fefa48f8a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:42.281746 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9983734f-ba02-4516-b7a7-784fefa48f8a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:42.282706 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9983734f-ba02-4516-b7a7-784fefa48f8a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:42.284616 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ca539954-982d-4806-a1da-33559ad34a50 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:42.285131 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ca539954-982d-4806-a1da-33559ad34a50 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:42.285586 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ca539954-982d-4806-a1da-33559ad34a50 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:42.286329 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ca539954-982d-4806-a1da-33559ad34a50 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:42.286800 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ca539954-982d-4806-a1da-33559ad34a50 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:42.287244 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ca539954-982d-4806-a1da-33559ad34a50 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:42.671963 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ca539954-982d-4806-a1da-33559ad34a50 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:42.711765 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ca539954-982d-4806-a1da-33559ad34a50 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/90d3311f-d4dc-4100-924a-963372dfcc88" status: 200 len: 1458 microversion: 2.1 time: 0.452597 Aug 31 16:25:42.720064 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2713/5458] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:42 2022] GET /compute/v2.1/servers/90d3311f-d4dc-4100-924a-963372dfcc88 => generated 1458 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:42.739860 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-3be707a6-797c-4a26-9a26-e778a4a5fbbe req-922af2ce-d8ac-4335-a0e1-62835c3bb020 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90d3311f-d4dc-4100-924a-963372dfcc88", "tag": "3bcdc13f-0bd3-4e94-8657-4188531f839a"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:25:42.761397 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-3be707a6-797c-4a26-9a26-e778a4a5fbbe req-922af2ce-d8ac-4335-a0e1-62835c3bb020 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:42.762866 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-3be707a6-797c-4a26-9a26-e778a4a5fbbe req-922af2ce-d8ac-4335-a0e1-62835c3bb020 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:42.764416 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-3be707a6-797c-4a26-9a26-e778a4a5fbbe req-922af2ce-d8ac-4335-a0e1-62835c3bb020 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:42.790756 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-3be707a6-797c-4a26-9a26-e778a4a5fbbe req-922af2ce-d8ac-4335-a0e1-62835c3bb020 service nova] Creating event network-changed:3bcdc13f-0bd3-4e94-8657-4188531f839a for instance 90d3311f-d4dc-4100-924a-963372dfcc88 on n-h2-850499-9 Aug 31 16:25:42.796388 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9983734f-ba02-4516-b7a7-784fefa48f8a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:42.802330 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-3be707a6-797c-4a26-9a26-e778a4a5fbbe req-922af2ce-d8ac-4335-a0e1-62835c3bb020 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079179 Aug 31 16:25:42.804213 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2714/5459] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:25:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:25:42.822013 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-15179c14-08f7-4344-aa0f-d169aeb99b91 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:42.827765 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-15179c14-08f7-4344-aa0f-d169aeb99b91 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:42.834767 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9983734f-ba02-4516-b7a7-784fefa48f8a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1526 microversion: 2.1 time: 0.598215 Aug 31 16:25:42.835725 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2746/5460] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:42 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1526 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:25:42.855970 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-15179c14-08f7-4344-aa0f-d169aeb99b91 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:42.868991 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-15179c14-08f7-4344-aa0f-d169aeb99b91 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:42.870383 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-15179c14-08f7-4344-aa0f-d169aeb99b91 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:42.871572 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-15179c14-08f7-4344-aa0f-d169aeb99b91 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:42.873745 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-15179c14-08f7-4344-aa0f-d169aeb99b91 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:42.874121 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-15179c14-08f7-4344-aa0f-d169aeb99b91 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:43.666492 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-15179c14-08f7-4344-aa0f-d169aeb99b91 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:43.713135 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-15179c14-08f7-4344-aa0f-d169aeb99b91 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1668 microversion: 2.1 time: 0.903228 Aug 31 16:25:43.720978 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2715/5461] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:42 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1668 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:43.796382 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-032222ea-f99a-430b-8803-75bd70910cf2 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:43.798693 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-032222ea-f99a-430b-8803-75bd70910cf2 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:43.830207 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-032222ea-f99a-430b-8803-75bd70910cf2 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:43.831573 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-032222ea-f99a-430b-8803-75bd70910cf2 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:43.832652 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-032222ea-f99a-430b-8803-75bd70910cf2 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:43.841781 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-032222ea-f99a-430b-8803-75bd70910cf2 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:43.843180 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-032222ea-f99a-430b-8803-75bd70910cf2 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:43.858216 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-032222ea-f99a-430b-8803-75bd70910cf2 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:43.876541 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b24d5b2e-9b11-42c1-acb9-fbccef66d97f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:43.877556 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b24d5b2e-9b11-42c1-acb9-fbccef66d97f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:43.890966 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b24d5b2e-9b11-42c1-acb9-fbccef66d97f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:43.898649 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b24d5b2e-9b11-42c1-acb9-fbccef66d97f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:43.899522 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b24d5b2e-9b11-42c1-acb9-fbccef66d97f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:43.905505 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b24d5b2e-9b11-42c1-acb9-fbccef66d97f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:43.920754 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b24d5b2e-9b11-42c1-acb9-fbccef66d97f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:43.922041 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b24d5b2e-9b11-42c1-acb9-fbccef66d97f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:44.767871 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-032222ea-f99a-430b-8803-75bd70910cf2 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:44.800255 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-032222ea-f99a-430b-8803-75bd70910cf2 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1668 microversion: 2.1 time: 1.022305 Aug 31 16:25:44.802133 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2747/5462] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:43 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1668 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:25:44.807594 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b24d5b2e-9b11-42c1-acb9-fbccef66d97f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:44.813296 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=96 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:25:44.853970 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4659db25-dee0-4d6a-842a-a52582fe43da tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:44.855142 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4659db25-dee0-4d6a-842a-a52582fe43da tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:44.864349 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b24d5b2e-9b11-42c1-acb9-fbccef66d97f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1508 microversion: 2.1 time: 0.979659 Aug 31 16:25:44.870232 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2716/5463] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:43 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1508 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:44.878124 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4659db25-dee0-4d6a-842a-a52582fe43da tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:44.878711 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4659db25-dee0-4d6a-842a-a52582fe43da tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:44.879222 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4659db25-dee0-4d6a-842a-a52582fe43da tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:44.880057 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4659db25-dee0-4d6a-842a-a52582fe43da tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:44.880598 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4659db25-dee0-4d6a-842a-a52582fe43da tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:44.881125 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4659db25-dee0-4d6a-842a-a52582fe43da tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:45.384144 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-4659db25-dee0-4d6a-842a-a52582fe43da tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:45.414280 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4659db25-dee0-4d6a-842a-a52582fe43da tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1668 microversion: 2.1 time: 0.581156 Aug 31 16:25:45.414587 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2748/5464] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:44 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1668 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:45.438214 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1de0c929-129b-4ad5-b78f-f3beb14bfed3 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:45.438970 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1de0c929-129b-4ad5-b78f-f3beb14bfed3 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:45.460051 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1de0c929-129b-4ad5-b78f-f3beb14bfed3 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:45.460051 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1de0c929-129b-4ad5-b78f-f3beb14bfed3 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:45.460980 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1de0c929-129b-4ad5-b78f-f3beb14bfed3 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:45.461568 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1de0c929-129b-4ad5-b78f-f3beb14bfed3 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:45.462218 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1de0c929-129b-4ad5-b78f-f3beb14bfed3 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:45.462733 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1de0c929-129b-4ad5-b78f-f3beb14bfed3 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:45.915854 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-88d6cf63-0195-4f71-9034-49d6e57492a9 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:45.918286 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-88d6cf63-0195-4f71-9034-49d6e57492a9 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:45.928907 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-88d6cf63-0195-4f71-9034-49d6e57492a9 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:45.930101 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-88d6cf63-0195-4f71-9034-49d6e57492a9 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:45.931134 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-88d6cf63-0195-4f71-9034-49d6e57492a9 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:45.932436 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-88d6cf63-0195-4f71-9034-49d6e57492a9 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:45.933577 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-88d6cf63-0195-4f71-9034-49d6e57492a9 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:45.936431 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-88d6cf63-0195-4f71-9034-49d6e57492a9 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:45.971483 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1de0c929-129b-4ad5-b78f-f3beb14bfed3 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:45.994957 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1de0c929-129b-4ad5-b78f-f3beb14bfed3 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1668 microversion: 2.1 time: 0.560782 Aug 31 16:25:46.032284 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2717/5465] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:45 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1668 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:25:46.318047 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5d13d112-a906-44da-8eec-1c1d1763ed2c tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1310633508", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "networks": [{"uuid": "41cc840d-a352-47ac-85b3-b767061353cc"}]}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:25:46.400667 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-88d6cf63-0195-4f71-9034-49d6e57492a9 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:46.432667 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-88d6cf63-0195-4f71-9034-49d6e57492a9 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1508 microversion: 2.1 time: 0.524053 Aug 31 16:25:46.443937 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2749/5466] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:45 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1508 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:25:46.500320 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-5d13d112-a906-44da-8eec-1c1d1763ed2c tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] validate_networks() for [('41cc840d-a352-47ac-85b3-b767061353cc', None, None, None, None, None)] {{(pid=122256) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:25:46.575029 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-f7b977ba-ce30-4332-ae0e-9c69fbec1d10 req-96665a21-77e8-49cd-af80-35a538ef3350 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22082563-385d-41a9-baa5-6fb277278505", "name": "network-vif-unplugged", "status": "completed", "tag": "01a10893-04bb-4b06-9640-8c6578bca1fc"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:25:46.599465 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-f7b977ba-ce30-4332-ae0e-9c69fbec1d10 req-96665a21-77e8-49cd-af80-35a538ef3350 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:46.602392 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-f7b977ba-ce30-4332-ae0e-9c69fbec1d10 req-96665a21-77e8-49cd-af80-35a538ef3350 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:46.604010 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-f7b977ba-ce30-4332-ae0e-9c69fbec1d10 req-96665a21-77e8-49cd-af80-35a538ef3350 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:46.658634 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-f7b977ba-ce30-4332-ae0e-9c69fbec1d10 req-96665a21-77e8-49cd-af80-35a538ef3350 service nova] Creating event network-vif-unplugged:01a10893-04bb-4b06-9640-8c6578bca1fc for instance 22082563-385d-41a9-baa5-6fb277278505 on n-h2-850499-9 Aug 31 16:25:46.682884 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-f7b977ba-ce30-4332-ae0e-9c69fbec1d10 req-96665a21-77e8-49cd-af80-35a538ef3350 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.112455 Aug 31 16:25:46.685562 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2750/5467] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:25:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:25:47.481250 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d902b41a-63c2-48b2-a7c4-5ae78dc5323e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:47.482637 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d902b41a-63c2-48b2-a7c4-5ae78dc5323e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:47.509112 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d902b41a-63c2-48b2-a7c4-5ae78dc5323e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:47.509604 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d902b41a-63c2-48b2-a7c4-5ae78dc5323e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:47.510383 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d902b41a-63c2-48b2-a7c4-5ae78dc5323e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:47.511365 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d902b41a-63c2-48b2-a7c4-5ae78dc5323e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:47.512032 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d902b41a-63c2-48b2-a7c4-5ae78dc5323e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:47.512797 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d902b41a-63c2-48b2-a7c4-5ae78dc5323e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:48.385299 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d902b41a-63c2-48b2-a7c4-5ae78dc5323e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:48.395659 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-5d13d112-a906-44da-8eec-1c1d1763ed2c tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:25:48.396307 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-5d13d112-a906-44da-8eec-1c1d1763ed2c tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:25:48.397359 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-5d13d112-a906-44da-8eec-1c1d1763ed2c tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:25:48.398500 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-5d13d112-a906-44da-8eec-1c1d1763ed2c tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:25:48.399731 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-5d13d112-a906-44da-8eec-1c1d1763ed2c tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:25:48.402925 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d902b41a-63c2-48b2-a7c4-5ae78dc5323e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1508 microversion: 2.1 time: 0.937215 Aug 31 16:25:48.405525 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2751/5468] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:47 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1508 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:48.421921 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5d13d112-a906-44da-8eec-1c1d1763ed2c tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:48.424007 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5d13d112-a906-44da-8eec-1c1d1763ed2c tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:48.425069 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5d13d112-a906-44da-8eec-1c1d1763ed2c tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:48.426148 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5d13d112-a906-44da-8eec-1c1d1763ed2c tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:48.426933 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5d13d112-a906-44da-8eec-1c1d1763ed2c tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:48.427910 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5d13d112-a906-44da-8eec-1c1d1763ed2c tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:48.468349 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-5d13d112-a906-44da-8eec-1c1d1763ed2c tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Getting quotas for project f8fa87d9431f4253b8425593a2150359. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:25:48.499023 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-5d13d112-a906-44da-8eec-1c1d1763ed2c tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Getting quotas for user a105ab564f304fa7a2ceba07418a22bc and project f8fa87d9431f4253b8425593a2150359. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:25:48.584273 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5d13d112-a906-44da-8eec-1c1d1763ed2c tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Going to run 1 instances... {{(pid=122256) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:25:48.586693 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5d13d112-a906-44da-8eec-1c1d1763ed2c tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 92076abd-df0a-4c10-bbfd-e8c304633298] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:25:48.717430 n-d-850499-9 devstack@n-api.service[122256]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5d13d112-a906-44da-8eec-1c1d1763ed2c tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [da407648-8e01-4692-9fea-e04810c81804] AMQP server on 10.222.0.61:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 31 16:25:49.442560 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-deb44351-0ff0-4c95-8c84-63a2e0aa2bf3 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:49.448959 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-deb44351-0ff0-4c95-8c84-63a2e0aa2bf3 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:49.458945 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=38 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:25:49.461815 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-deb44351-0ff0-4c95-8c84-63a2e0aa2bf3 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:49.462631 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-deb44351-0ff0-4c95-8c84-63a2e0aa2bf3 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:49.463434 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-deb44351-0ff0-4c95-8c84-63a2e0aa2bf3 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:49.464583 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-deb44351-0ff0-4c95-8c84-63a2e0aa2bf3 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:49.465154 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-deb44351-0ff0-4c95-8c84-63a2e0aa2bf3 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:49.466198 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-deb44351-0ff0-4c95-8c84-63a2e0aa2bf3 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:49.495856 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=100 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:25:49.706600 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-deb44351-0ff0-4c95-8c84-63a2e0aa2bf3 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:49.717564 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-deb44351-0ff0-4c95-8c84-63a2e0aa2bf3 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1511 microversion: 2.1 time: 0.282508 Aug 31 16:25:49.740220 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2752/5469] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:49 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1511 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:49.744170 n-d-850499-9 devstack@n-api.service[122256]: INFO oslo.messaging._drivers.impl_rabbit [None req-5d13d112-a906-44da-8eec-1c1d1763ed2c tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [da407648-8e01-4692-9fea-e04810c81804] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 59050. Aug 31 16:25:49.752841 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5d13d112-a906-44da-8eec-1c1d1763ed2c tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.442289 Aug 31 16:25:49.760484 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2718/5470] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:25:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 3451 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 16:25:49.777141 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-91af037e-24af-4d1a-8759-5f3206b3ff62 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:49.778982 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-91af037e-24af-4d1a-8759-5f3206b3ff62 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:49.790305 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-91af037e-24af-4d1a-8759-5f3206b3ff62 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:49.791669 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-91af037e-24af-4d1a-8759-5f3206b3ff62 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:49.792822 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-91af037e-24af-4d1a-8759-5f3206b3ff62 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:49.794112 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-91af037e-24af-4d1a-8759-5f3206b3ff62 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:49.794952 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-91af037e-24af-4d1a-8759-5f3206b3ff62 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:49.795757 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-91af037e-24af-4d1a-8759-5f3206b3ff62 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:49.800267 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0a27ffe5-47ae-4a18-a198-5ea70bb4ad53 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:49.805678 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0a27ffe5-47ae-4a18-a198-5ea70bb4ad53 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 92076abd-df0a-4c10-bbfd-e8c304633298] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:49.820620 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:25:50.235054 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-0a27ffe5-47ae-4a18-a198-5ea70bb4ad53 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:50.260134 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0a27ffe5-47ae-4a18-a198-5ea70bb4ad53 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/92076abd-df0a-4c10-bbfd-e8c304633298" status: 200 len: 1215 microversion: 2.1 time: 0.487869 Aug 31 16:25:50.275536 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2719/5471] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:49 2022] GET /compute/v2.1/servers/92076abd-df0a-4c10-bbfd-e8c304633298 => generated 1215 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:25:50.451321 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-91af037e-24af-4d1a-8759-5f3206b3ff62 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:50.471106 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-91af037e-24af-4d1a-8759-5f3206b3ff62 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1511 microversion: 2.1 time: 0.721323 Aug 31 16:25:50.475683 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2753/5472] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:49 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1511 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:25:50.685313 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e5e0ccab-d86d-4216-9766-1c596422e09b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:25:50.687339 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e5e0ccab-d86d-4216-9766-1c596422e09b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:50.716112 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e5e0ccab-d86d-4216-9766-1c596422e09b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:50.718050 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e5e0ccab-d86d-4216-9766-1c596422e09b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:50.720355 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e5e0ccab-d86d-4216-9766-1c596422e09b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:50.723142 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e5e0ccab-d86d-4216-9766-1c596422e09b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:50.725191 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e5e0ccab-d86d-4216-9766-1c596422e09b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:50.727267 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e5e0ccab-d86d-4216-9766-1c596422e09b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:50.816462 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-e5e0ccab-d86d-4216-9766-1c596422e09b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lazy-loading 'flavor' on Instance uuid 22082563-385d-41a9-baa5-6fb277278505 {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:25:50.852225 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-e5e0ccab-d86d-4216-9766-1c596422e09b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] HTTP exception thrown: Cannot 'shelve' instance 22082563-385d-41a9-baa5-6fb277278505 while it is in vm_state shelved_offloaded Aug 31 16:25:50.859783 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e5e0ccab-d86d-4216-9766-1c596422e09b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Request method failure captured: Aug 31 16:25:50.859783 n-d-850499-9 devstack@n-api.service[122256]: request: POST /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505/action HTTP/1.1 Aug 31 16:25:50.859783 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:25:50.859783 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:25:50.859783 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:25:50.859783 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 14 Aug 31 16:25:50.859783 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:25:50.859783 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:25:50.859783 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:25:50.859783 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:25:50.859783 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4q2NcJzZutw3Y6jF4GnmJD1H1MzSLIbHjRxunPVSp6uKTRmCePfT1DyksG9QgDfSYnSoM0q9vOxO3sqZKoJ5PA2HppEXRHLLn8jTh4ccTKQ6q8SYb3pqui6kOFW5_PmtYr9N0lihJC0EStA4OYRI4QsHOxwmGiiVscbhBZpLyiKmV0 Aug 31 16:25:50.859783 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:25:50.859783 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:25:50.859783 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:25:50.859783 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:25:50.859783 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:25:50.859783 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:25:50.859783 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 014522b19dc349a691e1f6b131229974 Aug 31 16:25:50.859783 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:25:50.859783 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:25:50.859783 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:25:50.859783 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/014522b19dc349a691e1f6b131229974"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/014522b19dc349a691e1f6b131229974"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_014522b19dc349a691e1f6b131229974", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/014522b19dc349a691e1f6b131229974"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:25:50.859783 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:25:50.859783 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 014522b19dc349a691e1f6b131229974 Aug 31 16:25:50.859783 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:25:50.859783 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ServersNegativeTestJSON-918151355-project Aug 31 16:25:50.859783 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:25:50.859783 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:25:50.859783 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: c042c43cc2aa4000a147fae62c261e86 Aug 31 16:25:50.859783 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ServersNegativeTestJSON-918151355-project Aug 31 16:25:50.859783 n-d-850499-9 devstack@n-api.service[122256]: Aug 31 16:25:50.859783 n-d-850499-9 devstack@n-api.service[122256]: {"shelve": {}} Aug 31 16:25:50.859783 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:25:50.859783 n-d-850499-9 devstack@n-api.service[122256]: exception: Cannot 'shelve' instance 22082563-385d-41a9-baa5-6fb277278505 while it is in vm_state shelved_offloaded Aug 31 16:25:50.859783 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '22082563-385d-41a9-baa5-6fb277278505', 'body': {'shelve': {}}} Aug 31 16:25:50.859783 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:25:50.859783 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:25:50.859783 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Aug 31 16:25:50.859783 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Aug 31 16:25:50.859783 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 31 16:25:50.859783 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 31 16:25:50.859783 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Aug 31 16:25:50.859783 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 31 16:25:50.859783 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 31 16:25:50.859783 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 31 16:25:50.859783 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 16:25:50.859783 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 16:25:50.859783 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 31 16:25:50.859783 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 31 16:25:50.859783 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 22082563-385d-41a9-baa5-6fb277278505 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Aug 31 16:25:50.859783 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:25:50.859783 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:25:50.859783 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:25:50.859783 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:25:50.859783 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:25:50.859783 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:25:50.859783 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:25:50.859783 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:25:50.859783 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:25:50.859783 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:25:50.859783 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Aug 31 16:25:50.859783 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 31 16:25:50.859783 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 31 16:25:50.859783 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 31 16:25:50.870369 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 22082563-385d-41a9-baa5-6fb277278505 while it is in vm_state shelved_offloaded Aug 31 16:25:50.870369 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:25:50.870369 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:25:50.870369 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:25:50.870369 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:25:50.870369 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:25:50.870369 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:25:50.870369 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:25:50.870369 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:25:50.870369 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 22082563-385d-41a9-baa5-6fb277278505 while it is in vm_state shelved_offloaded Aug 31 16:25:50.870369 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:25:50.877336 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e5e0ccab-d86d-4216-9766-1c596422e09b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Returning 409 to user: Cannot 'shelve' instance 22082563-385d-41a9-baa5-6fb277278505 while it is in vm_state shelved_offloaded {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:25:50.877336 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e5e0ccab-d86d-4216-9766-1c596422e09b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "POST /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505/action" status: 409 len: 155 microversion: 2.1 time: 0.198570 Aug 31 16:25:50.879572 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2720/5473] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:25:50 2022] POST /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505/action => generated 155 bytes in 202 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 31 16:25:50.896295 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-271f95ea-035f-4663-9c59-6785fbb25d72 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:25:50.897324 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-271f95ea-035f-4663-9c59-6785fbb25d72 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:50.909804 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-271f95ea-035f-4663-9c59-6785fbb25d72 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:50.910594 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-271f95ea-035f-4663-9c59-6785fbb25d72 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:50.911554 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-271f95ea-035f-4663-9c59-6785fbb25d72 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:50.912665 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-271f95ea-035f-4663-9c59-6785fbb25d72 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:50.913448 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-271f95ea-035f-4663-9c59-6785fbb25d72 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:50.914075 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-271f95ea-035f-4663-9c59-6785fbb25d72 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:51.014209 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-271f95ea-035f-4663-9c59-6785fbb25d72 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122257) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 31 16:25:51.154812 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-271f95ea-035f-4663-9c59-6785fbb25d72 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "POST /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505/action" status: 202 len: 0 microversion: 2.1 time: 0.268928 Aug 31 16:25:51.171708 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7330d822-df63-4cde-801f-64fe9348b774 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:51.173056 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7330d822-df63-4cde-801f-64fe9348b774 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:51.187704 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2754/5474] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:25:50 2022] POST /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505/action => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 16:25:51.195956 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7330d822-df63-4cde-801f-64fe9348b774 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:51.206276 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7330d822-df63-4cde-801f-64fe9348b774 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:51.208318 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7330d822-df63-4cde-801f-64fe9348b774 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:51.217635 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7330d822-df63-4cde-801f-64fe9348b774 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:51.219395 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7330d822-df63-4cde-801f-64fe9348b774 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:51.220810 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7330d822-df63-4cde-801f-64fe9348b774 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:51.306789 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2d33cdca-342d-4833-80b2-cdc00bfc905f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:51.322075 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2d33cdca-342d-4833-80b2-cdc00bfc905f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 92076abd-df0a-4c10-bbfd-e8c304633298] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:51.362611 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2d33cdca-342d-4833-80b2-cdc00bfc905f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:51.363125 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2d33cdca-342d-4833-80b2-cdc00bfc905f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:51.372559 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2d33cdca-342d-4833-80b2-cdc00bfc905f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:51.376044 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2d33cdca-342d-4833-80b2-cdc00bfc905f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:51.379851 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2d33cdca-342d-4833-80b2-cdc00bfc905f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:51.382393 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2d33cdca-342d-4833-80b2-cdc00bfc905f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:51.844383 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2d33cdca-342d-4833-80b2-cdc00bfc905f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:51.900835 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2d33cdca-342d-4833-80b2-cdc00bfc905f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/92076abd-df0a-4c10-bbfd-e8c304633298" status: 200 len: 1219 microversion: 2.1 time: 0.606150 Aug 31 16:25:51.901973 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2755/5475] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:51 2022] GET /compute/v2.1/servers/92076abd-df0a-4c10-bbfd-e8c304633298 => generated 1219 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:25:52.032720 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7330d822-df63-4cde-801f-64fe9348b774 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:52.047388 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7330d822-df63-4cde-801f-64fe9348b774 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1459 microversion: 2.1 time: 0.885243 Aug 31 16:25:52.052520 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2721/5476] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:51 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1459 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:25:52.939546 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3a71b774-5784-41ca-8d48-e5b0f4388431 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:52.941585 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3a71b774-5784-41ca-8d48-e5b0f4388431 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 92076abd-df0a-4c10-bbfd-e8c304633298] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:52.968779 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3a71b774-5784-41ca-8d48-e5b0f4388431 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:52.970293 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3a71b774-5784-41ca-8d48-e5b0f4388431 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:52.970753 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3a71b774-5784-41ca-8d48-e5b0f4388431 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:52.989440 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3a71b774-5784-41ca-8d48-e5b0f4388431 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:52.992983 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3a71b774-5784-41ca-8d48-e5b0f4388431 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:53.000981 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3a71b774-5784-41ca-8d48-e5b0f4388431 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:53.102817 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f74b3c9c-83bb-4697-b4c7-1e776c974d06 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:53.109434 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f74b3c9c-83bb-4697-b4c7-1e776c974d06 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:53.143119 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f74b3c9c-83bb-4697-b4c7-1e776c974d06 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:53.144368 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f74b3c9c-83bb-4697-b4c7-1e776c974d06 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:53.146444 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f74b3c9c-83bb-4697-b4c7-1e776c974d06 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:53.147418 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f74b3c9c-83bb-4697-b4c7-1e776c974d06 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:53.150800 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f74b3c9c-83bb-4697-b4c7-1e776c974d06 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:53.157895 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f74b3c9c-83bb-4697-b4c7-1e776c974d06 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:53.267038 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3a71b774-5784-41ca-8d48-e5b0f4388431 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:53.297202 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3a71b774-5784-41ca-8d48-e5b0f4388431 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/92076abd-df0a-4c10-bbfd-e8c304633298" status: 200 len: 1275 microversion: 2.1 time: 0.364925 Aug 31 16:25:53.300011 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2756/5477] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:52 2022] GET /compute/v2.1/servers/92076abd-df0a-4c10-bbfd-e8c304633298 => generated 1275 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:53.999978 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f74b3c9c-83bb-4697-b4c7-1e776c974d06 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:54.017130 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f74b3c9c-83bb-4697-b4c7-1e776c974d06 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1461 microversion: 2.1 time: 0.938085 Aug 31 16:25:54.023440 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2722/5478] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:53 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1461 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:25:54.344243 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b28b0a7e-938c-4162-80df-c12814bd9501 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:54.363622 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b28b0a7e-938c-4162-80df-c12814bd9501 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 92076abd-df0a-4c10-bbfd-e8c304633298] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:54.425990 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b28b0a7e-938c-4162-80df-c12814bd9501 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:54.426845 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b28b0a7e-938c-4162-80df-c12814bd9501 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:54.428119 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b28b0a7e-938c-4162-80df-c12814bd9501 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:54.429838 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b28b0a7e-938c-4162-80df-c12814bd9501 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:54.430995 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b28b0a7e-938c-4162-80df-c12814bd9501 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:54.432036 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b28b0a7e-938c-4162-80df-c12814bd9501 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:54.663159 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b28b0a7e-938c-4162-80df-c12814bd9501 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:54.678297 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b28b0a7e-938c-4162-80df-c12814bd9501 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/92076abd-df0a-4c10-bbfd-e8c304633298" status: 200 len: 1273 microversion: 2.1 time: 0.347879 Aug 31 16:25:54.678910 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2757/5479] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:54 2022] GET /compute/v2.1/servers/92076abd-df0a-4c10-bbfd-e8c304633298 => generated 1273 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:55.054030 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-94ef7a16-651c-4740-83a5-85c52f61ab02 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:55.055418 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-94ef7a16-651c-4740-83a5-85c52f61ab02 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:55.068858 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-94ef7a16-651c-4740-83a5-85c52f61ab02 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:55.074595 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-94ef7a16-651c-4740-83a5-85c52f61ab02 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:55.076213 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-94ef7a16-651c-4740-83a5-85c52f61ab02 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:55.077192 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-94ef7a16-651c-4740-83a5-85c52f61ab02 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:55.077862 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-94ef7a16-651c-4740-83a5-85c52f61ab02 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:55.078494 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-94ef7a16-651c-4740-83a5-85c52f61ab02 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:55.704964 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-96b19e75-f73d-4d3c-ba3b-be9bc05d1dde tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:55.706875 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-96b19e75-f73d-4d3c-ba3b-be9bc05d1dde tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 92076abd-df0a-4c10-bbfd-e8c304633298] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:55.723222 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-96b19e75-f73d-4d3c-ba3b-be9bc05d1dde tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:55.727335 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-96b19e75-f73d-4d3c-ba3b-be9bc05d1dde tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:55.735347 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-96b19e75-f73d-4d3c-ba3b-be9bc05d1dde tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:55.736418 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-96b19e75-f73d-4d3c-ba3b-be9bc05d1dde tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:55.736900 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-96b19e75-f73d-4d3c-ba3b-be9bc05d1dde tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:55.744207 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-96b19e75-f73d-4d3c-ba3b-be9bc05d1dde tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:55.847066 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-94ef7a16-651c-4740-83a5-85c52f61ab02 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:55.857096 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-94ef7a16-651c-4740-83a5-85c52f61ab02 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1517 microversion: 2.1 time: 0.806415 Aug 31 16:25:55.877699 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2723/5480] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:55 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1517 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:56.218092 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-96b19e75-f73d-4d3c-ba3b-be9bc05d1dde tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:56.235039 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-96b19e75-f73d-4d3c-ba3b-be9bc05d1dde tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/92076abd-df0a-4c10-bbfd-e8c304633298" status: 200 len: 1315 microversion: 2.1 time: 0.534212 Aug 31 16:25:56.243778 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2758/5481] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:55 2022] GET /compute/v2.1/servers/92076abd-df0a-4c10-bbfd-e8c304633298 => generated 1315 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:25:56.885133 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4d0a4727-368c-4bfe-8775-a746fb8a7ade tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:56.885755 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4d0a4727-368c-4bfe-8775-a746fb8a7ade tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:56.898864 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4d0a4727-368c-4bfe-8775-a746fb8a7ade tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:56.899610 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4d0a4727-368c-4bfe-8775-a746fb8a7ade tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:56.904532 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4d0a4727-368c-4bfe-8775-a746fb8a7ade tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:56.905457 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4d0a4727-368c-4bfe-8775-a746fb8a7ade tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:56.905975 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4d0a4727-368c-4bfe-8775-a746fb8a7ade tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:56.906425 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4d0a4727-368c-4bfe-8775-a746fb8a7ade tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:57.276464 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-60fbb657-acc1-4ed2-83b5-f0d2b63adee8 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:57.277445 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-60fbb657-acc1-4ed2-83b5-f0d2b63adee8 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 92076abd-df0a-4c10-bbfd-e8c304633298] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:57.351310 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-60fbb657-acc1-4ed2-83b5-f0d2b63adee8 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:57.357319 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-60fbb657-acc1-4ed2-83b5-f0d2b63adee8 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:57.358092 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-60fbb657-acc1-4ed2-83b5-f0d2b63adee8 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:57.363850 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-60fbb657-acc1-4ed2-83b5-f0d2b63adee8 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:57.368683 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-60fbb657-acc1-4ed2-83b5-f0d2b63adee8 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:57.380386 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-4d0a4727-368c-4bfe-8775-a746fb8a7ade tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:57.382347 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-60fbb657-acc1-4ed2-83b5-f0d2b63adee8 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:57.390682 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4d0a4727-368c-4bfe-8775-a746fb8a7ade tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1517 microversion: 2.1 time: 0.509487 Aug 31 16:25:57.411984 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2724/5482] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:56 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1517 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:57.643566 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-421bb916-14c7-44c8-8535-cee53efb1e30 req-f9ca2fe1-cee9-4188-bc5b-bee60ada2de6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92076abd-df0a-4c10-bbfd-e8c304633298", "tag": "1061a3fb-3b1b-4a6b-a7ca-c607c5cd782f"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:25:57.667727 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-421bb916-14c7-44c8-8535-cee53efb1e30 req-f9ca2fe1-cee9-4188-bc5b-bee60ada2de6 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:57.670554 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-421bb916-14c7-44c8-8535-cee53efb1e30 req-f9ca2fe1-cee9-4188-bc5b-bee60ada2de6 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:57.672451 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-421bb916-14c7-44c8-8535-cee53efb1e30 req-f9ca2fe1-cee9-4188-bc5b-bee60ada2de6 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:57.705365 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-421bb916-14c7-44c8-8535-cee53efb1e30 req-f9ca2fe1-cee9-4188-bc5b-bee60ada2de6 service nova] Creating event network-changed:1061a3fb-3b1b-4a6b-a7ca-c607c5cd782f for instance 92076abd-df0a-4c10-bbfd-e8c304633298 on n-h1-850499-9 Aug 31 16:25:57.721723 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-421bb916-14c7-44c8-8535-cee53efb1e30 req-f9ca2fe1-cee9-4188-bc5b-bee60ada2de6 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083986 Aug 31 16:25:57.723248 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2725/5483] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:25:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:25:58.054697 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-60fbb657-acc1-4ed2-83b5-f0d2b63adee8 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:58.065838 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-60fbb657-acc1-4ed2-83b5-f0d2b63adee8 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/92076abd-df0a-4c10-bbfd-e8c304633298" status: 200 len: 1315 microversion: 2.1 time: 0.794519 Aug 31 16:25:58.089977 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2759/5484] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:57 2022] GET /compute/v2.1/servers/92076abd-df0a-4c10-bbfd-e8c304633298 => generated 1315 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:58.435519 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-47789afd-6ab4-402d-b392-cf4d6df4129a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:58.437497 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-47789afd-6ab4-402d-b392-cf4d6df4129a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:58.479241 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:25:58.484117 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-47789afd-6ab4-402d-b392-cf4d6df4129a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:58.488414 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-47789afd-6ab4-402d-b392-cf4d6df4129a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:58.489547 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-47789afd-6ab4-402d-b392-cf4d6df4129a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:58.491948 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-47789afd-6ab4-402d-b392-cf4d6df4129a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:58.493687 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-47789afd-6ab4-402d-b392-cf4d6df4129a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:58.495736 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-47789afd-6ab4-402d-b392-cf4d6df4129a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:59.114829 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-95608ec6-560b-45e0-9390-edef8ca012ed tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:59.116172 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-95608ec6-560b-45e0-9390-edef8ca012ed tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 92076abd-df0a-4c10-bbfd-e8c304633298] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:59.152663 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-95608ec6-560b-45e0-9390-edef8ca012ed tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:59.156565 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-95608ec6-560b-45e0-9390-edef8ca012ed tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:59.157382 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-95608ec6-560b-45e0-9390-edef8ca012ed tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:59.163441 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-95608ec6-560b-45e0-9390-edef8ca012ed tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:59.164555 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-95608ec6-560b-45e0-9390-edef8ca012ed tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:59.165422 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-95608ec6-560b-45e0-9390-edef8ca012ed tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:59.204074 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-47789afd-6ab4-402d-b392-cf4d6df4129a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:59.220752 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-47789afd-6ab4-402d-b392-cf4d6df4129a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1517 microversion: 2.1 time: 0.802556 Aug 31 16:25:59.222286 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2726/5485] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:58 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1517 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:59.683017 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-95608ec6-560b-45e0-9390-edef8ca012ed tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:59.703260 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-95608ec6-560b-45e0-9390-edef8ca012ed tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/92076abd-df0a-4c10-bbfd-e8c304633298" status: 200 len: 1315 microversion: 2.1 time: 0.593565 Aug 31 16:25:59.720993 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2760/5486] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:59 2022] GET /compute/v2.1/servers/92076abd-df0a-4c10-bbfd-e8c304633298 => generated 1315 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:26:00.245998 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-25b5846e-7798-4fdf-8833-a8656ddbb5d0 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:00.248783 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-25b5846e-7798-4fdf-8833-a8656ddbb5d0 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:00.296060 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=8 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:26:00.298452 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-25b5846e-7798-4fdf-8833-a8656ddbb5d0 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:00.299043 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-25b5846e-7798-4fdf-8833-a8656ddbb5d0 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:00.306046 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-25b5846e-7798-4fdf-8833-a8656ddbb5d0 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:00.307022 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-25b5846e-7798-4fdf-8833-a8656ddbb5d0 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:00.307541 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-25b5846e-7798-4fdf-8833-a8656ddbb5d0 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:00.308005 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-25b5846e-7798-4fdf-8833-a8656ddbb5d0 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:00.703122 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-25b5846e-7798-4fdf-8833-a8656ddbb5d0 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:00.733934 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-25b5846e-7798-4fdf-8833-a8656ddbb5d0 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1517 microversion: 2.1 time: 0.493253 Aug 31 16:26:00.743951 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2727/5487] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:00 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1517 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:26:00.763717 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-bc318cb3-617c-42bb-9a7b-b89ffcfaf9da tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:00.765924 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-bc318cb3-617c-42bb-9a7b-b89ffcfaf9da tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 92076abd-df0a-4c10-bbfd-e8c304633298] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:00.777529 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bc318cb3-617c-42bb-9a7b-b89ffcfaf9da tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:00.779936 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bc318cb3-617c-42bb-9a7b-b89ffcfaf9da tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:00.781143 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bc318cb3-617c-42bb-9a7b-b89ffcfaf9da tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:00.783935 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bc318cb3-617c-42bb-9a7b-b89ffcfaf9da tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:00.786068 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bc318cb3-617c-42bb-9a7b-b89ffcfaf9da tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:00.787386 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bc318cb3-617c-42bb-9a7b-b89ffcfaf9da tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:01.111294 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-bc318cb3-617c-42bb-9a7b-b89ffcfaf9da tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:01.128469 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-bc318cb3-617c-42bb-9a7b-b89ffcfaf9da tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/92076abd-df0a-4c10-bbfd-e8c304633298" status: 200 len: 1315 microversion: 2.1 time: 0.384089 Aug 31 16:26:01.132954 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2761/5488] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:00 2022] GET /compute/v2.1/servers/92076abd-df0a-4c10-bbfd-e8c304633298 => generated 1315 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:26:01.772996 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-795a8c1c-f3a8-4dfd-be5a-437c46e6f321 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:01.773968 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-795a8c1c-f3a8-4dfd-be5a-437c46e6f321 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:01.801695 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-795a8c1c-f3a8-4dfd-be5a-437c46e6f321 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:01.810379 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-795a8c1c-f3a8-4dfd-be5a-437c46e6f321 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:01.816417 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-795a8c1c-f3a8-4dfd-be5a-437c46e6f321 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:01.818191 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-795a8c1c-f3a8-4dfd-be5a-437c46e6f321 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:01.821781 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-795a8c1c-f3a8-4dfd-be5a-437c46e6f321 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:01.822811 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-795a8c1c-f3a8-4dfd-be5a-437c46e6f321 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:02.183490 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ca4a914e-354a-4052-8e70-2d466a3af528 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:02.188682 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ca4a914e-354a-4052-8e70-2d466a3af528 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 92076abd-df0a-4c10-bbfd-e8c304633298] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:02.240193 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ca4a914e-354a-4052-8e70-2d466a3af528 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:02.241659 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ca4a914e-354a-4052-8e70-2d466a3af528 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:02.247328 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ca4a914e-354a-4052-8e70-2d466a3af528 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:02.250020 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ca4a914e-354a-4052-8e70-2d466a3af528 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:02.251287 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ca4a914e-354a-4052-8e70-2d466a3af528 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:02.252448 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ca4a914e-354a-4052-8e70-2d466a3af528 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:02.890924 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-795a8c1c-f3a8-4dfd-be5a-437c46e6f321 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:02.911063 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-795a8c1c-f3a8-4dfd-be5a-437c46e6f321 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1517 microversion: 2.1 time: 1.146582 Aug 31 16:26:02.915954 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2728/5489] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:01 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1517 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:26:03.086741 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ca4a914e-354a-4052-8e70-2d466a3af528 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:03.120975 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ca4a914e-354a-4052-8e70-2d466a3af528 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/92076abd-df0a-4c10-bbfd-e8c304633298" status: 200 len: 1315 microversion: 2.1 time: 0.945124 Aug 31 16:26:03.125828 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2762/5490] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:02 2022] GET /compute/v2.1/servers/92076abd-df0a-4c10-bbfd-e8c304633298 => generated 1315 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:26:03.962488 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a2230faf-d83b-4964-b62f-cc350e0bb5f8 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:03.964194 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a2230faf-d83b-4964-b62f-cc350e0bb5f8 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:03.991420 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a2230faf-d83b-4964-b62f-cc350e0bb5f8 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:03.997012 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a2230faf-d83b-4964-b62f-cc350e0bb5f8 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:04.002265 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a2230faf-d83b-4964-b62f-cc350e0bb5f8 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:04.009366 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a2230faf-d83b-4964-b62f-cc350e0bb5f8 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:04.010988 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a2230faf-d83b-4964-b62f-cc350e0bb5f8 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:04.017603 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a2230faf-d83b-4964-b62f-cc350e0bb5f8 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:04.169776 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-136e4201-b466-4215-bd25-73262f924a50 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:04.172126 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-136e4201-b466-4215-bd25-73262f924a50 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 92076abd-df0a-4c10-bbfd-e8c304633298] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:04.203759 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-136e4201-b466-4215-bd25-73262f924a50 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:04.209820 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-136e4201-b466-4215-bd25-73262f924a50 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:04.211067 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-136e4201-b466-4215-bd25-73262f924a50 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:04.217042 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-136e4201-b466-4215-bd25-73262f924a50 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:04.222643 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-136e4201-b466-4215-bd25-73262f924a50 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:04.224191 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-136e4201-b466-4215-bd25-73262f924a50 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:04.389469 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a2230faf-d83b-4964-b62f-cc350e0bb5f8 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:04.422665 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a2230faf-d83b-4964-b62f-cc350e0bb5f8 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1517 microversion: 2.1 time: 0.462227 Aug 31 16:26:04.425486 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2729/5491] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:03 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1517 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:26:05.233094 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-136e4201-b466-4215-bd25-73262f924a50 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:05.242562 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-136e4201-b466-4215-bd25-73262f924a50 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/92076abd-df0a-4c10-bbfd-e8c304633298" status: 200 len: 1315 microversion: 2.1 time: 1.079927 Aug 31 16:26:05.248698 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2763/5492] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:04 2022] GET /compute/v2.1/servers/92076abd-df0a-4c10-bbfd-e8c304633298 => generated 1315 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:26:05.453003 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d7aa0474-3671-4171-8ae4-befc6a7b39aa tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:05.454035 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d7aa0474-3671-4171-8ae4-befc6a7b39aa tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:05.487940 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d7aa0474-3671-4171-8ae4-befc6a7b39aa tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:05.489085 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d7aa0474-3671-4171-8ae4-befc6a7b39aa tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:05.490201 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d7aa0474-3671-4171-8ae4-befc6a7b39aa tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:05.491674 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d7aa0474-3671-4171-8ae4-befc6a7b39aa tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:05.493482 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d7aa0474-3671-4171-8ae4-befc6a7b39aa tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:05.494245 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d7aa0474-3671-4171-8ae4-befc6a7b39aa tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:06.011480 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d7aa0474-3671-4171-8ae4-befc6a7b39aa tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:06.045420 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d7aa0474-3671-4171-8ae4-befc6a7b39aa tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1517 microversion: 2.1 time: 0.593181 Aug 31 16:26:06.059529 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2730/5493] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:05 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1517 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:26:06.298592 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-fad07a1f-5347-4623-94a8-05d4bb91a5dc tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:06.301926 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-fad07a1f-5347-4623-94a8-05d4bb91a5dc tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 92076abd-df0a-4c10-bbfd-e8c304633298] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:06.351914 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fad07a1f-5347-4623-94a8-05d4bb91a5dc tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:06.363799 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fad07a1f-5347-4623-94a8-05d4bb91a5dc tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:06.364493 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fad07a1f-5347-4623-94a8-05d4bb91a5dc tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:06.365402 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fad07a1f-5347-4623-94a8-05d4bb91a5dc tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:06.373856 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fad07a1f-5347-4623-94a8-05d4bb91a5dc tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:06.375915 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fad07a1f-5347-4623-94a8-05d4bb91a5dc tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:06.747765 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-fad07a1f-5347-4623-94a8-05d4bb91a5dc tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:06.766835 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-fad07a1f-5347-4623-94a8-05d4bb91a5dc tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/92076abd-df0a-4c10-bbfd-e8c304633298" status: 200 len: 1315 microversion: 2.1 time: 0.481619 Aug 31 16:26:06.768612 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2764/5494] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:06 2022] GET /compute/v2.1/servers/92076abd-df0a-4c10-bbfd-e8c304633298 => generated 1315 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:26:07.090265 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7581d157-f3f1-41bd-92d0-e091e73c8227 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:07.097901 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7581d157-f3f1-41bd-92d0-e091e73c8227 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:07.148531 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7581d157-f3f1-41bd-92d0-e091e73c8227 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:07.149774 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7581d157-f3f1-41bd-92d0-e091e73c8227 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:07.150955 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7581d157-f3f1-41bd-92d0-e091e73c8227 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:07.155955 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7581d157-f3f1-41bd-92d0-e091e73c8227 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:07.157481 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7581d157-f3f1-41bd-92d0-e091e73c8227 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:07.160487 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7581d157-f3f1-41bd-92d0-e091e73c8227 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:07.283393 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-3af83498-cec9-4a46-9a38-37c81cc88dc6 req-ae5c63ff-df60-445a-8a96-19edfec50d19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92076abd-df0a-4c10-bbfd-e8c304633298", "name": "network-vif-plugged", "status": "completed", "tag": "1061a3fb-3b1b-4a6b-a7ca-c607c5cd782f"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:26:07.322609 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-3af83498-cec9-4a46-9a38-37c81cc88dc6 req-ae5c63ff-df60-445a-8a96-19edfec50d19 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:07.323917 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-3af83498-cec9-4a46-9a38-37c81cc88dc6 req-ae5c63ff-df60-445a-8a96-19edfec50d19 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:07.323917 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-3af83498-cec9-4a46-9a38-37c81cc88dc6 req-ae5c63ff-df60-445a-8a96-19edfec50d19 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:07.382338 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-3af83498-cec9-4a46-9a38-37c81cc88dc6 req-ae5c63ff-df60-445a-8a96-19edfec50d19 service nova] Creating event network-vif-plugged:1061a3fb-3b1b-4a6b-a7ca-c607c5cd782f for instance 92076abd-df0a-4c10-bbfd-e8c304633298 on n-h1-850499-9 Aug 31 16:26:07.402217 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-3af83498-cec9-4a46-9a38-37c81cc88dc6 req-ae5c63ff-df60-445a-8a96-19edfec50d19 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125898 Aug 31 16:26:07.403948 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2765/5495] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:26:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:26:07.796943 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-39381ff1-f269-4870-a447-4c768d524f79 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:07.797778 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-39381ff1-f269-4870-a447-4c768d524f79 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 92076abd-df0a-4c10-bbfd-e8c304633298] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:07.817636 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-39381ff1-f269-4870-a447-4c768d524f79 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:07.820610 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-39381ff1-f269-4870-a447-4c768d524f79 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:07.821179 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-39381ff1-f269-4870-a447-4c768d524f79 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:07.822910 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-39381ff1-f269-4870-a447-4c768d524f79 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:07.825878 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-39381ff1-f269-4870-a447-4c768d524f79 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:07.828652 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-39381ff1-f269-4870-a447-4c768d524f79 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:07.882154 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7581d157-f3f1-41bd-92d0-e091e73c8227 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:07.922033 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7581d157-f3f1-41bd-92d0-e091e73c8227 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1517 microversion: 2.1 time: 0.841885 Aug 31 16:26:07.979202 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2731/5496] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:07 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1517 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:26:08.444023 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-39381ff1-f269-4870-a447-4c768d524f79 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:08.480615 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-39381ff1-f269-4870-a447-4c768d524f79 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/92076abd-df0a-4c10-bbfd-e8c304633298" status: 200 len: 1315 microversion: 2.1 time: 0.688941 Aug 31 16:26:08.484092 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2766/5497] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:07 2022] GET /compute/v2.1/servers/92076abd-df0a-4c10-bbfd-e8c304633298 => generated 1315 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:26:09.004797 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9c06e6a4-5d94-4c22-a232-9305bb7886b9 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:09.007024 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9c06e6a4-5d94-4c22-a232-9305bb7886b9 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:09.034779 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9c06e6a4-5d94-4c22-a232-9305bb7886b9 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:09.035661 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9c06e6a4-5d94-4c22-a232-9305bb7886b9 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:09.042770 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9c06e6a4-5d94-4c22-a232-9305bb7886b9 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:09.044394 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9c06e6a4-5d94-4c22-a232-9305bb7886b9 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:09.045084 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9c06e6a4-5d94-4c22-a232-9305bb7886b9 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:09.045953 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9c06e6a4-5d94-4c22-a232-9305bb7886b9 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:09.494120 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-9c06e6a4-5d94-4c22-a232-9305bb7886b9 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:09.506938 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9c06e6a4-5d94-4c22-a232-9305bb7886b9 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1517 microversion: 2.1 time: 0.513733 Aug 31 16:26:09.508290 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2732/5498] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:08 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1517 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:26:09.516480 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c2e8ac16-4362-4754-8412-615fdbc4a80d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:09.520209 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c2e8ac16-4362-4754-8412-615fdbc4a80d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 92076abd-df0a-4c10-bbfd-e8c304633298] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:09.545833 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c2e8ac16-4362-4754-8412-615fdbc4a80d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:09.547590 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c2e8ac16-4362-4754-8412-615fdbc4a80d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:09.548439 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c2e8ac16-4362-4754-8412-615fdbc4a80d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:09.550878 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c2e8ac16-4362-4754-8412-615fdbc4a80d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:09.552811 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c2e8ac16-4362-4754-8412-615fdbc4a80d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:09.557033 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c2e8ac16-4362-4754-8412-615fdbc4a80d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:10.051053 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c2e8ac16-4362-4754-8412-615fdbc4a80d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:10.090198 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c2e8ac16-4362-4754-8412-615fdbc4a80d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/92076abd-df0a-4c10-bbfd-e8c304633298" status: 200 len: 1315 microversion: 2.1 time: 0.586296 Aug 31 16:26:10.112089 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2767/5499] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:09 2022] GET /compute/v2.1/servers/92076abd-df0a-4c10-bbfd-e8c304633298 => generated 1315 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:26:10.544361 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f6da644c-8d6f-4bb5-bb27-17317e546fe3 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:10.545844 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f6da644c-8d6f-4bb5-bb27-17317e546fe3 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:10.582857 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f6da644c-8d6f-4bb5-bb27-17317e546fe3 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:10.589420 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f6da644c-8d6f-4bb5-bb27-17317e546fe3 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:10.590942 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f6da644c-8d6f-4bb5-bb27-17317e546fe3 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:10.596693 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f6da644c-8d6f-4bb5-bb27-17317e546fe3 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:10.598595 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f6da644c-8d6f-4bb5-bb27-17317e546fe3 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:10.600655 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f6da644c-8d6f-4bb5-bb27-17317e546fe3 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:11.228141 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f6da644c-8d6f-4bb5-bb27-17317e546fe3 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:11.257979 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f6da644c-8d6f-4bb5-bb27-17317e546fe3 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1517 microversion: 2.1 time: 0.729621 Aug 31 16:26:11.262924 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2733/5500] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:10 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1517 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:26:11.280265 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d377e884-8b7e-4961-9852-83e477417308 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:11.286655 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d377e884-8b7e-4961-9852-83e477417308 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 92076abd-df0a-4c10-bbfd-e8c304633298] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:11.313497 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d377e884-8b7e-4961-9852-83e477417308 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:11.315754 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d377e884-8b7e-4961-9852-83e477417308 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:11.318162 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d377e884-8b7e-4961-9852-83e477417308 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:11.319012 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d377e884-8b7e-4961-9852-83e477417308 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:11.320986 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d377e884-8b7e-4961-9852-83e477417308 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:11.321983 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d377e884-8b7e-4961-9852-83e477417308 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:11.728078 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d377e884-8b7e-4961-9852-83e477417308 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:11.746005 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d377e884-8b7e-4961-9852-83e477417308 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/92076abd-df0a-4c10-bbfd-e8c304633298" status: 200 len: 1501 microversion: 2.1 time: 0.480603 Aug 31 16:26:11.761351 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2734/5501] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:11 2022] GET /compute/v2.1/servers/92076abd-df0a-4c10-bbfd-e8c304633298 => generated 1501 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:26:11.801703 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a50a1cbe-73f2-4fe2-8b85-d14400c8798f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:26:11.809131 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a50a1cbe-73f2-4fe2-8b85-d14400c8798f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 92076abd-df0a-4c10-bbfd-e8c304633298] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:11.825622 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a50a1cbe-73f2-4fe2-8b85-d14400c8798f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:11.830623 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a50a1cbe-73f2-4fe2-8b85-d14400c8798f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:11.831883 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a50a1cbe-73f2-4fe2-8b85-d14400c8798f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:11.839828 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a50a1cbe-73f2-4fe2-8b85-d14400c8798f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:11.841323 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a50a1cbe-73f2-4fe2-8b85-d14400c8798f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:11.842901 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a50a1cbe-73f2-4fe2-8b85-d14400c8798f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:11.899901 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=100 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:26:12.002369 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0d1b119c-7240-4602-924e-ac93ece73377 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:12.012415 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0d1b119c-7240-4602-924e-ac93ece73377 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:12.043629 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a50a1cbe-73f2-4fe2-8b85-d14400c8798f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "POST /compute/v2.1/servers/92076abd-df0a-4c10-bbfd-e8c304633298/action" status: 202 len: 0 microversion: 2.1 time: 0.248468 Aug 31 16:26:12.045510 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2735/5502] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:26:11 2022] POST /compute/v2.1/servers/92076abd-df0a-4c10-bbfd-e8c304633298/action => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:26:12.047832 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0d1b119c-7240-4602-924e-ac93ece73377 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:12.049676 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0d1b119c-7240-4602-924e-ac93ece73377 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:12.050520 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0d1b119c-7240-4602-924e-ac93ece73377 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:12.054941 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0d1b119c-7240-4602-924e-ac93ece73377 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:12.057217 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0d1b119c-7240-4602-924e-ac93ece73377 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:12.061252 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0d1b119c-7240-4602-924e-ac93ece73377 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:12.076679 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-feb87d47-0c72-48af-8a8a-316c71bd5177 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:12.078021 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-feb87d47-0c72-48af-8a8a-316c71bd5177 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 92076abd-df0a-4c10-bbfd-e8c304633298] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:12.095297 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-feb87d47-0c72-48af-8a8a-316c71bd5177 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:12.096970 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-feb87d47-0c72-48af-8a8a-316c71bd5177 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:12.098052 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-feb87d47-0c72-48af-8a8a-316c71bd5177 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:12.103852 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-feb87d47-0c72-48af-8a8a-316c71bd5177 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:12.105024 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-feb87d47-0c72-48af-8a8a-316c71bd5177 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:12.106364 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-feb87d47-0c72-48af-8a8a-316c71bd5177 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:12.138869 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:26:12.143119 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0d1b119c-7240-4602-924e-ac93ece73377 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5/os-volume_attachments/db18a078-30aa-45c3-bdf2-7d82a3e5c081" status: 200 len: 194 microversion: 2.20 time: 1.219793 Aug 31 16:26:12.151735 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2768/5503] 10.222.0.61 () {60 vars in 1454 bytes} [Wed Aug 31 16:26:10 2022] GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5/os-volume_attachments/db18a078-30aa-45c3-bdf2-7d82a3e5c081 => generated 194 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 16:26:12.270247 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-bf26189d-cb7f-47a2-82b0-350c7521f26c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:12.270764 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-bf26189d-cb7f-47a2-82b0-350c7521f26c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:12.338591 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bf26189d-cb7f-47a2-82b0-350c7521f26c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:12.338591 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bf26189d-cb7f-47a2-82b0-350c7521f26c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:12.338591 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bf26189d-cb7f-47a2-82b0-350c7521f26c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:12.338591 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bf26189d-cb7f-47a2-82b0-350c7521f26c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:12.338591 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bf26189d-cb7f-47a2-82b0-350c7521f26c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:12.339594 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bf26189d-cb7f-47a2-82b0-350c7521f26c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:12.585039 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-bf26189d-cb7f-47a2-82b0-350c7521f26c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lazy-loading 'services' on Instance uuid 85a0286b-2e02-4ecb-a63d-0b4a61048ab5 {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:26:12.810772 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-bf26189d-cb7f-47a2-82b0-350c7521f26c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "DELETE /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5/os-volume_attachments/db18a078-30aa-45c3-bdf2-7d82a3e5c081" status: 202 len: 0 microversion: 2.20 time: 0.544263 Aug 31 16:26:12.812957 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2769/5504] 10.222.0.61 () {60 vars in 1457 bytes} [Wed Aug 31 16:26:12 2022] DELETE /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5/os-volume_attachments/db18a078-30aa-45c3-bdf2-7d82a3e5c081 => generated 0 bytes in 549 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:26:12.821719 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ee7d7382-610e-48f6-8a2f-8e564917bd65 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:12.823207 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ee7d7382-610e-48f6-8a2f-8e564917bd65 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:12.838246 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-feb87d47-0c72-48af-8a8a-316c71bd5177 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:12.840565 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ee7d7382-610e-48f6-8a2f-8e564917bd65 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:12.841699 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ee7d7382-610e-48f6-8a2f-8e564917bd65 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:12.842419 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ee7d7382-610e-48f6-8a2f-8e564917bd65 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:12.843449 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ee7d7382-610e-48f6-8a2f-8e564917bd65 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:12.844830 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ee7d7382-610e-48f6-8a2f-8e564917bd65 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:12.845697 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ee7d7382-610e-48f6-8a2f-8e564917bd65 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:12.857821 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-feb87d47-0c72-48af-8a8a-316c71bd5177 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/92076abd-df0a-4c10-bbfd-e8c304633298" status: 200 len: 1506 microversion: 2.1 time: 0.803978 Aug 31 16:26:12.873563 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2736/5505] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:12 2022] GET /compute/v2.1/servers/92076abd-df0a-4c10-bbfd-e8c304633298 => generated 1506 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:26:12.886280 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2218addf-6353-46c9-b9ba-aa0bad11545b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:12.893041 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2218addf-6353-46c9-b9ba-aa0bad11545b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:12.904223 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2218addf-6353-46c9-b9ba-aa0bad11545b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:12.905688 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2218addf-6353-46c9-b9ba-aa0bad11545b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:12.906492 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2218addf-6353-46c9-b9ba-aa0bad11545b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:12.907597 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2218addf-6353-46c9-b9ba-aa0bad11545b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:12.908473 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2218addf-6353-46c9-b9ba-aa0bad11545b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:12.909189 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2218addf-6353-46c9-b9ba-aa0bad11545b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:12.977117 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2218addf-6353-46c9-b9ba-aa0bad11545b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.101250 Aug 31 16:26:12.978684 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2737/5506] 10.222.0.61 () {60 vars in 1343 bytes} [Wed Aug 31 16:26:12 2022] GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 16:26:13.144986 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ee7d7382-610e-48f6-8a2f-8e564917bd65 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:13.161315 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ee7d7382-610e-48f6-8a2f-8e564917bd65 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1517 microversion: 2.1 time: 0.346456 Aug 31 16:26:13.162145 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2770/5507] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:12 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1517 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:26:13.897906 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3a56dc93-4f66-4e40-9a21-1873da4c9c22 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:13.899355 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3a56dc93-4f66-4e40-9a21-1873da4c9c22 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 92076abd-df0a-4c10-bbfd-e8c304633298] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:13.910465 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3a56dc93-4f66-4e40-9a21-1873da4c9c22 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:13.911345 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3a56dc93-4f66-4e40-9a21-1873da4c9c22 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:13.912087 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3a56dc93-4f66-4e40-9a21-1873da4c9c22 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:13.913394 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3a56dc93-4f66-4e40-9a21-1873da4c9c22 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:13.914436 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3a56dc93-4f66-4e40-9a21-1873da4c9c22 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:13.915363 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3a56dc93-4f66-4e40-9a21-1873da4c9c22 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:14.005504 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3a0ce8bb-ddef-411c-813a-707ef4fa5a64 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:14.017936 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3a0ce8bb-ddef-411c-813a-707ef4fa5a64 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:14.033177 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3a0ce8bb-ddef-411c-813a-707ef4fa5a64 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:14.039730 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3a0ce8bb-ddef-411c-813a-707ef4fa5a64 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:14.040945 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3a0ce8bb-ddef-411c-813a-707ef4fa5a64 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:14.042556 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3a0ce8bb-ddef-411c-813a-707ef4fa5a64 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:14.043786 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3a0ce8bb-ddef-411c-813a-707ef4fa5a64 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:14.044689 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3a0ce8bb-ddef-411c-813a-707ef4fa5a64 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:14.136169 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3a0ce8bb-ddef-411c-813a-707ef4fa5a64 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.144511 Aug 31 16:26:14.144481 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2771/5508] 10.222.0.61 () {60 vars in 1343 bytes} [Wed Aug 31 16:26:13 2022] GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5/os-volume_attachments => generated 197 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 16:26:14.201560 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a1b74693-c019-4e3a-9ff9-a5cde43afd36 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:14.202554 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a1b74693-c019-4e3a-9ff9-a5cde43afd36 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:14.222989 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a1b74693-c019-4e3a-9ff9-a5cde43afd36 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:14.224554 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a1b74693-c019-4e3a-9ff9-a5cde43afd36 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:14.225241 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a1b74693-c019-4e3a-9ff9-a5cde43afd36 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:14.226605 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a1b74693-c019-4e3a-9ff9-a5cde43afd36 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:14.227572 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a1b74693-c019-4e3a-9ff9-a5cde43afd36 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:14.227780 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3a56dc93-4f66-4e40-9a21-1873da4c9c22 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:14.228688 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a1b74693-c019-4e3a-9ff9-a5cde43afd36 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:14.253730 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3a56dc93-4f66-4e40-9a21-1873da4c9c22 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/92076abd-df0a-4c10-bbfd-e8c304633298" status: 200 len: 1486 microversion: 2.1 time: 0.362191 Aug 31 16:26:14.254806 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2738/5509] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:13 2022] GET /compute/v2.1/servers/92076abd-df0a-4c10-bbfd-e8c304633298 => generated 1486 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:26:14.294383 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-79ec9866-53d8-4d47-b333-2ec85b5108ad tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:26:14.295301 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-79ec9866-53d8-4d47-b333-2ec85b5108ad tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 92076abd-df0a-4c10-bbfd-e8c304633298] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:14.310469 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-79ec9866-53d8-4d47-b333-2ec85b5108ad tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:14.311298 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-79ec9866-53d8-4d47-b333-2ec85b5108ad tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:14.312094 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-79ec9866-53d8-4d47-b333-2ec85b5108ad tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:14.313354 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-79ec9866-53d8-4d47-b333-2ec85b5108ad tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:14.314168 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-79ec9866-53d8-4d47-b333-2ec85b5108ad tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:14.314929 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-79ec9866-53d8-4d47-b333-2ec85b5108ad tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:14.368428 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-79ec9866-53d8-4d47-b333-2ec85b5108ad tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lazy-loading 'flavor' on Instance uuid 92076abd-df0a-4c10-bbfd-e8c304633298 {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:26:14.582375 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a1b74693-c019-4e3a-9ff9-a5cde43afd36 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:14.614043 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a1b74693-c019-4e3a-9ff9-a5cde43afd36 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1517 microversion: 2.1 time: 0.419366 Aug 31 16:26:14.614923 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2772/5510] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:14 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1517 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:26:14.838666 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-79ec9866-53d8-4d47-b333-2ec85b5108ad tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "POST /compute/v2.1/servers/92076abd-df0a-4c10-bbfd-e8c304633298/action" status: 202 len: 0 microversion: 2.1 time: 0.547902 Aug 31 16:26:14.842367 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2739/5511] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:26:14 2022] POST /compute/v2.1/servers/92076abd-df0a-4c10-bbfd-e8c304633298/action => generated 0 bytes in 556 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 16:26:14.855157 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-80743aca-0ce1-454a-8ec3-aa116849814f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:14.856326 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-80743aca-0ce1-454a-8ec3-aa116849814f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 92076abd-df0a-4c10-bbfd-e8c304633298] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:14.870739 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-80743aca-0ce1-454a-8ec3-aa116849814f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:14.873811 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-80743aca-0ce1-454a-8ec3-aa116849814f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:14.875196 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-80743aca-0ce1-454a-8ec3-aa116849814f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:14.876575 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-80743aca-0ce1-454a-8ec3-aa116849814f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:14.878661 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-80743aca-0ce1-454a-8ec3-aa116849814f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:14.880293 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-80743aca-0ce1-454a-8ec3-aa116849814f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:15.153450 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-bb056a4c-7393-4796-823e-283059b3d971 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:15.156025 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-bb056a4c-7393-4796-823e-283059b3d971 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:15.174741 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bb056a4c-7393-4796-823e-283059b3d971 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:15.174741 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bb056a4c-7393-4796-823e-283059b3d971 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:15.175139 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bb056a4c-7393-4796-823e-283059b3d971 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:15.175760 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bb056a4c-7393-4796-823e-283059b3d971 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:15.176228 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bb056a4c-7393-4796-823e-283059b3d971 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:15.176668 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bb056a4c-7393-4796-823e-283059b3d971 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:15.179713 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-80743aca-0ce1-454a-8ec3-aa116849814f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:15.195489 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-80743aca-0ce1-454a-8ec3-aa116849814f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/92076abd-df0a-4c10-bbfd-e8c304633298" status: 200 len: 1492 microversion: 2.1 time: 0.348165 Aug 31 16:26:15.197586 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2773/5512] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:14 2022] GET /compute/v2.1/servers/92076abd-df0a-4c10-bbfd-e8c304633298 => generated 1492 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:26:15.225060 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-bb056a4c-7393-4796-823e-283059b3d971 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.076811 Aug 31 16:26:15.229990 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2740/5513] 10.222.0.61 () {60 vars in 1343 bytes} [Wed Aug 31 16:26:15 2022] GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 16:26:15.647984 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c98bfafa-5d00-4c36-be8e-de622d1e1d87 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:15.648674 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c98bfafa-5d00-4c36-be8e-de622d1e1d87 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:15.653727 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ff9740f8-c47e-477b-94dd-ad5172251c75 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:15.655154 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ff9740f8-c47e-477b-94dd-ad5172251c75 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: b92e2d45-4596-4f2b-8a5c-8fd5f0084630] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:15.663293 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c98bfafa-5d00-4c36-be8e-de622d1e1d87 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:15.663846 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c98bfafa-5d00-4c36-be8e-de622d1e1d87 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:15.666766 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c98bfafa-5d00-4c36-be8e-de622d1e1d87 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:15.667734 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c98bfafa-5d00-4c36-be8e-de622d1e1d87 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:15.669088 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c98bfafa-5d00-4c36-be8e-de622d1e1d87 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:15.669903 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c98bfafa-5d00-4c36-be8e-de622d1e1d87 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:15.676101 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ff9740f8-c47e-477b-94dd-ad5172251c75 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:15.676695 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ff9740f8-c47e-477b-94dd-ad5172251c75 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:15.677228 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ff9740f8-c47e-477b-94dd-ad5172251c75 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:15.678105 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ff9740f8-c47e-477b-94dd-ad5172251c75 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:15.678652 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ff9740f8-c47e-477b-94dd-ad5172251c75 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:15.679245 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ff9740f8-c47e-477b-94dd-ad5172251c75 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:15.740538 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ff9740f8-c47e-477b-94dd-ad5172251c75 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/b92e2d45-4596-4f2b-8a5c-8fd5f0084630/ips" status: 200 len: 150 microversion: 2.1 time: 0.100650 Aug 31 16:26:15.742528 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2774/5514] 10.222.0.61 () {58 vars in 1248 bytes} [Wed Aug 31 16:26:15 2022] GET /compute/v2.1/servers/b92e2d45-4596-4f2b-8a5c-8fd5f0084630/ips => generated 150 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:26:15.763853 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a71a6dca-a946-4e1f-aa4f-bdffb1ba2280 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5552f8fd-f71f-4429-a5c2-8f7fd2fcde72"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:26:15.767300 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a71a6dca-a946-4e1f-aa4f-bdffb1ba2280 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: b92e2d45-4596-4f2b-8a5c-8fd5f0084630] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:15.777805 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a71a6dca-a946-4e1f-aa4f-bdffb1ba2280 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:15.779481 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a71a6dca-a946-4e1f-aa4f-bdffb1ba2280 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:15.780518 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a71a6dca-a946-4e1f-aa4f-bdffb1ba2280 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:15.781990 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a71a6dca-a946-4e1f-aa4f-bdffb1ba2280 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:15.783123 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a71a6dca-a946-4e1f-aa4f-bdffb1ba2280 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:15.786709 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a71a6dca-a946-4e1f-aa4f-bdffb1ba2280 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:15.927535 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c98bfafa-5d00-4c36-be8e-de622d1e1d87 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:15.931560 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-a71a6dca-a946-4e1f-aa4f-bdffb1ba2280 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] HTTP exception thrown: Invalid volume: volume 5552f8fd-f71f-4429-a5c2-8f7fd2fcde72 is already attached to instances: 6e139adf-20d3-4d88-941f-fe9a45276ad5 Aug 31 16:26:15.933340 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a71a6dca-a946-4e1f-aa4f-bdffb1ba2280 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Request method failure captured: Aug 31 16:26:15.933340 n-d-850499-9 devstack@n-api.service[122257]: request: POST /compute/v2.1/servers/b92e2d45-4596-4f2b-8a5c-8fd5f0084630/os-volume_attachments HTTP/1.1 Aug 31 16:26:15.933340 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:26:15.933340 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:26:15.933340 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:26:15.933340 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 74 Aug 31 16:26:15.933340 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:26:15.933340 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:26:15.933340 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:26:15.933340 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:26:15.933340 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4rNdtL8Hp93envnJYgxrkKzEuKKLro2yD65tuaCjxV170sTEb0vV7K7CSwqb17J41LEaCf2veX7M0gQMtVuIZTkoy1EqZ7hcQ7-sxxS5qnxJzqp8zg_d5_eF53mYW1SiUWmb2sxTco76Ig5gniRxyga2-esulxOQeqjncU6078g4lk Aug 31 16:26:15.933340 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:26:15.933340 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:26:15.933340 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:26:15.933340 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:26:15.933340 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:26:15.933340 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:26:15.933340 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 79d9ba3589a24faaac930a35742ce834 Aug 31 16:26:15.933340 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-AttachVolumeNegativeTest-1703723156 Aug 31 16:26:15.933340 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:26:15.933340 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:26:15.933340 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/79d9ba3589a24faaac930a35742ce834"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/79d9ba3589a24faaac930a35742ce834"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_79d9ba3589a24faaac930a35742ce834", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/79d9ba3589a24faaac930a35742ce834"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:26:15.933340 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-AttachVolumeNegativeTest-1703723156 Aug 31 16:26:15.933340 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 79d9ba3589a24faaac930a35742ce834 Aug 31 16:26:15.933340 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1703723156 Aug 31 16:26:15.933340 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-AttachVolumeNegativeTest-1703723156-project Aug 31 16:26:15.933340 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:26:15.933340 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:26:15.933340 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 133363b2b12d4730994557ee24f08879 Aug 31 16:26:15.933340 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-AttachVolumeNegativeTest-1703723156-project Aug 31 16:26:15.933340 n-d-850499-9 devstack@n-api.service[122257]: Aug 31 16:26:15.933340 n-d-850499-9 devstack@n-api.service[122257]: {"volumeAttachment": {"volumeId": "5552f8fd-f71f-4429-a5c2-8f7fd2fcde72"}} Aug 31 16:26:15.933340 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:26:15.933340 n-d-850499-9 devstack@n-api.service[122257]: exception: Invalid volume: volume 5552f8fd-f71f-4429-a5c2-8f7fd2fcde72 is already attached to instances: 6e139adf-20d3-4d88-941f-fe9a45276ad5 Aug 31 16:26:15.933340 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'server_id': 'b92e2d45-4596-4f2b-8a5c-8fd5f0084630', 'body': {'volumeAttachment': {'volumeId': '5552f8fd-f71f-4429-a5c2-8f7fd2fcde72'}}} Aug 31 16:26:15.933340 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:26:15.933340 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:26:15.933340 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 31 16:26:15.933340 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 31 16:26:15.933340 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 16:26:15.933340 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 16:26:15.933340 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 31 16:26:15.933340 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 31 16:26:15.933340 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 31 16:26:15.933340 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 31 16:26:15.933340 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 31 16:26:15.933340 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 31 16:26:15.933340 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 5552f8fd-f71f-4429-a5c2-8f7fd2fcde72 is already attached to instances: 6e139adf-20d3-4d88-941f-fe9a45276ad5 Aug 31 16:26:15.933340 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:26:15.933340 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:26:15.933340 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:26:15.933340 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:26:15.933340 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:26:15.933340 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:26:15.933340 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:26:15.933340 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:26:15.933340 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:26:15.933340 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:26:15.933340 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:26:15.933340 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:26:15.933340 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:26:15.933340 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:26:15.939682 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:26:15.939682 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:26:15.939682 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 31 16:26:15.939682 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 31 16:26:15.939682 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 5552f8fd-f71f-4429-a5c2-8f7fd2fcde72 is already attached to instances: 6e139adf-20d3-4d88-941f-fe9a45276ad5 Aug 31 16:26:15.939682 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:26:15.939682 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:26:15.939682 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:26:15.939682 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:26:15.939682 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:26:15.939682 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:26:15.939682 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:26:15.939682 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:26:15.939682 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 5552f8fd-f71f-4429-a5c2-8f7fd2fcde72 is already attached to instances: 6e139adf-20d3-4d88-941f-fe9a45276ad5 Aug 31 16:26:15.939682 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:26:15.943946 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c98bfafa-5d00-4c36-be8e-de622d1e1d87 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1517 microversion: 2.1 time: 0.298435 Aug 31 16:26:15.944231 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a71a6dca-a946-4e1f-aa4f-bdffb1ba2280 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Returning 400 to user: Invalid volume: volume 5552f8fd-f71f-4429-a5c2-8f7fd2fcde72 is already attached to instances: 6e139adf-20d3-4d88-941f-fe9a45276ad5 {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:26:15.944736 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a71a6dca-a946-4e1f-aa4f-bdffb1ba2280 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "POST /compute/v2.1/servers/b92e2d45-4596-4f2b-8a5c-8fd5f0084630/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.192754 Aug 31 16:26:15.945810 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2775/5515] 10.222.0.61 () {60 vars in 1323 bytes} [Wed Aug 31 16:26:15 2022] POST /compute/v2.1/servers/b92e2d45-4596-4f2b-8a5c-8fd5f0084630/os-volume_attachments => generated 174 bytes in 195 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 31 16:26:15.956063 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2741/5516] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:15 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1517 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:26:15.957779 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-051cf4f3-81dd-4972-ad23-9364e505171b tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:15.958500 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-051cf4f3-81dd-4972-ad23-9364e505171b tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: b92e2d45-4596-4f2b-8a5c-8fd5f0084630] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:15.972194 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-051cf4f3-81dd-4972-ad23-9364e505171b tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:15.972949 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-051cf4f3-81dd-4972-ad23-9364e505171b tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:15.973618 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-051cf4f3-81dd-4972-ad23-9364e505171b tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:15.974686 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-051cf4f3-81dd-4972-ad23-9364e505171b tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:15.975491 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-051cf4f3-81dd-4972-ad23-9364e505171b tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:15.976038 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-051cf4f3-81dd-4972-ad23-9364e505171b tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:16.009799 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-051cf4f3-81dd-4972-ad23-9364e505171b tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: b92e2d45-4596-4f2b-8a5c-8fd5f0084630] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:26:16.148581 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-051cf4f3-81dd-4972-ad23-9364e505171b tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "DELETE /compute/v2.1/servers/b92e2d45-4596-4f2b-8a5c-8fd5f0084630" status: 204 len: 0 microversion: 2.1 time: 0.195093 Aug 31 16:26:16.150306 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2776/5517] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:26:15 2022] DELETE /compute/v2.1/servers/b92e2d45-4596-4f2b-8a5c-8fd5f0084630 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 16:26:16.164209 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-586d5f24-6652-405d-9395-901da7111706 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:16.166389 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-586d5f24-6652-405d-9395-901da7111706 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: b92e2d45-4596-4f2b-8a5c-8fd5f0084630] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:16.176578 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-586d5f24-6652-405d-9395-901da7111706 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:16.177322 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-586d5f24-6652-405d-9395-901da7111706 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:16.177982 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-586d5f24-6652-405d-9395-901da7111706 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:16.179247 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-586d5f24-6652-405d-9395-901da7111706 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:16.180326 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-586d5f24-6652-405d-9395-901da7111706 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:16.181181 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-586d5f24-6652-405d-9395-901da7111706 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:16.224021 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9a0c37b0-1f6b-439b-8c07-3d36a145db4a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:16.238302 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9a0c37b0-1f6b-439b-8c07-3d36a145db4a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 92076abd-df0a-4c10-bbfd-e8c304633298] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:16.256704 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9a0c37b0-1f6b-439b-8c07-3d36a145db4a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:16.259368 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9a0c37b0-1f6b-439b-8c07-3d36a145db4a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:16.259889 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9a0c37b0-1f6b-439b-8c07-3d36a145db4a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:16.260737 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9a0c37b0-1f6b-439b-8c07-3d36a145db4a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:16.262468 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9a0c37b0-1f6b-439b-8c07-3d36a145db4a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:16.262928 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9a0c37b0-1f6b-439b-8c07-3d36a145db4a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:17.424095 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-586d5f24-6652-405d-9395-901da7111706 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133363b2b12d4730994557ee24f08879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d9ba3589a24faaac930a35742ce834', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:17.444493 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-586d5f24-6652-405d-9395-901da7111706 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/b92e2d45-4596-4f2b-8a5c-8fd5f0084630" status: 200 len: 1680 microversion: 2.1 time: 1.288666 Aug 31 16:26:17.460474 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2742/5518] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:16 2022] GET /compute/v2.1/servers/b92e2d45-4596-4f2b-8a5c-8fd5f0084630 => generated 1680 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:26:17.479212 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7bc2aac0-4680-47b5-8d3e-5d6516defb04 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:17.483275 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7bc2aac0-4680-47b5-8d3e-5d6516defb04 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:17.491037 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7bc2aac0-4680-47b5-8d3e-5d6516defb04 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:17.491920 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7bc2aac0-4680-47b5-8d3e-5d6516defb04 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:17.492546 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7bc2aac0-4680-47b5-8d3e-5d6516defb04 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:17.492843 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9a0c37b0-1f6b-439b-8c07-3d36a145db4a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:17.494167 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7bc2aac0-4680-47b5-8d3e-5d6516defb04 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:17.494883 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7bc2aac0-4680-47b5-8d3e-5d6516defb04 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:17.495615 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7bc2aac0-4680-47b5-8d3e-5d6516defb04 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:17.515876 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9a0c37b0-1f6b-439b-8c07-3d36a145db4a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/92076abd-df0a-4c10-bbfd-e8c304633298" status: 200 len: 1492 microversion: 2.1 time: 1.300420 Aug 31 16:26:17.534305 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2777/5519] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:16 2022] GET /compute/v2.1/servers/92076abd-df0a-4c10-bbfd-e8c304633298 => generated 1492 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:26:17.542309 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ce62b4af-0115-4837-90f3-a6df5a7324d5 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:17.544413 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ce62b4af-0115-4837-90f3-a6df5a7324d5 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:17.562009 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7bc2aac0-4680-47b5-8d3e-5d6516defb04 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.099698 Aug 31 16:26:17.562873 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ce62b4af-0115-4837-90f3-a6df5a7324d5 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:17.563138 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2743/5520] 10.222.0.61 () {60 vars in 1343 bytes} [Wed Aug 31 16:26:17 2022] GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 16:26:17.572730 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ce62b4af-0115-4837-90f3-a6df5a7324d5 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:17.575436 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ce62b4af-0115-4837-90f3-a6df5a7324d5 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:17.577396 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ce62b4af-0115-4837-90f3-a6df5a7324d5 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:17.578385 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ce62b4af-0115-4837-90f3-a6df5a7324d5 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:17.578923 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ce62b4af-0115-4837-90f3-a6df5a7324d5 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:17.879309 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ce62b4af-0115-4837-90f3-a6df5a7324d5 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:17.897742 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ce62b4af-0115-4837-90f3-a6df5a7324d5 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1517 microversion: 2.1 time: 0.362022 Aug 31 16:26:17.912840 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2778/5521] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:17 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1517 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:26:18.495656 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6313f049-862c-44d2-b295-1b1d25837205 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:18.500076 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6313f049-862c-44d2-b295-1b1d25837205 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: b92e2d45-4596-4f2b-8a5c-8fd5f0084630] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:18.531153 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6313f049-862c-44d2-b295-1b1d25837205 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:18.532252 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6313f049-862c-44d2-b295-1b1d25837205 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:18.535656 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6313f049-862c-44d2-b295-1b1d25837205 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:18.537202 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6313f049-862c-44d2-b295-1b1d25837205 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:18.538197 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6313f049-862c-44d2-b295-1b1d25837205 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:18.539018 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6313f049-862c-44d2-b295-1b1d25837205 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:18.542442 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8c5c19ee-1eb7-4f80-88cf-5ea5c10671b7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:18.543932 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8c5c19ee-1eb7-4f80-88cf-5ea5c10671b7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 92076abd-df0a-4c10-bbfd-e8c304633298] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:18.569804 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8c5c19ee-1eb7-4f80-88cf-5ea5c10671b7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:18.570886 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8c5c19ee-1eb7-4f80-88cf-5ea5c10671b7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:18.576996 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8c5c19ee-1eb7-4f80-88cf-5ea5c10671b7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:18.578624 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8c5c19ee-1eb7-4f80-88cf-5ea5c10671b7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:18.583384 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8c5c19ee-1eb7-4f80-88cf-5ea5c10671b7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:18.587372 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8c5c19ee-1eb7-4f80-88cf-5ea5c10671b7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:19.156304 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-6313f049-862c-44d2-b295-1b1d25837205 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133363b2b12d4730994557ee24f08879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d9ba3589a24faaac930a35742ce834', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:19.180310 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6313f049-862c-44d2-b295-1b1d25837205 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/b92e2d45-4596-4f2b-8a5c-8fd5f0084630" status: 200 len: 1680 microversion: 2.1 time: 0.704089 Aug 31 16:26:19.190183 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2744/5522] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:18 2022] GET /compute/v2.1/servers/b92e2d45-4596-4f2b-8a5c-8fd5f0084630 => generated 1680 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:26:19.196525 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8c5c19ee-1eb7-4f80-88cf-5ea5c10671b7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:19.206057 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-77ab879f-f8fe-479c-a50f-234aa5e38169 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:19.212857 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-77ab879f-f8fe-479c-a50f-234aa5e38169 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:19.215823 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8c5c19ee-1eb7-4f80-88cf-5ea5c10671b7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/92076abd-df0a-4c10-bbfd-e8c304633298" status: 200 len: 1513 microversion: 2.1 time: 0.678012 Aug 31 16:26:19.225782 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-77ab879f-f8fe-479c-a50f-234aa5e38169 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:19.227212 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-77ab879f-f8fe-479c-a50f-234aa5e38169 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:19.228267 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-77ab879f-f8fe-479c-a50f-234aa5e38169 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:19.229269 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2779/5523] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:18 2022] GET /compute/v2.1/servers/92076abd-df0a-4c10-bbfd-e8c304633298 => generated 1513 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:26:19.230727 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-77ab879f-f8fe-479c-a50f-234aa5e38169 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:19.232047 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-77ab879f-f8fe-479c-a50f-234aa5e38169 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:19.233053 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-77ab879f-f8fe-479c-a50f-234aa5e38169 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:19.236487 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-20b83966-3b97-4d05-ae91-3b7a88cb8e5b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:19.237137 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-20b83966-3b97-4d05-ae91-3b7a88cb8e5b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:19.265317 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-20b83966-3b97-4d05-ae91-3b7a88cb8e5b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:19.281144 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-20b83966-3b97-4d05-ae91-3b7a88cb8e5b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:19.281622 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-20b83966-3b97-4d05-ae91-3b7a88cb8e5b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:19.282395 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-20b83966-3b97-4d05-ae91-3b7a88cb8e5b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:19.282881 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-20b83966-3b97-4d05-ae91-3b7a88cb8e5b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:19.283323 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-20b83966-3b97-4d05-ae91-3b7a88cb8e5b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:19.293499 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-77ab879f-f8fe-479c-a50f-234aa5e38169 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.101310 Aug 31 16:26:19.295368 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2745/5524] 10.222.0.61 () {60 vars in 1343 bytes} [Wed Aug 31 16:26:19 2022] GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 16:26:19.301203 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-99338900-adb3-4785-b76b-5f6da94f20fc req-5a767e33-0b03-45c6-8e00-2558d6f78b3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92076abd-df0a-4c10-bbfd-e8c304633298", "name": "network-vif-plugged", "status": "completed", "tag": "1061a3fb-3b1b-4a6b-a7ca-c607c5cd782f"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:26:19.314275 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-99338900-adb3-4785-b76b-5f6da94f20fc req-5a767e33-0b03-45c6-8e00-2558d6f78b3b service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:19.315103 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-99338900-adb3-4785-b76b-5f6da94f20fc req-5a767e33-0b03-45c6-8e00-2558d6f78b3b service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:19.315816 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-99338900-adb3-4785-b76b-5f6da94f20fc req-5a767e33-0b03-45c6-8e00-2558d6f78b3b service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:19.334662 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-99338900-adb3-4785-b76b-5f6da94f20fc req-5a767e33-0b03-45c6-8e00-2558d6f78b3b service nova] Creating event network-vif-plugged:1061a3fb-3b1b-4a6b-a7ca-c607c5cd782f for instance 92076abd-df0a-4c10-bbfd-e8c304633298 on n-h1-850499-9 Aug 31 16:26:19.345426 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-99338900-adb3-4785-b76b-5f6da94f20fc req-5a767e33-0b03-45c6-8e00-2558d6f78b3b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048347 Aug 31 16:26:19.346642 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2746/5525] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:26:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:26:19.747642 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-20b83966-3b97-4d05-ae91-3b7a88cb8e5b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:19.780306 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-20b83966-3b97-4d05-ae91-3b7a88cb8e5b tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1517 microversion: 2.1 time: 0.545544 Aug 31 16:26:19.783864 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2780/5526] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:19 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1517 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:26:20.176879 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-897ee80e-2240-45b5-a9f4-b9fbfd436c1a req-1c289681-d792-40b4-a691-88bf06b684f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b92e2d45-4596-4f2b-8a5c-8fd5f0084630", "name": "network-vif-deleted", "tag": "b35ba8d8-fd10-45c4-89d9-1e04f3301266"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:26:20.225973 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8b6c9a19-785f-4271-9e73-6273f7f37be7 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:20.227268 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8b6c9a19-785f-4271-9e73-6273f7f37be7 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: b92e2d45-4596-4f2b-8a5c-8fd5f0084630] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:20.232819 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=58 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:26:20.235632 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:26:20.247771 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-897ee80e-2240-45b5-a9f4-b9fbfd436c1a req-1c289681-d792-40b4-a691-88bf06b684f8 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:20.248894 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-897ee80e-2240-45b5-a9f4-b9fbfd436c1a req-1c289681-d792-40b4-a691-88bf06b684f8 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:20.250305 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-897ee80e-2240-45b5-a9f4-b9fbfd436c1a req-1c289681-d792-40b4-a691-88bf06b684f8 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:20.278429 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b6c9a19-785f-4271-9e73-6273f7f37be7 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:20.278966 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b6c9a19-785f-4271-9e73-6273f7f37be7 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:20.279426 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b6c9a19-785f-4271-9e73-6273f7f37be7 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:20.280241 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b6c9a19-785f-4271-9e73-6273f7f37be7 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:20.282668 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b6c9a19-785f-4271-9e73-6273f7f37be7 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:20.283112 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b6c9a19-785f-4271-9e73-6273f7f37be7 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:20.367533 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-897ee80e-2240-45b5-a9f4-b9fbfd436c1a req-1c289681-d792-40b4-a691-88bf06b684f8 service nova] Creating event network-vif-deleted:b35ba8d8-fd10-45c4-89d9-1e04f3301266 for instance b92e2d45-4596-4f2b-8a5c-8fd5f0084630 on n-h1-850499-9 Aug 31 16:26:20.404638 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-897ee80e-2240-45b5-a9f4-b9fbfd436c1a req-1c289681-d792-40b4-a691-88bf06b684f8 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.243994 Aug 31 16:26:20.404638 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2747/5527] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:26:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:26:20.412491 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-582a6f01-4019-45e9-acc6-62410a571de4 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:20.413260 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-582a6f01-4019-45e9-acc6-62410a571de4 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 92076abd-df0a-4c10-bbfd-e8c304633298] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:20.429339 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b6c9a19-785f-4271-9e73-6273f7f37be7 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:20.430982 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b6c9a19-785f-4271-9e73-6273f7f37be7 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:20.432616 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b6c9a19-785f-4271-9e73-6273f7f37be7 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:20.434027 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-8b6c9a19-785f-4271-9e73-6273f7f37be7 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lazy-loading 'fault' on Instance uuid b92e2d45-4596-4f2b-8a5c-8fd5f0084630 {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:26:20.440205 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-582a6f01-4019-45e9-acc6-62410a571de4 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:20.440787 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-582a6f01-4019-45e9-acc6-62410a571de4 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:20.441258 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-582a6f01-4019-45e9-acc6-62410a571de4 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:20.442020 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-582a6f01-4019-45e9-acc6-62410a571de4 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:20.442495 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-582a6f01-4019-45e9-acc6-62410a571de4 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:20.442940 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-582a6f01-4019-45e9-acc6-62410a571de4 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:20.571866 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8b6c9a19-785f-4271-9e73-6273f7f37be7 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133363b2b12d4730994557ee24f08879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d9ba3589a24faaac930a35742ce834', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:20.589679 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8b6c9a19-785f-4271-9e73-6273f7f37be7 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/b92e2d45-4596-4f2b-8a5c-8fd5f0084630" status: 200 len: 1330 microversion: 2.1 time: 0.367483 Aug 31 16:26:20.592845 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2781/5528] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:20 2022] GET /compute/v2.1/servers/b92e2d45-4596-4f2b-8a5c-8fd5f0084630 => generated 1330 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:26:20.608620 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c872f4ea-ad17-4ebc-a5f1-0fffa02e0e5e tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:20.621488 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c872f4ea-ad17-4ebc-a5f1-0fffa02e0e5e tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:20.630447 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c872f4ea-ad17-4ebc-a5f1-0fffa02e0e5e tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:20.632078 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c872f4ea-ad17-4ebc-a5f1-0fffa02e0e5e tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:20.633697 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c872f4ea-ad17-4ebc-a5f1-0fffa02e0e5e tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:20.636135 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c872f4ea-ad17-4ebc-a5f1-0fffa02e0e5e tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:20.638078 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c872f4ea-ad17-4ebc-a5f1-0fffa02e0e5e tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:20.642552 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c872f4ea-ad17-4ebc-a5f1-0fffa02e0e5e tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:20.749775 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c872f4ea-ad17-4ebc-a5f1-0fffa02e0e5e tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.155270 Aug 31 16:26:20.750947 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2782/5529] 10.222.0.61 () {60 vars in 1343 bytes} [Wed Aug 31 16:26:20 2022] GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5/os-volume_attachments => generated 197 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 16:26:20.832596 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-de8439b4-27ac-4639-bfae-e5fa4974092f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:20.840662 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-de8439b4-27ac-4639-bfae-e5fa4974092f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:20.926726 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-de8439b4-27ac-4639-bfae-e5fa4974092f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:20.927866 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-de8439b4-27ac-4639-bfae-e5fa4974092f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:20.929005 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-de8439b4-27ac-4639-bfae-e5fa4974092f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:20.930604 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-de8439b4-27ac-4639-bfae-e5fa4974092f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:20.931773 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-de8439b4-27ac-4639-bfae-e5fa4974092f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:20.932775 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-de8439b4-27ac-4639-bfae-e5fa4974092f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:21.030902 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:26:21.331718 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-582a6f01-4019-45e9-acc6-62410a571de4 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:21.400167 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-582a6f01-4019-45e9-acc6-62410a571de4 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/92076abd-df0a-4c10-bbfd-e8c304633298" status: 200 len: 1513 microversion: 2.1 time: 0.995454 Aug 31 16:26:21.401145 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2748/5530] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:20 2022] GET /compute/v2.1/servers/92076abd-df0a-4c10-bbfd-e8c304633298 => generated 1513 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:26:21.626440 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e441e2f1-c864-4190-bc85-efe2edcb97bd tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:21.627609 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e441e2f1-c864-4190-bc85-efe2edcb97bd tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: b92e2d45-4596-4f2b-8a5c-8fd5f0084630] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:21.660239 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e441e2f1-c864-4190-bc85-efe2edcb97bd tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:21.666213 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e441e2f1-c864-4190-bc85-efe2edcb97bd tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:21.673547 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e441e2f1-c864-4190-bc85-efe2edcb97bd tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:21.676852 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e441e2f1-c864-4190-bc85-efe2edcb97bd tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:21.677974 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e441e2f1-c864-4190-bc85-efe2edcb97bd tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:21.678539 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e441e2f1-c864-4190-bc85-efe2edcb97bd tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:21.750655 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-e441e2f1-c864-4190-bc85-efe2edcb97bd tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] HTTP exception thrown: Instance b92e2d45-4596-4f2b-8a5c-8fd5f0084630 could not be found. Aug 31 16:26:21.758327 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e441e2f1-c864-4190-bc85-efe2edcb97bd tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Request method failure captured: Aug 31 16:26:21.758327 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/b92e2d45-4596-4f2b-8a5c-8fd5f0084630 HTTP/1.1 Aug 31 16:26:21.758327 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:26:21.758327 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:26:21.758327 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:26:21.758327 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:26:21.758327 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:26:21.758327 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:26:21.758327 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:26:21.758327 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:26:21.758327 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4rNdtL8Hp93envnJYgxrkKzEuKKLro2yD65tuaCjxV170sTEb0vV7K7CSwqb17J41LEaCf2veX7M0gQMtVuIZTkoy1EqZ7hcQ7-sxxS5qnxJzqp8zg_d5_eF53mYW1SiUWmb2sxTco76Ig5gniRxyga2-esulxOQeqjncU6078g4lk Aug 31 16:26:21.758327 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:26:21.758327 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:26:21.758327 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:26:21.758327 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:26:21.758327 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:26:21.758327 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:26:21.758327 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 79d9ba3589a24faaac930a35742ce834 Aug 31 16:26:21.758327 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-AttachVolumeNegativeTest-1703723156 Aug 31 16:26:21.758327 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:26:21.758327 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:26:21.758327 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/79d9ba3589a24faaac930a35742ce834"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/79d9ba3589a24faaac930a35742ce834"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_79d9ba3589a24faaac930a35742ce834", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/79d9ba3589a24faaac930a35742ce834"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:26:21.758327 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-AttachVolumeNegativeTest-1703723156 Aug 31 16:26:21.758327 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 79d9ba3589a24faaac930a35742ce834 Aug 31 16:26:21.758327 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1703723156 Aug 31 16:26:21.758327 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-AttachVolumeNegativeTest-1703723156-project Aug 31 16:26:21.758327 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:26:21.758327 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:26:21.758327 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 133363b2b12d4730994557ee24f08879 Aug 31 16:26:21.758327 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-AttachVolumeNegativeTest-1703723156-project Aug 31 16:26:21.758327 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:26:21.758327 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance b92e2d45-4596-4f2b-8a5c-8fd5f0084630 could not be found. Aug 31 16:26:21.758327 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': 'b92e2d45-4596-4f2b-8a5c-8fd5f0084630'} Aug 31 16:26:21.758327 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:26:21.758327 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:26:21.758327 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:26:21.758327 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:26:21.758327 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:26:21.758327 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:26:21.758327 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:26:21.758327 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:26:21.758327 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:26:21.758327 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:26:21.758327 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b92e2d45-4596-4f2b-8a5c-8fd5f0084630 could not be found. Aug 31 16:26:21.758327 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:26:21.758327 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:26:21.758327 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:26:21.758327 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:26:21.758327 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:26:21.758327 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:26:21.758327 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:26:21.758327 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:26:21.758327 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:26:21.758327 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:26:21.758327 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:26:21.758327 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:26:21.758327 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:26:21.758327 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:26:21.758327 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:26:21.758327 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:26:21.758327 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b92e2d45-4596-4f2b-8a5c-8fd5f0084630 could not be found. Aug 31 16:26:21.758327 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:26:21.758327 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:26:21.758327 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:26:21.772200 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:26:21.772200 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:26:21.772200 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:26:21.772200 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:26:21.772200 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:26:21.772200 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b92e2d45-4596-4f2b-8a5c-8fd5f0084630 could not be found. Aug 31 16:26:21.772200 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:26:21.772200 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e441e2f1-c864-4190-bc85-efe2edcb97bd tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Returning 404 to user: Instance b92e2d45-4596-4f2b-8a5c-8fd5f0084630 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:26:21.772200 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e441e2f1-c864-4190-bc85-efe2edcb97bd tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/b92e2d45-4596-4f2b-8a5c-8fd5f0084630" status: 404 len: 111 microversion: 2.1 time: 0.145222 Aug 31 16:26:21.773331 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2749/5531] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:21 2022] GET /compute/v2.1/servers/b92e2d45-4596-4f2b-8a5c-8fd5f0084630 => generated 111 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 16:26:21.798557 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2c991991-229f-4b30-94f8-e3939c677517 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:21.805846 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2c991991-229f-4b30-94f8-e3939c677517 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:21.822629 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2c991991-229f-4b30-94f8-e3939c677517 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:21.823754 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2c991991-229f-4b30-94f8-e3939c677517 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:21.827269 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2c991991-229f-4b30-94f8-e3939c677517 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:21.829618 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2c991991-229f-4b30-94f8-e3939c677517 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:21.833245 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2c991991-229f-4b30-94f8-e3939c677517 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:21.834734 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2c991991-229f-4b30-94f8-e3939c677517 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:21.964592 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2c991991-229f-4b30-94f8-e3939c677517 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.181927 Aug 31 16:26:21.966774 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2750/5532] 10.222.0.61 () {60 vars in 1343 bytes} [Wed Aug 31 16:26:21 2022] GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5/os-volume_attachments => generated 197 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 16:26:21.984052 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a13cd309-d53b-4d5c-9ef9-c7ec46f925bc tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '.version_select at 0x7f5ae3c72550>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:22.039539 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a13cd309-d53b-4d5c-9ef9-c7ec46f925bc tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-832706107" status: 202 len: 0 microversion: 2.1 time: 0.063683 Aug 31 16:26:22.059959 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2751/5533] 10.222.0.61 () {58 vars in 1218 bytes} [Wed Aug 31 16:26:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-832706107 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:26:22.068852 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-de8439b4-27ac-4639-bfae-e5fa4974092f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:22.084350 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-de8439b4-27ac-4639-bfae-e5fa4974092f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1517 microversion: 2.1 time: 1.278760 Aug 31 16:26:22.100797 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2783/5534] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:20 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1517 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:26:22.436616 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-dafe0957-7b80-4b33-96d1-4853492bf3fe tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:22.440087 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-dafe0957-7b80-4b33-96d1-4853492bf3fe tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 92076abd-df0a-4c10-bbfd-e8c304633298] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:22.463225 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dafe0957-7b80-4b33-96d1-4853492bf3fe tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:22.463403 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dafe0957-7b80-4b33-96d1-4853492bf3fe tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:22.464143 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dafe0957-7b80-4b33-96d1-4853492bf3fe tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:22.466063 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dafe0957-7b80-4b33-96d1-4853492bf3fe tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:22.467062 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dafe0957-7b80-4b33-96d1-4853492bf3fe tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:22.467786 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dafe0957-7b80-4b33-96d1-4853492bf3fe tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:22.536183 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:26:22.982809 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-49aff051-68fd-4f2a-a9df-730f310d99c2 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:22.986060 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-49aff051-68fd-4f2a-a9df-730f310d99c2 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:23.033315 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-49aff051-68fd-4f2a-a9df-730f310d99c2 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:23.037504 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-49aff051-68fd-4f2a-a9df-730f310d99c2 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:23.039599 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-49aff051-68fd-4f2a-a9df-730f310d99c2 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:23.041791 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-49aff051-68fd-4f2a-a9df-730f310d99c2 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:23.042525 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-49aff051-68fd-4f2a-a9df-730f310d99c2 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:23.046470 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-49aff051-68fd-4f2a-a9df-730f310d99c2 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:23.313181 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-dafe0957-7b80-4b33-96d1-4853492bf3fe tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:23.358774 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-dafe0957-7b80-4b33-96d1-4853492bf3fe tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/92076abd-df0a-4c10-bbfd-e8c304633298" status: 200 len: 1508 microversion: 2.1 time: 0.931641 Aug 31 16:26:23.365818 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-49aff051-68fd-4f2a-a9df-730f310d99c2 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.385349 Aug 31 16:26:23.370575 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2752/5535] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:22 2022] GET /compute/v2.1/servers/92076abd-df0a-4c10-bbfd-e8c304633298 => generated 1508 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:26:23.379247 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2784/5536] 10.222.0.61 () {60 vars in 1343 bytes} [Wed Aug 31 16:26:22 2022] GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5/os-volume_attachments => generated 197 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 16:26:23.410954 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1670341b-3e3e-4eea-8b29-fc3229a73d1c tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:23.420760 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1670341b-3e3e-4eea-8b29-fc3229a73d1c tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:23.452723 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1670341b-3e3e-4eea-8b29-fc3229a73d1c tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:23.453842 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1670341b-3e3e-4eea-8b29-fc3229a73d1c tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:23.454205 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1670341b-3e3e-4eea-8b29-fc3229a73d1c tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:23.463304 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1670341b-3e3e-4eea-8b29-fc3229a73d1c tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:23.465387 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1670341b-3e3e-4eea-8b29-fc3229a73d1c tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:23.469316 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1670341b-3e3e-4eea-8b29-fc3229a73d1c tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:24.406013 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e398cd4f-361a-4a14-a24e-071a8fa07035 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:24.412378 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e398cd4f-361a-4a14-a24e-071a8fa07035 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:24.428447 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1670341b-3e3e-4eea-8b29-fc3229a73d1c tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:24.432157 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e398cd4f-361a-4a14-a24e-071a8fa07035 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:24.433227 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e398cd4f-361a-4a14-a24e-071a8fa07035 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:24.434144 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e398cd4f-361a-4a14-a24e-071a8fa07035 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:24.437263 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e398cd4f-361a-4a14-a24e-071a8fa07035 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:24.438350 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e398cd4f-361a-4a14-a24e-071a8fa07035 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:24.441819 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e398cd4f-361a-4a14-a24e-071a8fa07035 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:24.446715 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1670341b-3e3e-4eea-8b29-fc3229a73d1c tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1517 microversion: 2.1 time: 1.062937 Aug 31 16:26:24.447329 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2753/5537] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:23 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1517 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:26:24.485731 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-fb831460-f4c4-4f21-b644-fce59d30f61c tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:24.487104 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-fb831460-f4c4-4f21-b644-fce59d30f61c tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 92076abd-df0a-4c10-bbfd-e8c304633298] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:24.506562 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fb831460-f4c4-4f21-b644-fce59d30f61c tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:24.507384 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fb831460-f4c4-4f21-b644-fce59d30f61c tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:24.508166 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fb831460-f4c4-4f21-b644-fce59d30f61c tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:24.509131 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fb831460-f4c4-4f21-b644-fce59d30f61c tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:24.510456 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fb831460-f4c4-4f21-b644-fce59d30f61c tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:24.511092 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fb831460-f4c4-4f21-b644-fce59d30f61c tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:24.627109 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e398cd4f-361a-4a14-a24e-071a8fa07035 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.239429 Aug 31 16:26:24.638448 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2785/5538] 10.222.0.61 () {60 vars in 1343 bytes} [Wed Aug 31 16:26:24 2022] GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5/os-volume_attachments => generated 197 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 16:26:24.979166 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-fb831460-f4c4-4f21-b644-fce59d30f61c tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:24.992015 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-fb831460-f4c4-4f21-b644-fce59d30f61c tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/92076abd-df0a-4c10-bbfd-e8c304633298" status: 200 len: 1508 microversion: 2.1 time: 0.521282 Aug 31 16:26:25.024189 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2754/5539] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:24 2022] GET /compute/v2.1/servers/92076abd-df0a-4c10-bbfd-e8c304633298 => generated 1508 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:26:25.365179 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0f6b83b9-d33e-4324-81f2-6629e65ef9a6 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:25.365711 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0f6b83b9-d33e-4324-81f2-6629e65ef9a6 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 6e139adf-20d3-4d88-941f-fe9a45276ad5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:25.395314 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0f6b83b9-d33e-4324-81f2-6629e65ef9a6 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:25.396921 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0f6b83b9-d33e-4324-81f2-6629e65ef9a6 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:25.399452 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0f6b83b9-d33e-4324-81f2-6629e65ef9a6 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:25.405128 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0f6b83b9-d33e-4324-81f2-6629e65ef9a6 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:25.406720 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0f6b83b9-d33e-4324-81f2-6629e65ef9a6 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:25.407725 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0f6b83b9-d33e-4324-81f2-6629e65ef9a6 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:25.502937 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-952b8efd-1811-4945-9b84-d7d13db41b18 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:25.518047 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-952b8efd-1811-4945-9b84-d7d13db41b18 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:25.590971 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-952b8efd-1811-4945-9b84-d7d13db41b18 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:25.602928 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-952b8efd-1811-4945-9b84-d7d13db41b18 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:25.609016 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-952b8efd-1811-4945-9b84-d7d13db41b18 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:25.610080 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-952b8efd-1811-4945-9b84-d7d13db41b18 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:25.611224 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-952b8efd-1811-4945-9b84-d7d13db41b18 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:25.617173 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-952b8efd-1811-4945-9b84-d7d13db41b18 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:25.955213 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-0f6b83b9-d33e-4324-81f2-6629e65ef9a6 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lazy-loading 'services' on Instance uuid 6e139adf-20d3-4d88-941f-fe9a45276ad5 {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:26:26.148338 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-952b8efd-1811-4945-9b84-d7d13db41b18 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:26.161314 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-952b8efd-1811-4945-9b84-d7d13db41b18 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1517 microversion: 2.1 time: 0.673037 Aug 31 16:26:26.165548 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2755/5540] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:25 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1517 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:26:26.177591 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-db2a7694-a392-4997-b0f3-106b2c7ac08b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:26.193476 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-db2a7694-a392-4997-b0f3-106b2c7ac08b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:26.207874 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-db2a7694-a392-4997-b0f3-106b2c7ac08b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:26.208393 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-db2a7694-a392-4997-b0f3-106b2c7ac08b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:26.211145 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-db2a7694-a392-4997-b0f3-106b2c7ac08b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:26.211949 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-db2a7694-a392-4997-b0f3-106b2c7ac08b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:26.213880 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-db2a7694-a392-4997-b0f3-106b2c7ac08b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:26.216679 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-db2a7694-a392-4997-b0f3-106b2c7ac08b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:26.259187 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0f6b83b9-d33e-4324-81f2-6629e65ef9a6 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "DELETE /compute/v2.1/servers/6e139adf-20d3-4d88-941f-fe9a45276ad5/os-volume_attachments/5552f8fd-f71f-4429-a5c2-8f7fd2fcde72" status: 202 len: 0 microversion: 2.1 time: 0.898239 Aug 31 16:26:26.260585 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2786/5541] 10.222.0.61 () {58 vars in 1416 bytes} [Wed Aug 31 16:26:25 2022] DELETE /compute/v2.1/servers/6e139adf-20d3-4d88-941f-fe9a45276ad5/os-volume_attachments/5552f8fd-f71f-4429-a5c2-8f7fd2fcde72 => generated 0 bytes in 901 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:26:26.286735 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f4a8e8a7-a7b2-4705-b3bf-8795af29c8c6 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:26.288052 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f4a8e8a7-a7b2-4705-b3bf-8795af29c8c6 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 92076abd-df0a-4c10-bbfd-e8c304633298] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:26.304317 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f4a8e8a7-a7b2-4705-b3bf-8795af29c8c6 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:26.305146 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f4a8e8a7-a7b2-4705-b3bf-8795af29c8c6 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:26.305860 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f4a8e8a7-a7b2-4705-b3bf-8795af29c8c6 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:26.319976 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f4a8e8a7-a7b2-4705-b3bf-8795af29c8c6 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:26.320973 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f4a8e8a7-a7b2-4705-b3bf-8795af29c8c6 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:26.321711 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f4a8e8a7-a7b2-4705-b3bf-8795af29c8c6 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:26.331539 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-db2a7694-a392-4997-b0f3-106b2c7ac08b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.163214 Aug 31 16:26:26.339949 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2756/5542] 10.222.0.61 () {60 vars in 1343 bytes} [Wed Aug 31 16:26:26 2022] GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5/os-volume_attachments => generated 197 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 16:26:26.353137 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-86980e5c-22a4-405d-947e-cab1e09c64a0 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:26.364972 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-86980e5c-22a4-405d-947e-cab1e09c64a0 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 6e139adf-20d3-4d88-941f-fe9a45276ad5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:26.384050 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-86980e5c-22a4-405d-947e-cab1e09c64a0 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:26.384706 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-86980e5c-22a4-405d-947e-cab1e09c64a0 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:26.385173 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-86980e5c-22a4-405d-947e-cab1e09c64a0 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:26.386033 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-86980e5c-22a4-405d-947e-cab1e09c64a0 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:26.392779 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-86980e5c-22a4-405d-947e-cab1e09c64a0 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:26.401660 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-86980e5c-22a4-405d-947e-cab1e09c64a0 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:26.521029 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-86980e5c-22a4-405d-947e-cab1e09c64a0 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/6e139adf-20d3-4d88-941f-fe9a45276ad5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.178033 Aug 31 16:26:26.529449 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2757/5543] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 16:26:26 2022] GET /compute/v2.1/servers/6e139adf-20d3-4d88-941f-fe9a45276ad5/os-volume_attachments => generated 197 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:26:26.758786 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f4a8e8a7-a7b2-4705-b3bf-8795af29c8c6 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:26.795862 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f4a8e8a7-a7b2-4705-b3bf-8795af29c8c6 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/92076abd-df0a-4c10-bbfd-e8c304633298" status: 200 len: 1508 microversion: 2.1 time: 0.517425 Aug 31 16:26:26.798880 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2787/5544] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:26 2022] GET /compute/v2.1/servers/92076abd-df0a-4c10-bbfd-e8c304633298 => generated 1508 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:26:27.219251 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-bc36d306-e5a3-44fb-8fd6-4341d85c8ba8 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:27.221057 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-bc36d306-e5a3-44fb-8fd6-4341d85c8ba8 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:27.273705 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bc36d306-e5a3-44fb-8fd6-4341d85c8ba8 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:27.276472 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bc36d306-e5a3-44fb-8fd6-4341d85c8ba8 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:27.281312 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bc36d306-e5a3-44fb-8fd6-4341d85c8ba8 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:27.289449 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bc36d306-e5a3-44fb-8fd6-4341d85c8ba8 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:27.291558 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bc36d306-e5a3-44fb-8fd6-4341d85c8ba8 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:27.291558 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bc36d306-e5a3-44fb-8fd6-4341d85c8ba8 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:27.369679 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e4c7ef07-4ba8-4573-a8e5-eeb78bdd58ba tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:27.403302 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e4c7ef07-4ba8-4573-a8e5-eeb78bdd58ba tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:27.469786 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e4c7ef07-4ba8-4573-a8e5-eeb78bdd58ba tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:27.478577 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e4c7ef07-4ba8-4573-a8e5-eeb78bdd58ba tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:27.479748 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e4c7ef07-4ba8-4573-a8e5-eeb78bdd58ba tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:27.482681 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e4c7ef07-4ba8-4573-a8e5-eeb78bdd58ba tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:27.484079 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e4c7ef07-4ba8-4573-a8e5-eeb78bdd58ba tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:27.485190 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e4c7ef07-4ba8-4573-a8e5-eeb78bdd58ba tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:27.653636 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e4c7ef07-4ba8-4573-a8e5-eeb78bdd58ba tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.300954 Aug 31 16:26:27.664652 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2788/5545] 10.222.0.61 () {60 vars in 1343 bytes} [Wed Aug 31 16:26:27 2022] GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5/os-volume_attachments => generated 197 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 16:26:27.679144 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-53946053-5b39-413a-bf7c-e19c355b78df tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:27.684636 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-53946053-5b39-413a-bf7c-e19c355b78df tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 6e139adf-20d3-4d88-941f-fe9a45276ad5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:27.708978 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-53946053-5b39-413a-bf7c-e19c355b78df tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:27.719176 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-53946053-5b39-413a-bf7c-e19c355b78df tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:27.721016 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-53946053-5b39-413a-bf7c-e19c355b78df tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:27.722861 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-53946053-5b39-413a-bf7c-e19c355b78df tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:27.724264 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-53946053-5b39-413a-bf7c-e19c355b78df tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:27.725406 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-53946053-5b39-413a-bf7c-e19c355b78df tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:27.964108 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-bc36d306-e5a3-44fb-8fd6-4341d85c8ba8 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:27.993928 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-bc36d306-e5a3-44fb-8fd6-4341d85c8ba8 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1517 microversion: 2.1 time: 0.785408 Aug 31 16:26:27.999900 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2758/5546] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:27 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1517 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:26:28.012385 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-53946053-5b39-413a-bf7c-e19c355b78df tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/6e139adf-20d3-4d88-941f-fe9a45276ad5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.319017 Aug 31 16:26:28.012385 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2789/5547] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 16:26:27 2022] GET /compute/v2.1/servers/6e139adf-20d3-4d88-941f-fe9a45276ad5/os-volume_attachments => generated 197 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:26:28.028325 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-11473561-dc80-4bd1-a0e5-39d6976ed030 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:28.028325 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-11473561-dc80-4bd1-a0e5-39d6976ed030 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 92076abd-df0a-4c10-bbfd-e8c304633298] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:28.075132 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-11473561-dc80-4bd1-a0e5-39d6976ed030 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:28.075738 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-11473561-dc80-4bd1-a0e5-39d6976ed030 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:28.076220 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-11473561-dc80-4bd1-a0e5-39d6976ed030 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:28.076967 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-11473561-dc80-4bd1-a0e5-39d6976ed030 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:28.077432 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-11473561-dc80-4bd1-a0e5-39d6976ed030 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:28.091461 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-11473561-dc80-4bd1-a0e5-39d6976ed030 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:28.154783 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-02939f60-4355-4e9b-915d-5eb9eda93a19 req-d261050f-e2f9-4651-bd1f-132fca98c3fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22082563-385d-41a9-baa5-6fb277278505", "name": "network-vif-plugged", "status": "completed", "tag": "01a10893-04bb-4b06-9640-8c6578bca1fc"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:26:28.190801 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-02939f60-4355-4e9b-915d-5eb9eda93a19 req-d261050f-e2f9-4651-bd1f-132fca98c3fc service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:28.196725 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-02939f60-4355-4e9b-915d-5eb9eda93a19 req-d261050f-e2f9-4651-bd1f-132fca98c3fc service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:28.197882 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-02939f60-4355-4e9b-915d-5eb9eda93a19 req-d261050f-e2f9-4651-bd1f-132fca98c3fc service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:28.252047 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-02939f60-4355-4e9b-915d-5eb9eda93a19 req-d261050f-e2f9-4651-bd1f-132fca98c3fc service nova] Creating event network-vif-plugged:01a10893-04bb-4b06-9640-8c6578bca1fc for instance 22082563-385d-41a9-baa5-6fb277278505 on n-h2-850499-9 Aug 31 16:26:28.272626 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-02939f60-4355-4e9b-915d-5eb9eda93a19 req-d261050f-e2f9-4651-bd1f-132fca98c3fc service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130117 Aug 31 16:26:28.276656 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2759/5548] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:26:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:26:28.541521 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-11473561-dc80-4bd1-a0e5-39d6976ed030 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:28.571908 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-11473561-dc80-4bd1-a0e5-39d6976ed030 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/92076abd-df0a-4c10-bbfd-e8c304633298" status: 200 len: 1508 microversion: 2.1 time: 0.565039 Aug 31 16:26:28.574729 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2790/5549] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:28 2022] GET /compute/v2.1/servers/92076abd-df0a-4c10-bbfd-e8c304633298 => generated 1508 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:26:28.677773 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-784ff4c9-e80c-4253-8208-c5aa4a3b7072 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:28.694155 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-784ff4c9-e80c-4253-8208-c5aa4a3b7072 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:28.715655 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-784ff4c9-e80c-4253-8208-c5aa4a3b7072 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:28.716441 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-784ff4c9-e80c-4253-8208-c5aa4a3b7072 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:28.717159 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-784ff4c9-e80c-4253-8208-c5aa4a3b7072 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:28.718422 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-784ff4c9-e80c-4253-8208-c5aa4a3b7072 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:28.727200 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-784ff4c9-e80c-4253-8208-c5aa4a3b7072 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:28.728586 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-784ff4c9-e80c-4253-8208-c5aa4a3b7072 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:28.836869 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-784ff4c9-e80c-4253-8208-c5aa4a3b7072 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.167058 Aug 31 16:26:28.838791 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2760/5550] 10.222.0.61 () {60 vars in 1343 bytes} [Wed Aug 31 16:26:28 2022] GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5/os-volume_attachments => generated 197 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 16:26:29.020044 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-85596fef-00b1-4f95-89ce-08bcc4b70708 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:29.027422 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-85596fef-00b1-4f95-89ce-08bcc4b70708 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 6e139adf-20d3-4d88-941f-fe9a45276ad5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:29.038734 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-85596fef-00b1-4f95-89ce-08bcc4b70708 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:29.040263 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-85596fef-00b1-4f95-89ce-08bcc4b70708 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:29.041565 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-85596fef-00b1-4f95-89ce-08bcc4b70708 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:29.043442 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-85596fef-00b1-4f95-89ce-08bcc4b70708 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:29.044429 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-85596fef-00b1-4f95-89ce-08bcc4b70708 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:29.045377 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-85596fef-00b1-4f95-89ce-08bcc4b70708 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:29.046394 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-74c98433-0ed3-493c-bc31-7b7e70c52c14 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:29.047794 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-74c98433-0ed3-493c-bc31-7b7e70c52c14 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:29.074508 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-74c98433-0ed3-493c-bc31-7b7e70c52c14 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:29.075207 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-74c98433-0ed3-493c-bc31-7b7e70c52c14 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:29.075787 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-74c98433-0ed3-493c-bc31-7b7e70c52c14 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:29.076578 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-74c98433-0ed3-493c-bc31-7b7e70c52c14 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:29.077200 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-74c98433-0ed3-493c-bc31-7b7e70c52c14 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:29.077674 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-74c98433-0ed3-493c-bc31-7b7e70c52c14 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:29.129877 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-85596fef-00b1-4f95-89ce-08bcc4b70708 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/6e139adf-20d3-4d88-941f-fe9a45276ad5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.114259 Aug 31 16:26:29.138994 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2791/5551] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 16:26:29 2022] GET /compute/v2.1/servers/6e139adf-20d3-4d88-941f-fe9a45276ad5/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:26:29.425395 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-74c98433-0ed3-493c-bc31-7b7e70c52c14 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:29.438777 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-74c98433-0ed3-493c-bc31-7b7e70c52c14 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1517 microversion: 2.1 time: 0.398503 Aug 31 16:26:29.440029 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2761/5552] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:29 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1517 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:26:29.612654 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b74cffdb-ff66-499a-b429-772b638a2cfe tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:29.614153 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b74cffdb-ff66-499a-b429-772b638a2cfe tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 92076abd-df0a-4c10-bbfd-e8c304633298] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:29.651179 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b74cffdb-ff66-499a-b429-772b638a2cfe tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:29.652565 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b74cffdb-ff66-499a-b429-772b638a2cfe tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:29.653790 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b74cffdb-ff66-499a-b429-772b638a2cfe tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:29.654818 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b74cffdb-ff66-499a-b429-772b638a2cfe tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:29.655564 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b74cffdb-ff66-499a-b429-772b638a2cfe tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:29.657256 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b74cffdb-ff66-499a-b429-772b638a2cfe tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:29.852710 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8856e0c7-61af-4e7f-a053-cd006c900327 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:29.856932 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8856e0c7-61af-4e7f-a053-cd006c900327 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:29.874239 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8856e0c7-61af-4e7f-a053-cd006c900327 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:29.875325 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8856e0c7-61af-4e7f-a053-cd006c900327 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:29.878462 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8856e0c7-61af-4e7f-a053-cd006c900327 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:29.879791 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8856e0c7-61af-4e7f-a053-cd006c900327 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:29.881734 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8856e0c7-61af-4e7f-a053-cd006c900327 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:29.897233 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8856e0c7-61af-4e7f-a053-cd006c900327 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:29.989659 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8856e0c7-61af-4e7f-a053-cd006c900327 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.141245 Aug 31 16:26:29.990778 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2762/5553] 10.222.0.61 () {60 vars in 1343 bytes} [Wed Aug 31 16:26:29 2022] GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5/os-volume_attachments => generated 197 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 16:26:30.055023 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b74cffdb-ff66-499a-b429-772b638a2cfe tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:30.068421 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b74cffdb-ff66-499a-b429-772b638a2cfe tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/92076abd-df0a-4c10-bbfd-e8c304633298" status: 200 len: 1508 microversion: 2.1 time: 0.461486 Aug 31 16:26:30.069244 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2792/5554] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:29 2022] GET /compute/v2.1/servers/92076abd-df0a-4c10-bbfd-e8c304633298 => generated 1508 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:26:30.153228 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5408e6f2-182c-4f60-8237-ce1b0c954154 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:30.159440 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5408e6f2-182c-4f60-8237-ce1b0c954154 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 6e139adf-20d3-4d88-941f-fe9a45276ad5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:30.186734 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5408e6f2-182c-4f60-8237-ce1b0c954154 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:30.187643 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5408e6f2-182c-4f60-8237-ce1b0c954154 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:30.188338 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5408e6f2-182c-4f60-8237-ce1b0c954154 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:30.189323 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5408e6f2-182c-4f60-8237-ce1b0c954154 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:30.190155 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5408e6f2-182c-4f60-8237-ce1b0c954154 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:30.190891 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5408e6f2-182c-4f60-8237-ce1b0c954154 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:30.272799 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5408e6f2-182c-4f60-8237-ce1b0c954154 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/6e139adf-20d3-4d88-941f-fe9a45276ad5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.125590 Aug 31 16:26:30.282126 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2763/5555] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 16:26:30 2022] GET /compute/v2.1/servers/6e139adf-20d3-4d88-941f-fe9a45276ad5/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:26:30.475291 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-06b88adb-767a-4b21-92ae-8b6c8545a92a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:30.475958 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-06b88adb-767a-4b21-92ae-8b6c8545a92a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:30.494039 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-06b88adb-767a-4b21-92ae-8b6c8545a92a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:30.495106 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-06b88adb-767a-4b21-92ae-8b6c8545a92a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:30.499137 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-06b88adb-767a-4b21-92ae-8b6c8545a92a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:30.500562 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-06b88adb-767a-4b21-92ae-8b6c8545a92a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:30.501467 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-06b88adb-767a-4b21-92ae-8b6c8545a92a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:30.502274 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-06b88adb-767a-4b21-92ae-8b6c8545a92a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:30.974805 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-06b88adb-767a-4b21-92ae-8b6c8545a92a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:31.009003 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f36e49b8-761e-447d-b8dd-5362587ebaa9 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:31.023132 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f36e49b8-761e-447d-b8dd-5362587ebaa9 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:31.034426 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-06b88adb-767a-4b21-92ae-8b6c8545a92a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1517 microversion: 2.1 time: 0.563480 Aug 31 16:26:31.035306 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2793/5556] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:30 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1517 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:26:31.039580 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f36e49b8-761e-447d-b8dd-5362587ebaa9 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:31.040278 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f36e49b8-761e-447d-b8dd-5362587ebaa9 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:31.047630 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f36e49b8-761e-447d-b8dd-5362587ebaa9 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:31.048842 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f36e49b8-761e-447d-b8dd-5362587ebaa9 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:31.049528 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f36e49b8-761e-447d-b8dd-5362587ebaa9 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:31.050103 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f36e49b8-761e-447d-b8dd-5362587ebaa9 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:31.098075 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3611f3d5-6a66-442e-a5af-d61d18b2a459 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:31.099679 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3611f3d5-6a66-442e-a5af-d61d18b2a459 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 92076abd-df0a-4c10-bbfd-e8c304633298] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:31.113701 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3611f3d5-6a66-442e-a5af-d61d18b2a459 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:31.123063 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3611f3d5-6a66-442e-a5af-d61d18b2a459 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:31.123421 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3611f3d5-6a66-442e-a5af-d61d18b2a459 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:31.137270 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3611f3d5-6a66-442e-a5af-d61d18b2a459 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:31.137912 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3611f3d5-6a66-442e-a5af-d61d18b2a459 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:31.138382 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3611f3d5-6a66-442e-a5af-d61d18b2a459 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:31.142974 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f36e49b8-761e-447d-b8dd-5362587ebaa9 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.143334 Aug 31 16:26:31.144528 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2764/5557] 10.222.0.61 () {60 vars in 1343 bytes} [Wed Aug 31 16:26:30 2022] GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5/os-volume_attachments => generated 197 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 16:26:31.298589 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8aa501e5-09eb-49ef-9afb-38c01ffaac3a tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:31.306170 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8aa501e5-09eb-49ef-9afb-38c01ffaac3a tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 6e139adf-20d3-4d88-941f-fe9a45276ad5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:31.324351 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8aa501e5-09eb-49ef-9afb-38c01ffaac3a tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:31.325024 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8aa501e5-09eb-49ef-9afb-38c01ffaac3a tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:31.325926 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8aa501e5-09eb-49ef-9afb-38c01ffaac3a tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:31.336199 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8aa501e5-09eb-49ef-9afb-38c01ffaac3a tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:31.337397 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8aa501e5-09eb-49ef-9afb-38c01ffaac3a tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:31.338425 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8aa501e5-09eb-49ef-9afb-38c01ffaac3a tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:31.470153 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8aa501e5-09eb-49ef-9afb-38c01ffaac3a tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/6e139adf-20d3-4d88-941f-fe9a45276ad5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.178660 Aug 31 16:26:31.476754 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2765/5558] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 16:26:31 2022] GET /compute/v2.1/servers/6e139adf-20d3-4d88-941f-fe9a45276ad5/os-volume_attachments => generated 197 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:26:31.476935 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3611f3d5-6a66-442e-a5af-d61d18b2a459 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:31.487280 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3611f3d5-6a66-442e-a5af-d61d18b2a459 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/92076abd-df0a-4c10-bbfd-e8c304633298" status: 200 len: 1508 microversion: 2.1 time: 0.393948 Aug 31 16:26:31.500957 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2794/5559] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:31 2022] GET /compute/v2.1/servers/92076abd-df0a-4c10-bbfd-e8c304633298 => generated 1508 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:26:32.077492 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-fdc2649f-4ed3-4e9e-88cb-948feea4c03c tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:32.078344 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-fdc2649f-4ed3-4e9e-88cb-948feea4c03c tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:32.088361 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fdc2649f-4ed3-4e9e-88cb-948feea4c03c tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:32.090278 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fdc2649f-4ed3-4e9e-88cb-948feea4c03c tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:32.092271 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fdc2649f-4ed3-4e9e-88cb-948feea4c03c tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:32.093542 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fdc2649f-4ed3-4e9e-88cb-948feea4c03c tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:32.094286 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fdc2649f-4ed3-4e9e-88cb-948feea4c03c tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:32.095387 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fdc2649f-4ed3-4e9e-88cb-948feea4c03c tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:32.160359 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3081ec15-bc41-4205-af47-9eae7299a821 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:32.165282 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3081ec15-bc41-4205-af47-9eae7299a821 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:32.195929 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3081ec15-bc41-4205-af47-9eae7299a821 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:32.198065 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3081ec15-bc41-4205-af47-9eae7299a821 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:32.200725 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3081ec15-bc41-4205-af47-9eae7299a821 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:32.203273 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3081ec15-bc41-4205-af47-9eae7299a821 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:32.204936 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3081ec15-bc41-4205-af47-9eae7299a821 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:32.206431 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3081ec15-bc41-4205-af47-9eae7299a821 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:32.350566 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3081ec15-bc41-4205-af47-9eae7299a821 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.196133 Aug 31 16:26:32.352701 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2795/5560] 10.222.0.61 () {60 vars in 1343 bytes} [Wed Aug 31 16:26:32 2022] GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5/os-volume_attachments => generated 197 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 16:26:32.435985 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-fdc2649f-4ed3-4e9e-88cb-948feea4c03c tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:32.461753 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-fdc2649f-4ed3-4e9e-88cb-948feea4c03c tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1517 microversion: 2.1 time: 0.392086 Aug 31 16:26:32.462464 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2766/5561] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:32 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1517 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:26:32.493154 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-432a696c-ab92-42d1-bed7-cc0931050935 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:32.500140 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-432a696c-ab92-42d1-bed7-cc0931050935 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 6e139adf-20d3-4d88-941f-fe9a45276ad5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:32.512733 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-432a696c-ab92-42d1-bed7-cc0931050935 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:32.513679 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-432a696c-ab92-42d1-bed7-cc0931050935 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:32.514524 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-432a696c-ab92-42d1-bed7-cc0931050935 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:32.515985 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-432a696c-ab92-42d1-bed7-cc0931050935 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:32.517159 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-432a696c-ab92-42d1-bed7-cc0931050935 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:32.517944 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-432a696c-ab92-42d1-bed7-cc0931050935 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:32.530149 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-645825ad-b47a-4480-84b8-caac7571dd35 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:32.530978 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-645825ad-b47a-4480-84b8-caac7571dd35 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 92076abd-df0a-4c10-bbfd-e8c304633298] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:32.545343 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-645825ad-b47a-4480-84b8-caac7571dd35 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:32.548519 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-645825ad-b47a-4480-84b8-caac7571dd35 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:32.552009 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-645825ad-b47a-4480-84b8-caac7571dd35 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:32.553060 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-645825ad-b47a-4480-84b8-caac7571dd35 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:32.556466 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-645825ad-b47a-4480-84b8-caac7571dd35 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:32.557426 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-645825ad-b47a-4480-84b8-caac7571dd35 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:32.568916 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-432a696c-ab92-42d1-bed7-cc0931050935 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/6e139adf-20d3-4d88-941f-fe9a45276ad5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087111 Aug 31 16:26:32.577612 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2796/5562] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 16:26:32 2022] GET /compute/v2.1/servers/6e139adf-20d3-4d88-941f-fe9a45276ad5/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:26:32.902409 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-645825ad-b47a-4480-84b8-caac7571dd35 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:32.921490 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-645825ad-b47a-4480-84b8-caac7571dd35 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/92076abd-df0a-4c10-bbfd-e8c304633298" status: 200 len: 1508 microversion: 2.1 time: 0.402581 Aug 31 16:26:32.923979 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2767/5563] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:32 2022] GET /compute/v2.1/servers/92076abd-df0a-4c10-bbfd-e8c304633298 => generated 1508 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:26:33.367368 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e74ab0c5-3cb8-4599-b30f-cfa6e57f919c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:33.369957 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e74ab0c5-3cb8-4599-b30f-cfa6e57f919c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:33.413871 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e74ab0c5-3cb8-4599-b30f-cfa6e57f919c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:33.420811 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e74ab0c5-3cb8-4599-b30f-cfa6e57f919c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:33.421853 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e74ab0c5-3cb8-4599-b30f-cfa6e57f919c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:33.423193 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e74ab0c5-3cb8-4599-b30f-cfa6e57f919c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:33.424124 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e74ab0c5-3cb8-4599-b30f-cfa6e57f919c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:33.427339 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e74ab0c5-3cb8-4599-b30f-cfa6e57f919c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:33.492053 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9cd85d7b-39c0-4e3f-9cfe-8db1e788d3ec tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:33.494710 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9cd85d7b-39c0-4e3f-9cfe-8db1e788d3ec tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:33.516827 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9cd85d7b-39c0-4e3f-9cfe-8db1e788d3ec tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:33.521545 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9cd85d7b-39c0-4e3f-9cfe-8db1e788d3ec tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:33.522421 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9cd85d7b-39c0-4e3f-9cfe-8db1e788d3ec tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:33.524072 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9cd85d7b-39c0-4e3f-9cfe-8db1e788d3ec tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:33.527182 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9cd85d7b-39c0-4e3f-9cfe-8db1e788d3ec tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:33.527913 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9cd85d7b-39c0-4e3f-9cfe-8db1e788d3ec tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:33.540890 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e74ab0c5-3cb8-4599-b30f-cfa6e57f919c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.179279 Aug 31 16:26:33.542922 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2797/5564] 10.222.0.61 () {60 vars in 1343 bytes} [Wed Aug 31 16:26:33 2022] GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5/os-volume_attachments => generated 25 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:26:33.549069 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-bbd0c91d-d2d7-45af-9528-e25a36d01650 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:33.549838 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-bbd0c91d-d2d7-45af-9528-e25a36d01650 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: d1c50fa6-2d8a-4707-9ee7-448ea57be62b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:33.563921 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bbd0c91d-d2d7-45af-9528-e25a36d01650 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:33.564738 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bbd0c91d-d2d7-45af-9528-e25a36d01650 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:33.565370 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bbd0c91d-d2d7-45af-9528-e25a36d01650 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:33.567081 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bbd0c91d-d2d7-45af-9528-e25a36d01650 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:33.567900 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bbd0c91d-d2d7-45af-9528-e25a36d01650 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:33.568523 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bbd0c91d-d2d7-45af-9528-e25a36d01650 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:33.796282 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-9cd85d7b-39c0-4e3f-9cfe-8db1e788d3ec tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:33.804547 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9cd85d7b-39c0-4e3f-9cfe-8db1e788d3ec tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1504 microversion: 2.1 time: 0.318881 Aug 31 16:26:33.805158 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2768/5565] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:33 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1504 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:26:33.828197 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-57eec7ab-0add-4d74-95c5-38da132e5ae5 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:33.830580 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-57eec7ab-0add-4d74-95c5-38da132e5ae5 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 6e139adf-20d3-4d88-941f-fe9a45276ad5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:33.841522 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-57eec7ab-0add-4d74-95c5-38da132e5ae5 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:33.842402 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-57eec7ab-0add-4d74-95c5-38da132e5ae5 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:33.843071 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-57eec7ab-0add-4d74-95c5-38da132e5ae5 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:33.845217 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-57eec7ab-0add-4d74-95c5-38da132e5ae5 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:33.845989 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-57eec7ab-0add-4d74-95c5-38da132e5ae5 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:33.846540 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-57eec7ab-0add-4d74-95c5-38da132e5ae5 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:33.883706 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=100 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:26:33.887351 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-57eec7ab-0add-4d74-95c5-38da132e5ae5 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/6e139adf-20d3-4d88-941f-fe9a45276ad5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065609 Aug 31 16:26:33.892398 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2769/5566] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 16:26:33 2022] GET /compute/v2.1/servers/6e139adf-20d3-4d88-941f-fe9a45276ad5/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:26:33.897873 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0aaadd4c-d256-4914-8498-c01ecf5dbeba tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:33.898533 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0aaadd4c-d256-4914-8498-c01ecf5dbeba tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:33.907115 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0aaadd4c-d256-4914-8498-c01ecf5dbeba tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:33.908056 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0aaadd4c-d256-4914-8498-c01ecf5dbeba tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:33.908890 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0aaadd4c-d256-4914-8498-c01ecf5dbeba tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:33.909798 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0aaadd4c-d256-4914-8498-c01ecf5dbeba tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:33.910435 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0aaadd4c-d256-4914-8498-c01ecf5dbeba tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:33.911043 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0aaadd4c-d256-4914-8498-c01ecf5dbeba tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:34.062029 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-bbd0c91d-d2d7-45af-9528-e25a36d01650 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lazy-loading 'services' on Instance uuid d1c50fa6-2d8a-4707-9ee7-448ea57be62b {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:26:34.065161 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:26:34.242655 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-0aaadd4c-d256-4914-8498-c01ecf5dbeba tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:34.255566 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0aaadd4c-d256-4914-8498-c01ecf5dbeba tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1504 microversion: 2.1 time: 0.361969 Aug 31 16:26:34.268623 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2770/5567] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:33 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1504 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:26:34.300617 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-50ae644c-00ff-4f5f-b7ea-24514315132a tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:34.304653 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-50ae644c-00ff-4f5f-b7ea-24514315132a tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:34.324469 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-50ae644c-00ff-4f5f-b7ea-24514315132a tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:34.325204 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-50ae644c-00ff-4f5f-b7ea-24514315132a tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:34.325971 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-50ae644c-00ff-4f5f-b7ea-24514315132a tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:34.327900 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-50ae644c-00ff-4f5f-b7ea-24514315132a tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:34.329265 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-50ae644c-00ff-4f5f-b7ea-24514315132a tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:34.330060 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-50ae644c-00ff-4f5f-b7ea-24514315132a tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:34.379049 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-bbd0c91d-d2d7-45af-9528-e25a36d01650 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "DELETE /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b/os-volume_attachments/f775e3fd-3bb1-468f-8a57-c9c7fea1f913" status: 202 len: 0 microversion: 2.1 time: 0.831592 Aug 31 16:26:34.382523 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2798/5568] 10.222.0.61 () {58 vars in 1416 bytes} [Wed Aug 31 16:26:33 2022] DELETE /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b/os-volume_attachments/f775e3fd-3bb1-468f-8a57-c9c7fea1f913 => generated 0 bytes in 839 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:26:34.399485 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4adfb2cd-9eec-466c-86d6-c7d39c45d441 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:34.405360 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4adfb2cd-9eec-466c-86d6-c7d39c45d441 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 92076abd-df0a-4c10-bbfd-e8c304633298] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:34.420216 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4adfb2cd-9eec-466c-86d6-c7d39c45d441 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:34.433593 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4adfb2cd-9eec-466c-86d6-c7d39c45d441 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:34.434360 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4adfb2cd-9eec-466c-86d6-c7d39c45d441 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:34.435850 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4adfb2cd-9eec-466c-86d6-c7d39c45d441 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:34.436502 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4adfb2cd-9eec-466c-86d6-c7d39c45d441 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:34.436954 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4adfb2cd-9eec-466c-86d6-c7d39c45d441 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:34.480829 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-50ae644c-00ff-4f5f-b7ea-24514315132a tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Going to try to terminate instance {{(pid=122256) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:26:34.792572 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-50ae644c-00ff-4f5f-b7ea-24514315132a tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "DELETE /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5" status: 204 len: 0 microversion: 2.20 time: 0.521681 Aug 31 16:26:34.797306 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2771/5569] 10.222.0.61 () {60 vars in 1280 bytes} [Wed Aug 31 16:26:34 2022] DELETE /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 16:26:34.818496 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-272d788e-3ef3-4286-9261-130a094c6cbd tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:34.819819 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-272d788e-3ef3-4286-9261-130a094c6cbd tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:34.836154 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-272d788e-3ef3-4286-9261-130a094c6cbd tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:34.836982 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-272d788e-3ef3-4286-9261-130a094c6cbd tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:34.837660 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-272d788e-3ef3-4286-9261-130a094c6cbd tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:34.841568 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-272d788e-3ef3-4286-9261-130a094c6cbd tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:34.844155 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-272d788e-3ef3-4286-9261-130a094c6cbd tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:34.844872 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-272d788e-3ef3-4286-9261-130a094c6cbd tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:34.884259 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-4adfb2cd-9eec-466c-86d6-c7d39c45d441 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:34.901423 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4adfb2cd-9eec-466c-86d6-c7d39c45d441 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/92076abd-df0a-4c10-bbfd-e8c304633298" status: 200 len: 1508 microversion: 2.1 time: 0.517027 Aug 31 16:26:34.903273 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2799/5570] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:34 2022] GET /compute/v2.1/servers/92076abd-df0a-4c10-bbfd-e8c304633298 => generated 1508 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:26:34.911745 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6661626c-5986-43e5-825d-8277ebce15ad tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:34.915109 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6661626c-5986-43e5-825d-8277ebce15ad tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: d1c50fa6-2d8a-4707-9ee7-448ea57be62b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:34.924555 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6661626c-5986-43e5-825d-8277ebce15ad tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:34.925689 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6661626c-5986-43e5-825d-8277ebce15ad tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:34.926471 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6661626c-5986-43e5-825d-8277ebce15ad tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:34.927700 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6661626c-5986-43e5-825d-8277ebce15ad tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:34.928708 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6661626c-5986-43e5-825d-8277ebce15ad tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:34.929398 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6661626c-5986-43e5-825d-8277ebce15ad tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:34.996953 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6661626c-5986-43e5-825d-8277ebce15ad tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091267 Aug 31 16:26:34.998362 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2800/5571] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 16:26:34 2022] GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:26:35.007150 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-418af2aa-85fa-40b2-8387-48c17d2fbaaf tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:35.008759 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-418af2aa-85fa-40b2-8387-48c17d2fbaaf tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:35.018973 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-418af2aa-85fa-40b2-8387-48c17d2fbaaf tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:35.021061 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-418af2aa-85fa-40b2-8387-48c17d2fbaaf tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:35.022375 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-418af2aa-85fa-40b2-8387-48c17d2fbaaf tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:35.023912 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-418af2aa-85fa-40b2-8387-48c17d2fbaaf tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:35.025062 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-418af2aa-85fa-40b2-8387-48c17d2fbaaf tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:35.026012 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-418af2aa-85fa-40b2-8387-48c17d2fbaaf tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:35.162478 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-272d788e-3ef3-4286-9261-130a094c6cbd tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:35.175721 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-272d788e-3ef3-4286-9261-130a094c6cbd tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1504 microversion: 2.1 time: 0.373865 Aug 31 16:26:35.176697 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2772/5572] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:34 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1504 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:26:35.201744 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-fb88d374-a4c9-42c4-8e91-39f9db2cd0f6 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:35.205205 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-fb88d374-a4c9-42c4-8e91-39f9db2cd0f6 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 6e139adf-20d3-4d88-941f-fe9a45276ad5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:35.213807 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fb88d374-a4c9-42c4-8e91-39f9db2cd0f6 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:35.215359 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fb88d374-a4c9-42c4-8e91-39f9db2cd0f6 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:35.216299 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fb88d374-a4c9-42c4-8e91-39f9db2cd0f6 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:35.217684 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fb88d374-a4c9-42c4-8e91-39f9db2cd0f6 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:35.218412 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fb88d374-a4c9-42c4-8e91-39f9db2cd0f6 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:35.219292 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fb88d374-a4c9-42c4-8e91-39f9db2cd0f6 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:35.290897 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-fb88d374-a4c9-42c4-8e91-39f9db2cd0f6 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/6e139adf-20d3-4d88-941f-fe9a45276ad5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.100906 Aug 31 16:26:35.298192 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2773/5573] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 16:26:35 2022] GET /compute/v2.1/servers/6e139adf-20d3-4d88-941f-fe9a45276ad5/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:26:35.304651 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b15c0365-7c22-4ee6-a8ee-58a404f03664 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:26:35.312771 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-b15c0365-7c22-4ee6-a8ee-58a404f03664 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] HTTP exception thrown: Instance 74bcfa5d-517d-4c00-8c73-3a6f21002def has no mapping to a cell. Aug 31 16:26:35.327075 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b15c0365-7c22-4ee6-a8ee-58a404f03664 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Request method failure captured: Aug 31 16:26:35.327075 n-d-850499-9 devstack@n-api.service[122256]: request: POST /compute/v2.1/servers/74bcfa5d-517d-4c00-8c73-3a6f21002def/action HTTP/1.1 Aug 31 16:26:35.327075 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:26:35.327075 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:26:35.327075 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:26:35.327075 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 15 Aug 31 16:26:35.327075 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:26:35.327075 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:26:35.327075 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:26:35.327075 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:26:35.327075 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4q2NcJzZutw3Y6jF4GnmJD1H1MzSLIbHjRxunPVSp6uKTRmCePfT1DyksG9QgDfSYnSoM0q9vOxO3sqZKoJ5PA2HppEXRHLLn8jTh4ccTKQ6q8SYb3pqui6kOFW5_PmtYr9N0lihJC0EStA4OYRI4QsHOxwmGiiVscbhBZpLyiKmV0 Aug 31 16:26:35.327075 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:26:35.327075 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:26:35.327075 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:26:35.327075 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:26:35.327075 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:26:35.327075 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:26:35.327075 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 014522b19dc349a691e1f6b131229974 Aug 31 16:26:35.327075 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:26:35.327075 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:26:35.327075 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:26:35.327075 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/014522b19dc349a691e1f6b131229974"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/014522b19dc349a691e1f6b131229974"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_014522b19dc349a691e1f6b131229974", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/014522b19dc349a691e1f6b131229974"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:26:35.327075 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:26:35.327075 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 014522b19dc349a691e1f6b131229974 Aug 31 16:26:35.327075 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:26:35.327075 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ServersNegativeTestJSON-918151355-project Aug 31 16:26:35.327075 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:26:35.327075 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:26:35.327075 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: c042c43cc2aa4000a147fae62c261e86 Aug 31 16:26:35.327075 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ServersNegativeTestJSON-918151355-project Aug 31 16:26:35.327075 n-d-850499-9 devstack@n-api.service[122256]: Aug 31 16:26:35.327075 n-d-850499-9 devstack@n-api.service[122256]: {"os-stop": {}} Aug 31 16:26:35.327075 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:26:35.327075 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance 74bcfa5d-517d-4c00-8c73-3a6f21002def has no mapping to a cell. Aug 31 16:26:35.327075 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '74bcfa5d-517d-4c00-8c73-3a6f21002def', 'body': {'os-stop': {}}} Aug 31 16:26:35.327075 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:26:35.327075 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:26:35.327075 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1408, in _get_instance Aug 31 16:26:35.327075 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Aug 31 16:26:35.327075 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 16:26:35.327075 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 16:26:35.327075 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Aug 31 16:26:35.327075 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Aug 31 16:26:35.327075 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 31 16:26:35.327075 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 31 16:26:35.327075 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Aug 31 16:26:35.327075 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Aug 31 16:26:35.327075 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 74bcfa5d-517d-4c00-8c73-3a6f21002def has no mapping to a cell. Aug 31 16:26:35.327075 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:26:35.327075 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:26:35.327075 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:26:35.327075 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:26:35.327075 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:26:35.327075 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:26:35.327075 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:26:35.327075 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:26:35.327075 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:26:35.327075 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:26:35.327075 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1441, in _stop_server Aug 31 16:26:35.327075 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Aug 31 16:26:35.327075 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1415, in _get_instance Aug 31 16:26:35.327075 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:26:35.327075 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74bcfa5d-517d-4c00-8c73-3a6f21002def has no mapping to a cell. Aug 31 16:26:35.334201 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:26:35.334201 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:26:35.334201 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:26:35.334201 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:26:35.334201 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:26:35.334201 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:26:35.334201 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:26:35.334201 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:26:35.334201 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74bcfa5d-517d-4c00-8c73-3a6f21002def has no mapping to a cell. Aug 31 16:26:35.334201 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:26:35.340097 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b15c0365-7c22-4ee6-a8ee-58a404f03664 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Returning 404 to user: Instance 74bcfa5d-517d-4c00-8c73-3a6f21002def has no mapping to a cell. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:26:35.341467 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b15c0365-7c22-4ee6-a8ee-58a404f03664 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "POST /compute/v2.1/servers/74bcfa5d-517d-4c00-8c73-3a6f21002def/action" status: 404 len: 117 microversion: 2.1 time: 0.041511 Aug 31 16:26:35.342414 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2774/5574] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:26:35 2022] POST /compute/v2.1/servers/74bcfa5d-517d-4c00-8c73-3a6f21002def/action => generated 117 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:26:35.366264 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-51422252-99ff-4fca-b9fa-3948c4202206 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:35.370447 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-51422252-99ff-4fca-b9fa-3948c4202206 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:35.405645 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-51422252-99ff-4fca-b9fa-3948c4202206 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:35.407965 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-51422252-99ff-4fca-b9fa-3948c4202206 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:35.413397 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-51422252-99ff-4fca-b9fa-3948c4202206 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:35.414481 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-51422252-99ff-4fca-b9fa-3948c4202206 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:35.419393 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-51422252-99ff-4fca-b9fa-3948c4202206 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:35.423416 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-51422252-99ff-4fca-b9fa-3948c4202206 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:35.513515 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-418af2aa-85fa-40b2-8387-48c17d2fbaaf tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:35.534101 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-418af2aa-85fa-40b2-8387-48c17d2fbaaf tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:35.537679 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-418af2aa-85fa-40b2-8387-48c17d2fbaaf tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:35.540868 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-418af2aa-85fa-40b2-8387-48c17d2fbaaf tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5" status: 200 len: 1725 microversion: 2.20 time: 0.540730 Aug 31 16:26:35.542281 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2801/5575] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:26:34 2022] GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5 => generated 1725 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:26:35.925315 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-51422252-99ff-4fca-b9fa-3948c4202206 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:35.935868 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9be55395-2ab3-4a18-8388-b81c0eb1d7dd tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:35.937634 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9be55395-2ab3-4a18-8388-b81c0eb1d7dd tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 92076abd-df0a-4c10-bbfd-e8c304633298] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:35.969208 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9be55395-2ab3-4a18-8388-b81c0eb1d7dd tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:35.969782 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-51422252-99ff-4fca-b9fa-3948c4202206 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1504 microversion: 2.1 time: 0.601362 Aug 31 16:26:35.970606 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2775/5576] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:35 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1504 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:26:35.984396 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9be55395-2ab3-4a18-8388-b81c0eb1d7dd tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:35.985014 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9be55395-2ab3-4a18-8388-b81c0eb1d7dd tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:35.985927 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9be55395-2ab3-4a18-8388-b81c0eb1d7dd tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:35.986553 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9be55395-2ab3-4a18-8388-b81c0eb1d7dd tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:35.987123 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9be55395-2ab3-4a18-8388-b81c0eb1d7dd tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:36.002414 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5e6a697d-c2cb-47af-894f-8e20fd11f11c tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:36.006475 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5e6a697d-c2cb-47af-894f-8e20fd11f11c tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:36.037549 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5e6a697d-c2cb-47af-894f-8e20fd11f11c tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:36.038385 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5e6a697d-c2cb-47af-894f-8e20fd11f11c tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:36.039002 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5e6a697d-c2cb-47af-894f-8e20fd11f11c tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:36.044540 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5e6a697d-c2cb-47af-894f-8e20fd11f11c tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:36.045339 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5e6a697d-c2cb-47af-894f-8e20fd11f11c tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:36.046474 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5e6a697d-c2cb-47af-894f-8e20fd11f11c tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:36.508042 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9be55395-2ab3-4a18-8388-b81c0eb1d7dd tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:36.517325 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9be55395-2ab3-4a18-8388-b81c0eb1d7dd tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/92076abd-df0a-4c10-bbfd-e8c304633298" status: 200 len: 1508 microversion: 2.1 time: 0.590170 Aug 31 16:26:36.562423 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2802/5577] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:35 2022] GET /compute/v2.1/servers/92076abd-df0a-4c10-bbfd-e8c304633298 => generated 1508 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:26:36.577797 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-428da322-1805-4353-98e8-1f2816cb8903 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:36.582865 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-428da322-1805-4353-98e8-1f2816cb8903 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: d1c50fa6-2d8a-4707-9ee7-448ea57be62b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:36.599324 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-428da322-1805-4353-98e8-1f2816cb8903 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:36.603793 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-428da322-1805-4353-98e8-1f2816cb8903 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:36.613575 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-428da322-1805-4353-98e8-1f2816cb8903 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:36.615465 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-428da322-1805-4353-98e8-1f2816cb8903 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:36.616489 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-428da322-1805-4353-98e8-1f2816cb8903 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:36.617480 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-428da322-1805-4353-98e8-1f2816cb8903 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:36.644313 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5e6a697d-c2cb-47af-894f-8e20fd11f11c tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:36.654910 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5e6a697d-c2cb-47af-894f-8e20fd11f11c tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1504 microversion: 2.1 time: 0.656407 Aug 31 16:26:36.660593 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2776/5578] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:35 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1504 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:26:36.675946 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-27d43c65-89f6-44af-b8be-60577d7927e4 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:36.678617 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-27d43c65-89f6-44af-b8be-60577d7927e4 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 6e139adf-20d3-4d88-941f-fe9a45276ad5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:36.697371 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-27d43c65-89f6-44af-b8be-60577d7927e4 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:36.698608 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-27d43c65-89f6-44af-b8be-60577d7927e4 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:36.699291 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-27d43c65-89f6-44af-b8be-60577d7927e4 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:36.704250 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-27d43c65-89f6-44af-b8be-60577d7927e4 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:36.704989 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-27d43c65-89f6-44af-b8be-60577d7927e4 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:36.705638 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-27d43c65-89f6-44af-b8be-60577d7927e4 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:36.713279 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-428da322-1805-4353-98e8-1f2816cb8903 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.148893 Aug 31 16:26:36.719109 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2803/5579] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 16:26:36 2022] GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b/os-volume_attachments => generated 197 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:26:36.731910 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-dbbf1fe7-e906-4791-b677-2f6218d08e25 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:36.738134 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-dbbf1fe7-e906-4791-b677-2f6218d08e25 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:36.745921 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dbbf1fe7-e906-4791-b677-2f6218d08e25 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:36.752540 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dbbf1fe7-e906-4791-b677-2f6218d08e25 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:36.753399 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dbbf1fe7-e906-4791-b677-2f6218d08e25 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:36.754328 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dbbf1fe7-e906-4791-b677-2f6218d08e25 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:36.754966 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dbbf1fe7-e906-4791-b677-2f6218d08e25 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:36.762042 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dbbf1fe7-e906-4791-b677-2f6218d08e25 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:36.785950 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-27d43c65-89f6-44af-b8be-60577d7927e4 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/6e139adf-20d3-4d88-941f-fe9a45276ad5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.123164 Aug 31 16:26:36.787153 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2777/5580] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 16:26:36 2022] GET /compute/v2.1/servers/6e139adf-20d3-4d88-941f-fe9a45276ad5/os-volume_attachments => generated 197 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:26:36.801020 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ae81ea72-ebe6-4cf3-983e-a9e448b99591 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:26:36.808986 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ae81ea72-ebe6-4cf3-983e-a9e448b99591 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 27ddf639-468c-4bf5-b0c0-fe74d4651f59] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:36.825279 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-ae81ea72-ebe6-4cf3-983e-a9e448b99591 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] HTTP exception thrown: Instance 27ddf639-468c-4bf5-b0c0-fe74d4651f59 could not be found. Aug 31 16:26:36.827328 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ae81ea72-ebe6-4cf3-983e-a9e448b99591 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Request method failure captured: Aug 31 16:26:36.827328 n-d-850499-9 devstack@n-api.service[122256]: request: POST /compute/v2.1/servers/27ddf639-468c-4bf5-b0c0-fe74d4651f59/action HTTP/1.1 Aug 31 16:26:36.827328 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:26:36.827328 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:26:36.827328 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:26:36.827328 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 15 Aug 31 16:26:36.827328 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:26:36.827328 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:26:36.827328 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:26:36.827328 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:26:36.827328 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4q2NcJzZutw3Y6jF4GnmJD1H1MzSLIbHjRxunPVSp6uKTRmCePfT1DyksG9QgDfSYnSoM0q9vOxO3sqZKoJ5PA2HppEXRHLLn8jTh4ccTKQ6q8SYb3pqui6kOFW5_PmtYr9N0lihJC0EStA4OYRI4QsHOxwmGiiVscbhBZpLyiKmV0 Aug 31 16:26:36.827328 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:26:36.827328 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:26:36.827328 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:26:36.827328 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:26:36.827328 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:26:36.827328 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:26:36.827328 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 014522b19dc349a691e1f6b131229974 Aug 31 16:26:36.827328 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:26:36.827328 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:26:36.827328 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:26:36.827328 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/014522b19dc349a691e1f6b131229974"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/014522b19dc349a691e1f6b131229974"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_014522b19dc349a691e1f6b131229974", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/014522b19dc349a691e1f6b131229974"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:26:36.827328 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:26:36.827328 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 014522b19dc349a691e1f6b131229974 Aug 31 16:26:36.827328 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:26:36.827328 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ServersNegativeTestJSON-918151355-project Aug 31 16:26:36.827328 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:26:36.827328 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:26:36.827328 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: c042c43cc2aa4000a147fae62c261e86 Aug 31 16:26:36.827328 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ServersNegativeTestJSON-918151355-project Aug 31 16:26:36.827328 n-d-850499-9 devstack@n-api.service[122256]: Aug 31 16:26:36.827328 n-d-850499-9 devstack@n-api.service[122256]: {"suspend": {}} Aug 31 16:26:36.827328 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:26:36.827328 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance 27ddf639-468c-4bf5-b0c0-fe74d4651f59 could not be found. Aug 31 16:26:36.827328 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '27ddf639-468c-4bf5-b0c0-fe74d4651f59', 'body': {'suspend': {}}} Aug 31 16:26:36.827328 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:26:36.827328 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:26:36.827328 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:26:36.827328 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:26:36.827328 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:26:36.827328 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:26:36.827328 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 31 16:26:36.827328 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 31 16:26:36.827328 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27ddf639-468c-4bf5-b0c0-fe74d4651f59 could not be found. Aug 31 16:26:36.827328 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:26:36.827328 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:26:36.827328 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:26:36.827328 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:26:36.827328 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:26:36.827328 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:26:36.827328 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:26:36.827328 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:26:36.827328 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:26:36.827328 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:26:36.827328 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Aug 31 16:26:36.827328 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Aug 31 16:26:36.827328 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:26:36.827328 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:26:36.827328 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27ddf639-468c-4bf5-b0c0-fe74d4651f59 could not be found. Aug 31 16:26:36.827328 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:26:36.827328 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:26:36.827328 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:26:36.827328 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:26:36.827328 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:26:36.827328 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:26:36.833008 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:26:36.833008 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:26:36.833008 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27ddf639-468c-4bf5-b0c0-fe74d4651f59 could not be found. Aug 31 16:26:36.833008 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:26:36.852230 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ae81ea72-ebe6-4cf3-983e-a9e448b99591 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Returning 404 to user: Instance 27ddf639-468c-4bf5-b0c0-fe74d4651f59 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:26:36.857920 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ae81ea72-ebe6-4cf3-983e-a9e448b99591 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "POST /compute/v2.1/servers/27ddf639-468c-4bf5-b0c0-fe74d4651f59/action" status: 404 len: 111 microversion: 2.1 time: 0.061118 Aug 31 16:26:36.864636 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2778/5581] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:26:36 2022] POST /compute/v2.1/servers/27ddf639-468c-4bf5-b0c0-fe74d4651f59/action => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:26:36.873685 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-84f8bc1e-7694-4e53-ab88-343906a55f23 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:36.874558 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-84f8bc1e-7694-4e53-ab88-343906a55f23 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:36.893411 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-84f8bc1e-7694-4e53-ab88-343906a55f23 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:36.894208 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-84f8bc1e-7694-4e53-ab88-343906a55f23 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:36.894939 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-84f8bc1e-7694-4e53-ab88-343906a55f23 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:36.895869 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-84f8bc1e-7694-4e53-ab88-343906a55f23 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:36.900027 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-84f8bc1e-7694-4e53-ab88-343906a55f23 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:36.900724 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-84f8bc1e-7694-4e53-ab88-343906a55f23 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:37.068503 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-dbbf1fe7-e906-4791-b677-2f6218d08e25 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:37.083753 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-dbbf1fe7-e906-4791-b677-2f6218d08e25 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:37.094237 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-dbbf1fe7-e906-4791-b677-2f6218d08e25 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:37.104177 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-dbbf1fe7-e906-4791-b677-2f6218d08e25 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5" status: 200 len: 1725 microversion: 2.20 time: 0.383432 Aug 31 16:26:37.120509 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2804/5582] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:26:36 2022] GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5 => generated 1725 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:26:37.275939 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-84f8bc1e-7694-4e53-ab88-343906a55f23 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:37.289288 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-84f8bc1e-7694-4e53-ab88-343906a55f23 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1504 microversion: 2.1 time: 0.420055 Aug 31 16:26:37.290299 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2779/5583] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:36 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1504 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:26:37.318300 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f3f92706-c4c2-4e2c-b28f-a6cc9bb5a8c8 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:37.319180 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f3f92706-c4c2-4e2c-b28f-a6cc9bb5a8c8 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:37.339052 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f3f92706-c4c2-4e2c-b28f-a6cc9bb5a8c8 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:37.340632 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f3f92706-c4c2-4e2c-b28f-a6cc9bb5a8c8 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:37.342440 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f3f92706-c4c2-4e2c-b28f-a6cc9bb5a8c8 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:37.343474 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f3f92706-c4c2-4e2c-b28f-a6cc9bb5a8c8 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:37.344042 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f3f92706-c4c2-4e2c-b28f-a6cc9bb5a8c8 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:37.345060 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f3f92706-c4c2-4e2c-b28f-a6cc9bb5a8c8 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:37.587604 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-aba2f0bb-d396-41cc-b446-4e3ede340d10 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:37.588358 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-aba2f0bb-d396-41cc-b446-4e3ede340d10 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 92076abd-df0a-4c10-bbfd-e8c304633298] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:37.602124 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aba2f0bb-d396-41cc-b446-4e3ede340d10 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:37.602961 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aba2f0bb-d396-41cc-b446-4e3ede340d10 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:37.603428 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aba2f0bb-d396-41cc-b446-4e3ede340d10 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:37.604230 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aba2f0bb-d396-41cc-b446-4e3ede340d10 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:37.605125 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aba2f0bb-d396-41cc-b446-4e3ede340d10 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:37.605861 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aba2f0bb-d396-41cc-b446-4e3ede340d10 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:38.670406 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-aba2f0bb-d396-41cc-b446-4e3ede340d10 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:38.681864 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-aba2f0bb-d396-41cc-b446-4e3ede340d10 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/92076abd-df0a-4c10-bbfd-e8c304633298" status: 200 len: 1508 microversion: 2.1 time: 1.119017 Aug 31 16:26:38.684307 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2780/5584] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:37 2022] GET /compute/v2.1/servers/92076abd-df0a-4c10-bbfd-e8c304633298 => generated 1508 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:26:38.700488 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-fa0129f9-a2de-46ee-bf5f-38008f5ac9fb tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:38.701370 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f3f92706-c4c2-4e2c-b28f-a6cc9bb5a8c8 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:38.708900 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-fa0129f9-a2de-46ee-bf5f-38008f5ac9fb tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: d1c50fa6-2d8a-4707-9ee7-448ea57be62b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:38.710017 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f3f92706-c4c2-4e2c-b28f-a6cc9bb5a8c8 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1504 microversion: 2.1 time: 1.398044 Aug 31 16:26:38.710631 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2805/5585] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:37 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1504 bytes in 1399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:26:38.726729 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fa0129f9-a2de-46ee-bf5f-38008f5ac9fb tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:38.727620 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fa0129f9-a2de-46ee-bf5f-38008f5ac9fb tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:38.728277 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fa0129f9-a2de-46ee-bf5f-38008f5ac9fb tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:38.729206 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fa0129f9-a2de-46ee-bf5f-38008f5ac9fb tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:38.732296 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fa0129f9-a2de-46ee-bf5f-38008f5ac9fb tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:38.733156 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fa0129f9-a2de-46ee-bf5f-38008f5ac9fb tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:38.739715 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-af71f670-49d6-4f24-b6b5-e4643220e746 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:38.742446 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-af71f670-49d6-4f24-b6b5-e4643220e746 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 6e139adf-20d3-4d88-941f-fe9a45276ad5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:38.770200 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-af71f670-49d6-4f24-b6b5-e4643220e746 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:38.770709 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-af71f670-49d6-4f24-b6b5-e4643220e746 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:38.771158 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-af71f670-49d6-4f24-b6b5-e4643220e746 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:38.771916 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-af71f670-49d6-4f24-b6b5-e4643220e746 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:38.782167 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-af71f670-49d6-4f24-b6b5-e4643220e746 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:38.785409 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-af71f670-49d6-4f24-b6b5-e4643220e746 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:38.793312 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-fa0129f9-a2de-46ee-bf5f-38008f5ac9fb tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103426 Aug 31 16:26:38.796602 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2781/5586] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 16:26:38 2022] GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:26:38.808431 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e0dde223-742c-4abb-9ac7-936605fd3f24 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:38.809147 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e0dde223-742c-4abb-9ac7-936605fd3f24 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:38.827021 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e0dde223-742c-4abb-9ac7-936605fd3f24 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:38.827584 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e0dde223-742c-4abb-9ac7-936605fd3f24 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:38.828184 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e0dde223-742c-4abb-9ac7-936605fd3f24 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:38.828930 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e0dde223-742c-4abb-9ac7-936605fd3f24 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:38.829392 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e0dde223-742c-4abb-9ac7-936605fd3f24 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:38.829827 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e0dde223-742c-4abb-9ac7-936605fd3f24 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:38.925187 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-af71f670-49d6-4f24-b6b5-e4643220e746 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/6e139adf-20d3-4d88-941f-fe9a45276ad5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.213379 Aug 31 16:26:38.939737 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2806/5587] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 16:26:38 2022] GET /compute/v2.1/servers/6e139adf-20d3-4d88-941f-fe9a45276ad5/os-volume_attachments => generated 197 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:26:38.959878 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a8a96b6a-c4ef-40d2-a2c3-23a188f8ea2e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:26:38.960763 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a8a96b6a-c4ef-40d2-a2c3-23a188f8ea2e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:38.973549 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a8a96b6a-c4ef-40d2-a2c3-23a188f8ea2e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:38.974415 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a8a96b6a-c4ef-40d2-a2c3-23a188f8ea2e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:38.975061 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a8a96b6a-c4ef-40d2-a2c3-23a188f8ea2e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:38.986406 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a8a96b6a-c4ef-40d2-a2c3-23a188f8ea2e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:38.988151 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a8a96b6a-c4ef-40d2-a2c3-23a188f8ea2e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:38.989300 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a8a96b6a-c4ef-40d2-a2c3-23a188f8ea2e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:39.035434 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-a8a96b6a-c4ef-40d2-a2c3-23a188f8ea2e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lazy-loading 'flavor' on Instance uuid 22082563-385d-41a9-baa5-6fb277278505 {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:26:39.262970 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a8a96b6a-c4ef-40d2-a2c3-23a188f8ea2e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "POST /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505/action" status: 202 len: 0 microversion: 2.1 time: 0.315524 Aug 31 16:26:39.268012 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2807/5588] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:26:38 2022] POST /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505/action => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:26:39.284144 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e0dde223-742c-4abb-9ac7-936605fd3f24 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:39.305199 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-281fc4d2-a0fb-426d-9dfb-bb4aa50ecaa0 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:39.306057 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-281fc4d2-a0fb-426d-9dfb-bb4aa50ecaa0 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:39.315240 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e0dde223-742c-4abb-9ac7-936605fd3f24 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:39.324800 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-281fc4d2-a0fb-426d-9dfb-bb4aa50ecaa0 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:39.325702 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-281fc4d2-a0fb-426d-9dfb-bb4aa50ecaa0 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:39.326032 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e0dde223-742c-4abb-9ac7-936605fd3f24 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:39.327020 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-281fc4d2-a0fb-426d-9dfb-bb4aa50ecaa0 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:39.328546 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-281fc4d2-a0fb-426d-9dfb-bb4aa50ecaa0 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:39.329739 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-281fc4d2-a0fb-426d-9dfb-bb4aa50ecaa0 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:39.330560 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-281fc4d2-a0fb-426d-9dfb-bb4aa50ecaa0 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:39.337750 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e0dde223-742c-4abb-9ac7-936605fd3f24 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5" status: 200 len: 1725 microversion: 2.20 time: 0.530072 Aug 31 16:26:39.338511 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2782/5589] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:26:38 2022] GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5 => generated 1725 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:26:39.680889 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-75c6571d-85e6-4962-9244-79a9f6e8fde2 req-0254397b-7289-4dfa-9ebc-afb9975d6a7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85a0286b-2e02-4ecb-a63d-0b4a61048ab5", "name": "network-vif-unplugged", "status": "completed", "tag": "b2e423e8-4d65-4e9c-90c7-27d4697688c2"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:26:39.712487 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-75c6571d-85e6-4962-9244-79a9f6e8fde2 req-0254397b-7289-4dfa-9ebc-afb9975d6a7c service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:39.713893 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-75c6571d-85e6-4962-9244-79a9f6e8fde2 req-0254397b-7289-4dfa-9ebc-afb9975d6a7c service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:39.715261 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-75c6571d-85e6-4962-9244-79a9f6e8fde2 req-0254397b-7289-4dfa-9ebc-afb9975d6a7c service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:39.742892 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-75c6571d-85e6-4962-9244-79a9f6e8fde2 req-0254397b-7289-4dfa-9ebc-afb9975d6a7c service nova] Creating event network-vif-unplugged:b2e423e8-4d65-4e9c-90c7-27d4697688c2 for instance 85a0286b-2e02-4ecb-a63d-0b4a61048ab5 on n-h2-850499-9 Aug 31 16:26:39.753722 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-75c6571d-85e6-4962-9244-79a9f6e8fde2 req-0254397b-7289-4dfa-9ebc-afb9975d6a7c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076850 Aug 31 16:26:39.762720 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2783/5590] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:26:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:26:39.769023 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-655306ef-1a80-45ab-b94c-fc5a720de541 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:39.775742 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-655306ef-1a80-45ab-b94c-fc5a720de541 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 92076abd-df0a-4c10-bbfd-e8c304633298] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:39.797454 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-655306ef-1a80-45ab-b94c-fc5a720de541 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:39.798844 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-655306ef-1a80-45ab-b94c-fc5a720de541 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:39.806239 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-655306ef-1a80-45ab-b94c-fc5a720de541 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:39.807403 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-655306ef-1a80-45ab-b94c-fc5a720de541 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:39.808704 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-655306ef-1a80-45ab-b94c-fc5a720de541 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:39.809381 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-655306ef-1a80-45ab-b94c-fc5a720de541 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:39.834797 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-281fc4d2-a0fb-426d-9dfb-bb4aa50ecaa0 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:39.858194 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-281fc4d2-a0fb-426d-9dfb-bb4aa50ecaa0 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1512 microversion: 2.1 time: 0.573894 Aug 31 16:26:39.872253 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2808/5591] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:39 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1512 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:26:39.887605 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-91f087fe-777d-473e-9824-73960ad53ece tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:39.902197 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-91f087fe-777d-473e-9824-73960ad53ece tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: d1c50fa6-2d8a-4707-9ee7-448ea57be62b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:39.936833 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-91f087fe-777d-473e-9824-73960ad53ece tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:39.937711 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-91f087fe-777d-473e-9824-73960ad53ece tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:39.938520 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-91f087fe-777d-473e-9824-73960ad53ece tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:39.939826 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-91f087fe-777d-473e-9824-73960ad53ece tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:39.940688 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-91f087fe-777d-473e-9824-73960ad53ece tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:39.941461 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-91f087fe-777d-473e-9824-73960ad53ece tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:40.021692 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-91f087fe-777d-473e-9824-73960ad53ece tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.141698 Aug 31 16:26:40.026097 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2809/5592] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 16:26:39 2022] GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b/os-volume_attachments => generated 197 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:26:40.037381 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-559ac7d8-fe42-44bf-91d0-9a1778078371 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:40.041592 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-559ac7d8-fe42-44bf-91d0-9a1778078371 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 6e139adf-20d3-4d88-941f-fe9a45276ad5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:40.053953 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-559ac7d8-fe42-44bf-91d0-9a1778078371 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:40.055915 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-559ac7d8-fe42-44bf-91d0-9a1778078371 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:40.056815 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-559ac7d8-fe42-44bf-91d0-9a1778078371 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:40.059357 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-559ac7d8-fe42-44bf-91d0-9a1778078371 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:40.060261 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-559ac7d8-fe42-44bf-91d0-9a1778078371 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:40.061206 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-559ac7d8-fe42-44bf-91d0-9a1778078371 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:40.140856 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-559ac7d8-fe42-44bf-91d0-9a1778078371 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/6e139adf-20d3-4d88-941f-fe9a45276ad5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.111469 Aug 31 16:26:40.142494 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2810/5593] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 16:26:40 2022] GET /compute/v2.1/servers/6e139adf-20d3-4d88-941f-fe9a45276ad5/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:26:40.286063 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-655306ef-1a80-45ab-b94c-fc5a720de541 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:40.297274 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-655306ef-1a80-45ab-b94c-fc5a720de541 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/92076abd-df0a-4c10-bbfd-e8c304633298" status: 200 len: 1508 microversion: 2.1 time: 0.532641 Aug 31 16:26:40.310305 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2784/5594] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:39 2022] GET /compute/v2.1/servers/92076abd-df0a-4c10-bbfd-e8c304633298 => generated 1508 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:26:40.364741 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-eb253420-632e-4175-b866-0745b3a0e583 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:40.365950 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-eb253420-632e-4175-b866-0745b3a0e583 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:40.401451 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eb253420-632e-4175-b866-0745b3a0e583 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:40.405896 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eb253420-632e-4175-b866-0745b3a0e583 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:40.406756 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eb253420-632e-4175-b866-0745b3a0e583 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:40.407688 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eb253420-632e-4175-b866-0745b3a0e583 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:40.408359 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eb253420-632e-4175-b866-0745b3a0e583 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:40.416797 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eb253420-632e-4175-b866-0745b3a0e583 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:40.549421 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-eb253420-632e-4175-b866-0745b3a0e583 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:40.566136 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-eb253420-632e-4175-b866-0745b3a0e583 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:40.577479 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-eb253420-632e-4175-b866-0745b3a0e583 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:40.578877 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-eb253420-632e-4175-b866-0745b3a0e583 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5" status: 200 len: 1657 microversion: 2.20 time: 0.220156 Aug 31 16:26:40.591535 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2811/5595] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:26:40 2022] GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5 => generated 1657 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:26:40.912385 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-595113d0-3e6b-46cd-a23b-8b98b27d36c5 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:40.913045 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-595113d0-3e6b-46cd-a23b-8b98b27d36c5 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:40.921903 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-595113d0-3e6b-46cd-a23b-8b98b27d36c5 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:40.922494 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-595113d0-3e6b-46cd-a23b-8b98b27d36c5 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:40.933401 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-595113d0-3e6b-46cd-a23b-8b98b27d36c5 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:40.934283 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-595113d0-3e6b-46cd-a23b-8b98b27d36c5 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:40.934804 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-595113d0-3e6b-46cd-a23b-8b98b27d36c5 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:40.935262 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-595113d0-3e6b-46cd-a23b-8b98b27d36c5 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:41.041168 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-73f17c63-6f6c-42bd-980a-87a238a5af39 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:41.045696 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-73f17c63-6f6c-42bd-980a-87a238a5af39 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: d1c50fa6-2d8a-4707-9ee7-448ea57be62b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:41.063309 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-73f17c63-6f6c-42bd-980a-87a238a5af39 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:41.063835 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-73f17c63-6f6c-42bd-980a-87a238a5af39 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:41.064289 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-73f17c63-6f6c-42bd-980a-87a238a5af39 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:41.065163 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-73f17c63-6f6c-42bd-980a-87a238a5af39 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:41.065630 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-73f17c63-6f6c-42bd-980a-87a238a5af39 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:41.066058 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-73f17c63-6f6c-42bd-980a-87a238a5af39 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:41.125582 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-73f17c63-6f6c-42bd-980a-87a238a5af39 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091104 Aug 31 16:26:41.126741 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2812/5596] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 16:26:41 2022] GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:26:41.160269 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8c99f266-e183-46c1-b8bc-f51a782a2be8 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:41.171024 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8c99f266-e183-46c1-b8bc-f51a782a2be8 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 6e139adf-20d3-4d88-941f-fe9a45276ad5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:41.186965 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8c99f266-e183-46c1-b8bc-f51a782a2be8 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:41.188034 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8c99f266-e183-46c1-b8bc-f51a782a2be8 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:41.189157 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8c99f266-e183-46c1-b8bc-f51a782a2be8 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:41.190070 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8c99f266-e183-46c1-b8bc-f51a782a2be8 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:41.190623 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8c99f266-e183-46c1-b8bc-f51a782a2be8 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:41.191316 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8c99f266-e183-46c1-b8bc-f51a782a2be8 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:41.247959 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:26:41.311862 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8c99f266-e183-46c1-b8bc-f51a782a2be8 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/6e139adf-20d3-4d88-941f-fe9a45276ad5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.154965 Aug 31 16:26:41.318682 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2813/5597] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 16:26:41 2022] GET /compute/v2.1/servers/6e139adf-20d3-4d88-941f-fe9a45276ad5/os-volume_attachments => generated 197 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:26:41.431190 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-595113d0-3e6b-46cd-a23b-8b98b27d36c5 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:41.449514 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-595113d0-3e6b-46cd-a23b-8b98b27d36c5 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1495 microversion: 2.1 time: 0.541281 Aug 31 16:26:41.461782 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2785/5598] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:40 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1495 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:26:41.484253 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-326dd406-915f-4c5a-9e6b-8ed0db0137de tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:41.485540 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-326dd406-915f-4c5a-9e6b-8ed0db0137de tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 92076abd-df0a-4c10-bbfd-e8c304633298] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:41.494769 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-326dd406-915f-4c5a-9e6b-8ed0db0137de tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:41.496466 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-326dd406-915f-4c5a-9e6b-8ed0db0137de tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:41.497511 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-326dd406-915f-4c5a-9e6b-8ed0db0137de tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:41.499366 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-326dd406-915f-4c5a-9e6b-8ed0db0137de tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:41.501118 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-326dd406-915f-4c5a-9e6b-8ed0db0137de tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:41.502135 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-326dd406-915f-4c5a-9e6b-8ed0db0137de tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:41.690211 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-a9430e34-601a-4ac8-bd48-686a43dab5eb req-64428bfb-353e-4781-8d3e-6187e11d4442 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85a0286b-2e02-4ecb-a63d-0b4a61048ab5", "name": "network-vif-deleted", "tag": "b2e423e8-4d65-4e9c-90c7-27d4697688c2"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:26:41.707348 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-a9430e34-601a-4ac8-bd48-686a43dab5eb req-64428bfb-353e-4781-8d3e-6187e11d4442 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:41.708255 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-a9430e34-601a-4ac8-bd48-686a43dab5eb req-64428bfb-353e-4781-8d3e-6187e11d4442 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:41.709357 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-a9430e34-601a-4ac8-bd48-686a43dab5eb req-64428bfb-353e-4781-8d3e-6187e11d4442 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:41.746391 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-a9430e34-601a-4ac8-bd48-686a43dab5eb req-64428bfb-353e-4781-8d3e-6187e11d4442 service nova] Creating event network-vif-deleted:b2e423e8-4d65-4e9c-90c7-27d4697688c2 for instance 85a0286b-2e02-4ecb-a63d-0b4a61048ab5 on n-h2-850499-9 Aug 31 16:26:41.759100 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-a9430e34-601a-4ac8-bd48-686a43dab5eb req-64428bfb-353e-4781-8d3e-6187e11d4442 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.441411 Aug 31 16:26:41.764203 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2814/5599] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:26:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:26:41.779224 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-18811cd6-b8dc-425a-89f3-fe4219ca35d0 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:26:41.780427 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-18811cd6-b8dc-425a-89f3-fe4219ca35d0 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:41.793660 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-326dd406-915f-4c5a-9e6b-8ed0db0137de tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:41.801541 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-18811cd6-b8dc-425a-89f3-fe4219ca35d0 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:41.802578 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-18811cd6-b8dc-425a-89f3-fe4219ca35d0 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:41.804448 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-18811cd6-b8dc-425a-89f3-fe4219ca35d0 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:41.805620 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-18811cd6-b8dc-425a-89f3-fe4219ca35d0 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:41.806330 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-326dd406-915f-4c5a-9e6b-8ed0db0137de tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/92076abd-df0a-4c10-bbfd-e8c304633298" status: 200 len: 1508 microversion: 2.1 time: 0.331385 Aug 31 16:26:41.819541 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-18811cd6-b8dc-425a-89f3-fe4219ca35d0 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:41.819541 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-18811cd6-b8dc-425a-89f3-fe4219ca35d0 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:41.823036 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2786/5600] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:41 2022] GET /compute/v2.1/servers/92076abd-df0a-4c10-bbfd-e8c304633298 => generated 1508 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:26:41.838939 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ff0888c7-b480-482a-ad2e-40af5f8400e4 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:41.840067 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ff0888c7-b480-482a-ad2e-40af5f8400e4 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:41.858065 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ff0888c7-b480-482a-ad2e-40af5f8400e4 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:41.858899 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ff0888c7-b480-482a-ad2e-40af5f8400e4 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:41.859561 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ff0888c7-b480-482a-ad2e-40af5f8400e4 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:41.860498 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ff0888c7-b480-482a-ad2e-40af5f8400e4 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:41.861202 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ff0888c7-b480-482a-ad2e-40af5f8400e4 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:41.861906 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ff0888c7-b480-482a-ad2e-40af5f8400e4 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:41.867296 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-18811cd6-b8dc-425a-89f3-fe4219ca35d0 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lazy-loading 'flavor' on Instance uuid 22082563-385d-41a9-baa5-6fb277278505 {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:26:41.896412 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-18811cd6-b8dc-425a-89f3-fe4219ca35d0 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] HTTP exception thrown: Cannot 'suspend' instance 22082563-385d-41a9-baa5-6fb277278505 while it is in vm_state suspended Aug 31 16:26:41.896412 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-18811cd6-b8dc-425a-89f3-fe4219ca35d0 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Request method failure captured: Aug 31 16:26:41.896412 n-d-850499-9 devstack@n-api.service[122257]: request: POST /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505/action HTTP/1.1 Aug 31 16:26:41.896412 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:26:41.896412 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:26:41.896412 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:26:41.896412 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 15 Aug 31 16:26:41.896412 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:26:41.896412 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:26:41.896412 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:26:41.896412 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:26:41.896412 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4q2NcJzZutw3Y6jF4GnmJD1H1MzSLIbHjRxunPVSp6uKTRmCePfT1DyksG9QgDfSYnSoM0q9vOxO3sqZKoJ5PA2HppEXRHLLn8jTh4ccTKQ6q8SYb3pqui6kOFW5_PmtYr9N0lihJC0EStA4OYRI4QsHOxwmGiiVscbhBZpLyiKmV0 Aug 31 16:26:41.896412 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:26:41.896412 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:26:41.896412 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:26:41.896412 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:26:41.896412 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:26:41.896412 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:26:41.896412 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 014522b19dc349a691e1f6b131229974 Aug 31 16:26:41.896412 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:26:41.896412 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:26:41.896412 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:26:41.896412 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/014522b19dc349a691e1f6b131229974"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/014522b19dc349a691e1f6b131229974"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_014522b19dc349a691e1f6b131229974", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/014522b19dc349a691e1f6b131229974"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:26:41.896412 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:26:41.896412 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 014522b19dc349a691e1f6b131229974 Aug 31 16:26:41.896412 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:26:41.896412 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ServersNegativeTestJSON-918151355-project Aug 31 16:26:41.896412 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:26:41.896412 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:26:41.896412 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: c042c43cc2aa4000a147fae62c261e86 Aug 31 16:26:41.896412 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ServersNegativeTestJSON-918151355-project Aug 31 16:26:41.896412 n-d-850499-9 devstack@n-api.service[122257]: Aug 31 16:26:41.896412 n-d-850499-9 devstack@n-api.service[122257]: {"suspend": {}} Aug 31 16:26:41.896412 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:26:41.896412 n-d-850499-9 devstack@n-api.service[122257]: exception: Cannot 'suspend' instance 22082563-385d-41a9-baa5-6fb277278505 while it is in vm_state suspended Aug 31 16:26:41.896412 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '22082563-385d-41a9-baa5-6fb277278505', 'body': {'suspend': {}}} Aug 31 16:26:41.896412 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:26:41.896412 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:26:41.896412 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Aug 31 16:26:41.896412 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Aug 31 16:26:41.896412 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 31 16:26:41.896412 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 31 16:26:41.896412 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Aug 31 16:26:41.896412 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 31 16:26:41.896412 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 31 16:26:41.896412 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 31 16:26:41.896412 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Aug 31 16:26:41.896412 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 31 16:26:41.896412 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 16:26:41.896412 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 16:26:41.896412 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 31 16:26:41.896412 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 31 16:26:41.896412 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 22082563-385d-41a9-baa5-6fb277278505 in vm_state suspended. Cannot suspend while the instance is in this state. Aug 31 16:26:41.896412 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:26:41.896412 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:26:41.896412 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:26:41.896412 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:26:41.896412 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:26:41.896412 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:26:41.896412 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:26:41.896412 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:26:41.907018 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:26:41.907018 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:26:41.907018 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Aug 31 16:26:41.907018 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 31 16:26:41.907018 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 31 16:26:41.907018 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 31 16:26:41.907018 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 22082563-385d-41a9-baa5-6fb277278505 while it is in vm_state suspended Aug 31 16:26:41.907018 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:26:41.907018 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:26:41.907018 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:26:41.907018 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:26:41.907018 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:26:41.907018 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:26:41.907018 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:26:41.907018 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:26:41.907018 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 22082563-385d-41a9-baa5-6fb277278505 while it is in vm_state suspended Aug 31 16:26:41.907018 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:26:41.907018 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-18811cd6-b8dc-425a-89f3-fe4219ca35d0 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Returning 409 to user: Cannot 'suspend' instance 22082563-385d-41a9-baa5-6fb277278505 while it is in vm_state suspended {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:26:41.907018 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-18811cd6-b8dc-425a-89f3-fe4219ca35d0 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "POST /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505/action" status: 409 len: 148 microversion: 2.1 time: 0.131706 Aug 31 16:26:41.907018 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2815/5601] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:26:41 2022] POST /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505/action => generated 148 bytes in 138 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 31 16:26:41.915533 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-149ea6c3-c973-422a-9b45-ff0b9a64f724 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:26:41.916456 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-149ea6c3-c973-422a-9b45-ff0b9a64f724 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:41.925757 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-149ea6c3-c973-422a-9b45-ff0b9a64f724 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:41.926615 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-149ea6c3-c973-422a-9b45-ff0b9a64f724 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:41.927181 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-149ea6c3-c973-422a-9b45-ff0b9a64f724 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:41.928077 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-149ea6c3-c973-422a-9b45-ff0b9a64f724 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:41.928666 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-149ea6c3-c973-422a-9b45-ff0b9a64f724 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:41.929682 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-149ea6c3-c973-422a-9b45-ff0b9a64f724 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:41.936685 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:26:41.978101 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ff0888c7-b480-482a-ad2e-40af5f8400e4 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:41.979030 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ff0888c7-b480-482a-ad2e-40af5f8400e4 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:41.980466 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ff0888c7-b480-482a-ad2e-40af5f8400e4 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:41.981143 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-ff0888c7-b480-482a-ad2e-40af5f8400e4 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lazy-loading 'fault' on Instance uuid 85a0286b-2e02-4ecb-a63d-0b4a61048ab5 {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:26:42.054942 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-149ea6c3-c973-422a-9b45-ff0b9a64f724 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "POST /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505/action" status: 202 len: 0 microversion: 2.1 time: 0.144016 Aug 31 16:26:42.058815 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2816/5602] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:26:41 2022] POST /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505/action => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 16:26:42.062359 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ff0888c7-b480-482a-ad2e-40af5f8400e4 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:42.077022 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ff0888c7-b480-482a-ad2e-40af5f8400e4 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:42.077732 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4e5f70c8-f50c-4332-b806-7569648d1065 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:42.078474 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4e5f70c8-f50c-4332-b806-7569648d1065 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:42.081547 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ff0888c7-b480-482a-ad2e-40af5f8400e4 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:42.084242 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ff0888c7-b480-482a-ad2e-40af5f8400e4 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5" status: 200 len: 1371 microversion: 2.20 time: 0.251524 Aug 31 16:26:42.099577 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4e5f70c8-f50c-4332-b806-7569648d1065 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:42.099577 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4e5f70c8-f50c-4332-b806-7569648d1065 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:42.099577 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4e5f70c8-f50c-4332-b806-7569648d1065 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:42.100487 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4e5f70c8-f50c-4332-b806-7569648d1065 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:42.101070 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4e5f70c8-f50c-4332-b806-7569648d1065 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:42.101210 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2787/5603] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:26:41 2022] GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5 => generated 1371 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:26:42.108716 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4e5f70c8-f50c-4332-b806-7569648d1065 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:42.143019 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-254c7ee1-6780-4bfe-b223-b187593b1e64 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:42.147082 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-254c7ee1-6780-4bfe-b223-b187593b1e64 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: d1c50fa6-2d8a-4707-9ee7-448ea57be62b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:42.196508 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-254c7ee1-6780-4bfe-b223-b187593b1e64 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:42.204874 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-254c7ee1-6780-4bfe-b223-b187593b1e64 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:42.206302 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-254c7ee1-6780-4bfe-b223-b187593b1e64 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:42.207434 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-254c7ee1-6780-4bfe-b223-b187593b1e64 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:42.208454 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-254c7ee1-6780-4bfe-b223-b187593b1e64 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:42.209382 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-254c7ee1-6780-4bfe-b223-b187593b1e64 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:42.288084 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-254c7ee1-6780-4bfe-b223-b187593b1e64 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.153750 Aug 31 16:26:42.297067 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2788/5604] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 16:26:42 2022] GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b/os-volume_attachments => generated 197 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:26:42.327817 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e58d1c27-5823-4792-b0d6-47049289c923 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:42.330556 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e58d1c27-5823-4792-b0d6-47049289c923 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 6e139adf-20d3-4d88-941f-fe9a45276ad5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:42.349782 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e58d1c27-5823-4792-b0d6-47049289c923 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:42.353979 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e58d1c27-5823-4792-b0d6-47049289c923 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:42.355554 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e58d1c27-5823-4792-b0d6-47049289c923 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:42.368279 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e58d1c27-5823-4792-b0d6-47049289c923 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:42.369711 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e58d1c27-5823-4792-b0d6-47049289c923 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:42.370883 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e58d1c27-5823-4792-b0d6-47049289c923 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:42.484031 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-4e5f70c8-f50c-4332-b806-7569648d1065 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:42.496497 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4e5f70c8-f50c-4332-b806-7569648d1065 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1501 microversion: 2.1 time: 0.433811 Aug 31 16:26:42.504030 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e58d1c27-5823-4792-b0d6-47049289c923 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/6e139adf-20d3-4d88-941f-fe9a45276ad5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.180827 Aug 31 16:26:42.514499 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2789/5605] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 16:26:42 2022] GET /compute/v2.1/servers/6e139adf-20d3-4d88-941f-fe9a45276ad5/os-volume_attachments => generated 197 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:26:42.514996 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2817/5606] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:42 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1501 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:26:42.840222 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f32f14fa-f586-403a-872e-b166be662d4e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:42.841076 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f32f14fa-f586-403a-872e-b166be662d4e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 92076abd-df0a-4c10-bbfd-e8c304633298] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:42.887912 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f32f14fa-f586-403a-872e-b166be662d4e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:42.888808 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f32f14fa-f586-403a-872e-b166be662d4e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:42.889561 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f32f14fa-f586-403a-872e-b166be662d4e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:42.890592 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f32f14fa-f586-403a-872e-b166be662d4e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:42.891384 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f32f14fa-f586-403a-872e-b166be662d4e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:42.892045 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f32f14fa-f586-403a-872e-b166be662d4e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:43.118494 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f9bf5983-f48f-4866-ba54-03e721f02e0e tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:43.119225 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f9bf5983-f48f-4866-ba54-03e721f02e0e tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:43.137091 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f9bf5983-f48f-4866-ba54-03e721f02e0e tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:43.140830 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f9bf5983-f48f-4866-ba54-03e721f02e0e tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:43.141523 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f9bf5983-f48f-4866-ba54-03e721f02e0e tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:43.142807 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f9bf5983-f48f-4866-ba54-03e721f02e0e tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:43.144121 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f9bf5983-f48f-4866-ba54-03e721f02e0e tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:43.146208 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f9bf5983-f48f-4866-ba54-03e721f02e0e tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:43.212387 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-f9bf5983-f48f-4866-ba54-03e721f02e0e tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] HTTP exception thrown: Instance 85a0286b-2e02-4ecb-a63d-0b4a61048ab5 could not be found. Aug 31 16:26:43.222890 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f9bf5983-f48f-4866-ba54-03e721f02e0e tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Request method failure captured: Aug 31 16:26:43.222890 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5 HTTP/1.1 Aug 31 16:26:43.222890 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:26:43.222890 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:26:43.222890 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:26:43.222890 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:26:43.222890 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:26:43.222890 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:26:43.222890 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:26:43.222890 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:26:43.222890 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4paH_G5w-Lewh6LZnRmXklLf1ya40XWD25uZ65baVRBpbj-4vWy4i5AnWd4H3SGDp4sxCxiENp5Pmk_UI3-ze2xj4kgXJvJU_1eSI3JYfEtoDAOG_48S5StQpjeOO2yWrcurlzW4wSg3Sw6jnrXt6NKcdBCorc5Vu_rwvkLY_lWj9I Aug 31 16:26:43.222890 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:26:43.222890 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:26:43.222890 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:26:43.222890 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:26:43.222890 n-d-850499-9 devstack@n-api.service[122257]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 16:26:43.222890 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:26:43.222890 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:26:43.222890 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 1c81cbf4a36943d78740dec7e7e1b4d9 Aug 31 16:26:43.222890 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1339167510 Aug 31 16:26:43.222890 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:26:43.222890 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:26:43.222890 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1c81cbf4a36943d78740dec7e7e1b4d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1c81cbf4a36943d78740dec7e7e1b4d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1c81cbf4a36943d78740dec7e7e1b4d9", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1c81cbf4a36943d78740dec7e7e1b4d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:26:43.222890 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1339167510 Aug 31 16:26:43.222890 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 1c81cbf4a36943d78740dec7e7e1b4d9 Aug 31 16:26:43.222890 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1339167510 Aug 31 16:26:43.222890 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-AttachVolumeShelveTestJSON-1339167510-project Aug 31 16:26:43.222890 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:26:43.222890 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:26:43.222890 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 6ef5541e135d48348fbb4419b29417e7 Aug 31 16:26:43.222890 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1339167510-project Aug 31 16:26:43.222890 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:26:43.222890 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance 85a0286b-2e02-4ecb-a63d-0b4a61048ab5 could not be found. Aug 31 16:26:43.222890 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '85a0286b-2e02-4ecb-a63d-0b4a61048ab5'} Aug 31 16:26:43.222890 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:26:43.222890 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:26:43.222890 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:26:43.222890 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:26:43.222890 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:26:43.222890 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:26:43.222890 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:26:43.222890 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:26:43.222890 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:26:43.222890 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:26:43.222890 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85a0286b-2e02-4ecb-a63d-0b4a61048ab5 could not be found. Aug 31 16:26:43.222890 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:26:43.222890 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:26:43.222890 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:26:43.222890 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:26:43.222890 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:26:43.222890 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:26:43.222890 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:26:43.222890 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:26:43.222890 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:26:43.222890 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:26:43.222890 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:26:43.222890 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:26:43.222890 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:26:43.222890 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:26:43.222890 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:26:43.222890 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:26:43.222890 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85a0286b-2e02-4ecb-a63d-0b4a61048ab5 could not be found. Aug 31 16:26:43.222890 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:26:43.222890 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:26:43.231735 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:26:43.231735 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:26:43.231735 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:26:43.231735 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:26:43.231735 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:26:43.231735 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:26:43.231735 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85a0286b-2e02-4ecb-a63d-0b4a61048ab5 could not be found. Aug 31 16:26:43.231735 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:26:43.231735 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f9bf5983-f48f-4866-ba54-03e721f02e0e tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Returning 404 to user: Instance 85a0286b-2e02-4ecb-a63d-0b4a61048ab5 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:26:43.232487 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f9bf5983-f48f-4866-ba54-03e721f02e0e tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5" status: 404 len: 111 microversion: 2.20 time: 0.118391 Aug 31 16:26:43.233199 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2818/5607] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:26:43 2022] GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:26:43.248536 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8210aabc-99d3-4e92-853e-f1b737a8a1c2 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '.version_select at 0x7f5ae3c82700>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:43.298004 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8210aabc-99d3-4e92-853e-f1b737a8a1c2 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-595158291" status: 204 len: 0 microversion: 2.20 time: 0.054538 Aug 31 16:26:43.301683 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2819/5608] 10.222.0.61 () {60 vars in 1259 bytes} [Wed Aug 31 16:26:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-595158291 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 16:26:43.326241 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-218a04bc-0782-4d35-a90f-272c46f81026 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:43.328916 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f32f14fa-f586-403a-872e-b166be662d4e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:43.330691 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-218a04bc-0782-4d35-a90f-272c46f81026 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: d1c50fa6-2d8a-4707-9ee7-448ea57be62b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:43.358867 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-218a04bc-0782-4d35-a90f-272c46f81026 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:43.360811 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-218a04bc-0782-4d35-a90f-272c46f81026 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:43.363359 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-218a04bc-0782-4d35-a90f-272c46f81026 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:43.365460 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f32f14fa-f586-403a-872e-b166be662d4e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/92076abd-df0a-4c10-bbfd-e8c304633298" status: 200 len: 1508 microversion: 2.1 time: 0.512249 Aug 31 16:26:43.375579 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-218a04bc-0782-4d35-a90f-272c46f81026 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:43.375579 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-218a04bc-0782-4d35-a90f-272c46f81026 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:43.375579 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-218a04bc-0782-4d35-a90f-272c46f81026 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:43.376863 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2790/5609] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:42 2022] GET /compute/v2.1/servers/92076abd-df0a-4c10-bbfd-e8c304633298 => generated 1508 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:26:43.451833 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-218a04bc-0782-4d35-a90f-272c46f81026 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.140405 Aug 31 16:26:43.456618 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2820/5610] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 16:26:43 2022] GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b/os-volume_attachments => generated 197 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:26:43.519328 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-fa461bcc-ee44-4574-af92-7761691ced68 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:43.530830 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-55ad283d-4c93-48b7-9fe6-80e6b15e3457 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:43.531934 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-55ad283d-4c93-48b7-9fe6-80e6b15e3457 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:43.535955 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-fa461bcc-ee44-4574-af92-7761691ced68 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 6e139adf-20d3-4d88-941f-fe9a45276ad5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:43.552280 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-55ad283d-4c93-48b7-9fe6-80e6b15e3457 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:43.557319 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-55ad283d-4c93-48b7-9fe6-80e6b15e3457 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:43.559913 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-55ad283d-4c93-48b7-9fe6-80e6b15e3457 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:43.562941 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-55ad283d-4c93-48b7-9fe6-80e6b15e3457 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:43.564335 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-55ad283d-4c93-48b7-9fe6-80e6b15e3457 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:43.564745 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fa461bcc-ee44-4574-af92-7761691ced68 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:43.565373 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fa461bcc-ee44-4574-af92-7761691ced68 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:43.565994 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fa461bcc-ee44-4574-af92-7761691ced68 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:43.566891 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fa461bcc-ee44-4574-af92-7761691ced68 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:43.567485 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fa461bcc-ee44-4574-af92-7761691ced68 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:43.570117 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-55ad283d-4c93-48b7-9fe6-80e6b15e3457 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:43.571074 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fa461bcc-ee44-4574-af92-7761691ced68 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:43.721642 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-fa461bcc-ee44-4574-af92-7761691ced68 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/6e139adf-20d3-4d88-941f-fe9a45276ad5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.205871 Aug 31 16:26:43.725386 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2791/5611] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 16:26:43 2022] GET /compute/v2.1/servers/6e139adf-20d3-4d88-941f-fe9a45276ad5/os-volume_attachments => generated 25 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 16:26:44.319162 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-55ad283d-4c93-48b7-9fe6-80e6b15e3457 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:44.336183 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b245a4f4-9c2e-40be-85fc-bacf30211170 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:44.337066 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b245a4f4-9c2e-40be-85fc-bacf30211170 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 6e139adf-20d3-4d88-941f-fe9a45276ad5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:44.349169 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-55ad283d-4c93-48b7-9fe6-80e6b15e3457 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1501 microversion: 2.1 time: 0.826106 Aug 31 16:26:44.355926 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:26:44.358580 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b245a4f4-9c2e-40be-85fc-bacf30211170 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:44.359731 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b245a4f4-9c2e-40be-85fc-bacf30211170 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:44.360471 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b245a4f4-9c2e-40be-85fc-bacf30211170 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:44.361487 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b245a4f4-9c2e-40be-85fc-bacf30211170 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:44.362911 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b245a4f4-9c2e-40be-85fc-bacf30211170 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:44.364835 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b245a4f4-9c2e-40be-85fc-bacf30211170 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:44.367414 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2821/5612] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:43 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1501 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:26:44.396371 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ddbeab6e-7db9-4a9e-ad28-01cb4ac4a0e3 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:44.397789 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ddbeab6e-7db9-4a9e-ad28-01cb4ac4a0e3 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 92076abd-df0a-4c10-bbfd-e8c304633298] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:44.415122 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ddbeab6e-7db9-4a9e-ad28-01cb4ac4a0e3 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:44.418074 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ddbeab6e-7db9-4a9e-ad28-01cb4ac4a0e3 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:44.419311 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ddbeab6e-7db9-4a9e-ad28-01cb4ac4a0e3 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:44.421889 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ddbeab6e-7db9-4a9e-ad28-01cb4ac4a0e3 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:44.423098 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ddbeab6e-7db9-4a9e-ad28-01cb4ac4a0e3 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:44.425468 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ddbeab6e-7db9-4a9e-ad28-01cb4ac4a0e3 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:44.444907 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b245a4f4-9c2e-40be-85fc-bacf30211170 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 6e139adf-20d3-4d88-941f-fe9a45276ad5] Going to try to terminate instance {{(pid=122256) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:26:44.725310 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b245a4f4-9c2e-40be-85fc-bacf30211170 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "DELETE /compute/v2.1/servers/6e139adf-20d3-4d88-941f-fe9a45276ad5" status: 204 len: 0 microversion: 2.1 time: 0.392844 Aug 31 16:26:44.735209 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2792/5613] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:26:44 2022] DELETE /compute/v2.1/servers/6e139adf-20d3-4d88-941f-fe9a45276ad5 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:26:44.752756 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1842e5be-0c00-4c6b-a7ed-d43caaeb0291 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:44.760467 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ddbeab6e-7db9-4a9e-ad28-01cb4ac4a0e3 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:44.765956 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1842e5be-0c00-4c6b-a7ed-d43caaeb0291 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: d1c50fa6-2d8a-4707-9ee7-448ea57be62b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:44.775664 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ddbeab6e-7db9-4a9e-ad28-01cb4ac4a0e3 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/92076abd-df0a-4c10-bbfd-e8c304633298" status: 200 len: 1508 microversion: 2.1 time: 0.385017 Aug 31 16:26:44.776353 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2822/5614] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:44 2022] GET /compute/v2.1/servers/92076abd-df0a-4c10-bbfd-e8c304633298 => generated 1508 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:26:44.781149 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1842e5be-0c00-4c6b-a7ed-d43caaeb0291 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:44.784153 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1842e5be-0c00-4c6b-a7ed-d43caaeb0291 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:44.784909 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1842e5be-0c00-4c6b-a7ed-d43caaeb0291 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:44.785901 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1842e5be-0c00-4c6b-a7ed-d43caaeb0291 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:44.787005 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1842e5be-0c00-4c6b-a7ed-d43caaeb0291 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:44.788094 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1842e5be-0c00-4c6b-a7ed-d43caaeb0291 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:44.823717 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-13ab1a5e-2b4b-4a94-90c9-e8426d9d8f94 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:44.825746 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-13ab1a5e-2b4b-4a94-90c9-e8426d9d8f94 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 6e139adf-20d3-4d88-941f-fe9a45276ad5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:44.849876 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-13ab1a5e-2b4b-4a94-90c9-e8426d9d8f94 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:44.850379 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-13ab1a5e-2b4b-4a94-90c9-e8426d9d8f94 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:44.850828 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-13ab1a5e-2b4b-4a94-90c9-e8426d9d8f94 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:44.856687 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-13ab1a5e-2b4b-4a94-90c9-e8426d9d8f94 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:44.857397 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-13ab1a5e-2b4b-4a94-90c9-e8426d9d8f94 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:44.858022 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-13ab1a5e-2b4b-4a94-90c9-e8426d9d8f94 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:44.907854 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1842e5be-0c00-4c6b-a7ed-d43caaeb0291 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.168829 Aug 31 16:26:44.919258 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2793/5615] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 16:26:44 2022] GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b/os-volume_attachments => generated 197 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:26:45.291093 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-13ab1a5e-2b4b-4a94-90c9-e8426d9d8f94 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133363b2b12d4730994557ee24f08879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d9ba3589a24faaac930a35742ce834', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:45.318218 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-13ab1a5e-2b4b-4a94-90c9-e8426d9d8f94 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/6e139adf-20d3-4d88-941f-fe9a45276ad5" status: 200 len: 1683 microversion: 2.1 time: 0.506169 Aug 31 16:26:45.319949 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2823/5616] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:44 2022] GET /compute/v2.1/servers/6e139adf-20d3-4d88-941f-fe9a45276ad5 => generated 1683 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:26:45.392879 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-dbc8576f-4acc-4c00-9810-b15f27d74fd1 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:45.399349 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-dbc8576f-4acc-4c00-9810-b15f27d74fd1 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:45.434203 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dbc8576f-4acc-4c00-9810-b15f27d74fd1 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:45.435686 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dbc8576f-4acc-4c00-9810-b15f27d74fd1 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:45.437208 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dbc8576f-4acc-4c00-9810-b15f27d74fd1 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:45.438905 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dbc8576f-4acc-4c00-9810-b15f27d74fd1 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:45.447491 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dbc8576f-4acc-4c00-9810-b15f27d74fd1 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:45.451228 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dbc8576f-4acc-4c00-9810-b15f27d74fd1 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:45.796126 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-dbc8576f-4acc-4c00-9810-b15f27d74fd1 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:45.815394 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-dbc8576f-4acc-4c00-9810-b15f27d74fd1 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1501 microversion: 2.1 time: 0.435062 Aug 31 16:26:45.821532 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9ce60527-81f6-43ef-9175-ecd6b972eaad tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:45.823257 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9ce60527-81f6-43ef-9175-ecd6b972eaad tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 92076abd-df0a-4c10-bbfd-e8c304633298] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:45.824981 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2794/5617] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:45 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1501 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:26:45.847549 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-abf44c9a-685e-4151-9c21-fd704d8b13d5 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Action: 'create', calling method: .version_select at 0x7f5ae8df5b80>, body: {"keypair": {"name": "tempest-keypair-250624264", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFGC8Lu2Kb6o3txtLX1t9nN1+GdVYVvAHbuVHhi5wyvPseXePB24KhUEcP/o2Fg9U97wBgpc8eutI6yqXp2L2hr98FY7aPtTiFsk2dz+JIn74Z0JuwX2ntfoOdGttkvFJQ=="}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:26:45.863898 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9ce60527-81f6-43ef-9175-ecd6b972eaad tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:45.865767 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9ce60527-81f6-43ef-9175-ecd6b972eaad tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:45.867414 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9ce60527-81f6-43ef-9175-ecd6b972eaad tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:45.869409 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9ce60527-81f6-43ef-9175-ecd6b972eaad tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:45.870983 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9ce60527-81f6-43ef-9175-ecd6b972eaad tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:45.873034 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9ce60527-81f6-43ef-9175-ecd6b972eaad tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:45.938308 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-abf44c9a-685e-4151-9c21-fd704d8b13d5 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Getting quotas for project 1c81cbf4a36943d78740dec7e7e1b4d9. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:26:45.956693 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-abf44c9a-685e-4151-9c21-fd704d8b13d5 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Getting quotas for user 6ef5541e135d48348fbb4419b29417e7 and project 1c81cbf4a36943d78740dec7e7e1b4d9. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:26:46.080625 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-abf44c9a-685e-4151-9c21-fd704d8b13d5 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.242790 Aug 31 16:26:46.082155 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2795/5618] 10.222.0.61 () {62 vars in 1200 bytes} [Wed Aug 31 16:26:45 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 246 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 31 16:26:46.096489 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-303640be-cdf9-40f7-b327-35365b84b9e5 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:46.099362 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-303640be-cdf9-40f7-b327-35365b84b9e5 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: d1c50fa6-2d8a-4707-9ee7-448ea57be62b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:46.116138 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-303640be-cdf9-40f7-b327-35365b84b9e5 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:46.119097 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-303640be-cdf9-40f7-b327-35365b84b9e5 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:46.120532 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-303640be-cdf9-40f7-b327-35365b84b9e5 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:46.124609 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-303640be-cdf9-40f7-b327-35365b84b9e5 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:46.125708 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-303640be-cdf9-40f7-b327-35365b84b9e5 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:46.128481 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-303640be-cdf9-40f7-b327-35365b84b9e5 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:46.291398 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-303640be-cdf9-40f7-b327-35365b84b9e5 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.207582 Aug 31 16:26:46.300664 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2796/5619] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 16:26:46 2022] GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b/os-volume_attachments => generated 197 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:26:46.360085 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-09f7ba1d-86d7-4eac-9aef-85ce9c9ddd4e tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:46.362068 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-09f7ba1d-86d7-4eac-9aef-85ce9c9ddd4e tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 6e139adf-20d3-4d88-941f-fe9a45276ad5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:46.382972 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9ce60527-81f6-43ef-9175-ecd6b972eaad tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:46.404559 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9ce60527-81f6-43ef-9175-ecd6b972eaad tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/92076abd-df0a-4c10-bbfd-e8c304633298" status: 200 len: 1508 microversion: 2.1 time: 0.590975 Aug 31 16:26:46.410119 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-09f7ba1d-86d7-4eac-9aef-85ce9c9ddd4e tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:46.410686 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-09f7ba1d-86d7-4eac-9aef-85ce9c9ddd4e tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:46.411061 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-09f7ba1d-86d7-4eac-9aef-85ce9c9ddd4e tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:46.412810 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2824/5620] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:45 2022] GET /compute/v2.1/servers/92076abd-df0a-4c10-bbfd-e8c304633298 => generated 1508 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:26:46.415943 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-09f7ba1d-86d7-4eac-9aef-85ce9c9ddd4e tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:46.417642 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-09f7ba1d-86d7-4eac-9aef-85ce9c9ddd4e tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:46.418880 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-09f7ba1d-86d7-4eac-9aef-85ce9c9ddd4e tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:46.860477 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-09f7ba1d-86d7-4eac-9aef-85ce9c9ddd4e tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133363b2b12d4730994557ee24f08879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d9ba3589a24faaac930a35742ce834', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:46.868589 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-dcd8800e-6c8b-440e-8e41-3099f042d2fa tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:46.871335 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-dcd8800e-6c8b-440e-8e41-3099f042d2fa tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:46.932244 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-09f7ba1d-86d7-4eac-9aef-85ce9c9ddd4e tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/6e139adf-20d3-4d88-941f-fe9a45276ad5" status: 200 len: 1683 microversion: 2.1 time: 0.592064 Aug 31 16:26:46.934906 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dcd8800e-6c8b-440e-8e41-3099f042d2fa tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:46.939297 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2797/5621] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:46 2022] GET /compute/v2.1/servers/6e139adf-20d3-4d88-941f-fe9a45276ad5 => generated 1683 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:26:46.940262 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dcd8800e-6c8b-440e-8e41-3099f042d2fa tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:46.942018 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dcd8800e-6c8b-440e-8e41-3099f042d2fa tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:46.943087 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dcd8800e-6c8b-440e-8e41-3099f042d2fa tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:46.948818 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dcd8800e-6c8b-440e-8e41-3099f042d2fa tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:46.949610 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dcd8800e-6c8b-440e-8e41-3099f042d2fa tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:47.318289 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-47266631-1de0-40cb-9df9-59659409bfdf tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:47.336598 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-47266631-1de0-40cb-9df9-59659409bfdf tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: d1c50fa6-2d8a-4707-9ee7-448ea57be62b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:47.359957 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-47266631-1de0-40cb-9df9-59659409bfdf tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:47.361934 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-47266631-1de0-40cb-9df9-59659409bfdf tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:47.369763 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-47266631-1de0-40cb-9df9-59659409bfdf tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:47.372222 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-47266631-1de0-40cb-9df9-59659409bfdf tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:47.373349 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-47266631-1de0-40cb-9df9-59659409bfdf tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:47.374410 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-47266631-1de0-40cb-9df9-59659409bfdf tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:47.380003 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-dcd8800e-6c8b-440e-8e41-3099f042d2fa tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:47.396472 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-dcd8800e-6c8b-440e-8e41-3099f042d2fa tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1504 microversion: 2.1 time: 0.532999 Aug 31 16:26:47.398640 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2825/5622] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:46 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1504 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:26:47.429131 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-578fc029-faec-40ef-bf30-05de03156db4 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:47.430579 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-578fc029-faec-40ef-bf30-05de03156db4 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:47.479636 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-578fc029-faec-40ef-bf30-05de03156db4 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:47.483489 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-578fc029-faec-40ef-bf30-05de03156db4 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:47.484721 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-578fc029-faec-40ef-bf30-05de03156db4 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:47.489133 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-578fc029-faec-40ef-bf30-05de03156db4 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:47.490342 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-578fc029-faec-40ef-bf30-05de03156db4 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:47.493446 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-578fc029-faec-40ef-bf30-05de03156db4 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:47.545423 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-47266631-1de0-40cb-9df9-59659409bfdf tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.239832 Aug 31 16:26:47.554418 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2798/5623] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 16:26:47 2022] GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b/os-volume_attachments => generated 197 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:26:47.572825 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-434cb410-c577-46bf-84d5-15970584dce0 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:47.575095 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-434cb410-c577-46bf-84d5-15970584dce0 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 92076abd-df0a-4c10-bbfd-e8c304633298] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:47.614040 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-434cb410-c577-46bf-84d5-15970584dce0 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:47.615356 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-434cb410-c577-46bf-84d5-15970584dce0 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:47.616467 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-434cb410-c577-46bf-84d5-15970584dce0 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:47.619420 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-434cb410-c577-46bf-84d5-15970584dce0 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:47.623263 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-434cb410-c577-46bf-84d5-15970584dce0 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:47.624407 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-434cb410-c577-46bf-84d5-15970584dce0 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:47.936168 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-578fc029-faec-40ef-bf30-05de03156db4 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:47.945247 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-578fc029-faec-40ef-bf30-05de03156db4 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1504 microversion: 2.1 time: 0.523728 Aug 31 16:26:47.949359 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2826/5624] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:47 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1504 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:26:47.969158 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ed7c0871-d890-4df1-b43f-f7ce2d7aca9d tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:47.970323 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ed7c0871-d890-4df1-b43f-f7ce2d7aca9d tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 6e139adf-20d3-4d88-941f-fe9a45276ad5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:47.991209 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ed7c0871-d890-4df1-b43f-f7ce2d7aca9d tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:47.998727 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ed7c0871-d890-4df1-b43f-f7ce2d7aca9d tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:48.000403 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ed7c0871-d890-4df1-b43f-f7ce2d7aca9d tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:48.003338 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ed7c0871-d890-4df1-b43f-f7ce2d7aca9d tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:48.004314 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ed7c0871-d890-4df1-b43f-f7ce2d7aca9d tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:48.005881 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ed7c0871-d890-4df1-b43f-f7ce2d7aca9d tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:49.523421 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ed7c0871-d890-4df1-b43f-f7ce2d7aca9d tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133363b2b12d4730994557ee24f08879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d9ba3589a24faaac930a35742ce834', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:49.550429 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ed7c0871-d890-4df1-b43f-f7ce2d7aca9d tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/6e139adf-20d3-4d88-941f-fe9a45276ad5" status: 200 len: 1683 microversion: 2.1 time: 1.581112 Aug 31 16:26:49.551220 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2827/5625] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:47 2022] GET /compute/v2.1/servers/6e139adf-20d3-4d88-941f-fe9a45276ad5 => generated 1683 bytes in 1598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:26:49.564242 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2e9003cb-6809-4517-bff4-7ce04bcec9dd tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:26:49.577255 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2e9003cb-6809-4517-bff4-7ce04bcec9dd tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: a21d95af-2072-4b64-b306-4750b7677fef] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:49.622828 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-2e9003cb-6809-4517-bff4-7ce04bcec9dd tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] HTTP exception thrown: Instance a21d95af-2072-4b64-b306-4750b7677fef could not be found. Aug 31 16:26:49.631203 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2e9003cb-6809-4517-bff4-7ce04bcec9dd tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Request method failure captured: Aug 31 16:26:49.631203 n-d-850499-9 devstack@n-api.service[122257]: request: POST /compute/v2.1/servers/a21d95af-2072-4b64-b306-4750b7677fef/action HTTP/1.1 Aug 31 16:26:49.631203 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:26:49.631203 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:26:49.631203 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:26:49.631203 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 15 Aug 31 16:26:49.631203 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:26:49.631203 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:26:49.631203 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:26:49.631203 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:26:49.631203 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4q2NcJzZutw3Y6jF4GnmJD1H1MzSLIbHjRxunPVSp6uKTRmCePfT1DyksG9QgDfSYnSoM0q9vOxO3sqZKoJ5PA2HppEXRHLLn8jTh4ccTKQ6q8SYb3pqui6kOFW5_PmtYr9N0lihJC0EStA4OYRI4QsHOxwmGiiVscbhBZpLyiKmV0 Aug 31 16:26:49.631203 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:26:49.631203 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:26:49.631203 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:26:49.631203 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:26:49.631203 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:26:49.631203 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:26:49.631203 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 014522b19dc349a691e1f6b131229974 Aug 31 16:26:49.631203 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:26:49.631203 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:26:49.631203 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:26:49.631203 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/014522b19dc349a691e1f6b131229974"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/014522b19dc349a691e1f6b131229974"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_014522b19dc349a691e1f6b131229974", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/014522b19dc349a691e1f6b131229974"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:26:49.631203 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:26:49.631203 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 014522b19dc349a691e1f6b131229974 Aug 31 16:26:49.631203 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:26:49.631203 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ServersNegativeTestJSON-918151355-project Aug 31 16:26:49.631203 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:26:49.631203 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:26:49.631203 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: c042c43cc2aa4000a147fae62c261e86 Aug 31 16:26:49.631203 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ServersNegativeTestJSON-918151355-project Aug 31 16:26:49.631203 n-d-850499-9 devstack@n-api.service[122257]: Aug 31 16:26:49.631203 n-d-850499-9 devstack@n-api.service[122257]: {"unpause": {}} Aug 31 16:26:49.631203 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:26:49.631203 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance a21d95af-2072-4b64-b306-4750b7677fef could not be found. Aug 31 16:26:49.631203 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': 'a21d95af-2072-4b64-b306-4750b7677fef', 'body': {'unpause': {}}} Aug 31 16:26:49.631203 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:26:49.631203 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:26:49.631203 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:26:49.631203 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:26:49.631203 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:26:49.631203 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:26:49.631203 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 31 16:26:49.631203 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 31 16:26:49.631203 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a21d95af-2072-4b64-b306-4750b7677fef could not be found. Aug 31 16:26:49.631203 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:26:49.631203 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:26:49.631203 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:26:49.631203 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:26:49.631203 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:26:49.631203 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:26:49.631203 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:26:49.631203 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:26:49.631203 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:26:49.631203 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:26:49.631203 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Aug 31 16:26:49.631203 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Aug 31 16:26:49.631203 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:26:49.631203 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:26:49.631203 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a21d95af-2072-4b64-b306-4750b7677fef could not be found. Aug 31 16:26:49.631203 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:26:49.631203 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:26:49.631203 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:26:49.631203 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:26:49.631203 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:26:49.631203 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:26:49.639312 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:26:49.639312 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:26:49.639312 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a21d95af-2072-4b64-b306-4750b7677fef could not be found. Aug 31 16:26:49.639312 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:26:49.652032 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2e9003cb-6809-4517-bff4-7ce04bcec9dd tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Returning 404 to user: Instance a21d95af-2072-4b64-b306-4750b7677fef could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:26:49.665188 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2e9003cb-6809-4517-bff4-7ce04bcec9dd tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "POST /compute/v2.1/servers/a21d95af-2072-4b64-b306-4750b7677fef/action" status: 404 len: 111 microversion: 2.1 time: 0.107899 Aug 31 16:26:49.668580 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2828/5626] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:26:49 2022] POST /compute/v2.1/servers/a21d95af-2072-4b64-b306-4750b7677fef/action => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:26:49.702549 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-434cb410-c577-46bf-84d5-15970584dce0 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:49.703850 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-60fe96e9-011e-4296-be22-ea91c41a52f2 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:49.708344 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-60fe96e9-011e-4296-be22-ea91c41a52f2 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: d1c50fa6-2d8a-4707-9ee7-448ea57be62b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:49.716403 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-434cb410-c577-46bf-84d5-15970584dce0 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/92076abd-df0a-4c10-bbfd-e8c304633298" status: 200 len: 1508 microversion: 2.1 time: 2.160022 Aug 31 16:26:49.751838 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2799/5627] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:47 2022] GET /compute/v2.1/servers/92076abd-df0a-4c10-bbfd-e8c304633298 => generated 1508 bytes in 2189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:26:49.756523 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:26:49.767331 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8077cab1-9af1-482a-a11b-1a8f0d177473 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:49.777112 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-60fe96e9-011e-4296-be22-ea91c41a52f2 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:49.777992 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-60fe96e9-011e-4296-be22-ea91c41a52f2 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:49.778774 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-60fe96e9-011e-4296-be22-ea91c41a52f2 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:49.780060 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-60fe96e9-011e-4296-be22-ea91c41a52f2 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:49.780205 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8077cab1-9af1-482a-a11b-1a8f0d177473 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:49.780873 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-60fe96e9-011e-4296-be22-ea91c41a52f2 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:49.781639 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-60fe96e9-011e-4296-be22-ea91c41a52f2 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:49.795354 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8077cab1-9af1-482a-a11b-1a8f0d177473 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:49.795882 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8077cab1-9af1-482a-a11b-1a8f0d177473 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:49.796322 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8077cab1-9af1-482a-a11b-1a8f0d177473 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:49.797044 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8077cab1-9af1-482a-a11b-1a8f0d177473 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:49.797508 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8077cab1-9af1-482a-a11b-1a8f0d177473 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:49.797953 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8077cab1-9af1-482a-a11b-1a8f0d177473 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:49.940626 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-60fe96e9-011e-4296-be22-ea91c41a52f2 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.267450 Aug 31 16:26:49.956189 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2829/5628] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 16:26:49 2022] GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b/os-volume_attachments => generated 197 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:26:50.573583 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3732f04d-aa8a-4b9b-af4e-7acc002fe774 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:50.575218 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3732f04d-aa8a-4b9b-af4e-7acc002fe774 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 6e139adf-20d3-4d88-941f-fe9a45276ad5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:50.588185 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3732f04d-aa8a-4b9b-af4e-7acc002fe774 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:50.591122 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3732f04d-aa8a-4b9b-af4e-7acc002fe774 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:50.592067 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3732f04d-aa8a-4b9b-af4e-7acc002fe774 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:50.595120 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3732f04d-aa8a-4b9b-af4e-7acc002fe774 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:50.596950 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3732f04d-aa8a-4b9b-af4e-7acc002fe774 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:50.600991 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3732f04d-aa8a-4b9b-af4e-7acc002fe774 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:50.626069 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8077cab1-9af1-482a-a11b-1a8f0d177473 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:50.637351 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8077cab1-9af1-482a-a11b-1a8f0d177473 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1504 microversion: 2.1 time: 0.874341 Aug 31 16:26:50.658584 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2800/5629] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:49 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1504 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:26:50.680963 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e111f2b6-e3e6-4c18-998c-8cc6d93927e0 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:50.685569 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e111f2b6-e3e6-4c18-998c-8cc6d93927e0 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:50.734516 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e111f2b6-e3e6-4c18-998c-8cc6d93927e0 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:50.735194 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e111f2b6-e3e6-4c18-998c-8cc6d93927e0 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:50.735821 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e111f2b6-e3e6-4c18-998c-8cc6d93927e0 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:50.736561 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e111f2b6-e3e6-4c18-998c-8cc6d93927e0 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:50.737066 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e111f2b6-e3e6-4c18-998c-8cc6d93927e0 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:50.737506 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e111f2b6-e3e6-4c18-998c-8cc6d93927e0 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:50.962774 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3732f04d-aa8a-4b9b-af4e-7acc002fe774 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133363b2b12d4730994557ee24f08879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d9ba3589a24faaac930a35742ce834', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:50.990374 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3732f04d-aa8a-4b9b-af4e-7acc002fe774 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/6e139adf-20d3-4d88-941f-fe9a45276ad5" status: 200 len: 1615 microversion: 2.1 time: 0.421681 Aug 31 16:26:50.998641 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2830/5630] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:50 2022] GET /compute/v2.1/servers/6e139adf-20d3-4d88-941f-fe9a45276ad5 => generated 1615 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:26:51.004113 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-24c32ea0-8216-4422-98eb-b53fd20fc1d2 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:51.009688 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-24c32ea0-8216-4422-98eb-b53fd20fc1d2 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 92076abd-df0a-4c10-bbfd-e8c304633298] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:51.029869 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-24c32ea0-8216-4422-98eb-b53fd20fc1d2 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:51.030835 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-24c32ea0-8216-4422-98eb-b53fd20fc1d2 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:51.031652 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-24c32ea0-8216-4422-98eb-b53fd20fc1d2 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:51.032885 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-24c32ea0-8216-4422-98eb-b53fd20fc1d2 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:51.040373 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-24c32ea0-8216-4422-98eb-b53fd20fc1d2 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:51.048423 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-24c32ea0-8216-4422-98eb-b53fd20fc1d2 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:52.015061 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e111f2b6-e3e6-4c18-998c-8cc6d93927e0 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:52.043006 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e111f2b6-e3e6-4c18-998c-8cc6d93927e0 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1504 microversion: 2.1 time: 1.360266 Aug 31 16:26:52.067877 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2801/5631] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:50 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1504 bytes in 1392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:26:52.091576 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c0c5f01a-ebfb-4bdb-9c9b-697b095e0669 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:52.098346 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c0c5f01a-ebfb-4bdb-9c9b-697b095e0669 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: d1c50fa6-2d8a-4707-9ee7-448ea57be62b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:52.121680 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-24c32ea0-8216-4422-98eb-b53fd20fc1d2 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:52.131066 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c0c5f01a-ebfb-4bdb-9c9b-697b095e0669 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:52.137378 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c0c5f01a-ebfb-4bdb-9c9b-697b095e0669 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:52.144058 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c0c5f01a-ebfb-4bdb-9c9b-697b095e0669 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:52.145288 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c0c5f01a-ebfb-4bdb-9c9b-697b095e0669 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:52.146922 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-24c32ea0-8216-4422-98eb-b53fd20fc1d2 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/92076abd-df0a-4c10-bbfd-e8c304633298" status: 200 len: 1508 microversion: 2.1 time: 1.142333 Aug 31 16:26:52.150944 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c0c5f01a-ebfb-4bdb-9c9b-697b095e0669 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:52.152639 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c0c5f01a-ebfb-4bdb-9c9b-697b095e0669 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:52.153129 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2831/5632] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:50 2022] GET /compute/v2.1/servers/92076abd-df0a-4c10-bbfd-e8c304633298 => generated 1508 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:26:52.173002 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a050c63d-0ec4-4787-bb14-7c239b7d937e tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1599926864", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bf979fdf-6d8e-4f7d-940c-521a4ddcf886"}], "security_groups": [{"name": "tempest-securitygroup--582983971"}], "key_name": "tempest-keypair-250624264", "user_data": "}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:26:52.265948 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c0c5f01a-ebfb-4bdb-9c9b-697b095e0669 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.196452 Aug 31 16:26:52.274032 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2802/5633] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 16:26:52 2022] GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b/os-volume_attachments => generated 197 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:26:52.282208 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-bdd5b09b-4234-4b11-b45b-14b3929e8804 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:52.290823 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-bdd5b09b-4234-4b11-b45b-14b3929e8804 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 6e139adf-20d3-4d88-941f-fe9a45276ad5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:52.303185 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bdd5b09b-4234-4b11-b45b-14b3929e8804 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:52.308830 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bdd5b09b-4234-4b11-b45b-14b3929e8804 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:52.309878 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bdd5b09b-4234-4b11-b45b-14b3929e8804 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:52.311757 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bdd5b09b-4234-4b11-b45b-14b3929e8804 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:52.312532 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bdd5b09b-4234-4b11-b45b-14b3929e8804 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:52.313235 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bdd5b09b-4234-4b11-b45b-14b3929e8804 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:52.333315 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:26:52.461769 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bdd5b09b-4234-4b11-b45b-14b3929e8804 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:52.462834 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bdd5b09b-4234-4b11-b45b-14b3929e8804 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:52.464542 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bdd5b09b-4234-4b11-b45b-14b3929e8804 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:52.466688 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-bdd5b09b-4234-4b11-b45b-14b3929e8804 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lazy-loading 'fault' on Instance uuid 6e139adf-20d3-4d88-941f-fe9a45276ad5 {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:26:52.564504 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-a050c63d-0ec4-4787-bb14-7c239b7d937e tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] validate_networks() for [('bf979fdf-6d8e-4f7d-940c-521a4ddcf886', None, None, None, None, None)] {{(pid=122257) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:26:53.988283 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-bdd5b09b-4234-4b11-b45b-14b3929e8804 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133363b2b12d4730994557ee24f08879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d9ba3589a24faaac930a35742ce834', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:53.998377 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-bdd5b09b-4234-4b11-b45b-14b3929e8804 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/6e139adf-20d3-4d88-941f-fe9a45276ad5" status: 200 len: 1331 microversion: 2.1 time: 1.722798 Aug 31 16:26:54.001966 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2803/5634] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:52 2022] GET /compute/v2.1/servers/6e139adf-20d3-4d88-941f-fe9a45276ad5 => generated 1331 bytes in 1727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:26:54.016621 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a7e6ae79-9e20-4073-8dab-e9589d7f106d tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:26:54.017282 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a7e6ae79-9e20-4073-8dab-e9589d7f106d tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:54.047940 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a7e6ae79-9e20-4073-8dab-e9589d7f106d tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:54.049027 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a7e6ae79-9e20-4073-8dab-e9589d7f106d tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:54.049838 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a7e6ae79-9e20-4073-8dab-e9589d7f106d tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:54.051005 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a7e6ae79-9e20-4073-8dab-e9589d7f106d tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:54.051525 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a7e6ae79-9e20-4073-8dab-e9589d7f106d tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:54.052003 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a7e6ae79-9e20-4073-8dab-e9589d7f106d tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:54.143099 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-a7e6ae79-9e20-4073-8dab-e9589d7f106d tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] HTTP exception thrown: Cannot 'unpause' instance 22082563-385d-41a9-baa5-6fb277278505 while it is in vm_state active Aug 31 16:26:54.149117 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a7e6ae79-9e20-4073-8dab-e9589d7f106d tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Request method failure captured: Aug 31 16:26:54.149117 n-d-850499-9 devstack@n-api.service[122256]: request: POST /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505/action HTTP/1.1 Aug 31 16:26:54.149117 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:26:54.149117 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:26:54.149117 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:26:54.149117 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 15 Aug 31 16:26:54.149117 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:26:54.149117 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:26:54.149117 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:26:54.149117 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:26:54.149117 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4q2NcJzZutw3Y6jF4GnmJD1H1MzSLIbHjRxunPVSp6uKTRmCePfT1DyksG9QgDfSYnSoM0q9vOxO3sqZKoJ5PA2HppEXRHLLn8jTh4ccTKQ6q8SYb3pqui6kOFW5_PmtYr9N0lihJC0EStA4OYRI4QsHOxwmGiiVscbhBZpLyiKmV0 Aug 31 16:26:54.149117 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:26:54.149117 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:26:54.149117 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:26:54.149117 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:26:54.149117 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:26:54.149117 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:26:54.149117 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 014522b19dc349a691e1f6b131229974 Aug 31 16:26:54.149117 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:26:54.149117 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:26:54.149117 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:26:54.149117 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/014522b19dc349a691e1f6b131229974"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/014522b19dc349a691e1f6b131229974"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_014522b19dc349a691e1f6b131229974", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/014522b19dc349a691e1f6b131229974"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:26:54.149117 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:26:54.149117 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 014522b19dc349a691e1f6b131229974 Aug 31 16:26:54.149117 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:26:54.149117 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ServersNegativeTestJSON-918151355-project Aug 31 16:26:54.149117 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:26:54.149117 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:26:54.149117 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: c042c43cc2aa4000a147fae62c261e86 Aug 31 16:26:54.149117 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ServersNegativeTestJSON-918151355-project Aug 31 16:26:54.149117 n-d-850499-9 devstack@n-api.service[122256]: Aug 31 16:26:54.149117 n-d-850499-9 devstack@n-api.service[122256]: {"unpause": {}} Aug 31 16:26:54.149117 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:26:54.149117 n-d-850499-9 devstack@n-api.service[122256]: exception: Cannot 'unpause' instance 22082563-385d-41a9-baa5-6fb277278505 while it is in vm_state active Aug 31 16:26:54.149117 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '22082563-385d-41a9-baa5-6fb277278505', 'body': {'unpause': {}}} Aug 31 16:26:54.149117 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:26:54.149117 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:26:54.149117 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Aug 31 16:26:54.149117 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Aug 31 16:26:54.149117 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 16:26:54.149117 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 16:26:54.149117 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 31 16:26:54.149117 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 31 16:26:54.149117 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 22082563-385d-41a9-baa5-6fb277278505 in vm_state active. Cannot unpause while the instance is in this state. Aug 31 16:26:54.149117 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:26:54.149117 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:26:54.149117 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:26:54.149117 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:26:54.149117 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:26:54.149117 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:26:54.149117 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:26:54.149117 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:26:54.149117 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:26:54.149117 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:26:54.149117 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Aug 31 16:26:54.149117 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 31 16:26:54.149117 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 31 16:26:54.149117 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 31 16:26:54.149117 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 22082563-385d-41a9-baa5-6fb277278505 while it is in vm_state active Aug 31 16:26:54.149117 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:26:54.149117 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:26:54.149117 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:26:54.149117 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:26:54.149117 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:26:54.155309 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:26:54.155309 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:26:54.155309 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:26:54.155309 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 22082563-385d-41a9-baa5-6fb277278505 while it is in vm_state active Aug 31 16:26:54.155309 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:26:54.156583 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a7e6ae79-9e20-4073-8dab-e9589d7f106d tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Returning 409 to user: Cannot 'unpause' instance 22082563-385d-41a9-baa5-6fb277278505 while it is in vm_state active {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:26:54.157640 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a7e6ae79-9e20-4073-8dab-e9589d7f106d tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "POST /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505/action" status: 409 len: 145 microversion: 2.1 time: 0.154599 Aug 31 16:26:54.163827 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2804/5635] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:26:54 2022] POST /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505/action => generated 145 bytes in 161 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 31 16:26:54.189262 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-c8c24881-0bed-42e5-b9bd-7094b8dbddbe req-6b161418-169f-478c-b608-7fb82d17514e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e139adf-20d3-4d88-941f-fe9a45276ad5", "name": "network-vif-deleted", "tag": "329b15f2-26ad-48cd-a95e-e8b610ce8985"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:26:54.205144 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-c8c24881-0bed-42e5-b9bd-7094b8dbddbe req-6b161418-169f-478c-b608-7fb82d17514e service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:54.206096 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-c8c24881-0bed-42e5-b9bd-7094b8dbddbe req-6b161418-169f-478c-b608-7fb82d17514e service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:54.206783 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-c8c24881-0bed-42e5-b9bd-7094b8dbddbe req-6b161418-169f-478c-b608-7fb82d17514e service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:54.230238 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-c8c24881-0bed-42e5-b9bd-7094b8dbddbe req-6b161418-169f-478c-b608-7fb82d17514e service nova] Creating event network-vif-deleted:329b15f2-26ad-48cd-a95e-e8b610ce8985 for instance 6e139adf-20d3-4d88-941f-fe9a45276ad5 on n-h1-850499-9 Aug 31 16:26:54.239806 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-c8c24881-0bed-42e5-b9bd-7094b8dbddbe req-6b161418-169f-478c-b608-7fb82d17514e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070458 Aug 31 16:26:54.241320 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2805/5636] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:26:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:26:54.249056 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-751c47bd-4e07-4b6e-a408-9617653648c7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:54.250696 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-751c47bd-4e07-4b6e-a408-9617653648c7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 92076abd-df0a-4c10-bbfd-e8c304633298] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:54.332245 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-751c47bd-4e07-4b6e-a408-9617653648c7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:54.332888 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-751c47bd-4e07-4b6e-a408-9617653648c7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:54.333461 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-751c47bd-4e07-4b6e-a408-9617653648c7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:54.334455 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-751c47bd-4e07-4b6e-a408-9617653648c7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:54.334967 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-751c47bd-4e07-4b6e-a408-9617653648c7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:54.348165 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-751c47bd-4e07-4b6e-a408-9617653648c7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:55.189410 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-a050c63d-0ec4-4787-bb14-7c239b7d937e tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:26:55.190690 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-a050c63d-0ec4-4787-bb14-7c239b7d937e tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:26:55.191434 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-a050c63d-0ec4-4787-bb14-7c239b7d937e tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:26:55.192126 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-a050c63d-0ec4-4787-bb14-7c239b7d937e tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:26:55.192792 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-a050c63d-0ec4-4787-bb14-7c239b7d937e tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:26:55.212966 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a050c63d-0ec4-4787-bb14-7c239b7d937e tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:55.216246 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a050c63d-0ec4-4787-bb14-7c239b7d937e tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:55.217118 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a050c63d-0ec4-4787-bb14-7c239b7d937e tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:55.218173 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a050c63d-0ec4-4787-bb14-7c239b7d937e tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:55.221625 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a050c63d-0ec4-4787-bb14-7c239b7d937e tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:55.222211 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a050c63d-0ec4-4787-bb14-7c239b7d937e tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:55.267712 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-a050c63d-0ec4-4787-bb14-7c239b7d937e tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Getting quotas for project 1c81cbf4a36943d78740dec7e7e1b4d9. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:26:55.294358 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-a050c63d-0ec4-4787-bb14-7c239b7d937e tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Getting quotas for user 6ef5541e135d48348fbb4419b29417e7 and project 1c81cbf4a36943d78740dec7e7e1b4d9. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:26:55.318826 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a050c63d-0ec4-4787-bb14-7c239b7d937e tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Going to run 1 instances... {{(pid=122257) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:26:55.321445 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a050c63d-0ec4-4787-bb14-7c239b7d937e tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: b31fb01b-045f-41f7-bf58-66c1eca839e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:26:55.329249 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-751c47bd-4e07-4b6e-a408-9617653648c7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:55.338102 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-751c47bd-4e07-4b6e-a408-9617653648c7 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/92076abd-df0a-4c10-bbfd-e8c304633298" status: 200 len: 1508 microversion: 2.1 time: 1.094757 Aug 31 16:26:55.343137 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2806/5637] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:54 2022] GET /compute/v2.1/servers/92076abd-df0a-4c10-bbfd-e8c304633298 => generated 1508 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:26:55.349088 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2f7170e8-4b94-419b-9f72-18d1edeeba0e tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:55.351904 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2f7170e8-4b94-419b-9f72-18d1edeeba0e tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: d1c50fa6-2d8a-4707-9ee7-448ea57be62b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:55.359701 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2f7170e8-4b94-419b-9f72-18d1edeeba0e tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:55.360649 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2f7170e8-4b94-419b-9f72-18d1edeeba0e tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:55.361644 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2f7170e8-4b94-419b-9f72-18d1edeeba0e tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:55.362654 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2f7170e8-4b94-419b-9f72-18d1edeeba0e tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:55.363361 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2f7170e8-4b94-419b-9f72-18d1edeeba0e tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:55.364476 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2f7170e8-4b94-419b-9f72-18d1edeeba0e tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:55.427084 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2f7170e8-4b94-419b-9f72-18d1edeeba0e tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081962 Aug 31 16:26:55.428331 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2807/5638] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 16:26:55 2022] GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:26:55.441850 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a050c63d-0ec4-4787-bb14-7c239b7d937e tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 3.287189 Aug 31 16:26:55.443257 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2832/5639] 10.222.0.61 () {62 vars in 1188 bytes} [Wed Aug 31 16:26:52 2022] POST /compute/v2.1/servers => generated 401 bytes in 3289 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 31 16:26:55.452350 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5b6c2323-4542-4387-9ec3-4b0c6b347491 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:55.455421 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5b6c2323-4542-4387-9ec3-4b0c6b347491 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 6e139adf-20d3-4d88-941f-fe9a45276ad5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:55.468675 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-eb9e54e4-bcbf-4558-b1e9-ef0f37c7b0d5 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:55.469561 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-eb9e54e4-bcbf-4558-b1e9-ef0f37c7b0d5 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:55.472570 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b6c2323-4542-4387-9ec3-4b0c6b347491 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:55.473465 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b6c2323-4542-4387-9ec3-4b0c6b347491 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:55.474551 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b6c2323-4542-4387-9ec3-4b0c6b347491 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:55.475552 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b6c2323-4542-4387-9ec3-4b0c6b347491 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:55.476675 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b6c2323-4542-4387-9ec3-4b0c6b347491 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:55.478693 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b6c2323-4542-4387-9ec3-4b0c6b347491 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:55.491070 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:26:55.491480 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eb9e54e4-bcbf-4558-b1e9-ef0f37c7b0d5 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:55.491480 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eb9e54e4-bcbf-4558-b1e9-ef0f37c7b0d5 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:55.491480 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eb9e54e4-bcbf-4558-b1e9-ef0f37c7b0d5 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:55.491480 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eb9e54e4-bcbf-4558-b1e9-ef0f37c7b0d5 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:55.491480 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eb9e54e4-bcbf-4558-b1e9-ef0f37c7b0d5 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:55.492435 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eb9e54e4-bcbf-4558-b1e9-ef0f37c7b0d5 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:55.534511 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-5b6c2323-4542-4387-9ec3-4b0c6b347491 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] HTTP exception thrown: Instance 6e139adf-20d3-4d88-941f-fe9a45276ad5 could not be found. Aug 31 16:26:55.545735 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5b6c2323-4542-4387-9ec3-4b0c6b347491 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Request method failure captured: Aug 31 16:26:55.545735 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/6e139adf-20d3-4d88-941f-fe9a45276ad5 HTTP/1.1 Aug 31 16:26:55.545735 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:26:55.545735 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:26:55.545735 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:26:55.545735 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:26:55.545735 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:26:55.545735 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:26:55.545735 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:26:55.545735 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:26:55.545735 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4rNdtL8Hp93envnJYgxrkKzEuKKLro2yD65tuaCjxV170sTEb0vV7K7CSwqb17J41LEaCf2veX7M0gQMtVuIZTkoy1EqZ7hcQ7-sxxS5qnxJzqp8zg_d5_eF53mYW1SiUWmb2sxTco76Ig5gniRxyga2-esulxOQeqjncU6078g4lk Aug 31 16:26:55.545735 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:26:55.545735 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:26:55.545735 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:26:55.545735 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:26:55.545735 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:26:55.545735 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:26:55.545735 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 79d9ba3589a24faaac930a35742ce834 Aug 31 16:26:55.545735 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-AttachVolumeNegativeTest-1703723156 Aug 31 16:26:55.545735 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:26:55.545735 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:26:55.545735 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/79d9ba3589a24faaac930a35742ce834"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/79d9ba3589a24faaac930a35742ce834"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_79d9ba3589a24faaac930a35742ce834", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/79d9ba3589a24faaac930a35742ce834"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:26:55.545735 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-AttachVolumeNegativeTest-1703723156 Aug 31 16:26:55.545735 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 79d9ba3589a24faaac930a35742ce834 Aug 31 16:26:55.545735 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1703723156 Aug 31 16:26:55.545735 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-AttachVolumeNegativeTest-1703723156-project Aug 31 16:26:55.545735 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:26:55.545735 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:26:55.545735 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 133363b2b12d4730994557ee24f08879 Aug 31 16:26:55.545735 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-AttachVolumeNegativeTest-1703723156-project Aug 31 16:26:55.545735 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:26:55.545735 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance 6e139adf-20d3-4d88-941f-fe9a45276ad5 could not be found. Aug 31 16:26:55.545735 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '6e139adf-20d3-4d88-941f-fe9a45276ad5'} Aug 31 16:26:55.545735 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:26:55.545735 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:26:55.545735 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:26:55.545735 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:26:55.545735 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:26:55.545735 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:26:55.545735 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:26:55.545735 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:26:55.545735 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:26:55.545735 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:26:55.545735 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e139adf-20d3-4d88-941f-fe9a45276ad5 could not be found. Aug 31 16:26:55.545735 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:26:55.545735 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:26:55.545735 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:26:55.545735 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:26:55.545735 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:26:55.545735 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:26:55.545735 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:26:55.545735 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:26:55.545735 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:26:55.545735 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:26:55.545735 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:26:55.545735 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:26:55.545735 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:26:55.545735 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:26:55.545735 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:26:55.545735 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:26:55.545735 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e139adf-20d3-4d88-941f-fe9a45276ad5 could not be found. Aug 31 16:26:55.545735 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:26:55.545735 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:26:55.545735 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:26:55.551917 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:26:55.551917 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:26:55.551917 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:26:55.551917 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:26:55.551917 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:26:55.551917 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e139adf-20d3-4d88-941f-fe9a45276ad5 could not be found. Aug 31 16:26:55.551917 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:26:55.552557 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5b6c2323-4542-4387-9ec3-4b0c6b347491 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Returning 404 to user: Instance 6e139adf-20d3-4d88-941f-fe9a45276ad5 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:26:55.553673 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5b6c2323-4542-4387-9ec3-4b0c6b347491 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/6e139adf-20d3-4d88-941f-fe9a45276ad5" status: 404 len: 111 microversion: 2.1 time: 0.109210 Aug 31 16:26:55.554710 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2833/5640] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:55 2022] GET /compute/v2.1/servers/6e139adf-20d3-4d88-941f-fe9a45276ad5 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:26:55.569890 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1738f4d2-9386-418d-9926-554a3c12ac4c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:55.570709 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1738f4d2-9386-418d-9926-554a3c12ac4c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: b31fb01b-045f-41f7-bf58-66c1eca839e8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:55.819523 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-1738f4d2-9386-418d-9926-554a3c12ac4c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:55.832873 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-1738f4d2-9386-418d-9926-554a3c12ac4c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:55.838209 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-1738f4d2-9386-418d-9926-554a3c12ac4c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:55.841967 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1738f4d2-9386-418d-9926-554a3c12ac4c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8" status: 200 len: 1281 microversion: 2.20 time: 0.285257 Aug 31 16:26:55.843934 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2834/5641] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:26:55 2022] GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8 => generated 1281 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:26:55.868769 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-985466b6-8c9e-41b4-a296-26e1755fae86 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '.version_select at 0x7f5aed29a9d0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:55.931887 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-985466b6-8c9e-41b4-a296-26e1755fae86 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1691197990" status: 202 len: 0 microversion: 2.1 time: 0.086439 Aug 31 16:26:55.934753 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2835/5642] 10.222.0.61 () {58 vars in 1221 bytes} [Wed Aug 31 16:26:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1691197990 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:26:56.010953 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=4 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:26:56.186910 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-eb9e54e4-bcbf-4558-b1e9-ef0f37c7b0d5 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:56.204574 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-eb9e54e4-bcbf-4558-b1e9-ef0f37c7b0d5 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1504 microversion: 2.1 time: 0.774561 Aug 31 16:26:56.205237 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2808/5643] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:55 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1504 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:26:56.237352 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e3c0ca90-1559-47a9-b709-0ab1097066b9 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:56.238144 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e3c0ca90-1559-47a9-b709-0ab1097066b9 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:56.256301 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e3c0ca90-1559-47a9-b709-0ab1097066b9 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:56.256908 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e3c0ca90-1559-47a9-b709-0ab1097066b9 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:56.257643 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e3c0ca90-1559-47a9-b709-0ab1097066b9 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:56.258682 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e3c0ca90-1559-47a9-b709-0ab1097066b9 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:56.259452 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e3c0ca90-1559-47a9-b709-0ab1097066b9 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:56.260257 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e3c0ca90-1559-47a9-b709-0ab1097066b9 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:56.369056 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-04804f40-9fa3-4915-a501-382a12a79f5d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:56.369767 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-04804f40-9fa3-4915-a501-382a12a79f5d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 92076abd-df0a-4c10-bbfd-e8c304633298] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:56.377641 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-04804f40-9fa3-4915-a501-382a12a79f5d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:56.378157 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-04804f40-9fa3-4915-a501-382a12a79f5d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:56.378605 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-04804f40-9fa3-4915-a501-382a12a79f5d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:56.379432 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-04804f40-9fa3-4915-a501-382a12a79f5d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:56.379973 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-04804f40-9fa3-4915-a501-382a12a79f5d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:56.380705 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-04804f40-9fa3-4915-a501-382a12a79f5d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:56.819317 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e3c0ca90-1559-47a9-b709-0ab1097066b9 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:56.840340 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e3c0ca90-1559-47a9-b709-0ab1097066b9 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1504 microversion: 2.1 time: 0.605493 Aug 31 16:26:56.841307 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2836/5644] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:56 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1504 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:26:56.854228 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-bd782365-c0eb-44ef-b37a-3442179b4758 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:56.863458 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-bd782365-c0eb-44ef-b37a-3442179b4758 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: d1c50fa6-2d8a-4707-9ee7-448ea57be62b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:56.878495 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bd782365-c0eb-44ef-b37a-3442179b4758 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:56.880084 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bd782365-c0eb-44ef-b37a-3442179b4758 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:56.880806 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bd782365-c0eb-44ef-b37a-3442179b4758 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:56.882847 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bd782365-c0eb-44ef-b37a-3442179b4758 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:56.885968 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bd782365-c0eb-44ef-b37a-3442179b4758 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:56.887324 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bd782365-c0eb-44ef-b37a-3442179b4758 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:56.966344 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-bd782365-c0eb-44ef-b37a-3442179b4758 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.120920 Aug 31 16:26:56.968061 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2837/5645] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 16:26:56 2022] GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b/os-volume_attachments => generated 25 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 16:26:56.973096 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-04804f40-9fa3-4915-a501-382a12a79f5d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:56.981332 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4d731c1e-e5c6-4159-a774-87cab0073d2a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:26:56.982508 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4d731c1e-e5c6-4159-a774-87cab0073d2a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: f1d3478c-c062-44fe-a5fc-07768c4e21b1] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:56.990384 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-04804f40-9fa3-4915-a501-382a12a79f5d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/92076abd-df0a-4c10-bbfd-e8c304633298" status: 200 len: 1505 microversion: 2.1 time: 0.627088 Aug 31 16:26:56.991102 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-4d731c1e-e5c6-4159-a774-87cab0073d2a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] HTTP exception thrown: Instance f1d3478c-c062-44fe-a5fc-07768c4e21b1 could not be found. Aug 31 16:26:56.994871 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4d731c1e-e5c6-4159-a774-87cab0073d2a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Request method failure captured: Aug 31 16:26:56.994871 n-d-850499-9 devstack@n-api.service[122257]: request: POST /compute/v2.1/servers/f1d3478c-c062-44fe-a5fc-07768c4e21b1/action HTTP/1.1 Aug 31 16:26:56.994871 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:26:56.994871 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:26:56.994871 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:26:56.994871 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 18 Aug 31 16:26:56.994871 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:26:56.994871 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:26:56.994871 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:26:56.994871 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:26:56.994871 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4q2NcJzZutw3Y6jF4GnmJD1H1MzSLIbHjRxunPVSp6uKTRmCePfT1DyksG9QgDfSYnSoM0q9vOxO3sqZKoJ5PA2HppEXRHLLn8jTh4ccTKQ6q8SYb3pqui6kOFW5_PmtYr9N0lihJC0EStA4OYRI4QsHOxwmGiiVscbhBZpLyiKmV0 Aug 31 16:26:56.994871 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:26:56.994871 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:26:56.994871 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:26:56.994871 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:26:56.994871 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:26:56.994871 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:26:56.994871 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 014522b19dc349a691e1f6b131229974 Aug 31 16:26:56.994871 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:26:56.994871 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:26:56.994871 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:26:56.994871 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/014522b19dc349a691e1f6b131229974"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/014522b19dc349a691e1f6b131229974"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_014522b19dc349a691e1f6b131229974", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/014522b19dc349a691e1f6b131229974"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:26:56.994871 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:26:56.994871 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 014522b19dc349a691e1f6b131229974 Aug 31 16:26:56.994871 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:26:56.994871 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ServersNegativeTestJSON-918151355-project Aug 31 16:26:56.994871 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:26:56.994871 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:26:56.994871 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: c042c43cc2aa4000a147fae62c261e86 Aug 31 16:26:56.994871 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ServersNegativeTestJSON-918151355-project Aug 31 16:26:56.994871 n-d-850499-9 devstack@n-api.service[122257]: Aug 31 16:26:56.994871 n-d-850499-9 devstack@n-api.service[122257]: {"unshelve": null} Aug 31 16:26:56.994871 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:26:56.994871 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance f1d3478c-c062-44fe-a5fc-07768c4e21b1 could not be found. Aug 31 16:26:56.994871 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': 'f1d3478c-c062-44fe-a5fc-07768c4e21b1', 'body': {'unshelve': None}} Aug 31 16:26:56.994871 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:26:56.994871 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:26:56.994871 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:26:56.994871 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:26:56.994871 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:26:56.994871 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:26:56.994871 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 31 16:26:56.994871 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 31 16:26:56.994871 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1d3478c-c062-44fe-a5fc-07768c4e21b1 could not be found. Aug 31 16:26:56.994871 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:26:56.994871 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:26:56.994871 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:26:56.994871 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:26:56.994871 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:26:56.994871 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:26:56.994871 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:26:56.994871 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:26:56.994871 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:26:56.994871 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:26:56.994871 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:26:56.994871 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:26:56.994871 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:26:56.994871 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:26:56.994871 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Aug 31 16:26:56.994871 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 31 16:26:56.994871 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:26:56.994871 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:26:56.994871 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1d3478c-c062-44fe-a5fc-07768c4e21b1 could not be found. Aug 31 16:26:56.994871 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:26:56.994871 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:26:57.000367 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:26:57.000367 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:26:57.000367 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:26:57.000367 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:26:57.000367 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:26:57.000367 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:26:57.000367 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1d3478c-c062-44fe-a5fc-07768c4e21b1 could not be found. Aug 31 16:26:57.000367 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:26:57.001420 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2809/5646] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:56 2022] GET /compute/v2.1/servers/92076abd-df0a-4c10-bbfd-e8c304633298 => generated 1505 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:26:57.002947 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4d731c1e-e5c6-4159-a774-87cab0073d2a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Returning 404 to user: Instance f1d3478c-c062-44fe-a5fc-07768c4e21b1 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:26:57.004089 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4d731c1e-e5c6-4159-a774-87cab0073d2a tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "POST /compute/v2.1/servers/f1d3478c-c062-44fe-a5fc-07768c4e21b1/action" status: 404 len: 111 microversion: 2.1 time: 0.034561 Aug 31 16:26:57.008201 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2838/5647] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:26:56 2022] POST /compute/v2.1/servers/f1d3478c-c062-44fe-a5fc-07768c4e21b1/action => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:26:57.014513 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-867bd2e6-6e61-4d5d-992e-e0f2ee3b4180 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:57.015864 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-867bd2e6-6e61-4d5d-992e-e0f2ee3b4180 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:57.023110 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b5f17d79-dfb7-4c5b-86df-a31902b397aa tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:57.029749 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b5f17d79-dfb7-4c5b-86df-a31902b397aa tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: b31fb01b-045f-41f7-bf58-66c1eca839e8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:57.030964 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-867bd2e6-6e61-4d5d-992e-e0f2ee3b4180 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:57.032098 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-867bd2e6-6e61-4d5d-992e-e0f2ee3b4180 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:57.033157 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-867bd2e6-6e61-4d5d-992e-e0f2ee3b4180 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:57.034838 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-867bd2e6-6e61-4d5d-992e-e0f2ee3b4180 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:57.035692 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-867bd2e6-6e61-4d5d-992e-e0f2ee3b4180 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:57.036330 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-867bd2e6-6e61-4d5d-992e-e0f2ee3b4180 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:57.062561 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b5f17d79-dfb7-4c5b-86df-a31902b397aa tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:57.063089 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b5f17d79-dfb7-4c5b-86df-a31902b397aa tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:57.065847 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b5f17d79-dfb7-4c5b-86df-a31902b397aa tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:57.066625 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b5f17d79-dfb7-4c5b-86df-a31902b397aa tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:57.067105 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b5f17d79-dfb7-4c5b-86df-a31902b397aa tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:57.067572 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b5f17d79-dfb7-4c5b-86df-a31902b397aa tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:57.241586 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b5f17d79-dfb7-4c5b-86df-a31902b397aa tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:57.256670 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b5f17d79-dfb7-4c5b-86df-a31902b397aa tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:57.258574 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b5f17d79-dfb7-4c5b-86df-a31902b397aa tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:57.261237 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b5f17d79-dfb7-4c5b-86df-a31902b397aa tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8" status: 200 len: 1285 microversion: 2.20 time: 0.261273 Aug 31 16:26:57.276989 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2810/5648] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:26:56 2022] GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8 => generated 1285 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:26:57.283570 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b9d87efd-c462-448c-af27-3e1b439e55de tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:26:57.287269 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b9d87efd-c462-448c-af27-3e1b439e55de tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: 238b044c-ec15-4c03-88da-d90f9b1ec116] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:57.309412 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b9d87efd-c462-448c-af27-3e1b439e55de tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:57.309916 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b9d87efd-c462-448c-af27-3e1b439e55de tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:57.310629 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b9d87efd-c462-448c-af27-3e1b439e55de tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:57.311670 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b9d87efd-c462-448c-af27-3e1b439e55de tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:57.312729 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b9d87efd-c462-448c-af27-3e1b439e55de tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:57.313354 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b9d87efd-c462-448c-af27-3e1b439e55de tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:57.318282 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-867bd2e6-6e61-4d5d-992e-e0f2ee3b4180 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:57.336317 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-867bd2e6-6e61-4d5d-992e-e0f2ee3b4180 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1504 microversion: 2.1 time: 0.326707 Aug 31 16:26:57.336923 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2839/5649] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:57 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1504 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:26:57.362596 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b51b1a57-1273-452b-9b20-e8e9b505929f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:57.363219 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b51b1a57-1273-452b-9b20-e8e9b505929f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:57.371373 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b51b1a57-1273-452b-9b20-e8e9b505929f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:57.373700 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-b9d87efd-c462-448c-af27-3e1b439e55de tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] HTTP exception thrown: Cannot 'reboot' instance 238b044c-ec15-4c03-88da-d90f9b1ec116 while it is in vm_state rescued Aug 31 16:26:57.375762 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b9d87efd-c462-448c-af27-3e1b439e55de tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Request method failure captured: Aug 31 16:26:57.375762 n-d-850499-9 devstack@n-api.service[122256]: request: POST /compute/v2.1/servers/238b044c-ec15-4c03-88da-d90f9b1ec116/action HTTP/1.1 Aug 31 16:26:57.375762 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:26:57.375762 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:26:57.375762 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:26:57.375762 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 28 Aug 31 16:26:57.375762 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:26:57.375762 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:26:57.375762 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:26:57.375762 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:26:57.375762 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4oy7qo0hac0I9IpX9ONeLQn5FXZxTJLjhjMB-WYHPcUUf61xQVdU4TOXEJINvaGC5c5Wjhk9pb4p_bnOvsu8HLsM1WUDttS1HJeEirzVfdDQ2PqvMBOo0UbRSxhckjuHlfQOCH8lv8yi1i-W11nad5j2vdw9RWWfX0Cd51S12MLuko Aug 31 16:26:57.375762 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:26:57.375762 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:26:57.375762 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:26:57.375762 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:26:57.375762 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:26:57.375762 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:26:57.375762 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: e014d4e4da5e47ff9a1261e7730034ac Aug 31 16:26:57.375762 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1963116327 Aug 31 16:26:57.375762 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:26:57.375762 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:26:57.375762 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e014d4e4da5e47ff9a1261e7730034ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/e014d4e4da5e47ff9a1261e7730034ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_e014d4e4da5e47ff9a1261e7730034ac", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e014d4e4da5e47ff9a1261e7730034ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:26:57.375762 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1963116327 Aug 31 16:26:57.375762 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: e014d4e4da5e47ff9a1261e7730034ac Aug 31 16:26:57.375762 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1963116327 Aug 31 16:26:57.375762 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ServerRescueNegativeTestJSON-1963116327-project Aug 31 16:26:57.375762 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:26:57.375762 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:26:57.375762 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: e4744703b964435bbead751ca884d1ae Aug 31 16:26:57.375762 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1963116327-project Aug 31 16:26:57.375762 n-d-850499-9 devstack@n-api.service[122256]: Aug 31 16:26:57.375762 n-d-850499-9 devstack@n-api.service[122256]: {"reboot": {"type": "HARD"}} Aug 31 16:26:57.375762 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:26:57.375762 n-d-850499-9 devstack@n-api.service[122256]: exception: Cannot 'reboot' instance 238b044c-ec15-4c03-88da-d90f9b1ec116 while it is in vm_state rescued Aug 31 16:26:57.375762 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '238b044c-ec15-4c03-88da-d90f9b1ec116', 'body': {'reboot': {'type': 'HARD'}}} Aug 31 16:26:57.375762 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:26:57.375762 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:26:57.375762 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Aug 31 16:26:57.375762 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Aug 31 16:26:57.375762 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 16:26:57.375762 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 16:26:57.375762 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Aug 31 16:26:57.375762 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Aug 31 16:26:57.375762 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 31 16:26:57.375762 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 31 16:26:57.375762 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 238b044c-ec15-4c03-88da-d90f9b1ec116 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Aug 31 16:26:57.375762 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:26:57.375762 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:26:57.375762 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:26:57.375762 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:26:57.375762 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:26:57.375762 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:26:57.375762 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:26:57.375762 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:26:57.375762 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:26:57.375762 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:26:57.375762 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:26:57.375762 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:26:57.375762 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Aug 31 16:26:57.375762 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 31 16:26:57.375762 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 31 16:26:57.375762 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 31 16:26:57.381405 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 238b044c-ec15-4c03-88da-d90f9b1ec116 while it is in vm_state rescued Aug 31 16:26:57.381405 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:26:57.381405 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:26:57.381405 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:26:57.381405 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:26:57.381405 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:26:57.381405 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:26:57.381405 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:26:57.381405 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:26:57.381405 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 238b044c-ec15-4c03-88da-d90f9b1ec116 while it is in vm_state rescued Aug 31 16:26:57.381405 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:26:57.381405 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b9d87efd-c462-448c-af27-3e1b439e55de tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Returning 409 to user: Cannot 'reboot' instance 238b044c-ec15-4c03-88da-d90f9b1ec116 while it is in vm_state rescued {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:26:57.383407 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b9d87efd-c462-448c-af27-3e1b439e55de tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "POST /compute/v2.1/servers/238b044c-ec15-4c03-88da-d90f9b1ec116/action" status: 409 len: 145 microversion: 2.1 time: 0.103525 Aug 31 16:26:57.385184 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b51b1a57-1273-452b-9b20-e8e9b505929f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:57.385923 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b51b1a57-1273-452b-9b20-e8e9b505929f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:57.386991 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b51b1a57-1273-452b-9b20-e8e9b505929f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:57.387562 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b51b1a57-1273-452b-9b20-e8e9b505929f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:57.389438 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2811/5650] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:26:57 2022] POST /compute/v2.1/servers/238b044c-ec15-4c03-88da-d90f9b1ec116/action => generated 145 bytes in 112 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 31 16:26:57.391193 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b51b1a57-1273-452b-9b20-e8e9b505929f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:57.394748 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-889a30e4-24ee-4031-b55b-eef8a37ddc12 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:26:57.397783 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-889a30e4-24ee-4031-b55b-eef8a37ddc12 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: 238b044c-ec15-4c03-88da-d90f9b1ec116] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:57.411939 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-889a30e4-24ee-4031-b55b-eef8a37ddc12 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:57.412496 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-889a30e4-24ee-4031-b55b-eef8a37ddc12 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:57.412961 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-889a30e4-24ee-4031-b55b-eef8a37ddc12 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:57.413740 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-889a30e4-24ee-4031-b55b-eef8a37ddc12 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:57.414206 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-889a30e4-24ee-4031-b55b-eef8a37ddc12 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:57.414646 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-889a30e4-24ee-4031-b55b-eef8a37ddc12 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:57.488109 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-889a30e4-24ee-4031-b55b-eef8a37ddc12 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] HTTP exception thrown: Cannot 'rebuild' instance 238b044c-ec15-4c03-88da-d90f9b1ec116 while it is in vm_state rescued Aug 31 16:26:57.490299 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-889a30e4-24ee-4031-b55b-eef8a37ddc12 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Request method failure captured: Aug 31 16:26:57.490299 n-d-850499-9 devstack@n-api.service[122256]: request: POST /compute/v2.1/servers/238b044c-ec15-4c03-88da-d90f9b1ec116/action HTTP/1.1 Aug 31 16:26:57.490299 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:26:57.490299 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:26:57.490299 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:26:57.490299 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 65 Aug 31 16:26:57.490299 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:26:57.490299 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:26:57.490299 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:26:57.490299 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:26:57.490299 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4oy7qo0hac0I9IpX9ONeLQn5FXZxTJLjhjMB-WYHPcUUf61xQVdU4TOXEJINvaGC5c5Wjhk9pb4p_bnOvsu8HLsM1WUDttS1HJeEirzVfdDQ2PqvMBOo0UbRSxhckjuHlfQOCH8lv8yi1i-W11nad5j2vdw9RWWfX0Cd51S12MLuko Aug 31 16:26:57.490299 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:26:57.490299 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:26:57.490299 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:26:57.490299 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:26:57.490299 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:26:57.490299 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:26:57.490299 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: e014d4e4da5e47ff9a1261e7730034ac Aug 31 16:26:57.490299 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1963116327 Aug 31 16:26:57.490299 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:26:57.490299 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:26:57.490299 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e014d4e4da5e47ff9a1261e7730034ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/e014d4e4da5e47ff9a1261e7730034ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_e014d4e4da5e47ff9a1261e7730034ac", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e014d4e4da5e47ff9a1261e7730034ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:26:57.490299 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1963116327 Aug 31 16:26:57.490299 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: e014d4e4da5e47ff9a1261e7730034ac Aug 31 16:26:57.490299 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1963116327 Aug 31 16:26:57.490299 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ServerRescueNegativeTestJSON-1963116327-project Aug 31 16:26:57.490299 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:26:57.490299 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:26:57.490299 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: e4744703b964435bbead751ca884d1ae Aug 31 16:26:57.490299 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1963116327-project Aug 31 16:26:57.490299 n-d-850499-9 devstack@n-api.service[122256]: Aug 31 16:26:57.490299 n-d-850499-9 devstack@n-api.service[122256]: {"rebuild": {"imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413"}} Aug 31 16:26:57.490299 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:26:57.490299 n-d-850499-9 devstack@n-api.service[122256]: exception: Cannot 'rebuild' instance 238b044c-ec15-4c03-88da-d90f9b1ec116 while it is in vm_state rescued Aug 31 16:26:57.490299 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '238b044c-ec15-4c03-88da-d90f9b1ec116', 'body': {'rebuild': {'imageRef': 'b9c36d42-ed46-4bf5-ad18-1df45cbd0413'}}} Aug 31 16:26:57.490299 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:26:57.490299 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:26:57.490299 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1220, in _action_rebuild Aug 31 16:26:57.490299 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Aug 31 16:26:57.490299 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Aug 31 16:26:57.490299 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 31 16:26:57.490299 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 31 16:26:57.490299 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 31 16:26:57.490299 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 16:26:57.490299 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 16:26:57.490299 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 31 16:26:57.490299 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 31 16:26:57.490299 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 238b044c-ec15-4c03-88da-d90f9b1ec116 in vm_state rescued. Cannot rebuild while the instance is in this state. Aug 31 16:26:57.490299 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:26:57.490299 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:26:57.490299 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:26:57.490299 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:26:57.490299 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:26:57.490299 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:26:57.490299 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:26:57.490299 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:26:57.490299 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:26:57.490299 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:26:57.490299 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:26:57.490299 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:26:57.490299 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:26:57.490299 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:26:57.490299 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:26:57.496240 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:26:57.496240 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 31 16:26:57.496240 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1228, in _action_rebuild Aug 31 16:26:57.496240 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 31 16:26:57.496240 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 31 16:26:57.496240 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 31 16:26:57.496240 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 238b044c-ec15-4c03-88da-d90f9b1ec116 while it is in vm_state rescued Aug 31 16:26:57.496240 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:26:57.496240 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:26:57.496240 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:26:57.496240 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:26:57.496240 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:26:57.496240 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:26:57.496240 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:26:57.496240 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:26:57.496240 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 238b044c-ec15-4c03-88da-d90f9b1ec116 while it is in vm_state rescued Aug 31 16:26:57.496240 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:26:57.499542 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-889a30e4-24ee-4031-b55b-eef8a37ddc12 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Returning 409 to user: Cannot 'rebuild' instance 238b044c-ec15-4c03-88da-d90f9b1ec116 while it is in vm_state rescued {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:26:57.500678 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-889a30e4-24ee-4031-b55b-eef8a37ddc12 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "POST /compute/v2.1/servers/238b044c-ec15-4c03-88da-d90f9b1ec116/action" status: 409 len: 146 microversion: 2.1 time: 0.110038 Aug 31 16:26:57.501799 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2812/5651] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:26:57 2022] POST /compute/v2.1/servers/238b044c-ec15-4c03-88da-d90f9b1ec116/action => generated 146 bytes in 112 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 31 16:26:57.518713 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-570f6758-bbd3-489a-bd82-918dee905391 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:57.519426 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-570f6758-bbd3-489a-bd82-918dee905391 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: d1c50fa6-2d8a-4707-9ee7-448ea57be62b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:57.534319 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-570f6758-bbd3-489a-bd82-918dee905391 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:57.542499 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-570f6758-bbd3-489a-bd82-918dee905391 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:57.542499 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-570f6758-bbd3-489a-bd82-918dee905391 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:57.542499 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-570f6758-bbd3-489a-bd82-918dee905391 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:57.546200 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-570f6758-bbd3-489a-bd82-918dee905391 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:57.546734 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-570f6758-bbd3-489a-bd82-918dee905391 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:57.597963 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-570f6758-bbd3-489a-bd82-918dee905391 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: d1c50fa6-2d8a-4707-9ee7-448ea57be62b] Going to try to terminate instance {{(pid=122256) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:26:57.830872 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-570f6758-bbd3-489a-bd82-918dee905391 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "DELETE /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b" status: 204 len: 0 microversion: 2.1 time: 0.323765 Aug 31 16:26:57.831525 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2813/5652] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:26:57 2022] DELETE /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:26:57.842294 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d65794c8-93be-49a4-aedb-3ec2cd136ee8 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Action: 'create', calling method: .version_select at 0x7f5ae8d8b700>, body: {"keypair": {"name": "tempest-keypair-1016504677", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKTnuZWiR0V9k7rp9wp/xucd+Yb6xvnHNwO/AR1UIapAH0WdC8KpvZNCr5VBwzYjlXEXd3xGvpG0+cBmOquY5AFu4T3usx5oQibrXK0ACJWuo1WFGqy2yXyXf8EfuM1gjg=="}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:26:57.867707 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b51b1a57-1273-452b-9b20-e8e9b505929f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:57.868004 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-d65794c8-93be-49a4-aedb-3ec2cd136ee8 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Getting quotas for project 79d9ba3589a24faaac930a35742ce834. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:26:57.878437 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-d65794c8-93be-49a4-aedb-3ec2cd136ee8 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Getting quotas for user 133363b2b12d4730994557ee24f08879 and project 79d9ba3589a24faaac930a35742ce834. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:26:57.882071 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b51b1a57-1273-452b-9b20-e8e9b505929f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1504 microversion: 2.1 time: 0.523134 Aug 31 16:26:57.883538 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2840/5653] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:57 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1504 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:26:57.890223 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1df104f4-9f7b-4110-88ea-85096ca72951 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:57.891854 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1df104f4-9f7b-4110-88ea-85096ca72951 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: d1c50fa6-2d8a-4707-9ee7-448ea57be62b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:57.905737 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1df104f4-9f7b-4110-88ea-85096ca72951 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:57.907181 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1df104f4-9f7b-4110-88ea-85096ca72951 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:57.908760 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1df104f4-9f7b-4110-88ea-85096ca72951 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:57.911064 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1df104f4-9f7b-4110-88ea-85096ca72951 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:57.913357 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1df104f4-9f7b-4110-88ea-85096ca72951 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:57.914555 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1df104f4-9f7b-4110-88ea-85096ca72951 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:57.954028 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d65794c8-93be-49a4-aedb-3ec2cd136ee8 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.120952 Aug 31 16:26:57.956188 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2814/5654] 10.222.0.61 () {60 vars in 1159 bytes} [Wed Aug 31 16:26:57 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:26:57.978439 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c51c41cd-5824-466c-8380-6325e261168f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:26:57.979407 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c51c41cd-5824-466c-8380-6325e261168f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:58.014484 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c51c41cd-5824-466c-8380-6325e261168f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:58.016024 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c51c41cd-5824-466c-8380-6325e261168f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:58.016767 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c51c41cd-5824-466c-8380-6325e261168f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:58.017852 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c51c41cd-5824-466c-8380-6325e261168f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:58.018574 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c51c41cd-5824-466c-8380-6325e261168f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:58.026205 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c51c41cd-5824-466c-8380-6325e261168f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:58.125303 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-c51c41cd-5824-466c-8380-6325e261168f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] HTTP exception thrown: Cannot 'unshelve' instance 22082563-385d-41a9-baa5-6fb277278505 while it is in vm_state active Aug 31 16:26:58.127483 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c51c41cd-5824-466c-8380-6325e261168f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Request method failure captured: Aug 31 16:26:58.127483 n-d-850499-9 devstack@n-api.service[122256]: request: POST /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505/action HTTP/1.1 Aug 31 16:26:58.127483 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:26:58.127483 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:26:58.127483 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:26:58.127483 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 18 Aug 31 16:26:58.127483 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:26:58.127483 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:26:58.127483 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:26:58.127483 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:26:58.127483 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4q2NcJzZutw3Y6jF4GnmJD1H1MzSLIbHjRxunPVSp6uKTRmCePfT1DyksG9QgDfSYnSoM0q9vOxO3sqZKoJ5PA2HppEXRHLLn8jTh4ccTKQ6q8SYb3pqui6kOFW5_PmtYr9N0lihJC0EStA4OYRI4QsHOxwmGiiVscbhBZpLyiKmV0 Aug 31 16:26:58.127483 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:26:58.127483 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:26:58.127483 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:26:58.127483 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:26:58.127483 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:26:58.127483 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:26:58.127483 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 014522b19dc349a691e1f6b131229974 Aug 31 16:26:58.127483 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:26:58.127483 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:26:58.127483 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:26:58.127483 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/014522b19dc349a691e1f6b131229974"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/014522b19dc349a691e1f6b131229974"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_014522b19dc349a691e1f6b131229974", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/014522b19dc349a691e1f6b131229974"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:26:58.127483 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:26:58.127483 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 014522b19dc349a691e1f6b131229974 Aug 31 16:26:58.127483 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:26:58.127483 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ServersNegativeTestJSON-918151355-project Aug 31 16:26:58.127483 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:26:58.127483 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:26:58.127483 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: c042c43cc2aa4000a147fae62c261e86 Aug 31 16:26:58.127483 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ServersNegativeTestJSON-918151355-project Aug 31 16:26:58.127483 n-d-850499-9 devstack@n-api.service[122256]: Aug 31 16:26:58.127483 n-d-850499-9 devstack@n-api.service[122256]: {"unshelve": null} Aug 31 16:26:58.127483 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:26:58.127483 n-d-850499-9 devstack@n-api.service[122256]: exception: Cannot 'unshelve' instance 22082563-385d-41a9-baa5-6fb277278505 while it is in vm_state active Aug 31 16:26:58.127483 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '22082563-385d-41a9-baa5-6fb277278505', 'body': {'unshelve': None}} Aug 31 16:26:58.127483 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:26:58.127483 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:26:58.127483 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Aug 31 16:26:58.127483 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Aug 31 16:26:58.127483 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 31 16:26:58.127483 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 16:26:58.127483 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 16:26:58.127483 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 16:26:58.127483 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 31 16:26:58.127483 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 31 16:26:58.127483 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 22082563-385d-41a9-baa5-6fb277278505 in vm_state active. Cannot unshelve while the instance is in this state. Aug 31 16:26:58.127483 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:26:58.127483 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:26:58.127483 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:26:58.127483 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:26:58.127483 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:26:58.127483 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:26:58.127483 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:26:58.127483 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:26:58.127483 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:26:58.127483 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:26:58.127483 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:26:58.127483 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:26:58.127483 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:26:58.127483 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:26:58.127483 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Aug 31 16:26:58.127483 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Aug 31 16:26:58.127483 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 31 16:26:58.127483 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 31 16:26:58.133226 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 22082563-385d-41a9-baa5-6fb277278505 while it is in vm_state active Aug 31 16:26:58.133226 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:26:58.133226 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:26:58.133226 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:26:58.133226 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:26:58.133226 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:26:58.133226 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:26:58.133226 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:26:58.133226 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:26:58.133226 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 22082563-385d-41a9-baa5-6fb277278505 while it is in vm_state active Aug 31 16:26:58.133226 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:26:58.133226 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c51c41cd-5824-466c-8380-6325e261168f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Returning 409 to user: Cannot 'unshelve' instance 22082563-385d-41a9-baa5-6fb277278505 while it is in vm_state active {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:26:58.135216 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c51c41cd-5824-466c-8380-6325e261168f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "POST /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505/action" status: 409 len: 146 microversion: 2.1 time: 0.176313 Aug 31 16:26:58.136939 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2815/5655] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:26:57 2022] POST /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505/action => generated 146 bytes in 180 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 31 16:26:58.146704 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2398cc8b-8588-461a-ae1f-2bec2fdde0e4 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:58.149383 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2398cc8b-8588-461a-ae1f-2bec2fdde0e4 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 92076abd-df0a-4c10-bbfd-e8c304633298] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:58.171181 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2398cc8b-8588-461a-ae1f-2bec2fdde0e4 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:58.172625 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2398cc8b-8588-461a-ae1f-2bec2fdde0e4 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:58.174070 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2398cc8b-8588-461a-ae1f-2bec2fdde0e4 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:58.175488 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2398cc8b-8588-461a-ae1f-2bec2fdde0e4 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:58.180997 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2398cc8b-8588-461a-ae1f-2bec2fdde0e4 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:58.181755 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2398cc8b-8588-461a-ae1f-2bec2fdde0e4 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:58.266136 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-1df104f4-9f7b-4110-88ea-85096ca72951 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4744703b964435bbead751ca884d1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e014d4e4da5e47ff9a1261e7730034ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:58.282274 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1df104f4-9f7b-4110-88ea-85096ca72951 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b" status: 200 len: 1690 microversion: 2.1 time: 0.396778 Aug 31 16:26:58.283153 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2841/5656] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:57 2022] GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b => generated 1690 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:26:58.301003 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2f028017-a76e-4a58-a0ff-a2bb86ddae73 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:58.305354 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2f028017-a76e-4a58-a0ff-a2bb86ddae73 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:58.323187 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2f028017-a76e-4a58-a0ff-a2bb86ddae73 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:58.324692 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2f028017-a76e-4a58-a0ff-a2bb86ddae73 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:58.325412 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2f028017-a76e-4a58-a0ff-a2bb86ddae73 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:58.328912 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2f028017-a76e-4a58-a0ff-a2bb86ddae73 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:58.329716 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2f028017-a76e-4a58-a0ff-a2bb86ddae73 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:58.330390 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2f028017-a76e-4a58-a0ff-a2bb86ddae73 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:58.602423 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2f028017-a76e-4a58-a0ff-a2bb86ddae73 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:58.615284 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2f028017-a76e-4a58-a0ff-a2bb86ddae73 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1504 microversion: 2.1 time: 0.326324 Aug 31 16:26:58.615284 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2842/5657] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:58 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1504 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:26:58.628690 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c8c8eb6c-d1de-440d-aad0-50dbd870987c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:58.629312 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c8c8eb6c-d1de-440d-aad0-50dbd870987c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: b31fb01b-045f-41f7-bf58-66c1eca839e8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:58.640440 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c8c8eb6c-d1de-440d-aad0-50dbd870987c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:58.641067 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c8c8eb6c-d1de-440d-aad0-50dbd870987c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:58.642152 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c8c8eb6c-d1de-440d-aad0-50dbd870987c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:58.643211 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c8c8eb6c-d1de-440d-aad0-50dbd870987c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:58.644241 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c8c8eb6c-d1de-440d-aad0-50dbd870987c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:58.645051 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c8c8eb6c-d1de-440d-aad0-50dbd870987c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:58.690419 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-2398cc8b-8588-461a-ae1f-2bec2fdde0e4 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:58.703828 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2398cc8b-8588-461a-ae1f-2bec2fdde0e4 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/92076abd-df0a-4c10-bbfd-e8c304633298" status: 200 len: 1505 microversion: 2.1 time: 0.564921 Aug 31 16:26:58.704462 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2816/5658] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:58 2022] GET /compute/v2.1/servers/92076abd-df0a-4c10-bbfd-e8c304633298 => generated 1505 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:26:58.722213 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-fe81e617-f9e2-4b30-b499-36f5e674d3d1 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:58.722943 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-fe81e617-f9e2-4b30-b499-36f5e674d3d1 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:58.731625 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fe81e617-f9e2-4b30-b499-36f5e674d3d1 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:58.732497 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fe81e617-f9e2-4b30-b499-36f5e674d3d1 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:58.733125 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fe81e617-f9e2-4b30-b499-36f5e674d3d1 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:58.734081 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fe81e617-f9e2-4b30-b499-36f5e674d3d1 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:58.734781 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fe81e617-f9e2-4b30-b499-36f5e674d3d1 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:58.735585 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fe81e617-f9e2-4b30-b499-36f5e674d3d1 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:58.835716 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c8c8eb6c-d1de-440d-aad0-50dbd870987c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:58.851605 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c8c8eb6c-d1de-440d-aad0-50dbd870987c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:58.855383 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c8c8eb6c-d1de-440d-aad0-50dbd870987c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:58.856830 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c8c8eb6c-d1de-440d-aad0-50dbd870987c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8" status: 200 len: 1333 microversion: 2.20 time: 0.244426 Aug 31 16:26:58.859523 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2843/5659] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:26:58 2022] GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8 => generated 1333 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:26:58.990926 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-d448ffa5-9cdf-440d-953a-fd26f0ab55f9 req-72379a64-a667-45ba-95a1-a8a8e6e6d9fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92076abd-df0a-4c10-bbfd-e8c304633298", "name": "network-vif-unplugged", "status": "completed", "tag": "1061a3fb-3b1b-4a6b-a7ca-c607c5cd782f"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:26:59.008407 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-d448ffa5-9cdf-440d-953a-fd26f0ab55f9 req-72379a64-a667-45ba-95a1-a8a8e6e6d9fc service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:59.008900 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-d448ffa5-9cdf-440d-953a-fd26f0ab55f9 req-72379a64-a667-45ba-95a1-a8a8e6e6d9fc service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:59.009340 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-d448ffa5-9cdf-440d-953a-fd26f0ab55f9 req-72379a64-a667-45ba-95a1-a8a8e6e6d9fc service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:59.046394 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.compute.server_external_events [req-d448ffa5-9cdf-440d-953a-fd26f0ab55f9 req-72379a64-a667-45ba-95a1-a8a8e6e6d9fc service nova] Unable to find a host for instance 92076abd-df0a-4c10-bbfd-e8c304633298. Dropping event network-vif-unplugged {{(pid=122257) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 31 16:26:59.052338 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-fe81e617-f9e2-4b30-b499-36f5e674d3d1 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:59.054359 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-d448ffa5-9cdf-440d-953a-fd26f0ab55f9 req-72379a64-a667-45ba-95a1-a8a8e6e6d9fc service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.067772 Aug 31 16:26:59.055315 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2844/5660] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:26:58 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 70 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 31 16:26:59.061834 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-fe81e617-f9e2-4b30-b499-36f5e674d3d1 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1504 microversion: 2.1 time: 0.354523 Aug 31 16:26:59.067703 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2817/5661] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:58 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1504 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:26:59.083348 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-77531149-9fd1-42bd-93b4-30c200354867 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-545281681_updated"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:26:59.086338 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-77531149-9fd1-42bd-93b4-30c200354867 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 04a6cf99-2bfd-48a9-a9fa-847b711ad966] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:59.115944 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-77531149-9fd1-42bd-93b4-30c200354867 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] HTTP exception thrown: Instance 04a6cf99-2bfd-48a9-a9fa-847b711ad966 could not be found. Aug 31 16:26:59.123051 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-77531149-9fd1-42bd-93b4-30c200354867 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Request method failure captured: Aug 31 16:26:59.123051 n-d-850499-9 devstack@n-api.service[122257]: request: PUT /compute/v2.1/servers/04a6cf99-2bfd-48a9-a9fa-847b711ad966 HTTP/1.1 Aug 31 16:26:59.123051 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:26:59.123051 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:26:59.123051 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:26:59.123051 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 80 Aug 31 16:26:59.123051 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:26:59.123051 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:26:59.123051 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:26:59.123051 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:26:59.123051 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4q2NcJzZutw3Y6jF4GnmJD1H1MzSLIbHjRxunPVSp6uKTRmCePfT1DyksG9QgDfSYnSoM0q9vOxO3sqZKoJ5PA2HppEXRHLLn8jTh4ccTKQ6q8SYb3pqui6kOFW5_PmtYr9N0lihJC0EStA4OYRI4QsHOxwmGiiVscbhBZpLyiKmV0 Aug 31 16:26:59.123051 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:26:59.123051 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:26:59.123051 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:26:59.123051 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:26:59.123051 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:26:59.123051 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:26:59.123051 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 014522b19dc349a691e1f6b131229974 Aug 31 16:26:59.123051 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:26:59.123051 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:26:59.123051 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:26:59.123051 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/014522b19dc349a691e1f6b131229974"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/014522b19dc349a691e1f6b131229974"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_014522b19dc349a691e1f6b131229974", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/014522b19dc349a691e1f6b131229974"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:26:59.123051 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:26:59.123051 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 014522b19dc349a691e1f6b131229974 Aug 31 16:26:59.123051 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:26:59.123051 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ServersNegativeTestJSON-918151355-project Aug 31 16:26:59.123051 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:26:59.123051 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:26:59.123051 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: c042c43cc2aa4000a147fae62c261e86 Aug 31 16:26:59.123051 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ServersNegativeTestJSON-918151355-project Aug 31 16:26:59.123051 n-d-850499-9 devstack@n-api.service[122257]: Aug 31 16:26:59.123051 n-d-850499-9 devstack@n-api.service[122257]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-545281681_updated"}} Aug 31 16:26:59.123051 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:26:59.123051 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance 04a6cf99-2bfd-48a9-a9fa-847b711ad966 could not be found. Aug 31 16:26:59.123051 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '04a6cf99-2bfd-48a9-a9fa-847b711ad966', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-545281681_updated'}}} Aug 31 16:26:59.123051 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:26:59.123051 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:26:59.123051 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:26:59.123051 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:26:59.123051 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:26:59.123051 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:26:59.123051 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 31 16:26:59.123051 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 31 16:26:59.123051 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04a6cf99-2bfd-48a9-a9fa-847b711ad966 could not be found. Aug 31 16:26:59.123051 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:26:59.123051 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:26:59.123051 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:26:59.123051 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:26:59.123051 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:26:59.123051 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:26:59.123051 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:26:59.123051 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:26:59.123051 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:26:59.123051 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:26:59.123051 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:26:59.123051 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:26:59.123051 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:26:59.123051 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:26:59.123051 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:26:59.123051 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:26:59.123051 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 31 16:26:59.123051 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Aug 31 16:26:59.123051 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Aug 31 16:26:59.123051 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:26:59.128666 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:26:59.128666 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:26:59.128666 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:26:59.128666 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04a6cf99-2bfd-48a9-a9fa-847b711ad966 could not be found. Aug 31 16:26:59.128666 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:26:59.128666 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:26:59.128666 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:26:59.128666 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:26:59.128666 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:26:59.128666 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:26:59.128666 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:26:59.128666 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:26:59.128666 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04a6cf99-2bfd-48a9-a9fa-847b711ad966 could not be found. Aug 31 16:26:59.128666 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:26:59.145262 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-77531149-9fd1-42bd-93b4-30c200354867 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Returning 404 to user: Instance 04a6cf99-2bfd-48a9-a9fa-847b711ad966 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:26:59.149226 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-77531149-9fd1-42bd-93b4-30c200354867 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "PUT /compute/v2.1/servers/04a6cf99-2bfd-48a9-a9fa-847b711ad966" status: 404 len: 111 microversion: 2.1 time: 0.068856 Aug 31 16:26:59.151917 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2845/5662] 10.222.0.61 () {60 vars in 1256 bytes} [Wed Aug 31 16:26:59 2022] PUT /compute/v2.1/servers/04a6cf99-2bfd-48a9-a9fa-847b711ad966 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:26:59.168167 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-eb563e95-0ac8-4579-993b-825e7703c499 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:59.169248 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-eb563e95-0ac8-4579-993b-825e7703c499 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:59.176534 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eb563e95-0ac8-4579-993b-825e7703c499 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:59.177405 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eb563e95-0ac8-4579-993b-825e7703c499 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:59.178594 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eb563e95-0ac8-4579-993b-825e7703c499 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:59.179658 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eb563e95-0ac8-4579-993b-825e7703c499 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:59.180376 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eb563e95-0ac8-4579-993b-825e7703c499 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:59.181819 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eb563e95-0ac8-4579-993b-825e7703c499 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:59.316977 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-36666a4c-11ec-4776-86d0-9a35644521ee tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:59.317644 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-36666a4c-11ec-4776-86d0-9a35644521ee tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: d1c50fa6-2d8a-4707-9ee7-448ea57be62b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:59.331834 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-36666a4c-11ec-4776-86d0-9a35644521ee tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:59.332402 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-36666a4c-11ec-4776-86d0-9a35644521ee tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:59.332739 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-36666a4c-11ec-4776-86d0-9a35644521ee tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:59.333456 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-36666a4c-11ec-4776-86d0-9a35644521ee tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:59.333925 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-36666a4c-11ec-4776-86d0-9a35644521ee tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:59.334360 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-36666a4c-11ec-4776-86d0-9a35644521ee tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:59.818598 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-eb563e95-0ac8-4579-993b-825e7703c499 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:59.835106 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-eb563e95-0ac8-4579-993b-825e7703c499 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1504 microversion: 2.1 time: 0.672574 Aug 31 16:26:59.836065 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2818/5663] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:59 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1504 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:26:59.852257 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d995c504-855b-4c3f-be0c-5fa48b68f07f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:59.853039 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d995c504-855b-4c3f-be0c-5fa48b68f07f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 92076abd-df0a-4c10-bbfd-e8c304633298] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:59.865914 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d995c504-855b-4c3f-be0c-5fa48b68f07f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:59.866498 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d995c504-855b-4c3f-be0c-5fa48b68f07f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:59.866954 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d995c504-855b-4c3f-be0c-5fa48b68f07f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:59.867749 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d995c504-855b-4c3f-be0c-5fa48b68f07f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:59.868212 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d995c504-855b-4c3f-be0c-5fa48b68f07f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:59.868841 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d995c504-855b-4c3f-be0c-5fa48b68f07f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:59.900688 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-36666a4c-11ec-4776-86d0-9a35644521ee tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4744703b964435bbead751ca884d1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e014d4e4da5e47ff9a1261e7730034ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:59.914096 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-36666a4c-11ec-4776-86d0-9a35644521ee tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b" status: 200 len: 1690 microversion: 2.1 time: 0.610086 Aug 31 16:26:59.914710 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2846/5664] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:59 2022] GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b => generated 1690 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:26:59.932578 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-dd461722-584e-4568-8fff-6f3e77a51036 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:59.933924 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-dd461722-584e-4568-8fff-6f3e77a51036 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:59.946986 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dd461722-584e-4568-8fff-6f3e77a51036 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:59.947490 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dd461722-584e-4568-8fff-6f3e77a51036 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:59.949207 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dd461722-584e-4568-8fff-6f3e77a51036 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:59.950375 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dd461722-584e-4568-8fff-6f3e77a51036 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:59.951408 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dd461722-584e-4568-8fff-6f3e77a51036 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:59.951886 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dd461722-584e-4568-8fff-6f3e77a51036 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:00.301341 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d995c504-855b-4c3f-be0c-5fa48b68f07f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:00.310732 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d995c504-855b-4c3f-be0c-5fa48b68f07f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/92076abd-df0a-4c10-bbfd-e8c304633298" status: 200 len: 1448 microversion: 2.1 time: 0.473522 Aug 31 16:27:00.332300 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2819/5665] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:59 2022] GET /compute/v2.1/servers/92076abd-df0a-4c10-bbfd-e8c304633298 => generated 1448 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:27:00.372495 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f0c19704-bd26-4eb4-b80a-d4177b769762 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:00.373560 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f0c19704-bd26-4eb4-b80a-d4177b769762 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: b31fb01b-045f-41f7-bf58-66c1eca839e8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:00.387854 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f0c19704-bd26-4eb4-b80a-d4177b769762 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:00.389234 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f0c19704-bd26-4eb4-b80a-d4177b769762 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:00.390284 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f0c19704-bd26-4eb4-b80a-d4177b769762 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:00.391942 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f0c19704-bd26-4eb4-b80a-d4177b769762 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:00.393096 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f0c19704-bd26-4eb4-b80a-d4177b769762 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:00.394161 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f0c19704-bd26-4eb4-b80a-d4177b769762 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:00.486220 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-dd461722-584e-4568-8fff-6f3e77a51036 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:00.495986 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-dd461722-584e-4568-8fff-6f3e77a51036 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1504 microversion: 2.1 time: 0.579608 Aug 31 16:27:00.499919 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2847/5666] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:59 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1504 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:27:00.510906 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e777a4ce-61aa-4cef-b045-f711428933a5 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:00.516408 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e777a4ce-61aa-4cef-b045-f711428933a5 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:00.537450 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e777a4ce-61aa-4cef-b045-f711428933a5 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:00.538392 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e777a4ce-61aa-4cef-b045-f711428933a5 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:00.538914 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e777a4ce-61aa-4cef-b045-f711428933a5 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:00.539750 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e777a4ce-61aa-4cef-b045-f711428933a5 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:00.540285 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e777a4ce-61aa-4cef-b045-f711428933a5 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:00.540795 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e777a4ce-61aa-4cef-b045-f711428933a5 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:00.655574 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f0c19704-bd26-4eb4-b80a-d4177b769762 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:00.660683 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:27:00.673302 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f0c19704-bd26-4eb4-b80a-d4177b769762 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:00.675444 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f0c19704-bd26-4eb4-b80a-d4177b769762 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:00.676718 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f0c19704-bd26-4eb4-b80a-d4177b769762 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8" status: 200 len: 1339 microversion: 2.20 time: 0.343078 Aug 31 16:27:00.678928 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2820/5667] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:27:00 2022] GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8 => generated 1339 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:27:00.691439 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8c1eb0c6-ab66-4681-bbc2-e75fb241fa32 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:27:00.697131 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8c1eb0c6-ab66-4681-bbc2-e75fb241fa32 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Request method failure captured: Aug 31 16:27:00.697131 n-d-850499-9 devstack@n-api.service[122256]: request: PUT /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 HTTP/1.1 Aug 31 16:27:00.697131 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:27:00.697131 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:27:00.697131 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:27:00.697131 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 280 Aug 31 16:27:00.697131 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:27:00.697131 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:27:00.697131 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:27:00.697131 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:27:00.697131 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4q2NcJzZutw3Y6jF4GnmJD1H1MzSLIbHjRxunPVSp6uKTRmCePfT1DyksG9QgDfSYnSoM0q9vOxO3sqZKoJ5PA2HppEXRHLLn8jTh4ccTKQ6q8SYb3pqui6kOFW5_PmtYr9N0lihJC0EStA4OYRI4QsHOxwmGiiVscbhBZpLyiKmV0 Aug 31 16:27:00.697131 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:27:00.697131 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:27:00.697131 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:27:00.697131 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:27:00.697131 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:27:00.697131 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:27:00.697131 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 014522b19dc349a691e1f6b131229974 Aug 31 16:27:00.697131 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:27:00.697131 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:27:00.697131 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:27:00.697131 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/014522b19dc349a691e1f6b131229974"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/014522b19dc349a691e1f6b131229974"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_014522b19dc349a691e1f6b131229974", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/014522b19dc349a691e1f6b131229974"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:27:00.697131 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:27:00.697131 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 014522b19dc349a691e1f6b131229974 Aug 31 16:27:00.697131 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:27:00.697131 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ServersNegativeTestJSON-918151355-project Aug 31 16:27:00.697131 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:27:00.697131 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:27:00.697131 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: c042c43cc2aa4000a147fae62c261e86 Aug 31 16:27:00.697131 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ServersNegativeTestJSON-918151355-project Aug 31 16:27:00.697131 n-d-850499-9 devstack@n-api.service[122256]: Aug 31 16:27:00.697131 n-d-850499-9 devstack@n-api.service[122256]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 31 16:27:00.697131 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:27:00.697131 n-d-850499-9 devstack@n-api.service[122256]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 31 16:27:00.697131 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '22082563-385d-41a9-baa5-6fb277278505', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 31 16:27:00.697131 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:27:00.697131 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:27:00.697131 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 16:27:00.697131 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 16:27:00.697131 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 16:27:00.697131 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise error Aug 31 16:27:00.697131 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 31 16:27:00.697131 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:27:00.697131 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Aug 31 16:27:00.697131 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 31 16:27:00.697131 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:27:00.697131 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 31 16:27:00.697131 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 31 16:27:00.697131 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:27:00.697131 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:27:00.697131 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:27:00.697131 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:27:00.703822 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:27:00.703822 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:27:00.703822 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:27:00.703822 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:27:00.703822 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:27:00.703822 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:27:00.703822 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:27:00.703822 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:27:00.703822 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 16:27:00.703822 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 16:27:00.703822 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 16:27:00.703822 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 16:27:00.703822 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 16:27:00.703822 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 16:27:00.703822 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 31 16:27:00.703822 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:27:00.703822 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:27:00.703822 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:27:00.703822 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:27:00.703822 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:27:00.703822 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:27:00.703822 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 16:27:00.703822 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 16:27:00.703822 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 31 16:27:00.703822 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:27:00.703822 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8c1eb0c6-ab66-4681-bbc2-e75fb241fa32 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:27:00.708576 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8c1eb0c6-ab66-4681-bbc2-e75fb241fa32 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "PUT /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 400 len: 619 microversion: 2.1 time: 0.027452 Aug 31 16:27:00.709415 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2821/5668] 10.222.0.61 () {60 vars in 1257 bytes} [Wed Aug 31 16:27:00 2022] PUT /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 619 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:27:00.721794 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6d141181-09b9-4470-8d8d-ba04cab1c292 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:00.729590 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6d141181-09b9-4470-8d8d-ba04cab1c292 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:00.756418 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6d141181-09b9-4470-8d8d-ba04cab1c292 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:00.758425 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6d141181-09b9-4470-8d8d-ba04cab1c292 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:00.759648 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6d141181-09b9-4470-8d8d-ba04cab1c292 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:00.760813 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6d141181-09b9-4470-8d8d-ba04cab1c292 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:00.762827 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6d141181-09b9-4470-8d8d-ba04cab1c292 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:00.764238 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6d141181-09b9-4470-8d8d-ba04cab1c292 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:00.919345 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e777a4ce-61aa-4cef-b045-f711428933a5 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:00.936250 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e777a4ce-61aa-4cef-b045-f711428933a5 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1668 microversion: 2.1 time: 0.428793 Aug 31 16:27:00.938634 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2848/5669] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:00 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1668 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:27:00.957367 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6dd710b0-1dde-4111-8f5d-f2c7988ff573 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:00.959081 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6dd710b0-1dde-4111-8f5d-f2c7988ff573 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: d1c50fa6-2d8a-4707-9ee7-448ea57be62b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:00.971376 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6dd710b0-1dde-4111-8f5d-f2c7988ff573 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:00.972666 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6dd710b0-1dde-4111-8f5d-f2c7988ff573 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:00.973432 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6dd710b0-1dde-4111-8f5d-f2c7988ff573 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:00.974459 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6dd710b0-1dde-4111-8f5d-f2c7988ff573 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:00.975190 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6dd710b0-1dde-4111-8f5d-f2c7988ff573 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:00.976157 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6dd710b0-1dde-4111-8f5d-f2c7988ff573 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:01.831688 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-6d141181-09b9-4470-8d8d-ba04cab1c292 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:01.849343 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6d141181-09b9-4470-8d8d-ba04cab1c292 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1504 microversion: 2.1 time: 1.133168 Aug 31 16:27:01.850653 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2822/5670] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:00 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1504 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:27:01.860270 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b5695962-52d2-4faa-80cd-d2dc141f0edb tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:01.861534 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b5695962-52d2-4faa-80cd-d2dc141f0edb tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:01.879300 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b5695962-52d2-4faa-80cd-d2dc141f0edb tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:01.880336 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b5695962-52d2-4faa-80cd-d2dc141f0edb tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:01.882843 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b5695962-52d2-4faa-80cd-d2dc141f0edb tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:01.884817 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b5695962-52d2-4faa-80cd-d2dc141f0edb tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:01.886447 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b5695962-52d2-4faa-80cd-d2dc141f0edb tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:01.887072 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b5695962-52d2-4faa-80cd-d2dc141f0edb tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:02.024999 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-6dd710b0-1dde-4111-8f5d-f2c7988ff573 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4744703b964435bbead751ca884d1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e014d4e4da5e47ff9a1261e7730034ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:02.040689 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6dd710b0-1dde-4111-8f5d-f2c7988ff573 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b" status: 200 len: 1690 microversion: 2.1 time: 1.100307 Aug 31 16:27:02.042619 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2849/5671] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:00 2022] GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b => generated 1690 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:27:02.069921 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b03ccb3a-a365-4648-9ad9-35d614c5592c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:02.070814 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b03ccb3a-a365-4648-9ad9-35d614c5592c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: b31fb01b-045f-41f7-bf58-66c1eca839e8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:02.105619 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b03ccb3a-a365-4648-9ad9-35d614c5592c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:02.108367 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b03ccb3a-a365-4648-9ad9-35d614c5592c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:02.109175 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b03ccb3a-a365-4648-9ad9-35d614c5592c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:02.111673 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b03ccb3a-a365-4648-9ad9-35d614c5592c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:02.114513 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b03ccb3a-a365-4648-9ad9-35d614c5592c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:02.116989 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b03ccb3a-a365-4648-9ad9-35d614c5592c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:02.337043 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b03ccb3a-a365-4648-9ad9-35d614c5592c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:02.357978 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b03ccb3a-a365-4648-9ad9-35d614c5592c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:02.366815 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b03ccb3a-a365-4648-9ad9-35d614c5592c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:02.373535 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b03ccb3a-a365-4648-9ad9-35d614c5592c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8" status: 200 len: 1339 microversion: 2.20 time: 0.324234 Aug 31 16:27:02.394568 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2850/5672] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:27:02 2022] GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8 => generated 1339 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:27:02.425827 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-55579e0d-b988-4ca5-a043-9db63e088dc8 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:02.430074 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-55579e0d-b988-4ca5-a043-9db63e088dc8 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:02.450801 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-55579e0d-b988-4ca5-a043-9db63e088dc8 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:02.451759 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-55579e0d-b988-4ca5-a043-9db63e088dc8 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:02.452557 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-55579e0d-b988-4ca5-a043-9db63e088dc8 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:02.454052 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-55579e0d-b988-4ca5-a043-9db63e088dc8 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:02.455230 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-55579e0d-b988-4ca5-a043-9db63e088dc8 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:02.455942 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-55579e0d-b988-4ca5-a043-9db63e088dc8 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:02.534505 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b5695962-52d2-4faa-80cd-d2dc141f0edb tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:02.545515 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b5695962-52d2-4faa-80cd-d2dc141f0edb tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1668 microversion: 2.1 time: 0.692760 Aug 31 16:27:02.553079 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2823/5673] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:01 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1668 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:27:02.583902 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-391fdc01-7b80-410f-83fd-ed4393dab4e2 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:02.586471 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-391fdc01-7b80-410f-83fd-ed4393dab4e2 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:02.605214 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-391fdc01-7b80-410f-83fd-ed4393dab4e2 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:02.606273 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-391fdc01-7b80-410f-83fd-ed4393dab4e2 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:02.606904 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-391fdc01-7b80-410f-83fd-ed4393dab4e2 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:02.609491 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-391fdc01-7b80-410f-83fd-ed4393dab4e2 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:02.610193 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-391fdc01-7b80-410f-83fd-ed4393dab4e2 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:02.612598 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-391fdc01-7b80-410f-83fd-ed4393dab4e2 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:03.238783 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-391fdc01-7b80-410f-83fd-ed4393dab4e2 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:03.250754 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-391fdc01-7b80-410f-83fd-ed4393dab4e2 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1668 microversion: 2.1 time: 0.672170 Aug 31 16:27:03.266532 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2824/5674] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:02 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1668 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:27:03.272193 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-dbcea341-037e-4e6d-8cde-568669e12d0f tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:03.273211 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-dbcea341-037e-4e6d-8cde-568669e12d0f tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: d1c50fa6-2d8a-4707-9ee7-448ea57be62b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:03.280919 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dbcea341-037e-4e6d-8cde-568669e12d0f tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:03.281711 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dbcea341-037e-4e6d-8cde-568669e12d0f tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:03.282365 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dbcea341-037e-4e6d-8cde-568669e12d0f tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:03.283284 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dbcea341-037e-4e6d-8cde-568669e12d0f tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:03.284578 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dbcea341-037e-4e6d-8cde-568669e12d0f tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:03.285205 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dbcea341-037e-4e6d-8cde-568669e12d0f tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:03.376208 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-55579e0d-b988-4ca5-a043-9db63e088dc8 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:03.391926 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-55579e0d-b988-4ca5-a043-9db63e088dc8 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1504 microversion: 2.1 time: 0.995643 Aug 31 16:27:03.411861 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2851/5675] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:02 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1504 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:27:03.418224 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-834c433b-ad31-4a1f-a5fc-01c925341759 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:03.419145 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-834c433b-ad31-4a1f-a5fc-01c925341759 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:03.432826 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-834c433b-ad31-4a1f-a5fc-01c925341759 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:03.433635 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-834c433b-ad31-4a1f-a5fc-01c925341759 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:03.434344 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-834c433b-ad31-4a1f-a5fc-01c925341759 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:03.435608 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-834c433b-ad31-4a1f-a5fc-01c925341759 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:03.436310 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-834c433b-ad31-4a1f-a5fc-01c925341759 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:03.437133 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-834c433b-ad31-4a1f-a5fc-01c925341759 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:03.938077 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-834c433b-ad31-4a1f-a5fc-01c925341759 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:03.950410 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-834c433b-ad31-4a1f-a5fc-01c925341759 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1668 microversion: 2.1 time: 0.536985 Aug 31 16:27:03.956896 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2852/5676] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:03 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1668 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:27:03.978500 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-883b6563-213f-4571-aa2b-bff1dd04daf5 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:03.978500 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-883b6563-213f-4571-aa2b-bff1dd04daf5 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: b31fb01b-045f-41f7-bf58-66c1eca839e8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:04.003202 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-883b6563-213f-4571-aa2b-bff1dd04daf5 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:04.003755 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-883b6563-213f-4571-aa2b-bff1dd04daf5 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:04.008971 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-883b6563-213f-4571-aa2b-bff1dd04daf5 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:04.011935 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-883b6563-213f-4571-aa2b-bff1dd04daf5 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:04.012602 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-883b6563-213f-4571-aa2b-bff1dd04daf5 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:04.012913 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-883b6563-213f-4571-aa2b-bff1dd04daf5 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:04.043236 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-dbcea341-037e-4e6d-8cde-568669e12d0f tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4744703b964435bbead751ca884d1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e014d4e4da5e47ff9a1261e7730034ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:04.056510 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-dbcea341-037e-4e6d-8cde-568669e12d0f tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b" status: 200 len: 1690 microversion: 2.1 time: 0.788426 Aug 31 16:27:04.057245 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2825/5677] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:03 2022] GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b => generated 1690 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:27:04.081482 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9582c4c1-932b-40b5-a272-4644c1fdce2f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:27:04.105621 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9582c4c1-932b-40b5-a272-4644c1fdce2f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Request method failure captured: Aug 31 16:27:04.105621 n-d-850499-9 devstack@n-api.service[122256]: request: PUT /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 HTTP/1.1 Aug 31 16:27:04.105621 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:27:04.105621 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:27:04.105621 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:27:04.105621 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 24 Aug 31 16:27:04.105621 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:27:04.105621 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:27:04.105621 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:27:04.105621 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:27:04.105621 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4q2NcJzZutw3Y6jF4GnmJD1H1MzSLIbHjRxunPVSp6uKTRmCePfT1DyksG9QgDfSYnSoM0q9vOxO3sqZKoJ5PA2HppEXRHLLn8jTh4ccTKQ6q8SYb3pqui6kOFW5_PmtYr9N0lihJC0EStA4OYRI4QsHOxwmGiiVscbhBZpLyiKmV0 Aug 31 16:27:04.105621 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:27:04.105621 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:27:04.105621 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:27:04.105621 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:27:04.105621 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:27:04.105621 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:27:04.105621 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 014522b19dc349a691e1f6b131229974 Aug 31 16:27:04.105621 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:27:04.105621 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:27:04.105621 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:27:04.105621 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/014522b19dc349a691e1f6b131229974"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/014522b19dc349a691e1f6b131229974"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_014522b19dc349a691e1f6b131229974", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/014522b19dc349a691e1f6b131229974"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:27:04.105621 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:27:04.105621 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 014522b19dc349a691e1f6b131229974 Aug 31 16:27:04.105621 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:27:04.105621 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ServersNegativeTestJSON-918151355-project Aug 31 16:27:04.105621 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:27:04.105621 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:27:04.105621 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: c042c43cc2aa4000a147fae62c261e86 Aug 31 16:27:04.105621 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ServersNegativeTestJSON-918151355-project Aug 31 16:27:04.105621 n-d-850499-9 devstack@n-api.service[122256]: Aug 31 16:27:04.105621 n-d-850499-9 devstack@n-api.service[122256]: {"server": {"name": ""}} Aug 31 16:27:04.105621 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:27:04.105621 n-d-850499-9 devstack@n-api.service[122256]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 31 16:27:04.105621 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '22082563-385d-41a9-baa5-6fb277278505', 'body': {'server': {'name': ''}}} Aug 31 16:27:04.105621 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:27:04.105621 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:27:04.105621 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 16:27:04.105621 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 16:27:04.105621 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 16:27:04.105621 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise error Aug 31 16:27:04.105621 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 31 16:27:04.105621 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:27:04.105621 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Aug 31 16:27:04.105621 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 31 16:27:04.105621 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:27:04.105621 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 31 16:27:04.105621 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi '' Aug 31 16:27:04.105621 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:27:04.105621 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:27:04.105621 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:27:04.105621 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:27:04.105621 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:27:04.105621 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:27:04.105621 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:27:04.105621 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:27:04.105621 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:27:04.105621 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:27:04.105621 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:27:04.105621 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:27:04.105621 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 16:27:04.105621 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 16:27:04.105621 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 16:27:04.105621 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 16:27:04.105621 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 16:27:04.105621 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 16:27:04.105621 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 31 16:27:04.112191 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:27:04.112191 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:27:04.112191 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:27:04.112191 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:27:04.112191 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:27:04.112191 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:27:04.112191 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 16:27:04.112191 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 16:27:04.112191 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 31 16:27:04.112191 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:27:04.112191 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9582c4c1-932b-40b5-a272-4644c1fdce2f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:27:04.114883 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9582c4c1-932b-40b5-a272-4644c1fdce2f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "PUT /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 400 len: 108 microversion: 2.1 time: 0.044137 Aug 31 16:27:04.116615 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2826/5678] 10.222.0.61 () {60 vars in 1256 bytes} [Wed Aug 31 16:27:04 2022] PUT /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 108 bytes in 54 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:27:04.130604 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-bb77a2b5-8fc6-4d51-b46f-3dcbbcfffa54 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1382058891", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "11b1617b-14c9-40d6-9f52-0ad0c12edada"}], "security_groups": [{"name": "tempest-securitygroup--2141363864"}], "key_name": "tempest-keypair-1016504677", "user_data": "}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:27:04.159378 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:INSERT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:27:04.702552 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-bb77a2b5-8fc6-4d51-b46f-3dcbbcfffa54 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] validate_networks() for [('11b1617b-14c9-40d6-9f52-0ad0c12edada', None, None, None, None, None)] {{(pid=122256) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:27:04.802093 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-883b6563-213f-4571-aa2b-bff1dd04daf5 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:04.813010 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-883b6563-213f-4571-aa2b-bff1dd04daf5 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:04.815153 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-883b6563-213f-4571-aa2b-bff1dd04daf5 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:04.816625 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-883b6563-213f-4571-aa2b-bff1dd04daf5 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8" status: 200 len: 1406 microversion: 2.20 time: 0.858670 Aug 31 16:27:04.820565 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2853/5679] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:27:03 2022] GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8 => generated 1406 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:27:04.836484 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3a353f68-2bbc-47ed-9842-a15a58e090a2 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:27:04.848997 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3a353f68-2bbc-47ed-9842-a15a58e090a2 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:04.850113 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3a353f68-2bbc-47ed-9842-a15a58e090a2 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:04.850779 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3a353f68-2bbc-47ed-9842-a15a58e090a2 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:04.894954 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3a353f68-2bbc-47ed-9842-a15a58e090a2 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Going to try to stop instance {{(pid=122257) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 31 16:27:04.941501 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=100 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:27:04.975589 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3a353f68-2bbc-47ed-9842-a15a58e090a2 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "POST /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c/action" status: 202 len: 0 microversion: 2.1 time: 0.148550 Aug 31 16:27:04.978584 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2854/5680] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:27:04 2022] POST /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c/action => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:27:04.989115 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a5f0bb89-24b4-4488-95a0-91de29183fc8 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:04.991178 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a5f0bb89-24b4-4488-95a0-91de29183fc8 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:05.005436 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a5f0bb89-24b4-4488-95a0-91de29183fc8 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:05.006573 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a5f0bb89-24b4-4488-95a0-91de29183fc8 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:05.008391 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a5f0bb89-24b4-4488-95a0-91de29183fc8 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:05.009415 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a5f0bb89-24b4-4488-95a0-91de29183fc8 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:05.011468 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a5f0bb89-24b4-4488-95a0-91de29183fc8 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:05.012734 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a5f0bb89-24b4-4488-95a0-91de29183fc8 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:05.243222 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:27:05.576631 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a5f0bb89-24b4-4488-95a0-91de29183fc8 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:05.590764 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a5f0bb89-24b4-4488-95a0-91de29183fc8 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1504 microversion: 2.1 time: 0.609859 Aug 31 16:27:05.613040 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2855/5681] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:04 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1504 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:27:05.641957 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2a78a935-d8af-4ced-8efd-9a266633c1ec tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:05.653603 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2a78a935-d8af-4ced-8efd-9a266633c1ec tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:05.664078 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2a78a935-d8af-4ced-8efd-9a266633c1ec tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:05.664619 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2a78a935-d8af-4ced-8efd-9a266633c1ec tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:05.665292 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2a78a935-d8af-4ced-8efd-9a266633c1ec tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:05.666424 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2a78a935-d8af-4ced-8efd-9a266633c1ec tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:05.666424 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2a78a935-d8af-4ced-8efd-9a266633c1ec tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:05.667048 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2a78a935-d8af-4ced-8efd-9a266633c1ec tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:05.826367 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=8 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:27:06.294305 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-bb77a2b5-8fc6-4d51-b46f-3dcbbcfffa54 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:27:06.294959 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-bb77a2b5-8fc6-4d51-b46f-3dcbbcfffa54 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:27:06.295212 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-bb77a2b5-8fc6-4d51-b46f-3dcbbcfffa54 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:27:06.295856 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-bb77a2b5-8fc6-4d51-b46f-3dcbbcfffa54 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:27:06.296453 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-bb77a2b5-8fc6-4d51-b46f-3dcbbcfffa54 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:27:06.318294 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bb77a2b5-8fc6-4d51-b46f-3dcbbcfffa54 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:06.321596 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bb77a2b5-8fc6-4d51-b46f-3dcbbcfffa54 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:06.322845 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bb77a2b5-8fc6-4d51-b46f-3dcbbcfffa54 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:06.325221 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bb77a2b5-8fc6-4d51-b46f-3dcbbcfffa54 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:06.326399 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bb77a2b5-8fc6-4d51-b46f-3dcbbcfffa54 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:06.328925 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bb77a2b5-8fc6-4d51-b46f-3dcbbcfffa54 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:06.381478 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-bb77a2b5-8fc6-4d51-b46f-3dcbbcfffa54 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Getting quotas for project 79d9ba3589a24faaac930a35742ce834. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:27:06.408594 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-bb77a2b5-8fc6-4d51-b46f-3dcbbcfffa54 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Getting quotas for user 133363b2b12d4730994557ee24f08879 and project 79d9ba3589a24faaac930a35742ce834. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:27:06.468128 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-bb77a2b5-8fc6-4d51-b46f-3dcbbcfffa54 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Going to run 1 instances... {{(pid=122256) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:27:06.474272 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-bb77a2b5-8fc6-4d51-b46f-3dcbbcfffa54 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 3c9c0c43-4e1a-4290-bbf1-60e26aba66ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:27:06.605417 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-bb77a2b5-8fc6-4d51-b46f-3dcbbcfffa54 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.482767 Aug 31 16:27:06.613609 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2827/5682] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:27:04 2022] POST /compute/v2.1/servers => generated 402 bytes in 2493 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:27:06.624613 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-73a11438-3bda-46a9-97ec-2968436cb516 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:06.628706 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-73a11438-3bda-46a9-97ec-2968436cb516 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: d1c50fa6-2d8a-4707-9ee7-448ea57be62b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:06.649652 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-73a11438-3bda-46a9-97ec-2968436cb516 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:06.651687 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-73a11438-3bda-46a9-97ec-2968436cb516 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:06.653721 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-73a11438-3bda-46a9-97ec-2968436cb516 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:06.656982 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-73a11438-3bda-46a9-97ec-2968436cb516 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:06.658074 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-73a11438-3bda-46a9-97ec-2968436cb516 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:06.660157 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-73a11438-3bda-46a9-97ec-2968436cb516 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:06.694703 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2a78a935-d8af-4ced-8efd-9a266633c1ec tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:06.720177 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2a78a935-d8af-4ced-8efd-9a266633c1ec tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1678 microversion: 2.1 time: 1.105427 Aug 31 16:27:06.724605 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2856/5683] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:05 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1678 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:27:06.750029 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f900a1f1-601b-4415-b77f-8e39738beb6a tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:06.754496 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f900a1f1-601b-4415-b77f-8e39738beb6a tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: b31fb01b-045f-41f7-bf58-66c1eca839e8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:06.774974 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-73a11438-3bda-46a9-97ec-2968436cb516 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:06.777709 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-73a11438-3bda-46a9-97ec-2968436cb516 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:06.779059 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-73a11438-3bda-46a9-97ec-2968436cb516 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:06.780296 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-73a11438-3bda-46a9-97ec-2968436cb516 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lazy-loading 'fault' on Instance uuid d1c50fa6-2d8a-4707-9ee7-448ea57be62b {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:27:06.782952 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f900a1f1-601b-4415-b77f-8e39738beb6a tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:06.787456 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f900a1f1-601b-4415-b77f-8e39738beb6a tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:06.787456 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f900a1f1-601b-4415-b77f-8e39738beb6a tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:06.794197 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f900a1f1-601b-4415-b77f-8e39738beb6a tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:06.794797 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f900a1f1-601b-4415-b77f-8e39738beb6a tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:06.795267 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f900a1f1-601b-4415-b77f-8e39738beb6a tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:08.417135 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-73a11438-3bda-46a9-97ec-2968436cb516 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4744703b964435bbead751ca884d1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e014d4e4da5e47ff9a1261e7730034ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:08.456089 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-73a11438-3bda-46a9-97ec-2968436cb516 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b" status: 200 len: 1336 microversion: 2.1 time: 1.818673 Aug 31 16:27:08.463595 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2828/5684] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:06 2022] GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b => generated 1336 bytes in 1849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:27:08.480794 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-a3a706df-46e9-4e77-b839-847fd73e6008 req-c5ce3ce6-68f1-435c-b71d-30fd0d3f4921 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1c50fa6-2d8a-4707-9ee7-448ea57be62b", "name": "network-vif-deleted", "tag": "cd30456c-29c0-40f3-baeb-7b819e58a733"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:27:08.534932 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-a3a706df-46e9-4e77-b839-847fd73e6008 req-c5ce3ce6-68f1-435c-b71d-30fd0d3f4921 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:08.537362 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-a3a706df-46e9-4e77-b839-847fd73e6008 req-c5ce3ce6-68f1-435c-b71d-30fd0d3f4921 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:08.537898 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-a3a706df-46e9-4e77-b839-847fd73e6008 req-c5ce3ce6-68f1-435c-b71d-30fd0d3f4921 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:08.605714 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-a3a706df-46e9-4e77-b839-847fd73e6008 req-c5ce3ce6-68f1-435c-b71d-30fd0d3f4921 service nova] Creating event network-vif-deleted:cd30456c-29c0-40f3-baeb-7b819e58a733 for instance d1c50fa6-2d8a-4707-9ee7-448ea57be62b on n-h2-850499-9 Aug 31 16:27:08.627191 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-a3a706df-46e9-4e77-b839-847fd73e6008 req-c5ce3ce6-68f1-435c-b71d-30fd0d3f4921 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161271 Aug 31 16:27:08.628000 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2829/5685] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:27:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:27:08.645333 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a7b4c6b5-2886-437c-b8b2-a9691e54dd48 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:08.646299 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a7b4c6b5-2886-437c-b8b2-a9691e54dd48 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 3c9c0c43-4e1a-4290-bbf1-60e26aba66ce] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:08.668230 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a7b4c6b5-2886-437c-b8b2-a9691e54dd48 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:08.687797 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a7b4c6b5-2886-437c-b8b2-a9691e54dd48 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:08.692962 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a7b4c6b5-2886-437c-b8b2-a9691e54dd48 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:08.711181 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a7b4c6b5-2886-437c-b8b2-a9691e54dd48 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:08.711352 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a7b4c6b5-2886-437c-b8b2-a9691e54dd48 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:08.712828 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a7b4c6b5-2886-437c-b8b2-a9691e54dd48 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:08.780742 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f900a1f1-601b-4415-b77f-8e39738beb6a tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:08.789697 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f900a1f1-601b-4415-b77f-8e39738beb6a tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:08.794781 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f900a1f1-601b-4415-b77f-8e39738beb6a tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:08.798075 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f900a1f1-601b-4415-b77f-8e39738beb6a tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8" status: 200 len: 1406 microversion: 2.20 time: 2.069789 Aug 31 16:27:08.800165 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2857/5686] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:27:06 2022] GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8 => generated 1406 bytes in 2075 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:27:08.816260 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6f6e939c-b607-4e8a-9b2f-31369664e8aa tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:08.824983 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6f6e939c-b607-4e8a-9b2f-31369664e8aa tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:08.837843 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6f6e939c-b607-4e8a-9b2f-31369664e8aa tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:08.842858 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6f6e939c-b607-4e8a-9b2f-31369664e8aa tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:08.843580 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6f6e939c-b607-4e8a-9b2f-31369664e8aa tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:08.845978 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6f6e939c-b607-4e8a-9b2f-31369664e8aa tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:08.850422 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6f6e939c-b607-4e8a-9b2f-31369664e8aa tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:08.853254 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6f6e939c-b607-4e8a-9b2f-31369664e8aa tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:08.953629 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a7b4c6b5-2886-437c-b8b2-a9691e54dd48 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133363b2b12d4730994557ee24f08879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d9ba3589a24faaac930a35742ce834', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:08.973566 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a7b4c6b5-2886-437c-b8b2-a9691e54dd48 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/3c9c0c43-4e1a-4290-bbf1-60e26aba66ce" status: 200 len: 1238 microversion: 2.1 time: 0.333527 Aug 31 16:27:08.974271 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2830/5687] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:08 2022] GET /compute/v2.1/servers/3c9c0c43-4e1a-4290-bbf1-60e26aba66ce => generated 1238 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:27:09.454177 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-6f6e939c-b607-4e8a-9b2f-31369664e8aa tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:09.476671 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6f6e939c-b607-4e8a-9b2f-31369664e8aa tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1678 microversion: 2.1 time: 0.674912 Aug 31 16:27:09.484098 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2858/5688] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:08 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1678 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:27:09.497221 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-314d4d05-0cbb-4a2a-b2c9-a125198eaf42 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:09.497898 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-314d4d05-0cbb-4a2a-b2c9-a125198eaf42 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: d1c50fa6-2d8a-4707-9ee7-448ea57be62b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:09.513493 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-314d4d05-0cbb-4a2a-b2c9-a125198eaf42 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:09.517428 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-314d4d05-0cbb-4a2a-b2c9-a125198eaf42 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:09.518072 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-314d4d05-0cbb-4a2a-b2c9-a125198eaf42 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:09.519572 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-314d4d05-0cbb-4a2a-b2c9-a125198eaf42 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:09.520555 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-314d4d05-0cbb-4a2a-b2c9-a125198eaf42 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:09.521634 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-314d4d05-0cbb-4a2a-b2c9-a125198eaf42 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:09.546283 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-314d4d05-0cbb-4a2a-b2c9-a125198eaf42 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] HTTP exception thrown: Instance d1c50fa6-2d8a-4707-9ee7-448ea57be62b could not be found. Aug 31 16:27:09.549261 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-314d4d05-0cbb-4a2a-b2c9-a125198eaf42 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Request method failure captured: Aug 31 16:27:09.549261 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b HTTP/1.1 Aug 31 16:27:09.549261 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:27:09.549261 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:27:09.549261 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:27:09.549261 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:27:09.549261 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:27:09.549261 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:27:09.549261 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:27:09.549261 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:27:09.549261 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4oy7qo0hac0I9IpX9ONeLQn5FXZxTJLjhjMB-WYHPcUUf61xQVdU4TOXEJINvaGC5c5Wjhk9pb4p_bnOvsu8HLsM1WUDttS1HJeEirzVfdDQ2PqvMBOo0UbRSxhckjuHlfQOCH8lv8yi1i-W11nad5j2vdw9RWWfX0Cd51S12MLuko Aug 31 16:27:09.549261 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:27:09.549261 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:27:09.549261 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:27:09.549261 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:27:09.549261 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:27:09.549261 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:27:09.549261 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: e014d4e4da5e47ff9a1261e7730034ac Aug 31 16:27:09.549261 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1963116327 Aug 31 16:27:09.549261 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:27:09.549261 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:27:09.549261 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e014d4e4da5e47ff9a1261e7730034ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/e014d4e4da5e47ff9a1261e7730034ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_e014d4e4da5e47ff9a1261e7730034ac", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e014d4e4da5e47ff9a1261e7730034ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:27:09.549261 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1963116327 Aug 31 16:27:09.549261 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: e014d4e4da5e47ff9a1261e7730034ac Aug 31 16:27:09.549261 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1963116327 Aug 31 16:27:09.549261 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ServerRescueNegativeTestJSON-1963116327-project Aug 31 16:27:09.549261 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:27:09.549261 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:27:09.549261 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: e4744703b964435bbead751ca884d1ae Aug 31 16:27:09.549261 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1963116327-project Aug 31 16:27:09.549261 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:27:09.549261 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance d1c50fa6-2d8a-4707-9ee7-448ea57be62b could not be found. Aug 31 16:27:09.549261 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': 'd1c50fa6-2d8a-4707-9ee7-448ea57be62b'} Aug 31 16:27:09.549261 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:27:09.549261 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:27:09.549261 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:27:09.549261 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:27:09.549261 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:27:09.549261 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:27:09.549261 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:27:09.549261 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:27:09.549261 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:27:09.549261 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:27:09.549261 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1c50fa6-2d8a-4707-9ee7-448ea57be62b could not be found. Aug 31 16:27:09.549261 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:27:09.549261 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:27:09.549261 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:27:09.549261 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:27:09.549261 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:27:09.549261 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:27:09.549261 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:27:09.549261 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:27:09.549261 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:27:09.549261 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:27:09.549261 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:27:09.549261 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:27:09.549261 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:27:09.549261 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:27:09.549261 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:27:09.549261 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:27:09.549261 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1c50fa6-2d8a-4707-9ee7-448ea57be62b could not be found. Aug 31 16:27:09.549261 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:27:09.549261 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:27:09.555556 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:27:09.555556 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:27:09.555556 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:27:09.555556 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:27:09.555556 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:27:09.555556 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:27:09.555556 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1c50fa6-2d8a-4707-9ee7-448ea57be62b could not be found. Aug 31 16:27:09.555556 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:27:09.556507 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-314d4d05-0cbb-4a2a-b2c9-a125198eaf42 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Returning 404 to user: Instance d1c50fa6-2d8a-4707-9ee7-448ea57be62b could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:27:09.563841 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-314d4d05-0cbb-4a2a-b2c9-a125198eaf42 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b" status: 404 len: 111 microversion: 2.1 time: 0.071825 Aug 31 16:27:09.564850 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2831/5689] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:09 2022] GET /compute/v2.1/servers/d1c50fa6-2d8a-4707-9ee7-448ea57be62b => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:27:09.579002 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-16ba48d1-618d-4bdb-8a00-1b1f233959f9 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '.version_select at 0x7f5ae84e6a60>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:09.626230 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-16ba48d1-618d-4bdb-8a00-1b1f233959f9 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1797165354" status: 202 len: 0 microversion: 2.1 time: 0.055861 Aug 31 16:27:09.627165 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2859/5690] 10.222.0.61 () {58 vars in 1221 bytes} [Wed Aug 31 16:27:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1797165354 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:27:09.828519 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-739fec60-60c7-4d09-95ae-15b948631ef2 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:09.829143 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-739fec60-60c7-4d09-95ae-15b948631ef2 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: b31fb01b-045f-41f7-bf58-66c1eca839e8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:09.840449 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-739fec60-60c7-4d09-95ae-15b948631ef2 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:09.841024 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-739fec60-60c7-4d09-95ae-15b948631ef2 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:09.841472 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-739fec60-60c7-4d09-95ae-15b948631ef2 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:09.842195 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-739fec60-60c7-4d09-95ae-15b948631ef2 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:09.842662 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-739fec60-60c7-4d09-95ae-15b948631ef2 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:09.843096 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-739fec60-60c7-4d09-95ae-15b948631ef2 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:09.996844 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-08faf6c8-e7f3-4b14-92f5-33070c8b28c2 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:09.998185 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-08faf6c8-e7f3-4b14-92f5-33070c8b28c2 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 3c9c0c43-4e1a-4290-bbf1-60e26aba66ce] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:10.010140 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-08faf6c8-e7f3-4b14-92f5-33070c8b28c2 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:10.013549 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-08faf6c8-e7f3-4b14-92f5-33070c8b28c2 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:10.014561 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-08faf6c8-e7f3-4b14-92f5-33070c8b28c2 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:10.016756 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-08faf6c8-e7f3-4b14-92f5-33070c8b28c2 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:10.019325 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-08faf6c8-e7f3-4b14-92f5-33070c8b28c2 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:10.020015 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-08faf6c8-e7f3-4b14-92f5-33070c8b28c2 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:10.447024 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-08faf6c8-e7f3-4b14-92f5-33070c8b28c2 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133363b2b12d4730994557ee24f08879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d9ba3589a24faaac930a35742ce834', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:10.493283 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-08faf6c8-e7f3-4b14-92f5-33070c8b28c2 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/3c9c0c43-4e1a-4290-bbf1-60e26aba66ce" status: 200 len: 1302 microversion: 2.1 time: 0.500255 Aug 31 16:27:10.508610 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2860/5691] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:09 2022] GET /compute/v2.1/servers/3c9c0c43-4e1a-4290-bbf1-60e26aba66ce => generated 1302 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:27:10.531456 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ee59de4f-5e37-482e-8013-c3ae4e9478d3 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:10.532363 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ee59de4f-5e37-482e-8013-c3ae4e9478d3 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:10.538861 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ee59de4f-5e37-482e-8013-c3ae4e9478d3 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:10.539554 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ee59de4f-5e37-482e-8013-c3ae4e9478d3 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:10.539914 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ee59de4f-5e37-482e-8013-c3ae4e9478d3 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:10.542054 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ee59de4f-5e37-482e-8013-c3ae4e9478d3 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:10.542645 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ee59de4f-5e37-482e-8013-c3ae4e9478d3 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:10.543575 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ee59de4f-5e37-482e-8013-c3ae4e9478d3 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:10.636477 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-739fec60-60c7-4d09-95ae-15b948631ef2 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:10.653591 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-739fec60-60c7-4d09-95ae-15b948631ef2 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:10.661831 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-739fec60-60c7-4d09-95ae-15b948631ef2 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:10.663480 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-739fec60-60c7-4d09-95ae-15b948631ef2 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8" status: 200 len: 1406 microversion: 2.20 time: 0.839595 Aug 31 16:27:10.664681 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2832/5692] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:27:09 2022] GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8 => generated 1406 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:27:10.770335 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-b278307d-b455-4278-a091-9344eb0da083 req-e2119ebc-0d0d-4674-acf9-f673fae125ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b31fb01b-045f-41f7-bf58-66c1eca839e8", "tag": "fbb954d2-1cb6-4ea2-b226-5a233a891670"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:27:10.794713 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-b278307d-b455-4278-a091-9344eb0da083 req-e2119ebc-0d0d-4674-acf9-f673fae125ee service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:10.797408 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-b278307d-b455-4278-a091-9344eb0da083 req-e2119ebc-0d0d-4674-acf9-f673fae125ee service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:10.799098 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-b278307d-b455-4278-a091-9344eb0da083 req-e2119ebc-0d0d-4674-acf9-f673fae125ee service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:10.839413 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-b278307d-b455-4278-a091-9344eb0da083 req-e2119ebc-0d0d-4674-acf9-f673fae125ee service nova] Creating event network-changed:fbb954d2-1cb6-4ea2-b226-5a233a891670 for instance b31fb01b-045f-41f7-bf58-66c1eca839e8 on n-h1-850499-9 Aug 31 16:27:10.852512 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-b278307d-b455-4278-a091-9344eb0da083 req-e2119ebc-0d0d-4674-acf9-f673fae125ee service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087350 Aug 31 16:27:10.857072 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2833/5693] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:27:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:27:11.136391 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ee59de4f-5e37-482e-8013-c3ae4e9478d3 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:11.158941 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ee59de4f-5e37-482e-8013-c3ae4e9478d3 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1678 microversion: 2.1 time: 0.646127 Aug 31 16:27:11.160998 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2861/5694] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:10 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1678 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:27:11.520797 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a9769d14-b29f-45ab-ac87-b7c394ff7da6 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:11.521589 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a9769d14-b29f-45ab-ac87-b7c394ff7da6 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 3c9c0c43-4e1a-4290-bbf1-60e26aba66ce] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:11.551063 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a9769d14-b29f-45ab-ac87-b7c394ff7da6 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:11.552150 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a9769d14-b29f-45ab-ac87-b7c394ff7da6 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:11.553526 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a9769d14-b29f-45ab-ac87-b7c394ff7da6 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:11.558827 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a9769d14-b29f-45ab-ac87-b7c394ff7da6 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:11.561234 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a9769d14-b29f-45ab-ac87-b7c394ff7da6 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:11.561894 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a9769d14-b29f-45ab-ac87-b7c394ff7da6 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:11.699823 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7e6e5d4e-5917-4302-9a39-994e96119d12 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:11.704170 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7e6e5d4e-5917-4302-9a39-994e96119d12 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: b31fb01b-045f-41f7-bf58-66c1eca839e8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:11.721034 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7e6e5d4e-5917-4302-9a39-994e96119d12 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:11.721551 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7e6e5d4e-5917-4302-9a39-994e96119d12 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:11.721998 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7e6e5d4e-5917-4302-9a39-994e96119d12 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:11.722745 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7e6e5d4e-5917-4302-9a39-994e96119d12 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:11.727634 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7e6e5d4e-5917-4302-9a39-994e96119d12 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:11.729205 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7e6e5d4e-5917-4302-9a39-994e96119d12 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:11.992674 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a9769d14-b29f-45ab-ac87-b7c394ff7da6 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133363b2b12d4730994557ee24f08879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d9ba3589a24faaac930a35742ce834', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:12.010964 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a9769d14-b29f-45ab-ac87-b7c394ff7da6 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/3c9c0c43-4e1a-4290-bbf1-60e26aba66ce" status: 200 len: 1300 microversion: 2.1 time: 0.496690 Aug 31 16:27:12.013656 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2834/5695] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:11 2022] GET /compute/v2.1/servers/3c9c0c43-4e1a-4290-bbf1-60e26aba66ce => generated 1300 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:27:12.184855 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-06e4973a-453c-4f4a-bb2c-5819764b7bbf tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:12.186187 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-06e4973a-453c-4f4a-bb2c-5819764b7bbf tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:12.210790 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-06e4973a-453c-4f4a-bb2c-5819764b7bbf tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:12.222665 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-06e4973a-453c-4f4a-bb2c-5819764b7bbf tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:12.231425 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-06e4973a-453c-4f4a-bb2c-5819764b7bbf tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:12.235678 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-06e4973a-453c-4f4a-bb2c-5819764b7bbf tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:12.242383 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-06e4973a-453c-4f4a-bb2c-5819764b7bbf tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:12.254809 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-06e4973a-453c-4f4a-bb2c-5819764b7bbf tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:13.065871 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-06e4973a-453c-4f4a-bb2c-5819764b7bbf tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:13.087887 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-06e4973a-453c-4f4a-bb2c-5819764b7bbf tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1678 microversion: 2.1 time: 0.906378 Aug 31 16:27:13.094913 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2835/5696] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:12 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1678 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:27:13.131687 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-dd6e4822-16b3-4435-8a6f-0060fb9a3429 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:13.132394 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-dd6e4822-16b3-4435-8a6f-0060fb9a3429 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 3c9c0c43-4e1a-4290-bbf1-60e26aba66ce] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:13.140124 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7e6e5d4e-5917-4302-9a39-994e96119d12 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:13.153002 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dd6e4822-16b3-4435-8a6f-0060fb9a3429 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:13.153549 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dd6e4822-16b3-4435-8a6f-0060fb9a3429 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:13.153995 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dd6e4822-16b3-4435-8a6f-0060fb9a3429 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:13.155114 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7e6e5d4e-5917-4302-9a39-994e96119d12 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:13.157349 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dd6e4822-16b3-4435-8a6f-0060fb9a3429 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:13.157507 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7e6e5d4e-5917-4302-9a39-994e96119d12 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:13.159795 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dd6e4822-16b3-4435-8a6f-0060fb9a3429 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:13.159999 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7e6e5d4e-5917-4302-9a39-994e96119d12 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8" status: 200 len: 1406 microversion: 2.20 time: 1.469647 Aug 31 16:27:13.160915 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dd6e4822-16b3-4435-8a6f-0060fb9a3429 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:13.161817 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2862/5697] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:27:11 2022] GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8 => generated 1406 bytes in 1473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:27:13.854465 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-dd6e4822-16b3-4435-8a6f-0060fb9a3429 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133363b2b12d4730994557ee24f08879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d9ba3589a24faaac930a35742ce834', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:13.873624 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-dd6e4822-16b3-4435-8a6f-0060fb9a3429 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/3c9c0c43-4e1a-4290-bbf1-60e26aba66ce" status: 200 len: 1368 microversion: 2.1 time: 0.770926 Aug 31 16:27:13.874841 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2836/5698] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:13 2022] GET /compute/v2.1/servers/3c9c0c43-4e1a-4290-bbf1-60e26aba66ce => generated 1368 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:27:14.122166 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-34bdfe1b-4c86-400a-a036-949d73e4592e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:14.122805 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-34bdfe1b-4c86-400a-a036-949d73e4592e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:14.141283 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-34bdfe1b-4c86-400a-a036-949d73e4592e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:14.146754 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-34bdfe1b-4c86-400a-a036-949d73e4592e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:14.155979 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-34bdfe1b-4c86-400a-a036-949d73e4592e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:14.157990 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-34bdfe1b-4c86-400a-a036-949d73e4592e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:14.163223 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-34bdfe1b-4c86-400a-a036-949d73e4592e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:14.171266 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-34bdfe1b-4c86-400a-a036-949d73e4592e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:14.200283 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9ac0f372-b86c-4816-9591-1e263ee4eee1 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:14.200283 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9ac0f372-b86c-4816-9591-1e263ee4eee1 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: b31fb01b-045f-41f7-bf58-66c1eca839e8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:14.218841 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9ac0f372-b86c-4816-9591-1e263ee4eee1 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:14.223785 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9ac0f372-b86c-4816-9591-1e263ee4eee1 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:14.227401 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9ac0f372-b86c-4816-9591-1e263ee4eee1 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:14.230316 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9ac0f372-b86c-4816-9591-1e263ee4eee1 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:14.248301 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9ac0f372-b86c-4816-9591-1e263ee4eee1 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:14.256852 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9ac0f372-b86c-4816-9591-1e263ee4eee1 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:14.725777 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-9ac0f372-b86c-4816-9591-1e263ee4eee1 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:14.736585 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-9ac0f372-b86c-4816-9591-1e263ee4eee1 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:14.741233 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-9ac0f372-b86c-4816-9591-1e263ee4eee1 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:14.748531 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9ac0f372-b86c-4816-9591-1e263ee4eee1 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8" status: 200 len: 1406 microversion: 2.20 time: 0.558419 Aug 31 16:27:14.767039 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2837/5699] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:27:14 2022] GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8 => generated 1406 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:27:14.815196 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-34bdfe1b-4c86-400a-a036-949d73e4592e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:14.828097 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-34bdfe1b-4c86-400a-a036-949d73e4592e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1678 microversion: 2.1 time: 0.708728 Aug 31 16:27:14.828746 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2863/5700] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:14 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1678 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:27:14.900422 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d3d44483-3560-4368-a756-78769c637b2f tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:14.901232 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d3d44483-3560-4368-a756-78769c637b2f tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 3c9c0c43-4e1a-4290-bbf1-60e26aba66ce] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:14.923876 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d3d44483-3560-4368-a756-78769c637b2f tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:14.924476 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d3d44483-3560-4368-a756-78769c637b2f tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:14.925053 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d3d44483-3560-4368-a756-78769c637b2f tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:14.925862 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d3d44483-3560-4368-a756-78769c637b2f tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:14.926338 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d3d44483-3560-4368-a756-78769c637b2f tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:14.926776 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d3d44483-3560-4368-a756-78769c637b2f tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:15.667703 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d3d44483-3560-4368-a756-78769c637b2f tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133363b2b12d4730994557ee24f08879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d9ba3589a24faaac930a35742ce834', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:15.693151 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d3d44483-3560-4368-a756-78769c637b2f tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/3c9c0c43-4e1a-4290-bbf1-60e26aba66ce" status: 200 len: 1368 microversion: 2.1 time: 0.798629 Aug 31 16:27:15.710159 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2838/5701] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:14 2022] GET /compute/v2.1/servers/3c9c0c43-4e1a-4290-bbf1-60e26aba66ce => generated 1368 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:27:15.779287 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-38ed88b4-340f-46af-b214-bec01ac00c25 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:15.783476 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-38ed88b4-340f-46af-b214-bec01ac00c25 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: b31fb01b-045f-41f7-bf58-66c1eca839e8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:15.810165 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-38ed88b4-340f-46af-b214-bec01ac00c25 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:15.816587 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-38ed88b4-340f-46af-b214-bec01ac00c25 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:15.828282 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-38ed88b4-340f-46af-b214-bec01ac00c25 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:15.833812 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-38ed88b4-340f-46af-b214-bec01ac00c25 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:15.836130 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-38ed88b4-340f-46af-b214-bec01ac00c25 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:15.836733 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-38ed88b4-340f-46af-b214-bec01ac00c25 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:15.854958 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-01ddd6d6-0101-4ba9-8b54-06e3eec1b268 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:15.856171 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-01ddd6d6-0101-4ba9-8b54-06e3eec1b268 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:15.879085 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-01ddd6d6-0101-4ba9-8b54-06e3eec1b268 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:15.888738 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-01ddd6d6-0101-4ba9-8b54-06e3eec1b268 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:15.890499 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-01ddd6d6-0101-4ba9-8b54-06e3eec1b268 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:15.897965 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-01ddd6d6-0101-4ba9-8b54-06e3eec1b268 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:15.899130 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-01ddd6d6-0101-4ba9-8b54-06e3eec1b268 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:15.901275 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-01ddd6d6-0101-4ba9-8b54-06e3eec1b268 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:16.363565 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:27:16.443383 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=10 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:27:16.873860 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-38ed88b4-340f-46af-b214-bec01ac00c25 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:16.879861 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-01ddd6d6-0101-4ba9-8b54-06e3eec1b268 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:16.889410 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-38ed88b4-340f-46af-b214-bec01ac00c25 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:16.890921 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-38ed88b4-340f-46af-b214-bec01ac00c25 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:16.898240 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-01ddd6d6-0101-4ba9-8b54-06e3eec1b268 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1655 microversion: 2.1 time: 1.047410 Aug 31 16:27:16.899756 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-38ed88b4-340f-46af-b214-bec01ac00c25 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8" status: 200 len: 1406 microversion: 2.20 time: 1.117113 Aug 31 16:27:16.921406 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2864/5702] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:27:15 2022] GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8 => generated 1406 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:27:16.926807 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-48709641-03db-4e4a-a8d2-86a4bb60ccb0 req-be379533-ddf1-4e01-ac0b-aeaaeb959dca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c9c0c43-4e1a-4290-bbf1-60e26aba66ce", "tag": "aef76fa3-a9f8-4e2a-ba1d-2d8dd5a9374a"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:27:16.930055 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2839/5703] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:15 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1655 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:27:16.945098 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-bfc37dd6-c942-410a-a538-c6afb3ca2723 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:16.946143 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-bfc37dd6-c942-410a-a538-c6afb3ca2723 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 3c9c0c43-4e1a-4290-bbf1-60e26aba66ce] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:16.959447 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-48709641-03db-4e4a-a8d2-86a4bb60ccb0 req-be379533-ddf1-4e01-ac0b-aeaaeb959dca service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:16.960865 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-48709641-03db-4e4a-a8d2-86a4bb60ccb0 req-be379533-ddf1-4e01-ac0b-aeaaeb959dca service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:16.961323 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-48709641-03db-4e4a-a8d2-86a4bb60ccb0 req-be379533-ddf1-4e01-ac0b-aeaaeb959dca service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:16.986134 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bfc37dd6-c942-410a-a538-c6afb3ca2723 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:16.987424 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-48709641-03db-4e4a-a8d2-86a4bb60ccb0 req-be379533-ddf1-4e01-ac0b-aeaaeb959dca service nova] Creating event network-changed:aef76fa3-a9f8-4e2a-ba1d-2d8dd5a9374a for instance 3c9c0c43-4e1a-4290-bbf1-60e26aba66ce on n-h2-850499-9 Aug 31 16:27:16.991816 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bfc37dd6-c942-410a-a538-c6afb3ca2723 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:16.993077 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bfc37dd6-c942-410a-a538-c6afb3ca2723 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:16.998328 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bfc37dd6-c942-410a-a538-c6afb3ca2723 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:16.999610 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bfc37dd6-c942-410a-a538-c6afb3ca2723 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:17.001834 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-48709641-03db-4e4a-a8d2-86a4bb60ccb0 req-be379533-ddf1-4e01-ac0b-aeaaeb959dca service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078841 Aug 31 16:27:17.002701 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bfc37dd6-c942-410a-a538-c6afb3ca2723 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:17.004594 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2865/5704] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:27:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:27:17.023220 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-88db4006-8ca2-4ff8-964b-fe60c41fce0a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:27:17.039811 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-88db4006-8ca2-4ff8-964b-fe60c41fce0a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:17.043616 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-88db4006-8ca2-4ff8-964b-fe60c41fce0a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:17.048100 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-88db4006-8ca2-4ff8-964b-fe60c41fce0a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:17.145504 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-88db4006-8ca2-4ff8-964b-fe60c41fce0a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Going to try to start instance {{(pid=122257) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 31 16:27:17.270398 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-88db4006-8ca2-4ff8-964b-fe60c41fce0a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "POST /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c/action" status: 202 len: 0 microversion: 2.1 time: 0.261415 Aug 31 16:27:17.271451 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2866/5705] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:27:17 2022] POST /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c/action => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:27:17.321861 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e0fd8d03-e7ca-4df4-b850-175882bb2d3b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:17.324407 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e0fd8d03-e7ca-4df4-b850-175882bb2d3b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:17.339208 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e0fd8d03-e7ca-4df4-b850-175882bb2d3b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:17.344596 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e0fd8d03-e7ca-4df4-b850-175882bb2d3b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:17.345391 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e0fd8d03-e7ca-4df4-b850-175882bb2d3b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:17.349387 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e0fd8d03-e7ca-4df4-b850-175882bb2d3b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:17.349969 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e0fd8d03-e7ca-4df4-b850-175882bb2d3b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:17.352724 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e0fd8d03-e7ca-4df4-b850-175882bb2d3b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:18.107870 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-bfc37dd6-c942-410a-a538-c6afb3ca2723 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133363b2b12d4730994557ee24f08879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d9ba3589a24faaac930a35742ce834', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:18.123223 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-bfc37dd6-c942-410a-a538-c6afb3ca2723 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/3c9c0c43-4e1a-4290-bbf1-60e26aba66ce" status: 200 len: 1368 microversion: 2.1 time: 1.190793 Aug 31 16:27:18.127658 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2840/5706] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:16 2022] GET /compute/v2.1/servers/3c9c0c43-4e1a-4290-bbf1-60e26aba66ce => generated 1368 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:27:18.143854 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-be668133-7225-4580-b240-3850d28d7e13 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:18.145380 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-be668133-7225-4580-b240-3850d28d7e13 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: b31fb01b-045f-41f7-bf58-66c1eca839e8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:18.158444 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-be668133-7225-4580-b240-3850d28d7e13 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:18.160526 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-be668133-7225-4580-b240-3850d28d7e13 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:18.161506 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-be668133-7225-4580-b240-3850d28d7e13 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:18.162922 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-be668133-7225-4580-b240-3850d28d7e13 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:18.163647 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-be668133-7225-4580-b240-3850d28d7e13 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:18.164380 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-be668133-7225-4580-b240-3850d28d7e13 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:18.667163 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e0fd8d03-e7ca-4df4-b850-175882bb2d3b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:18.691196 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e0fd8d03-e7ca-4df4-b850-175882bb2d3b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1664 microversion: 2.1 time: 1.412810 Aug 31 16:27:18.699837 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2867/5707] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:17 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1664 bytes in 1422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:27:19.178928 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-16b552b1-cfc1-4a84-a3a4-43183e1dbf49 req-42f51e85-5475-40e8-95da-09fcbc81a26c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b31fb01b-045f-41f7-bf58-66c1eca839e8", "name": "network-vif-plugged", "status": "completed", "tag": "fbb954d2-1cb6-4ea2-b226-5a233a891670"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:27:19.232508 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:27:19.239876 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-16b552b1-cfc1-4a84-a3a4-43183e1dbf49 req-42f51e85-5475-40e8-95da-09fcbc81a26c service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:19.240985 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-16b552b1-cfc1-4a84-a3a4-43183e1dbf49 req-42f51e85-5475-40e8-95da-09fcbc81a26c service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:19.243367 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-16b552b1-cfc1-4a84-a3a4-43183e1dbf49 req-42f51e85-5475-40e8-95da-09fcbc81a26c service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:19.301304 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-16b552b1-cfc1-4a84-a3a4-43183e1dbf49 req-42f51e85-5475-40e8-95da-09fcbc81a26c service nova] Creating event network-vif-plugged:fbb954d2-1cb6-4ea2-b226-5a233a891670 for instance b31fb01b-045f-41f7-bf58-66c1eca839e8 on n-h1-850499-9 Aug 31 16:27:19.309289 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-16b552b1-cfc1-4a84-a3a4-43183e1dbf49 req-42f51e85-5475-40e8-95da-09fcbc81a26c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.608399 Aug 31 16:27:19.310760 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2868/5708] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:27:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:27:19.318392 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-42fff626-8946-4520-8c16-15a8a0c143b3 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:19.319873 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-42fff626-8946-4520-8c16-15a8a0c143b3 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 4399d570-dda9-4a5a-921c-d76d95f0a6f5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:19.328796 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-42fff626-8946-4520-8c16-15a8a0c143b3 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:19.329789 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-42fff626-8946-4520-8c16-15a8a0c143b3 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:19.330390 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-42fff626-8946-4520-8c16-15a8a0c143b3 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:19.332089 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-42fff626-8946-4520-8c16-15a8a0c143b3 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:19.332774 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-42fff626-8946-4520-8c16-15a8a0c143b3 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:19.333673 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-42fff626-8946-4520-8c16-15a8a0c143b3 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:19.366178 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-42fff626-8946-4520-8c16-15a8a0c143b3 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] HTTP exception thrown: Instance 4399d570-dda9-4a5a-921c-d76d95f0a6f5 could not be found. Aug 31 16:27:19.372091 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-42fff626-8946-4520-8c16-15a8a0c143b3 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Request method failure captured: Aug 31 16:27:19.372091 n-d-850499-9 devstack@n-api.service[122257]: request: DELETE /compute/v2.1/servers/4399d570-dda9-4a5a-921c-d76d95f0a6f5 HTTP/1.1 Aug 31 16:27:19.372091 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:27:19.372091 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:27:19.372091 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:27:19.372091 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:27:19.372091 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:27:19.372091 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:27:19.372091 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:27:19.372091 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:27:19.372091 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4q2NcJzZutw3Y6jF4GnmJD1H1MzSLIbHjRxunPVSp6uKTRmCePfT1DyksG9QgDfSYnSoM0q9vOxO3sqZKoJ5PA2HppEXRHLLn8jTh4ccTKQ6q8SYb3pqui6kOFW5_PmtYr9N0lihJC0EStA4OYRI4QsHOxwmGiiVscbhBZpLyiKmV0 Aug 31 16:27:19.372091 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:27:19.372091 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:27:19.372091 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:27:19.372091 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:27:19.372091 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:27:19.372091 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:27:19.372091 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 014522b19dc349a691e1f6b131229974 Aug 31 16:27:19.372091 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:27:19.372091 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:27:19.372091 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:27:19.372091 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/014522b19dc349a691e1f6b131229974"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/014522b19dc349a691e1f6b131229974"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_014522b19dc349a691e1f6b131229974", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/014522b19dc349a691e1f6b131229974"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:27:19.372091 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:27:19.372091 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 014522b19dc349a691e1f6b131229974 Aug 31 16:27:19.372091 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:27:19.372091 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ServersNegativeTestJSON-918151355-project Aug 31 16:27:19.372091 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:27:19.372091 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:27:19.372091 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: c042c43cc2aa4000a147fae62c261e86 Aug 31 16:27:19.372091 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ServersNegativeTestJSON-918151355-project Aug 31 16:27:19.372091 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:27:19.372091 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance 4399d570-dda9-4a5a-921c-d76d95f0a6f5 could not be found. Aug 31 16:27:19.372091 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '4399d570-dda9-4a5a-921c-d76d95f0a6f5'} Aug 31 16:27:19.372091 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:27:19.372091 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:27:19.372091 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:27:19.372091 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:27:19.372091 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:27:19.372091 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:27:19.372091 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:27:19.372091 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:27:19.372091 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:27:19.372091 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:27:19.372091 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4399d570-dda9-4a5a-921c-d76d95f0a6f5 could not be found. Aug 31 16:27:19.372091 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:27:19.372091 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:27:19.372091 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:27:19.372091 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:27:19.372091 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:27:19.372091 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:27:19.372091 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:27:19.372091 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:27:19.372091 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:27:19.372091 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:27:19.372091 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:27:19.372091 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:27:19.372091 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:27:19.372091 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:27:19.372091 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:27:19.372091 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:27:19.372091 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:27:19.372091 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:27:19.377277 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4399d570-dda9-4a5a-921c-d76d95f0a6f5 could not be found. Aug 31 16:27:19.377277 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:27:19.377277 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:27:19.377277 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:27:19.377277 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:27:19.377277 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:27:19.377277 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:27:19.377277 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:27:19.377277 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:27:19.377277 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4399d570-dda9-4a5a-921c-d76d95f0a6f5 could not be found. Aug 31 16:27:19.377277 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:27:19.385137 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-42fff626-8946-4520-8c16-15a8a0c143b3 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Returning 404 to user: Instance 4399d570-dda9-4a5a-921c-d76d95f0a6f5 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:27:19.386883 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-42fff626-8946-4520-8c16-15a8a0c143b3 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "DELETE /compute/v2.1/servers/4399d570-dda9-4a5a-921c-d76d95f0a6f5" status: 404 len: 111 microversion: 2.1 time: 0.074564 Aug 31 16:27:19.405399 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2869/5709] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:27:19 2022] DELETE /compute/v2.1/servers/4399d570-dda9-4a5a-921c-d76d95f0a6f5 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:27:19.427346 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6978ff4b-86c2-4690-a32e-13cffa068106 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:19.432138 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6978ff4b-86c2-4690-a32e-13cffa068106 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 3c9c0c43-4e1a-4290-bbf1-60e26aba66ce] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:19.455824 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-be668133-7225-4580-b240-3850d28d7e13 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:19.477757 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6978ff4b-86c2-4690-a32e-13cffa068106 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:19.480692 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6978ff4b-86c2-4690-a32e-13cffa068106 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:19.482574 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=100 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:27:19.483362 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6978ff4b-86c2-4690-a32e-13cffa068106 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:19.484581 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6978ff4b-86c2-4690-a32e-13cffa068106 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:19.485582 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6978ff4b-86c2-4690-a32e-13cffa068106 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:19.486319 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6978ff4b-86c2-4690-a32e-13cffa068106 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:19.499053 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-be668133-7225-4580-b240-3850d28d7e13 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:19.501340 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-be668133-7225-4580-b240-3850d28d7e13 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:19.505515 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-be668133-7225-4580-b240-3850d28d7e13 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8" status: 200 len: 1406 microversion: 2.20 time: 1.375988 Aug 31 16:27:19.508649 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2841/5710] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:27:18 2022] GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8 => generated 1406 bytes in 1380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:27:19.578948 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c6e54c9d-3fcb-47b2-beab-47a0f1d21086 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:19.581730 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c6e54c9d-3fcb-47b2-beab-47a0f1d21086 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 4399d570-dda9-4a5a-921c-d76d95f0a6f5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:19.628319 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c6e54c9d-3fcb-47b2-beab-47a0f1d21086 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:19.636713 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c6e54c9d-3fcb-47b2-beab-47a0f1d21086 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:19.637291 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c6e54c9d-3fcb-47b2-beab-47a0f1d21086 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:19.639779 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c6e54c9d-3fcb-47b2-beab-47a0f1d21086 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:19.641012 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c6e54c9d-3fcb-47b2-beab-47a0f1d21086 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:19.642462 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c6e54c9d-3fcb-47b2-beab-47a0f1d21086 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:19.687105 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-c6e54c9d-3fcb-47b2-beab-47a0f1d21086 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] HTTP exception thrown: Instance 4399d570-dda9-4a5a-921c-d76d95f0a6f5 could not be found. Aug 31 16:27:19.697632 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c6e54c9d-3fcb-47b2-beab-47a0f1d21086 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Request method failure captured: Aug 31 16:27:19.697632 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/4399d570-dda9-4a5a-921c-d76d95f0a6f5 HTTP/1.1 Aug 31 16:27:19.697632 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:27:19.697632 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:27:19.697632 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:27:19.697632 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:27:19.697632 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:27:19.697632 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:27:19.697632 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:27:19.697632 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:27:19.697632 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4q2NcJzZutw3Y6jF4GnmJD1H1MzSLIbHjRxunPVSp6uKTRmCePfT1DyksG9QgDfSYnSoM0q9vOxO3sqZKoJ5PA2HppEXRHLLn8jTh4ccTKQ6q8SYb3pqui6kOFW5_PmtYr9N0lihJC0EStA4OYRI4QsHOxwmGiiVscbhBZpLyiKmV0 Aug 31 16:27:19.697632 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:27:19.697632 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:27:19.697632 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:27:19.697632 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:27:19.697632 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:27:19.697632 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:27:19.697632 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 014522b19dc349a691e1f6b131229974 Aug 31 16:27:19.697632 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:27:19.697632 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:27:19.697632 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:27:19.697632 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/014522b19dc349a691e1f6b131229974"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/014522b19dc349a691e1f6b131229974"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_014522b19dc349a691e1f6b131229974", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/014522b19dc349a691e1f6b131229974"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:27:19.697632 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:27:19.697632 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 014522b19dc349a691e1f6b131229974 Aug 31 16:27:19.697632 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:27:19.697632 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ServersNegativeTestJSON-918151355-project Aug 31 16:27:19.697632 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:27:19.697632 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:27:19.697632 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: c042c43cc2aa4000a147fae62c261e86 Aug 31 16:27:19.697632 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ServersNegativeTestJSON-918151355-project Aug 31 16:27:19.697632 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:27:19.697632 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance 4399d570-dda9-4a5a-921c-d76d95f0a6f5 could not be found. Aug 31 16:27:19.697632 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '4399d570-dda9-4a5a-921c-d76d95f0a6f5'} Aug 31 16:27:19.697632 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:27:19.697632 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:27:19.697632 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:27:19.697632 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:27:19.697632 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:27:19.697632 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:27:19.697632 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:27:19.697632 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:27:19.697632 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:27:19.697632 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:27:19.697632 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4399d570-dda9-4a5a-921c-d76d95f0a6f5 could not be found. Aug 31 16:27:19.697632 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:27:19.697632 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:27:19.697632 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:27:19.697632 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:27:19.697632 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:27:19.697632 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:27:19.697632 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:27:19.697632 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:27:19.697632 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:27:19.697632 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:27:19.697632 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:27:19.697632 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:27:19.697632 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:27:19.697632 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:27:19.697632 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:27:19.697632 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:27:19.697632 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4399d570-dda9-4a5a-921c-d76d95f0a6f5 could not be found. Aug 31 16:27:19.697632 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:27:19.697632 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:27:19.697632 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:27:19.702978 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:27:19.702978 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:27:19.702978 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:27:19.702978 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:27:19.702978 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:27:19.702978 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4399d570-dda9-4a5a-921c-d76d95f0a6f5 could not be found. Aug 31 16:27:19.702978 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:27:19.704755 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c6e54c9d-3fcb-47b2-beab-47a0f1d21086 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Returning 404 to user: Instance 4399d570-dda9-4a5a-921c-d76d95f0a6f5 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:27:19.705859 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c6e54c9d-3fcb-47b2-beab-47a0f1d21086 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/4399d570-dda9-4a5a-921c-d76d95f0a6f5" status: 404 len: 111 microversion: 2.1 time: 0.162721 Aug 31 16:27:19.706970 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2842/5711] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:19 2022] GET /compute/v2.1/servers/4399d570-dda9-4a5a-921c-d76d95f0a6f5 => generated 111 bytes in 197 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:27:19.725316 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e0149190-fe26-4897-9a0f-4204d904e8b4 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:19.738795 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e0149190-fe26-4897-9a0f-4204d904e8b4 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:19.760669 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e0149190-fe26-4897-9a0f-4204d904e8b4 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:19.761740 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e0149190-fe26-4897-9a0f-4204d904e8b4 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:19.768472 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e0149190-fe26-4897-9a0f-4204d904e8b4 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:19.774314 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e0149190-fe26-4897-9a0f-4204d904e8b4 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:19.775598 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e0149190-fe26-4897-9a0f-4204d904e8b4 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:19.776227 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e0149190-fe26-4897-9a0f-4204d904e8b4 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:21.223576 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e0149190-fe26-4897-9a0f-4204d904e8b4 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:21.243317 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e0149190-fe26-4897-9a0f-4204d904e8b4 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1664 microversion: 2.1 time: 1.524410 Aug 31 16:27:21.245439 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2843/5712] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:19 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1664 bytes in 1531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:27:21.268042 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-6978ff4b-86c2-4690-a32e-13cffa068106 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133363b2b12d4730994557ee24f08879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d9ba3589a24faaac930a35742ce834', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:21.277521 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9bdc1b5b-ffa2-4026-8aa1-c1b5c0b7137e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:21.278506 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9bdc1b5b-ffa2-4026-8aa1-c1b5c0b7137e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:21.281010 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6978ff4b-86c2-4690-a32e-13cffa068106 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/3c9c0c43-4e1a-4290-bbf1-60e26aba66ce" status: 200 len: 1368 microversion: 2.1 time: 1.873627 Aug 31 16:27:21.282734 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2870/5713] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:19 2022] GET /compute/v2.1/servers/3c9c0c43-4e1a-4290-bbf1-60e26aba66ce => generated 1368 bytes in 1876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:27:21.288580 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-cd4e5c1e-11dd-45f9-aee0-ccade87c8af5 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:21.289574 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-cd4e5c1e-11dd-45f9-aee0-ccade87c8af5 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: b31fb01b-045f-41f7-bf58-66c1eca839e8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:21.294043 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9bdc1b5b-ffa2-4026-8aa1-c1b5c0b7137e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:21.294915 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9bdc1b5b-ffa2-4026-8aa1-c1b5c0b7137e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:21.297597 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cd4e5c1e-11dd-45f9-aee0-ccade87c8af5 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:21.298264 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cd4e5c1e-11dd-45f9-aee0-ccade87c8af5 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:21.298904 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cd4e5c1e-11dd-45f9-aee0-ccade87c8af5 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:21.300043 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cd4e5c1e-11dd-45f9-aee0-ccade87c8af5 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:21.300236 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9bdc1b5b-ffa2-4026-8aa1-c1b5c0b7137e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:21.301122 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cd4e5c1e-11dd-45f9-aee0-ccade87c8af5 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:21.301945 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cd4e5c1e-11dd-45f9-aee0-ccade87c8af5 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:21.305332 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9bdc1b5b-ffa2-4026-8aa1-c1b5c0b7137e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:21.307192 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9bdc1b5b-ffa2-4026-8aa1-c1b5c0b7137e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:21.308580 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9bdc1b5b-ffa2-4026-8aa1-c1b5c0b7137e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:21.517782 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9bdc1b5b-ffa2-4026-8aa1-c1b5c0b7137e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Going to try to terminate instance {{(pid=122256) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:27:21.665555 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-cd4e5c1e-11dd-45f9-aee0-ccade87c8af5 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:21.679371 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-cd4e5c1e-11dd-45f9-aee0-ccade87c8af5 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:21.680995 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-cd4e5c1e-11dd-45f9-aee0-ccade87c8af5 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:21.682766 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-cd4e5c1e-11dd-45f9-aee0-ccade87c8af5 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8" status: 200 len: 1406 microversion: 2.20 time: 0.398890 Aug 31 16:27:21.705222 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2871/5714] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:27:21 2022] GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8 => generated 1406 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:27:21.822130 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9bdc1b5b-ffa2-4026-8aa1-c1b5c0b7137e tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "DELETE /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 204 len: 0 microversion: 2.1 time: 0.574934 Aug 31 16:27:21.823313 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2844/5715] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:27:21 2022] DELETE /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:27:21.832609 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-da5abb4f-7472-4151-845b-2c1be2fea8b6 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:21.833481 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-da5abb4f-7472-4151-845b-2c1be2fea8b6 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:21.842373 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-da5abb4f-7472-4151-845b-2c1be2fea8b6 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:21.843223 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-da5abb4f-7472-4151-845b-2c1be2fea8b6 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:21.844693 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-da5abb4f-7472-4151-845b-2c1be2fea8b6 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:21.845671 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-da5abb4f-7472-4151-845b-2c1be2fea8b6 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:21.846277 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-da5abb4f-7472-4151-845b-2c1be2fea8b6 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:21.846852 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-da5abb4f-7472-4151-845b-2c1be2fea8b6 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:22.274884 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e1a4ad81-9536-4885-a757-6247ab295caa tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:22.277114 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e1a4ad81-9536-4885-a757-6247ab295caa tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:22.297049 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e1a4ad81-9536-4885-a757-6247ab295caa tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:22.298059 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e1a4ad81-9536-4885-a757-6247ab295caa tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:22.300396 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e1a4ad81-9536-4885-a757-6247ab295caa tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:22.303940 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e1a4ad81-9536-4885-a757-6247ab295caa tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:22.304669 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e1a4ad81-9536-4885-a757-6247ab295caa tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:22.305863 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e1a4ad81-9536-4885-a757-6247ab295caa tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:22.954566 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-da5abb4f-7472-4151-845b-2c1be2fea8b6 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:22.968203 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:27:22.989740 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-da5abb4f-7472-4151-845b-2c1be2fea8b6 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1510 microversion: 2.1 time: 1.161593 Aug 31 16:27:23.011974 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2872/5716] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:21 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1510 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:27:23.031430 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5e6daed1-34f3-46d7-beac-6f5a1ca2cdcf tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:23.032614 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5e6daed1-34f3-46d7-beac-6f5a1ca2cdcf tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 3c9c0c43-4e1a-4290-bbf1-60e26aba66ce] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:23.061108 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5e6daed1-34f3-46d7-beac-6f5a1ca2cdcf tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:23.072512 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5e6daed1-34f3-46d7-beac-6f5a1ca2cdcf tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:23.073279 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5e6daed1-34f3-46d7-beac-6f5a1ca2cdcf tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:23.074495 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5e6daed1-34f3-46d7-beac-6f5a1ca2cdcf tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:23.075481 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5e6daed1-34f3-46d7-beac-6f5a1ca2cdcf tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:23.084462 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5e6daed1-34f3-46d7-beac-6f5a1ca2cdcf tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:23.214506 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e1a4ad81-9536-4885-a757-6247ab295caa tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:23.262784 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e1a4ad81-9536-4885-a757-6247ab295caa tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1664 microversion: 2.1 time: 0.958261 Aug 31 16:27:23.262784 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2845/5717] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:22 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1664 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:27:23.278137 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-551d96ca-838b-452b-b4dd-0c2327ad85be tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:23.285985 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-551d96ca-838b-452b-b4dd-0c2327ad85be tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: b31fb01b-045f-41f7-bf58-66c1eca839e8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:23.315882 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-551d96ca-838b-452b-b4dd-0c2327ad85be tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:23.330061 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-551d96ca-838b-452b-b4dd-0c2327ad85be tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:23.340795 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-551d96ca-838b-452b-b4dd-0c2327ad85be tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:23.342095 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-551d96ca-838b-452b-b4dd-0c2327ad85be tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:23.342941 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-551d96ca-838b-452b-b4dd-0c2327ad85be tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:23.343740 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-551d96ca-838b-452b-b4dd-0c2327ad85be tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:23.944416 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5e6daed1-34f3-46d7-beac-6f5a1ca2cdcf tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133363b2b12d4730994557ee24f08879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d9ba3589a24faaac930a35742ce834', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:24.000367 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5e6daed1-34f3-46d7-beac-6f5a1ca2cdcf tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/3c9c0c43-4e1a-4290-bbf1-60e26aba66ce" status: 200 len: 1368 microversion: 2.1 time: 0.986496 Aug 31 16:27:24.005008 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2873/5718] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:23 2022] GET /compute/v2.1/servers/3c9c0c43-4e1a-4290-bbf1-60e26aba66ce => generated 1368 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:27:24.033228 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f12f6dc6-3003-4dd9-8fad-76ac19dca182 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:24.034557 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f12f6dc6-3003-4dd9-8fad-76ac19dca182 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:24.058189 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f12f6dc6-3003-4dd9-8fad-76ac19dca182 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:24.059343 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f12f6dc6-3003-4dd9-8fad-76ac19dca182 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:24.061187 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f12f6dc6-3003-4dd9-8fad-76ac19dca182 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:24.062554 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f12f6dc6-3003-4dd9-8fad-76ac19dca182 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:24.068031 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f12f6dc6-3003-4dd9-8fad-76ac19dca182 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:24.069146 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f12f6dc6-3003-4dd9-8fad-76ac19dca182 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:24.613874 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-551d96ca-838b-452b-b4dd-0c2327ad85be tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:24.626215 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-551d96ca-838b-452b-b4dd-0c2327ad85be tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:24.642911 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-551d96ca-838b-452b-b4dd-0c2327ad85be tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:24.644358 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-551d96ca-838b-452b-b4dd-0c2327ad85be tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8" status: 200 len: 1598 microversion: 2.20 time: 1.382038 Aug 31 16:27:24.666441 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2846/5719] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:27:23 2022] GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8 => generated 1598 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:27:24.676954 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-82fea034-ffe5-49ad-8449-01c94f5592d6 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:24.677583 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-82fea034-ffe5-49ad-8449-01c94f5592d6 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:24.687047 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-82fea034-ffe5-49ad-8449-01c94f5592d6 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:24.687577 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-82fea034-ffe5-49ad-8449-01c94f5592d6 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:24.688023 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-82fea034-ffe5-49ad-8449-01c94f5592d6 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:24.688807 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-82fea034-ffe5-49ad-8449-01c94f5592d6 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:24.689269 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-82fea034-ffe5-49ad-8449-01c94f5592d6 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:24.689698 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-82fea034-ffe5-49ad-8449-01c94f5592d6 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:25.321341 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f12f6dc6-3003-4dd9-8fad-76ac19dca182 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:25.346349 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f12f6dc6-3003-4dd9-8fad-76ac19dca182 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1510 microversion: 2.1 time: 1.308829 Aug 31 16:27:25.365085 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2874/5720] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:24 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1510 bytes in 1339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:27:25.379067 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-286d8778-a306-4b2b-a316-2c1901b27836 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:25.381219 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-286d8778-a306-4b2b-a316-2c1901b27836 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: b31fb01b-045f-41f7-bf58-66c1eca839e8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:25.393225 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-286d8778-a306-4b2b-a316-2c1901b27836 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:25.421615 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-286d8778-a306-4b2b-a316-2c1901b27836 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:25.422276 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-286d8778-a306-4b2b-a316-2c1901b27836 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:25.424468 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-286d8778-a306-4b2b-a316-2c1901b27836 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:25.424968 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-286d8778-a306-4b2b-a316-2c1901b27836 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:25.425417 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-286d8778-a306-4b2b-a316-2c1901b27836 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:25.716646 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-286d8778-a306-4b2b-a316-2c1901b27836 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.347972 Aug 31 16:27:25.717489 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2875/5721] 10.222.0.61 () {60 vars in 1316 bytes} [Wed Aug 31 16:27:25 2022] GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8/os-interface => generated 284 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 16:27:25.740108 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-13ad9938-6080-4138-b518-f9e7dbbf6e2b tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:25.741125 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-13ad9938-6080-4138-b518-f9e7dbbf6e2b tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 3c9c0c43-4e1a-4290-bbf1-60e26aba66ce] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:25.762614 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-13ad9938-6080-4138-b518-f9e7dbbf6e2b tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:25.763384 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-13ad9938-6080-4138-b518-f9e7dbbf6e2b tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:25.765948 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-13ad9938-6080-4138-b518-f9e7dbbf6e2b tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:25.772495 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-13ad9938-6080-4138-b518-f9e7dbbf6e2b tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:25.778205 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-13ad9938-6080-4138-b518-f9e7dbbf6e2b tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:25.781679 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-13ad9938-6080-4138-b518-f9e7dbbf6e2b tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:25.924364 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-82fea034-ffe5-49ad-8449-01c94f5592d6 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:25.933527 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-82fea034-ffe5-49ad-8449-01c94f5592d6 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1664 microversion: 2.1 time: 1.266475 Aug 31 16:27:25.952262 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2847/5722] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:24 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1664 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:27:26.316175 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-13ad9938-6080-4138-b518-f9e7dbbf6e2b tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133363b2b12d4730994557ee24f08879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d9ba3589a24faaac930a35742ce834', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:26.334640 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-13ad9938-6080-4138-b518-f9e7dbbf6e2b tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/3c9c0c43-4e1a-4290-bbf1-60e26aba66ce" status: 200 len: 1368 microversion: 2.1 time: 0.615796 Aug 31 16:27:26.338848 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2876/5723] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:25 2022] GET /compute/v2.1/servers/3c9c0c43-4e1a-4290-bbf1-60e26aba66ce => generated 1368 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:27:26.378964 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b6d75ac0-d35e-4713-ad80-21874629f1d8 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:26.379852 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b6d75ac0-d35e-4713-ad80-21874629f1d8 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:26.412720 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b6d75ac0-d35e-4713-ad80-21874629f1d8 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:26.413666 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b6d75ac0-d35e-4713-ad80-21874629f1d8 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:26.414348 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b6d75ac0-d35e-4713-ad80-21874629f1d8 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:26.416449 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b6d75ac0-d35e-4713-ad80-21874629f1d8 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:26.424361 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b6d75ac0-d35e-4713-ad80-21874629f1d8 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:26.426134 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b6d75ac0-d35e-4713-ad80-21874629f1d8 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:26.978476 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b1d3e2a9-edeb-4931-8c31-fd02f94b408a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:26.979135 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b1d3e2a9-edeb-4931-8c31-fd02f94b408a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:26.990263 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b1d3e2a9-edeb-4931-8c31-fd02f94b408a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:26.990780 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b1d3e2a9-edeb-4931-8c31-fd02f94b408a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:26.991230 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b1d3e2a9-edeb-4931-8c31-fd02f94b408a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:27.001459 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b1d3e2a9-edeb-4931-8c31-fd02f94b408a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:27.001931 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b1d3e2a9-edeb-4931-8c31-fd02f94b408a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:27.002432 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b1d3e2a9-edeb-4931-8c31-fd02f94b408a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:27.589953 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b6d75ac0-d35e-4713-ad80-21874629f1d8 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:27.609780 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b6d75ac0-d35e-4713-ad80-21874629f1d8 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1510 microversion: 2.1 time: 1.236028 Aug 31 16:27:27.618866 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2848/5724] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:26 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1510 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:27:27.647593 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-f1b94570-7fd1-4e18-bb6e-f62f87d4baf1 req-8f872fa7-165b-41ed-8d47-e0db79b51c46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c9c0c43-4e1a-4290-bbf1-60e26aba66ce", "name": "network-vif-plugged", "status": "completed", "tag": "aef76fa3-a9f8-4e2a-ba1d-2d8dd5a9374a"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:27:27.718558 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-f1b94570-7fd1-4e18-bb6e-f62f87d4baf1 req-8f872fa7-165b-41ed-8d47-e0db79b51c46 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:27.719585 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-f1b94570-7fd1-4e18-bb6e-f62f87d4baf1 req-8f872fa7-165b-41ed-8d47-e0db79b51c46 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:27.720371 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-f1b94570-7fd1-4e18-bb6e-f62f87d4baf1 req-8f872fa7-165b-41ed-8d47-e0db79b51c46 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:27.793893 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-f1b94570-7fd1-4e18-bb6e-f62f87d4baf1 req-8f872fa7-165b-41ed-8d47-e0db79b51c46 service nova] Creating event network-vif-plugged:aef76fa3-a9f8-4e2a-ba1d-2d8dd5a9374a for instance 3c9c0c43-4e1a-4290-bbf1-60e26aba66ce on n-h2-850499-9 Aug 31 16:27:27.811427 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-f1b94570-7fd1-4e18-bb6e-f62f87d4baf1 req-8f872fa7-165b-41ed-8d47-e0db79b51c46 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.184495 Aug 31 16:27:27.812214 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2849/5725] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:27:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:27:27.819815 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-fe78054b-07cb-405c-bf6f-ccc2d1c8fcf3 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:27.820734 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-fe78054b-07cb-405c-bf6f-ccc2d1c8fcf3 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 3c9c0c43-4e1a-4290-bbf1-60e26aba66ce] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:27.828438 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fe78054b-07cb-405c-bf6f-ccc2d1c8fcf3 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:27.829166 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fe78054b-07cb-405c-bf6f-ccc2d1c8fcf3 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:27.829761 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fe78054b-07cb-405c-bf6f-ccc2d1c8fcf3 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:27.830687 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fe78054b-07cb-405c-bf6f-ccc2d1c8fcf3 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:27.831531 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fe78054b-07cb-405c-bf6f-ccc2d1c8fcf3 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:27.832215 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fe78054b-07cb-405c-bf6f-ccc2d1c8fcf3 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:28.116114 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b1d3e2a9-edeb-4931-8c31-fd02f94b408a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:28.159158 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b1d3e2a9-edeb-4931-8c31-fd02f94b408a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1668 microversion: 2.1 time: 1.184531 Aug 31 16:27:28.173301 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2877/5726] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:26 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1668 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:27:28.201425 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a1a8afd1-bd8d-41f6-bdda-12dcdbfe5f18 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:28.203980 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a1a8afd1-bd8d-41f6-bdda-12dcdbfe5f18 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: 238b044c-ec15-4c03-88da-d90f9b1ec116] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:28.232672 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a1a8afd1-bd8d-41f6-bdda-12dcdbfe5f18 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:28.234083 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a1a8afd1-bd8d-41f6-bdda-12dcdbfe5f18 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:28.236066 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a1a8afd1-bd8d-41f6-bdda-12dcdbfe5f18 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:28.239967 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a1a8afd1-bd8d-41f6-bdda-12dcdbfe5f18 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:28.241044 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a1a8afd1-bd8d-41f6-bdda-12dcdbfe5f18 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:28.242075 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a1a8afd1-bd8d-41f6-bdda-12dcdbfe5f18 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:28.346356 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a1a8afd1-bd8d-41f6-bdda-12dcdbfe5f18 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: 238b044c-ec15-4c03-88da-d90f9b1ec116] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:27:28.609379 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a1a8afd1-bd8d-41f6-bdda-12dcdbfe5f18 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "DELETE /compute/v2.1/servers/238b044c-ec15-4c03-88da-d90f9b1ec116" status: 204 len: 0 microversion: 2.1 time: 0.433128 Aug 31 16:27:28.620099 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2878/5727] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:27:28 2022] DELETE /compute/v2.1/servers/238b044c-ec15-4c03-88da-d90f9b1ec116 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:27:28.636961 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c0cc955a-9a69-41a0-9670-18273b651457 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:28.638466 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c0cc955a-9a69-41a0-9670-18273b651457 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:28.653179 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c0cc955a-9a69-41a0-9670-18273b651457 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:28.653179 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c0cc955a-9a69-41a0-9670-18273b651457 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:28.653723 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c0cc955a-9a69-41a0-9670-18273b651457 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:28.657046 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c0cc955a-9a69-41a0-9670-18273b651457 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:28.661231 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c0cc955a-9a69-41a0-9670-18273b651457 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:28.661759 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c0cc955a-9a69-41a0-9670-18273b651457 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:28.912167 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-fe78054b-07cb-405c-bf6f-ccc2d1c8fcf3 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133363b2b12d4730994557ee24f08879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d9ba3589a24faaac930a35742ce834', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:28.932580 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-fe78054b-07cb-405c-bf6f-ccc2d1c8fcf3 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/3c9c0c43-4e1a-4290-bbf1-60e26aba66ce" status: 200 len: 1368 microversion: 2.1 time: 1.119004 Aug 31 16:27:28.934188 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2850/5728] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:27 2022] GET /compute/v2.1/servers/3c9c0c43-4e1a-4290-bbf1-60e26aba66ce => generated 1368 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:27:28.949408 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-603561aa-6004-4127-8808-b3c29ebe5f9b tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:28.950398 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-603561aa-6004-4127-8808-b3c29ebe5f9b tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: 238b044c-ec15-4c03-88da-d90f9b1ec116] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:28.981060 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-603561aa-6004-4127-8808-b3c29ebe5f9b tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:28.981779 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-603561aa-6004-4127-8808-b3c29ebe5f9b tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:28.987167 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-603561aa-6004-4127-8808-b3c29ebe5f9b tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:28.988780 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-603561aa-6004-4127-8808-b3c29ebe5f9b tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:28.991299 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-603561aa-6004-4127-8808-b3c29ebe5f9b tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:28.995030 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-603561aa-6004-4127-8808-b3c29ebe5f9b tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:30.065818 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-603561aa-6004-4127-8808-b3c29ebe5f9b tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4744703b964435bbead751ca884d1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e014d4e4da5e47ff9a1261e7730034ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:30.095550 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-603561aa-6004-4127-8808-b3c29ebe5f9b tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/238b044c-ec15-4c03-88da-d90f9b1ec116" status: 200 len: 1509 microversion: 2.1 time: 1.160132 Aug 31 16:27:30.100894 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2851/5729] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:28 2022] GET /compute/v2.1/servers/238b044c-ec15-4c03-88da-d90f9b1ec116 => generated 1509 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:27:30.133211 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3a08a012-879a-4d6c-bc4b-a4b1bfd0ea8f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:30.145409 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3a08a012-879a-4d6c-bc4b-a4b1bfd0ea8f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:30.182653 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3a08a012-879a-4d6c-bc4b-a4b1bfd0ea8f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:30.185300 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3a08a012-879a-4d6c-bc4b-a4b1bfd0ea8f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:30.187051 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3a08a012-879a-4d6c-bc4b-a4b1bfd0ea8f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:30.197818 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3a08a012-879a-4d6c-bc4b-a4b1bfd0ea8f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:30.199181 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3a08a012-879a-4d6c-bc4b-a4b1bfd0ea8f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:30.204175 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3a08a012-879a-4d6c-bc4b-a4b1bfd0ea8f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:30.336685 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c0cc955a-9a69-41a0-9670-18273b651457 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:30.381307 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c0cc955a-9a69-41a0-9670-18273b651457 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1668 microversion: 2.1 time: 1.748707 Aug 31 16:27:30.388061 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2879/5730] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:28 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1668 bytes in 1767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:27:30.417499 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-f232c6aa-b181-49e7-82d4-3e03018a59bb req-d6c5af96-27ed-4333-8b06-1bb05dc79721 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b31fb01b-045f-41f7-bf58-66c1eca839e8", "tag": "fbb954d2-1cb6-4ea2-b226-5a233a891670"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:27:30.506687 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-f232c6aa-b181-49e7-82d4-3e03018a59bb req-d6c5af96-27ed-4333-8b06-1bb05dc79721 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:30.514956 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-f232c6aa-b181-49e7-82d4-3e03018a59bb req-d6c5af96-27ed-4333-8b06-1bb05dc79721 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:30.521785 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-f232c6aa-b181-49e7-82d4-3e03018a59bb req-d6c5af96-27ed-4333-8b06-1bb05dc79721 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:30.597189 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-f232c6aa-b181-49e7-82d4-3e03018a59bb req-d6c5af96-27ed-4333-8b06-1bb05dc79721 service nova] Creating event network-changed:fbb954d2-1cb6-4ea2-b226-5a233a891670 for instance b31fb01b-045f-41f7-bf58-66c1eca839e8 on n-h1-850499-9 Aug 31 16:27:30.635461 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-f232c6aa-b181-49e7-82d4-3e03018a59bb req-d6c5af96-27ed-4333-8b06-1bb05dc79721 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.245355 Aug 31 16:27:30.636408 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2880/5731] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:27:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:27:30.651426 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-57ec4026-ced9-466d-8cd4-3b9c8ef67c11 req-8a5b6962-15ed-4fb6-a921-674cba1cadc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22082563-385d-41a9-baa5-6fb277278505", "name": "network-vif-deleted", "tag": "01a10893-04bb-4b06-9640-8c6578bca1fc"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:27:30.705473 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-57ec4026-ced9-466d-8cd4-3b9c8ef67c11 req-8a5b6962-15ed-4fb6-a921-674cba1cadc0 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:30.705964 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-57ec4026-ced9-466d-8cd4-3b9c8ef67c11 req-8a5b6962-15ed-4fb6-a921-674cba1cadc0 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:30.706991 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-57ec4026-ced9-466d-8cd4-3b9c8ef67c11 req-8a5b6962-15ed-4fb6-a921-674cba1cadc0 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:30.763532 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-57ec4026-ced9-466d-8cd4-3b9c8ef67c11 req-8a5b6962-15ed-4fb6-a921-674cba1cadc0 service nova] Creating event network-vif-deleted:01a10893-04bb-4b06-9640-8c6578bca1fc for instance 22082563-385d-41a9-baa5-6fb277278505 on n-h2-850499-9 Aug 31 16:27:30.783901 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-57ec4026-ced9-466d-8cd4-3b9c8ef67c11 req-8a5b6962-15ed-4fb6-a921-674cba1cadc0 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139360 Aug 31 16:27:30.792929 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2881/5732] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:27:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:27:30.809664 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5723b023-baea-4c93-99e4-a4a7c5f95509 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:30.815491 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5723b023-baea-4c93-99e4-a4a7c5f95509 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 3c9c0c43-4e1a-4290-bbf1-60e26aba66ce] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:30.843876 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5723b023-baea-4c93-99e4-a4a7c5f95509 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:30.844642 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5723b023-baea-4c93-99e4-a4a7c5f95509 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:30.845089 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5723b023-baea-4c93-99e4-a4a7c5f95509 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:30.845815 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5723b023-baea-4c93-99e4-a4a7c5f95509 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:30.846277 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5723b023-baea-4c93-99e4-a4a7c5f95509 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:30.846707 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5723b023-baea-4c93-99e4-a4a7c5f95509 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:31.026888 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3a08a012-879a-4d6c-bc4b-a4b1bfd0ea8f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c042c43cc2aa4000a147fae62c261e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '014522b19dc349a691e1f6b131229974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:31.064392 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3a08a012-879a-4d6c-bc4b-a4b1bfd0ea8f tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 200 len: 1302 microversion: 2.1 time: 0.960946 Aug 31 16:27:31.066679 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2852/5733] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:30 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 1302 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:27:31.085227 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e56ea5bd-d77c-4b02-add8-df68ed5253cb tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:31.086259 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e56ea5bd-d77c-4b02-add8-df68ed5253cb tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:31.111809 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e56ea5bd-d77c-4b02-add8-df68ed5253cb tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:31.112673 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e56ea5bd-d77c-4b02-add8-df68ed5253cb tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:31.116471 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e56ea5bd-d77c-4b02-add8-df68ed5253cb tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:31.118504 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e56ea5bd-d77c-4b02-add8-df68ed5253cb tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:31.128078 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e56ea5bd-d77c-4b02-add8-df68ed5253cb tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:31.129509 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e56ea5bd-d77c-4b02-add8-df68ed5253cb tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:33.080660 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5723b023-baea-4c93-99e4-a4a7c5f95509 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133363b2b12d4730994557ee24f08879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d9ba3589a24faaac930a35742ce834', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:33.124224 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5723b023-baea-4c93-99e4-a4a7c5f95509 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/3c9c0c43-4e1a-4290-bbf1-60e26aba66ce" status: 200 len: 1368 microversion: 2.1 time: 2.323256 Aug 31 16:27:33.125412 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2882/5734] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:30 2022] GET /compute/v2.1/servers/3c9c0c43-4e1a-4290-bbf1-60e26aba66ce => generated 1368 bytes in 2332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:27:33.137825 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-17264485-c134-41f8-b3ae-4df03dabeca7 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:33.157126 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-17264485-c134-41f8-b3ae-4df03dabeca7 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: 238b044c-ec15-4c03-88da-d90f9b1ec116] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:33.206223 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-17264485-c134-41f8-b3ae-4df03dabeca7 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:33.215309 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-17264485-c134-41f8-b3ae-4df03dabeca7 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:33.216731 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-17264485-c134-41f8-b3ae-4df03dabeca7 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:33.218425 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-17264485-c134-41f8-b3ae-4df03dabeca7 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:33.219816 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-17264485-c134-41f8-b3ae-4df03dabeca7 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:33.227488 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-17264485-c134-41f8-b3ae-4df03dabeca7 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:33.468231 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e56ea5bd-d77c-4b02-add8-df68ed5253cb tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:33.516211 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e56ea5bd-d77c-4b02-add8-df68ed5253cb tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1668 microversion: 2.1 time: 2.447525 Aug 31 16:27:33.518411 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2853/5735] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:31 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1668 bytes in 2451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:27:33.536494 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a22ca520-99cf-4fc9-9c97-01b7a1775fd7 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:33.539616 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a22ca520-99cf-4fc9-9c97-01b7a1775fd7 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] [instance: 22082563-385d-41a9-baa5-6fb277278505] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:33.604650 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a22ca520-99cf-4fc9-9c97-01b7a1775fd7 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:33.612853 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a22ca520-99cf-4fc9-9c97-01b7a1775fd7 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:33.617004 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a22ca520-99cf-4fc9-9c97-01b7a1775fd7 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:33.623038 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a22ca520-99cf-4fc9-9c97-01b7a1775fd7 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:33.629829 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a22ca520-99cf-4fc9-9c97-01b7a1775fd7 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:33.633047 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a22ca520-99cf-4fc9-9c97-01b7a1775fd7 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:33.642749 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-17264485-c134-41f8-b3ae-4df03dabeca7 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4744703b964435bbead751ca884d1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e014d4e4da5e47ff9a1261e7730034ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:33.703990 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-17264485-c134-41f8-b3ae-4df03dabeca7 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/238b044c-ec15-4c03-88da-d90f9b1ec116" status: 200 len: 1467 microversion: 2.1 time: 0.563877 Aug 31 16:27:33.704237 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2883/5736] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:33 2022] GET /compute/v2.1/servers/238b044c-ec15-4c03-88da-d90f9b1ec116 => generated 1467 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:27:33.724641 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9f869063-8187-4a55-aa6a-e6109e58cd48 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:33.731834 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-a22ca520-99cf-4fc9-9c97-01b7a1775fd7 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] HTTP exception thrown: Instance 22082563-385d-41a9-baa5-6fb277278505 could not be found. Aug 31 16:27:33.740931 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9f869063-8187-4a55-aa6a-e6109e58cd48 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:33.750931 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a22ca520-99cf-4fc9-9c97-01b7a1775fd7 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Request method failure captured: Aug 31 16:27:33.750931 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 HTTP/1.1 Aug 31 16:27:33.750931 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:27:33.750931 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:27:33.750931 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:27:33.750931 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:27:33.750931 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:27:33.750931 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:27:33.750931 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:27:33.750931 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:27:33.750931 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4q2NcJzZutw3Y6jF4GnmJD1H1MzSLIbHjRxunPVSp6uKTRmCePfT1DyksG9QgDfSYnSoM0q9vOxO3sqZKoJ5PA2HppEXRHLLn8jTh4ccTKQ6q8SYb3pqui6kOFW5_PmtYr9N0lihJC0EStA4OYRI4QsHOxwmGiiVscbhBZpLyiKmV0 Aug 31 16:27:33.750931 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:27:33.750931 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:27:33.750931 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:27:33.750931 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:27:33.750931 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:27:33.750931 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:27:33.750931 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 014522b19dc349a691e1f6b131229974 Aug 31 16:27:33.750931 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:27:33.750931 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:27:33.750931 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:27:33.750931 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/014522b19dc349a691e1f6b131229974"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/014522b19dc349a691e1f6b131229974"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_014522b19dc349a691e1f6b131229974", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/014522b19dc349a691e1f6b131229974"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:27:33.750931 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:27:33.750931 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 014522b19dc349a691e1f6b131229974 Aug 31 16:27:33.750931 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ServersNegativeTestJSON-918151355 Aug 31 16:27:33.750931 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ServersNegativeTestJSON-918151355-project Aug 31 16:27:33.750931 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:27:33.750931 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:27:33.750931 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: c042c43cc2aa4000a147fae62c261e86 Aug 31 16:27:33.750931 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ServersNegativeTestJSON-918151355-project Aug 31 16:27:33.750931 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:27:33.750931 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance 22082563-385d-41a9-baa5-6fb277278505 could not be found. Aug 31 16:27:33.750931 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '22082563-385d-41a9-baa5-6fb277278505'} Aug 31 16:27:33.750931 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:27:33.750931 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:27:33.750931 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:27:33.750931 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:27:33.750931 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:27:33.750931 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:27:33.750931 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:27:33.750931 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:27:33.750931 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:27:33.750931 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:27:33.750931 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22082563-385d-41a9-baa5-6fb277278505 could not be found. Aug 31 16:27:33.750931 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:27:33.750931 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:27:33.750931 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:27:33.750931 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:27:33.750931 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:27:33.750931 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:27:33.750931 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:27:33.750931 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:27:33.750931 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:27:33.750931 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:27:33.750931 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:27:33.750931 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:27:33.750931 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:27:33.750931 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:27:33.750931 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:27:33.750931 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:27:33.750931 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22082563-385d-41a9-baa5-6fb277278505 could not be found. Aug 31 16:27:33.750931 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:27:33.750931 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:27:33.750931 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:27:33.756120 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:27:33.756120 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:27:33.756120 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:27:33.756120 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:27:33.756120 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:27:33.756120 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22082563-385d-41a9-baa5-6fb277278505 could not be found. Aug 31 16:27:33.756120 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:27:33.756120 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a22ca520-99cf-4fc9-9c97-01b7a1775fd7 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] Returning 404 to user: Instance 22082563-385d-41a9-baa5-6fb277278505 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:27:33.756120 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a22ca520-99cf-4fc9-9c97-01b7a1775fd7 tempest-ServersNegativeTestJSON-918151355 tempest-ServersNegativeTestJSON-918151355-project] 10.222.0.61 "GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505" status: 404 len: 111 microversion: 2.1 time: 0.235401 Aug 31 16:27:33.759759 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2854/5737] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:33 2022] GET /compute/v2.1/servers/22082563-385d-41a9-baa5-6fb277278505 => generated 111 bytes in 240 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:27:33.777007 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-3e0719d7-55d3-4572-8aac-4e52e35ca53f req-41ffabe5-5a50-45cd-b11f-f8891e30b77a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "238b044c-ec15-4c03-88da-d90f9b1ec116", "name": "network-vif-deleted", "tag": "d2825fd5-c211-4535-9a3d-64610db4b69a"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:27:33.798921 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9f869063-8187-4a55-aa6a-e6109e58cd48 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:33.800807 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9f869063-8187-4a55-aa6a-e6109e58cd48 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:33.808828 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9f869063-8187-4a55-aa6a-e6109e58cd48 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:33.811985 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9f869063-8187-4a55-aa6a-e6109e58cd48 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:33.816087 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9f869063-8187-4a55-aa6a-e6109e58cd48 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:33.817063 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9f869063-8187-4a55-aa6a-e6109e58cd48 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:33.866353 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-3e0719d7-55d3-4572-8aac-4e52e35ca53f req-41ffabe5-5a50-45cd-b11f-f8891e30b77a service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:33.867263 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-3e0719d7-55d3-4572-8aac-4e52e35ca53f req-41ffabe5-5a50-45cd-b11f-f8891e30b77a service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:33.868147 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-3e0719d7-55d3-4572-8aac-4e52e35ca53f req-41ffabe5-5a50-45cd-b11f-f8891e30b77a service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:33.959760 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-3e0719d7-55d3-4572-8aac-4e52e35ca53f req-41ffabe5-5a50-45cd-b11f-f8891e30b77a service nova] Creating event network-vif-deleted:d2825fd5-c211-4535-9a3d-64610db4b69a for instance 238b044c-ec15-4c03-88da-d90f9b1ec116 on n-h1-850499-9 Aug 31 16:27:33.990612 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-3e0719d7-55d3-4572-8aac-4e52e35ca53f req-41ffabe5-5a50-45cd-b11f-f8891e30b77a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.218501 Aug 31 16:27:33.994781 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2855/5738] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:27:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:27:34.158376 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-578fe043-c8d7-4ad4-81d2-541ba3907250 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:34.166454 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-578fe043-c8d7-4ad4-81d2-541ba3907250 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 3c9c0c43-4e1a-4290-bbf1-60e26aba66ce] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:34.218716 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:27:34.247253 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-578fe043-c8d7-4ad4-81d2-541ba3907250 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:34.249456 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-578fe043-c8d7-4ad4-81d2-541ba3907250 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:34.259843 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-578fe043-c8d7-4ad4-81d2-541ba3907250 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:34.261656 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-578fe043-c8d7-4ad4-81d2-541ba3907250 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:34.263870 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-578fe043-c8d7-4ad4-81d2-541ba3907250 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:34.265217 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-578fe043-c8d7-4ad4-81d2-541ba3907250 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:35.764298 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9f869063-8187-4a55-aa6a-e6109e58cd48 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:35.777334 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9f869063-8187-4a55-aa6a-e6109e58cd48 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1668 microversion: 2.1 time: 2.071153 Aug 31 16:27:35.778250 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2884/5739] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:33 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1668 bytes in 2074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:27:35.783685 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6f640bb3-d853-410b-bb71-ad22b94d65bd tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:35.784611 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6f640bb3-d853-410b-bb71-ad22b94d65bd tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: 238b044c-ec15-4c03-88da-d90f9b1ec116] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:35.793240 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6f640bb3-d853-410b-bb71-ad22b94d65bd tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:35.794063 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6f640bb3-d853-410b-bb71-ad22b94d65bd tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:35.794728 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6f640bb3-d853-410b-bb71-ad22b94d65bd tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:35.795993 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6f640bb3-d853-410b-bb71-ad22b94d65bd tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:35.796893 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6f640bb3-d853-410b-bb71-ad22b94d65bd tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:35.797757 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6f640bb3-d853-410b-bb71-ad22b94d65bd tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:35.824661 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-6f640bb3-d853-410b-bb71-ad22b94d65bd tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] HTTP exception thrown: Instance 238b044c-ec15-4c03-88da-d90f9b1ec116 could not be found. Aug 31 16:27:35.827213 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6f640bb3-d853-410b-bb71-ad22b94d65bd tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Request method failure captured: Aug 31 16:27:35.827213 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/238b044c-ec15-4c03-88da-d90f9b1ec116 HTTP/1.1 Aug 31 16:27:35.827213 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:27:35.827213 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:27:35.827213 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:27:35.827213 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:27:35.827213 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:27:35.827213 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:27:35.827213 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:27:35.827213 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:27:35.827213 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4oy7qo0hac0I9IpX9ONeLQn5FXZxTJLjhjMB-WYHPcUUf61xQVdU4TOXEJINvaGC5c5Wjhk9pb4p_bnOvsu8HLsM1WUDttS1HJeEirzVfdDQ2PqvMBOo0UbRSxhckjuHlfQOCH8lv8yi1i-W11nad5j2vdw9RWWfX0Cd51S12MLuko Aug 31 16:27:35.827213 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:27:35.827213 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:27:35.827213 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:27:35.827213 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:27:35.827213 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:27:35.827213 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:27:35.827213 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: e014d4e4da5e47ff9a1261e7730034ac Aug 31 16:27:35.827213 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1963116327 Aug 31 16:27:35.827213 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:27:35.827213 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:27:35.827213 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e014d4e4da5e47ff9a1261e7730034ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/e014d4e4da5e47ff9a1261e7730034ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_e014d4e4da5e47ff9a1261e7730034ac", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e014d4e4da5e47ff9a1261e7730034ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:27:35.827213 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1963116327 Aug 31 16:27:35.827213 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: e014d4e4da5e47ff9a1261e7730034ac Aug 31 16:27:35.827213 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1963116327 Aug 31 16:27:35.827213 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ServerRescueNegativeTestJSON-1963116327-project Aug 31 16:27:35.827213 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:27:35.827213 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:27:35.827213 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: e4744703b964435bbead751ca884d1ae Aug 31 16:27:35.827213 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1963116327-project Aug 31 16:27:35.827213 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:27:35.827213 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance 238b044c-ec15-4c03-88da-d90f9b1ec116 could not be found. Aug 31 16:27:35.827213 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '238b044c-ec15-4c03-88da-d90f9b1ec116'} Aug 31 16:27:35.827213 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:27:35.827213 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:27:35.827213 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:27:35.827213 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:27:35.827213 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:27:35.827213 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:27:35.827213 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:27:35.827213 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:27:35.827213 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:27:35.827213 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:27:35.827213 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 238b044c-ec15-4c03-88da-d90f9b1ec116 could not be found. Aug 31 16:27:35.827213 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:27:35.827213 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:27:35.827213 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:27:35.827213 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:27:35.827213 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:27:35.827213 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:27:35.827213 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:27:35.827213 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:27:35.827213 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:27:35.827213 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:27:35.827213 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:27:35.827213 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:27:35.827213 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:27:35.827213 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:27:35.827213 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:27:35.827213 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:27:35.827213 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 238b044c-ec15-4c03-88da-d90f9b1ec116 could not be found. Aug 31 16:27:35.827213 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:27:35.827213 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:27:35.830138 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:27:35.830138 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:27:35.830138 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:27:35.830138 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:27:35.830138 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:27:35.830138 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:27:35.830138 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 238b044c-ec15-4c03-88da-d90f9b1ec116 could not be found. Aug 31 16:27:35.830138 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:27:35.833197 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6f640bb3-d853-410b-bb71-ad22b94d65bd tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Returning 404 to user: Instance 238b044c-ec15-4c03-88da-d90f9b1ec116 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:27:35.834644 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6f640bb3-d853-410b-bb71-ad22b94d65bd tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/238b044c-ec15-4c03-88da-d90f9b1ec116" status: 404 len: 111 microversion: 2.1 time: 0.055121 Aug 31 16:27:35.840671 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2885/5740] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:35 2022] GET /compute/v2.1/servers/238b044c-ec15-4c03-88da-d90f9b1ec116 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:27:35.846722 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5a15eda5-a0fb-4281-a968-0a3a5e66a180 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:35.847984 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5a15eda5-a0fb-4281-a968-0a3a5e66a180 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:35.857485 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5a15eda5-a0fb-4281-a968-0a3a5e66a180 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:35.858352 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5a15eda5-a0fb-4281-a968-0a3a5e66a180 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:35.859012 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5a15eda5-a0fb-4281-a968-0a3a5e66a180 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:35.860012 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5a15eda5-a0fb-4281-a968-0a3a5e66a180 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:35.861227 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5a15eda5-a0fb-4281-a968-0a3a5e66a180 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:35.862090 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5a15eda5-a0fb-4281-a968-0a3a5e66a180 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:36.153544 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-578fe043-c8d7-4ad4-81d2-541ba3907250 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133363b2b12d4730994557ee24f08879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d9ba3589a24faaac930a35742ce834', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:36.181999 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-578fe043-c8d7-4ad4-81d2-541ba3907250 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/3c9c0c43-4e1a-4290-bbf1-60e26aba66ce" status: 200 len: 1558 microversion: 2.1 time: 2.033883 Aug 31 16:27:36.186517 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2856/5741] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:34 2022] GET /compute/v2.1/servers/3c9c0c43-4e1a-4290-bbf1-60e26aba66ce => generated 1558 bytes in 2041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:27:36.195925 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6c015c67-6626-49cb-a5d7-6d2346709972 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:36.211554 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6c015c67-6626-49cb-a5d7-6d2346709972 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: ffc6f828-c8ec-4fd6-b69e-9c0230692009] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:36.239679 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6c015c67-6626-49cb-a5d7-6d2346709972 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:36.240804 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6c015c67-6626-49cb-a5d7-6d2346709972 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:36.241789 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6c015c67-6626-49cb-a5d7-6d2346709972 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:36.244612 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6c015c67-6626-49cb-a5d7-6d2346709972 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:36.247807 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6c015c67-6626-49cb-a5d7-6d2346709972 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:36.252465 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6c015c67-6626-49cb-a5d7-6d2346709972 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:36.368992 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6c015c67-6626-49cb-a5d7-6d2346709972 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: ffc6f828-c8ec-4fd6-b69e-9c0230692009] Going to try to terminate instance {{(pid=122256) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:27:36.579333 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:27:36.672938 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6c015c67-6626-49cb-a5d7-6d2346709972 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "DELETE /compute/v2.1/servers/ffc6f828-c8ec-4fd6-b69e-9c0230692009" status: 204 len: 0 microversion: 2.1 time: 0.479487 Aug 31 16:27:36.677138 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2857/5742] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:27:36 2022] DELETE /compute/v2.1/servers/ffc6f828-c8ec-4fd6-b69e-9c0230692009 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:27:36.698976 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4fa934ce-2c08-4409-b88a-4f7d416c772e tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:36.711773 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4fa934ce-2c08-4409-b88a-4f7d416c772e tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 3c9c0c43-4e1a-4290-bbf1-60e26aba66ce] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:36.725748 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4fa934ce-2c08-4409-b88a-4f7d416c772e tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:36.729067 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4fa934ce-2c08-4409-b88a-4f7d416c772e tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:36.734079 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4fa934ce-2c08-4409-b88a-4f7d416c772e tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:36.735667 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4fa934ce-2c08-4409-b88a-4f7d416c772e tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:36.736660 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4fa934ce-2c08-4409-b88a-4f7d416c772e tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:36.744533 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4fa934ce-2c08-4409-b88a-4f7d416c772e tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:37.134557 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5a15eda5-a0fb-4281-a968-0a3a5e66a180 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:37.178701 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5a15eda5-a0fb-4281-a968-0a3a5e66a180 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1668 microversion: 2.1 time: 1.322736 Aug 31 16:27:37.181823 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2886/5743] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:35 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1668 bytes in 1340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:27:37.200058 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4fa934ce-2c08-4409-b88a-4f7d416c772e tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/3c9c0c43-4e1a-4290-bbf1-60e26aba66ce/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.520765 Aug 31 16:27:37.201228 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2858/5744] 10.222.0.61 () {58 vars in 1275 bytes} [Wed Aug 31 16:27:36 2022] GET /compute/v2.1/servers/3c9c0c43-4e1a-4290-bbf1-60e26aba66ce/os-interface => generated 284 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:27:37.202482 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5423c26d-c102-4979-b4bd-532d46dcd76d tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:37.205112 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5423c26d-c102-4979-b4bd-532d46dcd76d tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: ffc6f828-c8ec-4fd6-b69e-9c0230692009] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:37.229615 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5423c26d-c102-4979-b4bd-532d46dcd76d tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:37.231235 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5423c26d-c102-4979-b4bd-532d46dcd76d tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:37.233620 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5423c26d-c102-4979-b4bd-532d46dcd76d tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:37.235279 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5423c26d-c102-4979-b4bd-532d46dcd76d tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:37.238013 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5423c26d-c102-4979-b4bd-532d46dcd76d tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:37.239586 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5423c26d-c102-4979-b4bd-532d46dcd76d tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:37.243705 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9a94b408-e1b4-4016-a4f5-31ab8939ca9a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:27:37.244842 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9a94b408-e1b4-4016-a4f5-31ab8939ca9a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:37.276293 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9a94b408-e1b4-4016-a4f5-31ab8939ca9a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:37.277248 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9a94b408-e1b4-4016-a4f5-31ab8939ca9a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:37.278007 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9a94b408-e1b4-4016-a4f5-31ab8939ca9a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:37.284013 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9a94b408-e1b4-4016-a4f5-31ab8939ca9a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:37.288338 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9a94b408-e1b4-4016-a4f5-31ab8939ca9a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:37.291734 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9a94b408-e1b4-4016-a4f5-31ab8939ca9a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:37.368669 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-9a94b408-e1b4-4016-a4f5-31ab8939ca9a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lazy-loading 'flavor' on Instance uuid 42ccbb85-9677-4cb9-879a-dc280cda020c {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:27:37.607133 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9a94b408-e1b4-4016-a4f5-31ab8939ca9a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "POST /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c/action" status: 202 len: 0 microversion: 2.1 time: 0.368548 Aug 31 16:27:37.608394 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2859/5745] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:27:37 2022] POST /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c/action => generated 0 bytes in 371 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:27:37.629492 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d6864981-67fe-4ef1-80e3-b148061a7266 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:37.630429 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d6864981-67fe-4ef1-80e3-b148061a7266 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:37.640032 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d6864981-67fe-4ef1-80e3-b148061a7266 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:37.641303 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d6864981-67fe-4ef1-80e3-b148061a7266 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:37.641945 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d6864981-67fe-4ef1-80e3-b148061a7266 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:37.643157 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d6864981-67fe-4ef1-80e3-b148061a7266 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:37.643350 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d6864981-67fe-4ef1-80e3-b148061a7266 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:37.643831 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d6864981-67fe-4ef1-80e3-b148061a7266 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:37.816079 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5423c26d-c102-4979-b4bd-532d46dcd76d tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4744703b964435bbead751ca884d1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e014d4e4da5e47ff9a1261e7730034ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:37.832935 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5423c26d-c102-4979-b4bd-532d46dcd76d tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/ffc6f828-c8ec-4fd6-b69e-9c0230692009" status: 200 len: 1522 microversion: 2.1 time: 0.649061 Aug 31 16:27:37.833635 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2887/5746] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:37 2022] GET /compute/v2.1/servers/ffc6f828-c8ec-4fd6-b69e-9c0230692009 => generated 1522 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:27:38.498570 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d6864981-67fe-4ef1-80e3-b148061a7266 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:38.522355 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d6864981-67fe-4ef1-80e3-b148061a7266 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1676 microversion: 2.1 time: 0.908756 Aug 31 16:27:38.536182 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2860/5747] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:37 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1676 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:27:38.861348 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-88698746-da73-43b8-8394-392d2c5dfe11 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:38.862576 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-88698746-da73-43b8-8394-392d2c5dfe11 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: ffc6f828-c8ec-4fd6-b69e-9c0230692009] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:38.881113 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-88698746-da73-43b8-8394-392d2c5dfe11 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:38.881867 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-88698746-da73-43b8-8394-392d2c5dfe11 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:38.882683 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-88698746-da73-43b8-8394-392d2c5dfe11 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:38.884549 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-88698746-da73-43b8-8394-392d2c5dfe11 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:38.885330 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-88698746-da73-43b8-8394-392d2c5dfe11 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:38.885974 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-88698746-da73-43b8-8394-392d2c5dfe11 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:39.549224 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-979cadb0-ad78-4540-9e00-bd45439aea7f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:39.550447 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-979cadb0-ad78-4540-9e00-bd45439aea7f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:39.570223 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-979cadb0-ad78-4540-9e00-bd45439aea7f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:39.580193 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-979cadb0-ad78-4540-9e00-bd45439aea7f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:39.580895 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-979cadb0-ad78-4540-9e00-bd45439aea7f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:39.582724 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-979cadb0-ad78-4540-9e00-bd45439aea7f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:39.585475 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-979cadb0-ad78-4540-9e00-bd45439aea7f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:39.586120 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-979cadb0-ad78-4540-9e00-bd45439aea7f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:39.660494 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-88698746-da73-43b8-8394-392d2c5dfe11 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4744703b964435bbead751ca884d1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e014d4e4da5e47ff9a1261e7730034ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:39.687111 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-88698746-da73-43b8-8394-392d2c5dfe11 tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/ffc6f828-c8ec-4fd6-b69e-9c0230692009" status: 200 len: 1522 microversion: 2.1 time: 0.834155 Aug 31 16:27:39.688303 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2888/5748] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:38 2022] GET /compute/v2.1/servers/ffc6f828-c8ec-4fd6-b69e-9c0230692009 => generated 1522 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:27:40.007139 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-f2e1d971-7497-45f8-858f-cdf336ff39a9 req-7bf6eb86-8537-44ee-921d-d839f5650558 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffc6f828-c8ec-4fd6-b69e-9c0230692009", "name": "network-vif-deleted", "tag": "1f21436d-5375-4ec2-b60e-3ee54c0e8a00"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:27:40.074969 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-f2e1d971-7497-45f8-858f-cdf336ff39a9 req-7bf6eb86-8537-44ee-921d-d839f5650558 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:40.074969 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-f2e1d971-7497-45f8-858f-cdf336ff39a9 req-7bf6eb86-8537-44ee-921d-d839f5650558 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:40.075309 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-f2e1d971-7497-45f8-858f-cdf336ff39a9 req-7bf6eb86-8537-44ee-921d-d839f5650558 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:40.176611 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-f2e1d971-7497-45f8-858f-cdf336ff39a9 req-7bf6eb86-8537-44ee-921d-d839f5650558 service nova] Creating event network-vif-deleted:1f21436d-5375-4ec2-b60e-3ee54c0e8a00 for instance ffc6f828-c8ec-4fd6-b69e-9c0230692009 on n-h2-850499-9 Aug 31 16:27:40.220334 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-f2e1d971-7497-45f8-858f-cdf336ff39a9 req-7bf6eb86-8537-44ee-921d-d839f5650558 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.215927 Aug 31 16:27:40.224252 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2889/5749] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:27:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:27:40.379926 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-1351d99b-8205-4ca2-a169-5621df7882d1 req-b36383f1-57d8-435f-85fc-aaf5b3019549 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c9c0c43-4e1a-4290-bbf1-60e26aba66ce", "tag": "aef76fa3-a9f8-4e2a-ba1d-2d8dd5a9374a"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:27:40.430274 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-1351d99b-8205-4ca2-a169-5621df7882d1 req-b36383f1-57d8-435f-85fc-aaf5b3019549 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:40.431731 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-1351d99b-8205-4ca2-a169-5621df7882d1 req-b36383f1-57d8-435f-85fc-aaf5b3019549 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:40.432330 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-1351d99b-8205-4ca2-a169-5621df7882d1 req-b36383f1-57d8-435f-85fc-aaf5b3019549 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:40.511628 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-1351d99b-8205-4ca2-a169-5621df7882d1 req-b36383f1-57d8-435f-85fc-aaf5b3019549 service nova] Creating event network-changed:aef76fa3-a9f8-4e2a-ba1d-2d8dd5a9374a for instance 3c9c0c43-4e1a-4290-bbf1-60e26aba66ce on n-h2-850499-9 Aug 31 16:27:40.540221 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-979cadb0-ad78-4540-9e00-bd45439aea7f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:40.544387 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-1351d99b-8205-4ca2-a169-5621df7882d1 req-b36383f1-57d8-435f-85fc-aaf5b3019549 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.165708 Aug 31 16:27:40.547114 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2890/5750] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:27:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:27:40.554337 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-979cadb0-ad78-4540-9e00-bd45439aea7f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1659 microversion: 2.1 time: 1.007113 Aug 31 16:27:40.556629 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2861/5751] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:39 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1659 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:27:40.599699 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-59b45fdd-10d1-45dd-9503-146137aa73a9 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:27:40.600600 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-59b45fdd-10d1-45dd-9503-146137aa73a9 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:40.608639 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-59b45fdd-10d1-45dd-9503-146137aa73a9 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:40.609585 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-59b45fdd-10d1-45dd-9503-146137aa73a9 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:40.610245 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-59b45fdd-10d1-45dd-9503-146137aa73a9 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:40.611214 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-59b45fdd-10d1-45dd-9503-146137aa73a9 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:40.611918 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-59b45fdd-10d1-45dd-9503-146137aa73a9 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:40.612554 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-59b45fdd-10d1-45dd-9503-146137aa73a9 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:40.740348 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-625aeee1-675c-457f-b28a-ddf8d669f86a tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:40.744728 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-625aeee1-675c-457f-b28a-ddf8d669f86a tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: ffc6f828-c8ec-4fd6-b69e-9c0230692009] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:40.760398 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-59b45fdd-10d1-45dd-9503-146137aa73a9 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "POST /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c/action" status: 202 len: 0 microversion: 2.1 time: 0.167616 Aug 31 16:27:40.765961 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2862/5752] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:27:40 2022] POST /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c/action => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:27:40.769495 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-625aeee1-675c-457f-b28a-ddf8d669f86a tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:40.771414 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-625aeee1-675c-457f-b28a-ddf8d669f86a tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:40.773027 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-625aeee1-675c-457f-b28a-ddf8d669f86a tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:40.774115 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4ba9ec93-a906-450c-a2df-40ea02071a4d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:40.777364 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-625aeee1-675c-457f-b28a-ddf8d669f86a tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:40.778881 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4ba9ec93-a906-450c-a2df-40ea02071a4d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:40.779636 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-625aeee1-675c-457f-b28a-ddf8d669f86a tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:40.781595 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-625aeee1-675c-457f-b28a-ddf8d669f86a tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:40.796059 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4ba9ec93-a906-450c-a2df-40ea02071a4d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:40.796898 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4ba9ec93-a906-450c-a2df-40ea02071a4d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:40.797376 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4ba9ec93-a906-450c-a2df-40ea02071a4d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:40.798120 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4ba9ec93-a906-450c-a2df-40ea02071a4d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:40.798586 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4ba9ec93-a906-450c-a2df-40ea02071a4d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:40.799011 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4ba9ec93-a906-450c-a2df-40ea02071a4d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:40.853314 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:27:40.968853 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-625aeee1-675c-457f-b28a-ddf8d669f86a tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:40.970016 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-625aeee1-675c-457f-b28a-ddf8d669f86a tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:40.978492 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-625aeee1-675c-457f-b28a-ddf8d669f86a tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:40.980615 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-625aeee1-675c-457f-b28a-ddf8d669f86a tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lazy-loading 'fault' on Instance uuid ffc6f828-c8ec-4fd6-b69e-9c0230692009 {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:27:41.479601 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-625aeee1-675c-457f-b28a-ddf8d669f86a tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4744703b964435bbead751ca884d1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e014d4e4da5e47ff9a1261e7730034ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:41.508227 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-625aeee1-675c-457f-b28a-ddf8d669f86a tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/ffc6f828-c8ec-4fd6-b69e-9c0230692009" status: 200 len: 1311 microversion: 2.1 time: 0.783878 Aug 31 16:27:41.528104 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2891/5753] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:40 2022] GET /compute/v2.1/servers/ffc6f828-c8ec-4fd6-b69e-9c0230692009 => generated 1311 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:27:41.927052 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-4ba9ec93-a906-450c-a2df-40ea02071a4d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:41.956243 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4ba9ec93-a906-450c-a2df-40ea02071a4d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1665 microversion: 2.1 time: 1.183740 Aug 31 16:27:41.956243 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2863/5754] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:40 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1665 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:27:42.545571 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-39fc0a90-c8d9-4e69-aa37-06a231b2e81c tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:42.546797 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-39fc0a90-c8d9-4e69-aa37-06a231b2e81c tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] [instance: ffc6f828-c8ec-4fd6-b69e-9c0230692009] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:42.562490 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-39fc0a90-c8d9-4e69-aa37-06a231b2e81c tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:42.563217 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-39fc0a90-c8d9-4e69-aa37-06a231b2e81c tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:42.563852 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-39fc0a90-c8d9-4e69-aa37-06a231b2e81c tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:42.564771 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-39fc0a90-c8d9-4e69-aa37-06a231b2e81c tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:42.569660 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-39fc0a90-c8d9-4e69-aa37-06a231b2e81c tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:42.570445 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-39fc0a90-c8d9-4e69-aa37-06a231b2e81c tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:42.604291 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-39fc0a90-c8d9-4e69-aa37-06a231b2e81c tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] HTTP exception thrown: Instance ffc6f828-c8ec-4fd6-b69e-9c0230692009 could not be found. Aug 31 16:27:42.609172 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-39fc0a90-c8d9-4e69-aa37-06a231b2e81c tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Request method failure captured: Aug 31 16:27:42.609172 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/ffc6f828-c8ec-4fd6-b69e-9c0230692009 HTTP/1.1 Aug 31 16:27:42.609172 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:27:42.609172 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:27:42.609172 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:27:42.609172 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:27:42.609172 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:27:42.609172 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:27:42.609172 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:27:42.609172 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:27:42.609172 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4oy7qo0hac0I9IpX9ONeLQn5FXZxTJLjhjMB-WYHPcUUf61xQVdU4TOXEJINvaGC5c5Wjhk9pb4p_bnOvsu8HLsM1WUDttS1HJeEirzVfdDQ2PqvMBOo0UbRSxhckjuHlfQOCH8lv8yi1i-W11nad5j2vdw9RWWfX0Cd51S12MLuko Aug 31 16:27:42.609172 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:27:42.609172 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:27:42.609172 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:27:42.609172 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:27:42.609172 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:27:42.609172 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:27:42.609172 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: e014d4e4da5e47ff9a1261e7730034ac Aug 31 16:27:42.609172 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1963116327 Aug 31 16:27:42.609172 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:27:42.609172 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:27:42.609172 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e014d4e4da5e47ff9a1261e7730034ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/e014d4e4da5e47ff9a1261e7730034ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_e014d4e4da5e47ff9a1261e7730034ac", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e014d4e4da5e47ff9a1261e7730034ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:27:42.609172 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1963116327 Aug 31 16:27:42.609172 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: e014d4e4da5e47ff9a1261e7730034ac Aug 31 16:27:42.609172 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1963116327 Aug 31 16:27:42.609172 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ServerRescueNegativeTestJSON-1963116327-project Aug 31 16:27:42.609172 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:27:42.609172 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:27:42.609172 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: e4744703b964435bbead751ca884d1ae Aug 31 16:27:42.609172 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1963116327-project Aug 31 16:27:42.609172 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:27:42.609172 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance ffc6f828-c8ec-4fd6-b69e-9c0230692009 could not be found. Aug 31 16:27:42.609172 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': 'ffc6f828-c8ec-4fd6-b69e-9c0230692009'} Aug 31 16:27:42.609172 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:27:42.609172 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:27:42.609172 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:27:42.609172 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:27:42.609172 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:27:42.609172 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:27:42.609172 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:27:42.609172 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:27:42.609172 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:27:42.609172 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:27:42.609172 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffc6f828-c8ec-4fd6-b69e-9c0230692009 could not be found. Aug 31 16:27:42.609172 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:27:42.609172 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:27:42.609172 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:27:42.609172 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:27:42.609172 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:27:42.609172 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:27:42.609172 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:27:42.609172 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:27:42.609172 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:27:42.609172 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:27:42.609172 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:27:42.609172 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:27:42.609172 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:27:42.609172 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:27:42.609172 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:27:42.609172 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:27:42.609172 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffc6f828-c8ec-4fd6-b69e-9c0230692009 could not be found. Aug 31 16:27:42.609172 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:27:42.609172 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:27:42.612972 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:27:42.612972 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:27:42.612972 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:27:42.612972 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:27:42.612972 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:27:42.612972 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:27:42.612972 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffc6f828-c8ec-4fd6-b69e-9c0230692009 could not be found. Aug 31 16:27:42.612972 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:27:42.617205 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-39fc0a90-c8d9-4e69-aa37-06a231b2e81c tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] Returning 404 to user: Instance ffc6f828-c8ec-4fd6-b69e-9c0230692009 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:27:42.625292 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-39fc0a90-c8d9-4e69-aa37-06a231b2e81c tempest-ServerRescueNegativeTestJSON-1963116327 tempest-ServerRescueNegativeTestJSON-1963116327-project] 10.222.0.61 "GET /compute/v2.1/servers/ffc6f828-c8ec-4fd6-b69e-9c0230692009" status: 404 len: 111 microversion: 2.1 time: 0.083442 Aug 31 16:27:42.631390 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2892/5755] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:42 2022] GET /compute/v2.1/servers/ffc6f828-c8ec-4fd6-b69e-9c0230692009 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 16:27:42.990175 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a3ddeb5f-2c31-4125-a6fe-4e8dc101d365 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:42.991177 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a3ddeb5f-2c31-4125-a6fe-4e8dc101d365 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:43.074697 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a3ddeb5f-2c31-4125-a6fe-4e8dc101d365 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:43.075641 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a3ddeb5f-2c31-4125-a6fe-4e8dc101d365 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:43.086916 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a3ddeb5f-2c31-4125-a6fe-4e8dc101d365 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:43.095322 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a3ddeb5f-2c31-4125-a6fe-4e8dc101d365 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:43.096252 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a3ddeb5f-2c31-4125-a6fe-4e8dc101d365 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:43.104759 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a3ddeb5f-2c31-4125-a6fe-4e8dc101d365 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:44.432030 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a3ddeb5f-2c31-4125-a6fe-4e8dc101d365 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:44.446267 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a3ddeb5f-2c31-4125-a6fe-4e8dc101d365 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1665 microversion: 2.1 time: 1.447885 Aug 31 16:27:44.457922 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2864/5756] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:42 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1665 bytes in 1476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:27:45.497820 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a4c7bda4-a6f2-49f0-a282-8719097c88e0 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:45.501985 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a4c7bda4-a6f2-49f0-a282-8719097c88e0 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:45.515595 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a4c7bda4-a6f2-49f0-a282-8719097c88e0 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:45.516407 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a4c7bda4-a6f2-49f0-a282-8719097c88e0 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:45.518335 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a4c7bda4-a6f2-49f0-a282-8719097c88e0 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:45.522525 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a4c7bda4-a6f2-49f0-a282-8719097c88e0 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:45.525608 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a4c7bda4-a6f2-49f0-a282-8719097c88e0 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:45.526439 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a4c7bda4-a6f2-49f0-a282-8719097c88e0 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:46.038879 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a4c7bda4-a6f2-49f0-a282-8719097c88e0 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:46.066007 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a4c7bda4-a6f2-49f0-a282-8719097c88e0 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1665 microversion: 2.1 time: 0.573988 Aug 31 16:27:46.068178 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2893/5757] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:45 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1665 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:27:47.106113 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6d8dac1c-16b2-4a5d-8d95-fae27a855382 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:47.107344 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6d8dac1c-16b2-4a5d-8d95-fae27a855382 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:47.125068 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6d8dac1c-16b2-4a5d-8d95-fae27a855382 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:47.144077 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6d8dac1c-16b2-4a5d-8d95-fae27a855382 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:47.152301 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6d8dac1c-16b2-4a5d-8d95-fae27a855382 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:47.153308 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6d8dac1c-16b2-4a5d-8d95-fae27a855382 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:47.153988 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6d8dac1c-16b2-4a5d-8d95-fae27a855382 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:47.154431 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6d8dac1c-16b2-4a5d-8d95-fae27a855382 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:47.658246 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-6d8dac1c-16b2-4a5d-8d95-fae27a855382 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:47.667923 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6d8dac1c-16b2-4a5d-8d95-fae27a855382 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1668 microversion: 2.1 time: 0.580224 Aug 31 16:27:47.682513 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2865/5758] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:47 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1668 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:27:47.695691 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4d9b8523-4a26-4fd5-8182-ef56af54ec93 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:47.705600 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4d9b8523-4a26-4fd5-8182-ef56af54ec93 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:47.716096 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4d9b8523-4a26-4fd5-8182-ef56af54ec93 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:47.717183 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4d9b8523-4a26-4fd5-8182-ef56af54ec93 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:47.718061 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4d9b8523-4a26-4fd5-8182-ef56af54ec93 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:47.719562 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4d9b8523-4a26-4fd5-8182-ef56af54ec93 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:47.720973 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4d9b8523-4a26-4fd5-8182-ef56af54ec93 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:47.722004 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4d9b8523-4a26-4fd5-8182-ef56af54ec93 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:48.321680 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-4d9b8523-4a26-4fd5-8182-ef56af54ec93 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:48.331200 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4d9b8523-4a26-4fd5-8182-ef56af54ec93 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1668 microversion: 2.1 time: 0.643064 Aug 31 16:27:48.332546 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2894/5759] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:47 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1668 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:27:48.363066 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5dc08477-e10b-4425-a6ab-9cc97ecf3252 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:48.366061 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5dc08477-e10b-4425-a6ab-9cc97ecf3252 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 92076abd-df0a-4c10-bbfd-e8c304633298] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:48.403256 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5dc08477-e10b-4425-a6ab-9cc97ecf3252 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:48.408392 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5dc08477-e10b-4425-a6ab-9cc97ecf3252 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:48.413957 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5dc08477-e10b-4425-a6ab-9cc97ecf3252 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:48.416214 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5dc08477-e10b-4425-a6ab-9cc97ecf3252 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:48.417696 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5dc08477-e10b-4425-a6ab-9cc97ecf3252 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:48.418840 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5dc08477-e10b-4425-a6ab-9cc97ecf3252 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:48.502562 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5dc08477-e10b-4425-a6ab-9cc97ecf3252 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 92076abd-df0a-4c10-bbfd-e8c304633298] Going to try to terminate instance {{(pid=122256) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:27:48.523473 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.compute.api [None req-5dc08477-e10b-4425-a6ab-9cc97ecf3252 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 92076abd-df0a-4c10-bbfd-e8c304633298] Working on deleting snapshot 82333412-36c5-425b-afbc-15ae9eb3b1a2 from shelved instance... Aug 31 16:27:50.702030 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5dc08477-e10b-4425-a6ab-9cc97ecf3252 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 92076abd-df0a-4c10-bbfd-e8c304633298] Doing local delete in cell 9f6d6683-96bf-42a7-a78d-78a22f1453ed(cell1) {{(pid=122256) _delete /opt/stack/nova/nova/compute/api.py:2546}} Aug 31 16:27:50.704803 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5dc08477-e10b-4425-a6ab-9cc97ecf3252 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:50.705673 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5dc08477-e10b-4425-a6ab-9cc97ecf3252 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:50.706421 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5dc08477-e10b-4425-a6ab-9cc97ecf3252 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:50.707265 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.compute.api [None req-5dc08477-e10b-4425-a6ab-9cc97ecf3252 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 92076abd-df0a-4c10-bbfd-e8c304633298] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Aug 31 16:27:50.714497 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-5dc08477-e10b-4425-a6ab-9cc97ecf3252 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 92076abd-df0a-4c10-bbfd-e8c304633298] deallocate_for_instance() {{(pid=122256) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Aug 31 16:27:52.290429 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4d9b8523-4a26-4fd5-8182-ef56af54ec93 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:52.296698 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4d9b8523-4a26-4fd5-8182-ef56af54ec93 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute//" status: 200 len: 377 microversion: - time: 0.007001 Aug 31 16:27:52.299427 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2895/5760] 10.222.0.61 () {56 vars in 886 bytes} [Wed Aug 31 16:27:52 2022] GET /compute/ => generated 377 bytes in 11 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 31 16:27:52.655471 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-5dc08477-e10b-4425-a6ab-9cc97ecf3252 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 92076abd-df0a-4c10-bbfd-e8c304633298] Updating instance_info_cache with network_info: [] {{(pid=122256) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 31 16:27:52.761879 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-4cd6772b-64c2-404d-9836-9c3e54c03552 req-3c443050-e0ba-4dcb-8e57-c55558295779 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92076abd-df0a-4c10-bbfd-e8c304633298", "name": "network-vif-deleted", "tag": "1061a3fb-3b1b-4a6b-a7ca-c607c5cd782f"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:27:52.786464 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:27:52.810681 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-4cd6772b-64c2-404d-9836-9c3e54c03552 req-3c443050-e0ba-4dcb-8e57-c55558295779 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:52.811693 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-4cd6772b-64c2-404d-9836-9c3e54c03552 req-3c443050-e0ba-4dcb-8e57-c55558295779 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:52.812721 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-4cd6772b-64c2-404d-9836-9c3e54c03552 req-3c443050-e0ba-4dcb-8e57-c55558295779 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:52.859655 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.compute.server_external_events [req-4cd6772b-64c2-404d-9836-9c3e54c03552 req-3c443050-e0ba-4dcb-8e57-c55558295779 service nova] Unable to find a host for instance 92076abd-df0a-4c10-bbfd-e8c304633298. Dropping event network-vif-deleted {{(pid=122257) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 31 16:27:52.861387 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-4cd6772b-64c2-404d-9836-9c3e54c03552 req-3c443050-e0ba-4dcb-8e57-c55558295779 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.105271 Aug 31 16:27:52.865171 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2896/5761] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:27:52 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 110 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 31 16:27:53.828122 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=81,nova_cell1:UPDATE=14,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:27:53.870983 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5dc08477-e10b-4425-a6ab-9cc97ecf3252 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "DELETE /compute/v2.1/servers/92076abd-df0a-4c10-bbfd-e8c304633298" status: 204 len: 0 microversion: 2.1 time: 5.516427 Aug 31 16:27:53.871921 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2866/5762] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:27:48 2022] DELETE /compute/v2.1/servers/92076abd-df0a-4c10-bbfd-e8c304633298 => generated 0 bytes in 5518 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:27:53.884801 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a480bf48-6c06-4345-b6ea-60acb253317f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:53.885750 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a480bf48-6c06-4345-b6ea-60acb253317f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 92076abd-df0a-4c10-bbfd-e8c304633298] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:53.908457 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a480bf48-6c06-4345-b6ea-60acb253317f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:53.908966 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a480bf48-6c06-4345-b6ea-60acb253317f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:53.909422 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a480bf48-6c06-4345-b6ea-60acb253317f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:53.912498 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a480bf48-6c06-4345-b6ea-60acb253317f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:53.913337 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a480bf48-6c06-4345-b6ea-60acb253317f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:53.913940 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a480bf48-6c06-4345-b6ea-60acb253317f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:53.955377 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-a480bf48-6c06-4345-b6ea-60acb253317f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] HTTP exception thrown: Instance 92076abd-df0a-4c10-bbfd-e8c304633298 could not be found. Aug 31 16:27:53.962620 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a480bf48-6c06-4345-b6ea-60acb253317f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Request method failure captured: Aug 31 16:27:53.962620 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/92076abd-df0a-4c10-bbfd-e8c304633298 HTTP/1.1 Aug 31 16:27:53.962620 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:27:53.962620 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:27:53.962620 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:27:53.962620 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:27:53.962620 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:27:53.962620 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:27:53.962620 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:27:53.962620 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:27:53.962620 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4j4GoXu7a8XS8mokW4AeC842NZnj-uoRrLPe-ymerVUxYrezcAXYukQXkT8IqkMd2mshHtGlo5ORTm-xBrHOK9WFT9PPtSJjPDhKzFxYnOsxBAuHO1I5hUh0kdjx0f_1YsWDM7F8Lwt5dwXM7gNYQ4IaAaTeuNJuCJE3SFroPGrfPQ Aug 31 16:27:53.962620 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:27:53.962620 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:27:53.962620 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:27:53.962620 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:27:53.962620 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:27:53.962620 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:27:53.962620 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: f8fa87d9431f4253b8425593a2150359 Aug 31 16:27:53.962620 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ServerActionsTestJSON-1302460756 Aug 31 16:27:53.962620 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:27:53.962620 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:27:53.962620 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f8fa87d9431f4253b8425593a2150359"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f8fa87d9431f4253b8425593a2150359"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f8fa87d9431f4253b8425593a2150359", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f8fa87d9431f4253b8425593a2150359"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:27:53.962620 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ServerActionsTestJSON-1302460756 Aug 31 16:27:53.962620 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: f8fa87d9431f4253b8425593a2150359 Aug 31 16:27:53.962620 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ServerActionsTestJSON-1302460756 Aug 31 16:27:53.962620 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ServerActionsTestJSON-1302460756-project Aug 31 16:27:53.962620 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:27:53.962620 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:27:53.962620 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: a105ab564f304fa7a2ceba07418a22bc Aug 31 16:27:53.962620 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ServerActionsTestJSON-1302460756-project Aug 31 16:27:53.962620 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:27:53.962620 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance 92076abd-df0a-4c10-bbfd-e8c304633298 could not be found. Aug 31 16:27:53.962620 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '92076abd-df0a-4c10-bbfd-e8c304633298'} Aug 31 16:27:53.962620 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:27:53.962620 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:27:53.962620 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:27:53.962620 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:27:53.962620 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:27:53.962620 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:27:53.962620 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:27:53.962620 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:27:53.962620 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:27:53.962620 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:27:53.962620 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92076abd-df0a-4c10-bbfd-e8c304633298 could not be found. Aug 31 16:27:53.962620 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:27:53.962620 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:27:53.962620 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:27:53.962620 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:27:53.962620 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:27:53.962620 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:27:53.962620 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:27:53.962620 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:27:53.962620 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:27:53.962620 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:27:53.962620 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:27:53.962620 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:27:53.962620 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:27:53.962620 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:27:53.962620 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:27:53.962620 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:27:53.962620 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92076abd-df0a-4c10-bbfd-e8c304633298 could not be found. Aug 31 16:27:53.962620 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:27:53.962620 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:27:53.962620 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:27:53.968602 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:27:53.968602 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:27:53.968602 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:27:53.968602 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:27:53.968602 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:27:53.968602 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92076abd-df0a-4c10-bbfd-e8c304633298 could not be found. Aug 31 16:27:53.968602 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:27:53.971486 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a480bf48-6c06-4345-b6ea-60acb253317f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Returning 404 to user: Instance 92076abd-df0a-4c10-bbfd-e8c304633298 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:27:53.972692 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a480bf48-6c06-4345-b6ea-60acb253317f tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/92076abd-df0a-4c10-bbfd-e8c304633298" status: 404 len: 111 microversion: 2.1 time: 0.095334 Aug 31 16:27:53.975154 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2897/5763] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:53 2022] GET /compute/v2.1/servers/92076abd-df0a-4c10-bbfd-e8c304633298 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:27:53.984141 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-39524b6e-a2ae-4906-88f5-4d897b6c3d5b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:53.984945 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-39524b6e-a2ae-4906-88f5-4d897b6c3d5b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 90d3311f-d4dc-4100-924a-963372dfcc88] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:53.993637 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-39524b6e-a2ae-4906-88f5-4d897b6c3d5b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:53.994515 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-39524b6e-a2ae-4906-88f5-4d897b6c3d5b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:53.995170 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-39524b6e-a2ae-4906-88f5-4d897b6c3d5b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:53.996162 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-39524b6e-a2ae-4906-88f5-4d897b6c3d5b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:53.997001 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-39524b6e-a2ae-4906-88f5-4d897b6c3d5b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:53.997713 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-39524b6e-a2ae-4906-88f5-4d897b6c3d5b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:54.041651 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-39524b6e-a2ae-4906-88f5-4d897b6c3d5b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 90d3311f-d4dc-4100-924a-963372dfcc88] Going to try to terminate instance {{(pid=122256) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:27:54.206587 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-39524b6e-a2ae-4906-88f5-4d897b6c3d5b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "DELETE /compute/v2.1/servers/90d3311f-d4dc-4100-924a-963372dfcc88" status: 204 len: 0 microversion: 2.1 time: 0.226912 Aug 31 16:27:54.208591 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2867/5764] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:27:53 2022] DELETE /compute/v2.1/servers/90d3311f-d4dc-4100-924a-963372dfcc88 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 16:27:54.218711 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5a37c8fb-02f5-4753-bc2c-f67096adf08b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:54.220278 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5a37c8fb-02f5-4753-bc2c-f67096adf08b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 90d3311f-d4dc-4100-924a-963372dfcc88] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:54.228953 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5a37c8fb-02f5-4753-bc2c-f67096adf08b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:54.229472 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5a37c8fb-02f5-4753-bc2c-f67096adf08b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:54.229926 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5a37c8fb-02f5-4753-bc2c-f67096adf08b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:54.230697 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5a37c8fb-02f5-4753-bc2c-f67096adf08b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:54.231155 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5a37c8fb-02f5-4753-bc2c-f67096adf08b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:54.231789 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5a37c8fb-02f5-4753-bc2c-f67096adf08b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:54.357284 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5a37c8fb-02f5-4753-bc2c-f67096adf08b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:54.365746 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5a37c8fb-02f5-4753-bc2c-f67096adf08b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/90d3311f-d4dc-4100-924a-963372dfcc88" status: 200 len: 1464 microversion: 2.1 time: 0.151449 Aug 31 16:27:54.367626 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2898/5765] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:54 2022] GET /compute/v2.1/servers/90d3311f-d4dc-4100-924a-963372dfcc88 => generated 1464 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:27:55.391892 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-453e576a-166e-4e89-b653-aec420106784 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:55.393247 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-453e576a-166e-4e89-b653-aec420106784 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 90d3311f-d4dc-4100-924a-963372dfcc88] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:55.405447 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-453e576a-166e-4e89-b653-aec420106784 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:55.407196 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-453e576a-166e-4e89-b653-aec420106784 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:55.408146 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-453e576a-166e-4e89-b653-aec420106784 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:55.412474 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-453e576a-166e-4e89-b653-aec420106784 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:55.415878 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-453e576a-166e-4e89-b653-aec420106784 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:55.416541 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-453e576a-166e-4e89-b653-aec420106784 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:55.559320 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-453e576a-166e-4e89-b653-aec420106784 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:55.571395 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-453e576a-166e-4e89-b653-aec420106784 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/90d3311f-d4dc-4100-924a-963372dfcc88" status: 200 len: 1464 microversion: 2.1 time: 0.183988 Aug 31 16:27:55.574406 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2868/5766] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:55 2022] GET /compute/v2.1/servers/90d3311f-d4dc-4100-924a-963372dfcc88 => generated 1464 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:27:56.597604 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4f573eea-09e7-4779-a60a-608ba207e73b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:56.598269 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4f573eea-09e7-4779-a60a-608ba207e73b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 90d3311f-d4dc-4100-924a-963372dfcc88] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:56.606952 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4f573eea-09e7-4779-a60a-608ba207e73b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:56.607955 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4f573eea-09e7-4779-a60a-608ba207e73b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:56.608646 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4f573eea-09e7-4779-a60a-608ba207e73b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:56.609580 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4f573eea-09e7-4779-a60a-608ba207e73b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:56.610256 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4f573eea-09e7-4779-a60a-608ba207e73b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:56.611380 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4f573eea-09e7-4779-a60a-608ba207e73b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:56.734629 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-4f573eea-09e7-4779-a60a-608ba207e73b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:56.743884 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4f573eea-09e7-4779-a60a-608ba207e73b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/90d3311f-d4dc-4100-924a-963372dfcc88" status: 200 len: 1464 microversion: 2.1 time: 0.150366 Aug 31 16:27:56.746832 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2869/5767] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:56 2022] GET /compute/v2.1/servers/90d3311f-d4dc-4100-924a-963372dfcc88 => generated 1464 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:27:56.892516 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-befd42c1-f065-4488-b9da-35a473aabe5a tempest-VolumesNegativeTest-1734736166 tempest-VolumesNegativeTest-1734736166-project] Action: 'create', calling method: .version_select at 0x7f5aed1c2b80>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1155542136", "metadata": {"Type": "work"}}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:27:56.897279 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-befd42c1-f065-4488-b9da-35a473aabe5a tempest-VolumesNegativeTest-1734736166 tempest-VolumesNegativeTest-1734736166-project] Request method failure captured: Aug 31 16:27:56.897279 n-d-850499-9 devstack@n-api.service[122257]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 31 16:27:56.897279 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:27:56.897279 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:27:56.897279 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:27:56.897279 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 122 Aug 31 16:27:56.897279 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:27:56.897279 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:27:56.897279 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:27:56.897279 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:27:56.897279 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4wM_aY3nEn6izLGt90StdNv_07ZNHbNVLv9m4XDM-bU9PtF8EROAPrv7Sx1lDEM8Lc7YePXA48Cz-vz1ckYBSP1pPiOMI2rPfJisHw1hDvuO6_Lexijejx7160qZMKv0tFdORz44MjAk010s-4FO05DhmZuZE224OEcO3sM4RzICrg Aug 31 16:27:56.897279 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:27:56.897279 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:27:56.897279 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:27:56.897279 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:27:56.897279 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:27:56.897279 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:27:56.897279 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: b279ec001a154efb8553c18fcd5163fe Aug 31 16:27:56.897279 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-VolumesNegativeTest-1734736166 Aug 31 16:27:56.897279 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:27:56.897279 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:27:56.897279 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b279ec001a154efb8553c18fcd5163fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/b279ec001a154efb8553c18fcd5163fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_b279ec001a154efb8553c18fcd5163fe", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b279ec001a154efb8553c18fcd5163fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:27:56.897279 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-VolumesNegativeTest-1734736166 Aug 31 16:27:56.897279 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: b279ec001a154efb8553c18fcd5163fe Aug 31 16:27:56.897279 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-VolumesNegativeTest-1734736166 Aug 31 16:27:56.897279 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-VolumesNegativeTest-1734736166-project Aug 31 16:27:56.897279 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:27:56.897279 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:27:56.897279 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: b4d26403ee5a4fea86cba40d9cdd612d Aug 31 16:27:56.897279 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-VolumesNegativeTest-1734736166-project Aug 31 16:27:56.897279 n-d-850499-9 devstack@n-api.service[122257]: Aug 31 16:27:56.897279 n-d-850499-9 devstack@n-api.service[122257]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1155542136", "metadata": {"Type": "work"}}} Aug 31 16:27:56.897279 n-d-850499-9 devstack@n-api.service[122257]: method: Aug 31 16:27:56.897279 n-d-850499-9 devstack@n-api.service[122257]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 31 16:27:56.897279 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1155542136', 'metadata': {'Type': 'work'}}}} Aug 31 16:27:56.897279 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:27:56.897279 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:27:56.897279 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 16:27:56.897279 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 16:27:56.897279 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 16:27:56.897279 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise error Aug 31 16:27:56.897279 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 31 16:27:56.897279 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:27:56.897279 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 31 16:27:56.897279 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 31 16:27:56.897279 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:27:56.897279 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 31 16:27:56.897279 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi '#$%' Aug 31 16:27:56.897279 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:27:56.897279 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:27:56.897279 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:27:56.897279 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:27:56.897279 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:27:56.897279 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:27:56.897279 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:27:56.897279 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:27:56.897279 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:27:56.897279 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:27:56.897279 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:27:56.897279 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:27:56.897279 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 16:27:56.897279 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 16:27:56.897279 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 16:27:56.897279 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 16:27:56.897279 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 16:27:56.897279 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 16:27:56.901382 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 31 16:27:56.901382 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:27:56.901382 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:27:56.901382 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:27:56.901382 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:27:56.901382 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:27:56.901382 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:27:56.901382 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 16:27:56.901382 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 16:27:56.901382 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 31 16:27:56.901382 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:27:56.912797 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-befd42c1-f065-4488-b9da-35a473aabe5a tempest-VolumesNegativeTest-1734736166 tempest-VolumesNegativeTest-1734736166-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:27:56.913935 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-befd42c1-f065-4488-b9da-35a473aabe5a tempest-VolumesNegativeTest-1734736166 tempest-VolumesNegativeTest-1734736166-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.463480 Aug 31 16:27:56.915351 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2899/5768] 10.222.0.61 () {60 vars in 1156 bytes} [Wed Aug 31 16:27:56 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 466 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:27:56.925926 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-dc82e637-58db-4570-b9ef-eedd1a58e8d8 tempest-VolumesNegativeTest-1734736166 tempest-VolumesNegativeTest-1734736166-project] Action: 'create', calling method: .version_select at 0x7f5ae9751ee0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1309524535", "metadata": {"Type": "work"}}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:27:56.931606 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-dc82e637-58db-4570-b9ef-eedd1a58e8d8 tempest-VolumesNegativeTest-1734736166 tempest-VolumesNegativeTest-1734736166-project] Request method failure captured: Aug 31 16:27:56.931606 n-d-850499-9 devstack@n-api.service[122256]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 31 16:27:56.931606 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:27:56.931606 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:27:56.931606 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:27:56.931606 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 120 Aug 31 16:27:56.931606 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:27:56.931606 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:27:56.931606 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:27:56.931606 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:27:56.931606 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4wM_aY3nEn6izLGt90StdNv_07ZNHbNVLv9m4XDM-bU9PtF8EROAPrv7Sx1lDEM8Lc7YePXA48Cz-vz1ckYBSP1pPiOMI2rPfJisHw1hDvuO6_Lexijejx7160qZMKv0tFdORz44MjAk010s-4FO05DhmZuZE224OEcO3sM4RzICrg Aug 31 16:27:56.931606 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:27:56.931606 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:27:56.931606 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:27:56.931606 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:27:56.931606 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:27:56.931606 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:27:56.931606 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: b279ec001a154efb8553c18fcd5163fe Aug 31 16:27:56.931606 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-VolumesNegativeTest-1734736166 Aug 31 16:27:56.931606 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:27:56.931606 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:27:56.931606 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b279ec001a154efb8553c18fcd5163fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/b279ec001a154efb8553c18fcd5163fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_b279ec001a154efb8553c18fcd5163fe", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b279ec001a154efb8553c18fcd5163fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:27:56.931606 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-VolumesNegativeTest-1734736166 Aug 31 16:27:56.931606 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: b279ec001a154efb8553c18fcd5163fe Aug 31 16:27:56.931606 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-VolumesNegativeTest-1734736166 Aug 31 16:27:56.931606 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-VolumesNegativeTest-1734736166-project Aug 31 16:27:56.931606 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:27:56.931606 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:27:56.931606 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: b4d26403ee5a4fea86cba40d9cdd612d Aug 31 16:27:56.931606 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-VolumesNegativeTest-1734736166-project Aug 31 16:27:56.931606 n-d-850499-9 devstack@n-api.service[122256]: Aug 31 16:27:56.931606 n-d-850499-9 devstack@n-api.service[122256]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1309524535", "metadata": {"Type": "work"}}} Aug 31 16:27:56.931606 n-d-850499-9 devstack@n-api.service[122256]: method: Aug 31 16:27:56.931606 n-d-850499-9 devstack@n-api.service[122256]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 31 16:27:56.931606 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1309524535', 'metadata': {'Type': 'work'}}}} Aug 31 16:27:56.931606 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:27:56.931606 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:27:56.931606 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 16:27:56.931606 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 16:27:56.931606 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 16:27:56.931606 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise error Aug 31 16:27:56.931606 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 31 16:27:56.931606 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:27:56.931606 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 31 16:27:56.931606 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 31 16:27:56.931606 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:27:56.931606 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 31 16:27:56.931606 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi '0' Aug 31 16:27:56.931606 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:27:56.931606 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:27:56.931606 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:27:56.931606 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:27:56.931606 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:27:56.931606 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:27:56.931606 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:27:56.931606 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:27:56.931606 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:27:56.931606 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:27:56.931606 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:27:56.931606 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:27:56.931606 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 16:27:56.931606 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 16:27:56.931606 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 16:27:56.931606 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 16:27:56.931606 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 16:27:56.931606 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 16:27:56.935932 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 31 16:27:56.935932 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:27:56.935932 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:27:56.935932 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:27:56.935932 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:27:56.935932 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:27:56.935932 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:27:56.935932 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 16:27:56.935932 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 16:27:56.935932 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 31 16:27:56.935932 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:27:56.938185 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-dc82e637-58db-4570-b9ef-eedd1a58e8d8 tempest-VolumesNegativeTest-1734736166 tempest-VolumesNegativeTest-1734736166-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:27:56.939489 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-dc82e637-58db-4570-b9ef-eedd1a58e8d8 tempest-VolumesNegativeTest-1734736166 tempest-VolumesNegativeTest-1734736166-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.017949 Aug 31 16:27:56.940318 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2870/5769] 10.222.0.61 () {60 vars in 1156 bytes} [Wed Aug 31 16:27:56 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 31 16:27:56.949855 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4d90a440-9213-4534-a396-226eb96f89da tempest-VolumesNegativeTest-1734736166 tempest-VolumesNegativeTest-1734736166-project] Action: 'create', calling method: .version_select at 0x7f5ae8ec50d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1860005095", "metadata": {"Type": "work"}}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:27:56.955429 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4d90a440-9213-4534-a396-226eb96f89da tempest-VolumesNegativeTest-1734736166 tempest-VolumesNegativeTest-1734736166-project] Request method failure captured: Aug 31 16:27:56.955429 n-d-850499-9 devstack@n-api.service[122257]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 31 16:27:56.955429 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:27:56.955429 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:27:56.955429 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:27:56.955429 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 119 Aug 31 16:27:56.955429 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:27:56.955429 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:27:56.955429 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:27:56.955429 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:27:56.955429 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4wM_aY3nEn6izLGt90StdNv_07ZNHbNVLv9m4XDM-bU9PtF8EROAPrv7Sx1lDEM8Lc7YePXA48Cz-vz1ckYBSP1pPiOMI2rPfJisHw1hDvuO6_Lexijejx7160qZMKv0tFdORz44MjAk010s-4FO05DhmZuZE224OEcO3sM4RzICrg Aug 31 16:27:56.955429 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:27:56.955429 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:27:56.955429 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:27:56.955429 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:27:56.955429 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:27:56.955429 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:27:56.955429 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: b279ec001a154efb8553c18fcd5163fe Aug 31 16:27:56.955429 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-VolumesNegativeTest-1734736166 Aug 31 16:27:56.955429 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:27:56.955429 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:27:56.955429 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b279ec001a154efb8553c18fcd5163fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/b279ec001a154efb8553c18fcd5163fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_b279ec001a154efb8553c18fcd5163fe", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b279ec001a154efb8553c18fcd5163fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:27:56.955429 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-VolumesNegativeTest-1734736166 Aug 31 16:27:56.955429 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: b279ec001a154efb8553c18fcd5163fe Aug 31 16:27:56.955429 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-VolumesNegativeTest-1734736166 Aug 31 16:27:56.955429 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-VolumesNegativeTest-1734736166-project Aug 31 16:27:56.955429 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:27:56.955429 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:27:56.955429 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: b4d26403ee5a4fea86cba40d9cdd612d Aug 31 16:27:56.955429 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-VolumesNegativeTest-1734736166-project Aug 31 16:27:56.955429 n-d-850499-9 devstack@n-api.service[122257]: Aug 31 16:27:56.955429 n-d-850499-9 devstack@n-api.service[122257]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1860005095", "metadata": {"Type": "work"}}} Aug 31 16:27:56.955429 n-d-850499-9 devstack@n-api.service[122257]: method: Aug 31 16:27:56.955429 n-d-850499-9 devstack@n-api.service[122257]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 31 16:27:56.955429 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1860005095', 'metadata': {'Type': 'work'}}}} Aug 31 16:27:56.955429 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:27:56.955429 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:27:56.955429 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 16:27:56.955429 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 16:27:56.955429 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 16:27:56.955429 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise error Aug 31 16:27:56.955429 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 31 16:27:56.955429 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:27:56.955429 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 31 16:27:56.955429 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 31 16:27:56.955429 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:27:56.955429 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 31 16:27:56.955429 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi '' Aug 31 16:27:56.955429 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:27:56.955429 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:27:56.955429 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:27:56.955429 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:27:56.955429 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:27:56.955429 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:27:56.955429 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:27:56.955429 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:27:56.955429 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:27:56.955429 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:27:56.955429 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:27:56.955429 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:27:56.955429 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 16:27:56.955429 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 16:27:56.955429 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 16:27:56.955429 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 16:27:56.955429 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 16:27:56.955429 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 16:27:56.959865 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 31 16:27:56.959865 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:27:56.959865 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:27:56.959865 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:27:56.959865 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:27:56.959865 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:27:56.959865 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:27:56.959865 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 16:27:56.959865 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 16:27:56.959865 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 31 16:27:56.959865 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:27:56.962195 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4d90a440-9213-4534-a396-226eb96f89da tempest-VolumesNegativeTest-1734736166 tempest-VolumesNegativeTest-1734736166-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:27:56.963606 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4d90a440-9213-4534-a396-226eb96f89da tempest-VolumesNegativeTest-1734736166 tempest-VolumesNegativeTest-1734736166-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.017608 Aug 31 16:27:56.968450 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2900/5770] 10.222.0.61 () {60 vars in 1156 bytes} [Wed Aug 31 16:27:56 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:27:56.974331 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a11f3f3e-42f3-4926-b4f0-779a8a11abc4 tempest-VolumesNegativeTest-1734736166 tempest-VolumesNegativeTest-1734736166-project] Calling method '.version_select at 0x7f5ae9007670>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:57.037686 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-a11f3f3e-42f3-4926-b4f0-779a8a11abc4 tempest-VolumesNegativeTest-1734736166 tempest-VolumesNegativeTest-1734736166-project] HTTP exception thrown: Volume tempest-invalid-1735068368 could not be found. Aug 31 16:27:57.040652 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a11f3f3e-42f3-4926-b4f0-779a8a11abc4 tempest-VolumesNegativeTest-1734736166 tempest-VolumesNegativeTest-1734736166-project] Request method failure captured: Aug 31 16:27:57.040652 n-d-850499-9 devstack@n-api.service[122256]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1735068368 HTTP/1.1 Aug 31 16:27:57.040652 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:27:57.040652 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:27:57.040652 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:27:57.040652 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:27:57.040652 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:27:57.040652 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:27:57.040652 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:27:57.040652 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:27:57.040652 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4wM_aY3nEn6izLGt90StdNv_07ZNHbNVLv9m4XDM-bU9PtF8EROAPrv7Sx1lDEM8Lc7YePXA48Cz-vz1ckYBSP1pPiOMI2rPfJisHw1hDvuO6_Lexijejx7160qZMKv0tFdORz44MjAk010s-4FO05DhmZuZE224OEcO3sM4RzICrg Aug 31 16:27:57.040652 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:27:57.040652 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:27:57.040652 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:27:57.040652 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:27:57.040652 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:27:57.040652 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:27:57.040652 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: b279ec001a154efb8553c18fcd5163fe Aug 31 16:27:57.040652 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-VolumesNegativeTest-1734736166 Aug 31 16:27:57.040652 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:27:57.040652 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:27:57.040652 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b279ec001a154efb8553c18fcd5163fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/b279ec001a154efb8553c18fcd5163fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_b279ec001a154efb8553c18fcd5163fe", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b279ec001a154efb8553c18fcd5163fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:27:57.040652 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-VolumesNegativeTest-1734736166 Aug 31 16:27:57.040652 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: b279ec001a154efb8553c18fcd5163fe Aug 31 16:27:57.040652 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-VolumesNegativeTest-1734736166 Aug 31 16:27:57.040652 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-VolumesNegativeTest-1734736166-project Aug 31 16:27:57.040652 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:27:57.040652 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:27:57.040652 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: b4d26403ee5a4fea86cba40d9cdd612d Aug 31 16:27:57.040652 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-VolumesNegativeTest-1734736166-project Aug 31 16:27:57.040652 n-d-850499-9 devstack@n-api.service[122256]: method: Aug 31 16:27:57.040652 n-d-850499-9 devstack@n-api.service[122256]: exception: Volume tempest-invalid-1735068368 could not be found. Aug 31 16:27:57.040652 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': 'tempest-invalid-1735068368'} Aug 31 16:27:57.040652 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:27:57.040652 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:27:57.040652 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 16:27:57.040652 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 16:27:57.040652 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 16:27:57.040652 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 16:27:57.040652 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 16:27:57.040652 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 16:27:57.040652 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 16:27:57.040652 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 16:27:57.040652 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 16:27:57.040652 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 16:27:57.040652 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 16:27:57.040652 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 16:27:57.040652 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 16:27:57.040652 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 16:27:57.040652 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1735068368 could not be found. (HTTP 404) (Request-ID: req-29446de4-f4c8-411b-b5e8-70eae69a58ff) Aug 31 16:27:57.040652 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:27:57.040652 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:27:57.040652 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:27:57.040652 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:27:57.040652 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 31 16:27:57.040652 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 31 16:27:57.040652 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 16:27:57.040652 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 16:27:57.040652 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 16:27:57.040652 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 16:27:57.040652 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 16:27:57.040652 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 16:27:57.040652 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 16:27:57.043858 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 16:27:57.043858 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 16:27:57.043858 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 16:27:57.043858 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 16:27:57.043858 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 16:27:57.043858 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 16:27:57.043858 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 16:27:57.043858 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 16:27:57.043858 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 16:27:57.043858 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 16:27:57.043858 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 16:27:57.043858 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 16:27:57.043858 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 16:27:57.043858 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1735068368 could not be found. Aug 31 16:27:57.043858 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:27:57.043858 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:27:57.043858 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:27:57.043858 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:27:57.043858 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:27:57.043858 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:27:57.043858 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:27:57.043858 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:27:57.043858 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:27:57.043858 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:27:57.043858 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:27:57.043858 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:27:57.043858 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 31 16:27:57.043858 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:27:57.043858 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1735068368 could not be found. Aug 31 16:27:57.043858 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:27:57.043858 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:27:57.043858 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:27:57.043858 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:27:57.043858 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:27:57.043858 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:27:57.043858 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:27:57.043858 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:27:57.043858 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1735068368 could not be found. Aug 31 16:27:57.043858 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:27:57.047120 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a11f3f3e-42f3-4926-b4f0-779a8a11abc4 tempest-VolumesNegativeTest-1734736166 tempest-VolumesNegativeTest-1734736166-project] Returning 404 to user: Volume tempest-invalid-1735068368 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:27:57.048702 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a11f3f3e-42f3-4926-b4f0-779a8a11abc4 tempest-VolumesNegativeTest-1734736166 tempest-VolumesNegativeTest-1734736166-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1735068368" status: 404 len: 99 microversion: 2.1 time: 0.078570 Aug 31 16:27:57.053789 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2871/5771] 10.222.0.61 () {58 vars in 1218 bytes} [Wed Aug 31 16:27:56 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1735068368 => generated 99 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 31 16:27:57.068437 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-67816fba-92aa-4b08-a40e-cb2db4350b97 tempest-VolumesNegativeTest-1734736166 tempest-VolumesNegativeTest-1734736166-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.011163 Aug 31 16:27:57.069441 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2901/5772] 10.222.0.61 () {58 vars in 1140 bytes} [Wed Aug 31 16:27:57 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 15 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 31 16:27:57.087075 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-08c9911f-7a14-469e-b2d2-51e5dbdfb029 tempest-VolumesNegativeTest-1734736166 tempest-VolumesNegativeTest-1734736166-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.010219 Aug 31 16:27:57.088784 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2872/5773] 10.222.0.61 () {58 vars in 1137 bytes} [Wed Aug 31 16:27:57 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 14 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 31 16:27:57.108156 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d321c5b3-7608-4562-bebf-27acbccd51a4 tempest-VolumesNegativeTest-1734736166 tempest-VolumesNegativeTest-1734736166-project] Calling method '.version_select at 0x7f5ae8cd5c10>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:57.184602 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-d321c5b3-7608-4562-bebf-27acbccd51a4 tempest-VolumesNegativeTest-1734736166 tempest-VolumesNegativeTest-1734736166-project] HTTP exception thrown: Volume 49f65b2a-e137-42ed-b91a-cdc01e5e551f could not be found. Aug 31 16:27:57.186658 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d321c5b3-7608-4562-bebf-27acbccd51a4 tempest-VolumesNegativeTest-1734736166 tempest-VolumesNegativeTest-1734736166-project] Request method failure captured: Aug 31 16:27:57.186658 n-d-850499-9 devstack@n-api.service[122257]: request: DELETE /compute/v2.1/os-volumes/49f65b2a-e137-42ed-b91a-cdc01e5e551f HTTP/1.1 Aug 31 16:27:57.186658 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:27:57.186658 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:27:57.186658 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:27:57.186658 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:27:57.186658 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:27:57.186658 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:27:57.186658 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:27:57.186658 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:27:57.186658 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4wM_aY3nEn6izLGt90StdNv_07ZNHbNVLv9m4XDM-bU9PtF8EROAPrv7Sx1lDEM8Lc7YePXA48Cz-vz1ckYBSP1pPiOMI2rPfJisHw1hDvuO6_Lexijejx7160qZMKv0tFdORz44MjAk010s-4FO05DhmZuZE224OEcO3sM4RzICrg Aug 31 16:27:57.186658 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:27:57.186658 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:27:57.186658 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:27:57.186658 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:27:57.186658 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:27:57.186658 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:27:57.186658 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: b279ec001a154efb8553c18fcd5163fe Aug 31 16:27:57.186658 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-VolumesNegativeTest-1734736166 Aug 31 16:27:57.186658 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:27:57.186658 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:27:57.186658 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b279ec001a154efb8553c18fcd5163fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/b279ec001a154efb8553c18fcd5163fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_b279ec001a154efb8553c18fcd5163fe", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b279ec001a154efb8553c18fcd5163fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:27:57.186658 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-VolumesNegativeTest-1734736166 Aug 31 16:27:57.186658 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: b279ec001a154efb8553c18fcd5163fe Aug 31 16:27:57.186658 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-VolumesNegativeTest-1734736166 Aug 31 16:27:57.186658 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-VolumesNegativeTest-1734736166-project Aug 31 16:27:57.186658 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:27:57.186658 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:27:57.186658 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: b4d26403ee5a4fea86cba40d9cdd612d Aug 31 16:27:57.186658 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-VolumesNegativeTest-1734736166-project Aug 31 16:27:57.186658 n-d-850499-9 devstack@n-api.service[122257]: method: Aug 31 16:27:57.186658 n-d-850499-9 devstack@n-api.service[122257]: exception: Volume 49f65b2a-e137-42ed-b91a-cdc01e5e551f could not be found. Aug 31 16:27:57.186658 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '49f65b2a-e137-42ed-b91a-cdc01e5e551f'} Aug 31 16:27:57.186658 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:27:57.186658 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:27:57.186658 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 16:27:57.186658 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 16:27:57.186658 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 16:27:57.186658 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 16:27:57.186658 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 16:27:57.186658 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 16:27:57.186658 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 16:27:57.186658 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 16:27:57.186658 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 16:27:57.186658 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 16:27:57.186658 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 16:27:57.186658 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 16:27:57.186658 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 16:27:57.186658 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 16:27:57.186658 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 49f65b2a-e137-42ed-b91a-cdc01e5e551f could not be found. (HTTP 404) (Request-ID: req-5128a599-077b-4021-8c84-e099d6a724e3) Aug 31 16:27:57.186658 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:27:57.186658 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:27:57.186658 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:27:57.186658 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:27:57.186658 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 31 16:27:57.186658 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 31 16:27:57.186658 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 16:27:57.186658 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 16:27:57.186658 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 16:27:57.186658 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 16:27:57.186658 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 16:27:57.186658 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 16:27:57.186658 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 16:27:57.189895 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 16:27:57.189895 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 16:27:57.189895 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 16:27:57.189895 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 16:27:57.189895 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 16:27:57.189895 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 16:27:57.189895 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 16:27:57.189895 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 16:27:57.189895 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 16:27:57.189895 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 16:27:57.189895 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 16:27:57.189895 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 16:27:57.189895 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 16:27:57.189895 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 49f65b2a-e137-42ed-b91a-cdc01e5e551f could not be found. Aug 31 16:27:57.189895 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:27:57.189895 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:27:57.189895 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:27:57.189895 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:27:57.189895 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:27:57.189895 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:27:57.189895 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:27:57.189895 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:27:57.189895 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:27:57.189895 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:27:57.189895 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:27:57.189895 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:27:57.189895 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 31 16:27:57.189895 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:27:57.189895 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 49f65b2a-e137-42ed-b91a-cdc01e5e551f could not be found. Aug 31 16:27:57.189895 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:27:57.189895 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:27:57.189895 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:27:57.189895 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:27:57.189895 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:27:57.189895 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:27:57.189895 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:27:57.189895 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:27:57.189895 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 49f65b2a-e137-42ed-b91a-cdc01e5e551f could not be found. Aug 31 16:27:57.189895 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:27:57.189895 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d321c5b3-7608-4562-bebf-27acbccd51a4 tempest-VolumesNegativeTest-1734736166 tempest-VolumesNegativeTest-1734736166-project] Returning 404 to user: Volume 49f65b2a-e137-42ed-b91a-cdc01e5e551f could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:27:57.189895 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d321c5b3-7608-4562-bebf-27acbccd51a4 tempest-VolumesNegativeTest-1734736166 tempest-VolumesNegativeTest-1734736166-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/49f65b2a-e137-42ed-b91a-cdc01e5e551f" status: 404 len: 109 microversion: 2.1 time: 0.094196 Aug 31 16:27:57.189895 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2902/5774] 10.222.0.61 () {58 vars in 1248 bytes} [Wed Aug 31 16:27:57 2022] DELETE /compute/v2.1/os-volumes/49f65b2a-e137-42ed-b91a-cdc01e5e551f => generated 109 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 16:27:57.210190 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-50684428-018e-4783-842e-87c2cfb889b7 tempest-VolumesNegativeTest-1734736166 tempest-VolumesNegativeTest-1734736166-project] Calling method '.version_select at 0x7f5ae8247430>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:57.313487 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-50684428-018e-4783-842e-87c2cfb889b7 tempest-VolumesNegativeTest-1734736166 tempest-VolumesNegativeTest-1734736166-project] HTTP exception thrown: Volume 99bd7adf-12b5-4457-8048-21cf89318f68 could not be found. Aug 31 16:27:57.318954 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-50684428-018e-4783-842e-87c2cfb889b7 tempest-VolumesNegativeTest-1734736166 tempest-VolumesNegativeTest-1734736166-project] Request method failure captured: Aug 31 16:27:57.318954 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/os-volumes/99bd7adf-12b5-4457-8048-21cf89318f68 HTTP/1.1 Aug 31 16:27:57.318954 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:27:57.318954 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:27:57.318954 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:27:57.318954 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:27:57.318954 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:27:57.318954 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:27:57.318954 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:27:57.318954 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:27:57.318954 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4wM_aY3nEn6izLGt90StdNv_07ZNHbNVLv9m4XDM-bU9PtF8EROAPrv7Sx1lDEM8Lc7YePXA48Cz-vz1ckYBSP1pPiOMI2rPfJisHw1hDvuO6_Lexijejx7160qZMKv0tFdORz44MjAk010s-4FO05DhmZuZE224OEcO3sM4RzICrg Aug 31 16:27:57.318954 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:27:57.318954 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:27:57.318954 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:27:57.318954 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:27:57.318954 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:27:57.318954 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:27:57.318954 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: b279ec001a154efb8553c18fcd5163fe Aug 31 16:27:57.318954 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-VolumesNegativeTest-1734736166 Aug 31 16:27:57.318954 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:27:57.318954 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:27:57.318954 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b279ec001a154efb8553c18fcd5163fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/b279ec001a154efb8553c18fcd5163fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_b279ec001a154efb8553c18fcd5163fe", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b279ec001a154efb8553c18fcd5163fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:27:57.318954 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-VolumesNegativeTest-1734736166 Aug 31 16:27:57.318954 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: b279ec001a154efb8553c18fcd5163fe Aug 31 16:27:57.318954 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-VolumesNegativeTest-1734736166 Aug 31 16:27:57.318954 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-VolumesNegativeTest-1734736166-project Aug 31 16:27:57.318954 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:27:57.318954 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:27:57.318954 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: b4d26403ee5a4fea86cba40d9cdd612d Aug 31 16:27:57.318954 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-VolumesNegativeTest-1734736166-project Aug 31 16:27:57.318954 n-d-850499-9 devstack@n-api.service[122256]: method: Aug 31 16:27:57.318954 n-d-850499-9 devstack@n-api.service[122256]: exception: Volume 99bd7adf-12b5-4457-8048-21cf89318f68 could not be found. Aug 31 16:27:57.318954 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '99bd7adf-12b5-4457-8048-21cf89318f68'} Aug 31 16:27:57.318954 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:27:57.318954 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:27:57.318954 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 16:27:57.318954 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 16:27:57.318954 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 16:27:57.318954 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 16:27:57.318954 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 16:27:57.318954 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 16:27:57.318954 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 16:27:57.318954 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 16:27:57.318954 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 16:27:57.318954 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 16:27:57.318954 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 16:27:57.318954 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 16:27:57.318954 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 16:27:57.318954 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 16:27:57.318954 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 99bd7adf-12b5-4457-8048-21cf89318f68 could not be found. (HTTP 404) (Request-ID: req-df640f62-9d23-455d-8a4d-b53c15cf5f1e) Aug 31 16:27:57.318954 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:27:57.318954 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:27:57.318954 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:27:57.318954 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:27:57.318954 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 31 16:27:57.318954 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 31 16:27:57.318954 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 16:27:57.318954 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 16:27:57.318954 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 16:27:57.318954 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 16:27:57.318954 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 16:27:57.318954 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 16:27:57.318954 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 16:27:57.325534 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 16:27:57.325534 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 16:27:57.325534 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 16:27:57.325534 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 16:27:57.325534 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 16:27:57.325534 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 16:27:57.325534 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 16:27:57.325534 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 16:27:57.325534 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 16:27:57.325534 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 16:27:57.325534 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 16:27:57.325534 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 16:27:57.325534 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 16:27:57.325534 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 99bd7adf-12b5-4457-8048-21cf89318f68 could not be found. Aug 31 16:27:57.325534 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:27:57.325534 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:27:57.325534 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:27:57.325534 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:27:57.325534 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:27:57.325534 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:27:57.325534 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:27:57.325534 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:27:57.325534 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:27:57.325534 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:27:57.325534 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:27:57.325534 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:27:57.325534 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 31 16:27:57.325534 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:27:57.325534 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 99bd7adf-12b5-4457-8048-21cf89318f68 could not be found. Aug 31 16:27:57.325534 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:27:57.325534 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:27:57.325534 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:27:57.325534 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:27:57.325534 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:27:57.325534 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:27:57.325534 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:27:57.325534 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:27:57.325534 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 99bd7adf-12b5-4457-8048-21cf89318f68 could not be found. Aug 31 16:27:57.325534 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:27:57.340042 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-50684428-018e-4783-842e-87c2cfb889b7 tempest-VolumesNegativeTest-1734736166 tempest-VolumesNegativeTest-1734736166-project] Returning 404 to user: Volume 99bd7adf-12b5-4457-8048-21cf89318f68 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:27:57.346402 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-50684428-018e-4783-842e-87c2cfb889b7 tempest-VolumesNegativeTest-1734736166 tempest-VolumesNegativeTest-1734736166-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/99bd7adf-12b5-4457-8048-21cf89318f68" status: 404 len: 109 microversion: 2.1 time: 0.138371 Aug 31 16:27:57.352281 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2873/5775] 10.222.0.61 () {58 vars in 1245 bytes} [Wed Aug 31 16:27:57 2022] GET /compute/v2.1/os-volumes/99bd7adf-12b5-4457-8048-21cf89318f68 => generated 109 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:27:57.778675 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f7ca29f7-5561-48bc-b708-5b6311382c9e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:57.779857 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f7ca29f7-5561-48bc-b708-5b6311382c9e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 90d3311f-d4dc-4100-924a-963372dfcc88] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:57.821513 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f7ca29f7-5561-48bc-b708-5b6311382c9e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:57.826696 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f7ca29f7-5561-48bc-b708-5b6311382c9e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:57.827600 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f7ca29f7-5561-48bc-b708-5b6311382c9e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:57.828977 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f7ca29f7-5561-48bc-b708-5b6311382c9e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:57.829870 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f7ca29f7-5561-48bc-b708-5b6311382c9e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:57.830688 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f7ca29f7-5561-48bc-b708-5b6311382c9e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:58.420883 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f7ca29f7-5561-48bc-b708-5b6311382c9e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:58.454916 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f7ca29f7-5561-48bc-b708-5b6311382c9e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/90d3311f-d4dc-4100-924a-963372dfcc88" status: 200 len: 1464 microversion: 2.1 time: 0.684916 Aug 31 16:27:58.456491 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2903/5776] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:57 2022] GET /compute/v2.1/servers/90d3311f-d4dc-4100-924a-963372dfcc88 => generated 1464 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:27:58.678270 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-2b4806dd-6df1-4bd2-a8b4-c52c541d7bbf req-20dafdff-ab6d-4c6d-a482-4fda538d6b6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90d3311f-d4dc-4100-924a-963372dfcc88", "name": "network-vif-deleted", "tag": "3bcdc13f-0bd3-4e94-8657-4188531f839a"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:27:58.697697 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-2b4806dd-6df1-4bd2-a8b4-c52c541d7bbf req-20dafdff-ab6d-4c6d-a482-4fda538d6b6f service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:58.699675 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-2b4806dd-6df1-4bd2-a8b4-c52c541d7bbf req-20dafdff-ab6d-4c6d-a482-4fda538d6b6f service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:58.700282 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-2b4806dd-6df1-4bd2-a8b4-c52c541d7bbf req-20dafdff-ab6d-4c6d-a482-4fda538d6b6f service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:58.729541 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-2b4806dd-6df1-4bd2-a8b4-c52c541d7bbf req-20dafdff-ab6d-4c6d-a482-4fda538d6b6f service nova] Creating event network-vif-deleted:3bcdc13f-0bd3-4e94-8657-4188531f839a for instance 90d3311f-d4dc-4100-924a-963372dfcc88 on n-h2-850499-9 Aug 31 16:27:58.737177 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-2b4806dd-6df1-4bd2-a8b4-c52c541d7bbf req-20dafdff-ab6d-4c6d-a482-4fda538d6b6f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065175 Aug 31 16:27:58.746252 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2874/5777] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:27:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:27:59.512752 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f0af41bb-2f0f-4b87-b3b1-f8aabdc93405 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:59.514144 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f0af41bb-2f0f-4b87-b3b1-f8aabdc93405 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 90d3311f-d4dc-4100-924a-963372dfcc88] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:59.523132 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f0af41bb-2f0f-4b87-b3b1-f8aabdc93405 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:59.524533 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f0af41bb-2f0f-4b87-b3b1-f8aabdc93405 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:59.525110 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f0af41bb-2f0f-4b87-b3b1-f8aabdc93405 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:59.526343 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f0af41bb-2f0f-4b87-b3b1-f8aabdc93405 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:59.527138 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f0af41bb-2f0f-4b87-b3b1-f8aabdc93405 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:59.527899 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f0af41bb-2f0f-4b87-b3b1-f8aabdc93405 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:59.629725 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f0af41bb-2f0f-4b87-b3b1-f8aabdc93405 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:59.632625 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f0af41bb-2f0f-4b87-b3b1-f8aabdc93405 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:59.634822 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f0af41bb-2f0f-4b87-b3b1-f8aabdc93405 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:59.635609 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-f0af41bb-2f0f-4b87-b3b1-f8aabdc93405 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lazy-loading 'fault' on Instance uuid 90d3311f-d4dc-4100-924a-963372dfcc88 {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:27:59.864602 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f0af41bb-2f0f-4b87-b3b1-f8aabdc93405 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:59.873168 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f0af41bb-2f0f-4b87-b3b1-f8aabdc93405 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/90d3311f-d4dc-4100-924a-963372dfcc88" status: 200 len: 1303 microversion: 2.1 time: 0.364626 Aug 31 16:27:59.879340 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2904/5778] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:59 2022] GET /compute/v2.1/servers/90d3311f-d4dc-4100-924a-963372dfcc88 => generated 1303 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:28:00.912655 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f0561473-3980-45a8-b2bf-cd76bab3841c tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:00.915350 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f0561473-3980-45a8-b2bf-cd76bab3841c tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 90d3311f-d4dc-4100-924a-963372dfcc88] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:00.936973 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f0561473-3980-45a8-b2bf-cd76bab3841c tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:00.937498 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f0561473-3980-45a8-b2bf-cd76bab3841c tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:00.937950 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f0561473-3980-45a8-b2bf-cd76bab3841c tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:00.940914 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f0561473-3980-45a8-b2bf-cd76bab3841c tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:00.941642 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f0561473-3980-45a8-b2bf-cd76bab3841c tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:00.943053 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f0561473-3980-45a8-b2bf-cd76bab3841c tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:00.981674 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-f0561473-3980-45a8-b2bf-cd76bab3841c tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] HTTP exception thrown: Instance 90d3311f-d4dc-4100-924a-963372dfcc88 could not be found. Aug 31 16:28:00.989892 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f0561473-3980-45a8-b2bf-cd76bab3841c tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Request method failure captured: Aug 31 16:28:00.989892 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/90d3311f-d4dc-4100-924a-963372dfcc88 HTTP/1.1 Aug 31 16:28:00.989892 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:28:00.989892 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:28:00.989892 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:28:00.989892 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:28:00.989892 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:28:00.989892 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:28:00.989892 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:28:00.989892 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:28:00.989892 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4j4GoXu7a8XS8mokW4AeC842NZnj-uoRrLPe-ymerVUxYrezcAXYukQXkT8IqkMd2mshHtGlo5ORTm-xBrHOK9WFT9PPtSJjPDhKzFxYnOsxBAuHO1I5hUh0kdjx0f_1YsWDM7F8Lwt5dwXM7gNYQ4IaAaTeuNJuCJE3SFroPGrfPQ Aug 31 16:28:00.989892 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:28:00.989892 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:28:00.989892 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:28:00.989892 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:28:00.989892 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:28:00.989892 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:28:00.989892 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: f8fa87d9431f4253b8425593a2150359 Aug 31 16:28:00.989892 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ServerActionsTestJSON-1302460756 Aug 31 16:28:00.989892 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:28:00.989892 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:28:00.989892 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f8fa87d9431f4253b8425593a2150359"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f8fa87d9431f4253b8425593a2150359"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f8fa87d9431f4253b8425593a2150359", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f8fa87d9431f4253b8425593a2150359"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:28:00.989892 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ServerActionsTestJSON-1302460756 Aug 31 16:28:00.989892 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: f8fa87d9431f4253b8425593a2150359 Aug 31 16:28:00.989892 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ServerActionsTestJSON-1302460756 Aug 31 16:28:00.989892 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ServerActionsTestJSON-1302460756-project Aug 31 16:28:00.989892 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:28:00.989892 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:28:00.989892 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: a105ab564f304fa7a2ceba07418a22bc Aug 31 16:28:00.989892 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ServerActionsTestJSON-1302460756-project Aug 31 16:28:00.989892 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:28:00.989892 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance 90d3311f-d4dc-4100-924a-963372dfcc88 could not be found. Aug 31 16:28:00.989892 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '90d3311f-d4dc-4100-924a-963372dfcc88'} Aug 31 16:28:00.989892 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:28:00.989892 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:28:00.989892 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:28:00.989892 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:28:00.989892 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:28:00.989892 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:28:00.989892 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:28:00.989892 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:28:00.989892 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:28:00.989892 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:28:00.989892 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90d3311f-d4dc-4100-924a-963372dfcc88 could not be found. Aug 31 16:28:00.989892 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:28:00.989892 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:28:00.989892 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:28:00.989892 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:28:00.989892 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:28:00.989892 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:28:00.989892 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:28:00.989892 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:28:00.989892 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:28:00.989892 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:28:00.989892 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:28:00.989892 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:28:00.989892 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:28:00.989892 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:28:00.989892 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:28:00.989892 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:28:00.989892 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90d3311f-d4dc-4100-924a-963372dfcc88 could not be found. Aug 31 16:28:00.989892 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:28:00.989892 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:28:00.989892 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:28:00.995202 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:28:00.995202 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:28:00.995202 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:28:00.995202 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:28:00.995202 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:28:00.995202 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90d3311f-d4dc-4100-924a-963372dfcc88 could not be found. Aug 31 16:28:00.995202 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:28:00.999788 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f0561473-3980-45a8-b2bf-cd76bab3841c tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Returning 404 to user: Instance 90d3311f-d4dc-4100-924a-963372dfcc88 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:28:01.001134 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f0561473-3980-45a8-b2bf-cd76bab3841c tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/90d3311f-d4dc-4100-924a-963372dfcc88" status: 404 len: 111 microversion: 2.1 time: 0.095554 Aug 31 16:28:01.009045 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2875/5779] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:28:00 2022] GET /compute/v2.1/servers/90d3311f-d4dc-4100-924a-963372dfcc88 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:28:01.019610 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-062bf52c-677f-483a-bf21-2333da855769 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:01.020772 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-062bf52c-677f-483a-bf21-2333da855769 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: ef42ce7c-829a-47f8-8d9f-68eac68ec20b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:01.051995 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-062bf52c-677f-483a-bf21-2333da855769 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:01.056415 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-062bf52c-677f-483a-bf21-2333da855769 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:01.056415 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-062bf52c-677f-483a-bf21-2333da855769 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:01.060525 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-062bf52c-677f-483a-bf21-2333da855769 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:01.061126 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-062bf52c-677f-483a-bf21-2333da855769 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:01.061585 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-062bf52c-677f-483a-bf21-2333da855769 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:01.109296 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-062bf52c-677f-483a-bf21-2333da855769 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: ef42ce7c-829a-47f8-8d9f-68eac68ec20b] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:28:01.388195 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-062bf52c-677f-483a-bf21-2333da855769 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "DELETE /compute/v2.1/servers/ef42ce7c-829a-47f8-8d9f-68eac68ec20b" status: 204 len: 0 microversion: 2.1 time: 0.367004 Aug 31 16:28:01.390380 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2905/5780] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:28:01 2022] DELETE /compute/v2.1/servers/ef42ce7c-829a-47f8-8d9f-68eac68ec20b => generated 0 bytes in 377 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:28:01.403493 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8b734083-df99-4a15-a729-3a4a3e8c3dd6 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:01.404462 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8b734083-df99-4a15-a729-3a4a3e8c3dd6 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: ef42ce7c-829a-47f8-8d9f-68eac68ec20b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:01.471905 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8b734083-df99-4a15-a729-3a4a3e8c3dd6 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:01.471905 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8b734083-df99-4a15-a729-3a4a3e8c3dd6 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:01.471905 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8b734083-df99-4a15-a729-3a4a3e8c3dd6 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:01.471905 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8b734083-df99-4a15-a729-3a4a3e8c3dd6 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:01.471905 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8b734083-df99-4a15-a729-3a4a3e8c3dd6 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:01.471905 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8b734083-df99-4a15-a729-3a4a3e8c3dd6 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:02.379166 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8b734083-df99-4a15-a729-3a4a3e8c3dd6 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:02.407990 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8b734083-df99-4a15-a729-3a4a3e8c3dd6 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/ef42ce7c-829a-47f8-8d9f-68eac68ec20b" status: 200 len: 1507 microversion: 2.1 time: 1.005670 Aug 31 16:28:02.424196 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2876/5781] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:28:01 2022] GET /compute/v2.1/servers/ef42ce7c-829a-47f8-8d9f-68eac68ec20b => generated 1507 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:28:03.448740 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-cf5a9ab8-fef1-4793-9cde-9fdf7f77f290 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:03.451219 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-cf5a9ab8-fef1-4793-9cde-9fdf7f77f290 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: ef42ce7c-829a-47f8-8d9f-68eac68ec20b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:03.475233 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cf5a9ab8-fef1-4793-9cde-9fdf7f77f290 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:03.478104 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cf5a9ab8-fef1-4793-9cde-9fdf7f77f290 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:03.480523 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cf5a9ab8-fef1-4793-9cde-9fdf7f77f290 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:03.482429 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cf5a9ab8-fef1-4793-9cde-9fdf7f77f290 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:03.484040 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cf5a9ab8-fef1-4793-9cde-9fdf7f77f290 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:03.485163 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cf5a9ab8-fef1-4793-9cde-9fdf7f77f290 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:04.093155 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-cf5a9ab8-fef1-4793-9cde-9fdf7f77f290 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:04.111139 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-cf5a9ab8-fef1-4793-9cde-9fdf7f77f290 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/ef42ce7c-829a-47f8-8d9f-68eac68ec20b" status: 200 len: 1465 microversion: 2.1 time: 0.682210 Aug 31 16:28:04.114474 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2906/5782] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:28:03 2022] GET /compute/v2.1/servers/ef42ce7c-829a-47f8-8d9f-68eac68ec20b => generated 1465 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:28:04.127058 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-c2d65ec5-e58b-4c9b-84bf-ce71083e4183 req-707b2ee9-17ba-44c9-96b0-672c2cb0700e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef42ce7c-829a-47f8-8d9f-68eac68ec20b", "name": "network-vif-deleted", "tag": "1040a73e-2d3a-4ec7-8b73-8203c0395cca"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:28:04.177235 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-c2d65ec5-e58b-4c9b-84bf-ce71083e4183 req-707b2ee9-17ba-44c9-96b0-672c2cb0700e service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:04.178284 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-c2d65ec5-e58b-4c9b-84bf-ce71083e4183 req-707b2ee9-17ba-44c9-96b0-672c2cb0700e service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:04.184733 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-c2d65ec5-e58b-4c9b-84bf-ce71083e4183 req-707b2ee9-17ba-44c9-96b0-672c2cb0700e service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:04.239385 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-c2d65ec5-e58b-4c9b-84bf-ce71083e4183 req-707b2ee9-17ba-44c9-96b0-672c2cb0700e service nova] Creating event network-vif-deleted:1040a73e-2d3a-4ec7-8b73-8203c0395cca for instance ef42ce7c-829a-47f8-8d9f-68eac68ec20b on n-h1-850499-9 Aug 31 16:28:04.250199 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-c2d65ec5-e58b-4c9b-84bf-ce71083e4183 req-707b2ee9-17ba-44c9-96b0-672c2cb0700e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129639 Aug 31 16:28:04.262792 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2877/5783] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:28:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:28:05.166248 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ad742847-eba7-4c95-8c27-89afb824ee1d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:05.186476 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ad742847-eba7-4c95-8c27-89afb824ee1d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: ef42ce7c-829a-47f8-8d9f-68eac68ec20b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:05.225770 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ad742847-eba7-4c95-8c27-89afb824ee1d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:05.226279 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ad742847-eba7-4c95-8c27-89afb824ee1d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:05.226919 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ad742847-eba7-4c95-8c27-89afb824ee1d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:05.229440 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ad742847-eba7-4c95-8c27-89afb824ee1d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:05.230364 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ad742847-eba7-4c95-8c27-89afb824ee1d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:05.233773 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ad742847-eba7-4c95-8c27-89afb824ee1d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:05.381204 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ad742847-eba7-4c95-8c27-89afb824ee1d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:05.382360 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ad742847-eba7-4c95-8c27-89afb824ee1d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:05.387717 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ad742847-eba7-4c95-8c27-89afb824ee1d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:05.388905 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-ad742847-eba7-4c95-8c27-89afb824ee1d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lazy-loading 'fault' on Instance uuid ef42ce7c-829a-47f8-8d9f-68eac68ec20b {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:28:05.595151 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ad742847-eba7-4c95-8c27-89afb824ee1d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:05.627457 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ad742847-eba7-4c95-8c27-89afb824ee1d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/ef42ce7c-829a-47f8-8d9f-68eac68ec20b" status: 200 len: 1304 microversion: 2.1 time: 0.476912 Aug 31 16:28:05.645745 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2907/5784] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:28:05 2022] GET /compute/v2.1/servers/ef42ce7c-829a-47f8-8d9f-68eac68ec20b => generated 1304 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:28:06.670988 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-be7ba948-ce0f-45e4-994c-28cdb13d2910 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:06.677719 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-be7ba948-ce0f-45e4-994c-28cdb13d2910 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: ef42ce7c-829a-47f8-8d9f-68eac68ec20b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:06.694430 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=3 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:28:06.738856 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-be7ba948-ce0f-45e4-994c-28cdb13d2910 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:06.740940 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-be7ba948-ce0f-45e4-994c-28cdb13d2910 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:06.743144 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-be7ba948-ce0f-45e4-994c-28cdb13d2910 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:06.745874 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-be7ba948-ce0f-45e4-994c-28cdb13d2910 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:06.748603 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-be7ba948-ce0f-45e4-994c-28cdb13d2910 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:06.750050 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-be7ba948-ce0f-45e4-994c-28cdb13d2910 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:06.800427 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-be7ba948-ce0f-45e4-994c-28cdb13d2910 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] HTTP exception thrown: Instance ef42ce7c-829a-47f8-8d9f-68eac68ec20b could not be found. Aug 31 16:28:06.806132 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-be7ba948-ce0f-45e4-994c-28cdb13d2910 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Request method failure captured: Aug 31 16:28:06.806132 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/ef42ce7c-829a-47f8-8d9f-68eac68ec20b HTTP/1.1 Aug 31 16:28:06.806132 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:28:06.806132 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:28:06.806132 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:28:06.806132 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:28:06.806132 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:28:06.806132 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:28:06.806132 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:28:06.806132 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:28:06.806132 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4j4GoXu7a8XS8mokW4AeC842NZnj-uoRrLPe-ymerVUxYrezcAXYukQXkT8IqkMd2mshHtGlo5ORTm-xBrHOK9WFT9PPtSJjPDhKzFxYnOsxBAuHO1I5hUh0kdjx0f_1YsWDM7F8Lwt5dwXM7gNYQ4IaAaTeuNJuCJE3SFroPGrfPQ Aug 31 16:28:06.806132 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:28:06.806132 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:28:06.806132 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:28:06.806132 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:28:06.806132 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:28:06.806132 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:28:06.806132 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: f8fa87d9431f4253b8425593a2150359 Aug 31 16:28:06.806132 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ServerActionsTestJSON-1302460756 Aug 31 16:28:06.806132 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:28:06.806132 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:28:06.806132 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f8fa87d9431f4253b8425593a2150359"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f8fa87d9431f4253b8425593a2150359"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f8fa87d9431f4253b8425593a2150359", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f8fa87d9431f4253b8425593a2150359"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:28:06.806132 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ServerActionsTestJSON-1302460756 Aug 31 16:28:06.806132 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: f8fa87d9431f4253b8425593a2150359 Aug 31 16:28:06.806132 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ServerActionsTestJSON-1302460756 Aug 31 16:28:06.806132 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ServerActionsTestJSON-1302460756-project Aug 31 16:28:06.806132 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:28:06.806132 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:28:06.806132 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: a105ab564f304fa7a2ceba07418a22bc Aug 31 16:28:06.806132 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ServerActionsTestJSON-1302460756-project Aug 31 16:28:06.806132 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:28:06.806132 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance ef42ce7c-829a-47f8-8d9f-68eac68ec20b could not be found. Aug 31 16:28:06.806132 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': 'ef42ce7c-829a-47f8-8d9f-68eac68ec20b'} Aug 31 16:28:06.806132 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:28:06.806132 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:28:06.806132 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:28:06.806132 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:28:06.806132 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:28:06.806132 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:28:06.806132 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:28:06.806132 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:28:06.806132 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:28:06.806132 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:28:06.806132 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef42ce7c-829a-47f8-8d9f-68eac68ec20b could not be found. Aug 31 16:28:06.806132 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:28:06.806132 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:28:06.806132 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:28:06.806132 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:28:06.806132 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:28:06.806132 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:28:06.806132 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:28:06.806132 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:28:06.806132 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:28:06.806132 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:28:06.806132 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:28:06.806132 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:28:06.806132 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:28:06.806132 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:28:06.806132 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:28:06.806132 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:28:06.806132 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef42ce7c-829a-47f8-8d9f-68eac68ec20b could not be found. Aug 31 16:28:06.806132 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:28:06.806132 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:28:06.806132 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:28:06.815878 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:28:06.815878 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:28:06.815878 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:28:06.815878 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:28:06.815878 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:28:06.815878 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef42ce7c-829a-47f8-8d9f-68eac68ec20b could not be found. Aug 31 16:28:06.815878 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:28:06.825991 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-be7ba948-ce0f-45e4-994c-28cdb13d2910 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Returning 404 to user: Instance ef42ce7c-829a-47f8-8d9f-68eac68ec20b could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:28:06.831296 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-be7ba948-ce0f-45e4-994c-28cdb13d2910 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/ef42ce7c-829a-47f8-8d9f-68eac68ec20b" status: 404 len: 111 microversion: 2.1 time: 0.169600 Aug 31 16:28:06.841602 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2878/5785] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:28:06 2022] GET /compute/v2.1/servers/ef42ce7c-829a-47f8-8d9f-68eac68ec20b => generated 111 bytes in 182 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:28:06.850353 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-dc3814cd-606c-4a0d-a655-607a81d7c7da tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:06.851237 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-dc3814cd-606c-4a0d-a655-607a81d7c7da tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 2459bf91-9279-46ab-be03-9de04e8cb3f4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:06.872016 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dc3814cd-606c-4a0d-a655-607a81d7c7da tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:06.875468 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dc3814cd-606c-4a0d-a655-607a81d7c7da tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:06.876313 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dc3814cd-606c-4a0d-a655-607a81d7c7da tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:06.879175 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dc3814cd-606c-4a0d-a655-607a81d7c7da tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:06.882368 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dc3814cd-606c-4a0d-a655-607a81d7c7da tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:06.882555 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dc3814cd-606c-4a0d-a655-607a81d7c7da tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:06.955613 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-dc3814cd-606c-4a0d-a655-607a81d7c7da tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 2459bf91-9279-46ab-be03-9de04e8cb3f4] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:28:07.272615 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-dc3814cd-606c-4a0d-a655-607a81d7c7da tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "DELETE /compute/v2.1/servers/2459bf91-9279-46ab-be03-9de04e8cb3f4" status: 204 len: 0 microversion: 2.1 time: 0.429052 Aug 31 16:28:07.276399 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2908/5786] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:28:06 2022] DELETE /compute/v2.1/servers/2459bf91-9279-46ab-be03-9de04e8cb3f4 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:28:07.285337 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a4cad25f-027a-442c-a375-e840e1c3306a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:07.286352 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a4cad25f-027a-442c-a375-e840e1c3306a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 2459bf91-9279-46ab-be03-9de04e8cb3f4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:07.307998 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a4cad25f-027a-442c-a375-e840e1c3306a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:07.308557 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a4cad25f-027a-442c-a375-e840e1c3306a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:07.309021 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a4cad25f-027a-442c-a375-e840e1c3306a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:07.311206 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a4cad25f-027a-442c-a375-e840e1c3306a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:07.311828 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a4cad25f-027a-442c-a375-e840e1c3306a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:07.312172 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a4cad25f-027a-442c-a375-e840e1c3306a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:08.372671 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a4cad25f-027a-442c-a375-e840e1c3306a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:08.394228 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a4cad25f-027a-442c-a375-e840e1c3306a tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/2459bf91-9279-46ab-be03-9de04e8cb3f4" status: 200 len: 1495 microversion: 2.1 time: 1.113145 Aug 31 16:28:08.421329 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2879/5787] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:28:07 2022] GET /compute/v2.1/servers/2459bf91-9279-46ab-be03-9de04e8cb3f4 => generated 1495 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:28:09.434382 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b953ee2a-f46d-438b-bc3f-04600ea2f1a5 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:09.435808 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b953ee2a-f46d-438b-bc3f-04600ea2f1a5 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 2459bf91-9279-46ab-be03-9de04e8cb3f4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:09.463185 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b953ee2a-f46d-438b-bc3f-04600ea2f1a5 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:09.471237 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b953ee2a-f46d-438b-bc3f-04600ea2f1a5 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:09.472866 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b953ee2a-f46d-438b-bc3f-04600ea2f1a5 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:09.473884 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b953ee2a-f46d-438b-bc3f-04600ea2f1a5 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:09.474773 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b953ee2a-f46d-438b-bc3f-04600ea2f1a5 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:09.478175 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b953ee2a-f46d-438b-bc3f-04600ea2f1a5 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:09.699631 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b953ee2a-f46d-438b-bc3f-04600ea2f1a5 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:09.754356 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b953ee2a-f46d-438b-bc3f-04600ea2f1a5 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/2459bf91-9279-46ab-be03-9de04e8cb3f4" status: 200 len: 1453 microversion: 2.1 time: 0.325151 Aug 31 16:28:09.779195 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2909/5788] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:28:09 2022] GET /compute/v2.1/servers/2459bf91-9279-46ab-be03-9de04e8cb3f4 => generated 1453 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:28:10.168644 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-e2e3e212-22e2-46f7-935e-8b5e7785e2ef req-29334a88-ec32-46bf-89ad-7679033ff059 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2459bf91-9279-46ab-be03-9de04e8cb3f4", "name": "network-vif-deleted", "tag": "5aee3413-65c3-47d2-8e17-0db097d25bd7"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:28:10.229815 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-e2e3e212-22e2-46f7-935e-8b5e7785e2ef req-29334a88-ec32-46bf-89ad-7679033ff059 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:10.241208 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-e2e3e212-22e2-46f7-935e-8b5e7785e2ef req-29334a88-ec32-46bf-89ad-7679033ff059 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:10.241208 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-e2e3e212-22e2-46f7-935e-8b5e7785e2ef req-29334a88-ec32-46bf-89ad-7679033ff059 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:10.287425 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-e2e3e212-22e2-46f7-935e-8b5e7785e2ef req-29334a88-ec32-46bf-89ad-7679033ff059 service nova] Creating event network-vif-deleted:5aee3413-65c3-47d2-8e17-0db097d25bd7 for instance 2459bf91-9279-46ab-be03-9de04e8cb3f4 on n-h1-850499-9 Aug 31 16:28:10.315755 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-e2e3e212-22e2-46f7-935e-8b5e7785e2ef req-29334a88-ec32-46bf-89ad-7679033ff059 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147433 Aug 31 16:28:10.317729 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2880/5789] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:28:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:28:10.804331 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5b26deac-a6c9-4dda-856f-387c0bcb8b14 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:10.806509 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5b26deac-a6c9-4dda-856f-387c0bcb8b14 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 2459bf91-9279-46ab-be03-9de04e8cb3f4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:10.823866 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b26deac-a6c9-4dda-856f-387c0bcb8b14 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:10.825912 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b26deac-a6c9-4dda-856f-387c0bcb8b14 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:10.832114 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b26deac-a6c9-4dda-856f-387c0bcb8b14 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:10.834093 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b26deac-a6c9-4dda-856f-387c0bcb8b14 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:10.843563 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b26deac-a6c9-4dda-856f-387c0bcb8b14 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:10.844797 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b26deac-a6c9-4dda-856f-387c0bcb8b14 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:10.910034 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:28:10.984665 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b26deac-a6c9-4dda-856f-387c0bcb8b14 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:10.985542 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b26deac-a6c9-4dda-856f-387c0bcb8b14 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:10.986448 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b26deac-a6c9-4dda-856f-387c0bcb8b14 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:10.987343 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-5b26deac-a6c9-4dda-856f-387c0bcb8b14 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lazy-loading 'fault' on Instance uuid 2459bf91-9279-46ab-be03-9de04e8cb3f4 {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:28:11.314950 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5b26deac-a6c9-4dda-856f-387c0bcb8b14 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:11.364731 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5b26deac-a6c9-4dda-856f-387c0bcb8b14 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/2459bf91-9279-46ab-be03-9de04e8cb3f4" status: 200 len: 1305 microversion: 2.1 time: 0.569388 Aug 31 16:28:11.377878 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2910/5790] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:28:10 2022] GET /compute/v2.1/servers/2459bf91-9279-46ab-be03-9de04e8cb3f4 => generated 1305 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:28:12.423205 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b7fc3a19-394f-4316-9ad2-e1f1cee18138 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:12.428932 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b7fc3a19-394f-4316-9ad2-e1f1cee18138 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 2459bf91-9279-46ab-be03-9de04e8cb3f4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:12.498461 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b7fc3a19-394f-4316-9ad2-e1f1cee18138 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:12.500260 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b7fc3a19-394f-4316-9ad2-e1f1cee18138 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:12.503169 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b7fc3a19-394f-4316-9ad2-e1f1cee18138 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:12.506150 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b7fc3a19-394f-4316-9ad2-e1f1cee18138 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:12.508400 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b7fc3a19-394f-4316-9ad2-e1f1cee18138 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:12.512574 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b7fc3a19-394f-4316-9ad2-e1f1cee18138 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:12.577489 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-b7fc3a19-394f-4316-9ad2-e1f1cee18138 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] HTTP exception thrown: Instance 2459bf91-9279-46ab-be03-9de04e8cb3f4 could not be found. Aug 31 16:28:12.588885 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b7fc3a19-394f-4316-9ad2-e1f1cee18138 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Request method failure captured: Aug 31 16:28:12.588885 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/2459bf91-9279-46ab-be03-9de04e8cb3f4 HTTP/1.1 Aug 31 16:28:12.588885 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:28:12.588885 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:28:12.588885 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:28:12.588885 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:28:12.588885 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:28:12.588885 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:28:12.588885 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:28:12.588885 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:28:12.588885 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4j4GoXu7a8XS8mokW4AeC842NZnj-uoRrLPe-ymerVUxYrezcAXYukQXkT8IqkMd2mshHtGlo5ORTm-xBrHOK9WFT9PPtSJjPDhKzFxYnOsxBAuHO1I5hUh0kdjx0f_1YsWDM7F8Lwt5dwXM7gNYQ4IaAaTeuNJuCJE3SFroPGrfPQ Aug 31 16:28:12.588885 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:28:12.588885 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:28:12.588885 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:28:12.588885 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:28:12.588885 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:28:12.588885 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:28:12.588885 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: f8fa87d9431f4253b8425593a2150359 Aug 31 16:28:12.588885 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ServerActionsTestJSON-1302460756 Aug 31 16:28:12.588885 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:28:12.588885 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:28:12.588885 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f8fa87d9431f4253b8425593a2150359"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f8fa87d9431f4253b8425593a2150359"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f8fa87d9431f4253b8425593a2150359", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f8fa87d9431f4253b8425593a2150359"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:28:12.588885 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ServerActionsTestJSON-1302460756 Aug 31 16:28:12.588885 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: f8fa87d9431f4253b8425593a2150359 Aug 31 16:28:12.588885 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ServerActionsTestJSON-1302460756 Aug 31 16:28:12.588885 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ServerActionsTestJSON-1302460756-project Aug 31 16:28:12.588885 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:28:12.588885 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:28:12.588885 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: a105ab564f304fa7a2ceba07418a22bc Aug 31 16:28:12.588885 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ServerActionsTestJSON-1302460756-project Aug 31 16:28:12.588885 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:28:12.588885 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance 2459bf91-9279-46ab-be03-9de04e8cb3f4 could not be found. Aug 31 16:28:12.588885 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '2459bf91-9279-46ab-be03-9de04e8cb3f4'} Aug 31 16:28:12.588885 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:28:12.588885 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:28:12.588885 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:28:12.588885 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:28:12.588885 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:28:12.588885 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:28:12.588885 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:28:12.588885 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:28:12.588885 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:28:12.588885 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:28:12.588885 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2459bf91-9279-46ab-be03-9de04e8cb3f4 could not be found. Aug 31 16:28:12.588885 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:28:12.588885 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:28:12.588885 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:28:12.588885 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:28:12.588885 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:28:12.588885 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:28:12.588885 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:28:12.588885 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:28:12.588885 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:28:12.588885 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:28:12.588885 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:28:12.588885 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:28:12.588885 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:28:12.588885 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:28:12.588885 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:28:12.588885 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:28:12.588885 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2459bf91-9279-46ab-be03-9de04e8cb3f4 could not be found. Aug 31 16:28:12.588885 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:28:12.588885 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:28:12.588885 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:28:12.598259 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:28:12.598259 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:28:12.598259 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:28:12.598259 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:28:12.598259 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:28:12.598259 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2459bf91-9279-46ab-be03-9de04e8cb3f4 could not be found. Aug 31 16:28:12.598259 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:28:12.609126 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b7fc3a19-394f-4316-9ad2-e1f1cee18138 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Returning 404 to user: Instance 2459bf91-9279-46ab-be03-9de04e8cb3f4 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:28:12.611142 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b7fc3a19-394f-4316-9ad2-e1f1cee18138 tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/2459bf91-9279-46ab-be03-9de04e8cb3f4" status: 404 len: 111 microversion: 2.1 time: 0.200351 Aug 31 16:28:12.613040 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2881/5791] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:28:12 2022] GET /compute/v2.1/servers/2459bf91-9279-46ab-be03-9de04e8cb3f4 => generated 111 bytes in 204 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:28:12.626580 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-576ba665-1533-4dc9-aac3-a0a31deac16e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:12.629423 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-576ba665-1533-4dc9-aac3-a0a31deac16e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:12.705442 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-576ba665-1533-4dc9-aac3-a0a31deac16e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:12.706642 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-576ba665-1533-4dc9-aac3-a0a31deac16e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:12.720318 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-576ba665-1533-4dc9-aac3-a0a31deac16e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:12.721855 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-576ba665-1533-4dc9-aac3-a0a31deac16e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:12.727479 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-576ba665-1533-4dc9-aac3-a0a31deac16e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:12.728425 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-576ba665-1533-4dc9-aac3-a0a31deac16e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:12.904934 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-576ba665-1533-4dc9-aac3-a0a31deac16e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:28:13.239727 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-576ba665-1533-4dc9-aac3-a0a31deac16e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "DELETE /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 204 len: 0 microversion: 2.1 time: 0.615484 Aug 31 16:28:13.248605 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2911/5792] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:28:12 2022] DELETE /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 0 bytes in 630 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 16:28:13.260947 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b0c33727-d8ef-4085-8695-c87c431e8c7b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:13.262074 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b0c33727-d8ef-4085-8695-c87c431e8c7b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:13.303146 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b0c33727-d8ef-4085-8695-c87c431e8c7b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:13.307343 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b0c33727-d8ef-4085-8695-c87c431e8c7b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:13.308242 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b0c33727-d8ef-4085-8695-c87c431e8c7b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:13.309603 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b0c33727-d8ef-4085-8695-c87c431e8c7b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:13.313812 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b0c33727-d8ef-4085-8695-c87c431e8c7b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:13.314652 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b0c33727-d8ef-4085-8695-c87c431e8c7b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:13.975791 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b0c33727-d8ef-4085-8695-c87c431e8c7b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:13.985627 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b0c33727-d8ef-4085-8695-c87c431e8c7b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1674 microversion: 2.1 time: 0.733633 Aug 31 16:28:13.999532 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2882/5793] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:28:13 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1674 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:28:15.058223 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-67a7373f-3f9d-499c-93cf-94e20820fbfd tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:15.069419 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-67a7373f-3f9d-499c-93cf-94e20820fbfd tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:15.114055 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-67a7373f-3f9d-499c-93cf-94e20820fbfd tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:15.115682 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-67a7373f-3f9d-499c-93cf-94e20820fbfd tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:15.122587 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-67a7373f-3f9d-499c-93cf-94e20820fbfd tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:15.131951 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-67a7373f-3f9d-499c-93cf-94e20820fbfd tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:15.135710 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-67a7373f-3f9d-499c-93cf-94e20820fbfd tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:15.141056 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-67a7373f-3f9d-499c-93cf-94e20820fbfd tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:15.560167 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-67a7373f-3f9d-499c-93cf-94e20820fbfd tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:15.569023 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-67a7373f-3f9d-499c-93cf-94e20820fbfd tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1674 microversion: 2.1 time: 0.539160 Aug 31 16:28:15.580486 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2912/5794] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:28:15 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1674 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:28:16.236175 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d74488c7-b26b-4f5a-a36e-9890e9ccef95 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-1941104943", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "networks": [{"uuid": "5fc505fd-15d5-49a5-99f9-e82b433c2328"}]}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:28:16.250491 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4a802a23-7000-4e91-ab76-7cbd0493e00d tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1334517765", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "networks": [{"uuid": "94429e53-5601-48f1-920c-7fae90bc775e"}]}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:28:16.473171 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-d74488c7-b26b-4f5a-a36e-9890e9ccef95 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] validate_networks() for [('5fc505fd-15d5-49a5-99f9-e82b433c2328', None, None, None, None, None)] {{(pid=122256) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:28:16.480449 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-4a802a23-7000-4e91-ab76-7cbd0493e00d tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] validate_networks() for [('94429e53-5601-48f1-920c-7fae90bc775e', None, None, None, None, None)] {{(pid=122257) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:28:18.770460 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-4a802a23-7000-4e91-ab76-7cbd0493e00d tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:28:18.772055 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-4a802a23-7000-4e91-ab76-7cbd0493e00d tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:28:18.773360 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-4a802a23-7000-4e91-ab76-7cbd0493e00d tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:28:18.774354 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-4a802a23-7000-4e91-ab76-7cbd0493e00d tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:28:18.775261 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-4a802a23-7000-4e91-ab76-7cbd0493e00d tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:28:18.794531 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-d74488c7-b26b-4f5a-a36e-9890e9ccef95 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:28:18.795320 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-d74488c7-b26b-4f5a-a36e-9890e9ccef95 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:28:18.795860 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4a802a23-7000-4e91-ab76-7cbd0493e00d tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:18.796053 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-d74488c7-b26b-4f5a-a36e-9890e9ccef95 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:28:18.796390 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4a802a23-7000-4e91-ab76-7cbd0493e00d tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:18.796729 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-d74488c7-b26b-4f5a-a36e-9890e9ccef95 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:28:18.796868 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4a802a23-7000-4e91-ab76-7cbd0493e00d tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:18.797315 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-d74488c7-b26b-4f5a-a36e-9890e9ccef95 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:28:18.797604 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4a802a23-7000-4e91-ab76-7cbd0493e00d tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:18.800313 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4a802a23-7000-4e91-ab76-7cbd0493e00d tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:18.800768 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4a802a23-7000-4e91-ab76-7cbd0493e00d tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:18.848733 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d74488c7-b26b-4f5a-a36e-9890e9ccef95 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:18.849563 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d74488c7-b26b-4f5a-a36e-9890e9ccef95 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:18.850291 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d74488c7-b26b-4f5a-a36e-9890e9ccef95 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:18.852166 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d74488c7-b26b-4f5a-a36e-9890e9ccef95 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:18.852906 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d74488c7-b26b-4f5a-a36e-9890e9ccef95 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:18.853460 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-4a802a23-7000-4e91-ab76-7cbd0493e00d tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Getting quotas for project 7bb6a0a8643748b9830f2859de6d8b5e. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:28:18.853714 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d74488c7-b26b-4f5a-a36e-9890e9ccef95 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:18.878098 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-4a802a23-7000-4e91-ab76-7cbd0493e00d tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Getting quotas for user 7cc4d613cdc94357b40e83a2b70b0bf7 and project 7bb6a0a8643748b9830f2859de6d8b5e. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:28:18.926104 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4a802a23-7000-4e91-ab76-7cbd0493e00d tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Going to run 1 instances... {{(pid=122257) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:28:18.929904 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4a802a23-7000-4e91-ab76-7cbd0493e00d tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] [instance: 8d537fe8-d6d8-4858-a2d0-596abd805ac9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:28:18.933442 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-d74488c7-b26b-4f5a-a36e-9890e9ccef95 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Getting quotas for project 9d753dee849a4318a4711fa5e4791e44. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:28:18.957881 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-d74488c7-b26b-4f5a-a36e-9890e9ccef95 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Getting quotas for user cc96a6b97c3c458a88ebc013157332ce and project 9d753dee849a4318a4711fa5e4791e44. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:28:19.005301 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d74488c7-b26b-4f5a-a36e-9890e9ccef95 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Going to run 1 instances... {{(pid=122256) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:28:19.008451 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d74488c7-b26b-4f5a-a36e-9890e9ccef95 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] [instance: 1b38884c-e9e3-4a03-98d7-e687429cd132] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:28:19.057373 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4a802a23-7000-4e91-ab76-7cbd0493e00d tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.821863 Aug 31 16:28:19.063615 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2913/5795] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:28:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 2829 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 16:28:19.079536 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-223c1c24-5ac9-4ac1-ab10-d8c6faae801b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:19.084248 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-223c1c24-5ac9-4ac1-ab10-d8c6faae801b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:19.102126 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-223c1c24-5ac9-4ac1-ab10-d8c6faae801b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:19.103338 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-223c1c24-5ac9-4ac1-ab10-d8c6faae801b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:19.104044 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-223c1c24-5ac9-4ac1-ab10-d8c6faae801b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:19.105999 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-223c1c24-5ac9-4ac1-ab10-d8c6faae801b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:19.106747 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-223c1c24-5ac9-4ac1-ab10-d8c6faae801b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:19.107685 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-223c1c24-5ac9-4ac1-ab10-d8c6faae801b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:19.263726 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d74488c7-b26b-4f5a-a36e-9890e9ccef95 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 3.614910 Aug 31 16:28:19.278365 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2883/5796] 10.222.0.61 () {62 vars in 1188 bytes} [Wed Aug 31 16:28:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 3631 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 31 16:28:19.287474 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-054f9d04-033b-4d0f-a097-8c462f1492de req-82cd4366-7d6c-4f2f-800d-4f8c0f2270d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42ccbb85-9677-4cb9-879a-dc280cda020c", "name": "network-vif-deleted", "tag": "44b19fab-a1b0-47af-8c78-4bab130a016b"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:28:19.334611 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-223c1c24-5ac9-4ac1-ab10-d8c6faae801b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:19.337119 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-223c1c24-5ac9-4ac1-ab10-d8c6faae801b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:19.339224 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-054f9d04-033b-4d0f-a097-8c462f1492de req-82cd4366-7d6c-4f2f-800d-4f8c0f2270d4 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:19.339720 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-223c1c24-5ac9-4ac1-ab10-d8c6faae801b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:19.339852 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-054f9d04-033b-4d0f-a097-8c462f1492de req-82cd4366-7d6c-4f2f-800d-4f8c0f2270d4 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:19.340166 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-054f9d04-033b-4d0f-a097-8c462f1492de req-82cd4366-7d6c-4f2f-800d-4f8c0f2270d4 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:19.343248 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-223c1c24-5ac9-4ac1-ab10-d8c6faae801b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lazy-loading 'fault' on Instance uuid 42ccbb85-9677-4cb9-879a-dc280cda020c {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:28:19.393699 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-054f9d04-033b-4d0f-a097-8c462f1492de req-82cd4366-7d6c-4f2f-800d-4f8c0f2270d4 service nova] Creating event network-vif-deleted:44b19fab-a1b0-47af-8c78-4bab130a016b for instance 42ccbb85-9677-4cb9-879a-dc280cda020c on n-h2-850499-9 Aug 31 16:28:19.424227 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-054f9d04-033b-4d0f-a097-8c462f1492de req-82cd4366-7d6c-4f2f-800d-4f8c0f2270d4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143738 Aug 31 16:28:19.439673 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2884/5797] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:28:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:28:19.449883 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8532b5e2-f521-489a-9224-13af0f0a60d8 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:19.480944 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8532b5e2-f521-489a-9224-13af0f0a60d8 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] [instance: 8d537fe8-d6d8-4858-a2d0-596abd805ac9] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:19.662710 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-223c1c24-5ac9-4ac1-ab10-d8c6faae801b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a105ab564f304fa7a2ceba07418a22bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fa87d9431f4253b8425593a2150359', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:19.703884 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-223c1c24-5ac9-4ac1-ab10-d8c6faae801b tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 200 len: 1328 microversion: 2.1 time: 0.634938 Aug 31 16:28:19.708136 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2914/5798] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:28:19 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 1328 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:28:19.761711 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-50e0db47-adcc-4480-b7df-c2d5c3c841d0 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:19.790768 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-50e0db47-adcc-4480-b7df-c2d5c3c841d0 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] [instance: 1b38884c-e9e3-4a03-98d7-e687429cd132] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:19.862364 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8532b5e2-f521-489a-9224-13af0f0a60d8 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc4d613cdc94357b40e83a2b70b0bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb6a0a8643748b9830f2859de6d8b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:19.886977 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8532b5e2-f521-489a-9224-13af0f0a60d8 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] 10.222.0.61 "GET /compute/v2.1/servers/8d537fe8-d6d8-4858-a2d0-596abd805ac9" status: 200 len: 1214 microversion: 2.1 time: 0.444947 Aug 31 16:28:19.889308 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2885/5799] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:28:19 2022] GET /compute/v2.1/servers/8d537fe8-d6d8-4858-a2d0-596abd805ac9 => generated 1214 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:28:20.023789 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-50e0db47-adcc-4480-b7df-c2d5c3c841d0 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96a6b97c3c458a88ebc013157332ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d753dee849a4318a4711fa5e4791e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:20.048546 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-50e0db47-adcc-4480-b7df-c2d5c3c841d0 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc96a6b97c3c458a88ebc013157332ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d753dee849a4318a4711fa5e4791e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:20.050113 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-50e0db47-adcc-4480-b7df-c2d5c3c841d0 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc96a6b97c3c458a88ebc013157332ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d753dee849a4318a4711fa5e4791e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:20.063918 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-50e0db47-adcc-4480-b7df-c2d5c3c841d0 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] 10.222.0.61 "GET /compute/v2.1/servers/1b38884c-e9e3-4a03-98d7-e687429cd132" status: 200 len: 1262 microversion: 2.26 time: 0.348590 Aug 31 16:28:20.064514 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2915/5800] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:28:19 2022] GET /compute/v2.1/servers/1b38884c-e9e3-4a03-98d7-e687429cd132 => generated 1262 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:28:20.757343 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d45d5ce6-4fcc-4c3f-af2e-61cc3dc61b3e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:20.760796 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d45d5ce6-4fcc-4c3f-af2e-61cc3dc61b3e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] [instance: 42ccbb85-9677-4cb9-879a-dc280cda020c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:20.833006 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d45d5ce6-4fcc-4c3f-af2e-61cc3dc61b3e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:20.838297 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d45d5ce6-4fcc-4c3f-af2e-61cc3dc61b3e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:20.857669 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d45d5ce6-4fcc-4c3f-af2e-61cc3dc61b3e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:20.863956 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d45d5ce6-4fcc-4c3f-af2e-61cc3dc61b3e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:20.876390 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d45d5ce6-4fcc-4c3f-af2e-61cc3dc61b3e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:20.878802 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d45d5ce6-4fcc-4c3f-af2e-61cc3dc61b3e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:20.922432 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c9de0cad-7562-4db7-9432-6617de25cf56 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:20.931001 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c9de0cad-7562-4db7-9432-6617de25cf56 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] [instance: 8d537fe8-d6d8-4858-a2d0-596abd805ac9] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:20.940189 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-d45d5ce6-4fcc-4c3f-af2e-61cc3dc61b3e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] HTTP exception thrown: Instance 42ccbb85-9677-4cb9-879a-dc280cda020c could not be found. Aug 31 16:28:20.946753 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d45d5ce6-4fcc-4c3f-af2e-61cc3dc61b3e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Request method failure captured: Aug 31 16:28:20.946753 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c HTTP/1.1 Aug 31 16:28:20.946753 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:28:20.946753 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:28:20.946753 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:28:20.946753 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:28:20.946753 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:28:20.946753 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:28:20.946753 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:28:20.946753 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:28:20.946753 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4j4GoXu7a8XS8mokW4AeC842NZnj-uoRrLPe-ymerVUxYrezcAXYukQXkT8IqkMd2mshHtGlo5ORTm-xBrHOK9WFT9PPtSJjPDhKzFxYnOsxBAuHO1I5hUh0kdjx0f_1YsWDM7F8Lwt5dwXM7gNYQ4IaAaTeuNJuCJE3SFroPGrfPQ Aug 31 16:28:20.946753 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:28:20.946753 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:28:20.946753 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:28:20.946753 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:28:20.946753 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:28:20.946753 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:28:20.946753 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: f8fa87d9431f4253b8425593a2150359 Aug 31 16:28:20.946753 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ServerActionsTestJSON-1302460756 Aug 31 16:28:20.946753 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:28:20.946753 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:28:20.946753 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f8fa87d9431f4253b8425593a2150359"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f8fa87d9431f4253b8425593a2150359"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f8fa87d9431f4253b8425593a2150359", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f8fa87d9431f4253b8425593a2150359"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:28:20.946753 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ServerActionsTestJSON-1302460756 Aug 31 16:28:20.946753 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: f8fa87d9431f4253b8425593a2150359 Aug 31 16:28:20.946753 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ServerActionsTestJSON-1302460756 Aug 31 16:28:20.946753 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ServerActionsTestJSON-1302460756-project Aug 31 16:28:20.946753 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:28:20.946753 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:28:20.946753 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: a105ab564f304fa7a2ceba07418a22bc Aug 31 16:28:20.946753 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ServerActionsTestJSON-1302460756-project Aug 31 16:28:20.946753 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:28:20.946753 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance 42ccbb85-9677-4cb9-879a-dc280cda020c could not be found. Aug 31 16:28:20.946753 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '42ccbb85-9677-4cb9-879a-dc280cda020c'} Aug 31 16:28:20.946753 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:28:20.946753 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:28:20.946753 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:28:20.946753 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:28:20.946753 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:28:20.946753 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:28:20.946753 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:28:20.946753 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:28:20.946753 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:28:20.946753 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:28:20.946753 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42ccbb85-9677-4cb9-879a-dc280cda020c could not be found. Aug 31 16:28:20.946753 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:28:20.946753 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:28:20.946753 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:28:20.946753 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:28:20.946753 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:28:20.946753 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:28:20.946753 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:28:20.946753 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:28:20.946753 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:28:20.946753 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:28:20.946753 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:28:20.946753 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:28:20.946753 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:28:20.946753 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:28:20.946753 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:28:20.946753 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:28:20.946753 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42ccbb85-9677-4cb9-879a-dc280cda020c could not be found. Aug 31 16:28:20.946753 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:28:20.946753 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:28:20.946753 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:28:20.954111 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:28:20.954111 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:28:20.954111 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:28:20.954111 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:28:20.954111 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:28:20.954111 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42ccbb85-9677-4cb9-879a-dc280cda020c could not be found. Aug 31 16:28:20.954111 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:28:20.954111 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d45d5ce6-4fcc-4c3f-af2e-61cc3dc61b3e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Returning 404 to user: Instance 42ccbb85-9677-4cb9-879a-dc280cda020c could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:28:20.954111 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d45d5ce6-4fcc-4c3f-af2e-61cc3dc61b3e tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c" status: 404 len: 111 microversion: 2.1 time: 0.207205 Aug 31 16:28:20.954111 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2886/5801] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:28:20 2022] GET /compute/v2.1/servers/42ccbb85-9677-4cb9-879a-dc280cda020c => generated 111 bytes in 213 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:28:20.968618 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-389fad26-ec75-447c-ac80-50832e184a9d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] Calling method '.version_select at 0x7f5ae8247160>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:21.051471 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-389fad26-ec75-447c-ac80-50832e184a9d tempest-ServerActionsTestJSON-1302460756 tempest-ServerActionsTestJSON-1302460756-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1037646336" status: 202 len: 0 microversion: 2.1 time: 0.094409 Aug 31 16:28:21.058225 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2887/5802] 10.222.0.61 () {58 vars in 1221 bytes} [Wed Aug 31 16:28:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1037646336 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:28:21.120311 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c17c8b22-356e-4ee9-bfc9-f61a8ad37025 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:21.122543 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c17c8b22-356e-4ee9-bfc9-f61a8ad37025 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] [instance: 1b38884c-e9e3-4a03-98d7-e687429cd132] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:21.309069 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c9de0cad-7562-4db7-9432-6617de25cf56 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc4d613cdc94357b40e83a2b70b0bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb6a0a8643748b9830f2859de6d8b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:21.338389 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c9de0cad-7562-4db7-9432-6617de25cf56 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] 10.222.0.61 "GET /compute/v2.1/servers/8d537fe8-d6d8-4858-a2d0-596abd805ac9" status: 200 len: 1214 microversion: 2.1 time: 0.422618 Aug 31 16:28:21.345100 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2916/5803] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:28:20 2022] GET /compute/v2.1/servers/8d537fe8-d6d8-4858-a2d0-596abd805ac9 => generated 1214 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:28:22.382077 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-828bc137-087e-4a81-8e22-a37eb903ae1b tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:22.384372 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-828bc137-087e-4a81-8e22-a37eb903ae1b tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] [instance: 8d537fe8-d6d8-4858-a2d0-596abd805ac9] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:22.420052 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-828bc137-087e-4a81-8e22-a37eb903ae1b tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:22.421038 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-828bc137-087e-4a81-8e22-a37eb903ae1b tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:22.421707 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-828bc137-087e-4a81-8e22-a37eb903ae1b tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:22.422791 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-828bc137-087e-4a81-8e22-a37eb903ae1b tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:22.423590 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-828bc137-087e-4a81-8e22-a37eb903ae1b tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:22.424259 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-828bc137-087e-4a81-8e22-a37eb903ae1b tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:22.722496 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c17c8b22-356e-4ee9-bfc9-f61a8ad37025 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96a6b97c3c458a88ebc013157332ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d753dee849a4318a4711fa5e4791e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:22.759257 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c17c8b22-356e-4ee9-bfc9-f61a8ad37025 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc96a6b97c3c458a88ebc013157332ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d753dee849a4318a4711fa5e4791e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:22.769129 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c17c8b22-356e-4ee9-bfc9-f61a8ad37025 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc96a6b97c3c458a88ebc013157332ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d753dee849a4318a4711fa5e4791e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:22.772618 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c17c8b22-356e-4ee9-bfc9-f61a8ad37025 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] 10.222.0.61 "GET /compute/v2.1/servers/1b38884c-e9e3-4a03-98d7-e687429cd132" status: 200 len: 1262 microversion: 2.26 time: 1.656659 Aug 31 16:28:22.777498 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2888/5804] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:28:21 2022] GET /compute/v2.1/servers/1b38884c-e9e3-4a03-98d7-e687429cd132 => generated 1262 bytes in 1664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:28:23.163141 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-828bc137-087e-4a81-8e22-a37eb903ae1b tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc4d613cdc94357b40e83a2b70b0bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb6a0a8643748b9830f2859de6d8b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:23.187090 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-828bc137-087e-4a81-8e22-a37eb903ae1b tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] 10.222.0.61 "GET /compute/v2.1/servers/8d537fe8-d6d8-4858-a2d0-596abd805ac9" status: 200 len: 1266 microversion: 2.1 time: 0.817021 Aug 31 16:28:23.194144 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2917/5805] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:28:22 2022] GET /compute/v2.1/servers/8d537fe8-d6d8-4858-a2d0-596abd805ac9 => generated 1266 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:28:23.818280 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c13483b2-ec65-4944-af5a-c821ce6795bd tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:23.819771 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c13483b2-ec65-4944-af5a-c821ce6795bd tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] [instance: 1b38884c-e9e3-4a03-98d7-e687429cd132] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:23.847300 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c13483b2-ec65-4944-af5a-c821ce6795bd tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:23.847887 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c13483b2-ec65-4944-af5a-c821ce6795bd tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:23.848365 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c13483b2-ec65-4944-af5a-c821ce6795bd tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:23.849181 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c13483b2-ec65-4944-af5a-c821ce6795bd tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:23.849684 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c13483b2-ec65-4944-af5a-c821ce6795bd tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:23.850178 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c13483b2-ec65-4944-af5a-c821ce6795bd tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:24.082976 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c13483b2-ec65-4944-af5a-c821ce6795bd tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96a6b97c3c458a88ebc013157332ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d753dee849a4318a4711fa5e4791e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:24.086866 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:UPDATE=6,nova_cell1:DELETE=2,nova_cell1:SELECT=67,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:28:24.109260 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c13483b2-ec65-4944-af5a-c821ce6795bd tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc96a6b97c3c458a88ebc013157332ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d753dee849a4318a4711fa5e4791e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:24.111443 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c13483b2-ec65-4944-af5a-c821ce6795bd tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc96a6b97c3c458a88ebc013157332ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d753dee849a4318a4711fa5e4791e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:24.125741 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c13483b2-ec65-4944-af5a-c821ce6795bd tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] 10.222.0.61 "GET /compute/v2.1/servers/1b38884c-e9e3-4a03-98d7-e687429cd132" status: 200 len: 1320 microversion: 2.26 time: 0.316791 Aug 31 16:28:24.126956 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2889/5806] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:28:23 2022] GET /compute/v2.1/servers/1b38884c-e9e3-4a03-98d7-e687429cd132 => generated 1320 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:28:24.228550 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-05a9a671-9393-479b-ac4c-fec49e4893f9 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:24.229319 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-05a9a671-9393-479b-ac4c-fec49e4893f9 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] [instance: 8d537fe8-d6d8-4858-a2d0-596abd805ac9] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:24.245357 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:28:24.247436 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-05a9a671-9393-479b-ac4c-fec49e4893f9 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:24.248503 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-05a9a671-9393-479b-ac4c-fec49e4893f9 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:24.249285 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-05a9a671-9393-479b-ac4c-fec49e4893f9 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:24.250518 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-05a9a671-9393-479b-ac4c-fec49e4893f9 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:24.251881 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-05a9a671-9393-479b-ac4c-fec49e4893f9 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:24.252545 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-05a9a671-9393-479b-ac4c-fec49e4893f9 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:24.657310 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-05a9a671-9393-479b-ac4c-fec49e4893f9 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc4d613cdc94357b40e83a2b70b0bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb6a0a8643748b9830f2859de6d8b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:24.672939 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-05a9a671-9393-479b-ac4c-fec49e4893f9 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] 10.222.0.61 "GET /compute/v2.1/servers/8d537fe8-d6d8-4858-a2d0-596abd805ac9" status: 200 len: 1272 microversion: 2.1 time: 0.451105 Aug 31 16:28:24.688726 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2918/5807] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:28:24 2022] GET /compute/v2.1/servers/8d537fe8-d6d8-4858-a2d0-596abd805ac9 => generated 1272 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:28:25.173795 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-42a22c90-604e-4973-9f8f-f523f6578e14 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:25.175176 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-42a22c90-604e-4973-9f8f-f523f6578e14 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] [instance: 1b38884c-e9e3-4a03-98d7-e687429cd132] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:25.213762 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42a22c90-604e-4973-9f8f-f523f6578e14 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:25.215234 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42a22c90-604e-4973-9f8f-f523f6578e14 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:25.218473 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42a22c90-604e-4973-9f8f-f523f6578e14 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:25.221081 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42a22c90-604e-4973-9f8f-f523f6578e14 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:25.225520 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42a22c90-604e-4973-9f8f-f523f6578e14 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:25.228029 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42a22c90-604e-4973-9f8f-f523f6578e14 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:25.499600 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-42a22c90-604e-4973-9f8f-f523f6578e14 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96a6b97c3c458a88ebc013157332ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d753dee849a4318a4711fa5e4791e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:25.514176 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-42a22c90-604e-4973-9f8f-f523f6578e14 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc96a6b97c3c458a88ebc013157332ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d753dee849a4318a4711fa5e4791e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:25.515964 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-42a22c90-604e-4973-9f8f-f523f6578e14 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc96a6b97c3c458a88ebc013157332ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d753dee849a4318a4711fa5e4791e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:25.517499 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-42a22c90-604e-4973-9f8f-f523f6578e14 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] 10.222.0.61 "GET /compute/v2.1/servers/1b38884c-e9e3-4a03-98d7-e687429cd132" status: 200 len: 1320 microversion: 2.26 time: 0.359670 Aug 31 16:28:25.518579 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2890/5808] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:28:25 2022] GET /compute/v2.1/servers/1b38884c-e9e3-4a03-98d7-e687429cd132 => generated 1320 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:28:25.695417 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-21368dc0-bef4-4b3f-998a-e2e0233d31ca tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:25.696699 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-21368dc0-bef4-4b3f-998a-e2e0233d31ca tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] [instance: 8d537fe8-d6d8-4858-a2d0-596abd805ac9] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:25.713047 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-21368dc0-bef4-4b3f-998a-e2e0233d31ca tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:25.713799 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-21368dc0-bef4-4b3f-998a-e2e0233d31ca tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:25.714401 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-21368dc0-bef4-4b3f-998a-e2e0233d31ca tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:25.715286 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-21368dc0-bef4-4b3f-998a-e2e0233d31ca tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:25.715966 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-21368dc0-bef4-4b3f-998a-e2e0233d31ca tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:25.716556 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-21368dc0-bef4-4b3f-998a-e2e0233d31ca tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:26.018065 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-21368dc0-bef4-4b3f-998a-e2e0233d31ca tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc4d613cdc94357b40e83a2b70b0bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb6a0a8643748b9830f2859de6d8b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:26.028703 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-21368dc0-bef4-4b3f-998a-e2e0233d31ca tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] 10.222.0.61 "GET /compute/v2.1/servers/8d537fe8-d6d8-4858-a2d0-596abd805ac9" status: 200 len: 1272 microversion: 2.1 time: 0.336929 Aug 31 16:28:26.028703 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2919/5809] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:28:25 2022] GET /compute/v2.1/servers/8d537fe8-d6d8-4858-a2d0-596abd805ac9 => generated 1272 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:28:26.557396 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e83d82f0-d320-42b5-87e1-5fb4a0e2035e tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:26.558371 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e83d82f0-d320-42b5-87e1-5fb4a0e2035e tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] [instance: 1b38884c-e9e3-4a03-98d7-e687429cd132] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:26.580911 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e83d82f0-d320-42b5-87e1-5fb4a0e2035e tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:26.582203 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e83d82f0-d320-42b5-87e1-5fb4a0e2035e tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:26.584777 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e83d82f0-d320-42b5-87e1-5fb4a0e2035e tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:26.587384 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e83d82f0-d320-42b5-87e1-5fb4a0e2035e tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:26.597916 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e83d82f0-d320-42b5-87e1-5fb4a0e2035e tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:26.598573 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e83d82f0-d320-42b5-87e1-5fb4a0e2035e tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:27.055690 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-fbf2bc58-5dc4-4533-90c2-7dc462aae64d tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:27.056503 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-fbf2bc58-5dc4-4533-90c2-7dc462aae64d tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] [instance: 8d537fe8-d6d8-4858-a2d0-596abd805ac9] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:27.065630 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fbf2bc58-5dc4-4533-90c2-7dc462aae64d tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:27.067153 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fbf2bc58-5dc4-4533-90c2-7dc462aae64d tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:27.068127 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fbf2bc58-5dc4-4533-90c2-7dc462aae64d tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:27.072649 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fbf2bc58-5dc4-4533-90c2-7dc462aae64d tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:27.073756 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fbf2bc58-5dc4-4533-90c2-7dc462aae64d tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:27.074555 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fbf2bc58-5dc4-4533-90c2-7dc462aae64d tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:27.496642 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e83d82f0-d320-42b5-87e1-5fb4a0e2035e tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96a6b97c3c458a88ebc013157332ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d753dee849a4318a4711fa5e4791e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:27.519452 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e83d82f0-d320-42b5-87e1-5fb4a0e2035e tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc96a6b97c3c458a88ebc013157332ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d753dee849a4318a4711fa5e4791e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:27.521849 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e83d82f0-d320-42b5-87e1-5fb4a0e2035e tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc96a6b97c3c458a88ebc013157332ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d753dee849a4318a4711fa5e4791e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:27.524231 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e83d82f0-d320-42b5-87e1-5fb4a0e2035e tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] 10.222.0.61 "GET /compute/v2.1/servers/1b38884c-e9e3-4a03-98d7-e687429cd132" status: 200 len: 1362 microversion: 2.26 time: 0.977714 Aug 31 16:28:27.540463 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2891/5810] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:28:26 2022] GET /compute/v2.1/servers/1b38884c-e9e3-4a03-98d7-e687429cd132 => generated 1362 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:28:27.778035 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-fbf2bc58-5dc4-4533-90c2-7dc462aae64d tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc4d613cdc94357b40e83a2b70b0bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb6a0a8643748b9830f2859de6d8b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:27.809989 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-fbf2bc58-5dc4-4533-90c2-7dc462aae64d tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] 10.222.0.61 "GET /compute/v2.1/servers/8d537fe8-d6d8-4858-a2d0-596abd805ac9" status: 200 len: 1314 microversion: 2.1 time: 0.759570 Aug 31 16:28:27.811215 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2920/5811] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:28:27 2022] GET /compute/v2.1/servers/8d537fe8-d6d8-4858-a2d0-596abd805ac9 => generated 1314 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:28:28.351652 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-ae8e0a33-7e7c-47e3-927b-b88ad3ce0338 req-26cd50e4-5cc5-4d46-b88e-3d373fd4f439 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d537fe8-d6d8-4858-a2d0-596abd805ac9", "tag": "d9c91791-1248-49d0-b64b-f8552bf6ef73"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:28:28.405384 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-ae8e0a33-7e7c-47e3-927b-b88ad3ce0338 req-26cd50e4-5cc5-4d46-b88e-3d373fd4f439 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:28.417315 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-ae8e0a33-7e7c-47e3-927b-b88ad3ce0338 req-26cd50e4-5cc5-4d46-b88e-3d373fd4f439 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:28.421833 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-ae8e0a33-7e7c-47e3-927b-b88ad3ce0338 req-26cd50e4-5cc5-4d46-b88e-3d373fd4f439 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:28.457933 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-ae8e0a33-7e7c-47e3-927b-b88ad3ce0338 req-26cd50e4-5cc5-4d46-b88e-3d373fd4f439 service nova] Creating event network-changed:d9c91791-1248-49d0-b64b-f8552bf6ef73 for instance 8d537fe8-d6d8-4858-a2d0-596abd805ac9 on n-h1-850499-9 Aug 31 16:28:28.471937 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-ae8e0a33-7e7c-47e3-927b-b88ad3ce0338 req-26cd50e4-5cc5-4d46-b88e-3d373fd4f439 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126567 Aug 31 16:28:28.472575 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2892/5812] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:28:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:28:28.569151 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-72408f96-77f5-4051-834b-301c667ed9a3 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:28.577644 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-72408f96-77f5-4051-834b-301c667ed9a3 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] [instance: 1b38884c-e9e3-4a03-98d7-e687429cd132] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:28.603326 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-72408f96-77f5-4051-834b-301c667ed9a3 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:28.603885 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-72408f96-77f5-4051-834b-301c667ed9a3 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:28.604333 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-72408f96-77f5-4051-834b-301c667ed9a3 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:28.605062 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-72408f96-77f5-4051-834b-301c667ed9a3 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:28.605521 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-72408f96-77f5-4051-834b-301c667ed9a3 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:28.605959 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-72408f96-77f5-4051-834b-301c667ed9a3 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:28.829609 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:28:28.836893 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2a2b4bc9-7954-4e46-aefb-871a7fcb2d3a tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:28.837906 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2a2b4bc9-7954-4e46-aefb-871a7fcb2d3a tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] [instance: 8d537fe8-d6d8-4858-a2d0-596abd805ac9] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:28.856820 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2a2b4bc9-7954-4e46-aefb-871a7fcb2d3a tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:28.857787 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2a2b4bc9-7954-4e46-aefb-871a7fcb2d3a tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:28.858419 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2a2b4bc9-7954-4e46-aefb-871a7fcb2d3a tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:28.859538 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2a2b4bc9-7954-4e46-aefb-871a7fcb2d3a tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:28.860186 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2a2b4bc9-7954-4e46-aefb-871a7fcb2d3a tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:28.860768 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2a2b4bc9-7954-4e46-aefb-871a7fcb2d3a tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:28.934299 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:28:29.401809 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-72408f96-77f5-4051-834b-301c667ed9a3 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96a6b97c3c458a88ebc013157332ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d753dee849a4318a4711fa5e4791e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:29.442061 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-72408f96-77f5-4051-834b-301c667ed9a3 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc96a6b97c3c458a88ebc013157332ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d753dee849a4318a4711fa5e4791e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:29.449469 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-72408f96-77f5-4051-834b-301c667ed9a3 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc96a6b97c3c458a88ebc013157332ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d753dee849a4318a4711fa5e4791e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:29.453470 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-72408f96-77f5-4051-834b-301c667ed9a3 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] 10.222.0.61 "GET /compute/v2.1/servers/1b38884c-e9e3-4a03-98d7-e687429cd132" status: 200 len: 1362 microversion: 2.26 time: 0.890811 Aug 31 16:28:29.456252 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2921/5813] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:28:28 2022] GET /compute/v2.1/servers/1b38884c-e9e3-4a03-98d7-e687429cd132 => generated 1362 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:28:29.461281 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-2a2b4bc9-7954-4e46-aefb-871a7fcb2d3a tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc4d613cdc94357b40e83a2b70b0bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb6a0a8643748b9830f2859de6d8b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:29.474180 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-aaca954a-850d-4145-b2f0-497d2b64af08 req-8d52ec74-832c-4299-83e7-1e9c0c3a0372 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b38884c-e9e3-4a03-98d7-e687429cd132", "tag": "066cd027-ed89-4e4f-9c18-438760e9427e"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:28:29.477114 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2a2b4bc9-7954-4e46-aefb-871a7fcb2d3a tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] 10.222.0.61 "GET /compute/v2.1/servers/8d537fe8-d6d8-4858-a2d0-596abd805ac9" status: 200 len: 1314 microversion: 2.1 time: 0.645535 Aug 31 16:28:29.492110 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2893/5814] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:28:28 2022] GET /compute/v2.1/servers/8d537fe8-d6d8-4858-a2d0-596abd805ac9 => generated 1314 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:28:29.505046 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-aaca954a-850d-4145-b2f0-497d2b64af08 req-8d52ec74-832c-4299-83e7-1e9c0c3a0372 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:29.505562 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-aaca954a-850d-4145-b2f0-497d2b64af08 req-8d52ec74-832c-4299-83e7-1e9c0c3a0372 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:29.508733 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-aaca954a-850d-4145-b2f0-497d2b64af08 req-8d52ec74-832c-4299-83e7-1e9c0c3a0372 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:29.552196 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-aaca954a-850d-4145-b2f0-497d2b64af08 req-8d52ec74-832c-4299-83e7-1e9c0c3a0372 service nova] Creating event network-changed:066cd027-ed89-4e4f-9c18-438760e9427e for instance 1b38884c-e9e3-4a03-98d7-e687429cd132 on n-h1-850499-9 Aug 31 16:28:29.565127 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-aaca954a-850d-4145-b2f0-497d2b64af08 req-8d52ec74-832c-4299-83e7-1e9c0c3a0372 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107154 Aug 31 16:28:29.566986 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2922/5815] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:28:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:28:30.487359 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-aaef9387-2ca4-470a-89b6-e78e1aea0645 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:30.488070 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-aaef9387-2ca4-470a-89b6-e78e1aea0645 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] [instance: 1b38884c-e9e3-4a03-98d7-e687429cd132] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:30.497804 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aaef9387-2ca4-470a-89b6-e78e1aea0645 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:30.500631 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aaef9387-2ca4-470a-89b6-e78e1aea0645 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:30.501303 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aaef9387-2ca4-470a-89b6-e78e1aea0645 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:30.502210 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aaef9387-2ca4-470a-89b6-e78e1aea0645 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:30.502867 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aaef9387-2ca4-470a-89b6-e78e1aea0645 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:30.504014 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aaef9387-2ca4-470a-89b6-e78e1aea0645 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:30.526967 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c5ab47ed-7b6c-4921-8111-40d610966513 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:30.533889 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c5ab47ed-7b6c-4921-8111-40d610966513 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] [instance: 8d537fe8-d6d8-4858-a2d0-596abd805ac9] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:30.582496 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c5ab47ed-7b6c-4921-8111-40d610966513 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:30.588047 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c5ab47ed-7b6c-4921-8111-40d610966513 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:30.588708 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c5ab47ed-7b6c-4921-8111-40d610966513 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:30.596552 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c5ab47ed-7b6c-4921-8111-40d610966513 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:30.597418 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c5ab47ed-7b6c-4921-8111-40d610966513 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:30.598080 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c5ab47ed-7b6c-4921-8111-40d610966513 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:31.101206 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-aaef9387-2ca4-470a-89b6-e78e1aea0645 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96a6b97c3c458a88ebc013157332ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d753dee849a4318a4711fa5e4791e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:31.122491 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-aaef9387-2ca4-470a-89b6-e78e1aea0645 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc96a6b97c3c458a88ebc013157332ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d753dee849a4318a4711fa5e4791e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:31.124504 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-aaef9387-2ca4-470a-89b6-e78e1aea0645 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc96a6b97c3c458a88ebc013157332ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d753dee849a4318a4711fa5e4791e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:31.125934 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-aaef9387-2ca4-470a-89b6-e78e1aea0645 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] 10.222.0.61 "GET /compute/v2.1/servers/1b38884c-e9e3-4a03-98d7-e687429cd132" status: 200 len: 1362 microversion: 2.26 time: 0.646617 Aug 31 16:28:31.136354 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2894/5816] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:28:30 2022] GET /compute/v2.1/servers/1b38884c-e9e3-4a03-98d7-e687429cd132 => generated 1362 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:28:31.166158 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c5ab47ed-7b6c-4921-8111-40d610966513 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc4d613cdc94357b40e83a2b70b0bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb6a0a8643748b9830f2859de6d8b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:31.184514 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c5ab47ed-7b6c-4921-8111-40d610966513 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] 10.222.0.61 "GET /compute/v2.1/servers/8d537fe8-d6d8-4858-a2d0-596abd805ac9" status: 200 len: 1314 microversion: 2.1 time: 0.682580 Aug 31 16:28:31.188722 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2923/5817] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:28:30 2022] GET /compute/v2.1/servers/8d537fe8-d6d8-4858-a2d0-596abd805ac9 => generated 1314 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:28:31.372668 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b1d94e40-251e-4e19-af26-6899152c4390 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:31.373526 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b1d94e40-251e-4e19-af26-6899152c4390 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: b31fb01b-045f-41f7-bf58-66c1eca839e8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:31.388785 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b1d94e40-251e-4e19-af26-6899152c4390 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:31.389527 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b1d94e40-251e-4e19-af26-6899152c4390 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:31.390164 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b1d94e40-251e-4e19-af26-6899152c4390 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:31.391050 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b1d94e40-251e-4e19-af26-6899152c4390 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:31.391695 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b1d94e40-251e-4e19-af26-6899152c4390 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:31.392270 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b1d94e40-251e-4e19-af26-6899152c4390 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:31.451052 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b1d94e40-251e-4e19-af26-6899152c4390 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8/ips" status: 200 len: 152 microversion: 2.20 time: 0.082455 Aug 31 16:28:31.473878 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2895/5818] 10.222.0.61 () {60 vars in 1289 bytes} [Wed Aug 31 16:28:31 2022] GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8/ips => generated 152 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 16:28:32.164001 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-920e9b89-25cb-48b9-ad22-ff70f3825c14 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:32.165794 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-920e9b89-25cb-48b9-ad22-ff70f3825c14 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] [instance: 1b38884c-e9e3-4a03-98d7-e687429cd132] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:32.176048 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=10 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:28:32.208275 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-920e9b89-25cb-48b9-ad22-ff70f3825c14 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:32.212320 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-920e9b89-25cb-48b9-ad22-ff70f3825c14 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:32.213709 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-39c67da3-e46a-4264-8c3f-77683836642b tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:32.216888 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-39c67da3-e46a-4264-8c3f-77683836642b tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] [instance: 8d537fe8-d6d8-4858-a2d0-596abd805ac9] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:32.221679 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-920e9b89-25cb-48b9-ad22-ff70f3825c14 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:32.222444 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-920e9b89-25cb-48b9-ad22-ff70f3825c14 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:32.223027 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-920e9b89-25cb-48b9-ad22-ff70f3825c14 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:32.223689 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-920e9b89-25cb-48b9-ad22-ff70f3825c14 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:32.253479 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-39c67da3-e46a-4264-8c3f-77683836642b tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:32.255179 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-39c67da3-e46a-4264-8c3f-77683836642b tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:32.264965 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-39c67da3-e46a-4264-8c3f-77683836642b tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:32.267459 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-39c67da3-e46a-4264-8c3f-77683836642b tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:32.268808 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-39c67da3-e46a-4264-8c3f-77683836642b tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:32.269838 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-39c67da3-e46a-4264-8c3f-77683836642b tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:32.746898 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=10 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:28:32.952554 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-920e9b89-25cb-48b9-ad22-ff70f3825c14 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96a6b97c3c458a88ebc013157332ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d753dee849a4318a4711fa5e4791e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:32.965580 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-920e9b89-25cb-48b9-ad22-ff70f3825c14 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc96a6b97c3c458a88ebc013157332ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d753dee849a4318a4711fa5e4791e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:32.966998 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-920e9b89-25cb-48b9-ad22-ff70f3825c14 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc96a6b97c3c458a88ebc013157332ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d753dee849a4318a4711fa5e4791e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:32.968206 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-920e9b89-25cb-48b9-ad22-ff70f3825c14 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] 10.222.0.61 "GET /compute/v2.1/servers/1b38884c-e9e3-4a03-98d7-e687429cd132" status: 200 len: 1362 microversion: 2.26 time: 0.809986 Aug 31 16:28:32.979554 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2924/5819] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:28:32 2022] GET /compute/v2.1/servers/1b38884c-e9e3-4a03-98d7-e687429cd132 => generated 1362 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:28:33.052151 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-39c67da3-e46a-4264-8c3f-77683836642b tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc4d613cdc94357b40e83a2b70b0bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb6a0a8643748b9830f2859de6d8b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:33.067722 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-39c67da3-e46a-4264-8c3f-77683836642b tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] 10.222.0.61 "GET /compute/v2.1/servers/8d537fe8-d6d8-4858-a2d0-596abd805ac9" status: 200 len: 1314 microversion: 2.1 time: 0.860228 Aug 31 16:28:33.071352 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2896/5820] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:28:32 2022] GET /compute/v2.1/servers/8d537fe8-d6d8-4858-a2d0-596abd805ac9 => generated 1314 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:28:34.009917 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-626276f4-99b7-43fd-bb4f-00d8441bec16 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:34.011241 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-626276f4-99b7-43fd-bb4f-00d8441bec16 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] [instance: 1b38884c-e9e3-4a03-98d7-e687429cd132] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:34.028419 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-626276f4-99b7-43fd-bb4f-00d8441bec16 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:34.029335 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-626276f4-99b7-43fd-bb4f-00d8441bec16 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:34.029991 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-626276f4-99b7-43fd-bb4f-00d8441bec16 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:34.030932 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-626276f4-99b7-43fd-bb4f-00d8441bec16 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:34.033958 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-626276f4-99b7-43fd-bb4f-00d8441bec16 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:34.034923 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-626276f4-99b7-43fd-bb4f-00d8441bec16 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:34.104325 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a7b9f0e4-a89b-488d-98fa-9ea6624bf298 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:34.105392 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a7b9f0e4-a89b-488d-98fa-9ea6624bf298 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] [instance: 8d537fe8-d6d8-4858-a2d0-596abd805ac9] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:34.138773 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a7b9f0e4-a89b-488d-98fa-9ea6624bf298 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:34.144168 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a7b9f0e4-a89b-488d-98fa-9ea6624bf298 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:34.145082 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a7b9f0e4-a89b-488d-98fa-9ea6624bf298 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:34.146302 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a7b9f0e4-a89b-488d-98fa-9ea6624bf298 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:34.147125 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a7b9f0e4-a89b-488d-98fa-9ea6624bf298 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:34.156206 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a7b9f0e4-a89b-488d-98fa-9ea6624bf298 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:34.603666 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-626276f4-99b7-43fd-bb4f-00d8441bec16 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96a6b97c3c458a88ebc013157332ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d753dee849a4318a4711fa5e4791e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:34.643097 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a7b9f0e4-a89b-488d-98fa-9ea6624bf298 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc4d613cdc94357b40e83a2b70b0bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb6a0a8643748b9830f2859de6d8b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:34.668619 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-626276f4-99b7-43fd-bb4f-00d8441bec16 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc96a6b97c3c458a88ebc013157332ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d753dee849a4318a4711fa5e4791e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:34.680994 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a7b9f0e4-a89b-488d-98fa-9ea6624bf298 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] 10.222.0.61 "GET /compute/v2.1/servers/8d537fe8-d6d8-4858-a2d0-596abd805ac9" status: 200 len: 1314 microversion: 2.1 time: 0.582705 Aug 31 16:28:34.684134 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2897/5821] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:28:34 2022] GET /compute/v2.1/servers/8d537fe8-d6d8-4858-a2d0-596abd805ac9 => generated 1314 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:28:34.685593 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-626276f4-99b7-43fd-bb4f-00d8441bec16 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc96a6b97c3c458a88ebc013157332ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d753dee849a4318a4711fa5e4791e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:34.708985 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-626276f4-99b7-43fd-bb4f-00d8441bec16 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] 10.222.0.61 "GET /compute/v2.1/servers/1b38884c-e9e3-4a03-98d7-e687429cd132" status: 200 len: 1362 microversion: 2.26 time: 0.698806 Aug 31 16:28:34.712647 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2925/5822] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:28:34 2022] GET /compute/v2.1/servers/1b38884c-e9e3-4a03-98d7-e687429cd132 => generated 1362 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:28:35.244554 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0b509b82-531f-465b-b9bb-fe80d59d4e43 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:28:35.245442 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0b509b82-531f-465b-b9bb-fe80d59d4e43 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: b31fb01b-045f-41f7-bf58-66c1eca839e8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:35.271168 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0b509b82-531f-465b-b9bb-fe80d59d4e43 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:35.272547 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0b509b82-531f-465b-b9bb-fe80d59d4e43 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:35.273518 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0b509b82-531f-465b-b9bb-fe80d59d4e43 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:35.276956 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0b509b82-531f-465b-b9bb-fe80d59d4e43 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:35.277764 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0b509b82-531f-465b-b9bb-fe80d59d4e43 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:35.281209 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0b509b82-531f-465b-b9bb-fe80d59d4e43 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:35.354563 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-0b509b82-531f-465b-b9bb-fe80d59d4e43 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lazy-loading 'flavor' on Instance uuid b31fb01b-045f-41f7-bf58-66c1eca839e8 {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:28:35.706330 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-07848e88-8c87-4d1d-b2e7-f21a24f56964 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:35.707001 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-07848e88-8c87-4d1d-b2e7-f21a24f56964 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] [instance: 8d537fe8-d6d8-4858-a2d0-596abd805ac9] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:35.725647 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-07848e88-8c87-4d1d-b2e7-f21a24f56964 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:35.726570 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-07848e88-8c87-4d1d-b2e7-f21a24f56964 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:35.727204 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-07848e88-8c87-4d1d-b2e7-f21a24f56964 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:35.728598 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-07848e88-8c87-4d1d-b2e7-f21a24f56964 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:35.729688 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-07848e88-8c87-4d1d-b2e7-f21a24f56964 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:35.740449 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-07848e88-8c87-4d1d-b2e7-f21a24f56964 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:35.809084 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0b509b82-531f-465b-b9bb-fe80d59d4e43 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "POST /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8/action" status: 202 len: 0 microversion: 2.20 time: 0.571535 Aug 31 16:28:35.810481 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2898/5823] 10.222.0.61 () {62 vars in 1319 bytes} [Wed Aug 31 16:28:35 2022] POST /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8/action => generated 0 bytes in 575 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:28:35.857747 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ea8bdc4e-b31b-405f-ab57-9fe524da0b26 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:35.861792 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ea8bdc4e-b31b-405f-ab57-9fe524da0b26 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] [instance: 1b38884c-e9e3-4a03-98d7-e687429cd132] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:35.886028 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ea8bdc4e-b31b-405f-ab57-9fe524da0b26 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:35.888105 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ea8bdc4e-b31b-405f-ab57-9fe524da0b26 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:35.888882 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ea8bdc4e-b31b-405f-ab57-9fe524da0b26 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:35.892936 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ea8bdc4e-b31b-405f-ab57-9fe524da0b26 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:35.893441 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ea8bdc4e-b31b-405f-ab57-9fe524da0b26 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:35.893931 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ea8bdc4e-b31b-405f-ab57-9fe524da0b26 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:37.065027 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ea8bdc4e-b31b-405f-ab57-9fe524da0b26 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96a6b97c3c458a88ebc013157332ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d753dee849a4318a4711fa5e4791e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:37.066106 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-07848e88-8c87-4d1d-b2e7-f21a24f56964 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc4d613cdc94357b40e83a2b70b0bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb6a0a8643748b9830f2859de6d8b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:37.106606 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ea8bdc4e-b31b-405f-ab57-9fe524da0b26 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc96a6b97c3c458a88ebc013157332ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d753dee849a4318a4711fa5e4791e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:37.107405 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-07848e88-8c87-4d1d-b2e7-f21a24f56964 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] 10.222.0.61 "GET /compute/v2.1/servers/8d537fe8-d6d8-4858-a2d0-596abd805ac9" status: 200 len: 1314 microversion: 2.1 time: 1.403317 Aug 31 16:28:37.111408 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2926/5824] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:28:35 2022] GET /compute/v2.1/servers/8d537fe8-d6d8-4858-a2d0-596abd805ac9 => generated 1314 bytes in 1409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:28:37.131711 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ab500bc2-4fd8-4487-8d66-792dde2a65f5 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:37.132441 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ea8bdc4e-b31b-405f-ab57-9fe524da0b26 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc96a6b97c3c458a88ebc013157332ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d753dee849a4318a4711fa5e4791e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:37.133605 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ab500bc2-4fd8-4487-8d66-792dde2a65f5 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: b31fb01b-045f-41f7-bf58-66c1eca839e8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:37.137627 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ea8bdc4e-b31b-405f-ab57-9fe524da0b26 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] 10.222.0.61 "GET /compute/v2.1/servers/1b38884c-e9e3-4a03-98d7-e687429cd132" status: 200 len: 1362 microversion: 2.26 time: 1.324836 Aug 31 16:28:37.146931 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2899/5825] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:28:35 2022] GET /compute/v2.1/servers/1b38884c-e9e3-4a03-98d7-e687429cd132 => generated 1362 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:28:37.161641 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ab500bc2-4fd8-4487-8d66-792dde2a65f5 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:37.165841 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ab500bc2-4fd8-4487-8d66-792dde2a65f5 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:37.166706 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ab500bc2-4fd8-4487-8d66-792dde2a65f5 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:37.181436 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ab500bc2-4fd8-4487-8d66-792dde2a65f5 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:37.186704 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ab500bc2-4fd8-4487-8d66-792dde2a65f5 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:37.190671 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ab500bc2-4fd8-4487-8d66-792dde2a65f5 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:37.587658 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ab500bc2-4fd8-4487-8d66-792dde2a65f5 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:37.610285 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ab500bc2-4fd8-4487-8d66-792dde2a65f5 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:37.616629 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ab500bc2-4fd8-4487-8d66-792dde2a65f5 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:37.619135 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ab500bc2-4fd8-4487-8d66-792dde2a65f5 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8" status: 200 len: 1723 microversion: 2.20 time: 0.506176 Aug 31 16:28:37.620054 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2927/5826] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:28:37 2022] GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8 => generated 1723 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:28:37.653636 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-77b3fcb1-1846-4285-afb6-fadee83dd3ea req-17c0a7b9-2ade-4740-811a-06d21114a5a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d537fe8-d6d8-4858-a2d0-596abd805ac9", "name": "network-vif-plugged", "status": "completed", "tag": "d9c91791-1248-49d0-b64b-f8552bf6ef73"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:28:37.661802 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:28:37.693739 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-77b3fcb1-1846-4285-afb6-fadee83dd3ea req-17c0a7b9-2ade-4740-811a-06d21114a5a2 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:37.700837 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-77b3fcb1-1846-4285-afb6-fadee83dd3ea req-17c0a7b9-2ade-4740-811a-06d21114a5a2 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:37.701688 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-77b3fcb1-1846-4285-afb6-fadee83dd3ea req-17c0a7b9-2ade-4740-811a-06d21114a5a2 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:37.727037 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-77b3fcb1-1846-4285-afb6-fadee83dd3ea req-17c0a7b9-2ade-4740-811a-06d21114a5a2 service nova] Creating event network-vif-plugged:d9c91791-1248-49d0-b64b-f8552bf6ef73 for instance 8d537fe8-d6d8-4858-a2d0-596abd805ac9 on n-h1-850499-9 Aug 31 16:28:37.741910 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-77b3fcb1-1846-4285-afb6-fadee83dd3ea req-17c0a7b9-2ade-4740-811a-06d21114a5a2 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090934 Aug 31 16:28:37.753101 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2900/5827] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:28:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:28:38.151963 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-34b18ef9-1473-40a4-97e5-7ca7cc5aec6f tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:38.153811 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-34b18ef9-1473-40a4-97e5-7ca7cc5aec6f tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] [instance: 8d537fe8-d6d8-4858-a2d0-596abd805ac9] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:38.173981 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ffabcda8-e733-4ce8-b4c3-80fb39e9e1d0 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:38.175861 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ffabcda8-e733-4ce8-b4c3-80fb39e9e1d0 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] [instance: 1b38884c-e9e3-4a03-98d7-e687429cd132] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:38.184766 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-34b18ef9-1473-40a4-97e5-7ca7cc5aec6f tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:38.189226 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-34b18ef9-1473-40a4-97e5-7ca7cc5aec6f tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:38.192049 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-34b18ef9-1473-40a4-97e5-7ca7cc5aec6f tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:38.193710 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-34b18ef9-1473-40a4-97e5-7ca7cc5aec6f tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:38.195824 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-34b18ef9-1473-40a4-97e5-7ca7cc5aec6f tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:38.198994 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-34b18ef9-1473-40a4-97e5-7ca7cc5aec6f tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:38.206251 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ffabcda8-e733-4ce8-b4c3-80fb39e9e1d0 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:38.214844 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ffabcda8-e733-4ce8-b4c3-80fb39e9e1d0 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:38.218038 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:28:38.219395 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ffabcda8-e733-4ce8-b4c3-80fb39e9e1d0 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:38.221907 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ffabcda8-e733-4ce8-b4c3-80fb39e9e1d0 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:38.223394 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ffabcda8-e733-4ce8-b4c3-80fb39e9e1d0 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:38.229943 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ffabcda8-e733-4ce8-b4c3-80fb39e9e1d0 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:39.009770 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-34b18ef9-1473-40a4-97e5-7ca7cc5aec6f tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc4d613cdc94357b40e83a2b70b0bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb6a0a8643748b9830f2859de6d8b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:39.031285 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-34b18ef9-1473-40a4-97e5-7ca7cc5aec6f tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] 10.222.0.61 "GET /compute/v2.1/servers/8d537fe8-d6d8-4858-a2d0-596abd805ac9" status: 200 len: 1314 microversion: 2.1 time: 0.889717 Aug 31 16:28:39.031916 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2928/5828] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:28:38 2022] GET /compute/v2.1/servers/8d537fe8-d6d8-4858-a2d0-596abd805ac9 => generated 1314 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:28:39.042720 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ffabcda8-e733-4ce8-b4c3-80fb39e9e1d0 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96a6b97c3c458a88ebc013157332ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d753dee849a4318a4711fa5e4791e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:39.063711 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ffabcda8-e733-4ce8-b4c3-80fb39e9e1d0 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc96a6b97c3c458a88ebc013157332ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d753dee849a4318a4711fa5e4791e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:39.077075 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ffabcda8-e733-4ce8-b4c3-80fb39e9e1d0 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc96a6b97c3c458a88ebc013157332ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d753dee849a4318a4711fa5e4791e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:39.080122 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8f44cf95-d000-46b9-8230-5f28f8d46499 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:39.082539 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ffabcda8-e733-4ce8-b4c3-80fb39e9e1d0 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] 10.222.0.61 "GET /compute/v2.1/servers/1b38884c-e9e3-4a03-98d7-e687429cd132" status: 200 len: 1362 microversion: 2.26 time: 0.915897 Aug 31 16:28:39.082741 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8f44cf95-d000-46b9-8230-5f28f8d46499 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: b31fb01b-045f-41f7-bf58-66c1eca839e8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:39.087105 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2901/5829] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:28:38 2022] GET /compute/v2.1/servers/1b38884c-e9e3-4a03-98d7-e687429cd132 => generated 1362 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:28:39.098537 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8f44cf95-d000-46b9-8230-5f28f8d46499 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:39.099471 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8f44cf95-d000-46b9-8230-5f28f8d46499 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:39.107769 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8f44cf95-d000-46b9-8230-5f28f8d46499 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:39.109119 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8f44cf95-d000-46b9-8230-5f28f8d46499 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:39.109803 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8f44cf95-d000-46b9-8230-5f28f8d46499 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:39.112601 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8f44cf95-d000-46b9-8230-5f28f8d46499 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:39.527979 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8f44cf95-d000-46b9-8230-5f28f8d46499 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:39.548979 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8f44cf95-d000-46b9-8230-5f28f8d46499 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:39.555252 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8f44cf95-d000-46b9-8230-5f28f8d46499 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:39.557642 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8f44cf95-d000-46b9-8230-5f28f8d46499 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8" status: 200 len: 1723 microversion: 2.20 time: 0.501667 Aug 31 16:28:39.559768 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2929/5830] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:28:39 2022] GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8 => generated 1723 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:28:40.073442 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1b82abea-bd84-46cb-89f6-4b0ba2627719 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:40.076841 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1b82abea-bd84-46cb-89f6-4b0ba2627719 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] [instance: 8d537fe8-d6d8-4858-a2d0-596abd805ac9] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:40.100470 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1b82abea-bd84-46cb-89f6-4b0ba2627719 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:40.102445 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1b82abea-bd84-46cb-89f6-4b0ba2627719 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:40.103440 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1b82abea-bd84-46cb-89f6-4b0ba2627719 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:40.104724 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1b82abea-bd84-46cb-89f6-4b0ba2627719 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:40.105276 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1b82abea-bd84-46cb-89f6-4b0ba2627719 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:40.106070 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1b82abea-bd84-46cb-89f6-4b0ba2627719 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:40.121515 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-abf71edc-22e1-4321-859e-8771e8da9969 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:40.122597 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-abf71edc-22e1-4321-859e-8771e8da9969 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] [instance: 1b38884c-e9e3-4a03-98d7-e687429cd132] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:40.140901 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-abf71edc-22e1-4321-859e-8771e8da9969 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:40.141840 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-abf71edc-22e1-4321-859e-8771e8da9969 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:40.143410 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-abf71edc-22e1-4321-859e-8771e8da9969 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:40.144262 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-abf71edc-22e1-4321-859e-8771e8da9969 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:40.144803 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-abf71edc-22e1-4321-859e-8771e8da9969 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:40.145292 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-abf71edc-22e1-4321-859e-8771e8da9969 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:41.008338 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-abf71edc-22e1-4321-859e-8771e8da9969 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96a6b97c3c458a88ebc013157332ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d753dee849a4318a4711fa5e4791e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:41.016098 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1b82abea-bd84-46cb-89f6-4b0ba2627719 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc4d613cdc94357b40e83a2b70b0bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb6a0a8643748b9830f2859de6d8b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:41.029059 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1b82abea-bd84-46cb-89f6-4b0ba2627719 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] 10.222.0.61 "GET /compute/v2.1/servers/8d537fe8-d6d8-4858-a2d0-596abd805ac9" status: 200 len: 1498 microversion: 2.1 time: 0.971003 Aug 31 16:28:41.035769 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-abf71edc-22e1-4321-859e-8771e8da9969 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc96a6b97c3c458a88ebc013157332ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d753dee849a4318a4711fa5e4791e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:41.048608 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2902/5831] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:28:40 2022] GET /compute/v2.1/servers/8d537fe8-d6d8-4858-a2d0-596abd805ac9 => generated 1498 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:28:41.052958 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-39d1a7da-faf8-4d48-b900-2cdb3b988f9b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:41.055075 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-39d1a7da-faf8-4d48-b900-2cdb3b988f9b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: b31fb01b-045f-41f7-bf58-66c1eca839e8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:41.063322 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-abf71edc-22e1-4321-859e-8771e8da9969 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc96a6b97c3c458a88ebc013157332ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d753dee849a4318a4711fa5e4791e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:41.078782 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-abf71edc-22e1-4321-859e-8771e8da9969 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] 10.222.0.61 "GET /compute/v2.1/servers/1b38884c-e9e3-4a03-98d7-e687429cd132" status: 200 len: 1362 microversion: 2.26 time: 0.960638 Aug 31 16:28:41.080004 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2930/5832] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:28:40 2022] GET /compute/v2.1/servers/1b38884c-e9e3-4a03-98d7-e687429cd132 => generated 1362 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:28:41.093587 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-39d1a7da-faf8-4d48-b900-2cdb3b988f9b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:41.095489 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-39d1a7da-faf8-4d48-b900-2cdb3b988f9b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:41.096976 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-39d1a7da-faf8-4d48-b900-2cdb3b988f9b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:41.098054 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-39d1a7da-faf8-4d48-b900-2cdb3b988f9b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:41.099869 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-39d1a7da-faf8-4d48-b900-2cdb3b988f9b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:41.104493 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-39d1a7da-faf8-4d48-b900-2cdb3b988f9b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:41.222486 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-be0355d7-2629-447c-a662-52a77d483510 req-5611cd13-05f5-4610-ae3f-7ae60afe96d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b38884c-e9e3-4a03-98d7-e687429cd132", "name": "network-vif-plugged", "status": "completed", "tag": "066cd027-ed89-4e4f-9c18-438760e9427e"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:28:41.270018 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-be0355d7-2629-447c-a662-52a77d483510 req-5611cd13-05f5-4610-ae3f-7ae60afe96d6 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:41.273711 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-be0355d7-2629-447c-a662-52a77d483510 req-5611cd13-05f5-4610-ae3f-7ae60afe96d6 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:41.275473 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-be0355d7-2629-447c-a662-52a77d483510 req-5611cd13-05f5-4610-ae3f-7ae60afe96d6 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:41.297141 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-be0355d7-2629-447c-a662-52a77d483510 req-5611cd13-05f5-4610-ae3f-7ae60afe96d6 service nova] Creating event network-vif-plugged:066cd027-ed89-4e4f-9c18-438760e9427e for instance 1b38884c-e9e3-4a03-98d7-e687429cd132 on n-h1-850499-9 Aug 31 16:28:41.313398 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-be0355d7-2629-447c-a662-52a77d483510 req-5611cd13-05f5-4610-ae3f-7ae60afe96d6 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097339 Aug 31 16:28:41.314607 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2931/5833] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:28:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:28:41.431720 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-30398237-17ad-4f87-925e-b391dcd6a2df tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-349929227", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:28:41.566419 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-30398237-17ad-4f87-925e-b391dcd6a2df tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] validate_networks() for None {{(pid=122257) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:28:41.663266 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-39d1a7da-faf8-4d48-b900-2cdb3b988f9b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:41.674974 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-39d1a7da-faf8-4d48-b900-2cdb3b988f9b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:41.675155 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-39d1a7da-faf8-4d48-b900-2cdb3b988f9b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:41.676878 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-39d1a7da-faf8-4d48-b900-2cdb3b988f9b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8" status: 200 len: 1723 microversion: 2.20 time: 0.637802 Aug 31 16:28:41.678006 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2903/5834] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:28:41 2022] GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8 => generated 1723 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:28:41.893543 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-67259300-eba2-4a68-8b8b-096788378865 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:41.894292 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-67259300-eba2-4a68-8b8b-096788378865 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] [instance: 8d537fe8-d6d8-4858-a2d0-596abd805ac9] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:41.902114 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-67259300-eba2-4a68-8b8b-096788378865 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:41.902969 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-67259300-eba2-4a68-8b8b-096788378865 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:41.903663 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-67259300-eba2-4a68-8b8b-096788378865 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:41.904610 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-67259300-eba2-4a68-8b8b-096788378865 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:41.905300 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-67259300-eba2-4a68-8b8b-096788378865 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:41.905977 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-67259300-eba2-4a68-8b8b-096788378865 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:41.955318 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-67259300-eba2-4a68-8b8b-096788378865 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] [instance: 8d537fe8-d6d8-4858-a2d0-596abd805ac9] Going to try to terminate instance {{(pid=122256) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:28:42.018154 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:28:42.072996 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-67259300-eba2-4a68-8b8b-096788378865 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] 10.222.0.61 "DELETE /compute/v2.1/servers/8d537fe8-d6d8-4858-a2d0-596abd805ac9" status: 204 len: 0 microversion: 2.1 time: 0.182863 Aug 31 16:28:42.075516 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2904/5835] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:28:41 2022] DELETE /compute/v2.1/servers/8d537fe8-d6d8-4858-a2d0-596abd805ac9 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 16:28:42.087446 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-848f1cf0-cc91-4138-bb03-c92c2500c63d tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:42.088801 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-848f1cf0-cc91-4138-bb03-c92c2500c63d tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] [instance: 8d537fe8-d6d8-4858-a2d0-596abd805ac9] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:42.097209 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-848f1cf0-cc91-4138-bb03-c92c2500c63d tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:42.100812 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-848f1cf0-cc91-4138-bb03-c92c2500c63d tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:42.101666 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-848f1cf0-cc91-4138-bb03-c92c2500c63d tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:42.102869 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-848f1cf0-cc91-4138-bb03-c92c2500c63d tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:42.103682 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-848f1cf0-cc91-4138-bb03-c92c2500c63d tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:42.104406 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-848f1cf0-cc91-4138-bb03-c92c2500c63d tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:42.249185 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-30398237-17ad-4f87-925e-b391dcd6a2df tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:28:42.249979 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-30398237-17ad-4f87-925e-b391dcd6a2df tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:28:42.250153 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-30398237-17ad-4f87-925e-b391dcd6a2df tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:28:42.250554 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-30398237-17ad-4f87-925e-b391dcd6a2df tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:28:42.251006 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-30398237-17ad-4f87-925e-b391dcd6a2df tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:28:42.266242 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-30398237-17ad-4f87-925e-b391dcd6a2df tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:42.266743 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-30398237-17ad-4f87-925e-b391dcd6a2df tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:42.267192 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-30398237-17ad-4f87-925e-b391dcd6a2df tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:42.267965 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-30398237-17ad-4f87-925e-b391dcd6a2df tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:42.268441 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-30398237-17ad-4f87-925e-b391dcd6a2df tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:42.268874 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-30398237-17ad-4f87-925e-b391dcd6a2df tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:42.309729 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-30398237-17ad-4f87-925e-b391dcd6a2df tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Getting quotas for project 7d1b3cbf1d284da384315bd4f5e1e783. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:28:42.316646 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-30398237-17ad-4f87-925e-b391dcd6a2df tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Getting quotas for user 48419c9a6b934406b14d9150af9bbb22 and project 7d1b3cbf1d284da384315bd4f5e1e783. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:28:42.335467 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-30398237-17ad-4f87-925e-b391dcd6a2df tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Going to run 1 instances... {{(pid=122257) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:28:42.355256 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-30398237-17ad-4f87-925e-b391dcd6a2df tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] [instance: c7eaf35b-26b9-4011-8dc8-d5f48201f17e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:28:42.427455 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-30398237-17ad-4f87-925e-b391dcd6a2df tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.000207 Aug 31 16:28:42.435117 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2932/5836] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:28:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1009 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:28:42.440582 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a6351875-f8e1-4b9b-8846-e0869ab73318 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:42.442209 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a6351875-f8e1-4b9b-8846-e0869ab73318 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] [instance: 1b38884c-e9e3-4a03-98d7-e687429cd132] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:42.450768 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a6351875-f8e1-4b9b-8846-e0869ab73318 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:42.451709 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a6351875-f8e1-4b9b-8846-e0869ab73318 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:42.452385 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a6351875-f8e1-4b9b-8846-e0869ab73318 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:42.453347 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a6351875-f8e1-4b9b-8846-e0869ab73318 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:42.454041 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a6351875-f8e1-4b9b-8846-e0869ab73318 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:42.454704 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a6351875-f8e1-4b9b-8846-e0869ab73318 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:42.561261 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-848f1cf0-cc91-4138-bb03-c92c2500c63d tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc4d613cdc94357b40e83a2b70b0bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb6a0a8643748b9830f2859de6d8b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:42.578414 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-848f1cf0-cc91-4138-bb03-c92c2500c63d tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] 10.222.0.61 "GET /compute/v2.1/servers/8d537fe8-d6d8-4858-a2d0-596abd805ac9" status: 200 len: 1504 microversion: 2.1 time: 0.497758 Aug 31 16:28:42.606522 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2905/5837] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:28:42 2022] GET /compute/v2.1/servers/8d537fe8-d6d8-4858-a2d0-596abd805ac9 => generated 1504 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:28:42.618751 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1f233511-2a69-4cb6-b8d5-8f1070e35d2b tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:42.619877 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1f233511-2a69-4cb6-b8d5-8f1070e35d2b tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] [instance: c7eaf35b-26b9-4011-8dc8-d5f48201f17e] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:42.723045 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1f233511-2a69-4cb6-b8d5-8f1070e35d2b tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48419c9a6b934406b14d9150af9bbb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1b3cbf1d284da384315bd4f5e1e783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:42.739483 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1f233511-2a69-4cb6-b8d5-8f1070e35d2b tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] 10.222.0.61 "GET /compute/v2.1/servers/c7eaf35b-26b9-4011-8dc8-d5f48201f17e" status: 200 len: 1213 microversion: 2.1 time: 0.130087 Aug 31 16:28:42.741454 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2906/5838] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:28:42 2022] GET /compute/v2.1/servers/c7eaf35b-26b9-4011-8dc8-d5f48201f17e => generated 1213 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:28:42.751180 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-20b4ed8e-722b-438d-971b-c137307b6e82 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:42.752756 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-20b4ed8e-722b-438d-971b-c137307b6e82 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: b31fb01b-045f-41f7-bf58-66c1eca839e8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:42.764753 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-20b4ed8e-722b-438d-971b-c137307b6e82 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:42.765539 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-20b4ed8e-722b-438d-971b-c137307b6e82 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:42.766380 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-20b4ed8e-722b-438d-971b-c137307b6e82 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:42.767905 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-20b4ed8e-722b-438d-971b-c137307b6e82 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:42.768636 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-20b4ed8e-722b-438d-971b-c137307b6e82 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:42.769452 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-20b4ed8e-722b-438d-971b-c137307b6e82 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:42.989894 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a6351875-f8e1-4b9b-8846-e0869ab73318 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96a6b97c3c458a88ebc013157332ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d753dee849a4318a4711fa5e4791e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:43.007272 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a6351875-f8e1-4b9b-8846-e0869ab73318 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc96a6b97c3c458a88ebc013157332ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d753dee849a4318a4711fa5e4791e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:43.009915 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a6351875-f8e1-4b9b-8846-e0869ab73318 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc96a6b97c3c458a88ebc013157332ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d753dee849a4318a4711fa5e4791e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:43.011367 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a6351875-f8e1-4b9b-8846-e0869ab73318 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] 10.222.0.61 "GET /compute/v2.1/servers/1b38884c-e9e3-4a03-98d7-e687429cd132" status: 200 len: 1362 microversion: 2.26 time: 0.574750 Aug 31 16:28:43.012983 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2933/5839] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:28:42 2022] GET /compute/v2.1/servers/1b38884c-e9e3-4a03-98d7-e687429cd132 => generated 1362 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:28:43.189551 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-20b4ed8e-722b-438d-971b-c137307b6e82 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:43.204939 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-20b4ed8e-722b-438d-971b-c137307b6e82 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:43.209163 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-20b4ed8e-722b-438d-971b-c137307b6e82 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:43.218175 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-20b4ed8e-722b-438d-971b-c137307b6e82 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8" status: 200 len: 1723 microversion: 2.20 time: 0.466259 Aug 31 16:28:43.219660 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2907/5840] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:28:42 2022] GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8 => generated 1723 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:28:43.612289 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ee1db49f-d735-4b4f-a620-ede857ab25e3 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:43.612969 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ee1db49f-d735-4b4f-a620-ede857ab25e3 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] [instance: 8d537fe8-d6d8-4858-a2d0-596abd805ac9] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:43.632156 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ee1db49f-d735-4b4f-a620-ede857ab25e3 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:43.633393 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ee1db49f-d735-4b4f-a620-ede857ab25e3 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:43.633884 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ee1db49f-d735-4b4f-a620-ede857ab25e3 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:43.635989 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ee1db49f-d735-4b4f-a620-ede857ab25e3 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:43.636625 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ee1db49f-d735-4b4f-a620-ede857ab25e3 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:43.637072 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ee1db49f-d735-4b4f-a620-ede857ab25e3 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:43.778202 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ecbb6ffa-5360-410d-acf0-d6df6db4f0d4 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:43.780878 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ecbb6ffa-5360-410d-acf0-d6df6db4f0d4 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] [instance: c7eaf35b-26b9-4011-8dc8-d5f48201f17e] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:43.799268 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ecbb6ffa-5360-410d-acf0-d6df6db4f0d4 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:43.799986 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ecbb6ffa-5360-410d-acf0-d6df6db4f0d4 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:43.800780 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ecbb6ffa-5360-410d-acf0-d6df6db4f0d4 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:43.802775 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ecbb6ffa-5360-410d-acf0-d6df6db4f0d4 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:43.803856 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ecbb6ffa-5360-410d-acf0-d6df6db4f0d4 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:43.804585 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ecbb6ffa-5360-410d-acf0-d6df6db4f0d4 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:44.083342 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ecbb6ffa-5360-410d-acf0-d6df6db4f0d4 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48419c9a6b934406b14d9150af9bbb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1b3cbf1d284da384315bd4f5e1e783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:44.101342 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ecbb6ffa-5360-410d-acf0-d6df6db4f0d4 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] 10.222.0.61 "GET /compute/v2.1/servers/c7eaf35b-26b9-4011-8dc8-d5f48201f17e" status: 200 len: 1209 microversion: 2.1 time: 0.328965 Aug 31 16:28:44.102032 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2908/5841] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:28:43 2022] GET /compute/v2.1/servers/c7eaf35b-26b9-4011-8dc8-d5f48201f17e => generated 1209 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:28:44.116318 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0a7909d5-e9e4-4574-9484-77d222d57700 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:44.116318 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0a7909d5-e9e4-4574-9484-77d222d57700 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] [instance: 1b38884c-e9e3-4a03-98d7-e687429cd132] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:44.133628 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0a7909d5-e9e4-4574-9484-77d222d57700 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:44.136454 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0a7909d5-e9e4-4574-9484-77d222d57700 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:44.137006 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0a7909d5-e9e4-4574-9484-77d222d57700 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:44.140076 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0a7909d5-e9e4-4574-9484-77d222d57700 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:44.140900 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0a7909d5-e9e4-4574-9484-77d222d57700 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:44.141505 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0a7909d5-e9e4-4574-9484-77d222d57700 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:44.564765 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ee1db49f-d735-4b4f-a620-ede857ab25e3 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc4d613cdc94357b40e83a2b70b0bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb6a0a8643748b9830f2859de6d8b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:44.574632 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ee1db49f-d735-4b4f-a620-ede857ab25e3 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] 10.222.0.61 "GET /compute/v2.1/servers/8d537fe8-d6d8-4858-a2d0-596abd805ac9" status: 200 len: 1504 microversion: 2.1 time: 0.966854 Aug 31 16:28:44.594594 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2934/5842] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:28:43 2022] GET /compute/v2.1/servers/8d537fe8-d6d8-4858-a2d0-596abd805ac9 => generated 1504 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:28:44.604847 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ab28d012-65eb-494d-b22f-b29b14be66d6 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:44.605775 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ab28d012-65eb-494d-b22f-b29b14be66d6 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: b31fb01b-045f-41f7-bf58-66c1eca839e8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:44.640744 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ab28d012-65eb-494d-b22f-b29b14be66d6 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:44.641526 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ab28d012-65eb-494d-b22f-b29b14be66d6 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:44.641740 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ab28d012-65eb-494d-b22f-b29b14be66d6 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:44.642432 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ab28d012-65eb-494d-b22f-b29b14be66d6 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:44.642893 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ab28d012-65eb-494d-b22f-b29b14be66d6 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:44.644129 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ab28d012-65eb-494d-b22f-b29b14be66d6 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:45.022300 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-0a7909d5-e9e4-4574-9484-77d222d57700 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96a6b97c3c458a88ebc013157332ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d753dee849a4318a4711fa5e4791e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:45.042988 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-0a7909d5-e9e4-4574-9484-77d222d57700 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc96a6b97c3c458a88ebc013157332ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d753dee849a4318a4711fa5e4791e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:45.045225 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-0a7909d5-e9e4-4574-9484-77d222d57700 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc96a6b97c3c458a88ebc013157332ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d753dee849a4318a4711fa5e4791e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:45.046495 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0a7909d5-e9e4-4574-9484-77d222d57700 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] 10.222.0.61 "GET /compute/v2.1/servers/1b38884c-e9e3-4a03-98d7-e687429cd132" status: 200 len: 1545 microversion: 2.26 time: 0.943334 Aug 31 16:28:45.047285 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2909/5843] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:28:44 2022] GET /compute/v2.1/servers/1b38884c-e9e3-4a03-98d7-e687429cd132 => generated 1545 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:28:45.074149 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-525ecbb0-6e60-4a29-b0b9-9f3379b2d8c3 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Calling method '.version_select at 0x7f5ae8d79040>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:45.087825 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-525ecbb0-6e60-4a29-b0b9-9f3379b2d8c3 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:45.088848 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-525ecbb0-6e60-4a29-b0b9-9f3379b2d8c3 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:45.089820 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-525ecbb0-6e60-4a29-b0b9-9f3379b2d8c3 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:45.092209 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-525ecbb0-6e60-4a29-b0b9-9f3379b2d8c3 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] [instance: 1b38884c-e9e3-4a03-98d7-e687429cd132] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:45.099865 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-525ecbb0-6e60-4a29-b0b9-9f3379b2d8c3 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:45.101723 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-525ecbb0-6e60-4a29-b0b9-9f3379b2d8c3 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:45.102864 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-525ecbb0-6e60-4a29-b0b9-9f3379b2d8c3 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:45.104944 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-525ecbb0-6e60-4a29-b0b9-9f3379b2d8c3 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:45.106348 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-525ecbb0-6e60-4a29-b0b9-9f3379b2d8c3 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:45.107593 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-525ecbb0-6e60-4a29-b0b9-9f3379b2d8c3 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:45.174066 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-525ecbb0-6e60-4a29-b0b9-9f3379b2d8c3 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:45.186212 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-525ecbb0-6e60-4a29-b0b9-9f3379b2d8c3 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:45.186886 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-525ecbb0-6e60-4a29-b0b9-9f3379b2d8c3 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:45.248242 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-525ecbb0-6e60-4a29-b0b9-9f3379b2d8c3 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:45.248934 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-525ecbb0-6e60-4a29-b0b9-9f3379b2d8c3 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:45.254367 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-525ecbb0-6e60-4a29-b0b9-9f3379b2d8c3 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:45.309873 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ab28d012-65eb-494d-b22f-b29b14be66d6 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:45.342651 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-525ecbb0-6e60-4a29-b0b9-9f3379b2d8c3 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lazy-loading 'flavor' on Instance uuid 1b38884c-e9e3-4a03-98d7-e687429cd132 {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:28:45.352861 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ab28d012-65eb-494d-b22f-b29b14be66d6 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:45.372202 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ab28d012-65eb-494d-b22f-b29b14be66d6 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:45.379957 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ab28d012-65eb-494d-b22f-b29b14be66d6 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8" status: 200 len: 1723 microversion: 2.20 time: 0.781725 Aug 31 16:28:45.383639 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2935/5844] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:28:44 2022] GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8 => generated 1723 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:28:45.396359 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1f8efd90-197d-4088-b830-b659cf353258 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:45.397534 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1f8efd90-197d-4088-b830-b659cf353258 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] [instance: c7eaf35b-26b9-4011-8dc8-d5f48201f17e] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:45.409907 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1f8efd90-197d-4088-b830-b659cf353258 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:45.410659 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1f8efd90-197d-4088-b830-b659cf353258 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:45.411301 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1f8efd90-197d-4088-b830-b659cf353258 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:45.413569 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1f8efd90-197d-4088-b830-b659cf353258 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:45.415322 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-525ecbb0-6e60-4a29-b0b9-9f3379b2d8c3 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] 10.222.0.61 "PUT /compute/v2.1/servers/1b38884c-e9e3-4a03-98d7-e687429cd132/tags/tempest-tag-1241711163" status: 201 len: 0 microversion: 2.26 time: 0.341708 Aug 31 16:28:45.416232 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1f8efd90-197d-4088-b830-b659cf353258 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:45.417014 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1f8efd90-197d-4088-b830-b659cf353258 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:45.428920 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2910/5845] 10.222.0.61 () {62 vars in 1380 bytes} [Wed Aug 31 16:28:45 2022] PUT /compute/v2.1/servers/1b38884c-e9e3-4a03-98d7-e687429cd132/tags/tempest-tag-1241711163 => generated 0 bytes in 361 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Aug 31 16:28:45.435627 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-bd63a3fb-5778-406c-9081-65a4b9d339da tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Calling method '.version_select at 0x7f5ae9140940>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:45.451881 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bd63a3fb-5778-406c-9081-65a4b9d339da tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:45.454134 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bd63a3fb-5778-406c-9081-65a4b9d339da tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:45.457010 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bd63a3fb-5778-406c-9081-65a4b9d339da tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:45.487046 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-bd63a3fb-5778-406c-9081-65a4b9d339da tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] 10.222.0.61 "GET /compute/v2.1/servers/1b38884c-e9e3-4a03-98d7-e687429cd132/tags/tempest-tag-1241711163" status: 204 len: 0 microversion: 2.26 time: 0.056319 Aug 31 16:28:45.494016 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2911/5846] 10.222.0.61 () {60 vars in 1361 bytes} [Wed Aug 31 16:28:45 2022] GET /compute/v2.1/servers/1b38884c-e9e3-4a03-98d7-e687429cd132/tags/tempest-tag-1241711163 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 16:28:45.499582 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6a792897-6b71-4f0b-9705-891fb848b616 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Calling method '.version_select at 0x7f5ae829d0d0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:45.511045 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6a792897-6b71-4f0b-9705-891fb848b616 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:45.511896 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6a792897-6b71-4f0b-9705-891fb848b616 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:45.512527 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6a792897-6b71-4f0b-9705-891fb848b616 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:45.513205 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6a792897-6b71-4f0b-9705-891fb848b616 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] [instance: 1b38884c-e9e3-4a03-98d7-e687429cd132] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:45.529088 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6a792897-6b71-4f0b-9705-891fb848b616 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:45.529860 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6a792897-6b71-4f0b-9705-891fb848b616 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:45.530466 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6a792897-6b71-4f0b-9705-891fb848b616 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:45.531356 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6a792897-6b71-4f0b-9705-891fb848b616 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:45.532005 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6a792897-6b71-4f0b-9705-891fb848b616 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:45.532589 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6a792897-6b71-4f0b-9705-891fb848b616 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:45.583055 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6a792897-6b71-4f0b-9705-891fb848b616 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:45.583943 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6a792897-6b71-4f0b-9705-891fb848b616 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:45.585290 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6a792897-6b71-4f0b-9705-891fb848b616 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:45.667456 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-6a792897-6b71-4f0b-9705-891fb848b616 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lazy-loading 'flavor' on Instance uuid 1b38884c-e9e3-4a03-98d7-e687429cd132 {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:28:45.704973 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6a792897-6b71-4f0b-9705-891fb848b616 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] 10.222.0.61 "DELETE /compute/v2.1/servers/1b38884c-e9e3-4a03-98d7-e687429cd132/tags" status: 204 len: 0 microversion: 2.26 time: 0.209468 Aug 31 16:28:45.715175 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2912/5847] 10.222.0.61 () {60 vars in 1295 bytes} [Wed Aug 31 16:28:45 2022] DELETE /compute/v2.1/servers/1b38884c-e9e3-4a03-98d7-e687429cd132/tags => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 16:28:45.735581 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-94e730e6-48e2-4d07-bf8e-1171e48fa580 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:45.736521 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-94e730e6-48e2-4d07-bf8e-1171e48fa580 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] [instance: 8d537fe8-d6d8-4858-a2d0-596abd805ac9] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:45.747926 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-94e730e6-48e2-4d07-bf8e-1171e48fa580 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:45.748784 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-94e730e6-48e2-4d07-bf8e-1171e48fa580 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:45.749243 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-94e730e6-48e2-4d07-bf8e-1171e48fa580 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:45.750208 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-94e730e6-48e2-4d07-bf8e-1171e48fa580 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:45.750667 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-94e730e6-48e2-4d07-bf8e-1171e48fa580 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:45.751305 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-94e730e6-48e2-4d07-bf8e-1171e48fa580 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:46.120472 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-1f8efd90-197d-4088-b830-b659cf353258 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48419c9a6b934406b14d9150af9bbb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1b3cbf1d284da384315bd4f5e1e783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:46.130307 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1f8efd90-197d-4088-b830-b659cf353258 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] 10.222.0.61 "GET /compute/v2.1/servers/c7eaf35b-26b9-4011-8dc8-d5f48201f17e" status: 200 len: 1271 microversion: 2.1 time: 0.744266 Aug 31 16:28:46.130975 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2936/5848] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:28:45 2022] GET /compute/v2.1/servers/c7eaf35b-26b9-4011-8dc8-d5f48201f17e => generated 1271 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:28:46.143527 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-fb03279c-7480-4084-9ab7-c718c346a1da req-a4524379-223b-49ed-a6e4-f86c84a05cd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d537fe8-d6d8-4858-a2d0-596abd805ac9", "name": "network-vif-deleted", "tag": "d9c91791-1248-49d0-b64b-f8552bf6ef73"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:28:46.151893 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-fb03279c-7480-4084-9ab7-c718c346a1da req-a4524379-223b-49ed-a6e4-f86c84a05cd2 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:46.152417 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-fb03279c-7480-4084-9ab7-c718c346a1da req-a4524379-223b-49ed-a6e4-f86c84a05cd2 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:46.152864 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-fb03279c-7480-4084-9ab7-c718c346a1da req-a4524379-223b-49ed-a6e4-f86c84a05cd2 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:46.166822 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-fb03279c-7480-4084-9ab7-c718c346a1da req-a4524379-223b-49ed-a6e4-f86c84a05cd2 service nova] Creating event network-vif-deleted:d9c91791-1248-49d0-b64b-f8552bf6ef73 for instance 8d537fe8-d6d8-4858-a2d0-596abd805ac9 on n-h1-850499-9 Aug 31 16:28:46.173637 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-fb03279c-7480-4084-9ab7-c718c346a1da req-a4524379-223b-49ed-a6e4-f86c84a05cd2 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038621 Aug 31 16:28:46.174461 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2937/5849] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:28:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:28:46.182037 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-dafb7807-e1a7-4c14-a14c-382013243d0a tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Calling method '.version_select at 0x7f5ae3d3d0d0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:46.191492 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dafb7807-e1a7-4c14-a14c-382013243d0a tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:46.192087 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dafb7807-e1a7-4c14-a14c-382013243d0a tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:46.192495 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dafb7807-e1a7-4c14-a14c-382013243d0a tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:46.195644 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-94e730e6-48e2-4d07-bf8e-1171e48fa580 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc4d613cdc94357b40e83a2b70b0bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb6a0a8643748b9830f2859de6d8b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:46.210989 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-dafb7807-e1a7-4c14-a14c-382013243d0a tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] 10.222.0.61 "GET /compute/v2.1/servers/1b38884c-e9e3-4a03-98d7-e687429cd132/tags" status: 200 len: 12 microversion: 2.26 time: 0.034641 Aug 31 16:28:46.218556 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-94e730e6-48e2-4d07-bf8e-1171e48fa580 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] 10.222.0.61 "GET /compute/v2.1/servers/8d537fe8-d6d8-4858-a2d0-596abd805ac9" status: 200 len: 1462 microversion: 2.1 time: 0.496561 Aug 31 16:28:46.219921 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2913/5850] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:28:45 2022] GET /compute/v2.1/servers/8d537fe8-d6d8-4858-a2d0-596abd805ac9 => generated 1462 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:28:46.229289 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-aba5ab8a-0156-4d0b-8b99-e0bf30f0f239 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Calling method '.version_select at 0x7f5ae8fead30>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:46.233285 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2938/5851] 10.222.0.61 () {60 vars in 1292 bytes} [Wed Aug 31 16:28:46 2022] GET /compute/v2.1/servers/1b38884c-e9e3-4a03-98d7-e687429cd132/tags => generated 12 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:28:46.245851 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aba5ab8a-0156-4d0b-8b99-e0bf30f0f239 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:46.246798 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aba5ab8a-0156-4d0b-8b99-e0bf30f0f239 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:46.248118 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aba5ab8a-0156-4d0b-8b99-e0bf30f0f239 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:46.249155 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-aba5ab8a-0156-4d0b-8b99-e0bf30f0f239 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] [instance: 1b38884c-e9e3-4a03-98d7-e687429cd132] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:46.260219 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aba5ab8a-0156-4d0b-8b99-e0bf30f0f239 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:46.261352 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aba5ab8a-0156-4d0b-8b99-e0bf30f0f239 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:46.262028 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aba5ab8a-0156-4d0b-8b99-e0bf30f0f239 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:46.263277 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aba5ab8a-0156-4d0b-8b99-e0bf30f0f239 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:46.264031 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aba5ab8a-0156-4d0b-8b99-e0bf30f0f239 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:46.265794 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aba5ab8a-0156-4d0b-8b99-e0bf30f0f239 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:46.310493 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aba5ab8a-0156-4d0b-8b99-e0bf30f0f239 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:46.311210 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aba5ab8a-0156-4d0b-8b99-e0bf30f0f239 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:46.311926 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aba5ab8a-0156-4d0b-8b99-e0bf30f0f239 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:46.323641 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aba5ab8a-0156-4d0b-8b99-e0bf30f0f239 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:46.324386 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aba5ab8a-0156-4d0b-8b99-e0bf30f0f239 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:46.324986 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aba5ab8a-0156-4d0b-8b99-e0bf30f0f239 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:46.357053 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-aba5ab8a-0156-4d0b-8b99-e0bf30f0f239 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lazy-loading 'flavor' on Instance uuid 1b38884c-e9e3-4a03-98d7-e687429cd132 {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:28:46.380158 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-aba5ab8a-0156-4d0b-8b99-e0bf30f0f239 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] 10.222.0.61 "PUT /compute/v2.1/servers/1b38884c-e9e3-4a03-98d7-e687429cd132/tags/tempest-tag-1352094870" status: 201 len: 0 microversion: 2.26 time: 0.157457 Aug 31 16:28:46.380158 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2914/5852] 10.222.0.61 () {62 vars in 1380 bytes} [Wed Aug 31 16:28:46 2022] PUT /compute/v2.1/servers/1b38884c-e9e3-4a03-98d7-e687429cd132/tags/tempest-tag-1352094870 => generated 0 bytes in 159 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Aug 31 16:28:46.396542 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8099a3b3-b9f8-4dd0-898e-f987b6423e2e tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Calling method '.version_select at 0x7f5ae8d025e0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:46.414632 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-42d3d092-57ab-42e1-a986-b6f4589d8199 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:46.415428 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-42d3d092-57ab-42e1-a986-b6f4589d8199 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: b31fb01b-045f-41f7-bf58-66c1eca839e8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:46.415679 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8099a3b3-b9f8-4dd0-898e-f987b6423e2e tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:46.417204 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8099a3b3-b9f8-4dd0-898e-f987b6423e2e tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:46.418246 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8099a3b3-b9f8-4dd0-898e-f987b6423e2e tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:46.437797 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42d3d092-57ab-42e1-a986-b6f4589d8199 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:46.439602 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42d3d092-57ab-42e1-a986-b6f4589d8199 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:46.441997 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42d3d092-57ab-42e1-a986-b6f4589d8199 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:46.443617 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42d3d092-57ab-42e1-a986-b6f4589d8199 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:46.447285 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42d3d092-57ab-42e1-a986-b6f4589d8199 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:46.447930 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42d3d092-57ab-42e1-a986-b6f4589d8199 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:46.452589 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8099a3b3-b9f8-4dd0-898e-f987b6423e2e tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] 10.222.0.61 "GET /compute/v2.1/servers/1b38884c-e9e3-4a03-98d7-e687429cd132/tags" status: 200 len: 36 microversion: 2.26 time: 0.063336 Aug 31 16:28:46.454279 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2939/5853] 10.222.0.61 () {60 vars in 1292 bytes} [Wed Aug 31 16:28:46 2022] GET /compute/v2.1/servers/1b38884c-e9e3-4a03-98d7-e687429cd132/tags => generated 36 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:28:46.470849 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-184e5688-b53f-4a86-b901-be978599419b tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Calling method '.version_select at 0x7f5ae84af310>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:46.489411 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-184e5688-b53f-4a86-b901-be978599419b tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:46.492079 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-184e5688-b53f-4a86-b901-be978599419b tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:46.493157 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-184e5688-b53f-4a86-b901-be978599419b tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:46.497361 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-184e5688-b53f-4a86-b901-be978599419b tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] [instance: 1b38884c-e9e3-4a03-98d7-e687429cd132] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:46.512670 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-184e5688-b53f-4a86-b901-be978599419b tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:46.513715 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-184e5688-b53f-4a86-b901-be978599419b tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:46.514733 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-184e5688-b53f-4a86-b901-be978599419b tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:46.515823 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-184e5688-b53f-4a86-b901-be978599419b tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:46.517229 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-184e5688-b53f-4a86-b901-be978599419b tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:46.517997 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-184e5688-b53f-4a86-b901-be978599419b tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:46.577930 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-184e5688-b53f-4a86-b901-be978599419b tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:46.578832 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-184e5688-b53f-4a86-b901-be978599419b tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:46.579486 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-184e5688-b53f-4a86-b901-be978599419b tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:46.638160 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-184e5688-b53f-4a86-b901-be978599419b tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lazy-loading 'flavor' on Instance uuid 1b38884c-e9e3-4a03-98d7-e687429cd132 {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:28:46.664753 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-184e5688-b53f-4a86-b901-be978599419b tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] 10.222.0.61 "DELETE /compute/v2.1/servers/1b38884c-e9e3-4a03-98d7-e687429cd132/tags/tempest-tag-1352094870" status: 204 len: 0 microversion: 2.26 time: 0.198829 Aug 31 16:28:46.668643 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2940/5854] 10.222.0.61 () {60 vars in 1364 bytes} [Wed Aug 31 16:28:46 2022] DELETE /compute/v2.1/servers/1b38884c-e9e3-4a03-98d7-e687429cd132/tags/tempest-tag-1352094870 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 16:28:46.677101 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-25bb7c63-24eb-4e06-b0b5-f7d9dc52253b tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Calling method '.version_select at 0x7f5ae844fc10>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:46.689279 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-25bb7c63-24eb-4e06-b0b5-f7d9dc52253b tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:46.690092 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-25bb7c63-24eb-4e06-b0b5-f7d9dc52253b tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:46.690767 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-25bb7c63-24eb-4e06-b0b5-f7d9dc52253b tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:46.705441 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-25bb7c63-24eb-4e06-b0b5-f7d9dc52253b tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] 10.222.0.61 "GET /compute/v2.1/servers/1b38884c-e9e3-4a03-98d7-e687429cd132/tags" status: 200 len: 12 microversion: 2.26 time: 0.035160 Aug 31 16:28:46.714709 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2941/5855] 10.222.0.61 () {60 vars in 1292 bytes} [Wed Aug 31 16:28:46 2022] GET /compute/v2.1/servers/1b38884c-e9e3-4a03-98d7-e687429cd132/tags => generated 12 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:28:46.745512 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5700ac6e-1279-45be-83b0-a2d2fd8d7af9 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Calling method '.version_select at 0x7f5aed0f25e0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:46.770029 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5700ac6e-1279-45be-83b0-a2d2fd8d7af9 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:46.774529 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5700ac6e-1279-45be-83b0-a2d2fd8d7af9 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:46.775174 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5700ac6e-1279-45be-83b0-a2d2fd8d7af9 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:46.775891 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5700ac6e-1279-45be-83b0-a2d2fd8d7af9 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] [instance: 1b38884c-e9e3-4a03-98d7-e687429cd132] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:46.785315 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5700ac6e-1279-45be-83b0-a2d2fd8d7af9 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:46.785976 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5700ac6e-1279-45be-83b0-a2d2fd8d7af9 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:46.787156 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5700ac6e-1279-45be-83b0-a2d2fd8d7af9 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:46.792464 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5700ac6e-1279-45be-83b0-a2d2fd8d7af9 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:46.792999 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5700ac6e-1279-45be-83b0-a2d2fd8d7af9 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:46.793478 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5700ac6e-1279-45be-83b0-a2d2fd8d7af9 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:46.883758 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5700ac6e-1279-45be-83b0-a2d2fd8d7af9 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:46.886250 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5700ac6e-1279-45be-83b0-a2d2fd8d7af9 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:46.888276 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5700ac6e-1279-45be-83b0-a2d2fd8d7af9 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:46.925790 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-5700ac6e-1279-45be-83b0-a2d2fd8d7af9 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lazy-loading 'flavor' on Instance uuid 1b38884c-e9e3-4a03-98d7-e687429cd132 {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:28:46.967083 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5700ac6e-1279-45be-83b0-a2d2fd8d7af9 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] 10.222.0.61 "DELETE /compute/v2.1/servers/1b38884c-e9e3-4a03-98d7-e687429cd132/tags" status: 204 len: 0 microversion: 2.26 time: 0.250364 Aug 31 16:28:46.969703 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2942/5856] 10.222.0.61 () {60 vars in 1295 bytes} [Wed Aug 31 16:28:46 2022] DELETE /compute/v2.1/servers/1b38884c-e9e3-4a03-98d7-e687429cd132/tags => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 16:28:46.982453 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c28048fc-1804-4438-9d2e-30e74c28994b tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Calling method '.version_select at 0x7f5ae8cf6430>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:47.009764 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c28048fc-1804-4438-9d2e-30e74c28994b tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:47.010742 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c28048fc-1804-4438-9d2e-30e74c28994b tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:47.011622 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c28048fc-1804-4438-9d2e-30e74c28994b tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:47.012544 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c28048fc-1804-4438-9d2e-30e74c28994b tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] [instance: 1b38884c-e9e3-4a03-98d7-e687429cd132] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:47.022719 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c28048fc-1804-4438-9d2e-30e74c28994b tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:47.023600 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c28048fc-1804-4438-9d2e-30e74c28994b tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:47.024211 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c28048fc-1804-4438-9d2e-30e74c28994b tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:47.025082 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c28048fc-1804-4438-9d2e-30e74c28994b tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:47.025702 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c28048fc-1804-4438-9d2e-30e74c28994b tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:47.026127 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c28048fc-1804-4438-9d2e-30e74c28994b tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:47.105500 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c28048fc-1804-4438-9d2e-30e74c28994b tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:47.110098 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c28048fc-1804-4438-9d2e-30e74c28994b tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:47.110098 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c28048fc-1804-4438-9d2e-30e74c28994b tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:47.163921 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c28048fc-1804-4438-9d2e-30e74c28994b tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:47.164741 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c28048fc-1804-4438-9d2e-30e74c28994b tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:47.165539 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c28048fc-1804-4438-9d2e-30e74c28994b tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:47.251890 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-c28048fc-1804-4438-9d2e-30e74c28994b tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lazy-loading 'flavor' on Instance uuid 1b38884c-e9e3-4a03-98d7-e687429cd132 {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:28:47.300873 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-42d3d092-57ab-42e1-a986-b6f4589d8199 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:47.317594 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c28048fc-1804-4438-9d2e-30e74c28994b tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] 10.222.0.61 "PUT /compute/v2.1/servers/1b38884c-e9e3-4a03-98d7-e687429cd132/tags/tempest-tag-1726005758" status: 201 len: 0 microversion: 2.26 time: 0.342203 Aug 31 16:28:47.318258 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-42d3d092-57ab-42e1-a986-b6f4589d8199 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:47.325037 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2943/5857] 10.222.0.61 () {62 vars in 1380 bytes} [Wed Aug 31 16:28:46 2022] PUT /compute/v2.1/servers/1b38884c-e9e3-4a03-98d7-e687429cd132/tags/tempest-tag-1726005758 => generated 0 bytes in 351 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Aug 31 16:28:47.325628 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-42d3d092-57ab-42e1-a986-b6f4589d8199 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:47.327367 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-42d3d092-57ab-42e1-a986-b6f4589d8199 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8" status: 200 len: 1723 microversion: 2.20 time: 0.921037 Aug 31 16:28:47.331975 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8260bcaa-4035-44ef-bc20-68e8e2900e69 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:47.333308 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8260bcaa-4035-44ef-bc20-68e8e2900e69 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] [instance: c7eaf35b-26b9-4011-8dc8-d5f48201f17e] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:47.343730 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8260bcaa-4035-44ef-bc20-68e8e2900e69 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:47.345595 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8260bcaa-4035-44ef-bc20-68e8e2900e69 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:47.346432 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8260bcaa-4035-44ef-bc20-68e8e2900e69 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:47.347665 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8260bcaa-4035-44ef-bc20-68e8e2900e69 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:47.348387 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8260bcaa-4035-44ef-bc20-68e8e2900e69 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:47.349135 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8260bcaa-4035-44ef-bc20-68e8e2900e69 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:47.375716 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2915/5858] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:28:46 2022] GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8 => generated 1723 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:28:47.405990 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3f998608-1f7b-43ec-ac83-24c834e80f80 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:47.407744 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3f998608-1f7b-43ec-ac83-24c834e80f80 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] [instance: 8d537fe8-d6d8-4858-a2d0-596abd805ac9] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:47.418573 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3f998608-1f7b-43ec-ac83-24c834e80f80 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:47.419210 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3f998608-1f7b-43ec-ac83-24c834e80f80 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:47.419861 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3f998608-1f7b-43ec-ac83-24c834e80f80 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:47.420905 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3f998608-1f7b-43ec-ac83-24c834e80f80 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:47.421397 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3f998608-1f7b-43ec-ac83-24c834e80f80 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:47.421922 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3f998608-1f7b-43ec-ac83-24c834e80f80 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:47.471777 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-3f998608-1f7b-43ec-ac83-24c834e80f80 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] HTTP exception thrown: Instance 8d537fe8-d6d8-4858-a2d0-596abd805ac9 could not be found. Aug 31 16:28:47.476572 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3f998608-1f7b-43ec-ac83-24c834e80f80 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Request method failure captured: Aug 31 16:28:47.476572 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/8d537fe8-d6d8-4858-a2d0-596abd805ac9 HTTP/1.1 Aug 31 16:28:47.476572 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:28:47.476572 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:28:47.476572 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:28:47.476572 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:28:47.476572 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:28:47.476572 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:28:47.476572 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:28:47.476572 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:28:47.476572 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4wZLJ-DyFFGTHhgEKYLgfSs43zINeu_DNrapeY_k4BXs_rMbN_npwRwn50YfhzsB7Nu0_zL8qi15nhy_YuN7XcI0kPEjhKzckx-kIsgXABQy4PworPczIpdytjMQxVb_QjBwjLANsOmZ8RjvQeitOr6VT_ZmCEOY2b4htlm14k90sI Aug 31 16:28:47.476572 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:28:47.476572 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:28:47.476572 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:28:47.476572 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:28:47.476572 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:28:47.476572 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:28:47.476572 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 7bb6a0a8643748b9830f2859de6d8b5e Aug 31 16:28:47.476572 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-VolumesActionsTest-319567770 Aug 31 16:28:47.476572 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:28:47.476572 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:28:47.476572 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7bb6a0a8643748b9830f2859de6d8b5e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7bb6a0a8643748b9830f2859de6d8b5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7bb6a0a8643748b9830f2859de6d8b5e", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7bb6a0a8643748b9830f2859de6d8b5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:28:47.476572 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-VolumesActionsTest-319567770 Aug 31 16:28:47.476572 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 7bb6a0a8643748b9830f2859de6d8b5e Aug 31 16:28:47.476572 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-VolumesActionsTest-319567770 Aug 31 16:28:47.476572 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-VolumesActionsTest-319567770-project Aug 31 16:28:47.476572 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:28:47.476572 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:28:47.476572 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 7cc4d613cdc94357b40e83a2b70b0bf7 Aug 31 16:28:47.476572 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-VolumesActionsTest-319567770-project Aug 31 16:28:47.476572 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:28:47.476572 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance 8d537fe8-d6d8-4858-a2d0-596abd805ac9 could not be found. Aug 31 16:28:47.476572 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '8d537fe8-d6d8-4858-a2d0-596abd805ac9'} Aug 31 16:28:47.476572 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:28:47.476572 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:28:47.476572 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:28:47.476572 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:28:47.476572 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:28:47.476572 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:28:47.476572 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:28:47.476572 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:28:47.476572 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:28:47.476572 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:28:47.476572 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d537fe8-d6d8-4858-a2d0-596abd805ac9 could not be found. Aug 31 16:28:47.476572 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:28:47.476572 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:28:47.476572 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:28:47.476572 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:28:47.476572 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:28:47.476572 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:28:47.476572 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:28:47.476572 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:28:47.476572 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:28:47.476572 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:28:47.476572 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:28:47.476572 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:28:47.476572 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:28:47.476572 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:28:47.476572 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:28:47.476572 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:28:47.476572 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d537fe8-d6d8-4858-a2d0-596abd805ac9 could not be found. Aug 31 16:28:47.476572 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:28:47.476572 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:28:47.476572 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:28:47.480578 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:28:47.480578 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:28:47.480578 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:28:47.480578 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:28:47.480578 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:28:47.480578 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d537fe8-d6d8-4858-a2d0-596abd805ac9 could not be found. Aug 31 16:28:47.480578 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:28:47.484660 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3f998608-1f7b-43ec-ac83-24c834e80f80 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Returning 404 to user: Instance 8d537fe8-d6d8-4858-a2d0-596abd805ac9 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:28:47.486211 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3f998608-1f7b-43ec-ac83-24c834e80f80 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] 10.222.0.61 "GET /compute/v2.1/servers/8d537fe8-d6d8-4858-a2d0-596abd805ac9" status: 404 len: 111 microversion: 2.1 time: 0.108528 Aug 31 16:28:47.504969 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2916/5859] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:28:47 2022] GET /compute/v2.1/servers/8d537fe8-d6d8-4858-a2d0-596abd805ac9 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:28:47.516453 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2b6e07a9-b0a6-4c7b-9c4e-562bb4a5e5cf tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Calling method '.version_select at 0x7f5ae8667e50>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:47.534527 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2b6e07a9-b0a6-4c7b-9c4e-562bb4a5e5cf tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:47.535037 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2b6e07a9-b0a6-4c7b-9c4e-562bb4a5e5cf tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:47.535624 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2b6e07a9-b0a6-4c7b-9c4e-562bb4a5e5cf tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:47.545907 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2b6e07a9-b0a6-4c7b-9c4e-562bb4a5e5cf tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] [instance: 1b38884c-e9e3-4a03-98d7-e687429cd132] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:47.555900 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2b6e07a9-b0a6-4c7b-9c4e-562bb4a5e5cf tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:47.559399 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2b6e07a9-b0a6-4c7b-9c4e-562bb4a5e5cf tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:47.560308 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2b6e07a9-b0a6-4c7b-9c4e-562bb4a5e5cf tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:47.563787 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2b6e07a9-b0a6-4c7b-9c4e-562bb4a5e5cf tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:47.565686 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2b6e07a9-b0a6-4c7b-9c4e-562bb4a5e5cf tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:47.567783 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2b6e07a9-b0a6-4c7b-9c4e-562bb4a5e5cf tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:47.598904 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8260bcaa-4035-44ef-bc20-68e8e2900e69 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48419c9a6b934406b14d9150af9bbb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1b3cbf1d284da384315bd4f5e1e783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:47.607347 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=95,nova_cell1:DELETE=2,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=1,nova_cell1:RELEASE=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:28:47.640732 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8260bcaa-4035-44ef-bc20-68e8e2900e69 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] 10.222.0.61 "GET /compute/v2.1/servers/c7eaf35b-26b9-4011-8dc8-d5f48201f17e" status: 200 len: 1271 microversion: 2.1 time: 0.312401 Aug 31 16:28:47.643244 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2944/5860] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:28:47 2022] GET /compute/v2.1/servers/c7eaf35b-26b9-4011-8dc8-d5f48201f17e => generated 1271 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:28:47.663827 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2b6e07a9-b0a6-4c7b-9c4e-562bb4a5e5cf tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:47.669434 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2b6e07a9-b0a6-4c7b-9c4e-562bb4a5e5cf tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:47.670162 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2b6e07a9-b0a6-4c7b-9c4e-562bb4a5e5cf tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:47.702226 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2b6e07a9-b0a6-4c7b-9c4e-562bb4a5e5cf tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:47.702893 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2b6e07a9-b0a6-4c7b-9c4e-562bb4a5e5cf tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:47.705017 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2b6e07a9-b0a6-4c7b-9c4e-562bb4a5e5cf tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:47.748741 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-bfac2911-e658-4b13-8590-14ddb706c17c tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-879498372", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "networks": [{"uuid": "94429e53-5601-48f1-920c-7fae90bc775e"}]}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:28:47.766182 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=4,nova_cell1:SAVEPOINT=3,nova_cell1:RELEASE=3,nova_cell1:DELETE=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:28:47.794240 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-2b6e07a9-b0a6-4c7b-9c4e-562bb4a5e5cf tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lazy-loading 'flavor' on Instance uuid 1b38884c-e9e3-4a03-98d7-e687429cd132 {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:28:47.830228 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2b6e07a9-b0a6-4c7b-9c4e-562bb4a5e5cf tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] 10.222.0.61 "PUT /compute/v2.1/servers/1b38884c-e9e3-4a03-98d7-e687429cd132/tags/tempest-tag-1256032239" status: 201 len: 0 microversion: 2.26 time: 0.320860 Aug 31 16:28:47.832356 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2917/5861] 10.222.0.61 () {62 vars in 1380 bytes} [Wed Aug 31 16:28:47 2022] PUT /compute/v2.1/servers/1b38884c-e9e3-4a03-98d7-e687429cd132/tags/tempest-tag-1256032239 => generated 0 bytes in 326 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Aug 31 16:28:47.855797 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-75a9351c-7755-4163-9078-970f368803c7 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Calling method '.version_select at 0x7f5ae946f160>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:47.879169 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-75a9351c-7755-4163-9078-970f368803c7 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:47.880420 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-75a9351c-7755-4163-9078-970f368803c7 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:47.881841 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-75a9351c-7755-4163-9078-970f368803c7 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:47.882547 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-75a9351c-7755-4163-9078-970f368803c7 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] [instance: 1b38884c-e9e3-4a03-98d7-e687429cd132] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:47.904884 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-75a9351c-7755-4163-9078-970f368803c7 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:47.907869 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-75a9351c-7755-4163-9078-970f368803c7 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:47.908802 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-75a9351c-7755-4163-9078-970f368803c7 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:47.914299 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-75a9351c-7755-4163-9078-970f368803c7 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:47.915541 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-75a9351c-7755-4163-9078-970f368803c7 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:47.916454 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-75a9351c-7755-4163-9078-970f368803c7 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:47.967196 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-bfac2911-e658-4b13-8590-14ddb706c17c tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] validate_networks() for [('94429e53-5601-48f1-920c-7fae90bc775e', None, None, None, None, None)] {{(pid=122257) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:28:47.984335 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-75a9351c-7755-4163-9078-970f368803c7 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:47.987586 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-75a9351c-7755-4163-9078-970f368803c7 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:47.988350 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-75a9351c-7755-4163-9078-970f368803c7 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:48.026579 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-75a9351c-7755-4163-9078-970f368803c7 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lazy-loading 'flavor' on Instance uuid 1b38884c-e9e3-4a03-98d7-e687429cd132 {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:28:48.072960 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-75a9351c-7755-4163-9078-970f368803c7 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] 10.222.0.61 "DELETE /compute/v2.1/servers/1b38884c-e9e3-4a03-98d7-e687429cd132/tags" status: 204 len: 0 microversion: 2.26 time: 0.233601 Aug 31 16:28:48.073760 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2918/5862] 10.222.0.61 () {60 vars in 1295 bytes} [Wed Aug 31 16:28:47 2022] DELETE /compute/v2.1/servers/1b38884c-e9e3-4a03-98d7-e687429cd132/tags => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 16:28:48.085625 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-753104ad-8d9a-4fa1-81e4-feb9b2400e3f tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Calling method '.version_select at 0x7f5ae8667940>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:48.110928 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-753104ad-8d9a-4fa1-81e4-feb9b2400e3f tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:48.113002 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-753104ad-8d9a-4fa1-81e4-feb9b2400e3f tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:48.114972 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-753104ad-8d9a-4fa1-81e4-feb9b2400e3f tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:48.150688 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-753104ad-8d9a-4fa1-81e4-feb9b2400e3f tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] 10.222.0.61 "GET /compute/v2.1/servers/1b38884c-e9e3-4a03-98d7-e687429cd132/tags" status: 200 len: 12 microversion: 2.26 time: 0.069806 Aug 31 16:28:48.151732 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2919/5863] 10.222.0.61 () {60 vars in 1292 bytes} [Wed Aug 31 16:28:48 2022] GET /compute/v2.1/servers/1b38884c-e9e3-4a03-98d7-e687429cd132/tags => generated 12 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:28:48.165436 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-617997aa-8bf0-46a5-946e-cfad90f3e594 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Calling method '.version_select at 0x7f5ae86670d0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:48.193139 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-617997aa-8bf0-46a5-946e-cfad90f3e594 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:48.198029 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-617997aa-8bf0-46a5-946e-cfad90f3e594 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:48.198931 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-617997aa-8bf0-46a5-946e-cfad90f3e594 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:48.200119 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-617997aa-8bf0-46a5-946e-cfad90f3e594 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] [instance: 1b38884c-e9e3-4a03-98d7-e687429cd132] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:48.214039 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-617997aa-8bf0-46a5-946e-cfad90f3e594 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:48.221139 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-617997aa-8bf0-46a5-946e-cfad90f3e594 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:48.222284 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-617997aa-8bf0-46a5-946e-cfad90f3e594 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:48.225728 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-617997aa-8bf0-46a5-946e-cfad90f3e594 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:48.230149 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-617997aa-8bf0-46a5-946e-cfad90f3e594 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:48.230628 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-617997aa-8bf0-46a5-946e-cfad90f3e594 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:48.277913 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-617997aa-8bf0-46a5-946e-cfad90f3e594 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:48.279528 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-617997aa-8bf0-46a5-946e-cfad90f3e594 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:48.281231 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-617997aa-8bf0-46a5-946e-cfad90f3e594 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:48.298131 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-617997aa-8bf0-46a5-946e-cfad90f3e594 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lazy-loading 'flavor' on Instance uuid 1b38884c-e9e3-4a03-98d7-e687429cd132 {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:28:48.316294 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-617997aa-8bf0-46a5-946e-cfad90f3e594 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] 10.222.0.61 "DELETE /compute/v2.1/servers/1b38884c-e9e3-4a03-98d7-e687429cd132/tags" status: 204 len: 0 microversion: 2.26 time: 0.156053 Aug 31 16:28:48.318279 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2920/5864] 10.222.0.61 () {60 vars in 1295 bytes} [Wed Aug 31 16:28:48 2022] DELETE /compute/v2.1/servers/1b38884c-e9e3-4a03-98d7-e687429cd132/tags => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 16:28:48.336242 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-89298722-72b7-42aa-aa24-3c4cf3929de9 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Calling method '.version_select at 0x7f5ae858f940>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:48.354845 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-89298722-72b7-42aa-aa24-3c4cf3929de9 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:48.360456 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-89298722-72b7-42aa-aa24-3c4cf3929de9 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:48.361158 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-89298722-72b7-42aa-aa24-3c4cf3929de9 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:48.366231 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-89298722-72b7-42aa-aa24-3c4cf3929de9 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] [instance: 1b38884c-e9e3-4a03-98d7-e687429cd132] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:48.387891 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-89298722-72b7-42aa-aa24-3c4cf3929de9 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:48.388909 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-89298722-72b7-42aa-aa24-3c4cf3929de9 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:48.389723 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-89298722-72b7-42aa-aa24-3c4cf3929de9 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:48.391342 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-89298722-72b7-42aa-aa24-3c4cf3929de9 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:48.394446 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-89298722-72b7-42aa-aa24-3c4cf3929de9 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:48.395115 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-89298722-72b7-42aa-aa24-3c4cf3929de9 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:48.441655 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-89298722-72b7-42aa-aa24-3c4cf3929de9 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:48.442674 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-89298722-72b7-42aa-aa24-3c4cf3929de9 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:48.443762 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-89298722-72b7-42aa-aa24-3c4cf3929de9 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:48.456733 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-89298722-72b7-42aa-aa24-3c4cf3929de9 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:48.458406 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-89298722-72b7-42aa-aa24-3c4cf3929de9 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:48.459097 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-89298722-72b7-42aa-aa24-3c4cf3929de9 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:48.488691 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-89298722-72b7-42aa-aa24-3c4cf3929de9 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lazy-loading 'flavor' on Instance uuid 1b38884c-e9e3-4a03-98d7-e687429cd132 {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:28:48.507940 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-89298722-72b7-42aa-aa24-3c4cf3929de9 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] 10.222.0.61 "PUT /compute/v2.1/servers/1b38884c-e9e3-4a03-98d7-e687429cd132/tags/tempest-tag-1760996455" status: 201 len: 0 microversion: 2.26 time: 0.182967 Aug 31 16:28:48.509399 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2921/5865] 10.222.0.61 () {62 vars in 1380 bytes} [Wed Aug 31 16:28:48 2022] PUT /compute/v2.1/servers/1b38884c-e9e3-4a03-98d7-e687429cd132/tags/tempest-tag-1760996455 => generated 0 bytes in 185 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Aug 31 16:28:48.518749 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e5642c2a-f4a9-48d4-b3b4-ac86841f2502 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:48.520035 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e5642c2a-f4a9-48d4-b3b4-ac86841f2502 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: b31fb01b-045f-41f7-bf58-66c1eca839e8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:48.529731 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e5642c2a-f4a9-48d4-b3b4-ac86841f2502 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:48.530461 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e5642c2a-f4a9-48d4-b3b4-ac86841f2502 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:48.531170 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e5642c2a-f4a9-48d4-b3b4-ac86841f2502 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:48.532406 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e5642c2a-f4a9-48d4-b3b4-ac86841f2502 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:48.533356 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e5642c2a-f4a9-48d4-b3b4-ac86841f2502 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:48.534196 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e5642c2a-f4a9-48d4-b3b4-ac86841f2502 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:49.128936 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e5642c2a-f4a9-48d4-b3b4-ac86841f2502 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:49.144143 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e5642c2a-f4a9-48d4-b3b4-ac86841f2502 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:49.145765 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e5642c2a-f4a9-48d4-b3b4-ac86841f2502 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:49.147006 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e5642c2a-f4a9-48d4-b3b4-ac86841f2502 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8" status: 200 len: 1723 microversion: 2.20 time: 0.636189 Aug 31 16:28:49.148272 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2922/5866] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:28:48 2022] GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8 => generated 1723 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:28:49.153564 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-78b8dc8a-fcb4-41e0-a11b-e326e7a59b0a tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Calling method '.version_select at 0x7f5ae9007310>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:49.164270 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-78b8dc8a-fcb4-41e0-a11b-e326e7a59b0a tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:49.164777 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-78b8dc8a-fcb4-41e0-a11b-e326e7a59b0a tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:49.165219 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-78b8dc8a-fcb4-41e0-a11b-e326e7a59b0a tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:49.165714 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-78b8dc8a-fcb4-41e0-a11b-e326e7a59b0a tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] [instance: 1b38884c-e9e3-4a03-98d7-e687429cd132] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:49.171979 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-78b8dc8a-fcb4-41e0-a11b-e326e7a59b0a tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:49.172598 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-78b8dc8a-fcb4-41e0-a11b-e326e7a59b0a tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:49.173065 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-78b8dc8a-fcb4-41e0-a11b-e326e7a59b0a tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:49.173780 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-78b8dc8a-fcb4-41e0-a11b-e326e7a59b0a tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:49.174456 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-78b8dc8a-fcb4-41e0-a11b-e326e7a59b0a tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:49.175062 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-78b8dc8a-fcb4-41e0-a11b-e326e7a59b0a tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:49.207885 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-78b8dc8a-fcb4-41e0-a11b-e326e7a59b0a tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:49.208753 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-78b8dc8a-fcb4-41e0-a11b-e326e7a59b0a tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:49.209679 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-78b8dc8a-fcb4-41e0-a11b-e326e7a59b0a tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:49.224057 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-78b8dc8a-fcb4-41e0-a11b-e326e7a59b0a tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:49.224830 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-78b8dc8a-fcb4-41e0-a11b-e326e7a59b0a tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:49.225550 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-78b8dc8a-fcb4-41e0-a11b-e326e7a59b0a tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:49.263817 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-78b8dc8a-fcb4-41e0-a11b-e326e7a59b0a tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lazy-loading 'flavor' on Instance uuid 1b38884c-e9e3-4a03-98d7-e687429cd132 {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:28:49.290268 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-78b8dc8a-fcb4-41e0-a11b-e326e7a59b0a tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] 10.222.0.61 "PUT /compute/v2.1/servers/1b38884c-e9e3-4a03-98d7-e687429cd132/tags/tempest-tag-1624505397" status: 201 len: 0 microversion: 2.26 time: 0.140383 Aug 31 16:28:49.297527 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2923/5867] 10.222.0.61 () {62 vars in 1380 bytes} [Wed Aug 31 16:28:49 2022] PUT /compute/v2.1/servers/1b38884c-e9e3-4a03-98d7-e687429cd132/tags/tempest-tag-1624505397 => generated 0 bytes in 143 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Aug 31 16:28:49.302216 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-deaeb5b4-b2d3-41c3-9008-117cf280effd tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:49.303947 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-deaeb5b4-b2d3-41c3-9008-117cf280effd tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] [instance: c7eaf35b-26b9-4011-8dc8-d5f48201f17e] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:49.315149 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-deaeb5b4-b2d3-41c3-9008-117cf280effd tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:49.315737 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-deaeb5b4-b2d3-41c3-9008-117cf280effd tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:49.316503 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-deaeb5b4-b2d3-41c3-9008-117cf280effd tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:49.317333 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-deaeb5b4-b2d3-41c3-9008-117cf280effd tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:49.317799 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-deaeb5b4-b2d3-41c3-9008-117cf280effd tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:49.318512 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-deaeb5b4-b2d3-41c3-9008-117cf280effd tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:49.564527 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-deaeb5b4-b2d3-41c3-9008-117cf280effd tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48419c9a6b934406b14d9150af9bbb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1b3cbf1d284da384315bd4f5e1e783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:49.593543 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-deaeb5b4-b2d3-41c3-9008-117cf280effd tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] 10.222.0.61 "GET /compute/v2.1/servers/c7eaf35b-26b9-4011-8dc8-d5f48201f17e" status: 200 len: 1271 microversion: 2.1 time: 0.299854 Aug 31 16:28:49.594430 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2924/5868] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:28:49 2022] GET /compute/v2.1/servers/c7eaf35b-26b9-4011-8dc8-d5f48201f17e => generated 1271 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:28:49.608553 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-da923021-881e-4bf2-87f7-c6b3c0ba3e8b tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Action: 'update_all', calling method: .version_select at 0x7f5ae86a78b0>, body: {"tags": ["tempest-tag-457204428", "tempest-tag-1028641095"]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:28:49.650056 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-da923021-881e-4bf2-87f7-c6b3c0ba3e8b tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:49.651900 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-da923021-881e-4bf2-87f7-c6b3c0ba3e8b tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:49.654100 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-da923021-881e-4bf2-87f7-c6b3c0ba3e8b tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:49.655992 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-da923021-881e-4bf2-87f7-c6b3c0ba3e8b tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] [instance: 1b38884c-e9e3-4a03-98d7-e687429cd132] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:49.687912 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-da923021-881e-4bf2-87f7-c6b3c0ba3e8b tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:49.689212 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-da923021-881e-4bf2-87f7-c6b3c0ba3e8b tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:49.696142 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-da923021-881e-4bf2-87f7-c6b3c0ba3e8b tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:49.698046 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-da923021-881e-4bf2-87f7-c6b3c0ba3e8b tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:49.700050 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-da923021-881e-4bf2-87f7-c6b3c0ba3e8b tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:49.705289 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-da923021-881e-4bf2-87f7-c6b3c0ba3e8b tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:49.714295 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-bfac2911-e658-4b13-8590-14ddb706c17c tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:28:49.714989 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-bfac2911-e658-4b13-8590-14ddb706c17c tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:28:49.715184 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-bfac2911-e658-4b13-8590-14ddb706c17c tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:28:49.715812 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-bfac2911-e658-4b13-8590-14ddb706c17c tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:28:49.716417 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-bfac2911-e658-4b13-8590-14ddb706c17c tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:28:49.738577 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bfac2911-e658-4b13-8590-14ddb706c17c tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:49.739491 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bfac2911-e658-4b13-8590-14ddb706c17c tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:49.740302 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bfac2911-e658-4b13-8590-14ddb706c17c tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:49.744121 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-da923021-881e-4bf2-87f7-c6b3c0ba3e8b tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:49.744713 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-da923021-881e-4bf2-87f7-c6b3c0ba3e8b tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:49.745384 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-da923021-881e-4bf2-87f7-c6b3c0ba3e8b tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:49.745814 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bfac2911-e658-4b13-8590-14ddb706c17c tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:49.746551 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bfac2911-e658-4b13-8590-14ddb706c17c tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:49.747391 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bfac2911-e658-4b13-8590-14ddb706c17c tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:49.778818 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-da923021-881e-4bf2-87f7-c6b3c0ba3e8b tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lazy-loading 'flavor' on Instance uuid 1b38884c-e9e3-4a03-98d7-e687429cd132 {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:28:49.796108 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-bfac2911-e658-4b13-8590-14ddb706c17c tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Getting quotas for project 7bb6a0a8643748b9830f2859de6d8b5e. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:28:49.810215 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-bfac2911-e658-4b13-8590-14ddb706c17c tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Getting quotas for user 7cc4d613cdc94357b40e83a2b70b0bf7 and project 7bb6a0a8643748b9830f2859de6d8b5e. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:28:49.833786 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-bfac2911-e658-4b13-8590-14ddb706c17c tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Going to run 1 instances... {{(pid=122257) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:28:49.837945 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-da923021-881e-4bf2-87f7-c6b3c0ba3e8b tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] 10.222.0.61 "PUT /compute/v2.1/servers/1b38884c-e9e3-4a03-98d7-e687429cd132/tags" status: 200 len: 61 microversion: 2.26 time: 0.240717 Aug 31 16:28:49.838200 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-bfac2911-e658-4b13-8590-14ddb706c17c tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] [instance: fcaf0da3-ec31-4531-b09f-263f7d188b06] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:28:49.843580 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2925/5869] 10.222.0.61 () {62 vars in 1312 bytes} [Wed Aug 31 16:28:49 2022] PUT /compute/v2.1/servers/1b38884c-e9e3-4a03-98d7-e687429cd132/tags => generated 61 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:28:49.858237 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d4156fd7-6ac5-4449-ba08-59bed43126b5 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Calling method '.version_select at 0x7f5aed263b80>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:49.880353 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d4156fd7-6ac5-4449-ba08-59bed43126b5 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:49.880832 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d4156fd7-6ac5-4449-ba08-59bed43126b5 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:49.887314 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d4156fd7-6ac5-4449-ba08-59bed43126b5 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:49.925298 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d4156fd7-6ac5-4449-ba08-59bed43126b5 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] 10.222.0.61 "GET /compute/v2.1/servers/1b38884c-e9e3-4a03-98d7-e687429cd132/tags" status: 200 len: 61 microversion: 2.26 time: 0.079111 Aug 31 16:28:49.931564 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2926/5870] 10.222.0.61 () {60 vars in 1292 bytes} [Wed Aug 31 16:28:49 2022] GET /compute/v2.1/servers/1b38884c-e9e3-4a03-98d7-e687429cd132/tags => generated 61 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:28:49.938499 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c1963c5a-2853-450a-9e7f-35bc34393451 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Calling method '.version_select at 0x7f5ae8fea430>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:49.964487 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c1963c5a-2853-450a-9e7f-35bc34393451 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:49.968077 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-bfac2911-e658-4b13-8590-14ddb706c17c tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.225438 Aug 31 16:28:49.968574 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c1963c5a-2853-450a-9e7f-35bc34393451 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:49.969967 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c1963c5a-2853-450a-9e7f-35bc34393451 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:49.976099 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2945/5871] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:28:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 2236 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 16:28:49.977263 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c1963c5a-2853-450a-9e7f-35bc34393451 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] [instance: 1b38884c-e9e3-4a03-98d7-e687429cd132] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:49.988096 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c1963c5a-2853-450a-9e7f-35bc34393451 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:49.988852 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c1963c5a-2853-450a-9e7f-35bc34393451 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:49.989464 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c1963c5a-2853-450a-9e7f-35bc34393451 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:49.991605 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c1963c5a-2853-450a-9e7f-35bc34393451 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:49.994448 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c1963c5a-2853-450a-9e7f-35bc34393451 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:49.995208 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c1963c5a-2853-450a-9e7f-35bc34393451 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:50.003325 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-454e7e55-ac54-400e-9bc8-109e1991dbc0 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:50.004375 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-454e7e55-ac54-400e-9bc8-109e1991dbc0 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] [instance: fcaf0da3-ec31-4531-b09f-263f7d188b06] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:50.058210 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c1963c5a-2853-450a-9e7f-35bc34393451 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:50.059324 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c1963c5a-2853-450a-9e7f-35bc34393451 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:50.060090 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c1963c5a-2853-450a-9e7f-35bc34393451 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:50.091395 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-c1963c5a-2853-450a-9e7f-35bc34393451 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lazy-loading 'flavor' on Instance uuid 1b38884c-e9e3-4a03-98d7-e687429cd132 {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:28:50.128239 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c1963c5a-2853-450a-9e7f-35bc34393451 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] 10.222.0.61 "DELETE /compute/v2.1/servers/1b38884c-e9e3-4a03-98d7-e687429cd132/tags" status: 204 len: 0 microversion: 2.26 time: 0.195317 Aug 31 16:28:50.130337 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2927/5872] 10.222.0.61 () {60 vars in 1295 bytes} [Wed Aug 31 16:28:49 2022] DELETE /compute/v2.1/servers/1b38884c-e9e3-4a03-98d7-e687429cd132/tags => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 16:28:50.154946 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ddaade84-30b9-42f0-97db-671be025a9d5 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:50.155816 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ddaade84-30b9-42f0-97db-671be025a9d5 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] [instance: 1b38884c-e9e3-4a03-98d7-e687429cd132] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:50.165137 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ddaade84-30b9-42f0-97db-671be025a9d5 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:50.166269 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ddaade84-30b9-42f0-97db-671be025a9d5 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:50.167244 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ddaade84-30b9-42f0-97db-671be025a9d5 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:50.169417 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ddaade84-30b9-42f0-97db-671be025a9d5 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:50.171403 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ddaade84-30b9-42f0-97db-671be025a9d5 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:50.172444 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ddaade84-30b9-42f0-97db-671be025a9d5 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:50.247992 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ddaade84-30b9-42f0-97db-671be025a9d5 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] [instance: 1b38884c-e9e3-4a03-98d7-e687429cd132] Going to try to terminate instance {{(pid=122256) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:28:50.257819 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=89,nova_cell1:DELETE=4,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=3,nova_cell1:RELEASE=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:28:50.444364 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-454e7e55-ac54-400e-9bc8-109e1991dbc0 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc4d613cdc94357b40e83a2b70b0bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb6a0a8643748b9830f2859de6d8b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:50.448511 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ddaade84-30b9-42f0-97db-671be025a9d5 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] 10.222.0.61 "DELETE /compute/v2.1/servers/1b38884c-e9e3-4a03-98d7-e687429cd132" status: 204 len: 0 microversion: 2.26 time: 0.305666 Aug 31 16:28:50.450430 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2928/5873] 10.222.0.61 () {60 vars in 1280 bytes} [Wed Aug 31 16:28:50 2022] DELETE /compute/v2.1/servers/1b38884c-e9e3-4a03-98d7-e687429cd132 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 16:28:50.466553 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-92780095-9611-41e4-afea-c65ce28259db tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:50.467160 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-454e7e55-ac54-400e-9bc8-109e1991dbc0 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] 10.222.0.61 "GET /compute/v2.1/servers/fcaf0da3-ec31-4531-b09f-263f7d188b06" status: 200 len: 1213 microversion: 2.1 time: 0.484905 Aug 31 16:28:50.467802 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2946/5874] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:28:49 2022] GET /compute/v2.1/servers/fcaf0da3-ec31-4531-b09f-263f7d188b06 => generated 1213 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:28:50.468666 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-92780095-9611-41e4-afea-c65ce28259db tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: b31fb01b-045f-41f7-bf58-66c1eca839e8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:50.486719 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-92780095-9611-41e4-afea-c65ce28259db tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:50.487604 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-92780095-9611-41e4-afea-c65ce28259db tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:50.488369 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-92780095-9611-41e4-afea-c65ce28259db tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:50.490947 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d71b62db-1b0f-4d62-bb5a-54db3ac67864 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:50.491146 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-92780095-9611-41e4-afea-c65ce28259db tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:50.492040 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-92780095-9611-41e4-afea-c65ce28259db tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:50.492993 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-92780095-9611-41e4-afea-c65ce28259db tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:50.493637 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d71b62db-1b0f-4d62-bb5a-54db3ac67864 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] [instance: 1b38884c-e9e3-4a03-98d7-e687429cd132] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:50.507294 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d71b62db-1b0f-4d62-bb5a-54db3ac67864 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:50.508302 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d71b62db-1b0f-4d62-bb5a-54db3ac67864 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:50.509184 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d71b62db-1b0f-4d62-bb5a-54db3ac67864 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:50.514277 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d71b62db-1b0f-4d62-bb5a-54db3ac67864 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:50.515093 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d71b62db-1b0f-4d62-bb5a-54db3ac67864 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:50.515840 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d71b62db-1b0f-4d62-bb5a-54db3ac67864 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:51.097854 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d71b62db-1b0f-4d62-bb5a-54db3ac67864 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96a6b97c3c458a88ebc013157332ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d753dee849a4318a4711fa5e4791e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:51.116145 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d71b62db-1b0f-4d62-bb5a-54db3ac67864 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc96a6b97c3c458a88ebc013157332ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d753dee849a4318a4711fa5e4791e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:51.122076 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d71b62db-1b0f-4d62-bb5a-54db3ac67864 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc96a6b97c3c458a88ebc013157332ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d753dee849a4318a4711fa5e4791e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:51.131754 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d71b62db-1b0f-4d62-bb5a-54db3ac67864 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] 10.222.0.61 "GET /compute/v2.1/servers/1b38884c-e9e3-4a03-98d7-e687429cd132" status: 200 len: 1551 microversion: 2.26 time: 0.660150 Aug 31 16:28:51.133033 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2947/5875] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:28:50 2022] GET /compute/v2.1/servers/1b38884c-e9e3-4a03-98d7-e687429cd132 => generated 1551 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:28:51.155012 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2be73aa6-ed88-45aa-89de-e62f3c2e5319 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:51.156837 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2be73aa6-ed88-45aa-89de-e62f3c2e5319 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] [instance: c7eaf35b-26b9-4011-8dc8-d5f48201f17e] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:51.179535 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2be73aa6-ed88-45aa-89de-e62f3c2e5319 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:51.181220 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2be73aa6-ed88-45aa-89de-e62f3c2e5319 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:51.182540 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2be73aa6-ed88-45aa-89de-e62f3c2e5319 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:51.187286 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2be73aa6-ed88-45aa-89de-e62f3c2e5319 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:51.188939 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-92780095-9611-41e4-afea-c65ce28259db tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:51.189587 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2be73aa6-ed88-45aa-89de-e62f3c2e5319 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:51.190775 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2be73aa6-ed88-45aa-89de-e62f3c2e5319 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:51.205466 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-92780095-9611-41e4-afea-c65ce28259db tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:51.207147 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-92780095-9611-41e4-afea-c65ce28259db tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:51.213255 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-92780095-9611-41e4-afea-c65ce28259db tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8" status: 200 len: 1723 microversion: 2.20 time: 0.760702 Aug 31 16:28:51.213864 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2929/5876] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:28:50 2022] GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8 => generated 1723 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:28:51.492844 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c02c67b4-31f1-49a6-b594-7a101d9b7538 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:51.500812 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c02c67b4-31f1-49a6-b594-7a101d9b7538 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] [instance: fcaf0da3-ec31-4531-b09f-263f7d188b06] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:51.522403 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c02c67b4-31f1-49a6-b594-7a101d9b7538 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:51.523714 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c02c67b4-31f1-49a6-b594-7a101d9b7538 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:51.524180 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c02c67b4-31f1-49a6-b594-7a101d9b7538 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:51.524941 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c02c67b4-31f1-49a6-b594-7a101d9b7538 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:51.533757 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c02c67b4-31f1-49a6-b594-7a101d9b7538 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:51.534411 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c02c67b4-31f1-49a6-b594-7a101d9b7538 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:51.759816 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c02c67b4-31f1-49a6-b594-7a101d9b7538 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc4d613cdc94357b40e83a2b70b0bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb6a0a8643748b9830f2859de6d8b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:51.783792 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c02c67b4-31f1-49a6-b594-7a101d9b7538 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] 10.222.0.61 "GET /compute/v2.1/servers/fcaf0da3-ec31-4531-b09f-263f7d188b06" status: 200 len: 1265 microversion: 2.1 time: 0.295919 Aug 31 16:28:51.784430 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2930/5877] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:28:51 2022] GET /compute/v2.1/servers/fcaf0da3-ec31-4531-b09f-263f7d188b06 => generated 1265 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:28:51.873937 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2be73aa6-ed88-45aa-89de-e62f3c2e5319 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48419c9a6b934406b14d9150af9bbb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1b3cbf1d284da384315bd4f5e1e783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:51.904254 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2be73aa6-ed88-45aa-89de-e62f3c2e5319 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] 10.222.0.61 "GET /compute/v2.1/servers/c7eaf35b-26b9-4011-8dc8-d5f48201f17e" status: 200 len: 1313 microversion: 2.1 time: 0.764147 Aug 31 16:28:51.930136 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2948/5878] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:28:51 2022] GET /compute/v2.1/servers/c7eaf35b-26b9-4011-8dc8-d5f48201f17e => generated 1313 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:28:52.171919 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5f21b8ae-2c20-4dec-901d-af384e7cd5c5 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:52.172784 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5f21b8ae-2c20-4dec-901d-af384e7cd5c5 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] [instance: 1b38884c-e9e3-4a03-98d7-e687429cd132] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:52.202313 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5f21b8ae-2c20-4dec-901d-af384e7cd5c5 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:52.205384 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5f21b8ae-2c20-4dec-901d-af384e7cd5c5 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:52.206286 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5f21b8ae-2c20-4dec-901d-af384e7cd5c5 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:52.213344 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5f21b8ae-2c20-4dec-901d-af384e7cd5c5 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:52.215926 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5f21b8ae-2c20-4dec-901d-af384e7cd5c5 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:52.216935 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5f21b8ae-2c20-4dec-901d-af384e7cd5c5 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:52.251270 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-716ccd72-8e1f-4842-8f97-31f1e5574f2e tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:52.253273 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-716ccd72-8e1f-4842-8f97-31f1e5574f2e tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: b31fb01b-045f-41f7-bf58-66c1eca839e8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:52.270385 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-716ccd72-8e1f-4842-8f97-31f1e5574f2e tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:52.278872 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-716ccd72-8e1f-4842-8f97-31f1e5574f2e tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:52.280147 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-716ccd72-8e1f-4842-8f97-31f1e5574f2e tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:52.285540 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-716ccd72-8e1f-4842-8f97-31f1e5574f2e tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:52.286725 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-716ccd72-8e1f-4842-8f97-31f1e5574f2e tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:52.288936 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-716ccd72-8e1f-4842-8f97-31f1e5574f2e tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:52.737644 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:28:52.782451 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5f21b8ae-2c20-4dec-901d-af384e7cd5c5 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96a6b97c3c458a88ebc013157332ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d753dee849a4318a4711fa5e4791e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:52.801486 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5f21b8ae-2c20-4dec-901d-af384e7cd5c5 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc96a6b97c3c458a88ebc013157332ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d753dee849a4318a4711fa5e4791e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:52.804021 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5f21b8ae-2c20-4dec-901d-af384e7cd5c5 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc96a6b97c3c458a88ebc013157332ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d753dee849a4318a4711fa5e4791e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:52.807369 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5f21b8ae-2c20-4dec-901d-af384e7cd5c5 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] 10.222.0.61 "GET /compute/v2.1/servers/1b38884c-e9e3-4a03-98d7-e687429cd132" status: 200 len: 1551 microversion: 2.26 time: 0.649589 Aug 31 16:28:52.810525 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2931/5879] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:28:52 2022] GET /compute/v2.1/servers/1b38884c-e9e3-4a03-98d7-e687429cd132 => generated 1551 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:28:52.838883 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f0d5f793-365f-4712-8cf8-e6b81988c263 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:52.844257 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f0d5f793-365f-4712-8cf8-e6b81988c263 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] [instance: fcaf0da3-ec31-4531-b09f-263f7d188b06] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:52.850429 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-716ccd72-8e1f-4842-8f97-31f1e5574f2e tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:52.859350 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f0d5f793-365f-4712-8cf8-e6b81988c263 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:52.860813 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f0d5f793-365f-4712-8cf8-e6b81988c263 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:52.861557 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f0d5f793-365f-4712-8cf8-e6b81988c263 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:52.867368 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f0d5f793-365f-4712-8cf8-e6b81988c263 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:52.868226 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f0d5f793-365f-4712-8cf8-e6b81988c263 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:52.868985 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f0d5f793-365f-4712-8cf8-e6b81988c263 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:52.880752 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-716ccd72-8e1f-4842-8f97-31f1e5574f2e tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:52.888432 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-716ccd72-8e1f-4842-8f97-31f1e5574f2e tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:52.894608 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-716ccd72-8e1f-4842-8f97-31f1e5574f2e tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8" status: 200 len: 1723 microversion: 2.20 time: 0.649911 Aug 31 16:28:52.911713 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2949/5880] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:28:52 2022] GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8 => generated 1723 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:28:52.937105 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f67fd09f-61ad-42f6-b12d-d8dfdca2f3de tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:52.938493 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f67fd09f-61ad-42f6-b12d-d8dfdca2f3de tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] [instance: c7eaf35b-26b9-4011-8dc8-d5f48201f17e] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:52.939971 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:28:52.965736 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f67fd09f-61ad-42f6-b12d-d8dfdca2f3de tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:52.968686 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f67fd09f-61ad-42f6-b12d-d8dfdca2f3de tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:52.969674 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f67fd09f-61ad-42f6-b12d-d8dfdca2f3de tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:52.970651 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f67fd09f-61ad-42f6-b12d-d8dfdca2f3de tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:52.971885 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f67fd09f-61ad-42f6-b12d-d8dfdca2f3de tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:52.972617 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f67fd09f-61ad-42f6-b12d-d8dfdca2f3de tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:53.080668 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f0d5f793-365f-4712-8cf8-e6b81988c263 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc4d613cdc94357b40e83a2b70b0bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb6a0a8643748b9830f2859de6d8b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:53.117525 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f0d5f793-365f-4712-8cf8-e6b81988c263 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] 10.222.0.61 "GET /compute/v2.1/servers/fcaf0da3-ec31-4531-b09f-263f7d188b06" status: 200 len: 1271 microversion: 2.1 time: 0.291176 Aug 31 16:28:53.123453 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2932/5881] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:28:52 2022] GET /compute/v2.1/servers/fcaf0da3-ec31-4531-b09f-263f7d188b06 => generated 1271 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:28:53.170550 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-22ca486b-d0a7-4a19-a4ab-67793c91e91f req-ba74518b-6652-47ed-b58a-8a8d423c81e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7eaf35b-26b9-4011-8dc8-d5f48201f17e", "tag": "3d2b982b-9f9f-40db-8265-e4543d87210b"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:28:53.198909 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:28:53.242382 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-22ca486b-d0a7-4a19-a4ab-67793c91e91f req-ba74518b-6652-47ed-b58a-8a8d423c81e8 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:53.243589 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-22ca486b-d0a7-4a19-a4ab-67793c91e91f req-ba74518b-6652-47ed-b58a-8a8d423c81e8 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:53.245089 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-22ca486b-d0a7-4a19-a4ab-67793c91e91f req-ba74518b-6652-47ed-b58a-8a8d423c81e8 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:53.285985 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-22ca486b-d0a7-4a19-a4ab-67793c91e91f req-ba74518b-6652-47ed-b58a-8a8d423c81e8 service nova] Creating event network-changed:3d2b982b-9f9f-40db-8265-e4543d87210b for instance c7eaf35b-26b9-4011-8dc8-d5f48201f17e on n-h2-850499-9 Aug 31 16:28:53.299206 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-22ca486b-d0a7-4a19-a4ab-67793c91e91f req-ba74518b-6652-47ed-b58a-8a8d423c81e8 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.159302 Aug 31 16:28:53.306091 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2933/5882] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:28:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:28:53.641156 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f67fd09f-61ad-42f6-b12d-d8dfdca2f3de tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48419c9a6b934406b14d9150af9bbb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1b3cbf1d284da384315bd4f5e1e783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:53.663164 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f67fd09f-61ad-42f6-b12d-d8dfdca2f3de tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] 10.222.0.61 "GET /compute/v2.1/servers/c7eaf35b-26b9-4011-8dc8-d5f48201f17e" status: 200 len: 1313 microversion: 2.1 time: 0.729156 Aug 31 16:28:53.664450 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2950/5883] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:28:52 2022] GET /compute/v2.1/servers/c7eaf35b-26b9-4011-8dc8-d5f48201f17e => generated 1313 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:28:53.839649 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a864cf94-57ad-48fc-b793-888b7e3e360f tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:53.841103 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a864cf94-57ad-48fc-b793-888b7e3e360f tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] [instance: 1b38884c-e9e3-4a03-98d7-e687429cd132] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:53.863199 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a864cf94-57ad-48fc-b793-888b7e3e360f tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:53.864560 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a864cf94-57ad-48fc-b793-888b7e3e360f tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:53.866108 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a864cf94-57ad-48fc-b793-888b7e3e360f tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:53.867977 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a864cf94-57ad-48fc-b793-888b7e3e360f tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:53.869118 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a864cf94-57ad-48fc-b793-888b7e3e360f tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:53.879872 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a864cf94-57ad-48fc-b793-888b7e3e360f tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:53.941785 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e30604e5-e11b-4498-b36a-4c4abde796c2 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:53.942450 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e30604e5-e11b-4498-b36a-4c4abde796c2 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: b31fb01b-045f-41f7-bf58-66c1eca839e8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:53.954937 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e30604e5-e11b-4498-b36a-4c4abde796c2 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:53.955447 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e30604e5-e11b-4498-b36a-4c4abde796c2 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:53.956166 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e30604e5-e11b-4498-b36a-4c4abde796c2 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:53.957594 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e30604e5-e11b-4498-b36a-4c4abde796c2 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:53.958257 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e30604e5-e11b-4498-b36a-4c4abde796c2 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:53.958712 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e30604e5-e11b-4498-b36a-4c4abde796c2 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:54.401143 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a864cf94-57ad-48fc-b793-888b7e3e360f tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96a6b97c3c458a88ebc013157332ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d753dee849a4318a4711fa5e4791e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:54.420347 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a864cf94-57ad-48fc-b793-888b7e3e360f tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc96a6b97c3c458a88ebc013157332ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d753dee849a4318a4711fa5e4791e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:54.423065 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a864cf94-57ad-48fc-b793-888b7e3e360f tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc96a6b97c3c458a88ebc013157332ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d753dee849a4318a4711fa5e4791e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:54.428619 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a864cf94-57ad-48fc-b793-888b7e3e360f tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] 10.222.0.61 "GET /compute/v2.1/servers/1b38884c-e9e3-4a03-98d7-e687429cd132" status: 200 len: 1551 microversion: 2.26 time: 0.592631 Aug 31 16:28:54.446187 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2934/5884] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:28:53 2022] GET /compute/v2.1/servers/1b38884c-e9e3-4a03-98d7-e687429cd132 => generated 1551 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:28:54.463894 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b7ff927c-0098-4da4-a661-1f3c74a43361 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:54.464526 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b7ff927c-0098-4da4-a661-1f3c74a43361 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] [instance: fcaf0da3-ec31-4531-b09f-263f7d188b06] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:54.481001 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b7ff927c-0098-4da4-a661-1f3c74a43361 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:54.481513 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b7ff927c-0098-4da4-a661-1f3c74a43361 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:54.481965 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b7ff927c-0098-4da4-a661-1f3c74a43361 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:54.483437 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b7ff927c-0098-4da4-a661-1f3c74a43361 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:54.483951 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b7ff927c-0098-4da4-a661-1f3c74a43361 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:54.484594 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b7ff927c-0098-4da4-a661-1f3c74a43361 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:54.497942 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e30604e5-e11b-4498-b36a-4c4abde796c2 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:54.520674 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e30604e5-e11b-4498-b36a-4c4abde796c2 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:54.524425 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e30604e5-e11b-4498-b36a-4c4abde796c2 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:54.525670 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e30604e5-e11b-4498-b36a-4c4abde796c2 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8" status: 200 len: 1744 microversion: 2.20 time: 0.599057 Aug 31 16:28:54.530463 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2951/5885] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:28:53 2022] GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8 => generated 1744 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:28:54.616769 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-5defb08f-af01-457e-a91f-015f57b14d61 req-ae27f248-e0e5-4560-a0ed-525058c4fbdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b38884c-e9e3-4a03-98d7-e687429cd132", "name": "network-vif-deleted", "tag": "066cd027-ed89-4e4f-9c18-438760e9427e"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:28:54.640820 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-5defb08f-af01-457e-a91f-015f57b14d61 req-ae27f248-e0e5-4560-a0ed-525058c4fbdb service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:54.641315 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-5defb08f-af01-457e-a91f-015f57b14d61 req-ae27f248-e0e5-4560-a0ed-525058c4fbdb service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:54.641840 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-5defb08f-af01-457e-a91f-015f57b14d61 req-ae27f248-e0e5-4560-a0ed-525058c4fbdb service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:54.674231 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-5defb08f-af01-457e-a91f-015f57b14d61 req-ae27f248-e0e5-4560-a0ed-525058c4fbdb service nova] Creating event network-vif-deleted:066cd027-ed89-4e4f-9c18-438760e9427e for instance 1b38884c-e9e3-4a03-98d7-e687429cd132 on n-h1-850499-9 Aug 31 16:28:54.685907 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-5defb08f-af01-457e-a91f-015f57b14d61 req-ae27f248-e0e5-4560-a0ed-525058c4fbdb service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069420 Aug 31 16:28:54.687134 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2952/5886] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:28:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:28:54.692693 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-04dbc5cf-6fb2-485e-ad89-c94a4ae7be39 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:54.699588 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-04dbc5cf-6fb2-485e-ad89-c94a4ae7be39 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] [instance: c7eaf35b-26b9-4011-8dc8-d5f48201f17e] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:54.716204 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-04dbc5cf-6fb2-485e-ad89-c94a4ae7be39 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:54.720414 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-04dbc5cf-6fb2-485e-ad89-c94a4ae7be39 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:54.721186 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-04dbc5cf-6fb2-485e-ad89-c94a4ae7be39 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:54.722190 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-04dbc5cf-6fb2-485e-ad89-c94a4ae7be39 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:54.722825 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-04dbc5cf-6fb2-485e-ad89-c94a4ae7be39 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:54.723651 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-04dbc5cf-6fb2-485e-ad89-c94a4ae7be39 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:55.314368 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b7ff927c-0098-4da4-a661-1f3c74a43361 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc4d613cdc94357b40e83a2b70b0bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb6a0a8643748b9830f2859de6d8b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:55.322905 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-04dbc5cf-6fb2-485e-ad89-c94a4ae7be39 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48419c9a6b934406b14d9150af9bbb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1b3cbf1d284da384315bd4f5e1e783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:55.331354 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b7ff927c-0098-4da4-a661-1f3c74a43361 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] 10.222.0.61 "GET /compute/v2.1/servers/fcaf0da3-ec31-4531-b09f-263f7d188b06" status: 200 len: 1313 microversion: 2.1 time: 0.883540 Aug 31 16:28:55.343765 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2935/5887] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:28:54 2022] GET /compute/v2.1/servers/fcaf0da3-ec31-4531-b09f-263f7d188b06 => generated 1313 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:28:55.344114 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-04dbc5cf-6fb2-485e-ad89-c94a4ae7be39 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] 10.222.0.61 "GET /compute/v2.1/servers/c7eaf35b-26b9-4011-8dc8-d5f48201f17e" status: 200 len: 1313 microversion: 2.1 time: 0.654513 Aug 31 16:28:55.344378 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2953/5888] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:28:54 2022] GET /compute/v2.1/servers/c7eaf35b-26b9-4011-8dc8-d5f48201f17e => generated 1313 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:28:55.461922 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3812def6-7be4-498b-9ecf-6afd19a6a1f9 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:55.463226 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3812def6-7be4-498b-9ecf-6afd19a6a1f9 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] [instance: 1b38884c-e9e3-4a03-98d7-e687429cd132] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:55.482634 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3812def6-7be4-498b-9ecf-6afd19a6a1f9 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:55.483833 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3812def6-7be4-498b-9ecf-6afd19a6a1f9 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:55.491094 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3812def6-7be4-498b-9ecf-6afd19a6a1f9 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:55.492383 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3812def6-7be4-498b-9ecf-6afd19a6a1f9 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:55.493078 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3812def6-7be4-498b-9ecf-6afd19a6a1f9 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:55.493712 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3812def6-7be4-498b-9ecf-6afd19a6a1f9 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:55.566873 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3812def6-7be4-498b-9ecf-6afd19a6a1f9 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:55.567402 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3812def6-7be4-498b-9ecf-6afd19a6a1f9 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:55.568026 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3812def6-7be4-498b-9ecf-6afd19a6a1f9 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:55.568337 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-3812def6-7be4-498b-9ecf-6afd19a6a1f9 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lazy-loading 'fault' on Instance uuid 1b38884c-e9e3-4a03-98d7-e687429cd132 {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:28:55.573845 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c1e28d93-4d19-4b14-b914-2f78392e1657 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:55.577490 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c1e28d93-4d19-4b14-b914-2f78392e1657 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: b31fb01b-045f-41f7-bf58-66c1eca839e8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:55.609009 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c1e28d93-4d19-4b14-b914-2f78392e1657 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:55.615222 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c1e28d93-4d19-4b14-b914-2f78392e1657 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:55.616883 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c1e28d93-4d19-4b14-b914-2f78392e1657 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:55.621563 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c1e28d93-4d19-4b14-b914-2f78392e1657 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:55.622529 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c1e28d93-4d19-4b14-b914-2f78392e1657 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:55.625712 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c1e28d93-4d19-4b14-b914-2f78392e1657 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:55.687708 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3812def6-7be4-498b-9ecf-6afd19a6a1f9 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc96a6b97c3c458a88ebc013157332ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d753dee849a4318a4711fa5e4791e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:55.704767 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3812def6-7be4-498b-9ecf-6afd19a6a1f9 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc96a6b97c3c458a88ebc013157332ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d753dee849a4318a4711fa5e4791e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:55.706954 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3812def6-7be4-498b-9ecf-6afd19a6a1f9 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc96a6b97c3c458a88ebc013157332ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d753dee849a4318a4711fa5e4791e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:55.709387 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3812def6-7be4-498b-9ecf-6afd19a6a1f9 tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] 10.222.0.61 "GET /compute/v2.1/servers/1b38884c-e9e3-4a03-98d7-e687429cd132" status: 200 len: 1352 microversion: 2.26 time: 0.255606 Aug 31 16:28:55.711363 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2936/5889] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:28:55 2022] GET /compute/v2.1/servers/1b38884c-e9e3-4a03-98d7-e687429cd132 => generated 1352 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:28:55.943256 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c1e28d93-4d19-4b14-b914-2f78392e1657 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:55.958904 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c1e28d93-4d19-4b14-b914-2f78392e1657 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:55.962076 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c1e28d93-4d19-4b14-b914-2f78392e1657 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:55.965201 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c1e28d93-4d19-4b14-b914-2f78392e1657 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8" status: 200 len: 1744 microversion: 2.20 time: 0.402121 Aug 31 16:28:55.975611 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2954/5890] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:28:55 2022] GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8 => generated 1744 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:28:56.358398 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-02dba34f-c63f-49ec-8a20-3060c49f6ff1 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:56.359644 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-02dba34f-c63f-49ec-8a20-3060c49f6ff1 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] [instance: fcaf0da3-ec31-4531-b09f-263f7d188b06] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:56.369802 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e4555751-dff9-4220-85d6-99cd7d0c41d5 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:56.370678 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e4555751-dff9-4220-85d6-99cd7d0c41d5 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] [instance: c7eaf35b-26b9-4011-8dc8-d5f48201f17e] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:56.386767 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e4555751-dff9-4220-85d6-99cd7d0c41d5 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:56.388614 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-02dba34f-c63f-49ec-8a20-3060c49f6ff1 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:56.389357 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e4555751-dff9-4220-85d6-99cd7d0c41d5 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:56.389817 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e4555751-dff9-4220-85d6-99cd7d0c41d5 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:56.390561 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e4555751-dff9-4220-85d6-99cd7d0c41d5 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:56.391028 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e4555751-dff9-4220-85d6-99cd7d0c41d5 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:56.391464 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e4555751-dff9-4220-85d6-99cd7d0c41d5 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:56.399160 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-02dba34f-c63f-49ec-8a20-3060c49f6ff1 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:56.400063 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-02dba34f-c63f-49ec-8a20-3060c49f6ff1 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:56.401024 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-02dba34f-c63f-49ec-8a20-3060c49f6ff1 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:56.401701 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-02dba34f-c63f-49ec-8a20-3060c49f6ff1 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:56.402559 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-02dba34f-c63f-49ec-8a20-3060c49f6ff1 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:56.626518 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e4555751-dff9-4220-85d6-99cd7d0c41d5 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48419c9a6b934406b14d9150af9bbb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1b3cbf1d284da384315bd4f5e1e783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:56.643987 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e4555751-dff9-4220-85d6-99cd7d0c41d5 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] 10.222.0.61 "GET /compute/v2.1/servers/c7eaf35b-26b9-4011-8dc8-d5f48201f17e" status: 200 len: 1313 microversion: 2.1 time: 0.276959 Aug 31 16:28:56.644741 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2955/5891] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:28:56 2022] GET /compute/v2.1/servers/c7eaf35b-26b9-4011-8dc8-d5f48201f17e => generated 1313 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:28:56.656391 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-432159c3-21b1-4023-b0d8-bb347b0e5a33 req-271a1745-4c59-4a51-b683-ab65b06c02cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b31fb01b-045f-41f7-bf58-66c1eca839e8", "name": "network-vif-plugged", "status": "completed", "tag": "fbb954d2-1cb6-4ea2-b226-5a233a891670"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:28:56.669638 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-432159c3-21b1-4023-b0d8-bb347b0e5a33 req-271a1745-4c59-4a51-b683-ab65b06c02cd service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:56.670429 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-432159c3-21b1-4023-b0d8-bb347b0e5a33 req-271a1745-4c59-4a51-b683-ab65b06c02cd service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:56.671216 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-432159c3-21b1-4023-b0d8-bb347b0e5a33 req-271a1745-4c59-4a51-b683-ab65b06c02cd service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:56.688676 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-432159c3-21b1-4023-b0d8-bb347b0e5a33 req-271a1745-4c59-4a51-b683-ab65b06c02cd service nova] Creating event network-vif-plugged:fbb954d2-1cb6-4ea2-b226-5a233a891670 for instance b31fb01b-045f-41f7-bf58-66c1eca839e8 on n-h1-850499-9 Aug 31 16:28:56.696396 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-432159c3-21b1-4023-b0d8-bb347b0e5a33 req-271a1745-4c59-4a51-b683-ab65b06c02cd service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050185 Aug 31 16:28:56.697503 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2956/5892] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:28:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:28:56.742353 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5e888388-96f9-477c-ba65-5e713337f8fa tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:56.745087 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5e888388-96f9-477c-ba65-5e713337f8fa tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] [instance: 1b38884c-e9e3-4a03-98d7-e687429cd132] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:56.753781 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-02dba34f-c63f-49ec-8a20-3060c49f6ff1 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc4d613cdc94357b40e83a2b70b0bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb6a0a8643748b9830f2859de6d8b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:56.758695 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5e888388-96f9-477c-ba65-5e713337f8fa tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:56.759696 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5e888388-96f9-477c-ba65-5e713337f8fa tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:56.760376 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5e888388-96f9-477c-ba65-5e713337f8fa tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:56.761629 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5e888388-96f9-477c-ba65-5e713337f8fa tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:56.762448 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5e888388-96f9-477c-ba65-5e713337f8fa tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:56.763172 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5e888388-96f9-477c-ba65-5e713337f8fa tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:56.764523 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-02dba34f-c63f-49ec-8a20-3060c49f6ff1 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] 10.222.0.61 "GET /compute/v2.1/servers/fcaf0da3-ec31-4531-b09f-263f7d188b06" status: 200 len: 1313 microversion: 2.1 time: 0.410107 Aug 31 16:28:56.778810 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2937/5893] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:28:56 2022] GET /compute/v2.1/servers/fcaf0da3-ec31-4531-b09f-263f7d188b06 => generated 1313 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:28:56.793417 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-5e888388-96f9-477c-ba65-5e713337f8fa tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] HTTP exception thrown: Instance 1b38884c-e9e3-4a03-98d7-e687429cd132 could not be found. Aug 31 16:28:56.797076 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5e888388-96f9-477c-ba65-5e713337f8fa tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Request method failure captured: Aug 31 16:28:56.797076 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/1b38884c-e9e3-4a03-98d7-e687429cd132 HTTP/1.1 Aug 31 16:28:56.797076 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:28:56.797076 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:28:56.797076 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:28:56.797076 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:28:56.797076 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:28:56.797076 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:28:56.797076 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:28:56.797076 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:28:56.797076 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4weDub9LcIV4Li-rqdVO0cZI6WmkqCvFH8gh0DVDdGBZwm_Rt0LDvLxM7OMEdUAJk8jd_DFx6W6nXSlQJ0IdMS4imXsd9nv9SoIGRwKR6JRd-SIOO2pWzhj2Mv6oUI9nB-a6x3xP_KKPDASslA5TH1MxwEoiRXpNzjptEgdDD3dRBY Aug 31 16:28:56.797076 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:28:56.797076 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:28:56.797076 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:28:56.797076 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:28:56.797076 n-d-850499-9 devstack@n-api.service[122257]: X-Openstack-Nova-Api-Version: 2.26 Aug 31 16:28:56.797076 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:28:56.797076 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:28:56.797076 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 9d753dee849a4318a4711fa5e4791e44 Aug 31 16:28:56.797076 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ServerTagsTestJSON-1414101322 Aug 31 16:28:56.797076 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:28:56.797076 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:28:56.797076 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9d753dee849a4318a4711fa5e4791e44"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9d753dee849a4318a4711fa5e4791e44"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9d753dee849a4318a4711fa5e4791e44", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9d753dee849a4318a4711fa5e4791e44"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:28:56.797076 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ServerTagsTestJSON-1414101322 Aug 31 16:28:56.797076 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 9d753dee849a4318a4711fa5e4791e44 Aug 31 16:28:56.797076 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ServerTagsTestJSON-1414101322 Aug 31 16:28:56.797076 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ServerTagsTestJSON-1414101322-project Aug 31 16:28:56.797076 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:28:56.797076 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:28:56.797076 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: cc96a6b97c3c458a88ebc013157332ce Aug 31 16:28:56.797076 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ServerTagsTestJSON-1414101322-project Aug 31 16:28:56.797076 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:28:56.797076 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance 1b38884c-e9e3-4a03-98d7-e687429cd132 could not be found. Aug 31 16:28:56.797076 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '1b38884c-e9e3-4a03-98d7-e687429cd132'} Aug 31 16:28:56.797076 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:28:56.797076 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:28:56.797076 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:28:56.797076 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:28:56.797076 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:28:56.797076 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:28:56.797076 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:28:56.797076 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:28:56.797076 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:28:56.797076 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:28:56.797076 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b38884c-e9e3-4a03-98d7-e687429cd132 could not be found. Aug 31 16:28:56.797076 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:28:56.797076 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:28:56.797076 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:28:56.797076 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:28:56.797076 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:28:56.797076 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:28:56.797076 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:28:56.797076 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:28:56.797076 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:28:56.797076 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:28:56.797076 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:28:56.797076 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:28:56.797076 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:28:56.797076 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:28:56.797076 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:28:56.797076 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:28:56.797076 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b38884c-e9e3-4a03-98d7-e687429cd132 could not be found. Aug 31 16:28:56.797076 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:28:56.797076 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:28:56.797076 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:28:56.804518 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:28:56.804518 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:28:56.804518 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:28:56.804518 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:28:56.804518 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:28:56.804518 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b38884c-e9e3-4a03-98d7-e687429cd132 could not be found. Aug 31 16:28:56.804518 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:28:56.804518 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5e888388-96f9-477c-ba65-5e713337f8fa tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] Returning 404 to user: Instance 1b38884c-e9e3-4a03-98d7-e687429cd132 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:28:56.804518 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5e888388-96f9-477c-ba65-5e713337f8fa tempest-ServerTagsTestJSON-1414101322 tempest-ServerTagsTestJSON-1414101322-project] 10.222.0.61 "GET /compute/v2.1/servers/1b38884c-e9e3-4a03-98d7-e687429cd132" status: 404 len: 111 microversion: 2.26 time: 0.064253 Aug 31 16:28:56.805090 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2957/5894] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:28:56 2022] GET /compute/v2.1/servers/1b38884c-e9e3-4a03-98d7-e687429cd132 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:28:56.997981 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-dd96687b-81e2-40c1-8b2a-57ffb661700b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:56.998954 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-dd96687b-81e2-40c1-8b2a-57ffb661700b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: b31fb01b-045f-41f7-bf58-66c1eca839e8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:57.010266 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dd96687b-81e2-40c1-8b2a-57ffb661700b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:57.011691 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dd96687b-81e2-40c1-8b2a-57ffb661700b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:57.016399 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dd96687b-81e2-40c1-8b2a-57ffb661700b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:57.019914 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dd96687b-81e2-40c1-8b2a-57ffb661700b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:57.021245 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dd96687b-81e2-40c1-8b2a-57ffb661700b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:57.022445 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dd96687b-81e2-40c1-8b2a-57ffb661700b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:57.673648 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4d6b8fae-9b2d-412f-901f-a6036d2b1dca tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:57.674268 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4d6b8fae-9b2d-412f-901f-a6036d2b1dca tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] [instance: c7eaf35b-26b9-4011-8dc8-d5f48201f17e] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:57.688528 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4d6b8fae-9b2d-412f-901f-a6036d2b1dca tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:57.700470 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4d6b8fae-9b2d-412f-901f-a6036d2b1dca tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:57.706164 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4d6b8fae-9b2d-412f-901f-a6036d2b1dca tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:57.707191 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4d6b8fae-9b2d-412f-901f-a6036d2b1dca tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:57.711296 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4d6b8fae-9b2d-412f-901f-a6036d2b1dca tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:57.712210 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4d6b8fae-9b2d-412f-901f-a6036d2b1dca tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:58.217924 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-dd96687b-81e2-40c1-8b2a-57ffb661700b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:58.229932 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-dd96687b-81e2-40c1-8b2a-57ffb661700b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:58.243783 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-dd96687b-81e2-40c1-8b2a-57ffb661700b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:58.251942 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-dd96687b-81e2-40c1-8b2a-57ffb661700b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8" status: 200 len: 1744 microversion: 2.20 time: 1.254155 Aug 31 16:28:58.258244 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2938/5895] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:28:56 2022] GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8 => generated 1744 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:28:58.264582 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-14cef99b-e907-45f1-9918-451e82831859 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:58.275628 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-14cef99b-e907-45f1-9918-451e82831859 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] [instance: fcaf0da3-ec31-4531-b09f-263f7d188b06] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:58.297788 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-14cef99b-e907-45f1-9918-451e82831859 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:58.301202 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-14cef99b-e907-45f1-9918-451e82831859 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:58.301963 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-14cef99b-e907-45f1-9918-451e82831859 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:58.304973 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-14cef99b-e907-45f1-9918-451e82831859 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:58.306608 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-14cef99b-e907-45f1-9918-451e82831859 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:58.310738 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-14cef99b-e907-45f1-9918-451e82831859 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:59.211545 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-4d6b8fae-9b2d-412f-901f-a6036d2b1dca tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48419c9a6b934406b14d9150af9bbb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1b3cbf1d284da384315bd4f5e1e783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:59.224535 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4d6b8fae-9b2d-412f-901f-a6036d2b1dca tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] 10.222.0.61 "GET /compute/v2.1/servers/c7eaf35b-26b9-4011-8dc8-d5f48201f17e" status: 200 len: 1313 microversion: 2.1 time: 1.554589 Aug 31 16:28:59.228787 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2958/5896] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:28:57 2022] GET /compute/v2.1/servers/c7eaf35b-26b9-4011-8dc8-d5f48201f17e => generated 1313 bytes in 1563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:28:59.548324 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-66825e94-e3e9-4355-a1a8-02ccd99d2460 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-886625453", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "d0764a92-cb3d-4cac-8811-0a7f7292a98b"}]}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:28:59.695606 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-66825e94-e3e9-4355-a1a8-02ccd99d2460 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] validate_networks() for [('d0764a92-cb3d-4cac-8811-0a7f7292a98b', None, None, None, None, None)] {{(pid=122257) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:28:59.770946 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=4 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:28:59.868470 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-14cef99b-e907-45f1-9918-451e82831859 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc4d613cdc94357b40e83a2b70b0bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb6a0a8643748b9830f2859de6d8b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:59.890086 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-14cef99b-e907-45f1-9918-451e82831859 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] 10.222.0.61 "GET /compute/v2.1/servers/fcaf0da3-ec31-4531-b09f-263f7d188b06" status: 200 len: 1313 microversion: 2.1 time: 1.625454 Aug 31 16:28:59.891191 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2939/5897] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:28:58 2022] GET /compute/v2.1/servers/fcaf0da3-ec31-4531-b09f-263f7d188b06 => generated 1313 bytes in 1632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:28:59.911329 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-975ea007-9c26-440f-a24d-2affba790c7c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:59.912250 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-975ea007-9c26-440f-a24d-2affba790c7c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: b31fb01b-045f-41f7-bf58-66c1eca839e8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:59.932525 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-975ea007-9c26-440f-a24d-2affba790c7c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:59.936145 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-975ea007-9c26-440f-a24d-2affba790c7c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:59.938631 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-975ea007-9c26-440f-a24d-2affba790c7c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:59.941235 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-975ea007-9c26-440f-a24d-2affba790c7c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:59.942005 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-975ea007-9c26-440f-a24d-2affba790c7c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:59.945741 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-975ea007-9c26-440f-a24d-2affba790c7c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:00.324923 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-975ea007-9c26-440f-a24d-2affba790c7c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:00.335990 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-975ea007-9c26-440f-a24d-2affba790c7c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:00.345394 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-975ea007-9c26-440f-a24d-2affba790c7c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:00.347752 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-975ea007-9c26-440f-a24d-2affba790c7c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8" status: 200 len: 1739 microversion: 2.20 time: 0.451318 Aug 31 16:29:00.352257 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2940/5898] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:28:59 2022] GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8 => generated 1739 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:29:00.364021 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-bfbc4b00-cf9d-4556-af89-87c22beae436 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:00.365077 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-bfbc4b00-cf9d-4556-af89-87c22beae436 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] [instance: c7eaf35b-26b9-4011-8dc8-d5f48201f17e] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:00.380131 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bfbc4b00-cf9d-4556-af89-87c22beae436 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:00.380998 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bfbc4b00-cf9d-4556-af89-87c22beae436 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:00.387919 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bfbc4b00-cf9d-4556-af89-87c22beae436 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:00.388986 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bfbc4b00-cf9d-4556-af89-87c22beae436 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:00.389633 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bfbc4b00-cf9d-4556-af89-87c22beae436 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:00.390232 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bfbc4b00-cf9d-4556-af89-87c22beae436 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:00.457825 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=14 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:29:02.085194 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-bfbc4b00-cf9d-4556-af89-87c22beae436 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48419c9a6b934406b14d9150af9bbb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1b3cbf1d284da384315bd4f5e1e783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:02.100290 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-bfbc4b00-cf9d-4556-af89-87c22beae436 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] 10.222.0.61 "GET /compute/v2.1/servers/c7eaf35b-26b9-4011-8dc8-d5f48201f17e" status: 200 len: 1313 microversion: 2.1 time: 1.745850 Aug 31 16:29:02.107134 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2941/5899] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:00 2022] GET /compute/v2.1/servers/c7eaf35b-26b9-4011-8dc8-d5f48201f17e => generated 1313 bytes in 1754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:29:02.116440 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-8f103c4e-fec4-47e8-92e7-dc2c02d22542 req-48df310b-b09f-40b6-bcc6-c11891d283fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcaf0da3-ec31-4531-b09f-263f7d188b06", "tag": "cdcabff2-27a7-4cca-8476-bbcabbe12df7"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:29:02.150722 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-8f103c4e-fec4-47e8-92e7-dc2c02d22542 req-48df310b-b09f-40b6-bcc6-c11891d283fb service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:02.151621 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-8f103c4e-fec4-47e8-92e7-dc2c02d22542 req-48df310b-b09f-40b6-bcc6-c11891d283fb service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:02.152359 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-8f103c4e-fec4-47e8-92e7-dc2c02d22542 req-48df310b-b09f-40b6-bcc6-c11891d283fb service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:02.181363 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-8f103c4e-fec4-47e8-92e7-dc2c02d22542 req-48df310b-b09f-40b6-bcc6-c11891d283fb service nova] Creating event network-changed:cdcabff2-27a7-4cca-8476-bbcabbe12df7 for instance fcaf0da3-ec31-4531-b09f-263f7d188b06 on n-h2-850499-9 Aug 31 16:29:02.195001 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-8f103c4e-fec4-47e8-92e7-dc2c02d22542 req-48df310b-b09f-40b6-bcc6-c11891d283fb service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084935 Aug 31 16:29:02.200863 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2942/5900] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:29:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:29:02.215560 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-049df055-49f6-4878-bea0-2a2d2f3915dc tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:02.217345 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-049df055-49f6-4878-bea0-2a2d2f3915dc tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] [instance: fcaf0da3-ec31-4531-b09f-263f7d188b06] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:02.237603 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-049df055-49f6-4878-bea0-2a2d2f3915dc tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:02.238465 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-049df055-49f6-4878-bea0-2a2d2f3915dc tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:02.239140 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-049df055-49f6-4878-bea0-2a2d2f3915dc tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:02.240179 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-049df055-49f6-4878-bea0-2a2d2f3915dc tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:02.241021 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-049df055-49f6-4878-bea0-2a2d2f3915dc tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:02.244128 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-049df055-49f6-4878-bea0-2a2d2f3915dc tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:02.536490 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-66825e94-e3e9-4355-a1a8-02ccd99d2460 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:29:02.538392 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-66825e94-e3e9-4355-a1a8-02ccd99d2460 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:29:02.543915 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-66825e94-e3e9-4355-a1a8-02ccd99d2460 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:29:02.547613 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-66825e94-e3e9-4355-a1a8-02ccd99d2460 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:29:02.549725 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-66825e94-e3e9-4355-a1a8-02ccd99d2460 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:29:02.601419 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-66825e94-e3e9-4355-a1a8-02ccd99d2460 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:02.603102 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-66825e94-e3e9-4355-a1a8-02ccd99d2460 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:02.603907 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-66825e94-e3e9-4355-a1a8-02ccd99d2460 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:02.608167 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-66825e94-e3e9-4355-a1a8-02ccd99d2460 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:02.613189 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-66825e94-e3e9-4355-a1a8-02ccd99d2460 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:02.614978 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-66825e94-e3e9-4355-a1a8-02ccd99d2460 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:02.728262 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-66825e94-e3e9-4355-a1a8-02ccd99d2460 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Getting quotas for project a527440f8bf6444591088916ad74ef4f. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:29:02.774109 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-66825e94-e3e9-4355-a1a8-02ccd99d2460 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Getting quotas for user fe872c74e07d42478492b281dc1fbf1a and project a527440f8bf6444591088916ad74ef4f. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:29:02.822036 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-66825e94-e3e9-4355-a1a8-02ccd99d2460 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Going to run 1 instances... {{(pid=122257) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:29:02.862288 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-66825e94-e3e9-4355-a1a8-02ccd99d2460 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] [instance: 9f9fa018-34f8-495a-ade8-1ada7ff80130] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:29:03.023871 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-66825e94-e3e9-4355-a1a8-02ccd99d2460 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.793601 Aug 31 16:29:03.042248 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2959/5901] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:28:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 3812 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:29:03.054132 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0759d478-e7c4-4db1-b53d-3082ff8c2d82 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:03.070240 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0759d478-e7c4-4db1-b53d-3082ff8c2d82 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: b31fb01b-045f-41f7-bf58-66c1eca839e8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:03.092987 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0759d478-e7c4-4db1-b53d-3082ff8c2d82 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:03.097692 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0759d478-e7c4-4db1-b53d-3082ff8c2d82 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:03.101914 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0759d478-e7c4-4db1-b53d-3082ff8c2d82 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:03.106979 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0759d478-e7c4-4db1-b53d-3082ff8c2d82 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:03.116450 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0759d478-e7c4-4db1-b53d-3082ff8c2d82 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:03.117422 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0759d478-e7c4-4db1-b53d-3082ff8c2d82 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:03.766779 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-049df055-49f6-4878-bea0-2a2d2f3915dc tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc4d613cdc94357b40e83a2b70b0bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb6a0a8643748b9830f2859de6d8b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:03.800424 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-049df055-49f6-4878-bea0-2a2d2f3915dc tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] 10.222.0.61 "GET /compute/v2.1/servers/fcaf0da3-ec31-4531-b09f-263f7d188b06" status: 200 len: 1313 microversion: 2.1 time: 1.595536 Aug 31 16:29:03.800424 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2943/5902] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:02 2022] GET /compute/v2.1/servers/fcaf0da3-ec31-4531-b09f-263f7d188b06 => generated 1313 bytes in 1598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:29:03.833396 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5b6999ab-af04-421a-a946-a832a0b48648 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:03.835307 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5b6999ab-af04-421a-a946-a832a0b48648 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] [instance: 9f9fa018-34f8-495a-ade8-1ada7ff80130] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:03.987954 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0759d478-e7c4-4db1-b53d-3082ff8c2d82 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:04.015283 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0759d478-e7c4-4db1-b53d-3082ff8c2d82 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:04.017825 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0759d478-e7c4-4db1-b53d-3082ff8c2d82 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:04.019373 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0759d478-e7c4-4db1-b53d-3082ff8c2d82 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8" status: 200 len: 1739 microversion: 2.20 time: 0.975456 Aug 31 16:29:04.020703 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2960/5903] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:29:03 2022] GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8 => generated 1739 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:29:04.027174 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2a3aff95-1086-431d-b3d4-28294ca01562 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:04.028145 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2a3aff95-1086-431d-b3d4-28294ca01562 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] [instance: c7eaf35b-26b9-4011-8dc8-d5f48201f17e] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:04.048215 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2a3aff95-1086-431d-b3d4-28294ca01562 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:04.054050 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2a3aff95-1086-431d-b3d4-28294ca01562 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:04.058410 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2a3aff95-1086-431d-b3d4-28294ca01562 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:04.062587 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2a3aff95-1086-431d-b3d4-28294ca01562 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:04.065121 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2a3aff95-1086-431d-b3d4-28294ca01562 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:04.072079 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2a3aff95-1086-431d-b3d4-28294ca01562 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:04.487392 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5b6999ab-af04-421a-a946-a832a0b48648 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe872c74e07d42478492b281dc1fbf1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a527440f8bf6444591088916ad74ef4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:04.498695 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5b6999ab-af04-421a-a946-a832a0b48648 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] 10.222.0.61 "GET /compute/v2.1/servers/9f9fa018-34f8-495a-ade8-1ada7ff80130" status: 200 len: 1223 microversion: 2.1 time: 0.688528 Aug 31 16:29:04.506850 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2944/5904] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:03 2022] GET /compute/v2.1/servers/9f9fa018-34f8-495a-ade8-1ada7ff80130 => generated 1223 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:29:04.537429 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-fff693c6-eeca-42dd-80b9-fc573a2cb66f req-ce0d4720-9fc5-4392-b8b4-2f7d5387aafb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7eaf35b-26b9-4011-8dc8-d5f48201f17e", "name": "network-vif-plugged", "status": "completed", "tag": "3d2b982b-9f9f-40db-8265-e4543d87210b"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:29:04.592115 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-fff693c6-eeca-42dd-80b9-fc573a2cb66f req-ce0d4720-9fc5-4392-b8b4-2f7d5387aafb service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:04.596404 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-fff693c6-eeca-42dd-80b9-fc573a2cb66f req-ce0d4720-9fc5-4392-b8b4-2f7d5387aafb service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:04.601168 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-fff693c6-eeca-42dd-80b9-fc573a2cb66f req-ce0d4720-9fc5-4392-b8b4-2f7d5387aafb service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:04.636892 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-fff693c6-eeca-42dd-80b9-fc573a2cb66f req-ce0d4720-9fc5-4392-b8b4-2f7d5387aafb service nova] Creating event network-vif-plugged:3d2b982b-9f9f-40db-8265-e4543d87210b for instance c7eaf35b-26b9-4011-8dc8-d5f48201f17e on n-h2-850499-9 Aug 31 16:29:04.653210 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-fff693c6-eeca-42dd-80b9-fc573a2cb66f req-ce0d4720-9fc5-4392-b8b4-2f7d5387aafb service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127944 Aug 31 16:29:04.681301 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2945/5905] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:29:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:29:04.841379 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e9aad1d3-86fd-4778-91ee-aabf25c4ed7f tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:04.845760 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e9aad1d3-86fd-4778-91ee-aabf25c4ed7f tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] [instance: fcaf0da3-ec31-4531-b09f-263f7d188b06] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:04.917787 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e9aad1d3-86fd-4778-91ee-aabf25c4ed7f tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:04.918314 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e9aad1d3-86fd-4778-91ee-aabf25c4ed7f tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:04.922244 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e9aad1d3-86fd-4778-91ee-aabf25c4ed7f tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:04.933137 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e9aad1d3-86fd-4778-91ee-aabf25c4ed7f tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:04.933892 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e9aad1d3-86fd-4778-91ee-aabf25c4ed7f tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:04.949582 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e9aad1d3-86fd-4778-91ee-aabf25c4ed7f tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:05.067226 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:29:05.234304 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2a3aff95-1086-431d-b3d4-28294ca01562 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48419c9a6b934406b14d9150af9bbb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1b3cbf1d284da384315bd4f5e1e783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:05.269701 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2a3aff95-1086-431d-b3d4-28294ca01562 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] 10.222.0.61 "GET /compute/v2.1/servers/c7eaf35b-26b9-4011-8dc8-d5f48201f17e" status: 200 len: 1313 microversion: 2.1 time: 1.244471 Aug 31 16:29:05.283573 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2961/5906] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:04 2022] GET /compute/v2.1/servers/c7eaf35b-26b9-4011-8dc8-d5f48201f17e => generated 1313 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:29:05.294500 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6b6af98e-6977-4ae2-947f-54b2eeb94384 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:05.297022 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6b6af98e-6977-4ae2-947f-54b2eeb94384 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: b31fb01b-045f-41f7-bf58-66c1eca839e8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:05.339239 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6b6af98e-6977-4ae2-947f-54b2eeb94384 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:05.341317 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6b6af98e-6977-4ae2-947f-54b2eeb94384 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:05.345353 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6b6af98e-6977-4ae2-947f-54b2eeb94384 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:05.347039 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6b6af98e-6977-4ae2-947f-54b2eeb94384 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:05.359718 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6b6af98e-6977-4ae2-947f-54b2eeb94384 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:05.361236 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6b6af98e-6977-4ae2-947f-54b2eeb94384 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:06.484978 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e9aad1d3-86fd-4778-91ee-aabf25c4ed7f tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc4d613cdc94357b40e83a2b70b0bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb6a0a8643748b9830f2859de6d8b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:06.501808 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e9aad1d3-86fd-4778-91ee-aabf25c4ed7f tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] 10.222.0.61 "GET /compute/v2.1/servers/fcaf0da3-ec31-4531-b09f-263f7d188b06" status: 200 len: 1313 microversion: 2.1 time: 1.680821 Aug 31 16:29:06.507784 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2946/5907] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:04 2022] GET /compute/v2.1/servers/fcaf0da3-ec31-4531-b09f-263f7d188b06 => generated 1313 bytes in 1689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:29:06.523363 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4bced9e7-e5c5-4cb0-950b-217db4f62d48 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:06.528678 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4bced9e7-e5c5-4cb0-950b-217db4f62d48 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] [instance: 9f9fa018-34f8-495a-ade8-1ada7ff80130] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:06.555237 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4bced9e7-e5c5-4cb0-950b-217db4f62d48 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:06.558081 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4bced9e7-e5c5-4cb0-950b-217db4f62d48 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:06.558729 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4bced9e7-e5c5-4cb0-950b-217db4f62d48 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:06.559994 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4bced9e7-e5c5-4cb0-950b-217db4f62d48 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:06.561573 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4bced9e7-e5c5-4cb0-950b-217db4f62d48 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:06.563654 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4bced9e7-e5c5-4cb0-950b-217db4f62d48 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:06.885913 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-4bced9e7-e5c5-4cb0-950b-217db4f62d48 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe872c74e07d42478492b281dc1fbf1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a527440f8bf6444591088916ad74ef4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:06.901574 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4bced9e7-e5c5-4cb0-950b-217db4f62d48 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] 10.222.0.61 "GET /compute/v2.1/servers/9f9fa018-34f8-495a-ade8-1ada7ff80130" status: 200 len: 1283 microversion: 2.1 time: 0.388918 Aug 31 16:29:06.905817 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2947/5908] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:06 2022] GET /compute/v2.1/servers/9f9fa018-34f8-495a-ade8-1ada7ff80130 => generated 1283 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:29:06.913951 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-6b6af98e-6977-4ae2-947f-54b2eeb94384 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:06.924594 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-66c793b5-992c-44f9-b923-457ae50672a5 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:06.949073 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-6b6af98e-6977-4ae2-947f-54b2eeb94384 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:06.950608 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-6b6af98e-6977-4ae2-947f-54b2eeb94384 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:06.952604 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-66c793b5-992c-44f9-b923-457ae50672a5 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] [instance: c7eaf35b-26b9-4011-8dc8-d5f48201f17e] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:06.968136 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6b6af98e-6977-4ae2-947f-54b2eeb94384 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8" status: 200 len: 1739 microversion: 2.20 time: 1.683165 Aug 31 16:29:06.968775 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2962/5909] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:29:05 2022] GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8 => generated 1739 bytes in 1685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:29:06.979755 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-66c793b5-992c-44f9-b923-457ae50672a5 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:06.981879 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-66c793b5-992c-44f9-b923-457ae50672a5 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:06.992294 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-66c793b5-992c-44f9-b923-457ae50672a5 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:06.995131 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-66c793b5-992c-44f9-b923-457ae50672a5 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:06.996401 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-66c793b5-992c-44f9-b923-457ae50672a5 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:06.999800 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-66c793b5-992c-44f9-b923-457ae50672a5 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:07.556034 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-562177ec-2bf5-452f-9cb2-e115d0e99d4d tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:07.559847 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-562177ec-2bf5-452f-9cb2-e115d0e99d4d tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] [instance: fcaf0da3-ec31-4531-b09f-263f7d188b06] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:07.590927 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-562177ec-2bf5-452f-9cb2-e115d0e99d4d tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:07.592911 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-562177ec-2bf5-452f-9cb2-e115d0e99d4d tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:07.594474 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-562177ec-2bf5-452f-9cb2-e115d0e99d4d tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:07.601413 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-562177ec-2bf5-452f-9cb2-e115d0e99d4d tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:07.605789 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-562177ec-2bf5-452f-9cb2-e115d0e99d4d tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:07.606558 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-562177ec-2bf5-452f-9cb2-e115d0e99d4d tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:07.715591 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-66c793b5-992c-44f9-b923-457ae50672a5 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48419c9a6b934406b14d9150af9bbb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1b3cbf1d284da384315bd4f5e1e783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:07.743413 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-66c793b5-992c-44f9-b923-457ae50672a5 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] 10.222.0.61 "GET /compute/v2.1/servers/c7eaf35b-26b9-4011-8dc8-d5f48201f17e" status: 200 len: 1313 microversion: 2.1 time: 0.836155 Aug 31 16:29:07.744383 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2948/5910] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:06 2022] GET /compute/v2.1/servers/c7eaf35b-26b9-4011-8dc8-d5f48201f17e => generated 1313 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:29:08.089039 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-562177ec-2bf5-452f-9cb2-e115d0e99d4d tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc4d613cdc94357b40e83a2b70b0bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb6a0a8643748b9830f2859de6d8b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:08.109072 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-562177ec-2bf5-452f-9cb2-e115d0e99d4d tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] 10.222.0.61 "GET /compute/v2.1/servers/fcaf0da3-ec31-4531-b09f-263f7d188b06" status: 200 len: 1313 microversion: 2.1 time: 0.561489 Aug 31 16:29:08.120002 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2963/5911] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:07 2022] GET /compute/v2.1/servers/fcaf0da3-ec31-4531-b09f-263f7d188b06 => generated 1313 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:29:08.125133 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a20ee063-ca3c-4fa2-b691-b5f9b3f78994 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:08.153047 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a20ee063-ca3c-4fa2-b691-b5f9b3f78994 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] [instance: 9f9fa018-34f8-495a-ade8-1ada7ff80130] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:08.185107 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a20ee063-ca3c-4fa2-b691-b5f9b3f78994 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:08.189701 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a20ee063-ca3c-4fa2-b691-b5f9b3f78994 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:08.190561 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a20ee063-ca3c-4fa2-b691-b5f9b3f78994 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:08.193227 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a20ee063-ca3c-4fa2-b691-b5f9b3f78994 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:08.194911 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a20ee063-ca3c-4fa2-b691-b5f9b3f78994 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:08.195640 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a20ee063-ca3c-4fa2-b691-b5f9b3f78994 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:08.328726 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b0e37665-53c1-436c-be55-827ee73193e3 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:08.329144 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b0e37665-53c1-436c-be55-827ee73193e3 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 3c9c0c43-4e1a-4290-bbf1-60e26aba66ce] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:08.350657 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b0e37665-53c1-436c-be55-827ee73193e3 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:08.355804 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b0e37665-53c1-436c-be55-827ee73193e3 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:08.356628 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b0e37665-53c1-436c-be55-827ee73193e3 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:08.359334 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b0e37665-53c1-436c-be55-827ee73193e3 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:08.361736 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b0e37665-53c1-436c-be55-827ee73193e3 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:08.362518 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b0e37665-53c1-436c-be55-827ee73193e3 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:08.395471 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a20ee063-ca3c-4fa2-b691-b5f9b3f78994 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe872c74e07d42478492b281dc1fbf1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a527440f8bf6444591088916ad74ef4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:08.424356 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a20ee063-ca3c-4fa2-b691-b5f9b3f78994 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] 10.222.0.61 "GET /compute/v2.1/servers/9f9fa018-34f8-495a-ade8-1ada7ff80130" status: 200 len: 1281 microversion: 2.1 time: 0.300391 Aug 31 16:29:08.439047 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b0e37665-53c1-436c-be55-827ee73193e3 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/3c9c0c43-4e1a-4290-bbf1-60e26aba66ce/ips" status: 200 len: 149 microversion: 2.1 time: 0.693245 Aug 31 16:29:08.448357 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2964/5912] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:08 2022] GET /compute/v2.1/servers/9f9fa018-34f8-495a-ade8-1ada7ff80130 => generated 1281 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:29:08.455836 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9cdd7a17-32cb-4631-9a11-da1c61b4baed tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:08.456697 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9cdd7a17-32cb-4631-9a11-da1c61b4baed tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: b31fb01b-045f-41f7-bf58-66c1eca839e8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:08.470722 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9cdd7a17-32cb-4631-9a11-da1c61b4baed tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:08.472477 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9cdd7a17-32cb-4631-9a11-da1c61b4baed tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:08.474022 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9cdd7a17-32cb-4631-9a11-da1c61b4baed tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:08.477956 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9cdd7a17-32cb-4631-9a11-da1c61b4baed tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:08.479117 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9cdd7a17-32cb-4631-9a11-da1c61b4baed tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:08.480567 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9cdd7a17-32cb-4631-9a11-da1c61b4baed tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:08.481451 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2949/5913] 10.222.0.61 () {58 vars in 1248 bytes} [Wed Aug 31 16:29:07 2022] GET /compute/v2.1/servers/3c9c0c43-4e1a-4290-bbf1-60e26aba66ce/ips => generated 149 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:29:08.765209 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4c4146c9-3f57-4093-b6bb-44606e5b5ca6 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:08.766607 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4c4146c9-3f57-4093-b6bb-44606e5b5ca6 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] [instance: c7eaf35b-26b9-4011-8dc8-d5f48201f17e] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:08.778845 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4c4146c9-3f57-4093-b6bb-44606e5b5ca6 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:08.784311 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4c4146c9-3f57-4093-b6bb-44606e5b5ca6 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:08.785149 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4c4146c9-3f57-4093-b6bb-44606e5b5ca6 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:08.786126 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4c4146c9-3f57-4093-b6bb-44606e5b5ca6 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:08.786865 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4c4146c9-3f57-4093-b6bb-44606e5b5ca6 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:08.789005 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4c4146c9-3f57-4093-b6bb-44606e5b5ca6 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:09.163142 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9cdd7a17-32cb-4631-9a11-da1c61b4baed tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:09.169186 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=100 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:29:09.185461 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9cdd7a17-32cb-4631-9a11-da1c61b4baed tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:09.188292 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9cdd7a17-32cb-4631-9a11-da1c61b4baed tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:09.205376 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9cdd7a17-32cb-4631-9a11-da1c61b4baed tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8" status: 200 len: 1739 microversion: 2.20 time: 0.755147 Aug 31 16:29:09.207167 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2965/5914] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:29:08 2022] GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8 => generated 1739 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:29:09.235830 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-65950b0a-3da8-4685-88cc-5fe417d9e386 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:09.237151 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-65950b0a-3da8-4685-88cc-5fe417d9e386 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] [instance: fcaf0da3-ec31-4531-b09f-263f7d188b06] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:09.257434 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-65950b0a-3da8-4685-88cc-5fe417d9e386 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:09.260176 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-65950b0a-3da8-4685-88cc-5fe417d9e386 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:09.260945 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-65950b0a-3da8-4685-88cc-5fe417d9e386 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:09.267753 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-65950b0a-3da8-4685-88cc-5fe417d9e386 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:09.268482 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-65950b0a-3da8-4685-88cc-5fe417d9e386 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:09.269162 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-65950b0a-3da8-4685-88cc-5fe417d9e386 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:10.323877 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-4c4146c9-3f57-4093-b6bb-44606e5b5ca6 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48419c9a6b934406b14d9150af9bbb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1b3cbf1d284da384315bd4f5e1e783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:10.347753 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4c4146c9-3f57-4093-b6bb-44606e5b5ca6 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] 10.222.0.61 "GET /compute/v2.1/servers/c7eaf35b-26b9-4011-8dc8-d5f48201f17e" status: 200 len: 1313 microversion: 2.1 time: 1.585232 Aug 31 16:29:10.349202 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2950/5915] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:08 2022] GET /compute/v2.1/servers/c7eaf35b-26b9-4011-8dc8-d5f48201f17e => generated 1313 bytes in 1589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:29:10.371207 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-db07fbff-e080-43b3-878c-a9d29d537716 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:10.372766 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-db07fbff-e080-43b3-878c-a9d29d537716 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] [instance: 9f9fa018-34f8-495a-ade8-1ada7ff80130] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:10.413397 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-db07fbff-e080-43b3-878c-a9d29d537716 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:10.414669 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-db07fbff-e080-43b3-878c-a9d29d537716 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:10.417479 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-db07fbff-e080-43b3-878c-a9d29d537716 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:10.419541 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-db07fbff-e080-43b3-878c-a9d29d537716 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:10.424078 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-db07fbff-e080-43b3-878c-a9d29d537716 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:10.425166 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-db07fbff-e080-43b3-878c-a9d29d537716 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:10.545681 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-65950b0a-3da8-4685-88cc-5fe417d9e386 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc4d613cdc94357b40e83a2b70b0bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb6a0a8643748b9830f2859de6d8b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:10.573619 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-65950b0a-3da8-4685-88cc-5fe417d9e386 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] 10.222.0.61 "GET /compute/v2.1/servers/fcaf0da3-ec31-4531-b09f-263f7d188b06" status: 200 len: 1313 microversion: 2.1 time: 1.358772 Aug 31 16:29:10.575194 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2966/5916] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:09 2022] GET /compute/v2.1/servers/fcaf0da3-ec31-4531-b09f-263f7d188b06 => generated 1313 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:29:10.596447 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-102a6e44-b1fc-4192-a0d0-03be5de3d773 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:10.598234 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-102a6e44-b1fc-4192-a0d0-03be5de3d773 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: b31fb01b-045f-41f7-bf58-66c1eca839e8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:10.633764 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-102a6e44-b1fc-4192-a0d0-03be5de3d773 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:10.634996 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-102a6e44-b1fc-4192-a0d0-03be5de3d773 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:10.636029 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-102a6e44-b1fc-4192-a0d0-03be5de3d773 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:10.637587 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-102a6e44-b1fc-4192-a0d0-03be5de3d773 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:10.638621 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-102a6e44-b1fc-4192-a0d0-03be5de3d773 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:10.639592 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-102a6e44-b1fc-4192-a0d0-03be5de3d773 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:11.206501 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-102a6e44-b1fc-4192-a0d0-03be5de3d773 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:11.247924 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-102a6e44-b1fc-4192-a0d0-03be5de3d773 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:11.255006 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-102a6e44-b1fc-4192-a0d0-03be5de3d773 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:11.265764 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-102a6e44-b1fc-4192-a0d0-03be5de3d773 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8" status: 200 len: 1739 microversion: 2.20 time: 0.688139 Aug 31 16:29:11.272851 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2967/5917] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:29:10 2022] GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8 => generated 1739 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:29:11.371915 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c6c8d042-2ab7-48cb-8e6f-d2d62a4e003f tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:11.373336 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c6c8d042-2ab7-48cb-8e6f-d2d62a4e003f tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] [instance: c7eaf35b-26b9-4011-8dc8-d5f48201f17e] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:11.400493 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c6c8d042-2ab7-48cb-8e6f-d2d62a4e003f tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:11.401620 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c6c8d042-2ab7-48cb-8e6f-d2d62a4e003f tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:11.404619 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c6c8d042-2ab7-48cb-8e6f-d2d62a4e003f tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:11.405741 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c6c8d042-2ab7-48cb-8e6f-d2d62a4e003f tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:11.409714 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c6c8d042-2ab7-48cb-8e6f-d2d62a4e003f tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:11.410840 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c6c8d042-2ab7-48cb-8e6f-d2d62a4e003f tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:11.654664 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-db07fbff-e080-43b3-878c-a9d29d537716 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe872c74e07d42478492b281dc1fbf1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a527440f8bf6444591088916ad74ef4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:11.704135 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-db07fbff-e080-43b3-878c-a9d29d537716 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] 10.222.0.61 "GET /compute/v2.1/servers/9f9fa018-34f8-495a-ade8-1ada7ff80130" status: 200 len: 1323 microversion: 2.1 time: 1.353008 Aug 31 16:29:11.705237 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2951/5918] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:10 2022] GET /compute/v2.1/servers/9f9fa018-34f8-495a-ade8-1ada7ff80130 => generated 1323 bytes in 1355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:29:11.725186 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3170b2d3-2dc0-419e-9dc4-99f576356dc8 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:11.732800 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3170b2d3-2dc0-419e-9dc4-99f576356dc8 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] [instance: fcaf0da3-ec31-4531-b09f-263f7d188b06] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:11.754086 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3170b2d3-2dc0-419e-9dc4-99f576356dc8 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:11.769108 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3170b2d3-2dc0-419e-9dc4-99f576356dc8 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:11.770410 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3170b2d3-2dc0-419e-9dc4-99f576356dc8 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:11.773965 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3170b2d3-2dc0-419e-9dc4-99f576356dc8 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:11.779032 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3170b2d3-2dc0-419e-9dc4-99f576356dc8 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:11.780003 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3170b2d3-2dc0-419e-9dc4-99f576356dc8 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:12.299928 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c6c8d042-2ab7-48cb-8e6f-d2d62a4e003f tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48419c9a6b934406b14d9150af9bbb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1b3cbf1d284da384315bd4f5e1e783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:12.317295 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c6c8d042-2ab7-48cb-8e6f-d2d62a4e003f tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] 10.222.0.61 "GET /compute/v2.1/servers/c7eaf35b-26b9-4011-8dc8-d5f48201f17e" status: 200 len: 1463 microversion: 2.1 time: 0.951147 Aug 31 16:29:12.322492 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2968/5919] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:11 2022] GET /compute/v2.1/servers/c7eaf35b-26b9-4011-8dc8-d5f48201f17e => generated 1463 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:29:12.334459 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-fdba126d-9af5-47e8-8955-3d7474b6a17d tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:12.342193 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-fdba126d-9af5-47e8-8955-3d7474b6a17d tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: b31fb01b-045f-41f7-bf58-66c1eca839e8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:12.363747 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fdba126d-9af5-47e8-8955-3d7474b6a17d tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:12.363747 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fdba126d-9af5-47e8-8955-3d7474b6a17d tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:12.374900 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fdba126d-9af5-47e8-8955-3d7474b6a17d tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:12.375909 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fdba126d-9af5-47e8-8955-3d7474b6a17d tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:12.379739 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fdba126d-9af5-47e8-8955-3d7474b6a17d tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:12.380297 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fdba126d-9af5-47e8-8955-3d7474b6a17d tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:12.477531 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3170b2d3-2dc0-419e-9dc4-99f576356dc8 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc4d613cdc94357b40e83a2b70b0bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb6a0a8643748b9830f2859de6d8b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:12.493475 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3170b2d3-2dc0-419e-9dc4-99f576356dc8 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] 10.222.0.61 "GET /compute/v2.1/servers/fcaf0da3-ec31-4531-b09f-263f7d188b06" status: 200 len: 1313 microversion: 2.1 time: 0.783191 Aug 31 16:29:12.495306 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2952/5920] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:11 2022] GET /compute/v2.1/servers/fcaf0da3-ec31-4531-b09f-263f7d188b06 => generated 1313 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:29:12.509933 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-066f346f-4b3d-46d2-9dc4-fdb729e9ce07 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ad20bd49-57da-41bf-8fc2-85d0b207bea9", "device": "/dev/sdb"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:29:12.513557 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-066f346f-4b3d-46d2-9dc4-fdb729e9ce07 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] [instance: c7eaf35b-26b9-4011-8dc8-d5f48201f17e] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:12.530843 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-066f346f-4b3d-46d2-9dc4-fdb729e9ce07 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:12.534975 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-066f346f-4b3d-46d2-9dc4-fdb729e9ce07 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:12.535720 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-066f346f-4b3d-46d2-9dc4-fdb729e9ce07 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:12.539708 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-066f346f-4b3d-46d2-9dc4-fdb729e9ce07 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:12.540506 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-066f346f-4b3d-46d2-9dc4-fdb729e9ce07 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:12.541130 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-066f346f-4b3d-46d2-9dc4-fdb729e9ce07 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:12.655958 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:29:12.814989 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=6 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:29:13.248403 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-066f346f-4b3d-46d2-9dc4-fdb729e9ce07 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] 10.222.0.61 "POST /compute/v2.1/servers/c7eaf35b-26b9-4011-8dc8-d5f48201f17e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.750122 Aug 31 16:29:13.251208 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2953/5921] 10.222.0.61 () {60 vars in 1323 bytes} [Wed Aug 31 16:29:12 2022] POST /compute/v2.1/servers/c7eaf35b-26b9-4011-8dc8-d5f48201f17e/os-volume_attachments => generated 194 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:29:13.266730 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4cb37a50-ba2f-4881-99b2-8a0dd2a0e9b7 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:13.268591 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4cb37a50-ba2f-4881-99b2-8a0dd2a0e9b7 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] [instance: 9f9fa018-34f8-495a-ade8-1ada7ff80130] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:13.287853 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4cb37a50-ba2f-4881-99b2-8a0dd2a0e9b7 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:13.292020 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4cb37a50-ba2f-4881-99b2-8a0dd2a0e9b7 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:13.293384 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4cb37a50-ba2f-4881-99b2-8a0dd2a0e9b7 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:13.299045 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4cb37a50-ba2f-4881-99b2-8a0dd2a0e9b7 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:13.303409 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4cb37a50-ba2f-4881-99b2-8a0dd2a0e9b7 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:13.304326 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4cb37a50-ba2f-4881-99b2-8a0dd2a0e9b7 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:13.319777 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-fdba126d-9af5-47e8-8955-3d7474b6a17d tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:13.329529 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-fdba126d-9af5-47e8-8955-3d7474b6a17d tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:13.331076 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-fdba126d-9af5-47e8-8955-3d7474b6a17d tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:13.344033 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-fdba126d-9af5-47e8-8955-3d7474b6a17d tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8" status: 200 len: 1739 microversion: 2.20 time: 1.019954 Aug 31 16:29:13.350084 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2969/5922] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:29:12 2022] GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8 => generated 1739 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:29:13.371706 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5172de25-9b1d-4564-9f67-27c90faf9599 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9e79ff2e-8182-40eb-b40e-f58e719e422d"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:29:13.389233 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5172de25-9b1d-4564-9f67-27c90faf9599 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 3c9c0c43-4e1a-4290-bbf1-60e26aba66ce] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:13.428440 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5172de25-9b1d-4564-9f67-27c90faf9599 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:13.428440 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5172de25-9b1d-4564-9f67-27c90faf9599 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:13.428440 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5172de25-9b1d-4564-9f67-27c90faf9599 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:13.428440 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5172de25-9b1d-4564-9f67-27c90faf9599 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:13.428440 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5172de25-9b1d-4564-9f67-27c90faf9599 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:13.429065 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5172de25-9b1d-4564-9f67-27c90faf9599 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:14.103598 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-4cb37a50-ba2f-4881-99b2-8a0dd2a0e9b7 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe872c74e07d42478492b281dc1fbf1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a527440f8bf6444591088916ad74ef4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:14.115791 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4cb37a50-ba2f-4881-99b2-8a0dd2a0e9b7 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] 10.222.0.61 "GET /compute/v2.1/servers/9f9fa018-34f8-495a-ade8-1ada7ff80130" status: 200 len: 1323 microversion: 2.1 time: 0.862363 Aug 31 16:29:14.124033 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2954/5923] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:13 2022] GET /compute/v2.1/servers/9f9fa018-34f8-495a-ade8-1ada7ff80130 => generated 1323 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:29:14.141882 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-c4bcd583-3dc7-47ca-8ba1-3915c636b299 req-239e3486-4ff8-4824-9e77-c2dfb02fe8b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f9fa018-34f8-495a-ade8-1ada7ff80130", "tag": "c9d027ae-ab76-4b2d-be30-ee76a2429adb"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:29:14.209642 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-c4bcd583-3dc7-47ca-8ba1-3915c636b299 req-239e3486-4ff8-4824-9e77-c2dfb02fe8b0 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:14.212414 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-c4bcd583-3dc7-47ca-8ba1-3915c636b299 req-239e3486-4ff8-4824-9e77-c2dfb02fe8b0 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:14.216970 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-c4bcd583-3dc7-47ca-8ba1-3915c636b299 req-239e3486-4ff8-4824-9e77-c2dfb02fe8b0 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:14.276446 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-c4bcd583-3dc7-47ca-8ba1-3915c636b299 req-239e3486-4ff8-4824-9e77-c2dfb02fe8b0 service nova] Creating event network-changed:c9d027ae-ab76-4b2d-be30-ee76a2429adb for instance 9f9fa018-34f8-495a-ade8-1ada7ff80130 on n-h1-850499-9 Aug 31 16:29:14.295714 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-c4bcd583-3dc7-47ca-8ba1-3915c636b299 req-239e3486-4ff8-4824-9e77-c2dfb02fe8b0 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.162104 Aug 31 16:29:14.298436 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2955/5924] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:29:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:29:14.320770 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3e36d340-3285-43dc-be7f-8c65b1da8009 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:14.325493 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3e36d340-3285-43dc-be7f-8c65b1da8009 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] [instance: fcaf0da3-ec31-4531-b09f-263f7d188b06] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:14.356720 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3e36d340-3285-43dc-be7f-8c65b1da8009 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:14.358803 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5172de25-9b1d-4564-9f67-27c90faf9599 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "POST /compute/v2.1/servers/3c9c0c43-4e1a-4290-bbf1-60e26aba66ce/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.007280 Aug 31 16:29:14.359458 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2970/5925] 10.222.0.61 () {60 vars in 1323 bytes} [Wed Aug 31 16:29:13 2022] POST /compute/v2.1/servers/3c9c0c43-4e1a-4290-bbf1-60e26aba66ce/os-volume_attachments => generated 194 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:29:14.360296 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3e36d340-3285-43dc-be7f-8c65b1da8009 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:14.361088 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3e36d340-3285-43dc-be7f-8c65b1da8009 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:14.363592 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3e36d340-3285-43dc-be7f-8c65b1da8009 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:14.364561 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3e36d340-3285-43dc-be7f-8c65b1da8009 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:14.371545 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3e36d340-3285-43dc-be7f-8c65b1da8009 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:14.403444 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2968a321-0a71-48ed-b72b-19d226a308ac tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:14.405921 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2968a321-0a71-48ed-b72b-19d226a308ac tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: b31fb01b-045f-41f7-bf58-66c1eca839e8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:14.422626 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2968a321-0a71-48ed-b72b-19d226a308ac tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:14.426181 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2968a321-0a71-48ed-b72b-19d226a308ac tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:14.431234 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2968a321-0a71-48ed-b72b-19d226a308ac tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:14.432080 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2968a321-0a71-48ed-b72b-19d226a308ac tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:14.435662 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2968a321-0a71-48ed-b72b-19d226a308ac tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:14.436126 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2968a321-0a71-48ed-b72b-19d226a308ac tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:14.504132 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:29:15.170428 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2968a321-0a71-48ed-b72b-19d226a308ac tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:15.191996 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2968a321-0a71-48ed-b72b-19d226a308ac tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:15.199476 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2968a321-0a71-48ed-b72b-19d226a308ac tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:15.206540 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2968a321-0a71-48ed-b72b-19d226a308ac tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8" status: 200 len: 1739 microversion: 2.20 time: 0.823464 Aug 31 16:29:15.207571 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2971/5926] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:29:14 2022] GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8 => generated 1739 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:29:15.230959 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-32985313-5504-4a18-8e30-c2ae4ac39665 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:15.236312 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-32985313-5504-4a18-8e30-c2ae4ac39665 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] [instance: 9f9fa018-34f8-495a-ade8-1ada7ff80130] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:15.274331 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-32985313-5504-4a18-8e30-c2ae4ac39665 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:15.286314 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-32985313-5504-4a18-8e30-c2ae4ac39665 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:15.292111 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-32985313-5504-4a18-8e30-c2ae4ac39665 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:15.293391 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-32985313-5504-4a18-8e30-c2ae4ac39665 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:15.294020 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-32985313-5504-4a18-8e30-c2ae4ac39665 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:15.296265 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-32985313-5504-4a18-8e30-c2ae4ac39665 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:15.314322 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3e36d340-3285-43dc-be7f-8c65b1da8009 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc4d613cdc94357b40e83a2b70b0bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb6a0a8643748b9830f2859de6d8b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:15.323691 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3e36d340-3285-43dc-be7f-8c65b1da8009 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] 10.222.0.61 "GET /compute/v2.1/servers/fcaf0da3-ec31-4531-b09f-263f7d188b06" status: 200 len: 1313 microversion: 2.1 time: 1.021127 Aug 31 16:29:15.336250 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2956/5927] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:14 2022] GET /compute/v2.1/servers/fcaf0da3-ec31-4531-b09f-263f7d188b06 => generated 1313 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:29:15.590028 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-32985313-5504-4a18-8e30-c2ae4ac39665 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe872c74e07d42478492b281dc1fbf1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a527440f8bf6444591088916ad74ef4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:15.613988 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-32985313-5504-4a18-8e30-c2ae4ac39665 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] 10.222.0.61 "GET /compute/v2.1/servers/9f9fa018-34f8-495a-ade8-1ada7ff80130" status: 200 len: 1323 microversion: 2.1 time: 0.403742 Aug 31 16:29:15.617703 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2972/5928] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:15 2022] GET /compute/v2.1/servers/9f9fa018-34f8-495a-ade8-1ada7ff80130 => generated 1323 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:29:16.234987 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e72849af-2625-4a7b-a83b-01eeaf095f64 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:16.235656 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e72849af-2625-4a7b-a83b-01eeaf095f64 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: b31fb01b-045f-41f7-bf58-66c1eca839e8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:16.248332 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e72849af-2625-4a7b-a83b-01eeaf095f64 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:16.249943 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e72849af-2625-4a7b-a83b-01eeaf095f64 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:16.250412 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e72849af-2625-4a7b-a83b-01eeaf095f64 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:16.255345 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e72849af-2625-4a7b-a83b-01eeaf095f64 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:16.257479 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e72849af-2625-4a7b-a83b-01eeaf095f64 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:16.257950 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e72849af-2625-4a7b-a83b-01eeaf095f64 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:16.355249 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0e517c54-bd1a-4dc1-a3f1-8b103da18584 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:16.355954 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0e517c54-bd1a-4dc1-a3f1-8b103da18584 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] [instance: fcaf0da3-ec31-4531-b09f-263f7d188b06] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:16.380317 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0e517c54-bd1a-4dc1-a3f1-8b103da18584 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:16.381241 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0e517c54-bd1a-4dc1-a3f1-8b103da18584 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:16.382360 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0e517c54-bd1a-4dc1-a3f1-8b103da18584 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:16.384038 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0e517c54-bd1a-4dc1-a3f1-8b103da18584 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:16.385363 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0e517c54-bd1a-4dc1-a3f1-8b103da18584 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:16.389523 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0e517c54-bd1a-4dc1-a3f1-8b103da18584 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:16.902091 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e72849af-2625-4a7b-a83b-01eeaf095f64 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:16.918027 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e72849af-2625-4a7b-a83b-01eeaf095f64 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:16.919974 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e72849af-2625-4a7b-a83b-01eeaf095f64 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:16.921406 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e72849af-2625-4a7b-a83b-01eeaf095f64 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8" status: 200 len: 1739 microversion: 2.20 time: 0.691177 Aug 31 16:29:16.940599 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2957/5929] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:29:16 2022] GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8 => generated 1739 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:29:16.952327 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-554931df-3b75-4ef0-b0d2-a8ade4f3d199 req-ed35c8e0-40a0-4910-91ec-1ce6302a01b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcaf0da3-ec31-4531-b09f-263f7d188b06", "name": "network-vif-plugged", "status": "completed", "tag": "cdcabff2-27a7-4cca-8476-bbcabbe12df7"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:29:16.983670 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0e517c54-bd1a-4dc1-a3f1-8b103da18584 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc4d613cdc94357b40e83a2b70b0bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb6a0a8643748b9830f2859de6d8b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:16.994224 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0e517c54-bd1a-4dc1-a3f1-8b103da18584 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] 10.222.0.61 "GET /compute/v2.1/servers/fcaf0da3-ec31-4531-b09f-263f7d188b06" status: 200 len: 1313 microversion: 2.1 time: 0.643553 Aug 31 16:29:16.994906 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2973/5930] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:16 2022] GET /compute/v2.1/servers/fcaf0da3-ec31-4531-b09f-263f7d188b06 => generated 1313 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:29:17.015559 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-554931df-3b75-4ef0-b0d2-a8ade4f3d199 req-ed35c8e0-40a0-4910-91ec-1ce6302a01b0 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:17.016140 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-554931df-3b75-4ef0-b0d2-a8ade4f3d199 req-ed35c8e0-40a0-4910-91ec-1ce6302a01b0 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:17.016589 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-554931df-3b75-4ef0-b0d2-a8ade4f3d199 req-ed35c8e0-40a0-4910-91ec-1ce6302a01b0 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:17.030813 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b55e4ac0-6713-4e7c-966f-7552230eff1a tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:17.031462 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b55e4ac0-6713-4e7c-966f-7552230eff1a tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] [instance: 9f9fa018-34f8-495a-ade8-1ada7ff80130] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:17.061067 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b55e4ac0-6713-4e7c-966f-7552230eff1a tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:17.061630 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b55e4ac0-6713-4e7c-966f-7552230eff1a tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:17.062080 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b55e4ac0-6713-4e7c-966f-7552230eff1a tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:17.062948 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b55e4ac0-6713-4e7c-966f-7552230eff1a tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:17.063590 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b55e4ac0-6713-4e7c-966f-7552230eff1a tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:17.065605 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-554931df-3b75-4ef0-b0d2-a8ade4f3d199 req-ed35c8e0-40a0-4910-91ec-1ce6302a01b0 service nova] Creating event network-vif-plugged:cdcabff2-27a7-4cca-8476-bbcabbe12df7 for instance fcaf0da3-ec31-4531-b09f-263f7d188b06 on n-h2-850499-9 Aug 31 16:29:17.074205 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b55e4ac0-6713-4e7c-966f-7552230eff1a tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:17.088641 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-554931df-3b75-4ef0-b0d2-a8ade4f3d199 req-ed35c8e0-40a0-4910-91ec-1ce6302a01b0 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145931 Aug 31 16:29:17.095818 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2958/5931] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:29:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:29:17.611119 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b55e4ac0-6713-4e7c-966f-7552230eff1a tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe872c74e07d42478492b281dc1fbf1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a527440f8bf6444591088916ad74ef4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:17.625616 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b55e4ac0-6713-4e7c-966f-7552230eff1a tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] 10.222.0.61 "GET /compute/v2.1/servers/9f9fa018-34f8-495a-ade8-1ada7ff80130" status: 200 len: 1323 microversion: 2.1 time: 0.600169 Aug 31 16:29:17.640866 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2974/5932] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:16 2022] GET /compute/v2.1/servers/9f9fa018-34f8-495a-ade8-1ada7ff80130 => generated 1323 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:29:17.947828 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2a02d363-1d06-49a3-a80c-4edba8ad6d1b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:17.949658 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2a02d363-1d06-49a3-a80c-4edba8ad6d1b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: b31fb01b-045f-41f7-bf58-66c1eca839e8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:17.986197 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2a02d363-1d06-49a3-a80c-4edba8ad6d1b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:17.987700 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2a02d363-1d06-49a3-a80c-4edba8ad6d1b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:17.992766 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2a02d363-1d06-49a3-a80c-4edba8ad6d1b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:17.994693 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2a02d363-1d06-49a3-a80c-4edba8ad6d1b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:17.995704 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2a02d363-1d06-49a3-a80c-4edba8ad6d1b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:17.996358 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2a02d363-1d06-49a3-a80c-4edba8ad6d1b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:18.019998 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5fe723a3-f091-461f-877e-b3f6b6d7fb75 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:18.021445 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5fe723a3-f091-461f-877e-b3f6b6d7fb75 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] [instance: fcaf0da3-ec31-4531-b09f-263f7d188b06] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:18.038407 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5fe723a3-f091-461f-877e-b3f6b6d7fb75 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:18.039426 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5fe723a3-f091-461f-877e-b3f6b6d7fb75 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:18.040210 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5fe723a3-f091-461f-877e-b3f6b6d7fb75 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:18.042858 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5fe723a3-f091-461f-877e-b3f6b6d7fb75 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:18.043804 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5fe723a3-f091-461f-877e-b3f6b6d7fb75 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:18.045020 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5fe723a3-f091-461f-877e-b3f6b6d7fb75 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:18.647244 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5fe723a3-f091-461f-877e-b3f6b6d7fb75 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc4d613cdc94357b40e83a2b70b0bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb6a0a8643748b9830f2859de6d8b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:18.657621 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5fe723a3-f091-461f-877e-b3f6b6d7fb75 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] 10.222.0.61 "GET /compute/v2.1/servers/fcaf0da3-ec31-4531-b09f-263f7d188b06" status: 200 len: 1313 microversion: 2.1 time: 0.642058 Aug 31 16:29:18.665494 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2975/5933] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:18 2022] GET /compute/v2.1/servers/fcaf0da3-ec31-4531-b09f-263f7d188b06 => generated 1313 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:29:18.679024 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1b180c2d-6313-483c-b15f-ded84ba96f43 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:18.679977 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1b180c2d-6313-483c-b15f-ded84ba96f43 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] [instance: 9f9fa018-34f8-495a-ade8-1ada7ff80130] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:18.698380 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1b180c2d-6313-483c-b15f-ded84ba96f43 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:18.700053 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1b180c2d-6313-483c-b15f-ded84ba96f43 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:18.702844 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1b180c2d-6313-483c-b15f-ded84ba96f43 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:18.707462 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1b180c2d-6313-483c-b15f-ded84ba96f43 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:18.710257 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1b180c2d-6313-483c-b15f-ded84ba96f43 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:18.711294 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1b180c2d-6313-483c-b15f-ded84ba96f43 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:18.928887 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-2a02d363-1d06-49a3-a80c-4edba8ad6d1b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:18.939242 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-2a02d363-1d06-49a3-a80c-4edba8ad6d1b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:18.941833 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-2a02d363-1d06-49a3-a80c-4edba8ad6d1b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:18.950697 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2a02d363-1d06-49a3-a80c-4edba8ad6d1b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8" status: 200 len: 1739 microversion: 2.20 time: 1.007555 Aug 31 16:29:18.954303 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2959/5934] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:29:17 2022] GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8 => generated 1739 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:29:19.157891 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-1b180c2d-6313-483c-b15f-ded84ba96f43 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe872c74e07d42478492b281dc1fbf1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a527440f8bf6444591088916ad74ef4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:19.175881 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1b180c2d-6313-483c-b15f-ded84ba96f43 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] 10.222.0.61 "GET /compute/v2.1/servers/9f9fa018-34f8-495a-ade8-1ada7ff80130" status: 200 len: 1323 microversion: 2.1 time: 0.508530 Aug 31 16:29:19.176505 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2976/5935] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:18 2022] GET /compute/v2.1/servers/9f9fa018-34f8-495a-ade8-1ada7ff80130 => generated 1323 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:29:19.686845 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e0489596-4571-455f-9e89-02b5402f8f1b tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:19.687705 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e0489596-4571-455f-9e89-02b5402f8f1b tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] [instance: fcaf0da3-ec31-4531-b09f-263f7d188b06] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:19.700586 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e0489596-4571-455f-9e89-02b5402f8f1b tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:19.704514 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e0489596-4571-455f-9e89-02b5402f8f1b tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:19.705315 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e0489596-4571-455f-9e89-02b5402f8f1b tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:19.706326 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e0489596-4571-455f-9e89-02b5402f8f1b tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:19.709267 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e0489596-4571-455f-9e89-02b5402f8f1b tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:19.711995 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e0489596-4571-455f-9e89-02b5402f8f1b tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:19.981176 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a55e420b-a46e-4f9d-adfa-425a158955d3 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:19.981803 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a55e420b-a46e-4f9d-adfa-425a158955d3 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: b31fb01b-045f-41f7-bf58-66c1eca839e8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:19.998129 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a55e420b-a46e-4f9d-adfa-425a158955d3 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:19.998941 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a55e420b-a46e-4f9d-adfa-425a158955d3 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:19.999730 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a55e420b-a46e-4f9d-adfa-425a158955d3 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:20.000478 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a55e420b-a46e-4f9d-adfa-425a158955d3 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:20.000951 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a55e420b-a46e-4f9d-adfa-425a158955d3 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:20.005337 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a55e420b-a46e-4f9d-adfa-425a158955d3 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:20.058345 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e0489596-4571-455f-9e89-02b5402f8f1b tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc4d613cdc94357b40e83a2b70b0bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb6a0a8643748b9830f2859de6d8b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:20.072576 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e0489596-4571-455f-9e89-02b5402f8f1b tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] 10.222.0.61 "GET /compute/v2.1/servers/fcaf0da3-ec31-4531-b09f-263f7d188b06" status: 200 len: 1498 microversion: 2.1 time: 0.389630 Aug 31 16:29:20.073893 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2960/5936] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:19 2022] GET /compute/v2.1/servers/fcaf0da3-ec31-4531-b09f-263f7d188b06 => generated 1498 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:29:20.198357 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8d482f0c-5e99-49f5-8bc7-477b2c82c80b tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:20.199210 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8d482f0c-5e99-49f5-8bc7-477b2c82c80b tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] [instance: 9f9fa018-34f8-495a-ade8-1ada7ff80130] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:20.210135 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8d482f0c-5e99-49f5-8bc7-477b2c82c80b tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:20.223582 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8d482f0c-5e99-49f5-8bc7-477b2c82c80b tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:20.231735 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8d482f0c-5e99-49f5-8bc7-477b2c82c80b tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:20.232954 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8d482f0c-5e99-49f5-8bc7-477b2c82c80b tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:20.240981 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8d482f0c-5e99-49f5-8bc7-477b2c82c80b tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:20.241980 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8d482f0c-5e99-49f5-8bc7-477b2c82c80b tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:20.349685 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a55e420b-a46e-4f9d-adfa-425a158955d3 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:20.378007 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a55e420b-a46e-4f9d-adfa-425a158955d3 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:20.379484 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a55e420b-a46e-4f9d-adfa-425a158955d3 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:20.381144 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a55e420b-a46e-4f9d-adfa-425a158955d3 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8" status: 200 len: 1739 microversion: 2.20 time: 0.403927 Aug 31 16:29:20.402389 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2977/5937] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:29:19 2022] GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8 => generated 1739 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:29:20.659678 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8d482f0c-5e99-49f5-8bc7-477b2c82c80b tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe872c74e07d42478492b281dc1fbf1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a527440f8bf6444591088916ad74ef4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:20.678655 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8d482f0c-5e99-49f5-8bc7-477b2c82c80b tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] 10.222.0.61 "GET /compute/v2.1/servers/9f9fa018-34f8-495a-ade8-1ada7ff80130" status: 200 len: 1323 microversion: 2.1 time: 0.478093 Aug 31 16:29:20.679794 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2961/5938] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:20 2022] GET /compute/v2.1/servers/9f9fa018-34f8-495a-ade8-1ada7ff80130 => generated 1323 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:29:21.425111 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d70cc1a9-fb77-4d92-b974-0af88e571eac tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:21.425750 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d70cc1a9-fb77-4d92-b974-0af88e571eac tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: b31fb01b-045f-41f7-bf58-66c1eca839e8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:21.456992 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d70cc1a9-fb77-4d92-b974-0af88e571eac tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:21.457619 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d70cc1a9-fb77-4d92-b974-0af88e571eac tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:21.458067 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d70cc1a9-fb77-4d92-b974-0af88e571eac tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:21.463057 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d70cc1a9-fb77-4d92-b974-0af88e571eac tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:21.468519 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d70cc1a9-fb77-4d92-b974-0af88e571eac tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:21.470625 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d70cc1a9-fb77-4d92-b974-0af88e571eac tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:21.615643 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-97116983-b06f-4407-8499-49efc172a91b tempest-QuotasTestJSON-1910578941 tempest-QuotasTestJSON-1910578941-project] Calling method '.version_select at 0x7f5aed344b80>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:21.726558 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-97116983-b06f-4407-8499-49efc172a91b tempest-QuotasTestJSON-1910578941 tempest-QuotasTestJSON-1910578941-project] 10.222.0.61 "GET /compute/v2.1/os-quota-sets/2cde4213bfdd4c14abc0599ec116383d/defaults" status: 200 len: 371 microversion: 2.1 time: 0.476753 Aug 31 16:29:21.727436 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2978/5939] 10.222.0.61 () {58 vars in 1269 bytes} [Wed Aug 31 16:29:21 2022] GET /compute/v2.1/os-quota-sets/2cde4213bfdd4c14abc0599ec116383d/defaults => generated 371 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:29:21.738353 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1d6940d7-fbe2-4917-a293-c6e2c882318b tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:21.745162 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1d6940d7-fbe2-4917-a293-c6e2c882318b tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] [instance: 9f9fa018-34f8-495a-ade8-1ada7ff80130] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:21.757796 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1d6940d7-fbe2-4917-a293-c6e2c882318b tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:21.762574 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1d6940d7-fbe2-4917-a293-c6e2c882318b tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:21.765021 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1d6940d7-fbe2-4917-a293-c6e2c882318b tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:21.766621 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1d6940d7-fbe2-4917-a293-c6e2c882318b tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:21.770530 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1d6940d7-fbe2-4917-a293-c6e2c882318b tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:21.771643 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1d6940d7-fbe2-4917-a293-c6e2c882318b tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:22.295928 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d70cc1a9-fb77-4d92-b974-0af88e571eac tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:22.315013 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d70cc1a9-fb77-4d92-b974-0af88e571eac tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:22.317566 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d70cc1a9-fb77-4d92-b974-0af88e571eac tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:22.323616 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d70cc1a9-fb77-4d92-b974-0af88e571eac tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8" status: 200 len: 1739 microversion: 2.20 time: 0.903287 Aug 31 16:29:22.324494 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2962/5940] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:29:21 2022] GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8 => generated 1739 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:29:22.334294 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-1d6940d7-fbe2-4917-a293-c6e2c882318b tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe872c74e07d42478492b281dc1fbf1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a527440f8bf6444591088916ad74ef4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:22.341606 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-85cf001a-06af-4983-9c29-6587bd87946b tempest-QuotasTestJSON-1910578941 tempest-QuotasTestJSON-1910578941-project] Calling method '.version_select at 0x7f5ae85e7820>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:22.344946 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1d6940d7-fbe2-4917-a293-c6e2c882318b tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] 10.222.0.61 "GET /compute/v2.1/servers/9f9fa018-34f8-495a-ade8-1ada7ff80130" status: 200 len: 1323 microversion: 2.1 time: 0.614090 Aug 31 16:29:22.370851 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2979/5941] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:21 2022] GET /compute/v2.1/servers/9f9fa018-34f8-495a-ade8-1ada7ff80130 => generated 1323 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:29:22.461466 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-85cf001a-06af-4983-9c29-6587bd87946b tempest-QuotasTestJSON-1910578941 tempest-QuotasTestJSON-1910578941-project] 10.222.0.61 "GET /compute/v2.1/os-quota-sets/2cde4213bfdd4c14abc0599ec116383d" status: 200 len: 371 microversion: 2.1 time: 0.128952 Aug 31 16:29:22.462952 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2963/5942] 10.222.0.61 () {58 vars in 1242 bytes} [Wed Aug 31 16:29:22 2022] GET /compute/v2.1/os-quota-sets/2cde4213bfdd4c14abc0599ec116383d => generated 371 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:29:22.480609 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3367fb71-6cea-4eb6-96c9-3029ee42b4e0 tempest-QuotasTestJSON-1910578941 tempest-QuotasTestJSON-1910578941-project] Calling method '.version_select at 0x7f5aed3445e0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:22.555924 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3367fb71-6cea-4eb6-96c9-3029ee42b4e0 tempest-QuotasTestJSON-1910578941 tempest-QuotasTestJSON-1910578941-project] 10.222.0.61 "GET /compute/v2.1/os-quota-sets/2cde4213bfdd4c14abc0599ec116383d/defaults" status: 200 len: 371 microversion: 2.1 time: 0.079650 Aug 31 16:29:22.556957 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2980/5943] 10.222.0.61 () {58 vars in 1269 bytes} [Wed Aug 31 16:29:22 2022] GET /compute/v2.1/os-quota-sets/2cde4213bfdd4c14abc0599ec116383d/defaults => generated 371 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:29:22.575039 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-238af10a-6c78-4c5a-9741-e0e08ce97287 tempest-QuotasTestJSON-1910578941 tempest-QuotasTestJSON-1910578941-project] Calling method '.version_select at 0x7f5ae85ca1f0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:22.710473 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-238af10a-6c78-4c5a-9741-e0e08ce97287 tempest-QuotasTestJSON-1910578941 tempest-QuotasTestJSON-1910578941-project] 10.222.0.61 "GET /compute/v2.1/os-quota-sets/2cde4213bfdd4c14abc0599ec116383d" status: 200 len: 371 microversion: 2.1 time: 0.141150 Aug 31 16:29:22.712937 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2964/5944] 10.222.0.61 () {58 vars in 1242 bytes} [Wed Aug 31 16:29:22 2022] GET /compute/v2.1/os-quota-sets/2cde4213bfdd4c14abc0599ec116383d => generated 371 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:29:22.725883 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b61fc59b-39ea-414f-81fa-61c6d1740627 tempest-QuotasTestJSON-1910578941 tempest-QuotasTestJSON-1910578941-project] Calling method '.version_select at 0x7f5ae3d3d670>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:22.907977 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b61fc59b-39ea-414f-81fa-61c6d1740627 tempest-QuotasTestJSON-1910578941 tempest-QuotasTestJSON-1910578941-project] 10.222.0.61 "GET /compute/v2.1/os-quota-sets/2cde4213bfdd4c14abc0599ec116383d?user_id=4c627d8c8c9f482abfc057e89a7217d8" status: 200 len: 371 microversion: 2.1 time: 0.186291 Aug 31 16:29:22.918961 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2981/5945] 10.222.0.61 () {58 vars in 1323 bytes} [Wed Aug 31 16:29:22 2022] GET /compute/v2.1/os-quota-sets/2cde4213bfdd4c14abc0599ec116383d?user_id=4c627d8c8c9f482abfc057e89a7217d8 => generated 371 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:29:23.046388 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-97b33579-5dd3-44f3-9551-e6e5ce8313f2 req-cbe02678-25b8-416d-8cc7-b479a099cee3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f9fa018-34f8-495a-ade8-1ada7ff80130", "name": "network-vif-plugged", "status": "completed", "tag": "c9d027ae-ab76-4b2d-be30-ee76a2429adb"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:29:23.082214 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-97b33579-5dd3-44f3-9551-e6e5ce8313f2 req-cbe02678-25b8-416d-8cc7-b479a099cee3 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:23.083309 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-97b33579-5dd3-44f3-9551-e6e5ce8313f2 req-cbe02678-25b8-416d-8cc7-b479a099cee3 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:23.085667 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-97b33579-5dd3-44f3-9551-e6e5ce8313f2 req-cbe02678-25b8-416d-8cc7-b479a099cee3 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:23.137240 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-97b33579-5dd3-44f3-9551-e6e5ce8313f2 req-cbe02678-25b8-416d-8cc7-b479a099cee3 service nova] Creating event network-vif-plugged:c9d027ae-ab76-4b2d-be30-ee76a2429adb for instance 9f9fa018-34f8-495a-ade8-1ada7ff80130 on n-h1-850499-9 Aug 31 16:29:23.153524 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-97b33579-5dd3-44f3-9551-e6e5ce8313f2 req-cbe02678-25b8-416d-8cc7-b479a099cee3 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113860 Aug 31 16:29:23.155037 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2965/5946] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:29:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:29:23.365335 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b69da166-2b91-4e2f-b357-edc8d3fd43a7 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:23.366280 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b69da166-2b91-4e2f-b357-edc8d3fd43a7 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: b31fb01b-045f-41f7-bf58-66c1eca839e8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:23.379189 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7696839a-598c-49e9-9507-eae96aefc23c tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:23.381061 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7696839a-598c-49e9-9507-eae96aefc23c tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] [instance: 9f9fa018-34f8-495a-ade8-1ada7ff80130] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:23.392992 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:29:23.394665 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b69da166-2b91-4e2f-b357-edc8d3fd43a7 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:23.397693 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b69da166-2b91-4e2f-b357-edc8d3fd43a7 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:23.402433 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b69da166-2b91-4e2f-b357-edc8d3fd43a7 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:23.407075 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=74 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:29:23.408986 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b69da166-2b91-4e2f-b357-edc8d3fd43a7 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:23.412989 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7696839a-598c-49e9-9507-eae96aefc23c tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:23.413710 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b69da166-2b91-4e2f-b357-edc8d3fd43a7 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:23.419993 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b69da166-2b91-4e2f-b357-edc8d3fd43a7 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:23.426076 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7696839a-598c-49e9-9507-eae96aefc23c tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:23.429166 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7696839a-598c-49e9-9507-eae96aefc23c tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:23.435133 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7696839a-598c-49e9-9507-eae96aefc23c tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:23.435962 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7696839a-598c-49e9-9507-eae96aefc23c tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:23.438197 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7696839a-598c-49e9-9507-eae96aefc23c tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:23.456562 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:29:23.804429 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b69da166-2b91-4e2f-b357-edc8d3fd43a7 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:23.821886 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b69da166-2b91-4e2f-b357-edc8d3fd43a7 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:23.837644 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b69da166-2b91-4e2f-b357-edc8d3fd43a7 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:23.842329 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b69da166-2b91-4e2f-b357-edc8d3fd43a7 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8" status: 200 len: 1739 microversion: 2.20 time: 0.494164 Aug 31 16:29:23.852741 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2982/5947] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:29:23 2022] GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8 => generated 1739 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:29:23.928044 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7696839a-598c-49e9-9507-eae96aefc23c tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe872c74e07d42478492b281dc1fbf1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a527440f8bf6444591088916ad74ef4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:23.936748 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7696839a-598c-49e9-9507-eae96aefc23c tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] 10.222.0.61 "GET /compute/v2.1/servers/9f9fa018-34f8-495a-ade8-1ada7ff80130" status: 200 len: 1323 microversion: 2.1 time: 0.563477 Aug 31 16:29:23.952654 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2966/5948] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:23 2022] GET /compute/v2.1/servers/9f9fa018-34f8-495a-ade8-1ada7ff80130 => generated 1323 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:29:24.876365 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-82bcacbc-f2d8-4643-906b-e4c2d184d1ec tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:24.876983 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-82bcacbc-f2d8-4643-906b-e4c2d184d1ec tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: b31fb01b-045f-41f7-bf58-66c1eca839e8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:24.892880 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-82bcacbc-f2d8-4643-906b-e4c2d184d1ec tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:24.895370 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-82bcacbc-f2d8-4643-906b-e4c2d184d1ec tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:24.898242 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-82bcacbc-f2d8-4643-906b-e4c2d184d1ec tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:24.899285 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-82bcacbc-f2d8-4643-906b-e4c2d184d1ec tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:24.899962 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-82bcacbc-f2d8-4643-906b-e4c2d184d1ec tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:24.904668 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-82bcacbc-f2d8-4643-906b-e4c2d184d1ec tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:24.964011 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b1b560b5-af48-451a-bb3a-a073430cb2dc tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:24.964962 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b1b560b5-af48-451a-bb3a-a073430cb2dc tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] [instance: 9f9fa018-34f8-495a-ade8-1ada7ff80130] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:25.021883 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b1b560b5-af48-451a-bb3a-a073430cb2dc tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:25.024157 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b1b560b5-af48-451a-bb3a-a073430cb2dc tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:25.026916 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b1b560b5-af48-451a-bb3a-a073430cb2dc tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:25.035456 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b1b560b5-af48-451a-bb3a-a073430cb2dc tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:25.037628 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b1b560b5-af48-451a-bb3a-a073430cb2dc tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:25.040116 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b1b560b5-af48-451a-bb3a-a073430cb2dc tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:25.615318 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-82bcacbc-f2d8-4643-906b-e4c2d184d1ec tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:25.624848 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-82bcacbc-f2d8-4643-906b-e4c2d184d1ec tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:25.626423 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-82bcacbc-f2d8-4643-906b-e4c2d184d1ec tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:25.632271 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-82bcacbc-f2d8-4643-906b-e4c2d184d1ec tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8" status: 200 len: 1739 microversion: 2.20 time: 0.756216 Aug 31 16:29:25.632950 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2983/5949] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:29:24 2022] GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8 => generated 1739 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:29:25.763111 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b1b560b5-af48-451a-bb3a-a073430cb2dc tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe872c74e07d42478492b281dc1fbf1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a527440f8bf6444591088916ad74ef4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:25.777326 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b1b560b5-af48-451a-bb3a-a073430cb2dc tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] 10.222.0.61 "GET /compute/v2.1/servers/9f9fa018-34f8-495a-ade8-1ada7ff80130" status: 200 len: 1323 microversion: 2.1 time: 0.817584 Aug 31 16:29:25.779469 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2967/5950] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:24 2022] GET /compute/v2.1/servers/9f9fa018-34f8-495a-ade8-1ada7ff80130 => generated 1323 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:29:26.668350 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a5345b8c-9998-44b0-888b-d1cc01960d1c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:26.668350 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a5345b8c-9998-44b0-888b-d1cc01960d1c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: b31fb01b-045f-41f7-bf58-66c1eca839e8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:26.671314 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a5345b8c-9998-44b0-888b-d1cc01960d1c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:26.672221 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a5345b8c-9998-44b0-888b-d1cc01960d1c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:26.672945 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a5345b8c-9998-44b0-888b-d1cc01960d1c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:26.674159 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a5345b8c-9998-44b0-888b-d1cc01960d1c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:26.675379 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a5345b8c-9998-44b0-888b-d1cc01960d1c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:26.676122 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a5345b8c-9998-44b0-888b-d1cc01960d1c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:26.738262 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:29:26.832375 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-12162d62-7a1c-480e-a07b-4832be5cbdb6 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:26.832979 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-12162d62-7a1c-480e-a07b-4832be5cbdb6 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] [instance: 9f9fa018-34f8-495a-ade8-1ada7ff80130] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:26.854238 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-12162d62-7a1c-480e-a07b-4832be5cbdb6 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:26.855668 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-12162d62-7a1c-480e-a07b-4832be5cbdb6 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:26.856632 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-12162d62-7a1c-480e-a07b-4832be5cbdb6 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:26.857648 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-12162d62-7a1c-480e-a07b-4832be5cbdb6 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:26.858376 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-12162d62-7a1c-480e-a07b-4832be5cbdb6 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:26.859038 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-12162d62-7a1c-480e-a07b-4832be5cbdb6 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:27.214344 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a5345b8c-9998-44b0-888b-d1cc01960d1c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:27.216159 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-12162d62-7a1c-480e-a07b-4832be5cbdb6 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe872c74e07d42478492b281dc1fbf1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a527440f8bf6444591088916ad74ef4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:27.225650 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-12162d62-7a1c-480e-a07b-4832be5cbdb6 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] 10.222.0.61 "GET /compute/v2.1/servers/9f9fa018-34f8-495a-ade8-1ada7ff80130" status: 200 len: 1519 microversion: 2.1 time: 0.426718 Aug 31 16:29:27.226484 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2968/5951] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:26 2022] GET /compute/v2.1/servers/9f9fa018-34f8-495a-ade8-1ada7ff80130 => generated 1519 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:29:27.240168 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a5345b8c-9998-44b0-888b-d1cc01960d1c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:27.242620 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a5345b8c-9998-44b0-888b-d1cc01960d1c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:27.244162 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a5345b8c-9998-44b0-888b-d1cc01960d1c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8" status: 200 len: 1739 microversion: 2.20 time: 0.587855 Aug 31 16:29:27.244921 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2984/5952] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:29:26 2022] GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8 => generated 1739 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:29:27.520202 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a3ab6d37-49f2-445e-84c8-8b6b36a48890 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2111413119", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "d0764a92-cb3d-4cac-8811-0a7f7292a98b"}]}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:29:27.531692 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a3ab6d37-49f2-445e-84c8-8b6b36a48890 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Request method failure captured: Aug 31 16:29:27.531692 n-d-850499-9 devstack@n-api.service[122256]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 31 16:29:27.531692 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:29:27.531692 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:29:27.531692 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:29:27.531692 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 243 Aug 31 16:29:27.531692 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:29:27.531692 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:29:27.531692 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:29:27.531692 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:29:27.531692 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4xKYDUDcmpyfs-1ehFAPOwERZDhSNJNfsi2dWKCjoRiSQU9E3HdgLV7nLsg5peCHPl8sqiBrdEdeTyjFj23OIXibRY1Q95lLqgRbDNVVa7CwUHdujT4nhWGxGMRt-A0tzIZcN3-NDVk9gqTj1j4W86ybU_7BjVduMQAUblMp4H0Th0 Aug 31 16:29:27.531692 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:29:27.531692 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:29:27.531692 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:29:27.531692 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:29:27.531692 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:29:27.531692 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:29:27.531692 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: a527440f8bf6444591088916ad74ef4f Aug 31 16:29:27.531692 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1500883040 Aug 31 16:29:27.531692 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:29:27.531692 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:29:27.531692 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a527440f8bf6444591088916ad74ef4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a527440f8bf6444591088916ad74ef4f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a527440f8bf6444591088916ad74ef4f", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a527440f8bf6444591088916ad74ef4f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:29:27.531692 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1500883040 Aug 31 16:29:27.531692 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: a527440f8bf6444591088916ad74ef4f Aug 31 16:29:27.531692 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1500883040 Aug 31 16:29:27.531692 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ServerMetadataNegativeTestJSON-1500883040-project Aug 31 16:29:27.531692 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:29:27.531692 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:29:27.531692 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: fe872c74e07d42478492b281dc1fbf1a Aug 31 16:29:27.531692 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1500883040-project Aug 31 16:29:27.531692 n-d-850499-9 devstack@n-api.service[122256]: Aug 31 16:29:27.531692 n-d-850499-9 devstack@n-api.service[122256]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2111413119", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "d0764a92-cb3d-4cac-8811-0a7f7292a98b"}]}} Aug 31 16:29:27.531692 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:29:27.531692 n-d-850499-9 devstack@n-api.service[122256]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 31 16:29:27.531692 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-2111413119', 'imageRef': 'b9c36d42-ed46-4bf5-ad18-1df45cbd0413', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': 'd0764a92-cb3d-4cac-8811-0a7f7292a98b'}]}}} Aug 31 16:29:27.531692 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:29:27.531692 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:29:27.531692 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 16:29:27.531692 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 16:29:27.531692 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 16:29:27.531692 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise error Aug 31 16:29:27.531692 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 31 16:29:27.531692 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:29:27.531692 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 31 16:29:27.531692 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 31 16:29:27.531692 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 31 16:29:27.531692 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 31 16:29:27.531692 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 31 16:29:27.531692 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:29:27.531692 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 31 16:29:27.531692 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi {'': 'data1'} Aug 31 16:29:27.531692 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:29:27.531692 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:29:27.531692 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:29:27.531692 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:29:27.531692 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:29:27.531692 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:29:27.531692 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:29:27.531692 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:29:27.531692 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:29:27.531692 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:29:27.531692 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:29:27.535126 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:29:27.535126 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 16:29:27.535126 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 16:29:27.535126 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 16:29:27.535126 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 16:29:27.535126 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 16:29:27.535126 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 16:29:27.535126 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 31 16:29:27.535126 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:29:27.535126 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:29:27.535126 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:29:27.535126 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:29:27.535126 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:29:27.535126 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:29:27.535126 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 16:29:27.535126 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 16:29:27.535126 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 31 16:29:27.535126 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:29:27.535126 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a3ab6d37-49f2-445e-84c8-8b6b36a48890 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:29:27.535126 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a3ab6d37-49f2-445e-84c8-8b6b36a48890 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.017379 Aug 31 16:29:27.535126 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2969/5953] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:29:27 2022] POST /compute/v2.1/servers => generated 175 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:29:27.551244 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2cac0765-42cd-4ac2-b102-5b3fd9676429 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:27.552404 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2cac0765-42cd-4ac2-b102-5b3fd9676429 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] [instance: cafd537e-dde2-429f-867f-0f3f5e77717f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:27.567416 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-2cac0765-42cd-4ac2-b102-5b3fd9676429 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] HTTP exception thrown: Instance cafd537e-dde2-429f-867f-0f3f5e77717f could not be found. Aug 31 16:29:27.574462 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2cac0765-42cd-4ac2-b102-5b3fd9676429 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Request method failure captured: Aug 31 16:29:27.574462 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/cafd537e-dde2-429f-867f-0f3f5e77717f/metadata HTTP/1.1 Aug 31 16:29:27.574462 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:29:27.574462 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:29:27.574462 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:29:27.574462 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:29:27.574462 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:29:27.574462 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:29:27.574462 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:29:27.574462 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:29:27.574462 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4xKYDUDcmpyfs-1ehFAPOwERZDhSNJNfsi2dWKCjoRiSQU9E3HdgLV7nLsg5peCHPl8sqiBrdEdeTyjFj23OIXibRY1Q95lLqgRbDNVVa7CwUHdujT4nhWGxGMRt-A0tzIZcN3-NDVk9gqTj1j4W86ybU_7BjVduMQAUblMp4H0Th0 Aug 31 16:29:27.574462 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:29:27.574462 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:29:27.574462 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:29:27.574462 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:29:27.574462 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:29:27.574462 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:29:27.574462 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: a527440f8bf6444591088916ad74ef4f Aug 31 16:29:27.574462 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1500883040 Aug 31 16:29:27.574462 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:29:27.574462 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:29:27.574462 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a527440f8bf6444591088916ad74ef4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a527440f8bf6444591088916ad74ef4f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a527440f8bf6444591088916ad74ef4f", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a527440f8bf6444591088916ad74ef4f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:29:27.574462 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1500883040 Aug 31 16:29:27.574462 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: a527440f8bf6444591088916ad74ef4f Aug 31 16:29:27.574462 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1500883040 Aug 31 16:29:27.574462 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ServerMetadataNegativeTestJSON-1500883040-project Aug 31 16:29:27.574462 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:29:27.574462 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:29:27.574462 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: fe872c74e07d42478492b281dc1fbf1a Aug 31 16:29:27.574462 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1500883040-project Aug 31 16:29:27.574462 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:29:27.574462 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance cafd537e-dde2-429f-867f-0f3f5e77717f could not be found. Aug 31 16:29:27.574462 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'server_id': 'cafd537e-dde2-429f-867f-0f3f5e77717f'} Aug 31 16:29:27.574462 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:29:27.574462 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:29:27.574462 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:29:27.574462 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:29:27.574462 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:29:27.574462 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:29:27.574462 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 31 16:29:27.574462 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 31 16:29:27.574462 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cafd537e-dde2-429f-867f-0f3f5e77717f could not be found. Aug 31 16:29:27.574462 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:29:27.574462 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:29:27.574462 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:29:27.574462 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:29:27.574462 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:29:27.574462 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:29:27.574462 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:29:27.574462 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:29:27.574462 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:29:27.574462 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:29:27.574462 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Aug 31 16:29:27.574462 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Aug 31 16:29:27.574462 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:29:27.574462 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:29:27.574462 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cafd537e-dde2-429f-867f-0f3f5e77717f could not be found. Aug 31 16:29:27.574462 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:29:27.574462 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:29:27.574462 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:29:27.574462 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:29:27.574462 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:29:27.574462 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:29:27.578136 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:29:27.578136 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:29:27.578136 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cafd537e-dde2-429f-867f-0f3f5e77717f could not be found. Aug 31 16:29:27.578136 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:29:27.584387 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2cac0765-42cd-4ac2-b102-5b3fd9676429 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Returning 404 to user: Instance cafd537e-dde2-429f-867f-0f3f5e77717f could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:29:27.585322 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2cac0765-42cd-4ac2-b102-5b3fd9676429 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] 10.222.0.61 "GET /compute/v2.1/servers/cafd537e-dde2-429f-867f-0f3f5e77717f/metadata" status: 404 len: 111 microversion: 2.1 time: 0.038182 Aug 31 16:29:27.586279 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2985/5954] 10.222.0.61 () {58 vars in 1263 bytes} [Wed Aug 31 16:29:27 2022] GET /compute/v2.1/servers/cafd537e-dde2-429f-867f-0f3f5e77717f/metadata => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 16:29:27.706720 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-45c05793-453a-4596-835c-72b1fb85a031 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1538620850", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "d0764a92-cb3d-4cac-8811-0a7f7292a98b"}]}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:29:27.712121 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-45c05793-453a-4596-835c-72b1fb85a031 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Request method failure captured: Aug 31 16:29:27.712121 n-d-850499-9 devstack@n-api.service[122256]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 31 16:29:27.712121 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:29:27.712121 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:29:27.712121 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:29:27.712121 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 499 Aug 31 16:29:27.712121 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:29:27.712121 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:29:27.712121 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:29:27.712121 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:29:27.712121 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4xKYDUDcmpyfs-1ehFAPOwERZDhSNJNfsi2dWKCjoRiSQU9E3HdgLV7nLsg5peCHPl8sqiBrdEdeTyjFj23OIXibRY1Q95lLqgRbDNVVa7CwUHdujT4nhWGxGMRt-A0tzIZcN3-NDVk9gqTj1j4W86ybU_7BjVduMQAUblMp4H0Th0 Aug 31 16:29:27.712121 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:29:27.712121 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:29:27.712121 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:29:27.712121 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:29:27.712121 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:29:27.712121 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:29:27.712121 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: a527440f8bf6444591088916ad74ef4f Aug 31 16:29:27.712121 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1500883040 Aug 31 16:29:27.712121 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:29:27.712121 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:29:27.712121 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a527440f8bf6444591088916ad74ef4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a527440f8bf6444591088916ad74ef4f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a527440f8bf6444591088916ad74ef4f", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a527440f8bf6444591088916ad74ef4f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:29:27.712121 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1500883040 Aug 31 16:29:27.712121 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: a527440f8bf6444591088916ad74ef4f Aug 31 16:29:27.712121 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1500883040 Aug 31 16:29:27.712121 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ServerMetadataNegativeTestJSON-1500883040-project Aug 31 16:29:27.712121 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:29:27.712121 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:29:27.712121 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: fe872c74e07d42478492b281dc1fbf1a Aug 31 16:29:27.712121 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1500883040-project Aug 31 16:29:27.712121 n-d-850499-9 devstack@n-api.service[122256]: Aug 31 16:29:27.712121 n-d-850499-9 devstack@n-api.service[122256]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1538620850", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "d0764a92-cb3d-4cac-8811-0a7f7292a98b"}]}} Aug 31 16:29:27.712121 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:29:27.712121 n-d-850499-9 devstack@n-api.service[122256]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 31 16:29:27.712121 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1538620850', 'imageRef': 'b9c36d42-ed46-4bf5-ad18-1df45cbd0413', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'd0764a92-cb3d-4cac-8811-0a7f7292a98b'}]}}} Aug 31 16:29:27.712121 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:29:27.712121 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:29:27.712121 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 16:29:27.712121 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 16:29:27.712121 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 16:29:27.712121 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise error Aug 31 16:29:27.712121 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 31 16:29:27.712121 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:29:27.712121 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 31 16:29:27.712121 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 31 16:29:27.712121 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 31 16:29:27.712121 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 31 16:29:27.714756 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 31 16:29:27.714756 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:29:27.714756 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 31 16:29:27.714756 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 31 16:29:27.714756 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:29:27.714756 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:29:27.714756 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:29:27.714756 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:29:27.714756 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:29:27.714756 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:29:27.714756 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:29:27.714756 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:29:27.714756 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:29:27.714756 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:29:27.714756 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:29:27.714756 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:29:27.714756 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 16:29:27.714756 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 16:29:27.714756 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 16:29:27.714756 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 16:29:27.714756 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 16:29:27.714756 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 16:29:27.714756 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 31 16:29:27.714756 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:29:27.714756 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:29:27.714756 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:29:27.714756 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:29:27.714756 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:29:27.714756 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:29:27.714756 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 16:29:27.714756 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 16:29:27.714756 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 31 16:29:27.714756 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:29:27.735025 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-45c05793-453a-4596-835c-72b1fb85a031 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:29:27.738360 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-45c05793-453a-4596-835c-72b1fb85a031 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.034369 Aug 31 16:29:27.746679 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2970/5955] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:29:27 2022] POST /compute/v2.1/servers => generated 687 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:29:27.863217 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-87ff1778-2c28-4a81-b73b-ee0f56d809cd tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2031315250", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "d0764a92-cb3d-4cac-8811-0a7f7292a98b"}]}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:29:27.869174 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-87ff1778-2c28-4a81-b73b-ee0f56d809cd tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Request method failure captured: Aug 31 16:29:27.869174 n-d-850499-9 devstack@n-api.service[122257]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 31 16:29:27.869174 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:29:27.869174 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:29:27.869174 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:29:27.869174 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 500 Aug 31 16:29:27.869174 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:29:27.869174 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:29:27.869174 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:29:27.869174 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:29:27.869174 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4xKYDUDcmpyfs-1ehFAPOwERZDhSNJNfsi2dWKCjoRiSQU9E3HdgLV7nLsg5peCHPl8sqiBrdEdeTyjFj23OIXibRY1Q95lLqgRbDNVVa7CwUHdujT4nhWGxGMRt-A0tzIZcN3-NDVk9gqTj1j4W86ybU_7BjVduMQAUblMp4H0Th0 Aug 31 16:29:27.869174 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:29:27.869174 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:29:27.869174 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:29:27.869174 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:29:27.869174 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:29:27.869174 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:29:27.869174 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: a527440f8bf6444591088916ad74ef4f Aug 31 16:29:27.869174 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1500883040 Aug 31 16:29:27.869174 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:29:27.869174 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:29:27.869174 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a527440f8bf6444591088916ad74ef4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a527440f8bf6444591088916ad74ef4f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a527440f8bf6444591088916ad74ef4f", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a527440f8bf6444591088916ad74ef4f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:29:27.869174 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1500883040 Aug 31 16:29:27.869174 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: a527440f8bf6444591088916ad74ef4f Aug 31 16:29:27.869174 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1500883040 Aug 31 16:29:27.869174 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ServerMetadataNegativeTestJSON-1500883040-project Aug 31 16:29:27.869174 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:29:27.869174 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:29:27.869174 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: fe872c74e07d42478492b281dc1fbf1a Aug 31 16:29:27.869174 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1500883040-project Aug 31 16:29:27.869174 n-d-850499-9 devstack@n-api.service[122257]: Aug 31 16:29:27.869174 n-d-850499-9 devstack@n-api.service[122257]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2031315250", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "d0764a92-cb3d-4cac-8811-0a7f7292a98b"}]}} Aug 31 16:29:27.869174 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:29:27.869174 n-d-850499-9 devstack@n-api.service[122257]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 31 16:29:27.869174 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-2031315250', 'imageRef': 'b9c36d42-ed46-4bf5-ad18-1df45cbd0413', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'd0764a92-cb3d-4cac-8811-0a7f7292a98b'}]}}} Aug 31 16:29:27.869174 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:29:27.869174 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:29:27.869174 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 16:29:27.869174 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 16:29:27.869174 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 16:29:27.869174 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise error Aug 31 16:29:27.869174 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 31 16:29:27.869174 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:29:27.869174 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 31 16:29:27.869174 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 31 16:29:27.869174 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 31 16:29:27.869174 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 31 16:29:27.872077 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 31 16:29:27.872077 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:29:27.872077 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 31 16:29:27.872077 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 31 16:29:27.872077 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:29:27.872077 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:29:27.872077 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:29:27.872077 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:29:27.872077 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:29:27.872077 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:29:27.872077 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:29:27.872077 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:29:27.872077 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:29:27.872077 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:29:27.872077 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:29:27.872077 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:29:27.872077 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 16:29:27.872077 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 16:29:27.872077 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 16:29:27.872077 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 16:29:27.872077 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 16:29:27.872077 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 16:29:27.872077 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 31 16:29:27.872077 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:29:27.872077 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:29:27.872077 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:29:27.872077 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:29:27.872077 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:29:27.872077 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:29:27.872077 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 16:29:27.872077 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 16:29:27.872077 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 31 16:29:27.872077 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:29:27.882372 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-87ff1778-2c28-4a81-b73b-ee0f56d809cd tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:29:27.883662 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-87ff1778-2c28-4a81-b73b-ee0f56d809cd tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.024722 Aug 31 16:29:27.885211 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2986/5956] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:29:27 2022] POST /compute/v2.1/servers => generated 689 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:29:28.088588 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-19f28b0b-f36b-4251-9f28-805a9ae47918 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1889028374", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "d0764a92-cb3d-4cac-8811-0a7f7292a98b"}]}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:29:28.096899 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-19f28b0b-f36b-4251-9f28-805a9ae47918 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Request method failure captured: Aug 31 16:29:28.096899 n-d-850499-9 devstack@n-api.service[122256]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 31 16:29:28.096899 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:29:28.096899 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:29:28.096899 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:29:28.096899 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 754 Aug 31 16:29:28.096899 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:29:28.096899 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:29:28.096899 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:29:28.096899 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:29:28.096899 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4xKYDUDcmpyfs-1ehFAPOwERZDhSNJNfsi2dWKCjoRiSQU9E3HdgLV7nLsg5peCHPl8sqiBrdEdeTyjFj23OIXibRY1Q95lLqgRbDNVVa7CwUHdujT4nhWGxGMRt-A0tzIZcN3-NDVk9gqTj1j4W86ybU_7BjVduMQAUblMp4H0Th0 Aug 31 16:29:28.096899 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:29:28.096899 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:29:28.096899 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:29:28.096899 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:29:28.096899 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:29:28.096899 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:29:28.096899 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: a527440f8bf6444591088916ad74ef4f Aug 31 16:29:28.096899 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1500883040 Aug 31 16:29:28.096899 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:29:28.096899 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:29:28.096899 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a527440f8bf6444591088916ad74ef4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a527440f8bf6444591088916ad74ef4f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a527440f8bf6444591088916ad74ef4f", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a527440f8bf6444591088916ad74ef4f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:29:28.096899 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1500883040 Aug 31 16:29:28.096899 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: a527440f8bf6444591088916ad74ef4f Aug 31 16:29:28.096899 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1500883040 Aug 31 16:29:28.096899 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ServerMetadataNegativeTestJSON-1500883040-project Aug 31 16:29:28.096899 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:29:28.096899 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:29:28.096899 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: fe872c74e07d42478492b281dc1fbf1a Aug 31 16:29:28.096899 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1500883040-project Aug 31 16:29:28.096899 n-d-850499-9 devstack@n-api.service[122256]: Aug 31 16:29:28.096899 n-d-850499-9 devstack@n-api.service[122256]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1889028374", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "d0764a92-cb3d-4cac-8811-0a7f7292a98b"}]}} Aug 31 16:29:28.096899 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:29:28.096899 n-d-850499-9 devstack@n-api.service[122256]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 31 16:29:28.096899 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1889028374', 'imageRef': 'b9c36d42-ed46-4bf5-ad18-1df45cbd0413', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'd0764a92-cb3d-4cac-8811-0a7f7292a98b'}]}}} Aug 31 16:29:28.096899 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:29:28.096899 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:29:28.096899 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 16:29:28.096899 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 16:29:28.099386 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 16:29:28.099386 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise error Aug 31 16:29:28.099386 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 31 16:29:28.099386 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:29:28.099386 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 31 16:29:28.099386 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 31 16:29:28.099386 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 31 16:29:28.099386 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 31 16:29:28.099386 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 31 16:29:28.099386 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:29:28.099386 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 31 16:29:28.099386 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 31 16:29:28.099386 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:29:28.099386 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:29:28.099386 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:29:28.099386 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:29:28.099386 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:29:28.099386 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:29:28.099386 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:29:28.099386 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:29:28.099386 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:29:28.099386 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:29:28.099386 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:29:28.099386 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:29:28.099386 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 16:29:28.099386 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 16:29:28.099386 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 16:29:28.099386 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 16:29:28.099386 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 16:29:28.099386 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 16:29:28.099386 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 31 16:29:28.099386 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:29:28.099386 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:29:28.099386 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:29:28.099386 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:29:28.099386 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:29:28.099386 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:29:28.099386 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 16:29:28.099386 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 16:29:28.101443 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 31 16:29:28.101443 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:29:28.110852 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-19f28b0b-f36b-4251-9f28-805a9ae47918 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:29:28.112152 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-19f28b0b-f36b-4251-9f28-805a9ae47918 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.030065 Aug 31 16:29:28.113125 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2971/5957] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:29:28 2022] POST /compute/v2.1/servers => generated 1197 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Aug 31 16:29:28.215464 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3d7137ea-e5a2-451e-9e4a-60c05506eca9 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1003663503", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "d0764a92-cb3d-4cac-8811-0a7f7292a98b"}]}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:29:28.230344 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3d7137ea-e5a2-451e-9e4a-60c05506eca9 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Request method failure captured: Aug 31 16:29:28.230344 n-d-850499-9 devstack@n-api.service[122257]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 31 16:29:28.230344 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:29:28.230344 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:29:28.230344 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:29:28.230344 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 1266 Aug 31 16:29:28.230344 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:29:28.230344 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:29:28.230344 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:29:28.230344 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:29:28.230344 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4xKYDUDcmpyfs-1ehFAPOwERZDhSNJNfsi2dWKCjoRiSQU9E3HdgLV7nLsg5peCHPl8sqiBrdEdeTyjFj23OIXibRY1Q95lLqgRbDNVVa7CwUHdujT4nhWGxGMRt-A0tzIZcN3-NDVk9gqTj1j4W86ybU_7BjVduMQAUblMp4H0Th0 Aug 31 16:29:28.230344 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:29:28.230344 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:29:28.230344 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:29:28.230344 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:29:28.230344 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:29:28.230344 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:29:28.230344 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: a527440f8bf6444591088916ad74ef4f Aug 31 16:29:28.230344 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1500883040 Aug 31 16:29:28.230344 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:29:28.230344 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:29:28.230344 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a527440f8bf6444591088916ad74ef4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a527440f8bf6444591088916ad74ef4f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a527440f8bf6444591088916ad74ef4f", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a527440f8bf6444591088916ad74ef4f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:29:28.230344 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1500883040 Aug 31 16:29:28.230344 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: a527440f8bf6444591088916ad74ef4f Aug 31 16:29:28.230344 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1500883040 Aug 31 16:29:28.230344 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ServerMetadataNegativeTestJSON-1500883040-project Aug 31 16:29:28.230344 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:29:28.230344 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:29:28.230344 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: fe872c74e07d42478492b281dc1fbf1a Aug 31 16:29:28.230344 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1500883040-project Aug 31 16:29:28.230344 n-d-850499-9 devstack@n-api.service[122257]: Aug 31 16:29:28.230344 n-d-850499-9 devstack@n-api.service[122257]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1003663503", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "d0764a92-cb3d-4cac-8811-0a7f7292a98b"}]}} Aug 31 16:29:28.230344 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:29:28.232397 n-d-850499-9 devstack@n-api.service[122257]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 31 16:29:28.232397 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1003663503', 'imageRef': 'b9c36d42-ed46-4bf5-ad18-1df45cbd0413', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'd0764a92-cb3d-4cac-8811-0a7f7292a98b'}]}}} Aug 31 16:29:28.232397 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:29:28.232397 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:29:28.232397 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 16:29:28.232397 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 16:29:28.232397 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 16:29:28.232397 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise error Aug 31 16:29:28.232397 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 31 16:29:28.232397 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:29:28.232397 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 31 16:29:28.232397 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 31 16:29:28.232397 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 31 16:29:28.232397 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 31 16:29:28.232397 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 31 16:29:28.232397 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:29:28.232397 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 31 16:29:28.233375 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 31 16:29:28.233375 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:29:28.233375 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:29:28.233375 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:29:28.233375 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:29:28.233375 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:29:28.233375 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:29:28.233375 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:29:28.233375 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:29:28.233375 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:29:28.233375 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:29:28.233375 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:29:28.233375 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:29:28.233375 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 16:29:28.233375 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 16:29:28.233375 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 16:29:28.233375 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 16:29:28.233375 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 16:29:28.233375 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 16:29:28.233375 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 31 16:29:28.233375 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:29:28.233375 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:29:28.233375 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:29:28.233375 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:29:28.233375 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:29:28.233375 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:29:28.233375 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 16:29:28.233375 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 16:29:28.237226 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 31 16:29:28.237226 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:29:28.237226 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3d7137ea-e5a2-451e-9e4a-60c05506eca9 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:29:28.237226 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3d7137ea-e5a2-451e-9e4a-60c05506eca9 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.023041 Aug 31 16:29:28.237226 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2987/5958] 10.222.0.61 () {60 vars in 1148 bytes} [Wed Aug 31 16:29:28 2022] POST /compute/v2.1/servers => generated 2221 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Aug 31 16:29:28.246004 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-df4076af-c834-49c4-809e-4ba74b128fbb tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:28.246520 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-df4076af-c834-49c4-809e-4ba74b128fbb tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] [instance: 487980a4-4caa-45d5-840c-2d233694f4fa] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:28.265241 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-df4076af-c834-49c4-809e-4ba74b128fbb tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] HTTP exception thrown: Instance 487980a4-4caa-45d5-840c-2d233694f4fa could not be found. Aug 31 16:29:28.272270 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-be59ff79-95d6-40ff-b140-4a7056a279d1 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:28.272892 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-be59ff79-95d6-40ff-b140-4a7056a279d1 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: b31fb01b-045f-41f7-bf58-66c1eca839e8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:28.276192 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-df4076af-c834-49c4-809e-4ba74b128fbb tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Request method failure captured: Aug 31 16:29:28.276192 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/487980a4-4caa-45d5-840c-2d233694f4fa/metadata/test2 HTTP/1.1 Aug 31 16:29:28.276192 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:29:28.276192 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:29:28.276192 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:29:28.276192 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:29:28.276192 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:29:28.276192 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:29:28.276192 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:29:28.276192 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:29:28.276192 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4xKYDUDcmpyfs-1ehFAPOwERZDhSNJNfsi2dWKCjoRiSQU9E3HdgLV7nLsg5peCHPl8sqiBrdEdeTyjFj23OIXibRY1Q95lLqgRbDNVVa7CwUHdujT4nhWGxGMRt-A0tzIZcN3-NDVk9gqTj1j4W86ybU_7BjVduMQAUblMp4H0Th0 Aug 31 16:29:28.276192 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:29:28.276192 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:29:28.276192 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:29:28.276192 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:29:28.276192 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:29:28.276192 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:29:28.276192 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: a527440f8bf6444591088916ad74ef4f Aug 31 16:29:28.276192 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1500883040 Aug 31 16:29:28.276192 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:29:28.276192 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:29:28.276192 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a527440f8bf6444591088916ad74ef4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a527440f8bf6444591088916ad74ef4f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a527440f8bf6444591088916ad74ef4f", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a527440f8bf6444591088916ad74ef4f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:29:28.276192 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1500883040 Aug 31 16:29:28.276192 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: a527440f8bf6444591088916ad74ef4f Aug 31 16:29:28.276192 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1500883040 Aug 31 16:29:28.276192 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ServerMetadataNegativeTestJSON-1500883040-project Aug 31 16:29:28.276192 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:29:28.276192 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:29:28.276192 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: fe872c74e07d42478492b281dc1fbf1a Aug 31 16:29:28.276192 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1500883040-project Aug 31 16:29:28.276192 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:29:28.276192 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance 487980a4-4caa-45d5-840c-2d233694f4fa could not be found. Aug 31 16:29:28.276192 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'server_id': '487980a4-4caa-45d5-840c-2d233694f4fa', 'id': 'test2'} Aug 31 16:29:28.276192 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:29:28.276192 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:29:28.276192 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:29:28.276192 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:29:28.276192 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:29:28.276192 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:29:28.276192 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 31 16:29:28.276192 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 31 16:29:28.276192 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 487980a4-4caa-45d5-840c-2d233694f4fa could not be found. Aug 31 16:29:28.276192 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:29:28.276192 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:29:28.276192 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:29:28.276192 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:29:28.276192 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:29:28.276192 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:29:28.276192 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:29:28.276192 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:29:28.276192 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:29:28.276192 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:29:28.276192 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Aug 31 16:29:28.276192 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Aug 31 16:29:28.276192 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:29:28.276192 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:29:28.276192 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 487980a4-4caa-45d5-840c-2d233694f4fa could not be found. Aug 31 16:29:28.276192 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:29:28.276192 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:29:28.276192 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:29:28.276192 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:29:28.276192 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:29:28.276192 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:29:28.282762 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:29:28.282762 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:29:28.282762 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 487980a4-4caa-45d5-840c-2d233694f4fa could not be found. Aug 31 16:29:28.282762 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:29:28.282762 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-df4076af-c834-49c4-809e-4ba74b128fbb tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Returning 404 to user: Instance 487980a4-4caa-45d5-840c-2d233694f4fa could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:29:28.282762 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-df4076af-c834-49c4-809e-4ba74b128fbb tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] 10.222.0.61 "GET /compute/v2.1/servers/487980a4-4caa-45d5-840c-2d233694f4fa/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.035916 Aug 31 16:29:28.283887 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2972/5959] 10.222.0.61 () {58 vars in 1281 bytes} [Wed Aug 31 16:29:28 2022] GET /compute/v2.1/servers/487980a4-4caa-45d5-840c-2d233694f4fa/metadata/test2 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:29:28.285577 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-be59ff79-95d6-40ff-b140-4a7056a279d1 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:28.286148 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-be59ff79-95d6-40ff-b140-4a7056a279d1 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:28.286750 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-be59ff79-95d6-40ff-b140-4a7056a279d1 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:28.287520 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-be59ff79-95d6-40ff-b140-4a7056a279d1 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:28.288010 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-be59ff79-95d6-40ff-b140-4a7056a279d1 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:28.288449 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-be59ff79-95d6-40ff-b140-4a7056a279d1 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:28.297499 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6ae79ea3-8592-4d53-b526-178b8829fd50 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:28.299186 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6ae79ea3-8592-4d53-b526-178b8829fd50 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] [instance: 9f9fa018-34f8-495a-ade8-1ada7ff80130] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:28.309284 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6ae79ea3-8592-4d53-b526-178b8829fd50 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:28.310002 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6ae79ea3-8592-4d53-b526-178b8829fd50 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:28.310747 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6ae79ea3-8592-4d53-b526-178b8829fd50 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:28.311887 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6ae79ea3-8592-4d53-b526-178b8829fd50 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:28.312592 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6ae79ea3-8592-4d53-b526-178b8829fd50 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:28.313418 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6ae79ea3-8592-4d53-b526-178b8829fd50 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:28.380046 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6ae79ea3-8592-4d53-b526-178b8829fd50 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] [instance: 9f9fa018-34f8-495a-ade8-1ada7ff80130] Going to try to terminate instance {{(pid=122256) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:29:28.588375 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6ae79ea3-8592-4d53-b526-178b8829fd50 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] 10.222.0.61 "DELETE /compute/v2.1/servers/9f9fa018-34f8-495a-ade8-1ada7ff80130" status: 204 len: 0 microversion: 2.1 time: 0.299312 Aug 31 16:29:28.591050 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2973/5960] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:29:28 2022] DELETE /compute/v2.1/servers/9f9fa018-34f8-495a-ade8-1ada7ff80130 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 16:29:28.615565 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-42094dcd-d2a6-4cf9-ba35-c03a3c743340 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:28.616489 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-be59ff79-95d6-40ff-b140-4a7056a279d1 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:28.618217 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-42094dcd-d2a6-4cf9-ba35-c03a3c743340 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] [instance: 9f9fa018-34f8-495a-ade8-1ada7ff80130] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:28.625612 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-be59ff79-95d6-40ff-b140-4a7056a279d1 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:28.635233 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42094dcd-d2a6-4cf9-ba35-c03a3c743340 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:28.637224 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42094dcd-d2a6-4cf9-ba35-c03a3c743340 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:28.639090 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42094dcd-d2a6-4cf9-ba35-c03a3c743340 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:28.640156 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42094dcd-d2a6-4cf9-ba35-c03a3c743340 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:28.640773 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42094dcd-d2a6-4cf9-ba35-c03a3c743340 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:28.641339 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42094dcd-d2a6-4cf9-ba35-c03a3c743340 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:28.645647 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-be59ff79-95d6-40ff-b140-4a7056a279d1 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:28.647317 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-be59ff79-95d6-40ff-b140-4a7056a279d1 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8" status: 200 len: 1739 microversion: 2.20 time: 0.379461 Aug 31 16:29:28.650005 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2988/5961] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:29:28 2022] GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8 => generated 1739 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:29:28.949926 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-42094dcd-d2a6-4cf9-ba35-c03a3c743340 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe872c74e07d42478492b281dc1fbf1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a527440f8bf6444591088916ad74ef4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:28.963131 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-42094dcd-d2a6-4cf9-ba35-c03a3c743340 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] 10.222.0.61 "GET /compute/v2.1/servers/9f9fa018-34f8-495a-ade8-1ada7ff80130" status: 200 len: 1525 microversion: 2.1 time: 0.366389 Aug 31 16:29:28.976491 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2974/5962] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:28 2022] GET /compute/v2.1/servers/9f9fa018-34f8-495a-ade8-1ada7ff80130 => generated 1525 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:29:29.676150 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-995797b1-1b56-4c3a-a34d-ab1a635b4088 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:29.678780 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-995797b1-1b56-4c3a-a34d-ab1a635b4088 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: b31fb01b-045f-41f7-bf58-66c1eca839e8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:29.728810 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-995797b1-1b56-4c3a-a34d-ab1a635b4088 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:29.730111 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-995797b1-1b56-4c3a-a34d-ab1a635b4088 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.040s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:29.730584 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-995797b1-1b56-4c3a-a34d-ab1a635b4088 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:29.731361 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-995797b1-1b56-4c3a-a34d-ab1a635b4088 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:29.731864 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-995797b1-1b56-4c3a-a34d-ab1a635b4088 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:29.732306 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-995797b1-1b56-4c3a-a34d-ab1a635b4088 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:29.985750 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e700d963-8c63-457d-a3ec-cb3f2053d1e5 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:29.986391 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e700d963-8c63-457d-a3ec-cb3f2053d1e5 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] [instance: 9f9fa018-34f8-495a-ade8-1ada7ff80130] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:30.002772 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e700d963-8c63-457d-a3ec-cb3f2053d1e5 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:30.003563 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e700d963-8c63-457d-a3ec-cb3f2053d1e5 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:30.003982 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e700d963-8c63-457d-a3ec-cb3f2053d1e5 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:30.008724 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e700d963-8c63-457d-a3ec-cb3f2053d1e5 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:30.009619 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e700d963-8c63-457d-a3ec-cb3f2053d1e5 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:30.010220 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e700d963-8c63-457d-a3ec-cb3f2053d1e5 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:30.186188 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-995797b1-1b56-4c3a-a34d-ab1a635b4088 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:30.201967 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-995797b1-1b56-4c3a-a34d-ab1a635b4088 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:30.204478 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-995797b1-1b56-4c3a-a34d-ab1a635b4088 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:30.205921 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-995797b1-1b56-4c3a-a34d-ab1a635b4088 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8" status: 200 len: 1739 microversion: 2.20 time: 0.535568 Aug 31 16:29:30.206382 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2989/5963] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:29:29 2022] GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8 => generated 1739 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:29:30.421260 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e700d963-8c63-457d-a3ec-cb3f2053d1e5 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe872c74e07d42478492b281dc1fbf1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a527440f8bf6444591088916ad74ef4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:30.456548 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e700d963-8c63-457d-a3ec-cb3f2053d1e5 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] 10.222.0.61 "GET /compute/v2.1/servers/9f9fa018-34f8-495a-ade8-1ada7ff80130" status: 200 len: 1525 microversion: 2.1 time: 0.474912 Aug 31 16:29:30.462550 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2975/5964] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:29 2022] GET /compute/v2.1/servers/9f9fa018-34f8-495a-ade8-1ada7ff80130 => generated 1525 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:29:30.685252 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a988d6ca-0cfa-4031-b695-09e39f3aaf92 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:30.687802 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a988d6ca-0cfa-4031-b695-09e39f3aaf92 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] [instance: fcaf0da3-ec31-4531-b09f-263f7d188b06] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:30.705869 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a988d6ca-0cfa-4031-b695-09e39f3aaf92 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:30.706714 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a988d6ca-0cfa-4031-b695-09e39f3aaf92 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:30.709660 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a988d6ca-0cfa-4031-b695-09e39f3aaf92 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:30.711086 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a988d6ca-0cfa-4031-b695-09e39f3aaf92 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:30.717052 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a988d6ca-0cfa-4031-b695-09e39f3aaf92 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:30.717861 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a988d6ca-0cfa-4031-b695-09e39f3aaf92 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:30.764256 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a988d6ca-0cfa-4031-b695-09e39f3aaf92 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] [instance: fcaf0da3-ec31-4531-b09f-263f7d188b06] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:29:30.916656 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a988d6ca-0cfa-4031-b695-09e39f3aaf92 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] 10.222.0.61 "DELETE /compute/v2.1/servers/fcaf0da3-ec31-4531-b09f-263f7d188b06" status: 204 len: 0 microversion: 2.1 time: 0.235692 Aug 31 16:29:30.917266 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2990/5965] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:29:30 2022] DELETE /compute/v2.1/servers/fcaf0da3-ec31-4531-b09f-263f7d188b06 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:29:30.925515 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-20f049e8-6358-4a33-b24f-34b8618f0d70 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:30.926134 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-20f049e8-6358-4a33-b24f-34b8618f0d70 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] [instance: fcaf0da3-ec31-4531-b09f-263f7d188b06] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:30.937316 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-20f049e8-6358-4a33-b24f-34b8618f0d70 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:30.942844 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-20f049e8-6358-4a33-b24f-34b8618f0d70 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:30.943729 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-20f049e8-6358-4a33-b24f-34b8618f0d70 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:30.944936 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-20f049e8-6358-4a33-b24f-34b8618f0d70 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:30.945648 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-20f049e8-6358-4a33-b24f-34b8618f0d70 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:30.946293 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-20f049e8-6358-4a33-b24f-34b8618f0d70 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:31.232054 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-81b4e39f-593f-42fd-8b61-fad29822dc0f tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:31.233215 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-81b4e39f-593f-42fd-8b61-fad29822dc0f tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: b31fb01b-045f-41f7-bf58-66c1eca839e8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:31.241887 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-81b4e39f-593f-42fd-8b61-fad29822dc0f tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:31.242765 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-81b4e39f-593f-42fd-8b61-fad29822dc0f tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:31.244176 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-81b4e39f-593f-42fd-8b61-fad29822dc0f tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:31.245127 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-81b4e39f-593f-42fd-8b61-fad29822dc0f tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:31.245802 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-81b4e39f-593f-42fd-8b61-fad29822dc0f tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:31.246444 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-81b4e39f-593f-42fd-8b61-fad29822dc0f tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:31.785395 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-20f049e8-6358-4a33-b24f-34b8618f0d70 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc4d613cdc94357b40e83a2b70b0bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb6a0a8643748b9830f2859de6d8b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:31.800592 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-20f049e8-6358-4a33-b24f-34b8618f0d70 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] 10.222.0.61 "GET /compute/v2.1/servers/fcaf0da3-ec31-4531-b09f-263f7d188b06" status: 200 len: 1504 microversion: 2.1 time: 0.878325 Aug 31 16:29:31.807785 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2976/5966] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:30 2022] GET /compute/v2.1/servers/fcaf0da3-ec31-4531-b09f-263f7d188b06 => generated 1504 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:29:31.821352 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8e7f4948-a28b-435d-b67a-fe87365df9c9 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:31.821804 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-81b4e39f-593f-42fd-8b61-fad29822dc0f tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:31.823302 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8e7f4948-a28b-435d-b67a-fe87365df9c9 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] [instance: 9f9fa018-34f8-495a-ade8-1ada7ff80130] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:31.831260 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-81b4e39f-593f-42fd-8b61-fad29822dc0f tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:31.832798 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-81b4e39f-593f-42fd-8b61-fad29822dc0f tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:31.833444 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8e7f4948-a28b-435d-b67a-fe87365df9c9 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:31.834058 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8e7f4948-a28b-435d-b67a-fe87365df9c9 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:31.834800 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8e7f4948-a28b-435d-b67a-fe87365df9c9 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:31.835723 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8e7f4948-a28b-435d-b67a-fe87365df9c9 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:31.836287 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8e7f4948-a28b-435d-b67a-fe87365df9c9 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:31.837135 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8e7f4948-a28b-435d-b67a-fe87365df9c9 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:31.842103 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-81b4e39f-593f-42fd-8b61-fad29822dc0f tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8" status: 200 len: 1721 microversion: 2.20 time: 0.614603 Aug 31 16:29:31.852605 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2991/5967] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:29:31 2022] GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8 => generated 1721 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:29:31.898627 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-9ecb648d-05e8-4dd9-a2a9-1c6108106687 req-31dfa44d-e83f-4195-9f6c-31c43112d68e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f9fa018-34f8-495a-ade8-1ada7ff80130", "name": "network-vif-deleted", "tag": "c9d027ae-ab76-4b2d-be30-ee76a2429adb"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:29:31.923146 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-9ecb648d-05e8-4dd9-a2a9-1c6108106687 req-31dfa44d-e83f-4195-9f6c-31c43112d68e service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:31.923808 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-9ecb648d-05e8-4dd9-a2a9-1c6108106687 req-31dfa44d-e83f-4195-9f6c-31c43112d68e service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:31.924316 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-9ecb648d-05e8-4dd9-a2a9-1c6108106687 req-31dfa44d-e83f-4195-9f6c-31c43112d68e service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:31.944461 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-9ecb648d-05e8-4dd9-a2a9-1c6108106687 req-31dfa44d-e83f-4195-9f6c-31c43112d68e service nova] Creating event network-vif-deleted:c9d027ae-ab76-4b2d-be30-ee76a2429adb for instance 9f9fa018-34f8-495a-ade8-1ada7ff80130 on n-h1-850499-9 Aug 31 16:29:31.950108 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-9ecb648d-05e8-4dd9-a2a9-1c6108106687 req-31dfa44d-e83f-4195-9f6c-31c43112d68e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059155 Aug 31 16:29:31.951135 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2992/5968] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:29:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:29:32.061643 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8e7f4948-a28b-435d-b67a-fe87365df9c9 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe872c74e07d42478492b281dc1fbf1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a527440f8bf6444591088916ad74ef4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:32.075421 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8e7f4948-a28b-435d-b67a-fe87365df9c9 tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] 10.222.0.61 "GET /compute/v2.1/servers/9f9fa018-34f8-495a-ade8-1ada7ff80130" status: 200 len: 1483 microversion: 2.1 time: 0.262876 Aug 31 16:29:32.077115 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2977/5969] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:31 2022] GET /compute/v2.1/servers/9f9fa018-34f8-495a-ade8-1ada7ff80130 => generated 1483 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:29:32.809577 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-45866c9c-3fc4-45a9-8c6d-699ef5ed3db9 req-962f464b-3b37-418a-87c5-338c69240bad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b31fb01b-045f-41f7-bf58-66c1eca839e8", "name": "network-vif-unplugged", "status": "completed", "tag": "fbb954d2-1cb6-4ea2-b226-5a233a891670"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:29:32.831993 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1c520fbc-ec28-4f7b-bd5b-98088eda1af1 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:32.833319 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1c520fbc-ec28-4f7b-bd5b-98088eda1af1 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] [instance: fcaf0da3-ec31-4531-b09f-263f7d188b06] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:32.837200 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-45866c9c-3fc4-45a9-8c6d-699ef5ed3db9 req-962f464b-3b37-418a-87c5-338c69240bad service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:32.841709 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-45866c9c-3fc4-45a9-8c6d-699ef5ed3db9 req-962f464b-3b37-418a-87c5-338c69240bad service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:32.842387 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-45866c9c-3fc4-45a9-8c6d-699ef5ed3db9 req-962f464b-3b37-418a-87c5-338c69240bad service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:32.844316 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=4 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:29:32.850393 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1c520fbc-ec28-4f7b-bd5b-98088eda1af1 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:32.850939 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1c520fbc-ec28-4f7b-bd5b-98088eda1af1 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:32.854842 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1c520fbc-ec28-4f7b-bd5b-98088eda1af1 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:32.856971 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1c520fbc-ec28-4f7b-bd5b-98088eda1af1 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:32.857405 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1c520fbc-ec28-4f7b-bd5b-98088eda1af1 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:32.860958 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1c520fbc-ec28-4f7b-bd5b-98088eda1af1 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:32.874201 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-45866c9c-3fc4-45a9-8c6d-699ef5ed3db9 req-962f464b-3b37-418a-87c5-338c69240bad service nova] Creating event network-vif-unplugged:fbb954d2-1cb6-4ea2-b226-5a233a891670 for instance b31fb01b-045f-41f7-bf58-66c1eca839e8 on n-h1-850499-9 Aug 31 16:29:32.883276 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-45866c9c-3fc4-45a9-8c6d-699ef5ed3db9 req-962f464b-3b37-418a-87c5-338c69240bad service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078608 Aug 31 16:29:32.892671 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2993/5970] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:29:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:29:32.921273 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-513d6547-5139-4bb8-a62e-133fae618ffa tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:32.922310 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-513d6547-5139-4bb8-a62e-133fae618ffa tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: b31fb01b-045f-41f7-bf58-66c1eca839e8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:32.925426 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=4 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:29:32.934124 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-513d6547-5139-4bb8-a62e-133fae618ffa tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:32.934627 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-513d6547-5139-4bb8-a62e-133fae618ffa tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:32.935066 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-513d6547-5139-4bb8-a62e-133fae618ffa tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:32.936913 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-513d6547-5139-4bb8-a62e-133fae618ffa tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:32.937380 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-513d6547-5139-4bb8-a62e-133fae618ffa tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:32.937962 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-513d6547-5139-4bb8-a62e-133fae618ffa tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:33.245372 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1c520fbc-ec28-4f7b-bd5b-98088eda1af1 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc4d613cdc94357b40e83a2b70b0bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb6a0a8643748b9830f2859de6d8b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:33.256933 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1c520fbc-ec28-4f7b-bd5b-98088eda1af1 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] 10.222.0.61 "GET /compute/v2.1/servers/fcaf0da3-ec31-4531-b09f-263f7d188b06" status: 200 len: 1504 microversion: 2.1 time: 0.431614 Aug 31 16:29:33.267180 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2978/5971] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:32 2022] GET /compute/v2.1/servers/fcaf0da3-ec31-4531-b09f-263f7d188b06 => generated 1504 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:29:33.279206 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2e3fc62f-6883-4dbd-b7a8-bf60e8613f3c tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:33.282310 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2e3fc62f-6883-4dbd-b7a8-bf60e8613f3c tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] [instance: 9f9fa018-34f8-495a-ade8-1ada7ff80130] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:33.285343 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-513d6547-5139-4bb8-a62e-133fae618ffa tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:33.290894 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2e3fc62f-6883-4dbd-b7a8-bf60e8613f3c tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:33.291394 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2e3fc62f-6883-4dbd-b7a8-bf60e8613f3c tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:33.292051 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2e3fc62f-6883-4dbd-b7a8-bf60e8613f3c tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:33.292776 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2e3fc62f-6883-4dbd-b7a8-bf60e8613f3c tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:33.293234 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2e3fc62f-6883-4dbd-b7a8-bf60e8613f3c tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:33.293658 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2e3fc62f-6883-4dbd-b7a8-bf60e8613f3c tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:33.297453 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-513d6547-5139-4bb8-a62e-133fae618ffa tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:33.299772 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-513d6547-5139-4bb8-a62e-133fae618ffa tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:33.301332 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-513d6547-5139-4bb8-a62e-133fae618ffa tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8" status: 200 len: 1721 microversion: 2.20 time: 0.407194 Aug 31 16:29:33.302983 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2994/5972] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:29:32 2022] GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8 => generated 1721 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:29:33.337490 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-2e3fc62f-6883-4dbd-b7a8-bf60e8613f3c tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] HTTP exception thrown: Instance 9f9fa018-34f8-495a-ade8-1ada7ff80130 could not be found. Aug 31 16:29:33.340001 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2e3fc62f-6883-4dbd-b7a8-bf60e8613f3c tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Request method failure captured: Aug 31 16:29:33.340001 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/9f9fa018-34f8-495a-ade8-1ada7ff80130 HTTP/1.1 Aug 31 16:29:33.340001 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:29:33.340001 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:29:33.340001 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:29:33.340001 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:29:33.340001 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:29:33.340001 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:29:33.340001 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:29:33.340001 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:29:33.340001 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4xKYDUDcmpyfs-1ehFAPOwERZDhSNJNfsi2dWKCjoRiSQU9E3HdgLV7nLsg5peCHPl8sqiBrdEdeTyjFj23OIXibRY1Q95lLqgRbDNVVa7CwUHdujT4nhWGxGMRt-A0tzIZcN3-NDVk9gqTj1j4W86ybU_7BjVduMQAUblMp4H0Th0 Aug 31 16:29:33.340001 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:29:33.340001 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:29:33.340001 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:29:33.340001 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:29:33.340001 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:29:33.340001 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:29:33.340001 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: a527440f8bf6444591088916ad74ef4f Aug 31 16:29:33.340001 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1500883040 Aug 31 16:29:33.340001 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:29:33.340001 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:29:33.340001 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a527440f8bf6444591088916ad74ef4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a527440f8bf6444591088916ad74ef4f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a527440f8bf6444591088916ad74ef4f", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a527440f8bf6444591088916ad74ef4f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:29:33.340001 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1500883040 Aug 31 16:29:33.340001 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: a527440f8bf6444591088916ad74ef4f Aug 31 16:29:33.340001 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1500883040 Aug 31 16:29:33.340001 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ServerMetadataNegativeTestJSON-1500883040-project Aug 31 16:29:33.340001 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:29:33.340001 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:29:33.340001 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: fe872c74e07d42478492b281dc1fbf1a Aug 31 16:29:33.340001 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1500883040-project Aug 31 16:29:33.340001 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:29:33.340001 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance 9f9fa018-34f8-495a-ade8-1ada7ff80130 could not be found. Aug 31 16:29:33.340001 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '9f9fa018-34f8-495a-ade8-1ada7ff80130'} Aug 31 16:29:33.340001 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:29:33.340001 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:29:33.340001 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:29:33.340001 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:29:33.340001 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:29:33.340001 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:29:33.340001 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:29:33.340001 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:29:33.340001 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:29:33.340001 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:29:33.340001 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f9fa018-34f8-495a-ade8-1ada7ff80130 could not be found. Aug 31 16:29:33.340001 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:29:33.340001 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:29:33.340001 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:29:33.340001 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:29:33.340001 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:29:33.340001 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:29:33.340001 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:29:33.340001 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:29:33.340001 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:29:33.340001 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:29:33.340001 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:29:33.340001 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:29:33.340001 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:29:33.340001 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:29:33.340001 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:29:33.340001 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:29:33.340001 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f9fa018-34f8-495a-ade8-1ada7ff80130 could not be found. Aug 31 16:29:33.340001 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:29:33.340001 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:29:33.343404 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:29:33.343404 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:29:33.343404 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:29:33.343404 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:29:33.343404 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:29:33.343404 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:29:33.343404 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f9fa018-34f8-495a-ade8-1ada7ff80130 could not be found. Aug 31 16:29:33.343404 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:29:33.346713 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2e3fc62f-6883-4dbd-b7a8-bf60e8613f3c tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] Returning 404 to user: Instance 9f9fa018-34f8-495a-ade8-1ada7ff80130 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:29:33.348261 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2e3fc62f-6883-4dbd-b7a8-bf60e8613f3c tempest-ServerMetadataNegativeTestJSON-1500883040 tempest-ServerMetadataNegativeTestJSON-1500883040-project] 10.222.0.61 "GET /compute/v2.1/servers/9f9fa018-34f8-495a-ade8-1ada7ff80130" status: 404 len: 111 microversion: 2.1 time: 0.079698 Aug 31 16:29:33.349093 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2979/5973] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:33 2022] GET /compute/v2.1/servers/9f9fa018-34f8-495a-ade8-1ada7ff80130 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:29:34.281643 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-fa09a555-0498-4c21-9c76-e1cf00c95b60 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:34.288719 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-fa09a555-0498-4c21-9c76-e1cf00c95b60 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] [instance: fcaf0da3-ec31-4531-b09f-263f7d188b06] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:34.310873 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fa09a555-0498-4c21-9c76-e1cf00c95b60 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:34.311788 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fa09a555-0498-4c21-9c76-e1cf00c95b60 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:34.312515 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fa09a555-0498-4c21-9c76-e1cf00c95b60 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:34.314103 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fa09a555-0498-4c21-9c76-e1cf00c95b60 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:34.314721 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fa09a555-0498-4c21-9c76-e1cf00c95b60 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:34.315567 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fa09a555-0498-4c21-9c76-e1cf00c95b60 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:34.340629 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0df25c42-8efb-4848-b485-9bf261db087b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:34.341277 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0df25c42-8efb-4848-b485-9bf261db087b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: b31fb01b-045f-41f7-bf58-66c1eca839e8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:34.366939 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0df25c42-8efb-4848-b485-9bf261db087b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:34.367435 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0df25c42-8efb-4848-b485-9bf261db087b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:34.367967 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0df25c42-8efb-4848-b485-9bf261db087b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:34.368631 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0df25c42-8efb-4848-b485-9bf261db087b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:34.369339 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0df25c42-8efb-4848-b485-9bf261db087b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:34.369707 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0df25c42-8efb-4848-b485-9bf261db087b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:35.372399 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-0df25c42-8efb-4848-b485-9bf261db087b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:35.411457 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-fa09a555-0498-4c21-9c76-e1cf00c95b60 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc4d613cdc94357b40e83a2b70b0bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb6a0a8643748b9830f2859de6d8b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:35.419655 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-0df25c42-8efb-4848-b485-9bf261db087b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:35.421119 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-0df25c42-8efb-4848-b485-9bf261db087b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:35.422306 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0df25c42-8efb-4848-b485-9bf261db087b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8" status: 200 len: 1724 microversion: 2.20 time: 1.093296 Aug 31 16:29:35.423434 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-fa09a555-0498-4c21-9c76-e1cf00c95b60 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] 10.222.0.61 "GET /compute/v2.1/servers/fcaf0da3-ec31-4531-b09f-263f7d188b06" status: 200 len: 1504 microversion: 2.1 time: 1.147974 Aug 31 16:29:35.432196 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2995/5974] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:34 2022] GET /compute/v2.1/servers/fcaf0da3-ec31-4531-b09f-263f7d188b06 => generated 1504 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:29:35.456124 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2980/5975] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:29:34 2022] GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8 => generated 1724 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:29:35.456751 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-fb1dd430-4335-426c-bf0f-a29f91db2674 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b100b016-656f-4e37-a226-06f7b63d6eda"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:29:35.463136 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-fb1dd430-4335-426c-bf0f-a29f91db2674 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: b31fb01b-045f-41f7-bf58-66c1eca839e8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:35.479841 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fb1dd430-4335-426c-bf0f-a29f91db2674 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:35.482098 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fb1dd430-4335-426c-bf0f-a29f91db2674 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:35.485451 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fb1dd430-4335-426c-bf0f-a29f91db2674 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:35.487337 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fb1dd430-4335-426c-bf0f-a29f91db2674 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:35.491619 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fb1dd430-4335-426c-bf0f-a29f91db2674 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:35.492541 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fb1dd430-4335-426c-bf0f-a29f91db2674 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:36.068914 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-3b566d1c-f8ee-488d-867d-62078c92d460 req-61743f1c-b190-4736-8d2d-c56d3557a189 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcaf0da3-ec31-4531-b09f-263f7d188b06", "name": "network-vif-deleted", "tag": "cdcabff2-27a7-4cca-8476-bbcabbe12df7"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:29:36.115760 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-3b566d1c-f8ee-488d-867d-62078c92d460 req-61743f1c-b190-4736-8d2d-c56d3557a189 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:36.119288 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-3b566d1c-f8ee-488d-867d-62078c92d460 req-61743f1c-b190-4736-8d2d-c56d3557a189 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:36.123574 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-3b566d1c-f8ee-488d-867d-62078c92d460 req-61743f1c-b190-4736-8d2d-c56d3557a189 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:36.167651 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-fb1dd430-4335-426c-bf0f-a29f91db2674 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "POST /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.721149 Aug 31 16:29:36.168655 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2996/5976] 10.222.0.61 () {62 vars in 1364 bytes} [Wed Aug 31 16:29:35 2022] POST /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8/os-volume_attachments => generated 188 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 16:29:36.190200 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-3b566d1c-f8ee-488d-867d-62078c92d460 req-61743f1c-b190-4736-8d2d-c56d3557a189 service nova] Creating event network-vif-deleted:cdcabff2-27a7-4cca-8476-bbcabbe12df7 for instance fcaf0da3-ec31-4531-b09f-263f7d188b06 on n-h2-850499-9 Aug 31 16:29:36.220311 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-3b566d1c-f8ee-488d-867d-62078c92d460 req-61743f1c-b190-4736-8d2d-c56d3557a189 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153511 Aug 31 16:29:36.222893 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2981/5977] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:29:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:29:36.453057 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1af6bc9a-1128-4cc5-a237-1058cef2ef65 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:36.454018 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6e856f52-ffc1-4c2a-b505-b4ef337f1cce tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:36.458129 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6e856f52-ffc1-4c2a-b505-b4ef337f1cce tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: b31fb01b-045f-41f7-bf58-66c1eca839e8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:36.458904 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1af6bc9a-1128-4cc5-a237-1058cef2ef65 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] [instance: fcaf0da3-ec31-4531-b09f-263f7d188b06] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:36.491301 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1af6bc9a-1128-4cc5-a237-1058cef2ef65 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:36.495399 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6e856f52-ffc1-4c2a-b505-b4ef337f1cce tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:36.495941 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6e856f52-ffc1-4c2a-b505-b4ef337f1cce tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:36.497324 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6e856f52-ffc1-4c2a-b505-b4ef337f1cce tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:36.502956 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1af6bc9a-1128-4cc5-a237-1058cef2ef65 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:36.503478 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1af6bc9a-1128-4cc5-a237-1058cef2ef65 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:36.504275 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1af6bc9a-1128-4cc5-a237-1058cef2ef65 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:36.513167 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1af6bc9a-1128-4cc5-a237-1058cef2ef65 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:36.516007 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6e856f52-ffc1-4c2a-b505-b4ef337f1cce tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:36.517267 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1af6bc9a-1128-4cc5-a237-1058cef2ef65 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:36.521392 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6e856f52-ffc1-4c2a-b505-b4ef337f1cce tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:36.521887 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6e856f52-ffc1-4c2a-b505-b4ef337f1cce tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:36.719146 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1af6bc9a-1128-4cc5-a237-1058cef2ef65 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:36.719785 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1af6bc9a-1128-4cc5-a237-1058cef2ef65 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:36.727492 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1af6bc9a-1128-4cc5-a237-1058cef2ef65 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:36.728135 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-1af6bc9a-1128-4cc5-a237-1058cef2ef65 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lazy-loading 'fault' on Instance uuid fcaf0da3-ec31-4531-b09f-263f7d188b06 {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:29:36.870640 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1af6bc9a-1128-4cc5-a237-1058cef2ef65 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc4d613cdc94357b40e83a2b70b0bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb6a0a8643748b9830f2859de6d8b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:36.892664 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1af6bc9a-1128-4cc5-a237-1058cef2ef65 tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] 10.222.0.61 "GET /compute/v2.1/servers/fcaf0da3-ec31-4531-b09f-263f7d188b06" status: 200 len: 1303 microversion: 2.1 time: 0.449359 Aug 31 16:29:36.896458 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2982/5978] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:36 2022] GET /compute/v2.1/servers/fcaf0da3-ec31-4531-b09f-263f7d188b06 => generated 1303 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:29:37.275471 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6e856f52-ffc1-4c2a-b505-b4ef337f1cce tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "DELETE /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8/os-volume_attachments/b100b016-656f-4e37-a226-06f7b63d6eda" status: 202 len: 0 microversion: 2.20 time: 0.835552 Aug 31 16:29:37.276666 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2997/5979] 10.222.0.61 () {60 vars in 1457 bytes} [Wed Aug 31 16:29:36 2022] DELETE /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8/os-volume_attachments/b100b016-656f-4e37-a226-06f7b63d6eda => generated 0 bytes in 837 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:29:37.495674 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5202fff1-a3df-485c-9db8-64a4f0663a80 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:29:37.497096 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5202fff1-a3df-485c-9db8-64a4f0663a80 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: b31fb01b-045f-41f7-bf58-66c1eca839e8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:37.532046 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5202fff1-a3df-485c-9db8-64a4f0663a80 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:37.534955 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5202fff1-a3df-485c-9db8-64a4f0663a80 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:37.541111 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5202fff1-a3df-485c-9db8-64a4f0663a80 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:37.542418 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5202fff1-a3df-485c-9db8-64a4f0663a80 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:37.544119 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5202fff1-a3df-485c-9db8-64a4f0663a80 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:37.547267 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5202fff1-a3df-485c-9db8-64a4f0663a80 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:37.679859 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5202fff1-a3df-485c-9db8-64a4f0663a80 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: b31fb01b-045f-41f7-bf58-66c1eca839e8] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122256) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 31 16:29:37.923666 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6ea1c024-d39d-4798-9612-6fb5bd2ca94e tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:37.925465 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6ea1c024-d39d-4798-9612-6fb5bd2ca94e tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] [instance: fcaf0da3-ec31-4531-b09f-263f7d188b06] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:37.953402 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6ea1c024-d39d-4798-9612-6fb5bd2ca94e tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:37.956933 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6ea1c024-d39d-4798-9612-6fb5bd2ca94e tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:37.959396 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6ea1c024-d39d-4798-9612-6fb5bd2ca94e tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:37.960410 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6ea1c024-d39d-4798-9612-6fb5bd2ca94e tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:37.967424 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6ea1c024-d39d-4798-9612-6fb5bd2ca94e tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:37.968235 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6ea1c024-d39d-4798-9612-6fb5bd2ca94e tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:37.974175 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5202fff1-a3df-485c-9db8-64a4f0663a80 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "POST /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8/action" status: 202 len: 0 microversion: 2.20 time: 0.490289 Aug 31 16:29:38.001284 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2983/5980] 10.222.0.61 () {62 vars in 1319 bytes} [Wed Aug 31 16:29:37 2022] POST /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8/action => generated 0 bytes in 518 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:29:38.039257 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-321eca22-d463-4f47-b1ea-677a56af9b92 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:38.040777 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-321eca22-d463-4f47-b1ea-677a56af9b92 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: b31fb01b-045f-41f7-bf58-66c1eca839e8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:38.070487 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-321eca22-d463-4f47-b1ea-677a56af9b92 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:38.071459 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-321eca22-d463-4f47-b1ea-677a56af9b92 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:38.072337 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-321eca22-d463-4f47-b1ea-677a56af9b92 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:38.073886 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-321eca22-d463-4f47-b1ea-677a56af9b92 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:38.075161 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-321eca22-d463-4f47-b1ea-677a56af9b92 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:38.076647 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-321eca22-d463-4f47-b1ea-677a56af9b92 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:38.077332 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=9,nova_cell1:INSERT=6 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:29:38.183669 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6ea1c024-d39d-4798-9612-6fb5bd2ca94e tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:38.195869 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6ea1c024-d39d-4798-9612-6fb5bd2ca94e tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:38.200180 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6ea1c024-d39d-4798-9612-6fb5bd2ca94e tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:38.202613 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-6ea1c024-d39d-4798-9612-6fb5bd2ca94e tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lazy-loading 'fault' on Instance uuid fcaf0da3-ec31-4531-b09f-263f7d188b06 {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:29:38.430450 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-6ea1c024-d39d-4798-9612-6fb5bd2ca94e tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc4d613cdc94357b40e83a2b70b0bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb6a0a8643748b9830f2859de6d8b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:38.446231 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6ea1c024-d39d-4798-9612-6fb5bd2ca94e tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] 10.222.0.61 "GET /compute/v2.1/servers/fcaf0da3-ec31-4531-b09f-263f7d188b06" status: 200 len: 1303 microversion: 2.1 time: 0.523924 Aug 31 16:29:38.451100 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2998/5981] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:37 2022] GET /compute/v2.1/servers/fcaf0da3-ec31-4531-b09f-263f7d188b06 => generated 1303 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:29:38.779374 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-321eca22-d463-4f47-b1ea-677a56af9b92 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:38.800350 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-321eca22-d463-4f47-b1ea-677a56af9b92 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:38.802866 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-321eca22-d463-4f47-b1ea-677a56af9b92 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:38.807120 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-321eca22-d463-4f47-b1ea-677a56af9b92 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8" status: 200 len: 1672 microversion: 2.20 time: 0.804041 Aug 31 16:29:38.810305 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2984/5982] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:29:38 2022] GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8 => generated 1672 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:29:39.476770 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-081e96f3-ab4e-496a-abae-6d899d96555e tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:39.478390 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-081e96f3-ab4e-496a-abae-6d899d96555e tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] [instance: fcaf0da3-ec31-4531-b09f-263f7d188b06] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:39.503132 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-081e96f3-ab4e-496a-abae-6d899d96555e tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:39.508152 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-081e96f3-ab4e-496a-abae-6d899d96555e tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:39.508989 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-081e96f3-ab4e-496a-abae-6d899d96555e tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:39.511871 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-081e96f3-ab4e-496a-abae-6d899d96555e tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:39.514780 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-081e96f3-ab4e-496a-abae-6d899d96555e tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:39.515534 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-081e96f3-ab4e-496a-abae-6d899d96555e tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:39.565946 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-081e96f3-ab4e-496a-abae-6d899d96555e tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] HTTP exception thrown: Instance fcaf0da3-ec31-4531-b09f-263f7d188b06 could not be found. Aug 31 16:29:39.570957 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-081e96f3-ab4e-496a-abae-6d899d96555e tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Request method failure captured: Aug 31 16:29:39.570957 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/fcaf0da3-ec31-4531-b09f-263f7d188b06 HTTP/1.1 Aug 31 16:29:39.570957 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:29:39.570957 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:29:39.570957 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:29:39.570957 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:29:39.570957 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:29:39.570957 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:29:39.570957 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:29:39.570957 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:29:39.570957 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4wZLJ-DyFFGTHhgEKYLgfSs43zINeu_DNrapeY_k4BXs_rMbN_npwRwn50YfhzsB7Nu0_zL8qi15nhy_YuN7XcI0kPEjhKzckx-kIsgXABQy4PworPczIpdytjMQxVb_QjBwjLANsOmZ8RjvQeitOr6VT_ZmCEOY2b4htlm14k90sI Aug 31 16:29:39.570957 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:29:39.570957 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:29:39.570957 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:29:39.570957 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:29:39.570957 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:29:39.570957 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:29:39.570957 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 7bb6a0a8643748b9830f2859de6d8b5e Aug 31 16:29:39.570957 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-VolumesActionsTest-319567770 Aug 31 16:29:39.570957 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:29:39.570957 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:29:39.570957 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7bb6a0a8643748b9830f2859de6d8b5e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7bb6a0a8643748b9830f2859de6d8b5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7bb6a0a8643748b9830f2859de6d8b5e", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7bb6a0a8643748b9830f2859de6d8b5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:29:39.570957 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-VolumesActionsTest-319567770 Aug 31 16:29:39.570957 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 7bb6a0a8643748b9830f2859de6d8b5e Aug 31 16:29:39.570957 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-VolumesActionsTest-319567770 Aug 31 16:29:39.570957 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-VolumesActionsTest-319567770-project Aug 31 16:29:39.570957 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:29:39.570957 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:29:39.570957 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 7cc4d613cdc94357b40e83a2b70b0bf7 Aug 31 16:29:39.570957 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-VolumesActionsTest-319567770-project Aug 31 16:29:39.570957 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:29:39.570957 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance fcaf0da3-ec31-4531-b09f-263f7d188b06 could not be found. Aug 31 16:29:39.570957 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': 'fcaf0da3-ec31-4531-b09f-263f7d188b06'} Aug 31 16:29:39.570957 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:29:39.570957 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:29:39.570957 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:29:39.570957 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:29:39.570957 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:29:39.570957 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:29:39.570957 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:29:39.570957 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:29:39.570957 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:29:39.570957 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:29:39.570957 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcaf0da3-ec31-4531-b09f-263f7d188b06 could not be found. Aug 31 16:29:39.570957 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:29:39.570957 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:29:39.570957 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:29:39.570957 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:29:39.570957 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:29:39.570957 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:29:39.570957 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:29:39.570957 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:29:39.570957 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:29:39.570957 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:29:39.570957 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:29:39.570957 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:29:39.570957 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:29:39.570957 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:29:39.570957 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:29:39.570957 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:29:39.570957 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcaf0da3-ec31-4531-b09f-263f7d188b06 could not be found. Aug 31 16:29:39.570957 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:29:39.570957 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:29:39.570957 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:29:39.575456 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:29:39.575456 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:29:39.575456 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:29:39.575456 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:29:39.575456 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:29:39.575456 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcaf0da3-ec31-4531-b09f-263f7d188b06 could not be found. Aug 31 16:29:39.575456 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:29:39.577141 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-081e96f3-ab4e-496a-abae-6d899d96555e tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] Returning 404 to user: Instance fcaf0da3-ec31-4531-b09f-263f7d188b06 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:29:39.578797 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-081e96f3-ab4e-496a-abae-6d899d96555e tempest-VolumesActionsTest-319567770 tempest-VolumesActionsTest-319567770-project] 10.222.0.61 "GET /compute/v2.1/servers/fcaf0da3-ec31-4531-b09f-263f7d188b06" status: 404 len: 111 microversion: 2.1 time: 0.108559 Aug 31 16:29:39.586713 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 2999/5983] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:39 2022] GET /compute/v2.1/servers/fcaf0da3-ec31-4531-b09f-263f7d188b06 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:29:39.834252 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9f59c7ab-bc78-479a-9a46-49ab93132199 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:39.835478 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9f59c7ab-bc78-479a-9a46-49ab93132199 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: b31fb01b-045f-41f7-bf58-66c1eca839e8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:39.854316 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9f59c7ab-bc78-479a-9a46-49ab93132199 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:39.855542 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9f59c7ab-bc78-479a-9a46-49ab93132199 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:39.857099 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9f59c7ab-bc78-479a-9a46-49ab93132199 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:39.858527 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9f59c7ab-bc78-479a-9a46-49ab93132199 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:39.859168 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9f59c7ab-bc78-479a-9a46-49ab93132199 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:39.859819 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9f59c7ab-bc78-479a-9a46-49ab93132199 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:39.867890 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-01d55a2f-6fa2-4dc9-8e16-c1e9c20149ad tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9e79ff2e-8182-40eb-b40e-f58e719e422d"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:29:39.871324 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-01d55a2f-6fa2-4dc9-8e16-c1e9c20149ad tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 3c9c0c43-4e1a-4290-bbf1-60e26aba66ce] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:39.883053 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:29:39.892019 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-01d55a2f-6fa2-4dc9-8e16-c1e9c20149ad tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:39.892538 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-01d55a2f-6fa2-4dc9-8e16-c1e9c20149ad tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:39.892991 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-01d55a2f-6fa2-4dc9-8e16-c1e9c20149ad tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:39.893721 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-01d55a2f-6fa2-4dc9-8e16-c1e9c20149ad tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:39.894192 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-01d55a2f-6fa2-4dc9-8e16-c1e9c20149ad tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:39.894638 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-01d55a2f-6fa2-4dc9-8e16-c1e9c20149ad tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:40.180851 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-01d55a2f-6fa2-4dc9-8e16-c1e9c20149ad tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] HTTP exception thrown: Invalid volume: volume 9e79ff2e-8182-40eb-b40e-f58e719e422d is already attached to instances: 3c9c0c43-4e1a-4290-bbf1-60e26aba66ce Aug 31 16:29:40.184272 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-01d55a2f-6fa2-4dc9-8e16-c1e9c20149ad tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Request method failure captured: Aug 31 16:29:40.184272 n-d-850499-9 devstack@n-api.service[122257]: request: POST /compute/v2.1/servers/3c9c0c43-4e1a-4290-bbf1-60e26aba66ce/os-volume_attachments HTTP/1.1 Aug 31 16:29:40.184272 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:29:40.184272 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:29:40.184272 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:29:40.184272 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 74 Aug 31 16:29:40.184272 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:29:40.184272 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:29:40.184272 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:29:40.184272 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:29:40.184272 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4rNdtL8Hp93envnJYgxrkKzEuKKLro2yD65tuaCjxV170sTEb0vV7K7CSwqb17J41LEaCf2veX7M0gQMtVuIZTkoy1EqZ7hcQ7-sxxS5qnxJzqp8zg_d5_eF53mYW1SiUWmb2sxTco76Ig5gniRxyga2-esulxOQeqjncU6078g4lk Aug 31 16:29:40.184272 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:29:40.184272 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:29:40.184272 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:29:40.184272 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:29:40.184272 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:29:40.184272 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:29:40.184272 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 79d9ba3589a24faaac930a35742ce834 Aug 31 16:29:40.184272 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-AttachVolumeNegativeTest-1703723156 Aug 31 16:29:40.184272 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:29:40.184272 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:29:40.184272 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/79d9ba3589a24faaac930a35742ce834"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/79d9ba3589a24faaac930a35742ce834"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_79d9ba3589a24faaac930a35742ce834", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/79d9ba3589a24faaac930a35742ce834"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:29:40.184272 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-AttachVolumeNegativeTest-1703723156 Aug 31 16:29:40.184272 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 79d9ba3589a24faaac930a35742ce834 Aug 31 16:29:40.184272 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1703723156 Aug 31 16:29:40.184272 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-AttachVolumeNegativeTest-1703723156-project Aug 31 16:29:40.184272 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:29:40.184272 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:29:40.184272 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 133363b2b12d4730994557ee24f08879 Aug 31 16:29:40.184272 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-AttachVolumeNegativeTest-1703723156-project Aug 31 16:29:40.184272 n-d-850499-9 devstack@n-api.service[122257]: Aug 31 16:29:40.184272 n-d-850499-9 devstack@n-api.service[122257]: {"volumeAttachment": {"volumeId": "9e79ff2e-8182-40eb-b40e-f58e719e422d"}} Aug 31 16:29:40.184272 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:29:40.184272 n-d-850499-9 devstack@n-api.service[122257]: exception: Invalid volume: volume 9e79ff2e-8182-40eb-b40e-f58e719e422d is already attached to instances: 3c9c0c43-4e1a-4290-bbf1-60e26aba66ce Aug 31 16:29:40.184272 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'server_id': '3c9c0c43-4e1a-4290-bbf1-60e26aba66ce', 'body': {'volumeAttachment': {'volumeId': '9e79ff2e-8182-40eb-b40e-f58e719e422d'}}} Aug 31 16:29:40.184272 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:29:40.184272 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:29:40.184272 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 31 16:29:40.184272 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 31 16:29:40.184272 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 16:29:40.184272 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 16:29:40.184272 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 31 16:29:40.184272 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 31 16:29:40.184272 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 31 16:29:40.184272 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 31 16:29:40.184272 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 31 16:29:40.184272 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 31 16:29:40.184272 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 9e79ff2e-8182-40eb-b40e-f58e719e422d is already attached to instances: 3c9c0c43-4e1a-4290-bbf1-60e26aba66ce Aug 31 16:29:40.184272 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:29:40.184272 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:29:40.184272 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:29:40.184272 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:29:40.184272 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:29:40.184272 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:29:40.184272 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:29:40.184272 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:29:40.184272 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:29:40.184272 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:29:40.184272 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:29:40.184272 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:29:40.184272 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:29:40.184272 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:29:40.190983 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:29:40.190983 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:29:40.190983 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 31 16:29:40.190983 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 31 16:29:40.190983 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 9e79ff2e-8182-40eb-b40e-f58e719e422d is already attached to instances: 3c9c0c43-4e1a-4290-bbf1-60e26aba66ce Aug 31 16:29:40.190983 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:29:40.190983 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:29:40.190983 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:29:40.190983 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:29:40.190983 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:29:40.190983 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:29:40.190983 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:29:40.190983 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:29:40.190983 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 9e79ff2e-8182-40eb-b40e-f58e719e422d is already attached to instances: 3c9c0c43-4e1a-4290-bbf1-60e26aba66ce Aug 31 16:29:40.190983 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:29:40.190983 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-01d55a2f-6fa2-4dc9-8e16-c1e9c20149ad tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Returning 400 to user: Invalid volume: volume 9e79ff2e-8182-40eb-b40e-f58e719e422d is already attached to instances: 3c9c0c43-4e1a-4290-bbf1-60e26aba66ce {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:29:40.201619 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-01d55a2f-6fa2-4dc9-8e16-c1e9c20149ad tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "POST /compute/v2.1/servers/3c9c0c43-4e1a-4290-bbf1-60e26aba66ce/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.327067 Aug 31 16:29:40.204485 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3000/5984] 10.222.0.61 () {60 vars in 1323 bytes} [Wed Aug 31 16:29:39 2022] POST /compute/v2.1/servers/3c9c0c43-4e1a-4290-bbf1-60e26aba66ce/os-volume_attachments => generated 174 bytes in 342 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 31 16:29:40.428292 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9f38ee16-7c6d-4426-84d3-49dbd834e849 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:40.429230 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9f38ee16-7c6d-4426-84d3-49dbd834e849 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 3c9c0c43-4e1a-4290-bbf1-60e26aba66ce] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:40.438244 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9f38ee16-7c6d-4426-84d3-49dbd834e849 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:40.439092 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9f38ee16-7c6d-4426-84d3-49dbd834e849 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:40.439784 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9f38ee16-7c6d-4426-84d3-49dbd834e849 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:40.440792 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9f38ee16-7c6d-4426-84d3-49dbd834e849 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:40.441465 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9f38ee16-7c6d-4426-84d3-49dbd834e849 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:40.442398 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9f38ee16-7c6d-4426-84d3-49dbd834e849 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:40.739657 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-9f38ee16-7c6d-4426-84d3-49dbd834e849 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lazy-loading 'services' on Instance uuid 3c9c0c43-4e1a-4290-bbf1-60e26aba66ce {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:29:40.897435 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-9f59c7ab-bc78-479a-9a46-49ab93132199 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:40.936146 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-9f59c7ab-bc78-479a-9a46-49ab93132199 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:40.944911 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-9f59c7ab-bc78-479a-9a46-49ab93132199 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:40.969230 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9f59c7ab-bc78-479a-9a46-49ab93132199 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8" status: 200 len: 1672 microversion: 2.20 time: 1.132714 Aug 31 16:29:40.969908 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2985/5985] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:29:39 2022] GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8 => generated 1672 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:29:40.993527 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9f38ee16-7c6d-4426-84d3-49dbd834e849 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "DELETE /compute/v2.1/servers/3c9c0c43-4e1a-4290-bbf1-60e26aba66ce/os-volume_attachments/9e79ff2e-8182-40eb-b40e-f58e719e422d" status: 202 len: 0 microversion: 2.1 time: 0.566564 Aug 31 16:29:40.996861 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3001/5986] 10.222.0.61 () {58 vars in 1416 bytes} [Wed Aug 31 16:29:40 2022] DELETE /compute/v2.1/servers/3c9c0c43-4e1a-4290-bbf1-60e26aba66ce/os-volume_attachments/9e79ff2e-8182-40eb-b40e-f58e719e422d => generated 0 bytes in 575 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:29:41.005950 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6f68fc7d-9b07-4d5d-81e4-24a288818d51 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:41.017348 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6f68fc7d-9b07-4d5d-81e4-24a288818d51 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 3c9c0c43-4e1a-4290-bbf1-60e26aba66ce] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:41.046395 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6f68fc7d-9b07-4d5d-81e4-24a288818d51 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:41.048412 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6f68fc7d-9b07-4d5d-81e4-24a288818d51 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:41.049118 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6f68fc7d-9b07-4d5d-81e4-24a288818d51 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:41.050005 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6f68fc7d-9b07-4d5d-81e4-24a288818d51 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:41.050548 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6f68fc7d-9b07-4d5d-81e4-24a288818d51 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:41.051002 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6f68fc7d-9b07-4d5d-81e4-24a288818d51 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:41.131397 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6f68fc7d-9b07-4d5d-81e4-24a288818d51 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/3c9c0c43-4e1a-4290-bbf1-60e26aba66ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.129692 Aug 31 16:29:41.137474 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2986/5987] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 16:29:41 2022] GET /compute/v2.1/servers/3c9c0c43-4e1a-4290-bbf1-60e26aba66ce/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:29:41.998695 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-eb12a786-6cb6-455d-a803-0384c8630a02 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:42.000510 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-eb12a786-6cb6-455d-a803-0384c8630a02 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: b31fb01b-045f-41f7-bf58-66c1eca839e8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:42.032664 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eb12a786-6cb6-455d-a803-0384c8630a02 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:42.033594 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eb12a786-6cb6-455d-a803-0384c8630a02 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:42.034262 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eb12a786-6cb6-455d-a803-0384c8630a02 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:42.036359 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eb12a786-6cb6-455d-a803-0384c8630a02 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:42.037898 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eb12a786-6cb6-455d-a803-0384c8630a02 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:42.046443 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eb12a786-6cb6-455d-a803-0384c8630a02 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:42.155726 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b7a135d6-2c3d-4813-a6eb-82d37fdd079a tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:42.160712 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b7a135d6-2c3d-4813-a6eb-82d37fdd079a tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 3c9c0c43-4e1a-4290-bbf1-60e26aba66ce] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:42.185940 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b7a135d6-2c3d-4813-a6eb-82d37fdd079a tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:42.188373 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b7a135d6-2c3d-4813-a6eb-82d37fdd079a tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:42.189386 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b7a135d6-2c3d-4813-a6eb-82d37fdd079a tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:42.191418 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b7a135d6-2c3d-4813-a6eb-82d37fdd079a tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:42.193019 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b7a135d6-2c3d-4813-a6eb-82d37fdd079a tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:42.194066 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b7a135d6-2c3d-4813-a6eb-82d37fdd079a tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:42.259144 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b7a135d6-2c3d-4813-a6eb-82d37fdd079a tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/3c9c0c43-4e1a-4290-bbf1-60e26aba66ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107615 Aug 31 16:29:42.264872 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2987/5988] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 16:29:42 2022] GET /compute/v2.1/servers/3c9c0c43-4e1a-4290-bbf1-60e26aba66ce/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:29:43.278423 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-be00dc41-9126-4445-98b4-1beac5a8d35b tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:43.281244 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-be00dc41-9126-4445-98b4-1beac5a8d35b tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 3c9c0c43-4e1a-4290-bbf1-60e26aba66ce] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:43.311362 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-be00dc41-9126-4445-98b4-1beac5a8d35b tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:43.315772 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-be00dc41-9126-4445-98b4-1beac5a8d35b tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:43.318032 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-be00dc41-9126-4445-98b4-1beac5a8d35b tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:43.319307 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-be00dc41-9126-4445-98b4-1beac5a8d35b tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:43.320072 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-be00dc41-9126-4445-98b4-1beac5a8d35b tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:43.322124 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-be00dc41-9126-4445-98b4-1beac5a8d35b tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:43.443535 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-be00dc41-9126-4445-98b4-1beac5a8d35b tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/3c9c0c43-4e1a-4290-bbf1-60e26aba66ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.169391 Aug 31 16:29:43.448321 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2988/5989] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 16:29:43 2022] GET /compute/v2.1/servers/3c9c0c43-4e1a-4290-bbf1-60e26aba66ce/os-volume_attachments => generated 197 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:29:43.589432 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-eb12a786-6cb6-455d-a803-0384c8630a02 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:43.656134 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-eb12a786-6cb6-455d-a803-0384c8630a02 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:43.672429 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-eb12a786-6cb6-455d-a803-0384c8630a02 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:43.683455 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-eb12a786-6cb6-455d-a803-0384c8630a02 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8" status: 200 len: 1730 microversion: 2.20 time: 1.691720 Aug 31 16:29:43.692826 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3002/5990] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:29:41 2022] GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8 => generated 1730 bytes in 1702 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:29:44.461602 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9e5bc43f-0348-44a9-9669-ae52dbd09386 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:44.466986 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9e5bc43f-0348-44a9-9669-ae52dbd09386 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 3c9c0c43-4e1a-4290-bbf1-60e26aba66ce] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:44.482648 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9e5bc43f-0348-44a9-9669-ae52dbd09386 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:44.483143 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9e5bc43f-0348-44a9-9669-ae52dbd09386 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:44.483639 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9e5bc43f-0348-44a9-9669-ae52dbd09386 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:44.484410 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9e5bc43f-0348-44a9-9669-ae52dbd09386 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:44.484837 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9e5bc43f-0348-44a9-9669-ae52dbd09386 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:44.485277 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9e5bc43f-0348-44a9-9669-ae52dbd09386 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:44.619289 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9e5bc43f-0348-44a9-9669-ae52dbd09386 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/3c9c0c43-4e1a-4290-bbf1-60e26aba66ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.161880 Aug 31 16:29:44.626758 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2989/5991] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 16:29:44 2022] GET /compute/v2.1/servers/3c9c0c43-4e1a-4290-bbf1-60e26aba66ce/os-volume_attachments => generated 197 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:29:44.724083 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4d6ebce4-9f7e-447d-910b-bc1cdb8a0a17 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:44.724652 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4d6ebce4-9f7e-447d-910b-bc1cdb8a0a17 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: b31fb01b-045f-41f7-bf58-66c1eca839e8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:44.758597 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4d6ebce4-9f7e-447d-910b-bc1cdb8a0a17 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:44.759274 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4d6ebce4-9f7e-447d-910b-bc1cdb8a0a17 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:44.761411 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4d6ebce4-9f7e-447d-910b-bc1cdb8a0a17 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:44.762546 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4d6ebce4-9f7e-447d-910b-bc1cdb8a0a17 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:44.763040 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4d6ebce4-9f7e-447d-910b-bc1cdb8a0a17 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:44.763488 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4d6ebce4-9f7e-447d-910b-bc1cdb8a0a17 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:45.637753 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4ac7a50b-4354-40f2-bec8-df225bd81181 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:45.640335 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4ac7a50b-4354-40f2-bec8-df225bd81181 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 3c9c0c43-4e1a-4290-bbf1-60e26aba66ce] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:45.682005 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4ac7a50b-4354-40f2-bec8-df225bd81181 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:45.683024 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4ac7a50b-4354-40f2-bec8-df225bd81181 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:45.686536 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4ac7a50b-4354-40f2-bec8-df225bd81181 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:45.688504 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4ac7a50b-4354-40f2-bec8-df225bd81181 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:45.730474 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4ac7a50b-4354-40f2-bec8-df225bd81181 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.039s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:45.733144 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4ac7a50b-4354-40f2-bec8-df225bd81181 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:45.835016 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-4d6ebce4-9f7e-447d-910b-bc1cdb8a0a17 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:45.865182 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-4d6ebce4-9f7e-447d-910b-bc1cdb8a0a17 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:45.892907 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-4d6ebce4-9f7e-447d-910b-bc1cdb8a0a17 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:45.900894 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4d6ebce4-9f7e-447d-910b-bc1cdb8a0a17 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8" status: 200 len: 1730 microversion: 2.20 time: 1.181616 Aug 31 16:29:45.905946 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4ac7a50b-4354-40f2-bec8-df225bd81181 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/3c9c0c43-4e1a-4290-bbf1-60e26aba66ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.273378 Aug 31 16:29:45.907741 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2990/5992] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 16:29:45 2022] GET /compute/v2.1/servers/3c9c0c43-4e1a-4290-bbf1-60e26aba66ce/os-volume_attachments => generated 197 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:29:45.909253 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3003/5993] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:29:44 2022] GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8 => generated 1730 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:29:46.923251 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a66cf234-e9a5-48ad-ba0e-171f1f6a8e09 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:46.931532 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a66cf234-e9a5-48ad-ba0e-171f1f6a8e09 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 3c9c0c43-4e1a-4290-bbf1-60e26aba66ce] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:46.955753 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-eb37152c-220b-43ff-8799-8cf4b9b4f4f3 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:46.957145 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-eb37152c-220b-43ff-8799-8cf4b9b4f4f3 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: b31fb01b-045f-41f7-bf58-66c1eca839e8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:46.979929 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a66cf234-e9a5-48ad-ba0e-171f1f6a8e09 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:46.982785 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eb37152c-220b-43ff-8799-8cf4b9b4f4f3 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:46.986828 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eb37152c-220b-43ff-8799-8cf4b9b4f4f3 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:46.988853 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eb37152c-220b-43ff-8799-8cf4b9b4f4f3 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:46.989529 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a66cf234-e9a5-48ad-ba0e-171f1f6a8e09 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:46.993081 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eb37152c-220b-43ff-8799-8cf4b9b4f4f3 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:46.993364 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a66cf234-e9a5-48ad-ba0e-171f1f6a8e09 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:46.997754 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a66cf234-e9a5-48ad-ba0e-171f1f6a8e09 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:46.998395 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eb37152c-220b-43ff-8799-8cf4b9b4f4f3 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:47.002889 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a66cf234-e9a5-48ad-ba0e-171f1f6a8e09 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:47.004407 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eb37152c-220b-43ff-8799-8cf4b9b4f4f3 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:47.007407 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a66cf234-e9a5-48ad-ba0e-171f1f6a8e09 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:47.203409 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a66cf234-e9a5-48ad-ba0e-171f1f6a8e09 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/3c9c0c43-4e1a-4290-bbf1-60e26aba66ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.285071 Aug 31 16:29:47.204070 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3004/5994] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 16:29:46 2022] GET /compute/v2.1/servers/3c9c0c43-4e1a-4290-bbf1-60e26aba66ce/os-volume_attachments => generated 197 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:29:48.097149 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-eb37152c-220b-43ff-8799-8cf4b9b4f4f3 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:48.114130 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-eb37152c-220b-43ff-8799-8cf4b9b4f4f3 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:48.132920 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-eb37152c-220b-43ff-8799-8cf4b9b4f4f3 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:48.134729 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-eb37152c-220b-43ff-8799-8cf4b9b4f4f3 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8" status: 200 len: 1730 microversion: 2.20 time: 1.187499 Aug 31 16:29:48.141900 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2991/5995] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:29:46 2022] GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8 => generated 1730 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:29:48.217927 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-cf8ffddb-f280-4aea-83d9-dd9e4fc88982 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:48.221655 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-cf8ffddb-f280-4aea-83d9-dd9e4fc88982 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 3c9c0c43-4e1a-4290-bbf1-60e26aba66ce] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:48.260066 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cf8ffddb-f280-4aea-83d9-dd9e4fc88982 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:48.272750 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cf8ffddb-f280-4aea-83d9-dd9e4fc88982 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:48.275967 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cf8ffddb-f280-4aea-83d9-dd9e4fc88982 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:48.284735 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cf8ffddb-f280-4aea-83d9-dd9e4fc88982 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:48.288033 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cf8ffddb-f280-4aea-83d9-dd9e4fc88982 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:48.290965 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cf8ffddb-f280-4aea-83d9-dd9e4fc88982 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:48.445725 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-cf8ffddb-f280-4aea-83d9-dd9e4fc88982 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/3c9c0c43-4e1a-4290-bbf1-60e26aba66ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.231728 Aug 31 16:29:48.458293 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3005/5996] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 16:29:48 2022] GET /compute/v2.1/servers/3c9c0c43-4e1a-4290-bbf1-60e26aba66ce/os-volume_attachments => generated 197 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:29:49.173418 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4ea7f5ee-380f-4e22-a5da-e436d3ce560b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:49.174840 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4ea7f5ee-380f-4e22-a5da-e436d3ce560b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: b31fb01b-045f-41f7-bf58-66c1eca839e8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:49.195390 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4ea7f5ee-380f-4e22-a5da-e436d3ce560b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:49.197357 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4ea7f5ee-380f-4e22-a5da-e436d3ce560b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:49.199142 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4ea7f5ee-380f-4e22-a5da-e436d3ce560b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:49.200331 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4ea7f5ee-380f-4e22-a5da-e436d3ce560b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:49.201074 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4ea7f5ee-380f-4e22-a5da-e436d3ce560b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:49.201800 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4ea7f5ee-380f-4e22-a5da-e436d3ce560b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:49.466065 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5f6219a2-24d3-4f67-84e8-59cefdd1f274 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:49.487723 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5f6219a2-24d3-4f67-84e8-59cefdd1f274 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 3c9c0c43-4e1a-4290-bbf1-60e26aba66ce] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:49.551542 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5f6219a2-24d3-4f67-84e8-59cefdd1f274 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:49.563171 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5f6219a2-24d3-4f67-84e8-59cefdd1f274 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:49.574188 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5f6219a2-24d3-4f67-84e8-59cefdd1f274 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:49.577738 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5f6219a2-24d3-4f67-84e8-59cefdd1f274 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:49.592725 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5f6219a2-24d3-4f67-84e8-59cefdd1f274 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:49.597607 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5f6219a2-24d3-4f67-84e8-59cefdd1f274 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:49.623833 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-4ea7f5ee-380f-4e22-a5da-e436d3ce560b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:49.647153 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-4ea7f5ee-380f-4e22-a5da-e436d3ce560b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:49.649002 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-4ea7f5ee-380f-4e22-a5da-e436d3ce560b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:49.650260 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4ea7f5ee-380f-4e22-a5da-e436d3ce560b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8" status: 200 len: 1730 microversion: 2.20 time: 0.481436 Aug 31 16:29:49.656216 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2992/5997] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:29:49 2022] GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8 => generated 1730 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:29:49.841283 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5f6219a2-24d3-4f67-84e8-59cefdd1f274 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/3c9c0c43-4e1a-4290-bbf1-60e26aba66ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.382374 Aug 31 16:29:49.845018 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3006/5998] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 16:29:49 2022] GET /compute/v2.1/servers/3c9c0c43-4e1a-4290-bbf1-60e26aba66ce/os-volume_attachments => generated 197 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:29:50.701468 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f4fdbf4c-3210-464c-aa97-b9f1eebbfc76 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:50.702445 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f4fdbf4c-3210-464c-aa97-b9f1eebbfc76 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: b31fb01b-045f-41f7-bf58-66c1eca839e8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:50.777066 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f4fdbf4c-3210-464c-aa97-b9f1eebbfc76 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:50.777622 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f4fdbf4c-3210-464c-aa97-b9f1eebbfc76 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:50.778085 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f4fdbf4c-3210-464c-aa97-b9f1eebbfc76 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:50.778845 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f4fdbf4c-3210-464c-aa97-b9f1eebbfc76 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:50.779314 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f4fdbf4c-3210-464c-aa97-b9f1eebbfc76 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:50.779776 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f4fdbf4c-3210-464c-aa97-b9f1eebbfc76 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:50.858273 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-20f086e3-2153-423f-9f2d-05f23e4f803b tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:50.861046 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-20f086e3-2153-423f-9f2d-05f23e4f803b tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 3c9c0c43-4e1a-4290-bbf1-60e26aba66ce] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:50.905025 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-20f086e3-2153-423f-9f2d-05f23e4f803b tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:50.908832 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-20f086e3-2153-423f-9f2d-05f23e4f803b tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:50.911029 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-20f086e3-2153-423f-9f2d-05f23e4f803b tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:50.919377 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-20f086e3-2153-423f-9f2d-05f23e4f803b tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:50.930652 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-20f086e3-2153-423f-9f2d-05f23e4f803b tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:50.937090 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-20f086e3-2153-423f-9f2d-05f23e4f803b tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:51.086212 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-20f086e3-2153-423f-9f2d-05f23e4f803b tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/3c9c0c43-4e1a-4290-bbf1-60e26aba66ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.232240 Aug 31 16:29:51.102537 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3007/5999] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 16:29:50 2022] GET /compute/v2.1/servers/3c9c0c43-4e1a-4290-bbf1-60e26aba66ce/os-volume_attachments => generated 197 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:29:51.799211 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f4fdbf4c-3210-464c-aa97-b9f1eebbfc76 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:51.836598 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f4fdbf4c-3210-464c-aa97-b9f1eebbfc76 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:51.860927 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f4fdbf4c-3210-464c-aa97-b9f1eebbfc76 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:51.865063 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f4fdbf4c-3210-464c-aa97-b9f1eebbfc76 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8" status: 200 len: 1730 microversion: 2.20 time: 1.170306 Aug 31 16:29:51.874399 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2993/6000] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:29:50 2022] GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8 => generated 1730 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:29:52.118889 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d3a980a1-6bf4-40d6-bf94-0de5da7c5d1a tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:52.122450 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d3a980a1-6bf4-40d6-bf94-0de5da7c5d1a tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 3c9c0c43-4e1a-4290-bbf1-60e26aba66ce] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:52.235429 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d3a980a1-6bf4-40d6-bf94-0de5da7c5d1a tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:52.249892 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d3a980a1-6bf4-40d6-bf94-0de5da7c5d1a tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:52.250891 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d3a980a1-6bf4-40d6-bf94-0de5da7c5d1a tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:52.258342 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d3a980a1-6bf4-40d6-bf94-0de5da7c5d1a tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:52.259225 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d3a980a1-6bf4-40d6-bf94-0de5da7c5d1a tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:52.268515 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d3a980a1-6bf4-40d6-bf94-0de5da7c5d1a tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:52.532647 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d3a980a1-6bf4-40d6-bf94-0de5da7c5d1a tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/3c9c0c43-4e1a-4290-bbf1-60e26aba66ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.421305 Aug 31 16:29:52.552217 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3008/6001] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 16:29:52 2022] GET /compute/v2.1/servers/3c9c0c43-4e1a-4290-bbf1-60e26aba66ce/os-volume_attachments => generated 197 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:29:52.913000 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1ea4a49c-ce45-41dc-a8fa-3ef9d7ac0359 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:52.914113 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1ea4a49c-ce45-41dc-a8fa-3ef9d7ac0359 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: b31fb01b-045f-41f7-bf58-66c1eca839e8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:52.959201 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1ea4a49c-ce45-41dc-a8fa-3ef9d7ac0359 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:52.960574 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1ea4a49c-ce45-41dc-a8fa-3ef9d7ac0359 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:52.966766 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1ea4a49c-ce45-41dc-a8fa-3ef9d7ac0359 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:52.974156 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1ea4a49c-ce45-41dc-a8fa-3ef9d7ac0359 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:52.976327 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1ea4a49c-ce45-41dc-a8fa-3ef9d7ac0359 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:52.984747 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1ea4a49c-ce45-41dc-a8fa-3ef9d7ac0359 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:53.561976 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-aa60b82e-7fbc-4e5d-a2a3-b4adf6e97539 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:53.569099 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-aa60b82e-7fbc-4e5d-a2a3-b4adf6e97539 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 3c9c0c43-4e1a-4290-bbf1-60e26aba66ce] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:53.640968 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:29:53.648659 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-aa60b82e-7fbc-4e5d-a2a3-b4adf6e97539 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:53.662103 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-aa60b82e-7fbc-4e5d-a2a3-b4adf6e97539 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:53.671242 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-aa60b82e-7fbc-4e5d-a2a3-b4adf6e97539 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:53.682709 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-aa60b82e-7fbc-4e5d-a2a3-b4adf6e97539 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:53.687009 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-aa60b82e-7fbc-4e5d-a2a3-b4adf6e97539 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:53.696892 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-aa60b82e-7fbc-4e5d-a2a3-b4adf6e97539 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:54.025970 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-aa60b82e-7fbc-4e5d-a2a3-b4adf6e97539 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/3c9c0c43-4e1a-4290-bbf1-60e26aba66ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.471547 Aug 31 16:29:54.069402 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3009/6002] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 16:29:53 2022] GET /compute/v2.1/servers/3c9c0c43-4e1a-4290-bbf1-60e26aba66ce/os-volume_attachments => generated 197 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:29:55.013553 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1ea4a49c-ce45-41dc-a8fa-3ef9d7ac0359 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:55.032144 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1ea4a49c-ce45-41dc-a8fa-3ef9d7ac0359 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:55.040769 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1ea4a49c-ce45-41dc-a8fa-3ef9d7ac0359 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:55.048680 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1ea4a49c-ce45-41dc-a8fa-3ef9d7ac0359 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8" status: 200 len: 1730 microversion: 2.20 time: 2.140692 Aug 31 16:29:55.067532 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2994/6003] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:29:52 2022] GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8 => generated 1730 bytes in 2150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:29:55.081198 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-bd6a5da4-64ca-410e-a85c-bc995c725b89 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:55.084014 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-bd6a5da4-64ca-410e-a85c-bc995c725b89 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 3c9c0c43-4e1a-4290-bbf1-60e26aba66ce] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:55.133181 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bd6a5da4-64ca-410e-a85c-bc995c725b89 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:55.135414 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bd6a5da4-64ca-410e-a85c-bc995c725b89 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:55.141945 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bd6a5da4-64ca-410e-a85c-bc995c725b89 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:55.151194 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bd6a5da4-64ca-410e-a85c-bc995c725b89 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:55.154339 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bd6a5da4-64ca-410e-a85c-bc995c725b89 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:55.164200 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bd6a5da4-64ca-410e-a85c-bc995c725b89 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:55.473782 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-bd6a5da4-64ca-410e-a85c-bc995c725b89 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/3c9c0c43-4e1a-4290-bbf1-60e26aba66ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.398226 Aug 31 16:29:55.480851 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3010/6004] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 16:29:55 2022] GET /compute/v2.1/servers/3c9c0c43-4e1a-4290-bbf1-60e26aba66ce/os-volume_attachments => generated 197 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:29:56.099826 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-842718be-2f65-4b39-931b-3fbf6867067b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:56.101469 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-842718be-2f65-4b39-931b-3fbf6867067b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: b31fb01b-045f-41f7-bf58-66c1eca839e8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:56.144147 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-842718be-2f65-4b39-931b-3fbf6867067b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:56.145765 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-842718be-2f65-4b39-931b-3fbf6867067b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:56.153030 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-842718be-2f65-4b39-931b-3fbf6867067b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:56.160769 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-842718be-2f65-4b39-931b-3fbf6867067b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:56.161593 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-842718be-2f65-4b39-931b-3fbf6867067b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:56.162304 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-842718be-2f65-4b39-931b-3fbf6867067b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:56.670874 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7b5ddfe1-4ecd-4a62-9944-9c0bd9ea252c tempest-VolumesSnapshotsTestJSON-50744162 tempest-VolumesSnapshotsTestJSON-50744162-project] Action: 'create', calling method: .version_select at 0x7f5ae8fb69d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-866632649"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:29:57.281705 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-842718be-2f65-4b39-931b-3fbf6867067b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:57.299074 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-842718be-2f65-4b39-931b-3fbf6867067b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:57.300607 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-842718be-2f65-4b39-931b-3fbf6867067b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:57.302187 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-842718be-2f65-4b39-931b-3fbf6867067b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8" status: 200 len: 1730 microversion: 2.20 time: 1.215429 Aug 31 16:29:57.303003 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3011/6005] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:29:56 2022] GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8 => generated 1730 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:29:57.373037 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-45807372-a308-47ef-9db2-97f6a4f374c9 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:57.388376 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-45807372-a308-47ef-9db2-97f6a4f374c9 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 3c9c0c43-4e1a-4290-bbf1-60e26aba66ce] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:57.408027 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-45807372-a308-47ef-9db2-97f6a4f374c9 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:57.416402 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-45807372-a308-47ef-9db2-97f6a4f374c9 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:57.417098 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-45807372-a308-47ef-9db2-97f6a4f374c9 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:57.418115 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-45807372-a308-47ef-9db2-97f6a4f374c9 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:57.419044 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-45807372-a308-47ef-9db2-97f6a4f374c9 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:57.421388 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-45807372-a308-47ef-9db2-97f6a4f374c9 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:57.618265 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-45807372-a308-47ef-9db2-97f6a4f374c9 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/3c9c0c43-4e1a-4290-bbf1-60e26aba66ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.261835 Aug 31 16:29:57.627891 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3012/6006] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 16:29:57 2022] GET /compute/v2.1/servers/3c9c0c43-4e1a-4290-bbf1-60e26aba66ce/os-volume_attachments => generated 197 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:29:58.329685 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5fe6eed9-72ea-4c49-9d03-b06c3a1ab1d0 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:58.330676 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5fe6eed9-72ea-4c49-9d03-b06c3a1ab1d0 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: b31fb01b-045f-41f7-bf58-66c1eca839e8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:58.419807 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5fe6eed9-72ea-4c49-9d03-b06c3a1ab1d0 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:58.426532 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5fe6eed9-72ea-4c49-9d03-b06c3a1ab1d0 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:58.426997 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5fe6eed9-72ea-4c49-9d03-b06c3a1ab1d0 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:58.427794 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5fe6eed9-72ea-4c49-9d03-b06c3a1ab1d0 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:58.428269 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5fe6eed9-72ea-4c49-9d03-b06c3a1ab1d0 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:58.434787 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5fe6eed9-72ea-4c49-9d03-b06c3a1ab1d0 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:58.529160 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7b5ddfe1-4ecd-4a62-9944-9c0bd9ea252c tempest-VolumesSnapshotsTestJSON-50744162 tempest-VolumesSnapshotsTestJSON-50744162-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.014962 Aug 31 16:29:58.529973 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2995/6007] 10.222.0.61 () {60 vars in 1155 bytes} [Wed Aug 31 16:29:55 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3017 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 31 16:29:58.545031 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-efed88a8-4316-4e78-b2d4-1988c3740d68 tempest-VolumesSnapshotsTestJSON-50744162 tempest-VolumesSnapshotsTestJSON-50744162-project] Calling method '.version_select at 0x7f5ae3eddb80>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:58.769641 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-efed88a8-4316-4e78-b2d4-1988c3740d68 tempest-VolumesSnapshotsTestJSON-50744162 tempest-VolumesSnapshotsTestJSON-50744162-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/c5bc447d-0cea-4988-ba07-8baa655d635a" status: 200 len: 344 microversion: 2.1 time: 0.229056 Aug 31 16:29:58.776410 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2996/6008] 10.222.0.61 () {58 vars in 1245 bytes} [Wed Aug 31 16:29:58 2022] GET /compute/v2.1/os-volumes/c5bc447d-0cea-4988-ba07-8baa655d635a => generated 344 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:29:58.777336 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-48e5bb16-ecc5-4cd2-9ff8-b17e7b5af77c tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:58.779756 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-48e5bb16-ecc5-4cd2-9ff8-b17e7b5af77c tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 3c9c0c43-4e1a-4290-bbf1-60e26aba66ce] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:58.817212 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:29:58.818829 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-48e5bb16-ecc5-4cd2-9ff8-b17e7b5af77c tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:58.819343 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-48e5bb16-ecc5-4cd2-9ff8-b17e7b5af77c tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:58.819810 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-48e5bb16-ecc5-4cd2-9ff8-b17e7b5af77c tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:58.820699 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-48e5bb16-ecc5-4cd2-9ff8-b17e7b5af77c tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:58.821251 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-48e5bb16-ecc5-4cd2-9ff8-b17e7b5af77c tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:58.821735 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-48e5bb16-ecc5-4cd2-9ff8-b17e7b5af77c tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:59.057266 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-48e5bb16-ecc5-4cd2-9ff8-b17e7b5af77c tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/3c9c0c43-4e1a-4290-bbf1-60e26aba66ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.285258 Aug 31 16:29:59.089923 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2997/6009] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 16:29:58 2022] GET /compute/v2.1/servers/3c9c0c43-4e1a-4290-bbf1-60e26aba66ce/os-volume_attachments => generated 197 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:29:59.558879 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5fe6eed9-72ea-4c49-9d03-b06c3a1ab1d0 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:59.581834 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5fe6eed9-72ea-4c49-9d03-b06c3a1ab1d0 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:59.590386 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5fe6eed9-72ea-4c49-9d03-b06c3a1ab1d0 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:59.598945 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5fe6eed9-72ea-4c49-9d03-b06c3a1ab1d0 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8" status: 200 len: 1730 microversion: 2.20 time: 1.273839 Aug 31 16:29:59.617320 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3013/6010] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:29:58 2022] GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8 => generated 1730 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:29:59.789175 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f65e6363-2043-4022-9493-348f80ef0c65 tempest-VolumesSnapshotsTestJSON-50744162 tempest-VolumesSnapshotsTestJSON-50744162-project] Calling method '.version_select at 0x7f5ae3e0ea60>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:00.074607 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e988c169-aff0-4876-8cda-b67b874e1571 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:00.078691 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e988c169-aff0-4876-8cda-b67b874e1571 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 3c9c0c43-4e1a-4290-bbf1-60e26aba66ce] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:30:00.084080 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f65e6363-2043-4022-9493-348f80ef0c65 tempest-VolumesSnapshotsTestJSON-50744162 tempest-VolumesSnapshotsTestJSON-50744162-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/c5bc447d-0cea-4988-ba07-8baa655d635a" status: 200 len: 344 microversion: 2.1 time: 0.303701 Aug 31 16:30:00.085099 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2998/6011] 10.222.0.61 () {58 vars in 1245 bytes} [Wed Aug 31 16:29:59 2022] GET /compute/v2.1/os-volumes/c5bc447d-0cea-4988-ba07-8baa655d635a => generated 344 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:30:00.106940 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e988c169-aff0-4876-8cda-b67b874e1571 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:00.110877 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e988c169-aff0-4876-8cda-b67b874e1571 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:00.119162 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e988c169-aff0-4876-8cda-b67b874e1571 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:00.122559 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e988c169-aff0-4876-8cda-b67b874e1571 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:00.132202 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e988c169-aff0-4876-8cda-b67b874e1571 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:00.134995 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e988c169-aff0-4876-8cda-b67b874e1571 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:00.395777 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:30:00.418314 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e988c169-aff0-4876-8cda-b67b874e1571 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/3c9c0c43-4e1a-4290-bbf1-60e26aba66ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.351920 Aug 31 16:30:00.443884 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3014/6012] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 16:30:00 2022] GET /compute/v2.1/servers/3c9c0c43-4e1a-4290-bbf1-60e26aba66ce/os-volume_attachments => generated 197 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:30:00.632615 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-246defd5-8d54-4a2e-95ca-86258d2dab9e tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:00.633227 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-246defd5-8d54-4a2e-95ca-86258d2dab9e tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: b31fb01b-045f-41f7-bf58-66c1eca839e8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:30:00.645036 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-246defd5-8d54-4a2e-95ca-86258d2dab9e tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:00.648779 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-246defd5-8d54-4a2e-95ca-86258d2dab9e tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:00.649494 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-246defd5-8d54-4a2e-95ca-86258d2dab9e tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:00.650255 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-246defd5-8d54-4a2e-95ca-86258d2dab9e tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:00.650717 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-246defd5-8d54-4a2e-95ca-86258d2dab9e tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:00.656255 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-246defd5-8d54-4a2e-95ca-86258d2dab9e tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:01.105075 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-213044bf-7278-456c-b746-dcb1ce506bb7 tempest-VolumesSnapshotsTestJSON-50744162 tempest-VolumesSnapshotsTestJSON-50744162-project] Calling method '.version_select at 0x7f5ae3aa64c0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:01.286957 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-246defd5-8d54-4a2e-95ca-86258d2dab9e tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:01.306318 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-246defd5-8d54-4a2e-95ca-86258d2dab9e tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:01.309333 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-246defd5-8d54-4a2e-95ca-86258d2dab9e tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:01.317274 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-246defd5-8d54-4a2e-95ca-86258d2dab9e tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8" status: 200 len: 1730 microversion: 2.20 time: 0.689142 Aug 31 16:30:01.322773 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 2999/6013] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:30:00 2022] GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8 => generated 1730 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:30:01.370419 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-213044bf-7278-456c-b746-dcb1ce506bb7 tempest-VolumesSnapshotsTestJSON-50744162 tempest-VolumesSnapshotsTestJSON-50744162-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/c5bc447d-0cea-4988-ba07-8baa655d635a" status: 200 len: 344 microversion: 2.1 time: 0.274145 Aug 31 16:30:01.371646 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3015/6014] 10.222.0.61 () {58 vars in 1245 bytes} [Wed Aug 31 16:30:01 2022] GET /compute/v2.1/os-volumes/c5bc447d-0cea-4988-ba07-8baa655d635a => generated 344 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:30:01.448666 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-40b1d7f8-3818-4106-8990-e15a2339393e tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:01.451465 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-40b1d7f8-3818-4106-8990-e15a2339393e tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 3c9c0c43-4e1a-4290-bbf1-60e26aba66ce] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:30:01.485465 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-40b1d7f8-3818-4106-8990-e15a2339393e tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:01.489217 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-40b1d7f8-3818-4106-8990-e15a2339393e tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:01.505339 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-40b1d7f8-3818-4106-8990-e15a2339393e tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:01.517489 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-40b1d7f8-3818-4106-8990-e15a2339393e tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:01.527126 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-40b1d7f8-3818-4106-8990-e15a2339393e tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:01.528129 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-40b1d7f8-3818-4106-8990-e15a2339393e tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:01.821803 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-40b1d7f8-3818-4106-8990-e15a2339393e tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/3c9c0c43-4e1a-4290-bbf1-60e26aba66ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.376358 Aug 31 16:30:01.822575 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3000/6015] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 16:30:01 2022] GET /compute/v2.1/servers/3c9c0c43-4e1a-4290-bbf1-60e26aba66ce/os-volume_attachments => generated 197 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:30:02.356070 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-baf32473-eeda-472f-b32e-c86f8fe7fc31 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:02.356708 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-baf32473-eeda-472f-b32e-c86f8fe7fc31 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: b31fb01b-045f-41f7-bf58-66c1eca839e8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:30:02.386023 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-baf32473-eeda-472f-b32e-c86f8fe7fc31 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:02.386545 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-baf32473-eeda-472f-b32e-c86f8fe7fc31 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:02.386994 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-baf32473-eeda-472f-b32e-c86f8fe7fc31 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:02.387824 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d40a2938-753b-4494-b0fb-a9486aa81359 tempest-VolumesSnapshotsTestJSON-50744162 tempest-VolumesSnapshotsTestJSON-50744162-project] Calling method '.version_select at 0x7f5aed2c81f0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:02.393319 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-baf32473-eeda-472f-b32e-c86f8fe7fc31 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:02.393872 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-baf32473-eeda-472f-b32e-c86f8fe7fc31 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:02.400401 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-baf32473-eeda-472f-b32e-c86f8fe7fc31 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:02.649566 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d40a2938-753b-4494-b0fb-a9486aa81359 tempest-VolumesSnapshotsTestJSON-50744162 tempest-VolumesSnapshotsTestJSON-50744162-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/c5bc447d-0cea-4988-ba07-8baa655d635a" status: 200 len: 345 microversion: 2.1 time: 0.266612 Aug 31 16:30:02.650834 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3001/6016] 10.222.0.61 () {58 vars in 1245 bytes} [Wed Aug 31 16:30:02 2022] GET /compute/v2.1/os-volumes/c5bc447d-0cea-4988-ba07-8baa655d635a => generated 345 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:30:02.666156 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0c89cead-d6b9-4e62-a2e7-a6ee35900792 tempest-VolumesSnapshotsTestJSON-50744162 tempest-VolumesSnapshotsTestJSON-50744162-project] Action: 'create', calling method: .version_select at 0x7f5ae8f9c940>, body: {"snapshot": {"volume_id": "c5bc447d-0cea-4988-ba07-8baa655d635a", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1159919568"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:30:03.057530 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0c89cead-d6b9-4e62-a2e7-a6ee35900792 tempest-VolumesSnapshotsTestJSON-50744162 tempest-VolumesSnapshotsTestJSON-50744162-project] 10.222.0.61 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.395305 Aug 31 16:30:03.058161 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3002/6017] 10.222.0.61 () {60 vars in 1162 bytes} [Wed Aug 31 16:30:02 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:30:03.063667 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e5a38475-e970-490a-93dd-b985f6c65b8b tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:03.065860 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e5a38475-e970-490a-93dd-b985f6c65b8b tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 3c9c0c43-4e1a-4290-bbf1-60e26aba66ce] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:30:03.087351 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-baf32473-eeda-472f-b32e-c86f8fe7fc31 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:03.102906 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-baf32473-eeda-472f-b32e-c86f8fe7fc31 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:03.130853 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-baf32473-eeda-472f-b32e-c86f8fe7fc31 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:03.132010 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e5a38475-e970-490a-93dd-b985f6c65b8b tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:03.132818 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e5a38475-e970-490a-93dd-b985f6c65b8b tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:03.142934 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e5a38475-e970-490a-93dd-b985f6c65b8b tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:03.145133 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-baf32473-eeda-472f-b32e-c86f8fe7fc31 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8" status: 200 len: 1730 microversion: 2.20 time: 0.794129 Aug 31 16:30:03.146295 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e5a38475-e970-490a-93dd-b985f6c65b8b tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:03.149689 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3016/6018] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:30:02 2022] GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8 => generated 1730 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:30:03.152144 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e5a38475-e970-490a-93dd-b985f6c65b8b tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:03.157395 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e5a38475-e970-490a-93dd-b985f6c65b8b tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:03.172892 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7d560112-ebae-40e2-9326-b87e274f5521 tempest-VolumesSnapshotsTestJSON-50744162 tempest-VolumesSnapshotsTestJSON-50744162-project] Calling method '.version_select at 0x7f5ae3ac6c10>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:03.280013 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7d560112-ebae-40e2-9326-b87e274f5521 tempest-VolumesSnapshotsTestJSON-50744162 tempest-VolumesSnapshotsTestJSON-50744162-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/dd161e92-1683-44a7-96c2-ee24e2efd4d2" status: 200 len: 287 microversion: 2.1 time: 0.125672 Aug 31 16:30:03.280837 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3017/6019] 10.222.0.61 () {58 vars in 1251 bytes} [Wed Aug 31 16:30:03 2022] GET /compute/v2.1/os-snapshots/dd161e92-1683-44a7-96c2-ee24e2efd4d2 => generated 287 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:30:03.294706 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ad554815-2a86-4a8a-b850-4aa99290d7b1 tempest-VolumesSnapshotsTestJSON-50744162 tempest-VolumesSnapshotsTestJSON-50744162-project] Calling method '.version_select at 0x7f5ae3cbbdc0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:03.309540 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e5a38475-e970-490a-93dd-b985f6c65b8b tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/3c9c0c43-4e1a-4290-bbf1-60e26aba66ce/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.249808 Aug 31 16:30:03.314333 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3003/6020] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 16:30:03 2022] GET /compute/v2.1/servers/3c9c0c43-4e1a-4290-bbf1-60e26aba66ce/os-volume_attachments => generated 25 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 16:30:03.351819 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ad554815-2a86-4a8a-b850-4aa99290d7b1 tempest-VolumesSnapshotsTestJSON-50744162 tempest-VolumesSnapshotsTestJSON-50744162-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.061871 Aug 31 16:30:03.353400 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3018/6021] 10.222.0.61 () {58 vars in 1140 bytes} [Wed Aug 31 16:30:03 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:30:03.367096 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c35867d2-2c54-47a1-97c6-c5b99df3d123 tempest-VolumesSnapshotsTestJSON-50744162 tempest-VolumesSnapshotsTestJSON-50744162-project] Calling method '.version_select at 0x7f5ae829d940>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:03.496571 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c35867d2-2c54-47a1-97c6-c5b99df3d123 tempest-VolumesSnapshotsTestJSON-50744162 tempest-VolumesSnapshotsTestJSON-50744162-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/dd161e92-1683-44a7-96c2-ee24e2efd4d2" status: 200 len: 287 microversion: 2.1 time: 0.134332 Aug 31 16:30:03.497735 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3004/6022] 10.222.0.61 () {58 vars in 1251 bytes} [Wed Aug 31 16:30:03 2022] GET /compute/v2.1/os-snapshots/dd161e92-1683-44a7-96c2-ee24e2efd4d2 => generated 287 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:30:03.500912 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1fe0c7d9-963f-49ed-90ac-32207ad58a3d tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:03.502538 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1fe0c7d9-963f-49ed-90ac-32207ad58a3d tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 3c9c0c43-4e1a-4290-bbf1-60e26aba66ce] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:30:03.548121 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1fe0c7d9-963f-49ed-90ac-32207ad58a3d tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:03.548640 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1fe0c7d9-963f-49ed-90ac-32207ad58a3d tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:03.549088 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1fe0c7d9-963f-49ed-90ac-32207ad58a3d tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:03.549939 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1fe0c7d9-963f-49ed-90ac-32207ad58a3d tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:03.551135 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1fe0c7d9-963f-49ed-90ac-32207ad58a3d tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:03.551786 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1fe0c7d9-963f-49ed-90ac-32207ad58a3d tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:03.695758 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1fe0c7d9-963f-49ed-90ac-32207ad58a3d tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 3c9c0c43-4e1a-4290-bbf1-60e26aba66ce] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:30:04.118631 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1fe0c7d9-963f-49ed-90ac-32207ad58a3d tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "DELETE /compute/v2.1/servers/3c9c0c43-4e1a-4290-bbf1-60e26aba66ce" status: 204 len: 0 microversion: 2.1 time: 0.637274 Aug 31 16:30:04.124418 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3019/6023] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:30:03 2022] DELETE /compute/v2.1/servers/3c9c0c43-4e1a-4290-bbf1-60e26aba66ce => generated 0 bytes in 644 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:30:04.135089 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-150362e5-2d97-47b1-80aa-4f6f875f09ee tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:04.136754 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-150362e5-2d97-47b1-80aa-4f6f875f09ee tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 3c9c0c43-4e1a-4290-bbf1-60e26aba66ce] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:30:04.175120 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-85900977-5720-4269-8d0e-e7cf1c3e9a65 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:04.176776 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-85900977-5720-4269-8d0e-e7cf1c3e9a65 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: b31fb01b-045f-41f7-bf58-66c1eca839e8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:30:04.185701 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-150362e5-2d97-47b1-80aa-4f6f875f09ee tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:04.190530 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-150362e5-2d97-47b1-80aa-4f6f875f09ee tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:04.193365 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-150362e5-2d97-47b1-80aa-4f6f875f09ee tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:04.197175 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-150362e5-2d97-47b1-80aa-4f6f875f09ee tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:04.203247 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-150362e5-2d97-47b1-80aa-4f6f875f09ee tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:04.207371 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-85900977-5720-4269-8d0e-e7cf1c3e9a65 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:04.211762 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-150362e5-2d97-47b1-80aa-4f6f875f09ee tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:04.214895 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-85900977-5720-4269-8d0e-e7cf1c3e9a65 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:04.215356 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-85900977-5720-4269-8d0e-e7cf1c3e9a65 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:04.220971 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-85900977-5720-4269-8d0e-e7cf1c3e9a65 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:04.224641 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-85900977-5720-4269-8d0e-e7cf1c3e9a65 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:04.228728 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-85900977-5720-4269-8d0e-e7cf1c3e9a65 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:05.563022 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-150362e5-2d97-47b1-80aa-4f6f875f09ee tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133363b2b12d4730994557ee24f08879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d9ba3589a24faaac930a35742ce834', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:05.594330 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-150362e5-2d97-47b1-80aa-4f6f875f09ee tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/3c9c0c43-4e1a-4290-bbf1-60e26aba66ce" status: 200 len: 1682 microversion: 2.1 time: 1.463894 Aug 31 16:30:05.594922 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3005/6024] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:30:04 2022] GET /compute/v2.1/servers/3c9c0c43-4e1a-4290-bbf1-60e26aba66ce => generated 1682 bytes in 1467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:30:05.610541 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-85900977-5720-4269-8d0e-e7cf1c3e9a65 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:05.638799 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-85900977-5720-4269-8d0e-e7cf1c3e9a65 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:05.645130 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2da9408f-8b20-4420-8287-5997ee59dcd1 tempest-VolumesSnapshotsTestJSON-50744162 tempest-VolumesSnapshotsTestJSON-50744162-project] Calling method '.version_select at 0x7f5ae85e7820>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:05.650819 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-85900977-5720-4269-8d0e-e7cf1c3e9a65 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:05.665620 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-85900977-5720-4269-8d0e-e7cf1c3e9a65 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8" status: 200 len: 1730 microversion: 2.20 time: 1.493446 Aug 31 16:30:05.667747 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3020/6025] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:30:04 2022] GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8 => generated 1730 bytes in 1498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:30:05.787382 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2da9408f-8b20-4420-8287-5997ee59dcd1 tempest-VolumesSnapshotsTestJSON-50744162 tempest-VolumesSnapshotsTestJSON-50744162-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/dd161e92-1683-44a7-96c2-ee24e2efd4d2" status: 200 len: 287 microversion: 2.1 time: 0.191346 Aug 31 16:30:05.788515 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3006/6026] 10.222.0.61 () {58 vars in 1251 bytes} [Wed Aug 31 16:30:05 2022] GET /compute/v2.1/os-snapshots/dd161e92-1683-44a7-96c2-ee24e2efd4d2 => generated 287 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:30:06.624107 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-74763547-a5ec-41bb-95a3-74e9e97c6548 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:06.624947 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-74763547-a5ec-41bb-95a3-74e9e97c6548 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 3c9c0c43-4e1a-4290-bbf1-60e26aba66ce] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:30:06.702646 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a69a495d-87a9-4149-ac43-4bdf88673715 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:06.712665 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a69a495d-87a9-4149-ac43-4bdf88673715 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: b31fb01b-045f-41f7-bf58-66c1eca839e8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:30:06.726208 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-74763547-a5ec-41bb-95a3-74e9e97c6548 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:06.739571 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-74763547-a5ec-41bb-95a3-74e9e97c6548 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:06.750013 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-74763547-a5ec-41bb-95a3-74e9e97c6548 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:06.751482 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-74763547-a5ec-41bb-95a3-74e9e97c6548 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:06.752460 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-74763547-a5ec-41bb-95a3-74e9e97c6548 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:06.753332 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-74763547-a5ec-41bb-95a3-74e9e97c6548 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:06.780639 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a69a495d-87a9-4149-ac43-4bdf88673715 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:06.782292 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a69a495d-87a9-4149-ac43-4bdf88673715 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:06.784550 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a69a495d-87a9-4149-ac43-4bdf88673715 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:06.789299 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a69a495d-87a9-4149-ac43-4bdf88673715 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:06.791245 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a69a495d-87a9-4149-ac43-4bdf88673715 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:06.794252 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a69a495d-87a9-4149-ac43-4bdf88673715 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:09.768015 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a69a495d-87a9-4149-ac43-4bdf88673715 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:09.785183 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a69a495d-87a9-4149-ac43-4bdf88673715 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:09.787401 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a69a495d-87a9-4149-ac43-4bdf88673715 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:09.792596 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a69a495d-87a9-4149-ac43-4bdf88673715 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8" status: 200 len: 1730 microversion: 2.20 time: 3.099360 Aug 31 16:30:09.796573 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3007/6027] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:30:06 2022] GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8 => generated 1730 bytes in 3105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:30:09.817395 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-61fd8277-72bd-4692-a048-9bdd5a9ac41f tempest-VolumesSnapshotsTestJSON-50744162 tempest-VolumesSnapshotsTestJSON-50744162-project] Calling method '.version_select at 0x7f5ae80e4280>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:09.887056 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-61fd8277-72bd-4692-a048-9bdd5a9ac41f tempest-VolumesSnapshotsTestJSON-50744162 tempest-VolumesSnapshotsTestJSON-50744162-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/dd161e92-1683-44a7-96c2-ee24e2efd4d2" status: 200 len: 288 microversion: 2.1 time: 0.082422 Aug 31 16:30:09.888540 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3008/6028] 10.222.0.61 () {58 vars in 1251 bytes} [Wed Aug 31 16:30:09 2022] GET /compute/v2.1/os-snapshots/dd161e92-1683-44a7-96c2-ee24e2efd4d2 => generated 288 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:30:09.899668 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-912d34fb-f45c-4ce4-a33e-ad5c93a61ed5 tempest-VolumesSnapshotsTestJSON-50744162 tempest-VolumesSnapshotsTestJSON-50744162-project] Calling method '.version_select at 0x7f5ae3d15a60>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:10.028056 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-74763547-a5ec-41bb-95a3-74e9e97c6548 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133363b2b12d4730994557ee24f08879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d9ba3589a24faaac930a35742ce834', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:10.054828 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-74763547-a5ec-41bb-95a3-74e9e97c6548 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/3c9c0c43-4e1a-4290-bbf1-60e26aba66ce" status: 200 len: 1682 microversion: 2.1 time: 3.437730 Aug 31 16:30:10.059607 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3021/6029] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:30:06 2022] GET /compute/v2.1/servers/3c9c0c43-4e1a-4290-bbf1-60e26aba66ce => generated 1682 bytes in 3443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:30:10.107311 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-912d34fb-f45c-4ce4-a33e-ad5c93a61ed5 tempest-VolumesSnapshotsTestJSON-50744162 tempest-VolumesSnapshotsTestJSON-50744162-project] 10.222.0.61 "DELETE /compute/v2.1/os-snapshots/dd161e92-1683-44a7-96c2-ee24e2efd4d2" status: 202 len: 0 microversion: 2.1 time: 0.211516 Aug 31 16:30:10.108485 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3009/6030] 10.222.0.61 () {58 vars in 1254 bytes} [Wed Aug 31 16:30:09 2022] DELETE /compute/v2.1/os-snapshots/dd161e92-1683-44a7-96c2-ee24e2efd4d2 => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:30:10.119480 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-692e16fb-cb58-426e-9489-05217ed1b081 tempest-VolumesSnapshotsTestJSON-50744162 tempest-VolumesSnapshotsTestJSON-50744162-project] Calling method '.version_select at 0x7f5ae3ab51f0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:10.224601 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-692e16fb-cb58-426e-9489-05217ed1b081 tempest-VolumesSnapshotsTestJSON-50744162 tempest-VolumesSnapshotsTestJSON-50744162-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/dd161e92-1683-44a7-96c2-ee24e2efd4d2" status: 200 len: 287 microversion: 2.1 time: 0.111610 Aug 31 16:30:10.225729 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3022/6031] 10.222.0.61 () {58 vars in 1251 bytes} [Wed Aug 31 16:30:10 2022] GET /compute/v2.1/os-snapshots/dd161e92-1683-44a7-96c2-ee24e2efd4d2 => generated 287 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:30:10.829207 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-78bbd527-520d-4f84-978b-c53e8042e4a1 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:10.832371 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-78bbd527-520d-4f84-978b-c53e8042e4a1 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: b31fb01b-045f-41f7-bf58-66c1eca839e8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:30:10.944689 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-78bbd527-520d-4f84-978b-c53e8042e4a1 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:10.955819 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-78bbd527-520d-4f84-978b-c53e8042e4a1 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:10.959770 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-78bbd527-520d-4f84-978b-c53e8042e4a1 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:10.969496 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-78bbd527-520d-4f84-978b-c53e8042e4a1 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:10.970316 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-78bbd527-520d-4f84-978b-c53e8042e4a1 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:10.979725 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-78bbd527-520d-4f84-978b-c53e8042e4a1 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:11.092556 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0cc97db3-242c-4dd0-b965-019e051a2b5a tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:11.096041 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0cc97db3-242c-4dd0-b965-019e051a2b5a tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 3c9c0c43-4e1a-4290-bbf1-60e26aba66ce] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:30:11.163899 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0cc97db3-242c-4dd0-b965-019e051a2b5a tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:11.186762 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=96 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:30:11.201018 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0cc97db3-242c-4dd0-b965-019e051a2b5a tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.037s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:11.201473 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0cc97db3-242c-4dd0-b965-019e051a2b5a tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:11.202232 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0cc97db3-242c-4dd0-b965-019e051a2b5a tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:11.212281 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0cc97db3-242c-4dd0-b965-019e051a2b5a tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:11.217837 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0cc97db3-242c-4dd0-b965-019e051a2b5a tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:11.701844 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0cc97db3-242c-4dd0-b965-019e051a2b5a tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133363b2b12d4730994557ee24f08879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d9ba3589a24faaac930a35742ce834', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:11.720342 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0cc97db3-242c-4dd0-b965-019e051a2b5a tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/3c9c0c43-4e1a-4290-bbf1-60e26aba66ce" status: 200 len: 1327 microversion: 2.1 time: 0.639191 Aug 31 16:30:11.724913 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3023/6032] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:30:11 2022] GET /compute/v2.1/servers/3c9c0c43-4e1a-4290-bbf1-60e26aba66ce => generated 1327 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:30:11.751438 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-bde77ae3-558e-4e59-a741-874ccbf41357 req-88d7b6e3-07e4-4894-aa71-405eef3d5d24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c9c0c43-4e1a-4290-bbf1-60e26aba66ce", "name": "network-vif-deleted", "tag": "aef76fa3-a9f8-4e2a-ba1d-2d8dd5a9374a"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:30:11.830653 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-bde77ae3-558e-4e59-a741-874ccbf41357 req-88d7b6e3-07e4-4894-aa71-405eef3d5d24 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:11.830923 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-78bbd527-520d-4f84-978b-c53e8042e4a1 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:11.832061 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-bde77ae3-558e-4e59-a741-874ccbf41357 req-88d7b6e3-07e4-4894-aa71-405eef3d5d24 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:11.836431 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-bde77ae3-558e-4e59-a741-874ccbf41357 req-88d7b6e3-07e4-4894-aa71-405eef3d5d24 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:11.851122 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-78bbd527-520d-4f84-978b-c53e8042e4a1 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:11.857009 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-78bbd527-520d-4f84-978b-c53e8042e4a1 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:11.868658 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-78bbd527-520d-4f84-978b-c53e8042e4a1 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8" status: 200 len: 1730 microversion: 2.20 time: 1.049273 Aug 31 16:30:11.889331 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3010/6033] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:30:10 2022] GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8 => generated 1730 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:30:11.894831 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-bde77ae3-558e-4e59-a741-874ccbf41357 req-88d7b6e3-07e4-4894-aa71-405eef3d5d24 service nova] Creating event network-vif-deleted:aef76fa3-a9f8-4e2a-ba1d-2d8dd5a9374a for instance 3c9c0c43-4e1a-4290-bbf1-60e26aba66ce on n-h2-850499-9 Aug 31 16:30:11.906306 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2543939b-b328-4250-b2b9-da5defde5e37 tempest-VolumesSnapshotsTestJSON-50744162 tempest-VolumesSnapshotsTestJSON-50744162-project] Calling method '.version_select at 0x7f5ae3f37790>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:11.913891 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-bde77ae3-558e-4e59-a741-874ccbf41357 req-88d7b6e3-07e4-4894-aa71-405eef3d5d24 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.185209 Aug 31 16:30:11.916857 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3024/6034] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:30:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:30:11.997107 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2543939b-b328-4250-b2b9-da5defde5e37 tempest-VolumesSnapshotsTestJSON-50744162 tempest-VolumesSnapshotsTestJSON-50744162-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/dd161e92-1683-44a7-96c2-ee24e2efd4d2" status: 200 len: 287 microversion: 2.1 time: 0.105231 Aug 31 16:30:12.006912 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3011/6035] 10.222.0.61 () {58 vars in 1251 bytes} [Wed Aug 31 16:30:11 2022] GET /compute/v2.1/os-snapshots/dd161e92-1683-44a7-96c2-ee24e2efd4d2 => generated 287 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:30:12.749620 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5e46d8ff-41cd-4f25-9ae3-2f89607ebbd4 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:12.750347 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5e46d8ff-41cd-4f25-9ae3-2f89607ebbd4 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 3c9c0c43-4e1a-4290-bbf1-60e26aba66ce] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:30:12.779348 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5e46d8ff-41cd-4f25-9ae3-2f89607ebbd4 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:12.782150 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5e46d8ff-41cd-4f25-9ae3-2f89607ebbd4 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:12.784133 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5e46d8ff-41cd-4f25-9ae3-2f89607ebbd4 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:12.790555 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5e46d8ff-41cd-4f25-9ae3-2f89607ebbd4 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:12.792281 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5e46d8ff-41cd-4f25-9ae3-2f89607ebbd4 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:12.793641 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5e46d8ff-41cd-4f25-9ae3-2f89607ebbd4 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:12.896278 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8b86ce48-99ef-401b-9859-e6e78c64a528 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:12.897627 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8b86ce48-99ef-401b-9859-e6e78c64a528 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: b31fb01b-045f-41f7-bf58-66c1eca839e8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:30:12.902564 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-5e46d8ff-41cd-4f25-9ae3-2f89607ebbd4 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] HTTP exception thrown: Instance 3c9c0c43-4e1a-4290-bbf1-60e26aba66ce could not be found. Aug 31 16:30:12.914961 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5e46d8ff-41cd-4f25-9ae3-2f89607ebbd4 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Request method failure captured: Aug 31 16:30:12.914961 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/3c9c0c43-4e1a-4290-bbf1-60e26aba66ce HTTP/1.1 Aug 31 16:30:12.914961 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:30:12.914961 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:30:12.914961 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:30:12.914961 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:30:12.914961 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:30:12.914961 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:30:12.914961 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:30:12.914961 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:30:12.914961 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4rNdtL8Hp93envnJYgxrkKzEuKKLro2yD65tuaCjxV170sTEb0vV7K7CSwqb17J41LEaCf2veX7M0gQMtVuIZTkoy1EqZ7hcQ7-sxxS5qnxJzqp8zg_d5_eF53mYW1SiUWmb2sxTco76Ig5gniRxyga2-esulxOQeqjncU6078g4lk Aug 31 16:30:12.914961 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:30:12.914961 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:30:12.914961 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:30:12.914961 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:30:12.914961 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:30:12.914961 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:30:12.914961 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 79d9ba3589a24faaac930a35742ce834 Aug 31 16:30:12.914961 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-AttachVolumeNegativeTest-1703723156 Aug 31 16:30:12.914961 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:30:12.914961 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:30:12.914961 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/79d9ba3589a24faaac930a35742ce834"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/79d9ba3589a24faaac930a35742ce834"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_79d9ba3589a24faaac930a35742ce834", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/79d9ba3589a24faaac930a35742ce834"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:30:12.914961 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-AttachVolumeNegativeTest-1703723156 Aug 31 16:30:12.914961 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 79d9ba3589a24faaac930a35742ce834 Aug 31 16:30:12.914961 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1703723156 Aug 31 16:30:12.914961 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-AttachVolumeNegativeTest-1703723156-project Aug 31 16:30:12.914961 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:30:12.914961 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:30:12.914961 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 133363b2b12d4730994557ee24f08879 Aug 31 16:30:12.914961 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-AttachVolumeNegativeTest-1703723156-project Aug 31 16:30:12.914961 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:30:12.914961 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance 3c9c0c43-4e1a-4290-bbf1-60e26aba66ce could not be found. Aug 31 16:30:12.914961 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '3c9c0c43-4e1a-4290-bbf1-60e26aba66ce'} Aug 31 16:30:12.914961 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:30:12.914961 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:30:12.914961 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:30:12.914961 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:30:12.914961 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:30:12.914961 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:30:12.914961 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:30:12.914961 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:30:12.914961 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:30:12.914961 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:30:12.914961 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c9c0c43-4e1a-4290-bbf1-60e26aba66ce could not be found. Aug 31 16:30:12.914961 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:30:12.914961 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:30:12.914961 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:30:12.914961 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:30:12.914961 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:30:12.914961 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:30:12.914961 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:30:12.914961 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:30:12.914961 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:30:12.914961 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:30:12.914961 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:30:12.914961 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:30:12.914961 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:30:12.914961 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:30:12.914961 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:30:12.914961 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:30:12.914961 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c9c0c43-4e1a-4290-bbf1-60e26aba66ce could not be found. Aug 31 16:30:12.914961 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:30:12.914961 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:30:12.914961 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:30:12.919697 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:30:12.919697 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:30:12.919697 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:30:12.919697 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:30:12.919697 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:30:12.919697 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c9c0c43-4e1a-4290-bbf1-60e26aba66ce could not be found. Aug 31 16:30:12.919697 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:30:12.922641 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5e46d8ff-41cd-4f25-9ae3-2f89607ebbd4 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Returning 404 to user: Instance 3c9c0c43-4e1a-4290-bbf1-60e26aba66ce could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:30:12.929948 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5e46d8ff-41cd-4f25-9ae3-2f89607ebbd4 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/3c9c0c43-4e1a-4290-bbf1-60e26aba66ce" status: 404 len: 111 microversion: 2.1 time: 0.181887 Aug 31 16:30:12.938288 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3025/6036] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:30:12 2022] GET /compute/v2.1/servers/3c9c0c43-4e1a-4290-bbf1-60e26aba66ce => generated 111 bytes in 196 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:30:12.942774 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8b86ce48-99ef-401b-9859-e6e78c64a528 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:12.943937 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8b86ce48-99ef-401b-9859-e6e78c64a528 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:12.947290 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8b86ce48-99ef-401b-9859-e6e78c64a528 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:12.950244 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8b86ce48-99ef-401b-9859-e6e78c64a528 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:12.954722 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8b86ce48-99ef-401b-9859-e6e78c64a528 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:12.956136 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8b86ce48-99ef-401b-9859-e6e78c64a528 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:12.982528 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-94926abd-3132-41d4-aa3f-24d67fb7e945 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '.version_select at 0x7f5ae3ae4f70>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:13.133219 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-94926abd-3132-41d4-aa3f-24d67fb7e945 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1016504677" status: 202 len: 0 microversion: 2.1 time: 0.192803 Aug 31 16:30:13.146077 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3026/6037] 10.222.0.61 () {58 vars in 1221 bytes} [Wed Aug 31 16:30:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1016504677 => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:30:13.192764 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-31fd0d1e-cffb-47c7-9824-0ab408c3ed4d tempest-VolumesSnapshotsTestJSON-50744162 tempest-VolumesSnapshotsTestJSON-50744162-project] Calling method '.version_select at 0x7f5ae3ab5e50>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:13.468823 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-31fd0d1e-cffb-47c7-9824-0ab408c3ed4d tempest-VolumesSnapshotsTestJSON-50744162 tempest-VolumesSnapshotsTestJSON-50744162-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/dd161e92-1683-44a7-96c2-ee24e2efd4d2" status: 200 len: 287 microversion: 2.1 time: 0.305901 Aug 31 16:30:13.470296 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3027/6038] 10.222.0.61 () {58 vars in 1251 bytes} [Wed Aug 31 16:30:13 2022] GET /compute/v2.1/os-snapshots/dd161e92-1683-44a7-96c2-ee24e2efd4d2 => generated 287 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:30:14.535113 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-11bd6e1a-4218-49f7-8263-87e0420b23d4 tempest-VolumesSnapshotsTestJSON-50744162 tempest-VolumesSnapshotsTestJSON-50744162-project] Calling method '.version_select at 0x7f5ae3ae4ee0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:14.653371 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8b86ce48-99ef-401b-9859-e6e78c64a528 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:14.672378 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8b86ce48-99ef-401b-9859-e6e78c64a528 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:14.680393 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8b86ce48-99ef-401b-9859-e6e78c64a528 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:14.690908 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8b86ce48-99ef-401b-9859-e6e78c64a528 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8" status: 200 len: 1730 microversion: 2.20 time: 1.799867 Aug 31 16:30:14.696327 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3012/6039] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:30:12 2022] GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8 => generated 1730 bytes in 1806 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:30:14.850436 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-11bd6e1a-4218-49f7-8263-87e0420b23d4 tempest-VolumesSnapshotsTestJSON-50744162 tempest-VolumesSnapshotsTestJSON-50744162-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/dd161e92-1683-44a7-96c2-ee24e2efd4d2" status: 200 len: 287 microversion: 2.1 time: 0.354044 Aug 31 16:30:14.852439 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3028/6040] 10.222.0.61 () {58 vars in 1251 bytes} [Wed Aug 31 16:30:14 2022] GET /compute/v2.1/os-snapshots/dd161e92-1683-44a7-96c2-ee24e2efd4d2 => generated 287 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:30:15.728823 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f6514e19-c11f-4afc-8fac-3996ffde49b1 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:15.729556 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f6514e19-c11f-4afc-8fac-3996ffde49b1 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: b31fb01b-045f-41f7-bf58-66c1eca839e8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:30:15.787090 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f6514e19-c11f-4afc-8fac-3996ffde49b1 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:15.789270 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f6514e19-c11f-4afc-8fac-3996ffde49b1 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:15.798125 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f6514e19-c11f-4afc-8fac-3996ffde49b1 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:15.810802 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f6514e19-c11f-4afc-8fac-3996ffde49b1 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:15.817669 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f6514e19-c11f-4afc-8fac-3996ffde49b1 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:15.818169 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f6514e19-c11f-4afc-8fac-3996ffde49b1 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:15.870255 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ae8da305-4f21-4056-b358-0e5d338fe102 tempest-VolumesSnapshotsTestJSON-50744162 tempest-VolumesSnapshotsTestJSON-50744162-project] Calling method '.version_select at 0x7f5ae3abc670>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:16.061351 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ae8da305-4f21-4056-b358-0e5d338fe102 tempest-VolumesSnapshotsTestJSON-50744162 tempest-VolumesSnapshotsTestJSON-50744162-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/dd161e92-1683-44a7-96c2-ee24e2efd4d2" status: 200 len: 287 microversion: 2.1 time: 0.199826 Aug 31 16:30:16.061984 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3029/6041] 10.222.0.61 () {58 vars in 1251 bytes} [Wed Aug 31 16:30:15 2022] GET /compute/v2.1/os-snapshots/dd161e92-1683-44a7-96c2-ee24e2efd4d2 => generated 287 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:30:16.928601 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f6514e19-c11f-4afc-8fac-3996ffde49b1 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:16.969897 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f6514e19-c11f-4afc-8fac-3996ffde49b1 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:16.974675 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f6514e19-c11f-4afc-8fac-3996ffde49b1 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:16.981246 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f6514e19-c11f-4afc-8fac-3996ffde49b1 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8" status: 200 len: 1730 microversion: 2.20 time: 1.257792 Aug 31 16:30:16.984397 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3013/6042] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:30:15 2022] GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8 => generated 1730 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:30:17.078762 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-23b46284-dce7-4510-8648-a924fe0ea3be tempest-VolumesSnapshotsTestJSON-50744162 tempest-VolumesSnapshotsTestJSON-50744162-project] Calling method '.version_select at 0x7f5ae3ab50d0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:17.168092 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-23b46284-dce7-4510-8648-a924fe0ea3be tempest-VolumesSnapshotsTestJSON-50744162 tempest-VolumesSnapshotsTestJSON-50744162-project] HTTP exception thrown: Snapshot dd161e92-1683-44a7-96c2-ee24e2efd4d2 could not be found. Aug 31 16:30:17.182212 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-23b46284-dce7-4510-8648-a924fe0ea3be tempest-VolumesSnapshotsTestJSON-50744162 tempest-VolumesSnapshotsTestJSON-50744162-project] Request method failure captured: Aug 31 16:30:17.182212 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/os-snapshots/dd161e92-1683-44a7-96c2-ee24e2efd4d2 HTTP/1.1 Aug 31 16:30:17.182212 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:30:17.182212 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:30:17.182212 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:30:17.182212 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:30:17.182212 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:30:17.182212 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:30:17.182212 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:30:17.182212 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:30:17.182212 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4yD0UV5wmN39ln-YkwRgDDV9W9oRRP8YywR8TKRutTVJFjmDWzXxnfcLADEztFis2Wy9tCurmLryVL7F92WRKP2UZ8YXqCz3fATcYiYjB9Bh24g6deXthu32zgGFKdZVAIm6aMUEmJ6RUgDw84_prcoAY2IBmqkspXC1ZFNxfXs8xI Aug 31 16:30:17.182212 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:30:17.182212 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:30:17.182212 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:30:17.182212 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:30:17.182212 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:30:17.182212 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:30:17.182212 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 945855e9d35f407488ce73b7c8bdf392 Aug 31 16:30:17.182212 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-50744162 Aug 31 16:30:17.182212 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:30:17.182212 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:30:17.182212 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/945855e9d35f407488ce73b7c8bdf392"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/945855e9d35f407488ce73b7c8bdf392"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_945855e9d35f407488ce73b7c8bdf392", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/945855e9d35f407488ce73b7c8bdf392"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:30:17.182212 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-VolumesSnapshotsTestJSON-50744162 Aug 31 16:30:17.182212 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 945855e9d35f407488ce73b7c8bdf392 Aug 31 16:30:17.182212 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-50744162 Aug 31 16:30:17.182212 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-VolumesSnapshotsTestJSON-50744162-project Aug 31 16:30:17.182212 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:30:17.182212 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:30:17.182212 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 3c1d3ca05022459bb6f285b5e4c1feb0 Aug 31 16:30:17.182212 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-VolumesSnapshotsTestJSON-50744162-project Aug 31 16:30:17.182212 n-d-850499-9 devstack@n-api.service[122257]: method: Aug 31 16:30:17.182212 n-d-850499-9 devstack@n-api.service[122257]: exception: Snapshot dd161e92-1683-44a7-96c2-ee24e2efd4d2 could not be found. Aug 31 16:30:17.182212 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': 'dd161e92-1683-44a7-96c2-ee24e2efd4d2'} Aug 31 16:30:17.182212 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:30:17.182212 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:30:17.182212 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 31 16:30:17.182212 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 31 16:30:17.182212 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 31 16:30:17.182212 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 31 16:30:17.182212 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 31 16:30:17.182212 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 31 16:30:17.182212 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 16:30:17.182212 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 16:30:17.182212 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 16:30:17.182212 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 16:30:17.182212 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 16:30:17.182212 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 16:30:17.182212 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 16:30:17.182212 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 16:30:17.182212 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot dd161e92-1683-44a7-96c2-ee24e2efd4d2 could not be found. (HTTP 404) (Request-ID: req-76aa4561-0758-42f2-8f0f-c52590a3cc98) Aug 31 16:30:17.182212 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:30:17.182212 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:30:17.182212 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:30:17.182212 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:30:17.182212 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 31 16:30:17.182212 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 31 16:30:17.182212 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 16:30:17.182212 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 16:30:17.182212 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 31 16:30:17.182212 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 31 16:30:17.182212 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 16:30:17.182212 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 16:30:17.187159 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 31 16:30:17.187159 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 31 16:30:17.187159 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 31 16:30:17.187159 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 31 16:30:17.187159 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 31 16:30:17.187159 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 31 16:30:17.187159 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 16:30:17.187159 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 16:30:17.187159 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 16:30:17.187159 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 16:30:17.187159 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 16:30:17.187159 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 16:30:17.187159 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 16:30:17.187159 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 16:30:17.187159 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot dd161e92-1683-44a7-96c2-ee24e2efd4d2 could not be found. Aug 31 16:30:17.187159 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:30:17.187159 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:30:17.187159 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:30:17.187159 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:30:17.187159 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:30:17.187159 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:30:17.187159 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:30:17.187159 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:30:17.187159 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:30:17.187159 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:30:17.187159 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:30:17.187159 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:30:17.187159 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 31 16:30:17.187159 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:30:17.187159 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot dd161e92-1683-44a7-96c2-ee24e2efd4d2 could not be found. Aug 31 16:30:17.187159 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:30:17.187159 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:30:17.187159 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:30:17.187159 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:30:17.187159 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:30:17.187159 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:30:17.187159 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:30:17.187159 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:30:17.187159 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot dd161e92-1683-44a7-96c2-ee24e2efd4d2 could not be found. Aug 31 16:30:17.187159 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:30:17.187159 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-23b46284-dce7-4510-8648-a924fe0ea3be tempest-VolumesSnapshotsTestJSON-50744162 tempest-VolumesSnapshotsTestJSON-50744162-project] Returning 404 to user: Snapshot dd161e92-1683-44a7-96c2-ee24e2efd4d2 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:30:17.194920 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-23b46284-dce7-4510-8648-a924fe0ea3be tempest-VolumesSnapshotsTestJSON-50744162 tempest-VolumesSnapshotsTestJSON-50744162-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/dd161e92-1683-44a7-96c2-ee24e2efd4d2" status: 404 len: 111 microversion: 2.1 time: 0.119633 Aug 31 16:30:17.199901 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3030/6043] 10.222.0.61 () {58 vars in 1251 bytes} [Wed Aug 31 16:30:17 2022] GET /compute/v2.1/os-snapshots/dd161e92-1683-44a7-96c2-ee24e2efd4d2 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:30:17.216661 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8d3626c5-e247-40b7-85fd-4ed11c2cdd4b tempest-VolumesSnapshotsTestJSON-50744162 tempest-VolumesSnapshotsTestJSON-50744162-project] Calling method '.version_select at 0x7f5ae3f37790>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:17.392042 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8d3626c5-e247-40b7-85fd-4ed11c2cdd4b tempest-VolumesSnapshotsTestJSON-50744162 tempest-VolumesSnapshotsTestJSON-50744162-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/c5bc447d-0cea-4988-ba07-8baa655d635a" status: 202 len: 0 microversion: 2.1 time: 0.186103 Aug 31 16:30:17.392826 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3014/6044] 10.222.0.61 () {58 vars in 1248 bytes} [Wed Aug 31 16:30:17 2022] DELETE /compute/v2.1/os-volumes/c5bc447d-0cea-4988-ba07-8baa655d635a => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 16:30:17.403419 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4d443ef0-a417-4cb4-a79e-f5b01695e4dc tempest-VolumesSnapshotsTestJSON-50744162 tempest-VolumesSnapshotsTestJSON-50744162-project] Calling method '.version_select at 0x7f5ae3abcc10>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:17.561252 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4d443ef0-a417-4cb4-a79e-f5b01695e4dc tempest-VolumesSnapshotsTestJSON-50744162 tempest-VolumesSnapshotsTestJSON-50744162-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/c5bc447d-0cea-4988-ba07-8baa655d635a" status: 200 len: 344 microversion: 2.1 time: 0.161832 Aug 31 16:30:17.562290 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3031/6045] 10.222.0.61 () {58 vars in 1245 bytes} [Wed Aug 31 16:30:17 2022] GET /compute/v2.1/os-volumes/c5bc447d-0cea-4988-ba07-8baa655d635a => generated 344 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:30:17.603407 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7f3cdf45-dfc4-4f95-bc75-9b934ef4370a tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Action: 'create', calling method: .version_select at 0x7f5ae93cd310>, body: {"keypair": {"name": "tempest-keypair-2036783011", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLpUX4YIne8GRfU+ymzvG+RX39QXZXM/bcCZguAO4QYnTmbWWffgv4YNv6kYQkn19IltifIr0Dw7lEreDE+CrLqB3OkeBVtetsIMz0DiZpvbwTf7/FEUnQyiEdaL1xzdDA=="}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:30:17.654021 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-7f3cdf45-dfc4-4f95-bc75-9b934ef4370a tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Getting quotas for project 79d9ba3589a24faaac930a35742ce834. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:30:17.671547 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-7f3cdf45-dfc4-4f95-bc75-9b934ef4370a tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Getting quotas for user 133363b2b12d4730994557ee24f08879 and project 79d9ba3589a24faaac930a35742ce834. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:30:17.709231 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7f3cdf45-dfc4-4f95-bc75-9b934ef4370a tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.110237 Aug 31 16:30:17.728597 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3015/6046] 10.222.0.61 () {60 vars in 1159 bytes} [Wed Aug 31 16:30:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:30:18.010314 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e068cfe7-7945-4fde-95ff-45a853f87df1 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:18.010939 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e068cfe7-7945-4fde-95ff-45a853f87df1 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: b31fb01b-045f-41f7-bf58-66c1eca839e8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:30:18.024296 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e068cfe7-7945-4fde-95ff-45a853f87df1 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:18.024724 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e068cfe7-7945-4fde-95ff-45a853f87df1 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:18.025182 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e068cfe7-7945-4fde-95ff-45a853f87df1 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:18.025915 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e068cfe7-7945-4fde-95ff-45a853f87df1 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:18.033497 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e068cfe7-7945-4fde-95ff-45a853f87df1 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:18.034135 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e068cfe7-7945-4fde-95ff-45a853f87df1 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:18.576723 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-98aae3cc-c9b9-45e8-936d-ebb5d7e32c8a tempest-VolumesSnapshotsTestJSON-50744162 tempest-VolumesSnapshotsTestJSON-50744162-project] Calling method '.version_select at 0x7f5ae80e4310>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:18.824591 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-98aae3cc-c9b9-45e8-936d-ebb5d7e32c8a tempest-VolumesSnapshotsTestJSON-50744162 tempest-VolumesSnapshotsTestJSON-50744162-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/c5bc447d-0cea-4988-ba07-8baa655d635a" status: 200 len: 344 microversion: 2.1 time: 0.252013 Aug 31 16:30:18.833578 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3016/6047] 10.222.0.61 () {58 vars in 1245 bytes} [Wed Aug 31 16:30:18 2022] GET /compute/v2.1/os-volumes/c5bc447d-0cea-4988-ba07-8baa655d635a => generated 344 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:30:19.615523 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e068cfe7-7945-4fde-95ff-45a853f87df1 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:19.630298 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e068cfe7-7945-4fde-95ff-45a853f87df1 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:19.645386 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e068cfe7-7945-4fde-95ff-45a853f87df1 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:19.657671 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e068cfe7-7945-4fde-95ff-45a853f87df1 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8" status: 200 len: 1730 microversion: 2.20 time: 1.651280 Aug 31 16:30:19.677731 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3032/6048] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:30:18 2022] GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8 => generated 1730 bytes in 1672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:30:19.842538 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6751e6e4-5d68-4459-a1a8-956edc48551c tempest-VolumesSnapshotsTestJSON-50744162 tempest-VolumesSnapshotsTestJSON-50744162-project] Calling method '.version_select at 0x7f5aed263430>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:20.012230 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6751e6e4-5d68-4459-a1a8-956edc48551c tempest-VolumesSnapshotsTestJSON-50744162 tempest-VolumesSnapshotsTestJSON-50744162-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/c5bc447d-0cea-4988-ba07-8baa655d635a" status: 200 len: 344 microversion: 2.1 time: 0.175150 Aug 31 16:30:20.022297 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3017/6049] 10.222.0.61 () {58 vars in 1245 bytes} [Wed Aug 31 16:30:19 2022] GET /compute/v2.1/os-volumes/c5bc447d-0cea-4988-ba07-8baa655d635a => generated 344 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:30:20.691778 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-892ba75e-129f-4c74-b89b-cbf2966c9e50 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:20.693967 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-892ba75e-129f-4c74-b89b-cbf2966c9e50 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: b31fb01b-045f-41f7-bf58-66c1eca839e8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:30:20.710860 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-892ba75e-129f-4c74-b89b-cbf2966c9e50 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:20.715089 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-892ba75e-129f-4c74-b89b-cbf2966c9e50 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:20.716920 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-892ba75e-129f-4c74-b89b-cbf2966c9e50 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:20.719239 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-892ba75e-129f-4c74-b89b-cbf2966c9e50 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:20.720037 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-892ba75e-129f-4c74-b89b-cbf2966c9e50 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:20.723642 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-892ba75e-129f-4c74-b89b-cbf2966c9e50 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:20.962430 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-58374b61-9571-4871-b2d9-657673d50066 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-729902513", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:30:21.154812 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-892ba75e-129f-4c74-b89b-cbf2966c9e50 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:21.173662 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-892ba75e-129f-4c74-b89b-cbf2966c9e50 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:21.179169 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-892ba75e-129f-4c74-b89b-cbf2966c9e50 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:21.181313 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-892ba75e-129f-4c74-b89b-cbf2966c9e50 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8" status: 200 len: 1730 microversion: 2.20 time: 0.495609 Aug 31 16:30:21.202385 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3033/6050] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:30:20 2022] GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8 => generated 1730 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:30:21.212215 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e62739a2-2e37-45a3-98f6-7101bcaec09a tempest-VolumesSnapshotsTestJSON-50744162 tempest-VolumesSnapshotsTestJSON-50744162-project] Calling method '.version_select at 0x7f5ae3ae4e50>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:21.378139 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e62739a2-2e37-45a3-98f6-7101bcaec09a tempest-VolumesSnapshotsTestJSON-50744162 tempest-VolumesSnapshotsTestJSON-50744162-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/c5bc447d-0cea-4988-ba07-8baa655d635a" status: 200 len: 344 microversion: 2.1 time: 0.172587 Aug 31 16:30:21.379613 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3034/6051] 10.222.0.61 () {58 vars in 1245 bytes} [Wed Aug 31 16:30:21 2022] GET /compute/v2.1/os-volumes/c5bc447d-0cea-4988-ba07-8baa655d635a => generated 344 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:30:22.214601 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0b9b0c89-7086-41bc-97f4-01bfa0157a47 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:22.215881 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0b9b0c89-7086-41bc-97f4-01bfa0157a47 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: b31fb01b-045f-41f7-bf58-66c1eca839e8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:30:22.233616 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0b9b0c89-7086-41bc-97f4-01bfa0157a47 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:22.236880 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0b9b0c89-7086-41bc-97f4-01bfa0157a47 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:22.243307 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0b9b0c89-7086-41bc-97f4-01bfa0157a47 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:22.245132 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0b9b0c89-7086-41bc-97f4-01bfa0157a47 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:22.248908 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0b9b0c89-7086-41bc-97f4-01bfa0157a47 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:22.250598 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0b9b0c89-7086-41bc-97f4-01bfa0157a47 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:22.896600 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0b9b0c89-7086-41bc-97f4-01bfa0157a47 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:22.918884 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0b9b0c89-7086-41bc-97f4-01bfa0157a47 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:22.922689 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0b9b0c89-7086-41bc-97f4-01bfa0157a47 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:22.927004 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0b9b0c89-7086-41bc-97f4-01bfa0157a47 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8" status: 200 len: 1730 microversion: 2.20 time: 0.719775 Aug 31 16:30:22.929307 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3035/6052] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:30:22 2022] GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8 => generated 1730 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:30:22.937741 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e92133b7-eced-40be-b91f-5ae7c1d075c5 tempest-VolumesSnapshotsTestJSON-50744162 tempest-VolumesSnapshotsTestJSON-50744162-project] Calling method '.version_select at 0x7f5ae8e2b820>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:23.166536 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e92133b7-eced-40be-b91f-5ae7c1d075c5 tempest-VolumesSnapshotsTestJSON-50744162 tempest-VolumesSnapshotsTestJSON-50744162-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/c5bc447d-0cea-4988-ba07-8baa655d635a" status: 200 len: 344 microversion: 2.1 time: 0.235688 Aug 31 16:30:23.172701 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3036/6053] 10.222.0.61 () {58 vars in 1245 bytes} [Wed Aug 31 16:30:22 2022] GET /compute/v2.1/os-volumes/c5bc447d-0cea-4988-ba07-8baa655d635a => generated 344 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:30:23.957422 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9a51d1bf-c31e-4c7b-b24b-52c7a5372efb tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:23.958096 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9a51d1bf-c31e-4c7b-b24b-52c7a5372efb tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: b31fb01b-045f-41f7-bf58-66c1eca839e8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:30:23.960196 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:30:23.997730 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9a51d1bf-c31e-4c7b-b24b-52c7a5372efb tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:23.998521 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9a51d1bf-c31e-4c7b-b24b-52c7a5372efb tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:23.999158 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9a51d1bf-c31e-4c7b-b24b-52c7a5372efb tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:24.000140 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9a51d1bf-c31e-4c7b-b24b-52c7a5372efb tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:24.000779 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9a51d1bf-c31e-4c7b-b24b-52c7a5372efb tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:24.001918 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9a51d1bf-c31e-4c7b-b24b-52c7a5372efb tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:25.599447 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9a51d1bf-c31e-4c7b-b24b-52c7a5372efb tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:25.623232 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9a51d1bf-c31e-4c7b-b24b-52c7a5372efb tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:25.634856 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9a51d1bf-c31e-4c7b-b24b-52c7a5372efb tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:25.637570 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9a51d1bf-c31e-4c7b-b24b-52c7a5372efb tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8" status: 200 len: 1730 microversion: 2.20 time: 1.686184 Aug 31 16:30:25.656223 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3037/6054] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:30:23 2022] GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8 => generated 1730 bytes in 1705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:30:25.684106 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7f7f9756-9301-483b-9d3a-a6aebbeeb98b tempest-VolumesSnapshotsTestJSON-50744162 tempest-VolumesSnapshotsTestJSON-50744162-project] Calling method '.version_select at 0x7f5ae3bfe3a0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:25.834824 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-7f7f9756-9301-483b-9d3a-a6aebbeeb98b tempest-VolumesSnapshotsTestJSON-50744162 tempest-VolumesSnapshotsTestJSON-50744162-project] HTTP exception thrown: Volume c5bc447d-0cea-4988-ba07-8baa655d635a could not be found. Aug 31 16:30:25.836717 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7f7f9756-9301-483b-9d3a-a6aebbeeb98b tempest-VolumesSnapshotsTestJSON-50744162 tempest-VolumesSnapshotsTestJSON-50744162-project] Request method failure captured: Aug 31 16:30:25.836717 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/os-volumes/c5bc447d-0cea-4988-ba07-8baa655d635a HTTP/1.1 Aug 31 16:30:25.836717 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:30:25.836717 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:30:25.836717 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:30:25.836717 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:30:25.836717 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:30:25.836717 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:30:25.836717 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:30:25.836717 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:30:25.836717 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4yD0UV5wmN39ln-YkwRgDDV9W9oRRP8YywR8TKRutTVJFjmDWzXxnfcLADEztFis2Wy9tCurmLryVL7F92WRKP2UZ8YXqCz3fATcYiYjB9Bh24g6deXthu32zgGFKdZVAIm6aMUEmJ6RUgDw84_prcoAY2IBmqkspXC1ZFNxfXs8xI Aug 31 16:30:25.836717 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:30:25.836717 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:30:25.836717 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:30:25.836717 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:30:25.836717 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:30:25.836717 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:30:25.836717 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 945855e9d35f407488ce73b7c8bdf392 Aug 31 16:30:25.836717 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-50744162 Aug 31 16:30:25.836717 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:30:25.836717 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:30:25.836717 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/945855e9d35f407488ce73b7c8bdf392"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/945855e9d35f407488ce73b7c8bdf392"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_945855e9d35f407488ce73b7c8bdf392", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/945855e9d35f407488ce73b7c8bdf392"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:30:25.836717 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-VolumesSnapshotsTestJSON-50744162 Aug 31 16:30:25.836717 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 945855e9d35f407488ce73b7c8bdf392 Aug 31 16:30:25.836717 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-50744162 Aug 31 16:30:25.836717 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-VolumesSnapshotsTestJSON-50744162-project Aug 31 16:30:25.836717 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:30:25.836717 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:30:25.836717 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 3c1d3ca05022459bb6f285b5e4c1feb0 Aug 31 16:30:25.836717 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-VolumesSnapshotsTestJSON-50744162-project Aug 31 16:30:25.836717 n-d-850499-9 devstack@n-api.service[122257]: method: Aug 31 16:30:25.836717 n-d-850499-9 devstack@n-api.service[122257]: exception: Volume c5bc447d-0cea-4988-ba07-8baa655d635a could not be found. Aug 31 16:30:25.836717 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': 'c5bc447d-0cea-4988-ba07-8baa655d635a'} Aug 31 16:30:25.836717 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:30:25.836717 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:30:25.836717 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 16:30:25.836717 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 16:30:25.836717 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 16:30:25.836717 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 16:30:25.836717 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 16:30:25.836717 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 16:30:25.836717 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 16:30:25.836717 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 16:30:25.836717 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 16:30:25.836717 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 16:30:25.836717 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 16:30:25.836717 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 16:30:25.836717 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 16:30:25.836717 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 16:30:25.836717 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c5bc447d-0cea-4988-ba07-8baa655d635a could not be found. (HTTP 404) (Request-ID: req-ea2ddda4-0930-461e-b956-d4aafa558d9c) Aug 31 16:30:25.836717 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:30:25.836717 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:30:25.836717 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:30:25.836717 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:30:25.836717 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 31 16:30:25.836717 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 31 16:30:25.836717 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 16:30:25.836717 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 16:30:25.836717 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 16:30:25.836717 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 16:30:25.836717 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 16:30:25.836717 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 16:30:25.836717 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 16:30:25.849307 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 16:30:25.849307 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 16:30:25.849307 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 16:30:25.849307 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 16:30:25.849307 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 16:30:25.849307 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 16:30:25.849307 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 16:30:25.849307 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 16:30:25.849307 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 16:30:25.849307 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 16:30:25.849307 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 16:30:25.849307 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 16:30:25.849307 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 16:30:25.849307 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c5bc447d-0cea-4988-ba07-8baa655d635a could not be found. Aug 31 16:30:25.849307 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:30:25.849307 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:30:25.849307 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:30:25.849307 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:30:25.849307 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:30:25.849307 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:30:25.849307 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:30:25.849307 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:30:25.849307 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:30:25.849307 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:30:25.849307 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:30:25.849307 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:30:25.849307 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 31 16:30:25.849307 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:30:25.849307 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c5bc447d-0cea-4988-ba07-8baa655d635a could not be found. Aug 31 16:30:25.849307 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:30:25.849307 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:30:25.849307 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:30:25.849307 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:30:25.849307 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:30:25.849307 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:30:25.849307 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:30:25.849307 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:30:25.849307 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c5bc447d-0cea-4988-ba07-8baa655d635a could not be found. Aug 31 16:30:25.849307 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:30:25.849307 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7f7f9756-9301-483b-9d3a-a6aebbeeb98b tempest-VolumesSnapshotsTestJSON-50744162 tempest-VolumesSnapshotsTestJSON-50744162-project] Returning 404 to user: Volume c5bc447d-0cea-4988-ba07-8baa655d635a could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:30:25.849307 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7f7f9756-9301-483b-9d3a-a6aebbeeb98b tempest-VolumesSnapshotsTestJSON-50744162 tempest-VolumesSnapshotsTestJSON-50744162-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/c5bc447d-0cea-4988-ba07-8baa655d635a" status: 404 len: 109 microversion: 2.1 time: 0.177264 Aug 31 16:30:25.849307 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3038/6055] 10.222.0.61 () {58 vars in 1245 bytes} [Wed Aug 31 16:30:25 2022] GET /compute/v2.1/os-volumes/c5bc447d-0cea-4988-ba07-8baa655d635a => generated 109 bytes in 190 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:30:25.860362 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9631ec5d-8c2d-4c6f-b110-e7f3bf0c816e tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-689720441", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "11b1617b-14c9-40d6-9f52-0ad0c12edada"}], "security_groups": [{"name": "tempest-securitygroup--1948501279"}], "key_name": "tempest-keypair-2036783011", "user_data": "}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:30:26.965333 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=17 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:30:27.684085 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=4 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:30:29.537304 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-58374b61-9571-4871-b2d9-657673d50066 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] validate_networks() for None {{(pid=122256) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:30:29.922075 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-9631ec5d-8c2d-4c6f-b110-e7f3bf0c816e tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] validate_networks() for [('11b1617b-14c9-40d6-9f52-0ad0c12edada', None, None, None, None, None)] {{(pid=122257) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:30:31.007830 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:30:31.338008 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-58374b61-9571-4871-b2d9-657673d50066 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:30:31.338634 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-58374b61-9571-4871-b2d9-657673d50066 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:30:31.339236 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-58374b61-9571-4871-b2d9-657673d50066 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:30:31.339815 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-58374b61-9571-4871-b2d9-657673d50066 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:30:31.340343 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-58374b61-9571-4871-b2d9-657673d50066 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:30:31.369548 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-58374b61-9571-4871-b2d9-657673d50066 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:31.371910 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-58374b61-9571-4871-b2d9-657673d50066 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:31.373041 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-58374b61-9571-4871-b2d9-657673d50066 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:31.374615 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-58374b61-9571-4871-b2d9-657673d50066 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:31.375791 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-58374b61-9571-4871-b2d9-657673d50066 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:31.376787 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-58374b61-9571-4871-b2d9-657673d50066 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:31.412271 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-58374b61-9571-4871-b2d9-657673d50066 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Getting quotas for project 328421482a5c47c6b24ed86b0fd255b6. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:30:31.420330 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-58374b61-9571-4871-b2d9-657673d50066 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Getting quotas for user 683c03d9035c4793bd7875a41622b2d3 and project 328421482a5c47c6b24ed86b0fd255b6. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:30:31.472639 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-58374b61-9571-4871-b2d9-657673d50066 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Going to run 1 instances... {{(pid=122256) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:30:31.480870 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-58374b61-9571-4871-b2d9-657673d50066 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] [instance: 2fa574de-a7b8-4e7c-a1c1-4f8646901784] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:30:31.638549 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-58374b61-9571-4871-b2d9-657673d50066 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 10.682891 Aug 31 16:30:31.647990 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3018/6056] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:30:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 10693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 16:30:31.662855 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0a73003d-3bf7-44c4-bb9d-3e19e87b508b tempest-VolumesSnapshotsTestJSON-50744162 tempest-VolumesSnapshotsTestJSON-50744162-project] Calling method '.version_select at 0x7f5ae3da89d0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:31.796478 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-0a73003d-3bf7-44c4-bb9d-3e19e87b508b tempest-VolumesSnapshotsTestJSON-50744162 tempest-VolumesSnapshotsTestJSON-50744162-project] HTTP exception thrown: Volume c5bc447d-0cea-4988-ba07-8baa655d635a could not be found. Aug 31 16:30:31.830006 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0a73003d-3bf7-44c4-bb9d-3e19e87b508b tempest-VolumesSnapshotsTestJSON-50744162 tempest-VolumesSnapshotsTestJSON-50744162-project] Request method failure captured: Aug 31 16:30:31.830006 n-d-850499-9 devstack@n-api.service[122256]: request: DELETE /compute/v2.1/os-volumes/c5bc447d-0cea-4988-ba07-8baa655d635a HTTP/1.1 Aug 31 16:30:31.830006 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:30:31.830006 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:30:31.830006 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:30:31.830006 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:30:31.830006 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:30:31.830006 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:30:31.830006 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:30:31.830006 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:30:31.830006 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4yD0UV5wmN39ln-YkwRgDDV9W9oRRP8YywR8TKRutTVJFjmDWzXxnfcLADEztFis2Wy9tCurmLryVL7F92WRKP2UZ8YXqCz3fATcYiYjB9Bh24g6deXthu32zgGFKdZVAIm6aMUEmJ6RUgDw84_prcoAY2IBmqkspXC1ZFNxfXs8xI Aug 31 16:30:31.830006 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:30:31.830006 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:30:31.830006 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:30:31.830006 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:30:31.830006 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:30:31.830006 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:30:31.830006 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 945855e9d35f407488ce73b7c8bdf392 Aug 31 16:30:31.830006 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-50744162 Aug 31 16:30:31.830006 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:30:31.830006 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:30:31.830006 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/945855e9d35f407488ce73b7c8bdf392"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/945855e9d35f407488ce73b7c8bdf392"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_945855e9d35f407488ce73b7c8bdf392", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/945855e9d35f407488ce73b7c8bdf392"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:30:31.830006 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-VolumesSnapshotsTestJSON-50744162 Aug 31 16:30:31.830006 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 945855e9d35f407488ce73b7c8bdf392 Aug 31 16:30:31.830006 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-50744162 Aug 31 16:30:31.830006 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-VolumesSnapshotsTestJSON-50744162-project Aug 31 16:30:31.830006 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:30:31.830006 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:30:31.830006 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 3c1d3ca05022459bb6f285b5e4c1feb0 Aug 31 16:30:31.830006 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-VolumesSnapshotsTestJSON-50744162-project Aug 31 16:30:31.830006 n-d-850499-9 devstack@n-api.service[122256]: method: Aug 31 16:30:31.830006 n-d-850499-9 devstack@n-api.service[122256]: exception: Volume c5bc447d-0cea-4988-ba07-8baa655d635a could not be found. Aug 31 16:30:31.830006 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': 'c5bc447d-0cea-4988-ba07-8baa655d635a'} Aug 31 16:30:31.830006 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:30:31.830006 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:30:31.830006 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 16:30:31.830006 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 16:30:31.830006 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 16:30:31.830006 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 16:30:31.830006 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 16:30:31.830006 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 16:30:31.830006 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 16:30:31.830006 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 16:30:31.830006 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 16:30:31.830006 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 16:30:31.830006 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 16:30:31.830006 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 16:30:31.830006 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 16:30:31.830006 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 16:30:31.830006 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c5bc447d-0cea-4988-ba07-8baa655d635a could not be found. (HTTP 404) (Request-ID: req-220f2a9d-28b3-4a39-965b-793bc9d88195) Aug 31 16:30:31.830006 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:30:31.830006 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:30:31.830006 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:30:31.830006 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:30:31.830006 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 31 16:30:31.830006 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 31 16:30:31.830006 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 16:30:31.830006 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 16:30:31.830006 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 16:30:31.830006 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 16:30:31.830006 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 16:30:31.830006 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 16:30:31.830006 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 16:30:31.844822 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 16:30:31.844822 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 16:30:31.844822 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 16:30:31.844822 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 16:30:31.844822 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 16:30:31.844822 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 16:30:31.844822 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 16:30:31.844822 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 16:30:31.844822 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 16:30:31.844822 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 16:30:31.844822 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 16:30:31.844822 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 16:30:31.844822 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 16:30:31.844822 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c5bc447d-0cea-4988-ba07-8baa655d635a could not be found. Aug 31 16:30:31.844822 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:30:31.844822 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:30:31.844822 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:30:31.844822 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:30:31.844822 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:30:31.844822 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:30:31.844822 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:30:31.844822 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:30:31.844822 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:30:31.844822 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:30:31.844822 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:30:31.844822 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:30:31.844822 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 31 16:30:31.844822 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:30:31.844822 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c5bc447d-0cea-4988-ba07-8baa655d635a could not be found. Aug 31 16:30:31.844822 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:30:31.844822 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:30:31.844822 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:30:31.844822 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:30:31.844822 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:30:31.844822 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:30:31.844822 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:30:31.844822 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:30:31.844822 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c5bc447d-0cea-4988-ba07-8baa655d635a could not be found. Aug 31 16:30:31.844822 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:30:31.844822 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0a73003d-3bf7-44c4-bb9d-3e19e87b508b tempest-VolumesSnapshotsTestJSON-50744162 tempest-VolumesSnapshotsTestJSON-50744162-project] Returning 404 to user: Volume c5bc447d-0cea-4988-ba07-8baa655d635a could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:30:31.844822 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0a73003d-3bf7-44c4-bb9d-3e19e87b508b tempest-VolumesSnapshotsTestJSON-50744162 tempest-VolumesSnapshotsTestJSON-50744162-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/c5bc447d-0cea-4988-ba07-8baa655d635a" status: 404 len: 109 microversion: 2.1 time: 0.187608 Aug 31 16:30:31.856652 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3019/6057] 10.222.0.61 () {58 vars in 1248 bytes} [Wed Aug 31 16:30:31 2022] DELETE /compute/v2.1/os-volumes/c5bc447d-0cea-4988-ba07-8baa655d635a => generated 109 bytes in 206 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:30:31.881796 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c9961bb5-0e3f-458e-bd72-f636c882212f tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:31.883594 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c9961bb5-0e3f-458e-bd72-f636c882212f tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: b31fb01b-045f-41f7-bf58-66c1eca839e8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:30:31.901206 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c9961bb5-0e3f-458e-bd72-f636c882212f tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:31.903290 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c9961bb5-0e3f-458e-bd72-f636c882212f tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:31.904118 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c9961bb5-0e3f-458e-bd72-f636c882212f tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:31.905554 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c9961bb5-0e3f-458e-bd72-f636c882212f tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:31.908219 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c9961bb5-0e3f-458e-bd72-f636c882212f tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:31.909009 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c9961bb5-0e3f-458e-bd72-f636c882212f tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:33.032732 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-9631ec5d-8c2d-4c6f-b110-e7f3bf0c816e tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:30:33.035990 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-9631ec5d-8c2d-4c6f-b110-e7f3bf0c816e tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:30:33.036921 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-9631ec5d-8c2d-4c6f-b110-e7f3bf0c816e tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:30:33.037507 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-9631ec5d-8c2d-4c6f-b110-e7f3bf0c816e tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:30:33.038077 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-9631ec5d-8c2d-4c6f-b110-e7f3bf0c816e tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:30:33.069203 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9631ec5d-8c2d-4c6f-b110-e7f3bf0c816e tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:33.069710 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9631ec5d-8c2d-4c6f-b110-e7f3bf0c816e tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:33.070155 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9631ec5d-8c2d-4c6f-b110-e7f3bf0c816e tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:33.070919 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9631ec5d-8c2d-4c6f-b110-e7f3bf0c816e tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:33.071389 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9631ec5d-8c2d-4c6f-b110-e7f3bf0c816e tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:33.077162 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9631ec5d-8c2d-4c6f-b110-e7f3bf0c816e tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:33.121984 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:30:33.207421 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-9631ec5d-8c2d-4c6f-b110-e7f3bf0c816e tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Getting quotas for project 79d9ba3589a24faaac930a35742ce834. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:30:33.238079 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-9631ec5d-8c2d-4c6f-b110-e7f3bf0c816e tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Getting quotas for user 133363b2b12d4730994557ee24f08879 and project 79d9ba3589a24faaac930a35742ce834. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:30:33.313282 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9631ec5d-8c2d-4c6f-b110-e7f3bf0c816e tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Going to run 1 instances... {{(pid=122257) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:30:33.324008 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9631ec5d-8c2d-4c6f-b110-e7f3bf0c816e tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 67606165-1130-4a84-95b9-528ec49a9831] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:30:33.483922 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c9961bb5-0e3f-458e-bd72-f636c882212f tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:33.528733 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c9961bb5-0e3f-458e-bd72-f636c882212f tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:33.544061 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c9961bb5-0e3f-458e-bd72-f636c882212f tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:33.546952 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c9961bb5-0e3f-458e-bd72-f636c882212f tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8" status: 200 len: 1730 microversion: 2.20 time: 1.688814 Aug 31 16:30:33.552202 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3020/6058] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:30:31 2022] GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8 => generated 1730 bytes in 1695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:30:33.573424 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c0b5f05c-d455-4ac0-b6d7-172cdd591a77 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:33.575997 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c0b5f05c-d455-4ac0-b6d7-172cdd591a77 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] [instance: 2fa574de-a7b8-4e7c-a1c1-4f8646901784] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:30:33.614389 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c0b5f05c-d455-4ac0-b6d7-172cdd591a77 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:33.615211 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c0b5f05c-d455-4ac0-b6d7-172cdd591a77 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:33.620389 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c0b5f05c-d455-4ac0-b6d7-172cdd591a77 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:33.623272 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c0b5f05c-d455-4ac0-b6d7-172cdd591a77 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:33.624727 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c0b5f05c-d455-4ac0-b6d7-172cdd591a77 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:33.626327 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c0b5f05c-d455-4ac0-b6d7-172cdd591a77 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:33.659131 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9631ec5d-8c2d-4c6f-b110-e7f3bf0c816e tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 7.810472 Aug 31 16:30:33.668658 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3039/6059] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:30:25 2022] POST /compute/v2.1/servers => generated 402 bytes in 7821 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:30:33.691388 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c2456ca8-9b3e-4f41-809b-d8c86145719b tempest-VolumesSnapshotsTestJSON-50744162 tempest-VolumesSnapshotsTestJSON-50744162-project] Calling method '.version_select at 0x7f5ae3a4f4c0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:33.801726 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-c2456ca8-9b3e-4f41-809b-d8c86145719b tempest-VolumesSnapshotsTestJSON-50744162 tempest-VolumesSnapshotsTestJSON-50744162-project] HTTP exception thrown: Volume c5bc447d-0cea-4988-ba07-8baa655d635a could not be found. Aug 31 16:30:33.805709 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c2456ca8-9b3e-4f41-809b-d8c86145719b tempest-VolumesSnapshotsTestJSON-50744162 tempest-VolumesSnapshotsTestJSON-50744162-project] Request method failure captured: Aug 31 16:30:33.805709 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/os-volumes/c5bc447d-0cea-4988-ba07-8baa655d635a HTTP/1.1 Aug 31 16:30:33.805709 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:30:33.805709 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:30:33.805709 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:30:33.805709 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:30:33.805709 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:30:33.805709 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:30:33.805709 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:30:33.805709 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:30:33.805709 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4yD0UV5wmN39ln-YkwRgDDV9W9oRRP8YywR8TKRutTVJFjmDWzXxnfcLADEztFis2Wy9tCurmLryVL7F92WRKP2UZ8YXqCz3fATcYiYjB9Bh24g6deXthu32zgGFKdZVAIm6aMUEmJ6RUgDw84_prcoAY2IBmqkspXC1ZFNxfXs8xI Aug 31 16:30:33.805709 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:30:33.805709 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:30:33.805709 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:30:33.805709 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:30:33.805709 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:30:33.805709 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:30:33.805709 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 945855e9d35f407488ce73b7c8bdf392 Aug 31 16:30:33.805709 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-50744162 Aug 31 16:30:33.805709 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:30:33.805709 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:30:33.805709 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/945855e9d35f407488ce73b7c8bdf392"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/945855e9d35f407488ce73b7c8bdf392"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_945855e9d35f407488ce73b7c8bdf392", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/945855e9d35f407488ce73b7c8bdf392"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:30:33.805709 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-VolumesSnapshotsTestJSON-50744162 Aug 31 16:30:33.805709 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 945855e9d35f407488ce73b7c8bdf392 Aug 31 16:30:33.805709 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-50744162 Aug 31 16:30:33.805709 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-VolumesSnapshotsTestJSON-50744162-project Aug 31 16:30:33.805709 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:30:33.805709 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:30:33.805709 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 3c1d3ca05022459bb6f285b5e4c1feb0 Aug 31 16:30:33.805709 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-VolumesSnapshotsTestJSON-50744162-project Aug 31 16:30:33.805709 n-d-850499-9 devstack@n-api.service[122257]: method: Aug 31 16:30:33.805709 n-d-850499-9 devstack@n-api.service[122257]: exception: Volume c5bc447d-0cea-4988-ba07-8baa655d635a could not be found. Aug 31 16:30:33.805709 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': 'c5bc447d-0cea-4988-ba07-8baa655d635a'} Aug 31 16:30:33.805709 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:30:33.805709 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:30:33.805709 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 16:30:33.805709 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 16:30:33.805709 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 16:30:33.805709 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 16:30:33.805709 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 16:30:33.805709 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 16:30:33.805709 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 16:30:33.805709 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 16:30:33.805709 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 16:30:33.805709 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 16:30:33.805709 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 16:30:33.805709 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 16:30:33.805709 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 16:30:33.805709 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 16:30:33.805709 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c5bc447d-0cea-4988-ba07-8baa655d635a could not be found. (HTTP 404) (Request-ID: req-cd043aae-95a5-44b3-a472-fb17e1adf924) Aug 31 16:30:33.805709 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:30:33.805709 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:30:33.805709 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:30:33.805709 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:30:33.805709 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 31 16:30:33.805709 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 31 16:30:33.805709 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 16:30:33.805709 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 16:30:33.805709 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 16:30:33.805709 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 16:30:33.805709 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 16:30:33.805709 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 16:30:33.805709 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 16:30:33.811725 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 16:30:33.811725 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 16:30:33.811725 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 16:30:33.811725 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 16:30:33.811725 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 16:30:33.811725 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 16:30:33.811725 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 16:30:33.811725 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 16:30:33.811725 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 16:30:33.811725 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 16:30:33.811725 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 16:30:33.811725 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 16:30:33.811725 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 16:30:33.811725 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c5bc447d-0cea-4988-ba07-8baa655d635a could not be found. Aug 31 16:30:33.811725 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:30:33.811725 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:30:33.811725 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:30:33.811725 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:30:33.811725 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:30:33.811725 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:30:33.811725 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:30:33.811725 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:30:33.811725 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:30:33.811725 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:30:33.811725 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:30:33.811725 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:30:33.811725 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 31 16:30:33.811725 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:30:33.811725 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c5bc447d-0cea-4988-ba07-8baa655d635a could not be found. Aug 31 16:30:33.811725 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:30:33.811725 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:30:33.811725 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:30:33.811725 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:30:33.811725 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:30:33.811725 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:30:33.811725 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:30:33.811725 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:30:33.811725 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c5bc447d-0cea-4988-ba07-8baa655d635a could not be found. Aug 31 16:30:33.811725 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:30:33.811725 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c2456ca8-9b3e-4f41-809b-d8c86145719b tempest-VolumesSnapshotsTestJSON-50744162 tempest-VolumesSnapshotsTestJSON-50744162-project] Returning 404 to user: Volume c5bc447d-0cea-4988-ba07-8baa655d635a could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:30:33.811725 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c2456ca8-9b3e-4f41-809b-d8c86145719b tempest-VolumesSnapshotsTestJSON-50744162 tempest-VolumesSnapshotsTestJSON-50744162-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/c5bc447d-0cea-4988-ba07-8baa655d635a" status: 404 len: 109 microversion: 2.1 time: 0.140778 Aug 31 16:30:33.821315 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3040/6060] 10.222.0.61 () {58 vars in 1245 bytes} [Wed Aug 31 16:30:33 2022] GET /compute/v2.1/os-volumes/c5bc447d-0cea-4988-ba07-8baa655d635a => generated 109 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:30:33.842169 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-76c91b87-e79a-4a5f-a5f3-b90778d1b5a8 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:33.853677 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-76c91b87-e79a-4a5f-a5f3-b90778d1b5a8 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 67606165-1130-4a84-95b9-528ec49a9831] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:30:34.012825 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c0b5f05c-d455-4ac0-b6d7-172cdd591a77 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c03d9035c4793bd7875a41622b2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328421482a5c47c6b24ed86b0fd255b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:34.205067 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c0b5f05c-d455-4ac0-b6d7-172cdd591a77 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] 10.222.0.61 "GET /compute/v2.1/servers/2fa574de-a7b8-4e7c-a1c1-4f8646901784" status: 200 len: 1218 microversion: 2.1 time: 0.611966 Aug 31 16:30:34.205067 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3021/6061] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:30:33 2022] GET /compute/v2.1/servers/2fa574de-a7b8-4e7c-a1c1-4f8646901784 => generated 1218 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:30:34.309451 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-76c91b87-e79a-4a5f-a5f3-b90778d1b5a8 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133363b2b12d4730994557ee24f08879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d9ba3589a24faaac930a35742ce834', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:34.369433 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-76c91b87-e79a-4a5f-a5f3-b90778d1b5a8 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/67606165-1130-4a84-95b9-528ec49a9831" status: 200 len: 1241 microversion: 2.1 time: 0.533946 Aug 31 16:30:34.374555 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3041/6062] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:30:33 2022] GET /compute/v2.1/servers/67606165-1130-4a84-95b9-528ec49a9831 => generated 1241 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:30:34.584096 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-bb18ffac-737d-4c27-9802-3b9a7e08a59b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:34.586374 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-bb18ffac-737d-4c27-9802-3b9a7e08a59b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: b31fb01b-045f-41f7-bf58-66c1eca839e8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:30:34.636415 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bb18ffac-737d-4c27-9802-3b9a7e08a59b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:34.667207 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bb18ffac-737d-4c27-9802-3b9a7e08a59b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:34.680482 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bb18ffac-737d-4c27-9802-3b9a7e08a59b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:34.683285 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bb18ffac-737d-4c27-9802-3b9a7e08a59b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:34.697547 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bb18ffac-737d-4c27-9802-3b9a7e08a59b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:34.702837 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bb18ffac-737d-4c27-9802-3b9a7e08a59b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:35.261411 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4dfec5ec-46ff-4c5c-89e2-b2cf1b428f75 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:35.262419 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4dfec5ec-46ff-4c5c-89e2-b2cf1b428f75 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] [instance: 2fa574de-a7b8-4e7c-a1c1-4f8646901784] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:30:35.314001 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4dfec5ec-46ff-4c5c-89e2-b2cf1b428f75 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:35.321059 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4dfec5ec-46ff-4c5c-89e2-b2cf1b428f75 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:35.321781 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4dfec5ec-46ff-4c5c-89e2-b2cf1b428f75 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:35.327182 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4dfec5ec-46ff-4c5c-89e2-b2cf1b428f75 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:35.328105 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4dfec5ec-46ff-4c5c-89e2-b2cf1b428f75 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:35.328924 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4dfec5ec-46ff-4c5c-89e2-b2cf1b428f75 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:36.114177 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-4dfec5ec-46ff-4c5c-89e2-b2cf1b428f75 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c03d9035c4793bd7875a41622b2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328421482a5c47c6b24ed86b0fd255b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:36.157736 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4dfec5ec-46ff-4c5c-89e2-b2cf1b428f75 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] 10.222.0.61 "GET /compute/v2.1/servers/2fa574de-a7b8-4e7c-a1c1-4f8646901784" status: 200 len: 1274 microversion: 2.1 time: 0.902646 Aug 31 16:30:36.183080 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3042/6063] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:30:35 2022] GET /compute/v2.1/servers/2fa574de-a7b8-4e7c-a1c1-4f8646901784 => generated 1274 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:30:36.194931 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-72a454ff-ded8-4078-be83-3e8b60e7fd0d tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:36.201827 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-72a454ff-ded8-4078-be83-3e8b60e7fd0d tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 67606165-1130-4a84-95b9-528ec49a9831] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:30:36.216663 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-72a454ff-ded8-4078-be83-3e8b60e7fd0d tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:36.221288 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-72a454ff-ded8-4078-be83-3e8b60e7fd0d tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:36.222026 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-72a454ff-ded8-4078-be83-3e8b60e7fd0d tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:36.225472 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-72a454ff-ded8-4078-be83-3e8b60e7fd0d tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:36.225472 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-72a454ff-ded8-4078-be83-3e8b60e7fd0d tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:36.225472 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-72a454ff-ded8-4078-be83-3e8b60e7fd0d tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:36.461195 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-bb18ffac-737d-4c27-9802-3b9a7e08a59b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:36.478593 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-bb18ffac-737d-4c27-9802-3b9a7e08a59b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:36.489106 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-bb18ffac-737d-4c27-9802-3b9a7e08a59b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:36.490480 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-bb18ffac-737d-4c27-9802-3b9a7e08a59b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8" status: 200 len: 1730 microversion: 2.20 time: 1.916172 Aug 31 16:30:36.491082 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3022/6064] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:30:34 2022] GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8 => generated 1730 bytes in 1918 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:30:36.609754 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-72a454ff-ded8-4078-be83-3e8b60e7fd0d tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133363b2b12d4730994557ee24f08879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d9ba3589a24faaac930a35742ce834', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:36.639866 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-72a454ff-ded8-4078-be83-3e8b60e7fd0d tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/67606165-1130-4a84-95b9-528ec49a9831" status: 200 len: 1245 microversion: 2.1 time: 0.461551 Aug 31 16:30:36.653079 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3043/6065] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:30:36 2022] GET /compute/v2.1/servers/67606165-1130-4a84-95b9-528ec49a9831 => generated 1245 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:30:37.203556 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-dab1233c-7818-433f-9641-b7ca7f43c1db tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:37.206662 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-dab1233c-7818-433f-9641-b7ca7f43c1db tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] [instance: 2fa574de-a7b8-4e7c-a1c1-4f8646901784] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:30:37.283244 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dab1233c-7818-433f-9641-b7ca7f43c1db tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:37.286284 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dab1233c-7818-433f-9641-b7ca7f43c1db tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:37.291657 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dab1233c-7818-433f-9641-b7ca7f43c1db tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:37.315238 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dab1233c-7818-433f-9641-b7ca7f43c1db tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:37.319901 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dab1233c-7818-433f-9641-b7ca7f43c1db tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:37.323313 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dab1233c-7818-433f-9641-b7ca7f43c1db tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:37.520541 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-36b15c87-7c2d-4d09-8af7-6a40e2fcf6ce tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:37.522673 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-36b15c87-7c2d-4d09-8af7-6a40e2fcf6ce tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: b31fb01b-045f-41f7-bf58-66c1eca839e8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:30:37.555305 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-36b15c87-7c2d-4d09-8af7-6a40e2fcf6ce tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:37.557855 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-36b15c87-7c2d-4d09-8af7-6a40e2fcf6ce tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:37.559108 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-36b15c87-7c2d-4d09-8af7-6a40e2fcf6ce tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:37.563842 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-36b15c87-7c2d-4d09-8af7-6a40e2fcf6ce tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:37.565863 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-36b15c87-7c2d-4d09-8af7-6a40e2fcf6ce tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:37.566969 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-36b15c87-7c2d-4d09-8af7-6a40e2fcf6ce tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:38.016431 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-dab1233c-7818-433f-9641-b7ca7f43c1db tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c03d9035c4793bd7875a41622b2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328421482a5c47c6b24ed86b0fd255b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:38.103719 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-dab1233c-7818-433f-9641-b7ca7f43c1db tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] 10.222.0.61 "GET /compute/v2.1/servers/2fa574de-a7b8-4e7c-a1c1-4f8646901784" status: 200 len: 1272 microversion: 2.1 time: 0.904332 Aug 31 16:30:38.107263 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3023/6066] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:30:37 2022] GET /compute/v2.1/servers/2fa574de-a7b8-4e7c-a1c1-4f8646901784 => generated 1272 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:30:38.129572 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9a4ba73c-e62e-46e6-ad66-7420348d53aa tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:38.131103 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9a4ba73c-e62e-46e6-ad66-7420348d53aa tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 67606165-1130-4a84-95b9-528ec49a9831] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:30:38.178057 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9a4ba73c-e62e-46e6-ad66-7420348d53aa tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:38.182649 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9a4ba73c-e62e-46e6-ad66-7420348d53aa tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:38.183474 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9a4ba73c-e62e-46e6-ad66-7420348d53aa tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:38.186315 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9a4ba73c-e62e-46e6-ad66-7420348d53aa tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:38.190558 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9a4ba73c-e62e-46e6-ad66-7420348d53aa tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:38.194211 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9a4ba73c-e62e-46e6-ad66-7420348d53aa tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:39.702783 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-9a4ba73c-e62e-46e6-ad66-7420348d53aa tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133363b2b12d4730994557ee24f08879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d9ba3589a24faaac930a35742ce834', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:39.730824 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9a4ba73c-e62e-46e6-ad66-7420348d53aa tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/67606165-1130-4a84-95b9-528ec49a9831" status: 200 len: 1301 microversion: 2.1 time: 1.621489 Aug 31 16:30:39.739268 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3024/6067] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:30:38 2022] GET /compute/v2.1/servers/67606165-1130-4a84-95b9-528ec49a9831 => generated 1301 bytes in 1631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:30:39.759855 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-9d414073-5b3b-42d9-820b-85101d94b1dc req-f4ea8dfb-089d-4587-9ba0-4e126f9bf4ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b31fb01b-045f-41f7-bf58-66c1eca839e8", "name": "network-vif-plugged", "status": "completed", "tag": "fbb954d2-1cb6-4ea2-b226-5a233a891670"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:30:39.841715 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-9d414073-5b3b-42d9-820b-85101d94b1dc req-f4ea8dfb-089d-4587-9ba0-4e126f9bf4ee service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:39.849500 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-9d414073-5b3b-42d9-820b-85101d94b1dc req-f4ea8dfb-089d-4587-9ba0-4e126f9bf4ee service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:39.850704 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-36b15c87-7c2d-4d09-8af7-6a40e2fcf6ce tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:39.864566 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-9d414073-5b3b-42d9-820b-85101d94b1dc req-f4ea8dfb-089d-4587-9ba0-4e126f9bf4ee service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:39.907810 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-36b15c87-7c2d-4d09-8af7-6a40e2fcf6ce tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:39.910804 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-9d414073-5b3b-42d9-820b-85101d94b1dc req-f4ea8dfb-089d-4587-9ba0-4e126f9bf4ee service nova] Creating event network-vif-plugged:fbb954d2-1cb6-4ea2-b226-5a233a891670 for instance b31fb01b-045f-41f7-bf58-66c1eca839e8 on n-h1-850499-9 Aug 31 16:30:39.916361 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-36b15c87-7c2d-4d09-8af7-6a40e2fcf6ce tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:39.918785 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-36b15c87-7c2d-4d09-8af7-6a40e2fcf6ce tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8" status: 200 len: 1730 microversion: 2.20 time: 2.406010 Aug 31 16:30:39.921570 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-9d414073-5b3b-42d9-820b-85101d94b1dc req-f4ea8dfb-089d-4587-9ba0-4e126f9bf4ee service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.176426 Aug 31 16:30:39.929354 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3025/6068] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:30:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:30:39.935268 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3044/6069] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:30:37 2022] GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8 => generated 1730 bytes in 2424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:30:39.955185 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5d0bc653-08be-4169-a93e-4cfeafd55d56 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:39.956972 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5d0bc653-08be-4169-a93e-4cfeafd55d56 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] [instance: 2fa574de-a7b8-4e7c-a1c1-4f8646901784] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:30:40.002091 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5d0bc653-08be-4169-a93e-4cfeafd55d56 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:40.003666 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5d0bc653-08be-4169-a93e-4cfeafd55d56 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:40.005281 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5d0bc653-08be-4169-a93e-4cfeafd55d56 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:40.006594 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5d0bc653-08be-4169-a93e-4cfeafd55d56 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:40.007630 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5d0bc653-08be-4169-a93e-4cfeafd55d56 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:40.008892 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5d0bc653-08be-4169-a93e-4cfeafd55d56 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:40.335320 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5d0bc653-08be-4169-a93e-4cfeafd55d56 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c03d9035c4793bd7875a41622b2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328421482a5c47c6b24ed86b0fd255b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:40.361298 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5d0bc653-08be-4169-a93e-4cfeafd55d56 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] 10.222.0.61 "GET /compute/v2.1/servers/2fa574de-a7b8-4e7c-a1c1-4f8646901784" status: 200 len: 1272 microversion: 2.1 time: 0.429800 Aug 31 16:30:40.365371 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3026/6070] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:30:39 2022] GET /compute/v2.1/servers/2fa574de-a7b8-4e7c-a1c1-4f8646901784 => generated 1272 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:30:40.774539 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-da3d0929-2412-4734-b53f-3752e0c28c1c tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:40.775644 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-da3d0929-2412-4734-b53f-3752e0c28c1c tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 67606165-1130-4a84-95b9-528ec49a9831] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:30:40.787876 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-da3d0929-2412-4734-b53f-3752e0c28c1c tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:40.818661 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-da3d0929-2412-4734-b53f-3752e0c28c1c tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:40.819411 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-da3d0929-2412-4734-b53f-3752e0c28c1c tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:40.822672 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-da3d0929-2412-4734-b53f-3752e0c28c1c tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:40.824001 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-da3d0929-2412-4734-b53f-3752e0c28c1c tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:40.825078 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-da3d0929-2412-4734-b53f-3752e0c28c1c tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:40.963139 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e4555fad-97b5-4ccd-8280-eece28d5818c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:40.965559 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e4555fad-97b5-4ccd-8280-eece28d5818c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: b31fb01b-045f-41f7-bf58-66c1eca839e8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:30:40.992789 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e4555fad-97b5-4ccd-8280-eece28d5818c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:40.993785 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e4555fad-97b5-4ccd-8280-eece28d5818c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:40.994396 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e4555fad-97b5-4ccd-8280-eece28d5818c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:40.996669 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e4555fad-97b5-4ccd-8280-eece28d5818c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:40.997310 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e4555fad-97b5-4ccd-8280-eece28d5818c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:40.998621 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e4555fad-97b5-4ccd-8280-eece28d5818c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:41.389171 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:30:41.434995 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=6 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:30:42.683635 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e4555fad-97b5-4ccd-8280-eece28d5818c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:42.716858 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e4555fad-97b5-4ccd-8280-eece28d5818c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:42.728703 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e4555fad-97b5-4ccd-8280-eece28d5818c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:42.732449 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e4555fad-97b5-4ccd-8280-eece28d5818c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8" status: 200 len: 1730 microversion: 2.20 time: 1.773826 Aug 31 16:30:42.752237 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3027/6071] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:30:40 2022] GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8 => generated 1730 bytes in 1795 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:30:42.758478 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-08c91e70-5768-4ddf-82fa-3d25a75de1c5 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:42.760388 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-08c91e70-5768-4ddf-82fa-3d25a75de1c5 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] [instance: 2fa574de-a7b8-4e7c-a1c1-4f8646901784] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:30:42.776630 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-08c91e70-5768-4ddf-82fa-3d25a75de1c5 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:42.777974 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-08c91e70-5768-4ddf-82fa-3d25a75de1c5 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:42.779182 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-08c91e70-5768-4ddf-82fa-3d25a75de1c5 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:42.785650 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-08c91e70-5768-4ddf-82fa-3d25a75de1c5 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:42.800222 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-08c91e70-5768-4ddf-82fa-3d25a75de1c5 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:42.801801 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-08c91e70-5768-4ddf-82fa-3d25a75de1c5 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:43.123301 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:30:43.535053 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-08c91e70-5768-4ddf-82fa-3d25a75de1c5 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c03d9035c4793bd7875a41622b2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328421482a5c47c6b24ed86b0fd255b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:43.580745 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-08c91e70-5768-4ddf-82fa-3d25a75de1c5 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] 10.222.0.61 "GET /compute/v2.1/servers/2fa574de-a7b8-4e7c-a1c1-4f8646901784" status: 200 len: 1272 microversion: 2.1 time: 0.822071 Aug 31 16:30:43.585998 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3028/6072] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:30:42 2022] GET /compute/v2.1/servers/2fa574de-a7b8-4e7c-a1c1-4f8646901784 => generated 1272 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:30:43.697980 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-da3d0929-2412-4734-b53f-3752e0c28c1c tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133363b2b12d4730994557ee24f08879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d9ba3589a24faaac930a35742ce834', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:43.756081 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-da3d0929-2412-4734-b53f-3752e0c28c1c tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/67606165-1130-4a84-95b9-528ec49a9831" status: 200 len: 1367 microversion: 2.1 time: 2.981204 Aug 31 16:30:43.757915 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-81fd6139-fe13-4375-9ee3-c3ad3860d709 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:43.759686 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-81fd6139-fe13-4375-9ee3-c3ad3860d709 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: b31fb01b-045f-41f7-bf58-66c1eca839e8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:30:43.773838 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-81fd6139-fe13-4375-9ee3-c3ad3860d709 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:43.776982 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-81fd6139-fe13-4375-9ee3-c3ad3860d709 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:43.777761 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-81fd6139-fe13-4375-9ee3-c3ad3860d709 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:43.781989 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-81fd6139-fe13-4375-9ee3-c3ad3860d709 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:43.784556 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-81fd6139-fe13-4375-9ee3-c3ad3860d709 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:43.787018 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-81fd6139-fe13-4375-9ee3-c3ad3860d709 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:43.800447 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3045/6073] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:30:40 2022] GET /compute/v2.1/servers/67606165-1130-4a84-95b9-528ec49a9831 => generated 1367 bytes in 3031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:30:44.644900 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-918df701-d7af-42f1-9ad7-6c7e712e8df7 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:44.646655 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-918df701-d7af-42f1-9ad7-6c7e712e8df7 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] [instance: 2fa574de-a7b8-4e7c-a1c1-4f8646901784] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:30:44.750770 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=8 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:30:44.787242 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-918df701-d7af-42f1-9ad7-6c7e712e8df7 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:44.791550 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-918df701-d7af-42f1-9ad7-6c7e712e8df7 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:44.815675 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-918df701-d7af-42f1-9ad7-6c7e712e8df7 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:44.820793 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-918df701-d7af-42f1-9ad7-6c7e712e8df7 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:44.827703 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-918df701-d7af-42f1-9ad7-6c7e712e8df7 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:44.829033 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-918df701-d7af-42f1-9ad7-6c7e712e8df7 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:46.012004 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-81fd6139-fe13-4375-9ee3-c3ad3860d709 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:46.073327 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-81fd6139-fe13-4375-9ee3-c3ad3860d709 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:46.124374 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-81fd6139-fe13-4375-9ee3-c3ad3860d709 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:46.126560 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-81fd6139-fe13-4375-9ee3-c3ad3860d709 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8" status: 200 len: 1730 microversion: 2.20 time: 2.373892 Aug 31 16:30:46.163849 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3029/6074] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:30:43 2022] GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8 => generated 1730 bytes in 2400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:30:46.181425 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9a7db72b-ccb9-46cd-9fec-ace081e5aca1 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:46.182300 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9a7db72b-ccb9-46cd-9fec-ace081e5aca1 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 67606165-1130-4a84-95b9-528ec49a9831] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:30:46.206760 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9a7db72b-ccb9-46cd-9fec-ace081e5aca1 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:46.217462 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9a7db72b-ccb9-46cd-9fec-ace081e5aca1 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:46.219029 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9a7db72b-ccb9-46cd-9fec-ace081e5aca1 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:46.231523 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9a7db72b-ccb9-46cd-9fec-ace081e5aca1 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:46.238364 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9a7db72b-ccb9-46cd-9fec-ace081e5aca1 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:46.239279 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9a7db72b-ccb9-46cd-9fec-ace081e5aca1 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:46.353503 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-918df701-d7af-42f1-9ad7-6c7e712e8df7 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c03d9035c4793bd7875a41622b2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328421482a5c47c6b24ed86b0fd255b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:46.397205 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-918df701-d7af-42f1-9ad7-6c7e712e8df7 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] 10.222.0.61 "GET /compute/v2.1/servers/2fa574de-a7b8-4e7c-a1c1-4f8646901784" status: 200 len: 1314 microversion: 2.1 time: 1.779450 Aug 31 16:30:46.426557 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3046/6075] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:30:44 2022] GET /compute/v2.1/servers/2fa574de-a7b8-4e7c-a1c1-4f8646901784 => generated 1314 bytes in 1816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:30:46.935286 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-efde875e-b851-4c23-a0c1-6ec5e4f68468 req-8603eae5-e2b9-4c0e-b52b-f2c7762d52cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67606165-1130-4a84-95b9-528ec49a9831", "tag": "7afb154b-9ec1-4720-9dde-37860b970bf5"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:30:46.991962 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-efde875e-b851-4c23-a0c1-6ec5e4f68468 req-8603eae5-e2b9-4c0e-b52b-f2c7762d52cc service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:46.997509 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-efde875e-b851-4c23-a0c1-6ec5e4f68468 req-8603eae5-e2b9-4c0e-b52b-f2c7762d52cc service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:46.998609 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-efde875e-b851-4c23-a0c1-6ec5e4f68468 req-8603eae5-e2b9-4c0e-b52b-f2c7762d52cc service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:47.038894 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-efde875e-b851-4c23-a0c1-6ec5e4f68468 req-8603eae5-e2b9-4c0e-b52b-f2c7762d52cc service nova] Creating event network-changed:7afb154b-9ec1-4720-9dde-37860b970bf5 for instance 67606165-1130-4a84-95b9-528ec49a9831 on n-h1-850499-9 Aug 31 16:30:47.048625 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-efde875e-b851-4c23-a0c1-6ec5e4f68468 req-8603eae5-e2b9-4c0e-b52b-f2c7762d52cc service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.620156 Aug 31 16:30:47.050776 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3047/6076] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:30:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:30:47.184426 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-584d774f-1185-40a1-b892-5242a3c0542d tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:47.191727 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-584d774f-1185-40a1-b892-5242a3c0542d tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: b31fb01b-045f-41f7-bf58-66c1eca839e8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:30:47.216550 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-584d774f-1185-40a1-b892-5242a3c0542d tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:47.219981 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-584d774f-1185-40a1-b892-5242a3c0542d tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:47.222873 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-584d774f-1185-40a1-b892-5242a3c0542d tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:47.228407 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-584d774f-1185-40a1-b892-5242a3c0542d tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:47.231489 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-584d774f-1185-40a1-b892-5242a3c0542d tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:47.237963 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-584d774f-1185-40a1-b892-5242a3c0542d tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:47.682037 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-9a7db72b-ccb9-46cd-9fec-ace081e5aca1 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133363b2b12d4730994557ee24f08879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d9ba3589a24faaac930a35742ce834', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:47.724741 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9a7db72b-ccb9-46cd-9fec-ace081e5aca1 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/67606165-1130-4a84-95b9-528ec49a9831" status: 200 len: 1367 microversion: 2.1 time: 1.566713 Aug 31 16:30:47.725873 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3030/6077] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:30:46 2022] GET /compute/v2.1/servers/67606165-1130-4a84-95b9-528ec49a9831 => generated 1367 bytes in 1573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:30:47.748371 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1942d9b7-7e2c-45d1-96db-7f25fc53a759 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:47.756968 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1942d9b7-7e2c-45d1-96db-7f25fc53a759 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] [instance: 2fa574de-a7b8-4e7c-a1c1-4f8646901784] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:30:47.772567 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1942d9b7-7e2c-45d1-96db-7f25fc53a759 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:47.774184 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1942d9b7-7e2c-45d1-96db-7f25fc53a759 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:47.775628 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1942d9b7-7e2c-45d1-96db-7f25fc53a759 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:47.778834 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1942d9b7-7e2c-45d1-96db-7f25fc53a759 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:47.780019 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1942d9b7-7e2c-45d1-96db-7f25fc53a759 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:47.781315 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1942d9b7-7e2c-45d1-96db-7f25fc53a759 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:47.966999 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-584d774f-1185-40a1-b892-5242a3c0542d tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:47.999410 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-584d774f-1185-40a1-b892-5242a3c0542d tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:48.004022 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-584d774f-1185-40a1-b892-5242a3c0542d tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:48.007075 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-584d774f-1185-40a1-b892-5242a3c0542d tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8" status: 200 len: 1717 microversion: 2.20 time: 0.829971 Aug 31 16:30:48.008851 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3048/6078] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:30:47 2022] GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8 => generated 1717 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:30:48.134372 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1942d9b7-7e2c-45d1-96db-7f25fc53a759 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c03d9035c4793bd7875a41622b2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328421482a5c47c6b24ed86b0fd255b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:48.150890 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1942d9b7-7e2c-45d1-96db-7f25fc53a759 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] 10.222.0.61 "GET /compute/v2.1/servers/2fa574de-a7b8-4e7c-a1c1-4f8646901784" status: 200 len: 1314 microversion: 2.1 time: 0.408982 Aug 31 16:30:48.151983 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3031/6079] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:30:47 2022] GET /compute/v2.1/servers/2fa574de-a7b8-4e7c-a1c1-4f8646901784 => generated 1314 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:30:48.766358 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-953a848e-14f0-43c1-95ac-1418532710b4 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:48.769427 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-953a848e-14f0-43c1-95ac-1418532710b4 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 67606165-1130-4a84-95b9-528ec49a9831] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:30:48.792597 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-953a848e-14f0-43c1-95ac-1418532710b4 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:48.793434 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-953a848e-14f0-43c1-95ac-1418532710b4 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:48.794144 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-953a848e-14f0-43c1-95ac-1418532710b4 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:48.804385 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-953a848e-14f0-43c1-95ac-1418532710b4 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:48.805530 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-953a848e-14f0-43c1-95ac-1418532710b4 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:48.806576 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-953a848e-14f0-43c1-95ac-1418532710b4 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:49.184600 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-bf41feac-7242-42cd-a235-5124479f47cd tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:49.187295 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-bf41feac-7242-42cd-a235-5124479f47cd tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] [instance: 2fa574de-a7b8-4e7c-a1c1-4f8646901784] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:30:49.233583 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bf41feac-7242-42cd-a235-5124479f47cd tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:49.241050 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bf41feac-7242-42cd-a235-5124479f47cd tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:49.242194 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bf41feac-7242-42cd-a235-5124479f47cd tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:49.245813 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bf41feac-7242-42cd-a235-5124479f47cd tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:49.249341 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bf41feac-7242-42cd-a235-5124479f47cd tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:49.249811 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bf41feac-7242-42cd-a235-5124479f47cd tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:49.653004 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-953a848e-14f0-43c1-95ac-1418532710b4 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133363b2b12d4730994557ee24f08879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d9ba3589a24faaac930a35742ce834', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:49.667473 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-953a848e-14f0-43c1-95ac-1418532710b4 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/67606165-1130-4a84-95b9-528ec49a9831" status: 200 len: 1367 microversion: 2.1 time: 0.908143 Aug 31 16:30:49.684665 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3049/6080] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:30:48 2022] GET /compute/v2.1/servers/67606165-1130-4a84-95b9-528ec49a9831 => generated 1367 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:30:50.213456 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-bf41feac-7242-42cd-a235-5124479f47cd tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c03d9035c4793bd7875a41622b2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328421482a5c47c6b24ed86b0fd255b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:50.228068 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-bf41feac-7242-42cd-a235-5124479f47cd tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] 10.222.0.61 "GET /compute/v2.1/servers/2fa574de-a7b8-4e7c-a1c1-4f8646901784" status: 200 len: 1314 microversion: 2.1 time: 1.050947 Aug 31 16:30:50.228776 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3032/6081] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:30:49 2022] GET /compute/v2.1/servers/2fa574de-a7b8-4e7c-a1c1-4f8646901784 => generated 1314 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:30:50.703717 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c9eeb68f-e6bf-4dc4-be1d-e8a6731c6380 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:50.704700 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c9eeb68f-e6bf-4dc4-be1d-e8a6731c6380 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 67606165-1130-4a84-95b9-528ec49a9831] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:30:50.746779 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c9eeb68f-e6bf-4dc4-be1d-e8a6731c6380 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:50.747472 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c9eeb68f-e6bf-4dc4-be1d-e8a6731c6380 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:50.752533 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c9eeb68f-e6bf-4dc4-be1d-e8a6731c6380 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:50.753799 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c9eeb68f-e6bf-4dc4-be1d-e8a6731c6380 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:50.754214 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c9eeb68f-e6bf-4dc4-be1d-e8a6731c6380 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:50.754899 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c9eeb68f-e6bf-4dc4-be1d-e8a6731c6380 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:51.263929 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-fa6fa8ba-d6da-44a0-a251-a33e6a1de98b tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:51.271551 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-fa6fa8ba-d6da-44a0-a251-a33e6a1de98b tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] [instance: 2fa574de-a7b8-4e7c-a1c1-4f8646901784] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:30:51.311631 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fa6fa8ba-d6da-44a0-a251-a33e6a1de98b tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:51.312185 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fa6fa8ba-d6da-44a0-a251-a33e6a1de98b tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:51.312643 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fa6fa8ba-d6da-44a0-a251-a33e6a1de98b tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:51.313398 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fa6fa8ba-d6da-44a0-a251-a33e6a1de98b tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:51.313869 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fa6fa8ba-d6da-44a0-a251-a33e6a1de98b tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:51.315131 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fa6fa8ba-d6da-44a0-a251-a33e6a1de98b tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:51.873374 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c9eeb68f-e6bf-4dc4-be1d-e8a6731c6380 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133363b2b12d4730994557ee24f08879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d9ba3589a24faaac930a35742ce834', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:51.882243 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c9eeb68f-e6bf-4dc4-be1d-e8a6731c6380 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/67606165-1130-4a84-95b9-528ec49a9831" status: 200 len: 1367 microversion: 2.1 time: 1.192260 Aug 31 16:30:51.883189 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3050/6082] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:30:50 2022] GET /compute/v2.1/servers/67606165-1130-4a84-95b9-528ec49a9831 => generated 1367 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:30:51.888388 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-62ded4bc-9f47-45ff-8ee6-8c403b801267 req-1918505e-7776-486b-acf9-71321bf9ff1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67606165-1130-4a84-95b9-528ec49a9831", "name": "network-vif-plugged", "status": "completed", "tag": "7afb154b-9ec1-4720-9dde-37860b970bf5"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:30:51.900404 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-62ded4bc-9f47-45ff-8ee6-8c403b801267 req-1918505e-7776-486b-acf9-71321bf9ff1c service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:51.901002 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-62ded4bc-9f47-45ff-8ee6-8c403b801267 req-1918505e-7776-486b-acf9-71321bf9ff1c service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:51.901753 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-62ded4bc-9f47-45ff-8ee6-8c403b801267 req-1918505e-7776-486b-acf9-71321bf9ff1c service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:51.917819 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-62ded4bc-9f47-45ff-8ee6-8c403b801267 req-1918505e-7776-486b-acf9-71321bf9ff1c service nova] Creating event network-vif-plugged:7afb154b-9ec1-4720-9dde-37860b970bf5 for instance 67606165-1130-4a84-95b9-528ec49a9831 on n-h1-850499-9 Aug 31 16:30:51.925257 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-62ded4bc-9f47-45ff-8ee6-8c403b801267 req-1918505e-7776-486b-acf9-71321bf9ff1c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039923 Aug 31 16:30:51.926565 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3051/6083] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:30:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:30:52.169696 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-fa6fa8ba-d6da-44a0-a251-a33e6a1de98b tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c03d9035c4793bd7875a41622b2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328421482a5c47c6b24ed86b0fd255b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:52.188172 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-fa6fa8ba-d6da-44a0-a251-a33e6a1de98b tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] 10.222.0.61 "GET /compute/v2.1/servers/2fa574de-a7b8-4e7c-a1c1-4f8646901784" status: 200 len: 1314 microversion: 2.1 time: 0.931678 Aug 31 16:30:52.199611 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3033/6084] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:30:51 2022] GET /compute/v2.1/servers/2fa574de-a7b8-4e7c-a1c1-4f8646901784 => generated 1314 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:30:52.488895 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-dce30170-2b00-4db4-9131-33ed1e1c855c req-71c9e202-e4d1-4c3b-92db-ee3b156d187a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fa574de-a7b8-4e7c-a1c1-4f8646901784", "tag": "a5190e47-bdeb-4737-a542-c7e0cb95145b"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:30:52.506902 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-dce30170-2b00-4db4-9131-33ed1e1c855c req-71c9e202-e4d1-4c3b-92db-ee3b156d187a service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:52.508530 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-dce30170-2b00-4db4-9131-33ed1e1c855c req-71c9e202-e4d1-4c3b-92db-ee3b156d187a service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:52.509877 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-dce30170-2b00-4db4-9131-33ed1e1c855c req-71c9e202-e4d1-4c3b-92db-ee3b156d187a service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:52.536164 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-dce30170-2b00-4db4-9131-33ed1e1c855c req-71c9e202-e4d1-4c3b-92db-ee3b156d187a service nova] Creating event network-changed:a5190e47-bdeb-4737-a542-c7e0cb95145b for instance 2fa574de-a7b8-4e7c-a1c1-4f8646901784 on n-h1-850499-9 Aug 31 16:30:52.547053 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-dce30170-2b00-4db4-9131-33ed1e1c855c req-71c9e202-e4d1-4c3b-92db-ee3b156d187a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066081 Aug 31 16:30:52.549284 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3052/6085] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:30:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:30:52.905792 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-843bc9ff-bfdf-4cf1-a9c8-177556a64852 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:52.906742 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-843bc9ff-bfdf-4cf1-a9c8-177556a64852 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 67606165-1130-4a84-95b9-528ec49a9831] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:30:52.924519 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-843bc9ff-bfdf-4cf1-a9c8-177556a64852 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:52.925365 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-843bc9ff-bfdf-4cf1-a9c8-177556a64852 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:52.926158 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-843bc9ff-bfdf-4cf1-a9c8-177556a64852 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:52.927313 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-843bc9ff-bfdf-4cf1-a9c8-177556a64852 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:52.928170 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-843bc9ff-bfdf-4cf1-a9c8-177556a64852 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:52.930474 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-843bc9ff-bfdf-4cf1-a9c8-177556a64852 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:53.224708 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e00db3bb-13d5-4f76-870c-2eacc526afd9 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:53.226258 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e00db3bb-13d5-4f76-870c-2eacc526afd9 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] [instance: 2fa574de-a7b8-4e7c-a1c1-4f8646901784] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:30:53.241706 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e00db3bb-13d5-4f76-870c-2eacc526afd9 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:53.243961 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e00db3bb-13d5-4f76-870c-2eacc526afd9 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:53.245664 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e00db3bb-13d5-4f76-870c-2eacc526afd9 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:53.247532 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e00db3bb-13d5-4f76-870c-2eacc526afd9 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:53.248342 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e00db3bb-13d5-4f76-870c-2eacc526afd9 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:53.249990 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e00db3bb-13d5-4f76-870c-2eacc526afd9 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:53.312248 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-843bc9ff-bfdf-4cf1-a9c8-177556a64852 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133363b2b12d4730994557ee24f08879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d9ba3589a24faaac930a35742ce834', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:53.348350 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-843bc9ff-bfdf-4cf1-a9c8-177556a64852 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/67606165-1130-4a84-95b9-528ec49a9831" status: 200 len: 1367 microversion: 2.1 time: 0.447695 Aug 31 16:30:53.351090 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3034/6086] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:30:52 2022] GET /compute/v2.1/servers/67606165-1130-4a84-95b9-528ec49a9831 => generated 1367 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:30:53.953019 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e00db3bb-13d5-4f76-870c-2eacc526afd9 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c03d9035c4793bd7875a41622b2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328421482a5c47c6b24ed86b0fd255b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:53.981632 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e00db3bb-13d5-4f76-870c-2eacc526afd9 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] 10.222.0.61 "GET /compute/v2.1/servers/2fa574de-a7b8-4e7c-a1c1-4f8646901784" status: 200 len: 1314 microversion: 2.1 time: 0.760518 Aug 31 16:30:53.983472 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3053/6087] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:30:53 2022] GET /compute/v2.1/servers/2fa574de-a7b8-4e7c-a1c1-4f8646901784 => generated 1314 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:30:54.370429 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-381a6d55-81e2-410c-ba47-d14d1ab47f2d tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:54.371070 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-381a6d55-81e2-410c-ba47-d14d1ab47f2d tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 67606165-1130-4a84-95b9-528ec49a9831] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:30:54.382340 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-381a6d55-81e2-410c-ba47-d14d1ab47f2d tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:54.382839 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-381a6d55-81e2-410c-ba47-d14d1ab47f2d tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:54.398690 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-381a6d55-81e2-410c-ba47-d14d1ab47f2d tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:54.399467 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-381a6d55-81e2-410c-ba47-d14d1ab47f2d tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:54.406485 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-381a6d55-81e2-410c-ba47-d14d1ab47f2d tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:54.406951 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-381a6d55-81e2-410c-ba47-d14d1ab47f2d tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:55.013744 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5c96c84d-db45-4ac3-bc18-d1527031db08 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:55.014483 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5c96c84d-db45-4ac3-bc18-d1527031db08 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] [instance: 2fa574de-a7b8-4e7c-a1c1-4f8646901784] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:30:55.031988 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:30:55.042794 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5c96c84d-db45-4ac3-bc18-d1527031db08 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:55.045886 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5c96c84d-db45-4ac3-bc18-d1527031db08 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:55.056501 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5c96c84d-db45-4ac3-bc18-d1527031db08 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:55.071493 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5c96c84d-db45-4ac3-bc18-d1527031db08 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:55.071493 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5c96c84d-db45-4ac3-bc18-d1527031db08 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:55.071493 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5c96c84d-db45-4ac3-bc18-d1527031db08 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:55.091330 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-381a6d55-81e2-410c-ba47-d14d1ab47f2d tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133363b2b12d4730994557ee24f08879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d9ba3589a24faaac930a35742ce834', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:55.110902 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-381a6d55-81e2-410c-ba47-d14d1ab47f2d tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/67606165-1130-4a84-95b9-528ec49a9831" status: 200 len: 1557 microversion: 2.1 time: 0.744366 Aug 31 16:30:55.133364 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3035/6088] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:30:54 2022] GET /compute/v2.1/servers/67606165-1130-4a84-95b9-528ec49a9831 => generated 1557 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:30:55.157084 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-cc7c56a7-e9bb-49c1-8bbd-016a593855b1 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:55.157590 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-cc7c56a7-e9bb-49c1-8bbd-016a593855b1 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 67606165-1130-4a84-95b9-528ec49a9831] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:30:55.169161 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cc7c56a7-e9bb-49c1-8bbd-016a593855b1 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:55.169963 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cc7c56a7-e9bb-49c1-8bbd-016a593855b1 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:55.172764 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cc7c56a7-e9bb-49c1-8bbd-016a593855b1 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:55.177826 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cc7c56a7-e9bb-49c1-8bbd-016a593855b1 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:55.196553 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cc7c56a7-e9bb-49c1-8bbd-016a593855b1 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:55.197513 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cc7c56a7-e9bb-49c1-8bbd-016a593855b1 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:55.561989 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-cc7c56a7-e9bb-49c1-8bbd-016a593855b1 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/67606165-1130-4a84-95b9-528ec49a9831/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.407809 Aug 31 16:30:55.564032 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3036/6089] 10.222.0.61 () {58 vars in 1275 bytes} [Wed Aug 31 16:30:55 2022] GET /compute/v2.1/servers/67606165-1130-4a84-95b9-528ec49a9831/os-interface => generated 284 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:30:55.801543 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5c96c84d-db45-4ac3-bc18-d1527031db08 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c03d9035c4793bd7875a41622b2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328421482a5c47c6b24ed86b0fd255b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:55.815323 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5c96c84d-db45-4ac3-bc18-d1527031db08 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] 10.222.0.61 "GET /compute/v2.1/servers/2fa574de-a7b8-4e7c-a1c1-4f8646901784" status: 200 len: 1314 microversion: 2.1 time: 0.805718 Aug 31 16:30:55.828394 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3054/6090] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:30:55 2022] GET /compute/v2.1/servers/2fa574de-a7b8-4e7c-a1c1-4f8646901784 => generated 1314 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:30:56.842030 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9dc26d92-ebdc-4ff7-b11c-b60098d38eb4 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:56.843061 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9dc26d92-ebdc-4ff7-b11c-b60098d38eb4 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] [instance: 2fa574de-a7b8-4e7c-a1c1-4f8646901784] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:30:56.862212 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9dc26d92-ebdc-4ff7-b11c-b60098d38eb4 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:56.862734 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9dc26d92-ebdc-4ff7-b11c-b60098d38eb4 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:56.863181 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9dc26d92-ebdc-4ff7-b11c-b60098d38eb4 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:56.867394 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9dc26d92-ebdc-4ff7-b11c-b60098d38eb4 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:56.869423 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9dc26d92-ebdc-4ff7-b11c-b60098d38eb4 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:56.869892 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9dc26d92-ebdc-4ff7-b11c-b60098d38eb4 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:56.960726 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=100 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:30:58.377614 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-9dc26d92-ebdc-4ff7-b11c-b60098d38eb4 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c03d9035c4793bd7875a41622b2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328421482a5c47c6b24ed86b0fd255b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:58.388095 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9dc26d92-ebdc-4ff7-b11c-b60098d38eb4 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] 10.222.0.61 "GET /compute/v2.1/servers/2fa574de-a7b8-4e7c-a1c1-4f8646901784" status: 200 len: 1314 microversion: 2.1 time: 1.554362 Aug 31 16:30:58.388413 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3037/6091] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:30:56 2022] GET /compute/v2.1/servers/2fa574de-a7b8-4e7c-a1c1-4f8646901784 => generated 1314 bytes in 1557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:30:58.546405 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-3ecb5091-a934-48c6-ab9d-0fa68d78755c req-f968bfc3-7b77-450a-b113-6864306cce61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67606165-1130-4a84-95b9-528ec49a9831", "tag": "7afb154b-9ec1-4720-9dde-37860b970bf5"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:30:58.583034 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-3ecb5091-a934-48c6-ab9d-0fa68d78755c req-f968bfc3-7b77-450a-b113-6864306cce61 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:58.586062 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-3ecb5091-a934-48c6-ab9d-0fa68d78755c req-f968bfc3-7b77-450a-b113-6864306cce61 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:58.587826 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-3ecb5091-a934-48c6-ab9d-0fa68d78755c req-f968bfc3-7b77-450a-b113-6864306cce61 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:58.653349 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-3ecb5091-a934-48c6-ab9d-0fa68d78755c req-f968bfc3-7b77-450a-b113-6864306cce61 service nova] Creating event network-changed:7afb154b-9ec1-4720-9dde-37860b970bf5 for instance 67606165-1130-4a84-95b9-528ec49a9831 on n-h1-850499-9 Aug 31 16:30:58.668087 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-3ecb5091-a934-48c6-ab9d-0fa68d78755c req-f968bfc3-7b77-450a-b113-6864306cce61 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127289 Aug 31 16:30:58.677137 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3055/6092] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:30:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:30:59.414711 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a624cfd8-2652-4efb-8be1-3ab1ff38d492 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:59.415922 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a624cfd8-2652-4efb-8be1-3ab1ff38d492 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] [instance: 2fa574de-a7b8-4e7c-a1c1-4f8646901784] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:30:59.423145 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a624cfd8-2652-4efb-8be1-3ab1ff38d492 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:59.428546 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a624cfd8-2652-4efb-8be1-3ab1ff38d492 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:59.429807 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a624cfd8-2652-4efb-8be1-3ab1ff38d492 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:59.432564 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a624cfd8-2652-4efb-8be1-3ab1ff38d492 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:59.433256 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a624cfd8-2652-4efb-8be1-3ab1ff38d492 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:59.442464 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a624cfd8-2652-4efb-8be1-3ab1ff38d492 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:59.880898 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a624cfd8-2652-4efb-8be1-3ab1ff38d492 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c03d9035c4793bd7875a41622b2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328421482a5c47c6b24ed86b0fd255b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:59.893214 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a624cfd8-2652-4efb-8be1-3ab1ff38d492 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] 10.222.0.61 "GET /compute/v2.1/servers/2fa574de-a7b8-4e7c-a1c1-4f8646901784" status: 200 len: 1314 microversion: 2.1 time: 0.482020 Aug 31 16:30:59.897516 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3038/6093] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:30:59 2022] GET /compute/v2.1/servers/2fa574de-a7b8-4e7c-a1c1-4f8646901784 => generated 1314 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:31:00.945722 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-bdade524-0c4b-46fb-8b55-3cf382256b05 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:31:00.949083 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-bdade524-0c4b-46fb-8b55-3cf382256b05 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] [instance: 2fa574de-a7b8-4e7c-a1c1-4f8646901784] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:31:00.974830 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bdade524-0c4b-46fb-8b55-3cf382256b05 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:00.979718 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bdade524-0c4b-46fb-8b55-3cf382256b05 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:00.983091 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bdade524-0c4b-46fb-8b55-3cf382256b05 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:01.000665 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bdade524-0c4b-46fb-8b55-3cf382256b05 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:01.001806 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bdade524-0c4b-46fb-8b55-3cf382256b05 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:01.002828 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bdade524-0c4b-46fb-8b55-3cf382256b05 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:01.400113 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-bdade524-0c4b-46fb-8b55-3cf382256b05 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c03d9035c4793bd7875a41622b2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328421482a5c47c6b24ed86b0fd255b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:31:01.414515 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-bdade524-0c4b-46fb-8b55-3cf382256b05 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] 10.222.0.61 "GET /compute/v2.1/servers/2fa574de-a7b8-4e7c-a1c1-4f8646901784" status: 200 len: 1314 microversion: 2.1 time: 0.473896 Aug 31 16:31:01.421921 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3056/6094] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:31:00 2022] GET /compute/v2.1/servers/2fa574de-a7b8-4e7c-a1c1-4f8646901784 => generated 1314 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:31:02.445921 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-852b5d50-6c2b-4b69-9efd-da4ffd146c23 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:31:02.450280 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-852b5d50-6c2b-4b69-9efd-da4ffd146c23 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] [instance: 2fa574de-a7b8-4e7c-a1c1-4f8646901784] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:31:02.467740 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:31:02.493003 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-852b5d50-6c2b-4b69-9efd-da4ffd146c23 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:02.495912 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-852b5d50-6c2b-4b69-9efd-da4ffd146c23 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:02.498745 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-852b5d50-6c2b-4b69-9efd-da4ffd146c23 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:02.505468 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-852b5d50-6c2b-4b69-9efd-da4ffd146c23 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:02.506364 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-852b5d50-6c2b-4b69-9efd-da4ffd146c23 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:02.510627 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-852b5d50-6c2b-4b69-9efd-da4ffd146c23 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:02.936750 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-852b5d50-6c2b-4b69-9efd-da4ffd146c23 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c03d9035c4793bd7875a41622b2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328421482a5c47c6b24ed86b0fd255b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:31:02.967698 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-852b5d50-6c2b-4b69-9efd-da4ffd146c23 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] 10.222.0.61 "GET /compute/v2.1/servers/2fa574de-a7b8-4e7c-a1c1-4f8646901784" status: 200 len: 1314 microversion: 2.1 time: 0.526981 Aug 31 16:31:02.975839 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3039/6095] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:31:02 2022] GET /compute/v2.1/servers/2fa574de-a7b8-4e7c-a1c1-4f8646901784 => generated 1314 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:31:03.390334 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-6ccb6988-7ebb-439e-921f-008dc4bc975b req-afd2afa0-c0ef-4516-aba1-e695f0c9ec4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fa574de-a7b8-4e7c-a1c1-4f8646901784", "name": "network-vif-plugged", "status": "completed", "tag": "a5190e47-bdeb-4737-a542-c7e0cb95145b"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:31:03.404687 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-6ccb6988-7ebb-439e-921f-008dc4bc975b req-afd2afa0-c0ef-4516-aba1-e695f0c9ec4f service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:03.405460 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-6ccb6988-7ebb-439e-921f-008dc4bc975b req-afd2afa0-c0ef-4516-aba1-e695f0c9ec4f service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:03.406110 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-6ccb6988-7ebb-439e-921f-008dc4bc975b req-afd2afa0-c0ef-4516-aba1-e695f0c9ec4f service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:03.418352 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=76 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:31:03.420663 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-6ccb6988-7ebb-439e-921f-008dc4bc975b req-afd2afa0-c0ef-4516-aba1-e695f0c9ec4f service nova] Creating event network-vif-plugged:a5190e47-bdeb-4737-a542-c7e0cb95145b for instance 2fa574de-a7b8-4e7c-a1c1-4f8646901784 on n-h1-850499-9 Aug 31 16:31:03.428371 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-6ccb6988-7ebb-439e-921f-008dc4bc975b req-afd2afa0-c0ef-4516-aba1-e695f0c9ec4f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041807 Aug 31 16:31:03.430046 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3057/6096] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:31:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:31:04.005197 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-21194374-70e4-497f-b9d8-689bf7dbe9af tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:31:04.006795 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-21194374-70e4-497f-b9d8-689bf7dbe9af tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] [instance: 2fa574de-a7b8-4e7c-a1c1-4f8646901784] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:31:04.022608 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-21194374-70e4-497f-b9d8-689bf7dbe9af tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:04.023154 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-21194374-70e4-497f-b9d8-689bf7dbe9af tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:04.023666 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-21194374-70e4-497f-b9d8-689bf7dbe9af tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:04.027999 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-21194374-70e4-497f-b9d8-689bf7dbe9af tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:04.028533 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-21194374-70e4-497f-b9d8-689bf7dbe9af tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:04.028987 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-21194374-70e4-497f-b9d8-689bf7dbe9af tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:04.357296 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-21194374-70e4-497f-b9d8-689bf7dbe9af tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c03d9035c4793bd7875a41622b2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328421482a5c47c6b24ed86b0fd255b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:31:04.371663 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-21194374-70e4-497f-b9d8-689bf7dbe9af tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] 10.222.0.61 "GET /compute/v2.1/servers/2fa574de-a7b8-4e7c-a1c1-4f8646901784" status: 200 len: 1314 microversion: 2.1 time: 0.370219 Aug 31 16:31:04.374281 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3040/6097] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:31:03 2022] GET /compute/v2.1/servers/2fa574de-a7b8-4e7c-a1c1-4f8646901784 => generated 1314 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:31:05.406270 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-bc2106cb-3573-4545-aba5-9fe92bde57d3 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:31:05.408914 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-bc2106cb-3573-4545-aba5-9fe92bde57d3 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] [instance: 2fa574de-a7b8-4e7c-a1c1-4f8646901784] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:31:05.420577 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bc2106cb-3573-4545-aba5-9fe92bde57d3 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:05.421439 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bc2106cb-3573-4545-aba5-9fe92bde57d3 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:05.422269 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bc2106cb-3573-4545-aba5-9fe92bde57d3 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:05.424392 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bc2106cb-3573-4545-aba5-9fe92bde57d3 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:05.425203 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bc2106cb-3573-4545-aba5-9fe92bde57d3 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:05.425859 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bc2106cb-3573-4545-aba5-9fe92bde57d3 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:06.277022 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-bc2106cb-3573-4545-aba5-9fe92bde57d3 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c03d9035c4793bd7875a41622b2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328421482a5c47c6b24ed86b0fd255b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:31:06.293550 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-bc2106cb-3573-4545-aba5-9fe92bde57d3 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] 10.222.0.61 "GET /compute/v2.1/servers/2fa574de-a7b8-4e7c-a1c1-4f8646901784" status: 200 len: 1464 microversion: 2.1 time: 0.898490 Aug 31 16:31:06.295046 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3058/6098] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:31:05 2022] GET /compute/v2.1/servers/2fa574de-a7b8-4e7c-a1c1-4f8646901784 => generated 1464 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:31:06.360496 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4061e9e3-6236-49ea-8f33-a9d18db17f6a tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:31:06.362408 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4061e9e3-6236-49ea-8f33-a9d18db17f6a tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] [instance: 2fa574de-a7b8-4e7c-a1c1-4f8646901784] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:31:06.380422 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4061e9e3-6236-49ea-8f33-a9d18db17f6a tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:06.381189 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4061e9e3-6236-49ea-8f33-a9d18db17f6a tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:06.381952 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4061e9e3-6236-49ea-8f33-a9d18db17f6a tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:06.382852 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4061e9e3-6236-49ea-8f33-a9d18db17f6a tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:06.383479 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4061e9e3-6236-49ea-8f33-a9d18db17f6a tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:06.384122 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4061e9e3-6236-49ea-8f33-a9d18db17f6a tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:06.443218 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4061e9e3-6236-49ea-8f33-a9d18db17f6a tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] [instance: 2fa574de-a7b8-4e7c-a1c1-4f8646901784] Going to try to terminate instance {{(pid=122256) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:31:06.632143 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4061e9e3-6236-49ea-8f33-a9d18db17f6a tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] 10.222.0.61 "DELETE /compute/v2.1/servers/2fa574de-a7b8-4e7c-a1c1-4f8646901784" status: 204 len: 0 microversion: 2.1 time: 0.275361 Aug 31 16:31:06.633080 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3041/6099] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:31:06 2022] DELETE /compute/v2.1/servers/2fa574de-a7b8-4e7c-a1c1-4f8646901784 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:31:06.640969 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-425c5351-de9b-45af-b0ee-0d6faa708550 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:31:06.642791 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-425c5351-de9b-45af-b0ee-0d6faa708550 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] [instance: 2fa574de-a7b8-4e7c-a1c1-4f8646901784] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:31:06.651279 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-425c5351-de9b-45af-b0ee-0d6faa708550 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:06.659225 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-425c5351-de9b-45af-b0ee-0d6faa708550 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:06.664431 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-425c5351-de9b-45af-b0ee-0d6faa708550 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:06.665313 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-425c5351-de9b-45af-b0ee-0d6faa708550 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:06.665820 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-425c5351-de9b-45af-b0ee-0d6faa708550 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:06.666332 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-425c5351-de9b-45af-b0ee-0d6faa708550 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:06.978138 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-425c5351-de9b-45af-b0ee-0d6faa708550 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c03d9035c4793bd7875a41622b2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328421482a5c47c6b24ed86b0fd255b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:31:06.989532 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-425c5351-de9b-45af-b0ee-0d6faa708550 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] 10.222.0.61 "GET /compute/v2.1/servers/2fa574de-a7b8-4e7c-a1c1-4f8646901784" status: 200 len: 1470 microversion: 2.1 time: 0.352024 Aug 31 16:31:06.990400 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3059/6100] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:31:06 2022] GET /compute/v2.1/servers/2fa574de-a7b8-4e7c-a1c1-4f8646901784 => generated 1470 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:31:08.014377 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9d8811e4-7389-4998-b80c-ae299514a3c8 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:31:08.016133 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9d8811e4-7389-4998-b80c-ae299514a3c8 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] [instance: 2fa574de-a7b8-4e7c-a1c1-4f8646901784] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:31:08.032397 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9d8811e4-7389-4998-b80c-ae299514a3c8 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:08.035917 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9d8811e4-7389-4998-b80c-ae299514a3c8 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:08.036745 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9d8811e4-7389-4998-b80c-ae299514a3c8 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:08.043831 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9d8811e4-7389-4998-b80c-ae299514a3c8 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:08.044987 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9d8811e4-7389-4998-b80c-ae299514a3c8 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:08.046239 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9d8811e4-7389-4998-b80c-ae299514a3c8 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:08.395722 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-9d8811e4-7389-4998-b80c-ae299514a3c8 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c03d9035c4793bd7875a41622b2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328421482a5c47c6b24ed86b0fd255b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:31:08.405557 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9d8811e4-7389-4998-b80c-ae299514a3c8 tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] 10.222.0.61 "GET /compute/v2.1/servers/2fa574de-a7b8-4e7c-a1c1-4f8646901784" status: 200 len: 1470 microversion: 2.1 time: 0.396697 Aug 31 16:31:08.424958 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3042/6101] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:31:08 2022] GET /compute/v2.1/servers/2fa574de-a7b8-4e7c-a1c1-4f8646901784 => generated 1470 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:31:09.435439 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-cc99543d-609b-4351-b4fa-a2590d6f920a tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:31:09.452764 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-cc99543d-609b-4351-b4fa-a2590d6f920a tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] [instance: 2fa574de-a7b8-4e7c-a1c1-4f8646901784] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:31:09.469350 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cc99543d-609b-4351-b4fa-a2590d6f920a tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:09.470595 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cc99543d-609b-4351-b4fa-a2590d6f920a tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:09.471356 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cc99543d-609b-4351-b4fa-a2590d6f920a tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:09.472419 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cc99543d-609b-4351-b4fa-a2590d6f920a tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:09.473128 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cc99543d-609b-4351-b4fa-a2590d6f920a tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:09.473846 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cc99543d-609b-4351-b4fa-a2590d6f920a tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:09.512386 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-6458ec13-7706-4629-b319-370a82dc45e9 req-634a7f95-5843-4d2a-84cb-d496c4cb1fc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fa574de-a7b8-4e7c-a1c1-4f8646901784", "name": "network-vif-deleted", "tag": "a5190e47-bdeb-4737-a542-c7e0cb95145b"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:31:09.569393 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-6458ec13-7706-4629-b319-370a82dc45e9 req-634a7f95-5843-4d2a-84cb-d496c4cb1fc5 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:09.570440 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-6458ec13-7706-4629-b319-370a82dc45e9 req-634a7f95-5843-4d2a-84cb-d496c4cb1fc5 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:09.574711 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-6458ec13-7706-4629-b319-370a82dc45e9 req-634a7f95-5843-4d2a-84cb-d496c4cb1fc5 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:09.614035 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-6458ec13-7706-4629-b319-370a82dc45e9 req-634a7f95-5843-4d2a-84cb-d496c4cb1fc5 service nova] Creating event network-vif-deleted:a5190e47-bdeb-4737-a542-c7e0cb95145b for instance 2fa574de-a7b8-4e7c-a1c1-4f8646901784 on n-h1-850499-9 Aug 31 16:31:09.645589 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-6458ec13-7706-4629-b319-370a82dc45e9 req-634a7f95-5843-4d2a-84cb-d496c4cb1fc5 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140202 Aug 31 16:31:09.646722 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3043/6102] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:31:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:31:09.818406 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-cc99543d-609b-4351-b4fa-a2590d6f920a tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683c03d9035c4793bd7875a41622b2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328421482a5c47c6b24ed86b0fd255b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:31:09.842813 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-cc99543d-609b-4351-b4fa-a2590d6f920a tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] 10.222.0.61 "GET /compute/v2.1/servers/2fa574de-a7b8-4e7c-a1c1-4f8646901784" status: 200 len: 1428 microversion: 2.1 time: 0.414934 Aug 31 16:31:09.867401 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3060/6103] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:31:09 2022] GET /compute/v2.1/servers/2fa574de-a7b8-4e7c-a1c1-4f8646901784 => generated 1428 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:31:10.890492 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8135b149-ab06-4cf7-9ad1-9fadfc32fc0d tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:31:10.891371 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8135b149-ab06-4cf7-9ad1-9fadfc32fc0d tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] [instance: 2fa574de-a7b8-4e7c-a1c1-4f8646901784] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:31:10.906113 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8135b149-ab06-4cf7-9ad1-9fadfc32fc0d tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:10.906675 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8135b149-ab06-4cf7-9ad1-9fadfc32fc0d tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:10.907061 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8135b149-ab06-4cf7-9ad1-9fadfc32fc0d tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:10.908139 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8135b149-ab06-4cf7-9ad1-9fadfc32fc0d tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:10.908613 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8135b149-ab06-4cf7-9ad1-9fadfc32fc0d tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:10.909047 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8135b149-ab06-4cf7-9ad1-9fadfc32fc0d tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:10.930510 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-8135b149-ab06-4cf7-9ad1-9fadfc32fc0d tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] HTTP exception thrown: Instance 2fa574de-a7b8-4e7c-a1c1-4f8646901784 could not be found. Aug 31 16:31:10.932221 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8135b149-ab06-4cf7-9ad1-9fadfc32fc0d tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Request method failure captured: Aug 31 16:31:10.932221 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/2fa574de-a7b8-4e7c-a1c1-4f8646901784 HTTP/1.1 Aug 31 16:31:10.932221 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:31:10.932221 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:31:10.932221 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:31:10.932221 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:31:10.932221 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:31:10.932221 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:31:10.932221 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:31:10.932221 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:31:10.932221 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4yUAEcqNum0imhA9Jeny0tCPvwJCvigZICaMWgD71vDBsmHeROM5DrBT0A6c6cmQ0TblYwJwvbqGxaJmXP-t49V8vLJLBbUkGzzdB3rs7Zpoy8lSqNdT1xmXKaG-ytdB7lxDC3WGwQ-lZ1oIKcyLX-YZaHu_najMVpNLGGX3TxWkYE Aug 31 16:31:10.932221 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:31:10.932221 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:31:10.932221 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:31:10.932221 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:31:10.932221 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:31:10.932221 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:31:10.932221 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 328421482a5c47c6b24ed86b0fd255b6 Aug 31 16:31:10.932221 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-VolumesNegativeTest-1482977220 Aug 31 16:31:10.932221 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:31:10.932221 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:31:10.932221 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/328421482a5c47c6b24ed86b0fd255b6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/328421482a5c47c6b24ed86b0fd255b6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_328421482a5c47c6b24ed86b0fd255b6", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/328421482a5c47c6b24ed86b0fd255b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:31:10.932221 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-VolumesNegativeTest-1482977220 Aug 31 16:31:10.932221 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 328421482a5c47c6b24ed86b0fd255b6 Aug 31 16:31:10.932221 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-VolumesNegativeTest-1482977220 Aug 31 16:31:10.932221 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-VolumesNegativeTest-1482977220-project Aug 31 16:31:10.932221 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:31:10.932221 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:31:10.932221 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 683c03d9035c4793bd7875a41622b2d3 Aug 31 16:31:10.932221 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-VolumesNegativeTest-1482977220-project Aug 31 16:31:10.932221 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:31:10.932221 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance 2fa574de-a7b8-4e7c-a1c1-4f8646901784 could not be found. Aug 31 16:31:10.932221 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '2fa574de-a7b8-4e7c-a1c1-4f8646901784'} Aug 31 16:31:10.932221 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:31:10.932221 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:31:10.932221 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:31:10.932221 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:31:10.932221 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:31:10.932221 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:31:10.932221 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:31:10.932221 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:31:10.932221 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:31:10.932221 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:31:10.932221 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2fa574de-a7b8-4e7c-a1c1-4f8646901784 could not be found. Aug 31 16:31:10.932221 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:31:10.932221 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:31:10.932221 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:31:10.932221 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:31:10.932221 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:31:10.932221 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:31:10.932221 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:31:10.932221 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:31:10.932221 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:31:10.932221 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:31:10.932221 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:31:10.932221 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:31:10.932221 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:31:10.932221 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:31:10.932221 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:31:10.932221 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:31:10.932221 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2fa574de-a7b8-4e7c-a1c1-4f8646901784 could not be found. Aug 31 16:31:10.932221 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:31:10.932221 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:31:10.932221 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:31:10.940258 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:31:10.940258 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:31:10.940258 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:31:10.940258 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:31:10.940258 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:31:10.940258 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2fa574de-a7b8-4e7c-a1c1-4f8646901784 could not be found. Aug 31 16:31:10.940258 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:31:10.940258 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8135b149-ab06-4cf7-9ad1-9fadfc32fc0d tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] Returning 404 to user: Instance 2fa574de-a7b8-4e7c-a1c1-4f8646901784 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:31:10.940258 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8135b149-ab06-4cf7-9ad1-9fadfc32fc0d tempest-VolumesNegativeTest-1482977220 tempest-VolumesNegativeTest-1482977220-project] 10.222.0.61 "GET /compute/v2.1/servers/2fa574de-a7b8-4e7c-a1c1-4f8646901784" status: 404 len: 111 microversion: 2.1 time: 0.049687 Aug 31 16:31:10.955134 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3044/6104] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:31:10 2022] GET /compute/v2.1/servers/2fa574de-a7b8-4e7c-a1c1-4f8646901784 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 16:31:16.044906 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c4ee969f-e146-464e-888d-13628166ffd4 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-304464928", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "networks": [{"uuid": "29cf0d51-ef2e-47a2-a7b1-e3308f1b55eb"}]}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:31:16.186679 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-c4ee969f-e146-464e-888d-13628166ffd4 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] validate_networks() for [('29cf0d51-ef2e-47a2-a7b1-e3308f1b55eb', None, None, None, None, None)] {{(pid=122257) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:31:17.039871 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-c4ee969f-e146-464e-888d-13628166ffd4 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:31:17.040314 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-c4ee969f-e146-464e-888d-13628166ffd4 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:31:17.043216 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-c4ee969f-e146-464e-888d-13628166ffd4 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:31:17.043701 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-c4ee969f-e146-464e-888d-13628166ffd4 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:31:17.044136 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-c4ee969f-e146-464e-888d-13628166ffd4 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:31:17.065915 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c4ee969f-e146-464e-888d-13628166ffd4 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:17.077756 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c4ee969f-e146-464e-888d-13628166ffd4 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:17.078263 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c4ee969f-e146-464e-888d-13628166ffd4 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:17.085474 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c4ee969f-e146-464e-888d-13628166ffd4 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:17.091164 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c4ee969f-e146-464e-888d-13628166ffd4 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:17.091164 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c4ee969f-e146-464e-888d-13628166ffd4 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:17.148423 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-c4ee969f-e146-464e-888d-13628166ffd4 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Getting quotas for project ef597c49557e41f08d4f1b92dba126f5. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:31:17.160814 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-c4ee969f-e146-464e-888d-13628166ffd4 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Getting quotas for user cdc0b9eb2da5426982ab9719f48bd0a0 and project ef597c49557e41f08d4f1b92dba126f5. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:31:17.186133 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c4ee969f-e146-464e-888d-13628166ffd4 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Going to run 1 instances... {{(pid=122257) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:31:17.190253 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c4ee969f-e146-464e-888d-13628166ffd4 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] [instance: c470a4a1-e391-446d-85b5-eef6db8d10da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:31:17.350564 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c4ee969f-e146-464e-888d-13628166ffd4 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.706787 Aug 31 16:31:17.352472 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3061/6105] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:31:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1711 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:31:17.408992 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-27c3c919-c909-4d4b-a7fe-c8e5e0c48d25 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:31:17.425011 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-27c3c919-c909-4d4b-a7fe-c8e5e0c48d25 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] [instance: c470a4a1-e391-446d-85b5-eef6db8d10da] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:31:18.411468 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-27c3c919-c909-4d4b-a7fe-c8e5e0c48d25 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc0b9eb2da5426982ab9719f48bd0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef597c49557e41f08d4f1b92dba126f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:31:18.483005 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-27c3c919-c909-4d4b-a7fe-c8e5e0c48d25 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] 10.222.0.61 "GET /compute/v2.1/servers/c470a4a1-e391-446d-85b5-eef6db8d10da" status: 200 len: 1214 microversion: 2.1 time: 1.122204 Aug 31 16:31:18.494997 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3045/6106] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:31:17 2022] GET /compute/v2.1/servers/c470a4a1-e391-446d-85b5-eef6db8d10da => generated 1214 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:31:19.531190 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-df2f8612-5fd8-4916-99e8-a5f68fec2d76 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:31:19.533502 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-df2f8612-5fd8-4916-99e8-a5f68fec2d76 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] [instance: c470a4a1-e391-446d-85b5-eef6db8d10da] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:31:19.578303 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-df2f8612-5fd8-4916-99e8-a5f68fec2d76 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:19.578303 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-df2f8612-5fd8-4916-99e8-a5f68fec2d76 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:19.583322 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-df2f8612-5fd8-4916-99e8-a5f68fec2d76 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:19.584997 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-df2f8612-5fd8-4916-99e8-a5f68fec2d76 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:19.586194 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-df2f8612-5fd8-4916-99e8-a5f68fec2d76 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:19.588045 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-df2f8612-5fd8-4916-99e8-a5f68fec2d76 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:19.771841 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-df2f8612-5fd8-4916-99e8-a5f68fec2d76 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc0b9eb2da5426982ab9719f48bd0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef597c49557e41f08d4f1b92dba126f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:31:19.796163 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-df2f8612-5fd8-4916-99e8-a5f68fec2d76 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] 10.222.0.61 "GET /compute/v2.1/servers/c470a4a1-e391-446d-85b5-eef6db8d10da" status: 200 len: 1266 microversion: 2.1 time: 0.258165 Aug 31 16:31:19.798753 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3062/6107] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:31:19 2022] GET /compute/v2.1/servers/c470a4a1-e391-446d-85b5-eef6db8d10da => generated 1266 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:31:20.827861 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f52ba080-4950-4e3a-b5cc-9da78b94ba73 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:31:20.828644 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f52ba080-4950-4e3a-b5cc-9da78b94ba73 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] [instance: c470a4a1-e391-446d-85b5-eef6db8d10da] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:31:20.852442 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f52ba080-4950-4e3a-b5cc-9da78b94ba73 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:20.853015 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f52ba080-4950-4e3a-b5cc-9da78b94ba73 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:20.853618 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f52ba080-4950-4e3a-b5cc-9da78b94ba73 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:20.861700 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f52ba080-4950-4e3a-b5cc-9da78b94ba73 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:20.862486 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f52ba080-4950-4e3a-b5cc-9da78b94ba73 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:20.867569 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f52ba080-4950-4e3a-b5cc-9da78b94ba73 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:21.236843 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f52ba080-4950-4e3a-b5cc-9da78b94ba73 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc0b9eb2da5426982ab9719f48bd0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef597c49557e41f08d4f1b92dba126f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:31:21.251608 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f52ba080-4950-4e3a-b5cc-9da78b94ba73 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] 10.222.0.61 "GET /compute/v2.1/servers/c470a4a1-e391-446d-85b5-eef6db8d10da" status: 200 len: 1272 microversion: 2.1 time: 0.429107 Aug 31 16:31:21.262215 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3046/6108] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:31:20 2022] GET /compute/v2.1/servers/c470a4a1-e391-446d-85b5-eef6db8d10da => generated 1272 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:31:22.291096 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-452ac71d-e859-4a51-95f2-439cd8ae6eb1 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:31:22.292444 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-452ac71d-e859-4a51-95f2-439cd8ae6eb1 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] [instance: c470a4a1-e391-446d-85b5-eef6db8d10da] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:31:22.319936 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-452ac71d-e859-4a51-95f2-439cd8ae6eb1 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:22.321278 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-452ac71d-e859-4a51-95f2-439cd8ae6eb1 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:22.322196 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-452ac71d-e859-4a51-95f2-439cd8ae6eb1 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:22.325016 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-452ac71d-e859-4a51-95f2-439cd8ae6eb1 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:22.325905 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-452ac71d-e859-4a51-95f2-439cd8ae6eb1 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:22.329716 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-452ac71d-e859-4a51-95f2-439cd8ae6eb1 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:23.078430 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-452ac71d-e859-4a51-95f2-439cd8ae6eb1 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc0b9eb2da5426982ab9719f48bd0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef597c49557e41f08d4f1b92dba126f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:31:23.095421 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-452ac71d-e859-4a51-95f2-439cd8ae6eb1 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] 10.222.0.61 "GET /compute/v2.1/servers/c470a4a1-e391-446d-85b5-eef6db8d10da" status: 200 len: 1314 microversion: 2.1 time: 0.808729 Aug 31 16:31:23.098015 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3063/6109] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:31:22 2022] GET /compute/v2.1/servers/c470a4a1-e391-446d-85b5-eef6db8d10da => generated 1314 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:31:24.119656 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2e9efc56-9dd1-40a0-9d1c-9dbcc21d035e tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:31:24.120472 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2e9efc56-9dd1-40a0-9d1c-9dbcc21d035e tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] [instance: c470a4a1-e391-446d-85b5-eef6db8d10da] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:31:24.139281 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2e9efc56-9dd1-40a0-9d1c-9dbcc21d035e tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:24.140860 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2e9efc56-9dd1-40a0-9d1c-9dbcc21d035e tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:24.142193 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2e9efc56-9dd1-40a0-9d1c-9dbcc21d035e tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:24.147914 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2e9efc56-9dd1-40a0-9d1c-9dbcc21d035e tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:24.153203 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2e9efc56-9dd1-40a0-9d1c-9dbcc21d035e tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:24.153811 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2e9efc56-9dd1-40a0-9d1c-9dbcc21d035e tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:25.168476 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-2e9efc56-9dd1-40a0-9d1c-9dbcc21d035e tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc0b9eb2da5426982ab9719f48bd0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef597c49557e41f08d4f1b92dba126f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:31:25.181574 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2e9efc56-9dd1-40a0-9d1c-9dbcc21d035e tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] 10.222.0.61 "GET /compute/v2.1/servers/c470a4a1-e391-446d-85b5-eef6db8d10da" status: 200 len: 1314 microversion: 2.1 time: 1.067992 Aug 31 16:31:25.199747 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3047/6110] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:31:24 2022] GET /compute/v2.1/servers/c470a4a1-e391-446d-85b5-eef6db8d10da => generated 1314 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:31:25.564916 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-93a2d629-3ed7-42b2-86ee-beb1589c5b11 req-d3b2b592-20cf-4f7f-b70c-9be26d1a6a5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c470a4a1-e391-446d-85b5-eef6db8d10da", "tag": "e6c3ae68-21f8-4ef4-951a-1eec586153f1"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:31:25.591456 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:31:25.627259 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-93a2d629-3ed7-42b2-86ee-beb1589c5b11 req-d3b2b592-20cf-4f7f-b70c-9be26d1a6a5c service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:25.631175 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-93a2d629-3ed7-42b2-86ee-beb1589c5b11 req-d3b2b592-20cf-4f7f-b70c-9be26d1a6a5c service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:25.633517 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-93a2d629-3ed7-42b2-86ee-beb1589c5b11 req-d3b2b592-20cf-4f7f-b70c-9be26d1a6a5c service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:25.709020 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-93a2d629-3ed7-42b2-86ee-beb1589c5b11 req-d3b2b592-20cf-4f7f-b70c-9be26d1a6a5c service nova] Creating event network-changed:e6c3ae68-21f8-4ef4-951a-1eec586153f1 for instance c470a4a1-e391-446d-85b5-eef6db8d10da on n-h2-850499-9 Aug 31 16:31:25.743613 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-93a2d629-3ed7-42b2-86ee-beb1589c5b11 req-d3b2b592-20cf-4f7f-b70c-9be26d1a6a5c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.184758 Aug 31 16:31:25.746477 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3064/6111] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:31:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:31:26.209588 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b79b2e3b-049c-4f09-a794-931ce444c560 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:31:26.210273 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b79b2e3b-049c-4f09-a794-931ce444c560 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] [instance: c470a4a1-e391-446d-85b5-eef6db8d10da] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:31:26.246994 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b79b2e3b-049c-4f09-a794-931ce444c560 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:26.247822 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b79b2e3b-049c-4f09-a794-931ce444c560 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:26.251101 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b79b2e3b-049c-4f09-a794-931ce444c560 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:26.251902 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b79b2e3b-049c-4f09-a794-931ce444c560 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:26.258819 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b79b2e3b-049c-4f09-a794-931ce444c560 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:26.260196 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b79b2e3b-049c-4f09-a794-931ce444c560 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:27.097169 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b79b2e3b-049c-4f09-a794-931ce444c560 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc0b9eb2da5426982ab9719f48bd0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef597c49557e41f08d4f1b92dba126f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:31:27.104813 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:31:27.116105 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b79b2e3b-049c-4f09-a794-931ce444c560 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] 10.222.0.61 "GET /compute/v2.1/servers/c470a4a1-e391-446d-85b5-eef6db8d10da" status: 200 len: 1314 microversion: 2.1 time: 0.912293 Aug 31 16:31:27.122469 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3048/6112] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:31:26 2022] GET /compute/v2.1/servers/c470a4a1-e391-446d-85b5-eef6db8d10da => generated 1314 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:31:28.162971 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b2938b94-11e3-45e5-8781-1fe133ef8d0d tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:31:28.164216 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b2938b94-11e3-45e5-8781-1fe133ef8d0d tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] [instance: c470a4a1-e391-446d-85b5-eef6db8d10da] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:31:28.172283 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:31:28.174011 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=6 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:31:28.221021 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b2938b94-11e3-45e5-8781-1fe133ef8d0d tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:28.223692 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b2938b94-11e3-45e5-8781-1fe133ef8d0d tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:28.224365 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b2938b94-11e3-45e5-8781-1fe133ef8d0d tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:28.226332 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b2938b94-11e3-45e5-8781-1fe133ef8d0d tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:28.227410 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b2938b94-11e3-45e5-8781-1fe133ef8d0d tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:28.229247 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b2938b94-11e3-45e5-8781-1fe133ef8d0d tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:28.601160 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b2938b94-11e3-45e5-8781-1fe133ef8d0d tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc0b9eb2da5426982ab9719f48bd0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef597c49557e41f08d4f1b92dba126f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:31:28.622613 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b2938b94-11e3-45e5-8781-1fe133ef8d0d tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] 10.222.0.61 "GET /compute/v2.1/servers/c470a4a1-e391-446d-85b5-eef6db8d10da" status: 200 len: 1314 microversion: 2.1 time: 0.464607 Aug 31 16:31:28.624583 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3065/6113] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:31:28 2022] GET /compute/v2.1/servers/c470a4a1-e391-446d-85b5-eef6db8d10da => generated 1314 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:31:29.647686 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:31:29.656200 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-78c8beb0-746b-42ef-b2cc-270e7bd37ec7 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:31:29.659028 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-78c8beb0-746b-42ef-b2cc-270e7bd37ec7 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] [instance: c470a4a1-e391-446d-85b5-eef6db8d10da] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:31:29.688333 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-78c8beb0-746b-42ef-b2cc-270e7bd37ec7 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:29.693370 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-78c8beb0-746b-42ef-b2cc-270e7bd37ec7 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:29.697281 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-78c8beb0-746b-42ef-b2cc-270e7bd37ec7 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:29.699333 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-78c8beb0-746b-42ef-b2cc-270e7bd37ec7 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:29.699895 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-78c8beb0-746b-42ef-b2cc-270e7bd37ec7 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:29.702936 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-78c8beb0-746b-42ef-b2cc-270e7bd37ec7 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:29.999260 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-78c8beb0-746b-42ef-b2cc-270e7bd37ec7 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc0b9eb2da5426982ab9719f48bd0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef597c49557e41f08d4f1b92dba126f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:31:30.009401 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-78c8beb0-746b-42ef-b2cc-270e7bd37ec7 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] 10.222.0.61 "GET /compute/v2.1/servers/c470a4a1-e391-446d-85b5-eef6db8d10da" status: 200 len: 1314 microversion: 2.1 time: 0.364568 Aug 31 16:31:30.010814 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3049/6114] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:31:29 2022] GET /compute/v2.1/servers/c470a4a1-e391-446d-85b5-eef6db8d10da => generated 1314 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:31:31.049910 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8b1724ff-0b12-4656-95d9-a2e98b06db77 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:31:31.050718 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8b1724ff-0b12-4656-95d9-a2e98b06db77 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] [instance: c470a4a1-e391-446d-85b5-eef6db8d10da] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:31:31.063970 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b1724ff-0b12-4656-95d9-a2e98b06db77 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:31.064660 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b1724ff-0b12-4656-95d9-a2e98b06db77 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:31.074549 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b1724ff-0b12-4656-95d9-a2e98b06db77 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:31.075681 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b1724ff-0b12-4656-95d9-a2e98b06db77 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:31.076171 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b1724ff-0b12-4656-95d9-a2e98b06db77 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:31.077437 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b1724ff-0b12-4656-95d9-a2e98b06db77 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:31.480444 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8b1724ff-0b12-4656-95d9-a2e98b06db77 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc0b9eb2da5426982ab9719f48bd0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef597c49557e41f08d4f1b92dba126f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:31:31.502739 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8b1724ff-0b12-4656-95d9-a2e98b06db77 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] 10.222.0.61 "GET /compute/v2.1/servers/c470a4a1-e391-446d-85b5-eef6db8d10da" status: 200 len: 1314 microversion: 2.1 time: 0.457766 Aug 31 16:31:31.508719 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3066/6115] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:31:31 2022] GET /compute/v2.1/servers/c470a4a1-e391-446d-85b5-eef6db8d10da => generated 1314 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:31:32.530587 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a9fb6704-b020-4ebf-94a3-0a238b513a35 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:31:32.534639 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a9fb6704-b020-4ebf-94a3-0a238b513a35 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] [instance: c470a4a1-e391-446d-85b5-eef6db8d10da] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:31:32.538816 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:31:32.558223 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a9fb6704-b020-4ebf-94a3-0a238b513a35 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:32.558736 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a9fb6704-b020-4ebf-94a3-0a238b513a35 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:32.559210 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a9fb6704-b020-4ebf-94a3-0a238b513a35 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:32.559959 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a9fb6704-b020-4ebf-94a3-0a238b513a35 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:32.560424 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a9fb6704-b020-4ebf-94a3-0a238b513a35 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:32.560854 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a9fb6704-b020-4ebf-94a3-0a238b513a35 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:32.858915 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a9fb6704-b020-4ebf-94a3-0a238b513a35 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc0b9eb2da5426982ab9719f48bd0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef597c49557e41f08d4f1b92dba126f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:31:32.877132 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a9fb6704-b020-4ebf-94a3-0a238b513a35 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] 10.222.0.61 "GET /compute/v2.1/servers/c470a4a1-e391-446d-85b5-eef6db8d10da" status: 200 len: 1314 microversion: 2.1 time: 0.346767 Aug 31 16:31:32.877575 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3050/6116] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:31:32 2022] GET /compute/v2.1/servers/c470a4a1-e391-446d-85b5-eef6db8d10da => generated 1314 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:31:33.898889 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-001f8bdd-5178-41b4-b568-362bc9dd93e4 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:31:33.900052 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-001f8bdd-5178-41b4-b568-362bc9dd93e4 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] [instance: c470a4a1-e391-446d-85b5-eef6db8d10da] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:31:33.919528 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-001f8bdd-5178-41b4-b568-362bc9dd93e4 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:33.920367 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-001f8bdd-5178-41b4-b568-362bc9dd93e4 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:33.921136 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-001f8bdd-5178-41b4-b568-362bc9dd93e4 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:33.922454 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-001f8bdd-5178-41b4-b568-362bc9dd93e4 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:33.928060 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-001f8bdd-5178-41b4-b568-362bc9dd93e4 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:33.935678 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-001f8bdd-5178-41b4-b568-362bc9dd93e4 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:34.404638 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-001f8bdd-5178-41b4-b568-362bc9dd93e4 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc0b9eb2da5426982ab9719f48bd0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef597c49557e41f08d4f1b92dba126f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:31:34.416818 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-001f8bdd-5178-41b4-b568-362bc9dd93e4 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] 10.222.0.61 "GET /compute/v2.1/servers/c470a4a1-e391-446d-85b5-eef6db8d10da" status: 200 len: 1314 microversion: 2.1 time: 0.522610 Aug 31 16:31:34.433959 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3067/6117] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:31:33 2022] GET /compute/v2.1/servers/c470a4a1-e391-446d-85b5-eef6db8d10da => generated 1314 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:31:34.610555 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-3d063e79-5ff7-4bda-b3c4-e5d6a7348ae4 req-2285ebcf-95fb-48bd-8067-02fd9e542476 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c470a4a1-e391-446d-85b5-eef6db8d10da", "name": "network-vif-plugged", "status": "completed", "tag": "e6c3ae68-21f8-4ef4-951a-1eec586153f1"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:31:34.653292 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-3d063e79-5ff7-4bda-b3c4-e5d6a7348ae4 req-2285ebcf-95fb-48bd-8067-02fd9e542476 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:34.656244 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-3d063e79-5ff7-4bda-b3c4-e5d6a7348ae4 req-2285ebcf-95fb-48bd-8067-02fd9e542476 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:34.659244 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-3d063e79-5ff7-4bda-b3c4-e5d6a7348ae4 req-2285ebcf-95fb-48bd-8067-02fd9e542476 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:34.698822 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-3d063e79-5ff7-4bda-b3c4-e5d6a7348ae4 req-2285ebcf-95fb-48bd-8067-02fd9e542476 service nova] Creating event network-vif-plugged:e6c3ae68-21f8-4ef4-951a-1eec586153f1 for instance c470a4a1-e391-446d-85b5-eef6db8d10da on n-h2-850499-9 Aug 31 16:31:34.712528 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-3d063e79-5ff7-4bda-b3c4-e5d6a7348ae4 req-2285ebcf-95fb-48bd-8067-02fd9e542476 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105952 Aug 31 16:31:34.715546 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3051/6118] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:31:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:31:35.438699 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8733aa4e-f687-4e66-a85a-278b7bee25d2 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:31:35.456244 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8733aa4e-f687-4e66-a85a-278b7bee25d2 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] [instance: c470a4a1-e391-446d-85b5-eef6db8d10da] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:31:35.459317 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8733aa4e-f687-4e66-a85a-278b7bee25d2 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:35.463570 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8733aa4e-f687-4e66-a85a-278b7bee25d2 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:35.464023 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8733aa4e-f687-4e66-a85a-278b7bee25d2 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:35.464785 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8733aa4e-f687-4e66-a85a-278b7bee25d2 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:35.465274 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8733aa4e-f687-4e66-a85a-278b7bee25d2 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:35.465715 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8733aa4e-f687-4e66-a85a-278b7bee25d2 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:35.504698 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=54 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:31:35.958189 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8733aa4e-f687-4e66-a85a-278b7bee25d2 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc0b9eb2da5426982ab9719f48bd0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef597c49557e41f08d4f1b92dba126f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:31:35.971092 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8733aa4e-f687-4e66-a85a-278b7bee25d2 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] 10.222.0.61 "GET /compute/v2.1/servers/c470a4a1-e391-446d-85b5-eef6db8d10da" status: 200 len: 1314 microversion: 2.1 time: 0.536649 Aug 31 16:31:36.006772 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3068/6119] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:31:35 2022] GET /compute/v2.1/servers/c470a4a1-e391-446d-85b5-eef6db8d10da => generated 1314 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:31:37.004622 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ff3d544a-2811-46a9-9d2a-62069ab4fa62 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:31:37.006106 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ff3d544a-2811-46a9-9d2a-62069ab4fa62 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] [instance: c470a4a1-e391-446d-85b5-eef6db8d10da] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:31:37.031177 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ff3d544a-2811-46a9-9d2a-62069ab4fa62 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:37.034440 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ff3d544a-2811-46a9-9d2a-62069ab4fa62 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:37.037528 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ff3d544a-2811-46a9-9d2a-62069ab4fa62 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:37.042339 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ff3d544a-2811-46a9-9d2a-62069ab4fa62 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:37.042874 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ff3d544a-2811-46a9-9d2a-62069ab4fa62 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:37.046327 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ff3d544a-2811-46a9-9d2a-62069ab4fa62 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:37.458655 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ff3d544a-2811-46a9-9d2a-62069ab4fa62 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc0b9eb2da5426982ab9719f48bd0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef597c49557e41f08d4f1b92dba126f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:31:37.470850 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ff3d544a-2811-46a9-9d2a-62069ab4fa62 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] 10.222.0.61 "GET /compute/v2.1/servers/c470a4a1-e391-446d-85b5-eef6db8d10da" status: 200 len: 1500 microversion: 2.1 time: 0.471349 Aug 31 16:31:37.482264 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3052/6120] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:31:36 2022] GET /compute/v2.1/servers/c470a4a1-e391-446d-85b5-eef6db8d10da => generated 1500 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:31:37.505280 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d74be3c8-af00-44a8-bc59-b155f693fc5d tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:31:37.516427 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d74be3c8-af00-44a8-bc59-b155f693fc5d tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] [instance: c470a4a1-e391-446d-85b5-eef6db8d10da] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:31:37.535362 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d74be3c8-af00-44a8-bc59-b155f693fc5d tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:37.536562 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d74be3c8-af00-44a8-bc59-b155f693fc5d tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:37.539338 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d74be3c8-af00-44a8-bc59-b155f693fc5d tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:37.541137 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d74be3c8-af00-44a8-bc59-b155f693fc5d tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:37.543491 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d74be3c8-af00-44a8-bc59-b155f693fc5d tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:37.547615 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d74be3c8-af00-44a8-bc59-b155f693fc5d tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:38.227260 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d74be3c8-af00-44a8-bc59-b155f693fc5d tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc0b9eb2da5426982ab9719f48bd0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef597c49557e41f08d4f1b92dba126f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:31:38.238806 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d74be3c8-af00-44a8-bc59-b155f693fc5d tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] 10.222.0.61 "GET /compute/v2.1/servers/c470a4a1-e391-446d-85b5-eef6db8d10da" status: 200 len: 1500 microversion: 2.1 time: 0.739869 Aug 31 16:31:38.243176 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3069/6121] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:31:37 2022] GET /compute/v2.1/servers/c470a4a1-e391-446d-85b5-eef6db8d10da => generated 1500 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:31:38.262388 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-58dbad70-9dda-4c13-b034-2e629f10656e tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:31:38.264225 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-58dbad70-9dda-4c13-b034-2e629f10656e tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] [instance: c470a4a1-e391-446d-85b5-eef6db8d10da] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:31:38.274648 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-58dbad70-9dda-4c13-b034-2e629f10656e tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:38.275537 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-58dbad70-9dda-4c13-b034-2e629f10656e tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:38.276359 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-58dbad70-9dda-4c13-b034-2e629f10656e tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:38.277352 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-58dbad70-9dda-4c13-b034-2e629f10656e tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:38.278264 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-58dbad70-9dda-4c13-b034-2e629f10656e tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:38.279017 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-58dbad70-9dda-4c13-b034-2e629f10656e tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:38.314396 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-58dbad70-9dda-4c13-b034-2e629f10656e tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lazy-loading 'flavor' on Instance uuid c470a4a1-e391-446d-85b5-eef6db8d10da {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:31:38.494889 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-58dbad70-9dda-4c13-b034-2e629f10656e tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] 10.222.0.61 "POST /compute/v2.1/servers/c470a4a1-e391-446d-85b5-eef6db8d10da/action" status: 202 len: 0 microversion: 2.1 time: 0.236903 Aug 31 16:31:38.503303 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3053/6122] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:31:38 2022] POST /compute/v2.1/servers/c470a4a1-e391-446d-85b5-eef6db8d10da/action => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:31:38.525709 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b3d4fd2b-fc48-467c-a4e5-6da688c30db4 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:31:38.526950 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b3d4fd2b-fc48-467c-a4e5-6da688c30db4 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] [instance: c470a4a1-e391-446d-85b5-eef6db8d10da] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:31:38.570758 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b3d4fd2b-fc48-467c-a4e5-6da688c30db4 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:38.573750 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b3d4fd2b-fc48-467c-a4e5-6da688c30db4 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:38.575423 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b3d4fd2b-fc48-467c-a4e5-6da688c30db4 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:38.577178 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b3d4fd2b-fc48-467c-a4e5-6da688c30db4 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:38.579371 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b3d4fd2b-fc48-467c-a4e5-6da688c30db4 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:38.584707 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b3d4fd2b-fc48-467c-a4e5-6da688c30db4 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:38.969081 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b3d4fd2b-fc48-467c-a4e5-6da688c30db4 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc0b9eb2da5426982ab9719f48bd0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef597c49557e41f08d4f1b92dba126f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:31:38.983216 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b3d4fd2b-fc48-467c-a4e5-6da688c30db4 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] 10.222.0.61 "GET /compute/v2.1/servers/c470a4a1-e391-446d-85b5-eef6db8d10da" status: 200 len: 1508 microversion: 2.1 time: 0.475066 Aug 31 16:31:38.983858 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3070/6123] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:31:38 2022] GET /compute/v2.1/servers/c470a4a1-e391-446d-85b5-eef6db8d10da => generated 1508 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:31:40.009175 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-08a83e8b-61f2-489c-8203-56c73384aff1 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:31:40.009915 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-08a83e8b-61f2-489c-8203-56c73384aff1 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] [instance: c470a4a1-e391-446d-85b5-eef6db8d10da] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:31:40.026886 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-08a83e8b-61f2-489c-8203-56c73384aff1 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:40.029739 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-08a83e8b-61f2-489c-8203-56c73384aff1 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:40.030445 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-08a83e8b-61f2-489c-8203-56c73384aff1 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:40.032926 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-08a83e8b-61f2-489c-8203-56c73384aff1 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:40.033565 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-08a83e8b-61f2-489c-8203-56c73384aff1 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:40.035928 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-08a83e8b-61f2-489c-8203-56c73384aff1 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:40.603122 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-08a83e8b-61f2-489c-8203-56c73384aff1 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc0b9eb2da5426982ab9719f48bd0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef597c49557e41f08d4f1b92dba126f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:31:40.621658 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-08a83e8b-61f2-489c-8203-56c73384aff1 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] 10.222.0.61 "GET /compute/v2.1/servers/c470a4a1-e391-446d-85b5-eef6db8d10da" status: 200 len: 1491 microversion: 2.1 time: 0.617497 Aug 31 16:31:40.623389 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3054/6124] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:31:39 2022] GET /compute/v2.1/servers/c470a4a1-e391-446d-85b5-eef6db8d10da => generated 1491 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:31:40.644593 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c78c5989-200c-4ea3-b0d4-49fa692d4674 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:31:40.645144 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c78c5989-200c-4ea3-b0d4-49fa692d4674 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] [instance: c470a4a1-e391-446d-85b5-eef6db8d10da] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:31:40.662669 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c78c5989-200c-4ea3-b0d4-49fa692d4674 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:40.662669 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c78c5989-200c-4ea3-b0d4-49fa692d4674 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:40.662669 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c78c5989-200c-4ea3-b0d4-49fa692d4674 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:40.664273 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c78c5989-200c-4ea3-b0d4-49fa692d4674 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:40.667311 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c78c5989-200c-4ea3-b0d4-49fa692d4674 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:40.667975 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c78c5989-200c-4ea3-b0d4-49fa692d4674 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:40.811355 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c78c5989-200c-4ea3-b0d4-49fa692d4674 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] 10.222.0.61 "POST /compute/v2.1/servers/c470a4a1-e391-446d-85b5-eef6db8d10da/action" status: 202 len: 0 microversion: 2.1 time: 0.171741 Aug 31 16:31:40.813672 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3071/6125] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:31:40 2022] POST /compute/v2.1/servers/c470a4a1-e391-446d-85b5-eef6db8d10da/action => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:31:40.826806 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ac8eef56-0bd0-402a-9e75-976a79a34ae6 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:31:40.827650 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ac8eef56-0bd0-402a-9e75-976a79a34ae6 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] [instance: c470a4a1-e391-446d-85b5-eef6db8d10da] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:31:40.838069 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ac8eef56-0bd0-402a-9e75-976a79a34ae6 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:40.839512 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ac8eef56-0bd0-402a-9e75-976a79a34ae6 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:40.841332 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ac8eef56-0bd0-402a-9e75-976a79a34ae6 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:40.842351 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ac8eef56-0bd0-402a-9e75-976a79a34ae6 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:40.844063 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ac8eef56-0bd0-402a-9e75-976a79a34ae6 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:40.844716 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ac8eef56-0bd0-402a-9e75-976a79a34ae6 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:41.280943 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ac8eef56-0bd0-402a-9e75-976a79a34ae6 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc0b9eb2da5426982ab9719f48bd0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef597c49557e41f08d4f1b92dba126f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:31:41.295269 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ac8eef56-0bd0-402a-9e75-976a79a34ae6 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] 10.222.0.61 "GET /compute/v2.1/servers/c470a4a1-e391-446d-85b5-eef6db8d10da" status: 200 len: 1497 microversion: 2.1 time: 0.474435 Aug 31 16:31:41.296247 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3055/6126] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:31:40 2022] GET /compute/v2.1/servers/c470a4a1-e391-446d-85b5-eef6db8d10da => generated 1497 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:31:42.337461 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-749e7ea4-3f43-431b-9637-83ed8321136c tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:31:42.339057 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-749e7ea4-3f43-431b-9637-83ed8321136c tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] [instance: c470a4a1-e391-446d-85b5-eef6db8d10da] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:31:42.349307 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-749e7ea4-3f43-431b-9637-83ed8321136c tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:42.350169 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-749e7ea4-3f43-431b-9637-83ed8321136c tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:42.350867 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-749e7ea4-3f43-431b-9637-83ed8321136c tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:42.351829 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-749e7ea4-3f43-431b-9637-83ed8321136c tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:42.352493 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-749e7ea4-3f43-431b-9637-83ed8321136c tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:42.353116 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-749e7ea4-3f43-431b-9637-83ed8321136c tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:42.696854 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-749e7ea4-3f43-431b-9637-83ed8321136c tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc0b9eb2da5426982ab9719f48bd0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef597c49557e41f08d4f1b92dba126f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:31:42.715031 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-749e7ea4-3f43-431b-9637-83ed8321136c tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] 10.222.0.61 "GET /compute/v2.1/servers/c470a4a1-e391-446d-85b5-eef6db8d10da" status: 200 len: 1497 microversion: 2.1 time: 0.385427 Aug 31 16:31:42.741158 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3072/6127] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:31:42 2022] GET /compute/v2.1/servers/c470a4a1-e391-446d-85b5-eef6db8d10da => generated 1497 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:31:43.741515 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-111cc257-769c-4758-9e06-d46010997f32 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:31:43.742132 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-111cc257-769c-4758-9e06-d46010997f32 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] [instance: c470a4a1-e391-446d-85b5-eef6db8d10da] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:31:43.757729 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-111cc257-769c-4758-9e06-d46010997f32 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:43.758436 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-111cc257-769c-4758-9e06-d46010997f32 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:43.761338 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-111cc257-769c-4758-9e06-d46010997f32 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:43.763087 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-111cc257-769c-4758-9e06-d46010997f32 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:43.765657 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-111cc257-769c-4758-9e06-d46010997f32 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:43.795819 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-111cc257-769c-4758-9e06-d46010997f32 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:44.377557 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-111cc257-769c-4758-9e06-d46010997f32 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc0b9eb2da5426982ab9719f48bd0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef597c49557e41f08d4f1b92dba126f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:31:44.388957 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-111cc257-769c-4758-9e06-d46010997f32 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] 10.222.0.61 "GET /compute/v2.1/servers/c470a4a1-e391-446d-85b5-eef6db8d10da" status: 200 len: 1500 microversion: 2.1 time: 0.651779 Aug 31 16:31:44.392538 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3056/6128] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:31:43 2022] GET /compute/v2.1/servers/c470a4a1-e391-446d-85b5-eef6db8d10da => generated 1500 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:31:44.417458 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-24cc6bd5-d44a-4ae7-b5c2-78f6606b364b tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:31:44.418002 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-24cc6bd5-d44a-4ae7-b5c2-78f6606b364b tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] [instance: c470a4a1-e391-446d-85b5-eef6db8d10da] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:31:44.430495 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-24cc6bd5-d44a-4ae7-b5c2-78f6606b364b tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:44.431004 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-24cc6bd5-d44a-4ae7-b5c2-78f6606b364b tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:44.435583 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-24cc6bd5-d44a-4ae7-b5c2-78f6606b364b tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:44.436396 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-24cc6bd5-d44a-4ae7-b5c2-78f6606b364b tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:44.437255 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-24cc6bd5-d44a-4ae7-b5c2-78f6606b364b tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:44.438485 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-24cc6bd5-d44a-4ae7-b5c2-78f6606b364b tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:44.470870 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-24cc6bd5-d44a-4ae7-b5c2-78f6606b364b tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lazy-loading 'flavor' on Instance uuid c470a4a1-e391-446d-85b5-eef6db8d10da {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:31:44.637578 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-24cc6bd5-d44a-4ae7-b5c2-78f6606b364b tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] 10.222.0.61 "POST /compute/v2.1/servers/c470a4a1-e391-446d-85b5-eef6db8d10da/action" status: 202 len: 0 microversion: 2.1 time: 0.224106 Aug 31 16:31:44.639228 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3073/6129] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:31:44 2022] POST /compute/v2.1/servers/c470a4a1-e391-446d-85b5-eef6db8d10da/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:31:44.653770 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-64a720b2-b53d-4660-ad84-424b97a2728e tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:31:44.658357 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-64a720b2-b53d-4660-ad84-424b97a2728e tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] [instance: c470a4a1-e391-446d-85b5-eef6db8d10da] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:31:44.673629 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-64a720b2-b53d-4660-ad84-424b97a2728e tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:44.674072 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-64a720b2-b53d-4660-ad84-424b97a2728e tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:44.674519 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-64a720b2-b53d-4660-ad84-424b97a2728e tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:44.683058 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-64a720b2-b53d-4660-ad84-424b97a2728e tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:44.684463 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-64a720b2-b53d-4660-ad84-424b97a2728e tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:44.686894 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-64a720b2-b53d-4660-ad84-424b97a2728e tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:45.237936 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-64a720b2-b53d-4660-ad84-424b97a2728e tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc0b9eb2da5426982ab9719f48bd0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef597c49557e41f08d4f1b92dba126f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:31:45.251795 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-64a720b2-b53d-4660-ad84-424b97a2728e tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] 10.222.0.61 "GET /compute/v2.1/servers/c470a4a1-e391-446d-85b5-eef6db8d10da" status: 200 len: 1508 microversion: 2.1 time: 0.608411 Aug 31 16:31:45.270400 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3057/6130] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:31:44 2022] GET /compute/v2.1/servers/c470a4a1-e391-446d-85b5-eef6db8d10da => generated 1508 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:31:46.290205 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8ca267f6-7610-4a45-8fa6-bef15d44cc25 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:31:46.293186 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8ca267f6-7610-4a45-8fa6-bef15d44cc25 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] [instance: c470a4a1-e391-446d-85b5-eef6db8d10da] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:31:46.331722 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8ca267f6-7610-4a45-8fa6-bef15d44cc25 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:46.334640 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8ca267f6-7610-4a45-8fa6-bef15d44cc25 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:46.336515 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8ca267f6-7610-4a45-8fa6-bef15d44cc25 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:46.337504 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8ca267f6-7610-4a45-8fa6-bef15d44cc25 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:46.338195 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8ca267f6-7610-4a45-8fa6-bef15d44cc25 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:46.338994 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8ca267f6-7610-4a45-8fa6-bef15d44cc25 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:46.784137 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8ca267f6-7610-4a45-8fa6-bef15d44cc25 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc0b9eb2da5426982ab9719f48bd0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef597c49557e41f08d4f1b92dba126f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:31:46.807533 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8ca267f6-7610-4a45-8fa6-bef15d44cc25 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] 10.222.0.61 "GET /compute/v2.1/servers/c470a4a1-e391-446d-85b5-eef6db8d10da" status: 200 len: 1491 microversion: 2.1 time: 0.530905 Aug 31 16:31:46.810649 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3074/6131] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:31:46 2022] GET /compute/v2.1/servers/c470a4a1-e391-446d-85b5-eef6db8d10da => generated 1491 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:31:46.839051 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-31ca55b3-9a02-4e0b-9daf-49317660e15c tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:31:46.840336 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-31ca55b3-9a02-4e0b-9daf-49317660e15c tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] [instance: c470a4a1-e391-446d-85b5-eef6db8d10da] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:31:46.857739 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-31ca55b3-9a02-4e0b-9daf-49317660e15c tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:46.863871 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-31ca55b3-9a02-4e0b-9daf-49317660e15c tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:46.864529 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-31ca55b3-9a02-4e0b-9daf-49317660e15c tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:46.867057 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-31ca55b3-9a02-4e0b-9daf-49317660e15c tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:46.867816 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-31ca55b3-9a02-4e0b-9daf-49317660e15c tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:46.870349 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-31ca55b3-9a02-4e0b-9daf-49317660e15c tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:47.088219 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-31ca55b3-9a02-4e0b-9daf-49317660e15c tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] 10.222.0.61 "POST /compute/v2.1/servers/c470a4a1-e391-446d-85b5-eef6db8d10da/action" status: 202 len: 0 microversion: 2.1 time: 0.254839 Aug 31 16:31:47.089265 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3058/6132] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:31:46 2022] POST /compute/v2.1/servers/c470a4a1-e391-446d-85b5-eef6db8d10da/action => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:31:47.100873 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e89c6a9a-84b6-4562-bc37-40cadc9f5346 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:31:47.101722 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e89c6a9a-84b6-4562-bc37-40cadc9f5346 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] [instance: c470a4a1-e391-446d-85b5-eef6db8d10da] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:31:47.135762 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e89c6a9a-84b6-4562-bc37-40cadc9f5346 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:47.139006 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e89c6a9a-84b6-4562-bc37-40cadc9f5346 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:47.140207 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e89c6a9a-84b6-4562-bc37-40cadc9f5346 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:47.145694 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e89c6a9a-84b6-4562-bc37-40cadc9f5346 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:47.151692 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e89c6a9a-84b6-4562-bc37-40cadc9f5346 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:47.152190 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e89c6a9a-84b6-4562-bc37-40cadc9f5346 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:48.285347 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e89c6a9a-84b6-4562-bc37-40cadc9f5346 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc0b9eb2da5426982ab9719f48bd0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef597c49557e41f08d4f1b92dba126f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:31:48.306321 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e89c6a9a-84b6-4562-bc37-40cadc9f5346 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] 10.222.0.61 "GET /compute/v2.1/servers/c470a4a1-e391-446d-85b5-eef6db8d10da" status: 200 len: 1497 microversion: 2.1 time: 1.207233 Aug 31 16:31:48.309278 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3075/6133] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:31:47 2022] GET /compute/v2.1/servers/c470a4a1-e391-446d-85b5-eef6db8d10da => generated 1497 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:31:49.336172 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6840b551-bda6-4bce-8125-2143b6d7229d tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:31:49.336983 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6840b551-bda6-4bce-8125-2143b6d7229d tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] [instance: c470a4a1-e391-446d-85b5-eef6db8d10da] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:31:49.351763 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6840b551-bda6-4bce-8125-2143b6d7229d tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:49.352794 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6840b551-bda6-4bce-8125-2143b6d7229d tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:49.354686 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6840b551-bda6-4bce-8125-2143b6d7229d tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:49.355597 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6840b551-bda6-4bce-8125-2143b6d7229d tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:49.356955 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6840b551-bda6-4bce-8125-2143b6d7229d tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:49.360982 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6840b551-bda6-4bce-8125-2143b6d7229d tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:49.430837 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-189acc86-7e14-4643-be6e-af9846679aee tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:31:49.431883 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-189acc86-7e14-4643-be6e-af9846679aee tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] [instance: c7eaf35b-26b9-4011-8dc8-d5f48201f17e] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:31:49.447104 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-189acc86-7e14-4643-be6e-af9846679aee tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:49.449276 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-189acc86-7e14-4643-be6e-af9846679aee tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:49.452130 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-189acc86-7e14-4643-be6e-af9846679aee tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:49.453846 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-189acc86-7e14-4643-be6e-af9846679aee tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:49.455274 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-189acc86-7e14-4643-be6e-af9846679aee tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:49.457242 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-189acc86-7e14-4643-be6e-af9846679aee tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:49.592459 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-189acc86-7e14-4643-be6e-af9846679aee tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Lazy-loading 'services' on Instance uuid c7eaf35b-26b9-4011-8dc8-d5f48201f17e {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:31:49.716191 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-6840b551-bda6-4bce-8125-2143b6d7229d tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc0b9eb2da5426982ab9719f48bd0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef597c49557e41f08d4f1b92dba126f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:31:49.722393 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-189acc86-7e14-4643-be6e-af9846679aee tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] 10.222.0.61 "DELETE /compute/v2.1/servers/c7eaf35b-26b9-4011-8dc8-d5f48201f17e/os-volume_attachments/ad20bd49-57da-41bf-8fc2-85d0b207bea9" status: 202 len: 0 microversion: 2.1 time: 0.292829 Aug 31 16:31:49.725979 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3076/6134] 10.222.0.61 () {58 vars in 1416 bytes} [Wed Aug 31 16:31:49 2022] DELETE /compute/v2.1/servers/c7eaf35b-26b9-4011-8dc8-d5f48201f17e/os-volume_attachments/ad20bd49-57da-41bf-8fc2-85d0b207bea9 => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:31:49.728585 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6840b551-bda6-4bce-8125-2143b6d7229d tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] 10.222.0.61 "GET /compute/v2.1/servers/c470a4a1-e391-446d-85b5-eef6db8d10da" status: 200 len: 1497 microversion: 2.1 time: 0.400371 Aug 31 16:31:49.730715 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3059/6135] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:31:49 2022] GET /compute/v2.1/servers/c470a4a1-e391-446d-85b5-eef6db8d10da => generated 1497 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:31:50.751767 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-843ad6f0-2126-46bf-8754-c3195c5c647d tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:31:50.752491 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-843ad6f0-2126-46bf-8754-c3195c5c647d tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] [instance: c470a4a1-e391-446d-85b5-eef6db8d10da] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:31:50.762748 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-843ad6f0-2126-46bf-8754-c3195c5c647d tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:50.763261 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-843ad6f0-2126-46bf-8754-c3195c5c647d tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:50.763741 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-843ad6f0-2126-46bf-8754-c3195c5c647d tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:50.774953 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-843ad6f0-2126-46bf-8754-c3195c5c647d tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:50.775590 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-843ad6f0-2126-46bf-8754-c3195c5c647d tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:50.776049 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-843ad6f0-2126-46bf-8754-c3195c5c647d tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:51.304318 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-843ad6f0-2126-46bf-8754-c3195c5c647d tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc0b9eb2da5426982ab9719f48bd0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef597c49557e41f08d4f1b92dba126f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:31:51.315634 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-843ad6f0-2126-46bf-8754-c3195c5c647d tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] 10.222.0.61 "GET /compute/v2.1/servers/c470a4a1-e391-446d-85b5-eef6db8d10da" status: 200 len: 1497 microversion: 2.1 time: 0.567291 Aug 31 16:31:51.317710 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3077/6136] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:31:50 2022] GET /compute/v2.1/servers/c470a4a1-e391-446d-85b5-eef6db8d10da => generated 1497 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:31:52.352275 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-dca5154c-9ad2-45f8-8674-e255fbfe89cf tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:31:52.353322 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-dca5154c-9ad2-45f8-8674-e255fbfe89cf tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] [instance: c470a4a1-e391-446d-85b5-eef6db8d10da] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:31:52.358569 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-66f54340-5705-4839-b517-bc99838306ac tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:31:52.362406 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-66f54340-5705-4839-b517-bc99838306ac tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: b31fb01b-045f-41f7-bf58-66c1eca839e8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:31:52.369589 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dca5154c-9ad2-45f8-8674-e255fbfe89cf tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:52.370203 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dca5154c-9ad2-45f8-8674-e255fbfe89cf tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:52.370916 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dca5154c-9ad2-45f8-8674-e255fbfe89cf tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:52.371773 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dca5154c-9ad2-45f8-8674-e255fbfe89cf tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:52.374967 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dca5154c-9ad2-45f8-8674-e255fbfe89cf tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:52.375826 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dca5154c-9ad2-45f8-8674-e255fbfe89cf tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:52.379645 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-66f54340-5705-4839-b517-bc99838306ac tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:52.380154 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-66f54340-5705-4839-b517-bc99838306ac tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:52.380604 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-66f54340-5705-4839-b517-bc99838306ac tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:52.381438 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-66f54340-5705-4839-b517-bc99838306ac tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:52.381910 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-66f54340-5705-4839-b517-bc99838306ac tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:52.382349 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-66f54340-5705-4839-b517-bc99838306ac tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:52.465409 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-66f54340-5705-4839-b517-bc99838306ac tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.110739 Aug 31 16:31:52.465958 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3078/6137] 10.222.0.61 () {60 vars in 1343 bytes} [Wed Aug 31 16:31:52 2022] GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8/os-volume_attachments => generated 25 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:31:52.564024 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9c45cb76-b7a1-46af-bdf5-aad356b2a9fd tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:31:52.564826 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9c45cb76-b7a1-46af-bdf5-aad356b2a9fd tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: b31fb01b-045f-41f7-bf58-66c1eca839e8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:31:52.574600 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9c45cb76-b7a1-46af-bdf5-aad356b2a9fd tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:52.576506 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9c45cb76-b7a1-46af-bdf5-aad356b2a9fd tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:52.577121 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9c45cb76-b7a1-46af-bdf5-aad356b2a9fd tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:52.578332 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9c45cb76-b7a1-46af-bdf5-aad356b2a9fd tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:52.579448 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9c45cb76-b7a1-46af-bdf5-aad356b2a9fd tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:52.580128 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9c45cb76-b7a1-46af-bdf5-aad356b2a9fd tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:52.618546 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9c45cb76-b7a1-46af-bdf5-aad356b2a9fd tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: b31fb01b-045f-41f7-bf58-66c1eca839e8] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:31:52.745012 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:31:52.830084 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9c45cb76-b7a1-46af-bdf5-aad356b2a9fd tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "DELETE /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8" status: 204 len: 0 microversion: 2.20 time: 0.268110 Aug 31 16:31:52.831982 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3079/6138] 10.222.0.61 () {60 vars in 1280 bytes} [Wed Aug 31 16:31:52 2022] DELETE /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 31 16:31:52.849453 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a70cdb5a-a0c0-4b42-a030-930710b4dfca tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:31:52.851001 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a70cdb5a-a0c0-4b42-a030-930710b4dfca tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: b31fb01b-045f-41f7-bf58-66c1eca839e8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:31:52.873572 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a70cdb5a-a0c0-4b42-a030-930710b4dfca tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:52.874146 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a70cdb5a-a0c0-4b42-a030-930710b4dfca tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:52.881464 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a70cdb5a-a0c0-4b42-a030-930710b4dfca tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:52.915358 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a70cdb5a-a0c0-4b42-a030-930710b4dfca tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:52.915358 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a70cdb5a-a0c0-4b42-a030-930710b4dfca tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:52.915358 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a70cdb5a-a0c0-4b42-a030-930710b4dfca tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:52.955629 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-dca5154c-9ad2-45f8-8674-e255fbfe89cf tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc0b9eb2da5426982ab9719f48bd0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef597c49557e41f08d4f1b92dba126f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:31:52.972328 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-dca5154c-9ad2-45f8-8674-e255fbfe89cf tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] 10.222.0.61 "GET /compute/v2.1/servers/c470a4a1-e391-446d-85b5-eef6db8d10da" status: 200 len: 1500 microversion: 2.1 time: 0.631468 Aug 31 16:31:52.975394 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3060/6139] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:31:52 2022] GET /compute/v2.1/servers/c470a4a1-e391-446d-85b5-eef6db8d10da => generated 1500 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:31:52.996594 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d0c8f335-c957-48dd-bff9-6e234881a9be tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:31:52.997254 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d0c8f335-c957-48dd-bff9-6e234881a9be tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] [instance: c470a4a1-e391-446d-85b5-eef6db8d10da] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:31:53.013152 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d0c8f335-c957-48dd-bff9-6e234881a9be tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:53.016192 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d0c8f335-c957-48dd-bff9-6e234881a9be tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:53.017338 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d0c8f335-c957-48dd-bff9-6e234881a9be tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:53.019540 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d0c8f335-c957-48dd-bff9-6e234881a9be tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:53.023408 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d0c8f335-c957-48dd-bff9-6e234881a9be tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:53.025130 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d0c8f335-c957-48dd-bff9-6e234881a9be tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:53.112510 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d0c8f335-c957-48dd-bff9-6e234881a9be tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] [instance: c470a4a1-e391-446d-85b5-eef6db8d10da] Going to try to terminate instance {{(pid=122256) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:31:53.209856 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:31:53.308566 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d0c8f335-c957-48dd-bff9-6e234881a9be tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] 10.222.0.61 "DELETE /compute/v2.1/servers/c470a4a1-e391-446d-85b5-eef6db8d10da" status: 204 len: 0 microversion: 2.1 time: 0.316495 Aug 31 16:31:53.309535 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3061/6140] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:31:52 2022] DELETE /compute/v2.1/servers/c470a4a1-e391-446d-85b5-eef6db8d10da => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 16:31:53.321296 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b8e2b585-8b49-460b-b5e3-215347461c17 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:31:53.323343 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b8e2b585-8b49-460b-b5e3-215347461c17 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] [instance: c470a4a1-e391-446d-85b5-eef6db8d10da] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:31:53.333503 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b8e2b585-8b49-460b-b5e3-215347461c17 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:53.333846 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a70cdb5a-a0c0-4b42-a030-930710b4dfca tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:31:53.337528 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b8e2b585-8b49-460b-b5e3-215347461c17 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:53.337990 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b8e2b585-8b49-460b-b5e3-215347461c17 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:53.342604 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b8e2b585-8b49-460b-b5e3-215347461c17 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:53.343134 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b8e2b585-8b49-460b-b5e3-215347461c17 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:53.348890 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b8e2b585-8b49-460b-b5e3-215347461c17 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:53.352704 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a70cdb5a-a0c0-4b42-a030-930710b4dfca tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:31:53.355738 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a70cdb5a-a0c0-4b42-a030-930710b4dfca tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:31:53.361564 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a70cdb5a-a0c0-4b42-a030-930710b4dfca tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8" status: 200 len: 1723 microversion: 2.20 time: 0.524799 Aug 31 16:31:53.367163 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3080/6141] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:31:52 2022] GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8 => generated 1723 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:31:53.772609 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b8e2b585-8b49-460b-b5e3-215347461c17 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc0b9eb2da5426982ab9719f48bd0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef597c49557e41f08d4f1b92dba126f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:31:53.782701 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b8e2b585-8b49-460b-b5e3-215347461c17 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] 10.222.0.61 "GET /compute/v2.1/servers/c470a4a1-e391-446d-85b5-eef6db8d10da" status: 200 len: 1506 microversion: 2.1 time: 0.467702 Aug 31 16:31:53.784488 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3062/6142] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:31:53 2022] GET /compute/v2.1/servers/c470a4a1-e391-446d-85b5-eef6db8d10da => generated 1506 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:31:54.403101 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-dbd4bb12-7dc2-4765-8730-91399af46b66 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:31:54.403101 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-dbd4bb12-7dc2-4765-8730-91399af46b66 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: b31fb01b-045f-41f7-bf58-66c1eca839e8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:31:54.415723 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dbd4bb12-7dc2-4765-8730-91399af46b66 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:54.417085 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dbd4bb12-7dc2-4765-8730-91399af46b66 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:54.417594 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dbd4bb12-7dc2-4765-8730-91399af46b66 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:54.420332 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dbd4bb12-7dc2-4765-8730-91399af46b66 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:54.420824 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dbd4bb12-7dc2-4765-8730-91399af46b66 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:54.421266 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dbd4bb12-7dc2-4765-8730-91399af46b66 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:54.807860 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5ca1d74b-ba27-49b5-a4bb-0e3156380632 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:31:54.809244 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5ca1d74b-ba27-49b5-a4bb-0e3156380632 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] [instance: c470a4a1-e391-446d-85b5-eef6db8d10da] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:31:54.826440 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-dbd4bb12-7dc2-4765-8730-91399af46b66 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:31:54.836162 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-dbd4bb12-7dc2-4765-8730-91399af46b66 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:31:54.838823 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5ca1d74b-ba27-49b5-a4bb-0e3156380632 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:54.839667 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5ca1d74b-ba27-49b5-a4bb-0e3156380632 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:54.840387 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5ca1d74b-ba27-49b5-a4bb-0e3156380632 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:54.843409 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5ca1d74b-ba27-49b5-a4bb-0e3156380632 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:54.847963 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5ca1d74b-ba27-49b5-a4bb-0e3156380632 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:54.848663 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5ca1d74b-ba27-49b5-a4bb-0e3156380632 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:54.850038 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-dbd4bb12-7dc2-4765-8730-91399af46b66 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:31:54.853583 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-dbd4bb12-7dc2-4765-8730-91399af46b66 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8" status: 200 len: 1723 microversion: 2.20 time: 0.469142 Aug 31 16:31:54.854197 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3081/6143] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:31:54 2022] GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8 => generated 1723 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:31:55.232498 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5ca1d74b-ba27-49b5-a4bb-0e3156380632 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc0b9eb2da5426982ab9719f48bd0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef597c49557e41f08d4f1b92dba126f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:31:55.244907 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5ca1d74b-ba27-49b5-a4bb-0e3156380632 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] 10.222.0.61 "GET /compute/v2.1/servers/c470a4a1-e391-446d-85b5-eef6db8d10da" status: 200 len: 1506 microversion: 2.1 time: 0.442529 Aug 31 16:31:55.248006 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3063/6144] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:31:54 2022] GET /compute/v2.1/servers/c470a4a1-e391-446d-85b5-eef6db8d10da => generated 1506 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:31:55.881904 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-73479d48-c522-4f97-bb5b-9e3e4813d768 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:31:55.882581 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-73479d48-c522-4f97-bb5b-9e3e4813d768 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: b31fb01b-045f-41f7-bf58-66c1eca839e8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:31:55.900812 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:31:55.904019 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-73479d48-c522-4f97-bb5b-9e3e4813d768 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:55.904541 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-73479d48-c522-4f97-bb5b-9e3e4813d768 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:55.905094 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-73479d48-c522-4f97-bb5b-9e3e4813d768 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:55.905950 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-73479d48-c522-4f97-bb5b-9e3e4813d768 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:55.906417 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-73479d48-c522-4f97-bb5b-9e3e4813d768 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:55.906988 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-73479d48-c522-4f97-bb5b-9e3e4813d768 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:56.183430 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-73479d48-c522-4f97-bb5b-9e3e4813d768 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:31:56.203711 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-73479d48-c522-4f97-bb5b-9e3e4813d768 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:31:56.207972 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-73479d48-c522-4f97-bb5b-9e3e4813d768 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:31:56.215299 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-73479d48-c522-4f97-bb5b-9e3e4813d768 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8" status: 200 len: 1656 microversion: 2.20 time: 0.337204 Aug 31 16:31:56.216507 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3082/6145] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:31:55 2022] GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8 => generated 1656 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:31:56.278850 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-94f31c78-1af0-4cd0-81ae-cc8f0f645211 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:31:56.281772 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-94f31c78-1af0-4cd0-81ae-cc8f0f645211 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] [instance: c470a4a1-e391-446d-85b5-eef6db8d10da] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:31:56.318349 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-94f31c78-1af0-4cd0-81ae-cc8f0f645211 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:56.319840 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-94f31c78-1af0-4cd0-81ae-cc8f0f645211 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:56.320562 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-94f31c78-1af0-4cd0-81ae-cc8f0f645211 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:56.322398 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-94f31c78-1af0-4cd0-81ae-cc8f0f645211 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:56.323246 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-94f31c78-1af0-4cd0-81ae-cc8f0f645211 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:56.325071 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-94f31c78-1af0-4cd0-81ae-cc8f0f645211 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:57.800344 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-c8c80c34-c9ea-4680-8530-96f417436004 req-f8140ea8-f422-4f89-a373-d845449ca42f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b31fb01b-045f-41f7-bf58-66c1eca839e8", "name": "network-vif-deleted", "tag": "fbb954d2-1cb6-4ea2-b226-5a233a891670"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:31:57.823603 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-c8c80c34-c9ea-4680-8530-96f417436004 req-f8140ea8-f422-4f89-a373-d845449ca42f service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:57.824722 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-c8c80c34-c9ea-4680-8530-96f417436004 req-f8140ea8-f422-4f89-a373-d845449ca42f service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:57.825739 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-c8c80c34-c9ea-4680-8530-96f417436004 req-f8140ea8-f422-4f89-a373-d845449ca42f service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:57.866451 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-c8c80c34-c9ea-4680-8530-96f417436004 req-f8140ea8-f422-4f89-a373-d845449ca42f service nova] Creating event network-vif-deleted:fbb954d2-1cb6-4ea2-b226-5a233a891670 for instance b31fb01b-045f-41f7-bf58-66c1eca839e8 on n-h1-850499-9 Aug 31 16:31:57.879965 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-c8c80c34-c9ea-4680-8530-96f417436004 req-f8140ea8-f422-4f89-a373-d845449ca42f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.637094 Aug 31 16:31:57.885602 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3083/6146] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:31:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:31:57.897335 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-11b68e80-4e3e-4029-9435-92b106b4d77a tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:31:57.902962 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-11b68e80-4e3e-4029-9435-92b106b4d77a tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: b31fb01b-045f-41f7-bf58-66c1eca839e8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:31:57.919641 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-11b68e80-4e3e-4029-9435-92b106b4d77a tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:57.921314 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-11b68e80-4e3e-4029-9435-92b106b4d77a tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:57.924457 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-11b68e80-4e3e-4029-9435-92b106b4d77a tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:57.925637 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-11b68e80-4e3e-4029-9435-92b106b4d77a tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:57.926459 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-11b68e80-4e3e-4029-9435-92b106b4d77a tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:57.927151 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-11b68e80-4e3e-4029-9435-92b106b4d77a tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:58.090887 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-11b68e80-4e3e-4029-9435-92b106b4d77a tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:58.092436 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-11b68e80-4e3e-4029-9435-92b106b4d77a tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:58.096492 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-11b68e80-4e3e-4029-9435-92b106b4d77a tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:58.100069 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-11b68e80-4e3e-4029-9435-92b106b4d77a tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lazy-loading 'fault' on Instance uuid b31fb01b-045f-41f7-bf58-66c1eca839e8 {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:31:58.115192 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-94f31c78-1af0-4cd0-81ae-cc8f0f645211 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc0b9eb2da5426982ab9719f48bd0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef597c49557e41f08d4f1b92dba126f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:31:58.133039 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-94f31c78-1af0-4cd0-81ae-cc8f0f645211 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] 10.222.0.61 "GET /compute/v2.1/servers/c470a4a1-e391-446d-85b5-eef6db8d10da" status: 200 len: 1506 microversion: 2.1 time: 1.856102 Aug 31 16:31:58.139128 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3064/6147] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:31:56 2022] GET /compute/v2.1/servers/c470a4a1-e391-446d-85b5-eef6db8d10da => generated 1506 bytes in 1866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:31:58.403277 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-11b68e80-4e3e-4029-9435-92b106b4d77a tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:31:58.419704 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-11b68e80-4e3e-4029-9435-92b106b4d77a tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:31:58.424071 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-11b68e80-4e3e-4029-9435-92b106b4d77a tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ef5541e135d48348fbb4419b29417e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c81cbf4a36943d78740dec7e7e1b4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:31:58.425526 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-11b68e80-4e3e-4029-9435-92b106b4d77a tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8" status: 200 len: 1371 microversion: 2.20 time: 0.538441 Aug 31 16:31:58.427089 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3084/6148] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:31:57 2022] GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8 => generated 1371 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:31:59.162937 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8863405e-1e7f-4b6d-8d7b-d4907553b961 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:31:59.163757 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8863405e-1e7f-4b6d-8d7b-d4907553b961 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] [instance: c470a4a1-e391-446d-85b5-eef6db8d10da] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:31:59.177036 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8863405e-1e7f-4b6d-8d7b-d4907553b961 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:59.177547 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8863405e-1e7f-4b6d-8d7b-d4907553b961 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:59.177993 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8863405e-1e7f-4b6d-8d7b-d4907553b961 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:59.178729 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8863405e-1e7f-4b6d-8d7b-d4907553b961 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:59.179246 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8863405e-1e7f-4b6d-8d7b-d4907553b961 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:59.179787 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8863405e-1e7f-4b6d-8d7b-d4907553b961 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:59.187408 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1d0e4984-f81c-41bf-b6ee-6cbc794f858e tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:31:59.188418 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1d0e4984-f81c-41bf-b6ee-6cbc794f858e tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] [instance: c7eaf35b-26b9-4011-8dc8-d5f48201f17e] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:31:59.199611 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1d0e4984-f81c-41bf-b6ee-6cbc794f858e tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:59.200132 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1d0e4984-f81c-41bf-b6ee-6cbc794f858e tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:59.200587 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1d0e4984-f81c-41bf-b6ee-6cbc794f858e tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:59.201321 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1d0e4984-f81c-41bf-b6ee-6cbc794f858e tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:59.201791 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1d0e4984-f81c-41bf-b6ee-6cbc794f858e tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:59.202262 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1d0e4984-f81c-41bf-b6ee-6cbc794f858e tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:59.289393 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1d0e4984-f81c-41bf-b6ee-6cbc794f858e tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] [instance: c7eaf35b-26b9-4011-8dc8-d5f48201f17e] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:31:59.447041 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1d0e4984-f81c-41bf-b6ee-6cbc794f858e tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] 10.222.0.61 "DELETE /compute/v2.1/servers/c7eaf35b-26b9-4011-8dc8-d5f48201f17e" status: 204 len: 0 microversion: 2.1 time: 0.264211 Aug 31 16:31:59.448099 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3085/6149] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:31:59 2022] DELETE /compute/v2.1/servers/c7eaf35b-26b9-4011-8dc8-d5f48201f17e => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 16:31:59.455690 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8863405e-1e7f-4b6d-8d7b-d4907553b961 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc0b9eb2da5426982ab9719f48bd0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef597c49557e41f08d4f1b92dba126f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:31:59.486125 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-12713dfa-663f-4de1-8748-61cd5a24f51b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:31:59.487477 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8863405e-1e7f-4b6d-8d7b-d4907553b961 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] 10.222.0.61 "GET /compute/v2.1/servers/c470a4a1-e391-446d-85b5-eef6db8d10da" status: 200 len: 1464 microversion: 2.1 time: 0.321233 Aug 31 16:31:59.491336 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3065/6150] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:31:59 2022] GET /compute/v2.1/servers/c470a4a1-e391-446d-85b5-eef6db8d10da => generated 1464 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:31:59.495327 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-12713dfa-663f-4de1-8748-61cd5a24f51b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: b31fb01b-045f-41f7-bf58-66c1eca839e8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:31:59.507789 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0015a67b-de59-4e47-91e0-85525b33367d tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:31:59.508716 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0015a67b-de59-4e47-91e0-85525b33367d tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] [instance: c7eaf35b-26b9-4011-8dc8-d5f48201f17e] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:31:59.512609 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-12713dfa-663f-4de1-8748-61cd5a24f51b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:59.515726 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-12713dfa-663f-4de1-8748-61cd5a24f51b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:59.518167 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-12713dfa-663f-4de1-8748-61cd5a24f51b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:59.520565 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-12713dfa-663f-4de1-8748-61cd5a24f51b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:59.522864 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-12713dfa-663f-4de1-8748-61cd5a24f51b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:59.523374 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-12713dfa-663f-4de1-8748-61cd5a24f51b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:59.526916 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0015a67b-de59-4e47-91e0-85525b33367d tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:59.527427 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0015a67b-de59-4e47-91e0-85525b33367d tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:59.532000 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0015a67b-de59-4e47-91e0-85525b33367d tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:59.534685 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0015a67b-de59-4e47-91e0-85525b33367d tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:59.536465 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0015a67b-de59-4e47-91e0-85525b33367d tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:59.536935 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0015a67b-de59-4e47-91e0-85525b33367d tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:59.597077 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-12713dfa-663f-4de1-8748-61cd5a24f51b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] HTTP exception thrown: Instance b31fb01b-045f-41f7-bf58-66c1eca839e8 could not be found. Aug 31 16:31:59.603915 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-12713dfa-663f-4de1-8748-61cd5a24f51b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Request method failure captured: Aug 31 16:31:59.603915 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8 HTTP/1.1 Aug 31 16:31:59.603915 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:31:59.603915 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:31:59.603915 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:31:59.603915 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:31:59.603915 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:31:59.603915 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:31:59.603915 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:31:59.603915 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:31:59.603915 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4paH_G5w-Lewh6LZnRmXklLf1ya40XWD25uZ65baVRBpbj-4vWy4i5AnWd4H3SGDp4sxCxiENp5Pmk_UI3-ze2xj4kgXJvJU_1eSI3JYfEtoDAOG_48S5StQpjeOO2yWrcurlzW4wSg3Sw6jnrXt6NKcdBCorc5Vu_rwvkLY_lWj9I Aug 31 16:31:59.603915 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:31:59.603915 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:31:59.603915 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:31:59.603915 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:31:59.603915 n-d-850499-9 devstack@n-api.service[122257]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 16:31:59.603915 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:31:59.603915 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:31:59.603915 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 1c81cbf4a36943d78740dec7e7e1b4d9 Aug 31 16:31:59.603915 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1339167510 Aug 31 16:31:59.603915 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:31:59.603915 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:31:59.603915 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1c81cbf4a36943d78740dec7e7e1b4d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1c81cbf4a36943d78740dec7e7e1b4d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1c81cbf4a36943d78740dec7e7e1b4d9", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1c81cbf4a36943d78740dec7e7e1b4d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:31:59.603915 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1339167510 Aug 31 16:31:59.603915 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 1c81cbf4a36943d78740dec7e7e1b4d9 Aug 31 16:31:59.603915 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1339167510 Aug 31 16:31:59.603915 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-AttachVolumeShelveTestJSON-1339167510-project Aug 31 16:31:59.603915 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:31:59.603915 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:31:59.603915 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 6ef5541e135d48348fbb4419b29417e7 Aug 31 16:31:59.603915 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1339167510-project Aug 31 16:31:59.603915 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:31:59.603915 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance b31fb01b-045f-41f7-bf58-66c1eca839e8 could not be found. Aug 31 16:31:59.603915 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': 'b31fb01b-045f-41f7-bf58-66c1eca839e8'} Aug 31 16:31:59.603915 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:31:59.603915 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:31:59.603915 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:31:59.603915 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:31:59.603915 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:31:59.603915 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:31:59.603915 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:31:59.603915 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:31:59.603915 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:31:59.603915 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:31:59.603915 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b31fb01b-045f-41f7-bf58-66c1eca839e8 could not be found. Aug 31 16:31:59.603915 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:31:59.603915 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:31:59.603915 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:31:59.603915 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:31:59.603915 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:31:59.603915 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:31:59.603915 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:31:59.603915 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:31:59.603915 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:31:59.603915 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:31:59.603915 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:31:59.603915 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:31:59.603915 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:31:59.603915 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:31:59.603915 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:31:59.603915 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:31:59.603915 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b31fb01b-045f-41f7-bf58-66c1eca839e8 could not be found. Aug 31 16:31:59.603915 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:31:59.603915 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:31:59.609774 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:31:59.609774 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:31:59.609774 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:31:59.609774 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:31:59.609774 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:31:59.609774 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:31:59.609774 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b31fb01b-045f-41f7-bf58-66c1eca839e8 could not be found. Aug 31 16:31:59.609774 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:31:59.609774 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-12713dfa-663f-4de1-8748-61cd5a24f51b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Returning 404 to user: Instance b31fb01b-045f-41f7-bf58-66c1eca839e8 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:31:59.612225 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-12713dfa-663f-4de1-8748-61cd5a24f51b tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8" status: 404 len: 111 microversion: 2.20 time: 0.162351 Aug 31 16:31:59.613116 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3086/6151] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:31:59 2022] GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8 => generated 111 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 31 16:31:59.627330 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0817d038-96f6-4671-8115-587959303812 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '.version_select at 0x7f5ae857b700>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:31:59.661673 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0817d038-96f6-4671-8115-587959303812 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-250624264" status: 204 len: 0 microversion: 2.20 time: 0.042521 Aug 31 16:31:59.662460 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3087/6152] 10.222.0.61 () {60 vars in 1259 bytes} [Wed Aug 31 16:31:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-250624264 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 16:31:59.855225 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-0015a67b-de59-4e47-91e0-85525b33367d tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48419c9a6b934406b14d9150af9bbb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1b3cbf1d284da384315bd4f5e1e783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:31:59.866143 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0015a67b-de59-4e47-91e0-85525b33367d tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] 10.222.0.61 "GET /compute/v2.1/servers/c7eaf35b-26b9-4011-8dc8-d5f48201f17e" status: 200 len: 1469 microversion: 2.1 time: 0.373446 Aug 31 16:31:59.869101 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3066/6153] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:31:59 2022] GET /compute/v2.1/servers/c7eaf35b-26b9-4011-8dc8-d5f48201f17e => generated 1469 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:31:59.928343 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-6ebd35e9-7437-4b1e-be3c-f3bf78ccca4d req-1e0a4756-c4c4-4c57-b584-1adb40be4185 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c470a4a1-e391-446d-85b5-eef6db8d10da", "name": "network-vif-deleted", "tag": "e6c3ae68-21f8-4ef4-951a-1eec586153f1"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:31:59.944988 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-6ebd35e9-7437-4b1e-be3c-f3bf78ccca4d req-1e0a4756-c4c4-4c57-b584-1adb40be4185 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:59.946389 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-6ebd35e9-7437-4b1e-be3c-f3bf78ccca4d req-1e0a4756-c4c4-4c57-b584-1adb40be4185 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:59.947254 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-6ebd35e9-7437-4b1e-be3c-f3bf78ccca4d req-1e0a4756-c4c4-4c57-b584-1adb40be4185 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:59.965677 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-6ebd35e9-7437-4b1e-be3c-f3bf78ccca4d req-1e0a4756-c4c4-4c57-b584-1adb40be4185 service nova] Creating event network-vif-deleted:e6c3ae68-21f8-4ef4-951a-1eec586153f1 for instance c470a4a1-e391-446d-85b5-eef6db8d10da on n-h2-850499-9 Aug 31 16:31:59.973533 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-6ebd35e9-7437-4b1e-be3c-f3bf78ccca4d req-1e0a4756-c4c4-4c57-b584-1adb40be4185 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048552 Aug 31 16:31:59.974883 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3088/6154] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:31:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:32:00.515240 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2e803053-ba3f-4846-b8eb-88a59c378a4e tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:32:00.516082 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2e803053-ba3f-4846-b8eb-88a59c378a4e tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] [instance: c470a4a1-e391-446d-85b5-eef6db8d10da] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:32:00.532187 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2e803053-ba3f-4846-b8eb-88a59c378a4e tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:00.533015 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2e803053-ba3f-4846-b8eb-88a59c378a4e tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:00.534933 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2e803053-ba3f-4846-b8eb-88a59c378a4e tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:00.535994 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2e803053-ba3f-4846-b8eb-88a59c378a4e tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:00.536730 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2e803053-ba3f-4846-b8eb-88a59c378a4e tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:00.537400 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2e803053-ba3f-4846-b8eb-88a59c378a4e tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:00.617899 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-2e803053-ba3f-4846-b8eb-88a59c378a4e tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc0b9eb2da5426982ab9719f48bd0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef597c49557e41f08d4f1b92dba126f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:32:00.634076 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2e803053-ba3f-4846-b8eb-88a59c378a4e tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] 10.222.0.61 "GET /compute/v2.1/servers/c470a4a1-e391-446d-85b5-eef6db8d10da" status: 200 len: 1299 microversion: 2.1 time: 0.124028 Aug 31 16:32:00.637135 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3067/6155] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:32:00 2022] GET /compute/v2.1/servers/c470a4a1-e391-446d-85b5-eef6db8d10da => generated 1299 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:32:00.892577 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-dfa4c021-6eeb-47cb-979f-5ba3f7560d9c tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:32:00.893361 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-dfa4c021-6eeb-47cb-979f-5ba3f7560d9c tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] [instance: c7eaf35b-26b9-4011-8dc8-d5f48201f17e] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:32:00.923274 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dfa4c021-6eeb-47cb-979f-5ba3f7560d9c tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:00.926792 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dfa4c021-6eeb-47cb-979f-5ba3f7560d9c tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:00.927426 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dfa4c021-6eeb-47cb-979f-5ba3f7560d9c tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:00.928382 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dfa4c021-6eeb-47cb-979f-5ba3f7560d9c tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:00.929103 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dfa4c021-6eeb-47cb-979f-5ba3f7560d9c tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:00.929611 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dfa4c021-6eeb-47cb-979f-5ba3f7560d9c tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:01.346903 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-dfa4c021-6eeb-47cb-979f-5ba3f7560d9c tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48419c9a6b934406b14d9150af9bbb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1b3cbf1d284da384315bd4f5e1e783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:32:01.358538 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-dfa4c021-6eeb-47cb-979f-5ba3f7560d9c tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] 10.222.0.61 "GET /compute/v2.1/servers/c7eaf35b-26b9-4011-8dc8-d5f48201f17e" status: 200 len: 1469 microversion: 2.1 time: 0.471902 Aug 31 16:32:01.359648 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3089/6156] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:32:00 2022] GET /compute/v2.1/servers/c7eaf35b-26b9-4011-8dc8-d5f48201f17e => generated 1469 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:32:01.658922 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e81d9a63-9af1-418c-927e-14577623bb18 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:32:01.659458 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e81d9a63-9af1-418c-927e-14577623bb18 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] [instance: c470a4a1-e391-446d-85b5-eef6db8d10da] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:32:01.674576 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e81d9a63-9af1-418c-927e-14577623bb18 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:01.675657 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e81d9a63-9af1-418c-927e-14577623bb18 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:01.676705 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e81d9a63-9af1-418c-927e-14577623bb18 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:01.680715 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e81d9a63-9af1-418c-927e-14577623bb18 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:01.683899 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e81d9a63-9af1-418c-927e-14577623bb18 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:01.684685 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e81d9a63-9af1-418c-927e-14577623bb18 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:01.791710 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e81d9a63-9af1-418c-927e-14577623bb18 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:01.792215 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e81d9a63-9af1-418c-927e-14577623bb18 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:01.796869 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e81d9a63-9af1-418c-927e-14577623bb18 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:01.798956 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-e81d9a63-9af1-418c-927e-14577623bb18 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lazy-loading 'fault' on Instance uuid c470a4a1-e391-446d-85b5-eef6db8d10da {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:32:01.885915 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e81d9a63-9af1-418c-927e-14577623bb18 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc0b9eb2da5426982ab9719f48bd0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef597c49557e41f08d4f1b92dba126f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:32:01.899234 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e81d9a63-9af1-418c-927e-14577623bb18 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] 10.222.0.61 "GET /compute/v2.1/servers/c470a4a1-e391-446d-85b5-eef6db8d10da" status: 200 len: 1304 microversion: 2.1 time: 0.244683 Aug 31 16:32:01.915768 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3068/6157] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:32:01 2022] GET /compute/v2.1/servers/c470a4a1-e391-446d-85b5-eef6db8d10da => generated 1304 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:32:02.382526 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5baab1d6-f82a-4316-ba88-941433571c44 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:32:02.383718 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5baab1d6-f82a-4316-ba88-941433571c44 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] [instance: c7eaf35b-26b9-4011-8dc8-d5f48201f17e] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:32:02.400316 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5baab1d6-f82a-4316-ba88-941433571c44 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:02.400826 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5baab1d6-f82a-4316-ba88-941433571c44 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:02.401371 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5baab1d6-f82a-4316-ba88-941433571c44 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:02.401977 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5baab1d6-f82a-4316-ba88-941433571c44 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:02.402434 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5baab1d6-f82a-4316-ba88-941433571c44 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:02.418485 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5baab1d6-f82a-4316-ba88-941433571c44 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:02.930881 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-572a838a-2529-430d-add8-21c504c57231 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:32:02.931850 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-572a838a-2529-430d-add8-21c504c57231 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] [instance: c470a4a1-e391-446d-85b5-eef6db8d10da] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:32:02.968011 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:32:02.969955 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-572a838a-2529-430d-add8-21c504c57231 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:02.970500 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-572a838a-2529-430d-add8-21c504c57231 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:02.970927 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-572a838a-2529-430d-add8-21c504c57231 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:02.975650 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5baab1d6-f82a-4316-ba88-941433571c44 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48419c9a6b934406b14d9150af9bbb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1b3cbf1d284da384315bd4f5e1e783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:32:02.979902 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-572a838a-2529-430d-add8-21c504c57231 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:02.980419 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-572a838a-2529-430d-add8-21c504c57231 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:02.980874 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-572a838a-2529-430d-add8-21c504c57231 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:02.984755 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5baab1d6-f82a-4316-ba88-941433571c44 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] 10.222.0.61 "GET /compute/v2.1/servers/c7eaf35b-26b9-4011-8dc8-d5f48201f17e" status: 200 len: 1469 microversion: 2.1 time: 0.606187 Aug 31 16:32:02.995367 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3090/6158] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:32:02 2022] GET /compute/v2.1/servers/c7eaf35b-26b9-4011-8dc8-d5f48201f17e => generated 1469 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:32:03.017613 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-572a838a-2529-430d-add8-21c504c57231 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] HTTP exception thrown: Instance c470a4a1-e391-446d-85b5-eef6db8d10da could not be found. Aug 31 16:32:03.019662 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-572a838a-2529-430d-add8-21c504c57231 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Request method failure captured: Aug 31 16:32:03.019662 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/c470a4a1-e391-446d-85b5-eef6db8d10da HTTP/1.1 Aug 31 16:32:03.019662 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:32:03.019662 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:32:03.019662 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:32:03.019662 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:32:03.019662 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:32:03.019662 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:32:03.019662 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:32:03.019662 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:32:03.019662 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4zPdoXHk05ENwc7DLUUlXiCylCr_jCgqjRh01ywxlyctH5-lXwHuRiWJSe5LMI6xjCjfu45ZW3xBoV4Bi-wRWpcCli7Vc0xKdeQCye5uznMMU1a6x4RIjTFyRuUfFo3Ul5AX0mJhdFXhplaYgFYbYpnr61eoxKZ1zkT_dvN-zVBMQo Aug 31 16:32:03.019662 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:32:03.019662 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:32:03.019662 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:32:03.019662 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:32:03.019662 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:32:03.019662 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:32:03.019662 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: ef597c49557e41f08d4f1b92dba126f5 Aug 31 16:32:03.019662 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-TestServerAdvancedOps-742523501 Aug 31 16:32:03.019662 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:32:03.019662 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:32:03.019662 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ef597c49557e41f08d4f1b92dba126f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ef597c49557e41f08d4f1b92dba126f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ef597c49557e41f08d4f1b92dba126f5", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ef597c49557e41f08d4f1b92dba126f5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:32:03.019662 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-TestServerAdvancedOps-742523501 Aug 31 16:32:03.019662 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: ef597c49557e41f08d4f1b92dba126f5 Aug 31 16:32:03.019662 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-TestServerAdvancedOps-742523501 Aug 31 16:32:03.019662 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-TestServerAdvancedOps-742523501-project Aug 31 16:32:03.019662 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:32:03.019662 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:32:03.019662 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: cdc0b9eb2da5426982ab9719f48bd0a0 Aug 31 16:32:03.019662 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-TestServerAdvancedOps-742523501-project Aug 31 16:32:03.019662 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:32:03.019662 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance c470a4a1-e391-446d-85b5-eef6db8d10da could not be found. Aug 31 16:32:03.019662 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': 'c470a4a1-e391-446d-85b5-eef6db8d10da'} Aug 31 16:32:03.019662 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:32:03.019662 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:32:03.019662 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:32:03.019662 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:32:03.019662 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:32:03.019662 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:32:03.019662 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:32:03.019662 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:32:03.019662 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:32:03.019662 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:32:03.019662 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c470a4a1-e391-446d-85b5-eef6db8d10da could not be found. Aug 31 16:32:03.019662 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:32:03.019662 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:32:03.019662 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:32:03.019662 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:32:03.019662 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:32:03.019662 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:32:03.019662 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:32:03.019662 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:32:03.019662 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:32:03.019662 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:32:03.019662 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:32:03.019662 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:32:03.019662 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:32:03.019662 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:32:03.019662 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:32:03.019662 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:32:03.019662 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c470a4a1-e391-446d-85b5-eef6db8d10da could not be found. Aug 31 16:32:03.019662 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:32:03.019662 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:32:03.019662 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:32:03.024286 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:32:03.024286 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:32:03.024286 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:32:03.024286 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:32:03.024286 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:32:03.024286 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c470a4a1-e391-446d-85b5-eef6db8d10da could not be found. Aug 31 16:32:03.024286 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:32:03.027269 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-572a838a-2529-430d-add8-21c504c57231 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] Returning 404 to user: Instance c470a4a1-e391-446d-85b5-eef6db8d10da could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:32:03.028434 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-572a838a-2529-430d-add8-21c504c57231 tempest-TestServerAdvancedOps-742523501 tempest-TestServerAdvancedOps-742523501-project] 10.222.0.61 "GET /compute/v2.1/servers/c470a4a1-e391-446d-85b5-eef6db8d10da" status: 404 len: 111 microversion: 2.1 time: 0.109447 Aug 31 16:32:03.041280 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3069/6159] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:32:02 2022] GET /compute/v2.1/servers/c470a4a1-e391-446d-85b5-eef6db8d10da => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 16:32:03.583064 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-4d93b80e-432d-433b-a7cb-83d0dfc005ea req-1dd97018-4042-4d9e-8f9a-cf8a1f78c42b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7eaf35b-26b9-4011-8dc8-d5f48201f17e", "name": "network-vif-deleted", "tag": "3d2b982b-9f9f-40db-8265-e4543d87210b"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:32:03.607179 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-4d93b80e-432d-433b-a7cb-83d0dfc005ea req-1dd97018-4042-4d9e-8f9a-cf8a1f78c42b service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:03.608275 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-4d93b80e-432d-433b-a7cb-83d0dfc005ea req-1dd97018-4042-4d9e-8f9a-cf8a1f78c42b service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:03.609219 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-4d93b80e-432d-433b-a7cb-83d0dfc005ea req-1dd97018-4042-4d9e-8f9a-cf8a1f78c42b service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:03.624872 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-4d93b80e-432d-433b-a7cb-83d0dfc005ea req-1dd97018-4042-4d9e-8f9a-cf8a1f78c42b service nova] Creating event network-vif-deleted:3d2b982b-9f9f-40db-8265-e4543d87210b for instance c7eaf35b-26b9-4011-8dc8-d5f48201f17e on n-h2-850499-9 Aug 31 16:32:03.644602 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-4d93b80e-432d-433b-a7cb-83d0dfc005ea req-1dd97018-4042-4d9e-8f9a-cf8a1f78c42b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068299 Aug 31 16:32:03.645741 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3091/6160] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:32:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:32:04.022398 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-eb2b2d39-c399-47ad-aadb-c318eb6eb5d4 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:32:04.023566 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-eb2b2d39-c399-47ad-aadb-c318eb6eb5d4 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] [instance: c7eaf35b-26b9-4011-8dc8-d5f48201f17e] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:32:04.083080 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eb2b2d39-c399-47ad-aadb-c318eb6eb5d4 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:04.085393 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eb2b2d39-c399-47ad-aadb-c318eb6eb5d4 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:04.086486 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eb2b2d39-c399-47ad-aadb-c318eb6eb5d4 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:04.087479 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eb2b2d39-c399-47ad-aadb-c318eb6eb5d4 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:04.088352 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eb2b2d39-c399-47ad-aadb-c318eb6eb5d4 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:04.089138 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eb2b2d39-c399-47ad-aadb-c318eb6eb5d4 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:04.266235 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eb2b2d39-c399-47ad-aadb-c318eb6eb5d4 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:04.267122 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eb2b2d39-c399-47ad-aadb-c318eb6eb5d4 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:04.267947 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eb2b2d39-c399-47ad-aadb-c318eb6eb5d4 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:04.268762 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-eb2b2d39-c399-47ad-aadb-c318eb6eb5d4 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Lazy-loading 'fault' on Instance uuid c7eaf35b-26b9-4011-8dc8-d5f48201f17e {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:32:04.421996 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-eb2b2d39-c399-47ad-aadb-c318eb6eb5d4 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48419c9a6b934406b14d9150af9bbb22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d1b3cbf1d284da384315bd4f5e1e783', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:32:04.444058 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-eb2b2d39-c399-47ad-aadb-c318eb6eb5d4 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] 10.222.0.61 "GET /compute/v2.1/servers/c7eaf35b-26b9-4011-8dc8-d5f48201f17e" status: 200 len: 1303 microversion: 2.1 time: 0.419426 Aug 31 16:32:04.445662 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3070/6161] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:32:04 2022] GET /compute/v2.1/servers/c7eaf35b-26b9-4011-8dc8-d5f48201f17e => generated 1303 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:32:05.477208 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-85912322-ffa9-48fd-bd87-29982897a395 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:32:05.477957 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-85912322-ffa9-48fd-bd87-29982897a395 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] [instance: c7eaf35b-26b9-4011-8dc8-d5f48201f17e] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:32:05.496706 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-85912322-ffa9-48fd-bd87-29982897a395 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:05.498663 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-85912322-ffa9-48fd-bd87-29982897a395 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:05.499858 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-85912322-ffa9-48fd-bd87-29982897a395 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:05.504267 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-85912322-ffa9-48fd-bd87-29982897a395 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:05.505461 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-85912322-ffa9-48fd-bd87-29982897a395 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:05.506424 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-85912322-ffa9-48fd-bd87-29982897a395 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:05.547567 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-85912322-ffa9-48fd-bd87-29982897a395 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] HTTP exception thrown: Instance c7eaf35b-26b9-4011-8dc8-d5f48201f17e could not be found. Aug 31 16:32:05.551634 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-85912322-ffa9-48fd-bd87-29982897a395 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Request method failure captured: Aug 31 16:32:05.551634 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/c7eaf35b-26b9-4011-8dc8-d5f48201f17e HTTP/1.1 Aug 31 16:32:05.551634 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:32:05.551634 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:32:05.551634 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:32:05.551634 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:32:05.551634 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:32:05.551634 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:32:05.551634 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:32:05.551634 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:32:05.551634 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4w0tpYcIP27-8X7Ckyt58XkTA4u-H9ECHYsFUtMkF-lGGV7Z5KF1i5bhEjzSsY_6T4vfrxFr4RhZ-uabBZGeEcHET1IBnW_eGSEHqRs4PwcHmH26u-pcqlK0sdiX9HgWANIOAfHNuqtsG7G_07ezXLGnU2MD-H71r7xqdFSooeW480 Aug 31 16:32:05.551634 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:32:05.551634 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:32:05.551634 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:32:05.551634 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:32:05.551634 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:32:05.551634 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:32:05.551634 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 7d1b3cbf1d284da384315bd4f5e1e783 Aug 31 16:32:05.551634 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-VolumesBackupsTest-765721223 Aug 31 16:32:05.551634 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:32:05.551634 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:32:05.551634 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7d1b3cbf1d284da384315bd4f5e1e783"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7d1b3cbf1d284da384315bd4f5e1e783"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7d1b3cbf1d284da384315bd4f5e1e783", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7d1b3cbf1d284da384315bd4f5e1e783"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:32:05.551634 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-VolumesBackupsTest-765721223 Aug 31 16:32:05.551634 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 7d1b3cbf1d284da384315bd4f5e1e783 Aug 31 16:32:05.551634 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-VolumesBackupsTest-765721223 Aug 31 16:32:05.551634 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-VolumesBackupsTest-765721223-project Aug 31 16:32:05.551634 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:32:05.551634 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:32:05.551634 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 48419c9a6b934406b14d9150af9bbb22 Aug 31 16:32:05.551634 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-VolumesBackupsTest-765721223-project Aug 31 16:32:05.551634 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:32:05.551634 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance c7eaf35b-26b9-4011-8dc8-d5f48201f17e could not be found. Aug 31 16:32:05.551634 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': 'c7eaf35b-26b9-4011-8dc8-d5f48201f17e'} Aug 31 16:32:05.551634 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:32:05.551634 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:32:05.551634 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:32:05.551634 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:32:05.551634 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:32:05.551634 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:32:05.551634 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:32:05.551634 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:32:05.551634 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:32:05.551634 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:32:05.551634 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7eaf35b-26b9-4011-8dc8-d5f48201f17e could not be found. Aug 31 16:32:05.551634 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:32:05.551634 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:32:05.551634 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:32:05.551634 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:32:05.551634 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:32:05.551634 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:32:05.551634 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:32:05.551634 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:32:05.551634 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:32:05.551634 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:32:05.551634 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:32:05.551634 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:32:05.551634 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:32:05.551634 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:32:05.551634 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:32:05.551634 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:32:05.551634 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7eaf35b-26b9-4011-8dc8-d5f48201f17e could not be found. Aug 31 16:32:05.551634 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:32:05.551634 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:32:05.551634 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:32:05.562071 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:32:05.562071 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:32:05.562071 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:32:05.562071 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:32:05.562071 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:32:05.562071 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7eaf35b-26b9-4011-8dc8-d5f48201f17e could not be found. Aug 31 16:32:05.562071 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:32:05.565450 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-85912322-ffa9-48fd-bd87-29982897a395 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] Returning 404 to user: Instance c7eaf35b-26b9-4011-8dc8-d5f48201f17e could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:32:05.568296 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-85912322-ffa9-48fd-bd87-29982897a395 tempest-VolumesBackupsTest-765721223 tempest-VolumesBackupsTest-765721223-project] 10.222.0.61 "GET /compute/v2.1/servers/c7eaf35b-26b9-4011-8dc8-d5f48201f17e" status: 404 len: 111 microversion: 2.1 time: 0.099748 Aug 31 16:32:05.569637 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3092/6162] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:32:05 2022] GET /compute/v2.1/servers/c7eaf35b-26b9-4011-8dc8-d5f48201f17e => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:32:05.936132 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-aa7f71fd-c1a0-4587-8ca2-1ee77ec9c8c4 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:32:05.937265 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-aa7f71fd-c1a0-4587-8ca2-1ee77ec9c8c4 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: b31fb01b-045f-41f7-bf58-66c1eca839e8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:32:05.962202 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aa7f71fd-c1a0-4587-8ca2-1ee77ec9c8c4 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:05.962718 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aa7f71fd-c1a0-4587-8ca2-1ee77ec9c8c4 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:05.963165 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aa7f71fd-c1a0-4587-8ca2-1ee77ec9c8c4 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:05.963932 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aa7f71fd-c1a0-4587-8ca2-1ee77ec9c8c4 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:05.964391 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aa7f71fd-c1a0-4587-8ca2-1ee77ec9c8c4 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:05.976320 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aa7f71fd-c1a0-4587-8ca2-1ee77ec9c8c4 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:06.025262 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-aa7f71fd-c1a0-4587-8ca2-1ee77ec9c8c4 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] HTTP exception thrown: Instance b31fb01b-045f-41f7-bf58-66c1eca839e8 could not be found. Aug 31 16:32:06.027999 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-aa7f71fd-c1a0-4587-8ca2-1ee77ec9c8c4 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Request method failure captured: Aug 31 16:32:06.027999 n-d-850499-9 devstack@n-api.service[122256]: request: DELETE /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8 HTTP/1.1 Aug 31 16:32:06.027999 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:32:06.027999 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:32:06.027999 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:32:06.027999 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:32:06.027999 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:32:06.027999 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:32:06.027999 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:32:06.027999 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:32:06.027999 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4paH_G5w-Lewh6LZnRmXklLf1ya40XWD25uZ65baVRBpbj-4vWy4i5AnWd4H3SGDp4sxCxiENp5Pmk_UI3-ze2xj4kgXJvJU_1eSI3JYfEtoDAOG_48S5StQpjeOO2yWrcurlzW4wSg3Sw6jnrXt6NKcdBCorc5Vu_rwvkLY_lWj9I Aug 31 16:32:06.027999 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:32:06.027999 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:32:06.027999 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:32:06.027999 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:32:06.027999 n-d-850499-9 devstack@n-api.service[122256]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 16:32:06.027999 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:32:06.027999 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:32:06.027999 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 1c81cbf4a36943d78740dec7e7e1b4d9 Aug 31 16:32:06.027999 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1339167510 Aug 31 16:32:06.027999 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:32:06.027999 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:32:06.027999 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1c81cbf4a36943d78740dec7e7e1b4d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1c81cbf4a36943d78740dec7e7e1b4d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1c81cbf4a36943d78740dec7e7e1b4d9", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1c81cbf4a36943d78740dec7e7e1b4d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:32:06.027999 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1339167510 Aug 31 16:32:06.027999 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 1c81cbf4a36943d78740dec7e7e1b4d9 Aug 31 16:32:06.027999 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1339167510 Aug 31 16:32:06.027999 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-AttachVolumeShelveTestJSON-1339167510-project Aug 31 16:32:06.027999 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:32:06.027999 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:32:06.027999 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 6ef5541e135d48348fbb4419b29417e7 Aug 31 16:32:06.027999 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1339167510-project Aug 31 16:32:06.027999 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:32:06.027999 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance b31fb01b-045f-41f7-bf58-66c1eca839e8 could not be found. Aug 31 16:32:06.027999 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': 'b31fb01b-045f-41f7-bf58-66c1eca839e8'} Aug 31 16:32:06.027999 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:32:06.027999 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:32:06.027999 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:32:06.027999 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:32:06.027999 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:32:06.027999 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:32:06.027999 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:32:06.027999 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:32:06.027999 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:32:06.027999 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:32:06.027999 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b31fb01b-045f-41f7-bf58-66c1eca839e8 could not be found. Aug 31 16:32:06.027999 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:32:06.027999 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:32:06.027999 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:32:06.027999 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:32:06.027999 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:32:06.027999 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:32:06.027999 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:32:06.027999 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:32:06.027999 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:32:06.027999 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:32:06.027999 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:32:06.027999 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:32:06.027999 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:32:06.027999 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:32:06.027999 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:32:06.027999 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:32:06.027999 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:32:06.027999 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:32:06.040874 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b31fb01b-045f-41f7-bf58-66c1eca839e8 could not be found. Aug 31 16:32:06.040874 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:32:06.040874 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:32:06.040874 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:32:06.040874 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:32:06.040874 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:32:06.040874 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:32:06.040874 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:32:06.040874 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:32:06.040874 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b31fb01b-045f-41f7-bf58-66c1eca839e8 could not be found. Aug 31 16:32:06.040874 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:32:06.040874 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-aa7f71fd-c1a0-4587-8ca2-1ee77ec9c8c4 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Returning 404 to user: Instance b31fb01b-045f-41f7-bf58-66c1eca839e8 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:32:06.040874 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-aa7f71fd-c1a0-4587-8ca2-1ee77ec9c8c4 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "DELETE /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8" status: 404 len: 111 microversion: 2.20 time: 0.098435 Aug 31 16:32:06.048345 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3071/6163] 10.222.0.61 () {60 vars in 1280 bytes} [Wed Aug 31 16:32:05 2022] DELETE /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:32:06.063152 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-753ccd51-a6f9-4363-86e8-8c0a38d4048c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:32:06.065370 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-753ccd51-a6f9-4363-86e8-8c0a38d4048c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: b31fb01b-045f-41f7-bf58-66c1eca839e8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:32:06.109460 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-753ccd51-a6f9-4363-86e8-8c0a38d4048c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:06.110476 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-753ccd51-a6f9-4363-86e8-8c0a38d4048c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:06.115095 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-753ccd51-a6f9-4363-86e8-8c0a38d4048c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:06.119093 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-753ccd51-a6f9-4363-86e8-8c0a38d4048c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:06.122441 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-753ccd51-a6f9-4363-86e8-8c0a38d4048c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:06.123597 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-753ccd51-a6f9-4363-86e8-8c0a38d4048c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:06.238888 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-753ccd51-a6f9-4363-86e8-8c0a38d4048c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] HTTP exception thrown: Instance b31fb01b-045f-41f7-bf58-66c1eca839e8 could not be found. Aug 31 16:32:06.251350 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-753ccd51-a6f9-4363-86e8-8c0a38d4048c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Request method failure captured: Aug 31 16:32:06.251350 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8 HTTP/1.1 Aug 31 16:32:06.251350 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:32:06.251350 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:32:06.251350 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:32:06.251350 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:32:06.251350 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:32:06.251350 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:32:06.251350 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:32:06.251350 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:32:06.251350 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4paH_G5w-Lewh6LZnRmXklLf1ya40XWD25uZ65baVRBpbj-4vWy4i5AnWd4H3SGDp4sxCxiENp5Pmk_UI3-ze2xj4kgXJvJU_1eSI3JYfEtoDAOG_48S5StQpjeOO2yWrcurlzW4wSg3Sw6jnrXt6NKcdBCorc5Vu_rwvkLY_lWj9I Aug 31 16:32:06.251350 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:32:06.251350 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:32:06.251350 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:32:06.251350 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:32:06.251350 n-d-850499-9 devstack@n-api.service[122257]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 16:32:06.251350 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:32:06.251350 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:32:06.251350 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 1c81cbf4a36943d78740dec7e7e1b4d9 Aug 31 16:32:06.251350 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1339167510 Aug 31 16:32:06.251350 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:32:06.251350 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:32:06.251350 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1c81cbf4a36943d78740dec7e7e1b4d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1c81cbf4a36943d78740dec7e7e1b4d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1c81cbf4a36943d78740dec7e7e1b4d9", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1c81cbf4a36943d78740dec7e7e1b4d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:32:06.251350 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1339167510 Aug 31 16:32:06.251350 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 1c81cbf4a36943d78740dec7e7e1b4d9 Aug 31 16:32:06.251350 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1339167510 Aug 31 16:32:06.251350 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-AttachVolumeShelveTestJSON-1339167510-project Aug 31 16:32:06.251350 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:32:06.251350 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:32:06.251350 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 6ef5541e135d48348fbb4419b29417e7 Aug 31 16:32:06.251350 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1339167510-project Aug 31 16:32:06.251350 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:32:06.251350 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance b31fb01b-045f-41f7-bf58-66c1eca839e8 could not be found. Aug 31 16:32:06.251350 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': 'b31fb01b-045f-41f7-bf58-66c1eca839e8'} Aug 31 16:32:06.251350 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:32:06.251350 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:32:06.251350 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:32:06.251350 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:32:06.251350 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:32:06.251350 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:32:06.251350 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:32:06.251350 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:32:06.251350 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:32:06.251350 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:32:06.251350 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b31fb01b-045f-41f7-bf58-66c1eca839e8 could not be found. Aug 31 16:32:06.251350 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:32:06.251350 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:32:06.251350 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:32:06.251350 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:32:06.251350 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:32:06.251350 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:32:06.251350 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:32:06.251350 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:32:06.251350 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:32:06.251350 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:32:06.251350 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:32:06.251350 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:32:06.251350 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:32:06.251350 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:32:06.251350 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:32:06.251350 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:32:06.251350 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b31fb01b-045f-41f7-bf58-66c1eca839e8 could not be found. Aug 31 16:32:06.251350 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:32:06.251350 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:32:06.256689 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:32:06.256689 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:32:06.256689 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:32:06.256689 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:32:06.256689 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:32:06.256689 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:32:06.256689 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b31fb01b-045f-41f7-bf58-66c1eca839e8 could not be found. Aug 31 16:32:06.256689 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:32:06.261243 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-753ccd51-a6f9-4363-86e8-8c0a38d4048c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Returning 404 to user: Instance b31fb01b-045f-41f7-bf58-66c1eca839e8 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:32:06.264188 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-753ccd51-a6f9-4363-86e8-8c0a38d4048c tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8" status: 404 len: 111 microversion: 2.20 time: 0.214174 Aug 31 16:32:06.267802 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3093/6164] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:32:06 2022] GET /compute/v2.1/servers/b31fb01b-045f-41f7-bf58-66c1eca839e8 => generated 111 bytes in 219 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 31 16:32:10.558585 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f0791c67-baa6-4f6a-91ba-e724b254723c tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:32:10.559989 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f0791c67-baa6-4f6a-91ba-e724b254723c tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 67606165-1130-4a84-95b9-528ec49a9831] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:32:10.576747 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f0791c67-baa6-4f6a-91ba-e724b254723c tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:10.580461 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f0791c67-baa6-4f6a-91ba-e724b254723c tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:10.581148 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f0791c67-baa6-4f6a-91ba-e724b254723c tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:10.584261 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f0791c67-baa6-4f6a-91ba-e724b254723c tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:10.584956 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f0791c67-baa6-4f6a-91ba-e724b254723c tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:10.585580 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f0791c67-baa6-4f6a-91ba-e724b254723c tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:10.652759 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f0791c67-baa6-4f6a-91ba-e724b254723c tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/67606165-1130-4a84-95b9-528ec49a9831/ips" status: 200 len: 149 microversion: 2.1 time: 0.098489 Aug 31 16:32:10.653361 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3072/6165] 10.222.0.61 () {58 vars in 1248 bytes} [Wed Aug 31 16:32:10 2022] GET /compute/v2.1/servers/67606165-1130-4a84-95b9-528ec49a9831/ips => generated 149 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:32:14.934465 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8448599d-359e-4c1c-a9f5-150437084f9e tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4200d890-178f-4b89-8980-44c0110d4501"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:32:14.938394 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8448599d-359e-4c1c-a9f5-150437084f9e tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 67606165-1130-4a84-95b9-528ec49a9831] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:32:14.954962 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8448599d-359e-4c1c-a9f5-150437084f9e tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:14.957358 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8448599d-359e-4c1c-a9f5-150437084f9e tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:14.959857 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8448599d-359e-4c1c-a9f5-150437084f9e tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:14.960894 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8448599d-359e-4c1c-a9f5-150437084f9e tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:14.961741 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8448599d-359e-4c1c-a9f5-150437084f9e tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:14.968020 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8448599d-359e-4c1c-a9f5-150437084f9e tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:15.381147 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6fa0d201-21e8-4262-97a7-8c106f3a7359 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:32:15.382346 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6fa0d201-21e8-4262-97a7-8c106f3a7359 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:32:15.391984 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6fa0d201-21e8-4262-97a7-8c106f3a7359 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:15.396198 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6fa0d201-21e8-4262-97a7-8c106f3a7359 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:15.399205 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6fa0d201-21e8-4262-97a7-8c106f3a7359 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:15.401112 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6fa0d201-21e8-4262-97a7-8c106f3a7359 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:15.404049 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6fa0d201-21e8-4262-97a7-8c106f3a7359 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:15.404832 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6fa0d201-21e8-4262-97a7-8c106f3a7359 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:15.463927 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-6fa0d201-21e8-4262-97a7-8c106f3a7359 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] HTTP exception thrown: Instance 85a0286b-2e02-4ecb-a63d-0b4a61048ab5 could not be found. Aug 31 16:32:15.465868 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6fa0d201-21e8-4262-97a7-8c106f3a7359 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Request method failure captured: Aug 31 16:32:15.465868 n-d-850499-9 devstack@n-api.service[122256]: request: DELETE /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5 HTTP/1.1 Aug 31 16:32:15.465868 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:32:15.465868 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:32:15.465868 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:32:15.465868 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:32:15.465868 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:32:15.465868 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:32:15.465868 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:32:15.465868 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:32:15.465868 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4paH_G5w-Lewh6LZnRmXklLf1ya40XWD25uZ65baVRBpbj-4vWy4i5AnWd4H3SGDp4sxCxiENp5Pmk_UI3-ze2xj4kgXJvJU_1eSI3JYfEtoDAOG_48S5StQpjeOO2yWrcurlzW4wSg3Sw6jnrXt6NKcdBCorc5Vu_rwvkLY_lWj9I Aug 31 16:32:15.465868 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:32:15.465868 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:32:15.465868 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:32:15.465868 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:32:15.465868 n-d-850499-9 devstack@n-api.service[122256]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 16:32:15.465868 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:32:15.465868 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:32:15.465868 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 1c81cbf4a36943d78740dec7e7e1b4d9 Aug 31 16:32:15.465868 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1339167510 Aug 31 16:32:15.465868 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:32:15.465868 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:32:15.465868 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1c81cbf4a36943d78740dec7e7e1b4d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1c81cbf4a36943d78740dec7e7e1b4d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1c81cbf4a36943d78740dec7e7e1b4d9", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1c81cbf4a36943d78740dec7e7e1b4d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:32:15.465868 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1339167510 Aug 31 16:32:15.465868 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 1c81cbf4a36943d78740dec7e7e1b4d9 Aug 31 16:32:15.465868 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1339167510 Aug 31 16:32:15.465868 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-AttachVolumeShelveTestJSON-1339167510-project Aug 31 16:32:15.465868 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:32:15.465868 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:32:15.465868 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 6ef5541e135d48348fbb4419b29417e7 Aug 31 16:32:15.465868 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1339167510-project Aug 31 16:32:15.465868 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:32:15.465868 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance 85a0286b-2e02-4ecb-a63d-0b4a61048ab5 could not be found. Aug 31 16:32:15.465868 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '85a0286b-2e02-4ecb-a63d-0b4a61048ab5'} Aug 31 16:32:15.465868 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:32:15.465868 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:32:15.465868 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:32:15.465868 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:32:15.465868 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:32:15.465868 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:32:15.465868 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:32:15.465868 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:32:15.465868 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:32:15.465868 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:32:15.465868 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85a0286b-2e02-4ecb-a63d-0b4a61048ab5 could not be found. Aug 31 16:32:15.465868 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:32:15.465868 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:32:15.465868 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:32:15.465868 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:32:15.465868 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:32:15.465868 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:32:15.465868 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:32:15.465868 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:32:15.465868 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:32:15.465868 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:32:15.465868 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:32:15.465868 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:32:15.465868 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:32:15.465868 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:32:15.465868 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:32:15.465868 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:32:15.465868 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:32:15.465868 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:32:15.470713 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85a0286b-2e02-4ecb-a63d-0b4a61048ab5 could not be found. Aug 31 16:32:15.470713 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:32:15.470713 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:32:15.470713 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:32:15.470713 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:32:15.470713 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:32:15.470713 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:32:15.470713 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:32:15.470713 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:32:15.470713 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85a0286b-2e02-4ecb-a63d-0b4a61048ab5 could not be found. Aug 31 16:32:15.470713 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:32:15.470713 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6fa0d201-21e8-4262-97a7-8c106f3a7359 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Returning 404 to user: Instance 85a0286b-2e02-4ecb-a63d-0b4a61048ab5 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:32:15.472204 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6fa0d201-21e8-4262-97a7-8c106f3a7359 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "DELETE /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5" status: 404 len: 111 microversion: 2.20 time: 0.090490 Aug 31 16:32:15.473350 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3073/6166] 10.222.0.61 () {60 vars in 1280 bytes} [Wed Aug 31 16:32:15 2022] DELETE /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 31 16:32:15.482932 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2b10a2f2-c767-4ff9-958f-2a04c55c5f06 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:32:15.483970 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2b10a2f2-c767-4ff9-958f-2a04c55c5f06 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] [instance: 85a0286b-2e02-4ecb-a63d-0b4a61048ab5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:32:15.493327 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2b10a2f2-c767-4ff9-958f-2a04c55c5f06 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:15.494090 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2b10a2f2-c767-4ff9-958f-2a04c55c5f06 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:15.494754 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2b10a2f2-c767-4ff9-958f-2a04c55c5f06 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:15.495734 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2b10a2f2-c767-4ff9-958f-2a04c55c5f06 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:15.496378 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2b10a2f2-c767-4ff9-958f-2a04c55c5f06 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:15.497002 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2b10a2f2-c767-4ff9-958f-2a04c55c5f06 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:15.516080 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-2b10a2f2-c767-4ff9-958f-2a04c55c5f06 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] HTTP exception thrown: Instance 85a0286b-2e02-4ecb-a63d-0b4a61048ab5 could not be found. Aug 31 16:32:15.517936 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2b10a2f2-c767-4ff9-958f-2a04c55c5f06 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Request method failure captured: Aug 31 16:32:15.517936 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5 HTTP/1.1 Aug 31 16:32:15.517936 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:32:15.517936 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:32:15.517936 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:32:15.517936 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:32:15.517936 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:32:15.517936 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:32:15.517936 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:32:15.517936 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:32:15.517936 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4paH_G5w-Lewh6LZnRmXklLf1ya40XWD25uZ65baVRBpbj-4vWy4i5AnWd4H3SGDp4sxCxiENp5Pmk_UI3-ze2xj4kgXJvJU_1eSI3JYfEtoDAOG_48S5StQpjeOO2yWrcurlzW4wSg3Sw6jnrXt6NKcdBCorc5Vu_rwvkLY_lWj9I Aug 31 16:32:15.517936 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:32:15.517936 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:32:15.517936 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:32:15.517936 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:32:15.517936 n-d-850499-9 devstack@n-api.service[122256]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 16:32:15.517936 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:32:15.517936 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:32:15.517936 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 1c81cbf4a36943d78740dec7e7e1b4d9 Aug 31 16:32:15.517936 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1339167510 Aug 31 16:32:15.517936 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:32:15.517936 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:32:15.517936 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1c81cbf4a36943d78740dec7e7e1b4d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1c81cbf4a36943d78740dec7e7e1b4d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1c81cbf4a36943d78740dec7e7e1b4d9", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1c81cbf4a36943d78740dec7e7e1b4d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:32:15.517936 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1339167510 Aug 31 16:32:15.517936 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 1c81cbf4a36943d78740dec7e7e1b4d9 Aug 31 16:32:15.517936 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1339167510 Aug 31 16:32:15.517936 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-AttachVolumeShelveTestJSON-1339167510-project Aug 31 16:32:15.517936 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:32:15.517936 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:32:15.517936 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 6ef5541e135d48348fbb4419b29417e7 Aug 31 16:32:15.517936 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1339167510-project Aug 31 16:32:15.517936 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:32:15.517936 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance 85a0286b-2e02-4ecb-a63d-0b4a61048ab5 could not be found. Aug 31 16:32:15.517936 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '85a0286b-2e02-4ecb-a63d-0b4a61048ab5'} Aug 31 16:32:15.517936 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:32:15.517936 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:32:15.517936 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:32:15.517936 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:32:15.517936 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:32:15.517936 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:32:15.517936 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:32:15.517936 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:32:15.517936 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:32:15.517936 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:32:15.517936 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85a0286b-2e02-4ecb-a63d-0b4a61048ab5 could not be found. Aug 31 16:32:15.517936 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:32:15.517936 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:32:15.517936 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:32:15.517936 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:32:15.517936 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:32:15.517936 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:32:15.517936 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:32:15.517936 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:32:15.517936 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:32:15.517936 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:32:15.517936 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:32:15.517936 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:32:15.517936 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:32:15.517936 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:32:15.517936 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:32:15.517936 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:32:15.517936 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85a0286b-2e02-4ecb-a63d-0b4a61048ab5 could not be found. Aug 31 16:32:15.517936 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:32:15.517936 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:32:15.522105 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:32:15.522105 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:32:15.522105 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:32:15.522105 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:32:15.522105 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:32:15.522105 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:32:15.522105 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85a0286b-2e02-4ecb-a63d-0b4a61048ab5 could not be found. Aug 31 16:32:15.522105 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:32:15.524548 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2b10a2f2-c767-4ff9-958f-2a04c55c5f06 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] Returning 404 to user: Instance 85a0286b-2e02-4ecb-a63d-0b4a61048ab5 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:32:15.525666 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2b10a2f2-c767-4ff9-958f-2a04c55c5f06 tempest-AttachVolumeShelveTestJSON-1339167510 tempest-AttachVolumeShelveTestJSON-1339167510-project] 10.222.0.61 "GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5" status: 404 len: 111 microversion: 2.20 time: 0.048210 Aug 31 16:32:15.526451 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3074/6167] 10.222.0.61 () {60 vars in 1277 bytes} [Wed Aug 31 16:32:15 2022] GET /compute/v2.1/servers/85a0286b-2e02-4ecb-a63d-0b4a61048ab5 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:32:15.672290 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8448599d-359e-4c1c-a9f5-150437084f9e tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "POST /compute/v2.1/servers/67606165-1130-4a84-95b9-528ec49a9831/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.738709 Aug 31 16:32:15.674280 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3094/6168] 10.222.0.61 () {60 vars in 1323 bytes} [Wed Aug 31 16:32:14 2022] POST /compute/v2.1/servers/67606165-1130-4a84-95b9-528ec49a9831/os-volume_attachments => generated 194 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:32:36.306864 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-22e261e2-fae0-46bd-a38e-db2f9bc58407 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:32:36.307440 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-22e261e2-fae0-46bd-a38e-db2f9bc58407 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 67606165-1130-4a84-95b9-528ec49a9831] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:32:36.310515 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=13 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:32:36.311217 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=64 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:32:36.317678 n-d-850499-9 devstack@n-api.service[122256]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 16:32:36.324198 n-d-850499-9 devstack@n-api.service[122256]: Wed Aug 31 16:32:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/67606165-1130-4a84-95b9-528ec49a9831/os-volume_attachments/4200d890-178f-4b89-8980-44c0110d4501 (ip 10.222.0.61) !!! Aug 31 16:32:36.354196 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-22e261e2-fae0-46bd-a38e-db2f9bc58407 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:36.362000 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-22e261e2-fae0-46bd-a38e-db2f9bc58407 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:36.362891 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-22e261e2-fae0-46bd-a38e-db2f9bc58407 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:36.369476 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-22e261e2-fae0-46bd-a38e-db2f9bc58407 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:36.370415 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-22e261e2-fae0-46bd-a38e-db2f9bc58407 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:36.371309 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-22e261e2-fae0-46bd-a38e-db2f9bc58407 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:36.667882 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-22e261e2-fae0-46bd-a38e-db2f9bc58407 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lazy-loading 'services' on Instance uuid 67606165-1130-4a84-95b9-528ec49a9831 {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:32:36.844098 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-22e261e2-fae0-46bd-a38e-db2f9bc58407 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "DELETE /compute/v2.1/servers/67606165-1130-4a84-95b9-528ec49a9831/os-volume_attachments/4200d890-178f-4b89-8980-44c0110d4501" status: 202 len: 0 microversion: 2.1 time: 0.539932 Aug 31 16:32:36.846710 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3075/6169] 10.222.0.61 () {58 vars in 1416 bytes} [Wed Aug 31 16:32:36 2022] DELETE /compute/v2.1/servers/67606165-1130-4a84-95b9-528ec49a9831/os-volume_attachments/4200d890-178f-4b89-8980-44c0110d4501 => generated 0 bytes in 545 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:32:36.857932 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a400400b-e48e-44e7-bee1-bd4ac0b21b98 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:32:36.862688 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a400400b-e48e-44e7-bee1-bd4ac0b21b98 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 67606165-1130-4a84-95b9-528ec49a9831] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:32:36.873906 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:32:36.875700 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=75,nova_cell1:UPDATE=3 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:32:36.879955 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a400400b-e48e-44e7-bee1-bd4ac0b21b98 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:36.880681 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a400400b-e48e-44e7-bee1-bd4ac0b21b98 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:36.881289 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a400400b-e48e-44e7-bee1-bd4ac0b21b98 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:36.883188 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a400400b-e48e-44e7-bee1-bd4ac0b21b98 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:36.884146 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a400400b-e48e-44e7-bee1-bd4ac0b21b98 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:36.884897 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a400400b-e48e-44e7-bee1-bd4ac0b21b98 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:37.015625 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a400400b-e48e-44e7-bee1-bd4ac0b21b98 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/67606165-1130-4a84-95b9-528ec49a9831/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.165038 Aug 31 16:32:37.019448 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3095/6170] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 16:32:36 2022] GET /compute/v2.1/servers/67606165-1130-4a84-95b9-528ec49a9831/os-volume_attachments => generated 197 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:32:38.040360 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0c53bd2a-a199-434d-b8b1-59be1efe871f tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:32:38.047752 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0c53bd2a-a199-434d-b8b1-59be1efe871f tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 67606165-1130-4a84-95b9-528ec49a9831] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:32:38.093958 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0c53bd2a-a199-434d-b8b1-59be1efe871f tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:38.099490 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0c53bd2a-a199-434d-b8b1-59be1efe871f tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:38.102121 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0c53bd2a-a199-434d-b8b1-59be1efe871f tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:38.105300 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0c53bd2a-a199-434d-b8b1-59be1efe871f tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:38.106269 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0c53bd2a-a199-434d-b8b1-59be1efe871f tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:38.107895 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0c53bd2a-a199-434d-b8b1-59be1efe871f tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:38.233960 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0c53bd2a-a199-434d-b8b1-59be1efe871f tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/67606165-1130-4a84-95b9-528ec49a9831/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.206639 Aug 31 16:32:38.238528 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3076/6171] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 16:32:38 2022] GET /compute/v2.1/servers/67606165-1130-4a84-95b9-528ec49a9831/os-volume_attachments => generated 197 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:32:39.252718 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a04692bc-30de-4ae1-b55a-0dac7e3d46e4 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:32:39.255414 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a04692bc-30de-4ae1-b55a-0dac7e3d46e4 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 67606165-1130-4a84-95b9-528ec49a9831] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:32:39.293541 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a04692bc-30de-4ae1-b55a-0dac7e3d46e4 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:39.302478 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a04692bc-30de-4ae1-b55a-0dac7e3d46e4 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:39.303163 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a04692bc-30de-4ae1-b55a-0dac7e3d46e4 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:39.304112 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a04692bc-30de-4ae1-b55a-0dac7e3d46e4 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:39.304647 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a04692bc-30de-4ae1-b55a-0dac7e3d46e4 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:39.305138 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a04692bc-30de-4ae1-b55a-0dac7e3d46e4 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:39.490083 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a04692bc-30de-4ae1-b55a-0dac7e3d46e4 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/67606165-1130-4a84-95b9-528ec49a9831/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.244116 Aug 31 16:32:39.508666 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3096/6172] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 16:32:39 2022] GET /compute/v2.1/servers/67606165-1130-4a84-95b9-528ec49a9831/os-volume_attachments => generated 197 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:32:40.519116 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-cffc357a-ba7f-495f-8825-563e0aa13050 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:32:40.524183 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-cffc357a-ba7f-495f-8825-563e0aa13050 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 67606165-1130-4a84-95b9-528ec49a9831] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:32:40.597026 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cffc357a-ba7f-495f-8825-563e0aa13050 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:40.601488 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cffc357a-ba7f-495f-8825-563e0aa13050 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:40.606671 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cffc357a-ba7f-495f-8825-563e0aa13050 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:40.613234 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cffc357a-ba7f-495f-8825-563e0aa13050 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:40.621081 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cffc357a-ba7f-495f-8825-563e0aa13050 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:40.622421 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cffc357a-ba7f-495f-8825-563e0aa13050 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:40.836635 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-cffc357a-ba7f-495f-8825-563e0aa13050 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/67606165-1130-4a84-95b9-528ec49a9831/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.321448 Aug 31 16:32:40.837514 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3077/6173] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 16:32:40 2022] GET /compute/v2.1/servers/67606165-1130-4a84-95b9-528ec49a9831/os-volume_attachments => generated 197 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:32:41.851208 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f3a13003-48a0-4c68-ba8e-71b0dfce929e tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:32:41.855120 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f3a13003-48a0-4c68-ba8e-71b0dfce929e tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 67606165-1130-4a84-95b9-528ec49a9831] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:32:41.882494 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f3a13003-48a0-4c68-ba8e-71b0dfce929e tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:41.885346 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f3a13003-48a0-4c68-ba8e-71b0dfce929e tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:41.885933 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f3a13003-48a0-4c68-ba8e-71b0dfce929e tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:41.887136 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f3a13003-48a0-4c68-ba8e-71b0dfce929e tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:41.888671 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f3a13003-48a0-4c68-ba8e-71b0dfce929e tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:41.893781 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f3a13003-48a0-4c68-ba8e-71b0dfce929e tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:42.032392 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f3a13003-48a0-4c68-ba8e-71b0dfce929e tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/67606165-1130-4a84-95b9-528ec49a9831/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.185144 Aug 31 16:32:42.040705 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3097/6174] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 16:32:41 2022] GET /compute/v2.1/servers/67606165-1130-4a84-95b9-528ec49a9831/os-volume_attachments => generated 197 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:32:43.052319 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a4e8c7b7-c7f6-4ed2-99db-33bb7fc8b5f5 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:32:43.056251 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a4e8c7b7-c7f6-4ed2-99db-33bb7fc8b5f5 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 67606165-1130-4a84-95b9-528ec49a9831] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:32:43.081323 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a4e8c7b7-c7f6-4ed2-99db-33bb7fc8b5f5 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:43.084827 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a4e8c7b7-c7f6-4ed2-99db-33bb7fc8b5f5 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:43.094596 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a4e8c7b7-c7f6-4ed2-99db-33bb7fc8b5f5 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:43.097287 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a4e8c7b7-c7f6-4ed2-99db-33bb7fc8b5f5 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:43.100929 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a4e8c7b7-c7f6-4ed2-99db-33bb7fc8b5f5 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:43.102262 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a4e8c7b7-c7f6-4ed2-99db-33bb7fc8b5f5 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:43.188430 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a4e8c7b7-c7f6-4ed2-99db-33bb7fc8b5f5 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/67606165-1130-4a84-95b9-528ec49a9831/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.146915 Aug 31 16:32:43.196307 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3078/6175] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 16:32:43 2022] GET /compute/v2.1/servers/67606165-1130-4a84-95b9-528ec49a9831/os-volume_attachments => generated 197 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:32:44.226097 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b140bdec-bed8-44e5-a293-d728082b4e51 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:32:44.247402 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b140bdec-bed8-44e5-a293-d728082b4e51 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 67606165-1130-4a84-95b9-528ec49a9831] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:32:44.293835 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b140bdec-bed8-44e5-a293-d728082b4e51 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:44.296302 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b140bdec-bed8-44e5-a293-d728082b4e51 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:44.304154 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b140bdec-bed8-44e5-a293-d728082b4e51 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:44.307693 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b140bdec-bed8-44e5-a293-d728082b4e51 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:44.308667 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b140bdec-bed8-44e5-a293-d728082b4e51 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:44.310622 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b140bdec-bed8-44e5-a293-d728082b4e51 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:44.415913 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b140bdec-bed8-44e5-a293-d728082b4e51 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/67606165-1130-4a84-95b9-528ec49a9831/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.202104 Aug 31 16:32:44.421135 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3098/6176] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 16:32:44 2022] GET /compute/v2.1/servers/67606165-1130-4a84-95b9-528ec49a9831/os-volume_attachments => generated 197 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:32:45.437272 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0f85b292-07a0-472d-a1b3-bb6a85ce6af2 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:32:45.440236 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0f85b292-07a0-472d-a1b3-bb6a85ce6af2 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 67606165-1130-4a84-95b9-528ec49a9831] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:32:45.458364 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0f85b292-07a0-472d-a1b3-bb6a85ce6af2 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:45.465996 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0f85b292-07a0-472d-a1b3-bb6a85ce6af2 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:45.470662 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0f85b292-07a0-472d-a1b3-bb6a85ce6af2 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:45.471791 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0f85b292-07a0-472d-a1b3-bb6a85ce6af2 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:45.473611 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0f85b292-07a0-472d-a1b3-bb6a85ce6af2 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:45.475281 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0f85b292-07a0-472d-a1b3-bb6a85ce6af2 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:45.592432 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0f85b292-07a0-472d-a1b3-bb6a85ce6af2 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/67606165-1130-4a84-95b9-528ec49a9831/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.165370 Aug 31 16:32:45.595276 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3079/6177] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 16:32:45 2022] GET /compute/v2.1/servers/67606165-1130-4a84-95b9-528ec49a9831/os-volume_attachments => generated 197 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:32:46.609955 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0725c33d-2c3a-4e3e-9e36-a6d5f80dcef7 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:32:46.612364 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0725c33d-2c3a-4e3e-9e36-a6d5f80dcef7 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 67606165-1130-4a84-95b9-528ec49a9831] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:32:46.655218 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0725c33d-2c3a-4e3e-9e36-a6d5f80dcef7 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:46.656136 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0725c33d-2c3a-4e3e-9e36-a6d5f80dcef7 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:46.663981 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0725c33d-2c3a-4e3e-9e36-a6d5f80dcef7 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:46.665024 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0725c33d-2c3a-4e3e-9e36-a6d5f80dcef7 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:46.667433 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0725c33d-2c3a-4e3e-9e36-a6d5f80dcef7 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:46.667953 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0725c33d-2c3a-4e3e-9e36-a6d5f80dcef7 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:46.794252 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0725c33d-2c3a-4e3e-9e36-a6d5f80dcef7 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/67606165-1130-4a84-95b9-528ec49a9831/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.188902 Aug 31 16:32:46.801927 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3099/6178] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 16:32:46 2022] GET /compute/v2.1/servers/67606165-1130-4a84-95b9-528ec49a9831/os-volume_attachments => generated 197 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:32:47.816843 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-cfb3e1f7-ea01-4f89-8167-5394692b5227 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:32:47.831210 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-cfb3e1f7-ea01-4f89-8167-5394692b5227 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 67606165-1130-4a84-95b9-528ec49a9831] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:32:47.864531 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cfb3e1f7-ea01-4f89-8167-5394692b5227 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:47.866523 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cfb3e1f7-ea01-4f89-8167-5394692b5227 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:47.869815 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cfb3e1f7-ea01-4f89-8167-5394692b5227 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:47.871312 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cfb3e1f7-ea01-4f89-8167-5394692b5227 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:47.875798 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cfb3e1f7-ea01-4f89-8167-5394692b5227 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:47.876901 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cfb3e1f7-ea01-4f89-8167-5394692b5227 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:48.008772 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-cfb3e1f7-ea01-4f89-8167-5394692b5227 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/67606165-1130-4a84-95b9-528ec49a9831/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.190720 Aug 31 16:32:48.012346 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3080/6179] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 16:32:47 2022] GET /compute/v2.1/servers/67606165-1130-4a84-95b9-528ec49a9831/os-volume_attachments => generated 197 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:32:49.022415 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-fe9a6c7c-4c9d-413e-bc33-fcef86396e95 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:32:49.028177 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-fe9a6c7c-4c9d-413e-bc33-fcef86396e95 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 67606165-1130-4a84-95b9-528ec49a9831] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:32:49.051306 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fe9a6c7c-4c9d-413e-bc33-fcef86396e95 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:49.059839 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fe9a6c7c-4c9d-413e-bc33-fcef86396e95 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:49.060869 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fe9a6c7c-4c9d-413e-bc33-fcef86396e95 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:49.061705 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fe9a6c7c-4c9d-413e-bc33-fcef86396e95 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:49.062198 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fe9a6c7c-4c9d-413e-bc33-fcef86396e95 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:49.062641 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fe9a6c7c-4c9d-413e-bc33-fcef86396e95 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:49.128920 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-fe9a6c7c-4c9d-413e-bc33-fcef86396e95 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/67606165-1130-4a84-95b9-528ec49a9831/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.111366 Aug 31 16:32:49.129422 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3100/6180] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 16:32:49 2022] GET /compute/v2.1/servers/67606165-1130-4a84-95b9-528ec49a9831/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:32:50.154421 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ca5e4b8e-ee2a-4434-a757-e025496e2676 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:32:50.164340 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ca5e4b8e-ee2a-4434-a757-e025496e2676 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 67606165-1130-4a84-95b9-528ec49a9831] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:32:50.195834 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ca5e4b8e-ee2a-4434-a757-e025496e2676 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:50.207783 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ca5e4b8e-ee2a-4434-a757-e025496e2676 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:50.208520 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ca5e4b8e-ee2a-4434-a757-e025496e2676 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:50.209806 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ca5e4b8e-ee2a-4434-a757-e025496e2676 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:50.210668 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ca5e4b8e-ee2a-4434-a757-e025496e2676 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:50.211304 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ca5e4b8e-ee2a-4434-a757-e025496e2676 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:50.369669 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ca5e4b8e-ee2a-4434-a757-e025496e2676 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/67606165-1130-4a84-95b9-528ec49a9831/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.226621 Aug 31 16:32:50.375849 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3081/6181] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 16:32:50 2022] GET /compute/v2.1/servers/67606165-1130-4a84-95b9-528ec49a9831/os-volume_attachments => generated 197 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:32:51.391902 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2b65f20c-7d24-4e01-ab79-1405ecfeeba6 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:32:51.397744 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2b65f20c-7d24-4e01-ab79-1405ecfeeba6 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 67606165-1130-4a84-95b9-528ec49a9831] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:32:51.416579 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2b65f20c-7d24-4e01-ab79-1405ecfeeba6 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:51.418326 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2b65f20c-7d24-4e01-ab79-1405ecfeeba6 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:51.421326 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2b65f20c-7d24-4e01-ab79-1405ecfeeba6 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:51.423763 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2b65f20c-7d24-4e01-ab79-1405ecfeeba6 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:51.425820 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2b65f20c-7d24-4e01-ab79-1405ecfeeba6 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:51.426539 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2b65f20c-7d24-4e01-ab79-1405ecfeeba6 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:51.517695 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2b65f20c-7d24-4e01-ab79-1405ecfeeba6 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/67606165-1130-4a84-95b9-528ec49a9831/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.132041 Aug 31 16:32:51.519203 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3101/6182] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 16:32:51 2022] GET /compute/v2.1/servers/67606165-1130-4a84-95b9-528ec49a9831/os-volume_attachments => generated 25 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 16:32:51.617088 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f439335a-746b-4f9d-a8c6-2533524232ce tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:32:51.617967 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f439335a-746b-4f9d-a8c6-2533524232ce tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 67606165-1130-4a84-95b9-528ec49a9831] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:32:51.658042 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f439335a-746b-4f9d-a8c6-2533524232ce tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:51.658549 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f439335a-746b-4f9d-a8c6-2533524232ce tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:51.664285 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f439335a-746b-4f9d-a8c6-2533524232ce tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:51.665695 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f439335a-746b-4f9d-a8c6-2533524232ce tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:51.666349 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f439335a-746b-4f9d-a8c6-2533524232ce tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:51.676257 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f439335a-746b-4f9d-a8c6-2533524232ce tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:51.820597 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f439335a-746b-4f9d-a8c6-2533524232ce tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 67606165-1130-4a84-95b9-528ec49a9831] Going to try to terminate instance {{(pid=122256) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:32:52.097424 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f439335a-746b-4f9d-a8c6-2533524232ce tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "DELETE /compute/v2.1/servers/67606165-1130-4a84-95b9-528ec49a9831" status: 204 len: 0 microversion: 2.1 time: 0.482747 Aug 31 16:32:52.108198 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3082/6183] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:32:51 2022] DELETE /compute/v2.1/servers/67606165-1130-4a84-95b9-528ec49a9831 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:32:52.130109 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ba534658-28c9-40e3-b0c3-7266e47906d4 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:32:52.132058 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ba534658-28c9-40e3-b0c3-7266e47906d4 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 67606165-1130-4a84-95b9-528ec49a9831] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:32:52.142356 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ba534658-28c9-40e3-b0c3-7266e47906d4 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:52.143809 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ba534658-28c9-40e3-b0c3-7266e47906d4 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:52.144437 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ba534658-28c9-40e3-b0c3-7266e47906d4 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:52.145635 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ba534658-28c9-40e3-b0c3-7266e47906d4 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:52.146253 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ba534658-28c9-40e3-b0c3-7266e47906d4 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:52.146825 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ba534658-28c9-40e3-b0c3-7266e47906d4 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:53.112456 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ba534658-28c9-40e3-b0c3-7266e47906d4 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133363b2b12d4730994557ee24f08879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d9ba3589a24faaac930a35742ce834', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:32:53.137756 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ba534658-28c9-40e3-b0c3-7266e47906d4 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/67606165-1130-4a84-95b9-528ec49a9831" status: 200 len: 1681 microversion: 2.1 time: 1.027860 Aug 31 16:32:53.139522 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3102/6184] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:32:52 2022] GET /compute/v2.1/servers/67606165-1130-4a84-95b9-528ec49a9831 => generated 1681 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:32:54.181669 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8b7e27b9-70f2-406e-a36a-b462aeb1eeda tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:32:54.182533 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8b7e27b9-70f2-406e-a36a-b462aeb1eeda tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 67606165-1130-4a84-95b9-528ec49a9831] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:32:54.193975 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8b7e27b9-70f2-406e-a36a-b462aeb1eeda tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:54.196683 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8b7e27b9-70f2-406e-a36a-b462aeb1eeda tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:54.198646 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8b7e27b9-70f2-406e-a36a-b462aeb1eeda tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:54.203536 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8b7e27b9-70f2-406e-a36a-b462aeb1eeda tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:54.204934 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8b7e27b9-70f2-406e-a36a-b462aeb1eeda tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:54.205945 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8b7e27b9-70f2-406e-a36a-b462aeb1eeda tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:55.588030 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8b7e27b9-70f2-406e-a36a-b462aeb1eeda tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133363b2b12d4730994557ee24f08879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d9ba3589a24faaac930a35742ce834', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:32:55.661363 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8b7e27b9-70f2-406e-a36a-b462aeb1eeda tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/67606165-1130-4a84-95b9-528ec49a9831" status: 200 len: 1681 microversion: 2.1 time: 1.478673 Aug 31 16:32:55.679008 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3083/6185] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:32:54 2022] GET /compute/v2.1/servers/67606165-1130-4a84-95b9-528ec49a9831 => generated 1681 bytes in 1505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:32:56.685319 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c9b13093-7130-407b-baf4-e8802adfff75 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:32:56.686548 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c9b13093-7130-407b-baf4-e8802adfff75 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 67606165-1130-4a84-95b9-528ec49a9831] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:32:56.717787 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c9b13093-7130-407b-baf4-e8802adfff75 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:56.718585 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c9b13093-7130-407b-baf4-e8802adfff75 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:56.719053 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c9b13093-7130-407b-baf4-e8802adfff75 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:56.720468 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c9b13093-7130-407b-baf4-e8802adfff75 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:56.721429 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c9b13093-7130-407b-baf4-e8802adfff75 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:56.724226 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c9b13093-7130-407b-baf4-e8802adfff75 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:58.168591 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c9b13093-7130-407b-baf4-e8802adfff75 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133363b2b12d4730994557ee24f08879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d9ba3589a24faaac930a35742ce834', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:32:58.188154 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c9b13093-7130-407b-baf4-e8802adfff75 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/67606165-1130-4a84-95b9-528ec49a9831" status: 200 len: 1681 microversion: 2.1 time: 1.513438 Aug 31 16:32:58.202936 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3103/6186] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:32:56 2022] GET /compute/v2.1/servers/67606165-1130-4a84-95b9-528ec49a9831 => generated 1681 bytes in 1529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:32:59.213545 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-41104bdd-9e0e-4495-9909-fa832fc2de3f tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:32:59.215044 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-41104bdd-9e0e-4495-9909-fa832fc2de3f tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 67606165-1130-4a84-95b9-528ec49a9831] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:32:59.236562 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-41104bdd-9e0e-4495-9909-fa832fc2de3f tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:59.239589 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-41104bdd-9e0e-4495-9909-fa832fc2de3f tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:59.242125 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-41104bdd-9e0e-4495-9909-fa832fc2de3f tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:59.244790 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-41104bdd-9e0e-4495-9909-fa832fc2de3f tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:59.246000 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-41104bdd-9e0e-4495-9909-fa832fc2de3f tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:59.249865 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-41104bdd-9e0e-4495-9909-fa832fc2de3f tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:00.368227 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-41104bdd-9e0e-4495-9909-fa832fc2de3f tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133363b2b12d4730994557ee24f08879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d9ba3589a24faaac930a35742ce834', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:33:00.396205 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-41104bdd-9e0e-4495-9909-fa832fc2de3f tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/67606165-1130-4a84-95b9-528ec49a9831" status: 200 len: 1613 microversion: 2.1 time: 1.188060 Aug 31 16:33:00.398193 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3084/6187] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:32:59 2022] GET /compute/v2.1/servers/67606165-1130-4a84-95b9-528ec49a9831 => generated 1613 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:33:01.017751 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-b5db859c-e9c6-41a4-9771-309cfe878b2d req-a5639f48-a6a6-48cc-a689-974d716ef5bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67606165-1130-4a84-95b9-528ec49a9831", "name": "network-vif-deleted", "tag": "7afb154b-9ec1-4720-9dde-37860b970bf5"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:33:01.046531 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-b5db859c-e9c6-41a4-9771-309cfe878b2d req-a5639f48-a6a6-48cc-a689-974d716ef5bd service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:01.047308 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-b5db859c-e9c6-41a4-9771-309cfe878b2d req-a5639f48-a6a6-48cc-a689-974d716ef5bd service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:01.048033 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-b5db859c-e9c6-41a4-9771-309cfe878b2d req-a5639f48-a6a6-48cc-a689-974d716ef5bd service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:01.061928 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-b5db859c-e9c6-41a4-9771-309cfe878b2d req-a5639f48-a6a6-48cc-a689-974d716ef5bd service nova] Creating event network-vif-deleted:7afb154b-9ec1-4720-9dde-37860b970bf5 for instance 67606165-1130-4a84-95b9-528ec49a9831 on n-h1-850499-9 Aug 31 16:33:01.081400 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-b5db859c-e9c6-41a4-9771-309cfe878b2d req-a5639f48-a6a6-48cc-a689-974d716ef5bd service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074697 Aug 31 16:33:01.082411 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3104/6188] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:33:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:33:01.433918 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e1ebdcba-9691-4605-9014-b7fa4416f2f8 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:33:01.435097 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e1ebdcba-9691-4605-9014-b7fa4416f2f8 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 67606165-1130-4a84-95b9-528ec49a9831] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:33:01.446965 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e1ebdcba-9691-4605-9014-b7fa4416f2f8 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:01.449660 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e1ebdcba-9691-4605-9014-b7fa4416f2f8 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:01.456130 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e1ebdcba-9691-4605-9014-b7fa4416f2f8 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:01.461949 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e1ebdcba-9691-4605-9014-b7fa4416f2f8 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:01.462873 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e1ebdcba-9691-4605-9014-b7fa4416f2f8 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:01.464568 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e1ebdcba-9691-4605-9014-b7fa4416f2f8 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:01.592803 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e1ebdcba-9691-4605-9014-b7fa4416f2f8 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:01.598886 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e1ebdcba-9691-4605-9014-b7fa4416f2f8 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:01.600138 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e1ebdcba-9691-4605-9014-b7fa4416f2f8 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:01.607060 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-e1ebdcba-9691-4605-9014-b7fa4416f2f8 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lazy-loading 'fault' on Instance uuid 67606165-1130-4a84-95b9-528ec49a9831 {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:33:01.727704 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e1ebdcba-9691-4605-9014-b7fa4416f2f8 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133363b2b12d4730994557ee24f08879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d9ba3589a24faaac930a35742ce834', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:33:01.741065 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e1ebdcba-9691-4605-9014-b7fa4416f2f8 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/67606165-1130-4a84-95b9-528ec49a9831" status: 200 len: 1331 microversion: 2.1 time: 0.311074 Aug 31 16:33:01.749263 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3085/6189] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:33:01 2022] GET /compute/v2.1/servers/67606165-1130-4a84-95b9-528ec49a9831 => generated 1331 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:33:02.573543 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-bcabba12-f3df-40d6-8c7e-3956932e0013 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Action: 'create', calling method: .version_select at 0x7f5ae3cbbca0>, body: {"keypair": {"name": "tempest-TestServerBasicOps-1288760491", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDLfN9P6ILnERi1HZV0XUqYN8FAp0SQ927buzz0c4wsAwH1cYUVIsiobHS9rcuNR004L+muzsaNpWgrPW/bXEJs3vaoRKCV9BjePBRWSuQUaMshPsPXqsGP78erXMLoweQ=="}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:33:02.633808 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-bcabba12-f3df-40d6-8c7e-3956932e0013 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Getting quotas for project 51792b273f9f4220984586388169abf7. Resources: {'key_pairs'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:33:02.658269 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-bcabba12-f3df-40d6-8c7e-3956932e0013 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Getting quotas for user 0ae50daa6a6745d0a8f1ff15e6df1d50 and project 51792b273f9f4220984586388169abf7. Resources: {'key_pairs'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:33:02.709161 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-bcabba12-f3df-40d6-8c7e-3956932e0013 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.809094 Aug 31 16:33:02.712186 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3105/6190] 10.222.0.61 () {60 vars in 1159 bytes} [Wed Aug 31 16:33:01 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:33:02.795221 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-64411f8a-8714-4095-ae73-8546285f60d0 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:33:02.799619 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-64411f8a-8714-4095-ae73-8546285f60d0 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 67606165-1130-4a84-95b9-528ec49a9831] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:33:02.828486 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-64411f8a-8714-4095-ae73-8546285f60d0 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:02.829196 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-64411f8a-8714-4095-ae73-8546285f60d0 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:02.829848 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-64411f8a-8714-4095-ae73-8546285f60d0 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:02.830885 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-64411f8a-8714-4095-ae73-8546285f60d0 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:02.831669 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-64411f8a-8714-4095-ae73-8546285f60d0 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:02.832307 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-64411f8a-8714-4095-ae73-8546285f60d0 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:02.877425 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-64411f8a-8714-4095-ae73-8546285f60d0 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] HTTP exception thrown: Instance 67606165-1130-4a84-95b9-528ec49a9831 could not be found. Aug 31 16:33:02.885275 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-64411f8a-8714-4095-ae73-8546285f60d0 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Request method failure captured: Aug 31 16:33:02.885275 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/67606165-1130-4a84-95b9-528ec49a9831 HTTP/1.1 Aug 31 16:33:02.885275 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:33:02.885275 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:33:02.885275 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:33:02.885275 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:33:02.885275 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:33:02.885275 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:33:02.885275 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:33:02.885275 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:33:02.885275 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4rNdtL8Hp93envnJYgxrkKzEuKKLro2yD65tuaCjxV170sTEb0vV7K7CSwqb17J41LEaCf2veX7M0gQMtVuIZTkoy1EqZ7hcQ7-sxxS5qnxJzqp8zg_d5_eF53mYW1SiUWmb2sxTco76Ig5gniRxyga2-esulxOQeqjncU6078g4lk Aug 31 16:33:02.885275 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:33:02.885275 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:33:02.885275 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:33:02.885275 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:33:02.885275 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:33:02.885275 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:33:02.885275 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 79d9ba3589a24faaac930a35742ce834 Aug 31 16:33:02.885275 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-AttachVolumeNegativeTest-1703723156 Aug 31 16:33:02.885275 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:33:02.885275 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:33:02.885275 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/79d9ba3589a24faaac930a35742ce834"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/79d9ba3589a24faaac930a35742ce834"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_79d9ba3589a24faaac930a35742ce834", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/79d9ba3589a24faaac930a35742ce834"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:33:02.885275 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-AttachVolumeNegativeTest-1703723156 Aug 31 16:33:02.885275 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 79d9ba3589a24faaac930a35742ce834 Aug 31 16:33:02.885275 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1703723156 Aug 31 16:33:02.885275 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-AttachVolumeNegativeTest-1703723156-project Aug 31 16:33:02.885275 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:33:02.885275 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:33:02.885275 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 133363b2b12d4730994557ee24f08879 Aug 31 16:33:02.885275 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-AttachVolumeNegativeTest-1703723156-project Aug 31 16:33:02.885275 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:33:02.885275 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance 67606165-1130-4a84-95b9-528ec49a9831 could not be found. Aug 31 16:33:02.885275 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '67606165-1130-4a84-95b9-528ec49a9831'} Aug 31 16:33:02.885275 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:33:02.885275 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:33:02.885275 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:33:02.885275 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:33:02.885275 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:33:02.885275 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:33:02.885275 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:33:02.885275 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:33:02.885275 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:33:02.885275 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:33:02.885275 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67606165-1130-4a84-95b9-528ec49a9831 could not be found. Aug 31 16:33:02.885275 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:33:02.885275 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:33:02.885275 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:33:02.885275 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:33:02.885275 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:33:02.885275 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:33:02.885275 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:33:02.885275 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:33:02.885275 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:33:02.885275 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:33:02.885275 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:33:02.885275 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:33:02.885275 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:33:02.885275 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:33:02.885275 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:33:02.885275 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:33:02.885275 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67606165-1130-4a84-95b9-528ec49a9831 could not be found. Aug 31 16:33:02.885275 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:33:02.885275 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:33:02.885275 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:33:02.890910 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:33:02.890910 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:33:02.890910 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:33:02.890910 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:33:02.890910 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:33:02.890910 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67606165-1130-4a84-95b9-528ec49a9831 could not be found. Aug 31 16:33:02.890910 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:33:02.894088 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-64411f8a-8714-4095-ae73-8546285f60d0 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Returning 404 to user: Instance 67606165-1130-4a84-95b9-528ec49a9831 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:33:02.898021 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-64411f8a-8714-4095-ae73-8546285f60d0 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/67606165-1130-4a84-95b9-528ec49a9831" status: 404 len: 111 microversion: 2.1 time: 0.110329 Aug 31 16:33:02.899817 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3086/6191] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:33:02 2022] GET /compute/v2.1/servers/67606165-1130-4a84-95b9-528ec49a9831 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 16:33:02.909409 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e14fcd48-318b-4f87-a822-413c71e2a8d2 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '.version_select at 0x7f5ae3a1cee0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:33:02.955145 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e14fcd48-318b-4f87-a822-413c71e2a8d2 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2036783011" status: 202 len: 0 microversion: 2.1 time: 0.049190 Aug 31 16:33:02.956454 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3106/6192] 10.222.0.61 () {58 vars in 1221 bytes} [Wed Aug 31 16:33:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2036783011 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:33:08.398101 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1af594b7-c389-405f-ba50-cd7fedcac97c tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-2022991268", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-1288760491", "security_groups": [{"name": "tempest-secgroup-smoke-1384954981"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "5f6ea7b4-8d38-4e0d-a5d7-5bb663da77d9"}]}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:33:08.470096 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:33:08.987154 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-1af594b7-c389-405f-ba50-cd7fedcac97c tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] validate_networks() for [('5f6ea7b4-8d38-4e0d-a5d7-5bb663da77d9', None, None, None, None, None)] {{(pid=122256) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:33:12.241939 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-1af594b7-c389-405f-ba50-cd7fedcac97c tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Getting quotas for project 51792b273f9f4220984586388169abf7. Resources: dict_keys(['metadata_items']) {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:33:12.255722 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-1af594b7-c389-405f-ba50-cd7fedcac97c tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Getting quotas for user 0ae50daa6a6745d0a8f1ff15e6df1d50 and project 51792b273f9f4220984586388169abf7. Resources: dict_keys(['metadata_items']) {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:33:12.289921 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-1af594b7-c389-405f-ba50-cd7fedcac97c tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:33:12.290503 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-1af594b7-c389-405f-ba50-cd7fedcac97c tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:33:12.291055 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-1af594b7-c389-405f-ba50-cd7fedcac97c tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:33:12.291475 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-1af594b7-c389-405f-ba50-cd7fedcac97c tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:33:12.291911 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-1af594b7-c389-405f-ba50-cd7fedcac97c tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:33:12.316334 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1af594b7-c389-405f-ba50-cd7fedcac97c tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:12.316901 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1af594b7-c389-405f-ba50-cd7fedcac97c tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:12.317344 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1af594b7-c389-405f-ba50-cd7fedcac97c tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:12.318083 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1af594b7-c389-405f-ba50-cd7fedcac97c tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:12.318542 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1af594b7-c389-405f-ba50-cd7fedcac97c tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:12.318970 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1af594b7-c389-405f-ba50-cd7fedcac97c tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:12.351459 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=82,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:33:12.403375 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-1af594b7-c389-405f-ba50-cd7fedcac97c tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Getting quotas for project 51792b273f9f4220984586388169abf7. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:33:12.414156 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-1af594b7-c389-405f-ba50-cd7fedcac97c tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Getting quotas for user 0ae50daa6a6745d0a8f1ff15e6df1d50 and project 51792b273f9f4220984586388169abf7. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:33:12.470554 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1af594b7-c389-405f-ba50-cd7fedcac97c tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Going to run 1 instances... {{(pid=122256) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:33:12.475628 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1af594b7-c389-405f-ba50-cd7fedcac97c tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] [instance: 8a795e58-f921-411c-8660-0be993ad8aac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:33:12.685405 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1af594b7-c389-405f-ba50-cd7fedcac97c tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 4.296684 Aug 31 16:33:12.687872 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3087/6193] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:33:08 2022] POST /compute/v2.1/servers => generated 406 bytes in 4301 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:33:12.703162 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-25dd3a3f-63b6-4607-a27f-9fbc36b0b73c tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:33:12.704155 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-25dd3a3f-63b6-4607-a27f-9fbc36b0b73c tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] [instance: 8a795e58-f921-411c-8660-0be993ad8aac] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:33:12.728875 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=56 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:33:12.729901 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=4 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:33:12.733182 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:33:13.328623 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-25dd3a3f-63b6-4607-a27f-9fbc36b0b73c tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae50daa6a6745d0a8f1ff15e6df1d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51792b273f9f4220984586388169abf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:33:13.365798 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-25dd3a3f-63b6-4607-a27f-9fbc36b0b73c tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] 10.222.0.61 "GET /compute/v2.1/servers/8a795e58-f921-411c-8660-0be993ad8aac" status: 200 len: 1303 microversion: 2.1 time: 0.667794 Aug 31 16:33:13.393241 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3107/6194] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:33:12 2022] GET /compute/v2.1/servers/8a795e58-f921-411c-8660-0be993ad8aac => generated 1303 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:33:13.697512 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-78bc4eb1-6e17-44dc-b7ff-589bb1778a94 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:33:13.702089 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-78bc4eb1-6e17-44dc-b7ff-589bb1778a94 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 67606165-1130-4a84-95b9-528ec49a9831] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:33:13.715757 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-78bc4eb1-6e17-44dc-b7ff-589bb1778a94 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:13.716687 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-78bc4eb1-6e17-44dc-b7ff-589bb1778a94 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:13.717761 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-78bc4eb1-6e17-44dc-b7ff-589bb1778a94 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:13.720429 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-78bc4eb1-6e17-44dc-b7ff-589bb1778a94 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:13.721873 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-78bc4eb1-6e17-44dc-b7ff-589bb1778a94 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:13.724475 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-78bc4eb1-6e17-44dc-b7ff-589bb1778a94 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:13.764173 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-78bc4eb1-6e17-44dc-b7ff-589bb1778a94 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] HTTP exception thrown: Instance 67606165-1130-4a84-95b9-528ec49a9831 could not be found. Aug 31 16:33:13.772833 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-78bc4eb1-6e17-44dc-b7ff-589bb1778a94 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Request method failure captured: Aug 31 16:33:13.772833 n-d-850499-9 devstack@n-api.service[122256]: request: DELETE /compute/v2.1/servers/67606165-1130-4a84-95b9-528ec49a9831 HTTP/1.1 Aug 31 16:33:13.772833 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:33:13.772833 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:33:13.772833 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:33:13.772833 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:33:13.772833 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:33:13.772833 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:33:13.772833 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:33:13.772833 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:33:13.772833 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4rNdtL8Hp93envnJYgxrkKzEuKKLro2yD65tuaCjxV170sTEb0vV7K7CSwqb17J41LEaCf2veX7M0gQMtVuIZTkoy1EqZ7hcQ7-sxxS5qnxJzqp8zg_d5_eF53mYW1SiUWmb2sxTco76Ig5gniRxyga2-esulxOQeqjncU6078g4lk Aug 31 16:33:13.772833 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:33:13.772833 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:33:13.772833 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:33:13.772833 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:33:13.772833 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:33:13.772833 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:33:13.772833 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 79d9ba3589a24faaac930a35742ce834 Aug 31 16:33:13.772833 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-AttachVolumeNegativeTest-1703723156 Aug 31 16:33:13.772833 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:33:13.772833 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:33:13.772833 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/79d9ba3589a24faaac930a35742ce834"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/79d9ba3589a24faaac930a35742ce834"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_79d9ba3589a24faaac930a35742ce834", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/79d9ba3589a24faaac930a35742ce834"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:33:13.772833 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-AttachVolumeNegativeTest-1703723156 Aug 31 16:33:13.772833 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 79d9ba3589a24faaac930a35742ce834 Aug 31 16:33:13.772833 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1703723156 Aug 31 16:33:13.772833 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-AttachVolumeNegativeTest-1703723156-project Aug 31 16:33:13.772833 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:33:13.772833 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:33:13.772833 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 133363b2b12d4730994557ee24f08879 Aug 31 16:33:13.772833 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-AttachVolumeNegativeTest-1703723156-project Aug 31 16:33:13.772833 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:33:13.772833 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance 67606165-1130-4a84-95b9-528ec49a9831 could not be found. Aug 31 16:33:13.772833 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '67606165-1130-4a84-95b9-528ec49a9831'} Aug 31 16:33:13.772833 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:33:13.772833 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:33:13.772833 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:33:13.772833 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:33:13.772833 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:33:13.772833 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:33:13.772833 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:33:13.772833 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:33:13.772833 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:33:13.772833 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:33:13.772833 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67606165-1130-4a84-95b9-528ec49a9831 could not be found. Aug 31 16:33:13.772833 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:33:13.772833 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:33:13.772833 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:33:13.772833 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:33:13.772833 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:33:13.772833 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:33:13.772833 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:33:13.772833 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:33:13.772833 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:33:13.772833 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:33:13.772833 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:33:13.772833 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:33:13.772833 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:33:13.772833 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:33:13.772833 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:33:13.772833 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:33:13.772833 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:33:13.772833 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:33:13.778178 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67606165-1130-4a84-95b9-528ec49a9831 could not be found. Aug 31 16:33:13.778178 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:33:13.778178 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:33:13.778178 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:33:13.778178 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:33:13.778178 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:33:13.778178 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:33:13.778178 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:33:13.778178 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:33:13.778178 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67606165-1130-4a84-95b9-528ec49a9831 could not be found. Aug 31 16:33:13.778178 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:33:13.780118 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-78bc4eb1-6e17-44dc-b7ff-589bb1778a94 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Returning 404 to user: Instance 67606165-1130-4a84-95b9-528ec49a9831 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:33:13.784049 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-78bc4eb1-6e17-44dc-b7ff-589bb1778a94 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "DELETE /compute/v2.1/servers/67606165-1130-4a84-95b9-528ec49a9831" status: 404 len: 111 microversion: 2.1 time: 0.096760 Aug 31 16:33:13.787675 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3088/6195] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:33:13 2022] DELETE /compute/v2.1/servers/67606165-1130-4a84-95b9-528ec49a9831 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:33:13.798435 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-121d94f8-52ce-47f9-be80-db809ac01590 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:33:13.799408 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-121d94f8-52ce-47f9-be80-db809ac01590 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 67606165-1130-4a84-95b9-528ec49a9831] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:33:13.818174 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-121d94f8-52ce-47f9-be80-db809ac01590 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:13.818807 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-121d94f8-52ce-47f9-be80-db809ac01590 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:13.819676 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-121d94f8-52ce-47f9-be80-db809ac01590 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:13.821146 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-121d94f8-52ce-47f9-be80-db809ac01590 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:13.821874 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-121d94f8-52ce-47f9-be80-db809ac01590 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:13.824279 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-121d94f8-52ce-47f9-be80-db809ac01590 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:13.863394 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-121d94f8-52ce-47f9-be80-db809ac01590 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] HTTP exception thrown: Instance 67606165-1130-4a84-95b9-528ec49a9831 could not be found. Aug 31 16:33:13.870286 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-121d94f8-52ce-47f9-be80-db809ac01590 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Request method failure captured: Aug 31 16:33:13.870286 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/67606165-1130-4a84-95b9-528ec49a9831 HTTP/1.1 Aug 31 16:33:13.870286 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:33:13.870286 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:33:13.870286 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:33:13.870286 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:33:13.870286 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:33:13.870286 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:33:13.870286 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:33:13.870286 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:33:13.870286 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4rNdtL8Hp93envnJYgxrkKzEuKKLro2yD65tuaCjxV170sTEb0vV7K7CSwqb17J41LEaCf2veX7M0gQMtVuIZTkoy1EqZ7hcQ7-sxxS5qnxJzqp8zg_d5_eF53mYW1SiUWmb2sxTco76Ig5gniRxyga2-esulxOQeqjncU6078g4lk Aug 31 16:33:13.870286 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:33:13.870286 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:33:13.870286 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:33:13.870286 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:33:13.870286 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:33:13.870286 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:33:13.870286 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 79d9ba3589a24faaac930a35742ce834 Aug 31 16:33:13.870286 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-AttachVolumeNegativeTest-1703723156 Aug 31 16:33:13.870286 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:33:13.870286 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:33:13.870286 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/79d9ba3589a24faaac930a35742ce834"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/79d9ba3589a24faaac930a35742ce834"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_79d9ba3589a24faaac930a35742ce834", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/79d9ba3589a24faaac930a35742ce834"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:33:13.870286 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-AttachVolumeNegativeTest-1703723156 Aug 31 16:33:13.870286 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 79d9ba3589a24faaac930a35742ce834 Aug 31 16:33:13.870286 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1703723156 Aug 31 16:33:13.870286 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-AttachVolumeNegativeTest-1703723156-project Aug 31 16:33:13.870286 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:33:13.870286 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:33:13.870286 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 133363b2b12d4730994557ee24f08879 Aug 31 16:33:13.870286 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-AttachVolumeNegativeTest-1703723156-project Aug 31 16:33:13.870286 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:33:13.870286 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance 67606165-1130-4a84-95b9-528ec49a9831 could not be found. Aug 31 16:33:13.870286 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '67606165-1130-4a84-95b9-528ec49a9831'} Aug 31 16:33:13.870286 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:33:13.870286 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:33:13.870286 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:33:13.870286 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:33:13.870286 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:33:13.870286 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:33:13.870286 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:33:13.870286 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:33:13.870286 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:33:13.870286 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:33:13.870286 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67606165-1130-4a84-95b9-528ec49a9831 could not be found. Aug 31 16:33:13.870286 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:33:13.870286 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:33:13.870286 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:33:13.870286 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:33:13.870286 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:33:13.870286 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:33:13.870286 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:33:13.870286 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:33:13.870286 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:33:13.870286 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:33:13.870286 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:33:13.870286 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:33:13.870286 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:33:13.870286 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:33:13.870286 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:33:13.870286 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:33:13.870286 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67606165-1130-4a84-95b9-528ec49a9831 could not be found. Aug 31 16:33:13.870286 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:33:13.870286 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:33:13.870286 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:33:13.880523 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:33:13.880523 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:33:13.880523 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:33:13.880523 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:33:13.880523 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:33:13.880523 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67606165-1130-4a84-95b9-528ec49a9831 could not be found. Aug 31 16:33:13.880523 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:33:13.884328 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-121d94f8-52ce-47f9-be80-db809ac01590 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Returning 404 to user: Instance 67606165-1130-4a84-95b9-528ec49a9831 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:33:13.887136 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-121d94f8-52ce-47f9-be80-db809ac01590 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/67606165-1130-4a84-95b9-528ec49a9831" status: 404 len: 111 microversion: 2.1 time: 0.095273 Aug 31 16:33:13.905914 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3108/6196] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:33:13 2022] GET /compute/v2.1/servers/67606165-1130-4a84-95b9-528ec49a9831 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:33:14.405181 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c1cfb051-a8a1-412a-ac78-0ac13e98ce43 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:33:14.405821 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c1cfb051-a8a1-412a-ac78-0ac13e98ce43 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] [instance: 8a795e58-f921-411c-8660-0be993ad8aac] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:33:14.713307 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c1cfb051-a8a1-412a-ac78-0ac13e98ce43 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae50daa6a6745d0a8f1ff15e6df1d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51792b273f9f4220984586388169abf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:33:14.729778 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c1cfb051-a8a1-412a-ac78-0ac13e98ce43 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] 10.222.0.61 "GET /compute/v2.1/servers/8a795e58-f921-411c-8660-0be993ad8aac" status: 200 len: 1303 microversion: 2.1 time: 0.328304 Aug 31 16:33:14.731136 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3089/6197] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:33:14 2022] GET /compute/v2.1/servers/8a795e58-f921-411c-8660-0be993ad8aac => generated 1303 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:33:15.766700 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-bcd71a91-37f2-4da3-af32-9e62c13d44ca tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:33:15.769482 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-bcd71a91-37f2-4da3-af32-9e62c13d44ca tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] [instance: 8a795e58-f921-411c-8660-0be993ad8aac] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:33:15.800434 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bcd71a91-37f2-4da3-af32-9e62c13d44ca tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:15.803384 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bcd71a91-37f2-4da3-af32-9e62c13d44ca tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:15.835458 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bcd71a91-37f2-4da3-af32-9e62c13d44ca tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:15.840194 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bcd71a91-37f2-4da3-af32-9e62c13d44ca tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:15.842091 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bcd71a91-37f2-4da3-af32-9e62c13d44ca tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:15.845547 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bcd71a91-37f2-4da3-af32-9e62c13d44ca tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:16.726615 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-bcd71a91-37f2-4da3-af32-9e62c13d44ca tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae50daa6a6745d0a8f1ff15e6df1d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51792b273f9f4220984586388169abf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:33:16.745012 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-bcd71a91-37f2-4da3-af32-9e62c13d44ca tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] 10.222.0.61 "GET /compute/v2.1/servers/8a795e58-f921-411c-8660-0be993ad8aac" status: 200 len: 1355 microversion: 2.1 time: 0.989019 Aug 31 16:33:16.747582 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3109/6198] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:33:15 2022] GET /compute/v2.1/servers/8a795e58-f921-411c-8660-0be993ad8aac => generated 1355 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:33:17.778581 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-96d991f2-5a39-4d6d-a482-269a917d8560 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:33:17.780735 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-96d991f2-5a39-4d6d-a482-269a917d8560 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] [instance: 8a795e58-f921-411c-8660-0be993ad8aac] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:33:17.829977 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-96d991f2-5a39-4d6d-a482-269a917d8560 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:17.830616 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-96d991f2-5a39-4d6d-a482-269a917d8560 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:17.831184 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-96d991f2-5a39-4d6d-a482-269a917d8560 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:17.832493 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-96d991f2-5a39-4d6d-a482-269a917d8560 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:17.842241 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-96d991f2-5a39-4d6d-a482-269a917d8560 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:17.843829 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-96d991f2-5a39-4d6d-a482-269a917d8560 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:18.315031 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-96d991f2-5a39-4d6d-a482-269a917d8560 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae50daa6a6745d0a8f1ff15e6df1d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51792b273f9f4220984586388169abf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:33:18.333100 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-96d991f2-5a39-4d6d-a482-269a917d8560 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] 10.222.0.61 "GET /compute/v2.1/servers/8a795e58-f921-411c-8660-0be993ad8aac" status: 200 len: 1361 microversion: 2.1 time: 0.561546 Aug 31 16:33:18.334356 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3090/6199] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:33:17 2022] GET /compute/v2.1/servers/8a795e58-f921-411c-8660-0be993ad8aac => generated 1361 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:33:19.362494 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-bd6fbeb8-7ef7-4e34-a478-788950bbca56 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:33:19.364967 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-bd6fbeb8-7ef7-4e34-a478-788950bbca56 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] [instance: 8a795e58-f921-411c-8660-0be993ad8aac] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:33:19.380765 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bd6fbeb8-7ef7-4e34-a478-788950bbca56 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:19.382313 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bd6fbeb8-7ef7-4e34-a478-788950bbca56 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:19.383883 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bd6fbeb8-7ef7-4e34-a478-788950bbca56 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:19.387585 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bd6fbeb8-7ef7-4e34-a478-788950bbca56 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:19.389037 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bd6fbeb8-7ef7-4e34-a478-788950bbca56 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:19.390149 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bd6fbeb8-7ef7-4e34-a478-788950bbca56 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:19.768697 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-bd6fbeb8-7ef7-4e34-a478-788950bbca56 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae50daa6a6745d0a8f1ff15e6df1d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51792b273f9f4220984586388169abf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:33:19.811121 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-bd6fbeb8-7ef7-4e34-a478-788950bbca56 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] 10.222.0.61 "GET /compute/v2.1/servers/8a795e58-f921-411c-8660-0be993ad8aac" status: 200 len: 1361 microversion: 2.1 time: 0.458405 Aug 31 16:33:19.847928 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3110/6200] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:33:19 2022] GET /compute/v2.1/servers/8a795e58-f921-411c-8660-0be993ad8aac => generated 1361 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:33:20.876011 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6d56722c-9e05-429e-aa53-331ea1aa6606 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:33:20.901110 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6d56722c-9e05-429e-aa53-331ea1aa6606 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] [instance: 8a795e58-f921-411c-8660-0be993ad8aac] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:33:20.968290 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6d56722c-9e05-429e-aa53-331ea1aa6606 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:20.980518 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6d56722c-9e05-429e-aa53-331ea1aa6606 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:20.981636 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6d56722c-9e05-429e-aa53-331ea1aa6606 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:20.983995 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6d56722c-9e05-429e-aa53-331ea1aa6606 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:20.987915 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6d56722c-9e05-429e-aa53-331ea1aa6606 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:20.988852 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6d56722c-9e05-429e-aa53-331ea1aa6606 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:21.002060 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-90cf856d-75e3-4ed5-b8bc-b87d7096fca2 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:33:21.017039 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-90cf856d-75e3-4ed5-b8bc-b87d7096fca2 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 3c9c0c43-4e1a-4290-bbf1-60e26aba66ce] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:33:21.034591 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-90cf856d-75e3-4ed5-b8bc-b87d7096fca2 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:21.052063 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-90cf856d-75e3-4ed5-b8bc-b87d7096fca2 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:21.056261 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-90cf856d-75e3-4ed5-b8bc-b87d7096fca2 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:21.057705 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-90cf856d-75e3-4ed5-b8bc-b87d7096fca2 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:21.059839 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-90cf856d-75e3-4ed5-b8bc-b87d7096fca2 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:21.076715 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-90cf856d-75e3-4ed5-b8bc-b87d7096fca2 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:21.156435 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-90cf856d-75e3-4ed5-b8bc-b87d7096fca2 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] HTTP exception thrown: Instance 3c9c0c43-4e1a-4290-bbf1-60e26aba66ce could not be found. Aug 31 16:33:21.162059 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-90cf856d-75e3-4ed5-b8bc-b87d7096fca2 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Request method failure captured: Aug 31 16:33:21.162059 n-d-850499-9 devstack@n-api.service[122257]: request: DELETE /compute/v2.1/servers/3c9c0c43-4e1a-4290-bbf1-60e26aba66ce HTTP/1.1 Aug 31 16:33:21.162059 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:33:21.162059 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:33:21.162059 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:33:21.162059 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:33:21.162059 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:33:21.162059 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:33:21.162059 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:33:21.162059 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:33:21.162059 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4rNdtL8Hp93envnJYgxrkKzEuKKLro2yD65tuaCjxV170sTEb0vV7K7CSwqb17J41LEaCf2veX7M0gQMtVuIZTkoy1EqZ7hcQ7-sxxS5qnxJzqp8zg_d5_eF53mYW1SiUWmb2sxTco76Ig5gniRxyga2-esulxOQeqjncU6078g4lk Aug 31 16:33:21.162059 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:33:21.162059 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:33:21.162059 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:33:21.162059 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:33:21.162059 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:33:21.162059 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:33:21.162059 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 79d9ba3589a24faaac930a35742ce834 Aug 31 16:33:21.162059 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-AttachVolumeNegativeTest-1703723156 Aug 31 16:33:21.162059 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:33:21.162059 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:33:21.162059 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/79d9ba3589a24faaac930a35742ce834"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/79d9ba3589a24faaac930a35742ce834"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_79d9ba3589a24faaac930a35742ce834", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/79d9ba3589a24faaac930a35742ce834"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:33:21.162059 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-AttachVolumeNegativeTest-1703723156 Aug 31 16:33:21.162059 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 79d9ba3589a24faaac930a35742ce834 Aug 31 16:33:21.162059 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1703723156 Aug 31 16:33:21.162059 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-AttachVolumeNegativeTest-1703723156-project Aug 31 16:33:21.162059 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:33:21.162059 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:33:21.162059 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 133363b2b12d4730994557ee24f08879 Aug 31 16:33:21.162059 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-AttachVolumeNegativeTest-1703723156-project Aug 31 16:33:21.162059 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:33:21.162059 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance 3c9c0c43-4e1a-4290-bbf1-60e26aba66ce could not be found. Aug 31 16:33:21.162059 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '3c9c0c43-4e1a-4290-bbf1-60e26aba66ce'} Aug 31 16:33:21.162059 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:33:21.162059 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:33:21.162059 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:33:21.162059 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:33:21.162059 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:33:21.162059 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:33:21.162059 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:33:21.162059 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:33:21.162059 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:33:21.162059 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:33:21.162059 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c9c0c43-4e1a-4290-bbf1-60e26aba66ce could not be found. Aug 31 16:33:21.162059 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:33:21.162059 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:33:21.162059 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:33:21.162059 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:33:21.162059 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:33:21.162059 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:33:21.162059 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:33:21.162059 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:33:21.162059 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:33:21.162059 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:33:21.162059 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:33:21.162059 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:33:21.162059 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:33:21.162059 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:33:21.162059 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:33:21.162059 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:33:21.162059 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:33:21.162059 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:33:21.171636 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c9c0c43-4e1a-4290-bbf1-60e26aba66ce could not be found. Aug 31 16:33:21.171636 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:33:21.171636 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:33:21.171636 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:33:21.171636 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:33:21.171636 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:33:21.171636 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:33:21.171636 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:33:21.171636 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:33:21.171636 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c9c0c43-4e1a-4290-bbf1-60e26aba66ce could not be found. Aug 31 16:33:21.171636 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:33:21.175270 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-90cf856d-75e3-4ed5-b8bc-b87d7096fca2 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Returning 404 to user: Instance 3c9c0c43-4e1a-4290-bbf1-60e26aba66ce could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:33:21.175825 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-90cf856d-75e3-4ed5-b8bc-b87d7096fca2 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "DELETE /compute/v2.1/servers/3c9c0c43-4e1a-4290-bbf1-60e26aba66ce" status: 404 len: 111 microversion: 2.1 time: 0.181807 Aug 31 16:33:21.185472 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3111/6201] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:33:20 2022] DELETE /compute/v2.1/servers/3c9c0c43-4e1a-4290-bbf1-60e26aba66ce => generated 111 bytes in 193 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 16:33:21.190889 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c0871b27-9f5f-44ce-82e4-ab2f7d91a794 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:33:21.198088 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c0871b27-9f5f-44ce-82e4-ab2f7d91a794 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 3c9c0c43-4e1a-4290-bbf1-60e26aba66ce] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:33:21.209852 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c0871b27-9f5f-44ce-82e4-ab2f7d91a794 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:21.214263 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c0871b27-9f5f-44ce-82e4-ab2f7d91a794 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:21.214880 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c0871b27-9f5f-44ce-82e4-ab2f7d91a794 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:21.215941 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c0871b27-9f5f-44ce-82e4-ab2f7d91a794 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:21.218054 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c0871b27-9f5f-44ce-82e4-ab2f7d91a794 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:21.218653 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c0871b27-9f5f-44ce-82e4-ab2f7d91a794 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:21.265470 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-c0871b27-9f5f-44ce-82e4-ab2f7d91a794 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] HTTP exception thrown: Instance 3c9c0c43-4e1a-4290-bbf1-60e26aba66ce could not be found. Aug 31 16:33:21.267383 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c0871b27-9f5f-44ce-82e4-ab2f7d91a794 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Request method failure captured: Aug 31 16:33:21.267383 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/3c9c0c43-4e1a-4290-bbf1-60e26aba66ce HTTP/1.1 Aug 31 16:33:21.267383 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:33:21.267383 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:33:21.267383 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:33:21.267383 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:33:21.267383 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:33:21.267383 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:33:21.267383 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:33:21.267383 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:33:21.267383 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4rNdtL8Hp93envnJYgxrkKzEuKKLro2yD65tuaCjxV170sTEb0vV7K7CSwqb17J41LEaCf2veX7M0gQMtVuIZTkoy1EqZ7hcQ7-sxxS5qnxJzqp8zg_d5_eF53mYW1SiUWmb2sxTco76Ig5gniRxyga2-esulxOQeqjncU6078g4lk Aug 31 16:33:21.267383 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:33:21.267383 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:33:21.267383 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:33:21.267383 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:33:21.267383 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:33:21.267383 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:33:21.267383 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 79d9ba3589a24faaac930a35742ce834 Aug 31 16:33:21.267383 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-AttachVolumeNegativeTest-1703723156 Aug 31 16:33:21.267383 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:33:21.267383 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:33:21.267383 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/79d9ba3589a24faaac930a35742ce834"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/79d9ba3589a24faaac930a35742ce834"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_79d9ba3589a24faaac930a35742ce834", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/79d9ba3589a24faaac930a35742ce834"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:33:21.267383 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-AttachVolumeNegativeTest-1703723156 Aug 31 16:33:21.267383 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 79d9ba3589a24faaac930a35742ce834 Aug 31 16:33:21.267383 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1703723156 Aug 31 16:33:21.267383 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-AttachVolumeNegativeTest-1703723156-project Aug 31 16:33:21.267383 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:33:21.267383 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:33:21.267383 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 133363b2b12d4730994557ee24f08879 Aug 31 16:33:21.267383 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-AttachVolumeNegativeTest-1703723156-project Aug 31 16:33:21.267383 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:33:21.267383 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance 3c9c0c43-4e1a-4290-bbf1-60e26aba66ce could not be found. Aug 31 16:33:21.267383 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '3c9c0c43-4e1a-4290-bbf1-60e26aba66ce'} Aug 31 16:33:21.267383 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:33:21.267383 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:33:21.267383 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:33:21.267383 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:33:21.267383 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:33:21.267383 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:33:21.267383 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:33:21.267383 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:33:21.267383 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:33:21.267383 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:33:21.267383 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c9c0c43-4e1a-4290-bbf1-60e26aba66ce could not be found. Aug 31 16:33:21.267383 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:33:21.267383 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:33:21.267383 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:33:21.267383 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:33:21.267383 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:33:21.267383 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:33:21.267383 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:33:21.267383 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:33:21.267383 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:33:21.267383 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:33:21.267383 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:33:21.267383 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:33:21.267383 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:33:21.267383 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:33:21.267383 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:33:21.267383 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:33:21.267383 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c9c0c43-4e1a-4290-bbf1-60e26aba66ce could not be found. Aug 31 16:33:21.267383 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:33:21.267383 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:33:21.267383 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:33:21.279909 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:33:21.279909 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:33:21.279909 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:33:21.279909 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:33:21.279909 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:33:21.279909 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c9c0c43-4e1a-4290-bbf1-60e26aba66ce could not be found. Aug 31 16:33:21.279909 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:33:21.279909 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c0871b27-9f5f-44ce-82e4-ab2f7d91a794 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Returning 404 to user: Instance 3c9c0c43-4e1a-4290-bbf1-60e26aba66ce could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:33:21.279909 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c0871b27-9f5f-44ce-82e4-ab2f7d91a794 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/3c9c0c43-4e1a-4290-bbf1-60e26aba66ce" status: 404 len: 111 microversion: 2.1 time: 0.083511 Aug 31 16:33:21.279909 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3112/6202] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:33:21 2022] GET /compute/v2.1/servers/3c9c0c43-4e1a-4290-bbf1-60e26aba66ce => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:33:21.286217 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d8ee1fe0-1e91-4596-aa13-90baf924070c tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:33:21.300251 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d8ee1fe0-1e91-4596-aa13-90baf924070c tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: b92e2d45-4596-4f2b-8a5c-8fd5f0084630] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:33:21.320607 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d8ee1fe0-1e91-4596-aa13-90baf924070c tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:21.321123 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d8ee1fe0-1e91-4596-aa13-90baf924070c tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:21.323980 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d8ee1fe0-1e91-4596-aa13-90baf924070c tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:21.324923 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d8ee1fe0-1e91-4596-aa13-90baf924070c tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:21.327443 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d8ee1fe0-1e91-4596-aa13-90baf924070c tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:21.327979 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d8ee1fe0-1e91-4596-aa13-90baf924070c tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:21.371540 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-d8ee1fe0-1e91-4596-aa13-90baf924070c tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] HTTP exception thrown: Instance b92e2d45-4596-4f2b-8a5c-8fd5f0084630 could not be found. Aug 31 16:33:21.377204 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d8ee1fe0-1e91-4596-aa13-90baf924070c tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Request method failure captured: Aug 31 16:33:21.377204 n-d-850499-9 devstack@n-api.service[122257]: request: DELETE /compute/v2.1/servers/b92e2d45-4596-4f2b-8a5c-8fd5f0084630 HTTP/1.1 Aug 31 16:33:21.377204 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:33:21.377204 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:33:21.377204 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:33:21.377204 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:33:21.377204 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:33:21.377204 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:33:21.377204 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:33:21.377204 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:33:21.377204 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4rNdtL8Hp93envnJYgxrkKzEuKKLro2yD65tuaCjxV170sTEb0vV7K7CSwqb17J41LEaCf2veX7M0gQMtVuIZTkoy1EqZ7hcQ7-sxxS5qnxJzqp8zg_d5_eF53mYW1SiUWmb2sxTco76Ig5gniRxyga2-esulxOQeqjncU6078g4lk Aug 31 16:33:21.377204 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:33:21.377204 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:33:21.377204 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:33:21.377204 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:33:21.377204 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:33:21.377204 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:33:21.377204 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 79d9ba3589a24faaac930a35742ce834 Aug 31 16:33:21.377204 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-AttachVolumeNegativeTest-1703723156 Aug 31 16:33:21.377204 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:33:21.377204 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:33:21.377204 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/79d9ba3589a24faaac930a35742ce834"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/79d9ba3589a24faaac930a35742ce834"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_79d9ba3589a24faaac930a35742ce834", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/79d9ba3589a24faaac930a35742ce834"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:33:21.377204 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-AttachVolumeNegativeTest-1703723156 Aug 31 16:33:21.377204 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 79d9ba3589a24faaac930a35742ce834 Aug 31 16:33:21.377204 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1703723156 Aug 31 16:33:21.377204 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-AttachVolumeNegativeTest-1703723156-project Aug 31 16:33:21.377204 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:33:21.377204 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:33:21.377204 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 133363b2b12d4730994557ee24f08879 Aug 31 16:33:21.377204 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-AttachVolumeNegativeTest-1703723156-project Aug 31 16:33:21.377204 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:33:21.377204 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance b92e2d45-4596-4f2b-8a5c-8fd5f0084630 could not be found. Aug 31 16:33:21.377204 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': 'b92e2d45-4596-4f2b-8a5c-8fd5f0084630'} Aug 31 16:33:21.377204 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:33:21.377204 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:33:21.377204 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:33:21.377204 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:33:21.377204 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:33:21.377204 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:33:21.377204 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:33:21.377204 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:33:21.377204 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:33:21.377204 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:33:21.377204 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b92e2d45-4596-4f2b-8a5c-8fd5f0084630 could not be found. Aug 31 16:33:21.377204 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:33:21.377204 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:33:21.377204 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:33:21.377204 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:33:21.377204 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:33:21.377204 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:33:21.377204 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:33:21.377204 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:33:21.377204 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:33:21.377204 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:33:21.377204 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:33:21.377204 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:33:21.377204 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:33:21.377204 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:33:21.377204 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:33:21.377204 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:33:21.377204 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:33:21.377204 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:33:21.382337 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b92e2d45-4596-4f2b-8a5c-8fd5f0084630 could not be found. Aug 31 16:33:21.382337 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:33:21.382337 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:33:21.382337 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:33:21.382337 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:33:21.382337 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:33:21.382337 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:33:21.382337 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:33:21.382337 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:33:21.382337 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b92e2d45-4596-4f2b-8a5c-8fd5f0084630 could not be found. Aug 31 16:33:21.382337 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:33:21.382337 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d8ee1fe0-1e91-4596-aa13-90baf924070c tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Returning 404 to user: Instance b92e2d45-4596-4f2b-8a5c-8fd5f0084630 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:33:21.382337 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d8ee1fe0-1e91-4596-aa13-90baf924070c tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "DELETE /compute/v2.1/servers/b92e2d45-4596-4f2b-8a5c-8fd5f0084630" status: 404 len: 111 microversion: 2.1 time: 0.103327 Aug 31 16:33:21.383375 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3113/6203] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:33:21 2022] DELETE /compute/v2.1/servers/b92e2d45-4596-4f2b-8a5c-8fd5f0084630 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:33:21.393241 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-142bda35-b9fe-4d82-b3fe-4d1de9de80b8 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:33:21.403038 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-142bda35-b9fe-4d82-b3fe-4d1de9de80b8 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: b92e2d45-4596-4f2b-8a5c-8fd5f0084630] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:33:21.431018 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-142bda35-b9fe-4d82-b3fe-4d1de9de80b8 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:21.439951 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-142bda35-b9fe-4d82-b3fe-4d1de9de80b8 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:21.440691 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-142bda35-b9fe-4d82-b3fe-4d1de9de80b8 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:21.441934 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-142bda35-b9fe-4d82-b3fe-4d1de9de80b8 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:21.442691 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-142bda35-b9fe-4d82-b3fe-4d1de9de80b8 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:21.443353 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-142bda35-b9fe-4d82-b3fe-4d1de9de80b8 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:21.497157 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-142bda35-b9fe-4d82-b3fe-4d1de9de80b8 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] HTTP exception thrown: Instance b92e2d45-4596-4f2b-8a5c-8fd5f0084630 could not be found. Aug 31 16:33:21.501717 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-142bda35-b9fe-4d82-b3fe-4d1de9de80b8 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Request method failure captured: Aug 31 16:33:21.501717 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/b92e2d45-4596-4f2b-8a5c-8fd5f0084630 HTTP/1.1 Aug 31 16:33:21.501717 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:33:21.501717 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:33:21.501717 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:33:21.501717 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:33:21.501717 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:33:21.501717 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:33:21.501717 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:33:21.501717 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:33:21.501717 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4rNdtL8Hp93envnJYgxrkKzEuKKLro2yD65tuaCjxV170sTEb0vV7K7CSwqb17J41LEaCf2veX7M0gQMtVuIZTkoy1EqZ7hcQ7-sxxS5qnxJzqp8zg_d5_eF53mYW1SiUWmb2sxTco76Ig5gniRxyga2-esulxOQeqjncU6078g4lk Aug 31 16:33:21.501717 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:33:21.501717 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:33:21.501717 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:33:21.501717 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:33:21.501717 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:33:21.501717 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:33:21.501717 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 79d9ba3589a24faaac930a35742ce834 Aug 31 16:33:21.501717 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-AttachVolumeNegativeTest-1703723156 Aug 31 16:33:21.501717 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:33:21.501717 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:33:21.501717 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/79d9ba3589a24faaac930a35742ce834"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/79d9ba3589a24faaac930a35742ce834"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_79d9ba3589a24faaac930a35742ce834", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/79d9ba3589a24faaac930a35742ce834"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:33:21.501717 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-AttachVolumeNegativeTest-1703723156 Aug 31 16:33:21.501717 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 79d9ba3589a24faaac930a35742ce834 Aug 31 16:33:21.501717 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1703723156 Aug 31 16:33:21.501717 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-AttachVolumeNegativeTest-1703723156-project Aug 31 16:33:21.501717 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:33:21.501717 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:33:21.501717 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 133363b2b12d4730994557ee24f08879 Aug 31 16:33:21.501717 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-AttachVolumeNegativeTest-1703723156-project Aug 31 16:33:21.501717 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:33:21.501717 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance b92e2d45-4596-4f2b-8a5c-8fd5f0084630 could not be found. Aug 31 16:33:21.501717 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': 'b92e2d45-4596-4f2b-8a5c-8fd5f0084630'} Aug 31 16:33:21.501717 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:33:21.501717 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:33:21.501717 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:33:21.501717 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:33:21.501717 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:33:21.501717 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:33:21.501717 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:33:21.501717 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:33:21.501717 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:33:21.501717 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:33:21.501717 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b92e2d45-4596-4f2b-8a5c-8fd5f0084630 could not be found. Aug 31 16:33:21.501717 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:33:21.501717 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:33:21.501717 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:33:21.501717 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:33:21.501717 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:33:21.501717 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:33:21.501717 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:33:21.501717 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:33:21.501717 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:33:21.501717 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:33:21.501717 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:33:21.501717 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:33:21.501717 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:33:21.501717 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:33:21.501717 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:33:21.501717 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:33:21.501717 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b92e2d45-4596-4f2b-8a5c-8fd5f0084630 could not be found. Aug 31 16:33:21.501717 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:33:21.501717 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:33:21.501717 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:33:21.506126 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:33:21.506126 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:33:21.506126 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:33:21.506126 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:33:21.506126 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:33:21.506126 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b92e2d45-4596-4f2b-8a5c-8fd5f0084630 could not be found. Aug 31 16:33:21.506126 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:33:21.520904 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-142bda35-b9fe-4d82-b3fe-4d1de9de80b8 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Returning 404 to user: Instance b92e2d45-4596-4f2b-8a5c-8fd5f0084630 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:33:21.522176 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-142bda35-b9fe-4d82-b3fe-4d1de9de80b8 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/b92e2d45-4596-4f2b-8a5c-8fd5f0084630" status: 404 len: 111 microversion: 2.1 time: 0.132892 Aug 31 16:33:21.523353 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3114/6204] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:33:21 2022] GET /compute/v2.1/servers/b92e2d45-4596-4f2b-8a5c-8fd5f0084630 => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:33:21.626467 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-6d56722c-9e05-429e-aa53-331ea1aa6606 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae50daa6a6745d0a8f1ff15e6df1d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51792b273f9f4220984586388169abf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:33:21.661465 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6d56722c-9e05-429e-aa53-331ea1aa6606 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] 10.222.0.61 "GET /compute/v2.1/servers/8a795e58-f921-411c-8660-0be993ad8aac" status: 200 len: 1429 microversion: 2.1 time: 0.809588 Aug 31 16:33:21.684469 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3091/6205] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:33:20 2022] GET /compute/v2.1/servers/8a795e58-f921-411c-8660-0be993ad8aac => generated 1429 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:33:22.693639 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b6318e89-8246-49a6-9501-d6f424bbff5d tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:33:22.694966 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b6318e89-8246-49a6-9501-d6f424bbff5d tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] [instance: 8a795e58-f921-411c-8660-0be993ad8aac] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:33:22.711481 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b6318e89-8246-49a6-9501-d6f424bbff5d tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:22.720369 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b6318e89-8246-49a6-9501-d6f424bbff5d tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:22.721214 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b6318e89-8246-49a6-9501-d6f424bbff5d tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:22.722207 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b6318e89-8246-49a6-9501-d6f424bbff5d tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:22.722905 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b6318e89-8246-49a6-9501-d6f424bbff5d tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:22.723625 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b6318e89-8246-49a6-9501-d6f424bbff5d tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:23.363961 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:33:23.923996 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b6318e89-8246-49a6-9501-d6f424bbff5d tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae50daa6a6745d0a8f1ff15e6df1d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51792b273f9f4220984586388169abf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:33:23.951143 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b6318e89-8246-49a6-9501-d6f424bbff5d tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] 10.222.0.61 "GET /compute/v2.1/servers/8a795e58-f921-411c-8660-0be993ad8aac" status: 200 len: 1429 microversion: 2.1 time: 1.258051 Aug 31 16:33:23.952236 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3115/6206] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:33:22 2022] GET /compute/v2.1/servers/8a795e58-f921-411c-8660-0be993ad8aac => generated 1429 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:33:24.980413 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9a439990-ed2d-40c4-b9b3-1c384d939a09 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:33:24.982350 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9a439990-ed2d-40c4-b9b3-1c384d939a09 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] [instance: 8a795e58-f921-411c-8660-0be993ad8aac] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:33:24.991105 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:33:24.999920 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=12 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:33:25.006769 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9a439990-ed2d-40c4-b9b3-1c384d939a09 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:25.008683 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9a439990-ed2d-40c4-b9b3-1c384d939a09 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:25.010825 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9a439990-ed2d-40c4-b9b3-1c384d939a09 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:25.012937 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9a439990-ed2d-40c4-b9b3-1c384d939a09 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:25.013760 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9a439990-ed2d-40c4-b9b3-1c384d939a09 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:25.015031 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9a439990-ed2d-40c4-b9b3-1c384d939a09 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:25.863129 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-b78b5f84-f379-48dd-915d-0eaa97ad96cb req-63a2e33a-f3f6-4407-9518-8e72ee8a835c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a795e58-f921-411c-8660-0be993ad8aac", "tag": "a1a1b013-3ce9-4ed4-891e-95caa0880eef"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:33:25.889439 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-b78b5f84-f379-48dd-915d-0eaa97ad96cb req-63a2e33a-f3f6-4407-9518-8e72ee8a835c service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:25.890168 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-b78b5f84-f379-48dd-915d-0eaa97ad96cb req-63a2e33a-f3f6-4407-9518-8e72ee8a835c service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:25.890614 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-b78b5f84-f379-48dd-915d-0eaa97ad96cb req-63a2e33a-f3f6-4407-9518-8e72ee8a835c service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:25.912699 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-b78b5f84-f379-48dd-915d-0eaa97ad96cb req-63a2e33a-f3f6-4407-9518-8e72ee8a835c service nova] Creating event network-changed:a1a1b013-3ce9-4ed4-891e-95caa0880eef for instance 8a795e58-f921-411c-8660-0be993ad8aac on n-h2-850499-9 Aug 31 16:33:25.924973 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-b78b5f84-f379-48dd-915d-0eaa97ad96cb req-63a2e33a-f3f6-4407-9518-8e72ee8a835c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065825 Aug 31 16:33:25.938523 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3116/6207] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:33:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:33:26.188654 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-9a439990-ed2d-40c4-b9b3-1c384d939a09 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae50daa6a6745d0a8f1ff15e6df1d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51792b273f9f4220984586388169abf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:33:26.205395 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9a439990-ed2d-40c4-b9b3-1c384d939a09 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] 10.222.0.61 "GET /compute/v2.1/servers/8a795e58-f921-411c-8660-0be993ad8aac" status: 200 len: 1429 microversion: 2.1 time: 1.229557 Aug 31 16:33:26.223276 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3092/6208] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:33:24 2022] GET /compute/v2.1/servers/8a795e58-f921-411c-8660-0be993ad8aac => generated 1429 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:33:27.234328 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c62928de-d2f8-4648-a0f4-1b4291784a5b tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:33:27.236314 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c62928de-d2f8-4648-a0f4-1b4291784a5b tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] [instance: 8a795e58-f921-411c-8660-0be993ad8aac] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:33:27.251786 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c62928de-d2f8-4648-a0f4-1b4291784a5b tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:27.252880 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c62928de-d2f8-4648-a0f4-1b4291784a5b tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:27.258178 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c62928de-d2f8-4648-a0f4-1b4291784a5b tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:27.268278 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c62928de-d2f8-4648-a0f4-1b4291784a5b tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:27.269799 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c62928de-d2f8-4648-a0f4-1b4291784a5b tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:27.270493 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c62928de-d2f8-4648-a0f4-1b4291784a5b tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:28.036109 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c62928de-d2f8-4648-a0f4-1b4291784a5b tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae50daa6a6745d0a8f1ff15e6df1d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51792b273f9f4220984586388169abf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:33:28.048522 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c62928de-d2f8-4648-a0f4-1b4291784a5b tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] 10.222.0.61 "GET /compute/v2.1/servers/8a795e58-f921-411c-8660-0be993ad8aac" status: 200 len: 1429 microversion: 2.1 time: 0.821350 Aug 31 16:33:28.050373 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3117/6209] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:33:27 2022] GET /compute/v2.1/servers/8a795e58-f921-411c-8660-0be993ad8aac => generated 1429 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:33:28.450544 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6c122b2e-ca8b-4892-925b-a6aa642d0022 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:33:28.451058 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6c122b2e-ca8b-4892-925b-a6aa642d0022 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 6e139adf-20d3-4d88-941f-fe9a45276ad5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:33:28.458652 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6c122b2e-ca8b-4892-925b-a6aa642d0022 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:28.468953 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6c122b2e-ca8b-4892-925b-a6aa642d0022 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:28.469428 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6c122b2e-ca8b-4892-925b-a6aa642d0022 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:28.470201 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6c122b2e-ca8b-4892-925b-a6aa642d0022 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:28.470670 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6c122b2e-ca8b-4892-925b-a6aa642d0022 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:28.471110 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6c122b2e-ca8b-4892-925b-a6aa642d0022 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:28.502033 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-6c122b2e-ca8b-4892-925b-a6aa642d0022 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] HTTP exception thrown: Instance 6e139adf-20d3-4d88-941f-fe9a45276ad5 could not be found. Aug 31 16:33:28.514041 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6c122b2e-ca8b-4892-925b-a6aa642d0022 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Request method failure captured: Aug 31 16:33:28.514041 n-d-850499-9 devstack@n-api.service[122256]: request: DELETE /compute/v2.1/servers/6e139adf-20d3-4d88-941f-fe9a45276ad5 HTTP/1.1 Aug 31 16:33:28.514041 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:33:28.514041 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:33:28.514041 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:33:28.514041 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:33:28.514041 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:33:28.514041 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:33:28.514041 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:33:28.514041 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:33:28.514041 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4rNdtL8Hp93envnJYgxrkKzEuKKLro2yD65tuaCjxV170sTEb0vV7K7CSwqb17J41LEaCf2veX7M0gQMtVuIZTkoy1EqZ7hcQ7-sxxS5qnxJzqp8zg_d5_eF53mYW1SiUWmb2sxTco76Ig5gniRxyga2-esulxOQeqjncU6078g4lk Aug 31 16:33:28.514041 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:33:28.514041 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:33:28.514041 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:33:28.514041 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:33:28.514041 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:33:28.514041 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:33:28.514041 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 79d9ba3589a24faaac930a35742ce834 Aug 31 16:33:28.514041 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-AttachVolumeNegativeTest-1703723156 Aug 31 16:33:28.514041 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:33:28.514041 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:33:28.514041 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/79d9ba3589a24faaac930a35742ce834"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/79d9ba3589a24faaac930a35742ce834"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_79d9ba3589a24faaac930a35742ce834", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/79d9ba3589a24faaac930a35742ce834"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:33:28.514041 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-AttachVolumeNegativeTest-1703723156 Aug 31 16:33:28.514041 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 79d9ba3589a24faaac930a35742ce834 Aug 31 16:33:28.514041 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1703723156 Aug 31 16:33:28.514041 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-AttachVolumeNegativeTest-1703723156-project Aug 31 16:33:28.514041 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:33:28.514041 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:33:28.514041 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 133363b2b12d4730994557ee24f08879 Aug 31 16:33:28.514041 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-AttachVolumeNegativeTest-1703723156-project Aug 31 16:33:28.514041 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:33:28.514041 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance 6e139adf-20d3-4d88-941f-fe9a45276ad5 could not be found. Aug 31 16:33:28.514041 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '6e139adf-20d3-4d88-941f-fe9a45276ad5'} Aug 31 16:33:28.514041 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:33:28.514041 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:33:28.514041 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:33:28.514041 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:33:28.514041 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:33:28.514041 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:33:28.514041 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:33:28.514041 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:33:28.514041 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:33:28.514041 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:33:28.514041 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e139adf-20d3-4d88-941f-fe9a45276ad5 could not be found. Aug 31 16:33:28.514041 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:33:28.514041 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:33:28.514041 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:33:28.514041 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:33:28.514041 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:33:28.514041 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:33:28.514041 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:33:28.514041 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:33:28.514041 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:33:28.514041 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:33:28.514041 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:33:28.514041 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:33:28.514041 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:33:28.514041 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:33:28.514041 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:33:28.514041 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:33:28.514041 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:33:28.514041 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:33:28.518027 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e139adf-20d3-4d88-941f-fe9a45276ad5 could not be found. Aug 31 16:33:28.518027 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:33:28.518027 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:33:28.518027 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:33:28.518027 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:33:28.518027 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:33:28.518027 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:33:28.518027 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:33:28.518027 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:33:28.518027 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e139adf-20d3-4d88-941f-fe9a45276ad5 could not be found. Aug 31 16:33:28.518027 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:33:28.518027 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6c122b2e-ca8b-4892-925b-a6aa642d0022 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Returning 404 to user: Instance 6e139adf-20d3-4d88-941f-fe9a45276ad5 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:33:28.518027 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6c122b2e-ca8b-4892-925b-a6aa642d0022 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "DELETE /compute/v2.1/servers/6e139adf-20d3-4d88-941f-fe9a45276ad5" status: 404 len: 111 microversion: 2.1 time: 0.069515 Aug 31 16:33:28.518027 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3093/6210] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:33:28 2022] DELETE /compute/v2.1/servers/6e139adf-20d3-4d88-941f-fe9a45276ad5 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:33:28.525257 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-dc4ca933-47e4-466b-b532-95f91a409e05 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:33:28.531264 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-dc4ca933-47e4-466b-b532-95f91a409e05 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] [instance: 6e139adf-20d3-4d88-941f-fe9a45276ad5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:33:28.547040 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dc4ca933-47e4-466b-b532-95f91a409e05 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:28.547589 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dc4ca933-47e4-466b-b532-95f91a409e05 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:28.548024 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dc4ca933-47e4-466b-b532-95f91a409e05 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:28.548753 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dc4ca933-47e4-466b-b532-95f91a409e05 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:28.549217 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dc4ca933-47e4-466b-b532-95f91a409e05 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:28.549654 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dc4ca933-47e4-466b-b532-95f91a409e05 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:28.581913 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-dc4ca933-47e4-466b-b532-95f91a409e05 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] HTTP exception thrown: Instance 6e139adf-20d3-4d88-941f-fe9a45276ad5 could not be found. Aug 31 16:33:28.592339 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-dc4ca933-47e4-466b-b532-95f91a409e05 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Request method failure captured: Aug 31 16:33:28.592339 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/6e139adf-20d3-4d88-941f-fe9a45276ad5 HTTP/1.1 Aug 31 16:33:28.592339 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:33:28.592339 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:33:28.592339 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:33:28.592339 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:33:28.592339 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:33:28.592339 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:33:28.592339 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:33:28.592339 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:33:28.592339 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4rNdtL8Hp93envnJYgxrkKzEuKKLro2yD65tuaCjxV170sTEb0vV7K7CSwqb17J41LEaCf2veX7M0gQMtVuIZTkoy1EqZ7hcQ7-sxxS5qnxJzqp8zg_d5_eF53mYW1SiUWmb2sxTco76Ig5gniRxyga2-esulxOQeqjncU6078g4lk Aug 31 16:33:28.592339 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:33:28.592339 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:33:28.592339 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:33:28.592339 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:33:28.592339 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:33:28.592339 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:33:28.592339 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 79d9ba3589a24faaac930a35742ce834 Aug 31 16:33:28.592339 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-AttachVolumeNegativeTest-1703723156 Aug 31 16:33:28.592339 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:33:28.592339 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:33:28.592339 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/79d9ba3589a24faaac930a35742ce834"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/79d9ba3589a24faaac930a35742ce834"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_79d9ba3589a24faaac930a35742ce834", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/79d9ba3589a24faaac930a35742ce834"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:33:28.592339 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-AttachVolumeNegativeTest-1703723156 Aug 31 16:33:28.592339 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 79d9ba3589a24faaac930a35742ce834 Aug 31 16:33:28.592339 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1703723156 Aug 31 16:33:28.592339 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-AttachVolumeNegativeTest-1703723156-project Aug 31 16:33:28.592339 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:33:28.592339 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:33:28.592339 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 133363b2b12d4730994557ee24f08879 Aug 31 16:33:28.592339 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-AttachVolumeNegativeTest-1703723156-project Aug 31 16:33:28.592339 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:33:28.592339 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance 6e139adf-20d3-4d88-941f-fe9a45276ad5 could not be found. Aug 31 16:33:28.592339 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '6e139adf-20d3-4d88-941f-fe9a45276ad5'} Aug 31 16:33:28.592339 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:33:28.592339 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:33:28.592339 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:33:28.592339 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:33:28.592339 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:33:28.592339 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:33:28.592339 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:33:28.592339 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:33:28.592339 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:33:28.592339 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:33:28.592339 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e139adf-20d3-4d88-941f-fe9a45276ad5 could not be found. Aug 31 16:33:28.592339 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:33:28.592339 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:33:28.592339 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:33:28.592339 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:33:28.592339 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:33:28.592339 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:33:28.592339 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:33:28.592339 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:33:28.592339 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:33:28.592339 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:33:28.592339 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:33:28.592339 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:33:28.592339 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:33:28.592339 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:33:28.592339 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:33:28.592339 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:33:28.592339 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e139adf-20d3-4d88-941f-fe9a45276ad5 could not be found. Aug 31 16:33:28.592339 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:33:28.592339 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:33:28.592339 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:33:28.596584 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:33:28.596584 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:33:28.596584 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:33:28.596584 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:33:28.596584 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:33:28.596584 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e139adf-20d3-4d88-941f-fe9a45276ad5 could not be found. Aug 31 16:33:28.596584 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:33:28.599348 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-dc4ca933-47e4-466b-b532-95f91a409e05 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] Returning 404 to user: Instance 6e139adf-20d3-4d88-941f-fe9a45276ad5 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:33:28.602340 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-dc4ca933-47e4-466b-b532-95f91a409e05 tempest-AttachVolumeNegativeTest-1703723156 tempest-AttachVolumeNegativeTest-1703723156-project] 10.222.0.61 "GET /compute/v2.1/servers/6e139adf-20d3-4d88-941f-fe9a45276ad5" status: 404 len: 111 microversion: 2.1 time: 0.081481 Aug 31 16:33:28.610208 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3118/6211] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:33:28 2022] GET /compute/v2.1/servers/6e139adf-20d3-4d88-941f-fe9a45276ad5 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:33:29.073040 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-46885572-62d9-4678-8da8-1df552dbca48 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:33:29.074840 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-46885572-62d9-4678-8da8-1df552dbca48 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] [instance: 8a795e58-f921-411c-8660-0be993ad8aac] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:33:29.101594 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-46885572-62d9-4678-8da8-1df552dbca48 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:29.109375 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-46885572-62d9-4678-8da8-1df552dbca48 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:29.110370 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-46885572-62d9-4678-8da8-1df552dbca48 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:29.111399 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-46885572-62d9-4678-8da8-1df552dbca48 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:29.112128 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-46885572-62d9-4678-8da8-1df552dbca48 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:29.113557 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-46885572-62d9-4678-8da8-1df552dbca48 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:29.700007 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-46885572-62d9-4678-8da8-1df552dbca48 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae50daa6a6745d0a8f1ff15e6df1d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51792b273f9f4220984586388169abf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:33:29.725582 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-46885572-62d9-4678-8da8-1df552dbca48 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] 10.222.0.61 "GET /compute/v2.1/servers/8a795e58-f921-411c-8660-0be993ad8aac" status: 200 len: 1429 microversion: 2.1 time: 0.657586 Aug 31 16:33:29.728163 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3094/6212] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:33:29 2022] GET /compute/v2.1/servers/8a795e58-f921-411c-8660-0be993ad8aac => generated 1429 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:33:30.752150 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-790f1997-03d0-4bd7-aacc-a5462d5b1210 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:33:30.752932 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-790f1997-03d0-4bd7-aacc-a5462d5b1210 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] [instance: 8a795e58-f921-411c-8660-0be993ad8aac] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:33:30.765313 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-790f1997-03d0-4bd7-aacc-a5462d5b1210 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:30.778579 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-790f1997-03d0-4bd7-aacc-a5462d5b1210 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:30.779746 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-790f1997-03d0-4bd7-aacc-a5462d5b1210 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:30.781348 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-790f1997-03d0-4bd7-aacc-a5462d5b1210 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:30.783437 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-790f1997-03d0-4bd7-aacc-a5462d5b1210 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:30.784617 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-790f1997-03d0-4bd7-aacc-a5462d5b1210 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:31.268104 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-790f1997-03d0-4bd7-aacc-a5462d5b1210 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae50daa6a6745d0a8f1ff15e6df1d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51792b273f9f4220984586388169abf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:33:31.297386 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-790f1997-03d0-4bd7-aacc-a5462d5b1210 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] 10.222.0.61 "GET /compute/v2.1/servers/8a795e58-f921-411c-8660-0be993ad8aac" status: 200 len: 1429 microversion: 2.1 time: 0.551219 Aug 31 16:33:31.301563 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3119/6213] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:33:30 2022] GET /compute/v2.1/servers/8a795e58-f921-411c-8660-0be993ad8aac => generated 1429 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:33:32.336444 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b4056ff4-514f-4420-b730-2c286820b12d tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:33:32.337787 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b4056ff4-514f-4420-b730-2c286820b12d tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] [instance: 8a795e58-f921-411c-8660-0be993ad8aac] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:33:32.355455 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b4056ff4-514f-4420-b730-2c286820b12d tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:32.356525 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b4056ff4-514f-4420-b730-2c286820b12d tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:32.357194 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b4056ff4-514f-4420-b730-2c286820b12d tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:32.359971 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b4056ff4-514f-4420-b730-2c286820b12d tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:32.369294 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b4056ff4-514f-4420-b730-2c286820b12d tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:32.371288 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b4056ff4-514f-4420-b730-2c286820b12d tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:33.401748 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b4056ff4-514f-4420-b730-2c286820b12d tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae50daa6a6745d0a8f1ff15e6df1d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51792b273f9f4220984586388169abf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:33:33.422852 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b4056ff4-514f-4420-b730-2c286820b12d tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] 10.222.0.61 "GET /compute/v2.1/servers/8a795e58-f921-411c-8660-0be993ad8aac" status: 200 len: 1429 microversion: 2.1 time: 1.090691 Aug 31 16:33:33.425840 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3095/6214] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:33:32 2022] GET /compute/v2.1/servers/8a795e58-f921-411c-8660-0be993ad8aac => generated 1429 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:33:34.461475 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-056e28ec-f372-4c32-b327-85bb622ba71d tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:33:34.466506 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-056e28ec-f372-4c32-b327-85bb622ba71d tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] [instance: 8a795e58-f921-411c-8660-0be993ad8aac] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:33:34.530283 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-056e28ec-f372-4c32-b327-85bb622ba71d tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:34.540248 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-056e28ec-f372-4c32-b327-85bb622ba71d tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:34.541928 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-056e28ec-f372-4c32-b327-85bb622ba71d tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:34.544229 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-056e28ec-f372-4c32-b327-85bb622ba71d tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:34.556290 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-056e28ec-f372-4c32-b327-85bb622ba71d tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:34.557477 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-056e28ec-f372-4c32-b327-85bb622ba71d tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:35.172351 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-056e28ec-f372-4c32-b327-85bb622ba71d tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae50daa6a6745d0a8f1ff15e6df1d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51792b273f9f4220984586388169abf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:33:35.184894 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-056e28ec-f372-4c32-b327-85bb622ba71d tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] 10.222.0.61 "GET /compute/v2.1/servers/8a795e58-f921-411c-8660-0be993ad8aac" status: 200 len: 1429 microversion: 2.1 time: 0.734481 Aug 31 16:33:35.185930 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3120/6215] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:33:34 2022] GET /compute/v2.1/servers/8a795e58-f921-411c-8660-0be993ad8aac => generated 1429 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:33:36.210089 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-182056a8-8613-487a-afe5-9d2d9bd605cb tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:33:36.210781 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-182056a8-8613-487a-afe5-9d2d9bd605cb tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] [instance: 8a795e58-f921-411c-8660-0be993ad8aac] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:33:36.242693 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-182056a8-8613-487a-afe5-9d2d9bd605cb tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:36.245377 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-182056a8-8613-487a-afe5-9d2d9bd605cb tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:36.248651 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-182056a8-8613-487a-afe5-9d2d9bd605cb tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:36.249871 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-182056a8-8613-487a-afe5-9d2d9bd605cb tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:36.252373 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-182056a8-8613-487a-afe5-9d2d9bd605cb tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:36.253575 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-182056a8-8613-487a-afe5-9d2d9bd605cb tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:36.651300 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-182056a8-8613-487a-afe5-9d2d9bd605cb tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae50daa6a6745d0a8f1ff15e6df1d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51792b273f9f4220984586388169abf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:33:36.667548 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-182056a8-8613-487a-afe5-9d2d9bd605cb tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] 10.222.0.61 "GET /compute/v2.1/servers/8a795e58-f921-411c-8660-0be993ad8aac" status: 200 len: 1429 microversion: 2.1 time: 0.459505 Aug 31 16:33:36.682232 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3096/6216] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:33:36 2022] GET /compute/v2.1/servers/8a795e58-f921-411c-8660-0be993ad8aac => generated 1429 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:33:37.507798 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-26f566a4-a449-4497-b0bc-fca03bba7209 req-dfc30daf-bffc-4775-8ad5-a81a63a97583 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a795e58-f921-411c-8660-0be993ad8aac", "name": "network-vif-plugged", "status": "completed", "tag": "a1a1b013-3ce9-4ed4-891e-95caa0880eef"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:33:37.523577 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-26f566a4-a449-4497-b0bc-fca03bba7209 req-dfc30daf-bffc-4775-8ad5-a81a63a97583 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:37.527840 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-26f566a4-a449-4497-b0bc-fca03bba7209 req-dfc30daf-bffc-4775-8ad5-a81a63a97583 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:37.533059 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-26f566a4-a449-4497-b0bc-fca03bba7209 req-dfc30daf-bffc-4775-8ad5-a81a63a97583 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:37.552932 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-26f566a4-a449-4497-b0bc-fca03bba7209 req-dfc30daf-bffc-4775-8ad5-a81a63a97583 service nova] Creating event network-vif-plugged:a1a1b013-3ce9-4ed4-891e-95caa0880eef for instance 8a795e58-f921-411c-8660-0be993ad8aac on n-h2-850499-9 Aug 31 16:33:37.562716 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-26f566a4-a449-4497-b0bc-fca03bba7209 req-dfc30daf-bffc-4775-8ad5-a81a63a97583 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.419657 Aug 31 16:33:37.568241 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3121/6217] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:33:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:33:37.689760 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c1c4b11b-71d2-4cb7-9cee-06a1061c6243 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:33:37.691068 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c1c4b11b-71d2-4cb7-9cee-06a1061c6243 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] [instance: 8a795e58-f921-411c-8660-0be993ad8aac] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:33:37.698618 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c1c4b11b-71d2-4cb7-9cee-06a1061c6243 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:37.700269 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c1c4b11b-71d2-4cb7-9cee-06a1061c6243 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:37.701459 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c1c4b11b-71d2-4cb7-9cee-06a1061c6243 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:37.702670 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c1c4b11b-71d2-4cb7-9cee-06a1061c6243 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:37.703474 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c1c4b11b-71d2-4cb7-9cee-06a1061c6243 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:37.704274 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c1c4b11b-71d2-4cb7-9cee-06a1061c6243 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:38.559470 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c1c4b11b-71d2-4cb7-9cee-06a1061c6243 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae50daa6a6745d0a8f1ff15e6df1d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51792b273f9f4220984586388169abf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:33:38.576341 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c1c4b11b-71d2-4cb7-9cee-06a1061c6243 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] 10.222.0.61 "GET /compute/v2.1/servers/8a795e58-f921-411c-8660-0be993ad8aac" status: 200 len: 1429 microversion: 2.1 time: 0.890451 Aug 31 16:33:38.578086 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3097/6218] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:33:37 2022] GET /compute/v2.1/servers/8a795e58-f921-411c-8660-0be993ad8aac => generated 1429 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:33:39.605228 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-791f5559-a6c5-49ef-8480-d6572b106a6e tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:33:39.608787 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-791f5559-a6c5-49ef-8480-d6572b106a6e tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] [instance: 8a795e58-f921-411c-8660-0be993ad8aac] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:33:39.619127 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-791f5559-a6c5-49ef-8480-d6572b106a6e tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:39.620113 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-791f5559-a6c5-49ef-8480-d6572b106a6e tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:39.621255 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-791f5559-a6c5-49ef-8480-d6572b106a6e tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:39.622323 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-791f5559-a6c5-49ef-8480-d6572b106a6e tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:39.622935 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-791f5559-a6c5-49ef-8480-d6572b106a6e tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:39.623536 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-791f5559-a6c5-49ef-8480-d6572b106a6e tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:39.814603 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-791f5559-a6c5-49ef-8480-d6572b106a6e tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae50daa6a6745d0a8f1ff15e6df1d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51792b273f9f4220984586388169abf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:33:39.826715 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-791f5559-a6c5-49ef-8480-d6572b106a6e tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] 10.222.0.61 "GET /compute/v2.1/servers/8a795e58-f921-411c-8660-0be993ad8aac" status: 200 len: 1429 microversion: 2.1 time: 0.231394 Aug 31 16:33:39.840521 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3122/6219] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:33:39 2022] GET /compute/v2.1/servers/8a795e58-f921-411c-8660-0be993ad8aac => generated 1429 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:33:40.854004 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-64dc876d-a304-4e12-aa11-91195e24f35c tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:33:40.854798 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-64dc876d-a304-4e12-aa11-91195e24f35c tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] [instance: 8a795e58-f921-411c-8660-0be993ad8aac] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:33:40.860525 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:33:40.875302 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-64dc876d-a304-4e12-aa11-91195e24f35c tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:40.876870 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-64dc876d-a304-4e12-aa11-91195e24f35c tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:40.878829 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-64dc876d-a304-4e12-aa11-91195e24f35c tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:40.880549 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-64dc876d-a304-4e12-aa11-91195e24f35c tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:40.884525 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-64dc876d-a304-4e12-aa11-91195e24f35c tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:40.885341 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-64dc876d-a304-4e12-aa11-91195e24f35c tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:41.338678 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-64dc876d-a304-4e12-aa11-91195e24f35c tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae50daa6a6745d0a8f1ff15e6df1d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51792b273f9f4220984586388169abf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:33:41.365973 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-64dc876d-a304-4e12-aa11-91195e24f35c tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] 10.222.0.61 "GET /compute/v2.1/servers/8a795e58-f921-411c-8660-0be993ad8aac" status: 200 len: 1609 microversion: 2.1 time: 0.517066 Aug 31 16:33:41.368979 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3098/6220] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:33:40 2022] GET /compute/v2.1/servers/8a795e58-f921-411c-8660-0be993ad8aac => generated 1609 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:33:41.388645 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-88340abf-bb46-4b72-a952-e3494b6789d0 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:33:41.389262 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-88340abf-bb46-4b72-a952-e3494b6789d0 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] [instance: 8a795e58-f921-411c-8660-0be993ad8aac] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:33:41.403651 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-88340abf-bb46-4b72-a952-e3494b6789d0 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:41.409118 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-88340abf-bb46-4b72-a952-e3494b6789d0 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:41.410622 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-88340abf-bb46-4b72-a952-e3494b6789d0 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:41.411631 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-88340abf-bb46-4b72-a952-e3494b6789d0 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:41.421495 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-88340abf-bb46-4b72-a952-e3494b6789d0 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:41.422221 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-88340abf-bb46-4b72-a952-e3494b6789d0 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:42.178214 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-88340abf-bb46-4b72-a952-e3494b6789d0 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae50daa6a6745d0a8f1ff15e6df1d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51792b273f9f4220984586388169abf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:33:42.190322 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-88340abf-bb46-4b72-a952-e3494b6789d0 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] 10.222.0.61 "GET /compute/v2.1/servers/8a795e58-f921-411c-8660-0be993ad8aac" status: 200 len: 1609 microversion: 2.1 time: 0.806069 Aug 31 16:33:42.191871 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3123/6221] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:33:41 2022] GET /compute/v2.1/servers/8a795e58-f921-411c-8660-0be993ad8aac => generated 1609 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:33:42.212664 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-09b749cf-7f32-4b72-8017-2ae2055a7e53 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:33:42.213279 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-09b749cf-7f32-4b72-8017-2ae2055a7e53 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] [instance: 8a795e58-f921-411c-8660-0be993ad8aac] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:33:42.226096 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-09b749cf-7f32-4b72-8017-2ae2055a7e53 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:42.226678 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-09b749cf-7f32-4b72-8017-2ae2055a7e53 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:42.227117 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-09b749cf-7f32-4b72-8017-2ae2055a7e53 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:42.227849 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-09b749cf-7f32-4b72-8017-2ae2055a7e53 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:42.228370 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-09b749cf-7f32-4b72-8017-2ae2055a7e53 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:42.228722 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-09b749cf-7f32-4b72-8017-2ae2055a7e53 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:43.166794 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-09b749cf-7f32-4b72-8017-2ae2055a7e53 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae50daa6a6745d0a8f1ff15e6df1d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51792b273f9f4220984586388169abf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:33:43.171849 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=58 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:33:43.191440 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-09b749cf-7f32-4b72-8017-2ae2055a7e53 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] 10.222.0.61 "GET /compute/v2.1/servers/8a795e58-f921-411c-8660-0be993ad8aac" status: 200 len: 1609 microversion: 2.1 time: 0.983437 Aug 31 16:33:43.204617 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3099/6222] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:33:42 2022] GET /compute/v2.1/servers/8a795e58-f921-411c-8660-0be993ad8aac => generated 1609 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:33:48.281271 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2c6974e3-de7c-4589-a04c-171fdd5d8c4b tempest-VolumesTestJSON-205415459 tempest-VolumesTestJSON-205415459-project] Calling method '.version_select at 0x7f5ae3a4fa60>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:33:48.413559 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2c6974e3-de7c-4589-a04c-171fdd5d8c4b tempest-VolumesTestJSON-205415459 tempest-VolumesTestJSON-205415459-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/b1621af1-d97e-472d-ac4a-5a80c847f53d" status: 200 len: 349 microversion: 2.1 time: 0.136608 Aug 31 16:33:48.414148 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3124/6223] 10.222.0.61 () {58 vars in 1245 bytes} [Wed Aug 31 16:33:48 2022] GET /compute/v2.1/os-volumes/b1621af1-d97e-472d-ac4a-5a80c847f53d => generated 349 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:33:52.283166 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-6fa97349-63f3-428a-83cd-714d574c90a5 req-864078fc-c411-4f9a-a1d4-8585cce542a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a795e58-f921-411c-8660-0be993ad8aac", "tag": "a1a1b013-3ce9-4ed4-891e-95caa0880eef"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:33:52.289319 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=3 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:33:52.304574 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-6fa97349-63f3-428a-83cd-714d574c90a5 req-864078fc-c411-4f9a-a1d4-8585cce542a6 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:52.313384 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-6fa97349-63f3-428a-83cd-714d574c90a5 req-864078fc-c411-4f9a-a1d4-8585cce542a6 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:52.314047 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-6fa97349-63f3-428a-83cd-714d574c90a5 req-864078fc-c411-4f9a-a1d4-8585cce542a6 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:52.369137 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-6fa97349-63f3-428a-83cd-714d574c90a5 req-864078fc-c411-4f9a-a1d4-8585cce542a6 service nova] Creating event network-changed:a1a1b013-3ce9-4ed4-891e-95caa0880eef for instance 8a795e58-f921-411c-8660-0be993ad8aac on n-h2-850499-9 Aug 31 16:33:52.385262 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-6fa97349-63f3-428a-83cd-714d574c90a5 req-864078fc-c411-4f9a-a1d4-8585cce542a6 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105972 Aug 31 16:33:52.388408 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3100/6224] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:33:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:33:52.819439 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=35 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:33:52.821399 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=64 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:33:52.830647 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-aeb2dbb9-a9a6-48de-ac72-e3f0cdf97a24 tempest-VolumesTestJSON-205415459 tempest-VolumesTestJSON-205415459-project] Calling method '.version_select at 0x7f5ae3a0db80>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:33:52.962366 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-aeb2dbb9-a9a6-48de-ac72-e3f0cdf97a24 tempest-VolumesTestJSON-205415459 tempest-VolumesTestJSON-205415459-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/e341fbfb-a075-4436-af6b-46e6a93ed5ac" status: 200 len: 350 microversion: 2.1 time: 0.144889 Aug 31 16:33:52.973473 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3125/6225] 10.222.0.61 () {58 vars in 1245 bytes} [Wed Aug 31 16:33:52 2022] GET /compute/v2.1/os-volumes/e341fbfb-a075-4436-af6b-46e6a93ed5ac => generated 350 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:33:55.987791 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-358a2c32-be58-4a66-a77c-af3c2c7ea745 tempest-VolumesTestJSON-205415459 tempest-VolumesTestJSON-205415459-project] Calling method '.version_select at 0x7f5ae3b911f0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:33:56.144304 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-358a2c32-be58-4a66-a77c-af3c2c7ea745 tempest-VolumesTestJSON-205415459 tempest-VolumesTestJSON-205415459-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/68b86302-d920-41e8-a578-3dc694c647a6" status: 200 len: 351 microversion: 2.1 time: 0.161263 Aug 31 16:33:56.145154 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3101/6226] 10.222.0.61 () {58 vars in 1245 bytes} [Wed Aug 31 16:33:55 2022] GET /compute/v2.1/os-volumes/68b86302-d920-41e8-a578-3dc694c647a6 => generated 351 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:33:56.164597 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ed037970-4aa1-47e6-a927-e2469ed718df tempest-VolumesTestJSON-205415459 tempest-VolumesTestJSON-205415459-project] Calling method '.version_select at 0x7f5ae8c4a790>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:33:56.352931 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ed037970-4aa1-47e6-a927-e2469ed718df tempest-VolumesTestJSON-205415459 tempest-VolumesTestJSON-205415459-project] 10.222.0.61 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.197496 Aug 31 16:33:56.353529 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3126/6227] 10.222.0.61 () {58 vars in 1134 bytes} [Wed Aug 31 16:33:56 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:33:56.368890 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-878fc1e8-a63b-469a-a29c-cfc839d9f18e tempest-VolumesTestJSON-205415459 tempest-VolumesTestJSON-205415459-project] Calling method '.version_select at 0x7f5ae3d2df70>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:33:56.586829 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-878fc1e8-a63b-469a-a29c-cfc839d9f18e tempest-VolumesTestJSON-205415459 tempest-VolumesTestJSON-205415459-project] 10.222.0.61 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.222401 Aug 31 16:33:56.587962 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3102/6228] 10.222.0.61 () {58 vars in 1149 bytes} [Wed Aug 31 16:33:56 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:33:56.604099 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a0f1e879-cf78-46c8-960d-5f58c4ce795c tempest-VolumesTestJSON-205415459 tempest-VolumesTestJSON-205415459-project] Calling method '.version_select at 0x7f5ae3a0ddc0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:33:56.816217 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a0f1e879-cf78-46c8-960d-5f58c4ce795c tempest-VolumesTestJSON-205415459 tempest-VolumesTestJSON-205415459-project] 10.222.0.61 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.214582 Aug 31 16:33:56.817001 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3127/6229] 10.222.0.61 () {58 vars in 1134 bytes} [Wed Aug 31 16:33:56 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:33:56.835811 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ca8937f0-1545-449c-9acc-e0eccbfc80ac tempest-VolumesTestJSON-205415459 tempest-VolumesTestJSON-205415459-project] Calling method '.version_select at 0x7f5ae3d2d790>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:33:57.025427 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ca8937f0-1545-449c-9acc-e0eccbfc80ac tempest-VolumesTestJSON-205415459 tempest-VolumesTestJSON-205415459-project] 10.222.0.61 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.198362 Aug 31 16:33:57.029294 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3103/6230] 10.222.0.61 () {58 vars in 1167 bytes} [Wed Aug 31 16:33:56 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:33:57.043975 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-279df47f-e72d-4634-8a53-82213097cc04 tempest-VolumesTestJSON-205415459 tempest-VolumesTestJSON-205415459-project] Calling method '.version_select at 0x7f5ae3a0d940>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:33:57.256600 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-279df47f-e72d-4634-8a53-82213097cc04 tempest-VolumesTestJSON-205415459 tempest-VolumesTestJSON-205415459-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.217277 Aug 31 16:33:57.257194 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3128/6231] 10.222.0.61 () {58 vars in 1170 bytes} [Wed Aug 31 16:33:57 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:33:57.272278 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-fc67fe4a-823d-4411-af73-528d2b0b75ff tempest-VolumesTestJSON-205415459 tempest-VolumesTestJSON-205415459-project] Calling method '.version_select at 0x7f5ae3b9a550>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:33:57.486875 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-fc67fe4a-823d-4411-af73-528d2b0b75ff tempest-VolumesTestJSON-205415459 tempest-VolumesTestJSON-205415459-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.218491 Aug 31 16:33:57.487472 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3104/6232] 10.222.0.61 () {58 vars in 1155 bytes} [Wed Aug 31 16:33:57 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:33:57.504867 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-73a3e402-58df-447f-9bc0-65371b52687b tempest-VolumesTestJSON-205415459 tempest-VolumesTestJSON-205415459-project] Calling method '.version_select at 0x7f5ae3a14f70>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:33:57.626722 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-73a3e402-58df-447f-9bc0-65371b52687b tempest-VolumesTestJSON-205415459 tempest-VolumesTestJSON-205415459-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.125597 Aug 31 16:33:57.627240 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3129/6233] 10.222.0.61 () {58 vars in 1188 bytes} [Wed Aug 31 16:33:57 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:33:57.642264 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a9373482-85a4-4d70-a7a0-479e09e16899 tempest-VolumesTestJSON-205415459 tempest-VolumesTestJSON-205415459-project] Calling method '.version_select at 0x7f5ae3b9adc0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:33:57.753575 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a9373482-85a4-4d70-a7a0-479e09e16899 tempest-VolumesTestJSON-205415459 tempest-VolumesTestJSON-205415459-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.116263 Aug 31 16:33:57.754873 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3105/6234] 10.222.0.61 () {58 vars in 1155 bytes} [Wed Aug 31 16:33:57 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:35:08.921241 n-d-850499-9 devstack@n-api.service[122257]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 16:35:08.921833 n-d-850499-9 devstack@n-api.service[122257]: Wed Aug 31 16:35:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8a795e58-f921-411c-8660-0be993ad8aac/os-server-password (ip 10.222.0.61) !!! Aug 31 16:35:08.928388 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-142e5e98-b550-4fe7-9a96-e6b66d491dfd tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:35:08.928895 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-142e5e98-b550-4fe7-9a96-e6b66d491dfd tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] [instance: 8a795e58-f921-411c-8660-0be993ad8aac] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:35:08.956267 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-142e5e98-b550-4fe7-9a96-e6b66d491dfd tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:35:08.956771 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-142e5e98-b550-4fe7-9a96-e6b66d491dfd tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:35:08.957216 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-142e5e98-b550-4fe7-9a96-e6b66d491dfd tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:35:08.957945 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-142e5e98-b550-4fe7-9a96-e6b66d491dfd tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:35:08.958408 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-142e5e98-b550-4fe7-9a96-e6b66d491dfd tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:35:08.958839 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-142e5e98-b550-4fe7-9a96-e6b66d491dfd tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:35:08.992263 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-142e5e98-b550-4fe7-9a96-e6b66d491dfd tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] 10.222.0.61 "GET /compute/v2.1/servers/8a795e58-f921-411c-8660-0be993ad8aac/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.078927 Aug 31 16:35:08.994619 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3130/6235] 10.222.0.61 () {58 vars in 1293 bytes} [Wed Aug 31 16:35:08 2022] GET /compute/v2.1/servers/8a795e58-f921-411c-8660-0be993ad8aac/os-server-password => generated 116 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:35:35.788157 n-d-850499-9 devstack@n-api.service[122256]: ERROR oslo.messaging._drivers.impl_rabbit [-] [46519162-dc0d-41cb-af5d-7b19f3bd0573] AMQP server on 10.222.0.61:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 31 16:35:35.790095 n-d-850499-9 devstack@n-api.service[122256]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0cd6dd6f-a50d-4cf4-8d95-237d76a72b0e] AMQP server on 10.222.0.61:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 31 16:35:35.790922 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:35:35.792419 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=3 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:35:36.414291 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-88a1a0d6-88f3-4da8-abec-29c158c47afc tempest-PortsAdminExtendedAttrsTestJSON-241979572 tempest-PortsAdminExtendedAttrsTestJSON-241979572-project-admin] Calling method '.version_select at 0x7f5ae3d2d820>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:35:36.416902 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-88a1a0d6-88f3-4da8-abec-29c158c47afc tempest-PortsAdminExtendedAttrsTestJSON-241979572 tempest-PortsAdminExtendedAttrsTestJSON-241979572-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:35:36.418052 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-88a1a0d6-88f3-4da8-abec-29c158c47afc tempest-PortsAdminExtendedAttrsTestJSON-241979572 tempest-PortsAdminExtendedAttrsTestJSON-241979572-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:35:36.418700 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-88a1a0d6-88f3-4da8-abec-29c158c47afc tempest-PortsAdminExtendedAttrsTestJSON-241979572 tempest-PortsAdminExtendedAttrsTestJSON-241979572-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:35:36.461870 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-88a1a0d6-88f3-4da8-abec-29c158c47afc tempest-PortsAdminExtendedAttrsTestJSON-241979572 tempest-PortsAdminExtendedAttrsTestJSON-241979572-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:35:36.462387 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-88a1a0d6-88f3-4da8-abec-29c158c47afc tempest-PortsAdminExtendedAttrsTestJSON-241979572 tempest-PortsAdminExtendedAttrsTestJSON-241979572-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:35:36.486102 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-88a1a0d6-88f3-4da8-abec-29c158c47afc tempest-PortsAdminExtendedAttrsTestJSON-241979572 tempest-PortsAdminExtendedAttrsTestJSON-241979572-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:35:36.501837 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-88a1a0d6-88f3-4da8-abec-29c158c47afc tempest-PortsAdminExtendedAttrsTestJSON-241979572 tempest-PortsAdminExtendedAttrsTestJSON-241979572-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:35:36.502383 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-88a1a0d6-88f3-4da8-abec-29c158c47afc tempest-PortsAdminExtendedAttrsTestJSON-241979572 tempest-PortsAdminExtendedAttrsTestJSON-241979572-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:35:36.502812 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-88a1a0d6-88f3-4da8-abec-29c158c47afc tempest-PortsAdminExtendedAttrsTestJSON-241979572 tempest-PortsAdminExtendedAttrsTestJSON-241979572-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:35:36.510121 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-88a1a0d6-88f3-4da8-abec-29c158c47afc tempest-PortsAdminExtendedAttrsTestJSON-241979572 tempest-PortsAdminExtendedAttrsTestJSON-241979572-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.724995 Aug 31 16:35:36.511456 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3106/6236] 10.222.0.61 () {58 vars in 1146 bytes} [Wed Aug 31 16:35:35 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:35:46.758310 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:35:46.760287 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=4 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:35:47.087574 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-731e4833-ae69-4173-87dc-3fd11e2363d5 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1059217828", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "networks": [{"uuid": "4d9dd8c4-d44b-412f-b04c-74648e2da711"}]}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:35:47.230173 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-731e4833-ae69-4173-87dc-3fd11e2363d5 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] validate_networks() for [('4d9dd8c4-d44b-412f-b04c-74648e2da711', None, None, None, None, None)] {{(pid=122257) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:35:48.591564 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-731e4833-ae69-4173-87dc-3fd11e2363d5 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:35:48.593161 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-731e4833-ae69-4173-87dc-3fd11e2363d5 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:35:48.593869 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-731e4833-ae69-4173-87dc-3fd11e2363d5 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:35:48.594497 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-731e4833-ae69-4173-87dc-3fd11e2363d5 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:35:48.595143 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-731e4833-ae69-4173-87dc-3fd11e2363d5 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:35:48.606673 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-731e4833-ae69-4173-87dc-3fd11e2363d5 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:35:48.607492 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-731e4833-ae69-4173-87dc-3fd11e2363d5 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:35:48.608253 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-731e4833-ae69-4173-87dc-3fd11e2363d5 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:35:48.609239 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-731e4833-ae69-4173-87dc-3fd11e2363d5 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:35:48.609963 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-731e4833-ae69-4173-87dc-3fd11e2363d5 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:35:48.610608 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-731e4833-ae69-4173-87dc-3fd11e2363d5 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:35:48.631054 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-731e4833-ae69-4173-87dc-3fd11e2363d5 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Getting quotas for project 464106486e354d9996a53bd9c8fcc96c. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:35:48.637691 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-731e4833-ae69-4173-87dc-3fd11e2363d5 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Getting quotas for user ece934696704465a9a003ebd5d2b6f72 and project 464106486e354d9996a53bd9c8fcc96c. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:35:48.659487 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-731e4833-ae69-4173-87dc-3fd11e2363d5 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Going to run 1 instances... {{(pid=122257) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:35:48.664450 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-731e4833-ae69-4173-87dc-3fd11e2363d5 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] [instance: 444260df-2e21-4f91-b836-272b7e34c335] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:35:48.745661 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-731e4833-ae69-4173-87dc-3fd11e2363d5 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.992257 Aug 31 16:35:48.747363 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3131/6237] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:35:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1996 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:35:48.757991 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-795f19cf-6c02-45df-aabd-b73c0967073d tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:35:48.758737 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-795f19cf-6c02-45df-aabd-b73c0967073d tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] [instance: 444260df-2e21-4f91-b836-272b7e34c335] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:35:48.782521 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=4 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:35:48.784701 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=6 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:35:48.813195 n-d-850499-9 devstack@n-api.service[122256]: INFO oslo.messaging._drivers.impl_rabbit [-] [46519162-dc0d-41cb-af5d-7b19f3bd0573] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 45244. Aug 31 16:35:48.839937 n-d-850499-9 devstack@n-api.service[122256]: INFO oslo.messaging._drivers.impl_rabbit [-] [0cd6dd6f-a50d-4cf4-8d95-237d76a72b0e] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 45246. Aug 31 16:35:48.938223 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-795f19cf-6c02-45df-aabd-b73c0967073d tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece934696704465a9a003ebd5d2b6f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '464106486e354d9996a53bd9c8fcc96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:35:48.950228 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-795f19cf-6c02-45df-aabd-b73c0967073d tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] 10.222.0.61 "GET /compute/v2.1/servers/444260df-2e21-4f91-b836-272b7e34c335" status: 200 len: 1214 microversion: 2.1 time: 0.193200 Aug 31 16:35:48.951183 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3107/6238] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:35:48 2022] GET /compute/v2.1/servers/444260df-2e21-4f91-b836-272b7e34c335 => generated 1214 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:35:49.973549 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-761ad1bf-ef6c-4ea2-90e7-a991147742cb tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:35:49.974143 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-761ad1bf-ef6c-4ea2-90e7-a991147742cb tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] [instance: 444260df-2e21-4f91-b836-272b7e34c335] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:35:50.013863 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-761ad1bf-ef6c-4ea2-90e7-a991147742cb tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:35:50.014373 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-761ad1bf-ef6c-4ea2-90e7-a991147742cb tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:35:50.014820 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-761ad1bf-ef6c-4ea2-90e7-a991147742cb tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:35:50.018034 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-761ad1bf-ef6c-4ea2-90e7-a991147742cb tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:35:50.018569 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-761ad1bf-ef6c-4ea2-90e7-a991147742cb tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:35:50.019001 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-761ad1bf-ef6c-4ea2-90e7-a991147742cb tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:35:50.174137 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-761ad1bf-ef6c-4ea2-90e7-a991147742cb tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece934696704465a9a003ebd5d2b6f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '464106486e354d9996a53bd9c8fcc96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:35:50.187487 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-761ad1bf-ef6c-4ea2-90e7-a991147742cb tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] 10.222.0.61 "GET /compute/v2.1/servers/444260df-2e21-4f91-b836-272b7e34c335" status: 200 len: 1218 microversion: 2.1 time: 0.220764 Aug 31 16:35:50.195533 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3132/6239] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:35:49 2022] GET /compute/v2.1/servers/444260df-2e21-4f91-b836-272b7e34c335 => generated 1218 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:35:51.220669 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-357555db-4c50-4ebe-9b81-dd7d65e8e06e tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:35:51.221367 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-357555db-4c50-4ebe-9b81-dd7d65e8e06e tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] [instance: 444260df-2e21-4f91-b836-272b7e34c335] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:35:51.241055 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-357555db-4c50-4ebe-9b81-dd7d65e8e06e tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:35:51.241412 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-357555db-4c50-4ebe-9b81-dd7d65e8e06e tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:35:51.241940 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-357555db-4c50-4ebe-9b81-dd7d65e8e06e tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:35:51.242669 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-357555db-4c50-4ebe-9b81-dd7d65e8e06e tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:35:51.243126 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-357555db-4c50-4ebe-9b81-dd7d65e8e06e tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:35:51.243573 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-357555db-4c50-4ebe-9b81-dd7d65e8e06e tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:35:51.343550 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-357555db-4c50-4ebe-9b81-dd7d65e8e06e tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece934696704465a9a003ebd5d2b6f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '464106486e354d9996a53bd9c8fcc96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:35:51.355896 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-357555db-4c50-4ebe-9b81-dd7d65e8e06e tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] 10.222.0.61 "GET /compute/v2.1/servers/444260df-2e21-4f91-b836-272b7e34c335" status: 200 len: 1272 microversion: 2.1 time: 0.147431 Aug 31 16:35:51.361902 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3108/6240] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:35:51 2022] GET /compute/v2.1/servers/444260df-2e21-4f91-b836-272b7e34c335 => generated 1272 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:35:52.380601 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a4148487-b5d2-4d8d-83d8-724631a26f59 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:35:52.381111 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a4148487-b5d2-4d8d-83d8-724631a26f59 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] [instance: 444260df-2e21-4f91-b836-272b7e34c335] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:35:52.406883 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a4148487-b5d2-4d8d-83d8-724631a26f59 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:35:52.407375 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a4148487-b5d2-4d8d-83d8-724631a26f59 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:35:52.407971 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a4148487-b5d2-4d8d-83d8-724631a26f59 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:35:52.408566 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a4148487-b5d2-4d8d-83d8-724631a26f59 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:35:52.409029 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a4148487-b5d2-4d8d-83d8-724631a26f59 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:35:52.409478 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a4148487-b5d2-4d8d-83d8-724631a26f59 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:35:52.682717 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a4148487-b5d2-4d8d-83d8-724631a26f59 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece934696704465a9a003ebd5d2b6f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '464106486e354d9996a53bd9c8fcc96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:35:52.696586 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a4148487-b5d2-4d8d-83d8-724631a26f59 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] 10.222.0.61 "GET /compute/v2.1/servers/444260df-2e21-4f91-b836-272b7e34c335" status: 200 len: 1314 microversion: 2.1 time: 0.319798 Aug 31 16:35:52.698471 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3133/6241] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:35:52 2022] GET /compute/v2.1/servers/444260df-2e21-4f91-b836-272b7e34c335 => generated 1314 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:35:53.718467 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b1a63dc3-5b86-4e1e-8c6c-6f3a17307d97 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:35:53.719075 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b1a63dc3-5b86-4e1e-8c6c-6f3a17307d97 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] [instance: 444260df-2e21-4f91-b836-272b7e34c335] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:35:53.727337 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b1a63dc3-5b86-4e1e-8c6c-6f3a17307d97 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:35:53.730448 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b1a63dc3-5b86-4e1e-8c6c-6f3a17307d97 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:35:53.736321 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b1a63dc3-5b86-4e1e-8c6c-6f3a17307d97 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:35:53.736908 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b1a63dc3-5b86-4e1e-8c6c-6f3a17307d97 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:35:53.737384 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b1a63dc3-5b86-4e1e-8c6c-6f3a17307d97 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:35:53.737818 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b1a63dc3-5b86-4e1e-8c6c-6f3a17307d97 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:35:54.360044 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b1a63dc3-5b86-4e1e-8c6c-6f3a17307d97 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece934696704465a9a003ebd5d2b6f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '464106486e354d9996a53bd9c8fcc96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:35:54.387324 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b1a63dc3-5b86-4e1e-8c6c-6f3a17307d97 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] 10.222.0.61 "GET /compute/v2.1/servers/444260df-2e21-4f91-b836-272b7e34c335" status: 200 len: 1314 microversion: 2.1 time: 0.668849 Aug 31 16:35:54.394397 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3109/6242] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:35:53 2022] GET /compute/v2.1/servers/444260df-2e21-4f91-b836-272b7e34c335 => generated 1314 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:35:55.329218 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-a24ce116-18f8-445c-80c3-d33e19c73117 req-bf65161b-161d-4282-ad28-eb65ee875ede service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "444260df-2e21-4f91-b836-272b7e34c335", "tag": "30840c4f-852a-479a-899b-0842a34ad2b8"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:35:55.373906 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-a24ce116-18f8-445c-80c3-d33e19c73117 req-bf65161b-161d-4282-ad28-eb65ee875ede service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:35:55.374411 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-a24ce116-18f8-445c-80c3-d33e19c73117 req-bf65161b-161d-4282-ad28-eb65ee875ede service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:35:55.374853 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-a24ce116-18f8-445c-80c3-d33e19c73117 req-bf65161b-161d-4282-ad28-eb65ee875ede service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:35:55.412291 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8e81585a-e7f2-4ef9-95d3-789f244e046b tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:35:55.413759 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8e81585a-e7f2-4ef9-95d3-789f244e046b tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] [instance: 444260df-2e21-4f91-b836-272b7e34c335] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:35:55.429788 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8e81585a-e7f2-4ef9-95d3-789f244e046b tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:35:55.434435 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8e81585a-e7f2-4ef9-95d3-789f244e046b tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:35:55.438098 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8e81585a-e7f2-4ef9-95d3-789f244e046b tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:35:55.442554 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8e81585a-e7f2-4ef9-95d3-789f244e046b tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:35:55.445219 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8e81585a-e7f2-4ef9-95d3-789f244e046b tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:35:55.445978 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8e81585a-e7f2-4ef9-95d3-789f244e046b tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:35:55.463273 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-a24ce116-18f8-445c-80c3-d33e19c73117 req-bf65161b-161d-4282-ad28-eb65ee875ede service nova] Creating event network-changed:30840c4f-852a-479a-899b-0842a34ad2b8 for instance 444260df-2e21-4f91-b836-272b7e34c335 on n-h1-850499-9 Aug 31 16:35:55.494789 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-a24ce116-18f8-445c-80c3-d33e19c73117 req-bf65161b-161d-4282-ad28-eb65ee875ede service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.167321 Aug 31 16:35:55.495469 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3134/6243] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:35:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:35:56.197746 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8e81585a-e7f2-4ef9-95d3-789f244e046b tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece934696704465a9a003ebd5d2b6f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '464106486e354d9996a53bd9c8fcc96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:35:56.216941 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8e81585a-e7f2-4ef9-95d3-789f244e046b tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] 10.222.0.61 "GET /compute/v2.1/servers/444260df-2e21-4f91-b836-272b7e34c335" status: 200 len: 1314 microversion: 2.1 time: 0.802767 Aug 31 16:35:56.217895 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3110/6244] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:35:55 2022] GET /compute/v2.1/servers/444260df-2e21-4f91-b836-272b7e34c335 => generated 1314 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:35:57.239587 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-95094418-2535-4259-aa26-dd338e6618b0 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:35:57.247855 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-95094418-2535-4259-aa26-dd338e6618b0 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] [instance: 444260df-2e21-4f91-b836-272b7e34c335] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:35:57.264590 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-95094418-2535-4259-aa26-dd338e6618b0 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:35:57.265169 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-95094418-2535-4259-aa26-dd338e6618b0 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:35:57.265801 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-95094418-2535-4259-aa26-dd338e6618b0 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:35:57.266930 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-95094418-2535-4259-aa26-dd338e6618b0 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:35:57.268213 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-95094418-2535-4259-aa26-dd338e6618b0 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:35:57.268818 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-95094418-2535-4259-aa26-dd338e6618b0 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:35:57.771049 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-95094418-2535-4259-aa26-dd338e6618b0 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece934696704465a9a003ebd5d2b6f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '464106486e354d9996a53bd9c8fcc96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:35:57.784045 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-95094418-2535-4259-aa26-dd338e6618b0 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] 10.222.0.61 "GET /compute/v2.1/servers/444260df-2e21-4f91-b836-272b7e34c335" status: 200 len: 1314 microversion: 2.1 time: 0.549218 Aug 31 16:35:57.799724 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3135/6245] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:35:57 2022] GET /compute/v2.1/servers/444260df-2e21-4f91-b836-272b7e34c335 => generated 1314 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:35:58.811237 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5ac3d280-b7fb-47ab-853b-8ced77d8d2e2 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:35:58.812348 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5ac3d280-b7fb-47ab-853b-8ced77d8d2e2 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] [instance: 444260df-2e21-4f91-b836-272b7e34c335] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:35:58.856807 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5ac3d280-b7fb-47ab-853b-8ced77d8d2e2 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:35:58.857715 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5ac3d280-b7fb-47ab-853b-8ced77d8d2e2 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:35:58.861289 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5ac3d280-b7fb-47ab-853b-8ced77d8d2e2 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:35:58.862720 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5ac3d280-b7fb-47ab-853b-8ced77d8d2e2 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:35:58.864933 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5ac3d280-b7fb-47ab-853b-8ced77d8d2e2 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:35:58.869791 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5ac3d280-b7fb-47ab-853b-8ced77d8d2e2 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:35:58.959045 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:35:59.751039 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5ac3d280-b7fb-47ab-853b-8ced77d8d2e2 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece934696704465a9a003ebd5d2b6f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '464106486e354d9996a53bd9c8fcc96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:35:59.765130 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5ac3d280-b7fb-47ab-853b-8ced77d8d2e2 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] 10.222.0.61 "GET /compute/v2.1/servers/444260df-2e21-4f91-b836-272b7e34c335" status: 200 len: 1314 microversion: 2.1 time: 0.958323 Aug 31 16:35:59.785692 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3111/6246] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:35:58 2022] GET /compute/v2.1/servers/444260df-2e21-4f91-b836-272b7e34c335 => generated 1314 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:36:00.799197 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f8caa54f-dce2-4854-ac3e-b1310d1511ab tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:36:00.800676 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f8caa54f-dce2-4854-ac3e-b1310d1511ab tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] [instance: 444260df-2e21-4f91-b836-272b7e34c335] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:36:00.807771 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:36:00.809561 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=6 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:36:00.820157 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f8caa54f-dce2-4854-ac3e-b1310d1511ab tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:36:00.825916 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f8caa54f-dce2-4854-ac3e-b1310d1511ab tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:36:00.826696 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f8caa54f-dce2-4854-ac3e-b1310d1511ab tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:36:00.828322 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f8caa54f-dce2-4854-ac3e-b1310d1511ab tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:36:00.829015 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f8caa54f-dce2-4854-ac3e-b1310d1511ab tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:36:00.830025 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f8caa54f-dce2-4854-ac3e-b1310d1511ab tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:36:01.575616 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f8caa54f-dce2-4854-ac3e-b1310d1511ab tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece934696704465a9a003ebd5d2b6f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '464106486e354d9996a53bd9c8fcc96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:36:01.602113 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f8caa54f-dce2-4854-ac3e-b1310d1511ab tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] 10.222.0.61 "GET /compute/v2.1/servers/444260df-2e21-4f91-b836-272b7e34c335" status: 200 len: 1314 microversion: 2.1 time: 0.810955 Aug 31 16:36:01.609028 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3136/6247] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:36:00 2022] GET /compute/v2.1/servers/444260df-2e21-4f91-b836-272b7e34c335 => generated 1314 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:36:02.634194 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-60ab8b38-8976-4331-8b15-8449bd6f607e tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:36:02.636463 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-60ab8b38-8976-4331-8b15-8449bd6f607e tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] [instance: 444260df-2e21-4f91-b836-272b7e34c335] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:36:02.648508 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-60ab8b38-8976-4331-8b15-8449bd6f607e tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:36:02.649712 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-60ab8b38-8976-4331-8b15-8449bd6f607e tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:36:02.650533 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-60ab8b38-8976-4331-8b15-8449bd6f607e tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:36:02.651524 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-60ab8b38-8976-4331-8b15-8449bd6f607e tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:36:02.652264 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-60ab8b38-8976-4331-8b15-8449bd6f607e tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:36:02.652713 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-60ab8b38-8976-4331-8b15-8449bd6f607e tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:36:03.262315 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-60ab8b38-8976-4331-8b15-8449bd6f607e tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece934696704465a9a003ebd5d2b6f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '464106486e354d9996a53bd9c8fcc96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:36:03.275088 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-60ab8b38-8976-4331-8b15-8449bd6f607e tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] 10.222.0.61 "GET /compute/v2.1/servers/444260df-2e21-4f91-b836-272b7e34c335" status: 200 len: 1314 microversion: 2.1 time: 0.647549 Aug 31 16:36:03.276495 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3112/6248] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:36:02 2022] GET /compute/v2.1/servers/444260df-2e21-4f91-b836-272b7e34c335 => generated 1314 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:36:04.300480 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ba62a8ae-c182-401f-8f7c-e23ca1a061c0 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:36:04.301123 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ba62a8ae-c182-401f-8f7c-e23ca1a061c0 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] [instance: 444260df-2e21-4f91-b836-272b7e34c335] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:36:04.323257 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ba62a8ae-c182-401f-8f7c-e23ca1a061c0 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:36:04.326459 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ba62a8ae-c182-401f-8f7c-e23ca1a061c0 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:36:04.327209 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ba62a8ae-c182-401f-8f7c-e23ca1a061c0 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:36:04.329067 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ba62a8ae-c182-401f-8f7c-e23ca1a061c0 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:36:04.331592 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ba62a8ae-c182-401f-8f7c-e23ca1a061c0 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:36:04.332442 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ba62a8ae-c182-401f-8f7c-e23ca1a061c0 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:36:05.038616 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ba62a8ae-c182-401f-8f7c-e23ca1a061c0 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece934696704465a9a003ebd5d2b6f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '464106486e354d9996a53bd9c8fcc96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:36:05.048429 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ba62a8ae-c182-401f-8f7c-e23ca1a061c0 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] 10.222.0.61 "GET /compute/v2.1/servers/444260df-2e21-4f91-b836-272b7e34c335" status: 200 len: 1314 microversion: 2.1 time: 0.753938 Aug 31 16:36:05.055932 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3137/6249] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:36:04 2022] GET /compute/v2.1/servers/444260df-2e21-4f91-b836-272b7e34c335 => generated 1314 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:36:06.074006 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-08d57406-85ed-4aab-a55e-0cd653a3818b tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:36:06.075305 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-08d57406-85ed-4aab-a55e-0cd653a3818b tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] [instance: 444260df-2e21-4f91-b836-272b7e34c335] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:36:06.091156 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-08d57406-85ed-4aab-a55e-0cd653a3818b tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:36:06.091988 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-08d57406-85ed-4aab-a55e-0cd653a3818b tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:36:06.092865 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-08d57406-85ed-4aab-a55e-0cd653a3818b tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:36:06.099285 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-08d57406-85ed-4aab-a55e-0cd653a3818b tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:36:06.101556 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-08d57406-85ed-4aab-a55e-0cd653a3818b tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:36:06.102787 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-08d57406-85ed-4aab-a55e-0cd653a3818b tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:36:06.437162 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-208e5fdf-ff9a-409f-af4d-3dbc35d18716 req-cc32516f-2d4b-4b5e-99c7-90f5cc184a85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "444260df-2e21-4f91-b836-272b7e34c335", "name": "network-vif-plugged", "status": "completed", "tag": "30840c4f-852a-479a-899b-0842a34ad2b8"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:36:06.475820 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-208e5fdf-ff9a-409f-af4d-3dbc35d18716 req-cc32516f-2d4b-4b5e-99c7-90f5cc184a85 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:36:06.476601 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-208e5fdf-ff9a-409f-af4d-3dbc35d18716 req-cc32516f-2d4b-4b5e-99c7-90f5cc184a85 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:36:06.478191 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-208e5fdf-ff9a-409f-af4d-3dbc35d18716 req-cc32516f-2d4b-4b5e-99c7-90f5cc184a85 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:36:06.497170 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-08d57406-85ed-4aab-a55e-0cd653a3818b tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece934696704465a9a003ebd5d2b6f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '464106486e354d9996a53bd9c8fcc96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:36:06.517302 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-08d57406-85ed-4aab-a55e-0cd653a3818b tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] 10.222.0.61 "GET /compute/v2.1/servers/444260df-2e21-4f91-b836-272b7e34c335" status: 200 len: 1314 microversion: 2.1 time: 0.447790 Aug 31 16:36:06.521400 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-208e5fdf-ff9a-409f-af4d-3dbc35d18716 req-cc32516f-2d4b-4b5e-99c7-90f5cc184a85 service nova] Creating event network-vif-plugged:30840c4f-852a-479a-899b-0842a34ad2b8 for instance 444260df-2e21-4f91-b836-272b7e34c335 on n-h1-850499-9 Aug 31 16:36:06.522707 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3113/6250] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:36:06 2022] GET /compute/v2.1/servers/444260df-2e21-4f91-b836-272b7e34c335 => generated 1314 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:36:06.530360 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-208e5fdf-ff9a-409f-af4d-3dbc35d18716 req-cc32516f-2d4b-4b5e-99c7-90f5cc184a85 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122661 Aug 31 16:36:06.533828 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3138/6251] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:36:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:36:07.543100 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-783e4930-0833-4971-95c6-479e0fa22126 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:36:07.545267 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-783e4930-0833-4971-95c6-479e0fa22126 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] [instance: 444260df-2e21-4f91-b836-272b7e34c335] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:36:07.571563 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-783e4930-0833-4971-95c6-479e0fa22126 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:36:07.572502 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-783e4930-0833-4971-95c6-479e0fa22126 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:36:07.573160 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-783e4930-0833-4971-95c6-479e0fa22126 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:36:07.576132 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-783e4930-0833-4971-95c6-479e0fa22126 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:36:07.577984 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-783e4930-0833-4971-95c6-479e0fa22126 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:36:07.580073 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-783e4930-0833-4971-95c6-479e0fa22126 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:36:07.885154 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-783e4930-0833-4971-95c6-479e0fa22126 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece934696704465a9a003ebd5d2b6f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '464106486e354d9996a53bd9c8fcc96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:36:07.895882 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-783e4930-0833-4971-95c6-479e0fa22126 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] 10.222.0.61 "GET /compute/v2.1/servers/444260df-2e21-4f91-b836-272b7e34c335" status: 200 len: 1314 microversion: 2.1 time: 0.361213 Aug 31 16:36:07.901977 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3114/6252] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:36:07 2022] GET /compute/v2.1/servers/444260df-2e21-4f91-b836-272b7e34c335 => generated 1314 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:36:08.934701 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b3e9250c-b24a-4f7b-8d8b-401f8db189b3 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:36:08.936002 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b3e9250c-b24a-4f7b-8d8b-401f8db189b3 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] [instance: 444260df-2e21-4f91-b836-272b7e34c335] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:36:08.963782 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b3e9250c-b24a-4f7b-8d8b-401f8db189b3 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:36:08.964897 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b3e9250c-b24a-4f7b-8d8b-401f8db189b3 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:36:08.965986 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b3e9250c-b24a-4f7b-8d8b-401f8db189b3 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:36:08.967887 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b3e9250c-b24a-4f7b-8d8b-401f8db189b3 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:36:08.968856 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b3e9250c-b24a-4f7b-8d8b-401f8db189b3 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:36:08.978298 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b3e9250c-b24a-4f7b-8d8b-401f8db189b3 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:36:10.618987 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b3e9250c-b24a-4f7b-8d8b-401f8db189b3 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece934696704465a9a003ebd5d2b6f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '464106486e354d9996a53bd9c8fcc96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:36:10.639466 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b3e9250c-b24a-4f7b-8d8b-401f8db189b3 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] 10.222.0.61 "GET /compute/v2.1/servers/444260df-2e21-4f91-b836-272b7e34c335" status: 200 len: 1498 microversion: 2.1 time: 1.714376 Aug 31 16:36:10.642214 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3139/6253] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:36:08 2022] GET /compute/v2.1/servers/444260df-2e21-4f91-b836-272b7e34c335 => generated 1498 bytes in 1719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:36:18.566848 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3a04278b-df3e-4196-bd8d-480c1425c4c4 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:36:18.567288 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3a04278b-df3e-4196-bd8d-480c1425c4c4 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] [instance: 444260df-2e21-4f91-b836-272b7e34c335] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:36:18.572014 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=18 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:36:18.572725 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=42 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:36:18.583427 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3a04278b-df3e-4196-bd8d-480c1425c4c4 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:36:18.585403 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3a04278b-df3e-4196-bd8d-480c1425c4c4 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:36:18.586373 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3a04278b-df3e-4196-bd8d-480c1425c4c4 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:36:18.588243 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3a04278b-df3e-4196-bd8d-480c1425c4c4 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:36:18.588899 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3a04278b-df3e-4196-bd8d-480c1425c4c4 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:36:18.589566 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3a04278b-df3e-4196-bd8d-480c1425c4c4 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:36:18.638994 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3a04278b-df3e-4196-bd8d-480c1425c4c4 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] [instance: 444260df-2e21-4f91-b836-272b7e34c335] Going to try to terminate instance {{(pid=122256) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:36:18.829984 n-d-850499-9 devstack@n-api.service[122256]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3a04278b-df3e-4196-bd8d-480c1425c4c4 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] [a090154c-a288-4982-9b99-51aebb70f126] AMQP server on 10.222.0.61:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 31 16:36:19.861547 n-d-850499-9 devstack@n-api.service[122256]: INFO oslo.messaging._drivers.impl_rabbit [None req-3a04278b-df3e-4196-bd8d-480c1425c4c4 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] [a090154c-a288-4982-9b99-51aebb70f126] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 46358. Aug 31 16:36:19.902034 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3a04278b-df3e-4196-bd8d-480c1425c4c4 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] 10.222.0.61 "DELETE /compute/v2.1/servers/444260df-2e21-4f91-b836-272b7e34c335" status: 204 len: 0 microversion: 2.1 time: 1.339206 Aug 31 16:36:19.902696 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3115/6254] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:36:18 2022] DELETE /compute/v2.1/servers/444260df-2e21-4f91-b836-272b7e34c335 => generated 0 bytes in 1341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:36:19.920643 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-51b578f7-a0dc-4479-b451-12c76dac4785 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:36:19.921521 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-51b578f7-a0dc-4479-b451-12c76dac4785 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] [instance: 444260df-2e21-4f91-b836-272b7e34c335] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:36:19.933819 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:36:19.966899 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-51b578f7-a0dc-4479-b451-12c76dac4785 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:36:19.981799 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-51b578f7-a0dc-4479-b451-12c76dac4785 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:36:19.988340 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-51b578f7-a0dc-4479-b451-12c76dac4785 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:36:19.994837 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-51b578f7-a0dc-4479-b451-12c76dac4785 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:36:19.996400 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-51b578f7-a0dc-4479-b451-12c76dac4785 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:36:20.001847 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-51b578f7-a0dc-4479-b451-12c76dac4785 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:36:20.029386 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=43 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:36:21.177137 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-51b578f7-a0dc-4479-b451-12c76dac4785 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece934696704465a9a003ebd5d2b6f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '464106486e354d9996a53bd9c8fcc96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:36:21.219342 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-51b578f7-a0dc-4479-b451-12c76dac4785 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] 10.222.0.61 "GET /compute/v2.1/servers/444260df-2e21-4f91-b836-272b7e34c335" status: 200 len: 1504 microversion: 2.1 time: 1.299696 Aug 31 16:36:21.219342 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3140/6255] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:36:19 2022] GET /compute/v2.1/servers/444260df-2e21-4f91-b836-272b7e34c335 => generated 1504 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:36:22.248572 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6f1c27ad-62c0-4dd6-8b03-ec01df99cf30 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:36:22.250072 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6f1c27ad-62c0-4dd6-8b03-ec01df99cf30 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] [instance: 444260df-2e21-4f91-b836-272b7e34c335] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:36:22.274622 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6f1c27ad-62c0-4dd6-8b03-ec01df99cf30 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:36:22.278133 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6f1c27ad-62c0-4dd6-8b03-ec01df99cf30 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:36:22.278930 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6f1c27ad-62c0-4dd6-8b03-ec01df99cf30 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:36:22.280088 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6f1c27ad-62c0-4dd6-8b03-ec01df99cf30 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:36:22.285565 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6f1c27ad-62c0-4dd6-8b03-ec01df99cf30 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:36:22.286328 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6f1c27ad-62c0-4dd6-8b03-ec01df99cf30 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:36:23.386412 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-6f1c27ad-62c0-4dd6-8b03-ec01df99cf30 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece934696704465a9a003ebd5d2b6f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '464106486e354d9996a53bd9c8fcc96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:36:23.430870 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6f1c27ad-62c0-4dd6-8b03-ec01df99cf30 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] 10.222.0.61 "GET /compute/v2.1/servers/444260df-2e21-4f91-b836-272b7e34c335" status: 200 len: 1504 microversion: 2.1 time: 1.186390 Aug 31 16:36:23.432106 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3116/6256] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:36:22 2022] GET /compute/v2.1/servers/444260df-2e21-4f91-b836-272b7e34c335 => generated 1504 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:36:24.473126 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-970fa399-3f9f-4fad-97db-153d089ae8b1 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:36:24.476127 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-970fa399-3f9f-4fad-97db-153d089ae8b1 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] [instance: 444260df-2e21-4f91-b836-272b7e34c335] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:36:24.517188 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-970fa399-3f9f-4fad-97db-153d089ae8b1 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:36:24.524312 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-970fa399-3f9f-4fad-97db-153d089ae8b1 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:36:24.529104 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-970fa399-3f9f-4fad-97db-153d089ae8b1 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:36:24.530594 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-970fa399-3f9f-4fad-97db-153d089ae8b1 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:36:24.542915 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-970fa399-3f9f-4fad-97db-153d089ae8b1 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:36:24.544722 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-970fa399-3f9f-4fad-97db-153d089ae8b1 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:36:24.789064 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-bd9c7ee7-9f78-4d4b-ae30-35ea559aef60 req-23912295-f35d-44c2-bb58-c2d7b52727fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "444260df-2e21-4f91-b836-272b7e34c335", "name": "network-vif-deleted", "tag": "30840c4f-852a-479a-899b-0842a34ad2b8"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:36:24.818681 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-bd9c7ee7-9f78-4d4b-ae30-35ea559aef60 req-23912295-f35d-44c2-bb58-c2d7b52727fa service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:36:24.819220 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-bd9c7ee7-9f78-4d4b-ae30-35ea559aef60 req-23912295-f35d-44c2-bb58-c2d7b52727fa service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:36:24.819698 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-bd9c7ee7-9f78-4d4b-ae30-35ea559aef60 req-23912295-f35d-44c2-bb58-c2d7b52727fa service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:36:24.865750 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-bd9c7ee7-9f78-4d4b-ae30-35ea559aef60 req-23912295-f35d-44c2-bb58-c2d7b52727fa service nova] Creating event network-vif-deleted:30840c4f-852a-479a-899b-0842a34ad2b8 for instance 444260df-2e21-4f91-b836-272b7e34c335 on n-h1-850499-9 Aug 31 16:36:24.882033 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-970fa399-3f9f-4fad-97db-153d089ae8b1 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ece934696704465a9a003ebd5d2b6f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '464106486e354d9996a53bd9c8fcc96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:36:24.900078 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-970fa399-3f9f-4fad-97db-153d089ae8b1 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] 10.222.0.61 "GET /compute/v2.1/servers/444260df-2e21-4f91-b836-272b7e34c335" status: 200 len: 1462 microversion: 2.1 time: 0.445370 Aug 31 16:36:24.900871 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3141/6257] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:36:24 2022] GET /compute/v2.1/servers/444260df-2e21-4f91-b836-272b7e34c335 => generated 1462 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:36:24.906427 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-bd9c7ee7-9f78-4d4b-ae30-35ea559aef60 req-23912295-f35d-44c2-bb58-c2d7b52727fa service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124121 Aug 31 16:36:24.907839 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3117/6258] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:36:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 31 16:36:25.932100 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b8dfbe30-1cb2-447c-bb2f-2e7a766a4946 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:36:25.934746 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b8dfbe30-1cb2-447c-bb2f-2e7a766a4946 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] [instance: 444260df-2e21-4f91-b836-272b7e34c335] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:36:25.972419 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b8dfbe30-1cb2-447c-bb2f-2e7a766a4946 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:36:25.974944 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b8dfbe30-1cb2-447c-bb2f-2e7a766a4946 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:36:25.976106 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b8dfbe30-1cb2-447c-bb2f-2e7a766a4946 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:36:25.978933 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b8dfbe30-1cb2-447c-bb2f-2e7a766a4946 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:36:25.982126 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b8dfbe30-1cb2-447c-bb2f-2e7a766a4946 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:36:25.984785 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b8dfbe30-1cb2-447c-bb2f-2e7a766a4946 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:36:26.027337 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-b8dfbe30-1cb2-447c-bb2f-2e7a766a4946 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] HTTP exception thrown: Instance 444260df-2e21-4f91-b836-272b7e34c335 could not be found. Aug 31 16:36:26.033806 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b8dfbe30-1cb2-447c-bb2f-2e7a766a4946 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Request method failure captured: Aug 31 16:36:26.033806 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/444260df-2e21-4f91-b836-272b7e34c335 HTTP/1.1 Aug 31 16:36:26.033806 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:36:26.033806 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:36:26.033806 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:36:26.033806 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:36:26.033806 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:36:26.033806 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:36:26.033806 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:36:26.033806 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:36:26.033806 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD43fIr_6bEtZvmKWspQHlonEDiiFsfEMbJ7HiXVprULl7zY-cZVD9P4bBngksXRyS27jnY1yRf8CYyVMog6PJ_7YYbmq_gChWBTdjZfYHQs7pUTjq5QW_gtNCmVE-kepR6xGf8CFvM6ZYgJ1_FvaK8QZqcrmHBmVDYuXiYu9yndK3xE Aug 31 16:36:26.033806 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:36:26.033806 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:36:26.033806 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:36:26.033806 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:36:26.033806 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:36:26.033806 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:36:26.033806 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 464106486e354d9996a53bd9c8fcc96c Aug 31 16:36:26.033806 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-VolumesActionsTest-1815548266 Aug 31 16:36:26.033806 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:36:26.033806 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:36:26.033806 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/464106486e354d9996a53bd9c8fcc96c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/464106486e354d9996a53bd9c8fcc96c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_464106486e354d9996a53bd9c8fcc96c", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/464106486e354d9996a53bd9c8fcc96c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:36:26.033806 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-VolumesActionsTest-1815548266 Aug 31 16:36:26.033806 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 464106486e354d9996a53bd9c8fcc96c Aug 31 16:36:26.033806 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-VolumesActionsTest-1815548266 Aug 31 16:36:26.033806 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-VolumesActionsTest-1815548266-project Aug 31 16:36:26.033806 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:36:26.033806 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:36:26.033806 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: ece934696704465a9a003ebd5d2b6f72 Aug 31 16:36:26.033806 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-VolumesActionsTest-1815548266-project Aug 31 16:36:26.033806 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:36:26.033806 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance 444260df-2e21-4f91-b836-272b7e34c335 could not be found. Aug 31 16:36:26.033806 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '444260df-2e21-4f91-b836-272b7e34c335'} Aug 31 16:36:26.033806 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:36:26.033806 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:36:26.033806 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:36:26.033806 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:36:26.033806 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:36:26.033806 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:36:26.033806 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:36:26.033806 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:36:26.033806 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:36:26.033806 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:36:26.033806 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 444260df-2e21-4f91-b836-272b7e34c335 could not be found. Aug 31 16:36:26.033806 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:36:26.033806 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:36:26.033806 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:36:26.033806 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:36:26.033806 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:36:26.033806 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:36:26.033806 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:36:26.033806 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:36:26.033806 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:36:26.033806 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:36:26.033806 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:36:26.033806 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:36:26.033806 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:36:26.033806 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:36:26.033806 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:36:26.033806 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:36:26.033806 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 444260df-2e21-4f91-b836-272b7e34c335 could not be found. Aug 31 16:36:26.033806 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:36:26.033806 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:36:26.033806 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:36:26.039333 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:36:26.039333 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:36:26.039333 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:36:26.039333 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:36:26.039333 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:36:26.039333 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 444260df-2e21-4f91-b836-272b7e34c335 could not be found. Aug 31 16:36:26.039333 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:36:26.041512 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b8dfbe30-1cb2-447c-bb2f-2e7a766a4946 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] Returning 404 to user: Instance 444260df-2e21-4f91-b836-272b7e34c335 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:36:26.046328 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b8dfbe30-1cb2-447c-bb2f-2e7a766a4946 tempest-VolumesActionsTest-1815548266 tempest-VolumesActionsTest-1815548266-project] 10.222.0.61 "GET /compute/v2.1/servers/444260df-2e21-4f91-b836-272b7e34c335" status: 404 len: 111 microversion: 2.1 time: 0.117887 Aug 31 16:36:26.050045 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3142/6259] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:36:25 2022] GET /compute/v2.1/servers/444260df-2e21-4f91-b836-272b7e34c335 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:39:12.970245 n-d-850499-9 devstack@n-api.service[122256]: ERROR oslo.messaging._drivers.impl_rabbit [-] [46519162-dc0d-41cb-af5d-7b19f3bd0573] AMQP server on 10.222.0.61:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 31 16:39:12.971460 n-d-850499-9 devstack@n-api.service[122256]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0cd6dd6f-a50d-4cf4-8d95-237d76a72b0e] AMQP server on 10.222.0.61:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 31 16:39:12.972341 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:39:12.973774 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:39:12.974588 n-d-850499-9 devstack@n-api.service[122256]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 16:39:12.974712 n-d-850499-9 devstack@n-api.service[122256]: Wed Aug 31 16:39:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8a795e58-f921-411c-8660-0be993ad8aac (ip 10.222.0.61) !!! Aug 31 16:39:12.977827 n-d-850499-9 devstack@n-api.service[122256]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 16:39:12.977827 n-d-850499-9 devstack@n-api.service[122256]: Wed Aug 31 16:39:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8a795e58-f921-411c-8660-0be993ad8aac (ip 10.222.0.61) !!! Aug 31 16:39:13.477961 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-67bdf71f-259e-4ec3-8111-a172340a3f04 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:39:13.478825 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-67bdf71f-259e-4ec3-8111-a172340a3f04 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] [instance: 8a795e58-f921-411c-8660-0be993ad8aac] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:39:13.493435 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-67bdf71f-259e-4ec3-8111-a172340a3f04 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:39:13.496060 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-67bdf71f-259e-4ec3-8111-a172340a3f04 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:39:13.497804 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-67bdf71f-259e-4ec3-8111-a172340a3f04 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:39:13.498794 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-67bdf71f-259e-4ec3-8111-a172340a3f04 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:39:13.500970 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-67bdf71f-259e-4ec3-8111-a172340a3f04 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:39:13.502158 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-67bdf71f-259e-4ec3-8111-a172340a3f04 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:39:13.600388 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-67bdf71f-259e-4ec3-8111-a172340a3f04 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] [instance: 8a795e58-f921-411c-8660-0be993ad8aac] Going to try to terminate instance {{(pid=122256) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:39:13.812076 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-67bdf71f-259e-4ec3-8111-a172340a3f04 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] 10.222.0.61 "DELETE /compute/v2.1/servers/8a795e58-f921-411c-8660-0be993ad8aac" status: 204 len: 0 microversion: 2.1 time: 0.843504 Aug 31 16:39:13.812682 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3118/6260] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:39:12 2022] DELETE /compute/v2.1/servers/8a795e58-f921-411c-8660-0be993ad8aac => generated 0 bytes in 845 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:39:13.819756 n-d-850499-9 devstack@n-api.service[122257]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8b198bdc-d1f7-4259-9144-ce56665d9587] AMQP server on 10.222.0.61:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 31 16:39:13.821290 n-d-850499-9 devstack@n-api.service[122257]: ERROR oslo.messaging._drivers.impl_rabbit [-] [400e2b90-e189-478a-9cc4-4b0bfcefc34a] AMQP server on 10.222.0.61:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 31 16:39:13.821899 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=6 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:39:13.822801 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=13 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:39:13.823939 n-d-850499-9 devstack@n-api.service[122257]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 16:39:13.824188 n-d-850499-9 devstack@n-api.service[122257]: Wed Aug 31 16:39:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8a795e58-f921-411c-8660-0be993ad8aac (ip 10.222.0.61) !!! Aug 31 16:39:13.826800 n-d-850499-9 devstack@n-api.service[122257]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 31 16:39:13.827737 n-d-850499-9 devstack@n-api.service[122257]: Wed Aug 31 16:39:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8a795e58-f921-411c-8660-0be993ad8aac (ip 10.222.0.61) !!! Aug 31 16:39:13.829985 n-d-850499-9 devstack@n-api.service[122257]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 31 16:39:13.831427 n-d-850499-9 devstack@n-api.service[122257]: Wed Aug 31 16:39:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8a795e58-f921-411c-8660-0be993ad8aac (ip 10.222.0.61) !!! Aug 31 16:39:13.855400 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8b642168-febb-499e-badf-2f0893483b74 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:39:13.857419 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8b642168-febb-499e-badf-2f0893483b74 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] [instance: 8a795e58-f921-411c-8660-0be993ad8aac] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:39:13.878621 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b642168-febb-499e-badf-2f0893483b74 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:39:13.887934 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b642168-febb-499e-badf-2f0893483b74 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:39:13.888817 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b642168-febb-499e-badf-2f0893483b74 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:39:13.889825 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b642168-febb-499e-badf-2f0893483b74 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:39:13.890314 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b642168-febb-499e-badf-2f0893483b74 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:39:13.890813 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b642168-febb-499e-badf-2f0893483b74 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:39:14.231518 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8b642168-febb-499e-badf-2f0893483b74 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae50daa6a6745d0a8f1ff15e6df1d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51792b273f9f4220984586388169abf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:39:14.244640 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8b642168-febb-499e-badf-2f0893483b74 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] 10.222.0.61 "GET /compute/v2.1/servers/8a795e58-f921-411c-8660-0be993ad8aac" status: 200 len: 1733 microversion: 2.1 time: 0.427412 Aug 31 16:39:14.251413 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3143/6261] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:39:13 2022] GET /compute/v2.1/servers/8a795e58-f921-411c-8660-0be993ad8aac => generated 1733 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:39:15.274515 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7e35df31-bcc3-469d-a4e9-408e115c5e60 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:39:15.275233 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7e35df31-bcc3-469d-a4e9-408e115c5e60 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] [instance: 8a795e58-f921-411c-8660-0be993ad8aac] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:39:15.328826 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7e35df31-bcc3-469d-a4e9-408e115c5e60 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:39:15.329344 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7e35df31-bcc3-469d-a4e9-408e115c5e60 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:39:15.329805 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7e35df31-bcc3-469d-a4e9-408e115c5e60 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:39:15.330547 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7e35df31-bcc3-469d-a4e9-408e115c5e60 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:39:15.331047 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7e35df31-bcc3-469d-a4e9-408e115c5e60 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:39:15.331455 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7e35df31-bcc3-469d-a4e9-408e115c5e60 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:39:15.332863 n-d-850499-9 devstack@n-api.service[122256]: INFO oslo.messaging._drivers.impl_rabbit [-] [46519162-dc0d-41cb-af5d-7b19f3bd0573] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 51326. Aug 31 16:39:15.407538 n-d-850499-9 devstack@n-api.service[122256]: INFO oslo.messaging._drivers.impl_rabbit [-] [0cd6dd6f-a50d-4cf4-8d95-237d76a72b0e] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 51328. Aug 31 16:39:16.080723 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7e35df31-bcc3-469d-a4e9-408e115c5e60 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae50daa6a6745d0a8f1ff15e6df1d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51792b273f9f4220984586388169abf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:39:16.094798 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7e35df31-bcc3-469d-a4e9-408e115c5e60 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] 10.222.0.61 "GET /compute/v2.1/servers/8a795e58-f921-411c-8660-0be993ad8aac" status: 200 len: 1733 microversion: 2.1 time: 0.825119 Aug 31 16:39:16.101706 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3119/6262] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:39:15 2022] GET /compute/v2.1/servers/8a795e58-f921-411c-8660-0be993ad8aac => generated 1733 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:39:17.128636 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-886639f1-26a9-40db-a90b-1bf730a2e7fc tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:39:17.130315 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-886639f1-26a9-40db-a90b-1bf730a2e7fc tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] [instance: 8a795e58-f921-411c-8660-0be993ad8aac] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:39:17.171454 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-886639f1-26a9-40db-a90b-1bf730a2e7fc tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:39:17.178716 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-886639f1-26a9-40db-a90b-1bf730a2e7fc tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:39:17.179324 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-886639f1-26a9-40db-a90b-1bf730a2e7fc tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:39:17.182931 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-886639f1-26a9-40db-a90b-1bf730a2e7fc tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:39:17.185167 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-886639f1-26a9-40db-a90b-1bf730a2e7fc tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:39:17.185785 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-886639f1-26a9-40db-a90b-1bf730a2e7fc tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:39:17.196727 n-d-850499-9 devstack@n-api.service[122257]: INFO oslo.messaging._drivers.impl_rabbit [-] [400e2b90-e189-478a-9cc4-4b0bfcefc34a] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 51354. Aug 31 16:39:17.202200 n-d-850499-9 devstack@n-api.service[122257]: INFO oslo.messaging._drivers.impl_rabbit [-] [8b198bdc-d1f7-4259-9144-ce56665d9587] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 51352. Aug 31 16:39:18.269332 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-886639f1-26a9-40db-a90b-1bf730a2e7fc tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae50daa6a6745d0a8f1ff15e6df1d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51792b273f9f4220984586388169abf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:39:18.294167 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-886639f1-26a9-40db-a90b-1bf730a2e7fc tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] 10.222.0.61 "GET /compute/v2.1/servers/8a795e58-f921-411c-8660-0be993ad8aac" status: 200 len: 1733 microversion: 2.1 time: 1.172467 Aug 31 16:39:18.294689 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3144/6263] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:39:17 2022] GET /compute/v2.1/servers/8a795e58-f921-411c-8660-0be993ad8aac => generated 1733 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:39:19.108443 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-774f9d1c-b5d2-4e83-b1d2-0958909a587a req-b1e367ec-1e44-4896-8f84-306c6c669913 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a795e58-f921-411c-8660-0be993ad8aac", "name": "network-vif-unplugged", "status": "completed", "tag": "a1a1b013-3ce9-4ed4-891e-95caa0880eef"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:39:19.137604 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-774f9d1c-b5d2-4e83-b1d2-0958909a587a req-b1e367ec-1e44-4896-8f84-306c6c669913 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:39:19.140581 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-774f9d1c-b5d2-4e83-b1d2-0958909a587a req-b1e367ec-1e44-4896-8f84-306c6c669913 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:39:19.141105 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-774f9d1c-b5d2-4e83-b1d2-0958909a587a req-b1e367ec-1e44-4896-8f84-306c6c669913 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:39:19.180934 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-774f9d1c-b5d2-4e83-b1d2-0958909a587a req-b1e367ec-1e44-4896-8f84-306c6c669913 service nova] Creating event network-vif-unplugged:a1a1b013-3ce9-4ed4-891e-95caa0880eef for instance 8a795e58-f921-411c-8660-0be993ad8aac on n-h2-850499-9 Aug 31 16:39:19.205835 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-774f9d1c-b5d2-4e83-b1d2-0958909a587a req-b1e367ec-1e44-4896-8f84-306c6c669913 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.284139 Aug 31 16:39:19.219296 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3120/6264] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:39:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:39:19.322653 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-fe3c35fa-a6c7-4a57-8811-4eec19ce7914 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:39:19.326404 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-fe3c35fa-a6c7-4a57-8811-4eec19ce7914 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] [instance: 8a795e58-f921-411c-8660-0be993ad8aac] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:39:19.358364 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fe3c35fa-a6c7-4a57-8811-4eec19ce7914 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:39:19.360901 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fe3c35fa-a6c7-4a57-8811-4eec19ce7914 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:39:19.361617 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fe3c35fa-a6c7-4a57-8811-4eec19ce7914 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:39:19.367336 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fe3c35fa-a6c7-4a57-8811-4eec19ce7914 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:39:19.368329 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fe3c35fa-a6c7-4a57-8811-4eec19ce7914 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:39:19.369150 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fe3c35fa-a6c7-4a57-8811-4eec19ce7914 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:39:20.669195 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-fe3c35fa-a6c7-4a57-8811-4eec19ce7914 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae50daa6a6745d0a8f1ff15e6df1d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51792b273f9f4220984586388169abf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:39:20.689524 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-fe3c35fa-a6c7-4a57-8811-4eec19ce7914 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] 10.222.0.61 "GET /compute/v2.1/servers/8a795e58-f921-411c-8660-0be993ad8aac" status: 200 len: 1733 microversion: 2.1 time: 1.376453 Aug 31 16:39:20.690349 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3145/6265] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:39:19 2022] GET /compute/v2.1/servers/8a795e58-f921-411c-8660-0be993ad8aac => generated 1733 bytes in 1378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:39:21.720747 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-736a20ca-33dd-425a-b780-b4dc492fc78a tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:39:21.724073 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-736a20ca-33dd-425a-b780-b4dc492fc78a tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] [instance: 8a795e58-f921-411c-8660-0be993ad8aac] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:39:21.755089 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-736a20ca-33dd-425a-b780-b4dc492fc78a tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:39:21.763973 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-736a20ca-33dd-425a-b780-b4dc492fc78a tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:39:21.767815 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-736a20ca-33dd-425a-b780-b4dc492fc78a tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:39:21.772846 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-736a20ca-33dd-425a-b780-b4dc492fc78a tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:39:21.783469 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-736a20ca-33dd-425a-b780-b4dc492fc78a tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:39:21.792868 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-736a20ca-33dd-425a-b780-b4dc492fc78a tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:39:22.116908 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-736a20ca-33dd-425a-b780-b4dc492fc78a tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae50daa6a6745d0a8f1ff15e6df1d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51792b273f9f4220984586388169abf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:39:22.136750 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-736a20ca-33dd-425a-b780-b4dc492fc78a tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] 10.222.0.61 "GET /compute/v2.1/servers/8a795e58-f921-411c-8660-0be993ad8aac" status: 200 len: 1665 microversion: 2.1 time: 0.410848 Aug 31 16:39:22.158488 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3121/6266] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:39:21 2022] GET /compute/v2.1/servers/8a795e58-f921-411c-8660-0be993ad8aac => generated 1665 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:39:23.163875 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9dc1b68b-05dd-4d57-b5ac-7a901752d92a tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:39:23.165188 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9dc1b68b-05dd-4d57-b5ac-7a901752d92a tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] [instance: 8a795e58-f921-411c-8660-0be993ad8aac] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:39:23.176218 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9dc1b68b-05dd-4d57-b5ac-7a901752d92a tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:39:23.180783 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9dc1b68b-05dd-4d57-b5ac-7a901752d92a tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:39:23.185385 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9dc1b68b-05dd-4d57-b5ac-7a901752d92a tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:39:23.186995 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9dc1b68b-05dd-4d57-b5ac-7a901752d92a tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:39:23.187706 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9dc1b68b-05dd-4d57-b5ac-7a901752d92a tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:39:23.190016 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9dc1b68b-05dd-4d57-b5ac-7a901752d92a tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:39:23.575048 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9dc1b68b-05dd-4d57-b5ac-7a901752d92a tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae50daa6a6745d0a8f1ff15e6df1d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51792b273f9f4220984586388169abf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:39:23.622101 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9dc1b68b-05dd-4d57-b5ac-7a901752d92a tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] 10.222.0.61 "GET /compute/v2.1/servers/8a795e58-f921-411c-8660-0be993ad8aac" status: 200 len: 1665 microversion: 2.1 time: 0.451228 Aug 31 16:39:23.627178 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3146/6267] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:39:23 2022] GET /compute/v2.1/servers/8a795e58-f921-411c-8660-0be993ad8aac => generated 1665 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:39:24.030739 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-5242c79f-d90d-4496-b45b-c798e518f908 req-7246a250-1258-494e-b2de-3a7e41f84656 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a795e58-f921-411c-8660-0be993ad8aac", "name": "network-vif-deleted", "tag": "a1a1b013-3ce9-4ed4-891e-95caa0880eef"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:39:24.091307 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-5242c79f-d90d-4496-b45b-c798e518f908 req-7246a250-1258-494e-b2de-3a7e41f84656 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:39:24.100644 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-5242c79f-d90d-4496-b45b-c798e518f908 req-7246a250-1258-494e-b2de-3a7e41f84656 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:39:24.101197 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-5242c79f-d90d-4496-b45b-c798e518f908 req-7246a250-1258-494e-b2de-3a7e41f84656 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:39:24.166342 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-5242c79f-d90d-4496-b45b-c798e518f908 req-7246a250-1258-494e-b2de-3a7e41f84656 service nova] Creating event network-vif-deleted:a1a1b013-3ce9-4ed4-891e-95caa0880eef for instance 8a795e58-f921-411c-8660-0be993ad8aac on n-h2-850499-9 Aug 31 16:39:24.189685 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-5242c79f-d90d-4496-b45b-c798e518f908 req-7246a250-1258-494e-b2de-3a7e41f84656 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.619307 Aug 31 16:39:24.191100 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3122/6268] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:39:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:39:24.654579 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e0fcd6af-413a-4319-87b9-77905d4ac43e tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:39:24.656497 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e0fcd6af-413a-4319-87b9-77905d4ac43e tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] [instance: 8a795e58-f921-411c-8660-0be993ad8aac] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:39:24.682192 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e0fcd6af-413a-4319-87b9-77905d4ac43e tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:39:24.687322 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e0fcd6af-413a-4319-87b9-77905d4ac43e tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:39:24.689396 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e0fcd6af-413a-4319-87b9-77905d4ac43e tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:39:24.690436 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e0fcd6af-413a-4319-87b9-77905d4ac43e tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:39:24.693954 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e0fcd6af-413a-4319-87b9-77905d4ac43e tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:39:24.694698 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e0fcd6af-413a-4319-87b9-77905d4ac43e tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:39:24.754203 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-e0fcd6af-413a-4319-87b9-77905d4ac43e tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] HTTP exception thrown: Instance 8a795e58-f921-411c-8660-0be993ad8aac could not be found. Aug 31 16:39:24.756977 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e0fcd6af-413a-4319-87b9-77905d4ac43e tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Request method failure captured: Aug 31 16:39:24.756977 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/8a795e58-f921-411c-8660-0be993ad8aac HTTP/1.1 Aug 31 16:39:24.756977 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:39:24.756977 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:39:24.756977 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:39:24.756977 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:39:24.756977 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:39:24.756977 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:39:24.756977 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:39:24.756977 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:39:24.756977 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD40egTHoRcz4w6KyDNUtrPNfONHvC4l6yS52mPwrfpDMkuG2207Ygk-29dD5B1F5kGj_f8Iv9Bvi8q_BWxM2cw9iNw7bqp0Gp7U5xo7NqqkpbkmC5CKQkJHgy5_HXw428_3mu72zpMBydrchtXIerfsA2qUW8B8KKZyWdZnkv3xtnbM Aug 31 16:39:24.756977 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:39:24.756977 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:39:24.756977 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:39:24.756977 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:39:24.756977 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:39:24.756977 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:39:24.756977 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 51792b273f9f4220984586388169abf7 Aug 31 16:39:24.756977 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-TestServerBasicOps-298074045 Aug 31 16:39:24.756977 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:39:24.756977 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:39:24.756977 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/51792b273f9f4220984586388169abf7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/51792b273f9f4220984586388169abf7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_51792b273f9f4220984586388169abf7", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/51792b273f9f4220984586388169abf7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:39:24.756977 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-TestServerBasicOps-298074045 Aug 31 16:39:24.756977 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 51792b273f9f4220984586388169abf7 Aug 31 16:39:24.756977 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-TestServerBasicOps-298074045 Aug 31 16:39:24.756977 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-TestServerBasicOps-298074045-project Aug 31 16:39:24.756977 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:39:24.756977 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:39:24.756977 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 0ae50daa6a6745d0a8f1ff15e6df1d50 Aug 31 16:39:24.756977 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-TestServerBasicOps-298074045-project Aug 31 16:39:24.756977 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:39:24.756977 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance 8a795e58-f921-411c-8660-0be993ad8aac could not be found. Aug 31 16:39:24.756977 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '8a795e58-f921-411c-8660-0be993ad8aac'} Aug 31 16:39:24.756977 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:39:24.756977 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:39:24.756977 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:39:24.756977 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:39:24.756977 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:39:24.756977 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:39:24.756977 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:39:24.756977 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:39:24.756977 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:39:24.756977 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:39:24.756977 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a795e58-f921-411c-8660-0be993ad8aac could not be found. Aug 31 16:39:24.756977 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:39:24.756977 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:39:24.756977 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:39:24.756977 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:39:24.756977 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:39:24.756977 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:39:24.756977 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:39:24.756977 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:39:24.756977 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:39:24.756977 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:39:24.756977 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:39:24.756977 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:39:24.756977 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:39:24.756977 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:39:24.756977 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:39:24.756977 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:39:24.756977 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a795e58-f921-411c-8660-0be993ad8aac could not be found. Aug 31 16:39:24.756977 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:39:24.756977 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:39:24.756977 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:39:24.761543 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:39:24.761543 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:39:24.761543 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:39:24.761543 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:39:24.761543 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:39:24.761543 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a795e58-f921-411c-8660-0be993ad8aac could not be found. Aug 31 16:39:24.761543 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:39:24.761543 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e0fcd6af-413a-4319-87b9-77905d4ac43e tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Returning 404 to user: Instance 8a795e58-f921-411c-8660-0be993ad8aac could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:39:24.766362 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e0fcd6af-413a-4319-87b9-77905d4ac43e tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] 10.222.0.61 "GET /compute/v2.1/servers/8a795e58-f921-411c-8660-0be993ad8aac" status: 404 len: 111 microversion: 2.1 time: 0.119106 Aug 31 16:39:24.776392 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3147/6269] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:39:24 2022] GET /compute/v2.1/servers/8a795e58-f921-411c-8660-0be993ad8aac => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:39:27.364323 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f5037dd3-fdbc-4ba5-a3a9-46dc879eb5e5 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Action: 'create', calling method: .version_select at 0x7f5ae3bcf1f0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-34192722", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJgPPAoBeiujkzoiK0ZFoIJHMIOZ0wWpQ39XkrC69BjIvJgGVpjq3x4New9iUPINuxffPBNdCqcl3k4h2rczh4hLYarRFDDxFFKxmojzqYHAyA/NUlGICvgsMV8WYYMzYw=="}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:39:27.400906 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-f5037dd3-fdbc-4ba5-a3a9-46dc879eb5e5 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Getting quotas for project b5827544f2e140e3b44d712d1623a06b. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:39:27.416900 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-f5037dd3-fdbc-4ba5-a3a9-46dc879eb5e5 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Getting quotas for user e026a8cdb13f47de942566a2d4a10bc8 and project b5827544f2e140e3b44d712d1623a06b. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:39:27.454550 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8ccdcf02-6423-43f7-9fe6-bd027a3f8890 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:39:27.455985 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8ccdcf02-6423-43f7-9fe6-bd027a3f8890 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] [instance: 8a795e58-f921-411c-8660-0be993ad8aac] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:39:27.468099 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8ccdcf02-6423-43f7-9fe6-bd027a3f8890 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:39:27.480139 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8ccdcf02-6423-43f7-9fe6-bd027a3f8890 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:39:27.481131 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8ccdcf02-6423-43f7-9fe6-bd027a3f8890 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:39:27.502235 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8ccdcf02-6423-43f7-9fe6-bd027a3f8890 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:39:27.505247 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8ccdcf02-6423-43f7-9fe6-bd027a3f8890 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:39:27.510742 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8ccdcf02-6423-43f7-9fe6-bd027a3f8890 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:39:27.511005 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f5037dd3-fdbc-4ba5-a3a9-46dc879eb5e5 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.164544 Aug 31 16:39:27.512222 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3123/6270] 10.222.0.61 () {60 vars in 1159 bytes} [Wed Aug 31 16:39:27 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:39:27.568449 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-8ccdcf02-6423-43f7-9fe6-bd027a3f8890 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] HTTP exception thrown: Instance 8a795e58-f921-411c-8660-0be993ad8aac could not be found. Aug 31 16:39:27.573216 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8ccdcf02-6423-43f7-9fe6-bd027a3f8890 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Request method failure captured: Aug 31 16:39:27.573216 n-d-850499-9 devstack@n-api.service[122257]: request: DELETE /compute/v2.1/servers/8a795e58-f921-411c-8660-0be993ad8aac HTTP/1.1 Aug 31 16:39:27.573216 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:39:27.573216 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:39:27.573216 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:39:27.573216 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:39:27.573216 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:39:27.573216 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:39:27.573216 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:39:27.573216 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:39:27.573216 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD40egTHoRcz4w6KyDNUtrPNfONHvC4l6yS52mPwrfpDMkuG2207Ygk-29dD5B1F5kGj_f8Iv9Bvi8q_BWxM2cw9iNw7bqp0Gp7U5xo7NqqkpbkmC5CKQkJHgy5_HXw428_3mu72zpMBydrchtXIerfsA2qUW8B8KKZyWdZnkv3xtnbM Aug 31 16:39:27.573216 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:39:27.573216 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:39:27.573216 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:39:27.573216 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:39:27.573216 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:39:27.573216 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:39:27.573216 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 51792b273f9f4220984586388169abf7 Aug 31 16:39:27.573216 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-TestServerBasicOps-298074045 Aug 31 16:39:27.573216 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:39:27.573216 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:39:27.573216 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/51792b273f9f4220984586388169abf7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/51792b273f9f4220984586388169abf7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_51792b273f9f4220984586388169abf7", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/51792b273f9f4220984586388169abf7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:39:27.573216 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-TestServerBasicOps-298074045 Aug 31 16:39:27.573216 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 51792b273f9f4220984586388169abf7 Aug 31 16:39:27.573216 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-TestServerBasicOps-298074045 Aug 31 16:39:27.573216 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-TestServerBasicOps-298074045-project Aug 31 16:39:27.573216 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:39:27.573216 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:39:27.573216 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 0ae50daa6a6745d0a8f1ff15e6df1d50 Aug 31 16:39:27.573216 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-TestServerBasicOps-298074045-project Aug 31 16:39:27.573216 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:39:27.573216 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance 8a795e58-f921-411c-8660-0be993ad8aac could not be found. Aug 31 16:39:27.573216 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '8a795e58-f921-411c-8660-0be993ad8aac'} Aug 31 16:39:27.573216 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:39:27.573216 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:39:27.573216 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:39:27.573216 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:39:27.573216 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:39:27.573216 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:39:27.573216 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:39:27.573216 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:39:27.573216 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:39:27.573216 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:39:27.573216 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a795e58-f921-411c-8660-0be993ad8aac could not be found. Aug 31 16:39:27.573216 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:39:27.573216 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:39:27.573216 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:39:27.573216 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:39:27.573216 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:39:27.573216 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:39:27.573216 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:39:27.573216 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:39:27.573216 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:39:27.573216 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:39:27.573216 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:39:27.573216 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:39:27.573216 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:39:27.573216 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:39:27.573216 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:39:27.573216 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:39:27.573216 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:39:27.573216 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:39:27.577179 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a795e58-f921-411c-8660-0be993ad8aac could not be found. Aug 31 16:39:27.577179 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:39:27.577179 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:39:27.577179 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:39:27.577179 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:39:27.577179 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:39:27.577179 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:39:27.577179 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:39:27.577179 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:39:27.577179 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a795e58-f921-411c-8660-0be993ad8aac could not be found. Aug 31 16:39:27.577179 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:39:27.579563 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8ccdcf02-6423-43f7-9fe6-bd027a3f8890 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Returning 404 to user: Instance 8a795e58-f921-411c-8660-0be993ad8aac could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:39:27.581644 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8ccdcf02-6423-43f7-9fe6-bd027a3f8890 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] 10.222.0.61 "DELETE /compute/v2.1/servers/8a795e58-f921-411c-8660-0be993ad8aac" status: 404 len: 111 microversion: 2.1 time: 0.131350 Aug 31 16:39:27.583249 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3148/6271] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:39:27 2022] DELETE /compute/v2.1/servers/8a795e58-f921-411c-8660-0be993ad8aac => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:39:27.592410 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7b97849d-1692-4806-b456-8f28948d995b tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:39:27.593285 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7b97849d-1692-4806-b456-8f28948d995b tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] [instance: 8a795e58-f921-411c-8660-0be993ad8aac] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:39:27.603853 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7b97849d-1692-4806-b456-8f28948d995b tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:39:27.611544 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7b97849d-1692-4806-b456-8f28948d995b tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:39:27.616169 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7b97849d-1692-4806-b456-8f28948d995b tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:39:27.617231 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7b97849d-1692-4806-b456-8f28948d995b tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:39:27.617834 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7b97849d-1692-4806-b456-8f28948d995b tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:39:27.618393 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7b97849d-1692-4806-b456-8f28948d995b tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:39:27.664935 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-7b97849d-1692-4806-b456-8f28948d995b tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] HTTP exception thrown: Instance 8a795e58-f921-411c-8660-0be993ad8aac could not be found. Aug 31 16:39:27.666523 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7b97849d-1692-4806-b456-8f28948d995b tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Request method failure captured: Aug 31 16:39:27.666523 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/8a795e58-f921-411c-8660-0be993ad8aac HTTP/1.1 Aug 31 16:39:27.666523 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:39:27.666523 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:39:27.666523 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:39:27.666523 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:39:27.666523 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:39:27.666523 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:39:27.666523 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:39:27.666523 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:39:27.666523 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD40egTHoRcz4w6KyDNUtrPNfONHvC4l6yS52mPwrfpDMkuG2207Ygk-29dD5B1F5kGj_f8Iv9Bvi8q_BWxM2cw9iNw7bqp0Gp7U5xo7NqqkpbkmC5CKQkJHgy5_HXw428_3mu72zpMBydrchtXIerfsA2qUW8B8KKZyWdZnkv3xtnbM Aug 31 16:39:27.666523 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:39:27.666523 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:39:27.666523 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:39:27.666523 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:39:27.666523 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:39:27.666523 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:39:27.666523 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 51792b273f9f4220984586388169abf7 Aug 31 16:39:27.666523 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-TestServerBasicOps-298074045 Aug 31 16:39:27.666523 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:39:27.666523 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:39:27.666523 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/51792b273f9f4220984586388169abf7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/51792b273f9f4220984586388169abf7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_51792b273f9f4220984586388169abf7", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/51792b273f9f4220984586388169abf7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:39:27.666523 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-TestServerBasicOps-298074045 Aug 31 16:39:27.666523 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 51792b273f9f4220984586388169abf7 Aug 31 16:39:27.666523 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-TestServerBasicOps-298074045 Aug 31 16:39:27.666523 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-TestServerBasicOps-298074045-project Aug 31 16:39:27.666523 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:39:27.666523 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:39:27.666523 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 0ae50daa6a6745d0a8f1ff15e6df1d50 Aug 31 16:39:27.666523 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-TestServerBasicOps-298074045-project Aug 31 16:39:27.666523 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:39:27.666523 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance 8a795e58-f921-411c-8660-0be993ad8aac could not be found. Aug 31 16:39:27.666523 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '8a795e58-f921-411c-8660-0be993ad8aac'} Aug 31 16:39:27.666523 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:39:27.666523 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:39:27.666523 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:39:27.666523 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:39:27.666523 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:39:27.666523 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:39:27.666523 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:39:27.666523 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:39:27.666523 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:39:27.666523 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:39:27.666523 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a795e58-f921-411c-8660-0be993ad8aac could not be found. Aug 31 16:39:27.666523 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:39:27.666523 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:39:27.666523 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:39:27.666523 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:39:27.666523 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:39:27.666523 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:39:27.666523 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:39:27.666523 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:39:27.666523 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:39:27.666523 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:39:27.666523 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:39:27.666523 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:39:27.666523 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:39:27.666523 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:39:27.666523 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:39:27.666523 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:39:27.666523 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a795e58-f921-411c-8660-0be993ad8aac could not be found. Aug 31 16:39:27.666523 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:39:27.666523 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:39:27.666523 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:39:27.670301 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:39:27.670301 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:39:27.670301 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:39:27.670301 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:39:27.670301 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:39:27.670301 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a795e58-f921-411c-8660-0be993ad8aac could not be found. Aug 31 16:39:27.670301 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:39:27.670301 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7b97849d-1692-4806-b456-8f28948d995b tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Returning 404 to user: Instance 8a795e58-f921-411c-8660-0be993ad8aac could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:39:27.690397 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7b97849d-1692-4806-b456-8f28948d995b tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] 10.222.0.61 "GET /compute/v2.1/servers/8a795e58-f921-411c-8660-0be993ad8aac" status: 404 len: 111 microversion: 2.1 time: 0.101615 Aug 31 16:39:27.691567 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3124/6272] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:39:27 2022] GET /compute/v2.1/servers/8a795e58-f921-411c-8660-0be993ad8aac => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:39:28.164379 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-88373ad6-a79d-4eb4-9337-90a55dca3955 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] Calling method '.version_select at 0x7f5ae3a27280>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:39:28.240983 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-88373ad6-a79d-4eb4-9337-90a55dca3955 tempest-TestServerBasicOps-298074045 tempest-TestServerBasicOps-298074045-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1288760491" status: 202 len: 0 microversion: 2.1 time: 0.081684 Aug 31 16:39:28.241790 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3149/6273] 10.222.0.61 () {58 vars in 1254 bytes} [Wed Aug 31 16:39:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1288760491 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:39:30.971634 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-641f8070-24b7-4676-8a37-5aade3c26b97 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1157678809", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "networks": [{"uuid": "824e56dd-a941-4bab-a7ed-8a445e320b1a"}], "key_name": "tempest-TestNetworkBasicOps-34192722", "security_groups": [{"name": "tempest-secgroup-smoke-1059090492"}]}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:39:31.453610 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-641f8070-24b7-4676-8a37-5aade3c26b97 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] validate_networks() for [('824e56dd-a941-4bab-a7ed-8a445e320b1a', None, None, None, None, None)] {{(pid=122256) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:39:35.059277 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-641f8070-24b7-4676-8a37-5aade3c26b97 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:39:35.070469 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-641f8070-24b7-4676-8a37-5aade3c26b97 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:39:35.071187 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-641f8070-24b7-4676-8a37-5aade3c26b97 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:39:35.071687 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-641f8070-24b7-4676-8a37-5aade3c26b97 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:39:35.072595 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-641f8070-24b7-4676-8a37-5aade3c26b97 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:39:35.095899 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-641f8070-24b7-4676-8a37-5aade3c26b97 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:39:35.096414 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-641f8070-24b7-4676-8a37-5aade3c26b97 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:39:35.096941 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-641f8070-24b7-4676-8a37-5aade3c26b97 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:39:35.097860 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-641f8070-24b7-4676-8a37-5aade3c26b97 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:39:35.098901 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-641f8070-24b7-4676-8a37-5aade3c26b97 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:39:35.099519 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-641f8070-24b7-4676-8a37-5aade3c26b97 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:39:35.122157 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-641f8070-24b7-4676-8a37-5aade3c26b97 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Getting quotas for project b5827544f2e140e3b44d712d1623a06b. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:39:35.131595 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-641f8070-24b7-4676-8a37-5aade3c26b97 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Getting quotas for user e026a8cdb13f47de942566a2d4a10bc8 and project b5827544f2e140e3b44d712d1623a06b. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:39:35.147994 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-641f8070-24b7-4676-8a37-5aade3c26b97 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Going to run 1 instances... {{(pid=122256) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:39:35.151098 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-641f8070-24b7-4676-8a37-5aade3c26b97 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] [instance: 9fc3d479-902c-416f-92fb-976966b3c5a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:39:35.246238 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-641f8070-24b7-4676-8a37-5aade3c26b97 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 4.278468 Aug 31 16:39:35.251480 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3125/6274] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:39:30 2022] POST /compute/v2.1/servers => generated 406 bytes in 4284 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:39:35.264794 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-362125e0-d496-4d30-bc06-6e3a24f71002 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:39:35.266292 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-362125e0-d496-4d30-bc06-6e3a24f71002 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] [instance: 9fc3d479-902c-416f-92fb-976966b3c5a1] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:39:35.409836 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-362125e0-d496-4d30-bc06-6e3a24f71002 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e026a8cdb13f47de942566a2d4a10bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5827544f2e140e3b44d712d1623a06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:39:35.423024 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-362125e0-d496-4d30-bc06-6e3a24f71002 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] 10.222.0.61 "GET /compute/v2.1/servers/9fc3d479-902c-416f-92fb-976966b3c5a1" status: 200 len: 1247 microversion: 2.1 time: 0.161183 Aug 31 16:39:35.434629 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3150/6275] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:39:35 2022] GET /compute/v2.1/servers/9fc3d479-902c-416f-92fb-976966b3c5a1 => generated 1247 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:39:36.446436 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-089e4b92-12d0-48e1-b347-f070a64b4f2e tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:39:36.447068 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-089e4b92-12d0-48e1-b347-f070a64b4f2e tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] [instance: 9fc3d479-902c-416f-92fb-976966b3c5a1] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:39:36.702253 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-089e4b92-12d0-48e1-b347-f070a64b4f2e tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e026a8cdb13f47de942566a2d4a10bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5827544f2e140e3b44d712d1623a06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:39:36.715694 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-089e4b92-12d0-48e1-b347-f070a64b4f2e tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] 10.222.0.61 "GET /compute/v2.1/servers/9fc3d479-902c-416f-92fb-976966b3c5a1" status: 200 len: 1247 microversion: 2.1 time: 0.273726 Aug 31 16:39:36.716491 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3126/6276] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:39:36 2022] GET /compute/v2.1/servers/9fc3d479-902c-416f-92fb-976966b3c5a1 => generated 1247 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:39:37.744844 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-242b8210-858d-4668-a0ae-46d165b5838c tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:39:37.745478 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-242b8210-858d-4668-a0ae-46d165b5838c tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] [instance: 9fc3d479-902c-416f-92fb-976966b3c5a1] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:39:37.750918 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=28 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:39:37.766525 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-242b8210-858d-4668-a0ae-46d165b5838c tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:39:37.767059 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-242b8210-858d-4668-a0ae-46d165b5838c tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:39:37.768935 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-242b8210-858d-4668-a0ae-46d165b5838c tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:39:37.771329 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-242b8210-858d-4668-a0ae-46d165b5838c tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:39:37.773795 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-242b8210-858d-4668-a0ae-46d165b5838c tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:39:37.775459 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-242b8210-858d-4668-a0ae-46d165b5838c tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:39:38.046470 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-242b8210-858d-4668-a0ae-46d165b5838c tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e026a8cdb13f47de942566a2d4a10bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5827544f2e140e3b44d712d1623a06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:39:38.065221 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-242b8210-858d-4668-a0ae-46d165b5838c tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] 10.222.0.61 "GET /compute/v2.1/servers/9fc3d479-902c-416f-92fb-976966b3c5a1" status: 200 len: 1307 microversion: 2.1 time: 0.327749 Aug 31 16:39:38.068250 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3151/6277] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:39:37 2022] GET /compute/v2.1/servers/9fc3d479-902c-416f-92fb-976966b3c5a1 => generated 1307 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:39:39.090078 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-42970390-541e-4cc9-9aed-3d8ba38f642b tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:39:39.091035 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-42970390-541e-4cc9-9aed-3d8ba38f642b tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] [instance: 9fc3d479-902c-416f-92fb-976966b3c5a1] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:39:39.108962 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42970390-541e-4cc9-9aed-3d8ba38f642b tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:39:39.112325 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42970390-541e-4cc9-9aed-3d8ba38f642b tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:39:39.113173 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42970390-541e-4cc9-9aed-3d8ba38f642b tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:39:39.117584 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42970390-541e-4cc9-9aed-3d8ba38f642b tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:39:39.118244 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42970390-541e-4cc9-9aed-3d8ba38f642b tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:39:39.118838 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42970390-541e-4cc9-9aed-3d8ba38f642b tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:39:39.426075 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-42970390-541e-4cc9-9aed-3d8ba38f642b tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e026a8cdb13f47de942566a2d4a10bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5827544f2e140e3b44d712d1623a06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:39:39.438807 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-42970390-541e-4cc9-9aed-3d8ba38f642b tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] 10.222.0.61 "GET /compute/v2.1/servers/9fc3d479-902c-416f-92fb-976966b3c5a1" status: 200 len: 1305 microversion: 2.1 time: 0.354362 Aug 31 16:39:39.445408 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3127/6278] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:39:39 2022] GET /compute/v2.1/servers/9fc3d479-902c-416f-92fb-976966b3c5a1 => generated 1305 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:39:40.466411 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b7ba4a1a-bc2e-42c6-895f-5b267d1957ca tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:39:40.467712 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b7ba4a1a-bc2e-42c6-895f-5b267d1957ca tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] [instance: 9fc3d479-902c-416f-92fb-976966b3c5a1] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:39:40.491117 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b7ba4a1a-bc2e-42c6-895f-5b267d1957ca tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:39:40.497039 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b7ba4a1a-bc2e-42c6-895f-5b267d1957ca tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:39:40.497757 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b7ba4a1a-bc2e-42c6-895f-5b267d1957ca tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:39:40.499266 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b7ba4a1a-bc2e-42c6-895f-5b267d1957ca tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:39:40.503138 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b7ba4a1a-bc2e-42c6-895f-5b267d1957ca tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:39:40.503903 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b7ba4a1a-bc2e-42c6-895f-5b267d1957ca tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:39:41.189858 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b7ba4a1a-bc2e-42c6-895f-5b267d1957ca tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e026a8cdb13f47de942566a2d4a10bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5827544f2e140e3b44d712d1623a06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:39:41.198197 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b7ba4a1a-bc2e-42c6-895f-5b267d1957ca tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] 10.222.0.61 "GET /compute/v2.1/servers/9fc3d479-902c-416f-92fb-976966b3c5a1" status: 200 len: 1373 microversion: 2.1 time: 0.735704 Aug 31 16:39:41.203817 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3152/6279] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:39:40 2022] GET /compute/v2.1/servers/9fc3d479-902c-416f-92fb-976966b3c5a1 => generated 1373 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:39:42.227330 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-74108445-b9c3-4096-8030-5376242765a2 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:39:42.228012 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-74108445-b9c3-4096-8030-5376242765a2 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] [instance: 9fc3d479-902c-416f-92fb-976966b3c5a1] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:39:42.279258 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-74108445-b9c3-4096-8030-5376242765a2 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:39:42.310968 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-74108445-b9c3-4096-8030-5376242765a2 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:39:42.317160 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-74108445-b9c3-4096-8030-5376242765a2 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.037s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:39:42.320199 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-74108445-b9c3-4096-8030-5376242765a2 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:39:42.324007 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-74108445-b9c3-4096-8030-5376242765a2 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:39:42.328664 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-74108445-b9c3-4096-8030-5376242765a2 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:39:42.693845 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-a1084b5b-d28b-40ca-ae04-f2fa2e05c7c3 req-57342f94-a6e0-40af-8de1-a34fdf1ba8fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fc3d479-902c-416f-92fb-976966b3c5a1", "tag": "e37973b8-a7b3-4872-8a09-cdefe11540d9"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:39:42.711950 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-a1084b5b-d28b-40ca-ae04-f2fa2e05c7c3 req-57342f94-a6e0-40af-8de1-a34fdf1ba8fb service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:39:42.712440 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-a1084b5b-d28b-40ca-ae04-f2fa2e05c7c3 req-57342f94-a6e0-40af-8de1-a34fdf1ba8fb service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:39:42.712876 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-a1084b5b-d28b-40ca-ae04-f2fa2e05c7c3 req-57342f94-a6e0-40af-8de1-a34fdf1ba8fb service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:39:42.738555 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-a1084b5b-d28b-40ca-ae04-f2fa2e05c7c3 req-57342f94-a6e0-40af-8de1-a34fdf1ba8fb service nova] Creating event network-changed:e37973b8-a7b3-4872-8a09-cdefe11540d9 for instance 9fc3d479-902c-416f-92fb-976966b3c5a1 on n-h2-850499-9 Aug 31 16:39:42.772375 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-a1084b5b-d28b-40ca-ae04-f2fa2e05c7c3 req-57342f94-a6e0-40af-8de1-a34fdf1ba8fb service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083102 Aug 31 16:39:42.774579 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3153/6280] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:39:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:39:43.195288 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-74108445-b9c3-4096-8030-5376242765a2 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e026a8cdb13f47de942566a2d4a10bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5827544f2e140e3b44d712d1623a06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:39:43.210996 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:39:43.239746 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-74108445-b9c3-4096-8030-5376242765a2 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] 10.222.0.61 "GET /compute/v2.1/servers/9fc3d479-902c-416f-92fb-976966b3c5a1" status: 200 len: 1373 microversion: 2.1 time: 1.013294 Aug 31 16:39:43.241604 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3128/6281] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:39:42 2022] GET /compute/v2.1/servers/9fc3d479-902c-416f-92fb-976966b3c5a1 => generated 1373 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:39:44.265107 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-eba7da9e-d448-4a0e-9494-3a41496f4f15 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:39:44.265824 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-eba7da9e-d448-4a0e-9494-3a41496f4f15 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] [instance: 9fc3d479-902c-416f-92fb-976966b3c5a1] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:39:44.275363 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=26,nova_api:DELETE=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:39:44.281479 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eba7da9e-d448-4a0e-9494-3a41496f4f15 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:39:44.282194 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eba7da9e-d448-4a0e-9494-3a41496f4f15 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:39:44.291760 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eba7da9e-d448-4a0e-9494-3a41496f4f15 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:39:44.292798 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eba7da9e-d448-4a0e-9494-3a41496f4f15 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:39:44.293448 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eba7da9e-d448-4a0e-9494-3a41496f4f15 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:39:44.294047 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eba7da9e-d448-4a0e-9494-3a41496f4f15 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:39:44.731909 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-eba7da9e-d448-4a0e-9494-3a41496f4f15 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e026a8cdb13f47de942566a2d4a10bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5827544f2e140e3b44d712d1623a06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:39:44.749079 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-eba7da9e-d448-4a0e-9494-3a41496f4f15 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] 10.222.0.61 "GET /compute/v2.1/servers/9fc3d479-902c-416f-92fb-976966b3c5a1" status: 200 len: 1373 microversion: 2.1 time: 0.489774 Aug 31 16:39:44.750223 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3154/6282] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:39:44 2022] GET /compute/v2.1/servers/9fc3d479-902c-416f-92fb-976966b3c5a1 => generated 1373 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:39:45.776293 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a0343ba4-4342-4801-8591-25b58b317031 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:39:45.776925 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a0343ba4-4342-4801-8591-25b58b317031 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] [instance: 9fc3d479-902c-416f-92fb-976966b3c5a1] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:39:45.791361 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:39:45.792088 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:39:45.793750 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a0343ba4-4342-4801-8591-25b58b317031 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:39:45.794267 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a0343ba4-4342-4801-8591-25b58b317031 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:39:45.794716 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a0343ba4-4342-4801-8591-25b58b317031 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:39:45.795458 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a0343ba4-4342-4801-8591-25b58b317031 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:39:45.795952 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a0343ba4-4342-4801-8591-25b58b317031 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:39:45.796390 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a0343ba4-4342-4801-8591-25b58b317031 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:39:46.105659 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a0343ba4-4342-4801-8591-25b58b317031 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e026a8cdb13f47de942566a2d4a10bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5827544f2e140e3b44d712d1623a06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:39:46.114739 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a0343ba4-4342-4801-8591-25b58b317031 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] 10.222.0.61 "GET /compute/v2.1/servers/9fc3d479-902c-416f-92fb-976966b3c5a1" status: 200 len: 1373 microversion: 2.1 time: 0.342157 Aug 31 16:39:46.117781 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3129/6283] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:39:45 2022] GET /compute/v2.1/servers/9fc3d479-902c-416f-92fb-976966b3c5a1 => generated 1373 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:39:47.143881 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-cd688478-f925-4deb-8e32-65b38e66c50c tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:39:47.144407 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-cd688478-f925-4deb-8e32-65b38e66c50c tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] [instance: 9fc3d479-902c-416f-92fb-976966b3c5a1] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:39:47.147865 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:39:47.171527 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cd688478-f925-4deb-8e32-65b38e66c50c tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:39:47.172152 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cd688478-f925-4deb-8e32-65b38e66c50c tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:39:47.175457 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cd688478-f925-4deb-8e32-65b38e66c50c tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:39:47.176262 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cd688478-f925-4deb-8e32-65b38e66c50c tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:39:47.177365 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cd688478-f925-4deb-8e32-65b38e66c50c tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:39:47.204922 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cd688478-f925-4deb-8e32-65b38e66c50c tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:39:47.721156 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-cd688478-f925-4deb-8e32-65b38e66c50c tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e026a8cdb13f47de942566a2d4a10bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5827544f2e140e3b44d712d1623a06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:39:47.735705 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-cd688478-f925-4deb-8e32-65b38e66c50c tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] 10.222.0.61 "GET /compute/v2.1/servers/9fc3d479-902c-416f-92fb-976966b3c5a1" status: 200 len: 1373 microversion: 2.1 time: 0.596076 Aug 31 16:39:47.748406 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3155/6284] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:39:47 2022] GET /compute/v2.1/servers/9fc3d479-902c-416f-92fb-976966b3c5a1 => generated 1373 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:39:48.761944 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f47c1863-8fff-465d-85af-fdacc369c6b5 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:39:48.762568 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f47c1863-8fff-465d-85af-fdacc369c6b5 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] [instance: 9fc3d479-902c-416f-92fb-976966b3c5a1] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:39:48.772722 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=12 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:39:48.776872 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f47c1863-8fff-465d-85af-fdacc369c6b5 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:39:48.780132 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f47c1863-8fff-465d-85af-fdacc369c6b5 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:39:48.781350 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f47c1863-8fff-465d-85af-fdacc369c6b5 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:39:48.784836 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f47c1863-8fff-465d-85af-fdacc369c6b5 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:39:48.785543 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f47c1863-8fff-465d-85af-fdacc369c6b5 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:39:48.787542 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f47c1863-8fff-465d-85af-fdacc369c6b5 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:39:49.379875 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f47c1863-8fff-465d-85af-fdacc369c6b5 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e026a8cdb13f47de942566a2d4a10bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5827544f2e140e3b44d712d1623a06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:39:49.414199 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f47c1863-8fff-465d-85af-fdacc369c6b5 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] 10.222.0.61 "GET /compute/v2.1/servers/9fc3d479-902c-416f-92fb-976966b3c5a1" status: 200 len: 1373 microversion: 2.1 time: 0.655904 Aug 31 16:39:49.422457 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3130/6285] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:39:48 2022] GET /compute/v2.1/servers/9fc3d479-902c-416f-92fb-976966b3c5a1 => generated 1373 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:39:50.447725 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b8b2db3e-e4e1-45b5-96cb-2927038a1e6e tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:39:50.455857 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b8b2db3e-e4e1-45b5-96cb-2927038a1e6e tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] [instance: 9fc3d479-902c-416f-92fb-976966b3c5a1] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:39:50.474454 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b8b2db3e-e4e1-45b5-96cb-2927038a1e6e tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:39:50.476027 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b8b2db3e-e4e1-45b5-96cb-2927038a1e6e tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:39:50.477945 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b8b2db3e-e4e1-45b5-96cb-2927038a1e6e tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:39:50.483166 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b8b2db3e-e4e1-45b5-96cb-2927038a1e6e tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:39:50.484735 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b8b2db3e-e4e1-45b5-96cb-2927038a1e6e tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:39:50.489120 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b8b2db3e-e4e1-45b5-96cb-2927038a1e6e tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:39:50.922465 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b8b2db3e-e4e1-45b5-96cb-2927038a1e6e tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e026a8cdb13f47de942566a2d4a10bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5827544f2e140e3b44d712d1623a06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:39:50.937482 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b8b2db3e-e4e1-45b5-96cb-2927038a1e6e tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] 10.222.0.61 "GET /compute/v2.1/servers/9fc3d479-902c-416f-92fb-976966b3c5a1" status: 200 len: 1373 microversion: 2.1 time: 0.495660 Aug 31 16:39:50.952305 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3156/6286] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:39:50 2022] GET /compute/v2.1/servers/9fc3d479-902c-416f-92fb-976966b3c5a1 => generated 1373 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:39:51.961934 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c437914a-7e20-470e-a4bb-fe37188f95bd tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:39:51.962560 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c437914a-7e20-470e-a4bb-fe37188f95bd tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] [instance: 9fc3d479-902c-416f-92fb-976966b3c5a1] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:39:51.982167 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c437914a-7e20-470e-a4bb-fe37188f95bd tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:39:51.982678 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c437914a-7e20-470e-a4bb-fe37188f95bd tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:39:51.983122 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c437914a-7e20-470e-a4bb-fe37188f95bd tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:39:51.987763 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c437914a-7e20-470e-a4bb-fe37188f95bd tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:39:51.988634 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c437914a-7e20-470e-a4bb-fe37188f95bd tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:39:51.991584 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c437914a-7e20-470e-a4bb-fe37188f95bd tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:39:52.687568 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c437914a-7e20-470e-a4bb-fe37188f95bd tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e026a8cdb13f47de942566a2d4a10bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5827544f2e140e3b44d712d1623a06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:39:52.709920 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c437914a-7e20-470e-a4bb-fe37188f95bd tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] 10.222.0.61 "GET /compute/v2.1/servers/9fc3d479-902c-416f-92fb-976966b3c5a1" status: 200 len: 1373 microversion: 2.1 time: 0.753163 Aug 31 16:39:52.719948 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3131/6287] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:39:51 2022] GET /compute/v2.1/servers/9fc3d479-902c-416f-92fb-976966b3c5a1 => generated 1373 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:39:52.908841 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-0141517c-8b5f-4a9b-a2d3-bd007b1a5249 req-d28d07c9-c879-4304-bf13-d9d725657f8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fc3d479-902c-416f-92fb-976966b3c5a1", "name": "network-vif-plugged", "status": "completed", "tag": "e37973b8-a7b3-4872-8a09-cdefe11540d9"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:39:52.950846 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-0141517c-8b5f-4a9b-a2d3-bd007b1a5249 req-d28d07c9-c879-4304-bf13-d9d725657f8e service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:39:52.952519 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-0141517c-8b5f-4a9b-a2d3-bd007b1a5249 req-d28d07c9-c879-4304-bf13-d9d725657f8e service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:39:52.953461 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-0141517c-8b5f-4a9b-a2d3-bd007b1a5249 req-d28d07c9-c879-4304-bf13-d9d725657f8e service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:39:53.031937 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-0141517c-8b5f-4a9b-a2d3-bd007b1a5249 req-d28d07c9-c879-4304-bf13-d9d725657f8e service nova] Creating event network-vif-plugged:e37973b8-a7b3-4872-8a09-cdefe11540d9 for instance 9fc3d479-902c-416f-92fb-976966b3c5a1 on n-h2-850499-9 Aug 31 16:39:53.051457 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-0141517c-8b5f-4a9b-a2d3-bd007b1a5249 req-d28d07c9-c879-4304-bf13-d9d725657f8e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146595 Aug 31 16:39:53.054666 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3157/6288] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:39:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:39:53.747406 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6e4963b3-4c39-404e-89cb-65b4937acfb3 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:39:53.753004 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6e4963b3-4c39-404e-89cb-65b4937acfb3 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] [instance: 9fc3d479-902c-416f-92fb-976966b3c5a1] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:39:53.793556 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6e4963b3-4c39-404e-89cb-65b4937acfb3 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:39:53.795985 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6e4963b3-4c39-404e-89cb-65b4937acfb3 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:39:53.798121 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6e4963b3-4c39-404e-89cb-65b4937acfb3 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:39:53.800037 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6e4963b3-4c39-404e-89cb-65b4937acfb3 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:39:53.816842 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6e4963b3-4c39-404e-89cb-65b4937acfb3 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:39:53.817605 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6e4963b3-4c39-404e-89cb-65b4937acfb3 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:39:54.295875 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-6e4963b3-4c39-404e-89cb-65b4937acfb3 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e026a8cdb13f47de942566a2d4a10bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5827544f2e140e3b44d712d1623a06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:39:54.306043 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6e4963b3-4c39-404e-89cb-65b4937acfb3 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] 10.222.0.61 "GET /compute/v2.1/servers/9fc3d479-902c-416f-92fb-976966b3c5a1" status: 200 len: 1373 microversion: 2.1 time: 0.562987 Aug 31 16:39:54.322602 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3132/6289] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:39:53 2022] GET /compute/v2.1/servers/9fc3d479-902c-416f-92fb-976966b3c5a1 => generated 1373 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:39:55.337894 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-deaa92a6-507a-40e7-8189-15a155a26098 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:39:55.353148 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-deaa92a6-507a-40e7-8189-15a155a26098 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] [instance: 9fc3d479-902c-416f-92fb-976966b3c5a1] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:39:55.385835 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-deaa92a6-507a-40e7-8189-15a155a26098 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:39:55.386289 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-deaa92a6-507a-40e7-8189-15a155a26098 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:39:55.386744 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-deaa92a6-507a-40e7-8189-15a155a26098 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:39:55.387795 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-deaa92a6-507a-40e7-8189-15a155a26098 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:39:55.388235 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-deaa92a6-507a-40e7-8189-15a155a26098 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:39:55.388686 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-deaa92a6-507a-40e7-8189-15a155a26098 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:39:55.929226 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-deaa92a6-507a-40e7-8189-15a155a26098 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e026a8cdb13f47de942566a2d4a10bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5827544f2e140e3b44d712d1623a06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:39:55.965860 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-deaa92a6-507a-40e7-8189-15a155a26098 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] 10.222.0.61 "GET /compute/v2.1/servers/9fc3d479-902c-416f-92fb-976966b3c5a1" status: 200 len: 1545 microversion: 2.1 time: 0.637606 Aug 31 16:39:55.982763 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3158/6290] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:39:55 2022] GET /compute/v2.1/servers/9fc3d479-902c-416f-92fb-976966b3c5a1 => generated 1545 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:39:55.987847 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-739c1a2d-6f6a-4f8c-85b6-cbb4f238f220 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:39:55.988462 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-739c1a2d-6f6a-4f8c-85b6-cbb4f238f220 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] [instance: 9fc3d479-902c-416f-92fb-976966b3c5a1] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:39:56.018942 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-739c1a2d-6f6a-4f8c-85b6-cbb4f238f220 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:39:56.020960 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-739c1a2d-6f6a-4f8c-85b6-cbb4f238f220 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:39:56.023040 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-739c1a2d-6f6a-4f8c-85b6-cbb4f238f220 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:39:56.024034 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-739c1a2d-6f6a-4f8c-85b6-cbb4f238f220 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:39:56.027081 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-739c1a2d-6f6a-4f8c-85b6-cbb4f238f220 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:39:56.028778 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-739c1a2d-6f6a-4f8c-85b6-cbb4f238f220 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:39:56.475446 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-739c1a2d-6f6a-4f8c-85b6-cbb4f238f220 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e026a8cdb13f47de942566a2d4a10bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5827544f2e140e3b44d712d1623a06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:39:56.492065 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-739c1a2d-6f6a-4f8c-85b6-cbb4f238f220 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] 10.222.0.61 "GET /compute/v2.1/servers/9fc3d479-902c-416f-92fb-976966b3c5a1" status: 200 len: 1545 microversion: 2.1 time: 0.500292 Aug 31 16:39:56.494479 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3133/6291] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:39:55 2022] GET /compute/v2.1/servers/9fc3d479-902c-416f-92fb-976966b3c5a1 => generated 1545 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:40:03.670884 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-eaa51f9d-fb9e-4e8a-a4ff-2b7c4fba04ac req-8735d097-8649-49a5-81d0-2b7740314ee4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fc3d479-902c-416f-92fb-976966b3c5a1", "tag": "e37973b8-a7b3-4872-8a09-cdefe11540d9"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:40:03.686877 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-eaa51f9d-fb9e-4e8a-a4ff-2b7c4fba04ac req-8735d097-8649-49a5-81d0-2b7740314ee4 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:40:03.705513 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-eaa51f9d-fb9e-4e8a-a4ff-2b7c4fba04ac req-8735d097-8649-49a5-81d0-2b7740314ee4 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:40:03.728274 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-eaa51f9d-fb9e-4e8a-a4ff-2b7c4fba04ac req-8735d097-8649-49a5-81d0-2b7740314ee4 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:40:03.756955 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-eaa51f9d-fb9e-4e8a-a4ff-2b7c4fba04ac req-8735d097-8649-49a5-81d0-2b7740314ee4 service nova] Creating event network-changed:e37973b8-a7b3-4872-8a09-cdefe11540d9 for instance 9fc3d479-902c-416f-92fb-976966b3c5a1 on n-h2-850499-9 Aug 31 16:40:03.763989 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-eaa51f9d-fb9e-4e8a-a4ff-2b7c4fba04ac req-8735d097-8649-49a5-81d0-2b7740314ee4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.544380 Aug 31 16:40:03.765103 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3159/6292] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:40:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:40:28.879251 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-41ac7d92-1cea-4d85-9384-70d9ebc4470f tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1947603910", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "25ce4850-c9a1-4007-9657-c8812556757a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0b707539-6131-412e-ba43-5bdd2cb0fbe5"}]}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:40:28.909576 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=9 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:40:28.910828 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=31 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:40:29.119991 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-41ac7d92-1cea-4d85-9384-70d9ebc4470f tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] validate_networks() for [('0b707539-6131-412e-ba43-5bdd2cb0fbe5', None, None, None, None, None)] {{(pid=122256) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:40:29.803090 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-41ac7d92-1cea-4d85-9384-70d9ebc4470f tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:40:29.803699 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-41ac7d92-1cea-4d85-9384-70d9ebc4470f tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:40:29.804178 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-41ac7d92-1cea-4d85-9384-70d9ebc4470f tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:40:29.804596 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-41ac7d92-1cea-4d85-9384-70d9ebc4470f tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:40:29.805010 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-41ac7d92-1cea-4d85-9384-70d9ebc4470f tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:40:29.814196 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-41ac7d92-1cea-4d85-9384-70d9ebc4470f tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:40:29.814917 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-41ac7d92-1cea-4d85-9384-70d9ebc4470f tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:40:29.815524 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-41ac7d92-1cea-4d85-9384-70d9ebc4470f tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:40:29.816966 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-41ac7d92-1cea-4d85-9384-70d9ebc4470f tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:40:29.817419 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-41ac7d92-1cea-4d85-9384-70d9ebc4470f tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:40:29.818709 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-41ac7d92-1cea-4d85-9384-70d9ebc4470f tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:40:29.842058 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-41ac7d92-1cea-4d85-9384-70d9ebc4470f tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Getting quotas for project 798d7eff58b04ab582bac1e87112625f. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:40:29.849666 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-41ac7d92-1cea-4d85-9384-70d9ebc4470f tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Getting quotas for user 588d2ef08d8345a6b6175c8287633270 and project 798d7eff58b04ab582bac1e87112625f. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:40:29.943004 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-41ac7d92-1cea-4d85-9384-70d9ebc4470f tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Going to run 1 instances... {{(pid=122256) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:40:29.946058 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-41ac7d92-1cea-4d85-9384-70d9ebc4470f tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='25ce4850-c9a1-4007-9657-c8812556757a',volume_size=None,volume_type=None)] {{(pid=122256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:40:30.171376 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-41ac7d92-1cea-4d85-9384-70d9ebc4470f tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.303725 Aug 31 16:40:30.172354 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3134/6293] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:40:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1306 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:40:30.184298 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=11 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:40:30.184298 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=42 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:40:30.188815 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6e17d733-1eda-4985-99c2-5b3a280d762f tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:40:30.189800 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6e17d733-1eda-4985-99c2-5b3a280d762f tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:40:30.370578 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-6e17d733-1eda-4985-99c2-5b3a280d762f tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:40:30.396778 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6e17d733-1eda-4985-99c2-5b3a280d762f tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7" status: 200 len: 1057 microversion: 2.1 time: 0.204381 Aug 31 16:40:30.400103 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3160/6294] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:40:30 2022] GET /compute/v2.1/servers/abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7 => generated 1057 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:40:31.422344 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3cbcae5c-ff37-47d0-8bee-f059d41e9060 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:40:31.423280 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3cbcae5c-ff37-47d0-8bee-f059d41e9060 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:40:31.590616 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3cbcae5c-ff37-47d0-8bee-f059d41e9060 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:40:31.600660 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3cbcae5c-ff37-47d0-8bee-f059d41e9060 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7" status: 200 len: 1057 microversion: 2.1 time: 0.182908 Aug 31 16:40:31.620104 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3135/6295] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:40:31 2022] GET /compute/v2.1/servers/abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7 => generated 1057 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:40:32.644579 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-370e076b-9eb9-4be7-90c5-a3c93678b0c5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:40:32.645314 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-370e076b-9eb9-4be7-90c5-a3c93678b0c5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:40:32.758678 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-370e076b-9eb9-4be7-90c5-a3c93678b0c5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:40:32.769362 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-370e076b-9eb9-4be7-90c5-a3c93678b0c5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7" status: 200 len: 1057 microversion: 2.1 time: 0.128787 Aug 31 16:40:32.770052 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3161/6296] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:40:32 2022] GET /compute/v2.1/servers/abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7 => generated 1057 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:40:33.791957 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6cb84526-58b5-422f-be3f-4ef9391c1d76 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:40:33.791957 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6cb84526-58b5-422f-be3f-4ef9391c1d76 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:40:33.982856 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-6cb84526-58b5-422f-be3f-4ef9391c1d76 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:40:33.992523 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6cb84526-58b5-422f-be3f-4ef9391c1d76 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7" status: 200 len: 1057 microversion: 2.1 time: 0.205784 Aug 31 16:40:33.996232 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3136/6297] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:40:33 2022] GET /compute/v2.1/servers/abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7 => generated 1057 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:40:35.016042 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-bf1f8319-8016-4180-b3db-61b38c08f0c5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:40:35.016666 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-bf1f8319-8016-4180-b3db-61b38c08f0c5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:40:35.027607 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bf1f8319-8016-4180-b3db-61b38c08f0c5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:40:35.029505 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bf1f8319-8016-4180-b3db-61b38c08f0c5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:40:35.029968 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bf1f8319-8016-4180-b3db-61b38c08f0c5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:40:35.030706 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bf1f8319-8016-4180-b3db-61b38c08f0c5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:40:35.034840 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bf1f8319-8016-4180-b3db-61b38c08f0c5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:40:35.035360 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bf1f8319-8016-4180-b3db-61b38c08f0c5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:40:35.328019 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-bf1f8319-8016-4180-b3db-61b38c08f0c5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:40:35.342300 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-bf1f8319-8016-4180-b3db-61b38c08f0c5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7" status: 200 len: 1107 microversion: 2.1 time: 0.330334 Aug 31 16:40:35.355970 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3162/6298] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:40:35 2022] GET /compute/v2.1/servers/abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7 => generated 1107 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:40:36.372347 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8df4821e-3a23-4230-99a2-dfd8bd2e26c4 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:40:36.373171 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8df4821e-3a23-4230-99a2-dfd8bd2e26c4 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:40:36.421319 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8df4821e-3a23-4230-99a2-dfd8bd2e26c4 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:40:36.422599 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8df4821e-3a23-4230-99a2-dfd8bd2e26c4 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:40:36.424478 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8df4821e-3a23-4230-99a2-dfd8bd2e26c4 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:40:36.428125 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8df4821e-3a23-4230-99a2-dfd8bd2e26c4 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:40:36.430222 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8df4821e-3a23-4230-99a2-dfd8bd2e26c4 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:40:36.431107 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8df4821e-3a23-4230-99a2-dfd8bd2e26c4 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:40:36.816734 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8df4821e-3a23-4230-99a2-dfd8bd2e26c4 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:40:36.831226 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8df4821e-3a23-4230-99a2-dfd8bd2e26c4 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7" status: 200 len: 1155 microversion: 2.1 time: 0.462731 Aug 31 16:40:36.843853 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3137/6299] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:40:36 2022] GET /compute/v2.1/servers/abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7 => generated 1155 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:40:37.673160 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-779ce314-faa6-4f08-a080-284f407abef4 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:40:37.675549 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-779ce314-faa6-4f08-a080-284f407abef4 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] [instance: 9fc3d479-902c-416f-92fb-976966b3c5a1] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:40:37.696129 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-779ce314-faa6-4f08-a080-284f407abef4 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:40:37.698173 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-779ce314-faa6-4f08-a080-284f407abef4 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:40:37.701780 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-779ce314-faa6-4f08-a080-284f407abef4 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:40:37.702785 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-779ce314-faa6-4f08-a080-284f407abef4 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:40:37.703513 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-779ce314-faa6-4f08-a080-284f407abef4 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:40:37.704198 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-779ce314-faa6-4f08-a080-284f407abef4 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:40:37.827134 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-779ce314-faa6-4f08-a080-284f407abef4 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] 10.222.0.61 "POST /compute/v2.1/servers/9fc3d479-902c-416f-92fb-976966b3c5a1/action" status: 200 len: 24571 microversion: 2.1 time: 0.157762 Aug 31 16:40:37.827931 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3163/6300] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:40:37 2022] POST /compute/v2.1/servers/9fc3d479-902c-416f-92fb-976966b3c5a1/action => generated 24571 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 16:40:37.870410 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d09e0d0a-ab2e-4cef-8b45-4235f4d31e1a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:40:37.871181 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d09e0d0a-ab2e-4cef-8b45-4235f4d31e1a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:40:37.880588 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d09e0d0a-ab2e-4cef-8b45-4235f4d31e1a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:40:37.881449 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d09e0d0a-ab2e-4cef-8b45-4235f4d31e1a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:40:37.884598 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d09e0d0a-ab2e-4cef-8b45-4235f4d31e1a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:40:37.885557 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d09e0d0a-ab2e-4cef-8b45-4235f4d31e1a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:40:37.889564 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d09e0d0a-ab2e-4cef-8b45-4235f4d31e1a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:40:37.890204 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d09e0d0a-ab2e-4cef-8b45-4235f4d31e1a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:40:38.338650 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d09e0d0a-ab2e-4cef-8b45-4235f4d31e1a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:40:38.347246 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d09e0d0a-ab2e-4cef-8b45-4235f4d31e1a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7" status: 200 len: 1215 microversion: 2.1 time: 0.481716 Aug 31 16:40:38.353426 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3138/6301] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:40:37 2022] GET /compute/v2.1/servers/abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7 => generated 1215 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:40:39.374369 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-26ef127b-1afe-4b62-ae51-cfd2d1b80fd1 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:40:39.375074 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-26ef127b-1afe-4b62-ae51-cfd2d1b80fd1 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:40:39.388039 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-26ef127b-1afe-4b62-ae51-cfd2d1b80fd1 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:40:39.388811 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-26ef127b-1afe-4b62-ae51-cfd2d1b80fd1 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:40:39.390235 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-26ef127b-1afe-4b62-ae51-cfd2d1b80fd1 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:40:39.392321 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-26ef127b-1afe-4b62-ae51-cfd2d1b80fd1 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:40:39.393023 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-26ef127b-1afe-4b62-ae51-cfd2d1b80fd1 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:40:39.395601 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-26ef127b-1afe-4b62-ae51-cfd2d1b80fd1 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:40:39.847086 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-26ef127b-1afe-4b62-ae51-cfd2d1b80fd1 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:40:39.860557 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-26ef127b-1afe-4b62-ae51-cfd2d1b80fd1 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7" status: 200 len: 1215 microversion: 2.1 time: 0.490458 Aug 31 16:40:39.864781 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3164/6302] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:40:39 2022] GET /compute/v2.1/servers/abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7 => generated 1215 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:40:40.282721 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-bb2b371b-2f97-4a2a-a015-522e73792531 req-5b993453-f1e1-4124-acb3-f94a32aecac0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7", "tag": "bee0b36e-0e70-4dd9-9187-f3811b5a2f33"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:40:40.314191 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:40:40.333615 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-bb2b371b-2f97-4a2a-a015-522e73792531 req-5b993453-f1e1-4124-acb3-f94a32aecac0 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:40:40.334333 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-bb2b371b-2f97-4a2a-a015-522e73792531 req-5b993453-f1e1-4124-acb3-f94a32aecac0 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:40:40.334662 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-bb2b371b-2f97-4a2a-a015-522e73792531 req-5b993453-f1e1-4124-acb3-f94a32aecac0 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:40:40.383623 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-bb2b371b-2f97-4a2a-a015-522e73792531 req-5b993453-f1e1-4124-acb3-f94a32aecac0 service nova] Creating event network-changed:bee0b36e-0e70-4dd9-9187-f3811b5a2f33 for instance abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7 on n-h1-850499-9 Aug 31 16:40:40.399707 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-bb2b371b-2f97-4a2a-a015-522e73792531 req-5b993453-f1e1-4124-acb3-f94a32aecac0 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117511 Aug 31 16:40:40.402855 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3139/6303] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:40:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:40:40.885512 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a7ace2cd-3bcd-4eaa-8525-ca991f906a78 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:40:40.886133 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a7ace2cd-3bcd-4eaa-8525-ca991f906a78 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:40:40.933881 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a7ace2cd-3bcd-4eaa-8525-ca991f906a78 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:40:40.934543 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a7ace2cd-3bcd-4eaa-8525-ca991f906a78 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:40:40.935238 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a7ace2cd-3bcd-4eaa-8525-ca991f906a78 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:40:40.936231 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a7ace2cd-3bcd-4eaa-8525-ca991f906a78 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:40:40.936911 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a7ace2cd-3bcd-4eaa-8525-ca991f906a78 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:40:40.937554 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a7ace2cd-3bcd-4eaa-8525-ca991f906a78 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:40:41.554847 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a7ace2cd-3bcd-4eaa-8525-ca991f906a78 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:40:41.563101 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a7ace2cd-3bcd-4eaa-8525-ca991f906a78 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7" status: 200 len: 1215 microversion: 2.1 time: 0.681930 Aug 31 16:40:41.571194 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3165/6304] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:40:40 2022] GET /compute/v2.1/servers/abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7 => generated 1215 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:40:42.595880 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-51c65205-ad89-43cb-8a5c-51dbeee8c949 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:40:42.596603 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-51c65205-ad89-43cb-8a5c-51dbeee8c949 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:40:42.609474 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-51c65205-ad89-43cb-8a5c-51dbeee8c949 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:40:42.609985 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-51c65205-ad89-43cb-8a5c-51dbeee8c949 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:40:42.610425 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-51c65205-ad89-43cb-8a5c-51dbeee8c949 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:40:42.611137 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-51c65205-ad89-43cb-8a5c-51dbeee8c949 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:40:42.611624 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-51c65205-ad89-43cb-8a5c-51dbeee8c949 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:40:42.612057 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-51c65205-ad89-43cb-8a5c-51dbeee8c949 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:40:42.969751 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-51c65205-ad89-43cb-8a5c-51dbeee8c949 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:40:42.989966 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-51c65205-ad89-43cb-8a5c-51dbeee8c949 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7" status: 200 len: 1215 microversion: 2.1 time: 0.399267 Aug 31 16:40:42.996896 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3140/6305] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:40:42 2022] GET /compute/v2.1/servers/abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7 => generated 1215 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:40:44.027061 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8f06890e-3c41-4546-9922-23994f53c129 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:40:44.028693 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8f06890e-3c41-4546-9922-23994f53c129 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:40:44.045054 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=4 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:40:44.047995 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8f06890e-3c41-4546-9922-23994f53c129 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:40:44.048791 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8f06890e-3c41-4546-9922-23994f53c129 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:40:44.049465 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8f06890e-3c41-4546-9922-23994f53c129 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:40:44.050486 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8f06890e-3c41-4546-9922-23994f53c129 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:40:44.051169 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8f06890e-3c41-4546-9922-23994f53c129 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:40:44.063793 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8f06890e-3c41-4546-9922-23994f53c129 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:40:44.331010 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8f06890e-3c41-4546-9922-23994f53c129 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:40:44.346139 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8f06890e-3c41-4546-9922-23994f53c129 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7" status: 200 len: 1215 microversion: 2.1 time: 0.327149 Aug 31 16:40:44.347705 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3166/6306] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:40:44 2022] GET /compute/v2.1/servers/abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7 => generated 1215 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:40:45.373745 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-65726449-0ec8-4d7f-b6bc-28661e809fbe tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:40:45.376759 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-65726449-0ec8-4d7f-b6bc-28661e809fbe tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:40:45.397076 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=10 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:40:45.400284 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-65726449-0ec8-4d7f-b6bc-28661e809fbe tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:40:45.401596 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-65726449-0ec8-4d7f-b6bc-28661e809fbe tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:40:45.402234 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-65726449-0ec8-4d7f-b6bc-28661e809fbe tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:40:45.403903 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-65726449-0ec8-4d7f-b6bc-28661e809fbe tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:40:45.408825 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-65726449-0ec8-4d7f-b6bc-28661e809fbe tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:40:45.409618 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-65726449-0ec8-4d7f-b6bc-28661e809fbe tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:40:45.782049 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-65726449-0ec8-4d7f-b6bc-28661e809fbe tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:40:45.793746 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-65726449-0ec8-4d7f-b6bc-28661e809fbe tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7" status: 200 len: 1215 microversion: 2.1 time: 0.424811 Aug 31 16:40:45.794831 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3141/6307] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:40:45 2022] GET /compute/v2.1/servers/abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7 => generated 1215 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:40:46.817485 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-91a0c1d6-276a-49c4-aad7-1fc4193d7ce4 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:40:46.824853 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-91a0c1d6-276a-49c4-aad7-1fc4193d7ce4 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:40:46.853546 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-91a0c1d6-276a-49c4-aad7-1fc4193d7ce4 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:40:46.854614 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-91a0c1d6-276a-49c4-aad7-1fc4193d7ce4 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:40:46.855968 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-91a0c1d6-276a-49c4-aad7-1fc4193d7ce4 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:40:46.857435 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-91a0c1d6-276a-49c4-aad7-1fc4193d7ce4 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:40:46.858144 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-91a0c1d6-276a-49c4-aad7-1fc4193d7ce4 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:40:46.859246 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-91a0c1d6-276a-49c4-aad7-1fc4193d7ce4 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:40:47.336350 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-91a0c1d6-276a-49c4-aad7-1fc4193d7ce4 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:40:47.368047 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-91a0c1d6-276a-49c4-aad7-1fc4193d7ce4 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7" status: 200 len: 1215 microversion: 2.1 time: 0.550384 Aug 31 16:40:47.368047 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3167/6308] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:40:46 2022] GET /compute/v2.1/servers/abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7 => generated 1215 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:40:48.408431 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-bb09b164-c0dd-4698-b718-d32f0420d9ee tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:40:48.409830 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-bb09b164-c0dd-4698-b718-d32f0420d9ee tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:40:48.419736 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bb09b164-c0dd-4698-b718-d32f0420d9ee tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:40:48.420597 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bb09b164-c0dd-4698-b718-d32f0420d9ee tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:40:48.421269 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bb09b164-c0dd-4698-b718-d32f0420d9ee tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:40:48.422240 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bb09b164-c0dd-4698-b718-d32f0420d9ee tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:40:48.422913 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bb09b164-c0dd-4698-b718-d32f0420d9ee tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:40:48.423750 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bb09b164-c0dd-4698-b718-d32f0420d9ee tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:40:48.688412 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-bb09b164-c0dd-4698-b718-d32f0420d9ee tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:40:48.704246 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-bb09b164-c0dd-4698-b718-d32f0420d9ee tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7" status: 200 len: 1215 microversion: 2.1 time: 0.303226 Aug 31 16:40:48.719221 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3142/6309] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:40:48 2022] GET /compute/v2.1/servers/abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7 => generated 1215 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:40:49.727859 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e05cfca6-3932-4598-b478-5038b15c2e2f tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:40:49.728486 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e05cfca6-3932-4598-b478-5038b15c2e2f tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:40:49.739149 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e05cfca6-3932-4598-b478-5038b15c2e2f tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:40:49.748311 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e05cfca6-3932-4598-b478-5038b15c2e2f tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:40:49.749400 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e05cfca6-3932-4598-b478-5038b15c2e2f tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:40:49.750320 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e05cfca6-3932-4598-b478-5038b15c2e2f tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:40:49.750952 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e05cfca6-3932-4598-b478-5038b15c2e2f tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:40:49.751609 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e05cfca6-3932-4598-b478-5038b15c2e2f tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:40:50.085702 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e05cfca6-3932-4598-b478-5038b15c2e2f tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:40:50.098544 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e05cfca6-3932-4598-b478-5038b15c2e2f tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7" status: 200 len: 1215 microversion: 2.1 time: 0.375172 Aug 31 16:40:50.112887 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3168/6310] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:40:49 2022] GET /compute/v2.1/servers/abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7 => generated 1215 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:40:51.120793 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-462a8188-ab33-47cd-a0dd-019a8a7663c6 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:40:51.121936 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-462a8188-ab33-47cd-a0dd-019a8a7663c6 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:40:51.130005 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-462a8188-ab33-47cd-a0dd-019a8a7663c6 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:40:51.132162 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-462a8188-ab33-47cd-a0dd-019a8a7663c6 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:40:51.132987 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-462a8188-ab33-47cd-a0dd-019a8a7663c6 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:40:51.134604 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-462a8188-ab33-47cd-a0dd-019a8a7663c6 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:40:51.135257 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-462a8188-ab33-47cd-a0dd-019a8a7663c6 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:40:51.135924 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-462a8188-ab33-47cd-a0dd-019a8a7663c6 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:40:51.405744 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-462a8188-ab33-47cd-a0dd-019a8a7663c6 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:40:51.418496 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-462a8188-ab33-47cd-a0dd-019a8a7663c6 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7" status: 200 len: 1215 microversion: 2.1 time: 0.301860 Aug 31 16:40:51.419728 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3143/6311] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:40:51 2022] GET /compute/v2.1/servers/abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7 => generated 1215 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:40:52.448217 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c4619b52-e653-4926-b7bd-77f8834f29ad tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:40:52.448837 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c4619b52-e653-4926-b7bd-77f8834f29ad tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:40:52.461071 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c4619b52-e653-4926-b7bd-77f8834f29ad tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:40:52.461772 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c4619b52-e653-4926-b7bd-77f8834f29ad tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:40:52.462367 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c4619b52-e653-4926-b7bd-77f8834f29ad tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:40:52.463260 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c4619b52-e653-4926-b7bd-77f8834f29ad tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:40:52.463907 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c4619b52-e653-4926-b7bd-77f8834f29ad tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:40:52.464573 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c4619b52-e653-4926-b7bd-77f8834f29ad tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:40:52.649302 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c4619b52-e653-4926-b7bd-77f8834f29ad tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:40:52.669643 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c4619b52-e653-4926-b7bd-77f8834f29ad tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7" status: 200 len: 1203 microversion: 2.1 time: 0.231833 Aug 31 16:40:52.680556 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3169/6312] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:40:52 2022] GET /compute/v2.1/servers/abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7 => generated 1203 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:40:53.699468 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c1fe8f33-4314-4907-88cf-9e518d369639 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:40:53.700114 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c1fe8f33-4314-4907-88cf-9e518d369639 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:40:53.728077 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c1fe8f33-4314-4907-88cf-9e518d369639 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:40:53.728707 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c1fe8f33-4314-4907-88cf-9e518d369639 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:40:53.729168 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c1fe8f33-4314-4907-88cf-9e518d369639 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:40:53.729923 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c1fe8f33-4314-4907-88cf-9e518d369639 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:40:53.730384 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c1fe8f33-4314-4907-88cf-9e518d369639 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:40:53.730814 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c1fe8f33-4314-4907-88cf-9e518d369639 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:40:53.984285 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c1fe8f33-4314-4907-88cf-9e518d369639 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:40:53.996740 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c1fe8f33-4314-4907-88cf-9e518d369639 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7" status: 200 len: 1203 microversion: 2.1 time: 0.301497 Aug 31 16:40:54.008209 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3144/6313] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:40:53 2022] GET /compute/v2.1/servers/abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7 => generated 1203 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:40:55.021059 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1d70abaa-ef33-4a43-8329-5d2a44efba6e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:40:55.022742 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1d70abaa-ef33-4a43-8329-5d2a44efba6e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:40:55.037125 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1d70abaa-ef33-4a43-8329-5d2a44efba6e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:40:55.040387 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1d70abaa-ef33-4a43-8329-5d2a44efba6e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:40:55.041018 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1d70abaa-ef33-4a43-8329-5d2a44efba6e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:40:55.042013 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1d70abaa-ef33-4a43-8329-5d2a44efba6e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:40:55.042931 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1d70abaa-ef33-4a43-8329-5d2a44efba6e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:40:55.043583 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1d70abaa-ef33-4a43-8329-5d2a44efba6e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:40:55.338626 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-1d70abaa-ef33-4a43-8329-5d2a44efba6e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:40:55.350623 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1d70abaa-ef33-4a43-8329-5d2a44efba6e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7" status: 200 len: 1203 microversion: 2.1 time: 0.333728 Aug 31 16:40:55.352164 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3170/6314] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:40:55 2022] GET /compute/v2.1/servers/abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7 => generated 1203 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:40:56.373992 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-37feaee8-d669-4b4f-961c-86cf2c92279c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:40:56.374677 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-37feaee8-d669-4b4f-961c-86cf2c92279c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:40:56.385884 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-37feaee8-d669-4b4f-961c-86cf2c92279c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:40:56.386821 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-37feaee8-d669-4b4f-961c-86cf2c92279c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:40:56.387161 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-37feaee8-d669-4b4f-961c-86cf2c92279c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:40:56.388546 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-37feaee8-d669-4b4f-961c-86cf2c92279c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:40:56.389235 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-37feaee8-d669-4b4f-961c-86cf2c92279c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:40:56.389855 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-37feaee8-d669-4b4f-961c-86cf2c92279c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:40:56.659882 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-37feaee8-d669-4b4f-961c-86cf2c92279c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:40:56.673139 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-37feaee8-d669-4b4f-961c-86cf2c92279c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7" status: 200 len: 1203 microversion: 2.1 time: 0.304358 Aug 31 16:40:56.696508 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3145/6315] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:40:56 2022] GET /compute/v2.1/servers/abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7 => generated 1203 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:40:57.699248 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-33ffa5e3-fc76-4cfe-a174-efcc4212cae2 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:40:57.700720 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-33ffa5e3-fc76-4cfe-a174-efcc4212cae2 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:40:57.714904 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-33ffa5e3-fc76-4cfe-a174-efcc4212cae2 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:40:57.716026 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-33ffa5e3-fc76-4cfe-a174-efcc4212cae2 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:40:57.719640 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-33ffa5e3-fc76-4cfe-a174-efcc4212cae2 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:40:57.721320 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-33ffa5e3-fc76-4cfe-a174-efcc4212cae2 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:40:57.722445 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-33ffa5e3-fc76-4cfe-a174-efcc4212cae2 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:40:57.723427 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-33ffa5e3-fc76-4cfe-a174-efcc4212cae2 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:40:57.984337 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-33ffa5e3-fc76-4cfe-a174-efcc4212cae2 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:40:58.026518 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-33ffa5e3-fc76-4cfe-a174-efcc4212cae2 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7" status: 200 len: 1203 microversion: 2.1 time: 0.331210 Aug 31 16:40:58.040834 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3171/6316] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:40:57 2022] GET /compute/v2.1/servers/abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7 => generated 1203 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:40:59.066753 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-85a39664-5726-4776-8bfe-2baf59b3bd3a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:40:59.068077 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-85a39664-5726-4776-8bfe-2baf59b3bd3a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:40:59.105493 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:40:59.107300 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-85a39664-5726-4776-8bfe-2baf59b3bd3a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:40:59.107977 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-85a39664-5726-4776-8bfe-2baf59b3bd3a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:40:59.108643 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-85a39664-5726-4776-8bfe-2baf59b3bd3a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:40:59.109560 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-85a39664-5726-4776-8bfe-2baf59b3bd3a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:40:59.110171 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-85a39664-5726-4776-8bfe-2baf59b3bd3a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:40:59.110749 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-85a39664-5726-4776-8bfe-2baf59b3bd3a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:40:59.114883 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=53 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:40:59.384531 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-85a39664-5726-4776-8bfe-2baf59b3bd3a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:40:59.404302 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-85a39664-5726-4776-8bfe-2baf59b3bd3a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7" status: 200 len: 1203 microversion: 2.1 time: 0.341605 Aug 31 16:40:59.404895 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3146/6317] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:40:59 2022] GET /compute/v2.1/servers/abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7 => generated 1203 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:41:00.433371 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7e6d23a5-d5b1-444b-8fe6-bc8c20ad9841 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:41:00.434009 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7e6d23a5-d5b1-444b-8fe6-bc8c20ad9841 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:41:00.438765 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=29 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:41:00.445923 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7e6d23a5-d5b1-444b-8fe6-bc8c20ad9841 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:00.446434 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7e6d23a5-d5b1-444b-8fe6-bc8c20ad9841 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:00.457528 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7e6d23a5-d5b1-444b-8fe6-bc8c20ad9841 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:00.458412 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7e6d23a5-d5b1-444b-8fe6-bc8c20ad9841 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:00.458903 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7e6d23a5-d5b1-444b-8fe6-bc8c20ad9841 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:00.459901 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7e6d23a5-d5b1-444b-8fe6-bc8c20ad9841 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:00.467888 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=59 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:41:00.756026 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7e6d23a5-d5b1-444b-8fe6-bc8c20ad9841 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:41:00.771092 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7e6d23a5-d5b1-444b-8fe6-bc8c20ad9841 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7" status: 200 len: 1203 microversion: 2.1 time: 0.347342 Aug 31 16:41:00.772639 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3172/6318] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:41:00 2022] GET /compute/v2.1/servers/abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7 => generated 1203 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:41:01.793836 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b9318c80-4e90-4dc7-98ed-32771a10762d tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:41:01.795383 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b9318c80-4e90-4dc7-98ed-32771a10762d tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:41:01.820331 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b9318c80-4e90-4dc7-98ed-32771a10762d tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:01.821233 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b9318c80-4e90-4dc7-98ed-32771a10762d tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:01.821865 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b9318c80-4e90-4dc7-98ed-32771a10762d tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:01.822849 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b9318c80-4e90-4dc7-98ed-32771a10762d tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:01.823578 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b9318c80-4e90-4dc7-98ed-32771a10762d tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:01.824407 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b9318c80-4e90-4dc7-98ed-32771a10762d tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:02.031039 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b9318c80-4e90-4dc7-98ed-32771a10762d tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:41:02.044849 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b9318c80-4e90-4dc7-98ed-32771a10762d tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7" status: 200 len: 1203 microversion: 2.1 time: 0.255362 Aug 31 16:41:02.046080 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3147/6319] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:41:01 2022] GET /compute/v2.1/servers/abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7 => generated 1203 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:41:03.085973 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b2008c45-42bd-45f2-9aa7-2bc42a6aa71e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:41:03.088042 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b2008c45-42bd-45f2-9aa7-2bc42a6aa71e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:41:03.106302 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b2008c45-42bd-45f2-9aa7-2bc42a6aa71e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:03.108336 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b2008c45-42bd-45f2-9aa7-2bc42a6aa71e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:03.110736 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b2008c45-42bd-45f2-9aa7-2bc42a6aa71e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:03.112232 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b2008c45-42bd-45f2-9aa7-2bc42a6aa71e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:03.112927 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b2008c45-42bd-45f2-9aa7-2bc42a6aa71e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:03.113602 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b2008c45-42bd-45f2-9aa7-2bc42a6aa71e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:03.606580 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b2008c45-42bd-45f2-9aa7-2bc42a6aa71e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:41:03.616480 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b2008c45-42bd-45f2-9aa7-2bc42a6aa71e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7" status: 200 len: 1203 microversion: 2.1 time: 0.549500 Aug 31 16:41:03.627923 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3173/6320] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:41:03 2022] GET /compute/v2.1/servers/abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7 => generated 1203 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:41:03.715019 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-8c20e985-f401-4975-8e62-e703e7cbcc96 req-88f2b343-e562-4445-a752-03bbc44ebc81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7", "name": "network-vif-plugged", "status": "completed", "tag": "bee0b36e-0e70-4dd9-9187-f3811b5a2f33"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:41:03.781418 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-8c20e985-f401-4975-8e62-e703e7cbcc96 req-88f2b343-e562-4445-a752-03bbc44ebc81 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:03.791741 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-8c20e985-f401-4975-8e62-e703e7cbcc96 req-88f2b343-e562-4445-a752-03bbc44ebc81 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:03.793021 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-8c20e985-f401-4975-8e62-e703e7cbcc96 req-88f2b343-e562-4445-a752-03bbc44ebc81 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:03.838924 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-8c20e985-f401-4975-8e62-e703e7cbcc96 req-88f2b343-e562-4445-a752-03bbc44ebc81 service nova] Creating event network-vif-plugged:bee0b36e-0e70-4dd9-9187-f3811b5a2f33 for instance abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7 on n-h1-850499-9 Aug 31 16:41:03.847090 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-8c20e985-f401-4975-8e62-e703e7cbcc96 req-88f2b343-e562-4445-a752-03bbc44ebc81 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136421 Aug 31 16:41:03.848484 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3148/6321] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:41:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:41:04.640127 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-05bc698d-d5d0-4b64-b7b2-d74ad33a945b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:41:04.640945 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-05bc698d-d5d0-4b64-b7b2-d74ad33a945b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:41:04.661845 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-05bc698d-d5d0-4b64-b7b2-d74ad33a945b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:04.662897 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-05bc698d-d5d0-4b64-b7b2-d74ad33a945b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:04.663854 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-05bc698d-d5d0-4b64-b7b2-d74ad33a945b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:04.664877 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-05bc698d-d5d0-4b64-b7b2-d74ad33a945b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:04.665260 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-05bc698d-d5d0-4b64-b7b2-d74ad33a945b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:04.665949 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-05bc698d-d5d0-4b64-b7b2-d74ad33a945b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:04.891386 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-05bc698d-d5d0-4b64-b7b2-d74ad33a945b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:41:04.900818 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-05bc698d-d5d0-4b64-b7b2-d74ad33a945b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7" status: 200 len: 1203 microversion: 2.1 time: 0.266325 Aug 31 16:41:04.902962 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3174/6322] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:41:04 2022] GET /compute/v2.1/servers/abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7 => generated 1203 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:41:05.932113 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9ef468bc-14da-4855-8b93-268d29bb29d9 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:41:05.933752 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9ef468bc-14da-4855-8b93-268d29bb29d9 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:41:05.956985 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9ef468bc-14da-4855-8b93-268d29bb29d9 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:05.967789 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9ef468bc-14da-4855-8b93-268d29bb29d9 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:05.969503 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9ef468bc-14da-4855-8b93-268d29bb29d9 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:05.971604 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9ef468bc-14da-4855-8b93-268d29bb29d9 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:05.972337 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9ef468bc-14da-4855-8b93-268d29bb29d9 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:05.972936 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9ef468bc-14da-4855-8b93-268d29bb29d9 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:06.363462 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-9ef468bc-14da-4855-8b93-268d29bb29d9 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:41:06.377843 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9ef468bc-14da-4855-8b93-268d29bb29d9 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7" status: 200 len: 1390 microversion: 2.1 time: 0.451791 Aug 31 16:41:06.381401 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3149/6323] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:41:05 2022] GET /compute/v2.1/servers/abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7 => generated 1390 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:41:06.407030 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c17bf751-75ad-419e-a1ca-f66057d3ab4c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:41:06.411932 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c17bf751-75ad-419e-a1ca-f66057d3ab4c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:41:06.425690 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c17bf751-75ad-419e-a1ca-f66057d3ab4c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:06.426188 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c17bf751-75ad-419e-a1ca-f66057d3ab4c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:06.426624 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c17bf751-75ad-419e-a1ca-f66057d3ab4c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:06.438103 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c17bf751-75ad-419e-a1ca-f66057d3ab4c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:06.441170 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c17bf751-75ad-419e-a1ca-f66057d3ab4c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:06.443725 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c17bf751-75ad-419e-a1ca-f66057d3ab4c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:06.745979 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c17bf751-75ad-419e-a1ca-f66057d3ab4c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:41:06.760855 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c17bf751-75ad-419e-a1ca-f66057d3ab4c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7" status: 200 len: 1390 microversion: 2.1 time: 0.359786 Aug 31 16:41:06.761955 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3175/6324] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:41:06 2022] GET /compute/v2.1/servers/abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7 => generated 1390 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:41:06.793542 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-50809084-3e38-4e17-a79c-8df7fd996fd4 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:41:06.806515 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-50809084-3e38-4e17-a79c-8df7fd996fd4 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:41:06.823365 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-50809084-3e38-4e17-a79c-8df7fd996fd4 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:06.824255 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-50809084-3e38-4e17-a79c-8df7fd996fd4 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:06.824703 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-50809084-3e38-4e17-a79c-8df7fd996fd4 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:06.825797 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-50809084-3e38-4e17-a79c-8df7fd996fd4 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:06.826018 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-50809084-3e38-4e17-a79c-8df7fd996fd4 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:06.826809 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-50809084-3e38-4e17-a79c-8df7fd996fd4 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:07.174820 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-50809084-3e38-4e17-a79c-8df7fd996fd4 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:41:07.187038 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-50809084-3e38-4e17-a79c-8df7fd996fd4 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7" status: 200 len: 1390 microversion: 2.1 time: 0.398885 Aug 31 16:41:07.188592 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3150/6325] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:41:06 2022] GET /compute/v2.1/servers/abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7 => generated 1390 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:41:07.211034 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-000d2a7f-fe42-47ef-90d3-ac9a183a3311 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:41:07.214375 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-000d2a7f-fe42-47ef-90d3-ac9a183a3311 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:41:07.249891 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-000d2a7f-fe42-47ef-90d3-ac9a183a3311 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:07.250788 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-000d2a7f-fe42-47ef-90d3-ac9a183a3311 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:07.251408 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-000d2a7f-fe42-47ef-90d3-ac9a183a3311 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:07.252768 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-000d2a7f-fe42-47ef-90d3-ac9a183a3311 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:07.253422 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-000d2a7f-fe42-47ef-90d3-ac9a183a3311 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:07.254164 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-000d2a7f-fe42-47ef-90d3-ac9a183a3311 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:07.286049 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-000d2a7f-fe42-47ef-90d3-ac9a183a3311 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:41:07.529496 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-000d2a7f-fe42-47ef-90d3-ac9a183a3311 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "DELETE /compute/v2.1/servers/abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7" status: 204 len: 0 microversion: 2.1 time: 0.324226 Aug 31 16:41:07.541726 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3176/6326] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:41:07 2022] DELETE /compute/v2.1/servers/abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:41:07.562259 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a2f7c3f9-5f4a-4bfd-88a0-c21b1377f7e8 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:41:07.565160 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a2f7c3f9-5f4a-4bfd-88a0-c21b1377f7e8 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:41:07.591249 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a2f7c3f9-5f4a-4bfd-88a0-c21b1377f7e8 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:07.598376 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a2f7c3f9-5f4a-4bfd-88a0-c21b1377f7e8 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:07.600936 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a2f7c3f9-5f4a-4bfd-88a0-c21b1377f7e8 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:07.605961 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a2f7c3f9-5f4a-4bfd-88a0-c21b1377f7e8 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:07.607814 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a2f7c3f9-5f4a-4bfd-88a0-c21b1377f7e8 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:07.620650 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a2f7c3f9-5f4a-4bfd-88a0-c21b1377f7e8 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:08.065016 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a2f7c3f9-5f4a-4bfd-88a0-c21b1377f7e8 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:41:08.075712 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a2f7c3f9-5f4a-4bfd-88a0-c21b1377f7e8 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7" status: 200 len: 1396 microversion: 2.1 time: 0.525614 Aug 31 16:41:08.077029 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3151/6327] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:41:07 2022] GET /compute/v2.1/servers/abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7 => generated 1396 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:41:09.113114 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d04c8642-9519-4dfe-9850-b9b599c41cc7 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:41:09.113833 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d04c8642-9519-4dfe-9850-b9b599c41cc7 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:41:09.124632 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d04c8642-9519-4dfe-9850-b9b599c41cc7 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:09.125203 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d04c8642-9519-4dfe-9850-b9b599c41cc7 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:09.125717 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d04c8642-9519-4dfe-9850-b9b599c41cc7 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:09.126640 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d04c8642-9519-4dfe-9850-b9b599c41cc7 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:09.127124 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d04c8642-9519-4dfe-9850-b9b599c41cc7 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:09.127615 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d04c8642-9519-4dfe-9850-b9b599c41cc7 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:09.556529 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d04c8642-9519-4dfe-9850-b9b599c41cc7 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:41:09.574328 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d04c8642-9519-4dfe-9850-b9b599c41cc7 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7" status: 200 len: 1396 microversion: 2.1 time: 0.466301 Aug 31 16:41:09.575076 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3177/6328] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:41:09 2022] GET /compute/v2.1/servers/abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7 => generated 1396 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:41:10.152578 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-fe7dbc9a-91b3-4f21-8d0b-6ecc57f5f48f req-132f83a8-a1da-4558-afa8-15ba6fddc4f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7", "name": "network-vif-deleted", "tag": "bee0b36e-0e70-4dd9-9187-f3811b5a2f33"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:41:10.175791 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-fe7dbc9a-91b3-4f21-8d0b-6ecc57f5f48f req-132f83a8-a1da-4558-afa8-15ba6fddc4f0 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:10.176200 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-fe7dbc9a-91b3-4f21-8d0b-6ecc57f5f48f req-132f83a8-a1da-4558-afa8-15ba6fddc4f0 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:10.196258 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-fe7dbc9a-91b3-4f21-8d0b-6ecc57f5f48f req-132f83a8-a1da-4558-afa8-15ba6fddc4f0 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:10.243361 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-fe7dbc9a-91b3-4f21-8d0b-6ecc57f5f48f req-132f83a8-a1da-4558-afa8-15ba6fddc4f0 service nova] Creating event network-vif-deleted:bee0b36e-0e70-4dd9-9187-f3811b5a2f33 for instance abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7 on n-h1-850499-9 Aug 31 16:41:10.262465 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-fe7dbc9a-91b3-4f21-8d0b-6ecc57f5f48f req-132f83a8-a1da-4558-afa8-15ba6fddc4f0 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116791 Aug 31 16:41:10.269665 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3152/6329] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:41:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:41:10.596964 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b022bfbd-2b6a-49dc-bfd8-12d2f6f12c5f tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:41:10.597634 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b022bfbd-2b6a-49dc-bfd8-12d2f6f12c5f tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:41:10.609155 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b022bfbd-2b6a-49dc-bfd8-12d2f6f12c5f tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:10.609664 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b022bfbd-2b6a-49dc-bfd8-12d2f6f12c5f tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:10.610090 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b022bfbd-2b6a-49dc-bfd8-12d2f6f12c5f tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:10.624012 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b022bfbd-2b6a-49dc-bfd8-12d2f6f12c5f tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:10.624509 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b022bfbd-2b6a-49dc-bfd8-12d2f6f12c5f tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:10.624955 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b022bfbd-2b6a-49dc-bfd8-12d2f6f12c5f tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:11.723247 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b022bfbd-2b6a-49dc-bfd8-12d2f6f12c5f tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:41:11.735995 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b022bfbd-2b6a-49dc-bfd8-12d2f6f12c5f tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7" status: 200 len: 1188 microversion: 2.1 time: 1.143511 Aug 31 16:41:11.737262 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3178/6330] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:41:10 2022] GET /compute/v2.1/servers/abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7 => generated 1188 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:41:12.762828 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0277d842-b085-4a43-b246-67f1aa9734e8 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:41:12.763706 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0277d842-b085-4a43-b246-67f1aa9734e8 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:41:12.779938 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0277d842-b085-4a43-b246-67f1aa9734e8 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:12.781140 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0277d842-b085-4a43-b246-67f1aa9734e8 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:12.781697 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0277d842-b085-4a43-b246-67f1aa9734e8 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:12.782564 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0277d842-b085-4a43-b246-67f1aa9734e8 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:12.784070 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0277d842-b085-4a43-b246-67f1aa9734e8 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:12.785985 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0277d842-b085-4a43-b246-67f1aa9734e8 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:12.983037 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-0277d842-b085-4a43-b246-67f1aa9734e8 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:41:13.003427 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0277d842-b085-4a43-b246-67f1aa9734e8 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7" status: 200 len: 1188 microversion: 2.1 time: 0.245293 Aug 31 16:41:13.009428 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3153/6331] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:41:12 2022] GET /compute/v2.1/servers/abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7 => generated 1188 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:41:14.029695 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8f5f2a4f-fbc4-46bb-a5a9-d11da298b838 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:41:14.031754 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8f5f2a4f-fbc4-46bb-a5a9-d11da298b838 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:41:14.058289 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8f5f2a4f-fbc4-46bb-a5a9-d11da298b838 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:14.062240 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8f5f2a4f-fbc4-46bb-a5a9-d11da298b838 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:14.062908 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8f5f2a4f-fbc4-46bb-a5a9-d11da298b838 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:14.073434 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8f5f2a4f-fbc4-46bb-a5a9-d11da298b838 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:14.081500 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8f5f2a4f-fbc4-46bb-a5a9-d11da298b838 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:14.082172 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8f5f2a4f-fbc4-46bb-a5a9-d11da298b838 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:14.805933 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8f5f2a4f-fbc4-46bb-a5a9-d11da298b838 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:41:14.823394 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8f5f2a4f-fbc4-46bb-a5a9-d11da298b838 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7" status: 200 len: 1188 microversion: 2.1 time: 0.797498 Aug 31 16:41:14.824451 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3179/6332] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:41:14 2022] GET /compute/v2.1/servers/abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7 => generated 1188 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:41:15.845017 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4c975024-bf25-48d1-8e81-91861e7e71b2 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:41:15.846440 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4c975024-bf25-48d1-8e81-91861e7e71b2 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:41:15.864335 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4c975024-bf25-48d1-8e81-91861e7e71b2 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:15.864943 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4c975024-bf25-48d1-8e81-91861e7e71b2 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:15.865459 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4c975024-bf25-48d1-8e81-91861e7e71b2 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:15.866833 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4c975024-bf25-48d1-8e81-91861e7e71b2 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:15.867377 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4c975024-bf25-48d1-8e81-91861e7e71b2 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:15.867929 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4c975024-bf25-48d1-8e81-91861e7e71b2 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:16.031718 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-4c975024-bf25-48d1-8e81-91861e7e71b2 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:41:16.044448 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4c975024-bf25-48d1-8e81-91861e7e71b2 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7" status: 200 len: 1188 microversion: 2.1 time: 0.203396 Aug 31 16:41:16.045724 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3154/6333] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:41:15 2022] GET /compute/v2.1/servers/abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7 => generated 1188 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:41:17.067017 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f92b0a9c-2bb8-4e5c-a1c4-540eae5c2fb4 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:41:17.068014 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f92b0a9c-2bb8-4e5c-a1c4-540eae5c2fb4 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:41:17.095982 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f92b0a9c-2bb8-4e5c-a1c4-540eae5c2fb4 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:17.096712 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f92b0a9c-2bb8-4e5c-a1c4-540eae5c2fb4 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:17.097393 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f92b0a9c-2bb8-4e5c-a1c4-540eae5c2fb4 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:17.098583 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f92b0a9c-2bb8-4e5c-a1c4-540eae5c2fb4 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:17.099873 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f92b0a9c-2bb8-4e5c-a1c4-540eae5c2fb4 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:17.101382 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f92b0a9c-2bb8-4e5c-a1c4-540eae5c2fb4 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:17.365352 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f92b0a9c-2bb8-4e5c-a1c4-540eae5c2fb4 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:41:17.374729 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f92b0a9c-2bb8-4e5c-a1c4-540eae5c2fb4 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7" status: 200 len: 1188 microversion: 2.1 time: 0.311543 Aug 31 16:41:17.380642 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3180/6334] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:41:17 2022] GET /compute/v2.1/servers/abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7 => generated 1188 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:41:18.407954 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d527e607-0d60-4588-aa62-7864ff84ba8b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:41:18.408575 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d527e607-0d60-4588-aa62-7864ff84ba8b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:41:18.423538 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d527e607-0d60-4588-aa62-7864ff84ba8b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:18.425419 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d527e607-0d60-4588-aa62-7864ff84ba8b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:18.425834 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d527e607-0d60-4588-aa62-7864ff84ba8b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:18.427994 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d527e607-0d60-4588-aa62-7864ff84ba8b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:18.429637 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d527e607-0d60-4588-aa62-7864ff84ba8b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:18.430212 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d527e607-0d60-4588-aa62-7864ff84ba8b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:18.669205 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d527e607-0d60-4588-aa62-7864ff84ba8b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:41:18.701985 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d527e607-0d60-4588-aa62-7864ff84ba8b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7" status: 200 len: 1188 microversion: 2.1 time: 0.298343 Aug 31 16:41:18.711474 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3155/6335] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:41:18 2022] GET /compute/v2.1/servers/abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7 => generated 1188 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:41:19.731063 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a5b8fc15-f710-494e-8ca9-59b15b82e6dd tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:41:19.731776 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a5b8fc15-f710-494e-8ca9-59b15b82e6dd tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:41:19.753449 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a5b8fc15-f710-494e-8ca9-59b15b82e6dd tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:19.759906 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a5b8fc15-f710-494e-8ca9-59b15b82e6dd tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:19.761835 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a5b8fc15-f710-494e-8ca9-59b15b82e6dd tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:19.763968 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a5b8fc15-f710-494e-8ca9-59b15b82e6dd tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:19.764897 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a5b8fc15-f710-494e-8ca9-59b15b82e6dd tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:19.769337 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a5b8fc15-f710-494e-8ca9-59b15b82e6dd tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:20.204024 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a5b8fc15-f710-494e-8ca9-59b15b82e6dd tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:41:20.217174 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a5b8fc15-f710-494e-8ca9-59b15b82e6dd tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7" status: 200 len: 1188 microversion: 2.1 time: 0.489937 Aug 31 16:41:20.227323 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3181/6336] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:41:19 2022] GET /compute/v2.1/servers/abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7 => generated 1188 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:41:21.240107 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ef1983af-b072-439f-aa4a-48645f21a26e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:41:21.240725 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ef1983af-b072-439f-aa4a-48645f21a26e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:41:21.260851 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ef1983af-b072-439f-aa4a-48645f21a26e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:21.261662 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ef1983af-b072-439f-aa4a-48645f21a26e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:21.262276 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ef1983af-b072-439f-aa4a-48645f21a26e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:21.263216 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ef1983af-b072-439f-aa4a-48645f21a26e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:21.265517 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ef1983af-b072-439f-aa4a-48645f21a26e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:21.267606 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ef1983af-b072-439f-aa4a-48645f21a26e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:21.550380 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ef1983af-b072-439f-aa4a-48645f21a26e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:41:21.559410 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ef1983af-b072-439f-aa4a-48645f21a26e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7" status: 200 len: 1188 microversion: 2.1 time: 0.323129 Aug 31 16:41:21.567554 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3156/6337] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:41:21 2022] GET /compute/v2.1/servers/abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7 => generated 1188 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:41:22.609060 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a222692a-b173-4746-aa7f-2df2fa954cbf tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:41:22.623577 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a222692a-b173-4746-aa7f-2df2fa954cbf tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:41:22.709506 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a222692a-b173-4746-aa7f-2df2fa954cbf tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:22.746314 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a222692a-b173-4746-aa7f-2df2fa954cbf tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.040s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:22.746821 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a222692a-b173-4746-aa7f-2df2fa954cbf tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:22.782779 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a222692a-b173-4746-aa7f-2df2fa954cbf tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:22.783379 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a222692a-b173-4746-aa7f-2df2fa954cbf tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:22.789797 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a222692a-b173-4746-aa7f-2df2fa954cbf tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:22.827467 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-a222692a-b173-4746-aa7f-2df2fa954cbf tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] HTTP exception thrown: Instance abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7 could not be found. Aug 31 16:41:22.830265 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a222692a-b173-4746-aa7f-2df2fa954cbf tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Request method failure captured: Aug 31 16:41:22.830265 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7 HTTP/1.1 Aug 31 16:41:22.830265 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:41:22.830265 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:41:22.830265 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:41:22.830265 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:41:22.830265 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:41:22.830265 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:41:22.830265 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:41:22.830265 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:41:22.830265 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD47qS8C6HsXEaEmR5vEYZ6_LcYWck6kjg2PE2Sm6XicPmZbBvnd8kXBk0kFrhGPgu84OodaxIz7Gcm1qVV62nKCQjCd-8My5krh8bw3lC-5obyJ5MI9WGooafg2qsKoEyqO0fUDn4HqdbQ-uRSMHzaJZriF8vfhIimZHzzbd5tR6Fco Aug 31 16:41:22.830265 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:41:22.830265 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:41:22.830265 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:41:22.830265 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:41:22.830265 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:41:22.830265 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:41:22.830265 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 798d7eff58b04ab582bac1e87112625f Aug 31 16:41:22.830265 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-TestVolumeBootPattern-1074913281 Aug 31 16:41:22.830265 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:41:22.830265 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:41:22.830265 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/798d7eff58b04ab582bac1e87112625f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/798d7eff58b04ab582bac1e87112625f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_798d7eff58b04ab582bac1e87112625f", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/798d7eff58b04ab582bac1e87112625f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:41:22.830265 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-TestVolumeBootPattern-1074913281 Aug 31 16:41:22.830265 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 798d7eff58b04ab582bac1e87112625f Aug 31 16:41:22.830265 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-TestVolumeBootPattern-1074913281 Aug 31 16:41:22.830265 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-TestVolumeBootPattern-1074913281-project Aug 31 16:41:22.830265 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:41:22.830265 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:41:22.830265 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 588d2ef08d8345a6b6175c8287633270 Aug 31 16:41:22.830265 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-TestVolumeBootPattern-1074913281-project Aug 31 16:41:22.830265 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:41:22.830265 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7 could not be found. Aug 31 16:41:22.830265 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': 'abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7'} Aug 31 16:41:22.830265 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:41:22.830265 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:41:22.830265 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:41:22.830265 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:41:22.830265 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:41:22.830265 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:41:22.830265 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:41:22.830265 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:41:22.830265 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:41:22.830265 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:41:22.830265 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7 could not be found. Aug 31 16:41:22.830265 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:41:22.830265 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:41:22.830265 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:41:22.830265 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:41:22.830265 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:41:22.830265 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:41:22.830265 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:41:22.830265 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:41:22.830265 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:41:22.830265 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:41:22.830265 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:41:22.830265 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:41:22.830265 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:41:22.830265 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:41:22.830265 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:41:22.830265 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:41:22.830265 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7 could not be found. Aug 31 16:41:22.830265 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:41:22.830265 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:41:22.830265 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:41:22.835978 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:41:22.835978 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:41:22.835978 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:41:22.835978 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:41:22.835978 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:41:22.835978 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7 could not be found. Aug 31 16:41:22.835978 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:41:22.838059 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a222692a-b173-4746-aa7f-2df2fa954cbf tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Returning 404 to user: Instance abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:41:22.839134 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a222692a-b173-4746-aa7f-2df2fa954cbf tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7" status: 404 len: 111 microversion: 2.1 time: 0.258920 Aug 31 16:41:22.843560 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3182/6338] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:41:22 2022] GET /compute/v2.1/servers/abbd67b1-b1fe-4f2f-9d34-2488bbadd0d7 => generated 111 bytes in 264 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:41:23.216340 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-19277f15-ab34-4a20-ab34-713b2ea92a9a tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Action: 'create', calling method: .version_select at 0x7f5ae3b9a3a0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1745275298", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH75woOLJ1yDdICp+htrDMOlD4kgJUuARXTld50Gty21qfy1MRuNwT1/hKlhI1mT3tTRPWrKeP6fftNw4zQBejIk4pl6TAgGdzQVmpqDoEUFAkB5wA3JWf0eLlqE3XtbUg=="}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:41:23.279189 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-19277f15-ab34-4a20-ab34-713b2ea92a9a tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Getting quotas for project b5827544f2e140e3b44d712d1623a06b. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:41:23.321630 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-19277f15-ab34-4a20-ab34-713b2ea92a9a tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Getting quotas for user e026a8cdb13f47de942566a2d4a10bc8 and project b5827544f2e140e3b44d712d1623a06b. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:41:23.422839 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-19277f15-ab34-4a20-ab34-713b2ea92a9a tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.210594 Aug 31 16:41:23.424775 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3157/6339] 10.222.0.61 () {60 vars in 1159 bytes} [Wed Aug 31 16:41:23 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:41:27.643828 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-956f203a-8a9b-4483-a7e3-14680a2875fd tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-2017927823", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "networks": [{"uuid": "bc68de52-65ab-496d-847e-6df6a6866a06"}], "key_name": "tempest-TestNetworkBasicOps-1745275298", "security_groups": [{"name": "tempest-secgroup-smoke-1961556158"}]}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:41:28.229135 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-956f203a-8a9b-4483-a7e3-14680a2875fd tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] validate_networks() for [('bc68de52-65ab-496d-847e-6df6a6866a06', None, None, None, None, None)] {{(pid=122257) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:41:29.827613 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-956f203a-8a9b-4483-a7e3-14680a2875fd tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:41:29.828989 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-956f203a-8a9b-4483-a7e3-14680a2875fd tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:41:29.829490 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-956f203a-8a9b-4483-a7e3-14680a2875fd tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:41:29.829991 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-956f203a-8a9b-4483-a7e3-14680a2875fd tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:41:29.830455 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-956f203a-8a9b-4483-a7e3-14680a2875fd tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:41:29.882128 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-956f203a-8a9b-4483-a7e3-14680a2875fd tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:29.883236 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-956f203a-8a9b-4483-a7e3-14680a2875fd tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:29.883991 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-956f203a-8a9b-4483-a7e3-14680a2875fd tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:29.891539 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-956f203a-8a9b-4483-a7e3-14680a2875fd tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:29.893233 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-956f203a-8a9b-4483-a7e3-14680a2875fd tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:29.893898 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-956f203a-8a9b-4483-a7e3-14680a2875fd tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:29.968735 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-956f203a-8a9b-4483-a7e3-14680a2875fd tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Getting quotas for project b5827544f2e140e3b44d712d1623a06b. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:41:29.980875 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-956f203a-8a9b-4483-a7e3-14680a2875fd tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Getting quotas for user e026a8cdb13f47de942566a2d4a10bc8 and project b5827544f2e140e3b44d712d1623a06b. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:41:30.010403 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-956f203a-8a9b-4483-a7e3-14680a2875fd tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Going to run 1 instances... {{(pid=122257) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:41:30.025253 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-956f203a-8a9b-4483-a7e3-14680a2875fd tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] [instance: fb32933d-0171-42db-bf84-4478f79b5b84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:41:30.141517 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-956f203a-8a9b-4483-a7e3-14680a2875fd tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.502228 Aug 31 16:41:30.160896 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5610d97b-52c0-4345-9e86-626c625d7c35 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:41:30.162209 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5610d97b-52c0-4345-9e86-626c625d7c35 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] [instance: fb32933d-0171-42db-bf84-4478f79b5b84] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:41:30.165044 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:41:30.166895 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3183/6340] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:41:27 2022] POST /compute/v2.1/servers => generated 406 bytes in 2528 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:41:30.759420 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5610d97b-52c0-4345-9e86-626c625d7c35 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e026a8cdb13f47de942566a2d4a10bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5827544f2e140e3b44d712d1623a06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:41:30.771376 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5610d97b-52c0-4345-9e86-626c625d7c35 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] 10.222.0.61 "GET /compute/v2.1/servers/fb32933d-0171-42db-bf84-4478f79b5b84" status: 200 len: 1249 microversion: 2.1 time: 0.615147 Aug 31 16:41:30.789196 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3158/6341] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:41:30 2022] GET /compute/v2.1/servers/fb32933d-0171-42db-bf84-4478f79b5b84 => generated 1249 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:41:31.802072 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ab3c051d-abea-4716-8420-873188f6a1bb tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:41:31.803373 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ab3c051d-abea-4716-8420-873188f6a1bb tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] [instance: fb32933d-0171-42db-bf84-4478f79b5b84] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:41:31.841939 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:41:31.843887 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ab3c051d-abea-4716-8420-873188f6a1bb tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:31.844409 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ab3c051d-abea-4716-8420-873188f6a1bb tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:31.844857 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ab3c051d-abea-4716-8420-873188f6a1bb tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:31.849135 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ab3c051d-abea-4716-8420-873188f6a1bb tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:31.849707 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ab3c051d-abea-4716-8420-873188f6a1bb tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:31.850157 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ab3c051d-abea-4716-8420-873188f6a1bb tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:31.905312 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:41:31.995755 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ab3c051d-abea-4716-8420-873188f6a1bb tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e026a8cdb13f47de942566a2d4a10bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5827544f2e140e3b44d712d1623a06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:41:32.013785 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ab3c051d-abea-4716-8420-873188f6a1bb tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] 10.222.0.61 "GET /compute/v2.1/servers/fb32933d-0171-42db-bf84-4478f79b5b84" status: 200 len: 1301 microversion: 2.1 time: 0.211604 Aug 31 16:41:32.020282 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3184/6342] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:41:31 2022] GET /compute/v2.1/servers/fb32933d-0171-42db-bf84-4478f79b5b84 => generated 1301 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:41:33.032103 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8b0602ac-3ced-4592-8831-c2954d46e758 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:41:33.033052 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8b0602ac-3ced-4592-8831-c2954d46e758 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] [instance: fb32933d-0171-42db-bf84-4478f79b5b84] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:41:33.050041 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=57 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:41:33.053951 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8b0602ac-3ced-4592-8831-c2954d46e758 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:33.054486 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8b0602ac-3ced-4592-8831-c2954d46e758 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:33.055065 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8b0602ac-3ced-4592-8831-c2954d46e758 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:33.065668 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8b0602ac-3ced-4592-8831-c2954d46e758 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:33.066377 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8b0602ac-3ced-4592-8831-c2954d46e758 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:33.066993 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8b0602ac-3ced-4592-8831-c2954d46e758 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:33.280239 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8b0602ac-3ced-4592-8831-c2954d46e758 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e026a8cdb13f47de942566a2d4a10bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5827544f2e140e3b44d712d1623a06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:41:33.289095 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8b0602ac-3ced-4592-8831-c2954d46e758 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] 10.222.0.61 "GET /compute/v2.1/servers/fb32933d-0171-42db-bf84-4478f79b5b84" status: 200 len: 1307 microversion: 2.1 time: 0.262022 Aug 31 16:41:33.299653 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3159/6343] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:41:33 2022] GET /compute/v2.1/servers/fb32933d-0171-42db-bf84-4478f79b5b84 => generated 1307 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:41:34.322926 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-34358324-69b6-454e-999f-dd4efd479097 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:41:34.324797 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-34358324-69b6-454e-999f-dd4efd479097 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] [instance: fb32933d-0171-42db-bf84-4478f79b5b84] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:41:34.351245 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-34358324-69b6-454e-999f-dd4efd479097 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:34.353962 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-34358324-69b6-454e-999f-dd4efd479097 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:34.356481 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-34358324-69b6-454e-999f-dd4efd479097 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:34.364130 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-34358324-69b6-454e-999f-dd4efd479097 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:34.365360 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-34358324-69b6-454e-999f-dd4efd479097 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:34.368356 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-34358324-69b6-454e-999f-dd4efd479097 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:34.720984 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-34358324-69b6-454e-999f-dd4efd479097 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e026a8cdb13f47de942566a2d4a10bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5827544f2e140e3b44d712d1623a06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:41:34.734275 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-34358324-69b6-454e-999f-dd4efd479097 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] 10.222.0.61 "GET /compute/v2.1/servers/fb32933d-0171-42db-bf84-4478f79b5b84" status: 200 len: 1375 microversion: 2.1 time: 0.415854 Aug 31 16:41:34.738207 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3185/6344] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:41:34 2022] GET /compute/v2.1/servers/fb32933d-0171-42db-bf84-4478f79b5b84 => generated 1375 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:41:35.763308 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-64e4af40-0cd7-40c0-9905-6c089555cb87 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:41:35.764093 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-64e4af40-0cd7-40c0-9905-6c089555cb87 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] [instance: fb32933d-0171-42db-bf84-4478f79b5b84] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:41:35.777349 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-64e4af40-0cd7-40c0-9905-6c089555cb87 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:35.778208 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-64e4af40-0cd7-40c0-9905-6c089555cb87 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:35.779017 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-64e4af40-0cd7-40c0-9905-6c089555cb87 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:35.780251 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-64e4af40-0cd7-40c0-9905-6c089555cb87 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:35.783610 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-64e4af40-0cd7-40c0-9905-6c089555cb87 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:35.784300 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-64e4af40-0cd7-40c0-9905-6c089555cb87 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:36.227538 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-64e4af40-0cd7-40c0-9905-6c089555cb87 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e026a8cdb13f47de942566a2d4a10bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5827544f2e140e3b44d712d1623a06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:41:36.236845 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-64e4af40-0cd7-40c0-9905-6c089555cb87 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] 10.222.0.61 "GET /compute/v2.1/servers/fb32933d-0171-42db-bf84-4478f79b5b84" status: 200 len: 1375 microversion: 2.1 time: 0.477660 Aug 31 16:41:36.240909 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3160/6345] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:41:35 2022] GET /compute/v2.1/servers/fb32933d-0171-42db-bf84-4478f79b5b84 => generated 1375 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:41:36.538649 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-907bd615-67f9-4ebf-a6df-f62acab4f740 req-0428bfa6-d27d-470e-803c-daba8869b86f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb32933d-0171-42db-bf84-4478f79b5b84", "tag": "6f483704-a7fd-4e73-97f9-fa2a4522894b"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:41:36.563319 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-907bd615-67f9-4ebf-a6df-f62acab4f740 req-0428bfa6-d27d-470e-803c-daba8869b86f service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:36.572156 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-907bd615-67f9-4ebf-a6df-f62acab4f740 req-0428bfa6-d27d-470e-803c-daba8869b86f service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:36.572746 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-907bd615-67f9-4ebf-a6df-f62acab4f740 req-0428bfa6-d27d-470e-803c-daba8869b86f service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:36.616563 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-907bd615-67f9-4ebf-a6df-f62acab4f740 req-0428bfa6-d27d-470e-803c-daba8869b86f service nova] Creating event network-changed:6f483704-a7fd-4e73-97f9-fa2a4522894b for instance fb32933d-0171-42db-bf84-4478f79b5b84 on n-h1-850499-9 Aug 31 16:41:36.619097 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-907bd615-67f9-4ebf-a6df-f62acab4f740 req-0428bfa6-d27d-470e-803c-daba8869b86f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084216 Aug 31 16:41:36.620030 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3186/6346] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:41:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:41:36.908432 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1770ad74-2371-41c9-a66b-fbfb342ffcca tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1565786211", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "cc0458ec-e440-4bd2-896f-bf9eca6b4ffc", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0b707539-6131-412e-ba43-5bdd2cb0fbe5"}]}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:41:37.031426 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-1770ad74-2371-41c9-a66b-fbfb342ffcca tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] validate_networks() for [('0b707539-6131-412e-ba43-5bdd2cb0fbe5', None, None, None, None, None)] {{(pid=122256) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:41:37.263138 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b2269823-e6f6-4cee-b8e2-35bec1916a76 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:41:37.264270 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b2269823-e6f6-4cee-b8e2-35bec1916a76 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] [instance: fb32933d-0171-42db-bf84-4478f79b5b84] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:41:37.275194 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b2269823-e6f6-4cee-b8e2-35bec1916a76 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:37.275833 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b2269823-e6f6-4cee-b8e2-35bec1916a76 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:37.276503 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b2269823-e6f6-4cee-b8e2-35bec1916a76 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:37.277604 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b2269823-e6f6-4cee-b8e2-35bec1916a76 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:37.278268 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b2269823-e6f6-4cee-b8e2-35bec1916a76 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:37.278898 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b2269823-e6f6-4cee-b8e2-35bec1916a76 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:38.193289 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-1770ad74-2371-41c9-a66b-fbfb342ffcca tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:41:38.193984 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-1770ad74-2371-41c9-a66b-fbfb342ffcca tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:41:38.195461 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-1770ad74-2371-41c9-a66b-fbfb342ffcca tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:41:38.196447 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-1770ad74-2371-41c9-a66b-fbfb342ffcca tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:41:38.197439 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-1770ad74-2371-41c9-a66b-fbfb342ffcca tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:41:38.231634 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b2269823-e6f6-4cee-b8e2-35bec1916a76 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e026a8cdb13f47de942566a2d4a10bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5827544f2e140e3b44d712d1623a06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:41:38.232175 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1770ad74-2371-41c9-a66b-fbfb342ffcca tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:38.236521 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1770ad74-2371-41c9-a66b-fbfb342ffcca tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:38.237580 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1770ad74-2371-41c9-a66b-fbfb342ffcca tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:38.239168 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1770ad74-2371-41c9-a66b-fbfb342ffcca tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:38.244285 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1770ad74-2371-41c9-a66b-fbfb342ffcca tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:38.244751 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b2269823-e6f6-4cee-b8e2-35bec1916a76 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] 10.222.0.61 "GET /compute/v2.1/servers/fb32933d-0171-42db-bf84-4478f79b5b84" status: 200 len: 1375 microversion: 2.1 time: 0.985915 Aug 31 16:41:38.245542 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1770ad74-2371-41c9-a66b-fbfb342ffcca tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:38.260007 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3187/6347] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:41:37 2022] GET /compute/v2.1/servers/fb32933d-0171-42db-bf84-4478f79b5b84 => generated 1375 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:41:38.292616 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-1770ad74-2371-41c9-a66b-fbfb342ffcca tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Getting quotas for project 798d7eff58b04ab582bac1e87112625f. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:41:38.315369 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-1770ad74-2371-41c9-a66b-fbfb342ffcca tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Getting quotas for user 588d2ef08d8345a6b6175c8287633270 and project 798d7eff58b04ab582bac1e87112625f. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:41:38.440632 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1770ad74-2371-41c9-a66b-fbfb342ffcca tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Going to run 1 instances... {{(pid=122256) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:41:38.445262 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1770ad74-2371-41c9-a66b-fbfb342ffcca tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 4bc0d2c9-2a44-4f65-a780-d7ba828cea3a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cc0458ec-e440-4bd2-896f-bf9eca6b4ffc',volume_size=None,volume_type=None)] {{(pid=122256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:41:38.722772 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1770ad74-2371-41c9-a66b-fbfb342ffcca tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.826992 Aug 31 16:41:38.734717 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-88daf051-9acb-4967-bc73-a735175b8eed tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:41:38.735432 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-88daf051-9acb-4967-bc73-a735175b8eed tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 4bc0d2c9-2a44-4f65-a780-d7ba828cea3a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:41:38.749215 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3161/6348] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:41:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1853 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:41:39.216554 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-026f6dfb-4ffc-4256-b390-966d7d3fecc6 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Action: 'create', calling method: .version_select at 0x7f5ae3d21ee0>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-1617523581", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBcsRM40aCmNmFrBf8piSGxV08O+iYiBmwQD6QcF5T4s7Kuh/3egm9WrGj7AZ15abkAZS3mE6xlsIVIDBMn/nWWhIybL8HLXCjuvN1D4Pso55Ec0W+0IIKL5cjd1B5h/eQ=="}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:41:39.271263 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-026f6dfb-4ffc-4256-b390-966d7d3fecc6 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Getting quotas for project 5a56640b635e400694f60d00a5f922e7. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:41:39.290376 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-026f6dfb-4ffc-4256-b390-966d7d3fecc6 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Getting quotas for user fdb78657f161443083d53a3b29fb4406 and project 5a56640b635e400694f60d00a5f922e7. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:41:39.361996 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-026f6dfb-4ffc-4256-b390-966d7d3fecc6 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.149102 Aug 31 16:41:39.371892 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3162/6349] 10.222.0.61 () {60 vars in 1159 bytes} [Wed Aug 31 16:41:39 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:41:39.384837 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-becd1077-cfda-410a-9108-987389b9894c tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:41:39.385848 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-becd1077-cfda-410a-9108-987389b9894c tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] [instance: fb32933d-0171-42db-bf84-4478f79b5b84] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:41:39.404924 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-becd1077-cfda-410a-9108-987389b9894c tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:39.407788 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-becd1077-cfda-410a-9108-987389b9894c tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:39.409443 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-becd1077-cfda-410a-9108-987389b9894c tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:39.411379 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-becd1077-cfda-410a-9108-987389b9894c tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:39.412667 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-becd1077-cfda-410a-9108-987389b9894c tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:39.415517 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-becd1077-cfda-410a-9108-987389b9894c tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:39.629201 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-88daf051-9acb-4967-bc73-a735175b8eed tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:41:39.652326 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-88daf051-9acb-4967-bc73-a735175b8eed tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/4bc0d2c9-2a44-4f65-a780-d7ba828cea3a" status: 200 len: 1057 microversion: 2.1 time: 0.921005 Aug 31 16:41:39.672465 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3188/6350] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:41:38 2022] GET /compute/v2.1/servers/4bc0d2c9-2a44-4f65-a780-d7ba828cea3a => generated 1057 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:41:39.861531 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-becd1077-cfda-410a-9108-987389b9894c tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e026a8cdb13f47de942566a2d4a10bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5827544f2e140e3b44d712d1623a06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:41:39.872635 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-becd1077-cfda-410a-9108-987389b9894c tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] 10.222.0.61 "GET /compute/v2.1/servers/fb32933d-0171-42db-bf84-4478f79b5b84" status: 200 len: 1375 microversion: 2.1 time: 0.499579 Aug 31 16:41:39.876549 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3163/6351] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:41:39 2022] GET /compute/v2.1/servers/fb32933d-0171-42db-bf84-4478f79b5b84 => generated 1375 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:41:40.689154 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6ad601f4-4688-4ba6-b5c9-3a964f8fdc4b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:41:40.690610 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6ad601f4-4688-4ba6-b5c9-3a964f8fdc4b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 4bc0d2c9-2a44-4f65-a780-d7ba828cea3a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:41:40.693920 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:41:40.725297 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6ad601f4-4688-4ba6-b5c9-3a964f8fdc4b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:40.729605 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6ad601f4-4688-4ba6-b5c9-3a964f8fdc4b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:40.731696 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6ad601f4-4688-4ba6-b5c9-3a964f8fdc4b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:40.738145 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6ad601f4-4688-4ba6-b5c9-3a964f8fdc4b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:40.740983 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6ad601f4-4688-4ba6-b5c9-3a964f8fdc4b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:40.743129 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6ad601f4-4688-4ba6-b5c9-3a964f8fdc4b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:40.887359 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-6ad601f4-4688-4ba6-b5c9-3a964f8fdc4b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:41:40.901410 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6a39543b-d3cb-4ba2-b833-401bcb926478 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:41:40.902168 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6a39543b-d3cb-4ba2-b833-401bcb926478 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] [instance: fb32933d-0171-42db-bf84-4478f79b5b84] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:41:40.902814 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6ad601f4-4688-4ba6-b5c9-3a964f8fdc4b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/4bc0d2c9-2a44-4f65-a780-d7ba828cea3a" status: 200 len: 1163 microversion: 2.1 time: 0.222610 Aug 31 16:41:40.906266 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3189/6352] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:41:40 2022] GET /compute/v2.1/servers/4bc0d2c9-2a44-4f65-a780-d7ba828cea3a => generated 1163 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:41:40.921896 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6a39543b-d3cb-4ba2-b833-401bcb926478 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:40.922413 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6a39543b-d3cb-4ba2-b833-401bcb926478 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:40.924841 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6a39543b-d3cb-4ba2-b833-401bcb926478 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:40.933023 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6a39543b-d3cb-4ba2-b833-401bcb926478 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:40.933570 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6a39543b-d3cb-4ba2-b833-401bcb926478 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:40.938707 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6a39543b-d3cb-4ba2-b833-401bcb926478 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:41.397597 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-6a39543b-d3cb-4ba2-b833-401bcb926478 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e026a8cdb13f47de942566a2d4a10bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5827544f2e140e3b44d712d1623a06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:41:41.410005 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6a39543b-d3cb-4ba2-b833-401bcb926478 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] 10.222.0.61 "GET /compute/v2.1/servers/fb32933d-0171-42db-bf84-4478f79b5b84" status: 200 len: 1375 microversion: 2.1 time: 0.513515 Aug 31 16:41:41.424516 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3164/6353] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:41:40 2022] GET /compute/v2.1/servers/fb32933d-0171-42db-bf84-4478f79b5b84 => generated 1375 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:41:41.932303 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f76fee03-774d-401c-bd40-cea8e3ee31b5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:41:41.934196 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f76fee03-774d-401c-bd40-cea8e3ee31b5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 4bc0d2c9-2a44-4f65-a780-d7ba828cea3a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:41:41.971382 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f76fee03-774d-401c-bd40-cea8e3ee31b5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:41.977465 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f76fee03-774d-401c-bd40-cea8e3ee31b5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:41.982027 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f76fee03-774d-401c-bd40-cea8e3ee31b5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:41.985260 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f76fee03-774d-401c-bd40-cea8e3ee31b5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:41.990640 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f76fee03-774d-401c-bd40-cea8e3ee31b5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:41.992829 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f76fee03-774d-401c-bd40-cea8e3ee31b5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:42.341134 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f76fee03-774d-401c-bd40-cea8e3ee31b5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:41:42.359879 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f76fee03-774d-401c-bd40-cea8e3ee31b5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/4bc0d2c9-2a44-4f65-a780-d7ba828cea3a" status: 200 len: 1173 microversion: 2.1 time: 0.432663 Aug 31 16:41:42.364541 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3190/6354] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:41:41 2022] GET /compute/v2.1/servers/4bc0d2c9-2a44-4f65-a780-d7ba828cea3a => generated 1173 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:41:42.441463 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e5a91623-5515-4a55-afef-a2227bf90fbe tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:41:42.442143 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e5a91623-5515-4a55-afef-a2227bf90fbe tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] [instance: fb32933d-0171-42db-bf84-4478f79b5b84] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:41:42.465073 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e5a91623-5515-4a55-afef-a2227bf90fbe tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:42.465836 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e5a91623-5515-4a55-afef-a2227bf90fbe tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:42.466499 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e5a91623-5515-4a55-afef-a2227bf90fbe tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:42.467455 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e5a91623-5515-4a55-afef-a2227bf90fbe tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:42.472316 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e5a91623-5515-4a55-afef-a2227bf90fbe tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:42.473070 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e5a91623-5515-4a55-afef-a2227bf90fbe tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:43.099877 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6a8c348e-d27c-4fe7-8dd1-25df23189562 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-167444643", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "6f07bc1c-aaba-4c4c-b2fc-9ef0adeb326f", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-1617523581", "security_groups": [{"name": "tempest-secgroup-smoke-1492762862"}], "networks": [{"uuid": "e5f6136f-dd0c-485d-956e-8e57140b533e"}]}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:41:43.525685 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e5a91623-5515-4a55-afef-a2227bf90fbe tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e026a8cdb13f47de942566a2d4a10bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5827544f2e140e3b44d712d1623a06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:41:43.538951 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e5a91623-5515-4a55-afef-a2227bf90fbe tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] 10.222.0.61 "GET /compute/v2.1/servers/fb32933d-0171-42db-bf84-4478f79b5b84" status: 200 len: 1375 microversion: 2.1 time: 1.103755 Aug 31 16:41:43.540527 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3165/6355] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:41:42 2022] GET /compute/v2.1/servers/fb32933d-0171-42db-bf84-4478f79b5b84 => generated 1375 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:41:43.554087 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-74aa4993-11a5-43d2-bb5e-f9d7eba54350 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:41:43.555139 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-74aa4993-11a5-43d2-bb5e-f9d7eba54350 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 4bc0d2c9-2a44-4f65-a780-d7ba828cea3a] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:41:43.567804 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-74aa4993-11a5-43d2-bb5e-f9d7eba54350 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:43.572324 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-74aa4993-11a5-43d2-bb5e-f9d7eba54350 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:43.575354 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-74aa4993-11a5-43d2-bb5e-f9d7eba54350 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:43.576153 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-74aa4993-11a5-43d2-bb5e-f9d7eba54350 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:43.576632 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-74aa4993-11a5-43d2-bb5e-f9d7eba54350 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:43.579247 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-74aa4993-11a5-43d2-bb5e-f9d7eba54350 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:43.611857 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-6a8c348e-d27c-4fe7-8dd1-25df23189562 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] validate_networks() for [('e5f6136f-dd0c-485d-956e-8e57140b533e', None, None, None, None, None)] {{(pid=122257) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:41:43.702676 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-74aa4993-11a5-43d2-bb5e-f9d7eba54350 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:41:43.715750 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-74aa4993-11a5-43d2-bb5e-f9d7eba54350 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/4bc0d2c9-2a44-4f65-a780-d7ba828cea3a" status: 200 len: 1173 microversion: 2.1 time: 0.166804 Aug 31 16:41:43.716794 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3166/6356] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:41:43 2022] GET /compute/v2.1/servers/4bc0d2c9-2a44-4f65-a780-d7ba828cea3a => generated 1173 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:41:44.570522 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-914f81d5-c9ff-4a40-8282-61cc45203357 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:41:44.574183 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-914f81d5-c9ff-4a40-8282-61cc45203357 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] [instance: fb32933d-0171-42db-bf84-4478f79b5b84] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:41:44.606251 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-914f81d5-c9ff-4a40-8282-61cc45203357 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:44.620628 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-914f81d5-c9ff-4a40-8282-61cc45203357 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:44.622475 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-914f81d5-c9ff-4a40-8282-61cc45203357 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:44.623481 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-914f81d5-c9ff-4a40-8282-61cc45203357 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:44.636361 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-914f81d5-c9ff-4a40-8282-61cc45203357 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:44.640840 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-914f81d5-c9ff-4a40-8282-61cc45203357 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:45.063794 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-914f81d5-c9ff-4a40-8282-61cc45203357 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e026a8cdb13f47de942566a2d4a10bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5827544f2e140e3b44d712d1623a06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:41:45.080628 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-914f81d5-c9ff-4a40-8282-61cc45203357 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] 10.222.0.61 "GET /compute/v2.1/servers/fb32933d-0171-42db-bf84-4478f79b5b84" status: 200 len: 1375 microversion: 2.1 time: 0.517561 Aug 31 16:41:45.096980 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3167/6357] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:41:44 2022] GET /compute/v2.1/servers/fb32933d-0171-42db-bf84-4478f79b5b84 => generated 1375 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:41:45.103258 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-722fad6f-66e6-4ba4-9c47-3a50b492b531 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:41:45.109825 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-722fad6f-66e6-4ba4-9c47-3a50b492b531 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 4bc0d2c9-2a44-4f65-a780-d7ba828cea3a] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:41:45.127226 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-722fad6f-66e6-4ba4-9c47-3a50b492b531 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:45.128005 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-722fad6f-66e6-4ba4-9c47-3a50b492b531 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:45.128683 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-722fad6f-66e6-4ba4-9c47-3a50b492b531 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:45.130109 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-722fad6f-66e6-4ba4-9c47-3a50b492b531 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:45.132920 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-722fad6f-66e6-4ba4-9c47-3a50b492b531 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:45.135016 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-722fad6f-66e6-4ba4-9c47-3a50b492b531 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:45.152562 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-6a8c348e-d27c-4fe7-8dd1-25df23189562 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:41:45.153053 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-6a8c348e-d27c-4fe7-8dd1-25df23189562 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:41:45.153466 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-6a8c348e-d27c-4fe7-8dd1-25df23189562 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:41:45.154682 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-6a8c348e-d27c-4fe7-8dd1-25df23189562 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:41:45.155118 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-6a8c348e-d27c-4fe7-8dd1-25df23189562 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:41:45.178404 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6a8c348e-d27c-4fe7-8dd1-25df23189562 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:45.184327 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6a8c348e-d27c-4fe7-8dd1-25df23189562 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:45.186560 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6a8c348e-d27c-4fe7-8dd1-25df23189562 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:45.188519 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6a8c348e-d27c-4fe7-8dd1-25df23189562 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:45.193430 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6a8c348e-d27c-4fe7-8dd1-25df23189562 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:45.196662 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6a8c348e-d27c-4fe7-8dd1-25df23189562 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:45.274540 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-6a8c348e-d27c-4fe7-8dd1-25df23189562 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Getting quotas for project 5a56640b635e400694f60d00a5f922e7. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:41:45.291472 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-6a8c348e-d27c-4fe7-8dd1-25df23189562 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Getting quotas for user fdb78657f161443083d53a3b29fb4406 and project 5a56640b635e400694f60d00a5f922e7. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:41:45.415328 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6a8c348e-d27c-4fe7-8dd1-25df23189562 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Going to run 1 instances... {{(pid=122257) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:41:45.417489 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6a8c348e-d27c-4fe7-8dd1-25df23189562 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] [instance: 98964e5a-9c6a-4be8-af79-95db246ebcc4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6f07bc1c-aaba-4c4c-b2fc-9ef0adeb326f',volume_size=None,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:41:45.679522 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6a8c348e-d27c-4fe7-8dd1-25df23189562 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.584017 Aug 31 16:41:45.680791 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3191/6358] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:41:43 2022] POST /compute/v2.1/servers => generated 406 bytes in 2586 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:41:45.691185 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a0f7c7f8-2d00-4163-9a10-17b5a6b60122 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:41:45.692114 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a0f7c7f8-2d00-4163-9a10-17b5a6b60122 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] [instance: 98964e5a-9c6a-4be8-af79-95db246ebcc4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:41:46.109128 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a0f7c7f8-2d00-4163-9a10-17b5a6b60122 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb78657f161443083d53a3b29fb4406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a56640b635e400694f60d00a5f922e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:41:46.148542 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a0f7c7f8-2d00-4163-9a10-17b5a6b60122 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] 10.222.0.61 "GET /compute/v2.1/servers/98964e5a-9c6a-4be8-af79-95db246ebcc4" status: 200 len: 1098 microversion: 2.1 time: 0.436462 Aug 31 16:41:46.153287 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3192/6359] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:41:45 2022] GET /compute/v2.1/servers/98964e5a-9c6a-4be8-af79-95db246ebcc4 => generated 1098 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:41:46.185662 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-50cb0faa-5da6-4e35-992f-2ec8dc8ad61d req-53d90c6a-c468-4e5e-8a41-24c063c367a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb32933d-0171-42db-bf84-4478f79b5b84", "name": "network-vif-plugged", "status": "completed", "tag": "6f483704-a7fd-4e73-97f9-fa2a4522894b"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:41:46.256348 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-50cb0faa-5da6-4e35-992f-2ec8dc8ad61d req-53d90c6a-c468-4e5e-8a41-24c063c367a0 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:46.281811 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-50cb0faa-5da6-4e35-992f-2ec8dc8ad61d req-53d90c6a-c468-4e5e-8a41-24c063c367a0 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:46.284368 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-50cb0faa-5da6-4e35-992f-2ec8dc8ad61d req-53d90c6a-c468-4e5e-8a41-24c063c367a0 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:46.324582 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-50cb0faa-5da6-4e35-992f-2ec8dc8ad61d req-53d90c6a-c468-4e5e-8a41-24c063c367a0 service nova] Creating event network-vif-plugged:6f483704-a7fd-4e73-97f9-fa2a4522894b for instance fb32933d-0171-42db-bf84-4478f79b5b84 on n-h1-850499-9 Aug 31 16:41:46.340198 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-50cb0faa-5da6-4e35-992f-2ec8dc8ad61d req-53d90c6a-c468-4e5e-8a41-24c063c367a0 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.185388 Aug 31 16:41:46.343648 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3193/6360] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:41:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:41:46.373056 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b0a395bb-633f-403f-913c-a190318debf3 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:41:46.375773 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b0a395bb-633f-403f-913c-a190318debf3 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] [instance: fb32933d-0171-42db-bf84-4478f79b5b84] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:41:46.417942 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b0a395bb-633f-403f-913c-a190318debf3 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:46.421275 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b0a395bb-633f-403f-913c-a190318debf3 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:46.425214 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b0a395bb-633f-403f-913c-a190318debf3 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:46.428998 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b0a395bb-633f-403f-913c-a190318debf3 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:46.444097 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b0a395bb-633f-403f-913c-a190318debf3 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:46.452645 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b0a395bb-633f-403f-913c-a190318debf3 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:46.812220 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-722fad6f-66e6-4ba4-9c47-3a50b492b531 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:41:46.844916 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-722fad6f-66e6-4ba4-9c47-3a50b492b531 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/4bc0d2c9-2a44-4f65-a780-d7ba828cea3a" status: 200 len: 1215 microversion: 2.1 time: 1.746347 Aug 31 16:41:46.847852 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3168/6361] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:41:45 2022] GET /compute/v2.1/servers/4bc0d2c9-2a44-4f65-a780-d7ba828cea3a => generated 1215 bytes in 1750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:41:47.119616 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-e67a417e-4244-402f-93a4-cef73a6d318d req-585fc0b4-fea8-4503-91c9-7a578f747b7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4bc0d2c9-2a44-4f65-a780-d7ba828cea3a", "tag": "08232de5-98ba-470b-afde-6772fc90c184"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:41:47.120395 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b0a395bb-633f-403f-913c-a190318debf3 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e026a8cdb13f47de942566a2d4a10bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5827544f2e140e3b44d712d1623a06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:41:47.129912 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b0a395bb-633f-403f-913c-a190318debf3 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] 10.222.0.61 "GET /compute/v2.1/servers/fb32933d-0171-42db-bf84-4478f79b5b84" status: 200 len: 1375 microversion: 2.1 time: 0.784136 Aug 31 16:41:47.130946 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3194/6362] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:41:46 2022] GET /compute/v2.1/servers/fb32933d-0171-42db-bf84-4478f79b5b84 => generated 1375 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:41:47.152780 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-e67a417e-4244-402f-93a4-cef73a6d318d req-585fc0b4-fea8-4503-91c9-7a578f747b7a service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:47.154020 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-e67a417e-4244-402f-93a4-cef73a6d318d req-585fc0b4-fea8-4503-91c9-7a578f747b7a service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:47.154624 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-e67a417e-4244-402f-93a4-cef73a6d318d req-585fc0b4-fea8-4503-91c9-7a578f747b7a service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:47.178302 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-556ab29a-8408-4d7a-a72f-a80843dbd393 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:41:47.182026 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-e67a417e-4244-402f-93a4-cef73a6d318d req-585fc0b4-fea8-4503-91c9-7a578f747b7a service nova] Creating event network-changed:08232de5-98ba-470b-afde-6772fc90c184 for instance 4bc0d2c9-2a44-4f65-a780-d7ba828cea3a on n-h2-850499-9 Aug 31 16:41:47.182314 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-556ab29a-8408-4d7a-a72f-a80843dbd393 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] [instance: 98964e5a-9c6a-4be8-af79-95db246ebcc4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:41:47.201484 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-556ab29a-8408-4d7a-a72f-a80843dbd393 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:47.209818 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-556ab29a-8408-4d7a-a72f-a80843dbd393 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:47.210872 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-e67a417e-4244-402f-93a4-cef73a6d318d req-585fc0b4-fea8-4503-91c9-7a578f747b7a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095168 Aug 31 16:41:47.216659 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3169/6363] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:41:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:41:47.221316 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-556ab29a-8408-4d7a-a72f-a80843dbd393 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:47.222093 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-556ab29a-8408-4d7a-a72f-a80843dbd393 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:47.222574 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-556ab29a-8408-4d7a-a72f-a80843dbd393 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:47.223014 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-556ab29a-8408-4d7a-a72f-a80843dbd393 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:47.372816 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-556ab29a-8408-4d7a-a72f-a80843dbd393 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb78657f161443083d53a3b29fb4406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a56640b635e400694f60d00a5f922e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:41:47.399237 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-556ab29a-8408-4d7a-a72f-a80843dbd393 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] 10.222.0.61 "GET /compute/v2.1/servers/98964e5a-9c6a-4be8-af79-95db246ebcc4" status: 200 len: 1148 microversion: 2.1 time: 0.219111 Aug 31 16:41:47.400604 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3195/6364] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:41:47 2022] GET /compute/v2.1/servers/98964e5a-9c6a-4be8-af79-95db246ebcc4 => generated 1148 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:41:47.892625 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d8e6af52-485b-4389-b176-b1bd56724a61 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:41:47.893347 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d8e6af52-485b-4389-b176-b1bd56724a61 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 4bc0d2c9-2a44-4f65-a780-d7ba828cea3a] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:41:47.905852 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d8e6af52-485b-4389-b176-b1bd56724a61 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:47.908035 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d8e6af52-485b-4389-b176-b1bd56724a61 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:47.908853 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d8e6af52-485b-4389-b176-b1bd56724a61 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:47.909643 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d8e6af52-485b-4389-b176-b1bd56724a61 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:47.910121 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d8e6af52-485b-4389-b176-b1bd56724a61 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:47.910560 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d8e6af52-485b-4389-b176-b1bd56724a61 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:48.145340 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d8e6af52-485b-4389-b176-b1bd56724a61 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:41:48.156027 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d8e6af52-485b-4389-b176-b1bd56724a61 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/4bc0d2c9-2a44-4f65-a780-d7ba828cea3a" status: 200 len: 1215 microversion: 2.1 time: 0.267705 Aug 31 16:41:48.156627 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3170/6365] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:41:47 2022] GET /compute/v2.1/servers/4bc0d2c9-2a44-4f65-a780-d7ba828cea3a => generated 1215 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:41:48.169333 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-84eac976-38d5-456c-9b3a-d47dc06445b7 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:41:48.170747 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-84eac976-38d5-456c-9b3a-d47dc06445b7 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] [instance: fb32933d-0171-42db-bf84-4478f79b5b84] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:41:48.183336 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-84eac976-38d5-456c-9b3a-d47dc06445b7 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:48.184726 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-84eac976-38d5-456c-9b3a-d47dc06445b7 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:48.185409 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-84eac976-38d5-456c-9b3a-d47dc06445b7 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:48.186385 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-84eac976-38d5-456c-9b3a-d47dc06445b7 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:48.187079 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-84eac976-38d5-456c-9b3a-d47dc06445b7 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:48.191787 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-84eac976-38d5-456c-9b3a-d47dc06445b7 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:48.435982 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-67ea38a1-89a9-4635-a272-7f7b0e5ef0bd tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:41:48.436793 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-67ea38a1-89a9-4635-a272-7f7b0e5ef0bd tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] [instance: 98964e5a-9c6a-4be8-af79-95db246ebcc4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:41:48.462298 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:41:48.464800 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-67ea38a1-89a9-4635-a272-7f7b0e5ef0bd tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:48.466315 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-67ea38a1-89a9-4635-a272-7f7b0e5ef0bd tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:48.467699 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-67ea38a1-89a9-4635-a272-7f7b0e5ef0bd tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:48.469024 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-67ea38a1-89a9-4635-a272-7f7b0e5ef0bd tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:48.469625 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-67ea38a1-89a9-4635-a272-7f7b0e5ef0bd tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:48.470147 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-67ea38a1-89a9-4635-a272-7f7b0e5ef0bd tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:48.630609 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-67ea38a1-89a9-4635-a272-7f7b0e5ef0bd tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb78657f161443083d53a3b29fb4406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a56640b635e400694f60d00a5f922e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:41:48.635462 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-84eac976-38d5-456c-9b3a-d47dc06445b7 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e026a8cdb13f47de942566a2d4a10bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5827544f2e140e3b44d712d1623a06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:41:48.644832 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-84eac976-38d5-456c-9b3a-d47dc06445b7 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] 10.222.0.61 "GET /compute/v2.1/servers/fb32933d-0171-42db-bf84-4478f79b5b84" status: 200 len: 1375 microversion: 2.1 time: 0.479545 Aug 31 16:41:48.646458 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-67ea38a1-89a9-4635-a272-7f7b0e5ef0bd tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] 10.222.0.61 "GET /compute/v2.1/servers/98964e5a-9c6a-4be8-af79-95db246ebcc4" status: 200 len: 1196 microversion: 2.1 time: 0.215569 Aug 31 16:41:48.665022 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3171/6366] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:41:48 2022] GET /compute/v2.1/servers/98964e5a-9c6a-4be8-af79-95db246ebcc4 => generated 1196 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:41:48.665684 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3196/6367] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:41:48 2022] GET /compute/v2.1/servers/fb32933d-0171-42db-bf84-4478f79b5b84 => generated 1375 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:41:49.177484 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9026a72d-cd43-41a8-97d2-e2302166b2fd tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:41:49.178114 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9026a72d-cd43-41a8-97d2-e2302166b2fd tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 4bc0d2c9-2a44-4f65-a780-d7ba828cea3a] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:41:49.194333 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9026a72d-cd43-41a8-97d2-e2302166b2fd tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:49.194880 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9026a72d-cd43-41a8-97d2-e2302166b2fd tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:49.196117 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9026a72d-cd43-41a8-97d2-e2302166b2fd tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:49.197097 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9026a72d-cd43-41a8-97d2-e2302166b2fd tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:49.197589 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9026a72d-cd43-41a8-97d2-e2302166b2fd tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:49.198029 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9026a72d-cd43-41a8-97d2-e2302166b2fd tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:49.310381 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=16 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:41:49.616768 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-9026a72d-cd43-41a8-97d2-e2302166b2fd tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:41:49.636936 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9026a72d-cd43-41a8-97d2-e2302166b2fd tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/4bc0d2c9-2a44-4f65-a780-d7ba828cea3a" status: 200 len: 1215 microversion: 2.1 time: 0.463555 Aug 31 16:41:49.639104 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3172/6368] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:41:49 2022] GET /compute/v2.1/servers/4bc0d2c9-2a44-4f65-a780-d7ba828cea3a => generated 1215 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:41:49.671469 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9bdd17e1-ba02-4b7f-be43-6f7cce23c86c tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:41:49.672130 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9bdd17e1-ba02-4b7f-be43-6f7cce23c86c tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] [instance: 98964e5a-9c6a-4be8-af79-95db246ebcc4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:41:49.674493 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1fc5d898-8fef-4388-9adb-7f798a2873f8 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:41:49.676493 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1fc5d898-8fef-4388-9adb-7f798a2873f8 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] [instance: fb32933d-0171-42db-bf84-4478f79b5b84] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:41:49.684422 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9bdd17e1-ba02-4b7f-be43-6f7cce23c86c tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:49.684926 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9bdd17e1-ba02-4b7f-be43-6f7cce23c86c tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:49.685369 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9bdd17e1-ba02-4b7f-be43-6f7cce23c86c tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:49.686089 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9bdd17e1-ba02-4b7f-be43-6f7cce23c86c tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:49.686472 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1fc5d898-8fef-4388-9adb-7f798a2873f8 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:49.686588 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9bdd17e1-ba02-4b7f-be43-6f7cce23c86c tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:49.686963 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9bdd17e1-ba02-4b7f-be43-6f7cce23c86c tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:49.688715 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1fc5d898-8fef-4388-9adb-7f798a2873f8 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:49.689466 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1fc5d898-8fef-4388-9adb-7f798a2873f8 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:49.690579 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1fc5d898-8fef-4388-9adb-7f798a2873f8 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:49.691345 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1fc5d898-8fef-4388-9adb-7f798a2873f8 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:49.692042 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1fc5d898-8fef-4388-9adb-7f798a2873f8 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:49.786662 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9bdd17e1-ba02-4b7f-be43-6f7cce23c86c tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb78657f161443083d53a3b29fb4406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a56640b635e400694f60d00a5f922e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:41:49.801163 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9bdd17e1-ba02-4b7f-be43-6f7cce23c86c tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] 10.222.0.61 "GET /compute/v2.1/servers/98964e5a-9c6a-4be8-af79-95db246ebcc4" status: 200 len: 1214 microversion: 2.1 time: 0.134821 Aug 31 16:41:49.802421 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3197/6369] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:41:49 2022] GET /compute/v2.1/servers/98964e5a-9c6a-4be8-af79-95db246ebcc4 => generated 1214 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:41:49.970796 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1fc5d898-8fef-4388-9adb-7f798a2873f8 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e026a8cdb13f47de942566a2d4a10bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5827544f2e140e3b44d712d1623a06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:41:49.980865 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1fc5d898-8fef-4388-9adb-7f798a2873f8 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] 10.222.0.61 "GET /compute/v2.1/servers/fb32933d-0171-42db-bf84-4478f79b5b84" status: 200 len: 1548 microversion: 2.1 time: 0.311698 Aug 31 16:41:49.996170 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3173/6370] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:41:49 2022] GET /compute/v2.1/servers/fb32933d-0171-42db-bf84-4478f79b5b84 => generated 1548 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:41:50.003202 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3175c97c-bcd7-4897-8000-3cd1c0baf40e tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:41:50.004140 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3175c97c-bcd7-4897-8000-3cd1c0baf40e tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] [instance: fb32933d-0171-42db-bf84-4478f79b5b84] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:41:50.011892 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3175c97c-bcd7-4897-8000-3cd1c0baf40e tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:50.012623 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3175c97c-bcd7-4897-8000-3cd1c0baf40e tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:50.013234 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3175c97c-bcd7-4897-8000-3cd1c0baf40e tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:50.014117 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3175c97c-bcd7-4897-8000-3cd1c0baf40e tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:50.014769 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3175c97c-bcd7-4897-8000-3cd1c0baf40e tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:50.015361 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3175c97c-bcd7-4897-8000-3cd1c0baf40e tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:50.222717 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3175c97c-bcd7-4897-8000-3cd1c0baf40e tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e026a8cdb13f47de942566a2d4a10bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5827544f2e140e3b44d712d1623a06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:41:50.235621 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3175c97c-bcd7-4897-8000-3cd1c0baf40e tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] 10.222.0.61 "GET /compute/v2.1/servers/fb32933d-0171-42db-bf84-4478f79b5b84" status: 200 len: 1548 microversion: 2.1 time: 0.236790 Aug 31 16:41:50.237299 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3198/6371] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:41:49 2022] GET /compute/v2.1/servers/fb32933d-0171-42db-bf84-4478f79b5b84 => generated 1548 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:41:50.658580 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-34b7b87f-b529-452d-9bcb-04c27b8f6811 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:41:50.659934 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-34b7b87f-b529-452d-9bcb-04c27b8f6811 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 4bc0d2c9-2a44-4f65-a780-d7ba828cea3a] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:41:50.670217 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-34b7b87f-b529-452d-9bcb-04c27b8f6811 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:50.670954 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-34b7b87f-b529-452d-9bcb-04c27b8f6811 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:50.671840 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-34b7b87f-b529-452d-9bcb-04c27b8f6811 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:50.672719 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-34b7b87f-b529-452d-9bcb-04c27b8f6811 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:50.673336 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-34b7b87f-b529-452d-9bcb-04c27b8f6811 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:50.673932 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-34b7b87f-b529-452d-9bcb-04c27b8f6811 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:50.824310 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-caaa944c-44af-49c5-b788-6a75dfed4ddc tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:41:50.825005 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-caaa944c-44af-49c5-b788-6a75dfed4ddc tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] [instance: 98964e5a-9c6a-4be8-af79-95db246ebcc4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:41:50.832463 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-caaa944c-44af-49c5-b788-6a75dfed4ddc tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:50.832957 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-caaa944c-44af-49c5-b788-6a75dfed4ddc tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:50.834247 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-caaa944c-44af-49c5-b788-6a75dfed4ddc tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:50.835868 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-caaa944c-44af-49c5-b788-6a75dfed4ddc tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:50.836492 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-caaa944c-44af-49c5-b788-6a75dfed4ddc tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:50.836993 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-caaa944c-44af-49c5-b788-6a75dfed4ddc tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:50.903053 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-34b7b87f-b529-452d-9bcb-04c27b8f6811 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:41:50.911398 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-34b7b87f-b529-452d-9bcb-04c27b8f6811 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/4bc0d2c9-2a44-4f65-a780-d7ba828cea3a" status: 200 len: 1215 microversion: 2.1 time: 0.257303 Aug 31 16:41:50.912131 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3174/6372] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:41:50 2022] GET /compute/v2.1/servers/4bc0d2c9-2a44-4f65-a780-d7ba828cea3a => generated 1215 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:41:51.094740 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-caaa944c-44af-49c5-b788-6a75dfed4ddc tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb78657f161443083d53a3b29fb4406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a56640b635e400694f60d00a5f922e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:41:51.107872 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-caaa944c-44af-49c5-b788-6a75dfed4ddc tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] 10.222.0.61 "GET /compute/v2.1/servers/98964e5a-9c6a-4be8-af79-95db246ebcc4" status: 200 len: 1282 microversion: 2.1 time: 0.288466 Aug 31 16:41:51.108510 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3199/6373] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:41:50 2022] GET /compute/v2.1/servers/98964e5a-9c6a-4be8-af79-95db246ebcc4 => generated 1282 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:41:51.239834 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-8720bd1c-ba40-4b24-b82f-7b743bb6d788 req-3ef8cd9c-19a2-4bd6-b98a-702f243f297f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98964e5a-9c6a-4be8-af79-95db246ebcc4", "tag": "f5f846a4-ecbe-4e81-827a-e3a0fda3589e"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:41:51.250190 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-8720bd1c-ba40-4b24-b82f-7b743bb6d788 req-3ef8cd9c-19a2-4bd6-b98a-702f243f297f service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:51.250677 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-8720bd1c-ba40-4b24-b82f-7b743bb6d788 req-3ef8cd9c-19a2-4bd6-b98a-702f243f297f service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:51.251296 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-8720bd1c-ba40-4b24-b82f-7b743bb6d788 req-3ef8cd9c-19a2-4bd6-b98a-702f243f297f service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:51.274133 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-8720bd1c-ba40-4b24-b82f-7b743bb6d788 req-3ef8cd9c-19a2-4bd6-b98a-702f243f297f service nova] Creating event network-changed:f5f846a4-ecbe-4e81-827a-e3a0fda3589e for instance 98964e5a-9c6a-4be8-af79-95db246ebcc4 on n-h1-850499-9 Aug 31 16:41:51.282302 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-8720bd1c-ba40-4b24-b82f-7b743bb6d788 req-3ef8cd9c-19a2-4bd6-b98a-702f243f297f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045499 Aug 31 16:41:51.283372 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3175/6374] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:41:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:41:51.933661 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-efdaf42b-f234-4d54-b61d-f722dad51702 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:41:51.935162 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-efdaf42b-f234-4d54-b61d-f722dad51702 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 4bc0d2c9-2a44-4f65-a780-d7ba828cea3a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:41:51.942433 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-efdaf42b-f234-4d54-b61d-f722dad51702 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:51.943360 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-efdaf42b-f234-4d54-b61d-f722dad51702 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:51.944154 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-efdaf42b-f234-4d54-b61d-f722dad51702 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:51.945897 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-efdaf42b-f234-4d54-b61d-f722dad51702 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:51.946572 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-efdaf42b-f234-4d54-b61d-f722dad51702 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:51.947178 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-efdaf42b-f234-4d54-b61d-f722dad51702 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:52.129643 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-534e6c7d-7c10-4190-ad93-9b475a477a9b tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:41:52.131412 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-534e6c7d-7c10-4190-ad93-9b475a477a9b tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] [instance: 98964e5a-9c6a-4be8-af79-95db246ebcc4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:41:52.139589 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-534e6c7d-7c10-4190-ad93-9b475a477a9b tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:52.140315 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-534e6c7d-7c10-4190-ad93-9b475a477a9b tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:52.140923 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-534e6c7d-7c10-4190-ad93-9b475a477a9b tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:52.141858 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-534e6c7d-7c10-4190-ad93-9b475a477a9b tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:52.142468 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-534e6c7d-7c10-4190-ad93-9b475a477a9b tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:52.143051 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-534e6c7d-7c10-4190-ad93-9b475a477a9b tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:52.357270 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-efdaf42b-f234-4d54-b61d-f722dad51702 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:41:52.365709 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-efdaf42b-f234-4d54-b61d-f722dad51702 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/4bc0d2c9-2a44-4f65-a780-d7ba828cea3a" status: 200 len: 1215 microversion: 2.1 time: 0.436942 Aug 31 16:41:52.367208 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3200/6375] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:41:51 2022] GET /compute/v2.1/servers/4bc0d2c9-2a44-4f65-a780-d7ba828cea3a => generated 1215 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:41:52.553452 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-534e6c7d-7c10-4190-ad93-9b475a477a9b tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb78657f161443083d53a3b29fb4406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a56640b635e400694f60d00a5f922e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:41:52.562595 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-534e6c7d-7c10-4190-ad93-9b475a477a9b tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] 10.222.0.61 "GET /compute/v2.1/servers/98964e5a-9c6a-4be8-af79-95db246ebcc4" status: 200 len: 1282 microversion: 2.1 time: 0.436988 Aug 31 16:41:52.563866 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3176/6376] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:41:52 2022] GET /compute/v2.1/servers/98964e5a-9c6a-4be8-af79-95db246ebcc4 => generated 1282 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:41:53.388847 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-167cd0e6-feec-4c6c-8916-881660a469b5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:41:53.390174 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-167cd0e6-feec-4c6c-8916-881660a469b5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 4bc0d2c9-2a44-4f65-a780-d7ba828cea3a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:41:53.401060 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-167cd0e6-feec-4c6c-8916-881660a469b5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:53.408286 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-167cd0e6-feec-4c6c-8916-881660a469b5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:53.408759 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-167cd0e6-feec-4c6c-8916-881660a469b5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:53.409536 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-167cd0e6-feec-4c6c-8916-881660a469b5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:53.410084 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-167cd0e6-feec-4c6c-8916-881660a469b5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:53.410530 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-167cd0e6-feec-4c6c-8916-881660a469b5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:53.584404 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-464f58db-1399-471a-8b06-797e9686c1e9 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:41:53.585658 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-464f58db-1399-471a-8b06-797e9686c1e9 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] [instance: 98964e5a-9c6a-4be8-af79-95db246ebcc4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:41:53.592960 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-464f58db-1399-471a-8b06-797e9686c1e9 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:53.593586 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-464f58db-1399-471a-8b06-797e9686c1e9 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:53.594136 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-464f58db-1399-471a-8b06-797e9686c1e9 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:53.594948 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-464f58db-1399-471a-8b06-797e9686c1e9 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:53.595673 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-464f58db-1399-471a-8b06-797e9686c1e9 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:53.596455 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-464f58db-1399-471a-8b06-797e9686c1e9 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:53.625872 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-167cd0e6-feec-4c6c-8916-881660a469b5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:41:53.635131 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-167cd0e6-feec-4c6c-8916-881660a469b5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/4bc0d2c9-2a44-4f65-a780-d7ba828cea3a" status: 200 len: 1215 microversion: 2.1 time: 0.250269 Aug 31 16:41:53.638776 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3201/6377] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:41:53 2022] GET /compute/v2.1/servers/4bc0d2c9-2a44-4f65-a780-d7ba828cea3a => generated 1215 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:41:54.202102 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-464f58db-1399-471a-8b06-797e9686c1e9 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb78657f161443083d53a3b29fb4406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a56640b635e400694f60d00a5f922e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:41:54.210252 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-464f58db-1399-471a-8b06-797e9686c1e9 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] 10.222.0.61 "GET /compute/v2.1/servers/98964e5a-9c6a-4be8-af79-95db246ebcc4" status: 200 len: 1282 microversion: 2.1 time: 0.630256 Aug 31 16:41:54.210928 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3177/6378] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:41:53 2022] GET /compute/v2.1/servers/98964e5a-9c6a-4be8-af79-95db246ebcc4 => generated 1282 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:41:54.659883 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4bdc6bd4-c31e-4cfc-a0a1-31fbf5680103 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:41:54.662745 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4bdc6bd4-c31e-4cfc-a0a1-31fbf5680103 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 4bc0d2c9-2a44-4f65-a780-d7ba828cea3a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:41:54.671201 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4bdc6bd4-c31e-4cfc-a0a1-31fbf5680103 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:54.671949 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4bdc6bd4-c31e-4cfc-a0a1-31fbf5680103 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:54.672598 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4bdc6bd4-c31e-4cfc-a0a1-31fbf5680103 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:54.673655 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4bdc6bd4-c31e-4cfc-a0a1-31fbf5680103 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:54.674318 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4bdc6bd4-c31e-4cfc-a0a1-31fbf5680103 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:54.674952 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4bdc6bd4-c31e-4cfc-a0a1-31fbf5680103 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:54.887868 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-4bdc6bd4-c31e-4cfc-a0a1-31fbf5680103 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:41:54.896791 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4bdc6bd4-c31e-4cfc-a0a1-31fbf5680103 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/4bc0d2c9-2a44-4f65-a780-d7ba828cea3a" status: 200 len: 1215 microversion: 2.1 time: 0.241183 Aug 31 16:41:54.908682 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3202/6379] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:41:54 2022] GET /compute/v2.1/servers/4bc0d2c9-2a44-4f65-a780-d7ba828cea3a => generated 1215 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:41:55.230756 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a012cca2-f3fd-4abd-bc68-4a101d54877d tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:41:55.231429 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a012cca2-f3fd-4abd-bc68-4a101d54877d tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] [instance: 98964e5a-9c6a-4be8-af79-95db246ebcc4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:41:55.238786 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a012cca2-f3fd-4abd-bc68-4a101d54877d tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:55.239284 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a012cca2-f3fd-4abd-bc68-4a101d54877d tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:55.239755 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a012cca2-f3fd-4abd-bc68-4a101d54877d tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:55.240469 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a012cca2-f3fd-4abd-bc68-4a101d54877d tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:55.240930 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a012cca2-f3fd-4abd-bc68-4a101d54877d tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:55.241943 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a012cca2-f3fd-4abd-bc68-4a101d54877d tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:55.262487 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=100 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:41:55.395259 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a012cca2-f3fd-4abd-bc68-4a101d54877d tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb78657f161443083d53a3b29fb4406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a56640b635e400694f60d00a5f922e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:41:55.404582 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a012cca2-f3fd-4abd-bc68-4a101d54877d tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] 10.222.0.61 "GET /compute/v2.1/servers/98964e5a-9c6a-4be8-af79-95db246ebcc4" status: 200 len: 1282 microversion: 2.1 time: 0.178068 Aug 31 16:41:55.406120 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3178/6380] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:41:55 2022] GET /compute/v2.1/servers/98964e5a-9c6a-4be8-af79-95db246ebcc4 => generated 1282 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:41:55.920144 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a299b821-1f36-40d3-ad8d-0182f45fd5df tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:41:55.921042 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a299b821-1f36-40d3-ad8d-0182f45fd5df tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 4bc0d2c9-2a44-4f65-a780-d7ba828cea3a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:41:55.923286 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:41:55.930997 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a299b821-1f36-40d3-ad8d-0182f45fd5df tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:55.931640 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a299b821-1f36-40d3-ad8d-0182f45fd5df tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:55.932156 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a299b821-1f36-40d3-ad8d-0182f45fd5df tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:55.932985 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a299b821-1f36-40d3-ad8d-0182f45fd5df tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:55.933542 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a299b821-1f36-40d3-ad8d-0182f45fd5df tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:55.934368 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a299b821-1f36-40d3-ad8d-0182f45fd5df tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:56.101283 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a299b821-1f36-40d3-ad8d-0182f45fd5df tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:41:56.110056 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a299b821-1f36-40d3-ad8d-0182f45fd5df tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/4bc0d2c9-2a44-4f65-a780-d7ba828cea3a" status: 200 len: 1215 microversion: 2.1 time: 0.193732 Aug 31 16:41:56.110912 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3203/6381] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:41:55 2022] GET /compute/v2.1/servers/4bc0d2c9-2a44-4f65-a780-d7ba828cea3a => generated 1215 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:41:56.426358 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b799a6ee-0cd8-482d-ae96-a7029a7b6485 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:41:56.426976 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b799a6ee-0cd8-482d-ae96-a7029a7b6485 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] [instance: 98964e5a-9c6a-4be8-af79-95db246ebcc4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:41:56.434728 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b799a6ee-0cd8-482d-ae96-a7029a7b6485 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:56.435238 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b799a6ee-0cd8-482d-ae96-a7029a7b6485 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:56.435719 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b799a6ee-0cd8-482d-ae96-a7029a7b6485 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:56.436571 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b799a6ee-0cd8-482d-ae96-a7029a7b6485 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:56.437032 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b799a6ee-0cd8-482d-ae96-a7029a7b6485 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:56.437463 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b799a6ee-0cd8-482d-ae96-a7029a7b6485 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:56.589448 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b799a6ee-0cd8-482d-ae96-a7029a7b6485 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb78657f161443083d53a3b29fb4406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a56640b635e400694f60d00a5f922e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:41:56.602979 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b799a6ee-0cd8-482d-ae96-a7029a7b6485 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] 10.222.0.61 "GET /compute/v2.1/servers/98964e5a-9c6a-4be8-af79-95db246ebcc4" status: 200 len: 1282 microversion: 2.1 time: 0.180370 Aug 31 16:41:56.603727 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3179/6382] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:41:56 2022] GET /compute/v2.1/servers/98964e5a-9c6a-4be8-af79-95db246ebcc4 => generated 1282 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:41:57.131885 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4b22d3b6-5960-44e1-854b-0b529991f1bc tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:41:57.132526 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4b22d3b6-5960-44e1-854b-0b529991f1bc tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 4bc0d2c9-2a44-4f65-a780-d7ba828cea3a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:41:57.134382 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=16 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:41:57.140725 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4b22d3b6-5960-44e1-854b-0b529991f1bc tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:57.141202 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4b22d3b6-5960-44e1-854b-0b529991f1bc tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:57.141637 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4b22d3b6-5960-44e1-854b-0b529991f1bc tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:57.142339 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4b22d3b6-5960-44e1-854b-0b529991f1bc tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:57.142793 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4b22d3b6-5960-44e1-854b-0b529991f1bc tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:57.143217 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4b22d3b6-5960-44e1-854b-0b529991f1bc tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:57.297843 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-4b22d3b6-5960-44e1-854b-0b529991f1bc tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:41:57.306324 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=100 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:41:57.318817 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4b22d3b6-5960-44e1-854b-0b529991f1bc tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/4bc0d2c9-2a44-4f65-a780-d7ba828cea3a" status: 200 len: 1215 microversion: 2.1 time: 0.190777 Aug 31 16:41:57.319545 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3204/6383] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:41:57 2022] GET /compute/v2.1/servers/4bc0d2c9-2a44-4f65-a780-d7ba828cea3a => generated 1215 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:41:57.625324 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7505a5d6-f6de-4212-bd4d-ca8eabedd2d1 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:41:57.625858 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7505a5d6-f6de-4212-bd4d-ca8eabedd2d1 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] [instance: 98964e5a-9c6a-4be8-af79-95db246ebcc4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:41:57.633285 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7505a5d6-f6de-4212-bd4d-ca8eabedd2d1 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:57.633785 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7505a5d6-f6de-4212-bd4d-ca8eabedd2d1 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:57.634235 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7505a5d6-f6de-4212-bd4d-ca8eabedd2d1 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:57.634943 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7505a5d6-f6de-4212-bd4d-ca8eabedd2d1 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:57.635409 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7505a5d6-f6de-4212-bd4d-ca8eabedd2d1 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:57.635870 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7505a5d6-f6de-4212-bd4d-ca8eabedd2d1 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:57.778185 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7505a5d6-f6de-4212-bd4d-ca8eabedd2d1 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb78657f161443083d53a3b29fb4406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a56640b635e400694f60d00a5f922e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:41:57.786273 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7505a5d6-f6de-4212-bd4d-ca8eabedd2d1 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] 10.222.0.61 "GET /compute/v2.1/servers/98964e5a-9c6a-4be8-af79-95db246ebcc4" status: 200 len: 1282 microversion: 2.1 time: 0.164893 Aug 31 16:41:57.786856 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3180/6384] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:41:57 2022] GET /compute/v2.1/servers/98964e5a-9c6a-4be8-af79-95db246ebcc4 => generated 1282 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:41:58.340059 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6f0aa673-cb0f-42ef-82a0-92eb6e4d13b1 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:41:58.340749 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6f0aa673-cb0f-42ef-82a0-92eb6e4d13b1 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 4bc0d2c9-2a44-4f65-a780-d7ba828cea3a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:41:58.347999 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6f0aa673-cb0f-42ef-82a0-92eb6e4d13b1 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:58.348557 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6f0aa673-cb0f-42ef-82a0-92eb6e4d13b1 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:58.349058 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6f0aa673-cb0f-42ef-82a0-92eb6e4d13b1 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:58.349939 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6f0aa673-cb0f-42ef-82a0-92eb6e4d13b1 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:58.350396 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6f0aa673-cb0f-42ef-82a0-92eb6e4d13b1 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:58.351351 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6f0aa673-cb0f-42ef-82a0-92eb6e4d13b1 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:58.500702 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-6f0aa673-cb0f-42ef-82a0-92eb6e4d13b1 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:41:58.511489 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6f0aa673-cb0f-42ef-82a0-92eb6e4d13b1 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/4bc0d2c9-2a44-4f65-a780-d7ba828cea3a" status: 200 len: 1203 microversion: 2.1 time: 0.174846 Aug 31 16:41:58.512841 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3205/6385] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:41:58 2022] GET /compute/v2.1/servers/4bc0d2c9-2a44-4f65-a780-d7ba828cea3a => generated 1203 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:41:58.808748 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e4023280-07b0-4a41-ad5c-c9cbe83b1ff0 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:41:58.809357 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e4023280-07b0-4a41-ad5c-c9cbe83b1ff0 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] [instance: 98964e5a-9c6a-4be8-af79-95db246ebcc4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:41:58.822682 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e4023280-07b0-4a41-ad5c-c9cbe83b1ff0 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:58.823419 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e4023280-07b0-4a41-ad5c-c9cbe83b1ff0 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:58.823910 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e4023280-07b0-4a41-ad5c-c9cbe83b1ff0 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:58.824615 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e4023280-07b0-4a41-ad5c-c9cbe83b1ff0 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:58.825219 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e4023280-07b0-4a41-ad5c-c9cbe83b1ff0 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:58.825658 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e4023280-07b0-4a41-ad5c-c9cbe83b1ff0 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:59.037081 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e4023280-07b0-4a41-ad5c-c9cbe83b1ff0 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb78657f161443083d53a3b29fb4406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a56640b635e400694f60d00a5f922e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:41:59.051081 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e4023280-07b0-4a41-ad5c-c9cbe83b1ff0 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] 10.222.0.61 "GET /compute/v2.1/servers/98964e5a-9c6a-4be8-af79-95db246ebcc4" status: 200 len: 1282 microversion: 2.1 time: 0.246948 Aug 31 16:41:59.064376 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3181/6386] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:41:58 2022] GET /compute/v2.1/servers/98964e5a-9c6a-4be8-af79-95db246ebcc4 => generated 1282 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:41:59.535866 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-aba957d0-b12e-417e-9a15-d7e530c28caf tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:41:59.537020 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-aba957d0-b12e-417e-9a15-d7e530c28caf tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 4bc0d2c9-2a44-4f65-a780-d7ba828cea3a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:41:59.546934 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-aba957d0-b12e-417e-9a15-d7e530c28caf tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:59.548173 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-aba957d0-b12e-417e-9a15-d7e530c28caf tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:59.549480 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-aba957d0-b12e-417e-9a15-d7e530c28caf tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:59.551552 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-aba957d0-b12e-417e-9a15-d7e530c28caf tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:59.553445 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-aba957d0-b12e-417e-9a15-d7e530c28caf tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:59.554484 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-aba957d0-b12e-417e-9a15-d7e530c28caf tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:59.740168 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-aba957d0-b12e-417e-9a15-d7e530c28caf tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:41:59.754985 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-aba957d0-b12e-417e-9a15-d7e530c28caf tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/4bc0d2c9-2a44-4f65-a780-d7ba828cea3a" status: 200 len: 1203 microversion: 2.1 time: 0.224402 Aug 31 16:41:59.757823 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3206/6387] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:41:59 2022] GET /compute/v2.1/servers/4bc0d2c9-2a44-4f65-a780-d7ba828cea3a => generated 1203 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:42:00.074111 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5531c80e-0f72-4c68-a8c3-2999f7d023bb tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:42:00.074764 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5531c80e-0f72-4c68-a8c3-2999f7d023bb tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] [instance: 98964e5a-9c6a-4be8-af79-95db246ebcc4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:42:00.082482 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5531c80e-0f72-4c68-a8c3-2999f7d023bb tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:00.082995 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5531c80e-0f72-4c68-a8c3-2999f7d023bb tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:00.083446 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5531c80e-0f72-4c68-a8c3-2999f7d023bb tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:00.084204 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5531c80e-0f72-4c68-a8c3-2999f7d023bb tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:00.084683 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5531c80e-0f72-4c68-a8c3-2999f7d023bb tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:00.085255 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5531c80e-0f72-4c68-a8c3-2999f7d023bb tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:00.314572 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5531c80e-0f72-4c68-a8c3-2999f7d023bb tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb78657f161443083d53a3b29fb4406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a56640b635e400694f60d00a5f922e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:42:00.325035 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5531c80e-0f72-4c68-a8c3-2999f7d023bb tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] 10.222.0.61 "GET /compute/v2.1/servers/98964e5a-9c6a-4be8-af79-95db246ebcc4" status: 200 len: 1282 microversion: 2.1 time: 0.255358 Aug 31 16:42:00.328060 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3182/6388] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:42:00 2022] GET /compute/v2.1/servers/98964e5a-9c6a-4be8-af79-95db246ebcc4 => generated 1282 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:42:00.779107 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-bc86fc59-8366-46a7-81ed-5a35441dddd9 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:42:00.779873 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-bc86fc59-8366-46a7-81ed-5a35441dddd9 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 4bc0d2c9-2a44-4f65-a780-d7ba828cea3a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:42:00.787945 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bc86fc59-8366-46a7-81ed-5a35441dddd9 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:00.789828 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bc86fc59-8366-46a7-81ed-5a35441dddd9 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:00.790510 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bc86fc59-8366-46a7-81ed-5a35441dddd9 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:00.791703 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bc86fc59-8366-46a7-81ed-5a35441dddd9 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:00.792442 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bc86fc59-8366-46a7-81ed-5a35441dddd9 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:00.793131 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bc86fc59-8366-46a7-81ed-5a35441dddd9 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:01.018123 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-bc86fc59-8366-46a7-81ed-5a35441dddd9 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:42:01.029446 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-bc86fc59-8366-46a7-81ed-5a35441dddd9 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/4bc0d2c9-2a44-4f65-a780-d7ba828cea3a" status: 200 len: 1203 microversion: 2.1 time: 0.254834 Aug 31 16:42:01.030671 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3207/6389] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:42:00 2022] GET /compute/v2.1/servers/4bc0d2c9-2a44-4f65-a780-d7ba828cea3a => generated 1203 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:42:01.348761 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4fe820dd-d790-41c8-83f0-a7142f6e703d tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:42:01.349511 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4fe820dd-d790-41c8-83f0-a7142f6e703d tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] [instance: 98964e5a-9c6a-4be8-af79-95db246ebcc4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:42:01.352952 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=4 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:42:01.372121 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4fe820dd-d790-41c8-83f0-a7142f6e703d tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:01.372710 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4fe820dd-d790-41c8-83f0-a7142f6e703d tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:01.373160 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4fe820dd-d790-41c8-83f0-a7142f6e703d tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:01.373937 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4fe820dd-d790-41c8-83f0-a7142f6e703d tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:01.375029 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4fe820dd-d790-41c8-83f0-a7142f6e703d tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:01.375595 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4fe820dd-d790-41c8-83f0-a7142f6e703d tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:01.695708 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-4fe820dd-d790-41c8-83f0-a7142f6e703d tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb78657f161443083d53a3b29fb4406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a56640b635e400694f60d00a5f922e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:42:01.705186 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4fe820dd-d790-41c8-83f0-a7142f6e703d tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] 10.222.0.61 "GET /compute/v2.1/servers/98964e5a-9c6a-4be8-af79-95db246ebcc4" status: 200 len: 1282 microversion: 2.1 time: 0.360474 Aug 31 16:42:01.705774 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3183/6390] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:42:01 2022] GET /compute/v2.1/servers/98964e5a-9c6a-4be8-af79-95db246ebcc4 => generated 1282 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:42:02.055904 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1e285c9a-4dda-43dd-b1ab-c1a8b84c2749 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:42:02.056492 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1e285c9a-4dda-43dd-b1ab-c1a8b84c2749 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 4bc0d2c9-2a44-4f65-a780-d7ba828cea3a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:42:02.058817 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:42:02.064457 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1e285c9a-4dda-43dd-b1ab-c1a8b84c2749 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:02.065508 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1e285c9a-4dda-43dd-b1ab-c1a8b84c2749 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:02.065985 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1e285c9a-4dda-43dd-b1ab-c1a8b84c2749 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:02.067445 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1e285c9a-4dda-43dd-b1ab-c1a8b84c2749 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:02.067994 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1e285c9a-4dda-43dd-b1ab-c1a8b84c2749 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:02.068532 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1e285c9a-4dda-43dd-b1ab-c1a8b84c2749 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:02.290034 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-1e285c9a-4dda-43dd-b1ab-c1a8b84c2749 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:42:02.299658 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1e285c9a-4dda-43dd-b1ab-c1a8b84c2749 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/4bc0d2c9-2a44-4f65-a780-d7ba828cea3a" status: 200 len: 1203 microversion: 2.1 time: 0.250108 Aug 31 16:42:02.314276 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3208/6391] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:42:02 2022] GET /compute/v2.1/servers/4bc0d2c9-2a44-4f65-a780-d7ba828cea3a => generated 1203 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:42:02.727716 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c2f22ebc-1edb-45cc-8e30-bacd73eb0fb1 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:42:02.728653 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c2f22ebc-1edb-45cc-8e30-bacd73eb0fb1 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] [instance: 98964e5a-9c6a-4be8-af79-95db246ebcc4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:42:02.736274 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c2f22ebc-1edb-45cc-8e30-bacd73eb0fb1 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:02.737099 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c2f22ebc-1edb-45cc-8e30-bacd73eb0fb1 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:02.737665 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c2f22ebc-1edb-45cc-8e30-bacd73eb0fb1 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:02.738379 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c2f22ebc-1edb-45cc-8e30-bacd73eb0fb1 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:02.738834 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c2f22ebc-1edb-45cc-8e30-bacd73eb0fb1 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:02.739257 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c2f22ebc-1edb-45cc-8e30-bacd73eb0fb1 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:02.925268 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c2f22ebc-1edb-45cc-8e30-bacd73eb0fb1 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb78657f161443083d53a3b29fb4406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a56640b635e400694f60d00a5f922e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:42:02.936849 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c2f22ebc-1edb-45cc-8e30-bacd73eb0fb1 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] 10.222.0.61 "GET /compute/v2.1/servers/98964e5a-9c6a-4be8-af79-95db246ebcc4" status: 200 len: 1270 microversion: 2.1 time: 0.214047 Aug 31 16:42:02.953804 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3184/6392] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:42:02 2022] GET /compute/v2.1/servers/98964e5a-9c6a-4be8-af79-95db246ebcc4 => generated 1270 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:42:03.322976 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9467c4e5-c136-4759-ae21-b2b007f30c57 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:42:03.324198 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9467c4e5-c136-4759-ae21-b2b007f30c57 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 4bc0d2c9-2a44-4f65-a780-d7ba828cea3a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:42:03.337621 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9467c4e5-c136-4759-ae21-b2b007f30c57 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:03.338594 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9467c4e5-c136-4759-ae21-b2b007f30c57 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:03.339109 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9467c4e5-c136-4759-ae21-b2b007f30c57 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:03.340031 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9467c4e5-c136-4759-ae21-b2b007f30c57 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:03.340509 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9467c4e5-c136-4759-ae21-b2b007f30c57 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:03.340948 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9467c4e5-c136-4759-ae21-b2b007f30c57 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:03.523889 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9467c4e5-c136-4759-ae21-b2b007f30c57 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:42:03.533279 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9467c4e5-c136-4759-ae21-b2b007f30c57 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/4bc0d2c9-2a44-4f65-a780-d7ba828cea3a" status: 200 len: 1203 microversion: 2.1 time: 0.215477 Aug 31 16:42:03.533833 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3209/6393] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:42:03 2022] GET /compute/v2.1/servers/4bc0d2c9-2a44-4f65-a780-d7ba828cea3a => generated 1203 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:42:03.962555 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b3ff4581-7356-46a6-8d81-65da2b731c36 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:42:03.963291 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b3ff4581-7356-46a6-8d81-65da2b731c36 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] [instance: 98964e5a-9c6a-4be8-af79-95db246ebcc4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:42:03.976705 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b3ff4581-7356-46a6-8d81-65da2b731c36 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:03.977392 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b3ff4581-7356-46a6-8d81-65da2b731c36 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:03.977721 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b3ff4581-7356-46a6-8d81-65da2b731c36 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:03.981887 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b3ff4581-7356-46a6-8d81-65da2b731c36 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:03.981887 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b3ff4581-7356-46a6-8d81-65da2b731c36 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:03.981887 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b3ff4581-7356-46a6-8d81-65da2b731c36 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:04.158360 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b3ff4581-7356-46a6-8d81-65da2b731c36 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb78657f161443083d53a3b29fb4406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a56640b635e400694f60d00a5f922e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:42:04.169304 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b3ff4581-7356-46a6-8d81-65da2b731c36 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] 10.222.0.61 "GET /compute/v2.1/servers/98964e5a-9c6a-4be8-af79-95db246ebcc4" status: 200 len: 1270 microversion: 2.1 time: 0.210013 Aug 31 16:42:04.172169 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3185/6394] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:42:03 2022] GET /compute/v2.1/servers/98964e5a-9c6a-4be8-af79-95db246ebcc4 => generated 1270 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:42:04.555582 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-df329a16-f510-4bce-bc56-e80e53b2c320 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:42:04.556370 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-df329a16-f510-4bce-bc56-e80e53b2c320 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 4bc0d2c9-2a44-4f65-a780-d7ba828cea3a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:42:04.564318 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-df329a16-f510-4bce-bc56-e80e53b2c320 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:04.564843 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-df329a16-f510-4bce-bc56-e80e53b2c320 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:04.565366 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-df329a16-f510-4bce-bc56-e80e53b2c320 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:04.570043 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-df329a16-f510-4bce-bc56-e80e53b2c320 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:04.571337 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-df329a16-f510-4bce-bc56-e80e53b2c320 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:04.573406 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-df329a16-f510-4bce-bc56-e80e53b2c320 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:04.745838 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-df329a16-f510-4bce-bc56-e80e53b2c320 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:42:04.754796 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-df329a16-f510-4bce-bc56-e80e53b2c320 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/4bc0d2c9-2a44-4f65-a780-d7ba828cea3a" status: 200 len: 1203 microversion: 2.1 time: 0.204437 Aug 31 16:42:04.755860 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3210/6395] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:42:04 2022] GET /compute/v2.1/servers/4bc0d2c9-2a44-4f65-a780-d7ba828cea3a => generated 1203 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:42:05.195135 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-149a28d0-1b9e-470e-80e1-4fa543a952d6 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:42:05.196174 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-149a28d0-1b9e-470e-80e1-4fa543a952d6 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] [instance: 98964e5a-9c6a-4be8-af79-95db246ebcc4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:42:05.203862 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-149a28d0-1b9e-470e-80e1-4fa543a952d6 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:05.204499 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-149a28d0-1b9e-470e-80e1-4fa543a952d6 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:05.204996 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-149a28d0-1b9e-470e-80e1-4fa543a952d6 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:05.205782 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-149a28d0-1b9e-470e-80e1-4fa543a952d6 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:05.206468 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-149a28d0-1b9e-470e-80e1-4fa543a952d6 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:05.206977 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-149a28d0-1b9e-470e-80e1-4fa543a952d6 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:05.424395 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-149a28d0-1b9e-470e-80e1-4fa543a952d6 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb78657f161443083d53a3b29fb4406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a56640b635e400694f60d00a5f922e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:42:05.437792 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-149a28d0-1b9e-470e-80e1-4fa543a952d6 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] 10.222.0.61 "GET /compute/v2.1/servers/98964e5a-9c6a-4be8-af79-95db246ebcc4" status: 200 len: 1270 microversion: 2.1 time: 0.247235 Aug 31 16:42:05.438648 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3186/6396] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:42:05 2022] GET /compute/v2.1/servers/98964e5a-9c6a-4be8-af79-95db246ebcc4 => generated 1270 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:42:05.781687 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d2671d99-0218-470e-8d8a-61ac36e237db tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:42:05.782965 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d2671d99-0218-470e-8d8a-61ac36e237db tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 4bc0d2c9-2a44-4f65-a780-d7ba828cea3a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:42:05.792646 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d2671d99-0218-470e-8d8a-61ac36e237db tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:05.793406 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d2671d99-0218-470e-8d8a-61ac36e237db tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:05.794114 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d2671d99-0218-470e-8d8a-61ac36e237db tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:05.795300 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d2671d99-0218-470e-8d8a-61ac36e237db tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:05.796236 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d2671d99-0218-470e-8d8a-61ac36e237db tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:05.796950 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d2671d99-0218-470e-8d8a-61ac36e237db tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:05.992757 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d2671d99-0218-470e-8d8a-61ac36e237db tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:42:06.001890 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d2671d99-0218-470e-8d8a-61ac36e237db tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/4bc0d2c9-2a44-4f65-a780-d7ba828cea3a" status: 200 len: 1203 microversion: 2.1 time: 0.227389 Aug 31 16:42:06.002533 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3211/6397] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:42:05 2022] GET /compute/v2.1/servers/4bc0d2c9-2a44-4f65-a780-d7ba828cea3a => generated 1203 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:42:06.460627 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-fa599de6-2f0a-410a-a113-41d5eaaaa314 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:42:06.462353 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-fa599de6-2f0a-410a-a113-41d5eaaaa314 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] [instance: 98964e5a-9c6a-4be8-af79-95db246ebcc4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:42:06.474561 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fa599de6-2f0a-410a-a113-41d5eaaaa314 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:06.475389 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fa599de6-2f0a-410a-a113-41d5eaaaa314 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:06.476870 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fa599de6-2f0a-410a-a113-41d5eaaaa314 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:06.477868 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fa599de6-2f0a-410a-a113-41d5eaaaa314 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:06.478578 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fa599de6-2f0a-410a-a113-41d5eaaaa314 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:06.479232 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fa599de6-2f0a-410a-a113-41d5eaaaa314 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:06.762892 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-fa599de6-2f0a-410a-a113-41d5eaaaa314 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb78657f161443083d53a3b29fb4406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a56640b635e400694f60d00a5f922e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:42:06.779978 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-fa599de6-2f0a-410a-a113-41d5eaaaa314 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] 10.222.0.61 "GET /compute/v2.1/servers/98964e5a-9c6a-4be8-af79-95db246ebcc4" status: 200 len: 1270 microversion: 2.1 time: 0.322935 Aug 31 16:42:06.782871 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3187/6398] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:42:06 2022] GET /compute/v2.1/servers/98964e5a-9c6a-4be8-af79-95db246ebcc4 => generated 1270 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:42:07.026055 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9809e213-29f1-49ea-8125-667fbe929ccd tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:42:07.027305 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9809e213-29f1-49ea-8125-667fbe929ccd tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 4bc0d2c9-2a44-4f65-a780-d7ba828cea3a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:42:07.044436 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9809e213-29f1-49ea-8125-667fbe929ccd tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:07.045268 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9809e213-29f1-49ea-8125-667fbe929ccd tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:07.049142 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9809e213-29f1-49ea-8125-667fbe929ccd tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:07.050089 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9809e213-29f1-49ea-8125-667fbe929ccd tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:07.050722 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9809e213-29f1-49ea-8125-667fbe929ccd tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:07.051388 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9809e213-29f1-49ea-8125-667fbe929ccd tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:07.404150 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9809e213-29f1-49ea-8125-667fbe929ccd tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:42:07.416407 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9809e213-29f1-49ea-8125-667fbe929ccd tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/4bc0d2c9-2a44-4f65-a780-d7ba828cea3a" status: 200 len: 1203 microversion: 2.1 time: 0.396166 Aug 31 16:42:07.418327 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3212/6399] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:42:07 2022] GET /compute/v2.1/servers/4bc0d2c9-2a44-4f65-a780-d7ba828cea3a => generated 1203 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:42:07.810388 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-90a78cbf-7c16-4c54-b2b2-78594c84479e tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:42:07.812191 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-90a78cbf-7c16-4c54-b2b2-78594c84479e tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] [instance: 98964e5a-9c6a-4be8-af79-95db246ebcc4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:42:07.822504 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-90a78cbf-7c16-4c54-b2b2-78594c84479e tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:07.823106 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-90a78cbf-7c16-4c54-b2b2-78594c84479e tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:07.823661 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-90a78cbf-7c16-4c54-b2b2-78594c84479e tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:07.824483 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-90a78cbf-7c16-4c54-b2b2-78594c84479e tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:07.824997 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-90a78cbf-7c16-4c54-b2b2-78594c84479e tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:07.825522 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-90a78cbf-7c16-4c54-b2b2-78594c84479e tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:08.025181 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-90a78cbf-7c16-4c54-b2b2-78594c84479e tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb78657f161443083d53a3b29fb4406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a56640b635e400694f60d00a5f922e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:42:08.034958 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-90a78cbf-7c16-4c54-b2b2-78594c84479e tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] 10.222.0.61 "GET /compute/v2.1/servers/98964e5a-9c6a-4be8-af79-95db246ebcc4" status: 200 len: 1270 microversion: 2.1 time: 0.234364 Aug 31 16:42:08.039852 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3188/6400] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:42:07 2022] GET /compute/v2.1/servers/98964e5a-9c6a-4be8-af79-95db246ebcc4 => generated 1270 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:42:08.442219 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-17921818-7dfa-466d-9141-17e269f2b881 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:42:08.442936 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-17921818-7dfa-466d-9141-17e269f2b881 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 4bc0d2c9-2a44-4f65-a780-d7ba828cea3a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:42:08.450814 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-17921818-7dfa-466d-9141-17e269f2b881 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:08.451665 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-17921818-7dfa-466d-9141-17e269f2b881 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:08.455582 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-17921818-7dfa-466d-9141-17e269f2b881 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:08.456890 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-17921818-7dfa-466d-9141-17e269f2b881 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:08.457610 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-17921818-7dfa-466d-9141-17e269f2b881 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:08.458268 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-17921818-7dfa-466d-9141-17e269f2b881 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:08.658283 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-17921818-7dfa-466d-9141-17e269f2b881 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:42:08.673948 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-17921818-7dfa-466d-9141-17e269f2b881 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/4bc0d2c9-2a44-4f65-a780-d7ba828cea3a" status: 200 len: 1203 microversion: 2.1 time: 0.235528 Aug 31 16:42:08.679433 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3213/6401] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:42:08 2022] GET /compute/v2.1/servers/4bc0d2c9-2a44-4f65-a780-d7ba828cea3a => generated 1203 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:42:09.064330 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-74ab5857-f5b2-43de-ac35-7890df8ac9d7 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:42:09.064974 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-74ab5857-f5b2-43de-ac35-7890df8ac9d7 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] [instance: 98964e5a-9c6a-4be8-af79-95db246ebcc4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:42:09.097587 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-74ab5857-f5b2-43de-ac35-7890df8ac9d7 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:09.098365 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-74ab5857-f5b2-43de-ac35-7890df8ac9d7 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:09.099018 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-74ab5857-f5b2-43de-ac35-7890df8ac9d7 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:09.100459 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-74ab5857-f5b2-43de-ac35-7890df8ac9d7 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:09.102123 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-74ab5857-f5b2-43de-ac35-7890df8ac9d7 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:09.102891 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-74ab5857-f5b2-43de-ac35-7890df8ac9d7 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:09.322873 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-09bcc9cb-5cee-4487-b8b0-58527e51f2b7 req-4fbc8a54-028e-47f4-9774-b1febd539688 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bc0d2c9-2a44-4f65-a780-d7ba828cea3a", "name": "network-vif-plugged", "status": "completed", "tag": "08232de5-98ba-470b-afde-6772fc90c184"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:42:09.346274 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-09bcc9cb-5cee-4487-b8b0-58527e51f2b7 req-4fbc8a54-028e-47f4-9774-b1febd539688 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:09.346801 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-09bcc9cb-5cee-4487-b8b0-58527e51f2b7 req-4fbc8a54-028e-47f4-9774-b1febd539688 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:09.347673 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-09bcc9cb-5cee-4487-b8b0-58527e51f2b7 req-4fbc8a54-028e-47f4-9774-b1febd539688 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:09.349711 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-74ab5857-f5b2-43de-ac35-7890df8ac9d7 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb78657f161443083d53a3b29fb4406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a56640b635e400694f60d00a5f922e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:42:09.363612 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-74ab5857-f5b2-43de-ac35-7890df8ac9d7 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] 10.222.0.61 "GET /compute/v2.1/servers/98964e5a-9c6a-4be8-af79-95db246ebcc4" status: 200 len: 1270 microversion: 2.1 time: 0.302873 Aug 31 16:42:09.365151 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3189/6402] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:42:09 2022] GET /compute/v2.1/servers/98964e5a-9c6a-4be8-af79-95db246ebcc4 => generated 1270 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:42:09.393048 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-09bcc9cb-5cee-4487-b8b0-58527e51f2b7 req-4fbc8a54-028e-47f4-9774-b1febd539688 service nova] Creating event network-vif-plugged:08232de5-98ba-470b-afde-6772fc90c184 for instance 4bc0d2c9-2a44-4f65-a780-d7ba828cea3a on n-h2-850499-9 Aug 31 16:42:09.399854 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-09bcc9cb-5cee-4487-b8b0-58527e51f2b7 req-4fbc8a54-028e-47f4-9774-b1febd539688 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081362 Aug 31 16:42:09.401744 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3214/6403] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:42:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:42:09.701069 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3e17266b-051e-4879-b095-6448ca816a36 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:42:09.702153 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3e17266b-051e-4879-b095-6448ca816a36 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 4bc0d2c9-2a44-4f65-a780-d7ba828cea3a] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:42:09.708454 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3e17266b-051e-4879-b095-6448ca816a36 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:09.709149 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3e17266b-051e-4879-b095-6448ca816a36 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:09.709755 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3e17266b-051e-4879-b095-6448ca816a36 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:09.711568 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3e17266b-051e-4879-b095-6448ca816a36 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:09.712223 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3e17266b-051e-4879-b095-6448ca816a36 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:09.712830 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3e17266b-051e-4879-b095-6448ca816a36 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:09.921623 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3e17266b-051e-4879-b095-6448ca816a36 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:42:09.937867 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3e17266b-051e-4879-b095-6448ca816a36 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/4bc0d2c9-2a44-4f65-a780-d7ba828cea3a" status: 200 len: 1203 microversion: 2.1 time: 0.240465 Aug 31 16:42:09.958479 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3190/6404] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:42:09 2022] GET /compute/v2.1/servers/4bc0d2c9-2a44-4f65-a780-d7ba828cea3a => generated 1203 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:42:10.387928 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1edf42e7-1a2d-4c35-a94b-2e389ec6de72 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:42:10.388925 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1edf42e7-1a2d-4c35-a94b-2e389ec6de72 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] [instance: 98964e5a-9c6a-4be8-af79-95db246ebcc4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:42:10.398761 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1edf42e7-1a2d-4c35-a94b-2e389ec6de72 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:10.398761 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1edf42e7-1a2d-4c35-a94b-2e389ec6de72 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:10.398984 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1edf42e7-1a2d-4c35-a94b-2e389ec6de72 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:10.399730 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1edf42e7-1a2d-4c35-a94b-2e389ec6de72 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:10.400206 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1edf42e7-1a2d-4c35-a94b-2e389ec6de72 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:10.400622 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1edf42e7-1a2d-4c35-a94b-2e389ec6de72 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:10.587712 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-1edf42e7-1a2d-4c35-a94b-2e389ec6de72 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb78657f161443083d53a3b29fb4406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a56640b635e400694f60d00a5f922e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:42:10.599727 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1edf42e7-1a2d-4c35-a94b-2e389ec6de72 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] 10.222.0.61 "GET /compute/v2.1/servers/98964e5a-9c6a-4be8-af79-95db246ebcc4" status: 200 len: 1270 microversion: 2.1 time: 0.217287 Aug 31 16:42:10.600870 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3215/6405] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:42:10 2022] GET /compute/v2.1/servers/98964e5a-9c6a-4be8-af79-95db246ebcc4 => generated 1270 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:42:10.961859 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3847cc5c-19dc-46d1-8b20-ef1df941c4ae tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:42:10.963120 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3847cc5c-19dc-46d1-8b20-ef1df941c4ae tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 4bc0d2c9-2a44-4f65-a780-d7ba828cea3a] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:42:10.974093 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3847cc5c-19dc-46d1-8b20-ef1df941c4ae tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:10.980554 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3847cc5c-19dc-46d1-8b20-ef1df941c4ae tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:10.981271 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3847cc5c-19dc-46d1-8b20-ef1df941c4ae tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:10.982211 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3847cc5c-19dc-46d1-8b20-ef1df941c4ae tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:10.982843 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3847cc5c-19dc-46d1-8b20-ef1df941c4ae tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:10.987656 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3847cc5c-19dc-46d1-8b20-ef1df941c4ae tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:11.190786 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3847cc5c-19dc-46d1-8b20-ef1df941c4ae tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:42:11.203894 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3847cc5c-19dc-46d1-8b20-ef1df941c4ae tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/4bc0d2c9-2a44-4f65-a780-d7ba828cea3a" status: 200 len: 1203 microversion: 2.1 time: 0.247355 Aug 31 16:42:11.205207 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3191/6406] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:42:10 2022] GET /compute/v2.1/servers/4bc0d2c9-2a44-4f65-a780-d7ba828cea3a => generated 1203 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:42:11.625007 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9a6e4c44-8671-411a-9d86-b29c1660e285 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:42:11.626693 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9a6e4c44-8671-411a-9d86-b29c1660e285 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] [instance: 98964e5a-9c6a-4be8-af79-95db246ebcc4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:42:11.645948 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9a6e4c44-8671-411a-9d86-b29c1660e285 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:11.648005 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9a6e4c44-8671-411a-9d86-b29c1660e285 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:11.648830 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9a6e4c44-8671-411a-9d86-b29c1660e285 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:11.651350 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9a6e4c44-8671-411a-9d86-b29c1660e285 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:11.652488 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9a6e4c44-8671-411a-9d86-b29c1660e285 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:11.653266 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9a6e4c44-8671-411a-9d86-b29c1660e285 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:11.998706 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9a6e4c44-8671-411a-9d86-b29c1660e285 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb78657f161443083d53a3b29fb4406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a56640b635e400694f60d00a5f922e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:42:12.010433 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9a6e4c44-8671-411a-9d86-b29c1660e285 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] 10.222.0.61 "GET /compute/v2.1/servers/98964e5a-9c6a-4be8-af79-95db246ebcc4" status: 200 len: 1270 microversion: 2.1 time: 0.389514 Aug 31 16:42:12.011492 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3216/6407] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:42:11 2022] GET /compute/v2.1/servers/98964e5a-9c6a-4be8-af79-95db246ebcc4 => generated 1270 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:42:12.071486 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-0bc30990-9af6-4839-8ecc-31486c24fc91 req-13f2312d-a9a4-4403-a707-791f9e11a11c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98964e5a-9c6a-4be8-af79-95db246ebcc4", "name": "network-vif-plugged", "status": "completed", "tag": "f5f846a4-ecbe-4e81-827a-e3a0fda3589e"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:42:12.090656 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-0bc30990-9af6-4839-8ecc-31486c24fc91 req-13f2312d-a9a4-4403-a707-791f9e11a11c service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:12.091433 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-0bc30990-9af6-4839-8ecc-31486c24fc91 req-13f2312d-a9a4-4403-a707-791f9e11a11c service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:12.092068 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-0bc30990-9af6-4839-8ecc-31486c24fc91 req-13f2312d-a9a4-4403-a707-791f9e11a11c service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:12.116374 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-0bc30990-9af6-4839-8ecc-31486c24fc91 req-13f2312d-a9a4-4403-a707-791f9e11a11c service nova] Creating event network-vif-plugged:f5f846a4-ecbe-4e81-827a-e3a0fda3589e for instance 98964e5a-9c6a-4be8-af79-95db246ebcc4 on n-h1-850499-9 Aug 31 16:42:12.123838 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-0bc30990-9af6-4839-8ecc-31486c24fc91 req-13f2312d-a9a4-4403-a707-791f9e11a11c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056877 Aug 31 16:42:12.125347 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3192/6408] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:42:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:42:12.226941 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9da2eef6-6548-4151-94c1-7faa53fc3d56 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:42:12.228311 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9da2eef6-6548-4151-94c1-7faa53fc3d56 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 4bc0d2c9-2a44-4f65-a780-d7ba828cea3a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:42:12.238372 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9da2eef6-6548-4151-94c1-7faa53fc3d56 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:12.240994 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9da2eef6-6548-4151-94c1-7faa53fc3d56 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:12.242306 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9da2eef6-6548-4151-94c1-7faa53fc3d56 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:12.246582 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9da2eef6-6548-4151-94c1-7faa53fc3d56 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:12.248560 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9da2eef6-6548-4151-94c1-7faa53fc3d56 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:12.250538 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9da2eef6-6548-4151-94c1-7faa53fc3d56 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:12.550369 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9da2eef6-6548-4151-94c1-7faa53fc3d56 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:42:12.562455 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9da2eef6-6548-4151-94c1-7faa53fc3d56 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/4bc0d2c9-2a44-4f65-a780-d7ba828cea3a" status: 200 len: 1390 microversion: 2.1 time: 0.340361 Aug 31 16:42:12.580718 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3217/6409] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:42:12 2022] GET /compute/v2.1/servers/4bc0d2c9-2a44-4f65-a780-d7ba828cea3a => generated 1390 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:42:12.590654 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3301d865-4a18-403b-885d-66d7d876d9e6 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:42:12.591670 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3301d865-4a18-403b-885d-66d7d876d9e6 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 4bc0d2c9-2a44-4f65-a780-d7ba828cea3a] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:42:12.601915 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3301d865-4a18-403b-885d-66d7d876d9e6 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:12.603050 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3301d865-4a18-403b-885d-66d7d876d9e6 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:12.603683 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3301d865-4a18-403b-885d-66d7d876d9e6 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:12.605694 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3301d865-4a18-403b-885d-66d7d876d9e6 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:12.606399 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3301d865-4a18-403b-885d-66d7d876d9e6 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:12.607247 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3301d865-4a18-403b-885d-66d7d876d9e6 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:12.814695 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3301d865-4a18-403b-885d-66d7d876d9e6 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:42:12.825636 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3301d865-4a18-403b-885d-66d7d876d9e6 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/4bc0d2c9-2a44-4f65-a780-d7ba828cea3a" status: 200 len: 1390 microversion: 2.1 time: 0.240775 Aug 31 16:42:12.826959 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3193/6410] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:42:12 2022] GET /compute/v2.1/servers/4bc0d2c9-2a44-4f65-a780-d7ba828cea3a => generated 1390 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:42:12.848962 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-eca38ee2-74d1-4ac7-adc2-aca0db1bdef8 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:42:12.850222 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-eca38ee2-74d1-4ac7-adc2-aca0db1bdef8 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 4bc0d2c9-2a44-4f65-a780-d7ba828cea3a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:42:12.862039 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eca38ee2-74d1-4ac7-adc2-aca0db1bdef8 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:12.865494 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eca38ee2-74d1-4ac7-adc2-aca0db1bdef8 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:12.866729 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eca38ee2-74d1-4ac7-adc2-aca0db1bdef8 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:12.867732 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eca38ee2-74d1-4ac7-adc2-aca0db1bdef8 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:12.868398 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eca38ee2-74d1-4ac7-adc2-aca0db1bdef8 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:12.869388 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eca38ee2-74d1-4ac7-adc2-aca0db1bdef8 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:13.032832 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5226729b-3d5b-4bc5-8710-e8146a385258 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:42:13.034033 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5226729b-3d5b-4bc5-8710-e8146a385258 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] [instance: 98964e5a-9c6a-4be8-af79-95db246ebcc4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:42:13.053041 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5226729b-3d5b-4bc5-8710-e8146a385258 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:13.053766 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5226729b-3d5b-4bc5-8710-e8146a385258 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:13.054863 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5226729b-3d5b-4bc5-8710-e8146a385258 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:13.055909 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5226729b-3d5b-4bc5-8710-e8146a385258 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:13.056638 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5226729b-3d5b-4bc5-8710-e8146a385258 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:13.057316 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5226729b-3d5b-4bc5-8710-e8146a385258 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:13.109799 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-eca38ee2-74d1-4ac7-adc2-aca0db1bdef8 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:42:13.123742 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-eca38ee2-74d1-4ac7-adc2-aca0db1bdef8 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/4bc0d2c9-2a44-4f65-a780-d7ba828cea3a" status: 200 len: 1390 microversion: 2.1 time: 0.279925 Aug 31 16:42:13.136306 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3218/6411] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:42:12 2022] GET /compute/v2.1/servers/4bc0d2c9-2a44-4f65-a780-d7ba828cea3a => generated 1390 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:42:13.150558 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5381837a-be59-465d-b48e-71a9caaf3d85 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:42:13.152151 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5381837a-be59-465d-b48e-71a9caaf3d85 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 4bc0d2c9-2a44-4f65-a780-d7ba828cea3a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:42:13.167699 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5381837a-be59-465d-b48e-71a9caaf3d85 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:13.168504 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5381837a-be59-465d-b48e-71a9caaf3d85 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:13.170202 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5381837a-be59-465d-b48e-71a9caaf3d85 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:13.171611 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5381837a-be59-465d-b48e-71a9caaf3d85 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:13.172545 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5381837a-be59-465d-b48e-71a9caaf3d85 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:13.173269 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5381837a-be59-465d-b48e-71a9caaf3d85 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:13.212246 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5381837a-be59-465d-b48e-71a9caaf3d85 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 4bc0d2c9-2a44-4f65-a780-d7ba828cea3a] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:42:13.361034 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5381837a-be59-465d-b48e-71a9caaf3d85 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "DELETE /compute/v2.1/servers/4bc0d2c9-2a44-4f65-a780-d7ba828cea3a" status: 204 len: 0 microversion: 2.1 time: 0.216866 Aug 31 16:42:13.362602 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3219/6412] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:42:13 2022] DELETE /compute/v2.1/servers/4bc0d2c9-2a44-4f65-a780-d7ba828cea3a => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:42:13.382982 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8faeeb37-a2e4-4cc4-94f1-360e1d55f48e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:42:13.391785 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8faeeb37-a2e4-4cc4-94f1-360e1d55f48e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 4bc0d2c9-2a44-4f65-a780-d7ba828cea3a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:42:13.404382 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8faeeb37-a2e4-4cc4-94f1-360e1d55f48e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:13.409484 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8faeeb37-a2e4-4cc4-94f1-360e1d55f48e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:13.410289 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8faeeb37-a2e4-4cc4-94f1-360e1d55f48e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:13.411031 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8faeeb37-a2e4-4cc4-94f1-360e1d55f48e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:13.411522 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8faeeb37-a2e4-4cc4-94f1-360e1d55f48e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:13.411944 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8faeeb37-a2e4-4cc4-94f1-360e1d55f48e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:13.450208 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:42:13.545357 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5226729b-3d5b-4bc5-8710-e8146a385258 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb78657f161443083d53a3b29fb4406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a56640b635e400694f60d00a5f922e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:42:13.560207 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5226729b-3d5b-4bc5-8710-e8146a385258 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] 10.222.0.61 "GET /compute/v2.1/servers/98964e5a-9c6a-4be8-af79-95db246ebcc4" status: 200 len: 1270 microversion: 2.1 time: 0.531077 Aug 31 16:42:13.561771 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3194/6413] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:42:13 2022] GET /compute/v2.1/servers/98964e5a-9c6a-4be8-af79-95db246ebcc4 => generated 1270 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:42:13.630936 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8faeeb37-a2e4-4cc4-94f1-360e1d55f48e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:42:13.640408 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8faeeb37-a2e4-4cc4-94f1-360e1d55f48e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/4bc0d2c9-2a44-4f65-a780-d7ba828cea3a" status: 200 len: 1396 microversion: 2.1 time: 0.263937 Aug 31 16:42:13.641517 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3220/6414] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:42:13 2022] GET /compute/v2.1/servers/4bc0d2c9-2a44-4f65-a780-d7ba828cea3a => generated 1396 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:42:14.582921 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b510a264-cc91-4fdb-abeb-c45203b8c054 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:42:14.584524 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b510a264-cc91-4fdb-abeb-c45203b8c054 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] [instance: 98964e5a-9c6a-4be8-af79-95db246ebcc4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:42:14.593416 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b510a264-cc91-4fdb-abeb-c45203b8c054 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:14.594121 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b510a264-cc91-4fdb-abeb-c45203b8c054 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:14.594631 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b510a264-cc91-4fdb-abeb-c45203b8c054 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:14.595342 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b510a264-cc91-4fdb-abeb-c45203b8c054 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:14.595836 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b510a264-cc91-4fdb-abeb-c45203b8c054 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:14.596264 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b510a264-cc91-4fdb-abeb-c45203b8c054 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:14.664325 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1de01df8-b933-41a8-a238-beb289395dcb tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:42:14.665056 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1de01df8-b933-41a8-a238-beb289395dcb tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 4bc0d2c9-2a44-4f65-a780-d7ba828cea3a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:42:14.672902 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1de01df8-b933-41a8-a238-beb289395dcb tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:14.673712 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1de01df8-b933-41a8-a238-beb289395dcb tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:14.674359 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1de01df8-b933-41a8-a238-beb289395dcb tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:14.675300 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1de01df8-b933-41a8-a238-beb289395dcb tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:14.676014 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1de01df8-b933-41a8-a238-beb289395dcb tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:14.676787 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1de01df8-b933-41a8-a238-beb289395dcb tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:14.884041 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b510a264-cc91-4fdb-abeb-c45203b8c054 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb78657f161443083d53a3b29fb4406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a56640b635e400694f60d00a5f922e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:42:14.888965 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=100 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:42:14.901850 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b510a264-cc91-4fdb-abeb-c45203b8c054 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] 10.222.0.61 "GET /compute/v2.1/servers/98964e5a-9c6a-4be8-af79-95db246ebcc4" status: 200 len: 1459 microversion: 2.1 time: 0.323454 Aug 31 16:42:14.904088 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3195/6415] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:42:14 2022] GET /compute/v2.1/servers/98964e5a-9c6a-4be8-af79-95db246ebcc4 => generated 1459 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:42:14.930409 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b8954fc8-d2b6-46b7-b821-b302c9fa0943 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:42:14.930990 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b8954fc8-d2b6-46b7-b821-b302c9fa0943 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] [instance: 98964e5a-9c6a-4be8-af79-95db246ebcc4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:42:14.954820 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-1de01df8-b933-41a8-a238-beb289395dcb tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:42:14.955709 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b8954fc8-d2b6-46b7-b821-b302c9fa0943 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:14.956221 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b8954fc8-d2b6-46b7-b821-b302c9fa0943 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:14.956671 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b8954fc8-d2b6-46b7-b821-b302c9fa0943 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:14.957390 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b8954fc8-d2b6-46b7-b821-b302c9fa0943 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:14.957852 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b8954fc8-d2b6-46b7-b821-b302c9fa0943 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:14.958280 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b8954fc8-d2b6-46b7-b821-b302c9fa0943 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:14.971584 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1de01df8-b933-41a8-a238-beb289395dcb tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/4bc0d2c9-2a44-4f65-a780-d7ba828cea3a" status: 200 len: 1396 microversion: 2.1 time: 0.311921 Aug 31 16:42:14.990741 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3221/6416] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:42:14 2022] GET /compute/v2.1/servers/4bc0d2c9-2a44-4f65-a780-d7ba828cea3a => generated 1396 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:42:15.185104 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b8954fc8-d2b6-46b7-b821-b302c9fa0943 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb78657f161443083d53a3b29fb4406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a56640b635e400694f60d00a5f922e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:42:15.197046 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b8954fc8-d2b6-46b7-b821-b302c9fa0943 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] 10.222.0.61 "GET /compute/v2.1/servers/98964e5a-9c6a-4be8-af79-95db246ebcc4" status: 200 len: 1459 microversion: 2.1 time: 0.270697 Aug 31 16:42:15.198180 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3196/6417] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:42:14 2022] GET /compute/v2.1/servers/98964e5a-9c6a-4be8-af79-95db246ebcc4 => generated 1459 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:42:16.002396 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-61e01493-bd8c-4494-99c0-d80fd22656b6 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:42:16.004587 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-61e01493-bd8c-4494-99c0-d80fd22656b6 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 4bc0d2c9-2a44-4f65-a780-d7ba828cea3a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:42:16.019784 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-61e01493-bd8c-4494-99c0-d80fd22656b6 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:16.021066 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-61e01493-bd8c-4494-99c0-d80fd22656b6 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:16.021974 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-61e01493-bd8c-4494-99c0-d80fd22656b6 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:16.023954 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-61e01493-bd8c-4494-99c0-d80fd22656b6 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:16.024577 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-61e01493-bd8c-4494-99c0-d80fd22656b6 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:16.025496 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-61e01493-bd8c-4494-99c0-d80fd22656b6 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:16.415784 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-61e01493-bd8c-4494-99c0-d80fd22656b6 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:42:16.427311 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-61e01493-bd8c-4494-99c0-d80fd22656b6 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/4bc0d2c9-2a44-4f65-a780-d7ba828cea3a" status: 200 len: 1396 microversion: 2.1 time: 0.431667 Aug 31 16:42:16.436060 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3222/6418] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:42:15 2022] GET /compute/v2.1/servers/4bc0d2c9-2a44-4f65-a780-d7ba828cea3a => generated 1396 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:42:16.655310 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-b2c33810-d987-4710-8a7b-5f3731fb4cac req-8d54cb03-d51e-454a-b5e7-c9653ea59068 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bc0d2c9-2a44-4f65-a780-d7ba828cea3a", "name": "network-vif-deleted", "tag": "08232de5-98ba-470b-afde-6772fc90c184"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:42:16.686590 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-b2c33810-d987-4710-8a7b-5f3731fb4cac req-8d54cb03-d51e-454a-b5e7-c9653ea59068 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:16.691236 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-b2c33810-d987-4710-8a7b-5f3731fb4cac req-8d54cb03-d51e-454a-b5e7-c9653ea59068 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:16.691792 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-b2c33810-d987-4710-8a7b-5f3731fb4cac req-8d54cb03-d51e-454a-b5e7-c9653ea59068 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:16.738172 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-b2c33810-d987-4710-8a7b-5f3731fb4cac req-8d54cb03-d51e-454a-b5e7-c9653ea59068 service nova] Creating event network-vif-deleted:08232de5-98ba-470b-afde-6772fc90c184 for instance 4bc0d2c9-2a44-4f65-a780-d7ba828cea3a on n-h2-850499-9 Aug 31 16:42:16.761151 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-b2c33810-d987-4710-8a7b-5f3731fb4cac req-8d54cb03-d51e-454a-b5e7-c9653ea59068 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112087 Aug 31 16:42:16.766306 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3197/6419] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:42:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:42:17.459122 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-af4865bf-7066-466d-adc9-f1fe5287e7ae tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:42:17.459782 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-af4865bf-7066-466d-adc9-f1fe5287e7ae tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 4bc0d2c9-2a44-4f65-a780-d7ba828cea3a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:42:17.481999 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-af4865bf-7066-466d-adc9-f1fe5287e7ae tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:17.484100 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-af4865bf-7066-466d-adc9-f1fe5287e7ae tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:17.484393 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-af4865bf-7066-466d-adc9-f1fe5287e7ae tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:17.485155 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-af4865bf-7066-466d-adc9-f1fe5287e7ae tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:17.485626 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-af4865bf-7066-466d-adc9-f1fe5287e7ae tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:17.486042 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-af4865bf-7066-466d-adc9-f1fe5287e7ae tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:17.856181 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-af4865bf-7066-466d-adc9-f1fe5287e7ae tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:42:17.886895 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-af4865bf-7066-466d-adc9-f1fe5287e7ae tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/4bc0d2c9-2a44-4f65-a780-d7ba828cea3a" status: 200 len: 1188 microversion: 2.1 time: 0.431766 Aug 31 16:42:17.903255 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3223/6420] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:42:17 2022] GET /compute/v2.1/servers/4bc0d2c9-2a44-4f65-a780-d7ba828cea3a => generated 1188 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:42:18.915956 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ff94e3a6-50ab-4343-ba98-bbd4246e4276 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:42:18.916817 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ff94e3a6-50ab-4343-ba98-bbd4246e4276 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 4bc0d2c9-2a44-4f65-a780-d7ba828cea3a] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:42:18.933453 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ff94e3a6-50ab-4343-ba98-bbd4246e4276 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:18.933871 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ff94e3a6-50ab-4343-ba98-bbd4246e4276 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:18.934510 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ff94e3a6-50ab-4343-ba98-bbd4246e4276 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:18.935459 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ff94e3a6-50ab-4343-ba98-bbd4246e4276 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:18.936367 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ff94e3a6-50ab-4343-ba98-bbd4246e4276 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:18.936954 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ff94e3a6-50ab-4343-ba98-bbd4246e4276 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:19.074218 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ff94e3a6-50ab-4343-ba98-bbd4246e4276 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:42:19.082520 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ff94e3a6-50ab-4343-ba98-bbd4246e4276 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/4bc0d2c9-2a44-4f65-a780-d7ba828cea3a" status: 200 len: 1188 microversion: 2.1 time: 0.177038 Aug 31 16:42:19.088376 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3198/6421] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:42:18 2022] GET /compute/v2.1/servers/4bc0d2c9-2a44-4f65-a780-d7ba828cea3a => generated 1188 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:42:19.500203 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-83600a18-358b-40f9-abd2-9ba38485156f req-9d0a1681-b307-45da-b5c1-972e8a48f6cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98964e5a-9c6a-4be8-af79-95db246ebcc4", "tag": "f5f846a4-ecbe-4e81-827a-e3a0fda3589e"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:42:19.537032 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-83600a18-358b-40f9-abd2-9ba38485156f req-9d0a1681-b307-45da-b5c1-972e8a48f6cb service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:19.544524 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-83600a18-358b-40f9-abd2-9ba38485156f req-9d0a1681-b307-45da-b5c1-972e8a48f6cb service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:19.545227 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-83600a18-358b-40f9-abd2-9ba38485156f req-9d0a1681-b307-45da-b5c1-972e8a48f6cb service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:19.597028 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-83600a18-358b-40f9-abd2-9ba38485156f req-9d0a1681-b307-45da-b5c1-972e8a48f6cb service nova] Creating event network-changed:f5f846a4-ecbe-4e81-827a-e3a0fda3589e for instance 98964e5a-9c6a-4be8-af79-95db246ebcc4 on n-h1-850499-9 Aug 31 16:42:19.624003 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-83600a18-358b-40f9-abd2-9ba38485156f req-9d0a1681-b307-45da-b5c1-972e8a48f6cb service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128440 Aug 31 16:42:19.624773 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3224/6422] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:42:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:42:20.111361 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-727d033d-9539-4071-9da8-521c6f94cac8 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:42:20.121525 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-727d033d-9539-4071-9da8-521c6f94cac8 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 4bc0d2c9-2a44-4f65-a780-d7ba828cea3a] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:42:20.157806 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-727d033d-9539-4071-9da8-521c6f94cac8 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:20.161094 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-727d033d-9539-4071-9da8-521c6f94cac8 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:20.161777 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-727d033d-9539-4071-9da8-521c6f94cac8 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:20.167901 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-727d033d-9539-4071-9da8-521c6f94cac8 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:20.168628 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-727d033d-9539-4071-9da8-521c6f94cac8 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:20.170503 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-727d033d-9539-4071-9da8-521c6f94cac8 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:20.367036 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-727d033d-9539-4071-9da8-521c6f94cac8 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:42:20.376637 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-727d033d-9539-4071-9da8-521c6f94cac8 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/4bc0d2c9-2a44-4f65-a780-d7ba828cea3a" status: 200 len: 1188 microversion: 2.1 time: 0.269796 Aug 31 16:42:20.400139 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3199/6423] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:42:20 2022] GET /compute/v2.1/servers/4bc0d2c9-2a44-4f65-a780-d7ba828cea3a => generated 1188 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:42:21.424740 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-23f4c3e4-d471-4668-a013-49de74864865 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:42:21.425847 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-23f4c3e4-d471-4668-a013-49de74864865 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 4bc0d2c9-2a44-4f65-a780-d7ba828cea3a] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:42:21.445954 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-23f4c3e4-d471-4668-a013-49de74864865 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:21.446806 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-23f4c3e4-d471-4668-a013-49de74864865 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:21.447452 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-23f4c3e4-d471-4668-a013-49de74864865 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:21.448383 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-23f4c3e4-d471-4668-a013-49de74864865 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:21.450660 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-23f4c3e4-d471-4668-a013-49de74864865 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:21.451308 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-23f4c3e4-d471-4668-a013-49de74864865 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:21.795945 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-23f4c3e4-d471-4668-a013-49de74864865 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:42:21.811013 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-23f4c3e4-d471-4668-a013-49de74864865 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/4bc0d2c9-2a44-4f65-a780-d7ba828cea3a" status: 200 len: 1188 microversion: 2.1 time: 0.390432 Aug 31 16:42:21.835537 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3225/6424] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:42:21 2022] GET /compute/v2.1/servers/4bc0d2c9-2a44-4f65-a780-d7ba828cea3a => generated 1188 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:42:22.839492 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2284b811-a7e0-417a-a08b-b19fbfc09517 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:42:22.842296 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2284b811-a7e0-417a-a08b-b19fbfc09517 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 4bc0d2c9-2a44-4f65-a780-d7ba828cea3a] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:42:22.892163 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2284b811-a7e0-417a-a08b-b19fbfc09517 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:22.892163 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2284b811-a7e0-417a-a08b-b19fbfc09517 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:22.892445 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2284b811-a7e0-417a-a08b-b19fbfc09517 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:22.893251 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2284b811-a7e0-417a-a08b-b19fbfc09517 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:22.893725 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2284b811-a7e0-417a-a08b-b19fbfc09517 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:22.894166 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2284b811-a7e0-417a-a08b-b19fbfc09517 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:23.247763 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-2284b811-a7e0-417a-a08b-b19fbfc09517 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:42:23.266245 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2284b811-a7e0-417a-a08b-b19fbfc09517 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/4bc0d2c9-2a44-4f65-a780-d7ba828cea3a" status: 200 len: 1188 microversion: 2.1 time: 0.431319 Aug 31 16:42:23.279534 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3200/6425] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:42:22 2022] GET /compute/v2.1/servers/4bc0d2c9-2a44-4f65-a780-d7ba828cea3a => generated 1188 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:42:23.373246 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-e0d3125a-6bd9-47a2-af75-b93efc3e6e5c req-2e96a551-540e-42a8-9dd9-5af1f0d52d45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98964e5a-9c6a-4be8-af79-95db246ebcc4", "tag": "f5f846a4-ecbe-4e81-827a-e3a0fda3589e"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:42:23.402553 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-e0d3125a-6bd9-47a2-af75-b93efc3e6e5c req-2e96a551-540e-42a8-9dd9-5af1f0d52d45 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:23.407359 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-e0d3125a-6bd9-47a2-af75-b93efc3e6e5c req-2e96a551-540e-42a8-9dd9-5af1f0d52d45 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:23.408544 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-e0d3125a-6bd9-47a2-af75-b93efc3e6e5c req-2e96a551-540e-42a8-9dd9-5af1f0d52d45 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:23.443730 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-e0d3125a-6bd9-47a2-af75-b93efc3e6e5c req-2e96a551-540e-42a8-9dd9-5af1f0d52d45 service nova] Creating event network-changed:f5f846a4-ecbe-4e81-827a-e3a0fda3589e for instance 98964e5a-9c6a-4be8-af79-95db246ebcc4 on n-h1-850499-9 Aug 31 16:42:23.470487 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-e0d3125a-6bd9-47a2-af75-b93efc3e6e5c req-2e96a551-540e-42a8-9dd9-5af1f0d52d45 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100965 Aug 31 16:42:23.488556 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3226/6426] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:42:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:42:24.291871 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f5039a66-461a-475b-a40b-b5a30fdce19d tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:42:24.293079 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f5039a66-461a-475b-a40b-b5a30fdce19d tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 4bc0d2c9-2a44-4f65-a780-d7ba828cea3a] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:42:24.311795 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f5039a66-461a-475b-a40b-b5a30fdce19d tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:24.313417 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f5039a66-461a-475b-a40b-b5a30fdce19d tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:24.322609 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f5039a66-461a-475b-a40b-b5a30fdce19d tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:24.325021 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f5039a66-461a-475b-a40b-b5a30fdce19d tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:24.327083 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f5039a66-461a-475b-a40b-b5a30fdce19d tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:24.331382 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f5039a66-461a-475b-a40b-b5a30fdce19d tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:24.591115 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f5039a66-461a-475b-a40b-b5a30fdce19d tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:42:24.599385 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f5039a66-461a-475b-a40b-b5a30fdce19d tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/4bc0d2c9-2a44-4f65-a780-d7ba828cea3a" status: 200 len: 1188 microversion: 2.1 time: 0.312099 Aug 31 16:42:24.614265 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3201/6427] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:42:24 2022] GET /compute/v2.1/servers/4bc0d2c9-2a44-4f65-a780-d7ba828cea3a => generated 1188 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:42:25.552973 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-75ab0732-b3bc-4e2e-95cb-a8e4bd9ca033 req-85d89996-4e40-4ca2-bad3-51236a4b942d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98964e5a-9c6a-4be8-af79-95db246ebcc4", "tag": "f5f846a4-ecbe-4e81-827a-e3a0fda3589e"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:42:25.575632 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-75ab0732-b3bc-4e2e-95cb-a8e4bd9ca033 req-85d89996-4e40-4ca2-bad3-51236a4b942d service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:25.576127 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-75ab0732-b3bc-4e2e-95cb-a8e4bd9ca033 req-85d89996-4e40-4ca2-bad3-51236a4b942d service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:25.576577 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-75ab0732-b3bc-4e2e-95cb-a8e4bd9ca033 req-85d89996-4e40-4ca2-bad3-51236a4b942d service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:25.616966 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-75ab0732-b3bc-4e2e-95cb-a8e4bd9ca033 req-85d89996-4e40-4ca2-bad3-51236a4b942d service nova] Creating event network-changed:f5f846a4-ecbe-4e81-827a-e3a0fda3589e for instance 98964e5a-9c6a-4be8-af79-95db246ebcc4 on n-h1-850499-9 Aug 31 16:42:25.629299 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a32c69bc-ac75-4d8b-89fb-59f47151ad2b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:42:25.631194 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-75ab0732-b3bc-4e2e-95cb-a8e4bd9ca033 req-85d89996-4e40-4ca2-bad3-51236a4b942d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083120 Aug 31 16:42:25.631836 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3227/6428] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:42:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:42:25.639468 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a32c69bc-ac75-4d8b-89fb-59f47151ad2b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 4bc0d2c9-2a44-4f65-a780-d7ba828cea3a] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:42:25.653058 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a32c69bc-ac75-4d8b-89fb-59f47151ad2b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:25.659766 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a32c69bc-ac75-4d8b-89fb-59f47151ad2b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:25.662199 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a32c69bc-ac75-4d8b-89fb-59f47151ad2b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:25.663219 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a32c69bc-ac75-4d8b-89fb-59f47151ad2b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:25.665616 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a32c69bc-ac75-4d8b-89fb-59f47151ad2b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:25.670174 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a32c69bc-ac75-4d8b-89fb-59f47151ad2b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:25.705238 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-a32c69bc-ac75-4d8b-89fb-59f47151ad2b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] HTTP exception thrown: Instance 4bc0d2c9-2a44-4f65-a780-d7ba828cea3a could not be found. Aug 31 16:42:25.707722 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a32c69bc-ac75-4d8b-89fb-59f47151ad2b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Request method failure captured: Aug 31 16:42:25.707722 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/4bc0d2c9-2a44-4f65-a780-d7ba828cea3a HTTP/1.1 Aug 31 16:42:25.707722 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:42:25.707722 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:42:25.707722 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:42:25.707722 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:42:25.707722 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:42:25.707722 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:42:25.707722 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:42:25.707722 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:42:25.707722 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD47qS8C6HsXEaEmR5vEYZ6_LcYWck6kjg2PE2Sm6XicPmZbBvnd8kXBk0kFrhGPgu84OodaxIz7Gcm1qVV62nKCQjCd-8My5krh8bw3lC-5obyJ5MI9WGooafg2qsKoEyqO0fUDn4HqdbQ-uRSMHzaJZriF8vfhIimZHzzbd5tR6Fco Aug 31 16:42:25.707722 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:42:25.707722 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:42:25.707722 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:42:25.707722 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:42:25.707722 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:42:25.707722 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:42:25.707722 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 798d7eff58b04ab582bac1e87112625f Aug 31 16:42:25.707722 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-TestVolumeBootPattern-1074913281 Aug 31 16:42:25.707722 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:42:25.707722 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:42:25.707722 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/798d7eff58b04ab582bac1e87112625f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/798d7eff58b04ab582bac1e87112625f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_798d7eff58b04ab582bac1e87112625f", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/798d7eff58b04ab582bac1e87112625f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:42:25.707722 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-TestVolumeBootPattern-1074913281 Aug 31 16:42:25.707722 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 798d7eff58b04ab582bac1e87112625f Aug 31 16:42:25.707722 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-TestVolumeBootPattern-1074913281 Aug 31 16:42:25.707722 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-TestVolumeBootPattern-1074913281-project Aug 31 16:42:25.707722 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:42:25.707722 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:42:25.707722 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 588d2ef08d8345a6b6175c8287633270 Aug 31 16:42:25.707722 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-TestVolumeBootPattern-1074913281-project Aug 31 16:42:25.707722 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:42:25.707722 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance 4bc0d2c9-2a44-4f65-a780-d7ba828cea3a could not be found. Aug 31 16:42:25.707722 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '4bc0d2c9-2a44-4f65-a780-d7ba828cea3a'} Aug 31 16:42:25.707722 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:42:25.707722 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:42:25.707722 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:42:25.707722 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:42:25.707722 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:42:25.707722 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:42:25.707722 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:42:25.707722 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:42:25.707722 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:42:25.707722 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:42:25.707722 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4bc0d2c9-2a44-4f65-a780-d7ba828cea3a could not be found. Aug 31 16:42:25.707722 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:42:25.707722 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:42:25.707722 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:42:25.707722 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:42:25.707722 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:42:25.707722 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:42:25.707722 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:42:25.707722 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:42:25.707722 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:42:25.707722 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:42:25.707722 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:42:25.707722 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:42:25.707722 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:42:25.707722 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:42:25.707722 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:42:25.707722 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:42:25.707722 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4bc0d2c9-2a44-4f65-a780-d7ba828cea3a could not be found. Aug 31 16:42:25.707722 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:42:25.707722 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:42:25.707722 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:42:25.712815 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:42:25.712815 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:42:25.712815 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:42:25.712815 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:42:25.712815 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:42:25.712815 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4bc0d2c9-2a44-4f65-a780-d7ba828cea3a could not be found. Aug 31 16:42:25.712815 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:42:25.714961 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a32c69bc-ac75-4d8b-89fb-59f47151ad2b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Returning 404 to user: Instance 4bc0d2c9-2a44-4f65-a780-d7ba828cea3a could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:42:25.718304 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a32c69bc-ac75-4d8b-89fb-59f47151ad2b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/4bc0d2c9-2a44-4f65-a780-d7ba828cea3a" status: 404 len: 111 microversion: 2.1 time: 0.093858 Aug 31 16:42:25.721734 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3202/6429] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:42:25 2022] GET /compute/v2.1/servers/4bc0d2c9-2a44-4f65-a780-d7ba828cea3a => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 16:42:27.501553 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9089cdf0-7044-4cca-aba0-c11af0b29d04 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:42:27.502698 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9089cdf0-7044-4cca-aba0-c11af0b29d04 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] [instance: fb32933d-0171-42db-bf84-4478f79b5b84] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:42:27.513983 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9089cdf0-7044-4cca-aba0-c11af0b29d04 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:27.515633 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9089cdf0-7044-4cca-aba0-c11af0b29d04 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:27.516310 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9089cdf0-7044-4cca-aba0-c11af0b29d04 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:27.518979 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9089cdf0-7044-4cca-aba0-c11af0b29d04 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:27.519564 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9089cdf0-7044-4cca-aba0-c11af0b29d04 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:27.534460 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9089cdf0-7044-4cca-aba0-c11af0b29d04 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:27.578351 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9089cdf0-7044-4cca-aba0-c11af0b29d04 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] [instance: fb32933d-0171-42db-bf84-4478f79b5b84] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:42:27.705351 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9089cdf0-7044-4cca-aba0-c11af0b29d04 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] 10.222.0.61 "DELETE /compute/v2.1/servers/fb32933d-0171-42db-bf84-4478f79b5b84" status: 204 len: 0 microversion: 2.1 time: 0.209390 Aug 31 16:42:27.710282 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3228/6430] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:42:27 2022] DELETE /compute/v2.1/servers/fb32933d-0171-42db-bf84-4478f79b5b84 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:42:27.715218 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c26d64f4-e12a-4fe0-9621-a6764c3d694a tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:42:27.716067 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c26d64f4-e12a-4fe0-9621-a6764c3d694a tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] [instance: fb32933d-0171-42db-bf84-4478f79b5b84] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:42:27.729606 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c26d64f4-e12a-4fe0-9621-a6764c3d694a tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:27.736571 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c26d64f4-e12a-4fe0-9621-a6764c3d694a tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:27.737334 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c26d64f4-e12a-4fe0-9621-a6764c3d694a tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:27.738249 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c26d64f4-e12a-4fe0-9621-a6764c3d694a tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:27.738867 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c26d64f4-e12a-4fe0-9621-a6764c3d694a tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:27.739463 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c26d64f4-e12a-4fe0-9621-a6764c3d694a tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:27.950450 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c26d64f4-e12a-4fe0-9621-a6764c3d694a tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e026a8cdb13f47de942566a2d4a10bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5827544f2e140e3b44d712d1623a06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:42:27.964318 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c26d64f4-e12a-4fe0-9621-a6764c3d694a tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] 10.222.0.61 "GET /compute/v2.1/servers/fb32933d-0171-42db-bf84-4478f79b5b84" status: 200 len: 1554 microversion: 2.1 time: 0.252979 Aug 31 16:42:27.965864 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3203/6431] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:42:27 2022] GET /compute/v2.1/servers/fb32933d-0171-42db-bf84-4478f79b5b84 => generated 1554 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:42:28.988595 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-04ae45d1-96f3-407f-aabf-4eac9ce27a9b tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:42:28.989986 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-04ae45d1-96f3-407f-aabf-4eac9ce27a9b tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] [instance: fb32933d-0171-42db-bf84-4478f79b5b84] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:42:29.005650 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-04ae45d1-96f3-407f-aabf-4eac9ce27a9b tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:29.006463 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-04ae45d1-96f3-407f-aabf-4eac9ce27a9b tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:29.007145 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-04ae45d1-96f3-407f-aabf-4eac9ce27a9b tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:29.009193 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-04ae45d1-96f3-407f-aabf-4eac9ce27a9b tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:29.009879 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-04ae45d1-96f3-407f-aabf-4eac9ce27a9b tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:29.010524 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-04ae45d1-96f3-407f-aabf-4eac9ce27a9b tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:29.275684 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-04ae45d1-96f3-407f-aabf-4eac9ce27a9b tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e026a8cdb13f47de942566a2d4a10bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5827544f2e140e3b44d712d1623a06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:42:29.296893 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-04ae45d1-96f3-407f-aabf-4eac9ce27a9b tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] 10.222.0.61 "GET /compute/v2.1/servers/fb32933d-0171-42db-bf84-4478f79b5b84" status: 200 len: 1554 microversion: 2.1 time: 0.312777 Aug 31 16:42:29.315073 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3229/6432] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:42:28 2022] GET /compute/v2.1/servers/fb32933d-0171-42db-bf84-4478f79b5b84 => generated 1554 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:42:30.197081 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-21c36200-d973-4d79-84e7-c881f2fb8511 req-ec7e58e7-7e5c-4cb4-9a93-8ef1a79973ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb32933d-0171-42db-bf84-4478f79b5b84", "name": "network-vif-deleted", "tag": "6f483704-a7fd-4e73-97f9-fa2a4522894b"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:42:30.225535 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-21c36200-d973-4d79-84e7-c881f2fb8511 req-ec7e58e7-7e5c-4cb4-9a93-8ef1a79973ab service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:30.226205 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-21c36200-d973-4d79-84e7-c881f2fb8511 req-ec7e58e7-7e5c-4cb4-9a93-8ef1a79973ab service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:30.226834 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-21c36200-d973-4d79-84e7-c881f2fb8511 req-ec7e58e7-7e5c-4cb4-9a93-8ef1a79973ab service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:30.264383 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-21c36200-d973-4d79-84e7-c881f2fb8511 req-ec7e58e7-7e5c-4cb4-9a93-8ef1a79973ab service nova] Creating event network-vif-deleted:6f483704-a7fd-4e73-97f9-fa2a4522894b for instance fb32933d-0171-42db-bf84-4478f79b5b84 on n-h1-850499-9 Aug 31 16:42:30.276126 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-21c36200-d973-4d79-84e7-c881f2fb8511 req-ec7e58e7-7e5c-4cb4-9a93-8ef1a79973ab service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080359 Aug 31 16:42:30.293360 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3204/6433] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:42:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:42:30.321880 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1e47934d-3d46-4268-ba91-6850f53626eb tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:42:30.323194 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1e47934d-3d46-4268-ba91-6850f53626eb tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] [instance: fb32933d-0171-42db-bf84-4478f79b5b84] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:42:30.334718 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1e47934d-3d46-4268-ba91-6850f53626eb tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:30.335151 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1e47934d-3d46-4268-ba91-6850f53626eb tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:30.336792 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1e47934d-3d46-4268-ba91-6850f53626eb tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:30.337561 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1e47934d-3d46-4268-ba91-6850f53626eb tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:30.338522 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1e47934d-3d46-4268-ba91-6850f53626eb tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:30.338970 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1e47934d-3d46-4268-ba91-6850f53626eb tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:30.393253 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1e47934d-3d46-4268-ba91-6850f53626eb tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:30.394081 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1e47934d-3d46-4268-ba91-6850f53626eb tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:30.394722 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1e47934d-3d46-4268-ba91-6850f53626eb tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:30.395560 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-1e47934d-3d46-4268-ba91-6850f53626eb tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lazy-loading 'fault' on Instance uuid fb32933d-0171-42db-bf84-4478f79b5b84 {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:42:30.486790 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-1e47934d-3d46-4268-ba91-6850f53626eb tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e026a8cdb13f47de942566a2d4a10bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5827544f2e140e3b44d712d1623a06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:42:30.497270 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1e47934d-3d46-4268-ba91-6850f53626eb tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] 10.222.0.61 "GET /compute/v2.1/servers/fb32933d-0171-42db-bf84-4478f79b5b84" status: 200 len: 1339 microversion: 2.1 time: 0.180296 Aug 31 16:42:30.512116 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3230/6434] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:42:30 2022] GET /compute/v2.1/servers/fb32933d-0171-42db-bf84-4478f79b5b84 => generated 1339 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:42:31.527102 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-464c293b-a596-4f8b-b112-3cef2abd402f tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:42:31.527969 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-464c293b-a596-4f8b-b112-3cef2abd402f tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] [instance: fb32933d-0171-42db-bf84-4478f79b5b84] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:42:31.543195 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=44 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:42:31.549583 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-464c293b-a596-4f8b-b112-3cef2abd402f tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:31.550100 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-464c293b-a596-4f8b-b112-3cef2abd402f tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:31.550557 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-464c293b-a596-4f8b-b112-3cef2abd402f tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:31.557932 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-464c293b-a596-4f8b-b112-3cef2abd402f tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:31.558516 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-464c293b-a596-4f8b-b112-3cef2abd402f tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:31.558976 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-464c293b-a596-4f8b-b112-3cef2abd402f tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:31.580994 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-464c293b-a596-4f8b-b112-3cef2abd402f tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] HTTP exception thrown: Instance fb32933d-0171-42db-bf84-4478f79b5b84 could not be found. Aug 31 16:42:31.582654 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-464c293b-a596-4f8b-b112-3cef2abd402f tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Request method failure captured: Aug 31 16:42:31.582654 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/fb32933d-0171-42db-bf84-4478f79b5b84 HTTP/1.1 Aug 31 16:42:31.582654 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:42:31.582654 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:42:31.582654 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:42:31.582654 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:42:31.582654 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:42:31.582654 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:42:31.582654 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:42:31.582654 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:42:31.582654 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD46rwOUEviGXuYxpZgSVURhps4NGkPVIqF2NJA-5oDNILjyJvt-UCh7SiDQC1vZICAn6MmYucoePj2smr1WU3xP6XDZtQ9AGQV5q1r3ix0V4Roil5rik0wF3QGAD0HzPIHO87EMxvw8RQzgKQTUgLtLLQQRncoe_TCqBLYeARe6G0gU Aug 31 16:42:31.582654 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:42:31.582654 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:42:31.582654 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:42:31.582654 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:42:31.582654 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:42:31.582654 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:42:31.582654 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: b5827544f2e140e3b44d712d1623a06b Aug 31 16:42:31.582654 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-TestNetworkBasicOps-225290997 Aug 31 16:42:31.582654 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:42:31.582654 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:42:31.582654 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b5827544f2e140e3b44d712d1623a06b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/b5827544f2e140e3b44d712d1623a06b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_b5827544f2e140e3b44d712d1623a06b", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b5827544f2e140e3b44d712d1623a06b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:42:31.582654 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-TestNetworkBasicOps-225290997 Aug 31 16:42:31.582654 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: b5827544f2e140e3b44d712d1623a06b Aug 31 16:42:31.582654 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-TestNetworkBasicOps-225290997 Aug 31 16:42:31.582654 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-TestNetworkBasicOps-225290997-project Aug 31 16:42:31.582654 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:42:31.582654 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:42:31.582654 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: e026a8cdb13f47de942566a2d4a10bc8 Aug 31 16:42:31.582654 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-TestNetworkBasicOps-225290997-project Aug 31 16:42:31.582654 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:42:31.582654 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance fb32933d-0171-42db-bf84-4478f79b5b84 could not be found. Aug 31 16:42:31.582654 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': 'fb32933d-0171-42db-bf84-4478f79b5b84'} Aug 31 16:42:31.582654 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:42:31.582654 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:42:31.582654 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:42:31.582654 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:42:31.582654 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:42:31.582654 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:42:31.582654 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:42:31.582654 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:42:31.582654 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:42:31.582654 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:42:31.582654 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb32933d-0171-42db-bf84-4478f79b5b84 could not be found. Aug 31 16:42:31.582654 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:42:31.582654 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:42:31.582654 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:42:31.582654 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:42:31.582654 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:42:31.582654 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:42:31.582654 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:42:31.582654 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:42:31.582654 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:42:31.582654 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:42:31.582654 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:42:31.582654 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:42:31.582654 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:42:31.582654 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:42:31.582654 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:42:31.582654 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:42:31.582654 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb32933d-0171-42db-bf84-4478f79b5b84 could not be found. Aug 31 16:42:31.582654 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:42:31.582654 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:42:31.582654 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:42:31.588845 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:42:31.588845 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:42:31.588845 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:42:31.588845 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:42:31.588845 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:42:31.588845 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb32933d-0171-42db-bf84-4478f79b5b84 could not be found. Aug 31 16:42:31.588845 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:42:31.588845 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-464c293b-a596-4f8b-b112-3cef2abd402f tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Returning 404 to user: Instance fb32933d-0171-42db-bf84-4478f79b5b84 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:42:31.588845 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-464c293b-a596-4f8b-b112-3cef2abd402f tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] 10.222.0.61 "GET /compute/v2.1/servers/fb32933d-0171-42db-bf84-4478f79b5b84" status: 404 len: 111 microversion: 2.1 time: 0.064326 Aug 31 16:42:31.588845 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3205/6435] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:42:31 2022] GET /compute/v2.1/servers/fb32933d-0171-42db-bf84-4478f79b5b84 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:42:31.915482 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-879368e9-ad5b-49be-aacd-8d9403dcfba9 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Calling method '.version_select at 0x7f5aed1ca4c0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:42:31.926571 n-d-850499-9 devstack@n-api.service[122257]: ERROR oslo.messaging._drivers.impl_rabbit [None req-879368e9-ad5b-49be-aacd-8d9403dcfba9 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] [71efe5ec-3448-444a-b5c7-a9d033d02814] AMQP server on 10.222.0.61:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 31 16:42:32.955274 n-d-850499-9 devstack@n-api.service[122257]: INFO oslo.messaging._drivers.impl_rabbit [None req-879368e9-ad5b-49be-aacd-8d9403dcfba9 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] [71efe5ec-3448-444a-b5c7-a9d033d02814] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 57962. Aug 31 16:42:32.968778 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:42:33.040062 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-879368e9-ad5b-49be-aacd-8d9403dcfba9 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1745275298" status: 202 len: 0 microversion: 2.1 time: 1.129406 Aug 31 16:42:33.044892 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3231/6436] 10.222.0.61 () {58 vars in 1257 bytes} [Wed Aug 31 16:42:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1745275298 => generated 0 bytes in 1134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:42:36.126664 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-47da7c77-e7db-4b7c-8a5e-9d3242405082 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:42:36.128167 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-c95eefbc-db0b-4d5c-a0c0-89b2471169b0 req-e5a9bffa-8aa4-44b9-9a57-c9aa68a075a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fc3d479-902c-416f-92fb-976966b3c5a1", "tag": "e37973b8-a7b3-4872-8a09-cdefe11540d9"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:42:36.132136 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-47da7c77-e7db-4b7c-8a5e-9d3242405082 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] [instance: 9fc3d479-902c-416f-92fb-976966b3c5a1] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:42:36.156794 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-47da7c77-e7db-4b7c-8a5e-9d3242405082 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:36.160461 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-c95eefbc-db0b-4d5c-a0c0-89b2471169b0 req-e5a9bffa-8aa4-44b9-9a57-c9aa68a075a8 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:36.160848 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-47da7c77-e7db-4b7c-8a5e-9d3242405082 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:36.161139 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-c95eefbc-db0b-4d5c-a0c0-89b2471169b0 req-e5a9bffa-8aa4-44b9-9a57-c9aa68a075a8 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:36.161680 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-c95eefbc-db0b-4d5c-a0c0-89b2471169b0 req-e5a9bffa-8aa4-44b9-9a57-c9aa68a075a8 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:36.162208 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-47da7c77-e7db-4b7c-8a5e-9d3242405082 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:36.164508 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-47da7c77-e7db-4b7c-8a5e-9d3242405082 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:36.165182 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-47da7c77-e7db-4b7c-8a5e-9d3242405082 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:36.167916 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-47da7c77-e7db-4b7c-8a5e-9d3242405082 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:36.204912 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-c95eefbc-db0b-4d5c-a0c0-89b2471169b0 req-e5a9bffa-8aa4-44b9-9a57-c9aa68a075a8 service nova] Creating event network-changed:e37973b8-a7b3-4872-8a09-cdefe11540d9 for instance 9fc3d479-902c-416f-92fb-976966b3c5a1 on n-h2-850499-9 Aug 31 16:42:36.219115 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-c95eefbc-db0b-4d5c-a0c0-89b2471169b0 req-e5a9bffa-8aa4-44b9-9a57-c9aa68a075a8 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100233 Aug 31 16:42:36.220231 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3232/6437] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:42:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:42:36.233815 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-47da7c77-e7db-4b7c-8a5e-9d3242405082 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] [instance: 9fc3d479-902c-416f-92fb-976966b3c5a1] Going to try to terminate instance {{(pid=122256) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:42:36.449527 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-47da7c77-e7db-4b7c-8a5e-9d3242405082 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] 10.222.0.61 "DELETE /compute/v2.1/servers/9fc3d479-902c-416f-92fb-976966b3c5a1" status: 204 len: 0 microversion: 2.1 time: 0.332385 Aug 31 16:42:36.450335 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3206/6438] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:42:36 2022] DELETE /compute/v2.1/servers/9fc3d479-902c-416f-92fb-976966b3c5a1 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:42:36.459633 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-81891eab-eef3-420a-ba34-b9d3558d1ff0 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:42:36.460973 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-81891eab-eef3-420a-ba34-b9d3558d1ff0 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] [instance: 9fc3d479-902c-416f-92fb-976966b3c5a1] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:42:36.478574 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-81891eab-eef3-420a-ba34-b9d3558d1ff0 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:36.479096 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-81891eab-eef3-420a-ba34-b9d3558d1ff0 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:36.491612 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-81891eab-eef3-420a-ba34-b9d3558d1ff0 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:36.493165 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-81891eab-eef3-420a-ba34-b9d3558d1ff0 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:36.493672 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-81891eab-eef3-420a-ba34-b9d3558d1ff0 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:36.494125 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-81891eab-eef3-420a-ba34-b9d3558d1ff0 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:36.734064 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-81891eab-eef3-420a-ba34-b9d3558d1ff0 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e026a8cdb13f47de942566a2d4a10bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5827544f2e140e3b44d712d1623a06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:42:36.744011 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-81891eab-eef3-420a-ba34-b9d3558d1ff0 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] 10.222.0.61 "GET /compute/v2.1/servers/9fc3d479-902c-416f-92fb-976966b3c5a1" status: 200 len: 1669 microversion: 2.1 time: 0.288755 Aug 31 16:42:36.745139 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3233/6439] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:42:36 2022] GET /compute/v2.1/servers/9fc3d479-902c-416f-92fb-976966b3c5a1 => generated 1669 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:42:37.770800 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8c2240ac-24e0-4d52-b5d0-74450ba280e0 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:42:37.772084 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8c2240ac-24e0-4d52-b5d0-74450ba280e0 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] [instance: 9fc3d479-902c-416f-92fb-976966b3c5a1] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:42:37.787303 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8c2240ac-24e0-4d52-b5d0-74450ba280e0 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:37.788151 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8c2240ac-24e0-4d52-b5d0-74450ba280e0 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:37.793106 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8c2240ac-24e0-4d52-b5d0-74450ba280e0 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:37.794073 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8c2240ac-24e0-4d52-b5d0-74450ba280e0 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:37.794638 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8c2240ac-24e0-4d52-b5d0-74450ba280e0 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:37.795115 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8c2240ac-24e0-4d52-b5d0-74450ba280e0 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:38.078804 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8c2240ac-24e0-4d52-b5d0-74450ba280e0 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e026a8cdb13f47de942566a2d4a10bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5827544f2e140e3b44d712d1623a06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:42:38.088614 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8c2240ac-24e0-4d52-b5d0-74450ba280e0 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] 10.222.0.61 "GET /compute/v2.1/servers/9fc3d479-902c-416f-92fb-976966b3c5a1" status: 200 len: 1669 microversion: 2.1 time: 0.322232 Aug 31 16:42:38.094551 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3207/6440] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:42:37 2022] GET /compute/v2.1/servers/9fc3d479-902c-416f-92fb-976966b3c5a1 => generated 1669 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:42:39.120218 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1de62ea7-5474-4573-9a38-a8808bde238c tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:42:39.121566 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1de62ea7-5474-4573-9a38-a8808bde238c tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] [instance: 9fc3d479-902c-416f-92fb-976966b3c5a1] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:42:39.157064 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1de62ea7-5474-4573-9a38-a8808bde238c tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:39.157935 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1de62ea7-5474-4573-9a38-a8808bde238c tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:39.158739 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1de62ea7-5474-4573-9a38-a8808bde238c tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:39.159702 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1de62ea7-5474-4573-9a38-a8808bde238c tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:39.160443 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1de62ea7-5474-4573-9a38-a8808bde238c tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:39.161075 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1de62ea7-5474-4573-9a38-a8808bde238c tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:39.640080 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-1de62ea7-5474-4573-9a38-a8808bde238c tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e026a8cdb13f47de942566a2d4a10bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5827544f2e140e3b44d712d1623a06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:42:39.649267 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1de62ea7-5474-4573-9a38-a8808bde238c tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] 10.222.0.61 "GET /compute/v2.1/servers/9fc3d479-902c-416f-92fb-976966b3c5a1" status: 200 len: 1551 microversion: 2.1 time: 0.532872 Aug 31 16:42:39.652875 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3234/6441] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:42:39 2022] GET /compute/v2.1/servers/9fc3d479-902c-416f-92fb-976966b3c5a1 => generated 1551 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:42:39.683867 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-9611000f-3bfb-417f-b6ac-e10ac0fc3491 req-134cabbd-f770-44a0-b701-fb243a5d2837 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fc3d479-902c-416f-92fb-976966b3c5a1", "name": "network-vif-deleted", "tag": "e37973b8-a7b3-4872-8a09-cdefe11540d9"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:42:39.698573 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-9611000f-3bfb-417f-b6ac-e10ac0fc3491 req-134cabbd-f770-44a0-b701-fb243a5d2837 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:39.699458 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-9611000f-3bfb-417f-b6ac-e10ac0fc3491 req-134cabbd-f770-44a0-b701-fb243a5d2837 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:39.700393 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-9611000f-3bfb-417f-b6ac-e10ac0fc3491 req-134cabbd-f770-44a0-b701-fb243a5d2837 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:39.718008 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-9611000f-3bfb-417f-b6ac-e10ac0fc3491 req-134cabbd-f770-44a0-b701-fb243a5d2837 service nova] Creating event network-vif-deleted:e37973b8-a7b3-4872-8a09-cdefe11540d9 for instance 9fc3d479-902c-416f-92fb-976966b3c5a1 on n-h2-850499-9 Aug 31 16:42:39.731529 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-9611000f-3bfb-417f-b6ac-e10ac0fc3491 req-134cabbd-f770-44a0-b701-fb243a5d2837 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045463 Aug 31 16:42:39.732679 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3208/6442] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:42:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:42:40.675103 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b749b1b4-e89f-4217-8ed5-8075ab89f115 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:42:40.676630 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b749b1b4-e89f-4217-8ed5-8075ab89f115 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] [instance: 9fc3d479-902c-416f-92fb-976966b3c5a1] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:42:40.687671 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b749b1b4-e89f-4217-8ed5-8075ab89f115 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:40.688708 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b749b1b4-e89f-4217-8ed5-8075ab89f115 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:40.689614 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b749b1b4-e89f-4217-8ed5-8075ab89f115 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:40.690539 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b749b1b4-e89f-4217-8ed5-8075ab89f115 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:40.691178 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b749b1b4-e89f-4217-8ed5-8075ab89f115 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:40.691819 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b749b1b4-e89f-4217-8ed5-8075ab89f115 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:40.746851 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b749b1b4-e89f-4217-8ed5-8075ab89f115 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:40.747765 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b749b1b4-e89f-4217-8ed5-8075ab89f115 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:40.748788 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b749b1b4-e89f-4217-8ed5-8075ab89f115 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:40.751073 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-b749b1b4-e89f-4217-8ed5-8075ab89f115 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lazy-loading 'fault' on Instance uuid 9fc3d479-902c-416f-92fb-976966b3c5a1 {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:42:40.807229 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b749b1b4-e89f-4217-8ed5-8075ab89f115 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e026a8cdb13f47de942566a2d4a10bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5827544f2e140e3b44d712d1623a06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:42:40.819537 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b749b1b4-e89f-4217-8ed5-8075ab89f115 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] 10.222.0.61 "GET /compute/v2.1/servers/9fc3d479-902c-416f-92fb-976966b3c5a1" status: 200 len: 1337 microversion: 2.1 time: 0.150574 Aug 31 16:42:40.836969 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3235/6443] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:42:40 2022] GET /compute/v2.1/servers/9fc3d479-902c-416f-92fb-976966b3c5a1 => generated 1337 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:42:41.864512 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f0e58bc9-89d4-41f2-96fb-e8e2aaea1799 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:42:41.868326 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f0e58bc9-89d4-41f2-96fb-e8e2aaea1799 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] [instance: 9fc3d479-902c-416f-92fb-976966b3c5a1] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:42:41.909545 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f0e58bc9-89d4-41f2-96fb-e8e2aaea1799 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:41.910385 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f0e58bc9-89d4-41f2-96fb-e8e2aaea1799 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:41.911743 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f0e58bc9-89d4-41f2-96fb-e8e2aaea1799 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:41.912995 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f0e58bc9-89d4-41f2-96fb-e8e2aaea1799 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:41.914659 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f0e58bc9-89d4-41f2-96fb-e8e2aaea1799 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:41.915462 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f0e58bc9-89d4-41f2-96fb-e8e2aaea1799 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:41.943903 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-f0e58bc9-89d4-41f2-96fb-e8e2aaea1799 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] HTTP exception thrown: Instance 9fc3d479-902c-416f-92fb-976966b3c5a1 could not be found. Aug 31 16:42:41.946562 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f0e58bc9-89d4-41f2-96fb-e8e2aaea1799 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Request method failure captured: Aug 31 16:42:41.946562 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/9fc3d479-902c-416f-92fb-976966b3c5a1 HTTP/1.1 Aug 31 16:42:41.946562 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:42:41.946562 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:42:41.946562 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:42:41.946562 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:42:41.946562 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:42:41.946562 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:42:41.946562 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:42:41.946562 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:42:41.946562 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD46rwOUEviGXuYxpZgSVURhps4NGkPVIqF2NJA-5oDNILjyJvt-UCh7SiDQC1vZICAn6MmYucoePj2smr1WU3xP6XDZtQ9AGQV5q1r3ix0V4Roil5rik0wF3QGAD0HzPIHO87EMxvw8RQzgKQTUgLtLLQQRncoe_TCqBLYeARe6G0gU Aug 31 16:42:41.946562 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:42:41.946562 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:42:41.946562 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:42:41.946562 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:42:41.946562 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:42:41.946562 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:42:41.946562 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: b5827544f2e140e3b44d712d1623a06b Aug 31 16:42:41.946562 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-TestNetworkBasicOps-225290997 Aug 31 16:42:41.946562 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:42:41.946562 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:42:41.946562 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b5827544f2e140e3b44d712d1623a06b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/b5827544f2e140e3b44d712d1623a06b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_b5827544f2e140e3b44d712d1623a06b", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b5827544f2e140e3b44d712d1623a06b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:42:41.946562 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-TestNetworkBasicOps-225290997 Aug 31 16:42:41.946562 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: b5827544f2e140e3b44d712d1623a06b Aug 31 16:42:41.946562 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-TestNetworkBasicOps-225290997 Aug 31 16:42:41.946562 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-TestNetworkBasicOps-225290997-project Aug 31 16:42:41.946562 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:42:41.946562 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:42:41.946562 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: e026a8cdb13f47de942566a2d4a10bc8 Aug 31 16:42:41.946562 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-TestNetworkBasicOps-225290997-project Aug 31 16:42:41.946562 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:42:41.946562 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance 9fc3d479-902c-416f-92fb-976966b3c5a1 could not be found. Aug 31 16:42:41.946562 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '9fc3d479-902c-416f-92fb-976966b3c5a1'} Aug 31 16:42:41.946562 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:42:41.946562 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:42:41.946562 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:42:41.946562 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:42:41.946562 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:42:41.946562 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:42:41.946562 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:42:41.946562 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:42:41.946562 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:42:41.946562 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:42:41.946562 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fc3d479-902c-416f-92fb-976966b3c5a1 could not be found. Aug 31 16:42:41.946562 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:42:41.946562 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:42:41.946562 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:42:41.946562 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:42:41.946562 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:42:41.946562 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:42:41.946562 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:42:41.946562 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:42:41.946562 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:42:41.946562 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:42:41.946562 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:42:41.946562 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:42:41.946562 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:42:41.946562 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:42:41.946562 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:42:41.946562 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:42:41.946562 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fc3d479-902c-416f-92fb-976966b3c5a1 could not be found. Aug 31 16:42:41.946562 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:42:41.946562 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:42:41.946562 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:42:41.951615 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:42:41.951615 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:42:41.951615 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:42:41.951615 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:42:41.951615 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:42:41.951615 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fc3d479-902c-416f-92fb-976966b3c5a1 could not be found. Aug 31 16:42:41.951615 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:42:41.953106 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f0e58bc9-89d4-41f2-96fb-e8e2aaea1799 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Returning 404 to user: Instance 9fc3d479-902c-416f-92fb-976966b3c5a1 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:42:41.954708 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f0e58bc9-89d4-41f2-96fb-e8e2aaea1799 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] 10.222.0.61 "GET /compute/v2.1/servers/9fc3d479-902c-416f-92fb-976966b3c5a1" status: 404 len: 111 microversion: 2.1 time: 0.113305 Aug 31 16:42:41.956469 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3209/6444] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:42:41 2022] GET /compute/v2.1/servers/9fc3d479-902c-416f-92fb-976966b3c5a1 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:42:42.316607 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f557b50e-0be9-49d3-8c6e-9c1336af436c tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Calling method '.version_select at 0x7f5ae3ae4a60>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:42:42.358402 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f557b50e-0be9-49d3-8c6e-9c1336af436c tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-34192722" status: 202 len: 0 microversion: 2.1 time: 0.046290 Aug 31 16:42:42.360972 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3236/6445] 10.222.0.61 () {58 vars in 1251 bytes} [Wed Aug 31 16:42:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-34192722 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:42:58.875817 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-86273d3b-dec0-43d4-865b-fb25086da146 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1907884388", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "networks": [{"uuid": "3efb98ee-702a-44d4-b132-2e073fd94caa"}]}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:42:58.896987 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:42:58.899931 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:42:59.024253 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-86273d3b-dec0-43d4-865b-fb25086da146 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] validate_networks() for [('3efb98ee-702a-44d4-b132-2e073fd94caa', None, None, None, None, None)] {{(pid=122256) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:42:59.936116 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-86273d3b-dec0-43d4-865b-fb25086da146 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:42:59.938416 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-86273d3b-dec0-43d4-865b-fb25086da146 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:42:59.938824 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-86273d3b-dec0-43d4-865b-fb25086da146 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:42:59.939246 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-86273d3b-dec0-43d4-865b-fb25086da146 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:42:59.939849 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-86273d3b-dec0-43d4-865b-fb25086da146 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:42:59.954426 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-86273d3b-dec0-43d4-865b-fb25086da146 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:59.954926 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-86273d3b-dec0-43d4-865b-fb25086da146 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:59.955374 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-86273d3b-dec0-43d4-865b-fb25086da146 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:59.956179 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-86273d3b-dec0-43d4-865b-fb25086da146 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:59.956679 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-86273d3b-dec0-43d4-865b-fb25086da146 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:59.957114 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-86273d3b-dec0-43d4-865b-fb25086da146 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:59.978731 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-86273d3b-dec0-43d4-865b-fb25086da146 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Getting quotas for project c41821cff003462bb6734854b0116d71. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:42:59.984955 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-86273d3b-dec0-43d4-865b-fb25086da146 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Getting quotas for user aab56c16d1354864850f8f2e8339b50d and project c41821cff003462bb6734854b0116d71. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:42:59.999004 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-86273d3b-dec0-43d4-865b-fb25086da146 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Going to run 1 instances... {{(pid=122256) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:43:00.001646 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-86273d3b-dec0-43d4-865b-fb25086da146 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] [instance: 19ff8623-9d5a-4ed4-97a3-b2a581ebc311] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:43:00.085289 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-86273d3b-dec0-43d4-865b-fb25086da146 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.210013 Aug 31 16:43:00.089494 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3210/6446] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:42:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1219 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:43:00.100457 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ac4403a7-19d0-4297-a741-066eef1fa23c tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:43:00.101512 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ac4403a7-19d0-4297-a741-066eef1fa23c tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] [instance: 19ff8623-9d5a-4ed4-97a3-b2a581ebc311] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:43:00.113133 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:43:00.131023 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=15,nova_api:DELETE=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:43:00.262992 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ac4403a7-19d0-4297-a741-066eef1fa23c tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab56c16d1354864850f8f2e8339b50d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41821cff003462bb6734854b0116d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:43:00.272079 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ac4403a7-19d0-4297-a741-066eef1fa23c tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] 10.222.0.61 "GET /compute/v2.1/servers/19ff8623-9d5a-4ed4-97a3-b2a581ebc311" status: 200 len: 1219 microversion: 2.1 time: 0.175430 Aug 31 16:43:00.272673 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3237/6447] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:43:00 2022] GET /compute/v2.1/servers/19ff8623-9d5a-4ed4-97a3-b2a581ebc311 => generated 1219 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:43:00.726930 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-07e2b4ed-faf4-44bc-bedb-d69e4f4fd2c7 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:43:00.727709 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-07e2b4ed-faf4-44bc-bedb-d69e4f4fd2c7 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] [instance: 98964e5a-9c6a-4be8-af79-95db246ebcc4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:43:00.745175 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-14314dc5-8cc1-4af1-9909-7c100bbbc961 req-3a23a3aa-fbd7-4093-ac06-59c4a38ef081 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98964e5a-9c6a-4be8-af79-95db246ebcc4", "tag": "f5f846a4-ecbe-4e81-827a-e3a0fda3589e"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:43:00.766178 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-07e2b4ed-faf4-44bc-bedb-d69e4f4fd2c7 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:00.768871 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-07e2b4ed-faf4-44bc-bedb-d69e4f4fd2c7 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:00.769516 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-07e2b4ed-faf4-44bc-bedb-d69e4f4fd2c7 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:00.771211 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-14314dc5-8cc1-4af1-9909-7c100bbbc961 req-3a23a3aa-fbd7-4093-ac06-59c4a38ef081 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:00.775977 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-14314dc5-8cc1-4af1-9909-7c100bbbc961 req-3a23a3aa-fbd7-4093-ac06-59c4a38ef081 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:00.776268 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-07e2b4ed-faf4-44bc-bedb-d69e4f4fd2c7 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:00.777678 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-07e2b4ed-faf4-44bc-bedb-d69e4f4fd2c7 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:00.779117 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-07e2b4ed-faf4-44bc-bedb-d69e4f4fd2c7 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:00.781362 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-14314dc5-8cc1-4af1-9909-7c100bbbc961 req-3a23a3aa-fbd7-4093-ac06-59c4a38ef081 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:00.813450 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-14314dc5-8cc1-4af1-9909-7c100bbbc961 req-3a23a3aa-fbd7-4093-ac06-59c4a38ef081 service nova] Creating event network-changed:f5f846a4-ecbe-4e81-827a-e3a0fda3589e for instance 98964e5a-9c6a-4be8-af79-95db246ebcc4 on n-h1-850499-9 Aug 31 16:43:00.827128 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-14314dc5-8cc1-4af1-9909-7c100bbbc961 req-3a23a3aa-fbd7-4093-ac06-59c4a38ef081 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085768 Aug 31 16:43:00.836330 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3238/6448] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:43:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:43:00.868511 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-07e2b4ed-faf4-44bc-bedb-d69e4f4fd2c7 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] [instance: 98964e5a-9c6a-4be8-af79-95db246ebcc4] Going to try to terminate instance {{(pid=122256) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:43:01.081260 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-07e2b4ed-faf4-44bc-bedb-d69e4f4fd2c7 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] 10.222.0.61 "DELETE /compute/v2.1/servers/98964e5a-9c6a-4be8-af79-95db246ebcc4" status: 204 len: 0 microversion: 2.1 time: 0.359195 Aug 31 16:43:01.093604 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b43af9dc-bcdc-44a3-a882-2cf9b18c77e6 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:43:01.093914 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3211/6449] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:43:00 2022] DELETE /compute/v2.1/servers/98964e5a-9c6a-4be8-af79-95db246ebcc4 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:43:01.094859 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b43af9dc-bcdc-44a3-a882-2cf9b18c77e6 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] [instance: 98964e5a-9c6a-4be8-af79-95db246ebcc4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:43:01.103230 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b43af9dc-bcdc-44a3-a882-2cf9b18c77e6 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:01.104454 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b43af9dc-bcdc-44a3-a882-2cf9b18c77e6 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:01.105088 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b43af9dc-bcdc-44a3-a882-2cf9b18c77e6 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:01.106102 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b43af9dc-bcdc-44a3-a882-2cf9b18c77e6 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:01.106769 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b43af9dc-bcdc-44a3-a882-2cf9b18c77e6 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:01.107682 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b43af9dc-bcdc-44a3-a882-2cf9b18c77e6 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:01.296270 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8af49e8c-865d-4ba1-939c-799b9bf06e92 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:43:01.297014 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8af49e8c-865d-4ba1-939c-799b9bf06e92 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] [instance: 19ff8623-9d5a-4ed4-97a3-b2a581ebc311] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:43:01.324722 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8af49e8c-865d-4ba1-939c-799b9bf06e92 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:01.325270 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8af49e8c-865d-4ba1-939c-799b9bf06e92 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:01.325734 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8af49e8c-865d-4ba1-939c-799b9bf06e92 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:01.326492 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8af49e8c-865d-4ba1-939c-799b9bf06e92 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:01.326963 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8af49e8c-865d-4ba1-939c-799b9bf06e92 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:01.327406 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8af49e8c-865d-4ba1-939c-799b9bf06e92 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:01.468353 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b43af9dc-bcdc-44a3-a882-2cf9b18c77e6 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb78657f161443083d53a3b29fb4406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a56640b635e400694f60d00a5f922e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:43:01.477618 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b43af9dc-bcdc-44a3-a882-2cf9b18c77e6 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] 10.222.0.61 "GET /compute/v2.1/servers/98964e5a-9c6a-4be8-af79-95db246ebcc4" status: 200 len: 1583 microversion: 2.1 time: 0.388924 Aug 31 16:43:01.484416 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3239/6450] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:43:01 2022] GET /compute/v2.1/servers/98964e5a-9c6a-4be8-af79-95db246ebcc4 => generated 1583 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:43:01.553197 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8af49e8c-865d-4ba1-939c-799b9bf06e92 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab56c16d1354864850f8f2e8339b50d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41821cff003462bb6734854b0116d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:43:01.564530 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8af49e8c-865d-4ba1-939c-799b9bf06e92 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] 10.222.0.61 "GET /compute/v2.1/servers/19ff8623-9d5a-4ed4-97a3-b2a581ebc311" status: 200 len: 1215 microversion: 2.1 time: 0.274669 Aug 31 16:43:01.567809 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3212/6451] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:43:01 2022] GET /compute/v2.1/servers/19ff8623-9d5a-4ed4-97a3-b2a581ebc311 => generated 1215 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:43:02.506686 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3773e9ea-0b6d-4c6b-8eb7-e89b9bb5cf2e tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:43:02.507270 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3773e9ea-0b6d-4c6b-8eb7-e89b9bb5cf2e tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] [instance: 98964e5a-9c6a-4be8-af79-95db246ebcc4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:43:02.539674 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3773e9ea-0b6d-4c6b-8eb7-e89b9bb5cf2e tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:02.540217 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3773e9ea-0b6d-4c6b-8eb7-e89b9bb5cf2e tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:02.540763 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3773e9ea-0b6d-4c6b-8eb7-e89b9bb5cf2e tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:02.541466 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3773e9ea-0b6d-4c6b-8eb7-e89b9bb5cf2e tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:02.541872 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3773e9ea-0b6d-4c6b-8eb7-e89b9bb5cf2e tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:02.542310 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3773e9ea-0b6d-4c6b-8eb7-e89b9bb5cf2e tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:02.590374 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-61344eb0-7054-4b34-a56a-9eb615a0beab tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:43:02.591107 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-61344eb0-7054-4b34-a56a-9eb615a0beab tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] [instance: 19ff8623-9d5a-4ed4-97a3-b2a581ebc311] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:43:02.605227 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-61344eb0-7054-4b34-a56a-9eb615a0beab tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:02.605562 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-61344eb0-7054-4b34-a56a-9eb615a0beab tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:02.606016 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-61344eb0-7054-4b34-a56a-9eb615a0beab tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:02.606743 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-61344eb0-7054-4b34-a56a-9eb615a0beab tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:02.607461 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-61344eb0-7054-4b34-a56a-9eb615a0beab tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:02.618682 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-61344eb0-7054-4b34-a56a-9eb615a0beab tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:02.911440 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-61344eb0-7054-4b34-a56a-9eb615a0beab tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab56c16d1354864850f8f2e8339b50d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41821cff003462bb6734854b0116d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:43:02.927111 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-61344eb0-7054-4b34-a56a-9eb615a0beab tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] 10.222.0.61 "GET /compute/v2.1/servers/19ff8623-9d5a-4ed4-97a3-b2a581ebc311" status: 200 len: 1277 microversion: 2.1 time: 0.341155 Aug 31 16:43:02.930247 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3213/6452] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:43:02 2022] GET /compute/v2.1/servers/19ff8623-9d5a-4ed4-97a3-b2a581ebc311 => generated 1277 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:43:03.557161 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3773e9ea-0b6d-4c6b-8eb7-e89b9bb5cf2e tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb78657f161443083d53a3b29fb4406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a56640b635e400694f60d00a5f922e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:43:03.565718 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3773e9ea-0b6d-4c6b-8eb7-e89b9bb5cf2e tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] 10.222.0.61 "GET /compute/v2.1/servers/98964e5a-9c6a-4be8-af79-95db246ebcc4" status: 200 len: 1583 microversion: 2.1 time: 1.063530 Aug 31 16:43:03.589971 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3240/6453] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:43:02 2022] GET /compute/v2.1/servers/98964e5a-9c6a-4be8-af79-95db246ebcc4 => generated 1583 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:43:03.956445 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-eb845f5e-e8f1-47a6-a96a-936a45b45d39 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:43:03.957103 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-eb845f5e-e8f1-47a6-a96a-936a45b45d39 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] [instance: 19ff8623-9d5a-4ed4-97a3-b2a581ebc311] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:43:03.976331 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eb845f5e-e8f1-47a6-a96a-936a45b45d39 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:03.980954 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eb845f5e-e8f1-47a6-a96a-936a45b45d39 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:03.981398 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eb845f5e-e8f1-47a6-a96a-936a45b45d39 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:03.985500 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eb845f5e-e8f1-47a6-a96a-936a45b45d39 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:03.986011 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eb845f5e-e8f1-47a6-a96a-936a45b45d39 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:03.989668 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eb845f5e-e8f1-47a6-a96a-936a45b45d39 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:04.483892 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-71010960-6730-4a0b-9cf5-fe85fc237f9f req-eb910bd6-f8b2-46b3-bb7a-06537e5e8e89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98964e5a-9c6a-4be8-af79-95db246ebcc4", "name": "network-vif-deleted", "tag": "f5f846a4-ecbe-4e81-827a-e3a0fda3589e"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:43:04.515813 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-71010960-6730-4a0b-9cf5-fe85fc237f9f req-eb910bd6-f8b2-46b3-bb7a-06537e5e8e89 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:04.519619 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-71010960-6730-4a0b-9cf5-fe85fc237f9f req-eb910bd6-f8b2-46b3-bb7a-06537e5e8e89 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:04.522149 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-71010960-6730-4a0b-9cf5-fe85fc237f9f req-eb910bd6-f8b2-46b3-bb7a-06537e5e8e89 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:04.553763 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-71010960-6730-4a0b-9cf5-fe85fc237f9f req-eb910bd6-f8b2-46b3-bb7a-06537e5e8e89 service nova] Creating event network-vif-deleted:f5f846a4-ecbe-4e81-827a-e3a0fda3589e for instance 98964e5a-9c6a-4be8-af79-95db246ebcc4 on n-h1-850499-9 Aug 31 16:43:04.567059 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-71010960-6730-4a0b-9cf5-fe85fc237f9f req-eb910bd6-f8b2-46b3-bb7a-06537e5e8e89 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088945 Aug 31 16:43:04.571945 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3241/6454] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:43:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:43:04.594551 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ae548b7e-d923-4330-9aa6-27c8ab761e5e tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:43:04.595648 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ae548b7e-d923-4330-9aa6-27c8ab761e5e tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] [instance: 98964e5a-9c6a-4be8-af79-95db246ebcc4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:43:04.609303 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ae548b7e-d923-4330-9aa6-27c8ab761e5e tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:04.611487 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ae548b7e-d923-4330-9aa6-27c8ab761e5e tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:04.612250 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ae548b7e-d923-4330-9aa6-27c8ab761e5e tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:04.613196 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ae548b7e-d923-4330-9aa6-27c8ab761e5e tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:04.613868 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ae548b7e-d923-4330-9aa6-27c8ab761e5e tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:04.614526 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ae548b7e-d923-4330-9aa6-27c8ab761e5e tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:04.807362 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-eb845f5e-e8f1-47a6-a96a-936a45b45d39 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab56c16d1354864850f8f2e8339b50d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41821cff003462bb6734854b0116d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:43:04.821817 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-eb845f5e-e8f1-47a6-a96a-936a45b45d39 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] 10.222.0.61 "GET /compute/v2.1/servers/19ff8623-9d5a-4ed4-97a3-b2a581ebc311" status: 200 len: 1319 microversion: 2.1 time: 0.866059 Aug 31 16:43:04.823290 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3214/6455] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:43:03 2022] GET /compute/v2.1/servers/19ff8623-9d5a-4ed4-97a3-b2a581ebc311 => generated 1319 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:43:05.059414 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2c4614f1-6090-44c4-a5bf-798e78b104ee tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Action: 'create', calling method: .version_select at 0x7f5ae3b44820>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-492108040", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAorczVEhtDC28E/5sWYij2QD3QTlC1j8Y9gIv7WPYRQgj3MzhzKi5X5Cz6xSNcf+bNFWr3awbmFulOEHUmRpI8BdyYA/c2BRtMKarffynWAUXCRvcJPf6tEhqjHjhGUfw=="}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:43:05.124936 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-2c4614f1-6090-44c4-a5bf-798e78b104ee tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Getting quotas for project b5827544f2e140e3b44d712d1623a06b. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:43:05.145152 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-2c4614f1-6090-44c4-a5bf-798e78b104ee tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Getting quotas for user e026a8cdb13f47de942566a2d4a10bc8 and project b5827544f2e140e3b44d712d1623a06b. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:43:05.185822 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ae548b7e-d923-4330-9aa6-27c8ab761e5e tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb78657f161443083d53a3b29fb4406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a56640b635e400694f60d00a5f922e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:43:05.198630 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ae548b7e-d923-4330-9aa6-27c8ab761e5e tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] 10.222.0.61 "GET /compute/v2.1/servers/98964e5a-9c6a-4be8-af79-95db246ebcc4" status: 200 len: 1229 microversion: 2.1 time: 0.608753 Aug 31 16:43:05.212439 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3242/6456] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:43:04 2022] GET /compute/v2.1/servers/98964e5a-9c6a-4be8-af79-95db246ebcc4 => generated 1229 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:43:05.224492 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2c4614f1-6090-44c4-a5bf-798e78b104ee tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.168671 Aug 31 16:43:05.226156 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3215/6457] 10.222.0.61 () {60 vars in 1159 bytes} [Wed Aug 31 16:43:05 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:43:05.844186 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f6907142-1a51-4fa7-89d6-37e3dac5834b tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:43:05.844813 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f6907142-1a51-4fa7-89d6-37e3dac5834b tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] [instance: 19ff8623-9d5a-4ed4-97a3-b2a581ebc311] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:43:05.857309 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f6907142-1a51-4fa7-89d6-37e3dac5834b tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:05.857823 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f6907142-1a51-4fa7-89d6-37e3dac5834b tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:05.858272 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f6907142-1a51-4fa7-89d6-37e3dac5834b tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:05.859000 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f6907142-1a51-4fa7-89d6-37e3dac5834b tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:05.859468 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f6907142-1a51-4fa7-89d6-37e3dac5834b tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:05.874965 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f6907142-1a51-4fa7-89d6-37e3dac5834b tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:06.230684 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-af75fa1a-d4be-47da-a02e-bd4a9804b638 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:43:06.231306 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-af75fa1a-d4be-47da-a02e-bd4a9804b638 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] [instance: 98964e5a-9c6a-4be8-af79-95db246ebcc4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:43:06.251918 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-af75fa1a-d4be-47da-a02e-bd4a9804b638 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:06.252430 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-af75fa1a-d4be-47da-a02e-bd4a9804b638 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:06.253136 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-af75fa1a-d4be-47da-a02e-bd4a9804b638 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:06.253607 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-af75fa1a-d4be-47da-a02e-bd4a9804b638 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:06.264119 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-af75fa1a-d4be-47da-a02e-bd4a9804b638 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:06.264853 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-af75fa1a-d4be-47da-a02e-bd4a9804b638 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:07.337429 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f6907142-1a51-4fa7-89d6-37e3dac5834b tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab56c16d1354864850f8f2e8339b50d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41821cff003462bb6734854b0116d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:43:07.348658 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f6907142-1a51-4fa7-89d6-37e3dac5834b tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] 10.222.0.61 "GET /compute/v2.1/servers/19ff8623-9d5a-4ed4-97a3-b2a581ebc311" status: 200 len: 1319 microversion: 2.1 time: 1.508404 Aug 31 16:43:07.356661 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-af75fa1a-d4be-47da-a02e-bd4a9804b638 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb78657f161443083d53a3b29fb4406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a56640b635e400694f60d00a5f922e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:43:07.366719 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3243/6458] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:43:05 2022] GET /compute/v2.1/servers/19ff8623-9d5a-4ed4-97a3-b2a581ebc311 => generated 1319 bytes in 1527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:43:07.379435 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-af75fa1a-d4be-47da-a02e-bd4a9804b638 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] 10.222.0.61 "GET /compute/v2.1/servers/98964e5a-9c6a-4be8-af79-95db246ebcc4" status: 200 len: 1229 microversion: 2.1 time: 1.153572 Aug 31 16:43:07.381804 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3216/6459] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:43:06 2022] GET /compute/v2.1/servers/98964e5a-9c6a-4be8-af79-95db246ebcc4 => generated 1229 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:43:08.382471 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-689f5979-3c7a-4fc5-8e6e-e86e7cdcd98f tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:43:08.385216 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-689f5979-3c7a-4fc5-8e6e-e86e7cdcd98f tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] [instance: 19ff8623-9d5a-4ed4-97a3-b2a581ebc311] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:43:08.405700 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4cfdb153-7eab-4608-b4bc-d8aa8f428f78 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:43:08.406330 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4cfdb153-7eab-4608-b4bc-d8aa8f428f78 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] [instance: 98964e5a-9c6a-4be8-af79-95db246ebcc4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:43:08.417155 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-689f5979-3c7a-4fc5-8e6e-e86e7cdcd98f tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:08.420184 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-689f5979-3c7a-4fc5-8e6e-e86e7cdcd98f tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:08.420698 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-689f5979-3c7a-4fc5-8e6e-e86e7cdcd98f tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:08.421775 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4cfdb153-7eab-4608-b4bc-d8aa8f428f78 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:08.422151 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-689f5979-3c7a-4fc5-8e6e-e86e7cdcd98f tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:08.422336 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4cfdb153-7eab-4608-b4bc-d8aa8f428f78 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:08.422639 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-689f5979-3c7a-4fc5-8e6e-e86e7cdcd98f tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:08.422790 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4cfdb153-7eab-4608-b4bc-d8aa8f428f78 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:08.425577 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-689f5979-3c7a-4fc5-8e6e-e86e7cdcd98f tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:08.427977 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4cfdb153-7eab-4608-b4bc-d8aa8f428f78 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:08.429120 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4cfdb153-7eab-4608-b4bc-d8aa8f428f78 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:08.430833 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4cfdb153-7eab-4608-b4bc-d8aa8f428f78 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:08.761792 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-4cfdb153-7eab-4608-b4bc-d8aa8f428f78 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb78657f161443083d53a3b29fb4406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a56640b635e400694f60d00a5f922e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:43:08.776439 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4cfdb153-7eab-4608-b4bc-d8aa8f428f78 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] 10.222.0.61 "GET /compute/v2.1/servers/98964e5a-9c6a-4be8-af79-95db246ebcc4" status: 200 len: 1397 microversion: 2.1 time: 0.377637 Aug 31 16:43:08.778917 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3217/6460] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:43:08 2022] GET /compute/v2.1/servers/98964e5a-9c6a-4be8-af79-95db246ebcc4 => generated 1397 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:43:08.800004 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-b89f6113-d9f3-412b-b38f-f17cfd5ede44 req-85d91e6f-74cf-4f7f-ad41-f566cf5e5360 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19ff8623-9d5a-4ed4-97a3-b2a581ebc311", "tag": "d1cbae75-4e96-419f-b749-a514a1724ecc"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:43:08.825831 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-b89f6113-d9f3-412b-b38f-f17cfd5ede44 req-85d91e6f-74cf-4f7f-ad41-f566cf5e5360 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:08.826457 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-b89f6113-d9f3-412b-b38f-f17cfd5ede44 req-85d91e6f-74cf-4f7f-ad41-f566cf5e5360 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:08.826897 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-b89f6113-d9f3-412b-b38f-f17cfd5ede44 req-85d91e6f-74cf-4f7f-ad41-f566cf5e5360 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:08.841267 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-b89f6113-d9f3-412b-b38f-f17cfd5ede44 req-85d91e6f-74cf-4f7f-ad41-f566cf5e5360 service nova] Creating event network-changed:d1cbae75-4e96-419f-b749-a514a1724ecc for instance 19ff8623-9d5a-4ed4-97a3-b2a581ebc311 on n-h2-850499-9 Aug 31 16:43:08.861779 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-b89f6113-d9f3-412b-b38f-f17cfd5ede44 req-85d91e6f-74cf-4f7f-ad41-f566cf5e5360 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081414 Aug 31 16:43:08.863428 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3218/6461] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:43:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:43:09.060265 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-689f5979-3c7a-4fc5-8e6e-e86e7cdcd98f tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab56c16d1354864850f8f2e8339b50d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41821cff003462bb6734854b0116d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:43:09.090462 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-689f5979-3c7a-4fc5-8e6e-e86e7cdcd98f tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] 10.222.0.61 "GET /compute/v2.1/servers/19ff8623-9d5a-4ed4-97a3-b2a581ebc311" status: 200 len: 1319 microversion: 2.1 time: 0.720218 Aug 31 16:43:09.120447 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3244/6462] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:43:08 2022] GET /compute/v2.1/servers/19ff8623-9d5a-4ed4-97a3-b2a581ebc311 => generated 1319 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:43:09.803580 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3ee4ba8e-0b95-456f-a9d4-4182c285b325 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:43:09.804277 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3ee4ba8e-0b95-456f-a9d4-4182c285b325 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] [instance: 98964e5a-9c6a-4be8-af79-95db246ebcc4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:43:09.821519 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3ee4ba8e-0b95-456f-a9d4-4182c285b325 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:09.822444 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3ee4ba8e-0b95-456f-a9d4-4182c285b325 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:09.824027 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3ee4ba8e-0b95-456f-a9d4-4182c285b325 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:09.827340 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3ee4ba8e-0b95-456f-a9d4-4182c285b325 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:09.828616 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3ee4ba8e-0b95-456f-a9d4-4182c285b325 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:09.830642 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3ee4ba8e-0b95-456f-a9d4-4182c285b325 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:09.969839 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:43:10.016390 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3ee4ba8e-0b95-456f-a9d4-4182c285b325 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb78657f161443083d53a3b29fb4406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a56640b635e400694f60d00a5f922e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:43:10.030504 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3ee4ba8e-0b95-456f-a9d4-4182c285b325 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] 10.222.0.61 "GET /compute/v2.1/servers/98964e5a-9c6a-4be8-af79-95db246ebcc4" status: 200 len: 1397 microversion: 2.1 time: 0.232943 Aug 31 16:43:10.033448 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3219/6463] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:43:09 2022] GET /compute/v2.1/servers/98964e5a-9c6a-4be8-af79-95db246ebcc4 => generated 1397 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:43:10.116745 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c40abc79-db47-428d-a54f-0d4646daf100 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:43:10.119076 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c40abc79-db47-428d-a54f-0d4646daf100 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] [instance: 19ff8623-9d5a-4ed4-97a3-b2a581ebc311] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:43:10.136201 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c40abc79-db47-428d-a54f-0d4646daf100 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:10.140422 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c40abc79-db47-428d-a54f-0d4646daf100 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:10.141324 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c40abc79-db47-428d-a54f-0d4646daf100 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:10.142293 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c40abc79-db47-428d-a54f-0d4646daf100 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:10.143814 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c40abc79-db47-428d-a54f-0d4646daf100 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:10.145804 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c40abc79-db47-428d-a54f-0d4646daf100 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:10.273315 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:43:10.441124 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4fc4b608-a066-41ef-9928-2ac81557501f tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1067141436", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "networks": [{"uuid": "ea142d21-8653-4cf8-91ac-342c2e50184a"}], "key_name": "tempest-TestNetworkBasicOps-492108040", "security_groups": [{"name": "tempest-secgroup-smoke-1340883107"}]}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:43:10.495753 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c40abc79-db47-428d-a54f-0d4646daf100 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab56c16d1354864850f8f2e8339b50d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41821cff003462bb6734854b0116d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:43:10.523799 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c40abc79-db47-428d-a54f-0d4646daf100 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] 10.222.0.61 "GET /compute/v2.1/servers/19ff8623-9d5a-4ed4-97a3-b2a581ebc311" status: 200 len: 1319 microversion: 2.1 time: 0.410765 Aug 31 16:43:10.529746 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3245/6464] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:43:10 2022] GET /compute/v2.1/servers/19ff8623-9d5a-4ed4-97a3-b2a581ebc311 => generated 1319 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:43:10.701061 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-4fc4b608-a066-41ef-9928-2ac81557501f tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] validate_networks() for [('ea142d21-8653-4cf8-91ac-342c2e50184a', None, None, None, None, None)] {{(pid=122256) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:43:11.059464 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-87a603ca-3863-4800-a61a-1980134aa873 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:43:11.060425 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-87a603ca-3863-4800-a61a-1980134aa873 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] [instance: 98964e5a-9c6a-4be8-af79-95db246ebcc4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:43:11.068071 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-87a603ca-3863-4800-a61a-1980134aa873 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:11.069001 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-87a603ca-3863-4800-a61a-1980134aa873 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:11.069644 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-87a603ca-3863-4800-a61a-1980134aa873 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:11.071686 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-87a603ca-3863-4800-a61a-1980134aa873 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:11.072839 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-87a603ca-3863-4800-a61a-1980134aa873 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:11.073915 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-87a603ca-3863-4800-a61a-1980134aa873 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:11.228690 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-87a603ca-3863-4800-a61a-1980134aa873 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb78657f161443083d53a3b29fb4406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a56640b635e400694f60d00a5f922e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:43:11.240297 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-87a603ca-3863-4800-a61a-1980134aa873 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] 10.222.0.61 "GET /compute/v2.1/servers/98964e5a-9c6a-4be8-af79-95db246ebcc4" status: 200 len: 1397 microversion: 2.1 time: 0.190423 Aug 31 16:43:11.243294 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3246/6465] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:43:11 2022] GET /compute/v2.1/servers/98964e5a-9c6a-4be8-af79-95db246ebcc4 => generated 1397 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:43:11.446174 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-4fc4b608-a066-41ef-9928-2ac81557501f tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:43:11.446766 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-4fc4b608-a066-41ef-9928-2ac81557501f tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:43:11.447333 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-4fc4b608-a066-41ef-9928-2ac81557501f tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:43:11.447977 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-4fc4b608-a066-41ef-9928-2ac81557501f tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:43:11.448634 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-4fc4b608-a066-41ef-9928-2ac81557501f tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:43:11.473189 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4fc4b608-a066-41ef-9928-2ac81557501f tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:11.473707 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4fc4b608-a066-41ef-9928-2ac81557501f tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:11.475905 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4fc4b608-a066-41ef-9928-2ac81557501f tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:11.478034 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4fc4b608-a066-41ef-9928-2ac81557501f tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:11.478530 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4fc4b608-a066-41ef-9928-2ac81557501f tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:11.478973 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4fc4b608-a066-41ef-9928-2ac81557501f tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:11.521892 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-4fc4b608-a066-41ef-9928-2ac81557501f tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Getting quotas for project b5827544f2e140e3b44d712d1623a06b. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:43:11.531177 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-4fc4b608-a066-41ef-9928-2ac81557501f tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Getting quotas for user e026a8cdb13f47de942566a2d4a10bc8 and project b5827544f2e140e3b44d712d1623a06b. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:43:11.552607 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f7304cb7-9f94-4a26-9316-26447fd58674 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:43:11.553767 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f7304cb7-9f94-4a26-9316-26447fd58674 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] [instance: 19ff8623-9d5a-4ed4-97a3-b2a581ebc311] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:43:11.563408 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f7304cb7-9f94-4a26-9316-26447fd58674 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:11.564524 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f7304cb7-9f94-4a26-9316-26447fd58674 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:11.565150 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f7304cb7-9f94-4a26-9316-26447fd58674 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:11.565868 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f7304cb7-9f94-4a26-9316-26447fd58674 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:11.566326 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f7304cb7-9f94-4a26-9316-26447fd58674 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:11.566472 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4fc4b608-a066-41ef-9928-2ac81557501f tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Going to run 1 instances... {{(pid=122256) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:43:11.567070 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f7304cb7-9f94-4a26-9316-26447fd58674 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:11.568811 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4fc4b608-a066-41ef-9928-2ac81557501f tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] [instance: 8a4079ad-b084-41c9-af05-7e1d9c1a6616] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:43:11.739696 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4fc4b608-a066-41ef-9928-2ac81557501f tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.302629 Aug 31 16:43:11.743685 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3220/6466] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:43:10 2022] POST /compute/v2.1/servers => generated 406 bytes in 1308 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 16:43:11.752301 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d0f7c2f7-6183-47c0-9a13-373aa6667d36 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:43:11.753168 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d0f7c2f7-6183-47c0-9a13-373aa6667d36 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] [instance: 8a4079ad-b084-41c9-af05-7e1d9c1a6616] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:43:11.838277 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f7304cb7-9f94-4a26-9316-26447fd58674 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab56c16d1354864850f8f2e8339b50d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41821cff003462bb6734854b0116d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:43:11.852930 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f7304cb7-9f94-4a26-9316-26447fd58674 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] 10.222.0.61 "GET /compute/v2.1/servers/19ff8623-9d5a-4ed4-97a3-b2a581ebc311" status: 200 len: 1319 microversion: 2.1 time: 0.307285 Aug 31 16:43:11.856492 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3247/6467] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:43:11 2022] GET /compute/v2.1/servers/19ff8623-9d5a-4ed4-97a3-b2a581ebc311 => generated 1319 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:43:11.910477 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d0f7c2f7-6183-47c0-9a13-373aa6667d36 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e026a8cdb13f47de942566a2d4a10bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5827544f2e140e3b44d712d1623a06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:43:11.920104 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d0f7c2f7-6183-47c0-9a13-373aa6667d36 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] 10.222.0.61 "GET /compute/v2.1/servers/8a4079ad-b084-41c9-af05-7e1d9c1a6616" status: 200 len: 1248 microversion: 2.1 time: 0.171664 Aug 31 16:43:11.920712 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3221/6468] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:43:11 2022] GET /compute/v2.1/servers/8a4079ad-b084-41c9-af05-7e1d9c1a6616 => generated 1248 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:43:12.269679 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7e6bb2ed-508a-4a99-8403-942c38490c1a tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:43:12.271322 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7e6bb2ed-508a-4a99-8403-942c38490c1a tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] [instance: 98964e5a-9c6a-4be8-af79-95db246ebcc4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:43:12.306481 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7e6bb2ed-508a-4a99-8403-942c38490c1a tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:12.308706 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7e6bb2ed-508a-4a99-8403-942c38490c1a tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:12.309310 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7e6bb2ed-508a-4a99-8403-942c38490c1a tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:12.317262 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7e6bb2ed-508a-4a99-8403-942c38490c1a tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:12.318011 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7e6bb2ed-508a-4a99-8403-942c38490c1a tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:12.318772 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7e6bb2ed-508a-4a99-8403-942c38490c1a tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:12.512090 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7e6bb2ed-508a-4a99-8403-942c38490c1a tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb78657f161443083d53a3b29fb4406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a56640b635e400694f60d00a5f922e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:43:12.526151 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7e6bb2ed-508a-4a99-8403-942c38490c1a tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] 10.222.0.61 "GET /compute/v2.1/servers/98964e5a-9c6a-4be8-af79-95db246ebcc4" status: 200 len: 1397 microversion: 2.1 time: 0.262461 Aug 31 16:43:12.528808 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3248/6469] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:43:12 2022] GET /compute/v2.1/servers/98964e5a-9c6a-4be8-af79-95db246ebcc4 => generated 1397 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:43:12.878324 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-06eafe53-4b75-4d21-9d46-4a6d3a7c1b7a tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:43:12.879713 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-06eafe53-4b75-4d21-9d46-4a6d3a7c1b7a tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] [instance: 19ff8623-9d5a-4ed4-97a3-b2a581ebc311] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:43:12.896169 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-06eafe53-4b75-4d21-9d46-4a6d3a7c1b7a tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:12.896964 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-06eafe53-4b75-4d21-9d46-4a6d3a7c1b7a tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:12.899802 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-06eafe53-4b75-4d21-9d46-4a6d3a7c1b7a tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:12.900790 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-06eafe53-4b75-4d21-9d46-4a6d3a7c1b7a tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:12.904267 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-06eafe53-4b75-4d21-9d46-4a6d3a7c1b7a tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:12.904892 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-06eafe53-4b75-4d21-9d46-4a6d3a7c1b7a tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:12.942029 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-dcaa6cfa-ecf2-4d71-a08f-4d436a01cb6a tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:43:12.943917 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-dcaa6cfa-ecf2-4d71-a08f-4d436a01cb6a tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] [instance: 8a4079ad-b084-41c9-af05-7e1d9c1a6616] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:43:12.962723 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dcaa6cfa-ecf2-4d71-a08f-4d436a01cb6a tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:12.965152 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dcaa6cfa-ecf2-4d71-a08f-4d436a01cb6a tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:12.968209 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dcaa6cfa-ecf2-4d71-a08f-4d436a01cb6a tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:12.969916 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dcaa6cfa-ecf2-4d71-a08f-4d436a01cb6a tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:12.972573 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dcaa6cfa-ecf2-4d71-a08f-4d436a01cb6a tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:12.974184 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dcaa6cfa-ecf2-4d71-a08f-4d436a01cb6a tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:13.280593 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-dcaa6cfa-ecf2-4d71-a08f-4d436a01cb6a tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e026a8cdb13f47de942566a2d4a10bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5827544f2e140e3b44d712d1623a06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:43:13.297003 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-dcaa6cfa-ecf2-4d71-a08f-4d436a01cb6a tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] 10.222.0.61 "GET /compute/v2.1/servers/8a4079ad-b084-41c9-af05-7e1d9c1a6616" status: 200 len: 1244 microversion: 2.1 time: 0.359327 Aug 31 16:43:13.300533 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3249/6470] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:43:12 2022] GET /compute/v2.1/servers/8a4079ad-b084-41c9-af05-7e1d9c1a6616 => generated 1244 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:43:13.553902 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-14d23145-6240-4e52-96f7-636fbc51c210 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:43:13.554607 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-14d23145-6240-4e52-96f7-636fbc51c210 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] [instance: 98964e5a-9c6a-4be8-af79-95db246ebcc4] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:43:13.572228 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-14d23145-6240-4e52-96f7-636fbc51c210 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:13.580091 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-14d23145-6240-4e52-96f7-636fbc51c210 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:13.588766 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-14d23145-6240-4e52-96f7-636fbc51c210 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:13.590825 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-14d23145-6240-4e52-96f7-636fbc51c210 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:13.598707 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-14d23145-6240-4e52-96f7-636fbc51c210 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:13.599844 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-14d23145-6240-4e52-96f7-636fbc51c210 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:13.668749 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-06eafe53-4b75-4d21-9d46-4a6d3a7c1b7a tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab56c16d1354864850f8f2e8339b50d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41821cff003462bb6734854b0116d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:43:13.705286 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-06eafe53-4b75-4d21-9d46-4a6d3a7c1b7a tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] 10.222.0.61 "GET /compute/v2.1/servers/19ff8623-9d5a-4ed4-97a3-b2a581ebc311" status: 200 len: 1319 microversion: 2.1 time: 0.831229 Aug 31 16:43:13.710310 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3222/6471] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:43:12 2022] GET /compute/v2.1/servers/19ff8623-9d5a-4ed4-97a3-b2a581ebc311 => generated 1319 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:43:14.083812 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-14d23145-6240-4e52-96f7-636fbc51c210 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb78657f161443083d53a3b29fb4406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a56640b635e400694f60d00a5f922e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:43:14.120347 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-14d23145-6240-4e52-96f7-636fbc51c210 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] 10.222.0.61 "GET /compute/v2.1/servers/98964e5a-9c6a-4be8-af79-95db246ebcc4" status: 200 len: 1397 microversion: 2.1 time: 0.570654 Aug 31 16:43:14.120972 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3250/6472] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:43:13 2022] GET /compute/v2.1/servers/98964e5a-9c6a-4be8-af79-95db246ebcc4 => generated 1397 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:43:14.323248 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-54d376c3-961e-4dfc-9d66-dc666826fc14 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:43:14.323984 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-54d376c3-961e-4dfc-9d66-dc666826fc14 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] [instance: 8a4079ad-b084-41c9-af05-7e1d9c1a6616] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:43:14.336151 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-54d376c3-961e-4dfc-9d66-dc666826fc14 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:14.341133 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-54d376c3-961e-4dfc-9d66-dc666826fc14 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:14.343720 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-54d376c3-961e-4dfc-9d66-dc666826fc14 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:14.344788 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-54d376c3-961e-4dfc-9d66-dc666826fc14 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:14.346181 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-54d376c3-961e-4dfc-9d66-dc666826fc14 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:14.348059 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-54d376c3-961e-4dfc-9d66-dc666826fc14 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:14.511223 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-54d376c3-961e-4dfc-9d66-dc666826fc14 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e026a8cdb13f47de942566a2d4a10bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5827544f2e140e3b44d712d1623a06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:43:14.523563 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-54d376c3-961e-4dfc-9d66-dc666826fc14 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] 10.222.0.61 "GET /compute/v2.1/servers/8a4079ad-b084-41c9-af05-7e1d9c1a6616" status: 200 len: 1306 microversion: 2.1 time: 0.205857 Aug 31 16:43:14.525553 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3223/6473] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:43:14 2022] GET /compute/v2.1/servers/8a4079ad-b084-41c9-af05-7e1d9c1a6616 => generated 1306 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:43:14.736290 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-660b3ccd-e858-4351-b268-fbabc905e56a tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:43:14.737770 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-660b3ccd-e858-4351-b268-fbabc905e56a tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] [instance: 19ff8623-9d5a-4ed4-97a3-b2a581ebc311] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:43:14.753771 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-660b3ccd-e858-4351-b268-fbabc905e56a tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:14.754863 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-660b3ccd-e858-4351-b268-fbabc905e56a tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:14.756390 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-660b3ccd-e858-4351-b268-fbabc905e56a tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:14.761934 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-660b3ccd-e858-4351-b268-fbabc905e56a tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:14.764856 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-660b3ccd-e858-4351-b268-fbabc905e56a tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:14.765435 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-660b3ccd-e858-4351-b268-fbabc905e56a tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:15.144382 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e65a128a-c6ad-4432-b7df-000c58374dca tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:43:15.145252 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e65a128a-c6ad-4432-b7df-000c58374dca tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] [instance: 98964e5a-9c6a-4be8-af79-95db246ebcc4] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:43:15.156060 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e65a128a-c6ad-4432-b7df-000c58374dca tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:15.156645 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e65a128a-c6ad-4432-b7df-000c58374dca tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:15.157987 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e65a128a-c6ad-4432-b7df-000c58374dca tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:15.161756 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e65a128a-c6ad-4432-b7df-000c58374dca tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:15.162280 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e65a128a-c6ad-4432-b7df-000c58374dca tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:15.162925 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e65a128a-c6ad-4432-b7df-000c58374dca tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:15.253323 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-e65a128a-c6ad-4432-b7df-000c58374dca tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] HTTP exception thrown: Instance 98964e5a-9c6a-4be8-af79-95db246ebcc4 could not be found. Aug 31 16:43:15.263906 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e65a128a-c6ad-4432-b7df-000c58374dca tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Request method failure captured: Aug 31 16:43:15.263906 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/98964e5a-9c6a-4be8-af79-95db246ebcc4 HTTP/1.1 Aug 31 16:43:15.263906 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:43:15.263906 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:43:15.263906 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:43:15.263906 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:43:15.263906 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:43:15.263906 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:43:15.263906 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:43:15.263906 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:43:15.263906 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD44q5YjTTqSNsv6sNDVach-EfFdkUi47wrsR1CdNBjYU2UA2gMt7OFAJnt9oRCJiwRWp9W4QexlLIXnqDKRDrdK0WWE5J7u60ZohQdKaWsGp7fPcG-F7BObPATVm3BWe0cvrWpRtXHkcvg2zAxWqQHaxy0F6re2PWmwdNkeSahSTI7o Aug 31 16:43:15.263906 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:43:15.263906 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:43:15.263906 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:43:15.263906 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:43:15.263906 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:43:15.263906 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:43:15.263906 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 5a56640b635e400694f60d00a5f922e7 Aug 31 16:43:15.263906 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-TestVolumeBackupRestore-919816345 Aug 31 16:43:15.263906 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:43:15.263906 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:43:15.263906 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5a56640b635e400694f60d00a5f922e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5a56640b635e400694f60d00a5f922e7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5a56640b635e400694f60d00a5f922e7", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5a56640b635e400694f60d00a5f922e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:43:15.263906 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-TestVolumeBackupRestore-919816345 Aug 31 16:43:15.263906 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 5a56640b635e400694f60d00a5f922e7 Aug 31 16:43:15.263906 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-TestVolumeBackupRestore-919816345 Aug 31 16:43:15.263906 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-TestVolumeBackupRestore-919816345-project Aug 31 16:43:15.263906 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:43:15.263906 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:43:15.263906 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: fdb78657f161443083d53a3b29fb4406 Aug 31 16:43:15.263906 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-TestVolumeBackupRestore-919816345-project Aug 31 16:43:15.263906 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:43:15.263906 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance 98964e5a-9c6a-4be8-af79-95db246ebcc4 could not be found. Aug 31 16:43:15.263906 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '98964e5a-9c6a-4be8-af79-95db246ebcc4'} Aug 31 16:43:15.263906 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:43:15.263906 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:43:15.263906 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:43:15.263906 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:43:15.263906 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:43:15.263906 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:43:15.263906 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:43:15.263906 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:43:15.263906 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:43:15.263906 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:43:15.263906 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98964e5a-9c6a-4be8-af79-95db246ebcc4 could not be found. Aug 31 16:43:15.263906 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:43:15.263906 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:43:15.263906 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:43:15.263906 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:43:15.263906 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:43:15.263906 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:43:15.263906 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:43:15.263906 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:43:15.263906 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:43:15.263906 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:43:15.263906 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:43:15.263906 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:43:15.263906 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:43:15.263906 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:43:15.263906 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:43:15.263906 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:43:15.263906 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98964e5a-9c6a-4be8-af79-95db246ebcc4 could not be found. Aug 31 16:43:15.263906 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:43:15.263906 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:43:15.263906 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:43:15.269308 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:43:15.269308 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:43:15.269308 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:43:15.269308 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:43:15.269308 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:43:15.269308 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98964e5a-9c6a-4be8-af79-95db246ebcc4 could not be found. Aug 31 16:43:15.269308 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:43:15.279824 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e65a128a-c6ad-4432-b7df-000c58374dca tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Returning 404 to user: Instance 98964e5a-9c6a-4be8-af79-95db246ebcc4 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:43:15.289882 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e65a128a-c6ad-4432-b7df-000c58374dca tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] 10.222.0.61 "GET /compute/v2.1/servers/98964e5a-9c6a-4be8-af79-95db246ebcc4" status: 404 len: 111 microversion: 2.1 time: 0.142112 Aug 31 16:43:15.291190 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3224/6474] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:43:15 2022] GET /compute/v2.1/servers/98964e5a-9c6a-4be8-af79-95db246ebcc4 => generated 111 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:43:15.562390 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-822a9784-3c80-4ee8-9e69-a815894ecf11 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:43:15.563205 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-822a9784-3c80-4ee8-9e69-a815894ecf11 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] [instance: 8a4079ad-b084-41c9-af05-7e1d9c1a6616] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:43:15.574671 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-822a9784-3c80-4ee8-9e69-a815894ecf11 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:15.582021 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-822a9784-3c80-4ee8-9e69-a815894ecf11 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:15.586572 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-822a9784-3c80-4ee8-9e69-a815894ecf11 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:15.588592 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-822a9784-3c80-4ee8-9e69-a815894ecf11 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:15.589496 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-822a9784-3c80-4ee8-9e69-a815894ecf11 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:15.593261 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-822a9784-3c80-4ee8-9e69-a815894ecf11 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:15.835600 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-822a9784-3c80-4ee8-9e69-a815894ecf11 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e026a8cdb13f47de942566a2d4a10bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5827544f2e140e3b44d712d1623a06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:43:15.845001 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-660b3ccd-e858-4351-b268-fbabc905e56a tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab56c16d1354864850f8f2e8339b50d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41821cff003462bb6734854b0116d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:43:15.897345 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-660b3ccd-e858-4351-b268-fbabc905e56a tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] 10.222.0.61 "GET /compute/v2.1/servers/19ff8623-9d5a-4ed4-97a3-b2a581ebc311" status: 200 len: 1319 microversion: 2.1 time: 1.160886 Aug 31 16:43:15.900285 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-822a9784-3c80-4ee8-9e69-a815894ecf11 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] 10.222.0.61 "GET /compute/v2.1/servers/8a4079ad-b084-41c9-af05-7e1d9c1a6616" status: 200 len: 1306 microversion: 2.1 time: 0.345314 Aug 31 16:43:15.900957 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3225/6475] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:43:15 2022] GET /compute/v2.1/servers/8a4079ad-b084-41c9-af05-7e1d9c1a6616 => generated 1306 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:43:15.901937 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3251/6476] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:43:14 2022] GET /compute/v2.1/servers/19ff8623-9d5a-4ed4-97a3-b2a581ebc311 => generated 1319 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:43:16.075720 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c30eab52-37fa-4c22-baeb-6aa54617d140 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] Calling method '.version_select at 0x7f5ae937a310>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:43:16.153793 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c30eab52-37fa-4c22-baeb-6aa54617d140 tempest-TestVolumeBackupRestore-919816345 tempest-TestVolumeBackupRestore-919816345-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1617523581" status: 202 len: 0 microversion: 2.1 time: 0.083761 Aug 31 16:43:16.155092 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3226/6477] 10.222.0.61 () {58 vars in 1269 bytes} [Wed Aug 31 16:43:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1617523581 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:43:16.934719 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a0a98f9e-1848-41aa-b3b9-4a2756b2d927 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:43:16.935391 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a0a98f9e-1848-41aa-b3b9-4a2756b2d927 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] [instance: 8a4079ad-b084-41c9-af05-7e1d9c1a6616] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:43:16.947313 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-556dfec9-968b-425e-a78d-95a12c81dfc2 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:43:16.947998 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-556dfec9-968b-425e-a78d-95a12c81dfc2 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] [instance: 19ff8623-9d5a-4ed4-97a3-b2a581ebc311] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:43:16.975624 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-556dfec9-968b-425e-a78d-95a12c81dfc2 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:16.976136 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-556dfec9-968b-425e-a78d-95a12c81dfc2 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:16.977399 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a0a98f9e-1848-41aa-b3b9-4a2756b2d927 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:16.979781 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-556dfec9-968b-425e-a78d-95a12c81dfc2 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:16.980721 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-556dfec9-968b-425e-a78d-95a12c81dfc2 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:16.981387 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-556dfec9-968b-425e-a78d-95a12c81dfc2 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:16.981762 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a0a98f9e-1848-41aa-b3b9-4a2756b2d927 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:16.982262 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a0a98f9e-1848-41aa-b3b9-4a2756b2d927 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:16.982702 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-556dfec9-968b-425e-a78d-95a12c81dfc2 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:16.983264 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a0a98f9e-1848-41aa-b3b9-4a2756b2d927 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:16.986884 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a0a98f9e-1848-41aa-b3b9-4a2756b2d927 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:16.987600 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a0a98f9e-1848-41aa-b3b9-4a2756b2d927 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:17.883829 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-556dfec9-968b-425e-a78d-95a12c81dfc2 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab56c16d1354864850f8f2e8339b50d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41821cff003462bb6734854b0116d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:43:17.901871 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-556dfec9-968b-425e-a78d-95a12c81dfc2 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] 10.222.0.61 "GET /compute/v2.1/servers/19ff8623-9d5a-4ed4-97a3-b2a581ebc311" status: 200 len: 1319 microversion: 2.1 time: 0.970492 Aug 31 16:43:17.903073 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3252/6478] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:43:16 2022] GET /compute/v2.1/servers/19ff8623-9d5a-4ed4-97a3-b2a581ebc311 => generated 1319 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:43:17.917651 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5847e33c-9172-40b4-a762-bd3c08ee8e0c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-767884768", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "1080c430-7d3a-4c57-add8-a0f7805ad430", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "0b707539-6131-412e-ba43-5bdd2cb0fbe5"}]}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:43:18.055411 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a0a98f9e-1848-41aa-b3b9-4a2756b2d927 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e026a8cdb13f47de942566a2d4a10bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5827544f2e140e3b44d712d1623a06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:43:18.068256 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a0a98f9e-1848-41aa-b3b9-4a2756b2d927 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] 10.222.0.61 "GET /compute/v2.1/servers/8a4079ad-b084-41c9-af05-7e1d9c1a6616" status: 200 len: 1374 microversion: 2.1 time: 1.145399 Aug 31 16:43:18.071822 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3227/6479] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:43:16 2022] GET /compute/v2.1/servers/8a4079ad-b084-41c9-af05-7e1d9c1a6616 => generated 1374 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:43:18.202693 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-5847e33c-9172-40b4-a762-bd3c08ee8e0c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] validate_networks() for [('0b707539-6131-412e-ba43-5bdd2cb0fbe5', None, None, None, None, None)] {{(pid=122257) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:43:18.607779 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-2ef26d57-ba61-4a99-aa4d-1fb69ba76a4d req-43b0145c-86fd-415f-936a-630077856e53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a4079ad-b084-41c9-af05-7e1d9c1a6616", "tag": "d29323fd-2f20-4dbd-955c-b1c62b01a8e6"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:43:18.645698 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-2ef26d57-ba61-4a99-aa4d-1fb69ba76a4d req-43b0145c-86fd-415f-936a-630077856e53 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:18.648378 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-2ef26d57-ba61-4a99-aa4d-1fb69ba76a4d req-43b0145c-86fd-415f-936a-630077856e53 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:18.650307 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-2ef26d57-ba61-4a99-aa4d-1fb69ba76a4d req-43b0145c-86fd-415f-936a-630077856e53 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:18.678706 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-2ef26d57-ba61-4a99-aa4d-1fb69ba76a4d req-43b0145c-86fd-415f-936a-630077856e53 service nova] Creating event network-changed:d29323fd-2f20-4dbd-955c-b1c62b01a8e6 for instance 8a4079ad-b084-41c9-af05-7e1d9c1a6616 on n-h1-850499-9 Aug 31 16:43:18.694242 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-2ef26d57-ba61-4a99-aa4d-1fb69ba76a4d req-43b0145c-86fd-415f-936a-630077856e53 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098656 Aug 31 16:43:18.696139 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3228/6480] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:43:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:43:18.934510 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2948e30a-4ec7-4352-afa5-d93567f91c0b tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:43:18.935237 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2948e30a-4ec7-4352-afa5-d93567f91c0b tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] [instance: 19ff8623-9d5a-4ed4-97a3-b2a581ebc311] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:43:18.965467 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2948e30a-4ec7-4352-afa5-d93567f91c0b tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:18.966001 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2948e30a-4ec7-4352-afa5-d93567f91c0b tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:18.968758 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2948e30a-4ec7-4352-afa5-d93567f91c0b tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:18.969582 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2948e30a-4ec7-4352-afa5-d93567f91c0b tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:18.970049 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2948e30a-4ec7-4352-afa5-d93567f91c0b tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:18.970505 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2948e30a-4ec7-4352-afa5-d93567f91c0b tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:20.620912 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-2948e30a-4ec7-4352-afa5-d93567f91c0b tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab56c16d1354864850f8f2e8339b50d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41821cff003462bb6734854b0116d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:43:20.633387 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2948e30a-4ec7-4352-afa5-d93567f91c0b tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] 10.222.0.61 "GET /compute/v2.1/servers/19ff8623-9d5a-4ed4-97a3-b2a581ebc311" status: 200 len: 1319 microversion: 2.1 time: 1.711614 Aug 31 16:43:20.666993 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3229/6481] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:43:18 2022] GET /compute/v2.1/servers/19ff8623-9d5a-4ed4-97a3-b2a581ebc311 => generated 1319 bytes in 1747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:43:20.674231 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0f689119-822e-4fad-ba00-84f28bb0a9fa tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:43:20.685512 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0f689119-822e-4fad-ba00-84f28bb0a9fa tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] [instance: 8a4079ad-b084-41c9-af05-7e1d9c1a6616] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:43:20.703692 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0f689119-822e-4fad-ba00-84f28bb0a9fa tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:20.704221 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0f689119-822e-4fad-ba00-84f28bb0a9fa tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:20.705882 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0f689119-822e-4fad-ba00-84f28bb0a9fa tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:20.707796 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0f689119-822e-4fad-ba00-84f28bb0a9fa tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:20.710011 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0f689119-822e-4fad-ba00-84f28bb0a9fa tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:20.712192 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0f689119-822e-4fad-ba00-84f28bb0a9fa tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:21.049212 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-0f689119-822e-4fad-ba00-84f28bb0a9fa tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e026a8cdb13f47de942566a2d4a10bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5827544f2e140e3b44d712d1623a06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:43:21.068224 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0f689119-822e-4fad-ba00-84f28bb0a9fa tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] 10.222.0.61 "GET /compute/v2.1/servers/8a4079ad-b084-41c9-af05-7e1d9c1a6616" status: 200 len: 1374 microversion: 2.1 time: 0.399642 Aug 31 16:43:21.074865 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3230/6482] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:43:20 2022] GET /compute/v2.1/servers/8a4079ad-b084-41c9-af05-7e1d9c1a6616 => generated 1374 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:43:21.093651 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-0b688c6f-831f-4eb5-abfe-6f818246e6bf req-3c6a52f6-cf6a-4e48-a1fb-cf58e5e19fcb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19ff8623-9d5a-4ed4-97a3-b2a581ebc311", "name": "network-vif-plugged", "status": "completed", "tag": "d1cbae75-4e96-419f-b749-a514a1724ecc"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:43:21.142277 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-0b688c6f-831f-4eb5-abfe-6f818246e6bf req-3c6a52f6-cf6a-4e48-a1fb-cf58e5e19fcb service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:21.142774 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-0b688c6f-831f-4eb5-abfe-6f818246e6bf req-3c6a52f6-cf6a-4e48-a1fb-cf58e5e19fcb service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:21.143302 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-0b688c6f-831f-4eb5-abfe-6f818246e6bf req-3c6a52f6-cf6a-4e48-a1fb-cf58e5e19fcb service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:21.163165 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:43:21.214418 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-0b688c6f-831f-4eb5-abfe-6f818246e6bf req-3c6a52f6-cf6a-4e48-a1fb-cf58e5e19fcb service nova] Creating event network-vif-plugged:d1cbae75-4e96-419f-b749-a514a1724ecc for instance 19ff8623-9d5a-4ed4-97a3-b2a581ebc311 on n-h2-850499-9 Aug 31 16:43:21.238452 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-0b688c6f-831f-4eb5-abfe-6f818246e6bf req-3c6a52f6-cf6a-4e48-a1fb-cf58e5e19fcb service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161149 Aug 31 16:43:21.248177 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3231/6483] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:43:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:43:21.657336 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3fbfba51-58cf-4f39-bfe4-0c800e5ea55a tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:43:21.658062 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3fbfba51-58cf-4f39-bfe4-0c800e5ea55a tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] [instance: 19ff8623-9d5a-4ed4-97a3-b2a581ebc311] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:43:21.669301 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:43:21.698447 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3fbfba51-58cf-4f39-bfe4-0c800e5ea55a tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:21.699361 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3fbfba51-58cf-4f39-bfe4-0c800e5ea55a tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:21.705113 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3fbfba51-58cf-4f39-bfe4-0c800e5ea55a tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:21.706242 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3fbfba51-58cf-4f39-bfe4-0c800e5ea55a tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:21.709354 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3fbfba51-58cf-4f39-bfe4-0c800e5ea55a tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:21.710330 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3fbfba51-58cf-4f39-bfe4-0c800e5ea55a tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:21.920103 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=18 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:43:22.511320 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-5847e33c-9172-40b4-a762-bd3c08ee8e0c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:43:22.511873 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-5847e33c-9172-40b4-a762-bd3c08ee8e0c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:43:22.516283 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-5847e33c-9172-40b4-a762-bd3c08ee8e0c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:43:22.517010 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-5847e33c-9172-40b4-a762-bd3c08ee8e0c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:43:22.517457 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-5847e33c-9172-40b4-a762-bd3c08ee8e0c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:43:22.538323 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5847e33c-9172-40b4-a762-bd3c08ee8e0c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:22.544495 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5847e33c-9172-40b4-a762-bd3c08ee8e0c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:22.544770 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5847e33c-9172-40b4-a762-bd3c08ee8e0c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:22.555210 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5847e33c-9172-40b4-a762-bd3c08ee8e0c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:22.555471 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5847e33c-9172-40b4-a762-bd3c08ee8e0c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:22.556075 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5847e33c-9172-40b4-a762-bd3c08ee8e0c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:22.593708 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3fbfba51-58cf-4f39-bfe4-0c800e5ea55a tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab56c16d1354864850f8f2e8339b50d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41821cff003462bb6734854b0116d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:43:22.627312 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3fbfba51-58cf-4f39-bfe4-0c800e5ea55a tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] 10.222.0.61 "GET /compute/v2.1/servers/19ff8623-9d5a-4ed4-97a3-b2a581ebc311" status: 200 len: 1319 microversion: 2.1 time: 0.973305 Aug 31 16:43:22.629553 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3232/6484] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:43:21 2022] GET /compute/v2.1/servers/19ff8623-9d5a-4ed4-97a3-b2a581ebc311 => generated 1319 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:43:22.652075 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ab697f17-1f4e-4479-8f8a-b5a1e060ad4a tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:43:22.655843 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ab697f17-1f4e-4479-8f8a-b5a1e060ad4a tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] [instance: 8a4079ad-b084-41c9-af05-7e1d9c1a6616] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:43:22.663293 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-5847e33c-9172-40b4-a762-bd3c08ee8e0c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Getting quotas for project 798d7eff58b04ab582bac1e87112625f. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:43:22.686005 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ab697f17-1f4e-4479-8f8a-b5a1e060ad4a tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:22.688387 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ab697f17-1f4e-4479-8f8a-b5a1e060ad4a tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:22.690134 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ab697f17-1f4e-4479-8f8a-b5a1e060ad4a tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:22.692322 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ab697f17-1f4e-4479-8f8a-b5a1e060ad4a tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:22.693335 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-5847e33c-9172-40b4-a762-bd3c08ee8e0c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Getting quotas for user 588d2ef08d8345a6b6175c8287633270 and project 798d7eff58b04ab582bac1e87112625f. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:43:22.698036 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ab697f17-1f4e-4479-8f8a-b5a1e060ad4a tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:22.700323 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ab697f17-1f4e-4479-8f8a-b5a1e060ad4a tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:22.761843 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5847e33c-9172-40b4-a762-bd3c08ee8e0c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Going to run 1 instances... {{(pid=122257) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:43:22.769803 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5847e33c-9172-40b4-a762-bd3c08ee8e0c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: a89947bc-0241-4e87-bbbf-2fed45fa4cb6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='1080c430-7d3a-4c57-add8-a0f7805ad430',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:43:23.005589 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5847e33c-9172-40b4-a762-bd3c08ee8e0c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.094014 Aug 31 16:43:23.022979 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3253/6485] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:43:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 5112 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:43:23.046082 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a089dd86-f47f-4e86-b578-1950ead6398d tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:43:23.065480 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a089dd86-f47f-4e86-b578-1950ead6398d tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: a89947bc-0241-4e87-bbbf-2fed45fa4cb6] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:43:23.464056 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ab697f17-1f4e-4479-8f8a-b5a1e060ad4a tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e026a8cdb13f47de942566a2d4a10bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5827544f2e140e3b44d712d1623a06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:43:23.493527 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a089dd86-f47f-4e86-b578-1950ead6398d tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:43:23.501322 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a089dd86-f47f-4e86-b578-1950ead6398d tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/a89947bc-0241-4e87-bbbf-2fed45fa4cb6" status: 200 len: 1056 microversion: 2.1 time: 0.473190 Aug 31 16:43:23.519357 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3254/6486] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:43:23 2022] GET /compute/v2.1/servers/a89947bc-0241-4e87-bbbf-2fed45fa4cb6 => generated 1056 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:43:23.528187 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ab697f17-1f4e-4479-8f8a-b5a1e060ad4a tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] 10.222.0.61 "GET /compute/v2.1/servers/8a4079ad-b084-41c9-af05-7e1d9c1a6616" status: 200 len: 1374 microversion: 2.1 time: 0.851022 Aug 31 16:43:23.529212 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3233/6487] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:43:22 2022] GET /compute/v2.1/servers/8a4079ad-b084-41c9-af05-7e1d9c1a6616 => generated 1374 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:43:23.652275 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1dd9ab86-5349-4c6b-b146-ee9ca793cb59 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:43:23.653838 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1dd9ab86-5349-4c6b-b146-ee9ca793cb59 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] [instance: 19ff8623-9d5a-4ed4-97a3-b2a581ebc311] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:43:23.666305 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1dd9ab86-5349-4c6b-b146-ee9ca793cb59 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:23.667149 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1dd9ab86-5349-4c6b-b146-ee9ca793cb59 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:23.667898 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1dd9ab86-5349-4c6b-b146-ee9ca793cb59 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:23.670216 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1dd9ab86-5349-4c6b-b146-ee9ca793cb59 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:23.670801 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1dd9ab86-5349-4c6b-b146-ee9ca793cb59 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:23.671343 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1dd9ab86-5349-4c6b-b146-ee9ca793cb59 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:24.323062 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-1dd9ab86-5349-4c6b-b146-ee9ca793cb59 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab56c16d1354864850f8f2e8339b50d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41821cff003462bb6734854b0116d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:43:24.351027 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1dd9ab86-5349-4c6b-b146-ee9ca793cb59 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] 10.222.0.61 "GET /compute/v2.1/servers/19ff8623-9d5a-4ed4-97a3-b2a581ebc311" status: 200 len: 1319 microversion: 2.1 time: 0.704562 Aug 31 16:43:24.373811 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3255/6488] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:43:23 2022] GET /compute/v2.1/servers/19ff8623-9d5a-4ed4-97a3-b2a581ebc311 => generated 1319 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:43:24.542819 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5623d7c3-23fc-4ac6-af29-a517fff47c2b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:43:24.545016 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5623d7c3-23fc-4ac6-af29-a517fff47c2b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: a89947bc-0241-4e87-bbbf-2fed45fa4cb6] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:43:24.559267 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-55ad38f0-95b4-4173-8e11-239e3af80ecd tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:43:24.561273 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-55ad38f0-95b4-4173-8e11-239e3af80ecd tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] [instance: 8a4079ad-b084-41c9-af05-7e1d9c1a6616] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:43:24.586389 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:43:24.588866 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5623d7c3-23fc-4ac6-af29-a517fff47c2b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:24.589679 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5623d7c3-23fc-4ac6-af29-a517fff47c2b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:24.590412 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5623d7c3-23fc-4ac6-af29-a517fff47c2b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:24.640750 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-55ad38f0-95b4-4173-8e11-239e3af80ecd tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:24.642334 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-55ad38f0-95b4-4173-8e11-239e3af80ecd tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:24.645430 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-55ad38f0-95b4-4173-8e11-239e3af80ecd tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:24.646440 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5623d7c3-23fc-4ac6-af29-a517fff47c2b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:24.648926 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5623d7c3-23fc-4ac6-af29-a517fff47c2b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:24.649835 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-55ad38f0-95b4-4173-8e11-239e3af80ecd tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:24.651060 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-55ad38f0-95b4-4173-8e11-239e3af80ecd tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:24.651775 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-55ad38f0-95b4-4173-8e11-239e3af80ecd tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:24.652327 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5623d7c3-23fc-4ac6-af29-a517fff47c2b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:25.141078 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5623d7c3-23fc-4ac6-af29-a517fff47c2b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:43:25.184308 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5623d7c3-23fc-4ac6-af29-a517fff47c2b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/a89947bc-0241-4e87-bbbf-2fed45fa4cb6" status: 200 len: 1060 microversion: 2.1 time: 0.647168 Aug 31 16:43:25.200441 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3234/6489] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:43:24 2022] GET /compute/v2.1/servers/a89947bc-0241-4e87-bbbf-2fed45fa4cb6 => generated 1060 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:43:25.270082 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-55ad38f0-95b4-4173-8e11-239e3af80ecd tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e026a8cdb13f47de942566a2d4a10bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5827544f2e140e3b44d712d1623a06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:43:25.282258 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-55ad38f0-95b4-4173-8e11-239e3af80ecd tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] 10.222.0.61 "GET /compute/v2.1/servers/8a4079ad-b084-41c9-af05-7e1d9c1a6616" status: 200 len: 1374 microversion: 2.1 time: 0.733261 Aug 31 16:43:25.297712 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3256/6490] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:43:24 2022] GET /compute/v2.1/servers/8a4079ad-b084-41c9-af05-7e1d9c1a6616 => generated 1374 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:43:25.374963 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-326a4490-2116-4f6d-ab6a-fe0381484f61 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:43:25.376711 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-326a4490-2116-4f6d-ab6a-fe0381484f61 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] [instance: 19ff8623-9d5a-4ed4-97a3-b2a581ebc311] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:43:25.407617 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-326a4490-2116-4f6d-ab6a-fe0381484f61 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:25.408137 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-326a4490-2116-4f6d-ab6a-fe0381484f61 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:25.408593 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-326a4490-2116-4f6d-ab6a-fe0381484f61 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:25.411763 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-326a4490-2116-4f6d-ab6a-fe0381484f61 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:25.412276 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-326a4490-2116-4f6d-ab6a-fe0381484f61 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:25.412729 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-326a4490-2116-4f6d-ab6a-fe0381484f61 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:26.207211 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-edc35eea-8a3e-4c62-b961-85bc93175bb6 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:43:26.208892 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-edc35eea-8a3e-4c62-b961-85bc93175bb6 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: a89947bc-0241-4e87-bbbf-2fed45fa4cb6] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:43:26.235189 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-edc35eea-8a3e-4c62-b961-85bc93175bb6 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:26.235734 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-edc35eea-8a3e-4c62-b961-85bc93175bb6 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:26.236190 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-edc35eea-8a3e-4c62-b961-85bc93175bb6 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:26.247836 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-edc35eea-8a3e-4c62-b961-85bc93175bb6 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:26.248714 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-edc35eea-8a3e-4c62-b961-85bc93175bb6 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:26.249390 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-edc35eea-8a3e-4c62-b961-85bc93175bb6 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:26.328725 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=100 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:43:26.671254 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-326a4490-2116-4f6d-ab6a-fe0381484f61 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab56c16d1354864850f8f2e8339b50d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41821cff003462bb6734854b0116d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:43:26.688120 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-326a4490-2116-4f6d-ab6a-fe0381484f61 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] 10.222.0.61 "GET /compute/v2.1/servers/19ff8623-9d5a-4ed4-97a3-b2a581ebc311" status: 200 len: 1507 microversion: 2.1 time: 1.317492 Aug 31 16:43:26.700182 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3235/6491] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:43:25 2022] GET /compute/v2.1/servers/19ff8623-9d5a-4ed4-97a3-b2a581ebc311 => generated 1507 bytes in 1331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:43:26.706207 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c270a060-e2ec-4c80-affc-a61c96923d72 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:43:26.716607 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c270a060-e2ec-4c80-affc-a61c96923d72 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] [instance: 8a4079ad-b084-41c9-af05-7e1d9c1a6616] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:43:26.744683 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c270a060-e2ec-4c80-affc-a61c96923d72 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:26.747136 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c270a060-e2ec-4c80-affc-a61c96923d72 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:26.748972 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c270a060-e2ec-4c80-affc-a61c96923d72 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:26.752616 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c270a060-e2ec-4c80-affc-a61c96923d72 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:26.754759 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c270a060-e2ec-4c80-affc-a61c96923d72 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:26.755447 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c270a060-e2ec-4c80-affc-a61c96923d72 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:26.786214 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-edc35eea-8a3e-4c62-b961-85bc93175bb6 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:43:26.800623 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-edc35eea-8a3e-4c62-b961-85bc93175bb6 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/a89947bc-0241-4e87-bbbf-2fed45fa4cb6" status: 200 len: 1126 microversion: 2.1 time: 0.597944 Aug 31 16:43:26.801225 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3257/6492] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:43:26 2022] GET /compute/v2.1/servers/a89947bc-0241-4e87-bbbf-2fed45fa4cb6 => generated 1126 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:43:27.316939 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c270a060-e2ec-4c80-affc-a61c96923d72 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e026a8cdb13f47de942566a2d4a10bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5827544f2e140e3b44d712d1623a06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:43:27.338171 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c270a060-e2ec-4c80-affc-a61c96923d72 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] 10.222.0.61 "GET /compute/v2.1/servers/8a4079ad-b084-41c9-af05-7e1d9c1a6616" status: 200 len: 1374 microversion: 2.1 time: 0.632596 Aug 31 16:43:27.342608 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3236/6493] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:43:26 2022] GET /compute/v2.1/servers/8a4079ad-b084-41c9-af05-7e1d9c1a6616 => generated 1374 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:43:27.829775 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7ba732d0-3a71-4d5c-ac0c-e84ba6027157 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:43:27.830683 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7ba732d0-3a71-4d5c-ac0c-e84ba6027157 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: a89947bc-0241-4e87-bbbf-2fed45fa4cb6] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:43:27.843126 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7ba732d0-3a71-4d5c-ac0c-e84ba6027157 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:27.843663 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7ba732d0-3a71-4d5c-ac0c-e84ba6027157 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:27.854390 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7ba732d0-3a71-4d5c-ac0c-e84ba6027157 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:27.855231 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7ba732d0-3a71-4d5c-ac0c-e84ba6027157 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:27.855758 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7ba732d0-3a71-4d5c-ac0c-e84ba6027157 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:27.856205 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7ba732d0-3a71-4d5c-ac0c-e84ba6027157 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:28.119960 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7ba732d0-3a71-4d5c-ac0c-e84ba6027157 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:43:28.130364 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7ba732d0-3a71-4d5c-ac0c-e84ba6027157 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/a89947bc-0241-4e87-bbbf-2fed45fa4cb6" status: 200 len: 1126 microversion: 2.1 time: 0.302629 Aug 31 16:43:28.131301 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3258/6494] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:43:27 2022] GET /compute/v2.1/servers/a89947bc-0241-4e87-bbbf-2fed45fa4cb6 => generated 1126 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:43:28.362770 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-060f6003-c767-4e42-8bcb-fd835ffcd2e4 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:43:28.364320 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-060f6003-c767-4e42-8bcb-fd835ffcd2e4 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] [instance: 8a4079ad-b084-41c9-af05-7e1d9c1a6616] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:43:28.378117 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-060f6003-c767-4e42-8bcb-fd835ffcd2e4 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:28.381015 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-060f6003-c767-4e42-8bcb-fd835ffcd2e4 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:28.381715 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-060f6003-c767-4e42-8bcb-fd835ffcd2e4 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:28.383791 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-060f6003-c767-4e42-8bcb-fd835ffcd2e4 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:28.391084 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-060f6003-c767-4e42-8bcb-fd835ffcd2e4 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:28.396516 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-060f6003-c767-4e42-8bcb-fd835ffcd2e4 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:29.019740 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-060f6003-c767-4e42-8bcb-fd835ffcd2e4 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e026a8cdb13f47de942566a2d4a10bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5827544f2e140e3b44d712d1623a06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:43:29.044954 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-060f6003-c767-4e42-8bcb-fd835ffcd2e4 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] 10.222.0.61 "GET /compute/v2.1/servers/8a4079ad-b084-41c9-af05-7e1d9c1a6616" status: 200 len: 1374 microversion: 2.1 time: 0.675596 Aug 31 16:43:29.049227 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3237/6495] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:43:28 2022] GET /compute/v2.1/servers/8a4079ad-b084-41c9-af05-7e1d9c1a6616 => generated 1374 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:43:29.155257 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8be9a8f1-b90d-443d-87ce-e60e68cbfd11 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:43:29.156527 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8be9a8f1-b90d-443d-87ce-e60e68cbfd11 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: a89947bc-0241-4e87-bbbf-2fed45fa4cb6] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:43:29.174451 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8be9a8f1-b90d-443d-87ce-e60e68cbfd11 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:29.175298 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8be9a8f1-b90d-443d-87ce-e60e68cbfd11 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:29.176069 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8be9a8f1-b90d-443d-87ce-e60e68cbfd11 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:29.176549 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8be9a8f1-b90d-443d-87ce-e60e68cbfd11 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:29.177016 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8be9a8f1-b90d-443d-87ce-e60e68cbfd11 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:29.177629 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8be9a8f1-b90d-443d-87ce-e60e68cbfd11 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:29.869616 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8be9a8f1-b90d-443d-87ce-e60e68cbfd11 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:43:29.883532 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8be9a8f1-b90d-443d-87ce-e60e68cbfd11 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/a89947bc-0241-4e87-bbbf-2fed45fa4cb6" status: 200 len: 1168 microversion: 2.1 time: 0.732860 Aug 31 16:43:29.885114 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3259/6496] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:43:29 2022] GET /compute/v2.1/servers/a89947bc-0241-4e87-bbbf-2fed45fa4cb6 => generated 1168 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:43:30.069112 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ea0d877a-2f3a-4c50-a467-a3ffaeda89da tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:43:30.071241 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ea0d877a-2f3a-4c50-a467-a3ffaeda89da tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] [instance: 8a4079ad-b084-41c9-af05-7e1d9c1a6616] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:43:30.093093 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ea0d877a-2f3a-4c50-a467-a3ffaeda89da tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:30.098135 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ea0d877a-2f3a-4c50-a467-a3ffaeda89da tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:30.100917 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ea0d877a-2f3a-4c50-a467-a3ffaeda89da tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:30.102266 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ea0d877a-2f3a-4c50-a467-a3ffaeda89da tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:30.102963 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ea0d877a-2f3a-4c50-a467-a3ffaeda89da tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:30.103407 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ea0d877a-2f3a-4c50-a467-a3ffaeda89da tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:30.907166 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0fed4ad2-5a90-4bbf-8fd7-ea87d7b45b02 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:43:30.908806 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0fed4ad2-5a90-4bbf-8fd7-ea87d7b45b02 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: a89947bc-0241-4e87-bbbf-2fed45fa4cb6] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:43:30.912575 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:43:30.928019 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0fed4ad2-5a90-4bbf-8fd7-ea87d7b45b02 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:30.930087 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0fed4ad2-5a90-4bbf-8fd7-ea87d7b45b02 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:30.930932 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0fed4ad2-5a90-4bbf-8fd7-ea87d7b45b02 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:30.935411 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0fed4ad2-5a90-4bbf-8fd7-ea87d7b45b02 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:30.936462 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0fed4ad2-5a90-4bbf-8fd7-ea87d7b45b02 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:30.940485 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0fed4ad2-5a90-4bbf-8fd7-ea87d7b45b02 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:32.197507 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ea0d877a-2f3a-4c50-a467-a3ffaeda89da tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e026a8cdb13f47de942566a2d4a10bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5827544f2e140e3b44d712d1623a06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:43:32.209230 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ea0d877a-2f3a-4c50-a467-a3ffaeda89da tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] 10.222.0.61 "GET /compute/v2.1/servers/8a4079ad-b084-41c9-af05-7e1d9c1a6616" status: 200 len: 1374 microversion: 2.1 time: 2.144623 Aug 31 16:43:32.213881 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3238/6497] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:43:30 2022] GET /compute/v2.1/servers/8a4079ad-b084-41c9-af05-7e1d9c1a6616 => generated 1374 bytes in 2150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:43:32.605669 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:43:32.614050 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0fed4ad2-5a90-4bbf-8fd7-ea87d7b45b02 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:43:32.619771 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2af1c593-7b9c-4590-b3b4-43d255b850d9 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:43:32.621602 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2af1c593-7b9c-4590-b3b4-43d255b850d9 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:32.622100 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2af1c593-7b9c-4590-b3b4-43d255b850d9 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:32.622579 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2af1c593-7b9c-4590-b3b4-43d255b850d9 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:32.623301 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2af1c593-7b9c-4590-b3b4-43d255b850d9 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:32.623791 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2af1c593-7b9c-4590-b3b4-43d255b850d9 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:32.624228 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2af1c593-7b9c-4590-b3b4-43d255b850d9 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:32.639480 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0fed4ad2-5a90-4bbf-8fd7-ea87d7b45b02 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/a89947bc-0241-4e87-bbbf-2fed45fa4cb6" status: 200 len: 1168 microversion: 2.1 time: 1.734595 Aug 31 16:43:32.640523 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3260/6498] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:43:30 2022] GET /compute/v2.1/servers/a89947bc-0241-4e87-bbbf-2fed45fa4cb6 => generated 1168 bytes in 1739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:43:32.691373 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2af1c593-7b9c-4590-b3b4-43d255b850d9 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] 10.222.0.61 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.475376 Aug 31 16:43:32.692467 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3239/6499] 10.222.0.61 () {58 vars in 1185 bytes} [Wed Aug 31 16:43:32 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:43:33.005607 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0bdd065d-b940-427d-90cd-109eb8247964 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1255120718", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "availability_zone": "nova:n-h1-850499-9", "networks": [{"uuid": "80b1285c-7017-4385-a8a0-2309709dcd5b"}]}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:43:33.149473 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-0bdd065d-b940-427d-90cd-109eb8247964 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] validate_networks() for [('80b1285c-7017-4385-a8a0-2309709dcd5b', None, None, None, None, None)] {{(pid=122257) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:43:33.239050 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-988cc1a4-da2a-4445-a0f7-ef04230d508a tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:43:33.239723 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-988cc1a4-da2a-4445-a0f7-ef04230d508a tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] [instance: 8a4079ad-b084-41c9-af05-7e1d9c1a6616] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:43:33.251950 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-988cc1a4-da2a-4445-a0f7-ef04230d508a tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:33.255518 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-988cc1a4-da2a-4445-a0f7-ef04230d508a tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:33.256193 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-988cc1a4-da2a-4445-a0f7-ef04230d508a tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:33.260402 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-988cc1a4-da2a-4445-a0f7-ef04230d508a tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:33.268497 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-988cc1a4-da2a-4445-a0f7-ef04230d508a tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:33.269242 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-988cc1a4-da2a-4445-a0f7-ef04230d508a tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:33.501725 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=8 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:43:33.940390 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-988cc1a4-da2a-4445-a0f7-ef04230d508a tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e026a8cdb13f47de942566a2d4a10bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5827544f2e140e3b44d712d1623a06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:43:33.977192 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-988cc1a4-da2a-4445-a0f7-ef04230d508a tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] 10.222.0.61 "GET /compute/v2.1/servers/8a4079ad-b084-41c9-af05-7e1d9c1a6616" status: 200 len: 1374 microversion: 2.1 time: 0.742099 Aug 31 16:43:33.981093 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3240/6500] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:43:33 2022] GET /compute/v2.1/servers/8a4079ad-b084-41c9-af05-7e1d9c1a6616 => generated 1374 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:43:34.010645 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-fa29264b-51f9-44ab-a72d-35f24d3336a3 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:43:34.018142 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-fa29264b-51f9-44ab-a72d-35f24d3336a3 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: a89947bc-0241-4e87-bbbf-2fed45fa4cb6] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:43:34.033457 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fa29264b-51f9-44ab-a72d-35f24d3336a3 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:34.033978 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fa29264b-51f9-44ab-a72d-35f24d3336a3 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:34.034436 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fa29264b-51f9-44ab-a72d-35f24d3336a3 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:34.038263 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fa29264b-51f9-44ab-a72d-35f24d3336a3 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:34.038760 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fa29264b-51f9-44ab-a72d-35f24d3336a3 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:34.044493 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fa29264b-51f9-44ab-a72d-35f24d3336a3 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:35.021897 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-fa29264b-51f9-44ab-a72d-35f24d3336a3 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:43:35.032078 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-fa29264b-51f9-44ab-a72d-35f24d3336a3 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/a89947bc-0241-4e87-bbbf-2fed45fa4cb6" status: 200 len: 1168 microversion: 2.1 time: 1.030988 Aug 31 16:43:35.041143 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3241/6501] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:43:33 2022] GET /compute/v2.1/servers/a89947bc-0241-4e87-bbbf-2fed45fa4cb6 => generated 1168 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:43:35.049315 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-333a1a57-ff35-4d3d-8670-45aec8175b91 req-677792f8-2b9c-494b-9122-71df2869fe2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a4079ad-b084-41c9-af05-7e1d9c1a6616", "name": "network-vif-plugged", "status": "completed", "tag": "d29323fd-2f20-4dbd-955c-b1c62b01a8e6"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:43:35.073820 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-333a1a57-ff35-4d3d-8670-45aec8175b91 req-677792f8-2b9c-494b-9122-71df2869fe2b service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:35.080714 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-333a1a57-ff35-4d3d-8670-45aec8175b91 req-677792f8-2b9c-494b-9122-71df2869fe2b service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:35.081382 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-333a1a57-ff35-4d3d-8670-45aec8175b91 req-677792f8-2b9c-494b-9122-71df2869fe2b service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:35.118861 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-333a1a57-ff35-4d3d-8670-45aec8175b91 req-677792f8-2b9c-494b-9122-71df2869fe2b service nova] Creating event network-vif-plugged:d29323fd-2f20-4dbd-955c-b1c62b01a8e6 for instance 8a4079ad-b084-41c9-af05-7e1d9c1a6616 on n-h1-850499-9 Aug 31 16:43:35.135218 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-333a1a57-ff35-4d3d-8670-45aec8175b91 req-677792f8-2b9c-494b-9122-71df2869fe2b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092140 Aug 31 16:43:35.138062 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3242/6502] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:43:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:43:35.153268 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-3e228af9-e441-4ac5-8161-4fd5ba822c95 req-0948e327-3e0f-4849-9748-637035f7a157 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a89947bc-0241-4e87-bbbf-2fed45fa4cb6", "tag": "53b9a29d-be57-4020-b2c2-2ed49d2e1f28"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:43:35.189059 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-3e228af9-e441-4ac5-8161-4fd5ba822c95 req-0948e327-3e0f-4849-9748-637035f7a157 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:35.190008 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-3e228af9-e441-4ac5-8161-4fd5ba822c95 req-0948e327-3e0f-4849-9748-637035f7a157 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:35.190766 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-3e228af9-e441-4ac5-8161-4fd5ba822c95 req-0948e327-3e0f-4849-9748-637035f7a157 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:35.224918 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-3e228af9-e441-4ac5-8161-4fd5ba822c95 req-0948e327-3e0f-4849-9748-637035f7a157 service nova] Creating event network-changed:53b9a29d-be57-4020-b2c2-2ed49d2e1f28 for instance a89947bc-0241-4e87-bbbf-2fed45fa4cb6 on n-h2-850499-9 Aug 31 16:43:35.232346 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-3e228af9-e441-4ac5-8161-4fd5ba822c95 req-0948e327-3e0f-4849-9748-637035f7a157 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082988 Aug 31 16:43:35.234298 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3243/6503] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:43:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:43:35.246537 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f972d733-8551-402a-acd5-7ba8dea83c76 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:43:35.251383 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f972d733-8551-402a-acd5-7ba8dea83c76 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] [instance: 8a4079ad-b084-41c9-af05-7e1d9c1a6616] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:43:35.286493 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f972d733-8551-402a-acd5-7ba8dea83c76 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:35.288145 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f972d733-8551-402a-acd5-7ba8dea83c76 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:35.290420 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f972d733-8551-402a-acd5-7ba8dea83c76 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:35.291572 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f972d733-8551-402a-acd5-7ba8dea83c76 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:35.295032 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f972d733-8551-402a-acd5-7ba8dea83c76 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:35.296850 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f972d733-8551-402a-acd5-7ba8dea83c76 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:36.725593 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f972d733-8551-402a-acd5-7ba8dea83c76 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e026a8cdb13f47de942566a2d4a10bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5827544f2e140e3b44d712d1623a06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:43:36.745950 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-0bdd065d-b940-427d-90cd-109eb8247964 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:43:36.746639 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-0bdd065d-b940-427d-90cd-109eb8247964 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:43:36.746983 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-0bdd065d-b940-427d-90cd-109eb8247964 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:43:36.747398 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-0bdd065d-b940-427d-90cd-109eb8247964 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:43:36.748086 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-0bdd065d-b940-427d-90cd-109eb8247964 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:43:36.756825 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f972d733-8551-402a-acd5-7ba8dea83c76 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] 10.222.0.61 "GET /compute/v2.1/servers/8a4079ad-b084-41c9-af05-7e1d9c1a6616" status: 200 len: 1374 microversion: 2.1 time: 1.517834 Aug 31 16:43:36.757905 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3244/6504] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:43:35 2022] GET /compute/v2.1/servers/8a4079ad-b084-41c9-af05-7e1d9c1a6616 => generated 1374 bytes in 1523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:43:36.760688 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0bdd065d-b940-427d-90cd-109eb8247964 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:36.761352 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0bdd065d-b940-427d-90cd-109eb8247964 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:36.762016 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0bdd065d-b940-427d-90cd-109eb8247964 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:36.763415 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0bdd065d-b940-427d-90cd-109eb8247964 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:36.764915 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0bdd065d-b940-427d-90cd-109eb8247964 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:36.765541 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0bdd065d-b940-427d-90cd-109eb8247964 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:36.831186 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-98f048db-8e9c-4c49-8024-e68aeac166e5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:43:36.832654 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-98f048db-8e9c-4c49-8024-e68aeac166e5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: a89947bc-0241-4e87-bbbf-2fed45fa4cb6] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:43:36.844773 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-0bdd065d-b940-427d-90cd-109eb8247964 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Getting quotas for project 85be82e1abc6450fa1fc362528fb2762. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:43:36.848280 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-98f048db-8e9c-4c49-8024-e68aeac166e5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:36.849418 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-98f048db-8e9c-4c49-8024-e68aeac166e5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:36.851224 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-98f048db-8e9c-4c49-8024-e68aeac166e5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:36.855324 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-98f048db-8e9c-4c49-8024-e68aeac166e5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:36.857621 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-98f048db-8e9c-4c49-8024-e68aeac166e5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:36.859920 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-98f048db-8e9c-4c49-8024-e68aeac166e5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:36.869815 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-0bdd065d-b940-427d-90cd-109eb8247964 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Getting quotas for user ae0a30726eac45fca5856ae95f24e501 and project 85be82e1abc6450fa1fc362528fb2762. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:43:36.927112 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0bdd065d-b940-427d-90cd-109eb8247964 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Going to run 1 instances... {{(pid=122257) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:43:36.933018 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0bdd065d-b940-427d-90cd-109eb8247964 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] [instance: 3d5cba2d-6992-4782-93bf-b4260130af90] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:43:37.030573 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0bdd065d-b940-427d-90cd-109eb8247964 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.029440 Aug 31 16:43:37.031837 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3261/6505] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:43:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 4031 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:43:37.072262 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-bb7b4dbd-71fb-429f-99f7-be9b3b7cdcd9 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:43:37.075413 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-bb7b4dbd-71fb-429f-99f7-be9b3b7cdcd9 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] [instance: 3d5cba2d-6992-4782-93bf-b4260130af90] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:43:37.254821 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-bb7b4dbd-71fb-429f-99f7-be9b3b7cdcd9 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/3d5cba2d-6992-4782-93bf-b4260130af90" status: 200 len: 1329 microversion: 2.1 time: 0.200874 Aug 31 16:43:37.262885 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3262/6506] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:43:37 2022] GET /compute/v2.1/servers/3d5cba2d-6992-4782-93bf-b4260130af90 => generated 1329 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:43:37.464750 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-98f048db-8e9c-4c49-8024-e68aeac166e5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:43:37.482839 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-98f048db-8e9c-4c49-8024-e68aeac166e5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/a89947bc-0241-4e87-bbbf-2fed45fa4cb6" status: 200 len: 1168 microversion: 2.1 time: 0.722706 Aug 31 16:43:37.488636 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3245/6507] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:43:36 2022] GET /compute/v2.1/servers/a89947bc-0241-4e87-bbbf-2fed45fa4cb6 => generated 1168 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:43:37.785811 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e902d0bb-aafc-493f-9987-b41e85e4fd82 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:43:37.786435 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e902d0bb-aafc-493f-9987-b41e85e4fd82 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] [instance: 8a4079ad-b084-41c9-af05-7e1d9c1a6616] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:43:37.800663 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e902d0bb-aafc-493f-9987-b41e85e4fd82 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:37.807909 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e902d0bb-aafc-493f-9987-b41e85e4fd82 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:37.809668 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e902d0bb-aafc-493f-9987-b41e85e4fd82 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:37.811446 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e902d0bb-aafc-493f-9987-b41e85e4fd82 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:37.812838 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e902d0bb-aafc-493f-9987-b41e85e4fd82 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:37.814175 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e902d0bb-aafc-493f-9987-b41e85e4fd82 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:38.280927 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-adebffc4-ed62-4759-be3f-e890390b5b04 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:43:38.282370 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-adebffc4-ed62-4759-be3f-e890390b5b04 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] [instance: 3d5cba2d-6992-4782-93bf-b4260130af90] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:43:38.490732 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-adebffc4-ed62-4759-be3f-e890390b5b04 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/3d5cba2d-6992-4782-93bf-b4260130af90" status: 200 len: 1329 microversion: 2.1 time: 0.213405 Aug 31 16:43:38.495960 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3246/6508] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:43:38 2022] GET /compute/v2.1/servers/3d5cba2d-6992-4782-93bf-b4260130af90 => generated 1329 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:43:38.520959 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-87bf37e3-c053-42c2-a0ae-8398802458cd tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:43:38.522176 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-87bf37e3-c053-42c2-a0ae-8398802458cd tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: a89947bc-0241-4e87-bbbf-2fed45fa4cb6] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:43:38.553920 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-87bf37e3-c053-42c2-a0ae-8398802458cd tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:38.556405 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-87bf37e3-c053-42c2-a0ae-8398802458cd tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:38.557797 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-87bf37e3-c053-42c2-a0ae-8398802458cd tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:38.559395 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-87bf37e3-c053-42c2-a0ae-8398802458cd tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:38.560980 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-87bf37e3-c053-42c2-a0ae-8398802458cd tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:38.561664 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-87bf37e3-c053-42c2-a0ae-8398802458cd tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:38.763850 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e902d0bb-aafc-493f-9987-b41e85e4fd82 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e026a8cdb13f47de942566a2d4a10bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5827544f2e140e3b44d712d1623a06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:43:38.782235 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e902d0bb-aafc-493f-9987-b41e85e4fd82 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] 10.222.0.61 "GET /compute/v2.1/servers/8a4079ad-b084-41c9-af05-7e1d9c1a6616" status: 200 len: 1374 microversion: 2.1 time: 1.002141 Aug 31 16:43:38.784016 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3263/6509] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:43:37 2022] GET /compute/v2.1/servers/8a4079ad-b084-41c9-af05-7e1d9c1a6616 => generated 1374 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:43:39.275762 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-87bf37e3-c053-42c2-a0ae-8398802458cd tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:43:39.308089 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-87bf37e3-c053-42c2-a0ae-8398802458cd tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/a89947bc-0241-4e87-bbbf-2fed45fa4cb6" status: 200 len: 1168 microversion: 2.1 time: 0.792334 Aug 31 16:43:39.321725 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3247/6510] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:43:38 2022] GET /compute/v2.1/servers/a89947bc-0241-4e87-bbbf-2fed45fa4cb6 => generated 1168 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:43:39.526878 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3a3b53d1-66c1-4ea9-8ec2-f57f3ec2583b tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:43:39.528719 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3a3b53d1-66c1-4ea9-8ec2-f57f3ec2583b tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] [instance: 3d5cba2d-6992-4782-93bf-b4260130af90] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:43:39.560331 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3a3b53d1-66c1-4ea9-8ec2-f57f3ec2583b tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:39.561265 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3a3b53d1-66c1-4ea9-8ec2-f57f3ec2583b tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:39.563037 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3a3b53d1-66c1-4ea9-8ec2-f57f3ec2583b tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:39.565066 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3a3b53d1-66c1-4ea9-8ec2-f57f3ec2583b tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:39.568412 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3a3b53d1-66c1-4ea9-8ec2-f57f3ec2583b tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:39.569566 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3a3b53d1-66c1-4ea9-8ec2-f57f3ec2583b tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:39.793842 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3a3b53d1-66c1-4ea9-8ec2-f57f3ec2583b tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/3d5cba2d-6992-4782-93bf-b4260130af90" status: 200 len: 1416 microversion: 2.1 time: 0.271161 Aug 31 16:43:39.794598 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3264/6511] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:43:39 2022] GET /compute/v2.1/servers/3d5cba2d-6992-4782-93bf-b4260130af90 => generated 1416 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:43:39.810808 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-58669be4-d005-4a7b-9cf5-f0b66bfd84ef tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:43:39.811747 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-58669be4-d005-4a7b-9cf5-f0b66bfd84ef tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] [instance: 8a4079ad-b084-41c9-af05-7e1d9c1a6616] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:43:39.819336 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-58669be4-d005-4a7b-9cf5-f0b66bfd84ef tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:39.820123 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-58669be4-d005-4a7b-9cf5-f0b66bfd84ef tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:39.821312 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-58669be4-d005-4a7b-9cf5-f0b66bfd84ef tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:39.822264 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-58669be4-d005-4a7b-9cf5-f0b66bfd84ef tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:39.822971 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-58669be4-d005-4a7b-9cf5-f0b66bfd84ef tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:39.824098 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-58669be4-d005-4a7b-9cf5-f0b66bfd84ef tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:40.352377 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-97a16fb7-40da-4102-99e4-6e9574ef3997 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:43:40.353793 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-97a16fb7-40da-4102-99e4-6e9574ef3997 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: a89947bc-0241-4e87-bbbf-2fed45fa4cb6] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:43:40.407349 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-97a16fb7-40da-4102-99e4-6e9574ef3997 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:40.408422 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-97a16fb7-40da-4102-99e4-6e9574ef3997 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:40.409072 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-97a16fb7-40da-4102-99e4-6e9574ef3997 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:40.413509 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-97a16fb7-40da-4102-99e4-6e9574ef3997 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:40.430111 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-97a16fb7-40da-4102-99e4-6e9574ef3997 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:40.433563 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-97a16fb7-40da-4102-99e4-6e9574ef3997 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:41.291483 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-58669be4-d005-4a7b-9cf5-f0b66bfd84ef tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e026a8cdb13f47de942566a2d4a10bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5827544f2e140e3b44d712d1623a06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:43:41.303106 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-58669be4-d005-4a7b-9cf5-f0b66bfd84ef tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] 10.222.0.61 "GET /compute/v2.1/servers/8a4079ad-b084-41c9-af05-7e1d9c1a6616" status: 200 len: 1546 microversion: 2.1 time: 1.498295 Aug 31 16:43:41.321194 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3248/6512] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:43:39 2022] GET /compute/v2.1/servers/8a4079ad-b084-41c9-af05-7e1d9c1a6616 => generated 1546 bytes in 1518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:43:41.340315 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b065745c-bba4-4e92-96dd-08733d636186 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:43:41.341383 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b065745c-bba4-4e92-96dd-08733d636186 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] [instance: 3d5cba2d-6992-4782-93bf-b4260130af90] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:43:41.365680 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b065745c-bba4-4e92-96dd-08733d636186 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:41.366713 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b065745c-bba4-4e92-96dd-08733d636186 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:41.368158 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b065745c-bba4-4e92-96dd-08733d636186 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:41.369319 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b065745c-bba4-4e92-96dd-08733d636186 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:41.371205 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b065745c-bba4-4e92-96dd-08733d636186 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:41.376162 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b065745c-bba4-4e92-96dd-08733d636186 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:41.676723 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b065745c-bba4-4e92-96dd-08733d636186 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/3d5cba2d-6992-4782-93bf-b4260130af90" status: 200 len: 1422 microversion: 2.1 time: 0.353976 Aug 31 16:43:41.727068 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3249/6513] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:43:41 2022] GET /compute/v2.1/servers/3d5cba2d-6992-4782-93bf-b4260130af90 => generated 1422 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:43:41.771042 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7af7423c-2daf-4ac6-aca1-730f0886ade1 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:43:41.779280 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7af7423c-2daf-4ac6-aca1-730f0886ade1 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] [instance: 8a4079ad-b084-41c9-af05-7e1d9c1a6616] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:43:41.807083 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7af7423c-2daf-4ac6-aca1-730f0886ade1 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:41.808743 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7af7423c-2daf-4ac6-aca1-730f0886ade1 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:41.810786 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7af7423c-2daf-4ac6-aca1-730f0886ade1 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:41.814664 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7af7423c-2daf-4ac6-aca1-730f0886ade1 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:41.818310 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7af7423c-2daf-4ac6-aca1-730f0886ade1 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:41.818990 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7af7423c-2daf-4ac6-aca1-730f0886ade1 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:41.824307 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-97a16fb7-40da-4102-99e4-6e9574ef3997 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:43:41.854434 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-97a16fb7-40da-4102-99e4-6e9574ef3997 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/a89947bc-0241-4e87-bbbf-2fed45fa4cb6" status: 200 len: 1168 microversion: 2.1 time: 1.513291 Aug 31 16:43:41.880104 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3265/6514] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:43:40 2022] GET /compute/v2.1/servers/a89947bc-0241-4e87-bbbf-2fed45fa4cb6 => generated 1168 bytes in 1542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:43:42.410087 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7af7423c-2daf-4ac6-aca1-730f0886ade1 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e026a8cdb13f47de942566a2d4a10bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5827544f2e140e3b44d712d1623a06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:43:42.438408 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7af7423c-2daf-4ac6-aca1-730f0886ade1 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] 10.222.0.61 "GET /compute/v2.1/servers/8a4079ad-b084-41c9-af05-7e1d9c1a6616" status: 200 len: 1546 microversion: 2.1 time: 0.708054 Aug 31 16:43:42.439316 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3250/6515] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:43:41 2022] GET /compute/v2.1/servers/8a4079ad-b084-41c9-af05-7e1d9c1a6616 => generated 1546 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:43:42.728359 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6e1fb26d-1e60-4ac0-9398-425c358e1167 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:43:42.729439 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6e1fb26d-1e60-4ac0-9398-425c358e1167 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] [instance: 3d5cba2d-6992-4782-93bf-b4260130af90] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:43:42.743990 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6e1fb26d-1e60-4ac0-9398-425c358e1167 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:42.744772 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6e1fb26d-1e60-4ac0-9398-425c358e1167 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:42.748903 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6e1fb26d-1e60-4ac0-9398-425c358e1167 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:42.750030 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6e1fb26d-1e60-4ac0-9398-425c358e1167 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:42.750699 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6e1fb26d-1e60-4ac0-9398-425c358e1167 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:42.751453 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6e1fb26d-1e60-4ac0-9398-425c358e1167 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:42.889369 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-714227bf-185a-41a5-a70b-26f79659be68 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:43:42.889999 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-714227bf-185a-41a5-a70b-26f79659be68 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: a89947bc-0241-4e87-bbbf-2fed45fa4cb6] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:43:42.902669 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:43:42.935286 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-714227bf-185a-41a5-a70b-26f79659be68 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:42.935833 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-714227bf-185a-41a5-a70b-26f79659be68 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:42.936280 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-714227bf-185a-41a5-a70b-26f79659be68 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:42.941761 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-714227bf-185a-41a5-a70b-26f79659be68 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:42.947857 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-714227bf-185a-41a5-a70b-26f79659be68 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:42.948749 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-714227bf-185a-41a5-a70b-26f79659be68 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:43.026585 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=100 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:43:43.054338 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6e1fb26d-1e60-4ac0-9398-425c358e1167 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/3d5cba2d-6992-4782-93bf-b4260130af90" status: 200 len: 1422 microversion: 2.1 time: 0.330073 Aug 31 16:43:43.078355 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3266/6516] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:43:42 2022] GET /compute/v2.1/servers/3d5cba2d-6992-4782-93bf-b4260130af90 => generated 1422 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:43:43.492966 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-714227bf-185a-41a5-a70b-26f79659be68 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:43:43.510689 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-714227bf-185a-41a5-a70b-26f79659be68 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/a89947bc-0241-4e87-bbbf-2fed45fa4cb6" status: 200 len: 1168 microversion: 2.1 time: 0.628089 Aug 31 16:43:43.512558 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3251/6517] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:43:42 2022] GET /compute/v2.1/servers/a89947bc-0241-4e87-bbbf-2fed45fa4cb6 => generated 1168 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:43:44.082832 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-202b83c1-7fcf-4323-ad00-f52008039370 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:43:44.083658 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-202b83c1-7fcf-4323-ad00-f52008039370 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] [instance: 3d5cba2d-6992-4782-93bf-b4260130af90] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:43:44.098776 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-202b83c1-7fcf-4323-ad00-f52008039370 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:44.104266 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-202b83c1-7fcf-4323-ad00-f52008039370 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:44.105084 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-202b83c1-7fcf-4323-ad00-f52008039370 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:44.110531 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-202b83c1-7fcf-4323-ad00-f52008039370 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:44.111363 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-202b83c1-7fcf-4323-ad00-f52008039370 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:44.112018 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-202b83c1-7fcf-4323-ad00-f52008039370 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:44.569674 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9ff556cb-3f33-41b8-ad03-47db746d2043 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:43:44.588486 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9ff556cb-3f33-41b8-ad03-47db746d2043 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: a89947bc-0241-4e87-bbbf-2fed45fa4cb6] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:43:44.606806 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-202b83c1-7fcf-4323-ad00-f52008039370 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/3d5cba2d-6992-4782-93bf-b4260130af90" status: 200 len: 1464 microversion: 2.1 time: 0.527944 Aug 31 16:43:44.614610 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3267/6518] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:43:44 2022] GET /compute/v2.1/servers/3d5cba2d-6992-4782-93bf-b4260130af90 => generated 1464 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:43:44.616100 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9ff556cb-3f33-41b8-ad03-47db746d2043 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:44.619129 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9ff556cb-3f33-41b8-ad03-47db746d2043 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:44.621176 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9ff556cb-3f33-41b8-ad03-47db746d2043 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:44.623528 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9ff556cb-3f33-41b8-ad03-47db746d2043 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:44.624799 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9ff556cb-3f33-41b8-ad03-47db746d2043 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:44.625917 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9ff556cb-3f33-41b8-ad03-47db746d2043 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:45.637192 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-624d6818-81d6-4cd9-90e4-3c49e974ec85 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:43:45.639397 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-624d6818-81d6-4cd9-90e4-3c49e974ec85 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] [instance: 3d5cba2d-6992-4782-93bf-b4260130af90] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:43:45.664814 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-624d6818-81d6-4cd9-90e4-3c49e974ec85 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:45.666720 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-624d6818-81d6-4cd9-90e4-3c49e974ec85 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:45.667185 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-624d6818-81d6-4cd9-90e4-3c49e974ec85 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:45.670864 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-624d6818-81d6-4cd9-90e4-3c49e974ec85 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:45.671442 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-624d6818-81d6-4cd9-90e4-3c49e974ec85 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:45.681303 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-624d6818-81d6-4cd9-90e4-3c49e974ec85 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:45.980027 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-9ff556cb-3f33-41b8-ad03-47db746d2043 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:43:45.994946 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9ff556cb-3f33-41b8-ad03-47db746d2043 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/a89947bc-0241-4e87-bbbf-2fed45fa4cb6" status: 200 len: 1168 microversion: 2.1 time: 1.455500 Aug 31 16:43:46.004805 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3252/6519] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:43:44 2022] GET /compute/v2.1/servers/a89947bc-0241-4e87-bbbf-2fed45fa4cb6 => generated 1168 bytes in 1471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:43:46.186128 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-624d6818-81d6-4cd9-90e4-3c49e974ec85 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/3d5cba2d-6992-4782-93bf-b4260130af90" status: 200 len: 1464 microversion: 2.1 time: 0.554744 Aug 31 16:43:46.199896 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3268/6520] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:43:45 2022] GET /compute/v2.1/servers/3d5cba2d-6992-4782-93bf-b4260130af90 => generated 1464 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:43:46.883601 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-f5ad439a-aed4-40d3-b7d3-59fb8ce54fc6 req-b935af25-9701-43b5-8dc1-e56d77f9c34d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d5cba2d-6992-4782-93bf-b4260130af90", "tag": "1d66d4ea-685b-490b-9c9d-6342943a2cb0"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:43:46.920597 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-f5ad439a-aed4-40d3-b7d3-59fb8ce54fc6 req-b935af25-9701-43b5-8dc1-e56d77f9c34d service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:46.922853 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-f5ad439a-aed4-40d3-b7d3-59fb8ce54fc6 req-b935af25-9701-43b5-8dc1-e56d77f9c34d service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:46.923967 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-f5ad439a-aed4-40d3-b7d3-59fb8ce54fc6 req-b935af25-9701-43b5-8dc1-e56d77f9c34d service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:46.980690 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-f5ad439a-aed4-40d3-b7d3-59fb8ce54fc6 req-b935af25-9701-43b5-8dc1-e56d77f9c34d service nova] Creating event network-changed:1d66d4ea-685b-490b-9c9d-6342943a2cb0 for instance 3d5cba2d-6992-4782-93bf-b4260130af90 on n-h1-850499-9 Aug 31 16:43:46.993987 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-f5ad439a-aed4-40d3-b7d3-59fb8ce54fc6 req-b935af25-9701-43b5-8dc1-e56d77f9c34d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114465 Aug 31 16:43:47.005895 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3253/6521] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:43:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:43:47.029016 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ac3e2fa1-980d-4ffa-830a-e27aa5e6384a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:43:47.029638 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ac3e2fa1-980d-4ffa-830a-e27aa5e6384a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: a89947bc-0241-4e87-bbbf-2fed45fa4cb6] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:43:47.033717 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:43:47.040392 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ac3e2fa1-980d-4ffa-830a-e27aa5e6384a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:47.056400 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ac3e2fa1-980d-4ffa-830a-e27aa5e6384a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:47.057177 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ac3e2fa1-980d-4ffa-830a-e27aa5e6384a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:47.057952 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ac3e2fa1-980d-4ffa-830a-e27aa5e6384a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:47.058427 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ac3e2fa1-980d-4ffa-830a-e27aa5e6384a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:47.058867 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ac3e2fa1-980d-4ffa-830a-e27aa5e6384a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:47.223299 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b835d4f9-a0bf-476a-8e0d-fbb7add7b04f tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:43:47.224159 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b835d4f9-a0bf-476a-8e0d-fbb7add7b04f tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] [instance: 3d5cba2d-6992-4782-93bf-b4260130af90] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:43:47.236665 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b835d4f9-a0bf-476a-8e0d-fbb7add7b04f tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:47.239031 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b835d4f9-a0bf-476a-8e0d-fbb7add7b04f tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:47.241761 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b835d4f9-a0bf-476a-8e0d-fbb7add7b04f tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:47.243016 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b835d4f9-a0bf-476a-8e0d-fbb7add7b04f tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:47.245729 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b835d4f9-a0bf-476a-8e0d-fbb7add7b04f tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:47.246294 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b835d4f9-a0bf-476a-8e0d-fbb7add7b04f tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:47.254987 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=8 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:43:47.755814 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ac3e2fa1-980d-4ffa-830a-e27aa5e6384a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:43:47.769192 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ac3e2fa1-980d-4ffa-830a-e27aa5e6384a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/a89947bc-0241-4e87-bbbf-2fed45fa4cb6" status: 200 len: 1168 microversion: 2.1 time: 0.741445 Aug 31 16:43:47.770522 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3269/6522] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:43:47 2022] GET /compute/v2.1/servers/a89947bc-0241-4e87-bbbf-2fed45fa4cb6 => generated 1168 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:43:47.901752 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b835d4f9-a0bf-476a-8e0d-fbb7add7b04f tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/3d5cba2d-6992-4782-93bf-b4260130af90" status: 200 len: 1464 microversion: 2.1 time: 0.682855 Aug 31 16:43:47.911550 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3254/6523] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:43:47 2022] GET /compute/v2.1/servers/3d5cba2d-6992-4782-93bf-b4260130af90 => generated 1464 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:43:48.804843 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a5878481-26b1-4a4a-af1b-e52381a9aaa1 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:43:48.806855 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a5878481-26b1-4a4a-af1b-e52381a9aaa1 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: a89947bc-0241-4e87-bbbf-2fed45fa4cb6] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:43:48.832571 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a5878481-26b1-4a4a-af1b-e52381a9aaa1 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:48.833211 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a5878481-26b1-4a4a-af1b-e52381a9aaa1 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:48.833684 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a5878481-26b1-4a4a-af1b-e52381a9aaa1 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:48.834446 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a5878481-26b1-4a4a-af1b-e52381a9aaa1 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:48.834918 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a5878481-26b1-4a4a-af1b-e52381a9aaa1 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:48.835359 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a5878481-26b1-4a4a-af1b-e52381a9aaa1 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:48.926466 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a9127047-cc5e-46a1-bcca-d0679c592394 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:43:48.927782 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a9127047-cc5e-46a1-bcca-d0679c592394 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] [instance: 3d5cba2d-6992-4782-93bf-b4260130af90] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:43:48.938277 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:43:48.950604 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a9127047-cc5e-46a1-bcca-d0679c592394 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:48.954458 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a9127047-cc5e-46a1-bcca-d0679c592394 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:48.955317 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a9127047-cc5e-46a1-bcca-d0679c592394 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:48.956584 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a9127047-cc5e-46a1-bcca-d0679c592394 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:48.957249 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a9127047-cc5e-46a1-bcca-d0679c592394 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:48.957866 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a9127047-cc5e-46a1-bcca-d0679c592394 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:49.232145 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a9127047-cc5e-46a1-bcca-d0679c592394 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/3d5cba2d-6992-4782-93bf-b4260130af90" status: 200 len: 1464 microversion: 2.1 time: 0.309698 Aug 31 16:43:49.236466 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3255/6524] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:43:48 2022] GET /compute/v2.1/servers/3d5cba2d-6992-4782-93bf-b4260130af90 => generated 1464 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:43:49.258998 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-b38e03ac-8d06-43f9-8263-1cddaf6a0835 req-11787c62-e869-495c-828f-49234b562070 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a4079ad-b084-41c9-af05-7e1d9c1a6616", "tag": "d29323fd-2f20-4dbd-955c-b1c62b01a8e6"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:43:49.290724 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a5878481-26b1-4a4a-af1b-e52381a9aaa1 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:43:49.292567 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-b38e03ac-8d06-43f9-8263-1cddaf6a0835 req-11787c62-e869-495c-828f-49234b562070 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:49.293256 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-b38e03ac-8d06-43f9-8263-1cddaf6a0835 req-11787c62-e869-495c-828f-49234b562070 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:49.293879 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-b38e03ac-8d06-43f9-8263-1cddaf6a0835 req-11787c62-e869-495c-828f-49234b562070 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:49.299364 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a5878481-26b1-4a4a-af1b-e52381a9aaa1 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/a89947bc-0241-4e87-bbbf-2fed45fa4cb6" status: 200 len: 1168 microversion: 2.1 time: 0.499635 Aug 31 16:43:49.303391 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3270/6525] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:43:48 2022] GET /compute/v2.1/servers/a89947bc-0241-4e87-bbbf-2fed45fa4cb6 => generated 1168 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:43:49.324719 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-b38e03ac-8d06-43f9-8263-1cddaf6a0835 req-11787c62-e869-495c-828f-49234b562070 service nova] Creating event network-changed:d29323fd-2f20-4dbd-955c-b1c62b01a8e6 for instance 8a4079ad-b084-41c9-af05-7e1d9c1a6616 on n-h1-850499-9 Aug 31 16:43:49.336811 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-b38e03ac-8d06-43f9-8263-1cddaf6a0835 req-11787c62-e869-495c-828f-49234b562070 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097831 Aug 31 16:43:49.343052 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3256/6526] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:43:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:43:50.257116 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-18ab7cd1-6f76-438e-9d7d-68c04c7f7e5f tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:43:50.259337 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-18ab7cd1-6f76-438e-9d7d-68c04c7f7e5f tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] [instance: 3d5cba2d-6992-4782-93bf-b4260130af90] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:43:50.282059 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-18ab7cd1-6f76-438e-9d7d-68c04c7f7e5f tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:50.285228 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-18ab7cd1-6f76-438e-9d7d-68c04c7f7e5f tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:50.286983 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-18ab7cd1-6f76-438e-9d7d-68c04c7f7e5f tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:50.291405 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-18ab7cd1-6f76-438e-9d7d-68c04c7f7e5f tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:50.292208 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-18ab7cd1-6f76-438e-9d7d-68c04c7f7e5f tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:50.292982 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-18ab7cd1-6f76-438e-9d7d-68c04c7f7e5f tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:50.326248 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1fb40494-a0d7-4629-9ee3-3788e7e410b8 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:43:50.326994 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1fb40494-a0d7-4629-9ee3-3788e7e410b8 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: a89947bc-0241-4e87-bbbf-2fed45fa4cb6] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:43:50.344284 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1fb40494-a0d7-4629-9ee3-3788e7e410b8 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:50.344619 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1fb40494-a0d7-4629-9ee3-3788e7e410b8 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:50.367661 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1fb40494-a0d7-4629-9ee3-3788e7e410b8 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:50.369198 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1fb40494-a0d7-4629-9ee3-3788e7e410b8 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:50.369701 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1fb40494-a0d7-4629-9ee3-3788e7e410b8 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:50.372016 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1fb40494-a0d7-4629-9ee3-3788e7e410b8 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:50.986994 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-18ab7cd1-6f76-438e-9d7d-68c04c7f7e5f tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/3d5cba2d-6992-4782-93bf-b4260130af90" status: 200 len: 1464 microversion: 2.1 time: 0.734038 Aug 31 16:43:50.996762 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3271/6527] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:43:50 2022] GET /compute/v2.1/servers/3d5cba2d-6992-4782-93bf-b4260130af90 => generated 1464 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:43:52.012462 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-41731514-4e8d-4b9e-b037-0164fd19eb14 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:43:52.014025 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-41731514-4e8d-4b9e-b037-0164fd19eb14 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] [instance: 3d5cba2d-6992-4782-93bf-b4260130af90] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:43:52.049279 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-41731514-4e8d-4b9e-b037-0164fd19eb14 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:52.051108 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-41731514-4e8d-4b9e-b037-0164fd19eb14 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:52.052112 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-41731514-4e8d-4b9e-b037-0164fd19eb14 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:52.056665 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-41731514-4e8d-4b9e-b037-0164fd19eb14 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:52.057681 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-41731514-4e8d-4b9e-b037-0164fd19eb14 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:52.058784 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-41731514-4e8d-4b9e-b037-0164fd19eb14 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:52.094095 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1fb40494-a0d7-4629-9ee3-3788e7e410b8 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:43:52.106220 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1fb40494-a0d7-4629-9ee3-3788e7e410b8 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/a89947bc-0241-4e87-bbbf-2fed45fa4cb6" status: 200 len: 1168 microversion: 2.1 time: 1.786613 Aug 31 16:43:52.108161 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3257/6528] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:43:50 2022] GET /compute/v2.1/servers/a89947bc-0241-4e87-bbbf-2fed45fa4cb6 => generated 1168 bytes in 1789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:43:52.525821 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-41731514-4e8d-4b9e-b037-0164fd19eb14 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/3d5cba2d-6992-4782-93bf-b4260130af90" status: 200 len: 1464 microversion: 2.1 time: 0.517767 Aug 31 16:43:52.538802 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3272/6529] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:43:52 2022] GET /compute/v2.1/servers/3d5cba2d-6992-4782-93bf-b4260130af90 => generated 1464 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:43:53.140719 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f620c3a9-eb28-43c2-9b79-c3c1b06b1f01 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:43:53.141340 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f620c3a9-eb28-43c2-9b79-c3c1b06b1f01 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: a89947bc-0241-4e87-bbbf-2fed45fa4cb6] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:43:53.154063 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f620c3a9-eb28-43c2-9b79-c3c1b06b1f01 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:53.154818 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f620c3a9-eb28-43c2-9b79-c3c1b06b1f01 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:53.155422 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f620c3a9-eb28-43c2-9b79-c3c1b06b1f01 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:53.156355 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f620c3a9-eb28-43c2-9b79-c3c1b06b1f01 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:53.157250 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f620c3a9-eb28-43c2-9b79-c3c1b06b1f01 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:53.157885 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f620c3a9-eb28-43c2-9b79-c3c1b06b1f01 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:53.546867 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-85654bb6-f935-4c9f-b9a8-f3aa79f923af tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:43:53.548674 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-85654bb6-f935-4c9f-b9a8-f3aa79f923af tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] [instance: 3d5cba2d-6992-4782-93bf-b4260130af90] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:43:53.558153 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-85654bb6-f935-4c9f-b9a8-f3aa79f923af tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:53.558912 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-85654bb6-f935-4c9f-b9a8-f3aa79f923af tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:53.559566 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-85654bb6-f935-4c9f-b9a8-f3aa79f923af tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:53.560466 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-85654bb6-f935-4c9f-b9a8-f3aa79f923af tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:53.561095 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-85654bb6-f935-4c9f-b9a8-f3aa79f923af tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:53.561687 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-85654bb6-f935-4c9f-b9a8-f3aa79f923af tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:53.780467 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f620c3a9-eb28-43c2-9b79-c3c1b06b1f01 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:43:53.790673 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f620c3a9-eb28-43c2-9b79-c3c1b06b1f01 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/a89947bc-0241-4e87-bbbf-2fed45fa4cb6" status: 200 len: 1168 microversion: 2.1 time: 0.655135 Aug 31 16:43:53.791974 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3258/6530] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:43:53 2022] GET /compute/v2.1/servers/a89947bc-0241-4e87-bbbf-2fed45fa4cb6 => generated 1168 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:43:53.869585 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-85654bb6-f935-4c9f-b9a8-f3aa79f923af tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/3d5cba2d-6992-4782-93bf-b4260130af90" status: 200 len: 1464 microversion: 2.1 time: 0.326880 Aug 31 16:43:53.870959 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3273/6531] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:43:53 2022] GET /compute/v2.1/servers/3d5cba2d-6992-4782-93bf-b4260130af90 => generated 1464 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:43:54.142119 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-3df8b747-4779-4288-8c63-cf062ab56d50 req-594d4f43-1ecf-461a-b178-bca7c4dd44b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d5cba2d-6992-4782-93bf-b4260130af90", "name": "network-vif-plugged", "status": "completed", "tag": "1d66d4ea-685b-490b-9c9d-6342943a2cb0"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:43:54.164248 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-3df8b747-4779-4288-8c63-cf062ab56d50 req-594d4f43-1ecf-461a-b178-bca7c4dd44b5 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:54.164967 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-3df8b747-4779-4288-8c63-cf062ab56d50 req-594d4f43-1ecf-461a-b178-bca7c4dd44b5 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:54.165348 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-3df8b747-4779-4288-8c63-cf062ab56d50 req-594d4f43-1ecf-461a-b178-bca7c4dd44b5 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:54.197110 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-3df8b747-4779-4288-8c63-cf062ab56d50 req-594d4f43-1ecf-461a-b178-bca7c4dd44b5 service nova] Creating event network-vif-plugged:1d66d4ea-685b-490b-9c9d-6342943a2cb0 for instance 3d5cba2d-6992-4782-93bf-b4260130af90 on n-h1-850499-9 Aug 31 16:43:54.207772 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-3df8b747-4779-4288-8c63-cf062ab56d50 req-594d4f43-1ecf-461a-b178-bca7c4dd44b5 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069070 Aug 31 16:43:54.209589 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3259/6532] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:43:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:43:54.814409 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-365b2925-a17e-4f5f-8112-a7fb977468b8 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:43:54.815034 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-365b2925-a17e-4f5f-8112-a7fb977468b8 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: a89947bc-0241-4e87-bbbf-2fed45fa4cb6] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:43:54.823913 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-365b2925-a17e-4f5f-8112-a7fb977468b8 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:54.824416 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-365b2925-a17e-4f5f-8112-a7fb977468b8 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:54.824862 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-365b2925-a17e-4f5f-8112-a7fb977468b8 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:54.825587 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-365b2925-a17e-4f5f-8112-a7fb977468b8 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:54.832537 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-365b2925-a17e-4f5f-8112-a7fb977468b8 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:54.834657 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-365b2925-a17e-4f5f-8112-a7fb977468b8 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:54.893574 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-321c2f70-5da0-4a7d-9ce9-092dc4468cca tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:43:54.894623 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-321c2f70-5da0-4a7d-9ce9-092dc4468cca tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] [instance: 3d5cba2d-6992-4782-93bf-b4260130af90] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:43:54.902123 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=55 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:43:54.907659 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-321c2f70-5da0-4a7d-9ce9-092dc4468cca tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:54.908490 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-321c2f70-5da0-4a7d-9ce9-092dc4468cca tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:54.909171 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-321c2f70-5da0-4a7d-9ce9-092dc4468cca tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:54.910131 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-321c2f70-5da0-4a7d-9ce9-092dc4468cca tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:54.910814 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-321c2f70-5da0-4a7d-9ce9-092dc4468cca tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:54.911452 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-321c2f70-5da0-4a7d-9ce9-092dc4468cca tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:55.208946 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-365b2925-a17e-4f5f-8112-a7fb977468b8 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:43:55.209545 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-321c2f70-5da0-4a7d-9ce9-092dc4468cca tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/3d5cba2d-6992-4782-93bf-b4260130af90" status: 200 len: 1464 microversion: 2.1 time: 0.320107 Aug 31 16:43:55.224499 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3260/6533] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:43:54 2022] GET /compute/v2.1/servers/3d5cba2d-6992-4782-93bf-b4260130af90 => generated 1464 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:43:55.241721 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-365b2925-a17e-4f5f-8112-a7fb977468b8 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/a89947bc-0241-4e87-bbbf-2fed45fa4cb6" status: 200 len: 1168 microversion: 2.1 time: 0.431051 Aug 31 16:43:55.245709 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3274/6534] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:43:54 2022] GET /compute/v2.1/servers/a89947bc-0241-4e87-bbbf-2fed45fa4cb6 => generated 1168 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:43:56.233713 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1cf8fb3c-4787-47ac-9426-bb2734e74e0d tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:43:56.234601 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1cf8fb3c-4787-47ac-9426-bb2734e74e0d tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] [instance: 3d5cba2d-6992-4782-93bf-b4260130af90] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:43:56.256226 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1cf8fb3c-4787-47ac-9426-bb2734e74e0d tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:56.256613 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1cf8fb3c-4787-47ac-9426-bb2734e74e0d tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:56.257034 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1cf8fb3c-4787-47ac-9426-bb2734e74e0d tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:56.258446 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1cf8fb3c-4787-47ac-9426-bb2734e74e0d tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:56.258755 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1cf8fb3c-4787-47ac-9426-bb2734e74e0d tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:56.259622 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1cf8fb3c-4787-47ac-9426-bb2734e74e0d tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:56.265022 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-fa3d8803-cb02-49d7-a647-715fb9cfc395 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:43:56.266350 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-fa3d8803-cb02-49d7-a647-715fb9cfc395 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: a89947bc-0241-4e87-bbbf-2fed45fa4cb6] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:43:56.277112 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fa3d8803-cb02-49d7-a647-715fb9cfc395 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:56.279844 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fa3d8803-cb02-49d7-a647-715fb9cfc395 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:56.280857 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fa3d8803-cb02-49d7-a647-715fb9cfc395 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:56.282483 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fa3d8803-cb02-49d7-a647-715fb9cfc395 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:56.283924 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fa3d8803-cb02-49d7-a647-715fb9cfc395 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:56.284637 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fa3d8803-cb02-49d7-a647-715fb9cfc395 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:56.579717 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-fa3d8803-cb02-49d7-a647-715fb9cfc395 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:43:56.583343 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=99 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:43:56.591544 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-fa3d8803-cb02-49d7-a647-715fb9cfc395 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/a89947bc-0241-4e87-bbbf-2fed45fa4cb6" status: 200 len: 1202 microversion: 2.1 time: 0.330842 Aug 31 16:43:56.593726 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3275/6535] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:43:56 2022] GET /compute/v2.1/servers/a89947bc-0241-4e87-bbbf-2fed45fa4cb6 => generated 1202 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:43:56.600240 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1cf8fb3c-4787-47ac-9426-bb2734e74e0d tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/3d5cba2d-6992-4782-93bf-b4260130af90" status: 200 len: 1650 microversion: 2.1 time: 0.370239 Aug 31 16:43:56.614227 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3261/6536] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:43:56 2022] GET /compute/v2.1/servers/3d5cba2d-6992-4782-93bf-b4260130af90 => generated 1650 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:43:56.635136 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7083da80-6940-47de-b6a8-7bd6aa0607d0 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:43:56.636810 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7083da80-6940-47de-b6a8-7bd6aa0607d0 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] [instance: 3d5cba2d-6992-4782-93bf-b4260130af90] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:43:56.647985 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7083da80-6940-47de-b6a8-7bd6aa0607d0 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:56.649284 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7083da80-6940-47de-b6a8-7bd6aa0607d0 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:56.650393 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7083da80-6940-47de-b6a8-7bd6aa0607d0 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:56.652050 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7083da80-6940-47de-b6a8-7bd6aa0607d0 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:56.653206 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7083da80-6940-47de-b6a8-7bd6aa0607d0 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:56.654337 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7083da80-6940-47de-b6a8-7bd6aa0607d0 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:56.905670 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7083da80-6940-47de-b6a8-7bd6aa0607d0 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/3d5cba2d-6992-4782-93bf-b4260130af90" status: 200 len: 1650 microversion: 2.1 time: 0.278445 Aug 31 16:43:56.906733 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3276/6537] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:43:56 2022] GET /compute/v2.1/servers/3d5cba2d-6992-4782-93bf-b4260130af90 => generated 1650 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:43:56.989242 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-195d33b8-cebd-48a7-a3a0-0461894251eb tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:43:56.992373 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-195d33b8-cebd-48a7-a3a0-0461894251eb tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] [instance: 3d5cba2d-6992-4782-93bf-b4260130af90] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:43:57.021432 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-195d33b8-cebd-48a7-a3a0-0461894251eb tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:57.028153 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-195d33b8-cebd-48a7-a3a0-0461894251eb tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:57.029140 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-195d33b8-cebd-48a7-a3a0-0461894251eb tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:57.031058 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-195d33b8-cebd-48a7-a3a0-0461894251eb tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:57.031881 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-195d33b8-cebd-48a7-a3a0-0461894251eb tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:57.032775 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-195d33b8-cebd-48a7-a3a0-0461894251eb tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:57.210284 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-195d33b8-cebd-48a7-a3a0-0461894251eb tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/3d5cba2d-6992-4782-93bf-b4260130af90" status: 200 len: 1650 microversion: 2.1 time: 0.277412 Aug 31 16:43:57.213033 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3262/6538] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:43:56 2022] GET /compute/v2.1/servers/3d5cba2d-6992-4782-93bf-b4260130af90 => generated 1650 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:43:57.389658 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0fa73516-3400-4ed5-8904-e28f97942039 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-456762394", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "availability_zone": "nova:n-h2-850499-9", "networks": [{"uuid": "80b1285c-7017-4385-a8a0-2309709dcd5b"}]}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:43:57.456542 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-0fa73516-3400-4ed5-8904-e28f97942039 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] validate_networks() for [('80b1285c-7017-4385-a8a0-2309709dcd5b', None, None, None, None, None)] {{(pid=122257) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:43:57.616272 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-db071abc-c16b-4a26-9a28-40a9c770fd3e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:43:57.617050 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-db071abc-c16b-4a26-9a28-40a9c770fd3e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: a89947bc-0241-4e87-bbbf-2fed45fa4cb6] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:43:57.624655 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-db071abc-c16b-4a26-9a28-40a9c770fd3e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:57.625167 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-db071abc-c16b-4a26-9a28-40a9c770fd3e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:57.625615 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-db071abc-c16b-4a26-9a28-40a9c770fd3e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:57.626536 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-db071abc-c16b-4a26-9a28-40a9c770fd3e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:57.627009 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-db071abc-c16b-4a26-9a28-40a9c770fd3e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:57.627445 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-db071abc-c16b-4a26-9a28-40a9c770fd3e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:57.873455 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-db071abc-c16b-4a26-9a28-40a9c770fd3e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:43:57.884694 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-db071abc-c16b-4a26-9a28-40a9c770fd3e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/a89947bc-0241-4e87-bbbf-2fed45fa4cb6" status: 200 len: 1202 microversion: 2.1 time: 0.273048 Aug 31 16:43:57.886004 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3263/6539] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:43:57 2022] GET /compute/v2.1/servers/a89947bc-0241-4e87-bbbf-2fed45fa4cb6 => generated 1202 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:43:57.995768 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-0fa73516-3400-4ed5-8904-e28f97942039 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:43:57.996548 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-0fa73516-3400-4ed5-8904-e28f97942039 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:43:57.997203 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-0fa73516-3400-4ed5-8904-e28f97942039 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:43:57.997820 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-0fa73516-3400-4ed5-8904-e28f97942039 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:43:57.998772 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-0fa73516-3400-4ed5-8904-e28f97942039 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:43:58.009454 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0fa73516-3400-4ed5-8904-e28f97942039 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:58.010230 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0fa73516-3400-4ed5-8904-e28f97942039 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:58.010860 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0fa73516-3400-4ed5-8904-e28f97942039 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:58.011919 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0fa73516-3400-4ed5-8904-e28f97942039 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:58.012554 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0fa73516-3400-4ed5-8904-e28f97942039 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:58.013509 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0fa73516-3400-4ed5-8904-e28f97942039 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:58.035371 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-0fa73516-3400-4ed5-8904-e28f97942039 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Getting quotas for project 85be82e1abc6450fa1fc362528fb2762. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:43:58.042455 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-0fa73516-3400-4ed5-8904-e28f97942039 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Getting quotas for user ae0a30726eac45fca5856ae95f24e501 and project 85be82e1abc6450fa1fc362528fb2762. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:43:58.056263 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0fa73516-3400-4ed5-8904-e28f97942039 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Going to run 1 instances... {{(pid=122257) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:43:58.065034 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0fa73516-3400-4ed5-8904-e28f97942039 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] [instance: d15ee718-42e5-41db-afa6-ad596e32c483] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:43:58.112199 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0fa73516-3400-4ed5-8904-e28f97942039 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.726362 Aug 31 16:43:58.123630 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3277/6540] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:43:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 735 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:43:58.125729 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-72602050-c47b-4b7f-8daf-7d7bfd90fa55 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:43:58.126528 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-72602050-c47b-4b7f-8daf-7d7bfd90fa55 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] [instance: d15ee718-42e5-41db-afa6-ad596e32c483] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:43:58.203733 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-72602050-c47b-4b7f-8daf-7d7bfd90fa55 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/d15ee718-42e5-41db-afa6-ad596e32c483" status: 200 len: 1328 microversion: 2.1 time: 0.081863 Aug 31 16:43:58.224866 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3264/6541] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:43:58 2022] GET /compute/v2.1/servers/d15ee718-42e5-41db-afa6-ad596e32c483 => generated 1328 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:43:58.909512 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-152ed1e9-687f-47b9-b41d-64cef8347b5b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:43:58.911725 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-152ed1e9-687f-47b9-b41d-64cef8347b5b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: a89947bc-0241-4e87-bbbf-2fed45fa4cb6] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:43:58.926076 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-152ed1e9-687f-47b9-b41d-64cef8347b5b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:58.926930 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-152ed1e9-687f-47b9-b41d-64cef8347b5b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:58.931248 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-152ed1e9-687f-47b9-b41d-64cef8347b5b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:58.931248 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-152ed1e9-687f-47b9-b41d-64cef8347b5b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:58.957330 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-152ed1e9-687f-47b9-b41d-64cef8347b5b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:58.959986 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-152ed1e9-687f-47b9-b41d-64cef8347b5b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:59.192741 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-152ed1e9-687f-47b9-b41d-64cef8347b5b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:43:59.208460 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-152ed1e9-687f-47b9-b41d-64cef8347b5b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/a89947bc-0241-4e87-bbbf-2fed45fa4cb6" status: 200 len: 1202 microversion: 2.1 time: 0.305150 Aug 31 16:43:59.209385 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3278/6542] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:43:58 2022] GET /compute/v2.1/servers/a89947bc-0241-4e87-bbbf-2fed45fa4cb6 => generated 1202 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:43:59.236551 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e8c409f0-77cd-43ba-b994-7cddb596296e tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:43:59.237196 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e8c409f0-77cd-43ba-b994-7cddb596296e tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] [instance: d15ee718-42e5-41db-afa6-ad596e32c483] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:43:59.245592 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e8c409f0-77cd-43ba-b994-7cddb596296e tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:59.246415 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e8c409f0-77cd-43ba-b994-7cddb596296e tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:59.247398 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e8c409f0-77cd-43ba-b994-7cddb596296e tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:59.248177 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e8c409f0-77cd-43ba-b994-7cddb596296e tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:59.248618 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e8c409f0-77cd-43ba-b994-7cddb596296e tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:59.249045 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e8c409f0-77cd-43ba-b994-7cddb596296e tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:59.354169 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e8c409f0-77cd-43ba-b994-7cddb596296e tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/d15ee718-42e5-41db-afa6-ad596e32c483" status: 200 len: 1415 microversion: 2.1 time: 0.123898 Aug 31 16:43:59.357883 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3265/6543] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:43:59 2022] GET /compute/v2.1/servers/d15ee718-42e5-41db-afa6-ad596e32c483 => generated 1415 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:44:00.234546 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-11a39bc2-4cb6-4513-9ed1-bdb26da8af6d tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:00.235891 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-11a39bc2-4cb6-4513-9ed1-bdb26da8af6d tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: a89947bc-0241-4e87-bbbf-2fed45fa4cb6] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:00.252490 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-11a39bc2-4cb6-4513-9ed1-bdb26da8af6d tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:00.255615 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-11a39bc2-4cb6-4513-9ed1-bdb26da8af6d tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:00.257663 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-11a39bc2-4cb6-4513-9ed1-bdb26da8af6d tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:00.261385 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-11a39bc2-4cb6-4513-9ed1-bdb26da8af6d tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:00.263612 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-11a39bc2-4cb6-4513-9ed1-bdb26da8af6d tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:00.266278 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-11a39bc2-4cb6-4513-9ed1-bdb26da8af6d tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:00.386746 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6d63577c-1354-45c3-8b8a-c5e358e3cc6f tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:00.388213 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6d63577c-1354-45c3-8b8a-c5e358e3cc6f tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] [instance: d15ee718-42e5-41db-afa6-ad596e32c483] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:00.403336 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6d63577c-1354-45c3-8b8a-c5e358e3cc6f tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:00.404039 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6d63577c-1354-45c3-8b8a-c5e358e3cc6f tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:00.404494 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6d63577c-1354-45c3-8b8a-c5e358e3cc6f tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:00.405243 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6d63577c-1354-45c3-8b8a-c5e358e3cc6f tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:00.405720 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6d63577c-1354-45c3-8b8a-c5e358e3cc6f tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:00.406159 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6d63577c-1354-45c3-8b8a-c5e358e3cc6f tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:00.749450 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6d63577c-1354-45c3-8b8a-c5e358e3cc6f tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/d15ee718-42e5-41db-afa6-ad596e32c483" status: 200 len: 1463 microversion: 2.1 time: 0.370975 Aug 31 16:44:00.750064 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3266/6544] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:00 2022] GET /compute/v2.1/servers/d15ee718-42e5-41db-afa6-ad596e32c483 => generated 1463 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:44:00.783744 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-11a39bc2-4cb6-4513-9ed1-bdb26da8af6d tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:44:00.810022 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-11a39bc2-4cb6-4513-9ed1-bdb26da8af6d tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/a89947bc-0241-4e87-bbbf-2fed45fa4cb6" status: 200 len: 1202 microversion: 2.1 time: 0.579900 Aug 31 16:44:00.824791 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3279/6545] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:00 2022] GET /compute/v2.1/servers/a89947bc-0241-4e87-bbbf-2fed45fa4cb6 => generated 1202 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:44:01.506904 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-7a58fb8e-bbf1-46d7-a22d-06c335410720 req-66b458cc-42d3-434c-83da-18465d40899e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d15ee718-42e5-41db-afa6-ad596e32c483", "tag": "100797af-51b0-49c2-b6fa-ce591a3ffc43"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:44:01.522343 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-7a58fb8e-bbf1-46d7-a22d-06c335410720 req-66b458cc-42d3-434c-83da-18465d40899e service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:01.523160 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-7a58fb8e-bbf1-46d7-a22d-06c335410720 req-66b458cc-42d3-434c-83da-18465d40899e service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:01.524555 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-7a58fb8e-bbf1-46d7-a22d-06c335410720 req-66b458cc-42d3-434c-83da-18465d40899e service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:01.561658 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-7a58fb8e-bbf1-46d7-a22d-06c335410720 req-66b458cc-42d3-434c-83da-18465d40899e service nova] Creating event network-changed:100797af-51b0-49c2-b6fa-ce591a3ffc43 for instance d15ee718-42e5-41db-afa6-ad596e32c483 on n-h2-850499-9 Aug 31 16:44:01.580242 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-7a58fb8e-bbf1-46d7-a22d-06c335410720 req-66b458cc-42d3-434c-83da-18465d40899e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083370 Aug 31 16:44:01.581606 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3267/6546] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:44:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:44:01.783528 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ce0ed15c-41a1-4ae6-954b-39960a319671 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:01.784300 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ce0ed15c-41a1-4ae6-954b-39960a319671 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] [instance: d15ee718-42e5-41db-afa6-ad596e32c483] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:01.790283 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=6 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:44:01.795330 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ce0ed15c-41a1-4ae6-954b-39960a319671 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:01.796182 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ce0ed15c-41a1-4ae6-954b-39960a319671 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:01.796827 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ce0ed15c-41a1-4ae6-954b-39960a319671 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:01.797745 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ce0ed15c-41a1-4ae6-954b-39960a319671 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:01.798219 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ce0ed15c-41a1-4ae6-954b-39960a319671 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:01.798663 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ce0ed15c-41a1-4ae6-954b-39960a319671 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:01.834227 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3e3dc387-5c1a-4c7e-813b-7ec513595721 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:01.834938 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3e3dc387-5c1a-4c7e-813b-7ec513595721 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: a89947bc-0241-4e87-bbbf-2fed45fa4cb6] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:01.842842 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3e3dc387-5c1a-4c7e-813b-7ec513595721 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:01.843346 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3e3dc387-5c1a-4c7e-813b-7ec513595721 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:01.843820 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3e3dc387-5c1a-4c7e-813b-7ec513595721 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:01.844537 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3e3dc387-5c1a-4c7e-813b-7ec513595721 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:01.845000 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3e3dc387-5c1a-4c7e-813b-7ec513595721 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:01.845433 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3e3dc387-5c1a-4c7e-813b-7ec513595721 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:02.151827 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3e3dc387-5c1a-4c7e-813b-7ec513595721 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:44:02.166884 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ce0ed15c-41a1-4ae6-954b-39960a319671 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/d15ee718-42e5-41db-afa6-ad596e32c483" status: 200 len: 1463 microversion: 2.1 time: 0.388041 Aug 31 16:44:02.168901 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3280/6547] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:01 2022] GET /compute/v2.1/servers/d15ee718-42e5-41db-afa6-ad596e32c483 => generated 1463 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:44:02.169332 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3e3dc387-5c1a-4c7e-813b-7ec513595721 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/a89947bc-0241-4e87-bbbf-2fed45fa4cb6" status: 200 len: 1202 microversion: 2.1 time: 0.339220 Aug 31 16:44:02.169936 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3268/6548] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:01 2022] GET /compute/v2.1/servers/a89947bc-0241-4e87-bbbf-2fed45fa4cb6 => generated 1202 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:44:02.783313 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-768861fd-8cef-4452-9960-4f1a423aba06 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "804b210a-20c3-4ff5-b1a8-cac5d8c62982", "device": "/dev/sdb"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:44:02.785929 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-768861fd-8cef-4452-9960-4f1a423aba06 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] [instance: 19ff8623-9d5a-4ed4-97a3-b2a581ebc311] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:02.793138 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-768861fd-8cef-4452-9960-4f1a423aba06 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:02.793641 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-768861fd-8cef-4452-9960-4f1a423aba06 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:02.794130 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-768861fd-8cef-4452-9960-4f1a423aba06 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:02.794797 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-768861fd-8cef-4452-9960-4f1a423aba06 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:02.795265 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-768861fd-8cef-4452-9960-4f1a423aba06 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:02.795721 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-768861fd-8cef-4452-9960-4f1a423aba06 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:03.191426 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7a7031c5-d64e-43eb-8ff3-5a123441511e tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:03.192637 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7a7031c5-d64e-43eb-8ff3-5a123441511e tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] [instance: d15ee718-42e5-41db-afa6-ad596e32c483] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:03.210188 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7a7031c5-d64e-43eb-8ff3-5a123441511e tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:03.210958 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7a7031c5-d64e-43eb-8ff3-5a123441511e tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:03.212625 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7a7031c5-d64e-43eb-8ff3-5a123441511e tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:03.213812 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7a7031c5-d64e-43eb-8ff3-5a123441511e tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:03.214705 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7a7031c5-d64e-43eb-8ff3-5a123441511e tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:03.215661 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7a7031c5-d64e-43eb-8ff3-5a123441511e tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:03.374762 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7a7031c5-d64e-43eb-8ff3-5a123441511e tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/d15ee718-42e5-41db-afa6-ad596e32c483" status: 200 len: 1463 microversion: 2.1 time: 0.187470 Aug 31 16:44:03.375378 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3269/6549] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:03 2022] GET /compute/v2.1/servers/d15ee718-42e5-41db-afa6-ad596e32c483 => generated 1463 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:44:03.400939 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3d9b8e36-3a00-4fc4-bbd5-d0b59091dbbf tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:03.403684 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3d9b8e36-3a00-4fc4-bbd5-d0b59091dbbf tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: a89947bc-0241-4e87-bbbf-2fed45fa4cb6] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:03.415133 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3d9b8e36-3a00-4fc4-bbd5-d0b59091dbbf tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:03.416192 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3d9b8e36-3a00-4fc4-bbd5-d0b59091dbbf tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:03.416923 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3d9b8e36-3a00-4fc4-bbd5-d0b59091dbbf tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:03.418039 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3d9b8e36-3a00-4fc4-bbd5-d0b59091dbbf tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:03.418639 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3d9b8e36-3a00-4fc4-bbd5-d0b59091dbbf tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:03.419231 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3d9b8e36-3a00-4fc4-bbd5-d0b59091dbbf tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:03.572824 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3d9b8e36-3a00-4fc4-bbd5-d0b59091dbbf tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:44:03.581309 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3d9b8e36-3a00-4fc4-bbd5-d0b59091dbbf tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/a89947bc-0241-4e87-bbbf-2fed45fa4cb6" status: 200 len: 1202 microversion: 2.1 time: 0.204838 Aug 31 16:44:03.581914 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3270/6550] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:03 2022] GET /compute/v2.1/servers/a89947bc-0241-4e87-bbbf-2fed45fa4cb6 => generated 1202 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:44:04.401192 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-49bdba9a-63bd-4405-a1b5-b815d4fbe9b5 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:04.401914 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-49bdba9a-63bd-4405-a1b5-b815d4fbe9b5 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] [instance: d15ee718-42e5-41db-afa6-ad596e32c483] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:04.409446 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-49bdba9a-63bd-4405-a1b5-b815d4fbe9b5 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:04.410275 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-49bdba9a-63bd-4405-a1b5-b815d4fbe9b5 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:04.410803 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-49bdba9a-63bd-4405-a1b5-b815d4fbe9b5 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:04.411716 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-49bdba9a-63bd-4405-a1b5-b815d4fbe9b5 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:04.412250 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-49bdba9a-63bd-4405-a1b5-b815d4fbe9b5 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:04.412765 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-49bdba9a-63bd-4405-a1b5-b815d4fbe9b5 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:04.568720 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=100 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:44:04.575728 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-49bdba9a-63bd-4405-a1b5-b815d4fbe9b5 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/d15ee718-42e5-41db-afa6-ad596e32c483" status: 200 len: 1463 microversion: 2.1 time: 0.178570 Aug 31 16:44:04.576325 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3271/6551] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:04 2022] GET /compute/v2.1/servers/d15ee718-42e5-41db-afa6-ad596e32c483 => generated 1463 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:44:04.612283 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-953258a5-1e93-4b09-ab87-3310c8a2b56b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:04.613420 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-953258a5-1e93-4b09-ab87-3310c8a2b56b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: a89947bc-0241-4e87-bbbf-2fed45fa4cb6] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:04.620183 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-953258a5-1e93-4b09-ab87-3310c8a2b56b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:04.620678 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-953258a5-1e93-4b09-ab87-3310c8a2b56b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:04.621121 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-953258a5-1e93-4b09-ab87-3310c8a2b56b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:04.621834 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-953258a5-1e93-4b09-ab87-3310c8a2b56b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:04.622299 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-953258a5-1e93-4b09-ab87-3310c8a2b56b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:04.622729 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-953258a5-1e93-4b09-ab87-3310c8a2b56b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:04.789661 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-953258a5-1e93-4b09-ab87-3310c8a2b56b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:44:04.798560 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-953258a5-1e93-4b09-ab87-3310c8a2b56b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/a89947bc-0241-4e87-bbbf-2fed45fa4cb6" status: 200 len: 1202 microversion: 2.1 time: 0.190521 Aug 31 16:44:04.799428 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3272/6552] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:04 2022] GET /compute/v2.1/servers/a89947bc-0241-4e87-bbbf-2fed45fa4cb6 => generated 1202 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:44:05.599632 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e0d80731-2674-4f48-bcdd-1fa77a2b98d9 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:05.600334 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e0d80731-2674-4f48-bcdd-1fa77a2b98d9 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] [instance: d15ee718-42e5-41db-afa6-ad596e32c483] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:05.610076 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e0d80731-2674-4f48-bcdd-1fa77a2b98d9 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:05.610665 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e0d80731-2674-4f48-bcdd-1fa77a2b98d9 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:05.611283 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e0d80731-2674-4f48-bcdd-1fa77a2b98d9 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:05.612358 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e0d80731-2674-4f48-bcdd-1fa77a2b98d9 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:05.613795 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e0d80731-2674-4f48-bcdd-1fa77a2b98d9 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:05.614381 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e0d80731-2674-4f48-bcdd-1fa77a2b98d9 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:06.110598 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e0d80731-2674-4f48-bcdd-1fa77a2b98d9 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/d15ee718-42e5-41db-afa6-ad596e32c483" status: 200 len: 1463 microversion: 2.1 time: 0.514685 Aug 31 16:44:06.111406 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3273/6553] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:05 2022] GET /compute/v2.1/servers/d15ee718-42e5-41db-afa6-ad596e32c483 => generated 1463 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:44:06.123343 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-daea57ff-59bd-480b-8526-12c3ef1301bb tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:06.128472 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-daea57ff-59bd-480b-8526-12c3ef1301bb tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: a89947bc-0241-4e87-bbbf-2fed45fa4cb6] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:06.137824 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-daea57ff-59bd-480b-8526-12c3ef1301bb tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:06.139104 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-daea57ff-59bd-480b-8526-12c3ef1301bb tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:06.140028 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-daea57ff-59bd-480b-8526-12c3ef1301bb tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:06.141302 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-daea57ff-59bd-480b-8526-12c3ef1301bb tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:06.142108 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-daea57ff-59bd-480b-8526-12c3ef1301bb tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:06.143217 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-daea57ff-59bd-480b-8526-12c3ef1301bb tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:06.162301 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-768861fd-8cef-4452-9960-4f1a423aba06 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] 10.222.0.61 "POST /compute/v2.1/servers/19ff8623-9d5a-4ed4-97a3-b2a581ebc311/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.382503 Aug 31 16:44:06.168025 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3281/6554] 10.222.0.61 () {60 vars in 1323 bytes} [Wed Aug 31 16:44:02 2022] POST /compute/v2.1/servers/19ff8623-9d5a-4ed4-97a3-b2a581ebc311/os-volume_attachments => generated 194 bytes in 3389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:44:06.469778 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-daea57ff-59bd-480b-8526-12c3ef1301bb tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:44:06.483083 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-daea57ff-59bd-480b-8526-12c3ef1301bb tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/a89947bc-0241-4e87-bbbf-2fed45fa4cb6" status: 200 len: 1202 microversion: 2.1 time: 0.370817 Aug 31 16:44:06.485038 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3274/6555] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:06 2022] GET /compute/v2.1/servers/a89947bc-0241-4e87-bbbf-2fed45fa4cb6 => generated 1202 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:44:07.134459 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a0e775a7-546a-4b76-ad22-b94ce88470ed tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:07.135171 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a0e775a7-546a-4b76-ad22-b94ce88470ed tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] [instance: d15ee718-42e5-41db-afa6-ad596e32c483] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:07.146532 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a0e775a7-546a-4b76-ad22-b94ce88470ed tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:07.147225 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a0e775a7-546a-4b76-ad22-b94ce88470ed tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:07.147704 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a0e775a7-546a-4b76-ad22-b94ce88470ed tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:07.149137 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a0e775a7-546a-4b76-ad22-b94ce88470ed tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:07.149713 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a0e775a7-546a-4b76-ad22-b94ce88470ed tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:07.150156 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a0e775a7-546a-4b76-ad22-b94ce88470ed tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:07.345695 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-16e5d7d5-01a0-42ad-b74d-5176fb383d87 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Action: 'create', calling method: .version_select at 0x7f5ae3a043a0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-792229916", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKXmFbypwCnIQ99KTXBffwMjjAoWoYRYMnIrMeYH90+qqnuTcA6+BJZAc0lCPigs//R+GeSjCkIukyqFOqb7M0h2cfk748IDjAIjmkEp6YnWUbUGMgMycjgfjZKbv1zGIA=="}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:44:07.356873 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a0e775a7-546a-4b76-ad22-b94ce88470ed tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/d15ee718-42e5-41db-afa6-ad596e32c483" status: 200 len: 1463 microversion: 2.1 time: 0.228277 Aug 31 16:44:07.358807 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3275/6556] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:07 2022] GET /compute/v2.1/servers/d15ee718-42e5-41db-afa6-ad596e32c483 => generated 1463 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:44:07.366686 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-16e5d7d5-01a0-42ad-b74d-5176fb383d87 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Getting quotas for project 1464b491651b43498f56ffcbe24646d8. Resources: {'key_pairs'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:44:07.373433 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-16e5d7d5-01a0-42ad-b74d-5176fb383d87 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Getting quotas for user bf392720aaea4a068b23404ef76ccd5f and project 1464b491651b43498f56ffcbe24646d8. Resources: {'key_pairs'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:44:07.409951 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-16e5d7d5-01a0-42ad-b74d-5176fb383d87 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.330680 Aug 31 16:44:07.410623 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3282/6557] 10.222.0.61 () {60 vars in 1159 bytes} [Wed Aug 31 16:44:07 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:44:07.510723 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-19551d45-1164-49bc-9810-b916c97bb6dd tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:07.511684 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-19551d45-1164-49bc-9810-b916c97bb6dd tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: a89947bc-0241-4e87-bbbf-2fed45fa4cb6] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:07.518210 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-19551d45-1164-49bc-9810-b916c97bb6dd tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:07.518982 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-19551d45-1164-49bc-9810-b916c97bb6dd tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:07.519667 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-19551d45-1164-49bc-9810-b916c97bb6dd tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:07.520575 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-19551d45-1164-49bc-9810-b916c97bb6dd tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:07.521221 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-19551d45-1164-49bc-9810-b916c97bb6dd tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:07.521823 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-19551d45-1164-49bc-9810-b916c97bb6dd tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:07.818242 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-19551d45-1164-49bc-9810-b916c97bb6dd tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:44:07.840831 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-19551d45-1164-49bc-9810-b916c97bb6dd tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/a89947bc-0241-4e87-bbbf-2fed45fa4cb6" status: 200 len: 1202 microversion: 2.1 time: 0.334766 Aug 31 16:44:07.841454 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3276/6558] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:07 2022] GET /compute/v2.1/servers/a89947bc-0241-4e87-bbbf-2fed45fa4cb6 => generated 1202 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:44:08.132267 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-ead7f3fc-166c-468a-82cb-12bcdbf026d4 req-4ea0dea4-f3a2-4c4c-89e0-0bba84a892da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a89947bc-0241-4e87-bbbf-2fed45fa4cb6", "name": "network-vif-plugged", "status": "completed", "tag": "53b9a29d-be57-4020-b2c2-2ed49d2e1f28"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:44:08.155101 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:44:08.179060 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-ead7f3fc-166c-468a-82cb-12bcdbf026d4 req-4ea0dea4-f3a2-4c4c-89e0-0bba84a892da service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:08.180481 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-ead7f3fc-166c-468a-82cb-12bcdbf026d4 req-4ea0dea4-f3a2-4c4c-89e0-0bba84a892da service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:08.181003 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-ead7f3fc-166c-468a-82cb-12bcdbf026d4 req-4ea0dea4-f3a2-4c4c-89e0-0bba84a892da service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:08.201435 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-ead7f3fc-166c-468a-82cb-12bcdbf026d4 req-4ea0dea4-f3a2-4c4c-89e0-0bba84a892da service nova] Creating event network-vif-plugged:53b9a29d-be57-4020-b2c2-2ed49d2e1f28 for instance a89947bc-0241-4e87-bbbf-2fed45fa4cb6 on n-h2-850499-9 Aug 31 16:44:08.208197 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-ead7f3fc-166c-468a-82cb-12bcdbf026d4 req-4ea0dea4-f3a2-4c4c-89e0-0bba84a892da service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103724 Aug 31 16:44:08.208934 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3283/6559] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:44:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:44:08.398488 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0b9cb6c8-7cd5-487e-8aa4-dfad56047be5 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:08.403181 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0b9cb6c8-7cd5-487e-8aa4-dfad56047be5 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] [instance: d15ee718-42e5-41db-afa6-ad596e32c483] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:08.411730 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:44:08.424058 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0b9cb6c8-7cd5-487e-8aa4-dfad56047be5 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:08.425145 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0b9cb6c8-7cd5-487e-8aa4-dfad56047be5 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:08.425830 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0b9cb6c8-7cd5-487e-8aa4-dfad56047be5 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:08.426712 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0b9cb6c8-7cd5-487e-8aa4-dfad56047be5 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:08.427292 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0b9cb6c8-7cd5-487e-8aa4-dfad56047be5 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:08.428090 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0b9cb6c8-7cd5-487e-8aa4-dfad56047be5 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:08.754410 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0b9cb6c8-7cd5-487e-8aa4-dfad56047be5 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/d15ee718-42e5-41db-afa6-ad596e32c483" status: 200 len: 1463 microversion: 2.1 time: 0.366827 Aug 31 16:44:08.763287 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3277/6560] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:08 2022] GET /compute/v2.1/servers/d15ee718-42e5-41db-afa6-ad596e32c483 => generated 1463 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:44:08.865268 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-df2e0514-e726-4d1e-9b7a-2a0abf4a7a60 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:08.866664 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-df2e0514-e726-4d1e-9b7a-2a0abf4a7a60 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: a89947bc-0241-4e87-bbbf-2fed45fa4cb6] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:08.874010 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-df2e0514-e726-4d1e-9b7a-2a0abf4a7a60 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:08.874792 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-df2e0514-e726-4d1e-9b7a-2a0abf4a7a60 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:08.875419 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-df2e0514-e726-4d1e-9b7a-2a0abf4a7a60 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:08.876339 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-df2e0514-e726-4d1e-9b7a-2a0abf4a7a60 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:08.877223 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-df2e0514-e726-4d1e-9b7a-2a0abf4a7a60 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:08.878220 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-df2e0514-e726-4d1e-9b7a-2a0abf4a7a60 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:09.116630 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-df2e0514-e726-4d1e-9b7a-2a0abf4a7a60 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:44:09.130695 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-df2e0514-e726-4d1e-9b7a-2a0abf4a7a60 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/a89947bc-0241-4e87-bbbf-2fed45fa4cb6" status: 200 len: 1202 microversion: 2.1 time: 0.269927 Aug 31 16:44:09.131933 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3284/6561] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:08 2022] GET /compute/v2.1/servers/a89947bc-0241-4e87-bbbf-2fed45fa4cb6 => generated 1202 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:44:09.782516 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-44f6714c-9d64-43a2-a9c7-baa48e1f4b88 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:09.785439 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-44f6714c-9d64-43a2-a9c7-baa48e1f4b88 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] [instance: d15ee718-42e5-41db-afa6-ad596e32c483] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:09.801864 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-44f6714c-9d64-43a2-a9c7-baa48e1f4b88 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:09.802858 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-44f6714c-9d64-43a2-a9c7-baa48e1f4b88 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:09.803580 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-44f6714c-9d64-43a2-a9c7-baa48e1f4b88 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:09.804578 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-44f6714c-9d64-43a2-a9c7-baa48e1f4b88 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:09.805357 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-44f6714c-9d64-43a2-a9c7-baa48e1f4b88 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:09.806151 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-44f6714c-9d64-43a2-a9c7-baa48e1f4b88 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:10.020945 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-44f6714c-9d64-43a2-a9c7-baa48e1f4b88 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/d15ee718-42e5-41db-afa6-ad596e32c483" status: 200 len: 1463 microversion: 2.1 time: 0.247112 Aug 31 16:44:10.021912 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3278/6562] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:09 2022] GET /compute/v2.1/servers/d15ee718-42e5-41db-afa6-ad596e32c483 => generated 1463 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:44:10.168030 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d3c4eb5b-c017-4ef6-a912-1f62a63095ad tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:10.169132 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d3c4eb5b-c017-4ef6-a912-1f62a63095ad tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: a89947bc-0241-4e87-bbbf-2fed45fa4cb6] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:10.181072 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d3c4eb5b-c017-4ef6-a912-1f62a63095ad tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:10.181685 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d3c4eb5b-c017-4ef6-a912-1f62a63095ad tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:10.182237 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d3c4eb5b-c017-4ef6-a912-1f62a63095ad tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:10.183187 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d3c4eb5b-c017-4ef6-a912-1f62a63095ad tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:10.183943 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d3c4eb5b-c017-4ef6-a912-1f62a63095ad tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:10.184773 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d3c4eb5b-c017-4ef6-a912-1f62a63095ad tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:10.233669 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-a90c6185-5c7b-46e5-9538-2827ddd4eeec req-1a6160fc-0768-4c85-a838-d5aa54698c2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d15ee718-42e5-41db-afa6-ad596e32c483", "name": "network-vif-plugged", "status": "completed", "tag": "100797af-51b0-49c2-b6fa-ce591a3ffc43"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:44:10.264678 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-a90c6185-5c7b-46e5-9538-2827ddd4eeec req-1a6160fc-0768-4c85-a838-d5aa54698c2e service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:10.265695 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-a90c6185-5c7b-46e5-9538-2827ddd4eeec req-1a6160fc-0768-4c85-a838-d5aa54698c2e service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:10.266413 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-a90c6185-5c7b-46e5-9538-2827ddd4eeec req-1a6160fc-0768-4c85-a838-d5aa54698c2e service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:10.288454 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-a90c6185-5c7b-46e5-9538-2827ddd4eeec req-1a6160fc-0768-4c85-a838-d5aa54698c2e service nova] Creating event network-vif-plugged:100797af-51b0-49c2-b6fa-ce591a3ffc43 for instance d15ee718-42e5-41db-afa6-ad596e32c483 on n-h2-850499-9 Aug 31 16:44:10.301034 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-a90c6185-5c7b-46e5-9538-2827ddd4eeec req-1a6160fc-0768-4c85-a838-d5aa54698c2e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074311 Aug 31 16:44:10.302232 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3279/6563] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:44:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:44:10.433051 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d3c4eb5b-c017-4ef6-a912-1f62a63095ad tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:44:10.444729 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d3c4eb5b-c017-4ef6-a912-1f62a63095ad tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/a89947bc-0241-4e87-bbbf-2fed45fa4cb6" status: 200 len: 1202 microversion: 2.1 time: 0.284967 Aug 31 16:44:10.460377 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3285/6564] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:10 2022] GET /compute/v2.1/servers/a89947bc-0241-4e87-bbbf-2fed45fa4cb6 => generated 1202 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:44:11.054979 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7d8783fd-daff-493e-b44c-b76d39d00ecb tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:11.063684 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7d8783fd-daff-493e-b44c-b76d39d00ecb tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] [instance: d15ee718-42e5-41db-afa6-ad596e32c483] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:11.082356 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7d8783fd-daff-493e-b44c-b76d39d00ecb tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:11.083363 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7d8783fd-daff-493e-b44c-b76d39d00ecb tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:11.083904 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7d8783fd-daff-493e-b44c-b76d39d00ecb tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:11.084903 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7d8783fd-daff-493e-b44c-b76d39d00ecb tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:11.085581 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7d8783fd-daff-493e-b44c-b76d39d00ecb tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:11.086713 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7d8783fd-daff-493e-b44c-b76d39d00ecb tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:11.260863 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7d8783fd-daff-493e-b44c-b76d39d00ecb tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/d15ee718-42e5-41db-afa6-ad596e32c483" status: 200 len: 1463 microversion: 2.1 time: 0.210404 Aug 31 16:44:11.275648 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3280/6565] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:11 2022] GET /compute/v2.1/servers/d15ee718-42e5-41db-afa6-ad596e32c483 => generated 1463 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:44:11.474439 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ddf0506f-1794-41b1-a74a-3eb00425f7b0 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:11.475597 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ddf0506f-1794-41b1-a74a-3eb00425f7b0 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: a89947bc-0241-4e87-bbbf-2fed45fa4cb6] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:11.488903 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ddf0506f-1794-41b1-a74a-3eb00425f7b0 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:11.490083 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ddf0506f-1794-41b1-a74a-3eb00425f7b0 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:11.491286 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ddf0506f-1794-41b1-a74a-3eb00425f7b0 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:11.493933 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ddf0506f-1794-41b1-a74a-3eb00425f7b0 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:11.494740 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ddf0506f-1794-41b1-a74a-3eb00425f7b0 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:11.496321 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ddf0506f-1794-41b1-a74a-3eb00425f7b0 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:11.713474 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ddf0506f-1794-41b1-a74a-3eb00425f7b0 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:44:11.727393 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ddf0506f-1794-41b1-a74a-3eb00425f7b0 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/a89947bc-0241-4e87-bbbf-2fed45fa4cb6" status: 200 len: 1389 microversion: 2.1 time: 0.260401 Aug 31 16:44:11.758616 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3286/6566] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:11 2022] GET /compute/v2.1/servers/a89947bc-0241-4e87-bbbf-2fed45fa4cb6 => generated 1389 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:44:11.770121 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a4d55792-ab3b-4927-8b1b-fb1250b2ab74 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:11.771697 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a4d55792-ab3b-4927-8b1b-fb1250b2ab74 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: a89947bc-0241-4e87-bbbf-2fed45fa4cb6] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:11.785443 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a4d55792-ab3b-4927-8b1b-fb1250b2ab74 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:11.786681 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a4d55792-ab3b-4927-8b1b-fb1250b2ab74 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:11.787948 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a4d55792-ab3b-4927-8b1b-fb1250b2ab74 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:11.791284 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a4d55792-ab3b-4927-8b1b-fb1250b2ab74 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:11.792355 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a4d55792-ab3b-4927-8b1b-fb1250b2ab74 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:11.793330 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a4d55792-ab3b-4927-8b1b-fb1250b2ab74 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:11.998832 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a4d55792-ab3b-4927-8b1b-fb1250b2ab74 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:44:12.014340 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a4d55792-ab3b-4927-8b1b-fb1250b2ab74 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/a89947bc-0241-4e87-bbbf-2fed45fa4cb6" status: 200 len: 1389 microversion: 2.1 time: 0.252623 Aug 31 16:44:12.028946 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3281/6567] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:11 2022] GET /compute/v2.1/servers/a89947bc-0241-4e87-bbbf-2fed45fa4cb6 => generated 1389 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:44:12.047554 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-bdd71294-6a4a-4bd5-97f5-e80f14f66d3c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:12.049041 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-bdd71294-6a4a-4bd5-97f5-e80f14f66d3c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: a89947bc-0241-4e87-bbbf-2fed45fa4cb6] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:12.060808 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bdd71294-6a4a-4bd5-97f5-e80f14f66d3c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:12.062516 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bdd71294-6a4a-4bd5-97f5-e80f14f66d3c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:12.063284 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bdd71294-6a4a-4bd5-97f5-e80f14f66d3c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:12.065143 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bdd71294-6a4a-4bd5-97f5-e80f14f66d3c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:12.065970 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bdd71294-6a4a-4bd5-97f5-e80f14f66d3c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:12.066793 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bdd71294-6a4a-4bd5-97f5-e80f14f66d3c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:12.285941 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-bdd71294-6a4a-4bd5-97f5-e80f14f66d3c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:44:12.296695 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-bdd71294-6a4a-4bd5-97f5-e80f14f66d3c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/a89947bc-0241-4e87-bbbf-2fed45fa4cb6" status: 200 len: 1389 microversion: 2.1 time: 0.260563 Aug 31 16:44:12.296974 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8cb3a349-6530-4842-bc48-26483c7f1043 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:12.297962 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8cb3a349-6530-4842-bc48-26483c7f1043 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] [instance: d15ee718-42e5-41db-afa6-ad596e32c483] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:12.298665 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3287/6568] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:12 2022] GET /compute/v2.1/servers/a89947bc-0241-4e87-bbbf-2fed45fa4cb6 => generated 1389 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:44:12.328937 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8cb3a349-6530-4842-bc48-26483c7f1043 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:12.329786 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8cb3a349-6530-4842-bc48-26483c7f1043 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:12.332880 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8cb3a349-6530-4842-bc48-26483c7f1043 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:12.341132 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8cb3a349-6530-4842-bc48-26483c7f1043 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:12.345407 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8cb3a349-6530-4842-bc48-26483c7f1043 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:12.346140 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8cb3a349-6530-4842-bc48-26483c7f1043 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:12.473942 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0dea5285-de09-4be6-8094-7951487f934f tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:12.474630 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0dea5285-de09-4be6-8094-7951487f934f tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: a89947bc-0241-4e87-bbbf-2fed45fa4cb6] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:12.495442 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0dea5285-de09-4be6-8094-7951487f934f tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:12.496163 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0dea5285-de09-4be6-8094-7951487f934f tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:12.496743 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0dea5285-de09-4be6-8094-7951487f934f tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:12.501257 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0dea5285-de09-4be6-8094-7951487f934f tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:12.510749 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0dea5285-de09-4be6-8094-7951487f934f tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:12.511707 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0dea5285-de09-4be6-8094-7951487f934f tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:12.574932 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0dea5285-de09-4be6-8094-7951487f934f tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: a89947bc-0241-4e87-bbbf-2fed45fa4cb6] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:44:12.624771 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8cb3a349-6530-4842-bc48-26483c7f1043 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/d15ee718-42e5-41db-afa6-ad596e32c483" status: 200 len: 1463 microversion: 2.1 time: 0.331889 Aug 31 16:44:12.626486 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3282/6569] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:12 2022] GET /compute/v2.1/servers/d15ee718-42e5-41db-afa6-ad596e32c483 => generated 1463 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:44:12.684259 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0dea5285-de09-4be6-8094-7951487f934f tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "DELETE /compute/v2.1/servers/a89947bc-0241-4e87-bbbf-2fed45fa4cb6" status: 204 len: 0 microversion: 2.1 time: 0.224424 Aug 31 16:44:12.685703 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3288/6570] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:44:12 2022] DELETE /compute/v2.1/servers/a89947bc-0241-4e87-bbbf-2fed45fa4cb6 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:44:12.696128 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-50aedcbe-15a1-4a72-be18-ef6c1a9f7939 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:12.697545 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-50aedcbe-15a1-4a72-be18-ef6c1a9f7939 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: a89947bc-0241-4e87-bbbf-2fed45fa4cb6] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:12.704599 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-50aedcbe-15a1-4a72-be18-ef6c1a9f7939 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:12.705205 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-50aedcbe-15a1-4a72-be18-ef6c1a9f7939 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:12.706321 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-50aedcbe-15a1-4a72-be18-ef6c1a9f7939 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:12.708220 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-50aedcbe-15a1-4a72-be18-ef6c1a9f7939 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:12.708797 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-50aedcbe-15a1-4a72-be18-ef6c1a9f7939 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:12.709316 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-50aedcbe-15a1-4a72-be18-ef6c1a9f7939 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:12.889910 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-50aedcbe-15a1-4a72-be18-ef6c1a9f7939 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:44:12.899052 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-50aedcbe-15a1-4a72-be18-ef6c1a9f7939 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/a89947bc-0241-4e87-bbbf-2fed45fa4cb6" status: 200 len: 1395 microversion: 2.1 time: 0.207945 Aug 31 16:44:12.906426 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3283/6571] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:12 2022] GET /compute/v2.1/servers/a89947bc-0241-4e87-bbbf-2fed45fa4cb6 => generated 1395 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:44:13.649624 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-588cfe79-5c17-4d82-a765-344b26c8c4b5 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:13.652063 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-588cfe79-5c17-4d82-a765-344b26c8c4b5 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] [instance: d15ee718-42e5-41db-afa6-ad596e32c483] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:13.659406 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-588cfe79-5c17-4d82-a765-344b26c8c4b5 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:13.660203 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-588cfe79-5c17-4d82-a765-344b26c8c4b5 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:13.660847 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-588cfe79-5c17-4d82-a765-344b26c8c4b5 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:13.661747 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-588cfe79-5c17-4d82-a765-344b26c8c4b5 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:13.662393 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-588cfe79-5c17-4d82-a765-344b26c8c4b5 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:13.663015 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-588cfe79-5c17-4d82-a765-344b26c8c4b5 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:13.875935 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-588cfe79-5c17-4d82-a765-344b26c8c4b5 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/d15ee718-42e5-41db-afa6-ad596e32c483" status: 200 len: 1648 microversion: 2.1 time: 0.230900 Aug 31 16:44:13.880097 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3289/6572] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:13 2022] GET /compute/v2.1/servers/d15ee718-42e5-41db-afa6-ad596e32c483 => generated 1648 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:44:13.911935 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ef51dc58-2f26-4946-966b-989d2d6b263a tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:13.912754 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ef51dc58-2f26-4946-966b-989d2d6b263a tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] [instance: d15ee718-42e5-41db-afa6-ad596e32c483] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:13.921864 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ef51dc58-2f26-4946-966b-989d2d6b263a tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:13.922314 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-90f0365e-1d0e-43f1-8bcc-16450388f202 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:13.922954 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-90f0365e-1d0e-43f1-8bcc-16450388f202 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: a89947bc-0241-4e87-bbbf-2fed45fa4cb6] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:13.923251 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ef51dc58-2f26-4946-966b-989d2d6b263a tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:13.923964 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ef51dc58-2f26-4946-966b-989d2d6b263a tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:13.925183 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ef51dc58-2f26-4946-966b-989d2d6b263a tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:13.926463 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ef51dc58-2f26-4946-966b-989d2d6b263a tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:13.927224 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ef51dc58-2f26-4946-966b-989d2d6b263a tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:13.937323 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-90f0365e-1d0e-43f1-8bcc-16450388f202 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:13.937841 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-90f0365e-1d0e-43f1-8bcc-16450388f202 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:13.938299 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-90f0365e-1d0e-43f1-8bcc-16450388f202 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:13.939041 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-90f0365e-1d0e-43f1-8bcc-16450388f202 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:13.939540 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-90f0365e-1d0e-43f1-8bcc-16450388f202 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:13.948403 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-90f0365e-1d0e-43f1-8bcc-16450388f202 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:14.275045 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-90f0365e-1d0e-43f1-8bcc-16450388f202 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:44:14.288482 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ef51dc58-2f26-4946-966b-989d2d6b263a tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/d15ee718-42e5-41db-afa6-ad596e32c483" status: 200 len: 1648 microversion: 2.1 time: 0.386110 Aug 31 16:44:14.291264 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3284/6573] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:13 2022] GET /compute/v2.1/servers/d15ee718-42e5-41db-afa6-ad596e32c483 => generated 1648 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:44:14.303169 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-90f0365e-1d0e-43f1-8bcc-16450388f202 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/a89947bc-0241-4e87-bbbf-2fed45fa4cb6" status: 200 len: 1395 microversion: 2.1 time: 0.383207 Aug 31 16:44:14.324019 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3290/6574] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:13 2022] GET /compute/v2.1/servers/a89947bc-0241-4e87-bbbf-2fed45fa4cb6 => generated 1395 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:44:14.330693 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9cdc6338-8bad-4afe-86d1-54ebf8a3ba0b tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:14.331884 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9cdc6338-8bad-4afe-86d1-54ebf8a3ba0b tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] [instance: d15ee718-42e5-41db-afa6-ad596e32c483] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:14.339442 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9cdc6338-8bad-4afe-86d1-54ebf8a3ba0b tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:14.339999 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9cdc6338-8bad-4afe-86d1-54ebf8a3ba0b tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:14.340440 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9cdc6338-8bad-4afe-86d1-54ebf8a3ba0b tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:14.341839 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9cdc6338-8bad-4afe-86d1-54ebf8a3ba0b tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:14.342370 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9cdc6338-8bad-4afe-86d1-54ebf8a3ba0b tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:14.342816 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9cdc6338-8bad-4afe-86d1-54ebf8a3ba0b tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:14.558897 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-bf7c2665-e68b-4050-80b6-454b1fac6b85 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:44:14.563273 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-bf7c2665-e68b-4050-80b6-454b1fac6b85 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] [instance: 8a4079ad-b084-41c9-af05-7e1d9c1a6616] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:14.593546 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:44:14.596146 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bf7c2665-e68b-4050-80b6-454b1fac6b85 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:14.597753 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bf7c2665-e68b-4050-80b6-454b1fac6b85 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:14.598203 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bf7c2665-e68b-4050-80b6-454b1fac6b85 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:14.599025 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bf7c2665-e68b-4050-80b6-454b1fac6b85 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:14.599485 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bf7c2665-e68b-4050-80b6-454b1fac6b85 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:14.601583 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9cdc6338-8bad-4afe-86d1-54ebf8a3ba0b tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/d15ee718-42e5-41db-afa6-ad596e32c483" status: 200 len: 1648 microversion: 2.1 time: 0.275783 Aug 31 16:44:14.602917 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3291/6575] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:14 2022] GET /compute/v2.1/servers/d15ee718-42e5-41db-afa6-ad596e32c483 => generated 1648 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:44:14.603116 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bf7c2665-e68b-4050-80b6-454b1fac6b85 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:14.634728 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4921e2de-3d70-4066-bbdc-125362984cac tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:14.635339 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4921e2de-3d70-4066-bbdc-125362984cac tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] [instance: d15ee718-42e5-41db-afa6-ad596e32c483] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:14.663908 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4921e2de-3d70-4066-bbdc-125362984cac tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:14.665840 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4921e2de-3d70-4066-bbdc-125362984cac tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:14.666472 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4921e2de-3d70-4066-bbdc-125362984cac tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:14.668910 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4921e2de-3d70-4066-bbdc-125362984cac tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:14.669238 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4921e2de-3d70-4066-bbdc-125362984cac tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:14.671139 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4921e2de-3d70-4066-bbdc-125362984cac tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:14.728596 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-bf7c2665-e68b-4050-80b6-454b1fac6b85 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] 10.222.0.61 "POST /compute/v2.1/servers/8a4079ad-b084-41c9-af05-7e1d9c1a6616/action" status: 200 len: 24570 microversion: 2.1 time: 0.430326 Aug 31 16:44:14.730246 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4921e2de-3d70-4066-bbdc-125362984cac tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] [instance: d15ee718-42e5-41db-afa6-ad596e32c483] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:44:14.731231 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3285/6576] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:44:14 2022] POST /compute/v2.1/servers/8a4079ad-b084-41c9-af05-7e1d9c1a6616/action => generated 24570 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 16:44:14.914552 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4921e2de-3d70-4066-bbdc-125362984cac tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] 10.222.0.61 "DELETE /compute/v2.1/servers/d15ee718-42e5-41db-afa6-ad596e32c483" status: 204 len: 0 microversion: 2.1 time: 0.276031 Aug 31 16:44:14.914552 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3292/6577] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:44:14 2022] DELETE /compute/v2.1/servers/d15ee718-42e5-41db-afa6-ad596e32c483 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 16:44:14.929087 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-31344520-f187-444c-8414-1af22f1c4ff4 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:14.931970 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-31344520-f187-444c-8414-1af22f1c4ff4 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] [instance: d15ee718-42e5-41db-afa6-ad596e32c483] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:14.958615 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-31344520-f187-444c-8414-1af22f1c4ff4 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:14.959487 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-31344520-f187-444c-8414-1af22f1c4ff4 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:14.959781 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-31344520-f187-444c-8414-1af22f1c4ff4 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:14.961684 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-31344520-f187-444c-8414-1af22f1c4ff4 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:14.962290 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-31344520-f187-444c-8414-1af22f1c4ff4 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:14.964703 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-31344520-f187-444c-8414-1af22f1c4ff4 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:15.228348 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-31344520-f187-444c-8414-1af22f1c4ff4 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/d15ee718-42e5-41db-afa6-ad596e32c483" status: 200 len: 1654 microversion: 2.1 time: 0.314988 Aug 31 16:44:15.229222 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3286/6578] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:14 2022] GET /compute/v2.1/servers/d15ee718-42e5-41db-afa6-ad596e32c483 => generated 1654 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:44:15.327358 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e91daf2d-3d4c-4c19-855e-6ea48ceb1483 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:15.328385 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e91daf2d-3d4c-4c19-855e-6ea48ceb1483 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: a89947bc-0241-4e87-bbbf-2fed45fa4cb6] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:15.338907 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e91daf2d-3d4c-4c19-855e-6ea48ceb1483 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:15.339420 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e91daf2d-3d4c-4c19-855e-6ea48ceb1483 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:15.340133 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e91daf2d-3d4c-4c19-855e-6ea48ceb1483 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:15.340962 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e91daf2d-3d4c-4c19-855e-6ea48ceb1483 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:15.341751 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e91daf2d-3d4c-4c19-855e-6ea48ceb1483 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:15.342694 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e91daf2d-3d4c-4c19-855e-6ea48ceb1483 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:15.535945 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e91daf2d-3d4c-4c19-855e-6ea48ceb1483 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:44:15.550047 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e91daf2d-3d4c-4c19-855e-6ea48ceb1483 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/a89947bc-0241-4e87-bbbf-2fed45fa4cb6" status: 200 len: 1395 microversion: 2.1 time: 0.227101 Aug 31 16:44:15.551734 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3293/6579] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:15 2022] GET /compute/v2.1/servers/a89947bc-0241-4e87-bbbf-2fed45fa4cb6 => generated 1395 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:44:16.045877 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6a384069-ade6-4ba8-8938-e59bedf1447e tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1598994249", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "networks": [{"uuid": "84ebbf1c-80cc-40db-b5dd-a3f490827e6b"}], "key_name": "tempest-TestNetworkAdvancedServerOps-792229916", "security_groups": [{"name": "tempest-secgroup-smoke-604600252"}]}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:44:16.193047 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-6a384069-ade6-4ba8-8938-e59bedf1447e tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] validate_networks() for [('84ebbf1c-80cc-40db-b5dd-a3f490827e6b', None, None, None, None, None)] {{(pid=122256) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:44:16.254527 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b11b827f-992d-4a93-8962-0f9016e0e726 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:16.255143 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b11b827f-992d-4a93-8962-0f9016e0e726 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] [instance: d15ee718-42e5-41db-afa6-ad596e32c483] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:16.269316 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b11b827f-992d-4a93-8962-0f9016e0e726 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:16.269820 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b11b827f-992d-4a93-8962-0f9016e0e726 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:16.270259 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b11b827f-992d-4a93-8962-0f9016e0e726 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:16.270973 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b11b827f-992d-4a93-8962-0f9016e0e726 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:16.271436 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b11b827f-992d-4a93-8962-0f9016e0e726 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:16.278041 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b11b827f-992d-4a93-8962-0f9016e0e726 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:16.858155 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b11b827f-992d-4a93-8962-0f9016e0e726 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/d15ee718-42e5-41db-afa6-ad596e32c483" status: 200 len: 1654 microversion: 2.1 time: 0.607781 Aug 31 16:44:16.859027 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3294/6580] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:16 2022] GET /compute/v2.1/servers/d15ee718-42e5-41db-afa6-ad596e32c483 => generated 1654 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:44:16.873406 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-bddafb9f-6617-40cd-90a6-4f92991684a5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:16.874289 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-bddafb9f-6617-40cd-90a6-4f92991684a5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: a89947bc-0241-4e87-bbbf-2fed45fa4cb6] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:16.893152 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bddafb9f-6617-40cd-90a6-4f92991684a5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:16.893949 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bddafb9f-6617-40cd-90a6-4f92991684a5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:16.894576 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bddafb9f-6617-40cd-90a6-4f92991684a5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:16.895596 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bddafb9f-6617-40cd-90a6-4f92991684a5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:16.896023 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bddafb9f-6617-40cd-90a6-4f92991684a5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:16.896463 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bddafb9f-6617-40cd-90a6-4f92991684a5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:17.384048 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=10 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:44:17.390676 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-6a384069-ade6-4ba8-8938-e59bedf1447e tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:44:17.391702 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-6a384069-ade6-4ba8-8938-e59bedf1447e tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:44:17.392381 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-6a384069-ade6-4ba8-8938-e59bedf1447e tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:44:17.392952 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-6a384069-ade6-4ba8-8938-e59bedf1447e tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:44:17.393534 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-6a384069-ade6-4ba8-8938-e59bedf1447e tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:44:17.408548 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6a384069-ade6-4ba8-8938-e59bedf1447e tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:17.409082 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6a384069-ade6-4ba8-8938-e59bedf1447e tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:17.409517 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6a384069-ade6-4ba8-8938-e59bedf1447e tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:17.410274 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6a384069-ade6-4ba8-8938-e59bedf1447e tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:17.410748 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6a384069-ade6-4ba8-8938-e59bedf1447e tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:17.411189 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6a384069-ade6-4ba8-8938-e59bedf1447e tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:17.413048 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-bddafb9f-6617-40cd-90a6-4f92991684a5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:44:17.426061 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-bddafb9f-6617-40cd-90a6-4f92991684a5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/a89947bc-0241-4e87-bbbf-2fed45fa4cb6" status: 200 len: 1395 microversion: 2.1 time: 0.556438 Aug 31 16:44:17.431704 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3295/6581] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:16 2022] GET /compute/v2.1/servers/a89947bc-0241-4e87-bbbf-2fed45fa4cb6 => generated 1395 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:44:17.460668 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-6a384069-ade6-4ba8-8938-e59bedf1447e tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Getting quotas for project 1464b491651b43498f56ffcbe24646d8. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:44:17.469432 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-6a384069-ade6-4ba8-8938-e59bedf1447e tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Getting quotas for user bf392720aaea4a068b23404ef76ccd5f and project 1464b491651b43498f56ffcbe24646d8. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:44:17.485406 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6a384069-ade6-4ba8-8938-e59bedf1447e tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Going to run 1 instances... {{(pid=122256) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:44:17.488102 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6a384069-ade6-4ba8-8938-e59bedf1447e tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 962444ac-43a3-4c95-94f6-38414daf29c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:44:17.565739 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6a384069-ade6-4ba8-8938-e59bedf1447e tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.523465 Aug 31 16:44:17.568723 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3287/6582] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:44:16 2022] POST /compute/v2.1/servers => generated 405 bytes in 1527 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:44:17.581088 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ad854d8b-f6ea-4227-8fa7-2050e8f573df tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:17.582035 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ad854d8b-f6ea-4227-8fa7-2050e8f573df tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 962444ac-43a3-4c95-94f6-38414daf29c1] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:17.752773 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ad854d8b-f6ea-4227-8fa7-2050e8f573df tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:44:17.779101 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ad854d8b-f6ea-4227-8fa7-2050e8f573df tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1" status: 200 len: 1266 microversion: 2.1 time: 0.202269 Aug 31 16:44:17.798502 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3296/6583] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:17 2022] GET /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1 => generated 1266 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:44:17.897854 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-21446016-c120-4451-ad69-52dcefdf8def req-01fedef5-a068-4ca5-b6a5-719162db09b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a89947bc-0241-4e87-bbbf-2fed45fa4cb6", "name": "network-vif-deleted", "tag": "53b9a29d-be57-4020-b2c2-2ed49d2e1f28"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:44:17.914736 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-caa413d3-406a-460d-9543-ba78921ecaef tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:17.917413 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-caa413d3-406a-460d-9543-ba78921ecaef tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] [instance: d15ee718-42e5-41db-afa6-ad596e32c483] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:17.922829 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-21446016-c120-4451-ad69-52dcefdf8def req-01fedef5-a068-4ca5-b6a5-719162db09b0 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:17.926141 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-21446016-c120-4451-ad69-52dcefdf8def req-01fedef5-a068-4ca5-b6a5-719162db09b0 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:17.933374 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-21446016-c120-4451-ad69-52dcefdf8def req-01fedef5-a068-4ca5-b6a5-719162db09b0 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:17.939306 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-caa413d3-406a-460d-9543-ba78921ecaef tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:17.943229 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-caa413d3-406a-460d-9543-ba78921ecaef tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:17.947377 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-caa413d3-406a-460d-9543-ba78921ecaef tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:17.948932 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-caa413d3-406a-460d-9543-ba78921ecaef tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:17.951948 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-caa413d3-406a-460d-9543-ba78921ecaef tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:17.953536 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-caa413d3-406a-460d-9543-ba78921ecaef tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:17.966275 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-21446016-c120-4451-ad69-52dcefdf8def req-01fedef5-a068-4ca5-b6a5-719162db09b0 service nova] Creating event network-vif-deleted:53b9a29d-be57-4020-b2c2-2ed49d2e1f28 for instance a89947bc-0241-4e87-bbbf-2fed45fa4cb6 on n-h2-850499-9 Aug 31 16:44:17.986887 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-21446016-c120-4451-ad69-52dcefdf8def req-01fedef5-a068-4ca5-b6a5-719162db09b0 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090863 Aug 31 16:44:17.989392 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3297/6584] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:44:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:44:18.280251 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-caa413d3-406a-460d-9543-ba78921ecaef tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/d15ee718-42e5-41db-afa6-ad596e32c483" status: 200 len: 1612 microversion: 2.1 time: 0.402500 Aug 31 16:44:18.284525 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3288/6585] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:17 2022] GET /compute/v2.1/servers/d15ee718-42e5-41db-afa6-ad596e32c483 => generated 1612 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:44:18.469663 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4a77816e-c314-49d2-bd85-2a937ecba104 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:18.473794 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4a77816e-c314-49d2-bd85-2a937ecba104 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: a89947bc-0241-4e87-bbbf-2fed45fa4cb6] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:18.509483 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4a77816e-c314-49d2-bd85-2a937ecba104 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:18.517670 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4a77816e-c314-49d2-bd85-2a937ecba104 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:18.525701 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4a77816e-c314-49d2-bd85-2a937ecba104 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:18.529086 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4a77816e-c314-49d2-bd85-2a937ecba104 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:18.531438 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4a77816e-c314-49d2-bd85-2a937ecba104 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:18.533186 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4a77816e-c314-49d2-bd85-2a937ecba104 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:18.735293 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-4a77816e-c314-49d2-bd85-2a937ecba104 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:44:18.750367 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4a77816e-c314-49d2-bd85-2a937ecba104 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/a89947bc-0241-4e87-bbbf-2fed45fa4cb6" status: 200 len: 1187 microversion: 2.1 time: 0.289570 Aug 31 16:44:18.752020 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3298/6586] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:18 2022] GET /compute/v2.1/servers/a89947bc-0241-4e87-bbbf-2fed45fa4cb6 => generated 1187 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:44:18.810939 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5bf29f50-25f9-44e4-ad7d-f4049fb7f129 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:18.812392 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5bf29f50-25f9-44e4-ad7d-f4049fb7f129 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 962444ac-43a3-4c95-94f6-38414daf29c1] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:18.838634 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5bf29f50-25f9-44e4-ad7d-f4049fb7f129 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:18.841874 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5bf29f50-25f9-44e4-ad7d-f4049fb7f129 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:18.842544 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5bf29f50-25f9-44e4-ad7d-f4049fb7f129 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:18.844766 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5bf29f50-25f9-44e4-ad7d-f4049fb7f129 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:18.846205 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5bf29f50-25f9-44e4-ad7d-f4049fb7f129 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:18.851426 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5bf29f50-25f9-44e4-ad7d-f4049fb7f129 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:18.988366 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5bf29f50-25f9-44e4-ad7d-f4049fb7f129 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:44:19.001880 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5bf29f50-25f9-44e4-ad7d-f4049fb7f129 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1" status: 200 len: 1270 microversion: 2.1 time: 0.196213 Aug 31 16:44:19.003687 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3289/6587] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:18 2022] GET /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1 => generated 1270 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:44:19.304413 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-896d568e-a711-4395-a0e2-13933d88ce6a tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:19.309104 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-896d568e-a711-4395-a0e2-13933d88ce6a tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] [instance: d15ee718-42e5-41db-afa6-ad596e32c483] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:19.325291 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-896d568e-a711-4395-a0e2-13933d88ce6a tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:19.333899 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-896d568e-a711-4395-a0e2-13933d88ce6a tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:19.334636 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-896d568e-a711-4395-a0e2-13933d88ce6a tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:19.335733 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-896d568e-a711-4395-a0e2-13933d88ce6a tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:19.337920 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-896d568e-a711-4395-a0e2-13933d88ce6a tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:19.343659 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-896d568e-a711-4395-a0e2-13933d88ce6a tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:19.440732 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-896d568e-a711-4395-a0e2-13933d88ce6a tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:19.441563 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-896d568e-a711-4395-a0e2-13933d88ce6a tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:19.442662 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-896d568e-a711-4395-a0e2-13933d88ce6a tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:19.443061 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-896d568e-a711-4395-a0e2-13933d88ce6a tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lazy-loading 'fault' on Instance uuid d15ee718-42e5-41db-afa6-ad596e32c483 {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:44:19.535214 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-896d568e-a711-4395-a0e2-13933d88ce6a tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/d15ee718-42e5-41db-afa6-ad596e32c483" status: 200 len: 1453 microversion: 2.1 time: 0.234372 Aug 31 16:44:19.536893 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3299/6588] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:19 2022] GET /compute/v2.1/servers/d15ee718-42e5-41db-afa6-ad596e32c483 => generated 1453 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:44:19.775805 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-48b77aa4-aba0-44dc-b7a5-8ecb86f77093 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:19.776451 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-48b77aa4-aba0-44dc-b7a5-8ecb86f77093 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: a89947bc-0241-4e87-bbbf-2fed45fa4cb6] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:19.792821 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-48b77aa4-aba0-44dc-b7a5-8ecb86f77093 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:19.793342 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-48b77aa4-aba0-44dc-b7a5-8ecb86f77093 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:19.796098 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-48b77aa4-aba0-44dc-b7a5-8ecb86f77093 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:19.800946 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-48b77aa4-aba0-44dc-b7a5-8ecb86f77093 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:19.801476 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-48b77aa4-aba0-44dc-b7a5-8ecb86f77093 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:19.801943 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-48b77aa4-aba0-44dc-b7a5-8ecb86f77093 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:19.809170 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=100 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:44:20.025960 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9d31efce-0aa7-489b-8064-350ce33605af tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:20.026682 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9d31efce-0aa7-489b-8064-350ce33605af tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 962444ac-43a3-4c95-94f6-38414daf29c1] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:20.036900 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9d31efce-0aa7-489b-8064-350ce33605af tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:20.039956 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9d31efce-0aa7-489b-8064-350ce33605af tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:20.040780 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9d31efce-0aa7-489b-8064-350ce33605af tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:20.044019 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9d31efce-0aa7-489b-8064-350ce33605af tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:20.044539 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9d31efce-0aa7-489b-8064-350ce33605af tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:20.046696 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9d31efce-0aa7-489b-8064-350ce33605af tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:20.097934 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-48b77aa4-aba0-44dc-b7a5-8ecb86f77093 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:44:20.129905 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-48b77aa4-aba0-44dc-b7a5-8ecb86f77093 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/a89947bc-0241-4e87-bbbf-2fed45fa4cb6" status: 200 len: 1187 microversion: 2.1 time: 0.360090 Aug 31 16:44:20.134445 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3290/6589] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:19 2022] GET /compute/v2.1/servers/a89947bc-0241-4e87-bbbf-2fed45fa4cb6 => generated 1187 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:44:20.140938 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-ad7755e9-b05a-4b4e-bcaa-3f1f3980400f req-3942b32e-f4e2-4438-ac8c-5f894c05b9ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d15ee718-42e5-41db-afa6-ad596e32c483", "name": "network-vif-deleted", "tag": "100797af-51b0-49c2-b6fa-ce591a3ffc43"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:44:20.177685 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-ad7755e9-b05a-4b4e-bcaa-3f1f3980400f req-3942b32e-f4e2-4438-ac8c-5f894c05b9ed service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:20.178329 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-ad7755e9-b05a-4b4e-bcaa-3f1f3980400f req-3942b32e-f4e2-4438-ac8c-5f894c05b9ed service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:20.178986 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-ad7755e9-b05a-4b4e-bcaa-3f1f3980400f req-3942b32e-f4e2-4438-ac8c-5f894c05b9ed service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:20.223254 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9d31efce-0aa7-489b-8064-350ce33605af tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:44:20.224425 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-ad7755e9-b05a-4b4e-bcaa-3f1f3980400f req-3942b32e-f4e2-4438-ac8c-5f894c05b9ed service nova] Creating event network-vif-deleted:100797af-51b0-49c2-b6fa-ce591a3ffc43 for instance d15ee718-42e5-41db-afa6-ad596e32c483 on n-h2-850499-9 Aug 31 16:44:20.241125 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-ad7755e9-b05a-4b4e-bcaa-3f1f3980400f req-3942b32e-f4e2-4438-ac8c-5f894c05b9ed service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104644 Aug 31 16:44:20.242028 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3291/6590] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:44:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:44:20.250322 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9d31efce-0aa7-489b-8064-350ce33605af tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1" status: 200 len: 1336 microversion: 2.1 time: 0.229083 Aug 31 16:44:20.261145 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3300/6591] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:20 2022] GET /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1 => generated 1336 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:44:20.572763 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-672acd7e-d6d7-485b-9e59-be10f6c69043 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:20.574256 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-672acd7e-d6d7-485b-9e59-be10f6c69043 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] [instance: d15ee718-42e5-41db-afa6-ad596e32c483] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:20.597704 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-672acd7e-d6d7-485b-9e59-be10f6c69043 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:20.598470 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-672acd7e-d6d7-485b-9e59-be10f6c69043 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:20.599110 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-672acd7e-d6d7-485b-9e59-be10f6c69043 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:20.600186 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-672acd7e-d6d7-485b-9e59-be10f6c69043 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:20.600899 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-672acd7e-d6d7-485b-9e59-be10f6c69043 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:20.601726 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-672acd7e-d6d7-485b-9e59-be10f6c69043 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:20.651563 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-672acd7e-d6d7-485b-9e59-be10f6c69043 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] HTTP exception thrown: Instance d15ee718-42e5-41db-afa6-ad596e32c483 could not be found. Aug 31 16:44:20.653311 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-672acd7e-d6d7-485b-9e59-be10f6c69043 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Request method failure captured: Aug 31 16:44:20.653311 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/d15ee718-42e5-41db-afa6-ad596e32c483 HTTP/1.1 Aug 31 16:44:20.653311 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:44:20.653311 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:44:20.653311 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:44:20.653311 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:44:20.653311 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:44:20.653311 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:44:20.653311 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:44:20.653311 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:44:20.653311 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4-zl_sfB0fzrYfIsTUjBjVZX7-dGqrxkNuXsr1vHbhB0_1i5Mggp-C-DrUXejGH-1StrDYsI8ugVvFYmjHPQCKkKyat-_QDUji4bkj0Mi0njk9seyWoanvn0lz-g0ByThDQjzqG1lX7UJ4w-eCORkoESmhGWkIqcdZNRMW4NZW0S0o Aug 31 16:44:20.653311 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:44:20.653311 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:44:20.653311 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:44:20.653311 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:44:20.653311 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:44:20.653311 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:44:20.653311 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 85be82e1abc6450fa1fc362528fb2762 Aug 31 16:44:20.653311 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-TestServerMultinode-599294088 Aug 31 16:44:20.653311 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,admin,member Aug 31 16:44:20.653311 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,admin,member Aug 31 16:44:20.653311 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/85be82e1abc6450fa1fc362528fb2762"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/85be82e1abc6450fa1fc362528fb2762"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_85be82e1abc6450fa1fc362528fb2762", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/85be82e1abc6450fa1fc362528fb2762"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:44:20.653311 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-TestServerMultinode-599294088 Aug 31 16:44:20.653311 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 85be82e1abc6450fa1fc362528fb2762 Aug 31 16:44:20.653311 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-TestServerMultinode-599294088 Aug 31 16:44:20.653311 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-TestServerMultinode-599294088-project-admin Aug 31 16:44:20.653311 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:44:20.653311 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:44:20.653311 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: ae0a30726eac45fca5856ae95f24e501 Aug 31 16:44:20.653311 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-TestServerMultinode-599294088-project-admin Aug 31 16:44:20.653311 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:44:20.653311 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance d15ee718-42e5-41db-afa6-ad596e32c483 could not be found. Aug 31 16:44:20.653311 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': 'd15ee718-42e5-41db-afa6-ad596e32c483'} Aug 31 16:44:20.653311 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:44:20.653311 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:44:20.653311 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:44:20.653311 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:44:20.653311 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:44:20.653311 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:44:20.653311 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:44:20.653311 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:44:20.653311 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:44:20.653311 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:44:20.653311 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d15ee718-42e5-41db-afa6-ad596e32c483 could not be found. Aug 31 16:44:20.653311 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:44:20.653311 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:44:20.653311 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:44:20.653311 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:44:20.653311 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:44:20.653311 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:44:20.653311 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:44:20.653311 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:44:20.653311 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:44:20.653311 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:44:20.653311 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:44:20.653311 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:44:20.653311 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:44:20.653311 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:44:20.653311 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:44:20.653311 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:44:20.653311 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d15ee718-42e5-41db-afa6-ad596e32c483 could not be found. Aug 31 16:44:20.653311 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:44:20.653311 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:44:20.653311 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:44:20.659046 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:44:20.659046 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:44:20.659046 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:44:20.659046 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:44:20.659046 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:44:20.659046 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d15ee718-42e5-41db-afa6-ad596e32c483 could not be found. Aug 31 16:44:20.659046 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:44:20.659046 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-672acd7e-d6d7-485b-9e59-be10f6c69043 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Returning 404 to user: Instance d15ee718-42e5-41db-afa6-ad596e32c483 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:44:20.659046 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-672acd7e-d6d7-485b-9e59-be10f6c69043 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/d15ee718-42e5-41db-afa6-ad596e32c483" status: 404 len: 111 microversion: 2.1 time: 0.094756 Aug 31 16:44:20.659989 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3292/6592] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:20 2022] GET /compute/v2.1/servers/d15ee718-42e5-41db-afa6-ad596e32c483 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:44:20.667227 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-71f2a7bc-17e4-458b-acff-56208e12d756 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:20.667923 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-71f2a7bc-17e4-458b-acff-56208e12d756 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] [instance: 3d5cba2d-6992-4782-93bf-b4260130af90] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:20.683755 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-71f2a7bc-17e4-458b-acff-56208e12d756 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:20.684431 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-71f2a7bc-17e4-458b-acff-56208e12d756 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:20.685028 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-71f2a7bc-17e4-458b-acff-56208e12d756 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:20.690389 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-71f2a7bc-17e4-458b-acff-56208e12d756 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:20.691041 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-71f2a7bc-17e4-458b-acff-56208e12d756 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:20.691632 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-71f2a7bc-17e4-458b-acff-56208e12d756 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:20.756987 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-71f2a7bc-17e4-458b-acff-56208e12d756 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] [instance: 3d5cba2d-6992-4782-93bf-b4260130af90] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:44:20.953187 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-71f2a7bc-17e4-458b-acff-56208e12d756 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] 10.222.0.61 "DELETE /compute/v2.1/servers/3d5cba2d-6992-4782-93bf-b4260130af90" status: 204 len: 0 microversion: 2.1 time: 0.291806 Aug 31 16:44:20.960482 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3301/6593] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:44:20 2022] DELETE /compute/v2.1/servers/3d5cba2d-6992-4782-93bf-b4260130af90 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:44:20.970601 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8672de44-80ec-4369-a4c5-20052eec6e98 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:20.971361 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8672de44-80ec-4369-a4c5-20052eec6e98 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] [instance: 3d5cba2d-6992-4782-93bf-b4260130af90] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:20.989136 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8672de44-80ec-4369-a4c5-20052eec6e98 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:20.989636 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8672de44-80ec-4369-a4c5-20052eec6e98 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:20.990083 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8672de44-80ec-4369-a4c5-20052eec6e98 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:20.990806 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8672de44-80ec-4369-a4c5-20052eec6e98 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:20.991269 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8672de44-80ec-4369-a4c5-20052eec6e98 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:20.991730 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8672de44-80ec-4369-a4c5-20052eec6e98 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:21.180503 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ed73e1a3-6054-415b-a9e5-437ec1bf1b3c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:21.181483 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ed73e1a3-6054-415b-a9e5-437ec1bf1b3c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: a89947bc-0241-4e87-bbbf-2fed45fa4cb6] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:21.200452 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ed73e1a3-6054-415b-a9e5-437ec1bf1b3c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:21.200975 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ed73e1a3-6054-415b-a9e5-437ec1bf1b3c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:21.201432 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ed73e1a3-6054-415b-a9e5-437ec1bf1b3c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:21.202184 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ed73e1a3-6054-415b-a9e5-437ec1bf1b3c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:21.206988 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ed73e1a3-6054-415b-a9e5-437ec1bf1b3c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:21.207623 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ed73e1a3-6054-415b-a9e5-437ec1bf1b3c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:21.389173 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8672de44-80ec-4369-a4c5-20052eec6e98 tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/3d5cba2d-6992-4782-93bf-b4260130af90" status: 200 len: 1656 microversion: 2.1 time: 0.423297 Aug 31 16:44:21.401283 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3293/6594] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:20 2022] GET /compute/v2.1/servers/3d5cba2d-6992-4782-93bf-b4260130af90 => generated 1656 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:44:21.409828 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5525503c-3a44-45db-ad42-19f8ae0fc2d5 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:21.420541 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5525503c-3a44-45db-ad42-19f8ae0fc2d5 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 962444ac-43a3-4c95-94f6-38414daf29c1] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:21.429223 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5525503c-3a44-45db-ad42-19f8ae0fc2d5 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:21.430317 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5525503c-3a44-45db-ad42-19f8ae0fc2d5 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:21.430964 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5525503c-3a44-45db-ad42-19f8ae0fc2d5 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:21.431803 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5525503c-3a44-45db-ad42-19f8ae0fc2d5 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:21.432198 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5525503c-3a44-45db-ad42-19f8ae0fc2d5 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:21.439548 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5525503c-3a44-45db-ad42-19f8ae0fc2d5 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:21.480050 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ed73e1a3-6054-415b-a9e5-437ec1bf1b3c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:44:21.501782 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ed73e1a3-6054-415b-a9e5-437ec1bf1b3c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/a89947bc-0241-4e87-bbbf-2fed45fa4cb6" status: 200 len: 1187 microversion: 2.1 time: 0.344887 Aug 31 16:44:21.502730 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3302/6595] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:21 2022] GET /compute/v2.1/servers/a89947bc-0241-4e87-bbbf-2fed45fa4cb6 => generated 1187 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:44:21.660847 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5525503c-3a44-45db-ad42-19f8ae0fc2d5 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:44:21.685358 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5525503c-3a44-45db-ad42-19f8ae0fc2d5 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1" status: 200 len: 1324 microversion: 2.1 time: 0.282173 Aug 31 16:44:21.685985 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3294/6596] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:21 2022] GET /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1 => generated 1324 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:44:22.439463 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d8e0dc49-b95e-4a7b-a360-e8972bb13a6e tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:22.442964 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d8e0dc49-b95e-4a7b-a360-e8972bb13a6e tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] [instance: 3d5cba2d-6992-4782-93bf-b4260130af90] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:22.485983 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d8e0dc49-b95e-4a7b-a360-e8972bb13a6e tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:22.500784 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d8e0dc49-b95e-4a7b-a360-e8972bb13a6e tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:22.503790 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d8e0dc49-b95e-4a7b-a360-e8972bb13a6e tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:22.509941 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d8e0dc49-b95e-4a7b-a360-e8972bb13a6e tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:22.513241 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d8e0dc49-b95e-4a7b-a360-e8972bb13a6e tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:22.517301 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d8e0dc49-b95e-4a7b-a360-e8972bb13a6e tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:22.531783 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0a2e6266-fa7a-44f4-b447-a7a69e7fd7f8 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:22.532610 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0a2e6266-fa7a-44f4-b447-a7a69e7fd7f8 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: a89947bc-0241-4e87-bbbf-2fed45fa4cb6] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:22.553588 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0a2e6266-fa7a-44f4-b447-a7a69e7fd7f8 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:22.554590 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0a2e6266-fa7a-44f4-b447-a7a69e7fd7f8 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:22.556808 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0a2e6266-fa7a-44f4-b447-a7a69e7fd7f8 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:22.559705 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0a2e6266-fa7a-44f4-b447-a7a69e7fd7f8 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:22.561623 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0a2e6266-fa7a-44f4-b447-a7a69e7fd7f8 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:22.562437 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0a2e6266-fa7a-44f4-b447-a7a69e7fd7f8 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:22.796451 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-0a2e6266-fa7a-44f4-b447-a7a69e7fd7f8 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:44:22.818287 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0a2e6266-fa7a-44f4-b447-a7a69e7fd7f8 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/a89947bc-0241-4e87-bbbf-2fed45fa4cb6" status: 200 len: 1187 microversion: 2.1 time: 0.283119 Aug 31 16:44:22.819026 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3295/6597] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:22 2022] GET /compute/v2.1/servers/a89947bc-0241-4e87-bbbf-2fed45fa4cb6 => generated 1187 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:44:22.828340 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9129597e-d733-4377-9e3c-14717ee75ac3 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:22.830159 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9129597e-d733-4377-9e3c-14717ee75ac3 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 962444ac-43a3-4c95-94f6-38414daf29c1] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:22.847919 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9129597e-d733-4377-9e3c-14717ee75ac3 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:22.848925 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9129597e-d733-4377-9e3c-14717ee75ac3 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:22.849579 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9129597e-d733-4377-9e3c-14717ee75ac3 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:22.850615 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9129597e-d733-4377-9e3c-14717ee75ac3 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:22.851261 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9129597e-d733-4377-9e3c-14717ee75ac3 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:22.853352 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9129597e-d733-4377-9e3c-14717ee75ac3 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:22.880997 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d8e0dc49-b95e-4a7b-a360-e8972bb13a6e tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/3d5cba2d-6992-4782-93bf-b4260130af90" status: 200 len: 1656 microversion: 2.1 time: 0.445392 Aug 31 16:44:22.891885 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3303/6598] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:22 2022] GET /compute/v2.1/servers/3d5cba2d-6992-4782-93bf-b4260130af90 => generated 1656 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:44:23.198308 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-0c03d7f2-85d4-4673-8adb-63eef3cd7858 req-608bb16c-c218-4bc5-84db-2fe32984e566 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d5cba2d-6992-4782-93bf-b4260130af90", "name": "network-vif-deleted", "tag": "1d66d4ea-685b-490b-9c9d-6342943a2cb0"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:44:23.226405 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-0c03d7f2-85d4-4673-8adb-63eef3cd7858 req-608bb16c-c218-4bc5-84db-2fe32984e566 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:23.228814 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-9129597e-d733-4377-9e3c-14717ee75ac3 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:44:23.229685 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-0c03d7f2-85d4-4673-8adb-63eef3cd7858 req-608bb16c-c218-4bc5-84db-2fe32984e566 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:23.231902 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-0c03d7f2-85d4-4673-8adb-63eef3cd7858 req-608bb16c-c218-4bc5-84db-2fe32984e566 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:23.246806 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9129597e-d733-4377-9e3c-14717ee75ac3 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1" status: 200 len: 1391 microversion: 2.1 time: 0.425062 Aug 31 16:44:23.248189 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3296/6599] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:22 2022] GET /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1 => generated 1391 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:44:23.285603 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-0c03d7f2-85d4-4673-8adb-63eef3cd7858 req-608bb16c-c218-4bc5-84db-2fe32984e566 service nova] Creating event network-vif-deleted:1d66d4ea-685b-490b-9c9d-6342943a2cb0 for instance 3d5cba2d-6992-4782-93bf-b4260130af90 on n-h1-850499-9 Aug 31 16:44:23.299124 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-0c03d7f2-85d4-4673-8adb-63eef3cd7858 req-608bb16c-c218-4bc5-84db-2fe32984e566 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106515 Aug 31 16:44:23.300143 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3304/6600] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:44:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:44:23.814920 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-2fd7119b-fa11-45bc-a01a-e6d9a68c0ac8 req-0852858a-6793-47e7-b601-d925ee72f5e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "962444ac-43a3-4c95-94f6-38414daf29c1", "tag": "44cc7e58-7fc0-46b5-a51f-021cf720d9e1"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:44:23.830514 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-2fd7119b-fa11-45bc-a01a-e6d9a68c0ac8 req-0852858a-6793-47e7-b601-d925ee72f5e7 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:23.831006 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-2fd7119b-fa11-45bc-a01a-e6d9a68c0ac8 req-0852858a-6793-47e7-b601-d925ee72f5e7 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:23.831447 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-2fd7119b-fa11-45bc-a01a-e6d9a68c0ac8 req-0852858a-6793-47e7-b601-d925ee72f5e7 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:23.857745 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3ec9a06d-14a6-4dcf-91dd-846fbe1f97a5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:23.859179 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3ec9a06d-14a6-4dcf-91dd-846fbe1f97a5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: a89947bc-0241-4e87-bbbf-2fed45fa4cb6] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:23.867659 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-2fd7119b-fa11-45bc-a01a-e6d9a68c0ac8 req-0852858a-6793-47e7-b601-d925ee72f5e7 service nova] Creating event network-changed:44cc7e58-7fc0-46b5-a51f-021cf720d9e1 for instance 962444ac-43a3-4c95-94f6-38414daf29c1 on n-h1-850499-9 Aug 31 16:44:23.868370 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3ec9a06d-14a6-4dcf-91dd-846fbe1f97a5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:23.868990 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3ec9a06d-14a6-4dcf-91dd-846fbe1f97a5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:23.869799 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3ec9a06d-14a6-4dcf-91dd-846fbe1f97a5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:23.870867 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3ec9a06d-14a6-4dcf-91dd-846fbe1f97a5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:23.871585 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3ec9a06d-14a6-4dcf-91dd-846fbe1f97a5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:23.872230 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3ec9a06d-14a6-4dcf-91dd-846fbe1f97a5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:23.874752 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-2fd7119b-fa11-45bc-a01a-e6d9a68c0ac8 req-0852858a-6793-47e7-b601-d925ee72f5e7 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.151496 Aug 31 16:44:23.875927 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3297/6601] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:44:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:44:23.914998 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9f0de625-4f0e-4f0d-b88e-85ac0c19ca7f tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:23.922403 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9f0de625-4f0e-4f0d-b88e-85ac0c19ca7f tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] [instance: 3d5cba2d-6992-4782-93bf-b4260130af90] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:23.947418 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9f0de625-4f0e-4f0d-b88e-85ac0c19ca7f tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:23.947766 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9f0de625-4f0e-4f0d-b88e-85ac0c19ca7f tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:23.948405 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9f0de625-4f0e-4f0d-b88e-85ac0c19ca7f tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:23.949987 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9f0de625-4f0e-4f0d-b88e-85ac0c19ca7f tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:23.957674 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9f0de625-4f0e-4f0d-b88e-85ac0c19ca7f tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:23.958684 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9f0de625-4f0e-4f0d-b88e-85ac0c19ca7f tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:23.998206 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3ec9a06d-14a6-4dcf-91dd-846fbe1f97a5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:44:24.021353 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3ec9a06d-14a6-4dcf-91dd-846fbe1f97a5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/a89947bc-0241-4e87-bbbf-2fed45fa4cb6" status: 200 len: 1187 microversion: 2.1 time: 0.172879 Aug 31 16:44:24.034177 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3305/6602] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:23 2022] GET /compute/v2.1/servers/a89947bc-0241-4e87-bbbf-2fed45fa4cb6 => generated 1187 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:44:24.037776 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9f0de625-4f0e-4f0d-b88e-85ac0c19ca7f tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:24.043272 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9f0de625-4f0e-4f0d-b88e-85ac0c19ca7f tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:24.044071 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9f0de625-4f0e-4f0d-b88e-85ac0c19ca7f tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:24.044626 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-9f0de625-4f0e-4f0d-b88e-85ac0c19ca7f tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lazy-loading 'fault' on Instance uuid 3d5cba2d-6992-4782-93bf-b4260130af90 {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:44:24.179290 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9f0de625-4f0e-4f0d-b88e-85ac0c19ca7f tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/3d5cba2d-6992-4782-93bf-b4260130af90" status: 200 len: 1454 microversion: 2.1 time: 0.268887 Aug 31 16:44:24.197080 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3298/6603] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:23 2022] GET /compute/v2.1/servers/3d5cba2d-6992-4782-93bf-b4260130af90 => generated 1454 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:44:24.270716 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7e2ec886-37bc-413a-86a1-d9e42c266e12 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:24.271760 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7e2ec886-37bc-413a-86a1-d9e42c266e12 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 962444ac-43a3-4c95-94f6-38414daf29c1] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:24.281585 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7e2ec886-37bc-413a-86a1-d9e42c266e12 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:24.282489 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7e2ec886-37bc-413a-86a1-d9e42c266e12 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:24.283173 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7e2ec886-37bc-413a-86a1-d9e42c266e12 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:24.284161 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7e2ec886-37bc-413a-86a1-d9e42c266e12 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:24.284851 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7e2ec886-37bc-413a-86a1-d9e42c266e12 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:24.285528 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7e2ec886-37bc-413a-86a1-d9e42c266e12 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:24.688910 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7e2ec886-37bc-413a-86a1-d9e42c266e12 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:44:24.701689 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7e2ec886-37bc-413a-86a1-d9e42c266e12 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1" status: 200 len: 1391 microversion: 2.1 time: 0.435026 Aug 31 16:44:24.703050 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3306/6604] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:24 2022] GET /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1 => generated 1391 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:44:25.046472 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-972e855e-bf7a-45dc-9836-f78dbb554a91 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:25.048176 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-972e855e-bf7a-45dc-9836-f78dbb554a91 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: a89947bc-0241-4e87-bbbf-2fed45fa4cb6] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:25.054501 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:44:25.057693 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-972e855e-bf7a-45dc-9836-f78dbb554a91 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:25.058479 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-972e855e-bf7a-45dc-9836-f78dbb554a91 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:25.061757 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-972e855e-bf7a-45dc-9836-f78dbb554a91 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:25.063224 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-972e855e-bf7a-45dc-9836-f78dbb554a91 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:25.064109 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-972e855e-bf7a-45dc-9836-f78dbb554a91 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:25.064871 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-972e855e-bf7a-45dc-9836-f78dbb554a91 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:25.230207 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-36b86cbf-25fc-4124-a996-8f6561d50fdc tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:25.231274 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-36b86cbf-25fc-4124-a996-8f6561d50fdc tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] [instance: 3d5cba2d-6992-4782-93bf-b4260130af90] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:25.233558 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-972e855e-bf7a-45dc-9836-f78dbb554a91 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:44:25.249253 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-972e855e-bf7a-45dc-9836-f78dbb554a91 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/a89947bc-0241-4e87-bbbf-2fed45fa4cb6" status: 200 len: 1187 microversion: 2.1 time: 0.210733 Aug 31 16:44:25.250484 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3299/6605] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:25 2022] GET /compute/v2.1/servers/a89947bc-0241-4e87-bbbf-2fed45fa4cb6 => generated 1187 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:44:25.255532 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-36b86cbf-25fc-4124-a996-8f6561d50fdc tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:25.255532 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-36b86cbf-25fc-4124-a996-8f6561d50fdc tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:25.255802 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-36b86cbf-25fc-4124-a996-8f6561d50fdc tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:25.259745 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-36b86cbf-25fc-4124-a996-8f6561d50fdc tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:25.260593 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-36b86cbf-25fc-4124-a996-8f6561d50fdc tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:25.261600 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-36b86cbf-25fc-4124-a996-8f6561d50fdc tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:25.265904 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:44:25.298113 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-36b86cbf-25fc-4124-a996-8f6561d50fdc tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] HTTP exception thrown: Instance 3d5cba2d-6992-4782-93bf-b4260130af90 could not be found. Aug 31 16:44:25.300232 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-36b86cbf-25fc-4124-a996-8f6561d50fdc tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Request method failure captured: Aug 31 16:44:25.300232 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/3d5cba2d-6992-4782-93bf-b4260130af90 HTTP/1.1 Aug 31 16:44:25.300232 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:44:25.300232 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:44:25.300232 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:44:25.300232 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:44:25.300232 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:44:25.300232 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:44:25.300232 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:44:25.300232 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:44:25.300232 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4-zl_sfB0fzrYfIsTUjBjVZX7-dGqrxkNuXsr1vHbhB0_1i5Mggp-C-DrUXejGH-1StrDYsI8ugVvFYmjHPQCKkKyat-_QDUji4bkj0Mi0njk9seyWoanvn0lz-g0ByThDQjzqG1lX7UJ4w-eCORkoESmhGWkIqcdZNRMW4NZW0S0o Aug 31 16:44:25.300232 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:44:25.300232 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:44:25.300232 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:44:25.300232 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:44:25.300232 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:44:25.300232 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:44:25.300232 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 85be82e1abc6450fa1fc362528fb2762 Aug 31 16:44:25.300232 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-TestServerMultinode-599294088 Aug 31 16:44:25.300232 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,admin,member Aug 31 16:44:25.300232 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,admin,member Aug 31 16:44:25.300232 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/85be82e1abc6450fa1fc362528fb2762"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/85be82e1abc6450fa1fc362528fb2762"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_85be82e1abc6450fa1fc362528fb2762", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/85be82e1abc6450fa1fc362528fb2762"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:44:25.300232 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-TestServerMultinode-599294088 Aug 31 16:44:25.300232 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 85be82e1abc6450fa1fc362528fb2762 Aug 31 16:44:25.300232 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-TestServerMultinode-599294088 Aug 31 16:44:25.300232 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-TestServerMultinode-599294088-project-admin Aug 31 16:44:25.300232 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:44:25.300232 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:44:25.300232 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: ae0a30726eac45fca5856ae95f24e501 Aug 31 16:44:25.300232 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-TestServerMultinode-599294088-project-admin Aug 31 16:44:25.300232 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:44:25.300232 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance 3d5cba2d-6992-4782-93bf-b4260130af90 could not be found. Aug 31 16:44:25.300232 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '3d5cba2d-6992-4782-93bf-b4260130af90'} Aug 31 16:44:25.300232 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:44:25.300232 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:44:25.300232 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:44:25.300232 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:44:25.300232 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:44:25.300232 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:44:25.300232 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:44:25.300232 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:44:25.300232 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:44:25.300232 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:44:25.300232 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d5cba2d-6992-4782-93bf-b4260130af90 could not be found. Aug 31 16:44:25.300232 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:44:25.300232 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:44:25.300232 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:44:25.300232 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:44:25.300232 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:44:25.300232 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:44:25.300232 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:44:25.300232 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:44:25.300232 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:44:25.300232 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:44:25.300232 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:44:25.300232 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:44:25.300232 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:44:25.300232 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:44:25.300232 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:44:25.300232 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:44:25.300232 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d5cba2d-6992-4782-93bf-b4260130af90 could not be found. Aug 31 16:44:25.300232 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:44:25.300232 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:44:25.300232 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:44:25.310917 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:44:25.310917 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:44:25.310917 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:44:25.310917 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:44:25.310917 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:44:25.310917 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d5cba2d-6992-4782-93bf-b4260130af90 could not be found. Aug 31 16:44:25.310917 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:44:25.310917 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-36b86cbf-25fc-4124-a996-8f6561d50fdc tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] Returning 404 to user: Instance 3d5cba2d-6992-4782-93bf-b4260130af90 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:44:25.310917 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-36b86cbf-25fc-4124-a996-8f6561d50fdc tempest-TestServerMultinode-599294088 tempest-TestServerMultinode-599294088-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/3d5cba2d-6992-4782-93bf-b4260130af90" status: 404 len: 111 microversion: 2.1 time: 0.080225 Aug 31 16:44:25.310917 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3307/6606] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:25 2022] GET /compute/v2.1/servers/3d5cba2d-6992-4782-93bf-b4260130af90 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 16:44:25.726407 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e4034ae9-a577-48fa-afcf-3b7c051aca48 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:25.727653 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e4034ae9-a577-48fa-afcf-3b7c051aca48 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 962444ac-43a3-4c95-94f6-38414daf29c1] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:25.737996 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e4034ae9-a577-48fa-afcf-3b7c051aca48 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:25.738808 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e4034ae9-a577-48fa-afcf-3b7c051aca48 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:25.739852 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e4034ae9-a577-48fa-afcf-3b7c051aca48 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:25.741246 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e4034ae9-a577-48fa-afcf-3b7c051aca48 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:25.742887 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e4034ae9-a577-48fa-afcf-3b7c051aca48 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:25.743920 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e4034ae9-a577-48fa-afcf-3b7c051aca48 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:26.074412 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e4034ae9-a577-48fa-afcf-3b7c051aca48 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:44:26.088892 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e4034ae9-a577-48fa-afcf-3b7c051aca48 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1" status: 200 len: 1391 microversion: 2.1 time: 0.369246 Aug 31 16:44:26.092672 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3300/6607] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:25 2022] GET /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1 => generated 1391 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:44:26.281059 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7794b819-27ed-4f98-938f-8709d035f9d9 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:26.281693 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7794b819-27ed-4f98-938f-8709d035f9d9 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: a89947bc-0241-4e87-bbbf-2fed45fa4cb6] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:26.295415 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7794b819-27ed-4f98-938f-8709d035f9d9 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:26.296666 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7794b819-27ed-4f98-938f-8709d035f9d9 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:26.297331 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7794b819-27ed-4f98-938f-8709d035f9d9 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:26.298251 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7794b819-27ed-4f98-938f-8709d035f9d9 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:26.298782 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7794b819-27ed-4f98-938f-8709d035f9d9 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:26.299307 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7794b819-27ed-4f98-938f-8709d035f9d9 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:26.318148 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-7794b819-27ed-4f98-938f-8709d035f9d9 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] HTTP exception thrown: Instance a89947bc-0241-4e87-bbbf-2fed45fa4cb6 could not be found. Aug 31 16:44:26.320621 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7794b819-27ed-4f98-938f-8709d035f9d9 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Request method failure captured: Aug 31 16:44:26.320621 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/a89947bc-0241-4e87-bbbf-2fed45fa4cb6 HTTP/1.1 Aug 31 16:44:26.320621 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:44:26.320621 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:44:26.320621 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:44:26.320621 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:44:26.320621 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:44:26.320621 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:44:26.320621 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:44:26.320621 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:44:26.320621 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD47qS8C6HsXEaEmR5vEYZ6_LcYWck6kjg2PE2Sm6XicPmZbBvnd8kXBk0kFrhGPgu84OodaxIz7Gcm1qVV62nKCQjCd-8My5krh8bw3lC-5obyJ5MI9WGooafg2qsKoEyqO0fUDn4HqdbQ-uRSMHzaJZriF8vfhIimZHzzbd5tR6Fco Aug 31 16:44:26.320621 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:44:26.320621 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:44:26.320621 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:44:26.320621 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:44:26.320621 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:44:26.320621 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:44:26.320621 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 798d7eff58b04ab582bac1e87112625f Aug 31 16:44:26.320621 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-TestVolumeBootPattern-1074913281 Aug 31 16:44:26.320621 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:44:26.320621 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:44:26.320621 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/798d7eff58b04ab582bac1e87112625f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/798d7eff58b04ab582bac1e87112625f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_798d7eff58b04ab582bac1e87112625f", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/798d7eff58b04ab582bac1e87112625f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:44:26.320621 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-TestVolumeBootPattern-1074913281 Aug 31 16:44:26.320621 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 798d7eff58b04ab582bac1e87112625f Aug 31 16:44:26.320621 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-TestVolumeBootPattern-1074913281 Aug 31 16:44:26.320621 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-TestVolumeBootPattern-1074913281-project Aug 31 16:44:26.320621 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:44:26.320621 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:44:26.320621 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 588d2ef08d8345a6b6175c8287633270 Aug 31 16:44:26.320621 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-TestVolumeBootPattern-1074913281-project Aug 31 16:44:26.320621 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:44:26.320621 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance a89947bc-0241-4e87-bbbf-2fed45fa4cb6 could not be found. Aug 31 16:44:26.320621 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': 'a89947bc-0241-4e87-bbbf-2fed45fa4cb6'} Aug 31 16:44:26.320621 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:44:26.320621 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:44:26.320621 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:44:26.320621 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:44:26.320621 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:44:26.320621 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:44:26.320621 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:44:26.320621 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:44:26.320621 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:44:26.320621 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:44:26.320621 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a89947bc-0241-4e87-bbbf-2fed45fa4cb6 could not be found. Aug 31 16:44:26.320621 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:44:26.320621 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:44:26.320621 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:44:26.320621 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:44:26.320621 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:44:26.320621 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:44:26.320621 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:44:26.320621 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:44:26.320621 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:44:26.320621 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:44:26.320621 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:44:26.320621 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:44:26.320621 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:44:26.320621 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:44:26.320621 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:44:26.320621 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:44:26.320621 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a89947bc-0241-4e87-bbbf-2fed45fa4cb6 could not be found. Aug 31 16:44:26.320621 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:44:26.320621 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:44:26.320621 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:44:26.324887 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:44:26.324887 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:44:26.324887 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:44:26.324887 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:44:26.324887 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:44:26.324887 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a89947bc-0241-4e87-bbbf-2fed45fa4cb6 could not be found. Aug 31 16:44:26.324887 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:44:26.328875 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7794b819-27ed-4f98-938f-8709d035f9d9 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Returning 404 to user: Instance a89947bc-0241-4e87-bbbf-2fed45fa4cb6 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:44:26.330103 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7794b819-27ed-4f98-938f-8709d035f9d9 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/a89947bc-0241-4e87-bbbf-2fed45fa4cb6" status: 404 len: 111 microversion: 2.1 time: 0.054825 Aug 31 16:44:26.331033 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3308/6608] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:26 2022] GET /compute/v2.1/servers/a89947bc-0241-4e87-bbbf-2fed45fa4cb6 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:44:27.121701 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e7582765-8072-458a-bdbd-a2f1273464e4 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:27.122869 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e7582765-8072-458a-bdbd-a2f1273464e4 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 962444ac-43a3-4c95-94f6-38414daf29c1] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:27.143360 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e7582765-8072-458a-bdbd-a2f1273464e4 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:27.144093 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e7582765-8072-458a-bdbd-a2f1273464e4 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:27.145139 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e7582765-8072-458a-bdbd-a2f1273464e4 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:27.146911 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e7582765-8072-458a-bdbd-a2f1273464e4 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:27.148325 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e7582765-8072-458a-bdbd-a2f1273464e4 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:27.149416 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e7582765-8072-458a-bdbd-a2f1273464e4 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:27.439320 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:44:27.477169 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=6 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:44:27.671405 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e7582765-8072-458a-bdbd-a2f1273464e4 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:44:27.689661 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e7582765-8072-458a-bdbd-a2f1273464e4 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1" status: 200 len: 1391 microversion: 2.1 time: 0.575033 Aug 31 16:44:27.693371 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3301/6609] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:27 2022] GET /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1 => generated 1391 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:44:28.715117 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f814fd14-a1f2-4b2d-8f48-641c45f860bf tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:28.715736 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f814fd14-a1f2-4b2d-8f48-641c45f860bf tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 962444ac-43a3-4c95-94f6-38414daf29c1] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:28.721286 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:44:28.732184 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f814fd14-a1f2-4b2d-8f48-641c45f860bf tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:28.735189 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f814fd14-a1f2-4b2d-8f48-641c45f860bf tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:28.740791 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f814fd14-a1f2-4b2d-8f48-641c45f860bf tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:28.741844 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f814fd14-a1f2-4b2d-8f48-641c45f860bf tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:28.743548 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f814fd14-a1f2-4b2d-8f48-641c45f860bf tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:28.744412 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f814fd14-a1f2-4b2d-8f48-641c45f860bf tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:28.940585 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f814fd14-a1f2-4b2d-8f48-641c45f860bf tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:44:28.959337 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f814fd14-a1f2-4b2d-8f48-641c45f860bf tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1" status: 200 len: 1391 microversion: 2.1 time: 0.248856 Aug 31 16:44:28.961608 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3309/6610] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:28 2022] GET /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1 => generated 1391 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:44:29.628770 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-fdc0725b-b8db-4a7c-b21b-63aaa41a46ba tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:29.629684 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-fdc0725b-b8db-4a7c-b21b-63aaa41a46ba tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: a89947bc-0241-4e87-bbbf-2fed45fa4cb6] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:29.640439 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fdc0725b-b8db-4a7c-b21b-63aaa41a46ba tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:29.641176 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fdc0725b-b8db-4a7c-b21b-63aaa41a46ba tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:29.641994 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fdc0725b-b8db-4a7c-b21b-63aaa41a46ba tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:29.642934 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fdc0725b-b8db-4a7c-b21b-63aaa41a46ba tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:29.643793 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fdc0725b-b8db-4a7c-b21b-63aaa41a46ba tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:29.644604 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fdc0725b-b8db-4a7c-b21b-63aaa41a46ba tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:29.671851 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-fdc0725b-b8db-4a7c-b21b-63aaa41a46ba tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] HTTP exception thrown: Instance a89947bc-0241-4e87-bbbf-2fed45fa4cb6 could not be found. Aug 31 16:44:29.674315 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-fdc0725b-b8db-4a7c-b21b-63aaa41a46ba tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Request method failure captured: Aug 31 16:44:29.674315 n-d-850499-9 devstack@n-api.service[122256]: request: DELETE /compute/v2.1/servers/a89947bc-0241-4e87-bbbf-2fed45fa4cb6 HTTP/1.1 Aug 31 16:44:29.674315 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:44:29.674315 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:44:29.674315 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:44:29.674315 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:44:29.674315 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:44:29.674315 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:44:29.674315 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:44:29.674315 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:44:29.674315 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD47qS8C6HsXEaEmR5vEYZ6_LcYWck6kjg2PE2Sm6XicPmZbBvnd8kXBk0kFrhGPgu84OodaxIz7Gcm1qVV62nKCQjCd-8My5krh8bw3lC-5obyJ5MI9WGooafg2qsKoEyqO0fUDn4HqdbQ-uRSMHzaJZriF8vfhIimZHzzbd5tR6Fco Aug 31 16:44:29.674315 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:44:29.674315 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:44:29.674315 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:44:29.674315 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:44:29.674315 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:44:29.674315 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:44:29.674315 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 798d7eff58b04ab582bac1e87112625f Aug 31 16:44:29.674315 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-TestVolumeBootPattern-1074913281 Aug 31 16:44:29.674315 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:44:29.674315 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:44:29.674315 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/798d7eff58b04ab582bac1e87112625f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/798d7eff58b04ab582bac1e87112625f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_798d7eff58b04ab582bac1e87112625f", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/798d7eff58b04ab582bac1e87112625f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:44:29.674315 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-TestVolumeBootPattern-1074913281 Aug 31 16:44:29.674315 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 798d7eff58b04ab582bac1e87112625f Aug 31 16:44:29.674315 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-TestVolumeBootPattern-1074913281 Aug 31 16:44:29.674315 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-TestVolumeBootPattern-1074913281-project Aug 31 16:44:29.674315 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:44:29.674315 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:44:29.674315 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 588d2ef08d8345a6b6175c8287633270 Aug 31 16:44:29.674315 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-TestVolumeBootPattern-1074913281-project Aug 31 16:44:29.674315 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:44:29.674315 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance a89947bc-0241-4e87-bbbf-2fed45fa4cb6 could not be found. Aug 31 16:44:29.674315 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': 'a89947bc-0241-4e87-bbbf-2fed45fa4cb6'} Aug 31 16:44:29.674315 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:44:29.674315 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:44:29.674315 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:44:29.674315 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:44:29.674315 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:44:29.674315 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:44:29.674315 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:44:29.674315 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:44:29.674315 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:44:29.674315 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:44:29.674315 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a89947bc-0241-4e87-bbbf-2fed45fa4cb6 could not be found. Aug 31 16:44:29.674315 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:44:29.674315 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:44:29.674315 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:44:29.674315 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:44:29.674315 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:44:29.674315 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:44:29.674315 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:44:29.674315 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:44:29.674315 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:44:29.674315 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:44:29.674315 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:44:29.674315 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:44:29.674315 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:44:29.674315 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:44:29.674315 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:44:29.674315 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:44:29.674315 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:44:29.674315 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:44:29.680564 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a89947bc-0241-4e87-bbbf-2fed45fa4cb6 could not be found. Aug 31 16:44:29.680564 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:44:29.680564 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:44:29.680564 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:44:29.680564 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:44:29.680564 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:44:29.680564 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:44:29.680564 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:44:29.680564 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:44:29.680564 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a89947bc-0241-4e87-bbbf-2fed45fa4cb6 could not be found. Aug 31 16:44:29.680564 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:44:29.683653 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-fdc0725b-b8db-4a7c-b21b-63aaa41a46ba tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Returning 404 to user: Instance a89947bc-0241-4e87-bbbf-2fed45fa4cb6 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:44:29.686039 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-fdc0725b-b8db-4a7c-b21b-63aaa41a46ba tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "DELETE /compute/v2.1/servers/a89947bc-0241-4e87-bbbf-2fed45fa4cb6" status: 404 len: 111 microversion: 2.1 time: 0.061424 Aug 31 16:44:29.692831 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3302/6611] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:44:29 2022] DELETE /compute/v2.1/servers/a89947bc-0241-4e87-bbbf-2fed45fa4cb6 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:44:29.709196 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0603572b-18cd-48a3-a096-77e291091be4 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:29.709860 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0603572b-18cd-48a3-a096-77e291091be4 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: a89947bc-0241-4e87-bbbf-2fed45fa4cb6] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:29.725178 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0603572b-18cd-48a3-a096-77e291091be4 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:29.726093 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0603572b-18cd-48a3-a096-77e291091be4 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:29.726093 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0603572b-18cd-48a3-a096-77e291091be4 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:29.727139 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0603572b-18cd-48a3-a096-77e291091be4 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:29.731470 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0603572b-18cd-48a3-a096-77e291091be4 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:29.736890 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0603572b-18cd-48a3-a096-77e291091be4 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:29.779624 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-0603572b-18cd-48a3-a096-77e291091be4 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] HTTP exception thrown: Instance a89947bc-0241-4e87-bbbf-2fed45fa4cb6 could not be found. Aug 31 16:44:29.785366 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0603572b-18cd-48a3-a096-77e291091be4 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Request method failure captured: Aug 31 16:44:29.785366 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/a89947bc-0241-4e87-bbbf-2fed45fa4cb6 HTTP/1.1 Aug 31 16:44:29.785366 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:44:29.785366 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:44:29.785366 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:44:29.785366 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:44:29.785366 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:44:29.785366 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:44:29.785366 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:44:29.785366 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:44:29.785366 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD47qS8C6HsXEaEmR5vEYZ6_LcYWck6kjg2PE2Sm6XicPmZbBvnd8kXBk0kFrhGPgu84OodaxIz7Gcm1qVV62nKCQjCd-8My5krh8bw3lC-5obyJ5MI9WGooafg2qsKoEyqO0fUDn4HqdbQ-uRSMHzaJZriF8vfhIimZHzzbd5tR6Fco Aug 31 16:44:29.785366 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:44:29.785366 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:44:29.785366 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:44:29.785366 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:44:29.785366 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:44:29.785366 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:44:29.785366 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 798d7eff58b04ab582bac1e87112625f Aug 31 16:44:29.785366 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-TestVolumeBootPattern-1074913281 Aug 31 16:44:29.785366 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:44:29.785366 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:44:29.785366 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/798d7eff58b04ab582bac1e87112625f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/798d7eff58b04ab582bac1e87112625f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_798d7eff58b04ab582bac1e87112625f", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/798d7eff58b04ab582bac1e87112625f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:44:29.785366 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-TestVolumeBootPattern-1074913281 Aug 31 16:44:29.785366 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 798d7eff58b04ab582bac1e87112625f Aug 31 16:44:29.785366 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-TestVolumeBootPattern-1074913281 Aug 31 16:44:29.785366 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-TestVolumeBootPattern-1074913281-project Aug 31 16:44:29.785366 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:44:29.785366 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:44:29.785366 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 588d2ef08d8345a6b6175c8287633270 Aug 31 16:44:29.785366 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-TestVolumeBootPattern-1074913281-project Aug 31 16:44:29.785366 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:44:29.785366 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance a89947bc-0241-4e87-bbbf-2fed45fa4cb6 could not be found. Aug 31 16:44:29.785366 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': 'a89947bc-0241-4e87-bbbf-2fed45fa4cb6'} Aug 31 16:44:29.785366 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:44:29.785366 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:44:29.785366 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:44:29.785366 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:44:29.785366 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:44:29.785366 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:44:29.785366 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:44:29.785366 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:44:29.785366 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:44:29.785366 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:44:29.785366 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a89947bc-0241-4e87-bbbf-2fed45fa4cb6 could not be found. Aug 31 16:44:29.785366 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:44:29.785366 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:44:29.785366 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:44:29.785366 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:44:29.785366 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:44:29.785366 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:44:29.785366 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:44:29.785366 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:44:29.785366 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:44:29.785366 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:44:29.785366 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:44:29.785366 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:44:29.785366 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:44:29.785366 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:44:29.785366 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:44:29.785366 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:44:29.785366 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a89947bc-0241-4e87-bbbf-2fed45fa4cb6 could not be found. Aug 31 16:44:29.785366 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:44:29.785366 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:44:29.785366 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:44:29.791467 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:44:29.791467 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:44:29.791467 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:44:29.791467 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:44:29.791467 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:44:29.791467 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a89947bc-0241-4e87-bbbf-2fed45fa4cb6 could not be found. Aug 31 16:44:29.791467 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:44:29.792601 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0603572b-18cd-48a3-a096-77e291091be4 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Returning 404 to user: Instance a89947bc-0241-4e87-bbbf-2fed45fa4cb6 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:44:29.793839 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0603572b-18cd-48a3-a096-77e291091be4 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/a89947bc-0241-4e87-bbbf-2fed45fa4cb6" status: 404 len: 111 microversion: 2.1 time: 0.096928 Aug 31 16:44:29.798901 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3310/6612] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:29 2022] GET /compute/v2.1/servers/a89947bc-0241-4e87-bbbf-2fed45fa4cb6 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:44:29.993212 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d513b22d-62af-48ae-93df-848446e15f92 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:29.993932 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d513b22d-62af-48ae-93df-848446e15f92 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 962444ac-43a3-4c95-94f6-38414daf29c1] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:30.013914 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d513b22d-62af-48ae-93df-848446e15f92 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:30.015222 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d513b22d-62af-48ae-93df-848446e15f92 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:30.015459 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d513b22d-62af-48ae-93df-848446e15f92 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:30.027162 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d513b22d-62af-48ae-93df-848446e15f92 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:30.028182 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d513b22d-62af-48ae-93df-848446e15f92 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:30.028863 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d513b22d-62af-48ae-93df-848446e15f92 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:30.406238 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d513b22d-62af-48ae-93df-848446e15f92 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:44:30.420446 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d513b22d-62af-48ae-93df-848446e15f92 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1" status: 200 len: 1391 microversion: 2.1 time: 0.433315 Aug 31 16:44:30.444327 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3303/6613] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:29 2022] GET /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1 => generated 1391 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:44:31.453055 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d144684f-fa07-49d2-9e6a-06adefb1fc00 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:31.456568 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d144684f-fa07-49d2-9e6a-06adefb1fc00 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 962444ac-43a3-4c95-94f6-38414daf29c1] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:31.485975 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d144684f-fa07-49d2-9e6a-06adefb1fc00 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:31.496898 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d144684f-fa07-49d2-9e6a-06adefb1fc00 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:31.497664 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d144684f-fa07-49d2-9e6a-06adefb1fc00 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:31.503238 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d144684f-fa07-49d2-9e6a-06adefb1fc00 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:31.510076 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d144684f-fa07-49d2-9e6a-06adefb1fc00 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:31.514431 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d144684f-fa07-49d2-9e6a-06adefb1fc00 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:31.845321 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d144684f-fa07-49d2-9e6a-06adefb1fc00 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:44:31.868210 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d144684f-fa07-49d2-9e6a-06adefb1fc00 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1" status: 200 len: 1391 microversion: 2.1 time: 0.418887 Aug 31 16:44:31.884306 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3311/6614] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:31 2022] GET /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1 => generated 1391 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:44:32.845106 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-5393f1c6-d0a9-4c15-b590-b2c3d38c6c6b req-fb52172e-60e0-40dc-8b65-b8a3de97f4b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "962444ac-43a3-4c95-94f6-38414daf29c1", "name": "network-vif-plugged", "status": "completed", "tag": "44cc7e58-7fc0-46b5-a51f-021cf720d9e1"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:44:32.859040 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-5393f1c6-d0a9-4c15-b590-b2c3d38c6c6b req-fb52172e-60e0-40dc-8b65-b8a3de97f4b1 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:32.859662 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-5393f1c6-d0a9-4c15-b590-b2c3d38c6c6b req-fb52172e-60e0-40dc-8b65-b8a3de97f4b1 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:32.860354 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-5393f1c6-d0a9-4c15-b590-b2c3d38c6c6b req-fb52172e-60e0-40dc-8b65-b8a3de97f4b1 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:32.879943 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-5393f1c6-d0a9-4c15-b590-b2c3d38c6c6b req-fb52172e-60e0-40dc-8b65-b8a3de97f4b1 service nova] Creating event network-vif-plugged:44cc7e58-7fc0-46b5-a51f-021cf720d9e1 for instance 962444ac-43a3-4c95-94f6-38414daf29c1 on n-h1-850499-9 Aug 31 16:44:32.888364 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-5393f1c6-d0a9-4c15-b590-b2c3d38c6c6b req-fb52172e-60e0-40dc-8b65-b8a3de97f4b1 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165601 Aug 31 16:44:32.889169 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3304/6615] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:44:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:44:32.894969 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c1cb0d8d-8574-451e-9e96-ff56bbfe5645 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:32.896297 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c1cb0d8d-8574-451e-9e96-ff56bbfe5645 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 962444ac-43a3-4c95-94f6-38414daf29c1] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:32.906822 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=1,nova_api:UPDATE=3 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:44:32.909126 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c1cb0d8d-8574-451e-9e96-ff56bbfe5645 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:32.909880 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c1cb0d8d-8574-451e-9e96-ff56bbfe5645 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:32.910649 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c1cb0d8d-8574-451e-9e96-ff56bbfe5645 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:32.911664 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c1cb0d8d-8574-451e-9e96-ff56bbfe5645 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:32.912731 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c1cb0d8d-8574-451e-9e96-ff56bbfe5645 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:32.913395 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c1cb0d8d-8574-451e-9e96-ff56bbfe5645 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:33.197311 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c1cb0d8d-8574-451e-9e96-ff56bbfe5645 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:44:33.205131 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c1cb0d8d-8574-451e-9e96-ff56bbfe5645 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1" status: 200 len: 1391 microversion: 2.1 time: 0.315455 Aug 31 16:44:33.206065 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3312/6616] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:32 2022] GET /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1 => generated 1391 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:44:34.230919 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f1c32c4b-e6b2-40fd-9e4c-25ab06719dd5 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:34.232291 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f1c32c4b-e6b2-40fd-9e4c-25ab06719dd5 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 962444ac-43a3-4c95-94f6-38414daf29c1] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:34.262505 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f1c32c4b-e6b2-40fd-9e4c-25ab06719dd5 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:34.265452 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f1c32c4b-e6b2-40fd-9e4c-25ab06719dd5 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:34.266118 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f1c32c4b-e6b2-40fd-9e4c-25ab06719dd5 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:34.267532 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f1c32c4b-e6b2-40fd-9e4c-25ab06719dd5 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:34.268184 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f1c32c4b-e6b2-40fd-9e4c-25ab06719dd5 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:34.269547 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f1c32c4b-e6b2-40fd-9e4c-25ab06719dd5 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:34.565825 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f1c32c4b-e6b2-40fd-9e4c-25ab06719dd5 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:44:34.576676 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f1c32c4b-e6b2-40fd-9e4c-25ab06719dd5 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1" status: 200 len: 1391 microversion: 2.1 time: 0.350383 Aug 31 16:44:34.577576 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3305/6617] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:34 2022] GET /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1 => generated 1391 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:44:35.601161 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-63e7b555-58f3-42c2-994b-8df548eb4b02 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:35.601952 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-63e7b555-58f3-42c2-994b-8df548eb4b02 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 962444ac-43a3-4c95-94f6-38414daf29c1] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:35.620384 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-63e7b555-58f3-42c2-994b-8df548eb4b02 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:35.633746 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-63e7b555-58f3-42c2-994b-8df548eb4b02 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:35.637354 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-63e7b555-58f3-42c2-994b-8df548eb4b02 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:35.638563 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-63e7b555-58f3-42c2-994b-8df548eb4b02 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:35.647177 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-63e7b555-58f3-42c2-994b-8df548eb4b02 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:35.649464 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-63e7b555-58f3-42c2-994b-8df548eb4b02 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:36.016099 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-63e7b555-58f3-42c2-994b-8df548eb4b02 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:44:36.043942 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-63e7b555-58f3-42c2-994b-8df548eb4b02 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1" status: 200 len: 1563 microversion: 2.1 time: 0.446018 Aug 31 16:44:36.044715 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3313/6618] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:35 2022] GET /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1 => generated 1563 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:44:36.069826 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b32fb11e-00cb-4406-bbdf-d8fd76ab5377 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:36.072237 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b32fb11e-00cb-4406-bbdf-d8fd76ab5377 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 962444ac-43a3-4c95-94f6-38414daf29c1] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:36.098714 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b32fb11e-00cb-4406-bbdf-d8fd76ab5377 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:36.099075 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b32fb11e-00cb-4406-bbdf-d8fd76ab5377 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:36.105930 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b32fb11e-00cb-4406-bbdf-d8fd76ab5377 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:36.115916 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b32fb11e-00cb-4406-bbdf-d8fd76ab5377 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:36.116420 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b32fb11e-00cb-4406-bbdf-d8fd76ab5377 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:36.116874 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b32fb11e-00cb-4406-bbdf-d8fd76ab5377 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:36.327699 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b32fb11e-00cb-4406-bbdf-d8fd76ab5377 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:44:36.338388 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b32fb11e-00cb-4406-bbdf-d8fd76ab5377 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1" status: 200 len: 1563 microversion: 2.1 time: 0.270359 Aug 31 16:44:36.344110 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3306/6619] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:36 2022] GET /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1 => generated 1563 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:44:38.183817 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-04e8822b-a561-4b8a-bcf2-c0df9244d91a tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:38.185054 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-04e8822b-a561-4b8a-bcf2-c0df9244d91a tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] [instance: 19ff8623-9d5a-4ed4-97a3-b2a581ebc311] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:38.193558 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-04e8822b-a561-4b8a-bcf2-c0df9244d91a tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:38.194479 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-04e8822b-a561-4b8a-bcf2-c0df9244d91a tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:38.195258 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-04e8822b-a561-4b8a-bcf2-c0df9244d91a tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:38.196435 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-04e8822b-a561-4b8a-bcf2-c0df9244d91a tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:38.197172 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-04e8822b-a561-4b8a-bcf2-c0df9244d91a tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:38.197842 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-04e8822b-a561-4b8a-bcf2-c0df9244d91a tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:38.347919 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-04e8822b-a561-4b8a-bcf2-c0df9244d91a tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lazy-loading 'services' on Instance uuid 19ff8623-9d5a-4ed4-97a3-b2a581ebc311 {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:44:38.454405 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-04e8822b-a561-4b8a-bcf2-c0df9244d91a tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] 10.222.0.61 "DELETE /compute/v2.1/servers/19ff8623-9d5a-4ed4-97a3-b2a581ebc311/os-volume_attachments/804b210a-20c3-4ff5-b1a8-cac5d8c62982" status: 202 len: 0 microversion: 2.1 time: 0.276043 Aug 31 16:44:38.456031 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3314/6620] 10.222.0.61 () {58 vars in 1416 bytes} [Wed Aug 31 16:44:38 2022] DELETE /compute/v2.1/servers/19ff8623-9d5a-4ed4-97a3-b2a581ebc311/os-volume_attachments/804b210a-20c3-4ff5-b1a8-cac5d8c62982 => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:44:38.886798 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7faa8a17-5d89-4243-b484-f09d06b4664d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:38.893383 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-34045c33-f70e-40ae-9f24-ae7fbf90bdac req-6e8678ee-1c2d-47fb-a5a5-0dacb3eb1e5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "962444ac-43a3-4c95-94f6-38414daf29c1", "tag": "44cc7e58-7fc0-46b5-a51f-021cf720d9e1"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:44:38.898621 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7faa8a17-5d89-4243-b484-f09d06b4664d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 962444ac-43a3-4c95-94f6-38414daf29c1] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:38.910550 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7faa8a17-5d89-4243-b484-f09d06b4664d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:38.911324 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7faa8a17-5d89-4243-b484-f09d06b4664d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:38.913490 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-34045c33-f70e-40ae-9f24-ae7fbf90bdac req-6e8678ee-1c2d-47fb-a5a5-0dacb3eb1e5a service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:38.914518 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-34045c33-f70e-40ae-9f24-ae7fbf90bdac req-6e8678ee-1c2d-47fb-a5a5-0dacb3eb1e5a service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:38.915686 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-34045c33-f70e-40ae-9f24-ae7fbf90bdac req-6e8678ee-1c2d-47fb-a5a5-0dacb3eb1e5a service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:38.920298 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7faa8a17-5d89-4243-b484-f09d06b4664d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:38.921326 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7faa8a17-5d89-4243-b484-f09d06b4664d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:38.921990 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7faa8a17-5d89-4243-b484-f09d06b4664d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:38.922610 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7faa8a17-5d89-4243-b484-f09d06b4664d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:38.948620 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-34045c33-f70e-40ae-9f24-ae7fbf90bdac req-6e8678ee-1c2d-47fb-a5a5-0dacb3eb1e5a service nova] Creating event network-changed:44cc7e58-7fc0-46b5-a51f-021cf720d9e1 for instance 962444ac-43a3-4c95-94f6-38414daf29c1 on n-h1-850499-9 Aug 31 16:44:38.961640 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-34045c33-f70e-40ae-9f24-ae7fbf90bdac req-6e8678ee-1c2d-47fb-a5a5-0dacb3eb1e5a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072147 Aug 31 16:44:38.962637 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3315/6621] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:44:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:44:39.190324 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7faa8a17-5d89-4243-b484-f09d06b4664d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:44:39.203810 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7faa8a17-5d89-4243-b484-f09d06b4664d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1" status: 200 len: 1563 microversion: 2.1 time: 0.320680 Aug 31 16:44:39.204685 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3307/6622] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:38 2022] GET /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1 => generated 1563 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:44:43.952853 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c9a68225-5bb9-48e9-9375-2abe76165fed tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:43.953728 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c9a68225-5bb9-48e9-9375-2abe76165fed tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] [instance: 19ff8623-9d5a-4ed4-97a3-b2a581ebc311] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:43.961093 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c9a68225-5bb9-48e9-9375-2abe76165fed tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:43.961913 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c9a68225-5bb9-48e9-9375-2abe76165fed tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:43.962358 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c9a68225-5bb9-48e9-9375-2abe76165fed tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:43.963077 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c9a68225-5bb9-48e9-9375-2abe76165fed tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:43.963557 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c9a68225-5bb9-48e9-9375-2abe76165fed tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:43.964260 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c9a68225-5bb9-48e9-9375-2abe76165fed tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:43.995165 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c9a68225-5bb9-48e9-9375-2abe76165fed tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] [instance: 19ff8623-9d5a-4ed4-97a3-b2a581ebc311] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:44:44.098606 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c9a68225-5bb9-48e9-9375-2abe76165fed tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] 10.222.0.61 "DELETE /compute/v2.1/servers/19ff8623-9d5a-4ed4-97a3-b2a581ebc311" status: 204 len: 0 microversion: 2.1 time: 0.149261 Aug 31 16:44:44.102237 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3316/6623] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:44:43 2022] DELETE /compute/v2.1/servers/19ff8623-9d5a-4ed4-97a3-b2a581ebc311 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:44:44.113858 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8b0a27a4-db70-439b-846d-4d4ac922efc7 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:44.116217 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8b0a27a4-db70-439b-846d-4d4ac922efc7 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] [instance: 19ff8623-9d5a-4ed4-97a3-b2a581ebc311] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:44.127339 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8b0a27a4-db70-439b-846d-4d4ac922efc7 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:44.127997 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8b0a27a4-db70-439b-846d-4d4ac922efc7 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:44.129763 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8b0a27a4-db70-439b-846d-4d4ac922efc7 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:44.130668 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8b0a27a4-db70-439b-846d-4d4ac922efc7 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:44.131218 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8b0a27a4-db70-439b-846d-4d4ac922efc7 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:44.131969 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8b0a27a4-db70-439b-846d-4d4ac922efc7 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:44.322128 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8b0a27a4-db70-439b-846d-4d4ac922efc7 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab56c16d1354864850f8f2e8339b50d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41821cff003462bb6734854b0116d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:44:44.331468 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8b0a27a4-db70-439b-846d-4d4ac922efc7 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] 10.222.0.61 "GET /compute/v2.1/servers/19ff8623-9d5a-4ed4-97a3-b2a581ebc311" status: 200 len: 1513 microversion: 2.1 time: 0.224274 Aug 31 16:44:44.332480 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3308/6624] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:44 2022] GET /compute/v2.1/servers/19ff8623-9d5a-4ed4-97a3-b2a581ebc311 => generated 1513 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:44:45.355606 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2bfbe6b6-b9cb-4766-9bf9-4697ffc39ccd tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:45.356240 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2bfbe6b6-b9cb-4766-9bf9-4697ffc39ccd tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] [instance: 19ff8623-9d5a-4ed4-97a3-b2a581ebc311] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:45.363987 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2bfbe6b6-b9cb-4766-9bf9-4697ffc39ccd tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:45.364958 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2bfbe6b6-b9cb-4766-9bf9-4697ffc39ccd tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:45.365625 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2bfbe6b6-b9cb-4766-9bf9-4697ffc39ccd tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:45.366369 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2bfbe6b6-b9cb-4766-9bf9-4697ffc39ccd tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:45.366831 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2bfbe6b6-b9cb-4766-9bf9-4697ffc39ccd tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:45.368022 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2bfbe6b6-b9cb-4766-9bf9-4697ffc39ccd tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:45.530850 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2bfbe6b6-b9cb-4766-9bf9-4697ffc39ccd tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab56c16d1354864850f8f2e8339b50d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41821cff003462bb6734854b0116d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:44:45.539549 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2bfbe6b6-b9cb-4766-9bf9-4697ffc39ccd tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] 10.222.0.61 "GET /compute/v2.1/servers/19ff8623-9d5a-4ed4-97a3-b2a581ebc311" status: 200 len: 1513 microversion: 2.1 time: 0.188611 Aug 31 16:44:45.541060 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3317/6625] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:45 2022] GET /compute/v2.1/servers/19ff8623-9d5a-4ed4-97a3-b2a581ebc311 => generated 1513 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:44:46.574032 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2dec4d13-c853-45ec-8e67-cfe006a5afa1 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:46.574723 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2dec4d13-c853-45ec-8e67-cfe006a5afa1 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] [instance: 19ff8623-9d5a-4ed4-97a3-b2a581ebc311] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:46.587831 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2dec4d13-c853-45ec-8e67-cfe006a5afa1 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:46.588692 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2dec4d13-c853-45ec-8e67-cfe006a5afa1 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:46.589542 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2dec4d13-c853-45ec-8e67-cfe006a5afa1 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:46.590717 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2dec4d13-c853-45ec-8e67-cfe006a5afa1 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:46.591605 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2dec4d13-c853-45ec-8e67-cfe006a5afa1 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:46.592325 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2dec4d13-c853-45ec-8e67-cfe006a5afa1 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:46.829546 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-2dec4d13-c853-45ec-8e67-cfe006a5afa1 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab56c16d1354864850f8f2e8339b50d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41821cff003462bb6734854b0116d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:44:46.833459 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=100 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:44:46.840425 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2dec4d13-c853-45ec-8e67-cfe006a5afa1 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] 10.222.0.61 "GET /compute/v2.1/servers/19ff8623-9d5a-4ed4-97a3-b2a581ebc311" status: 200 len: 1513 microversion: 2.1 time: 0.275590 Aug 31 16:44:46.841090 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3309/6626] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:46 2022] GET /compute/v2.1/servers/19ff8623-9d5a-4ed4-97a3-b2a581ebc311 => generated 1513 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:44:47.097648 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-ecc92fae-04be-483a-bb68-41d0f7ec055b req-20b20c24-81d8-4960-b5e9-c6207d1deb2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19ff8623-9d5a-4ed4-97a3-b2a581ebc311", "name": "network-vif-deleted", "tag": "d1cbae75-4e96-419f-b749-a514a1724ecc"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:44:47.111033 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-ecc92fae-04be-483a-bb68-41d0f7ec055b req-20b20c24-81d8-4960-b5e9-c6207d1deb2c service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:47.111553 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-ecc92fae-04be-483a-bb68-41d0f7ec055b req-20b20c24-81d8-4960-b5e9-c6207d1deb2c service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:47.112000 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-ecc92fae-04be-483a-bb68-41d0f7ec055b req-20b20c24-81d8-4960-b5e9-c6207d1deb2c service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:47.128334 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-ecc92fae-04be-483a-bb68-41d0f7ec055b req-20b20c24-81d8-4960-b5e9-c6207d1deb2c service nova] Creating event network-vif-deleted:d1cbae75-4e96-419f-b749-a514a1724ecc for instance 19ff8623-9d5a-4ed4-97a3-b2a581ebc311 on n-h2-850499-9 Aug 31 16:44:47.134153 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-ecc92fae-04be-483a-bb68-41d0f7ec055b req-20b20c24-81d8-4960-b5e9-c6207d1deb2c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040442 Aug 31 16:44:47.136131 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3318/6627] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:44:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:44:47.865235 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d1903a25-8c6e-40e0-9506-a8fbccf9e397 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:47.865912 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d1903a25-8c6e-40e0-9506-a8fbccf9e397 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] [instance: 19ff8623-9d5a-4ed4-97a3-b2a581ebc311] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:47.874229 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d1903a25-8c6e-40e0-9506-a8fbccf9e397 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:47.875318 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d1903a25-8c6e-40e0-9506-a8fbccf9e397 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:47.876173 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d1903a25-8c6e-40e0-9506-a8fbccf9e397 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:47.877289 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d1903a25-8c6e-40e0-9506-a8fbccf9e397 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:47.877825 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d1903a25-8c6e-40e0-9506-a8fbccf9e397 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:47.878419 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d1903a25-8c6e-40e0-9506-a8fbccf9e397 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:47.896591 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-d1903a25-8c6e-40e0-9506-a8fbccf9e397 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] HTTP exception thrown: Instance 19ff8623-9d5a-4ed4-97a3-b2a581ebc311 could not be found. Aug 31 16:44:47.898245 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d1903a25-8c6e-40e0-9506-a8fbccf9e397 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Request method failure captured: Aug 31 16:44:47.898245 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/19ff8623-9d5a-4ed4-97a3-b2a581ebc311 HTTP/1.1 Aug 31 16:44:47.898245 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:44:47.898245 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:44:47.898245 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:44:47.898245 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:44:47.898245 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:44:47.898245 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:44:47.898245 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:44:47.898245 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:44:47.898245 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD48z2KyC3QnU7_XcODIP0_9SzDfHpcAkWboVstp-nkYao1s7d-o5_7LUMP-skj64ClhAe7rFAAxZ9zJ3ExpA4rTvzTYvo2gWXWwAdLFtPDzxxUQPF5QrTof7T9S03ngtvvSYZD_ZygI7raj21-kdlXEdJQSAjnzGriP_oRw36z-rwgU Aug 31 16:44:47.898245 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:44:47.898245 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:44:47.898245 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:44:47.898245 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:44:47.898245 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:44:47.898245 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:44:47.898245 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: c41821cff003462bb6734854b0116d71 Aug 31 16:44:47.898245 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-VolumesSnapshotTestJSON-988799959 Aug 31 16:44:47.898245 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:44:47.898245 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:44:47.898245 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c41821cff003462bb6734854b0116d71"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/c41821cff003462bb6734854b0116d71"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_c41821cff003462bb6734854b0116d71", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c41821cff003462bb6734854b0116d71"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:44:47.898245 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-VolumesSnapshotTestJSON-988799959 Aug 31 16:44:47.898245 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: c41821cff003462bb6734854b0116d71 Aug 31 16:44:47.898245 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-988799959 Aug 31 16:44:47.898245 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-VolumesSnapshotTestJSON-988799959-project Aug 31 16:44:47.898245 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:44:47.898245 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:44:47.898245 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: aab56c16d1354864850f8f2e8339b50d Aug 31 16:44:47.898245 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-VolumesSnapshotTestJSON-988799959-project Aug 31 16:44:47.898245 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:44:47.898245 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance 19ff8623-9d5a-4ed4-97a3-b2a581ebc311 could not be found. Aug 31 16:44:47.898245 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '19ff8623-9d5a-4ed4-97a3-b2a581ebc311'} Aug 31 16:44:47.898245 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:44:47.898245 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:44:47.898245 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:44:47.898245 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:44:47.898245 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:44:47.898245 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:44:47.898245 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:44:47.898245 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:44:47.898245 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:44:47.898245 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:44:47.898245 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19ff8623-9d5a-4ed4-97a3-b2a581ebc311 could not be found. Aug 31 16:44:47.898245 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:44:47.898245 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:44:47.898245 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:44:47.898245 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:44:47.898245 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:44:47.898245 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:44:47.898245 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:44:47.898245 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:44:47.898245 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:44:47.898245 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:44:47.898245 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:44:47.898245 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:44:47.898245 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:44:47.898245 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:44:47.898245 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:44:47.898245 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:44:47.898245 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19ff8623-9d5a-4ed4-97a3-b2a581ebc311 could not be found. Aug 31 16:44:47.898245 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:44:47.898245 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:44:47.898245 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:44:47.906458 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:44:47.906458 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:44:47.906458 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:44:47.906458 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:44:47.906458 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:44:47.906458 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19ff8623-9d5a-4ed4-97a3-b2a581ebc311 could not be found. Aug 31 16:44:47.906458 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:44:47.906458 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d1903a25-8c6e-40e0-9506-a8fbccf9e397 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Returning 404 to user: Instance 19ff8623-9d5a-4ed4-97a3-b2a581ebc311 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:44:47.906458 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d1903a25-8c6e-40e0-9506-a8fbccf9e397 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] 10.222.0.61 "GET /compute/v2.1/servers/19ff8623-9d5a-4ed4-97a3-b2a581ebc311" status: 404 len: 111 microversion: 2.1 time: 0.040929 Aug 31 16:44:47.906458 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3310/6628] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:47 2022] GET /compute/v2.1/servers/19ff8623-9d5a-4ed4-97a3-b2a581ebc311 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:44:53.825896 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-89bcaeb7-fb74-4a84-98b9-69a353b34294 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:44:53.828278 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-89bcaeb7-fb74-4a84-98b9-69a353b34294 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] [instance: 8a4079ad-b084-41c9-af05-7e1d9c1a6616] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:53.836743 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-89bcaeb7-fb74-4a84-98b9-69a353b34294 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:53.838424 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-89bcaeb7-fb74-4a84-98b9-69a353b34294 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:53.838424 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-89bcaeb7-fb74-4a84-98b9-69a353b34294 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:53.839703 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-89bcaeb7-fb74-4a84-98b9-69a353b34294 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:53.839703 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-89bcaeb7-fb74-4a84-98b9-69a353b34294 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:53.840554 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-89bcaeb7-fb74-4a84-98b9-69a353b34294 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:53.921957 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-89bcaeb7-fb74-4a84-98b9-69a353b34294 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] 10.222.0.61 "POST /compute/v2.1/servers/8a4079ad-b084-41c9-af05-7e1d9c1a6616/action" status: 200 len: 32639 microversion: 2.1 time: 0.102116 Aug 31 16:44:53.929555 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3319/6629] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:44:53 2022] POST /compute/v2.1/servers/8a4079ad-b084-41c9-af05-7e1d9c1a6616/action => generated 32639 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 16:44:54.917334 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1d3ae244-9364-41d5-a860-b931ac715acb tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1389290228", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "networks": [{"uuid": "3efb98ee-702a-44d4-b132-2e073fd94caa"}]}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:44:54.980054 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-1d3ae244-9364-41d5-a860-b931ac715acb tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] validate_networks() for [('3efb98ee-702a-44d4-b132-2e073fd94caa', None, None, None, None, None)] {{(pid=122256) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:44:55.568730 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7f6eef9a-4104-4e6f-a3e5-4a99b8bce25b tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:55.569399 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7f6eef9a-4104-4e6f-a3e5-4a99b8bce25b tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] [instance: 8a4079ad-b084-41c9-af05-7e1d9c1a6616] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:55.580871 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7f6eef9a-4104-4e6f-a3e5-4a99b8bce25b tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:55.581736 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7f6eef9a-4104-4e6f-a3e5-4a99b8bce25b tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:55.583841 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7f6eef9a-4104-4e6f-a3e5-4a99b8bce25b tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:55.587994 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7f6eef9a-4104-4e6f-a3e5-4a99b8bce25b tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:55.589572 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7f6eef9a-4104-4e6f-a3e5-4a99b8bce25b tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:55.590100 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7f6eef9a-4104-4e6f-a3e5-4a99b8bce25b tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:55.630991 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7f6eef9a-4104-4e6f-a3e5-4a99b8bce25b tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] [instance: 8a4079ad-b084-41c9-af05-7e1d9c1a6616] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:44:55.752762 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7f6eef9a-4104-4e6f-a3e5-4a99b8bce25b tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] 10.222.0.61 "DELETE /compute/v2.1/servers/8a4079ad-b084-41c9-af05-7e1d9c1a6616" status: 204 len: 0 microversion: 2.1 time: 0.189875 Aug 31 16:44:55.753445 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3320/6630] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:44:55 2022] DELETE /compute/v2.1/servers/8a4079ad-b084-41c9-af05-7e1d9c1a6616 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:44:55.760323 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-7076f5d4-ec8c-4e95-af25-8f9d11a71cff req-4f7759e3-190e-49d2-903c-877800dad1c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a4079ad-b084-41c9-af05-7e1d9c1a6616", "tag": "d29323fd-2f20-4dbd-955c-b1c62b01a8e6"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:44:55.770692 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-7076f5d4-ec8c-4e95-af25-8f9d11a71cff req-4f7759e3-190e-49d2-903c-877800dad1c5 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:55.771193 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-7076f5d4-ec8c-4e95-af25-8f9d11a71cff req-4f7759e3-190e-49d2-903c-877800dad1c5 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:55.771667 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-7076f5d4-ec8c-4e95-af25-8f9d11a71cff req-4f7759e3-190e-49d2-903c-877800dad1c5 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:55.785642 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-7076f5d4-ec8c-4e95-af25-8f9d11a71cff req-4f7759e3-190e-49d2-903c-877800dad1c5 service nova] Creating event network-changed:d29323fd-2f20-4dbd-955c-b1c62b01a8e6 for instance 8a4079ad-b084-41c9-af05-7e1d9c1a6616 on n-h1-850499-9 Aug 31 16:44:55.791688 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-7076f5d4-ec8c-4e95-af25-8f9d11a71cff req-4f7759e3-190e-49d2-903c-877800dad1c5 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036536 Aug 31 16:44:55.792351 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3321/6631] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:44:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:44:55.797965 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c0206d8c-7d73-4ec4-a185-d4c3cfd73643 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:55.798686 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c0206d8c-7d73-4ec4-a185-d4c3cfd73643 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] [instance: 8a4079ad-b084-41c9-af05-7e1d9c1a6616] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:55.806233 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c0206d8c-7d73-4ec4-a185-d4c3cfd73643 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:55.806877 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c0206d8c-7d73-4ec4-a185-d4c3cfd73643 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:55.807329 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c0206d8c-7d73-4ec4-a185-d4c3cfd73643 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:55.808224 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c0206d8c-7d73-4ec4-a185-d4c3cfd73643 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:55.808709 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c0206d8c-7d73-4ec4-a185-d4c3cfd73643 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:55.809132 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c0206d8c-7d73-4ec4-a185-d4c3cfd73643 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:55.956814 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-1d3ae244-9364-41d5-a860-b931ac715acb tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:44:55.957776 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-1d3ae244-9364-41d5-a860-b931ac715acb tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:44:55.958413 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-1d3ae244-9364-41d5-a860-b931ac715acb tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:44:55.959341 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-1d3ae244-9364-41d5-a860-b931ac715acb tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:44:55.959972 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-1d3ae244-9364-41d5-a860-b931ac715acb tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:44:55.965415 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=26 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:44:55.973108 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1d3ae244-9364-41d5-a860-b931ac715acb tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:55.973796 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1d3ae244-9364-41d5-a860-b931ac715acb tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:55.974792 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1d3ae244-9364-41d5-a860-b931ac715acb tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:55.975739 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1d3ae244-9364-41d5-a860-b931ac715acb tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:55.976389 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1d3ae244-9364-41d5-a860-b931ac715acb tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:55.977835 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1d3ae244-9364-41d5-a860-b931ac715acb tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:55.998306 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-1d3ae244-9364-41d5-a860-b931ac715acb tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Getting quotas for project c41821cff003462bb6734854b0116d71. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:44:56.011432 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-1d3ae244-9364-41d5-a860-b931ac715acb tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Getting quotas for user aab56c16d1354864850f8f2e8339b50d and project c41821cff003462bb6734854b0116d71. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:44:56.027667 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1d3ae244-9364-41d5-a860-b931ac715acb tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Going to run 1 instances... {{(pid=122256) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:44:56.030521 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1d3ae244-9364-41d5-a860-b931ac715acb tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] [instance: a4dcf873-c5d9-4e9d-90d3-671d3c5a553b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:44:56.065655 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c0206d8c-7d73-4ec4-a185-d4c3cfd73643 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e026a8cdb13f47de942566a2d4a10bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5827544f2e140e3b44d712d1623a06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:44:56.078811 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c0206d8c-7d73-4ec4-a185-d4c3cfd73643 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] 10.222.0.61 "GET /compute/v2.1/servers/8a4079ad-b084-41c9-af05-7e1d9c1a6616" status: 200 len: 1671 microversion: 2.1 time: 0.284987 Aug 31 16:44:56.081587 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3322/6632] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:55 2022] GET /compute/v2.1/servers/8a4079ad-b084-41c9-af05-7e1d9c1a6616 => generated 1671 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:44:56.085882 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1d3ae244-9364-41d5-a860-b931ac715acb tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.173007 Aug 31 16:44:56.087203 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3311/6633] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:44:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1175 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:44:56.111737 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-72552b28-82d9-470a-a56f-d1650b43c27f tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:56.112371 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-72552b28-82d9-470a-a56f-d1650b43c27f tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] [instance: a4dcf873-c5d9-4e9d-90d3-671d3c5a553b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:56.146010 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2e15fd98-f1ae-4251-a3f1-10d1516671ff tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1157296944", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "e259e878-9b32-42de-99f9-26a08af2e67e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "0b707539-6131-412e-ba43-5bdd2cb0fbe5"}]}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:44:56.200066 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-72552b28-82d9-470a-a56f-d1650b43c27f tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab56c16d1354864850f8f2e8339b50d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41821cff003462bb6734854b0116d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:44:56.208922 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-72552b28-82d9-470a-a56f-d1650b43c27f tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] 10.222.0.61 "GET /compute/v2.1/servers/a4dcf873-c5d9-4e9d-90d3-671d3c5a553b" status: 200 len: 1219 microversion: 2.1 time: 0.109630 Aug 31 16:44:56.223264 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-2e15fd98-f1ae-4251-a3f1-10d1516671ff tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] validate_networks() for [('0b707539-6131-412e-ba43-5bdd2cb0fbe5', None, None, None, None, None)] {{(pid=122256) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:44:56.223717 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3323/6634] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:56 2022] GET /compute/v2.1/servers/a4dcf873-c5d9-4e9d-90d3-671d3c5a553b => generated 1219 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:44:56.686150 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-2e15fd98-f1ae-4251-a3f1-10d1516671ff tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:44:56.686661 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-2e15fd98-f1ae-4251-a3f1-10d1516671ff tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:44:56.690671 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-2e15fd98-f1ae-4251-a3f1-10d1516671ff tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:44:56.691090 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-2e15fd98-f1ae-4251-a3f1-10d1516671ff tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:44:56.691524 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-2e15fd98-f1ae-4251-a3f1-10d1516671ff tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:44:56.703200 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2e15fd98-f1ae-4251-a3f1-10d1516671ff tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:56.703772 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2e15fd98-f1ae-4251-a3f1-10d1516671ff tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:56.704539 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2e15fd98-f1ae-4251-a3f1-10d1516671ff tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:56.705371 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2e15fd98-f1ae-4251-a3f1-10d1516671ff tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:56.705977 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2e15fd98-f1ae-4251-a3f1-10d1516671ff tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:56.706642 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2e15fd98-f1ae-4251-a3f1-10d1516671ff tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:56.728017 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-2e15fd98-f1ae-4251-a3f1-10d1516671ff tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Getting quotas for project 798d7eff58b04ab582bac1e87112625f. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:44:56.734066 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-2e15fd98-f1ae-4251-a3f1-10d1516671ff tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Getting quotas for user 588d2ef08d8345a6b6175c8287633270 and project 798d7eff58b04ab582bac1e87112625f. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:44:56.810431 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2e15fd98-f1ae-4251-a3f1-10d1516671ff tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Going to run 1 instances... {{(pid=122256) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:44:56.812769 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2e15fd98-f1ae-4251-a3f1-10d1516671ff tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 15ac4673-682b-4707-a9d9-da02c4e37879] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e259e878-9b32-42de-99f9-26a08af2e67e',volume_size=None,volume_type=None)] {{(pid=122256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:44:57.011621 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2e15fd98-f1ae-4251-a3f1-10d1516671ff tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.869401 Aug 31 16:44:57.012533 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3312/6635] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:44:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 871 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 16:44:57.024767 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9a8233df-6d96-467f-b937-a8d4cd74afe6 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:57.025572 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9a8233df-6d96-467f-b937-a8d4cd74afe6 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 15ac4673-682b-4707-a9d9-da02c4e37879] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:57.116589 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-47f834c6-516c-4e86-9685-f0505ea39788 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:57.117554 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-47f834c6-516c-4e86-9685-f0505ea39788 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] [instance: 8a4079ad-b084-41c9-af05-7e1d9c1a6616] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:57.126349 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-47f834c6-516c-4e86-9685-f0505ea39788 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:57.127361 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-47f834c6-516c-4e86-9685-f0505ea39788 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:57.129678 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-47f834c6-516c-4e86-9685-f0505ea39788 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:57.131001 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-47f834c6-516c-4e86-9685-f0505ea39788 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:57.131914 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-47f834c6-516c-4e86-9685-f0505ea39788 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:57.132600 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-47f834c6-516c-4e86-9685-f0505ea39788 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:57.156228 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9a8233df-6d96-467f-b937-a8d4cd74afe6 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:44:57.174470 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9a8233df-6d96-467f-b937-a8d4cd74afe6 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/15ac4673-682b-4707-a9d9-da02c4e37879" status: 200 len: 1071 microversion: 2.1 time: 0.154994 Aug 31 16:44:57.175102 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3324/6636] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:57 2022] GET /compute/v2.1/servers/15ac4673-682b-4707-a9d9-da02c4e37879 => generated 1071 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:44:57.231903 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b78bf247-630a-47b3-95cb-a86bfa46ad77 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:57.232712 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b78bf247-630a-47b3-95cb-a86bfa46ad77 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] [instance: a4dcf873-c5d9-4e9d-90d3-671d3c5a553b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:57.239988 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b78bf247-630a-47b3-95cb-a86bfa46ad77 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:57.240849 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b78bf247-630a-47b3-95cb-a86bfa46ad77 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:57.241578 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b78bf247-630a-47b3-95cb-a86bfa46ad77 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:57.243815 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b78bf247-630a-47b3-95cb-a86bfa46ad77 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:57.244585 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b78bf247-630a-47b3-95cb-a86bfa46ad77 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:57.245246 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b78bf247-630a-47b3-95cb-a86bfa46ad77 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:57.251133 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:44:57.353881 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b78bf247-630a-47b3-95cb-a86bfa46ad77 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab56c16d1354864850f8f2e8339b50d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41821cff003462bb6734854b0116d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:44:57.371018 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b78bf247-630a-47b3-95cb-a86bfa46ad77 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] 10.222.0.61 "GET /compute/v2.1/servers/a4dcf873-c5d9-4e9d-90d3-671d3c5a553b" status: 200 len: 1271 microversion: 2.1 time: 0.144013 Aug 31 16:44:57.371664 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3325/6637] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:57 2022] GET /compute/v2.1/servers/a4dcf873-c5d9-4e9d-90d3-671d3c5a553b => generated 1271 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:44:57.401233 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-47f834c6-516c-4e86-9685-f0505ea39788 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e026a8cdb13f47de942566a2d4a10bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5827544f2e140e3b44d712d1623a06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:44:57.422992 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-47f834c6-516c-4e86-9685-f0505ea39788 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] 10.222.0.61 "GET /compute/v2.1/servers/8a4079ad-b084-41c9-af05-7e1d9c1a6616" status: 200 len: 1671 microversion: 2.1 time: 0.310664 Aug 31 16:44:57.423645 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3313/6638] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:57 2022] GET /compute/v2.1/servers/8a4079ad-b084-41c9-af05-7e1d9c1a6616 => generated 1671 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:44:58.198276 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-967cffdd-b946-47f4-9c83-d5e76e5fabae tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:58.199261 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-967cffdd-b946-47f4-9c83-d5e76e5fabae tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 15ac4673-682b-4707-a9d9-da02c4e37879] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:58.210021 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-967cffdd-b946-47f4-9c83-d5e76e5fabae tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:58.210713 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-967cffdd-b946-47f4-9c83-d5e76e5fabae tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:58.212027 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-967cffdd-b946-47f4-9c83-d5e76e5fabae tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:58.212944 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-967cffdd-b946-47f4-9c83-d5e76e5fabae tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:58.213421 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-967cffdd-b946-47f4-9c83-d5e76e5fabae tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:58.213868 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-967cffdd-b946-47f4-9c83-d5e76e5fabae tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:58.298079 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-e77f237e-8ea6-4b02-a5a6-2535b1e746a4 req-4bce0e7c-6f2a-494f-a6f1-099e1fc7b73b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a4079ad-b084-41c9-af05-7e1d9c1a6616", "name": "network-vif-deleted", "tag": "d29323fd-2f20-4dbd-955c-b1c62b01a8e6"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:44:58.312745 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-e77f237e-8ea6-4b02-a5a6-2535b1e746a4 req-4bce0e7c-6f2a-494f-a6f1-099e1fc7b73b service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:58.313171 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-e77f237e-8ea6-4b02-a5a6-2535b1e746a4 req-4bce0e7c-6f2a-494f-a6f1-099e1fc7b73b service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:58.313660 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-e77f237e-8ea6-4b02-a5a6-2535b1e746a4 req-4bce0e7c-6f2a-494f-a6f1-099e1fc7b73b service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:58.330401 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-967cffdd-b946-47f4-9c83-d5e76e5fabae tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:44:58.331153 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-e77f237e-8ea6-4b02-a5a6-2535b1e746a4 req-4bce0e7c-6f2a-494f-a6f1-099e1fc7b73b service nova] Creating event network-vif-deleted:d29323fd-2f20-4dbd-955c-b1c62b01a8e6 for instance 8a4079ad-b084-41c9-af05-7e1d9c1a6616 on n-h1-850499-9 Aug 31 16:44:58.343487 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-967cffdd-b946-47f4-9c83-d5e76e5fabae tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/15ac4673-682b-4707-a9d9-da02c4e37879" status: 200 len: 1169 microversion: 2.1 time: 0.151129 Aug 31 16:44:58.346772 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3326/6639] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:58 2022] GET /compute/v2.1/servers/15ac4673-682b-4707-a9d9-da02c4e37879 => generated 1169 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:44:58.346963 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-e77f237e-8ea6-4b02-a5a6-2535b1e746a4 req-4bce0e7c-6f2a-494f-a6f1-099e1fc7b73b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053072 Aug 31 16:44:58.346963 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3314/6640] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:44:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:44:58.400654 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1886d2f0-5acc-4ce7-b415-9787a54bf5ce tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:58.401428 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1886d2f0-5acc-4ce7-b415-9787a54bf5ce tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] [instance: a4dcf873-c5d9-4e9d-90d3-671d3c5a553b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:58.408471 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1886d2f0-5acc-4ce7-b415-9787a54bf5ce tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:58.408971 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1886d2f0-5acc-4ce7-b415-9787a54bf5ce tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:58.409407 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1886d2f0-5acc-4ce7-b415-9787a54bf5ce tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:58.410124 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1886d2f0-5acc-4ce7-b415-9787a54bf5ce tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:58.410575 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1886d2f0-5acc-4ce7-b415-9787a54bf5ce tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:58.411001 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1886d2f0-5acc-4ce7-b415-9787a54bf5ce tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:58.474587 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-59c856eb-74a0-40f6-b666-0fe78bfbd941 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:58.475602 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-59c856eb-74a0-40f6-b666-0fe78bfbd941 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] [instance: 8a4079ad-b084-41c9-af05-7e1d9c1a6616] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:58.483419 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-59c856eb-74a0-40f6-b666-0fe78bfbd941 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:58.483958 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-59c856eb-74a0-40f6-b666-0fe78bfbd941 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:58.484612 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-59c856eb-74a0-40f6-b666-0fe78bfbd941 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:58.485334 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-59c856eb-74a0-40f6-b666-0fe78bfbd941 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:58.485799 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-59c856eb-74a0-40f6-b666-0fe78bfbd941 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:58.486489 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-59c856eb-74a0-40f6-b666-0fe78bfbd941 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:58.506465 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-1886d2f0-5acc-4ce7-b415-9787a54bf5ce tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab56c16d1354864850f8f2e8339b50d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41821cff003462bb6734854b0116d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:44:58.520680 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1886d2f0-5acc-4ce7-b415-9787a54bf5ce tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] 10.222.0.61 "GET /compute/v2.1/servers/a4dcf873-c5d9-4e9d-90d3-671d3c5a553b" status: 200 len: 1277 microversion: 2.1 time: 0.124840 Aug 31 16:44:58.521279 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3327/6641] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:58 2022] GET /compute/v2.1/servers/a4dcf873-c5d9-4e9d-90d3-671d3c5a553b => generated 1277 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:44:58.534514 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-59c856eb-74a0-40f6-b666-0fe78bfbd941 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:58.534514 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-59c856eb-74a0-40f6-b666-0fe78bfbd941 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:58.534514 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-59c856eb-74a0-40f6-b666-0fe78bfbd941 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:58.534514 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-59c856eb-74a0-40f6-b666-0fe78bfbd941 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lazy-loading 'fault' on Instance uuid 8a4079ad-b084-41c9-af05-7e1d9c1a6616 {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:44:58.590821 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-59c856eb-74a0-40f6-b666-0fe78bfbd941 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e026a8cdb13f47de942566a2d4a10bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5827544f2e140e3b44d712d1623a06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:44:58.599778 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-59c856eb-74a0-40f6-b666-0fe78bfbd941 tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] 10.222.0.61 "GET /compute/v2.1/servers/8a4079ad-b084-41c9-af05-7e1d9c1a6616" status: 200 len: 1338 microversion: 2.1 time: 0.129586 Aug 31 16:44:58.600701 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3315/6642] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:58 2022] GET /compute/v2.1/servers/8a4079ad-b084-41c9-af05-7e1d9c1a6616 => generated 1338 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:44:59.367016 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6bf2ef0a-b9a0-41b4-9a9f-af9dde934b98 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:59.368192 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6bf2ef0a-b9a0-41b4-9a9f-af9dde934b98 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 15ac4673-682b-4707-a9d9-da02c4e37879] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:59.375085 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6bf2ef0a-b9a0-41b4-9a9f-af9dde934b98 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:59.375626 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6bf2ef0a-b9a0-41b4-9a9f-af9dde934b98 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:59.376307 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6bf2ef0a-b9a0-41b4-9a9f-af9dde934b98 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:59.377230 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6bf2ef0a-b9a0-41b4-9a9f-af9dde934b98 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:59.377855 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6bf2ef0a-b9a0-41b4-9a9f-af9dde934b98 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:59.378480 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6bf2ef0a-b9a0-41b4-9a9f-af9dde934b98 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:59.498079 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-6bf2ef0a-b9a0-41b4-9a9f-af9dde934b98 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:44:59.507658 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6bf2ef0a-b9a0-41b4-9a9f-af9dde934b98 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/15ac4673-682b-4707-a9d9-da02c4e37879" status: 200 len: 1187 microversion: 2.1 time: 0.144970 Aug 31 16:44:59.508663 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3328/6643] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:59 2022] GET /compute/v2.1/servers/15ac4673-682b-4707-a9d9-da02c4e37879 => generated 1187 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:44:59.543439 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-73883cf2-71eb-4ff3-8778-07e0f2067790 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:59.544166 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-73883cf2-71eb-4ff3-8778-07e0f2067790 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] [instance: a4dcf873-c5d9-4e9d-90d3-671d3c5a553b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:59.551365 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-73883cf2-71eb-4ff3-8778-07e0f2067790 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:59.552067 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-73883cf2-71eb-4ff3-8778-07e0f2067790 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:59.552797 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-73883cf2-71eb-4ff3-8778-07e0f2067790 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:59.553880 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-73883cf2-71eb-4ff3-8778-07e0f2067790 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:59.554491 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-73883cf2-71eb-4ff3-8778-07e0f2067790 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:59.558636 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-73883cf2-71eb-4ff3-8778-07e0f2067790 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:59.623357 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7af2b058-9dcb-4067-adcf-b2ba2a13cc0a tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:59.624028 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7af2b058-9dcb-4067-adcf-b2ba2a13cc0a tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] [instance: 8a4079ad-b084-41c9-af05-7e1d9c1a6616] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:59.630990 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7af2b058-9dcb-4067-adcf-b2ba2a13cc0a tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:59.631532 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7af2b058-9dcb-4067-adcf-b2ba2a13cc0a tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:59.632006 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7af2b058-9dcb-4067-adcf-b2ba2a13cc0a tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:59.633321 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7af2b058-9dcb-4067-adcf-b2ba2a13cc0a tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:59.634024 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7af2b058-9dcb-4067-adcf-b2ba2a13cc0a tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:59.634460 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7af2b058-9dcb-4067-adcf-b2ba2a13cc0a tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:59.652474 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-7af2b058-9dcb-4067-adcf-b2ba2a13cc0a tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] HTTP exception thrown: Instance 8a4079ad-b084-41c9-af05-7e1d9c1a6616 could not be found. Aug 31 16:44:59.654047 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7af2b058-9dcb-4067-adcf-b2ba2a13cc0a tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Request method failure captured: Aug 31 16:44:59.654047 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/8a4079ad-b084-41c9-af05-7e1d9c1a6616 HTTP/1.1 Aug 31 16:44:59.654047 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:44:59.654047 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:44:59.654047 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:44:59.654047 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:44:59.654047 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:44:59.654047 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:44:59.654047 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:44:59.654047 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:44:59.654047 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD46rwOUEviGXuYxpZgSVURhps4NGkPVIqF2NJA-5oDNILjyJvt-UCh7SiDQC1vZICAn6MmYucoePj2smr1WU3xP6XDZtQ9AGQV5q1r3ix0V4Roil5rik0wF3QGAD0HzPIHO87EMxvw8RQzgKQTUgLtLLQQRncoe_TCqBLYeARe6G0gU Aug 31 16:44:59.654047 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:44:59.654047 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:44:59.654047 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:44:59.654047 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:44:59.654047 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:44:59.654047 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:44:59.654047 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: b5827544f2e140e3b44d712d1623a06b Aug 31 16:44:59.654047 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-TestNetworkBasicOps-225290997 Aug 31 16:44:59.654047 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:44:59.654047 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:44:59.654047 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b5827544f2e140e3b44d712d1623a06b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/b5827544f2e140e3b44d712d1623a06b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_b5827544f2e140e3b44d712d1623a06b", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b5827544f2e140e3b44d712d1623a06b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:44:59.654047 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-TestNetworkBasicOps-225290997 Aug 31 16:44:59.654047 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: b5827544f2e140e3b44d712d1623a06b Aug 31 16:44:59.654047 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-TestNetworkBasicOps-225290997 Aug 31 16:44:59.654047 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-TestNetworkBasicOps-225290997-project Aug 31 16:44:59.654047 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:44:59.654047 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:44:59.654047 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: e026a8cdb13f47de942566a2d4a10bc8 Aug 31 16:44:59.654047 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-TestNetworkBasicOps-225290997-project Aug 31 16:44:59.654047 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:44:59.654047 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance 8a4079ad-b084-41c9-af05-7e1d9c1a6616 could not be found. Aug 31 16:44:59.654047 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '8a4079ad-b084-41c9-af05-7e1d9c1a6616'} Aug 31 16:44:59.654047 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:44:59.654047 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:44:59.654047 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:44:59.654047 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:44:59.654047 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:44:59.654047 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:44:59.654047 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:44:59.654047 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:44:59.654047 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:44:59.654047 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:44:59.654047 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a4079ad-b084-41c9-af05-7e1d9c1a6616 could not be found. Aug 31 16:44:59.654047 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:44:59.654047 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:44:59.654047 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:44:59.654047 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:44:59.654047 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:44:59.654047 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:44:59.654047 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:44:59.654047 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:44:59.654047 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:44:59.654047 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:44:59.654047 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:44:59.654047 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:44:59.654047 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:44:59.654047 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:44:59.654047 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:44:59.654047 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:44:59.654047 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a4079ad-b084-41c9-af05-7e1d9c1a6616 could not be found. Aug 31 16:44:59.654047 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:44:59.654047 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:44:59.654047 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:44:59.658907 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:44:59.658907 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:44:59.658907 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:44:59.658907 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:44:59.658907 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:44:59.658907 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a4079ad-b084-41c9-af05-7e1d9c1a6616 could not be found. Aug 31 16:44:59.658907 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:44:59.660446 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7af2b058-9dcb-4067-adcf-b2ba2a13cc0a tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Returning 404 to user: Instance 8a4079ad-b084-41c9-af05-7e1d9c1a6616 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:44:59.661511 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7af2b058-9dcb-4067-adcf-b2ba2a13cc0a tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] 10.222.0.61 "GET /compute/v2.1/servers/8a4079ad-b084-41c9-af05-7e1d9c1a6616" status: 404 len: 111 microversion: 2.1 time: 0.043012 Aug 31 16:44:59.666160 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3329/6644] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:59 2022] GET /compute/v2.1/servers/8a4079ad-b084-41c9-af05-7e1d9c1a6616 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 16:44:59.834840 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ac738a99-44ae-4dd3-a6e1-48ec53d0596e tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] Calling method '.version_select at 0x7f5ae83d84c0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:59.857716 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ac738a99-44ae-4dd3-a6e1-48ec53d0596e tempest-TestNetworkBasicOps-225290997 tempest-TestNetworkBasicOps-225290997-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-492108040" status: 202 len: 0 microversion: 2.1 time: 0.026882 Aug 31 16:44:59.858473 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3330/6645] 10.222.0.61 () {58 vars in 1254 bytes} [Wed Aug 31 16:44:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-492108040 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:44:59.960797 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-73883cf2-71eb-4ff3-8778-07e0f2067790 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab56c16d1354864850f8f2e8339b50d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41821cff003462bb6734854b0116d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:44:59.975568 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-73883cf2-71eb-4ff3-8778-07e0f2067790 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] 10.222.0.61 "GET /compute/v2.1/servers/a4dcf873-c5d9-4e9d-90d3-671d3c5a553b" status: 200 len: 1319 microversion: 2.1 time: 0.436629 Aug 31 16:44:59.977224 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3316/6646] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:59 2022] GET /compute/v2.1/servers/a4dcf873-c5d9-4e9d-90d3-671d3c5a553b => generated 1319 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:00.530062 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e4ae6299-da00-4894-ba46-29c4994750cd tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:00.531623 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e4ae6299-da00-4894-ba46-29c4994750cd tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 15ac4673-682b-4707-a9d9-da02c4e37879] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:00.540992 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e4ae6299-da00-4894-ba46-29c4994750cd tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:00.542688 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e4ae6299-da00-4894-ba46-29c4994750cd tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:00.543319 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e4ae6299-da00-4894-ba46-29c4994750cd tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:00.544260 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e4ae6299-da00-4894-ba46-29c4994750cd tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:00.544893 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e4ae6299-da00-4894-ba46-29c4994750cd tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:00.545495 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e4ae6299-da00-4894-ba46-29c4994750cd tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:00.967706 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e4ae6299-da00-4894-ba46-29c4994750cd tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:00.998518 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-cb885dfb-0041-408c-b14d-067460295c7b tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:00.999102 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e4ae6299-da00-4894-ba46-29c4994750cd tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/15ac4673-682b-4707-a9d9-da02c4e37879" status: 200 len: 1229 microversion: 2.1 time: 0.467083 Aug 31 16:45:01.001575 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3331/6647] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:00 2022] GET /compute/v2.1/servers/15ac4673-682b-4707-a9d9-da02c4e37879 => generated 1229 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:01.012445 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-cb885dfb-0041-408c-b14d-067460295c7b tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] [instance: a4dcf873-c5d9-4e9d-90d3-671d3c5a553b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:01.022521 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cb885dfb-0041-408c-b14d-067460295c7b tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:01.023095 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cb885dfb-0041-408c-b14d-067460295c7b tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:01.024293 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cb885dfb-0041-408c-b14d-067460295c7b tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:01.025521 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cb885dfb-0041-408c-b14d-067460295c7b tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:01.026178 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cb885dfb-0041-408c-b14d-067460295c7b tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:01.027514 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cb885dfb-0041-408c-b14d-067460295c7b tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:01.216817 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-5118eddf-d741-4c6e-89a2-6fc8b2a240d1 req-5abfc601-8cfa-4f2b-b1cc-6991538e7a66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4dcf873-c5d9-4e9d-90d3-671d3c5a553b", "tag": "9999cbcd-cce4-4603-8eaa-e2f3c53995c7"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:45:01.239304 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-5118eddf-d741-4c6e-89a2-6fc8b2a240d1 req-5abfc601-8cfa-4f2b-b1cc-6991538e7a66 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:01.240674 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-5118eddf-d741-4c6e-89a2-6fc8b2a240d1 req-5abfc601-8cfa-4f2b-b1cc-6991538e7a66 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:01.241689 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-5118eddf-d741-4c6e-89a2-6fc8b2a240d1 req-5abfc601-8cfa-4f2b-b1cc-6991538e7a66 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:01.260781 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-5118eddf-d741-4c6e-89a2-6fc8b2a240d1 req-5abfc601-8cfa-4f2b-b1cc-6991538e7a66 service nova] Creating event network-changed:9999cbcd-cce4-4603-8eaa-e2f3c53995c7 for instance a4dcf873-c5d9-4e9d-90d3-671d3c5a553b on n-h2-850499-9 Aug 31 16:45:01.270465 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-5118eddf-d741-4c6e-89a2-6fc8b2a240d1 req-5abfc601-8cfa-4f2b-b1cc-6991538e7a66 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057545 Aug 31 16:45:01.271463 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3332/6648] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:45:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:45:01.501659 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-cb885dfb-0041-408c-b14d-067460295c7b tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab56c16d1354864850f8f2e8339b50d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41821cff003462bb6734854b0116d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:01.514206 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-cb885dfb-0041-408c-b14d-067460295c7b tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] 10.222.0.61 "GET /compute/v2.1/servers/a4dcf873-c5d9-4e9d-90d3-671d3c5a553b" status: 200 len: 1319 microversion: 2.1 time: 0.519187 Aug 31 16:45:01.515456 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3317/6649] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:00 2022] GET /compute/v2.1/servers/a4dcf873-c5d9-4e9d-90d3-671d3c5a553b => generated 1319 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:45:02.021249 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9d4941e0-3782-41b0-b3fa-b9dab8d26b19 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:02.022571 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9d4941e0-3782-41b0-b3fa-b9dab8d26b19 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 15ac4673-682b-4707-a9d9-da02c4e37879] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:02.030045 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9d4941e0-3782-41b0-b3fa-b9dab8d26b19 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:02.030801 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9d4941e0-3782-41b0-b3fa-b9dab8d26b19 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:02.031440 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9d4941e0-3782-41b0-b3fa-b9dab8d26b19 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:02.032353 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9d4941e0-3782-41b0-b3fa-b9dab8d26b19 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:02.032989 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9d4941e0-3782-41b0-b3fa-b9dab8d26b19 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:02.033596 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9d4941e0-3782-41b0-b3fa-b9dab8d26b19 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:02.442441 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9d4941e0-3782-41b0-b3fa-b9dab8d26b19 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:02.452906 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9d4941e0-3782-41b0-b3fa-b9dab8d26b19 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/15ac4673-682b-4707-a9d9-da02c4e37879" status: 200 len: 1229 microversion: 2.1 time: 0.436818 Aug 31 16:45:02.453872 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3333/6650] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:02 2022] GET /compute/v2.1/servers/15ac4673-682b-4707-a9d9-da02c4e37879 => generated 1229 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:02.536131 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0b700a46-cdf7-45fa-a462-25014a57b067 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:02.536670 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0b700a46-cdf7-45fa-a462-25014a57b067 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] [instance: a4dcf873-c5d9-4e9d-90d3-671d3c5a553b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:02.549282 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0b700a46-cdf7-45fa-a462-25014a57b067 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:02.550005 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0b700a46-cdf7-45fa-a462-25014a57b067 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:02.550525 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0b700a46-cdf7-45fa-a462-25014a57b067 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:02.551367 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0b700a46-cdf7-45fa-a462-25014a57b067 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:02.552113 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0b700a46-cdf7-45fa-a462-25014a57b067 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:02.552730 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0b700a46-cdf7-45fa-a462-25014a57b067 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:02.797595 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-0b700a46-cdf7-45fa-a462-25014a57b067 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab56c16d1354864850f8f2e8339b50d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41821cff003462bb6734854b0116d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:02.807094 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0b700a46-cdf7-45fa-a462-25014a57b067 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] 10.222.0.61 "GET /compute/v2.1/servers/a4dcf873-c5d9-4e9d-90d3-671d3c5a553b" status: 200 len: 1319 microversion: 2.1 time: 0.274778 Aug 31 16:45:02.811363 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3318/6651] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:02 2022] GET /compute/v2.1/servers/a4dcf873-c5d9-4e9d-90d3-671d3c5a553b => generated 1319 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:03.376100 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-4654783b-3409-4d34-874e-8db8c9ae2f88 req-12f76735-bd05-4de7-897a-700e3c57f007 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15ac4673-682b-4707-a9d9-da02c4e37879", "tag": "3fdf4b50-f03c-4d02-ad34-9fb01e5a58a1"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:45:03.384966 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:45:03.400150 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-4654783b-3409-4d34-874e-8db8c9ae2f88 req-12f76735-bd05-4de7-897a-700e3c57f007 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:03.403592 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-4654783b-3409-4d34-874e-8db8c9ae2f88 req-12f76735-bd05-4de7-897a-700e3c57f007 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:03.404329 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-4654783b-3409-4d34-874e-8db8c9ae2f88 req-12f76735-bd05-4de7-897a-700e3c57f007 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:03.442162 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-4654783b-3409-4d34-874e-8db8c9ae2f88 req-12f76735-bd05-4de7-897a-700e3c57f007 service nova] Creating event network-changed:3fdf4b50-f03c-4d02-ad34-9fb01e5a58a1 for instance 15ac4673-682b-4707-a9d9-da02c4e37879 on n-h1-850499-9 Aug 31 16:45:03.453391 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-4654783b-3409-4d34-874e-8db8c9ae2f88 req-12f76735-bd05-4de7-897a-700e3c57f007 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082473 Aug 31 16:45:03.454386 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3334/6652] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:45:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:45:03.480398 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f8950e9f-dc27-474b-888e-6315bca08ba5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:03.482115 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f8950e9f-dc27-474b-888e-6315bca08ba5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 15ac4673-682b-4707-a9d9-da02c4e37879] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:03.509015 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f8950e9f-dc27-474b-888e-6315bca08ba5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:03.510314 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f8950e9f-dc27-474b-888e-6315bca08ba5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:03.513399 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f8950e9f-dc27-474b-888e-6315bca08ba5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:03.516777 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f8950e9f-dc27-474b-888e-6315bca08ba5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:03.518113 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f8950e9f-dc27-474b-888e-6315bca08ba5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:03.522139 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f8950e9f-dc27-474b-888e-6315bca08ba5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:03.833436 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-faa996ac-b11a-44a3-ae23-f0bcbb2b39ff tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:03.834171 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-faa996ac-b11a-44a3-ae23-f0bcbb2b39ff tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] [instance: a4dcf873-c5d9-4e9d-90d3-671d3c5a553b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:03.854015 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-faa996ac-b11a-44a3-ae23-f0bcbb2b39ff tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:03.854855 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-faa996ac-b11a-44a3-ae23-f0bcbb2b39ff tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:03.855530 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-faa996ac-b11a-44a3-ae23-f0bcbb2b39ff tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:03.856477 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-faa996ac-b11a-44a3-ae23-f0bcbb2b39ff tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:03.862509 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f8950e9f-dc27-474b-888e-6315bca08ba5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:03.879851 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-faa996ac-b11a-44a3-ae23-f0bcbb2b39ff tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:03.883293 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f8950e9f-dc27-474b-888e-6315bca08ba5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/15ac4673-682b-4707-a9d9-da02c4e37879" status: 200 len: 1229 microversion: 2.1 time: 0.411910 Aug 31 16:45:03.884401 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-faa996ac-b11a-44a3-ae23-f0bcbb2b39ff tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:03.888984 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3319/6653] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:03 2022] GET /compute/v2.1/servers/15ac4673-682b-4707-a9d9-da02c4e37879 => generated 1229 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:04.158929 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-faa996ac-b11a-44a3-ae23-f0bcbb2b39ff tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab56c16d1354864850f8f2e8339b50d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41821cff003462bb6734854b0116d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:04.170753 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-faa996ac-b11a-44a3-ae23-f0bcbb2b39ff tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] 10.222.0.61 "GET /compute/v2.1/servers/a4dcf873-c5d9-4e9d-90d3-671d3c5a553b" status: 200 len: 1319 microversion: 2.1 time: 0.343033 Aug 31 16:45:04.186387 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3335/6654] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:03 2022] GET /compute/v2.1/servers/a4dcf873-c5d9-4e9d-90d3-671d3c5a553b => generated 1319 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:45:04.910501 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-53c93533-7e4b-4fe5-983c-3564fcb01eef tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:04.911932 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-53c93533-7e4b-4fe5-983c-3564fcb01eef tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 15ac4673-682b-4707-a9d9-da02c4e37879] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:04.920078 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-53c93533-7e4b-4fe5-983c-3564fcb01eef tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:04.920668 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-53c93533-7e4b-4fe5-983c-3564fcb01eef tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:04.921119 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-53c93533-7e4b-4fe5-983c-3564fcb01eef tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:04.921864 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-53c93533-7e4b-4fe5-983c-3564fcb01eef tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:04.922316 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-53c93533-7e4b-4fe5-983c-3564fcb01eef tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:04.922750 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-53c93533-7e4b-4fe5-983c-3564fcb01eef tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:05.138521 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-53c93533-7e4b-4fe5-983c-3564fcb01eef tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:05.149061 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-53c93533-7e4b-4fe5-983c-3564fcb01eef tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/15ac4673-682b-4707-a9d9-da02c4e37879" status: 200 len: 1229 microversion: 2.1 time: 0.242354 Aug 31 16:45:05.156264 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3320/6655] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:04 2022] GET /compute/v2.1/servers/15ac4673-682b-4707-a9d9-da02c4e37879 => generated 1229 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:05.193335 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-645dcd10-f0a2-45fd-b643-3373fedcda59 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:05.194656 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-645dcd10-f0a2-45fd-b643-3373fedcda59 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] [instance: a4dcf873-c5d9-4e9d-90d3-671d3c5a553b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:05.202858 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-645dcd10-f0a2-45fd-b643-3373fedcda59 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:05.203360 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-645dcd10-f0a2-45fd-b643-3373fedcda59 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:05.204163 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-645dcd10-f0a2-45fd-b643-3373fedcda59 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:05.205062 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-645dcd10-f0a2-45fd-b643-3373fedcda59 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:05.205531 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-645dcd10-f0a2-45fd-b643-3373fedcda59 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:05.205960 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-645dcd10-f0a2-45fd-b643-3373fedcda59 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:05.713058 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-645dcd10-f0a2-45fd-b643-3373fedcda59 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab56c16d1354864850f8f2e8339b50d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41821cff003462bb6734854b0116d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:05.731354 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-645dcd10-f0a2-45fd-b643-3373fedcda59 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] 10.222.0.61 "GET /compute/v2.1/servers/a4dcf873-c5d9-4e9d-90d3-671d3c5a553b" status: 200 len: 1319 microversion: 2.1 time: 0.542474 Aug 31 16:45:05.732059 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3336/6656] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:05 2022] GET /compute/v2.1/servers/a4dcf873-c5d9-4e9d-90d3-671d3c5a553b => generated 1319 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:06.176081 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c71f6005-3fd2-4582-94cd-d2fc3e256915 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:06.176815 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c71f6005-3fd2-4582-94cd-d2fc3e256915 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 15ac4673-682b-4707-a9d9-da02c4e37879] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:06.186374 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c71f6005-3fd2-4582-94cd-d2fc3e256915 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:06.186978 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c71f6005-3fd2-4582-94cd-d2fc3e256915 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:06.187508 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c71f6005-3fd2-4582-94cd-d2fc3e256915 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:06.188301 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c71f6005-3fd2-4582-94cd-d2fc3e256915 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:06.188856 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c71f6005-3fd2-4582-94cd-d2fc3e256915 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:06.189361 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c71f6005-3fd2-4582-94cd-d2fc3e256915 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:06.340066 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c71f6005-3fd2-4582-94cd-d2fc3e256915 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:06.355546 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c71f6005-3fd2-4582-94cd-d2fc3e256915 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/15ac4673-682b-4707-a9d9-da02c4e37879" status: 200 len: 1217 microversion: 2.1 time: 0.184762 Aug 31 16:45:06.356600 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3321/6657] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:06 2022] GET /compute/v2.1/servers/15ac4673-682b-4707-a9d9-da02c4e37879 => generated 1217 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:06.753092 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c04fb599-6457-497b-81df-e49ca3bedc5d tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:06.753717 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c04fb599-6457-497b-81df-e49ca3bedc5d tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] [instance: a4dcf873-c5d9-4e9d-90d3-671d3c5a553b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:06.761178 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c04fb599-6457-497b-81df-e49ca3bedc5d tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:06.761679 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c04fb599-6457-497b-81df-e49ca3bedc5d tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:06.762127 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c04fb599-6457-497b-81df-e49ca3bedc5d tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:06.762843 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c04fb599-6457-497b-81df-e49ca3bedc5d tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:06.763304 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c04fb599-6457-497b-81df-e49ca3bedc5d tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:06.763772 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c04fb599-6457-497b-81df-e49ca3bedc5d tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:06.911524 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c04fb599-6457-497b-81df-e49ca3bedc5d tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab56c16d1354864850f8f2e8339b50d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41821cff003462bb6734854b0116d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:06.920243 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c04fb599-6457-497b-81df-e49ca3bedc5d tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] 10.222.0.61 "GET /compute/v2.1/servers/a4dcf873-c5d9-4e9d-90d3-671d3c5a553b" status: 200 len: 1319 microversion: 2.1 time: 0.170879 Aug 31 16:45:06.920768 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3337/6658] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:06 2022] GET /compute/v2.1/servers/a4dcf873-c5d9-4e9d-90d3-671d3c5a553b => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:07.379362 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b90393dc-60c4-4e9a-a4a3-b024d137d102 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:07.380143 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b90393dc-60c4-4e9a-a4a3-b024d137d102 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 15ac4673-682b-4707-a9d9-da02c4e37879] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:07.382067 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=4 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:45:07.382853 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=12 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:45:07.390012 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b90393dc-60c4-4e9a-a4a3-b024d137d102 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:07.390525 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b90393dc-60c4-4e9a-a4a3-b024d137d102 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:07.390926 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b90393dc-60c4-4e9a-a4a3-b024d137d102 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:07.391703 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b90393dc-60c4-4e9a-a4a3-b024d137d102 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:07.392359 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b90393dc-60c4-4e9a-a4a3-b024d137d102 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:07.393302 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b90393dc-60c4-4e9a-a4a3-b024d137d102 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:07.557798 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b90393dc-60c4-4e9a-a4a3-b024d137d102 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:07.566471 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b90393dc-60c4-4e9a-a4a3-b024d137d102 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/15ac4673-682b-4707-a9d9-da02c4e37879" status: 200 len: 1217 microversion: 2.1 time: 0.191595 Aug 31 16:45:07.567339 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3322/6659] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:07 2022] GET /compute/v2.1/servers/15ac4673-682b-4707-a9d9-da02c4e37879 => generated 1217 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:07.847433 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=4 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:45:07.943795 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-039e48f2-2112-4583-b996-dc5a3f3a5a49 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:07.944413 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-039e48f2-2112-4583-b996-dc5a3f3a5a49 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] [instance: a4dcf873-c5d9-4e9d-90d3-671d3c5a553b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:07.952191 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-039e48f2-2112-4583-b996-dc5a3f3a5a49 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:07.952696 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-039e48f2-2112-4583-b996-dc5a3f3a5a49 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:07.953138 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-039e48f2-2112-4583-b996-dc5a3f3a5a49 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:07.954047 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-039e48f2-2112-4583-b996-dc5a3f3a5a49 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:07.954505 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-039e48f2-2112-4583-b996-dc5a3f3a5a49 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:07.955122 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-039e48f2-2112-4583-b996-dc5a3f3a5a49 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:08.029631 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-319184ce-b4af-4c32-9574-7c4bfd1ab0a5 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Action: 'create', calling method: .version_select at 0x7f5ae8516700>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-1475348723", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEyakzR6Swmv5DkHDzMfTZZU8UG8wew9nc0tncc+Ats6AbSUdG0v5zi9fHhhdxVA+V4YZngKzQjDAy/p0c6ortFPPNQA3eQWn/k5FZeplEJ0j/ikx6Di9LMRuzwqs0Lmrw=="}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:45:08.046776 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-319184ce-b4af-4c32-9574-7c4bfd1ab0a5 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Getting quotas for project b18b57cca5d34cada128b3a7e2b5adc8. Resources: {'key_pairs'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:45:08.053224 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-319184ce-b4af-4c32-9574-7c4bfd1ab0a5 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Getting quotas for user 1c112e27f9234237a138100fbc23818c and project b18b57cca5d34cada128b3a7e2b5adc8. Resources: {'key_pairs'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:45:08.083920 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-319184ce-b4af-4c32-9574-7c4bfd1ab0a5 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.241108 Aug 31 16:45:08.084893 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3338/6660] 10.222.0.61 () {60 vars in 1159 bytes} [Wed Aug 31 16:45:07 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:45:08.100385 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-3a6a7846-efac-4c1f-9b71-339983ad1dc5 req-479cdf63-c7d3-4aff-bc24-728a638c72c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4dcf873-c5d9-4e9d-90d3-671d3c5a553b", "name": "network-vif-plugged", "status": "completed", "tag": "9999cbcd-cce4-4603-8eaa-e2f3c53995c7"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:45:08.115258 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-3a6a7846-efac-4c1f-9b71-339983ad1dc5 req-479cdf63-c7d3-4aff-bc24-728a638c72c3 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:08.117907 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-3a6a7846-efac-4c1f-9b71-339983ad1dc5 req-479cdf63-c7d3-4aff-bc24-728a638c72c3 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:08.119036 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-3a6a7846-efac-4c1f-9b71-339983ad1dc5 req-479cdf63-c7d3-4aff-bc24-728a638c72c3 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:08.121507 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-039e48f2-2112-4583-b996-dc5a3f3a5a49 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab56c16d1354864850f8f2e8339b50d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41821cff003462bb6734854b0116d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:08.133495 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-3a6a7846-efac-4c1f-9b71-339983ad1dc5 req-479cdf63-c7d3-4aff-bc24-728a638c72c3 service nova] Creating event network-vif-plugged:9999cbcd-cce4-4603-8eaa-e2f3c53995c7 for instance a4dcf873-c5d9-4e9d-90d3-671d3c5a553b on n-h2-850499-9 Aug 31 16:45:08.134804 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-039e48f2-2112-4583-b996-dc5a3f3a5a49 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] 10.222.0.61 "GET /compute/v2.1/servers/a4dcf873-c5d9-4e9d-90d3-671d3c5a553b" status: 200 len: 1319 microversion: 2.1 time: 0.194165 Aug 31 16:45:08.136188 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3323/6661] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:07 2022] GET /compute/v2.1/servers/a4dcf873-c5d9-4e9d-90d3-671d3c5a553b => generated 1319 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:08.139620 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-3a6a7846-efac-4c1f-9b71-339983ad1dc5 req-479cdf63-c7d3-4aff-bc24-728a638c72c3 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043525 Aug 31 16:45:08.140892 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3339/6662] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:45:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:45:08.594371 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-89d1e479-b672-47c3-84a3-7056fe6498cc tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:08.596158 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-89d1e479-b672-47c3-84a3-7056fe6498cc tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 15ac4673-682b-4707-a9d9-da02c4e37879] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:08.606176 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-89d1e479-b672-47c3-84a3-7056fe6498cc tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:08.606821 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-89d1e479-b672-47c3-84a3-7056fe6498cc tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:08.607485 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-89d1e479-b672-47c3-84a3-7056fe6498cc tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:08.609640 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-89d1e479-b672-47c3-84a3-7056fe6498cc tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:08.610481 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-89d1e479-b672-47c3-84a3-7056fe6498cc tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:08.610931 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-89d1e479-b672-47c3-84a3-7056fe6498cc tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:08.763393 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-89d1e479-b672-47c3-84a3-7056fe6498cc tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:08.771945 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-89d1e479-b672-47c3-84a3-7056fe6498cc tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/15ac4673-682b-4707-a9d9-da02c4e37879" status: 200 len: 1217 microversion: 2.1 time: 0.184537 Aug 31 16:45:08.772585 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3324/6663] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:08 2022] GET /compute/v2.1/servers/15ac4673-682b-4707-a9d9-da02c4e37879 => generated 1217 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:09.157883 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5d61ee67-41db-4598-ba87-77bf8084d368 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:09.158638 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5d61ee67-41db-4598-ba87-77bf8084d368 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] [instance: a4dcf873-c5d9-4e9d-90d3-671d3c5a553b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:09.170362 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5d61ee67-41db-4598-ba87-77bf8084d368 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:09.170874 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5d61ee67-41db-4598-ba87-77bf8084d368 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:09.171334 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5d61ee67-41db-4598-ba87-77bf8084d368 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:09.172096 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5d61ee67-41db-4598-ba87-77bf8084d368 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:09.172554 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5d61ee67-41db-4598-ba87-77bf8084d368 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:09.172989 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5d61ee67-41db-4598-ba87-77bf8084d368 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:09.334658 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5d61ee67-41db-4598-ba87-77bf8084d368 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab56c16d1354864850f8f2e8339b50d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41821cff003462bb6734854b0116d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:09.343900 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5d61ee67-41db-4598-ba87-77bf8084d368 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] 10.222.0.61 "GET /compute/v2.1/servers/a4dcf873-c5d9-4e9d-90d3-671d3c5a553b" status: 200 len: 1319 microversion: 2.1 time: 0.191064 Aug 31 16:45:09.344503 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3340/6664] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:09 2022] GET /compute/v2.1/servers/a4dcf873-c5d9-4e9d-90d3-671d3c5a553b => generated 1319 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:09.793050 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b1e4be82-fabb-4e28-9883-5002135a9489 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:09.793647 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b1e4be82-fabb-4e28-9883-5002135a9489 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 15ac4673-682b-4707-a9d9-da02c4e37879] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:09.800752 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b1e4be82-fabb-4e28-9883-5002135a9489 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:09.801239 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b1e4be82-fabb-4e28-9883-5002135a9489 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:09.801677 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b1e4be82-fabb-4e28-9883-5002135a9489 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:09.802386 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b1e4be82-fabb-4e28-9883-5002135a9489 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:09.802843 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b1e4be82-fabb-4e28-9883-5002135a9489 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:09.803265 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b1e4be82-fabb-4e28-9883-5002135a9489 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:09.940364 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b1e4be82-fabb-4e28-9883-5002135a9489 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:09.949977 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b1e4be82-fabb-4e28-9883-5002135a9489 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/15ac4673-682b-4707-a9d9-da02c4e37879" status: 200 len: 1217 microversion: 2.1 time: 0.160808 Aug 31 16:45:09.950570 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3325/6665] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:09 2022] GET /compute/v2.1/servers/15ac4673-682b-4707-a9d9-da02c4e37879 => generated 1217 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:10.366730 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-db19315c-6ac3-4c0d-89dd-4f45b0ff76fc tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:10.368153 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-db19315c-6ac3-4c0d-89dd-4f45b0ff76fc tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] [instance: a4dcf873-c5d9-4e9d-90d3-671d3c5a553b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:10.375642 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-db19315c-6ac3-4c0d-89dd-4f45b0ff76fc tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:10.376144 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-db19315c-6ac3-4c0d-89dd-4f45b0ff76fc tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:10.376588 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-db19315c-6ac3-4c0d-89dd-4f45b0ff76fc tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:10.377290 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-db19315c-6ac3-4c0d-89dd-4f45b0ff76fc tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:10.377749 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-db19315c-6ac3-4c0d-89dd-4f45b0ff76fc tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:10.378180 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-db19315c-6ac3-4c0d-89dd-4f45b0ff76fc tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:10.555810 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-db19315c-6ac3-4c0d-89dd-4f45b0ff76fc tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab56c16d1354864850f8f2e8339b50d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41821cff003462bb6734854b0116d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:10.572890 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-db19315c-6ac3-4c0d-89dd-4f45b0ff76fc tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] 10.222.0.61 "GET /compute/v2.1/servers/a4dcf873-c5d9-4e9d-90d3-671d3c5a553b" status: 200 len: 1507 microversion: 2.1 time: 0.209572 Aug 31 16:45:10.574404 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3341/6666] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:10 2022] GET /compute/v2.1/servers/a4dcf873-c5d9-4e9d-90d3-671d3c5a553b => generated 1507 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:10.598705 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-373cb1e2-cd58-461c-acee-eafa3862bcb0 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "661b7538-b92b-452e-b362-37a9181bb2cb", "device": "/dev/sdb"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:45:10.601405 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-373cb1e2-cd58-461c-acee-eafa3862bcb0 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] [instance: a4dcf873-c5d9-4e9d-90d3-671d3c5a553b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:10.609440 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-373cb1e2-cd58-461c-acee-eafa3862bcb0 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:10.610087 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-373cb1e2-cd58-461c-acee-eafa3862bcb0 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:10.610719 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-373cb1e2-cd58-461c-acee-eafa3862bcb0 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:10.611864 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-373cb1e2-cd58-461c-acee-eafa3862bcb0 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:10.612434 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-373cb1e2-cd58-461c-acee-eafa3862bcb0 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:10.612958 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-373cb1e2-cd58-461c-acee-eafa3862bcb0 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:10.975369 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3fb044be-64ca-4d53-9dae-3049ae9f9ca9 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:10.976973 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3fb044be-64ca-4d53-9dae-3049ae9f9ca9 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 15ac4673-682b-4707-a9d9-da02c4e37879] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:11.003941 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3fb044be-64ca-4d53-9dae-3049ae9f9ca9 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:11.004271 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3fb044be-64ca-4d53-9dae-3049ae9f9ca9 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:11.004662 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3fb044be-64ca-4d53-9dae-3049ae9f9ca9 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:11.005429 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3fb044be-64ca-4d53-9dae-3049ae9f9ca9 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:11.006043 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3fb044be-64ca-4d53-9dae-3049ae9f9ca9 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:11.006490 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3fb044be-64ca-4d53-9dae-3049ae9f9ca9 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:11.051370 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-373cb1e2-cd58-461c-acee-eafa3862bcb0 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] 10.222.0.61 "POST /compute/v2.1/servers/a4dcf873-c5d9-4e9d-90d3-671d3c5a553b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.457885 Aug 31 16:45:11.060872 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3326/6667] 10.222.0.61 () {60 vars in 1323 bytes} [Wed Aug 31 16:45:10 2022] POST /compute/v2.1/servers/a4dcf873-c5d9-4e9d-90d3-671d3c5a553b/os-volume_attachments => generated 194 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:45:11.316270 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3fb044be-64ca-4d53-9dae-3049ae9f9ca9 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:11.333438 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3fb044be-64ca-4d53-9dae-3049ae9f9ca9 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/15ac4673-682b-4707-a9d9-da02c4e37879" status: 200 len: 1217 microversion: 2.1 time: 0.365701 Aug 31 16:45:11.334180 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3342/6668] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:10 2022] GET /compute/v2.1/servers/15ac4673-682b-4707-a9d9-da02c4e37879 => generated 1217 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:11.659311 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-21afc080-b422-48f6-9391-b6e5768ca520 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:45:11.662141 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-21afc080-b422-48f6-9391-b6e5768ca520 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 962444ac-43a3-4c95-94f6-38414daf29c1] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:11.675833 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-21afc080-b422-48f6-9391-b6e5768ca520 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:11.683299 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-21afc080-b422-48f6-9391-b6e5768ca520 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:11.683755 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-21afc080-b422-48f6-9391-b6e5768ca520 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:11.686072 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-21afc080-b422-48f6-9391-b6e5768ca520 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:11.686574 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-21afc080-b422-48f6-9391-b6e5768ca520 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:11.687030 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-21afc080-b422-48f6-9391-b6e5768ca520 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:11.721036 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:45:12.331721 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-21afc080-b422-48f6-9391-b6e5768ca520 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "POST /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1/action" status: 200 len: 24561 microversion: 2.1 time: 0.676995 Aug 31 16:45:12.332882 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3327/6669] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:45:11 2022] POST /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1/action => generated 24561 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 16:45:12.356772 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-254f3c3d-52a2-407f-83a3-69655d94a62f tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:12.359732 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-254f3c3d-52a2-407f-83a3-69655d94a62f tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 15ac4673-682b-4707-a9d9-da02c4e37879] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:12.381687 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-254f3c3d-52a2-407f-83a3-69655d94a62f tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:12.382449 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-254f3c3d-52a2-407f-83a3-69655d94a62f tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:12.383222 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-254f3c3d-52a2-407f-83a3-69655d94a62f tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:12.384370 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-254f3c3d-52a2-407f-83a3-69655d94a62f tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:12.385206 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-254f3c3d-52a2-407f-83a3-69655d94a62f tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:12.396256 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-254f3c3d-52a2-407f-83a3-69655d94a62f tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:12.651041 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-254f3c3d-52a2-407f-83a3-69655d94a62f tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:12.662881 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-254f3c3d-52a2-407f-83a3-69655d94a62f tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/15ac4673-682b-4707-a9d9-da02c4e37879" status: 200 len: 1217 microversion: 2.1 time: 0.312346 Aug 31 16:45:12.663984 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3343/6670] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:12 2022] GET /compute/v2.1/servers/15ac4673-682b-4707-a9d9-da02c4e37879 => generated 1217 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:13.688987 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f88511b7-b990-4bbc-9845-633fa64e0ea0 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:13.689813 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f88511b7-b990-4bbc-9845-633fa64e0ea0 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 15ac4673-682b-4707-a9d9-da02c4e37879] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:13.711453 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f88511b7-b990-4bbc-9845-633fa64e0ea0 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:13.712359 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f88511b7-b990-4bbc-9845-633fa64e0ea0 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:13.713147 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f88511b7-b990-4bbc-9845-633fa64e0ea0 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:13.713970 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f88511b7-b990-4bbc-9845-633fa64e0ea0 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:13.714502 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f88511b7-b990-4bbc-9845-633fa64e0ea0 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:13.714993 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f88511b7-b990-4bbc-9845-633fa64e0ea0 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:13.995284 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f88511b7-b990-4bbc-9845-633fa64e0ea0 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:14.012353 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f88511b7-b990-4bbc-9845-633fa64e0ea0 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/15ac4673-682b-4707-a9d9-da02c4e37879" status: 200 len: 1217 microversion: 2.1 time: 0.329304 Aug 31 16:45:14.028782 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3328/6671] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:13 2022] GET /compute/v2.1/servers/15ac4673-682b-4707-a9d9-da02c4e37879 => generated 1217 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:14.537574 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8c246db1-9e2a-4082-9848-9ae212131352 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-1167354013-access_point-408274522", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "networks": [{"uuid": "f17f8f36-22fc-40f4-8c90-417ce261ad8c"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1475348723", "security_groups": [{"name": "tempest-secgroup_access--1622262000"}, {"name": "tempest-secgroup_general--258765918"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:45:14.765568 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-8c246db1-9e2a-4082-9848-9ae212131352 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] validate_networks() for [('f17f8f36-22fc-40f4-8c90-417ce261ad8c', None, None, None, None, None)] {{(pid=122257) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:45:15.059241 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-404aeab8-2ff4-4ca1-a2b5-e3c8b77f159b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:15.062364 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-404aeab8-2ff4-4ca1-a2b5-e3c8b77f159b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 15ac4673-682b-4707-a9d9-da02c4e37879] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:15.078054 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-404aeab8-2ff4-4ca1-a2b5-e3c8b77f159b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:15.079250 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-404aeab8-2ff4-4ca1-a2b5-e3c8b77f159b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:15.080002 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-404aeab8-2ff4-4ca1-a2b5-e3c8b77f159b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:15.081095 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-404aeab8-2ff4-4ca1-a2b5-e3c8b77f159b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:15.082417 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-404aeab8-2ff4-4ca1-a2b5-e3c8b77f159b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:15.083102 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-404aeab8-2ff4-4ca1-a2b5-e3c8b77f159b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:15.389630 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-404aeab8-2ff4-4ca1-a2b5-e3c8b77f159b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:15.404922 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-404aeab8-2ff4-4ca1-a2b5-e3c8b77f159b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/15ac4673-682b-4707-a9d9-da02c4e37879" status: 200 len: 1217 microversion: 2.1 time: 0.355264 Aug 31 16:45:15.406065 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3329/6672] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:15 2022] GET /compute/v2.1/servers/15ac4673-682b-4707-a9d9-da02c4e37879 => generated 1217 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:45:15.434043 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-8c246db1-9e2a-4082-9848-9ae212131352 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:45:15.434483 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-8c246db1-9e2a-4082-9848-9ae212131352 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:45:15.435311 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-8c246db1-9e2a-4082-9848-9ae212131352 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:45:15.436043 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-8c246db1-9e2a-4082-9848-9ae212131352 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:45:15.436580 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-8c246db1-9e2a-4082-9848-9ae212131352 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:45:15.459264 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8c246db1-9e2a-4082-9848-9ae212131352 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:15.459875 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8c246db1-9e2a-4082-9848-9ae212131352 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:15.461962 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8c246db1-9e2a-4082-9848-9ae212131352 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:15.462367 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8c246db1-9e2a-4082-9848-9ae212131352 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:15.463153 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8c246db1-9e2a-4082-9848-9ae212131352 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:15.463873 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8c246db1-9e2a-4082-9848-9ae212131352 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:15.490923 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-8c246db1-9e2a-4082-9848-9ae212131352 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Getting quotas for project b18b57cca5d34cada128b3a7e2b5adc8. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:45:15.501895 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-8c246db1-9e2a-4082-9848-9ae212131352 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Getting quotas for user 1c112e27f9234237a138100fbc23818c and project b18b57cca5d34cada128b3a7e2b5adc8. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:45:15.530627 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8c246db1-9e2a-4082-9848-9ae212131352 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Going to run 1 instances... {{(pid=122257) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:45:15.533426 n-d-850499-9 devstack@n-api.service[122257]: WARNING nova.utils [None req-8c246db1-9e2a-4082-9848-9ae212131352 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-1167354013-access_point-408274522 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-1167354013-ac Aug 31 16:45:15.535302 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8c246db1-9e2a-4082-9848-9ae212131352 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] [instance: 46b94da0-6f4a-4912-a2f1-e23b83df2052] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:45:15.612765 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8c246db1-9e2a-4082-9848-9ae212131352 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 457 microversion: 2.1 time: 1.079108 Aug 31 16:45:15.614503 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3344/6673] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:45:14 2022] POST /compute/v2.1/servers => generated 457 bytes in 1082 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:45:15.625747 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b0ac807e-c5f8-4ccf-9908-4f5025c42fc9 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:15.626374 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b0ac807e-c5f8-4ccf-9908-4f5025c42fc9 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] [instance: 46b94da0-6f4a-4912-a2f1-e23b83df2052] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:15.731284 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b0ac807e-c5f8-4ccf-9908-4f5025c42fc9 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c112e27f9234237a138100fbc23818c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18b57cca5d34cada128b3a7e2b5adc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:15.743778 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b0ac807e-c5f8-4ccf-9908-4f5025c42fc9 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] 10.222.0.61 "GET /compute/v2.1/servers/46b94da0-6f4a-4912-a2f1-e23b83df2052" status: 200 len: 1294 microversion: 2.1 time: 0.121605 Aug 31 16:45:15.744653 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3330/6674] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:15 2022] GET /compute/v2.1/servers/46b94da0-6f4a-4912-a2f1-e23b83df2052 => generated 1294 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:16.433607 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3c9490fa-17f4-403a-9d8a-692c56ab38fd tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:16.434501 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3c9490fa-17f4-403a-9d8a-692c56ab38fd tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 15ac4673-682b-4707-a9d9-da02c4e37879] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:16.455783 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3c9490fa-17f4-403a-9d8a-692c56ab38fd tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:16.461126 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3c9490fa-17f4-403a-9d8a-692c56ab38fd tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:16.461767 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3c9490fa-17f4-403a-9d8a-692c56ab38fd tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:16.462804 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3c9490fa-17f4-403a-9d8a-692c56ab38fd tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:16.463226 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3c9490fa-17f4-403a-9d8a-692c56ab38fd tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:16.463860 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3c9490fa-17f4-403a-9d8a-692c56ab38fd tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:16.634986 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3c9490fa-17f4-403a-9d8a-692c56ab38fd tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:16.645293 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3c9490fa-17f4-403a-9d8a-692c56ab38fd tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/15ac4673-682b-4707-a9d9-da02c4e37879" status: 200 len: 1217 microversion: 2.1 time: 0.217078 Aug 31 16:45:16.646660 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3345/6675] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:16 2022] GET /compute/v2.1/servers/15ac4673-682b-4707-a9d9-da02c4e37879 => generated 1217 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:16.780573 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-95ed0b3f-9f7b-4e7b-a564-08dc2f212a15 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:16.782471 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-95ed0b3f-9f7b-4e7b-a564-08dc2f212a15 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] [instance: 46b94da0-6f4a-4912-a2f1-e23b83df2052] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:16.793749 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-95ed0b3f-9f7b-4e7b-a564-08dc2f212a15 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:16.794553 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-95ed0b3f-9f7b-4e7b-a564-08dc2f212a15 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:16.795294 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-95ed0b3f-9f7b-4e7b-a564-08dc2f212a15 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:16.796309 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-95ed0b3f-9f7b-4e7b-a564-08dc2f212a15 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:16.797032 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-95ed0b3f-9f7b-4e7b-a564-08dc2f212a15 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:16.797595 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-95ed0b3f-9f7b-4e7b-a564-08dc2f212a15 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:16.872569 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-95ed0b3f-9f7b-4e7b-a564-08dc2f212a15 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c112e27f9234237a138100fbc23818c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18b57cca5d34cada128b3a7e2b5adc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:16.883420 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-95ed0b3f-9f7b-4e7b-a564-08dc2f212a15 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] 10.222.0.61 "GET /compute/v2.1/servers/46b94da0-6f4a-4912-a2f1-e23b83df2052" status: 200 len: 1346 microversion: 2.1 time: 0.109646 Aug 31 16:45:16.884248 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3331/6676] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:16 2022] GET /compute/v2.1/servers/46b94da0-6f4a-4912-a2f1-e23b83df2052 => generated 1346 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:17.671911 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c0f6b201-7a99-4fbe-9731-2fbd899729cf tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:17.674253 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c0f6b201-7a99-4fbe-9731-2fbd899729cf tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 15ac4673-682b-4707-a9d9-da02c4e37879] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:17.683338 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c0f6b201-7a99-4fbe-9731-2fbd899729cf tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:17.683995 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c0f6b201-7a99-4fbe-9731-2fbd899729cf tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:17.684567 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c0f6b201-7a99-4fbe-9731-2fbd899729cf tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:17.685623 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c0f6b201-7a99-4fbe-9731-2fbd899729cf tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:17.686386 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c0f6b201-7a99-4fbe-9731-2fbd899729cf tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:17.686851 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c0f6b201-7a99-4fbe-9731-2fbd899729cf tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:17.905851 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f1049906-da29-45c9-be57-b03609809dd8 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:17.906503 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f1049906-da29-45c9-be57-b03609809dd8 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] [instance: 46b94da0-6f4a-4912-a2f1-e23b83df2052] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:17.915153 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f1049906-da29-45c9-be57-b03609809dd8 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:17.916211 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f1049906-da29-45c9-be57-b03609809dd8 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:17.916874 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f1049906-da29-45c9-be57-b03609809dd8 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:17.917825 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f1049906-da29-45c9-be57-b03609809dd8 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:17.918302 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f1049906-da29-45c9-be57-b03609809dd8 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:17.918742 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f1049906-da29-45c9-be57-b03609809dd8 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:18.156205 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f1049906-da29-45c9-be57-b03609809dd8 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c112e27f9234237a138100fbc23818c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18b57cca5d34cada128b3a7e2b5adc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:18.166698 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f1049906-da29-45c9-be57-b03609809dd8 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] 10.222.0.61 "GET /compute/v2.1/servers/46b94da0-6f4a-4912-a2f1-e23b83df2052" status: 200 len: 1352 microversion: 2.1 time: 0.265038 Aug 31 16:45:18.167701 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3332/6677] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:17 2022] GET /compute/v2.1/servers/46b94da0-6f4a-4912-a2f1-e23b83df2052 => generated 1352 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:45:18.303889 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c0f6b201-7a99-4fbe-9731-2fbd899729cf tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:18.315465 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c0f6b201-7a99-4fbe-9731-2fbd899729cf tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/15ac4673-682b-4707-a9d9-da02c4e37879" status: 200 len: 1217 microversion: 2.1 time: 0.647568 Aug 31 16:45:18.316479 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3346/6678] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:17 2022] GET /compute/v2.1/servers/15ac4673-682b-4707-a9d9-da02c4e37879 => generated 1217 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:18.828565 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-541387c0-412c-410b-b04c-8597c541d5f0 req-1f9e8af4-24d6-4eb4-a45e-793a7956cbf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15ac4673-682b-4707-a9d9-da02c4e37879", "name": "network-vif-plugged", "status": "completed", "tag": "3fdf4b50-f03c-4d02-ad34-9fb01e5a58a1"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:45:18.850899 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-541387c0-412c-410b-b04c-8597c541d5f0 req-1f9e8af4-24d6-4eb4-a45e-793a7956cbf9 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:18.851397 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-541387c0-412c-410b-b04c-8597c541d5f0 req-1f9e8af4-24d6-4eb4-a45e-793a7956cbf9 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:18.856683 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-541387c0-412c-410b-b04c-8597c541d5f0 req-1f9e8af4-24d6-4eb4-a45e-793a7956cbf9 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:18.885824 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-541387c0-412c-410b-b04c-8597c541d5f0 req-1f9e8af4-24d6-4eb4-a45e-793a7956cbf9 service nova] Creating event network-vif-plugged:3fdf4b50-f03c-4d02-ad34-9fb01e5a58a1 for instance 15ac4673-682b-4707-a9d9-da02c4e37879 on n-h1-850499-9 Aug 31 16:45:18.896997 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-541387c0-412c-410b-b04c-8597c541d5f0 req-1f9e8af4-24d6-4eb4-a45e-793a7956cbf9 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072009 Aug 31 16:45:18.899057 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3333/6679] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:45:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:45:19.189941 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6ff3796e-d770-4d85-9fb5-bf96c225d5a5 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:19.190658 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6ff3796e-d770-4d85-9fb5-bf96c225d5a5 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] [instance: 46b94da0-6f4a-4912-a2f1-e23b83df2052] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:19.197757 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6ff3796e-d770-4d85-9fb5-bf96c225d5a5 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:19.198257 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6ff3796e-d770-4d85-9fb5-bf96c225d5a5 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:19.198703 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6ff3796e-d770-4d85-9fb5-bf96c225d5a5 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:19.199447 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6ff3796e-d770-4d85-9fb5-bf96c225d5a5 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:19.200088 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6ff3796e-d770-4d85-9fb5-bf96c225d5a5 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:19.200529 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6ff3796e-d770-4d85-9fb5-bf96c225d5a5 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:19.203457 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=100 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:45:19.338782 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-06a7fbc9-8419-44e2-a9e6-c5ed77b7a924 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:19.339628 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-06a7fbc9-8419-44e2-a9e6-c5ed77b7a924 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 15ac4673-682b-4707-a9d9-da02c4e37879] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:19.346041 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-06a7fbc9-8419-44e2-a9e6-c5ed77b7a924 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:19.346603 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-06a7fbc9-8419-44e2-a9e6-c5ed77b7a924 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:19.347113 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-06a7fbc9-8419-44e2-a9e6-c5ed77b7a924 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:19.347963 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-06a7fbc9-8419-44e2-a9e6-c5ed77b7a924 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:19.348516 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-06a7fbc9-8419-44e2-a9e6-c5ed77b7a924 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:19.348997 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-06a7fbc9-8419-44e2-a9e6-c5ed77b7a924 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:19.472426 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-6ff3796e-d770-4d85-9fb5-bf96c225d5a5 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c112e27f9234237a138100fbc23818c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18b57cca5d34cada128b3a7e2b5adc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:19.484096 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6ff3796e-d770-4d85-9fb5-bf96c225d5a5 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] 10.222.0.61 "GET /compute/v2.1/servers/46b94da0-6f4a-4912-a2f1-e23b83df2052" status: 200 len: 1471 microversion: 2.1 time: 0.298347 Aug 31 16:45:19.490712 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3347/6680] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:19 2022] GET /compute/v2.1/servers/46b94da0-6f4a-4912-a2f1-e23b83df2052 => generated 1471 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:19.644357 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-06a7fbc9-8419-44e2-a9e6-c5ed77b7a924 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:19.656019 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-06a7fbc9-8419-44e2-a9e6-c5ed77b7a924 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/15ac4673-682b-4707-a9d9-da02c4e37879" status: 200 len: 1217 microversion: 2.1 time: 0.320198 Aug 31 16:45:19.656019 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3334/6681] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:19 2022] GET /compute/v2.1/servers/15ac4673-682b-4707-a9d9-da02c4e37879 => generated 1217 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:45:19.792717 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-ea4716b7-6c8a-4987-87b0-1dee7235d0c3 req-ebc3f0a2-ac92-4bc9-ba30-33dfa1ec3367 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46b94da0-6f4a-4912-a2f1-e23b83df2052", "tag": "81ad1ab6-2308-4a6f-8d44-b00c3f185571"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:45:19.809170 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-ea4716b7-6c8a-4987-87b0-1dee7235d0c3 req-ebc3f0a2-ac92-4bc9-ba30-33dfa1ec3367 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:19.809977 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-ea4716b7-6c8a-4987-87b0-1dee7235d0c3 req-ebc3f0a2-ac92-4bc9-ba30-33dfa1ec3367 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:19.810621 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-ea4716b7-6c8a-4987-87b0-1dee7235d0c3 req-ebc3f0a2-ac92-4bc9-ba30-33dfa1ec3367 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:19.828140 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-ea4716b7-6c8a-4987-87b0-1dee7235d0c3 req-ebc3f0a2-ac92-4bc9-ba30-33dfa1ec3367 service nova] Creating event network-changed:81ad1ab6-2308-4a6f-8d44-b00c3f185571 for instance 46b94da0-6f4a-4912-a2f1-e23b83df2052 on n-h2-850499-9 Aug 31 16:45:19.834612 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-ea4716b7-6c8a-4987-87b0-1dee7235d0c3 req-ebc3f0a2-ac92-4bc9-ba30-33dfa1ec3367 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046285 Aug 31 16:45:19.836167 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3348/6682] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:45:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:45:20.516332 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8c14e0cf-e9eb-44be-a2ef-d292a13d17b5 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:20.516991 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8c14e0cf-e9eb-44be-a2ef-d292a13d17b5 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] [instance: 46b94da0-6f4a-4912-a2f1-e23b83df2052] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:20.525353 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8c14e0cf-e9eb-44be-a2ef-d292a13d17b5 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:20.526189 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8c14e0cf-e9eb-44be-a2ef-d292a13d17b5 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:20.527068 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8c14e0cf-e9eb-44be-a2ef-d292a13d17b5 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:20.528151 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8c14e0cf-e9eb-44be-a2ef-d292a13d17b5 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:20.528655 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8c14e0cf-e9eb-44be-a2ef-d292a13d17b5 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:20.529244 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8c14e0cf-e9eb-44be-a2ef-d292a13d17b5 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:20.690042 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-00ea1c18-0a23-40d7-83c3-e3baf51eb584 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:20.694184 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-00ea1c18-0a23-40d7-83c3-e3baf51eb584 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 15ac4673-682b-4707-a9d9-da02c4e37879] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:20.720281 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-00ea1c18-0a23-40d7-83c3-e3baf51eb584 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:20.720965 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-00ea1c18-0a23-40d7-83c3-e3baf51eb584 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:20.721440 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-00ea1c18-0a23-40d7-83c3-e3baf51eb584 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:20.722211 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-00ea1c18-0a23-40d7-83c3-e3baf51eb584 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:20.722682 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-00ea1c18-0a23-40d7-83c3-e3baf51eb584 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:20.723333 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-00ea1c18-0a23-40d7-83c3-e3baf51eb584 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:20.732551 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8c14e0cf-e9eb-44be-a2ef-d292a13d17b5 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c112e27f9234237a138100fbc23818c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18b57cca5d34cada128b3a7e2b5adc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:20.743915 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8c14e0cf-e9eb-44be-a2ef-d292a13d17b5 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] 10.222.0.61 "GET /compute/v2.1/servers/46b94da0-6f4a-4912-a2f1-e23b83df2052" status: 200 len: 1471 microversion: 2.1 time: 0.234332 Aug 31 16:45:20.745154 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3335/6683] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:20 2022] GET /compute/v2.1/servers/46b94da0-6f4a-4912-a2f1-e23b83df2052 => generated 1471 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:20.896030 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-00ea1c18-0a23-40d7-83c3-e3baf51eb584 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:20.905022 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-00ea1c18-0a23-40d7-83c3-e3baf51eb584 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/15ac4673-682b-4707-a9d9-da02c4e37879" status: 200 len: 1217 microversion: 2.1 time: 0.219560 Aug 31 16:45:20.911606 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3349/6684] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:20 2022] GET /compute/v2.1/servers/15ac4673-682b-4707-a9d9-da02c4e37879 => generated 1217 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:21.771974 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c6a717a9-07cf-4139-b7e3-bb7f964c4c29 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:21.772596 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c6a717a9-07cf-4139-b7e3-bb7f964c4c29 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] [instance: 46b94da0-6f4a-4912-a2f1-e23b83df2052] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:21.780896 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c6a717a9-07cf-4139-b7e3-bb7f964c4c29 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:21.781394 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c6a717a9-07cf-4139-b7e3-bb7f964c4c29 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:21.781841 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c6a717a9-07cf-4139-b7e3-bb7f964c4c29 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:21.782544 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c6a717a9-07cf-4139-b7e3-bb7f964c4c29 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:21.783006 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c6a717a9-07cf-4139-b7e3-bb7f964c4c29 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:21.783436 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c6a717a9-07cf-4139-b7e3-bb7f964c4c29 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:21.926476 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d524d7c1-f828-4138-861c-34076996a1bf tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:21.927100 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d524d7c1-f828-4138-861c-34076996a1bf tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 15ac4673-682b-4707-a9d9-da02c4e37879] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:21.934957 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d524d7c1-f828-4138-861c-34076996a1bf tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:21.935465 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d524d7c1-f828-4138-861c-34076996a1bf tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:21.935672 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c6a717a9-07cf-4139-b7e3-bb7f964c4c29 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c112e27f9234237a138100fbc23818c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18b57cca5d34cada128b3a7e2b5adc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:21.935945 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d524d7c1-f828-4138-861c-34076996a1bf tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:21.936660 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d524d7c1-f828-4138-861c-34076996a1bf tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:21.937128 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d524d7c1-f828-4138-861c-34076996a1bf tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:21.937564 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d524d7c1-f828-4138-861c-34076996a1bf tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:21.943777 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c6a717a9-07cf-4139-b7e3-bb7f964c4c29 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] 10.222.0.61 "GET /compute/v2.1/servers/46b94da0-6f4a-4912-a2f1-e23b83df2052" status: 200 len: 1471 microversion: 2.1 time: 0.176693 Aug 31 16:45:21.944374 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3336/6685] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:21 2022] GET /compute/v2.1/servers/46b94da0-6f4a-4912-a2f1-e23b83df2052 => generated 1471 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:22.073657 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d524d7c1-f828-4138-861c-34076996a1bf tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:22.082286 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d524d7c1-f828-4138-861c-34076996a1bf tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/15ac4673-682b-4707-a9d9-da02c4e37879" status: 200 len: 1405 microversion: 2.1 time: 0.159983 Aug 31 16:45:22.083159 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3350/6686] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:21 2022] GET /compute/v2.1/servers/15ac4673-682b-4707-a9d9-da02c4e37879 => generated 1405 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:45:22.104048 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8ef400ad-11b2-4518-9bf7-55b1b203d8c0 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:22.104667 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8ef400ad-11b2-4518-9bf7-55b1b203d8c0 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 15ac4673-682b-4707-a9d9-da02c4e37879] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:22.110718 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8ef400ad-11b2-4518-9bf7-55b1b203d8c0 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:22.111208 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8ef400ad-11b2-4518-9bf7-55b1b203d8c0 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:22.111934 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8ef400ad-11b2-4518-9bf7-55b1b203d8c0 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:22.112673 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8ef400ad-11b2-4518-9bf7-55b1b203d8c0 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:22.113129 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8ef400ad-11b2-4518-9bf7-55b1b203d8c0 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:22.113557 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8ef400ad-11b2-4518-9bf7-55b1b203d8c0 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:22.254983 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8ef400ad-11b2-4518-9bf7-55b1b203d8c0 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:22.263528 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8ef400ad-11b2-4518-9bf7-55b1b203d8c0 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/15ac4673-682b-4707-a9d9-da02c4e37879" status: 200 len: 1405 microversion: 2.1 time: 0.163482 Aug 31 16:45:22.264108 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3337/6687] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:22 2022] GET /compute/v2.1/servers/15ac4673-682b-4707-a9d9-da02c4e37879 => generated 1405 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:22.283956 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-afaa2618-33bb-4f47-9bee-3a86d1c2bc39 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1732748176"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:45:22.286827 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-afaa2618-33bb-4f47-9bee-3a86d1c2bc39 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 15ac4673-682b-4707-a9d9-da02c4e37879] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:22.294450 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-afaa2618-33bb-4f47-9bee-3a86d1c2bc39 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:22.294948 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-afaa2618-33bb-4f47-9bee-3a86d1c2bc39 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:22.295393 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-afaa2618-33bb-4f47-9bee-3a86d1c2bc39 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:22.296129 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-afaa2618-33bb-4f47-9bee-3a86d1c2bc39 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:22.296593 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-afaa2618-33bb-4f47-9bee-3a86d1c2bc39 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:22.297027 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-afaa2618-33bb-4f47-9bee-3a86d1c2bc39 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:22.397589 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.compute.api [None req-afaa2618-33bb-4f47-9bee-3a86d1c2bc39 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 15ac4673-682b-4707-a9d9-da02c4e37879] Attempting to quiesce instance before volume snapshot. Aug 31 16:45:22.463193 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.compute.api [None req-afaa2618-33bb-4f47-9bee-3a86d1c2bc39 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 15ac4673-682b-4707-a9d9-da02c4e37879] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Aug 31 16:45:22.537652 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-afaa2618-33bb-4f47-9bee-3a86d1c2bc39 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 15ac4673-682b-4707-a9d9-da02c4e37879] Creating snapshot from volume e259e878-9b32-42de-99f9-26a08af2e67e. {{(pid=122257) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Aug 31 16:45:22.966374 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-92748fc7-df3c-4200-80c3-5e9d97212513 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:22.967959 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-92748fc7-df3c-4200-80c3-5e9d97212513 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] [instance: 46b94da0-6f4a-4912-a2f1-e23b83df2052] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:22.975153 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-92748fc7-df3c-4200-80c3-5e9d97212513 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:22.975681 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-92748fc7-df3c-4200-80c3-5e9d97212513 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:22.976375 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-92748fc7-df3c-4200-80c3-5e9d97212513 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:22.977884 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-92748fc7-df3c-4200-80c3-5e9d97212513 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:22.978623 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-92748fc7-df3c-4200-80c3-5e9d97212513 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:22.979341 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-92748fc7-df3c-4200-80c3-5e9d97212513 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:23.172909 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-92748fc7-df3c-4200-80c3-5e9d97212513 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c112e27f9234237a138100fbc23818c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18b57cca5d34cada128b3a7e2b5adc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:23.183858 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-92748fc7-df3c-4200-80c3-5e9d97212513 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] 10.222.0.61 "GET /compute/v2.1/servers/46b94da0-6f4a-4912-a2f1-e23b83df2052" status: 200 len: 1471 microversion: 2.1 time: 0.221497 Aug 31 16:45:23.185247 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3338/6688] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:22 2022] GET /compute/v2.1/servers/46b94da0-6f4a-4912-a2f1-e23b83df2052 => generated 1471 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:45:23.604553 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-afaa2618-33bb-4f47-9bee-3a86d1c2bc39 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "POST /compute/v2.1/servers/15ac4673-682b-4707-a9d9-da02c4e37879/action" status: 202 len: 0 microversion: 2.1 time: 1.324497 Aug 31 16:45:23.605201 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3351/6689] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:45:22 2022] POST /compute/v2.1/servers/15ac4673-682b-4707-a9d9-da02c4e37879/action => generated 0 bytes in 1326 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 31 16:45:24.222597 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-85be0597-f85b-4d36-876c-02c7b8be320d tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:24.225324 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-85be0597-f85b-4d36-876c-02c7b8be320d tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] [instance: 46b94da0-6f4a-4912-a2f1-e23b83df2052] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:24.237257 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-85be0597-f85b-4d36-876c-02c7b8be320d tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:24.237758 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-85be0597-f85b-4d36-876c-02c7b8be320d tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:24.238231 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-85be0597-f85b-4d36-876c-02c7b8be320d tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:24.239152 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-85be0597-f85b-4d36-876c-02c7b8be320d tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:24.239853 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-85be0597-f85b-4d36-876c-02c7b8be320d tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:24.240449 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-85be0597-f85b-4d36-876c-02c7b8be320d tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:24.594121 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-85be0597-f85b-4d36-876c-02c7b8be320d tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c112e27f9234237a138100fbc23818c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18b57cca5d34cada128b3a7e2b5adc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:24.609913 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-85be0597-f85b-4d36-876c-02c7b8be320d tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] 10.222.0.61 "GET /compute/v2.1/servers/46b94da0-6f4a-4912-a2f1-e23b83df2052" status: 200 len: 1471 microversion: 2.1 time: 0.399410 Aug 31 16:45:24.610658 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3339/6690] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:24 2022] GET /compute/v2.1/servers/46b94da0-6f4a-4912-a2f1-e23b83df2052 => generated 1471 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:24.990799 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8eea95be-ab13-481e-ae17-6726c86f1eef tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1462040553", "imageRef": "a68e3389-9c81-43c9-b596-e2e4978897fb", "flavorRef": "452", "networks": [{"uuid": "0b707539-6131-412e-ba43-5bdd2cb0fbe5"}]}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:45:25.053851 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-8eea95be-ab13-481e-ae17-6726c86f1eef tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] validate_networks() for [('0b707539-6131-412e-ba43-5bdd2cb0fbe5', None, None, None, None, None)] {{(pid=122257) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:45:25.475582 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:45:25.522608 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=10 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:45:25.553279 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-8eea95be-ab13-481e-ae17-6726c86f1eef tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:45:25.553793 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-8eea95be-ab13-481e-ae17-6726c86f1eef tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:45:25.554364 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-8eea95be-ab13-481e-ae17-6726c86f1eef tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:45:25.554892 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-8eea95be-ab13-481e-ae17-6726c86f1eef tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:45:25.555385 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-8eea95be-ab13-481e-ae17-6726c86f1eef tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:45:25.566561 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8eea95be-ab13-481e-ae17-6726c86f1eef tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:25.567034 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8eea95be-ab13-481e-ae17-6726c86f1eef tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:25.567697 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8eea95be-ab13-481e-ae17-6726c86f1eef tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:25.568557 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8eea95be-ab13-481e-ae17-6726c86f1eef tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:25.569554 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8eea95be-ab13-481e-ae17-6726c86f1eef tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:25.569554 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8eea95be-ab13-481e-ae17-6726c86f1eef tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:25.587350 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-8eea95be-ab13-481e-ae17-6726c86f1eef tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Getting quotas for project 798d7eff58b04ab582bac1e87112625f. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:45:25.593668 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-8eea95be-ab13-481e-ae17-6726c86f1eef tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Getting quotas for user 588d2ef08d8345a6b6175c8287633270 and project 798d7eff58b04ab582bac1e87112625f. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:45:25.615861 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8eea95be-ab13-481e-ae17-6726c86f1eef tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Going to run 1 instances... {{(pid=122257) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:45:25.619990 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8eea95be-ab13-481e-ae17-6726c86f1eef tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: b4017430-cc40-4cfe-a387-49283eaa8a42] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='117343a7-f70a-4f42-b18e-c1423c29547b',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:45:25.631895 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3f9c923e-4c47-49d6-9659-b3f9da11e508 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:25.632602 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3f9c923e-4c47-49d6-9659-b3f9da11e508 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] [instance: 46b94da0-6f4a-4912-a2f1-e23b83df2052] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:25.640452 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3f9c923e-4c47-49d6-9659-b3f9da11e508 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:25.640987 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3f9c923e-4c47-49d6-9659-b3f9da11e508 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:25.641405 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3f9c923e-4c47-49d6-9659-b3f9da11e508 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:25.642224 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3f9c923e-4c47-49d6-9659-b3f9da11e508 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:25.642538 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3f9c923e-4c47-49d6-9659-b3f9da11e508 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:25.642973 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3f9c923e-4c47-49d6-9659-b3f9da11e508 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:25.718204 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8eea95be-ab13-481e-ae17-6726c86f1eef tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.734777 Aug 31 16:45:25.719094 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3352/6691] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:45:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 737 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:45:25.736982 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:45:25.740147 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-55dcbbec-5809-463d-91d3-74521e6a18c0 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:25.741311 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-55dcbbec-5809-463d-91d3-74521e6a18c0 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: b4017430-cc40-4cfe-a387-49283eaa8a42] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:25.836398 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-55dcbbec-5809-463d-91d3-74521e6a18c0 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:25.848197 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-55dcbbec-5809-463d-91d3-74521e6a18c0 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/b4017430-cc40-4cfe-a387-49283eaa8a42" status: 200 len: 1230 microversion: 2.1 time: 0.117156 Aug 31 16:45:25.852476 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3353/6692] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:25 2022] GET /compute/v2.1/servers/b4017430-cc40-4cfe-a387-49283eaa8a42 => generated 1230 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:45:25.897920 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3f9c923e-4c47-49d6-9659-b3f9da11e508 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c112e27f9234237a138100fbc23818c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18b57cca5d34cada128b3a7e2b5adc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:25.908910 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3f9c923e-4c47-49d6-9659-b3f9da11e508 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] 10.222.0.61 "GET /compute/v2.1/servers/46b94da0-6f4a-4912-a2f1-e23b83df2052" status: 200 len: 1471 microversion: 2.1 time: 0.280716 Aug 31 16:45:25.909514 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3340/6693] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:25 2022] GET /compute/v2.1/servers/46b94da0-6f4a-4912-a2f1-e23b83df2052 => generated 1471 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:26.302767 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-75cf5260-66e5-48a1-b8cf-8f413b6010f3 req-5ed54837-9ac4-4727-9a0e-90febce8fa1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46b94da0-6f4a-4912-a2f1-e23b83df2052", "name": "network-vif-plugged", "status": "completed", "tag": "81ad1ab6-2308-4a6f-8d44-b00c3f185571"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:45:26.316773 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-75cf5260-66e5-48a1-b8cf-8f413b6010f3 req-5ed54837-9ac4-4727-9a0e-90febce8fa1a service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:26.317581 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-75cf5260-66e5-48a1-b8cf-8f413b6010f3 req-5ed54837-9ac4-4727-9a0e-90febce8fa1a service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:26.317899 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-75cf5260-66e5-48a1-b8cf-8f413b6010f3 req-5ed54837-9ac4-4727-9a0e-90febce8fa1a service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:26.331248 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-75cf5260-66e5-48a1-b8cf-8f413b6010f3 req-5ed54837-9ac4-4727-9a0e-90febce8fa1a service nova] Creating event network-vif-plugged:81ad1ab6-2308-4a6f-8d44-b00c3f185571 for instance 46b94da0-6f4a-4912-a2f1-e23b83df2052 on n-h2-850499-9 Aug 31 16:45:26.338151 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-75cf5260-66e5-48a1-b8cf-8f413b6010f3 req-5ed54837-9ac4-4727-9a0e-90febce8fa1a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039058 Aug 31 16:45:26.339145 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3354/6694] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:45:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:45:26.875489 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-65bebbf0-ca54-4fa6-b73e-5591ef40b396 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:26.876624 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-65bebbf0-ca54-4fa6-b73e-5591ef40b396 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: b4017430-cc40-4cfe-a387-49283eaa8a42] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:26.887988 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=6 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:45:26.892679 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-65bebbf0-ca54-4fa6-b73e-5591ef40b396 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:26.893468 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-65bebbf0-ca54-4fa6-b73e-5591ef40b396 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:26.895227 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-65bebbf0-ca54-4fa6-b73e-5591ef40b396 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:26.896597 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-65bebbf0-ca54-4fa6-b73e-5591ef40b396 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:26.898103 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-65bebbf0-ca54-4fa6-b73e-5591ef40b396 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:26.898673 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-65bebbf0-ca54-4fa6-b73e-5591ef40b396 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:26.943353 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-abb9647d-953e-4051-8f1a-dc606705c14e tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:26.944530 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-abb9647d-953e-4051-8f1a-dc606705c14e tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] [instance: 46b94da0-6f4a-4912-a2f1-e23b83df2052] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:26.953162 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-abb9647d-953e-4051-8f1a-dc606705c14e tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:26.953968 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-abb9647d-953e-4051-8f1a-dc606705c14e tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:26.954635 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-abb9647d-953e-4051-8f1a-dc606705c14e tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:26.955607 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-abb9647d-953e-4051-8f1a-dc606705c14e tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:26.956265 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-abb9647d-953e-4051-8f1a-dc606705c14e tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:26.956889 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-abb9647d-953e-4051-8f1a-dc606705c14e tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:26.996296 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-65bebbf0-ca54-4fa6-b73e-5591ef40b396 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:27.007467 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-65bebbf0-ca54-4fa6-b73e-5591ef40b396 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/b4017430-cc40-4cfe-a387-49283eaa8a42" status: 200 len: 1282 microversion: 2.1 time: 0.136754 Aug 31 16:45:27.008071 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3341/6695] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:26 2022] GET /compute/v2.1/servers/b4017430-cc40-4cfe-a387-49283eaa8a42 => generated 1282 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:27.161397 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-abb9647d-953e-4051-8f1a-dc606705c14e tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c112e27f9234237a138100fbc23818c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18b57cca5d34cada128b3a7e2b5adc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:27.170076 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-abb9647d-953e-4051-8f1a-dc606705c14e tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] 10.222.0.61 "GET /compute/v2.1/servers/46b94da0-6f4a-4912-a2f1-e23b83df2052" status: 200 len: 1471 microversion: 2.1 time: 0.233347 Aug 31 16:45:27.170676 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3355/6696] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:26 2022] GET /compute/v2.1/servers/46b94da0-6f4a-4912-a2f1-e23b83df2052 => generated 1471 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:28.030369 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-40edae61-3ba7-4838-8b05-9640732555a1 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:28.031756 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-40edae61-3ba7-4838-8b05-9640732555a1 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: b4017430-cc40-4cfe-a387-49283eaa8a42] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:28.043251 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-40edae61-3ba7-4838-8b05-9640732555a1 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:28.044523 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-40edae61-3ba7-4838-8b05-9640732555a1 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:28.046818 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-40edae61-3ba7-4838-8b05-9640732555a1 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:28.048342 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-40edae61-3ba7-4838-8b05-9640732555a1 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:28.050038 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-40edae61-3ba7-4838-8b05-9640732555a1 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:28.050673 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-40edae61-3ba7-4838-8b05-9640732555a1 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:28.200336 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9ebcbf31-98e8-4788-874b-15f1ffc6a455 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:28.201680 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9ebcbf31-98e8-4788-874b-15f1ffc6a455 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] [instance: 46b94da0-6f4a-4912-a2f1-e23b83df2052] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:28.221979 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9ebcbf31-98e8-4788-874b-15f1ffc6a455 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:28.224608 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9ebcbf31-98e8-4788-874b-15f1ffc6a455 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:28.237333 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9ebcbf31-98e8-4788-874b-15f1ffc6a455 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:28.239014 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9ebcbf31-98e8-4788-874b-15f1ffc6a455 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:28.243698 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9ebcbf31-98e8-4788-874b-15f1ffc6a455 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:28.244699 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9ebcbf31-98e8-4788-874b-15f1ffc6a455 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:28.349298 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-40edae61-3ba7-4838-8b05-9640732555a1 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:28.361315 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-40edae61-3ba7-4838-8b05-9640732555a1 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/b4017430-cc40-4cfe-a387-49283eaa8a42" status: 200 len: 1342 microversion: 2.1 time: 0.334528 Aug 31 16:45:28.369635 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3342/6697] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:28 2022] GET /compute/v2.1/servers/b4017430-cc40-4cfe-a387-49283eaa8a42 => generated 1342 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:45:28.587282 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9ebcbf31-98e8-4788-874b-15f1ffc6a455 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c112e27f9234237a138100fbc23818c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18b57cca5d34cada128b3a7e2b5adc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:28.648158 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9ebcbf31-98e8-4788-874b-15f1ffc6a455 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] 10.222.0.61 "GET /compute/v2.1/servers/46b94da0-6f4a-4912-a2f1-e23b83df2052" status: 200 len: 1471 microversion: 2.1 time: 0.452385 Aug 31 16:45:28.652774 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3356/6698] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:28 2022] GET /compute/v2.1/servers/46b94da0-6f4a-4912-a2f1-e23b83df2052 => generated 1471 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:29.392012 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9e219463-10c7-4fde-b8e6-1c0f9dfe439a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:29.393062 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9e219463-10c7-4fde-b8e6-1c0f9dfe439a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: b4017430-cc40-4cfe-a387-49283eaa8a42] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:29.408822 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9e219463-10c7-4fde-b8e6-1c0f9dfe439a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:29.409044 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9e219463-10c7-4fde-b8e6-1c0f9dfe439a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:29.411086 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9e219463-10c7-4fde-b8e6-1c0f9dfe439a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:29.412219 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9e219463-10c7-4fde-b8e6-1c0f9dfe439a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:29.413183 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9e219463-10c7-4fde-b8e6-1c0f9dfe439a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:29.413793 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9e219463-10c7-4fde-b8e6-1c0f9dfe439a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:29.693282 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-bea7584d-c97d-46e7-ad92-2f038c6f28ae req-03015530-e38d-4956-939e-e3ff0fde779e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4017430-cc40-4cfe-a387-49283eaa8a42", "tag": "f8146720-1978-4445-ac4c-8e9692d3809e"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:45:29.733212 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-bea7584d-c97d-46e7-ad92-2f038c6f28ae req-03015530-e38d-4956-939e-e3ff0fde779e service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:29.734336 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-bea7584d-c97d-46e7-ad92-2f038c6f28ae req-03015530-e38d-4956-939e-e3ff0fde779e service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:29.735067 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-bea7584d-c97d-46e7-ad92-2f038c6f28ae req-03015530-e38d-4956-939e-e3ff0fde779e service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:29.758392 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-bea7584d-c97d-46e7-ad92-2f038c6f28ae req-03015530-e38d-4956-939e-e3ff0fde779e service nova] Creating event network-changed:f8146720-1978-4445-ac4c-8e9692d3809e for instance b4017430-cc40-4cfe-a387-49283eaa8a42 on n-h1-850499-9 Aug 31 16:45:29.775223 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-bea7584d-c97d-46e7-ad92-2f038c6f28ae req-03015530-e38d-4956-939e-e3ff0fde779e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104223 Aug 31 16:45:29.776345 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3357/6699] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:45:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:45:29.782902 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-250add59-51b7-423d-8727-2bb685608302 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:29.785439 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-250add59-51b7-423d-8727-2bb685608302 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] [instance: 46b94da0-6f4a-4912-a2f1-e23b83df2052] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:29.795089 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-250add59-51b7-423d-8727-2bb685608302 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:29.796097 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-250add59-51b7-423d-8727-2bb685608302 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:29.797164 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-250add59-51b7-423d-8727-2bb685608302 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:29.801969 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-9e219463-10c7-4fde-b8e6-1c0f9dfe439a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:29.807652 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-250add59-51b7-423d-8727-2bb685608302 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:29.811010 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-250add59-51b7-423d-8727-2bb685608302 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:29.815186 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-250add59-51b7-423d-8727-2bb685608302 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:29.820567 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9e219463-10c7-4fde-b8e6-1c0f9dfe439a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/b4017430-cc40-4cfe-a387-49283eaa8a42" status: 200 len: 1342 microversion: 2.1 time: 0.427537 Aug 31 16:45:29.822207 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3343/6700] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:29 2022] GET /compute/v2.1/servers/b4017430-cc40-4cfe-a387-49283eaa8a42 => generated 1342 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:30.126334 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-250add59-51b7-423d-8727-2bb685608302 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c112e27f9234237a138100fbc23818c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18b57cca5d34cada128b3a7e2b5adc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:30.149374 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-250add59-51b7-423d-8727-2bb685608302 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] 10.222.0.61 "GET /compute/v2.1/servers/46b94da0-6f4a-4912-a2f1-e23b83df2052" status: 200 len: 1642 microversion: 2.1 time: 0.369982 Aug 31 16:45:30.160184 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3358/6701] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:29 2022] GET /compute/v2.1/servers/46b94da0-6f4a-4912-a2f1-e23b83df2052 => generated 1642 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:30.173884 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5531cf80-7d57-4453-b555-e24693450d69 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:30.175243 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5531cf80-7d57-4453-b555-e24693450d69 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] [instance: 46b94da0-6f4a-4912-a2f1-e23b83df2052] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:30.191400 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5531cf80-7d57-4453-b555-e24693450d69 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:30.192747 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5531cf80-7d57-4453-b555-e24693450d69 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:30.193422 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5531cf80-7d57-4453-b555-e24693450d69 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:30.194394 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5531cf80-7d57-4453-b555-e24693450d69 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:30.195088 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5531cf80-7d57-4453-b555-e24693450d69 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:30.195992 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5531cf80-7d57-4453-b555-e24693450d69 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:30.554413 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5531cf80-7d57-4453-b555-e24693450d69 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c112e27f9234237a138100fbc23818c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18b57cca5d34cada128b3a7e2b5adc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:30.643560 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5531cf80-7d57-4453-b555-e24693450d69 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] 10.222.0.61 "GET /compute/v2.1/servers/46b94da0-6f4a-4912-a2f1-e23b83df2052" status: 200 len: 1642 microversion: 2.1 time: 0.463303 Aug 31 16:45:30.647410 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3344/6702] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:30 2022] GET /compute/v2.1/servers/46b94da0-6f4a-4912-a2f1-e23b83df2052 => generated 1642 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:30.691426 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-de0e4ad2-c32a-416c-8f0c-9fa052ed21dd tempest-TestSecurityGroupsBasicOps-2044291637 tempest-TestSecurityGroupsBasicOps-2044291637-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:30.697792 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-de0e4ad2-c32a-416c-8f0c-9fa052ed21dd tempest-TestSecurityGroupsBasicOps-2044291637 tempest-TestSecurityGroupsBasicOps-2044291637-project-admin] [instance: 46b94da0-6f4a-4912-a2f1-e23b83df2052] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:30.718855 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-de0e4ad2-c32a-416c-8f0c-9fa052ed21dd tempest-TestSecurityGroupsBasicOps-2044291637 tempest-TestSecurityGroupsBasicOps-2044291637-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:30.722425 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-de0e4ad2-c32a-416c-8f0c-9fa052ed21dd tempest-TestSecurityGroupsBasicOps-2044291637 tempest-TestSecurityGroupsBasicOps-2044291637-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:30.731568 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-de0e4ad2-c32a-416c-8f0c-9fa052ed21dd tempest-TestSecurityGroupsBasicOps-2044291637 tempest-TestSecurityGroupsBasicOps-2044291637-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:30.732344 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-de0e4ad2-c32a-416c-8f0c-9fa052ed21dd tempest-TestSecurityGroupsBasicOps-2044291637 tempest-TestSecurityGroupsBasicOps-2044291637-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:30.733039 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-de0e4ad2-c32a-416c-8f0c-9fa052ed21dd tempest-TestSecurityGroupsBasicOps-2044291637 tempest-TestSecurityGroupsBasicOps-2044291637-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:30.733666 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-de0e4ad2-c32a-416c-8f0c-9fa052ed21dd tempest-TestSecurityGroupsBasicOps-2044291637 tempest-TestSecurityGroupsBasicOps-2044291637-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:30.842617 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-93afb6dc-75b2-4ae1-b509-0959d50bce64 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:30.843268 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-93afb6dc-75b2-4ae1-b509-0959d50bce64 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: b4017430-cc40-4cfe-a387-49283eaa8a42] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:30.850944 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-93afb6dc-75b2-4ae1-b509-0959d50bce64 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:30.855492 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-93afb6dc-75b2-4ae1-b509-0959d50bce64 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:30.856126 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-93afb6dc-75b2-4ae1-b509-0959d50bce64 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:30.856956 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-93afb6dc-75b2-4ae1-b509-0959d50bce64 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:30.857535 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-93afb6dc-75b2-4ae1-b509-0959d50bce64 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:30.858178 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-93afb6dc-75b2-4ae1-b509-0959d50bce64 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:31.196839 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-93afb6dc-75b2-4ae1-b509-0959d50bce64 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:31.217633 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-93afb6dc-75b2-4ae1-b509-0959d50bce64 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/b4017430-cc40-4cfe-a387-49283eaa8a42" status: 200 len: 1342 microversion: 2.1 time: 0.378827 Aug 31 16:45:31.224194 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3345/6703] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:30 2022] GET /compute/v2.1/servers/b4017430-cc40-4cfe-a387-49283eaa8a42 => generated 1342 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:45:31.806075 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-de0e4ad2-c32a-416c-8f0c-9fa052ed21dd tempest-TestSecurityGroupsBasicOps-2044291637 tempest-TestSecurityGroupsBasicOps-2044291637-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/46b94da0-6f4a-4912-a2f1-e23b83df2052" status: 200 len: 1793 microversion: 2.1 time: 1.137217 Aug 31 16:45:31.806744 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3359/6704] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:30 2022] GET /compute/v2.1/servers/46b94da0-6f4a-4912-a2f1-e23b83df2052 => generated 1793 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:32.247428 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ea485bcd-a425-42c9-9222-43172cb8b66d tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:32.248991 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ea485bcd-a425-42c9-9222-43172cb8b66d tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: b4017430-cc40-4cfe-a387-49283eaa8a42] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:32.270880 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ea485bcd-a425-42c9-9222-43172cb8b66d tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:32.272570 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ea485bcd-a425-42c9-9222-43172cb8b66d tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:32.274483 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ea485bcd-a425-42c9-9222-43172cb8b66d tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:32.278318 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ea485bcd-a425-42c9-9222-43172cb8b66d tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:32.279770 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ea485bcd-a425-42c9-9222-43172cb8b66d tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:32.279770 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ea485bcd-a425-42c9-9222-43172cb8b66d tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:32.289337 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=100 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:45:32.566618 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ea485bcd-a425-42c9-9222-43172cb8b66d tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:32.580831 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ea485bcd-a425-42c9-9222-43172cb8b66d tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/b4017430-cc40-4cfe-a387-49283eaa8a42" status: 200 len: 1342 microversion: 2.1 time: 0.338893 Aug 31 16:45:32.582229 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3346/6705] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:32 2022] GET /compute/v2.1/servers/b4017430-cc40-4cfe-a387-49283eaa8a42 => generated 1342 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:33.603690 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1c0a3780-c73c-4a07-9462-735bfd187032 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:33.604300 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1c0a3780-c73c-4a07-9462-735bfd187032 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: b4017430-cc40-4cfe-a387-49283eaa8a42] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:33.614359 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1c0a3780-c73c-4a07-9462-735bfd187032 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:33.614873 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1c0a3780-c73c-4a07-9462-735bfd187032 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:33.615327 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1c0a3780-c73c-4a07-9462-735bfd187032 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:33.616083 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1c0a3780-c73c-4a07-9462-735bfd187032 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:33.616556 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1c0a3780-c73c-4a07-9462-735bfd187032 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:33.617002 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1c0a3780-c73c-4a07-9462-735bfd187032 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:33.934224 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-1c0a3780-c73c-4a07-9462-735bfd187032 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:33.944406 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1c0a3780-c73c-4a07-9462-735bfd187032 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/b4017430-cc40-4cfe-a387-49283eaa8a42" status: 200 len: 1342 microversion: 2.1 time: 0.345745 Aug 31 16:45:33.960625 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3360/6706] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:33 2022] GET /compute/v2.1/servers/b4017430-cc40-4cfe-a387-49283eaa8a42 => generated 1342 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:34.934176 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-0045f22d-9c5e-42cd-a47c-0153a3e06141 req-38bf33b5-aeb6-45d6-95ce-4f99ef320753 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46b94da0-6f4a-4912-a2f1-e23b83df2052", "tag": "81ad1ab6-2308-4a6f-8d44-b00c3f185571"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:45:34.957878 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-0045f22d-9c5e-42cd-a47c-0153a3e06141 req-38bf33b5-aeb6-45d6-95ce-4f99ef320753 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:34.965543 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-0045f22d-9c5e-42cd-a47c-0153a3e06141 req-38bf33b5-aeb6-45d6-95ce-4f99ef320753 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:34.967371 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-0045f22d-9c5e-42cd-a47c-0153a3e06141 req-38bf33b5-aeb6-45d6-95ce-4f99ef320753 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:34.979335 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b5a93f90-6901-4164-88f5-83708685278b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:34.986191 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b5a93f90-6901-4164-88f5-83708685278b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: b4017430-cc40-4cfe-a387-49283eaa8a42] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:34.996246 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-0045f22d-9c5e-42cd-a47c-0153a3e06141 req-38bf33b5-aeb6-45d6-95ce-4f99ef320753 service nova] Creating event network-changed:81ad1ab6-2308-4a6f-8d44-b00c3f185571 for instance 46b94da0-6f4a-4912-a2f1-e23b83df2052 on n-h2-850499-9 Aug 31 16:45:34.996975 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=7 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:45:35.006989 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-0045f22d-9c5e-42cd-a47c-0153a3e06141 req-38bf33b5-aeb6-45d6-95ce-4f99ef320753 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.297875 Aug 31 16:45:35.008729 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3347/6707] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:45:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:45:35.014421 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b5a93f90-6901-4164-88f5-83708685278b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:35.018651 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b5a93f90-6901-4164-88f5-83708685278b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:35.019545 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b5a93f90-6901-4164-88f5-83708685278b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:35.020944 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b5a93f90-6901-4164-88f5-83708685278b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:35.025783 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b5a93f90-6901-4164-88f5-83708685278b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:35.027548 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b5a93f90-6901-4164-88f5-83708685278b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:35.578058 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:45:35.814431 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b5a93f90-6901-4164-88f5-83708685278b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:35.840314 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b5a93f90-6901-4164-88f5-83708685278b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/b4017430-cc40-4cfe-a387-49283eaa8a42" status: 200 len: 1342 microversion: 2.1 time: 0.872020 Aug 31 16:45:35.841675 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3361/6708] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:34 2022] GET /compute/v2.1/servers/b4017430-cc40-4cfe-a387-49283eaa8a42 => generated 1342 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:36.875320 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-44540a38-7f85-469a-9ef7-74bdfb37b00e tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:36.877005 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-44540a38-7f85-469a-9ef7-74bdfb37b00e tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] [instance: a4dcf873-c5d9-4e9d-90d3-671d3c5a553b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:36.890825 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-44540a38-7f85-469a-9ef7-74bdfb37b00e tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:36.892218 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-44540a38-7f85-469a-9ef7-74bdfb37b00e tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:36.893259 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-44540a38-7f85-469a-9ef7-74bdfb37b00e tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:36.894824 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-44540a38-7f85-469a-9ef7-74bdfb37b00e tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:36.895815 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-44540a38-7f85-469a-9ef7-74bdfb37b00e tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:36.896832 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-44540a38-7f85-469a-9ef7-74bdfb37b00e tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:36.897552 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-05b9a199-ce94-4dfe-aaec-156ac9407147 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:36.902711 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-05b9a199-ce94-4dfe-aaec-156ac9407147 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: b4017430-cc40-4cfe-a387-49283eaa8a42] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:36.905477 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=8 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:45:36.916758 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-05b9a199-ce94-4dfe-aaec-156ac9407147 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:36.923705 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-05b9a199-ce94-4dfe-aaec-156ac9407147 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:36.924412 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-05b9a199-ce94-4dfe-aaec-156ac9407147 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:36.925590 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-05b9a199-ce94-4dfe-aaec-156ac9407147 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:36.926074 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-05b9a199-ce94-4dfe-aaec-156ac9407147 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:36.926585 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-05b9a199-ce94-4dfe-aaec-156ac9407147 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:37.014321 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-44540a38-7f85-469a-9ef7-74bdfb37b00e tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lazy-loading 'services' on Instance uuid a4dcf873-c5d9-4e9d-90d3-671d3c5a553b {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:45:37.202696 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-05b9a199-ce94-4dfe-aaec-156ac9407147 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:37.223463 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-05b9a199-ce94-4dfe-aaec-156ac9407147 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/b4017430-cc40-4cfe-a387-49283eaa8a42" status: 200 len: 1342 microversion: 2.1 time: 0.331754 Aug 31 16:45:37.224908 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3362/6709] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:36 2022] GET /compute/v2.1/servers/b4017430-cc40-4cfe-a387-49283eaa8a42 => generated 1342 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:37.249937 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-44540a38-7f85-469a-9ef7-74bdfb37b00e tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] 10.222.0.61 "DELETE /compute/v2.1/servers/a4dcf873-c5d9-4e9d-90d3-671d3c5a553b/os-volume_attachments/661b7538-b92b-452e-b362-37a9181bb2cb" status: 202 len: 0 microversion: 2.1 time: 0.384228 Aug 31 16:45:37.250559 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3348/6710] 10.222.0.61 () {58 vars in 1416 bytes} [Wed Aug 31 16:45:36 2022] DELETE /compute/v2.1/servers/a4dcf873-c5d9-4e9d-90d3-671d3c5a553b/os-volume_attachments/661b7538-b92b-452e-b362-37a9181bb2cb => generated 0 bytes in 387 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:45:38.248683 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-cac1d853-29c0-49b5-b51f-c9c20acccf51 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:38.249340 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-cac1d853-29c0-49b5-b51f-c9c20acccf51 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: b4017430-cc40-4cfe-a387-49283eaa8a42] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:38.256837 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cac1d853-29c0-49b5-b51f-c9c20acccf51 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:38.257458 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cac1d853-29c0-49b5-b51f-c9c20acccf51 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:38.258589 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cac1d853-29c0-49b5-b51f-c9c20acccf51 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:38.259315 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cac1d853-29c0-49b5-b51f-c9c20acccf51 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:38.259810 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cac1d853-29c0-49b5-b51f-c9c20acccf51 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:38.260247 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cac1d853-29c0-49b5-b51f-c9c20acccf51 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:38.462632 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-cac1d853-29c0-49b5-b51f-c9c20acccf51 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:38.474376 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-cac1d853-29c0-49b5-b51f-c9c20acccf51 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/b4017430-cc40-4cfe-a387-49283eaa8a42" status: 200 len: 1342 microversion: 2.1 time: 0.230324 Aug 31 16:45:38.487874 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3363/6711] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:38 2022] GET /compute/v2.1/servers/b4017430-cc40-4cfe-a387-49283eaa8a42 => generated 1342 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:45:39.499644 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9969c7c4-e4ec-49bd-b9e9-29f19e6ecb6a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:39.501269 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9969c7c4-e4ec-49bd-b9e9-29f19e6ecb6a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: b4017430-cc40-4cfe-a387-49283eaa8a42] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:39.511127 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9969c7c4-e4ec-49bd-b9e9-29f19e6ecb6a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:39.512771 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9969c7c4-e4ec-49bd-b9e9-29f19e6ecb6a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:39.512771 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9969c7c4-e4ec-49bd-b9e9-29f19e6ecb6a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:39.513218 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9969c7c4-e4ec-49bd-b9e9-29f19e6ecb6a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:39.513796 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9969c7c4-e4ec-49bd-b9e9-29f19e6ecb6a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:39.514487 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9969c7c4-e4ec-49bd-b9e9-29f19e6ecb6a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:39.679368 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-9969c7c4-e4ec-49bd-b9e9-29f19e6ecb6a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:39.688459 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9969c7c4-e4ec-49bd-b9e9-29f19e6ecb6a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/b4017430-cc40-4cfe-a387-49283eaa8a42" status: 200 len: 1342 microversion: 2.1 time: 0.195289 Aug 31 16:45:39.689048 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3349/6712] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:39 2022] GET /compute/v2.1/servers/b4017430-cc40-4cfe-a387-49283eaa8a42 => generated 1342 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:40.710476 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-43e01982-c432-41af-bdd2-ec26dae38e90 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:40.712629 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-43e01982-c432-41af-bdd2-ec26dae38e90 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: b4017430-cc40-4cfe-a387-49283eaa8a42] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:40.720156 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-43e01982-c432-41af-bdd2-ec26dae38e90 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:40.721042 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-43e01982-c432-41af-bdd2-ec26dae38e90 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:40.721567 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-43e01982-c432-41af-bdd2-ec26dae38e90 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:40.722512 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-43e01982-c432-41af-bdd2-ec26dae38e90 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:40.723149 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-43e01982-c432-41af-bdd2-ec26dae38e90 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:40.723718 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-43e01982-c432-41af-bdd2-ec26dae38e90 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:40.884372 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-43e01982-c432-41af-bdd2-ec26dae38e90 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:40.893083 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-43e01982-c432-41af-bdd2-ec26dae38e90 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/b4017430-cc40-4cfe-a387-49283eaa8a42" status: 200 len: 1342 microversion: 2.1 time: 0.186616 Aug 31 16:45:40.894373 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3364/6713] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:40 2022] GET /compute/v2.1/servers/b4017430-cc40-4cfe-a387-49283eaa8a42 => generated 1342 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:41.914676 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-cb4c0913-971a-4786-bbf0-de89f23b7125 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:41.915681 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-cb4c0913-971a-4786-bbf0-de89f23b7125 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: b4017430-cc40-4cfe-a387-49283eaa8a42] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:41.923296 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cb4c0913-971a-4786-bbf0-de89f23b7125 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:41.923922 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cb4c0913-971a-4786-bbf0-de89f23b7125 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:41.924438 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cb4c0913-971a-4786-bbf0-de89f23b7125 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:41.925229 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cb4c0913-971a-4786-bbf0-de89f23b7125 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:41.926152 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cb4c0913-971a-4786-bbf0-de89f23b7125 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:41.926268 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cb4c0913-971a-4786-bbf0-de89f23b7125 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:42.067058 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-cb4c0913-971a-4786-bbf0-de89f23b7125 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:42.076135 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-cb4c0913-971a-4786-bbf0-de89f23b7125 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/b4017430-cc40-4cfe-a387-49283eaa8a42" status: 200 len: 1342 microversion: 2.1 time: 0.165639 Aug 31 16:45:42.076935 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3350/6714] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:41 2022] GET /compute/v2.1/servers/b4017430-cc40-4cfe-a387-49283eaa8a42 => generated 1342 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:42.762768 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a91349a0-c6d0-4301-ac7c-878d048dcf67 tempest-TestNetworkAdvancedServerOps-354410215 tempest-TestNetworkAdvancedServerOps-354410215-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:42.764148 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a91349a0-c6d0-4301-ac7c-878d048dcf67 tempest-TestNetworkAdvancedServerOps-354410215 tempest-TestNetworkAdvancedServerOps-354410215-project-admin] [instance: 962444ac-43a3-4c95-94f6-38414daf29c1] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:42.772753 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a91349a0-c6d0-4301-ac7c-878d048dcf67 tempest-TestNetworkAdvancedServerOps-354410215 tempest-TestNetworkAdvancedServerOps-354410215-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:42.773880 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a91349a0-c6d0-4301-ac7c-878d048dcf67 tempest-TestNetworkAdvancedServerOps-354410215 tempest-TestNetworkAdvancedServerOps-354410215-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:42.774549 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a91349a0-c6d0-4301-ac7c-878d048dcf67 tempest-TestNetworkAdvancedServerOps-354410215 tempest-TestNetworkAdvancedServerOps-354410215-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:42.776415 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a91349a0-c6d0-4301-ac7c-878d048dcf67 tempest-TestNetworkAdvancedServerOps-354410215 tempest-TestNetworkAdvancedServerOps-354410215-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:42.777079 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a91349a0-c6d0-4301-ac7c-878d048dcf67 tempest-TestNetworkAdvancedServerOps-354410215 tempest-TestNetworkAdvancedServerOps-354410215-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:42.777709 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a91349a0-c6d0-4301-ac7c-878d048dcf67 tempest-TestNetworkAdvancedServerOps-354410215 tempest-TestNetworkAdvancedServerOps-354410215-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:42.783381 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:45:42.889203 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-542dc9bd-fed5-4512-94c0-6d41178c2f0d tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:42.890248 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-542dc9bd-fed5-4512-94c0-6d41178c2f0d tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] [instance: a4dcf873-c5d9-4e9d-90d3-671d3c5a553b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:42.904345 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-542dc9bd-fed5-4512-94c0-6d41178c2f0d tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:42.904345 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-542dc9bd-fed5-4512-94c0-6d41178c2f0d tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:42.904345 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-542dc9bd-fed5-4512-94c0-6d41178c2f0d tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:42.904345 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-542dc9bd-fed5-4512-94c0-6d41178c2f0d tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:42.904345 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-542dc9bd-fed5-4512-94c0-6d41178c2f0d tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:42.905001 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-542dc9bd-fed5-4512-94c0-6d41178c2f0d tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:42.935242 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-542dc9bd-fed5-4512-94c0-6d41178c2f0d tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] [instance: a4dcf873-c5d9-4e9d-90d3-671d3c5a553b] Going to try to terminate instance {{(pid=122256) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:45:43.034047 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-542dc9bd-fed5-4512-94c0-6d41178c2f0d tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] 10.222.0.61 "DELETE /compute/v2.1/servers/a4dcf873-c5d9-4e9d-90d3-671d3c5a553b" status: 204 len: 0 microversion: 2.1 time: 0.149209 Aug 31 16:45:43.035605 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3351/6715] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:45:42 2022] DELETE /compute/v2.1/servers/a4dcf873-c5d9-4e9d-90d3-671d3c5a553b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 16:45:43.047229 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4696e3af-7dd6-496c-ab44-8746fe7c0931 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:43.048149 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4696e3af-7dd6-496c-ab44-8746fe7c0931 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] [instance: a4dcf873-c5d9-4e9d-90d3-671d3c5a553b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:43.055512 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4696e3af-7dd6-496c-ab44-8746fe7c0931 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:43.056079 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4696e3af-7dd6-496c-ab44-8746fe7c0931 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:43.056981 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4696e3af-7dd6-496c-ab44-8746fe7c0931 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:43.058113 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4696e3af-7dd6-496c-ab44-8746fe7c0931 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:43.058956 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4696e3af-7dd6-496c-ab44-8746fe7c0931 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:43.060982 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4696e3af-7dd6-496c-ab44-8746fe7c0931 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:43.303279 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-4696e3af-7dd6-496c-ab44-8746fe7c0931 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab56c16d1354864850f8f2e8339b50d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41821cff003462bb6734854b0116d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:43.313943 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4696e3af-7dd6-496c-ab44-8746fe7c0931 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] 10.222.0.61 "GET /compute/v2.1/servers/a4dcf873-c5d9-4e9d-90d3-671d3c5a553b" status: 200 len: 1513 microversion: 2.1 time: 0.272026 Aug 31 16:45:43.315957 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3352/6716] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:43 2022] GET /compute/v2.1/servers/a4dcf873-c5d9-4e9d-90d3-671d3c5a553b => generated 1513 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:43.322102 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5d665dc5-40f2-463f-ac26-34e4ee6861d3 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:43.322722 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5d665dc5-40f2-463f-ac26-34e4ee6861d3 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: b4017430-cc40-4cfe-a387-49283eaa8a42] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:43.324074 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a91349a0-c6d0-4301-ac7c-878d048dcf67 tempest-TestNetworkAdvancedServerOps-354410215 tempest-TestNetworkAdvancedServerOps-354410215-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1" status: 200 len: 1832 microversion: 2.1 time: 0.566854 Aug 31 16:45:43.340485 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3365/6717] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:42 2022] GET /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1 => generated 1832 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:43.340672 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5d665dc5-40f2-463f-ac26-34e4ee6861d3 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:43.340672 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5d665dc5-40f2-463f-ac26-34e4ee6861d3 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:43.340672 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5d665dc5-40f2-463f-ac26-34e4ee6861d3 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:43.340672 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5d665dc5-40f2-463f-ac26-34e4ee6861d3 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:43.340672 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5d665dc5-40f2-463f-ac26-34e4ee6861d3 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:43.340672 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5d665dc5-40f2-463f-ac26-34e4ee6861d3 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:43.356507 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-205c2534-de04-4fa5-94f7-a4b8be215411 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:43.359177 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-205c2534-de04-4fa5-94f7-a4b8be215411 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 962444ac-43a3-4c95-94f6-38414daf29c1] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:43.366601 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-205c2534-de04-4fa5-94f7-a4b8be215411 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:43.367136 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-205c2534-de04-4fa5-94f7-a4b8be215411 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:43.367730 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-205c2534-de04-4fa5-94f7-a4b8be215411 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:43.368567 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-205c2534-de04-4fa5-94f7-a4b8be215411 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:43.369068 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-205c2534-de04-4fa5-94f7-a4b8be215411 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:43.369525 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-205c2534-de04-4fa5-94f7-a4b8be215411 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:43.569858 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5d665dc5-40f2-463f-ac26-34e4ee6861d3 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:43.580318 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5d665dc5-40f2-463f-ac26-34e4ee6861d3 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/b4017430-cc40-4cfe-a387-49283eaa8a42" status: 200 len: 1342 microversion: 2.1 time: 0.263573 Aug 31 16:45:43.581477 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3353/6718] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:43 2022] GET /compute/v2.1/servers/b4017430-cc40-4cfe-a387-49283eaa8a42 => generated 1342 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:43.587696 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-205c2534-de04-4fa5-94f7-a4b8be215411 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:43.597026 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-205c2534-de04-4fa5-94f7-a4b8be215411 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1" status: 200 len: 1681 microversion: 2.1 time: 0.245969 Aug 31 16:45:43.597657 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3366/6719] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:43 2022] GET /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1 => generated 1681 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:45:43.702253 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-eb3650b9-ca93-4c59-9d5b-9084ee7b6641 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:45:43.705147 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-eb3650b9-ca93-4c59-9d5b-9084ee7b6641 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 962444ac-43a3-4c95-94f6-38414daf29c1] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:43.712255 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eb3650b9-ca93-4c59-9d5b-9084ee7b6641 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:43.712767 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eb3650b9-ca93-4c59-9d5b-9084ee7b6641 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:43.713212 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eb3650b9-ca93-4c59-9d5b-9084ee7b6641 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:43.713938 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eb3650b9-ca93-4c59-9d5b-9084ee7b6641 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:43.714439 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eb3650b9-ca93-4c59-9d5b-9084ee7b6641 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:43.714870 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-eb3650b9-ca93-4c59-9d5b-9084ee7b6641 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:43.802076 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-eb3650b9-ca93-4c59-9d5b-9084ee7b6641 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "POST /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1/action" status: 200 len: 32631 microversion: 2.1 time: 0.104753 Aug 31 16:45:43.803194 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3354/6720] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:45:43 2022] POST /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1/action => generated 32631 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 16:45:43.971926 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2cdbeae1-2095-4731-a6b9-d57f610450c5 tempest-TestNetworkAdvancedServerOps-354410215 tempest-TestNetworkAdvancedServerOps-354410215-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:45:43.972465 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2cdbeae1-2095-4731-a6b9-d57f610450c5 tempest-TestNetworkAdvancedServerOps-354410215 tempest-TestNetworkAdvancedServerOps-354410215-project-admin] [instance: 962444ac-43a3-4c95-94f6-38414daf29c1] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:43.981165 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2cdbeae1-2095-4731-a6b9-d57f610450c5 tempest-TestNetworkAdvancedServerOps-354410215 tempest-TestNetworkAdvancedServerOps-354410215-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:43.981599 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2cdbeae1-2095-4731-a6b9-d57f610450c5 tempest-TestNetworkAdvancedServerOps-354410215 tempest-TestNetworkAdvancedServerOps-354410215-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:43.982090 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2cdbeae1-2095-4731-a6b9-d57f610450c5 tempest-TestNetworkAdvancedServerOps-354410215 tempest-TestNetworkAdvancedServerOps-354410215-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:43.982917 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2cdbeae1-2095-4731-a6b9-d57f610450c5 tempest-TestNetworkAdvancedServerOps-354410215 tempest-TestNetworkAdvancedServerOps-354410215-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:43.983401 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2cdbeae1-2095-4731-a6b9-d57f610450c5 tempest-TestNetworkAdvancedServerOps-354410215 tempest-TestNetworkAdvancedServerOps-354410215-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:43.983930 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2cdbeae1-2095-4731-a6b9-d57f610450c5 tempest-TestNetworkAdvancedServerOps-354410215 tempest-TestNetworkAdvancedServerOps-354410215-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:44.033471 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2cdbeae1-2095-4731-a6b9-d57f610450c5 tempest-TestNetworkAdvancedServerOps-354410215 tempest-TestNetworkAdvancedServerOps-354410215-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '8d8c87e0c7f447d3a75ae889d9c6e5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925377bf8f394e8caa609a3448058431', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:44.034132 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2cdbeae1-2095-4731-a6b9-d57f610450c5 tempest-TestNetworkAdvancedServerOps-354410215 tempest-TestNetworkAdvancedServerOps-354410215-project-admin] [instance: 962444ac-43a3-4c95-94f6-38414daf29c1] flavor_id is None. Assuming migration. {{(pid=122257) resize /opt/stack/nova/nova/compute/api.py:4194}} Aug 31 16:45:44.034599 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2cdbeae1-2095-4731-a6b9-d57f610450c5 tempest-TestNetworkAdvancedServerOps-354410215 tempest-TestNetworkAdvancedServerOps-354410215-project-admin] [instance: 962444ac-43a3-4c95-94f6-38414daf29c1] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122257) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 31 16:45:44.281914 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2cdbeae1-2095-4731-a6b9-d57f610450c5 tempest-TestNetworkAdvancedServerOps-354410215 tempest-TestNetworkAdvancedServerOps-354410215-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1/action" status: 202 len: 0 microversion: 2.1 time: 0.314320 Aug 31 16:45:44.282730 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3367/6721] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:45:43 2022] POST /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1/action => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 16:45:44.293764 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7c27366c-80f4-473a-8b21-8ea5377622be tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:44.294547 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7c27366c-80f4-473a-8b21-8ea5377622be tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 962444ac-43a3-4c95-94f6-38414daf29c1] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:44.303163 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7c27366c-80f4-473a-8b21-8ea5377622be tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:44.303703 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7c27366c-80f4-473a-8b21-8ea5377622be tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:44.304152 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7c27366c-80f4-473a-8b21-8ea5377622be tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:44.306173 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7c27366c-80f4-473a-8b21-8ea5377622be tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:44.306679 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7c27366c-80f4-473a-8b21-8ea5377622be tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:44.307128 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7c27366c-80f4-473a-8b21-8ea5377622be tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:44.342399 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9a635279-b571-490d-bdb9-1be429dab962 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:44.343762 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9a635279-b571-490d-bdb9-1be429dab962 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] [instance: a4dcf873-c5d9-4e9d-90d3-671d3c5a553b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:44.353904 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9a635279-b571-490d-bdb9-1be429dab962 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:44.355103 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9a635279-b571-490d-bdb9-1be429dab962 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:44.356428 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9a635279-b571-490d-bdb9-1be429dab962 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:44.357676 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9a635279-b571-490d-bdb9-1be429dab962 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:44.358408 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9a635279-b571-490d-bdb9-1be429dab962 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:44.359376 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9a635279-b571-490d-bdb9-1be429dab962 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:44.560020 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7c27366c-80f4-473a-8b21-8ea5377622be tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:44.581664 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7c27366c-80f4-473a-8b21-8ea5377622be tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1" status: 200 len: 1690 microversion: 2.1 time: 0.293641 Aug 31 16:45:44.582904 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3355/6722] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:44 2022] GET /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1 => generated 1690 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:45:44.603189 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b5134702-1530-493c-a3c9-9ce023d349eb tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:44.603852 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b5134702-1530-493c-a3c9-9ce023d349eb tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: b4017430-cc40-4cfe-a387-49283eaa8a42] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:44.605743 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9a635279-b571-490d-bdb9-1be429dab962 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab56c16d1354864850f8f2e8339b50d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41821cff003462bb6734854b0116d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:44.611190 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b5134702-1530-493c-a3c9-9ce023d349eb tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:44.611190 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b5134702-1530-493c-a3c9-9ce023d349eb tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:44.611635 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b5134702-1530-493c-a3c9-9ce023d349eb tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:44.612662 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b5134702-1530-493c-a3c9-9ce023d349eb tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:44.613146 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b5134702-1530-493c-a3c9-9ce023d349eb tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:44.613696 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b5134702-1530-493c-a3c9-9ce023d349eb tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:44.616710 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9a635279-b571-490d-bdb9-1be429dab962 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] 10.222.0.61 "GET /compute/v2.1/servers/a4dcf873-c5d9-4e9d-90d3-671d3c5a553b" status: 200 len: 1513 microversion: 2.1 time: 0.280263 Aug 31 16:45:44.632365 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3368/6723] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:44 2022] GET /compute/v2.1/servers/a4dcf873-c5d9-4e9d-90d3-671d3c5a553b => generated 1513 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:44.822309 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b5134702-1530-493c-a3c9-9ce023d349eb tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:44.835808 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b5134702-1530-493c-a3c9-9ce023d349eb tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/b4017430-cc40-4cfe-a387-49283eaa8a42" status: 200 len: 1342 microversion: 2.1 time: 0.236716 Aug 31 16:45:44.836717 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3356/6724] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:44 2022] GET /compute/v2.1/servers/b4017430-cc40-4cfe-a387-49283eaa8a42 => generated 1342 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:45:45.605324 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-fcd61ba6-c791-4a8a-876a-7740c1702d02 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:45.606523 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-fcd61ba6-c791-4a8a-876a-7740c1702d02 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 962444ac-43a3-4c95-94f6-38414daf29c1] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:45.626736 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fcd61ba6-c791-4a8a-876a-7740c1702d02 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:45.627264 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fcd61ba6-c791-4a8a-876a-7740c1702d02 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:45.627896 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fcd61ba6-c791-4a8a-876a-7740c1702d02 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:45.628841 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fcd61ba6-c791-4a8a-876a-7740c1702d02 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:45.629654 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fcd61ba6-c791-4a8a-876a-7740c1702d02 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:45.630011 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fcd61ba6-c791-4a8a-876a-7740c1702d02 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:45.643191 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-aff7cdde-34c1-4cbf-a441-7c0246754809 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:45.644080 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-aff7cdde-34c1-4cbf-a441-7c0246754809 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] [instance: a4dcf873-c5d9-4e9d-90d3-671d3c5a553b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:45.658767 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aff7cdde-34c1-4cbf-a441-7c0246754809 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:45.659778 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aff7cdde-34c1-4cbf-a441-7c0246754809 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:45.660626 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aff7cdde-34c1-4cbf-a441-7c0246754809 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:45.662195 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aff7cdde-34c1-4cbf-a441-7c0246754809 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:45.663088 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aff7cdde-34c1-4cbf-a441-7c0246754809 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:45.664211 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aff7cdde-34c1-4cbf-a441-7c0246754809 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:46.019799 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-fcd61ba6-c791-4a8a-876a-7740c1702d02 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:46.028411 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-aff7cdde-34c1-4cbf-a441-7c0246754809 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab56c16d1354864850f8f2e8339b50d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41821cff003462bb6734854b0116d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:46.030856 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-fcd61ba6-c791-4a8a-876a-7740c1702d02 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1" status: 200 len: 1690 microversion: 2.1 time: 0.429734 Aug 31 16:45:46.031681 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3369/6725] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:45 2022] GET /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1 => generated 1690 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:46.036556 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-79085edc-4fd8-4f0b-be19-0104bc1dab58 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:46.037452 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-79085edc-4fd8-4f0b-be19-0104bc1dab58 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: b4017430-cc40-4cfe-a387-49283eaa8a42] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:46.043374 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-aff7cdde-34c1-4cbf-a441-7c0246754809 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] 10.222.0.61 "GET /compute/v2.1/servers/a4dcf873-c5d9-4e9d-90d3-671d3c5a553b" status: 200 len: 1513 microversion: 2.1 time: 0.406028 Aug 31 16:45:46.051328 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-79085edc-4fd8-4f0b-be19-0104bc1dab58 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:46.051896 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-79085edc-4fd8-4f0b-be19-0104bc1dab58 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:46.052497 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-79085edc-4fd8-4f0b-be19-0104bc1dab58 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:46.056013 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-79085edc-4fd8-4f0b-be19-0104bc1dab58 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:46.056920 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-79085edc-4fd8-4f0b-be19-0104bc1dab58 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:46.057593 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-79085edc-4fd8-4f0b-be19-0104bc1dab58 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:46.059185 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3357/6726] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:45 2022] GET /compute/v2.1/servers/a4dcf873-c5d9-4e9d-90d3-671d3c5a553b => generated 1513 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:46.330933 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-79085edc-4fd8-4f0b-be19-0104bc1dab58 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:46.341646 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-79085edc-4fd8-4f0b-be19-0104bc1dab58 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/b4017430-cc40-4cfe-a387-49283eaa8a42" status: 200 len: 1342 microversion: 2.1 time: 0.308524 Aug 31 16:45:46.356835 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3370/6727] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:46 2022] GET /compute/v2.1/servers/b4017430-cc40-4cfe-a387-49283eaa8a42 => generated 1342 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:46.464952 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-ab006fad-6725-422f-acab-6622e3e76fdb req-561e110c-5a20-4954-af4c-a2f3a7a72449 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4dcf873-c5d9-4e9d-90d3-671d3c5a553b", "name": "network-vif-deleted", "tag": "9999cbcd-cce4-4603-8eaa-e2f3c53995c7"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:45:46.494043 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-ab006fad-6725-422f-acab-6622e3e76fdb req-561e110c-5a20-4954-af4c-a2f3a7a72449 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:46.494566 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-ab006fad-6725-422f-acab-6622e3e76fdb req-561e110c-5a20-4954-af4c-a2f3a7a72449 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:46.495058 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-ab006fad-6725-422f-acab-6622e3e76fdb req-561e110c-5a20-4954-af4c-a2f3a7a72449 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:46.509710 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-ab006fad-6725-422f-acab-6622e3e76fdb req-561e110c-5a20-4954-af4c-a2f3a7a72449 service nova] Creating event network-vif-deleted:9999cbcd-cce4-4603-8eaa-e2f3c53995c7 for instance a4dcf873-c5d9-4e9d-90d3-671d3c5a553b on n-h2-850499-9 Aug 31 16:45:46.514897 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-ab006fad-6725-422f-acab-6622e3e76fdb req-561e110c-5a20-4954-af4c-a2f3a7a72449 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061430 Aug 31 16:45:46.515543 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3358/6728] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:45:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:45:47.060513 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-575cbe08-2978-4660-8d6f-2e3541de6e75 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:47.062333 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-575cbe08-2978-4660-8d6f-2e3541de6e75 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 962444ac-43a3-4c95-94f6-38414daf29c1] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:47.074102 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-575cbe08-2978-4660-8d6f-2e3541de6e75 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:47.075020 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-575cbe08-2978-4660-8d6f-2e3541de6e75 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:47.075803 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-575cbe08-2978-4660-8d6f-2e3541de6e75 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:47.077192 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-575cbe08-2978-4660-8d6f-2e3541de6e75 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:47.077982 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-575cbe08-2978-4660-8d6f-2e3541de6e75 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:47.078657 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-575cbe08-2978-4660-8d6f-2e3541de6e75 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:47.082075 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b070e335-079a-4c37-8d09-f95dded48751 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:47.082931 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b070e335-079a-4c37-8d09-f95dded48751 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] [instance: a4dcf873-c5d9-4e9d-90d3-671d3c5a553b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:47.096670 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b070e335-079a-4c37-8d09-f95dded48751 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:47.097103 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b070e335-079a-4c37-8d09-f95dded48751 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:47.097756 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b070e335-079a-4c37-8d09-f95dded48751 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:47.098481 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b070e335-079a-4c37-8d09-f95dded48751 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:47.099379 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b070e335-079a-4c37-8d09-f95dded48751 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:47.115940 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b070e335-079a-4c37-8d09-f95dded48751 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:47.178541 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b070e335-079a-4c37-8d09-f95dded48751 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:47.179420 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b070e335-079a-4c37-8d09-f95dded48751 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:47.180207 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b070e335-079a-4c37-8d09-f95dded48751 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:47.180897 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-b070e335-079a-4c37-8d09-f95dded48751 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lazy-loading 'fault' on Instance uuid a4dcf873-c5d9-4e9d-90d3-671d3c5a553b {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:45:47.299662 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b070e335-079a-4c37-8d09-f95dded48751 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab56c16d1354864850f8f2e8339b50d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41821cff003462bb6734854b0116d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:47.325653 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b070e335-079a-4c37-8d09-f95dded48751 tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] 10.222.0.61 "GET /compute/v2.1/servers/a4dcf873-c5d9-4e9d-90d3-671d3c5a553b" status: 200 len: 1309 microversion: 2.1 time: 0.254950 Aug 31 16:45:47.326522 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3359/6729] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:47 2022] GET /compute/v2.1/servers/a4dcf873-c5d9-4e9d-90d3-671d3c5a553b => generated 1309 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:47.378416 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d24ea4be-b1c4-4d8d-8bee-b73cf3bd7eea tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:47.380238 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d24ea4be-b1c4-4d8d-8bee-b73cf3bd7eea tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: b4017430-cc40-4cfe-a387-49283eaa8a42] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:47.393265 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d24ea4be-b1c4-4d8d-8bee-b73cf3bd7eea tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:47.394055 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-575cbe08-2978-4660-8d6f-2e3541de6e75 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:47.394538 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d24ea4be-b1c4-4d8d-8bee-b73cf3bd7eea tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:47.395173 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d24ea4be-b1c4-4d8d-8bee-b73cf3bd7eea tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:47.396131 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d24ea4be-b1c4-4d8d-8bee-b73cf3bd7eea tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:47.396789 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d24ea4be-b1c4-4d8d-8bee-b73cf3bd7eea tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:47.397434 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d24ea4be-b1c4-4d8d-8bee-b73cf3bd7eea tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:47.413598 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-575cbe08-2978-4660-8d6f-2e3541de6e75 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1" status: 200 len: 1690 microversion: 2.1 time: 0.359287 Aug 31 16:45:47.415009 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3371/6730] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:47 2022] GET /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1 => generated 1690 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:47.618550 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d24ea4be-b1c4-4d8d-8bee-b73cf3bd7eea tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:47.627973 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d24ea4be-b1c4-4d8d-8bee-b73cf3bd7eea tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/b4017430-cc40-4cfe-a387-49283eaa8a42" status: 200 len: 1342 microversion: 2.1 time: 0.261968 Aug 31 16:45:47.628581 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3360/6731] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:47 2022] GET /compute/v2.1/servers/b4017430-cc40-4cfe-a387-49283eaa8a42 => generated 1342 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:48.359855 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-012e877f-fb43-4c89-b111-c06d42fc07ac tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:48.360614 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-012e877f-fb43-4c89-b111-c06d42fc07ac tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] [instance: a4dcf873-c5d9-4e9d-90d3-671d3c5a553b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:48.371208 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-012e877f-fb43-4c89-b111-c06d42fc07ac tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:48.371793 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-012e877f-fb43-4c89-b111-c06d42fc07ac tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:48.372341 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-012e877f-fb43-4c89-b111-c06d42fc07ac tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:48.373480 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-012e877f-fb43-4c89-b111-c06d42fc07ac tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:48.374062 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-012e877f-fb43-4c89-b111-c06d42fc07ac tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:48.374551 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-012e877f-fb43-4c89-b111-c06d42fc07ac tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:48.392090 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-012e877f-fb43-4c89-b111-c06d42fc07ac tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] HTTP exception thrown: Instance a4dcf873-c5d9-4e9d-90d3-671d3c5a553b could not be found. Aug 31 16:45:48.393942 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-012e877f-fb43-4c89-b111-c06d42fc07ac tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Request method failure captured: Aug 31 16:45:48.393942 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/a4dcf873-c5d9-4e9d-90d3-671d3c5a553b HTTP/1.1 Aug 31 16:45:48.393942 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:45:48.393942 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:45:48.393942 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:45:48.393942 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:45:48.393942 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:45:48.393942 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:45:48.393942 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:45:48.393942 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:45:48.393942 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD48z2KyC3QnU7_XcODIP0_9SzDfHpcAkWboVstp-nkYao1s7d-o5_7LUMP-skj64ClhAe7rFAAxZ9zJ3ExpA4rTvzTYvo2gWXWwAdLFtPDzxxUQPF5QrTof7T9S03ngtvvSYZD_ZygI7raj21-kdlXEdJQSAjnzGriP_oRw36z-rwgU Aug 31 16:45:48.393942 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:45:48.393942 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:45:48.393942 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:45:48.393942 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:45:48.393942 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:45:48.393942 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:45:48.393942 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: c41821cff003462bb6734854b0116d71 Aug 31 16:45:48.393942 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-VolumesSnapshotTestJSON-988799959 Aug 31 16:45:48.393942 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:45:48.393942 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:45:48.393942 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c41821cff003462bb6734854b0116d71"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/c41821cff003462bb6734854b0116d71"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_c41821cff003462bb6734854b0116d71", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c41821cff003462bb6734854b0116d71"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:45:48.393942 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-VolumesSnapshotTestJSON-988799959 Aug 31 16:45:48.393942 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: c41821cff003462bb6734854b0116d71 Aug 31 16:45:48.393942 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-988799959 Aug 31 16:45:48.393942 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-VolumesSnapshotTestJSON-988799959-project Aug 31 16:45:48.393942 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:45:48.393942 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:45:48.393942 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: aab56c16d1354864850f8f2e8339b50d Aug 31 16:45:48.393942 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-VolumesSnapshotTestJSON-988799959-project Aug 31 16:45:48.393942 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:45:48.393942 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance a4dcf873-c5d9-4e9d-90d3-671d3c5a553b could not be found. Aug 31 16:45:48.393942 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': 'a4dcf873-c5d9-4e9d-90d3-671d3c5a553b'} Aug 31 16:45:48.393942 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:45:48.393942 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:45:48.393942 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:45:48.393942 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:45:48.393942 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:45:48.393942 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:45:48.393942 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:45:48.393942 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:45:48.393942 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:45:48.393942 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:45:48.393942 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4dcf873-c5d9-4e9d-90d3-671d3c5a553b could not be found. Aug 31 16:45:48.393942 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:45:48.393942 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:45:48.393942 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:45:48.393942 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:45:48.393942 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:45:48.393942 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:45:48.393942 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:45:48.393942 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:45:48.393942 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:45:48.393942 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:45:48.393942 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:45:48.393942 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:45:48.393942 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:45:48.393942 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:45:48.393942 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:45:48.393942 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:45:48.393942 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4dcf873-c5d9-4e9d-90d3-671d3c5a553b could not be found. Aug 31 16:45:48.393942 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:45:48.393942 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:45:48.393942 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:45:48.399135 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:45:48.399135 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:45:48.399135 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:45:48.399135 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:45:48.399135 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:45:48.399135 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4dcf873-c5d9-4e9d-90d3-671d3c5a553b could not be found. Aug 31 16:45:48.399135 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:45:48.399135 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-012e877f-fb43-4c89-b111-c06d42fc07ac tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] Returning 404 to user: Instance a4dcf873-c5d9-4e9d-90d3-671d3c5a553b could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:45:48.399135 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-012e877f-fb43-4c89-b111-c06d42fc07ac tempest-VolumesSnapshotTestJSON-988799959 tempest-VolumesSnapshotTestJSON-988799959-project] 10.222.0.61 "GET /compute/v2.1/servers/a4dcf873-c5d9-4e9d-90d3-671d3c5a553b" status: 404 len: 111 microversion: 2.1 time: 0.040787 Aug 31 16:45:48.399135 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3372/6732] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:48 2022] GET /compute/v2.1/servers/a4dcf873-c5d9-4e9d-90d3-671d3c5a553b => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:45:48.443520 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-64b4fe2f-fe52-4536-87b9-2d30c5b58ba1 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:48.444142 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-64b4fe2f-fe52-4536-87b9-2d30c5b58ba1 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 962444ac-43a3-4c95-94f6-38414daf29c1] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:48.452706 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-64b4fe2f-fe52-4536-87b9-2d30c5b58ba1 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:48.453411 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-64b4fe2f-fe52-4536-87b9-2d30c5b58ba1 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:48.453927 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-64b4fe2f-fe52-4536-87b9-2d30c5b58ba1 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:48.454874 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-64b4fe2f-fe52-4536-87b9-2d30c5b58ba1 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:48.455543 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-64b4fe2f-fe52-4536-87b9-2d30c5b58ba1 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:48.456134 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-64b4fe2f-fe52-4536-87b9-2d30c5b58ba1 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:48.641800 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-64b4fe2f-fe52-4536-87b9-2d30c5b58ba1 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:48.645639 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:45:48.653277 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-64b4fe2f-fe52-4536-87b9-2d30c5b58ba1 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1" status: 200 len: 1695 microversion: 2.1 time: 0.214588 Aug 31 16:45:48.654826 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3361/6733] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:48 2022] GET /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1 => generated 1695 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:48.656500 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5bda155a-5490-4955-bb02-d02a68243faa tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:48.658072 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5bda155a-5490-4955-bb02-d02a68243faa tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: b4017430-cc40-4cfe-a387-49283eaa8a42] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:48.670970 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5bda155a-5490-4955-bb02-d02a68243faa tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:48.671727 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5bda155a-5490-4955-bb02-d02a68243faa tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:48.672356 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5bda155a-5490-4955-bb02-d02a68243faa tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:48.673342 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5bda155a-5490-4955-bb02-d02a68243faa tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:48.674075 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5bda155a-5490-4955-bb02-d02a68243faa tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:48.674545 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5bda155a-5490-4955-bb02-d02a68243faa tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:48.902828 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5bda155a-5490-4955-bb02-d02a68243faa tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:48.914686 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5bda155a-5490-4955-bb02-d02a68243faa tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/b4017430-cc40-4cfe-a387-49283eaa8a42" status: 200 len: 1376 microversion: 2.1 time: 0.265687 Aug 31 16:45:48.915638 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3373/6734] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:48 2022] GET /compute/v2.1/servers/b4017430-cc40-4cfe-a387-49283eaa8a42 => generated 1376 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:49.680584 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7b7a342e-3468-4ac4-b2ad-9b9823dfc32e tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:49.681364 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7b7a342e-3468-4ac4-b2ad-9b9823dfc32e tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 962444ac-43a3-4c95-94f6-38414daf29c1] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:49.691338 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7b7a342e-3468-4ac4-b2ad-9b9823dfc32e tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:49.691895 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7b7a342e-3468-4ac4-b2ad-9b9823dfc32e tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:49.692378 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7b7a342e-3468-4ac4-b2ad-9b9823dfc32e tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:49.693133 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7b7a342e-3468-4ac4-b2ad-9b9823dfc32e tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:49.693622 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7b7a342e-3468-4ac4-b2ad-9b9823dfc32e tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:49.694068 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7b7a342e-3468-4ac4-b2ad-9b9823dfc32e tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:49.872076 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7b7a342e-3468-4ac4-b2ad-9b9823dfc32e tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:49.879818 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7b7a342e-3468-4ac4-b2ad-9b9823dfc32e tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1" status: 200 len: 1695 microversion: 2.1 time: 0.204636 Aug 31 16:45:49.880761 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3362/6735] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:49 2022] GET /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1 => generated 1695 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:49.937684 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-78478560-10e1-45c6-9198-50e0af1c63ed tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:49.938355 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-78478560-10e1-45c6-9198-50e0af1c63ed tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: b4017430-cc40-4cfe-a387-49283eaa8a42] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:49.946775 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-78478560-10e1-45c6-9198-50e0af1c63ed tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:49.947292 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-78478560-10e1-45c6-9198-50e0af1c63ed tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:49.947815 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-78478560-10e1-45c6-9198-50e0af1c63ed tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:49.948633 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-78478560-10e1-45c6-9198-50e0af1c63ed tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:49.949135 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-78478560-10e1-45c6-9198-50e0af1c63ed tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:49.949576 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-78478560-10e1-45c6-9198-50e0af1c63ed tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:50.112146 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-78478560-10e1-45c6-9198-50e0af1c63ed tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:50.122227 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-78478560-10e1-45c6-9198-50e0af1c63ed tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/b4017430-cc40-4cfe-a387-49283eaa8a42" status: 200 len: 1376 microversion: 2.1 time: 0.188448 Aug 31 16:45:50.122823 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3374/6736] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:49 2022] GET /compute/v2.1/servers/b4017430-cc40-4cfe-a387-49283eaa8a42 => generated 1376 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:50.907698 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a1067d8e-e06d-4506-a831-5a97b6fa9105 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:50.908704 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a1067d8e-e06d-4506-a831-5a97b6fa9105 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 962444ac-43a3-4c95-94f6-38414daf29c1] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:50.917004 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a1067d8e-e06d-4506-a831-5a97b6fa9105 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:50.917524 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a1067d8e-e06d-4506-a831-5a97b6fa9105 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:50.918168 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a1067d8e-e06d-4506-a831-5a97b6fa9105 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:50.918916 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a1067d8e-e06d-4506-a831-5a97b6fa9105 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:50.919417 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a1067d8e-e06d-4506-a831-5a97b6fa9105 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:50.920097 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a1067d8e-e06d-4506-a831-5a97b6fa9105 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:51.108242 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a1067d8e-e06d-4506-a831-5a97b6fa9105 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:51.122913 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a1067d8e-e06d-4506-a831-5a97b6fa9105 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1" status: 200 len: 1695 microversion: 2.1 time: 0.219219 Aug 31 16:45:51.123867 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3363/6737] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:50 2022] GET /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1 => generated 1695 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:51.144170 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-02a3476f-f503-4c25-8824-2ef076ad6f89 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:51.144798 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-02a3476f-f503-4c25-8824-2ef076ad6f89 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: b4017430-cc40-4cfe-a387-49283eaa8a42] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:51.152791 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-02a3476f-f503-4c25-8824-2ef076ad6f89 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:51.153300 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-02a3476f-f503-4c25-8824-2ef076ad6f89 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:51.153753 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-02a3476f-f503-4c25-8824-2ef076ad6f89 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:51.154507 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-02a3476f-f503-4c25-8824-2ef076ad6f89 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:51.154992 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-02a3476f-f503-4c25-8824-2ef076ad6f89 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:51.155525 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-02a3476f-f503-4c25-8824-2ef076ad6f89 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:51.315842 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-02a3476f-f503-4c25-8824-2ef076ad6f89 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:51.325790 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-02a3476f-f503-4c25-8824-2ef076ad6f89 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/b4017430-cc40-4cfe-a387-49283eaa8a42" status: 200 len: 1376 microversion: 2.1 time: 0.185804 Aug 31 16:45:51.326516 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3375/6738] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:51 2022] GET /compute/v2.1/servers/b4017430-cc40-4cfe-a387-49283eaa8a42 => generated 1376 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:52.147791 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4c35d261-a390-48b3-bbf6-8749c4f36203 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:52.149063 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4c35d261-a390-48b3-bbf6-8749c4f36203 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 962444ac-43a3-4c95-94f6-38414daf29c1] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:52.157013 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4c35d261-a390-48b3-bbf6-8749c4f36203 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:52.157450 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4c35d261-a390-48b3-bbf6-8749c4f36203 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:52.158115 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4c35d261-a390-48b3-bbf6-8749c4f36203 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:52.158909 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4c35d261-a390-48b3-bbf6-8749c4f36203 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:52.159310 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4c35d261-a390-48b3-bbf6-8749c4f36203 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:52.159775 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4c35d261-a390-48b3-bbf6-8749c4f36203 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:52.326617 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-4c35d261-a390-48b3-bbf6-8749c4f36203 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:52.337160 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4c35d261-a390-48b3-bbf6-8749c4f36203 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1" status: 200 len: 1695 microversion: 2.1 time: 0.193647 Aug 31 16:45:52.338155 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3364/6739] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:52 2022] GET /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1 => generated 1695 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:45:52.349066 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f2350008-5634-4e17-bdf6-1946e9521c20 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:52.349707 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f2350008-5634-4e17-bdf6-1946e9521c20 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: b4017430-cc40-4cfe-a387-49283eaa8a42] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:52.357504 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f2350008-5634-4e17-bdf6-1946e9521c20 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:52.358051 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f2350008-5634-4e17-bdf6-1946e9521c20 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:52.358561 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f2350008-5634-4e17-bdf6-1946e9521c20 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:52.359325 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f2350008-5634-4e17-bdf6-1946e9521c20 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:52.360076 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f2350008-5634-4e17-bdf6-1946e9521c20 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:52.360533 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f2350008-5634-4e17-bdf6-1946e9521c20 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:52.545525 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f2350008-5634-4e17-bdf6-1946e9521c20 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:52.556275 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f2350008-5634-4e17-bdf6-1946e9521c20 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/b4017430-cc40-4cfe-a387-49283eaa8a42" status: 200 len: 1376 microversion: 2.1 time: 0.210819 Aug 31 16:45:52.557494 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3376/6740] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:52 2022] GET /compute/v2.1/servers/b4017430-cc40-4cfe-a387-49283eaa8a42 => generated 1376 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:53.366274 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-cda315b4-0477-48d1-b435-754c7daaacf3 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:53.370242 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-cda315b4-0477-48d1-b435-754c7daaacf3 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 962444ac-43a3-4c95-94f6-38414daf29c1] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:53.378473 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cda315b4-0477-48d1-b435-754c7daaacf3 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:53.379291 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cda315b4-0477-48d1-b435-754c7daaacf3 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:53.379599 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cda315b4-0477-48d1-b435-754c7daaacf3 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:53.380275 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cda315b4-0477-48d1-b435-754c7daaacf3 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:53.380798 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cda315b4-0477-48d1-b435-754c7daaacf3 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:53.381191 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cda315b4-0477-48d1-b435-754c7daaacf3 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:53.552802 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-cda315b4-0477-48d1-b435-754c7daaacf3 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:53.562577 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-cda315b4-0477-48d1-b435-754c7daaacf3 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1" status: 200 len: 1695 microversion: 2.1 time: 0.200960 Aug 31 16:45:53.563112 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3365/6741] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:53 2022] GET /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1 => generated 1695 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:45:53.578746 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-eb5a6426-dc65-41da-9b27-517f0735bcda tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:53.579641 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-eb5a6426-dc65-41da-9b27-517f0735bcda tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: b4017430-cc40-4cfe-a387-49283eaa8a42] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:53.587791 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eb5a6426-dc65-41da-9b27-517f0735bcda tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:53.588412 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eb5a6426-dc65-41da-9b27-517f0735bcda tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:53.592049 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eb5a6426-dc65-41da-9b27-517f0735bcda tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:53.593004 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eb5a6426-dc65-41da-9b27-517f0735bcda tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:53.593497 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eb5a6426-dc65-41da-9b27-517f0735bcda tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:53.593949 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eb5a6426-dc65-41da-9b27-517f0735bcda tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:53.755486 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-eb5a6426-dc65-41da-9b27-517f0735bcda tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:53.764924 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-eb5a6426-dc65-41da-9b27-517f0735bcda tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/b4017430-cc40-4cfe-a387-49283eaa8a42" status: 200 len: 1376 microversion: 2.1 time: 0.190635 Aug 31 16:45:53.765515 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3377/6742] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:53 2022] GET /compute/v2.1/servers/b4017430-cc40-4cfe-a387-49283eaa8a42 => generated 1376 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:54.586425 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7bff8041-4400-45d8-a84f-089ca686031f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:54.587238 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7bff8041-4400-45d8-a84f-089ca686031f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 962444ac-43a3-4c95-94f6-38414daf29c1] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:54.593429 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7bff8041-4400-45d8-a84f-089ca686031f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:54.593925 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7bff8041-4400-45d8-a84f-089ca686031f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:54.594402 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7bff8041-4400-45d8-a84f-089ca686031f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:54.595078 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7bff8041-4400-45d8-a84f-089ca686031f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:54.595587 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7bff8041-4400-45d8-a84f-089ca686031f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:54.596012 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7bff8041-4400-45d8-a84f-089ca686031f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:54.792431 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5b486efe-d9c1-4f86-b7da-38c3ad50af7b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:54.793382 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7bff8041-4400-45d8-a84f-089ca686031f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:54.794405 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5b486efe-d9c1-4f86-b7da-38c3ad50af7b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: b4017430-cc40-4cfe-a387-49283eaa8a42] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:54.801661 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7bff8041-4400-45d8-a84f-089ca686031f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1" status: 200 len: 1695 microversion: 2.1 time: 0.220192 Aug 31 16:45:54.802254 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3366/6743] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:54 2022] GET /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1 => generated 1695 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:54.807812 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b486efe-d9c1-4f86-b7da-38c3ad50af7b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:54.808632 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b486efe-d9c1-4f86-b7da-38c3ad50af7b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:54.809407 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b486efe-d9c1-4f86-b7da-38c3ad50af7b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:54.810318 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b486efe-d9c1-4f86-b7da-38c3ad50af7b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:54.810899 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b486efe-d9c1-4f86-b7da-38c3ad50af7b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:54.811362 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b486efe-d9c1-4f86-b7da-38c3ad50af7b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:54.963365 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5b486efe-d9c1-4f86-b7da-38c3ad50af7b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:54.971937 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5b486efe-d9c1-4f86-b7da-38c3ad50af7b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/b4017430-cc40-4cfe-a387-49283eaa8a42" status: 200 len: 1376 microversion: 2.1 time: 0.189128 Aug 31 16:45:54.972518 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3378/6744] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:54 2022] GET /compute/v2.1/servers/b4017430-cc40-4cfe-a387-49283eaa8a42 => generated 1376 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:55.824621 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7ad5f85f-5e9d-45b8-82ec-c85499d5a083 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:55.825374 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7ad5f85f-5e9d-45b8-82ec-c85499d5a083 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 962444ac-43a3-4c95-94f6-38414daf29c1] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:55.832912 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7ad5f85f-5e9d-45b8-82ec-c85499d5a083 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:55.833418 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7ad5f85f-5e9d-45b8-82ec-c85499d5a083 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:55.833871 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7ad5f85f-5e9d-45b8-82ec-c85499d5a083 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:55.834625 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7ad5f85f-5e9d-45b8-82ec-c85499d5a083 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:55.835097 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7ad5f85f-5e9d-45b8-82ec-c85499d5a083 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:55.835596 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7ad5f85f-5e9d-45b8-82ec-c85499d5a083 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:55.993913 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7ad5f85f-5e9d-45b8-82ec-c85499d5a083 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:55.994855 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-cf2ccccc-a9dd-4088-a55c-2cb480c10a50 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:55.996375 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-cf2ccccc-a9dd-4088-a55c-2cb480c10a50 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: b4017430-cc40-4cfe-a387-49283eaa8a42] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:56.003162 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7ad5f85f-5e9d-45b8-82ec-c85499d5a083 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1" status: 200 len: 1695 microversion: 2.1 time: 0.183456 Aug 31 16:45:56.004221 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3367/6745] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:55 2022] GET /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1 => generated 1695 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:56.016391 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cf2ccccc-a9dd-4088-a55c-2cb480c10a50 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:56.016895 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cf2ccccc-a9dd-4088-a55c-2cb480c10a50 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:56.017427 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cf2ccccc-a9dd-4088-a55c-2cb480c10a50 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:56.018175 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cf2ccccc-a9dd-4088-a55c-2cb480c10a50 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:56.018659 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cf2ccccc-a9dd-4088-a55c-2cb480c10a50 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:56.019111 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cf2ccccc-a9dd-4088-a55c-2cb480c10a50 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:56.165872 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-cf2ccccc-a9dd-4088-a55c-2cb480c10a50 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:56.176561 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-cf2ccccc-a9dd-4088-a55c-2cb480c10a50 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/b4017430-cc40-4cfe-a387-49283eaa8a42" status: 200 len: 1376 microversion: 2.1 time: 0.185872 Aug 31 16:45:56.177330 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3379/6746] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:55 2022] GET /compute/v2.1/servers/b4017430-cc40-4cfe-a387-49283eaa8a42 => generated 1376 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:57.032277 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5b09ba07-a38e-4278-9e12-e6d236d82081 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:57.032856 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5b09ba07-a38e-4278-9e12-e6d236d82081 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 962444ac-43a3-4c95-94f6-38414daf29c1] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:57.043230 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:45:57.046357 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5b09ba07-a38e-4278-9e12-e6d236d82081 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:57.046769 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5b09ba07-a38e-4278-9e12-e6d236d82081 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:57.047402 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5b09ba07-a38e-4278-9e12-e6d236d82081 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:57.048159 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5b09ba07-a38e-4278-9e12-e6d236d82081 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:57.048648 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5b09ba07-a38e-4278-9e12-e6d236d82081 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:57.049079 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5b09ba07-a38e-4278-9e12-e6d236d82081 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:57.205477 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-05e0fbbf-011c-4824-81ac-206763a77f39 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:57.206820 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-05e0fbbf-011c-4824-81ac-206763a77f39 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: b4017430-cc40-4cfe-a387-49283eaa8a42] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:57.216632 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-05e0fbbf-011c-4824-81ac-206763a77f39 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:57.217409 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-05e0fbbf-011c-4824-81ac-206763a77f39 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:57.218156 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-05e0fbbf-011c-4824-81ac-206763a77f39 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:57.219128 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-05e0fbbf-011c-4824-81ac-206763a77f39 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:57.219869 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-05e0fbbf-011c-4824-81ac-206763a77f39 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:57.220974 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-05e0fbbf-011c-4824-81ac-206763a77f39 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:57.236833 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5b09ba07-a38e-4278-9e12-e6d236d82081 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:57.247925 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5b09ba07-a38e-4278-9e12-e6d236d82081 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1" status: 200 len: 1695 microversion: 2.1 time: 0.221489 Aug 31 16:45:57.249049 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3368/6747] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:57 2022] GET /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1 => generated 1695 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:57.398758 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-05e0fbbf-011c-4824-81ac-206763a77f39 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:57.403188 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:45:57.408620 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-05e0fbbf-011c-4824-81ac-206763a77f39 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/b4017430-cc40-4cfe-a387-49283eaa8a42" status: 200 len: 1376 microversion: 2.1 time: 0.207273 Aug 31 16:45:57.409220 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3380/6748] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:57 2022] GET /compute/v2.1/servers/b4017430-cc40-4cfe-a387-49283eaa8a42 => generated 1376 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:58.275087 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-117d87f7-6971-4906-b142-b609441bfe98 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:58.275087 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-117d87f7-6971-4906-b142-b609441bfe98 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 962444ac-43a3-4c95-94f6-38414daf29c1] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:58.281868 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-117d87f7-6971-4906-b142-b609441bfe98 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:58.282506 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-117d87f7-6971-4906-b142-b609441bfe98 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:58.283303 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-117d87f7-6971-4906-b142-b609441bfe98 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:58.283917 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-117d87f7-6971-4906-b142-b609441bfe98 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:58.284443 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-117d87f7-6971-4906-b142-b609441bfe98 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:58.285240 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-117d87f7-6971-4906-b142-b609441bfe98 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:58.431029 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ac26af92-411f-47d9-b8d5-732d5bb3407b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:58.432742 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ac26af92-411f-47d9-b8d5-732d5bb3407b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: b4017430-cc40-4cfe-a387-49283eaa8a42] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:58.440601 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ac26af92-411f-47d9-b8d5-732d5bb3407b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:58.441631 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ac26af92-411f-47d9-b8d5-732d5bb3407b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:58.442365 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ac26af92-411f-47d9-b8d5-732d5bb3407b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:58.443347 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ac26af92-411f-47d9-b8d5-732d5bb3407b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:58.444211 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ac26af92-411f-47d9-b8d5-732d5bb3407b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:58.444830 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ac26af92-411f-47d9-b8d5-732d5bb3407b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:58.496647 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-117d87f7-6971-4906-b142-b609441bfe98 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:58.505189 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-117d87f7-6971-4906-b142-b609441bfe98 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1" status: 200 len: 1695 microversion: 2.1 time: 0.239020 Aug 31 16:45:58.520339 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3369/6749] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:58 2022] GET /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1 => generated 1695 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:58.968838 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ac26af92-411f-47d9-b8d5-732d5bb3407b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:58.985225 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ac26af92-411f-47d9-b8d5-732d5bb3407b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/b4017430-cc40-4cfe-a387-49283eaa8a42" status: 200 len: 1376 microversion: 2.1 time: 0.558240 Aug 31 16:45:58.995655 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3381/6750] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:58 2022] GET /compute/v2.1/servers/b4017430-cc40-4cfe-a387-49283eaa8a42 => generated 1376 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:45:59.050554 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-f7d3ac67-92c2-4506-83e9-b8aeba9e26ee req-be8ff32c-7988-47d4-8819-a7ecdfdbe2ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4017430-cc40-4cfe-a387-49283eaa8a42", "name": "network-vif-plugged", "status": "completed", "tag": "f8146720-1978-4445-ac4c-8e9692d3809e"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:45:59.061617 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-f7d3ac67-92c2-4506-83e9-b8aeba9e26ee req-be8ff32c-7988-47d4-8819-a7ecdfdbe2ca service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:59.062420 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-f7d3ac67-92c2-4506-83e9-b8aeba9e26ee req-be8ff32c-7988-47d4-8819-a7ecdfdbe2ca service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:59.062865 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-f7d3ac67-92c2-4506-83e9-b8aeba9e26ee req-be8ff32c-7988-47d4-8819-a7ecdfdbe2ca service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:59.086447 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-f7d3ac67-92c2-4506-83e9-b8aeba9e26ee req-be8ff32c-7988-47d4-8819-a7ecdfdbe2ca service nova] Creating event network-vif-plugged:f8146720-1978-4445-ac4c-8e9692d3809e for instance b4017430-cc40-4cfe-a387-49283eaa8a42 on n-h1-850499-9 Aug 31 16:45:59.100917 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-f7d3ac67-92c2-4506-83e9-b8aeba9e26ee req-be8ff32c-7988-47d4-8819-a7ecdfdbe2ca service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053949 Aug 31 16:45:59.102755 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3370/6751] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:45:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:45:59.528654 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a68fa707-f999-493e-8ed2-feb90ff3db0b tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:59.529355 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a68fa707-f999-493e-8ed2-feb90ff3db0b tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 962444ac-43a3-4c95-94f6-38414daf29c1] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:59.537190 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a68fa707-f999-493e-8ed2-feb90ff3db0b tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:59.537692 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a68fa707-f999-493e-8ed2-feb90ff3db0b tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:59.538148 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a68fa707-f999-493e-8ed2-feb90ff3db0b tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:59.538858 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a68fa707-f999-493e-8ed2-feb90ff3db0b tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:59.539826 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a68fa707-f999-493e-8ed2-feb90ff3db0b tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:59.540026 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a68fa707-f999-493e-8ed2-feb90ff3db0b tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:59.693616 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a68fa707-f999-493e-8ed2-feb90ff3db0b tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:59.702980 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a68fa707-f999-493e-8ed2-feb90ff3db0b tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1" status: 200 len: 1695 microversion: 2.1 time: 0.178738 Aug 31 16:45:59.715920 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3382/6752] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:59 2022] GET /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1 => generated 1695 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:46:00.010441 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7179585e-7803-4b9a-826a-fb0b143dc156 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:00.011173 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7179585e-7803-4b9a-826a-fb0b143dc156 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: b4017430-cc40-4cfe-a387-49283eaa8a42] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:00.018747 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7179585e-7803-4b9a-826a-fb0b143dc156 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:00.019211 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7179585e-7803-4b9a-826a-fb0b143dc156 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:00.019676 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7179585e-7803-4b9a-826a-fb0b143dc156 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:00.020405 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7179585e-7803-4b9a-826a-fb0b143dc156 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:00.020872 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7179585e-7803-4b9a-826a-fb0b143dc156 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:00.021302 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7179585e-7803-4b9a-826a-fb0b143dc156 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:00.190874 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7179585e-7803-4b9a-826a-fb0b143dc156 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:46:00.198074 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7179585e-7803-4b9a-826a-fb0b143dc156 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/b4017430-cc40-4cfe-a387-49283eaa8a42" status: 200 len: 1376 microversion: 2.1 time: 0.194676 Aug 31 16:46:00.205253 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3371/6753] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:46:00 2022] GET /compute/v2.1/servers/b4017430-cc40-4cfe-a387-49283eaa8a42 => generated 1376 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:46:00.725442 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ef314b02-cf16-4617-8397-335a116e8c44 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:00.726133 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ef314b02-cf16-4617-8397-335a116e8c44 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 962444ac-43a3-4c95-94f6-38414daf29c1] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:00.733786 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ef314b02-cf16-4617-8397-335a116e8c44 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:00.734295 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ef314b02-cf16-4617-8397-335a116e8c44 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:00.734749 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ef314b02-cf16-4617-8397-335a116e8c44 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:00.735462 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ef314b02-cf16-4617-8397-335a116e8c44 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:00.735969 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ef314b02-cf16-4617-8397-335a116e8c44 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:00.736410 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ef314b02-cf16-4617-8397-335a116e8c44 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:00.883148 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ef314b02-cf16-4617-8397-335a116e8c44 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:46:00.891358 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ef314b02-cf16-4617-8397-335a116e8c44 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1" status: 200 len: 1695 microversion: 2.1 time: 0.169954 Aug 31 16:46:00.892008 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3383/6754] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:46:00 2022] GET /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1 => generated 1695 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:46:01.218691 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b7407a1e-ce46-4d36-95a4-e7a74a91560a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:01.219369 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b7407a1e-ce46-4d36-95a4-e7a74a91560a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: b4017430-cc40-4cfe-a387-49283eaa8a42] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:01.227446 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b7407a1e-ce46-4d36-95a4-e7a74a91560a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:01.227446 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b7407a1e-ce46-4d36-95a4-e7a74a91560a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:01.228023 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b7407a1e-ce46-4d36-95a4-e7a74a91560a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:01.228579 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b7407a1e-ce46-4d36-95a4-e7a74a91560a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:01.229037 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b7407a1e-ce46-4d36-95a4-e7a74a91560a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:01.229467 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b7407a1e-ce46-4d36-95a4-e7a74a91560a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:01.375677 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b7407a1e-ce46-4d36-95a4-e7a74a91560a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:46:01.384136 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b7407a1e-ce46-4d36-95a4-e7a74a91560a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/b4017430-cc40-4cfe-a387-49283eaa8a42" status: 200 len: 1563 microversion: 2.1 time: 0.169632 Aug 31 16:46:01.384731 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3372/6755] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:46:01 2022] GET /compute/v2.1/servers/b4017430-cc40-4cfe-a387-49283eaa8a42 => generated 1563 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:46:01.405373 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1fa90e60-f55c-4a27-84ca-99f8370c2174 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:01.406177 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1fa90e60-f55c-4a27-84ca-99f8370c2174 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: b4017430-cc40-4cfe-a387-49283eaa8a42] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:01.412510 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1fa90e60-f55c-4a27-84ca-99f8370c2174 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:01.413092 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1fa90e60-f55c-4a27-84ca-99f8370c2174 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:01.413614 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1fa90e60-f55c-4a27-84ca-99f8370c2174 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:01.414557 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1fa90e60-f55c-4a27-84ca-99f8370c2174 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:01.415098 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1fa90e60-f55c-4a27-84ca-99f8370c2174 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:01.415643 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1fa90e60-f55c-4a27-84ca-99f8370c2174 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:01.561159 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-1fa90e60-f55c-4a27-84ca-99f8370c2174 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:46:01.569353 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1fa90e60-f55c-4a27-84ca-99f8370c2174 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/b4017430-cc40-4cfe-a387-49283eaa8a42" status: 200 len: 1563 microversion: 2.1 time: 0.167964 Aug 31 16:46:01.570046 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3384/6756] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:46:01 2022] GET /compute/v2.1/servers/b4017430-cc40-4cfe-a387-49283eaa8a42 => generated 1563 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:46:01.650975 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-503868c3-16a2-4222-a3c0-309d444db713 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:01.651519 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-503868c3-16a2-4222-a3c0-309d444db713 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: b4017430-cc40-4cfe-a387-49283eaa8a42] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:01.657673 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-503868c3-16a2-4222-a3c0-309d444db713 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:01.658188 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-503868c3-16a2-4222-a3c0-309d444db713 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:01.658625 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-503868c3-16a2-4222-a3c0-309d444db713 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:01.659814 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-503868c3-16a2-4222-a3c0-309d444db713 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:01.660281 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-503868c3-16a2-4222-a3c0-309d444db713 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:01.660717 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-503868c3-16a2-4222-a3c0-309d444db713 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:01.689424 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-503868c3-16a2-4222-a3c0-309d444db713 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: b4017430-cc40-4cfe-a387-49283eaa8a42] Going to try to terminate instance {{(pid=122256) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:46:01.776090 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-503868c3-16a2-4222-a3c0-309d444db713 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "DELETE /compute/v2.1/servers/b4017430-cc40-4cfe-a387-49283eaa8a42" status: 204 len: 0 microversion: 2.1 time: 0.129068 Aug 31 16:46:01.777080 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3373/6757] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:46:01 2022] DELETE /compute/v2.1/servers/b4017430-cc40-4cfe-a387-49283eaa8a42 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:46:01.786321 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0f9372c0-0b15-458c-8260-9a42a5edbdaf tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:01.787301 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0f9372c0-0b15-458c-8260-9a42a5edbdaf tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: b4017430-cc40-4cfe-a387-49283eaa8a42] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:01.795038 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0f9372c0-0b15-458c-8260-9a42a5edbdaf tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:01.795594 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0f9372c0-0b15-458c-8260-9a42a5edbdaf tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:01.796050 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0f9372c0-0b15-458c-8260-9a42a5edbdaf tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:01.796899 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0f9372c0-0b15-458c-8260-9a42a5edbdaf tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:01.797372 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0f9372c0-0b15-458c-8260-9a42a5edbdaf tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:01.797811 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0f9372c0-0b15-458c-8260-9a42a5edbdaf tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:01.917142 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3432d0fc-00e3-4791-b162-d120422e9edb tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:01.917861 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3432d0fc-00e3-4791-b162-d120422e9edb tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 962444ac-43a3-4c95-94f6-38414daf29c1] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:01.925519 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3432d0fc-00e3-4791-b162-d120422e9edb tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:01.926027 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3432d0fc-00e3-4791-b162-d120422e9edb tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:01.926468 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3432d0fc-00e3-4791-b162-d120422e9edb tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:01.927404 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3432d0fc-00e3-4791-b162-d120422e9edb tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:01.927896 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3432d0fc-00e3-4791-b162-d120422e9edb tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:01.928329 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3432d0fc-00e3-4791-b162-d120422e9edb tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:01.948565 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0f9372c0-0b15-458c-8260-9a42a5edbdaf tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:46:01.957900 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0f9372c0-0b15-458c-8260-9a42a5edbdaf tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/b4017430-cc40-4cfe-a387-49283eaa8a42" status: 200 len: 1569 microversion: 2.1 time: 0.175846 Aug 31 16:46:01.958497 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3385/6758] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:46:01 2022] GET /compute/v2.1/servers/b4017430-cc40-4cfe-a387-49283eaa8a42 => generated 1569 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:46:02.078057 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3432d0fc-00e3-4791-b162-d120422e9edb tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:46:02.086119 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3432d0fc-00e3-4791-b162-d120422e9edb tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1" status: 200 len: 1695 microversion: 2.1 time: 0.175519 Aug 31 16:46:02.086706 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3374/6759] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:46:01 2022] GET /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1 => generated 1695 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:46:02.979435 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ef00aad3-a96c-4bf6-a3de-3f0294dd5e85 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:02.980020 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ef00aad3-a96c-4bf6-a3de-3f0294dd5e85 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: b4017430-cc40-4cfe-a387-49283eaa8a42] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:02.986955 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ef00aad3-a96c-4bf6-a3de-3f0294dd5e85 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:02.987463 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ef00aad3-a96c-4bf6-a3de-3f0294dd5e85 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:02.988208 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ef00aad3-a96c-4bf6-a3de-3f0294dd5e85 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:02.988928 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ef00aad3-a96c-4bf6-a3de-3f0294dd5e85 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:02.989408 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ef00aad3-a96c-4bf6-a3de-3f0294dd5e85 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:02.989860 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ef00aad3-a96c-4bf6-a3de-3f0294dd5e85 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:03.108887 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-79b2f63c-bb41-4b16-b0dc-b9a2fa49d02d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:03.113756 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-79b2f63c-bb41-4b16-b0dc-b9a2fa49d02d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 962444ac-43a3-4c95-94f6-38414daf29c1] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:03.121219 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-79b2f63c-bb41-4b16-b0dc-b9a2fa49d02d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:03.121716 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-79b2f63c-bb41-4b16-b0dc-b9a2fa49d02d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:03.122194 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-79b2f63c-bb41-4b16-b0dc-b9a2fa49d02d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:03.122910 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-79b2f63c-bb41-4b16-b0dc-b9a2fa49d02d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:03.123374 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-79b2f63c-bb41-4b16-b0dc-b9a2fa49d02d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:03.123871 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-79b2f63c-bb41-4b16-b0dc-b9a2fa49d02d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:03.140519 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ef00aad3-a96c-4bf6-a3de-3f0294dd5e85 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:46:03.159111 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ef00aad3-a96c-4bf6-a3de-3f0294dd5e85 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/b4017430-cc40-4cfe-a387-49283eaa8a42" status: 200 len: 1569 microversion: 2.1 time: 0.184677 Aug 31 16:46:03.159977 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3386/6760] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:46:02 2022] GET /compute/v2.1/servers/b4017430-cc40-4cfe-a387-49283eaa8a42 => generated 1569 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:46:03.279397 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-79b2f63c-bb41-4b16-b0dc-b9a2fa49d02d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:46:03.288457 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-79b2f63c-bb41-4b16-b0dc-b9a2fa49d02d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1" status: 200 len: 1695 microversion: 2.1 time: 0.183352 Aug 31 16:46:03.289900 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3375/6761] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:46:03 2022] GET /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1 => generated 1695 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:46:04.182780 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-514f401e-a44a-4950-9d95-faf96d007ae4 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:04.184152 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-514f401e-a44a-4950-9d95-faf96d007ae4 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: b4017430-cc40-4cfe-a387-49283eaa8a42] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:04.191423 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-514f401e-a44a-4950-9d95-faf96d007ae4 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:04.192337 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-514f401e-a44a-4950-9d95-faf96d007ae4 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:04.192876 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-514f401e-a44a-4950-9d95-faf96d007ae4 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:04.193734 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-514f401e-a44a-4950-9d95-faf96d007ae4 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:04.194462 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-514f401e-a44a-4950-9d95-faf96d007ae4 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:04.194917 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-514f401e-a44a-4950-9d95-faf96d007ae4 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:04.312789 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-790ae90d-1e74-40fb-aee8-c9e911ef4a20 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:04.313409 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-790ae90d-1e74-40fb-aee8-c9e911ef4a20 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 962444ac-43a3-4c95-94f6-38414daf29c1] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:04.327703 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-790ae90d-1e74-40fb-aee8-c9e911ef4a20 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:04.328510 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-790ae90d-1e74-40fb-aee8-c9e911ef4a20 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:04.329140 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-790ae90d-1e74-40fb-aee8-c9e911ef4a20 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:04.330051 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-790ae90d-1e74-40fb-aee8-c9e911ef4a20 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:04.330695 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-790ae90d-1e74-40fb-aee8-c9e911ef4a20 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:04.331306 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-790ae90d-1e74-40fb-aee8-c9e911ef4a20 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:04.403194 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-514f401e-a44a-4950-9d95-faf96d007ae4 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:46:04.413387 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-514f401e-a44a-4950-9d95-faf96d007ae4 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/b4017430-cc40-4cfe-a387-49283eaa8a42" status: 200 len: 1569 microversion: 2.1 time: 0.236384 Aug 31 16:46:04.413988 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3387/6762] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:46:04 2022] GET /compute/v2.1/servers/b4017430-cc40-4cfe-a387-49283eaa8a42 => generated 1569 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:46:04.505670 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-790ae90d-1e74-40fb-aee8-c9e911ef4a20 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:46:04.520509 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-790ae90d-1e74-40fb-aee8-c9e911ef4a20 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1" status: 200 len: 1695 microversion: 2.1 time: 0.211756 Aug 31 16:46:04.521109 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3376/6763] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:46:04 2022] GET /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1 => generated 1695 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:46:05.435987 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-26dfb44b-f044-42ae-8bde-dd6bb5e25a62 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:05.436608 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-26dfb44b-f044-42ae-8bde-dd6bb5e25a62 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: b4017430-cc40-4cfe-a387-49283eaa8a42] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:05.443732 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=56 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:46:05.446289 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-26dfb44b-f044-42ae-8bde-dd6bb5e25a62 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:05.447098 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-26dfb44b-f044-42ae-8bde-dd6bb5e25a62 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:05.447808 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-26dfb44b-f044-42ae-8bde-dd6bb5e25a62 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:05.448926 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-26dfb44b-f044-42ae-8bde-dd6bb5e25a62 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:05.449561 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-26dfb44b-f044-42ae-8bde-dd6bb5e25a62 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:05.450241 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-26dfb44b-f044-42ae-8bde-dd6bb5e25a62 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:05.545968 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-476ef92e-2a5e-4916-b6cd-116987f97a52 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:05.546619 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-476ef92e-2a5e-4916-b6cd-116987f97a52 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 962444ac-43a3-4c95-94f6-38414daf29c1] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:05.554910 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-476ef92e-2a5e-4916-b6cd-116987f97a52 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:05.556139 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-476ef92e-2a5e-4916-b6cd-116987f97a52 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:05.556505 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-476ef92e-2a5e-4916-b6cd-116987f97a52 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:05.557440 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-476ef92e-2a5e-4916-b6cd-116987f97a52 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:05.558094 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-476ef92e-2a5e-4916-b6cd-116987f97a52 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:05.558704 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-476ef92e-2a5e-4916-b6cd-116987f97a52 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:05.580904 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:46:05.956403 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-26dfb44b-f044-42ae-8bde-dd6bb5e25a62 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:46:05.973199 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-26dfb44b-f044-42ae-8bde-dd6bb5e25a62 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/b4017430-cc40-4cfe-a387-49283eaa8a42" status: 200 len: 1569 microversion: 2.1 time: 0.541858 Aug 31 16:46:05.974554 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3388/6764] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:46:05 2022] GET /compute/v2.1/servers/b4017430-cc40-4cfe-a387-49283eaa8a42 => generated 1569 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:46:05.983057 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-c352225d-a726-4864-800a-4c8aee4a2576 req-413863cc-464c-4881-ae7d-bbeb9ec48c8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4017430-cc40-4cfe-a387-49283eaa8a42", "name": "network-vif-deleted", "tag": "f8146720-1978-4445-ac4c-8e9692d3809e"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:46:06.009129 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-c352225d-a726-4864-800a-4c8aee4a2576 req-413863cc-464c-4881-ae7d-bbeb9ec48c8e service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:06.011162 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-c352225d-a726-4864-800a-4c8aee4a2576 req-413863cc-464c-4881-ae7d-bbeb9ec48c8e service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:06.013642 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-c352225d-a726-4864-800a-4c8aee4a2576 req-413863cc-464c-4881-ae7d-bbeb9ec48c8e service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:06.026299 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-476ef92e-2a5e-4916-b6cd-116987f97a52 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:46:06.032384 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-c352225d-a726-4864-800a-4c8aee4a2576 req-413863cc-464c-4881-ae7d-bbeb9ec48c8e service nova] Creating event network-vif-deleted:f8146720-1978-4445-ac4c-8e9692d3809e for instance b4017430-cc40-4cfe-a387-49283eaa8a42 on n-h1-850499-9 Aug 31 16:46:06.043844 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-c352225d-a726-4864-800a-4c8aee4a2576 req-413863cc-464c-4881-ae7d-bbeb9ec48c8e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067450 Aug 31 16:46:06.046108 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-476ef92e-2a5e-4916-b6cd-116987f97a52 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1" status: 200 len: 1694 microversion: 2.1 time: 0.505445 Aug 31 16:46:06.047568 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3389/6766] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:46:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:46:06.047732 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3377/6766] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:46:05 2022] GET /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1 => generated 1694 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:46:06.997693 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4dc2511f-6bec-48f2-bb03-121a7b13745b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:06.998425 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4dc2511f-6bec-48f2-bb03-121a7b13745b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: b4017430-cc40-4cfe-a387-49283eaa8a42] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:07.009414 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4dc2511f-6bec-48f2-bb03-121a7b13745b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:07.009414 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4dc2511f-6bec-48f2-bb03-121a7b13745b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:07.009414 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4dc2511f-6bec-48f2-bb03-121a7b13745b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:07.009414 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4dc2511f-6bec-48f2-bb03-121a7b13745b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:07.011075 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4dc2511f-6bec-48f2-bb03-121a7b13745b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:07.011075 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4dc2511f-6bec-48f2-bb03-121a7b13745b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:07.074531 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-37f62c38-be4a-4a3e-b150-da451477e821 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:07.076100 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-37f62c38-be4a-4a3e-b150-da451477e821 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 962444ac-43a3-4c95-94f6-38414daf29c1] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:07.084467 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-37f62c38-be4a-4a3e-b150-da451477e821 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:07.085297 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-37f62c38-be4a-4a3e-b150-da451477e821 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:07.086615 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-37f62c38-be4a-4a3e-b150-da451477e821 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:07.088495 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-37f62c38-be4a-4a3e-b150-da451477e821 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:07.088962 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-37f62c38-be4a-4a3e-b150-da451477e821 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:07.089698 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-37f62c38-be4a-4a3e-b150-da451477e821 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:07.129090 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-4dc2511f-6bec-48f2-bb03-121a7b13745b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:46:07.141145 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4dc2511f-6bec-48f2-bb03-121a7b13745b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/b4017430-cc40-4cfe-a387-49283eaa8a42" status: 200 len: 1361 microversion: 2.1 time: 0.149440 Aug 31 16:46:07.142722 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3390/6767] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:46:06 2022] GET /compute/v2.1/servers/b4017430-cc40-4cfe-a387-49283eaa8a42 => generated 1361 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:46:07.349244 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-37f62c38-be4a-4a3e-b150-da451477e821 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:46:07.361533 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-37f62c38-be4a-4a3e-b150-da451477e821 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1" status: 200 len: 1694 microversion: 2.1 time: 0.291646 Aug 31 16:46:07.362505 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3378/6768] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:46:07 2022] GET /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1 => generated 1694 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:46:08.073934 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-6517a18d-f258-42d8-8d83-e0d71106e135 req-5506dd10-e217-4beb-91b9-5567139d02e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "962444ac-43a3-4c95-94f6-38414daf29c1", "name": "network-vif-unplugged", "status": "completed", "tag": "44cc7e58-7fc0-46b5-a51f-021cf720d9e1"}, {"name": "network-changed", "server_uuid": "962444ac-43a3-4c95-94f6-38414daf29c1", "tag": "44cc7e58-7fc0-46b5-a51f-021cf720d9e1"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:46:08.086812 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-6517a18d-f258-42d8-8d83-e0d71106e135 req-5506dd10-e217-4beb-91b9-5567139d02e9 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:08.087578 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-6517a18d-f258-42d8-8d83-e0d71106e135 req-5506dd10-e217-4beb-91b9-5567139d02e9 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:08.088229 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-6517a18d-f258-42d8-8d83-e0d71106e135 req-5506dd10-e217-4beb-91b9-5567139d02e9 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:08.102048 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-6517a18d-f258-42d8-8d83-e0d71106e135 req-5506dd10-e217-4beb-91b9-5567139d02e9 service nova] Creating event network-vif-unplugged:44cc7e58-7fc0-46b5-a51f-021cf720d9e1 for instance 962444ac-43a3-4c95-94f6-38414daf29c1 on n-h2-850499-9 Aug 31 16:46:08.102669 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-6517a18d-f258-42d8-8d83-e0d71106e135 req-5506dd10-e217-4beb-91b9-5567139d02e9 service nova] Creating event network-changed:44cc7e58-7fc0-46b5-a51f-021cf720d9e1 for instance 962444ac-43a3-4c95-94f6-38414daf29c1 on n-h2-850499-9 Aug 31 16:46:08.109502 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [req-6517a18d-f258-42d8-8d83-e0d71106e135 req-5506dd10-e217-4beb-91b9-5567139d02e9 service nova] Instance 962444ac-43a3-4c95-94f6-38414daf29c1 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850499-9', 'n-h1-850499-9'} {{(pid=122257) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 31 16:46:08.121604 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-6517a18d-f258-42d8-8d83-e0d71106e135 req-5506dd10-e217-4beb-91b9-5567139d02e9 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.052284 Aug 31 16:46:08.122673 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3391/6769] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:46:08 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:46:08.167603 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-438b4e9e-1d80-4c7a-b3c0-cb813b092d4e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:08.168765 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-438b4e9e-1d80-4c7a-b3c0-cb813b092d4e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: b4017430-cc40-4cfe-a387-49283eaa8a42] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:08.176161 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-438b4e9e-1d80-4c7a-b3c0-cb813b092d4e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:08.176741 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-438b4e9e-1d80-4c7a-b3c0-cb813b092d4e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:08.177248 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-438b4e9e-1d80-4c7a-b3c0-cb813b092d4e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:08.178067 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-438b4e9e-1d80-4c7a-b3c0-cb813b092d4e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:08.178669 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-438b4e9e-1d80-4c7a-b3c0-cb813b092d4e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:08.179168 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-438b4e9e-1d80-4c7a-b3c0-cb813b092d4e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:08.294300 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-438b4e9e-1d80-4c7a-b3c0-cb813b092d4e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:46:08.304299 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-438b4e9e-1d80-4c7a-b3c0-cb813b092d4e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/b4017430-cc40-4cfe-a387-49283eaa8a42" status: 200 len: 1361 microversion: 2.1 time: 0.141918 Aug 31 16:46:08.322547 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3379/6770] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:46:08 2022] GET /compute/v2.1/servers/b4017430-cc40-4cfe-a387-49283eaa8a42 => generated 1361 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:46:08.385057 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-33a8a24e-b508-440a-b4f1-d6f1d04505b2 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:08.385794 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-33a8a24e-b508-440a-b4f1-d6f1d04505b2 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 962444ac-43a3-4c95-94f6-38414daf29c1] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:08.392851 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-33a8a24e-b508-440a-b4f1-d6f1d04505b2 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:08.393646 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-33a8a24e-b508-440a-b4f1-d6f1d04505b2 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:08.394292 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-33a8a24e-b508-440a-b4f1-d6f1d04505b2 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:08.395234 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-33a8a24e-b508-440a-b4f1-d6f1d04505b2 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:08.395932 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-33a8a24e-b508-440a-b4f1-d6f1d04505b2 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:08.396552 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-33a8a24e-b508-440a-b4f1-d6f1d04505b2 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:08.700307 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-33a8a24e-b508-440a-b4f1-d6f1d04505b2 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:46:08.709676 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-33a8a24e-b508-440a-b4f1-d6f1d04505b2 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1" status: 200 len: 1692 microversion: 2.1 time: 0.329061 Aug 31 16:46:08.724803 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3392/6771] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:46:08 2022] GET /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1 => generated 1692 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:46:09.329670 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9967c4a3-fece-4ff6-a8b9-466a8707356c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:09.330664 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9967c4a3-fece-4ff6-a8b9-466a8707356c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: b4017430-cc40-4cfe-a387-49283eaa8a42] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:09.339097 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9967c4a3-fece-4ff6-a8b9-466a8707356c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:09.339780 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9967c4a3-fece-4ff6-a8b9-466a8707356c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:09.340335 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9967c4a3-fece-4ff6-a8b9-466a8707356c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:09.341613 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9967c4a3-fece-4ff6-a8b9-466a8707356c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:09.342192 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9967c4a3-fece-4ff6-a8b9-466a8707356c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:09.342733 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9967c4a3-fece-4ff6-a8b9-466a8707356c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:09.417422 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-9967c4a3-fece-4ff6-a8b9-466a8707356c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:46:09.425754 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9967c4a3-fece-4ff6-a8b9-466a8707356c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/b4017430-cc40-4cfe-a387-49283eaa8a42" status: 200 len: 1361 microversion: 2.1 time: 0.100194 Aug 31 16:46:09.426497 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3380/6772] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:46:09 2022] GET /compute/v2.1/servers/b4017430-cc40-4cfe-a387-49283eaa8a42 => generated 1361 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:46:09.736352 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-18d53fb4-0d44-4127-8fd8-d59b943d1bb8 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:09.739745 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-18d53fb4-0d44-4127-8fd8-d59b943d1bb8 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 962444ac-43a3-4c95-94f6-38414daf29c1] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:09.747706 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-18d53fb4-0d44-4127-8fd8-d59b943d1bb8 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:09.748223 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-18d53fb4-0d44-4127-8fd8-d59b943d1bb8 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:09.748682 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-18d53fb4-0d44-4127-8fd8-d59b943d1bb8 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:09.749416 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-18d53fb4-0d44-4127-8fd8-d59b943d1bb8 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:09.749891 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-18d53fb4-0d44-4127-8fd8-d59b943d1bb8 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:09.750338 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-18d53fb4-0d44-4127-8fd8-d59b943d1bb8 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:09.891690 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-18d53fb4-0d44-4127-8fd8-d59b943d1bb8 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:46:09.901156 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-18d53fb4-0d44-4127-8fd8-d59b943d1bb8 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1" status: 200 len: 1692 microversion: 2.1 time: 0.169137 Aug 31 16:46:09.901753 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3393/6773] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:46:09 2022] GET /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1 => generated 1692 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:46:10.446491 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6c73fa7f-6c4e-403b-a3de-ed98263c8f67 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:10.448062 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6c73fa7f-6c4e-403b-a3de-ed98263c8f67 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: b4017430-cc40-4cfe-a387-49283eaa8a42] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:10.456287 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6c73fa7f-6c4e-403b-a3de-ed98263c8f67 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:10.457022 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6c73fa7f-6c4e-403b-a3de-ed98263c8f67 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:10.457495 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6c73fa7f-6c4e-403b-a3de-ed98263c8f67 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:10.458392 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6c73fa7f-6c4e-403b-a3de-ed98263c8f67 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:10.458861 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6c73fa7f-6c4e-403b-a3de-ed98263c8f67 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:10.459296 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6c73fa7f-6c4e-403b-a3de-ed98263c8f67 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:10.526481 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-6c73fa7f-6c4e-403b-a3de-ed98263c8f67 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:46:10.535468 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6c73fa7f-6c4e-403b-a3de-ed98263c8f67 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/b4017430-cc40-4cfe-a387-49283eaa8a42" status: 200 len: 1361 microversion: 2.1 time: 0.092854 Aug 31 16:46:10.536376 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3381/6774] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:46:10 2022] GET /compute/v2.1/servers/b4017430-cc40-4cfe-a387-49283eaa8a42 => generated 1361 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:46:10.923193 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-cb12b19f-de84-4d56-a904-05c59d337c49 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:10.924087 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-cb12b19f-de84-4d56-a904-05c59d337c49 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 962444ac-43a3-4c95-94f6-38414daf29c1] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:10.932666 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cb12b19f-de84-4d56-a904-05c59d337c49 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:10.933579 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cb12b19f-de84-4d56-a904-05c59d337c49 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:10.934219 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cb12b19f-de84-4d56-a904-05c59d337c49 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:10.935111 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cb12b19f-de84-4d56-a904-05c59d337c49 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:10.935774 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cb12b19f-de84-4d56-a904-05c59d337c49 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:10.937361 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cb12b19f-de84-4d56-a904-05c59d337c49 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:11.369100 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-cb12b19f-de84-4d56-a904-05c59d337c49 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:46:11.377993 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-cb12b19f-de84-4d56-a904-05c59d337c49 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1" status: 200 len: 1692 microversion: 2.1 time: 0.459143 Aug 31 16:46:11.404088 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3394/6775] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:46:10 2022] GET /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1 => generated 1692 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:46:11.561514 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-086908f9-7908-4a27-aa18-f2a45dc0c24a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:11.563072 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-086908f9-7908-4a27-aa18-f2a45dc0c24a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: b4017430-cc40-4cfe-a387-49283eaa8a42] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:11.582119 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-086908f9-7908-4a27-aa18-f2a45dc0c24a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:11.582628 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-086908f9-7908-4a27-aa18-f2a45dc0c24a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:11.583067 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-086908f9-7908-4a27-aa18-f2a45dc0c24a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:11.602217 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-086908f9-7908-4a27-aa18-f2a45dc0c24a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:11.603041 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-086908f9-7908-4a27-aa18-f2a45dc0c24a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:11.603702 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-086908f9-7908-4a27-aa18-f2a45dc0c24a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:11.632180 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-086908f9-7908-4a27-aa18-f2a45dc0c24a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] HTTP exception thrown: Instance b4017430-cc40-4cfe-a387-49283eaa8a42 could not be found. Aug 31 16:46:11.635079 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-086908f9-7908-4a27-aa18-f2a45dc0c24a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Request method failure captured: Aug 31 16:46:11.635079 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/b4017430-cc40-4cfe-a387-49283eaa8a42 HTTP/1.1 Aug 31 16:46:11.635079 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:46:11.635079 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:46:11.635079 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:46:11.635079 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:46:11.635079 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:46:11.635079 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:46:11.635079 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:46:11.635079 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:46:11.635079 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD47qS8C6HsXEaEmR5vEYZ6_LcYWck6kjg2PE2Sm6XicPmZbBvnd8kXBk0kFrhGPgu84OodaxIz7Gcm1qVV62nKCQjCd-8My5krh8bw3lC-5obyJ5MI9WGooafg2qsKoEyqO0fUDn4HqdbQ-uRSMHzaJZriF8vfhIimZHzzbd5tR6Fco Aug 31 16:46:11.635079 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:46:11.635079 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:46:11.635079 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:46:11.635079 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:46:11.635079 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:46:11.635079 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:46:11.635079 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 798d7eff58b04ab582bac1e87112625f Aug 31 16:46:11.635079 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-TestVolumeBootPattern-1074913281 Aug 31 16:46:11.635079 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:46:11.635079 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:46:11.635079 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/798d7eff58b04ab582bac1e87112625f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/798d7eff58b04ab582bac1e87112625f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_798d7eff58b04ab582bac1e87112625f", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/798d7eff58b04ab582bac1e87112625f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:46:11.635079 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-TestVolumeBootPattern-1074913281 Aug 31 16:46:11.635079 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 798d7eff58b04ab582bac1e87112625f Aug 31 16:46:11.635079 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-TestVolumeBootPattern-1074913281 Aug 31 16:46:11.635079 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-TestVolumeBootPattern-1074913281-project Aug 31 16:46:11.635079 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:46:11.635079 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:46:11.635079 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 588d2ef08d8345a6b6175c8287633270 Aug 31 16:46:11.635079 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-TestVolumeBootPattern-1074913281-project Aug 31 16:46:11.635079 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:46:11.635079 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance b4017430-cc40-4cfe-a387-49283eaa8a42 could not be found. Aug 31 16:46:11.635079 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': 'b4017430-cc40-4cfe-a387-49283eaa8a42'} Aug 31 16:46:11.635079 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:46:11.635079 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:46:11.635079 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:46:11.635079 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:46:11.635079 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:46:11.635079 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:46:11.635079 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:46:11.635079 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:46:11.635079 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:46:11.635079 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:46:11.635079 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4017430-cc40-4cfe-a387-49283eaa8a42 could not be found. Aug 31 16:46:11.635079 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:46:11.635079 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:46:11.635079 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:46:11.635079 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:46:11.635079 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:46:11.635079 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:46:11.635079 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:46:11.635079 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:46:11.635079 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:46:11.635079 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:46:11.635079 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:46:11.635079 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:46:11.635079 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:46:11.635079 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:46:11.635079 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:46:11.635079 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:46:11.635079 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4017430-cc40-4cfe-a387-49283eaa8a42 could not be found. Aug 31 16:46:11.635079 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:46:11.635079 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:46:11.635079 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:46:11.640425 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:46:11.640425 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:46:11.640425 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:46:11.640425 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:46:11.640425 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:46:11.640425 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4017430-cc40-4cfe-a387-49283eaa8a42 could not be found. Aug 31 16:46:11.640425 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:46:11.640425 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-086908f9-7908-4a27-aa18-f2a45dc0c24a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Returning 404 to user: Instance b4017430-cc40-4cfe-a387-49283eaa8a42 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:46:11.641962 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-086908f9-7908-4a27-aa18-f2a45dc0c24a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/b4017430-cc40-4cfe-a387-49283eaa8a42" status: 404 len: 111 microversion: 2.1 time: 0.088064 Aug 31 16:46:11.642105 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3382/6776] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:46:11 2022] GET /compute/v2.1/servers/b4017430-cc40-4cfe-a387-49283eaa8a42 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:46:12.404908 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-afc66389-9563-41a2-a897-7855eca70520 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:12.406531 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-afc66389-9563-41a2-a897-7855eca70520 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 962444ac-43a3-4c95-94f6-38414daf29c1] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:12.415312 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-afc66389-9563-41a2-a897-7855eca70520 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:12.416493 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-afc66389-9563-41a2-a897-7855eca70520 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:12.417189 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-afc66389-9563-41a2-a897-7855eca70520 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:12.418358 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-afc66389-9563-41a2-a897-7855eca70520 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:12.419063 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-afc66389-9563-41a2-a897-7855eca70520 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:12.419475 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-afc66389-9563-41a2-a897-7855eca70520 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:12.625743 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-afc66389-9563-41a2-a897-7855eca70520 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:46:12.635370 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-afc66389-9563-41a2-a897-7855eca70520 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1" status: 200 len: 1689 microversion: 2.1 time: 0.234266 Aug 31 16:46:12.636683 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3395/6777] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:46:12 2022] GET /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1 => generated 1689 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:46:12.660461 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-38a81192-2386-48c6-a6c3-35db4c55b0a4 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:46:12.661147 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-38a81192-2386-48c6-a6c3-35db4c55b0a4 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 962444ac-43a3-4c95-94f6-38414daf29c1] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:12.681905 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-38a81192-2386-48c6-a6c3-35db4c55b0a4 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:12.682425 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-38a81192-2386-48c6-a6c3-35db4c55b0a4 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:12.682879 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-38a81192-2386-48c6-a6c3-35db4c55b0a4 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:12.683861 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-38a81192-2386-48c6-a6c3-35db4c55b0a4 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:12.684170 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-38a81192-2386-48c6-a6c3-35db4c55b0a4 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:12.684630 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-38a81192-2386-48c6-a6c3-35db4c55b0a4 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:12.758927 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-38a81192-2386-48c6-a6c3-35db4c55b0a4 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "POST /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1/action" status: 204 len: 0 microversion: 2.1 time: 0.101816 Aug 31 16:46:12.760002 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3383/6778] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:46:12 2022] POST /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1/action => generated 0 bytes in 105 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 16:46:12.768978 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5326723f-9793-41fa-b706-4e708e55672e tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:12.769539 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5326723f-9793-41fa-b706-4e708e55672e tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 962444ac-43a3-4c95-94f6-38414daf29c1] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:12.779178 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5326723f-9793-41fa-b706-4e708e55672e tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:12.783601 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5326723f-9793-41fa-b706-4e708e55672e tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:12.784523 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5326723f-9793-41fa-b706-4e708e55672e tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:12.790056 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5326723f-9793-41fa-b706-4e708e55672e tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:12.790795 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5326723f-9793-41fa-b706-4e708e55672e tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:12.791386 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5326723f-9793-41fa-b706-4e708e55672e tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:13.120160 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5326723f-9793-41fa-b706-4e708e55672e tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:46:13.142071 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5326723f-9793-41fa-b706-4e708e55672e tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1" status: 200 len: 1689 microversion: 2.1 time: 0.377316 Aug 31 16:46:13.143198 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3396/6779] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:46:12 2022] GET /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1 => generated 1689 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:46:14.170004 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-37e9a114-8597-4571-ad74-5bf36b6bdd57 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:14.171063 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-37e9a114-8597-4571-ad74-5bf36b6bdd57 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 962444ac-43a3-4c95-94f6-38414daf29c1] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:14.177551 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-37e9a114-8597-4571-ad74-5bf36b6bdd57 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:14.178320 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-37e9a114-8597-4571-ad74-5bf36b6bdd57 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:14.178994 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-37e9a114-8597-4571-ad74-5bf36b6bdd57 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:14.181399 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-37e9a114-8597-4571-ad74-5bf36b6bdd57 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:14.182736 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-37e9a114-8597-4571-ad74-5bf36b6bdd57 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:14.182736 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-37e9a114-8597-4571-ad74-5bf36b6bdd57 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:14.366087 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-37e9a114-8597-4571-ad74-5bf36b6bdd57 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:46:14.375901 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-37e9a114-8597-4571-ad74-5bf36b6bdd57 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1" status: 200 len: 1689 microversion: 2.1 time: 0.212362 Aug 31 16:46:14.376784 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3384/6780] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:46:14 2022] GET /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1 => generated 1689 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:46:14.662421 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-26a8d412-f609-4269-8d94-19316cfa4eee req-0406b408-710a-47b2-82f4-11bdbbb2a1cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "962444ac-43a3-4c95-94f6-38414daf29c1", "name": "network-vif-plugged", "status": "completed", "tag": "44cc7e58-7fc0-46b5-a51f-021cf720d9e1"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:46:14.680898 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-26a8d412-f609-4269-8d94-19316cfa4eee req-0406b408-710a-47b2-82f4-11bdbbb2a1cf service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:14.681611 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-26a8d412-f609-4269-8d94-19316cfa4eee req-0406b408-710a-47b2-82f4-11bdbbb2a1cf service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:14.682135 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-26a8d412-f609-4269-8d94-19316cfa4eee req-0406b408-710a-47b2-82f4-11bdbbb2a1cf service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:14.707442 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-26a8d412-f609-4269-8d94-19316cfa4eee req-0406b408-710a-47b2-82f4-11bdbbb2a1cf service nova] Creating event network-vif-plugged:44cc7e58-7fc0-46b5-a51f-021cf720d9e1 for instance 962444ac-43a3-4c95-94f6-38414daf29c1 on n-h2-850499-9 Aug 31 16:46:14.722693 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-26a8d412-f609-4269-8d94-19316cfa4eee req-0406b408-710a-47b2-82f4-11bdbbb2a1cf service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065782 Aug 31 16:46:14.724052 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3397/6781] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:46:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:46:15.400169 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-994b5014-d0a9-4a8c-980d-8f87a4d111ba tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:15.401503 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-994b5014-d0a9-4a8c-980d-8f87a4d111ba tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 962444ac-43a3-4c95-94f6-38414daf29c1] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:15.410972 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-994b5014-d0a9-4a8c-980d-8f87a4d111ba tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:15.414598 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-994b5014-d0a9-4a8c-980d-8f87a4d111ba tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:15.415176 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-994b5014-d0a9-4a8c-980d-8f87a4d111ba tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:15.425353 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-994b5014-d0a9-4a8c-980d-8f87a4d111ba tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:15.425947 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-994b5014-d0a9-4a8c-980d-8f87a4d111ba tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:15.426488 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-994b5014-d0a9-4a8c-980d-8f87a4d111ba tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:15.618293 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-994b5014-d0a9-4a8c-980d-8f87a4d111ba tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:46:15.634645 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-994b5014-d0a9-4a8c-980d-8f87a4d111ba tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1" status: 200 len: 1681 microversion: 2.1 time: 0.239108 Aug 31 16:46:15.635314 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3385/6782] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:46:15 2022] GET /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1 => generated 1681 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:46:17.167440 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-702fa7b1-a466-4228-b732-7f77707612b3 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:17.168202 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-702fa7b1-a466-4228-b732-7f77707612b3 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 15ac4673-682b-4707-a9d9-da02c4e37879] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:17.174784 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-702fa7b1-a466-4228-b732-7f77707612b3 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:17.175294 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-702fa7b1-a466-4228-b732-7f77707612b3 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:17.175776 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-702fa7b1-a466-4228-b732-7f77707612b3 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:17.176525 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-702fa7b1-a466-4228-b732-7f77707612b3 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:17.176996 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-702fa7b1-a466-4228-b732-7f77707612b3 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:17.177438 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-702fa7b1-a466-4228-b732-7f77707612b3 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:17.204902 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-702fa7b1-a466-4228-b732-7f77707612b3 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 15ac4673-682b-4707-a9d9-da02c4e37879] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:46:17.221535 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=100 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:46:17.299870 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-702fa7b1-a466-4228-b732-7f77707612b3 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "DELETE /compute/v2.1/servers/15ac4673-682b-4707-a9d9-da02c4e37879" status: 204 len: 0 microversion: 2.1 time: 0.137779 Aug 31 16:46:17.302085 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3398/6783] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:46:17 2022] DELETE /compute/v2.1/servers/15ac4673-682b-4707-a9d9-da02c4e37879 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:46:17.314460 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c4266042-bad0-40e0-b279-7618d61884a0 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:17.315313 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c4266042-bad0-40e0-b279-7618d61884a0 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 15ac4673-682b-4707-a9d9-da02c4e37879] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:17.323223 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c4266042-bad0-40e0-b279-7618d61884a0 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:17.323778 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c4266042-bad0-40e0-b279-7618d61884a0 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:17.324226 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c4266042-bad0-40e0-b279-7618d61884a0 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:17.324949 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c4266042-bad0-40e0-b279-7618d61884a0 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:17.325443 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c4266042-bad0-40e0-b279-7618d61884a0 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:17.325934 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c4266042-bad0-40e0-b279-7618d61884a0 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:17.515484 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c4266042-bad0-40e0-b279-7618d61884a0 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:46:17.524564 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c4266042-bad0-40e0-b279-7618d61884a0 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/15ac4673-682b-4707-a9d9-da02c4e37879" status: 200 len: 1411 microversion: 2.1 time: 0.215092 Aug 31 16:46:17.525577 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3386/6784] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:46:17 2022] GET /compute/v2.1/servers/15ac4673-682b-4707-a9d9-da02c4e37879 => generated 1411 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:46:18.546207 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9ac033a3-3163-46be-ae3d-68344429b28b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:18.547259 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9ac033a3-3163-46be-ae3d-68344429b28b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 15ac4673-682b-4707-a9d9-da02c4e37879] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:18.554551 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9ac033a3-3163-46be-ae3d-68344429b28b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:18.555382 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9ac033a3-3163-46be-ae3d-68344429b28b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:18.555758 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9ac033a3-3163-46be-ae3d-68344429b28b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:18.556458 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9ac033a3-3163-46be-ae3d-68344429b28b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:18.556972 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9ac033a3-3163-46be-ae3d-68344429b28b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:18.557408 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9ac033a3-3163-46be-ae3d-68344429b28b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:18.696098 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9ac033a3-3163-46be-ae3d-68344429b28b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:46:18.704422 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9ac033a3-3163-46be-ae3d-68344429b28b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/15ac4673-682b-4707-a9d9-da02c4e37879" status: 200 len: 1411 microversion: 2.1 time: 0.162340 Aug 31 16:46:18.705072 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3399/6785] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:46:18 2022] GET /compute/v2.1/servers/15ac4673-682b-4707-a9d9-da02c4e37879 => generated 1411 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:46:19.503379 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-c817180f-91a9-41ab-aeaa-14507cc58374 req-fafd45c4-f723-4f47-9d8e-d527a712af66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15ac4673-682b-4707-a9d9-da02c4e37879", "name": "network-vif-deleted", "tag": "3fdf4b50-f03c-4d02-ad34-9fb01e5a58a1"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:46:19.518824 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-c817180f-91a9-41ab-aeaa-14507cc58374 req-fafd45c4-f723-4f47-9d8e-d527a712af66 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:19.519332 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-c817180f-91a9-41ab-aeaa-14507cc58374 req-fafd45c4-f723-4f47-9d8e-d527a712af66 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:19.520001 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-c817180f-91a9-41ab-aeaa-14507cc58374 req-fafd45c4-f723-4f47-9d8e-d527a712af66 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:19.537495 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-c817180f-91a9-41ab-aeaa-14507cc58374 req-fafd45c4-f723-4f47-9d8e-d527a712af66 service nova] Creating event network-vif-deleted:3fdf4b50-f03c-4d02-ad34-9fb01e5a58a1 for instance 15ac4673-682b-4707-a9d9-da02c4e37879 on n-h1-850499-9 Aug 31 16:46:19.544945 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-c817180f-91a9-41ab-aeaa-14507cc58374 req-fafd45c4-f723-4f47-9d8e-d527a712af66 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045412 Aug 31 16:46:19.545883 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3387/6786] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:46:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:46:19.728248 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-eca7146a-916b-4fe6-9499-a0f45fb3ac1b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:19.729898 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-eca7146a-916b-4fe6-9499-a0f45fb3ac1b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 15ac4673-682b-4707-a9d9-da02c4e37879] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:19.746368 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eca7146a-916b-4fe6-9499-a0f45fb3ac1b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:19.746990 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eca7146a-916b-4fe6-9499-a0f45fb3ac1b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:19.747587 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eca7146a-916b-4fe6-9499-a0f45fb3ac1b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:19.748439 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eca7146a-916b-4fe6-9499-a0f45fb3ac1b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:19.749012 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eca7146a-916b-4fe6-9499-a0f45fb3ac1b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:19.750062 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eca7146a-916b-4fe6-9499-a0f45fb3ac1b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:19.854282 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-eca7146a-916b-4fe6-9499-a0f45fb3ac1b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:46:19.866113 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-eca7146a-916b-4fe6-9499-a0f45fb3ac1b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/15ac4673-682b-4707-a9d9-da02c4e37879" status: 200 len: 1202 microversion: 2.1 time: 0.143926 Aug 31 16:46:19.867195 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3400/6787] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:46:19 2022] GET /compute/v2.1/servers/15ac4673-682b-4707-a9d9-da02c4e37879 => generated 1202 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:46:20.893950 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-55f391ef-4c0d-42f7-b3fc-82fba24d5b7e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:20.895155 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-55f391ef-4c0d-42f7-b3fc-82fba24d5b7e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 15ac4673-682b-4707-a9d9-da02c4e37879] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:20.903746 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-55f391ef-4c0d-42f7-b3fc-82fba24d5b7e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:20.904249 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-55f391ef-4c0d-42f7-b3fc-82fba24d5b7e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:20.905882 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-55f391ef-4c0d-42f7-b3fc-82fba24d5b7e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:20.905882 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-55f391ef-4c0d-42f7-b3fc-82fba24d5b7e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:20.907346 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-55f391ef-4c0d-42f7-b3fc-82fba24d5b7e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:20.907874 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-55f391ef-4c0d-42f7-b3fc-82fba24d5b7e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:21.026753 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-55f391ef-4c0d-42f7-b3fc-82fba24d5b7e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:46:21.036301 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-55f391ef-4c0d-42f7-b3fc-82fba24d5b7e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/15ac4673-682b-4707-a9d9-da02c4e37879" status: 200 len: 1202 microversion: 2.1 time: 0.147092 Aug 31 16:46:21.037691 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3388/6788] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:46:20 2022] GET /compute/v2.1/servers/15ac4673-682b-4707-a9d9-da02c4e37879 => generated 1202 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:46:22.060224 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1a3ceba0-69bd-4229-bbb7-e34a0ab051aa tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:22.061364 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1a3ceba0-69bd-4229-bbb7-e34a0ab051aa tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 15ac4673-682b-4707-a9d9-da02c4e37879] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:22.068862 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1a3ceba0-69bd-4229-bbb7-e34a0ab051aa tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:22.069477 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1a3ceba0-69bd-4229-bbb7-e34a0ab051aa tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:22.070172 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1a3ceba0-69bd-4229-bbb7-e34a0ab051aa tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:22.070905 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1a3ceba0-69bd-4229-bbb7-e34a0ab051aa tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:22.071545 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1a3ceba0-69bd-4229-bbb7-e34a0ab051aa tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:22.072100 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1a3ceba0-69bd-4229-bbb7-e34a0ab051aa tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:22.141795 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-1a3ceba0-69bd-4229-bbb7-e34a0ab051aa tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:46:22.151041 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1a3ceba0-69bd-4229-bbb7-e34a0ab051aa tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/15ac4673-682b-4707-a9d9-da02c4e37879" status: 200 len: 1202 microversion: 2.1 time: 0.094726 Aug 31 16:46:22.151860 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3401/6789] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:46:22 2022] GET /compute/v2.1/servers/15ac4673-682b-4707-a9d9-da02c4e37879 => generated 1202 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:46:23.173406 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-dd3e3c90-27ce-45bc-ac56-27e94d127e0c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:23.174267 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-dd3e3c90-27ce-45bc-ac56-27e94d127e0c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 15ac4673-682b-4707-a9d9-da02c4e37879] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:23.182553 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dd3e3c90-27ce-45bc-ac56-27e94d127e0c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:23.183198 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dd3e3c90-27ce-45bc-ac56-27e94d127e0c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:23.183827 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dd3e3c90-27ce-45bc-ac56-27e94d127e0c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:23.184645 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dd3e3c90-27ce-45bc-ac56-27e94d127e0c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:23.185254 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dd3e3c90-27ce-45bc-ac56-27e94d127e0c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:23.185757 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dd3e3c90-27ce-45bc-ac56-27e94d127e0c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:23.252730 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-dd3e3c90-27ce-45bc-ac56-27e94d127e0c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:46:23.262596 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-dd3e3c90-27ce-45bc-ac56-27e94d127e0c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/15ac4673-682b-4707-a9d9-da02c4e37879" status: 200 len: 1202 microversion: 2.1 time: 0.093190 Aug 31 16:46:23.263342 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3389/6790] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:46:23 2022] GET /compute/v2.1/servers/15ac4673-682b-4707-a9d9-da02c4e37879 => generated 1202 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:46:24.284774 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-760a2f19-4fd3-4fd6-888b-4e47edbaa7cd tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:24.285559 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-760a2f19-4fd3-4fd6-888b-4e47edbaa7cd tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 15ac4673-682b-4707-a9d9-da02c4e37879] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:24.296388 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-760a2f19-4fd3-4fd6-888b-4e47edbaa7cd tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:24.297248 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-760a2f19-4fd3-4fd6-888b-4e47edbaa7cd tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:24.297973 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-760a2f19-4fd3-4fd6-888b-4e47edbaa7cd tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:24.299736 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-760a2f19-4fd3-4fd6-888b-4e47edbaa7cd tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:24.300552 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-760a2f19-4fd3-4fd6-888b-4e47edbaa7cd tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:24.301414 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-760a2f19-4fd3-4fd6-888b-4e47edbaa7cd tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:24.344842 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-760a2f19-4fd3-4fd6-888b-4e47edbaa7cd tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:24.345679 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-760a2f19-4fd3-4fd6-888b-4e47edbaa7cd tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:24.346402 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-760a2f19-4fd3-4fd6-888b-4e47edbaa7cd tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:24.347258 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-760a2f19-4fd3-4fd6-888b-4e47edbaa7cd tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lazy-loading 'fault' on Instance uuid 15ac4673-682b-4707-a9d9-da02c4e37879 {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:46:24.408875 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-760a2f19-4fd3-4fd6-888b-4e47edbaa7cd tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:46:24.432459 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-760a2f19-4fd3-4fd6-888b-4e47edbaa7cd tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/15ac4673-682b-4707-a9d9-da02c4e37879" status: 200 len: 1207 microversion: 2.1 time: 0.152358 Aug 31 16:46:24.433484 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3402/6791] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:46:24 2022] GET /compute/v2.1/servers/15ac4673-682b-4707-a9d9-da02c4e37879 => generated 1207 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:46:25.456471 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-51f10848-92ce-47d8-a4e1-acf8205b2e1e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:25.457196 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-51f10848-92ce-47d8-a4e1-acf8205b2e1e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 15ac4673-682b-4707-a9d9-da02c4e37879] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:25.476118 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-51f10848-92ce-47d8-a4e1-acf8205b2e1e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:25.477551 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-51f10848-92ce-47d8-a4e1-acf8205b2e1e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:25.477940 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-51f10848-92ce-47d8-a4e1-acf8205b2e1e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:25.478656 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-51f10848-92ce-47d8-a4e1-acf8205b2e1e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:25.479117 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-51f10848-92ce-47d8-a4e1-acf8205b2e1e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:25.479569 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-51f10848-92ce-47d8-a4e1-acf8205b2e1e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:25.506857 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-51f10848-92ce-47d8-a4e1-acf8205b2e1e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] HTTP exception thrown: Instance 15ac4673-682b-4707-a9d9-da02c4e37879 could not be found. Aug 31 16:46:25.509077 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-51f10848-92ce-47d8-a4e1-acf8205b2e1e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Request method failure captured: Aug 31 16:46:25.509077 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/15ac4673-682b-4707-a9d9-da02c4e37879 HTTP/1.1 Aug 31 16:46:25.509077 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:46:25.509077 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:46:25.509077 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:46:25.509077 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:46:25.509077 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:46:25.509077 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:46:25.509077 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:46:25.509077 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:46:25.509077 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD47qS8C6HsXEaEmR5vEYZ6_LcYWck6kjg2PE2Sm6XicPmZbBvnd8kXBk0kFrhGPgu84OodaxIz7Gcm1qVV62nKCQjCd-8My5krh8bw3lC-5obyJ5MI9WGooafg2qsKoEyqO0fUDn4HqdbQ-uRSMHzaJZriF8vfhIimZHzzbd5tR6Fco Aug 31 16:46:25.509077 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:46:25.509077 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:46:25.509077 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:46:25.509077 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:46:25.509077 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:46:25.509077 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:46:25.509077 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 798d7eff58b04ab582bac1e87112625f Aug 31 16:46:25.509077 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-TestVolumeBootPattern-1074913281 Aug 31 16:46:25.509077 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:46:25.509077 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:46:25.509077 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/798d7eff58b04ab582bac1e87112625f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/798d7eff58b04ab582bac1e87112625f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_798d7eff58b04ab582bac1e87112625f", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/798d7eff58b04ab582bac1e87112625f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:46:25.509077 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-TestVolumeBootPattern-1074913281 Aug 31 16:46:25.509077 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 798d7eff58b04ab582bac1e87112625f Aug 31 16:46:25.509077 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-TestVolumeBootPattern-1074913281 Aug 31 16:46:25.509077 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-TestVolumeBootPattern-1074913281-project Aug 31 16:46:25.509077 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:46:25.509077 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:46:25.509077 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 588d2ef08d8345a6b6175c8287633270 Aug 31 16:46:25.509077 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-TestVolumeBootPattern-1074913281-project Aug 31 16:46:25.509077 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:46:25.509077 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance 15ac4673-682b-4707-a9d9-da02c4e37879 could not be found. Aug 31 16:46:25.509077 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '15ac4673-682b-4707-a9d9-da02c4e37879'} Aug 31 16:46:25.509077 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:46:25.509077 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:46:25.509077 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:46:25.509077 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:46:25.509077 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:46:25.509077 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:46:25.509077 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:46:25.509077 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:46:25.509077 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:46:25.509077 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:46:25.509077 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15ac4673-682b-4707-a9d9-da02c4e37879 could not be found. Aug 31 16:46:25.509077 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:46:25.509077 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:46:25.509077 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:46:25.509077 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:46:25.509077 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:46:25.509077 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:46:25.509077 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:46:25.509077 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:46:25.509077 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:46:25.509077 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:46:25.509077 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:46:25.509077 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:46:25.509077 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:46:25.509077 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:46:25.509077 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:46:25.509077 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:46:25.509077 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15ac4673-682b-4707-a9d9-da02c4e37879 could not be found. Aug 31 16:46:25.509077 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:46:25.509077 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:46:25.509077 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:46:25.514530 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:46:25.514530 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:46:25.514530 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:46:25.514530 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:46:25.514530 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:46:25.514530 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15ac4673-682b-4707-a9d9-da02c4e37879 could not be found. Aug 31 16:46:25.514530 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:46:25.514530 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-51f10848-92ce-47d8-a4e1-acf8205b2e1e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Returning 404 to user: Instance 15ac4673-682b-4707-a9d9-da02c4e37879 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:46:25.514530 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-51f10848-92ce-47d8-a4e1-acf8205b2e1e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/15ac4673-682b-4707-a9d9-da02c4e37879" status: 404 len: 111 microversion: 2.1 time: 0.058695 Aug 31 16:46:25.514530 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3390/6792] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:46:25 2022] GET /compute/v2.1/servers/15ac4673-682b-4707-a9d9-da02c4e37879 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 16:46:27.662820 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d2a6d891-7813-4202-a41b-51b32f8f50bd tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:27.663340 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d2a6d891-7813-4202-a41b-51b32f8f50bd tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: b4017430-cc40-4cfe-a387-49283eaa8a42] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:27.671290 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d2a6d891-7813-4202-a41b-51b32f8f50bd tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:27.672111 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d2a6d891-7813-4202-a41b-51b32f8f50bd tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:27.672763 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d2a6d891-7813-4202-a41b-51b32f8f50bd tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:27.673490 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d2a6d891-7813-4202-a41b-51b32f8f50bd tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:27.673966 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d2a6d891-7813-4202-a41b-51b32f8f50bd tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:27.674651 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d2a6d891-7813-4202-a41b-51b32f8f50bd tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:27.691144 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-d2a6d891-7813-4202-a41b-51b32f8f50bd tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] HTTP exception thrown: Instance b4017430-cc40-4cfe-a387-49283eaa8a42 could not be found. Aug 31 16:46:27.692987 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d2a6d891-7813-4202-a41b-51b32f8f50bd tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Request method failure captured: Aug 31 16:46:27.692987 n-d-850499-9 devstack@n-api.service[122257]: request: DELETE /compute/v2.1/servers/b4017430-cc40-4cfe-a387-49283eaa8a42 HTTP/1.1 Aug 31 16:46:27.692987 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:46:27.692987 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:46:27.692987 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:46:27.692987 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:46:27.692987 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:46:27.692987 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:46:27.692987 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:46:27.692987 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:46:27.692987 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD47qS8C6HsXEaEmR5vEYZ6_LcYWck6kjg2PE2Sm6XicPmZbBvnd8kXBk0kFrhGPgu84OodaxIz7Gcm1qVV62nKCQjCd-8My5krh8bw3lC-5obyJ5MI9WGooafg2qsKoEyqO0fUDn4HqdbQ-uRSMHzaJZriF8vfhIimZHzzbd5tR6Fco Aug 31 16:46:27.692987 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:46:27.692987 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:46:27.692987 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:46:27.692987 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:46:27.692987 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:46:27.692987 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:46:27.692987 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 798d7eff58b04ab582bac1e87112625f Aug 31 16:46:27.692987 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-TestVolumeBootPattern-1074913281 Aug 31 16:46:27.692987 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:46:27.692987 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:46:27.692987 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/798d7eff58b04ab582bac1e87112625f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/798d7eff58b04ab582bac1e87112625f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_798d7eff58b04ab582bac1e87112625f", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/798d7eff58b04ab582bac1e87112625f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:46:27.692987 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-TestVolumeBootPattern-1074913281 Aug 31 16:46:27.692987 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 798d7eff58b04ab582bac1e87112625f Aug 31 16:46:27.692987 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-TestVolumeBootPattern-1074913281 Aug 31 16:46:27.692987 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-TestVolumeBootPattern-1074913281-project Aug 31 16:46:27.692987 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:46:27.692987 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:46:27.692987 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 588d2ef08d8345a6b6175c8287633270 Aug 31 16:46:27.692987 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-TestVolumeBootPattern-1074913281-project Aug 31 16:46:27.692987 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:46:27.692987 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance b4017430-cc40-4cfe-a387-49283eaa8a42 could not be found. Aug 31 16:46:27.692987 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': 'b4017430-cc40-4cfe-a387-49283eaa8a42'} Aug 31 16:46:27.692987 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:46:27.692987 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:46:27.692987 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:46:27.692987 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:46:27.692987 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:46:27.692987 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:46:27.692987 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:46:27.692987 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:46:27.692987 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:46:27.692987 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:46:27.692987 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4017430-cc40-4cfe-a387-49283eaa8a42 could not be found. Aug 31 16:46:27.692987 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:46:27.692987 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:46:27.692987 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:46:27.692987 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:46:27.692987 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:46:27.692987 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:46:27.692987 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:46:27.692987 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:46:27.692987 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:46:27.692987 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:46:27.692987 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:46:27.692987 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:46:27.692987 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:46:27.692987 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:46:27.692987 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:46:27.692987 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:46:27.692987 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:46:27.692987 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:46:27.698823 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4017430-cc40-4cfe-a387-49283eaa8a42 could not be found. Aug 31 16:46:27.698823 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:46:27.698823 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:46:27.698823 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:46:27.698823 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:46:27.698823 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:46:27.698823 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:46:27.698823 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:46:27.698823 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:46:27.698823 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4017430-cc40-4cfe-a387-49283eaa8a42 could not be found. Aug 31 16:46:27.698823 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:46:27.698823 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d2a6d891-7813-4202-a41b-51b32f8f50bd tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Returning 404 to user: Instance b4017430-cc40-4cfe-a387-49283eaa8a42 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:46:27.698823 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d2a6d891-7813-4202-a41b-51b32f8f50bd tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "DELETE /compute/v2.1/servers/b4017430-cc40-4cfe-a387-49283eaa8a42" status: 404 len: 111 microversion: 2.1 time: 0.038404 Aug 31 16:46:27.700498 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3403/6793] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:46:27 2022] DELETE /compute/v2.1/servers/b4017430-cc40-4cfe-a387-49283eaa8a42 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:46:27.708808 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6c427938-d2da-4a78-a888-775d83f7b6e7 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:27.710076 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6c427938-d2da-4a78-a888-775d83f7b6e7 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: b4017430-cc40-4cfe-a387-49283eaa8a42] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:27.713657 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:46:27.719720 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6c427938-d2da-4a78-a888-775d83f7b6e7 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:27.720369 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6c427938-d2da-4a78-a888-775d83f7b6e7 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:27.720912 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6c427938-d2da-4a78-a888-775d83f7b6e7 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:27.721747 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6c427938-d2da-4a78-a888-775d83f7b6e7 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:27.722313 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6c427938-d2da-4a78-a888-775d83f7b6e7 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:27.722844 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6c427938-d2da-4a78-a888-775d83f7b6e7 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:27.740133 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-6c427938-d2da-4a78-a888-775d83f7b6e7 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] HTTP exception thrown: Instance b4017430-cc40-4cfe-a387-49283eaa8a42 could not be found. Aug 31 16:46:27.742348 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6c427938-d2da-4a78-a888-775d83f7b6e7 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Request method failure captured: Aug 31 16:46:27.742348 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/b4017430-cc40-4cfe-a387-49283eaa8a42 HTTP/1.1 Aug 31 16:46:27.742348 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:46:27.742348 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:46:27.742348 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:46:27.742348 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:46:27.742348 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:46:27.742348 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:46:27.742348 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:46:27.742348 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:46:27.742348 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD47qS8C6HsXEaEmR5vEYZ6_LcYWck6kjg2PE2Sm6XicPmZbBvnd8kXBk0kFrhGPgu84OodaxIz7Gcm1qVV62nKCQjCd-8My5krh8bw3lC-5obyJ5MI9WGooafg2qsKoEyqO0fUDn4HqdbQ-uRSMHzaJZriF8vfhIimZHzzbd5tR6Fco Aug 31 16:46:27.742348 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:46:27.742348 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:46:27.742348 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:46:27.742348 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:46:27.742348 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:46:27.742348 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:46:27.742348 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 798d7eff58b04ab582bac1e87112625f Aug 31 16:46:27.742348 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-TestVolumeBootPattern-1074913281 Aug 31 16:46:27.742348 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:46:27.742348 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:46:27.742348 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/798d7eff58b04ab582bac1e87112625f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/798d7eff58b04ab582bac1e87112625f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_798d7eff58b04ab582bac1e87112625f", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/798d7eff58b04ab582bac1e87112625f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:46:27.742348 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-TestVolumeBootPattern-1074913281 Aug 31 16:46:27.742348 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 798d7eff58b04ab582bac1e87112625f Aug 31 16:46:27.742348 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-TestVolumeBootPattern-1074913281 Aug 31 16:46:27.742348 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-TestVolumeBootPattern-1074913281-project Aug 31 16:46:27.742348 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:46:27.742348 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:46:27.742348 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 588d2ef08d8345a6b6175c8287633270 Aug 31 16:46:27.742348 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-TestVolumeBootPattern-1074913281-project Aug 31 16:46:27.742348 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:46:27.742348 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance b4017430-cc40-4cfe-a387-49283eaa8a42 could not be found. Aug 31 16:46:27.742348 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': 'b4017430-cc40-4cfe-a387-49283eaa8a42'} Aug 31 16:46:27.742348 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:46:27.742348 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:46:27.742348 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:46:27.742348 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:46:27.742348 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:46:27.742348 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:46:27.742348 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:46:27.742348 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:46:27.742348 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:46:27.742348 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:46:27.742348 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4017430-cc40-4cfe-a387-49283eaa8a42 could not be found. Aug 31 16:46:27.742348 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:46:27.742348 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:46:27.742348 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:46:27.742348 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:46:27.742348 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:46:27.742348 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:46:27.742348 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:46:27.742348 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:46:27.742348 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:46:27.742348 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:46:27.742348 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:46:27.742348 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:46:27.742348 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:46:27.742348 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:46:27.742348 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:46:27.742348 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:46:27.742348 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4017430-cc40-4cfe-a387-49283eaa8a42 could not be found. Aug 31 16:46:27.742348 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:46:27.742348 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:46:27.742348 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:46:27.748532 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:46:27.748532 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:46:27.748532 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:46:27.748532 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:46:27.748532 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:46:27.748532 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4017430-cc40-4cfe-a387-49283eaa8a42 could not be found. Aug 31 16:46:27.748532 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:46:27.748532 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6c427938-d2da-4a78-a888-775d83f7b6e7 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Returning 404 to user: Instance b4017430-cc40-4cfe-a387-49283eaa8a42 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:46:27.748532 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6c427938-d2da-4a78-a888-775d83f7b6e7 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/b4017430-cc40-4cfe-a387-49283eaa8a42" status: 404 len: 111 microversion: 2.1 time: 0.041633 Aug 31 16:46:27.749856 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3391/6794] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:46:27 2022] GET /compute/v2.1/servers/b4017430-cc40-4cfe-a387-49283eaa8a42 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:46:28.190656 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e8892cc4-290b-42ad-850c-56bb5e3ea5c4 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:28.191177 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e8892cc4-290b-42ad-850c-56bb5e3ea5c4 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 15ac4673-682b-4707-a9d9-da02c4e37879] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:28.198628 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e8892cc4-290b-42ad-850c-56bb5e3ea5c4 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:28.199084 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e8892cc4-290b-42ad-850c-56bb5e3ea5c4 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:28.199600 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e8892cc4-290b-42ad-850c-56bb5e3ea5c4 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:28.200321 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e8892cc4-290b-42ad-850c-56bb5e3ea5c4 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:28.200800 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e8892cc4-290b-42ad-850c-56bb5e3ea5c4 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:28.201249 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e8892cc4-290b-42ad-850c-56bb5e3ea5c4 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:28.216906 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-e8892cc4-290b-42ad-850c-56bb5e3ea5c4 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] HTTP exception thrown: Instance 15ac4673-682b-4707-a9d9-da02c4e37879 could not be found. Aug 31 16:46:28.218503 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e8892cc4-290b-42ad-850c-56bb5e3ea5c4 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Request method failure captured: Aug 31 16:46:28.218503 n-d-850499-9 devstack@n-api.service[122257]: request: DELETE /compute/v2.1/servers/15ac4673-682b-4707-a9d9-da02c4e37879 HTTP/1.1 Aug 31 16:46:28.218503 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:46:28.218503 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:46:28.218503 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:46:28.218503 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:46:28.218503 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:46:28.218503 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:46:28.218503 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:46:28.218503 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:46:28.218503 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD47qS8C6HsXEaEmR5vEYZ6_LcYWck6kjg2PE2Sm6XicPmZbBvnd8kXBk0kFrhGPgu84OodaxIz7Gcm1qVV62nKCQjCd-8My5krh8bw3lC-5obyJ5MI9WGooafg2qsKoEyqO0fUDn4HqdbQ-uRSMHzaJZriF8vfhIimZHzzbd5tR6Fco Aug 31 16:46:28.218503 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:46:28.218503 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:46:28.218503 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:46:28.218503 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:46:28.218503 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:46:28.218503 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:46:28.218503 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 798d7eff58b04ab582bac1e87112625f Aug 31 16:46:28.218503 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-TestVolumeBootPattern-1074913281 Aug 31 16:46:28.218503 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:46:28.218503 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:46:28.218503 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/798d7eff58b04ab582bac1e87112625f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/798d7eff58b04ab582bac1e87112625f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_798d7eff58b04ab582bac1e87112625f", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/798d7eff58b04ab582bac1e87112625f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:46:28.218503 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-TestVolumeBootPattern-1074913281 Aug 31 16:46:28.218503 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 798d7eff58b04ab582bac1e87112625f Aug 31 16:46:28.218503 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-TestVolumeBootPattern-1074913281 Aug 31 16:46:28.218503 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-TestVolumeBootPattern-1074913281-project Aug 31 16:46:28.218503 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:46:28.218503 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:46:28.218503 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 588d2ef08d8345a6b6175c8287633270 Aug 31 16:46:28.218503 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-TestVolumeBootPattern-1074913281-project Aug 31 16:46:28.218503 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:46:28.218503 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance 15ac4673-682b-4707-a9d9-da02c4e37879 could not be found. Aug 31 16:46:28.218503 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '15ac4673-682b-4707-a9d9-da02c4e37879'} Aug 31 16:46:28.218503 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:46:28.218503 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:46:28.218503 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:46:28.218503 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:46:28.218503 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:46:28.218503 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:46:28.218503 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:46:28.218503 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:46:28.218503 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:46:28.218503 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:46:28.218503 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15ac4673-682b-4707-a9d9-da02c4e37879 could not be found. Aug 31 16:46:28.218503 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:46:28.218503 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:46:28.218503 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:46:28.218503 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:46:28.218503 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:46:28.218503 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:46:28.218503 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:46:28.218503 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:46:28.218503 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:46:28.218503 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:46:28.218503 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:46:28.218503 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:46:28.218503 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:46:28.218503 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:46:28.218503 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:46:28.218503 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:46:28.218503 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:46:28.218503 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:46:28.224621 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15ac4673-682b-4707-a9d9-da02c4e37879 could not be found. Aug 31 16:46:28.224621 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:46:28.224621 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:46:28.224621 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:46:28.224621 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:46:28.224621 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:46:28.224621 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:46:28.224621 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:46:28.224621 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:46:28.224621 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15ac4673-682b-4707-a9d9-da02c4e37879 could not be found. Aug 31 16:46:28.224621 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:46:28.224621 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e8892cc4-290b-42ad-850c-56bb5e3ea5c4 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Returning 404 to user: Instance 15ac4673-682b-4707-a9d9-da02c4e37879 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:46:28.224621 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e8892cc4-290b-42ad-850c-56bb5e3ea5c4 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "DELETE /compute/v2.1/servers/15ac4673-682b-4707-a9d9-da02c4e37879" status: 404 len: 111 microversion: 2.1 time: 0.033643 Aug 31 16:46:28.224621 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3404/6795] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:46:28 2022] DELETE /compute/v2.1/servers/15ac4673-682b-4707-a9d9-da02c4e37879 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:46:28.228974 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0310c01a-82fb-4831-9e50-8880eedd7b74 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:28.229596 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0310c01a-82fb-4831-9e50-8880eedd7b74 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 15ac4673-682b-4707-a9d9-da02c4e37879] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:28.236347 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0310c01a-82fb-4831-9e50-8880eedd7b74 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:28.236849 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0310c01a-82fb-4831-9e50-8880eedd7b74 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:28.237297 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0310c01a-82fb-4831-9e50-8880eedd7b74 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:28.238005 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0310c01a-82fb-4831-9e50-8880eedd7b74 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:28.238739 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0310c01a-82fb-4831-9e50-8880eedd7b74 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:28.239175 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0310c01a-82fb-4831-9e50-8880eedd7b74 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:28.253204 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-0310c01a-82fb-4831-9e50-8880eedd7b74 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] HTTP exception thrown: Instance 15ac4673-682b-4707-a9d9-da02c4e37879 could not be found. Aug 31 16:46:28.254755 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0310c01a-82fb-4831-9e50-8880eedd7b74 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Request method failure captured: Aug 31 16:46:28.254755 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/15ac4673-682b-4707-a9d9-da02c4e37879 HTTP/1.1 Aug 31 16:46:28.254755 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:46:28.254755 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:46:28.254755 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:46:28.254755 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:46:28.254755 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:46:28.254755 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:46:28.254755 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:46:28.254755 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:46:28.254755 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD47qS8C6HsXEaEmR5vEYZ6_LcYWck6kjg2PE2Sm6XicPmZbBvnd8kXBk0kFrhGPgu84OodaxIz7Gcm1qVV62nKCQjCd-8My5krh8bw3lC-5obyJ5MI9WGooafg2qsKoEyqO0fUDn4HqdbQ-uRSMHzaJZriF8vfhIimZHzzbd5tR6Fco Aug 31 16:46:28.254755 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:46:28.254755 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:46:28.254755 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:46:28.254755 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:46:28.254755 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:46:28.254755 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:46:28.254755 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 798d7eff58b04ab582bac1e87112625f Aug 31 16:46:28.254755 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-TestVolumeBootPattern-1074913281 Aug 31 16:46:28.254755 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:46:28.254755 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:46:28.254755 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/798d7eff58b04ab582bac1e87112625f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/798d7eff58b04ab582bac1e87112625f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_798d7eff58b04ab582bac1e87112625f", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/798d7eff58b04ab582bac1e87112625f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:46:28.254755 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-TestVolumeBootPattern-1074913281 Aug 31 16:46:28.254755 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 798d7eff58b04ab582bac1e87112625f Aug 31 16:46:28.254755 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-TestVolumeBootPattern-1074913281 Aug 31 16:46:28.254755 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-TestVolumeBootPattern-1074913281-project Aug 31 16:46:28.254755 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:46:28.254755 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:46:28.254755 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 588d2ef08d8345a6b6175c8287633270 Aug 31 16:46:28.254755 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-TestVolumeBootPattern-1074913281-project Aug 31 16:46:28.254755 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:46:28.254755 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance 15ac4673-682b-4707-a9d9-da02c4e37879 could not be found. Aug 31 16:46:28.254755 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '15ac4673-682b-4707-a9d9-da02c4e37879'} Aug 31 16:46:28.254755 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:46:28.254755 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:46:28.254755 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:46:28.254755 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:46:28.254755 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:46:28.254755 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:46:28.254755 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:46:28.254755 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:46:28.254755 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:46:28.254755 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:46:28.254755 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15ac4673-682b-4707-a9d9-da02c4e37879 could not be found. Aug 31 16:46:28.254755 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:46:28.254755 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:46:28.254755 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:46:28.254755 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:46:28.254755 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:46:28.254755 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:46:28.254755 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:46:28.254755 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:46:28.254755 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:46:28.254755 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:46:28.254755 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:46:28.254755 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:46:28.254755 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:46:28.254755 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:46:28.254755 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:46:28.254755 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:46:28.254755 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15ac4673-682b-4707-a9d9-da02c4e37879 could not be found. Aug 31 16:46:28.254755 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:46:28.254755 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:46:28.254755 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:46:28.260831 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:46:28.260831 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:46:28.260831 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:46:28.260831 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:46:28.260831 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:46:28.260831 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15ac4673-682b-4707-a9d9-da02c4e37879 could not be found. Aug 31 16:46:28.260831 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:46:28.260831 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0310c01a-82fb-4831-9e50-8880eedd7b74 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Returning 404 to user: Instance 15ac4673-682b-4707-a9d9-da02c4e37879 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:46:28.260831 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0310c01a-82fb-4831-9e50-8880eedd7b74 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/15ac4673-682b-4707-a9d9-da02c4e37879" status: 404 len: 111 microversion: 2.1 time: 0.031183 Aug 31 16:46:28.260831 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3392/6796] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:46:28 2022] GET /compute/v2.1/servers/15ac4673-682b-4707-a9d9-da02c4e37879 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:46:28.336882 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8d4ad7f0-05e1-4ee0-b982-9f675732eefb tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Action: 'create', calling method: .version_select at 0x7f5ae3adb430>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-435793919", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNBIwqD3HX18rgq2bOVNbKbTFkpReRil7Cf0Hr+g6G4FZ8Q3nAdN0o+8tuB3b9ni6ATyuoJAxBGY/F8t11wIq/vF/k0WKN8kdJdW7P38oJIhFiXH5JiHhSJH0lalEeKqQg=="}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:46:28.353742 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-8d4ad7f0-05e1-4ee0-b982-9f675732eefb tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Getting quotas for project 798d7eff58b04ab582bac1e87112625f. Resources: {'key_pairs'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:46:28.359040 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-8d4ad7f0-05e1-4ee0-b982-9f675732eefb tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Getting quotas for user 588d2ef08d8345a6b6175c8287633270 and project 798d7eff58b04ab582bac1e87112625f. Resources: {'key_pairs'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:46:28.386401 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8d4ad7f0-05e1-4ee0-b982-9f675732eefb tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.053851 Aug 31 16:46:28.387009 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3405/6797] 10.222.0.61 () {60 vars in 1159 bytes} [Wed Aug 31 16:46:28 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:46:48.525659 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c32dcca3-8140-4d82-b1f6-2a84b1d8798e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1892860217", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-435793919", "security_groups": [{"name": "tempest-secgroup-smoke-64941522"}], "block_device_mapping_v2": [{"uuid": "d43b69c1-aa51-4c04-b846-18da4fd68bca", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0b707539-6131-412e-ba43-5bdd2cb0fbe5"}]}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:46:48.538295 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=3 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:46:48.539368 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:46:49.062565 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-c32dcca3-8140-4d82-b1f6-2a84b1d8798e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] validate_networks() for [('0b707539-6131-412e-ba43-5bdd2cb0fbe5', None, None, None, None, None)] {{(pid=122256) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:46:49.772532 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-c32dcca3-8140-4d82-b1f6-2a84b1d8798e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:46:49.774151 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-c32dcca3-8140-4d82-b1f6-2a84b1d8798e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:46:49.774366 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-c32dcca3-8140-4d82-b1f6-2a84b1d8798e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:46:49.774620 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-c32dcca3-8140-4d82-b1f6-2a84b1d8798e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:46:49.775362 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-c32dcca3-8140-4d82-b1f6-2a84b1d8798e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:46:49.807140 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c32dcca3-8140-4d82-b1f6-2a84b1d8798e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:49.807831 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c32dcca3-8140-4d82-b1f6-2a84b1d8798e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:49.808446 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c32dcca3-8140-4d82-b1f6-2a84b1d8798e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:49.809563 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c32dcca3-8140-4d82-b1f6-2a84b1d8798e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:49.810167 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c32dcca3-8140-4d82-b1f6-2a84b1d8798e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:49.812152 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c32dcca3-8140-4d82-b1f6-2a84b1d8798e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:49.900664 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-c32dcca3-8140-4d82-b1f6-2a84b1d8798e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Getting quotas for project 798d7eff58b04ab582bac1e87112625f. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:46:49.904702 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c83f36b6-6ddc-47c4-b2bf-58a02a1e5615 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:46:49.907208 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c83f36b6-6ddc-47c4-b2bf-58a02a1e5615 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 962444ac-43a3-4c95-94f6-38414daf29c1] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:49.910089 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:46:49.910287 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=4 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:46:49.910885 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:46:49.915748 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-c32dcca3-8140-4d82-b1f6-2a84b1d8798e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Getting quotas for user 588d2ef08d8345a6b6175c8287633270 and project 798d7eff58b04ab582bac1e87112625f. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:46:49.955137 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c83f36b6-6ddc-47c4-b2bf-58a02a1e5615 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:49.980597 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c83f36b6-6ddc-47c4-b2bf-58a02a1e5615 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:49.981668 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c83f36b6-6ddc-47c4-b2bf-58a02a1e5615 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:49.982911 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c83f36b6-6ddc-47c4-b2bf-58a02a1e5615 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:49.983845 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c83f36b6-6ddc-47c4-b2bf-58a02a1e5615 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:49.989532 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c83f36b6-6ddc-47c4-b2bf-58a02a1e5615 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:50.120813 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c32dcca3-8140-4d82-b1f6-2a84b1d8798e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Going to run 1 instances... {{(pid=122256) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:46:50.122995 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c32dcca3-8140-4d82-b1f6-2a84b1d8798e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: f8037ce9-f608-4fba-aed6-52b6d33f4175] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d43b69c1-aa51-4c04-b846-18da4fd68bca',volume_size=None,volume_type=None)] {{(pid=122256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:46:50.126189 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c83f36b6-6ddc-47c4-b2bf-58a02a1e5615 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "POST /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1/action" status: 200 len: 24579 microversion: 2.1 time: 0.225120 Aug 31 16:46:50.126927 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3406/6798] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:46:49 2022] POST /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1/action => generated 24579 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 16:46:50.436068 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c32dcca3-8140-4d82-b1f6-2a84b1d8798e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.914713 Aug 31 16:46:50.440188 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3393/6799] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:46:48 2022] POST /compute/v2.1/servers => generated 404 bytes in 1922 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:46:50.454475 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d74197ee-1fb6-4920-8724-e4ccb6107455 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:50.462259 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d74197ee-1fb6-4920-8724-e4ccb6107455 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: f8037ce9-f608-4fba-aed6-52b6d33f4175] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:50.593893 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d74197ee-1fb6-4920-8724-e4ccb6107455 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:46:50.610007 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d74197ee-1fb6-4920-8724-e4ccb6107455 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/f8037ce9-f608-4fba-aed6-52b6d33f4175" status: 200 len: 1094 microversion: 2.1 time: 0.163041 Aug 31 16:46:50.611095 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3407/6800] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:46:50 2022] GET /compute/v2.1/servers/f8037ce9-f608-4fba-aed6-52b6d33f4175 => generated 1094 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:46:51.638684 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-53ab09b0-ae2e-4dcb-bc75-49bcdac3ff55 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:51.640318 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-53ab09b0-ae2e-4dcb-bc75-49bcdac3ff55 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: f8037ce9-f608-4fba-aed6-52b6d33f4175] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:51.648480 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-53ab09b0-ae2e-4dcb-bc75-49bcdac3ff55 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:51.649190 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-53ab09b0-ae2e-4dcb-bc75-49bcdac3ff55 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:51.652510 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-53ab09b0-ae2e-4dcb-bc75-49bcdac3ff55 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:51.652944 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-53ab09b0-ae2e-4dcb-bc75-49bcdac3ff55 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:51.653653 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-53ab09b0-ae2e-4dcb-bc75-49bcdac3ff55 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:51.654116 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-53ab09b0-ae2e-4dcb-bc75-49bcdac3ff55 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:51.696865 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-95219a5e-15f1-42d9-96f3-3622316bd934 tempest-TestAggregatesBasicOps-1486102392 tempest-TestAggregatesBasicOps-1486102392-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-1251426372", "availability_zone": "foo_zone"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:46:51.718336 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.aggregate [None req-95219a5e-15f1-42d9-96f3-3622316bd934 tempest-TestAggregatesBasicOps-1486102392 tempest-TestAggregatesBasicOps-1486102392-project-admin] Generated uuid 4f85cdf6-82b7-4f74-b29b-ce8ad42375c1 for aggregate {{(pid=122256) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 31 16:46:51.739897 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-53ab09b0-ae2e-4dcb-bc75-49bcdac3ff55 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:46:51.748916 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-53ab09b0-ae2e-4dcb-bc75-49bcdac3ff55 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/f8037ce9-f608-4fba-aed6-52b6d33f4175" status: 200 len: 1192 microversion: 2.1 time: 0.114054 Aug 31 16:46:51.749515 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3408/6801] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:46:51 2022] GET /compute/v2.1/servers/f8037ce9-f608-4fba-aed6-52b6d33f4175 => generated 1192 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:46:51.757555 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-95219a5e-15f1-42d9-96f3-3622316bd934 tempest-TestAggregatesBasicOps-1486102392 tempest-TestAggregatesBasicOps-1486102392-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates" status: 200 len: 209 microversion: 2.1 time: 0.133355 Aug 31 16:46:51.759945 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3394/6802] 10.222.0.61 () {60 vars in 1164 bytes} [Wed Aug 31 16:46:51 2022] POST /compute/v2.1/os-aggregates => generated 209 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:46:51.776092 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6bb4548c-c0f9-43c3-af5e-e4201dece1fd tempest-TestAggregatesBasicOps-1486102392 tempest-TestAggregatesBasicOps-1486102392-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:46:51.806251 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6bb4548c-c0f9-43c3-af5e-e4201dece1fd tempest-TestAggregatesBasicOps-1486102392 tempest-TestAggregatesBasicOps-1486102392-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 319 microversion: 2.1 time: 0.036285 Aug 31 16:46:51.813894 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3409/6803] 10.222.0.61 () {60 vars in 1194 bytes} [Wed Aug 31 16:46:51 2022] POST /compute/v2.1/os-aggregates/19/action => generated 319 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:46:51.819241 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-40f1176c-b5ae-4c5c-b022-0a3b4b1cc0d1 tempest-TestAggregatesBasicOps-1486102392 tempest-TestAggregatesBasicOps-1486102392-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:51.823148 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-40f1176c-b5ae-4c5c-b022-0a3b4b1cc0d1 tempest-TestAggregatesBasicOps-1486102392 tempest-TestAggregatesBasicOps-1486102392-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:51.828492 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-40f1176c-b5ae-4c5c-b022-0a3b4b1cc0d1 tempest-TestAggregatesBasicOps-1486102392 tempest-TestAggregatesBasicOps-1486102392-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:51.828968 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-40f1176c-b5ae-4c5c-b022-0a3b4b1cc0d1 tempest-TestAggregatesBasicOps-1486102392 tempest-TestAggregatesBasicOps-1486102392-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:51.829875 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-40f1176c-b5ae-4c5c-b022-0a3b4b1cc0d1 tempest-TestAggregatesBasicOps-1486102392 tempest-TestAggregatesBasicOps-1486102392-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:51.831027 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-40f1176c-b5ae-4c5c-b022-0a3b4b1cc0d1 tempest-TestAggregatesBasicOps-1486102392 tempest-TestAggregatesBasicOps-1486102392-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:51.831924 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-40f1176c-b5ae-4c5c-b022-0a3b4b1cc0d1 tempest-TestAggregatesBasicOps-1486102392 tempest-TestAggregatesBasicOps-1486102392-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:51.869437 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-40f1176c-b5ae-4c5c-b022-0a3b4b1cc0d1 tempest-TestAggregatesBasicOps-1486102392 tempest-TestAggregatesBasicOps-1486102392-project-admin] 10.222.0.61 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.054322 Aug 31 16:46:51.871087 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3395/6804] 10.222.0.61 () {58 vars in 1176 bytes} [Wed Aug 31 16:46:51 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:46:51.884263 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9e45e30c-204a-4e07-b033-38d1a8099eb3 tempest-TestAggregatesBasicOps-1486102392 tempest-TestAggregatesBasicOps-1486102392-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:51.894696 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9e45e30c-204a-4e07-b033-38d1a8099eb3 tempest-TestAggregatesBasicOps-1486102392 tempest-TestAggregatesBasicOps-1486102392-project-admin] 10.222.0.61 "GET /compute/v2.1/os-aggregates" status: 200 len: 298 microversion: 2.1 time: 0.015836 Aug 31 16:46:51.895280 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3410/6805] 10.222.0.61 () {58 vars in 1143 bytes} [Wed Aug 31 16:46:51 2022] GET /compute/v2.1/os-aggregates => generated 298 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:46:51.910246 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-42ceb56c-005a-4a8b-9869-a701d81a74b4 tempest-TestAggregatesBasicOps-1486102392 tempest-TestAggregatesBasicOps-1486102392-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-850499-9"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:46:51.922004 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42ceb56c-005a-4a8b-9869-a701d81a74b4 tempest-TestAggregatesBasicOps-1486102392 tempest-TestAggregatesBasicOps-1486102392-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:51.923153 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42ceb56c-005a-4a8b-9869-a701d81a74b4 tempest-TestAggregatesBasicOps-1486102392 tempest-TestAggregatesBasicOps-1486102392-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:51.923636 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42ceb56c-005a-4a8b-9869-a701d81a74b4 tempest-TestAggregatesBasicOps-1486102392 tempest-TestAggregatesBasicOps-1486102392-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:52.400778 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-42ceb56c-005a-4a8b-9869-a701d81a74b4 tempest-TestAggregatesBasicOps-1486102392 tempest-TestAggregatesBasicOps-1486102392-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 310 microversion: 2.1 time: 0.494498 Aug 31 16:46:52.408900 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3396/6806] 10.222.0.61 () {60 vars in 1194 bytes} [Wed Aug 31 16:46:51 2022] POST /compute/v2.1/os-aggregates/19/action => generated 310 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:46:52.415899 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f432bcd0-f1cd-4417-9562-e80ff7872a44 tempest-TestAggregatesBasicOps-1486102392 tempest-TestAggregatesBasicOps-1486102392-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:52.427266 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f432bcd0-f1cd-4417-9562-e80ff7872a44 tempest-TestAggregatesBasicOps-1486102392 tempest-TestAggregatesBasicOps-1486102392-project-admin] 10.222.0.61 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 310 microversion: 2.1 time: 0.015841 Aug 31 16:46:52.428742 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3411/6807] 10.222.0.61 () {58 vars in 1152 bytes} [Wed Aug 31 16:46:52 2022] GET /compute/v2.1/os-aggregates/19 => generated 310 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:46:52.442442 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ba57c50b-69e9-4d3e-80c6-86120a304fd5 tempest-TestAggregatesBasicOps-1486102392 tempest-TestAggregatesBasicOps-1486102392-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-766538871", "availability_zone": "foo_zone"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:46:52.716344 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ba57c50b-69e9-4d3e-80c6-86120a304fd5 tempest-TestAggregatesBasicOps-1486102392 tempest-TestAggregatesBasicOps-1486102392-project-admin] 10.222.0.61 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 341 microversion: 2.1 time: 0.278914 Aug 31 16:46:52.717674 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3397/6808] 10.222.0.61 () {60 vars in 1173 bytes} [Wed Aug 31 16:46:52 2022] PUT /compute/v2.1/os-aggregates/19 => generated 341 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:46:52.734058 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-74a813dc-24cd-4706-a1f5-2d600d5ed45c tempest-TestAggregatesBasicOps-1486102392 tempest-TestAggregatesBasicOps-1486102392-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:46:52.772686 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a01422e5-24be-4f43-a5e2-723491d79209 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:52.774346 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a01422e5-24be-4f43-a5e2-723491d79209 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: f8037ce9-f608-4fba-aed6-52b6d33f4175] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:52.779367 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-74a813dc-24cd-4706-a1f5-2d600d5ed45c tempest-TestAggregatesBasicOps-1486102392 tempest-TestAggregatesBasicOps-1486102392-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 355 microversion: 2.1 time: 0.052205 Aug 31 16:46:52.780631 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3412/6809] 10.222.0.61 () {60 vars in 1194 bytes} [Wed Aug 31 16:46:52 2022] POST /compute/v2.1/os-aggregates/19/action => generated 355 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:46:52.789147 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a01422e5-24be-4f43-a5e2-723491d79209 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:52.789668 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a01422e5-24be-4f43-a5e2-723491d79209 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:52.792544 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a01422e5-24be-4f43-a5e2-723491d79209 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:52.793398 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a01422e5-24be-4f43-a5e2-723491d79209 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:52.793893 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a01422e5-24be-4f43-a5e2-723491d79209 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:52.795053 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a01422e5-24be-4f43-a5e2-723491d79209 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:52.796437 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5f806d12-82bc-41c9-b231-a91b053bcb1c tempest-TestAggregatesBasicOps-1486102392 tempest-TestAggregatesBasicOps-1486102392-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:52.818868 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5f806d12-82bc-41c9-b231-a91b053bcb1c tempest-TestAggregatesBasicOps-1486102392 tempest-TestAggregatesBasicOps-1486102392-project-admin] 10.222.0.61 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 355 microversion: 2.1 time: 0.026808 Aug 31 16:46:52.821217 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3413/6810] 10.222.0.61 () {58 vars in 1152 bytes} [Wed Aug 31 16:46:52 2022] GET /compute/v2.1/os-aggregates/19 => generated 355 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:46:52.837336 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-dcd81010-2496-490d-98cb-93be86156b71 tempest-TestAggregatesBasicOps-1486102392 tempest-TestAggregatesBasicOps-1486102392-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-850499-9"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:46:52.858044 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dcd81010-2496-490d-98cb-93be86156b71 tempest-TestAggregatesBasicOps-1486102392 tempest-TestAggregatesBasicOps-1486102392-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:52.858905 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dcd81010-2496-490d-98cb-93be86156b71 tempest-TestAggregatesBasicOps-1486102392 tempest-TestAggregatesBasicOps-1486102392-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:52.859925 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dcd81010-2496-490d-98cb-93be86156b71 tempest-TestAggregatesBasicOps-1486102392 tempest-TestAggregatesBasicOps-1486102392-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:53.044874 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a01422e5-24be-4f43-a5e2-723491d79209 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:46:53.047295 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-dcd81010-2496-490d-98cb-93be86156b71 tempest-TestAggregatesBasicOps-1486102392 tempest-TestAggregatesBasicOps-1486102392-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 340 microversion: 2.1 time: 0.217695 Aug 31 16:46:53.048445 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3414/6811] 10.222.0.61 () {60 vars in 1194 bytes} [Wed Aug 31 16:46:52 2022] POST /compute/v2.1/os-aggregates/19/action => generated 340 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:46:53.057088 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a01422e5-24be-4f43-a5e2-723491d79209 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/f8037ce9-f608-4fba-aed6-52b6d33f4175" status: 200 len: 1214 microversion: 2.1 time: 0.290553 Aug 31 16:46:53.060464 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-643ece1a-421e-45ac-b2ec-e768779ba703 tempest-TestAggregatesBasicOps-1486102392 tempest-TestAggregatesBasicOps-1486102392-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:53.063670 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3398/6812] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:46:52 2022] GET /compute/v2.1/servers/f8037ce9-f608-4fba-aed6-52b6d33f4175 => generated 1214 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:46:53.098056 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-643ece1a-421e-45ac-b2ec-e768779ba703 tempest-TestAggregatesBasicOps-1486102392 tempest-TestAggregatesBasicOps-1486102392-project-admin] 10.222.0.61 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.041758 Aug 31 16:46:53.098923 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3415/6813] 10.222.0.61 () {58 vars in 1155 bytes} [Wed Aug 31 16:46:53 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Aug 31 16:46:54.083341 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3227db70-538e-4181-922d-7c094dacea95 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:54.084450 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3227db70-538e-4181-922d-7c094dacea95 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: f8037ce9-f608-4fba-aed6-52b6d33f4175] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:54.108211 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3227db70-538e-4181-922d-7c094dacea95 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:54.108767 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3227db70-538e-4181-922d-7c094dacea95 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:54.111667 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3227db70-538e-4181-922d-7c094dacea95 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:54.114045 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3227db70-538e-4181-922d-7c094dacea95 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:54.118922 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3227db70-538e-4181-922d-7c094dacea95 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:54.119394 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3227db70-538e-4181-922d-7c094dacea95 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:54.533945 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3227db70-538e-4181-922d-7c094dacea95 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:46:54.554476 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3227db70-538e-4181-922d-7c094dacea95 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/f8037ce9-f608-4fba-aed6-52b6d33f4175" status: 200 len: 1276 microversion: 2.1 time: 0.476788 Aug 31 16:46:54.555653 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3399/6814] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:46:54 2022] GET /compute/v2.1/servers/f8037ce9-f608-4fba-aed6-52b6d33f4175 => generated 1276 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:46:55.584828 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ee9f3481-4cad-4210-ba93-9fda11fd9aa4 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:55.587486 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ee9f3481-4cad-4210-ba93-9fda11fd9aa4 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: f8037ce9-f608-4fba-aed6-52b6d33f4175] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:55.612024 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ee9f3481-4cad-4210-ba93-9fda11fd9aa4 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:55.612808 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ee9f3481-4cad-4210-ba93-9fda11fd9aa4 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:55.613767 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ee9f3481-4cad-4210-ba93-9fda11fd9aa4 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:55.615275 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ee9f3481-4cad-4210-ba93-9fda11fd9aa4 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:55.617156 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ee9f3481-4cad-4210-ba93-9fda11fd9aa4 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:55.620994 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ee9f3481-4cad-4210-ba93-9fda11fd9aa4 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:56.331008 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ee9f3481-4cad-4210-ba93-9fda11fd9aa4 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:46:56.352527 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ee9f3481-4cad-4210-ba93-9fda11fd9aa4 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/f8037ce9-f608-4fba-aed6-52b6d33f4175" status: 200 len: 1276 microversion: 2.1 time: 0.771552 Aug 31 16:46:56.365677 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3416/6815] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:46:55 2022] GET /compute/v2.1/servers/f8037ce9-f608-4fba-aed6-52b6d33f4175 => generated 1276 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:46:56.880559 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-5b687b4d-84e2-4725-b43b-55168df05981 req-1dcfabd6-99ea-4990-a3f4-a32ec551e3e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8037ce9-f608-4fba-aed6-52b6d33f4175", "tag": "f07fd1db-0972-4f97-9fb3-1da21d5997ba"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:46:56.896807 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-5b687b4d-84e2-4725-b43b-55168df05981 req-1dcfabd6-99ea-4990-a3f4-a32ec551e3e2 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:56.905235 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-5b687b4d-84e2-4725-b43b-55168df05981 req-1dcfabd6-99ea-4990-a3f4-a32ec551e3e2 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:56.906348 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-5b687b4d-84e2-4725-b43b-55168df05981 req-1dcfabd6-99ea-4990-a3f4-a32ec551e3e2 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:56.931778 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-5b687b4d-84e2-4725-b43b-55168df05981 req-1dcfabd6-99ea-4990-a3f4-a32ec551e3e2 service nova] Creating event network-changed:f07fd1db-0972-4f97-9fb3-1da21d5997ba for instance f8037ce9-f608-4fba-aed6-52b6d33f4175 on n-h1-850499-9 Aug 31 16:46:56.949956 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-5b687b4d-84e2-4725-b43b-55168df05981 req-1dcfabd6-99ea-4990-a3f4-a32ec551e3e2 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075150 Aug 31 16:46:56.950949 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3400/6816] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:46:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:46:57.389913 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8f62da7a-bbf0-4730-b245-f91ec7bdf277 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:57.391383 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8f62da7a-bbf0-4730-b245-f91ec7bdf277 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: f8037ce9-f608-4fba-aed6-52b6d33f4175] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:57.402747 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8f62da7a-bbf0-4730-b245-f91ec7bdf277 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:57.410813 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8f62da7a-bbf0-4730-b245-f91ec7bdf277 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:57.413317 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8f62da7a-bbf0-4730-b245-f91ec7bdf277 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:57.416912 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8f62da7a-bbf0-4730-b245-f91ec7bdf277 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:57.418901 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8f62da7a-bbf0-4730-b245-f91ec7bdf277 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:57.422153 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8f62da7a-bbf0-4730-b245-f91ec7bdf277 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:58.189839 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8f62da7a-bbf0-4730-b245-f91ec7bdf277 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:46:58.225311 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8f62da7a-bbf0-4730-b245-f91ec7bdf277 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/f8037ce9-f608-4fba-aed6-52b6d33f4175" status: 200 len: 1276 microversion: 2.1 time: 0.837874 Aug 31 16:46:58.228727 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3417/6817] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:46:57 2022] GET /compute/v2.1/servers/f8037ce9-f608-4fba-aed6-52b6d33f4175 => generated 1276 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:46:59.263237 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-64dc0b92-4d6d-46ae-9942-801f0fea23de tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:59.266623 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-64dc0b92-4d6d-46ae-9942-801f0fea23de tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: f8037ce9-f608-4fba-aed6-52b6d33f4175] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:59.295140 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-64dc0b92-4d6d-46ae-9942-801f0fea23de tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:59.297055 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-64dc0b92-4d6d-46ae-9942-801f0fea23de tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:59.303351 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-64dc0b92-4d6d-46ae-9942-801f0fea23de tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:59.309433 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-64dc0b92-4d6d-46ae-9942-801f0fea23de tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:59.315774 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-64dc0b92-4d6d-46ae-9942-801f0fea23de tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:59.317911 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-64dc0b92-4d6d-46ae-9942-801f0fea23de tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:59.934904 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=6 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:47:00.340637 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-64dc0b92-4d6d-46ae-9942-801f0fea23de tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:47:00.354477 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-64dc0b92-4d6d-46ae-9942-801f0fea23de tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/f8037ce9-f608-4fba-aed6-52b6d33f4175" status: 200 len: 1276 microversion: 2.1 time: 1.105869 Aug 31 16:47:00.355417 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3401/6818] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:46:59 2022] GET /compute/v2.1/servers/f8037ce9-f608-4fba-aed6-52b6d33f4175 => generated 1276 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:47:01.405595 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7e642030-c335-4e8c-a08d-65b470fbd09c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:01.406289 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7e642030-c335-4e8c-a08d-65b470fbd09c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: f8037ce9-f608-4fba-aed6-52b6d33f4175] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:01.409450 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:47:01.418346 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7e642030-c335-4e8c-a08d-65b470fbd09c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:01.418867 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7e642030-c335-4e8c-a08d-65b470fbd09c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:01.419328 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7e642030-c335-4e8c-a08d-65b470fbd09c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:01.420187 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7e642030-c335-4e8c-a08d-65b470fbd09c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:01.420831 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7e642030-c335-4e8c-a08d-65b470fbd09c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:01.421498 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7e642030-c335-4e8c-a08d-65b470fbd09c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:01.702252 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7e642030-c335-4e8c-a08d-65b470fbd09c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:47:01.729997 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7e642030-c335-4e8c-a08d-65b470fbd09c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/f8037ce9-f608-4fba-aed6-52b6d33f4175" status: 200 len: 1264 microversion: 2.1 time: 0.345800 Aug 31 16:47:01.732648 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3418/6819] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:47:01 2022] GET /compute/v2.1/servers/f8037ce9-f608-4fba-aed6-52b6d33f4175 => generated 1264 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:47:02.769647 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-02791bb5-bf4a-43aa-88d8-854c631c3cfe tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:02.772202 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-02791bb5-bf4a-43aa-88d8-854c631c3cfe tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: f8037ce9-f608-4fba-aed6-52b6d33f4175] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:02.777688 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=4 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:47:02.787454 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-02791bb5-bf4a-43aa-88d8-854c631c3cfe tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:02.788377 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-02791bb5-bf4a-43aa-88d8-854c631c3cfe tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:02.789492 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-02791bb5-bf4a-43aa-88d8-854c631c3cfe tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:02.790486 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-02791bb5-bf4a-43aa-88d8-854c631c3cfe tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:02.791529 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-02791bb5-bf4a-43aa-88d8-854c631c3cfe tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:02.792310 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-02791bb5-bf4a-43aa-88d8-854c631c3cfe tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:02.995866 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-02791bb5-bf4a-43aa-88d8-854c631c3cfe tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:47:03.006684 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-02791bb5-bf4a-43aa-88d8-854c631c3cfe tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/f8037ce9-f608-4fba-aed6-52b6d33f4175" status: 200 len: 1264 microversion: 2.1 time: 0.244468 Aug 31 16:47:03.007666 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3402/6820] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:47:02 2022] GET /compute/v2.1/servers/f8037ce9-f608-4fba-aed6-52b6d33f4175 => generated 1264 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:47:04.030513 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-51527c0b-90da-4bca-a84f-45bc181d29eb tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:04.031069 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-51527c0b-90da-4bca-a84f-45bc181d29eb tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: f8037ce9-f608-4fba-aed6-52b6d33f4175] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:04.048227 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-51527c0b-90da-4bca-a84f-45bc181d29eb tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:04.048755 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-51527c0b-90da-4bca-a84f-45bc181d29eb tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:04.052743 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-51527c0b-90da-4bca-a84f-45bc181d29eb tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:04.053696 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-51527c0b-90da-4bca-a84f-45bc181d29eb tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:04.055987 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-51527c0b-90da-4bca-a84f-45bc181d29eb tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:04.056617 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-51527c0b-90da-4bca-a84f-45bc181d29eb tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:04.092079 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-421068dd-7d91-4817-98b7-6e569f904cc8 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-2095419749", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "networks": [{"uuid": "17c6db8f-5502-454b-8f4a-2fd28f728ac9"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1475348723", "security_groups": []}, "os:scheduler_hints": {"different_host": ["46b94da0-6f4a-4912-a2f1-e23b83df2052"]}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:47:04.184694 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-421068dd-7d91-4817-98b7-6e569f904cc8 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] validate_networks() for [('17c6db8f-5502-454b-8f4a-2fd28f728ac9', None, None, None, None, None)] {{(pid=122256) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:47:04.481882 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-51527c0b-90da-4bca-a84f-45bc181d29eb tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:47:04.499669 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-51527c0b-90da-4bca-a84f-45bc181d29eb tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/f8037ce9-f608-4fba-aed6-52b6d33f4175" status: 200 len: 1264 microversion: 2.1 time: 0.472555 Aug 31 16:47:04.501074 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3419/6821] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:47:04 2022] GET /compute/v2.1/servers/f8037ce9-f608-4fba-aed6-52b6d33f4175 => generated 1264 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:47:05.015963 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-421068dd-7d91-4817-98b7-6e569f904cc8 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:47:05.016340 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-421068dd-7d91-4817-98b7-6e569f904cc8 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:47:05.016989 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-421068dd-7d91-4817-98b7-6e569f904cc8 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:47:05.017402 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-421068dd-7d91-4817-98b7-6e569f904cc8 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:47:05.017820 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-421068dd-7d91-4817-98b7-6e569f904cc8 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:47:05.063008 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-421068dd-7d91-4817-98b7-6e569f904cc8 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:05.064339 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-421068dd-7d91-4817-98b7-6e569f904cc8 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:05.065556 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-421068dd-7d91-4817-98b7-6e569f904cc8 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:05.067410 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-421068dd-7d91-4817-98b7-6e569f904cc8 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:05.067997 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-421068dd-7d91-4817-98b7-6e569f904cc8 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:05.068541 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-421068dd-7d91-4817-98b7-6e569f904cc8 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:05.091290 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-421068dd-7d91-4817-98b7-6e569f904cc8 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Getting quotas for project b18b57cca5d34cada128b3a7e2b5adc8. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:47:05.098239 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-421068dd-7d91-4817-98b7-6e569f904cc8 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Getting quotas for user 1c112e27f9234237a138100fbc23818c and project b18b57cca5d34cada128b3a7e2b5adc8. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:47:05.120859 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-421068dd-7d91-4817-98b7-6e569f904cc8 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Going to run 1 instances... {{(pid=122256) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:47:05.124339 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-421068dd-7d91-4817-98b7-6e569f904cc8 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] [instance: 166290ea-36c3-452a-97a4-4545d8826288] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:47:05.181666 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-421068dd-7d91-4817-98b7-6e569f904cc8 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 1.093323 Aug 31 16:47:05.182577 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3403/6822] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:47:04 2022] POST /compute/v2.1/servers => generated 361 bytes in 1095 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 16:47:05.194598 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-62fd8e8c-9cba-4669-947d-ca67677c2425 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:05.195635 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-62fd8e8c-9cba-4669-947d-ca67677c2425 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] [instance: 166290ea-36c3-452a-97a4-4545d8826288] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:05.304736 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-62fd8e8c-9cba-4669-947d-ca67677c2425 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c112e27f9234237a138100fbc23818c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18b57cca5d34cada128b3a7e2b5adc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:47:05.315664 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-62fd8e8c-9cba-4669-947d-ca67677c2425 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] 10.222.0.61 "GET /compute/v2.1/servers/166290ea-36c3-452a-97a4-4545d8826288" status: 200 len: 1242 microversion: 2.1 time: 0.124708 Aug 31 16:47:05.317531 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3420/6823] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:47:05 2022] GET /compute/v2.1/servers/166290ea-36c3-452a-97a4-4545d8826288 => generated 1242 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:47:05.538406 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f968fc7d-0657-4e98-856a-4b87ebf5096c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:05.540640 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f968fc7d-0657-4e98-856a-4b87ebf5096c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: f8037ce9-f608-4fba-aed6-52b6d33f4175] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:05.561461 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f968fc7d-0657-4e98-856a-4b87ebf5096c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:05.567463 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f968fc7d-0657-4e98-856a-4b87ebf5096c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:05.567463 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f968fc7d-0657-4e98-856a-4b87ebf5096c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:05.567463 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f968fc7d-0657-4e98-856a-4b87ebf5096c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:05.567463 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f968fc7d-0657-4e98-856a-4b87ebf5096c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:05.567802 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f968fc7d-0657-4e98-856a-4b87ebf5096c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:05.829321 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f968fc7d-0657-4e98-856a-4b87ebf5096c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:47:05.843890 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f968fc7d-0657-4e98-856a-4b87ebf5096c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/f8037ce9-f608-4fba-aed6-52b6d33f4175" status: 200 len: 1264 microversion: 2.1 time: 0.307561 Aug 31 16:47:05.843890 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3404/6824] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:47:05 2022] GET /compute/v2.1/servers/f8037ce9-f608-4fba-aed6-52b6d33f4175 => generated 1264 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:47:06.343464 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e075665c-ce40-45f6-83b5-3ca5c8e31488 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:06.345929 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e075665c-ce40-45f6-83b5-3ca5c8e31488 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] [instance: 166290ea-36c3-452a-97a4-4545d8826288] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:06.356895 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e075665c-ce40-45f6-83b5-3ca5c8e31488 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:06.358190 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e075665c-ce40-45f6-83b5-3ca5c8e31488 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:06.359488 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e075665c-ce40-45f6-83b5-3ca5c8e31488 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:06.360982 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e075665c-ce40-45f6-83b5-3ca5c8e31488 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:06.368064 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e075665c-ce40-45f6-83b5-3ca5c8e31488 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:06.368776 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e075665c-ce40-45f6-83b5-3ca5c8e31488 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:06.467105 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e075665c-ce40-45f6-83b5-3ca5c8e31488 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c112e27f9234237a138100fbc23818c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18b57cca5d34cada128b3a7e2b5adc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:47:06.476544 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e075665c-ce40-45f6-83b5-3ca5c8e31488 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] 10.222.0.61 "GET /compute/v2.1/servers/166290ea-36c3-452a-97a4-4545d8826288" status: 200 len: 1294 microversion: 2.1 time: 0.141141 Aug 31 16:47:06.478471 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3421/6825] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:47:06 2022] GET /compute/v2.1/servers/166290ea-36c3-452a-97a4-4545d8826288 => generated 1294 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:47:06.861542 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-95cfcd78-4c23-43b6-8ab6-e48225e0f0f0 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:06.862425 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-95cfcd78-4c23-43b6-8ab6-e48225e0f0f0 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: f8037ce9-f608-4fba-aed6-52b6d33f4175] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:06.876465 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-95cfcd78-4c23-43b6-8ab6-e48225e0f0f0 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:06.876977 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-95cfcd78-4c23-43b6-8ab6-e48225e0f0f0 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:06.877635 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-95cfcd78-4c23-43b6-8ab6-e48225e0f0f0 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:06.880470 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-95cfcd78-4c23-43b6-8ab6-e48225e0f0f0 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:06.881023 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-95cfcd78-4c23-43b6-8ab6-e48225e0f0f0 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:06.881447 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-95cfcd78-4c23-43b6-8ab6-e48225e0f0f0 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:07.118720 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-95cfcd78-4c23-43b6-8ab6-e48225e0f0f0 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:47:07.128434 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-95cfcd78-4c23-43b6-8ab6-e48225e0f0f0 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/f8037ce9-f608-4fba-aed6-52b6d33f4175" status: 200 len: 1264 microversion: 2.1 time: 0.271393 Aug 31 16:47:07.129198 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3405/6826] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:47:06 2022] GET /compute/v2.1/servers/f8037ce9-f608-4fba-aed6-52b6d33f4175 => generated 1264 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:47:07.504718 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e0bec5a6-39dd-4b92-bf80-bbfa75249acc tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:07.505275 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e0bec5a6-39dd-4b92-bf80-bbfa75249acc tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] [instance: 166290ea-36c3-452a-97a4-4545d8826288] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:07.516219 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e0bec5a6-39dd-4b92-bf80-bbfa75249acc tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:07.516703 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e0bec5a6-39dd-4b92-bf80-bbfa75249acc tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:07.517163 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e0bec5a6-39dd-4b92-bf80-bbfa75249acc tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:07.517896 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e0bec5a6-39dd-4b92-bf80-bbfa75249acc tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:07.518376 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e0bec5a6-39dd-4b92-bf80-bbfa75249acc tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:07.521886 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e0bec5a6-39dd-4b92-bf80-bbfa75249acc tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:07.645698 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e0bec5a6-39dd-4b92-bf80-bbfa75249acc tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c112e27f9234237a138100fbc23818c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18b57cca5d34cada128b3a7e2b5adc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:47:07.669733 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e0bec5a6-39dd-4b92-bf80-bbfa75249acc tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] 10.222.0.61 "GET /compute/v2.1/servers/166290ea-36c3-452a-97a4-4545d8826288" status: 200 len: 1300 microversion: 2.1 time: 0.171187 Aug 31 16:47:07.670976 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3422/6827] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:47:07 2022] GET /compute/v2.1/servers/166290ea-36c3-452a-97a4-4545d8826288 => generated 1300 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:47:08.153068 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-bb3e0723-22d8-4ab4-be99-a8087dedda50 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:08.153855 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-bb3e0723-22d8-4ab4-be99-a8087dedda50 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: f8037ce9-f608-4fba-aed6-52b6d33f4175] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:08.163724 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bb3e0723-22d8-4ab4-be99-a8087dedda50 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:08.164330 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bb3e0723-22d8-4ab4-be99-a8087dedda50 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:08.164920 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bb3e0723-22d8-4ab4-be99-a8087dedda50 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:08.165711 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bb3e0723-22d8-4ab4-be99-a8087dedda50 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:08.166183 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bb3e0723-22d8-4ab4-be99-a8087dedda50 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:08.166617 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bb3e0723-22d8-4ab4-be99-a8087dedda50 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:08.553449 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-bb3e0723-22d8-4ab4-be99-a8087dedda50 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:47:08.565490 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-bb3e0723-22d8-4ab4-be99-a8087dedda50 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/f8037ce9-f608-4fba-aed6-52b6d33f4175" status: 200 len: 1264 microversion: 2.1 time: 0.416266 Aug 31 16:47:08.566426 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3406/6828] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:47:08 2022] GET /compute/v2.1/servers/f8037ce9-f608-4fba-aed6-52b6d33f4175 => generated 1264 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:47:08.693900 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-57f1ec08-859f-4e0e-82ed-1ee80a37f95c tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:08.694620 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-57f1ec08-859f-4e0e-82ed-1ee80a37f95c tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] [instance: 166290ea-36c3-452a-97a4-4545d8826288] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:08.703140 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-57f1ec08-859f-4e0e-82ed-1ee80a37f95c tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:08.703689 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-57f1ec08-859f-4e0e-82ed-1ee80a37f95c tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:08.704332 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-57f1ec08-859f-4e0e-82ed-1ee80a37f95c tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:08.705239 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-57f1ec08-859f-4e0e-82ed-1ee80a37f95c tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:08.705877 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-57f1ec08-859f-4e0e-82ed-1ee80a37f95c tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:08.706386 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-57f1ec08-859f-4e0e-82ed-1ee80a37f95c tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:08.828871 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-57f1ec08-859f-4e0e-82ed-1ee80a37f95c tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c112e27f9234237a138100fbc23818c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18b57cca5d34cada128b3a7e2b5adc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:47:08.838881 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-57f1ec08-859f-4e0e-82ed-1ee80a37f95c tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] 10.222.0.61 "GET /compute/v2.1/servers/166290ea-36c3-452a-97a4-4545d8826288" status: 200 len: 1300 microversion: 2.1 time: 0.149125 Aug 31 16:47:08.839834 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3423/6829] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:47:08 2022] GET /compute/v2.1/servers/166290ea-36c3-452a-97a4-4545d8826288 => generated 1300 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:47:08.923241 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-bd5f5dc7-0dad-4b3e-9643-3bf7429de25f req-b86f1c80-094a-4a04-9837-5bc2bb3de621 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "166290ea-36c3-452a-97a4-4545d8826288", "tag": "f3d9e7e3-6e44-498f-a5a8-26ddfb45c611"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:47:08.935283 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-bd5f5dc7-0dad-4b3e-9643-3bf7429de25f req-b86f1c80-094a-4a04-9837-5bc2bb3de621 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:08.936117 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-bd5f5dc7-0dad-4b3e-9643-3bf7429de25f req-b86f1c80-094a-4a04-9837-5bc2bb3de621 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:08.936775 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-bd5f5dc7-0dad-4b3e-9643-3bf7429de25f req-b86f1c80-094a-4a04-9837-5bc2bb3de621 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:08.959994 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-bd5f5dc7-0dad-4b3e-9643-3bf7429de25f req-b86f1c80-094a-4a04-9837-5bc2bb3de621 service nova] Creating event network-changed:f3d9e7e3-6e44-498f-a5a8-26ddfb45c611 for instance 166290ea-36c3-452a-97a4-4545d8826288 on n-h1-850499-9 Aug 31 16:47:08.976291 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-bd5f5dc7-0dad-4b3e-9643-3bf7429de25f req-b86f1c80-094a-4a04-9837-5bc2bb3de621 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054223 Aug 31 16:47:08.976291 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3407/6830] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:47:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:47:09.599907 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7353185b-ee62-4394-9903-be0b73f78799 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:09.600550 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7353185b-ee62-4394-9903-be0b73f78799 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: f8037ce9-f608-4fba-aed6-52b6d33f4175] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:09.609484 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7353185b-ee62-4394-9903-be0b73f78799 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:09.610141 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7353185b-ee62-4394-9903-be0b73f78799 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:09.610668 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7353185b-ee62-4394-9903-be0b73f78799 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:09.611891 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7353185b-ee62-4394-9903-be0b73f78799 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:09.612467 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7353185b-ee62-4394-9903-be0b73f78799 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:09.612992 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7353185b-ee62-4394-9903-be0b73f78799 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:09.857228 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7353185b-ee62-4394-9903-be0b73f78799 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:47:09.867991 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7353185b-ee62-4394-9903-be0b73f78799 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/f8037ce9-f608-4fba-aed6-52b6d33f4175" status: 200 len: 1264 microversion: 2.1 time: 0.273181 Aug 31 16:47:09.869245 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3424/6831] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:47:09 2022] GET /compute/v2.1/servers/f8037ce9-f608-4fba-aed6-52b6d33f4175 => generated 1264 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:47:09.880796 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c0a95df8-f43b-4ada-aac0-6c9a0b6a423e tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:09.880796 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c0a95df8-f43b-4ada-aac0-6c9a0b6a423e tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] [instance: 166290ea-36c3-452a-97a4-4545d8826288] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:09.891636 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c0a95df8-f43b-4ada-aac0-6c9a0b6a423e tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:09.892276 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c0a95df8-f43b-4ada-aac0-6c9a0b6a423e tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:09.892929 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c0a95df8-f43b-4ada-aac0-6c9a0b6a423e tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:09.893749 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c0a95df8-f43b-4ada-aac0-6c9a0b6a423e tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:09.894293 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c0a95df8-f43b-4ada-aac0-6c9a0b6a423e tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:09.894800 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c0a95df8-f43b-4ada-aac0-6c9a0b6a423e tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:09.993349 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c0a95df8-f43b-4ada-aac0-6c9a0b6a423e tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c112e27f9234237a138100fbc23818c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18b57cca5d34cada128b3a7e2b5adc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:47:10.002038 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c0a95df8-f43b-4ada-aac0-6c9a0b6a423e tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] 10.222.0.61 "GET /compute/v2.1/servers/166290ea-36c3-452a-97a4-4545d8826288" status: 200 len: 1300 microversion: 2.1 time: 0.144157 Aug 31 16:47:10.016317 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3408/6832] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:47:09 2022] GET /compute/v2.1/servers/166290ea-36c3-452a-97a4-4545d8826288 => generated 1300 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:47:10.897810 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-89f21cbf-1dee-4931-86a6-8af3f91dc031 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:10.901342 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-89f21cbf-1dee-4931-86a6-8af3f91dc031 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: f8037ce9-f608-4fba-aed6-52b6d33f4175] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:10.910970 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-89f21cbf-1dee-4931-86a6-8af3f91dc031 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:10.911771 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-89f21cbf-1dee-4931-86a6-8af3f91dc031 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:10.912510 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-89f21cbf-1dee-4931-86a6-8af3f91dc031 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:10.913513 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-89f21cbf-1dee-4931-86a6-8af3f91dc031 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:10.915153 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-89f21cbf-1dee-4931-86a6-8af3f91dc031 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:10.915409 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-89f21cbf-1dee-4931-86a6-8af3f91dc031 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:11.025540 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-20ac325a-39a3-4fb3-9cbc-70c5007ed820 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:11.026800 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-20ac325a-39a3-4fb3-9cbc-70c5007ed820 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] [instance: 166290ea-36c3-452a-97a4-4545d8826288] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:11.034276 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-20ac325a-39a3-4fb3-9cbc-70c5007ed820 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:11.034792 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-20ac325a-39a3-4fb3-9cbc-70c5007ed820 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:11.035244 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-20ac325a-39a3-4fb3-9cbc-70c5007ed820 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:11.038295 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-20ac325a-39a3-4fb3-9cbc-70c5007ed820 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:11.039733 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-20ac325a-39a3-4fb3-9cbc-70c5007ed820 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:11.049751 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-20ac325a-39a3-4fb3-9cbc-70c5007ed820 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:11.157954 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-89f21cbf-1dee-4931-86a6-8af3f91dc031 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:47:11.167308 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-89f21cbf-1dee-4931-86a6-8af3f91dc031 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/f8037ce9-f608-4fba-aed6-52b6d33f4175" status: 200 len: 1264 microversion: 2.1 time: 0.275604 Aug 31 16:47:11.168338 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3425/6833] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:47:10 2022] GET /compute/v2.1/servers/f8037ce9-f608-4fba-aed6-52b6d33f4175 => generated 1264 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:47:11.233267 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-20ac325a-39a3-4fb3-9cbc-70c5007ed820 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c112e27f9234237a138100fbc23818c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18b57cca5d34cada128b3a7e2b5adc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:47:11.244963 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-20ac325a-39a3-4fb3-9cbc-70c5007ed820 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] 10.222.0.61 "GET /compute/v2.1/servers/166290ea-36c3-452a-97a4-4545d8826288" status: 200 len: 1300 microversion: 2.1 time: 0.223670 Aug 31 16:47:11.245721 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3409/6834] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:47:11 2022] GET /compute/v2.1/servers/166290ea-36c3-452a-97a4-4545d8826288 => generated 1300 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:47:12.217088 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6770513f-0ac3-4414-9bd5-2c68e601a3e1 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:12.222891 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6770513f-0ac3-4414-9bd5-2c68e601a3e1 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: f8037ce9-f608-4fba-aed6-52b6d33f4175] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:12.269714 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6770513f-0ac3-4414-9bd5-2c68e601a3e1 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:12.272798 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6770513f-0ac3-4414-9bd5-2c68e601a3e1 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:12.273979 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-47d4c6a7-7d71-429a-8ff2-3113285ccbdb tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:12.274709 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-47d4c6a7-7d71-429a-8ff2-3113285ccbdb tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] [instance: 166290ea-36c3-452a-97a4-4545d8826288] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:12.276041 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6770513f-0ac3-4414-9bd5-2c68e601a3e1 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:12.278381 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6770513f-0ac3-4414-9bd5-2c68e601a3e1 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:12.280613 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6770513f-0ac3-4414-9bd5-2c68e601a3e1 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:12.282153 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6770513f-0ac3-4414-9bd5-2c68e601a3e1 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:12.292039 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-47d4c6a7-7d71-429a-8ff2-3113285ccbdb tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:12.292547 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-47d4c6a7-7d71-429a-8ff2-3113285ccbdb tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:12.293198 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-47d4c6a7-7d71-429a-8ff2-3113285ccbdb tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:12.295903 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-47d4c6a7-7d71-429a-8ff2-3113285ccbdb tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:12.297298 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-47d4c6a7-7d71-429a-8ff2-3113285ccbdb tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:12.297942 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-47d4c6a7-7d71-429a-8ff2-3113285ccbdb tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:12.657288 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-47d4c6a7-7d71-429a-8ff2-3113285ccbdb tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c112e27f9234237a138100fbc23818c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18b57cca5d34cada128b3a7e2b5adc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:47:12.671184 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-47d4c6a7-7d71-429a-8ff2-3113285ccbdb tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] 10.222.0.61 "GET /compute/v2.1/servers/166290ea-36c3-452a-97a4-4545d8826288" status: 200 len: 1300 microversion: 2.1 time: 0.402740 Aug 31 16:47:12.672416 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3410/6835] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:47:12 2022] GET /compute/v2.1/servers/166290ea-36c3-452a-97a4-4545d8826288 => generated 1300 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:47:12.735433 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-6770513f-0ac3-4414-9bd5-2c68e601a3e1 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:47:12.749832 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6770513f-0ac3-4414-9bd5-2c68e601a3e1 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/f8037ce9-f608-4fba-aed6-52b6d33f4175" status: 200 len: 1264 microversion: 2.1 time: 0.556590 Aug 31 16:47:12.750944 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3426/6836] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:47:12 2022] GET /compute/v2.1/servers/f8037ce9-f608-4fba-aed6-52b6d33f4175 => generated 1264 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:47:13.695558 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ee3b3df4-7460-4893-a82d-2d643f7884a5 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:13.696788 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ee3b3df4-7460-4893-a82d-2d643f7884a5 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] [instance: 166290ea-36c3-452a-97a4-4545d8826288] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:13.706402 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ee3b3df4-7460-4893-a82d-2d643f7884a5 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:13.708223 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ee3b3df4-7460-4893-a82d-2d643f7884a5 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:13.712381 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ee3b3df4-7460-4893-a82d-2d643f7884a5 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:13.714933 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ee3b3df4-7460-4893-a82d-2d643f7884a5 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:13.717158 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ee3b3df4-7460-4893-a82d-2d643f7884a5 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:13.718233 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ee3b3df4-7460-4893-a82d-2d643f7884a5 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:13.778301 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b901b700-9519-430e-ba43-bbf92fa5b035 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:13.779039 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b901b700-9519-430e-ba43-bbf92fa5b035 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: f8037ce9-f608-4fba-aed6-52b6d33f4175] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:13.792204 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b901b700-9519-430e-ba43-bbf92fa5b035 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:13.795275 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b901b700-9519-430e-ba43-bbf92fa5b035 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:13.795879 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b901b700-9519-430e-ba43-bbf92fa5b035 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:13.796733 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b901b700-9519-430e-ba43-bbf92fa5b035 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:13.799098 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b901b700-9519-430e-ba43-bbf92fa5b035 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:13.799892 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b901b700-9519-430e-ba43-bbf92fa5b035 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:13.929626 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ee3b3df4-7460-4893-a82d-2d643f7884a5 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c112e27f9234237a138100fbc23818c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18b57cca5d34cada128b3a7e2b5adc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:47:13.944411 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ee3b3df4-7460-4893-a82d-2d643f7884a5 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] 10.222.0.61 "GET /compute/v2.1/servers/166290ea-36c3-452a-97a4-4545d8826288" status: 200 len: 1300 microversion: 2.1 time: 0.254596 Aug 31 16:47:13.965864 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3411/6837] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:47:13 2022] GET /compute/v2.1/servers/166290ea-36c3-452a-97a4-4545d8826288 => generated 1300 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:47:14.056095 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b901b700-9519-430e-ba43-bbf92fa5b035 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:47:14.079605 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b901b700-9519-430e-ba43-bbf92fa5b035 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/f8037ce9-f608-4fba-aed6-52b6d33f4175" status: 200 len: 1264 microversion: 2.1 time: 0.308038 Aug 31 16:47:14.095407 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3427/6838] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:47:13 2022] GET /compute/v2.1/servers/f8037ce9-f608-4fba-aed6-52b6d33f4175 => generated 1264 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:47:14.171280 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-385fd14c-325b-4c89-b41b-cfb40e39405b req-49fe5df4-ae75-432d-bb80-d0692770c329 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8037ce9-f608-4fba-aed6-52b6d33f4175", "name": "network-vif-plugged", "status": "completed", "tag": "f07fd1db-0972-4f97-9fb3-1da21d5997ba"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:47:14.185569 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-385fd14c-325b-4c89-b41b-cfb40e39405b req-49fe5df4-ae75-432d-bb80-d0692770c329 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:14.186059 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-385fd14c-325b-4c89-b41b-cfb40e39405b req-49fe5df4-ae75-432d-bb80-d0692770c329 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:14.186662 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-385fd14c-325b-4c89-b41b-cfb40e39405b req-49fe5df4-ae75-432d-bb80-d0692770c329 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:14.206370 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-385fd14c-325b-4c89-b41b-cfb40e39405b req-49fe5df4-ae75-432d-bb80-d0692770c329 service nova] Creating event network-vif-plugged:f07fd1db-0972-4f97-9fb3-1da21d5997ba for instance f8037ce9-f608-4fba-aed6-52b6d33f4175 on n-h1-850499-9 Aug 31 16:47:14.219905 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-385fd14c-325b-4c89-b41b-cfb40e39405b req-49fe5df4-ae75-432d-bb80-d0692770c329 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052017 Aug 31 16:47:14.221109 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3412/6839] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:47:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:47:14.970642 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-60636c25-fa42-4174-855f-83e229756783 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:14.971980 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-60636c25-fa42-4174-855f-83e229756783 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] [instance: 166290ea-36c3-452a-97a4-4545d8826288] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:14.980991 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-60636c25-fa42-4174-855f-83e229756783 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:14.981574 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-60636c25-fa42-4174-855f-83e229756783 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:14.982093 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-60636c25-fa42-4174-855f-83e229756783 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:14.983210 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-60636c25-fa42-4174-855f-83e229756783 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:14.983866 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-60636c25-fa42-4174-855f-83e229756783 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:14.984472 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-60636c25-fa42-4174-855f-83e229756783 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:15.098264 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-60636c25-fa42-4174-855f-83e229756783 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c112e27f9234237a138100fbc23818c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18b57cca5d34cada128b3a7e2b5adc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:47:15.101091 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:47:15.109708 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-60636c25-fa42-4174-855f-83e229756783 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] 10.222.0.61 "GET /compute/v2.1/servers/166290ea-36c3-452a-97a4-4545d8826288" status: 200 len: 1300 microversion: 2.1 time: 0.143005 Aug 31 16:47:15.110680 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3428/6840] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:47:14 2022] GET /compute/v2.1/servers/166290ea-36c3-452a-97a4-4545d8826288 => generated 1300 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:47:15.114394 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5f63d685-5908-4ac6-8dd8-ddf0817131b5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:15.116183 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5f63d685-5908-4ac6-8dd8-ddf0817131b5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: f8037ce9-f608-4fba-aed6-52b6d33f4175] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:15.119247 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=6 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:47:15.120655 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:47:15.130746 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5f63d685-5908-4ac6-8dd8-ddf0817131b5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:15.131594 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5f63d685-5908-4ac6-8dd8-ddf0817131b5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:15.132937 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5f63d685-5908-4ac6-8dd8-ddf0817131b5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:15.134061 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5f63d685-5908-4ac6-8dd8-ddf0817131b5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:15.134717 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5f63d685-5908-4ac6-8dd8-ddf0817131b5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:15.135361 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5f63d685-5908-4ac6-8dd8-ddf0817131b5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:15.286665 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5f63d685-5908-4ac6-8dd8-ddf0817131b5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:47:15.297256 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5f63d685-5908-4ac6-8dd8-ddf0817131b5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/f8037ce9-f608-4fba-aed6-52b6d33f4175" status: 200 len: 1264 microversion: 2.1 time: 0.198349 Aug 31 16:47:15.297846 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3413/6841] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:47:15 2022] GET /compute/v2.1/servers/f8037ce9-f608-4fba-aed6-52b6d33f4175 => generated 1264 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:47:16.139170 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-67359953-392b-4c5f-8838-61bee07dc61b tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:16.142890 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-67359953-392b-4c5f-8838-61bee07dc61b tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] [instance: 166290ea-36c3-452a-97a4-4545d8826288] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:16.149228 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:47:16.151822 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-67359953-392b-4c5f-8838-61bee07dc61b tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:16.152333 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-67359953-392b-4c5f-8838-61bee07dc61b tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:16.153002 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-67359953-392b-4c5f-8838-61bee07dc61b tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:16.153787 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-67359953-392b-4c5f-8838-61bee07dc61b tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:16.154376 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-67359953-392b-4c5f-8838-61bee07dc61b tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:16.154817 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-67359953-392b-4c5f-8838-61bee07dc61b tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:16.265139 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-67359953-392b-4c5f-8838-61bee07dc61b tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c112e27f9234237a138100fbc23818c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18b57cca5d34cada128b3a7e2b5adc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:47:16.275517 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-95c1bf7a-6632-4eae-a2ff-2bb7ef3f29ac req-225cae11-ec24-43a6-9a9e-d92f1b76b4ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "166290ea-36c3-452a-97a4-4545d8826288", "name": "network-vif-plugged", "status": "completed", "tag": "f3d9e7e3-6e44-498f-a5a8-26ddfb45c611"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:47:16.285936 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-95c1bf7a-6632-4eae-a2ff-2bb7ef3f29ac req-225cae11-ec24-43a6-9a9e-d92f1b76b4ca service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:16.286749 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-95c1bf7a-6632-4eae-a2ff-2bb7ef3f29ac req-225cae11-ec24-43a6-9a9e-d92f1b76b4ca service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:16.287411 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-95c1bf7a-6632-4eae-a2ff-2bb7ef3f29ac req-225cae11-ec24-43a6-9a9e-d92f1b76b4ca service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:16.290419 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-67359953-392b-4c5f-8838-61bee07dc61b tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] 10.222.0.61 "GET /compute/v2.1/servers/166290ea-36c3-452a-97a4-4545d8826288" status: 200 len: 1300 microversion: 2.1 time: 0.154658 Aug 31 16:47:16.296077 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3429/6842] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:47:16 2022] GET /compute/v2.1/servers/166290ea-36c3-452a-97a4-4545d8826288 => generated 1300 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:47:16.307472 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-95c1bf7a-6632-4eae-a2ff-2bb7ef3f29ac req-225cae11-ec24-43a6-9a9e-d92f1b76b4ca service nova] Creating event network-vif-plugged:f3d9e7e3-6e44-498f-a5a8-26ddfb45c611 for instance 166290ea-36c3-452a-97a4-4545d8826288 on n-h1-850499-9 Aug 31 16:47:16.313755 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-95c1bf7a-6632-4eae-a2ff-2bb7ef3f29ac req-225cae11-ec24-43a6-9a9e-d92f1b76b4ca service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042352 Aug 31 16:47:16.314378 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3414/6843] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:47:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:47:16.318392 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-fd11de4e-5221-4fe6-b453-bab2cbe041d5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:16.319029 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-fd11de4e-5221-4fe6-b453-bab2cbe041d5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: f8037ce9-f608-4fba-aed6-52b6d33f4175] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:16.328052 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fd11de4e-5221-4fe6-b453-bab2cbe041d5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:16.328980 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fd11de4e-5221-4fe6-b453-bab2cbe041d5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:16.329417 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fd11de4e-5221-4fe6-b453-bab2cbe041d5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:16.330304 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fd11de4e-5221-4fe6-b453-bab2cbe041d5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:16.330964 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fd11de4e-5221-4fe6-b453-bab2cbe041d5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:16.331419 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fd11de4e-5221-4fe6-b453-bab2cbe041d5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:16.560203 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-fd11de4e-5221-4fe6-b453-bab2cbe041d5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:47:16.575486 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-fd11de4e-5221-4fe6-b453-bab2cbe041d5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/f8037ce9-f608-4fba-aed6-52b6d33f4175" status: 200 len: 1451 microversion: 2.1 time: 0.260414 Aug 31 16:47:16.576873 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3430/6844] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:47:16 2022] GET /compute/v2.1/servers/f8037ce9-f608-4fba-aed6-52b6d33f4175 => generated 1451 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:47:16.599487 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-82d603c1-51ba-4ef0-88e7-9ce81282ea3c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:16.600488 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-82d603c1-51ba-4ef0-88e7-9ce81282ea3c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: f8037ce9-f608-4fba-aed6-52b6d33f4175] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:16.607536 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-82d603c1-51ba-4ef0-88e7-9ce81282ea3c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:16.608258 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-82d603c1-51ba-4ef0-88e7-9ce81282ea3c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:16.608846 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-82d603c1-51ba-4ef0-88e7-9ce81282ea3c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:16.609950 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-82d603c1-51ba-4ef0-88e7-9ce81282ea3c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:16.610679 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-82d603c1-51ba-4ef0-88e7-9ce81282ea3c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:16.611257 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-82d603c1-51ba-4ef0-88e7-9ce81282ea3c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:16.795453 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-82d603c1-51ba-4ef0-88e7-9ce81282ea3c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:47:16.804592 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-82d603c1-51ba-4ef0-88e7-9ce81282ea3c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/f8037ce9-f608-4fba-aed6-52b6d33f4175" status: 200 len: 1451 microversion: 2.1 time: 0.209897 Aug 31 16:47:16.805572 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3415/6845] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:47:16 2022] GET /compute/v2.1/servers/f8037ce9-f608-4fba-aed6-52b6d33f4175 => generated 1451 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:47:17.314050 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-466fa710-b36b-44dc-a5c4-bc6fde13c113 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:17.315945 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-466fa710-b36b-44dc-a5c4-bc6fde13c113 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] [instance: 166290ea-36c3-452a-97a4-4545d8826288] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:17.326631 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-466fa710-b36b-44dc-a5c4-bc6fde13c113 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:17.327482 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-466fa710-b36b-44dc-a5c4-bc6fde13c113 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:17.331827 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-466fa710-b36b-44dc-a5c4-bc6fde13c113 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:17.333338 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-466fa710-b36b-44dc-a5c4-bc6fde13c113 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:17.334288 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-466fa710-b36b-44dc-a5c4-bc6fde13c113 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:17.335134 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-466fa710-b36b-44dc-a5c4-bc6fde13c113 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:17.401962 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=100 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:47:17.505664 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-466fa710-b36b-44dc-a5c4-bc6fde13c113 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c112e27f9234237a138100fbc23818c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18b57cca5d34cada128b3a7e2b5adc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:47:17.517606 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-466fa710-b36b-44dc-a5c4-bc6fde13c113 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] 10.222.0.61 "GET /compute/v2.1/servers/166290ea-36c3-452a-97a4-4545d8826288" status: 200 len: 1300 microversion: 2.1 time: 0.208779 Aug 31 16:47:17.524068 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3431/6846] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:47:17 2022] GET /compute/v2.1/servers/166290ea-36c3-452a-97a4-4545d8826288 => generated 1300 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:47:18.546955 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-133fab5f-ded8-452e-b18e-8c4417038e96 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:18.547891 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-133fab5f-ded8-452e-b18e-8c4417038e96 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] [instance: 166290ea-36c3-452a-97a4-4545d8826288] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:18.557517 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-133fab5f-ded8-452e-b18e-8c4417038e96 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:18.559163 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-133fab5f-ded8-452e-b18e-8c4417038e96 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:18.559928 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-133fab5f-ded8-452e-b18e-8c4417038e96 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:18.561125 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-133fab5f-ded8-452e-b18e-8c4417038e96 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:18.561969 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-133fab5f-ded8-452e-b18e-8c4417038e96 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:18.562664 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-133fab5f-ded8-452e-b18e-8c4417038e96 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:18.594365 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=99 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:47:18.745079 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-133fab5f-ded8-452e-b18e-8c4417038e96 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c112e27f9234237a138100fbc23818c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18b57cca5d34cada128b3a7e2b5adc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:47:18.759563 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-133fab5f-ded8-452e-b18e-8c4417038e96 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] 10.222.0.61 "GET /compute/v2.1/servers/166290ea-36c3-452a-97a4-4545d8826288" status: 200 len: 1473 microversion: 2.1 time: 0.217309 Aug 31 16:47:18.776895 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3416/6847] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:47:18 2022] GET /compute/v2.1/servers/166290ea-36c3-452a-97a4-4545d8826288 => generated 1473 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:47:18.791910 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-49e3e130-0a9b-4e49-a653-d252e588e966 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:18.795092 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-49e3e130-0a9b-4e49-a653-d252e588e966 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] [instance: 166290ea-36c3-452a-97a4-4545d8826288] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:18.805938 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-49e3e130-0a9b-4e49-a653-d252e588e966 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:18.808717 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-49e3e130-0a9b-4e49-a653-d252e588e966 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:18.813435 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-49e3e130-0a9b-4e49-a653-d252e588e966 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:18.814451 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-49e3e130-0a9b-4e49-a653-d252e588e966 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:18.815135 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-49e3e130-0a9b-4e49-a653-d252e588e966 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:18.818393 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-49e3e130-0a9b-4e49-a653-d252e588e966 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:19.070371 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-49e3e130-0a9b-4e49-a653-d252e588e966 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c112e27f9234237a138100fbc23818c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18b57cca5d34cada128b3a7e2b5adc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:47:19.083307 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-49e3e130-0a9b-4e49-a653-d252e588e966 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] 10.222.0.61 "GET /compute/v2.1/servers/166290ea-36c3-452a-97a4-4545d8826288" status: 200 len: 1473 microversion: 2.1 time: 0.296299 Aug 31 16:47:19.084757 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3432/6848] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:47:18 2022] GET /compute/v2.1/servers/166290ea-36c3-452a-97a4-4545d8826288 => generated 1473 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:47:19.106161 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9cb79504-5134-45fa-aa4b-b2cb47a97807 tempest-TestSecurityGroupsBasicOps-2044291637 tempest-TestSecurityGroupsBasicOps-2044291637-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:19.107077 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9cb79504-5134-45fa-aa4b-b2cb47a97807 tempest-TestSecurityGroupsBasicOps-2044291637 tempest-TestSecurityGroupsBasicOps-2044291637-project-admin] [instance: 166290ea-36c3-452a-97a4-4545d8826288] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:19.114185 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9cb79504-5134-45fa-aa4b-b2cb47a97807 tempest-TestSecurityGroupsBasicOps-2044291637 tempest-TestSecurityGroupsBasicOps-2044291637-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:19.115191 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9cb79504-5134-45fa-aa4b-b2cb47a97807 tempest-TestSecurityGroupsBasicOps-2044291637 tempest-TestSecurityGroupsBasicOps-2044291637-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:19.115942 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9cb79504-5134-45fa-aa4b-b2cb47a97807 tempest-TestSecurityGroupsBasicOps-2044291637 tempest-TestSecurityGroupsBasicOps-2044291637-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:19.117054 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9cb79504-5134-45fa-aa4b-b2cb47a97807 tempest-TestSecurityGroupsBasicOps-2044291637 tempest-TestSecurityGroupsBasicOps-2044291637-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:19.118046 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9cb79504-5134-45fa-aa4b-b2cb47a97807 tempest-TestSecurityGroupsBasicOps-2044291637 tempest-TestSecurityGroupsBasicOps-2044291637-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:19.118654 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9cb79504-5134-45fa-aa4b-b2cb47a97807 tempest-TestSecurityGroupsBasicOps-2044291637 tempest-TestSecurityGroupsBasicOps-2044291637-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:19.331544 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9cb79504-5134-45fa-aa4b-b2cb47a97807 tempest-TestSecurityGroupsBasicOps-2044291637 tempest-TestSecurityGroupsBasicOps-2044291637-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/166290ea-36c3-452a-97a4-4545d8826288" status: 200 len: 1624 microversion: 2.1 time: 0.230316 Aug 31 16:47:19.332602 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3417/6849] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:47:19 2022] GET /compute/v2.1/servers/166290ea-36c3-452a-97a4-4545d8826288 => generated 1624 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:47:19.357838 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-942c24d1-287d-4dd5-a920-5c6285baa695 tempest-TestSecurityGroupsBasicOps-2044291637 tempest-TestSecurityGroupsBasicOps-2044291637-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:19.358724 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-942c24d1-287d-4dd5-a920-5c6285baa695 tempest-TestSecurityGroupsBasicOps-2044291637 tempest-TestSecurityGroupsBasicOps-2044291637-project-admin] [instance: 46b94da0-6f4a-4912-a2f1-e23b83df2052] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:19.367059 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-942c24d1-287d-4dd5-a920-5c6285baa695 tempest-TestSecurityGroupsBasicOps-2044291637 tempest-TestSecurityGroupsBasicOps-2044291637-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:19.367899 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-942c24d1-287d-4dd5-a920-5c6285baa695 tempest-TestSecurityGroupsBasicOps-2044291637 tempest-TestSecurityGroupsBasicOps-2044291637-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:19.368617 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-942c24d1-287d-4dd5-a920-5c6285baa695 tempest-TestSecurityGroupsBasicOps-2044291637 tempest-TestSecurityGroupsBasicOps-2044291637-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:19.369763 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-942c24d1-287d-4dd5-a920-5c6285baa695 tempest-TestSecurityGroupsBasicOps-2044291637 tempest-TestSecurityGroupsBasicOps-2044291637-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:19.370549 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-942c24d1-287d-4dd5-a920-5c6285baa695 tempest-TestSecurityGroupsBasicOps-2044291637 tempest-TestSecurityGroupsBasicOps-2044291637-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:19.371354 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-942c24d1-287d-4dd5-a920-5c6285baa695 tempest-TestSecurityGroupsBasicOps-2044291637 tempest-TestSecurityGroupsBasicOps-2044291637-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:19.696303 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-942c24d1-287d-4dd5-a920-5c6285baa695 tempest-TestSecurityGroupsBasicOps-2044291637 tempest-TestSecurityGroupsBasicOps-2044291637-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/46b94da0-6f4a-4912-a2f1-e23b83df2052" status: 200 len: 1912 microversion: 2.1 time: 0.342776 Aug 31 16:47:19.697583 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3433/6850] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:47:19 2022] GET /compute/v2.1/servers/46b94da0-6f4a-4912-a2f1-e23b83df2052 => generated 1912 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:47:19.799324 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ca356b05-491f-4fe2-8372-b4b12cfc2a73 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:19.801054 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ca356b05-491f-4fe2-8372-b4b12cfc2a73 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] [instance: 166290ea-36c3-452a-97a4-4545d8826288] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:19.815109 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ca356b05-491f-4fe2-8372-b4b12cfc2a73 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:19.816305 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ca356b05-491f-4fe2-8372-b4b12cfc2a73 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:19.817300 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ca356b05-491f-4fe2-8372-b4b12cfc2a73 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:19.820118 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ca356b05-491f-4fe2-8372-b4b12cfc2a73 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:19.821161 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ca356b05-491f-4fe2-8372-b4b12cfc2a73 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:19.822207 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ca356b05-491f-4fe2-8372-b4b12cfc2a73 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:19.889755 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ca356b05-491f-4fe2-8372-b4b12cfc2a73 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] [instance: 166290ea-36c3-452a-97a4-4545d8826288] Going to try to terminate instance {{(pid=122256) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:47:19.950888 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-5ee92c7b-c1e0-4b86-a665-5e12fdd5f809 req-830f3f9e-faa2-4181-9187-e83410f5c342 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8037ce9-f608-4fba-aed6-52b6d33f4175", "tag": "f07fd1db-0972-4f97-9fb3-1da21d5997ba"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:47:19.970947 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-5ee92c7b-c1e0-4b86-a665-5e12fdd5f809 req-830f3f9e-faa2-4181-9187-e83410f5c342 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:19.971785 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-5ee92c7b-c1e0-4b86-a665-5e12fdd5f809 req-830f3f9e-faa2-4181-9187-e83410f5c342 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:19.972547 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-5ee92c7b-c1e0-4b86-a665-5e12fdd5f809 req-830f3f9e-faa2-4181-9187-e83410f5c342 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:19.987539 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-5ee92c7b-c1e0-4b86-a665-5e12fdd5f809 req-830f3f9e-faa2-4181-9187-e83410f5c342 service nova] Creating event network-changed:f07fd1db-0972-4f97-9fb3-1da21d5997ba for instance f8037ce9-f608-4fba-aed6-52b6d33f4175 on n-h1-850499-9 Aug 31 16:47:19.994268 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-5ee92c7b-c1e0-4b86-a665-5e12fdd5f809 req-830f3f9e-faa2-4181-9187-e83410f5c342 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047662 Aug 31 16:47:19.999892 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3434/6851] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:47:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:47:20.044528 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ca356b05-491f-4fe2-8372-b4b12cfc2a73 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] 10.222.0.61 "DELETE /compute/v2.1/servers/166290ea-36c3-452a-97a4-4545d8826288" status: 204 len: 0 microversion: 2.1 time: 0.251827 Aug 31 16:47:20.045808 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3418/6852] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:47:19 2022] DELETE /compute/v2.1/servers/166290ea-36c3-452a-97a4-4545d8826288 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:47:20.061282 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-24fd62d3-1021-4247-82e1-3902bec8894a tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:20.074277 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-24fd62d3-1021-4247-82e1-3902bec8894a tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] [instance: 166290ea-36c3-452a-97a4-4545d8826288] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:20.087742 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=2,nova_api:DELETE=3 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:47:20.107920 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-24fd62d3-1021-4247-82e1-3902bec8894a tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:20.108920 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-24fd62d3-1021-4247-82e1-3902bec8894a tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:20.110146 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-24fd62d3-1021-4247-82e1-3902bec8894a tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:20.110146 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-24fd62d3-1021-4247-82e1-3902bec8894a tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:20.111227 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-24fd62d3-1021-4247-82e1-3902bec8894a tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:20.111227 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-24fd62d3-1021-4247-82e1-3902bec8894a tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:20.328598 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-24fd62d3-1021-4247-82e1-3902bec8894a tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c112e27f9234237a138100fbc23818c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18b57cca5d34cada128b3a7e2b5adc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:47:20.349114 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-24fd62d3-1021-4247-82e1-3902bec8894a tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] 10.222.0.61 "GET /compute/v2.1/servers/166290ea-36c3-452a-97a4-4545d8826288" status: 200 len: 1479 microversion: 2.1 time: 0.298586 Aug 31 16:47:20.349790 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3435/6853] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:47:20 2022] GET /compute/v2.1/servers/166290ea-36c3-452a-97a4-4545d8826288 => generated 1479 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:47:20.385798 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2ef8740d-ef6b-4cf8-be1a-09bcbbef627c tempest-TestNetworkAdvancedServerOps-354410215 tempest-TestNetworkAdvancedServerOps-354410215-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:20.386893 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2ef8740d-ef6b-4cf8-be1a-09bcbbef627c tempest-TestNetworkAdvancedServerOps-354410215 tempest-TestNetworkAdvancedServerOps-354410215-project-admin] [instance: 962444ac-43a3-4c95-94f6-38414daf29c1] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:20.403174 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2ef8740d-ef6b-4cf8-be1a-09bcbbef627c tempest-TestNetworkAdvancedServerOps-354410215 tempest-TestNetworkAdvancedServerOps-354410215-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:20.403684 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2ef8740d-ef6b-4cf8-be1a-09bcbbef627c tempest-TestNetworkAdvancedServerOps-354410215 tempest-TestNetworkAdvancedServerOps-354410215-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:20.404236 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2ef8740d-ef6b-4cf8-be1a-09bcbbef627c tempest-TestNetworkAdvancedServerOps-354410215 tempest-TestNetworkAdvancedServerOps-354410215-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:20.405192 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2ef8740d-ef6b-4cf8-be1a-09bcbbef627c tempest-TestNetworkAdvancedServerOps-354410215 tempest-TestNetworkAdvancedServerOps-354410215-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:20.407419 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2ef8740d-ef6b-4cf8-be1a-09bcbbef627c tempest-TestNetworkAdvancedServerOps-354410215 tempest-TestNetworkAdvancedServerOps-354410215-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:20.408075 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2ef8740d-ef6b-4cf8-be1a-09bcbbef627c tempest-TestNetworkAdvancedServerOps-354410215 tempest-TestNetworkAdvancedServerOps-354410215-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:20.680829 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2ef8740d-ef6b-4cf8-be1a-09bcbbef627c tempest-TestNetworkAdvancedServerOps-354410215 tempest-TestNetworkAdvancedServerOps-354410215-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1" status: 200 len: 1832 microversion: 2.1 time: 0.340368 Aug 31 16:47:20.683136 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3419/6854] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:47:20 2022] GET /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1 => generated 1832 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:47:21.385930 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b6ab3b1a-5fce-45c9-a7ea-80326a448cf1 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:21.386913 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b6ab3b1a-5fce-45c9-a7ea-80326a448cf1 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] [instance: 166290ea-36c3-452a-97a4-4545d8826288] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:21.402221 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b6ab3b1a-5fce-45c9-a7ea-80326a448cf1 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:21.403177 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b6ab3b1a-5fce-45c9-a7ea-80326a448cf1 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:21.405553 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b6ab3b1a-5fce-45c9-a7ea-80326a448cf1 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:21.407558 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b6ab3b1a-5fce-45c9-a7ea-80326a448cf1 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:21.410381 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b6ab3b1a-5fce-45c9-a7ea-80326a448cf1 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:21.414140 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b6ab3b1a-5fce-45c9-a7ea-80326a448cf1 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:22.109794 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b6ab3b1a-5fce-45c9-a7ea-80326a448cf1 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c112e27f9234237a138100fbc23818c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18b57cca5d34cada128b3a7e2b5adc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:47:22.120541 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b6ab3b1a-5fce-45c9-a7ea-80326a448cf1 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] 10.222.0.61 "GET /compute/v2.1/servers/166290ea-36c3-452a-97a4-4545d8826288" status: 200 len: 1479 microversion: 2.1 time: 0.740923 Aug 31 16:47:22.121802 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3436/6855] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:47:21 2022] GET /compute/v2.1/servers/166290ea-36c3-452a-97a4-4545d8826288 => generated 1479 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:47:23.156185 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-aadea80f-17a1-4178-8a9c-54ecfa91cd3b tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:23.157597 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-aadea80f-17a1-4178-8a9c-54ecfa91cd3b tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] [instance: 166290ea-36c3-452a-97a4-4545d8826288] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:23.166374 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aadea80f-17a1-4178-8a9c-54ecfa91cd3b tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:23.167542 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aadea80f-17a1-4178-8a9c-54ecfa91cd3b tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:23.168630 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aadea80f-17a1-4178-8a9c-54ecfa91cd3b tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:23.170165 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aadea80f-17a1-4178-8a9c-54ecfa91cd3b tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:23.170504 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aadea80f-17a1-4178-8a9c-54ecfa91cd3b tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:23.174668 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aadea80f-17a1-4178-8a9c-54ecfa91cd3b tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:23.186223 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2866dfff-0052-480e-8bf2-bfd2b38faf32 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:23.188796 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2866dfff-0052-480e-8bf2-bfd2b38faf32 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 962444ac-43a3-4c95-94f6-38414daf29c1] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:23.209647 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2866dfff-0052-480e-8bf2-bfd2b38faf32 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:23.212688 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2866dfff-0052-480e-8bf2-bfd2b38faf32 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:23.213694 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2866dfff-0052-480e-8bf2-bfd2b38faf32 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:23.215279 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2866dfff-0052-480e-8bf2-bfd2b38faf32 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:23.216180 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2866dfff-0052-480e-8bf2-bfd2b38faf32 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:23.216930 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2866dfff-0052-480e-8bf2-bfd2b38faf32 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:23.258377 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2866dfff-0052-480e-8bf2-bfd2b38faf32 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 962444ac-43a3-4c95-94f6-38414daf29c1] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:47:23.338986 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-aadea80f-17a1-4178-8a9c-54ecfa91cd3b tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c112e27f9234237a138100fbc23818c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18b57cca5d34cada128b3a7e2b5adc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:47:23.353465 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-aadea80f-17a1-4178-8a9c-54ecfa91cd3b tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] 10.222.0.61 "GET /compute/v2.1/servers/166290ea-36c3-452a-97a4-4545d8826288" status: 200 len: 1479 microversion: 2.1 time: 0.204001 Aug 31 16:47:23.354538 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3420/6856] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:47:23 2022] GET /compute/v2.1/servers/166290ea-36c3-452a-97a4-4545d8826288 => generated 1479 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:47:23.365542 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-a3647131-4bd9-4afa-9f29-62c65d669775 req-d82a6e32-ca7c-4c8c-b4f4-9f4297cf7618 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "962444ac-43a3-4c95-94f6-38414daf29c1", "tag": "44cc7e58-7fc0-46b5-a51f-021cf720d9e1"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:47:23.386063 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-a3647131-4bd9-4afa-9f29-62c65d669775 req-d82a6e32-ca7c-4c8c-b4f4-9f4297cf7618 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:23.386575 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-a3647131-4bd9-4afa-9f29-62c65d669775 req-d82a6e32-ca7c-4c8c-b4f4-9f4297cf7618 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:23.409760 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-a3647131-4bd9-4afa-9f29-62c65d669775 req-d82a6e32-ca7c-4c8c-b4f4-9f4297cf7618 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:23.417813 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2866dfff-0052-480e-8bf2-bfd2b38faf32 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "DELETE /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1" status: 204 len: 0 microversion: 2.1 time: 0.240809 Aug 31 16:47:23.419779 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3437/6857] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:47:23 2022] DELETE /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 16:47:23.434920 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a89c1f59-c610-4649-9507-263a8eb60224 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:23.437678 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a89c1f59-c610-4649-9507-263a8eb60224 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 962444ac-43a3-4c95-94f6-38414daf29c1] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:23.448899 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a89c1f59-c610-4649-9507-263a8eb60224 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:23.449773 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a89c1f59-c610-4649-9507-263a8eb60224 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:23.450744 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a89c1f59-c610-4649-9507-263a8eb60224 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:23.451870 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a89c1f59-c610-4649-9507-263a8eb60224 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:23.452863 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a89c1f59-c610-4649-9507-263a8eb60224 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:23.453879 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a89c1f59-c610-4649-9507-263a8eb60224 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:23.470350 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-a3647131-4bd9-4afa-9f29-62c65d669775 req-d82a6e32-ca7c-4c8c-b4f4-9f4297cf7618 service nova] Creating event network-changed:44cc7e58-7fc0-46b5-a51f-021cf720d9e1 for instance 962444ac-43a3-4c95-94f6-38414daf29c1 on n-h2-850499-9 Aug 31 16:47:23.484988 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-a3647131-4bd9-4afa-9f29-62c65d669775 req-d82a6e32-ca7c-4c8c-b4f4-9f4297cf7618 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128864 Aug 31 16:47:23.486620 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3421/6858] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:47:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:47:23.686721 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a89c1f59-c610-4649-9507-263a8eb60224 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:47:23.697851 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a89c1f59-c610-4649-9507-263a8eb60224 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1" status: 200 len: 1687 microversion: 2.1 time: 0.272789 Aug 31 16:47:23.699535 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3438/6859] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:47:23 2022] GET /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1 => generated 1687 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:47:24.384454 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c19bb18e-cd9b-4cd7-9081-4bb35f607024 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:24.385465 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c19bb18e-cd9b-4cd7-9081-4bb35f607024 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] [instance: 166290ea-36c3-452a-97a4-4545d8826288] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:24.393912 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c19bb18e-cd9b-4cd7-9081-4bb35f607024 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:24.394423 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c19bb18e-cd9b-4cd7-9081-4bb35f607024 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:24.394873 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c19bb18e-cd9b-4cd7-9081-4bb35f607024 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:24.395632 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c19bb18e-cd9b-4cd7-9081-4bb35f607024 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:24.396111 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c19bb18e-cd9b-4cd7-9081-4bb35f607024 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:24.396547 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c19bb18e-cd9b-4cd7-9081-4bb35f607024 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:24.413891 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-c19bb18e-cd9b-4cd7-9081-4bb35f607024 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] HTTP exception thrown: Instance 166290ea-36c3-452a-97a4-4545d8826288 could not be found. Aug 31 16:47:24.415660 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c19bb18e-cd9b-4cd7-9081-4bb35f607024 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Request method failure captured: Aug 31 16:47:24.415660 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/166290ea-36c3-452a-97a4-4545d8826288 HTTP/1.1 Aug 31 16:47:24.415660 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:47:24.415660 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:47:24.415660 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:47:24.415660 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:47:24.415660 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:47:24.415660 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:47:24.415660 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:47:24.415660 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:47:24.415660 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD5AStm94nqVT53CTYN3AEKaQzCvaP4dC81iZprWdLutITLr-P942T3ZTBRfsaG8sklmh2ZxIdINmO5bXqprBrNwqiLAll1bPklYqX-LTLnGt1o-Logw3m2NGswosGLqUwB8erqS2YQyJKut99slzTa9nHAnKePM5baQ1MMSOlYY9GuA Aug 31 16:47:24.415660 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:47:24.415660 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:47:24.415660 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:47:24.415660 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:47:24.415660 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:47:24.415660 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:47:24.415660 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: b18b57cca5d34cada128b3a7e2b5adc8 Aug 31 16:47:24.415660 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1167354013 Aug 31 16:47:24.415660 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:47:24.415660 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:47:24.415660 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b18b57cca5d34cada128b3a7e2b5adc8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/b18b57cca5d34cada128b3a7e2b5adc8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_b18b57cca5d34cada128b3a7e2b5adc8", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b18b57cca5d34cada128b3a7e2b5adc8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:47:24.415660 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1167354013 Aug 31 16:47:24.415660 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: b18b57cca5d34cada128b3a7e2b5adc8 Aug 31 16:47:24.415660 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1167354013 Aug 31 16:47:24.415660 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-TestSecurityGroupsBasicOps-1167354013-project Aug 31 16:47:24.415660 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:47:24.415660 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:47:24.415660 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 1c112e27f9234237a138100fbc23818c Aug 31 16:47:24.415660 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1167354013-project Aug 31 16:47:24.415660 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:47:24.415660 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance 166290ea-36c3-452a-97a4-4545d8826288 could not be found. Aug 31 16:47:24.415660 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '166290ea-36c3-452a-97a4-4545d8826288'} Aug 31 16:47:24.415660 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:47:24.415660 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:47:24.415660 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:47:24.415660 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:47:24.415660 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:47:24.415660 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:47:24.415660 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:47:24.415660 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:47:24.415660 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:47:24.415660 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:47:24.415660 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 166290ea-36c3-452a-97a4-4545d8826288 could not be found. Aug 31 16:47:24.415660 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:47:24.415660 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:47:24.415660 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:47:24.415660 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:47:24.415660 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:47:24.415660 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:47:24.415660 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:47:24.415660 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:47:24.415660 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:47:24.415660 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:47:24.415660 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:47:24.415660 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:47:24.415660 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:47:24.415660 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:47:24.415660 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:47:24.415660 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:47:24.415660 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 166290ea-36c3-452a-97a4-4545d8826288 could not be found. Aug 31 16:47:24.415660 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:47:24.415660 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:47:24.420366 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:47:24.420366 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:47:24.420366 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:47:24.420366 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:47:24.420366 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:47:24.420366 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:47:24.420366 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 166290ea-36c3-452a-97a4-4545d8826288 could not be found. Aug 31 16:47:24.420366 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:47:24.420366 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c19bb18e-cd9b-4cd7-9081-4bb35f607024 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Returning 404 to user: Instance 166290ea-36c3-452a-97a4-4545d8826288 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:47:24.420366 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c19bb18e-cd9b-4cd7-9081-4bb35f607024 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] 10.222.0.61 "GET /compute/v2.1/servers/166290ea-36c3-452a-97a4-4545d8826288" status: 404 len: 111 microversion: 2.1 time: 0.038602 Aug 31 16:47:24.422468 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3422/6860] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:47:24 2022] GET /compute/v2.1/servers/166290ea-36c3-452a-97a4-4545d8826288 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:47:24.727432 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ff38858e-59e5-460a-824f-2f9569a7580c tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:24.728098 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ff38858e-59e5-460a-824f-2f9569a7580c tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 962444ac-43a3-4c95-94f6-38414daf29c1] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:24.735920 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ff38858e-59e5-460a-824f-2f9569a7580c tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:24.736806 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ff38858e-59e5-460a-824f-2f9569a7580c tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:24.738989 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ff38858e-59e5-460a-824f-2f9569a7580c tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:24.738989 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ff38858e-59e5-460a-824f-2f9569a7580c tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:24.739209 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ff38858e-59e5-460a-824f-2f9569a7580c tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:24.746061 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ff38858e-59e5-460a-824f-2f9569a7580c tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:25.019900 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ff38858e-59e5-460a-824f-2f9569a7580c tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:47:25.029134 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ff38858e-59e5-460a-824f-2f9569a7580c tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1" status: 200 len: 1687 microversion: 2.1 time: 0.305580 Aug 31 16:47:25.029731 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3439/6861] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:47:24 2022] GET /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1 => generated 1687 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:47:25.515109 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-85502175-c7dc-4f10-b66f-43f478945c31 req-8faada73-2df7-45cf-ba19-4d3dae09d6d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "166290ea-36c3-452a-97a4-4545d8826288", "name": "network-vif-deleted", "tag": "f3d9e7e3-6e44-498f-a5a8-26ddfb45c611"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:47:25.533075 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-85502175-c7dc-4f10-b66f-43f478945c31 req-8faada73-2df7-45cf-ba19-4d3dae09d6d9 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:25.533826 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-85502175-c7dc-4f10-b66f-43f478945c31 req-8faada73-2df7-45cf-ba19-4d3dae09d6d9 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:25.535048 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-85502175-c7dc-4f10-b66f-43f478945c31 req-8faada73-2df7-45cf-ba19-4d3dae09d6d9 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:25.550924 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-85502175-c7dc-4f10-b66f-43f478945c31 req-8faada73-2df7-45cf-ba19-4d3dae09d6d9 service nova] Creating event network-vif-deleted:f3d9e7e3-6e44-498f-a5a8-26ddfb45c611 for instance 166290ea-36c3-452a-97a4-4545d8826288 on n-h1-850499-9 Aug 31 16:47:25.559315 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-85502175-c7dc-4f10-b66f-43f478945c31 req-8faada73-2df7-45cf-ba19-4d3dae09d6d9 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050237 Aug 31 16:47:25.560807 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3423/6862] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:47:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:47:26.052983 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6ec10590-213a-4107-86a3-f1a7be3451c3 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:26.053616 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6ec10590-213a-4107-86a3-f1a7be3451c3 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 962444ac-43a3-4c95-94f6-38414daf29c1] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:26.062116 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6ec10590-213a-4107-86a3-f1a7be3451c3 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:26.062967 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6ec10590-213a-4107-86a3-f1a7be3451c3 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:26.063927 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6ec10590-213a-4107-86a3-f1a7be3451c3 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:26.064890 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6ec10590-213a-4107-86a3-f1a7be3451c3 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:26.065466 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6ec10590-213a-4107-86a3-f1a7be3451c3 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:26.066135 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6ec10590-213a-4107-86a3-f1a7be3451c3 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:26.179857 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-6ec10590-213a-4107-86a3-f1a7be3451c3 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:47:26.191230 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6ec10590-213a-4107-86a3-f1a7be3451c3 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1" status: 200 len: 1502 microversion: 2.1 time: 0.140561 Aug 31 16:47:26.206909 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3440/6863] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:47:26 2022] GET /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1 => generated 1502 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:47:27.217427 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1947db2d-1fa9-4113-bb11-ec4e1e2aa93b tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:27.218432 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1947db2d-1fa9-4113-bb11-ec4e1e2aa93b tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 962444ac-43a3-4c95-94f6-38414daf29c1] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:27.228168 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1947db2d-1fa9-4113-bb11-ec4e1e2aa93b tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:27.228781 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1947db2d-1fa9-4113-bb11-ec4e1e2aa93b tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:27.229335 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1947db2d-1fa9-4113-bb11-ec4e1e2aa93b tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:27.230192 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1947db2d-1fa9-4113-bb11-ec4e1e2aa93b tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:27.230866 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1947db2d-1fa9-4113-bb11-ec4e1e2aa93b tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:27.231310 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1947db2d-1fa9-4113-bb11-ec4e1e2aa93b tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:27.248300 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-1947db2d-1fa9-4113-bb11-ec4e1e2aa93b tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] HTTP exception thrown: Instance 962444ac-43a3-4c95-94f6-38414daf29c1 could not be found. Aug 31 16:47:27.250125 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1947db2d-1fa9-4113-bb11-ec4e1e2aa93b tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Request method failure captured: Aug 31 16:47:27.250125 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1 HTTP/1.1 Aug 31 16:47:27.250125 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:47:27.250125 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:47:27.250125 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:47:27.250125 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:47:27.250125 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:47:27.250125 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:47:27.250125 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:47:27.250125 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:47:27.250125 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4_WgD4QikPr5cF-bgJByIIY9om79DYcPMqMqsO-QLvTluETH-73GviQTPoMUqKYlX3NhUluX-Xu-yN_DDF2dOtGmm0lyWPtEq7FsxUNcGFIoyzKHnCgn3ibP5w1pC53PzHFJSukSTZE-QhQ71cjyt3B2uRrfnTMcNRrq4qjkk4kSj8 Aug 31 16:47:27.250125 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:47:27.250125 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:47:27.250125 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:47:27.250125 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:47:27.250125 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:47:27.250125 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:47:27.250125 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 1464b491651b43498f56ffcbe24646d8 Aug 31 16:47:27.250125 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-386022060 Aug 31 16:47:27.250125 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:47:27.250125 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:47:27.250125 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1464b491651b43498f56ffcbe24646d8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1464b491651b43498f56ffcbe24646d8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1464b491651b43498f56ffcbe24646d8", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1464b491651b43498f56ffcbe24646d8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:47:27.250125 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-TestNetworkAdvancedServerOps-386022060 Aug 31 16:47:27.250125 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 1464b491651b43498f56ffcbe24646d8 Aug 31 16:47:27.250125 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-386022060 Aug 31 16:47:27.250125 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-TestNetworkAdvancedServerOps-386022060-project Aug 31 16:47:27.250125 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:47:27.250125 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:47:27.250125 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: bf392720aaea4a068b23404ef76ccd5f Aug 31 16:47:27.250125 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-TestNetworkAdvancedServerOps-386022060-project Aug 31 16:47:27.250125 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:47:27.250125 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance 962444ac-43a3-4c95-94f6-38414daf29c1 could not be found. Aug 31 16:47:27.250125 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '962444ac-43a3-4c95-94f6-38414daf29c1'} Aug 31 16:47:27.250125 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:47:27.250125 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:47:27.250125 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:47:27.250125 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:47:27.250125 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:47:27.250125 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:47:27.250125 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:47:27.250125 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:47:27.250125 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:47:27.250125 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:47:27.250125 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 962444ac-43a3-4c95-94f6-38414daf29c1 could not be found. Aug 31 16:47:27.250125 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:47:27.250125 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:47:27.250125 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:47:27.250125 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:47:27.250125 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:47:27.250125 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:47:27.250125 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:47:27.250125 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:47:27.250125 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:47:27.250125 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:47:27.250125 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:47:27.250125 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:47:27.250125 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:47:27.250125 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:47:27.250125 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:47:27.250125 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:47:27.250125 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 962444ac-43a3-4c95-94f6-38414daf29c1 could not be found. Aug 31 16:47:27.250125 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:47:27.250125 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:47:27.257674 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:47:27.257674 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:47:27.257674 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:47:27.257674 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:47:27.257674 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:47:27.257674 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:47:27.257674 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 962444ac-43a3-4c95-94f6-38414daf29c1 could not be found. Aug 31 16:47:27.257674 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:47:27.257674 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1947db2d-1fa9-4113-bb11-ec4e1e2aa93b tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Returning 404 to user: Instance 962444ac-43a3-4c95-94f6-38414daf29c1 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:47:27.257674 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1947db2d-1fa9-4113-bb11-ec4e1e2aa93b tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1" status: 404 len: 111 microversion: 2.1 time: 0.041150 Aug 31 16:47:27.257674 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3424/6864] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:47:27 2022] GET /compute/v2.1/servers/962444ac-43a3-4c95-94f6-38414daf29c1 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 16:47:27.600502 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-bccdbbd1-50db-4798-87fa-2c3e38b73554 req-3590c05f-cade-4b41-916b-bc853436414d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "962444ac-43a3-4c95-94f6-38414daf29c1", "name": "network-vif-deleted", "tag": "44cc7e58-7fc0-46b5-a51f-021cf720d9e1"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:47:27.614458 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-bccdbbd1-50db-4798-87fa-2c3e38b73554 req-3590c05f-cade-4b41-916b-bc853436414d service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:27.615444 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-bccdbbd1-50db-4798-87fa-2c3e38b73554 req-3590c05f-cade-4b41-916b-bc853436414d service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:27.615931 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-bccdbbd1-50db-4798-87fa-2c3e38b73554 req-3590c05f-cade-4b41-916b-bc853436414d service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:27.647045 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-bccdbbd1-50db-4798-87fa-2c3e38b73554 req-3590c05f-cade-4b41-916b-bc853436414d service nova] Creating event network-vif-deleted:44cc7e58-7fc0-46b5-a51f-021cf720d9e1 for instance 962444ac-43a3-4c95-94f6-38414daf29c1 on n-h2-850499-9 Aug 31 16:47:27.655575 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-bccdbbd1-50db-4798-87fa-2c3e38b73554 req-3590c05f-cade-4b41-916b-bc853436414d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058963 Aug 31 16:47:27.656202 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3441/6865] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:47:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:47:29.838557 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6a8f74b6-966e-455f-9f23-bdef8895f80b tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:29.839078 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6a8f74b6-966e-455f-9f23-bdef8895f80b tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] [instance: 46b94da0-6f4a-4912-a2f1-e23b83df2052] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:29.845941 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-3a243f40-f4eb-4a86-86c8-896aa1c28a09 req-98903d70-bb47-487d-92a0-749684925991 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46b94da0-6f4a-4912-a2f1-e23b83df2052", "tag": "81ad1ab6-2308-4a6f-8d44-b00c3f185571"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:47:29.847136 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6a8f74b6-966e-455f-9f23-bdef8895f80b tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:29.847836 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6a8f74b6-966e-455f-9f23-bdef8895f80b tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:29.848448 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6a8f74b6-966e-455f-9f23-bdef8895f80b tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:29.849325 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6a8f74b6-966e-455f-9f23-bdef8895f80b tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:29.849940 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6a8f74b6-966e-455f-9f23-bdef8895f80b tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:29.850526 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6a8f74b6-966e-455f-9f23-bdef8895f80b tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:29.865813 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-3a243f40-f4eb-4a86-86c8-896aa1c28a09 req-98903d70-bb47-487d-92a0-749684925991 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:29.866339 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-3a243f40-f4eb-4a86-86c8-896aa1c28a09 req-98903d70-bb47-487d-92a0-749684925991 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:29.867379 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-3a243f40-f4eb-4a86-86c8-896aa1c28a09 req-98903d70-bb47-487d-92a0-749684925991 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:29.887182 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6a8f74b6-966e-455f-9f23-bdef8895f80b tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] [instance: 46b94da0-6f4a-4912-a2f1-e23b83df2052] Going to try to terminate instance {{(pid=122256) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:47:29.916722 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-3a243f40-f4eb-4a86-86c8-896aa1c28a09 req-98903d70-bb47-487d-92a0-749684925991 service nova] Creating event network-changed:81ad1ab6-2308-4a6f-8d44-b00c3f185571 for instance 46b94da0-6f4a-4912-a2f1-e23b83df2052 on n-h2-850499-9 Aug 31 16:47:29.935370 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-3a243f40-f4eb-4a86-86c8-896aa1c28a09 req-98903d70-bb47-487d-92a0-749684925991 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088190 Aug 31 16:47:29.936536 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3442/6866] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:47:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:47:29.989695 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6a8f74b6-966e-455f-9f23-bdef8895f80b tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] 10.222.0.61 "DELETE /compute/v2.1/servers/46b94da0-6f4a-4912-a2f1-e23b83df2052" status: 204 len: 0 microversion: 2.1 time: 0.155244 Aug 31 16:47:29.991695 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3425/6867] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:47:29 2022] DELETE /compute/v2.1/servers/46b94da0-6f4a-4912-a2f1-e23b83df2052 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:47:30.001243 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-af87f76a-6a5d-40b0-8fc5-af847c4d7379 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:30.002162 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-af87f76a-6a5d-40b0-8fc5-af847c4d7379 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] [instance: 46b94da0-6f4a-4912-a2f1-e23b83df2052] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:30.012720 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-af87f76a-6a5d-40b0-8fc5-af847c4d7379 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:30.013406 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-af87f76a-6a5d-40b0-8fc5-af847c4d7379 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:30.013967 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-af87f76a-6a5d-40b0-8fc5-af847c4d7379 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:30.014824 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-af87f76a-6a5d-40b0-8fc5-af847c4d7379 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:30.015423 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-af87f76a-6a5d-40b0-8fc5-af847c4d7379 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:30.016259 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-af87f76a-6a5d-40b0-8fc5-af847c4d7379 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:30.205717 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-af87f76a-6a5d-40b0-8fc5-af847c4d7379 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c112e27f9234237a138100fbc23818c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18b57cca5d34cada128b3a7e2b5adc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:47:30.218893 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-af87f76a-6a5d-40b0-8fc5-af847c4d7379 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] 10.222.0.61 "GET /compute/v2.1/servers/46b94da0-6f4a-4912-a2f1-e23b83df2052" status: 200 len: 1767 microversion: 2.1 time: 0.222130 Aug 31 16:47:30.219830 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3443/6868] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:47:29 2022] GET /compute/v2.1/servers/46b94da0-6f4a-4912-a2f1-e23b83df2052 => generated 1767 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:47:31.253632 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-050f7f3d-0e81-41ca-a665-50b06d4abc73 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:31.254469 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-050f7f3d-0e81-41ca-a665-50b06d4abc73 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] [instance: 46b94da0-6f4a-4912-a2f1-e23b83df2052] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:31.279857 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-050f7f3d-0e81-41ca-a665-50b06d4abc73 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:31.280631 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-050f7f3d-0e81-41ca-a665-50b06d4abc73 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:31.281206 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-050f7f3d-0e81-41ca-a665-50b06d4abc73 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:31.283276 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-050f7f3d-0e81-41ca-a665-50b06d4abc73 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:31.284016 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-050f7f3d-0e81-41ca-a665-50b06d4abc73 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:31.286251 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-050f7f3d-0e81-41ca-a665-50b06d4abc73 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:32.046957 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-050f7f3d-0e81-41ca-a665-50b06d4abc73 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c112e27f9234237a138100fbc23818c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18b57cca5d34cada128b3a7e2b5adc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:47:32.062138 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-050f7f3d-0e81-41ca-a665-50b06d4abc73 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] 10.222.0.61 "GET /compute/v2.1/servers/46b94da0-6f4a-4912-a2f1-e23b83df2052" status: 200 len: 1767 microversion: 2.1 time: 0.823759 Aug 31 16:47:32.063292 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3426/6869] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:47:31 2022] GET /compute/v2.1/servers/46b94da0-6f4a-4912-a2f1-e23b83df2052 => generated 1767 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:47:32.642439 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e3d7e485-d16c-489c-9415-3171d88f9fca tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '.version_select at 0x7f5ae8dfe160>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:32.669071 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e3d7e485-d16c-489c-9415-3171d88f9fca tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-792229916" status: 202 len: 0 microversion: 2.1 time: 0.031332 Aug 31 16:47:32.671564 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3444/6870] 10.222.0.61 () {58 vars in 1281 bytes} [Wed Aug 31 16:47:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-792229916 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:47:32.710965 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c259ecdb-c16a-46ab-af43-c245edd18ea2 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Action: 'create', calling method: .version_select at 0x7f5aed1d9f70>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2140848967", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMxYUG2CrRmawCEpuw/D9dr2cKPzYbZqeND2uk5fiX3rm5dR6O6wA/BBAD2Uy7g+xxsB6zOyBatI7ntOG4GO2vwH2H+m90AeRCrHHT5rsxoGcQ8b/qY4bk0Er5nHplFjjQ=="}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:47:32.730378 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-c259ecdb-c16a-46ab-af43-c245edd18ea2 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Getting quotas for project 1464b491651b43498f56ffcbe24646d8. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:47:32.737868 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-c259ecdb-c16a-46ab-af43-c245edd18ea2 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Getting quotas for user bf392720aaea4a068b23404ef76ccd5f and project 1464b491651b43498f56ffcbe24646d8. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:47:32.745633 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-034df02c-db37-4561-b932-63adc935af95 req-051c3981-1486-4722-8ed2-ed9a40adac8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46b94da0-6f4a-4912-a2f1-e23b83df2052", "name": "network-vif-deleted", "tag": "81ad1ab6-2308-4a6f-8d44-b00c3f185571"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:47:32.767087 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-034df02c-db37-4561-b932-63adc935af95 req-051c3981-1486-4722-8ed2-ed9a40adac8b service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:32.768435 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-034df02c-db37-4561-b932-63adc935af95 req-051c3981-1486-4722-8ed2-ed9a40adac8b service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:32.769232 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-034df02c-db37-4561-b932-63adc935af95 req-051c3981-1486-4722-8ed2-ed9a40adac8b service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:32.776307 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c259ecdb-c16a-46ab-af43-c245edd18ea2 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.072478 Aug 31 16:47:32.777400 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3427/6871] 10.222.0.61 () {60 vars in 1159 bytes} [Wed Aug 31 16:47:32 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:47:32.788781 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-034df02c-db37-4561-b932-63adc935af95 req-051c3981-1486-4722-8ed2-ed9a40adac8b service nova] Creating event network-vif-deleted:81ad1ab6-2308-4a6f-8d44-b00c3f185571 for instance 46b94da0-6f4a-4912-a2f1-e23b83df2052 on n-h2-850499-9 Aug 31 16:47:32.794280 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-034df02c-db37-4561-b932-63adc935af95 req-051c3981-1486-4722-8ed2-ed9a40adac8b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060827 Aug 31 16:47:32.795122 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3445/6872] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:47:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:47:33.088240 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-cdde746e-926e-4f7e-b531-3e3f009dde71 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:33.088873 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-cdde746e-926e-4f7e-b531-3e3f009dde71 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] [instance: 46b94da0-6f4a-4912-a2f1-e23b83df2052] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:33.095958 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cdde746e-926e-4f7e-b531-3e3f009dde71 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:33.096671 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cdde746e-926e-4f7e-b531-3e3f009dde71 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:33.097120 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cdde746e-926e-4f7e-b531-3e3f009dde71 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:33.097853 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cdde746e-926e-4f7e-b531-3e3f009dde71 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:33.098319 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cdde746e-926e-4f7e-b531-3e3f009dde71 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:33.100092 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cdde746e-926e-4f7e-b531-3e3f009dde71 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:33.140815 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cdde746e-926e-4f7e-b531-3e3f009dde71 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:33.143105 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cdde746e-926e-4f7e-b531-3e3f009dde71 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:33.143105 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cdde746e-926e-4f7e-b531-3e3f009dde71 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:33.143105 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-cdde746e-926e-4f7e-b531-3e3f009dde71 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lazy-loading 'fault' on Instance uuid 46b94da0-6f4a-4912-a2f1-e23b83df2052 {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:47:33.204177 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-cdde746e-926e-4f7e-b531-3e3f009dde71 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c112e27f9234237a138100fbc23818c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18b57cca5d34cada128b3a7e2b5adc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:47:33.213491 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-cdde746e-926e-4f7e-b531-3e3f009dde71 tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] 10.222.0.61 "GET /compute/v2.1/servers/46b94da0-6f4a-4912-a2f1-e23b83df2052" status: 200 len: 1384 microversion: 2.1 time: 0.129835 Aug 31 16:47:33.215831 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3428/6873] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:47:33 2022] GET /compute/v2.1/servers/46b94da0-6f4a-4912-a2f1-e23b83df2052 => generated 1384 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:47:34.242744 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-954164ff-e24f-4630-8d46-45ec41f59ddd tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:34.243529 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-954164ff-e24f-4630-8d46-45ec41f59ddd tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] [instance: 46b94da0-6f4a-4912-a2f1-e23b83df2052] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:34.250718 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-954164ff-e24f-4630-8d46-45ec41f59ddd tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:34.251227 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-954164ff-e24f-4630-8d46-45ec41f59ddd tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:34.251720 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-954164ff-e24f-4630-8d46-45ec41f59ddd tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:34.252444 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-954164ff-e24f-4630-8d46-45ec41f59ddd tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:34.253099 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-954164ff-e24f-4630-8d46-45ec41f59ddd tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:34.253546 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-954164ff-e24f-4630-8d46-45ec41f59ddd tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:34.273717 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-954164ff-e24f-4630-8d46-45ec41f59ddd tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] HTTP exception thrown: Instance 46b94da0-6f4a-4912-a2f1-e23b83df2052 could not be found. Aug 31 16:47:34.275636 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-954164ff-e24f-4630-8d46-45ec41f59ddd tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Request method failure captured: Aug 31 16:47:34.275636 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/46b94da0-6f4a-4912-a2f1-e23b83df2052 HTTP/1.1 Aug 31 16:47:34.275636 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:47:34.275636 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:47:34.275636 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:47:34.275636 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:47:34.275636 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:47:34.275636 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:47:34.275636 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:47:34.275636 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:47:34.275636 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD5AStm94nqVT53CTYN3AEKaQzCvaP4dC81iZprWdLutITLr-P942T3ZTBRfsaG8sklmh2ZxIdINmO5bXqprBrNwqiLAll1bPklYqX-LTLnGt1o-Logw3m2NGswosGLqUwB8erqS2YQyJKut99slzTa9nHAnKePM5baQ1MMSOlYY9GuA Aug 31 16:47:34.275636 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:47:34.275636 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:47:34.275636 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:47:34.275636 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:47:34.275636 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:47:34.275636 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:47:34.275636 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: b18b57cca5d34cada128b3a7e2b5adc8 Aug 31 16:47:34.275636 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1167354013 Aug 31 16:47:34.275636 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:47:34.275636 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:47:34.275636 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b18b57cca5d34cada128b3a7e2b5adc8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/b18b57cca5d34cada128b3a7e2b5adc8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_b18b57cca5d34cada128b3a7e2b5adc8", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b18b57cca5d34cada128b3a7e2b5adc8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:47:34.275636 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1167354013 Aug 31 16:47:34.275636 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: b18b57cca5d34cada128b3a7e2b5adc8 Aug 31 16:47:34.275636 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1167354013 Aug 31 16:47:34.275636 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-TestSecurityGroupsBasicOps-1167354013-project Aug 31 16:47:34.275636 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:47:34.275636 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:47:34.275636 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 1c112e27f9234237a138100fbc23818c Aug 31 16:47:34.275636 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1167354013-project Aug 31 16:47:34.275636 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:47:34.275636 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance 46b94da0-6f4a-4912-a2f1-e23b83df2052 could not be found. Aug 31 16:47:34.275636 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '46b94da0-6f4a-4912-a2f1-e23b83df2052'} Aug 31 16:47:34.275636 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:47:34.275636 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:47:34.275636 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:47:34.275636 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:47:34.275636 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:47:34.275636 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:47:34.275636 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:47:34.275636 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:47:34.275636 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:47:34.275636 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:47:34.275636 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46b94da0-6f4a-4912-a2f1-e23b83df2052 could not be found. Aug 31 16:47:34.275636 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:47:34.275636 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:47:34.275636 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:47:34.275636 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:47:34.275636 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:47:34.275636 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:47:34.275636 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:47:34.275636 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:47:34.275636 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:47:34.275636 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:47:34.275636 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:47:34.275636 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:47:34.275636 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:47:34.275636 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:47:34.275636 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:47:34.275636 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:47:34.275636 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46b94da0-6f4a-4912-a2f1-e23b83df2052 could not be found. Aug 31 16:47:34.275636 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:47:34.275636 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:47:34.281180 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:47:34.281180 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:47:34.281180 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:47:34.281180 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:47:34.281180 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:47:34.281180 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:47:34.281180 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46b94da0-6f4a-4912-a2f1-e23b83df2052 could not be found. Aug 31 16:47:34.281180 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:47:34.281180 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-954164ff-e24f-4630-8d46-45ec41f59ddd tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Returning 404 to user: Instance 46b94da0-6f4a-4912-a2f1-e23b83df2052 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:47:34.281180 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-954164ff-e24f-4630-8d46-45ec41f59ddd tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] 10.222.0.61 "GET /compute/v2.1/servers/46b94da0-6f4a-4912-a2f1-e23b83df2052" status: 404 len: 111 microversion: 2.1 time: 0.044083 Aug 31 16:47:34.281180 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3446/6874] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:47:34 2022] GET /compute/v2.1/servers/46b94da0-6f4a-4912-a2f1-e23b83df2052 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 16:47:39.916554 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0290c582-3389-4b6f-9a48-497cb1cf96af tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] Calling method '.version_select at 0x7f5aed1d9700>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:39.964609 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0290c582-3389-4b6f-9a48-497cb1cf96af tempest-TestSecurityGroupsBasicOps-1167354013 tempest-TestSecurityGroupsBasicOps-1167354013-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1475348723" status: 202 len: 0 microversion: 2.1 time: 0.057756 Aug 31 16:47:39.966019 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3429/6875] 10.222.0.61 () {58 vars in 1278 bytes} [Wed Aug 31 16:47:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1475348723 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:47:41.462832 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0598c2cb-ecf1-498b-9c1b-add8ed183f1d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1146572524", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "networks": [{"uuid": "3cf14f0d-753c-434c-970a-0042e6315322"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2140848967", "security_groups": [{"name": "tempest-secgroup-smoke-703238588"}]}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:47:41.670697 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-0598c2cb-ecf1-498b-9c1b-add8ed183f1d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] validate_networks() for [('3cf14f0d-753c-434c-970a-0042e6315322', None, None, None, None, None)] {{(pid=122257) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:47:42.542448 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-0598c2cb-ecf1-498b-9c1b-add8ed183f1d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:47:42.543604 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-0598c2cb-ecf1-498b-9c1b-add8ed183f1d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:47:42.544569 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-0598c2cb-ecf1-498b-9c1b-add8ed183f1d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:47:42.545214 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-0598c2cb-ecf1-498b-9c1b-add8ed183f1d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:47:42.546180 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-0598c2cb-ecf1-498b-9c1b-add8ed183f1d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:47:42.560165 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0598c2cb-ecf1-498b-9c1b-add8ed183f1d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:42.561106 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0598c2cb-ecf1-498b-9c1b-add8ed183f1d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:42.561656 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0598c2cb-ecf1-498b-9c1b-add8ed183f1d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:42.562593 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0598c2cb-ecf1-498b-9c1b-add8ed183f1d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:42.563073 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0598c2cb-ecf1-498b-9c1b-add8ed183f1d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:42.563726 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0598c2cb-ecf1-498b-9c1b-add8ed183f1d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:42.586884 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-0598c2cb-ecf1-498b-9c1b-add8ed183f1d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Getting quotas for project 1464b491651b43498f56ffcbe24646d8. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:47:42.595994 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-0598c2cb-ecf1-498b-9c1b-add8ed183f1d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Getting quotas for user bf392720aaea4a068b23404ef76ccd5f and project 1464b491651b43498f56ffcbe24646d8. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:47:42.613427 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0598c2cb-ecf1-498b-9c1b-add8ed183f1d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Going to run 1 instances... {{(pid=122257) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:47:42.617035 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0598c2cb-ecf1-498b-9c1b-add8ed183f1d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 81e9db46-4167-48f7-900f-9d65fdfc72b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:47:42.672505 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0598c2cb-ecf1-498b-9c1b-add8ed183f1d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.214823 Aug 31 16:47:42.673821 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3447/6876] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:47:41 2022] POST /compute/v2.1/servers => generated 405 bytes in 1217 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 16:47:42.696233 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-78b0418a-fb8f-4eea-8f16-f00c55aa5094 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:42.696967 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-78b0418a-fb8f-4eea-8f16-f00c55aa5094 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 81e9db46-4167-48f7-900f-9d65fdfc72b7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:42.745230 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=4 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:47:42.768869 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-78b0418a-fb8f-4eea-8f16-f00c55aa5094 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:47:42.778689 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-78b0418a-fb8f-4eea-8f16-f00c55aa5094 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7" status: 200 len: 1267 microversion: 2.1 time: 0.096010 Aug 31 16:47:42.781000 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3430/6877] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:47:42 2022] GET /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7 => generated 1267 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:47:43.804240 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-09496f01-c267-4e78-bdf8-0087a91cc26d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:43.805237 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-09496f01-c267-4e78-bdf8-0087a91cc26d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 81e9db46-4167-48f7-900f-9d65fdfc72b7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:43.815811 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-09496f01-c267-4e78-bdf8-0087a91cc26d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:43.816345 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-09496f01-c267-4e78-bdf8-0087a91cc26d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:43.823662 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-09496f01-c267-4e78-bdf8-0087a91cc26d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:43.824659 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-09496f01-c267-4e78-bdf8-0087a91cc26d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:43.825306 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-09496f01-c267-4e78-bdf8-0087a91cc26d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:43.825707 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-09496f01-c267-4e78-bdf8-0087a91cc26d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:43.905203 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-09496f01-c267-4e78-bdf8-0087a91cc26d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:47:43.913956 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-09496f01-c267-4e78-bdf8-0087a91cc26d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7" status: 200 len: 1319 microversion: 2.1 time: 0.114557 Aug 31 16:47:43.914575 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3448/6878] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:47:43 2022] GET /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7 => generated 1319 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:47:44.933929 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:47:44.948872 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9e57a786-cbd2-4327-95fa-9573de4dc49f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:44.950062 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9e57a786-cbd2-4327-95fa-9573de4dc49f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 81e9db46-4167-48f7-900f-9d65fdfc72b7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:44.959835 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9e57a786-cbd2-4327-95fa-9573de4dc49f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:44.961027 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9e57a786-cbd2-4327-95fa-9573de4dc49f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:44.962319 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9e57a786-cbd2-4327-95fa-9573de4dc49f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:44.964423 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9e57a786-cbd2-4327-95fa-9573de4dc49f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:44.965360 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9e57a786-cbd2-4327-95fa-9573de4dc49f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:44.966209 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9e57a786-cbd2-4327-95fa-9573de4dc49f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:45.225281 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-9e57a786-cbd2-4327-95fa-9573de4dc49f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:47:45.234378 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9e57a786-cbd2-4327-95fa-9573de4dc49f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7" status: 200 len: 1392 microversion: 2.1 time: 0.301354 Aug 31 16:47:45.235153 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3431/6879] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:47:44 2022] GET /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7 => generated 1392 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:47:45.951356 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-de7cde12-b15d-4ba5-ab5b-4af035fa28c5 req-f7b6b20f-547d-4b2f-99da-6d67a7856204 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81e9db46-4167-48f7-900f-9d65fdfc72b7", "tag": "a574579c-df0c-467a-bdb8-ee3e7daa36e5"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:47:45.972741 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-de7cde12-b15d-4ba5-ab5b-4af035fa28c5 req-f7b6b20f-547d-4b2f-99da-6d67a7856204 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:45.973423 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-de7cde12-b15d-4ba5-ab5b-4af035fa28c5 req-f7b6b20f-547d-4b2f-99da-6d67a7856204 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:45.974207 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-de7cde12-b15d-4ba5-ab5b-4af035fa28c5 req-f7b6b20f-547d-4b2f-99da-6d67a7856204 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:45.989532 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-de7cde12-b15d-4ba5-ab5b-4af035fa28c5 req-f7b6b20f-547d-4b2f-99da-6d67a7856204 service nova] Creating event network-changed:a574579c-df0c-467a-bdb8-ee3e7daa36e5 for instance 81e9db46-4167-48f7-900f-9d65fdfc72b7 on n-h2-850499-9 Aug 31 16:47:45.999597 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-de7cde12-b15d-4ba5-ab5b-4af035fa28c5 req-f7b6b20f-547d-4b2f-99da-6d67a7856204 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052486 Aug 31 16:47:46.000966 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3449/6880] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:47:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:47:46.262736 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a488ab9b-d6ac-4779-a1c6-39367c9e9299 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:46.263814 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a488ab9b-d6ac-4779-a1c6-39367c9e9299 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 81e9db46-4167-48f7-900f-9d65fdfc72b7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:46.267233 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=2,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:47:46.271386 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a488ab9b-d6ac-4779-a1c6-39367c9e9299 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:46.271975 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a488ab9b-d6ac-4779-a1c6-39367c9e9299 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:46.272419 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a488ab9b-d6ac-4779-a1c6-39367c9e9299 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:46.273927 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a488ab9b-d6ac-4779-a1c6-39367c9e9299 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:46.274402 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a488ab9b-d6ac-4779-a1c6-39367c9e9299 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:46.274835 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a488ab9b-d6ac-4779-a1c6-39367c9e9299 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:46.511266 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a488ab9b-d6ac-4779-a1c6-39367c9e9299 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:47:46.519547 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a488ab9b-d6ac-4779-a1c6-39367c9e9299 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7" status: 200 len: 1392 microversion: 2.1 time: 0.261098 Aug 31 16:47:46.520131 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3432/6881] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:47:46 2022] GET /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7 => generated 1392 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:47:47.544630 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ea79ec07-f3dc-4a9d-ba9a-76c930bb336f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:47.545339 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ea79ec07-f3dc-4a9d-ba9a-76c930bb336f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 81e9db46-4167-48f7-900f-9d65fdfc72b7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:47.552414 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ea79ec07-f3dc-4a9d-ba9a-76c930bb336f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:47.552925 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ea79ec07-f3dc-4a9d-ba9a-76c930bb336f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:47.553386 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ea79ec07-f3dc-4a9d-ba9a-76c930bb336f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:47.554803 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ea79ec07-f3dc-4a9d-ba9a-76c930bb336f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:47.555361 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ea79ec07-f3dc-4a9d-ba9a-76c930bb336f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:47.555822 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ea79ec07-f3dc-4a9d-ba9a-76c930bb336f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:47.558990 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:47:47.715626 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ea79ec07-f3dc-4a9d-ba9a-76c930bb336f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:47:47.724378 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ea79ec07-f3dc-4a9d-ba9a-76c930bb336f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7" status: 200 len: 1392 microversion: 2.1 time: 0.186043 Aug 31 16:47:47.725014 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3450/6882] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:47:47 2022] GET /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7 => generated 1392 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:47:48.747077 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a89b9fb4-20c6-4f25-adab-fb461482c05e tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:48.747633 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a89b9fb4-20c6-4f25-adab-fb461482c05e tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 81e9db46-4167-48f7-900f-9d65fdfc72b7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:48.754508 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a89b9fb4-20c6-4f25-adab-fb461482c05e tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:48.754999 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a89b9fb4-20c6-4f25-adab-fb461482c05e tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:48.755439 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a89b9fb4-20c6-4f25-adab-fb461482c05e tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:48.756166 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a89b9fb4-20c6-4f25-adab-fb461482c05e tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:48.756629 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a89b9fb4-20c6-4f25-adab-fb461482c05e tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:48.757670 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a89b9fb4-20c6-4f25-adab-fb461482c05e tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:48.899616 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a89b9fb4-20c6-4f25-adab-fb461482c05e tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:47:48.916424 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a89b9fb4-20c6-4f25-adab-fb461482c05e tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7" status: 200 len: 1392 microversion: 2.1 time: 0.173445 Aug 31 16:47:48.917033 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3433/6883] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:47:48 2022] GET /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7 => generated 1392 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:47:49.938129 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-92bc0b2c-98aa-4371-b62a-5d785934e009 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:49.938746 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-92bc0b2c-98aa-4371-b62a-5d785934e009 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 81e9db46-4167-48f7-900f-9d65fdfc72b7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:49.945819 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-92bc0b2c-98aa-4371-b62a-5d785934e009 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:49.946324 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-92bc0b2c-98aa-4371-b62a-5d785934e009 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:49.946780 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-92bc0b2c-98aa-4371-b62a-5d785934e009 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:49.947509 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-92bc0b2c-98aa-4371-b62a-5d785934e009 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:49.947985 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-92bc0b2c-98aa-4371-b62a-5d785934e009 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:49.948425 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-92bc0b2c-98aa-4371-b62a-5d785934e009 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:50.089263 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-92bc0b2c-98aa-4371-b62a-5d785934e009 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:47:50.097327 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-92bc0b2c-98aa-4371-b62a-5d785934e009 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7" status: 200 len: 1392 microversion: 2.1 time: 0.163273 Aug 31 16:47:50.097907 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3451/6884] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:47:49 2022] GET /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7 => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:47:51.121999 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c1a20249-4fcc-41f7-8627-7571b5509d67 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:51.122623 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c1a20249-4fcc-41f7-8627-7571b5509d67 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 81e9db46-4167-48f7-900f-9d65fdfc72b7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:51.130425 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c1a20249-4fcc-41f7-8627-7571b5509d67 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:51.131055 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c1a20249-4fcc-41f7-8627-7571b5509d67 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:51.131715 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c1a20249-4fcc-41f7-8627-7571b5509d67 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:51.132989 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c1a20249-4fcc-41f7-8627-7571b5509d67 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:51.133859 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c1a20249-4fcc-41f7-8627-7571b5509d67 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:51.134666 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c1a20249-4fcc-41f7-8627-7571b5509d67 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:51.279728 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c1a20249-4fcc-41f7-8627-7571b5509d67 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:47:51.291674 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c1a20249-4fcc-41f7-8627-7571b5509d67 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7" status: 200 len: 1392 microversion: 2.1 time: 0.173647 Aug 31 16:47:51.292268 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3434/6885] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:47:51 2022] GET /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7 => generated 1392 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:47:52.315392 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-553c6cf4-5623-4c2a-adb5-689e284f2795 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:52.316532 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-553c6cf4-5623-4c2a-adb5-689e284f2795 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 81e9db46-4167-48f7-900f-9d65fdfc72b7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:52.318592 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:47:52.324761 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-553c6cf4-5623-4c2a-adb5-689e284f2795 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:52.325279 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-553c6cf4-5623-4c2a-adb5-689e284f2795 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:52.325746 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-553c6cf4-5623-4c2a-adb5-689e284f2795 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:52.326473 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-553c6cf4-5623-4c2a-adb5-689e284f2795 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:52.326950 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-553c6cf4-5623-4c2a-adb5-689e284f2795 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:52.327394 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-553c6cf4-5623-4c2a-adb5-689e284f2795 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:52.479387 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-553c6cf4-5623-4c2a-adb5-689e284f2795 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:47:52.491035 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-553c6cf4-5623-4c2a-adb5-689e284f2795 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7" status: 200 len: 1392 microversion: 2.1 time: 0.181886 Aug 31 16:47:52.491825 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3452/6886] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:47:52 2022] GET /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7 => generated 1392 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:47:52.987777 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-6bbf14bd-e56f-4a58-afae-0a0ea76325ec req-bb6d0a22-d48e-46c9-95df-464858df36a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81e9db46-4167-48f7-900f-9d65fdfc72b7", "name": "network-vif-plugged", "status": "completed", "tag": "a574579c-df0c-467a-bdb8-ee3e7daa36e5"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:47:52.996296 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:47:53.004121 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-6bbf14bd-e56f-4a58-afae-0a0ea76325ec req-bb6d0a22-d48e-46c9-95df-464858df36a7 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:53.004611 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-6bbf14bd-e56f-4a58-afae-0a0ea76325ec req-bb6d0a22-d48e-46c9-95df-464858df36a7 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:53.005059 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-6bbf14bd-e56f-4a58-afae-0a0ea76325ec req-bb6d0a22-d48e-46c9-95df-464858df36a7 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:53.019892 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-6bbf14bd-e56f-4a58-afae-0a0ea76325ec req-bb6d0a22-d48e-46c9-95df-464858df36a7 service nova] Creating event network-vif-plugged:a574579c-df0c-467a-bdb8-ee3e7daa36e5 for instance 81e9db46-4167-48f7-900f-9d65fdfc72b7 on n-h2-850499-9 Aug 31 16:47:53.027191 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-6bbf14bd-e56f-4a58-afae-0a0ea76325ec req-bb6d0a22-d48e-46c9-95df-464858df36a7 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042582 Aug 31 16:47:53.027849 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3435/6887] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:47:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:47:53.518207 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-347da5ff-8435-4765-a399-d823a3216547 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:53.518870 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-347da5ff-8435-4765-a399-d823a3216547 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 81e9db46-4167-48f7-900f-9d65fdfc72b7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:53.520946 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:47:53.521660 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=6 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:47:53.529065 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-347da5ff-8435-4765-a399-d823a3216547 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:53.529675 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-347da5ff-8435-4765-a399-d823a3216547 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:53.530141 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-347da5ff-8435-4765-a399-d823a3216547 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:53.530866 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-347da5ff-8435-4765-a399-d823a3216547 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:53.531349 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-347da5ff-8435-4765-a399-d823a3216547 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:53.531828 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-347da5ff-8435-4765-a399-d823a3216547 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:53.677885 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-347da5ff-8435-4765-a399-d823a3216547 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:47:53.686860 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-347da5ff-8435-4765-a399-d823a3216547 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7" status: 200 len: 1392 microversion: 2.1 time: 0.172618 Aug 31 16:47:53.687450 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3453/6888] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:47:53 2022] GET /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7 => generated 1392 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:47:54.708863 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e250072c-9838-486d-aa3d-752b66c614ad tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:54.709771 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e250072c-9838-486d-aa3d-752b66c614ad tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 81e9db46-4167-48f7-900f-9d65fdfc72b7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:54.719813 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e250072c-9838-486d-aa3d-752b66c614ad tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:54.720311 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e250072c-9838-486d-aa3d-752b66c614ad tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:54.720755 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e250072c-9838-486d-aa3d-752b66c614ad tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:54.721474 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e250072c-9838-486d-aa3d-752b66c614ad tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:54.721939 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e250072c-9838-486d-aa3d-752b66c614ad tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:54.722373 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e250072c-9838-486d-aa3d-752b66c614ad tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:54.869627 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e250072c-9838-486d-aa3d-752b66c614ad tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:47:54.878291 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e250072c-9838-486d-aa3d-752b66c614ad tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7" status: 200 len: 1563 microversion: 2.1 time: 0.174208 Aug 31 16:47:54.878986 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3436/6889] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:47:54 2022] GET /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7 => generated 1563 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:47:54.900191 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1a66a152-ec4a-42b0-99fa-dea3e13aa8ea tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:54.900882 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1a66a152-ec4a-42b0-99fa-dea3e13aa8ea tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 81e9db46-4167-48f7-900f-9d65fdfc72b7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:54.908268 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1a66a152-ec4a-42b0-99fa-dea3e13aa8ea tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:54.908809 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1a66a152-ec4a-42b0-99fa-dea3e13aa8ea tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:54.909312 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1a66a152-ec4a-42b0-99fa-dea3e13aa8ea tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:54.910058 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1a66a152-ec4a-42b0-99fa-dea3e13aa8ea tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:54.910612 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1a66a152-ec4a-42b0-99fa-dea3e13aa8ea tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:54.911084 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1a66a152-ec4a-42b0-99fa-dea3e13aa8ea tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:55.065738 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-1a66a152-ec4a-42b0-99fa-dea3e13aa8ea tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:47:55.074273 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1a66a152-ec4a-42b0-99fa-dea3e13aa8ea tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7" status: 200 len: 1563 microversion: 2.1 time: 0.178394 Aug 31 16:47:55.074822 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3454/6890] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:47:54 2022] GET /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7 => generated 1563 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:47:57.108431 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2caa5a4b-11ba-40b1-9ccb-d6cbde952f40 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:57.109061 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2caa5a4b-11ba-40b1-9ccb-d6cbde952f40 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 81e9db46-4167-48f7-900f-9d65fdfc72b7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:57.110595 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-e851dbc3-4c72-469f-a0ed-609dd15bddd8 req-700a3164-abef-4320-926e-c5e001c6314c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81e9db46-4167-48f7-900f-9d65fdfc72b7", "tag": "a574579c-df0c-467a-bdb8-ee3e7daa36e5"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:47:57.117610 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2caa5a4b-11ba-40b1-9ccb-d6cbde952f40 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:57.118181 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2caa5a4b-11ba-40b1-9ccb-d6cbde952f40 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:57.118712 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2caa5a4b-11ba-40b1-9ccb-d6cbde952f40 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:57.119555 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2caa5a4b-11ba-40b1-9ccb-d6cbde952f40 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:57.120030 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2caa5a4b-11ba-40b1-9ccb-d6cbde952f40 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:57.120464 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2caa5a4b-11ba-40b1-9ccb-d6cbde952f40 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:57.125492 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-e851dbc3-4c72-469f-a0ed-609dd15bddd8 req-700a3164-abef-4320-926e-c5e001c6314c service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:57.126010 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-e851dbc3-4c72-469f-a0ed-609dd15bddd8 req-700a3164-abef-4320-926e-c5e001c6314c service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:57.126597 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-e851dbc3-4c72-469f-a0ed-609dd15bddd8 req-700a3164-abef-4320-926e-c5e001c6314c service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:57.145178 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-e851dbc3-4c72-469f-a0ed-609dd15bddd8 req-700a3164-abef-4320-926e-c5e001c6314c service nova] Creating event network-changed:a574579c-df0c-467a-bdb8-ee3e7daa36e5 for instance 81e9db46-4167-48f7-900f-9d65fdfc72b7 on n-h2-850499-9 Aug 31 16:47:57.151067 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-e851dbc3-4c72-469f-a0ed-609dd15bddd8 req-700a3164-abef-4320-926e-c5e001c6314c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044183 Aug 31 16:47:57.152477 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3455/6891] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:47:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:47:57.356008 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-2caa5a4b-11ba-40b1-9ccb-d6cbde952f40 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:47:57.366142 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2caa5a4b-11ba-40b1-9ccb-d6cbde952f40 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7" status: 200 len: 1563 microversion: 2.1 time: 0.261401 Aug 31 16:47:57.368398 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3437/6892] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:47:57 2022] GET /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7 => generated 1563 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:48:36.706554 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=7 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:48:36.707361 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=31 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:48:36.712216 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b0562f7b-e167-4e9d-b46b-d46dd64a2674 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:48:36.714481 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b0562f7b-e167-4e9d-b46b-d46dd64a2674 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 81e9db46-4167-48f7-900f-9d65fdfc72b7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:48:36.721963 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b0562f7b-e167-4e9d-b46b-d46dd64a2674 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:48:36.722470 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b0562f7b-e167-4e9d-b46b-d46dd64a2674 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:48:36.722938 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b0562f7b-e167-4e9d-b46b-d46dd64a2674 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:48:36.723843 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b0562f7b-e167-4e9d-b46b-d46dd64a2674 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:48:36.724329 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b0562f7b-e167-4e9d-b46b-d46dd64a2674 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:48:36.724779 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b0562f7b-e167-4e9d-b46b-d46dd64a2674 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:48:36.798630 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b0562f7b-e167-4e9d-b46b-d46dd64a2674 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "POST /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7/action" status: 200 len: 24573 microversion: 2.1 time: 0.093956 Aug 31 16:48:36.799279 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3456/6893] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:48:36 2022] POST /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7/action => generated 24573 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 16:49:15.544678 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=11 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:49:15.545530 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=38 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:49:15.719665 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3d567619-07f7-4e7d-b3c3-7a5a2f6c0e1d tempest-TestNetworkAdvancedServerOps-354410215 tempest-TestNetworkAdvancedServerOps-354410215-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:49:15.720315 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3d567619-07f7-4e7d-b3c3-7a5a2f6c0e1d tempest-TestNetworkAdvancedServerOps-354410215 tempest-TestNetworkAdvancedServerOps-354410215-project-admin] [instance: 81e9db46-4167-48f7-900f-9d65fdfc72b7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:49:15.727447 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3d567619-07f7-4e7d-b3c3-7a5a2f6c0e1d tempest-TestNetworkAdvancedServerOps-354410215 tempest-TestNetworkAdvancedServerOps-354410215-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:15.727969 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3d567619-07f7-4e7d-b3c3-7a5a2f6c0e1d tempest-TestNetworkAdvancedServerOps-354410215 tempest-TestNetworkAdvancedServerOps-354410215-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:15.728416 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3d567619-07f7-4e7d-b3c3-7a5a2f6c0e1d tempest-TestNetworkAdvancedServerOps-354410215 tempest-TestNetworkAdvancedServerOps-354410215-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:15.729130 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3d567619-07f7-4e7d-b3c3-7a5a2f6c0e1d tempest-TestNetworkAdvancedServerOps-354410215 tempest-TestNetworkAdvancedServerOps-354410215-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:15.729589 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3d567619-07f7-4e7d-b3c3-7a5a2f6c0e1d tempest-TestNetworkAdvancedServerOps-354410215 tempest-TestNetworkAdvancedServerOps-354410215-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:15.730024 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3d567619-07f7-4e7d-b3c3-7a5a2f6c0e1d tempest-TestNetworkAdvancedServerOps-354410215 tempest-TestNetworkAdvancedServerOps-354410215-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:15.860561 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3d567619-07f7-4e7d-b3c3-7a5a2f6c0e1d tempest-TestNetworkAdvancedServerOps-354410215 tempest-TestNetworkAdvancedServerOps-354410215-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7" status: 200 len: 1833 microversion: 2.1 time: 0.317927 Aug 31 16:49:15.861139 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3438/6894] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:49:15 2022] GET /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7 => generated 1833 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:49:15.884514 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:49:15.885277 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=4 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:49:15.996523 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4055f91a-d10a-4f75-9f2c-7e070d28a67b tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:49:15.997249 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4055f91a-d10a-4f75-9f2c-7e070d28a67b tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 81e9db46-4167-48f7-900f-9d65fdfc72b7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:49:16.004640 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4055f91a-d10a-4f75-9f2c-7e070d28a67b tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:16.005148 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4055f91a-d10a-4f75-9f2c-7e070d28a67b tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:16.005605 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4055f91a-d10a-4f75-9f2c-7e070d28a67b tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:16.006483 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4055f91a-d10a-4f75-9f2c-7e070d28a67b tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:16.006956 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4055f91a-d10a-4f75-9f2c-7e070d28a67b tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:16.007400 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4055f91a-d10a-4f75-9f2c-7e070d28a67b tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:16.142635 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-4055f91a-d10a-4f75-9f2c-7e070d28a67b tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:49:16.150604 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4055f91a-d10a-4f75-9f2c-7e070d28a67b tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7" status: 200 len: 1682 microversion: 2.1 time: 0.271960 Aug 31 16:49:16.151175 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3457/6895] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:49:15 2022] GET /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7 => generated 1682 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:49:16.250539 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-de487ebb-8b3b-4094-b45a-a0cd224f6f39 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:49:16.252890 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-de487ebb-8b3b-4094-b45a-a0cd224f6f39 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 81e9db46-4167-48f7-900f-9d65fdfc72b7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:49:16.259136 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-de487ebb-8b3b-4094-b45a-a0cd224f6f39 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:16.259673 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-de487ebb-8b3b-4094-b45a-a0cd224f6f39 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:16.260119 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-de487ebb-8b3b-4094-b45a-a0cd224f6f39 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:16.260818 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-de487ebb-8b3b-4094-b45a-a0cd224f6f39 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:16.261276 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-de487ebb-8b3b-4094-b45a-a0cd224f6f39 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:16.261704 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-de487ebb-8b3b-4094-b45a-a0cd224f6f39 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:16.336578 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-de487ebb-8b3b-4094-b45a-a0cd224f6f39 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "POST /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7/action" status: 200 len: 32645 microversion: 2.1 time: 0.090020 Aug 31 16:49:16.337546 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3439/6896] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:49:16 2022] POST /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7/action => generated 32645 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 16:49:16.477140 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7e443499-a06a-4382-8d3a-a93fccb6b4c4 tempest-TestNetworkAdvancedServerOps-354410215 tempest-TestNetworkAdvancedServerOps-354410215-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:49:16.477729 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7e443499-a06a-4382-8d3a-a93fccb6b4c4 tempest-TestNetworkAdvancedServerOps-354410215 tempest-TestNetworkAdvancedServerOps-354410215-project-admin] [instance: 81e9db46-4167-48f7-900f-9d65fdfc72b7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:49:16.484417 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7e443499-a06a-4382-8d3a-a93fccb6b4c4 tempest-TestNetworkAdvancedServerOps-354410215 tempest-TestNetworkAdvancedServerOps-354410215-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:16.484843 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7e443499-a06a-4382-8d3a-a93fccb6b4c4 tempest-TestNetworkAdvancedServerOps-354410215 tempest-TestNetworkAdvancedServerOps-354410215-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:16.485298 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7e443499-a06a-4382-8d3a-a93fccb6b4c4 tempest-TestNetworkAdvancedServerOps-354410215 tempest-TestNetworkAdvancedServerOps-354410215-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:16.486011 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7e443499-a06a-4382-8d3a-a93fccb6b4c4 tempest-TestNetworkAdvancedServerOps-354410215 tempest-TestNetworkAdvancedServerOps-354410215-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:16.486504 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7e443499-a06a-4382-8d3a-a93fccb6b4c4 tempest-TestNetworkAdvancedServerOps-354410215 tempest-TestNetworkAdvancedServerOps-354410215-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:16.486947 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7e443499-a06a-4382-8d3a-a93fccb6b4c4 tempest-TestNetworkAdvancedServerOps-354410215 tempest-TestNetworkAdvancedServerOps-354410215-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:16.514945 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7e443499-a06a-4382-8d3a-a93fccb6b4c4 tempest-TestNetworkAdvancedServerOps-354410215 tempest-TestNetworkAdvancedServerOps-354410215-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '8d8c87e0c7f447d3a75ae889d9c6e5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925377bf8f394e8caa609a3448058431', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:49:16.515561 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7e443499-a06a-4382-8d3a-a93fccb6b4c4 tempest-TestNetworkAdvancedServerOps-354410215 tempest-TestNetworkAdvancedServerOps-354410215-project-admin] [instance: 81e9db46-4167-48f7-900f-9d65fdfc72b7] flavor_id is None. Assuming migration. {{(pid=122257) resize /opt/stack/nova/nova/compute/api.py:4194}} Aug 31 16:49:16.516014 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7e443499-a06a-4382-8d3a-a93fccb6b4c4 tempest-TestNetworkAdvancedServerOps-354410215 tempest-TestNetworkAdvancedServerOps-354410215-project-admin] [instance: 81e9db46-4167-48f7-900f-9d65fdfc72b7] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122257) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 31 16:49:16.627819 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7e443499-a06a-4382-8d3a-a93fccb6b4c4 tempest-TestNetworkAdvancedServerOps-354410215 tempest-TestNetworkAdvancedServerOps-354410215-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7/action" status: 202 len: 0 microversion: 2.1 time: 0.155056 Aug 31 16:49:16.628631 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3458/6897] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:49:16 2022] POST /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7/action => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:49:16.637810 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7f88e5b9-6fb8-454e-bce5-984b14e73437 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:49:16.638608 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7f88e5b9-6fb8-454e-bce5-984b14e73437 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 81e9db46-4167-48f7-900f-9d65fdfc72b7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:49:16.647310 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7f88e5b9-6fb8-454e-bce5-984b14e73437 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:16.647938 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7f88e5b9-6fb8-454e-bce5-984b14e73437 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:16.648724 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7f88e5b9-6fb8-454e-bce5-984b14e73437 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:16.649468 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7f88e5b9-6fb8-454e-bce5-984b14e73437 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:16.650316 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7f88e5b9-6fb8-454e-bce5-984b14e73437 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:16.651522 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7f88e5b9-6fb8-454e-bce5-984b14e73437 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:16.798333 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7f88e5b9-6fb8-454e-bce5-984b14e73437 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:49:16.807037 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7f88e5b9-6fb8-454e-bce5-984b14e73437 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7" status: 200 len: 1691 microversion: 2.1 time: 0.173486 Aug 31 16:49:16.807657 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3440/6898] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:49:16 2022] GET /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7 => generated 1691 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:49:16.988835 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-da1fb4d3-2e0a-4db6-b5e3-9f6e93664798 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:49:16.989395 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-da1fb4d3-2e0a-4db6-b5e3-9f6e93664798 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: f8037ce9-f608-4fba-aed6-52b6d33f4175] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:49:16.996353 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-da1fb4d3-2e0a-4db6-b5e3-9f6e93664798 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:16.996871 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-da1fb4d3-2e0a-4db6-b5e3-9f6e93664798 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:16.997526 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-da1fb4d3-2e0a-4db6-b5e3-9f6e93664798 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:16.998434 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-da1fb4d3-2e0a-4db6-b5e3-9f6e93664798 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:16.998910 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-da1fb4d3-2e0a-4db6-b5e3-9f6e93664798 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:16.999358 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-da1fb4d3-2e0a-4db6-b5e3-9f6e93664798 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:17.026534 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-da1fb4d3-2e0a-4db6-b5e3-9f6e93664798 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: f8037ce9-f608-4fba-aed6-52b6d33f4175] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:49:17.114992 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-da1fb4d3-2e0a-4db6-b5e3-9f6e93664798 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "DELETE /compute/v2.1/servers/f8037ce9-f608-4fba-aed6-52b6d33f4175" status: 204 len: 0 microversion: 2.1 time: 0.130075 Aug 31 16:49:17.115620 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3459/6899] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:49:16 2022] DELETE /compute/v2.1/servers/f8037ce9-f608-4fba-aed6-52b6d33f4175 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:49:17.124515 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-66c78b6a-9a9e-4420-a164-4472f505168c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:49:17.125235 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-66c78b6a-9a9e-4420-a164-4472f505168c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: f8037ce9-f608-4fba-aed6-52b6d33f4175] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:49:17.133193 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-66c78b6a-9a9e-4420-a164-4472f505168c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:17.133797 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-66c78b6a-9a9e-4420-a164-4472f505168c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:17.134432 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-66c78b6a-9a9e-4420-a164-4472f505168c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:17.135158 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-66c78b6a-9a9e-4420-a164-4472f505168c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:17.135667 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-66c78b6a-9a9e-4420-a164-4472f505168c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:17.136207 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-66c78b6a-9a9e-4420-a164-4472f505168c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:17.273289 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-66c78b6a-9a9e-4420-a164-4472f505168c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:49:17.280402 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-66c78b6a-9a9e-4420-a164-4472f505168c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/f8037ce9-f608-4fba-aed6-52b6d33f4175" status: 200 len: 1576 microversion: 2.1 time: 0.160023 Aug 31 16:49:17.280976 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3441/6900] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:49:17 2022] GET /compute/v2.1/servers/f8037ce9-f608-4fba-aed6-52b6d33f4175 => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:49:17.829933 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-56823c39-24d9-45e0-8054-a4c635e9064a tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:49:17.830651 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-56823c39-24d9-45e0-8054-a4c635e9064a tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 81e9db46-4167-48f7-900f-9d65fdfc72b7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:49:17.837547 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-56823c39-24d9-45e0-8054-a4c635e9064a tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:17.838051 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-56823c39-24d9-45e0-8054-a4c635e9064a tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:17.838509 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-56823c39-24d9-45e0-8054-a4c635e9064a tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:17.839225 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-56823c39-24d9-45e0-8054-a4c635e9064a tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:17.839732 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-56823c39-24d9-45e0-8054-a4c635e9064a tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:17.840174 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-56823c39-24d9-45e0-8054-a4c635e9064a tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:17.979406 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-56823c39-24d9-45e0-8054-a4c635e9064a tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:49:17.987247 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-56823c39-24d9-45e0-8054-a4c635e9064a tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7" status: 200 len: 1691 microversion: 2.1 time: 0.161982 Aug 31 16:49:17.987854 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3460/6901] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:49:17 2022] GET /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7 => generated 1691 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:49:18.301618 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7ddb3c4c-7b14-4a76-a901-bd9d161727ae tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:49:18.302359 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7ddb3c4c-7b14-4a76-a901-bd9d161727ae tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: f8037ce9-f608-4fba-aed6-52b6d33f4175] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:49:18.310119 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7ddb3c4c-7b14-4a76-a901-bd9d161727ae tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:18.310642 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7ddb3c4c-7b14-4a76-a901-bd9d161727ae tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:18.311084 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7ddb3c4c-7b14-4a76-a901-bd9d161727ae tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:18.311812 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7ddb3c4c-7b14-4a76-a901-bd9d161727ae tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:18.312273 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7ddb3c4c-7b14-4a76-a901-bd9d161727ae tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:18.312702 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7ddb3c4c-7b14-4a76-a901-bd9d161727ae tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:18.449336 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7ddb3c4c-7b14-4a76-a901-bd9d161727ae tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:49:18.457494 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7ddb3c4c-7b14-4a76-a901-bd9d161727ae tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/f8037ce9-f608-4fba-aed6-52b6d33f4175" status: 200 len: 1576 microversion: 2.1 time: 0.159956 Aug 31 16:49:18.458121 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3442/6902] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:49:18 2022] GET /compute/v2.1/servers/f8037ce9-f608-4fba-aed6-52b6d33f4175 => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:49:19.011145 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-fdfe8273-cfbe-4f10-97b6-0f2ed61d0674 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:49:19.011904 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-fdfe8273-cfbe-4f10-97b6-0f2ed61d0674 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 81e9db46-4167-48f7-900f-9d65fdfc72b7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:49:19.019135 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fdfe8273-cfbe-4f10-97b6-0f2ed61d0674 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:19.019691 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fdfe8273-cfbe-4f10-97b6-0f2ed61d0674 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:19.020124 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fdfe8273-cfbe-4f10-97b6-0f2ed61d0674 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:19.020832 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fdfe8273-cfbe-4f10-97b6-0f2ed61d0674 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:19.021727 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fdfe8273-cfbe-4f10-97b6-0f2ed61d0674 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:19.022281 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fdfe8273-cfbe-4f10-97b6-0f2ed61d0674 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:19.275758 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-fdfe8273-cfbe-4f10-97b6-0f2ed61d0674 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:49:19.283645 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-fdfe8273-cfbe-4f10-97b6-0f2ed61d0674 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7" status: 200 len: 1691 microversion: 2.1 time: 0.277364 Aug 31 16:49:19.284234 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3461/6903] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:49:19 2022] GET /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7 => generated 1691 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:49:19.479159 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-71490f17-0f42-4520-8614-2b786a080179 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:49:19.479823 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-71490f17-0f42-4520-8614-2b786a080179 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: f8037ce9-f608-4fba-aed6-52b6d33f4175] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:49:19.486824 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-71490f17-0f42-4520-8614-2b786a080179 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:19.487325 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-71490f17-0f42-4520-8614-2b786a080179 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:19.487819 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-71490f17-0f42-4520-8614-2b786a080179 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:19.488535 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-71490f17-0f42-4520-8614-2b786a080179 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:19.489002 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-71490f17-0f42-4520-8614-2b786a080179 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:19.489438 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-71490f17-0f42-4520-8614-2b786a080179 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:19.944155 n-d-850499-9 devstack@n-api.service[122256]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 16:49:19.944389 n-d-850499-9 devstack@n-api.service[122256]: Wed Aug 31 16:49:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f8037ce9-f608-4fba-aed6-52b6d33f4175 (ip 10.222.0.61) !!! Aug 31 16:49:20.066951 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-71490f17-0f42-4520-8614-2b786a080179 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:49:20.075392 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-71490f17-0f42-4520-8614-2b786a080179 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/f8037ce9-f608-4fba-aed6-52b6d33f4175" status: 200 len: 1576 microversion: 2.1 time: 0.600899 Aug 31 16:49:20.076009 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3443/6904] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:49:19 2022] GET /compute/v2.1/servers/f8037ce9-f608-4fba-aed6-52b6d33f4175 => generated 1576 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:49:20.307126 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ced7ac38-b560-4255-a6ab-73ef962f09e7 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:49:20.307795 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ced7ac38-b560-4255-a6ab-73ef962f09e7 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 81e9db46-4167-48f7-900f-9d65fdfc72b7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:49:20.322983 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ced7ac38-b560-4255-a6ab-73ef962f09e7 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:20.324107 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ced7ac38-b560-4255-a6ab-73ef962f09e7 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:20.325168 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ced7ac38-b560-4255-a6ab-73ef962f09e7 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:20.326259 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ced7ac38-b560-4255-a6ab-73ef962f09e7 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:20.327046 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ced7ac38-b560-4255-a6ab-73ef962f09e7 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:20.327785 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ced7ac38-b560-4255-a6ab-73ef962f09e7 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:20.677471 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ced7ac38-b560-4255-a6ab-73ef962f09e7 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:49:20.700025 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ced7ac38-b560-4255-a6ab-73ef962f09e7 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7" status: 200 len: 1691 microversion: 2.1 time: 0.397727 Aug 31 16:49:20.700934 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3462/6905] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:49:20 2022] GET /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7 => generated 1691 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:49:20.996082 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-2a9b7333-e738-4c76-b720-15024133a6b9 req-9a0c89b5-d885-4ccd-b36d-f631cc6e38ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8037ce9-f608-4fba-aed6-52b6d33f4175", "name": "network-vif-deleted", "tag": "f07fd1db-0972-4f97-9fb3-1da21d5997ba"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:49:21.009475 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-2a9b7333-e738-4c76-b720-15024133a6b9 req-9a0c89b5-d885-4ccd-b36d-f631cc6e38ed service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:21.011786 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-2a9b7333-e738-4c76-b720-15024133a6b9 req-9a0c89b5-d885-4ccd-b36d-f631cc6e38ed service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:21.012726 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-2a9b7333-e738-4c76-b720-15024133a6b9 req-9a0c89b5-d885-4ccd-b36d-f631cc6e38ed service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:21.028996 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-2a9b7333-e738-4c76-b720-15024133a6b9 req-9a0c89b5-d885-4ccd-b36d-f631cc6e38ed service nova] Creating event network-vif-deleted:f07fd1db-0972-4f97-9fb3-1da21d5997ba for instance f8037ce9-f608-4fba-aed6-52b6d33f4175 on n-h1-850499-9 Aug 31 16:49:21.037105 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-2a9b7333-e738-4c76-b720-15024133a6b9 req-9a0c89b5-d885-4ccd-b36d-f631cc6e38ed service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052036 Aug 31 16:49:21.040183 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3444/6906] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:49:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:49:21.100947 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-cc3002bd-5786-491a-97c9-79193e5bfc28 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:49:21.101814 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-cc3002bd-5786-491a-97c9-79193e5bfc28 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: f8037ce9-f608-4fba-aed6-52b6d33f4175] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:49:21.110270 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cc3002bd-5786-491a-97c9-79193e5bfc28 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:21.113921 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cc3002bd-5786-491a-97c9-79193e5bfc28 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:21.116108 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cc3002bd-5786-491a-97c9-79193e5bfc28 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:21.118232 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cc3002bd-5786-491a-97c9-79193e5bfc28 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:21.118726 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cc3002bd-5786-491a-97c9-79193e5bfc28 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:21.119175 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cc3002bd-5786-491a-97c9-79193e5bfc28 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:21.205546 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-cc3002bd-5786-491a-97c9-79193e5bfc28 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:49:21.214088 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-cc3002bd-5786-491a-97c9-79193e5bfc28 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/f8037ce9-f608-4fba-aed6-52b6d33f4175" status: 200 len: 1225 microversion: 2.1 time: 0.120251 Aug 31 16:49:21.214685 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3463/6907] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:49:21 2022] GET /compute/v2.1/servers/f8037ce9-f608-4fba-aed6-52b6d33f4175 => generated 1225 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:49:21.726208 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5e8ba4cb-6e6e-4e74-bc2d-a9a655bf7f83 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:49:21.727059 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5e8ba4cb-6e6e-4e74-bc2d-a9a655bf7f83 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 81e9db46-4167-48f7-900f-9d65fdfc72b7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:49:21.733790 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5e8ba4cb-6e6e-4e74-bc2d-a9a655bf7f83 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:21.734294 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5e8ba4cb-6e6e-4e74-bc2d-a9a655bf7f83 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:21.734746 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5e8ba4cb-6e6e-4e74-bc2d-a9a655bf7f83 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:21.735928 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5e8ba4cb-6e6e-4e74-bc2d-a9a655bf7f83 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:21.736393 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5e8ba4cb-6e6e-4e74-bc2d-a9a655bf7f83 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:21.736906 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5e8ba4cb-6e6e-4e74-bc2d-a9a655bf7f83 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:21.899319 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5e8ba4cb-6e6e-4e74-bc2d-a9a655bf7f83 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:49:21.907825 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5e8ba4cb-6e6e-4e74-bc2d-a9a655bf7f83 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7" status: 200 len: 1696 microversion: 2.1 time: 0.186336 Aug 31 16:49:21.908948 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3445/6908] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:49:21 2022] GET /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7 => generated 1696 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:49:22.236130 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f771f45c-6567-4f31-bf4e-c265b70b2581 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:49:22.236792 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f771f45c-6567-4f31-bf4e-c265b70b2581 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: f8037ce9-f608-4fba-aed6-52b6d33f4175] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:49:22.257168 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f771f45c-6567-4f31-bf4e-c265b70b2581 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:22.257694 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f771f45c-6567-4f31-bf4e-c265b70b2581 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:22.259603 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f771f45c-6567-4f31-bf4e-c265b70b2581 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:22.260348 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f771f45c-6567-4f31-bf4e-c265b70b2581 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:22.261587 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f771f45c-6567-4f31-bf4e-c265b70b2581 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:22.262037 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f771f45c-6567-4f31-bf4e-c265b70b2581 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:22.331042 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f771f45c-6567-4f31-bf4e-c265b70b2581 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:49:22.339687 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f771f45c-6567-4f31-bf4e-c265b70b2581 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/f8037ce9-f608-4fba-aed6-52b6d33f4175" status: 200 len: 1225 microversion: 2.1 time: 0.107403 Aug 31 16:49:22.340279 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3464/6909] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:49:22 2022] GET /compute/v2.1/servers/f8037ce9-f608-4fba-aed6-52b6d33f4175 => generated 1225 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:49:22.931304 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5682d8f3-5d54-4f03-88df-e7b40b237fab tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:49:22.931961 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5682d8f3-5d54-4f03-88df-e7b40b237fab tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 81e9db46-4167-48f7-900f-9d65fdfc72b7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:49:22.939454 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5682d8f3-5d54-4f03-88df-e7b40b237fab tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:22.939996 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5682d8f3-5d54-4f03-88df-e7b40b237fab tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:22.940449 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5682d8f3-5d54-4f03-88df-e7b40b237fab tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:22.941171 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5682d8f3-5d54-4f03-88df-e7b40b237fab tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:22.941674 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5682d8f3-5d54-4f03-88df-e7b40b237fab tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:22.942116 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5682d8f3-5d54-4f03-88df-e7b40b237fab tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:23.079851 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5682d8f3-5d54-4f03-88df-e7b40b237fab tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:49:23.087812 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5682d8f3-5d54-4f03-88df-e7b40b237fab tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7" status: 200 len: 1696 microversion: 2.1 time: 0.161230 Aug 31 16:49:23.088402 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3446/6910] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:49:22 2022] GET /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7 => generated 1696 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:49:23.361502 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c722ecf1-29c7-466f-99b6-fafa384b7a96 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:49:23.362278 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c722ecf1-29c7-466f-99b6-fafa384b7a96 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: f8037ce9-f608-4fba-aed6-52b6d33f4175] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:49:23.370130 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c722ecf1-29c7-466f-99b6-fafa384b7a96 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:23.370641 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c722ecf1-29c7-466f-99b6-fafa384b7a96 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:23.371102 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c722ecf1-29c7-466f-99b6-fafa384b7a96 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:23.371858 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c722ecf1-29c7-466f-99b6-fafa384b7a96 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:23.372380 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c722ecf1-29c7-466f-99b6-fafa384b7a96 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:23.372825 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c722ecf1-29c7-466f-99b6-fafa384b7a96 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:23.440411 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c722ecf1-29c7-466f-99b6-fafa384b7a96 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:49:23.449632 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c722ecf1-29c7-466f-99b6-fafa384b7a96 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/f8037ce9-f608-4fba-aed6-52b6d33f4175" status: 200 len: 1225 microversion: 2.1 time: 0.092149 Aug 31 16:49:23.450424 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3465/6911] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:49:23 2022] GET /compute/v2.1/servers/f8037ce9-f608-4fba-aed6-52b6d33f4175 => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:49:24.110166 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1e461f0e-3c38-45c2-8a7b-6e86d0fef92a tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:49:24.110785 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1e461f0e-3c38-45c2-8a7b-6e86d0fef92a tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 81e9db46-4167-48f7-900f-9d65fdfc72b7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:49:24.118066 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1e461f0e-3c38-45c2-8a7b-6e86d0fef92a tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:24.118565 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1e461f0e-3c38-45c2-8a7b-6e86d0fef92a tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:24.119004 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1e461f0e-3c38-45c2-8a7b-6e86d0fef92a tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:24.119753 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1e461f0e-3c38-45c2-8a7b-6e86d0fef92a tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:24.120218 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1e461f0e-3c38-45c2-8a7b-6e86d0fef92a tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:24.120655 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1e461f0e-3c38-45c2-8a7b-6e86d0fef92a tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:24.264775 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1e461f0e-3c38-45c2-8a7b-6e86d0fef92a tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:49:24.273923 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1e461f0e-3c38-45c2-8a7b-6e86d0fef92a tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7" status: 200 len: 1696 microversion: 2.1 time: 0.167657 Aug 31 16:49:24.274512 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3447/6912] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:49:24 2022] GET /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7 => generated 1696 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:49:24.470357 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-73530b52-59ba-4fe4-9d4c-0fcbf2f0bf71 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:49:24.471045 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-73530b52-59ba-4fe4-9d4c-0fcbf2f0bf71 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: f8037ce9-f608-4fba-aed6-52b6d33f4175] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:49:24.478947 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-73530b52-59ba-4fe4-9d4c-0fcbf2f0bf71 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:24.479471 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-73530b52-59ba-4fe4-9d4c-0fcbf2f0bf71 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:24.479962 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-73530b52-59ba-4fe4-9d4c-0fcbf2f0bf71 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:24.480710 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-73530b52-59ba-4fe4-9d4c-0fcbf2f0bf71 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:24.481190 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-73530b52-59ba-4fe4-9d4c-0fcbf2f0bf71 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:24.481661 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-73530b52-59ba-4fe4-9d4c-0fcbf2f0bf71 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:24.551148 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-73530b52-59ba-4fe4-9d4c-0fcbf2f0bf71 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:49:24.559972 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-73530b52-59ba-4fe4-9d4c-0fcbf2f0bf71 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/f8037ce9-f608-4fba-aed6-52b6d33f4175" status: 200 len: 1225 microversion: 2.1 time: 0.093442 Aug 31 16:49:24.560583 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3466/6913] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:49:24 2022] GET /compute/v2.1/servers/f8037ce9-f608-4fba-aed6-52b6d33f4175 => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:49:25.296149 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5888fef0-5e00-463a-9bc3-e6437b890ea3 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:49:25.296769 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5888fef0-5e00-463a-9bc3-e6437b890ea3 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 81e9db46-4167-48f7-900f-9d65fdfc72b7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:49:25.308426 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5888fef0-5e00-463a-9bc3-e6437b890ea3 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:25.308944 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5888fef0-5e00-463a-9bc3-e6437b890ea3 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:25.309392 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5888fef0-5e00-463a-9bc3-e6437b890ea3 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:25.310448 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5888fef0-5e00-463a-9bc3-e6437b890ea3 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:25.310916 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5888fef0-5e00-463a-9bc3-e6437b890ea3 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:25.311657 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5888fef0-5e00-463a-9bc3-e6437b890ea3 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:25.454073 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5888fef0-5e00-463a-9bc3-e6437b890ea3 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:49:25.464335 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5888fef0-5e00-463a-9bc3-e6437b890ea3 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7" status: 200 len: 1696 microversion: 2.1 time: 0.172085 Aug 31 16:49:25.465122 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3448/6914] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:49:25 2022] GET /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7 => generated 1696 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:49:25.581262 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-56a0789e-b4b5-400c-b620-b293b75536c9 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:49:25.581891 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-56a0789e-b4b5-400c-b620-b293b75536c9 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: f8037ce9-f608-4fba-aed6-52b6d33f4175] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:49:25.588995 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-56a0789e-b4b5-400c-b620-b293b75536c9 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:25.589506 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-56a0789e-b4b5-400c-b620-b293b75536c9 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:25.589967 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-56a0789e-b4b5-400c-b620-b293b75536c9 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:25.590680 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-56a0789e-b4b5-400c-b620-b293b75536c9 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:25.591157 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-56a0789e-b4b5-400c-b620-b293b75536c9 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:25.591630 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-56a0789e-b4b5-400c-b620-b293b75536c9 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:25.629003 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-56a0789e-b4b5-400c-b620-b293b75536c9 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:25.629521 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-56a0789e-b4b5-400c-b620-b293b75536c9 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:25.630430 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-56a0789e-b4b5-400c-b620-b293b75536c9 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:25.631714 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-56a0789e-b4b5-400c-b620-b293b75536c9 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lazy-loading 'fault' on Instance uuid f8037ce9-f608-4fba-aed6-52b6d33f4175 {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:49:25.676626 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-56a0789e-b4b5-400c-b620-b293b75536c9 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:49:25.685685 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-56a0789e-b4b5-400c-b620-b293b75536c9 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/f8037ce9-f608-4fba-aed6-52b6d33f4175" status: 200 len: 1230 microversion: 2.1 time: 0.108244 Aug 31 16:49:25.686331 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3467/6915] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:49:25 2022] GET /compute/v2.1/servers/f8037ce9-f608-4fba-aed6-52b6d33f4175 => generated 1230 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:49:26.486360 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c9781cf5-16b5-4194-add8-3832e9e2e15d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:49:26.486983 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c9781cf5-16b5-4194-add8-3832e9e2e15d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 81e9db46-4167-48f7-900f-9d65fdfc72b7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:49:26.495122 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c9781cf5-16b5-4194-add8-3832e9e2e15d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:26.495646 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c9781cf5-16b5-4194-add8-3832e9e2e15d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:26.496082 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c9781cf5-16b5-4194-add8-3832e9e2e15d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:26.496788 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c9781cf5-16b5-4194-add8-3832e9e2e15d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:26.497250 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c9781cf5-16b5-4194-add8-3832e9e2e15d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:26.497682 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c9781cf5-16b5-4194-add8-3832e9e2e15d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:26.635152 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c9781cf5-16b5-4194-add8-3832e9e2e15d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:49:26.644078 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c9781cf5-16b5-4194-add8-3832e9e2e15d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7" status: 200 len: 1696 microversion: 2.1 time: 0.161290 Aug 31 16:49:26.644689 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3449/6916] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:49:26 2022] GET /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7 => generated 1696 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:49:26.707594 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-fa686b7f-a995-461d-b203-ad5f9d78f62c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:49:26.708163 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-fa686b7f-a995-461d-b203-ad5f9d78f62c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: f8037ce9-f608-4fba-aed6-52b6d33f4175] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:49:26.715984 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fa686b7f-a995-461d-b203-ad5f9d78f62c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:26.716493 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fa686b7f-a995-461d-b203-ad5f9d78f62c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:26.716954 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fa686b7f-a995-461d-b203-ad5f9d78f62c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:26.717669 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fa686b7f-a995-461d-b203-ad5f9d78f62c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:26.718149 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fa686b7f-a995-461d-b203-ad5f9d78f62c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:26.718651 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fa686b7f-a995-461d-b203-ad5f9d78f62c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:26.732155 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-fa686b7f-a995-461d-b203-ad5f9d78f62c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] HTTP exception thrown: Instance f8037ce9-f608-4fba-aed6-52b6d33f4175 could not be found. Aug 31 16:49:26.733828 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-fa686b7f-a995-461d-b203-ad5f9d78f62c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Request method failure captured: Aug 31 16:49:26.733828 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/f8037ce9-f608-4fba-aed6-52b6d33f4175 HTTP/1.1 Aug 31 16:49:26.733828 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:49:26.733828 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:49:26.733828 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:49:26.733828 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:49:26.733828 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:49:26.733828 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:49:26.733828 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:49:26.733828 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:49:26.733828 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD47qS8C6HsXEaEmR5vEYZ6_LcYWck6kjg2PE2Sm6XicPmZbBvnd8kXBk0kFrhGPgu84OodaxIz7Gcm1qVV62nKCQjCd-8My5krh8bw3lC-5obyJ5MI9WGooafg2qsKoEyqO0fUDn4HqdbQ-uRSMHzaJZriF8vfhIimZHzzbd5tR6Fco Aug 31 16:49:26.733828 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:49:26.733828 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:49:26.733828 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:49:26.733828 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:49:26.733828 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:49:26.733828 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:49:26.733828 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 798d7eff58b04ab582bac1e87112625f Aug 31 16:49:26.733828 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-TestVolumeBootPattern-1074913281 Aug 31 16:49:26.733828 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:49:26.733828 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:49:26.733828 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/798d7eff58b04ab582bac1e87112625f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/798d7eff58b04ab582bac1e87112625f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_798d7eff58b04ab582bac1e87112625f", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/798d7eff58b04ab582bac1e87112625f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:49:26.733828 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-TestVolumeBootPattern-1074913281 Aug 31 16:49:26.733828 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 798d7eff58b04ab582bac1e87112625f Aug 31 16:49:26.733828 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-TestVolumeBootPattern-1074913281 Aug 31 16:49:26.733828 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-TestVolumeBootPattern-1074913281-project Aug 31 16:49:26.733828 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:49:26.733828 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:49:26.733828 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 588d2ef08d8345a6b6175c8287633270 Aug 31 16:49:26.733828 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-TestVolumeBootPattern-1074913281-project Aug 31 16:49:26.733828 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:49:26.733828 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance f8037ce9-f608-4fba-aed6-52b6d33f4175 could not be found. Aug 31 16:49:26.733828 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': 'f8037ce9-f608-4fba-aed6-52b6d33f4175'} Aug 31 16:49:26.733828 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:49:26.733828 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:49:26.733828 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:49:26.733828 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:49:26.733828 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:49:26.733828 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:49:26.733828 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:49:26.733828 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:49:26.733828 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:49:26.733828 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:49:26.733828 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8037ce9-f608-4fba-aed6-52b6d33f4175 could not be found. Aug 31 16:49:26.733828 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:49:26.733828 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:49:26.733828 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:49:26.733828 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:49:26.733828 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:49:26.733828 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:49:26.733828 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:49:26.733828 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:49:26.733828 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:49:26.733828 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:49:26.733828 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:49:26.733828 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:49:26.733828 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:49:26.733828 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:49:26.733828 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:49:26.733828 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:49:26.733828 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8037ce9-f608-4fba-aed6-52b6d33f4175 could not be found. Aug 31 16:49:26.733828 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:49:26.733828 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:49:26.733828 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:49:26.737689 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:49:26.737689 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:49:26.737689 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:49:26.737689 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:49:26.737689 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:49:26.737689 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8037ce9-f608-4fba-aed6-52b6d33f4175 could not be found. Aug 31 16:49:26.737689 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:49:26.737689 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-fa686b7f-a995-461d-b203-ad5f9d78f62c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Returning 404 to user: Instance f8037ce9-f608-4fba-aed6-52b6d33f4175 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:49:26.737689 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-fa686b7f-a995-461d-b203-ad5f9d78f62c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/f8037ce9-f608-4fba-aed6-52b6d33f4175" status: 404 len: 111 microversion: 2.1 time: 0.031776 Aug 31 16:49:26.737689 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3468/6917] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:49:26 2022] GET /compute/v2.1/servers/f8037ce9-f608-4fba-aed6-52b6d33f4175 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:49:26.836066 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7b8aa1cc-8ce4-4139-ba08-cff050e2bba6 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-900695407", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-435793919", "security_groups": [{"name": "tempest-secgroup-smoke-64941522"}], "block_device_mapping_v2": [{"uuid": "d43b69c1-aa51-4c04-b846-18da4fd68bca", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0b707539-6131-412e-ba43-5bdd2cb0fbe5"}]}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:49:26.951239 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-7b8aa1cc-8ce4-4139-ba08-cff050e2bba6 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] validate_networks() for [('0b707539-6131-412e-ba43-5bdd2cb0fbe5', None, None, None, None, None)] {{(pid=122256) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:49:27.324497 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-7b8aa1cc-8ce4-4139-ba08-cff050e2bba6 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:49:27.324929 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-7b8aa1cc-8ce4-4139-ba08-cff050e2bba6 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:49:27.325412 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-7b8aa1cc-8ce4-4139-ba08-cff050e2bba6 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:49:27.325829 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-7b8aa1cc-8ce4-4139-ba08-cff050e2bba6 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:49:27.326248 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-7b8aa1cc-8ce4-4139-ba08-cff050e2bba6 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:49:27.336942 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7b8aa1cc-8ce4-4139-ba08-cff050e2bba6 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:27.337425 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7b8aa1cc-8ce4-4139-ba08-cff050e2bba6 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:27.337863 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7b8aa1cc-8ce4-4139-ba08-cff050e2bba6 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:27.338582 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7b8aa1cc-8ce4-4139-ba08-cff050e2bba6 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:27.339066 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7b8aa1cc-8ce4-4139-ba08-cff050e2bba6 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:27.339492 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7b8aa1cc-8ce4-4139-ba08-cff050e2bba6 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:27.356464 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-7b8aa1cc-8ce4-4139-ba08-cff050e2bba6 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Getting quotas for project 798d7eff58b04ab582bac1e87112625f. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:49:27.361931 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-7b8aa1cc-8ce4-4139-ba08-cff050e2bba6 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Getting quotas for user 588d2ef08d8345a6b6175c8287633270 and project 798d7eff58b04ab582bac1e87112625f. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:49:27.424768 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7b8aa1cc-8ce4-4139-ba08-cff050e2bba6 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Going to run 1 instances... {{(pid=122256) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:49:27.426894 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7b8aa1cc-8ce4-4139-ba08-cff050e2bba6 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 4987acd8-f1a1-4fb1-ac82-b426d7543100] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d43b69c1-aa51-4c04-b846-18da4fd68bca',volume_size=None,volume_type=None)] {{(pid=122256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:49:27.563370 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7b8aa1cc-8ce4-4139-ba08-cff050e2bba6 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.731348 Aug 31 16:49:27.564748 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3450/6918] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:49:26 2022] POST /compute/v2.1/servers => generated 404 bytes in 733 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:49:27.576136 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b225a2bc-e1c5-4dc2-9cde-695414929bdd tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:49:27.576686 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b225a2bc-e1c5-4dc2-9cde-695414929bdd tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 4987acd8-f1a1-4fb1-ac82-b426d7543100] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:49:27.631979 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b225a2bc-e1c5-4dc2-9cde-695414929bdd tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:49:27.640008 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b225a2bc-e1c5-4dc2-9cde-695414929bdd tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/4987acd8-f1a1-4fb1-ac82-b426d7543100" status: 200 len: 1093 microversion: 2.1 time: 0.067824 Aug 31 16:49:27.640584 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3469/6919] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:49:27 2022] GET /compute/v2.1/servers/4987acd8-f1a1-4fb1-ac82-b426d7543100 => generated 1093 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:49:27.665870 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c21cf380-7f5a-4fe4-a2a2-9c7333907045 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:49:27.666497 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c21cf380-7f5a-4fe4-a2a2-9c7333907045 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 81e9db46-4167-48f7-900f-9d65fdfc72b7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:49:27.672739 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c21cf380-7f5a-4fe4-a2a2-9c7333907045 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:27.673442 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c21cf380-7f5a-4fe4-a2a2-9c7333907045 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:27.673882 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c21cf380-7f5a-4fe4-a2a2-9c7333907045 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:27.674715 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c21cf380-7f5a-4fe4-a2a2-9c7333907045 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:27.675172 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c21cf380-7f5a-4fe4-a2a2-9c7333907045 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:27.675624 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c21cf380-7f5a-4fe4-a2a2-9c7333907045 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:27.829523 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c21cf380-7f5a-4fe4-a2a2-9c7333907045 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:49:27.840599 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c21cf380-7f5a-4fe4-a2a2-9c7333907045 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7" status: 200 len: 1696 microversion: 2.1 time: 0.177823 Aug 31 16:49:27.841217 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3451/6920] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:49:27 2022] GET /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7 => generated 1696 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:49:28.662411 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-51772880-28cc-485b-9ceb-9c8c524dcf00 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:49:28.663336 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-51772880-28cc-485b-9ceb-9c8c524dcf00 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 4987acd8-f1a1-4fb1-ac82-b426d7543100] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:49:28.671109 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-51772880-28cc-485b-9ceb-9c8c524dcf00 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:28.671667 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-51772880-28cc-485b-9ceb-9c8c524dcf00 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:28.672137 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-51772880-28cc-485b-9ceb-9c8c524dcf00 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:28.672961 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-51772880-28cc-485b-9ceb-9c8c524dcf00 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:28.673442 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-51772880-28cc-485b-9ceb-9c8c524dcf00 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:28.673895 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-51772880-28cc-485b-9ceb-9c8c524dcf00 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:28.741062 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-51772880-28cc-485b-9ceb-9c8c524dcf00 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:49:28.749604 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-51772880-28cc-485b-9ceb-9c8c524dcf00 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/4987acd8-f1a1-4fb1-ac82-b426d7543100" status: 200 len: 1199 microversion: 2.1 time: 0.091099 Aug 31 16:49:28.750402 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3470/6921] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:49:28 2022] GET /compute/v2.1/servers/4987acd8-f1a1-4fb1-ac82-b426d7543100 => generated 1199 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:49:28.863175 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-662231cd-dfd7-41c6-abfe-5d467f989d27 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:49:28.863831 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-662231cd-dfd7-41c6-abfe-5d467f989d27 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 81e9db46-4167-48f7-900f-9d65fdfc72b7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:49:28.871734 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-662231cd-dfd7-41c6-abfe-5d467f989d27 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:28.872344 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-662231cd-dfd7-41c6-abfe-5d467f989d27 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:28.872788 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-662231cd-dfd7-41c6-abfe-5d467f989d27 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:28.873521 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-662231cd-dfd7-41c6-abfe-5d467f989d27 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:28.873982 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-662231cd-dfd7-41c6-abfe-5d467f989d27 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:28.874417 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-662231cd-dfd7-41c6-abfe-5d467f989d27 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:29.104868 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-662231cd-dfd7-41c6-abfe-5d467f989d27 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:49:29.113146 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-662231cd-dfd7-41c6-abfe-5d467f989d27 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7" status: 200 len: 1696 microversion: 2.1 time: 0.254861 Aug 31 16:49:29.114182 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3452/6922] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:49:28 2022] GET /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7 => generated 1696 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:49:29.773385 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4cae5178-e751-4072-858e-4c9ae49d760c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:49:29.774041 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4cae5178-e751-4072-858e-4c9ae49d760c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 4987acd8-f1a1-4fb1-ac82-b426d7543100] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:49:29.782336 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4cae5178-e751-4072-858e-4c9ae49d760c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:29.782916 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4cae5178-e751-4072-858e-4c9ae49d760c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:29.783387 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4cae5178-e751-4072-858e-4c9ae49d760c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:29.784155 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4cae5178-e751-4072-858e-4c9ae49d760c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:29.784639 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4cae5178-e751-4072-858e-4c9ae49d760c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:29.785094 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4cae5178-e751-4072-858e-4c9ae49d760c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:29.825358 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:49:30.055522 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-4cae5178-e751-4072-858e-4c9ae49d760c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:49:30.065716 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4cae5178-e751-4072-858e-4c9ae49d760c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/4987acd8-f1a1-4fb1-ac82-b426d7543100" status: 200 len: 1275 microversion: 2.1 time: 0.296954 Aug 31 16:49:30.066662 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3471/6923] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:49:29 2022] GET /compute/v2.1/servers/4987acd8-f1a1-4fb1-ac82-b426d7543100 => generated 1275 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:49:30.136659 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b8c73726-0876-4738-88f0-1728da689956 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:49:30.137291 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b8c73726-0876-4738-88f0-1728da689956 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 81e9db46-4167-48f7-900f-9d65fdfc72b7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:49:30.146249 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b8c73726-0876-4738-88f0-1728da689956 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:30.148211 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b8c73726-0876-4738-88f0-1728da689956 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:30.148667 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b8c73726-0876-4738-88f0-1728da689956 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:30.149405 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b8c73726-0876-4738-88f0-1728da689956 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:30.150040 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b8c73726-0876-4738-88f0-1728da689956 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:30.150544 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b8c73726-0876-4738-88f0-1728da689956 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:30.364097 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b8c73726-0876-4738-88f0-1728da689956 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:49:30.372944 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b8c73726-0876-4738-88f0-1728da689956 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7" status: 200 len: 1696 microversion: 2.1 time: 0.241152 Aug 31 16:49:30.373875 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3453/6924] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:49:30 2022] GET /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7 => generated 1696 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:49:30.530166 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-63957cf1-34b3-4d3c-aeb3-9561df1414c6 req-b887f517-018a-4bd7-a5c2-84127389891d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4987acd8-f1a1-4fb1-ac82-b426d7543100", "tag": "2b784555-0e5f-4057-8c53-bf90f27149bf"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:49:30.541523 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-63957cf1-34b3-4d3c-aeb3-9561df1414c6 req-b887f517-018a-4bd7-a5c2-84127389891d service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:30.542284 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-63957cf1-34b3-4d3c-aeb3-9561df1414c6 req-b887f517-018a-4bd7-a5c2-84127389891d service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:30.542902 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-63957cf1-34b3-4d3c-aeb3-9561df1414c6 req-b887f517-018a-4bd7-a5c2-84127389891d service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:30.555705 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-63957cf1-34b3-4d3c-aeb3-9561df1414c6 req-b887f517-018a-4bd7-a5c2-84127389891d service nova] Creating event network-changed:2b784555-0e5f-4057-8c53-bf90f27149bf for instance 4987acd8-f1a1-4fb1-ac82-b426d7543100 on n-h2-850499-9 Aug 31 16:49:30.560749 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-63957cf1-34b3-4d3c-aeb3-9561df1414c6 req-b887f517-018a-4bd7-a5c2-84127389891d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122763 Aug 31 16:49:30.561394 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3472/6925] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:49:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:49:31.089303 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2a385107-51d6-4f15-af6b-da2749800e50 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:49:31.089925 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2a385107-51d6-4f15-af6b-da2749800e50 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 4987acd8-f1a1-4fb1-ac82-b426d7543100] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:49:31.096276 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2a385107-51d6-4f15-af6b-da2749800e50 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:31.096784 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2a385107-51d6-4f15-af6b-da2749800e50 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:31.097235 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2a385107-51d6-4f15-af6b-da2749800e50 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:31.097950 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2a385107-51d6-4f15-af6b-da2749800e50 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:31.098696 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2a385107-51d6-4f15-af6b-da2749800e50 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:31.099351 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2a385107-51d6-4f15-af6b-da2749800e50 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:31.309318 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-2a385107-51d6-4f15-af6b-da2749800e50 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:49:31.317705 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2a385107-51d6-4f15-af6b-da2749800e50 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/4987acd8-f1a1-4fb1-ac82-b426d7543100" status: 200 len: 1275 microversion: 2.1 time: 0.232502 Aug 31 16:49:31.328469 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3454/6926] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:49:31 2022] GET /compute/v2.1/servers/4987acd8-f1a1-4fb1-ac82-b426d7543100 => generated 1275 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:49:31.395231 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c61520f6-0743-4a1b-ba32-81b44f6da40f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:49:31.395964 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c61520f6-0743-4a1b-ba32-81b44f6da40f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 81e9db46-4167-48f7-900f-9d65fdfc72b7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:49:31.404203 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c61520f6-0743-4a1b-ba32-81b44f6da40f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:31.404713 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c61520f6-0743-4a1b-ba32-81b44f6da40f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:31.405166 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c61520f6-0743-4a1b-ba32-81b44f6da40f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:31.405880 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c61520f6-0743-4a1b-ba32-81b44f6da40f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:31.406352 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c61520f6-0743-4a1b-ba32-81b44f6da40f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:31.406789 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c61520f6-0743-4a1b-ba32-81b44f6da40f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:31.574453 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c61520f6-0743-4a1b-ba32-81b44f6da40f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:49:31.584686 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c61520f6-0743-4a1b-ba32-81b44f6da40f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7" status: 200 len: 1696 microversion: 2.1 time: 0.193668 Aug 31 16:49:31.585381 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3473/6927] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:49:31 2022] GET /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7 => generated 1696 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:49:32.338604 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6db22f71-6f17-4c2c-9d21-89407be188a7 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:49:32.339241 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6db22f71-6f17-4c2c-9d21-89407be188a7 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 4987acd8-f1a1-4fb1-ac82-b426d7543100] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:49:32.346252 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6db22f71-6f17-4c2c-9d21-89407be188a7 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:32.346699 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6db22f71-6f17-4c2c-9d21-89407be188a7 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:32.347151 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6db22f71-6f17-4c2c-9d21-89407be188a7 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:32.347892 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6db22f71-6f17-4c2c-9d21-89407be188a7 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:32.348360 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6db22f71-6f17-4c2c-9d21-89407be188a7 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:32.348796 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6db22f71-6f17-4c2c-9d21-89407be188a7 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:32.486807 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-6db22f71-6f17-4c2c-9d21-89407be188a7 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:49:32.495339 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6db22f71-6f17-4c2c-9d21-89407be188a7 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/4987acd8-f1a1-4fb1-ac82-b426d7543100" status: 200 len: 1275 microversion: 2.1 time: 0.160841 Aug 31 16:49:32.495928 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3455/6928] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:49:32 2022] GET /compute/v2.1/servers/4987acd8-f1a1-4fb1-ac82-b426d7543100 => generated 1275 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:49:32.606335 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-73c4c562-39c4-4b9e-bf6d-132b2ad71b14 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:49:32.607002 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-73c4c562-39c4-4b9e-bf6d-132b2ad71b14 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 81e9db46-4167-48f7-900f-9d65fdfc72b7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:49:32.614337 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-73c4c562-39c4-4b9e-bf6d-132b2ad71b14 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:32.614856 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-73c4c562-39c4-4b9e-bf6d-132b2ad71b14 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:32.616522 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-73c4c562-39c4-4b9e-bf6d-132b2ad71b14 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:32.617264 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-73c4c562-39c4-4b9e-bf6d-132b2ad71b14 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:32.618029 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-73c4c562-39c4-4b9e-bf6d-132b2ad71b14 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:32.618511 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-73c4c562-39c4-4b9e-bf6d-132b2ad71b14 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:33.079090 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-73c4c562-39c4-4b9e-bf6d-132b2ad71b14 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:49:33.087056 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-73c4c562-39c4-4b9e-bf6d-132b2ad71b14 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7" status: 200 len: 1696 microversion: 2.1 time: 0.484689 Aug 31 16:49:33.087663 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3474/6929] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:49:32 2022] GET /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7 => generated 1696 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:49:33.518016 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c1e86624-69e3-4b37-bd8f-3dc88491513f tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:49:33.518776 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c1e86624-69e3-4b37-bd8f-3dc88491513f tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 4987acd8-f1a1-4fb1-ac82-b426d7543100] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:49:33.527209 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c1e86624-69e3-4b37-bd8f-3dc88491513f tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:33.527795 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c1e86624-69e3-4b37-bd8f-3dc88491513f tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:33.528371 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c1e86624-69e3-4b37-bd8f-3dc88491513f tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:33.529109 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c1e86624-69e3-4b37-bd8f-3dc88491513f tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:33.529583 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c1e86624-69e3-4b37-bd8f-3dc88491513f tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:33.530185 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c1e86624-69e3-4b37-bd8f-3dc88491513f tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:33.534953 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=100 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:49:33.764412 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c1e86624-69e3-4b37-bd8f-3dc88491513f tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:49:33.773557 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c1e86624-69e3-4b37-bd8f-3dc88491513f tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/4987acd8-f1a1-4fb1-ac82-b426d7543100" status: 200 len: 1275 microversion: 2.1 time: 0.259686 Aug 31 16:49:33.774163 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3456/6930] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:49:33 2022] GET /compute/v2.1/servers/4987acd8-f1a1-4fb1-ac82-b426d7543100 => generated 1275 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:49:33.861774 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-e46453b8-befc-4994-8710-53050e184cf6 req-d7ff253b-5306-4fc8-8f62-5c2688fbd613 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81e9db46-4167-48f7-900f-9d65fdfc72b7", "name": "network-vif-unplugged", "status": "completed", "tag": "a574579c-df0c-467a-bdb8-ee3e7daa36e5"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:49:33.876670 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-e46453b8-befc-4994-8710-53050e184cf6 req-d7ff253b-5306-4fc8-8f62-5c2688fbd613 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:33.877179 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-e46453b8-befc-4994-8710-53050e184cf6 req-d7ff253b-5306-4fc8-8f62-5c2688fbd613 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:33.879031 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-e46453b8-befc-4994-8710-53050e184cf6 req-d7ff253b-5306-4fc8-8f62-5c2688fbd613 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:33.899946 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-e46453b8-befc-4994-8710-53050e184cf6 req-d7ff253b-5306-4fc8-8f62-5c2688fbd613 service nova] Creating event network-vif-unplugged:a574579c-df0c-467a-bdb8-ee3e7daa36e5 for instance 81e9db46-4167-48f7-900f-9d65fdfc72b7 on n-h1-850499-9 Aug 31 16:49:33.908886 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [req-e46453b8-befc-4994-8710-53050e184cf6 req-d7ff253b-5306-4fc8-8f62-5c2688fbd613 service nova] Instance 81e9db46-4167-48f7-900f-9d65fdfc72b7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850499-9', 'n-h2-850499-9'} {{(pid=122257) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 31 16:49:33.922922 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-e46453b8-befc-4994-8710-53050e184cf6 req-d7ff253b-5306-4fc8-8f62-5c2688fbd613 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066395 Aug 31 16:49:33.924395 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3475/6931] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:49:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:49:34.109124 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-04ce100a-8199-4f01-8a6a-b216276de45e tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:49:34.109753 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-04ce100a-8199-4f01-8a6a-b216276de45e tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 81e9db46-4167-48f7-900f-9d65fdfc72b7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:49:34.116917 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-04ce100a-8199-4f01-8a6a-b216276de45e tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:34.117421 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-04ce100a-8199-4f01-8a6a-b216276de45e tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:34.118121 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-04ce100a-8199-4f01-8a6a-b216276de45e tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:34.118842 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-04ce100a-8199-4f01-8a6a-b216276de45e tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:34.119572 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-04ce100a-8199-4f01-8a6a-b216276de45e tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:34.120256 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-04ce100a-8199-4f01-8a6a-b216276de45e tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:34.320593 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-04ce100a-8199-4f01-8a6a-b216276de45e tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:49:34.329137 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-04ce100a-8199-4f01-8a6a-b216276de45e tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7" status: 200 len: 1695 microversion: 2.1 time: 0.224043 Aug 31 16:49:34.329743 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3457/6932] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:49:34 2022] GET /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7 => generated 1695 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:49:34.795037 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0db9b11b-85ed-41be-a84f-40f397cd837e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:49:34.795819 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0db9b11b-85ed-41be-a84f-40f397cd837e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 4987acd8-f1a1-4fb1-ac82-b426d7543100] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:49:34.802101 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0db9b11b-85ed-41be-a84f-40f397cd837e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:34.802603 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0db9b11b-85ed-41be-a84f-40f397cd837e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:34.803052 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0db9b11b-85ed-41be-a84f-40f397cd837e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:34.803956 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0db9b11b-85ed-41be-a84f-40f397cd837e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:34.804426 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0db9b11b-85ed-41be-a84f-40f397cd837e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:34.804940 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0db9b11b-85ed-41be-a84f-40f397cd837e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:34.986632 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0db9b11b-85ed-41be-a84f-40f397cd837e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:49:34.996260 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0db9b11b-85ed-41be-a84f-40f397cd837e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/4987acd8-f1a1-4fb1-ac82-b426d7543100" status: 200 len: 1263 microversion: 2.1 time: 0.205594 Aug 31 16:49:34.996879 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3476/6933] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:49:34 2022] GET /compute/v2.1/servers/4987acd8-f1a1-4fb1-ac82-b426d7543100 => generated 1263 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:49:35.351699 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-368e6d4f-04ca-45dc-9765-4b391baf8163 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:49:35.352250 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-368e6d4f-04ca-45dc-9765-4b391baf8163 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 81e9db46-4167-48f7-900f-9d65fdfc72b7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:49:35.359294 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-368e6d4f-04ca-45dc-9765-4b391baf8163 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:35.359822 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-368e6d4f-04ca-45dc-9765-4b391baf8163 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:35.360302 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-368e6d4f-04ca-45dc-9765-4b391baf8163 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:35.361011 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-368e6d4f-04ca-45dc-9765-4b391baf8163 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:35.361481 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-368e6d4f-04ca-45dc-9765-4b391baf8163 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:35.361921 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-368e6d4f-04ca-45dc-9765-4b391baf8163 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:35.502193 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-368e6d4f-04ca-45dc-9765-4b391baf8163 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:49:35.510170 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-368e6d4f-04ca-45dc-9765-4b391baf8163 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7" status: 200 len: 1693 microversion: 2.1 time: 0.163589 Aug 31 16:49:35.510742 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3458/6934] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:49:35 2022] GET /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7 => generated 1693 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:49:35.956277 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-8572885d-110d-4328-a1bd-529234feb68b req-66d379fd-a393-4183-8400-bfa2b5453c57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81e9db46-4167-48f7-900f-9d65fdfc72b7", "tag": "a574579c-df0c-467a-bdb8-ee3e7daa36e5"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:49:35.966656 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-8572885d-110d-4328-a1bd-529234feb68b req-66d379fd-a393-4183-8400-bfa2b5453c57 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:35.967154 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-8572885d-110d-4328-a1bd-529234feb68b req-66d379fd-a393-4183-8400-bfa2b5453c57 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:35.967643 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-8572885d-110d-4328-a1bd-529234feb68b req-66d379fd-a393-4183-8400-bfa2b5453c57 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:35.979481 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-8572885d-110d-4328-a1bd-529234feb68b req-66d379fd-a393-4183-8400-bfa2b5453c57 service nova] Creating event network-changed:a574579c-df0c-467a-bdb8-ee3e7daa36e5 for instance 81e9db46-4167-48f7-900f-9d65fdfc72b7 on n-h1-850499-9 Aug 31 16:49:35.984854 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [req-8572885d-110d-4328-a1bd-529234feb68b req-66d379fd-a393-4183-8400-bfa2b5453c57 service nova] Instance 81e9db46-4167-48f7-900f-9d65fdfc72b7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850499-9', 'n-h2-850499-9'} {{(pid=122257) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 31 16:49:35.996240 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-8572885d-110d-4328-a1bd-529234feb68b req-66d379fd-a393-4183-8400-bfa2b5453c57 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043795 Aug 31 16:49:35.996905 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3477/6935] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:49:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:49:36.017242 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7db8904a-0c5e-43db-ac8a-062471fb0e68 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:49:36.017863 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7db8904a-0c5e-43db-ac8a-062471fb0e68 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 4987acd8-f1a1-4fb1-ac82-b426d7543100] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:49:36.024593 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7db8904a-0c5e-43db-ac8a-062471fb0e68 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:36.025088 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7db8904a-0c5e-43db-ac8a-062471fb0e68 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:36.025538 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7db8904a-0c5e-43db-ac8a-062471fb0e68 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:36.026298 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7db8904a-0c5e-43db-ac8a-062471fb0e68 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:36.026766 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7db8904a-0c5e-43db-ac8a-062471fb0e68 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:36.027205 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7db8904a-0c5e-43db-ac8a-062471fb0e68 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:36.257652 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7db8904a-0c5e-43db-ac8a-062471fb0e68 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:49:36.265837 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7db8904a-0c5e-43db-ac8a-062471fb0e68 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/4987acd8-f1a1-4fb1-ac82-b426d7543100" status: 200 len: 1263 microversion: 2.1 time: 0.252465 Aug 31 16:49:36.266419 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3459/6936] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:49:36 2022] GET /compute/v2.1/servers/4987acd8-f1a1-4fb1-ac82-b426d7543100 => generated 1263 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:49:36.532792 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2d3c67e9-a617-485a-815b-8a106acb265e tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:49:36.533549 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2d3c67e9-a617-485a-815b-8a106acb265e tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 81e9db46-4167-48f7-900f-9d65fdfc72b7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:49:36.540436 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2d3c67e9-a617-485a-815b-8a106acb265e tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:36.540955 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2d3c67e9-a617-485a-815b-8a106acb265e tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:36.541412 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2d3c67e9-a617-485a-815b-8a106acb265e tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:36.542132 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2d3c67e9-a617-485a-815b-8a106acb265e tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:36.542612 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2d3c67e9-a617-485a-815b-8a106acb265e tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:36.543063 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2d3c67e9-a617-485a-815b-8a106acb265e tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:36.728430 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2d3c67e9-a617-485a-815b-8a106acb265e tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:49:36.737504 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2d3c67e9-a617-485a-815b-8a106acb265e tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7" status: 200 len: 1693 microversion: 2.1 time: 0.209045 Aug 31 16:49:36.738122 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3478/6937] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:49:36 2022] GET /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7 => generated 1693 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:49:37.290802 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-43c827b0-5ffc-4b60-a0a9-bd3b9228787b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:49:37.291409 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-43c827b0-5ffc-4b60-a0a9-bd3b9228787b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 4987acd8-f1a1-4fb1-ac82-b426d7543100] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:49:37.298641 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-43c827b0-5ffc-4b60-a0a9-bd3b9228787b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:37.299140 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-43c827b0-5ffc-4b60-a0a9-bd3b9228787b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:37.299616 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-43c827b0-5ffc-4b60-a0a9-bd3b9228787b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:37.300352 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-43c827b0-5ffc-4b60-a0a9-bd3b9228787b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:37.300812 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-43c827b0-5ffc-4b60-a0a9-bd3b9228787b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:37.301285 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-43c827b0-5ffc-4b60-a0a9-bd3b9228787b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:37.345308 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:49:37.369656 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=6 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:49:37.449290 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-43c827b0-5ffc-4b60-a0a9-bd3b9228787b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:49:37.457357 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-43c827b0-5ffc-4b60-a0a9-bd3b9228787b tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/4987acd8-f1a1-4fb1-ac82-b426d7543100" status: 200 len: 1263 microversion: 2.1 time: 0.172980 Aug 31 16:49:37.457960 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3460/6938] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:49:37 2022] GET /compute/v2.1/servers/4987acd8-f1a1-4fb1-ac82-b426d7543100 => generated 1263 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:49:37.760856 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a593705b-ab8e-4382-aa67-89a922660680 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:49:37.761487 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a593705b-ab8e-4382-aa67-89a922660680 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 81e9db46-4167-48f7-900f-9d65fdfc72b7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:49:37.764568 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:49:37.770221 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a593705b-ab8e-4382-aa67-89a922660680 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:37.770731 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a593705b-ab8e-4382-aa67-89a922660680 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:37.771190 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a593705b-ab8e-4382-aa67-89a922660680 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:37.772865 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a593705b-ab8e-4382-aa67-89a922660680 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:37.773353 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a593705b-ab8e-4382-aa67-89a922660680 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:37.773803 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a593705b-ab8e-4382-aa67-89a922660680 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:37.982904 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a593705b-ab8e-4382-aa67-89a922660680 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:49:37.991553 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a593705b-ab8e-4382-aa67-89a922660680 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7" status: 200 len: 1693 microversion: 2.1 time: 0.234584 Aug 31 16:49:37.992248 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3479/6939] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:49:37 2022] GET /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7 => generated 1693 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:49:38.597159 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c651f8dc-a22a-40b6-adb5-902231e0dfe2 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:49:38.597782 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c651f8dc-a22a-40b6-adb5-902231e0dfe2 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 4987acd8-f1a1-4fb1-ac82-b426d7543100] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:49:38.605383 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c651f8dc-a22a-40b6-adb5-902231e0dfe2 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:38.605879 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c651f8dc-a22a-40b6-adb5-902231e0dfe2 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:38.606324 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c651f8dc-a22a-40b6-adb5-902231e0dfe2 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:38.607029 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c651f8dc-a22a-40b6-adb5-902231e0dfe2 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:38.607492 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c651f8dc-a22a-40b6-adb5-902231e0dfe2 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:38.607953 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c651f8dc-a22a-40b6-adb5-902231e0dfe2 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:38.740240 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c651f8dc-a22a-40b6-adb5-902231e0dfe2 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:49:38.748474 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c651f8dc-a22a-40b6-adb5-902231e0dfe2 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/4987acd8-f1a1-4fb1-ac82-b426d7543100" status: 200 len: 1263 microversion: 2.1 time: 0.155256 Aug 31 16:49:38.749051 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3461/6940] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:49:38 2022] GET /compute/v2.1/servers/4987acd8-f1a1-4fb1-ac82-b426d7543100 => generated 1263 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:49:39.015967 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a422be75-4255-47bf-b0d7-a4ec2dd75898 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:49:39.016591 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a422be75-4255-47bf-b0d7-a4ec2dd75898 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 81e9db46-4167-48f7-900f-9d65fdfc72b7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:49:39.023839 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a422be75-4255-47bf-b0d7-a4ec2dd75898 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:39.024351 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a422be75-4255-47bf-b0d7-a4ec2dd75898 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:39.024818 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a422be75-4255-47bf-b0d7-a4ec2dd75898 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:39.025528 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a422be75-4255-47bf-b0d7-a4ec2dd75898 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:39.026019 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a422be75-4255-47bf-b0d7-a4ec2dd75898 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:39.026466 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a422be75-4255-47bf-b0d7-a4ec2dd75898 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:39.167690 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a422be75-4255-47bf-b0d7-a4ec2dd75898 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:49:39.175513 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a422be75-4255-47bf-b0d7-a4ec2dd75898 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7" status: 200 len: 1690 microversion: 2.1 time: 0.163532 Aug 31 16:49:39.176103 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3480/6941] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:49:39 2022] GET /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7 => generated 1690 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:49:39.198061 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f9d25476-27f8-4702-b6cb-c684be0557ab tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:49:39.198600 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f9d25476-27f8-4702-b6cb-c684be0557ab tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 81e9db46-4167-48f7-900f-9d65fdfc72b7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:49:39.204628 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f9d25476-27f8-4702-b6cb-c684be0557ab tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:39.205122 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f9d25476-27f8-4702-b6cb-c684be0557ab tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:39.205564 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f9d25476-27f8-4702-b6cb-c684be0557ab tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:39.206267 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f9d25476-27f8-4702-b6cb-c684be0557ab tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:39.206726 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f9d25476-27f8-4702-b6cb-c684be0557ab tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:39.207159 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f9d25476-27f8-4702-b6cb-c684be0557ab tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:39.314850 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f9d25476-27f8-4702-b6cb-c684be0557ab tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "POST /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7/action" status: 202 len: 0 microversion: 2.1 time: 0.121070 Aug 31 16:49:39.315478 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3462/6942] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:49:39 2022] POST /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:49:39.328155 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1abac177-51ba-464b-a422-f09b766906c2 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:49:39.329370 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1abac177-51ba-464b-a422-f09b766906c2 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 81e9db46-4167-48f7-900f-9d65fdfc72b7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:49:39.338005 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1abac177-51ba-464b-a422-f09b766906c2 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:39.338764 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1abac177-51ba-464b-a422-f09b766906c2 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:39.339254 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1abac177-51ba-464b-a422-f09b766906c2 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:39.340110 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1abac177-51ba-464b-a422-f09b766906c2 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:39.340591 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1abac177-51ba-464b-a422-f09b766906c2 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:39.341032 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1abac177-51ba-464b-a422-f09b766906c2 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:39.538437 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-1abac177-51ba-464b-a422-f09b766906c2 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:49:39.546278 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1abac177-51ba-464b-a422-f09b766906c2 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7" status: 200 len: 1689 microversion: 2.1 time: 0.225141 Aug 31 16:49:39.546859 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3481/6943] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:49:39 2022] GET /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7 => generated 1689 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:49:39.772063 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ae402b2d-266c-4b61-94f0-98c57ca5b4d2 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:49:39.772772 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ae402b2d-266c-4b61-94f0-98c57ca5b4d2 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 4987acd8-f1a1-4fb1-ac82-b426d7543100] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:49:39.779530 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ae402b2d-266c-4b61-94f0-98c57ca5b4d2 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:39.780042 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ae402b2d-266c-4b61-94f0-98c57ca5b4d2 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:39.780484 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ae402b2d-266c-4b61-94f0-98c57ca5b4d2 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:39.781191 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ae402b2d-266c-4b61-94f0-98c57ca5b4d2 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:39.781648 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ae402b2d-266c-4b61-94f0-98c57ca5b4d2 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:39.782155 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ae402b2d-266c-4b61-94f0-98c57ca5b4d2 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:39.986827 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ae402b2d-266c-4b61-94f0-98c57ca5b4d2 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:49:39.996352 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ae402b2d-266c-4b61-94f0-98c57ca5b4d2 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/4987acd8-f1a1-4fb1-ac82-b426d7543100" status: 200 len: 1263 microversion: 2.1 time: 0.229494 Aug 31 16:49:39.997043 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3463/6944] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:49:39 2022] GET /compute/v2.1/servers/4987acd8-f1a1-4fb1-ac82-b426d7543100 => generated 1263 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:49:40.568533 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d57e59c8-1979-4000-a178-dfc604e09c95 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:49:40.569260 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d57e59c8-1979-4000-a178-dfc604e09c95 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 81e9db46-4167-48f7-900f-9d65fdfc72b7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:49:40.576216 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d57e59c8-1979-4000-a178-dfc604e09c95 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:40.576720 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d57e59c8-1979-4000-a178-dfc604e09c95 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:40.577207 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d57e59c8-1979-4000-a178-dfc604e09c95 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:40.577947 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d57e59c8-1979-4000-a178-dfc604e09c95 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:40.578429 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d57e59c8-1979-4000-a178-dfc604e09c95 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:40.578873 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d57e59c8-1979-4000-a178-dfc604e09c95 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:40.722682 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d57e59c8-1979-4000-a178-dfc604e09c95 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:49:40.732015 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d57e59c8-1979-4000-a178-dfc604e09c95 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7" status: 200 len: 1689 microversion: 2.1 time: 0.167681 Aug 31 16:49:40.732604 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3482/6945] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:49:40 2022] GET /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7 => generated 1689 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:49:41.018378 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-478eb8e8-f34b-47ab-9400-28f0c4b9dc69 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:49:41.019002 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-478eb8e8-f34b-47ab-9400-28f0c4b9dc69 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 4987acd8-f1a1-4fb1-ac82-b426d7543100] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:49:41.026351 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-478eb8e8-f34b-47ab-9400-28f0c4b9dc69 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:41.026853 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-478eb8e8-f34b-47ab-9400-28f0c4b9dc69 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:41.027297 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-478eb8e8-f34b-47ab-9400-28f0c4b9dc69 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:41.028037 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-478eb8e8-f34b-47ab-9400-28f0c4b9dc69 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:41.028503 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-478eb8e8-f34b-47ab-9400-28f0c4b9dc69 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:41.028935 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-478eb8e8-f34b-47ab-9400-28f0c4b9dc69 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:41.168423 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-478eb8e8-f34b-47ab-9400-28f0c4b9dc69 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:49:41.176321 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-478eb8e8-f34b-47ab-9400-28f0c4b9dc69 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/4987acd8-f1a1-4fb1-ac82-b426d7543100" status: 200 len: 1263 microversion: 2.1 time: 0.161928 Aug 31 16:49:41.176907 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3464/6946] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:49:41 2022] GET /compute/v2.1/servers/4987acd8-f1a1-4fb1-ac82-b426d7543100 => generated 1263 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:49:41.755393 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-43fb2f4e-606d-44bd-b3ee-111d7832473f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:49:41.756731 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-43fb2f4e-606d-44bd-b3ee-111d7832473f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 81e9db46-4167-48f7-900f-9d65fdfc72b7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:49:41.763759 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-43fb2f4e-606d-44bd-b3ee-111d7832473f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:41.764258 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-43fb2f4e-606d-44bd-b3ee-111d7832473f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:41.764707 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-43fb2f4e-606d-44bd-b3ee-111d7832473f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:41.765645 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-43fb2f4e-606d-44bd-b3ee-111d7832473f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:41.766117 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-43fb2f4e-606d-44bd-b3ee-111d7832473f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:41.766554 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-43fb2f4e-606d-44bd-b3ee-111d7832473f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:41.916141 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-43fb2f4e-606d-44bd-b3ee-111d7832473f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:49:41.924194 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-43fb2f4e-606d-44bd-b3ee-111d7832473f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7" status: 200 len: 1689 microversion: 2.1 time: 0.173737 Aug 31 16:49:41.924792 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3483/6947] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:49:41 2022] GET /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7 => generated 1689 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:49:42.198281 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7c38a643-7787-4b20-9a99-98d20c87957a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:49:42.198901 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7c38a643-7787-4b20-9a99-98d20c87957a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 4987acd8-f1a1-4fb1-ac82-b426d7543100] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:49:42.205942 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7c38a643-7787-4b20-9a99-98d20c87957a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:42.206438 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7c38a643-7787-4b20-9a99-98d20c87957a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:42.206884 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7c38a643-7787-4b20-9a99-98d20c87957a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:42.207632 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7c38a643-7787-4b20-9a99-98d20c87957a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:42.208095 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7c38a643-7787-4b20-9a99-98d20c87957a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:42.208531 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7c38a643-7787-4b20-9a99-98d20c87957a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:42.375064 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7c38a643-7787-4b20-9a99-98d20c87957a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:49:42.385316 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7c38a643-7787-4b20-9a99-98d20c87957a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/4987acd8-f1a1-4fb1-ac82-b426d7543100" status: 200 len: 1263 microversion: 2.1 time: 0.191955 Aug 31 16:49:42.385909 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3465/6948] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:49:42 2022] GET /compute/v2.1/servers/4987acd8-f1a1-4fb1-ac82-b426d7543100 => generated 1263 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:49:42.472224 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-cdfebc4b-ea02-403a-a151-e1e125f0d2fc req-d92eb4dd-5bb6-4592-8241-a15462e84605 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81e9db46-4167-48f7-900f-9d65fdfc72b7", "name": "network-vif-plugged", "status": "completed", "tag": "a574579c-df0c-467a-bdb8-ee3e7daa36e5"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:49:42.482763 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-cdfebc4b-ea02-403a-a151-e1e125f0d2fc req-d92eb4dd-5bb6-4592-8241-a15462e84605 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:42.483261 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-cdfebc4b-ea02-403a-a151-e1e125f0d2fc req-d92eb4dd-5bb6-4592-8241-a15462e84605 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:42.483743 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-cdfebc4b-ea02-403a-a151-e1e125f0d2fc req-d92eb4dd-5bb6-4592-8241-a15462e84605 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:42.496829 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-cdfebc4b-ea02-403a-a151-e1e125f0d2fc req-d92eb4dd-5bb6-4592-8241-a15462e84605 service nova] Creating event network-vif-plugged:a574579c-df0c-467a-bdb8-ee3e7daa36e5 for instance 81e9db46-4167-48f7-900f-9d65fdfc72b7 on n-h1-850499-9 Aug 31 16:49:42.502259 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [req-cdfebc4b-ea02-403a-a151-e1e125f0d2fc req-d92eb4dd-5bb6-4592-8241-a15462e84605 service nova] Instance 81e9db46-4167-48f7-900f-9d65fdfc72b7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850499-9', 'n-h2-850499-9'} {{(pid=122257) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 31 16:49:42.513534 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-cdfebc4b-ea02-403a-a151-e1e125f0d2fc req-d92eb4dd-5bb6-4592-8241-a15462e84605 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127401 Aug 31 16:49:42.514136 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3484/6949] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:49:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:49:42.946204 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d500d11e-c8be-416c-96ab-395194b7535c tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:49:42.946818 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d500d11e-c8be-416c-96ab-395194b7535c tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 81e9db46-4167-48f7-900f-9d65fdfc72b7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:49:42.953164 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d500d11e-c8be-416c-96ab-395194b7535c tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:42.953659 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d500d11e-c8be-416c-96ab-395194b7535c tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:42.954097 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d500d11e-c8be-416c-96ab-395194b7535c tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:42.954797 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d500d11e-c8be-416c-96ab-395194b7535c tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:42.955255 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d500d11e-c8be-416c-96ab-395194b7535c tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:42.955710 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d500d11e-c8be-416c-96ab-395194b7535c tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:43.173454 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d500d11e-c8be-416c-96ab-395194b7535c tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:49:43.181553 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d500d11e-c8be-416c-96ab-395194b7535c tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7" status: 200 len: 1689 microversion: 2.1 time: 0.239331 Aug 31 16:49:43.182143 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3466/6950] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:49:42 2022] GET /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7 => generated 1689 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:49:43.408462 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6f9e2eeb-fddc-41d8-b978-4e6cbf84ffe8 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:49:43.409959 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6f9e2eeb-fddc-41d8-b978-4e6cbf84ffe8 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 4987acd8-f1a1-4fb1-ac82-b426d7543100] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:49:43.418470 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6f9e2eeb-fddc-41d8-b978-4e6cbf84ffe8 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:43.418984 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6f9e2eeb-fddc-41d8-b978-4e6cbf84ffe8 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:43.419685 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6f9e2eeb-fddc-41d8-b978-4e6cbf84ffe8 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:43.420584 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6f9e2eeb-fddc-41d8-b978-4e6cbf84ffe8 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:43.421216 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6f9e2eeb-fddc-41d8-b978-4e6cbf84ffe8 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:43.421830 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6f9e2eeb-fddc-41d8-b978-4e6cbf84ffe8 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:43.541043 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-64936d87-543d-46e3-9b20-25b312da1402 req-8d977ea6-72da-41a9-8b18-339018103b8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81e9db46-4167-48f7-900f-9d65fdfc72b7", "name": "network-vif-unplugged", "status": "completed", "tag": "a574579c-df0c-467a-bdb8-ee3e7daa36e5"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:49:43.559640 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-64936d87-543d-46e3-9b20-25b312da1402 req-8d977ea6-72da-41a9-8b18-339018103b8c service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:43.560300 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-64936d87-543d-46e3-9b20-25b312da1402 req-8d977ea6-72da-41a9-8b18-339018103b8c service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:43.560718 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-64936d87-543d-46e3-9b20-25b312da1402 req-8d977ea6-72da-41a9-8b18-339018103b8c service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:43.581645 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-64936d87-543d-46e3-9b20-25b312da1402 req-8d977ea6-72da-41a9-8b18-339018103b8c service nova] Creating event network-vif-unplugged:a574579c-df0c-467a-bdb8-ee3e7daa36e5 for instance 81e9db46-4167-48f7-900f-9d65fdfc72b7 on n-h2-850499-9 Aug 31 16:49:43.588116 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [req-64936d87-543d-46e3-9b20-25b312da1402 req-8d977ea6-72da-41a9-8b18-339018103b8c service nova] Instance 81e9db46-4167-48f7-900f-9d65fdfc72b7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850499-9', 'n-h1-850499-9'} {{(pid=122256) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 31 16:49:43.598935 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-64936d87-543d-46e3-9b20-25b312da1402 req-8d977ea6-72da-41a9-8b18-339018103b8c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062245 Aug 31 16:49:43.599569 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3467/6951] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:49:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:49:43.694126 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-6f9e2eeb-fddc-41d8-b978-4e6cbf84ffe8 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:49:43.702167 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6f9e2eeb-fddc-41d8-b978-4e6cbf84ffe8 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/4987acd8-f1a1-4fb1-ac82-b426d7543100" status: 200 len: 1263 microversion: 2.1 time: 0.298664 Aug 31 16:49:43.703126 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3485/6952] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:49:43 2022] GET /compute/v2.1/servers/4987acd8-f1a1-4fb1-ac82-b426d7543100 => generated 1263 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:49:44.203934 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9c2a5870-9a5f-4db0-96f9-37ab554b5b98 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:49:44.205005 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9c2a5870-9a5f-4db0-96f9-37ab554b5b98 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 81e9db46-4167-48f7-900f-9d65fdfc72b7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:49:44.212083 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9c2a5870-9a5f-4db0-96f9-37ab554b5b98 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:44.212590 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9c2a5870-9a5f-4db0-96f9-37ab554b5b98 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:44.213038 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9c2a5870-9a5f-4db0-96f9-37ab554b5b98 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:44.213753 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9c2a5870-9a5f-4db0-96f9-37ab554b5b98 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:44.214221 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9c2a5870-9a5f-4db0-96f9-37ab554b5b98 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:44.214781 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9c2a5870-9a5f-4db0-96f9-37ab554b5b98 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:44.447180 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-9c2a5870-9a5f-4db0-96f9-37ab554b5b98 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:49:44.455853 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9c2a5870-9a5f-4db0-96f9-37ab554b5b98 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7" status: 200 len: 1689 microversion: 2.1 time: 0.256329 Aug 31 16:49:44.456515 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3468/6953] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:49:44 2022] GET /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7 => generated 1689 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:49:44.724000 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8f64ea64-0148-431e-9571-da720dc28676 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:49:44.724700 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8f64ea64-0148-431e-9571-da720dc28676 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 4987acd8-f1a1-4fb1-ac82-b426d7543100] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:49:44.731683 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8f64ea64-0148-431e-9571-da720dc28676 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:44.732193 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8f64ea64-0148-431e-9571-da720dc28676 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:44.732649 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8f64ea64-0148-431e-9571-da720dc28676 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:44.733365 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8f64ea64-0148-431e-9571-da720dc28676 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:44.733843 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8f64ea64-0148-431e-9571-da720dc28676 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:44.734286 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8f64ea64-0148-431e-9571-da720dc28676 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:44.944074 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8f64ea64-0148-431e-9571-da720dc28676 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:49:44.951971 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8f64ea64-0148-431e-9571-da720dc28676 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/4987acd8-f1a1-4fb1-ac82-b426d7543100" status: 200 len: 1263 microversion: 2.1 time: 0.231835 Aug 31 16:49:44.952876 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3486/6954] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:49:44 2022] GET /compute/v2.1/servers/4987acd8-f1a1-4fb1-ac82-b426d7543100 => generated 1263 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:49:45.449285 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-739a3b63-c7b5-478c-a01f-d4e0f3d64570 req-10f616dc-be0f-4105-869f-6e8d5b3248cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4987acd8-f1a1-4fb1-ac82-b426d7543100", "name": "network-vif-plugged", "status": "completed", "tag": "2b784555-0e5f-4057-8c53-bf90f27149bf"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:49:45.460315 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-739a3b63-c7b5-478c-a01f-d4e0f3d64570 req-10f616dc-be0f-4105-869f-6e8d5b3248cb service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:45.460835 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-739a3b63-c7b5-478c-a01f-d4e0f3d64570 req-10f616dc-be0f-4105-869f-6e8d5b3248cb service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:45.461302 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-739a3b63-c7b5-478c-a01f-d4e0f3d64570 req-10f616dc-be0f-4105-869f-6e8d5b3248cb service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:45.473081 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-739a3b63-c7b5-478c-a01f-d4e0f3d64570 req-10f616dc-be0f-4105-869f-6e8d5b3248cb service nova] Creating event network-vif-plugged:2b784555-0e5f-4057-8c53-bf90f27149bf for instance 4987acd8-f1a1-4fb1-ac82-b426d7543100 on n-h2-850499-9 Aug 31 16:49:45.478682 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-739a3b63-c7b5-478c-a01f-d4e0f3d64570 req-10f616dc-be0f-4105-869f-6e8d5b3248cb service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033340 Aug 31 16:49:45.479436 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3469/6955] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:49:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:49:45.479629 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d19654be-cca3-4368-95b8-9213fa5cefd0 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:49:45.480279 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d19654be-cca3-4368-95b8-9213fa5cefd0 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 81e9db46-4167-48f7-900f-9d65fdfc72b7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:49:45.486948 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d19654be-cca3-4368-95b8-9213fa5cefd0 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:45.487460 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d19654be-cca3-4368-95b8-9213fa5cefd0 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:45.487964 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d19654be-cca3-4368-95b8-9213fa5cefd0 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:45.488694 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d19654be-cca3-4368-95b8-9213fa5cefd0 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:45.489179 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d19654be-cca3-4368-95b8-9213fa5cefd0 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:45.489628 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d19654be-cca3-4368-95b8-9213fa5cefd0 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:45.618609 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-2d7e3278-e698-4ceb-8e54-23b354fce755 req-57bf5fc3-5436-4215-85ab-005a0b47ef48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81e9db46-4167-48f7-900f-9d65fdfc72b7", "tag": "a574579c-df0c-467a-bdb8-ee3e7daa36e5"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:49:45.623568 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=3 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:49:45.629961 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d19654be-cca3-4368-95b8-9213fa5cefd0 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:49:45.630366 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-2d7e3278-e698-4ceb-8e54-23b354fce755 req-57bf5fc3-5436-4215-85ab-005a0b47ef48 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:45.630985 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-2d7e3278-e698-4ceb-8e54-23b354fce755 req-57bf5fc3-5436-4215-85ab-005a0b47ef48 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:45.632081 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-2d7e3278-e698-4ceb-8e54-23b354fce755 req-57bf5fc3-5436-4215-85ab-005a0b47ef48 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:45.640275 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d19654be-cca3-4368-95b8-9213fa5cefd0 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7" status: 200 len: 1689 microversion: 2.1 time: 0.165941 Aug 31 16:49:45.641010 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3487/6956] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:49:45 2022] GET /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7 => generated 1689 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:49:45.644033 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-2d7e3278-e698-4ceb-8e54-23b354fce755 req-57bf5fc3-5436-4215-85ab-005a0b47ef48 service nova] Creating event network-changed:a574579c-df0c-467a-bdb8-ee3e7daa36e5 for instance 81e9db46-4167-48f7-900f-9d65fdfc72b7 on n-h2-850499-9 Aug 31 16:49:45.650102 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [req-2d7e3278-e698-4ceb-8e54-23b354fce755 req-57bf5fc3-5436-4215-85ab-005a0b47ef48 service nova] Instance 81e9db46-4167-48f7-900f-9d65fdfc72b7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850499-9', 'n-h1-850499-9'} {{(pid=122256) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 31 16:49:45.660522 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-2d7e3278-e698-4ceb-8e54-23b354fce755 req-57bf5fc3-5436-4215-85ab-005a0b47ef48 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047241 Aug 31 16:49:45.661123 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3470/6957] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:49:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:49:45.973772 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-47b65e86-6214-48cd-84d8-8ce01d11be4f tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:49:45.975143 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-47b65e86-6214-48cd-84d8-8ce01d11be4f tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 4987acd8-f1a1-4fb1-ac82-b426d7543100] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:49:45.978068 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:49:45.983455 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-47b65e86-6214-48cd-84d8-8ce01d11be4f tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:45.984024 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-47b65e86-6214-48cd-84d8-8ce01d11be4f tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:45.984476 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-47b65e86-6214-48cd-84d8-8ce01d11be4f tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:45.985187 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-47b65e86-6214-48cd-84d8-8ce01d11be4f tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:45.985657 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-47b65e86-6214-48cd-84d8-8ce01d11be4f tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:45.986096 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-47b65e86-6214-48cd-84d8-8ce01d11be4f tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:46.205574 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-47b65e86-6214-48cd-84d8-8ce01d11be4f tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:49:46.213968 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-47b65e86-6214-48cd-84d8-8ce01d11be4f tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/4987acd8-f1a1-4fb1-ac82-b426d7543100" status: 200 len: 1263 microversion: 2.1 time: 0.244199 Aug 31 16:49:46.214564 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3488/6958] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:49:45 2022] GET /compute/v2.1/servers/4987acd8-f1a1-4fb1-ac82-b426d7543100 => generated 1263 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:49:46.663951 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-fc4b304e-644f-4bed-a425-3fe31a9aa324 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:49:46.664662 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-fc4b304e-644f-4bed-a425-3fe31a9aa324 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 81e9db46-4167-48f7-900f-9d65fdfc72b7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:49:46.670908 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fc4b304e-644f-4bed-a425-3fe31a9aa324 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:46.671405 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fc4b304e-644f-4bed-a425-3fe31a9aa324 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:46.671882 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fc4b304e-644f-4bed-a425-3fe31a9aa324 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:46.672591 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fc4b304e-644f-4bed-a425-3fe31a9aa324 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:46.673058 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fc4b304e-644f-4bed-a425-3fe31a9aa324 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:46.673493 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fc4b304e-644f-4bed-a425-3fe31a9aa324 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:46.809115 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-fc4b304e-644f-4bed-a425-3fe31a9aa324 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:49:46.818413 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-fc4b304e-644f-4bed-a425-3fe31a9aa324 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7" status: 200 len: 1689 microversion: 2.1 time: 0.159367 Aug 31 16:49:46.819481 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3471/6959] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:49:46 2022] GET /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7 => generated 1689 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:49:47.236091 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-dd803ecc-d97d-49d8-8e55-7c650e2145b3 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:49:47.236719 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-dd803ecc-d97d-49d8-8e55-7c650e2145b3 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 4987acd8-f1a1-4fb1-ac82-b426d7543100] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:49:47.243684 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dd803ecc-d97d-49d8-8e55-7c650e2145b3 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:47.244202 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dd803ecc-d97d-49d8-8e55-7c650e2145b3 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:47.244698 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dd803ecc-d97d-49d8-8e55-7c650e2145b3 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:47.245442 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dd803ecc-d97d-49d8-8e55-7c650e2145b3 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:47.245994 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dd803ecc-d97d-49d8-8e55-7c650e2145b3 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:47.246448 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dd803ecc-d97d-49d8-8e55-7c650e2145b3 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:47.386503 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-dd803ecc-d97d-49d8-8e55-7c650e2145b3 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:49:47.391053 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=100 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:49:47.397677 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-dd803ecc-d97d-49d8-8e55-7c650e2145b3 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/4987acd8-f1a1-4fb1-ac82-b426d7543100" status: 200 len: 1263 microversion: 2.1 time: 0.165791 Aug 31 16:49:47.398264 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3489/6960] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:49:47 2022] GET /compute/v2.1/servers/4987acd8-f1a1-4fb1-ac82-b426d7543100 => generated 1263 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:49:47.843722 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a7a38812-ba13-4e4b-9e79-c5470c7797ee tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:49:47.844344 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a7a38812-ba13-4e4b-9e79-c5470c7797ee tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 81e9db46-4167-48f7-900f-9d65fdfc72b7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:49:47.858096 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a7a38812-ba13-4e4b-9e79-c5470c7797ee tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:47.858610 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a7a38812-ba13-4e4b-9e79-c5470c7797ee tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:47.859056 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a7a38812-ba13-4e4b-9e79-c5470c7797ee tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:47.859809 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a7a38812-ba13-4e4b-9e79-c5470c7797ee tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:47.860944 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a7a38812-ba13-4e4b-9e79-c5470c7797ee tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:47.860944 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a7a38812-ba13-4e4b-9e79-c5470c7797ee tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:47.881562 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:49:48.116025 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a7a38812-ba13-4e4b-9e79-c5470c7797ee tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:49:48.124278 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a7a38812-ba13-4e4b-9e79-c5470c7797ee tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7" status: 200 len: 1689 microversion: 2.1 time: 0.284525 Aug 31 16:49:48.124861 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3472/6961] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:49:47 2022] GET /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7 => generated 1689 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:49:48.418942 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a6122b96-181a-4fb7-88a0-0647d284ecc0 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:49:48.419514 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a6122b96-181a-4fb7-88a0-0647d284ecc0 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 4987acd8-f1a1-4fb1-ac82-b426d7543100] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:49:48.426637 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a6122b96-181a-4fb7-88a0-0647d284ecc0 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:48.427143 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a6122b96-181a-4fb7-88a0-0647d284ecc0 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:48.428306 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a6122b96-181a-4fb7-88a0-0647d284ecc0 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:48.429050 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a6122b96-181a-4fb7-88a0-0647d284ecc0 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:48.429536 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a6122b96-181a-4fb7-88a0-0647d284ecc0 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:48.430041 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a6122b96-181a-4fb7-88a0-0647d284ecc0 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:48.567252 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a6122b96-181a-4fb7-88a0-0647d284ecc0 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:49:48.575732 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a6122b96-181a-4fb7-88a0-0647d284ecc0 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/4987acd8-f1a1-4fb1-ac82-b426d7543100" status: 200 len: 1263 microversion: 2.1 time: 0.160868 Aug 31 16:49:48.576325 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3490/6962] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:49:48 2022] GET /compute/v2.1/servers/4987acd8-f1a1-4fb1-ac82-b426d7543100 => generated 1263 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:49:49.147079 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a9d123b6-5db3-4d6a-9edf-9d0f4aa490f0 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:49:49.147739 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a9d123b6-5db3-4d6a-9edf-9d0f4aa490f0 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 81e9db46-4167-48f7-900f-9d65fdfc72b7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:49:49.153786 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a9d123b6-5db3-4d6a-9edf-9d0f4aa490f0 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:49.154288 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a9d123b6-5db3-4d6a-9edf-9d0f4aa490f0 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:49.154737 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a9d123b6-5db3-4d6a-9edf-9d0f4aa490f0 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:49.155451 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a9d123b6-5db3-4d6a-9edf-9d0f4aa490f0 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:49.155971 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a9d123b6-5db3-4d6a-9edf-9d0f4aa490f0 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:49.156409 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a9d123b6-5db3-4d6a-9edf-9d0f4aa490f0 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:49.314153 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a9d123b6-5db3-4d6a-9edf-9d0f4aa490f0 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:49:49.322492 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a9d123b6-5db3-4d6a-9edf-9d0f4aa490f0 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7" status: 200 len: 1682 microversion: 2.1 time: 0.180384 Aug 31 16:49:49.323050 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3473/6963] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:49:49 2022] GET /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7 => generated 1682 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:49:49.598034 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-30387770-1f43-43bc-a116-939b7350b326 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:49:49.599065 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-30387770-1f43-43bc-a116-939b7350b326 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 4987acd8-f1a1-4fb1-ac82-b426d7543100] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:49:49.606407 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-30387770-1f43-43bc-a116-939b7350b326 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:49.606917 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-30387770-1f43-43bc-a116-939b7350b326 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:49.607378 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-30387770-1f43-43bc-a116-939b7350b326 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:49.608136 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-30387770-1f43-43bc-a116-939b7350b326 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:49.608652 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-30387770-1f43-43bc-a116-939b7350b326 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:49.609102 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-30387770-1f43-43bc-a116-939b7350b326 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:49.756307 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-30387770-1f43-43bc-a116-939b7350b326 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:49:49.764168 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-30387770-1f43-43bc-a116-939b7350b326 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/4987acd8-f1a1-4fb1-ac82-b426d7543100" status: 200 len: 1263 microversion: 2.1 time: 0.170084 Aug 31 16:49:49.764755 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3491/6964] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:49:49 2022] GET /compute/v2.1/servers/4987acd8-f1a1-4fb1-ac82-b426d7543100 => generated 1263 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:49:50.785737 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4f2551da-4fad-4ed5-ae31-0bd61706b86a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:49:50.786374 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4f2551da-4fad-4ed5-ae31-0bd61706b86a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 4987acd8-f1a1-4fb1-ac82-b426d7543100] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:49:50.794513 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4f2551da-4fad-4ed5-ae31-0bd61706b86a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:50.795154 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4f2551da-4fad-4ed5-ae31-0bd61706b86a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:50.795692 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4f2551da-4fad-4ed5-ae31-0bd61706b86a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:50.796406 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4f2551da-4fad-4ed5-ae31-0bd61706b86a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:50.796986 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4f2551da-4fad-4ed5-ae31-0bd61706b86a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:50.797556 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4f2551da-4fad-4ed5-ae31-0bd61706b86a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:50.936588 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-4f2551da-4fad-4ed5-ae31-0bd61706b86a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:49:50.944792 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4f2551da-4fad-4ed5-ae31-0bd61706b86a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/4987acd8-f1a1-4fb1-ac82-b426d7543100" status: 200 len: 1451 microversion: 2.1 time: 0.162986 Aug 31 16:49:50.945364 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3474/6965] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:49:50 2022] GET /compute/v2.1/servers/4987acd8-f1a1-4fb1-ac82-b426d7543100 => generated 1451 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:49:50.966360 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ac6f0f02-fc30-4249-972c-ab51a242bc24 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:49:50.966983 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ac6f0f02-fc30-4249-972c-ab51a242bc24 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 4987acd8-f1a1-4fb1-ac82-b426d7543100] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:49:50.974051 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ac6f0f02-fc30-4249-972c-ab51a242bc24 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:50.975259 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ac6f0f02-fc30-4249-972c-ab51a242bc24 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:50.975822 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ac6f0f02-fc30-4249-972c-ab51a242bc24 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:50.976536 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ac6f0f02-fc30-4249-972c-ab51a242bc24 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:50.977014 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ac6f0f02-fc30-4249-972c-ab51a242bc24 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:50.977453 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ac6f0f02-fc30-4249-972c-ab51a242bc24 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:51.112800 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ac6f0f02-fc30-4249-972c-ab51a242bc24 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:49:51.121585 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ac6f0f02-fc30-4249-972c-ab51a242bc24 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/4987acd8-f1a1-4fb1-ac82-b426d7543100" status: 200 len: 1451 microversion: 2.1 time: 0.159077 Aug 31 16:49:51.122163 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3492/6966] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:49:50 2022] GET /compute/v2.1/servers/4987acd8-f1a1-4fb1-ac82-b426d7543100 => generated 1451 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:49:51.485677 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-fde0bd62-ad17-4737-ae73-81d2ae010d88 req-df495afe-65cb-408c-92d7-c5d9caa8eed1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81e9db46-4167-48f7-900f-9d65fdfc72b7", "name": "network-vif-plugged", "status": "completed", "tag": "a574579c-df0c-467a-bdb8-ee3e7daa36e5"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:49:51.497895 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-fde0bd62-ad17-4737-ae73-81d2ae010d88 req-df495afe-65cb-408c-92d7-c5d9caa8eed1 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:51.498417 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-fde0bd62-ad17-4737-ae73-81d2ae010d88 req-df495afe-65cb-408c-92d7-c5d9caa8eed1 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:51.498868 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-fde0bd62-ad17-4737-ae73-81d2ae010d88 req-df495afe-65cb-408c-92d7-c5d9caa8eed1 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:51.513266 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-fde0bd62-ad17-4737-ae73-81d2ae010d88 req-df495afe-65cb-408c-92d7-c5d9caa8eed1 service nova] Creating event network-vif-plugged:a574579c-df0c-467a-bdb8-ee3e7daa36e5 for instance 81e9db46-4167-48f7-900f-9d65fdfc72b7 on n-h2-850499-9 Aug 31 16:49:51.518498 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-fde0bd62-ad17-4737-ae73-81d2ae010d88 req-df495afe-65cb-408c-92d7-c5d9caa8eed1 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036488 Aug 31 16:49:51.519466 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3475/6967] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:49:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:49:52.810612 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-23002c90-0be6-46d3-b6e2-ccc2bc1efede req-f3718900-e700-409d-860e-b21f0adcc33c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4987acd8-f1a1-4fb1-ac82-b426d7543100", "tag": "2b784555-0e5f-4057-8c53-bf90f27149bf"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:49:52.822049 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-23002c90-0be6-46d3-b6e2-ccc2bc1efede req-f3718900-e700-409d-860e-b21f0adcc33c service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:52.822556 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-23002c90-0be6-46d3-b6e2-ccc2bc1efede req-f3718900-e700-409d-860e-b21f0adcc33c service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:52.823003 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-23002c90-0be6-46d3-b6e2-ccc2bc1efede req-f3718900-e700-409d-860e-b21f0adcc33c service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:52.834731 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-23002c90-0be6-46d3-b6e2-ccc2bc1efede req-f3718900-e700-409d-860e-b21f0adcc33c service nova] Creating event network-changed:2b784555-0e5f-4057-8c53-bf90f27149bf for instance 4987acd8-f1a1-4fb1-ac82-b426d7543100 on n-h2-850499-9 Aug 31 16:49:52.841025 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-23002c90-0be6-46d3-b6e2-ccc2bc1efede req-f3718900-e700-409d-860e-b21f0adcc33c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034042 Aug 31 16:49:52.841635 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3493/6968] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:49:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:50:25.579066 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=11 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:50:25.579924 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=17 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:50:25.584956 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3970c7e7-6d53-4db7-ba24-42b41b6449df tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:50:25.587229 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3970c7e7-6d53-4db7-ba24-42b41b6449df tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 81e9db46-4167-48f7-900f-9d65fdfc72b7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:50:25.594192 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3970c7e7-6d53-4db7-ba24-42b41b6449df tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:50:25.594675 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3970c7e7-6d53-4db7-ba24-42b41b6449df tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:50:25.595112 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3970c7e7-6d53-4db7-ba24-42b41b6449df tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:50:25.595833 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3970c7e7-6d53-4db7-ba24-42b41b6449df tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:50:25.596291 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3970c7e7-6d53-4db7-ba24-42b41b6449df tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:50:25.596717 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3970c7e7-6d53-4db7-ba24-42b41b6449df tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:50:25.673438 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3970c7e7-6d53-4db7-ba24-42b41b6449df tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "POST /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7/action" status: 200 len: 63151 microversion: 2.1 time: 0.096359 Aug 31 16:50:25.674143 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3476/6969] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:50:25 2022] POST /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7/action => generated 63151 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 16:50:48.401988 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e8c83211-06d2-4b7e-8182-47d0d56746ee tempest-TestNetworkAdvancedServerOps-354410215 tempest-TestNetworkAdvancedServerOps-354410215-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:50:48.402714 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e8c83211-06d2-4b7e-8182-47d0d56746ee tempest-TestNetworkAdvancedServerOps-354410215 tempest-TestNetworkAdvancedServerOps-354410215-project-admin] [instance: 81e9db46-4167-48f7-900f-9d65fdfc72b7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:50:48.405164 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=11 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:50:48.405861 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=20 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:50:48.412932 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e8c83211-06d2-4b7e-8182-47d0d56746ee tempest-TestNetworkAdvancedServerOps-354410215 tempest-TestNetworkAdvancedServerOps-354410215-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:50:48.413445 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e8c83211-06d2-4b7e-8182-47d0d56746ee tempest-TestNetworkAdvancedServerOps-354410215 tempest-TestNetworkAdvancedServerOps-354410215-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:50:48.413906 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e8c83211-06d2-4b7e-8182-47d0d56746ee tempest-TestNetworkAdvancedServerOps-354410215 tempest-TestNetworkAdvancedServerOps-354410215-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:50:48.414628 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e8c83211-06d2-4b7e-8182-47d0d56746ee tempest-TestNetworkAdvancedServerOps-354410215 tempest-TestNetworkAdvancedServerOps-354410215-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:50:48.415109 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e8c83211-06d2-4b7e-8182-47d0d56746ee tempest-TestNetworkAdvancedServerOps-354410215 tempest-TestNetworkAdvancedServerOps-354410215-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:50:48.415587 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e8c83211-06d2-4b7e-8182-47d0d56746ee tempest-TestNetworkAdvancedServerOps-354410215 tempest-TestNetworkAdvancedServerOps-354410215-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:50:48.551342 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e8c83211-06d2-4b7e-8182-47d0d56746ee tempest-TestNetworkAdvancedServerOps-354410215 tempest-TestNetworkAdvancedServerOps-354410215-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7" status: 200 len: 1833 microversion: 2.1 time: 0.153867 Aug 31 16:50:48.552506 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3494/6970] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:50:48 2022] GET /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7 => generated 1833 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:50:49.418584 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-043e576e-ec95-40ac-a29f-922ac07fd81b tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:50:49.419215 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-043e576e-ec95-40ac-a29f-922ac07fd81b tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 81e9db46-4167-48f7-900f-9d65fdfc72b7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:50:49.423339 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:50:49.424045 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=4 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:50:49.429665 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-043e576e-ec95-40ac-a29f-922ac07fd81b tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:50:49.430167 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-043e576e-ec95-40ac-a29f-922ac07fd81b tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:50:49.430706 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-043e576e-ec95-40ac-a29f-922ac07fd81b tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:50:49.431602 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-043e576e-ec95-40ac-a29f-922ac07fd81b tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:50:49.432076 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-043e576e-ec95-40ac-a29f-922ac07fd81b tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:50:49.432516 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-043e576e-ec95-40ac-a29f-922ac07fd81b tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:50:49.462056 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-043e576e-ec95-40ac-a29f-922ac07fd81b tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 81e9db46-4167-48f7-900f-9d65fdfc72b7] Going to try to terminate instance {{(pid=122256) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:50:49.513974 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-ae5b3cb3-361b-4fb9-9c12-ca19be0df3c5 req-b5ea45e2-6bfb-4fa1-b429-9e0d4cce5d07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81e9db46-4167-48f7-900f-9d65fdfc72b7", "tag": "a574579c-df0c-467a-bdb8-ee3e7daa36e5"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:50:49.530965 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-ae5b3cb3-361b-4fb9-9c12-ca19be0df3c5 req-b5ea45e2-6bfb-4fa1-b429-9e0d4cce5d07 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:50:49.531949 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-ae5b3cb3-361b-4fb9-9c12-ca19be0df3c5 req-b5ea45e2-6bfb-4fa1-b429-9e0d4cce5d07 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:50:49.532395 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-ae5b3cb3-361b-4fb9-9c12-ca19be0df3c5 req-b5ea45e2-6bfb-4fa1-b429-9e0d4cce5d07 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:50:49.547819 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-ae5b3cb3-361b-4fb9-9c12-ca19be0df3c5 req-b5ea45e2-6bfb-4fa1-b429-9e0d4cce5d07 service nova] Creating event network-changed:a574579c-df0c-467a-bdb8-ee3e7daa36e5 for instance 81e9db46-4167-48f7-900f-9d65fdfc72b7 on n-h2-850499-9 Aug 31 16:50:49.550101 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-043e576e-ec95-40ac-a29f-922ac07fd81b tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "DELETE /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7" status: 204 len: 0 microversion: 2.1 time: 0.135711 Aug 31 16:50:49.550803 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3477/6971] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:50:49 2022] DELETE /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:50:49.556397 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-ae5b3cb3-361b-4fb9-9c12-ca19be0df3c5 req-b5ea45e2-6bfb-4fa1-b429-9e0d4cce5d07 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139331 Aug 31 16:50:49.558423 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3495/6972] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:50:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:50:49.560594 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b2abb5e9-4d9b-44d1-9c96-1f372c037a78 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:50:49.561314 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b2abb5e9-4d9b-44d1-9c96-1f372c037a78 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 81e9db46-4167-48f7-900f-9d65fdfc72b7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:50:49.567840 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b2abb5e9-4d9b-44d1-9c96-1f372c037a78 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:50:49.568340 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b2abb5e9-4d9b-44d1-9c96-1f372c037a78 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:50:49.568786 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b2abb5e9-4d9b-44d1-9c96-1f372c037a78 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:50:49.569499 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b2abb5e9-4d9b-44d1-9c96-1f372c037a78 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:50:49.569964 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b2abb5e9-4d9b-44d1-9c96-1f372c037a78 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:50:49.570406 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b2abb5e9-4d9b-44d1-9c96-1f372c037a78 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:50:49.710087 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b2abb5e9-4d9b-44d1-9c96-1f372c037a78 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:50:49.718032 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b2abb5e9-4d9b-44d1-9c96-1f372c037a78 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7" status: 200 len: 1688 microversion: 2.1 time: 0.162384 Aug 31 16:50:49.718621 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3478/6973] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:50:49 2022] GET /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7 => generated 1688 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:50:50.741441 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ace2702b-5bb2-47ad-8fd2-1c7268604eed tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:50:50.742131 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ace2702b-5bb2-47ad-8fd2-1c7268604eed tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 81e9db46-4167-48f7-900f-9d65fdfc72b7] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:50:50.749521 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ace2702b-5bb2-47ad-8fd2-1c7268604eed tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:50:50.750029 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ace2702b-5bb2-47ad-8fd2-1c7268604eed tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:50:50.750491 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ace2702b-5bb2-47ad-8fd2-1c7268604eed tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:50:50.751263 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ace2702b-5bb2-47ad-8fd2-1c7268604eed tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:50:50.751771 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ace2702b-5bb2-47ad-8fd2-1c7268604eed tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:50:50.752223 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ace2702b-5bb2-47ad-8fd2-1c7268604eed tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:50:50.925802 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ace2702b-5bb2-47ad-8fd2-1c7268604eed tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:50:50.934545 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ace2702b-5bb2-47ad-8fd2-1c7268604eed tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7" status: 200 len: 1688 microversion: 2.1 time: 0.198144 Aug 31 16:50:50.935157 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3496/6974] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:50:50 2022] GET /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7 => generated 1688 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:50:51.956764 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c25383a4-5f37-4c52-aeb0-3fb8363f10da tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:50:51.957884 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c25383a4-5f37-4c52-aeb0-3fb8363f10da tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 81e9db46-4167-48f7-900f-9d65fdfc72b7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:50:51.964968 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c25383a4-5f37-4c52-aeb0-3fb8363f10da tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:50:51.965397 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c25383a4-5f37-4c52-aeb0-3fb8363f10da tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:50:51.965842 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c25383a4-5f37-4c52-aeb0-3fb8363f10da tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:50:51.966556 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c25383a4-5f37-4c52-aeb0-3fb8363f10da tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:50:51.967020 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c25383a4-5f37-4c52-aeb0-3fb8363f10da tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:50:51.967453 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c25383a4-5f37-4c52-aeb0-3fb8363f10da tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:50:52.192154 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c25383a4-5f37-4c52-aeb0-3fb8363f10da tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:50:52.200293 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c25383a4-5f37-4c52-aeb0-3fb8363f10da tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7" status: 200 len: 1688 microversion: 2.1 time: 0.247390 Aug 31 16:50:52.201341 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3479/6975] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:50:51 2022] GET /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7 => generated 1688 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:50:52.372870 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-1650583c-5b75-41da-b627-eb84908abb8d req-c3f968c7-257a-4a7e-bab1-48bde11396b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81e9db46-4167-48f7-900f-9d65fdfc72b7", "name": "network-vif-deleted", "tag": "a574579c-df0c-467a-bdb8-ee3e7daa36e5"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:50:52.383758 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-1650583c-5b75-41da-b627-eb84908abb8d req-c3f968c7-257a-4a7e-bab1-48bde11396b1 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:50:52.384262 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-1650583c-5b75-41da-b627-eb84908abb8d req-c3f968c7-257a-4a7e-bab1-48bde11396b1 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:50:52.384712 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-1650583c-5b75-41da-b627-eb84908abb8d req-c3f968c7-257a-4a7e-bab1-48bde11396b1 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:50:52.397803 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-1650583c-5b75-41da-b627-eb84908abb8d req-c3f968c7-257a-4a7e-bab1-48bde11396b1 service nova] Creating event network-vif-deleted:a574579c-df0c-467a-bdb8-ee3e7daa36e5 for instance 81e9db46-4167-48f7-900f-9d65fdfc72b7 on n-h2-850499-9 Aug 31 16:50:52.403052 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-1650583c-5b75-41da-b627-eb84908abb8d req-c3f968c7-257a-4a7e-bab1-48bde11396b1 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034181 Aug 31 16:50:52.403850 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3497/6976] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:50:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:50:53.229031 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-883f41c8-c5c5-4e39-9b6d-a9ff291b2acb tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:50:53.229578 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-883f41c8-c5c5-4e39-9b6d-a9ff291b2acb tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 81e9db46-4167-48f7-900f-9d65fdfc72b7] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:50:53.236697 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-883f41c8-c5c5-4e39-9b6d-a9ff291b2acb tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:50:53.237189 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-883f41c8-c5c5-4e39-9b6d-a9ff291b2acb tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:50:53.237630 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-883f41c8-c5c5-4e39-9b6d-a9ff291b2acb tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:50:53.238346 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-883f41c8-c5c5-4e39-9b6d-a9ff291b2acb tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:50:53.238804 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-883f41c8-c5c5-4e39-9b6d-a9ff291b2acb tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:50:53.239792 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-883f41c8-c5c5-4e39-9b6d-a9ff291b2acb tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:50:53.253514 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-883f41c8-c5c5-4e39-9b6d-a9ff291b2acb tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] HTTP exception thrown: Instance 81e9db46-4167-48f7-900f-9d65fdfc72b7 could not be found. Aug 31 16:50:53.255842 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-883f41c8-c5c5-4e39-9b6d-a9ff291b2acb tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Request method failure captured: Aug 31 16:50:53.255842 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7 HTTP/1.1 Aug 31 16:50:53.255842 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:50:53.255842 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:50:53.255842 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:50:53.255842 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:50:53.255842 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:50:53.255842 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:50:53.255842 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:50:53.255842 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:50:53.255842 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4_WgD4QikPr5cF-bgJByIIY9om79DYcPMqMqsO-QLvTluETH-73GviQTPoMUqKYlX3NhUluX-Xu-yN_DDF2dOtGmm0lyWPtEq7FsxUNcGFIoyzKHnCgn3ibP5w1pC53PzHFJSukSTZE-QhQ71cjyt3B2uRrfnTMcNRrq4qjkk4kSj8 Aug 31 16:50:53.255842 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:50:53.255842 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:50:53.255842 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:50:53.255842 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:50:53.255842 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:50:53.255842 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:50:53.255842 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 1464b491651b43498f56ffcbe24646d8 Aug 31 16:50:53.255842 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-386022060 Aug 31 16:50:53.255842 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:50:53.255842 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:50:53.255842 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1464b491651b43498f56ffcbe24646d8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1464b491651b43498f56ffcbe24646d8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1464b491651b43498f56ffcbe24646d8", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1464b491651b43498f56ffcbe24646d8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:50:53.255842 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-TestNetworkAdvancedServerOps-386022060 Aug 31 16:50:53.255842 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 1464b491651b43498f56ffcbe24646d8 Aug 31 16:50:53.255842 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-386022060 Aug 31 16:50:53.255842 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-TestNetworkAdvancedServerOps-386022060-project Aug 31 16:50:53.255842 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:50:53.255842 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:50:53.255842 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: bf392720aaea4a068b23404ef76ccd5f Aug 31 16:50:53.255842 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-TestNetworkAdvancedServerOps-386022060-project Aug 31 16:50:53.255842 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:50:53.255842 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance 81e9db46-4167-48f7-900f-9d65fdfc72b7 could not be found. Aug 31 16:50:53.255842 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '81e9db46-4167-48f7-900f-9d65fdfc72b7'} Aug 31 16:50:53.255842 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:50:53.255842 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:50:53.255842 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:50:53.255842 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:50:53.255842 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:50:53.255842 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:50:53.255842 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:50:53.255842 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:50:53.255842 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:50:53.255842 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:50:53.255842 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81e9db46-4167-48f7-900f-9d65fdfc72b7 could not be found. Aug 31 16:50:53.255842 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:50:53.255842 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:50:53.255842 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:50:53.255842 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:50:53.255842 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:50:53.255842 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:50:53.255842 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:50:53.255842 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:50:53.255842 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:50:53.255842 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:50:53.255842 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:50:53.255842 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:50:53.255842 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:50:53.255842 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:50:53.255842 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:50:53.255842 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:50:53.255842 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81e9db46-4167-48f7-900f-9d65fdfc72b7 could not be found. Aug 31 16:50:53.255842 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:50:53.255842 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:50:53.261066 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:50:53.261066 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:50:53.261066 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:50:53.261066 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:50:53.261066 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:50:53.261066 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:50:53.261066 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81e9db46-4167-48f7-900f-9d65fdfc72b7 could not be found. Aug 31 16:50:53.261066 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:50:53.261066 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-883f41c8-c5c5-4e39-9b6d-a9ff291b2acb tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Returning 404 to user: Instance 81e9db46-4167-48f7-900f-9d65fdfc72b7 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:50:53.261066 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-883f41c8-c5c5-4e39-9b6d-a9ff291b2acb tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7" status: 404 len: 111 microversion: 2.1 time: 0.032310 Aug 31 16:50:53.261066 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3480/6977] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:50:53 2022] GET /compute/v2.1/servers/81e9db46-4167-48f7-900f-9d65fdfc72b7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 16:50:56.639918 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-601845a7-03e9-49d1-b13d-c752e1c3a6af tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '.version_select at 0x7f5ae3a440d0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:50:56.665765 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-601845a7-03e9-49d1-b13d-c752e1c3a6af tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2140848967" status: 202 len: 0 microversion: 2.1 time: 0.030337 Aug 31 16:50:56.667169 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3498/6978] 10.222.0.61 () {58 vars in 1284 bytes} [Wed Aug 31 16:50:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2140848967 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:50:56.700936 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3908741f-7e43-4c00-848f-16e01bfce8c1 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Action: 'create', calling method: .version_select at 0x7f5ae3c80280>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1645588075", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCWGyrjVWTg84vPDRbs/hTvVLArhmeWAmldkEMcSsCX0Gal4qYGa3C7kHJqzqQPjoc/P0JM20kmzGYJIKlNN9MAJHOl8/ffHMZjhRc8/53ZCFDi0lVs0fz4cgPK3EnWg/g=="}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:50:56.719344 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-3908741f-7e43-4c00-848f-16e01bfce8c1 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Getting quotas for project 1464b491651b43498f56ffcbe24646d8. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:50:56.726917 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-3908741f-7e43-4c00-848f-16e01bfce8c1 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Getting quotas for user bf392720aaea4a068b23404ef76ccd5f and project 1464b491651b43498f56ffcbe24646d8. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:50:56.741878 n-d-850499-9 devstack@n-api.service[122256]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3908741f-7e43-4c00-848f-16e01bfce8c1 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [1ec33fc2-e14a-42ed-8921-718494e3d541] AMQP server on 10.222.0.61:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 31 16:50:57.751025 n-d-850499-9 devstack@n-api.service[122256]: INFO oslo.messaging._drivers.impl_rabbit [None req-3908741f-7e43-4c00-848f-16e01bfce8c1 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [1ec33fc2-e14a-42ed-8921-718494e3d541] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 34852. Aug 31 16:50:57.769308 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3908741f-7e43-4c00-848f-16e01bfce8c1 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 1.071965 Aug 31 16:50:57.769927 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3481/6979] 10.222.0.61 () {60 vars in 1159 bytes} [Wed Aug 31 16:50:56 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:51:03.412280 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8e143075-e138-419f-a00a-d381767f273c tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-88976234", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "networks": [{"uuid": "c0b0e827-51a8-4742-a0bb-44406b5c0705"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1645588075", "security_groups": [{"name": "tempest-secgroup-smoke-1248961262"}]}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:51:03.423543 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=16 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:51:03.557614 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-8e143075-e138-419f-a00a-d381767f273c tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] validate_networks() for [('c0b0e827-51a8-4742-a0bb-44406b5c0705', None, None, None, None, None)] {{(pid=122257) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:51:04.033456 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-8e143075-e138-419f-a00a-d381767f273c tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:51:04.034540 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-8e143075-e138-419f-a00a-d381767f273c tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:51:04.035251 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-8e143075-e138-419f-a00a-d381767f273c tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:51:04.036444 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-8e143075-e138-419f-a00a-d381767f273c tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:51:04.037195 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-8e143075-e138-419f-a00a-d381767f273c tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:51:04.048982 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8e143075-e138-419f-a00a-d381767f273c tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:04.049633 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8e143075-e138-419f-a00a-d381767f273c tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:04.050188 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8e143075-e138-419f-a00a-d381767f273c tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:04.051022 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8e143075-e138-419f-a00a-d381767f273c tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:04.052459 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8e143075-e138-419f-a00a-d381767f273c tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:04.053560 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8e143075-e138-419f-a00a-d381767f273c tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:04.075643 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-8e143075-e138-419f-a00a-d381767f273c tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Getting quotas for project 1464b491651b43498f56ffcbe24646d8. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:51:04.083057 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-8e143075-e138-419f-a00a-d381767f273c tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Getting quotas for user bf392720aaea4a068b23404ef76ccd5f and project 1464b491651b43498f56ffcbe24646d8. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:51:04.098706 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8e143075-e138-419f-a00a-d381767f273c tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Going to run 1 instances... {{(pid=122257) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:51:04.101659 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8e143075-e138-419f-a00a-d381767f273c tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 4a9d6789-8df2-48ba-878b-4f643ee89cfa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:51:04.180212 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8e143075-e138-419f-a00a-d381767f273c tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.769441 Aug 31 16:51:04.181504 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3499/6980] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:51:03 2022] POST /compute/v2.1/servers => generated 406 bytes in 774 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:51:04.194956 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-295278de-372c-4ad7-90a1-f32bfbb6ade6 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:51:04.196303 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-295278de-372c-4ad7-90a1-f32bfbb6ade6 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 4a9d6789-8df2-48ba-878b-4f643ee89cfa] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:51:04.210120 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:51:04.284321 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-295278de-372c-4ad7-90a1-f32bfbb6ade6 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:51:04.292714 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-295278de-372c-4ad7-90a1-f32bfbb6ade6 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/4a9d6789-8df2-48ba-878b-4f643ee89cfa" status: 200 len: 1265 microversion: 2.1 time: 0.104017 Aug 31 16:51:04.293941 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3482/6981] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:51:04 2022] GET /compute/v2.1/servers/4a9d6789-8df2-48ba-878b-4f643ee89cfa => generated 1265 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:51:05.314755 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ac4638b4-8d08-4550-b20a-a51230c9c497 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:51:05.315388 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ac4638b4-8d08-4550-b20a-a51230c9c497 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 4a9d6789-8df2-48ba-878b-4f643ee89cfa] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:51:05.324903 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ac4638b4-8d08-4550-b20a-a51230c9c497 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:05.325742 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ac4638b4-8d08-4550-b20a-a51230c9c497 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:05.326183 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ac4638b4-8d08-4550-b20a-a51230c9c497 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:05.326892 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ac4638b4-8d08-4550-b20a-a51230c9c497 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:05.327419 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ac4638b4-8d08-4550-b20a-a51230c9c497 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:05.327948 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ac4638b4-8d08-4550-b20a-a51230c9c497 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:05.399940 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ac4638b4-8d08-4550-b20a-a51230c9c497 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:51:05.408507 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ac4638b4-8d08-4550-b20a-a51230c9c497 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/4a9d6789-8df2-48ba-878b-4f643ee89cfa" status: 200 len: 1317 microversion: 2.1 time: 0.097526 Aug 31 16:51:05.409286 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3500/6982] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:51:05 2022] GET /compute/v2.1/servers/4a9d6789-8df2-48ba-878b-4f643ee89cfa => generated 1317 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:51:06.433478 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-16e91f05-9e7d-4e8c-af28-8aceabdd0f77 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:51:06.434098 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-16e91f05-9e7d-4e8c-af28-8aceabdd0f77 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 4a9d6789-8df2-48ba-878b-4f643ee89cfa] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:51:06.444912 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-16e91f05-9e7d-4e8c-af28-8aceabdd0f77 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:06.445429 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-16e91f05-9e7d-4e8c-af28-8aceabdd0f77 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:06.445880 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-16e91f05-9e7d-4e8c-af28-8aceabdd0f77 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:06.446778 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-16e91f05-9e7d-4e8c-af28-8aceabdd0f77 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:06.459658 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-16e91f05-9e7d-4e8c-af28-8aceabdd0f77 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:06.460385 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-16e91f05-9e7d-4e8c-af28-8aceabdd0f77 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:06.692577 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-16e91f05-9e7d-4e8c-af28-8aceabdd0f77 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:51:06.701252 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-16e91f05-9e7d-4e8c-af28-8aceabdd0f77 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/4a9d6789-8df2-48ba-878b-4f643ee89cfa" status: 200 len: 1391 microversion: 2.1 time: 0.271880 Aug 31 16:51:06.702032 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3483/6983] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:51:06 2022] GET /compute/v2.1/servers/4a9d6789-8df2-48ba-878b-4f643ee89cfa => generated 1391 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:51:07.165192 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-11650779-f904-4040-b3a5-0d960f7e39e7 req-16295ba2-cf88-411c-bffc-763531c4d653 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a9d6789-8df2-48ba-878b-4f643ee89cfa", "tag": "7780ca42-78e9-4f1d-bdbe-e18a72e8cdfd"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:51:07.182104 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-11650779-f904-4040-b3a5-0d960f7e39e7 req-16295ba2-cf88-411c-bffc-763531c4d653 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:07.182924 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-11650779-f904-4040-b3a5-0d960f7e39e7 req-16295ba2-cf88-411c-bffc-763531c4d653 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:07.183388 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-11650779-f904-4040-b3a5-0d960f7e39e7 req-16295ba2-cf88-411c-bffc-763531c4d653 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:07.198403 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-11650779-f904-4040-b3a5-0d960f7e39e7 req-16295ba2-cf88-411c-bffc-763531c4d653 service nova] Creating event network-changed:7780ca42-78e9-4f1d-bdbe-e18a72e8cdfd for instance 4a9d6789-8df2-48ba-878b-4f643ee89cfa on n-h1-850499-9 Aug 31 16:51:07.204274 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-11650779-f904-4040-b3a5-0d960f7e39e7 req-16295ba2-cf88-411c-bffc-763531c4d653 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045392 Aug 31 16:51:07.205429 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3501/6984] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:51:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:51:07.724508 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-26a7936d-f232-48a2-b066-658baa214d83 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:51:07.725160 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-26a7936d-f232-48a2-b066-658baa214d83 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 4a9d6789-8df2-48ba-878b-4f643ee89cfa] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:51:07.733004 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-26a7936d-f232-48a2-b066-658baa214d83 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:07.733497 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-26a7936d-f232-48a2-b066-658baa214d83 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:07.733939 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-26a7936d-f232-48a2-b066-658baa214d83 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:07.734664 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-26a7936d-f232-48a2-b066-658baa214d83 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:07.735111 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-26a7936d-f232-48a2-b066-658baa214d83 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:07.735565 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-26a7936d-f232-48a2-b066-658baa214d83 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:07.874821 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-26a7936d-f232-48a2-b066-658baa214d83 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:51:07.883716 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-26a7936d-f232-48a2-b066-658baa214d83 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/4a9d6789-8df2-48ba-878b-4f643ee89cfa" status: 200 len: 1391 microversion: 2.1 time: 0.164248 Aug 31 16:51:07.884295 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3484/6985] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:51:07 2022] GET /compute/v2.1/servers/4a9d6789-8df2-48ba-878b-4f643ee89cfa => generated 1391 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:51:08.905320 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6aba87e4-90be-41ff-b4b7-dd167c656eac tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:51:08.906079 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6aba87e4-90be-41ff-b4b7-dd167c656eac tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 4a9d6789-8df2-48ba-878b-4f643ee89cfa] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:51:08.914107 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6aba87e4-90be-41ff-b4b7-dd167c656eac tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:08.914609 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6aba87e4-90be-41ff-b4b7-dd167c656eac tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:08.915066 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6aba87e4-90be-41ff-b4b7-dd167c656eac tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:08.915812 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6aba87e4-90be-41ff-b4b7-dd167c656eac tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:08.916281 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6aba87e4-90be-41ff-b4b7-dd167c656eac tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:08.916725 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6aba87e4-90be-41ff-b4b7-dd167c656eac tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:09.063482 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-6aba87e4-90be-41ff-b4b7-dd167c656eac tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:51:09.071945 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6aba87e4-90be-41ff-b4b7-dd167c656eac tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/4a9d6789-8df2-48ba-878b-4f643ee89cfa" status: 200 len: 1391 microversion: 2.1 time: 0.170833 Aug 31 16:51:09.072544 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3502/6986] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:51:08 2022] GET /compute/v2.1/servers/4a9d6789-8df2-48ba-878b-4f643ee89cfa => generated 1391 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:51:10.093881 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6bea4a5b-651b-48f3-aec1-33448f066493 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:51:10.094593 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6bea4a5b-651b-48f3-aec1-33448f066493 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 4a9d6789-8df2-48ba-878b-4f643ee89cfa] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:51:10.102452 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6bea4a5b-651b-48f3-aec1-33448f066493 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:10.102957 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6bea4a5b-651b-48f3-aec1-33448f066493 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:10.103397 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6bea4a5b-651b-48f3-aec1-33448f066493 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:10.104142 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6bea4a5b-651b-48f3-aec1-33448f066493 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:10.104599 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6bea4a5b-651b-48f3-aec1-33448f066493 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:10.105031 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6bea4a5b-651b-48f3-aec1-33448f066493 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:10.479841 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-6bea4a5b-651b-48f3-aec1-33448f066493 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:51:10.487464 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6bea4a5b-651b-48f3-aec1-33448f066493 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/4a9d6789-8df2-48ba-878b-4f643ee89cfa" status: 200 len: 1391 microversion: 2.1 time: 0.397537 Aug 31 16:51:10.488065 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3485/6987] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:51:10 2022] GET /compute/v2.1/servers/4a9d6789-8df2-48ba-878b-4f643ee89cfa => generated 1391 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:51:11.511095 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6a9ff9a4-5ef2-45ae-bb28-4f00adc27f0e tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:51:11.511749 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6a9ff9a4-5ef2-45ae-bb28-4f00adc27f0e tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 4a9d6789-8df2-48ba-878b-4f643ee89cfa] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:51:11.519050 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6a9ff9a4-5ef2-45ae-bb28-4f00adc27f0e tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:11.519577 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6a9ff9a4-5ef2-45ae-bb28-4f00adc27f0e tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:11.520069 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6a9ff9a4-5ef2-45ae-bb28-4f00adc27f0e tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:11.520770 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6a9ff9a4-5ef2-45ae-bb28-4f00adc27f0e tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:11.521237 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6a9ff9a4-5ef2-45ae-bb28-4f00adc27f0e tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:11.521676 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6a9ff9a4-5ef2-45ae-bb28-4f00adc27f0e tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:11.713821 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-6a9ff9a4-5ef2-45ae-bb28-4f00adc27f0e tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:51:11.721569 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6a9ff9a4-5ef2-45ae-bb28-4f00adc27f0e tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/4a9d6789-8df2-48ba-878b-4f643ee89cfa" status: 200 len: 1391 microversion: 2.1 time: 0.214475 Aug 31 16:51:11.722149 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3503/6988] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:51:11 2022] GET /compute/v2.1/servers/4a9d6789-8df2-48ba-878b-4f643ee89cfa => generated 1391 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:51:12.743485 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0084a2e8-807a-4f24-86c5-4df6f98507bf tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:51:12.744141 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0084a2e8-807a-4f24-86c5-4df6f98507bf tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 4a9d6789-8df2-48ba-878b-4f643ee89cfa] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:51:12.751789 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0084a2e8-807a-4f24-86c5-4df6f98507bf tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:12.752317 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0084a2e8-807a-4f24-86c5-4df6f98507bf tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:12.752769 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0084a2e8-807a-4f24-86c5-4df6f98507bf tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:12.753470 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0084a2e8-807a-4f24-86c5-4df6f98507bf tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:12.753922 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0084a2e8-807a-4f24-86c5-4df6f98507bf tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:12.754594 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0084a2e8-807a-4f24-86c5-4df6f98507bf tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:12.910064 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-0084a2e8-807a-4f24-86c5-4df6f98507bf tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:51:12.918809 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0084a2e8-807a-4f24-86c5-4df6f98507bf tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/4a9d6789-8df2-48ba-878b-4f643ee89cfa" status: 200 len: 1391 microversion: 2.1 time: 0.180251 Aug 31 16:51:12.919819 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3486/6989] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:51:12 2022] GET /compute/v2.1/servers/4a9d6789-8df2-48ba-878b-4f643ee89cfa => generated 1391 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:51:13.941361 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ae13d4c4-d7f3-4443-92fc-067dfd2903ea tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:51:13.943202 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ae13d4c4-d7f3-4443-92fc-067dfd2903ea tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 4a9d6789-8df2-48ba-878b-4f643ee89cfa] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:51:13.951921 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ae13d4c4-d7f3-4443-92fc-067dfd2903ea tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:13.952510 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ae13d4c4-d7f3-4443-92fc-067dfd2903ea tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:13.952976 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ae13d4c4-d7f3-4443-92fc-067dfd2903ea tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:13.953711 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ae13d4c4-d7f3-4443-92fc-067dfd2903ea tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:13.954192 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ae13d4c4-d7f3-4443-92fc-067dfd2903ea tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:13.954643 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ae13d4c4-d7f3-4443-92fc-067dfd2903ea tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:14.065387 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:51:14.092212 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=6 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:51:14.103687 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ae13d4c4-d7f3-4443-92fc-067dfd2903ea tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:51:14.112178 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ae13d4c4-d7f3-4443-92fc-067dfd2903ea tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/4a9d6789-8df2-48ba-878b-4f643ee89cfa" status: 200 len: 1391 microversion: 2.1 time: 0.174729 Aug 31 16:51:14.112788 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3504/6990] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:51:13 2022] GET /compute/v2.1/servers/4a9d6789-8df2-48ba-878b-4f643ee89cfa => generated 1391 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:51:14.897974 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-db2b43ee-01f0-48e9-8366-7ca73e359a3d req-2f58878e-39d2-43d9-8c8f-d308b12c36c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a9d6789-8df2-48ba-878b-4f643ee89cfa", "name": "network-vif-plugged", "status": "completed", "tag": "7780ca42-78e9-4f1d-bdbe-e18a72e8cdfd"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:51:14.904954 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=6 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:51:14.913128 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-db2b43ee-01f0-48e9-8366-7ca73e359a3d req-2f58878e-39d2-43d9-8c8f-d308b12c36c3 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:14.913617 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-db2b43ee-01f0-48e9-8366-7ca73e359a3d req-2f58878e-39d2-43d9-8c8f-d308b12c36c3 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:14.914055 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-db2b43ee-01f0-48e9-8366-7ca73e359a3d req-2f58878e-39d2-43d9-8c8f-d308b12c36c3 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:14.925628 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-db2b43ee-01f0-48e9-8366-7ca73e359a3d req-2f58878e-39d2-43d9-8c8f-d308b12c36c3 service nova] Creating event network-vif-plugged:7780ca42-78e9-4f1d-bdbe-e18a72e8cdfd for instance 4a9d6789-8df2-48ba-878b-4f643ee89cfa on n-h1-850499-9 Aug 31 16:51:14.930921 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-db2b43ee-01f0-48e9-8366-7ca73e359a3d req-2f58878e-39d2-43d9-8c8f-d308b12c36c3 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039253 Aug 31 16:51:14.931553 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3487/6991] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:51:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:51:15.134811 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5d887c3a-96cd-447b-95c0-207dfd262c13 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:51:15.135452 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5d887c3a-96cd-447b-95c0-207dfd262c13 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 4a9d6789-8df2-48ba-878b-4f643ee89cfa] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:51:15.142475 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5d887c3a-96cd-447b-95c0-207dfd262c13 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:15.142984 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5d887c3a-96cd-447b-95c0-207dfd262c13 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:15.143448 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5d887c3a-96cd-447b-95c0-207dfd262c13 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:15.144199 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5d887c3a-96cd-447b-95c0-207dfd262c13 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:15.144678 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5d887c3a-96cd-447b-95c0-207dfd262c13 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:15.146234 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5d887c3a-96cd-447b-95c0-207dfd262c13 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:15.283887 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5d887c3a-96cd-447b-95c0-207dfd262c13 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:51:15.292480 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5d887c3a-96cd-447b-95c0-207dfd262c13 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/4a9d6789-8df2-48ba-878b-4f643ee89cfa" status: 200 len: 1391 microversion: 2.1 time: 0.161617 Aug 31 16:51:15.293059 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3505/6992] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:51:15 2022] GET /compute/v2.1/servers/4a9d6789-8df2-48ba-878b-4f643ee89cfa => generated 1391 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:51:16.324181 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3e0fbb2e-0e7f-4656-bf90-6b34adc59d7c tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:51:16.324949 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3e0fbb2e-0e7f-4656-bf90-6b34adc59d7c tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 4a9d6789-8df2-48ba-878b-4f643ee89cfa] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:51:16.332593 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3e0fbb2e-0e7f-4656-bf90-6b34adc59d7c tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:16.333426 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3e0fbb2e-0e7f-4656-bf90-6b34adc59d7c tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:16.334058 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3e0fbb2e-0e7f-4656-bf90-6b34adc59d7c tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:16.334944 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3e0fbb2e-0e7f-4656-bf90-6b34adc59d7c tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:16.335585 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3e0fbb2e-0e7f-4656-bf90-6b34adc59d7c tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:16.336185 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3e0fbb2e-0e7f-4656-bf90-6b34adc59d7c tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:16.505247 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3e0fbb2e-0e7f-4656-bf90-6b34adc59d7c tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:51:16.518350 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3e0fbb2e-0e7f-4656-bf90-6b34adc59d7c tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/4a9d6789-8df2-48ba-878b-4f643ee89cfa" status: 200 len: 1391 microversion: 2.1 time: 0.198274 Aug 31 16:51:16.528314 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3488/6993] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:51:16 2022] GET /compute/v2.1/servers/4a9d6789-8df2-48ba-878b-4f643ee89cfa => generated 1391 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:51:17.541894 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-748172c3-c868-48b3-a3ab-52733519474e tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:51:17.542561 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-748172c3-c868-48b3-a3ab-52733519474e tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 4a9d6789-8df2-48ba-878b-4f643ee89cfa] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:51:17.548311 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-748172c3-c868-48b3-a3ab-52733519474e tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:17.549086 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-748172c3-c868-48b3-a3ab-52733519474e tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:17.549534 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-748172c3-c868-48b3-a3ab-52733519474e tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:17.552936 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-748172c3-c868-48b3-a3ab-52733519474e tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:17.552936 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-748172c3-c868-48b3-a3ab-52733519474e tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:17.552936 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-748172c3-c868-48b3-a3ab-52733519474e tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:17.707779 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-748172c3-c868-48b3-a3ab-52733519474e tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:51:17.715739 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-748172c3-c868-48b3-a3ab-52733519474e tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/4a9d6789-8df2-48ba-878b-4f643ee89cfa" status: 200 len: 1563 microversion: 2.1 time: 0.178394 Aug 31 16:51:17.716327 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3506/6994] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:51:17 2022] GET /compute/v2.1/servers/4a9d6789-8df2-48ba-878b-4f643ee89cfa => generated 1563 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:51:17.738076 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f03d8f23-0698-4b4f-852e-749d2773cb90 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:51:17.739744 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f03d8f23-0698-4b4f-852e-749d2773cb90 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 4a9d6789-8df2-48ba-878b-4f643ee89cfa] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:51:17.748459 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f03d8f23-0698-4b4f-852e-749d2773cb90 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:17.748960 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f03d8f23-0698-4b4f-852e-749d2773cb90 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:17.749400 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f03d8f23-0698-4b4f-852e-749d2773cb90 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:17.750945 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f03d8f23-0698-4b4f-852e-749d2773cb90 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:17.750945 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f03d8f23-0698-4b4f-852e-749d2773cb90 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:17.750945 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f03d8f23-0698-4b4f-852e-749d2773cb90 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:17.894462 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f03d8f23-0698-4b4f-852e-749d2773cb90 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:51:17.904106 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f03d8f23-0698-4b4f-852e-749d2773cb90 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/4a9d6789-8df2-48ba-878b-4f643ee89cfa" status: 200 len: 1563 microversion: 2.1 time: 0.170554 Aug 31 16:51:17.904682 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3489/6995] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:51:17 2022] GET /compute/v2.1/servers/4a9d6789-8df2-48ba-878b-4f643ee89cfa => generated 1563 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:51:19.564902 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a708f679-27ff-4e9a-8bc3-ad47af30ffda tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:51:19.565654 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a708f679-27ff-4e9a-8bc3-ad47af30ffda tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 4a9d6789-8df2-48ba-878b-4f643ee89cfa] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:51:19.568548 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-abb8fa96-6888-4ce9-90a5-0ae499e720ad req-9b2beaa8-c38e-4e09-b0c2-66cb410c34b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a9d6789-8df2-48ba-878b-4f643ee89cfa", "tag": "7780ca42-78e9-4f1d-bdbe-e18a72e8cdfd"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:51:19.568987 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=41,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:51:19.575456 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a708f679-27ff-4e9a-8bc3-ad47af30ffda tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:19.576222 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a708f679-27ff-4e9a-8bc3-ad47af30ffda tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:19.576749 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a708f679-27ff-4e9a-8bc3-ad47af30ffda tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:19.577552 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a708f679-27ff-4e9a-8bc3-ad47af30ffda tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:19.578229 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a708f679-27ff-4e9a-8bc3-ad47af30ffda tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:19.578448 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:51:19.579121 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a708f679-27ff-4e9a-8bc3-ad47af30ffda tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:19.580272 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-abb8fa96-6888-4ce9-90a5-0ae499e720ad req-9b2beaa8-c38e-4e09-b0c2-66cb410c34b7 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:19.580720 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-abb8fa96-6888-4ce9-90a5-0ae499e720ad req-9b2beaa8-c38e-4e09-b0c2-66cb410c34b7 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:19.581308 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-abb8fa96-6888-4ce9-90a5-0ae499e720ad req-9b2beaa8-c38e-4e09-b0c2-66cb410c34b7 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:19.594731 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-abb8fa96-6888-4ce9-90a5-0ae499e720ad req-9b2beaa8-c38e-4e09-b0c2-66cb410c34b7 service nova] Creating event network-changed:7780ca42-78e9-4f1d-bdbe-e18a72e8cdfd for instance 4a9d6789-8df2-48ba-878b-4f643ee89cfa on n-h1-850499-9 Aug 31 16:51:19.602092 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-abb8fa96-6888-4ce9-90a5-0ae499e720ad req-9b2beaa8-c38e-4e09-b0c2-66cb410c34b7 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037994 Aug 31 16:51:19.603069 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3490/6996] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:51:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:51:19.817471 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a708f679-27ff-4e9a-8bc3-ad47af30ffda tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:51:19.826726 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a708f679-27ff-4e9a-8bc3-ad47af30ffda tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/4a9d6789-8df2-48ba-878b-4f643ee89cfa" status: 200 len: 1563 microversion: 2.1 time: 0.265677 Aug 31 16:51:19.843398 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3507/6997] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:51:19 2022] GET /compute/v2.1/servers/4a9d6789-8df2-48ba-878b-4f643ee89cfa => generated 1563 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:51:32.878797 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=40 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:51:32.883917 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5ef2d403-ce40-45cc-947e-c569e677b655 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1686975029", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-435793919", "security_groups": [{"name": "tempest-secgroup-smoke-64941522"}], "block_device_mapping_v2": [{"uuid": "0c5b7eb4-988d-4b00-8188-6b7c2ffe5db7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0b707539-6131-412e-ba43-5bdd2cb0fbe5"}]}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:51:33.008585 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-5ef2d403-ce40-45cc-947e-c569e677b655 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] validate_networks() for [('0b707539-6131-412e-ba43-5bdd2cb0fbe5', None, None, None, None, None)] {{(pid=122256) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:51:33.450222 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-5ef2d403-ce40-45cc-947e-c569e677b655 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:51:33.450682 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-5ef2d403-ce40-45cc-947e-c569e677b655 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:51:33.451173 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-5ef2d403-ce40-45cc-947e-c569e677b655 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:51:33.451615 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-5ef2d403-ce40-45cc-947e-c569e677b655 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:51:33.452130 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-5ef2d403-ce40-45cc-947e-c569e677b655 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:51:33.461623 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5ef2d403-ce40-45cc-947e-c569e677b655 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:33.462120 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5ef2d403-ce40-45cc-947e-c569e677b655 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:33.462567 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5ef2d403-ce40-45cc-947e-c569e677b655 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:33.463335 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5ef2d403-ce40-45cc-947e-c569e677b655 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:33.463824 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5ef2d403-ce40-45cc-947e-c569e677b655 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:33.464263 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5ef2d403-ce40-45cc-947e-c569e677b655 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:33.482439 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-5ef2d403-ce40-45cc-947e-c569e677b655 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Getting quotas for project 798d7eff58b04ab582bac1e87112625f. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:51:33.487951 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-5ef2d403-ce40-45cc-947e-c569e677b655 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Getting quotas for user 588d2ef08d8345a6b6175c8287633270 and project 798d7eff58b04ab582bac1e87112625f. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:51:33.552859 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5ef2d403-ce40-45cc-947e-c569e677b655 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Going to run 1 instances... {{(pid=122256) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:51:33.555104 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5ef2d403-ce40-45cc-947e-c569e677b655 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: f4cfce12-0ec7-4eb8-b460-ce043fc1e968] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0c5b7eb4-988d-4b00-8188-6b7c2ffe5db7',volume_size=None,volume_type=None)] {{(pid=122256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:51:33.693084 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5ef2d403-ce40-45cc-947e-c569e677b655 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.816326 Aug 31 16:51:33.694986 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3491/6998] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:51:32 2022] POST /compute/v2.1/servers => generated 404 bytes in 818 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:51:33.705736 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-30a49a51-95e1-4409-91a1-10eca9707861 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:51:33.706441 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-30a49a51-95e1-4409-91a1-10eca9707861 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: f4cfce12-0ec7-4eb8-b460-ce043fc1e968] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:51:33.710437 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:51:33.711291 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=46 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:51:33.774970 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-30a49a51-95e1-4409-91a1-10eca9707861 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:51:33.782403 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-30a49a51-95e1-4409-91a1-10eca9707861 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/f4cfce12-0ec7-4eb8-b460-ce043fc1e968" status: 200 len: 1094 microversion: 2.1 time: 0.080641 Aug 31 16:51:33.782991 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3508/6999] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:51:33 2022] GET /compute/v2.1/servers/f4cfce12-0ec7-4eb8-b460-ce043fc1e968 => generated 1094 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:51:34.805422 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-12429d65-e2d4-4f39-97e0-b68446aacdd8 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:51:34.806034 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-12429d65-e2d4-4f39-97e0-b68446aacdd8 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: f4cfce12-0ec7-4eb8-b460-ce043fc1e968] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:51:34.813651 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-12429d65-e2d4-4f39-97e0-b68446aacdd8 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:34.814279 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-12429d65-e2d4-4f39-97e0-b68446aacdd8 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:34.814596 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-12429d65-e2d4-4f39-97e0-b68446aacdd8 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:34.815314 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-12429d65-e2d4-4f39-97e0-b68446aacdd8 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:34.815819 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-12429d65-e2d4-4f39-97e0-b68446aacdd8 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:34.816256 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-12429d65-e2d4-4f39-97e0-b68446aacdd8 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:34.881410 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-12429d65-e2d4-4f39-97e0-b68446aacdd8 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:51:34.889375 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-12429d65-e2d4-4f39-97e0-b68446aacdd8 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/f4cfce12-0ec7-4eb8-b460-ce043fc1e968" status: 200 len: 1192 microversion: 2.1 time: 0.088916 Aug 31 16:51:34.890114 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3492/7000] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:51:34 2022] GET /compute/v2.1/servers/f4cfce12-0ec7-4eb8-b460-ce043fc1e968 => generated 1192 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:51:35.911603 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d934025a-7932-4501-964b-681eeb95910f tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:51:35.912252 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d934025a-7932-4501-964b-681eeb95910f tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: f4cfce12-0ec7-4eb8-b460-ce043fc1e968] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:51:35.922210 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d934025a-7932-4501-964b-681eeb95910f tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:35.923216 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d934025a-7932-4501-964b-681eeb95910f tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:35.923920 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d934025a-7932-4501-964b-681eeb95910f tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:35.924897 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d934025a-7932-4501-964b-681eeb95910f tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:35.925580 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d934025a-7932-4501-964b-681eeb95910f tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:35.926298 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d934025a-7932-4501-964b-681eeb95910f tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:36.202545 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d934025a-7932-4501-964b-681eeb95910f tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:51:36.211457 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d934025a-7932-4501-964b-681eeb95910f tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/f4cfce12-0ec7-4eb8-b460-ce043fc1e968" status: 200 len: 1276 microversion: 2.1 time: 0.305029 Aug 31 16:51:36.212174 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3509/7001] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:51:35 2022] GET /compute/v2.1/servers/f4cfce12-0ec7-4eb8-b460-ce043fc1e968 => generated 1276 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:51:36.612098 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-c2770a8b-3f7e-489f-9e85-1add1994634d req-0db0e02c-b028-4a56-877d-514a9464c21b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4cfce12-0ec7-4eb8-b460-ce043fc1e968", "tag": "12788af8-acbd-4022-9eaa-f6c945bc2538"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:51:36.625364 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-c2770a8b-3f7e-489f-9e85-1add1994634d req-0db0e02c-b028-4a56-877d-514a9464c21b service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:36.626207 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-c2770a8b-3f7e-489f-9e85-1add1994634d req-0db0e02c-b028-4a56-877d-514a9464c21b service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:36.626588 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-c2770a8b-3f7e-489f-9e85-1add1994634d req-0db0e02c-b028-4a56-877d-514a9464c21b service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:36.645491 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-c2770a8b-3f7e-489f-9e85-1add1994634d req-0db0e02c-b028-4a56-877d-514a9464c21b service nova] Creating event network-changed:12788af8-acbd-4022-9eaa-f6c945bc2538 for instance f4cfce12-0ec7-4eb8-b460-ce043fc1e968 on n-h2-850499-9 Aug 31 16:51:36.651133 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-c2770a8b-3f7e-489f-9e85-1add1994634d req-0db0e02c-b028-4a56-877d-514a9464c21b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042983 Aug 31 16:51:36.652482 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3493/7002] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:51:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:51:37.233542 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0c38a539-b36b-4d7f-97e2-26e6e71e6b86 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:51:37.234330 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0c38a539-b36b-4d7f-97e2-26e6e71e6b86 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: f4cfce12-0ec7-4eb8-b460-ce043fc1e968] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:51:37.242251 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0c38a539-b36b-4d7f-97e2-26e6e71e6b86 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:37.242771 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0c38a539-b36b-4d7f-97e2-26e6e71e6b86 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:37.243336 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0c38a539-b36b-4d7f-97e2-26e6e71e6b86 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:37.244106 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0c38a539-b36b-4d7f-97e2-26e6e71e6b86 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:37.244834 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0c38a539-b36b-4d7f-97e2-26e6e71e6b86 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:37.245297 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0c38a539-b36b-4d7f-97e2-26e6e71e6b86 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:37.826325 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0c38a539-b36b-4d7f-97e2-26e6e71e6b86 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:51:37.835147 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0c38a539-b36b-4d7f-97e2-26e6e71e6b86 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/f4cfce12-0ec7-4eb8-b460-ce043fc1e968" status: 200 len: 1276 microversion: 2.1 time: 0.605587 Aug 31 16:51:37.848425 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3510/7003] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:51:37 2022] GET /compute/v2.1/servers/f4cfce12-0ec7-4eb8-b460-ce043fc1e968 => generated 1276 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:51:38.857452 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-da2e7ea3-647b-4901-8b36-97278eeafd92 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:51:38.858156 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-da2e7ea3-647b-4901-8b36-97278eeafd92 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: f4cfce12-0ec7-4eb8-b460-ce043fc1e968] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:51:38.865723 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-da2e7ea3-647b-4901-8b36-97278eeafd92 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:38.866226 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-da2e7ea3-647b-4901-8b36-97278eeafd92 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:38.866669 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-da2e7ea3-647b-4901-8b36-97278eeafd92 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:38.867446 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-da2e7ea3-647b-4901-8b36-97278eeafd92 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:38.867937 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-da2e7ea3-647b-4901-8b36-97278eeafd92 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:38.868369 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-da2e7ea3-647b-4901-8b36-97278eeafd92 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:39.017151 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-da2e7ea3-647b-4901-8b36-97278eeafd92 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:51:39.026198 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-da2e7ea3-647b-4901-8b36-97278eeafd92 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/f4cfce12-0ec7-4eb8-b460-ce043fc1e968" status: 200 len: 1276 microversion: 2.1 time: 0.172702 Aug 31 16:51:39.026506 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3494/7004] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:51:38 2022] GET /compute/v2.1/servers/f4cfce12-0ec7-4eb8-b460-ce043fc1e968 => generated 1276 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:51:40.047741 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5ee72490-6001-4070-b438-1a952e3e0e95 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:51:40.048644 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5ee72490-6001-4070-b438-1a952e3e0e95 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: f4cfce12-0ec7-4eb8-b460-ce043fc1e968] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:51:40.057126 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5ee72490-6001-4070-b438-1a952e3e0e95 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:40.057666 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5ee72490-6001-4070-b438-1a952e3e0e95 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:40.058078 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5ee72490-6001-4070-b438-1a952e3e0e95 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:40.059068 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5ee72490-6001-4070-b438-1a952e3e0e95 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:40.059708 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5ee72490-6001-4070-b438-1a952e3e0e95 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:40.060164 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5ee72490-6001-4070-b438-1a952e3e0e95 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:40.207857 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5ee72490-6001-4070-b438-1a952e3e0e95 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:51:40.215982 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5ee72490-6001-4070-b438-1a952e3e0e95 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/f4cfce12-0ec7-4eb8-b460-ce043fc1e968" status: 200 len: 1276 microversion: 2.1 time: 0.172221 Aug 31 16:51:40.216575 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3511/7005] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:51:40 2022] GET /compute/v2.1/servers/f4cfce12-0ec7-4eb8-b460-ce043fc1e968 => generated 1276 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:51:41.237432 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e54a20d5-9564-4871-a8fb-1c50cab509ea tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:51:41.238051 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e54a20d5-9564-4871-a8fb-1c50cab509ea tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: f4cfce12-0ec7-4eb8-b460-ce043fc1e968] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:51:41.245805 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e54a20d5-9564-4871-a8fb-1c50cab509ea tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:41.246334 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e54a20d5-9564-4871-a8fb-1c50cab509ea tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:41.246780 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e54a20d5-9564-4871-a8fb-1c50cab509ea tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:41.247481 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e54a20d5-9564-4871-a8fb-1c50cab509ea tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:41.247970 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e54a20d5-9564-4871-a8fb-1c50cab509ea tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:41.248405 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e54a20d5-9564-4871-a8fb-1c50cab509ea tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:41.382185 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e54a20d5-9564-4871-a8fb-1c50cab509ea tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:51:41.390159 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e54a20d5-9564-4871-a8fb-1c50cab509ea tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/f4cfce12-0ec7-4eb8-b460-ce043fc1e968" status: 200 len: 1264 microversion: 2.1 time: 0.156595 Aug 31 16:51:41.390749 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3495/7006] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:51:41 2022] GET /compute/v2.1/servers/f4cfce12-0ec7-4eb8-b460-ce043fc1e968 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:51:42.412869 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b142b5ab-f8f6-4f24-8237-91f9ea8771dc tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:51:42.413542 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b142b5ab-f8f6-4f24-8237-91f9ea8771dc tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: f4cfce12-0ec7-4eb8-b460-ce043fc1e968] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:51:42.420593 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b142b5ab-f8f6-4f24-8237-91f9ea8771dc tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:42.421100 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b142b5ab-f8f6-4f24-8237-91f9ea8771dc tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:42.421640 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b142b5ab-f8f6-4f24-8237-91f9ea8771dc tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:42.422293 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b142b5ab-f8f6-4f24-8237-91f9ea8771dc tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:42.422776 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b142b5ab-f8f6-4f24-8237-91f9ea8771dc tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:42.423221 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b142b5ab-f8f6-4f24-8237-91f9ea8771dc tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:42.568091 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b142b5ab-f8f6-4f24-8237-91f9ea8771dc tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:51:42.576057 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b142b5ab-f8f6-4f24-8237-91f9ea8771dc tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/f4cfce12-0ec7-4eb8-b460-ce043fc1e968" status: 200 len: 1264 microversion: 2.1 time: 0.167579 Aug 31 16:51:42.576600 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3512/7007] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:51:42 2022] GET /compute/v2.1/servers/f4cfce12-0ec7-4eb8-b460-ce043fc1e968 => generated 1264 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:51:43.596903 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e04ebd17-e979-4a08-8045-41cfacc32561 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:51:43.597620 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e04ebd17-e979-4a08-8045-41cfacc32561 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: f4cfce12-0ec7-4eb8-b460-ce043fc1e968] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:51:43.600638 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:51:43.601381 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=6 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:51:43.607612 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e04ebd17-e979-4a08-8045-41cfacc32561 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:43.608116 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e04ebd17-e979-4a08-8045-41cfacc32561 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:43.608650 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e04ebd17-e979-4a08-8045-41cfacc32561 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:43.609414 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e04ebd17-e979-4a08-8045-41cfacc32561 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:43.609872 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e04ebd17-e979-4a08-8045-41cfacc32561 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:43.610312 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e04ebd17-e979-4a08-8045-41cfacc32561 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:43.772912 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e04ebd17-e979-4a08-8045-41cfacc32561 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:51:43.781367 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e04ebd17-e979-4a08-8045-41cfacc32561 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/f4cfce12-0ec7-4eb8-b460-ce043fc1e968" status: 200 len: 1264 microversion: 2.1 time: 0.188359 Aug 31 16:51:43.781961 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3496/7008] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:51:43 2022] GET /compute/v2.1/servers/f4cfce12-0ec7-4eb8-b460-ce043fc1e968 => generated 1264 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:51:44.803100 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:51:44.807335 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-786e0cea-d0e8-438a-87b1-134c22b34331 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:51:44.808087 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-786e0cea-d0e8-438a-87b1-134c22b34331 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: f4cfce12-0ec7-4eb8-b460-ce043fc1e968] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:51:44.814946 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-786e0cea-d0e8-438a-87b1-134c22b34331 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:44.815414 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-786e0cea-d0e8-438a-87b1-134c22b34331 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:44.815903 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-786e0cea-d0e8-438a-87b1-134c22b34331 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:44.816983 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-786e0cea-d0e8-438a-87b1-134c22b34331 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:44.817524 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-786e0cea-d0e8-438a-87b1-134c22b34331 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:44.817980 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-786e0cea-d0e8-438a-87b1-134c22b34331 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:44.974350 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-786e0cea-d0e8-438a-87b1-134c22b34331 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:51:44.982646 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-786e0cea-d0e8-438a-87b1-134c22b34331 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/f4cfce12-0ec7-4eb8-b460-ce043fc1e968" status: 200 len: 1264 microversion: 2.1 time: 0.181751 Aug 31 16:51:44.983225 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3513/7009] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:51:44 2022] GET /compute/v2.1/servers/f4cfce12-0ec7-4eb8-b460-ce043fc1e968 => generated 1264 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:51:46.005997 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1fdbc869-b059-4d78-b134-c028d9972b7a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:51:46.006878 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1fdbc869-b059-4d78-b134-c028d9972b7a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: f4cfce12-0ec7-4eb8-b460-ce043fc1e968] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:51:46.013529 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1fdbc869-b059-4d78-b134-c028d9972b7a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:46.014139 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1fdbc869-b059-4d78-b134-c028d9972b7a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:46.014594 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1fdbc869-b059-4d78-b134-c028d9972b7a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:46.015320 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1fdbc869-b059-4d78-b134-c028d9972b7a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:46.015841 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1fdbc869-b059-4d78-b134-c028d9972b7a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:46.016442 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1fdbc869-b059-4d78-b134-c028d9972b7a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:46.074360 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-d6430872-6794-4bac-bc09-d270510d2391 req-37387360-7099-46f5-898c-c71f59b36714 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4cfce12-0ec7-4eb8-b460-ce043fc1e968", "name": "network-vif-plugged", "status": "completed", "tag": "12788af8-acbd-4022-9eaa-f6c945bc2538"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:51:46.084789 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-d6430872-6794-4bac-bc09-d270510d2391 req-37387360-7099-46f5-898c-c71f59b36714 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:46.085519 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-d6430872-6794-4bac-bc09-d270510d2391 req-37387360-7099-46f5-898c-c71f59b36714 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:46.085963 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-d6430872-6794-4bac-bc09-d270510d2391 req-37387360-7099-46f5-898c-c71f59b36714 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:46.098797 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-d6430872-6794-4bac-bc09-d270510d2391 req-37387360-7099-46f5-898c-c71f59b36714 service nova] Creating event network-vif-plugged:12788af8-acbd-4022-9eaa-f6c945bc2538 for instance f4cfce12-0ec7-4eb8-b460-ce043fc1e968 on n-h2-850499-9 Aug 31 16:51:46.104439 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-d6430872-6794-4bac-bc09-d270510d2391 req-37387360-7099-46f5-898c-c71f59b36714 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034460 Aug 31 16:51:46.105050 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3514/7010] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:51:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:51:46.173718 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1fdbc869-b059-4d78-b134-c028d9972b7a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:51:46.188831 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1fdbc869-b059-4d78-b134-c028d9972b7a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/f4cfce12-0ec7-4eb8-b460-ce043fc1e968" status: 200 len: 1264 microversion: 2.1 time: 0.187609 Aug 31 16:51:46.189613 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3497/7011] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:51:45 2022] GET /compute/v2.1/servers/f4cfce12-0ec7-4eb8-b460-ce043fc1e968 => generated 1264 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:51:47.214100 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f64e487e-e3ce-4f33-b508-40911ea9ea5a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:51:47.214817 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f64e487e-e3ce-4f33-b508-40911ea9ea5a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: f4cfce12-0ec7-4eb8-b460-ce043fc1e968] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:51:47.221256 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f64e487e-e3ce-4f33-b508-40911ea9ea5a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:47.221759 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f64e487e-e3ce-4f33-b508-40911ea9ea5a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:47.222217 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f64e487e-e3ce-4f33-b508-40911ea9ea5a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:47.223059 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f64e487e-e3ce-4f33-b508-40911ea9ea5a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:47.223689 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f64e487e-e3ce-4f33-b508-40911ea9ea5a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:47.224135 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f64e487e-e3ce-4f33-b508-40911ea9ea5a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:47.364761 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f64e487e-e3ce-4f33-b508-40911ea9ea5a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:51:47.373707 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f64e487e-e3ce-4f33-b508-40911ea9ea5a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/f4cfce12-0ec7-4eb8-b460-ce043fc1e968" status: 200 len: 1264 microversion: 2.1 time: 0.164755 Aug 31 16:51:47.374284 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3515/7012] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:51:47 2022] GET /compute/v2.1/servers/f4cfce12-0ec7-4eb8-b460-ce043fc1e968 => generated 1264 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:51:48.395649 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ac76c708-9817-4bc9-9f77-3ce0cf106f42 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:51:48.396183 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ac76c708-9817-4bc9-9f77-3ce0cf106f42 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: f4cfce12-0ec7-4eb8-b460-ce043fc1e968] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:51:48.403081 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ac76c708-9817-4bc9-9f77-3ce0cf106f42 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:48.403602 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ac76c708-9817-4bc9-9f77-3ce0cf106f42 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:48.404036 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ac76c708-9817-4bc9-9f77-3ce0cf106f42 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:48.404730 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ac76c708-9817-4bc9-9f77-3ce0cf106f42 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:48.405186 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ac76c708-9817-4bc9-9f77-3ce0cf106f42 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:48.405612 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ac76c708-9817-4bc9-9f77-3ce0cf106f42 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:48.552239 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ac76c708-9817-4bc9-9f77-3ce0cf106f42 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:51:48.560361 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ac76c708-9817-4bc9-9f77-3ce0cf106f42 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/f4cfce12-0ec7-4eb8-b460-ce043fc1e968" status: 200 len: 1452 microversion: 2.1 time: 0.169061 Aug 31 16:51:48.560966 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3498/7013] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:51:48 2022] GET /compute/v2.1/servers/f4cfce12-0ec7-4eb8-b460-ce043fc1e968 => generated 1452 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:51:48.581491 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ea15947b-05df-4cb9-83fc-577af9f1229c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:51:48.582900 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ea15947b-05df-4cb9-83fc-577af9f1229c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: f4cfce12-0ec7-4eb8-b460-ce043fc1e968] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:51:48.590059 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ea15947b-05df-4cb9-83fc-577af9f1229c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:48.590569 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ea15947b-05df-4cb9-83fc-577af9f1229c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:48.591023 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ea15947b-05df-4cb9-83fc-577af9f1229c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:48.591806 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ea15947b-05df-4cb9-83fc-577af9f1229c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:48.592282 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ea15947b-05df-4cb9-83fc-577af9f1229c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:48.592763 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ea15947b-05df-4cb9-83fc-577af9f1229c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:48.826761 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ea15947b-05df-4cb9-83fc-577af9f1229c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:51:48.835899 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ea15947b-05df-4cb9-83fc-577af9f1229c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/f4cfce12-0ec7-4eb8-b460-ce043fc1e968" status: 200 len: 1452 microversion: 2.1 time: 0.258254 Aug 31 16:51:48.836588 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3516/7014] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:51:48 2022] GET /compute/v2.1/servers/f4cfce12-0ec7-4eb8-b460-ce043fc1e968 => generated 1452 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:51:50.526988 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-f773d9e8-de55-4d5e-af27-702464b4420b req-2bddb4d3-f710-434e-8fad-d4a2550000c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4cfce12-0ec7-4eb8-b460-ce043fc1e968", "tag": "12788af8-acbd-4022-9eaa-f6c945bc2538"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:51:50.537895 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-f773d9e8-de55-4d5e-af27-702464b4420b req-2bddb4d3-f710-434e-8fad-d4a2550000c0 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:50.538377 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-f773d9e8-de55-4d5e-af27-702464b4420b req-2bddb4d3-f710-434e-8fad-d4a2550000c0 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:50.538809 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-f773d9e8-de55-4d5e-af27-702464b4420b req-2bddb4d3-f710-434e-8fad-d4a2550000c0 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:50.550420 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-f773d9e8-de55-4d5e-af27-702464b4420b req-2bddb4d3-f710-434e-8fad-d4a2550000c0 service nova] Creating event network-changed:12788af8-acbd-4022-9eaa-f6c945bc2538 for instance f4cfce12-0ec7-4eb8-b460-ce043fc1e968 on n-h2-850499-9 Aug 31 16:51:50.556596 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-f773d9e8-de55-4d5e-af27-702464b4420b req-2bddb4d3-f710-434e-8fad-d4a2550000c0 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033187 Aug 31 16:51:50.557234 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3499/7015] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:51:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:51:53.152620 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-bf06e076-6637-4983-ac9a-96c5c83427c4 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:51:53.154807 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-bf06e076-6637-4983-ac9a-96c5c83427c4 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 4a9d6789-8df2-48ba-878b-4f643ee89cfa] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:51:53.162913 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bf06e076-6637-4983-ac9a-96c5c83427c4 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:53.163417 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bf06e076-6637-4983-ac9a-96c5c83427c4 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:53.163905 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bf06e076-6637-4983-ac9a-96c5c83427c4 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:53.164615 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bf06e076-6637-4983-ac9a-96c5c83427c4 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:53.165086 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bf06e076-6637-4983-ac9a-96c5c83427c4 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:53.165560 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bf06e076-6637-4983-ac9a-96c5c83427c4 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:53.233953 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-bf06e076-6637-4983-ac9a-96c5c83427c4 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "POST /compute/v2.1/servers/4a9d6789-8df2-48ba-878b-4f643ee89cfa/action" status: 200 len: 24561 microversion: 2.1 time: 0.085108 Aug 31 16:51:53.234708 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3517/7016] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:51:53 2022] POST /compute/v2.1/servers/4a9d6789-8df2-48ba-878b-4f643ee89cfa/action => generated 24561 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 16:52:23.632723 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:52:23.633463 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=42 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:52:23.637523 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-42872725-b8e8-4635-bd87-3a997e9b77a8 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:52:23.638234 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-42872725-b8e8-4635-bd87-3a997e9b77a8 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 4a9d6789-8df2-48ba-878b-4f643ee89cfa] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:52:23.645504 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42872725-b8e8-4635-bd87-3a997e9b77a8 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:52:23.645991 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42872725-b8e8-4635-bd87-3a997e9b77a8 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:52:23.646430 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42872725-b8e8-4635-bd87-3a997e9b77a8 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:52:23.647123 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42872725-b8e8-4635-bd87-3a997e9b77a8 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:52:23.647733 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42872725-b8e8-4635-bd87-3a997e9b77a8 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:52:23.648174 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-42872725-b8e8-4635-bd87-3a997e9b77a8 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:52:23.877706 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-42872725-b8e8-4635-bd87-3a997e9b77a8 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:52:23.885737 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-42872725-b8e8-4635-bd87-3a997e9b77a8 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/4a9d6789-8df2-48ba-878b-4f643ee89cfa" status: 200 len: 1682 microversion: 2.1 time: 0.255168 Aug 31 16:52:23.886338 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3500/7017] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:52:23 2022] GET /compute/v2.1/servers/4a9d6789-8df2-48ba-878b-4f643ee89cfa => generated 1682 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:52:23.994007 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-77fec573-43aa-40b7-84ca-26f609b294a5 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:52:23.996706 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-77fec573-43aa-40b7-84ca-26f609b294a5 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 4a9d6789-8df2-48ba-878b-4f643ee89cfa] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:52:23.999312 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=22 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:52:24.000175 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=48 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:52:24.007412 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-77fec573-43aa-40b7-84ca-26f609b294a5 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:52:24.007958 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-77fec573-43aa-40b7-84ca-26f609b294a5 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:52:24.008419 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-77fec573-43aa-40b7-84ca-26f609b294a5 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:52:24.009146 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-77fec573-43aa-40b7-84ca-26f609b294a5 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:52:24.009960 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-77fec573-43aa-40b7-84ca-26f609b294a5 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:52:24.010411 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-77fec573-43aa-40b7-84ca-26f609b294a5 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:52:24.087044 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-77fec573-43aa-40b7-84ca-26f609b294a5 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "POST /compute/v2.1/servers/4a9d6789-8df2-48ba-878b-4f643ee89cfa/action" status: 200 len: 32632 microversion: 2.1 time: 0.097316 Aug 31 16:52:24.087810 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3518/7018] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:52:23 2022] POST /compute/v2.1/servers/4a9d6789-8df2-48ba-878b-4f643ee89cfa/action => generated 32632 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 16:52:24.308683 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2b93c894-577e-4f19-841e-15a422e856d8 tempest-TestNetworkAdvancedServerOps-354410215 tempest-TestNetworkAdvancedServerOps-354410215-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:52:24.309390 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2b93c894-577e-4f19-841e-15a422e856d8 tempest-TestNetworkAdvancedServerOps-354410215 tempest-TestNetworkAdvancedServerOps-354410215-project-admin] [instance: 4a9d6789-8df2-48ba-878b-4f643ee89cfa] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:52:24.317084 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2b93c894-577e-4f19-841e-15a422e856d8 tempest-TestNetworkAdvancedServerOps-354410215 tempest-TestNetworkAdvancedServerOps-354410215-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:52:24.317781 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2b93c894-577e-4f19-841e-15a422e856d8 tempest-TestNetworkAdvancedServerOps-354410215 tempest-TestNetworkAdvancedServerOps-354410215-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:52:24.318236 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2b93c894-577e-4f19-841e-15a422e856d8 tempest-TestNetworkAdvancedServerOps-354410215 tempest-TestNetworkAdvancedServerOps-354410215-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:52:24.318961 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2b93c894-577e-4f19-841e-15a422e856d8 tempest-TestNetworkAdvancedServerOps-354410215 tempest-TestNetworkAdvancedServerOps-354410215-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:52:24.319428 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2b93c894-577e-4f19-841e-15a422e856d8 tempest-TestNetworkAdvancedServerOps-354410215 tempest-TestNetworkAdvancedServerOps-354410215-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:52:24.319892 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2b93c894-577e-4f19-841e-15a422e856d8 tempest-TestNetworkAdvancedServerOps-354410215 tempest-TestNetworkAdvancedServerOps-354410215-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:52:24.488732 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2b93c894-577e-4f19-841e-15a422e856d8 tempest-TestNetworkAdvancedServerOps-354410215 tempest-TestNetworkAdvancedServerOps-354410215-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/4a9d6789-8df2-48ba-878b-4f643ee89cfa" status: 200 len: 1833 microversion: 2.1 time: 0.184754 Aug 31 16:52:24.489351 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3501/7019] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:52:24 2022] GET /compute/v2.1/servers/4a9d6789-8df2-48ba-878b-4f643ee89cfa => generated 1833 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:52:24.517861 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7faae351-9192-44c6-a24f-258639ab10a4 tempest-TestNetworkAdvancedServerOps-354410215 tempest-TestNetworkAdvancedServerOps-354410215-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:52:24.520964 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7faae351-9192-44c6-a24f-258639ab10a4 tempest-TestNetworkAdvancedServerOps-354410215 tempest-TestNetworkAdvancedServerOps-354410215-project-admin] [instance: 4a9d6789-8df2-48ba-878b-4f643ee89cfa] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:52:24.528046 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7faae351-9192-44c6-a24f-258639ab10a4 tempest-TestNetworkAdvancedServerOps-354410215 tempest-TestNetworkAdvancedServerOps-354410215-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:52:24.528548 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7faae351-9192-44c6-a24f-258639ab10a4 tempest-TestNetworkAdvancedServerOps-354410215 tempest-TestNetworkAdvancedServerOps-354410215-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:52:24.529001 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7faae351-9192-44c6-a24f-258639ab10a4 tempest-TestNetworkAdvancedServerOps-354410215 tempest-TestNetworkAdvancedServerOps-354410215-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:52:24.529708 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7faae351-9192-44c6-a24f-258639ab10a4 tempest-TestNetworkAdvancedServerOps-354410215 tempest-TestNetworkAdvancedServerOps-354410215-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:52:24.530178 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7faae351-9192-44c6-a24f-258639ab10a4 tempest-TestNetworkAdvancedServerOps-354410215 tempest-TestNetworkAdvancedServerOps-354410215-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:52:24.530617 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7faae351-9192-44c6-a24f-258639ab10a4 tempest-TestNetworkAdvancedServerOps-354410215 tempest-TestNetworkAdvancedServerOps-354410215-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:52:24.557265 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-7faae351-9192-44c6-a24f-258639ab10a4 tempest-TestNetworkAdvancedServerOps-354410215 tempest-TestNetworkAdvancedServerOps-354410215-project-admin] Lazy-loading 'flavor' on Instance uuid 4a9d6789-8df2-48ba-878b-4f643ee89cfa {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:52:24.570666 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7faae351-9192-44c6-a24f-258639ab10a4 tempest-TestNetworkAdvancedServerOps-354410215 tempest-TestNetworkAdvancedServerOps-354410215-project-admin] [instance: 4a9d6789-8df2-48ba-878b-4f643ee89cfa] Going to try to live migrate instance to another host {{(pid=122257) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 31 16:52:26.089319 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7faae351-9192-44c6-a24f-258639ab10a4 tempest-TestNetworkAdvancedServerOps-354410215 tempest-TestNetworkAdvancedServerOps-354410215-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/4a9d6789-8df2-48ba-878b-4f643ee89cfa/action" status: 202 len: 0 microversion: 2.1 time: 1.575768 Aug 31 16:52:26.094038 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3519/7020] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:52:24 2022] POST /compute/v2.1/servers/4a9d6789-8df2-48ba-878b-4f643ee89cfa/action => generated 0 bytes in 1578 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:52:26.102498 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a042f26c-5cb2-48de-a96d-8f76ba6a12ce tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:52:26.103403 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a042f26c-5cb2-48de-a96d-8f76ba6a12ce tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 4a9d6789-8df2-48ba-878b-4f643ee89cfa] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:52:26.110643 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a042f26c-5cb2-48de-a96d-8f76ba6a12ce tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:52:26.111301 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a042f26c-5cb2-48de-a96d-8f76ba6a12ce tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:52:26.111879 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a042f26c-5cb2-48de-a96d-8f76ba6a12ce tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:52:26.112923 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a042f26c-5cb2-48de-a96d-8f76ba6a12ce tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:52:26.113933 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a042f26c-5cb2-48de-a96d-8f76ba6a12ce tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:52:26.114380 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a042f26c-5cb2-48de-a96d-8f76ba6a12ce tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:52:26.263188 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a042f26c-5cb2-48de-a96d-8f76ba6a12ce tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:52:26.271387 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a042f26c-5cb2-48de-a96d-8f76ba6a12ce tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/4a9d6789-8df2-48ba-878b-4f643ee89cfa" status: 200 len: 1692 microversion: 2.1 time: 0.175009 Aug 31 16:52:26.272193 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3502/7021] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:52:26 2022] GET /compute/v2.1/servers/4a9d6789-8df2-48ba-878b-4f643ee89cfa => generated 1692 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:52:27.278475 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-48eccf71-a72b-43fd-b1bc-2160d641de0d req-91a2c8ac-e871-44d9-aae1-a7e034016190 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a9d6789-8df2-48ba-878b-4f643ee89cfa", "name": "network-vif-unplugged", "status": "completed", "tag": "7780ca42-78e9-4f1d-bdbe-e18a72e8cdfd"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:52:27.293684 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f94d4cbc-09e4-4dda-af10-83c16b130ba2 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:52:27.294289 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f94d4cbc-09e4-4dda-af10-83c16b130ba2 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 4a9d6789-8df2-48ba-878b-4f643ee89cfa] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:52:27.304410 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-48eccf71-a72b-43fd-b1bc-2160d641de0d req-91a2c8ac-e871-44d9-aae1-a7e034016190 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:52:27.306381 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f94d4cbc-09e4-4dda-af10-83c16b130ba2 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:52:27.307071 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-48eccf71-a72b-43fd-b1bc-2160d641de0d req-91a2c8ac-e871-44d9-aae1-a7e034016190 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:52:27.308037 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-48eccf71-a72b-43fd-b1bc-2160d641de0d req-91a2c8ac-e871-44d9-aae1-a7e034016190 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:52:27.308505 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f94d4cbc-09e4-4dda-af10-83c16b130ba2 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:52:27.308940 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f94d4cbc-09e4-4dda-af10-83c16b130ba2 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:52:27.309675 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f94d4cbc-09e4-4dda-af10-83c16b130ba2 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:52:27.310137 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f94d4cbc-09e4-4dda-af10-83c16b130ba2 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:52:27.310554 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f94d4cbc-09e4-4dda-af10-83c16b130ba2 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:52:27.328336 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-48eccf71-a72b-43fd-b1bc-2160d641de0d req-91a2c8ac-e871-44d9-aae1-a7e034016190 service nova] Creating event network-vif-unplugged:7780ca42-78e9-4f1d-bdbe-e18a72e8cdfd for instance 4a9d6789-8df2-48ba-878b-4f643ee89cfa on n-h1-850499-9 Aug 31 16:52:27.336671 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-48eccf71-a72b-43fd-b1bc-2160d641de0d req-91a2c8ac-e871-44d9-aae1-a7e034016190 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064670 Aug 31 16:52:27.337883 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3520/7022] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:52:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:52:27.548579 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f94d4cbc-09e4-4dda-af10-83c16b130ba2 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:52:27.556734 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f94d4cbc-09e4-4dda-af10-83c16b130ba2 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/4a9d6789-8df2-48ba-878b-4f643ee89cfa" status: 200 len: 1692 microversion: 2.1 time: 0.267544 Aug 31 16:52:27.557409 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3503/7023] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:52:27 2022] GET /compute/v2.1/servers/4a9d6789-8df2-48ba-878b-4f643ee89cfa => generated 1692 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:52:28.580069 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9f3d53d4-925c-4034-b542-0ff05fcdd5ae tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:52:28.580783 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9f3d53d4-925c-4034-b542-0ff05fcdd5ae tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 4a9d6789-8df2-48ba-878b-4f643ee89cfa] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:52:28.587315 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9f3d53d4-925c-4034-b542-0ff05fcdd5ae tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:52:28.587855 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9f3d53d4-925c-4034-b542-0ff05fcdd5ae tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:52:28.588313 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9f3d53d4-925c-4034-b542-0ff05fcdd5ae tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:52:28.589023 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9f3d53d4-925c-4034-b542-0ff05fcdd5ae tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:52:28.589501 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9f3d53d4-925c-4034-b542-0ff05fcdd5ae tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:52:28.589949 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9f3d53d4-925c-4034-b542-0ff05fcdd5ae tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:52:28.725407 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9f3d53d4-925c-4034-b542-0ff05fcdd5ae tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:52:28.733372 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9f3d53d4-925c-4034-b542-0ff05fcdd5ae tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/4a9d6789-8df2-48ba-878b-4f643ee89cfa" status: 200 len: 1692 microversion: 2.1 time: 0.158520 Aug 31 16:52:28.733951 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3521/7024] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:52:28 2022] GET /compute/v2.1/servers/4a9d6789-8df2-48ba-878b-4f643ee89cfa => generated 1692 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:52:29.356430 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-2ef84551-1fdc-45b7-8ef9-28d82188ba32 req-46a69f19-b20c-4e6d-88f3-24d1330a5f9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a9d6789-8df2-48ba-878b-4f643ee89cfa", "tag": "7780ca42-78e9-4f1d-bdbe-e18a72e8cdfd"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:52:29.366647 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-2ef84551-1fdc-45b7-8ef9-28d82188ba32 req-46a69f19-b20c-4e6d-88f3-24d1330a5f9b service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:52:29.367126 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-2ef84551-1fdc-45b7-8ef9-28d82188ba32 req-46a69f19-b20c-4e6d-88f3-24d1330a5f9b service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:52:29.367584 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-2ef84551-1fdc-45b7-8ef9-28d82188ba32 req-46a69f19-b20c-4e6d-88f3-24d1330a5f9b service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:52:29.378727 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-2ef84551-1fdc-45b7-8ef9-28d82188ba32 req-46a69f19-b20c-4e6d-88f3-24d1330a5f9b service nova] Creating event network-changed:7780ca42-78e9-4f1d-bdbe-e18a72e8cdfd for instance 4a9d6789-8df2-48ba-878b-4f643ee89cfa on n-h1-850499-9 Aug 31 16:52:29.383789 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-2ef84551-1fdc-45b7-8ef9-28d82188ba32 req-46a69f19-b20c-4e6d-88f3-24d1330a5f9b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031261 Aug 31 16:52:29.384410 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3504/7025] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:52:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:52:29.755936 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d5025a35-28b7-4dfc-b727-d5c1d6179281 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:52:29.756573 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d5025a35-28b7-4dfc-b727-d5c1d6179281 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 4a9d6789-8df2-48ba-878b-4f643ee89cfa] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:52:29.763219 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d5025a35-28b7-4dfc-b727-d5c1d6179281 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:52:29.763763 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d5025a35-28b7-4dfc-b727-d5c1d6179281 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:52:29.764223 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d5025a35-28b7-4dfc-b727-d5c1d6179281 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:52:29.764961 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d5025a35-28b7-4dfc-b727-d5c1d6179281 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:52:29.765436 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d5025a35-28b7-4dfc-b727-d5c1d6179281 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:52:29.765886 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d5025a35-28b7-4dfc-b727-d5c1d6179281 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:52:29.960791 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d5025a35-28b7-4dfc-b727-d5c1d6179281 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:52:29.969050 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d5025a35-28b7-4dfc-b727-d5c1d6179281 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/4a9d6789-8df2-48ba-878b-4f643ee89cfa" status: 200 len: 1692 microversion: 2.1 time: 0.217753 Aug 31 16:52:29.969643 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3522/7026] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:52:29 2022] GET /compute/v2.1/servers/4a9d6789-8df2-48ba-878b-4f643ee89cfa => generated 1692 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:52:30.990868 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7da537d7-645b-4d5d-b5f8-dee89bda9476 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:52:30.991598 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7da537d7-645b-4d5d-b5f8-dee89bda9476 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 4a9d6789-8df2-48ba-878b-4f643ee89cfa] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:52:30.998942 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7da537d7-645b-4d5d-b5f8-dee89bda9476 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:52:30.999461 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7da537d7-645b-4d5d-b5f8-dee89bda9476 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:52:30.999932 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7da537d7-645b-4d5d-b5f8-dee89bda9476 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:52:31.000637 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7da537d7-645b-4d5d-b5f8-dee89bda9476 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:52:31.001135 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7da537d7-645b-4d5d-b5f8-dee89bda9476 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:52:31.001570 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7da537d7-645b-4d5d-b5f8-dee89bda9476 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:52:31.135365 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7da537d7-645b-4d5d-b5f8-dee89bda9476 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:52:31.143139 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7da537d7-645b-4d5d-b5f8-dee89bda9476 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/4a9d6789-8df2-48ba-878b-4f643ee89cfa" status: 200 len: 1692 microversion: 2.1 time: 0.156613 Aug 31 16:52:31.144431 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3505/7027] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:52:30 2022] GET /compute/v2.1/servers/4a9d6789-8df2-48ba-878b-4f643ee89cfa => generated 1692 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:52:32.165868 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e9be7dbb-5ffb-4558-954e-170642a8cfcc tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:52:32.166502 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e9be7dbb-5ffb-4558-954e-170642a8cfcc tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 4a9d6789-8df2-48ba-878b-4f643ee89cfa] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:52:32.173439 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e9be7dbb-5ffb-4558-954e-170642a8cfcc tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:52:32.173947 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e9be7dbb-5ffb-4558-954e-170642a8cfcc tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:52:32.174412 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e9be7dbb-5ffb-4558-954e-170642a8cfcc tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:52:32.175244 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e9be7dbb-5ffb-4558-954e-170642a8cfcc tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:52:32.175751 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e9be7dbb-5ffb-4558-954e-170642a8cfcc tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:52:32.176203 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e9be7dbb-5ffb-4558-954e-170642a8cfcc tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:52:32.311266 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e9be7dbb-5ffb-4558-954e-170642a8cfcc tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:52:32.319195 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e9be7dbb-5ffb-4558-954e-170642a8cfcc tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/4a9d6789-8df2-48ba-878b-4f643ee89cfa" status: 200 len: 1692 microversion: 2.1 time: 0.157360 Aug 31 16:52:32.319823 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3523/7028] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:52:32 2022] GET /compute/v2.1/servers/4a9d6789-8df2-48ba-878b-4f643ee89cfa => generated 1692 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:52:33.341526 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-11f6ff5c-622f-4038-ad49-bb24a0cf96d5 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:52:33.342151 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-11f6ff5c-622f-4038-ad49-bb24a0cf96d5 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 4a9d6789-8df2-48ba-878b-4f643ee89cfa] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:52:33.352861 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-11f6ff5c-622f-4038-ad49-bb24a0cf96d5 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:52:33.353355 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-11f6ff5c-622f-4038-ad49-bb24a0cf96d5 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:52:33.353798 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-11f6ff5c-622f-4038-ad49-bb24a0cf96d5 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:52:33.354507 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-11f6ff5c-622f-4038-ad49-bb24a0cf96d5 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:52:33.354975 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-11f6ff5c-622f-4038-ad49-bb24a0cf96d5 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:52:33.355411 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-11f6ff5c-622f-4038-ad49-bb24a0cf96d5 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:52:33.494122 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-11f6ff5c-622f-4038-ad49-bb24a0cf96d5 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:52:33.502187 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-11f6ff5c-622f-4038-ad49-bb24a0cf96d5 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/4a9d6789-8df2-48ba-878b-4f643ee89cfa" status: 200 len: 1692 microversion: 2.1 time: 0.164903 Aug 31 16:52:33.502759 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3506/7029] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:52:33 2022] GET /compute/v2.1/servers/4a9d6789-8df2-48ba-878b-4f643ee89cfa => generated 1692 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:52:34.523429 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0eb99f97-30e8-4fb3-a784-f5e520eba788 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:52:34.524126 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0eb99f97-30e8-4fb3-a784-f5e520eba788 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 4a9d6789-8df2-48ba-878b-4f643ee89cfa] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:52:34.531050 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0eb99f97-30e8-4fb3-a784-f5e520eba788 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:52:34.531581 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0eb99f97-30e8-4fb3-a784-f5e520eba788 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:52:34.532030 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0eb99f97-30e8-4fb3-a784-f5e520eba788 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:52:34.532734 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0eb99f97-30e8-4fb3-a784-f5e520eba788 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:52:34.533197 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0eb99f97-30e8-4fb3-a784-f5e520eba788 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:52:34.533633 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0eb99f97-30e8-4fb3-a784-f5e520eba788 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:52:34.668536 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0eb99f97-30e8-4fb3-a784-f5e520eba788 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:52:34.676952 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0eb99f97-30e8-4fb3-a784-f5e520eba788 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/4a9d6789-8df2-48ba-878b-4f643ee89cfa" status: 200 len: 1692 microversion: 2.1 time: 0.157431 Aug 31 16:52:34.677548 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3524/7030] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:52:34 2022] GET /compute/v2.1/servers/4a9d6789-8df2-48ba-878b-4f643ee89cfa => generated 1692 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:52:35.698217 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d2656401-2eb2-434b-8926-cc63bb42dced tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:52:35.698815 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d2656401-2eb2-434b-8926-cc63bb42dced tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 4a9d6789-8df2-48ba-878b-4f643ee89cfa] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:52:35.705966 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d2656401-2eb2-434b-8926-cc63bb42dced tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:52:35.707263 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d2656401-2eb2-434b-8926-cc63bb42dced tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:52:35.707570 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d2656401-2eb2-434b-8926-cc63bb42dced tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:52:35.708270 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d2656401-2eb2-434b-8926-cc63bb42dced tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:52:35.708726 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d2656401-2eb2-434b-8926-cc63bb42dced tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:52:35.709153 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d2656401-2eb2-434b-8926-cc63bb42dced tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:52:35.849777 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d2656401-2eb2-434b-8926-cc63bb42dced tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:52:35.857497 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d2656401-2eb2-434b-8926-cc63bb42dced tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/4a9d6789-8df2-48ba-878b-4f643ee89cfa" status: 200 len: 1692 microversion: 2.1 time: 0.163181 Aug 31 16:52:35.858077 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3507/7031] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:52:35 2022] GET /compute/v2.1/servers/4a9d6789-8df2-48ba-878b-4f643ee89cfa => generated 1692 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:52:36.882745 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7742ae82-b51a-4592-86cf-de50a9a3a8ba tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:52:36.883787 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7742ae82-b51a-4592-86cf-de50a9a3a8ba tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 4a9d6789-8df2-48ba-878b-4f643ee89cfa] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:52:36.892560 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7742ae82-b51a-4592-86cf-de50a9a3a8ba tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:52:36.893089 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7742ae82-b51a-4592-86cf-de50a9a3a8ba tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:52:36.893741 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7742ae82-b51a-4592-86cf-de50a9a3a8ba tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:52:36.894397 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7742ae82-b51a-4592-86cf-de50a9a3a8ba tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:52:36.894892 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7742ae82-b51a-4592-86cf-de50a9a3a8ba tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:52:36.895367 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7742ae82-b51a-4592-86cf-de50a9a3a8ba tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:52:37.169877 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7742ae82-b51a-4592-86cf-de50a9a3a8ba tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:52:37.177750 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7742ae82-b51a-4592-86cf-de50a9a3a8ba tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/4a9d6789-8df2-48ba-878b-4f643ee89cfa" status: 200 len: 1692 microversion: 2.1 time: 0.301418 Aug 31 16:52:37.178342 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3525/7032] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:52:36 2022] GET /compute/v2.1/servers/4a9d6789-8df2-48ba-878b-4f643ee89cfa => generated 1692 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:52:38.200344 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d79890b3-ab56-40ee-8e43-41226997719c tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:52:38.201018 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d79890b3-ab56-40ee-8e43-41226997719c tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 4a9d6789-8df2-48ba-878b-4f643ee89cfa] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:52:38.210157 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d79890b3-ab56-40ee-8e43-41226997719c tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:52:38.210841 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d79890b3-ab56-40ee-8e43-41226997719c tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:52:38.211393 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d79890b3-ab56-40ee-8e43-41226997719c tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:52:38.212170 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d79890b3-ab56-40ee-8e43-41226997719c tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:52:38.212638 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d79890b3-ab56-40ee-8e43-41226997719c tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:52:38.213081 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d79890b3-ab56-40ee-8e43-41226997719c tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:52:38.439435 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d79890b3-ab56-40ee-8e43-41226997719c tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:52:38.449802 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d79890b3-ab56-40ee-8e43-41226997719c tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/4a9d6789-8df2-48ba-878b-4f643ee89cfa" status: 200 len: 1692 microversion: 2.1 time: 0.253754 Aug 31 16:52:38.450892 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3508/7033] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:52:38 2022] GET /compute/v2.1/servers/4a9d6789-8df2-48ba-878b-4f643ee89cfa => generated 1692 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:52:39.473030 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8a78f2aa-44b7-480f-915a-3eadd9de3817 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:52:39.473955 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8a78f2aa-44b7-480f-915a-3eadd9de3817 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 4a9d6789-8df2-48ba-878b-4f643ee89cfa] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:52:39.480573 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8a78f2aa-44b7-480f-915a-3eadd9de3817 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:52:39.481074 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8a78f2aa-44b7-480f-915a-3eadd9de3817 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:52:39.481525 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8a78f2aa-44b7-480f-915a-3eadd9de3817 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:52:39.482232 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8a78f2aa-44b7-480f-915a-3eadd9de3817 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:52:39.482716 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8a78f2aa-44b7-480f-915a-3eadd9de3817 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:52:39.483141 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8a78f2aa-44b7-480f-915a-3eadd9de3817 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:52:39.621012 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8a78f2aa-44b7-480f-915a-3eadd9de3817 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:52:39.629581 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8a78f2aa-44b7-480f-915a-3eadd9de3817 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/4a9d6789-8df2-48ba-878b-4f643ee89cfa" status: 200 len: 1682 microversion: 2.1 time: 0.160413 Aug 31 16:52:39.630091 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3526/7034] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:52:39 2022] GET /compute/v2.1/servers/4a9d6789-8df2-48ba-878b-4f643ee89cfa => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:52:39.650133 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5c05162b-9447-421a-9fb1-3082558ad1d5 tempest-TestNetworkAdvancedServerOps-354410215 tempest-TestNetworkAdvancedServerOps-354410215-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:52:39.650748 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5c05162b-9447-421a-9fb1-3082558ad1d5 tempest-TestNetworkAdvancedServerOps-354410215 tempest-TestNetworkAdvancedServerOps-354410215-project-admin] [instance: 4a9d6789-8df2-48ba-878b-4f643ee89cfa] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:52:39.657877 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5c05162b-9447-421a-9fb1-3082558ad1d5 tempest-TestNetworkAdvancedServerOps-354410215 tempest-TestNetworkAdvancedServerOps-354410215-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:52:39.658360 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5c05162b-9447-421a-9fb1-3082558ad1d5 tempest-TestNetworkAdvancedServerOps-354410215 tempest-TestNetworkAdvancedServerOps-354410215-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:52:39.658797 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5c05162b-9447-421a-9fb1-3082558ad1d5 tempest-TestNetworkAdvancedServerOps-354410215 tempest-TestNetworkAdvancedServerOps-354410215-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:52:39.660083 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5c05162b-9447-421a-9fb1-3082558ad1d5 tempest-TestNetworkAdvancedServerOps-354410215 tempest-TestNetworkAdvancedServerOps-354410215-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:52:39.660664 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5c05162b-9447-421a-9fb1-3082558ad1d5 tempest-TestNetworkAdvancedServerOps-354410215 tempest-TestNetworkAdvancedServerOps-354410215-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:52:39.660974 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5c05162b-9447-421a-9fb1-3082558ad1d5 tempest-TestNetworkAdvancedServerOps-354410215 tempest-TestNetworkAdvancedServerOps-354410215-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:52:39.798030 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5c05162b-9447-421a-9fb1-3082558ad1d5 tempest-TestNetworkAdvancedServerOps-354410215 tempest-TestNetworkAdvancedServerOps-354410215-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/4a9d6789-8df2-48ba-878b-4f643ee89cfa" status: 200 len: 1833 microversion: 2.1 time: 0.151532 Aug 31 16:52:39.798611 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3509/7035] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:52:39 2022] GET /compute/v2.1/servers/4a9d6789-8df2-48ba-878b-4f643ee89cfa => generated 1833 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:52:39.819850 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-415aae97-f0a9-4eba-8f40-c027b363344f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:52:39.820478 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-415aae97-f0a9-4eba-8f40-c027b363344f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 4a9d6789-8df2-48ba-878b-4f643ee89cfa] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:52:39.826659 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-415aae97-f0a9-4eba-8f40-c027b363344f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:52:39.827162 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-415aae97-f0a9-4eba-8f40-c027b363344f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:52:39.827642 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-415aae97-f0a9-4eba-8f40-c027b363344f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:52:39.828356 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-415aae97-f0a9-4eba-8f40-c027b363344f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:52:39.828823 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-415aae97-f0a9-4eba-8f40-c027b363344f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:52:39.829260 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-415aae97-f0a9-4eba-8f40-c027b363344f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:52:39.967804 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-415aae97-f0a9-4eba-8f40-c027b363344f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:52:39.975987 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-415aae97-f0a9-4eba-8f40-c027b363344f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/4a9d6789-8df2-48ba-878b-4f643ee89cfa" status: 200 len: 1682 microversion: 2.1 time: 0.159921 Aug 31 16:52:39.976564 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3527/7036] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:52:39 2022] GET /compute/v2.1/servers/4a9d6789-8df2-48ba-878b-4f643ee89cfa => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:52:40.070738 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d5f63063-c802-4f94-8266-48fd4df059e5 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:52:40.072975 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d5f63063-c802-4f94-8266-48fd4df059e5 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 4a9d6789-8df2-48ba-878b-4f643ee89cfa] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:52:40.078922 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d5f63063-c802-4f94-8266-48fd4df059e5 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:52:40.079414 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d5f63063-c802-4f94-8266-48fd4df059e5 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:52:40.079894 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d5f63063-c802-4f94-8266-48fd4df059e5 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:52:40.080619 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d5f63063-c802-4f94-8266-48fd4df059e5 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:52:40.081831 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d5f63063-c802-4f94-8266-48fd4df059e5 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:52:40.082270 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d5f63063-c802-4f94-8266-48fd4df059e5 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:52:40.152594 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d5f63063-c802-4f94-8266-48fd4df059e5 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "POST /compute/v2.1/servers/4a9d6789-8df2-48ba-878b-4f643ee89cfa/action" status: 200 len: 38457 microversion: 2.1 time: 0.085888 Aug 31 16:52:40.153263 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3510/7037] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:52:40 2022] POST /compute/v2.1/servers/4a9d6789-8df2-48ba-878b-4f643ee89cfa/action => generated 38457 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 16:52:41.480006 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-aaf62ddb-d0fd-46c4-8cd0-ea038eaac13d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:52:41.480897 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-aaf62ddb-d0fd-46c4-8cd0-ea038eaac13d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 4a9d6789-8df2-48ba-878b-4f643ee89cfa] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:52:41.486247 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-2c3ff828-8276-4e4f-a977-57258e5d165f req-3a1366a5-5d8f-4cb0-aab9-25b7bf11cb5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a9d6789-8df2-48ba-878b-4f643ee89cfa", "tag": "7780ca42-78e9-4f1d-bdbe-e18a72e8cdfd"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:52:41.488685 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-aaf62ddb-d0fd-46c4-8cd0-ea038eaac13d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:52:41.489469 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-aaf62ddb-d0fd-46c4-8cd0-ea038eaac13d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:52:41.490146 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-aaf62ddb-d0fd-46c4-8cd0-ea038eaac13d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:52:41.490994 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-aaf62ddb-d0fd-46c4-8cd0-ea038eaac13d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:52:41.491678 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-aaf62ddb-d0fd-46c4-8cd0-ea038eaac13d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:52:41.492251 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-aaf62ddb-d0fd-46c4-8cd0-ea038eaac13d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:52:41.499252 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-2c3ff828-8276-4e4f-a977-57258e5d165f req-3a1366a5-5d8f-4cb0-aab9-25b7bf11cb5a service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:52:41.499759 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-2c3ff828-8276-4e4f-a977-57258e5d165f req-3a1366a5-5d8f-4cb0-aab9-25b7bf11cb5a service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:52:41.500199 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-2c3ff828-8276-4e4f-a977-57258e5d165f req-3a1366a5-5d8f-4cb0-aab9-25b7bf11cb5a service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:52:41.513049 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-2c3ff828-8276-4e4f-a977-57258e5d165f req-3a1366a5-5d8f-4cb0-aab9-25b7bf11cb5a service nova] Creating event network-changed:7780ca42-78e9-4f1d-bdbe-e18a72e8cdfd for instance 4a9d6789-8df2-48ba-878b-4f643ee89cfa on n-h2-850499-9 Aug 31 16:52:41.518242 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-2c3ff828-8276-4e4f-a977-57258e5d165f req-3a1366a5-5d8f-4cb0-aab9-25b7bf11cb5a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036047 Aug 31 16:52:41.519866 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3511/7038] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:52:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:52:41.522139 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-aaf62ddb-d0fd-46c4-8cd0-ea038eaac13d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 4a9d6789-8df2-48ba-878b-4f643ee89cfa] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:52:41.624607 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-aaf62ddb-d0fd-46c4-8cd0-ea038eaac13d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "DELETE /compute/v2.1/servers/4a9d6789-8df2-48ba-878b-4f643ee89cfa" status: 204 len: 0 microversion: 2.1 time: 0.148306 Aug 31 16:52:41.625786 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3528/7039] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:52:41 2022] DELETE /compute/v2.1/servers/4a9d6789-8df2-48ba-878b-4f643ee89cfa => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:52:41.636987 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2b01ccf2-17e8-49ce-9bb8-9d2ca509a56b tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:52:41.637998 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2b01ccf2-17e8-49ce-9bb8-9d2ca509a56b tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 4a9d6789-8df2-48ba-878b-4f643ee89cfa] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:52:41.645891 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2b01ccf2-17e8-49ce-9bb8-9d2ca509a56b tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:52:41.646511 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2b01ccf2-17e8-49ce-9bb8-9d2ca509a56b tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:52:41.647022 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2b01ccf2-17e8-49ce-9bb8-9d2ca509a56b tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:52:41.647834 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2b01ccf2-17e8-49ce-9bb8-9d2ca509a56b tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:52:41.648371 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2b01ccf2-17e8-49ce-9bb8-9d2ca509a56b tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:52:41.648875 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2b01ccf2-17e8-49ce-9bb8-9d2ca509a56b tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:52:41.793818 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-2b01ccf2-17e8-49ce-9bb8-9d2ca509a56b tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:52:41.803852 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2b01ccf2-17e8-49ce-9bb8-9d2ca509a56b tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/4a9d6789-8df2-48ba-878b-4f643ee89cfa" status: 200 len: 1688 microversion: 2.1 time: 0.171676 Aug 31 16:52:41.804450 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3512/7040] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:52:41 2022] GET /compute/v2.1/servers/4a9d6789-8df2-48ba-878b-4f643ee89cfa => generated 1688 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:52:42.827179 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-eeeb320d-7418-42dd-8280-4a544fe9a5a4 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:52:42.827941 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-eeeb320d-7418-42dd-8280-4a544fe9a5a4 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 4a9d6789-8df2-48ba-878b-4f643ee89cfa] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:52:42.835604 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eeeb320d-7418-42dd-8280-4a544fe9a5a4 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:52:42.836139 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eeeb320d-7418-42dd-8280-4a544fe9a5a4 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:52:42.836598 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eeeb320d-7418-42dd-8280-4a544fe9a5a4 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:52:42.837314 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eeeb320d-7418-42dd-8280-4a544fe9a5a4 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:52:42.837790 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eeeb320d-7418-42dd-8280-4a544fe9a5a4 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:52:42.838237 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eeeb320d-7418-42dd-8280-4a544fe9a5a4 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:52:42.975712 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-eeeb320d-7418-42dd-8280-4a544fe9a5a4 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:52:42.983538 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-eeeb320d-7418-42dd-8280-4a544fe9a5a4 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/4a9d6789-8df2-48ba-878b-4f643ee89cfa" status: 200 len: 1688 microversion: 2.1 time: 0.160649 Aug 31 16:52:42.984116 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3529/7041] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:52:42 2022] GET /compute/v2.1/servers/4a9d6789-8df2-48ba-878b-4f643ee89cfa => generated 1688 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:52:43.549165 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-c52af97c-fdff-45b0-846e-d407fa9337b5 req-eef2f411-a6b4-4a8f-8447-c2c47c8ba8a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a9d6789-8df2-48ba-878b-4f643ee89cfa", "name": "network-vif-deleted", "tag": "7780ca42-78e9-4f1d-bdbe-e18a72e8cdfd"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:52:43.566133 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-c52af97c-fdff-45b0-846e-d407fa9337b5 req-eef2f411-a6b4-4a8f-8447-c2c47c8ba8a4 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:52:43.566957 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-c52af97c-fdff-45b0-846e-d407fa9337b5 req-eef2f411-a6b4-4a8f-8447-c2c47c8ba8a4 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:52:43.567753 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-c52af97c-fdff-45b0-846e-d407fa9337b5 req-eef2f411-a6b4-4a8f-8447-c2c47c8ba8a4 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:52:43.586625 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-c52af97c-fdff-45b0-846e-d407fa9337b5 req-eef2f411-a6b4-4a8f-8447-c2c47c8ba8a4 service nova] Creating event network-vif-deleted:7780ca42-78e9-4f1d-bdbe-e18a72e8cdfd for instance 4a9d6789-8df2-48ba-878b-4f643ee89cfa on n-h2-850499-9 Aug 31 16:52:43.593846 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-c52af97c-fdff-45b0-846e-d407fa9337b5 req-eef2f411-a6b4-4a8f-8447-c2c47c8ba8a4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050708 Aug 31 16:52:43.595095 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3513/7042] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:52:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:52:44.005940 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7b0b5195-60d9-4296-a362-e5321bff9b8f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:52:44.006652 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7b0b5195-60d9-4296-a362-e5321bff9b8f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 4a9d6789-8df2-48ba-878b-4f643ee89cfa] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:52:44.014461 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7b0b5195-60d9-4296-a362-e5321bff9b8f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:52:44.014978 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7b0b5195-60d9-4296-a362-e5321bff9b8f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:52:44.015432 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7b0b5195-60d9-4296-a362-e5321bff9b8f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:52:44.016195 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7b0b5195-60d9-4296-a362-e5321bff9b8f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:52:44.016676 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7b0b5195-60d9-4296-a362-e5321bff9b8f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:52:44.017128 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7b0b5195-60d9-4296-a362-e5321bff9b8f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:52:44.055898 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7b0b5195-60d9-4296-a362-e5321bff9b8f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:52:44.056417 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7b0b5195-60d9-4296-a362-e5321bff9b8f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:52:44.056876 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7b0b5195-60d9-4296-a362-e5321bff9b8f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:52:44.057339 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-7b0b5195-60d9-4296-a362-e5321bff9b8f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lazy-loading 'fault' on Instance uuid 4a9d6789-8df2-48ba-878b-4f643ee89cfa {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:52:44.103384 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7b0b5195-60d9-4296-a362-e5321bff9b8f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:52:44.113614 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7b0b5195-60d9-4296-a362-e5321bff9b8f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/4a9d6789-8df2-48ba-878b-4f643ee89cfa" status: 200 len: 1355 microversion: 2.1 time: 0.112046 Aug 31 16:52:44.114336 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3530/7043] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:52:44 2022] GET /compute/v2.1/servers/4a9d6789-8df2-48ba-878b-4f643ee89cfa => generated 1355 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:52:45.141266 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-762d4b19-3069-4704-9201-247ebacaa82f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:52:45.142079 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-762d4b19-3069-4704-9201-247ebacaa82f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 4a9d6789-8df2-48ba-878b-4f643ee89cfa] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:52:45.150331 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-762d4b19-3069-4704-9201-247ebacaa82f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:52:45.150824 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-762d4b19-3069-4704-9201-247ebacaa82f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:52:45.151275 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-762d4b19-3069-4704-9201-247ebacaa82f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:52:45.152344 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-762d4b19-3069-4704-9201-247ebacaa82f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:52:45.152939 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-762d4b19-3069-4704-9201-247ebacaa82f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:52:45.153378 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-762d4b19-3069-4704-9201-247ebacaa82f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:52:45.168248 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-762d4b19-3069-4704-9201-247ebacaa82f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] HTTP exception thrown: Instance 4a9d6789-8df2-48ba-878b-4f643ee89cfa could not be found. Aug 31 16:52:45.169909 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-762d4b19-3069-4704-9201-247ebacaa82f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Request method failure captured: Aug 31 16:52:45.169909 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/4a9d6789-8df2-48ba-878b-4f643ee89cfa HTTP/1.1 Aug 31 16:52:45.169909 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:52:45.169909 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:52:45.169909 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:52:45.169909 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:52:45.169909 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:52:45.169909 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:52:45.169909 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:52:45.169909 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:52:45.169909 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD4_WgD4QikPr5cF-bgJByIIY9om79DYcPMqMqsO-QLvTluETH-73GviQTPoMUqKYlX3NhUluX-Xu-yN_DDF2dOtGmm0lyWPtEq7FsxUNcGFIoyzKHnCgn3ibP5w1pC53PzHFJSukSTZE-QhQ71cjyt3B2uRrfnTMcNRrq4qjkk4kSj8 Aug 31 16:52:45.169909 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:52:45.169909 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:52:45.169909 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:52:45.169909 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:52:45.169909 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:52:45.169909 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:52:45.169909 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 1464b491651b43498f56ffcbe24646d8 Aug 31 16:52:45.169909 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-386022060 Aug 31 16:52:45.169909 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:52:45.169909 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:52:45.169909 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1464b491651b43498f56ffcbe24646d8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1464b491651b43498f56ffcbe24646d8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1464b491651b43498f56ffcbe24646d8", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1464b491651b43498f56ffcbe24646d8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:52:45.169909 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-TestNetworkAdvancedServerOps-386022060 Aug 31 16:52:45.169909 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 1464b491651b43498f56ffcbe24646d8 Aug 31 16:52:45.169909 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-386022060 Aug 31 16:52:45.169909 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-TestNetworkAdvancedServerOps-386022060-project Aug 31 16:52:45.169909 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:52:45.169909 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:52:45.169909 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: bf392720aaea4a068b23404ef76ccd5f Aug 31 16:52:45.169909 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-TestNetworkAdvancedServerOps-386022060-project Aug 31 16:52:45.169909 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:52:45.169909 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance 4a9d6789-8df2-48ba-878b-4f643ee89cfa could not be found. Aug 31 16:52:45.169909 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '4a9d6789-8df2-48ba-878b-4f643ee89cfa'} Aug 31 16:52:45.169909 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:52:45.169909 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:52:45.169909 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:52:45.169909 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:52:45.169909 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:52:45.169909 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:52:45.169909 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:52:45.169909 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:52:45.169909 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:52:45.169909 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:52:45.169909 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a9d6789-8df2-48ba-878b-4f643ee89cfa could not be found. Aug 31 16:52:45.169909 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:52:45.169909 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:52:45.169909 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:52:45.169909 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:52:45.169909 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:52:45.169909 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:52:45.169909 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:52:45.169909 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:52:45.169909 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:52:45.169909 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:52:45.169909 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:52:45.169909 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:52:45.169909 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:52:45.169909 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:52:45.169909 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:52:45.169909 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:52:45.169909 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a9d6789-8df2-48ba-878b-4f643ee89cfa could not be found. Aug 31 16:52:45.169909 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:52:45.169909 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:52:45.173924 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:52:45.173924 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:52:45.173924 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:52:45.173924 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:52:45.173924 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:52:45.173924 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:52:45.173924 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a9d6789-8df2-48ba-878b-4f643ee89cfa could not be found. Aug 31 16:52:45.173924 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:52:45.173924 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-762d4b19-3069-4704-9201-247ebacaa82f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Returning 404 to user: Instance 4a9d6789-8df2-48ba-878b-4f643ee89cfa could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:52:45.173924 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-762d4b19-3069-4704-9201-247ebacaa82f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/4a9d6789-8df2-48ba-878b-4f643ee89cfa" status: 404 len: 111 microversion: 2.1 time: 0.036869 Aug 31 16:52:45.173924 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3514/7044] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:52:45 2022] GET /compute/v2.1/servers/4a9d6789-8df2-48ba-878b-4f643ee89cfa => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:52:48.379537 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-fdecc212-601b-4dcd-a97b-e3add3b0f4d8 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '.version_select at 0x7f5ae991bdc0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:52:48.415190 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-fdecc212-601b-4dcd-a97b-e3add3b0f4d8 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1645588075" status: 202 len: 0 microversion: 2.1 time: 0.040301 Aug 31 16:52:48.415954 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3531/7045] 10.222.0.61 () {58 vars in 1284 bytes} [Wed Aug 31 16:52:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1645588075 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:52:48.449201 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-09c7e947-4636-4142-8a08-80781c29158a tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Action: 'create', calling method: .version_select at 0x7f5ae3c851f0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1958334303", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEY4zZLWoenaMsG/VADNnROnfdZN0awg7vNnEJgqe7sbuniuJBFBTF/SeYR9os6Y4DIQ7/gE1fYBDXBpVOwUJQqCF0PLXOMDpIUavSuX+DmyYCoCiY4Xp83nBEVAB05+Yg=="}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:52:48.470400 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-09c7e947-4636-4142-8a08-80781c29158a tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Getting quotas for project 1464b491651b43498f56ffcbe24646d8. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:52:48.476980 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-09c7e947-4636-4142-8a08-80781c29158a tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Getting quotas for user bf392720aaea4a068b23404ef76ccd5f and project 1464b491651b43498f56ffcbe24646d8. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:52:48.503833 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-09c7e947-4636-4142-8a08-80781c29158a tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.059222 Aug 31 16:52:48.504426 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3515/7046] 10.222.0.61 () {60 vars in 1159 bytes} [Wed Aug 31 16:52:48 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:52:54.496018 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:52:54.502331 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3453c014-1815-4323-9ab8-5c3a211fc1fb tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-826656744", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "networks": [{"uuid": "859231f4-d4ba-4503-8d45-5b79c4df9f86"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1958334303", "security_groups": [{"name": "tempest-secgroup-smoke-1684579986"}]}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:52:54.513099 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:52:54.649862 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-3453c014-1815-4323-9ab8-5c3a211fc1fb tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] validate_networks() for [('859231f4-d4ba-4503-8d45-5b79c4df9f86', None, None, None, None, None)] {{(pid=122257) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:52:55.175833 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-3453c014-1815-4323-9ab8-5c3a211fc1fb tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:52:55.176282 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-3453c014-1815-4323-9ab8-5c3a211fc1fb tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:52:55.176772 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-3453c014-1815-4323-9ab8-5c3a211fc1fb tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:52:55.177222 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-3453c014-1815-4323-9ab8-5c3a211fc1fb tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:52:55.177674 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-3453c014-1815-4323-9ab8-5c3a211fc1fb tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:52:55.186417 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3453c014-1815-4323-9ab8-5c3a211fc1fb tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:52:55.186913 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3453c014-1815-4323-9ab8-5c3a211fc1fb tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:52:55.187438 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3453c014-1815-4323-9ab8-5c3a211fc1fb tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:52:55.188405 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3453c014-1815-4323-9ab8-5c3a211fc1fb tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:52:55.188877 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3453c014-1815-4323-9ab8-5c3a211fc1fb tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:52:55.189316 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3453c014-1815-4323-9ab8-5c3a211fc1fb tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:52:55.210117 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-3453c014-1815-4323-9ab8-5c3a211fc1fb tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Getting quotas for project 1464b491651b43498f56ffcbe24646d8. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:52:55.217189 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-3453c014-1815-4323-9ab8-5c3a211fc1fb tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Getting quotas for user bf392720aaea4a068b23404ef76ccd5f and project 1464b491651b43498f56ffcbe24646d8. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:52:55.232408 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3453c014-1815-4323-9ab8-5c3a211fc1fb tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Going to run 1 instances... {{(pid=122257) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:52:55.234729 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3453c014-1815-4323-9ab8-5c3a211fc1fb tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 412f872c-ead6-4a31-9ed3-b29f2237ae8d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:52:55.286931 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3453c014-1815-4323-9ab8-5c3a211fc1fb tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.792281 Aug 31 16:52:55.287662 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3532/7047] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:52:54 2022] POST /compute/v2.1/servers => generated 406 bytes in 794 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 16:52:55.296931 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=72 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:52:55.301926 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-85f06d5c-b229-45e3-af32-863cf621300a tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:52:55.302555 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-85f06d5c-b229-45e3-af32-863cf621300a tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 412f872c-ead6-4a31-9ed3-b29f2237ae8d] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:52:55.304427 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:52:55.386369 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-85f06d5c-b229-45e3-af32-863cf621300a tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:52:55.402144 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-85f06d5c-b229-45e3-af32-863cf621300a tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/412f872c-ead6-4a31-9ed3-b29f2237ae8d" status: 200 len: 1266 microversion: 2.1 time: 0.106909 Aug 31 16:52:55.402828 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3516/7048] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:52:55 2022] GET /compute/v2.1/servers/412f872c-ead6-4a31-9ed3-b29f2237ae8d => generated 1266 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:52:56.425652 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-fbab8fb5-1b0b-41f7-b3a0-4852fef83281 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:52:56.426884 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-fbab8fb5-1b0b-41f7-b3a0-4852fef83281 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 412f872c-ead6-4a31-9ed3-b29f2237ae8d] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:52:56.435523 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fbab8fb5-1b0b-41f7-b3a0-4852fef83281 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:52:56.436062 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fbab8fb5-1b0b-41f7-b3a0-4852fef83281 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:52:56.436525 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fbab8fb5-1b0b-41f7-b3a0-4852fef83281 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:52:56.437760 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fbab8fb5-1b0b-41f7-b3a0-4852fef83281 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:52:56.438502 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fbab8fb5-1b0b-41f7-b3a0-4852fef83281 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:52:56.438966 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fbab8fb5-1b0b-41f7-b3a0-4852fef83281 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:52:56.913204 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-fbab8fb5-1b0b-41f7-b3a0-4852fef83281 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:52:56.921449 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-fbab8fb5-1b0b-41f7-b3a0-4852fef83281 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/412f872c-ead6-4a31-9ed3-b29f2237ae8d" status: 200 len: 1326 microversion: 2.1 time: 0.501227 Aug 31 16:52:56.922112 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3533/7049] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:52:56 2022] GET /compute/v2.1/servers/412f872c-ead6-4a31-9ed3-b29f2237ae8d => generated 1326 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:52:57.951783 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ab2e4592-afb2-42f7-85f4-5fe5df47be0d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:52:57.953007 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ab2e4592-afb2-42f7-85f4-5fe5df47be0d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 412f872c-ead6-4a31-9ed3-b29f2237ae8d] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:52:57.969273 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ab2e4592-afb2-42f7-85f4-5fe5df47be0d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:52:57.970065 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ab2e4592-afb2-42f7-85f4-5fe5df47be0d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:52:57.970819 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ab2e4592-afb2-42f7-85f4-5fe5df47be0d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:52:57.972103 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ab2e4592-afb2-42f7-85f4-5fe5df47be0d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:52:57.972614 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ab2e4592-afb2-42f7-85f4-5fe5df47be0d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:52:57.973209 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ab2e4592-afb2-42f7-85f4-5fe5df47be0d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:52:58.202421 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ab2e4592-afb2-42f7-85f4-5fe5df47be0d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:52:58.211229 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ab2e4592-afb2-42f7-85f4-5fe5df47be0d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/412f872c-ead6-4a31-9ed3-b29f2237ae8d" status: 200 len: 1392 microversion: 2.1 time: 0.264566 Aug 31 16:52:58.211921 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3517/7050] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:52:57 2022] GET /compute/v2.1/servers/412f872c-ead6-4a31-9ed3-b29f2237ae8d => generated 1392 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:52:58.473224 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-cdfae2b3-73c6-4078-a247-75b6367a033a req-25cd1c17-f7c8-4afd-9942-d3bd5cd65070 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "412f872c-ead6-4a31-9ed3-b29f2237ae8d", "tag": "ee079756-27e9-4a85-a0e9-8b1a89d91205"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:52:58.496689 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-cdfae2b3-73c6-4078-a247-75b6367a033a req-25cd1c17-f7c8-4afd-9942-d3bd5cd65070 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:52:58.497597 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-cdfae2b3-73c6-4078-a247-75b6367a033a req-25cd1c17-f7c8-4afd-9942-d3bd5cd65070 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:52:58.498412 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-cdfae2b3-73c6-4078-a247-75b6367a033a req-25cd1c17-f7c8-4afd-9942-d3bd5cd65070 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:52:58.522970 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-cdfae2b3-73c6-4078-a247-75b6367a033a req-25cd1c17-f7c8-4afd-9942-d3bd5cd65070 service nova] Creating event network-changed:ee079756-27e9-4a85-a0e9-8b1a89d91205 for instance 412f872c-ead6-4a31-9ed3-b29f2237ae8d on n-h1-850499-9 Aug 31 16:52:58.529340 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-cdfae2b3-73c6-4078-a247-75b6367a033a req-25cd1c17-f7c8-4afd-9942-d3bd5cd65070 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064473 Aug 31 16:52:58.529964 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3534/7051] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:52:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:52:59.233510 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-760cef4f-5627-4e1e-859a-87ccb72b0073 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:52:59.234122 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-760cef4f-5627-4e1e-859a-87ccb72b0073 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 412f872c-ead6-4a31-9ed3-b29f2237ae8d] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:52:59.241697 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-760cef4f-5627-4e1e-859a-87ccb72b0073 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:52:59.242185 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-760cef4f-5627-4e1e-859a-87ccb72b0073 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:52:59.242624 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-760cef4f-5627-4e1e-859a-87ccb72b0073 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:52:59.243318 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-760cef4f-5627-4e1e-859a-87ccb72b0073 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:52:59.243799 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-760cef4f-5627-4e1e-859a-87ccb72b0073 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:52:59.244253 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-760cef4f-5627-4e1e-859a-87ccb72b0073 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:52:59.384273 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-760cef4f-5627-4e1e-859a-87ccb72b0073 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:52:59.393319 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-760cef4f-5627-4e1e-859a-87ccb72b0073 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/412f872c-ead6-4a31-9ed3-b29f2237ae8d" status: 200 len: 1392 microversion: 2.1 time: 0.163473 Aug 31 16:52:59.395017 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3518/7052] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:52:59 2022] GET /compute/v2.1/servers/412f872c-ead6-4a31-9ed3-b29f2237ae8d => generated 1392 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:53:00.415735 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a8723d56-ec2d-46d3-ac6c-c272492c556d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:53:00.416464 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a8723d56-ec2d-46d3-ac6c-c272492c556d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 412f872c-ead6-4a31-9ed3-b29f2237ae8d] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:53:00.422733 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a8723d56-ec2d-46d3-ac6c-c272492c556d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:00.423237 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a8723d56-ec2d-46d3-ac6c-c272492c556d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:00.423739 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a8723d56-ec2d-46d3-ac6c-c272492c556d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:00.424985 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a8723d56-ec2d-46d3-ac6c-c272492c556d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:00.425824 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a8723d56-ec2d-46d3-ac6c-c272492c556d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:00.426633 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a8723d56-ec2d-46d3-ac6c-c272492c556d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:00.565771 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a8723d56-ec2d-46d3-ac6c-c272492c556d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:53:00.573886 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a8723d56-ec2d-46d3-ac6c-c272492c556d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/412f872c-ead6-4a31-9ed3-b29f2237ae8d" status: 200 len: 1392 microversion: 2.1 time: 0.163308 Aug 31 16:53:00.574446 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3535/7053] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:53:00 2022] GET /compute/v2.1/servers/412f872c-ead6-4a31-9ed3-b29f2237ae8d => generated 1392 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:53:01.598979 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8d4bed14-7777-47f1-9e81-e58ace9df52d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:53:01.601443 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8d4bed14-7777-47f1-9e81-e58ace9df52d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 412f872c-ead6-4a31-9ed3-b29f2237ae8d] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:53:01.608727 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8d4bed14-7777-47f1-9e81-e58ace9df52d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:01.609227 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8d4bed14-7777-47f1-9e81-e58ace9df52d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:01.609678 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8d4bed14-7777-47f1-9e81-e58ace9df52d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:01.610395 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8d4bed14-7777-47f1-9e81-e58ace9df52d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:01.611010 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8d4bed14-7777-47f1-9e81-e58ace9df52d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:01.611304 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8d4bed14-7777-47f1-9e81-e58ace9df52d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:01.755423 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8d4bed14-7777-47f1-9e81-e58ace9df52d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:53:01.763341 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8d4bed14-7777-47f1-9e81-e58ace9df52d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/412f872c-ead6-4a31-9ed3-b29f2237ae8d" status: 200 len: 1392 microversion: 2.1 time: 0.170755 Aug 31 16:53:01.764015 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3519/7054] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:53:01 2022] GET /compute/v2.1/servers/412f872c-ead6-4a31-9ed3-b29f2237ae8d => generated 1392 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:53:02.785469 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-174cfb9c-eb5c-4954-9a95-39b3e2c90f4a tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:53:02.786087 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-174cfb9c-eb5c-4954-9a95-39b3e2c90f4a tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 412f872c-ead6-4a31-9ed3-b29f2237ae8d] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:53:02.793423 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-174cfb9c-eb5c-4954-9a95-39b3e2c90f4a tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:02.793932 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-174cfb9c-eb5c-4954-9a95-39b3e2c90f4a tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:02.794389 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-174cfb9c-eb5c-4954-9a95-39b3e2c90f4a tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:02.795123 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-174cfb9c-eb5c-4954-9a95-39b3e2c90f4a tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:02.795637 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-174cfb9c-eb5c-4954-9a95-39b3e2c90f4a tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:02.796086 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-174cfb9c-eb5c-4954-9a95-39b3e2c90f4a tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:02.939489 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-174cfb9c-eb5c-4954-9a95-39b3e2c90f4a tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:53:02.948485 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-174cfb9c-eb5c-4954-9a95-39b3e2c90f4a tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/412f872c-ead6-4a31-9ed3-b29f2237ae8d" status: 200 len: 1392 microversion: 2.1 time: 0.167876 Aug 31 16:53:02.949064 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3536/7055] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:53:02 2022] GET /compute/v2.1/servers/412f872c-ead6-4a31-9ed3-b29f2237ae8d => generated 1392 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:53:03.970101 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-619225af-95bc-40d0-8a69-6dbb151e49d7 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:53:03.970724 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-619225af-95bc-40d0-8a69-6dbb151e49d7 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 412f872c-ead6-4a31-9ed3-b29f2237ae8d] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:53:03.977847 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-619225af-95bc-40d0-8a69-6dbb151e49d7 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:03.978336 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-619225af-95bc-40d0-8a69-6dbb151e49d7 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:03.978789 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-619225af-95bc-40d0-8a69-6dbb151e49d7 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:03.979517 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-619225af-95bc-40d0-8a69-6dbb151e49d7 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:03.979991 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-619225af-95bc-40d0-8a69-6dbb151e49d7 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:03.980442 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-619225af-95bc-40d0-8a69-6dbb151e49d7 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:04.123022 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-619225af-95bc-40d0-8a69-6dbb151e49d7 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:53:04.131573 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-619225af-95bc-40d0-8a69-6dbb151e49d7 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/412f872c-ead6-4a31-9ed3-b29f2237ae8d" status: 200 len: 1392 microversion: 2.1 time: 0.165392 Aug 31 16:53:04.132160 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3520/7056] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:53:03 2022] GET /compute/v2.1/servers/412f872c-ead6-4a31-9ed3-b29f2237ae8d => generated 1392 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:53:05.152771 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f04c352d-2320-4690-98d0-37368636e0f2 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:53:05.153406 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f04c352d-2320-4690-98d0-37368636e0f2 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 412f872c-ead6-4a31-9ed3-b29f2237ae8d] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:53:05.161558 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f04c352d-2320-4690-98d0-37368636e0f2 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:05.162068 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f04c352d-2320-4690-98d0-37368636e0f2 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:05.162533 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f04c352d-2320-4690-98d0-37368636e0f2 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:05.163270 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f04c352d-2320-4690-98d0-37368636e0f2 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:05.163774 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f04c352d-2320-4690-98d0-37368636e0f2 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:05.164228 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f04c352d-2320-4690-98d0-37368636e0f2 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:05.196909 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:53:05.225902 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=6 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:53:05.308987 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f04c352d-2320-4690-98d0-37368636e0f2 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:53:05.317311 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f04c352d-2320-4690-98d0-37368636e0f2 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/412f872c-ead6-4a31-9ed3-b29f2237ae8d" status: 200 len: 1392 microversion: 2.1 time: 0.168586 Aug 31 16:53:05.317900 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3537/7057] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:53:05 2022] GET /compute/v2.1/servers/412f872c-ead6-4a31-9ed3-b29f2237ae8d => generated 1392 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:53:05.453738 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-a5765f14-be06-4060-8258-2d0d917d604c req-fc5483c3-0804-441a-9d44-f839a588b9a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "412f872c-ead6-4a31-9ed3-b29f2237ae8d", "name": "network-vif-plugged", "status": "completed", "tag": "ee079756-27e9-4a85-a0e9-8b1a89d91205"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:53:05.462211 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=6 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:53:05.469020 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-a5765f14-be06-4060-8258-2d0d917d604c req-fc5483c3-0804-441a-9d44-f839a588b9a8 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:05.470826 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-a5765f14-be06-4060-8258-2d0d917d604c req-fc5483c3-0804-441a-9d44-f839a588b9a8 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:05.470826 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-a5765f14-be06-4060-8258-2d0d917d604c req-fc5483c3-0804-441a-9d44-f839a588b9a8 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:05.484039 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-a5765f14-be06-4060-8258-2d0d917d604c req-fc5483c3-0804-441a-9d44-f839a588b9a8 service nova] Creating event network-vif-plugged:ee079756-27e9-4a85-a0e9-8b1a89d91205 for instance 412f872c-ead6-4a31-9ed3-b29f2237ae8d on n-h1-850499-9 Aug 31 16:53:05.489246 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-a5765f14-be06-4060-8258-2d0d917d604c req-fc5483c3-0804-441a-9d44-f839a588b9a8 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040344 Aug 31 16:53:05.489860 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3521/7058] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:53:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:53:06.338582 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-dabc7c0d-1539-4b00-ab45-1aa702d66c54 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:53:06.339254 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-dabc7c0d-1539-4b00-ab45-1aa702d66c54 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 412f872c-ead6-4a31-9ed3-b29f2237ae8d] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:53:06.347450 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dabc7c0d-1539-4b00-ab45-1aa702d66c54 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:06.347988 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dabc7c0d-1539-4b00-ab45-1aa702d66c54 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:06.348463 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dabc7c0d-1539-4b00-ab45-1aa702d66c54 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:06.349228 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dabc7c0d-1539-4b00-ab45-1aa702d66c54 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:06.349662 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dabc7c0d-1539-4b00-ab45-1aa702d66c54 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:06.350142 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dabc7c0d-1539-4b00-ab45-1aa702d66c54 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:06.495371 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-dabc7c0d-1539-4b00-ab45-1aa702d66c54 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:53:06.504878 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-dabc7c0d-1539-4b00-ab45-1aa702d66c54 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/412f872c-ead6-4a31-9ed3-b29f2237ae8d" status: 200 len: 1392 microversion: 2.1 time: 0.170108 Aug 31 16:53:06.505495 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3538/7059] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:53:06 2022] GET /compute/v2.1/servers/412f872c-ead6-4a31-9ed3-b29f2237ae8d => generated 1392 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:53:07.529394 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d0578ebd-c993-49d9-97bb-eea69311dc0b tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:53:07.530092 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d0578ebd-c993-49d9-97bb-eea69311dc0b tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 412f872c-ead6-4a31-9ed3-b29f2237ae8d] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:53:07.536582 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d0578ebd-c993-49d9-97bb-eea69311dc0b tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:07.537069 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d0578ebd-c993-49d9-97bb-eea69311dc0b tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:07.537505 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d0578ebd-c993-49d9-97bb-eea69311dc0b tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:07.538195 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d0578ebd-c993-49d9-97bb-eea69311dc0b tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:07.538650 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d0578ebd-c993-49d9-97bb-eea69311dc0b tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:07.539079 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d0578ebd-c993-49d9-97bb-eea69311dc0b tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:07.684523 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d0578ebd-c993-49d9-97bb-eea69311dc0b tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:53:07.693702 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d0578ebd-c993-49d9-97bb-eea69311dc0b tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/412f872c-ead6-4a31-9ed3-b29f2237ae8d" status: 200 len: 1563 microversion: 2.1 time: 0.169410 Aug 31 16:53:07.694295 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3522/7060] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:53:07 2022] GET /compute/v2.1/servers/412f872c-ead6-4a31-9ed3-b29f2237ae8d => generated 1563 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:53:07.716068 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b30deac2-52ca-41a5-ba32-b8739315f6b4 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:53:07.716705 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b30deac2-52ca-41a5-ba32-b8739315f6b4 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 412f872c-ead6-4a31-9ed3-b29f2237ae8d] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:53:07.723853 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b30deac2-52ca-41a5-ba32-b8739315f6b4 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:07.724362 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b30deac2-52ca-41a5-ba32-b8739315f6b4 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:07.724825 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b30deac2-52ca-41a5-ba32-b8739315f6b4 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:07.725546 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b30deac2-52ca-41a5-ba32-b8739315f6b4 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:07.726024 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b30deac2-52ca-41a5-ba32-b8739315f6b4 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:07.726469 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b30deac2-52ca-41a5-ba32-b8739315f6b4 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:07.889229 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b30deac2-52ca-41a5-ba32-b8739315f6b4 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:53:07.897743 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b30deac2-52ca-41a5-ba32-b8739315f6b4 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/412f872c-ead6-4a31-9ed3-b29f2237ae8d" status: 200 len: 1563 microversion: 2.1 time: 0.186340 Aug 31 16:53:07.898350 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3539/7061] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:53:07 2022] GET /compute/v2.1/servers/412f872c-ead6-4a31-9ed3-b29f2237ae8d => generated 1563 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:53:09.603565 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1c35a0e4-dbf7-4c66-8eca-5f4c93e1e21f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:53:09.608996 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-cdc3bd4c-7255-4bc2-8766-e5846da036a6 req-f4da57f1-0c3e-4bc2-ae8c-c82b90e0984c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "412f872c-ead6-4a31-9ed3-b29f2237ae8d", "tag": "ee079756-27e9-4a85-a0e9-8b1a89d91205"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:53:09.616932 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1c35a0e4-dbf7-4c66-8eca-5f4c93e1e21f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 412f872c-ead6-4a31-9ed3-b29f2237ae8d] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:53:09.624512 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1c35a0e4-dbf7-4c66-8eca-5f4c93e1e21f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:09.624930 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-cdc3bd4c-7255-4bc2-8766-e5846da036a6 req-f4da57f1-0c3e-4bc2-ae8c-c82b90e0984c service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:09.625039 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1c35a0e4-dbf7-4c66-8eca-5f4c93e1e21f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:09.625450 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1c35a0e4-dbf7-4c66-8eca-5f4c93e1e21f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:09.625567 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-cdc3bd4c-7255-4bc2-8766-e5846da036a6 req-f4da57f1-0c3e-4bc2-ae8c-c82b90e0984c service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:09.626090 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-cdc3bd4c-7255-4bc2-8766-e5846da036a6 req-f4da57f1-0c3e-4bc2-ae8c-c82b90e0984c service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:09.626192 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1c35a0e4-dbf7-4c66-8eca-5f4c93e1e21f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:09.626615 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1c35a0e4-dbf7-4c66-8eca-5f4c93e1e21f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:09.627051 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1c35a0e4-dbf7-4c66-8eca-5f4c93e1e21f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:09.639227 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-cdc3bd4c-7255-4bc2-8766-e5846da036a6 req-f4da57f1-0c3e-4bc2-ae8c-c82b90e0984c service nova] Creating event network-changed:ee079756-27e9-4a85-a0e9-8b1a89d91205 for instance 412f872c-ead6-4a31-9ed3-b29f2237ae8d on n-h1-850499-9 Aug 31 16:53:09.645685 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-cdc3bd4c-7255-4bc2-8766-e5846da036a6 req-f4da57f1-0c3e-4bc2-ae8c-c82b90e0984c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039762 Aug 31 16:53:09.646614 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3540/7062] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:53:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:53:09.865711 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1c35a0e4-dbf7-4c66-8eca-5f4c93e1e21f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:53:09.874295 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1c35a0e4-dbf7-4c66-8eca-5f4c93e1e21f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/412f872c-ead6-4a31-9ed3-b29f2237ae8d" status: 200 len: 1563 microversion: 2.1 time: 0.275124 Aug 31 16:53:09.874992 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3523/7063] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:53:09 2022] GET /compute/v2.1/servers/412f872c-ead6-4a31-9ed3-b29f2237ae8d => generated 1563 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:53:30.583680 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6355c8f5-6e6e-4436-b8ab-6feea1cc80bb tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:53:30.584296 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6355c8f5-6e6e-4436-b8ab-6feea1cc80bb tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: f4cfce12-0ec7-4eb8-b460-ce043fc1e968] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:53:30.585641 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-bdee8287-931a-46db-a0d3-439698a66209 req-6d6970ea-9377-4b92-b5a1-e65569ec3c7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4cfce12-0ec7-4eb8-b460-ce043fc1e968", "tag": "12788af8-acbd-4022-9eaa-f6c945bc2538"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:53:30.587874 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:53:30.588661 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=42 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:53:30.591775 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=17 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:53:30.592840 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=38 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:53:30.594003 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6355c8f5-6e6e-4436-b8ab-6feea1cc80bb tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:30.594610 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6355c8f5-6e6e-4436-b8ab-6feea1cc80bb tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:30.595079 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6355c8f5-6e6e-4436-b8ab-6feea1cc80bb tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:30.596830 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6355c8f5-6e6e-4436-b8ab-6feea1cc80bb tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:30.597319 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6355c8f5-6e6e-4436-b8ab-6feea1cc80bb tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:30.597774 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6355c8f5-6e6e-4436-b8ab-6feea1cc80bb tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:30.600091 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-bdee8287-931a-46db-a0d3-439698a66209 req-6d6970ea-9377-4b92-b5a1-e65569ec3c7d service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:30.600577 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-bdee8287-931a-46db-a0d3-439698a66209 req-6d6970ea-9377-4b92-b5a1-e65569ec3c7d service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:30.601014 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-bdee8287-931a-46db-a0d3-439698a66209 req-6d6970ea-9377-4b92-b5a1-e65569ec3c7d service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:30.613477 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-bdee8287-931a-46db-a0d3-439698a66209 req-6d6970ea-9377-4b92-b5a1-e65569ec3c7d service nova] Creating event network-changed:12788af8-acbd-4022-9eaa-f6c945bc2538 for instance f4cfce12-0ec7-4eb8-b460-ce043fc1e968 on n-h2-850499-9 Aug 31 16:53:30.618662 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-bdee8287-931a-46db-a0d3-439698a66209 req-6d6970ea-9377-4b92-b5a1-e65569ec3c7d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036892 Aug 31 16:53:30.619363 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3524/7064] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:53:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:53:30.627308 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6355c8f5-6e6e-4436-b8ab-6feea1cc80bb tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: f4cfce12-0ec7-4eb8-b460-ce043fc1e968] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:53:30.719196 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6355c8f5-6e6e-4436-b8ab-6feea1cc80bb tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "DELETE /compute/v2.1/servers/f4cfce12-0ec7-4eb8-b460-ce043fc1e968" status: 204 len: 0 microversion: 2.1 time: 0.139729 Aug 31 16:53:30.720020 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3541/7065] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:53:30 2022] DELETE /compute/v2.1/servers/f4cfce12-0ec7-4eb8-b460-ce043fc1e968 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 16:53:30.730029 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d2d008fb-a3d5-4554-bea0-35b6e100b823 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:53:30.732030 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d2d008fb-a3d5-4554-bea0-35b6e100b823 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: f4cfce12-0ec7-4eb8-b460-ce043fc1e968] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:53:30.739644 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d2d008fb-a3d5-4554-bea0-35b6e100b823 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:30.740144 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d2d008fb-a3d5-4554-bea0-35b6e100b823 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:30.740588 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d2d008fb-a3d5-4554-bea0-35b6e100b823 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:30.741300 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d2d008fb-a3d5-4554-bea0-35b6e100b823 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:30.741771 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d2d008fb-a3d5-4554-bea0-35b6e100b823 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:30.742221 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d2d008fb-a3d5-4554-bea0-35b6e100b823 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:30.889418 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d2d008fb-a3d5-4554-bea0-35b6e100b823 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:53:30.897611 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d2d008fb-a3d5-4554-bea0-35b6e100b823 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/f4cfce12-0ec7-4eb8-b460-ce043fc1e968" status: 200 len: 1577 microversion: 2.1 time: 0.172588 Aug 31 16:53:30.898430 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3525/7066] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:53:30 2022] GET /compute/v2.1/servers/f4cfce12-0ec7-4eb8-b460-ce043fc1e968 => generated 1577 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:53:31.920626 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4975ae4e-793e-405f-aa7f-d48ec2bb014c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:53:31.921556 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4975ae4e-793e-405f-aa7f-d48ec2bb014c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: f4cfce12-0ec7-4eb8-b460-ce043fc1e968] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:53:31.933761 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4975ae4e-793e-405f-aa7f-d48ec2bb014c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:31.934298 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4975ae4e-793e-405f-aa7f-d48ec2bb014c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:31.934768 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4975ae4e-793e-405f-aa7f-d48ec2bb014c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:31.935921 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4975ae4e-793e-405f-aa7f-d48ec2bb014c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:31.936417 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4975ae4e-793e-405f-aa7f-d48ec2bb014c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:31.936897 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4975ae4e-793e-405f-aa7f-d48ec2bb014c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:32.471423 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-4975ae4e-793e-405f-aa7f-d48ec2bb014c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:53:32.480236 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4975ae4e-793e-405f-aa7f-d48ec2bb014c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/f4cfce12-0ec7-4eb8-b460-ce043fc1e968" status: 200 len: 1577 microversion: 2.1 time: 0.563715 Aug 31 16:53:32.481019 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3542/7067] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:53:31 2022] GET /compute/v2.1/servers/f4cfce12-0ec7-4eb8-b460-ce043fc1e968 => generated 1577 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:53:33.488722 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-999717ae-02e5-4892-8567-1a155763e593 req-416684a9-0d4c-463a-bd62-0ad5baa89fa9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4cfce12-0ec7-4eb8-b460-ce043fc1e968", "name": "network-vif-deleted", "tag": "12788af8-acbd-4022-9eaa-f6c945bc2538"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:53:33.501535 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-999717ae-02e5-4892-8567-1a155763e593 req-416684a9-0d4c-463a-bd62-0ad5baa89fa9 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:33.502666 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-999717ae-02e5-4892-8567-1a155763e593 req-416684a9-0d4c-463a-bd62-0ad5baa89fa9 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:33.502666 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-999717ae-02e5-4892-8567-1a155763e593 req-416684a9-0d4c-463a-bd62-0ad5baa89fa9 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:33.503057 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-789a5735-f006-4655-9b83-f73604e865e2 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:53:33.503733 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-789a5735-f006-4655-9b83-f73604e865e2 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: f4cfce12-0ec7-4eb8-b460-ce043fc1e968] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:53:33.514885 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-999717ae-02e5-4892-8567-1a155763e593 req-416684a9-0d4c-463a-bd62-0ad5baa89fa9 service nova] Creating event network-vif-deleted:12788af8-acbd-4022-9eaa-f6c945bc2538 for instance f4cfce12-0ec7-4eb8-b460-ce043fc1e968 on n-h2-850499-9 Aug 31 16:53:33.517152 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-789a5735-f006-4655-9b83-f73604e865e2 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:33.519312 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-789a5735-f006-4655-9b83-f73604e865e2 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:33.520053 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-789a5735-f006-4655-9b83-f73604e865e2 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:33.520987 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-789a5735-f006-4655-9b83-f73604e865e2 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:33.521474 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-789a5735-f006-4655-9b83-f73604e865e2 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:33.522017 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-789a5735-f006-4655-9b83-f73604e865e2 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:33.522205 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-999717ae-02e5-4892-8567-1a155763e593 req-416684a9-0d4c-463a-bd62-0ad5baa89fa9 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036938 Aug 31 16:53:33.522960 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3526/7068] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:53:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:53:33.591100 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-789a5735-f006-4655-9b83-f73604e865e2 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:53:33.600715 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-789a5735-f006-4655-9b83-f73604e865e2 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/f4cfce12-0ec7-4eb8-b460-ce043fc1e968" status: 200 len: 1225 microversion: 2.1 time: 0.101830 Aug 31 16:53:33.601625 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3543/7069] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:53:33 2022] GET /compute/v2.1/servers/f4cfce12-0ec7-4eb8-b460-ce043fc1e968 => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:53:34.623726 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-bc84bb54-230f-4aac-826c-0effddeafebb tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:53:34.624427 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-bc84bb54-230f-4aac-826c-0effddeafebb tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: f4cfce12-0ec7-4eb8-b460-ce043fc1e968] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:53:34.631640 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bc84bb54-230f-4aac-826c-0effddeafebb tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:34.632130 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bc84bb54-230f-4aac-826c-0effddeafebb tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:34.632570 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bc84bb54-230f-4aac-826c-0effddeafebb tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:34.633288 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bc84bb54-230f-4aac-826c-0effddeafebb tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:34.633828 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bc84bb54-230f-4aac-826c-0effddeafebb tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:34.634258 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bc84bb54-230f-4aac-826c-0effddeafebb tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:34.697663 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-bc84bb54-230f-4aac-826c-0effddeafebb tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:53:34.705856 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-bc84bb54-230f-4aac-826c-0effddeafebb tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/f4cfce12-0ec7-4eb8-b460-ce043fc1e968" status: 200 len: 1225 microversion: 2.1 time: 0.087420 Aug 31 16:53:34.706442 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3527/7070] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:53:34 2022] GET /compute/v2.1/servers/f4cfce12-0ec7-4eb8-b460-ce043fc1e968 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:53:35.726982 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5810c773-8ebc-4bd4-85f3-173ed7df9dca tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:53:35.727859 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5810c773-8ebc-4bd4-85f3-173ed7df9dca tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: f4cfce12-0ec7-4eb8-b460-ce043fc1e968] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:53:35.734905 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5810c773-8ebc-4bd4-85f3-173ed7df9dca tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:35.735415 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5810c773-8ebc-4bd4-85f3-173ed7df9dca tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:35.735910 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5810c773-8ebc-4bd4-85f3-173ed7df9dca tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:35.737218 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5810c773-8ebc-4bd4-85f3-173ed7df9dca tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:35.737845 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5810c773-8ebc-4bd4-85f3-173ed7df9dca tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:35.738290 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5810c773-8ebc-4bd4-85f3-173ed7df9dca tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:35.804910 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5810c773-8ebc-4bd4-85f3-173ed7df9dca tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:53:35.813231 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5810c773-8ebc-4bd4-85f3-173ed7df9dca tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/f4cfce12-0ec7-4eb8-b460-ce043fc1e968" status: 200 len: 1225 microversion: 2.1 time: 0.090190 Aug 31 16:53:35.813812 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3544/7071] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:53:35 2022] GET /compute/v2.1/servers/f4cfce12-0ec7-4eb8-b460-ce043fc1e968 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:53:36.835282 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-23cfa466-ee88-499b-b712-94e6e166cbbb tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:53:36.836029 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-23cfa466-ee88-499b-b712-94e6e166cbbb tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: f4cfce12-0ec7-4eb8-b460-ce043fc1e968] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:53:36.843550 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-23cfa466-ee88-499b-b712-94e6e166cbbb tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:36.844075 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-23cfa466-ee88-499b-b712-94e6e166cbbb tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:36.844452 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-23cfa466-ee88-499b-b712-94e6e166cbbb tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:36.845229 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-23cfa466-ee88-499b-b712-94e6e166cbbb tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:36.845882 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-23cfa466-ee88-499b-b712-94e6e166cbbb tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:36.846334 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-23cfa466-ee88-499b-b712-94e6e166cbbb tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:36.919004 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-23cfa466-ee88-499b-b712-94e6e166cbbb tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:53:36.927044 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-23cfa466-ee88-499b-b712-94e6e166cbbb tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/f4cfce12-0ec7-4eb8-b460-ce043fc1e968" status: 200 len: 1225 microversion: 2.1 time: 0.095962 Aug 31 16:53:36.927651 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3528/7072] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:53:36 2022] GET /compute/v2.1/servers/f4cfce12-0ec7-4eb8-b460-ce043fc1e968 => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:53:37.947906 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-462c1af1-a750-4923-9120-ee9c12fba8a5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:53:37.948627 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-462c1af1-a750-4923-9120-ee9c12fba8a5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: f4cfce12-0ec7-4eb8-b460-ce043fc1e968] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:53:37.957011 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-462c1af1-a750-4923-9120-ee9c12fba8a5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:37.957607 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-462c1af1-a750-4923-9120-ee9c12fba8a5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:37.958142 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-462c1af1-a750-4923-9120-ee9c12fba8a5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:37.958968 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-462c1af1-a750-4923-9120-ee9c12fba8a5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:37.959650 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-462c1af1-a750-4923-9120-ee9c12fba8a5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:37.960208 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-462c1af1-a750-4923-9120-ee9c12fba8a5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:37.994857 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-462c1af1-a750-4923-9120-ee9c12fba8a5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:37.995275 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-462c1af1-a750-4923-9120-ee9c12fba8a5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:37.995771 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-462c1af1-a750-4923-9120-ee9c12fba8a5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:37.996492 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-462c1af1-a750-4923-9120-ee9c12fba8a5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lazy-loading 'fault' on Instance uuid f4cfce12-0ec7-4eb8-b460-ce043fc1e968 {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:53:38.048372 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-462c1af1-a750-4923-9120-ee9c12fba8a5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:53:38.056468 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-462c1af1-a750-4923-9120-ee9c12fba8a5 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/f4cfce12-0ec7-4eb8-b460-ce043fc1e968" status: 200 len: 1230 microversion: 2.1 time: 0.112531 Aug 31 16:53:38.057044 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3545/7073] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:53:37 2022] GET /compute/v2.1/servers/f4cfce12-0ec7-4eb8-b460-ce043fc1e968 => generated 1230 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:53:39.077802 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a8207807-1389-4371-b0a2-5e27fa522f78 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:53:39.078437 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a8207807-1389-4371-b0a2-5e27fa522f78 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: f4cfce12-0ec7-4eb8-b460-ce043fc1e968] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:53:39.086053 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a8207807-1389-4371-b0a2-5e27fa522f78 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:39.086543 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a8207807-1389-4371-b0a2-5e27fa522f78 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:39.086992 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a8207807-1389-4371-b0a2-5e27fa522f78 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:39.087721 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a8207807-1389-4371-b0a2-5e27fa522f78 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:39.088189 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a8207807-1389-4371-b0a2-5e27fa522f78 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:39.088629 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a8207807-1389-4371-b0a2-5e27fa522f78 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:39.103198 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-a8207807-1389-4371-b0a2-5e27fa522f78 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] HTTP exception thrown: Instance f4cfce12-0ec7-4eb8-b460-ce043fc1e968 could not be found. Aug 31 16:53:39.104969 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a8207807-1389-4371-b0a2-5e27fa522f78 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Request method failure captured: Aug 31 16:53:39.104969 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/f4cfce12-0ec7-4eb8-b460-ce043fc1e968 HTTP/1.1 Aug 31 16:53:39.104969 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:53:39.104969 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:53:39.104969 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:53:39.104969 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:53:39.104969 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:53:39.104969 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:53:39.104969 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:53:39.104969 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:53:39.104969 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD47qS8C6HsXEaEmR5vEYZ6_LcYWck6kjg2PE2Sm6XicPmZbBvnd8kXBk0kFrhGPgu84OodaxIz7Gcm1qVV62nKCQjCd-8My5krh8bw3lC-5obyJ5MI9WGooafg2qsKoEyqO0fUDn4HqdbQ-uRSMHzaJZriF8vfhIimZHzzbd5tR6Fco Aug 31 16:53:39.104969 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:53:39.104969 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:53:39.104969 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:53:39.104969 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:53:39.104969 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:53:39.104969 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:53:39.104969 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 798d7eff58b04ab582bac1e87112625f Aug 31 16:53:39.104969 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-TestVolumeBootPattern-1074913281 Aug 31 16:53:39.104969 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:53:39.104969 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:53:39.104969 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/798d7eff58b04ab582bac1e87112625f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/798d7eff58b04ab582bac1e87112625f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_798d7eff58b04ab582bac1e87112625f", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/798d7eff58b04ab582bac1e87112625f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:53:39.104969 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-TestVolumeBootPattern-1074913281 Aug 31 16:53:39.104969 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 798d7eff58b04ab582bac1e87112625f Aug 31 16:53:39.104969 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-TestVolumeBootPattern-1074913281 Aug 31 16:53:39.104969 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-TestVolumeBootPattern-1074913281-project Aug 31 16:53:39.104969 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:53:39.104969 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:53:39.104969 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 588d2ef08d8345a6b6175c8287633270 Aug 31 16:53:39.104969 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-TestVolumeBootPattern-1074913281-project Aug 31 16:53:39.104969 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:53:39.104969 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance f4cfce12-0ec7-4eb8-b460-ce043fc1e968 could not be found. Aug 31 16:53:39.104969 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': 'f4cfce12-0ec7-4eb8-b460-ce043fc1e968'} Aug 31 16:53:39.104969 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:53:39.104969 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:53:39.104969 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:53:39.104969 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:53:39.104969 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:53:39.104969 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:53:39.104969 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:53:39.104969 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:53:39.104969 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:53:39.104969 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:53:39.104969 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4cfce12-0ec7-4eb8-b460-ce043fc1e968 could not be found. Aug 31 16:53:39.104969 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:53:39.104969 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:53:39.104969 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:53:39.104969 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:53:39.104969 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:53:39.104969 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:53:39.104969 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:53:39.104969 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:53:39.104969 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:53:39.104969 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:53:39.104969 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:53:39.104969 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:53:39.104969 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:53:39.104969 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:53:39.104969 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:53:39.104969 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:53:39.104969 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4cfce12-0ec7-4eb8-b460-ce043fc1e968 could not be found. Aug 31 16:53:39.104969 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:53:39.104969 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:53:39.104969 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:53:39.109380 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:53:39.109380 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:53:39.109380 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:53:39.109380 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:53:39.109380 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:53:39.109380 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4cfce12-0ec7-4eb8-b460-ce043fc1e968 could not be found. Aug 31 16:53:39.109380 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:53:39.109380 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a8207807-1389-4371-b0a2-5e27fa522f78 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Returning 404 to user: Instance f4cfce12-0ec7-4eb8-b460-ce043fc1e968 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:53:39.109380 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a8207807-1389-4371-b0a2-5e27fa522f78 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/f4cfce12-0ec7-4eb8-b460-ce043fc1e968" status: 404 len: 111 microversion: 2.1 time: 0.032526 Aug 31 16:53:39.109380 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3529/7074] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:53:39 2022] GET /compute/v2.1/servers/f4cfce12-0ec7-4eb8-b460-ce043fc1e968 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:53:43.183980 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-16bfff75-0aef-4ea5-ad0a-f614c0d445d6 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:53:43.188904 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-16bfff75-0aef-4ea5-ad0a-f614c0d445d6 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 412f872c-ead6-4a31-9ed3-b29f2237ae8d] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:53:43.198974 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-16bfff75-0aef-4ea5-ad0a-f614c0d445d6 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:43.199716 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-16bfff75-0aef-4ea5-ad0a-f614c0d445d6 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:43.200345 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-16bfff75-0aef-4ea5-ad0a-f614c0d445d6 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:43.201214 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-16bfff75-0aef-4ea5-ad0a-f614c0d445d6 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:43.201869 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-16bfff75-0aef-4ea5-ad0a-f614c0d445d6 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:43.202395 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-16bfff75-0aef-4ea5-ad0a-f614c0d445d6 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:43.360585 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-16bfff75-0aef-4ea5-ad0a-f614c0d445d6 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "POST /compute/v2.1/servers/412f872c-ead6-4a31-9ed3-b29f2237ae8d/action" status: 200 len: 24566 microversion: 2.1 time: 0.181624 Aug 31 16:53:43.362828 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3546/7075] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:53:43 2022] POST /compute/v2.1/servers/412f872c-ead6-4a31-9ed3-b29f2237ae8d/action => generated 24566 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 16:53:45.703693 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-ebe7cd6e-e46a-44d0-ad3e-59b7e4223361 req-01eab8d5-782b-40b8-820d-e690a547298d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4987acd8-f1a1-4fb1-ac82-b426d7543100", "tag": "2b784555-0e5f-4057-8c53-bf90f27149bf"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:53:45.704816 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-74a83f6b-d314-4c59-ad28-e3f1a9cd7a9e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:53:45.705938 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-74a83f6b-d314-4c59-ad28-e3f1a9cd7a9e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 4987acd8-f1a1-4fb1-ac82-b426d7543100] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:53:45.714022 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-74a83f6b-d314-4c59-ad28-e3f1a9cd7a9e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:45.714761 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-74a83f6b-d314-4c59-ad28-e3f1a9cd7a9e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:45.715223 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-74a83f6b-d314-4c59-ad28-e3f1a9cd7a9e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:45.715993 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-74a83f6b-d314-4c59-ad28-e3f1a9cd7a9e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:45.716331 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-ebe7cd6e-e46a-44d0-ad3e-59b7e4223361 req-01eab8d5-782b-40b8-820d-e690a547298d service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:45.716821 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-ebe7cd6e-e46a-44d0-ad3e-59b7e4223361 req-01eab8d5-782b-40b8-820d-e690a547298d service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:45.716970 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-74a83f6b-d314-4c59-ad28-e3f1a9cd7a9e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:45.717253 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-ebe7cd6e-e46a-44d0-ad3e-59b7e4223361 req-01eab8d5-782b-40b8-820d-e690a547298d service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:45.717369 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-74a83f6b-d314-4c59-ad28-e3f1a9cd7a9e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:45.729364 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-ebe7cd6e-e46a-44d0-ad3e-59b7e4223361 req-01eab8d5-782b-40b8-820d-e690a547298d service nova] Creating event network-changed:2b784555-0e5f-4057-8c53-bf90f27149bf for instance 4987acd8-f1a1-4fb1-ac82-b426d7543100 on n-h2-850499-9 Aug 31 16:53:45.734909 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-ebe7cd6e-e46a-44d0-ad3e-59b7e4223361 req-01eab8d5-782b-40b8-820d-e690a547298d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035641 Aug 31 16:53:45.735758 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3530/7076] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:53:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:53:45.745280 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-74a83f6b-d314-4c59-ad28-e3f1a9cd7a9e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 4987acd8-f1a1-4fb1-ac82-b426d7543100] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:53:45.827241 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-74a83f6b-d314-4c59-ad28-e3f1a9cd7a9e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "DELETE /compute/v2.1/servers/4987acd8-f1a1-4fb1-ac82-b426d7543100" status: 204 len: 0 microversion: 2.1 time: 0.126264 Aug 31 16:53:45.827879 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3547/7077] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:53:45 2022] DELETE /compute/v2.1/servers/4987acd8-f1a1-4fb1-ac82-b426d7543100 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:53:45.839960 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a5e52676-eb51-4e20-9379-21d0a6e7c4bc tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:53:45.840796 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a5e52676-eb51-4e20-9379-21d0a6e7c4bc tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 4987acd8-f1a1-4fb1-ac82-b426d7543100] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:53:45.851471 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a5e52676-eb51-4e20-9379-21d0a6e7c4bc tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:45.852011 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a5e52676-eb51-4e20-9379-21d0a6e7c4bc tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:45.853081 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a5e52676-eb51-4e20-9379-21d0a6e7c4bc tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:45.855214 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a5e52676-eb51-4e20-9379-21d0a6e7c4bc tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:45.855798 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a5e52676-eb51-4e20-9379-21d0a6e7c4bc tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:45.856240 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a5e52676-eb51-4e20-9379-21d0a6e7c4bc tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:46.002207 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a5e52676-eb51-4e20-9379-21d0a6e7c4bc tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:53:46.010706 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a5e52676-eb51-4e20-9379-21d0a6e7c4bc tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/4987acd8-f1a1-4fb1-ac82-b426d7543100" status: 200 len: 1576 microversion: 2.1 time: 0.176219 Aug 31 16:53:46.015572 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3531/7078] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:53:45 2022] GET /compute/v2.1/servers/4987acd8-f1a1-4fb1-ac82-b426d7543100 => generated 1576 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:53:47.035000 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0d2876de-74da-4ccb-9026-3cf0d43ff25f tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:53:47.035846 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0d2876de-74da-4ccb-9026-3cf0d43ff25f tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 4987acd8-f1a1-4fb1-ac82-b426d7543100] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:53:47.043596 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0d2876de-74da-4ccb-9026-3cf0d43ff25f tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:47.044107 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0d2876de-74da-4ccb-9026-3cf0d43ff25f tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:47.044568 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0d2876de-74da-4ccb-9026-3cf0d43ff25f tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:47.045279 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0d2876de-74da-4ccb-9026-3cf0d43ff25f tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:47.045757 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0d2876de-74da-4ccb-9026-3cf0d43ff25f tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:47.046206 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0d2876de-74da-4ccb-9026-3cf0d43ff25f tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:47.254215 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0d2876de-74da-4ccb-9026-3cf0d43ff25f tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:53:47.262321 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0d2876de-74da-4ccb-9026-3cf0d43ff25f tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/4987acd8-f1a1-4fb1-ac82-b426d7543100" status: 200 len: 1576 microversion: 2.1 time: 0.232152 Aug 31 16:53:47.262912 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3548/7079] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:53:47 2022] GET /compute/v2.1/servers/4987acd8-f1a1-4fb1-ac82-b426d7543100 => generated 1576 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:53:48.285247 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7e74a7ee-3c35-4a96-86cf-a38fba93a58c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:53:48.285872 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7e74a7ee-3c35-4a96-86cf-a38fba93a58c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 4987acd8-f1a1-4fb1-ac82-b426d7543100] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:53:48.293361 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7e74a7ee-3c35-4a96-86cf-a38fba93a58c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:48.293871 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7e74a7ee-3c35-4a96-86cf-a38fba93a58c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:48.294311 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7e74a7ee-3c35-4a96-86cf-a38fba93a58c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:48.295024 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7e74a7ee-3c35-4a96-86cf-a38fba93a58c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:48.295491 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7e74a7ee-3c35-4a96-86cf-a38fba93a58c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:48.295948 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7e74a7ee-3c35-4a96-86cf-a38fba93a58c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:48.555342 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-7e1f1a22-8d94-4677-b434-3264f2933e6f req-a23eea54-a4d8-4dc9-a794-e4118e7a344d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4987acd8-f1a1-4fb1-ac82-b426d7543100", "name": "network-vif-deleted", "tag": "2b784555-0e5f-4057-8c53-bf90f27149bf"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:53:48.562459 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7e74a7ee-3c35-4a96-86cf-a38fba93a58c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:53:48.567553 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-7e1f1a22-8d94-4677-b434-3264f2933e6f req-a23eea54-a4d8-4dc9-a794-e4118e7a344d service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:48.576615 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7e74a7ee-3c35-4a96-86cf-a38fba93a58c tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/4987acd8-f1a1-4fb1-ac82-b426d7543100" status: 200 len: 1457 microversion: 2.1 time: 0.296158 Aug 31 16:53:48.576962 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-7e1f1a22-8d94-4677-b434-3264f2933e6f req-a23eea54-a4d8-4dc9-a794-e4118e7a344d service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:48.577284 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3532/7080] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:53:48 2022] GET /compute/v2.1/servers/4987acd8-f1a1-4fb1-ac82-b426d7543100 => generated 1457 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:53:48.577471 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-7e1f1a22-8d94-4677-b434-3264f2933e6f req-a23eea54-a4d8-4dc9-a794-e4118e7a344d service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:48.590853 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-7e1f1a22-8d94-4677-b434-3264f2933e6f req-a23eea54-a4d8-4dc9-a794-e4118e7a344d service nova] Creating event network-vif-deleted:2b784555-0e5f-4057-8c53-bf90f27149bf for instance 4987acd8-f1a1-4fb1-ac82-b426d7543100 on n-h2-850499-9 Aug 31 16:53:48.597217 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-7e1f1a22-8d94-4677-b434-3264f2933e6f req-a23eea54-a4d8-4dc9-a794-e4118e7a344d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045596 Aug 31 16:53:48.597833 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3549/7081] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:53:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:53:49.599798 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8b876f7d-8777-4cdf-926c-8ac0caf2e152 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:53:49.600423 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8b876f7d-8777-4cdf-926c-8ac0caf2e152 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 4987acd8-f1a1-4fb1-ac82-b426d7543100] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:53:49.608449 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8b876f7d-8777-4cdf-926c-8ac0caf2e152 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:49.608906 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8b876f7d-8777-4cdf-926c-8ac0caf2e152 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:49.609227 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8b876f7d-8777-4cdf-926c-8ac0caf2e152 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:49.609922 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8b876f7d-8777-4cdf-926c-8ac0caf2e152 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:49.610390 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8b876f7d-8777-4cdf-926c-8ac0caf2e152 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:49.610843 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8b876f7d-8777-4cdf-926c-8ac0caf2e152 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:49.738183 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8b876f7d-8777-4cdf-926c-8ac0caf2e152 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:53:49.746275 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8b876f7d-8777-4cdf-926c-8ac0caf2e152 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/4987acd8-f1a1-4fb1-ac82-b426d7543100" status: 200 len: 1224 microversion: 2.1 time: 0.150990 Aug 31 16:53:49.760277 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3533/7082] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:53:49 2022] GET /compute/v2.1/servers/4987acd8-f1a1-4fb1-ac82-b426d7543100 => generated 1224 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:53:50.769700 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ada374a4-6c14-4e72-a9b2-3be67755420e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:53:50.770423 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ada374a4-6c14-4e72-a9b2-3be67755420e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 4987acd8-f1a1-4fb1-ac82-b426d7543100] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:53:50.776909 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ada374a4-6c14-4e72-a9b2-3be67755420e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:50.777425 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ada374a4-6c14-4e72-a9b2-3be67755420e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:50.778118 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ada374a4-6c14-4e72-a9b2-3be67755420e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:50.778920 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ada374a4-6c14-4e72-a9b2-3be67755420e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:50.779275 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ada374a4-6c14-4e72-a9b2-3be67755420e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:50.779751 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ada374a4-6c14-4e72-a9b2-3be67755420e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:50.889178 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ada374a4-6c14-4e72-a9b2-3be67755420e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:53:50.898854 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ada374a4-6c14-4e72-a9b2-3be67755420e tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/4987acd8-f1a1-4fb1-ac82-b426d7543100" status: 200 len: 1224 microversion: 2.1 time: 0.134268 Aug 31 16:53:50.899587 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3550/7083] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:53:50 2022] GET /compute/v2.1/servers/4987acd8-f1a1-4fb1-ac82-b426d7543100 => generated 1224 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:53:51.920492 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7433924f-b8d7-4d5e-be37-0c0b90037c26 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:53:51.921135 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7433924f-b8d7-4d5e-be37-0c0b90037c26 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 4987acd8-f1a1-4fb1-ac82-b426d7543100] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:53:51.929325 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7433924f-b8d7-4d5e-be37-0c0b90037c26 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:51.929980 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7433924f-b8d7-4d5e-be37-0c0b90037c26 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:51.930430 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7433924f-b8d7-4d5e-be37-0c0b90037c26 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:51.931151 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7433924f-b8d7-4d5e-be37-0c0b90037c26 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:51.931656 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7433924f-b8d7-4d5e-be37-0c0b90037c26 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:51.932089 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7433924f-b8d7-4d5e-be37-0c0b90037c26 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:51.998400 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7433924f-b8d7-4d5e-be37-0c0b90037c26 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:53:52.012404 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7433924f-b8d7-4d5e-be37-0c0b90037c26 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/4987acd8-f1a1-4fb1-ac82-b426d7543100" status: 200 len: 1224 microversion: 2.1 time: 0.096114 Aug 31 16:53:52.013013 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3534/7084] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:53:51 2022] GET /compute/v2.1/servers/4987acd8-f1a1-4fb1-ac82-b426d7543100 => generated 1224 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:53:53.034171 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0dc91a8e-e184-468e-8bc9-da830aad9c47 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:53:53.034813 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0dc91a8e-e184-468e-8bc9-da830aad9c47 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 4987acd8-f1a1-4fb1-ac82-b426d7543100] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:53:53.041837 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0dc91a8e-e184-468e-8bc9-da830aad9c47 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:53.042345 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0dc91a8e-e184-468e-8bc9-da830aad9c47 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:53.042803 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0dc91a8e-e184-468e-8bc9-da830aad9c47 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:53.043547 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0dc91a8e-e184-468e-8bc9-da830aad9c47 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:53.044015 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0dc91a8e-e184-468e-8bc9-da830aad9c47 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:53.044455 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0dc91a8e-e184-468e-8bc9-da830aad9c47 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:53.080022 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0dc91a8e-e184-468e-8bc9-da830aad9c47 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:53.080531 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0dc91a8e-e184-468e-8bc9-da830aad9c47 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:53.080987 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0dc91a8e-e184-468e-8bc9-da830aad9c47 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:53.081450 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-0dc91a8e-e184-468e-8bc9-da830aad9c47 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lazy-loading 'fault' on Instance uuid 4987acd8-f1a1-4fb1-ac82-b426d7543100 {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:53:53.127193 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0dc91a8e-e184-468e-8bc9-da830aad9c47 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '588d2ef08d8345a6b6175c8287633270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '798d7eff58b04ab582bac1e87112625f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:53:53.135338 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0dc91a8e-e184-468e-8bc9-da830aad9c47 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/4987acd8-f1a1-4fb1-ac82-b426d7543100" status: 200 len: 1229 microversion: 2.1 time: 0.105508 Aug 31 16:53:53.135960 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3551/7085] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:53:53 2022] GET /compute/v2.1/servers/4987acd8-f1a1-4fb1-ac82-b426d7543100 => generated 1229 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:53:54.159534 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-90932607-9d9a-4afa-a26a-ba9d84b65d0a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:53:54.160150 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-90932607-9d9a-4afa-a26a-ba9d84b65d0a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: 4987acd8-f1a1-4fb1-ac82-b426d7543100] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:53:54.166976 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-90932607-9d9a-4afa-a26a-ba9d84b65d0a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:54.167459 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-90932607-9d9a-4afa-a26a-ba9d84b65d0a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:54.167930 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-90932607-9d9a-4afa-a26a-ba9d84b65d0a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:54.168619 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-90932607-9d9a-4afa-a26a-ba9d84b65d0a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:54.169080 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-90932607-9d9a-4afa-a26a-ba9d84b65d0a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:54.169504 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-90932607-9d9a-4afa-a26a-ba9d84b65d0a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:54.184177 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-90932607-9d9a-4afa-a26a-ba9d84b65d0a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] HTTP exception thrown: Instance 4987acd8-f1a1-4fb1-ac82-b426d7543100 could not be found. Aug 31 16:53:54.185829 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-90932607-9d9a-4afa-a26a-ba9d84b65d0a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Request method failure captured: Aug 31 16:53:54.185829 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/4987acd8-f1a1-4fb1-ac82-b426d7543100 HTTP/1.1 Aug 31 16:53:54.185829 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:53:54.185829 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:53:54.185829 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:53:54.185829 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:53:54.185829 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:53:54.185829 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:53:54.185829 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:53:54.185829 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:53:54.185829 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD47qS8C6HsXEaEmR5vEYZ6_LcYWck6kjg2PE2Sm6XicPmZbBvnd8kXBk0kFrhGPgu84OodaxIz7Gcm1qVV62nKCQjCd-8My5krh8bw3lC-5obyJ5MI9WGooafg2qsKoEyqO0fUDn4HqdbQ-uRSMHzaJZriF8vfhIimZHzzbd5tR6Fco Aug 31 16:53:54.185829 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:53:54.185829 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:53:54.185829 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:53:54.185829 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:53:54.185829 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:53:54.185829 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:53:54.185829 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 798d7eff58b04ab582bac1e87112625f Aug 31 16:53:54.185829 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-TestVolumeBootPattern-1074913281 Aug 31 16:53:54.185829 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:53:54.185829 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:53:54.185829 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/798d7eff58b04ab582bac1e87112625f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/798d7eff58b04ab582bac1e87112625f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_798d7eff58b04ab582bac1e87112625f", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/798d7eff58b04ab582bac1e87112625f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:53:54.185829 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-TestVolumeBootPattern-1074913281 Aug 31 16:53:54.185829 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 798d7eff58b04ab582bac1e87112625f Aug 31 16:53:54.185829 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-TestVolumeBootPattern-1074913281 Aug 31 16:53:54.185829 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-TestVolumeBootPattern-1074913281-project Aug 31 16:53:54.185829 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:53:54.185829 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:53:54.185829 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 588d2ef08d8345a6b6175c8287633270 Aug 31 16:53:54.185829 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-TestVolumeBootPattern-1074913281-project Aug 31 16:53:54.185829 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:53:54.185829 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance 4987acd8-f1a1-4fb1-ac82-b426d7543100 could not be found. Aug 31 16:53:54.185829 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '4987acd8-f1a1-4fb1-ac82-b426d7543100'} Aug 31 16:53:54.185829 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:53:54.185829 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:53:54.185829 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:53:54.185829 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:53:54.185829 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:53:54.185829 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:53:54.185829 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:53:54.185829 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:53:54.185829 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:53:54.185829 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:53:54.185829 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4987acd8-f1a1-4fb1-ac82-b426d7543100 could not be found. Aug 31 16:53:54.185829 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:53:54.185829 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:53:54.185829 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:53:54.185829 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:53:54.185829 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:53:54.185829 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:53:54.185829 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:53:54.185829 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:53:54.185829 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:53:54.185829 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:53:54.185829 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:53:54.185829 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:53:54.185829 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:53:54.185829 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:53:54.185829 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:53:54.185829 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:53:54.185829 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4987acd8-f1a1-4fb1-ac82-b426d7543100 could not be found. Aug 31 16:53:54.185829 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:53:54.185829 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:53:54.185829 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:53:54.192851 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:53:54.192851 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:53:54.192851 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:53:54.192851 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:53:54.192851 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:53:54.192851 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4987acd8-f1a1-4fb1-ac82-b426d7543100 could not be found. Aug 31 16:53:54.192851 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:53:54.192851 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-90932607-9d9a-4afa-a26a-ba9d84b65d0a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Returning 404 to user: Instance 4987acd8-f1a1-4fb1-ac82-b426d7543100 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:53:54.192851 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-90932607-9d9a-4afa-a26a-ba9d84b65d0a tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/4987acd8-f1a1-4fb1-ac82-b426d7543100" status: 404 len: 111 microversion: 2.1 time: 0.032738 Aug 31 16:53:54.192851 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3535/7086] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:53:54 2022] GET /compute/v2.1/servers/4987acd8-f1a1-4fb1-ac82-b426d7543100 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:53:54.641935 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9bf8e15e-9521-47f6-a078-e5a6d0f6fb4d tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:53:54.643292 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9bf8e15e-9521-47f6-a078-e5a6d0f6fb4d tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: f8037ce9-f608-4fba-aed6-52b6d33f4175] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:53:54.650470 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9bf8e15e-9521-47f6-a078-e5a6d0f6fb4d tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:54.650982 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9bf8e15e-9521-47f6-a078-e5a6d0f6fb4d tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:54.651443 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9bf8e15e-9521-47f6-a078-e5a6d0f6fb4d tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:54.652182 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9bf8e15e-9521-47f6-a078-e5a6d0f6fb4d tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:54.652662 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9bf8e15e-9521-47f6-a078-e5a6d0f6fb4d tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:54.653110 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9bf8e15e-9521-47f6-a078-e5a6d0f6fb4d tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:54.668272 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-9bf8e15e-9521-47f6-a078-e5a6d0f6fb4d tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] HTTP exception thrown: Instance f8037ce9-f608-4fba-aed6-52b6d33f4175 could not be found. Aug 31 16:53:54.670011 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9bf8e15e-9521-47f6-a078-e5a6d0f6fb4d tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Request method failure captured: Aug 31 16:53:54.670011 n-d-850499-9 devstack@n-api.service[122257]: request: DELETE /compute/v2.1/servers/f8037ce9-f608-4fba-aed6-52b6d33f4175 HTTP/1.1 Aug 31 16:53:54.670011 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:53:54.670011 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:53:54.670011 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:53:54.670011 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:53:54.670011 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:53:54.670011 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:53:54.670011 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:53:54.670011 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:53:54.670011 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD47qS8C6HsXEaEmR5vEYZ6_LcYWck6kjg2PE2Sm6XicPmZbBvnd8kXBk0kFrhGPgu84OodaxIz7Gcm1qVV62nKCQjCd-8My5krh8bw3lC-5obyJ5MI9WGooafg2qsKoEyqO0fUDn4HqdbQ-uRSMHzaJZriF8vfhIimZHzzbd5tR6Fco Aug 31 16:53:54.670011 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:53:54.670011 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:53:54.670011 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:53:54.670011 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:53:54.670011 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:53:54.670011 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:53:54.670011 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 798d7eff58b04ab582bac1e87112625f Aug 31 16:53:54.670011 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-TestVolumeBootPattern-1074913281 Aug 31 16:53:54.670011 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:53:54.670011 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:53:54.670011 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/798d7eff58b04ab582bac1e87112625f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/798d7eff58b04ab582bac1e87112625f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_798d7eff58b04ab582bac1e87112625f", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/798d7eff58b04ab582bac1e87112625f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:53:54.670011 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-TestVolumeBootPattern-1074913281 Aug 31 16:53:54.670011 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 798d7eff58b04ab582bac1e87112625f Aug 31 16:53:54.670011 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-TestVolumeBootPattern-1074913281 Aug 31 16:53:54.670011 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-TestVolumeBootPattern-1074913281-project Aug 31 16:53:54.670011 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:53:54.670011 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:53:54.670011 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 588d2ef08d8345a6b6175c8287633270 Aug 31 16:53:54.670011 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-TestVolumeBootPattern-1074913281-project Aug 31 16:53:54.670011 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:53:54.670011 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance f8037ce9-f608-4fba-aed6-52b6d33f4175 could not be found. Aug 31 16:53:54.670011 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': 'f8037ce9-f608-4fba-aed6-52b6d33f4175'} Aug 31 16:53:54.670011 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:53:54.670011 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:53:54.670011 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:53:54.670011 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:53:54.670011 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:53:54.670011 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:53:54.670011 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:53:54.670011 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:53:54.670011 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:53:54.670011 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:53:54.670011 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8037ce9-f608-4fba-aed6-52b6d33f4175 could not be found. Aug 31 16:53:54.670011 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:53:54.670011 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:53:54.670011 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:53:54.670011 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:53:54.670011 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:53:54.670011 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:53:54.670011 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:53:54.670011 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:53:54.670011 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:53:54.670011 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:53:54.670011 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:53:54.670011 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:53:54.670011 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:53:54.670011 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:53:54.670011 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:53:54.670011 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:53:54.670011 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:53:54.670011 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:53:54.674037 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8037ce9-f608-4fba-aed6-52b6d33f4175 could not be found. Aug 31 16:53:54.674037 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:53:54.674037 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:53:54.674037 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:53:54.674037 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:53:54.674037 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:53:54.674037 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:53:54.674037 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:53:54.674037 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:53:54.674037 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8037ce9-f608-4fba-aed6-52b6d33f4175 could not be found. Aug 31 16:53:54.674037 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:53:54.674037 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9bf8e15e-9521-47f6-a078-e5a6d0f6fb4d tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Returning 404 to user: Instance f8037ce9-f608-4fba-aed6-52b6d33f4175 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:53:54.674037 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9bf8e15e-9521-47f6-a078-e5a6d0f6fb4d tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "DELETE /compute/v2.1/servers/f8037ce9-f608-4fba-aed6-52b6d33f4175" status: 404 len: 111 microversion: 2.1 time: 0.033565 Aug 31 16:53:54.674037 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3552/7087] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:53:54 2022] DELETE /compute/v2.1/servers/f8037ce9-f608-4fba-aed6-52b6d33f4175 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:53:54.680545 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f257480b-761a-488d-b346-b81a459758a7 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:53:54.681170 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f257480b-761a-488d-b346-b81a459758a7 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] [instance: f8037ce9-f608-4fba-aed6-52b6d33f4175] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:53:54.687188 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f257480b-761a-488d-b346-b81a459758a7 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:54.687718 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f257480b-761a-488d-b346-b81a459758a7 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:54.688167 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f257480b-761a-488d-b346-b81a459758a7 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:54.689434 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f257480b-761a-488d-b346-b81a459758a7 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:54.689885 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f257480b-761a-488d-b346-b81a459758a7 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:54.690320 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f257480b-761a-488d-b346-b81a459758a7 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:54.704000 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-f257480b-761a-488d-b346-b81a459758a7 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] HTTP exception thrown: Instance f8037ce9-f608-4fba-aed6-52b6d33f4175 could not be found. Aug 31 16:53:54.705692 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f257480b-761a-488d-b346-b81a459758a7 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Request method failure captured: Aug 31 16:53:54.705692 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/f8037ce9-f608-4fba-aed6-52b6d33f4175 HTTP/1.1 Aug 31 16:53:54.705692 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:53:54.705692 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:53:54.705692 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:53:54.705692 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:53:54.705692 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:53:54.705692 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:53:54.705692 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:53:54.705692 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:53:54.705692 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD47qS8C6HsXEaEmR5vEYZ6_LcYWck6kjg2PE2Sm6XicPmZbBvnd8kXBk0kFrhGPgu84OodaxIz7Gcm1qVV62nKCQjCd-8My5krh8bw3lC-5obyJ5MI9WGooafg2qsKoEyqO0fUDn4HqdbQ-uRSMHzaJZriF8vfhIimZHzzbd5tR6Fco Aug 31 16:53:54.705692 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:53:54.705692 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:53:54.705692 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:53:54.705692 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:53:54.705692 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:53:54.705692 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:53:54.705692 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 798d7eff58b04ab582bac1e87112625f Aug 31 16:53:54.705692 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-TestVolumeBootPattern-1074913281 Aug 31 16:53:54.705692 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:53:54.705692 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:53:54.705692 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/798d7eff58b04ab582bac1e87112625f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/798d7eff58b04ab582bac1e87112625f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_798d7eff58b04ab582bac1e87112625f", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/798d7eff58b04ab582bac1e87112625f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:53:54.705692 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-TestVolumeBootPattern-1074913281 Aug 31 16:53:54.705692 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 798d7eff58b04ab582bac1e87112625f Aug 31 16:53:54.705692 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-TestVolumeBootPattern-1074913281 Aug 31 16:53:54.705692 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-TestVolumeBootPattern-1074913281-project Aug 31 16:53:54.705692 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:53:54.705692 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:53:54.705692 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 588d2ef08d8345a6b6175c8287633270 Aug 31 16:53:54.705692 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-TestVolumeBootPattern-1074913281-project Aug 31 16:53:54.705692 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:53:54.705692 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance f8037ce9-f608-4fba-aed6-52b6d33f4175 could not be found. Aug 31 16:53:54.705692 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': 'f8037ce9-f608-4fba-aed6-52b6d33f4175'} Aug 31 16:53:54.705692 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:53:54.705692 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:53:54.705692 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:53:54.705692 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:53:54.705692 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:53:54.705692 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:53:54.705692 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:53:54.705692 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:53:54.705692 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:53:54.705692 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:53:54.705692 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8037ce9-f608-4fba-aed6-52b6d33f4175 could not be found. Aug 31 16:53:54.705692 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:53:54.705692 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:53:54.705692 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:53:54.705692 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:53:54.705692 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:53:54.705692 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:53:54.705692 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:53:54.705692 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:53:54.705692 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:53:54.705692 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:53:54.705692 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:53:54.705692 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:53:54.705692 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:53:54.705692 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:53:54.705692 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:53:54.705692 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:53:54.705692 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8037ce9-f608-4fba-aed6-52b6d33f4175 could not be found. Aug 31 16:53:54.705692 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:53:54.705692 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:53:54.705692 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:53:54.713163 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:53:54.713163 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:53:54.713163 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:53:54.713163 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:53:54.713163 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:53:54.713163 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8037ce9-f608-4fba-aed6-52b6d33f4175 could not be found. Aug 31 16:53:54.713163 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:53:54.713163 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f257480b-761a-488d-b346-b81a459758a7 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Returning 404 to user: Instance f8037ce9-f608-4fba-aed6-52b6d33f4175 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:53:54.713163 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f257480b-761a-488d-b346-b81a459758a7 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "GET /compute/v2.1/servers/f8037ce9-f608-4fba-aed6-52b6d33f4175" status: 404 len: 111 microversion: 2.1 time: 0.031046 Aug 31 16:53:54.713163 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3536/7088] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:53:54 2022] GET /compute/v2.1/servers/f8037ce9-f608-4fba-aed6-52b6d33f4175 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:53:58.149117 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-cfaf4eea-648e-437d-a663-66c708bb8af8 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] Calling method '.version_select at 0x7f5ae39c3040>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:53:58.176914 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-cfaf4eea-648e-437d-a663-66c708bb8af8 tempest-TestVolumeBootPattern-1074913281 tempest-TestVolumeBootPattern-1074913281-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-435793919" status: 202 len: 0 microversion: 2.1 time: 0.032019 Aug 31 16:53:58.183258 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3553/7089] 10.222.0.61 () {58 vars in 1260 bytes} [Wed Aug 31 16:53:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-435793919 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:54:13.828451 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e37a459c-1921-4645-a990-4f53b757c0b7 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:54:13.832247 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e37a459c-1921-4645-a990-4f53b757c0b7 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 412f872c-ead6-4a31-9ed3-b29f2237ae8d] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:54:13.835346 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=26 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:54:13.836204 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=54 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:54:13.843228 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e37a459c-1921-4645-a990-4f53b757c0b7 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:54:13.843757 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e37a459c-1921-4645-a990-4f53b757c0b7 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:54:13.844302 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e37a459c-1921-4645-a990-4f53b757c0b7 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:54:13.845755 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e37a459c-1921-4645-a990-4f53b757c0b7 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:54:13.846469 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e37a459c-1921-4645-a990-4f53b757c0b7 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:54:13.846937 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e37a459c-1921-4645-a990-4f53b757c0b7 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:54:14.226706 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-e37a459c-1921-4645-a990-4f53b757c0b7 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:54:14.227135 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-e37a459c-1921-4645-a990-4f53b757c0b7 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:54:14.227643 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-e37a459c-1921-4645-a990-4f53b757c0b7 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:54:14.228091 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-e37a459c-1921-4645-a990-4f53b757c0b7 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:54:14.228506 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-e37a459c-1921-4645-a990-4f53b757c0b7 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:54:14.288009 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e37a459c-1921-4645-a990-4f53b757c0b7 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 412f872c-ead6-4a31-9ed3-b29f2237ae8d] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:54:14.293763 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e37a459c-1921-4645-a990-4f53b757c0b7 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:54:14.294256 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e37a459c-1921-4645-a990-4f53b757c0b7 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:54:14.294703 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e37a459c-1921-4645-a990-4f53b757c0b7 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:54:14.295413 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e37a459c-1921-4645-a990-4f53b757c0b7 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:54:14.295909 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e37a459c-1921-4645-a990-4f53b757c0b7 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:54:14.296338 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e37a459c-1921-4645-a990-4f53b757c0b7 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:54:14.326153 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e37a459c-1921-4645-a990-4f53b757c0b7 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "POST /compute/v2.1/servers/412f872c-ead6-4a31-9ed3-b29f2237ae8d/action" status: 202 len: 1136 microversion: 2.1 time: 0.501840 Aug 31 16:54:14.326843 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3537/7090] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:54:13 2022] POST /compute/v2.1/servers/412f872c-ead6-4a31-9ed3-b29f2237ae8d/action => generated 1136 bytes in 503 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 31 16:54:14.346286 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:54:14.348622 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:54:14.355606 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2084cbb0-f6af-4ff8-a54d-88922239754a tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:54:14.356609 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2084cbb0-f6af-4ff8-a54d-88922239754a tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 412f872c-ead6-4a31-9ed3-b29f2237ae8d] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:54:14.371175 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2084cbb0-f6af-4ff8-a54d-88922239754a tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:54:14.374013 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2084cbb0-f6af-4ff8-a54d-88922239754a tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:54:14.374556 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2084cbb0-f6af-4ff8-a54d-88922239754a tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:54:14.375303 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2084cbb0-f6af-4ff8-a54d-88922239754a tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:54:14.376907 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2084cbb0-f6af-4ff8-a54d-88922239754a tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:54:14.377492 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2084cbb0-f6af-4ff8-a54d-88922239754a tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:54:14.664865 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2084cbb0-f6af-4ff8-a54d-88922239754a tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:54:14.674836 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2084cbb0-f6af-4ff8-a54d-88922239754a tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/412f872c-ead6-4a31-9ed3-b29f2237ae8d" status: 200 len: 1691 microversion: 2.1 time: 0.332289 Aug 31 16:54:14.675401 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3554/7091] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:54:14 2022] GET /compute/v2.1/servers/412f872c-ead6-4a31-9ed3-b29f2237ae8d => generated 1691 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:54:15.834881 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-10797d95-ca54-46db-ae0c-460b17511c8d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:54:15.835524 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-10797d95-ca54-46db-ae0c-460b17511c8d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 412f872c-ead6-4a31-9ed3-b29f2237ae8d] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:54:15.841623 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-10797d95-ca54-46db-ae0c-460b17511c8d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:54:15.842126 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-10797d95-ca54-46db-ae0c-460b17511c8d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:54:15.842572 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-10797d95-ca54-46db-ae0c-460b17511c8d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:54:15.843273 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-10797d95-ca54-46db-ae0c-460b17511c8d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:54:15.843771 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-10797d95-ca54-46db-ae0c-460b17511c8d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:54:15.844204 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-10797d95-ca54-46db-ae0c-460b17511c8d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:54:15.982256 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-10797d95-ca54-46db-ae0c-460b17511c8d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:54:15.990100 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-10797d95-ca54-46db-ae0c-460b17511c8d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/412f872c-ead6-4a31-9ed3-b29f2237ae8d" status: 200 len: 1691 microversion: 2.1 time: 0.297604 Aug 31 16:54:15.990692 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3538/7092] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:54:15 2022] GET /compute/v2.1/servers/412f872c-ead6-4a31-9ed3-b29f2237ae8d => generated 1691 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:54:17.011312 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-53fa56f0-7414-4df2-bbd5-d3f9d3cbff42 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:54:17.012017 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-53fa56f0-7414-4df2-bbd5-d3f9d3cbff42 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 412f872c-ead6-4a31-9ed3-b29f2237ae8d] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:54:17.020508 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-53fa56f0-7414-4df2-bbd5-d3f9d3cbff42 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:54:17.021042 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-53fa56f0-7414-4df2-bbd5-d3f9d3cbff42 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:54:17.021544 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-53fa56f0-7414-4df2-bbd5-d3f9d3cbff42 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:54:17.022273 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-53fa56f0-7414-4df2-bbd5-d3f9d3cbff42 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:54:17.022773 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-53fa56f0-7414-4df2-bbd5-d3f9d3cbff42 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:54:17.023248 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-53fa56f0-7414-4df2-bbd5-d3f9d3cbff42 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:54:17.175011 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-53fa56f0-7414-4df2-bbd5-d3f9d3cbff42 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:54:17.182835 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-53fa56f0-7414-4df2-bbd5-d3f9d3cbff42 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/412f872c-ead6-4a31-9ed3-b29f2237ae8d" status: 200 len: 1691 microversion: 2.1 time: 0.175633 Aug 31 16:54:17.183419 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3555/7093] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:54:17 2022] GET /compute/v2.1/servers/412f872c-ead6-4a31-9ed3-b29f2237ae8d => generated 1691 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:54:18.205941 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-925b72af-efa1-4b60-a46d-d18192d8a9fe tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:54:18.206565 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-925b72af-efa1-4b60-a46d-d18192d8a9fe tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 412f872c-ead6-4a31-9ed3-b29f2237ae8d] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:54:18.213617 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-925b72af-efa1-4b60-a46d-d18192d8a9fe tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:54:18.214168 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-925b72af-efa1-4b60-a46d-d18192d8a9fe tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:54:18.214554 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-925b72af-efa1-4b60-a46d-d18192d8a9fe tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:54:18.215287 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-925b72af-efa1-4b60-a46d-d18192d8a9fe tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:54:18.215819 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-925b72af-efa1-4b60-a46d-d18192d8a9fe tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:54:18.216212 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-925b72af-efa1-4b60-a46d-d18192d8a9fe tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:54:18.355193 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-925b72af-efa1-4b60-a46d-d18192d8a9fe tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:54:18.363100 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-925b72af-efa1-4b60-a46d-d18192d8a9fe tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/412f872c-ead6-4a31-9ed3-b29f2237ae8d" status: 200 len: 1691 microversion: 2.1 time: 0.161657 Aug 31 16:54:18.363715 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3539/7094] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:54:18 2022] GET /compute/v2.1/servers/412f872c-ead6-4a31-9ed3-b29f2237ae8d => generated 1691 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:54:19.385849 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-abece0af-85f9-4d64-b0d7-f8317aed110d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:54:19.386497 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-abece0af-85f9-4d64-b0d7-f8317aed110d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 412f872c-ead6-4a31-9ed3-b29f2237ae8d] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:54:19.394356 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-abece0af-85f9-4d64-b0d7-f8317aed110d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:54:19.394752 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-abece0af-85f9-4d64-b0d7-f8317aed110d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:54:19.395222 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-abece0af-85f9-4d64-b0d7-f8317aed110d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:54:19.396008 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-abece0af-85f9-4d64-b0d7-f8317aed110d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:54:19.396835 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-abece0af-85f9-4d64-b0d7-f8317aed110d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:54:19.396968 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-abece0af-85f9-4d64-b0d7-f8317aed110d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:54:19.534646 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-abece0af-85f9-4d64-b0d7-f8317aed110d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:54:19.542461 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-abece0af-85f9-4d64-b0d7-f8317aed110d tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/412f872c-ead6-4a31-9ed3-b29f2237ae8d" status: 200 len: 1691 microversion: 2.1 time: 0.161016 Aug 31 16:54:19.543038 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3556/7095] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:54:19 2022] GET /compute/v2.1/servers/412f872c-ead6-4a31-9ed3-b29f2237ae8d => generated 1691 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:54:20.564623 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a12fa979-7315-408a-a59e-c9712dec90f0 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:54:20.565330 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a12fa979-7315-408a-a59e-c9712dec90f0 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 412f872c-ead6-4a31-9ed3-b29f2237ae8d] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:54:20.572582 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a12fa979-7315-408a-a59e-c9712dec90f0 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:54:20.573080 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a12fa979-7315-408a-a59e-c9712dec90f0 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:54:20.573526 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a12fa979-7315-408a-a59e-c9712dec90f0 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:54:20.574233 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a12fa979-7315-408a-a59e-c9712dec90f0 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:54:20.574696 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a12fa979-7315-408a-a59e-c9712dec90f0 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:54:20.575127 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a12fa979-7315-408a-a59e-c9712dec90f0 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:54:20.717303 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a12fa979-7315-408a-a59e-c9712dec90f0 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:54:20.725315 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a12fa979-7315-408a-a59e-c9712dec90f0 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/412f872c-ead6-4a31-9ed3-b29f2237ae8d" status: 200 len: 1691 microversion: 2.1 time: 0.165426 Aug 31 16:54:20.725891 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3540/7096] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:54:20 2022] GET /compute/v2.1/servers/412f872c-ead6-4a31-9ed3-b29f2237ae8d => generated 1691 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:54:21.747306 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-51368ed5-96ae-4948-b973-159ebb198c29 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:54:21.747857 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-51368ed5-96ae-4948-b973-159ebb198c29 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 412f872c-ead6-4a31-9ed3-b29f2237ae8d] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:54:21.755961 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-51368ed5-96ae-4948-b973-159ebb198c29 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:54:21.756164 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-51368ed5-96ae-4948-b973-159ebb198c29 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:54:21.756618 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-51368ed5-96ae-4948-b973-159ebb198c29 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:54:21.757337 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-51368ed5-96ae-4948-b973-159ebb198c29 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:54:21.757808 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-51368ed5-96ae-4948-b973-159ebb198c29 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:54:21.758254 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-51368ed5-96ae-4948-b973-159ebb198c29 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:54:21.898915 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-51368ed5-96ae-4948-b973-159ebb198c29 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:54:21.906903 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-51368ed5-96ae-4948-b973-159ebb198c29 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/412f872c-ead6-4a31-9ed3-b29f2237ae8d" status: 200 len: 1691 microversion: 2.1 time: 0.163964 Aug 31 16:54:21.908124 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3557/7097] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:54:21 2022] GET /compute/v2.1/servers/412f872c-ead6-4a31-9ed3-b29f2237ae8d => generated 1691 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:54:22.929565 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6c9c93a5-5fe8-40bd-9d55-4b1e7b18c556 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:54:22.930181 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6c9c93a5-5fe8-40bd-9d55-4b1e7b18c556 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 412f872c-ead6-4a31-9ed3-b29f2237ae8d] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:54:22.937364 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6c9c93a5-5fe8-40bd-9d55-4b1e7b18c556 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:54:22.937858 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6c9c93a5-5fe8-40bd-9d55-4b1e7b18c556 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:54:22.938337 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6c9c93a5-5fe8-40bd-9d55-4b1e7b18c556 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:54:22.939207 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6c9c93a5-5fe8-40bd-9d55-4b1e7b18c556 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:54:22.939699 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6c9c93a5-5fe8-40bd-9d55-4b1e7b18c556 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:54:22.940133 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6c9c93a5-5fe8-40bd-9d55-4b1e7b18c556 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:54:23.078920 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-6c9c93a5-5fe8-40bd-9d55-4b1e7b18c556 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:54:23.087315 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6c9c93a5-5fe8-40bd-9d55-4b1e7b18c556 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/412f872c-ead6-4a31-9ed3-b29f2237ae8d" status: 200 len: 1691 microversion: 2.1 time: 0.161706 Aug 31 16:54:23.087939 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3541/7098] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:54:22 2022] GET /compute/v2.1/servers/412f872c-ead6-4a31-9ed3-b29f2237ae8d => generated 1691 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:54:24.110087 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9b070497-5a0b-44ef-aae2-b0f865f04263 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:54:24.111246 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9b070497-5a0b-44ef-aae2-b0f865f04263 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 412f872c-ead6-4a31-9ed3-b29f2237ae8d] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:54:24.118744 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9b070497-5a0b-44ef-aae2-b0f865f04263 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:54:24.119264 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9b070497-5a0b-44ef-aae2-b0f865f04263 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:54:24.119756 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9b070497-5a0b-44ef-aae2-b0f865f04263 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:54:24.120482 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9b070497-5a0b-44ef-aae2-b0f865f04263 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:54:24.120961 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9b070497-5a0b-44ef-aae2-b0f865f04263 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:54:24.121414 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9b070497-5a0b-44ef-aae2-b0f865f04263 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:54:24.259129 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9b070497-5a0b-44ef-aae2-b0f865f04263 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:54:24.267758 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9b070497-5a0b-44ef-aae2-b0f865f04263 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/412f872c-ead6-4a31-9ed3-b29f2237ae8d" status: 200 len: 1691 microversion: 2.1 time: 0.161460 Aug 31 16:54:24.268375 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3558/7099] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:54:24 2022] GET /compute/v2.1/servers/412f872c-ead6-4a31-9ed3-b29f2237ae8d => generated 1691 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:54:25.289958 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0bba50ea-5658-40c4-9f52-375959c66b12 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:54:25.290663 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0bba50ea-5658-40c4-9f52-375959c66b12 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 412f872c-ead6-4a31-9ed3-b29f2237ae8d] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:54:25.300364 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0bba50ea-5658-40c4-9f52-375959c66b12 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:54:25.300862 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0bba50ea-5658-40c4-9f52-375959c66b12 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:54:25.301403 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0bba50ea-5658-40c4-9f52-375959c66b12 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:54:25.302230 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0bba50ea-5658-40c4-9f52-375959c66b12 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:54:25.302689 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0bba50ea-5658-40c4-9f52-375959c66b12 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:54:25.303122 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0bba50ea-5658-40c4-9f52-375959c66b12 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:54:25.447789 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-0bba50ea-5658-40c4-9f52-375959c66b12 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:54:25.457280 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0bba50ea-5658-40c4-9f52-375959c66b12 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/412f872c-ead6-4a31-9ed3-b29f2237ae8d" status: 200 len: 1691 microversion: 2.1 time: 0.171021 Aug 31 16:54:25.458088 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3542/7100] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:54:25 2022] GET /compute/v2.1/servers/412f872c-ead6-4a31-9ed3-b29f2237ae8d => generated 1691 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:54:26.481521 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c5dc17d4-76e9-42f8-9489-815b89545aae tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:54:26.482224 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c5dc17d4-76e9-42f8-9489-815b89545aae tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 412f872c-ead6-4a31-9ed3-b29f2237ae8d] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:54:26.490150 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c5dc17d4-76e9-42f8-9489-815b89545aae tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:54:26.490656 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c5dc17d4-76e9-42f8-9489-815b89545aae tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:54:26.491136 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c5dc17d4-76e9-42f8-9489-815b89545aae tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:54:26.491888 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c5dc17d4-76e9-42f8-9489-815b89545aae tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:54:26.492406 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c5dc17d4-76e9-42f8-9489-815b89545aae tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:54:26.492849 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c5dc17d4-76e9-42f8-9489-815b89545aae tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:54:26.635873 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c5dc17d4-76e9-42f8-9489-815b89545aae tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:54:26.644660 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c5dc17d4-76e9-42f8-9489-815b89545aae tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/412f872c-ead6-4a31-9ed3-b29f2237ae8d" status: 200 len: 1691 microversion: 2.1 time: 0.166997 Aug 31 16:54:26.645273 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3559/7101] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:54:26 2022] GET /compute/v2.1/servers/412f872c-ead6-4a31-9ed3-b29f2237ae8d => generated 1691 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:54:27.665889 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-73527aea-fee5-486a-8a28-cbb9da287476 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:54:27.666533 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-73527aea-fee5-486a-8a28-cbb9da287476 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 412f872c-ead6-4a31-9ed3-b29f2237ae8d] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:54:27.674531 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-73527aea-fee5-486a-8a28-cbb9da287476 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:54:27.675021 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-73527aea-fee5-486a-8a28-cbb9da287476 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:54:27.675468 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-73527aea-fee5-486a-8a28-cbb9da287476 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:54:27.676202 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-73527aea-fee5-486a-8a28-cbb9da287476 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:54:27.676662 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-73527aea-fee5-486a-8a28-cbb9da287476 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:54:27.677093 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-73527aea-fee5-486a-8a28-cbb9da287476 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:54:27.815960 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-73527aea-fee5-486a-8a28-cbb9da287476 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:54:27.824968 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-73527aea-fee5-486a-8a28-cbb9da287476 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/412f872c-ead6-4a31-9ed3-b29f2237ae8d" status: 200 len: 1691 microversion: 2.1 time: 0.163028 Aug 31 16:54:27.827542 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3543/7102] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:54:27 2022] GET /compute/v2.1/servers/412f872c-ead6-4a31-9ed3-b29f2237ae8d => generated 1691 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:54:28.846415 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-15fcd505-3739-4d2d-95b9-58fe173cdfa9 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:54:28.847052 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-15fcd505-3739-4d2d-95b9-58fe173cdfa9 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 412f872c-ead6-4a31-9ed3-b29f2237ae8d] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:54:28.854191 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-15fcd505-3739-4d2d-95b9-58fe173cdfa9 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:54:28.854710 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-15fcd505-3739-4d2d-95b9-58fe173cdfa9 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:54:28.855168 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-15fcd505-3739-4d2d-95b9-58fe173cdfa9 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:54:28.855926 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-15fcd505-3739-4d2d-95b9-58fe173cdfa9 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:54:28.856404 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-15fcd505-3739-4d2d-95b9-58fe173cdfa9 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:54:28.856880 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-15fcd505-3739-4d2d-95b9-58fe173cdfa9 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:54:29.000040 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-15fcd505-3739-4d2d-95b9-58fe173cdfa9 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:54:29.009360 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-15fcd505-3739-4d2d-95b9-58fe173cdfa9 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/412f872c-ead6-4a31-9ed3-b29f2237ae8d" status: 200 len: 1691 microversion: 2.1 time: 0.167452 Aug 31 16:54:29.009955 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3560/7103] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:54:28 2022] GET /compute/v2.1/servers/412f872c-ead6-4a31-9ed3-b29f2237ae8d => generated 1691 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:54:30.031420 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-47ea30cb-9678-4e98-a89c-f806f0d29aeb tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:54:30.032114 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-47ea30cb-9678-4e98-a89c-f806f0d29aeb tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 412f872c-ead6-4a31-9ed3-b29f2237ae8d] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:54:30.039119 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-47ea30cb-9678-4e98-a89c-f806f0d29aeb tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:54:30.039661 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-47ea30cb-9678-4e98-a89c-f806f0d29aeb tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:54:30.040138 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-47ea30cb-9678-4e98-a89c-f806f0d29aeb tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:54:30.040843 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-47ea30cb-9678-4e98-a89c-f806f0d29aeb tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:54:30.041325 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-47ea30cb-9678-4e98-a89c-f806f0d29aeb tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:54:30.041759 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-47ea30cb-9678-4e98-a89c-f806f0d29aeb tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:54:30.177893 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-47ea30cb-9678-4e98-a89c-f806f0d29aeb tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:54:30.185640 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-47ea30cb-9678-4e98-a89c-f806f0d29aeb tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/412f872c-ead6-4a31-9ed3-b29f2237ae8d" status: 200 len: 1691 microversion: 2.1 time: 0.158138 Aug 31 16:54:30.186211 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3544/7104] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:54:30 2022] GET /compute/v2.1/servers/412f872c-ead6-4a31-9ed3-b29f2237ae8d => generated 1691 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:54:31.207898 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ff2f6a83-3001-4167-85e0-c546bcab89f0 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:54:31.208531 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ff2f6a83-3001-4167-85e0-c546bcab89f0 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 412f872c-ead6-4a31-9ed3-b29f2237ae8d] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:54:31.216046 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ff2f6a83-3001-4167-85e0-c546bcab89f0 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:54:31.216586 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ff2f6a83-3001-4167-85e0-c546bcab89f0 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:54:31.217045 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ff2f6a83-3001-4167-85e0-c546bcab89f0 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:54:31.217768 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ff2f6a83-3001-4167-85e0-c546bcab89f0 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:54:31.218240 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ff2f6a83-3001-4167-85e0-c546bcab89f0 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:54:31.218686 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ff2f6a83-3001-4167-85e0-c546bcab89f0 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:54:31.361684 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ff2f6a83-3001-4167-85e0-c546bcab89f0 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:54:31.369531 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ff2f6a83-3001-4167-85e0-c546bcab89f0 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/412f872c-ead6-4a31-9ed3-b29f2237ae8d" status: 200 len: 1709 microversion: 2.1 time: 0.166170 Aug 31 16:54:31.370115 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3561/7105] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:54:31 2022] GET /compute/v2.1/servers/412f872c-ead6-4a31-9ed3-b29f2237ae8d => generated 1709 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:54:32.394985 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b9cbe661-32dd-4389-988a-dbd6a1927033 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:54:32.395952 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b9cbe661-32dd-4389-988a-dbd6a1927033 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 412f872c-ead6-4a31-9ed3-b29f2237ae8d] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:54:32.403960 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b9cbe661-32dd-4389-988a-dbd6a1927033 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:54:32.404459 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b9cbe661-32dd-4389-988a-dbd6a1927033 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:54:32.404906 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b9cbe661-32dd-4389-988a-dbd6a1927033 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:54:32.405614 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b9cbe661-32dd-4389-988a-dbd6a1927033 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:54:32.406081 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b9cbe661-32dd-4389-988a-dbd6a1927033 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:54:32.406520 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b9cbe661-32dd-4389-988a-dbd6a1927033 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:54:32.537641 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b9cbe661-32dd-4389-988a-dbd6a1927033 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:54:32.545413 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b9cbe661-32dd-4389-988a-dbd6a1927033 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/412f872c-ead6-4a31-9ed3-b29f2237ae8d" status: 200 len: 1697 microversion: 2.1 time: 0.156721 Aug 31 16:54:32.545992 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3545/7106] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:54:32 2022] GET /compute/v2.1/servers/412f872c-ead6-4a31-9ed3-b29f2237ae8d => generated 1697 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:54:33.569583 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8087f17e-30ea-485a-817f-1df78424545a tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:54:33.570209 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8087f17e-30ea-485a-817f-1df78424545a tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 412f872c-ead6-4a31-9ed3-b29f2237ae8d] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:54:33.576286 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8087f17e-30ea-485a-817f-1df78424545a tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:54:33.576785 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8087f17e-30ea-485a-817f-1df78424545a tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:54:33.577233 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8087f17e-30ea-485a-817f-1df78424545a tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:54:33.577932 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8087f17e-30ea-485a-817f-1df78424545a tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:54:33.578403 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8087f17e-30ea-485a-817f-1df78424545a tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:54:33.579009 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8087f17e-30ea-485a-817f-1df78424545a tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:54:33.714857 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8087f17e-30ea-485a-817f-1df78424545a tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:54:33.723040 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8087f17e-30ea-485a-817f-1df78424545a tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/412f872c-ead6-4a31-9ed3-b29f2237ae8d" status: 200 len: 1697 microversion: 2.1 time: 0.158311 Aug 31 16:54:33.723653 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3562/7107] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:54:33 2022] GET /compute/v2.1/servers/412f872c-ead6-4a31-9ed3-b29f2237ae8d => generated 1697 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:54:34.745375 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-febd2f5e-6139-4813-892d-62bb2a9140f3 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:54:34.745928 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-febd2f5e-6139-4813-892d-62bb2a9140f3 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 412f872c-ead6-4a31-9ed3-b29f2237ae8d] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:54:34.753314 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-febd2f5e-6139-4813-892d-62bb2a9140f3 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:54:34.753805 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-febd2f5e-6139-4813-892d-62bb2a9140f3 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:54:34.754245 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-febd2f5e-6139-4813-892d-62bb2a9140f3 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:54:34.754938 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-febd2f5e-6139-4813-892d-62bb2a9140f3 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:54:34.755401 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-febd2f5e-6139-4813-892d-62bb2a9140f3 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:54:34.755854 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-febd2f5e-6139-4813-892d-62bb2a9140f3 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:54:34.887417 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-febd2f5e-6139-4813-892d-62bb2a9140f3 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:54:34.895756 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-febd2f5e-6139-4813-892d-62bb2a9140f3 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/412f872c-ead6-4a31-9ed3-b29f2237ae8d" status: 200 len: 1697 microversion: 2.1 time: 0.154402 Aug 31 16:54:34.896327 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3546/7108] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:54:34 2022] GET /compute/v2.1/servers/412f872c-ead6-4a31-9ed3-b29f2237ae8d => generated 1697 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:54:35.917269 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-488c713f-6519-4e15-adbb-e07af82ee668 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:54:35.918197 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-488c713f-6519-4e15-adbb-e07af82ee668 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 412f872c-ead6-4a31-9ed3-b29f2237ae8d] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:54:35.925966 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-488c713f-6519-4e15-adbb-e07af82ee668 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:54:35.926471 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-488c713f-6519-4e15-adbb-e07af82ee668 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:54:35.927116 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-488c713f-6519-4e15-adbb-e07af82ee668 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:54:35.927733 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-488c713f-6519-4e15-adbb-e07af82ee668 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:54:35.928206 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-488c713f-6519-4e15-adbb-e07af82ee668 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:54:35.928651 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-488c713f-6519-4e15-adbb-e07af82ee668 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:54:36.075822 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-488c713f-6519-4e15-adbb-e07af82ee668 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:54:36.084665 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-488c713f-6519-4e15-adbb-e07af82ee668 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/412f872c-ead6-4a31-9ed3-b29f2237ae8d" status: 200 len: 1682 microversion: 2.1 time: 0.171292 Aug 31 16:54:36.085249 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3563/7109] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:54:35 2022] GET /compute/v2.1/servers/412f872c-ead6-4a31-9ed3-b29f2237ae8d => generated 1682 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:54:36.189256 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-85063c56-81d4-4594-bc5f-d74f33ccd5f9 req-f6d330e2-9c78-4230-8a64-873b803e6767 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "412f872c-ead6-4a31-9ed3-b29f2237ae8d", "name": "network-vif-unplugged", "status": "completed", "tag": "ee079756-27e9-4a85-a0e9-8b1a89d91205"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:54:36.199388 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-85063c56-81d4-4594-bc5f-d74f33ccd5f9 req-f6d330e2-9c78-4230-8a64-873b803e6767 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:54:36.199910 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-85063c56-81d4-4594-bc5f-d74f33ccd5f9 req-f6d330e2-9c78-4230-8a64-873b803e6767 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:54:36.200372 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-85063c56-81d4-4594-bc5f-d74f33ccd5f9 req-f6d330e2-9c78-4230-8a64-873b803e6767 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:54:36.213251 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-85063c56-81d4-4594-bc5f-d74f33ccd5f9 req-f6d330e2-9c78-4230-8a64-873b803e6767 service nova] Creating event network-vif-unplugged:ee079756-27e9-4a85-a0e9-8b1a89d91205 for instance 412f872c-ead6-4a31-9ed3-b29f2237ae8d on n-h1-850499-9 Aug 31 16:54:36.218640 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-85063c56-81d4-4594-bc5f-d74f33ccd5f9 req-f6d330e2-9c78-4230-8a64-873b803e6767 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.094689 Aug 31 16:54:36.220876 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3547/7110] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:54:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:54:38.233317 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-31dae326-0383-4228-9f96-62822f15dfad req-f0c40eb1-25d0-4654-94bc-567240eede9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "412f872c-ead6-4a31-9ed3-b29f2237ae8d", "name": "network-vif-plugged", "status": "completed", "tag": "ee079756-27e9-4a85-a0e9-8b1a89d91205"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:54:38.244204 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-31dae326-0383-4228-9f96-62822f15dfad req-f0c40eb1-25d0-4654-94bc-567240eede9d service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:54:38.244697 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-31dae326-0383-4228-9f96-62822f15dfad req-f0c40eb1-25d0-4654-94bc-567240eede9d service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:54:38.245142 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-31dae326-0383-4228-9f96-62822f15dfad req-f0c40eb1-25d0-4654-94bc-567240eede9d service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:54:38.256915 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-31dae326-0383-4228-9f96-62822f15dfad req-f0c40eb1-25d0-4654-94bc-567240eede9d service nova] Creating event network-vif-plugged:ee079756-27e9-4a85-a0e9-8b1a89d91205 for instance 412f872c-ead6-4a31-9ed3-b29f2237ae8d on n-h1-850499-9 Aug 31 16:54:38.261935 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-31dae326-0383-4228-9f96-62822f15dfad req-f0c40eb1-25d0-4654-94bc-567240eede9d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032304 Aug 31 16:54:38.262520 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3564/7111] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:54:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:55:10.334804 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=26 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:55:10.335676 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:55:10.340358 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9a6cccae-5caf-40fe-b3d4-22c77335c33f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:55:10.342711 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9a6cccae-5caf-40fe-b3d4-22c77335c33f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 412f872c-ead6-4a31-9ed3-b29f2237ae8d] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:55:10.355364 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9a6cccae-5caf-40fe-b3d4-22c77335c33f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:10.356036 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9a6cccae-5caf-40fe-b3d4-22c77335c33f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:10.357646 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9a6cccae-5caf-40fe-b3d4-22c77335c33f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:10.357646 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9a6cccae-5caf-40fe-b3d4-22c77335c33f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:10.357819 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9a6cccae-5caf-40fe-b3d4-22c77335c33f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:10.358184 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9a6cccae-5caf-40fe-b3d4-22c77335c33f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:10.446974 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9a6cccae-5caf-40fe-b3d4-22c77335c33f tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "POST /compute/v2.1/servers/412f872c-ead6-4a31-9ed3-b29f2237ae8d/action" status: 200 len: 24570 microversion: 2.1 time: 0.114086 Aug 31 16:55:10.447899 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3548/7112] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:55:10 2022] POST /compute/v2.1/servers/412f872c-ead6-4a31-9ed3-b29f2237ae8d/action => generated 24570 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 16:55:41.739472 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=22 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:55:41.740694 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=62 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:55:41.745631 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c6f24a70-7fdd-47c2-babd-4b4510a7719a tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:55:41.746247 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c6f24a70-7fdd-47c2-babd-4b4510a7719a tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 412f872c-ead6-4a31-9ed3-b29f2237ae8d] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:55:41.759809 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c6f24a70-7fdd-47c2-babd-4b4510a7719a tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:41.760332 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c6f24a70-7fdd-47c2-babd-4b4510a7719a tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:41.760794 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c6f24a70-7fdd-47c2-babd-4b4510a7719a tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:41.761530 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c6f24a70-7fdd-47c2-babd-4b4510a7719a tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:41.762009 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c6f24a70-7fdd-47c2-babd-4b4510a7719a tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:41.762698 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c6f24a70-7fdd-47c2-babd-4b4510a7719a tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:41.799225 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c6f24a70-7fdd-47c2-babd-4b4510a7719a tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 412f872c-ead6-4a31-9ed3-b29f2237ae8d] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:55:41.806310 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:55:41.808014 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=4 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:55:41.866824 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-e927cb90-b295-4dd3-a1de-23620d97e6eb req-7f4d8b10-4d01-4c3a-8680-0e38a8132891 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "412f872c-ead6-4a31-9ed3-b29f2237ae8d", "tag": "ee079756-27e9-4a85-a0e9-8b1a89d91205"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:55:41.886532 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c6f24a70-7fdd-47c2-babd-4b4510a7719a tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "DELETE /compute/v2.1/servers/412f872c-ead6-4a31-9ed3-b29f2237ae8d" status: 204 len: 0 microversion: 2.1 time: 0.149416 Aug 31 16:55:41.887605 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3565/7113] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:55:41 2022] DELETE /compute/v2.1/servers/412f872c-ead6-4a31-9ed3-b29f2237ae8d => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:55:41.889316 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-e927cb90-b295-4dd3-a1de-23620d97e6eb req-7f4d8b10-4d01-4c3a-8680-0e38a8132891 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:41.890124 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-e927cb90-b295-4dd3-a1de-23620d97e6eb req-7f4d8b10-4d01-4c3a-8680-0e38a8132891 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:41.890883 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-e927cb90-b295-4dd3-a1de-23620d97e6eb req-7f4d8b10-4d01-4c3a-8680-0e38a8132891 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:41.899065 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c1a5f161-2f24-481b-8c9c-e5a6dbfaed08 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:55:41.899831 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c1a5f161-2f24-481b-8c9c-e5a6dbfaed08 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 412f872c-ead6-4a31-9ed3-b29f2237ae8d] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:55:41.905089 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-e927cb90-b295-4dd3-a1de-23620d97e6eb req-7f4d8b10-4d01-4c3a-8680-0e38a8132891 service nova] Creating event network-changed:ee079756-27e9-4a85-a0e9-8b1a89d91205 for instance 412f872c-ead6-4a31-9ed3-b29f2237ae8d on n-h1-850499-9 Aug 31 16:55:41.906744 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c1a5f161-2f24-481b-8c9c-e5a6dbfaed08 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:41.907267 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c1a5f161-2f24-481b-8c9c-e5a6dbfaed08 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:41.907761 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c1a5f161-2f24-481b-8c9c-e5a6dbfaed08 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:41.908545 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c1a5f161-2f24-481b-8c9c-e5a6dbfaed08 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:41.909631 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c1a5f161-2f24-481b-8c9c-e5a6dbfaed08 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:41.909631 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c1a5f161-2f24-481b-8c9c-e5a6dbfaed08 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:41.910999 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-e927cb90-b295-4dd3-a1de-23620d97e6eb req-7f4d8b10-4d01-4c3a-8680-0e38a8132891 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110880 Aug 31 16:55:41.911813 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3549/7114] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:55:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:55:42.060690 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c1a5f161-2f24-481b-8c9c-e5a6dbfaed08 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:55:42.070315 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c1a5f161-2f24-481b-8c9c-e5a6dbfaed08 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/412f872c-ead6-4a31-9ed3-b29f2237ae8d" status: 200 len: 1688 microversion: 2.1 time: 0.177838 Aug 31 16:55:42.071017 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3566/7115] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:55:41 2022] GET /compute/v2.1/servers/412f872c-ead6-4a31-9ed3-b29f2237ae8d => generated 1688 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:55:43.094805 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7736eb31-d5bb-419d-91da-696c2eadad03 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:55:43.095650 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7736eb31-d5bb-419d-91da-696c2eadad03 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 412f872c-ead6-4a31-9ed3-b29f2237ae8d] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:55:43.101857 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7736eb31-d5bb-419d-91da-696c2eadad03 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:43.102348 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7736eb31-d5bb-419d-91da-696c2eadad03 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:43.102789 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7736eb31-d5bb-419d-91da-696c2eadad03 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:43.103486 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7736eb31-d5bb-419d-91da-696c2eadad03 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:43.104071 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7736eb31-d5bb-419d-91da-696c2eadad03 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:43.104772 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7736eb31-d5bb-419d-91da-696c2eadad03 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:43.326412 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7736eb31-d5bb-419d-91da-696c2eadad03 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:55:43.337443 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7736eb31-d5bb-419d-91da-696c2eadad03 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/412f872c-ead6-4a31-9ed3-b29f2237ae8d" status: 200 len: 1688 microversion: 2.1 time: 0.247860 Aug 31 16:55:43.338039 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3550/7116] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:55:43 2022] GET /compute/v2.1/servers/412f872c-ead6-4a31-9ed3-b29f2237ae8d => generated 1688 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:55:44.148732 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-f2309faa-9ed2-44b1-b8a0-979657f45af0 req-d3967963-6a32-4435-8e0f-c84e49c44cfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "412f872c-ead6-4a31-9ed3-b29f2237ae8d", "name": "network-vif-deleted", "tag": "ee079756-27e9-4a85-a0e9-8b1a89d91205"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:55:44.164068 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-f2309faa-9ed2-44b1-b8a0-979657f45af0 req-d3967963-6a32-4435-8e0f-c84e49c44cfe service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:44.164576 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-f2309faa-9ed2-44b1-b8a0-979657f45af0 req-d3967963-6a32-4435-8e0f-c84e49c44cfe service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:44.165036 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-f2309faa-9ed2-44b1-b8a0-979657f45af0 req-d3967963-6a32-4435-8e0f-c84e49c44cfe service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:44.179132 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-f2309faa-9ed2-44b1-b8a0-979657f45af0 req-d3967963-6a32-4435-8e0f-c84e49c44cfe service nova] Creating event network-vif-deleted:ee079756-27e9-4a85-a0e9-8b1a89d91205 for instance 412f872c-ead6-4a31-9ed3-b29f2237ae8d on n-h1-850499-9 Aug 31 16:55:44.184220 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-f2309faa-9ed2-44b1-b8a0-979657f45af0 req-d3967963-6a32-4435-8e0f-c84e49c44cfe service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039362 Aug 31 16:55:44.184836 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3567/7117] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:55:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:55:44.362044 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d421616e-71f6-4789-900c-5463518706c5 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:55:44.362578 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d421616e-71f6-4789-900c-5463518706c5 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 412f872c-ead6-4a31-9ed3-b29f2237ae8d] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:55:44.368837 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d421616e-71f6-4789-900c-5463518706c5 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:44.369324 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d421616e-71f6-4789-900c-5463518706c5 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:44.369785 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d421616e-71f6-4789-900c-5463518706c5 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:44.370563 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d421616e-71f6-4789-900c-5463518706c5 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:44.371035 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d421616e-71f6-4789-900c-5463518706c5 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:44.371475 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d421616e-71f6-4789-900c-5463518706c5 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:44.408428 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d421616e-71f6-4789-900c-5463518706c5 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:44.408928 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d421616e-71f6-4789-900c-5463518706c5 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:44.409384 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d421616e-71f6-4789-900c-5463518706c5 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:44.409843 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-d421616e-71f6-4789-900c-5463518706c5 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lazy-loading 'fault' on Instance uuid 412f872c-ead6-4a31-9ed3-b29f2237ae8d {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:55:44.454615 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d421616e-71f6-4789-900c-5463518706c5 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf392720aaea4a068b23404ef76ccd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1464b491651b43498f56ffcbe24646d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:55:44.463973 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d421616e-71f6-4789-900c-5463518706c5 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/412f872c-ead6-4a31-9ed3-b29f2237ae8d" status: 200 len: 1356 microversion: 2.1 time: 0.106884 Aug 31 16:55:44.477559 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3551/7118] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:55:44 2022] GET /compute/v2.1/servers/412f872c-ead6-4a31-9ed3-b29f2237ae8d => generated 1356 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:55:45.486090 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e4039597-4f11-4e02-ae9c-498f2fcce166 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:55:45.486812 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e4039597-4f11-4e02-ae9c-498f2fcce166 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [instance: 412f872c-ead6-4a31-9ed3-b29f2237ae8d] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:55:45.493971 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e4039597-4f11-4e02-ae9c-498f2fcce166 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:45.494483 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e4039597-4f11-4e02-ae9c-498f2fcce166 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:45.494947 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e4039597-4f11-4e02-ae9c-498f2fcce166 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:45.495703 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e4039597-4f11-4e02-ae9c-498f2fcce166 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:45.496182 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e4039597-4f11-4e02-ae9c-498f2fcce166 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:45.496633 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e4039597-4f11-4e02-ae9c-498f2fcce166 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:45.510460 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-e4039597-4f11-4e02-ae9c-498f2fcce166 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] HTTP exception thrown: Instance 412f872c-ead6-4a31-9ed3-b29f2237ae8d could not be found. Aug 31 16:55:45.512140 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e4039597-4f11-4e02-ae9c-498f2fcce166 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Request method failure captured: Aug 31 16:55:45.512140 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/412f872c-ead6-4a31-9ed3-b29f2237ae8d HTTP/1.1 Aug 31 16:55:45.512140 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:55:45.512140 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:55:45.512140 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:55:45.512140 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:55:45.512140 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:55:45.512140 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:55:45.512140 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:55:45.512140 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:55:45.512140 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD4_WgD4QikPr5cF-bgJByIIY9om79DYcPMqMqsO-QLvTluETH-73GviQTPoMUqKYlX3NhUluX-Xu-yN_DDF2dOtGmm0lyWPtEq7FsxUNcGFIoyzKHnCgn3ibP5w1pC53PzHFJSukSTZE-QhQ71cjyt3B2uRrfnTMcNRrq4qjkk4kSj8 Aug 31 16:55:45.512140 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:55:45.512140 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:55:45.512140 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:55:45.512140 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:55:45.512140 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:55:45.512140 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:55:45.512140 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 1464b491651b43498f56ffcbe24646d8 Aug 31 16:55:45.512140 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-386022060 Aug 31 16:55:45.512140 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:55:45.512140 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:55:45.512140 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1464b491651b43498f56ffcbe24646d8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1464b491651b43498f56ffcbe24646d8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1464b491651b43498f56ffcbe24646d8", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1464b491651b43498f56ffcbe24646d8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:55:45.512140 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-TestNetworkAdvancedServerOps-386022060 Aug 31 16:55:45.512140 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 1464b491651b43498f56ffcbe24646d8 Aug 31 16:55:45.512140 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-386022060 Aug 31 16:55:45.512140 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-TestNetworkAdvancedServerOps-386022060-project Aug 31 16:55:45.512140 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:55:45.512140 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:55:45.512140 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: bf392720aaea4a068b23404ef76ccd5f Aug 31 16:55:45.512140 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-TestNetworkAdvancedServerOps-386022060-project Aug 31 16:55:45.512140 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:55:45.512140 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance 412f872c-ead6-4a31-9ed3-b29f2237ae8d could not be found. Aug 31 16:55:45.512140 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '412f872c-ead6-4a31-9ed3-b29f2237ae8d'} Aug 31 16:55:45.512140 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:55:45.512140 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:55:45.512140 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:55:45.512140 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:55:45.512140 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:55:45.512140 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:55:45.512140 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:55:45.512140 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:55:45.512140 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:55:45.512140 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:55:45.512140 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 412f872c-ead6-4a31-9ed3-b29f2237ae8d could not be found. Aug 31 16:55:45.512140 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:55:45.512140 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:55:45.512140 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:55:45.512140 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:55:45.512140 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:55:45.512140 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:55:45.512140 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:55:45.512140 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:55:45.512140 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:55:45.512140 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:55:45.512140 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:55:45.512140 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:55:45.512140 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:55:45.512140 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:55:45.512140 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:55:45.512140 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:55:45.512140 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 412f872c-ead6-4a31-9ed3-b29f2237ae8d could not be found. Aug 31 16:55:45.512140 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:55:45.512140 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:55:45.517419 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:55:45.517419 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:55:45.517419 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:55:45.517419 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:55:45.517419 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:55:45.517419 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:55:45.517419 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 412f872c-ead6-4a31-9ed3-b29f2237ae8d could not be found. Aug 31 16:55:45.517419 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:55:45.517419 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e4039597-4f11-4e02-ae9c-498f2fcce166 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Returning 404 to user: Instance 412f872c-ead6-4a31-9ed3-b29f2237ae8d could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:55:45.517419 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e4039597-4f11-4e02-ae9c-498f2fcce166 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "GET /compute/v2.1/servers/412f872c-ead6-4a31-9ed3-b29f2237ae8d" status: 404 len: 111 microversion: 2.1 time: 0.032002 Aug 31 16:55:45.517419 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3568/7119] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:55:45 2022] GET /compute/v2.1/servers/412f872c-ead6-4a31-9ed3-b29f2237ae8d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:55:49.009483 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-dd95d47c-c64c-4c18-b0cb-074a427e0219 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] Calling method '.version_select at 0x7f5ae91cd160>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:55:49.018925 n-d-850499-9 devstack@n-api.service[122256]: ERROR oslo.messaging._drivers.impl_rabbit [None req-dd95d47c-c64c-4c18-b0cb-074a427e0219 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [1ec33fc2-e14a-42ed-8921-718494e3d541] AMQP server on 10.222.0.61:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 31 16:55:50.025984 n-d-850499-9 devstack@n-api.service[122256]: INFO oslo.messaging._drivers.impl_rabbit [None req-dd95d47c-c64c-4c18-b0cb-074a427e0219 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] [1ec33fc2-e14a-42ed-8921-718494e3d541] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 35616. Aug 31 16:55:50.046888 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-dd95d47c-c64c-4c18-b0cb-074a427e0219 tempest-TestNetworkAdvancedServerOps-386022060 tempest-TestNetworkAdvancedServerOps-386022060-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1958334303" status: 202 len: 0 microversion: 2.1 time: 1.041542 Aug 31 16:55:50.047484 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3552/7120] 10.222.0.61 () {58 vars in 1284 bytes} [Wed Aug 31 16:55:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1958334303 => generated 0 bytes in 1043 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:56:02.701609 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:56:02.703147 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:56:02.837853 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-28bb8d7d-d015-42d3-8bae-35643f51d498 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1070884130", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:56:02.893214 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-28bb8d7d-d015-42d3-8bae-35643f51d498 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] validate_networks() for None {{(pid=122257) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:56:03.181833 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-28bb8d7d-d015-42d3-8bae-35643f51d498 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:56:03.182296 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-28bb8d7d-d015-42d3-8bae-35643f51d498 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:56:03.182874 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-28bb8d7d-d015-42d3-8bae-35643f51d498 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:56:03.183301 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-28bb8d7d-d015-42d3-8bae-35643f51d498 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:56:03.183755 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-28bb8d7d-d015-42d3-8bae-35643f51d498 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:56:03.200191 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-28bb8d7d-d015-42d3-8bae-35643f51d498 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:03.200693 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-28bb8d7d-d015-42d3-8bae-35643f51d498 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:03.201155 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-28bb8d7d-d015-42d3-8bae-35643f51d498 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:03.202550 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-28bb8d7d-d015-42d3-8bae-35643f51d498 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:03.203029 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-28bb8d7d-d015-42d3-8bae-35643f51d498 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:03.203597 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-28bb8d7d-d015-42d3-8bae-35643f51d498 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:03.223233 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-28bb8d7d-d015-42d3-8bae-35643f51d498 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Getting quotas for project 4ca037d272dd4033af2cdc4294eb8af2. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:56:03.228830 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-28bb8d7d-d015-42d3-8bae-35643f51d498 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Getting quotas for user aa5b2c80c21846b38065af07af21812d and project 4ca037d272dd4033af2cdc4294eb8af2. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:56:03.241379 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-28bb8d7d-d015-42d3-8bae-35643f51d498 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Going to run 1 instances... {{(pid=122257) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:56:03.243781 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-28bb8d7d-d015-42d3-8bae-35643f51d498 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] [instance: b6131f25-563b-4808-b12b-f82e291dc513] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:56:03.287082 n-d-850499-9 devstack@n-api.service[122257]: ERROR oslo.messaging._drivers.impl_rabbit [None req-28bb8d7d-d015-42d3-8bae-35643f51d498 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] [08cd7b35-3bf6-4e68-8f61-cc4146940754] AMQP server on 10.222.0.61:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 31 16:56:04.295642 n-d-850499-9 devstack@n-api.service[122257]: INFO oslo.messaging._drivers.impl_rabbit [None req-28bb8d7d-d015-42d3-8bae-35643f51d498 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] [08cd7b35-3bf6-4e68-8f61-cc4146940754] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 35700. Aug 31 16:56:04.300815 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-28bb8d7d-d015-42d3-8bae-35643f51d498 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.604389 Aug 31 16:56:04.301481 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3569/7121] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:56:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1606 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:56:04.311839 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=16 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:56:04.312586 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:56:04.318115 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a80cc8bd-daa9-48a3-9d9a-da5cf466a49a tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:56:04.319075 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a80cc8bd-daa9-48a3-9d9a-da5cf466a49a tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] [instance: b6131f25-563b-4808-b12b-f82e291dc513] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:56:04.379686 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a80cc8bd-daa9-48a3-9d9a-da5cf466a49a tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5b2c80c21846b38065af07af21812d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca037d272dd4033af2cdc4294eb8af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:56:04.391263 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a80cc8bd-daa9-48a3-9d9a-da5cf466a49a tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] 10.222.0.61 "GET /compute/v2.1/servers/b6131f25-563b-4808-b12b-f82e291dc513" status: 200 len: 1222 microversion: 2.1 time: 0.080785 Aug 31 16:56:04.392025 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3553/7122] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:56:04 2022] GET /compute/v2.1/servers/b6131f25-563b-4808-b12b-f82e291dc513 => generated 1222 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:56:05.413209 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1c6be70e-c76c-4038-ad17-8b55737b368e tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:56:05.414527 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1c6be70e-c76c-4038-ad17-8b55737b368e tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] [instance: b6131f25-563b-4808-b12b-f82e291dc513] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:56:05.421204 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1c6be70e-c76c-4038-ad17-8b55737b368e tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:05.421704 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1c6be70e-c76c-4038-ad17-8b55737b368e tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:05.422162 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1c6be70e-c76c-4038-ad17-8b55737b368e tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:05.422876 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1c6be70e-c76c-4038-ad17-8b55737b368e tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:05.423352 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1c6be70e-c76c-4038-ad17-8b55737b368e tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:05.423833 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1c6be70e-c76c-4038-ad17-8b55737b368e tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:05.490348 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-1c6be70e-c76c-4038-ad17-8b55737b368e tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5b2c80c21846b38065af07af21812d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca037d272dd4033af2cdc4294eb8af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:56:05.498583 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1c6be70e-c76c-4038-ad17-8b55737b368e tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] 10.222.0.61 "GET /compute/v2.1/servers/b6131f25-563b-4808-b12b-f82e291dc513" status: 200 len: 1274 microversion: 2.1 time: 0.090085 Aug 31 16:56:05.500321 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3570/7123] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:56:05 2022] GET /compute/v2.1/servers/b6131f25-563b-4808-b12b-f82e291dc513 => generated 1274 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:56:06.522136 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b0cefb49-84d6-48f7-84c5-ad8698df5920 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:56:06.522911 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b0cefb49-84d6-48f7-84c5-ad8698df5920 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] [instance: b6131f25-563b-4808-b12b-f82e291dc513] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:56:06.531574 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b0cefb49-84d6-48f7-84c5-ad8698df5920 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:06.532367 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b0cefb49-84d6-48f7-84c5-ad8698df5920 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:06.532984 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b0cefb49-84d6-48f7-84c5-ad8698df5920 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:06.533706 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b0cefb49-84d6-48f7-84c5-ad8698df5920 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:06.534172 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b0cefb49-84d6-48f7-84c5-ad8698df5920 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:06.534610 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b0cefb49-84d6-48f7-84c5-ad8698df5920 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:06.692464 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b0cefb49-84d6-48f7-84c5-ad8698df5920 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5b2c80c21846b38065af07af21812d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca037d272dd4033af2cdc4294eb8af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:56:06.700749 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b0cefb49-84d6-48f7-84c5-ad8698df5920 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] 10.222.0.61 "GET /compute/v2.1/servers/b6131f25-563b-4808-b12b-f82e291dc513" status: 200 len: 1322 microversion: 2.1 time: 0.182627 Aug 31 16:56:06.701498 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3554/7124] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:56:06 2022] GET /compute/v2.1/servers/b6131f25-563b-4808-b12b-f82e291dc513 => generated 1322 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:56:07.300157 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-0e8d6dc6-bffa-4a10-8cfd-b3f0ca3a113e req-0b44a2f3-2de4-42bb-9227-e7d0ca291ef4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6131f25-563b-4808-b12b-f82e291dc513", "tag": "18d9a1f5-ca2f-44d9-b0d3-ffa8eddb5f33"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:56:07.312996 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-0e8d6dc6-bffa-4a10-8cfd-b3f0ca3a113e req-0b44a2f3-2de4-42bb-9227-e7d0ca291ef4 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:07.313752 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-0e8d6dc6-bffa-4a10-8cfd-b3f0ca3a113e req-0b44a2f3-2de4-42bb-9227-e7d0ca291ef4 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:07.314290 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-0e8d6dc6-bffa-4a10-8cfd-b3f0ca3a113e req-0b44a2f3-2de4-42bb-9227-e7d0ca291ef4 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:07.325898 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-0e8d6dc6-bffa-4a10-8cfd-b3f0ca3a113e req-0b44a2f3-2de4-42bb-9227-e7d0ca291ef4 service nova] Creating event network-changed:18d9a1f5-ca2f-44d9-b0d3-ffa8eddb5f33 for instance b6131f25-563b-4808-b12b-f82e291dc513 on n-h2-850499-9 Aug 31 16:56:07.331723 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-0e8d6dc6-bffa-4a10-8cfd-b3f0ca3a113e req-0b44a2f3-2de4-42bb-9227-e7d0ca291ef4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037220 Aug 31 16:56:07.332512 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3571/7125] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:56:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:56:07.723223 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3cbeb682-e104-4bbc-8b72-0f04c5d51fca tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:56:07.723772 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3cbeb682-e104-4bbc-8b72-0f04c5d51fca tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] [instance: b6131f25-563b-4808-b12b-f82e291dc513] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:56:07.730731 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3cbeb682-e104-4bbc-8b72-0f04c5d51fca tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:07.731230 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3cbeb682-e104-4bbc-8b72-0f04c5d51fca tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:07.731704 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3cbeb682-e104-4bbc-8b72-0f04c5d51fca tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:07.732414 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3cbeb682-e104-4bbc-8b72-0f04c5d51fca tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:07.733003 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3cbeb682-e104-4bbc-8b72-0f04c5d51fca tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:07.733918 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3cbeb682-e104-4bbc-8b72-0f04c5d51fca tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:07.957003 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3cbeb682-e104-4bbc-8b72-0f04c5d51fca tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5b2c80c21846b38065af07af21812d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca037d272dd4033af2cdc4294eb8af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:56:07.965195 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3cbeb682-e104-4bbc-8b72-0f04c5d51fca tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] 10.222.0.61 "GET /compute/v2.1/servers/b6131f25-563b-4808-b12b-f82e291dc513" status: 200 len: 1322 microversion: 2.1 time: 0.246124 Aug 31 16:56:07.965806 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3555/7126] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:56:07 2022] GET /compute/v2.1/servers/b6131f25-563b-4808-b12b-f82e291dc513 => generated 1322 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:56:08.987416 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-34107af7-df2b-4238-aa09-6ab5b030afda tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:56:08.988155 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-34107af7-df2b-4238-aa09-6ab5b030afda tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] [instance: b6131f25-563b-4808-b12b-f82e291dc513] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:56:08.995138 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-34107af7-df2b-4238-aa09-6ab5b030afda tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:08.995676 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-34107af7-df2b-4238-aa09-6ab5b030afda tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:08.996128 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-34107af7-df2b-4238-aa09-6ab5b030afda tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:08.996831 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-34107af7-df2b-4238-aa09-6ab5b030afda tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:08.997298 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-34107af7-df2b-4238-aa09-6ab5b030afda tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:08.997736 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-34107af7-df2b-4238-aa09-6ab5b030afda tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:09.132967 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-34107af7-df2b-4238-aa09-6ab5b030afda tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5b2c80c21846b38065af07af21812d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca037d272dd4033af2cdc4294eb8af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:56:09.141287 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-34107af7-df2b-4238-aa09-6ab5b030afda tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] 10.222.0.61 "GET /compute/v2.1/servers/b6131f25-563b-4808-b12b-f82e291dc513" status: 200 len: 1322 microversion: 2.1 time: 0.158798 Aug 31 16:56:09.141864 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3572/7127] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:56:08 2022] GET /compute/v2.1/servers/b6131f25-563b-4808-b12b-f82e291dc513 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:56:10.161882 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e2a233fc-b244-477a-bb76-65e742eb9788 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:56:10.162501 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e2a233fc-b244-477a-bb76-65e742eb9788 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] [instance: b6131f25-563b-4808-b12b-f82e291dc513] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:56:10.169354 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e2a233fc-b244-477a-bb76-65e742eb9788 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:10.169843 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e2a233fc-b244-477a-bb76-65e742eb9788 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:10.170283 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e2a233fc-b244-477a-bb76-65e742eb9788 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:10.171701 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e2a233fc-b244-477a-bb76-65e742eb9788 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:10.172165 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e2a233fc-b244-477a-bb76-65e742eb9788 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:10.172598 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e2a233fc-b244-477a-bb76-65e742eb9788 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:10.309698 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e2a233fc-b244-477a-bb76-65e742eb9788 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5b2c80c21846b38065af07af21812d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca037d272dd4033af2cdc4294eb8af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:56:10.318057 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e2a233fc-b244-477a-bb76-65e742eb9788 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] 10.222.0.61 "GET /compute/v2.1/servers/b6131f25-563b-4808-b12b-f82e291dc513" status: 200 len: 1322 microversion: 2.1 time: 0.160123 Aug 31 16:56:10.318634 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3556/7128] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:56:10 2022] GET /compute/v2.1/servers/b6131f25-563b-4808-b12b-f82e291dc513 => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:56:11.338551 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2e940bad-3ad0-4219-ab53-0726c8c7ce84 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:56:11.339116 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2e940bad-3ad0-4219-ab53-0726c8c7ce84 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] [instance: b6131f25-563b-4808-b12b-f82e291dc513] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:56:11.346175 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2e940bad-3ad0-4219-ab53-0726c8c7ce84 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:11.346667 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2e940bad-3ad0-4219-ab53-0726c8c7ce84 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:11.347114 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2e940bad-3ad0-4219-ab53-0726c8c7ce84 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:11.347837 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2e940bad-3ad0-4219-ab53-0726c8c7ce84 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:11.348304 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2e940bad-3ad0-4219-ab53-0726c8c7ce84 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:11.348770 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2e940bad-3ad0-4219-ab53-0726c8c7ce84 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:11.483727 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2e940bad-3ad0-4219-ab53-0726c8c7ce84 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5b2c80c21846b38065af07af21812d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca037d272dd4033af2cdc4294eb8af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:56:11.491576 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2e940bad-3ad0-4219-ab53-0726c8c7ce84 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] 10.222.0.61 "GET /compute/v2.1/servers/b6131f25-563b-4808-b12b-f82e291dc513" status: 200 len: 1322 microversion: 2.1 time: 0.157026 Aug 31 16:56:11.492169 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3573/7129] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:56:11 2022] GET /compute/v2.1/servers/b6131f25-563b-4808-b12b-f82e291dc513 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:56:12.512247 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0da92a43-a121-4283-9526-ff3610adf4a2 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:56:12.512859 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0da92a43-a121-4283-9526-ff3610adf4a2 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] [instance: b6131f25-563b-4808-b12b-f82e291dc513] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:56:12.520811 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0da92a43-a121-4283-9526-ff3610adf4a2 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:12.521312 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0da92a43-a121-4283-9526-ff3610adf4a2 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:12.521784 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0da92a43-a121-4283-9526-ff3610adf4a2 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:12.522489 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0da92a43-a121-4283-9526-ff3610adf4a2 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:12.522955 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0da92a43-a121-4283-9526-ff3610adf4a2 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:12.523391 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0da92a43-a121-4283-9526-ff3610adf4a2 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:12.658009 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-0da92a43-a121-4283-9526-ff3610adf4a2 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5b2c80c21846b38065af07af21812d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca037d272dd4033af2cdc4294eb8af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:56:12.665657 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0da92a43-a121-4283-9526-ff3610adf4a2 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] 10.222.0.61 "GET /compute/v2.1/servers/b6131f25-563b-4808-b12b-f82e291dc513" status: 200 len: 1322 microversion: 2.1 time: 0.157284 Aug 31 16:56:12.666235 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3557/7130] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:56:12 2022] GET /compute/v2.1/servers/b6131f25-563b-4808-b12b-f82e291dc513 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:56:13.686654 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-696e9f82-0fd8-478a-9a9a-b2eb1f2dacb9 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:56:13.687347 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-696e9f82-0fd8-478a-9a9a-b2eb1f2dacb9 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] [instance: b6131f25-563b-4808-b12b-f82e291dc513] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:56:13.690207 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:56:13.691072 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=6 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:56:13.697357 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-696e9f82-0fd8-478a-9a9a-b2eb1f2dacb9 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:13.697786 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-696e9f82-0fd8-478a-9a9a-b2eb1f2dacb9 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:13.698243 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-696e9f82-0fd8-478a-9a9a-b2eb1f2dacb9 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:13.698965 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-696e9f82-0fd8-478a-9a9a-b2eb1f2dacb9 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:13.699447 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-696e9f82-0fd8-478a-9a9a-b2eb1f2dacb9 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:13.699930 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-696e9f82-0fd8-478a-9a9a-b2eb1f2dacb9 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:13.839184 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-696e9f82-0fd8-478a-9a9a-b2eb1f2dacb9 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5b2c80c21846b38065af07af21812d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca037d272dd4033af2cdc4294eb8af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:56:13.848311 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-696e9f82-0fd8-478a-9a9a-b2eb1f2dacb9 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] 10.222.0.61 "GET /compute/v2.1/servers/b6131f25-563b-4808-b12b-f82e291dc513" status: 200 len: 1322 microversion: 2.1 time: 0.166137 Aug 31 16:56:13.848922 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3574/7131] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:56:13 2022] GET /compute/v2.1/servers/b6131f25-563b-4808-b12b-f82e291dc513 => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:56:14.869991 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ee658ce9-6eb5-49c9-af5e-926b28e3773d tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:56:14.870614 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ee658ce9-6eb5-49c9-af5e-926b28e3773d tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] [instance: b6131f25-563b-4808-b12b-f82e291dc513] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:56:14.875992 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:56:14.880181 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ee658ce9-6eb5-49c9-af5e-926b28e3773d tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:14.880689 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ee658ce9-6eb5-49c9-af5e-926b28e3773d tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:14.881167 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ee658ce9-6eb5-49c9-af5e-926b28e3773d tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:14.881977 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ee658ce9-6eb5-49c9-af5e-926b28e3773d tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:14.882456 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ee658ce9-6eb5-49c9-af5e-926b28e3773d tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:14.882904 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ee658ce9-6eb5-49c9-af5e-926b28e3773d tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:15.015511 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ee658ce9-6eb5-49c9-af5e-926b28e3773d tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5b2c80c21846b38065af07af21812d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca037d272dd4033af2cdc4294eb8af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:56:15.023203 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ee658ce9-6eb5-49c9-af5e-926b28e3773d tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] 10.222.0.61 "GET /compute/v2.1/servers/b6131f25-563b-4808-b12b-f82e291dc513" status: 200 len: 1322 microversion: 2.1 time: 0.157450 Aug 31 16:56:15.023933 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3558/7132] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:56:14 2022] GET /compute/v2.1/servers/b6131f25-563b-4808-b12b-f82e291dc513 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:56:15.360179 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-4e57e29a-9f3f-4255-acb1-39eb11c62d33 req-74082dbb-193a-460c-863a-b9c3bfad2d68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6131f25-563b-4808-b12b-f82e291dc513", "name": "network-vif-plugged", "status": "completed", "tag": "18d9a1f5-ca2f-44d9-b0d3-ffa8eddb5f33"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:56:15.371240 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-4e57e29a-9f3f-4255-acb1-39eb11c62d33 req-74082dbb-193a-460c-863a-b9c3bfad2d68 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:15.371766 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-4e57e29a-9f3f-4255-acb1-39eb11c62d33 req-74082dbb-193a-460c-863a-b9c3bfad2d68 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:15.372217 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-4e57e29a-9f3f-4255-acb1-39eb11c62d33 req-74082dbb-193a-460c-863a-b9c3bfad2d68 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:15.384238 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-4e57e29a-9f3f-4255-acb1-39eb11c62d33 req-74082dbb-193a-460c-863a-b9c3bfad2d68 service nova] Creating event network-vif-plugged:18d9a1f5-ca2f-44d9-b0d3-ffa8eddb5f33 for instance b6131f25-563b-4808-b12b-f82e291dc513 on n-h2-850499-9 Aug 31 16:56:15.390464 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-4e57e29a-9f3f-4255-acb1-39eb11c62d33 req-74082dbb-193a-460c-863a-b9c3bfad2d68 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035051 Aug 31 16:56:15.391045 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3575/7133] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:56:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:56:16.045196 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6746d36f-abe4-4247-b0f1-f8b67c9813e1 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:56:16.046519 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6746d36f-abe4-4247-b0f1-f8b67c9813e1 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] [instance: b6131f25-563b-4808-b12b-f82e291dc513] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:56:16.053288 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6746d36f-abe4-4247-b0f1-f8b67c9813e1 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:16.053783 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6746d36f-abe4-4247-b0f1-f8b67c9813e1 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:16.054231 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6746d36f-abe4-4247-b0f1-f8b67c9813e1 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:16.054940 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6746d36f-abe4-4247-b0f1-f8b67c9813e1 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:16.055415 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6746d36f-abe4-4247-b0f1-f8b67c9813e1 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:16.055874 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6746d36f-abe4-4247-b0f1-f8b67c9813e1 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:16.194053 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-6746d36f-abe4-4247-b0f1-f8b67c9813e1 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5b2c80c21846b38065af07af21812d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca037d272dd4033af2cdc4294eb8af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:56:16.204120 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6746d36f-abe4-4247-b0f1-f8b67c9813e1 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] 10.222.0.61 "GET /compute/v2.1/servers/b6131f25-563b-4808-b12b-f82e291dc513" status: 200 len: 1322 microversion: 2.1 time: 0.163913 Aug 31 16:56:16.204722 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3559/7134] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:56:16 2022] GET /compute/v2.1/servers/b6131f25-563b-4808-b12b-f82e291dc513 => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:56:17.229769 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-22d4fe21-c98a-4b41-bbca-76dd8606ecf6 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:56:17.230508 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-22d4fe21-c98a-4b41-bbca-76dd8606ecf6 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] [instance: b6131f25-563b-4808-b12b-f82e291dc513] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:56:17.237565 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-22d4fe21-c98a-4b41-bbca-76dd8606ecf6 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:17.238077 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-22d4fe21-c98a-4b41-bbca-76dd8606ecf6 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:17.238537 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-22d4fe21-c98a-4b41-bbca-76dd8606ecf6 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:17.239280 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-22d4fe21-c98a-4b41-bbca-76dd8606ecf6 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:17.239764 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-22d4fe21-c98a-4b41-bbca-76dd8606ecf6 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:17.240326 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-22d4fe21-c98a-4b41-bbca-76dd8606ecf6 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:17.378487 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-22d4fe21-c98a-4b41-bbca-76dd8606ecf6 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5b2c80c21846b38065af07af21812d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca037d272dd4033af2cdc4294eb8af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:56:17.386966 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-22d4fe21-c98a-4b41-bbca-76dd8606ecf6 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] 10.222.0.61 "GET /compute/v2.1/servers/b6131f25-563b-4808-b12b-f82e291dc513" status: 200 len: 1471 microversion: 2.1 time: 0.162421 Aug 31 16:56:17.387589 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3576/7135] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:56:17 2022] GET /compute/v2.1/servers/b6131f25-563b-4808-b12b-f82e291dc513 => generated 1471 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:56:17.464205 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9bb83173-0e78-4c94-b72c-db1e8718f2be tempest-ServersAdminNegativeTestJSON-2063182525 tempest-ServersAdminNegativeTestJSON-2063182525-project-admin] Calling method '.version_select at 0x7f5ae3d1a700>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:56:17.536383 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9bb83173-0e78-4c94-b72c-db1e8718f2be tempest-ServersAdminNegativeTestJSON-2063182525 tempest-ServersAdminNegativeTestJSON-2063182525-project-admin] 10.222.0.61 "GET /compute/v2.1/os-quota-sets/03d3245a207048b6b7046d1d7c8f52d6" status: 200 len: 371 microversion: 2.1 time: 0.130038 Aug 31 16:56:17.536962 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3560/7136] 10.222.0.61 () {58 vars in 1242 bytes} [Wed Aug 31 16:56:17 2022] GET /compute/v2.1/os-quota-sets/03d3245a207048b6b7046d1d7c8f52d6 => generated 371 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:56:17.549734 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d3419477-3805-4214-aa84-dc26d13f52de tempest-ServersAdminNegativeTestJSON-2063182525 tempest-ServersAdminNegativeTestJSON-2063182525-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-155035958", "id": 47965545, "os-flavor-access:is_public": "True"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:56:17.568456 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d3419477-3805-4214-aa84-dc26d13f52de tempest-ServersAdminNegativeTestJSON-2063182525 tempest-ServersAdminNegativeTestJSON-2063182525-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.023609 Aug 31 16:56:17.569215 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3577/7137] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:56:17 2022] POST /compute/v2.1/flavors => generated 431 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:56:17.581505 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-88ced35c-aaa6-499f-afa0-bb95c028c72f tempest-ServersAdminNegativeTestJSON-2063182525 tempest-ServersAdminNegativeTestJSON-2063182525-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "47965545"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:56:17.583801 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-88ced35c-aaa6-499f-afa0-bb95c028c72f tempest-ServersAdminNegativeTestJSON-2063182525 tempest-ServersAdminNegativeTestJSON-2063182525-project-admin] [instance: b6131f25-563b-4808-b12b-f82e291dc513] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:56:17.589720 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-88ced35c-aaa6-499f-afa0-bb95c028c72f tempest-ServersAdminNegativeTestJSON-2063182525 tempest-ServersAdminNegativeTestJSON-2063182525-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:17.590207 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-88ced35c-aaa6-499f-afa0-bb95c028c72f tempest-ServersAdminNegativeTestJSON-2063182525 tempest-ServersAdminNegativeTestJSON-2063182525-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:17.590643 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-88ced35c-aaa6-499f-afa0-bb95c028c72f tempest-ServersAdminNegativeTestJSON-2063182525 tempest-ServersAdminNegativeTestJSON-2063182525-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:17.591336 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-88ced35c-aaa6-499f-afa0-bb95c028c72f tempest-ServersAdminNegativeTestJSON-2063182525 tempest-ServersAdminNegativeTestJSON-2063182525-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:17.591823 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-88ced35c-aaa6-499f-afa0-bb95c028c72f tempest-ServersAdminNegativeTestJSON-2063182525 tempest-ServersAdminNegativeTestJSON-2063182525-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:17.592298 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-88ced35c-aaa6-499f-afa0-bb95c028c72f tempest-ServersAdminNegativeTestJSON-2063182525 tempest-ServersAdminNegativeTestJSON-2063182525-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:17.752108 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-88ced35c-aaa6-499f-afa0-bb95c028c72f tempest-ServersAdminNegativeTestJSON-2063182525 tempest-ServersAdminNegativeTestJSON-2063182525-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'd6d5382bd6904e34b8a536076a0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03d3245a207048b6b7046d1d7c8f52d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:56:17.758881 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-88ced35c-aaa6-499f-afa0-bb95c028c72f tempest-ServersAdminNegativeTestJSON-2063182525 tempest-ServersAdminNegativeTestJSON-2063182525-project-admin] [instance: b6131f25-563b-4808-b12b-f82e291dc513] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-155035958 {{(pid=122256) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 31 16:56:17.765585 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-88ced35c-aaa6-499f-afa0-bb95c028c72f tempest-ServersAdminNegativeTestJSON-2063182525 tempest-ServersAdminNegativeTestJSON-2063182525-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:17.766065 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-88ced35c-aaa6-499f-afa0-bb95c028c72f tempest-ServersAdminNegativeTestJSON-2063182525 tempest-ServersAdminNegativeTestJSON-2063182525-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:17.766501 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-88ced35c-aaa6-499f-afa0-bb95c028c72f tempest-ServersAdminNegativeTestJSON-2063182525 tempest-ServersAdminNegativeTestJSON-2063182525-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:17.767223 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-88ced35c-aaa6-499f-afa0-bb95c028c72f tempest-ServersAdminNegativeTestJSON-2063182525 tempest-ServersAdminNegativeTestJSON-2063182525-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:17.767721 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-88ced35c-aaa6-499f-afa0-bb95c028c72f tempest-ServersAdminNegativeTestJSON-2063182525 tempest-ServersAdminNegativeTestJSON-2063182525-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:17.768149 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-88ced35c-aaa6-499f-afa0-bb95c028c72f tempest-ServersAdminNegativeTestJSON-2063182525 tempest-ServersAdminNegativeTestJSON-2063182525-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:17.792482 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-88ced35c-aaa6-499f-afa0-bb95c028c72f tempest-ServersAdminNegativeTestJSON-2063182525 tempest-ServersAdminNegativeTestJSON-2063182525-project-admin] Getting quotas for project 4ca037d272dd4033af2cdc4294eb8af2. Resources: {'ram', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:56:17.800612 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-88ced35c-aaa6-499f-afa0-bb95c028c72f tempest-ServersAdminNegativeTestJSON-2063182525 tempest-ServersAdminNegativeTestJSON-2063182525-project-admin] Getting quotas for user aa5b2c80c21846b38065af07af21812d and project 4ca037d272dd4033af2cdc4294eb8af2. Resources: {'ram', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:56:17.815336 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.compute.api [None req-88ced35c-aaa6-499f-afa0-bb95c028c72f tempest-ServersAdminNegativeTestJSON-2063182525 tempest-ServersAdminNegativeTestJSON-2063182525-project-admin] ram quota exceeded for 03d3245a207048b6b7046d1d7c8f52d6, tried to resize instance. Aug 31 16:56:17.815914 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-88ced35c-aaa6-499f-afa0-bb95c028c72f tempest-ServersAdminNegativeTestJSON-2063182525 tempest-ServersAdminNegativeTestJSON-2063182525-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 31 16:56:17.823937 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-88ced35c-aaa6-499f-afa0-bb95c028c72f tempest-ServersAdminNegativeTestJSON-2063182525 tempest-ServersAdminNegativeTestJSON-2063182525-project-admin] Request method failure captured: Aug 31 16:56:17.823937 n-d-850499-9 devstack@n-api.service[122256]: request: POST /compute/v2.1/servers/b6131f25-563b-4808-b12b-f82e291dc513/action HTTP/1.1 Aug 31 16:56:17.823937 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:56:17.823937 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:56:17.823937 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:56:17.823937 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 37 Aug 31 16:56:17.823937 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:56:17.823937 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:56:17.823937 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:56:17.823937 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:56:17.823937 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD5KiEqZhVAdcNhysxfKSJjBr4pqf9IN5Z55Ig1wsmzsRJEnbEtrwGOlJb7jgkLxSC8-h5uRALCs8MMcMYFmYd6-el6WR0gZzhtO6mbrI5whJS5-t9Xks3YI_csOVpq2t0OR__WjLTQgkWjW6jUYhtkkSYZVQcUxWXbArOYAUAKZS7Sw Aug 31 16:56:17.823937 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:56:17.823937 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:56:17.823937 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:56:17.823937 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:56:17.823937 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:56:17.823937 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:56:17.823937 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 03d3245a207048b6b7046d1d7c8f52d6 Aug 31 16:56:17.823937 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2063182525 Aug 31 16:56:17.823937 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,admin,member Aug 31 16:56:17.823937 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,admin,member Aug 31 16:56:17.823937 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/03d3245a207048b6b7046d1d7c8f52d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/03d3245a207048b6b7046d1d7c8f52d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_03d3245a207048b6b7046d1d7c8f52d6", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/03d3245a207048b6b7046d1d7c8f52d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:56:17.823937 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2063182525 Aug 31 16:56:17.823937 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 03d3245a207048b6b7046d1d7c8f52d6 Aug 31 16:56:17.823937 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2063182525 Aug 31 16:56:17.823937 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ServersAdminNegativeTestJSON-2063182525-project-admin Aug 31 16:56:17.823937 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:56:17.823937 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:56:17.823937 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: d6d5382bd6904e34b8a536076a0879c4 Aug 31 16:56:17.823937 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2063182525-project-admin Aug 31 16:56:17.823937 n-d-850499-9 devstack@n-api.service[122256]: Aug 31 16:56:17.823937 n-d-850499-9 devstack@n-api.service[122256]: {"resize": {"flavorRef": "47965545"}} Aug 31 16:56:17.823937 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:56:17.823937 n-d-850499-9 devstack@n-api.service[122256]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 31 16:56:17.823937 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': 'b6131f25-563b-4808-b12b-f82e291dc513', 'body': {'resize': {'flavorRef': '47965545'}}} Aug 31 16:56:17.823937 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:56:17.823937 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:56:17.823937 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3876, in _check_quota_for_upsize Aug 31 16:56:17.823937 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Aug 31 16:56:17.823937 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 16:56:17.823937 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 16:56:17.823937 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 31 16:56:17.823937 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc Aug 31 16:56:17.823937 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 31 16:56:17.823937 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 31 16:56:17.823937 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 16:56:17.823937 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 16:56:17.823937 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 31 16:56:17.823937 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 31 16:56:17.823937 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 31 16:56:17.823937 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 31 16:56:17.823937 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Aug 31 16:56:17.823937 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 31 16:56:17.823937 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Aug 31 16:56:17.823937 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:56:17.823937 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:56:17.823937 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:56:17.823937 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:56:17.823937 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 31 16:56:17.823937 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 31 16:56:17.823937 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 31 16:56:17.823937 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 16:56:17.823937 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 31 16:56:17.828738 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 31 16:56:17.828738 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 31 16:56:17.828738 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 31 16:56:17.828738 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 16:56:17.828738 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 16:56:17.828738 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 31 16:56:17.828738 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 31 16:56:17.828738 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Aug 31 16:56:17.828738 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 16:56:17.828738 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4242, in resize Aug 31 16:56:17.828738 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Aug 31 16:56:17.828738 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3894, in _check_quota_for_upsize Aug 31 16:56:17.828738 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 31 16:56:17.828738 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 31 16:56:17.828738 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:56:17.828738 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:56:17.828738 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:56:17.828738 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:56:17.828738 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:56:17.828738 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:56:17.828738 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:56:17.828738 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:56:17.828738 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:56:17.828738 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:56:17.828738 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:56:17.828738 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:56:17.828738 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 31 16:56:17.828738 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 31 16:56:17.828738 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Aug 31 16:56:17.828738 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 31 16:56:17.828738 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 31 16:56:17.828738 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:56:17.828738 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:56:17.828738 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:56:17.828738 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:56:17.828738 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:56:17.828738 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:56:17.828738 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:56:17.828738 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:56:17.828738 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 31 16:56:17.828738 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:56:17.828738 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-88ced35c-aaa6-499f-afa0-bb95c028c72f tempest-ServersAdminNegativeTestJSON-2063182525 tempest-ServersAdminNegativeTestJSON-2063182525-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:56:17.828738 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-88ced35c-aaa6-499f-afa0-bb95c028c72f tempest-ServersAdminNegativeTestJSON-2063182525 tempest-ServersAdminNegativeTestJSON-2063182525-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/b6131f25-563b-4808-b12b-f82e291dc513/action" status: 403 len: 118 microversion: 2.1 time: 0.247847 Aug 31 16:56:17.828738 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3561/7138] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:56:17 2022] POST /compute/v2.1/servers/b6131f25-563b-4808-b12b-f82e291dc513/action => generated 118 bytes in 249 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:56:17.834768 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-878625b0-1148-447d-a1d9-ea7835f7b9f0 tempest-ServersAdminNegativeTestJSON-2063182525 tempest-ServersAdminNegativeTestJSON-2063182525-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:56:17.851354 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-878625b0-1148-447d-a1d9-ea7835f7b9f0 tempest-ServersAdminNegativeTestJSON-2063182525 tempest-ServersAdminNegativeTestJSON-2063182525-project-admin] 10.222.0.61 "DELETE /compute/v2.1/flavors/47965545" status: 202 len: 0 microversion: 2.1 time: 0.020266 Aug 31 16:56:17.851953 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3578/7139] 10.222.0.61 () {58 vars in 1155 bytes} [Wed Aug 31 16:56:17 2022] DELETE /compute/v2.1/flavors/47965545 => generated 0 bytes in 21 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:56:17.860567 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-074be34b-2816-416e-ae53-3ad52c1aa656 tempest-ServersAdminNegativeTestJSON-2063182525 tempest-ServersAdminNegativeTestJSON-2063182525-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:56:17.881537 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-074be34b-2816-416e-ae53-3ad52c1aa656 tempest-ServersAdminNegativeTestJSON-2063182525 tempest-ServersAdminNegativeTestJSON-2063182525-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025323 Aug 31 16:56:17.882102 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3562/7140] 10.222.0.61 () {58 vars in 1146 bytes} [Wed Aug 31 16:56:17 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:56:17.901722 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-36c04c8a-79b1-4fa6-9c2d-c1070a6ff0db tempest-ServersAdminNegativeTestJSON-2063182525 tempest-ServersAdminNegativeTestJSON-2063182525-project-admin] Calling method '.version_select at 0x7f5ae39f1430>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:56:17.971212 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-36c04c8a-79b1-4fa6-9c2d-c1070a6ff0db tempest-ServersAdminNegativeTestJSON-2063182525 tempest-ServersAdminNegativeTestJSON-2063182525-project-admin] 10.222.0.61 "GET /compute/v2.1/os-quota-sets/03d3245a207048b6b7046d1d7c8f52d6" status: 200 len: 371 microversion: 2.1 time: 0.073166 Aug 31 16:56:17.971822 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3579/7141] 10.222.0.61 () {58 vars in 1242 bytes} [Wed Aug 31 16:56:17 2022] GET /compute/v2.1/os-quota-sets/03d3245a207048b6b7046d1d7c8f52d6 => generated 371 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:56:17.983753 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8626d2ab-2b34-46bf-8414-9a9f46678311 tempest-ServersAdminNegativeTestJSON-2063182525 tempest-ServersAdminNegativeTestJSON-2063182525-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1124464151", "id": 1128615135, "os-flavor-access:is_public": "True"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:56:18.001488 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8626d2ab-2b34-46bf-8414-9a9f46678311 tempest-ServersAdminNegativeTestJSON-2063182525 tempest-ServersAdminNegativeTestJSON-2063182525-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.022056 Aug 31 16:56:18.002076 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3563/7142] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:56:17 2022] POST /compute/v2.1/flavors => generated 437 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:56:18.014314 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-99b4b9c2-9d05-4d53-b840-922f426e7db9 tempest-ServersAdminNegativeTestJSON-2063182525 tempest-ServersAdminNegativeTestJSON-2063182525-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1128615135"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:56:18.016959 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-99b4b9c2-9d05-4d53-b840-922f426e7db9 tempest-ServersAdminNegativeTestJSON-2063182525 tempest-ServersAdminNegativeTestJSON-2063182525-project-admin] [instance: b6131f25-563b-4808-b12b-f82e291dc513] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:56:18.023059 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-99b4b9c2-9d05-4d53-b840-922f426e7db9 tempest-ServersAdminNegativeTestJSON-2063182525 tempest-ServersAdminNegativeTestJSON-2063182525-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:18.023591 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-99b4b9c2-9d05-4d53-b840-922f426e7db9 tempest-ServersAdminNegativeTestJSON-2063182525 tempest-ServersAdminNegativeTestJSON-2063182525-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:18.024049 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-99b4b9c2-9d05-4d53-b840-922f426e7db9 tempest-ServersAdminNegativeTestJSON-2063182525 tempest-ServersAdminNegativeTestJSON-2063182525-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:18.024829 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-99b4b9c2-9d05-4d53-b840-922f426e7db9 tempest-ServersAdminNegativeTestJSON-2063182525 tempest-ServersAdminNegativeTestJSON-2063182525-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:18.025298 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-99b4b9c2-9d05-4d53-b840-922f426e7db9 tempest-ServersAdminNegativeTestJSON-2063182525 tempest-ServersAdminNegativeTestJSON-2063182525-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:18.025744 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-99b4b9c2-9d05-4d53-b840-922f426e7db9 tempest-ServersAdminNegativeTestJSON-2063182525 tempest-ServersAdminNegativeTestJSON-2063182525-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:18.187667 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-99b4b9c2-9d05-4d53-b840-922f426e7db9 tempest-ServersAdminNegativeTestJSON-2063182525 tempest-ServersAdminNegativeTestJSON-2063182525-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'd6d5382bd6904e34b8a536076a0879c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03d3245a207048b6b7046d1d7c8f52d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:56:18.194206 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-99b4b9c2-9d05-4d53-b840-922f426e7db9 tempest-ServersAdminNegativeTestJSON-2063182525 tempest-ServersAdminNegativeTestJSON-2063182525-project-admin] [instance: b6131f25-563b-4808-b12b-f82e291dc513] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1124464151 {{(pid=122257) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 31 16:56:18.200822 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-99b4b9c2-9d05-4d53-b840-922f426e7db9 tempest-ServersAdminNegativeTestJSON-2063182525 tempest-ServersAdminNegativeTestJSON-2063182525-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:18.201325 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-99b4b9c2-9d05-4d53-b840-922f426e7db9 tempest-ServersAdminNegativeTestJSON-2063182525 tempest-ServersAdminNegativeTestJSON-2063182525-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:18.202065 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-99b4b9c2-9d05-4d53-b840-922f426e7db9 tempest-ServersAdminNegativeTestJSON-2063182525 tempest-ServersAdminNegativeTestJSON-2063182525-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:18.202932 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-99b4b9c2-9d05-4d53-b840-922f426e7db9 tempest-ServersAdminNegativeTestJSON-2063182525 tempest-ServersAdminNegativeTestJSON-2063182525-project-admin] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:18.203413 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-99b4b9c2-9d05-4d53-b840-922f426e7db9 tempest-ServersAdminNegativeTestJSON-2063182525 tempest-ServersAdminNegativeTestJSON-2063182525-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:18.203891 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-99b4b9c2-9d05-4d53-b840-922f426e7db9 tempest-ServersAdminNegativeTestJSON-2063182525 tempest-ServersAdminNegativeTestJSON-2063182525-project-admin] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:18.229725 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-99b4b9c2-9d05-4d53-b840-922f426e7db9 tempest-ServersAdminNegativeTestJSON-2063182525 tempest-ServersAdminNegativeTestJSON-2063182525-project-admin] Getting quotas for project 4ca037d272dd4033af2cdc4294eb8af2. Resources: {'ram', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:56:18.236206 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-99b4b9c2-9d05-4d53-b840-922f426e7db9 tempest-ServersAdminNegativeTestJSON-2063182525 tempest-ServersAdminNegativeTestJSON-2063182525-project-admin] Getting quotas for user aa5b2c80c21846b38065af07af21812d and project 4ca037d272dd4033af2cdc4294eb8af2. Resources: {'ram', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:56:18.248801 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.compute.api [None req-99b4b9c2-9d05-4d53-b840-922f426e7db9 tempest-ServersAdminNegativeTestJSON-2063182525 tempest-ServersAdminNegativeTestJSON-2063182525-project-admin] cores quota exceeded for 03d3245a207048b6b7046d1d7c8f52d6, tried to resize instance. Aug 31 16:56:18.249360 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-99b4b9c2-9d05-4d53-b840-922f426e7db9 tempest-ServersAdminNegativeTestJSON-2063182525 tempest-ServersAdminNegativeTestJSON-2063182525-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 31 16:56:18.251483 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-99b4b9c2-9d05-4d53-b840-922f426e7db9 tempest-ServersAdminNegativeTestJSON-2063182525 tempest-ServersAdminNegativeTestJSON-2063182525-project-admin] Request method failure captured: Aug 31 16:56:18.251483 n-d-850499-9 devstack@n-api.service[122257]: request: POST /compute/v2.1/servers/b6131f25-563b-4808-b12b-f82e291dc513/action HTTP/1.1 Aug 31 16:56:18.251483 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:56:18.251483 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:56:18.251483 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:56:18.251483 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 39 Aug 31 16:56:18.251483 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:56:18.251483 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:56:18.251483 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:56:18.251483 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:56:18.251483 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD5KiEqZhVAdcNhysxfKSJjBr4pqf9IN5Z55Ig1wsmzsRJEnbEtrwGOlJb7jgkLxSC8-h5uRALCs8MMcMYFmYd6-el6WR0gZzhtO6mbrI5whJS5-t9Xks3YI_csOVpq2t0OR__WjLTQgkWjW6jUYhtkkSYZVQcUxWXbArOYAUAKZS7Sw Aug 31 16:56:18.251483 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:56:18.251483 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:56:18.251483 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:56:18.251483 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:56:18.251483 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:56:18.251483 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:56:18.251483 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 03d3245a207048b6b7046d1d7c8f52d6 Aug 31 16:56:18.251483 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2063182525 Aug 31 16:56:18.251483 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,admin,member Aug 31 16:56:18.251483 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,admin,member Aug 31 16:56:18.251483 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/03d3245a207048b6b7046d1d7c8f52d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/03d3245a207048b6b7046d1d7c8f52d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_03d3245a207048b6b7046d1d7c8f52d6", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/03d3245a207048b6b7046d1d7c8f52d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:56:18.251483 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2063182525 Aug 31 16:56:18.251483 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 03d3245a207048b6b7046d1d7c8f52d6 Aug 31 16:56:18.251483 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2063182525 Aug 31 16:56:18.251483 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ServersAdminNegativeTestJSON-2063182525-project-admin Aug 31 16:56:18.251483 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:56:18.251483 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:56:18.251483 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: d6d5382bd6904e34b8a536076a0879c4 Aug 31 16:56:18.251483 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2063182525-project-admin Aug 31 16:56:18.251483 n-d-850499-9 devstack@n-api.service[122257]: Aug 31 16:56:18.251483 n-d-850499-9 devstack@n-api.service[122257]: {"resize": {"flavorRef": "1128615135"}} Aug 31 16:56:18.251483 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:56:18.251483 n-d-850499-9 devstack@n-api.service[122257]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 31 16:56:18.251483 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': 'b6131f25-563b-4808-b12b-f82e291dc513', 'body': {'resize': {'flavorRef': '1128615135'}}} Aug 31 16:56:18.251483 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:56:18.251483 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:56:18.251483 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3876, in _check_quota_for_upsize Aug 31 16:56:18.251483 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Aug 31 16:56:18.251483 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 16:56:18.251483 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 16:56:18.251483 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 31 16:56:18.251483 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc Aug 31 16:56:18.251483 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 31 16:56:18.251483 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 31 16:56:18.251483 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 16:56:18.251483 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 16:56:18.251483 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 31 16:56:18.251483 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 31 16:56:18.251483 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 31 16:56:18.251483 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 31 16:56:18.251483 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Aug 31 16:56:18.251483 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 31 16:56:18.251483 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Aug 31 16:56:18.251483 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:56:18.251483 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:56:18.251483 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:56:18.251483 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:56:18.251483 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 31 16:56:18.251483 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 31 16:56:18.251483 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 31 16:56:18.251483 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 16:56:18.251483 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 31 16:56:18.255627 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 31 16:56:18.255627 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 31 16:56:18.255627 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 31 16:56:18.255627 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 16:56:18.255627 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 16:56:18.255627 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 31 16:56:18.255627 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 31 16:56:18.255627 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Aug 31 16:56:18.255627 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 16:56:18.255627 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4242, in resize Aug 31 16:56:18.255627 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Aug 31 16:56:18.255627 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3894, in _check_quota_for_upsize Aug 31 16:56:18.255627 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 31 16:56:18.255627 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 31 16:56:18.255627 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:56:18.255627 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:56:18.255627 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:56:18.255627 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:56:18.255627 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:56:18.255627 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:56:18.255627 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:56:18.255627 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:56:18.255627 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:56:18.255627 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:56:18.255627 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:56:18.255627 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:56:18.255627 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 31 16:56:18.255627 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 31 16:56:18.255627 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Aug 31 16:56:18.255627 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 31 16:56:18.255627 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 31 16:56:18.255627 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:56:18.255627 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:56:18.255627 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:56:18.255627 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:56:18.255627 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:56:18.255627 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:56:18.255627 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:56:18.255627 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:56:18.255627 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 31 16:56:18.255627 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:56:18.255627 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-99b4b9c2-9d05-4d53-b840-922f426e7db9 tempest-ServersAdminNegativeTestJSON-2063182525 tempest-ServersAdminNegativeTestJSON-2063182525-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:56:18.255627 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-99b4b9c2-9d05-4d53-b840-922f426e7db9 tempest-ServersAdminNegativeTestJSON-2063182525 tempest-ServersAdminNegativeTestJSON-2063182525-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/b6131f25-563b-4808-b12b-f82e291dc513/action" status: 403 len: 113 microversion: 2.1 time: 0.242776 Aug 31 16:56:18.255627 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3580/7143] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:56:18 2022] POST /compute/v2.1/servers/b6131f25-563b-4808-b12b-f82e291dc513/action => generated 113 bytes in 244 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:56:18.261759 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-dd5e6715-1390-4a64-b8e2-d59fbc478b39 tempest-ServersAdminNegativeTestJSON-2063182525 tempest-ServersAdminNegativeTestJSON-2063182525-project-admin] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:56:18.279345 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-dd5e6715-1390-4a64-b8e2-d59fbc478b39 tempest-ServersAdminNegativeTestJSON-2063182525 tempest-ServersAdminNegativeTestJSON-2063182525-project-admin] 10.222.0.61 "DELETE /compute/v2.1/flavors/1128615135" status: 202 len: 0 microversion: 2.1 time: 0.021279 Aug 31 16:56:18.280711 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3564/7144] 10.222.0.61 () {58 vars in 1161 bytes} [Wed Aug 31 16:56:18 2022] DELETE /compute/v2.1/flavors/1128615135 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:56:18.288929 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c45a9ad6-fa67-4594-a04d-c9b535ef0512 tempest-ServersAdminNegativeTestJSON-2063182525 tempest-ServersAdminNegativeTestJSON-2063182525-project-admin] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:56:18.309946 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c45a9ad6-fa67-4594-a04d-c9b535ef0512 tempest-ServersAdminNegativeTestJSON-2063182525 tempest-ServersAdminNegativeTestJSON-2063182525-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024771 Aug 31 16:56:18.310516 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3581/7145] 10.222.0.61 () {58 vars in 1146 bytes} [Wed Aug 31 16:56:18 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:56:18.330407 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-fa7a18ff-3a40-4b25-bf82-61d81c7bdbaf tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:56:18.330976 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-fa7a18ff-3a40-4b25-bf82-61d81c7bdbaf tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] [instance: b6131f25-563b-4808-b12b-f82e291dc513] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:56:18.337192 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fa7a18ff-3a40-4b25-bf82-61d81c7bdbaf tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:18.337688 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fa7a18ff-3a40-4b25-bf82-61d81c7bdbaf tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:18.338139 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fa7a18ff-3a40-4b25-bf82-61d81c7bdbaf tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:18.338842 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fa7a18ff-3a40-4b25-bf82-61d81c7bdbaf tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:18.339309 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fa7a18ff-3a40-4b25-bf82-61d81c7bdbaf tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:18.339772 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fa7a18ff-3a40-4b25-bf82-61d81c7bdbaf tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:18.365927 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-fa7a18ff-3a40-4b25-bf82-61d81c7bdbaf tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] [instance: b6131f25-563b-4808-b12b-f82e291dc513] Going to try to terminate instance {{(pid=122256) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:56:18.449003 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-fa7a18ff-3a40-4b25-bf82-61d81c7bdbaf tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] 10.222.0.61 "DELETE /compute/v2.1/servers/b6131f25-563b-4808-b12b-f82e291dc513" status: 204 len: 0 microversion: 2.1 time: 0.122850 Aug 31 16:56:18.450050 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3565/7146] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:56:18 2022] DELETE /compute/v2.1/servers/b6131f25-563b-4808-b12b-f82e291dc513 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:56:18.458626 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7aa6a826-fc37-47b7-8b1b-bb85b06b6325 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:56:18.459435 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7aa6a826-fc37-47b7-8b1b-bb85b06b6325 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] [instance: b6131f25-563b-4808-b12b-f82e291dc513] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:56:18.465781 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7aa6a826-fc37-47b7-8b1b-bb85b06b6325 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:18.466290 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7aa6a826-fc37-47b7-8b1b-bb85b06b6325 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:18.466748 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7aa6a826-fc37-47b7-8b1b-bb85b06b6325 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:18.468150 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7aa6a826-fc37-47b7-8b1b-bb85b06b6325 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:18.468735 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7aa6a826-fc37-47b7-8b1b-bb85b06b6325 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:18.469080 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7aa6a826-fc37-47b7-8b1b-bb85b06b6325 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:18.599816 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7aa6a826-fc37-47b7-8b1b-bb85b06b6325 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5b2c80c21846b38065af07af21812d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca037d272dd4033af2cdc4294eb8af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:56:18.607657 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7aa6a826-fc37-47b7-8b1b-bb85b06b6325 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] 10.222.0.61 "GET /compute/v2.1/servers/b6131f25-563b-4808-b12b-f82e291dc513" status: 200 len: 1477 microversion: 2.1 time: 0.152923 Aug 31 16:56:18.608604 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3582/7147] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:56:18 2022] GET /compute/v2.1/servers/b6131f25-563b-4808-b12b-f82e291dc513 => generated 1477 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:56:19.629906 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-81435e08-50e7-4a36-ad4c-033edeb5ad68 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:56:19.630606 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-81435e08-50e7-4a36-ad4c-033edeb5ad68 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] [instance: b6131f25-563b-4808-b12b-f82e291dc513] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:56:19.639058 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-81435e08-50e7-4a36-ad4c-033edeb5ad68 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:19.639576 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-81435e08-50e7-4a36-ad4c-033edeb5ad68 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:19.640023 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-81435e08-50e7-4a36-ad4c-033edeb5ad68 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:19.640756 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-81435e08-50e7-4a36-ad4c-033edeb5ad68 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:19.641221 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-81435e08-50e7-4a36-ad4c-033edeb5ad68 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:19.641650 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-81435e08-50e7-4a36-ad4c-033edeb5ad68 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:19.773166 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-81435e08-50e7-4a36-ad4c-033edeb5ad68 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5b2c80c21846b38065af07af21812d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca037d272dd4033af2cdc4294eb8af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:56:19.781468 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-81435e08-50e7-4a36-ad4c-033edeb5ad68 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] 10.222.0.61 "GET /compute/v2.1/servers/b6131f25-563b-4808-b12b-f82e291dc513" status: 200 len: 1477 microversion: 2.1 time: 0.155864 Aug 31 16:56:19.782035 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3566/7148] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:56:19 2022] GET /compute/v2.1/servers/b6131f25-563b-4808-b12b-f82e291dc513 => generated 1477 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:56:20.747783 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-23411898-601c-4fa0-98d0-46c1278fff5f req-54ff79f1-663b-4318-b590-349ca7a60d09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6131f25-563b-4808-b12b-f82e291dc513", "name": "network-vif-deleted", "tag": "18d9a1f5-ca2f-44d9-b0d3-ffa8eddb5f33"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:56:20.762318 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-23411898-601c-4fa0-98d0-46c1278fff5f req-54ff79f1-663b-4318-b590-349ca7a60d09 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:20.763199 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-23411898-601c-4fa0-98d0-46c1278fff5f req-54ff79f1-663b-4318-b590-349ca7a60d09 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:20.764085 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-23411898-601c-4fa0-98d0-46c1278fff5f req-54ff79f1-663b-4318-b590-349ca7a60d09 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:20.778442 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-23411898-601c-4fa0-98d0-46c1278fff5f req-54ff79f1-663b-4318-b590-349ca7a60d09 service nova] Creating event network-vif-deleted:18d9a1f5-ca2f-44d9-b0d3-ffa8eddb5f33 for instance b6131f25-563b-4808-b12b-f82e291dc513 on n-h2-850499-9 Aug 31 16:56:20.785331 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-23411898-601c-4fa0-98d0-46c1278fff5f req-54ff79f1-663b-4318-b590-349ca7a60d09 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040813 Aug 31 16:56:20.786801 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3583/7149] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:56:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:56:20.806711 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1ab9a81b-487e-4eda-af44-ddfc9ff9de4c tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:56:20.807440 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1ab9a81b-487e-4eda-af44-ddfc9ff9de4c tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] [instance: b6131f25-563b-4808-b12b-f82e291dc513] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:56:20.816212 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1ab9a81b-487e-4eda-af44-ddfc9ff9de4c tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:20.816726 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1ab9a81b-487e-4eda-af44-ddfc9ff9de4c tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:20.817171 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1ab9a81b-487e-4eda-af44-ddfc9ff9de4c tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:20.817914 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1ab9a81b-487e-4eda-af44-ddfc9ff9de4c tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:20.818377 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1ab9a81b-487e-4eda-af44-ddfc9ff9de4c tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:20.818810 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1ab9a81b-487e-4eda-af44-ddfc9ff9de4c tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:20.900951 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1ab9a81b-487e-4eda-af44-ddfc9ff9de4c tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5b2c80c21846b38065af07af21812d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca037d272dd4033af2cdc4294eb8af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:56:20.910944 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1ab9a81b-487e-4eda-af44-ddfc9ff9de4c tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] 10.222.0.61 "GET /compute/v2.1/servers/b6131f25-563b-4808-b12b-f82e291dc513" status: 200 len: 1307 microversion: 2.1 time: 0.108663 Aug 31 16:56:20.911387 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3567/7150] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:56:20 2022] GET /compute/v2.1/servers/b6131f25-563b-4808-b12b-f82e291dc513 => generated 1307 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:56:21.932649 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-15433927-607d-47eb-b691-974917efb221 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:56:21.933303 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-15433927-607d-47eb-b691-974917efb221 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] [instance: b6131f25-563b-4808-b12b-f82e291dc513] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:56:21.940571 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-15433927-607d-47eb-b691-974917efb221 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:21.941077 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-15433927-607d-47eb-b691-974917efb221 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:21.941544 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-15433927-607d-47eb-b691-974917efb221 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:21.942287 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-15433927-607d-47eb-b691-974917efb221 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:21.942760 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-15433927-607d-47eb-b691-974917efb221 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:21.943205 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-15433927-607d-47eb-b691-974917efb221 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:21.956792 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-15433927-607d-47eb-b691-974917efb221 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] HTTP exception thrown: Instance b6131f25-563b-4808-b12b-f82e291dc513 could not be found. Aug 31 16:56:21.958686 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-15433927-607d-47eb-b691-974917efb221 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Request method failure captured: Aug 31 16:56:21.958686 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/b6131f25-563b-4808-b12b-f82e291dc513 HTTP/1.1 Aug 31 16:56:21.958686 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:56:21.958686 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:56:21.958686 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:56:21.958686 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:56:21.958686 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:56:21.958686 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:56:21.958686 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:56:21.958686 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:56:21.958686 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD5KhRocvEyGuXqy1h71YiSVAeRicErulletpMACpucQx0qESKy-CJVby70YQIXedskCEfyHcV6z-xRsr8pTdDicoJK-4fltRmJz7Ix1mDasnVKxXVOte9p-MMOWrhzrr5A6Y8Bl7_JRfyolAAQj2n27s89W5mvVC_V0IztcQXLEfGuA Aug 31 16:56:21.958686 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:56:21.958686 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:56:21.958686 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:56:21.958686 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:56:21.958686 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:56:21.958686 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:56:21.958686 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 4ca037d272dd4033af2cdc4294eb8af2 Aug 31 16:56:21.958686 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-697597277 Aug 31 16:56:21.958686 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:56:21.958686 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:56:21.958686 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4ca037d272dd4033af2cdc4294eb8af2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/4ca037d272dd4033af2cdc4294eb8af2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_4ca037d272dd4033af2cdc4294eb8af2", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4ca037d272dd4033af2cdc4294eb8af2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:56:21.958686 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ServersAdminNegativeTestJSON-697597277 Aug 31 16:56:21.958686 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 4ca037d272dd4033af2cdc4294eb8af2 Aug 31 16:56:21.958686 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-697597277 Aug 31 16:56:21.958686 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ServersAdminNegativeTestJSON-697597277-project Aug 31 16:56:21.958686 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:56:21.958686 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:56:21.958686 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: aa5b2c80c21846b38065af07af21812d Aug 31 16:56:21.958686 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ServersAdminNegativeTestJSON-697597277-project Aug 31 16:56:21.958686 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:56:21.958686 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance b6131f25-563b-4808-b12b-f82e291dc513 could not be found. Aug 31 16:56:21.958686 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': 'b6131f25-563b-4808-b12b-f82e291dc513'} Aug 31 16:56:21.958686 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:56:21.958686 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:56:21.958686 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:56:21.958686 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:56:21.958686 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:56:21.958686 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:56:21.958686 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:56:21.958686 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:56:21.958686 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:56:21.958686 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:56:21.958686 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6131f25-563b-4808-b12b-f82e291dc513 could not be found. Aug 31 16:56:21.958686 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:56:21.958686 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:56:21.958686 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:56:21.958686 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:56:21.958686 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:56:21.958686 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:56:21.958686 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:56:21.958686 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:56:21.958686 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:56:21.958686 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:56:21.958686 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:56:21.958686 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:56:21.958686 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:56:21.958686 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:56:21.958686 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:56:21.958686 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:56:21.958686 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6131f25-563b-4808-b12b-f82e291dc513 could not be found. Aug 31 16:56:21.958686 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:56:21.958686 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:56:21.962539 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:56:21.962539 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:56:21.962539 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:56:21.962539 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:56:21.962539 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:56:21.962539 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:56:21.962539 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6131f25-563b-4808-b12b-f82e291dc513 could not be found. Aug 31 16:56:21.962539 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:56:21.962539 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-15433927-607d-47eb-b691-974917efb221 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] Returning 404 to user: Instance b6131f25-563b-4808-b12b-f82e291dc513 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:56:21.962539 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-15433927-607d-47eb-b691-974917efb221 tempest-ServersAdminNegativeTestJSON-697597277 tempest-ServersAdminNegativeTestJSON-697597277-project] 10.222.0.61 "GET /compute/v2.1/servers/b6131f25-563b-4808-b12b-f82e291dc513" status: 404 len: 111 microversion: 2.1 time: 0.031861 Aug 31 16:56:21.962539 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3584/7151] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:56:21 2022] GET /compute/v2.1/servers/b6131f25-563b-4808-b12b-f82e291dc513 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:56:28.207731 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:56:28.208634 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=3 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:56:28.352626 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c93a9232-2680-4829-aa34-4ac9dbddee30 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1550814689", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "networks": [{"uuid": "eb1fca42-2699-481d-a1f6-becb7bd9f9af"}]}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:56:28.424376 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-c93a9232-2680-4829-aa34-4ac9dbddee30 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] validate_networks() for [('eb1fca42-2699-481d-a1f6-becb7bd9f9af', None, None, None, None, None)] {{(pid=122256) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:56:28.886781 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-c93a9232-2680-4829-aa34-4ac9dbddee30 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:56:28.887266 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-c93a9232-2680-4829-aa34-4ac9dbddee30 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:56:28.887820 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-c93a9232-2680-4829-aa34-4ac9dbddee30 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:56:28.888262 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-c93a9232-2680-4829-aa34-4ac9dbddee30 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:56:28.888686 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-c93a9232-2680-4829-aa34-4ac9dbddee30 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:56:28.899597 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c93a9232-2680-4829-aa34-4ac9dbddee30 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:28.900100 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c93a9232-2680-4829-aa34-4ac9dbddee30 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:28.900551 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c93a9232-2680-4829-aa34-4ac9dbddee30 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:28.901292 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c93a9232-2680-4829-aa34-4ac9dbddee30 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:28.901758 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c93a9232-2680-4829-aa34-4ac9dbddee30 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:28.902191 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c93a9232-2680-4829-aa34-4ac9dbddee30 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:28.921858 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-c93a9232-2680-4829-aa34-4ac9dbddee30 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Getting quotas for project c294727d94f44b69a0bfe87e3c323e95. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:56:28.927754 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-c93a9232-2680-4829-aa34-4ac9dbddee30 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Getting quotas for user ab432e6211d8480885d6f1acedd80efd and project c294727d94f44b69a0bfe87e3c323e95. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:56:28.941723 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c93a9232-2680-4829-aa34-4ac9dbddee30 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Going to run 1 instances... {{(pid=122256) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:56:28.944069 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c93a9232-2680-4829-aa34-4ac9dbddee30 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] [instance: 21f746ec-50b3-4294-a7d8-e68e4c32f993] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:56:28.994434 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c93a9232-2680-4829-aa34-4ac9dbddee30 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.792939 Aug 31 16:56:28.995441 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3568/7152] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:56:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 795 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:56:29.006719 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ee3a1c75-7738-43cd-9f8b-97d7b1d954ec tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:56:29.007756 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ee3a1c75-7738-43cd-9f8b-97d7b1d954ec tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] [instance: 21f746ec-50b3-4294-a7d8-e68e4c32f993] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:56:29.012331 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:56:29.013205 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=3 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:56:29.075979 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ee3a1c75-7738-43cd-9f8b-97d7b1d954ec tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab432e6211d8480885d6f1acedd80efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c294727d94f44b69a0bfe87e3c323e95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:56:29.085690 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ee3a1c75-7738-43cd-9f8b-97d7b1d954ec tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] 10.222.0.61 "GET /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993" status: 200 len: 1215 microversion: 2.1 time: 0.082882 Aug 31 16:56:29.086288 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3585/7153] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:56:29 2022] GET /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993 => generated 1215 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:56:30.115186 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-23d3c3ed-1814-44c5-b25a-064ddde6fde3 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:56:30.117079 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-23d3c3ed-1814-44c5-b25a-064ddde6fde3 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] [instance: 21f746ec-50b3-4294-a7d8-e68e4c32f993] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:56:30.130018 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-23d3c3ed-1814-44c5-b25a-064ddde6fde3 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:30.130519 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-23d3c3ed-1814-44c5-b25a-064ddde6fde3 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:30.131014 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-23d3c3ed-1814-44c5-b25a-064ddde6fde3 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:30.131829 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-23d3c3ed-1814-44c5-b25a-064ddde6fde3 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:30.132215 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-23d3c3ed-1814-44c5-b25a-064ddde6fde3 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:30.132739 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-23d3c3ed-1814-44c5-b25a-064ddde6fde3 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:30.219576 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-23d3c3ed-1814-44c5-b25a-064ddde6fde3 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab432e6211d8480885d6f1acedd80efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c294727d94f44b69a0bfe87e3c323e95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:56:30.229136 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-23d3c3ed-1814-44c5-b25a-064ddde6fde3 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] 10.222.0.61 "GET /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993" status: 200 len: 1267 microversion: 2.1 time: 0.124349 Aug 31 16:56:30.229751 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3569/7154] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:56:30 2022] GET /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993 => generated 1267 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:56:31.253819 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4cfcc537-f863-4995-a1d0-a6493c3d0cd1 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:56:31.255194 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4cfcc537-f863-4995-a1d0-a6493c3d0cd1 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] [instance: 21f746ec-50b3-4294-a7d8-e68e4c32f993] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:56:31.264203 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4cfcc537-f863-4995-a1d0-a6493c3d0cd1 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:31.265245 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4cfcc537-f863-4995-a1d0-a6493c3d0cd1 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:31.266568 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4cfcc537-f863-4995-a1d0-a6493c3d0cd1 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:31.267528 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4cfcc537-f863-4995-a1d0-a6493c3d0cd1 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:31.268493 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4cfcc537-f863-4995-a1d0-a6493c3d0cd1 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:31.269095 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4cfcc537-f863-4995-a1d0-a6493c3d0cd1 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:31.420283 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-4cfcc537-f863-4995-a1d0-a6493c3d0cd1 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab432e6211d8480885d6f1acedd80efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c294727d94f44b69a0bfe87e3c323e95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:56:31.428663 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4cfcc537-f863-4995-a1d0-a6493c3d0cd1 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] 10.222.0.61 "GET /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993" status: 200 len: 1315 microversion: 2.1 time: 0.178714 Aug 31 16:56:31.429255 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3586/7155] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:56:31 2022] GET /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993 => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:56:31.934535 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-76d98fbd-cc10-490b-9da0-08cf24626348 req-b9eb6bf4-160c-42ad-93dd-e933de082da9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21f746ec-50b3-4294-a7d8-e68e4c32f993", "tag": "ab187d23-9004-497b-afc0-776751e5e19b"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:56:31.947885 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-76d98fbd-cc10-490b-9da0-08cf24626348 req-b9eb6bf4-160c-42ad-93dd-e933de082da9 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:31.948359 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-76d98fbd-cc10-490b-9da0-08cf24626348 req-b9eb6bf4-160c-42ad-93dd-e933de082da9 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:31.948785 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-76d98fbd-cc10-490b-9da0-08cf24626348 req-b9eb6bf4-160c-42ad-93dd-e933de082da9 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:31.960663 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-76d98fbd-cc10-490b-9da0-08cf24626348 req-b9eb6bf4-160c-42ad-93dd-e933de082da9 service nova] Creating event network-changed:ab187d23-9004-497b-afc0-776751e5e19b for instance 21f746ec-50b3-4294-a7d8-e68e4c32f993 on n-h2-850499-9 Aug 31 16:56:31.966366 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-76d98fbd-cc10-490b-9da0-08cf24626348 req-b9eb6bf4-160c-42ad-93dd-e933de082da9 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036083 Aug 31 16:56:31.968315 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3570/7156] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:56:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:56:32.450587 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8090f76a-ab3a-4b49-a9bf-671bbe175ff2 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:56:32.452313 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8090f76a-ab3a-4b49-a9bf-671bbe175ff2 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] [instance: 21f746ec-50b3-4294-a7d8-e68e4c32f993] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:56:32.466558 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8090f76a-ab3a-4b49-a9bf-671bbe175ff2 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:32.467155 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8090f76a-ab3a-4b49-a9bf-671bbe175ff2 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:32.467826 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8090f76a-ab3a-4b49-a9bf-671bbe175ff2 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:32.468754 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8090f76a-ab3a-4b49-a9bf-671bbe175ff2 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:32.469237 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8090f76a-ab3a-4b49-a9bf-671bbe175ff2 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:32.469690 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8090f76a-ab3a-4b49-a9bf-671bbe175ff2 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:32.640193 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8090f76a-ab3a-4b49-a9bf-671bbe175ff2 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab432e6211d8480885d6f1acedd80efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c294727d94f44b69a0bfe87e3c323e95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:56:32.648850 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8090f76a-ab3a-4b49-a9bf-671bbe175ff2 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] 10.222.0.61 "GET /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993" status: 200 len: 1315 microversion: 2.1 time: 0.202372 Aug 31 16:56:32.649454 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3587/7157] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:56:32 2022] GET /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993 => generated 1315 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:56:33.672565 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8569b4fc-cbf6-4861-834a-b55435dd69c8 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:56:33.673293 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8569b4fc-cbf6-4861-834a-b55435dd69c8 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] [instance: 21f746ec-50b3-4294-a7d8-e68e4c32f993] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:56:33.679667 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8569b4fc-cbf6-4861-834a-b55435dd69c8 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:33.680161 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8569b4fc-cbf6-4861-834a-b55435dd69c8 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:33.680606 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8569b4fc-cbf6-4861-834a-b55435dd69c8 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:33.681310 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8569b4fc-cbf6-4861-834a-b55435dd69c8 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:33.681774 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8569b4fc-cbf6-4861-834a-b55435dd69c8 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:33.682206 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8569b4fc-cbf6-4861-834a-b55435dd69c8 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:33.813910 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8569b4fc-cbf6-4861-834a-b55435dd69c8 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab432e6211d8480885d6f1acedd80efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c294727d94f44b69a0bfe87e3c323e95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:56:33.821911 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8569b4fc-cbf6-4861-834a-b55435dd69c8 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] 10.222.0.61 "GET /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993" status: 200 len: 1315 microversion: 2.1 time: 0.155252 Aug 31 16:56:33.822478 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3571/7158] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:56:33 2022] GET /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:56:34.843536 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c8076f79-87cc-4a97-9abd-dce258f563a7 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:56:34.844173 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c8076f79-87cc-4a97-9abd-dce258f563a7 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] [instance: 21f746ec-50b3-4294-a7d8-e68e4c32f993] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:56:34.846844 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:56:34.852929 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c8076f79-87cc-4a97-9abd-dce258f563a7 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:34.853436 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c8076f79-87cc-4a97-9abd-dce258f563a7 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:34.853893 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c8076f79-87cc-4a97-9abd-dce258f563a7 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:34.854610 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c8076f79-87cc-4a97-9abd-dce258f563a7 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:34.855116 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c8076f79-87cc-4a97-9abd-dce258f563a7 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:34.855592 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c8076f79-87cc-4a97-9abd-dce258f563a7 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:34.859534 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=72 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:56:35.002056 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c8076f79-87cc-4a97-9abd-dce258f563a7 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab432e6211d8480885d6f1acedd80efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c294727d94f44b69a0bfe87e3c323e95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:56:35.009851 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c8076f79-87cc-4a97-9abd-dce258f563a7 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] 10.222.0.61 "GET /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993" status: 200 len: 1315 microversion: 2.1 time: 0.170494 Aug 31 16:56:35.010433 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3588/7159] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:56:34 2022] GET /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:56:36.032041 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-22b252b4-1236-4eea-8a76-f949719076c5 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:56:36.032657 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-22b252b4-1236-4eea-8a76-f949719076c5 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] [instance: 21f746ec-50b3-4294-a7d8-e68e4c32f993] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:56:36.035414 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:56:36.040924 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-22b252b4-1236-4eea-8a76-f949719076c5 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:36.041417 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-22b252b4-1236-4eea-8a76-f949719076c5 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:36.041855 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-22b252b4-1236-4eea-8a76-f949719076c5 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:36.042559 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-22b252b4-1236-4eea-8a76-f949719076c5 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:36.043018 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-22b252b4-1236-4eea-8a76-f949719076c5 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:36.043444 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-22b252b4-1236-4eea-8a76-f949719076c5 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:36.047077 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:56:36.186710 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-22b252b4-1236-4eea-8a76-f949719076c5 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab432e6211d8480885d6f1acedd80efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c294727d94f44b69a0bfe87e3c323e95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:56:36.194206 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-22b252b4-1236-4eea-8a76-f949719076c5 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] 10.222.0.61 "GET /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993" status: 200 len: 1315 microversion: 2.1 time: 0.166371 Aug 31 16:56:36.194798 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3572/7160] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:56:36 2022] GET /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:56:37.215906 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8435b5c2-2a24-42e7-91a7-672673aeaf55 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:56:37.216548 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8435b5c2-2a24-42e7-91a7-672673aeaf55 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] [instance: 21f746ec-50b3-4294-a7d8-e68e4c32f993] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:56:37.224631 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8435b5c2-2a24-42e7-91a7-672673aeaf55 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:37.225138 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8435b5c2-2a24-42e7-91a7-672673aeaf55 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:37.225616 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8435b5c2-2a24-42e7-91a7-672673aeaf55 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:37.226345 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8435b5c2-2a24-42e7-91a7-672673aeaf55 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:37.226819 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8435b5c2-2a24-42e7-91a7-672673aeaf55 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:37.227265 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8435b5c2-2a24-42e7-91a7-672673aeaf55 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:37.361082 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8435b5c2-2a24-42e7-91a7-672673aeaf55 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab432e6211d8480885d6f1acedd80efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c294727d94f44b69a0bfe87e3c323e95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:56:37.369011 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8435b5c2-2a24-42e7-91a7-672673aeaf55 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] 10.222.0.61 "GET /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993" status: 200 len: 1315 microversion: 2.1 time: 0.157102 Aug 31 16:56:37.369616 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3589/7161] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:56:37 2022] GET /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:56:38.390388 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f80aa56f-92f0-43a4-9495-009c4c297f4d tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:56:38.390987 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f80aa56f-92f0-43a4-9495-009c4c297f4d tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] [instance: 21f746ec-50b3-4294-a7d8-e68e4c32f993] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:56:38.397973 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f80aa56f-92f0-43a4-9495-009c4c297f4d tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:38.398462 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f80aa56f-92f0-43a4-9495-009c4c297f4d tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:38.398898 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f80aa56f-92f0-43a4-9495-009c4c297f4d tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:38.399815 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f80aa56f-92f0-43a4-9495-009c4c297f4d tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:38.400275 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f80aa56f-92f0-43a4-9495-009c4c297f4d tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:38.400633 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f80aa56f-92f0-43a4-9495-009c4c297f4d tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:38.866935 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f80aa56f-92f0-43a4-9495-009c4c297f4d tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab432e6211d8480885d6f1acedd80efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c294727d94f44b69a0bfe87e3c323e95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:56:38.875274 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f80aa56f-92f0-43a4-9495-009c4c297f4d tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] 10.222.0.61 "GET /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993" status: 200 len: 1315 microversion: 2.1 time: 0.489089 Aug 31 16:56:38.875871 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3573/7162] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:56:38 2022] GET /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993 => generated 1315 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:56:39.514198 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-0f5e5410-33c5-4c7e-bf88-e9197aa0bc53 req-5cecbdcd-173c-42c7-bd80-76063546adf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21f746ec-50b3-4294-a7d8-e68e4c32f993", "name": "network-vif-plugged", "status": "completed", "tag": "ab187d23-9004-497b-afc0-776751e5e19b"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:56:39.520027 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:56:39.526108 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-0f5e5410-33c5-4c7e-bf88-e9197aa0bc53 req-5cecbdcd-173c-42c7-bd80-76063546adf8 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:39.526612 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-0f5e5410-33c5-4c7e-bf88-e9197aa0bc53 req-5cecbdcd-173c-42c7-bd80-76063546adf8 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:39.527058 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-0f5e5410-33c5-4c7e-bf88-e9197aa0bc53 req-5cecbdcd-173c-42c7-bd80-76063546adf8 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:39.540341 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-0f5e5410-33c5-4c7e-bf88-e9197aa0bc53 req-5cecbdcd-173c-42c7-bd80-76063546adf8 service nova] Creating event network-vif-plugged:ab187d23-9004-497b-afc0-776751e5e19b for instance 21f746ec-50b3-4294-a7d8-e68e4c32f993 on n-h2-850499-9 Aug 31 16:56:39.546026 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-0f5e5410-33c5-4c7e-bf88-e9197aa0bc53 req-5cecbdcd-173c-42c7-bd80-76063546adf8 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036007 Aug 31 16:56:39.546957 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3590/7163] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:56:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:56:39.896424 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b540eca1-be3c-4d94-ba92-17ea91d80dc9 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:56:39.897077 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b540eca1-be3c-4d94-ba92-17ea91d80dc9 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] [instance: 21f746ec-50b3-4294-a7d8-e68e4c32f993] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:56:39.899956 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:56:39.900617 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=6 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:56:39.906304 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b540eca1-be3c-4d94-ba92-17ea91d80dc9 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:39.906791 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b540eca1-be3c-4d94-ba92-17ea91d80dc9 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:39.907227 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b540eca1-be3c-4d94-ba92-17ea91d80dc9 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:39.907945 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b540eca1-be3c-4d94-ba92-17ea91d80dc9 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:39.908402 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b540eca1-be3c-4d94-ba92-17ea91d80dc9 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:39.908828 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b540eca1-be3c-4d94-ba92-17ea91d80dc9 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:40.046584 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b540eca1-be3c-4d94-ba92-17ea91d80dc9 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab432e6211d8480885d6f1acedd80efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c294727d94f44b69a0bfe87e3c323e95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:56:40.054424 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b540eca1-be3c-4d94-ba92-17ea91d80dc9 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] 10.222.0.61 "GET /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993" status: 200 len: 1315 microversion: 2.1 time: 0.162209 Aug 31 16:56:40.055012 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3574/7164] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:56:39 2022] GET /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:56:41.077860 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8c007017-88b5-400a-9206-b6f47a8c1db4 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:56:41.078580 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8c007017-88b5-400a-9206-b6f47a8c1db4 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] [instance: 21f746ec-50b3-4294-a7d8-e68e4c32f993] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:56:41.084802 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8c007017-88b5-400a-9206-b6f47a8c1db4 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:41.085316 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8c007017-88b5-400a-9206-b6f47a8c1db4 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:41.085773 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8c007017-88b5-400a-9206-b6f47a8c1db4 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:41.086526 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8c007017-88b5-400a-9206-b6f47a8c1db4 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:41.087008 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8c007017-88b5-400a-9206-b6f47a8c1db4 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:41.087478 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8c007017-88b5-400a-9206-b6f47a8c1db4 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:41.227176 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8c007017-88b5-400a-9206-b6f47a8c1db4 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab432e6211d8480885d6f1acedd80efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c294727d94f44b69a0bfe87e3c323e95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:56:41.235712 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8c007017-88b5-400a-9206-b6f47a8c1db4 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] 10.222.0.61 "GET /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993" status: 200 len: 1315 microversion: 2.1 time: 0.163803 Aug 31 16:56:41.236293 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3591/7165] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:56:41 2022] GET /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:56:42.257025 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-daa7a22d-706b-4d48-b63d-39c1af365a2d tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:56:42.257582 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-daa7a22d-706b-4d48-b63d-39c1af365a2d tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] [instance: 21f746ec-50b3-4294-a7d8-e68e4c32f993] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:56:42.265187 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-daa7a22d-706b-4d48-b63d-39c1af365a2d tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:42.265674 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-daa7a22d-706b-4d48-b63d-39c1af365a2d tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:42.266114 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-daa7a22d-706b-4d48-b63d-39c1af365a2d tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:42.266837 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-daa7a22d-706b-4d48-b63d-39c1af365a2d tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:42.267293 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-daa7a22d-706b-4d48-b63d-39c1af365a2d tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:42.267759 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-daa7a22d-706b-4d48-b63d-39c1af365a2d tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:42.403528 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-daa7a22d-706b-4d48-b63d-39c1af365a2d tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab432e6211d8480885d6f1acedd80efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c294727d94f44b69a0bfe87e3c323e95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:56:42.411692 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-daa7a22d-706b-4d48-b63d-39c1af365a2d tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] 10.222.0.61 "GET /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993" status: 200 len: 1503 microversion: 2.1 time: 0.158799 Aug 31 16:56:42.412272 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3575/7166] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:56:42 2022] GET /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993 => generated 1503 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:56:42.432520 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0873edf8-db0f-443d-99d6-2a5d6271039e tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:56:42.434774 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0873edf8-db0f-443d-99d6-2a5d6271039e tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] [instance: 21f746ec-50b3-4294-a7d8-e68e4c32f993] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:56:42.442255 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0873edf8-db0f-443d-99d6-2a5d6271039e tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:42.442759 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0873edf8-db0f-443d-99d6-2a5d6271039e tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:42.443214 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0873edf8-db0f-443d-99d6-2a5d6271039e tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:42.443950 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0873edf8-db0f-443d-99d6-2a5d6271039e tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:42.444426 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0873edf8-db0f-443d-99d6-2a5d6271039e tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:42.444871 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0873edf8-db0f-443d-99d6-2a5d6271039e tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:42.520901 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0873edf8-db0f-443d-99d6-2a5d6271039e tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'ab432e6211d8480885d6f1acedd80efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c294727d94f44b69a0bfe87e3c323e95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:56:42.526881 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0873edf8-db0f-443d-99d6-2a5d6271039e tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] [instance: 21f746ec-50b3-4294-a7d8-e68e4c32f993] Old instance type m1.heat2, new instance type m1.heat {{(pid=122257) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 31 16:56:42.533510 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-0873edf8-db0f-443d-99d6-2a5d6271039e tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:56:42.533968 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-0873edf8-db0f-443d-99d6-2a5d6271039e tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:56:42.534495 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-0873edf8-db0f-443d-99d6-2a5d6271039e tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:56:42.534920 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-0873edf8-db0f-443d-99d6-2a5d6271039e tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:56:42.535349 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-0873edf8-db0f-443d-99d6-2a5d6271039e tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:56:42.646538 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0873edf8-db0f-443d-99d6-2a5d6271039e tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] 10.222.0.61 "POST /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993/action" status: 202 len: 0 microversion: 2.1 time: 0.217945 Aug 31 16:56:42.647165 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3592/7167] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:56:42 2022] POST /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993/action => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:56:42.656077 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2094591b-488d-4a98-bb26-8da150de1f4c tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:56:42.656802 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2094591b-488d-4a98-bb26-8da150de1f4c tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] [instance: 21f746ec-50b3-4294-a7d8-e68e4c32f993] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:56:42.662860 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2094591b-488d-4a98-bb26-8da150de1f4c tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:42.663687 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2094591b-488d-4a98-bb26-8da150de1f4c tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:42.664128 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2094591b-488d-4a98-bb26-8da150de1f4c tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:42.664827 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2094591b-488d-4a98-bb26-8da150de1f4c tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:42.665284 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2094591b-488d-4a98-bb26-8da150de1f4c tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:42.665710 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2094591b-488d-4a98-bb26-8da150de1f4c tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:42.844522 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-2094591b-488d-4a98-bb26-8da150de1f4c tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab432e6211d8480885d6f1acedd80efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c294727d94f44b69a0bfe87e3c323e95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:56:42.852543 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2094591b-488d-4a98-bb26-8da150de1f4c tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] 10.222.0.61 "GET /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993" status: 200 len: 1512 microversion: 2.1 time: 0.200860 Aug 31 16:56:42.853133 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3576/7168] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:56:42 2022] GET /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993 => generated 1512 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:56:43.874354 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d48d953a-a412-41ea-8cd5-1729b5989638 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:56:43.875043 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d48d953a-a412-41ea-8cd5-1729b5989638 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] [instance: 21f746ec-50b3-4294-a7d8-e68e4c32f993] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:56:43.882733 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d48d953a-a412-41ea-8cd5-1729b5989638 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:43.883236 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d48d953a-a412-41ea-8cd5-1729b5989638 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:43.883712 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d48d953a-a412-41ea-8cd5-1729b5989638 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:43.884433 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d48d953a-a412-41ea-8cd5-1729b5989638 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:43.884903 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d48d953a-a412-41ea-8cd5-1729b5989638 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:43.885348 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d48d953a-a412-41ea-8cd5-1729b5989638 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:44.022484 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d48d953a-a412-41ea-8cd5-1729b5989638 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab432e6211d8480885d6f1acedd80efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c294727d94f44b69a0bfe87e3c323e95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:56:44.031069 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d48d953a-a412-41ea-8cd5-1729b5989638 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] 10.222.0.61 "GET /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993" status: 200 len: 1512 microversion: 2.1 time: 0.161090 Aug 31 16:56:44.031673 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3593/7169] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:56:43 2022] GET /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993 => generated 1512 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:56:45.052123 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-28b8013e-e64b-4348-be9d-5eeb7a57b9e1 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:56:45.052747 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-28b8013e-e64b-4348-be9d-5eeb7a57b9e1 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] [instance: 21f746ec-50b3-4294-a7d8-e68e4c32f993] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:56:45.059894 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-28b8013e-e64b-4348-be9d-5eeb7a57b9e1 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:45.060460 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-28b8013e-e64b-4348-be9d-5eeb7a57b9e1 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:45.060990 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-28b8013e-e64b-4348-be9d-5eeb7a57b9e1 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:45.061701 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-28b8013e-e64b-4348-be9d-5eeb7a57b9e1 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:45.062165 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-28b8013e-e64b-4348-be9d-5eeb7a57b9e1 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:45.062599 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-28b8013e-e64b-4348-be9d-5eeb7a57b9e1 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:45.193679 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-28b8013e-e64b-4348-be9d-5eeb7a57b9e1 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab432e6211d8480885d6f1acedd80efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c294727d94f44b69a0bfe87e3c323e95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:56:45.201715 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-28b8013e-e64b-4348-be9d-5eeb7a57b9e1 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] 10.222.0.61 "GET /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993" status: 200 len: 1517 microversion: 2.1 time: 0.153537 Aug 31 16:56:45.202295 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3577/7170] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:56:45 2022] GET /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993 => generated 1517 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:56:46.222420 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d4eb2e97-a992-4a44-bd71-5158e5d6b8a0 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:56:46.223055 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d4eb2e97-a992-4a44-bd71-5158e5d6b8a0 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] [instance: 21f746ec-50b3-4294-a7d8-e68e4c32f993] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:56:46.230178 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d4eb2e97-a992-4a44-bd71-5158e5d6b8a0 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:46.230687 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d4eb2e97-a992-4a44-bd71-5158e5d6b8a0 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:46.231147 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d4eb2e97-a992-4a44-bd71-5158e5d6b8a0 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:46.231900 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d4eb2e97-a992-4a44-bd71-5158e5d6b8a0 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:46.233525 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d4eb2e97-a992-4a44-bd71-5158e5d6b8a0 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:46.233977 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d4eb2e97-a992-4a44-bd71-5158e5d6b8a0 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:46.365555 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d4eb2e97-a992-4a44-bd71-5158e5d6b8a0 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab432e6211d8480885d6f1acedd80efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c294727d94f44b69a0bfe87e3c323e95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:56:46.374302 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d4eb2e97-a992-4a44-bd71-5158e5d6b8a0 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] 10.222.0.61 "GET /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993" status: 200 len: 1517 microversion: 2.1 time: 0.155664 Aug 31 16:56:46.374982 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3594/7171] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:56:46 2022] GET /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993 => generated 1517 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:56:47.396217 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-16379aa4-b0e1-496f-bcd3-60e1db95a5ac tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:56:47.396840 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-16379aa4-b0e1-496f-bcd3-60e1db95a5ac tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] [instance: 21f746ec-50b3-4294-a7d8-e68e4c32f993] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:56:47.403030 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-16379aa4-b0e1-496f-bcd3-60e1db95a5ac tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:47.403549 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-16379aa4-b0e1-496f-bcd3-60e1db95a5ac tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:47.404019 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-16379aa4-b0e1-496f-bcd3-60e1db95a5ac tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:47.405424 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-16379aa4-b0e1-496f-bcd3-60e1db95a5ac tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:47.405899 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-16379aa4-b0e1-496f-bcd3-60e1db95a5ac tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:47.406347 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-16379aa4-b0e1-496f-bcd3-60e1db95a5ac tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:47.548140 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-16379aa4-b0e1-496f-bcd3-60e1db95a5ac tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab432e6211d8480885d6f1acedd80efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c294727d94f44b69a0bfe87e3c323e95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:56:47.555988 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-16379aa4-b0e1-496f-bcd3-60e1db95a5ac tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] 10.222.0.61 "GET /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993" status: 200 len: 1517 microversion: 2.1 time: 0.164080 Aug 31 16:56:47.558466 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3578/7172] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:56:47 2022] GET /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993 => generated 1517 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:56:48.580117 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-072d8c20-e462-4e86-8306-dd6f08cca07d tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:56:48.580753 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-072d8c20-e462-4e86-8306-dd6f08cca07d tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] [instance: 21f746ec-50b3-4294-a7d8-e68e4c32f993] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:56:48.587090 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-072d8c20-e462-4e86-8306-dd6f08cca07d tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:48.587637 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-072d8c20-e462-4e86-8306-dd6f08cca07d tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:48.588100 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-072d8c20-e462-4e86-8306-dd6f08cca07d tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:48.588814 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-072d8c20-e462-4e86-8306-dd6f08cca07d tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:48.589294 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-072d8c20-e462-4e86-8306-dd6f08cca07d tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:48.589745 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-072d8c20-e462-4e86-8306-dd6f08cca07d tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:48.725480 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-072d8c20-e462-4e86-8306-dd6f08cca07d tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab432e6211d8480885d6f1acedd80efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c294727d94f44b69a0bfe87e3c323e95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:56:48.733414 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-072d8c20-e462-4e86-8306-dd6f08cca07d tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] 10.222.0.61 "GET /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993" status: 200 len: 1517 microversion: 2.1 time: 0.157920 Aug 31 16:56:48.733991 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3595/7173] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:56:48 2022] GET /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993 => generated 1517 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:56:49.755056 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-100ee3b6-a266-45d8-8645-a12f5757538f tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:56:49.755649 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-100ee3b6-a266-45d8-8645-a12f5757538f tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] [instance: 21f746ec-50b3-4294-a7d8-e68e4c32f993] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:56:49.762527 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-100ee3b6-a266-45d8-8645-a12f5757538f tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:49.763022 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-100ee3b6-a266-45d8-8645-a12f5757538f tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:49.763467 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-100ee3b6-a266-45d8-8645-a12f5757538f tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:49.764190 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-100ee3b6-a266-45d8-8645-a12f5757538f tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:49.764652 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-100ee3b6-a266-45d8-8645-a12f5757538f tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:49.765084 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-100ee3b6-a266-45d8-8645-a12f5757538f tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:49.902475 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-100ee3b6-a266-45d8-8645-a12f5757538f tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab432e6211d8480885d6f1acedd80efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c294727d94f44b69a0bfe87e3c323e95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:56:49.910878 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-100ee3b6-a266-45d8-8645-a12f5757538f tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] 10.222.0.61 "GET /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993" status: 200 len: 1517 microversion: 2.1 time: 0.159848 Aug 31 16:56:49.911464 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3579/7174] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:56:49 2022] GET /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993 => generated 1517 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:56:50.931322 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9963926f-bbc5-4647-843f-867fa5c7246d tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:56:50.931969 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9963926f-bbc5-4647-843f-867fa5c7246d tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] [instance: 21f746ec-50b3-4294-a7d8-e68e4c32f993] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:56:50.939488 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9963926f-bbc5-4647-843f-867fa5c7246d tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:50.940013 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9963926f-bbc5-4647-843f-867fa5c7246d tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:50.940460 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9963926f-bbc5-4647-843f-867fa5c7246d tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:50.941159 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9963926f-bbc5-4647-843f-867fa5c7246d tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:50.941625 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9963926f-bbc5-4647-843f-867fa5c7246d tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:50.942061 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9963926f-bbc5-4647-843f-867fa5c7246d tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:51.074086 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9963926f-bbc5-4647-843f-867fa5c7246d tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab432e6211d8480885d6f1acedd80efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c294727d94f44b69a0bfe87e3c323e95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:56:51.082571 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9963926f-bbc5-4647-843f-867fa5c7246d tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] 10.222.0.61 "GET /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993" status: 200 len: 1517 microversion: 2.1 time: 0.155131 Aug 31 16:56:51.083442 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3596/7175] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:56:50 2022] GET /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993 => generated 1517 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:56:52.104397 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ce826161-a463-4ab7-a693-7a7a1581565a tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:56:52.105021 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ce826161-a463-4ab7-a693-7a7a1581565a tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] [instance: 21f746ec-50b3-4294-a7d8-e68e4c32f993] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:56:52.112088 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ce826161-a463-4ab7-a693-7a7a1581565a tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:52.112580 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ce826161-a463-4ab7-a693-7a7a1581565a tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:52.113024 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ce826161-a463-4ab7-a693-7a7a1581565a tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:52.113728 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ce826161-a463-4ab7-a693-7a7a1581565a tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:52.114191 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ce826161-a463-4ab7-a693-7a7a1581565a tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:52.114624 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ce826161-a463-4ab7-a693-7a7a1581565a tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:52.251392 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ce826161-a463-4ab7-a693-7a7a1581565a tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab432e6211d8480885d6f1acedd80efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c294727d94f44b69a0bfe87e3c323e95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:56:52.259690 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ce826161-a463-4ab7-a693-7a7a1581565a tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] 10.222.0.61 "GET /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993" status: 200 len: 1517 microversion: 2.1 time: 0.159148 Aug 31 16:56:52.260261 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3580/7176] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:56:52 2022] GET /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993 => generated 1517 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:56:53.282042 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9f43cef9-6f59-4521-9462-0e18b3f9a020 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:56:53.282671 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9f43cef9-6f59-4521-9462-0e18b3f9a020 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] [instance: 21f746ec-50b3-4294-a7d8-e68e4c32f993] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:56:53.289523 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9f43cef9-6f59-4521-9462-0e18b3f9a020 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:53.290021 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9f43cef9-6f59-4521-9462-0e18b3f9a020 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:53.290471 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9f43cef9-6f59-4521-9462-0e18b3f9a020 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:53.291184 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9f43cef9-6f59-4521-9462-0e18b3f9a020 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:53.291676 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9f43cef9-6f59-4521-9462-0e18b3f9a020 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:53.292132 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9f43cef9-6f59-4521-9462-0e18b3f9a020 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:53.425554 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9f43cef9-6f59-4521-9462-0e18b3f9a020 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab432e6211d8480885d6f1acedd80efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c294727d94f44b69a0bfe87e3c323e95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:56:53.433285 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9f43cef9-6f59-4521-9462-0e18b3f9a020 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] 10.222.0.61 "GET /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993" status: 200 len: 1517 microversion: 2.1 time: 0.155674 Aug 31 16:56:53.433860 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3597/7177] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:56:53 2022] GET /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993 => generated 1517 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:56:54.454541 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-93d269c4-0436-435b-a984-6c2b191eb354 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:56:54.455160 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-93d269c4-0436-435b-a984-6c2b191eb354 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] [instance: 21f746ec-50b3-4294-a7d8-e68e4c32f993] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:56:54.462256 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-93d269c4-0436-435b-a984-6c2b191eb354 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:54.462752 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-93d269c4-0436-435b-a984-6c2b191eb354 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:54.463198 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-93d269c4-0436-435b-a984-6c2b191eb354 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:54.464014 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-93d269c4-0436-435b-a984-6c2b191eb354 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:54.464484 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-93d269c4-0436-435b-a984-6c2b191eb354 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:54.464913 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-93d269c4-0436-435b-a984-6c2b191eb354 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:54.593589 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-93d269c4-0436-435b-a984-6c2b191eb354 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab432e6211d8480885d6f1acedd80efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c294727d94f44b69a0bfe87e3c323e95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:56:54.601360 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-93d269c4-0436-435b-a984-6c2b191eb354 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] 10.222.0.61 "GET /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993" status: 200 len: 1517 microversion: 2.1 time: 0.150908 Aug 31 16:56:54.601936 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3581/7178] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:56:54 2022] GET /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993 => generated 1517 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:56:55.622956 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-721293a4-8298-4ea4-a7c8-4acb6c091155 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:56:55.624018 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-721293a4-8298-4ea4-a7c8-4acb6c091155 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] [instance: 21f746ec-50b3-4294-a7d8-e68e4c32f993] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:56:55.630737 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-721293a4-8298-4ea4-a7c8-4acb6c091155 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:55.631232 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-721293a4-8298-4ea4-a7c8-4acb6c091155 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:55.631726 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-721293a4-8298-4ea4-a7c8-4acb6c091155 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:55.632440 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-721293a4-8298-4ea4-a7c8-4acb6c091155 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:55.632910 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-721293a4-8298-4ea4-a7c8-4acb6c091155 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:55.633348 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-721293a4-8298-4ea4-a7c8-4acb6c091155 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:55.772855 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-721293a4-8298-4ea4-a7c8-4acb6c091155 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab432e6211d8480885d6f1acedd80efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c294727d94f44b69a0bfe87e3c323e95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:56:55.781280 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-721293a4-8298-4ea4-a7c8-4acb6c091155 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] 10.222.0.61 "GET /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993" status: 200 len: 1517 microversion: 2.1 time: 0.162870 Aug 31 16:56:55.781858 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3598/7179] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:56:55 2022] GET /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993 => generated 1517 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:56:56.802663 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a749555c-3a8b-4ed7-8176-441b819decf6 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:56:56.803276 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a749555c-3a8b-4ed7-8176-441b819decf6 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] [instance: 21f746ec-50b3-4294-a7d8-e68e4c32f993] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:56:56.810865 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a749555c-3a8b-4ed7-8176-441b819decf6 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:56.811471 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a749555c-3a8b-4ed7-8176-441b819decf6 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:56.811973 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a749555c-3a8b-4ed7-8176-441b819decf6 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:56.812685 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a749555c-3a8b-4ed7-8176-441b819decf6 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:56.813141 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a749555c-3a8b-4ed7-8176-441b819decf6 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:56.813567 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a749555c-3a8b-4ed7-8176-441b819decf6 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:56.945953 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a749555c-3a8b-4ed7-8176-441b819decf6 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab432e6211d8480885d6f1acedd80efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c294727d94f44b69a0bfe87e3c323e95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:56:56.953878 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a749555c-3a8b-4ed7-8176-441b819decf6 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] 10.222.0.61 "GET /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993" status: 200 len: 1517 microversion: 2.1 time: 0.155526 Aug 31 16:56:56.954446 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3582/7180] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:56:56 2022] GET /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993 => generated 1517 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:56:57.975468 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7ba4c81d-fe43-452c-a5a7-bfbfed707da2 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:56:57.976123 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7ba4c81d-fe43-452c-a5a7-bfbfed707da2 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] [instance: 21f746ec-50b3-4294-a7d8-e68e4c32f993] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:56:57.983695 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7ba4c81d-fe43-452c-a5a7-bfbfed707da2 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:57.984193 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7ba4c81d-fe43-452c-a5a7-bfbfed707da2 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:57.984648 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7ba4c81d-fe43-452c-a5a7-bfbfed707da2 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:57.985463 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7ba4c81d-fe43-452c-a5a7-bfbfed707da2 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:57.985935 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7ba4c81d-fe43-452c-a5a7-bfbfed707da2 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:57.986370 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7ba4c81d-fe43-452c-a5a7-bfbfed707da2 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:58.122080 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7ba4c81d-fe43-452c-a5a7-bfbfed707da2 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab432e6211d8480885d6f1acedd80efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c294727d94f44b69a0bfe87e3c323e95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:56:58.130210 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7ba4c81d-fe43-452c-a5a7-bfbfed707da2 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] 10.222.0.61 "GET /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993" status: 200 len: 1517 microversion: 2.1 time: 0.158631 Aug 31 16:56:58.130788 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3599/7181] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:56:57 2022] GET /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993 => generated 1517 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:56:59.152047 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-982d6b64-dd6c-4843-9a41-f87b1e9531a4 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:56:59.152674 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-982d6b64-dd6c-4843-9a41-f87b1e9531a4 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] [instance: 21f746ec-50b3-4294-a7d8-e68e4c32f993] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:56:59.160688 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-982d6b64-dd6c-4843-9a41-f87b1e9531a4 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:59.161173 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-982d6b64-dd6c-4843-9a41-f87b1e9531a4 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:59.161612 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-982d6b64-dd6c-4843-9a41-f87b1e9531a4 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:59.162309 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-982d6b64-dd6c-4843-9a41-f87b1e9531a4 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:59.162764 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-982d6b64-dd6c-4843-9a41-f87b1e9531a4 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:59.163197 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-982d6b64-dd6c-4843-9a41-f87b1e9531a4 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:59.300252 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-982d6b64-dd6c-4843-9a41-f87b1e9531a4 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab432e6211d8480885d6f1acedd80efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c294727d94f44b69a0bfe87e3c323e95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:56:59.307879 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-982d6b64-dd6c-4843-9a41-f87b1e9531a4 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] 10.222.0.61 "GET /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993" status: 200 len: 1517 microversion: 2.1 time: 0.159796 Aug 31 16:56:59.308822 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3583/7182] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:56:59 2022] GET /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993 => generated 1517 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:57:00.330185 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-aceab79e-7854-4800-95cf-a12e11cba300 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:57:00.330817 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-aceab79e-7854-4800-95cf-a12e11cba300 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] [instance: 21f746ec-50b3-4294-a7d8-e68e4c32f993] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:57:00.337630 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-aceab79e-7854-4800-95cf-a12e11cba300 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:00.338138 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-aceab79e-7854-4800-95cf-a12e11cba300 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:00.338597 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-aceab79e-7854-4800-95cf-a12e11cba300 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:00.339308 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-aceab79e-7854-4800-95cf-a12e11cba300 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:00.339814 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-aceab79e-7854-4800-95cf-a12e11cba300 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:00.340263 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-aceab79e-7854-4800-95cf-a12e11cba300 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:00.472587 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-aceab79e-7854-4800-95cf-a12e11cba300 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab432e6211d8480885d6f1acedd80efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c294727d94f44b69a0bfe87e3c323e95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:57:00.480454 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-aceab79e-7854-4800-95cf-a12e11cba300 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] 10.222.0.61 "GET /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993" status: 200 len: 1517 microversion: 2.1 time: 0.155146 Aug 31 16:57:00.481036 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3600/7183] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:57:00 2022] GET /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993 => generated 1517 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:57:01.502439 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-522ec62c-fefc-4fdf-a536-e0761b95966b tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:57:01.503069 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-522ec62c-fefc-4fdf-a536-e0761b95966b tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] [instance: 21f746ec-50b3-4294-a7d8-e68e4c32f993] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:57:01.509954 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-522ec62c-fefc-4fdf-a536-e0761b95966b tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:01.510450 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-522ec62c-fefc-4fdf-a536-e0761b95966b tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:01.510897 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-522ec62c-fefc-4fdf-a536-e0761b95966b tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:01.511632 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-522ec62c-fefc-4fdf-a536-e0761b95966b tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:01.512103 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-522ec62c-fefc-4fdf-a536-e0761b95966b tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:01.512542 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-522ec62c-fefc-4fdf-a536-e0761b95966b tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:01.655492 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-522ec62c-fefc-4fdf-a536-e0761b95966b tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab432e6211d8480885d6f1acedd80efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c294727d94f44b69a0bfe87e3c323e95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:57:01.663298 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-522ec62c-fefc-4fdf-a536-e0761b95966b tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] 10.222.0.61 "GET /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993" status: 200 len: 1517 microversion: 2.1 time: 0.165509 Aug 31 16:57:01.663920 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3584/7184] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:57:01 2022] GET /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993 => generated 1517 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:57:02.684687 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0d1173f9-7ab0-41cb-82f4-23a1253cd018 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:57:02.686485 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0d1173f9-7ab0-41cb-82f4-23a1253cd018 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] [instance: 21f746ec-50b3-4294-a7d8-e68e4c32f993] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:57:02.693441 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0d1173f9-7ab0-41cb-82f4-23a1253cd018 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:02.693990 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0d1173f9-7ab0-41cb-82f4-23a1253cd018 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:02.694450 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0d1173f9-7ab0-41cb-82f4-23a1253cd018 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:02.695164 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0d1173f9-7ab0-41cb-82f4-23a1253cd018 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:02.695740 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0d1173f9-7ab0-41cb-82f4-23a1253cd018 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:02.696196 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0d1173f9-7ab0-41cb-82f4-23a1253cd018 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:02.828556 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0d1173f9-7ab0-41cb-82f4-23a1253cd018 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab432e6211d8480885d6f1acedd80efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c294727d94f44b69a0bfe87e3c323e95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:57:02.836561 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0d1173f9-7ab0-41cb-82f4-23a1253cd018 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] 10.222.0.61 "GET /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993" status: 200 len: 1517 microversion: 2.1 time: 0.155900 Aug 31 16:57:02.837161 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3601/7185] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:57:02 2022] GET /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993 => generated 1517 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:57:03.858411 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c696f511-dca8-4a90-89d0-a3ac59fc68ad tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:57:03.859038 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c696f511-dca8-4a90-89d0-a3ac59fc68ad tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] [instance: 21f746ec-50b3-4294-a7d8-e68e4c32f993] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:57:03.865909 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c696f511-dca8-4a90-89d0-a3ac59fc68ad tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:03.866386 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c696f511-dca8-4a90-89d0-a3ac59fc68ad tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:03.866818 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c696f511-dca8-4a90-89d0-a3ac59fc68ad tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:03.867526 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c696f511-dca8-4a90-89d0-a3ac59fc68ad tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:03.867966 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c696f511-dca8-4a90-89d0-a3ac59fc68ad tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:03.868389 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c696f511-dca8-4a90-89d0-a3ac59fc68ad tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:04.004034 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c696f511-dca8-4a90-89d0-a3ac59fc68ad tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab432e6211d8480885d6f1acedd80efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c294727d94f44b69a0bfe87e3c323e95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:57:04.011873 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c696f511-dca8-4a90-89d0-a3ac59fc68ad tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] 10.222.0.61 "GET /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993" status: 200 len: 1517 microversion: 2.1 time: 0.157496 Aug 31 16:57:04.012448 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3585/7186] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:57:03 2022] GET /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993 => generated 1517 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:57:05.035043 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e8918074-8f4c-46b5-a66e-5cd72ecc122c tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:57:05.035700 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e8918074-8f4c-46b5-a66e-5cd72ecc122c tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] [instance: 21f746ec-50b3-4294-a7d8-e68e4c32f993] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:57:05.038580 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=32 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:57:05.044393 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e8918074-8f4c-46b5-a66e-5cd72ecc122c tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:05.044899 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e8918074-8f4c-46b5-a66e-5cd72ecc122c tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:05.045348 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e8918074-8f4c-46b5-a66e-5cd72ecc122c tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:05.046059 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e8918074-8f4c-46b5-a66e-5cd72ecc122c tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:05.046552 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e8918074-8f4c-46b5-a66e-5cd72ecc122c tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:05.046993 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e8918074-8f4c-46b5-a66e-5cd72ecc122c tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:05.051332 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:57:05.178035 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e8918074-8f4c-46b5-a66e-5cd72ecc122c tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab432e6211d8480885d6f1acedd80efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c294727d94f44b69a0bfe87e3c323e95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:57:05.186601 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e8918074-8f4c-46b5-a66e-5cd72ecc122c tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] 10.222.0.61 "GET /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993" status: 200 len: 1517 microversion: 2.1 time: 0.155455 Aug 31 16:57:05.187179 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3602/7187] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:57:05 2022] GET /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993 => generated 1517 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:57:06.208098 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6da58f24-4461-4c89-abf4-44ffc55d50ad tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:57:06.208712 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6da58f24-4461-4c89-abf4-44ffc55d50ad tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] [instance: 21f746ec-50b3-4294-a7d8-e68e4c32f993] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:57:06.212016 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=28 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:57:06.217585 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6da58f24-4461-4c89-abf4-44ffc55d50ad tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:06.218070 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6da58f24-4461-4c89-abf4-44ffc55d50ad tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:06.218510 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6da58f24-4461-4c89-abf4-44ffc55d50ad tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:06.219204 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6da58f24-4461-4c89-abf4-44ffc55d50ad tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:06.219755 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6da58f24-4461-4c89-abf4-44ffc55d50ad tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:06.220128 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6da58f24-4461-4c89-abf4-44ffc55d50ad tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:06.222950 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=84 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:57:06.356093 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-6da58f24-4461-4c89-abf4-44ffc55d50ad tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab432e6211d8480885d6f1acedd80efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c294727d94f44b69a0bfe87e3c323e95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:57:06.366712 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6da58f24-4461-4c89-abf4-44ffc55d50ad tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] 10.222.0.61 "GET /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993" status: 200 len: 1517 microversion: 2.1 time: 0.162440 Aug 31 16:57:06.367228 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3586/7188] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:57:06 2022] GET /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993 => generated 1517 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:57:07.390388 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5263b2b9-cf69-4b2d-b18f-ef99eec9e3b2 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:57:07.390953 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5263b2b9-cf69-4b2d-b18f-ef99eec9e3b2 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] [instance: 21f746ec-50b3-4294-a7d8-e68e4c32f993] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:57:07.397934 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5263b2b9-cf69-4b2d-b18f-ef99eec9e3b2 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:07.398443 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5263b2b9-cf69-4b2d-b18f-ef99eec9e3b2 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:07.398898 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5263b2b9-cf69-4b2d-b18f-ef99eec9e3b2 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:07.399653 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5263b2b9-cf69-4b2d-b18f-ef99eec9e3b2 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:07.400127 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5263b2b9-cf69-4b2d-b18f-ef99eec9e3b2 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:07.400569 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5263b2b9-cf69-4b2d-b18f-ef99eec9e3b2 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:07.536640 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5263b2b9-cf69-4b2d-b18f-ef99eec9e3b2 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab432e6211d8480885d6f1acedd80efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c294727d94f44b69a0bfe87e3c323e95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:57:07.544580 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5263b2b9-cf69-4b2d-b18f-ef99eec9e3b2 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] 10.222.0.61 "GET /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993" status: 200 len: 1517 microversion: 2.1 time: 0.158960 Aug 31 16:57:07.545155 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3603/7189] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:57:07 2022] GET /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993 => generated 1517 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:57:08.565613 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a16002c9-33fb-441c-8b95-114eb64bae2c tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:57:08.566230 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a16002c9-33fb-441c-8b95-114eb64bae2c tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] [instance: 21f746ec-50b3-4294-a7d8-e68e4c32f993] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:57:08.572992 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a16002c9-33fb-441c-8b95-114eb64bae2c tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:08.573480 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a16002c9-33fb-441c-8b95-114eb64bae2c tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:08.573914 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a16002c9-33fb-441c-8b95-114eb64bae2c tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:08.574603 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a16002c9-33fb-441c-8b95-114eb64bae2c tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:08.575057 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a16002c9-33fb-441c-8b95-114eb64bae2c tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:08.576093 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a16002c9-33fb-441c-8b95-114eb64bae2c tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:08.705408 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a16002c9-33fb-441c-8b95-114eb64bae2c tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab432e6211d8480885d6f1acedd80efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c294727d94f44b69a0bfe87e3c323e95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:57:08.713099 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a16002c9-33fb-441c-8b95-114eb64bae2c tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] 10.222.0.61 "GET /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993" status: 200 len: 1517 microversion: 2.1 time: 0.151415 Aug 31 16:57:08.713673 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3587/7190] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:57:08 2022] GET /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993 => generated 1517 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:57:09.735536 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f2b08072-c4ef-4f96-aad5-a10c372cf1b2 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:57:09.736112 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f2b08072-c4ef-4f96-aad5-a10c372cf1b2 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] [instance: 21f746ec-50b3-4294-a7d8-e68e4c32f993] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:57:09.742925 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f2b08072-c4ef-4f96-aad5-a10c372cf1b2 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:09.743420 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f2b08072-c4ef-4f96-aad5-a10c372cf1b2 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:09.743913 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f2b08072-c4ef-4f96-aad5-a10c372cf1b2 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:09.744882 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f2b08072-c4ef-4f96-aad5-a10c372cf1b2 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:09.745107 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f2b08072-c4ef-4f96-aad5-a10c372cf1b2 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:09.745548 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f2b08072-c4ef-4f96-aad5-a10c372cf1b2 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:10.148287 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f2b08072-c4ef-4f96-aad5-a10c372cf1b2 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab432e6211d8480885d6f1acedd80efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c294727d94f44b69a0bfe87e3c323e95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:57:10.156583 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f2b08072-c4ef-4f96-aad5-a10c372cf1b2 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] 10.222.0.61 "GET /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993" status: 200 len: 1517 microversion: 2.1 time: 0.425920 Aug 31 16:57:10.157151 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3604/7191] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:57:09 2022] GET /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993 => generated 1517 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:57:11.178438 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8a9fd309-ee2c-4cb6-9deb-653dfb451565 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:57:11.178867 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8a9fd309-ee2c-4cb6-9deb-653dfb451565 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] [instance: 21f746ec-50b3-4294-a7d8-e68e4c32f993] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:57:11.186452 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8a9fd309-ee2c-4cb6-9deb-653dfb451565 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:11.186946 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8a9fd309-ee2c-4cb6-9deb-653dfb451565 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:11.187388 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8a9fd309-ee2c-4cb6-9deb-653dfb451565 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:11.188113 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8a9fd309-ee2c-4cb6-9deb-653dfb451565 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:11.188575 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8a9fd309-ee2c-4cb6-9deb-653dfb451565 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:11.189006 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8a9fd309-ee2c-4cb6-9deb-653dfb451565 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:11.319904 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8a9fd309-ee2c-4cb6-9deb-653dfb451565 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab432e6211d8480885d6f1acedd80efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c294727d94f44b69a0bfe87e3c323e95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:57:11.327779 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8a9fd309-ee2c-4cb6-9deb-653dfb451565 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] 10.222.0.61 "GET /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993" status: 200 len: 1517 microversion: 2.1 time: 0.153415 Aug 31 16:57:11.328361 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3588/7192] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:57:11 2022] GET /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993 => generated 1517 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:57:12.349647 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-231c16e6-8de5-445f-83fc-3c87d16eeb66 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:57:12.350309 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-231c16e6-8de5-445f-83fc-3c87d16eeb66 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] [instance: 21f746ec-50b3-4294-a7d8-e68e4c32f993] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:57:12.357676 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-231c16e6-8de5-445f-83fc-3c87d16eeb66 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:12.358241 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-231c16e6-8de5-445f-83fc-3c87d16eeb66 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:12.358664 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-231c16e6-8de5-445f-83fc-3c87d16eeb66 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:12.359593 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-231c16e6-8de5-445f-83fc-3c87d16eeb66 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:12.360094 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-231c16e6-8de5-445f-83fc-3c87d16eeb66 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:12.360730 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-231c16e6-8de5-445f-83fc-3c87d16eeb66 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:12.559242 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-231c16e6-8de5-445f-83fc-3c87d16eeb66 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab432e6211d8480885d6f1acedd80efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c294727d94f44b69a0bfe87e3c323e95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:57:12.567617 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-231c16e6-8de5-445f-83fc-3c87d16eeb66 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] 10.222.0.61 "GET /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993" status: 200 len: 1516 microversion: 2.1 time: 0.222073 Aug 31 16:57:12.568406 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3605/7193] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:57:12 2022] GET /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993 => generated 1516 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:57:12.843851 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-775f4f14-fa34-4e1f-990d-ac0c68742d57 req-2fbef591-06bf-4062-8530-9c9d9f244b29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21f746ec-50b3-4294-a7d8-e68e4c32f993", "name": "network-vif-unplugged", "status": "completed", "tag": "ab187d23-9004-497b-afc0-776751e5e19b"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:57:12.854138 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-775f4f14-fa34-4e1f-990d-ac0c68742d57 req-2fbef591-06bf-4062-8530-9c9d9f244b29 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:12.854624 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-775f4f14-fa34-4e1f-990d-ac0c68742d57 req-2fbef591-06bf-4062-8530-9c9d9f244b29 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:12.855202 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-775f4f14-fa34-4e1f-990d-ac0c68742d57 req-2fbef591-06bf-4062-8530-9c9d9f244b29 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:12.868814 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-775f4f14-fa34-4e1f-990d-ac0c68742d57 req-2fbef591-06bf-4062-8530-9c9d9f244b29 service nova] Creating event network-vif-unplugged:ab187d23-9004-497b-afc0-776751e5e19b for instance 21f746ec-50b3-4294-a7d8-e68e4c32f993 on n-h1-850499-9 Aug 31 16:57:12.875234 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [req-775f4f14-fa34-4e1f-990d-ac0c68742d57 req-2fbef591-06bf-4062-8530-9c9d9f244b29 service nova] Instance 21f746ec-50b3-4294-a7d8-e68e4c32f993 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850499-9', 'n-h2-850499-9'} {{(pid=122256) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 31 16:57:12.886121 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-775f4f14-fa34-4e1f-990d-ac0c68742d57 req-2fbef591-06bf-4062-8530-9c9d9f244b29 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046370 Aug 31 16:57:12.886999 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3589/7194] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:57:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:57:13.590246 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7630c55d-b5eb-43d1-860d-f362a4709cfb tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:57:13.591009 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7630c55d-b5eb-43d1-860d-f362a4709cfb tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] [instance: 21f746ec-50b3-4294-a7d8-e68e4c32f993] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:57:13.600726 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7630c55d-b5eb-43d1-860d-f362a4709cfb tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:13.601168 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7630c55d-b5eb-43d1-860d-f362a4709cfb tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:13.601813 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7630c55d-b5eb-43d1-860d-f362a4709cfb tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:13.602367 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7630c55d-b5eb-43d1-860d-f362a4709cfb tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:13.602854 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7630c55d-b5eb-43d1-860d-f362a4709cfb tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:13.603308 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7630c55d-b5eb-43d1-860d-f362a4709cfb tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:13.749148 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7630c55d-b5eb-43d1-860d-f362a4709cfb tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab432e6211d8480885d6f1acedd80efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c294727d94f44b69a0bfe87e3c323e95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:57:13.756962 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7630c55d-b5eb-43d1-860d-f362a4709cfb tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] 10.222.0.61 "GET /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993" status: 200 len: 1516 microversion: 2.1 time: 0.170613 Aug 31 16:57:13.757543 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3606/7195] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:57:13 2022] GET /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993 => generated 1516 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:57:14.782149 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a0c1746f-a9c6-4578-8155-0e164437cf87 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:57:14.782858 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a0c1746f-a9c6-4578-8155-0e164437cf87 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] [instance: 21f746ec-50b3-4294-a7d8-e68e4c32f993] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:57:14.789082 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a0c1746f-a9c6-4578-8155-0e164437cf87 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:14.789578 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a0c1746f-a9c6-4578-8155-0e164437cf87 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:14.790021 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a0c1746f-a9c6-4578-8155-0e164437cf87 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:14.790729 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a0c1746f-a9c6-4578-8155-0e164437cf87 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:14.791192 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a0c1746f-a9c6-4578-8155-0e164437cf87 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:14.791659 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a0c1746f-a9c6-4578-8155-0e164437cf87 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:14.903087 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-df2fb869-444e-47bf-9ac2-00da58ce824d req-b5997f1f-63d9-4810-87e2-44d04c4841f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21f746ec-50b3-4294-a7d8-e68e4c32f993", "tag": "ab187d23-9004-497b-afc0-776751e5e19b"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:57:14.913978 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-df2fb869-444e-47bf-9ac2-00da58ce824d req-b5997f1f-63d9-4810-87e2-44d04c4841f3 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:14.914477 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-df2fb869-444e-47bf-9ac2-00da58ce824d req-b5997f1f-63d9-4810-87e2-44d04c4841f3 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:14.914933 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-df2fb869-444e-47bf-9ac2-00da58ce824d req-b5997f1f-63d9-4810-87e2-44d04c4841f3 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:14.927676 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-df2fb869-444e-47bf-9ac2-00da58ce824d req-b5997f1f-63d9-4810-87e2-44d04c4841f3 service nova] Creating event network-changed:ab187d23-9004-497b-afc0-776751e5e19b for instance 21f746ec-50b3-4294-a7d8-e68e4c32f993 on n-h1-850499-9 Aug 31 16:57:14.933728 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [req-df2fb869-444e-47bf-9ac2-00da58ce824d req-b5997f1f-63d9-4810-87e2-44d04c4841f3 service nova] Instance 21f746ec-50b3-4294-a7d8-e68e4c32f993 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850499-9', 'n-h2-850499-9'} {{(pid=122257) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 31 16:57:14.939291 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a0c1746f-a9c6-4578-8155-0e164437cf87 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab432e6211d8480885d6f1acedd80efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c294727d94f44b69a0bfe87e3c323e95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:57:14.946286 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-df2fb869-444e-47bf-9ac2-00da58ce824d req-b5997f1f-63d9-4810-87e2-44d04c4841f3 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047080 Aug 31 16:57:14.947086 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3607/7196] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:57:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:57:14.947208 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a0c1746f-a9c6-4578-8155-0e164437cf87 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] 10.222.0.61 "GET /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993" status: 200 len: 1514 microversion: 2.1 time: 0.171543 Aug 31 16:57:14.948061 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3590/7197] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:57:14 2022] GET /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993 => generated 1514 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:57:15.971032 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e9eb2c70-c169-422f-8be6-1a546899fe40 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:57:15.971799 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e9eb2c70-c169-422f-8be6-1a546899fe40 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] [instance: 21f746ec-50b3-4294-a7d8-e68e4c32f993] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:57:15.977969 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e9eb2c70-c169-422f-8be6-1a546899fe40 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:15.978474 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e9eb2c70-c169-422f-8be6-1a546899fe40 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:15.978931 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e9eb2c70-c169-422f-8be6-1a546899fe40 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:15.979683 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e9eb2c70-c169-422f-8be6-1a546899fe40 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:15.980166 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e9eb2c70-c169-422f-8be6-1a546899fe40 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:15.980611 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e9eb2c70-c169-422f-8be6-1a546899fe40 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:16.197135 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e9eb2c70-c169-422f-8be6-1a546899fe40 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab432e6211d8480885d6f1acedd80efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c294727d94f44b69a0bfe87e3c323e95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:57:16.205270 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e9eb2c70-c169-422f-8be6-1a546899fe40 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] 10.222.0.61 "GET /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993" status: 200 len: 1514 microversion: 2.1 time: 0.239572 Aug 31 16:57:16.206657 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3608/7198] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:57:15 2022] GET /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993 => generated 1514 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:57:17.227653 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-154e0775-31a3-4de3-9430-eccfdb72ac79 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:57:17.228419 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-154e0775-31a3-4de3-9430-eccfdb72ac79 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] [instance: 21f746ec-50b3-4294-a7d8-e68e4c32f993] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:57:17.235345 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-154e0775-31a3-4de3-9430-eccfdb72ac79 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:17.235793 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-154e0775-31a3-4de3-9430-eccfdb72ac79 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:17.236239 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-154e0775-31a3-4de3-9430-eccfdb72ac79 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:17.236964 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-154e0775-31a3-4de3-9430-eccfdb72ac79 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:17.237432 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-154e0775-31a3-4de3-9430-eccfdb72ac79 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:17.237881 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-154e0775-31a3-4de3-9430-eccfdb72ac79 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:17.370854 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-154e0775-31a3-4de3-9430-eccfdb72ac79 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab432e6211d8480885d6f1acedd80efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c294727d94f44b69a0bfe87e3c323e95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:57:17.378902 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-154e0775-31a3-4de3-9430-eccfdb72ac79 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] 10.222.0.61 "GET /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993" status: 200 len: 1511 microversion: 2.1 time: 0.156151 Aug 31 16:57:17.379483 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3591/7199] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:57:17 2022] GET /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993 => generated 1511 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:57:17.399361 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1cb9c8d5-4b5a-4b74-8cc7-dcdf27b97390 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:57:17.399892 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1cb9c8d5-4b5a-4b74-8cc7-dcdf27b97390 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] [instance: 21f746ec-50b3-4294-a7d8-e68e4c32f993] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:57:17.406690 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1cb9c8d5-4b5a-4b74-8cc7-dcdf27b97390 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:17.407204 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1cb9c8d5-4b5a-4b74-8cc7-dcdf27b97390 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:17.407697 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1cb9c8d5-4b5a-4b74-8cc7-dcdf27b97390 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:17.408427 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1cb9c8d5-4b5a-4b74-8cc7-dcdf27b97390 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:17.408907 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1cb9c8d5-4b5a-4b74-8cc7-dcdf27b97390 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:17.409357 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1cb9c8d5-4b5a-4b74-8cc7-dcdf27b97390 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:17.437804 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1cb9c8d5-4b5a-4b74-8cc7-dcdf27b97390 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] [instance: 21f746ec-50b3-4294-a7d8-e68e4c32f993] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:57:17.488849 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.compute.api [None req-1cb9c8d5-4b5a-4b74-8cc7-dcdf27b97390 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] [instance: 21f746ec-50b3-4294-a7d8-e68e4c32f993] Found an unconfirmed migration during delete, id: 16, status: finished Aug 31 16:57:18.733578 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-c4115c13-0498-4fbf-858a-bb73bb855c0c req-8e5e4ba1-1455-4cb1-9a2c-f09574b10964 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21f746ec-50b3-4294-a7d8-e68e4c32f993", "name": "network-vif-plugged", "status": "completed", "tag": "ab187d23-9004-497b-afc0-776751e5e19b"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:57:18.744751 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-c4115c13-0498-4fbf-858a-bb73bb855c0c req-8e5e4ba1-1455-4cb1-9a2c-f09574b10964 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:18.745175 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-c4115c13-0498-4fbf-858a-bb73bb855c0c req-8e5e4ba1-1455-4cb1-9a2c-f09574b10964 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:18.745669 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-c4115c13-0498-4fbf-858a-bb73bb855c0c req-8e5e4ba1-1455-4cb1-9a2c-f09574b10964 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:18.759631 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-c4115c13-0498-4fbf-858a-bb73bb855c0c req-8e5e4ba1-1455-4cb1-9a2c-f09574b10964 service nova] Creating event network-vif-plugged:ab187d23-9004-497b-afc0-776751e5e19b for instance 21f746ec-50b3-4294-a7d8-e68e4c32f993 on n-h1-850499-9 Aug 31 16:57:18.766860 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [req-c4115c13-0498-4fbf-858a-bb73bb855c0c req-8e5e4ba1-1455-4cb1-9a2c-f09574b10964 service nova] Instance 21f746ec-50b3-4294-a7d8-e68e4c32f993 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850499-9', 'n-h2-850499-9'} {{(pid=122256) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 31 16:57:18.779791 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-c4115c13-0498-4fbf-858a-bb73bb855c0c req-8e5e4ba1-1455-4cb1-9a2c-f09574b10964 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050376 Aug 31 16:57:18.780474 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3592/7200] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:57:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:57:19.088972 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1cb9c8d5-4b5a-4b74-8cc7-dcdf27b97390 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] 10.222.0.61 "DELETE /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993" status: 204 len: 0 microversion: 2.1 time: 1.693171 Aug 31 16:57:19.090365 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3609/7201] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:57:17 2022] DELETE /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993 => generated 0 bytes in 1696 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:57:19.101533 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2b9aef98-f169-466a-9f59-91ae3bc338b4 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:57:19.102424 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2b9aef98-f169-466a-9f59-91ae3bc338b4 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] [instance: 21f746ec-50b3-4294-a7d8-e68e4c32f993] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:57:19.109419 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2b9aef98-f169-466a-9f59-91ae3bc338b4 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:19.109913 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2b9aef98-f169-466a-9f59-91ae3bc338b4 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:19.110359 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2b9aef98-f169-466a-9f59-91ae3bc338b4 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:19.111069 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2b9aef98-f169-466a-9f59-91ae3bc338b4 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:19.111673 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2b9aef98-f169-466a-9f59-91ae3bc338b4 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:19.112135 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2b9aef98-f169-466a-9f59-91ae3bc338b4 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:19.253599 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-2b9aef98-f169-466a-9f59-91ae3bc338b4 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab432e6211d8480885d6f1acedd80efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c294727d94f44b69a0bfe87e3c323e95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:57:19.261566 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2b9aef98-f169-466a-9f59-91ae3bc338b4 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] 10.222.0.61 "GET /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993" status: 200 len: 1503 microversion: 2.1 time: 0.164719 Aug 31 16:57:19.262144 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3593/7202] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:57:19 2022] GET /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993 => generated 1503 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:57:20.283856 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b189fcd8-bf12-4692-8dee-7ba2158e4247 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:57:20.284596 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b189fcd8-bf12-4692-8dee-7ba2158e4247 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] [instance: 21f746ec-50b3-4294-a7d8-e68e4c32f993] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:57:20.291471 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b189fcd8-bf12-4692-8dee-7ba2158e4247 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:20.292026 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b189fcd8-bf12-4692-8dee-7ba2158e4247 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:20.292483 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b189fcd8-bf12-4692-8dee-7ba2158e4247 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:20.293202 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b189fcd8-bf12-4692-8dee-7ba2158e4247 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:20.293682 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b189fcd8-bf12-4692-8dee-7ba2158e4247 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:20.294207 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b189fcd8-bf12-4692-8dee-7ba2158e4247 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:20.439315 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b189fcd8-bf12-4692-8dee-7ba2158e4247 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab432e6211d8480885d6f1acedd80efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c294727d94f44b69a0bfe87e3c323e95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:57:20.448447 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b189fcd8-bf12-4692-8dee-7ba2158e4247 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] 10.222.0.61 "GET /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993" status: 200 len: 1503 microversion: 2.1 time: 0.168610 Aug 31 16:57:20.462977 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3610/7203] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:57:20 2022] GET /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993 => generated 1503 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:57:21.471146 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-64253bfd-2d00-4610-8194-33e9d5219f8c tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:57:21.471807 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-64253bfd-2d00-4610-8194-33e9d5219f8c tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] [instance: 21f746ec-50b3-4294-a7d8-e68e4c32f993] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:57:21.478670 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-64253bfd-2d00-4610-8194-33e9d5219f8c tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:21.479169 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-64253bfd-2d00-4610-8194-33e9d5219f8c tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:21.479643 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-64253bfd-2d00-4610-8194-33e9d5219f8c tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:21.480394 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-64253bfd-2d00-4610-8194-33e9d5219f8c tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:21.480857 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-64253bfd-2d00-4610-8194-33e9d5219f8c tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:21.481339 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-64253bfd-2d00-4610-8194-33e9d5219f8c tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:21.539846 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-4bcd4557-d7b6-4241-a860-31e25c952ab8 req-7c9eafb0-4fff-4fdd-a4ec-bc6439d6c234 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21f746ec-50b3-4294-a7d8-e68e4c32f993", "name": "network-vif-deleted", "tag": "ab187d23-9004-497b-afc0-776751e5e19b"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:57:21.558538 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-4bcd4557-d7b6-4241-a860-31e25c952ab8 req-7c9eafb0-4fff-4fdd-a4ec-bc6439d6c234 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:21.559512 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-4bcd4557-d7b6-4241-a860-31e25c952ab8 req-7c9eafb0-4fff-4fdd-a4ec-bc6439d6c234 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:21.560616 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-4bcd4557-d7b6-4241-a860-31e25c952ab8 req-7c9eafb0-4fff-4fdd-a4ec-bc6439d6c234 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:21.570504 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-64253bfd-2d00-4610-8194-33e9d5219f8c tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab432e6211d8480885d6f1acedd80efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c294727d94f44b69a0bfe87e3c323e95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:57:21.593670 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-4bcd4557-d7b6-4241-a860-31e25c952ab8 req-7c9eafb0-4fff-4fdd-a4ec-bc6439d6c234 service nova] Creating event network-vif-deleted:ab187d23-9004-497b-afc0-776751e5e19b for instance 21f746ec-50b3-4294-a7d8-e68e4c32f993 on n-h1-850499-9 Aug 31 16:57:21.596662 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-64253bfd-2d00-4610-8194-33e9d5219f8c tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] 10.222.0.61 "GET /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993" status: 200 len: 1461 microversion: 2.1 time: 0.129399 Aug 31 16:57:21.597280 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3594/7204] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:57:21 2022] GET /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993 => generated 1461 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:57:21.603651 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-4bcd4557-d7b6-4241-a860-31e25c952ab8 req-7c9eafb0-4fff-4fdd-a4ec-bc6439d6c234 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067989 Aug 31 16:57:21.604863 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3611/7205] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:57:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:57:22.618738 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-439e36e5-ee0e-47b7-8c5f-9358911872b0 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:57:22.619388 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-439e36e5-ee0e-47b7-8c5f-9358911872b0 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] [instance: 21f746ec-50b3-4294-a7d8-e68e4c32f993] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:57:22.627163 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-439e36e5-ee0e-47b7-8c5f-9358911872b0 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:22.627695 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-439e36e5-ee0e-47b7-8c5f-9358911872b0 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:22.628148 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-439e36e5-ee0e-47b7-8c5f-9358911872b0 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:22.628866 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-439e36e5-ee0e-47b7-8c5f-9358911872b0 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:22.629334 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-439e36e5-ee0e-47b7-8c5f-9358911872b0 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:22.629773 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-439e36e5-ee0e-47b7-8c5f-9358911872b0 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:22.644383 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-439e36e5-ee0e-47b7-8c5f-9358911872b0 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] HTTP exception thrown: Instance 21f746ec-50b3-4294-a7d8-e68e4c32f993 could not be found. Aug 31 16:57:22.646063 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-439e36e5-ee0e-47b7-8c5f-9358911872b0 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Request method failure captured: Aug 31 16:57:22.646063 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993 HTTP/1.1 Aug 31 16:57:22.646063 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:57:22.646063 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:57:22.646063 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:57:22.646063 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:57:22.646063 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:57:22.646063 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:57:22.646063 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:57:22.646063 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:57:22.646063 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD5K8hlTjm9IV5HJxbnZjofPQHgiJak-SyrlB3HhIompWXspTk8czqbSVx54tXT9JmiOluaPO15rqDN6UdvvLOTMiG1sV9TL9wlEa7x5kSkzuO_O1mbFBH3eZUDCaBFk0ioWL_VPmIaKiSZ9kwYlb3vIhYoQii0kJvfyedZXhzINnjIA Aug 31 16:57:22.646063 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:57:22.646063 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:57:22.646063 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:57:22.646063 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:57:22.646063 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:57:22.646063 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:57:22.646063 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: c294727d94f44b69a0bfe87e3c323e95 Aug 31 16:57:22.646063 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-DeleteServersTestJSON-664150464 Aug 31 16:57:22.646063 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:57:22.646063 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:57:22.646063 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c294727d94f44b69a0bfe87e3c323e95"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/c294727d94f44b69a0bfe87e3c323e95"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_c294727d94f44b69a0bfe87e3c323e95", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c294727d94f44b69a0bfe87e3c323e95"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:57:22.646063 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-DeleteServersTestJSON-664150464 Aug 31 16:57:22.646063 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: c294727d94f44b69a0bfe87e3c323e95 Aug 31 16:57:22.646063 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-DeleteServersTestJSON-664150464 Aug 31 16:57:22.646063 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-DeleteServersTestJSON-664150464-project Aug 31 16:57:22.646063 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:57:22.646063 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:57:22.646063 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: ab432e6211d8480885d6f1acedd80efd Aug 31 16:57:22.646063 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-DeleteServersTestJSON-664150464-project Aug 31 16:57:22.646063 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:57:22.646063 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance 21f746ec-50b3-4294-a7d8-e68e4c32f993 could not be found. Aug 31 16:57:22.646063 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '21f746ec-50b3-4294-a7d8-e68e4c32f993'} Aug 31 16:57:22.646063 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:57:22.646063 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:57:22.646063 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:57:22.646063 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:57:22.646063 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:57:22.646063 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:57:22.646063 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:57:22.646063 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:57:22.646063 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:57:22.646063 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:57:22.646063 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21f746ec-50b3-4294-a7d8-e68e4c32f993 could not be found. Aug 31 16:57:22.646063 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:57:22.646063 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:57:22.646063 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:57:22.646063 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:57:22.646063 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:57:22.646063 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:57:22.646063 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:57:22.646063 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:57:22.646063 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:57:22.646063 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:57:22.646063 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:57:22.646063 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:57:22.646063 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:57:22.646063 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:57:22.646063 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:57:22.646063 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:57:22.646063 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21f746ec-50b3-4294-a7d8-e68e4c32f993 could not be found. Aug 31 16:57:22.646063 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:57:22.646063 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:57:22.646063 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:57:22.655004 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:57:22.655004 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:57:22.655004 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:57:22.655004 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:57:22.655004 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:57:22.655004 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21f746ec-50b3-4294-a7d8-e68e4c32f993 could not be found. Aug 31 16:57:22.655004 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:57:22.655004 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-439e36e5-ee0e-47b7-8c5f-9358911872b0 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Returning 404 to user: Instance 21f746ec-50b3-4294-a7d8-e68e4c32f993 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:57:22.655004 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-439e36e5-ee0e-47b7-8c5f-9358911872b0 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] 10.222.0.61 "GET /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993" status: 404 len: 111 microversion: 2.1 time: 0.032791 Aug 31 16:57:22.655004 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3595/7206] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:57:22 2022] GET /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:57:22.665819 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-28f19ae6-8039-4473-b6d3-3d91c89b65af tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:57:22.666429 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-28f19ae6-8039-4473-b6d3-3d91c89b65af tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] [instance: 21f746ec-50b3-4294-a7d8-e68e4c32f993] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:57:22.674961 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-28f19ae6-8039-4473-b6d3-3d91c89b65af tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:22.675478 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-28f19ae6-8039-4473-b6d3-3d91c89b65af tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:22.675960 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-28f19ae6-8039-4473-b6d3-3d91c89b65af tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:22.676693 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-28f19ae6-8039-4473-b6d3-3d91c89b65af tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:22.677174 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-28f19ae6-8039-4473-b6d3-3d91c89b65af tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:22.677624 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-28f19ae6-8039-4473-b6d3-3d91c89b65af tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:22.691794 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-28f19ae6-8039-4473-b6d3-3d91c89b65af tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] HTTP exception thrown: Instance 21f746ec-50b3-4294-a7d8-e68e4c32f993 could not be found. Aug 31 16:57:22.693529 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-28f19ae6-8039-4473-b6d3-3d91c89b65af tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Request method failure captured: Aug 31 16:57:22.693529 n-d-850499-9 devstack@n-api.service[122257]: request: DELETE /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993 HTTP/1.1 Aug 31 16:57:22.693529 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:57:22.693529 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:57:22.693529 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:57:22.693529 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:57:22.693529 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:57:22.693529 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:57:22.693529 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:57:22.693529 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:57:22.693529 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD5K8hlTjm9IV5HJxbnZjofPQHgiJak-SyrlB3HhIompWXspTk8czqbSVx54tXT9JmiOluaPO15rqDN6UdvvLOTMiG1sV9TL9wlEa7x5kSkzuO_O1mbFBH3eZUDCaBFk0ioWL_VPmIaKiSZ9kwYlb3vIhYoQii0kJvfyedZXhzINnjIA Aug 31 16:57:22.693529 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:57:22.693529 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:57:22.693529 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:57:22.693529 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:57:22.693529 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:57:22.693529 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:57:22.693529 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: c294727d94f44b69a0bfe87e3c323e95 Aug 31 16:57:22.693529 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-DeleteServersTestJSON-664150464 Aug 31 16:57:22.693529 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:57:22.693529 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:57:22.693529 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c294727d94f44b69a0bfe87e3c323e95"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/c294727d94f44b69a0bfe87e3c323e95"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_c294727d94f44b69a0bfe87e3c323e95", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c294727d94f44b69a0bfe87e3c323e95"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:57:22.693529 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-DeleteServersTestJSON-664150464 Aug 31 16:57:22.693529 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: c294727d94f44b69a0bfe87e3c323e95 Aug 31 16:57:22.693529 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-DeleteServersTestJSON-664150464 Aug 31 16:57:22.693529 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-DeleteServersTestJSON-664150464-project Aug 31 16:57:22.693529 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:57:22.693529 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:57:22.693529 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: ab432e6211d8480885d6f1acedd80efd Aug 31 16:57:22.693529 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-DeleteServersTestJSON-664150464-project Aug 31 16:57:22.693529 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:57:22.693529 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance 21f746ec-50b3-4294-a7d8-e68e4c32f993 could not be found. Aug 31 16:57:22.693529 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '21f746ec-50b3-4294-a7d8-e68e4c32f993'} Aug 31 16:57:22.693529 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:57:22.693529 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:57:22.693529 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:57:22.693529 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:57:22.693529 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:57:22.693529 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:57:22.693529 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:57:22.693529 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:57:22.693529 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:57:22.693529 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:57:22.693529 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21f746ec-50b3-4294-a7d8-e68e4c32f993 could not be found. Aug 31 16:57:22.693529 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:57:22.693529 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:57:22.693529 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:57:22.693529 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:57:22.693529 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:57:22.693529 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:57:22.693529 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:57:22.693529 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:57:22.693529 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:57:22.693529 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:57:22.693529 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:57:22.693529 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:57:22.693529 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:57:22.693529 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:57:22.693529 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:57:22.693529 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:57:22.693529 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:57:22.693529 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:57:22.697824 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21f746ec-50b3-4294-a7d8-e68e4c32f993 could not be found. Aug 31 16:57:22.697824 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:57:22.697824 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:57:22.697824 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:57:22.697824 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:57:22.697824 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:57:22.697824 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:57:22.697824 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:57:22.697824 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:57:22.697824 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21f746ec-50b3-4294-a7d8-e68e4c32f993 could not be found. Aug 31 16:57:22.697824 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:57:22.697824 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-28f19ae6-8039-4473-b6d3-3d91c89b65af tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Returning 404 to user: Instance 21f746ec-50b3-4294-a7d8-e68e4c32f993 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:57:22.697824 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-28f19ae6-8039-4473-b6d3-3d91c89b65af tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] 10.222.0.61 "DELETE /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993" status: 404 len: 111 microversion: 2.1 time: 0.035175 Aug 31 16:57:22.697824 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3612/7207] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:57:22 2022] DELETE /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:57:22.704455 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-667c2665-b124-40fd-a4ed-90045f26b096 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:57:22.705015 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-667c2665-b124-40fd-a4ed-90045f26b096 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] [instance: 21f746ec-50b3-4294-a7d8-e68e4c32f993] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:57:22.711129 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-667c2665-b124-40fd-a4ed-90045f26b096 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:22.711655 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-667c2665-b124-40fd-a4ed-90045f26b096 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:22.712101 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-667c2665-b124-40fd-a4ed-90045f26b096 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:22.712802 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-667c2665-b124-40fd-a4ed-90045f26b096 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:22.713264 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-667c2665-b124-40fd-a4ed-90045f26b096 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:22.713697 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-667c2665-b124-40fd-a4ed-90045f26b096 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:22.728473 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-667c2665-b124-40fd-a4ed-90045f26b096 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] HTTP exception thrown: Instance 21f746ec-50b3-4294-a7d8-e68e4c32f993 could not be found. Aug 31 16:57:22.730019 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-667c2665-b124-40fd-a4ed-90045f26b096 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Request method failure captured: Aug 31 16:57:22.730019 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993 HTTP/1.1 Aug 31 16:57:22.730019 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:57:22.730019 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:57:22.730019 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:57:22.730019 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:57:22.730019 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:57:22.730019 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:57:22.730019 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:57:22.730019 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:57:22.730019 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD5K8hlTjm9IV5HJxbnZjofPQHgiJak-SyrlB3HhIompWXspTk8czqbSVx54tXT9JmiOluaPO15rqDN6UdvvLOTMiG1sV9TL9wlEa7x5kSkzuO_O1mbFBH3eZUDCaBFk0ioWL_VPmIaKiSZ9kwYlb3vIhYoQii0kJvfyedZXhzINnjIA Aug 31 16:57:22.730019 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:57:22.730019 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:57:22.730019 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:57:22.730019 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:57:22.730019 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:57:22.730019 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:57:22.730019 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: c294727d94f44b69a0bfe87e3c323e95 Aug 31 16:57:22.730019 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-DeleteServersTestJSON-664150464 Aug 31 16:57:22.730019 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:57:22.730019 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:57:22.730019 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c294727d94f44b69a0bfe87e3c323e95"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/c294727d94f44b69a0bfe87e3c323e95"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_c294727d94f44b69a0bfe87e3c323e95", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c294727d94f44b69a0bfe87e3c323e95"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:57:22.730019 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-DeleteServersTestJSON-664150464 Aug 31 16:57:22.730019 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: c294727d94f44b69a0bfe87e3c323e95 Aug 31 16:57:22.730019 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-DeleteServersTestJSON-664150464 Aug 31 16:57:22.730019 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-DeleteServersTestJSON-664150464-project Aug 31 16:57:22.730019 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:57:22.730019 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:57:22.730019 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: ab432e6211d8480885d6f1acedd80efd Aug 31 16:57:22.730019 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-DeleteServersTestJSON-664150464-project Aug 31 16:57:22.730019 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:57:22.730019 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance 21f746ec-50b3-4294-a7d8-e68e4c32f993 could not be found. Aug 31 16:57:22.730019 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '21f746ec-50b3-4294-a7d8-e68e4c32f993'} Aug 31 16:57:22.730019 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:57:22.730019 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:57:22.730019 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:57:22.730019 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:57:22.730019 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:57:22.730019 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:57:22.730019 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:57:22.730019 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:57:22.730019 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:57:22.730019 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:57:22.730019 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21f746ec-50b3-4294-a7d8-e68e4c32f993 could not be found. Aug 31 16:57:22.730019 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:57:22.730019 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:57:22.730019 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:57:22.730019 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:57:22.730019 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:57:22.730019 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:57:22.730019 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:57:22.730019 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:57:22.730019 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:57:22.730019 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:57:22.730019 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:57:22.730019 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:57:22.730019 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:57:22.730019 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:57:22.730019 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:57:22.730019 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:57:22.730019 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21f746ec-50b3-4294-a7d8-e68e4c32f993 could not be found. Aug 31 16:57:22.730019 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:57:22.730019 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:57:22.730019 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:57:22.735386 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:57:22.735386 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:57:22.735386 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:57:22.735386 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:57:22.735386 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:57:22.735386 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21f746ec-50b3-4294-a7d8-e68e4c32f993 could not be found. Aug 31 16:57:22.735386 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:57:22.735386 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-667c2665-b124-40fd-a4ed-90045f26b096 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] Returning 404 to user: Instance 21f746ec-50b3-4294-a7d8-e68e4c32f993 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:57:22.735386 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-667c2665-b124-40fd-a4ed-90045f26b096 tempest-DeleteServersTestJSON-664150464 tempest-DeleteServersTestJSON-664150464-project] 10.222.0.61 "GET /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993" status: 404 len: 111 microversion: 2.1 time: 0.031982 Aug 31 16:57:22.735386 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3596/7208] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:57:22 2022] GET /compute/v2.1/servers/21f746ec-50b3-4294-a7d8-e68e4c32f993 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:57:31.869531 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-180e388f-42d5-4435-aff7-4277e9988bdd tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1679971073", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "networks": [{"uuid": "99f30407-a628-4a17-90d7-d673792074dc"}]}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:57:31.927473 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-180e388f-42d5-4435-aff7-4277e9988bdd tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] validate_networks() for [('99f30407-a628-4a17-90d7-d673792074dc', None, None, None, None, None)] {{(pid=122257) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:57:32.323214 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-180e388f-42d5-4435-aff7-4277e9988bdd tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:57:32.323681 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-180e388f-42d5-4435-aff7-4277e9988bdd tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:57:32.324241 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-180e388f-42d5-4435-aff7-4277e9988bdd tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:57:32.324671 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-180e388f-42d5-4435-aff7-4277e9988bdd tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:57:32.325879 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-180e388f-42d5-4435-aff7-4277e9988bdd tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:57:32.340813 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-180e388f-42d5-4435-aff7-4277e9988bdd tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:32.341528 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-180e388f-42d5-4435-aff7-4277e9988bdd tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:32.342080 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-180e388f-42d5-4435-aff7-4277e9988bdd tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:32.343180 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-180e388f-42d5-4435-aff7-4277e9988bdd tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:32.343764 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-180e388f-42d5-4435-aff7-4277e9988bdd tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:32.344282 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-180e388f-42d5-4435-aff7-4277e9988bdd tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:32.363793 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-180e388f-42d5-4435-aff7-4277e9988bdd tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Getting quotas for project 61d77247e9aa471eba23dcc9d2c30e72. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:57:32.369814 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-180e388f-42d5-4435-aff7-4277e9988bdd tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Getting quotas for user 7228e15d12e442b0802ef033bc6158b7 and project 61d77247e9aa471eba23dcc9d2c30e72. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:57:32.385117 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-180e388f-42d5-4435-aff7-4277e9988bdd tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Going to run 1 instances... {{(pid=122257) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:57:32.392611 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-180e388f-42d5-4435-aff7-4277e9988bdd tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: b1623b9c-b818-43a2-9360-99751b436ec2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:57:32.437583 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-180e388f-42d5-4435-aff7-4277e9988bdd tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.697596 Aug 31 16:57:32.438140 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3613/7209] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:57:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 699 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:57:32.450496 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8816c8b7-5648-4278-a57d-ec3d70d402dc tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:57:32.450496 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8816c8b7-5648-4278-a57d-ec3d70d402dc tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: b1623b9c-b818-43a2-9360-99751b436ec2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:57:32.515318 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8816c8b7-5648-4278-a57d-ec3d70d402dc tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7228e15d12e442b0802ef033bc6158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d77247e9aa471eba23dcc9d2c30e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:57:32.522257 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8816c8b7-5648-4278-a57d-ec3d70d402dc tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "GET /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2" status: 200 len: 1218 microversion: 2.1 time: 0.077284 Aug 31 16:57:32.522842 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3597/7210] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:57:32 2022] GET /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2 => generated 1218 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:57:33.544945 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-461086fb-7f65-4a49-9075-d5e628e306e6 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:57:33.545635 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-461086fb-7f65-4a49-9075-d5e628e306e6 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: b1623b9c-b818-43a2-9360-99751b436ec2] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:57:33.554836 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-461086fb-7f65-4a49-9075-d5e628e306e6 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:33.555685 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-461086fb-7f65-4a49-9075-d5e628e306e6 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:33.556157 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-461086fb-7f65-4a49-9075-d5e628e306e6 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:33.556913 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-461086fb-7f65-4a49-9075-d5e628e306e6 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:33.557407 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-461086fb-7f65-4a49-9075-d5e628e306e6 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:33.557867 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-461086fb-7f65-4a49-9075-d5e628e306e6 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:33.636686 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-461086fb-7f65-4a49-9075-d5e628e306e6 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7228e15d12e442b0802ef033bc6158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d77247e9aa471eba23dcc9d2c30e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:57:33.645921 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-461086fb-7f65-4a49-9075-d5e628e306e6 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "GET /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2" status: 200 len: 1270 microversion: 2.1 time: 0.106271 Aug 31 16:57:33.646626 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3614/7211] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:57:33 2022] GET /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2 => generated 1270 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:57:34.668608 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ae3514e7-deb5-46e9-85da-f4385ad3eebb tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:57:34.669250 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ae3514e7-deb5-46e9-85da-f4385ad3eebb tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: b1623b9c-b818-43a2-9360-99751b436ec2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:57:34.671356 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=53 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:57:34.687405 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ae3514e7-deb5-46e9-85da-f4385ad3eebb tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:34.688448 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ae3514e7-deb5-46e9-85da-f4385ad3eebb tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:34.688889 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ae3514e7-deb5-46e9-85da-f4385ad3eebb tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:34.689805 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ae3514e7-deb5-46e9-85da-f4385ad3eebb tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:34.690432 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ae3514e7-deb5-46e9-85da-f4385ad3eebb tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:34.691208 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ae3514e7-deb5-46e9-85da-f4385ad3eebb tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:34.951219 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ae3514e7-deb5-46e9-85da-f4385ad3eebb tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7228e15d12e442b0802ef033bc6158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d77247e9aa471eba23dcc9d2c30e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:57:34.959792 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ae3514e7-deb5-46e9-85da-f4385ad3eebb tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "GET /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2" status: 200 len: 1318 microversion: 2.1 time: 0.295244 Aug 31 16:57:34.960378 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3598/7212] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:57:34 2022] GET /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2 => generated 1318 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:57:35.285079 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-435a14e2-29db-4ecf-b222-0ca7072bc068 req-69d0e7d7-16e3-4182-9a56-19db1947cf38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1623b9c-b818-43a2-9360-99751b436ec2", "tag": "7b318eca-bd27-4228-80b5-324494fde0c2"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:57:35.291707 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:57:35.298906 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-435a14e2-29db-4ecf-b222-0ca7072bc068 req-69d0e7d7-16e3-4182-9a56-19db1947cf38 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:35.299491 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-435a14e2-29db-4ecf-b222-0ca7072bc068 req-69d0e7d7-16e3-4182-9a56-19db1947cf38 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:35.300092 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-435a14e2-29db-4ecf-b222-0ca7072bc068 req-69d0e7d7-16e3-4182-9a56-19db1947cf38 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:35.305693 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:57:35.314774 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-435a14e2-29db-4ecf-b222-0ca7072bc068 req-69d0e7d7-16e3-4182-9a56-19db1947cf38 service nova] Creating event network-changed:7b318eca-bd27-4228-80b5-324494fde0c2 for instance b1623b9c-b818-43a2-9360-99751b436ec2 on n-h1-850499-9 Aug 31 16:57:35.321148 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-435a14e2-29db-4ecf-b222-0ca7072bc068 req-69d0e7d7-16e3-4182-9a56-19db1947cf38 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040375 Aug 31 16:57:35.322061 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3615/7213] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:57:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:57:35.981338 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-79f13fe8-8d4a-4719-8346-5d14a406932f tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:57:35.982161 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-79f13fe8-8d4a-4719-8346-5d14a406932f tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: b1623b9c-b818-43a2-9360-99751b436ec2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:57:35.989332 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-79f13fe8-8d4a-4719-8346-5d14a406932f tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:35.989826 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-79f13fe8-8d4a-4719-8346-5d14a406932f tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:35.990275 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-79f13fe8-8d4a-4719-8346-5d14a406932f tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:35.990987 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-79f13fe8-8d4a-4719-8346-5d14a406932f tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:35.991455 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-79f13fe8-8d4a-4719-8346-5d14a406932f tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:35.991911 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-79f13fe8-8d4a-4719-8346-5d14a406932f tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:36.133906 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-79f13fe8-8d4a-4719-8346-5d14a406932f tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7228e15d12e442b0802ef033bc6158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d77247e9aa471eba23dcc9d2c30e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:57:36.142944 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-79f13fe8-8d4a-4719-8346-5d14a406932f tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "GET /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2" status: 200 len: 1318 microversion: 2.1 time: 0.165658 Aug 31 16:57:36.143564 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3599/7214] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:57:35 2022] GET /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:57:37.169607 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-068287d0-e399-406a-8e54-945c5019830e tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:57:37.170378 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-068287d0-e399-406a-8e54-945c5019830e tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: b1623b9c-b818-43a2-9360-99751b436ec2] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:57:37.177796 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-068287d0-e399-406a-8e54-945c5019830e tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:37.178301 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-068287d0-e399-406a-8e54-945c5019830e tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:37.178754 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-068287d0-e399-406a-8e54-945c5019830e tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:37.179463 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-068287d0-e399-406a-8e54-945c5019830e tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:37.179955 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-068287d0-e399-406a-8e54-945c5019830e tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:37.180399 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-068287d0-e399-406a-8e54-945c5019830e tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:37.309521 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-068287d0-e399-406a-8e54-945c5019830e tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7228e15d12e442b0802ef033bc6158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d77247e9aa471eba23dcc9d2c30e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:57:37.317423 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-068287d0-e399-406a-8e54-945c5019830e tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "GET /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2" status: 200 len: 1318 microversion: 2.1 time: 0.154952 Aug 31 16:57:37.318005 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3616/7215] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:57:37 2022] GET /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:57:38.338811 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-de10b82b-7f34-4935-a107-68a423d76027 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:57:38.339346 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-de10b82b-7f34-4935-a107-68a423d76027 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: b1623b9c-b818-43a2-9360-99751b436ec2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:57:38.343113 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=30 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:57:38.348642 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-de10b82b-7f34-4935-a107-68a423d76027 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:38.349146 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-de10b82b-7f34-4935-a107-68a423d76027 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:38.349590 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-de10b82b-7f34-4935-a107-68a423d76027 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:38.350330 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-de10b82b-7f34-4935-a107-68a423d76027 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:38.350794 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-de10b82b-7f34-4935-a107-68a423d76027 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:38.351229 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-de10b82b-7f34-4935-a107-68a423d76027 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:38.490585 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-de10b82b-7f34-4935-a107-68a423d76027 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7228e15d12e442b0802ef033bc6158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d77247e9aa471eba23dcc9d2c30e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:57:38.498420 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-de10b82b-7f34-4935-a107-68a423d76027 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "GET /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2" status: 200 len: 1318 microversion: 2.1 time: 0.163647 Aug 31 16:57:38.499271 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3600/7216] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:57:38 2022] GET /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:57:39.519629 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8f7fdb21-8408-4f96-b856-c3f83e5d1b04 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:57:39.520262 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8f7fdb21-8408-4f96-b856-c3f83e5d1b04 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: b1623b9c-b818-43a2-9360-99751b436ec2] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:57:39.527376 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8f7fdb21-8408-4f96-b856-c3f83e5d1b04 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:39.528608 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8f7fdb21-8408-4f96-b856-c3f83e5d1b04 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:39.529389 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8f7fdb21-8408-4f96-b856-c3f83e5d1b04 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:39.530130 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8f7fdb21-8408-4f96-b856-c3f83e5d1b04 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:39.530652 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8f7fdb21-8408-4f96-b856-c3f83e5d1b04 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:39.531107 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8f7fdb21-8408-4f96-b856-c3f83e5d1b04 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:39.661660 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8f7fdb21-8408-4f96-b856-c3f83e5d1b04 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7228e15d12e442b0802ef033bc6158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d77247e9aa471eba23dcc9d2c30e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:57:39.670086 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8f7fdb21-8408-4f96-b856-c3f83e5d1b04 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "GET /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2" status: 200 len: 1318 microversion: 2.1 time: 0.154470 Aug 31 16:57:39.670660 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3617/7217] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:57:39 2022] GET /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:57:40.690955 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d4ea1908-9f11-45b7-823a-958a1eb98aef tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:57:40.691629 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d4ea1908-9f11-45b7-823a-958a1eb98aef tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: b1623b9c-b818-43a2-9360-99751b436ec2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:57:40.698605 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d4ea1908-9f11-45b7-823a-958a1eb98aef tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:40.699095 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d4ea1908-9f11-45b7-823a-958a1eb98aef tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:40.699613 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d4ea1908-9f11-45b7-823a-958a1eb98aef tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:40.701044 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d4ea1908-9f11-45b7-823a-958a1eb98aef tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:40.701510 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d4ea1908-9f11-45b7-823a-958a1eb98aef tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:40.701944 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d4ea1908-9f11-45b7-823a-958a1eb98aef tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:40.837519 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-9da9faa6-600f-41c6-b7d6-fcf1d90d6d68 req-2c0a96da-8cd9-499b-8584-62e963c9330e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1623b9c-b818-43a2-9360-99751b436ec2", "name": "network-vif-plugged", "status": "completed", "tag": "7b318eca-bd27-4228-80b5-324494fde0c2"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:57:40.842174 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d4ea1908-9f11-45b7-823a-958a1eb98aef tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7228e15d12e442b0802ef033bc6158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d77247e9aa471eba23dcc9d2c30e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:57:40.849286 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-9da9faa6-600f-41c6-b7d6-fcf1d90d6d68 req-2c0a96da-8cd9-499b-8584-62e963c9330e service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:40.849986 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-9da9faa6-600f-41c6-b7d6-fcf1d90d6d68 req-2c0a96da-8cd9-499b-8584-62e963c9330e service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:40.850441 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-9da9faa6-600f-41c6-b7d6-fcf1d90d6d68 req-2c0a96da-8cd9-499b-8584-62e963c9330e service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:40.851696 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d4ea1908-9f11-45b7-823a-958a1eb98aef tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "GET /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2" status: 200 len: 1318 microversion: 2.1 time: 0.164383 Aug 31 16:57:40.852481 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3601/7218] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:57:40 2022] GET /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:57:40.866862 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-9da9faa6-600f-41c6-b7d6-fcf1d90d6d68 req-2c0a96da-8cd9-499b-8584-62e963c9330e service nova] Creating event network-vif-plugged:7b318eca-bd27-4228-80b5-324494fde0c2 for instance b1623b9c-b818-43a2-9360-99751b436ec2 on n-h1-850499-9 Aug 31 16:57:40.872830 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-9da9faa6-600f-41c6-b7d6-fcf1d90d6d68 req-2c0a96da-8cd9-499b-8584-62e963c9330e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040867 Aug 31 16:57:40.874235 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3618/7219] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:57:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:57:41.879098 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-edbfa7bd-0654-42fa-ae5e-34fe902ed53d tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:57:41.879098 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-edbfa7bd-0654-42fa-ae5e-34fe902ed53d tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: b1623b9c-b818-43a2-9360-99751b436ec2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:57:41.886104 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-edbfa7bd-0654-42fa-ae5e-34fe902ed53d tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:41.886600 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-edbfa7bd-0654-42fa-ae5e-34fe902ed53d tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:41.887082 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-edbfa7bd-0654-42fa-ae5e-34fe902ed53d tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:41.888030 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-edbfa7bd-0654-42fa-ae5e-34fe902ed53d tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:41.888496 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-edbfa7bd-0654-42fa-ae5e-34fe902ed53d tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:41.888931 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-edbfa7bd-0654-42fa-ae5e-34fe902ed53d tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:42.032507 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-edbfa7bd-0654-42fa-ae5e-34fe902ed53d tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7228e15d12e442b0802ef033bc6158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d77247e9aa471eba23dcc9d2c30e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:57:42.040495 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-edbfa7bd-0654-42fa-ae5e-34fe902ed53d tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "GET /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2" status: 200 len: 1318 microversion: 2.1 time: 0.165983 Aug 31 16:57:42.041098 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3602/7220] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:57:41 2022] GET /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:57:43.060253 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:57:43.061281 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=6 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:57:43.066073 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3be133cd-25ee-4d83-9197-3a0cd2f28535 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:57:43.067005 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3be133cd-25ee-4d83-9197-3a0cd2f28535 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: b1623b9c-b818-43a2-9360-99751b436ec2] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:57:43.075351 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3be133cd-25ee-4d83-9197-3a0cd2f28535 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:43.075969 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3be133cd-25ee-4d83-9197-3a0cd2f28535 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:43.076431 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3be133cd-25ee-4d83-9197-3a0cd2f28535 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:43.077184 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3be133cd-25ee-4d83-9197-3a0cd2f28535 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:43.077670 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3be133cd-25ee-4d83-9197-3a0cd2f28535 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:43.078122 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3be133cd-25ee-4d83-9197-3a0cd2f28535 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:43.208839 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3be133cd-25ee-4d83-9197-3a0cd2f28535 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7228e15d12e442b0802ef033bc6158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d77247e9aa471eba23dcc9d2c30e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:57:43.217804 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3be133cd-25ee-4d83-9197-3a0cd2f28535 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "GET /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2" status: 200 len: 1507 microversion: 2.1 time: 0.159443 Aug 31 16:57:43.218388 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3619/7221] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:57:43 2022] GET /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2 => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:57:43.237983 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-79986577-62ff-4069-a063-620c925e7330 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:57:43.238521 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-79986577-62ff-4069-a063-620c925e7330 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: b1623b9c-b818-43a2-9360-99751b436ec2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:57:43.240487 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:57:43.246612 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-79986577-62ff-4069-a063-620c925e7330 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:43.247261 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-79986577-62ff-4069-a063-620c925e7330 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:43.247739 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-79986577-62ff-4069-a063-620c925e7330 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:43.248448 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-79986577-62ff-4069-a063-620c925e7330 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:43.249174 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-79986577-62ff-4069-a063-620c925e7330 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:43.249609 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-79986577-62ff-4069-a063-620c925e7330 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:43.380123 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-79986577-62ff-4069-a063-620c925e7330 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7228e15d12e442b0802ef033bc6158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d77247e9aa471eba23dcc9d2c30e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:57:43.388384 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-79986577-62ff-4069-a063-620c925e7330 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "GET /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2" status: 200 len: 1507 microversion: 2.1 time: 0.154351 Aug 31 16:57:43.388968 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3603/7222] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:57:43 2022] GET /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2 => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:57:43.413017 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f6e9410f-fe2d-4a83-bf32-0f8c3239b617 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:57:43.415914 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f6e9410f-fe2d-4a83-bf32-0f8c3239b617 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: b1623b9c-b818-43a2-9360-99751b436ec2] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:57:43.422588 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f6e9410f-fe2d-4a83-bf32-0f8c3239b617 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:43.423085 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f6e9410f-fe2d-4a83-bf32-0f8c3239b617 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:43.423558 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f6e9410f-fe2d-4a83-bf32-0f8c3239b617 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:43.424261 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f6e9410f-fe2d-4a83-bf32-0f8c3239b617 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:43.424729 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f6e9410f-fe2d-4a83-bf32-0f8c3239b617 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:43.425165 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f6e9410f-fe2d-4a83-bf32-0f8c3239b617 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:43.488931 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f6e9410f-fe2d-4a83-bf32-0f8c3239b617 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "PUT /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2" status: 200 len: 1079 microversion: 2.1 time: 0.083602 Aug 31 16:57:43.489496 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3620/7223] 10.222.0.61 () {60 vars in 1256 bytes} [Wed Aug 31 16:57:43 2022] PUT /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2 => generated 1079 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:57:43.507086 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-298c3e07-cc92-49a8-a5c0-452935b3f93f tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:57:43.507736 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-298c3e07-cc92-49a8-a5c0-452935b3f93f tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: b1623b9c-b818-43a2-9360-99751b436ec2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:57:43.514406 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-298c3e07-cc92-49a8-a5c0-452935b3f93f tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:43.514896 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-298c3e07-cc92-49a8-a5c0-452935b3f93f tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:43.515338 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-298c3e07-cc92-49a8-a5c0-452935b3f93f tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:43.516076 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-298c3e07-cc92-49a8-a5c0-452935b3f93f tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:43.516536 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-298c3e07-cc92-49a8-a5c0-452935b3f93f tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:43.516969 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-298c3e07-cc92-49a8-a5c0-452935b3f93f tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:43.651559 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-298c3e07-cc92-49a8-a5c0-452935b3f93f tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7228e15d12e442b0802ef033bc6158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d77247e9aa471eba23dcc9d2c30e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:57:43.659638 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-298c3e07-cc92-49a8-a5c0-452935b3f93f tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "GET /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2" status: 200 len: 1505 microversion: 2.1 time: 0.156532 Aug 31 16:57:43.660247 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3604/7224] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:57:43 2022] GET /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2 => generated 1505 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:57:43.680100 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-64c2a64a-1819-4ad6-80f7-c502cceae360 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:57:43.680737 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-64c2a64a-1819-4ad6-80f7-c502cceae360 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: b1623b9c-b818-43a2-9360-99751b436ec2] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:57:43.687446 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-64c2a64a-1819-4ad6-80f7-c502cceae360 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:43.687985 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-64c2a64a-1819-4ad6-80f7-c502cceae360 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:43.688467 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-64c2a64a-1819-4ad6-80f7-c502cceae360 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:43.689857 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-64c2a64a-1819-4ad6-80f7-c502cceae360 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:43.690462 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-64c2a64a-1819-4ad6-80f7-c502cceae360 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:43.690931 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-64c2a64a-1819-4ad6-80f7-c502cceae360 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:43.825504 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-64c2a64a-1819-4ad6-80f7-c502cceae360 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7228e15d12e442b0802ef033bc6158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d77247e9aa471eba23dcc9d2c30e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:57:43.833379 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-64c2a64a-1819-4ad6-80f7-c502cceae360 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "GET /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2" status: 200 len: 1505 microversion: 2.1 time: 0.157242 Aug 31 16:57:43.833960 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3621/7225] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:57:43 2022] GET /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2 => generated 1505 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:57:43.853181 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-686ae5c1-10c7-4766-834c-2583e0c9b1dc tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:57:43.855522 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-686ae5c1-10c7-4766-834c-2583e0c9b1dc tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: b1623b9c-b818-43a2-9360-99751b436ec2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:57:43.862202 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-686ae5c1-10c7-4766-834c-2583e0c9b1dc tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:43.862690 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-686ae5c1-10c7-4766-834c-2583e0c9b1dc tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:43.863127 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-686ae5c1-10c7-4766-834c-2583e0c9b1dc tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:43.863848 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-686ae5c1-10c7-4766-834c-2583e0c9b1dc tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:43.864303 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-686ae5c1-10c7-4766-834c-2583e0c9b1dc tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:43.864728 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-686ae5c1-10c7-4766-834c-2583e0c9b1dc tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:43.893888 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-686ae5c1-10c7-4766-834c-2583e0c9b1dc tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '7228e15d12e442b0802ef033bc6158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d77247e9aa471eba23dcc9d2c30e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:57:43.899557 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-686ae5c1-10c7-4766-834c-2583e0c9b1dc tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: b1623b9c-b818-43a2-9360-99751b436ec2] Old instance type m1.heat2, new instance type m1.heat {{(pid=122256) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 31 16:57:43.906681 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-686ae5c1-10c7-4766-834c-2583e0c9b1dc tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:57:43.907102 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-686ae5c1-10c7-4766-834c-2583e0c9b1dc tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:57:43.907687 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-686ae5c1-10c7-4766-834c-2583e0c9b1dc tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:57:43.908103 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-686ae5c1-10c7-4766-834c-2583e0c9b1dc tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:57:43.908513 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-686ae5c1-10c7-4766-834c-2583e0c9b1dc tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:57:43.971995 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-686ae5c1-10c7-4766-834c-2583e0c9b1dc tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "POST /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2/action" status: 202 len: 0 microversion: 2.1 time: 0.122687 Aug 31 16:57:43.972611 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3605/7226] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:57:43 2022] POST /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:57:43.981696 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f4d8f68d-3cfa-4d14-bf36-896ba0620aa0 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:57:43.983035 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f4d8f68d-3cfa-4d14-bf36-896ba0620aa0 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: b1623b9c-b818-43a2-9360-99751b436ec2] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:57:43.989642 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f4d8f68d-3cfa-4d14-bf36-896ba0620aa0 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:43.990926 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f4d8f68d-3cfa-4d14-bf36-896ba0620aa0 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:43.991413 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f4d8f68d-3cfa-4d14-bf36-896ba0620aa0 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:43.992169 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f4d8f68d-3cfa-4d14-bf36-896ba0620aa0 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:43.993360 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f4d8f68d-3cfa-4d14-bf36-896ba0620aa0 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:43.993808 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f4d8f68d-3cfa-4d14-bf36-896ba0620aa0 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:44.158709 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f4d8f68d-3cfa-4d14-bf36-896ba0620aa0 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7228e15d12e442b0802ef033bc6158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d77247e9aa471eba23dcc9d2c30e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:57:44.167598 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f4d8f68d-3cfa-4d14-bf36-896ba0620aa0 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "GET /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2" status: 200 len: 1516 microversion: 2.1 time: 0.190635 Aug 31 16:57:44.168500 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3622/7227] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:57:43 2022] GET /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2 => generated 1516 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:57:45.190751 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6713dc80-f3de-450f-b86b-8786a535b242 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:57:45.191378 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6713dc80-f3de-450f-b86b-8786a535b242 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: b1623b9c-b818-43a2-9360-99751b436ec2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:57:45.201768 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6713dc80-f3de-450f-b86b-8786a535b242 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:45.202265 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6713dc80-f3de-450f-b86b-8786a535b242 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:45.202714 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6713dc80-f3de-450f-b86b-8786a535b242 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:45.203422 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6713dc80-f3de-450f-b86b-8786a535b242 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:45.203917 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6713dc80-f3de-450f-b86b-8786a535b242 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:45.204353 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6713dc80-f3de-450f-b86b-8786a535b242 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:45.337676 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-6713dc80-f3de-450f-b86b-8786a535b242 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7228e15d12e442b0802ef033bc6158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d77247e9aa471eba23dcc9d2c30e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:57:45.345678 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6713dc80-f3de-450f-b86b-8786a535b242 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "GET /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2" status: 200 len: 1516 microversion: 2.1 time: 0.160488 Aug 31 16:57:45.346253 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3606/7228] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:57:45 2022] GET /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2 => generated 1516 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:57:46.367775 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4f780ef6-2d42-4a8e-8a7f-62837f88a39e tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:57:46.368407 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4f780ef6-2d42-4a8e-8a7f-62837f88a39e tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: b1623b9c-b818-43a2-9360-99751b436ec2] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:57:46.375634 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4f780ef6-2d42-4a8e-8a7f-62837f88a39e tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:46.376142 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4f780ef6-2d42-4a8e-8a7f-62837f88a39e tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:46.376594 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4f780ef6-2d42-4a8e-8a7f-62837f88a39e tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:46.377339 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4f780ef6-2d42-4a8e-8a7f-62837f88a39e tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:46.377813 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4f780ef6-2d42-4a8e-8a7f-62837f88a39e tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:46.378254 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4f780ef6-2d42-4a8e-8a7f-62837f88a39e tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:46.516872 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-4f780ef6-2d42-4a8e-8a7f-62837f88a39e tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7228e15d12e442b0802ef033bc6158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d77247e9aa471eba23dcc9d2c30e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:57:46.524690 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4f780ef6-2d42-4a8e-8a7f-62837f88a39e tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "GET /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2" status: 200 len: 1521 microversion: 2.1 time: 0.161020 Aug 31 16:57:46.525264 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3623/7229] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:57:46 2022] GET /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:57:47.545830 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a6ef1888-3eec-41fe-b3a2-f684ea3a1312 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:57:47.546559 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a6ef1888-3eec-41fe-b3a2-f684ea3a1312 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: b1623b9c-b818-43a2-9360-99751b436ec2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:57:47.553313 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a6ef1888-3eec-41fe-b3a2-f684ea3a1312 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:47.553796 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a6ef1888-3eec-41fe-b3a2-f684ea3a1312 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:47.554234 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a6ef1888-3eec-41fe-b3a2-f684ea3a1312 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:47.554925 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a6ef1888-3eec-41fe-b3a2-f684ea3a1312 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:47.555379 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a6ef1888-3eec-41fe-b3a2-f684ea3a1312 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:47.555837 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a6ef1888-3eec-41fe-b3a2-f684ea3a1312 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:47.685742 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a6ef1888-3eec-41fe-b3a2-f684ea3a1312 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7228e15d12e442b0802ef033bc6158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d77247e9aa471eba23dcc9d2c30e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:57:47.693544 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a6ef1888-3eec-41fe-b3a2-f684ea3a1312 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "GET /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2" status: 200 len: 1521 microversion: 2.1 time: 0.152556 Aug 31 16:57:47.694122 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3607/7230] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:57:47 2022] GET /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:57:48.714631 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-94bedd45-b304-4237-aa4b-d2a87c7d7588 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:57:48.715739 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-94bedd45-b304-4237-aa4b-d2a87c7d7588 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: b1623b9c-b818-43a2-9360-99751b436ec2] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:57:48.722377 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-94bedd45-b304-4237-aa4b-d2a87c7d7588 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:48.722890 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-94bedd45-b304-4237-aa4b-d2a87c7d7588 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:48.723343 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-94bedd45-b304-4237-aa4b-d2a87c7d7588 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:48.724088 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-94bedd45-b304-4237-aa4b-d2a87c7d7588 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:48.724572 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-94bedd45-b304-4237-aa4b-d2a87c7d7588 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:48.725016 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-94bedd45-b304-4237-aa4b-d2a87c7d7588 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:48.854975 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-94bedd45-b304-4237-aa4b-d2a87c7d7588 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7228e15d12e442b0802ef033bc6158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d77247e9aa471eba23dcc9d2c30e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:57:48.863084 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-94bedd45-b304-4237-aa4b-d2a87c7d7588 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "GET /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2" status: 200 len: 1521 microversion: 2.1 time: 0.152617 Aug 31 16:57:48.863715 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3624/7231] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:57:48 2022] GET /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:57:49.885241 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2403ae1f-9356-4d39-a700-ea27b6c6c640 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:57:49.885855 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2403ae1f-9356-4d39-a700-ea27b6c6c640 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: b1623b9c-b818-43a2-9360-99751b436ec2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:57:49.892979 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2403ae1f-9356-4d39-a700-ea27b6c6c640 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:49.893468 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2403ae1f-9356-4d39-a700-ea27b6c6c640 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:49.893910 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2403ae1f-9356-4d39-a700-ea27b6c6c640 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:49.894602 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2403ae1f-9356-4d39-a700-ea27b6c6c640 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:49.895064 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2403ae1f-9356-4d39-a700-ea27b6c6c640 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:49.895516 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2403ae1f-9356-4d39-a700-ea27b6c6c640 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:50.033079 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-2403ae1f-9356-4d39-a700-ea27b6c6c640 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7228e15d12e442b0802ef033bc6158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d77247e9aa471eba23dcc9d2c30e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:57:50.040864 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2403ae1f-9356-4d39-a700-ea27b6c6c640 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "GET /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2" status: 200 len: 1521 microversion: 2.1 time: 0.159585 Aug 31 16:57:50.041437 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3608/7232] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:57:49 2022] GET /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:57:51.063372 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e70c1976-ca98-4aed-b143-a6b1f9ffc367 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:57:51.064047 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e70c1976-ca98-4aed-b143-a6b1f9ffc367 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: b1623b9c-b818-43a2-9360-99751b436ec2] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:57:51.071880 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e70c1976-ca98-4aed-b143-a6b1f9ffc367 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:51.072319 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e70c1976-ca98-4aed-b143-a6b1f9ffc367 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:51.072780 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e70c1976-ca98-4aed-b143-a6b1f9ffc367 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:51.073504 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e70c1976-ca98-4aed-b143-a6b1f9ffc367 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:51.073984 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e70c1976-ca98-4aed-b143-a6b1f9ffc367 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:51.075197 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e70c1976-ca98-4aed-b143-a6b1f9ffc367 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:51.208871 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e70c1976-ca98-4aed-b143-a6b1f9ffc367 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7228e15d12e442b0802ef033bc6158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d77247e9aa471eba23dcc9d2c30e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:57:51.216822 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e70c1976-ca98-4aed-b143-a6b1f9ffc367 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "GET /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2" status: 200 len: 1521 microversion: 2.1 time: 0.158372 Aug 31 16:57:51.217391 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3625/7233] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:57:51 2022] GET /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:57:52.237812 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-606790b0-f5cd-4abe-89e9-c4f4a7567e9e tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:57:52.238458 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-606790b0-f5cd-4abe-89e9-c4f4a7567e9e tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: b1623b9c-b818-43a2-9360-99751b436ec2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:57:52.245341 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-606790b0-f5cd-4abe-89e9-c4f4a7567e9e tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:52.245840 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-606790b0-f5cd-4abe-89e9-c4f4a7567e9e tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:52.246969 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-606790b0-f5cd-4abe-89e9-c4f4a7567e9e tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:52.247684 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-606790b0-f5cd-4abe-89e9-c4f4a7567e9e tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:52.248147 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-606790b0-f5cd-4abe-89e9-c4f4a7567e9e tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:52.248579 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-606790b0-f5cd-4abe-89e9-c4f4a7567e9e tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:52.387855 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-606790b0-f5cd-4abe-89e9-c4f4a7567e9e tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7228e15d12e442b0802ef033bc6158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d77247e9aa471eba23dcc9d2c30e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:57:52.395812 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-606790b0-f5cd-4abe-89e9-c4f4a7567e9e tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "GET /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2" status: 200 len: 1521 microversion: 2.1 time: 0.161795 Aug 31 16:57:52.396389 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3609/7234] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:57:52 2022] GET /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:57:53.416715 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-91c5b7a7-affd-47b1-832f-4df456e11217 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:57:53.417353 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-91c5b7a7-affd-47b1-832f-4df456e11217 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: b1623b9c-b818-43a2-9360-99751b436ec2] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:57:53.424483 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-91c5b7a7-affd-47b1-832f-4df456e11217 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:53.424993 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-91c5b7a7-affd-47b1-832f-4df456e11217 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:53.425455 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-91c5b7a7-affd-47b1-832f-4df456e11217 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:53.426172 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-91c5b7a7-affd-47b1-832f-4df456e11217 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:53.426649 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-91c5b7a7-affd-47b1-832f-4df456e11217 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:53.427101 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-91c5b7a7-affd-47b1-832f-4df456e11217 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:53.559644 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-91c5b7a7-affd-47b1-832f-4df456e11217 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7228e15d12e442b0802ef033bc6158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d77247e9aa471eba23dcc9d2c30e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:57:53.567671 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-91c5b7a7-affd-47b1-832f-4df456e11217 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "GET /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2" status: 200 len: 1521 microversion: 2.1 time: 0.154821 Aug 31 16:57:53.568408 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3626/7235] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:57:53 2022] GET /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:57:54.590815 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8aab7ffb-2430-42f9-b01b-8d06a2ebad15 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:57:54.591438 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8aab7ffb-2430-42f9-b01b-8d06a2ebad15 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: b1623b9c-b818-43a2-9360-99751b436ec2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:57:54.598503 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8aab7ffb-2430-42f9-b01b-8d06a2ebad15 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:54.599021 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8aab7ffb-2430-42f9-b01b-8d06a2ebad15 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:54.599446 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8aab7ffb-2430-42f9-b01b-8d06a2ebad15 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:54.600169 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8aab7ffb-2430-42f9-b01b-8d06a2ebad15 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:54.600635 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8aab7ffb-2430-42f9-b01b-8d06a2ebad15 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:54.601070 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8aab7ffb-2430-42f9-b01b-8d06a2ebad15 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:54.734793 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8aab7ffb-2430-42f9-b01b-8d06a2ebad15 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7228e15d12e442b0802ef033bc6158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d77247e9aa471eba23dcc9d2c30e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:57:54.742588 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8aab7ffb-2430-42f9-b01b-8d06a2ebad15 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "GET /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2" status: 200 len: 1521 microversion: 2.1 time: 0.156332 Aug 31 16:57:54.743168 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3610/7236] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:57:54 2022] GET /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:57:55.765334 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1843b858-4777-42cb-b1de-55ae8d964009 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:57:55.765993 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1843b858-4777-42cb-b1de-55ae8d964009 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: b1623b9c-b818-43a2-9360-99751b436ec2] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:57:55.775046 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1843b858-4777-42cb-b1de-55ae8d964009 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:55.776196 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1843b858-4777-42cb-b1de-55ae8d964009 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:55.777241 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1843b858-4777-42cb-b1de-55ae8d964009 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:55.778517 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1843b858-4777-42cb-b1de-55ae8d964009 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:55.778993 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1843b858-4777-42cb-b1de-55ae8d964009 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:55.779440 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1843b858-4777-42cb-b1de-55ae8d964009 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:55.915014 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-1843b858-4777-42cb-b1de-55ae8d964009 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7228e15d12e442b0802ef033bc6158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d77247e9aa471eba23dcc9d2c30e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:57:55.923558 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1843b858-4777-42cb-b1de-55ae8d964009 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "GET /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2" status: 200 len: 1521 microversion: 2.1 time: 0.163452 Aug 31 16:57:55.924136 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3627/7237] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:57:55 2022] GET /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:57:56.944929 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0d8994f5-f6e1-42de-a8bc-c2269e07a21f tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:57:56.945543 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0d8994f5-f6e1-42de-a8bc-c2269e07a21f tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: b1623b9c-b818-43a2-9360-99751b436ec2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:57:56.952444 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0d8994f5-f6e1-42de-a8bc-c2269e07a21f tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:56.952934 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0d8994f5-f6e1-42de-a8bc-c2269e07a21f tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:56.953374 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0d8994f5-f6e1-42de-a8bc-c2269e07a21f tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:56.954068 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0d8994f5-f6e1-42de-a8bc-c2269e07a21f tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:56.954537 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0d8994f5-f6e1-42de-a8bc-c2269e07a21f tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:56.954967 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0d8994f5-f6e1-42de-a8bc-c2269e07a21f tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:57.085269 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-0d8994f5-f6e1-42de-a8bc-c2269e07a21f tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7228e15d12e442b0802ef033bc6158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d77247e9aa471eba23dcc9d2c30e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:57:57.093689 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0d8994f5-f6e1-42de-a8bc-c2269e07a21f tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "GET /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2" status: 200 len: 1521 microversion: 2.1 time: 0.152645 Aug 31 16:57:57.094259 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3611/7238] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:57:56 2022] GET /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:57:58.114736 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f3d728af-2036-4203-a0f4-d221ec26d1ef tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:57:58.115369 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f3d728af-2036-4203-a0f4-d221ec26d1ef tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: b1623b9c-b818-43a2-9360-99751b436ec2] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:57:58.123563 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f3d728af-2036-4203-a0f4-d221ec26d1ef tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:58.124334 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f3d728af-2036-4203-a0f4-d221ec26d1ef tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:58.124799 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f3d728af-2036-4203-a0f4-d221ec26d1ef tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:58.125521 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f3d728af-2036-4203-a0f4-d221ec26d1ef tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:58.126002 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f3d728af-2036-4203-a0f4-d221ec26d1ef tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:58.126457 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f3d728af-2036-4203-a0f4-d221ec26d1ef tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:58.258907 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f3d728af-2036-4203-a0f4-d221ec26d1ef tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7228e15d12e442b0802ef033bc6158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d77247e9aa471eba23dcc9d2c30e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:57:58.267241 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f3d728af-2036-4203-a0f4-d221ec26d1ef tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "GET /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2" status: 200 len: 1521 microversion: 2.1 time: 0.156444 Aug 31 16:57:58.268076 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3628/7239] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:57:58 2022] GET /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:57:59.289345 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ea857579-e6a9-4c5c-9f8c-0e21ad2f3d8d tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:57:59.289966 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ea857579-e6a9-4c5c-9f8c-0e21ad2f3d8d tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: b1623b9c-b818-43a2-9360-99751b436ec2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:57:59.297450 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ea857579-e6a9-4c5c-9f8c-0e21ad2f3d8d tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:59.297944 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ea857579-e6a9-4c5c-9f8c-0e21ad2f3d8d tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:59.298382 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ea857579-e6a9-4c5c-9f8c-0e21ad2f3d8d tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:59.299105 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ea857579-e6a9-4c5c-9f8c-0e21ad2f3d8d tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:59.299585 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ea857579-e6a9-4c5c-9f8c-0e21ad2f3d8d tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:59.300012 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ea857579-e6a9-4c5c-9f8c-0e21ad2f3d8d tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:59.434533 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ea857579-e6a9-4c5c-9f8c-0e21ad2f3d8d tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7228e15d12e442b0802ef033bc6158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d77247e9aa471eba23dcc9d2c30e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:57:59.442400 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ea857579-e6a9-4c5c-9f8c-0e21ad2f3d8d tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "GET /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2" status: 200 len: 1521 microversion: 2.1 time: 0.157008 Aug 31 16:57:59.442981 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3612/7240] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:57:59 2022] GET /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:58:00.464132 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ce33d456-db62-485f-9055-70311720825b tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:58:00.464778 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ce33d456-db62-485f-9055-70311720825b tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: b1623b9c-b818-43a2-9360-99751b436ec2] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:58:00.472171 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ce33d456-db62-485f-9055-70311720825b tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:00.472987 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ce33d456-db62-485f-9055-70311720825b tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:00.473121 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ce33d456-db62-485f-9055-70311720825b tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:00.473925 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ce33d456-db62-485f-9055-70311720825b tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:00.474338 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ce33d456-db62-485f-9055-70311720825b tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:00.474779 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ce33d456-db62-485f-9055-70311720825b tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:00.609428 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ce33d456-db62-485f-9055-70311720825b tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7228e15d12e442b0802ef033bc6158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d77247e9aa471eba23dcc9d2c30e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:58:00.617259 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ce33d456-db62-485f-9055-70311720825b tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "GET /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2" status: 200 len: 1521 microversion: 2.1 time: 0.157045 Aug 31 16:58:00.617831 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3629/7241] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:58:00 2022] GET /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:58:01.640861 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-38ccf1b9-4224-40a6-acdf-7e082e0b4b84 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:58:01.641479 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-38ccf1b9-4224-40a6-acdf-7e082e0b4b84 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: b1623b9c-b818-43a2-9360-99751b436ec2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:58:01.648386 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-38ccf1b9-4224-40a6-acdf-7e082e0b4b84 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:01.648792 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-38ccf1b9-4224-40a6-acdf-7e082e0b4b84 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:01.649232 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-38ccf1b9-4224-40a6-acdf-7e082e0b4b84 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:01.649927 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-38ccf1b9-4224-40a6-acdf-7e082e0b4b84 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:01.650392 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-38ccf1b9-4224-40a6-acdf-7e082e0b4b84 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:01.650828 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-38ccf1b9-4224-40a6-acdf-7e082e0b4b84 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:01.654961 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:58:01.783519 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-38ccf1b9-4224-40a6-acdf-7e082e0b4b84 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7228e15d12e442b0802ef033bc6158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d77247e9aa471eba23dcc9d2c30e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:58:01.791451 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-38ccf1b9-4224-40a6-acdf-7e082e0b4b84 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "GET /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2" status: 200 len: 1521 microversion: 2.1 time: 0.155308 Aug 31 16:58:01.792074 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3613/7242] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:58:01 2022] GET /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:58:02.813370 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7a943768-fda8-47dc-9302-b8b3280a41d3 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:58:02.814013 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7a943768-fda8-47dc-9302-b8b3280a41d3 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: b1623b9c-b818-43a2-9360-99751b436ec2] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:58:02.821059 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7a943768-fda8-47dc-9302-b8b3280a41d3 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:02.821569 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7a943768-fda8-47dc-9302-b8b3280a41d3 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:02.822050 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7a943768-fda8-47dc-9302-b8b3280a41d3 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:02.822754 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7a943768-fda8-47dc-9302-b8b3280a41d3 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:02.823240 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7a943768-fda8-47dc-9302-b8b3280a41d3 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:02.823729 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7a943768-fda8-47dc-9302-b8b3280a41d3 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:02.957605 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7a943768-fda8-47dc-9302-b8b3280a41d3 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7228e15d12e442b0802ef033bc6158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d77247e9aa471eba23dcc9d2c30e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:58:02.965943 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7a943768-fda8-47dc-9302-b8b3280a41d3 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "GET /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2" status: 200 len: 1521 microversion: 2.1 time: 0.157111 Aug 31 16:58:02.966514 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3630/7243] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:58:02 2022] GET /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:58:03.987438 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c95b0589-7a3f-4c34-807b-be7ff316e83f tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:58:03.988080 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c95b0589-7a3f-4c34-807b-be7ff316e83f tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: b1623b9c-b818-43a2-9360-99751b436ec2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:58:03.994862 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c95b0589-7a3f-4c34-807b-be7ff316e83f tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:03.995347 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c95b0589-7a3f-4c34-807b-be7ff316e83f tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:03.995825 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c95b0589-7a3f-4c34-807b-be7ff316e83f tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:03.996645 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c95b0589-7a3f-4c34-807b-be7ff316e83f tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:03.997094 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c95b0589-7a3f-4c34-807b-be7ff316e83f tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:03.997518 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c95b0589-7a3f-4c34-807b-be7ff316e83f tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:04.131817 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c95b0589-7a3f-4c34-807b-be7ff316e83f tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7228e15d12e442b0802ef033bc6158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d77247e9aa471eba23dcc9d2c30e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:58:04.140716 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c95b0589-7a3f-4c34-807b-be7ff316e83f tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "GET /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2" status: 200 len: 1521 microversion: 2.1 time: 0.157071 Aug 31 16:58:04.146089 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3614/7244] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:58:03 2022] GET /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:58:05.168600 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-feaaab82-b1c3-4aa2-8744-d57c3dbecc7e tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:58:05.169255 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-feaaab82-b1c3-4aa2-8744-d57c3dbecc7e tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: b1623b9c-b818-43a2-9360-99751b436ec2] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:58:05.176343 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-feaaab82-b1c3-4aa2-8744-d57c3dbecc7e tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:05.176848 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-feaaab82-b1c3-4aa2-8744-d57c3dbecc7e tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:05.177310 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-feaaab82-b1c3-4aa2-8744-d57c3dbecc7e tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:05.178028 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-feaaab82-b1c3-4aa2-8744-d57c3dbecc7e tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:05.178510 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-feaaab82-b1c3-4aa2-8744-d57c3dbecc7e tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:05.178964 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-feaaab82-b1c3-4aa2-8744-d57c3dbecc7e tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:05.313346 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-feaaab82-b1c3-4aa2-8744-d57c3dbecc7e tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7228e15d12e442b0802ef033bc6158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d77247e9aa471eba23dcc9d2c30e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:58:05.322965 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-feaaab82-b1c3-4aa2-8744-d57c3dbecc7e tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "GET /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2" status: 200 len: 1521 microversion: 2.1 time: 0.159062 Aug 31 16:58:05.323593 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3631/7245] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:58:05 2022] GET /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:58:06.345010 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9daeb246-9323-4a63-8b1f-d04efed6eef3 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:58:06.345634 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9daeb246-9323-4a63-8b1f-d04efed6eef3 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: b1623b9c-b818-43a2-9360-99751b436ec2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:58:06.352523 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9daeb246-9323-4a63-8b1f-d04efed6eef3 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:06.353015 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9daeb246-9323-4a63-8b1f-d04efed6eef3 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:06.353453 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9daeb246-9323-4a63-8b1f-d04efed6eef3 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:06.354154 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9daeb246-9323-4a63-8b1f-d04efed6eef3 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:06.354633 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9daeb246-9323-4a63-8b1f-d04efed6eef3 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:06.355060 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9daeb246-9323-4a63-8b1f-d04efed6eef3 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:06.491178 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-9daeb246-9323-4a63-8b1f-d04efed6eef3 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7228e15d12e442b0802ef033bc6158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d77247e9aa471eba23dcc9d2c30e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:58:06.499712 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9daeb246-9323-4a63-8b1f-d04efed6eef3 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "GET /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2" status: 200 len: 1521 microversion: 2.1 time: 0.158341 Aug 31 16:58:06.500299 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3615/7246] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:58:06 2022] GET /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:58:07.522033 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b8ea3585-9ece-4f07-b9ca-c0151eedaf2e tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:58:07.522669 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b8ea3585-9ece-4f07-b9ca-c0151eedaf2e tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: b1623b9c-b818-43a2-9360-99751b436ec2] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:58:07.525505 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=34 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:58:07.531109 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b8ea3585-9ece-4f07-b9ca-c0151eedaf2e tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:07.531637 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b8ea3585-9ece-4f07-b9ca-c0151eedaf2e tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:07.532089 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b8ea3585-9ece-4f07-b9ca-c0151eedaf2e tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:07.532799 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b8ea3585-9ece-4f07-b9ca-c0151eedaf2e tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:07.533268 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b8ea3585-9ece-4f07-b9ca-c0151eedaf2e tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:07.533712 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b8ea3585-9ece-4f07-b9ca-c0151eedaf2e tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:07.537720 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:58:07.663044 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b8ea3585-9ece-4f07-b9ca-c0151eedaf2e tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7228e15d12e442b0802ef033bc6158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d77247e9aa471eba23dcc9d2c30e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:58:07.672262 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b8ea3585-9ece-4f07-b9ca-c0151eedaf2e tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "GET /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2" status: 200 len: 1521 microversion: 2.1 time: 0.154893 Aug 31 16:58:07.672765 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3632/7247] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:58:07 2022] GET /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:58:08.693221 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ddd89bbb-4941-4555-92e3-81f5df012370 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:58:08.693839 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ddd89bbb-4941-4555-92e3-81f5df012370 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: b1623b9c-b818-43a2-9360-99751b436ec2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:58:08.696581 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=36 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:58:08.702557 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ddd89bbb-4941-4555-92e3-81f5df012370 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:08.703083 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ddd89bbb-4941-4555-92e3-81f5df012370 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:08.703585 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ddd89bbb-4941-4555-92e3-81f5df012370 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:08.704343 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ddd89bbb-4941-4555-92e3-81f5df012370 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:08.704761 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ddd89bbb-4941-4555-92e3-81f5df012370 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:08.705197 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ddd89bbb-4941-4555-92e3-81f5df012370 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:08.835446 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ddd89bbb-4941-4555-92e3-81f5df012370 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7228e15d12e442b0802ef033bc6158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d77247e9aa471eba23dcc9d2c30e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:58:08.843335 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ddd89bbb-4941-4555-92e3-81f5df012370 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "GET /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2" status: 200 len: 1521 microversion: 2.1 time: 0.154078 Aug 31 16:58:08.843940 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3616/7248] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:58:08 2022] GET /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:58:09.865381 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-21ab7bce-ef89-45f8-aece-9efd1cb09935 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:58:09.866008 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-21ab7bce-ef89-45f8-aece-9efd1cb09935 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: b1623b9c-b818-43a2-9360-99751b436ec2] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:58:09.873432 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-21ab7bce-ef89-45f8-aece-9efd1cb09935 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:09.874208 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-21ab7bce-ef89-45f8-aece-9efd1cb09935 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:09.874719 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-21ab7bce-ef89-45f8-aece-9efd1cb09935 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:09.875430 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-21ab7bce-ef89-45f8-aece-9efd1cb09935 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:09.875929 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-21ab7bce-ef89-45f8-aece-9efd1cb09935 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:09.876372 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-21ab7bce-ef89-45f8-aece-9efd1cb09935 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:10.009868 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-21ab7bce-ef89-45f8-aece-9efd1cb09935 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7228e15d12e442b0802ef033bc6158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d77247e9aa471eba23dcc9d2c30e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:58:10.018400 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-21ab7bce-ef89-45f8-aece-9efd1cb09935 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "GET /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2" status: 200 len: 1521 microversion: 2.1 time: 0.157041 Aug 31 16:58:10.018994 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3633/7249] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:58:09 2022] GET /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:58:11.039064 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7ef95b2c-b7b3-4ead-ba87-fa0d95a16688 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:58:11.039767 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7ef95b2c-b7b3-4ead-ba87-fa0d95a16688 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: b1623b9c-b818-43a2-9360-99751b436ec2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:58:11.046751 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7ef95b2c-b7b3-4ead-ba87-fa0d95a16688 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:11.047250 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7ef95b2c-b7b3-4ead-ba87-fa0d95a16688 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:11.047745 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7ef95b2c-b7b3-4ead-ba87-fa0d95a16688 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:11.048449 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7ef95b2c-b7b3-4ead-ba87-fa0d95a16688 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:11.048912 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7ef95b2c-b7b3-4ead-ba87-fa0d95a16688 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:11.049347 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7ef95b2c-b7b3-4ead-ba87-fa0d95a16688 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:11.179275 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7ef95b2c-b7b3-4ead-ba87-fa0d95a16688 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7228e15d12e442b0802ef033bc6158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d77247e9aa471eba23dcc9d2c30e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:58:11.190143 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7ef95b2c-b7b3-4ead-ba87-fa0d95a16688 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "GET /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2" status: 200 len: 1521 microversion: 2.1 time: 0.154879 Aug 31 16:58:11.190826 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3617/7250] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:58:11 2022] GET /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:58:12.212057 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0997d5bd-9084-4b88-87d1-faaac2f3ca4d tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:58:12.212809 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0997d5bd-9084-4b88-87d1-faaac2f3ca4d tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: b1623b9c-b818-43a2-9360-99751b436ec2] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:58:12.220463 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0997d5bd-9084-4b88-87d1-faaac2f3ca4d tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:12.220981 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0997d5bd-9084-4b88-87d1-faaac2f3ca4d tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:12.221439 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0997d5bd-9084-4b88-87d1-faaac2f3ca4d tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:12.222159 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0997d5bd-9084-4b88-87d1-faaac2f3ca4d tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:12.222657 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0997d5bd-9084-4b88-87d1-faaac2f3ca4d tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:12.223105 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0997d5bd-9084-4b88-87d1-faaac2f3ca4d tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:12.356025 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0997d5bd-9084-4b88-87d1-faaac2f3ca4d tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7228e15d12e442b0802ef033bc6158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d77247e9aa471eba23dcc9d2c30e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:58:12.364506 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0997d5bd-9084-4b88-87d1-faaac2f3ca4d tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "GET /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2" status: 200 len: 1521 microversion: 2.1 time: 0.156148 Aug 31 16:58:12.365240 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3634/7251] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:58:12 2022] GET /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:58:13.388847 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-89d74eb2-4f7d-424d-a1b1-aaf9061cc6a9 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:58:13.390383 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-89d74eb2-4f7d-424d-a1b1-aaf9061cc6a9 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: b1623b9c-b818-43a2-9360-99751b436ec2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:58:13.396844 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-89d74eb2-4f7d-424d-a1b1-aaf9061cc6a9 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:13.397350 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-89d74eb2-4f7d-424d-a1b1-aaf9061cc6a9 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:13.397936 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-89d74eb2-4f7d-424d-a1b1-aaf9061cc6a9 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:13.398654 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-89d74eb2-4f7d-424d-a1b1-aaf9061cc6a9 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:13.399123 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-89d74eb2-4f7d-424d-a1b1-aaf9061cc6a9 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:13.399595 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-89d74eb2-4f7d-424d-a1b1-aaf9061cc6a9 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:13.466561 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-138ac49e-bf8b-43bb-a2e1-8523c5d5496d req-9daff4ea-6ef0-4c71-ada8-874ecf3ddceb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1623b9c-b818-43a2-9360-99751b436ec2", "name": "network-vif-unplugged", "status": "completed", "tag": "7b318eca-bd27-4228-80b5-324494fde0c2"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:58:13.477454 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-138ac49e-bf8b-43bb-a2e1-8523c5d5496d req-9daff4ea-6ef0-4c71-ada8-874ecf3ddceb service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:13.477981 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-138ac49e-bf8b-43bb-a2e1-8523c5d5496d req-9daff4ea-6ef0-4c71-ada8-874ecf3ddceb service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:13.478432 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-138ac49e-bf8b-43bb-a2e1-8523c5d5496d req-9daff4ea-6ef0-4c71-ada8-874ecf3ddceb service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:13.490908 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-138ac49e-bf8b-43bb-a2e1-8523c5d5496d req-9daff4ea-6ef0-4c71-ada8-874ecf3ddceb service nova] Creating event network-vif-unplugged:7b318eca-bd27-4228-80b5-324494fde0c2 for instance b1623b9c-b818-43a2-9360-99751b436ec2 on n-h2-850499-9 Aug 31 16:58:13.497660 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [req-138ac49e-bf8b-43bb-a2e1-8523c5d5496d req-9daff4ea-6ef0-4c71-ada8-874ecf3ddceb service nova] Instance b1623b9c-b818-43a2-9360-99751b436ec2 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850499-9', 'n-h1-850499-9'} {{(pid=122257) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 31 16:58:13.510113 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-138ac49e-bf8b-43bb-a2e1-8523c5d5496d req-9daff4ea-6ef0-4c71-ada8-874ecf3ddceb service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047519 Aug 31 16:58:13.510745 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3635/7252] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:58:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:58:13.662712 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-89d74eb2-4f7d-424d-a1b1-aaf9061cc6a9 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7228e15d12e442b0802ef033bc6158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d77247e9aa471eba23dcc9d2c30e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:58:13.670845 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-89d74eb2-4f7d-424d-a1b1-aaf9061cc6a9 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "GET /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2" status: 200 len: 1520 microversion: 2.1 time: 0.287282 Aug 31 16:58:13.671737 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3618/7253] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:58:13 2022] GET /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2 => generated 1520 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:58:14.695465 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-146bfe53-1122-4f09-a2a0-13829e4142c2 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:58:14.696144 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-146bfe53-1122-4f09-a2a0-13829e4142c2 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: b1623b9c-b818-43a2-9360-99751b436ec2] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:58:14.703684 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-146bfe53-1122-4f09-a2a0-13829e4142c2 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:14.703684 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-146bfe53-1122-4f09-a2a0-13829e4142c2 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:14.704103 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-146bfe53-1122-4f09-a2a0-13829e4142c2 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:14.704896 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-146bfe53-1122-4f09-a2a0-13829e4142c2 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:14.705510 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-146bfe53-1122-4f09-a2a0-13829e4142c2 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:14.705958 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-146bfe53-1122-4f09-a2a0-13829e4142c2 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:14.837792 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-146bfe53-1122-4f09-a2a0-13829e4142c2 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7228e15d12e442b0802ef033bc6158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d77247e9aa471eba23dcc9d2c30e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:58:14.845854 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-146bfe53-1122-4f09-a2a0-13829e4142c2 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "GET /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2" status: 200 len: 1518 microversion: 2.1 time: 0.156190 Aug 31 16:58:14.846437 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3636/7254] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:58:14 2022] GET /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2 => generated 1518 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:58:15.526576 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-dccdb465-a873-4ac1-912d-0c3a5985ab87 req-95baa210-f053-4a06-966f-28f2e4a593ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1623b9c-b818-43a2-9360-99751b436ec2", "tag": "7b318eca-bd27-4228-80b5-324494fde0c2"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:58:15.536787 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-dccdb465-a873-4ac1-912d-0c3a5985ab87 req-95baa210-f053-4a06-966f-28f2e4a593ab service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:15.537279 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-dccdb465-a873-4ac1-912d-0c3a5985ab87 req-95baa210-f053-4a06-966f-28f2e4a593ab service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:15.537723 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-dccdb465-a873-4ac1-912d-0c3a5985ab87 req-95baa210-f053-4a06-966f-28f2e4a593ab service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:15.549817 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-dccdb465-a873-4ac1-912d-0c3a5985ab87 req-95baa210-f053-4a06-966f-28f2e4a593ab service nova] Creating event network-changed:7b318eca-bd27-4228-80b5-324494fde0c2 for instance b1623b9c-b818-43a2-9360-99751b436ec2 on n-h2-850499-9 Aug 31 16:58:15.555078 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [req-dccdb465-a873-4ac1-912d-0c3a5985ab87 req-95baa210-f053-4a06-966f-28f2e4a593ab service nova] Instance b1623b9c-b818-43a2-9360-99751b436ec2 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850499-9', 'n-h1-850499-9'} {{(pid=122256) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 31 16:58:15.566264 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-dccdb465-a873-4ac1-912d-0c3a5985ab87 req-95baa210-f053-4a06-966f-28f2e4a593ab service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043693 Aug 31 16:58:15.566866 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3619/7255] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:58:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:58:15.868096 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-37a0736d-5f72-42e2-bbb7-fdb77fe6b08f tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:58:15.868722 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-37a0736d-5f72-42e2-bbb7-fdb77fe6b08f tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: b1623b9c-b818-43a2-9360-99751b436ec2] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:58:15.876705 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-37a0736d-5f72-42e2-bbb7-fdb77fe6b08f tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:15.877223 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-37a0736d-5f72-42e2-bbb7-fdb77fe6b08f tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:15.877685 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-37a0736d-5f72-42e2-bbb7-fdb77fe6b08f tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:15.878413 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-37a0736d-5f72-42e2-bbb7-fdb77fe6b08f tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:15.878914 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-37a0736d-5f72-42e2-bbb7-fdb77fe6b08f tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:15.879559 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-37a0736d-5f72-42e2-bbb7-fdb77fe6b08f tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:16.133073 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-37a0736d-5f72-42e2-bbb7-fdb77fe6b08f tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7228e15d12e442b0802ef033bc6158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d77247e9aa471eba23dcc9d2c30e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:58:16.141417 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-37a0736d-5f72-42e2-bbb7-fdb77fe6b08f tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "GET /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2" status: 200 len: 1518 microversion: 2.1 time: 0.277304 Aug 31 16:58:16.142136 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3637/7256] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:58:15 2022] GET /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2 => generated 1518 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:58:17.164416 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9d25ff36-4572-482f-9ed3-eb943b30dc59 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:58:17.165045 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9d25ff36-4572-482f-9ed3-eb943b30dc59 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: b1623b9c-b818-43a2-9360-99751b436ec2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:58:17.171919 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9d25ff36-4572-482f-9ed3-eb943b30dc59 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:17.172407 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9d25ff36-4572-482f-9ed3-eb943b30dc59 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:17.172856 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9d25ff36-4572-482f-9ed3-eb943b30dc59 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:17.173553 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9d25ff36-4572-482f-9ed3-eb943b30dc59 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:17.174134 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9d25ff36-4572-482f-9ed3-eb943b30dc59 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:17.174548 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9d25ff36-4572-482f-9ed3-eb943b30dc59 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:17.305444 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-9d25ff36-4572-482f-9ed3-eb943b30dc59 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7228e15d12e442b0802ef033bc6158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d77247e9aa471eba23dcc9d2c30e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:58:17.313305 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9d25ff36-4572-482f-9ed3-eb943b30dc59 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "GET /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2" status: 200 len: 1518 microversion: 2.1 time: 0.154254 Aug 31 16:58:17.313909 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3620/7257] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:58:17 2022] GET /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2 => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:58:18.335959 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-321649c6-b451-47ae-af18-f0e736f534d6 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:58:18.336502 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-321649c6-b451-47ae-af18-f0e736f534d6 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: b1623b9c-b818-43a2-9360-99751b436ec2] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:58:18.343208 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-321649c6-b451-47ae-af18-f0e736f534d6 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:18.343754 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-321649c6-b451-47ae-af18-f0e736f534d6 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:18.344220 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-321649c6-b451-47ae-af18-f0e736f534d6 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:18.344977 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-321649c6-b451-47ae-af18-f0e736f534d6 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:18.345460 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-321649c6-b451-47ae-af18-f0e736f534d6 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:18.345910 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-321649c6-b451-47ae-af18-f0e736f534d6 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:18.561128 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-321649c6-b451-47ae-af18-f0e736f534d6 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7228e15d12e442b0802ef033bc6158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d77247e9aa471eba23dcc9d2c30e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:58:18.570272 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-321649c6-b451-47ae-af18-f0e736f534d6 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "GET /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2" status: 200 len: 1518 microversion: 2.1 time: 0.239227 Aug 31 16:58:18.570873 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3638/7258] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:58:18 2022] GET /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2 => generated 1518 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:58:19.592273 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c72c4eb6-e944-4508-bd48-753352c4c3af tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:58:19.592878 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c72c4eb6-e944-4508-bd48-753352c4c3af tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: b1623b9c-b818-43a2-9360-99751b436ec2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:58:19.599893 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c72c4eb6-e944-4508-bd48-753352c4c3af tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:19.600362 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c72c4eb6-e944-4508-bd48-753352c4c3af tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:19.600763 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c72c4eb6-e944-4508-bd48-753352c4c3af tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:19.602418 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c72c4eb6-e944-4508-bd48-753352c4c3af tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:19.602418 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c72c4eb6-e944-4508-bd48-753352c4c3af tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:19.602418 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c72c4eb6-e944-4508-bd48-753352c4c3af tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:19.737170 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c72c4eb6-e944-4508-bd48-753352c4c3af tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7228e15d12e442b0802ef033bc6158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d77247e9aa471eba23dcc9d2c30e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:58:19.745169 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c72c4eb6-e944-4508-bd48-753352c4c3af tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "GET /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2" status: 200 len: 1515 microversion: 2.1 time: 0.156836 Aug 31 16:58:19.746408 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3621/7259] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:58:19 2022] GET /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:58:19.766957 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d388dc29-5ad9-471d-8bee-87277a88a170 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:58:19.767552 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d388dc29-5ad9-471d-8bee-87277a88a170 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: b1623b9c-b818-43a2-9360-99751b436ec2] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:58:19.781791 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d388dc29-5ad9-471d-8bee-87277a88a170 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:19.782357 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d388dc29-5ad9-471d-8bee-87277a88a170 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:19.782753 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d388dc29-5ad9-471d-8bee-87277a88a170 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:19.783481 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d388dc29-5ad9-471d-8bee-87277a88a170 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:19.783987 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d388dc29-5ad9-471d-8bee-87277a88a170 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:19.784430 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d388dc29-5ad9-471d-8bee-87277a88a170 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:19.845467 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d388dc29-5ad9-471d-8bee-87277a88a170 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "POST /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2/action" status: 204 len: 0 microversion: 2.1 time: 0.082004 Aug 31 16:58:19.846103 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3639/7260] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:58:19 2022] POST /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2/action => generated 0 bytes in 85 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:58:19.855907 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-23af617a-a0e6-4357-90df-7a2a19d57e1b tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:58:19.856470 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-23af617a-a0e6-4357-90df-7a2a19d57e1b tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: b1623b9c-b818-43a2-9360-99751b436ec2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:58:19.862998 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-23af617a-a0e6-4357-90df-7a2a19d57e1b tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:19.863681 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-23af617a-a0e6-4357-90df-7a2a19d57e1b tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:19.864199 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-23af617a-a0e6-4357-90df-7a2a19d57e1b tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:19.865030 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-23af617a-a0e6-4357-90df-7a2a19d57e1b tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:19.865584 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-23af617a-a0e6-4357-90df-7a2a19d57e1b tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:19.866910 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-23af617a-a0e6-4357-90df-7a2a19d57e1b tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:20.093462 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-23af617a-a0e6-4357-90df-7a2a19d57e1b tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7228e15d12e442b0802ef033bc6158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d77247e9aa471eba23dcc9d2c30e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:58:20.101612 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-23af617a-a0e6-4357-90df-7a2a19d57e1b tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "GET /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2" status: 200 len: 1515 microversion: 2.1 time: 0.251209 Aug 31 16:58:20.102208 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3622/7261] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:58:19 2022] GET /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2 => generated 1515 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:58:20.466704 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-f77a458b-3671-4a16-bb4a-3027f815a838 req-dc8b25eb-4fc7-488d-8c6a-7e07709a6b7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1623b9c-b818-43a2-9360-99751b436ec2", "name": "network-vif-plugged", "status": "completed", "tag": "7b318eca-bd27-4228-80b5-324494fde0c2"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:58:20.479451 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-f77a458b-3671-4a16-bb4a-3027f815a838 req-dc8b25eb-4fc7-488d-8c6a-7e07709a6b7e service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:20.480862 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-f77a458b-3671-4a16-bb4a-3027f815a838 req-dc8b25eb-4fc7-488d-8c6a-7e07709a6b7e service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:20.481347 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-f77a458b-3671-4a16-bb4a-3027f815a838 req-dc8b25eb-4fc7-488d-8c6a-7e07709a6b7e service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:20.494597 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-f77a458b-3671-4a16-bb4a-3027f815a838 req-dc8b25eb-4fc7-488d-8c6a-7e07709a6b7e service nova] Creating event network-vif-plugged:7b318eca-bd27-4228-80b5-324494fde0c2 for instance b1623b9c-b818-43a2-9360-99751b436ec2 on n-h2-850499-9 Aug 31 16:58:20.501772 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [req-f77a458b-3671-4a16-bb4a-3027f815a838 req-dc8b25eb-4fc7-488d-8c6a-7e07709a6b7e service nova] Instance b1623b9c-b818-43a2-9360-99751b436ec2 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850499-9', 'n-h1-850499-9'} {{(pid=122257) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 31 16:58:20.513716 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-f77a458b-3671-4a16-bb4a-3027f815a838 req-dc8b25eb-4fc7-488d-8c6a-7e07709a6b7e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053275 Aug 31 16:58:20.514693 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3640/7262] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:58:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:58:21.123878 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7a5cb97f-f9f2-4fb7-95de-382d8a671fb6 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:58:21.124838 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7a5cb97f-f9f2-4fb7-95de-382d8a671fb6 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: b1623b9c-b818-43a2-9360-99751b436ec2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:58:21.132973 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7a5cb97f-f9f2-4fb7-95de-382d8a671fb6 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:21.133232 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7a5cb97f-f9f2-4fb7-95de-382d8a671fb6 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:21.133673 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7a5cb97f-f9f2-4fb7-95de-382d8a671fb6 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:21.134530 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7a5cb97f-f9f2-4fb7-95de-382d8a671fb6 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:21.135095 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7a5cb97f-f9f2-4fb7-95de-382d8a671fb6 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:21.135546 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7a5cb97f-f9f2-4fb7-95de-382d8a671fb6 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:21.283678 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7a5cb97f-f9f2-4fb7-95de-382d8a671fb6 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7228e15d12e442b0802ef033bc6158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d77247e9aa471eba23dcc9d2c30e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:58:21.294922 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7a5cb97f-f9f2-4fb7-95de-382d8a671fb6 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "GET /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2" status: 200 len: 1515 microversion: 2.1 time: 0.174411 Aug 31 16:58:21.309590 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3623/7263] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:58:21 2022] GET /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2 => generated 1515 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:58:22.319552 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ab90a9e7-3626-4182-aaf6-30d494ddb61f tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:58:22.320273 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ab90a9e7-3626-4182-aaf6-30d494ddb61f tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: b1623b9c-b818-43a2-9360-99751b436ec2] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:58:22.327554 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ab90a9e7-3626-4182-aaf6-30d494ddb61f tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:22.328065 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ab90a9e7-3626-4182-aaf6-30d494ddb61f tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:22.328526 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ab90a9e7-3626-4182-aaf6-30d494ddb61f tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:22.329244 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ab90a9e7-3626-4182-aaf6-30d494ddb61f tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:22.329717 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ab90a9e7-3626-4182-aaf6-30d494ddb61f tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:22.330160 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ab90a9e7-3626-4182-aaf6-30d494ddb61f tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:22.469003 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ab90a9e7-3626-4182-aaf6-30d494ddb61f tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7228e15d12e442b0802ef033bc6158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d77247e9aa471eba23dcc9d2c30e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:58:22.481939 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ab90a9e7-3626-4182-aaf6-30d494ddb61f tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "GET /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2" status: 200 len: 1507 microversion: 2.1 time: 0.167479 Aug 31 16:58:22.482705 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3641/7264] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:58:22 2022] GET /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2 => generated 1507 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:58:22.502834 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-efa14bf3-5ae1-4cef-81ad-a206d922fa53 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:58:22.503457 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-efa14bf3-5ae1-4cef-81ad-a206d922fa53 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: b1623b9c-b818-43a2-9360-99751b436ec2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:58:22.511143 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-efa14bf3-5ae1-4cef-81ad-a206d922fa53 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:22.512760 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-efa14bf3-5ae1-4cef-81ad-a206d922fa53 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:22.513215 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-efa14bf3-5ae1-4cef-81ad-a206d922fa53 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:22.513931 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-efa14bf3-5ae1-4cef-81ad-a206d922fa53 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:22.514401 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-efa14bf3-5ae1-4cef-81ad-a206d922fa53 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:22.514843 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-efa14bf3-5ae1-4cef-81ad-a206d922fa53 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:22.648899 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-efa14bf3-5ae1-4cef-81ad-a206d922fa53 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7228e15d12e442b0802ef033bc6158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d77247e9aa471eba23dcc9d2c30e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:58:22.657115 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-efa14bf3-5ae1-4cef-81ad-a206d922fa53 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "GET /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2" status: 200 len: 1507 microversion: 2.1 time: 0.158391 Aug 31 16:58:22.657695 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3624/7265] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:58:22 2022] GET /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2 => generated 1507 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:58:22.681760 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-364b6a4c-c5f7-4045-b148-f6e24ccdc983 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Action: 'create', calling method: .version_select at 0x7f5ae3c67040>, body: {"keypair": {"name": "tempest-keypair-426025420", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKd0dkMd33uiWTW8XjA03P84GUWDFvtC1G9TWXHLtLhoYUdJewBcbk6Wb0XomIMv5CzN+cAbjBhXg6JHKGbjVKm1LI/g33+lngxDF2PP5nBQyIrJA15jfFEfvcYsWKEHvQ=="}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:58:22.697504 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-364b6a4c-c5f7-4045-b148-f6e24ccdc983 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Getting quotas for project 61d77247e9aa471eba23dcc9d2c30e72. Resources: {'key_pairs'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:58:22.703329 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-364b6a4c-c5f7-4045-b148-f6e24ccdc983 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Getting quotas for user 7228e15d12e442b0802ef033bc6158b7 and project 61d77247e9aa471eba23dcc9d2c30e72. Resources: {'key_pairs'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:58:22.728159 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-364b6a4c-c5f7-4045-b148-f6e24ccdc983 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.050339 Aug 31 16:58:22.728766 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3642/7266] 10.222.0.61 () {60 vars in 1159 bytes} [Wed Aug 31 16:58:22 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:58:23.994045 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-77ba6bb2-962e-47b5-bda9-8c6db95818c8 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:58:23.994775 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-77ba6bb2-962e-47b5-bda9-8c6db95818c8 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: b1623b9c-b818-43a2-9360-99751b436ec2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:58:24.003884 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-77ba6bb2-962e-47b5-bda9-8c6db95818c8 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:24.004369 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-77ba6bb2-962e-47b5-bda9-8c6db95818c8 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:24.004809 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-77ba6bb2-962e-47b5-bda9-8c6db95818c8 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:24.005562 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-77ba6bb2-962e-47b5-bda9-8c6db95818c8 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:24.006029 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-77ba6bb2-962e-47b5-bda9-8c6db95818c8 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:24.006461 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-77ba6bb2-962e-47b5-bda9-8c6db95818c8 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:24.142632 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-77ba6bb2-962e-47b5-bda9-8c6db95818c8 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7228e15d12e442b0802ef033bc6158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d77247e9aa471eba23dcc9d2c30e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:58:24.150517 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-77ba6bb2-962e-47b5-bda9-8c6db95818c8 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "GET /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2" status: 200 len: 1507 microversion: 2.1 time: 0.160594 Aug 31 16:58:24.151101 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3625/7267] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:58:23 2022] GET /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2 => generated 1507 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:58:24.172700 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c30b8580-2b82-4118-827d-25a686c1d4e8 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:58:24.173254 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c30b8580-2b82-4118-827d-25a686c1d4e8 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: b1623b9c-b818-43a2-9360-99751b436ec2] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:58:24.180036 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c30b8580-2b82-4118-827d-25a686c1d4e8 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:24.180558 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c30b8580-2b82-4118-827d-25a686c1d4e8 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:24.181021 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c30b8580-2b82-4118-827d-25a686c1d4e8 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:24.181761 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c30b8580-2b82-4118-827d-25a686c1d4e8 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:24.182223 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c30b8580-2b82-4118-827d-25a686c1d4e8 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:24.182678 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c30b8580-2b82-4118-827d-25a686c1d4e8 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:24.211150 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c30b8580-2b82-4118-827d-25a686c1d4e8 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: b1623b9c-b818-43a2-9360-99751b436ec2] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:58:24.291759 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c30b8580-2b82-4118-827d-25a686c1d4e8 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "DELETE /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2" status: 204 len: 0 microversion: 2.1 time: 0.123939 Aug 31 16:58:24.292657 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3643/7268] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:58:24 2022] DELETE /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:58:24.350407 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-96f44b98-2dd8-4314-b6a1-eca98d2c5add tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-2069551881", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "networks": [{"uuid": "99f30407-a628-4a17-90d7-d673792074dc"}]}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:58:24.405655 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-96f44b98-2dd8-4314-b6a1-eca98d2c5add tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] validate_networks() for [('99f30407-a628-4a17-90d7-d673792074dc', None, None, None, None, None)] {{(pid=122256) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:58:24.784037 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-96f44b98-2dd8-4314-b6a1-eca98d2c5add tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:58:24.784459 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-96f44b98-2dd8-4314-b6a1-eca98d2c5add tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:58:24.784934 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-96f44b98-2dd8-4314-b6a1-eca98d2c5add tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:58:24.785341 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-96f44b98-2dd8-4314-b6a1-eca98d2c5add tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:58:24.785751 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-96f44b98-2dd8-4314-b6a1-eca98d2c5add tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:58:24.795303 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-96f44b98-2dd8-4314-b6a1-eca98d2c5add tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:24.795827 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-96f44b98-2dd8-4314-b6a1-eca98d2c5add tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:24.796262 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-96f44b98-2dd8-4314-b6a1-eca98d2c5add tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:24.796985 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-96f44b98-2dd8-4314-b6a1-eca98d2c5add tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:24.797442 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-96f44b98-2dd8-4314-b6a1-eca98d2c5add tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:24.797867 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-96f44b98-2dd8-4314-b6a1-eca98d2c5add tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:24.814224 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-96f44b98-2dd8-4314-b6a1-eca98d2c5add tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Getting quotas for project 61d77247e9aa471eba23dcc9d2c30e72. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:58:24.819394 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-96f44b98-2dd8-4314-b6a1-eca98d2c5add tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Getting quotas for user 7228e15d12e442b0802ef033bc6158b7 and project 61d77247e9aa471eba23dcc9d2c30e72. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:58:24.831663 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-96f44b98-2dd8-4314-b6a1-eca98d2c5add tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Going to run 1 instances... {{(pid=122256) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:58:24.833940 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-96f44b98-2dd8-4314-b6a1-eca98d2c5add tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: 22d313f2-f865-4823-bf70-c963835ae9d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:58:24.880545 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-96f44b98-2dd8-4314-b6a1-eca98d2c5add tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.533970 Aug 31 16:58:24.881198 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3626/7269] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:58:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 535 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:58:24.893021 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-057ab797-9ad7-49c9-94a0-f1ae74699666 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:58:24.893747 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-057ab797-9ad7-49c9-94a0-f1ae74699666 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: 22d313f2-f865-4823-bf70-c963835ae9d5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:58:24.950740 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-057ab797-9ad7-49c9-94a0-f1ae74699666 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7228e15d12e442b0802ef033bc6158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d77247e9aa471eba23dcc9d2c30e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:58:24.958181 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-057ab797-9ad7-49c9-94a0-f1ae74699666 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "GET /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5" status: 200 len: 1218 microversion: 2.1 time: 0.069400 Aug 31 16:58:24.958845 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3644/7270] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:58:24 2022] GET /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5 => generated 1218 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:58:25.981925 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e32c80bd-bb56-4e55-be4a-939b881d7f63 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:58:25.983823 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e32c80bd-bb56-4e55-be4a-939b881d7f63 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: 22d313f2-f865-4823-bf70-c963835ae9d5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:58:25.989885 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e32c80bd-bb56-4e55-be4a-939b881d7f63 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:25.990386 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e32c80bd-bb56-4e55-be4a-939b881d7f63 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:25.990842 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e32c80bd-bb56-4e55-be4a-939b881d7f63 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:25.991586 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e32c80bd-bb56-4e55-be4a-939b881d7f63 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:25.992056 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e32c80bd-bb56-4e55-be4a-939b881d7f63 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:25.992519 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e32c80bd-bb56-4e55-be4a-939b881d7f63 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:26.064762 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e32c80bd-bb56-4e55-be4a-939b881d7f63 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7228e15d12e442b0802ef033bc6158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d77247e9aa471eba23dcc9d2c30e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:58:26.072821 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e32c80bd-bb56-4e55-be4a-939b881d7f63 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "GET /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5" status: 200 len: 1214 microversion: 2.1 time: 0.096842 Aug 31 16:58:26.073531 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3627/7271] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:58:25 2022] GET /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5 => generated 1214 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:58:26.652101 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-63a44ef3-3634-4b4b-8985-83ef0189b78f req-8eef7ec6-f2a4-406f-a404-68bd9be55e6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1623b9c-b818-43a2-9360-99751b436ec2", "name": "network-vif-deleted", "tag": "7b318eca-bd27-4228-80b5-324494fde0c2"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:58:26.669730 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-63a44ef3-3634-4b4b-8985-83ef0189b78f req-8eef7ec6-f2a4-406f-a404-68bd9be55e6a service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:26.670239 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-63a44ef3-3634-4b4b-8985-83ef0189b78f req-8eef7ec6-f2a4-406f-a404-68bd9be55e6a service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:26.670689 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-63a44ef3-3634-4b4b-8985-83ef0189b78f req-8eef7ec6-f2a4-406f-a404-68bd9be55e6a service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:26.682724 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-63a44ef3-3634-4b4b-8985-83ef0189b78f req-8eef7ec6-f2a4-406f-a404-68bd9be55e6a service nova] Creating event network-vif-deleted:7b318eca-bd27-4228-80b5-324494fde0c2 for instance b1623b9c-b818-43a2-9360-99751b436ec2 on n-h2-850499-9 Aug 31 16:58:26.695483 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-63a44ef3-3634-4b4b-8985-83ef0189b78f req-8eef7ec6-f2a4-406f-a404-68bd9be55e6a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046761 Aug 31 16:58:26.696265 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3645/7272] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:58:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:58:27.095447 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-25f0c0db-c9da-4f85-acd9-0429aac4faaf tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:58:27.096692 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-25f0c0db-c9da-4f85-acd9-0429aac4faaf tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: 22d313f2-f865-4823-bf70-c963835ae9d5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:58:27.104838 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-25f0c0db-c9da-4f85-acd9-0429aac4faaf tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:27.105330 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-25f0c0db-c9da-4f85-acd9-0429aac4faaf tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:27.105765 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-25f0c0db-c9da-4f85-acd9-0429aac4faaf tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:27.106467 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-25f0c0db-c9da-4f85-acd9-0429aac4faaf tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:27.106928 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-25f0c0db-c9da-4f85-acd9-0429aac4faaf tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:27.107356 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-25f0c0db-c9da-4f85-acd9-0429aac4faaf tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:27.211016 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-25f0c0db-c9da-4f85-acd9-0429aac4faaf tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7228e15d12e442b0802ef033bc6158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d77247e9aa471eba23dcc9d2c30e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:58:27.219656 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-25f0c0db-c9da-4f85-acd9-0429aac4faaf tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "GET /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5" status: 200 len: 1276 microversion: 2.1 time: 0.128705 Aug 31 16:58:27.220347 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3628/7273] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:58:27 2022] GET /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5 => generated 1276 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:58:28.243249 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-664f5fab-4271-4787-8df7-9995bee6f7e9 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:58:28.244003 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-664f5fab-4271-4787-8df7-9995bee6f7e9 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: 22d313f2-f865-4823-bf70-c963835ae9d5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:58:28.251064 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-664f5fab-4271-4787-8df7-9995bee6f7e9 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:28.251613 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-664f5fab-4271-4787-8df7-9995bee6f7e9 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:28.252081 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-664f5fab-4271-4787-8df7-9995bee6f7e9 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:28.252811 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-664f5fab-4271-4787-8df7-9995bee6f7e9 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:28.253294 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-664f5fab-4271-4787-8df7-9995bee6f7e9 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:28.253746 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-664f5fab-4271-4787-8df7-9995bee6f7e9 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:28.477762 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-664f5fab-4271-4787-8df7-9995bee6f7e9 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7228e15d12e442b0802ef033bc6158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d77247e9aa471eba23dcc9d2c30e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:58:28.489457 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-664f5fab-4271-4787-8df7-9995bee6f7e9 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "GET /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5" status: 200 len: 1318 microversion: 2.1 time: 0.251262 Aug 31 16:58:28.490071 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3646/7274] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:58:28 2022] GET /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5 => generated 1318 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:58:28.710523 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-f27e9a52-8561-4e37-8349-573c1170014f req-df240ba1-c5bb-41ed-91c8-a60666e755aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22d313f2-f865-4823-bf70-c963835ae9d5", "tag": "272cb998-cea9-4a28-8451-7c9ae53b4f45"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:58:28.721190 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-f27e9a52-8561-4e37-8349-573c1170014f req-df240ba1-c5bb-41ed-91c8-a60666e755aa service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:28.721687 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-f27e9a52-8561-4e37-8349-573c1170014f req-df240ba1-c5bb-41ed-91c8-a60666e755aa service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:28.722128 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-f27e9a52-8561-4e37-8349-573c1170014f req-df240ba1-c5bb-41ed-91c8-a60666e755aa service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:28.733776 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-f27e9a52-8561-4e37-8349-573c1170014f req-df240ba1-c5bb-41ed-91c8-a60666e755aa service nova] Creating event network-changed:272cb998-cea9-4a28-8451-7c9ae53b4f45 for instance 22d313f2-f865-4823-bf70-c963835ae9d5 on n-h2-850499-9 Aug 31 16:58:28.738866 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-f27e9a52-8561-4e37-8349-573c1170014f req-df240ba1-c5bb-41ed-91c8-a60666e755aa service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032247 Aug 31 16:58:28.739481 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3629/7275] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:58:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:58:29.513843 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a3af8186-4d8f-4d26-97a2-d77d7eba752e tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:58:29.514470 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a3af8186-4d8f-4d26-97a2-d77d7eba752e tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: 22d313f2-f865-4823-bf70-c963835ae9d5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:58:29.521843 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a3af8186-4d8f-4d26-97a2-d77d7eba752e tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:29.522353 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a3af8186-4d8f-4d26-97a2-d77d7eba752e tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:29.522812 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a3af8186-4d8f-4d26-97a2-d77d7eba752e tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:29.523572 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a3af8186-4d8f-4d26-97a2-d77d7eba752e tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:29.524055 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a3af8186-4d8f-4d26-97a2-d77d7eba752e tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:29.524505 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a3af8186-4d8f-4d26-97a2-d77d7eba752e tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:29.655348 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a3af8186-4d8f-4d26-97a2-d77d7eba752e tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7228e15d12e442b0802ef033bc6158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d77247e9aa471eba23dcc9d2c30e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:58:29.663231 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a3af8186-4d8f-4d26-97a2-d77d7eba752e tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "GET /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5" status: 200 len: 1318 microversion: 2.1 time: 0.154200 Aug 31 16:58:29.663835 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3647/7276] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:58:29 2022] GET /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:58:30.686671 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8aaf2c60-103b-4ef0-8182-12896ffa444e tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:58:30.687397 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8aaf2c60-103b-4ef0-8182-12896ffa444e tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: 22d313f2-f865-4823-bf70-c963835ae9d5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:58:30.693765 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8aaf2c60-103b-4ef0-8182-12896ffa444e tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:30.694258 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8aaf2c60-103b-4ef0-8182-12896ffa444e tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:30.694700 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8aaf2c60-103b-4ef0-8182-12896ffa444e tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:30.695394 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8aaf2c60-103b-4ef0-8182-12896ffa444e tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:30.695878 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8aaf2c60-103b-4ef0-8182-12896ffa444e tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:30.696308 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8aaf2c60-103b-4ef0-8182-12896ffa444e tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:30.825801 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8aaf2c60-103b-4ef0-8182-12896ffa444e tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7228e15d12e442b0802ef033bc6158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d77247e9aa471eba23dcc9d2c30e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:58:30.833645 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8aaf2c60-103b-4ef0-8182-12896ffa444e tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "GET /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5" status: 200 len: 1318 microversion: 2.1 time: 0.152744 Aug 31 16:58:30.834218 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3630/7277] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:58:30 2022] GET /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:58:31.854516 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b6a881a4-4827-4340-b41b-a037df1c8eda tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:58:31.855172 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b6a881a4-4827-4340-b41b-a037df1c8eda tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: 22d313f2-f865-4823-bf70-c963835ae9d5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:58:31.862120 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b6a881a4-4827-4340-b41b-a037df1c8eda tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:31.862980 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b6a881a4-4827-4340-b41b-a037df1c8eda tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:31.863439 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b6a881a4-4827-4340-b41b-a037df1c8eda tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:31.864207 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b6a881a4-4827-4340-b41b-a037df1c8eda tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:31.864679 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b6a881a4-4827-4340-b41b-a037df1c8eda tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:31.865207 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b6a881a4-4827-4340-b41b-a037df1c8eda tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:32.114174 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b6a881a4-4827-4340-b41b-a037df1c8eda tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7228e15d12e442b0802ef033bc6158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d77247e9aa471eba23dcc9d2c30e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:58:32.126806 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b6a881a4-4827-4340-b41b-a037df1c8eda tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "GET /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5" status: 200 len: 1318 microversion: 2.1 time: 0.275889 Aug 31 16:58:32.127767 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3648/7278] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:58:31 2022] GET /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5 => generated 1318 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:58:33.153829 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9ec1e69f-db21-4447-a3fe-2b74b80ade37 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:58:33.154513 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9ec1e69f-db21-4447-a3fe-2b74b80ade37 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: 22d313f2-f865-4823-bf70-c963835ae9d5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:58:33.161473 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9ec1e69f-db21-4447-a3fe-2b74b80ade37 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:33.161979 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9ec1e69f-db21-4447-a3fe-2b74b80ade37 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:33.162432 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9ec1e69f-db21-4447-a3fe-2b74b80ade37 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:33.163144 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9ec1e69f-db21-4447-a3fe-2b74b80ade37 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:33.163634 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9ec1e69f-db21-4447-a3fe-2b74b80ade37 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:33.164074 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9ec1e69f-db21-4447-a3fe-2b74b80ade37 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:33.166761 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=97 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:58:33.297944 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-9ec1e69f-db21-4447-a3fe-2b74b80ade37 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7228e15d12e442b0802ef033bc6158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d77247e9aa471eba23dcc9d2c30e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:58:33.305742 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9ec1e69f-db21-4447-a3fe-2b74b80ade37 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "GET /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5" status: 200 len: 1318 microversion: 2.1 time: 0.157222 Aug 31 16:58:33.306326 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3631/7279] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:58:33 2022] GET /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:58:34.326396 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7c936511-64d8-44db-9988-253f3e2fa453 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:58:34.327391 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7c936511-64d8-44db-9988-253f3e2fa453 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: 22d313f2-f865-4823-bf70-c963835ae9d5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:58:34.334401 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7c936511-64d8-44db-9988-253f3e2fa453 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:34.334913 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7c936511-64d8-44db-9988-253f3e2fa453 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:34.335390 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7c936511-64d8-44db-9988-253f3e2fa453 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:34.336246 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7c936511-64d8-44db-9988-253f3e2fa453 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:34.336610 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7c936511-64d8-44db-9988-253f3e2fa453 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:34.337071 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7c936511-64d8-44db-9988-253f3e2fa453 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:34.341658 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:58:34.479449 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7c936511-64d8-44db-9988-253f3e2fa453 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7228e15d12e442b0802ef033bc6158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d77247e9aa471eba23dcc9d2c30e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:58:34.488426 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-c1f910ec-9b2f-48e8-8a7d-619a152b4976 req-c8dee658-4584-43e3-9d19-12d197b6ca92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22d313f2-f865-4823-bf70-c963835ae9d5", "name": "network-vif-plugged", "status": "completed", "tag": "272cb998-cea9-4a28-8451-7c9ae53b4f45"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:58:34.488991 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7c936511-64d8-44db-9988-253f3e2fa453 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "GET /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5" status: 200 len: 1318 microversion: 2.1 time: 0.166074 Aug 31 16:58:34.489107 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3649/7280] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:58:34 2022] GET /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:58:34.504991 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-c1f910ec-9b2f-48e8-8a7d-619a152b4976 req-c8dee658-4584-43e3-9d19-12d197b6ca92 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:34.505699 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-c1f910ec-9b2f-48e8-8a7d-619a152b4976 req-c8dee658-4584-43e3-9d19-12d197b6ca92 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:34.506141 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-c1f910ec-9b2f-48e8-8a7d-619a152b4976 req-c8dee658-4584-43e3-9d19-12d197b6ca92 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:34.518022 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-c1f910ec-9b2f-48e8-8a7d-619a152b4976 req-c8dee658-4584-43e3-9d19-12d197b6ca92 service nova] Creating event network-vif-plugged:272cb998-cea9-4a28-8451-7c9ae53b4f45 for instance 22d313f2-f865-4823-bf70-c963835ae9d5 on n-h2-850499-9 Aug 31 16:58:34.523359 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-c1f910ec-9b2f-48e8-8a7d-619a152b4976 req-c8dee658-4584-43e3-9d19-12d197b6ca92 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038786 Aug 31 16:58:34.524018 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3632/7281] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:58:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:58:35.511770 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-afb58a7a-f4a2-4d5e-8b46-a52d0e11e195 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:58:35.512399 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-afb58a7a-f4a2-4d5e-8b46-a52d0e11e195 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: 22d313f2-f865-4823-bf70-c963835ae9d5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:58:35.514415 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=6 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:58:35.520734 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-afb58a7a-f4a2-4d5e-8b46-a52d0e11e195 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:35.521178 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-afb58a7a-f4a2-4d5e-8b46-a52d0e11e195 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:35.521630 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-afb58a7a-f4a2-4d5e-8b46-a52d0e11e195 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:35.522341 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-afb58a7a-f4a2-4d5e-8b46-a52d0e11e195 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:35.522811 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-afb58a7a-f4a2-4d5e-8b46-a52d0e11e195 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:35.523259 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-afb58a7a-f4a2-4d5e-8b46-a52d0e11e195 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:35.658093 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-afb58a7a-f4a2-4d5e-8b46-a52d0e11e195 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7228e15d12e442b0802ef033bc6158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d77247e9aa471eba23dcc9d2c30e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:58:35.665870 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-afb58a7a-f4a2-4d5e-8b46-a52d0e11e195 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "GET /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5" status: 200 len: 1318 microversion: 2.1 time: 0.158269 Aug 31 16:58:35.666443 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3650/7282] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:58:35 2022] GET /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:58:36.684837 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:58:36.685617 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=6 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:58:36.691427 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0a1b8673-db40-44d7-bc88-3f5693cce07c tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:58:36.692210 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0a1b8673-db40-44d7-bc88-3f5693cce07c tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: 22d313f2-f865-4823-bf70-c963835ae9d5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:58:36.698976 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0a1b8673-db40-44d7-bc88-3f5693cce07c tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:36.699511 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0a1b8673-db40-44d7-bc88-3f5693cce07c tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:36.699975 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0a1b8673-db40-44d7-bc88-3f5693cce07c tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:36.700675 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0a1b8673-db40-44d7-bc88-3f5693cce07c tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:36.701140 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0a1b8673-db40-44d7-bc88-3f5693cce07c tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:36.701570 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0a1b8673-db40-44d7-bc88-3f5693cce07c tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:36.832838 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-0a1b8673-db40-44d7-bc88-3f5693cce07c tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7228e15d12e442b0802ef033bc6158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d77247e9aa471eba23dcc9d2c30e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:58:36.841175 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0a1b8673-db40-44d7-bc88-3f5693cce07c tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "GET /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5" status: 200 len: 1508 microversion: 2.1 time: 0.157935 Aug 31 16:58:36.841746 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3633/7283] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:58:36 2022] GET /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5 => generated 1508 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:58:36.862503 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a9e6f059-714a-4dca-a100-1997fa5566a3 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:58:36.863134 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a9e6f059-714a-4dca-a100-1997fa5566a3 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: 22d313f2-f865-4823-bf70-c963835ae9d5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:58:36.870214 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a9e6f059-714a-4dca-a100-1997fa5566a3 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:36.870876 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a9e6f059-714a-4dca-a100-1997fa5566a3 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:36.871569 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a9e6f059-714a-4dca-a100-1997fa5566a3 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:36.872045 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a9e6f059-714a-4dca-a100-1997fa5566a3 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:36.872522 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a9e6f059-714a-4dca-a100-1997fa5566a3 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:36.873012 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a9e6f059-714a-4dca-a100-1997fa5566a3 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:37.010525 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a9e6f059-714a-4dca-a100-1997fa5566a3 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7228e15d12e442b0802ef033bc6158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d77247e9aa471eba23dcc9d2c30e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:58:37.019121 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a9e6f059-714a-4dca-a100-1997fa5566a3 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "GET /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5" status: 200 len: 1508 microversion: 2.1 time: 0.160670 Aug 31 16:58:37.019732 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3651/7284] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:58:36 2022] GET /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5 => generated 1508 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:58:37.039810 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-89be107e-1b4d-4449-8b08-ab3a12920ebe tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:58:37.042030 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-89be107e-1b4d-4449-8b08-ab3a12920ebe tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: 22d313f2-f865-4823-bf70-c963835ae9d5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:58:37.048567 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-89be107e-1b4d-4449-8b08-ab3a12920ebe tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:37.049054 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-89be107e-1b4d-4449-8b08-ab3a12920ebe tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:37.049491 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-89be107e-1b4d-4449-8b08-ab3a12920ebe tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:37.050181 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-89be107e-1b4d-4449-8b08-ab3a12920ebe tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:37.050635 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-89be107e-1b4d-4449-8b08-ab3a12920ebe tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:37.051056 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-89be107e-1b4d-4449-8b08-ab3a12920ebe tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:37.079636 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-89be107e-1b4d-4449-8b08-ab3a12920ebe tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '7228e15d12e442b0802ef033bc6158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d77247e9aa471eba23dcc9d2c30e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:58:37.085354 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-89be107e-1b4d-4449-8b08-ab3a12920ebe tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: 22d313f2-f865-4823-bf70-c963835ae9d5] Old instance type m1.heat2, new instance type m1.heat {{(pid=122256) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 31 16:58:37.092558 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-89be107e-1b4d-4449-8b08-ab3a12920ebe tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:58:37.093004 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-89be107e-1b4d-4449-8b08-ab3a12920ebe tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:58:37.093479 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-89be107e-1b4d-4449-8b08-ab3a12920ebe tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:58:37.093891 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-89be107e-1b4d-4449-8b08-ab3a12920ebe tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:58:37.094306 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-89be107e-1b4d-4449-8b08-ab3a12920ebe tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:58:37.159156 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-89be107e-1b4d-4449-8b08-ab3a12920ebe tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "POST /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5/action" status: 202 len: 0 microversion: 2.1 time: 0.123403 Aug 31 16:58:37.159805 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3634/7285] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:58:37 2022] POST /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:58:37.169490 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f7e8a573-208e-41ae-9e95-77457cbfaf29 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:58:37.170129 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f7e8a573-208e-41ae-9e95-77457cbfaf29 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: 22d313f2-f865-4823-bf70-c963835ae9d5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:58:37.176516 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f7e8a573-208e-41ae-9e95-77457cbfaf29 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:37.177029 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f7e8a573-208e-41ae-9e95-77457cbfaf29 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:37.177489 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f7e8a573-208e-41ae-9e95-77457cbfaf29 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:37.178244 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f7e8a573-208e-41ae-9e95-77457cbfaf29 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:37.178726 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f7e8a573-208e-41ae-9e95-77457cbfaf29 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:37.179180 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f7e8a573-208e-41ae-9e95-77457cbfaf29 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:37.341605 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f7e8a573-208e-41ae-9e95-77457cbfaf29 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7228e15d12e442b0802ef033bc6158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d77247e9aa471eba23dcc9d2c30e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:58:37.351237 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f7e8a573-208e-41ae-9e95-77457cbfaf29 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "GET /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5" status: 200 len: 1515 microversion: 2.1 time: 0.186074 Aug 31 16:58:37.351873 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3652/7286] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:58:37 2022] GET /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5 => generated 1515 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:58:38.374975 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0869a6b4-9c34-42f3-8120-e417be7f29bf tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:58:38.375627 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0869a6b4-9c34-42f3-8120-e417be7f29bf tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: 22d313f2-f865-4823-bf70-c963835ae9d5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:58:38.381987 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0869a6b4-9c34-42f3-8120-e417be7f29bf tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:38.382459 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0869a6b4-9c34-42f3-8120-e417be7f29bf tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:38.382909 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0869a6b4-9c34-42f3-8120-e417be7f29bf tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:38.383639 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0869a6b4-9c34-42f3-8120-e417be7f29bf tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:38.384138 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0869a6b4-9c34-42f3-8120-e417be7f29bf tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:38.384555 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0869a6b4-9c34-42f3-8120-e417be7f29bf tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:38.585743 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-0869a6b4-9c34-42f3-8120-e417be7f29bf tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7228e15d12e442b0802ef033bc6158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d77247e9aa471eba23dcc9d2c30e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:58:38.595377 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0869a6b4-9c34-42f3-8120-e417be7f29bf tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "GET /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5" status: 200 len: 1515 microversion: 2.1 time: 0.226403 Aug 31 16:58:38.596003 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3635/7287] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:58:38 2022] GET /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5 => generated 1515 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:58:39.621663 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-96640bf4-c1c6-4f9e-81f5-5c63887bb9b9 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:58:39.622359 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-96640bf4-c1c6-4f9e-81f5-5c63887bb9b9 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: 22d313f2-f865-4823-bf70-c963835ae9d5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:58:39.625975 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:58:39.631688 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-96640bf4-c1c6-4f9e-81f5-5c63887bb9b9 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:39.632239 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-96640bf4-c1c6-4f9e-81f5-5c63887bb9b9 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:39.632700 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-96640bf4-c1c6-4f9e-81f5-5c63887bb9b9 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:39.633447 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-96640bf4-c1c6-4f9e-81f5-5c63887bb9b9 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:39.633920 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-96640bf4-c1c6-4f9e-81f5-5c63887bb9b9 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:39.634372 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-96640bf4-c1c6-4f9e-81f5-5c63887bb9b9 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:39.776854 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-96640bf4-c1c6-4f9e-81f5-5c63887bb9b9 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7228e15d12e442b0802ef033bc6158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d77247e9aa471eba23dcc9d2c30e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:58:39.784884 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-96640bf4-c1c6-4f9e-81f5-5c63887bb9b9 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "GET /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5" status: 200 len: 1520 microversion: 2.1 time: 0.168086 Aug 31 16:58:39.785469 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3653/7288] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:58:39 2022] GET /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5 => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:58:40.806379 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-56582994-f18c-4638-9ce8-ecacee96f28a tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:58:40.807001 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-56582994-f18c-4638-9ce8-ecacee96f28a tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: 22d313f2-f865-4823-bf70-c963835ae9d5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:58:40.810339 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:58:40.816501 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-56582994-f18c-4638-9ce8-ecacee96f28a tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:40.817023 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-56582994-f18c-4638-9ce8-ecacee96f28a tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:40.817501 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-56582994-f18c-4638-9ce8-ecacee96f28a tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:40.818207 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-56582994-f18c-4638-9ce8-ecacee96f28a tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:40.818670 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-56582994-f18c-4638-9ce8-ecacee96f28a tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:40.819102 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-56582994-f18c-4638-9ce8-ecacee96f28a tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:40.954796 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-56582994-f18c-4638-9ce8-ecacee96f28a tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7228e15d12e442b0802ef033bc6158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d77247e9aa471eba23dcc9d2c30e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:58:40.962828 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-56582994-f18c-4638-9ce8-ecacee96f28a tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "GET /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5" status: 200 len: 1520 microversion: 2.1 time: 0.160337 Aug 31 16:58:40.963430 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3636/7289] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:58:40 2022] GET /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:58:41.985155 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-58d34bd0-2e4d-477a-9cb9-ad16706026a6 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:58:41.985788 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-58d34bd0-2e4d-477a-9cb9-ad16706026a6 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: 22d313f2-f865-4823-bf70-c963835ae9d5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:58:41.992704 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-58d34bd0-2e4d-477a-9cb9-ad16706026a6 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:41.993210 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-58d34bd0-2e4d-477a-9cb9-ad16706026a6 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:41.993672 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-58d34bd0-2e4d-477a-9cb9-ad16706026a6 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:41.994383 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-58d34bd0-2e4d-477a-9cb9-ad16706026a6 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:41.994865 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-58d34bd0-2e4d-477a-9cb9-ad16706026a6 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:41.995311 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-58d34bd0-2e4d-477a-9cb9-ad16706026a6 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:42.131898 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-58d34bd0-2e4d-477a-9cb9-ad16706026a6 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7228e15d12e442b0802ef033bc6158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d77247e9aa471eba23dcc9d2c30e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:58:42.140090 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-58d34bd0-2e4d-477a-9cb9-ad16706026a6 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "GET /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5" status: 200 len: 1520 microversion: 2.1 time: 0.159630 Aug 31 16:58:42.140710 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3654/7290] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:58:41 2022] GET /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:58:43.161077 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-83948d2a-f52d-46e4-b6ae-d54e206225d6 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:58:43.161680 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-83948d2a-f52d-46e4-b6ae-d54e206225d6 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: 22d313f2-f865-4823-bf70-c963835ae9d5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:58:43.169207 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-83948d2a-f52d-46e4-b6ae-d54e206225d6 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:43.169691 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-83948d2a-f52d-46e4-b6ae-d54e206225d6 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:43.170129 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-83948d2a-f52d-46e4-b6ae-d54e206225d6 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:43.170821 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-83948d2a-f52d-46e4-b6ae-d54e206225d6 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:43.171384 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-83948d2a-f52d-46e4-b6ae-d54e206225d6 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:43.171839 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-83948d2a-f52d-46e4-b6ae-d54e206225d6 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:43.304938 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-83948d2a-f52d-46e4-b6ae-d54e206225d6 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7228e15d12e442b0802ef033bc6158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d77247e9aa471eba23dcc9d2c30e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:58:43.313238 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-83948d2a-f52d-46e4-b6ae-d54e206225d6 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "GET /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5" status: 200 len: 1520 microversion: 2.1 time: 0.156062 Aug 31 16:58:43.313812 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3637/7291] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:58:43 2022] GET /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:58:44.335088 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5533b666-2149-42ed-8821-c90c53a77cd8 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:58:44.335747 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5533b666-2149-42ed-8821-c90c53a77cd8 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: 22d313f2-f865-4823-bf70-c963835ae9d5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:58:44.342707 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5533b666-2149-42ed-8821-c90c53a77cd8 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:44.343218 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5533b666-2149-42ed-8821-c90c53a77cd8 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:44.343789 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5533b666-2149-42ed-8821-c90c53a77cd8 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:44.344570 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5533b666-2149-42ed-8821-c90c53a77cd8 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:44.345047 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5533b666-2149-42ed-8821-c90c53a77cd8 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:44.345495 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5533b666-2149-42ed-8821-c90c53a77cd8 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:44.482033 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5533b666-2149-42ed-8821-c90c53a77cd8 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7228e15d12e442b0802ef033bc6158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d77247e9aa471eba23dcc9d2c30e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:58:44.489935 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5533b666-2149-42ed-8821-c90c53a77cd8 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "GET /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5" status: 200 len: 1520 microversion: 2.1 time: 0.158938 Aug 31 16:58:44.490519 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3655/7292] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:58:44 2022] GET /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:58:45.513408 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-001f9d26-6ca8-4c92-b5ca-08d3eeb4e926 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:58:45.514037 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-001f9d26-6ca8-4c92-b5ca-08d3eeb4e926 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: 22d313f2-f865-4823-bf70-c963835ae9d5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:58:45.520280 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-001f9d26-6ca8-4c92-b5ca-08d3eeb4e926 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:45.520774 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-001f9d26-6ca8-4c92-b5ca-08d3eeb4e926 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:45.521216 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-001f9d26-6ca8-4c92-b5ca-08d3eeb4e926 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:45.521910 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-001f9d26-6ca8-4c92-b5ca-08d3eeb4e926 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:45.522373 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-001f9d26-6ca8-4c92-b5ca-08d3eeb4e926 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:45.522805 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-001f9d26-6ca8-4c92-b5ca-08d3eeb4e926 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:45.657806 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-001f9d26-6ca8-4c92-b5ca-08d3eeb4e926 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7228e15d12e442b0802ef033bc6158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d77247e9aa471eba23dcc9d2c30e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:58:45.665548 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-001f9d26-6ca8-4c92-b5ca-08d3eeb4e926 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "GET /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5" status: 200 len: 1520 microversion: 2.1 time: 0.157149 Aug 31 16:58:45.666131 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3638/7293] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:58:45 2022] GET /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:58:46.686683 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c4abe8fa-ee35-42ba-a401-26a4feb926b6 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:58:46.687224 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c4abe8fa-ee35-42ba-a401-26a4feb926b6 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: 22d313f2-f865-4823-bf70-c963835ae9d5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:58:46.694320 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c4abe8fa-ee35-42ba-a401-26a4feb926b6 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:46.694827 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c4abe8fa-ee35-42ba-a401-26a4feb926b6 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:46.695279 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c4abe8fa-ee35-42ba-a401-26a4feb926b6 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:46.696019 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c4abe8fa-ee35-42ba-a401-26a4feb926b6 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:46.696489 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c4abe8fa-ee35-42ba-a401-26a4feb926b6 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:46.696933 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c4abe8fa-ee35-42ba-a401-26a4feb926b6 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:46.830994 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c4abe8fa-ee35-42ba-a401-26a4feb926b6 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7228e15d12e442b0802ef033bc6158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d77247e9aa471eba23dcc9d2c30e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:58:46.838818 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c4abe8fa-ee35-42ba-a401-26a4feb926b6 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "GET /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5" status: 200 len: 1520 microversion: 2.1 time: 0.156416 Aug 31 16:58:46.839454 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3656/7294] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:58:46 2022] GET /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:58:47.861759 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-16d610a0-e1f9-4756-8c12-1c9049838e82 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:58:47.862399 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-16d610a0-e1f9-4756-8c12-1c9049838e82 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: 22d313f2-f865-4823-bf70-c963835ae9d5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:58:47.869527 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-16d610a0-e1f9-4756-8c12-1c9049838e82 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:47.870012 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-16d610a0-e1f9-4756-8c12-1c9049838e82 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:47.870468 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-16d610a0-e1f9-4756-8c12-1c9049838e82 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:47.871884 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-16d610a0-e1f9-4756-8c12-1c9049838e82 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:47.872545 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-16d610a0-e1f9-4756-8c12-1c9049838e82 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:47.872975 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-16d610a0-e1f9-4756-8c12-1c9049838e82 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:48.014899 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-16d610a0-e1f9-4756-8c12-1c9049838e82 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7228e15d12e442b0802ef033bc6158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d77247e9aa471eba23dcc9d2c30e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:58:48.022596 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-16d610a0-e1f9-4756-8c12-1c9049838e82 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "GET /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5" status: 200 len: 1520 microversion: 2.1 time: 0.165047 Aug 31 16:58:48.023162 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3639/7295] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:58:47 2022] GET /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:58:49.043920 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e5655491-b74a-4692-8323-19cf719157d3 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:58:49.044568 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e5655491-b74a-4692-8323-19cf719157d3 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: 22d313f2-f865-4823-bf70-c963835ae9d5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:58:49.051060 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e5655491-b74a-4692-8323-19cf719157d3 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:49.051608 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e5655491-b74a-4692-8323-19cf719157d3 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:49.052074 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e5655491-b74a-4692-8323-19cf719157d3 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:49.052795 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e5655491-b74a-4692-8323-19cf719157d3 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:49.053276 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e5655491-b74a-4692-8323-19cf719157d3 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:49.053749 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e5655491-b74a-4692-8323-19cf719157d3 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:49.187015 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e5655491-b74a-4692-8323-19cf719157d3 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7228e15d12e442b0802ef033bc6158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d77247e9aa471eba23dcc9d2c30e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:58:49.194933 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e5655491-b74a-4692-8323-19cf719157d3 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "GET /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5" status: 200 len: 1520 microversion: 2.1 time: 0.156092 Aug 31 16:58:49.195537 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3657/7296] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:58:49 2022] GET /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:58:50.217516 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e7c42ea2-f814-4dad-8646-468c016b2f8b tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:58:50.218140 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e7c42ea2-f814-4dad-8646-468c016b2f8b tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: 22d313f2-f865-4823-bf70-c963835ae9d5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:58:50.225005 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e7c42ea2-f814-4dad-8646-468c016b2f8b tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:50.225501 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e7c42ea2-f814-4dad-8646-468c016b2f8b tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:50.225950 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e7c42ea2-f814-4dad-8646-468c016b2f8b tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:50.226653 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e7c42ea2-f814-4dad-8646-468c016b2f8b tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:50.227174 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e7c42ea2-f814-4dad-8646-468c016b2f8b tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:50.227645 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e7c42ea2-f814-4dad-8646-468c016b2f8b tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:50.363166 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e7c42ea2-f814-4dad-8646-468c016b2f8b tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7228e15d12e442b0802ef033bc6158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d77247e9aa471eba23dcc9d2c30e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:58:50.372010 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e7c42ea2-f814-4dad-8646-468c016b2f8b tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "GET /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5" status: 200 len: 1520 microversion: 2.1 time: 0.158970 Aug 31 16:58:50.372597 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3640/7297] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:58:50 2022] GET /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:58:51.393526 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a253eb19-ceea-47f2-a0b6-38f8af876d43 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:58:51.394147 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a253eb19-ceea-47f2-a0b6-38f8af876d43 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: 22d313f2-f865-4823-bf70-c963835ae9d5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:58:51.401254 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a253eb19-ceea-47f2-a0b6-38f8af876d43 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:51.402445 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a253eb19-ceea-47f2-a0b6-38f8af876d43 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:51.403521 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a253eb19-ceea-47f2-a0b6-38f8af876d43 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:51.404270 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a253eb19-ceea-47f2-a0b6-38f8af876d43 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:51.404780 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a253eb19-ceea-47f2-a0b6-38f8af876d43 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:51.405219 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a253eb19-ceea-47f2-a0b6-38f8af876d43 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:51.540765 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a253eb19-ceea-47f2-a0b6-38f8af876d43 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7228e15d12e442b0802ef033bc6158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d77247e9aa471eba23dcc9d2c30e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:58:51.548780 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a253eb19-ceea-47f2-a0b6-38f8af876d43 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "GET /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5" status: 200 len: 1520 microversion: 2.1 time: 0.159386 Aug 31 16:58:51.549358 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3658/7298] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:58:51 2022] GET /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:58:52.570189 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ca2dcdff-1aab-4e9c-b4ac-4f8e385a7113 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:58:52.570798 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ca2dcdff-1aab-4e9c-b4ac-4f8e385a7113 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: 22d313f2-f865-4823-bf70-c963835ae9d5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:58:52.578476 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ca2dcdff-1aab-4e9c-b4ac-4f8e385a7113 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:52.578961 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ca2dcdff-1aab-4e9c-b4ac-4f8e385a7113 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:52.579396 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ca2dcdff-1aab-4e9c-b4ac-4f8e385a7113 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:52.580113 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ca2dcdff-1aab-4e9c-b4ac-4f8e385a7113 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:52.580566 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ca2dcdff-1aab-4e9c-b4ac-4f8e385a7113 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:52.580991 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ca2dcdff-1aab-4e9c-b4ac-4f8e385a7113 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:52.714179 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ca2dcdff-1aab-4e9c-b4ac-4f8e385a7113 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7228e15d12e442b0802ef033bc6158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d77247e9aa471eba23dcc9d2c30e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:58:52.722186 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ca2dcdff-1aab-4e9c-b4ac-4f8e385a7113 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "GET /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5" status: 200 len: 1520 microversion: 2.1 time: 0.155942 Aug 31 16:58:52.722757 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3641/7299] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:58:52 2022] GET /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:58:53.743014 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-47912c40-9bf6-4a9f-a236-e91576c72909 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:58:53.743637 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-47912c40-9bf6-4a9f-a236-e91576c72909 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: 22d313f2-f865-4823-bf70-c963835ae9d5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:58:53.751868 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-47912c40-9bf6-4a9f-a236-e91576c72909 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:53.752392 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-47912c40-9bf6-4a9f-a236-e91576c72909 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:53.752855 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-47912c40-9bf6-4a9f-a236-e91576c72909 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:53.753591 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-47912c40-9bf6-4a9f-a236-e91576c72909 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:53.754076 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-47912c40-9bf6-4a9f-a236-e91576c72909 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:53.754528 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-47912c40-9bf6-4a9f-a236-e91576c72909 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:53.903335 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-47912c40-9bf6-4a9f-a236-e91576c72909 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7228e15d12e442b0802ef033bc6158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d77247e9aa471eba23dcc9d2c30e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:58:53.911327 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-47912c40-9bf6-4a9f-a236-e91576c72909 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "GET /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5" status: 200 len: 1520 microversion: 2.1 time: 0.172390 Aug 31 16:58:53.911951 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3659/7300] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:58:53 2022] GET /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5 => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:58:54.934185 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f2670e71-eec6-49dc-aaf6-e55a15e0b6c0 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:58:54.934803 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f2670e71-eec6-49dc-aaf6-e55a15e0b6c0 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: 22d313f2-f865-4823-bf70-c963835ae9d5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:58:54.941714 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f2670e71-eec6-49dc-aaf6-e55a15e0b6c0 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:54.942202 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f2670e71-eec6-49dc-aaf6-e55a15e0b6c0 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:54.942645 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f2670e71-eec6-49dc-aaf6-e55a15e0b6c0 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:54.943356 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f2670e71-eec6-49dc-aaf6-e55a15e0b6c0 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:54.943836 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f2670e71-eec6-49dc-aaf6-e55a15e0b6c0 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:54.944267 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f2670e71-eec6-49dc-aaf6-e55a15e0b6c0 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:55.076656 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f2670e71-eec6-49dc-aaf6-e55a15e0b6c0 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7228e15d12e442b0802ef033bc6158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d77247e9aa471eba23dcc9d2c30e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:58:55.084456 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f2670e71-eec6-49dc-aaf6-e55a15e0b6c0 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "GET /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5" status: 200 len: 1520 microversion: 2.1 time: 0.154850 Aug 31 16:58:55.085031 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3642/7301] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:58:54 2022] GET /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:58:56.105822 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-35e9af51-78e3-4772-9464-f44b3ba1b862 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:58:56.106445 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-35e9af51-78e3-4772-9464-f44b3ba1b862 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: 22d313f2-f865-4823-bf70-c963835ae9d5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:58:56.113285 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-35e9af51-78e3-4772-9464-f44b3ba1b862 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:56.113780 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-35e9af51-78e3-4772-9464-f44b3ba1b862 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:56.114229 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-35e9af51-78e3-4772-9464-f44b3ba1b862 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:56.114932 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-35e9af51-78e3-4772-9464-f44b3ba1b862 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:56.115407 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-35e9af51-78e3-4772-9464-f44b3ba1b862 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:56.115876 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-35e9af51-78e3-4772-9464-f44b3ba1b862 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:56.248073 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-35e9af51-78e3-4772-9464-f44b3ba1b862 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7228e15d12e442b0802ef033bc6158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d77247e9aa471eba23dcc9d2c30e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:58:56.256072 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-35e9af51-78e3-4772-9464-f44b3ba1b862 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "GET /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5" status: 200 len: 1520 microversion: 2.1 time: 0.154259 Aug 31 16:58:56.256650 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3660/7302] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:58:56 2022] GET /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:58:57.277389 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a11003b7-e2fc-4954-80e0-682e266e37d1 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:58:57.278034 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a11003b7-e2fc-4954-80e0-682e266e37d1 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: 22d313f2-f865-4823-bf70-c963835ae9d5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:58:57.285178 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a11003b7-e2fc-4954-80e0-682e266e37d1 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:57.285677 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a11003b7-e2fc-4954-80e0-682e266e37d1 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:57.286125 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a11003b7-e2fc-4954-80e0-682e266e37d1 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:57.286865 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a11003b7-e2fc-4954-80e0-682e266e37d1 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:57.287332 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a11003b7-e2fc-4954-80e0-682e266e37d1 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:57.287805 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a11003b7-e2fc-4954-80e0-682e266e37d1 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:57.426582 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a11003b7-e2fc-4954-80e0-682e266e37d1 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7228e15d12e442b0802ef033bc6158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d77247e9aa471eba23dcc9d2c30e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:58:57.434584 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a11003b7-e2fc-4954-80e0-682e266e37d1 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "GET /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5" status: 200 len: 1520 microversion: 2.1 time: 0.161278 Aug 31 16:58:57.435162 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3643/7303] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:58:57 2022] GET /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:58:58.456224 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f4524784-7dd2-4de1-b567-7f44e2ed7cce tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:58:58.456863 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f4524784-7dd2-4de1-b567-7f44e2ed7cce tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: 22d313f2-f865-4823-bf70-c963835ae9d5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:58:58.463848 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f4524784-7dd2-4de1-b567-7f44e2ed7cce tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:58.465006 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f4524784-7dd2-4de1-b567-7f44e2ed7cce tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:58.466482 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f4524784-7dd2-4de1-b567-7f44e2ed7cce tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:58.467210 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f4524784-7dd2-4de1-b567-7f44e2ed7cce tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:58.467720 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f4524784-7dd2-4de1-b567-7f44e2ed7cce tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:58.468174 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f4524784-7dd2-4de1-b567-7f44e2ed7cce tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:58.600067 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f4524784-7dd2-4de1-b567-7f44e2ed7cce tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7228e15d12e442b0802ef033bc6158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d77247e9aa471eba23dcc9d2c30e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:58:58.608436 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f4524784-7dd2-4de1-b567-7f44e2ed7cce tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "GET /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5" status: 200 len: 1520 microversion: 2.1 time: 0.156221 Aug 31 16:58:58.609029 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3661/7304] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:58:58 2022] GET /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:58:59.630276 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3fa9551c-2baa-4b0e-8efe-23913fce7a9f tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:58:59.630893 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3fa9551c-2baa-4b0e-8efe-23913fce7a9f tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: 22d313f2-f865-4823-bf70-c963835ae9d5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:58:59.637990 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3fa9551c-2baa-4b0e-8efe-23913fce7a9f tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:59.638480 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3fa9551c-2baa-4b0e-8efe-23913fce7a9f tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:59.638924 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3fa9551c-2baa-4b0e-8efe-23913fce7a9f tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:59.639672 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3fa9551c-2baa-4b0e-8efe-23913fce7a9f tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:59.640142 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3fa9551c-2baa-4b0e-8efe-23913fce7a9f tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:59.640575 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3fa9551c-2baa-4b0e-8efe-23913fce7a9f tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:59.781570 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3fa9551c-2baa-4b0e-8efe-23913fce7a9f tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7228e15d12e442b0802ef033bc6158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d77247e9aa471eba23dcc9d2c30e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:58:59.789332 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3fa9551c-2baa-4b0e-8efe-23913fce7a9f tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "GET /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5" status: 200 len: 1520 microversion: 2.1 time: 0.162997 Aug 31 16:58:59.789918 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3644/7305] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:58:59 2022] GET /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:59:00.812332 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-14c5a99d-76ae-4d38-9784-26ced56a9d5a tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:59:00.813095 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-14c5a99d-76ae-4d38-9784-26ced56a9d5a tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: 22d313f2-f865-4823-bf70-c963835ae9d5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:59:00.820295 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-14c5a99d-76ae-4d38-9784-26ced56a9d5a tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:00.820815 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-14c5a99d-76ae-4d38-9784-26ced56a9d5a tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:00.821281 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-14c5a99d-76ae-4d38-9784-26ced56a9d5a tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:00.822012 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-14c5a99d-76ae-4d38-9784-26ced56a9d5a tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:00.822494 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-14c5a99d-76ae-4d38-9784-26ced56a9d5a tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:00.822944 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-14c5a99d-76ae-4d38-9784-26ced56a9d5a tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:00.958628 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-14c5a99d-76ae-4d38-9784-26ced56a9d5a tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7228e15d12e442b0802ef033bc6158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d77247e9aa471eba23dcc9d2c30e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:59:00.966707 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-14c5a99d-76ae-4d38-9784-26ced56a9d5a tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "GET /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5" status: 200 len: 1520 microversion: 2.1 time: 0.159070 Aug 31 16:59:00.967287 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3662/7306] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:59:00 2022] GET /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:59:01.987948 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6fe9199d-6a74-41d0-afb7-bcaa76d40dee tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:59:01.988563 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6fe9199d-6a74-41d0-afb7-bcaa76d40dee tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: 22d313f2-f865-4823-bf70-c963835ae9d5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:59:01.996172 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6fe9199d-6a74-41d0-afb7-bcaa76d40dee tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:01.996761 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6fe9199d-6a74-41d0-afb7-bcaa76d40dee tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:01.997204 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6fe9199d-6a74-41d0-afb7-bcaa76d40dee tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:01.997902 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6fe9199d-6a74-41d0-afb7-bcaa76d40dee tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:01.998363 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6fe9199d-6a74-41d0-afb7-bcaa76d40dee tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:01.998824 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6fe9199d-6a74-41d0-afb7-bcaa76d40dee tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:02.132159 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-6fe9199d-6a74-41d0-afb7-bcaa76d40dee tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7228e15d12e442b0802ef033bc6158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d77247e9aa471eba23dcc9d2c30e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:59:02.140060 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6fe9199d-6a74-41d0-afb7-bcaa76d40dee tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "GET /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5" status: 200 len: 1520 microversion: 2.1 time: 0.156082 Aug 31 16:59:02.140635 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3645/7307] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:59:01 2022] GET /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:59:03.161189 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-fff4bdf0-845d-4955-ae8e-1a690805a85b tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:59:03.161836 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-fff4bdf0-845d-4955-ae8e-1a690805a85b tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: 22d313f2-f865-4823-bf70-c963835ae9d5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:59:03.169438 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fff4bdf0-845d-4955-ae8e-1a690805a85b tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:03.169958 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fff4bdf0-845d-4955-ae8e-1a690805a85b tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:03.170421 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fff4bdf0-845d-4955-ae8e-1a690805a85b tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:03.171147 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fff4bdf0-845d-4955-ae8e-1a690805a85b tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:03.171662 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fff4bdf0-845d-4955-ae8e-1a690805a85b tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:03.172120 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fff4bdf0-845d-4955-ae8e-1a690805a85b tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:03.302422 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-fff4bdf0-845d-4955-ae8e-1a690805a85b tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7228e15d12e442b0802ef033bc6158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d77247e9aa471eba23dcc9d2c30e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:59:03.310753 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-fff4bdf0-845d-4955-ae8e-1a690805a85b tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "GET /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5" status: 200 len: 1520 microversion: 2.1 time: 0.153573 Aug 31 16:59:03.311331 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3663/7308] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:59:03 2022] GET /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:59:04.332140 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8bc9dfd8-3f46-4813-a387-574f7977073f tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:59:04.332763 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8bc9dfd8-3f46-4813-a387-574f7977073f tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: 22d313f2-f865-4823-bf70-c963835ae9d5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:59:04.341577 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8bc9dfd8-3f46-4813-a387-574f7977073f tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:04.342084 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8bc9dfd8-3f46-4813-a387-574f7977073f tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:04.342960 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8bc9dfd8-3f46-4813-a387-574f7977073f tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:04.343233 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8bc9dfd8-3f46-4813-a387-574f7977073f tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:04.343844 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8bc9dfd8-3f46-4813-a387-574f7977073f tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:04.345439 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8bc9dfd8-3f46-4813-a387-574f7977073f tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:04.361366 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:59:04.480188 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8bc9dfd8-3f46-4813-a387-574f7977073f tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7228e15d12e442b0802ef033bc6158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d77247e9aa471eba23dcc9d2c30e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:59:04.487864 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8bc9dfd8-3f46-4813-a387-574f7977073f tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "GET /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5" status: 200 len: 1520 microversion: 2.1 time: 0.159513 Aug 31 16:59:04.488434 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3646/7309] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:59:04 2022] GET /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:59:05.512737 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-988108c1-e7c3-4bee-bd34-1124d5da2ec9 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:59:05.513379 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-988108c1-e7c3-4bee-bd34-1124d5da2ec9 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: 22d313f2-f865-4823-bf70-c963835ae9d5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:59:05.521065 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-988108c1-e7c3-4bee-bd34-1124d5da2ec9 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:05.521950 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-988108c1-e7c3-4bee-bd34-1124d5da2ec9 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:05.522416 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-988108c1-e7c3-4bee-bd34-1124d5da2ec9 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:05.523148 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-988108c1-e7c3-4bee-bd34-1124d5da2ec9 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:05.523659 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-988108c1-e7c3-4bee-bd34-1124d5da2ec9 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:05.524109 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-988108c1-e7c3-4bee-bd34-1124d5da2ec9 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:05.526868 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=89 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:59:05.657810 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-988108c1-e7c3-4bee-bd34-1124d5da2ec9 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7228e15d12e442b0802ef033bc6158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d77247e9aa471eba23dcc9d2c30e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:59:05.665535 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-988108c1-e7c3-4bee-bd34-1124d5da2ec9 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "GET /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5" status: 200 len: 1520 microversion: 2.1 time: 0.159601 Aug 31 16:59:05.666104 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3664/7310] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:59:05 2022] GET /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:59:06.687265 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-479616b1-e5e8-40b9-a961-1bc3e6cb59aa tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:59:06.687931 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-479616b1-e5e8-40b9-a961-1bc3e6cb59aa tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: 22d313f2-f865-4823-bf70-c963835ae9d5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:59:06.695130 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-479616b1-e5e8-40b9-a961-1bc3e6cb59aa tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:06.695667 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-479616b1-e5e8-40b9-a961-1bc3e6cb59aa tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:06.696112 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-479616b1-e5e8-40b9-a961-1bc3e6cb59aa tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:06.696822 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-479616b1-e5e8-40b9-a961-1bc3e6cb59aa tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:06.697286 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-479616b1-e5e8-40b9-a961-1bc3e6cb59aa tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:06.697721 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-479616b1-e5e8-40b9-a961-1bc3e6cb59aa tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:06.920784 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-479616b1-e5e8-40b9-a961-1bc3e6cb59aa tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7228e15d12e442b0802ef033bc6158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d77247e9aa471eba23dcc9d2c30e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:59:06.929403 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-479616b1-e5e8-40b9-a961-1bc3e6cb59aa tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "GET /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5" status: 200 len: 1519 microversion: 2.1 time: 0.247079 Aug 31 16:59:06.930073 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3647/7311] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:59:06 2022] GET /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5 => generated 1519 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:59:07.210022 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-7729269e-50f0-492f-9bd6-3a94e709b0d3 req-e9952a42-e942-427e-97e3-5dd2b44fd102 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22d313f2-f865-4823-bf70-c963835ae9d5", "name": "network-vif-unplugged", "status": "completed", "tag": "272cb998-cea9-4a28-8451-7c9ae53b4f45"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:59:07.226350 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-7729269e-50f0-492f-9bd6-3a94e709b0d3 req-e9952a42-e942-427e-97e3-5dd2b44fd102 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:07.226908 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-7729269e-50f0-492f-9bd6-3a94e709b0d3 req-e9952a42-e942-427e-97e3-5dd2b44fd102 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:07.227361 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-7729269e-50f0-492f-9bd6-3a94e709b0d3 req-e9952a42-e942-427e-97e3-5dd2b44fd102 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:07.244877 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-7729269e-50f0-492f-9bd6-3a94e709b0d3 req-e9952a42-e942-427e-97e3-5dd2b44fd102 service nova] Creating event network-vif-unplugged:272cb998-cea9-4a28-8451-7c9ae53b4f45 for instance 22d313f2-f865-4823-bf70-c963835ae9d5 on n-h1-850499-9 Aug 31 16:59:07.251408 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [req-7729269e-50f0-492f-9bd6-3a94e709b0d3 req-e9952a42-e942-427e-97e3-5dd2b44fd102 service nova] Instance 22d313f2-f865-4823-bf70-c963835ae9d5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850499-9', 'n-h2-850499-9'} {{(pid=122257) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 31 16:59:07.263920 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-7729269e-50f0-492f-9bd6-3a94e709b0d3 req-e9952a42-e942-427e-97e3-5dd2b44fd102 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057494 Aug 31 16:59:07.264510 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3665/7312] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:59:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:59:07.951280 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e7e3bc2c-6880-4d90-af4b-f6a2ea9edde7 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:59:07.951855 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e7e3bc2c-6880-4d90-af4b-f6a2ea9edde7 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: 22d313f2-f865-4823-bf70-c963835ae9d5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:59:07.958740 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e7e3bc2c-6880-4d90-af4b-f6a2ea9edde7 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:07.959233 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e7e3bc2c-6880-4d90-af4b-f6a2ea9edde7 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:07.959722 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e7e3bc2c-6880-4d90-af4b-f6a2ea9edde7 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:07.960421 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e7e3bc2c-6880-4d90-af4b-f6a2ea9edde7 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:07.960883 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e7e3bc2c-6880-4d90-af4b-f6a2ea9edde7 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:07.961311 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e7e3bc2c-6880-4d90-af4b-f6a2ea9edde7 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:08.094446 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e7e3bc2c-6880-4d90-af4b-f6a2ea9edde7 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7228e15d12e442b0802ef033bc6158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d77247e9aa471eba23dcc9d2c30e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:59:08.102164 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e7e3bc2c-6880-4d90-af4b-f6a2ea9edde7 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "GET /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5" status: 200 len: 1519 microversion: 2.1 time: 0.155277 Aug 31 16:59:08.102734 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3648/7313] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:59:07 2022] GET /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:59:09.125483 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e63d3df3-7542-4fa4-ae73-3e789de9803c tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:59:09.126196 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e63d3df3-7542-4fa4-ae73-3e789de9803c tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: 22d313f2-f865-4823-bf70-c963835ae9d5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:59:09.132579 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e63d3df3-7542-4fa4-ae73-3e789de9803c tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:09.133079 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e63d3df3-7542-4fa4-ae73-3e789de9803c tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:09.133530 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e63d3df3-7542-4fa4-ae73-3e789de9803c tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:09.134264 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e63d3df3-7542-4fa4-ae73-3e789de9803c tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:09.134733 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e63d3df3-7542-4fa4-ae73-3e789de9803c tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:09.135178 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e63d3df3-7542-4fa4-ae73-3e789de9803c tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:09.273411 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e63d3df3-7542-4fa4-ae73-3e789de9803c tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7228e15d12e442b0802ef033bc6158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d77247e9aa471eba23dcc9d2c30e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:59:09.282328 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-8696f33b-172f-4c9a-ab18-1fed0994ba17 req-ce748901-68c2-447a-858a-2d849038df33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22d313f2-f865-4823-bf70-c963835ae9d5", "tag": "272cb998-cea9-4a28-8451-7c9ae53b4f45"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:59:09.283249 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e63d3df3-7542-4fa4-ae73-3e789de9803c tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "GET /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5" status: 200 len: 1517 microversion: 2.1 time: 0.163784 Aug 31 16:59:09.283889 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3666/7314] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:59:09 2022] GET /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5 => generated 1517 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:59:09.293010 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-8696f33b-172f-4c9a-ab18-1fed0994ba17 req-ce748901-68c2-447a-858a-2d849038df33 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:09.293558 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-8696f33b-172f-4c9a-ab18-1fed0994ba17 req-ce748901-68c2-447a-858a-2d849038df33 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:09.294072 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-8696f33b-172f-4c9a-ab18-1fed0994ba17 req-ce748901-68c2-447a-858a-2d849038df33 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:09.305493 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-8696f33b-172f-4c9a-ab18-1fed0994ba17 req-ce748901-68c2-447a-858a-2d849038df33 service nova] Creating event network-changed:272cb998-cea9-4a28-8451-7c9ae53b4f45 for instance 22d313f2-f865-4823-bf70-c963835ae9d5 on n-h1-850499-9 Aug 31 16:59:09.311303 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [req-8696f33b-172f-4c9a-ab18-1fed0994ba17 req-ce748901-68c2-447a-858a-2d849038df33 service nova] Instance 22d313f2-f865-4823-bf70-c963835ae9d5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850499-9', 'n-h2-850499-9'} {{(pid=122256) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 31 16:59:09.322496 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-8696f33b-172f-4c9a-ab18-1fed0994ba17 req-ce748901-68c2-447a-858a-2d849038df33 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044014 Aug 31 16:59:09.323349 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3649/7315] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:59:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:59:10.305597 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2caeab7e-f229-490b-ab9a-c5811fafed42 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:59:10.306229 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2caeab7e-f229-490b-ab9a-c5811fafed42 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: 22d313f2-f865-4823-bf70-c963835ae9d5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:59:10.309221 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=28 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:59:10.314910 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2caeab7e-f229-490b-ab9a-c5811fafed42 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:10.315421 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2caeab7e-f229-490b-ab9a-c5811fafed42 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:10.315903 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2caeab7e-f229-490b-ab9a-c5811fafed42 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:10.316626 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2caeab7e-f229-490b-ab9a-c5811fafed42 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:10.317104 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2caeab7e-f229-490b-ab9a-c5811fafed42 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:10.317551 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2caeab7e-f229-490b-ab9a-c5811fafed42 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:10.451261 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2caeab7e-f229-490b-ab9a-c5811fafed42 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7228e15d12e442b0802ef033bc6158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d77247e9aa471eba23dcc9d2c30e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:59:10.459405 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2caeab7e-f229-490b-ab9a-c5811fafed42 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "GET /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5" status: 200 len: 1517 microversion: 2.1 time: 0.157885 Aug 31 16:59:10.460027 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3667/7316] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:59:10 2022] GET /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5 => generated 1517 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:59:11.481525 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3911bec5-c0fc-420d-aabc-8f4a1a9fce92 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:59:11.482237 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3911bec5-c0fc-420d-aabc-8f4a1a9fce92 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: 22d313f2-f865-4823-bf70-c963835ae9d5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:59:11.485183 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=28 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:59:11.491177 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3911bec5-c0fc-420d-aabc-8f4a1a9fce92 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:11.491707 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3911bec5-c0fc-420d-aabc-8f4a1a9fce92 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:11.492152 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3911bec5-c0fc-420d-aabc-8f4a1a9fce92 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:11.492859 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3911bec5-c0fc-420d-aabc-8f4a1a9fce92 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:11.493321 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3911bec5-c0fc-420d-aabc-8f4a1a9fce92 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:11.493751 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3911bec5-c0fc-420d-aabc-8f4a1a9fce92 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:11.718621 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3911bec5-c0fc-420d-aabc-8f4a1a9fce92 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7228e15d12e442b0802ef033bc6158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d77247e9aa471eba23dcc9d2c30e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:59:11.726624 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3911bec5-c0fc-420d-aabc-8f4a1a9fce92 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "GET /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5" status: 200 len: 1514 microversion: 2.1 time: 0.249382 Aug 31 16:59:11.727223 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3650/7317] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:59:11 2022] GET /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5 => generated 1514 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:59:11.748244 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a0fffac0-3d12-431f-adb6-11e58ca2340d tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:59:11.748906 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a0fffac0-3d12-431f-adb6-11e58ca2340d tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: 22d313f2-f865-4823-bf70-c963835ae9d5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:59:11.757713 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a0fffac0-3d12-431f-adb6-11e58ca2340d tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:11.758467 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a0fffac0-3d12-431f-adb6-11e58ca2340d tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:11.758997 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a0fffac0-3d12-431f-adb6-11e58ca2340d tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:11.759852 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a0fffac0-3d12-431f-adb6-11e58ca2340d tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:11.760421 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a0fffac0-3d12-431f-adb6-11e58ca2340d tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:11.761030 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a0fffac0-3d12-431f-adb6-11e58ca2340d tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:11.826754 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a0fffac0-3d12-431f-adb6-11e58ca2340d tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "POST /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5/action" status: 204 len: 0 microversion: 2.1 time: 0.083063 Aug 31 16:59:11.827833 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3668/7318] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 16:59:11 2022] POST /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5/action => generated 0 bytes in 85 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:59:11.835748 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-849cfa61-85c3-42d5-8cc4-daa0f76ae30e tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:59:11.836610 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-849cfa61-85c3-42d5-8cc4-daa0f76ae30e tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: 22d313f2-f865-4823-bf70-c963835ae9d5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:59:11.852321 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-849cfa61-85c3-42d5-8cc4-daa0f76ae30e tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:11.857123 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-849cfa61-85c3-42d5-8cc4-daa0f76ae30e tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:11.857804 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-849cfa61-85c3-42d5-8cc4-daa0f76ae30e tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:11.858743 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-849cfa61-85c3-42d5-8cc4-daa0f76ae30e tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:11.859373 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-849cfa61-85c3-42d5-8cc4-daa0f76ae30e tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:11.860040 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-849cfa61-85c3-42d5-8cc4-daa0f76ae30e tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:12.352591 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-849cfa61-85c3-42d5-8cc4-daa0f76ae30e tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7228e15d12e442b0802ef033bc6158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d77247e9aa471eba23dcc9d2c30e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:59:12.361235 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-849cfa61-85c3-42d5-8cc4-daa0f76ae30e tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "GET /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5" status: 200 len: 1514 microversion: 2.1 time: 0.529458 Aug 31 16:59:12.361814 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3651/7319] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:59:11 2022] GET /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5 => generated 1514 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:59:13.303394 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-89a71fa9-3cba-4d4e-83fe-d304d59c9d18 req-1791783b-7c23-45dc-95c5-d5f08211ea94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22d313f2-f865-4823-bf70-c963835ae9d5", "name": "network-vif-plugged", "status": "completed", "tag": "272cb998-cea9-4a28-8451-7c9ae53b4f45"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:59:13.313528 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-89a71fa9-3cba-4d4e-83fe-d304d59c9d18 req-1791783b-7c23-45dc-95c5-d5f08211ea94 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:13.314231 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-89a71fa9-3cba-4d4e-83fe-d304d59c9d18 req-1791783b-7c23-45dc-95c5-d5f08211ea94 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:13.316117 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-89a71fa9-3cba-4d4e-83fe-d304d59c9d18 req-1791783b-7c23-45dc-95c5-d5f08211ea94 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:13.327405 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-89a71fa9-3cba-4d4e-83fe-d304d59c9d18 req-1791783b-7c23-45dc-95c5-d5f08211ea94 service nova] Creating event network-vif-plugged:272cb998-cea9-4a28-8451-7c9ae53b4f45 for instance 22d313f2-f865-4823-bf70-c963835ae9d5 on n-h1-850499-9 Aug 31 16:59:13.332897 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [req-89a71fa9-3cba-4d4e-83fe-d304d59c9d18 req-1791783b-7c23-45dc-95c5-d5f08211ea94 service nova] Instance 22d313f2-f865-4823-bf70-c963835ae9d5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850499-9', 'n-h2-850499-9'} {{(pid=122257) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 31 16:59:13.344322 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-89a71fa9-3cba-4d4e-83fe-d304d59c9d18 req-1791783b-7c23-45dc-95c5-d5f08211ea94 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045979 Aug 31 16:59:13.344944 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3669/7320] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:59:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:59:13.382778 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-23da3411-12fd-435a-9389-913cd33fd728 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:59:13.383398 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-23da3411-12fd-435a-9389-913cd33fd728 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: 22d313f2-f865-4823-bf70-c963835ae9d5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:59:13.391418 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-23da3411-12fd-435a-9389-913cd33fd728 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:13.391959 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-23da3411-12fd-435a-9389-913cd33fd728 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:13.392411 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-23da3411-12fd-435a-9389-913cd33fd728 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:13.393124 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-23da3411-12fd-435a-9389-913cd33fd728 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:13.393588 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-23da3411-12fd-435a-9389-913cd33fd728 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:13.394024 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-23da3411-12fd-435a-9389-913cd33fd728 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:13.536501 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-23da3411-12fd-435a-9389-913cd33fd728 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7228e15d12e442b0802ef033bc6158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d77247e9aa471eba23dcc9d2c30e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:59:13.545149 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-23da3411-12fd-435a-9389-913cd33fd728 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "GET /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5" status: 200 len: 1514 microversion: 2.1 time: 0.166530 Aug 31 16:59:13.545942 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3652/7321] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:59:13 2022] GET /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5 => generated 1514 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:59:14.568864 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-bf8d89f2-4dc5-4d4f-9a26-582eeab6a646 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:59:14.569591 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-bf8d89f2-4dc5-4d4f-9a26-582eeab6a646 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: 22d313f2-f865-4823-bf70-c963835ae9d5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:59:14.576402 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bf8d89f2-4dc5-4d4f-9a26-582eeab6a646 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:14.576917 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bf8d89f2-4dc5-4d4f-9a26-582eeab6a646 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:14.577383 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bf8d89f2-4dc5-4d4f-9a26-582eeab6a646 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:14.578101 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bf8d89f2-4dc5-4d4f-9a26-582eeab6a646 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:14.578588 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bf8d89f2-4dc5-4d4f-9a26-582eeab6a646 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:14.579037 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bf8d89f2-4dc5-4d4f-9a26-582eeab6a646 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:14.767210 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-bf8d89f2-4dc5-4d4f-9a26-582eeab6a646 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7228e15d12e442b0802ef033bc6158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d77247e9aa471eba23dcc9d2c30e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:59:14.775056 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-bf8d89f2-4dc5-4d4f-9a26-582eeab6a646 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "GET /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5" status: 200 len: 1506 microversion: 2.1 time: 0.211501 Aug 31 16:59:14.775658 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3670/7322] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:59:14 2022] GET /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5 => generated 1506 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:59:14.795770 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-15a66f19-883e-43b6-bab3-8d93ecd550c5 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:59:14.796395 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-15a66f19-883e-43b6-bab3-8d93ecd550c5 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: 22d313f2-f865-4823-bf70-c963835ae9d5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:59:14.803189 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-15a66f19-883e-43b6-bab3-8d93ecd550c5 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:14.803732 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-15a66f19-883e-43b6-bab3-8d93ecd550c5 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:14.804179 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-15a66f19-883e-43b6-bab3-8d93ecd550c5 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:14.804875 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-15a66f19-883e-43b6-bab3-8d93ecd550c5 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:14.805342 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-15a66f19-883e-43b6-bab3-8d93ecd550c5 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:14.805771 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-15a66f19-883e-43b6-bab3-8d93ecd550c5 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:14.988976 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-15a66f19-883e-43b6-bab3-8d93ecd550c5 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7228e15d12e442b0802ef033bc6158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d77247e9aa471eba23dcc9d2c30e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:59:14.999730 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-15a66f19-883e-43b6-bab3-8d93ecd550c5 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "GET /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5" status: 200 len: 1506 microversion: 2.1 time: 0.208153 Aug 31 16:59:15.001279 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3653/7323] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:59:14 2022] GET /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5 => generated 1506 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:59:15.021233 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-81af9f79-77ff-469d-bcc1-3d66830384cd tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:59:15.021871 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-81af9f79-77ff-469d-bcc1-3d66830384cd tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: 22d313f2-f865-4823-bf70-c963835ae9d5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:59:15.028501 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-81af9f79-77ff-469d-bcc1-3d66830384cd tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:15.029007 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-81af9f79-77ff-469d-bcc1-3d66830384cd tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:15.029467 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-81af9f79-77ff-469d-bcc1-3d66830384cd tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:15.030178 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-81af9f79-77ff-469d-bcc1-3d66830384cd tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:15.030661 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-81af9f79-77ff-469d-bcc1-3d66830384cd tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:15.031106 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-81af9f79-77ff-469d-bcc1-3d66830384cd tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:15.165199 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-81af9f79-77ff-469d-bcc1-3d66830384cd tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7228e15d12e442b0802ef033bc6158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d77247e9aa471eba23dcc9d2c30e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:59:15.174685 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-81af9f79-77ff-469d-bcc1-3d66830384cd tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "GET /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5" status: 200 len: 1506 microversion: 2.1 time: 0.157076 Aug 31 16:59:15.175269 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3671/7324] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:59:15 2022] GET /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5 => generated 1506 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:59:15.194584 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e4687007-491a-4b0d-98fc-26135a8253ca tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:59:15.195090 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e4687007-491a-4b0d-98fc-26135a8253ca tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: 22d313f2-f865-4823-bf70-c963835ae9d5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:59:15.201510 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e4687007-491a-4b0d-98fc-26135a8253ca tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:15.202006 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e4687007-491a-4b0d-98fc-26135a8253ca tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:15.202453 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e4687007-491a-4b0d-98fc-26135a8253ca tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:15.203153 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e4687007-491a-4b0d-98fc-26135a8253ca tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:15.203642 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e4687007-491a-4b0d-98fc-26135a8253ca tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:15.204079 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e4687007-491a-4b0d-98fc-26135a8253ca tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:15.230640 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e4687007-491a-4b0d-98fc-26135a8253ca tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: 22d313f2-f865-4823-bf70-c963835ae9d5] Going to try to terminate instance {{(pid=122256) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:59:15.306243 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e4687007-491a-4b0d-98fc-26135a8253ca tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "DELETE /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5" status: 204 len: 0 microversion: 2.1 time: 0.115153 Aug 31 16:59:15.306870 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3654/7325] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:59:15 2022] DELETE /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:59:15.320718 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-33c7719c-7e95-44d3-ac07-40e57ccc4075 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:59:15.321269 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-33c7719c-7e95-44d3-ac07-40e57ccc4075 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: 22d313f2-f865-4823-bf70-c963835ae9d5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:59:15.328094 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-33c7719c-7e95-44d3-ac07-40e57ccc4075 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:15.328608 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-33c7719c-7e95-44d3-ac07-40e57ccc4075 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:15.329071 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-33c7719c-7e95-44d3-ac07-40e57ccc4075 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:15.329797 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-33c7719c-7e95-44d3-ac07-40e57ccc4075 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:15.330282 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-33c7719c-7e95-44d3-ac07-40e57ccc4075 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:15.330734 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-33c7719c-7e95-44d3-ac07-40e57ccc4075 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:15.357414 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-33c7719c-7e95-44d3-ac07-40e57ccc4075 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: 22d313f2-f865-4823-bf70-c963835ae9d5] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:59:15.411325 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.compute.api [None req-33c7719c-7e95-44d3-ac07-40e57ccc4075 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: 22d313f2-f865-4823-bf70-c963835ae9d5] Instance is already in deleting state, ignoring this request Aug 31 16:59:15.412214 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-33c7719c-7e95-44d3-ac07-40e57ccc4075 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "DELETE /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5" status: 204 len: 0 microversion: 2.1 time: 0.095495 Aug 31 16:59:15.412790 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3672/7326] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:59:15 2022] DELETE /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:59:15.421800 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c8b3c46b-2471-4f9c-b1a5-e393d3921888 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:59:15.422515 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c8b3c46b-2471-4f9c-b1a5-e393d3921888 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: 22d313f2-f865-4823-bf70-c963835ae9d5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:59:15.428744 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c8b3c46b-2471-4f9c-b1a5-e393d3921888 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:15.429238 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c8b3c46b-2471-4f9c-b1a5-e393d3921888 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:15.429687 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c8b3c46b-2471-4f9c-b1a5-e393d3921888 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:15.430384 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c8b3c46b-2471-4f9c-b1a5-e393d3921888 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:15.430844 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c8b3c46b-2471-4f9c-b1a5-e393d3921888 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:15.431276 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c8b3c46b-2471-4f9c-b1a5-e393d3921888 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:15.562247 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c8b3c46b-2471-4f9c-b1a5-e393d3921888 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7228e15d12e442b0802ef033bc6158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d77247e9aa471eba23dcc9d2c30e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:59:15.570083 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c8b3c46b-2471-4f9c-b1a5-e393d3921888 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "GET /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5" status: 200 len: 1512 microversion: 2.1 time: 0.152526 Aug 31 16:59:15.570685 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3655/7327] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:59:15 2022] GET /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5 => generated 1512 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:59:16.592061 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a5a3103b-f5ee-4b04-a0aa-fe37c14c5773 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:59:16.592698 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a5a3103b-f5ee-4b04-a0aa-fe37c14c5773 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: 22d313f2-f865-4823-bf70-c963835ae9d5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:59:16.599527 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a5a3103b-f5ee-4b04-a0aa-fe37c14c5773 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:16.600041 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a5a3103b-f5ee-4b04-a0aa-fe37c14c5773 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:16.600499 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a5a3103b-f5ee-4b04-a0aa-fe37c14c5773 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:16.601219 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a5a3103b-f5ee-4b04-a0aa-fe37c14c5773 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:16.601699 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a5a3103b-f5ee-4b04-a0aa-fe37c14c5773 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:16.602145 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a5a3103b-f5ee-4b04-a0aa-fe37c14c5773 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:16.735521 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a5a3103b-f5ee-4b04-a0aa-fe37c14c5773 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7228e15d12e442b0802ef033bc6158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d77247e9aa471eba23dcc9d2c30e72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:59:16.743403 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a5a3103b-f5ee-4b04-a0aa-fe37c14c5773 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "GET /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5" status: 200 len: 1512 microversion: 2.1 time: 0.155678 Aug 31 16:59:16.744014 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3673/7328] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:59:16 2022] GET /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5 => generated 1512 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:59:17.422562 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-cad4d095-432f-4d04-b75f-3b658353dd83 req-4c7ce659-aae7-4614-9ac8-c81769be6587 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22d313f2-f865-4823-bf70-c963835ae9d5", "name": "network-vif-deleted", "tag": "272cb998-cea9-4a28-8451-7c9ae53b4f45"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:59:17.440548 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-cad4d095-432f-4d04-b75f-3b658353dd83 req-4c7ce659-aae7-4614-9ac8-c81769be6587 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:17.441059 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-cad4d095-432f-4d04-b75f-3b658353dd83 req-4c7ce659-aae7-4614-9ac8-c81769be6587 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:17.441873 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-cad4d095-432f-4d04-b75f-3b658353dd83 req-4c7ce659-aae7-4614-9ac8-c81769be6587 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:17.457505 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-cad4d095-432f-4d04-b75f-3b658353dd83 req-4c7ce659-aae7-4614-9ac8-c81769be6587 service nova] Creating event network-vif-deleted:272cb998-cea9-4a28-8451-7c9ae53b4f45 for instance 22d313f2-f865-4823-bf70-c963835ae9d5 on n-h1-850499-9 Aug 31 16:59:17.465462 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-cad4d095-432f-4d04-b75f-3b658353dd83 req-4c7ce659-aae7-4614-9ac8-c81769be6587 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047243 Aug 31 16:59:17.466401 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3656/7329] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:59:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:59:17.765981 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-eb57be7d-e734-4442-89a5-d9f80fb0742c tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:59:17.766617 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-eb57be7d-e734-4442-89a5-d9f80fb0742c tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: 22d313f2-f865-4823-bf70-c963835ae9d5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:59:17.772801 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eb57be7d-e734-4442-89a5-d9f80fb0742c tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:17.773314 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eb57be7d-e734-4442-89a5-d9f80fb0742c tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:17.773778 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eb57be7d-e734-4442-89a5-d9f80fb0742c tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:17.774496 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eb57be7d-e734-4442-89a5-d9f80fb0742c tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:17.774977 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eb57be7d-e734-4442-89a5-d9f80fb0742c tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:17.775427 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eb57be7d-e734-4442-89a5-d9f80fb0742c tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:17.789240 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-eb57be7d-e734-4442-89a5-d9f80fb0742c tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] HTTP exception thrown: Instance 22d313f2-f865-4823-bf70-c963835ae9d5 could not be found. Aug 31 16:59:17.790928 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-eb57be7d-e734-4442-89a5-d9f80fb0742c tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Request method failure captured: Aug 31 16:59:17.790928 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5 HTTP/1.1 Aug 31 16:59:17.790928 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:59:17.790928 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:59:17.790928 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:59:17.790928 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:59:17.790928 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:59:17.790928 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:59:17.790928 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:59:17.790928 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:59:17.790928 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD5L7EdGmgP8U8uIQVXkwknVE2v9rDvKYrdDflDhd-c7hwVwMs2uUfYzE-iiQ2LkuYvizA0iXgl0_YMzX6iIe9Pu4CNiOjZ_6e2Xhneem1Yy5zsuLKWVLoT3a01SaTqLcxHqD-VnFAfhivGqVooFz0y7LOrbo0ZWwShUJWdiL9w9G3a0 Aug 31 16:59:17.790928 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:59:17.790928 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:59:17.790928 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:59:17.790928 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:59:17.790928 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:59:17.790928 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:59:17.790928 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 61d77247e9aa471eba23dcc9d2c30e72 Aug 31 16:59:17.790928 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ServerDiskConfigTestJSON-21015090 Aug 31 16:59:17.790928 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:59:17.790928 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:59:17.790928 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/61d77247e9aa471eba23dcc9d2c30e72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/61d77247e9aa471eba23dcc9d2c30e72"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_61d77247e9aa471eba23dcc9d2c30e72", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/61d77247e9aa471eba23dcc9d2c30e72"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:59:17.790928 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ServerDiskConfigTestJSON-21015090 Aug 31 16:59:17.790928 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 61d77247e9aa471eba23dcc9d2c30e72 Aug 31 16:59:17.790928 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-21015090 Aug 31 16:59:17.790928 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ServerDiskConfigTestJSON-21015090-project Aug 31 16:59:17.790928 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:59:17.790928 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:59:17.790928 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 7228e15d12e442b0802ef033bc6158b7 Aug 31 16:59:17.790928 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ServerDiskConfigTestJSON-21015090-project Aug 31 16:59:17.790928 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:59:17.790928 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance 22d313f2-f865-4823-bf70-c963835ae9d5 could not be found. Aug 31 16:59:17.790928 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '22d313f2-f865-4823-bf70-c963835ae9d5'} Aug 31 16:59:17.790928 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:59:17.790928 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:59:17.790928 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:59:17.790928 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:59:17.790928 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:59:17.790928 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:59:17.790928 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:59:17.790928 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:59:17.790928 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:59:17.790928 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:59:17.790928 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22d313f2-f865-4823-bf70-c963835ae9d5 could not be found. Aug 31 16:59:17.790928 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:59:17.790928 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:59:17.790928 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:59:17.790928 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:59:17.790928 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:59:17.790928 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:59:17.790928 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:59:17.790928 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:59:17.790928 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:59:17.790928 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:59:17.790928 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:59:17.790928 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:59:17.790928 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:59:17.790928 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:59:17.790928 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:59:17.790928 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:59:17.790928 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22d313f2-f865-4823-bf70-c963835ae9d5 could not be found. Aug 31 16:59:17.790928 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:59:17.790928 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:59:17.790928 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:59:17.796270 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:59:17.796270 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:59:17.796270 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:59:17.796270 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:59:17.796270 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:59:17.796270 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22d313f2-f865-4823-bf70-c963835ae9d5 could not be found. Aug 31 16:59:17.796270 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:59:17.796270 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-eb57be7d-e734-4442-89a5-d9f80fb0742c tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Returning 404 to user: Instance 22d313f2-f865-4823-bf70-c963835ae9d5 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:59:17.796270 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-eb57be7d-e734-4442-89a5-d9f80fb0742c tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "GET /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5" status: 404 len: 111 microversion: 2.1 time: 0.031625 Aug 31 16:59:17.796270 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3674/7330] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:59:17 2022] GET /compute/v2.1/servers/22d313f2-f865-4823-bf70-c963835ae9d5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:59:17.802513 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-cdba79c8-7fbb-44de-a873-ba7697bb13b5 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '.version_select at 0x7f5ae3c9a3a0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:59:17.823900 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-cdba79c8-7fbb-44de-a873-ba7697bb13b5 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-426025420" status: 202 len: 0 microversion: 2.1 time: 0.025556 Aug 31 16:59:17.824495 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3657/7331] 10.222.0.61 () {58 vars in 1218 bytes} [Wed Aug 31 16:59:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-426025420 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:59:18.441826 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-dcb1f09a-0202-4d24-8c1d-e18e6be61a55 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:59:18.442345 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-dcb1f09a-0202-4d24-8c1d-e18e6be61a55 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: b1623b9c-b818-43a2-9360-99751b436ec2] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:59:18.448638 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dcb1f09a-0202-4d24-8c1d-e18e6be61a55 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:18.448975 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dcb1f09a-0202-4d24-8c1d-e18e6be61a55 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:18.449432 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dcb1f09a-0202-4d24-8c1d-e18e6be61a55 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:18.450154 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dcb1f09a-0202-4d24-8c1d-e18e6be61a55 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:18.450626 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dcb1f09a-0202-4d24-8c1d-e18e6be61a55 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:18.451071 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dcb1f09a-0202-4d24-8c1d-e18e6be61a55 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:18.465939 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-dcb1f09a-0202-4d24-8c1d-e18e6be61a55 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] HTTP exception thrown: Instance b1623b9c-b818-43a2-9360-99751b436ec2 could not be found. Aug 31 16:59:18.467557 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-dcb1f09a-0202-4d24-8c1d-e18e6be61a55 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Request method failure captured: Aug 31 16:59:18.467557 n-d-850499-9 devstack@n-api.service[122257]: request: DELETE /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2 HTTP/1.1 Aug 31 16:59:18.467557 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 16:59:18.467557 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 16:59:18.467557 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 16:59:18.467557 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 16:59:18.467557 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 16:59:18.467557 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 16:59:18.467557 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 16:59:18.467557 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 16:59:18.467557 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD5L7EdGmgP8U8uIQVXkwknVE2v9rDvKYrdDflDhd-c7hwVwMs2uUfYzE-iiQ2LkuYvizA0iXgl0_YMzX6iIe9Pu4CNiOjZ_6e2Xhneem1Yy5zsuLKWVLoT3a01SaTqLcxHqD-VnFAfhivGqVooFz0y7LOrbo0ZWwShUJWdiL9w9G3a0 Aug 31 16:59:18.467557 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 16:59:18.467557 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 16:59:18.467557 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 16:59:18.467557 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 16:59:18.467557 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 16:59:18.467557 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 16:59:18.467557 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 61d77247e9aa471eba23dcc9d2c30e72 Aug 31 16:59:18.467557 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ServerDiskConfigTestJSON-21015090 Aug 31 16:59:18.467557 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 16:59:18.467557 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 16:59:18.467557 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/61d77247e9aa471eba23dcc9d2c30e72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/61d77247e9aa471eba23dcc9d2c30e72"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_61d77247e9aa471eba23dcc9d2c30e72", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/61d77247e9aa471eba23dcc9d2c30e72"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:59:18.467557 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ServerDiskConfigTestJSON-21015090 Aug 31 16:59:18.467557 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 61d77247e9aa471eba23dcc9d2c30e72 Aug 31 16:59:18.467557 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-21015090 Aug 31 16:59:18.467557 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ServerDiskConfigTestJSON-21015090-project Aug 31 16:59:18.467557 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 16:59:18.467557 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 16:59:18.467557 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 7228e15d12e442b0802ef033bc6158b7 Aug 31 16:59:18.467557 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ServerDiskConfigTestJSON-21015090-project Aug 31 16:59:18.467557 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 16:59:18.467557 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance b1623b9c-b818-43a2-9360-99751b436ec2 could not be found. Aug 31 16:59:18.467557 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': 'b1623b9c-b818-43a2-9360-99751b436ec2'} Aug 31 16:59:18.467557 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:59:18.467557 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:59:18.467557 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:59:18.467557 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:59:18.467557 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:59:18.467557 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:59:18.467557 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:59:18.467557 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:59:18.467557 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:59:18.467557 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:59:18.467557 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1623b9c-b818-43a2-9360-99751b436ec2 could not be found. Aug 31 16:59:18.467557 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:59:18.467557 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:59:18.467557 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:59:18.467557 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:59:18.467557 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:59:18.467557 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:59:18.467557 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:59:18.467557 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:59:18.467557 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:59:18.467557 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:59:18.467557 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:59:18.467557 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:59:18.467557 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:59:18.467557 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:59:18.467557 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:59:18.467557 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:59:18.467557 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:59:18.467557 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:59:18.475244 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1623b9c-b818-43a2-9360-99751b436ec2 could not be found. Aug 31 16:59:18.475244 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:59:18.475244 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:59:18.475244 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:59:18.475244 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:59:18.475244 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:59:18.475244 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:59:18.475244 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:59:18.475244 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:59:18.475244 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1623b9c-b818-43a2-9360-99751b436ec2 could not be found. Aug 31 16:59:18.475244 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 16:59:18.475244 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-dcb1f09a-0202-4d24-8c1d-e18e6be61a55 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Returning 404 to user: Instance b1623b9c-b818-43a2-9360-99751b436ec2 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:59:18.475244 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-dcb1f09a-0202-4d24-8c1d-e18e6be61a55 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "DELETE /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2" status: 404 len: 111 microversion: 2.1 time: 0.031206 Aug 31 16:59:18.475244 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3675/7332] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 16:59:18 2022] DELETE /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:59:18.478430 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4c6d1ab3-cf52-4c73-a321-bb328f370ee0 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:59:18.479755 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4c6d1ab3-cf52-4c73-a321-bb328f370ee0 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] [instance: b1623b9c-b818-43a2-9360-99751b436ec2] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:59:18.488818 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4c6d1ab3-cf52-4c73-a321-bb328f370ee0 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:18.489311 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4c6d1ab3-cf52-4c73-a321-bb328f370ee0 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:18.489748 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4c6d1ab3-cf52-4c73-a321-bb328f370ee0 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:18.490438 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4c6d1ab3-cf52-4c73-a321-bb328f370ee0 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:18.490895 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4c6d1ab3-cf52-4c73-a321-bb328f370ee0 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:18.491322 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4c6d1ab3-cf52-4c73-a321-bb328f370ee0 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:18.505618 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-4c6d1ab3-cf52-4c73-a321-bb328f370ee0 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] HTTP exception thrown: Instance b1623b9c-b818-43a2-9360-99751b436ec2 could not be found. Aug 31 16:59:18.507276 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4c6d1ab3-cf52-4c73-a321-bb328f370ee0 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Request method failure captured: Aug 31 16:59:18.507276 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2 HTTP/1.1 Aug 31 16:59:18.507276 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 16:59:18.507276 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 16:59:18.507276 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 16:59:18.507276 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 16:59:18.507276 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 16:59:18.507276 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 16:59:18.507276 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 16:59:18.507276 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 16:59:18.507276 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD5L7EdGmgP8U8uIQVXkwknVE2v9rDvKYrdDflDhd-c7hwVwMs2uUfYzE-iiQ2LkuYvizA0iXgl0_YMzX6iIe9Pu4CNiOjZ_6e2Xhneem1Yy5zsuLKWVLoT3a01SaTqLcxHqD-VnFAfhivGqVooFz0y7LOrbo0ZWwShUJWdiL9w9G3a0 Aug 31 16:59:18.507276 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 16:59:18.507276 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 16:59:18.507276 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 16:59:18.507276 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 16:59:18.507276 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 16:59:18.507276 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 16:59:18.507276 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 61d77247e9aa471eba23dcc9d2c30e72 Aug 31 16:59:18.507276 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ServerDiskConfigTestJSON-21015090 Aug 31 16:59:18.507276 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 16:59:18.507276 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 16:59:18.507276 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/61d77247e9aa471eba23dcc9d2c30e72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/61d77247e9aa471eba23dcc9d2c30e72"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_61d77247e9aa471eba23dcc9d2c30e72", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/61d77247e9aa471eba23dcc9d2c30e72"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 16:59:18.507276 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ServerDiskConfigTestJSON-21015090 Aug 31 16:59:18.507276 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 61d77247e9aa471eba23dcc9d2c30e72 Aug 31 16:59:18.507276 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-21015090 Aug 31 16:59:18.507276 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ServerDiskConfigTestJSON-21015090-project Aug 31 16:59:18.507276 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 16:59:18.507276 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 16:59:18.507276 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 7228e15d12e442b0802ef033bc6158b7 Aug 31 16:59:18.507276 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ServerDiskConfigTestJSON-21015090-project Aug 31 16:59:18.507276 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 16:59:18.507276 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance b1623b9c-b818-43a2-9360-99751b436ec2 could not be found. Aug 31 16:59:18.507276 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': 'b1623b9c-b818-43a2-9360-99751b436ec2'} Aug 31 16:59:18.507276 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:59:18.507276 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:59:18.507276 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:59:18.507276 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:59:18.507276 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:59:18.507276 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:59:18.507276 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:59:18.507276 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:59:18.507276 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:59:18.507276 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:59:18.507276 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1623b9c-b818-43a2-9360-99751b436ec2 could not be found. Aug 31 16:59:18.507276 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:59:18.507276 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:59:18.507276 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:59:18.507276 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:59:18.507276 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:59:18.507276 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:59:18.507276 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:59:18.507276 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:59:18.507276 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:59:18.507276 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:59:18.507276 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:59:18.507276 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:59:18.507276 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:59:18.507276 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:59:18.507276 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:59:18.507276 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:59:18.507276 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1623b9c-b818-43a2-9360-99751b436ec2 could not be found. Aug 31 16:59:18.507276 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:59:18.507276 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:59:18.507276 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:59:18.515611 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:59:18.515611 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:59:18.515611 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:59:18.515611 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:59:18.515611 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:59:18.515611 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1623b9c-b818-43a2-9360-99751b436ec2 could not be found. Aug 31 16:59:18.515611 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 16:59:18.515611 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4c6d1ab3-cf52-4c73-a321-bb328f370ee0 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] Returning 404 to user: Instance b1623b9c-b818-43a2-9360-99751b436ec2 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:59:18.515611 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4c6d1ab3-cf52-4c73-a321-bb328f370ee0 tempest-ServerDiskConfigTestJSON-21015090 tempest-ServerDiskConfigTestJSON-21015090-project] 10.222.0.61 "GET /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2" status: 404 len: 111 microversion: 2.1 time: 0.034963 Aug 31 16:59:18.515611 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3658/7333] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:59:18 2022] GET /compute/v2.1/servers/b1623b9c-b818-43a2-9360-99751b436ec2 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 16:59:27.317226 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0e97d635-d750-4464-a878-4bcd2af366e8 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Action: 'create', calling method: .version_select at 0x7f5ae8e2b820>, body: {"keypair": {"name": "tempest-keypair-1911906825", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMCPU3uzEByc0H1a01B2uYd1YgsbbaxEWyYxBpAsusxRG2p1J6VmGSGHi8k5ICmWBn/UvW7/eQf/Zr5nDCt5Msvwprqj5TmUvAnYZ4qAUz7TOnOZBhlmMW4drHj9PZfrSg=="}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:59:27.333717 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-0e97d635-d750-4464-a878-4bcd2af366e8 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Getting quotas for project f38fad62a33848c59db3d09c5c9788cc. Resources: {'key_pairs'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:59:27.340526 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-0e97d635-d750-4464-a878-4bcd2af366e8 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Getting quotas for user a3e98ea428604e7da092d46e865cfe1d and project f38fad62a33848c59db3d09c5c9788cc. Resources: {'key_pairs'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:59:27.371649 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0e97d635-d750-4464-a878-4bcd2af366e8 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.179358 Aug 31 16:59:27.372303 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3676/7334] 10.222.0.61 () {60 vars in 1159 bytes} [Wed Aug 31 16:59:27 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:59:28.747240 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c3bede3b-de81-4771-b42a-3a043d939715 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-652579776", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "41af13fa-aeee-464a-8b24-48b02ed3bdc6"}], "security_groups": [{"name": "tempest-securitygroup--824623775"}], "key_name": "tempest-keypair-1911906825", "user_data": "}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:59:28.758006 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:59:28.759193 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:59:28.864678 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-c3bede3b-de81-4771-b42a-3a043d939715 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] validate_networks() for [('41af13fa-aeee-464a-8b24-48b02ed3bdc6', None, None, None, None, None)] {{(pid=122256) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:59:29.267703 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-c3bede3b-de81-4771-b42a-3a043d939715 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:59:29.268309 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-c3bede3b-de81-4771-b42a-3a043d939715 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:59:29.268791 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-c3bede3b-de81-4771-b42a-3a043d939715 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:59:29.269207 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-c3bede3b-de81-4771-b42a-3a043d939715 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:59:29.269614 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-c3bede3b-de81-4771-b42a-3a043d939715 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:59:29.280015 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c3bede3b-de81-4771-b42a-3a043d939715 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:29.280837 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c3bede3b-de81-4771-b42a-3a043d939715 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:29.281430 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c3bede3b-de81-4771-b42a-3a043d939715 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:29.282338 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c3bede3b-de81-4771-b42a-3a043d939715 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:29.282950 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c3bede3b-de81-4771-b42a-3a043d939715 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:29.283630 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c3bede3b-de81-4771-b42a-3a043d939715 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:29.302103 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-c3bede3b-de81-4771-b42a-3a043d939715 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Getting quotas for project f38fad62a33848c59db3d09c5c9788cc. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:59:29.308770 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-c3bede3b-de81-4771-b42a-3a043d939715 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Getting quotas for user a3e98ea428604e7da092d46e865cfe1d and project f38fad62a33848c59db3d09c5c9788cc. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:59:29.323042 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c3bede3b-de81-4771-b42a-3a043d939715 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Going to run 1 instances... {{(pid=122256) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:59:29.325438 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c3bede3b-de81-4771-b42a-3a043d939715 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 9771d91b-c36b-441b-98a0-38cbdc43beba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:59:29.380221 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c3bede3b-de81-4771-b42a-3a043d939715 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.638330 Aug 31 16:59:29.381256 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3659/7335] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 16:59:28 2022] POST /compute/v2.1/servers => generated 408 bytes in 640 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:59:29.392499 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a3c0539f-3f21-44d0-8f54-7aca76c5cd55 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:59:29.395053 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a3c0539f-3f21-44d0-8f54-7aca76c5cd55 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 9771d91b-c36b-441b-98a0-38cbdc43beba] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:59:29.398222 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:59:29.478666 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a3c0539f-3f21-44d0-8f54-7aca76c5cd55 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:59:29.490401 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a3c0539f-3f21-44d0-8f54-7aca76c5cd55 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/9771d91b-c36b-441b-98a0-38cbdc43beba" status: 200 len: 1238 microversion: 2.1 time: 0.101920 Aug 31 16:59:29.490997 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3677/7336] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:59:29 2022] GET /compute/v2.1/servers/9771d91b-c36b-441b-98a0-38cbdc43beba => generated 1238 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:59:30.513697 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-14bd02f0-96cf-4507-b2f6-55f09a9a42b8 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:59:30.514486 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-14bd02f0-96cf-4507-b2f6-55f09a9a42b8 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 9771d91b-c36b-441b-98a0-38cbdc43beba] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:59:30.522927 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-14bd02f0-96cf-4507-b2f6-55f09a9a42b8 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:30.523829 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-14bd02f0-96cf-4507-b2f6-55f09a9a42b8 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:30.524533 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-14bd02f0-96cf-4507-b2f6-55f09a9a42b8 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:30.525586 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-14bd02f0-96cf-4507-b2f6-55f09a9a42b8 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:30.526738 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-14bd02f0-96cf-4507-b2f6-55f09a9a42b8 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:30.527600 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-14bd02f0-96cf-4507-b2f6-55f09a9a42b8 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:30.639883 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-14bd02f0-96cf-4507-b2f6-55f09a9a42b8 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:59:30.654688 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-14bd02f0-96cf-4507-b2f6-55f09a9a42b8 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/9771d91b-c36b-441b-98a0-38cbdc43beba" status: 200 len: 1290 microversion: 2.1 time: 0.146318 Aug 31 16:59:30.658746 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3660/7337] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:59:30 2022] GET /compute/v2.1/servers/9771d91b-c36b-441b-98a0-38cbdc43beba => generated 1290 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:59:31.682568 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-85eb361a-5b95-478c-9d0b-29169ce0eb01 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:59:31.683320 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-85eb361a-5b95-478c-9d0b-29169ce0eb01 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 9771d91b-c36b-441b-98a0-38cbdc43beba] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:59:31.691558 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-85eb361a-5b95-478c-9d0b-29169ce0eb01 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:31.692683 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-85eb361a-5b95-478c-9d0b-29169ce0eb01 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:31.693387 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-85eb361a-5b95-478c-9d0b-29169ce0eb01 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:31.694256 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-85eb361a-5b95-478c-9d0b-29169ce0eb01 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:31.694796 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-85eb361a-5b95-478c-9d0b-29169ce0eb01 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:31.695683 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-85eb361a-5b95-478c-9d0b-29169ce0eb01 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:31.954623 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-85eb361a-5b95-478c-9d0b-29169ce0eb01 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:59:31.963068 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-85eb361a-5b95-478c-9d0b-29169ce0eb01 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/9771d91b-c36b-441b-98a0-38cbdc43beba" status: 200 len: 1363 microversion: 2.1 time: 0.285222 Aug 31 16:59:31.963900 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3678/7338] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:59:31 2022] GET /compute/v2.1/servers/9771d91b-c36b-441b-98a0-38cbdc43beba => generated 1363 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:59:32.263722 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-41ac6882-fc75-4eba-b961-bdb89c0e9bcf req-2153d4f8-246a-40cc-b9bd-84d785103808 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9771d91b-c36b-441b-98a0-38cbdc43beba", "tag": "14c7aab8-b889-4428-b275-55ee6c2fc5ed"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:59:32.276387 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-41ac6882-fc75-4eba-b961-bdb89c0e9bcf req-2153d4f8-246a-40cc-b9bd-84d785103808 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:32.277233 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-41ac6882-fc75-4eba-b961-bdb89c0e9bcf req-2153d4f8-246a-40cc-b9bd-84d785103808 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:32.278025 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-41ac6882-fc75-4eba-b961-bdb89c0e9bcf req-2153d4f8-246a-40cc-b9bd-84d785103808 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:32.292446 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-41ac6882-fc75-4eba-b961-bdb89c0e9bcf req-2153d4f8-246a-40cc-b9bd-84d785103808 service nova] Creating event network-changed:14c7aab8-b889-4428-b275-55ee6c2fc5ed for instance 9771d91b-c36b-441b-98a0-38cbdc43beba on n-h1-850499-9 Aug 31 16:59:32.297601 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-41ac6882-fc75-4eba-b961-bdb89c0e9bcf req-2153d4f8-246a-40cc-b9bd-84d785103808 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040336 Aug 31 16:59:32.298422 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3661/7339] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:59:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:59:32.985788 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-10d5a815-f8a4-4243-8255-a896371cff6b tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:59:32.986320 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-10d5a815-f8a4-4243-8255-a896371cff6b tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 9771d91b-c36b-441b-98a0-38cbdc43beba] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:59:32.993422 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-10d5a815-f8a4-4243-8255-a896371cff6b tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:32.993968 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-10d5a815-f8a4-4243-8255-a896371cff6b tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:32.994512 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-10d5a815-f8a4-4243-8255-a896371cff6b tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:32.995431 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-10d5a815-f8a4-4243-8255-a896371cff6b tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:32.995941 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-10d5a815-f8a4-4243-8255-a896371cff6b tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:32.996391 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-10d5a815-f8a4-4243-8255-a896371cff6b tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:33.126626 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-10d5a815-f8a4-4243-8255-a896371cff6b tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:59:33.134469 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-10d5a815-f8a4-4243-8255-a896371cff6b tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/9771d91b-c36b-441b-98a0-38cbdc43beba" status: 200 len: 1363 microversion: 2.1 time: 0.152699 Aug 31 16:59:33.135305 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3679/7340] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:59:32 2022] GET /compute/v2.1/servers/9771d91b-c36b-441b-98a0-38cbdc43beba => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:59:34.155926 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0e01df35-ddf6-4c68-b304-8b97a02ba693 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:59:34.156543 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0e01df35-ddf6-4c68-b304-8b97a02ba693 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 9771d91b-c36b-441b-98a0-38cbdc43beba] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:59:34.162734 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0e01df35-ddf6-4c68-b304-8b97a02ba693 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:34.163315 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0e01df35-ddf6-4c68-b304-8b97a02ba693 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:34.163784 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0e01df35-ddf6-4c68-b304-8b97a02ba693 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:34.164476 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0e01df35-ddf6-4c68-b304-8b97a02ba693 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:34.164935 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0e01df35-ddf6-4c68-b304-8b97a02ba693 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:34.165364 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0e01df35-ddf6-4c68-b304-8b97a02ba693 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:34.636490 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-0e01df35-ddf6-4c68-b304-8b97a02ba693 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:59:34.644150 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0e01df35-ddf6-4c68-b304-8b97a02ba693 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/9771d91b-c36b-441b-98a0-38cbdc43beba" status: 200 len: 1363 microversion: 2.1 time: 0.493628 Aug 31 16:59:34.644715 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3662/7341] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:59:34 2022] GET /compute/v2.1/servers/9771d91b-c36b-441b-98a0-38cbdc43beba => generated 1363 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:59:35.665297 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7e25dd71-bc4a-467a-9945-37dd39bcfd1a tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:59:35.665869 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7e25dd71-bc4a-467a-9945-37dd39bcfd1a tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 9771d91b-c36b-441b-98a0-38cbdc43beba] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:59:35.673506 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7e25dd71-bc4a-467a-9945-37dd39bcfd1a tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:35.674009 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7e25dd71-bc4a-467a-9945-37dd39bcfd1a tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:35.674464 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7e25dd71-bc4a-467a-9945-37dd39bcfd1a tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:35.675199 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7e25dd71-bc4a-467a-9945-37dd39bcfd1a tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:35.675716 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7e25dd71-bc4a-467a-9945-37dd39bcfd1a tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:35.676160 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7e25dd71-bc4a-467a-9945-37dd39bcfd1a tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:35.808804 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7e25dd71-bc4a-467a-9945-37dd39bcfd1a tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:59:35.816748 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7e25dd71-bc4a-467a-9945-37dd39bcfd1a tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/9771d91b-c36b-441b-98a0-38cbdc43beba" status: 200 len: 1363 microversion: 2.1 time: 0.155457 Aug 31 16:59:35.817334 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3680/7342] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:59:35 2022] GET /compute/v2.1/servers/9771d91b-c36b-441b-98a0-38cbdc43beba => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:59:36.837537 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4c7f04e9-db13-4886-8040-61543952cf11 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:59:36.838737 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4c7f04e9-db13-4886-8040-61543952cf11 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 9771d91b-c36b-441b-98a0-38cbdc43beba] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:59:36.845727 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4c7f04e9-db13-4886-8040-61543952cf11 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:36.846222 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4c7f04e9-db13-4886-8040-61543952cf11 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:36.846661 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4c7f04e9-db13-4886-8040-61543952cf11 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:36.847405 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4c7f04e9-db13-4886-8040-61543952cf11 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:36.847893 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4c7f04e9-db13-4886-8040-61543952cf11 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:36.848325 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4c7f04e9-db13-4886-8040-61543952cf11 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:36.979164 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-4c7f04e9-db13-4886-8040-61543952cf11 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:59:36.987508 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4c7f04e9-db13-4886-8040-61543952cf11 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/9771d91b-c36b-441b-98a0-38cbdc43beba" status: 200 len: 1363 microversion: 2.1 time: 0.153913 Aug 31 16:59:36.988087 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3663/7343] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:59:36 2022] GET /compute/v2.1/servers/9771d91b-c36b-441b-98a0-38cbdc43beba => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:59:37.443949 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-64594f9f-a710-490a-8b1d-977a51327f6f req-e0cefe61-1f06-438d-a0b3-ed04d39f2e55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9771d91b-c36b-441b-98a0-38cbdc43beba", "name": "network-vif-plugged", "status": "completed", "tag": "14c7aab8-b889-4428-b275-55ee6c2fc5ed"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:59:37.454345 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-64594f9f-a710-490a-8b1d-977a51327f6f req-e0cefe61-1f06-438d-a0b3-ed04d39f2e55 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:37.455133 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-64594f9f-a710-490a-8b1d-977a51327f6f req-e0cefe61-1f06-438d-a0b3-ed04d39f2e55 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:37.455308 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-64594f9f-a710-490a-8b1d-977a51327f6f req-e0cefe61-1f06-438d-a0b3-ed04d39f2e55 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:37.469838 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-64594f9f-a710-490a-8b1d-977a51327f6f req-e0cefe61-1f06-438d-a0b3-ed04d39f2e55 service nova] Creating event network-vif-plugged:14c7aab8-b889-4428-b275-55ee6c2fc5ed for instance 9771d91b-c36b-441b-98a0-38cbdc43beba on n-h1-850499-9 Aug 31 16:59:37.474842 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-64594f9f-a710-490a-8b1d-977a51327f6f req-e0cefe61-1f06-438d-a0b3-ed04d39f2e55 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096660 Aug 31 16:59:37.475482 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3681/7344] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:59:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:59:38.007402 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-fd122603-78f9-4569-b687-dcf90dbfed55 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:59:38.008052 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-fd122603-78f9-4569-b687-dcf90dbfed55 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 9771d91b-c36b-441b-98a0-38cbdc43beba] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:59:38.015518 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fd122603-78f9-4569-b687-dcf90dbfed55 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:38.016030 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fd122603-78f9-4569-b687-dcf90dbfed55 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:38.016478 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fd122603-78f9-4569-b687-dcf90dbfed55 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:38.017186 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fd122603-78f9-4569-b687-dcf90dbfed55 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:38.017649 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fd122603-78f9-4569-b687-dcf90dbfed55 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:38.018089 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fd122603-78f9-4569-b687-dcf90dbfed55 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:38.149471 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-fd122603-78f9-4569-b687-dcf90dbfed55 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:59:38.158082 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-fd122603-78f9-4569-b687-dcf90dbfed55 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/9771d91b-c36b-441b-98a0-38cbdc43beba" status: 200 len: 1363 microversion: 2.1 time: 0.154601 Aug 31 16:59:38.158693 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3664/7345] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:59:38 2022] GET /compute/v2.1/servers/9771d91b-c36b-441b-98a0-38cbdc43beba => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:59:39.180372 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-fe2f75dc-e11d-4fad-9df7-c24b372882b9 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:59:39.181045 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-fe2f75dc-e11d-4fad-9df7-c24b372882b9 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 9771d91b-c36b-441b-98a0-38cbdc43beba] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:59:39.187605 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fe2f75dc-e11d-4fad-9df7-c24b372882b9 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:39.188160 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fe2f75dc-e11d-4fad-9df7-c24b372882b9 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:39.188617 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fe2f75dc-e11d-4fad-9df7-c24b372882b9 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:39.189326 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fe2f75dc-e11d-4fad-9df7-c24b372882b9 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:39.189800 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fe2f75dc-e11d-4fad-9df7-c24b372882b9 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:39.190244 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fe2f75dc-e11d-4fad-9df7-c24b372882b9 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:39.328049 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-fe2f75dc-e11d-4fad-9df7-c24b372882b9 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:59:39.335982 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-fe2f75dc-e11d-4fad-9df7-c24b372882b9 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/9771d91b-c36b-441b-98a0-38cbdc43beba" status: 200 len: 1550 microversion: 2.1 time: 0.160903 Aug 31 16:59:39.336558 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3682/7346] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 16:59:39 2022] GET /compute/v2.1/servers/9771d91b-c36b-441b-98a0-38cbdc43beba => generated 1550 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:59:39.358129 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7e1bd630-e574-4987-8bab-60ca97b0e96c tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:59:39.358632 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7e1bd630-e574-4987-8bab-60ca97b0e96c tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 9771d91b-c36b-441b-98a0-38cbdc43beba] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:59:39.361409 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:59:39.362195 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=6 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:59:39.368367 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7e1bd630-e574-4987-8bab-60ca97b0e96c tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:39.368820 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7e1bd630-e574-4987-8bab-60ca97b0e96c tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:39.369280 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7e1bd630-e574-4987-8bab-60ca97b0e96c tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:39.369985 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7e1bd630-e574-4987-8bab-60ca97b0e96c tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:39.370479 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7e1bd630-e574-4987-8bab-60ca97b0e96c tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:39.371046 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7e1bd630-e574-4987-8bab-60ca97b0e96c tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:39.452490 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7e1bd630-e574-4987-8bab-60ca97b0e96c tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/9771d91b-c36b-441b-98a0-38cbdc43beba/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098293 Aug 31 16:59:39.453293 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3665/7347] 10.222.0.61 () {58 vars in 1275 bytes} [Wed Aug 31 16:59:39 2022] GET /compute/v2.1/servers/9771d91b-c36b-441b-98a0-38cbdc43beba/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:59:40.399323 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-8b9b2d9e-050f-4367-abc9-58b6c6ea6622 req-2d0dbfed-e802-4ef3-8e91-11b28088ea44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9771d91b-c36b-441b-98a0-38cbdc43beba", "tag": "14c7aab8-b889-4428-b275-55ee6c2fc5ed"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:59:40.405157 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=6 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:59:40.406869 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:59:40.413631 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-8b9b2d9e-050f-4367-abc9-58b6c6ea6622 req-2d0dbfed-e802-4ef3-8e91-11b28088ea44 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:40.414203 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-8b9b2d9e-050f-4367-abc9-58b6c6ea6622 req-2d0dbfed-e802-4ef3-8e91-11b28088ea44 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:40.414727 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-8b9b2d9e-050f-4367-abc9-58b6c6ea6622 req-2d0dbfed-e802-4ef3-8e91-11b28088ea44 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:40.427667 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-8b9b2d9e-050f-4367-abc9-58b6c6ea6622 req-2d0dbfed-e802-4ef3-8e91-11b28088ea44 service nova] Creating event network-changed:14c7aab8-b889-4428-b275-55ee6c2fc5ed for instance 9771d91b-c36b-441b-98a0-38cbdc43beba on n-h1-850499-9 Aug 31 16:59:40.434173 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-8b9b2d9e-050f-4367-abc9-58b6c6ea6622 req-2d0dbfed-e802-4ef3-8e91-11b28088ea44 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038506 Aug 31 16:59:40.434780 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3683/7348] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 16:59:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:00:55.698460 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:00:55.699371 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=32 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:00:55.704105 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3a2a4c77-87fb-4c07-8030-2d37e559e70d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:00:55.704668 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3a2a4c77-87fb-4c07-8030-2d37e559e70d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 9771d91b-c36b-441b-98a0-38cbdc43beba] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:00:55.712418 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3a2a4c77-87fb-4c07-8030-2d37e559e70d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:00:55.712909 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3a2a4c77-87fb-4c07-8030-2d37e559e70d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:00:55.713353 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3a2a4c77-87fb-4c07-8030-2d37e559e70d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:00:55.714781 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3a2a4c77-87fb-4c07-8030-2d37e559e70d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:00:55.715246 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3a2a4c77-87fb-4c07-8030-2d37e559e70d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:00:55.715715 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3a2a4c77-87fb-4c07-8030-2d37e559e70d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:00:55.853106 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3a2a4c77-87fb-4c07-8030-2d37e559e70d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:00:55.861268 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3a2a4c77-87fb-4c07-8030-2d37e559e70d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/9771d91b-c36b-441b-98a0-38cbdc43beba" status: 200 len: 1668 microversion: 2.1 time: 0.165602 Aug 31 17:00:55.861842 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3666/7349] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:00:55 2022] GET /compute/v2.1/servers/9771d91b-c36b-441b-98a0-38cbdc43beba => generated 1668 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:00:55.880338 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=28 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:00:55.881098 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:00:55.885233 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6d697ea2-4c14-47e0-95c1-e83fe5203776 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:00:55.886507 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6d697ea2-4c14-47e0-95c1-e83fe5203776 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 9771d91b-c36b-441b-98a0-38cbdc43beba] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:00:55.893460 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6d697ea2-4c14-47e0-95c1-e83fe5203776 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:00:55.893962 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6d697ea2-4c14-47e0-95c1-e83fe5203776 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:00:55.894418 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6d697ea2-4c14-47e0-95c1-e83fe5203776 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:00:55.895129 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6d697ea2-4c14-47e0-95c1-e83fe5203776 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:00:55.895634 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6d697ea2-4c14-47e0-95c1-e83fe5203776 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:00:55.896079 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6d697ea2-4c14-47e0-95c1-e83fe5203776 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:00:56.026818 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-6d697ea2-4c14-47e0-95c1-e83fe5203776 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:00:56.035351 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6d697ea2-4c14-47e0-95c1-e83fe5203776 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/9771d91b-c36b-441b-98a0-38cbdc43beba" status: 200 len: 1668 microversion: 2.1 time: 0.157275 Aug 31 17:00:56.036345 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3684/7350] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:00:55 2022] GET /compute/v2.1/servers/9771d91b-c36b-441b-98a0-38cbdc43beba => generated 1668 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:00:56.055095 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ba7bcdff-2c3b-48f7-b1c8-bc79775debb9 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:00:56.055743 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ba7bcdff-2c3b-48f7-b1c8-bc79775debb9 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 9771d91b-c36b-441b-98a0-38cbdc43beba] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:00:56.062169 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ba7bcdff-2c3b-48f7-b1c8-bc79775debb9 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:00:56.062655 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ba7bcdff-2c3b-48f7-b1c8-bc79775debb9 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:00:56.063094 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ba7bcdff-2c3b-48f7-b1c8-bc79775debb9 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:00:56.063812 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ba7bcdff-2c3b-48f7-b1c8-bc79775debb9 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:00:56.064270 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ba7bcdff-2c3b-48f7-b1c8-bc79775debb9 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:00:56.064704 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ba7bcdff-2c3b-48f7-b1c8-bc79775debb9 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:00:56.195266 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ba7bcdff-2c3b-48f7-b1c8-bc79775debb9 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:00:56.204088 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ba7bcdff-2c3b-48f7-b1c8-bc79775debb9 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/9771d91b-c36b-441b-98a0-38cbdc43beba" status: 200 len: 1668 microversion: 2.1 time: 0.152789 Aug 31 17:00:56.204656 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3667/7351] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:00:56 2022] GET /compute/v2.1/servers/9771d91b-c36b-441b-98a0-38cbdc43beba => generated 1668 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:00:56.224226 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-48705a43-9d51-45c6-bcf1-a3649417ecd1 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:00:56.226424 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-48705a43-9d51-45c6-bcf1-a3649417ecd1 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 9771d91b-c36b-441b-98a0-38cbdc43beba] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:00:56.232693 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-48705a43-9d51-45c6-bcf1-a3649417ecd1 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:00:56.233212 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-48705a43-9d51-45c6-bcf1-a3649417ecd1 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:00:56.233674 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-48705a43-9d51-45c6-bcf1-a3649417ecd1 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:00:56.234396 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-48705a43-9d51-45c6-bcf1-a3649417ecd1 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:00:56.234873 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-48705a43-9d51-45c6-bcf1-a3649417ecd1 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:00:56.235325 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-48705a43-9d51-45c6-bcf1-a3649417ecd1 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:00:56.265637 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-48705a43-9d51-45c6-bcf1-a3649417ecd1 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:00:56.271414 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-48705a43-9d51-45c6-bcf1-a3649417ecd1 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 9771d91b-c36b-441b-98a0-38cbdc43beba] Old instance type m1.heat2, new instance type m1.heat {{(pid=122257) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 31 17:00:56.280092 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-48705a43-9d51-45c6-bcf1-a3649417ecd1 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 17:00:56.280866 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-48705a43-9d51-45c6-bcf1-a3649417ecd1 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 17:00:56.281744 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-48705a43-9d51-45c6-bcf1-a3649417ecd1 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 17:00:56.282341 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-48705a43-9d51-45c6-bcf1-a3649417ecd1 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 17:00:56.282912 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-48705a43-9d51-45c6-bcf1-a3649417ecd1 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 17:00:56.348926 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-48705a43-9d51-45c6-bcf1-a3649417ecd1 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "POST /compute/v2.1/servers/9771d91b-c36b-441b-98a0-38cbdc43beba/action" status: 202 len: 0 microversion: 2.1 time: 0.128669 Aug 31 17:00:56.349548 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3685/7352] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 17:00:56 2022] POST /compute/v2.1/servers/9771d91b-c36b-441b-98a0-38cbdc43beba/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 17:00:56.358484 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f016a6eb-2988-4684-9a82-fbc1831f97b5 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:00:56.359113 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f016a6eb-2988-4684-9a82-fbc1831f97b5 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 9771d91b-c36b-441b-98a0-38cbdc43beba] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:00:56.365074 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f016a6eb-2988-4684-9a82-fbc1831f97b5 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:00:56.365565 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f016a6eb-2988-4684-9a82-fbc1831f97b5 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:00:56.366010 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f016a6eb-2988-4684-9a82-fbc1831f97b5 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:00:56.366717 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f016a6eb-2988-4684-9a82-fbc1831f97b5 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:00:56.367222 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f016a6eb-2988-4684-9a82-fbc1831f97b5 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:00:56.367693 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f016a6eb-2988-4684-9a82-fbc1831f97b5 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:00:56.533652 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f016a6eb-2988-4684-9a82-fbc1831f97b5 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:00:56.541668 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f016a6eb-2988-4684-9a82-fbc1831f97b5 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/9771d91b-c36b-441b-98a0-38cbdc43beba" status: 200 len: 1677 microversion: 2.1 time: 0.187795 Aug 31 17:00:56.543318 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3668/7353] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:00:56 2022] GET /compute/v2.1/servers/9771d91b-c36b-441b-98a0-38cbdc43beba => generated 1677 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:00:57.565695 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d3bf1101-c223-4deb-ab44-1dc8f5f7c56d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:00:57.566516 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d3bf1101-c223-4deb-ab44-1dc8f5f7c56d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 9771d91b-c36b-441b-98a0-38cbdc43beba] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:00:57.572618 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d3bf1101-c223-4deb-ab44-1dc8f5f7c56d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:00:57.573629 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d3bf1101-c223-4deb-ab44-1dc8f5f7c56d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:00:57.574092 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d3bf1101-c223-4deb-ab44-1dc8f5f7c56d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:00:57.574814 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d3bf1101-c223-4deb-ab44-1dc8f5f7c56d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:00:57.575295 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d3bf1101-c223-4deb-ab44-1dc8f5f7c56d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:00:57.575745 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d3bf1101-c223-4deb-ab44-1dc8f5f7c56d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:00:57.720351 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d3bf1101-c223-4deb-ab44-1dc8f5f7c56d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:00:57.728187 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d3bf1101-c223-4deb-ab44-1dc8f5f7c56d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/9771d91b-c36b-441b-98a0-38cbdc43beba" status: 200 len: 1677 microversion: 2.1 time: 0.167512 Aug 31 17:00:57.728758 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3686/7354] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:00:57 2022] GET /compute/v2.1/servers/9771d91b-c36b-441b-98a0-38cbdc43beba => generated 1677 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:00:58.750079 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ce9a232a-5993-4f0c-b7db-664f9cfe9091 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:00:58.750942 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ce9a232a-5993-4f0c-b7db-664f9cfe9091 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 9771d91b-c36b-441b-98a0-38cbdc43beba] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:00:58.757815 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ce9a232a-5993-4f0c-b7db-664f9cfe9091 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:00:58.758300 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ce9a232a-5993-4f0c-b7db-664f9cfe9091 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:00:58.758740 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ce9a232a-5993-4f0c-b7db-664f9cfe9091 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:00:58.759454 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ce9a232a-5993-4f0c-b7db-664f9cfe9091 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:00:58.759938 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ce9a232a-5993-4f0c-b7db-664f9cfe9091 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:00:58.760369 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ce9a232a-5993-4f0c-b7db-664f9cfe9091 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:00:58.897859 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ce9a232a-5993-4f0c-b7db-664f9cfe9091 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:00:58.906275 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ce9a232a-5993-4f0c-b7db-664f9cfe9091 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/9771d91b-c36b-441b-98a0-38cbdc43beba" status: 200 len: 1682 microversion: 2.1 time: 0.160236 Aug 31 17:00:58.906850 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3669/7355] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:00:58 2022] GET /compute/v2.1/servers/9771d91b-c36b-441b-98a0-38cbdc43beba => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:00:59.929230 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5b304d9c-0881-42a7-886e-dad7578625fd tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:00:59.929910 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5b304d9c-0881-42a7-886e-dad7578625fd tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 9771d91b-c36b-441b-98a0-38cbdc43beba] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:00:59.936976 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b304d9c-0881-42a7-886e-dad7578625fd tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:00:59.937484 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b304d9c-0881-42a7-886e-dad7578625fd tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:00:59.937942 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b304d9c-0881-42a7-886e-dad7578625fd tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:00:59.938670 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b304d9c-0881-42a7-886e-dad7578625fd tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:00:59.939147 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b304d9c-0881-42a7-886e-dad7578625fd tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:00:59.939621 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b304d9c-0881-42a7-886e-dad7578625fd tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:01:00.097371 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5b304d9c-0881-42a7-886e-dad7578625fd tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:01:00.106016 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5b304d9c-0881-42a7-886e-dad7578625fd tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/9771d91b-c36b-441b-98a0-38cbdc43beba" status: 200 len: 1682 microversion: 2.1 time: 0.181527 Aug 31 17:01:00.106607 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3687/7356] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:00:59 2022] GET /compute/v2.1/servers/9771d91b-c36b-441b-98a0-38cbdc43beba => generated 1682 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:01:01.127898 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3ae09af0-bfd6-4372-b9d6-462b94048763 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:01:01.128550 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3ae09af0-bfd6-4372-b9d6-462b94048763 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 9771d91b-c36b-441b-98a0-38cbdc43beba] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:01:01.135425 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3ae09af0-bfd6-4372-b9d6-462b94048763 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:01:01.135957 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3ae09af0-bfd6-4372-b9d6-462b94048763 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:01:01.136402 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3ae09af0-bfd6-4372-b9d6-462b94048763 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:01:01.137108 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3ae09af0-bfd6-4372-b9d6-462b94048763 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:01:01.137581 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3ae09af0-bfd6-4372-b9d6-462b94048763 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:01:01.138016 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3ae09af0-bfd6-4372-b9d6-462b94048763 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:01:01.273187 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3ae09af0-bfd6-4372-b9d6-462b94048763 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:01:01.281683 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3ae09af0-bfd6-4372-b9d6-462b94048763 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/9771d91b-c36b-441b-98a0-38cbdc43beba" status: 200 len: 1682 microversion: 2.1 time: 0.158004 Aug 31 17:01:01.282260 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3670/7357] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:01:01 2022] GET /compute/v2.1/servers/9771d91b-c36b-441b-98a0-38cbdc43beba => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 17:01:02.303429 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6207cc37-ffdb-4641-814a-9a494df7de85 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:01:02.304188 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6207cc37-ffdb-4641-814a-9a494df7de85 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 9771d91b-c36b-441b-98a0-38cbdc43beba] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:01:02.312170 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6207cc37-ffdb-4641-814a-9a494df7de85 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:01:02.312685 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6207cc37-ffdb-4641-814a-9a494df7de85 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:01:02.313174 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6207cc37-ffdb-4641-814a-9a494df7de85 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:01:02.313924 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6207cc37-ffdb-4641-814a-9a494df7de85 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:01:02.314403 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6207cc37-ffdb-4641-814a-9a494df7de85 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:01:02.314852 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6207cc37-ffdb-4641-814a-9a494df7de85 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:01:02.452721 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-6207cc37-ffdb-4641-814a-9a494df7de85 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:01:02.460834 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6207cc37-ffdb-4641-814a-9a494df7de85 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/9771d91b-c36b-441b-98a0-38cbdc43beba" status: 200 len: 1682 microversion: 2.1 time: 0.161380 Aug 31 17:01:02.461426 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3688/7358] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:01:02 2022] GET /compute/v2.1/servers/9771d91b-c36b-441b-98a0-38cbdc43beba => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:01:03.483405 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-bf0b8cd3-cd29-43fa-888e-65d22b11229f tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:01:03.483963 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-bf0b8cd3-cd29-43fa-888e-65d22b11229f tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 9771d91b-c36b-441b-98a0-38cbdc43beba] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:01:03.490697 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bf0b8cd3-cd29-43fa-888e-65d22b11229f tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:01:03.491381 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bf0b8cd3-cd29-43fa-888e-65d22b11229f tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:01:03.492011 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bf0b8cd3-cd29-43fa-888e-65d22b11229f tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:01:03.492798 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bf0b8cd3-cd29-43fa-888e-65d22b11229f tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:01:03.493262 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bf0b8cd3-cd29-43fa-888e-65d22b11229f tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:01:03.493692 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bf0b8cd3-cd29-43fa-888e-65d22b11229f tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:01:03.629025 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-bf0b8cd3-cd29-43fa-888e-65d22b11229f tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:01:03.638140 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-bf0b8cd3-cd29-43fa-888e-65d22b11229f tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/9771d91b-c36b-441b-98a0-38cbdc43beba" status: 200 len: 1682 microversion: 2.1 time: 0.159214 Aug 31 17:01:03.638812 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3671/7359] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:01:03 2022] GET /compute/v2.1/servers/9771d91b-c36b-441b-98a0-38cbdc43beba => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:01:04.660357 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f2850298-2499-40bc-9471-96f046498054 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:01:04.660995 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f2850298-2499-40bc-9471-96f046498054 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 9771d91b-c36b-441b-98a0-38cbdc43beba] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:01:04.668962 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f2850298-2499-40bc-9471-96f046498054 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:01:04.669532 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f2850298-2499-40bc-9471-96f046498054 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:01:04.670350 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f2850298-2499-40bc-9471-96f046498054 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:01:04.671452 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f2850298-2499-40bc-9471-96f046498054 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:01:04.672385 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f2850298-2499-40bc-9471-96f046498054 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:01:04.673171 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f2850298-2499-40bc-9471-96f046498054 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:01:04.804332 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f2850298-2499-40bc-9471-96f046498054 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:01:04.814120 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f2850298-2499-40bc-9471-96f046498054 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/9771d91b-c36b-441b-98a0-38cbdc43beba" status: 200 len: 1682 microversion: 2.1 time: 0.157684 Aug 31 17:01:04.814717 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3689/7360] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:01:04 2022] GET /compute/v2.1/servers/9771d91b-c36b-441b-98a0-38cbdc43beba => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:01:05.835933 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9b5c159d-3c9b-4fc9-96e9-ed5406de9e39 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:01:05.836528 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9b5c159d-3c9b-4fc9-96e9-ed5406de9e39 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 9771d91b-c36b-441b-98a0-38cbdc43beba] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:01:05.843607 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9b5c159d-3c9b-4fc9-96e9-ed5406de9e39 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:01:05.844101 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9b5c159d-3c9b-4fc9-96e9-ed5406de9e39 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:01:05.844544 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9b5c159d-3c9b-4fc9-96e9-ed5406de9e39 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:01:05.845245 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9b5c159d-3c9b-4fc9-96e9-ed5406de9e39 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:01:05.845706 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9b5c159d-3c9b-4fc9-96e9-ed5406de9e39 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:01:05.846136 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9b5c159d-3c9b-4fc9-96e9-ed5406de9e39 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:01:05.976917 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-9b5c159d-3c9b-4fc9-96e9-ed5406de9e39 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:01:05.985400 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9b5c159d-3c9b-4fc9-96e9-ed5406de9e39 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/9771d91b-c36b-441b-98a0-38cbdc43beba" status: 200 len: 1682 microversion: 2.1 time: 0.153480 Aug 31 17:01:05.986005 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3672/7361] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:01:05 2022] GET /compute/v2.1/servers/9771d91b-c36b-441b-98a0-38cbdc43beba => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:01:07.006758 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2203c585-108a-471e-b530-5bdfe1f8305f tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:01:07.007340 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2203c585-108a-471e-b530-5bdfe1f8305f tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 9771d91b-c36b-441b-98a0-38cbdc43beba] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:01:07.014744 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2203c585-108a-471e-b530-5bdfe1f8305f tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:01:07.015252 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2203c585-108a-471e-b530-5bdfe1f8305f tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:01:07.015739 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2203c585-108a-471e-b530-5bdfe1f8305f tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:01:07.016461 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2203c585-108a-471e-b530-5bdfe1f8305f tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:01:07.017018 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2203c585-108a-471e-b530-5bdfe1f8305f tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:01:07.017516 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2203c585-108a-471e-b530-5bdfe1f8305f tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:01:07.158184 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2203c585-108a-471e-b530-5bdfe1f8305f tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:01:07.166461 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2203c585-108a-471e-b530-5bdfe1f8305f tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/9771d91b-c36b-441b-98a0-38cbdc43beba" status: 200 len: 1682 microversion: 2.1 time: 0.163741 Aug 31 17:01:07.167873 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3690/7362] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:01:07 2022] GET /compute/v2.1/servers/9771d91b-c36b-441b-98a0-38cbdc43beba => generated 1682 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:01:08.188981 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8bb628fe-def1-4701-94b7-eb2830bafb6d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:01:08.189599 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8bb628fe-def1-4701-94b7-eb2830bafb6d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 9771d91b-c36b-441b-98a0-38cbdc43beba] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:01:08.196531 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8bb628fe-def1-4701-94b7-eb2830bafb6d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:01:08.197028 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8bb628fe-def1-4701-94b7-eb2830bafb6d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:01:08.197471 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8bb628fe-def1-4701-94b7-eb2830bafb6d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:01:08.198704 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8bb628fe-def1-4701-94b7-eb2830bafb6d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:01:08.199175 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8bb628fe-def1-4701-94b7-eb2830bafb6d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:01:08.199645 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8bb628fe-def1-4701-94b7-eb2830bafb6d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:01:08.599670 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8bb628fe-def1-4701-94b7-eb2830bafb6d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:01:08.608132 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8bb628fe-def1-4701-94b7-eb2830bafb6d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/9771d91b-c36b-441b-98a0-38cbdc43beba" status: 200 len: 1682 microversion: 2.1 time: 0.423072 Aug 31 17:01:08.608770 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3673/7363] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:01:08 2022] GET /compute/v2.1/servers/9771d91b-c36b-441b-98a0-38cbdc43beba => generated 1682 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:01:09.630062 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d6356125-3ffe-42e4-930b-9c05dbb55595 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:01:09.630719 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d6356125-3ffe-42e4-930b-9c05dbb55595 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 9771d91b-c36b-441b-98a0-38cbdc43beba] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:01:09.640220 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d6356125-3ffe-42e4-930b-9c05dbb55595 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:01:09.640825 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d6356125-3ffe-42e4-930b-9c05dbb55595 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:01:09.641282 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d6356125-3ffe-42e4-930b-9c05dbb55595 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:01:09.642005 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d6356125-3ffe-42e4-930b-9c05dbb55595 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:01:09.642476 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d6356125-3ffe-42e4-930b-9c05dbb55595 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:01:09.642919 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d6356125-3ffe-42e4-930b-9c05dbb55595 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:01:09.781904 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d6356125-3ffe-42e4-930b-9c05dbb55595 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:01:09.789820 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d6356125-3ffe-42e4-930b-9c05dbb55595 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/9771d91b-c36b-441b-98a0-38cbdc43beba" status: 200 len: 1682 microversion: 2.1 time: 0.164332 Aug 31 17:01:09.790402 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3691/7364] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:01:09 2022] GET /compute/v2.1/servers/9771d91b-c36b-441b-98a0-38cbdc43beba => generated 1682 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:01:10.812766 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3f84621c-7b3d-4d08-8b6a-f5e70c9005d2 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:01:10.813430 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3f84621c-7b3d-4d08-8b6a-f5e70c9005d2 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 9771d91b-c36b-441b-98a0-38cbdc43beba] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:01:10.820121 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3f84621c-7b3d-4d08-8b6a-f5e70c9005d2 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:01:10.820626 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3f84621c-7b3d-4d08-8b6a-f5e70c9005d2 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:01:10.821073 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3f84621c-7b3d-4d08-8b6a-f5e70c9005d2 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:01:10.821786 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3f84621c-7b3d-4d08-8b6a-f5e70c9005d2 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:01:10.822253 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3f84621c-7b3d-4d08-8b6a-f5e70c9005d2 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:01:10.823282 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3f84621c-7b3d-4d08-8b6a-f5e70c9005d2 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:01:11.005422 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-663a17dc-836c-4a19-96e0-c5236138aeaf req-5130533b-d7ec-4e71-a886-75af9dd4c8e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9771d91b-c36b-441b-98a0-38cbdc43beba", "name": "network-vif-unplugged", "status": "completed", "tag": "14c7aab8-b889-4428-b275-55ee6c2fc5ed"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:01:11.016273 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-663a17dc-836c-4a19-96e0-c5236138aeaf req-5130533b-d7ec-4e71-a886-75af9dd4c8e2 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:01:11.016780 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-663a17dc-836c-4a19-96e0-c5236138aeaf req-5130533b-d7ec-4e71-a886-75af9dd4c8e2 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:01:11.017237 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-663a17dc-836c-4a19-96e0-c5236138aeaf req-5130533b-d7ec-4e71-a886-75af9dd4c8e2 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:01:11.030171 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-663a17dc-836c-4a19-96e0-c5236138aeaf req-5130533b-d7ec-4e71-a886-75af9dd4c8e2 service nova] Creating event network-vif-unplugged:14c7aab8-b889-4428-b275-55ee6c2fc5ed for instance 9771d91b-c36b-441b-98a0-38cbdc43beba on n-h2-850499-9 Aug 31 17:01:11.035743 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [req-663a17dc-836c-4a19-96e0-c5236138aeaf req-5130533b-d7ec-4e71-a886-75af9dd4c8e2 service nova] Instance 9771d91b-c36b-441b-98a0-38cbdc43beba is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850499-9', 'n-h1-850499-9'} {{(pid=122257) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 31 17:01:11.047278 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-663a17dc-836c-4a19-96e0-c5236138aeaf req-5130533b-d7ec-4e71-a886-75af9dd4c8e2 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.116981 Aug 31 17:01:11.047949 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3692/7365] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:01:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:01:11.099385 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3f84621c-7b3d-4d08-8b6a-f5e70c9005d2 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:01:11.107585 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3f84621c-7b3d-4d08-8b6a-f5e70c9005d2 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/9771d91b-c36b-441b-98a0-38cbdc43beba" status: 200 len: 1681 microversion: 2.1 time: 0.300521 Aug 31 17:01:11.108167 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3674/7366] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:01:10 2022] GET /compute/v2.1/servers/9771d91b-c36b-441b-98a0-38cbdc43beba => generated 1681 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:01:12.132892 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-cffb18b6-fc84-4f90-841a-bd98d0aaa7d3 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:01:12.133621 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-cffb18b6-fc84-4f90-841a-bd98d0aaa7d3 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 9771d91b-c36b-441b-98a0-38cbdc43beba] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:01:12.140133 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cffb18b6-fc84-4f90-841a-bd98d0aaa7d3 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:01:12.140653 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cffb18b6-fc84-4f90-841a-bd98d0aaa7d3 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:01:12.141117 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cffb18b6-fc84-4f90-841a-bd98d0aaa7d3 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:01:12.141847 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cffb18b6-fc84-4f90-841a-bd98d0aaa7d3 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:01:12.142326 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cffb18b6-fc84-4f90-841a-bd98d0aaa7d3 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:01:12.142773 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cffb18b6-fc84-4f90-841a-bd98d0aaa7d3 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:01:12.331910 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-cffb18b6-fc84-4f90-841a-bd98d0aaa7d3 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:01:12.341862 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-cffb18b6-fc84-4f90-841a-bd98d0aaa7d3 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/9771d91b-c36b-441b-98a0-38cbdc43beba" status: 200 len: 1681 microversion: 2.1 time: 0.214849 Aug 31 17:01:12.342558 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3693/7367] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:01:12 2022] GET /compute/v2.1/servers/9771d91b-c36b-441b-98a0-38cbdc43beba => generated 1681 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:01:13.067636 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-0c5504f1-9840-46f8-b468-28d64e790012 req-b395fc17-42f8-48b3-b5c1-2371d0db30e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9771d91b-c36b-441b-98a0-38cbdc43beba", "tag": "14c7aab8-b889-4428-b275-55ee6c2fc5ed"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:01:13.078441 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-0c5504f1-9840-46f8-b468-28d64e790012 req-b395fc17-42f8-48b3-b5c1-2371d0db30e1 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:01:13.078929 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-0c5504f1-9840-46f8-b468-28d64e790012 req-b395fc17-42f8-48b3-b5c1-2371d0db30e1 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:01:13.079373 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-0c5504f1-9840-46f8-b468-28d64e790012 req-b395fc17-42f8-48b3-b5c1-2371d0db30e1 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:01:13.091827 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-0c5504f1-9840-46f8-b468-28d64e790012 req-b395fc17-42f8-48b3-b5c1-2371d0db30e1 service nova] Creating event network-changed:14c7aab8-b889-4428-b275-55ee6c2fc5ed for instance 9771d91b-c36b-441b-98a0-38cbdc43beba on n-h2-850499-9 Aug 31 17:01:13.097610 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [req-0c5504f1-9840-46f8-b468-28d64e790012 req-b395fc17-42f8-48b3-b5c1-2371d0db30e1 service nova] Instance 9771d91b-c36b-441b-98a0-38cbdc43beba is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850499-9', 'n-h1-850499-9'} {{(pid=122256) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 31 17:01:13.109312 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-0c5504f1-9840-46f8-b468-28d64e790012 req-b395fc17-42f8-48b3-b5c1-2371d0db30e1 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045456 Aug 31 17:01:13.109927 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3675/7368] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:01:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:01:13.363854 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-22d3c125-ed32-4a52-84bc-79b6bdc17e9e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:01:13.364461 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-22d3c125-ed32-4a52-84bc-79b6bdc17e9e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 9771d91b-c36b-441b-98a0-38cbdc43beba] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:01:13.372811 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-22d3c125-ed32-4a52-84bc-79b6bdc17e9e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:01:13.373329 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-22d3c125-ed32-4a52-84bc-79b6bdc17e9e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:01:13.373862 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-22d3c125-ed32-4a52-84bc-79b6bdc17e9e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:01:13.374513 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-22d3c125-ed32-4a52-84bc-79b6bdc17e9e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:01:13.374990 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-22d3c125-ed32-4a52-84bc-79b6bdc17e9e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:01:13.375726 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-22d3c125-ed32-4a52-84bc-79b6bdc17e9e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:01:13.614199 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-22d3c125-ed32-4a52-84bc-79b6bdc17e9e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:01:13.623411 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-22d3c125-ed32-4a52-84bc-79b6bdc17e9e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/9771d91b-c36b-441b-98a0-38cbdc43beba" status: 200 len: 1679 microversion: 2.1 time: 0.263775 Aug 31 17:01:13.624344 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3694/7369] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:01:13 2022] GET /compute/v2.1/servers/9771d91b-c36b-441b-98a0-38cbdc43beba => generated 1679 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:01:14.650257 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b9fe63ec-ca48-49f7-92ab-08f65feca911 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:01:14.652109 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b9fe63ec-ca48-49f7-92ab-08f65feca911 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 9771d91b-c36b-441b-98a0-38cbdc43beba] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:01:14.658373 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b9fe63ec-ca48-49f7-92ab-08f65feca911 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:01:14.658867 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b9fe63ec-ca48-49f7-92ab-08f65feca911 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:01:14.659317 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b9fe63ec-ca48-49f7-92ab-08f65feca911 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:01:14.660057 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b9fe63ec-ca48-49f7-92ab-08f65feca911 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:01:14.660525 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b9fe63ec-ca48-49f7-92ab-08f65feca911 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:01:14.660964 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b9fe63ec-ca48-49f7-92ab-08f65feca911 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:01:14.809171 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b9fe63ec-ca48-49f7-92ab-08f65feca911 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:01:14.817625 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b9fe63ec-ca48-49f7-92ab-08f65feca911 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/9771d91b-c36b-441b-98a0-38cbdc43beba" status: 200 len: 1679 microversion: 2.1 time: 0.173575 Aug 31 17:01:14.818210 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3676/7370] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:01:14 2022] GET /compute/v2.1/servers/9771d91b-c36b-441b-98a0-38cbdc43beba => generated 1679 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:01:15.841842 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d3ee429b-6311-4182-8927-64c1b7ed59ef tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:01:15.843239 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d3ee429b-6311-4182-8927-64c1b7ed59ef tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 9771d91b-c36b-441b-98a0-38cbdc43beba] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:01:15.851770 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d3ee429b-6311-4182-8927-64c1b7ed59ef tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:01:15.852416 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d3ee429b-6311-4182-8927-64c1b7ed59ef tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:01:15.852950 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d3ee429b-6311-4182-8927-64c1b7ed59ef tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:01:15.853768 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d3ee429b-6311-4182-8927-64c1b7ed59ef tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:01:15.855546 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d3ee429b-6311-4182-8927-64c1b7ed59ef tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:01:15.856246 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d3ee429b-6311-4182-8927-64c1b7ed59ef tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:01:16.072377 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d3ee429b-6311-4182-8927-64c1b7ed59ef tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:01:16.081059 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d3ee429b-6311-4182-8927-64c1b7ed59ef tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/9771d91b-c36b-441b-98a0-38cbdc43beba" status: 200 len: 1676 microversion: 2.1 time: 0.245924 Aug 31 17:01:16.081655 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3695/7371] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:01:15 2022] GET /compute/v2.1/servers/9771d91b-c36b-441b-98a0-38cbdc43beba => generated 1676 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 17:01:16.102172 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-cc2bbbd5-9215-4f6f-9f2c-ea0b1bc457f5 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:01:16.102747 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-cc2bbbd5-9215-4f6f-9f2c-ea0b1bc457f5 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 9771d91b-c36b-441b-98a0-38cbdc43beba] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:01:16.109464 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cc2bbbd5-9215-4f6f-9f2c-ea0b1bc457f5 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:01:16.110000 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cc2bbbd5-9215-4f6f-9f2c-ea0b1bc457f5 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:01:16.110451 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cc2bbbd5-9215-4f6f-9f2c-ea0b1bc457f5 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:01:16.111194 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cc2bbbd5-9215-4f6f-9f2c-ea0b1bc457f5 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:01:16.111734 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cc2bbbd5-9215-4f6f-9f2c-ea0b1bc457f5 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:01:16.112300 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cc2bbbd5-9215-4f6f-9f2c-ea0b1bc457f5 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:01:16.179665 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-cc2bbbd5-9215-4f6f-9f2c-ea0b1bc457f5 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "POST /compute/v2.1/servers/9771d91b-c36b-441b-98a0-38cbdc43beba/action" status: 204 len: 0 microversion: 2.1 time: 0.081362 Aug 31 17:01:16.180314 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3677/7372] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 17:01:16 2022] POST /compute/v2.1/servers/9771d91b-c36b-441b-98a0-38cbdc43beba/action => generated 0 bytes in 83 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 17:01:16.192167 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f05c1542-f74e-4a22-97c3-2fbaff2a1d87 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:01:16.192903 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f05c1542-f74e-4a22-97c3-2fbaff2a1d87 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 9771d91b-c36b-441b-98a0-38cbdc43beba] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:01:16.200680 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f05c1542-f74e-4a22-97c3-2fbaff2a1d87 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:01:16.202180 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f05c1542-f74e-4a22-97c3-2fbaff2a1d87 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:01:16.202665 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f05c1542-f74e-4a22-97c3-2fbaff2a1d87 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:01:16.203405 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f05c1542-f74e-4a22-97c3-2fbaff2a1d87 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:01:16.204174 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f05c1542-f74e-4a22-97c3-2fbaff2a1d87 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:01:16.204634 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f05c1542-f74e-4a22-97c3-2fbaff2a1d87 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:01:16.422760 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f05c1542-f74e-4a22-97c3-2fbaff2a1d87 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:01:16.435114 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f05c1542-f74e-4a22-97c3-2fbaff2a1d87 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/9771d91b-c36b-441b-98a0-38cbdc43beba" status: 200 len: 1676 microversion: 2.1 time: 0.244511 Aug 31 17:01:16.436419 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3696/7373] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:01:16 2022] GET /compute/v2.1/servers/9771d91b-c36b-441b-98a0-38cbdc43beba => generated 1676 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 17:01:17.218694 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-07d82d5a-7e97-40ab-8b37-d8b722778a73 req-3feb5e24-fe8e-4cf3-892c-84df75ba53f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9771d91b-c36b-441b-98a0-38cbdc43beba", "name": "network-vif-plugged", "status": "completed", "tag": "14c7aab8-b889-4428-b275-55ee6c2fc5ed"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:01:17.232168 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-07d82d5a-7e97-40ab-8b37-d8b722778a73 req-3feb5e24-fe8e-4cf3-892c-84df75ba53f6 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:01:17.232758 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-07d82d5a-7e97-40ab-8b37-d8b722778a73 req-3feb5e24-fe8e-4cf3-892c-84df75ba53f6 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:01:17.233207 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-07d82d5a-7e97-40ab-8b37-d8b722778a73 req-3feb5e24-fe8e-4cf3-892c-84df75ba53f6 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:01:17.247017 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-07d82d5a-7e97-40ab-8b37-d8b722778a73 req-3feb5e24-fe8e-4cf3-892c-84df75ba53f6 service nova] Creating event network-vif-plugged:14c7aab8-b889-4428-b275-55ee6c2fc5ed for instance 9771d91b-c36b-441b-98a0-38cbdc43beba on n-h2-850499-9 Aug 31 17:01:17.254640 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [req-07d82d5a-7e97-40ab-8b37-d8b722778a73 req-3feb5e24-fe8e-4cf3-892c-84df75ba53f6 service nova] Instance 9771d91b-c36b-441b-98a0-38cbdc43beba is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850499-9', 'n-h1-850499-9'} {{(pid=122256) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 31 17:01:17.266511 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-07d82d5a-7e97-40ab-8b37-d8b722778a73 req-3feb5e24-fe8e-4cf3-892c-84df75ba53f6 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053318 Aug 31 17:01:17.267135 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3678/7374] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:01:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:01:17.458192 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d6033dee-166b-47a7-ac5a-3c1df0444b9c tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:01:17.458836 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d6033dee-166b-47a7-ac5a-3c1df0444b9c tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 9771d91b-c36b-441b-98a0-38cbdc43beba] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:01:17.466714 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d6033dee-166b-47a7-ac5a-3c1df0444b9c tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:01:17.467258 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d6033dee-166b-47a7-ac5a-3c1df0444b9c tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:01:17.467743 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d6033dee-166b-47a7-ac5a-3c1df0444b9c tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:01:17.468560 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d6033dee-166b-47a7-ac5a-3c1df0444b9c tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:01:17.469038 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d6033dee-166b-47a7-ac5a-3c1df0444b9c tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:01:17.469486 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d6033dee-166b-47a7-ac5a-3c1df0444b9c tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:01:17.613347 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d6033dee-166b-47a7-ac5a-3c1df0444b9c tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:01:17.622425 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d6033dee-166b-47a7-ac5a-3c1df0444b9c tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/9771d91b-c36b-441b-98a0-38cbdc43beba" status: 200 len: 1676 microversion: 2.1 time: 0.168499 Aug 31 17:01:17.623021 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3697/7375] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:01:17 2022] GET /compute/v2.1/servers/9771d91b-c36b-441b-98a0-38cbdc43beba => generated 1676 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:01:18.644730 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-52cb19a2-28b0-4818-9961-6956f50ccf5f tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:01:18.645423 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-52cb19a2-28b0-4818-9961-6956f50ccf5f tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 9771d91b-c36b-441b-98a0-38cbdc43beba] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:01:18.652652 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-52cb19a2-28b0-4818-9961-6956f50ccf5f tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:01:18.653141 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-52cb19a2-28b0-4818-9961-6956f50ccf5f tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:01:18.653578 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-52cb19a2-28b0-4818-9961-6956f50ccf5f tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:01:18.654289 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-52cb19a2-28b0-4818-9961-6956f50ccf5f tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:01:18.654726 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-52cb19a2-28b0-4818-9961-6956f50ccf5f tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:01:18.655152 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-52cb19a2-28b0-4818-9961-6956f50ccf5f tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:01:18.795871 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-52cb19a2-28b0-4818-9961-6956f50ccf5f tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:01:18.804373 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-52cb19a2-28b0-4818-9961-6956f50ccf5f tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/9771d91b-c36b-441b-98a0-38cbdc43beba" status: 200 len: 1668 microversion: 2.1 time: 0.163713 Aug 31 17:01:18.804963 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3679/7376] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:01:18 2022] GET /compute/v2.1/servers/9771d91b-c36b-441b-98a0-38cbdc43beba => generated 1668 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:01:18.825881 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c6e77c4d-5563-49db-99e5-7c1f6b196e46 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:01:18.826544 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c6e77c4d-5563-49db-99e5-7c1f6b196e46 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 9771d91b-c36b-441b-98a0-38cbdc43beba] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:01:18.833546 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c6e77c4d-5563-49db-99e5-7c1f6b196e46 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:01:18.834063 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c6e77c4d-5563-49db-99e5-7c1f6b196e46 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:01:18.834527 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c6e77c4d-5563-49db-99e5-7c1f6b196e46 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:01:18.835242 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c6e77c4d-5563-49db-99e5-7c1f6b196e46 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:01:18.835744 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c6e77c4d-5563-49db-99e5-7c1f6b196e46 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:01:18.836191 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c6e77c4d-5563-49db-99e5-7c1f6b196e46 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:01:18.973252 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c6e77c4d-5563-49db-99e5-7c1f6b196e46 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:01:18.982258 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c6e77c4d-5563-49db-99e5-7c1f6b196e46 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/9771d91b-c36b-441b-98a0-38cbdc43beba" status: 200 len: 1668 microversion: 2.1 time: 0.161067 Aug 31 17:01:18.982858 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3698/7377] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:01:18 2022] GET /compute/v2.1/servers/9771d91b-c36b-441b-98a0-38cbdc43beba => generated 1668 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:01:19.003987 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-61708642-949a-4f5f-8ea7-045acef5f48d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:01:19.004702 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-61708642-949a-4f5f-8ea7-045acef5f48d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 9771d91b-c36b-441b-98a0-38cbdc43beba] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:01:19.014513 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-61708642-949a-4f5f-8ea7-045acef5f48d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:01:19.015024 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-61708642-949a-4f5f-8ea7-045acef5f48d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:01:19.015477 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-61708642-949a-4f5f-8ea7-045acef5f48d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:01:19.016223 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-61708642-949a-4f5f-8ea7-045acef5f48d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:01:19.016696 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-61708642-949a-4f5f-8ea7-045acef5f48d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:01:19.017132 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-61708642-949a-4f5f-8ea7-045acef5f48d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:01:19.154771 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-61708642-949a-4f5f-8ea7-045acef5f48d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:01:19.162545 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-61708642-949a-4f5f-8ea7-045acef5f48d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/9771d91b-c36b-441b-98a0-38cbdc43beba" status: 200 len: 1668 microversion: 2.1 time: 0.163332 Aug 31 17:01:19.163114 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3680/7378] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:01:18 2022] GET /compute/v2.1/servers/9771d91b-c36b-441b-98a0-38cbdc43beba => generated 1668 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:01:19.183707 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d6d6637b-34db-4af6-8e45-5813d5a83a25 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:01:19.184227 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d6d6637b-34db-4af6-8e45-5813d5a83a25 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 9771d91b-c36b-441b-98a0-38cbdc43beba] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:01:19.190364 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d6d6637b-34db-4af6-8e45-5813d5a83a25 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:01:19.190872 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d6d6637b-34db-4af6-8e45-5813d5a83a25 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:01:19.191334 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d6d6637b-34db-4af6-8e45-5813d5a83a25 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:01:19.192081 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d6d6637b-34db-4af6-8e45-5813d5a83a25 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:01:19.192561 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d6d6637b-34db-4af6-8e45-5813d5a83a25 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:01:19.193009 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d6d6637b-34db-4af6-8e45-5813d5a83a25 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:01:19.212018 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:01:19.220616 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d6d6637b-34db-4af6-8e45-5813d5a83a25 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 9771d91b-c36b-441b-98a0-38cbdc43beba] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 17:01:19.301608 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d6d6637b-34db-4af6-8e45-5813d5a83a25 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "DELETE /compute/v2.1/servers/9771d91b-c36b-441b-98a0-38cbdc43beba" status: 204 len: 0 microversion: 2.1 time: 0.122172 Aug 31 17:01:19.302349 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3699/7379] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 17:01:19 2022] DELETE /compute/v2.1/servers/9771d91b-c36b-441b-98a0-38cbdc43beba => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 17:01:19.312330 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0a67cc51-35fa-40d6-a2de-2dbfc19d3d63 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:01:19.312941 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0a67cc51-35fa-40d6-a2de-2dbfc19d3d63 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 9771d91b-c36b-441b-98a0-38cbdc43beba] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:01:19.318967 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0a67cc51-35fa-40d6-a2de-2dbfc19d3d63 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:01:19.319466 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0a67cc51-35fa-40d6-a2de-2dbfc19d3d63 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:01:19.320000 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0a67cc51-35fa-40d6-a2de-2dbfc19d3d63 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:01:19.320701 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0a67cc51-35fa-40d6-a2de-2dbfc19d3d63 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:01:19.321227 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0a67cc51-35fa-40d6-a2de-2dbfc19d3d63 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:01:19.321678 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0a67cc51-35fa-40d6-a2de-2dbfc19d3d63 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:01:19.454291 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-0a67cc51-35fa-40d6-a2de-2dbfc19d3d63 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:01:19.462319 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0a67cc51-35fa-40d6-a2de-2dbfc19d3d63 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/9771d91b-c36b-441b-98a0-38cbdc43beba" status: 200 len: 1674 microversion: 2.1 time: 0.155540 Aug 31 17:01:19.462893 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3681/7380] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:01:19 2022] GET /compute/v2.1/servers/9771d91b-c36b-441b-98a0-38cbdc43beba => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:01:20.487282 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1965b4e7-af4e-4cf2-b95d-7d703669ade2 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:01:20.488068 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1965b4e7-af4e-4cf2-b95d-7d703669ade2 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 9771d91b-c36b-441b-98a0-38cbdc43beba] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:01:20.494340 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1965b4e7-af4e-4cf2-b95d-7d703669ade2 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:01:20.494960 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1965b4e7-af4e-4cf2-b95d-7d703669ade2 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:01:20.495440 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1965b4e7-af4e-4cf2-b95d-7d703669ade2 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:01:20.496225 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1965b4e7-af4e-4cf2-b95d-7d703669ade2 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:01:20.496709 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1965b4e7-af4e-4cf2-b95d-7d703669ade2 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:01:20.497158 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1965b4e7-af4e-4cf2-b95d-7d703669ade2 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:01:20.647312 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-1965b4e7-af4e-4cf2-b95d-7d703669ade2 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:01:20.657103 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1965b4e7-af4e-4cf2-b95d-7d703669ade2 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/9771d91b-c36b-441b-98a0-38cbdc43beba" status: 200 len: 1674 microversion: 2.1 time: 0.175519 Aug 31 17:01:20.657704 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3700/7381] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:01:20 2022] GET /compute/v2.1/servers/9771d91b-c36b-441b-98a0-38cbdc43beba => generated 1674 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 17:01:21.678476 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f1771671-a1b5-4894-9793-2e6fa9c6cbef tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:01:21.679108 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f1771671-a1b5-4894-9793-2e6fa9c6cbef tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 9771d91b-c36b-441b-98a0-38cbdc43beba] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:01:21.686939 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f1771671-a1b5-4894-9793-2e6fa9c6cbef tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:01:21.687990 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f1771671-a1b5-4894-9793-2e6fa9c6cbef tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:01:21.688716 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f1771671-a1b5-4894-9793-2e6fa9c6cbef tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:01:21.689692 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f1771671-a1b5-4894-9793-2e6fa9c6cbef tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:01:21.690407 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f1771671-a1b5-4894-9793-2e6fa9c6cbef tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:01:21.690915 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f1771671-a1b5-4894-9793-2e6fa9c6cbef tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:01:21.694093 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:01:21.778221 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f1771671-a1b5-4894-9793-2e6fa9c6cbef tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:01:21.786391 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f1771671-a1b5-4894-9793-2e6fa9c6cbef tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/9771d91b-c36b-441b-98a0-38cbdc43beba" status: 200 len: 1607 microversion: 2.1 time: 0.111876 Aug 31 17:01:21.786985 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3682/7382] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:01:21 2022] GET /compute/v2.1/servers/9771d91b-c36b-441b-98a0-38cbdc43beba => generated 1607 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:01:21.895837 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-e70c5de7-59d8-4dcf-8161-6e981658624f req-be7c7358-5c93-430a-8cce-f24e3fee62c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9771d91b-c36b-441b-98a0-38cbdc43beba", "name": "network-vif-deleted", "tag": "14c7aab8-b889-4428-b275-55ee6c2fc5ed"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:01:21.907402 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-e70c5de7-59d8-4dcf-8161-6e981658624f req-be7c7358-5c93-430a-8cce-f24e3fee62c7 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:01:21.907938 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-e70c5de7-59d8-4dcf-8161-6e981658624f req-be7c7358-5c93-430a-8cce-f24e3fee62c7 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:01:21.908393 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-e70c5de7-59d8-4dcf-8161-6e981658624f req-be7c7358-5c93-430a-8cce-f24e3fee62c7 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:01:21.921231 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-e70c5de7-59d8-4dcf-8161-6e981658624f req-be7c7358-5c93-430a-8cce-f24e3fee62c7 service nova] Creating event network-vif-deleted:14c7aab8-b889-4428-b275-55ee6c2fc5ed for instance 9771d91b-c36b-441b-98a0-38cbdc43beba on n-h2-850499-9 Aug 31 17:01:21.926802 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-e70c5de7-59d8-4dcf-8161-6e981658624f req-be7c7358-5c93-430a-8cce-f24e3fee62c7 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034926 Aug 31 17:01:21.927539 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3701/7383] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:01:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:01:22.810006 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-957e1f40-217f-42ec-82e0-a3c72cdf4b08 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:01:22.810633 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-957e1f40-217f-42ec-82e0-a3c72cdf4b08 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 9771d91b-c36b-441b-98a0-38cbdc43beba] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:01:22.819041 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-957e1f40-217f-42ec-82e0-a3c72cdf4b08 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:01:22.819653 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-957e1f40-217f-42ec-82e0-a3c72cdf4b08 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:01:22.820041 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-957e1f40-217f-42ec-82e0-a3c72cdf4b08 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:01:22.821494 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-957e1f40-217f-42ec-82e0-a3c72cdf4b08 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:01:22.822029 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-957e1f40-217f-42ec-82e0-a3c72cdf4b08 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:01:22.822470 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-957e1f40-217f-42ec-82e0-a3c72cdf4b08 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:01:22.837168 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-957e1f40-217f-42ec-82e0-a3c72cdf4b08 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] HTTP exception thrown: Instance 9771d91b-c36b-441b-98a0-38cbdc43beba could not be found. Aug 31 17:01:22.838937 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-957e1f40-217f-42ec-82e0-a3c72cdf4b08 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Request method failure captured: Aug 31 17:01:22.838937 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/9771d91b-c36b-441b-98a0-38cbdc43beba HTTP/1.1 Aug 31 17:01:22.838937 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 17:01:22.838937 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 17:01:22.838937 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 17:01:22.838937 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 17:01:22.838937 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 17:01:22.838937 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 17:01:22.838937 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 17:01:22.838937 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 17:01:22.838937 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD5Nv8GJZq1tAU_0B41QogV9NIcJdPpwMr_NXfjBi2_q4oUJIInVGdHr79haO8h167WXFYih4WATMYJ8x__N41D8Vj_h-g4tmjTg1gnT9rlBTtYAJ4qzKuSSR4SRddtXJGZ38GeQNeHZeDZnQxyjFCcsQeloJgCoY--vpZdgiHPrfHyY Aug 31 17:01:22.838937 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 17:01:22.838937 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 17:01:22.838937 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 17:01:22.838937 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 17:01:22.838937 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 17:01:22.838937 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 17:01:22.838937 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: f38fad62a33848c59db3d09c5c9788cc Aug 31 17:01:22.838937 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ServerActionsTestJSON-992920924 Aug 31 17:01:22.838937 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 17:01:22.838937 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 17:01:22.838937 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f38fad62a33848c59db3d09c5c9788cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f38fad62a33848c59db3d09c5c9788cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f38fad62a33848c59db3d09c5c9788cc", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f38fad62a33848c59db3d09c5c9788cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 17:01:22.838937 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ServerActionsTestJSON-992920924 Aug 31 17:01:22.838937 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: f38fad62a33848c59db3d09c5c9788cc Aug 31 17:01:22.838937 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ServerActionsTestJSON-992920924 Aug 31 17:01:22.838937 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ServerActionsTestJSON-992920924-project Aug 31 17:01:22.838937 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 17:01:22.838937 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 17:01:22.838937 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: a3e98ea428604e7da092d46e865cfe1d Aug 31 17:01:22.838937 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ServerActionsTestJSON-992920924-project Aug 31 17:01:22.838937 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 17:01:22.838937 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance 9771d91b-c36b-441b-98a0-38cbdc43beba could not be found. Aug 31 17:01:22.838937 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '9771d91b-c36b-441b-98a0-38cbdc43beba'} Aug 31 17:01:22.838937 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 17:01:22.838937 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:01:22.838937 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 17:01:22.838937 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 17:01:22.838937 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 17:01:22.838937 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 17:01:22.838937 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 17:01:22.838937 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 17:01:22.838937 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 17:01:22.838937 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 17:01:22.838937 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9771d91b-c36b-441b-98a0-38cbdc43beba could not be found. Aug 31 17:01:22.838937 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:01:22.838937 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:01:22.838937 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:01:22.838937 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:01:22.838937 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:01:22.838937 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:01:22.838937 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 17:01:22.838937 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 17:01:22.838937 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 17:01:22.838937 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 17:01:22.838937 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 17:01:22.838937 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 17:01:22.838937 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 17:01:22.838937 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 17:01:22.838937 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 17:01:22.838937 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 17:01:22.838937 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9771d91b-c36b-441b-98a0-38cbdc43beba could not be found. Aug 31 17:01:22.838937 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:01:22.838937 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:01:22.838937 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:01:22.843872 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:01:22.843872 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:01:22.843872 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:01:22.843872 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 17:01:22.843872 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 17:01:22.843872 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9771d91b-c36b-441b-98a0-38cbdc43beba could not be found. Aug 31 17:01:22.843872 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:01:22.843872 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-957e1f40-217f-42ec-82e0-a3c72cdf4b08 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Returning 404 to user: Instance 9771d91b-c36b-441b-98a0-38cbdc43beba could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 17:01:22.843872 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-957e1f40-217f-42ec-82e0-a3c72cdf4b08 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/9771d91b-c36b-441b-98a0-38cbdc43beba" status: 404 len: 111 microversion: 2.1 time: 0.035458 Aug 31 17:01:22.843872 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3683/7384] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:01:22 2022] GET /compute/v2.1/servers/9771d91b-c36b-441b-98a0-38cbdc43beba => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 17:01:22.854688 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1d056f98-137f-4423-833b-2a026e23ac66 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:01:22.855626 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1d056f98-137f-4423-833b-2a026e23ac66 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 9771d91b-c36b-441b-98a0-38cbdc43beba] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:01:22.862158 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1d056f98-137f-4423-833b-2a026e23ac66 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:01:22.862754 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1d056f98-137f-4423-833b-2a026e23ac66 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:01:22.863287 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1d056f98-137f-4423-833b-2a026e23ac66 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:01:22.864162 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1d056f98-137f-4423-833b-2a026e23ac66 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:01:22.864713 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1d056f98-137f-4423-833b-2a026e23ac66 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:01:22.865229 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1d056f98-137f-4423-833b-2a026e23ac66 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:01:22.881738 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-1d056f98-137f-4423-833b-2a026e23ac66 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] HTTP exception thrown: Instance 9771d91b-c36b-441b-98a0-38cbdc43beba could not be found. Aug 31 17:01:22.883617 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1d056f98-137f-4423-833b-2a026e23ac66 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Request method failure captured: Aug 31 17:01:22.883617 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/9771d91b-c36b-441b-98a0-38cbdc43beba HTTP/1.1 Aug 31 17:01:22.883617 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 17:01:22.883617 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 17:01:22.883617 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 17:01:22.883617 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 17:01:22.883617 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 17:01:22.883617 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 17:01:22.883617 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 17:01:22.883617 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 17:01:22.883617 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD5Nv8GJZq1tAU_0B41QogV9NIcJdPpwMr_NXfjBi2_q4oUJIInVGdHr79haO8h167WXFYih4WATMYJ8x__N41D8Vj_h-g4tmjTg1gnT9rlBTtYAJ4qzKuSSR4SRddtXJGZ38GeQNeHZeDZnQxyjFCcsQeloJgCoY--vpZdgiHPrfHyY Aug 31 17:01:22.883617 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 17:01:22.883617 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 17:01:22.883617 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 17:01:22.883617 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 17:01:22.883617 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 17:01:22.883617 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 17:01:22.883617 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: f38fad62a33848c59db3d09c5c9788cc Aug 31 17:01:22.883617 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ServerActionsTestJSON-992920924 Aug 31 17:01:22.883617 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 17:01:22.883617 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 17:01:22.883617 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f38fad62a33848c59db3d09c5c9788cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f38fad62a33848c59db3d09c5c9788cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f38fad62a33848c59db3d09c5c9788cc", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f38fad62a33848c59db3d09c5c9788cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 17:01:22.883617 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ServerActionsTestJSON-992920924 Aug 31 17:01:22.883617 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: f38fad62a33848c59db3d09c5c9788cc Aug 31 17:01:22.883617 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ServerActionsTestJSON-992920924 Aug 31 17:01:22.883617 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ServerActionsTestJSON-992920924-project Aug 31 17:01:22.883617 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 17:01:22.883617 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 17:01:22.883617 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: a3e98ea428604e7da092d46e865cfe1d Aug 31 17:01:22.883617 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ServerActionsTestJSON-992920924-project Aug 31 17:01:22.883617 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 17:01:22.883617 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance 9771d91b-c36b-441b-98a0-38cbdc43beba could not be found. Aug 31 17:01:22.883617 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '9771d91b-c36b-441b-98a0-38cbdc43beba'} Aug 31 17:01:22.883617 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 17:01:22.883617 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:01:22.883617 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 17:01:22.883617 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 17:01:22.883617 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 17:01:22.883617 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 17:01:22.883617 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 17:01:22.883617 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 17:01:22.883617 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 17:01:22.883617 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 17:01:22.883617 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9771d91b-c36b-441b-98a0-38cbdc43beba could not be found. Aug 31 17:01:22.883617 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 17:01:22.883617 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:01:22.883617 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 17:01:22.883617 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:01:22.883617 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:01:22.883617 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:01:22.883617 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 17:01:22.883617 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 17:01:22.883617 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 17:01:22.883617 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 17:01:22.883617 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 17:01:22.883617 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 17:01:22.883617 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 17:01:22.883617 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 17:01:22.883617 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 17:01:22.883617 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 17:01:22.883617 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9771d91b-c36b-441b-98a0-38cbdc43beba could not be found. Aug 31 17:01:22.883617 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 17:01:22.883617 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:01:22.883617 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 17:01:22.888372 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:01:22.888372 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:01:22.888372 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:01:22.888372 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 17:01:22.888372 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 17:01:22.888372 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9771d91b-c36b-441b-98a0-38cbdc43beba could not be found. Aug 31 17:01:22.888372 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 17:01:22.888372 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1d056f98-137f-4423-833b-2a026e23ac66 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Returning 404 to user: Instance 9771d91b-c36b-441b-98a0-38cbdc43beba could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 17:01:22.888372 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1d056f98-137f-4423-833b-2a026e23ac66 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/9771d91b-c36b-441b-98a0-38cbdc43beba" status: 404 len: 111 microversion: 2.1 time: 0.036780 Aug 31 17:01:22.889730 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3702/7385] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:01:22 2022] GET /compute/v2.1/servers/9771d91b-c36b-441b-98a0-38cbdc43beba => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 17:01:22.942800 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-80b2ae98-23af-4e7a-8d65-9a3435cef0b0 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1901099033", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "networks": [{"uuid": "41af13fa-aeee-464a-8b24-48b02ed3bdc6"}], "security_groups": [{"name": "tempest-securitygroup--824623775"}], "key_name": "tempest-keypair-1911906825", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:01:23.073094 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-80b2ae98-23af-4e7a-8d65-9a3435cef0b0 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] validate_networks() for [('41af13fa-aeee-464a-8b24-48b02ed3bdc6', None, None, None, None, None)] {{(pid=122256) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 17:01:23.517908 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-80b2ae98-23af-4e7a-8d65-9a3435cef0b0 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 17:01:23.518628 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-80b2ae98-23af-4e7a-8d65-9a3435cef0b0 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 17:01:23.518797 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-80b2ae98-23af-4e7a-8d65-9a3435cef0b0 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 17:01:23.519209 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-80b2ae98-23af-4e7a-8d65-9a3435cef0b0 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 17:01:23.519739 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-80b2ae98-23af-4e7a-8d65-9a3435cef0b0 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 17:01:23.529764 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-80b2ae98-23af-4e7a-8d65-9a3435cef0b0 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:01:23.530259 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-80b2ae98-23af-4e7a-8d65-9a3435cef0b0 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:01:23.530720 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-80b2ae98-23af-4e7a-8d65-9a3435cef0b0 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:01:23.531453 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-80b2ae98-23af-4e7a-8d65-9a3435cef0b0 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:01:23.531945 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-80b2ae98-23af-4e7a-8d65-9a3435cef0b0 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:01:23.532384 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-80b2ae98-23af-4e7a-8d65-9a3435cef0b0 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:01:23.550596 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-80b2ae98-23af-4e7a-8d65-9a3435cef0b0 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Getting quotas for project f38fad62a33848c59db3d09c5c9788cc. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 17:01:23.556073 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-80b2ae98-23af-4e7a-8d65-9a3435cef0b0 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Getting quotas for user a3e98ea428604e7da092d46e865cfe1d and project f38fad62a33848c59db3d09c5c9788cc. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 17:01:23.570051 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-80b2ae98-23af-4e7a-8d65-9a3435cef0b0 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Going to run 1 instances... {{(pid=122256) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 17:01:23.572425 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-80b2ae98-23af-4e7a-8d65-9a3435cef0b0 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: c8e9aa29-8a3f-4571-8eb1-ec393a43b095] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 17:01:23.623392 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-80b2ae98-23af-4e7a-8d65-9a3435cef0b0 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.684910 Aug 31 17:01:23.623999 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3684/7386] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 17:01:22 2022] POST /compute/v2.1/servers => generated 405 bytes in 686 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 17:01:23.635834 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f37f28ae-2d3b-4770-b34d-e445034ac356 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:01:23.636574 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f37f28ae-2d3b-4770-b34d-e445034ac356 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: c8e9aa29-8a3f-4571-8eb1-ec393a43b095] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:01:23.697654 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f37f28ae-2d3b-4770-b34d-e445034ac356 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:01:23.706987 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f37f28ae-2d3b-4770-b34d-e445034ac356 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095" status: 200 len: 1239 microversion: 2.1 time: 0.075400 Aug 31 17:01:23.707589 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3703/7387] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:01:23 2022] GET /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095 => generated 1239 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:01:24.730466 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1e506887-8de9-47ce-bc68-ca02c803a41a tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:01:24.731175 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1e506887-8de9-47ce-bc68-ca02c803a41a tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: c8e9aa29-8a3f-4571-8eb1-ec393a43b095] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:01:24.738657 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1e506887-8de9-47ce-bc68-ca02c803a41a tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:01:24.739256 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1e506887-8de9-47ce-bc68-ca02c803a41a tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:01:24.739935 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1e506887-8de9-47ce-bc68-ca02c803a41a tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:01:24.740678 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1e506887-8de9-47ce-bc68-ca02c803a41a tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:01:24.741183 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1e506887-8de9-47ce-bc68-ca02c803a41a tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:01:24.741640 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1e506887-8de9-47ce-bc68-ca02c803a41a tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:01:24.818900 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1e506887-8de9-47ce-bc68-ca02c803a41a tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:01:24.828880 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1e506887-8de9-47ce-bc68-ca02c803a41a tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095" status: 200 len: 1299 microversion: 2.1 time: 0.104119 Aug 31 17:01:24.829746 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3685/7388] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:01:24 2022] GET /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095 => generated 1299 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:01:25.851883 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-17c33048-848f-42d0-b3cd-85bc520578d1 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:01:25.852593 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-17c33048-848f-42d0-b3cd-85bc520578d1 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: c8e9aa29-8a3f-4571-8eb1-ec393a43b095] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:01:25.860638 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-17c33048-848f-42d0-b3cd-85bc520578d1 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:01:25.861467 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-17c33048-848f-42d0-b3cd-85bc520578d1 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:01:25.862116 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-17c33048-848f-42d0-b3cd-85bc520578d1 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:01:25.862862 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-17c33048-848f-42d0-b3cd-85bc520578d1 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:01:25.863349 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-17c33048-848f-42d0-b3cd-85bc520578d1 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:01:25.863866 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-17c33048-848f-42d0-b3cd-85bc520578d1 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:01:26.117900 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-17c33048-848f-42d0-b3cd-85bc520578d1 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:01:26.126704 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-17c33048-848f-42d0-b3cd-85bc520578d1 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095" status: 200 len: 1364 microversion: 2.1 time: 0.278773 Aug 31 17:01:26.127291 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3704/7389] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:01:25 2022] GET /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095 => generated 1364 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 17:01:26.522675 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-0d32be68-fc43-4253-b778-47d96a48c872 req-6891e5ad-8fd7-4543-933d-1b79c544025f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8e9aa29-8a3f-4571-8eb1-ec393a43b095", "tag": "f011e62d-d810-49e6-9659-65598c091814"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:01:26.529388 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:01:26.537648 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-0d32be68-fc43-4253-b778-47d96a48c872 req-6891e5ad-8fd7-4543-933d-1b79c544025f service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:01:26.538151 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-0d32be68-fc43-4253-b778-47d96a48c872 req-6891e5ad-8fd7-4543-933d-1b79c544025f service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:01:26.538610 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-0d32be68-fc43-4253-b778-47d96a48c872 req-6891e5ad-8fd7-4543-933d-1b79c544025f service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:01:26.557528 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-0d32be68-fc43-4253-b778-47d96a48c872 req-6891e5ad-8fd7-4543-933d-1b79c544025f service nova] Creating event network-changed:f011e62d-d810-49e6-9659-65598c091814 for instance c8e9aa29-8a3f-4571-8eb1-ec393a43b095 on n-h1-850499-9 Aug 31 17:01:26.561887 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-0d32be68-fc43-4253-b778-47d96a48c872 req-6891e5ad-8fd7-4543-933d-1b79c544025f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043494 Aug 31 17:01:26.562639 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3686/7390] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:01:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:01:27.149282 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-86df9560-494f-4b2e-acdc-ca4acfdd4b04 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:01:27.149863 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-86df9560-494f-4b2e-acdc-ca4acfdd4b04 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: c8e9aa29-8a3f-4571-8eb1-ec393a43b095] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:01:27.153858 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:01:27.159451 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-86df9560-494f-4b2e-acdc-ca4acfdd4b04 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:01:27.160008 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-86df9560-494f-4b2e-acdc-ca4acfdd4b04 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:01:27.160471 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-86df9560-494f-4b2e-acdc-ca4acfdd4b04 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:01:27.161204 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-86df9560-494f-4b2e-acdc-ca4acfdd4b04 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:01:27.161685 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-86df9560-494f-4b2e-acdc-ca4acfdd4b04 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:01:27.162135 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-86df9560-494f-4b2e-acdc-ca4acfdd4b04 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:01:27.304733 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-86df9560-494f-4b2e-acdc-ca4acfdd4b04 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:01:27.312935 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-86df9560-494f-4b2e-acdc-ca4acfdd4b04 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095" status: 200 len: 1364 microversion: 2.1 time: 0.167668 Aug 31 17:01:27.313523 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3705/7391] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:01:27 2022] GET /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095 => generated 1364 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:01:28.335579 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a5dd4853-d82b-4bb3-bd1c-1e440c48566e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:01:28.336325 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a5dd4853-d82b-4bb3-bd1c-1e440c48566e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: c8e9aa29-8a3f-4571-8eb1-ec393a43b095] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:01:28.343827 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a5dd4853-d82b-4bb3-bd1c-1e440c48566e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:01:28.344333 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a5dd4853-d82b-4bb3-bd1c-1e440c48566e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:01:28.344783 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a5dd4853-d82b-4bb3-bd1c-1e440c48566e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:01:28.345498 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a5dd4853-d82b-4bb3-bd1c-1e440c48566e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:01:28.346018 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a5dd4853-d82b-4bb3-bd1c-1e440c48566e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:01:28.346410 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a5dd4853-d82b-4bb3-bd1c-1e440c48566e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:01:28.488156 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a5dd4853-d82b-4bb3-bd1c-1e440c48566e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:01:28.497538 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a5dd4853-d82b-4bb3-bd1c-1e440c48566e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095" status: 200 len: 1364 microversion: 2.1 time: 0.166785 Aug 31 17:01:28.498051 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3687/7392] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:01:28 2022] GET /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095 => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:01:29.518799 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9f8b50d6-c9fa-45aa-9eb1-955c66cbaeb7 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:01:29.519464 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9f8b50d6-c9fa-45aa-9eb1-955c66cbaeb7 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: c8e9aa29-8a3f-4571-8eb1-ec393a43b095] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:01:29.529559 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9f8b50d6-c9fa-45aa-9eb1-955c66cbaeb7 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:01:29.530143 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9f8b50d6-c9fa-45aa-9eb1-955c66cbaeb7 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:01:29.531695 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9f8b50d6-c9fa-45aa-9eb1-955c66cbaeb7 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:01:29.531695 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9f8b50d6-c9fa-45aa-9eb1-955c66cbaeb7 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:01:29.531967 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9f8b50d6-c9fa-45aa-9eb1-955c66cbaeb7 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:01:29.532410 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9f8b50d6-c9fa-45aa-9eb1-955c66cbaeb7 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:01:29.673273 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9f8b50d6-c9fa-45aa-9eb1-955c66cbaeb7 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:01:29.681272 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9f8b50d6-c9fa-45aa-9eb1-955c66cbaeb7 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095" status: 200 len: 1364 microversion: 2.1 time: 0.166660 Aug 31 17:01:29.681889 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3706/7393] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:01:29 2022] GET /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095 => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:01:30.708710 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c6cedcfc-3493-4265-b6e7-7811282a5a04 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:01:30.709349 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c6cedcfc-3493-4265-b6e7-7811282a5a04 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: c8e9aa29-8a3f-4571-8eb1-ec393a43b095] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:01:30.716772 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c6cedcfc-3493-4265-b6e7-7811282a5a04 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:01:30.717287 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c6cedcfc-3493-4265-b6e7-7811282a5a04 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:01:30.717733 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c6cedcfc-3493-4265-b6e7-7811282a5a04 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:01:30.718433 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c6cedcfc-3493-4265-b6e7-7811282a5a04 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:01:30.718894 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c6cedcfc-3493-4265-b6e7-7811282a5a04 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:01:30.719319 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c6cedcfc-3493-4265-b6e7-7811282a5a04 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:01:30.854549 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c6cedcfc-3493-4265-b6e7-7811282a5a04 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:01:30.862239 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c6cedcfc-3493-4265-b6e7-7811282a5a04 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095" status: 200 len: 1364 microversion: 2.1 time: 0.157500 Aug 31 17:01:30.862822 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3688/7394] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:01:30 2022] GET /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:01:31.883931 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8d0bde0e-65e7-40f9-b7b3-213f511af61e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:01:31.885557 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8d0bde0e-65e7-40f9-b7b3-213f511af61e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: c8e9aa29-8a3f-4571-8eb1-ec393a43b095] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:01:31.892542 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8d0bde0e-65e7-40f9-b7b3-213f511af61e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:01:31.893053 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8d0bde0e-65e7-40f9-b7b3-213f511af61e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:01:31.893515 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8d0bde0e-65e7-40f9-b7b3-213f511af61e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:01:31.894249 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8d0bde0e-65e7-40f9-b7b3-213f511af61e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:01:31.894728 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8d0bde0e-65e7-40f9-b7b3-213f511af61e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:01:31.895180 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8d0bde0e-65e7-40f9-b7b3-213f511af61e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:01:32.029480 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-5fc07175-427c-4dfb-88f5-4c5d0fea5500 req-e6ee4cf7-e6e7-4a37-b2f0-5b666f9db674 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8e9aa29-8a3f-4571-8eb1-ec393a43b095", "name": "network-vif-plugged", "status": "completed", "tag": "f011e62d-d810-49e6-9659-65598c091814"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:01:32.039223 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8d0bde0e-65e7-40f9-b7b3-213f511af61e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:01:32.041599 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-5fc07175-427c-4dfb-88f5-4c5d0fea5500 req-e6ee4cf7-e6e7-4a37-b2f0-5b666f9db674 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:01:32.042106 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-5fc07175-427c-4dfb-88f5-4c5d0fea5500 req-e6ee4cf7-e6e7-4a37-b2f0-5b666f9db674 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:01:32.042707 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-5fc07175-427c-4dfb-88f5-4c5d0fea5500 req-e6ee4cf7-e6e7-4a37-b2f0-5b666f9db674 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:01:32.052145 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8d0bde0e-65e7-40f9-b7b3-213f511af61e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095" status: 200 len: 1364 microversion: 2.1 time: 0.172187 Aug 31 17:01:32.053371 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3707/7395] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:01:31 2022] GET /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095 => generated 1364 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:01:32.054752 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-5fc07175-427c-4dfb-88f5-4c5d0fea5500 req-e6ee4cf7-e6e7-4a37-b2f0-5b666f9db674 service nova] Creating event network-vif-plugged:f011e62d-d810-49e6-9659-65598c091814 for instance c8e9aa29-8a3f-4571-8eb1-ec393a43b095 on n-h1-850499-9 Aug 31 17:01:32.069445 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-5fc07175-427c-4dfb-88f5-4c5d0fea5500 req-e6ee4cf7-e6e7-4a37-b2f0-5b666f9db674 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044640 Aug 31 17:01:32.070091 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3689/7396] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:01:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 17:01:33.074968 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c6899a11-e6ec-43d5-9a5f-a3fd2c891a2a tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:01:33.075629 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c6899a11-e6ec-43d5-9a5f-a3fd2c891a2a tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: c8e9aa29-8a3f-4571-8eb1-ec393a43b095] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:01:33.084969 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c6899a11-e6ec-43d5-9a5f-a3fd2c891a2a tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:01:33.085496 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c6899a11-e6ec-43d5-9a5f-a3fd2c891a2a tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:01:33.085952 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c6899a11-e6ec-43d5-9a5f-a3fd2c891a2a tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:01:33.086695 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c6899a11-e6ec-43d5-9a5f-a3fd2c891a2a tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:01:33.087173 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c6899a11-e6ec-43d5-9a5f-a3fd2c891a2a tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:01:33.087810 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c6899a11-e6ec-43d5-9a5f-a3fd2c891a2a tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:01:33.255516 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c6899a11-e6ec-43d5-9a5f-a3fd2c891a2a tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:01:33.266749 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c6899a11-e6ec-43d5-9a5f-a3fd2c891a2a tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095" status: 200 len: 1364 microversion: 2.1 time: 0.196120 Aug 31 17:01:33.267363 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3708/7397] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:01:33 2022] GET /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095 => generated 1364 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:01:34.290778 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:01:34.292201 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=6 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:01:34.295640 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-55a5becf-385c-4cad-8d38-f14759ee30b7 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:01:34.296348 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-55a5becf-385c-4cad-8d38-f14759ee30b7 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: c8e9aa29-8a3f-4571-8eb1-ec393a43b095] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:01:34.303473 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-55a5becf-385c-4cad-8d38-f14759ee30b7 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:01:34.303992 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-55a5becf-385c-4cad-8d38-f14759ee30b7 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:01:34.304436 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-55a5becf-385c-4cad-8d38-f14759ee30b7 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:01:34.305139 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-55a5becf-385c-4cad-8d38-f14759ee30b7 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:01:34.305602 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-55a5becf-385c-4cad-8d38-f14759ee30b7 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:01:34.306039 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-55a5becf-385c-4cad-8d38-f14759ee30b7 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:01:34.448409 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-55a5becf-385c-4cad-8d38-f14759ee30b7 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:01:34.457025 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-55a5becf-385c-4cad-8d38-f14759ee30b7 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095" status: 200 len: 1552 microversion: 2.1 time: 0.168075 Aug 31 17:01:34.457659 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3690/7398] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:01:34 2022] GET /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095 => generated 1552 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:01:34.478295 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-69f007fc-9ffb-4e01-bc15-6f38d9cfc73e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:01:34.478968 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-69f007fc-9ffb-4e01-bc15-6f38d9cfc73e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: c8e9aa29-8a3f-4571-8eb1-ec393a43b095] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:01:34.480868 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:01:34.487105 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-69f007fc-9ffb-4e01-bc15-6f38d9cfc73e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:01:34.487697 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-69f007fc-9ffb-4e01-bc15-6f38d9cfc73e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:01:34.488166 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-69f007fc-9ffb-4e01-bc15-6f38d9cfc73e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:01:34.488897 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-69f007fc-9ffb-4e01-bc15-6f38d9cfc73e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:01:34.489541 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-69f007fc-9ffb-4e01-bc15-6f38d9cfc73e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:01:34.490270 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-69f007fc-9ffb-4e01-bc15-6f38d9cfc73e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:01:34.568959 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-69f007fc-9ffb-4e01-bc15-6f38d9cfc73e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094569 Aug 31 17:01:34.569573 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3709/7399] 10.222.0.61 () {58 vars in 1275 bytes} [Wed Aug 31 17:01:34 2022] GET /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 17:01:35.551324 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-6f8439c8-eea1-4c3c-9110-3321cd833f36 req-91655cc4-ce49-402b-879f-f150201958b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8e9aa29-8a3f-4571-8eb1-ec393a43b095", "tag": "f011e62d-d810-49e6-9659-65598c091814"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:01:35.562581 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-6f8439c8-eea1-4c3c-9110-3321cd833f36 req-91655cc4-ce49-402b-879f-f150201958b4 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:01:35.563075 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-6f8439c8-eea1-4c3c-9110-3321cd833f36 req-91655cc4-ce49-402b-879f-f150201958b4 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:01:35.563533 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-6f8439c8-eea1-4c3c-9110-3321cd833f36 req-91655cc4-ce49-402b-879f-f150201958b4 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:01:35.575149 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-6f8439c8-eea1-4c3c-9110-3321cd833f36 req-91655cc4-ce49-402b-879f-f150201958b4 service nova] Creating event network-changed:f011e62d-d810-49e6-9659-65598c091814 for instance c8e9aa29-8a3f-4571-8eb1-ec393a43b095 on n-h1-850499-9 Aug 31 17:01:35.580654 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-6f8439c8-eea1-4c3c-9110-3321cd833f36 req-91655cc4-ce49-402b-879f-f150201958b4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032788 Aug 31 17:01:35.581121 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3691/7400] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:01:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:02:49.880474 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=9 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:02:49.881330 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:02:49.882337 n-d-850499-9 devstack@n-api.service[122257]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 17:02:49.882543 n-d-850499-9 devstack@n-api.service[122257]: Wed Aug 31 17:02:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095/action (ip 10.222.0.61) !!! Aug 31 17:02:49.891327 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3e4cc6a6-424f-4a6f-98a1-9642daa44159 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:02:49.902595 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3e4cc6a6-424f-4a6f-98a1-9642daa44159 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:02:49.903156 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3e4cc6a6-424f-4a6f-98a1-9642daa44159 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:02:49.903639 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3e4cc6a6-424f-4a6f-98a1-9642daa44159 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:02:49.927535 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3e4cc6a6-424f-4a6f-98a1-9642daa44159 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: c8e9aa29-8a3f-4571-8eb1-ec393a43b095] Going to try to stop instance {{(pid=122257) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 31 17:02:49.969811 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3e4cc6a6-424f-4a6f-98a1-9642daa44159 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "POST /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095/action" status: 202 len: 0 microversion: 2.1 time: 0.091786 Aug 31 17:02:49.970647 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3710/7401] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 17:02:49 2022] POST /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 17:02:49.979421 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=11 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:02:49.980707 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=39 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:02:49.985576 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-86339175-12ec-4a7f-8f18-25b7837ed886 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:02:49.986291 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-86339175-12ec-4a7f-8f18-25b7837ed886 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: c8e9aa29-8a3f-4571-8eb1-ec393a43b095] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:02:49.994227 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-86339175-12ec-4a7f-8f18-25b7837ed886 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:02:49.994754 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-86339175-12ec-4a7f-8f18-25b7837ed886 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:02:49.995281 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-86339175-12ec-4a7f-8f18-25b7837ed886 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:02:49.996023 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-86339175-12ec-4a7f-8f18-25b7837ed886 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:02:49.996486 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-86339175-12ec-4a7f-8f18-25b7837ed886 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:02:49.996915 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-86339175-12ec-4a7f-8f18-25b7837ed886 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:02:50.134189 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-86339175-12ec-4a7f-8f18-25b7837ed886 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:02:50.142572 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-86339175-12ec-4a7f-8f18-25b7837ed886 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095" status: 200 len: 1680 microversion: 2.1 time: 0.166677 Aug 31 17:02:50.143154 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3692/7402] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:02:49 2022] GET /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095 => generated 1680 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 17:02:51.167374 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1afaceb2-957c-4ee9-a1e7-451b99445e69 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:02:51.168134 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1afaceb2-957c-4ee9-a1e7-451b99445e69 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: c8e9aa29-8a3f-4571-8eb1-ec393a43b095] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:02:51.174904 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1afaceb2-957c-4ee9-a1e7-451b99445e69 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:02:51.175424 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1afaceb2-957c-4ee9-a1e7-451b99445e69 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:02:51.175921 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1afaceb2-957c-4ee9-a1e7-451b99445e69 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:02:51.176657 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1afaceb2-957c-4ee9-a1e7-451b99445e69 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:02:51.177137 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1afaceb2-957c-4ee9-a1e7-451b99445e69 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:02:51.177690 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1afaceb2-957c-4ee9-a1e7-451b99445e69 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:02:51.318100 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-1afaceb2-957c-4ee9-a1e7-451b99445e69 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:02:51.326711 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1afaceb2-957c-4ee9-a1e7-451b99445e69 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095" status: 200 len: 1680 microversion: 2.1 time: 0.165818 Aug 31 17:02:51.327300 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3711/7403] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:02:51 2022] GET /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095 => generated 1680 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:02:52.349117 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-33a8c645-db0e-48ab-94af-08bdac949f83 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:02:52.349730 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-33a8c645-db0e-48ab-94af-08bdac949f83 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: c8e9aa29-8a3f-4571-8eb1-ec393a43b095] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:02:52.357297 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-33a8c645-db0e-48ab-94af-08bdac949f83 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:02:52.357781 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-33a8c645-db0e-48ab-94af-08bdac949f83 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:02:52.358243 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-33a8c645-db0e-48ab-94af-08bdac949f83 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:02:52.358939 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-33a8c645-db0e-48ab-94af-08bdac949f83 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:02:52.359398 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-33a8c645-db0e-48ab-94af-08bdac949f83 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:02:52.359851 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-33a8c645-db0e-48ab-94af-08bdac949f83 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:02:52.507822 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-33a8c645-db0e-48ab-94af-08bdac949f83 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:02:52.517468 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-33a8c645-db0e-48ab-94af-08bdac949f83 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095" status: 200 len: 1680 microversion: 2.1 time: 0.172230 Aug 31 17:02:52.518042 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3693/7404] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:02:52 2022] GET /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095 => generated 1680 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:02:53.539751 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-87d1a8b2-5c2f-4c69-84c3-858f2967922c tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:02:53.540307 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-87d1a8b2-5c2f-4c69-84c3-858f2967922c tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: c8e9aa29-8a3f-4571-8eb1-ec393a43b095] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:02:53.547316 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-87d1a8b2-5c2f-4c69-84c3-858f2967922c tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:02:53.547859 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-87d1a8b2-5c2f-4c69-84c3-858f2967922c tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:02:53.548321 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-87d1a8b2-5c2f-4c69-84c3-858f2967922c tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:02:53.549046 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-87d1a8b2-5c2f-4c69-84c3-858f2967922c tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:02:53.549521 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-87d1a8b2-5c2f-4c69-84c3-858f2967922c tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:02:53.549969 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-87d1a8b2-5c2f-4c69-84c3-858f2967922c tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:02:53.690169 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-87d1a8b2-5c2f-4c69-84c3-858f2967922c tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:02:53.698789 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-87d1a8b2-5c2f-4c69-84c3-858f2967922c tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095" status: 200 len: 1680 microversion: 2.1 time: 0.163161 Aug 31 17:02:53.699384 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3712/7405] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:02:53 2022] GET /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095 => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:02:54.722475 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b47f7f41-ffc6-4d7e-ad06-ff412704505a tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:02:54.722990 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b47f7f41-ffc6-4d7e-ad06-ff412704505a tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: c8e9aa29-8a3f-4571-8eb1-ec393a43b095] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:02:54.731177 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b47f7f41-ffc6-4d7e-ad06-ff412704505a tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:02:54.731707 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b47f7f41-ffc6-4d7e-ad06-ff412704505a tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:02:54.732158 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b47f7f41-ffc6-4d7e-ad06-ff412704505a tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:02:54.732866 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b47f7f41-ffc6-4d7e-ad06-ff412704505a tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:02:54.733330 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b47f7f41-ffc6-4d7e-ad06-ff412704505a tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:02:54.733766 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b47f7f41-ffc6-4d7e-ad06-ff412704505a tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:02:54.866328 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b47f7f41-ffc6-4d7e-ad06-ff412704505a tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:02:54.874300 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b47f7f41-ffc6-4d7e-ad06-ff412704505a tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095" status: 200 len: 1680 microversion: 2.1 time: 0.155838 Aug 31 17:02:54.874957 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3694/7406] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:02:54 2022] GET /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 17:02:55.896468 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e9d98928-b5f7-4c04-9c54-52bdbd529752 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:02:55.897008 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e9d98928-b5f7-4c04-9c54-52bdbd529752 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: c8e9aa29-8a3f-4571-8eb1-ec393a43b095] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:02:55.904772 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e9d98928-b5f7-4c04-9c54-52bdbd529752 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:02:55.905269 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e9d98928-b5f7-4c04-9c54-52bdbd529752 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:02:55.905720 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e9d98928-b5f7-4c04-9c54-52bdbd529752 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:02:55.906428 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e9d98928-b5f7-4c04-9c54-52bdbd529752 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:02:55.906906 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e9d98928-b5f7-4c04-9c54-52bdbd529752 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:02:55.907350 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e9d98928-b5f7-4c04-9c54-52bdbd529752 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:02:56.046626 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e9d98928-b5f7-4c04-9c54-52bdbd529752 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:02:56.054486 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e9d98928-b5f7-4c04-9c54-52bdbd529752 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095" status: 200 len: 1680 microversion: 2.1 time: 0.162068 Aug 31 17:02:56.055087 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3713/7407] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:02:55 2022] GET /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095 => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:02:57.077317 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2855fa44-30fb-49be-9732-a9e80b97fd28 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:02:57.077969 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2855fa44-30fb-49be-9732-a9e80b97fd28 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: c8e9aa29-8a3f-4571-8eb1-ec393a43b095] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:02:57.084761 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2855fa44-30fb-49be-9732-a9e80b97fd28 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:02:57.085252 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2855fa44-30fb-49be-9732-a9e80b97fd28 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:02:57.085690 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2855fa44-30fb-49be-9732-a9e80b97fd28 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:02:57.086384 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2855fa44-30fb-49be-9732-a9e80b97fd28 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:02:57.086848 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2855fa44-30fb-49be-9732-a9e80b97fd28 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:02:57.087453 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2855fa44-30fb-49be-9732-a9e80b97fd28 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:02:57.224085 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-2855fa44-30fb-49be-9732-a9e80b97fd28 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:02:57.232452 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2855fa44-30fb-49be-9732-a9e80b97fd28 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095" status: 200 len: 1680 microversion: 2.1 time: 0.159762 Aug 31 17:02:57.233051 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3695/7408] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:02:57 2022] GET /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095 => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:02:58.254211 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2548e6ac-0e1e-4f20-8cf3-f29975f3a94f tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:02:58.254847 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2548e6ac-0e1e-4f20-8cf3-f29975f3a94f tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: c8e9aa29-8a3f-4571-8eb1-ec393a43b095] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:02:58.262414 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2548e6ac-0e1e-4f20-8cf3-f29975f3a94f tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:02:58.262932 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2548e6ac-0e1e-4f20-8cf3-f29975f3a94f tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:02:58.263389 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2548e6ac-0e1e-4f20-8cf3-f29975f3a94f tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:02:58.264141 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2548e6ac-0e1e-4f20-8cf3-f29975f3a94f tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:02:58.264620 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2548e6ac-0e1e-4f20-8cf3-f29975f3a94f tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:02:58.265068 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2548e6ac-0e1e-4f20-8cf3-f29975f3a94f tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:02:58.405271 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2548e6ac-0e1e-4f20-8cf3-f29975f3a94f tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:02:58.413278 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2548e6ac-0e1e-4f20-8cf3-f29975f3a94f tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095" status: 200 len: 1680 microversion: 2.1 time: 0.163317 Aug 31 17:02:58.413884 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3714/7409] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:02:58 2022] GET /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095 => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:02:59.435256 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2a040c94-f2ca-45d3-bb25-5c0ee886b574 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:02:59.435845 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2a040c94-f2ca-45d3-bb25-5c0ee886b574 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: c8e9aa29-8a3f-4571-8eb1-ec393a43b095] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:02:59.443010 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2a040c94-f2ca-45d3-bb25-5c0ee886b574 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:02:59.443523 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2a040c94-f2ca-45d3-bb25-5c0ee886b574 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:02:59.443982 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2a040c94-f2ca-45d3-bb25-5c0ee886b574 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:02:59.444694 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2a040c94-f2ca-45d3-bb25-5c0ee886b574 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:02:59.445163 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2a040c94-f2ca-45d3-bb25-5c0ee886b574 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:02:59.445602 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2a040c94-f2ca-45d3-bb25-5c0ee886b574 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:02:59.591408 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-2a040c94-f2ca-45d3-bb25-5c0ee886b574 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:02:59.599440 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2a040c94-f2ca-45d3-bb25-5c0ee886b574 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095" status: 200 len: 1680 microversion: 2.1 time: 0.168960 Aug 31 17:02:59.600048 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3696/7410] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:02:59 2022] GET /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095 => generated 1680 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:03:00.622961 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2b3e9a41-c3a2-4cfe-8c3d-dcb88ddb81a7 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:03:00.623550 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2b3e9a41-c3a2-4cfe-8c3d-dcb88ddb81a7 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: c8e9aa29-8a3f-4571-8eb1-ec393a43b095] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:03:00.630986 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2b3e9a41-c3a2-4cfe-8c3d-dcb88ddb81a7 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:03:00.631516 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2b3e9a41-c3a2-4cfe-8c3d-dcb88ddb81a7 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:03:00.631996 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2b3e9a41-c3a2-4cfe-8c3d-dcb88ddb81a7 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:03:00.632724 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2b3e9a41-c3a2-4cfe-8c3d-dcb88ddb81a7 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:03:00.633323 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2b3e9a41-c3a2-4cfe-8c3d-dcb88ddb81a7 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:03:00.633795 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2b3e9a41-c3a2-4cfe-8c3d-dcb88ddb81a7 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:03:00.766394 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2b3e9a41-c3a2-4cfe-8c3d-dcb88ddb81a7 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:03:00.775328 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2b3e9a41-c3a2-4cfe-8c3d-dcb88ddb81a7 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095" status: 200 len: 1680 microversion: 2.1 time: 0.156137 Aug 31 17:03:00.776278 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3715/7411] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:03:00 2022] GET /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:03:01.797117 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3d76fb23-53c2-4b25-91b5-536b53ee10d9 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:03:01.797765 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3d76fb23-53c2-4b25-91b5-536b53ee10d9 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: c8e9aa29-8a3f-4571-8eb1-ec393a43b095] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:03:01.804773 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3d76fb23-53c2-4b25-91b5-536b53ee10d9 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:03:01.805262 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3d76fb23-53c2-4b25-91b5-536b53ee10d9 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:03:01.805721 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3d76fb23-53c2-4b25-91b5-536b53ee10d9 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:03:01.806438 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3d76fb23-53c2-4b25-91b5-536b53ee10d9 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:03:01.806922 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3d76fb23-53c2-4b25-91b5-536b53ee10d9 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:03:01.807445 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3d76fb23-53c2-4b25-91b5-536b53ee10d9 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:03:01.951056 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3d76fb23-53c2-4b25-91b5-536b53ee10d9 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:03:01.958258 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3d76fb23-53c2-4b25-91b5-536b53ee10d9 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095" status: 200 len: 1680 microversion: 2.1 time: 0.165075 Aug 31 17:03:01.958890 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3697/7412] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:03:01 2022] GET /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095 => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:03:02.984411 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-763076f1-967b-4fa9-838e-8c2b3f8e0593 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:03:02.985090 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-763076f1-967b-4fa9-838e-8c2b3f8e0593 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: c8e9aa29-8a3f-4571-8eb1-ec393a43b095] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:03:02.992539 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-763076f1-967b-4fa9-838e-8c2b3f8e0593 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:03:02.993063 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-763076f1-967b-4fa9-838e-8c2b3f8e0593 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:03:02.993709 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-763076f1-967b-4fa9-838e-8c2b3f8e0593 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:03:02.994812 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-763076f1-967b-4fa9-838e-8c2b3f8e0593 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:03:02.995446 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-763076f1-967b-4fa9-838e-8c2b3f8e0593 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:03:02.995928 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-763076f1-967b-4fa9-838e-8c2b3f8e0593 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:03:03.132102 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-763076f1-967b-4fa9-838e-8c2b3f8e0593 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:03:03.141370 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-763076f1-967b-4fa9-838e-8c2b3f8e0593 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095" status: 200 len: 1680 microversion: 2.1 time: 0.161185 Aug 31 17:03:03.141988 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3716/7413] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:03:02 2022] GET /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095 => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:03:04.163785 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a012fc57-1fce-4c24-926c-df062fd9534a tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:03:04.164433 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a012fc57-1fce-4c24-926c-df062fd9534a tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: c8e9aa29-8a3f-4571-8eb1-ec393a43b095] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:03:04.172016 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a012fc57-1fce-4c24-926c-df062fd9534a tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:03:04.172506 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a012fc57-1fce-4c24-926c-df062fd9534a tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:03:04.172942 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a012fc57-1fce-4c24-926c-df062fd9534a tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:03:04.173637 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a012fc57-1fce-4c24-926c-df062fd9534a tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:03:04.174094 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a012fc57-1fce-4c24-926c-df062fd9534a tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:03:04.174526 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a012fc57-1fce-4c24-926c-df062fd9534a tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:03:04.323753 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a012fc57-1fce-4c24-926c-df062fd9534a tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:03:04.333385 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a012fc57-1fce-4c24-926c-df062fd9534a tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095" status: 200 len: 1680 microversion: 2.1 time: 0.173551 Aug 31 17:03:04.333971 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3698/7414] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:03:04 2022] GET /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095 => generated 1680 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:03:05.358383 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7358089c-57b2-4624-a455-171738578516 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:03:05.359139 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7358089c-57b2-4624-a455-171738578516 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: c8e9aa29-8a3f-4571-8eb1-ec393a43b095] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:03:05.366498 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7358089c-57b2-4624-a455-171738578516 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:03:05.367010 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7358089c-57b2-4624-a455-171738578516 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:03:05.367465 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7358089c-57b2-4624-a455-171738578516 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:03:05.368210 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7358089c-57b2-4624-a455-171738578516 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:03:05.368788 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7358089c-57b2-4624-a455-171738578516 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:03:05.369292 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7358089c-57b2-4624-a455-171738578516 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:03:05.510217 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7358089c-57b2-4624-a455-171738578516 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:03:05.518330 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7358089c-57b2-4624-a455-171738578516 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095" status: 200 len: 1680 microversion: 2.1 time: 0.164952 Aug 31 17:03:05.518871 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3717/7415] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:03:05 2022] GET /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095 => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:03:06.540450 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-67dc43d9-c825-4122-afc2-ee7bd3cca5ab tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:03:06.541083 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-67dc43d9-c825-4122-afc2-ee7bd3cca5ab tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: c8e9aa29-8a3f-4571-8eb1-ec393a43b095] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:03:06.548411 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-67dc43d9-c825-4122-afc2-ee7bd3cca5ab tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:03:06.548838 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-67dc43d9-c825-4122-afc2-ee7bd3cca5ab tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:03:06.549282 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-67dc43d9-c825-4122-afc2-ee7bd3cca5ab tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:03:06.549985 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-67dc43d9-c825-4122-afc2-ee7bd3cca5ab tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:03:06.550456 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-67dc43d9-c825-4122-afc2-ee7bd3cca5ab tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:03:06.550892 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-67dc43d9-c825-4122-afc2-ee7bd3cca5ab tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:03:06.680514 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-67dc43d9-c825-4122-afc2-ee7bd3cca5ab tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:03:06.688876 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-67dc43d9-c825-4122-afc2-ee7bd3cca5ab tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095" status: 200 len: 1657 microversion: 2.1 time: 0.152321 Aug 31 17:03:06.689453 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3699/7416] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:03:06 2022] GET /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095 => generated 1657 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:03:06.709969 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d2bdbd4c-694c-45c5-b3e7-4a7158e52b98 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:03:06.712347 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d2bdbd4c-694c-45c5-b3e7-4a7158e52b98 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: c8e9aa29-8a3f-4571-8eb1-ec393a43b095] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:03:06.719405 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d2bdbd4c-694c-45c5-b3e7-4a7158e52b98 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:03:06.719955 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d2bdbd4c-694c-45c5-b3e7-4a7158e52b98 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:03:06.720415 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d2bdbd4c-694c-45c5-b3e7-4a7158e52b98 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:03:06.721141 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d2bdbd4c-694c-45c5-b3e7-4a7158e52b98 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:03:06.721622 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d2bdbd4c-694c-45c5-b3e7-4a7158e52b98 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:03:06.722071 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d2bdbd4c-694c-45c5-b3e7-4a7158e52b98 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:03:06.757438 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d2bdbd4c-694c-45c5-b3e7-4a7158e52b98 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:03:06.764846 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d2bdbd4c-694c-45c5-b3e7-4a7158e52b98 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: c8e9aa29-8a3f-4571-8eb1-ec393a43b095] Old instance type m1.heat2, new instance type m1.heat {{(pid=122257) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 31 17:03:06.771954 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-d2bdbd4c-694c-45c5-b3e7-4a7158e52b98 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 17:03:06.772390 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-d2bdbd4c-694c-45c5-b3e7-4a7158e52b98 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 17:03:06.772877 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-d2bdbd4c-694c-45c5-b3e7-4a7158e52b98 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 17:03:06.773304 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-d2bdbd4c-694c-45c5-b3e7-4a7158e52b98 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 17:03:06.773728 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-d2bdbd4c-694c-45c5-b3e7-4a7158e52b98 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 17:03:06.840628 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d2bdbd4c-694c-45c5-b3e7-4a7158e52b98 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "POST /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095/action" status: 202 len: 0 microversion: 2.1 time: 0.134631 Aug 31 17:03:06.841337 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3718/7417] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 17:03:06 2022] POST /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 17:03:06.849581 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-29043186-87aa-4c79-b738-289cf0e8c1e0 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:03:06.850206 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-29043186-87aa-4c79-b738-289cf0e8c1e0 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: c8e9aa29-8a3f-4571-8eb1-ec393a43b095] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:03:06.856684 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-29043186-87aa-4c79-b738-289cf0e8c1e0 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:03:06.857191 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-29043186-87aa-4c79-b738-289cf0e8c1e0 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:03:06.857717 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-29043186-87aa-4c79-b738-289cf0e8c1e0 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:03:06.858370 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-29043186-87aa-4c79-b738-289cf0e8c1e0 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:03:06.858855 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-29043186-87aa-4c79-b738-289cf0e8c1e0 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:03:06.859265 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-29043186-87aa-4c79-b738-289cf0e8c1e0 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:03:07.036088 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-29043186-87aa-4c79-b738-289cf0e8c1e0 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:03:07.045882 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-29043186-87aa-4c79-b738-289cf0e8c1e0 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095" status: 200 len: 1680 microversion: 2.1 time: 0.200221 Aug 31 17:03:07.046514 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3700/7418] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:03:06 2022] GET /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095 => generated 1680 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:03:08.069096 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f1f45c53-9035-443b-a802-07f86e3f69b9 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:03:08.069868 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f1f45c53-9035-443b-a802-07f86e3f69b9 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: c8e9aa29-8a3f-4571-8eb1-ec393a43b095] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:03:08.077857 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f1f45c53-9035-443b-a802-07f86e3f69b9 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:03:08.078358 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f1f45c53-9035-443b-a802-07f86e3f69b9 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:03:08.078815 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f1f45c53-9035-443b-a802-07f86e3f69b9 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:03:08.079565 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f1f45c53-9035-443b-a802-07f86e3f69b9 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:03:08.080045 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f1f45c53-9035-443b-a802-07f86e3f69b9 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:03:08.080514 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f1f45c53-9035-443b-a802-07f86e3f69b9 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:03:08.214491 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f1f45c53-9035-443b-a802-07f86e3f69b9 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:03:08.222407 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f1f45c53-9035-443b-a802-07f86e3f69b9 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095" status: 200 len: 1680 microversion: 2.1 time: 0.158217 Aug 31 17:03:08.222995 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3719/7419] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:03:08 2022] GET /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:03:09.245647 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0575cc1c-ccc1-4bcb-805b-771d9ec1e5ca tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:03:09.246236 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0575cc1c-ccc1-4bcb-805b-771d9ec1e5ca tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: c8e9aa29-8a3f-4571-8eb1-ec393a43b095] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:03:09.253723 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0575cc1c-ccc1-4bcb-805b-771d9ec1e5ca tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:03:09.254235 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0575cc1c-ccc1-4bcb-805b-771d9ec1e5ca tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:03:09.254685 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0575cc1c-ccc1-4bcb-805b-771d9ec1e5ca tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:03:09.255406 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0575cc1c-ccc1-4bcb-805b-771d9ec1e5ca tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:03:09.255906 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0575cc1c-ccc1-4bcb-805b-771d9ec1e5ca tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:03:09.256355 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0575cc1c-ccc1-4bcb-805b-771d9ec1e5ca tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:03:09.731489 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-0575cc1c-ccc1-4bcb-805b-771d9ec1e5ca tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:03:09.739565 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0575cc1c-ccc1-4bcb-805b-771d9ec1e5ca tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095" status: 200 len: 1685 microversion: 2.1 time: 0.499190 Aug 31 17:03:09.740163 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3701/7420] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:03:09 2022] GET /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095 => generated 1685 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:03:10.762899 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-55e3627a-5475-410b-bfcb-ee333741becc tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:03:10.763558 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-55e3627a-5475-410b-bfcb-ee333741becc tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: c8e9aa29-8a3f-4571-8eb1-ec393a43b095] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:03:10.770649 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-55e3627a-5475-410b-bfcb-ee333741becc tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:03:10.771162 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-55e3627a-5475-410b-bfcb-ee333741becc tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:03:10.771651 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-55e3627a-5475-410b-bfcb-ee333741becc tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:03:10.772383 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-55e3627a-5475-410b-bfcb-ee333741becc tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:03:10.772863 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-55e3627a-5475-410b-bfcb-ee333741becc tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:03:10.773314 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-55e3627a-5475-410b-bfcb-ee333741becc tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:03:10.910547 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-55e3627a-5475-410b-bfcb-ee333741becc tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:03:10.919151 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-55e3627a-5475-410b-bfcb-ee333741becc tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095" status: 200 len: 1685 microversion: 2.1 time: 0.160217 Aug 31 17:03:10.919786 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3720/7421] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:03:10 2022] GET /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095 => generated 1685 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:03:11.685065 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-9f8b69ea-ba5c-491d-b566-64e28372c5ad req-b53d87f6-790d-449a-b129-1fbf20372aa6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8e9aa29-8a3f-4571-8eb1-ec393a43b095", "name": "network-vif-unplugged", "status": "completed", "tag": "f011e62d-d810-49e6-9659-65598c091814"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:03:11.695430 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-9f8b69ea-ba5c-491d-b566-64e28372c5ad req-b53d87f6-790d-449a-b129-1fbf20372aa6 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:03:11.695823 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-9f8b69ea-ba5c-491d-b566-64e28372c5ad req-b53d87f6-790d-449a-b129-1fbf20372aa6 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:03:11.696261 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-9f8b69ea-ba5c-491d-b566-64e28372c5ad req-b53d87f6-790d-449a-b129-1fbf20372aa6 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:03:11.709143 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-9f8b69ea-ba5c-491d-b566-64e28372c5ad req-b53d87f6-790d-449a-b129-1fbf20372aa6 service nova] Creating event network-vif-unplugged:f011e62d-d810-49e6-9659-65598c091814 for instance c8e9aa29-8a3f-4571-8eb1-ec393a43b095 on n-h2-850499-9 Aug 31 17:03:11.715756 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [req-9f8b69ea-ba5c-491d-b566-64e28372c5ad req-b53d87f6-790d-449a-b129-1fbf20372aa6 service nova] Instance c8e9aa29-8a3f-4571-8eb1-ec393a43b095 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850499-9', 'n-h1-850499-9'} {{(pid=122256) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 31 17:03:11.726625 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-9f8b69ea-ba5c-491d-b566-64e28372c5ad req-b53d87f6-790d-449a-b129-1fbf20372aa6 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046067 Aug 31 17:03:11.727442 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3702/7422] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:03:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:03:11.941584 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-41d14d13-6860-4a55-a618-d0bee5112afd tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:03:11.942148 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-41d14d13-6860-4a55-a618-d0bee5112afd tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: c8e9aa29-8a3f-4571-8eb1-ec393a43b095] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:03:11.950447 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-41d14d13-6860-4a55-a618-d0bee5112afd tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:03:11.951003 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-41d14d13-6860-4a55-a618-d0bee5112afd tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:03:11.951515 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-41d14d13-6860-4a55-a618-d0bee5112afd tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:03:11.952260 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-41d14d13-6860-4a55-a618-d0bee5112afd tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:03:11.952795 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-41d14d13-6860-4a55-a618-d0bee5112afd tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:03:11.953277 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-41d14d13-6860-4a55-a618-d0bee5112afd tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:03:12.153400 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-41d14d13-6860-4a55-a618-d0bee5112afd tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:03:12.161775 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-41d14d13-6860-4a55-a618-d0bee5112afd tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095" status: 200 len: 1684 microversion: 2.1 time: 0.224206 Aug 31 17:03:12.162386 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3721/7423] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:03:11 2022] GET /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095 => generated 1684 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:03:13.187540 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0c70bd09-84c6-4732-81c1-144b5e01f804 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:03:13.188190 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0c70bd09-84c6-4732-81c1-144b5e01f804 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: c8e9aa29-8a3f-4571-8eb1-ec393a43b095] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:03:13.194477 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0c70bd09-84c6-4732-81c1-144b5e01f804 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:03:13.194983 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0c70bd09-84c6-4732-81c1-144b5e01f804 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:03:13.195433 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0c70bd09-84c6-4732-81c1-144b5e01f804 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:03:13.196165 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0c70bd09-84c6-4732-81c1-144b5e01f804 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:03:13.197851 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0c70bd09-84c6-4732-81c1-144b5e01f804 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:03:13.198294 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0c70bd09-84c6-4732-81c1-144b5e01f804 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:03:13.341567 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-0c70bd09-84c6-4732-81c1-144b5e01f804 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:03:13.349521 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0c70bd09-84c6-4732-81c1-144b5e01f804 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095" status: 200 len: 1682 microversion: 2.1 time: 0.167737 Aug 31 17:03:13.350138 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3703/7424] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:03:13 2022] GET /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095 => generated 1682 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:03:13.742638 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-7cfd6c13-2c2e-4af9-ae01-4c950f6bc622 req-e0674f3f-5124-4223-9b28-73c610049e5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8e9aa29-8a3f-4571-8eb1-ec393a43b095", "tag": "f011e62d-d810-49e6-9659-65598c091814"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:03:13.754056 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-7cfd6c13-2c2e-4af9-ae01-4c950f6bc622 req-e0674f3f-5124-4223-9b28-73c610049e5e service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:03:13.754553 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-7cfd6c13-2c2e-4af9-ae01-4c950f6bc622 req-e0674f3f-5124-4223-9b28-73c610049e5e service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:03:13.755156 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-7cfd6c13-2c2e-4af9-ae01-4c950f6bc622 req-e0674f3f-5124-4223-9b28-73c610049e5e service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:03:13.767557 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-7cfd6c13-2c2e-4af9-ae01-4c950f6bc622 req-e0674f3f-5124-4223-9b28-73c610049e5e service nova] Creating event network-changed:f011e62d-d810-49e6-9659-65598c091814 for instance c8e9aa29-8a3f-4571-8eb1-ec393a43b095 on n-h2-850499-9 Aug 31 17:03:13.773218 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [req-7cfd6c13-2c2e-4af9-ae01-4c950f6bc622 req-e0674f3f-5124-4223-9b28-73c610049e5e service nova] Instance c8e9aa29-8a3f-4571-8eb1-ec393a43b095 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850499-9', 'n-h1-850499-9'} {{(pid=122257) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 31 17:03:13.784128 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-7cfd6c13-2c2e-4af9-ae01-4c950f6bc622 req-e0674f3f-5124-4223-9b28-73c610049e5e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045197 Aug 31 17:03:13.784739 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3722/7425] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:03:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:03:14.370208 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-af146cff-f827-45cd-b414-b586b40274be tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:03:14.370861 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-af146cff-f827-45cd-b414-b586b40274be tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: c8e9aa29-8a3f-4571-8eb1-ec393a43b095] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:03:14.378030 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-af146cff-f827-45cd-b414-b586b40274be tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:03:14.378524 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-af146cff-f827-45cd-b414-b586b40274be tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:03:14.378971 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-af146cff-f827-45cd-b414-b586b40274be tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:03:14.379758 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-af146cff-f827-45cd-b414-b586b40274be tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:03:14.380224 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-af146cff-f827-45cd-b414-b586b40274be tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:03:14.380655 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-af146cff-f827-45cd-b414-b586b40274be tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:03:14.523977 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-af146cff-f827-45cd-b414-b586b40274be tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:03:14.533124 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-af146cff-f827-45cd-b414-b586b40274be tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095" status: 200 len: 1682 microversion: 2.1 time: 0.166851 Aug 31 17:03:14.533960 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3704/7426] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:03:14 2022] GET /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095 => generated 1682 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:03:15.558041 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-84d33109-18b0-4e58-bff4-43291695be85 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:03:15.558772 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-84d33109-18b0-4e58-bff4-43291695be85 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: c8e9aa29-8a3f-4571-8eb1-ec393a43b095] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:03:15.565145 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-84d33109-18b0-4e58-bff4-43291695be85 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:03:15.565659 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-84d33109-18b0-4e58-bff4-43291695be85 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:03:15.566117 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-84d33109-18b0-4e58-bff4-43291695be85 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:03:15.566839 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-84d33109-18b0-4e58-bff4-43291695be85 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:03:15.567314 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-84d33109-18b0-4e58-bff4-43291695be85 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:03:15.567797 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-84d33109-18b0-4e58-bff4-43291695be85 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:03:15.707846 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-84d33109-18b0-4e58-bff4-43291695be85 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:03:15.717456 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-84d33109-18b0-4e58-bff4-43291695be85 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095" status: 200 len: 1682 microversion: 2.1 time: 0.165161 Aug 31 17:03:15.731711 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3723/7427] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:03:15 2022] GET /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095 => generated 1682 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:03:16.740135 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b0404565-bc0d-47a7-afff-ac52b22f22af tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:03:16.740762 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b0404565-bc0d-47a7-afff-ac52b22f22af tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: c8e9aa29-8a3f-4571-8eb1-ec393a43b095] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:03:16.747831 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b0404565-bc0d-47a7-afff-ac52b22f22af tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:03:16.748338 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b0404565-bc0d-47a7-afff-ac52b22f22af tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:03:16.748794 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b0404565-bc0d-47a7-afff-ac52b22f22af tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:03:16.749505 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b0404565-bc0d-47a7-afff-ac52b22f22af tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:03:16.749979 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b0404565-bc0d-47a7-afff-ac52b22f22af tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:03:16.750422 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b0404565-bc0d-47a7-afff-ac52b22f22af tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:03:16.886477 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b0404565-bc0d-47a7-afff-ac52b22f22af tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:03:16.894383 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b0404565-bc0d-47a7-afff-ac52b22f22af tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095" status: 200 len: 1678 microversion: 2.1 time: 0.158155 Aug 31 17:03:16.894963 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3705/7428] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:03:16 2022] GET /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095 => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:03:16.916001 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f561273d-4f17-4be7-8e5b-deb250ba4180 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:03:16.916601 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f561273d-4f17-4be7-8e5b-deb250ba4180 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: c8e9aa29-8a3f-4571-8eb1-ec393a43b095] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:03:16.923557 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f561273d-4f17-4be7-8e5b-deb250ba4180 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:03:16.924069 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f561273d-4f17-4be7-8e5b-deb250ba4180 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:03:16.924530 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f561273d-4f17-4be7-8e5b-deb250ba4180 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:03:16.925243 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f561273d-4f17-4be7-8e5b-deb250ba4180 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:03:16.925720 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f561273d-4f17-4be7-8e5b-deb250ba4180 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:03:16.926165 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f561273d-4f17-4be7-8e5b-deb250ba4180 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:03:16.945228 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:03:16.988584 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f561273d-4f17-4be7-8e5b-deb250ba4180 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "POST /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095/action" status: 204 len: 0 microversion: 2.1 time: 0.076876 Aug 31 17:03:16.989250 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3724/7429] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 17:03:16 2022] POST /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095/action => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 17:03:16.997942 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-59222e72-1e8d-486c-9f90-d6dd3daad85b tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:03:16.998532 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-59222e72-1e8d-486c-9f90-d6dd3daad85b tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: c8e9aa29-8a3f-4571-8eb1-ec393a43b095] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:03:17.011068 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-59222e72-1e8d-486c-9f90-d6dd3daad85b tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:03:17.011588 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-59222e72-1e8d-486c-9f90-d6dd3daad85b tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:03:17.012242 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-59222e72-1e8d-486c-9f90-d6dd3daad85b tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:03:17.013002 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-59222e72-1e8d-486c-9f90-d6dd3daad85b tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:03:17.013423 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-59222e72-1e8d-486c-9f90-d6dd3daad85b tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:03:17.013859 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-59222e72-1e8d-486c-9f90-d6dd3daad85b tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:03:17.230236 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-59222e72-1e8d-486c-9f90-d6dd3daad85b tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:03:17.238003 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-59222e72-1e8d-486c-9f90-d6dd3daad85b tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095" status: 200 len: 1678 microversion: 2.1 time: 0.244503 Aug 31 17:03:17.238605 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3706/7430] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:03:16 2022] GET /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095 => generated 1678 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:03:17.803314 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-a4b6b135-6b95-401b-a0cc-0d0c5e9c64ac req-b3d50aac-2b88-4839-8675-94260e304373 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8e9aa29-8a3f-4571-8eb1-ec393a43b095", "name": "network-vif-plugged", "status": "completed", "tag": "f011e62d-d810-49e6-9659-65598c091814"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:03:17.814255 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-a4b6b135-6b95-401b-a0cc-0d0c5e9c64ac req-b3d50aac-2b88-4839-8675-94260e304373 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:03:17.814760 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-a4b6b135-6b95-401b-a0cc-0d0c5e9c64ac req-b3d50aac-2b88-4839-8675-94260e304373 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:03:17.815215 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-a4b6b135-6b95-401b-a0cc-0d0c5e9c64ac req-b3d50aac-2b88-4839-8675-94260e304373 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:03:17.828924 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-a4b6b135-6b95-401b-a0cc-0d0c5e9c64ac req-b3d50aac-2b88-4839-8675-94260e304373 service nova] Creating event network-vif-plugged:f011e62d-d810-49e6-9659-65598c091814 for instance c8e9aa29-8a3f-4571-8eb1-ec393a43b095 on n-h2-850499-9 Aug 31 17:03:17.834400 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [req-a4b6b135-6b95-401b-a0cc-0d0c5e9c64ac req-b3d50aac-2b88-4839-8675-94260e304373 service nova] Instance c8e9aa29-8a3f-4571-8eb1-ec393a43b095 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850499-9', 'n-h1-850499-9'} {{(pid=122257) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 31 17:03:17.846832 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-a4b6b135-6b95-401b-a0cc-0d0c5e9c64ac req-b3d50aac-2b88-4839-8675-94260e304373 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047546 Aug 31 17:03:17.847443 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3725/7431] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:03:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:03:18.259665 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-35190979-4486-4130-8b4e-70750a26fc27 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:03:18.260345 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-35190979-4486-4130-8b4e-70750a26fc27 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: c8e9aa29-8a3f-4571-8eb1-ec393a43b095] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:03:18.267011 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-35190979-4486-4130-8b4e-70750a26fc27 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:03:18.267530 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-35190979-4486-4130-8b4e-70750a26fc27 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:03:18.267965 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-35190979-4486-4130-8b4e-70750a26fc27 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:03:18.268662 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-35190979-4486-4130-8b4e-70750a26fc27 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:03:18.269119 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-35190979-4486-4130-8b4e-70750a26fc27 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:03:18.269548 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-35190979-4486-4130-8b4e-70750a26fc27 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:03:18.417075 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-35190979-4486-4130-8b4e-70750a26fc27 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:03:18.425637 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-35190979-4486-4130-8b4e-70750a26fc27 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095" status: 200 len: 1678 microversion: 2.1 time: 0.169892 Aug 31 17:03:18.426222 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3707/7432] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:03:18 2022] GET /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095 => generated 1678 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:03:19.449493 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-24341f70-f212-4d43-9e00-45f2d162f405 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:03:19.450233 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-24341f70-f212-4d43-9e00-45f2d162f405 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: c8e9aa29-8a3f-4571-8eb1-ec393a43b095] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:03:19.456716 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-24341f70-f212-4d43-9e00-45f2d162f405 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:03:19.457228 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-24341f70-f212-4d43-9e00-45f2d162f405 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:03:19.457690 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-24341f70-f212-4d43-9e00-45f2d162f405 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:03:19.458417 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-24341f70-f212-4d43-9e00-45f2d162f405 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:03:19.458897 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-24341f70-f212-4d43-9e00-45f2d162f405 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:03:19.459347 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-24341f70-f212-4d43-9e00-45f2d162f405 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:03:19.594827 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-24341f70-f212-4d43-9e00-45f2d162f405 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:03:19.603362 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-24341f70-f212-4d43-9e00-45f2d162f405 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095" status: 200 len: 1657 microversion: 2.1 time: 0.159025 Aug 31 17:03:19.604062 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3726/7433] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:03:19 2022] GET /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095 => generated 1657 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:03:19.623690 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7a5129e8-b6a4-42f0-8dd7-2d53ae7951cb tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:03:19.624663 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7a5129e8-b6a4-42f0-8dd7-2d53ae7951cb tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: c8e9aa29-8a3f-4571-8eb1-ec393a43b095] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:03:19.631713 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7a5129e8-b6a4-42f0-8dd7-2d53ae7951cb tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:03:19.632184 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7a5129e8-b6a4-42f0-8dd7-2d53ae7951cb tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:03:19.632621 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7a5129e8-b6a4-42f0-8dd7-2d53ae7951cb tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:03:19.633314 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7a5129e8-b6a4-42f0-8dd7-2d53ae7951cb tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:03:19.633886 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7a5129e8-b6a4-42f0-8dd7-2d53ae7951cb tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:03:19.634338 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7a5129e8-b6a4-42f0-8dd7-2d53ae7951cb tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:03:19.769850 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7a5129e8-b6a4-42f0-8dd7-2d53ae7951cb tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:03:19.773418 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=100 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:03:19.779801 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7a5129e8-b6a4-42f0-8dd7-2d53ae7951cb tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095" status: 200 len: 1657 microversion: 2.1 time: 0.159948 Aug 31 17:03:19.780381 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3708/7434] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:03:19 2022] GET /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095 => generated 1657 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 17:03:19.800013 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f73b0850-9533-4bf0-9fc0-b25034bb38bf tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:03:19.806329 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f73b0850-9533-4bf0-9fc0-b25034bb38bf tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:03:19.806842 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f73b0850-9533-4bf0-9fc0-b25034bb38bf tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:03:19.807302 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f73b0850-9533-4bf0-9fc0-b25034bb38bf tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:03:19.843784 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f73b0850-9533-4bf0-9fc0-b25034bb38bf tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: c8e9aa29-8a3f-4571-8eb1-ec393a43b095] Going to try to start instance {{(pid=122257) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 31 17:03:19.886735 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f73b0850-9533-4bf0-9fc0-b25034bb38bf tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "POST /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095/action" status: 202 len: 0 microversion: 2.1 time: 0.090459 Aug 31 17:03:19.887344 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3727/7435] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 17:03:19 2022] POST /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 17:03:19.895807 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-30c24a3e-fad4-4a15-94fd-5a45ba4bfc90 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:03:19.896430 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-30c24a3e-fad4-4a15-94fd-5a45ba4bfc90 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: c8e9aa29-8a3f-4571-8eb1-ec393a43b095] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:03:19.903460 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-30c24a3e-fad4-4a15-94fd-5a45ba4bfc90 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:03:19.904037 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-30c24a3e-fad4-4a15-94fd-5a45ba4bfc90 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:03:19.904430 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-30c24a3e-fad4-4a15-94fd-5a45ba4bfc90 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:03:19.905145 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-30c24a3e-fad4-4a15-94fd-5a45ba4bfc90 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:03:19.905763 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-30c24a3e-fad4-4a15-94fd-5a45ba4bfc90 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:03:19.906536 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-30c24a3e-fad4-4a15-94fd-5a45ba4bfc90 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:03:20.075841 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-30c24a3e-fad4-4a15-94fd-5a45ba4bfc90 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:03:20.083804 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-30c24a3e-fad4-4a15-94fd-5a45ba4bfc90 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095" status: 200 len: 1666 microversion: 2.1 time: 0.191832 Aug 31 17:03:20.084393 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3709/7436] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:03:19 2022] GET /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095 => generated 1666 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 17:03:21.106891 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b46cb17a-b803-45d9-9bcf-c9cd98812050 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:03:21.107653 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b46cb17a-b803-45d9-9bcf-c9cd98812050 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: c8e9aa29-8a3f-4571-8eb1-ec393a43b095] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:03:21.109683 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=41 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:03:21.115439 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b46cb17a-b803-45d9-9bcf-c9cd98812050 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:03:21.115977 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b46cb17a-b803-45d9-9bcf-c9cd98812050 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:03:21.116440 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b46cb17a-b803-45d9-9bcf-c9cd98812050 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:03:21.117174 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b46cb17a-b803-45d9-9bcf-c9cd98812050 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:03:21.117653 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b46cb17a-b803-45d9-9bcf-c9cd98812050 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:03:21.118610 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b46cb17a-b803-45d9-9bcf-c9cd98812050 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:03:21.276760 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b46cb17a-b803-45d9-9bcf-c9cd98812050 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:03:21.284927 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b46cb17a-b803-45d9-9bcf-c9cd98812050 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095" status: 200 len: 1666 microversion: 2.1 time: 0.183400 Aug 31 17:03:21.285516 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3728/7437] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:03:21 2022] GET /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095 => generated 1666 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:03:22.310116 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ec3139ee-1e4e-4e1c-9d04-be5de3ac1945 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:03:22.310758 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ec3139ee-1e4e-4e1c-9d04-be5de3ac1945 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: c8e9aa29-8a3f-4571-8eb1-ec393a43b095] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:03:22.315296 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=37 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:03:22.322343 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ec3139ee-1e4e-4e1c-9d04-be5de3ac1945 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:03:22.322892 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ec3139ee-1e4e-4e1c-9d04-be5de3ac1945 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:03:22.323345 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ec3139ee-1e4e-4e1c-9d04-be5de3ac1945 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:03:22.324096 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ec3139ee-1e4e-4e1c-9d04-be5de3ac1945 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:03:22.324566 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ec3139ee-1e4e-4e1c-9d04-be5de3ac1945 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:03:22.325007 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ec3139ee-1e4e-4e1c-9d04-be5de3ac1945 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:03:22.463484 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ec3139ee-1e4e-4e1c-9d04-be5de3ac1945 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:03:22.471598 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ec3139ee-1e4e-4e1c-9d04-be5de3ac1945 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095" status: 200 len: 1670 microversion: 2.1 time: 0.167375 Aug 31 17:03:22.472297 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3710/7438] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:03:22 2022] GET /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095 => generated 1670 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:03:22.497083 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-df9d0091-cb7d-45c3-b734-8ef249861239 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:03:22.497644 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-df9d0091-cb7d-45c3-b734-8ef249861239 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: c8e9aa29-8a3f-4571-8eb1-ec393a43b095] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:03:22.505112 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-df9d0091-cb7d-45c3-b734-8ef249861239 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:03:22.505662 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-df9d0091-cb7d-45c3-b734-8ef249861239 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:03:22.506131 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-df9d0091-cb7d-45c3-b734-8ef249861239 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:03:22.506858 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-df9d0091-cb7d-45c3-b734-8ef249861239 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:03:22.507342 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-df9d0091-cb7d-45c3-b734-8ef249861239 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:03:22.507820 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-df9d0091-cb7d-45c3-b734-8ef249861239 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:03:22.535290 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-df9d0091-cb7d-45c3-b734-8ef249861239 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: c8e9aa29-8a3f-4571-8eb1-ec393a43b095] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 17:03:22.614549 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-df9d0091-cb7d-45c3-b734-8ef249861239 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "DELETE /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095" status: 204 len: 0 microversion: 2.1 time: 0.121630 Aug 31 17:03:22.615047 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3729/7439] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 17:03:22 2022] DELETE /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 17:03:22.624565 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0f19954e-23d1-4764-83e2-c49b2e67a55e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:03:22.625188 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0f19954e-23d1-4764-83e2-c49b2e67a55e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: c8e9aa29-8a3f-4571-8eb1-ec393a43b095] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:03:22.632421 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0f19954e-23d1-4764-83e2-c49b2e67a55e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:03:22.632924 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0f19954e-23d1-4764-83e2-c49b2e67a55e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:03:22.633374 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0f19954e-23d1-4764-83e2-c49b2e67a55e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:03:22.634788 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0f19954e-23d1-4764-83e2-c49b2e67a55e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:03:22.635411 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0f19954e-23d1-4764-83e2-c49b2e67a55e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:03:22.635888 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0f19954e-23d1-4764-83e2-c49b2e67a55e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:03:22.767539 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-0f19954e-23d1-4764-83e2-c49b2e67a55e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:03:22.775992 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0f19954e-23d1-4764-83e2-c49b2e67a55e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095" status: 200 len: 1676 microversion: 2.1 time: 0.155537 Aug 31 17:03:22.776581 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3711/7440] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:03:22 2022] GET /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095 => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:03:23.798164 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3684139b-aafc-4525-ad4f-a72accc72314 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:03:23.798888 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3684139b-aafc-4525-ad4f-a72accc72314 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: c8e9aa29-8a3f-4571-8eb1-ec393a43b095] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:03:23.806815 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3684139b-aafc-4525-ad4f-a72accc72314 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:03:23.807338 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3684139b-aafc-4525-ad4f-a72accc72314 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:03:23.807945 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3684139b-aafc-4525-ad4f-a72accc72314 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:03:23.808681 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3684139b-aafc-4525-ad4f-a72accc72314 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:03:23.809166 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3684139b-aafc-4525-ad4f-a72accc72314 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:03:23.809627 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3684139b-aafc-4525-ad4f-a72accc72314 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:03:23.946034 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3684139b-aafc-4525-ad4f-a72accc72314 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:03:23.955587 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3684139b-aafc-4525-ad4f-a72accc72314 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095" status: 200 len: 1676 microversion: 2.1 time: 0.161679 Aug 31 17:03:23.956756 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3730/7441] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:03:23 2022] GET /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095 => generated 1676 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:03:24.984097 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a8d54081-2b1c-467d-8de3-9972ca15fc38 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:03:24.984906 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a8d54081-2b1c-467d-8de3-9972ca15fc38 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: c8e9aa29-8a3f-4571-8eb1-ec393a43b095] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:03:24.992684 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a8d54081-2b1c-467d-8de3-9972ca15fc38 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:03:24.993941 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a8d54081-2b1c-467d-8de3-9972ca15fc38 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:03:24.994412 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a8d54081-2b1c-467d-8de3-9972ca15fc38 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:03:24.995158 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a8d54081-2b1c-467d-8de3-9972ca15fc38 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:03:24.995673 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a8d54081-2b1c-467d-8de3-9972ca15fc38 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:03:24.996124 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a8d54081-2b1c-467d-8de3-9972ca15fc38 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:03:25.299681 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a8d54081-2b1c-467d-8de3-9972ca15fc38 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:03:25.307529 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a8d54081-2b1c-467d-8de3-9972ca15fc38 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095" status: 200 len: 1609 microversion: 2.1 time: 0.327788 Aug 31 17:03:25.308125 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3712/7442] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:03:24 2022] GET /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095 => generated 1609 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:03:25.527854 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-43595dcc-b6ed-46a1-9dad-2cfbe6d1802a req-bbe1ce88-ef3f-43b3-9db4-df12259c54fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8e9aa29-8a3f-4571-8eb1-ec393a43b095", "name": "network-vif-deleted", "tag": "f011e62d-d810-49e6-9659-65598c091814"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:03:25.540156 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-43595dcc-b6ed-46a1-9dad-2cfbe6d1802a req-bbe1ce88-ef3f-43b3-9db4-df12259c54fc service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:03:25.540785 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-43595dcc-b6ed-46a1-9dad-2cfbe6d1802a req-bbe1ce88-ef3f-43b3-9db4-df12259c54fc service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:03:25.541243 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-43595dcc-b6ed-46a1-9dad-2cfbe6d1802a req-bbe1ce88-ef3f-43b3-9db4-df12259c54fc service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:03:25.554725 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-43595dcc-b6ed-46a1-9dad-2cfbe6d1802a req-bbe1ce88-ef3f-43b3-9db4-df12259c54fc service nova] Creating event network-vif-deleted:f011e62d-d810-49e6-9659-65598c091814 for instance c8e9aa29-8a3f-4571-8eb1-ec393a43b095 on n-h2-850499-9 Aug 31 17:03:25.561376 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-43595dcc-b6ed-46a1-9dad-2cfbe6d1802a req-bbe1ce88-ef3f-43b3-9db4-df12259c54fc service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038412 Aug 31 17:03:25.562312 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3731/7443] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:03:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:03:26.329456 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d613207b-e6ff-4767-bb6e-d8e560279b24 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:03:26.330056 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d613207b-e6ff-4767-bb6e-d8e560279b24 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: c8e9aa29-8a3f-4571-8eb1-ec393a43b095] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:03:26.337407 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d613207b-e6ff-4767-bb6e-d8e560279b24 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:03:26.338191 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d613207b-e6ff-4767-bb6e-d8e560279b24 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:03:26.338816 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d613207b-e6ff-4767-bb6e-d8e560279b24 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:03:26.339545 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d613207b-e6ff-4767-bb6e-d8e560279b24 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:03:26.340009 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d613207b-e6ff-4767-bb6e-d8e560279b24 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:03:26.340440 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d613207b-e6ff-4767-bb6e-d8e560279b24 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:03:26.355435 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-d613207b-e6ff-4767-bb6e-d8e560279b24 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] HTTP exception thrown: Instance c8e9aa29-8a3f-4571-8eb1-ec393a43b095 could not be found. Aug 31 17:03:26.357229 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d613207b-e6ff-4767-bb6e-d8e560279b24 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Request method failure captured: Aug 31 17:03:26.357229 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095 HTTP/1.1 Aug 31 17:03:26.357229 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 17:03:26.357229 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 17:03:26.357229 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 17:03:26.357229 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 17:03:26.357229 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 17:03:26.357229 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 17:03:26.357229 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 17:03:26.357229 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 17:03:26.357229 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD5Nv8GJZq1tAU_0B41QogV9NIcJdPpwMr_NXfjBi2_q4oUJIInVGdHr79haO8h167WXFYih4WATMYJ8x__N41D8Vj_h-g4tmjTg1gnT9rlBTtYAJ4qzKuSSR4SRddtXJGZ38GeQNeHZeDZnQxyjFCcsQeloJgCoY--vpZdgiHPrfHyY Aug 31 17:03:26.357229 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 17:03:26.357229 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 17:03:26.357229 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 17:03:26.357229 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 17:03:26.357229 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 17:03:26.357229 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 17:03:26.357229 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: f38fad62a33848c59db3d09c5c9788cc Aug 31 17:03:26.357229 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ServerActionsTestJSON-992920924 Aug 31 17:03:26.357229 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 17:03:26.357229 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 17:03:26.357229 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f38fad62a33848c59db3d09c5c9788cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f38fad62a33848c59db3d09c5c9788cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f38fad62a33848c59db3d09c5c9788cc", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f38fad62a33848c59db3d09c5c9788cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 17:03:26.357229 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ServerActionsTestJSON-992920924 Aug 31 17:03:26.357229 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: f38fad62a33848c59db3d09c5c9788cc Aug 31 17:03:26.357229 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ServerActionsTestJSON-992920924 Aug 31 17:03:26.357229 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ServerActionsTestJSON-992920924-project Aug 31 17:03:26.357229 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 17:03:26.357229 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 17:03:26.357229 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: a3e98ea428604e7da092d46e865cfe1d Aug 31 17:03:26.357229 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ServerActionsTestJSON-992920924-project Aug 31 17:03:26.357229 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 17:03:26.357229 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance c8e9aa29-8a3f-4571-8eb1-ec393a43b095 could not be found. Aug 31 17:03:26.357229 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': 'c8e9aa29-8a3f-4571-8eb1-ec393a43b095'} Aug 31 17:03:26.357229 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 17:03:26.357229 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:03:26.357229 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 17:03:26.357229 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 17:03:26.357229 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 17:03:26.357229 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 17:03:26.357229 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 17:03:26.357229 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 17:03:26.357229 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 17:03:26.357229 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 17:03:26.357229 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8e9aa29-8a3f-4571-8eb1-ec393a43b095 could not be found. Aug 31 17:03:26.357229 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:03:26.357229 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:03:26.357229 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:03:26.357229 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:03:26.357229 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:03:26.357229 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:03:26.357229 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 17:03:26.357229 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 17:03:26.357229 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 17:03:26.357229 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 17:03:26.357229 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 17:03:26.357229 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 17:03:26.357229 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 17:03:26.357229 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 17:03:26.357229 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 17:03:26.357229 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 17:03:26.357229 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8e9aa29-8a3f-4571-8eb1-ec393a43b095 could not be found. Aug 31 17:03:26.357229 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:03:26.357229 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:03:26.357229 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:03:26.361481 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:03:26.361481 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:03:26.361481 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:03:26.361481 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 17:03:26.361481 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 17:03:26.361481 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8e9aa29-8a3f-4571-8eb1-ec393a43b095 could not be found. Aug 31 17:03:26.361481 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:03:26.361481 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d613207b-e6ff-4767-bb6e-d8e560279b24 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Returning 404 to user: Instance c8e9aa29-8a3f-4571-8eb1-ec393a43b095 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 17:03:26.361481 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d613207b-e6ff-4767-bb6e-d8e560279b24 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095" status: 404 len: 111 microversion: 2.1 time: 0.033288 Aug 31 17:03:26.361481 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3713/7444] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:03:26 2022] GET /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 17:03:26.381076 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-dd70af88-a065-4915-be7d-da1afd931ece tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:03:26.381800 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-dd70af88-a065-4915-be7d-da1afd931ece tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: c8e9aa29-8a3f-4571-8eb1-ec393a43b095] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:03:26.388458 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dd70af88-a065-4915-be7d-da1afd931ece tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:03:26.388981 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dd70af88-a065-4915-be7d-da1afd931ece tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:03:26.389667 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dd70af88-a065-4915-be7d-da1afd931ece tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:03:26.390549 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dd70af88-a065-4915-be7d-da1afd931ece tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:03:26.391040 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dd70af88-a065-4915-be7d-da1afd931ece tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:03:26.391486 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dd70af88-a065-4915-be7d-da1afd931ece tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:03:26.406039 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-dd70af88-a065-4915-be7d-da1afd931ece tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] HTTP exception thrown: Instance c8e9aa29-8a3f-4571-8eb1-ec393a43b095 could not be found. Aug 31 17:03:26.407782 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-dd70af88-a065-4915-be7d-da1afd931ece tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Request method failure captured: Aug 31 17:03:26.407782 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095 HTTP/1.1 Aug 31 17:03:26.407782 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 17:03:26.407782 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 17:03:26.407782 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 17:03:26.407782 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 17:03:26.407782 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 17:03:26.407782 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 17:03:26.407782 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 17:03:26.407782 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 17:03:26.407782 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD5Nv8GJZq1tAU_0B41QogV9NIcJdPpwMr_NXfjBi2_q4oUJIInVGdHr79haO8h167WXFYih4WATMYJ8x__N41D8Vj_h-g4tmjTg1gnT9rlBTtYAJ4qzKuSSR4SRddtXJGZ38GeQNeHZeDZnQxyjFCcsQeloJgCoY--vpZdgiHPrfHyY Aug 31 17:03:26.407782 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 17:03:26.407782 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 17:03:26.407782 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 17:03:26.407782 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 17:03:26.407782 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 17:03:26.407782 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 17:03:26.407782 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: f38fad62a33848c59db3d09c5c9788cc Aug 31 17:03:26.407782 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ServerActionsTestJSON-992920924 Aug 31 17:03:26.407782 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 17:03:26.407782 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 17:03:26.407782 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f38fad62a33848c59db3d09c5c9788cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f38fad62a33848c59db3d09c5c9788cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f38fad62a33848c59db3d09c5c9788cc", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f38fad62a33848c59db3d09c5c9788cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 17:03:26.407782 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ServerActionsTestJSON-992920924 Aug 31 17:03:26.407782 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: f38fad62a33848c59db3d09c5c9788cc Aug 31 17:03:26.407782 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ServerActionsTestJSON-992920924 Aug 31 17:03:26.407782 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ServerActionsTestJSON-992920924-project Aug 31 17:03:26.407782 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 17:03:26.407782 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 17:03:26.407782 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: a3e98ea428604e7da092d46e865cfe1d Aug 31 17:03:26.407782 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ServerActionsTestJSON-992920924-project Aug 31 17:03:26.407782 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 17:03:26.407782 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance c8e9aa29-8a3f-4571-8eb1-ec393a43b095 could not be found. Aug 31 17:03:26.407782 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': 'c8e9aa29-8a3f-4571-8eb1-ec393a43b095'} Aug 31 17:03:26.407782 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 17:03:26.407782 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:03:26.407782 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 17:03:26.407782 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 17:03:26.407782 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 17:03:26.407782 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 17:03:26.407782 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 17:03:26.407782 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 17:03:26.407782 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 17:03:26.407782 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 17:03:26.407782 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8e9aa29-8a3f-4571-8eb1-ec393a43b095 could not be found. Aug 31 17:03:26.407782 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 17:03:26.407782 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:03:26.407782 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 17:03:26.407782 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:03:26.407782 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:03:26.407782 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:03:26.407782 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 17:03:26.407782 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 17:03:26.407782 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 17:03:26.407782 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 17:03:26.407782 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 17:03:26.407782 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 17:03:26.407782 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 17:03:26.407782 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 17:03:26.407782 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 17:03:26.407782 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 17:03:26.407782 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8e9aa29-8a3f-4571-8eb1-ec393a43b095 could not be found. Aug 31 17:03:26.407782 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 17:03:26.407782 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:03:26.407782 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 17:03:26.417689 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:03:26.417689 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:03:26.417689 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:03:26.417689 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 17:03:26.417689 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 17:03:26.417689 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8e9aa29-8a3f-4571-8eb1-ec393a43b095 could not be found. Aug 31 17:03:26.417689 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 17:03:26.417689 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-dd70af88-a065-4915-be7d-da1afd931ece tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Returning 404 to user: Instance c8e9aa29-8a3f-4571-8eb1-ec393a43b095 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 17:03:26.417689 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-dd70af88-a065-4915-be7d-da1afd931ece tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095" status: 404 len: 111 microversion: 2.1 time: 0.032537 Aug 31 17:03:26.417689 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3732/7445] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:03:26 2022] GET /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 17:03:26.458339 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e537d48e-f3cb-48eb-aea5-8135d4f5317d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1126725012", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "networks": [{"uuid": "41af13fa-aeee-464a-8b24-48b02ed3bdc6"}], "security_groups": [{"name": "tempest-securitygroup--824623775"}], "key_name": "tempest-keypair-1911906825", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:03:26.570431 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-e537d48e-f3cb-48eb-aea5-8135d4f5317d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] validate_networks() for [('41af13fa-aeee-464a-8b24-48b02ed3bdc6', None, None, None, None, None)] {{(pid=122256) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 17:03:26.947030 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-e537d48e-f3cb-48eb-aea5-8135d4f5317d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 17:03:26.947487 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-e537d48e-f3cb-48eb-aea5-8135d4f5317d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 17:03:26.948006 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-e537d48e-f3cb-48eb-aea5-8135d4f5317d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 17:03:26.948431 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-e537d48e-f3cb-48eb-aea5-8135d4f5317d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 17:03:26.948856 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-e537d48e-f3cb-48eb-aea5-8135d4f5317d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 17:03:26.957709 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e537d48e-f3cb-48eb-aea5-8135d4f5317d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:03:26.958202 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e537d48e-f3cb-48eb-aea5-8135d4f5317d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:03:26.958648 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e537d48e-f3cb-48eb-aea5-8135d4f5317d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:03:26.959387 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e537d48e-f3cb-48eb-aea5-8135d4f5317d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:03:26.959884 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e537d48e-f3cb-48eb-aea5-8135d4f5317d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:03:26.960320 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e537d48e-f3cb-48eb-aea5-8135d4f5317d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:03:26.978858 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-e537d48e-f3cb-48eb-aea5-8135d4f5317d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Getting quotas for project f38fad62a33848c59db3d09c5c9788cc. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 17:03:26.984201 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-e537d48e-f3cb-48eb-aea5-8135d4f5317d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Getting quotas for user a3e98ea428604e7da092d46e865cfe1d and project f38fad62a33848c59db3d09c5c9788cc. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 17:03:26.997525 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e537d48e-f3cb-48eb-aea5-8135d4f5317d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Going to run 1 instances... {{(pid=122256) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 17:03:26.999876 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e537d48e-f3cb-48eb-aea5-8135d4f5317d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 280ffda9-548a-4569-8e9b-ee695fb05b8b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 17:03:27.049493 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e537d48e-f3cb-48eb-aea5-8135d4f5317d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.595111 Aug 31 17:03:27.050148 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3714/7446] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 17:03:26 2022] POST /compute/v2.1/servers => generated 405 bytes in 596 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 17:03:27.062371 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e396eda6-2d34-47e5-b597-8975a0db3350 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:03:27.063014 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e396eda6-2d34-47e5-b597-8975a0db3350 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 280ffda9-548a-4569-8e9b-ee695fb05b8b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:03:27.120660 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e396eda6-2d34-47e5-b597-8975a0db3350 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:03:27.128858 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e396eda6-2d34-47e5-b597-8975a0db3350 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b" status: 200 len: 1239 microversion: 2.1 time: 0.070388 Aug 31 17:03:27.129429 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3733/7447] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:03:27 2022] GET /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b => generated 1239 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:03:28.151861 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5e1ac2d2-963e-42c2-b060-511affc66227 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:03:28.152514 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5e1ac2d2-963e-42c2-b060-511affc66227 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 280ffda9-548a-4569-8e9b-ee695fb05b8b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:03:28.160149 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5e1ac2d2-963e-42c2-b060-511affc66227 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:03:28.160680 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5e1ac2d2-963e-42c2-b060-511affc66227 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:03:28.161134 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5e1ac2d2-963e-42c2-b060-511affc66227 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:03:28.161924 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5e1ac2d2-963e-42c2-b060-511affc66227 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:03:28.162417 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5e1ac2d2-963e-42c2-b060-511affc66227 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:03:28.162857 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5e1ac2d2-963e-42c2-b060-511affc66227 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:03:28.259797 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5e1ac2d2-963e-42c2-b060-511affc66227 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:03:28.269833 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5e1ac2d2-963e-42c2-b060-511affc66227 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b" status: 200 len: 1299 microversion: 2.1 time: 0.123393 Aug 31 17:03:28.270731 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3715/7448] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:03:28 2022] GET /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b => generated 1299 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:03:29.293832 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ce74c224-d8e1-45ac-9c87-b6e70daadc44 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:03:29.294730 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ce74c224-d8e1-45ac-9c87-b6e70daadc44 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 280ffda9-548a-4569-8e9b-ee695fb05b8b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:03:29.302376 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ce74c224-d8e1-45ac-9c87-b6e70daadc44 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:03:29.302887 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ce74c224-d8e1-45ac-9c87-b6e70daadc44 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:03:29.303345 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ce74c224-d8e1-45ac-9c87-b6e70daadc44 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:03:29.304102 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ce74c224-d8e1-45ac-9c87-b6e70daadc44 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:03:29.304610 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ce74c224-d8e1-45ac-9c87-b6e70daadc44 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:03:29.305060 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ce74c224-d8e1-45ac-9c87-b6e70daadc44 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:03:29.563291 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ce74c224-d8e1-45ac-9c87-b6e70daadc44 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:03:29.571631 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ce74c224-d8e1-45ac-9c87-b6e70daadc44 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b" status: 200 len: 1364 microversion: 2.1 time: 0.282548 Aug 31 17:03:29.572442 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3734/7449] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:03:29 2022] GET /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b => generated 1364 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 17:03:29.692700 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-173c5d7e-cdf6-4243-8d86-937dc7ab8630 req-693484f6-a70a-490a-84f3-377fb557314a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "280ffda9-548a-4569-8e9b-ee695fb05b8b", "tag": "d64f8643-c971-49d8-bdfd-62637dde241e"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:03:29.707860 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-173c5d7e-cdf6-4243-8d86-937dc7ab8630 req-693484f6-a70a-490a-84f3-377fb557314a service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:03:29.708452 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-173c5d7e-cdf6-4243-8d86-937dc7ab8630 req-693484f6-a70a-490a-84f3-377fb557314a service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:03:29.709338 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-173c5d7e-cdf6-4243-8d86-937dc7ab8630 req-693484f6-a70a-490a-84f3-377fb557314a service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:03:29.722395 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-173c5d7e-cdf6-4243-8d86-937dc7ab8630 req-693484f6-a70a-490a-84f3-377fb557314a service nova] Creating event network-changed:d64f8643-c971-49d8-bdfd-62637dde241e for instance 280ffda9-548a-4569-8e9b-ee695fb05b8b on n-h1-850499-9 Aug 31 17:03:29.728117 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-173c5d7e-cdf6-4243-8d86-937dc7ab8630 req-693484f6-a70a-490a-84f3-377fb557314a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038501 Aug 31 17:03:29.728759 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3716/7450] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:03:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:03:30.594405 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-af0c5aa4-a213-439d-81b9-bc57b7b0861e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:03:30.594992 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-af0c5aa4-a213-439d-81b9-bc57b7b0861e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 280ffda9-548a-4569-8e9b-ee695fb05b8b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:03:30.602986 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-af0c5aa4-a213-439d-81b9-bc57b7b0861e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:03:30.603654 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-af0c5aa4-a213-439d-81b9-bc57b7b0861e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:03:30.604153 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-af0c5aa4-a213-439d-81b9-bc57b7b0861e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:03:30.604947 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-af0c5aa4-a213-439d-81b9-bc57b7b0861e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:03:30.605447 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-af0c5aa4-a213-439d-81b9-bc57b7b0861e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:03:30.606052 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-af0c5aa4-a213-439d-81b9-bc57b7b0861e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:03:30.738276 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-af0c5aa4-a213-439d-81b9-bc57b7b0861e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:03:30.747294 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-af0c5aa4-a213-439d-81b9-bc57b7b0861e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b" status: 200 len: 1364 microversion: 2.1 time: 0.157403 Aug 31 17:03:30.747908 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3735/7451] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:03:30 2022] GET /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:03:31.770280 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a62aac5e-0511-4881-9448-0b395c486bea tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:03:31.770995 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a62aac5e-0511-4881-9448-0b395c486bea tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 280ffda9-548a-4569-8e9b-ee695fb05b8b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:03:31.777869 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a62aac5e-0511-4881-9448-0b395c486bea tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:03:31.778398 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a62aac5e-0511-4881-9448-0b395c486bea tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:03:31.778848 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a62aac5e-0511-4881-9448-0b395c486bea tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:03:31.779603 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a62aac5e-0511-4881-9448-0b395c486bea tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:03:31.780117 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a62aac5e-0511-4881-9448-0b395c486bea tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:03:31.780660 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a62aac5e-0511-4881-9448-0b395c486bea tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:03:31.922695 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a62aac5e-0511-4881-9448-0b395c486bea tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:03:31.930479 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a62aac5e-0511-4881-9448-0b395c486bea tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b" status: 200 len: 1364 microversion: 2.1 time: 0.165357 Aug 31 17:03:31.931163 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3717/7452] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:03:31 2022] GET /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:03:32.952594 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-308018d7-5496-4398-849b-295aeb31410f tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:03:32.953443 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-308018d7-5496-4398-849b-295aeb31410f tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 280ffda9-548a-4569-8e9b-ee695fb05b8b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:03:32.960416 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-308018d7-5496-4398-849b-295aeb31410f tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:03:32.961143 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-308018d7-5496-4398-849b-295aeb31410f tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:03:32.961742 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-308018d7-5496-4398-849b-295aeb31410f tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:03:32.962864 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-308018d7-5496-4398-849b-295aeb31410f tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:03:32.963529 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-308018d7-5496-4398-849b-295aeb31410f tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:03:32.963994 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-308018d7-5496-4398-849b-295aeb31410f tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:03:33.099526 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-308018d7-5496-4398-849b-295aeb31410f tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:03:33.108028 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-308018d7-5496-4398-849b-295aeb31410f tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b" status: 200 len: 1364 microversion: 2.1 time: 0.159490 Aug 31 17:03:33.108613 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3736/7453] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:03:32 2022] GET /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:03:34.131320 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a7f604fa-7a06-46dd-9602-0407c49d6597 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:03:34.131945 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a7f604fa-7a06-46dd-9602-0407c49d6597 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 280ffda9-548a-4569-8e9b-ee695fb05b8b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:03:34.139094 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a7f604fa-7a06-46dd-9602-0407c49d6597 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:03:34.139623 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a7f604fa-7a06-46dd-9602-0407c49d6597 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:03:34.140073 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a7f604fa-7a06-46dd-9602-0407c49d6597 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:03:34.140783 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a7f604fa-7a06-46dd-9602-0407c49d6597 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:03:34.141246 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a7f604fa-7a06-46dd-9602-0407c49d6597 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:03:34.141680 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a7f604fa-7a06-46dd-9602-0407c49d6597 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:03:34.279177 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a7f604fa-7a06-46dd-9602-0407c49d6597 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:03:34.287085 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a7f604fa-7a06-46dd-9602-0407c49d6597 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b" status: 200 len: 1364 microversion: 2.1 time: 0.160929 Aug 31 17:03:34.287689 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3718/7454] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:03:34 2022] GET /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:03:35.308540 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-99a02545-0d6f-4ad2-986d-9cc32871331e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:03:35.309779 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-99a02545-0d6f-4ad2-986d-9cc32871331e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 280ffda9-548a-4569-8e9b-ee695fb05b8b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:03:35.326418 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-99a02545-0d6f-4ad2-986d-9cc32871331e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:03:35.327039 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-99a02545-0d6f-4ad2-986d-9cc32871331e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:03:35.327591 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-99a02545-0d6f-4ad2-986d-9cc32871331e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:03:35.328263 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-99a02545-0d6f-4ad2-986d-9cc32871331e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:03:35.328736 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-99a02545-0d6f-4ad2-986d-9cc32871331e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:03:35.329176 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-99a02545-0d6f-4ad2-986d-9cc32871331e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:03:35.476839 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-99a02545-0d6f-4ad2-986d-9cc32871331e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:03:35.485433 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-99a02545-0d6f-4ad2-986d-9cc32871331e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b" status: 200 len: 1364 microversion: 2.1 time: 0.181368 Aug 31 17:03:35.486124 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3737/7455] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:03:35 2022] GET /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b => generated 1364 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:03:36.509552 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-bc13615e-9851-45dc-8a6a-f4e77d122ff7 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:03:36.510316 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-bc13615e-9851-45dc-8a6a-f4e77d122ff7 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 280ffda9-548a-4569-8e9b-ee695fb05b8b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:03:36.516791 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bc13615e-9851-45dc-8a6a-f4e77d122ff7 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:03:36.517295 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bc13615e-9851-45dc-8a6a-f4e77d122ff7 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:03:36.517743 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bc13615e-9851-45dc-8a6a-f4e77d122ff7 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:03:36.518479 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bc13615e-9851-45dc-8a6a-f4e77d122ff7 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:03:36.518948 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bc13615e-9851-45dc-8a6a-f4e77d122ff7 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:03:36.519391 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bc13615e-9851-45dc-8a6a-f4e77d122ff7 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:03:36.669866 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-bc13615e-9851-45dc-8a6a-f4e77d122ff7 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:03:36.682823 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-bc13615e-9851-45dc-8a6a-f4e77d122ff7 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b" status: 200 len: 1364 microversion: 2.1 time: 0.178790 Aug 31 17:03:36.690730 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3719/7456] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:03:36 2022] GET /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b => generated 1364 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:03:36.731747 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-d0a0fe25-7625-4e21-babc-8c1b86807f86 req-6ef5ac3b-626f-45c9-b111-4573ee106868 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "280ffda9-548a-4569-8e9b-ee695fb05b8b", "name": "network-vif-plugged", "status": "completed", "tag": "d64f8643-c971-49d8-bdfd-62637dde241e"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:03:36.745890 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-d0a0fe25-7625-4e21-babc-8c1b86807f86 req-6ef5ac3b-626f-45c9-b111-4573ee106868 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:03:36.745890 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-d0a0fe25-7625-4e21-babc-8c1b86807f86 req-6ef5ac3b-626f-45c9-b111-4573ee106868 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:03:36.745890 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-d0a0fe25-7625-4e21-babc-8c1b86807f86 req-6ef5ac3b-626f-45c9-b111-4573ee106868 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:03:36.758668 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-d0a0fe25-7625-4e21-babc-8c1b86807f86 req-6ef5ac3b-626f-45c9-b111-4573ee106868 service nova] Creating event network-vif-plugged:d64f8643-c971-49d8-bdfd-62637dde241e for instance 280ffda9-548a-4569-8e9b-ee695fb05b8b on n-h1-850499-9 Aug 31 17:03:36.764331 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-d0a0fe25-7625-4e21-babc-8c1b86807f86 req-6ef5ac3b-626f-45c9-b111-4573ee106868 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037565 Aug 31 17:03:36.765307 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3738/7457] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:03:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:03:37.705468 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-be0fa5be-5976-48e6-88a5-45585e68d5fd tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:03:37.706138 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-be0fa5be-5976-48e6-88a5-45585e68d5fd tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 280ffda9-548a-4569-8e9b-ee695fb05b8b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:03:37.708734 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:03:37.709494 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=6 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:03:37.717278 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-be0fa5be-5976-48e6-88a5-45585e68d5fd tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:03:37.717794 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-be0fa5be-5976-48e6-88a5-45585e68d5fd tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:03:37.718218 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-be0fa5be-5976-48e6-88a5-45585e68d5fd tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:03:37.718974 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-be0fa5be-5976-48e6-88a5-45585e68d5fd tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:03:37.719427 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-be0fa5be-5976-48e6-88a5-45585e68d5fd tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:03:37.719887 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-be0fa5be-5976-48e6-88a5-45585e68d5fd tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:03:37.857067 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-be0fa5be-5976-48e6-88a5-45585e68d5fd tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:03:37.864717 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-be0fa5be-5976-48e6-88a5-45585e68d5fd tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b" status: 200 len: 1364 microversion: 2.1 time: 0.163490 Aug 31 17:03:37.865292 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3720/7458] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:03:37 2022] GET /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:03:38.884555 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:03:38.889675 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8f515d83-e0b3-4b2f-8e21-dd86bc04ca3b tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:03:38.890391 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8f515d83-e0b3-4b2f-8e21-dd86bc04ca3b tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 280ffda9-548a-4569-8e9b-ee695fb05b8b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:03:38.896923 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8f515d83-e0b3-4b2f-8e21-dd86bc04ca3b tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:03:38.897424 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8f515d83-e0b3-4b2f-8e21-dd86bc04ca3b tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:03:38.897875 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8f515d83-e0b3-4b2f-8e21-dd86bc04ca3b tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:03:38.898580 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8f515d83-e0b3-4b2f-8e21-dd86bc04ca3b tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:03:38.899778 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8f515d83-e0b3-4b2f-8e21-dd86bc04ca3b tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:03:38.900227 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8f515d83-e0b3-4b2f-8e21-dd86bc04ca3b tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:03:39.034640 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8f515d83-e0b3-4b2f-8e21-dd86bc04ca3b tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:03:39.043466 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8f515d83-e0b3-4b2f-8e21-dd86bc04ca3b tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b" status: 200 len: 1551 microversion: 2.1 time: 0.160468 Aug 31 17:03:39.044074 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3739/7459] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:03:38 2022] GET /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b => generated 1551 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:03:39.064879 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b90f3d3d-92f8-4d6b-8400-f7979d994876 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:03:39.065398 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b90f3d3d-92f8-4d6b-8400-f7979d994876 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 280ffda9-548a-4569-8e9b-ee695fb05b8b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:03:39.072398 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b90f3d3d-92f8-4d6b-8400-f7979d994876 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:03:39.072898 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b90f3d3d-92f8-4d6b-8400-f7979d994876 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:03:39.073347 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b90f3d3d-92f8-4d6b-8400-f7979d994876 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:03:39.074058 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b90f3d3d-92f8-4d6b-8400-f7979d994876 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:03:39.074526 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b90f3d3d-92f8-4d6b-8400-f7979d994876 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:03:39.074962 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b90f3d3d-92f8-4d6b-8400-f7979d994876 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:03:39.156771 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b90f3d3d-92f8-4d6b-8400-f7979d994876 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095873 Aug 31 17:03:39.157374 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3721/7460] 10.222.0.61 () {58 vars in 1275 bytes} [Wed Aug 31 17:03:39 2022] GET /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:03:40.108524 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-c0a56493-ca9a-45f7-98d2-33ec874822cd req-a1798fb3-48ee-41af-a628-e8b9600fb09d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "280ffda9-548a-4569-8e9b-ee695fb05b8b", "tag": "d64f8643-c971-49d8-bdfd-62637dde241e"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:03:40.119409 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-c0a56493-ca9a-45f7-98d2-33ec874822cd req-a1798fb3-48ee-41af-a628-e8b9600fb09d service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:03:40.120016 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-c0a56493-ca9a-45f7-98d2-33ec874822cd req-a1798fb3-48ee-41af-a628-e8b9600fb09d service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:03:40.120530 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-c0a56493-ca9a-45f7-98d2-33ec874822cd req-a1798fb3-48ee-41af-a628-e8b9600fb09d service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:03:40.132260 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-c0a56493-ca9a-45f7-98d2-33ec874822cd req-a1798fb3-48ee-41af-a628-e8b9600fb09d service nova] Creating event network-changed:d64f8643-c971-49d8-bdfd-62637dde241e for instance 280ffda9-548a-4569-8e9b-ee695fb05b8b on n-h1-850499-9 Aug 31 17:03:40.138193 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-c0a56493-ca9a-45f7-98d2-33ec874822cd req-a1798fb3-48ee-41af-a628-e8b9600fb09d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033490 Aug 31 17:03:40.139059 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3740/7461] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:03:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:04:52.102547 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:04:52.103525 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=64 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:04:52.105013 n-d-850499-9 devstack@n-api.service[122256]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 17:04:52.105266 n-d-850499-9 devstack@n-api.service[122256]: Wed Aug 31 17:04:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b/action (ip 10.222.0.61) !!! Aug 31 17:04:52.216836 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ad77ef72-b551-4a22-8160-3a8a64ff3c92 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:04:52.219282 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ad77ef72-b551-4a22-8160-3a8a64ff3c92 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 280ffda9-548a-4569-8e9b-ee695fb05b8b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:04:52.226944 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ad77ef72-b551-4a22-8160-3a8a64ff3c92 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:04:52.227434 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ad77ef72-b551-4a22-8160-3a8a64ff3c92 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:04:52.227897 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ad77ef72-b551-4a22-8160-3a8a64ff3c92 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:04:52.228589 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ad77ef72-b551-4a22-8160-3a8a64ff3c92 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:04:52.229048 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ad77ef72-b551-4a22-8160-3a8a64ff3c92 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:04:52.229474 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ad77ef72-b551-4a22-8160-3a8a64ff3c92 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:04:52.257560 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ad77ef72-b551-4a22-8160-3a8a64ff3c92 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:04:52.263388 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ad77ef72-b551-4a22-8160-3a8a64ff3c92 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 280ffda9-548a-4569-8e9b-ee695fb05b8b] Old instance type m1.heat2, new instance type m1.heat {{(pid=122256) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 31 17:04:52.270785 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-ad77ef72-b551-4a22-8160-3a8a64ff3c92 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 17:04:52.271204 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-ad77ef72-b551-4a22-8160-3a8a64ff3c92 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 17:04:52.271715 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-ad77ef72-b551-4a22-8160-3a8a64ff3c92 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 17:04:52.272128 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-ad77ef72-b551-4a22-8160-3a8a64ff3c92 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 17:04:52.272541 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-ad77ef72-b551-4a22-8160-3a8a64ff3c92 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 17:04:52.336445 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ad77ef72-b551-4a22-8160-3a8a64ff3c92 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "POST /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b/action" status: 202 len: 0 microversion: 2.1 time: 0.236703 Aug 31 17:04:52.337410 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3722/7462] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 17:04:52 2022] POST /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b/action => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 17:04:52.345980 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:04:52.347004 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:04:52.355566 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-70176d7f-39a1-47a1-b080-548f9f2709ea tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:04:52.356248 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-70176d7f-39a1-47a1-b080-548f9f2709ea tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 280ffda9-548a-4569-8e9b-ee695fb05b8b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:04:52.364868 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-70176d7f-39a1-47a1-b080-548f9f2709ea tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:04:52.365372 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-70176d7f-39a1-47a1-b080-548f9f2709ea tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:04:52.365830 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-70176d7f-39a1-47a1-b080-548f9f2709ea tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:04:52.366607 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-70176d7f-39a1-47a1-b080-548f9f2709ea tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:04:52.367093 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-70176d7f-39a1-47a1-b080-548f9f2709ea tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:04:52.367595 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-70176d7f-39a1-47a1-b080-548f9f2709ea tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:04:52.586890 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-70176d7f-39a1-47a1-b080-548f9f2709ea tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:04:52.595184 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-70176d7f-39a1-47a1-b080-548f9f2709ea tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b" status: 200 len: 1678 microversion: 2.1 time: 0.253147 Aug 31 17:04:52.595908 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3741/7463] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:04:52 2022] GET /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b => generated 1678 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:04:53.619194 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-78e26b4b-01d9-4cad-a1a7-3b00ace1e127 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:04:53.619813 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-78e26b4b-01d9-4cad-a1a7-3b00ace1e127 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 280ffda9-548a-4569-8e9b-ee695fb05b8b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:04:53.626280 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-78e26b4b-01d9-4cad-a1a7-3b00ace1e127 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:04:53.627033 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-78e26b4b-01d9-4cad-a1a7-3b00ace1e127 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:04:53.627585 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-78e26b4b-01d9-4cad-a1a7-3b00ace1e127 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:04:53.628324 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-78e26b4b-01d9-4cad-a1a7-3b00ace1e127 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:04:53.628787 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-78e26b4b-01d9-4cad-a1a7-3b00ace1e127 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:04:53.629218 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-78e26b4b-01d9-4cad-a1a7-3b00ace1e127 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:04:53.908418 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-78e26b4b-01d9-4cad-a1a7-3b00ace1e127 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:04:53.916225 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-78e26b4b-01d9-4cad-a1a7-3b00ace1e127 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b" status: 200 len: 1678 microversion: 2.1 time: 0.303593 Aug 31 17:04:53.916826 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3723/7464] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:04:53 2022] GET /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b => generated 1678 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:04:54.939745 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b069c3e4-2942-4494-b157-67fbbf99cb35 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:04:54.940376 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b069c3e4-2942-4494-b157-67fbbf99cb35 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 280ffda9-548a-4569-8e9b-ee695fb05b8b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:04:54.948168 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b069c3e4-2942-4494-b157-67fbbf99cb35 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:04:54.948699 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b069c3e4-2942-4494-b157-67fbbf99cb35 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:04:54.949164 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b069c3e4-2942-4494-b157-67fbbf99cb35 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:04:54.949971 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b069c3e4-2942-4494-b157-67fbbf99cb35 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:04:54.950457 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b069c3e4-2942-4494-b157-67fbbf99cb35 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:04:54.950916 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b069c3e4-2942-4494-b157-67fbbf99cb35 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:04:55.085139 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b069c3e4-2942-4494-b157-67fbbf99cb35 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:04:55.093157 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b069c3e4-2942-4494-b157-67fbbf99cb35 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b" status: 200 len: 1683 microversion: 2.1 time: 0.158007 Aug 31 17:04:55.093739 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3742/7465] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:04:54 2022] GET /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:04:56.115433 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0aa8d5ef-2e1f-4a49-95d4-99561d40ef44 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:04:56.115997 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0aa8d5ef-2e1f-4a49-95d4-99561d40ef44 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 280ffda9-548a-4569-8e9b-ee695fb05b8b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:04:56.122850 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0aa8d5ef-2e1f-4a49-95d4-99561d40ef44 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:04:56.123345 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0aa8d5ef-2e1f-4a49-95d4-99561d40ef44 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:04:56.123819 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0aa8d5ef-2e1f-4a49-95d4-99561d40ef44 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:04:56.124520 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0aa8d5ef-2e1f-4a49-95d4-99561d40ef44 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:04:56.124991 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0aa8d5ef-2e1f-4a49-95d4-99561d40ef44 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:04:56.125426 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0aa8d5ef-2e1f-4a49-95d4-99561d40ef44 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:04:56.264861 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-0aa8d5ef-2e1f-4a49-95d4-99561d40ef44 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:04:56.273339 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0aa8d5ef-2e1f-4a49-95d4-99561d40ef44 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b" status: 200 len: 1683 microversion: 2.1 time: 0.161903 Aug 31 17:04:56.273924 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3724/7466] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:04:56 2022] GET /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:04:57.294558 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e3ae315c-75a8-4ab9-9c5b-23042b438a38 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:04:57.295193 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e3ae315c-75a8-4ab9-9c5b-23042b438a38 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 280ffda9-548a-4569-8e9b-ee695fb05b8b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:04:57.302655 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e3ae315c-75a8-4ab9-9c5b-23042b438a38 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:04:57.303160 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e3ae315c-75a8-4ab9-9c5b-23042b438a38 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:04:57.303648 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e3ae315c-75a8-4ab9-9c5b-23042b438a38 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:04:57.304365 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e3ae315c-75a8-4ab9-9c5b-23042b438a38 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:04:57.304840 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e3ae315c-75a8-4ab9-9c5b-23042b438a38 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:04:57.305282 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e3ae315c-75a8-4ab9-9c5b-23042b438a38 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:04:57.438859 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e3ae315c-75a8-4ab9-9c5b-23042b438a38 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:04:57.447400 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e3ae315c-75a8-4ab9-9c5b-23042b438a38 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b" status: 200 len: 1683 microversion: 2.1 time: 0.156339 Aug 31 17:04:57.448218 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3743/7467] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:04:57 2022] GET /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:04:58.468216 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2f085410-936d-4284-8b71-9b8ce37f8464 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:04:58.468936 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2f085410-936d-4284-8b71-9b8ce37f8464 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 280ffda9-548a-4569-8e9b-ee695fb05b8b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:04:58.476149 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2f085410-936d-4284-8b71-9b8ce37f8464 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:04:58.476741 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2f085410-936d-4284-8b71-9b8ce37f8464 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:04:58.477182 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2f085410-936d-4284-8b71-9b8ce37f8464 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:04:58.477982 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2f085410-936d-4284-8b71-9b8ce37f8464 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:04:58.478362 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2f085410-936d-4284-8b71-9b8ce37f8464 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:04:58.478802 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2f085410-936d-4284-8b71-9b8ce37f8464 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:04:58.622338 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-2f085410-936d-4284-8b71-9b8ce37f8464 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:04:58.631973 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2f085410-936d-4284-8b71-9b8ce37f8464 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b" status: 200 len: 1683 microversion: 2.1 time: 0.167611 Aug 31 17:04:58.632561 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3725/7468] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:04:58 2022] GET /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b => generated 1683 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:04:59.654448 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-54d67c5a-122c-4f69-a3d0-c3447e1ea21f tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:04:59.655080 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-54d67c5a-122c-4f69-a3d0-c3447e1ea21f tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 280ffda9-548a-4569-8e9b-ee695fb05b8b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:04:59.662820 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-54d67c5a-122c-4f69-a3d0-c3447e1ea21f tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:04:59.663356 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-54d67c5a-122c-4f69-a3d0-c3447e1ea21f tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:04:59.663854 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-54d67c5a-122c-4f69-a3d0-c3447e1ea21f tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:04:59.664592 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-54d67c5a-122c-4f69-a3d0-c3447e1ea21f tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:04:59.665071 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-54d67c5a-122c-4f69-a3d0-c3447e1ea21f tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:04:59.665520 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-54d67c5a-122c-4f69-a3d0-c3447e1ea21f tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:04:59.805893 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-54d67c5a-122c-4f69-a3d0-c3447e1ea21f tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:04:59.814376 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-54d67c5a-122c-4f69-a3d0-c3447e1ea21f tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b" status: 200 len: 1683 microversion: 2.1 time: 0.163893 Aug 31 17:04:59.815301 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3744/7469] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:04:59 2022] GET /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b => generated 1683 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:05:00.836598 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3991b482-2ee8-42d2-b482-dcd038733a68 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:05:00.837237 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3991b482-2ee8-42d2-b482-dcd038733a68 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 280ffda9-548a-4569-8e9b-ee695fb05b8b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:05:00.844476 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3991b482-2ee8-42d2-b482-dcd038733a68 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:00.844979 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3991b482-2ee8-42d2-b482-dcd038733a68 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:00.845426 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3991b482-2ee8-42d2-b482-dcd038733a68 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:00.846137 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3991b482-2ee8-42d2-b482-dcd038733a68 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:00.846603 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3991b482-2ee8-42d2-b482-dcd038733a68 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:00.847040 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3991b482-2ee8-42d2-b482-dcd038733a68 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:00.984194 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3991b482-2ee8-42d2-b482-dcd038733a68 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:05:00.992790 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3991b482-2ee8-42d2-b482-dcd038733a68 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b" status: 200 len: 1683 microversion: 2.1 time: 0.160425 Aug 31 17:05:00.993389 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3726/7470] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:05:00 2022] GET /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b => generated 1683 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 17:05:02.016293 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f8f8fe97-aaee-499c-942f-e8bda702b23e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:05:02.016949 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f8f8fe97-aaee-499c-942f-e8bda702b23e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 280ffda9-548a-4569-8e9b-ee695fb05b8b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:05:02.023867 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f8f8fe97-aaee-499c-942f-e8bda702b23e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:02.024378 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f8f8fe97-aaee-499c-942f-e8bda702b23e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:02.024834 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f8f8fe97-aaee-499c-942f-e8bda702b23e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:02.025553 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f8f8fe97-aaee-499c-942f-e8bda702b23e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:02.026034 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f8f8fe97-aaee-499c-942f-e8bda702b23e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:02.026484 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f8f8fe97-aaee-499c-942f-e8bda702b23e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:02.164977 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f8f8fe97-aaee-499c-942f-e8bda702b23e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:05:02.173436 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f8f8fe97-aaee-499c-942f-e8bda702b23e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b" status: 200 len: 1683 microversion: 2.1 time: 0.160596 Aug 31 17:05:02.174003 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3745/7471] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:05:02 2022] GET /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b => generated 1683 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:05:03.195331 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7a680452-d9c0-4716-a575-c49b2c2c3aab tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:05:03.195985 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7a680452-d9c0-4716-a575-c49b2c2c3aab tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 280ffda9-548a-4569-8e9b-ee695fb05b8b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:05:03.203274 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7a680452-d9c0-4716-a575-c49b2c2c3aab tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:03.204115 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7a680452-d9c0-4716-a575-c49b2c2c3aab tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:03.204607 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7a680452-d9c0-4716-a575-c49b2c2c3aab tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:03.205318 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7a680452-d9c0-4716-a575-c49b2c2c3aab tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:03.205789 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7a680452-d9c0-4716-a575-c49b2c2c3aab tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:03.206229 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7a680452-d9c0-4716-a575-c49b2c2c3aab tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:03.350884 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7a680452-d9c0-4716-a575-c49b2c2c3aab tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:05:03.358854 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7a680452-d9c0-4716-a575-c49b2c2c3aab tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b" status: 200 len: 1683 microversion: 2.1 time: 0.167514 Aug 31 17:05:03.359445 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3727/7472] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:05:03 2022] GET /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b => generated 1683 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:05:04.383103 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0b8bde69-be65-456f-8107-5751e7bbfeca tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:05:04.383785 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0b8bde69-be65-456f-8107-5751e7bbfeca tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 280ffda9-548a-4569-8e9b-ee695fb05b8b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:05:04.390922 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0b8bde69-be65-456f-8107-5751e7bbfeca tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:04.391995 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0b8bde69-be65-456f-8107-5751e7bbfeca tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:04.392468 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0b8bde69-be65-456f-8107-5751e7bbfeca tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:04.393220 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0b8bde69-be65-456f-8107-5751e7bbfeca tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:04.393673 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0b8bde69-be65-456f-8107-5751e7bbfeca tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:04.394112 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0b8bde69-be65-456f-8107-5751e7bbfeca tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:04.543320 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0b8bde69-be65-456f-8107-5751e7bbfeca tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:05:04.551194 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0b8bde69-be65-456f-8107-5751e7bbfeca tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b" status: 200 len: 1683 microversion: 2.1 time: 0.172013 Aug 31 17:05:04.551809 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3746/7473] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:05:04 2022] GET /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b => generated 1683 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:05:05.572805 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6ebe457c-4c40-44da-9290-73f09365c0bf tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:05:05.573422 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6ebe457c-4c40-44da-9290-73f09365c0bf tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 280ffda9-548a-4569-8e9b-ee695fb05b8b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:05:05.582624 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6ebe457c-4c40-44da-9290-73f09365c0bf tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:05.583378 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6ebe457c-4c40-44da-9290-73f09365c0bf tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:05.584083 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6ebe457c-4c40-44da-9290-73f09365c0bf tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:05.584912 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6ebe457c-4c40-44da-9290-73f09365c0bf tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:05.585404 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6ebe457c-4c40-44da-9290-73f09365c0bf tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:05.585849 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6ebe457c-4c40-44da-9290-73f09365c0bf tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:05.716733 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-6ebe457c-4c40-44da-9290-73f09365c0bf tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:05:05.725774 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6ebe457c-4c40-44da-9290-73f09365c0bf tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b" status: 200 len: 1683 microversion: 2.1 time: 0.156920 Aug 31 17:05:05.726354 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3728/7474] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:05:05 2022] GET /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:05:06.747714 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-fff73f7d-5f37-4459-beca-78e5e685a0a5 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:05:06.748351 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-fff73f7d-5f37-4459-beca-78e5e685a0a5 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 280ffda9-548a-4569-8e9b-ee695fb05b8b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:05:06.755651 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fff73f7d-5f37-4459-beca-78e5e685a0a5 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:06.756161 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fff73f7d-5f37-4459-beca-78e5e685a0a5 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:06.756624 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fff73f7d-5f37-4459-beca-78e5e685a0a5 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:06.757354 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fff73f7d-5f37-4459-beca-78e5e685a0a5 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:06.757828 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fff73f7d-5f37-4459-beca-78e5e685a0a5 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:06.758277 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fff73f7d-5f37-4459-beca-78e5e685a0a5 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:06.933452 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-1d7e17aa-21ec-4c5a-bc43-04a37351207c req-0b24aaf2-4d38-4fe0-b2c4-5df54537c48d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "280ffda9-548a-4569-8e9b-ee695fb05b8b", "name": "network-vif-unplugged", "status": "completed", "tag": "d64f8643-c971-49d8-bdfd-62637dde241e"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:05:06.947258 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-1d7e17aa-21ec-4c5a-bc43-04a37351207c req-0b24aaf2-4d38-4fe0-b2c4-5df54537c48d service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:06.947789 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-1d7e17aa-21ec-4c5a-bc43-04a37351207c req-0b24aaf2-4d38-4fe0-b2c4-5df54537c48d service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:06.948236 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-1d7e17aa-21ec-4c5a-bc43-04a37351207c req-0b24aaf2-4d38-4fe0-b2c4-5df54537c48d service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:06.961458 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-1d7e17aa-21ec-4c5a-bc43-04a37351207c req-0b24aaf2-4d38-4fe0-b2c4-5df54537c48d service nova] Creating event network-vif-unplugged:d64f8643-c971-49d8-bdfd-62637dde241e for instance 280ffda9-548a-4569-8e9b-ee695fb05b8b on n-h2-850499-9 Aug 31 17:05:06.965576 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-fff73f7d-5f37-4459-beca-78e5e685a0a5 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:05:06.967836 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [req-1d7e17aa-21ec-4c5a-bc43-04a37351207c req-0b24aaf2-4d38-4fe0-b2c4-5df54537c48d service nova] Instance 280ffda9-548a-4569-8e9b-ee695fb05b8b is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850499-9', 'n-h1-850499-9'} {{(pid=122256) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 31 17:05:06.973701 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-fff73f7d-5f37-4459-beca-78e5e685a0a5 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b" status: 200 len: 1682 microversion: 2.1 time: 0.229963 Aug 31 17:05:06.974315 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3747/7475] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:05:06 2022] GET /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b => generated 1682 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:05:06.990080 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-1d7e17aa-21ec-4c5a-bc43-04a37351207c req-0b24aaf2-4d38-4fe0-b2c4-5df54537c48d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060473 Aug 31 17:05:06.990853 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3729/7476] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:05:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 17:05:07.997357 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e8a3ba45-b261-47df-9959-2be521ec0792 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:05:07.997999 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e8a3ba45-b261-47df-9959-2be521ec0792 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 280ffda9-548a-4569-8e9b-ee695fb05b8b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:05:08.006124 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e8a3ba45-b261-47df-9959-2be521ec0792 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:08.006637 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e8a3ba45-b261-47df-9959-2be521ec0792 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:08.007124 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e8a3ba45-b261-47df-9959-2be521ec0792 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:08.007885 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e8a3ba45-b261-47df-9959-2be521ec0792 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:08.008367 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e8a3ba45-b261-47df-9959-2be521ec0792 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:08.008819 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e8a3ba45-b261-47df-9959-2be521ec0792 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:08.139621 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e8a3ba45-b261-47df-9959-2be521ec0792 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:05:08.148063 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e8a3ba45-b261-47df-9959-2be521ec0792 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b" status: 200 len: 1680 microversion: 2.1 time: 0.155128 Aug 31 17:05:08.148633 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3748/7477] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:05:07 2022] GET /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:05:09.034760 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-61ff09e0-0584-4adf-8cf3-e54e9189197d req-afc2b92f-d6b2-4255-953d-eefa7682702e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "280ffda9-548a-4569-8e9b-ee695fb05b8b", "tag": "d64f8643-c971-49d8-bdfd-62637dde241e"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:05:09.044457 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-61ff09e0-0584-4adf-8cf3-e54e9189197d req-afc2b92f-d6b2-4255-953d-eefa7682702e service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:09.044941 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-61ff09e0-0584-4adf-8cf3-e54e9189197d req-afc2b92f-d6b2-4255-953d-eefa7682702e service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:09.045406 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-61ff09e0-0584-4adf-8cf3-e54e9189197d req-afc2b92f-d6b2-4255-953d-eefa7682702e service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:09.060043 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-61ff09e0-0584-4adf-8cf3-e54e9189197d req-afc2b92f-d6b2-4255-953d-eefa7682702e service nova] Creating event network-changed:d64f8643-c971-49d8-bdfd-62637dde241e for instance 280ffda9-548a-4569-8e9b-ee695fb05b8b on n-h2-850499-9 Aug 31 17:05:09.065877 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [req-61ff09e0-0584-4adf-8cf3-e54e9189197d req-afc2b92f-d6b2-4255-953d-eefa7682702e service nova] Instance 280ffda9-548a-4569-8e9b-ee695fb05b8b is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850499-9', 'n-h1-850499-9'} {{(pid=122256) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 31 17:05:09.076868 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-61ff09e0-0584-4adf-8cf3-e54e9189197d req-afc2b92f-d6b2-4255-953d-eefa7682702e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047334 Aug 31 17:05:09.077477 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3730/7478] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:05:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:05:09.170278 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7245e689-3307-4e18-a30a-e144c27125b7 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:05:09.170923 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7245e689-3307-4e18-a30a-e144c27125b7 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 280ffda9-548a-4569-8e9b-ee695fb05b8b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:05:09.177944 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7245e689-3307-4e18-a30a-e144c27125b7 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:09.178455 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7245e689-3307-4e18-a30a-e144c27125b7 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:09.178917 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7245e689-3307-4e18-a30a-e144c27125b7 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:09.179673 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7245e689-3307-4e18-a30a-e144c27125b7 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:09.180155 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7245e689-3307-4e18-a30a-e144c27125b7 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:09.180615 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7245e689-3307-4e18-a30a-e144c27125b7 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:09.392747 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7245e689-3307-4e18-a30a-e144c27125b7 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:05:09.401583 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7245e689-3307-4e18-a30a-e144c27125b7 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b" status: 200 len: 1680 microversion: 2.1 time: 0.235558 Aug 31 17:05:09.402476 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3749/7479] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:05:09 2022] GET /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b => generated 1680 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:05:10.424730 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e798d1eb-f85a-4cfe-adc7-9307796b616e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:05:10.425467 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e798d1eb-f85a-4cfe-adc7-9307796b616e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 280ffda9-548a-4569-8e9b-ee695fb05b8b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:05:10.431613 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e798d1eb-f85a-4cfe-adc7-9307796b616e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:10.432116 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e798d1eb-f85a-4cfe-adc7-9307796b616e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:10.432561 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e798d1eb-f85a-4cfe-adc7-9307796b616e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:10.433275 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e798d1eb-f85a-4cfe-adc7-9307796b616e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:10.433751 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e798d1eb-f85a-4cfe-adc7-9307796b616e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:10.434179 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e798d1eb-f85a-4cfe-adc7-9307796b616e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:10.570004 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e798d1eb-f85a-4cfe-adc7-9307796b616e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:05:10.577829 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e798d1eb-f85a-4cfe-adc7-9307796b616e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b" status: 200 len: 1680 microversion: 2.1 time: 0.158415 Aug 31 17:05:10.579052 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3731/7480] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:05:10 2022] GET /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:05:11.600604 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-46d9ee30-a0bd-4593-8590-6160a87fbed1 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:05:11.601143 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-46d9ee30-a0bd-4593-8590-6160a87fbed1 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 280ffda9-548a-4569-8e9b-ee695fb05b8b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:05:11.608140 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-46d9ee30-a0bd-4593-8590-6160a87fbed1 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:11.608658 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-46d9ee30-a0bd-4593-8590-6160a87fbed1 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:11.609120 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-46d9ee30-a0bd-4593-8590-6160a87fbed1 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:11.610002 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-46d9ee30-a0bd-4593-8590-6160a87fbed1 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:11.610484 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-46d9ee30-a0bd-4593-8590-6160a87fbed1 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:11.610947 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-46d9ee30-a0bd-4593-8590-6160a87fbed1 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:11.754812 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-46d9ee30-a0bd-4593-8590-6160a87fbed1 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:05:11.762870 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-46d9ee30-a0bd-4593-8590-6160a87fbed1 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b" status: 200 len: 1677 microversion: 2.1 time: 0.166473 Aug 31 17:05:11.763480 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3750/7481] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:05:11 2022] GET /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b => generated 1677 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:05:11.784271 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-85b0076c-370d-4115-855e-8e7c37a1d660 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:05:11.784821 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-85b0076c-370d-4115-855e-8e7c37a1d660 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 280ffda9-548a-4569-8e9b-ee695fb05b8b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:05:11.791795 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-85b0076c-370d-4115-855e-8e7c37a1d660 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:11.792294 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-85b0076c-370d-4115-855e-8e7c37a1d660 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:11.792742 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-85b0076c-370d-4115-855e-8e7c37a1d660 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:11.793442 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-85b0076c-370d-4115-855e-8e7c37a1d660 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:11.793907 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-85b0076c-370d-4115-855e-8e7c37a1d660 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:11.794388 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-85b0076c-370d-4115-855e-8e7c37a1d660 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:11.833906 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-85b0076c-370d-4115-855e-8e7c37a1d660 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:11.834401 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-85b0076c-370d-4115-855e-8e7c37a1d660 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:11.834840 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-85b0076c-370d-4115-855e-8e7c37a1d660 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:11.835607 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-85b0076c-370d-4115-855e-8e7c37a1d660 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:11.836070 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-85b0076c-370d-4115-855e-8e7c37a1d660 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:11.836504 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-85b0076c-370d-4115-855e-8e7c37a1d660 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:11.856948 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-85b0076c-370d-4115-855e-8e7c37a1d660 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Getting quotas for project f38fad62a33848c59db3d09c5c9788cc. Resources: {'ram', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 17:05:11.862076 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-85b0076c-370d-4115-855e-8e7c37a1d660 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Getting quotas for user a3e98ea428604e7da092d46e865cfe1d and project f38fad62a33848c59db3d09c5c9788cc. Resources: {'ram', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 17:05:11.968366 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-85b0076c-370d-4115-855e-8e7c37a1d660 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "POST /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b/action" status: 202 len: 0 microversion: 2.1 time: 0.187971 Aug 31 17:05:11.972921 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3732/7482] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 17:05:11 2022] POST /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b/action => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 17:05:11.978404 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ae42f243-6083-4aa8-8e11-f908f7319ee6 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:05:11.979053 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ae42f243-6083-4aa8-8e11-f908f7319ee6 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 280ffda9-548a-4569-8e9b-ee695fb05b8b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:05:11.988980 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ae42f243-6083-4aa8-8e11-f908f7319ee6 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:11.990725 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ae42f243-6083-4aa8-8e11-f908f7319ee6 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:11.990725 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ae42f243-6083-4aa8-8e11-f908f7319ee6 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:11.991122 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ae42f243-6083-4aa8-8e11-f908f7319ee6 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:11.991790 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ae42f243-6083-4aa8-8e11-f908f7319ee6 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:11.992863 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ae42f243-6083-4aa8-8e11-f908f7319ee6 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:12.195939 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ae42f243-6083-4aa8-8e11-f908f7319ee6 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:05:12.203850 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ae42f243-6083-4aa8-8e11-f908f7319ee6 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b" status: 200 len: 1676 microversion: 2.1 time: 0.229478 Aug 31 17:05:12.204443 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3751/7483] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:05:11 2022] GET /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b => generated 1676 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:05:12.976336 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-05e68d72-e270-4182-a210-88ffde74e4ad req-de56a509-caab-46ac-81f7-b3f379bc61dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "280ffda9-548a-4569-8e9b-ee695fb05b8b", "name": "network-vif-plugged", "status": "completed", "tag": "d64f8643-c971-49d8-bdfd-62637dde241e"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:05:12.988900 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-05e68d72-e270-4182-a210-88ffde74e4ad req-de56a509-caab-46ac-81f7-b3f379bc61dd service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:12.989456 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-05e68d72-e270-4182-a210-88ffde74e4ad req-de56a509-caab-46ac-81f7-b3f379bc61dd service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:12.989904 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-05e68d72-e270-4182-a210-88ffde74e4ad req-de56a509-caab-46ac-81f7-b3f379bc61dd service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:13.000997 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-05e68d72-e270-4182-a210-88ffde74e4ad req-de56a509-caab-46ac-81f7-b3f379bc61dd service nova] Creating event network-vif-plugged:d64f8643-c971-49d8-bdfd-62637dde241e for instance 280ffda9-548a-4569-8e9b-ee695fb05b8b on n-h2-850499-9 Aug 31 17:05:13.006620 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [req-05e68d72-e270-4182-a210-88ffde74e4ad req-de56a509-caab-46ac-81f7-b3f379bc61dd service nova] Instance 280ffda9-548a-4569-8e9b-ee695fb05b8b is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850499-9', 'n-h1-850499-9'} {{(pid=122256) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 31 17:05:13.018307 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-05e68d72-e270-4182-a210-88ffde74e4ad req-de56a509-caab-46ac-81f7-b3f379bc61dd service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100834 Aug 31 17:05:13.018935 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3733/7484] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:05:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:05:13.225770 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ce68de43-8943-429a-b8cd-14ba299e1e1f tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:05:13.226323 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ce68de43-8943-429a-b8cd-14ba299e1e1f tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 280ffda9-548a-4569-8e9b-ee695fb05b8b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:05:13.233246 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ce68de43-8943-429a-b8cd-14ba299e1e1f tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:13.233757 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ce68de43-8943-429a-b8cd-14ba299e1e1f tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:13.234224 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ce68de43-8943-429a-b8cd-14ba299e1e1f tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:13.235543 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ce68de43-8943-429a-b8cd-14ba299e1e1f tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:13.236045 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ce68de43-8943-429a-b8cd-14ba299e1e1f tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:13.236503 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ce68de43-8943-429a-b8cd-14ba299e1e1f tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:13.373085 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ce68de43-8943-429a-b8cd-14ba299e1e1f tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:05:13.382159 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ce68de43-8943-429a-b8cd-14ba299e1e1f tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b" status: 200 len: 1676 microversion: 2.1 time: 0.160424 Aug 31 17:05:13.382750 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3752/7485] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:05:13 2022] GET /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b => generated 1676 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:05:14.405310 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-beb8f4b7-3107-4c59-8c1a-cbaff95ac8ec tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:05:14.406040 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-beb8f4b7-3107-4c59-8c1a-cbaff95ac8ec tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 280ffda9-548a-4569-8e9b-ee695fb05b8b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:05:14.414122 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-beb8f4b7-3107-4c59-8c1a-cbaff95ac8ec tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:14.414620 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-beb8f4b7-3107-4c59-8c1a-cbaff95ac8ec tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:14.415091 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-beb8f4b7-3107-4c59-8c1a-cbaff95ac8ec tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:14.415824 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-beb8f4b7-3107-4c59-8c1a-cbaff95ac8ec tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:14.416294 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-beb8f4b7-3107-4c59-8c1a-cbaff95ac8ec tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:14.416735 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-beb8f4b7-3107-4c59-8c1a-cbaff95ac8ec tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:14.555294 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-beb8f4b7-3107-4c59-8c1a-cbaff95ac8ec tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:05:14.563961 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-beb8f4b7-3107-4c59-8c1a-cbaff95ac8ec tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b" status: 200 len: 1676 microversion: 2.1 time: 0.162354 Aug 31 17:05:14.564560 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3734/7486] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:05:14 2022] GET /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b => generated 1676 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:05:15.586339 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-99a56f45-e094-4b48-9dd8-87306f7cdf20 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:05:15.586966 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-99a56f45-e094-4b48-9dd8-87306f7cdf20 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 280ffda9-548a-4569-8e9b-ee695fb05b8b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:05:15.595037 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-99a56f45-e094-4b48-9dd8-87306f7cdf20 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:15.595859 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-99a56f45-e094-4b48-9dd8-87306f7cdf20 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:15.596322 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-99a56f45-e094-4b48-9dd8-87306f7cdf20 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:15.597065 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-99a56f45-e094-4b48-9dd8-87306f7cdf20 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:15.597548 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-99a56f45-e094-4b48-9dd8-87306f7cdf20 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:15.597999 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-99a56f45-e094-4b48-9dd8-87306f7cdf20 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:15.706397 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-e88f0500-145b-475a-8c3b-b01b3af86e54 req-7769f059-c76a-4587-8d71-30a17c8b7637 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "280ffda9-548a-4569-8e9b-ee695fb05b8b", "name": "network-vif-unplugged", "status": "completed", "tag": "d64f8643-c971-49d8-bdfd-62637dde241e"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:05:15.721380 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-e88f0500-145b-475a-8c3b-b01b3af86e54 req-7769f059-c76a-4587-8d71-30a17c8b7637 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:15.721881 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-e88f0500-145b-475a-8c3b-b01b3af86e54 req-7769f059-c76a-4587-8d71-30a17c8b7637 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:15.722328 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-e88f0500-145b-475a-8c3b-b01b3af86e54 req-7769f059-c76a-4587-8d71-30a17c8b7637 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:15.726776 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:05:15.738863 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-e88f0500-145b-475a-8c3b-b01b3af86e54 req-7769f059-c76a-4587-8d71-30a17c8b7637 service nova] Creating event network-vif-unplugged:d64f8643-c971-49d8-bdfd-62637dde241e for instance 280ffda9-548a-4569-8e9b-ee695fb05b8b on n-h1-850499-9 Aug 31 17:05:15.750934 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [req-e88f0500-145b-475a-8c3b-b01b3af86e54 req-7769f059-c76a-4587-8d71-30a17c8b7637 service nova] Instance 280ffda9-548a-4569-8e9b-ee695fb05b8b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850499-9', 'n-h2-850499-9'} {{(pid=122256) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 31 17:05:15.762774 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-e88f0500-145b-475a-8c3b-b01b3af86e54 req-7769f059-c76a-4587-8d71-30a17c8b7637 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061222 Aug 31 17:05:15.763648 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3735/7487] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:05:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:05:15.830806 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-99a56f45-e094-4b48-9dd8-87306f7cdf20 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:05:15.838686 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-99a56f45-e094-4b48-9dd8-87306f7cdf20 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b" status: 200 len: 1676 microversion: 2.1 time: 0.256305 Aug 31 17:05:15.839270 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3753/7488] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:05:15 2022] GET /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b => generated 1676 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:05:16.862291 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c68a5890-2e79-45f6-bc5b-a239da12a2fd tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:05:16.863090 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c68a5890-2e79-45f6-bc5b-a239da12a2fd tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 280ffda9-548a-4569-8e9b-ee695fb05b8b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:05:16.870717 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c68a5890-2e79-45f6-bc5b-a239da12a2fd tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:16.871208 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c68a5890-2e79-45f6-bc5b-a239da12a2fd tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:16.871676 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c68a5890-2e79-45f6-bc5b-a239da12a2fd tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:16.872394 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c68a5890-2e79-45f6-bc5b-a239da12a2fd tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:16.872852 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c68a5890-2e79-45f6-bc5b-a239da12a2fd tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:16.873275 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c68a5890-2e79-45f6-bc5b-a239da12a2fd tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:17.068910 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c68a5890-2e79-45f6-bc5b-a239da12a2fd tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:05:17.077455 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c68a5890-2e79-45f6-bc5b-a239da12a2fd tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b" status: 200 len: 1676 microversion: 2.1 time: 0.220568 Aug 31 17:05:17.078055 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3736/7489] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:05:16 2022] GET /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b => generated 1676 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:05:17.797368 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-283a932e-a4ba-47df-a77b-ce206a98e2c0 req-88a63508-af5f-4ca8-9b85-989a8c3b2477 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "280ffda9-548a-4569-8e9b-ee695fb05b8b", "tag": "d64f8643-c971-49d8-bdfd-62637dde241e"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:05:17.807237 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-283a932e-a4ba-47df-a77b-ce206a98e2c0 req-88a63508-af5f-4ca8-9b85-989a8c3b2477 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:17.807772 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-283a932e-a4ba-47df-a77b-ce206a98e2c0 req-88a63508-af5f-4ca8-9b85-989a8c3b2477 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:17.808272 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-283a932e-a4ba-47df-a77b-ce206a98e2c0 req-88a63508-af5f-4ca8-9b85-989a8c3b2477 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:17.820967 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-283a932e-a4ba-47df-a77b-ce206a98e2c0 req-88a63508-af5f-4ca8-9b85-989a8c3b2477 service nova] Creating event network-changed:d64f8643-c971-49d8-bdfd-62637dde241e for instance 280ffda9-548a-4569-8e9b-ee695fb05b8b on n-h1-850499-9 Aug 31 17:05:17.826499 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [req-283a932e-a4ba-47df-a77b-ce206a98e2c0 req-88a63508-af5f-4ca8-9b85-989a8c3b2477 service nova] Instance 280ffda9-548a-4569-8e9b-ee695fb05b8b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850499-9', 'n-h2-850499-9'} {{(pid=122257) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 31 17:05:17.839173 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-283a932e-a4ba-47df-a77b-ce206a98e2c0 req-88a63508-af5f-4ca8-9b85-989a8c3b2477 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045797 Aug 31 17:05:17.839831 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3754/7490] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:05:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:05:18.100471 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1b0d5843-22cc-4001-898d-db746d27fdde tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:05:18.101103 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1b0d5843-22cc-4001-898d-db746d27fdde tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 280ffda9-548a-4569-8e9b-ee695fb05b8b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:05:18.108651 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1b0d5843-22cc-4001-898d-db746d27fdde tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:18.109158 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1b0d5843-22cc-4001-898d-db746d27fdde tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:18.110689 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1b0d5843-22cc-4001-898d-db746d27fdde tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:18.111657 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1b0d5843-22cc-4001-898d-db746d27fdde tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:18.112124 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1b0d5843-22cc-4001-898d-db746d27fdde tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:18.112567 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1b0d5843-22cc-4001-898d-db746d27fdde tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:18.326901 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1b0d5843-22cc-4001-898d-db746d27fdde tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:05:18.335528 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1b0d5843-22cc-4001-898d-db746d27fdde tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b" status: 200 len: 1676 microversion: 2.1 time: 0.238966 Aug 31 17:05:18.336135 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3737/7491] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:05:18 2022] GET /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b => generated 1676 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:05:19.359910 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-15e20c5e-6f38-4ce3-87d8-740613e270c9 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:05:19.360728 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-15e20c5e-6f38-4ce3-87d8-740613e270c9 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 280ffda9-548a-4569-8e9b-ee695fb05b8b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:05:19.370047 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-15e20c5e-6f38-4ce3-87d8-740613e270c9 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:19.370662 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-15e20c5e-6f38-4ce3-87d8-740613e270c9 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:19.371104 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-15e20c5e-6f38-4ce3-87d8-740613e270c9 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:19.372968 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-15e20c5e-6f38-4ce3-87d8-740613e270c9 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:19.372968 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-15e20c5e-6f38-4ce3-87d8-740613e270c9 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:19.372968 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-15e20c5e-6f38-4ce3-87d8-740613e270c9 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:19.597092 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-15e20c5e-6f38-4ce3-87d8-740613e270c9 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:05:19.605205 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-15e20c5e-6f38-4ce3-87d8-740613e270c9 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b" status: 200 len: 1676 microversion: 2.1 time: 0.250826 Aug 31 17:05:19.605792 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3755/7492] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:05:19 2022] GET /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b => generated 1676 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:05:20.628231 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9379011c-c3f5-431d-bea0-2fabbf40fe26 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:05:20.628799 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9379011c-c3f5-431d-bea0-2fabbf40fe26 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 280ffda9-548a-4569-8e9b-ee695fb05b8b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:05:20.635972 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9379011c-c3f5-431d-bea0-2fabbf40fe26 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:20.636490 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9379011c-c3f5-431d-bea0-2fabbf40fe26 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:20.636490 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9379011c-c3f5-431d-bea0-2fabbf40fe26 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:20.637640 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9379011c-c3f5-431d-bea0-2fabbf40fe26 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:20.638106 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9379011c-c3f5-431d-bea0-2fabbf40fe26 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:20.638544 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9379011c-c3f5-431d-bea0-2fabbf40fe26 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:20.786590 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-9379011c-c3f5-431d-bea0-2fabbf40fe26 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:05:20.794383 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9379011c-c3f5-431d-bea0-2fabbf40fe26 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b" status: 200 len: 1669 microversion: 2.1 time: 0.171304 Aug 31 17:05:20.794963 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3738/7493] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:05:20 2022] GET /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b => generated 1669 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:05:20.817555 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-53627c07-a227-4812-ac3d-f9dc6410dddb tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:05:20.818192 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-53627c07-a227-4812-ac3d-f9dc6410dddb tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 280ffda9-548a-4569-8e9b-ee695fb05b8b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:05:20.824834 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-53627c07-a227-4812-ac3d-f9dc6410dddb tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:20.825351 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-53627c07-a227-4812-ac3d-f9dc6410dddb tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:20.825805 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-53627c07-a227-4812-ac3d-f9dc6410dddb tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:20.826538 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-53627c07-a227-4812-ac3d-f9dc6410dddb tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:20.827010 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-53627c07-a227-4812-ac3d-f9dc6410dddb tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:20.827450 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-53627c07-a227-4812-ac3d-f9dc6410dddb tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:20.989054 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-53627c07-a227-4812-ac3d-f9dc6410dddb tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:05:20.998517 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-53627c07-a227-4812-ac3d-f9dc6410dddb tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b" status: 200 len: 1669 microversion: 2.1 time: 0.186090 Aug 31 17:05:21.012490 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3756/7494] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:05:20 2022] GET /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b => generated 1669 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:05:21.025045 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-53447b44-c709-412f-b45a-e7a1f33b32f7 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:05:21.025666 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-53447b44-c709-412f-b45a-e7a1f33b32f7 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 280ffda9-548a-4569-8e9b-ee695fb05b8b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:05:21.035815 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-53447b44-c709-412f-b45a-e7a1f33b32f7 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:21.036350 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-53447b44-c709-412f-b45a-e7a1f33b32f7 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:21.036800 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-53447b44-c709-412f-b45a-e7a1f33b32f7 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:21.037979 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-53447b44-c709-412f-b45a-e7a1f33b32f7 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:21.037979 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-53447b44-c709-412f-b45a-e7a1f33b32f7 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:21.038392 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-53447b44-c709-412f-b45a-e7a1f33b32f7 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:21.233905 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-53447b44-c709-412f-b45a-e7a1f33b32f7 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:05:21.243399 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-53447b44-c709-412f-b45a-e7a1f33b32f7 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b" status: 200 len: 1669 microversion: 2.1 time: 0.222919 Aug 31 17:05:21.244223 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3739/7495] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:05:21 2022] GET /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b => generated 1669 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:05:21.264799 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c4cb7ba9-633c-49b6-8f2e-dfb717f7325d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:05:21.265417 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c4cb7ba9-633c-49b6-8f2e-dfb717f7325d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 280ffda9-548a-4569-8e9b-ee695fb05b8b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:05:21.272656 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c4cb7ba9-633c-49b6-8f2e-dfb717f7325d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:21.273173 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c4cb7ba9-633c-49b6-8f2e-dfb717f7325d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:21.273910 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c4cb7ba9-633c-49b6-8f2e-dfb717f7325d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:21.274718 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c4cb7ba9-633c-49b6-8f2e-dfb717f7325d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:21.275297 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c4cb7ba9-633c-49b6-8f2e-dfb717f7325d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:21.275854 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c4cb7ba9-633c-49b6-8f2e-dfb717f7325d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:21.302649 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c4cb7ba9-633c-49b6-8f2e-dfb717f7325d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 280ffda9-548a-4569-8e9b-ee695fb05b8b] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 17:05:21.305826 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=100 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:05:21.394984 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c4cb7ba9-633c-49b6-8f2e-dfb717f7325d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "DELETE /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b" status: 204 len: 0 microversion: 2.1 time: 0.133487 Aug 31 17:05:21.398576 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3757/7496] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 17:05:21 2022] DELETE /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 17:05:21.405085 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c2b48c7a-7a34-4f58-a487-eb570cb51711 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:05:21.407215 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c2b48c7a-7a34-4f58-a487-eb570cb51711 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 280ffda9-548a-4569-8e9b-ee695fb05b8b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:05:21.414477 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c2b48c7a-7a34-4f58-a487-eb570cb51711 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:21.415195 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c2b48c7a-7a34-4f58-a487-eb570cb51711 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:21.416021 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c2b48c7a-7a34-4f58-a487-eb570cb51711 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:21.416875 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c2b48c7a-7a34-4f58-a487-eb570cb51711 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:21.417624 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c2b48c7a-7a34-4f58-a487-eb570cb51711 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:21.418269 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c2b48c7a-7a34-4f58-a487-eb570cb51711 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:21.559584 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c2b48c7a-7a34-4f58-a487-eb570cb51711 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:05:21.569343 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c2b48c7a-7a34-4f58-a487-eb570cb51711 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b" status: 200 len: 1675 microversion: 2.1 time: 0.168540 Aug 31 17:05:21.575747 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3740/7497] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:05:21 2022] GET /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b => generated 1675 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 17:05:22.592174 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-31b01668-4e7c-49f8-8c98-5fcc38de94f7 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:05:22.593021 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-31b01668-4e7c-49f8-8c98-5fcc38de94f7 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 280ffda9-548a-4569-8e9b-ee695fb05b8b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:05:22.596088 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:05:22.601660 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-31b01668-4e7c-49f8-8c98-5fcc38de94f7 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:22.602210 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-31b01668-4e7c-49f8-8c98-5fcc38de94f7 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:22.602673 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-31b01668-4e7c-49f8-8c98-5fcc38de94f7 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:22.603409 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-31b01668-4e7c-49f8-8c98-5fcc38de94f7 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:22.603917 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-31b01668-4e7c-49f8-8c98-5fcc38de94f7 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:22.604367 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-31b01668-4e7c-49f8-8c98-5fcc38de94f7 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:22.803881 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-31b01668-4e7c-49f8-8c98-5fcc38de94f7 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:05:22.811721 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-31b01668-4e7c-49f8-8c98-5fcc38de94f7 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b" status: 200 len: 1675 microversion: 2.1 time: 0.223924 Aug 31 17:05:22.812311 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3758/7498] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:05:22 2022] GET /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b => generated 1675 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:05:23.052800 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-cecdb040-1964-447c-950a-cfc2890a71a9 req-e216a695-e458-4285-a950-a4fc1908cc08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "280ffda9-548a-4569-8e9b-ee695fb05b8b", "name": "network-vif-plugged", "status": "completed", "tag": "d64f8643-c971-49d8-bdfd-62637dde241e"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:05:23.059535 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=3 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:05:23.060373 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:05:23.068767 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-cecdb040-1964-447c-950a-cfc2890a71a9 req-e216a695-e458-4285-a950-a4fc1908cc08 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:23.069805 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-cecdb040-1964-447c-950a-cfc2890a71a9 req-e216a695-e458-4285-a950-a4fc1908cc08 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:23.070257 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-cecdb040-1964-447c-950a-cfc2890a71a9 req-e216a695-e458-4285-a950-a4fc1908cc08 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:23.086208 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-cecdb040-1964-447c-950a-cfc2890a71a9 req-e216a695-e458-4285-a950-a4fc1908cc08 service nova] Creating event network-vif-plugged:d64f8643-c971-49d8-bdfd-62637dde241e for instance 280ffda9-548a-4569-8e9b-ee695fb05b8b on n-h1-850499-9 Aug 31 17:05:23.095774 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-cecdb040-1964-447c-950a-cfc2890a71a9 req-e216a695-e458-4285-a950-a4fc1908cc08 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047155 Aug 31 17:05:23.097256 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3741/7499] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:05:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:05:23.834381 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-79311d1a-0a56-4ae0-8d0d-d655e880113d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:05:23.835159 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-79311d1a-0a56-4ae0-8d0d-d655e880113d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 280ffda9-548a-4569-8e9b-ee695fb05b8b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:05:23.842840 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-79311d1a-0a56-4ae0-8d0d-d655e880113d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:23.843364 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-79311d1a-0a56-4ae0-8d0d-d655e880113d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:23.844443 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-79311d1a-0a56-4ae0-8d0d-d655e880113d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:23.845184 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-79311d1a-0a56-4ae0-8d0d-d655e880113d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:23.845670 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-79311d1a-0a56-4ae0-8d0d-d655e880113d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:23.846123 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-79311d1a-0a56-4ae0-8d0d-d655e880113d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:23.926969 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-074d006d-2af8-49a8-950c-4812596f1029 req-9bbed0a7-d8d3-40da-ab7f-adcfcf12634f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "280ffda9-548a-4569-8e9b-ee695fb05b8b", "name": "network-vif-deleted", "tag": "d64f8643-c971-49d8-bdfd-62637dde241e"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:05:23.943255 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-79311d1a-0a56-4ae0-8d0d-d655e880113d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:05:23.949206 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-074d006d-2af8-49a8-950c-4812596f1029 req-9bbed0a7-d8d3-40da-ab7f-adcfcf12634f service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:23.949870 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-074d006d-2af8-49a8-950c-4812596f1029 req-9bbed0a7-d8d3-40da-ab7f-adcfcf12634f service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:23.950319 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-074d006d-2af8-49a8-950c-4812596f1029 req-9bbed0a7-d8d3-40da-ab7f-adcfcf12634f service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:23.961527 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-79311d1a-0a56-4ae0-8d0d-d655e880113d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b" status: 200 len: 1608 microversion: 2.1 time: 0.131176 Aug 31 17:05:23.965071 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3759/7500] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:05:23 2022] GET /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b => generated 1608 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:05:23.965677 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-074d006d-2af8-49a8-950c-4812596f1029 req-9bbed0a7-d8d3-40da-ab7f-adcfcf12634f service nova] Creating event network-vif-deleted:d64f8643-c971-49d8-bdfd-62637dde241e for instance 280ffda9-548a-4569-8e9b-ee695fb05b8b on n-h1-850499-9 Aug 31 17:05:23.971864 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-074d006d-2af8-49a8-950c-4812596f1029 req-9bbed0a7-d8d3-40da-ab7f-adcfcf12634f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050342 Aug 31 17:05:23.973489 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3742/7501] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:05:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:05:24.986570 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d96794d9-99ff-47f7-b7ad-90729b2c84e7 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:05:24.987172 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d96794d9-99ff-47f7-b7ad-90729b2c84e7 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 280ffda9-548a-4569-8e9b-ee695fb05b8b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:05:24.994340 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d96794d9-99ff-47f7-b7ad-90729b2c84e7 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:24.994860 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d96794d9-99ff-47f7-b7ad-90729b2c84e7 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:24.995327 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d96794d9-99ff-47f7-b7ad-90729b2c84e7 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:24.996098 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d96794d9-99ff-47f7-b7ad-90729b2c84e7 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:24.996623 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d96794d9-99ff-47f7-b7ad-90729b2c84e7 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:24.997650 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d96794d9-99ff-47f7-b7ad-90729b2c84e7 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:25.013073 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-d96794d9-99ff-47f7-b7ad-90729b2c84e7 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] HTTP exception thrown: Instance 280ffda9-548a-4569-8e9b-ee695fb05b8b could not be found. Aug 31 17:05:25.014780 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d96794d9-99ff-47f7-b7ad-90729b2c84e7 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Request method failure captured: Aug 31 17:05:25.014780 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b HTTP/1.1 Aug 31 17:05:25.014780 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 17:05:25.014780 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 17:05:25.014780 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 17:05:25.014780 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 17:05:25.014780 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 17:05:25.014780 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 17:05:25.014780 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 17:05:25.014780 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 17:05:25.014780 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD5Nv8GJZq1tAU_0B41QogV9NIcJdPpwMr_NXfjBi2_q4oUJIInVGdHr79haO8h167WXFYih4WATMYJ8x__N41D8Vj_h-g4tmjTg1gnT9rlBTtYAJ4qzKuSSR4SRddtXJGZ38GeQNeHZeDZnQxyjFCcsQeloJgCoY--vpZdgiHPrfHyY Aug 31 17:05:25.014780 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 17:05:25.014780 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 17:05:25.014780 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 17:05:25.014780 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 17:05:25.014780 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 17:05:25.014780 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 17:05:25.014780 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: f38fad62a33848c59db3d09c5c9788cc Aug 31 17:05:25.014780 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ServerActionsTestJSON-992920924 Aug 31 17:05:25.014780 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 17:05:25.014780 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 17:05:25.014780 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f38fad62a33848c59db3d09c5c9788cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f38fad62a33848c59db3d09c5c9788cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f38fad62a33848c59db3d09c5c9788cc", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f38fad62a33848c59db3d09c5c9788cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 17:05:25.014780 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ServerActionsTestJSON-992920924 Aug 31 17:05:25.014780 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: f38fad62a33848c59db3d09c5c9788cc Aug 31 17:05:25.014780 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ServerActionsTestJSON-992920924 Aug 31 17:05:25.014780 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ServerActionsTestJSON-992920924-project Aug 31 17:05:25.014780 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 17:05:25.014780 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 17:05:25.014780 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: a3e98ea428604e7da092d46e865cfe1d Aug 31 17:05:25.014780 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ServerActionsTestJSON-992920924-project Aug 31 17:05:25.014780 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 17:05:25.014780 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance 280ffda9-548a-4569-8e9b-ee695fb05b8b could not be found. Aug 31 17:05:25.014780 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '280ffda9-548a-4569-8e9b-ee695fb05b8b'} Aug 31 17:05:25.014780 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 17:05:25.014780 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:05:25.014780 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 17:05:25.014780 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 17:05:25.014780 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 17:05:25.014780 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 17:05:25.014780 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 17:05:25.014780 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 17:05:25.014780 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 17:05:25.014780 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 17:05:25.014780 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 280ffda9-548a-4569-8e9b-ee695fb05b8b could not be found. Aug 31 17:05:25.014780 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 17:05:25.014780 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:05:25.014780 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 17:05:25.014780 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:05:25.014780 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:05:25.014780 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:05:25.014780 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 17:05:25.014780 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 17:05:25.014780 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 17:05:25.014780 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 17:05:25.014780 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 17:05:25.014780 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 17:05:25.014780 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 17:05:25.014780 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 17:05:25.014780 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 17:05:25.014780 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 17:05:25.014780 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 280ffda9-548a-4569-8e9b-ee695fb05b8b could not be found. Aug 31 17:05:25.014780 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 17:05:25.014780 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:05:25.014780 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 17:05:25.019023 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:05:25.019023 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:05:25.019023 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:05:25.019023 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 17:05:25.019023 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 17:05:25.019023 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 280ffda9-548a-4569-8e9b-ee695fb05b8b could not be found. Aug 31 17:05:25.019023 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 17:05:25.019023 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d96794d9-99ff-47f7-b7ad-90729b2c84e7 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Returning 404 to user: Instance 280ffda9-548a-4569-8e9b-ee695fb05b8b could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 17:05:25.019023 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d96794d9-99ff-47f7-b7ad-90729b2c84e7 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b" status: 404 len: 111 microversion: 2.1 time: 0.034691 Aug 31 17:05:25.019023 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3760/7502] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:05:24 2022] GET /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 17:05:25.032118 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-05a50107-f94e-4446-b0af-a061654a3124 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:05:25.032890 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-05a50107-f94e-4446-b0af-a061654a3124 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 280ffda9-548a-4569-8e9b-ee695fb05b8b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:05:25.040330 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-05a50107-f94e-4446-b0af-a061654a3124 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:25.040826 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-05a50107-f94e-4446-b0af-a061654a3124 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:25.041307 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-05a50107-f94e-4446-b0af-a061654a3124 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:25.042015 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-05a50107-f94e-4446-b0af-a061654a3124 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:25.042480 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-05a50107-f94e-4446-b0af-a061654a3124 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:25.042910 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-05a50107-f94e-4446-b0af-a061654a3124 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:25.057314 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-05a50107-f94e-4446-b0af-a061654a3124 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] HTTP exception thrown: Instance 280ffda9-548a-4569-8e9b-ee695fb05b8b could not be found. Aug 31 17:05:25.058993 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-05a50107-f94e-4446-b0af-a061654a3124 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Request method failure captured: Aug 31 17:05:25.058993 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b HTTP/1.1 Aug 31 17:05:25.058993 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 17:05:25.058993 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 17:05:25.058993 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 17:05:25.058993 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 17:05:25.058993 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 17:05:25.058993 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 17:05:25.058993 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 17:05:25.058993 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 17:05:25.058993 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD5Nv8GJZq1tAU_0B41QogV9NIcJdPpwMr_NXfjBi2_q4oUJIInVGdHr79haO8h167WXFYih4WATMYJ8x__N41D8Vj_h-g4tmjTg1gnT9rlBTtYAJ4qzKuSSR4SRddtXJGZ38GeQNeHZeDZnQxyjFCcsQeloJgCoY--vpZdgiHPrfHyY Aug 31 17:05:25.058993 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 17:05:25.058993 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 17:05:25.058993 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 17:05:25.058993 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 17:05:25.058993 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 17:05:25.058993 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 17:05:25.058993 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: f38fad62a33848c59db3d09c5c9788cc Aug 31 17:05:25.058993 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ServerActionsTestJSON-992920924 Aug 31 17:05:25.058993 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 17:05:25.058993 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 17:05:25.058993 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f38fad62a33848c59db3d09c5c9788cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f38fad62a33848c59db3d09c5c9788cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f38fad62a33848c59db3d09c5c9788cc", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f38fad62a33848c59db3d09c5c9788cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 17:05:25.058993 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ServerActionsTestJSON-992920924 Aug 31 17:05:25.058993 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: f38fad62a33848c59db3d09c5c9788cc Aug 31 17:05:25.058993 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ServerActionsTestJSON-992920924 Aug 31 17:05:25.058993 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ServerActionsTestJSON-992920924-project Aug 31 17:05:25.058993 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 17:05:25.058993 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 17:05:25.058993 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: a3e98ea428604e7da092d46e865cfe1d Aug 31 17:05:25.058993 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ServerActionsTestJSON-992920924-project Aug 31 17:05:25.058993 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 17:05:25.058993 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance 280ffda9-548a-4569-8e9b-ee695fb05b8b could not be found. Aug 31 17:05:25.058993 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '280ffda9-548a-4569-8e9b-ee695fb05b8b'} Aug 31 17:05:25.058993 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 17:05:25.058993 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:05:25.058993 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 17:05:25.058993 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 17:05:25.058993 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 17:05:25.058993 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 17:05:25.058993 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 17:05:25.058993 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 17:05:25.058993 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 17:05:25.058993 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 17:05:25.058993 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 280ffda9-548a-4569-8e9b-ee695fb05b8b could not be found. Aug 31 17:05:25.058993 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:05:25.058993 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:05:25.058993 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:05:25.058993 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:05:25.058993 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:05:25.058993 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:05:25.058993 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 17:05:25.058993 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 17:05:25.058993 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 17:05:25.058993 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 17:05:25.058993 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 17:05:25.058993 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 17:05:25.058993 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 17:05:25.058993 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 17:05:25.058993 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 17:05:25.058993 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 17:05:25.058993 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 280ffda9-548a-4569-8e9b-ee695fb05b8b could not be found. Aug 31 17:05:25.058993 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:05:25.058993 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:05:25.058993 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:05:25.064102 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:05:25.064102 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:05:25.064102 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:05:25.064102 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 17:05:25.064102 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 17:05:25.064102 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 280ffda9-548a-4569-8e9b-ee695fb05b8b could not be found. Aug 31 17:05:25.064102 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:05:25.064102 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-05a50107-f94e-4446-b0af-a061654a3124 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Returning 404 to user: Instance 280ffda9-548a-4569-8e9b-ee695fb05b8b could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 17:05:25.064102 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-05a50107-f94e-4446-b0af-a061654a3124 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b" status: 404 len: 111 microversion: 2.1 time: 0.033168 Aug 31 17:05:25.065225 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3743/7503] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:05:25 2022] GET /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 17:05:25.112884 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-bf5c4aa2-39c0-431b-8bc6-d5699e125772 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1457890652", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "networks": [{"uuid": "41af13fa-aeee-464a-8b24-48b02ed3bdc6"}], "security_groups": [{"name": "tempest-securitygroup--824623775"}], "key_name": "tempest-keypair-1911906825", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:05:25.220706 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-bf5c4aa2-39c0-431b-8bc6-d5699e125772 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] validate_networks() for [('41af13fa-aeee-464a-8b24-48b02ed3bdc6', None, None, None, None, None)] {{(pid=122257) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 17:05:25.657139 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-bf5c4aa2-39c0-431b-8bc6-d5699e125772 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 17:05:25.657595 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-bf5c4aa2-39c0-431b-8bc6-d5699e125772 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 17:05:25.658099 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-bf5c4aa2-39c0-431b-8bc6-d5699e125772 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 17:05:25.658536 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-bf5c4aa2-39c0-431b-8bc6-d5699e125772 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 17:05:25.658977 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-bf5c4aa2-39c0-431b-8bc6-d5699e125772 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 17:05:25.668027 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bf5c4aa2-39c0-431b-8bc6-d5699e125772 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:25.668539 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bf5c4aa2-39c0-431b-8bc6-d5699e125772 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:25.669002 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bf5c4aa2-39c0-431b-8bc6-d5699e125772 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:25.669758 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bf5c4aa2-39c0-431b-8bc6-d5699e125772 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:25.670239 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bf5c4aa2-39c0-431b-8bc6-d5699e125772 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:25.670691 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bf5c4aa2-39c0-431b-8bc6-d5699e125772 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:25.689420 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-bf5c4aa2-39c0-431b-8bc6-d5699e125772 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Getting quotas for project f38fad62a33848c59db3d09c5c9788cc. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 17:05:25.694765 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-bf5c4aa2-39c0-431b-8bc6-d5699e125772 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Getting quotas for user a3e98ea428604e7da092d46e865cfe1d and project f38fad62a33848c59db3d09c5c9788cc. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 17:05:25.707823 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-bf5c4aa2-39c0-431b-8bc6-d5699e125772 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Going to run 1 instances... {{(pid=122257) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 17:05:25.710148 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-bf5c4aa2-39c0-431b-8bc6-d5699e125772 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 1c131f57-2412-4310-836c-c63e70281fd5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 17:05:25.758944 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-bf5c4aa2-39c0-431b-8bc6-d5699e125772 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.651071 Aug 31 17:05:25.759638 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3761/7504] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 17:05:25 2022] POST /compute/v2.1/servers => generated 405 bytes in 653 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 17:05:25.771296 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2b248e5f-3712-48ff-bbb1-95686d11849f tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:05:25.771943 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2b248e5f-3712-48ff-bbb1-95686d11849f tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 1c131f57-2412-4310-836c-c63e70281fd5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:05:25.837459 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-2b248e5f-3712-48ff-bbb1-95686d11849f tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:05:25.845222 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2b248e5f-3712-48ff-bbb1-95686d11849f tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5" status: 200 len: 1239 microversion: 2.1 time: 0.077977 Aug 31 17:05:25.845799 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3744/7505] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:05:25 2022] GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5 => generated 1239 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:05:26.867678 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a78cee12-c209-4a1c-a356-ec219f17f759 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:05:26.868472 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a78cee12-c209-4a1c-a356-ec219f17f759 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 1c131f57-2412-4310-836c-c63e70281fd5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:05:26.878589 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a78cee12-c209-4a1c-a356-ec219f17f759 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:26.879251 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a78cee12-c209-4a1c-a356-ec219f17f759 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:26.879760 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a78cee12-c209-4a1c-a356-ec219f17f759 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:26.880497 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a78cee12-c209-4a1c-a356-ec219f17f759 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:26.881178 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a78cee12-c209-4a1c-a356-ec219f17f759 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:26.881635 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a78cee12-c209-4a1c-a356-ec219f17f759 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:26.958192 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a78cee12-c209-4a1c-a356-ec219f17f759 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:05:26.966529 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a78cee12-c209-4a1c-a356-ec219f17f759 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5" status: 200 len: 1299 microversion: 2.1 time: 0.103677 Aug 31 17:05:26.967127 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3762/7506] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:05:26 2022] GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5 => generated 1299 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:05:27.989425 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b4399e3c-8816-4f35-9b64-dd7042e02e5e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:05:27.990180 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b4399e3c-8816-4f35-9b64-dd7042e02e5e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 1c131f57-2412-4310-836c-c63e70281fd5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:05:27.998493 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b4399e3c-8816-4f35-9b64-dd7042e02e5e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:27.999077 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b4399e3c-8816-4f35-9b64-dd7042e02e5e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:27.999666 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b4399e3c-8816-4f35-9b64-dd7042e02e5e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:28.001213 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b4399e3c-8816-4f35-9b64-dd7042e02e5e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:28.001971 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b4399e3c-8816-4f35-9b64-dd7042e02e5e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:28.002420 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b4399e3c-8816-4f35-9b64-dd7042e02e5e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:28.214437 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b4399e3c-8816-4f35-9b64-dd7042e02e5e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:05:28.224652 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b4399e3c-8816-4f35-9b64-dd7042e02e5e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5" status: 200 len: 1364 microversion: 2.1 time: 0.239101 Aug 31 17:05:28.225348 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3745/7507] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:05:27 2022] GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5 => generated 1364 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 17:05:28.427648 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-657936b0-52a1-40b8-8458-ae9b3685fc53 req-88cdb795-840f-44bc-84bf-034b59575653 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c131f57-2412-4310-836c-c63e70281fd5", "tag": "df0eec12-64b7-45d6-b90c-30c4b3636221"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:05:28.440170 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-657936b0-52a1-40b8-8458-ae9b3685fc53 req-88cdb795-840f-44bc-84bf-034b59575653 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:28.440584 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-657936b0-52a1-40b8-8458-ae9b3685fc53 req-88cdb795-840f-44bc-84bf-034b59575653 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:28.441045 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-657936b0-52a1-40b8-8458-ae9b3685fc53 req-88cdb795-840f-44bc-84bf-034b59575653 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:28.453063 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-657936b0-52a1-40b8-8458-ae9b3685fc53 req-88cdb795-840f-44bc-84bf-034b59575653 service nova] Creating event network-changed:df0eec12-64b7-45d6-b90c-30c4b3636221 for instance 1c131f57-2412-4310-836c-c63e70281fd5 on n-h2-850499-9 Aug 31 17:05:28.458540 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-657936b0-52a1-40b8-8458-ae9b3685fc53 req-88cdb795-840f-44bc-84bf-034b59575653 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034816 Aug 31 17:05:28.459156 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3763/7508] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:05:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 17:05:29.248366 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4232423e-f835-4dcf-a2ce-d0f058791704 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:05:29.248986 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4232423e-f835-4dcf-a2ce-d0f058791704 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 1c131f57-2412-4310-836c-c63e70281fd5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:05:29.256559 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4232423e-f835-4dcf-a2ce-d0f058791704 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:29.257052 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4232423e-f835-4dcf-a2ce-d0f058791704 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:29.257494 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4232423e-f835-4dcf-a2ce-d0f058791704 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:29.258196 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4232423e-f835-4dcf-a2ce-d0f058791704 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:29.258661 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4232423e-f835-4dcf-a2ce-d0f058791704 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:29.259095 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4232423e-f835-4dcf-a2ce-d0f058791704 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:29.398971 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-4232423e-f835-4dcf-a2ce-d0f058791704 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:05:29.407349 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4232423e-f835-4dcf-a2ce-d0f058791704 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5" status: 200 len: 1364 microversion: 2.1 time: 0.164081 Aug 31 17:05:29.408017 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3746/7509] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:05:29 2022] GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5 => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:05:30.430110 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6a9d0974-c055-4dc7-b00f-532086219b41 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:05:30.430831 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6a9d0974-c055-4dc7-b00f-532086219b41 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 1c131f57-2412-4310-836c-c63e70281fd5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:05:30.437728 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6a9d0974-c055-4dc7-b00f-532086219b41 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:30.438324 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6a9d0974-c055-4dc7-b00f-532086219b41 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:30.438786 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6a9d0974-c055-4dc7-b00f-532086219b41 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:30.439548 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6a9d0974-c055-4dc7-b00f-532086219b41 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:30.440023 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6a9d0974-c055-4dc7-b00f-532086219b41 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:30.440474 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6a9d0974-c055-4dc7-b00f-532086219b41 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:30.575956 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-6a9d0974-c055-4dc7-b00f-532086219b41 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:05:30.584909 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6a9d0974-c055-4dc7-b00f-532086219b41 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5" status: 200 len: 1364 microversion: 2.1 time: 0.159975 Aug 31 17:05:30.585490 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3764/7510] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:05:30 2022] GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 17:05:31.606701 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-928ba95c-7feb-481d-9a2a-47cbb7520c56 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:05:31.607352 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-928ba95c-7feb-481d-9a2a-47cbb7520c56 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 1c131f57-2412-4310-836c-c63e70281fd5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:05:31.614900 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-928ba95c-7feb-481d-9a2a-47cbb7520c56 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:31.615396 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-928ba95c-7feb-481d-9a2a-47cbb7520c56 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:31.615878 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-928ba95c-7feb-481d-9a2a-47cbb7520c56 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:31.616576 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-928ba95c-7feb-481d-9a2a-47cbb7520c56 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:31.617039 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-928ba95c-7feb-481d-9a2a-47cbb7520c56 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:31.617471 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-928ba95c-7feb-481d-9a2a-47cbb7520c56 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:31.831674 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-928ba95c-7feb-481d-9a2a-47cbb7520c56 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:05:31.839562 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-928ba95c-7feb-481d-9a2a-47cbb7520c56 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5" status: 200 len: 1364 microversion: 2.1 time: 0.236774 Aug 31 17:05:31.840154 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3747/7511] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:05:31 2022] GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5 => generated 1364 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:05:32.862421 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-34ce9c07-392b-461d-8180-9e107c59baa8 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:05:32.863149 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-34ce9c07-392b-461d-8180-9e107c59baa8 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 1c131f57-2412-4310-836c-c63e70281fd5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:05:32.870238 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-34ce9c07-392b-461d-8180-9e107c59baa8 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:32.870748 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-34ce9c07-392b-461d-8180-9e107c59baa8 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:32.871209 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-34ce9c07-392b-461d-8180-9e107c59baa8 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:32.871955 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-34ce9c07-392b-461d-8180-9e107c59baa8 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:32.872428 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-34ce9c07-392b-461d-8180-9e107c59baa8 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:32.872866 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-34ce9c07-392b-461d-8180-9e107c59baa8 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:33.013028 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-34ce9c07-392b-461d-8180-9e107c59baa8 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:05:33.022692 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-34ce9c07-392b-461d-8180-9e107c59baa8 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5" status: 200 len: 1364 microversion: 2.1 time: 0.164198 Aug 31 17:05:33.023184 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3765/7512] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:05:32 2022] GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5 => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:05:34.043690 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f9088c75-f01e-4a4f-a027-434a72f702a2 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:05:34.044371 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f9088c75-f01e-4a4f-a027-434a72f702a2 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 1c131f57-2412-4310-836c-c63e70281fd5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:05:34.052164 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f9088c75-f01e-4a4f-a027-434a72f702a2 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:34.052662 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f9088c75-f01e-4a4f-a027-434a72f702a2 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:34.053111 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f9088c75-f01e-4a4f-a027-434a72f702a2 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:34.053822 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f9088c75-f01e-4a4f-a027-434a72f702a2 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:34.054290 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f9088c75-f01e-4a4f-a027-434a72f702a2 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:34.054729 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f9088c75-f01e-4a4f-a027-434a72f702a2 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:34.188912 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f9088c75-f01e-4a4f-a027-434a72f702a2 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:05:34.196907 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f9088c75-f01e-4a4f-a027-434a72f702a2 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5" status: 200 len: 1364 microversion: 2.1 time: 0.157231 Aug 31 17:05:34.197525 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3748/7513] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:05:34 2022] GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 17:05:35.043835 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-b8dbfa75-2d33-4ab1-928c-db62549b744e req-844419da-269f-44b5-bb2b-6b0e61944e7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c131f57-2412-4310-836c-c63e70281fd5", "name": "network-vif-plugged", "status": "completed", "tag": "df0eec12-64b7-45d6-b90c-30c4b3636221"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:05:35.056514 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-b8dbfa75-2d33-4ab1-928c-db62549b744e req-844419da-269f-44b5-bb2b-6b0e61944e7b service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:35.057116 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-b8dbfa75-2d33-4ab1-928c-db62549b744e req-844419da-269f-44b5-bb2b-6b0e61944e7b service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:35.057821 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-b8dbfa75-2d33-4ab1-928c-db62549b744e req-844419da-269f-44b5-bb2b-6b0e61944e7b service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:35.071955 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-b8dbfa75-2d33-4ab1-928c-db62549b744e req-844419da-269f-44b5-bb2b-6b0e61944e7b service nova] Creating event network-vif-plugged:df0eec12-64b7-45d6-b90c-30c4b3636221 for instance 1c131f57-2412-4310-836c-c63e70281fd5 on n-h2-850499-9 Aug 31 17:05:35.077415 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-b8dbfa75-2d33-4ab1-928c-db62549b744e req-844419da-269f-44b5-bb2b-6b0e61944e7b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038076 Aug 31 17:05:35.078372 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3766/7514] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:05:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:05:35.219428 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5e12a7c3-2828-42da-9ec1-18c7d67ad5dc tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:05:35.220504 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5e12a7c3-2828-42da-9ec1-18c7d67ad5dc tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 1c131f57-2412-4310-836c-c63e70281fd5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:05:35.228262 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5e12a7c3-2828-42da-9ec1-18c7d67ad5dc tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:35.228778 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5e12a7c3-2828-42da-9ec1-18c7d67ad5dc tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:35.229228 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5e12a7c3-2828-42da-9ec1-18c7d67ad5dc tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:35.229956 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5e12a7c3-2828-42da-9ec1-18c7d67ad5dc tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:35.230425 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5e12a7c3-2828-42da-9ec1-18c7d67ad5dc tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:35.231312 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5e12a7c3-2828-42da-9ec1-18c7d67ad5dc tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:35.400871 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5e12a7c3-2828-42da-9ec1-18c7d67ad5dc tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:05:35.410050 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5e12a7c3-2828-42da-9ec1-18c7d67ad5dc tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5" status: 200 len: 1364 microversion: 2.1 time: 0.195565 Aug 31 17:05:35.410637 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3749/7515] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:05:35 2022] GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5 => generated 1364 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:05:36.431255 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f5a134e7-b89f-437d-a42b-455549a8cf0b tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:05:36.431929 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f5a134e7-b89f-437d-a42b-455549a8cf0b tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 1c131f57-2412-4310-836c-c63e70281fd5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:05:36.433950 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:05:36.434644 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=6 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:05:36.442622 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f5a134e7-b89f-437d-a42b-455549a8cf0b tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:36.443133 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f5a134e7-b89f-437d-a42b-455549a8cf0b tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:36.443626 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f5a134e7-b89f-437d-a42b-455549a8cf0b tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:36.444355 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f5a134e7-b89f-437d-a42b-455549a8cf0b tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:36.444839 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f5a134e7-b89f-437d-a42b-455549a8cf0b tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:36.445288 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f5a134e7-b89f-437d-a42b-455549a8cf0b tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:36.595436 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f5a134e7-b89f-437d-a42b-455549a8cf0b tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:05:36.603516 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f5a134e7-b89f-437d-a42b-455549a8cf0b tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5" status: 200 len: 1364 microversion: 2.1 time: 0.176597 Aug 31 17:05:36.604127 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3767/7516] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:05:36 2022] GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5 => generated 1364 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:05:37.627238 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-43f50be2-4665-4f81-a0ad-d26f2daf2495 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:05:37.627894 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-43f50be2-4665-4f81-a0ad-d26f2daf2495 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 1c131f57-2412-4310-836c-c63e70281fd5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:05:37.629877 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:05:37.637102 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-43f50be2-4665-4f81-a0ad-d26f2daf2495 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:37.637599 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-43f50be2-4665-4f81-a0ad-d26f2daf2495 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:37.638047 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-43f50be2-4665-4f81-a0ad-d26f2daf2495 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:37.638870 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-43f50be2-4665-4f81-a0ad-d26f2daf2495 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:37.639339 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-43f50be2-4665-4f81-a0ad-d26f2daf2495 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:37.639796 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-43f50be2-4665-4f81-a0ad-d26f2daf2495 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:37.774833 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-43f50be2-4665-4f81-a0ad-d26f2daf2495 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:05:37.784022 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-43f50be2-4665-4f81-a0ad-d26f2daf2495 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5" status: 200 len: 1551 microversion: 2.1 time: 0.161775 Aug 31 17:05:37.784717 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3750/7517] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:05:37 2022] GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5 => generated 1551 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:05:37.806023 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c90ced57-626f-4f41-ac85-23ca9e4b5f4e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:05:37.806542 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c90ced57-626f-4f41-ac85-23ca9e4b5f4e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 1c131f57-2412-4310-836c-c63e70281fd5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:05:37.814727 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c90ced57-626f-4f41-ac85-23ca9e4b5f4e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:37.815243 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c90ced57-626f-4f41-ac85-23ca9e4b5f4e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:37.815736 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c90ced57-626f-4f41-ac85-23ca9e4b5f4e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:37.816470 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c90ced57-626f-4f41-ac85-23ca9e4b5f4e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:37.816950 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c90ced57-626f-4f41-ac85-23ca9e4b5f4e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:37.817401 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c90ced57-626f-4f41-ac85-23ca9e4b5f4e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:37.904104 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c90ced57-626f-4f41-ac85-23ca9e4b5f4e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.101916 Aug 31 17:05:37.904709 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3768/7518] 10.222.0.61 () {58 vars in 1275 bytes} [Wed Aug 31 17:05:37 2022] GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:05:38.993074 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-6c4c7ee9-8acb-47df-93ef-0f4da7b4211e req-2fe7d92b-994f-49d1-9267-c7ca4611cb70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c131f57-2412-4310-836c-c63e70281fd5", "tag": "df0eec12-64b7-45d6-b90c-30c4b3636221"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:05:39.003758 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-6c4c7ee9-8acb-47df-93ef-0f4da7b4211e req-2fe7d92b-994f-49d1-9267-c7ca4611cb70 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:39.004251 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-6c4c7ee9-8acb-47df-93ef-0f4da7b4211e req-2fe7d92b-994f-49d1-9267-c7ca4611cb70 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:39.004691 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-6c4c7ee9-8acb-47df-93ef-0f4da7b4211e req-2fe7d92b-994f-49d1-9267-c7ca4611cb70 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:39.016206 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-6c4c7ee9-8acb-47df-93ef-0f4da7b4211e req-2fe7d92b-994f-49d1-9267-c7ca4611cb70 service nova] Creating event network-changed:df0eec12-64b7-45d6-b90c-30c4b3636221 for instance 1c131f57-2412-4310-836c-c63e70281fd5 on n-h2-850499-9 Aug 31 17:05:39.021240 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-6c4c7ee9-8acb-47df-93ef-0f4da7b4211e req-2fe7d92b-994f-49d1-9267-c7ca4611cb70 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085340 Aug 31 17:05:39.021912 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3751/7519] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:05:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:06:53.495612 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:06:53.496420 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:06:53.498226 n-d-850499-9 devstack@n-api.service[122257]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 17:06:53.498518 n-d-850499-9 devstack@n-api.service[122257]: Wed Aug 31 17:06:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5 (ip 10.222.0.61) !!! Aug 31 17:06:53.506468 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9ae83945-9540-4bbf-8515-da4e41dbe34d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:06:53.507102 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9ae83945-9540-4bbf-8515-da4e41dbe34d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 1c131f57-2412-4310-836c-c63e70281fd5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:06:53.519635 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9ae83945-9540-4bbf-8515-da4e41dbe34d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:06:53.520151 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9ae83945-9540-4bbf-8515-da4e41dbe34d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:06:53.520615 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9ae83945-9540-4bbf-8515-da4e41dbe34d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:06:53.521343 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9ae83945-9540-4bbf-8515-da4e41dbe34d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:06:53.521824 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9ae83945-9540-4bbf-8515-da4e41dbe34d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:06:53.522275 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9ae83945-9540-4bbf-8515-da4e41dbe34d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:06:53.662135 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9ae83945-9540-4bbf-8515-da4e41dbe34d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:06:53.669919 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9ae83945-9540-4bbf-8515-da4e41dbe34d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5" status: 200 len: 1669 microversion: 2.1 time: 0.177109 Aug 31 17:06:53.670505 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3769/7520] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:06:53 2022] GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5 => generated 1669 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:06:53.690352 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=23 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:06:53.691100 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=76 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:06:53.696691 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5760a6a0-7300-4ed1-a006-8f23769a2c0b tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e68ad6da-529d-4f2f-af50-7002fbb33d1a"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:06:53.699150 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5760a6a0-7300-4ed1-a006-8f23769a2c0b tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 1c131f57-2412-4310-836c-c63e70281fd5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:06:53.707201 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5760a6a0-7300-4ed1-a006-8f23769a2c0b tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:06:53.707718 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5760a6a0-7300-4ed1-a006-8f23769a2c0b tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:06:53.708163 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5760a6a0-7300-4ed1-a006-8f23769a2c0b tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:06:53.709194 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5760a6a0-7300-4ed1-a006-8f23769a2c0b tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:06:53.709398 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5760a6a0-7300-4ed1-a006-8f23769a2c0b tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:06:53.709751 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5760a6a0-7300-4ed1-a006-8f23769a2c0b tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:06:53.995424 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5760a6a0-7300-4ed1-a006-8f23769a2c0b tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "POST /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.308161 Aug 31 17:06:53.996106 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3752/7521] 10.222.0.61 () {60 vars in 1323 bytes} [Wed Aug 31 17:06:53 2022] POST /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5/os-volume_attachments => generated 194 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:07:05.808875 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-25a4bc44-976f-42e6-96b0-9cc9318a53e2 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:07:05.811197 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-25a4bc44-976f-42e6-96b0-9cc9318a53e2 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 1c131f57-2412-4310-836c-c63e70281fd5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:07:05.814229 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:07:05.815048 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=6 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:07:05.820688 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-25a4bc44-976f-42e6-96b0-9cc9318a53e2 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:05.821198 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-25a4bc44-976f-42e6-96b0-9cc9318a53e2 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:05.821656 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-25a4bc44-976f-42e6-96b0-9cc9318a53e2 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:05.822385 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-25a4bc44-976f-42e6-96b0-9cc9318a53e2 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:05.822852 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-25a4bc44-976f-42e6-96b0-9cc9318a53e2 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:05.823324 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-25a4bc44-976f-42e6-96b0-9cc9318a53e2 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:05.866714 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-25a4bc44-976f-42e6-96b0-9cc9318a53e2 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:07:05.873880 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-25a4bc44-976f-42e6-96b0-9cc9318a53e2 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 1c131f57-2412-4310-836c-c63e70281fd5] Old instance type m1.heat2, new instance type m1.heat {{(pid=122257) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 31 17:07:05.882804 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-25a4bc44-976f-42e6-96b0-9cc9318a53e2 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 17:07:05.883247 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-25a4bc44-976f-42e6-96b0-9cc9318a53e2 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 17:07:05.883773 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-25a4bc44-976f-42e6-96b0-9cc9318a53e2 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 17:07:05.884210 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-25a4bc44-976f-42e6-96b0-9cc9318a53e2 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 17:07:05.884678 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-25a4bc44-976f-42e6-96b0-9cc9318a53e2 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 17:07:05.956774 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-25a4bc44-976f-42e6-96b0-9cc9318a53e2 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "POST /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5/action" status: 202 len: 0 microversion: 2.1 time: 0.153026 Aug 31 17:07:05.957407 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3770/7522] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 17:07:05 2022] POST /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5/action => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 17:07:05.967015 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7125e235-5345-4e64-98c2-36d67e5279e4 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:07:05.968009 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7125e235-5345-4e64-98c2-36d67e5279e4 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 1c131f57-2412-4310-836c-c63e70281fd5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:07:05.971742 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:07:05.972601 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:07:05.980640 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7125e235-5345-4e64-98c2-36d67e5279e4 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:05.981312 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7125e235-5345-4e64-98c2-36d67e5279e4 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:05.982035 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7125e235-5345-4e64-98c2-36d67e5279e4 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:05.982799 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7125e235-5345-4e64-98c2-36d67e5279e4 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:05.983318 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7125e235-5345-4e64-98c2-36d67e5279e4 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:05.983894 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7125e235-5345-4e64-98c2-36d67e5279e4 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:06.148429 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7125e235-5345-4e64-98c2-36d67e5279e4 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:07:06.158734 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7125e235-5345-4e64-98c2-36d67e5279e4 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5" status: 200 len: 1724 microversion: 2.1 time: 0.196234 Aug 31 17:07:06.159398 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3753/7523] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:07:05 2022] GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5 => generated 1724 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:07:07.184383 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-116a9b83-f9b4-4c0a-b5cd-2937ad85ca9c tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:07:07.185026 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-116a9b83-f9b4-4c0a-b5cd-2937ad85ca9c tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 1c131f57-2412-4310-836c-c63e70281fd5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:07:07.191945 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-116a9b83-f9b4-4c0a-b5cd-2937ad85ca9c tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:07.192461 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-116a9b83-f9b4-4c0a-b5cd-2937ad85ca9c tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:07.192924 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-116a9b83-f9b4-4c0a-b5cd-2937ad85ca9c tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:07.193657 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-116a9b83-f9b4-4c0a-b5cd-2937ad85ca9c tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:07.194137 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-116a9b83-f9b4-4c0a-b5cd-2937ad85ca9c tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:07.194590 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-116a9b83-f9b4-4c0a-b5cd-2937ad85ca9c tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:07.332172 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-116a9b83-f9b4-4c0a-b5cd-2937ad85ca9c tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:07:07.340758 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-116a9b83-f9b4-4c0a-b5cd-2937ad85ca9c tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5" status: 200 len: 1724 microversion: 2.1 time: 0.161250 Aug 31 17:07:07.341356 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3771/7524] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:07:07 2022] GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:07:08.363810 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c6da330f-1508-437c-bac1-54fa5ec9fa37 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:07:08.364437 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c6da330f-1508-437c-bac1-54fa5ec9fa37 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 1c131f57-2412-4310-836c-c63e70281fd5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:07:08.371575 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c6da330f-1508-437c-bac1-54fa5ec9fa37 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:08.372077 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c6da330f-1508-437c-bac1-54fa5ec9fa37 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:08.372536 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c6da330f-1508-437c-bac1-54fa5ec9fa37 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:08.373256 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c6da330f-1508-437c-bac1-54fa5ec9fa37 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:08.373723 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c6da330f-1508-437c-bac1-54fa5ec9fa37 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:08.375065 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c6da330f-1508-437c-bac1-54fa5ec9fa37 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:08.509340 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c6da330f-1508-437c-bac1-54fa5ec9fa37 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:07:08.519141 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c6da330f-1508-437c-bac1-54fa5ec9fa37 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5" status: 200 len: 1724 microversion: 2.1 time: 0.159349 Aug 31 17:07:08.519745 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3754/7525] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:07:08 2022] GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:07:09.541597 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ca9d1e71-a85b-4f90-a019-6d3c5e7b370e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:07:09.542239 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ca9d1e71-a85b-4f90-a019-6d3c5e7b370e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 1c131f57-2412-4310-836c-c63e70281fd5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:07:09.549977 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ca9d1e71-a85b-4f90-a019-6d3c5e7b370e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:09.550497 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ca9d1e71-a85b-4f90-a019-6d3c5e7b370e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:09.550967 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ca9d1e71-a85b-4f90-a019-6d3c5e7b370e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:09.551734 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ca9d1e71-a85b-4f90-a019-6d3c5e7b370e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:09.552216 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ca9d1e71-a85b-4f90-a019-6d3c5e7b370e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:09.552670 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ca9d1e71-a85b-4f90-a019-6d3c5e7b370e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:09.776670 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ca9d1e71-a85b-4f90-a019-6d3c5e7b370e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:07:09.785550 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ca9d1e71-a85b-4f90-a019-6d3c5e7b370e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5" status: 200 len: 1724 microversion: 2.1 time: 0.247938 Aug 31 17:07:09.786223 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3772/7526] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:07:09 2022] GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5 => generated 1724 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 17:07:10.807832 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6e5c2fbc-0c38-418f-a1dc-fc1e6b664ea0 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:07:10.808443 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6e5c2fbc-0c38-418f-a1dc-fc1e6b664ea0 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 1c131f57-2412-4310-836c-c63e70281fd5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:07:10.815350 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6e5c2fbc-0c38-418f-a1dc-fc1e6b664ea0 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:10.815944 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6e5c2fbc-0c38-418f-a1dc-fc1e6b664ea0 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:10.816383 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6e5c2fbc-0c38-418f-a1dc-fc1e6b664ea0 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:10.817081 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6e5c2fbc-0c38-418f-a1dc-fc1e6b664ea0 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:10.817539 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6e5c2fbc-0c38-418f-a1dc-fc1e6b664ea0 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:10.817970 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6e5c2fbc-0c38-418f-a1dc-fc1e6b664ea0 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:10.953927 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-6e5c2fbc-0c38-418f-a1dc-fc1e6b664ea0 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:07:10.965106 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6e5c2fbc-0c38-418f-a1dc-fc1e6b664ea0 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5" status: 200 len: 1729 microversion: 2.1 time: 0.161313 Aug 31 17:07:10.965686 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3755/7527] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:07:10 2022] GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:07:11.993200 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-13f52fc8-03f6-4620-ba42-f7e405e0e08b tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:07:11.993834 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-13f52fc8-03f6-4620-ba42-f7e405e0e08b tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 1c131f57-2412-4310-836c-c63e70281fd5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:07:12.001124 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-13f52fc8-03f6-4620-ba42-f7e405e0e08b tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:12.001617 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-13f52fc8-03f6-4620-ba42-f7e405e0e08b tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:12.002327 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-13f52fc8-03f6-4620-ba42-f7e405e0e08b tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:12.003041 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-13f52fc8-03f6-4620-ba42-f7e405e0e08b tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:12.003530 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-13f52fc8-03f6-4620-ba42-f7e405e0e08b tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:12.003976 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-13f52fc8-03f6-4620-ba42-f7e405e0e08b tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:12.158608 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-13f52fc8-03f6-4620-ba42-f7e405e0e08b tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:07:12.167770 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-13f52fc8-03f6-4620-ba42-f7e405e0e08b tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5" status: 200 len: 1729 microversion: 2.1 time: 0.178523 Aug 31 17:07:12.168383 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3773/7528] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:07:11 2022] GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5 => generated 1729 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:07:13.191070 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f23ef33c-9e59-4b59-b3f0-fcbca4197889 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:07:13.191729 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f23ef33c-9e59-4b59-b3f0-fcbca4197889 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 1c131f57-2412-4310-836c-c63e70281fd5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:07:13.198795 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f23ef33c-9e59-4b59-b3f0-fcbca4197889 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:13.199323 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f23ef33c-9e59-4b59-b3f0-fcbca4197889 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:13.199822 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f23ef33c-9e59-4b59-b3f0-fcbca4197889 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:13.200509 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f23ef33c-9e59-4b59-b3f0-fcbca4197889 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:13.200974 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f23ef33c-9e59-4b59-b3f0-fcbca4197889 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:13.201413 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f23ef33c-9e59-4b59-b3f0-fcbca4197889 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:13.334710 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f23ef33c-9e59-4b59-b3f0-fcbca4197889 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:07:13.343381 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f23ef33c-9e59-4b59-b3f0-fcbca4197889 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5" status: 200 len: 1729 microversion: 2.1 time: 0.156914 Aug 31 17:07:13.344006 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3756/7529] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:07:13 2022] GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5 => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:07:14.366057 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-26e0134c-6fcc-48f7-a979-f60680fa5d18 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:07:14.366675 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-26e0134c-6fcc-48f7-a979-f60680fa5d18 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 1c131f57-2412-4310-836c-c63e70281fd5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:07:14.373783 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-26e0134c-6fcc-48f7-a979-f60680fa5d18 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:14.374920 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-26e0134c-6fcc-48f7-a979-f60680fa5d18 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:14.375389 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-26e0134c-6fcc-48f7-a979-f60680fa5d18 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:14.376138 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-26e0134c-6fcc-48f7-a979-f60680fa5d18 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:14.376619 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-26e0134c-6fcc-48f7-a979-f60680fa5d18 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:14.377316 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-26e0134c-6fcc-48f7-a979-f60680fa5d18 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:14.513055 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-26e0134c-6fcc-48f7-a979-f60680fa5d18 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:07:14.522216 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-26e0134c-6fcc-48f7-a979-f60680fa5d18 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5" status: 200 len: 1729 microversion: 2.1 time: 0.160167 Aug 31 17:07:14.522811 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3774/7530] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:07:14 2022] GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:07:15.543951 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e1400839-040d-49da-824f-062863a3a5bc tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:07:15.544568 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e1400839-040d-49da-824f-062863a3a5bc tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 1c131f57-2412-4310-836c-c63e70281fd5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:07:15.551644 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e1400839-040d-49da-824f-062863a3a5bc tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:15.552137 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e1400839-040d-49da-824f-062863a3a5bc tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:15.552575 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e1400839-040d-49da-824f-062863a3a5bc tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:15.553281 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e1400839-040d-49da-824f-062863a3a5bc tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:15.553740 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e1400839-040d-49da-824f-062863a3a5bc tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:15.554165 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e1400839-040d-49da-824f-062863a3a5bc tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:15.696847 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e1400839-040d-49da-824f-062863a3a5bc tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:07:15.705889 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e1400839-040d-49da-824f-062863a3a5bc tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5" status: 200 len: 1729 microversion: 2.1 time: 0.165964 Aug 31 17:07:15.706477 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3757/7531] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:07:15 2022] GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5 => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:07:16.727182 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c7a44e49-9810-47a5-8e6e-41fac11db5a9 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:07:16.727861 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c7a44e49-9810-47a5-8e6e-41fac11db5a9 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 1c131f57-2412-4310-836c-c63e70281fd5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:07:16.735811 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c7a44e49-9810-47a5-8e6e-41fac11db5a9 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:16.736325 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c7a44e49-9810-47a5-8e6e-41fac11db5a9 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:16.736784 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c7a44e49-9810-47a5-8e6e-41fac11db5a9 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:16.737503 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c7a44e49-9810-47a5-8e6e-41fac11db5a9 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:16.737983 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c7a44e49-9810-47a5-8e6e-41fac11db5a9 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:16.738434 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c7a44e49-9810-47a5-8e6e-41fac11db5a9 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:16.871665 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c7a44e49-9810-47a5-8e6e-41fac11db5a9 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:07:16.880585 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c7a44e49-9810-47a5-8e6e-41fac11db5a9 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5" status: 200 len: 1729 microversion: 2.1 time: 0.157381 Aug 31 17:07:16.881171 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3775/7532] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:07:16 2022] GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:07:17.902523 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-083857e8-043f-4202-be72-18545f4ba97c tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:07:17.903189 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-083857e8-043f-4202-be72-18545f4ba97c tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 1c131f57-2412-4310-836c-c63e70281fd5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:07:17.910440 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-083857e8-043f-4202-be72-18545f4ba97c tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:17.910954 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-083857e8-043f-4202-be72-18545f4ba97c tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:17.911397 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-083857e8-043f-4202-be72-18545f4ba97c tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:17.912135 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-083857e8-043f-4202-be72-18545f4ba97c tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:17.912608 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-083857e8-043f-4202-be72-18545f4ba97c tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:17.913046 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-083857e8-043f-4202-be72-18545f4ba97c tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:18.052274 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-083857e8-043f-4202-be72-18545f4ba97c tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:07:18.060554 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-083857e8-043f-4202-be72-18545f4ba97c tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5" status: 200 len: 1729 microversion: 2.1 time: 0.162052 Aug 31 17:07:18.061133 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3758/7533] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:07:17 2022] GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:07:19.083128 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7dc18533-a2e4-4a88-ade3-5868ec2b6872 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:07:19.083811 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7dc18533-a2e4-4a88-ade3-5868ec2b6872 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 1c131f57-2412-4310-836c-c63e70281fd5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:07:19.090223 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7dc18533-a2e4-4a88-ade3-5868ec2b6872 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:19.090731 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7dc18533-a2e4-4a88-ade3-5868ec2b6872 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:19.091194 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7dc18533-a2e4-4a88-ade3-5868ec2b6872 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:19.091940 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7dc18533-a2e4-4a88-ade3-5868ec2b6872 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:19.092421 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7dc18533-a2e4-4a88-ade3-5868ec2b6872 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:19.093420 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7dc18533-a2e4-4a88-ade3-5868ec2b6872 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:19.222591 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7dc18533-a2e4-4a88-ade3-5868ec2b6872 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:07:19.230978 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7dc18533-a2e4-4a88-ade3-5868ec2b6872 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5" status: 200 len: 1729 microversion: 2.1 time: 0.152027 Aug 31 17:07:19.231577 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3776/7534] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:07:19 2022] GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5 => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:07:20.253740 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f5f3c245-9aba-41d1-a34a-4e7cbdc13210 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:07:20.254361 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f5f3c245-9aba-41d1-a34a-4e7cbdc13210 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 1c131f57-2412-4310-836c-c63e70281fd5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:07:20.261497 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f5f3c245-9aba-41d1-a34a-4e7cbdc13210 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:20.261993 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f5f3c245-9aba-41d1-a34a-4e7cbdc13210 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:20.262433 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f5f3c245-9aba-41d1-a34a-4e7cbdc13210 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:20.263138 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f5f3c245-9aba-41d1-a34a-4e7cbdc13210 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:20.263616 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f5f3c245-9aba-41d1-a34a-4e7cbdc13210 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:20.264054 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f5f3c245-9aba-41d1-a34a-4e7cbdc13210 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:20.409970 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f5f3c245-9aba-41d1-a34a-4e7cbdc13210 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:07:20.418759 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f5f3c245-9aba-41d1-a34a-4e7cbdc13210 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5" status: 200 len: 1729 microversion: 2.1 time: 0.169394 Aug 31 17:07:20.419725 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3759/7535] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:07:20 2022] GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5 => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:07:21.440416 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c526419e-7507-4691-a6ee-80310ee960fb tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:07:21.441003 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c526419e-7507-4691-a6ee-80310ee960fb tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 1c131f57-2412-4310-836c-c63e70281fd5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:07:21.448734 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c526419e-7507-4691-a6ee-80310ee960fb tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:21.449263 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c526419e-7507-4691-a6ee-80310ee960fb tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:21.449730 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c526419e-7507-4691-a6ee-80310ee960fb tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:21.450479 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c526419e-7507-4691-a6ee-80310ee960fb tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:21.450965 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c526419e-7507-4691-a6ee-80310ee960fb tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:21.451417 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c526419e-7507-4691-a6ee-80310ee960fb tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:21.590584 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c526419e-7507-4691-a6ee-80310ee960fb tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:07:21.599350 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c526419e-7507-4691-a6ee-80310ee960fb tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5" status: 200 len: 1729 microversion: 2.1 time: 0.163989 Aug 31 17:07:21.599975 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3777/7536] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:07:21 2022] GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5 => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:07:22.620958 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-fe6e3ca9-d05a-4005-a081-a3f17001feae tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:07:22.621583 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-fe6e3ca9-d05a-4005-a081-a3f17001feae tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 1c131f57-2412-4310-836c-c63e70281fd5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:07:22.629703 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fe6e3ca9-d05a-4005-a081-a3f17001feae tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:22.630202 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fe6e3ca9-d05a-4005-a081-a3f17001feae tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:22.630647 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fe6e3ca9-d05a-4005-a081-a3f17001feae tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:22.631354 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fe6e3ca9-d05a-4005-a081-a3f17001feae tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:22.631868 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fe6e3ca9-d05a-4005-a081-a3f17001feae tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:22.632296 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fe6e3ca9-d05a-4005-a081-a3f17001feae tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:22.763165 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-fe6e3ca9-d05a-4005-a081-a3f17001feae tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:07:22.771783 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-fe6e3ca9-d05a-4005-a081-a3f17001feae tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5" status: 200 len: 1729 microversion: 2.1 time: 0.154793 Aug 31 17:07:22.772388 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3760/7537] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:07:22 2022] GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:07:23.794100 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ed758664-3872-4603-b73b-7cfdb7e0c994 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:07:23.794727 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ed758664-3872-4603-b73b-7cfdb7e0c994 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 1c131f57-2412-4310-836c-c63e70281fd5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:07:23.801660 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ed758664-3872-4603-b73b-7cfdb7e0c994 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:23.802162 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ed758664-3872-4603-b73b-7cfdb7e0c994 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:23.802617 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ed758664-3872-4603-b73b-7cfdb7e0c994 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:23.803320 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ed758664-3872-4603-b73b-7cfdb7e0c994 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:23.803822 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ed758664-3872-4603-b73b-7cfdb7e0c994 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:23.804267 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ed758664-3872-4603-b73b-7cfdb7e0c994 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:23.941189 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ed758664-3872-4603-b73b-7cfdb7e0c994 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:07:23.949643 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ed758664-3872-4603-b73b-7cfdb7e0c994 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5" status: 200 len: 1729 microversion: 2.1 time: 0.159621 Aug 31 17:07:23.950227 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3778/7538] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:07:23 2022] GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:07:24.971972 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4f6f2b1e-343b-4079-95fe-771306701f7b tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:07:24.972625 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4f6f2b1e-343b-4079-95fe-771306701f7b tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 1c131f57-2412-4310-836c-c63e70281fd5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:07:24.979617 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4f6f2b1e-343b-4079-95fe-771306701f7b tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:24.980126 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4f6f2b1e-343b-4079-95fe-771306701f7b tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:24.980573 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4f6f2b1e-343b-4079-95fe-771306701f7b tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:24.981282 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4f6f2b1e-343b-4079-95fe-771306701f7b tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:24.981763 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4f6f2b1e-343b-4079-95fe-771306701f7b tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:24.982186 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4f6f2b1e-343b-4079-95fe-771306701f7b tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:25.116051 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-4f6f2b1e-343b-4079-95fe-771306701f7b tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:07:25.124343 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4f6f2b1e-343b-4079-95fe-771306701f7b tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5" status: 200 len: 1729 microversion: 2.1 time: 0.157096 Aug 31 17:07:25.125471 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3761/7539] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:07:24 2022] GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:07:26.148449 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e730ca96-8024-46db-aa60-91e24f0041fb tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:07:26.149138 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e730ca96-8024-46db-aa60-91e24f0041fb tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 1c131f57-2412-4310-836c-c63e70281fd5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:07:26.157116 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e730ca96-8024-46db-aa60-91e24f0041fb tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:26.157632 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e730ca96-8024-46db-aa60-91e24f0041fb tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:26.158088 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e730ca96-8024-46db-aa60-91e24f0041fb tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:26.158819 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e730ca96-8024-46db-aa60-91e24f0041fb tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:26.159302 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e730ca96-8024-46db-aa60-91e24f0041fb tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:26.159771 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e730ca96-8024-46db-aa60-91e24f0041fb tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:26.297687 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e730ca96-8024-46db-aa60-91e24f0041fb tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:07:26.306340 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e730ca96-8024-46db-aa60-91e24f0041fb tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5" status: 200 len: 1729 microversion: 2.1 time: 0.162961 Aug 31 17:07:26.306863 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3779/7540] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:07:26 2022] GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5 => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:07:27.328395 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b4462f0d-d0dc-45d1-b1c6-27985f312783 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:07:27.329032 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b4462f0d-d0dc-45d1-b1c6-27985f312783 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 1c131f57-2412-4310-836c-c63e70281fd5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:07:27.336051 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b4462f0d-d0dc-45d1-b1c6-27985f312783 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:27.336502 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b4462f0d-d0dc-45d1-b1c6-27985f312783 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:27.336952 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b4462f0d-d0dc-45d1-b1c6-27985f312783 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:27.337664 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b4462f0d-d0dc-45d1-b1c6-27985f312783 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:27.338134 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b4462f0d-d0dc-45d1-b1c6-27985f312783 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:27.338574 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b4462f0d-d0dc-45d1-b1c6-27985f312783 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:27.472902 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b4462f0d-d0dc-45d1-b1c6-27985f312783 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:07:27.481769 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b4462f0d-d0dc-45d1-b1c6-27985f312783 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5" status: 200 len: 1729 microversion: 2.1 time: 0.157890 Aug 31 17:07:27.482368 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3762/7541] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:07:27 2022] GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:07:28.503815 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7912f1af-7c5a-41fc-8702-4531bf2138df tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:07:28.504454 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7912f1af-7c5a-41fc-8702-4531bf2138df tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 1c131f57-2412-4310-836c-c63e70281fd5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:07:28.511593 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7912f1af-7c5a-41fc-8702-4531bf2138df tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:28.512102 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7912f1af-7c5a-41fc-8702-4531bf2138df tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:28.512564 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7912f1af-7c5a-41fc-8702-4531bf2138df tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:28.513283 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7912f1af-7c5a-41fc-8702-4531bf2138df tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:28.513761 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7912f1af-7c5a-41fc-8702-4531bf2138df tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:28.514208 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7912f1af-7c5a-41fc-8702-4531bf2138df tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:28.651050 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7912f1af-7c5a-41fc-8702-4531bf2138df tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:07:28.660335 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7912f1af-7c5a-41fc-8702-4531bf2138df tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5" status: 200 len: 1729 microversion: 2.1 time: 0.160820 Aug 31 17:07:28.660949 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3780/7542] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:07:28 2022] GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:07:29.682070 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-64c5e902-5573-4b29-90bb-5a8a4eb7960f tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:07:29.682688 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-64c5e902-5573-4b29-90bb-5a8a4eb7960f tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 1c131f57-2412-4310-836c-c63e70281fd5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:07:29.690487 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-64c5e902-5573-4b29-90bb-5a8a4eb7960f tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:29.690980 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-64c5e902-5573-4b29-90bb-5a8a4eb7960f tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:29.691423 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-64c5e902-5573-4b29-90bb-5a8a4eb7960f tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:29.692158 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-64c5e902-5573-4b29-90bb-5a8a4eb7960f tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:29.692620 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-64c5e902-5573-4b29-90bb-5a8a4eb7960f tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:29.693053 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-64c5e902-5573-4b29-90bb-5a8a4eb7960f tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:29.839379 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-64c5e902-5573-4b29-90bb-5a8a4eb7960f tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:07:29.848212 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-64c5e902-5573-4b29-90bb-5a8a4eb7960f tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5" status: 200 len: 1729 microversion: 2.1 time: 0.170127 Aug 31 17:07:29.848821 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3763/7543] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:07:29 2022] GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5 => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:07:30.869215 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f1c000db-4432-49e7-a396-6b2ad8d48c7e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:07:30.869845 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f1c000db-4432-49e7-a396-6b2ad8d48c7e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 1c131f57-2412-4310-836c-c63e70281fd5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:07:30.876699 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f1c000db-4432-49e7-a396-6b2ad8d48c7e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:30.878141 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f1c000db-4432-49e7-a396-6b2ad8d48c7e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:30.878604 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f1c000db-4432-49e7-a396-6b2ad8d48c7e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:30.879316 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f1c000db-4432-49e7-a396-6b2ad8d48c7e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:30.879811 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f1c000db-4432-49e7-a396-6b2ad8d48c7e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:30.880256 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f1c000db-4432-49e7-a396-6b2ad8d48c7e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:31.011330 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f1c000db-4432-49e7-a396-6b2ad8d48c7e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:07:31.020196 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f1c000db-4432-49e7-a396-6b2ad8d48c7e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5" status: 200 len: 1729 microversion: 2.1 time: 0.154982 Aug 31 17:07:31.020793 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3781/7544] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:07:30 2022] GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:07:32.042254 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c664bb6e-307c-409a-8115-85892981b49e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:07:32.042868 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c664bb6e-307c-409a-8115-85892981b49e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 1c131f57-2412-4310-836c-c63e70281fd5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:07:32.050557 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c664bb6e-307c-409a-8115-85892981b49e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:32.051047 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c664bb6e-307c-409a-8115-85892981b49e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:32.051491 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c664bb6e-307c-409a-8115-85892981b49e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:32.052213 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c664bb6e-307c-409a-8115-85892981b49e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:32.052671 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c664bb6e-307c-409a-8115-85892981b49e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:32.053099 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c664bb6e-307c-409a-8115-85892981b49e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:32.189813 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c664bb6e-307c-409a-8115-85892981b49e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:07:32.197802 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c664bb6e-307c-409a-8115-85892981b49e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5" status: 200 len: 1729 microversion: 2.1 time: 0.159496 Aug 31 17:07:32.198438 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3764/7545] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:07:32 2022] GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:07:33.219443 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c31cc8e0-fde2-4d15-955c-b50aec417281 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:07:33.220118 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c31cc8e0-fde2-4d15-955c-b50aec417281 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 1c131f57-2412-4310-836c-c63e70281fd5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:07:33.228132 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c31cc8e0-fde2-4d15-955c-b50aec417281 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:33.228650 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c31cc8e0-fde2-4d15-955c-b50aec417281 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:33.229110 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c31cc8e0-fde2-4d15-955c-b50aec417281 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:33.229844 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c31cc8e0-fde2-4d15-955c-b50aec417281 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:33.230324 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c31cc8e0-fde2-4d15-955c-b50aec417281 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:33.230774 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c31cc8e0-fde2-4d15-955c-b50aec417281 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:33.368418 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c31cc8e0-fde2-4d15-955c-b50aec417281 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:07:33.377395 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c31cc8e0-fde2-4d15-955c-b50aec417281 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5" status: 200 len: 1729 microversion: 2.1 time: 0.161588 Aug 31 17:07:33.377968 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3782/7546] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:07:33 2022] GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:07:34.399199 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c7ec99af-9996-46fd-bd1e-4a86fbbf287b tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:07:34.399808 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c7ec99af-9996-46fd-bd1e-4a86fbbf287b tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 1c131f57-2412-4310-836c-c63e70281fd5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:07:34.407169 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c7ec99af-9996-46fd-bd1e-4a86fbbf287b tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:34.407709 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c7ec99af-9996-46fd-bd1e-4a86fbbf287b tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:34.408873 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c7ec99af-9996-46fd-bd1e-4a86fbbf287b tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:34.409758 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c7ec99af-9996-46fd-bd1e-4a86fbbf287b tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:34.410228 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c7ec99af-9996-46fd-bd1e-4a86fbbf287b tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:34.410716 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c7ec99af-9996-46fd-bd1e-4a86fbbf287b tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:34.623619 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c7ec99af-9996-46fd-bd1e-4a86fbbf287b tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:07:34.632549 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c7ec99af-9996-46fd-bd1e-4a86fbbf287b tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5" status: 200 len: 1728 microversion: 2.1 time: 0.237454 Aug 31 17:07:34.633138 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3765/7547] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:07:34 2022] GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5 => generated 1728 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:07:34.918966 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-bcb5cd08-a357-4cb1-b910-4d1ea4e28bb7 req-dc2eca56-f287-40b7-8019-09d796181011 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c131f57-2412-4310-836c-c63e70281fd5", "name": "network-vif-unplugged", "status": "completed", "tag": "df0eec12-64b7-45d6-b90c-30c4b3636221"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:07:34.930044 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-bcb5cd08-a357-4cb1-b910-4d1ea4e28bb7 req-dc2eca56-f287-40b7-8019-09d796181011 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:34.930552 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-bcb5cd08-a357-4cb1-b910-4d1ea4e28bb7 req-dc2eca56-f287-40b7-8019-09d796181011 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:34.931012 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-bcb5cd08-a357-4cb1-b910-4d1ea4e28bb7 req-dc2eca56-f287-40b7-8019-09d796181011 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:34.943295 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-bcb5cd08-a357-4cb1-b910-4d1ea4e28bb7 req-dc2eca56-f287-40b7-8019-09d796181011 service nova] Creating event network-vif-unplugged:df0eec12-64b7-45d6-b90c-30c4b3636221 for instance 1c131f57-2412-4310-836c-c63e70281fd5 on n-h1-850499-9 Aug 31 17:07:34.948972 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [req-bcb5cd08-a357-4cb1-b910-4d1ea4e28bb7 req-dc2eca56-f287-40b7-8019-09d796181011 service nova] Instance 1c131f57-2412-4310-836c-c63e70281fd5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850499-9', 'n-h2-850499-9'} {{(pid=122257) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 31 17:07:34.961877 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-bcb5cd08-a357-4cb1-b910-4d1ea4e28bb7 req-dc2eca56-f287-40b7-8019-09d796181011 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.105935 Aug 31 17:07:34.962808 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3783/7548] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:07:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:07:35.654707 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-958dfa3f-a6f6-47b2-9ef3-9a7b498ded98 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:07:35.655332 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-958dfa3f-a6f6-47b2-9ef3-9a7b498ded98 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 1c131f57-2412-4310-836c-c63e70281fd5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:07:35.662564 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-958dfa3f-a6f6-47b2-9ef3-9a7b498ded98 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:35.663071 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-958dfa3f-a6f6-47b2-9ef3-9a7b498ded98 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:35.663540 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-958dfa3f-a6f6-47b2-9ef3-9a7b498ded98 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:35.664257 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-958dfa3f-a6f6-47b2-9ef3-9a7b498ded98 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:35.664730 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-958dfa3f-a6f6-47b2-9ef3-9a7b498ded98 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:35.665170 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-958dfa3f-a6f6-47b2-9ef3-9a7b498ded98 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:35.889591 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-958dfa3f-a6f6-47b2-9ef3-9a7b498ded98 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:07:35.898979 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-958dfa3f-a6f6-47b2-9ef3-9a7b498ded98 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5" status: 200 len: 1728 microversion: 2.1 time: 0.247962 Aug 31 17:07:35.899248 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3766/7549] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:07:35 2022] GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5 => generated 1728 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:07:36.921391 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3e8da23d-0669-4c3c-a397-5cf1bdfc1f58 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:07:36.922109 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3e8da23d-0669-4c3c-a397-5cf1bdfc1f58 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 1c131f57-2412-4310-836c-c63e70281fd5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:07:36.925116 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=33 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:07:36.930541 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3e8da23d-0669-4c3c-a397-5cf1bdfc1f58 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:36.931048 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3e8da23d-0669-4c3c-a397-5cf1bdfc1f58 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:36.931523 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3e8da23d-0669-4c3c-a397-5cf1bdfc1f58 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:36.932494 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3e8da23d-0669-4c3c-a397-5cf1bdfc1f58 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:36.932873 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3e8da23d-0669-4c3c-a397-5cf1bdfc1f58 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:36.933317 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3e8da23d-0669-4c3c-a397-5cf1bdfc1f58 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:36.936385 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:07:36.981162 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-92543afd-f1d5-4022-9c5f-de3bfc859509 req-07161f96-f4ac-4051-9667-576edae9ca50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c131f57-2412-4310-836c-c63e70281fd5", "tag": "df0eec12-64b7-45d6-b90c-30c4b3636221"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:07:36.988629 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=29 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:07:36.992764 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-92543afd-f1d5-4022-9c5f-de3bfc859509 req-07161f96-f4ac-4051-9667-576edae9ca50 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:36.993251 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-92543afd-f1d5-4022-9c5f-de3bfc859509 req-07161f96-f4ac-4051-9667-576edae9ca50 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:36.993685 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-92543afd-f1d5-4022-9c5f-de3bfc859509 req-07161f96-f4ac-4051-9667-576edae9ca50 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:36.998331 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=85 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:07:37.008250 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-92543afd-f1d5-4022-9c5f-de3bfc859509 req-07161f96-f4ac-4051-9667-576edae9ca50 service nova] Creating event network-changed:df0eec12-64b7-45d6-b90c-30c4b3636221 for instance 1c131f57-2412-4310-836c-c63e70281fd5 on n-h1-850499-9 Aug 31 17:07:37.014967 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [req-92543afd-f1d5-4022-9c5f-de3bfc859509 req-07161f96-f4ac-4051-9667-576edae9ca50 service nova] Instance 1c131f57-2412-4310-836c-c63e70281fd5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850499-9', 'n-h2-850499-9'} {{(pid=122256) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 31 17:07:37.027748 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-92543afd-f1d5-4022-9c5f-de3bfc859509 req-07161f96-f4ac-4051-9667-576edae9ca50 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050284 Aug 31 17:07:37.028731 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3767/7550] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:07:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 17:07:37.110713 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3e8da23d-0669-4c3c-a397-5cf1bdfc1f58 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:07:37.120068 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3e8da23d-0669-4c3c-a397-5cf1bdfc1f58 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5" status: 200 len: 1726 microversion: 2.1 time: 0.203239 Aug 31 17:07:37.121064 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3784/7551] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:07:36 2022] GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5 => generated 1726 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:07:38.147231 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1471087a-7ff7-4443-a119-40760e3a6a41 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:07:38.148182 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1471087a-7ff7-4443-a119-40760e3a6a41 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 1c131f57-2412-4310-836c-c63e70281fd5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:07:38.157651 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1471087a-7ff7-4443-a119-40760e3a6a41 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:38.159153 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1471087a-7ff7-4443-a119-40760e3a6a41 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:38.159924 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1471087a-7ff7-4443-a119-40760e3a6a41 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:38.160842 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1471087a-7ff7-4443-a119-40760e3a6a41 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:38.161315 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1471087a-7ff7-4443-a119-40760e3a6a41 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:38.161759 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1471087a-7ff7-4443-a119-40760e3a6a41 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:38.316615 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1471087a-7ff7-4443-a119-40760e3a6a41 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:07:38.328256 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1471087a-7ff7-4443-a119-40760e3a6a41 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5" status: 200 len: 1726 microversion: 2.1 time: 0.187293 Aug 31 17:07:38.328858 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3768/7552] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:07:38 2022] GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5 => generated 1726 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:07:39.353723 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3f9d2d0c-af0b-458f-8942-b3fb26e1e68f tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:07:39.354372 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3f9d2d0c-af0b-458f-8942-b3fb26e1e68f tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 1c131f57-2412-4310-836c-c63e70281fd5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:07:39.363178 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3f9d2d0c-af0b-458f-8942-b3fb26e1e68f tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:39.363732 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3f9d2d0c-af0b-458f-8942-b3fb26e1e68f tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:39.364201 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3f9d2d0c-af0b-458f-8942-b3fb26e1e68f tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:39.364952 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3f9d2d0c-af0b-458f-8942-b3fb26e1e68f tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:39.365440 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3f9d2d0c-af0b-458f-8942-b3fb26e1e68f tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:39.365902 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3f9d2d0c-af0b-458f-8942-b3fb26e1e68f tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:39.509373 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3f9d2d0c-af0b-458f-8942-b3fb26e1e68f tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:07:39.518308 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3f9d2d0c-af0b-458f-8942-b3fb26e1e68f tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5" status: 200 len: 1726 microversion: 2.1 time: 0.168337 Aug 31 17:07:39.518908 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3785/7553] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:07:39 2022] GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5 => generated 1726 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:07:40.539803 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-515b6c6c-894d-4d81-8707-03d98f909f75 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:07:40.540424 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-515b6c6c-894d-4d81-8707-03d98f909f75 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 1c131f57-2412-4310-836c-c63e70281fd5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:07:40.547735 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-515b6c6c-894d-4d81-8707-03d98f909f75 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:40.548233 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-515b6c6c-894d-4d81-8707-03d98f909f75 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:40.549446 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-515b6c6c-894d-4d81-8707-03d98f909f75 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:40.550172 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-515b6c6c-894d-4d81-8707-03d98f909f75 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:40.550640 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-515b6c6c-894d-4d81-8707-03d98f909f75 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:40.551077 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-515b6c6c-894d-4d81-8707-03d98f909f75 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:40.694732 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-515b6c6c-894d-4d81-8707-03d98f909f75 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:07:40.703530 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-515b6c6c-894d-4d81-8707-03d98f909f75 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5" status: 200 len: 1726 microversion: 2.1 time: 0.167594 Aug 31 17:07:40.704196 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3769/7554] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:07:40 2022] GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5 => generated 1726 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:07:41.725966 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-cd6f82bb-b8b2-4263-b8cb-2e01919708f9 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:07:41.726594 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-cd6f82bb-b8b2-4263-b8cb-2e01919708f9 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 1c131f57-2412-4310-836c-c63e70281fd5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:07:41.733488 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cd6f82bb-b8b2-4263-b8cb-2e01919708f9 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:41.733986 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cd6f82bb-b8b2-4263-b8cb-2e01919708f9 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:41.734435 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cd6f82bb-b8b2-4263-b8cb-2e01919708f9 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:41.735136 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cd6f82bb-b8b2-4263-b8cb-2e01919708f9 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:41.735635 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cd6f82bb-b8b2-4263-b8cb-2e01919708f9 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:41.736762 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cd6f82bb-b8b2-4263-b8cb-2e01919708f9 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:41.879481 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-cd6f82bb-b8b2-4263-b8cb-2e01919708f9 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:07:41.889565 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-cd6f82bb-b8b2-4263-b8cb-2e01919708f9 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5" status: 200 len: 1726 microversion: 2.1 time: 0.167413 Aug 31 17:07:41.890178 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3786/7555] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:07:41 2022] GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5 => generated 1726 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:07:42.911690 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-12436fa2-fff9-4d0f-88e4-c71a93fbc8b3 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:07:42.912372 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-12436fa2-fff9-4d0f-88e4-c71a93fbc8b3 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 1c131f57-2412-4310-836c-c63e70281fd5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:07:42.919270 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-12436fa2-fff9-4d0f-88e4-c71a93fbc8b3 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:42.919805 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-12436fa2-fff9-4d0f-88e4-c71a93fbc8b3 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:42.920254 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-12436fa2-fff9-4d0f-88e4-c71a93fbc8b3 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:42.920959 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-12436fa2-fff9-4d0f-88e4-c71a93fbc8b3 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:42.921430 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-12436fa2-fff9-4d0f-88e4-c71a93fbc8b3 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:42.921869 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-12436fa2-fff9-4d0f-88e4-c71a93fbc8b3 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:43.057032 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-12436fa2-fff9-4d0f-88e4-c71a93fbc8b3 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:07:43.066219 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-12436fa2-fff9-4d0f-88e4-c71a93fbc8b3 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5" status: 200 len: 1726 microversion: 2.1 time: 0.158699 Aug 31 17:07:43.066813 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3770/7556] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:07:42 2022] GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5 => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:07:44.087492 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c6599691-f32e-4f3b-868c-72ed5ce10e5a tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:07:44.088056 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c6599691-f32e-4f3b-868c-72ed5ce10e5a tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 1c131f57-2412-4310-836c-c63e70281fd5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:07:44.094926 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c6599691-f32e-4f3b-868c-72ed5ce10e5a tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:44.095439 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c6599691-f32e-4f3b-868c-72ed5ce10e5a tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:44.097005 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c6599691-f32e-4f3b-868c-72ed5ce10e5a tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:44.097778 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c6599691-f32e-4f3b-868c-72ed5ce10e5a tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:44.098268 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c6599691-f32e-4f3b-868c-72ed5ce10e5a tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:44.098724 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c6599691-f32e-4f3b-868c-72ed5ce10e5a tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:44.236359 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c6599691-f32e-4f3b-868c-72ed5ce10e5a tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:07:44.244847 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c6599691-f32e-4f3b-868c-72ed5ce10e5a tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5" status: 200 len: 1726 microversion: 2.1 time: 0.161364 Aug 31 17:07:44.245485 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3787/7557] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:07:44 2022] GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5 => generated 1726 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:07:45.267641 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f886e325-2e38-4eaf-a19c-22ac6f4ae5ed tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:07:45.268235 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f886e325-2e38-4eaf-a19c-22ac6f4ae5ed tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 1c131f57-2412-4310-836c-c63e70281fd5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:07:45.275162 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f886e325-2e38-4eaf-a19c-22ac6f4ae5ed tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:45.275703 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f886e325-2e38-4eaf-a19c-22ac6f4ae5ed tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:45.276149 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f886e325-2e38-4eaf-a19c-22ac6f4ae5ed tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:45.276857 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f886e325-2e38-4eaf-a19c-22ac6f4ae5ed tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:45.277327 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f886e325-2e38-4eaf-a19c-22ac6f4ae5ed tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:45.277813 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f886e325-2e38-4eaf-a19c-22ac6f4ae5ed tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:45.424591 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f886e325-2e38-4eaf-a19c-22ac6f4ae5ed tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:07:45.433247 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f886e325-2e38-4eaf-a19c-22ac6f4ae5ed tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5" status: 200 len: 1726 microversion: 2.1 time: 0.169599 Aug 31 17:07:45.433849 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3771/7558] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:07:45 2022] GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5 => generated 1726 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:07:46.454507 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7ea6e28d-0033-4cfe-8d88-0e365cb48077 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:07:46.456038 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7ea6e28d-0033-4cfe-8d88-0e365cb48077 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 1c131f57-2412-4310-836c-c63e70281fd5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:07:46.462862 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7ea6e28d-0033-4cfe-8d88-0e365cb48077 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:46.463371 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7ea6e28d-0033-4cfe-8d88-0e365cb48077 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:46.463862 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7ea6e28d-0033-4cfe-8d88-0e365cb48077 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:46.464582 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7ea6e28d-0033-4cfe-8d88-0e365cb48077 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:46.465057 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7ea6e28d-0033-4cfe-8d88-0e365cb48077 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:46.465503 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7ea6e28d-0033-4cfe-8d88-0e365cb48077 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:46.602517 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7ea6e28d-0033-4cfe-8d88-0e365cb48077 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:07:46.610936 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7ea6e28d-0033-4cfe-8d88-0e365cb48077 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5" status: 200 len: 1726 microversion: 2.1 time: 0.160512 Aug 31 17:07:46.612243 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3788/7559] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:07:46 2022] GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5 => generated 1726 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:07:47.633793 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-95915f2e-f219-437e-97c8-ee85e3bac4a6 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:07:47.634405 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-95915f2e-f219-437e-97c8-ee85e3bac4a6 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 1c131f57-2412-4310-836c-c63e70281fd5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:07:47.641799 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-95915f2e-f219-437e-97c8-ee85e3bac4a6 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:47.642298 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-95915f2e-f219-437e-97c8-ee85e3bac4a6 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:47.642793 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-95915f2e-f219-437e-97c8-ee85e3bac4a6 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:47.643515 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-95915f2e-f219-437e-97c8-ee85e3bac4a6 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:47.643986 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-95915f2e-f219-437e-97c8-ee85e3bac4a6 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:47.644423 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-95915f2e-f219-437e-97c8-ee85e3bac4a6 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:47.782617 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-95915f2e-f219-437e-97c8-ee85e3bac4a6 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:07:47.791778 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-95915f2e-f219-437e-97c8-ee85e3bac4a6 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5" status: 200 len: 1726 microversion: 2.1 time: 0.162002 Aug 31 17:07:47.792377 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3772/7560] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:07:47 2022] GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5 => generated 1726 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 17:07:48.815093 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4138c370-0795-4b02-a0ef-ff910bc2299c tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:07:48.815848 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4138c370-0795-4b02-a0ef-ff910bc2299c tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 1c131f57-2412-4310-836c-c63e70281fd5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:07:48.822162 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4138c370-0795-4b02-a0ef-ff910bc2299c tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:48.822673 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4138c370-0795-4b02-a0ef-ff910bc2299c tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:48.823138 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4138c370-0795-4b02-a0ef-ff910bc2299c tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:48.823887 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4138c370-0795-4b02-a0ef-ff910bc2299c tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:48.824372 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4138c370-0795-4b02-a0ef-ff910bc2299c tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:48.824824 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4138c370-0795-4b02-a0ef-ff910bc2299c tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:48.954643 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-4138c370-0795-4b02-a0ef-ff910bc2299c tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:07:48.963996 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4138c370-0795-4b02-a0ef-ff910bc2299c tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5" status: 200 len: 1726 microversion: 2.1 time: 0.153493 Aug 31 17:07:48.964594 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3789/7561] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:07:48 2022] GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5 => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:07:49.986279 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-dab69a10-eb80-474e-92ec-b8bfaaa84190 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:07:49.986919 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-dab69a10-eb80-474e-92ec-b8bfaaa84190 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 1c131f57-2412-4310-836c-c63e70281fd5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:07:49.993866 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dab69a10-eb80-474e-92ec-b8bfaaa84190 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:49.994366 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dab69a10-eb80-474e-92ec-b8bfaaa84190 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:49.994828 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dab69a10-eb80-474e-92ec-b8bfaaa84190 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:49.995543 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dab69a10-eb80-474e-92ec-b8bfaaa84190 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:49.996103 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dab69a10-eb80-474e-92ec-b8bfaaa84190 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:49.996542 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dab69a10-eb80-474e-92ec-b8bfaaa84190 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:50.137969 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-dab69a10-eb80-474e-92ec-b8bfaaa84190 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:07:50.146599 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-dab69a10-eb80-474e-92ec-b8bfaaa84190 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5" status: 200 len: 1726 microversion: 2.1 time: 0.164305 Aug 31 17:07:50.147179 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3773/7562] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:07:49 2022] GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5 => generated 1726 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:07:51.168947 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-33b61056-6096-4f3a-ac0d-e4a873f25904 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:07:51.169615 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-33b61056-6096-4f3a-ac0d-e4a873f25904 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 1c131f57-2412-4310-836c-c63e70281fd5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:07:51.177292 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-33b61056-6096-4f3a-ac0d-e4a873f25904 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:51.178002 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-33b61056-6096-4f3a-ac0d-e4a873f25904 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:51.178680 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-33b61056-6096-4f3a-ac0d-e4a873f25904 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:51.179932 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-33b61056-6096-4f3a-ac0d-e4a873f25904 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:51.180783 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-33b61056-6096-4f3a-ac0d-e4a873f25904 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:51.181254 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-33b61056-6096-4f3a-ac0d-e4a873f25904 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:51.317813 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-33b61056-6096-4f3a-ac0d-e4a873f25904 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:07:51.326113 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-33b61056-6096-4f3a-ac0d-e4a873f25904 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5" status: 200 len: 1723 microversion: 2.1 time: 0.162200 Aug 31 17:07:51.326692 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3790/7563] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:07:51 2022] GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:07:51.348484 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4bd583ea-b700-4a17-b17e-cb5eaf1e46ef tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:07:51.349046 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4bd583ea-b700-4a17-b17e-cb5eaf1e46ef tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 1c131f57-2412-4310-836c-c63e70281fd5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:07:51.356197 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4bd583ea-b700-4a17-b17e-cb5eaf1e46ef tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:51.356699 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4bd583ea-b700-4a17-b17e-cb5eaf1e46ef tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:51.357146 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4bd583ea-b700-4a17-b17e-cb5eaf1e46ef tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:51.357854 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4bd583ea-b700-4a17-b17e-cb5eaf1e46ef tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:51.358329 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4bd583ea-b700-4a17-b17e-cb5eaf1e46ef tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:51.358768 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4bd583ea-b700-4a17-b17e-cb5eaf1e46ef tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:51.397851 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4bd583ea-b700-4a17-b17e-cb5eaf1e46ef tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:51.398349 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4bd583ea-b700-4a17-b17e-cb5eaf1e46ef tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:51.398802 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4bd583ea-b700-4a17-b17e-cb5eaf1e46ef tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:51.399572 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4bd583ea-b700-4a17-b17e-cb5eaf1e46ef tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:51.400036 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4bd583ea-b700-4a17-b17e-cb5eaf1e46ef tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:51.400466 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4bd583ea-b700-4a17-b17e-cb5eaf1e46ef tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:51.422353 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-4bd583ea-b700-4a17-b17e-cb5eaf1e46ef tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Getting quotas for project f38fad62a33848c59db3d09c5c9788cc. Resources: {'ram', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 17:07:51.428237 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-4bd583ea-b700-4a17-b17e-cb5eaf1e46ef tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Getting quotas for user a3e98ea428604e7da092d46e865cfe1d and project f38fad62a33848c59db3d09c5c9788cc. Resources: {'ram', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 17:07:51.530474 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4bd583ea-b700-4a17-b17e-cb5eaf1e46ef tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "POST /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5/action" status: 202 len: 0 microversion: 2.1 time: 0.186497 Aug 31 17:07:51.531123 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3774/7564] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 17:07:51 2022] POST /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5/action => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 17:07:51.539881 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ca7e6106-af59-404f-b8b4-fb41c92a2b8d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:07:51.540512 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ca7e6106-af59-404f-b8b4-fb41c92a2b8d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 1c131f57-2412-4310-836c-c63e70281fd5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:07:51.547120 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ca7e6106-af59-404f-b8b4-fb41c92a2b8d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:51.547619 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ca7e6106-af59-404f-b8b4-fb41c92a2b8d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:51.548056 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ca7e6106-af59-404f-b8b4-fb41c92a2b8d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:51.549434 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ca7e6106-af59-404f-b8b4-fb41c92a2b8d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:51.549993 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ca7e6106-af59-404f-b8b4-fb41c92a2b8d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:51.550447 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ca7e6106-af59-404f-b8b4-fb41c92a2b8d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:51.763917 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ca7e6106-af59-404f-b8b4-fb41c92a2b8d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:07:51.772783 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ca7e6106-af59-404f-b8b4-fb41c92a2b8d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5" status: 200 len: 1722 microversion: 2.1 time: 0.236792 Aug 31 17:07:51.773392 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3791/7565] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:07:51 2022] GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5 => generated 1722 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:07:52.795729 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-21a0ef4b-286e-4c62-abde-1b0babc77812 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:07:52.796461 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-21a0ef4b-286e-4c62-abde-1b0babc77812 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 1c131f57-2412-4310-836c-c63e70281fd5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:07:52.804410 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-21a0ef4b-286e-4c62-abde-1b0babc77812 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:52.804895 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-21a0ef4b-286e-4c62-abde-1b0babc77812 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:52.805331 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-21a0ef4b-286e-4c62-abde-1b0babc77812 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:52.806018 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-21a0ef4b-286e-4c62-abde-1b0babc77812 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:52.806472 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-21a0ef4b-286e-4c62-abde-1b0babc77812 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:52.806897 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-21a0ef4b-286e-4c62-abde-1b0babc77812 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:52.942385 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-21a0ef4b-286e-4c62-abde-1b0babc77812 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:07:52.950775 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-21a0ef4b-286e-4c62-abde-1b0babc77812 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5" status: 200 len: 1722 microversion: 2.1 time: 0.160218 Aug 31 17:07:52.951351 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3775/7566] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:07:52 2022] GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:07:53.864857 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-0d99de1a-b624-40b3-a981-947b55ca52b0 req-f9c094b7-f62b-4f33-ba9d-ffeff928b440 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c131f57-2412-4310-836c-c63e70281fd5", "name": "network-vif-plugged", "status": "completed", "tag": "df0eec12-64b7-45d6-b90c-30c4b3636221"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:07:53.880612 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-0d99de1a-b624-40b3-a981-947b55ca52b0 req-f9c094b7-f62b-4f33-ba9d-ffeff928b440 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:53.881253 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-0d99de1a-b624-40b3-a981-947b55ca52b0 req-f9c094b7-f62b-4f33-ba9d-ffeff928b440 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:53.881720 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-0d99de1a-b624-40b3-a981-947b55ca52b0 req-f9c094b7-f62b-4f33-ba9d-ffeff928b440 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:53.895328 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-0d99de1a-b624-40b3-a981-947b55ca52b0 req-f9c094b7-f62b-4f33-ba9d-ffeff928b440 service nova] Creating event network-vif-plugged:df0eec12-64b7-45d6-b90c-30c4b3636221 for instance 1c131f57-2412-4310-836c-c63e70281fd5 on n-h1-850499-9 Aug 31 17:07:53.900945 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [req-0d99de1a-b624-40b3-a981-947b55ca52b0 req-f9c094b7-f62b-4f33-ba9d-ffeff928b440 service nova] Instance 1c131f57-2412-4310-836c-c63e70281fd5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850499-9', 'n-h2-850499-9'} {{(pid=122257) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 31 17:07:53.914820 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-0d99de1a-b624-40b3-a981-947b55ca52b0 req-f9c094b7-f62b-4f33-ba9d-ffeff928b440 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053848 Aug 31 17:07:53.915442 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3792/7567] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:07:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:07:53.973451 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f64853a9-370f-449e-83c5-7a831e141c6d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:07:53.974109 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f64853a9-370f-449e-83c5-7a831e141c6d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 1c131f57-2412-4310-836c-c63e70281fd5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:07:53.981190 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f64853a9-370f-449e-83c5-7a831e141c6d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:53.981685 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f64853a9-370f-449e-83c5-7a831e141c6d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:53.982132 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f64853a9-370f-449e-83c5-7a831e141c6d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:53.982834 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f64853a9-370f-449e-83c5-7a831e141c6d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:53.983298 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f64853a9-370f-449e-83c5-7a831e141c6d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:53.983828 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f64853a9-370f-449e-83c5-7a831e141c6d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:54.121504 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f64853a9-370f-449e-83c5-7a831e141c6d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:07:54.130673 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f64853a9-370f-449e-83c5-7a831e141c6d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5" status: 200 len: 1722 microversion: 2.1 time: 0.162155 Aug 31 17:07:54.131249 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3776/7568] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:07:53 2022] GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:07:55.152258 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-62767e3d-d6af-4cb7-9446-aa15180893a7 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:07:55.152989 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-62767e3d-d6af-4cb7-9446-aa15180893a7 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 1c131f57-2412-4310-836c-c63e70281fd5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:07:55.161031 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-62767e3d-d6af-4cb7-9446-aa15180893a7 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:55.161677 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-62767e3d-d6af-4cb7-9446-aa15180893a7 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:55.161994 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-62767e3d-d6af-4cb7-9446-aa15180893a7 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:55.162729 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-62767e3d-d6af-4cb7-9446-aa15180893a7 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:55.163209 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-62767e3d-d6af-4cb7-9446-aa15180893a7 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:55.163698 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-62767e3d-d6af-4cb7-9446-aa15180893a7 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:55.301334 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-62767e3d-d6af-4cb7-9446-aa15180893a7 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:07:55.310072 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-62767e3d-d6af-4cb7-9446-aa15180893a7 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5" status: 200 len: 1722 microversion: 2.1 time: 0.162137 Aug 31 17:07:55.310813 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3793/7569] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:07:55 2022] GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:07:56.332185 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-351dda18-7fd6-4f5b-a579-1c1b1a245066 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:07:56.332835 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-351dda18-7fd6-4f5b-a579-1c1b1a245066 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 1c131f57-2412-4310-836c-c63e70281fd5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:07:56.339984 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-351dda18-7fd6-4f5b-a579-1c1b1a245066 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:56.340491 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-351dda18-7fd6-4f5b-a579-1c1b1a245066 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:56.340943 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-351dda18-7fd6-4f5b-a579-1c1b1a245066 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:56.341658 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-351dda18-7fd6-4f5b-a579-1c1b1a245066 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:56.342131 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-351dda18-7fd6-4f5b-a579-1c1b1a245066 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:56.342565 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-351dda18-7fd6-4f5b-a579-1c1b1a245066 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:56.490592 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-351dda18-7fd6-4f5b-a579-1c1b1a245066 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:07:56.499487 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-351dda18-7fd6-4f5b-a579-1c1b1a245066 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5" status: 200 len: 1722 microversion: 2.1 time: 0.171767 Aug 31 17:07:56.500091 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3777/7570] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:07:56 2022] GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:07:57.157751 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-5961ec44-b9ab-47ad-a2ba-256f82330003 req-96abebce-358d-47fd-829f-f7037f381017 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c131f57-2412-4310-836c-c63e70281fd5", "name": "network-vif-unplugged", "status": "completed", "tag": "df0eec12-64b7-45d6-b90c-30c4b3636221"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:07:57.168230 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-5961ec44-b9ab-47ad-a2ba-256f82330003 req-96abebce-358d-47fd-829f-f7037f381017 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:57.168764 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-5961ec44-b9ab-47ad-a2ba-256f82330003 req-96abebce-358d-47fd-829f-f7037f381017 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:57.169188 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-5961ec44-b9ab-47ad-a2ba-256f82330003 req-96abebce-358d-47fd-829f-f7037f381017 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:57.182391 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-5961ec44-b9ab-47ad-a2ba-256f82330003 req-96abebce-358d-47fd-829f-f7037f381017 service nova] Creating event network-vif-unplugged:df0eec12-64b7-45d6-b90c-30c4b3636221 for instance 1c131f57-2412-4310-836c-c63e70281fd5 on n-h2-850499-9 Aug 31 17:07:57.188516 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [req-5961ec44-b9ab-47ad-a2ba-256f82330003 req-96abebce-358d-47fd-829f-f7037f381017 service nova] Instance 1c131f57-2412-4310-836c-c63e70281fd5 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850499-9', 'n-h1-850499-9'} {{(pid=122257) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 31 17:07:57.199916 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-5961ec44-b9ab-47ad-a2ba-256f82330003 req-96abebce-358d-47fd-829f-f7037f381017 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045907 Aug 31 17:07:57.200541 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3794/7571] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:07:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 17:07:57.522084 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-090c35e6-b159-4c97-b7a9-11e8f46fb9f6 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:07:57.522718 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-090c35e6-b159-4c97-b7a9-11e8f46fb9f6 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 1c131f57-2412-4310-836c-c63e70281fd5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:07:57.529370 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-090c35e6-b159-4c97-b7a9-11e8f46fb9f6 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:57.529868 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-090c35e6-b159-4c97-b7a9-11e8f46fb9f6 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:57.530314 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-090c35e6-b159-4c97-b7a9-11e8f46fb9f6 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:57.531018 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-090c35e6-b159-4c97-b7a9-11e8f46fb9f6 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:57.531536 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-090c35e6-b159-4c97-b7a9-11e8f46fb9f6 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:57.531971 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-090c35e6-b159-4c97-b7a9-11e8f46fb9f6 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:57.679001 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-090c35e6-b159-4c97-b7a9-11e8f46fb9f6 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:07:57.687413 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-090c35e6-b159-4c97-b7a9-11e8f46fb9f6 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5" status: 200 len: 1722 microversion: 2.1 time: 0.169282 Aug 31 17:07:57.687964 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3778/7572] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:07:57 2022] GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:07:58.711399 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-41f1e4e4-8e36-4bdb-a9a3-c29edbfb6de4 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:07:58.712263 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-41f1e4e4-8e36-4bdb-a9a3-c29edbfb6de4 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 1c131f57-2412-4310-836c-c63e70281fd5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:07:58.718724 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-41f1e4e4-8e36-4bdb-a9a3-c29edbfb6de4 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:58.719231 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-41f1e4e4-8e36-4bdb-a9a3-c29edbfb6de4 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:58.719722 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-41f1e4e4-8e36-4bdb-a9a3-c29edbfb6de4 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:58.721066 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-41f1e4e4-8e36-4bdb-a9a3-c29edbfb6de4 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:58.721545 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-41f1e4e4-8e36-4bdb-a9a3-c29edbfb6de4 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:58.721997 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-41f1e4e4-8e36-4bdb-a9a3-c29edbfb6de4 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:58.861664 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-41f1e4e4-8e36-4bdb-a9a3-c29edbfb6de4 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:07:58.870334 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-41f1e4e4-8e36-4bdb-a9a3-c29edbfb6de4 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5" status: 200 len: 1722 microversion: 2.1 time: 0.164099 Aug 31 17:07:58.870883 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3795/7573] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:07:58 2022] GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:07:59.246861 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-347079f6-b568-4388-98fe-f1ba87e907e9 req-aecbd4f4-19ba-4915-ab7e-bccd401cf866 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c131f57-2412-4310-836c-c63e70281fd5", "tag": "df0eec12-64b7-45d6-b90c-30c4b3636221"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:07:59.259397 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-347079f6-b568-4388-98fe-f1ba87e907e9 req-aecbd4f4-19ba-4915-ab7e-bccd401cf866 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:59.259949 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-347079f6-b568-4388-98fe-f1ba87e907e9 req-aecbd4f4-19ba-4915-ab7e-bccd401cf866 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:59.260384 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-347079f6-b568-4388-98fe-f1ba87e907e9 req-aecbd4f4-19ba-4915-ab7e-bccd401cf866 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:59.276480 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-347079f6-b568-4388-98fe-f1ba87e907e9 req-aecbd4f4-19ba-4915-ab7e-bccd401cf866 service nova] Creating event network-changed:df0eec12-64b7-45d6-b90c-30c4b3636221 for instance 1c131f57-2412-4310-836c-c63e70281fd5 on n-h2-850499-9 Aug 31 17:07:59.281349 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [req-347079f6-b568-4388-98fe-f1ba87e907e9 req-aecbd4f4-19ba-4915-ab7e-bccd401cf866 service nova] Instance 1c131f57-2412-4310-836c-c63e70281fd5 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850499-9', 'n-h1-850499-9'} {{(pid=122256) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 31 17:07:59.293951 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-347079f6-b568-4388-98fe-f1ba87e907e9 req-aecbd4f4-19ba-4915-ab7e-bccd401cf866 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050805 Aug 31 17:07:59.294546 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3779/7574] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:07:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:07:59.894390 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d13cad7a-cdc0-4ac4-a26c-0c105aab15a1 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:07:59.895029 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d13cad7a-cdc0-4ac4-a26c-0c105aab15a1 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 1c131f57-2412-4310-836c-c63e70281fd5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:07:59.902754 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d13cad7a-cdc0-4ac4-a26c-0c105aab15a1 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:59.903271 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d13cad7a-cdc0-4ac4-a26c-0c105aab15a1 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:59.903950 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d13cad7a-cdc0-4ac4-a26c-0c105aab15a1 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:59.905127 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d13cad7a-cdc0-4ac4-a26c-0c105aab15a1 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:59.905217 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d13cad7a-cdc0-4ac4-a26c-0c105aab15a1 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:59.905593 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d13cad7a-cdc0-4ac4-a26c-0c105aab15a1 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:00.234602 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d13cad7a-cdc0-4ac4-a26c-0c105aab15a1 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:08:00.245651 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d13cad7a-cdc0-4ac4-a26c-0c105aab15a1 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5" status: 200 len: 1722 microversion: 2.1 time: 0.355357 Aug 31 17:08:00.246254 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3796/7575] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:07:59 2022] GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5 => generated 1722 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:08:01.330623 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-76e056b4-590c-400e-9bd7-c52a18497181 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:08:01.331772 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-76e056b4-590c-400e-9bd7-c52a18497181 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 1c131f57-2412-4310-836c-c63e70281fd5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:08:01.339414 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-76e056b4-590c-400e-9bd7-c52a18497181 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:01.339949 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-76e056b4-590c-400e-9bd7-c52a18497181 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:01.340398 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-76e056b4-590c-400e-9bd7-c52a18497181 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:01.341148 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-76e056b4-590c-400e-9bd7-c52a18497181 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:01.341616 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-76e056b4-590c-400e-9bd7-c52a18497181 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:01.342052 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-76e056b4-590c-400e-9bd7-c52a18497181 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:01.415851 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=3 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:08:01.508953 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-76e056b4-590c-400e-9bd7-c52a18497181 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:08:01.517961 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-76e056b4-590c-400e-9bd7-c52a18497181 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5" status: 200 len: 1722 microversion: 2.1 time: 0.193663 Aug 31 17:08:01.518546 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3780/7576] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:08:01 2022] GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5 => generated 1722 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:08:02.540500 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9a51c0ad-a21d-4b75-9e7e-1c2cd1fc8c6d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:08:02.541146 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9a51c0ad-a21d-4b75-9e7e-1c2cd1fc8c6d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 1c131f57-2412-4310-836c-c63e70281fd5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:08:02.549387 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9a51c0ad-a21d-4b75-9e7e-1c2cd1fc8c6d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:02.549902 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9a51c0ad-a21d-4b75-9e7e-1c2cd1fc8c6d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:02.550360 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9a51c0ad-a21d-4b75-9e7e-1c2cd1fc8c6d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:02.551215 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9a51c0ad-a21d-4b75-9e7e-1c2cd1fc8c6d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:02.551566 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9a51c0ad-a21d-4b75-9e7e-1c2cd1fc8c6d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:02.552014 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9a51c0ad-a21d-4b75-9e7e-1c2cd1fc8c6d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:02.691740 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9a51c0ad-a21d-4b75-9e7e-1c2cd1fc8c6d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:08:02.700485 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9a51c0ad-a21d-4b75-9e7e-1c2cd1fc8c6d tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5" status: 200 len: 1722 microversion: 2.1 time: 0.163974 Aug 31 17:08:02.701086 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3797/7577] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:08:02 2022] GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:08:03.723310 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a7fde6f9-c2d1-4eb7-a009-d316c3e1bcbe tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:08:03.723876 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a7fde6f9-c2d1-4eb7-a009-d316c3e1bcbe tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 1c131f57-2412-4310-836c-c63e70281fd5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:08:03.730767 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a7fde6f9-c2d1-4eb7-a009-d316c3e1bcbe tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:03.731267 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a7fde6f9-c2d1-4eb7-a009-d316c3e1bcbe tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:03.731744 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a7fde6f9-c2d1-4eb7-a009-d316c3e1bcbe tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:03.732459 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a7fde6f9-c2d1-4eb7-a009-d316c3e1bcbe tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:03.732928 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a7fde6f9-c2d1-4eb7-a009-d316c3e1bcbe tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:03.733367 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a7fde6f9-c2d1-4eb7-a009-d316c3e1bcbe tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:03.749040 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:08:03.876055 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a7fde6f9-c2d1-4eb7-a009-d316c3e1bcbe tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:08:03.886168 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a7fde6f9-c2d1-4eb7-a009-d316c3e1bcbe tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5" status: 200 len: 1722 microversion: 2.1 time: 0.167753 Aug 31 17:08:03.886758 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3781/7578] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:08:03 2022] GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:08:04.908608 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-189d30d7-d5aa-45e6-8227-e1e1f32e04bd tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:08:04.909233 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-189d30d7-d5aa-45e6-8227-e1e1f32e04bd tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 1c131f57-2412-4310-836c-c63e70281fd5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:08:04.916720 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-189d30d7-d5aa-45e6-8227-e1e1f32e04bd tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:04.917230 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-189d30d7-d5aa-45e6-8227-e1e1f32e04bd tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:04.917723 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-189d30d7-d5aa-45e6-8227-e1e1f32e04bd tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:04.918440 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-189d30d7-d5aa-45e6-8227-e1e1f32e04bd tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:04.918921 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-189d30d7-d5aa-45e6-8227-e1e1f32e04bd tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:04.919368 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-189d30d7-d5aa-45e6-8227-e1e1f32e04bd tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:05.055212 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-189d30d7-d5aa-45e6-8227-e1e1f32e04bd tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:08:05.065625 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-189d30d7-d5aa-45e6-8227-e1e1f32e04bd tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5" status: 200 len: 1722 microversion: 2.1 time: 0.161669 Aug 31 17:08:05.066318 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3798/7579] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:08:04 2022] GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:08:06.091095 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d21e83a6-10e4-4af6-820e-626adf9f72d4 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:08:06.091759 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d21e83a6-10e4-4af6-820e-626adf9f72d4 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 1c131f57-2412-4310-836c-c63e70281fd5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:08:06.099314 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d21e83a6-10e4-4af6-820e-626adf9f72d4 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:06.099850 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d21e83a6-10e4-4af6-820e-626adf9f72d4 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:06.100294 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d21e83a6-10e4-4af6-820e-626adf9f72d4 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:06.100998 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d21e83a6-10e4-4af6-820e-626adf9f72d4 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:06.101464 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d21e83a6-10e4-4af6-820e-626adf9f72d4 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:06.101907 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d21e83a6-10e4-4af6-820e-626adf9f72d4 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:06.244989 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d21e83a6-10e4-4af6-820e-626adf9f72d4 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:08:06.253690 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d21e83a6-10e4-4af6-820e-626adf9f72d4 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5" status: 200 len: 1722 microversion: 2.1 time: 0.166550 Aug 31 17:08:06.254277 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3782/7580] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:08:06 2022] GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:08:07.275659 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-08905445-027a-45f9-a94d-120526726d85 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:08:07.276297 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-08905445-027a-45f9-a94d-120526726d85 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 1c131f57-2412-4310-836c-c63e70281fd5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:08:07.279647 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=30 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:08:07.285657 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-08905445-027a-45f9-a94d-120526726d85 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:07.286175 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-08905445-027a-45f9-a94d-120526726d85 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:07.286639 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-08905445-027a-45f9-a94d-120526726d85 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:07.287376 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-08905445-027a-45f9-a94d-120526726d85 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:07.287883 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-08905445-027a-45f9-a94d-120526726d85 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:07.288339 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-08905445-027a-45f9-a94d-120526726d85 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:07.291315 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=86 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:08:07.431805 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-08905445-027a-45f9-a94d-120526726d85 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:08:07.441194 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-08905445-027a-45f9-a94d-120526726d85 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5" status: 200 len: 1722 microversion: 2.1 time: 0.169464 Aug 31 17:08:07.441769 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3799/7581] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:08:07 2022] GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:08:08.466347 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7e018c22-437d-4375-a1dc-de5f7955c233 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:08:08.466902 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7e018c22-437d-4375-a1dc-de5f7955c233 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 1c131f57-2412-4310-836c-c63e70281fd5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:08:08.469690 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:08:08.477701 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7e018c22-437d-4375-a1dc-de5f7955c233 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:08.478208 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7e018c22-437d-4375-a1dc-de5f7955c233 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:08.478663 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7e018c22-437d-4375-a1dc-de5f7955c233 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:08.479379 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7e018c22-437d-4375-a1dc-de5f7955c233 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:08.479888 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7e018c22-437d-4375-a1dc-de5f7955c233 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:08.480328 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7e018c22-437d-4375-a1dc-de5f7955c233 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:08.620906 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7e018c22-437d-4375-a1dc-de5f7955c233 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:08:08.630706 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7e018c22-437d-4375-a1dc-de5f7955c233 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5" status: 200 len: 1722 microversion: 2.1 time: 0.168363 Aug 31 17:08:08.631311 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3783/7582] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:08:08 2022] GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:08:09.652675 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0e834e2b-9fd7-435d-a9ee-f8a98f7e31c8 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:08:09.653249 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0e834e2b-9fd7-435d-a9ee-f8a98f7e31c8 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 1c131f57-2412-4310-836c-c63e70281fd5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:08:09.661716 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0e834e2b-9fd7-435d-a9ee-f8a98f7e31c8 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:09.662236 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0e834e2b-9fd7-435d-a9ee-f8a98f7e31c8 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:09.662702 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0e834e2b-9fd7-435d-a9ee-f8a98f7e31c8 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:09.663475 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0e834e2b-9fd7-435d-a9ee-f8a98f7e31c8 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:09.663986 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0e834e2b-9fd7-435d-a9ee-f8a98f7e31c8 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:09.664437 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0e834e2b-9fd7-435d-a9ee-f8a98f7e31c8 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:09.810497 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0e834e2b-9fd7-435d-a9ee-f8a98f7e31c8 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:08:09.819658 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0e834e2b-9fd7-435d-a9ee-f8a98f7e31c8 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5" status: 200 len: 1722 microversion: 2.1 time: 0.170896 Aug 31 17:08:09.820258 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3800/7583] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:08:09 2022] GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:08:10.841787 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-97958053-9e2c-449a-9725-284e5e7dfb8a tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:08:10.842401 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-97958053-9e2c-449a-9725-284e5e7dfb8a tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 1c131f57-2412-4310-836c-c63e70281fd5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:08:10.850076 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-97958053-9e2c-449a-9725-284e5e7dfb8a tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:10.850570 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-97958053-9e2c-449a-9725-284e5e7dfb8a tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:10.851007 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-97958053-9e2c-449a-9725-284e5e7dfb8a tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:10.851751 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-97958053-9e2c-449a-9725-284e5e7dfb8a tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:10.852211 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-97958053-9e2c-449a-9725-284e5e7dfb8a tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:10.853379 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-97958053-9e2c-449a-9725-284e5e7dfb8a tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:10.992228 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-97958053-9e2c-449a-9725-284e5e7dfb8a tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:08:11.002033 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-97958053-9e2c-449a-9725-284e5e7dfb8a tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5" status: 200 len: 1722 microversion: 2.1 time: 0.164042 Aug 31 17:08:11.003069 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3784/7584] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:08:10 2022] GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:08:12.025510 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-fc77a641-679e-4698-9218-44fefa18037e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:08:12.026134 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-fc77a641-679e-4698-9218-44fefa18037e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 1c131f57-2412-4310-836c-c63e70281fd5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:08:12.033438 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fc77a641-679e-4698-9218-44fefa18037e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:12.033950 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fc77a641-679e-4698-9218-44fefa18037e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:12.034436 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fc77a641-679e-4698-9218-44fefa18037e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:12.035165 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fc77a641-679e-4698-9218-44fefa18037e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:12.035670 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fc77a641-679e-4698-9218-44fefa18037e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:12.036110 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fc77a641-679e-4698-9218-44fefa18037e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:12.178529 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-fc77a641-679e-4698-9218-44fefa18037e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:08:12.186995 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-fc77a641-679e-4698-9218-44fefa18037e tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5" status: 200 len: 1722 microversion: 2.1 time: 0.165354 Aug 31 17:08:12.187601 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3801/7585] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:08:12 2022] GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:08:13.208641 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1b2f53ae-114f-4b88-ada1-59f41f61c0ec tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:08:13.209311 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1b2f53ae-114f-4b88-ada1-59f41f61c0ec tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 1c131f57-2412-4310-836c-c63e70281fd5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:08:13.216346 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1b2f53ae-114f-4b88-ada1-59f41f61c0ec tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:13.216837 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1b2f53ae-114f-4b88-ada1-59f41f61c0ec tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:13.217277 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1b2f53ae-114f-4b88-ada1-59f41f61c0ec tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:13.217976 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1b2f53ae-114f-4b88-ada1-59f41f61c0ec tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:13.218434 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1b2f53ae-114f-4b88-ada1-59f41f61c0ec tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:13.218863 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1b2f53ae-114f-4b88-ada1-59f41f61c0ec tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:13.359646 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1b2f53ae-114f-4b88-ada1-59f41f61c0ec tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:08:13.368207 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1b2f53ae-114f-4b88-ada1-59f41f61c0ec tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5" status: 200 len: 1715 microversion: 2.1 time: 0.163644 Aug 31 17:08:13.368809 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3785/7586] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:08:13 2022] GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5 => generated 1715 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:08:13.391029 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9caf3428-b44e-4b56-977f-81f12cbc93cf tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:08:13.393182 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9caf3428-b44e-4b56-977f-81f12cbc93cf tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 1c131f57-2412-4310-836c-c63e70281fd5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:08:13.401760 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9caf3428-b44e-4b56-977f-81f12cbc93cf tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:13.402283 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9caf3428-b44e-4b56-977f-81f12cbc93cf tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:13.402741 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9caf3428-b44e-4b56-977f-81f12cbc93cf tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:13.403477 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9caf3428-b44e-4b56-977f-81f12cbc93cf tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:13.403980 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9caf3428-b44e-4b56-977f-81f12cbc93cf tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:13.404451 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9caf3428-b44e-4b56-977f-81f12cbc93cf tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:13.568363 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9caf3428-b44e-4b56-977f-81f12cbc93cf tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:08:13.576875 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9caf3428-b44e-4b56-977f-81f12cbc93cf tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5" status: 200 len: 1715 microversion: 2.1 time: 0.190692 Aug 31 17:08:13.577466 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3802/7587] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:08:13 2022] GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5 => generated 1715 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:08:13.598506 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7245c6f7-8beb-42ee-a3a4-0b190d315b29 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:08:13.599155 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7245c6f7-8beb-42ee-a3a4-0b190d315b29 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 1c131f57-2412-4310-836c-c63e70281fd5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:08:13.605390 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7245c6f7-8beb-42ee-a3a4-0b190d315b29 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:13.605875 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7245c6f7-8beb-42ee-a3a4-0b190d315b29 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:13.606311 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7245c6f7-8beb-42ee-a3a4-0b190d315b29 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:13.607012 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7245c6f7-8beb-42ee-a3a4-0b190d315b29 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:13.607469 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7245c6f7-8beb-42ee-a3a4-0b190d315b29 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:13.607946 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7245c6f7-8beb-42ee-a3a4-0b190d315b29 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:13.749519 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7245c6f7-8beb-42ee-a3a4-0b190d315b29 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:08:13.759749 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7245c6f7-8beb-42ee-a3a4-0b190d315b29 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5" status: 200 len: 1715 microversion: 2.1 time: 0.165519 Aug 31 17:08:13.760346 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3786/7588] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:08:13 2022] GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5 => generated 1715 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:08:13.781758 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-62a43896-28bf-4ba4-af60-0bcc3f768302 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:08:13.782685 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-62a43896-28bf-4ba4-af60-0bcc3f768302 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 1c131f57-2412-4310-836c-c63e70281fd5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:08:13.789402 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-62a43896-28bf-4ba4-af60-0bcc3f768302 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:13.789926 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-62a43896-28bf-4ba4-af60-0bcc3f768302 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:13.790393 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-62a43896-28bf-4ba4-af60-0bcc3f768302 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:13.791225 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-62a43896-28bf-4ba4-af60-0bcc3f768302 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:13.791812 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-62a43896-28bf-4ba4-af60-0bcc3f768302 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:13.792282 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-62a43896-28bf-4ba4-af60-0bcc3f768302 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:13.820740 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-62a43896-28bf-4ba4-af60-0bcc3f768302 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 1c131f57-2412-4310-836c-c63e70281fd5] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 17:08:13.905823 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-62a43896-28bf-4ba4-af60-0bcc3f768302 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "DELETE /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5" status: 204 len: 0 microversion: 2.1 time: 0.128187 Aug 31 17:08:13.906567 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3803/7589] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 17:08:13 2022] DELETE /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 17:08:13.916110 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7992b859-3dff-456c-8997-ef200ca410e0 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:08:13.917172 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7992b859-3dff-456c-8997-ef200ca410e0 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 1c131f57-2412-4310-836c-c63e70281fd5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:08:13.922958 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7992b859-3dff-456c-8997-ef200ca410e0 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:13.923455 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7992b859-3dff-456c-8997-ef200ca410e0 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:13.924590 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7992b859-3dff-456c-8997-ef200ca410e0 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:13.925364 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7992b859-3dff-456c-8997-ef200ca410e0 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:13.925841 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7992b859-3dff-456c-8997-ef200ca410e0 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:13.926276 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7992b859-3dff-456c-8997-ef200ca410e0 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:14.071324 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7992b859-3dff-456c-8997-ef200ca410e0 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:08:14.080720 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7992b859-3dff-456c-8997-ef200ca410e0 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5" status: 200 len: 1721 microversion: 2.1 time: 0.168748 Aug 31 17:08:14.081309 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3787/7590] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:08:13 2022] GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5 => generated 1721 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:08:14.232967 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-214be781-45bf-4cb1-a9a7-fdb6255d188f req-5ea31c04-099b-403f-875c-e8b90c5fdb6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c131f57-2412-4310-836c-c63e70281fd5", "name": "network-vif-plugged", "status": "completed", "tag": "df0eec12-64b7-45d6-b90c-30c4b3636221"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:08:14.243742 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-214be781-45bf-4cb1-a9a7-fdb6255d188f req-5ea31c04-099b-403f-875c-e8b90c5fdb6f service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:14.244261 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-214be781-45bf-4cb1-a9a7-fdb6255d188f req-5ea31c04-099b-403f-875c-e8b90c5fdb6f service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:14.244710 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-214be781-45bf-4cb1-a9a7-fdb6255d188f req-5ea31c04-099b-403f-875c-e8b90c5fdb6f service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:14.258308 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-214be781-45bf-4cb1-a9a7-fdb6255d188f req-5ea31c04-099b-403f-875c-e8b90c5fdb6f service nova] Creating event network-vif-plugged:df0eec12-64b7-45d6-b90c-30c4b3636221 for instance 1c131f57-2412-4310-836c-c63e70281fd5 on n-h2-850499-9 Aug 31 17:08:14.263621 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-214be781-45bf-4cb1-a9a7-fdb6255d188f req-5ea31c04-099b-403f-875c-e8b90c5fdb6f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036489 Aug 31 17:08:14.264232 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3804/7591] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:08:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:08:15.103394 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-520f0c17-6e8a-4565-b286-7c882aee1f1c tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:08:15.104159 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-520f0c17-6e8a-4565-b286-7c882aee1f1c tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 1c131f57-2412-4310-836c-c63e70281fd5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:08:15.111406 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-520f0c17-6e8a-4565-b286-7c882aee1f1c tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:15.111951 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-520f0c17-6e8a-4565-b286-7c882aee1f1c tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:15.112407 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-520f0c17-6e8a-4565-b286-7c882aee1f1c tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:15.113120 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-520f0c17-6e8a-4565-b286-7c882aee1f1c tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:15.113617 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-520f0c17-6e8a-4565-b286-7c882aee1f1c tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:15.114057 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-520f0c17-6e8a-4565-b286-7c882aee1f1c tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:15.261217 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-520f0c17-6e8a-4565-b286-7c882aee1f1c tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:08:15.270600 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-520f0c17-6e8a-4565-b286-7c882aee1f1c tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5" status: 200 len: 1721 microversion: 2.1 time: 0.171178 Aug 31 17:08:15.271194 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3788/7592] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:08:15 2022] GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5 => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:08:16.293228 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5d54c562-cac7-4690-a3d2-122a05c87551 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:08:16.293961 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5d54c562-cac7-4690-a3d2-122a05c87551 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 1c131f57-2412-4310-836c-c63e70281fd5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:08:16.300355 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5d54c562-cac7-4690-a3d2-122a05c87551 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:16.300874 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5d54c562-cac7-4690-a3d2-122a05c87551 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:16.301338 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5d54c562-cac7-4690-a3d2-122a05c87551 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:16.302066 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5d54c562-cac7-4690-a3d2-122a05c87551 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:16.302550 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5d54c562-cac7-4690-a3d2-122a05c87551 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:16.303006 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5d54c562-cac7-4690-a3d2-122a05c87551 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:16.534268 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5d54c562-cac7-4690-a3d2-122a05c87551 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:08:16.544860 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5d54c562-cac7-4690-a3d2-122a05c87551 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5" status: 200 len: 1721 microversion: 2.1 time: 0.256696 Aug 31 17:08:16.545390 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3805/7593] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:08:16 2022] GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5 => generated 1721 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:08:16.860893 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-0f2dad00-cb10-4e05-a933-1e0f8350e54f req-f6bbb6bb-0d72-4286-bc90-ab4c7bb53c13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c131f57-2412-4310-836c-c63e70281fd5", "name": "network-vif-deleted", "tag": "df0eec12-64b7-45d6-b90c-30c4b3636221"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:08:16.871925 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-0f2dad00-cb10-4e05-a933-1e0f8350e54f req-f6bbb6bb-0d72-4286-bc90-ab4c7bb53c13 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:16.872416 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-0f2dad00-cb10-4e05-a933-1e0f8350e54f req-f6bbb6bb-0d72-4286-bc90-ab4c7bb53c13 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:16.872914 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-0f2dad00-cb10-4e05-a933-1e0f8350e54f req-f6bbb6bb-0d72-4286-bc90-ab4c7bb53c13 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:16.886371 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-0f2dad00-cb10-4e05-a933-1e0f8350e54f req-f6bbb6bb-0d72-4286-bc90-ab4c7bb53c13 service nova] Creating event network-vif-deleted:df0eec12-64b7-45d6-b90c-30c4b3636221 for instance 1c131f57-2412-4310-836c-c63e70281fd5 on n-h2-850499-9 Aug 31 17:08:16.893630 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-0f2dad00-cb10-4e05-a933-1e0f8350e54f req-f6bbb6bb-0d72-4286-bc90-ab4c7bb53c13 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036443 Aug 31 17:08:16.895731 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3789/7594] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:08:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:08:17.569306 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e6abbda0-3d17-453e-ba6f-68f1bc3d0fcd tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:08:17.569956 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e6abbda0-3d17-453e-ba6f-68f1bc3d0fcd tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 1c131f57-2412-4310-836c-c63e70281fd5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:08:17.576948 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e6abbda0-3d17-453e-ba6f-68f1bc3d0fcd tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:17.577499 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e6abbda0-3d17-453e-ba6f-68f1bc3d0fcd tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:17.578111 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e6abbda0-3d17-453e-ba6f-68f1bc3d0fcd tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:17.578852 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e6abbda0-3d17-453e-ba6f-68f1bc3d0fcd tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:17.579338 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e6abbda0-3d17-453e-ba6f-68f1bc3d0fcd tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:17.579822 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e6abbda0-3d17-453e-ba6f-68f1bc3d0fcd tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:17.651290 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e6abbda0-3d17-453e-ba6f-68f1bc3d0fcd tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:08:17.660822 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e6abbda0-3d17-453e-ba6f-68f1bc3d0fcd tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5" status: 200 len: 1370 microversion: 2.1 time: 0.098028 Aug 31 17:08:17.661412 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3806/7595] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:08:17 2022] GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5 => generated 1370 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:08:18.684298 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8feee761-80c8-4892-a16e-865e5aed489b tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:08:18.685767 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8feee761-80c8-4892-a16e-865e5aed489b tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 1c131f57-2412-4310-836c-c63e70281fd5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:08:18.692231 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8feee761-80c8-4892-a16e-865e5aed489b tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:18.692727 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8feee761-80c8-4892-a16e-865e5aed489b tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:18.693173 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8feee761-80c8-4892-a16e-865e5aed489b tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:18.693884 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8feee761-80c8-4892-a16e-865e5aed489b tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:18.694449 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8feee761-80c8-4892-a16e-865e5aed489b tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:18.694976 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8feee761-80c8-4892-a16e-865e5aed489b tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:18.761837 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8feee761-80c8-4892-a16e-865e5aed489b tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:08:18.771101 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8feee761-80c8-4892-a16e-865e5aed489b tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5" status: 200 len: 1370 microversion: 2.1 time: 0.091925 Aug 31 17:08:18.771940 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3790/7596] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:08:18 2022] GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5 => generated 1370 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:08:19.792642 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3da9cb85-e49f-4951-aff5-3199472a3632 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:08:19.793272 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3da9cb85-e49f-4951-aff5-3199472a3632 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 1c131f57-2412-4310-836c-c63e70281fd5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:08:19.801239 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3da9cb85-e49f-4951-aff5-3199472a3632 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:19.801754 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3da9cb85-e49f-4951-aff5-3199472a3632 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:19.802544 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3da9cb85-e49f-4951-aff5-3199472a3632 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:19.803876 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3da9cb85-e49f-4951-aff5-3199472a3632 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:19.804543 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3da9cb85-e49f-4951-aff5-3199472a3632 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:19.804847 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3da9cb85-e49f-4951-aff5-3199472a3632 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:19.873913 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3da9cb85-e49f-4951-aff5-3199472a3632 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:08:19.883344 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3da9cb85-e49f-4951-aff5-3199472a3632 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5" status: 200 len: 1370 microversion: 2.1 time: 0.094643 Aug 31 17:08:19.883980 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3807/7597] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:08:19 2022] GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5 => generated 1370 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:08:20.904689 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7439f0d7-607c-40a7-bb2a-290616348e59 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:08:20.905303 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7439f0d7-607c-40a7-bb2a-290616348e59 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 1c131f57-2412-4310-836c-c63e70281fd5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:08:20.913331 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7439f0d7-607c-40a7-bb2a-290616348e59 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:20.913826 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7439f0d7-607c-40a7-bb2a-290616348e59 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:20.914282 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7439f0d7-607c-40a7-bb2a-290616348e59 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:20.914981 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7439f0d7-607c-40a7-bb2a-290616348e59 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:20.915456 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7439f0d7-607c-40a7-bb2a-290616348e59 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:20.916023 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7439f0d7-607c-40a7-bb2a-290616348e59 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:20.994778 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7439f0d7-607c-40a7-bb2a-290616348e59 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e98ea428604e7da092d46e865cfe1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38fad62a33848c59db3d09c5c9788cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:08:21.004705 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7439f0d7-607c-40a7-bb2a-290616348e59 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5" status: 200 len: 1370 microversion: 2.1 time: 0.103925 Aug 31 17:08:21.005513 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3791/7598] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:08:20 2022] GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5 => generated 1370 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:08:22.026449 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e4bc7bba-f1dc-49d1-9cf2-982e81a05962 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:08:22.027082 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e4bc7bba-f1dc-49d1-9cf2-982e81a05962 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 1c131f57-2412-4310-836c-c63e70281fd5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:08:22.034088 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e4bc7bba-f1dc-49d1-9cf2-982e81a05962 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:22.034655 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e4bc7bba-f1dc-49d1-9cf2-982e81a05962 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:22.035060 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e4bc7bba-f1dc-49d1-9cf2-982e81a05962 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:22.035814 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e4bc7bba-f1dc-49d1-9cf2-982e81a05962 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:22.036294 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e4bc7bba-f1dc-49d1-9cf2-982e81a05962 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:22.036773 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e4bc7bba-f1dc-49d1-9cf2-982e81a05962 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:22.051380 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-e4bc7bba-f1dc-49d1-9cf2-982e81a05962 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] HTTP exception thrown: Instance 1c131f57-2412-4310-836c-c63e70281fd5 could not be found. Aug 31 17:08:22.053138 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e4bc7bba-f1dc-49d1-9cf2-982e81a05962 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Request method failure captured: Aug 31 17:08:22.053138 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5 HTTP/1.1 Aug 31 17:08:22.053138 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 17:08:22.053138 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 17:08:22.053138 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 17:08:22.053138 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 17:08:22.053138 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 17:08:22.053138 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 17:08:22.053138 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 17:08:22.053138 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 17:08:22.053138 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD5Nv8GJZq1tAU_0B41QogV9NIcJdPpwMr_NXfjBi2_q4oUJIInVGdHr79haO8h167WXFYih4WATMYJ8x__N41D8Vj_h-g4tmjTg1gnT9rlBTtYAJ4qzKuSSR4SRddtXJGZ38GeQNeHZeDZnQxyjFCcsQeloJgCoY--vpZdgiHPrfHyY Aug 31 17:08:22.053138 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 17:08:22.053138 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 17:08:22.053138 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 17:08:22.053138 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 17:08:22.053138 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 17:08:22.053138 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 17:08:22.053138 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: f38fad62a33848c59db3d09c5c9788cc Aug 31 17:08:22.053138 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ServerActionsTestJSON-992920924 Aug 31 17:08:22.053138 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 17:08:22.053138 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 17:08:22.053138 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f38fad62a33848c59db3d09c5c9788cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f38fad62a33848c59db3d09c5c9788cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f38fad62a33848c59db3d09c5c9788cc", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f38fad62a33848c59db3d09c5c9788cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 17:08:22.053138 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ServerActionsTestJSON-992920924 Aug 31 17:08:22.053138 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: f38fad62a33848c59db3d09c5c9788cc Aug 31 17:08:22.053138 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ServerActionsTestJSON-992920924 Aug 31 17:08:22.053138 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ServerActionsTestJSON-992920924-project Aug 31 17:08:22.053138 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 17:08:22.053138 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 17:08:22.053138 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: a3e98ea428604e7da092d46e865cfe1d Aug 31 17:08:22.053138 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ServerActionsTestJSON-992920924-project Aug 31 17:08:22.053138 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 17:08:22.053138 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance 1c131f57-2412-4310-836c-c63e70281fd5 could not be found. Aug 31 17:08:22.053138 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '1c131f57-2412-4310-836c-c63e70281fd5'} Aug 31 17:08:22.053138 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 17:08:22.053138 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:08:22.053138 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 17:08:22.053138 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 17:08:22.053138 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 17:08:22.053138 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 17:08:22.053138 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 17:08:22.053138 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 17:08:22.053138 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 17:08:22.053138 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 17:08:22.053138 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c131f57-2412-4310-836c-c63e70281fd5 could not be found. Aug 31 17:08:22.053138 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 17:08:22.053138 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:08:22.053138 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 17:08:22.053138 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:08:22.053138 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:08:22.053138 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:08:22.053138 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 17:08:22.053138 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 17:08:22.053138 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 17:08:22.053138 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 17:08:22.053138 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 17:08:22.053138 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 17:08:22.053138 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 17:08:22.053138 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 17:08:22.053138 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 17:08:22.053138 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 17:08:22.053138 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c131f57-2412-4310-836c-c63e70281fd5 could not be found. Aug 31 17:08:22.053138 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 17:08:22.053138 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:08:22.053138 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 17:08:22.057817 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:08:22.057817 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:08:22.057817 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:08:22.057817 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 17:08:22.057817 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 17:08:22.057817 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c131f57-2412-4310-836c-c63e70281fd5 could not be found. Aug 31 17:08:22.057817 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 17:08:22.057817 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e4bc7bba-f1dc-49d1-9cf2-982e81a05962 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Returning 404 to user: Instance 1c131f57-2412-4310-836c-c63e70281fd5 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 17:08:22.057817 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e4bc7bba-f1dc-49d1-9cf2-982e81a05962 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5" status: 404 len: 111 microversion: 2.1 time: 0.032208 Aug 31 17:08:22.057817 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3808/7599] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:08:22 2022] GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 17:08:22.115775 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4b0c68ad-ca99-4e16-a1f6-7fa8cabac48b tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:08:22.118016 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4b0c68ad-ca99-4e16-a1f6-7fa8cabac48b tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 1c131f57-2412-4310-836c-c63e70281fd5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:08:22.124953 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4b0c68ad-ca99-4e16-a1f6-7fa8cabac48b tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:22.125479 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4b0c68ad-ca99-4e16-a1f6-7fa8cabac48b tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:22.125930 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4b0c68ad-ca99-4e16-a1f6-7fa8cabac48b tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:22.126647 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4b0c68ad-ca99-4e16-a1f6-7fa8cabac48b tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:22.127864 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4b0c68ad-ca99-4e16-a1f6-7fa8cabac48b tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:22.128810 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4b0c68ad-ca99-4e16-a1f6-7fa8cabac48b tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:22.142078 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-4b0c68ad-ca99-4e16-a1f6-7fa8cabac48b tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] HTTP exception thrown: Instance 1c131f57-2412-4310-836c-c63e70281fd5 could not be found. Aug 31 17:08:22.144415 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4b0c68ad-ca99-4e16-a1f6-7fa8cabac48b tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Request method failure captured: Aug 31 17:08:22.144415 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5/os-volume_attachments HTTP/1.1 Aug 31 17:08:22.144415 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 17:08:22.144415 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 17:08:22.144415 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 17:08:22.144415 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 17:08:22.144415 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 17:08:22.144415 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 17:08:22.144415 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 17:08:22.144415 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 17:08:22.144415 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD5Nv8GJZq1tAU_0B41QogV9NIcJdPpwMr_NXfjBi2_q4oUJIInVGdHr79haO8h167WXFYih4WATMYJ8x__N41D8Vj_h-g4tmjTg1gnT9rlBTtYAJ4qzKuSSR4SRddtXJGZ38GeQNeHZeDZnQxyjFCcsQeloJgCoY--vpZdgiHPrfHyY Aug 31 17:08:22.144415 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 17:08:22.144415 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 17:08:22.144415 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 17:08:22.144415 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 17:08:22.144415 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 17:08:22.144415 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 17:08:22.144415 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: f38fad62a33848c59db3d09c5c9788cc Aug 31 17:08:22.144415 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ServerActionsTestJSON-992920924 Aug 31 17:08:22.144415 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 17:08:22.144415 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 17:08:22.144415 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f38fad62a33848c59db3d09c5c9788cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f38fad62a33848c59db3d09c5c9788cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f38fad62a33848c59db3d09c5c9788cc", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f38fad62a33848c59db3d09c5c9788cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 17:08:22.144415 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ServerActionsTestJSON-992920924 Aug 31 17:08:22.144415 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: f38fad62a33848c59db3d09c5c9788cc Aug 31 17:08:22.144415 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ServerActionsTestJSON-992920924 Aug 31 17:08:22.144415 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ServerActionsTestJSON-992920924-project Aug 31 17:08:22.144415 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 17:08:22.144415 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 17:08:22.144415 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: a3e98ea428604e7da092d46e865cfe1d Aug 31 17:08:22.144415 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ServerActionsTestJSON-992920924-project Aug 31 17:08:22.144415 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 17:08:22.144415 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance 1c131f57-2412-4310-836c-c63e70281fd5 could not be found. Aug 31 17:08:22.144415 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'server_id': '1c131f57-2412-4310-836c-c63e70281fd5'} Aug 31 17:08:22.144415 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 17:08:22.144415 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:08:22.144415 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 17:08:22.144415 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 17:08:22.144415 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 17:08:22.144415 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 17:08:22.144415 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 17:08:22.144415 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 17:08:22.144415 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 17:08:22.144415 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 17:08:22.144415 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c131f57-2412-4310-836c-c63e70281fd5 could not be found. Aug 31 17:08:22.144415 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:08:22.144415 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:08:22.144415 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:08:22.144415 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:08:22.144415 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:08:22.144415 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:08:22.144415 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 17:08:22.144415 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 17:08:22.144415 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 17:08:22.144415 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 17:08:22.144415 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 31 17:08:22.144415 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 17:08:22.144415 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 31 17:08:22.144415 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 17:08:22.144415 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 31 17:08:22.144415 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 31 17:08:22.144415 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 17:08:22.144415 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 17:08:22.149027 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c131f57-2412-4310-836c-c63e70281fd5 could not be found. Aug 31 17:08:22.149027 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:08:22.149027 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:08:22.149027 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:08:22.149027 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:08:22.149027 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:08:22.149027 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:08:22.149027 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 17:08:22.149027 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 17:08:22.149027 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c131f57-2412-4310-836c-c63e70281fd5 could not be found. Aug 31 17:08:22.149027 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:08:22.149027 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4b0c68ad-ca99-4e16-a1f6-7fa8cabac48b tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Returning 404 to user: Instance 1c131f57-2412-4310-836c-c63e70281fd5 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 17:08:22.149027 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4b0c68ad-ca99-4e16-a1f6-7fa8cabac48b tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.035061 Aug 31 17:08:22.149027 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3792/7600] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 17:08:22 2022] GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5/os-volume_attachments => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 17:08:25.483732 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0a964630-a260-4345-9eb5-215662629ebb tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:08:25.484366 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0a964630-a260-4345-9eb5-215662629ebb tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 1c131f57-2412-4310-836c-c63e70281fd5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:08:25.492831 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0a964630-a260-4345-9eb5-215662629ebb tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:25.494028 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0a964630-a260-4345-9eb5-215662629ebb tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:25.494580 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0a964630-a260-4345-9eb5-215662629ebb tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:25.495381 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0a964630-a260-4345-9eb5-215662629ebb tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:25.495986 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0a964630-a260-4345-9eb5-215662629ebb tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:25.496505 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0a964630-a260-4345-9eb5-215662629ebb tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:25.512433 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-0a964630-a260-4345-9eb5-215662629ebb tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] HTTP exception thrown: Instance 1c131f57-2412-4310-836c-c63e70281fd5 could not be found. Aug 31 17:08:25.514035 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0a964630-a260-4345-9eb5-215662629ebb tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Request method failure captured: Aug 31 17:08:25.514035 n-d-850499-9 devstack@n-api.service[122257]: request: DELETE /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5 HTTP/1.1 Aug 31 17:08:25.514035 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 17:08:25.514035 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 17:08:25.514035 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 17:08:25.514035 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 17:08:25.514035 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 17:08:25.514035 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 17:08:25.514035 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 17:08:25.514035 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 17:08:25.514035 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD5Nv8GJZq1tAU_0B41QogV9NIcJdPpwMr_NXfjBi2_q4oUJIInVGdHr79haO8h167WXFYih4WATMYJ8x__N41D8Vj_h-g4tmjTg1gnT9rlBTtYAJ4qzKuSSR4SRddtXJGZ38GeQNeHZeDZnQxyjFCcsQeloJgCoY--vpZdgiHPrfHyY Aug 31 17:08:25.514035 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 17:08:25.514035 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 17:08:25.514035 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 17:08:25.514035 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 17:08:25.514035 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 17:08:25.514035 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 17:08:25.514035 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: f38fad62a33848c59db3d09c5c9788cc Aug 31 17:08:25.514035 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ServerActionsTestJSON-992920924 Aug 31 17:08:25.514035 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 17:08:25.514035 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 17:08:25.514035 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f38fad62a33848c59db3d09c5c9788cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f38fad62a33848c59db3d09c5c9788cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f38fad62a33848c59db3d09c5c9788cc", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f38fad62a33848c59db3d09c5c9788cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 17:08:25.514035 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ServerActionsTestJSON-992920924 Aug 31 17:08:25.514035 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: f38fad62a33848c59db3d09c5c9788cc Aug 31 17:08:25.514035 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ServerActionsTestJSON-992920924 Aug 31 17:08:25.514035 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ServerActionsTestJSON-992920924-project Aug 31 17:08:25.514035 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 17:08:25.514035 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 17:08:25.514035 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: a3e98ea428604e7da092d46e865cfe1d Aug 31 17:08:25.514035 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ServerActionsTestJSON-992920924-project Aug 31 17:08:25.514035 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 17:08:25.514035 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance 1c131f57-2412-4310-836c-c63e70281fd5 could not be found. Aug 31 17:08:25.514035 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '1c131f57-2412-4310-836c-c63e70281fd5'} Aug 31 17:08:25.514035 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 17:08:25.514035 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:08:25.514035 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 17:08:25.514035 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 17:08:25.514035 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 17:08:25.514035 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 17:08:25.514035 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 17:08:25.514035 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 17:08:25.514035 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 17:08:25.514035 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 17:08:25.514035 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c131f57-2412-4310-836c-c63e70281fd5 could not be found. Aug 31 17:08:25.514035 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 17:08:25.514035 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:08:25.514035 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 17:08:25.514035 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:08:25.514035 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:08:25.514035 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:08:25.514035 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 17:08:25.514035 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 17:08:25.514035 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 17:08:25.514035 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 17:08:25.514035 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 17:08:25.514035 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 17:08:25.514035 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 17:08:25.514035 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 17:08:25.514035 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 17:08:25.514035 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 17:08:25.514035 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 17:08:25.514035 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 17:08:25.519330 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c131f57-2412-4310-836c-c63e70281fd5 could not be found. Aug 31 17:08:25.519330 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 17:08:25.519330 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:08:25.519330 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 17:08:25.519330 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:08:25.519330 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:08:25.519330 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:08:25.519330 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 17:08:25.519330 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 17:08:25.519330 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c131f57-2412-4310-836c-c63e70281fd5 could not be found. Aug 31 17:08:25.519330 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 17:08:25.519330 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0a964630-a260-4345-9eb5-215662629ebb tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Returning 404 to user: Instance 1c131f57-2412-4310-836c-c63e70281fd5 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 17:08:25.519330 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0a964630-a260-4345-9eb5-215662629ebb tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "DELETE /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5" status: 404 len: 111 microversion: 2.1 time: 0.035796 Aug 31 17:08:25.519330 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3809/7601] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 17:08:25 2022] DELETE /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 17:08:25.525047 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-151163e4-1208-48fa-a7bd-6a50aac85081 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:08:25.525674 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-151163e4-1208-48fa-a7bd-6a50aac85081 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 1c131f57-2412-4310-836c-c63e70281fd5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:08:25.532846 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-151163e4-1208-48fa-a7bd-6a50aac85081 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:25.533446 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-151163e4-1208-48fa-a7bd-6a50aac85081 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:25.533990 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-151163e4-1208-48fa-a7bd-6a50aac85081 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:25.534692 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-151163e4-1208-48fa-a7bd-6a50aac85081 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:25.535157 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-151163e4-1208-48fa-a7bd-6a50aac85081 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:25.535616 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-151163e4-1208-48fa-a7bd-6a50aac85081 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:25.549454 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-151163e4-1208-48fa-a7bd-6a50aac85081 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] HTTP exception thrown: Instance 1c131f57-2412-4310-836c-c63e70281fd5 could not be found. Aug 31 17:08:25.551219 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-151163e4-1208-48fa-a7bd-6a50aac85081 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Request method failure captured: Aug 31 17:08:25.551219 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5 HTTP/1.1 Aug 31 17:08:25.551219 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 17:08:25.551219 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 17:08:25.551219 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 17:08:25.551219 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 17:08:25.551219 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 17:08:25.551219 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 17:08:25.551219 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 17:08:25.551219 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 17:08:25.551219 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD5Nv8GJZq1tAU_0B41QogV9NIcJdPpwMr_NXfjBi2_q4oUJIInVGdHr79haO8h167WXFYih4WATMYJ8x__N41D8Vj_h-g4tmjTg1gnT9rlBTtYAJ4qzKuSSR4SRddtXJGZ38GeQNeHZeDZnQxyjFCcsQeloJgCoY--vpZdgiHPrfHyY Aug 31 17:08:25.551219 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 17:08:25.551219 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 17:08:25.551219 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 17:08:25.551219 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 17:08:25.551219 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 17:08:25.551219 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 17:08:25.551219 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: f38fad62a33848c59db3d09c5c9788cc Aug 31 17:08:25.551219 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ServerActionsTestJSON-992920924 Aug 31 17:08:25.551219 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 17:08:25.551219 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 17:08:25.551219 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f38fad62a33848c59db3d09c5c9788cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f38fad62a33848c59db3d09c5c9788cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f38fad62a33848c59db3d09c5c9788cc", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f38fad62a33848c59db3d09c5c9788cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 17:08:25.551219 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ServerActionsTestJSON-992920924 Aug 31 17:08:25.551219 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: f38fad62a33848c59db3d09c5c9788cc Aug 31 17:08:25.551219 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ServerActionsTestJSON-992920924 Aug 31 17:08:25.551219 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ServerActionsTestJSON-992920924-project Aug 31 17:08:25.551219 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 17:08:25.551219 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 17:08:25.551219 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: a3e98ea428604e7da092d46e865cfe1d Aug 31 17:08:25.551219 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ServerActionsTestJSON-992920924-project Aug 31 17:08:25.551219 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 17:08:25.551219 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance 1c131f57-2412-4310-836c-c63e70281fd5 could not be found. Aug 31 17:08:25.551219 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '1c131f57-2412-4310-836c-c63e70281fd5'} Aug 31 17:08:25.551219 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 17:08:25.551219 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:08:25.551219 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 17:08:25.551219 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 17:08:25.551219 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 17:08:25.551219 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 17:08:25.551219 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 17:08:25.551219 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 17:08:25.551219 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 17:08:25.551219 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 17:08:25.551219 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c131f57-2412-4310-836c-c63e70281fd5 could not be found. Aug 31 17:08:25.551219 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:08:25.551219 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:08:25.551219 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:08:25.551219 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:08:25.551219 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:08:25.551219 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:08:25.551219 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 17:08:25.551219 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 17:08:25.551219 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 17:08:25.551219 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 17:08:25.551219 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 17:08:25.551219 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 17:08:25.551219 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 17:08:25.551219 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 17:08:25.551219 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 17:08:25.551219 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 17:08:25.551219 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c131f57-2412-4310-836c-c63e70281fd5 could not be found. Aug 31 17:08:25.551219 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:08:25.551219 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:08:25.551219 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:08:25.556091 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:08:25.556091 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:08:25.556091 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:08:25.556091 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 17:08:25.556091 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 17:08:25.556091 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c131f57-2412-4310-836c-c63e70281fd5 could not be found. Aug 31 17:08:25.556091 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:08:25.556091 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-151163e4-1208-48fa-a7bd-6a50aac85081 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Returning 404 to user: Instance 1c131f57-2412-4310-836c-c63e70281fd5 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 17:08:25.556091 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-151163e4-1208-48fa-a7bd-6a50aac85081 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5" status: 404 len: 111 microversion: 2.1 time: 0.031509 Aug 31 17:08:25.556091 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3793/7602] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:08:25 2022] GET /compute/v2.1/servers/1c131f57-2412-4310-836c-c63e70281fd5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 17:08:25.561327 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-40a58795-6101-47b7-87f6-f2a49c0be65c tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:08:25.561852 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-40a58795-6101-47b7-87f6-f2a49c0be65c tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 280ffda9-548a-4569-8e9b-ee695fb05b8b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:08:25.568739 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-40a58795-6101-47b7-87f6-f2a49c0be65c tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:25.569241 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-40a58795-6101-47b7-87f6-f2a49c0be65c tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:25.569700 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-40a58795-6101-47b7-87f6-f2a49c0be65c tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:25.570410 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-40a58795-6101-47b7-87f6-f2a49c0be65c tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:25.570885 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-40a58795-6101-47b7-87f6-f2a49c0be65c tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:25.571326 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-40a58795-6101-47b7-87f6-f2a49c0be65c tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:25.585745 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-40a58795-6101-47b7-87f6-f2a49c0be65c tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] HTTP exception thrown: Instance 280ffda9-548a-4569-8e9b-ee695fb05b8b could not be found. Aug 31 17:08:25.587443 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-40a58795-6101-47b7-87f6-f2a49c0be65c tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Request method failure captured: Aug 31 17:08:25.587443 n-d-850499-9 devstack@n-api.service[122257]: request: DELETE /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b HTTP/1.1 Aug 31 17:08:25.587443 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 17:08:25.587443 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 17:08:25.587443 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 17:08:25.587443 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 17:08:25.587443 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 17:08:25.587443 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 17:08:25.587443 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 17:08:25.587443 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 17:08:25.587443 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD5Nv8GJZq1tAU_0B41QogV9NIcJdPpwMr_NXfjBi2_q4oUJIInVGdHr79haO8h167WXFYih4WATMYJ8x__N41D8Vj_h-g4tmjTg1gnT9rlBTtYAJ4qzKuSSR4SRddtXJGZ38GeQNeHZeDZnQxyjFCcsQeloJgCoY--vpZdgiHPrfHyY Aug 31 17:08:25.587443 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 17:08:25.587443 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 17:08:25.587443 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 17:08:25.587443 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 17:08:25.587443 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 17:08:25.587443 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 17:08:25.587443 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: f38fad62a33848c59db3d09c5c9788cc Aug 31 17:08:25.587443 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ServerActionsTestJSON-992920924 Aug 31 17:08:25.587443 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 17:08:25.587443 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 17:08:25.587443 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f38fad62a33848c59db3d09c5c9788cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f38fad62a33848c59db3d09c5c9788cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f38fad62a33848c59db3d09c5c9788cc", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f38fad62a33848c59db3d09c5c9788cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 17:08:25.587443 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ServerActionsTestJSON-992920924 Aug 31 17:08:25.587443 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: f38fad62a33848c59db3d09c5c9788cc Aug 31 17:08:25.587443 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ServerActionsTestJSON-992920924 Aug 31 17:08:25.587443 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ServerActionsTestJSON-992920924-project Aug 31 17:08:25.587443 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 17:08:25.587443 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 17:08:25.587443 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: a3e98ea428604e7da092d46e865cfe1d Aug 31 17:08:25.587443 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ServerActionsTestJSON-992920924-project Aug 31 17:08:25.587443 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 17:08:25.587443 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance 280ffda9-548a-4569-8e9b-ee695fb05b8b could not be found. Aug 31 17:08:25.587443 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '280ffda9-548a-4569-8e9b-ee695fb05b8b'} Aug 31 17:08:25.587443 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 17:08:25.587443 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:08:25.587443 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 17:08:25.587443 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 17:08:25.587443 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 17:08:25.587443 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 17:08:25.587443 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 17:08:25.587443 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 17:08:25.587443 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 17:08:25.587443 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 17:08:25.587443 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 280ffda9-548a-4569-8e9b-ee695fb05b8b could not be found. Aug 31 17:08:25.587443 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 17:08:25.587443 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:08:25.587443 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 17:08:25.587443 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:08:25.587443 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:08:25.587443 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:08:25.587443 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 17:08:25.587443 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 17:08:25.587443 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 17:08:25.587443 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 17:08:25.587443 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 17:08:25.587443 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 17:08:25.587443 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 17:08:25.587443 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 17:08:25.587443 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 17:08:25.587443 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 17:08:25.587443 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 17:08:25.587443 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 17:08:25.591586 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 280ffda9-548a-4569-8e9b-ee695fb05b8b could not be found. Aug 31 17:08:25.591586 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 17:08:25.591586 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:08:25.591586 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 17:08:25.591586 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:08:25.591586 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:08:25.591586 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:08:25.591586 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 17:08:25.591586 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 17:08:25.591586 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 280ffda9-548a-4569-8e9b-ee695fb05b8b could not be found. Aug 31 17:08:25.591586 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 17:08:25.591586 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-40a58795-6101-47b7-87f6-f2a49c0be65c tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Returning 404 to user: Instance 280ffda9-548a-4569-8e9b-ee695fb05b8b could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 17:08:25.591586 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-40a58795-6101-47b7-87f6-f2a49c0be65c tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "DELETE /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b" status: 404 len: 111 microversion: 2.1 time: 0.031532 Aug 31 17:08:25.591586 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3810/7603] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 17:08:25 2022] DELETE /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 17:08:25.597757 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-685247fb-8d3a-4b4d-8e7f-195b469be6b4 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:08:25.598383 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-685247fb-8d3a-4b4d-8e7f-195b469be6b4 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 280ffda9-548a-4569-8e9b-ee695fb05b8b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:08:25.604953 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-685247fb-8d3a-4b4d-8e7f-195b469be6b4 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:25.605448 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-685247fb-8d3a-4b4d-8e7f-195b469be6b4 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:25.605883 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-685247fb-8d3a-4b4d-8e7f-195b469be6b4 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:25.606595 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-685247fb-8d3a-4b4d-8e7f-195b469be6b4 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:25.607052 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-685247fb-8d3a-4b4d-8e7f-195b469be6b4 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:25.607481 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-685247fb-8d3a-4b4d-8e7f-195b469be6b4 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:25.622862 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-685247fb-8d3a-4b4d-8e7f-195b469be6b4 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] HTTP exception thrown: Instance 280ffda9-548a-4569-8e9b-ee695fb05b8b could not be found. Aug 31 17:08:25.624483 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-685247fb-8d3a-4b4d-8e7f-195b469be6b4 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Request method failure captured: Aug 31 17:08:25.624483 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b HTTP/1.1 Aug 31 17:08:25.624483 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 17:08:25.624483 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 17:08:25.624483 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 17:08:25.624483 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 17:08:25.624483 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 17:08:25.624483 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 17:08:25.624483 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 17:08:25.624483 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 17:08:25.624483 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD5Nv8GJZq1tAU_0B41QogV9NIcJdPpwMr_NXfjBi2_q4oUJIInVGdHr79haO8h167WXFYih4WATMYJ8x__N41D8Vj_h-g4tmjTg1gnT9rlBTtYAJ4qzKuSSR4SRddtXJGZ38GeQNeHZeDZnQxyjFCcsQeloJgCoY--vpZdgiHPrfHyY Aug 31 17:08:25.624483 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 17:08:25.624483 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 17:08:25.624483 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 17:08:25.624483 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 17:08:25.624483 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 17:08:25.624483 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 17:08:25.624483 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: f38fad62a33848c59db3d09c5c9788cc Aug 31 17:08:25.624483 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ServerActionsTestJSON-992920924 Aug 31 17:08:25.624483 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 17:08:25.624483 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 17:08:25.624483 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f38fad62a33848c59db3d09c5c9788cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f38fad62a33848c59db3d09c5c9788cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f38fad62a33848c59db3d09c5c9788cc", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f38fad62a33848c59db3d09c5c9788cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 17:08:25.624483 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ServerActionsTestJSON-992920924 Aug 31 17:08:25.624483 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: f38fad62a33848c59db3d09c5c9788cc Aug 31 17:08:25.624483 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ServerActionsTestJSON-992920924 Aug 31 17:08:25.624483 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ServerActionsTestJSON-992920924-project Aug 31 17:08:25.624483 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 17:08:25.624483 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 17:08:25.624483 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: a3e98ea428604e7da092d46e865cfe1d Aug 31 17:08:25.624483 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ServerActionsTestJSON-992920924-project Aug 31 17:08:25.624483 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 17:08:25.624483 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance 280ffda9-548a-4569-8e9b-ee695fb05b8b could not be found. Aug 31 17:08:25.624483 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '280ffda9-548a-4569-8e9b-ee695fb05b8b'} Aug 31 17:08:25.624483 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 17:08:25.624483 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:08:25.624483 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 17:08:25.624483 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 17:08:25.624483 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 17:08:25.624483 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 17:08:25.624483 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 17:08:25.624483 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 17:08:25.624483 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 17:08:25.624483 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 17:08:25.624483 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 280ffda9-548a-4569-8e9b-ee695fb05b8b could not be found. Aug 31 17:08:25.624483 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:08:25.624483 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:08:25.624483 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:08:25.624483 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:08:25.624483 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:08:25.624483 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:08:25.624483 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 17:08:25.624483 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 17:08:25.624483 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 17:08:25.624483 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 17:08:25.624483 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 17:08:25.624483 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 17:08:25.624483 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 17:08:25.624483 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 17:08:25.624483 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 17:08:25.624483 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 17:08:25.624483 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 280ffda9-548a-4569-8e9b-ee695fb05b8b could not be found. Aug 31 17:08:25.624483 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:08:25.624483 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:08:25.624483 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:08:25.629754 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:08:25.629754 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:08:25.629754 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:08:25.629754 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 17:08:25.629754 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 17:08:25.629754 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 280ffda9-548a-4569-8e9b-ee695fb05b8b could not be found. Aug 31 17:08:25.629754 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:08:25.629754 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-685247fb-8d3a-4b4d-8e7f-195b469be6b4 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Returning 404 to user: Instance 280ffda9-548a-4569-8e9b-ee695fb05b8b could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 17:08:25.629754 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-685247fb-8d3a-4b4d-8e7f-195b469be6b4 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b" status: 404 len: 111 microversion: 2.1 time: 0.032312 Aug 31 17:08:25.629754 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3794/7604] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:08:25 2022] GET /compute/v2.1/servers/280ffda9-548a-4569-8e9b-ee695fb05b8b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 17:08:25.636530 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a50eb850-8130-481a-87cc-c95cd521db13 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:08:25.637054 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a50eb850-8130-481a-87cc-c95cd521db13 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: c8e9aa29-8a3f-4571-8eb1-ec393a43b095] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:08:25.644877 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a50eb850-8130-481a-87cc-c95cd521db13 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:25.645402 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a50eb850-8130-481a-87cc-c95cd521db13 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:25.645866 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a50eb850-8130-481a-87cc-c95cd521db13 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:25.646612 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a50eb850-8130-481a-87cc-c95cd521db13 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:25.647104 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a50eb850-8130-481a-87cc-c95cd521db13 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:25.647582 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a50eb850-8130-481a-87cc-c95cd521db13 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:25.662939 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-a50eb850-8130-481a-87cc-c95cd521db13 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] HTTP exception thrown: Instance c8e9aa29-8a3f-4571-8eb1-ec393a43b095 could not be found. Aug 31 17:08:25.664598 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a50eb850-8130-481a-87cc-c95cd521db13 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Request method failure captured: Aug 31 17:08:25.664598 n-d-850499-9 devstack@n-api.service[122257]: request: DELETE /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095 HTTP/1.1 Aug 31 17:08:25.664598 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 17:08:25.664598 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 17:08:25.664598 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 17:08:25.664598 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 17:08:25.664598 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 17:08:25.664598 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 17:08:25.664598 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 17:08:25.664598 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 17:08:25.664598 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD5Nv8GJZq1tAU_0B41QogV9NIcJdPpwMr_NXfjBi2_q4oUJIInVGdHr79haO8h167WXFYih4WATMYJ8x__N41D8Vj_h-g4tmjTg1gnT9rlBTtYAJ4qzKuSSR4SRddtXJGZ38GeQNeHZeDZnQxyjFCcsQeloJgCoY--vpZdgiHPrfHyY Aug 31 17:08:25.664598 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 17:08:25.664598 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 17:08:25.664598 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 17:08:25.664598 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 17:08:25.664598 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 17:08:25.664598 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 17:08:25.664598 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: f38fad62a33848c59db3d09c5c9788cc Aug 31 17:08:25.664598 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ServerActionsTestJSON-992920924 Aug 31 17:08:25.664598 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 17:08:25.664598 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 17:08:25.664598 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f38fad62a33848c59db3d09c5c9788cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f38fad62a33848c59db3d09c5c9788cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f38fad62a33848c59db3d09c5c9788cc", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f38fad62a33848c59db3d09c5c9788cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 17:08:25.664598 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ServerActionsTestJSON-992920924 Aug 31 17:08:25.664598 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: f38fad62a33848c59db3d09c5c9788cc Aug 31 17:08:25.664598 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ServerActionsTestJSON-992920924 Aug 31 17:08:25.664598 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ServerActionsTestJSON-992920924-project Aug 31 17:08:25.664598 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 17:08:25.664598 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 17:08:25.664598 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: a3e98ea428604e7da092d46e865cfe1d Aug 31 17:08:25.664598 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ServerActionsTestJSON-992920924-project Aug 31 17:08:25.664598 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 17:08:25.664598 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance c8e9aa29-8a3f-4571-8eb1-ec393a43b095 could not be found. Aug 31 17:08:25.664598 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': 'c8e9aa29-8a3f-4571-8eb1-ec393a43b095'} Aug 31 17:08:25.664598 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 17:08:25.664598 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:08:25.664598 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 17:08:25.664598 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 17:08:25.664598 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 17:08:25.664598 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 17:08:25.664598 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 17:08:25.664598 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 17:08:25.664598 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 17:08:25.664598 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 17:08:25.664598 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8e9aa29-8a3f-4571-8eb1-ec393a43b095 could not be found. Aug 31 17:08:25.664598 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 17:08:25.664598 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:08:25.664598 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 17:08:25.664598 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:08:25.664598 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:08:25.664598 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:08:25.664598 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 17:08:25.664598 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 17:08:25.664598 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 17:08:25.664598 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 17:08:25.664598 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 17:08:25.664598 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 17:08:25.664598 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 17:08:25.664598 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 17:08:25.664598 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 17:08:25.664598 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 17:08:25.664598 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 17:08:25.664598 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 17:08:25.668643 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8e9aa29-8a3f-4571-8eb1-ec393a43b095 could not be found. Aug 31 17:08:25.668643 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 17:08:25.668643 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:08:25.668643 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 17:08:25.668643 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:08:25.668643 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:08:25.668643 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:08:25.668643 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 17:08:25.668643 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 17:08:25.668643 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8e9aa29-8a3f-4571-8eb1-ec393a43b095 could not be found. Aug 31 17:08:25.668643 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 17:08:25.668643 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a50eb850-8130-481a-87cc-c95cd521db13 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Returning 404 to user: Instance c8e9aa29-8a3f-4571-8eb1-ec393a43b095 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 17:08:25.668643 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a50eb850-8130-481a-87cc-c95cd521db13 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "DELETE /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095" status: 404 len: 111 microversion: 2.1 time: 0.033668 Aug 31 17:08:25.668643 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3811/7605] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 17:08:25 2022] DELETE /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 17:08:25.674865 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4e3f4297-9200-4b68-8675-d6a6eea26c48 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:08:25.675478 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4e3f4297-9200-4b68-8675-d6a6eea26c48 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: c8e9aa29-8a3f-4571-8eb1-ec393a43b095] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:08:25.681834 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4e3f4297-9200-4b68-8675-d6a6eea26c48 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:25.682325 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4e3f4297-9200-4b68-8675-d6a6eea26c48 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:25.682765 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4e3f4297-9200-4b68-8675-d6a6eea26c48 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:25.683463 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4e3f4297-9200-4b68-8675-d6a6eea26c48 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:25.683947 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4e3f4297-9200-4b68-8675-d6a6eea26c48 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:25.684376 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4e3f4297-9200-4b68-8675-d6a6eea26c48 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:25.699068 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-4e3f4297-9200-4b68-8675-d6a6eea26c48 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] HTTP exception thrown: Instance c8e9aa29-8a3f-4571-8eb1-ec393a43b095 could not be found. Aug 31 17:08:25.700688 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4e3f4297-9200-4b68-8675-d6a6eea26c48 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Request method failure captured: Aug 31 17:08:25.700688 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095 HTTP/1.1 Aug 31 17:08:25.700688 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 17:08:25.700688 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 17:08:25.700688 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 17:08:25.700688 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 17:08:25.700688 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 17:08:25.700688 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 17:08:25.700688 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 17:08:25.700688 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 17:08:25.700688 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD5Nv8GJZq1tAU_0B41QogV9NIcJdPpwMr_NXfjBi2_q4oUJIInVGdHr79haO8h167WXFYih4WATMYJ8x__N41D8Vj_h-g4tmjTg1gnT9rlBTtYAJ4qzKuSSR4SRddtXJGZ38GeQNeHZeDZnQxyjFCcsQeloJgCoY--vpZdgiHPrfHyY Aug 31 17:08:25.700688 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 17:08:25.700688 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 17:08:25.700688 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 17:08:25.700688 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 17:08:25.700688 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 17:08:25.700688 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 17:08:25.700688 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: f38fad62a33848c59db3d09c5c9788cc Aug 31 17:08:25.700688 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ServerActionsTestJSON-992920924 Aug 31 17:08:25.700688 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 17:08:25.700688 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 17:08:25.700688 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f38fad62a33848c59db3d09c5c9788cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f38fad62a33848c59db3d09c5c9788cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f38fad62a33848c59db3d09c5c9788cc", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f38fad62a33848c59db3d09c5c9788cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 17:08:25.700688 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ServerActionsTestJSON-992920924 Aug 31 17:08:25.700688 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: f38fad62a33848c59db3d09c5c9788cc Aug 31 17:08:25.700688 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ServerActionsTestJSON-992920924 Aug 31 17:08:25.700688 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ServerActionsTestJSON-992920924-project Aug 31 17:08:25.700688 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 17:08:25.700688 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 17:08:25.700688 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: a3e98ea428604e7da092d46e865cfe1d Aug 31 17:08:25.700688 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ServerActionsTestJSON-992920924-project Aug 31 17:08:25.700688 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 17:08:25.700688 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance c8e9aa29-8a3f-4571-8eb1-ec393a43b095 could not be found. Aug 31 17:08:25.700688 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': 'c8e9aa29-8a3f-4571-8eb1-ec393a43b095'} Aug 31 17:08:25.700688 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 17:08:25.700688 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:08:25.700688 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 17:08:25.700688 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 17:08:25.700688 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 17:08:25.700688 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 17:08:25.700688 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 17:08:25.700688 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 17:08:25.700688 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 17:08:25.700688 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 17:08:25.700688 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8e9aa29-8a3f-4571-8eb1-ec393a43b095 could not be found. Aug 31 17:08:25.700688 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:08:25.700688 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:08:25.700688 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:08:25.700688 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:08:25.700688 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:08:25.700688 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:08:25.700688 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 17:08:25.700688 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 17:08:25.700688 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 17:08:25.700688 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 17:08:25.700688 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 17:08:25.700688 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 17:08:25.700688 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 17:08:25.700688 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 17:08:25.700688 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 17:08:25.700688 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 17:08:25.700688 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8e9aa29-8a3f-4571-8eb1-ec393a43b095 could not be found. Aug 31 17:08:25.700688 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:08:25.700688 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:08:25.700688 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:08:25.706152 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:08:25.706152 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:08:25.706152 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:08:25.706152 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 17:08:25.706152 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 17:08:25.706152 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8e9aa29-8a3f-4571-8eb1-ec393a43b095 could not be found. Aug 31 17:08:25.706152 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:08:25.706152 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4e3f4297-9200-4b68-8675-d6a6eea26c48 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Returning 404 to user: Instance c8e9aa29-8a3f-4571-8eb1-ec393a43b095 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 17:08:25.706152 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4e3f4297-9200-4b68-8675-d6a6eea26c48 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095" status: 404 len: 111 microversion: 2.1 time: 0.031151 Aug 31 17:08:25.706794 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3795/7606] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:08:25 2022] GET /compute/v2.1/servers/c8e9aa29-8a3f-4571-8eb1-ec393a43b095 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 17:08:25.711910 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5e8b5304-26a0-47f7-8469-46b69ef8cba3 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:08:25.712459 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5e8b5304-26a0-47f7-8469-46b69ef8cba3 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 9771d91b-c36b-441b-98a0-38cbdc43beba] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:08:25.718654 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5e8b5304-26a0-47f7-8469-46b69ef8cba3 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:25.719162 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5e8b5304-26a0-47f7-8469-46b69ef8cba3 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:25.719647 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5e8b5304-26a0-47f7-8469-46b69ef8cba3 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:25.720361 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5e8b5304-26a0-47f7-8469-46b69ef8cba3 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:25.720845 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5e8b5304-26a0-47f7-8469-46b69ef8cba3 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:25.721286 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5e8b5304-26a0-47f7-8469-46b69ef8cba3 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:25.735086 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-5e8b5304-26a0-47f7-8469-46b69ef8cba3 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] HTTP exception thrown: Instance 9771d91b-c36b-441b-98a0-38cbdc43beba could not be found. Aug 31 17:08:25.737236 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5e8b5304-26a0-47f7-8469-46b69ef8cba3 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Request method failure captured: Aug 31 17:08:25.737236 n-d-850499-9 devstack@n-api.service[122257]: request: DELETE /compute/v2.1/servers/9771d91b-c36b-441b-98a0-38cbdc43beba HTTP/1.1 Aug 31 17:08:25.737236 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 17:08:25.737236 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 17:08:25.737236 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 17:08:25.737236 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 17:08:25.737236 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 17:08:25.737236 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 17:08:25.737236 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 17:08:25.737236 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 17:08:25.737236 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD5Nv8GJZq1tAU_0B41QogV9NIcJdPpwMr_NXfjBi2_q4oUJIInVGdHr79haO8h167WXFYih4WATMYJ8x__N41D8Vj_h-g4tmjTg1gnT9rlBTtYAJ4qzKuSSR4SRddtXJGZ38GeQNeHZeDZnQxyjFCcsQeloJgCoY--vpZdgiHPrfHyY Aug 31 17:08:25.737236 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 17:08:25.737236 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 17:08:25.737236 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 17:08:25.737236 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 17:08:25.737236 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 17:08:25.737236 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 17:08:25.737236 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: f38fad62a33848c59db3d09c5c9788cc Aug 31 17:08:25.737236 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ServerActionsTestJSON-992920924 Aug 31 17:08:25.737236 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 17:08:25.737236 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 17:08:25.737236 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f38fad62a33848c59db3d09c5c9788cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f38fad62a33848c59db3d09c5c9788cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f38fad62a33848c59db3d09c5c9788cc", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f38fad62a33848c59db3d09c5c9788cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 17:08:25.737236 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ServerActionsTestJSON-992920924 Aug 31 17:08:25.737236 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: f38fad62a33848c59db3d09c5c9788cc Aug 31 17:08:25.737236 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ServerActionsTestJSON-992920924 Aug 31 17:08:25.737236 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ServerActionsTestJSON-992920924-project Aug 31 17:08:25.737236 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 17:08:25.737236 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 17:08:25.737236 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: a3e98ea428604e7da092d46e865cfe1d Aug 31 17:08:25.737236 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ServerActionsTestJSON-992920924-project Aug 31 17:08:25.737236 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 17:08:25.737236 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance 9771d91b-c36b-441b-98a0-38cbdc43beba could not be found. Aug 31 17:08:25.737236 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '9771d91b-c36b-441b-98a0-38cbdc43beba'} Aug 31 17:08:25.737236 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 17:08:25.737236 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:08:25.737236 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 17:08:25.737236 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 17:08:25.737236 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 17:08:25.737236 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 17:08:25.737236 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 17:08:25.737236 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 17:08:25.737236 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 17:08:25.737236 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 17:08:25.737236 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9771d91b-c36b-441b-98a0-38cbdc43beba could not be found. Aug 31 17:08:25.737236 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 17:08:25.737236 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:08:25.737236 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 17:08:25.737236 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:08:25.737236 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:08:25.737236 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:08:25.737236 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 17:08:25.737236 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 17:08:25.737236 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 17:08:25.737236 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 17:08:25.737236 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 17:08:25.737236 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 17:08:25.737236 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 17:08:25.737236 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 17:08:25.737236 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 17:08:25.737236 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 17:08:25.737236 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 17:08:25.737236 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 17:08:25.744228 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9771d91b-c36b-441b-98a0-38cbdc43beba could not be found. Aug 31 17:08:25.744228 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 17:08:25.744228 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:08:25.744228 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 17:08:25.744228 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:08:25.744228 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:08:25.744228 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:08:25.744228 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 17:08:25.744228 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 17:08:25.744228 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9771d91b-c36b-441b-98a0-38cbdc43beba could not be found. Aug 31 17:08:25.744228 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 17:08:25.744228 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5e8b5304-26a0-47f7-8469-46b69ef8cba3 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Returning 404 to user: Instance 9771d91b-c36b-441b-98a0-38cbdc43beba could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 17:08:25.744228 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5e8b5304-26a0-47f7-8469-46b69ef8cba3 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "DELETE /compute/v2.1/servers/9771d91b-c36b-441b-98a0-38cbdc43beba" status: 404 len: 111 microversion: 2.1 time: 0.030818 Aug 31 17:08:25.744228 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3812/7607] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 17:08:25 2022] DELETE /compute/v2.1/servers/9771d91b-c36b-441b-98a0-38cbdc43beba => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 17:08:25.747035 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f96c4797-90dc-4d8b-bd68-e145a3b677be tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:08:25.747681 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f96c4797-90dc-4d8b-bd68-e145a3b677be tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] [instance: 9771d91b-c36b-441b-98a0-38cbdc43beba] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:08:25.754536 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f96c4797-90dc-4d8b-bd68-e145a3b677be tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:25.755089 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f96c4797-90dc-4d8b-bd68-e145a3b677be tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:25.755478 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f96c4797-90dc-4d8b-bd68-e145a3b677be tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:25.756214 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f96c4797-90dc-4d8b-bd68-e145a3b677be tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:25.756681 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f96c4797-90dc-4d8b-bd68-e145a3b677be tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:25.757251 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f96c4797-90dc-4d8b-bd68-e145a3b677be tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:25.771234 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-f96c4797-90dc-4d8b-bd68-e145a3b677be tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] HTTP exception thrown: Instance 9771d91b-c36b-441b-98a0-38cbdc43beba could not be found. Aug 31 17:08:25.772826 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f96c4797-90dc-4d8b-bd68-e145a3b677be tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Request method failure captured: Aug 31 17:08:25.772826 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/9771d91b-c36b-441b-98a0-38cbdc43beba HTTP/1.1 Aug 31 17:08:25.772826 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 17:08:25.772826 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 17:08:25.772826 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 17:08:25.772826 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 17:08:25.772826 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 17:08:25.772826 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 17:08:25.772826 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 17:08:25.772826 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 17:08:25.772826 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD5Nv8GJZq1tAU_0B41QogV9NIcJdPpwMr_NXfjBi2_q4oUJIInVGdHr79haO8h167WXFYih4WATMYJ8x__N41D8Vj_h-g4tmjTg1gnT9rlBTtYAJ4qzKuSSR4SRddtXJGZ38GeQNeHZeDZnQxyjFCcsQeloJgCoY--vpZdgiHPrfHyY Aug 31 17:08:25.772826 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 17:08:25.772826 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 17:08:25.772826 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 17:08:25.772826 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 17:08:25.772826 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 17:08:25.772826 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 17:08:25.772826 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: f38fad62a33848c59db3d09c5c9788cc Aug 31 17:08:25.772826 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ServerActionsTestJSON-992920924 Aug 31 17:08:25.772826 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 17:08:25.772826 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 17:08:25.772826 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f38fad62a33848c59db3d09c5c9788cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f38fad62a33848c59db3d09c5c9788cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f38fad62a33848c59db3d09c5c9788cc", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f38fad62a33848c59db3d09c5c9788cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 17:08:25.772826 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ServerActionsTestJSON-992920924 Aug 31 17:08:25.772826 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: f38fad62a33848c59db3d09c5c9788cc Aug 31 17:08:25.772826 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ServerActionsTestJSON-992920924 Aug 31 17:08:25.772826 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ServerActionsTestJSON-992920924-project Aug 31 17:08:25.772826 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 17:08:25.772826 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 17:08:25.772826 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: a3e98ea428604e7da092d46e865cfe1d Aug 31 17:08:25.772826 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ServerActionsTestJSON-992920924-project Aug 31 17:08:25.772826 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 17:08:25.772826 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance 9771d91b-c36b-441b-98a0-38cbdc43beba could not be found. Aug 31 17:08:25.772826 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '9771d91b-c36b-441b-98a0-38cbdc43beba'} Aug 31 17:08:25.772826 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 17:08:25.772826 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:08:25.772826 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 17:08:25.772826 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 17:08:25.772826 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 17:08:25.772826 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 17:08:25.772826 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 17:08:25.772826 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 17:08:25.772826 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 17:08:25.772826 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 17:08:25.772826 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9771d91b-c36b-441b-98a0-38cbdc43beba could not be found. Aug 31 17:08:25.772826 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:08:25.772826 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:08:25.772826 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:08:25.772826 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:08:25.772826 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:08:25.772826 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:08:25.772826 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 17:08:25.772826 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 17:08:25.772826 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 17:08:25.772826 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 17:08:25.772826 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 17:08:25.772826 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 17:08:25.772826 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 17:08:25.772826 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 17:08:25.772826 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 17:08:25.772826 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 17:08:25.772826 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9771d91b-c36b-441b-98a0-38cbdc43beba could not be found. Aug 31 17:08:25.772826 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:08:25.772826 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:08:25.772826 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:08:25.781042 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:08:25.781042 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:08:25.781042 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:08:25.781042 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 17:08:25.781042 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 17:08:25.781042 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9771d91b-c36b-441b-98a0-38cbdc43beba could not be found. Aug 31 17:08:25.781042 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:08:25.781042 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f96c4797-90dc-4d8b-bd68-e145a3b677be tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Returning 404 to user: Instance 9771d91b-c36b-441b-98a0-38cbdc43beba could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 17:08:25.781042 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f96c4797-90dc-4d8b-bd68-e145a3b677be tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "GET /compute/v2.1/servers/9771d91b-c36b-441b-98a0-38cbdc43beba" status: 404 len: 111 microversion: 2.1 time: 0.031054 Aug 31 17:08:25.781042 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3796/7608] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:08:25 2022] GET /compute/v2.1/servers/9771d91b-c36b-441b-98a0-38cbdc43beba => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 17:08:25.782868 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-29821f51-4663-4d34-9ebc-f9b00a4a1539 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] Calling method '.version_select at 0x7f5ae8ea55e0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:08:25.807537 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-29821f51-4663-4d34-9ebc-f9b00a4a1539 tempest-ServerActionsTestJSON-992920924 tempest-ServerActionsTestJSON-992920924-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1911906825" status: 202 len: 0 microversion: 2.1 time: 0.028382 Aug 31 17:08:25.808373 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3813/7609] 10.222.0.61 () {58 vars in 1221 bytes} [Wed Aug 31 17:08:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1911906825 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 17:08:35.415372 n-d-850499-9 devstack@n-api.service[122256]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 17:08:35.416077 n-d-850499-9 devstack@n-api.service[122256]: Wed Aug 31 17:08:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.61) !!! Aug 31 17:08:35.418076 n-d-850499-9 devstack@n-api.service[122256]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 17:08:35.418214 n-d-850499-9 devstack@n-api.service[122256]: Wed Aug 31 17:08:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.61) !!! Aug 31 17:08:35.593900 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-50e432ac-e6d3-4e9a-9c7b-defaaa1c9381 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-179774657", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "networks": [{"uuid": "39b119db-4696-4864-a7e0-1485ad8c2f9f"}]}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:08:35.657383 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-50e432ac-e6d3-4e9a-9c7b-defaaa1c9381 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] validate_networks() for [('39b119db-4696-4864-a7e0-1485ad8c2f9f', None, None, None, None, None)] {{(pid=122256) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 17:08:35.762069 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=69 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:08:36.121698 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-50e432ac-e6d3-4e9a-9c7b-defaaa1c9381 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 17:08:36.122294 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-50e432ac-e6d3-4e9a-9c7b-defaaa1c9381 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 17:08:36.122806 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-50e432ac-e6d3-4e9a-9c7b-defaaa1c9381 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 17:08:36.123222 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-50e432ac-e6d3-4e9a-9c7b-defaaa1c9381 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 17:08:36.123689 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-50e432ac-e6d3-4e9a-9c7b-defaaa1c9381 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 17:08:36.133908 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-50e432ac-e6d3-4e9a-9c7b-defaaa1c9381 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:36.134399 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-50e432ac-e6d3-4e9a-9c7b-defaaa1c9381 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:36.134841 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-50e432ac-e6d3-4e9a-9c7b-defaaa1c9381 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:36.135623 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-50e432ac-e6d3-4e9a-9c7b-defaaa1c9381 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:36.136085 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-50e432ac-e6d3-4e9a-9c7b-defaaa1c9381 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:36.136516 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-50e432ac-e6d3-4e9a-9c7b-defaaa1c9381 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:36.153791 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-50e432ac-e6d3-4e9a-9c7b-defaaa1c9381 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Getting quotas for project 35aeac1bc04346f8b7e3f04bb62038b5. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 17:08:36.159255 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-50e432ac-e6d3-4e9a-9c7b-defaaa1c9381 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Getting quotas for user 7d865bc8e6c24be8933711243c693084 and project 35aeac1bc04346f8b7e3f04bb62038b5. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 17:08:36.172778 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-50e432ac-e6d3-4e9a-9c7b-defaaa1c9381 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Going to run 1 instances... {{(pid=122256) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 17:08:36.175918 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-50e432ac-e6d3-4e9a-9c7b-defaaa1c9381 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] [instance: 3a883a82-d992-4428-befc-9e667cee0d5c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 17:08:36.226598 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-50e432ac-e6d3-4e9a-9c7b-defaaa1c9381 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.817231 Aug 31 17:08:36.228110 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3797/7610] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 17:08:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 820 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 17:08:36.239017 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:08:36.239845 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:08:36.244285 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-933f46b6-1844-4f13-b476-98cce8aaa19e tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:08:36.244934 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-933f46b6-1844-4f13-b476-98cce8aaa19e tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] [instance: 3a883a82-d992-4428-befc-9e667cee0d5c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:08:36.318396 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-933f46b6-1844-4f13-b476-98cce8aaa19e tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d865bc8e6c24be8933711243c693084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35aeac1bc04346f8b7e3f04bb62038b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:08:36.326374 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-933f46b6-1844-4f13-b476-98cce8aaa19e tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] 10.222.0.61 "GET /compute/v2.1/servers/3a883a82-d992-4428-befc-9e667cee0d5c" status: 200 len: 1216 microversion: 2.1 time: 0.090851 Aug 31 17:08:36.327136 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3814/7611] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:08:36 2022] GET /compute/v2.1/servers/3a883a82-d992-4428-befc-9e667cee0d5c => generated 1216 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:08:37.349669 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8dba1a87-90ed-4395-b9f4-9a2367a032af tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:08:37.350327 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8dba1a87-90ed-4395-b9f4-9a2367a032af tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] [instance: 3a883a82-d992-4428-befc-9e667cee0d5c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:08:37.357443 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8dba1a87-90ed-4395-b9f4-9a2367a032af tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:37.357870 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8dba1a87-90ed-4395-b9f4-9a2367a032af tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:37.358345 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8dba1a87-90ed-4395-b9f4-9a2367a032af tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:37.359053 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8dba1a87-90ed-4395-b9f4-9a2367a032af tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:37.359545 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8dba1a87-90ed-4395-b9f4-9a2367a032af tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:37.359989 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8dba1a87-90ed-4395-b9f4-9a2367a032af tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:37.429718 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8dba1a87-90ed-4395-b9f4-9a2367a032af tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d865bc8e6c24be8933711243c693084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35aeac1bc04346f8b7e3f04bb62038b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:08:37.437889 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8dba1a87-90ed-4395-b9f4-9a2367a032af tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] 10.222.0.61 "GET /compute/v2.1/servers/3a883a82-d992-4428-befc-9e667cee0d5c" status: 200 len: 1268 microversion: 2.1 time: 0.093669 Aug 31 17:08:37.442230 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3798/7612] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:08:37 2022] GET /compute/v2.1/servers/3a883a82-d992-4428-befc-9e667cee0d5c => generated 1268 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:08:38.460927 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-271a1818-fc0a-4e07-a7fb-20e57ba6a513 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:08:38.461658 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-271a1818-fc0a-4e07-a7fb-20e57ba6a513 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] [instance: 3a883a82-d992-4428-befc-9e667cee0d5c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:08:38.473380 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-271a1818-fc0a-4e07-a7fb-20e57ba6a513 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:38.476030 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-271a1818-fc0a-4e07-a7fb-20e57ba6a513 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:38.477101 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-271a1818-fc0a-4e07-a7fb-20e57ba6a513 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:38.478103 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-271a1818-fc0a-4e07-a7fb-20e57ba6a513 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:38.478800 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-271a1818-fc0a-4e07-a7fb-20e57ba6a513 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:38.483412 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-271a1818-fc0a-4e07-a7fb-20e57ba6a513 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:38.754528 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-271a1818-fc0a-4e07-a7fb-20e57ba6a513 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d865bc8e6c24be8933711243c693084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35aeac1bc04346f8b7e3f04bb62038b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:08:38.771719 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-271a1818-fc0a-4e07-a7fb-20e57ba6a513 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] 10.222.0.61 "GET /compute/v2.1/servers/3a883a82-d992-4428-befc-9e667cee0d5c" status: 200 len: 1316 microversion: 2.1 time: 0.314873 Aug 31 17:08:38.780370 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3815/7613] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:08:38 2022] GET /compute/v2.1/servers/3a883a82-d992-4428-befc-9e667cee0d5c => generated 1316 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:08:39.113151 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-84855375-c7c4-4fd4-9070-9ccd0d63d49e req-27a066a3-2528-4d3d-bdc8-63dcacbc34cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a883a82-d992-4428-befc-9e667cee0d5c", "tag": "41127c66-bac2-4d09-991a-7b365aa8d78f"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:08:39.120623 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:08:39.130644 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-84855375-c7c4-4fd4-9070-9ccd0d63d49e req-27a066a3-2528-4d3d-bdc8-63dcacbc34cc service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:39.131283 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-84855375-c7c4-4fd4-9070-9ccd0d63d49e req-27a066a3-2528-4d3d-bdc8-63dcacbc34cc service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:39.132008 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-84855375-c7c4-4fd4-9070-9ccd0d63d49e req-27a066a3-2528-4d3d-bdc8-63dcacbc34cc service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:39.148755 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-84855375-c7c4-4fd4-9070-9ccd0d63d49e req-27a066a3-2528-4d3d-bdc8-63dcacbc34cc service nova] Creating event network-changed:41127c66-bac2-4d09-991a-7b365aa8d78f for instance 3a883a82-d992-4428-befc-9e667cee0d5c on n-h2-850499-9 Aug 31 17:08:39.154696 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-84855375-c7c4-4fd4-9070-9ccd0d63d49e req-27a066a3-2528-4d3d-bdc8-63dcacbc34cc service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045283 Aug 31 17:08:39.155701 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3799/7614] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:08:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:08:39.796494 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e7463f5c-d23d-418b-9057-f038cc5f423d tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:08:39.797130 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e7463f5c-d23d-418b-9057-f038cc5f423d tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] [instance: 3a883a82-d992-4428-befc-9e667cee0d5c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:08:39.804904 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e7463f5c-d23d-418b-9057-f038cc5f423d tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:39.805389 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e7463f5c-d23d-418b-9057-f038cc5f423d tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:39.805846 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e7463f5c-d23d-418b-9057-f038cc5f423d tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:39.806565 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e7463f5c-d23d-418b-9057-f038cc5f423d tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:39.807038 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e7463f5c-d23d-418b-9057-f038cc5f423d tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:39.807484 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e7463f5c-d23d-418b-9057-f038cc5f423d tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:39.946793 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e7463f5c-d23d-418b-9057-f038cc5f423d tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d865bc8e6c24be8933711243c693084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35aeac1bc04346f8b7e3f04bb62038b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:08:39.954637 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e7463f5c-d23d-418b-9057-f038cc5f423d tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] 10.222.0.61 "GET /compute/v2.1/servers/3a883a82-d992-4428-befc-9e667cee0d5c" status: 200 len: 1316 microversion: 2.1 time: 0.162238 Aug 31 17:08:39.955330 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3816/7615] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:08:39 2022] GET /compute/v2.1/servers/3a883a82-d992-4428-befc-9e667cee0d5c => generated 1316 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:08:40.977721 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f012cea9-f8f0-45c6-926a-9ddd7c2ffaac tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:08:40.979481 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f012cea9-f8f0-45c6-926a-9ddd7c2ffaac tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] [instance: 3a883a82-d992-4428-befc-9e667cee0d5c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:08:40.985063 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f012cea9-f8f0-45c6-926a-9ddd7c2ffaac tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:40.985561 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f012cea9-f8f0-45c6-926a-9ddd7c2ffaac tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:40.986129 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f012cea9-f8f0-45c6-926a-9ddd7c2ffaac tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:40.987137 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f012cea9-f8f0-45c6-926a-9ddd7c2ffaac tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:40.987630 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f012cea9-f8f0-45c6-926a-9ddd7c2ffaac tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:40.988066 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f012cea9-f8f0-45c6-926a-9ddd7c2ffaac tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:41.149772 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f012cea9-f8f0-45c6-926a-9ddd7c2ffaac tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d865bc8e6c24be8933711243c693084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35aeac1bc04346f8b7e3f04bb62038b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:08:41.157842 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f012cea9-f8f0-45c6-926a-9ddd7c2ffaac tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] 10.222.0.61 "GET /compute/v2.1/servers/3a883a82-d992-4428-befc-9e667cee0d5c" status: 200 len: 1316 microversion: 2.1 time: 0.185267 Aug 31 17:08:41.158480 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3800/7616] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:08:40 2022] GET /compute/v2.1/servers/3a883a82-d992-4428-befc-9e667cee0d5c => generated 1316 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:08:42.179669 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f24f73fe-809a-4f81-84ee-6ef48f40c829 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:08:42.180308 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f24f73fe-809a-4f81-84ee-6ef48f40c829 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] [instance: 3a883a82-d992-4428-befc-9e667cee0d5c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:08:42.187173 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f24f73fe-809a-4f81-84ee-6ef48f40c829 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:42.187721 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f24f73fe-809a-4f81-84ee-6ef48f40c829 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:42.188181 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f24f73fe-809a-4f81-84ee-6ef48f40c829 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:42.188904 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f24f73fe-809a-4f81-84ee-6ef48f40c829 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:42.190019 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f24f73fe-809a-4f81-84ee-6ef48f40c829 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:42.190473 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f24f73fe-809a-4f81-84ee-6ef48f40c829 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:42.403393 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f24f73fe-809a-4f81-84ee-6ef48f40c829 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d865bc8e6c24be8933711243c693084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35aeac1bc04346f8b7e3f04bb62038b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:08:42.412414 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f24f73fe-809a-4f81-84ee-6ef48f40c829 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] 10.222.0.61 "GET /compute/v2.1/servers/3a883a82-d992-4428-befc-9e667cee0d5c" status: 200 len: 1316 microversion: 2.1 time: 0.236789 Aug 31 17:08:42.413006 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3817/7617] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:08:42 2022] GET /compute/v2.1/servers/3a883a82-d992-4428-befc-9e667cee0d5c => generated 1316 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:08:43.434076 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5ed5677d-4602-4768-97c3-b7424f364f1f tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:08:43.434723 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5ed5677d-4602-4768-97c3-b7424f364f1f tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] [instance: 3a883a82-d992-4428-befc-9e667cee0d5c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:08:43.442184 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5ed5677d-4602-4768-97c3-b7424f364f1f tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:43.442681 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5ed5677d-4602-4768-97c3-b7424f364f1f tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:43.443130 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5ed5677d-4602-4768-97c3-b7424f364f1f tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:43.443858 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5ed5677d-4602-4768-97c3-b7424f364f1f tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:43.444326 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5ed5677d-4602-4768-97c3-b7424f364f1f tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:43.444770 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5ed5677d-4602-4768-97c3-b7424f364f1f tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:43.578873 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5ed5677d-4602-4768-97c3-b7424f364f1f tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d865bc8e6c24be8933711243c693084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35aeac1bc04346f8b7e3f04bb62038b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:08:43.593734 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5ed5677d-4602-4768-97c3-b7424f364f1f tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] 10.222.0.61 "GET /compute/v2.1/servers/3a883a82-d992-4428-befc-9e667cee0d5c" status: 200 len: 1316 microversion: 2.1 time: 0.163138 Aug 31 17:08:43.594434 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3801/7618] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:08:43 2022] GET /compute/v2.1/servers/3a883a82-d992-4428-befc-9e667cee0d5c => generated 1316 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:08:44.617552 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-65befa75-8549-4d72-8be8-601bf25369da tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:08:44.618186 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-65befa75-8549-4d72-8be8-601bf25369da tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] [instance: 3a883a82-d992-4428-befc-9e667cee0d5c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:08:44.625241 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-65befa75-8549-4d72-8be8-601bf25369da tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:44.625756 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-65befa75-8549-4d72-8be8-601bf25369da tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:44.626236 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-65befa75-8549-4d72-8be8-601bf25369da tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:44.628410 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-65befa75-8549-4d72-8be8-601bf25369da tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:44.628886 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-65befa75-8549-4d72-8be8-601bf25369da tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:44.629342 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-65befa75-8549-4d72-8be8-601bf25369da tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:44.767835 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-65befa75-8549-4d72-8be8-601bf25369da tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d865bc8e6c24be8933711243c693084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35aeac1bc04346f8b7e3f04bb62038b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:08:44.775826 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-65befa75-8549-4d72-8be8-601bf25369da tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] 10.222.0.61 "GET /compute/v2.1/servers/3a883a82-d992-4428-befc-9e667cee0d5c" status: 200 len: 1316 microversion: 2.1 time: 0.162269 Aug 31 17:08:44.776417 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3818/7619] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:08:44 2022] GET /compute/v2.1/servers/3a883a82-d992-4428-befc-9e667cee0d5c => generated 1316 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:08:45.797236 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2c4fb9b0-cc30-4d30-9f60-8909782617ac tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:08:45.797884 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2c4fb9b0-cc30-4d30-9f60-8909782617ac tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] [instance: 3a883a82-d992-4428-befc-9e667cee0d5c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:08:45.804155 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2c4fb9b0-cc30-4d30-9f60-8909782617ac tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:45.804650 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2c4fb9b0-cc30-4d30-9f60-8909782617ac tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:45.805100 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2c4fb9b0-cc30-4d30-9f60-8909782617ac tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:45.805819 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2c4fb9b0-cc30-4d30-9f60-8909782617ac tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:45.806498 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2c4fb9b0-cc30-4d30-9f60-8909782617ac tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:45.807163 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2c4fb9b0-cc30-4d30-9f60-8909782617ac tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:45.943131 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-2c4fb9b0-cc30-4d30-9f60-8909782617ac tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d865bc8e6c24be8933711243c693084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35aeac1bc04346f8b7e3f04bb62038b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:08:45.951152 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2c4fb9b0-cc30-4d30-9f60-8909782617ac tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] 10.222.0.61 "GET /compute/v2.1/servers/3a883a82-d992-4428-befc-9e667cee0d5c" status: 200 len: 1316 microversion: 2.1 time: 0.158324 Aug 31 17:08:45.951791 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3802/7620] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:08:45 2022] GET /compute/v2.1/servers/3a883a82-d992-4428-befc-9e667cee0d5c => generated 1316 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:08:46.406349 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-3d835308-b52f-4755-bcc5-48a78aef7adf req-68a8daa2-28e6-477e-89ec-e2ded00bd229 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a883a82-d992-4428-befc-9e667cee0d5c", "name": "network-vif-plugged", "status": "completed", "tag": "41127c66-bac2-4d09-991a-7b365aa8d78f"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:08:46.413878 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:08:46.420174 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-3d835308-b52f-4755-bcc5-48a78aef7adf req-68a8daa2-28e6-477e-89ec-e2ded00bd229 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:46.420687 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-3d835308-b52f-4755-bcc5-48a78aef7adf req-68a8daa2-28e6-477e-89ec-e2ded00bd229 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:46.421141 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-3d835308-b52f-4755-bcc5-48a78aef7adf req-68a8daa2-28e6-477e-89ec-e2ded00bd229 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:46.434563 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-3d835308-b52f-4755-bcc5-48a78aef7adf req-68a8daa2-28e6-477e-89ec-e2ded00bd229 service nova] Creating event network-vif-plugged:41127c66-bac2-4d09-991a-7b365aa8d78f for instance 3a883a82-d992-4428-befc-9e667cee0d5c on n-h2-850499-9 Aug 31 17:08:46.441537 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-3d835308-b52f-4755-bcc5-48a78aef7adf req-68a8daa2-28e6-477e-89ec-e2ded00bd229 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037696 Aug 31 17:08:46.442367 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3819/7621] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:08:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 17:08:46.972771 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-34aa97ca-4b3e-40c4-acde-6f0eab1ac3df tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:08:46.973383 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-34aa97ca-4b3e-40c4-acde-6f0eab1ac3df tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] [instance: 3a883a82-d992-4428-befc-9e667cee0d5c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:08:46.975481 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:08:46.976350 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=6 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:08:46.983029 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-34aa97ca-4b3e-40c4-acde-6f0eab1ac3df tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:46.983538 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-34aa97ca-4b3e-40c4-acde-6f0eab1ac3df tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:46.983981 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-34aa97ca-4b3e-40c4-acde-6f0eab1ac3df tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:46.984682 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-34aa97ca-4b3e-40c4-acde-6f0eab1ac3df tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:46.985142 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-34aa97ca-4b3e-40c4-acde-6f0eab1ac3df tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:46.985572 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-34aa97ca-4b3e-40c4-acde-6f0eab1ac3df tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:47.448248 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-34aa97ca-4b3e-40c4-acde-6f0eab1ac3df tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d865bc8e6c24be8933711243c693084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35aeac1bc04346f8b7e3f04bb62038b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:08:47.456926 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-34aa97ca-4b3e-40c4-acde-6f0eab1ac3df tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] 10.222.0.61 "GET /compute/v2.1/servers/3a883a82-d992-4428-befc-9e667cee0d5c" status: 200 len: 1316 microversion: 2.1 time: 0.488040 Aug 31 17:08:47.457514 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3803/7622] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:08:46 2022] GET /compute/v2.1/servers/3a883a82-d992-4428-befc-9e667cee0d5c => generated 1316 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:08:48.477933 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7b6be313-58e2-4e9e-a0fc-d018f2f1527f tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:08:48.478649 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7b6be313-58e2-4e9e-a0fc-d018f2f1527f tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] [instance: 3a883a82-d992-4428-befc-9e667cee0d5c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:08:48.485099 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7b6be313-58e2-4e9e-a0fc-d018f2f1527f tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:48.485596 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7b6be313-58e2-4e9e-a0fc-d018f2f1527f tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:48.486158 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7b6be313-58e2-4e9e-a0fc-d018f2f1527f tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:48.486872 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7b6be313-58e2-4e9e-a0fc-d018f2f1527f tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:48.487347 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7b6be313-58e2-4e9e-a0fc-d018f2f1527f tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:48.487817 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7b6be313-58e2-4e9e-a0fc-d018f2f1527f tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:48.620363 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7b6be313-58e2-4e9e-a0fc-d018f2f1527f tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d865bc8e6c24be8933711243c693084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35aeac1bc04346f8b7e3f04bb62038b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:08:48.629130 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7b6be313-58e2-4e9e-a0fc-d018f2f1527f tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] 10.222.0.61 "GET /compute/v2.1/servers/3a883a82-d992-4428-befc-9e667cee0d5c" status: 200 len: 1505 microversion: 2.1 time: 0.155580 Aug 31 17:08:48.629631 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3820/7623] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:08:48 2022] GET /compute/v2.1/servers/3a883a82-d992-4428-befc-9e667cee0d5c => generated 1505 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:08:48.687333 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7d0cf4a2-5ad6-4d79-bb47-56f1a47ea359 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-620759280", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "networks": [{"uuid": "39b119db-4696-4864-a7e0-1485ad8c2f9f"}]}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:08:48.742267 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-7d0cf4a2-5ad6-4d79-bb47-56f1a47ea359 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] validate_networks() for [('39b119db-4696-4864-a7e0-1485ad8c2f9f', None, None, None, None, None)] {{(pid=122256) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 17:08:49.110205 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-7d0cf4a2-5ad6-4d79-bb47-56f1a47ea359 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 17:08:49.110817 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-7d0cf4a2-5ad6-4d79-bb47-56f1a47ea359 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 17:08:49.112277 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-7d0cf4a2-5ad6-4d79-bb47-56f1a47ea359 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 17:08:49.112717 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-7d0cf4a2-5ad6-4d79-bb47-56f1a47ea359 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 17:08:49.113135 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-7d0cf4a2-5ad6-4d79-bb47-56f1a47ea359 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 17:08:49.122053 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7d0cf4a2-5ad6-4d79-bb47-56f1a47ea359 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:49.122542 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7d0cf4a2-5ad6-4d79-bb47-56f1a47ea359 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:49.122995 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7d0cf4a2-5ad6-4d79-bb47-56f1a47ea359 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:49.123769 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7d0cf4a2-5ad6-4d79-bb47-56f1a47ea359 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:49.124241 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7d0cf4a2-5ad6-4d79-bb47-56f1a47ea359 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:49.124675 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7d0cf4a2-5ad6-4d79-bb47-56f1a47ea359 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:49.142714 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-7d0cf4a2-5ad6-4d79-bb47-56f1a47ea359 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Getting quotas for project 35aeac1bc04346f8b7e3f04bb62038b5. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 17:08:49.148191 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-7d0cf4a2-5ad6-4d79-bb47-56f1a47ea359 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Getting quotas for user 7d865bc8e6c24be8933711243c693084 and project 35aeac1bc04346f8b7e3f04bb62038b5. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 17:08:49.162329 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7d0cf4a2-5ad6-4d79-bb47-56f1a47ea359 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Going to run 1 instances... {{(pid=122256) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 17:08:49.164663 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7d0cf4a2-5ad6-4d79-bb47-56f1a47ea359 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] [instance: a443c74b-c1a3-4f08-9b8a-cc1c87d16b56] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 17:08:49.211188 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7d0cf4a2-5ad6-4d79-bb47-56f1a47ea359 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.527680 Aug 31 17:08:49.211815 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3804/7624] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 17:08:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 529 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 17:08:49.223759 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a7a9e885-ebbd-4176-8f82-fa3b9e75d4eb tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:08:49.224405 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a7a9e885-ebbd-4176-8f82-fa3b9e75d4eb tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] [instance: a443c74b-c1a3-4f08-9b8a-cc1c87d16b56] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:08:49.280553 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a7a9e885-ebbd-4176-8f82-fa3b9e75d4eb tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d865bc8e6c24be8933711243c693084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35aeac1bc04346f8b7e3f04bb62038b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:08:49.288783 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a7a9e885-ebbd-4176-8f82-fa3b9e75d4eb tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] 10.222.0.61 "GET /compute/v2.1/servers/a443c74b-c1a3-4f08-9b8a-cc1c87d16b56" status: 200 len: 1216 microversion: 2.1 time: 0.070134 Aug 31 17:08:49.289380 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3821/7625] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:08:49 2022] GET /compute/v2.1/servers/a443c74b-c1a3-4f08-9b8a-cc1c87d16b56 => generated 1216 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:08:50.311734 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5818b673-f011-4185-ac8c-3ad9bf488971 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:08:50.312401 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5818b673-f011-4185-ac8c-3ad9bf488971 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] [instance: a443c74b-c1a3-4f08-9b8a-cc1c87d16b56] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:08:50.320464 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5818b673-f011-4185-ac8c-3ad9bf488971 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:50.320964 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5818b673-f011-4185-ac8c-3ad9bf488971 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:50.321409 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5818b673-f011-4185-ac8c-3ad9bf488971 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:50.322126 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5818b673-f011-4185-ac8c-3ad9bf488971 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:50.322593 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5818b673-f011-4185-ac8c-3ad9bf488971 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:50.323033 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5818b673-f011-4185-ac8c-3ad9bf488971 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:50.430957 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5818b673-f011-4185-ac8c-3ad9bf488971 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d865bc8e6c24be8933711243c693084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35aeac1bc04346f8b7e3f04bb62038b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:08:50.440132 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5818b673-f011-4185-ac8c-3ad9bf488971 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] 10.222.0.61 "GET /compute/v2.1/servers/a443c74b-c1a3-4f08-9b8a-cc1c87d16b56" status: 200 len: 1276 microversion: 2.1 time: 0.133477 Aug 31 17:08:50.440736 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3805/7626] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:08:50 2022] GET /compute/v2.1/servers/a443c74b-c1a3-4f08-9b8a-cc1c87d16b56 => generated 1276 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:08:51.462013 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5b03165d-137d-48f9-a087-1fd92d32e429 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:08:51.462655 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5b03165d-137d-48f9-a087-1fd92d32e429 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] [instance: a443c74b-c1a3-4f08-9b8a-cc1c87d16b56] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:08:51.470420 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b03165d-137d-48f9-a087-1fd92d32e429 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:51.471021 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b03165d-137d-48f9-a087-1fd92d32e429 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:51.471725 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b03165d-137d-48f9-a087-1fd92d32e429 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:51.472585 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b03165d-137d-48f9-a087-1fd92d32e429 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:51.473076 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b03165d-137d-48f9-a087-1fd92d32e429 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:51.473529 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5b03165d-137d-48f9-a087-1fd92d32e429 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:51.722082 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5b03165d-137d-48f9-a087-1fd92d32e429 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d865bc8e6c24be8933711243c693084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35aeac1bc04346f8b7e3f04bb62038b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:08:51.729903 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5b03165d-137d-48f9-a087-1fd92d32e429 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] 10.222.0.61 "GET /compute/v2.1/servers/a443c74b-c1a3-4f08-9b8a-cc1c87d16b56" status: 200 len: 1316 microversion: 2.1 time: 0.271863 Aug 31 17:08:51.730581 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3822/7627] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:08:51 2022] GET /compute/v2.1/servers/a443c74b-c1a3-4f08-9b8a-cc1c87d16b56 => generated 1316 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:08:51.855675 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-41f5641d-e419-44dc-b90d-8930a1757cc1 req-0aa9be54-2143-41d8-92ca-dd00badfc154 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a443c74b-c1a3-4f08-9b8a-cc1c87d16b56", "tag": "f2e3742a-f3df-441e-bf66-34f16ac321d6"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:08:51.869725 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-41f5641d-e419-44dc-b90d-8930a1757cc1 req-0aa9be54-2143-41d8-92ca-dd00badfc154 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:51.870322 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-41f5641d-e419-44dc-b90d-8930a1757cc1 req-0aa9be54-2143-41d8-92ca-dd00badfc154 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:51.870820 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-41f5641d-e419-44dc-b90d-8930a1757cc1 req-0aa9be54-2143-41d8-92ca-dd00badfc154 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:51.883752 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-41f5641d-e419-44dc-b90d-8930a1757cc1 req-0aa9be54-2143-41d8-92ca-dd00badfc154 service nova] Creating event network-changed:f2e3742a-f3df-441e-bf66-34f16ac321d6 for instance a443c74b-c1a3-4f08-9b8a-cc1c87d16b56 on n-h1-850499-9 Aug 31 17:08:51.889358 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-41f5641d-e419-44dc-b90d-8930a1757cc1 req-0aa9be54-2143-41d8-92ca-dd00badfc154 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045001 Aug 31 17:08:51.889981 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3806/7628] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:08:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:08:52.753224 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-373b061a-973c-4ffd-898c-48bf5fd9e620 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:08:52.753818 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-373b061a-973c-4ffd-898c-48bf5fd9e620 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] [instance: a443c74b-c1a3-4f08-9b8a-cc1c87d16b56] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:08:52.760781 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-373b061a-973c-4ffd-898c-48bf5fd9e620 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:52.761291 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-373b061a-973c-4ffd-898c-48bf5fd9e620 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:52.761749 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-373b061a-973c-4ffd-898c-48bf5fd9e620 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:52.762465 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-373b061a-973c-4ffd-898c-48bf5fd9e620 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:52.762940 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-373b061a-973c-4ffd-898c-48bf5fd9e620 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:52.763388 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-373b061a-973c-4ffd-898c-48bf5fd9e620 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:52.902880 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-373b061a-973c-4ffd-898c-48bf5fd9e620 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d865bc8e6c24be8933711243c693084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35aeac1bc04346f8b7e3f04bb62038b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:08:52.910658 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-373b061a-973c-4ffd-898c-48bf5fd9e620 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] 10.222.0.61 "GET /compute/v2.1/servers/a443c74b-c1a3-4f08-9b8a-cc1c87d16b56" status: 200 len: 1316 microversion: 2.1 time: 0.162261 Aug 31 17:08:52.911232 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3823/7629] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:08:52 2022] GET /compute/v2.1/servers/a443c74b-c1a3-4f08-9b8a-cc1c87d16b56 => generated 1316 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:08:53.930843 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-28607f76-952e-40e6-a6b5-6e66ad0c9af0 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:08:53.931574 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-28607f76-952e-40e6-a6b5-6e66ad0c9af0 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] [instance: a443c74b-c1a3-4f08-9b8a-cc1c87d16b56] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:08:53.938691 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-28607f76-952e-40e6-a6b5-6e66ad0c9af0 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:53.939182 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-28607f76-952e-40e6-a6b5-6e66ad0c9af0 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:53.939728 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-28607f76-952e-40e6-a6b5-6e66ad0c9af0 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:53.940483 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-28607f76-952e-40e6-a6b5-6e66ad0c9af0 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:53.940942 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-28607f76-952e-40e6-a6b5-6e66ad0c9af0 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:53.941368 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-28607f76-952e-40e6-a6b5-6e66ad0c9af0 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:54.075652 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-28607f76-952e-40e6-a6b5-6e66ad0c9af0 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d865bc8e6c24be8933711243c693084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35aeac1bc04346f8b7e3f04bb62038b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:08:54.084675 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-28607f76-952e-40e6-a6b5-6e66ad0c9af0 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] 10.222.0.61 "GET /compute/v2.1/servers/a443c74b-c1a3-4f08-9b8a-cc1c87d16b56" status: 200 len: 1316 microversion: 2.1 time: 0.158057 Aug 31 17:08:54.085435 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3807/7630] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:08:53 2022] GET /compute/v2.1/servers/a443c74b-c1a3-4f08-9b8a-cc1c87d16b56 => generated 1316 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:08:55.106643 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-70372e4a-5101-4b59-aeee-77f64cbc7c7b tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:08:55.107286 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-70372e4a-5101-4b59-aeee-77f64cbc7c7b tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] [instance: a443c74b-c1a3-4f08-9b8a-cc1c87d16b56] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:08:55.115106 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-70372e4a-5101-4b59-aeee-77f64cbc7c7b tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:55.115646 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-70372e4a-5101-4b59-aeee-77f64cbc7c7b tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:55.116108 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-70372e4a-5101-4b59-aeee-77f64cbc7c7b tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:55.116840 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-70372e4a-5101-4b59-aeee-77f64cbc7c7b tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:55.117319 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-70372e4a-5101-4b59-aeee-77f64cbc7c7b tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:55.117769 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-70372e4a-5101-4b59-aeee-77f64cbc7c7b tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:55.258181 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-70372e4a-5101-4b59-aeee-77f64cbc7c7b tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d865bc8e6c24be8933711243c693084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35aeac1bc04346f8b7e3f04bb62038b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:08:55.266078 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-70372e4a-5101-4b59-aeee-77f64cbc7c7b tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] 10.222.0.61 "GET /compute/v2.1/servers/a443c74b-c1a3-4f08-9b8a-cc1c87d16b56" status: 200 len: 1316 microversion: 2.1 time: 0.163481 Aug 31 17:08:55.266667 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3824/7631] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:08:55 2022] GET /compute/v2.1/servers/a443c74b-c1a3-4f08-9b8a-cc1c87d16b56 => generated 1316 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:08:56.289355 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f2e5a0e9-1d8a-421f-8738-f6fb6a96cc92 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:08:56.289986 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f2e5a0e9-1d8a-421f-8738-f6fb6a96cc92 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] [instance: a443c74b-c1a3-4f08-9b8a-cc1c87d16b56] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:08:56.297741 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f2e5a0e9-1d8a-421f-8738-f6fb6a96cc92 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:56.298246 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f2e5a0e9-1d8a-421f-8738-f6fb6a96cc92 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:56.298695 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f2e5a0e9-1d8a-421f-8738-f6fb6a96cc92 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:56.299702 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f2e5a0e9-1d8a-421f-8738-f6fb6a96cc92 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:56.300385 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f2e5a0e9-1d8a-421f-8738-f6fb6a96cc92 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:56.300815 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f2e5a0e9-1d8a-421f-8738-f6fb6a96cc92 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:56.453609 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f2e5a0e9-1d8a-421f-8738-f6fb6a96cc92 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d865bc8e6c24be8933711243c693084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35aeac1bc04346f8b7e3f04bb62038b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:08:56.463336 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f2e5a0e9-1d8a-421f-8738-f6fb6a96cc92 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] 10.222.0.61 "GET /compute/v2.1/servers/a443c74b-c1a3-4f08-9b8a-cc1c87d16b56" status: 200 len: 1316 microversion: 2.1 time: 0.178436 Aug 31 17:08:56.463962 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3808/7632] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:08:56 2022] GET /compute/v2.1/servers/a443c74b-c1a3-4f08-9b8a-cc1c87d16b56 => generated 1316 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:08:57.484704 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a910e7ee-b0ad-4141-ad66-81cfc745818c tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:08:57.485335 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a910e7ee-b0ad-4141-ad66-81cfc745818c tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] [instance: a443c74b-c1a3-4f08-9b8a-cc1c87d16b56] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:08:57.492364 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a910e7ee-b0ad-4141-ad66-81cfc745818c tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:57.492865 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a910e7ee-b0ad-4141-ad66-81cfc745818c tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:57.493319 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a910e7ee-b0ad-4141-ad66-81cfc745818c tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:57.494049 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a910e7ee-b0ad-4141-ad66-81cfc745818c tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:57.494621 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a910e7ee-b0ad-4141-ad66-81cfc745818c tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:57.494946 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a910e7ee-b0ad-4141-ad66-81cfc745818c tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:57.629592 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a910e7ee-b0ad-4141-ad66-81cfc745818c tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d865bc8e6c24be8933711243c693084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35aeac1bc04346f8b7e3f04bb62038b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:08:57.637412 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a910e7ee-b0ad-4141-ad66-81cfc745818c tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] 10.222.0.61 "GET /compute/v2.1/servers/a443c74b-c1a3-4f08-9b8a-cc1c87d16b56" status: 200 len: 1316 microversion: 2.1 time: 0.156733 Aug 31 17:08:57.637987 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3825/7633] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:08:57 2022] GET /compute/v2.1/servers/a443c74b-c1a3-4f08-9b8a-cc1c87d16b56 => generated 1316 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:08:58.089916 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-fc5704e1-8c5c-4e2f-83fe-9278036868e9 req-bb479a30-85d6-45fe-b705-7af116f42816 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a443c74b-c1a3-4f08-9b8a-cc1c87d16b56", "name": "network-vif-plugged", "status": "completed", "tag": "f2e3742a-f3df-441e-bf66-34f16ac321d6"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:08:58.102782 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-fc5704e1-8c5c-4e2f-83fe-9278036868e9 req-bb479a30-85d6-45fe-b705-7af116f42816 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:58.103281 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-fc5704e1-8c5c-4e2f-83fe-9278036868e9 req-bb479a30-85d6-45fe-b705-7af116f42816 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:58.103768 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-fc5704e1-8c5c-4e2f-83fe-9278036868e9 req-bb479a30-85d6-45fe-b705-7af116f42816 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:58.116134 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-fc5704e1-8c5c-4e2f-83fe-9278036868e9 req-bb479a30-85d6-45fe-b705-7af116f42816 service nova] Creating event network-vif-plugged:f2e3742a-f3df-441e-bf66-34f16ac321d6 for instance a443c74b-c1a3-4f08-9b8a-cc1c87d16b56 on n-h1-850499-9 Aug 31 17:08:58.121313 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-fc5704e1-8c5c-4e2f-83fe-9278036868e9 req-bb479a30-85d6-45fe-b705-7af116f42816 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035196 Aug 31 17:08:58.121925 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3809/7634] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:08:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 17:08:58.658308 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9fd9eac1-3791-4c53-9f07-0993361ca62d tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:08:58.660266 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9fd9eac1-3791-4c53-9f07-0993361ca62d tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] [instance: a443c74b-c1a3-4f08-9b8a-cc1c87d16b56] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:08:58.667412 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9fd9eac1-3791-4c53-9f07-0993361ca62d tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:58.667965 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9fd9eac1-3791-4c53-9f07-0993361ca62d tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:58.668452 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9fd9eac1-3791-4c53-9f07-0993361ca62d tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:58.669209 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9fd9eac1-3791-4c53-9f07-0993361ca62d tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:58.669687 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9fd9eac1-3791-4c53-9f07-0993361ca62d tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:58.670137 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9fd9eac1-3791-4c53-9f07-0993361ca62d tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:58.824741 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9fd9eac1-3791-4c53-9f07-0993361ca62d tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d865bc8e6c24be8933711243c693084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35aeac1bc04346f8b7e3f04bb62038b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:08:58.833606 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9fd9eac1-3791-4c53-9f07-0993361ca62d tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] 10.222.0.61 "GET /compute/v2.1/servers/a443c74b-c1a3-4f08-9b8a-cc1c87d16b56" status: 200 len: 1316 microversion: 2.1 time: 0.179297 Aug 31 17:08:58.834207 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3826/7635] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:08:58 2022] GET /compute/v2.1/servers/a443c74b-c1a3-4f08-9b8a-cc1c87d16b56 => generated 1316 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:08:59.855935 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6dc76540-e32c-45c9-8598-efe18c74adc9 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:08:59.856561 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6dc76540-e32c-45c9-8598-efe18c74adc9 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] [instance: a443c74b-c1a3-4f08-9b8a-cc1c87d16b56] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:08:59.859304 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:08:59.860002 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=6 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:08:59.866895 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6dc76540-e32c-45c9-8598-efe18c74adc9 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:59.867389 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6dc76540-e32c-45c9-8598-efe18c74adc9 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:59.867858 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6dc76540-e32c-45c9-8598-efe18c74adc9 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:59.868569 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6dc76540-e32c-45c9-8598-efe18c74adc9 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:59.869032 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6dc76540-e32c-45c9-8598-efe18c74adc9 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:59.869466 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6dc76540-e32c-45c9-8598-efe18c74adc9 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:09:00.004551 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-6dc76540-e32c-45c9-8598-efe18c74adc9 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d865bc8e6c24be8933711243c693084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35aeac1bc04346f8b7e3f04bb62038b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:09:00.013486 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6dc76540-e32c-45c9-8598-efe18c74adc9 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] 10.222.0.61 "GET /compute/v2.1/servers/a443c74b-c1a3-4f08-9b8a-cc1c87d16b56" status: 200 len: 1504 microversion: 2.1 time: 0.162158 Aug 31 17:09:00.014229 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3810/7636] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:08:59 2022] GET /compute/v2.1/servers/a443c74b-c1a3-4f08-9b8a-cc1c87d16b56 => generated 1504 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:09:00.035488 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0074e2c6-b27f-4c00-8a52-9cd931dd9e3a tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:09:00.036125 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0074e2c6-b27f-4c00-8a52-9cd931dd9e3a tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] [instance: a443c74b-c1a3-4f08-9b8a-cc1c87d16b56] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:09:00.039143 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:09:00.046668 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0074e2c6-b27f-4c00-8a52-9cd931dd9e3a tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:09:00.047186 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0074e2c6-b27f-4c00-8a52-9cd931dd9e3a tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:09:00.047679 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0074e2c6-b27f-4c00-8a52-9cd931dd9e3a tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:09:00.048402 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0074e2c6-b27f-4c00-8a52-9cd931dd9e3a tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:09:00.048887 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0074e2c6-b27f-4c00-8a52-9cd931dd9e3a tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:09:00.049334 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0074e2c6-b27f-4c00-8a52-9cd931dd9e3a tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:09:00.074659 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0074e2c6-b27f-4c00-8a52-9cd931dd9e3a tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] [instance: a443c74b-c1a3-4f08-9b8a-cc1c87d16b56] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 17:09:00.151138 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0074e2c6-b27f-4c00-8a52-9cd931dd9e3a tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] 10.222.0.61 "DELETE /compute/v2.1/servers/a443c74b-c1a3-4f08-9b8a-cc1c87d16b56" status: 204 len: 0 microversion: 2.1 time: 0.120605 Aug 31 17:09:00.151694 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3827/7637] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 17:09:00 2022] DELETE /compute/v2.1/servers/a443c74b-c1a3-4f08-9b8a-cc1c87d16b56 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 17:09:00.161728 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-79358984-c6b2-4620-afda-eb1287cc53e4 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:09:00.162355 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-79358984-c6b2-4620-afda-eb1287cc53e4 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] [instance: a443c74b-c1a3-4f08-9b8a-cc1c87d16b56] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:09:00.168415 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-79358984-c6b2-4620-afda-eb1287cc53e4 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:09:00.168913 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-79358984-c6b2-4620-afda-eb1287cc53e4 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:09:00.169363 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-79358984-c6b2-4620-afda-eb1287cc53e4 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:09:00.170070 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-79358984-c6b2-4620-afda-eb1287cc53e4 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:09:00.170536 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-79358984-c6b2-4620-afda-eb1287cc53e4 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:09:00.170971 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-79358984-c6b2-4620-afda-eb1287cc53e4 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:09:00.308658 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-79358984-c6b2-4620-afda-eb1287cc53e4 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d865bc8e6c24be8933711243c693084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35aeac1bc04346f8b7e3f04bb62038b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:09:00.317060 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-79358984-c6b2-4620-afda-eb1287cc53e4 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] 10.222.0.61 "GET /compute/v2.1/servers/a443c74b-c1a3-4f08-9b8a-cc1c87d16b56" status: 200 len: 1510 microversion: 2.1 time: 0.160715 Aug 31 17:09:00.317646 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3811/7638] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:09:00 2022] GET /compute/v2.1/servers/a443c74b-c1a3-4f08-9b8a-cc1c87d16b56 => generated 1510 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 17:09:01.339140 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-05250846-a660-49bd-b6d2-57b7ef0515ee tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:09:01.339906 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-05250846-a660-49bd-b6d2-57b7ef0515ee tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] [instance: a443c74b-c1a3-4f08-9b8a-cc1c87d16b56] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:09:01.347455 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-05250846-a660-49bd-b6d2-57b7ef0515ee tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:09:01.347990 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-05250846-a660-49bd-b6d2-57b7ef0515ee tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:09:01.348454 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-05250846-a660-49bd-b6d2-57b7ef0515ee tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:09:01.349183 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-05250846-a660-49bd-b6d2-57b7ef0515ee tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:09:01.349663 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-05250846-a660-49bd-b6d2-57b7ef0515ee tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:09:01.350117 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-05250846-a660-49bd-b6d2-57b7ef0515ee tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:09:01.491764 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-05250846-a660-49bd-b6d2-57b7ef0515ee tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d865bc8e6c24be8933711243c693084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35aeac1bc04346f8b7e3f04bb62038b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:09:01.499648 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-05250846-a660-49bd-b6d2-57b7ef0515ee tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] 10.222.0.61 "GET /compute/v2.1/servers/a443c74b-c1a3-4f08-9b8a-cc1c87d16b56" status: 200 len: 1510 microversion: 2.1 time: 0.164800 Aug 31 17:09:01.500226 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3828/7639] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:09:01 2022] GET /compute/v2.1/servers/a443c74b-c1a3-4f08-9b8a-cc1c87d16b56 => generated 1510 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:09:02.310942 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-e95cced5-7088-45d6-a433-e59851505145 req-f9d4036d-e896-4c5d-a39e-38e8a8269492 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a443c74b-c1a3-4f08-9b8a-cc1c87d16b56", "name": "network-vif-deleted", "tag": "f2e3742a-f3df-441e-bf66-34f16ac321d6"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:09:02.322861 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-e95cced5-7088-45d6-a433-e59851505145 req-f9d4036d-e896-4c5d-a39e-38e8a8269492 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:09:02.323362 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-e95cced5-7088-45d6-a433-e59851505145 req-f9d4036d-e896-4c5d-a39e-38e8a8269492 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:09:02.324061 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-e95cced5-7088-45d6-a433-e59851505145 req-f9d4036d-e896-4c5d-a39e-38e8a8269492 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:09:02.338710 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-e95cced5-7088-45d6-a433-e59851505145 req-f9d4036d-e896-4c5d-a39e-38e8a8269492 service nova] Creating event network-vif-deleted:f2e3742a-f3df-441e-bf66-34f16ac321d6 for instance a443c74b-c1a3-4f08-9b8a-cc1c87d16b56 on n-h1-850499-9 Aug 31 17:09:02.347088 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-e95cced5-7088-45d6-a433-e59851505145 req-f9d4036d-e896-4c5d-a39e-38e8a8269492 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038803 Aug 31 17:09:02.350847 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3812/7640] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:09:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:09:02.521711 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c34b73fb-349f-42fd-8cc8-44782f1cc1a7 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:09:02.522540 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c34b73fb-349f-42fd-8cc8-44782f1cc1a7 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] [instance: a443c74b-c1a3-4f08-9b8a-cc1c87d16b56] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:09:02.529763 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c34b73fb-349f-42fd-8cc8-44782f1cc1a7 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:09:02.530275 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c34b73fb-349f-42fd-8cc8-44782f1cc1a7 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:09:02.530733 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c34b73fb-349f-42fd-8cc8-44782f1cc1a7 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:09:02.531450 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c34b73fb-349f-42fd-8cc8-44782f1cc1a7 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:09:02.531955 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c34b73fb-349f-42fd-8cc8-44782f1cc1a7 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:09:02.532401 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c34b73fb-349f-42fd-8cc8-44782f1cc1a7 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:09:02.569724 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c34b73fb-349f-42fd-8cc8-44782f1cc1a7 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:09:02.570171 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c34b73fb-349f-42fd-8cc8-44782f1cc1a7 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:09:02.570636 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c34b73fb-349f-42fd-8cc8-44782f1cc1a7 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:09:02.571113 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-c34b73fb-349f-42fd-8cc8-44782f1cc1a7 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lazy-loading 'fault' on Instance uuid a443c74b-c1a3-4f08-9b8a-cc1c87d16b56 {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 17:09:02.613737 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c34b73fb-349f-42fd-8cc8-44782f1cc1a7 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d865bc8e6c24be8933711243c693084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35aeac1bc04346f8b7e3f04bb62038b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:09:02.621598 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c34b73fb-349f-42fd-8cc8-44782f1cc1a7 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] 10.222.0.61 "GET /compute/v2.1/servers/a443c74b-c1a3-4f08-9b8a-cc1c87d16b56" status: 200 len: 1306 microversion: 2.1 time: 0.105286 Aug 31 17:09:02.622176 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3829/7641] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:09:02 2022] GET /compute/v2.1/servers/a443c74b-c1a3-4f08-9b8a-cc1c87d16b56 => generated 1306 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:09:03.644352 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-01a12d14-6d7f-4178-acb9-cf147f09c9df tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:09:03.645066 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-01a12d14-6d7f-4178-acb9-cf147f09c9df tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] [instance: a443c74b-c1a3-4f08-9b8a-cc1c87d16b56] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:09:03.651659 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-01a12d14-6d7f-4178-acb9-cf147f09c9df tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:09:03.652162 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-01a12d14-6d7f-4178-acb9-cf147f09c9df tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:09:03.652612 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-01a12d14-6d7f-4178-acb9-cf147f09c9df tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:09:03.653328 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-01a12d14-6d7f-4178-acb9-cf147f09c9df tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:09:03.653798 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-01a12d14-6d7f-4178-acb9-cf147f09c9df tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:09:03.654238 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-01a12d14-6d7f-4178-acb9-cf147f09c9df tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:09:03.669049 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-01a12d14-6d7f-4178-acb9-cf147f09c9df tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] HTTP exception thrown: Instance a443c74b-c1a3-4f08-9b8a-cc1c87d16b56 could not be found. Aug 31 17:09:03.670755 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-01a12d14-6d7f-4178-acb9-cf147f09c9df tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Request method failure captured: Aug 31 17:09:03.670755 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/a443c74b-c1a3-4f08-9b8a-cc1c87d16b56 HTTP/1.1 Aug 31 17:09:03.670755 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 17:09:03.670755 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 17:09:03.670755 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 17:09:03.670755 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 17:09:03.670755 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 17:09:03.670755 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 17:09:03.670755 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 17:09:03.670755 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 17:09:03.670755 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD5WTGammTlouQczb5FbUJAK3pp2FKm6dpNJafd3dH_x8xB4zvijHVPtWrwBpMaWLUIKkoJaCFSXpqZtNmWEVeMjjk9BUMh6zVRwGMA05B0hINK2qsPXt3YpKgJBoXdKaw_ijXoQGT6DR6Sk7yILn7gELAFEObaXbMTB355taDwB-yXA Aug 31 17:09:03.670755 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 17:09:03.670755 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 17:09:03.670755 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 17:09:03.670755 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 17:09:03.670755 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 17:09:03.670755 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 17:09:03.670755 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 35aeac1bc04346f8b7e3f04bb62038b5 Aug 31 17:09:03.670755 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ServersNegativeTestJSON-913757076 Aug 31 17:09:03.670755 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 17:09:03.670755 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 17:09:03.670755 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/35aeac1bc04346f8b7e3f04bb62038b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/35aeac1bc04346f8b7e3f04bb62038b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_35aeac1bc04346f8b7e3f04bb62038b5", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/35aeac1bc04346f8b7e3f04bb62038b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 17:09:03.670755 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ServersNegativeTestJSON-913757076 Aug 31 17:09:03.670755 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 35aeac1bc04346f8b7e3f04bb62038b5 Aug 31 17:09:03.670755 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ServersNegativeTestJSON-913757076 Aug 31 17:09:03.670755 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ServersNegativeTestJSON-913757076-project Aug 31 17:09:03.670755 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 17:09:03.670755 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 17:09:03.670755 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 7d865bc8e6c24be8933711243c693084 Aug 31 17:09:03.670755 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ServersNegativeTestJSON-913757076-project Aug 31 17:09:03.670755 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 17:09:03.670755 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance a443c74b-c1a3-4f08-9b8a-cc1c87d16b56 could not be found. Aug 31 17:09:03.670755 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': 'a443c74b-c1a3-4f08-9b8a-cc1c87d16b56'} Aug 31 17:09:03.670755 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 17:09:03.670755 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:09:03.670755 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 17:09:03.670755 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 17:09:03.670755 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 17:09:03.670755 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 17:09:03.670755 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 17:09:03.670755 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 17:09:03.670755 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 17:09:03.670755 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 17:09:03.670755 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a443c74b-c1a3-4f08-9b8a-cc1c87d16b56 could not be found. Aug 31 17:09:03.670755 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:09:03.670755 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:09:03.670755 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:09:03.670755 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:09:03.670755 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:09:03.670755 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:09:03.670755 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 17:09:03.670755 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 17:09:03.670755 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 17:09:03.670755 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 17:09:03.670755 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 17:09:03.670755 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 17:09:03.670755 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 17:09:03.670755 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 17:09:03.670755 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 17:09:03.670755 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 17:09:03.670755 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a443c74b-c1a3-4f08-9b8a-cc1c87d16b56 could not be found. Aug 31 17:09:03.670755 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:09:03.670755 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:09:03.670755 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:09:03.676972 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:09:03.676972 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:09:03.676972 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:09:03.676972 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 17:09:03.676972 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 17:09:03.676972 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a443c74b-c1a3-4f08-9b8a-cc1c87d16b56 could not be found. Aug 31 17:09:03.676972 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:09:03.676972 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-01a12d14-6d7f-4178-acb9-cf147f09c9df tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Returning 404 to user: Instance a443c74b-c1a3-4f08-9b8a-cc1c87d16b56 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 17:09:03.676972 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-01a12d14-6d7f-4178-acb9-cf147f09c9df tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] 10.222.0.61 "GET /compute/v2.1/servers/a443c74b-c1a3-4f08-9b8a-cc1c87d16b56" status: 404 len: 111 microversion: 2.1 time: 0.033838 Aug 31 17:09:03.676972 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3813/7642] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:09:03 2022] GET /compute/v2.1/servers/a443c74b-c1a3-4f08-9b8a-cc1c87d16b56 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 17:09:03.681506 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-37f5f722-9d95-4d68-87ce-d690f6d028d9 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:09:03.682147 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-37f5f722-9d95-4d68-87ce-d690f6d028d9 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] [instance: 3a883a82-d992-4428-befc-9e667cee0d5c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:09:03.689358 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-37f5f722-9d95-4d68-87ce-d690f6d028d9 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:09:03.690129 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-37f5f722-9d95-4d68-87ce-d690f6d028d9 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:09:03.690473 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-37f5f722-9d95-4d68-87ce-d690f6d028d9 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:09:03.691205 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-37f5f722-9d95-4d68-87ce-d690f6d028d9 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:09:03.691720 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-37f5f722-9d95-4d68-87ce-d690f6d028d9 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:09:03.692171 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-37f5f722-9d95-4d68-87ce-d690f6d028d9 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:09:03.829760 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-37f5f722-9d95-4d68-87ce-d690f6d028d9 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d865bc8e6c24be8933711243c693084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35aeac1bc04346f8b7e3f04bb62038b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:09:03.838520 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-37f5f722-9d95-4d68-87ce-d690f6d028d9 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] 10.222.0.61 "GET /compute/v2.1/servers/3a883a82-d992-4428-befc-9e667cee0d5c" status: 200 len: 1505 microversion: 2.1 time: 0.160923 Aug 31 17:09:03.839098 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3830/7643] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:09:03 2022] GET /compute/v2.1/servers/3a883a82-d992-4428-befc-9e667cee0d5c => generated 1505 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:09:03.859554 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1384ea6e-a49c-484c-b6b1-9d2beebab01b tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:09:03.861806 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1384ea6e-a49c-484c-b6b1-9d2beebab01b tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] [instance: b8cbed3d-2a04-4f8f-a46c-876c3b1214e8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:09:03.867446 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-1384ea6e-a49c-484c-b6b1-9d2beebab01b tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] HTTP exception thrown: Instance b8cbed3d-2a04-4f8f-a46c-876c3b1214e8 could not be found. Aug 31 17:09:03.869060 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1384ea6e-a49c-484c-b6b1-9d2beebab01b tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Request method failure captured: Aug 31 17:09:03.869060 n-d-850499-9 devstack@n-api.service[122256]: request: POST /compute/v2.1/servers/b8cbed3d-2a04-4f8f-a46c-876c3b1214e8/action HTTP/1.1 Aug 31 17:09:03.869060 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 17:09:03.869060 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 17:09:03.869060 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 17:09:03.869060 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 32 Aug 31 17:09:03.869060 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 17:09:03.869060 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 17:09:03.869060 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 17:09:03.869060 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 17:09:03.869060 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD5WTGammTlouQczb5FbUJAK3pp2FKm6dpNJafd3dH_x8xB4zvijHVPtWrwBpMaWLUIKkoJaCFSXpqZtNmWEVeMjjk9BUMh6zVRwGMA05B0hINK2qsPXt3YpKgJBoXdKaw_ijXoQGT6DR6Sk7yILn7gELAFEObaXbMTB355taDwB-yXA Aug 31 17:09:03.869060 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 17:09:03.869060 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 17:09:03.869060 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 17:09:03.869060 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 17:09:03.869060 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 17:09:03.869060 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 17:09:03.869060 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 35aeac1bc04346f8b7e3f04bb62038b5 Aug 31 17:09:03.869060 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ServersNegativeTestJSON-913757076 Aug 31 17:09:03.869060 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 17:09:03.869060 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 17:09:03.869060 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/35aeac1bc04346f8b7e3f04bb62038b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/35aeac1bc04346f8b7e3f04bb62038b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_35aeac1bc04346f8b7e3f04bb62038b5", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/35aeac1bc04346f8b7e3f04bb62038b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 17:09:03.869060 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ServersNegativeTestJSON-913757076 Aug 31 17:09:03.869060 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 35aeac1bc04346f8b7e3f04bb62038b5 Aug 31 17:09:03.869060 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ServersNegativeTestJSON-913757076 Aug 31 17:09:03.869060 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ServersNegativeTestJSON-913757076-project Aug 31 17:09:03.869060 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 17:09:03.869060 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 17:09:03.869060 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 7d865bc8e6c24be8933711243c693084 Aug 31 17:09:03.869060 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ServersNegativeTestJSON-913757076-project Aug 31 17:09:03.869060 n-d-850499-9 devstack@n-api.service[122256]: Aug 31 17:09:03.869060 n-d-850499-9 devstack@n-api.service[122256]: {"resize": {"flavorRef": "452"}} Aug 31 17:09:03.869060 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 17:09:03.869060 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance b8cbed3d-2a04-4f8f-a46c-876c3b1214e8 could not be found. Aug 31 17:09:03.869060 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': 'b8cbed3d-2a04-4f8f-a46c-876c3b1214e8', 'body': {'resize': {'flavorRef': '452'}}} Aug 31 17:09:03.869060 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 17:09:03.869060 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:09:03.869060 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 17:09:03.869060 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 17:09:03.869060 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 17:09:03.869060 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 17:09:03.869060 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 31 17:09:03.869060 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 31 17:09:03.869060 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8cbed3d-2a04-4f8f-a46c-876c3b1214e8 could not be found. Aug 31 17:09:03.869060 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:09:03.869060 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:09:03.869060 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:09:03.869060 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:09:03.869060 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:09:03.869060 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:09:03.869060 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 17:09:03.869060 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 17:09:03.869060 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 17:09:03.869060 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 17:09:03.869060 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 17:09:03.869060 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 17:09:03.869060 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 31 17:09:03.869060 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 31 17:09:03.869060 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Aug 31 17:09:03.869060 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Aug 31 17:09:03.869060 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 17:09:03.869060 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 17:09:03.869060 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 17:09:03.869060 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 17:09:03.873923 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8cbed3d-2a04-4f8f-a46c-876c3b1214e8 could not be found. Aug 31 17:09:03.873923 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:09:03.873923 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:09:03.873923 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:09:03.873923 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:09:03.873923 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:09:03.873923 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:09:03.873923 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 17:09:03.873923 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 17:09:03.873923 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8cbed3d-2a04-4f8f-a46c-876c3b1214e8 could not be found. Aug 31 17:09:03.873923 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:09:03.873923 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1384ea6e-a49c-484c-b6b1-9d2beebab01b tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Returning 404 to user: Instance b8cbed3d-2a04-4f8f-a46c-876c3b1214e8 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 17:09:03.873923 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1384ea6e-a49c-484c-b6b1-9d2beebab01b tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] 10.222.0.61 "POST /compute/v2.1/servers/b8cbed3d-2a04-4f8f-a46c-876c3b1214e8/action" status: 404 len: 111 microversion: 2.1 time: 0.015013 Aug 31 17:09:03.873923 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3814/7644] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 17:09:03 2022] POST /compute/v2.1/servers/b8cbed3d-2a04-4f8f-a46c-876c3b1214e8/action => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 17:09:03.879782 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5cf2a18b-163b-4674-9e82-0e0c61c566ed tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:09:03.880482 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5cf2a18b-163b-4674-9e82-0e0c61c566ed tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] [instance: 3a883a82-d992-4428-befc-9e667cee0d5c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:09:03.886559 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5cf2a18b-163b-4674-9e82-0e0c61c566ed tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:09:03.887072 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5cf2a18b-163b-4674-9e82-0e0c61c566ed tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:09:03.887544 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5cf2a18b-163b-4674-9e82-0e0c61c566ed tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:09:03.888269 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5cf2a18b-163b-4674-9e82-0e0c61c566ed tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:09:03.888745 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5cf2a18b-163b-4674-9e82-0e0c61c566ed tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:09:03.889190 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5cf2a18b-163b-4674-9e82-0e0c61c566ed tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:09:03.894335 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:09:04.026407 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5cf2a18b-163b-4674-9e82-0e0c61c566ed tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d865bc8e6c24be8933711243c693084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35aeac1bc04346f8b7e3f04bb62038b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:09:04.034241 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5cf2a18b-163b-4674-9e82-0e0c61c566ed tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] 10.222.0.61 "GET /compute/v2.1/servers/3a883a82-d992-4428-befc-9e667cee0d5c" status: 200 len: 1505 microversion: 2.1 time: 0.158845 Aug 31 17:09:04.034819 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3831/7645] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:09:03 2022] GET /compute/v2.1/servers/3a883a82-d992-4428-befc-9e667cee0d5c => generated 1505 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:09:04.054773 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-43aec1d7-fa94-4538-8a6c-d77f40bb8a8f tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:09:04.055394 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-43aec1d7-fa94-4538-8a6c-d77f40bb8a8f tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] [instance: 3a883a82-d992-4428-befc-9e667cee0d5c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:09:04.062443 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-43aec1d7-fa94-4538-8a6c-d77f40bb8a8f tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:09:04.062936 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-43aec1d7-fa94-4538-8a6c-d77f40bb8a8f tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:09:04.063377 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-43aec1d7-fa94-4538-8a6c-d77f40bb8a8f tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:09:04.064117 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-43aec1d7-fa94-4538-8a6c-d77f40bb8a8f tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:09:04.065297 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-43aec1d7-fa94-4538-8a6c-d77f40bb8a8f tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:09:04.066071 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-43aec1d7-fa94-4538-8a6c-d77f40bb8a8f tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:09:04.199942 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-43aec1d7-fa94-4538-8a6c-d77f40bb8a8f tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d865bc8e6c24be8933711243c693084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35aeac1bc04346f8b7e3f04bb62038b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:09:04.208955 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-43aec1d7-fa94-4538-8a6c-d77f40bb8a8f tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] 10.222.0.61 "GET /compute/v2.1/servers/3a883a82-d992-4428-befc-9e667cee0d5c" status: 200 len: 1505 microversion: 2.1 time: 0.158077 Aug 31 17:09:04.209539 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3815/7646] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:09:04 2022] GET /compute/v2.1/servers/3a883a82-d992-4428-befc-9e667cee0d5c => generated 1505 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:09:04.229300 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8835158a-5ce8-476e-8418-b3618df06b58 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1f7321ff-8454-4a60-a465-49a140691260"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:09:04.231662 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8835158a-5ce8-476e-8418-b3618df06b58 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] [instance: 3a883a82-d992-4428-befc-9e667cee0d5c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:09:04.238325 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8835158a-5ce8-476e-8418-b3618df06b58 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:09:04.238838 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8835158a-5ce8-476e-8418-b3618df06b58 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:09:04.239303 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8835158a-5ce8-476e-8418-b3618df06b58 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:09:04.240668 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8835158a-5ce8-476e-8418-b3618df06b58 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:09:04.241147 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8835158a-5ce8-476e-8418-b3618df06b58 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:09:04.241603 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8835158a-5ce8-476e-8418-b3618df06b58 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:09:04.272616 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8835158a-5ce8-476e-8418-b3618df06b58 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '7d865bc8e6c24be8933711243c693084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35aeac1bc04346f8b7e3f04bb62038b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:09:04.278256 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-8835158a-5ce8-476e-8418-b3618df06b58 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] HTTP exception thrown: Flavor 1f7321ff-8454-4a60-a465-49a140691260 could not be found. Aug 31 17:09:04.289302 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8835158a-5ce8-476e-8418-b3618df06b58 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Request method failure captured: Aug 31 17:09:04.289302 n-d-850499-9 devstack@n-api.service[122257]: request: POST /compute/v2.1/servers/3a883a82-d992-4428-befc-9e667cee0d5c/action HTTP/1.1 Aug 31 17:09:04.289302 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 17:09:04.289302 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 17:09:04.289302 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 17:09:04.289302 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 65 Aug 31 17:09:04.289302 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 17:09:04.289302 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 17:09:04.289302 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 17:09:04.289302 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 17:09:04.289302 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD5WTGammTlouQczb5FbUJAK3pp2FKm6dpNJafd3dH_x8xB4zvijHVPtWrwBpMaWLUIKkoJaCFSXpqZtNmWEVeMjjk9BUMh6zVRwGMA05B0hINK2qsPXt3YpKgJBoXdKaw_ijXoQGT6DR6Sk7yILn7gELAFEObaXbMTB355taDwB-yXA Aug 31 17:09:04.289302 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 17:09:04.289302 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 17:09:04.289302 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 17:09:04.289302 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 17:09:04.289302 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 17:09:04.289302 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 17:09:04.289302 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 35aeac1bc04346f8b7e3f04bb62038b5 Aug 31 17:09:04.289302 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ServersNegativeTestJSON-913757076 Aug 31 17:09:04.289302 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 17:09:04.289302 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 17:09:04.289302 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/35aeac1bc04346f8b7e3f04bb62038b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/35aeac1bc04346f8b7e3f04bb62038b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_35aeac1bc04346f8b7e3f04bb62038b5", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/35aeac1bc04346f8b7e3f04bb62038b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 17:09:04.289302 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ServersNegativeTestJSON-913757076 Aug 31 17:09:04.289302 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 35aeac1bc04346f8b7e3f04bb62038b5 Aug 31 17:09:04.289302 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ServersNegativeTestJSON-913757076 Aug 31 17:09:04.289302 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ServersNegativeTestJSON-913757076-project Aug 31 17:09:04.289302 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 17:09:04.289302 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 17:09:04.289302 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 7d865bc8e6c24be8933711243c693084 Aug 31 17:09:04.289302 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ServersNegativeTestJSON-913757076-project Aug 31 17:09:04.289302 n-d-850499-9 devstack@n-api.service[122257]: Aug 31 17:09:04.289302 n-d-850499-9 devstack@n-api.service[122257]: {"resize": {"flavorRef": "1f7321ff-8454-4a60-a465-49a140691260"}} Aug 31 17:09:04.289302 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 17:09:04.289302 n-d-850499-9 devstack@n-api.service[122257]: exception: Flavor 1f7321ff-8454-4a60-a465-49a140691260 could not be found. Aug 31 17:09:04.289302 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '3a883a82-d992-4428-befc-9e667cee0d5c', 'body': {'resize': {'flavorRef': '1f7321ff-8454-4a60-a465-49a140691260'}}} Aug 31 17:09:04.289302 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 17:09:04.289302 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:09:04.289302 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 31 17:09:04.289302 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 31 17:09:04.289302 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 31 17:09:04.289302 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 17:09:04.289302 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 31 17:09:04.289302 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 31 17:09:04.289302 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 31 17:09:04.289302 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 31 17:09:04.289302 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 17:09:04.289302 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 17:09:04.289302 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 31 17:09:04.289302 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 31 17:09:04.289302 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Aug 31 17:09:04.289302 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 17:09:04.289302 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4198, in resize Aug 31 17:09:04.289302 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Aug 31 17:09:04.289302 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 17:09:04.289302 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 17:09:04.289302 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 17:09:04.289302 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 17:09:04.289302 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 17:09:04.289302 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 17:09:04.289302 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 17:09:04.289302 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 17:09:04.289302 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 17:09:04.293643 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 17:09:04.293643 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 1f7321ff-8454-4a60-a465-49a140691260 could not be found. Aug 31 17:09:04.293643 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 17:09:04.293643 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:09:04.293643 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 17:09:04.293643 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:09:04.293643 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:09:04.293643 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:09:04.293643 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 17:09:04.293643 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 17:09:04.293643 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 17:09:04.293643 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 17:09:04.293643 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 17:09:04.293643 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 17:09:04.293643 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 31 17:09:04.293643 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 31 17:09:04.293643 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Aug 31 17:09:04.293643 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 31 17:09:04.293643 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 1f7321ff-8454-4a60-a465-49a140691260 could not be found. Aug 31 17:09:04.293643 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 17:09:04.293643 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:09:04.293643 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 17:09:04.293643 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:09:04.293643 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:09:04.293643 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:09:04.293643 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 17:09:04.293643 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 17:09:04.293643 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1f7321ff-8454-4a60-a465-49a140691260 could not be found. Aug 31 17:09:04.293643 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 17:09:04.293643 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8835158a-5ce8-476e-8418-b3618df06b58 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Returning 400 to user: Flavor 1f7321ff-8454-4a60-a465-49a140691260 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 17:09:04.293643 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8835158a-5ce8-476e-8418-b3618df06b58 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] 10.222.0.61 "POST /compute/v2.1/servers/3a883a82-d992-4428-befc-9e667cee0d5c/action" status: 400 len: 107 microversion: 2.1 time: 0.065580 Aug 31 17:09:04.293643 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3832/7647] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 17:09:04 2022] POST /compute/v2.1/servers/3a883a82-d992-4428-befc-9e667cee0d5c/action => generated 107 bytes in 67 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 17:09:04.299911 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-94cc3c0e-236b-4699-9bd5-178d5d53819e tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:09:04.300538 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-94cc3c0e-236b-4699-9bd5-178d5d53819e tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] [instance: 3a883a82-d992-4428-befc-9e667cee0d5c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:09:04.306528 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-94cc3c0e-236b-4699-9bd5-178d5d53819e tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:09:04.307015 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-94cc3c0e-236b-4699-9bd5-178d5d53819e tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:09:04.307459 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-94cc3c0e-236b-4699-9bd5-178d5d53819e tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:09:04.308180 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-94cc3c0e-236b-4699-9bd5-178d5d53819e tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:09:04.308644 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-94cc3c0e-236b-4699-9bd5-178d5d53819e tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:09:04.309077 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-94cc3c0e-236b-4699-9bd5-178d5d53819e tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:09:04.452259 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-94cc3c0e-236b-4699-9bd5-178d5d53819e tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d865bc8e6c24be8933711243c693084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35aeac1bc04346f8b7e3f04bb62038b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:09:04.460620 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-94cc3c0e-236b-4699-9bd5-178d5d53819e tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] 10.222.0.61 "GET /compute/v2.1/servers/3a883a82-d992-4428-befc-9e667cee0d5c" status: 200 len: 1505 microversion: 2.1 time: 0.164726 Aug 31 17:09:04.461212 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3816/7648] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:09:04 2022] GET /compute/v2.1/servers/3a883a82-d992-4428-befc-9e667cee0d5c => generated 1505 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:09:04.482029 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5fea6f3b-fe7f-4400-92b3-de6638fc75ec tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:09:04.482669 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5fea6f3b-fe7f-4400-92b3-de6638fc75ec tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] [instance: 3a883a82-d992-4428-befc-9e667cee0d5c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:09:04.489238 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5fea6f3b-fe7f-4400-92b3-de6638fc75ec tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:09:04.489753 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5fea6f3b-fe7f-4400-92b3-de6638fc75ec tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:09:04.490215 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5fea6f3b-fe7f-4400-92b3-de6638fc75ec tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:09:04.490935 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5fea6f3b-fe7f-4400-92b3-de6638fc75ec tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:09:04.491426 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5fea6f3b-fe7f-4400-92b3-de6638fc75ec tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:09:04.491906 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5fea6f3b-fe7f-4400-92b3-de6638fc75ec tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:09:04.623087 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5fea6f3b-fe7f-4400-92b3-de6638fc75ec tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d865bc8e6c24be8933711243c693084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35aeac1bc04346f8b7e3f04bb62038b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:09:04.632278 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5fea6f3b-fe7f-4400-92b3-de6638fc75ec tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] 10.222.0.61 "GET /compute/v2.1/servers/3a883a82-d992-4428-befc-9e667cee0d5c" status: 200 len: 1505 microversion: 2.1 time: 0.154137 Aug 31 17:09:04.632854 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3833/7649] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:09:04 2022] GET /compute/v2.1/servers/3a883a82-d992-4428-befc-9e667cee0d5c => generated 1505 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:09:04.652543 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-899eef91-22db-45af-b339-8d70ab405c5b tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:09:04.656138 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-899eef91-22db-45af-b339-8d70ab405c5b tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Request method failure captured: Aug 31 17:09:04.656138 n-d-850499-9 devstack@n-api.service[122256]: request: POST /compute/v2.1/servers/3a883a82-d992-4428-befc-9e667cee0d5c/action HTTP/1.1 Aug 31 17:09:04.656138 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 17:09:04.656138 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 17:09:04.656138 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 17:09:04.656138 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 29 Aug 31 17:09:04.656138 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 17:09:04.656138 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 17:09:04.656138 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 17:09:04.656138 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 17:09:04.656138 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD5WTGammTlouQczb5FbUJAK3pp2FKm6dpNJafd3dH_x8xB4zvijHVPtWrwBpMaWLUIKkoJaCFSXpqZtNmWEVeMjjk9BUMh6zVRwGMA05B0hINK2qsPXt3YpKgJBoXdKaw_ijXoQGT6DR6Sk7yILn7gELAFEObaXbMTB355taDwB-yXA Aug 31 17:09:04.656138 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 17:09:04.656138 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 17:09:04.656138 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 17:09:04.656138 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 17:09:04.656138 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 17:09:04.656138 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 17:09:04.656138 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 35aeac1bc04346f8b7e3f04bb62038b5 Aug 31 17:09:04.656138 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ServersNegativeTestJSON-913757076 Aug 31 17:09:04.656138 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 17:09:04.656138 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 17:09:04.656138 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/35aeac1bc04346f8b7e3f04bb62038b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/35aeac1bc04346f8b7e3f04bb62038b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_35aeac1bc04346f8b7e3f04bb62038b5", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/35aeac1bc04346f8b7e3f04bb62038b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 17:09:04.656138 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ServersNegativeTestJSON-913757076 Aug 31 17:09:04.656138 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 35aeac1bc04346f8b7e3f04bb62038b5 Aug 31 17:09:04.656138 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ServersNegativeTestJSON-913757076 Aug 31 17:09:04.656138 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ServersNegativeTestJSON-913757076-project Aug 31 17:09:04.656138 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 17:09:04.656138 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 17:09:04.656138 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 7d865bc8e6c24be8933711243c693084 Aug 31 17:09:04.656138 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ServersNegativeTestJSON-913757076-project Aug 31 17:09:04.656138 n-d-850499-9 devstack@n-api.service[122256]: Aug 31 17:09:04.656138 n-d-850499-9 devstack@n-api.service[122256]: {"resize": {"flavorRef": ""}} Aug 31 17:09:04.656138 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 17:09:04.656138 n-d-850499-9 devstack@n-api.service[122256]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 31 17:09:04.656138 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '3a883a82-d992-4428-befc-9e667cee0d5c', 'body': {'resize': {'flavorRef': ''}}} Aug 31 17:09:04.656138 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 17:09:04.656138 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:09:04.656138 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 17:09:04.656138 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 17:09:04.656138 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 17:09:04.656138 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise error Aug 31 17:09:04.656138 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 31 17:09:04.656138 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:09:04.656138 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Aug 31 17:09:04.656138 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Aug 31 17:09:04.656138 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:09:04.656138 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi On instance['resize']: Aug 31 17:09:04.656138 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi '' Aug 31 17:09:04.656138 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:09:04.656138 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:09:04.656138 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:09:04.656138 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:09:04.656138 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:09:04.656138 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:09:04.656138 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 17:09:04.656138 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 17:09:04.656138 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 17:09:04.656138 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 17:09:04.656138 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 17:09:04.656138 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 17:09:04.656138 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 17:09:04.656138 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 17:09:04.656138 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 17:09:04.656138 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 17:09:04.656138 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 31 17:09:04.656138 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:09:04.656138 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:09:04.661152 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:09:04.661152 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:09:04.661152 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:09:04.661152 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:09:04.661152 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 17:09:04.661152 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 17:09:04.661152 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 31 17:09:04.661152 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:09:04.661152 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-899eef91-22db-45af-b339-8d70ab405c5b tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 17:09:04.661152 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-899eef91-22db-45af-b339-8d70ab405c5b tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] 10.222.0.61 "POST /compute/v2.1/servers/3a883a82-d992-4428-befc-9e667cee0d5c/action" status: 400 len: 113 microversion: 2.1 time: 0.008898 Aug 31 17:09:04.661152 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3817/7650] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 17:09:04 2022] POST /compute/v2.1/servers/3a883a82-d992-4428-befc-9e667cee0d5c/action => generated 113 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 17:09:04.666064 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-853d3b34-7991-43ad-a69a-fa09a885c0f6 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:09:04.666692 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-853d3b34-7991-43ad-a69a-fa09a885c0f6 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] [instance: 3a883a82-d992-4428-befc-9e667cee0d5c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:09:04.673039 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-853d3b34-7991-43ad-a69a-fa09a885c0f6 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:09:04.673549 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-853d3b34-7991-43ad-a69a-fa09a885c0f6 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:09:04.674624 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-853d3b34-7991-43ad-a69a-fa09a885c0f6 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:09:04.675338 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-853d3b34-7991-43ad-a69a-fa09a885c0f6 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:09:04.675872 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-853d3b34-7991-43ad-a69a-fa09a885c0f6 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:09:04.676317 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-853d3b34-7991-43ad-a69a-fa09a885c0f6 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:09:04.809115 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-853d3b34-7991-43ad-a69a-fa09a885c0f6 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d865bc8e6c24be8933711243c693084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35aeac1bc04346f8b7e3f04bb62038b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:09:04.817374 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-853d3b34-7991-43ad-a69a-fa09a885c0f6 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] 10.222.0.61 "GET /compute/v2.1/servers/3a883a82-d992-4428-befc-9e667cee0d5c" status: 200 len: 1505 microversion: 2.1 time: 0.155133 Aug 31 17:09:04.817973 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3834/7651] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:09:04 2022] GET /compute/v2.1/servers/3a883a82-d992-4428-befc-9e667cee0d5c => generated 1505 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:09:04.841429 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-38b2452d-1877-4ba1-be7e-1cae58648d70 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:09:04.841849 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-38b2452d-1877-4ba1-be7e-1cae58648d70 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] [instance: a443c74b-c1a3-4f08-9b8a-cc1c87d16b56] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:09:04.849578 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-38b2452d-1877-4ba1-be7e-1cae58648d70 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:09:04.850067 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-38b2452d-1877-4ba1-be7e-1cae58648d70 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:09:04.850500 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-38b2452d-1877-4ba1-be7e-1cae58648d70 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:09:04.851189 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-38b2452d-1877-4ba1-be7e-1cae58648d70 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:09:04.851684 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-38b2452d-1877-4ba1-be7e-1cae58648d70 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:09:04.852111 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-38b2452d-1877-4ba1-be7e-1cae58648d70 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:09:04.865766 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-38b2452d-1877-4ba1-be7e-1cae58648d70 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] HTTP exception thrown: Instance a443c74b-c1a3-4f08-9b8a-cc1c87d16b56 could not be found. Aug 31 17:09:04.867315 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-38b2452d-1877-4ba1-be7e-1cae58648d70 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Request method failure captured: Aug 31 17:09:04.867315 n-d-850499-9 devstack@n-api.service[122256]: request: DELETE /compute/v2.1/servers/a443c74b-c1a3-4f08-9b8a-cc1c87d16b56 HTTP/1.1 Aug 31 17:09:04.867315 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 17:09:04.867315 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 17:09:04.867315 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 17:09:04.867315 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 17:09:04.867315 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 17:09:04.867315 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 17:09:04.867315 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 17:09:04.867315 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 17:09:04.867315 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD5WTGammTlouQczb5FbUJAK3pp2FKm6dpNJafd3dH_x8xB4zvijHVPtWrwBpMaWLUIKkoJaCFSXpqZtNmWEVeMjjk9BUMh6zVRwGMA05B0hINK2qsPXt3YpKgJBoXdKaw_ijXoQGT6DR6Sk7yILn7gELAFEObaXbMTB355taDwB-yXA Aug 31 17:09:04.867315 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 17:09:04.867315 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 17:09:04.867315 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 17:09:04.867315 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 17:09:04.867315 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 17:09:04.867315 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 17:09:04.867315 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 35aeac1bc04346f8b7e3f04bb62038b5 Aug 31 17:09:04.867315 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-ServersNegativeTestJSON-913757076 Aug 31 17:09:04.867315 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 17:09:04.867315 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 17:09:04.867315 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/35aeac1bc04346f8b7e3f04bb62038b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/35aeac1bc04346f8b7e3f04bb62038b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_35aeac1bc04346f8b7e3f04bb62038b5", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/35aeac1bc04346f8b7e3f04bb62038b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 17:09:04.867315 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-ServersNegativeTestJSON-913757076 Aug 31 17:09:04.867315 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 35aeac1bc04346f8b7e3f04bb62038b5 Aug 31 17:09:04.867315 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-ServersNegativeTestJSON-913757076 Aug 31 17:09:04.867315 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-ServersNegativeTestJSON-913757076-project Aug 31 17:09:04.867315 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 17:09:04.867315 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 17:09:04.867315 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 7d865bc8e6c24be8933711243c693084 Aug 31 17:09:04.867315 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-ServersNegativeTestJSON-913757076-project Aug 31 17:09:04.867315 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 17:09:04.867315 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance a443c74b-c1a3-4f08-9b8a-cc1c87d16b56 could not be found. Aug 31 17:09:04.867315 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': 'a443c74b-c1a3-4f08-9b8a-cc1c87d16b56'} Aug 31 17:09:04.867315 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 17:09:04.867315 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:09:04.867315 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 17:09:04.867315 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 17:09:04.867315 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 17:09:04.867315 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 17:09:04.867315 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 17:09:04.867315 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 17:09:04.867315 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 17:09:04.867315 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 17:09:04.867315 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a443c74b-c1a3-4f08-9b8a-cc1c87d16b56 could not be found. Aug 31 17:09:04.867315 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:09:04.867315 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:09:04.867315 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:09:04.867315 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:09:04.867315 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:09:04.867315 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:09:04.867315 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 17:09:04.867315 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 17:09:04.867315 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 17:09:04.867315 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 17:09:04.867315 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 17:09:04.867315 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 17:09:04.867315 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 17:09:04.867315 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 17:09:04.867315 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 17:09:04.867315 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 17:09:04.867315 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 17:09:04.867315 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 17:09:04.871745 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a443c74b-c1a3-4f08-9b8a-cc1c87d16b56 could not be found. Aug 31 17:09:04.871745 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:09:04.871745 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:09:04.871745 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:09:04.871745 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:09:04.871745 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:09:04.871745 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:09:04.871745 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 17:09:04.871745 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 17:09:04.871745 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a443c74b-c1a3-4f08-9b8a-cc1c87d16b56 could not be found. Aug 31 17:09:04.871745 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:09:04.871745 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-38b2452d-1877-4ba1-be7e-1cae58648d70 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Returning 404 to user: Instance a443c74b-c1a3-4f08-9b8a-cc1c87d16b56 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 17:09:04.871745 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-38b2452d-1877-4ba1-be7e-1cae58648d70 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] 10.222.0.61 "DELETE /compute/v2.1/servers/a443c74b-c1a3-4f08-9b8a-cc1c87d16b56" status: 404 len: 111 microversion: 2.1 time: 0.032031 Aug 31 17:09:04.871745 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3818/7652] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 17:09:04 2022] DELETE /compute/v2.1/servers/a443c74b-c1a3-4f08-9b8a-cc1c87d16b56 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 17:09:04.877218 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-cabdd4e1-c682-436a-a185-cb6a526d1f97 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:09:04.878136 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-cabdd4e1-c682-436a-a185-cb6a526d1f97 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] [instance: a443c74b-c1a3-4f08-9b8a-cc1c87d16b56] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:09:04.884531 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cabdd4e1-c682-436a-a185-cb6a526d1f97 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:09:04.885040 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cabdd4e1-c682-436a-a185-cb6a526d1f97 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:09:04.885494 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cabdd4e1-c682-436a-a185-cb6a526d1f97 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:09:04.886208 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cabdd4e1-c682-436a-a185-cb6a526d1f97 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:09:04.886679 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cabdd4e1-c682-436a-a185-cb6a526d1f97 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:09:04.887125 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cabdd4e1-c682-436a-a185-cb6a526d1f97 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:09:04.900943 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-cabdd4e1-c682-436a-a185-cb6a526d1f97 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] HTTP exception thrown: Instance a443c74b-c1a3-4f08-9b8a-cc1c87d16b56 could not be found. Aug 31 17:09:04.902538 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-cabdd4e1-c682-436a-a185-cb6a526d1f97 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Request method failure captured: Aug 31 17:09:04.902538 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/a443c74b-c1a3-4f08-9b8a-cc1c87d16b56 HTTP/1.1 Aug 31 17:09:04.902538 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 17:09:04.902538 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 17:09:04.902538 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 17:09:04.902538 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 17:09:04.902538 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 17:09:04.902538 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 17:09:04.902538 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 17:09:04.902538 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 17:09:04.902538 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD5WTGammTlouQczb5FbUJAK3pp2FKm6dpNJafd3dH_x8xB4zvijHVPtWrwBpMaWLUIKkoJaCFSXpqZtNmWEVeMjjk9BUMh6zVRwGMA05B0hINK2qsPXt3YpKgJBoXdKaw_ijXoQGT6DR6Sk7yILn7gELAFEObaXbMTB355taDwB-yXA Aug 31 17:09:04.902538 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 17:09:04.902538 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 17:09:04.902538 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 17:09:04.902538 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 17:09:04.902538 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 17:09:04.902538 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 17:09:04.902538 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 35aeac1bc04346f8b7e3f04bb62038b5 Aug 31 17:09:04.902538 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ServersNegativeTestJSON-913757076 Aug 31 17:09:04.902538 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 17:09:04.902538 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 17:09:04.902538 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/35aeac1bc04346f8b7e3f04bb62038b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/35aeac1bc04346f8b7e3f04bb62038b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_35aeac1bc04346f8b7e3f04bb62038b5", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/35aeac1bc04346f8b7e3f04bb62038b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 17:09:04.902538 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ServersNegativeTestJSON-913757076 Aug 31 17:09:04.902538 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 35aeac1bc04346f8b7e3f04bb62038b5 Aug 31 17:09:04.902538 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ServersNegativeTestJSON-913757076 Aug 31 17:09:04.902538 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ServersNegativeTestJSON-913757076-project Aug 31 17:09:04.902538 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 17:09:04.902538 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 17:09:04.902538 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 7d865bc8e6c24be8933711243c693084 Aug 31 17:09:04.902538 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ServersNegativeTestJSON-913757076-project Aug 31 17:09:04.902538 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 17:09:04.902538 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance a443c74b-c1a3-4f08-9b8a-cc1c87d16b56 could not be found. Aug 31 17:09:04.902538 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': 'a443c74b-c1a3-4f08-9b8a-cc1c87d16b56'} Aug 31 17:09:04.902538 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 17:09:04.902538 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:09:04.902538 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 17:09:04.902538 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 17:09:04.902538 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 17:09:04.902538 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 17:09:04.902538 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 17:09:04.902538 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 17:09:04.902538 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 17:09:04.902538 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 17:09:04.902538 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a443c74b-c1a3-4f08-9b8a-cc1c87d16b56 could not be found. Aug 31 17:09:04.902538 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 17:09:04.902538 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:09:04.902538 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 17:09:04.902538 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:09:04.902538 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:09:04.902538 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:09:04.902538 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 17:09:04.902538 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 17:09:04.902538 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 17:09:04.902538 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 17:09:04.902538 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 17:09:04.902538 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 17:09:04.902538 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 17:09:04.902538 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 17:09:04.902538 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 17:09:04.902538 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 17:09:04.902538 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a443c74b-c1a3-4f08-9b8a-cc1c87d16b56 could not be found. Aug 31 17:09:04.902538 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 17:09:04.902538 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:09:04.902538 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 17:09:04.907039 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:09:04.907039 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:09:04.907039 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:09:04.907039 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 17:09:04.907039 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 17:09:04.907039 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a443c74b-c1a3-4f08-9b8a-cc1c87d16b56 could not be found. Aug 31 17:09:04.907039 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 17:09:04.907039 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-cabdd4e1-c682-436a-a185-cb6a526d1f97 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Returning 404 to user: Instance a443c74b-c1a3-4f08-9b8a-cc1c87d16b56 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 17:09:04.907039 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-cabdd4e1-c682-436a-a185-cb6a526d1f97 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] 10.222.0.61 "GET /compute/v2.1/servers/a443c74b-c1a3-4f08-9b8a-cc1c87d16b56" status: 404 len: 111 microversion: 2.1 time: 0.030717 Aug 31 17:09:04.907039 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3835/7653] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:09:04 2022] GET /compute/v2.1/servers/a443c74b-c1a3-4f08-9b8a-cc1c87d16b56 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 17:09:04.913057 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a42d6075-c5a6-4a8d-880b-2d0ecf48eefc tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:09:04.913560 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a42d6075-c5a6-4a8d-880b-2d0ecf48eefc tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] [instance: 3a883a82-d992-4428-befc-9e667cee0d5c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:09:04.919725 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a42d6075-c5a6-4a8d-880b-2d0ecf48eefc tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:09:04.920223 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a42d6075-c5a6-4a8d-880b-2d0ecf48eefc tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:09:04.920665 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a42d6075-c5a6-4a8d-880b-2d0ecf48eefc tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:09:04.921367 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a42d6075-c5a6-4a8d-880b-2d0ecf48eefc tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:09:04.921834 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a42d6075-c5a6-4a8d-880b-2d0ecf48eefc tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:09:04.922267 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a42d6075-c5a6-4a8d-880b-2d0ecf48eefc tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:09:04.949018 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a42d6075-c5a6-4a8d-880b-2d0ecf48eefc tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] [instance: 3a883a82-d992-4428-befc-9e667cee0d5c] Going to try to terminate instance {{(pid=122256) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 17:09:04.984171 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:09:05.029186 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a42d6075-c5a6-4a8d-880b-2d0ecf48eefc tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] 10.222.0.61 "DELETE /compute/v2.1/servers/3a883a82-d992-4428-befc-9e667cee0d5c" status: 204 len: 0 microversion: 2.1 time: 0.119481 Aug 31 17:09:05.029993 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3819/7654] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 17:09:04 2022] DELETE /compute/v2.1/servers/3a883a82-d992-4428-befc-9e667cee0d5c => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 17:09:05.038711 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ef0e7c01-fa64-41ea-a5aa-4910e03a5c7c tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:09:05.039349 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ef0e7c01-fa64-41ea-a5aa-4910e03a5c7c tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] [instance: 3a883a82-d992-4428-befc-9e667cee0d5c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:09:05.045446 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ef0e7c01-fa64-41ea-a5aa-4910e03a5c7c tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:09:05.045946 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ef0e7c01-fa64-41ea-a5aa-4910e03a5c7c tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:09:05.046409 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ef0e7c01-fa64-41ea-a5aa-4910e03a5c7c tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:09:05.047122 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ef0e7c01-fa64-41ea-a5aa-4910e03a5c7c tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:09:05.047625 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ef0e7c01-fa64-41ea-a5aa-4910e03a5c7c tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:09:05.048080 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ef0e7c01-fa64-41ea-a5aa-4910e03a5c7c tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:09:05.188289 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ef0e7c01-fa64-41ea-a5aa-4910e03a5c7c tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d865bc8e6c24be8933711243c693084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35aeac1bc04346f8b7e3f04bb62038b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:09:05.196597 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ef0e7c01-fa64-41ea-a5aa-4910e03a5c7c tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] 10.222.0.61 "GET /compute/v2.1/servers/3a883a82-d992-4428-befc-9e667cee0d5c" status: 200 len: 1511 microversion: 2.1 time: 0.161749 Aug 31 17:09:05.197180 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3836/7655] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:09:05 2022] GET /compute/v2.1/servers/3a883a82-d992-4428-befc-9e667cee0d5c => generated 1511 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:09:06.218777 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2c820f10-dd3e-4fbe-a6d7-ba5d7dce967d tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:09:06.219480 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2c820f10-dd3e-4fbe-a6d7-ba5d7dce967d tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] [instance: 3a883a82-d992-4428-befc-9e667cee0d5c] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:09:06.227014 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2c820f10-dd3e-4fbe-a6d7-ba5d7dce967d tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:09:06.227487 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2c820f10-dd3e-4fbe-a6d7-ba5d7dce967d tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:09:06.227949 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2c820f10-dd3e-4fbe-a6d7-ba5d7dce967d tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:09:06.228649 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2c820f10-dd3e-4fbe-a6d7-ba5d7dce967d tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:09:06.229109 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2c820f10-dd3e-4fbe-a6d7-ba5d7dce967d tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:09:06.229536 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2c820f10-dd3e-4fbe-a6d7-ba5d7dce967d tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:09:06.362881 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-2c820f10-dd3e-4fbe-a6d7-ba5d7dce967d tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d865bc8e6c24be8933711243c693084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35aeac1bc04346f8b7e3f04bb62038b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:09:06.370938 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2c820f10-dd3e-4fbe-a6d7-ba5d7dce967d tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] 10.222.0.61 "GET /compute/v2.1/servers/3a883a82-d992-4428-befc-9e667cee0d5c" status: 200 len: 1511 microversion: 2.1 time: 0.156431 Aug 31 17:09:06.371578 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3820/7656] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:09:06 2022] GET /compute/v2.1/servers/3a883a82-d992-4428-befc-9e667cee0d5c => generated 1511 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:09:07.396778 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8dee32f7-957b-4aec-81ab-b85d2a5d2835 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:09:07.397410 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8dee32f7-957b-4aec-81ab-b85d2a5d2835 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] [instance: 3a883a82-d992-4428-befc-9e667cee0d5c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:09:07.399385 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:09:07.404993 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8dee32f7-957b-4aec-81ab-b85d2a5d2835 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:09:07.405498 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8dee32f7-957b-4aec-81ab-b85d2a5d2835 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:09:07.405960 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8dee32f7-957b-4aec-81ab-b85d2a5d2835 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:09:07.406665 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8dee32f7-957b-4aec-81ab-b85d2a5d2835 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:09:07.407134 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8dee32f7-957b-4aec-81ab-b85d2a5d2835 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:09:07.407606 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8dee32f7-957b-4aec-81ab-b85d2a5d2835 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:09:07.525178 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8dee32f7-957b-4aec-81ab-b85d2a5d2835 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d865bc8e6c24be8933711243c693084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35aeac1bc04346f8b7e3f04bb62038b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:09:07.538635 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8dee32f7-957b-4aec-81ab-b85d2a5d2835 tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] 10.222.0.61 "GET /compute/v2.1/servers/3a883a82-d992-4428-befc-9e667cee0d5c" status: 200 len: 1469 microversion: 2.1 time: 0.150655 Aug 31 17:09:07.539236 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3837/7657] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:09:07 2022] GET /compute/v2.1/servers/3a883a82-d992-4428-befc-9e667cee0d5c => generated 1469 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:09:07.567492 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-a794f953-bf1c-4de0-a82f-1e2364b23c71 req-58f0d781-2204-4b5e-b3e9-814e856ef2cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a883a82-d992-4428-befc-9e667cee0d5c", "name": "network-vif-deleted", "tag": "41127c66-bac2-4d09-991a-7b365aa8d78f"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:09:07.578213 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-a794f953-bf1c-4de0-a82f-1e2364b23c71 req-58f0d781-2204-4b5e-b3e9-814e856ef2cb service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:09:07.578785 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-a794f953-bf1c-4de0-a82f-1e2364b23c71 req-58f0d781-2204-4b5e-b3e9-814e856ef2cb service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:09:07.579300 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-a794f953-bf1c-4de0-a82f-1e2364b23c71 req-58f0d781-2204-4b5e-b3e9-814e856ef2cb service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:09:07.592515 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-a794f953-bf1c-4de0-a82f-1e2364b23c71 req-58f0d781-2204-4b5e-b3e9-814e856ef2cb service nova] Creating event network-vif-deleted:41127c66-bac2-4d09-991a-7b365aa8d78f for instance 3a883a82-d992-4428-befc-9e667cee0d5c on n-h2-850499-9 Aug 31 17:09:07.598634 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-a794f953-bf1c-4de0-a82f-1e2364b23c71 req-58f0d781-2204-4b5e-b3e9-814e856ef2cb service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035529 Aug 31 17:09:07.599300 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3821/7658] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:09:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:09:08.560594 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5c1571e9-d95e-462b-94b2-d06a909629cc tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:09:08.561226 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5c1571e9-d95e-462b-94b2-d06a909629cc tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] [instance: 3a883a82-d992-4428-befc-9e667cee0d5c] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:09:08.568965 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5c1571e9-d95e-462b-94b2-d06a909629cc tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:09:08.569475 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5c1571e9-d95e-462b-94b2-d06a909629cc tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:09:08.569944 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5c1571e9-d95e-462b-94b2-d06a909629cc tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:09:08.570657 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5c1571e9-d95e-462b-94b2-d06a909629cc tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:09:08.571124 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5c1571e9-d95e-462b-94b2-d06a909629cc tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:09:08.571596 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5c1571e9-d95e-462b-94b2-d06a909629cc tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:09:08.585856 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-5c1571e9-d95e-462b-94b2-d06a909629cc tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] HTTP exception thrown: Instance 3a883a82-d992-4428-befc-9e667cee0d5c could not be found. Aug 31 17:09:08.587423 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5c1571e9-d95e-462b-94b2-d06a909629cc tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Request method failure captured: Aug 31 17:09:08.587423 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/3a883a82-d992-4428-befc-9e667cee0d5c HTTP/1.1 Aug 31 17:09:08.587423 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 17:09:08.587423 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 17:09:08.587423 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 17:09:08.587423 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 17:09:08.587423 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 17:09:08.587423 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 17:09:08.587423 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 17:09:08.587423 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 17:09:08.587423 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD5WTGammTlouQczb5FbUJAK3pp2FKm6dpNJafd3dH_x8xB4zvijHVPtWrwBpMaWLUIKkoJaCFSXpqZtNmWEVeMjjk9BUMh6zVRwGMA05B0hINK2qsPXt3YpKgJBoXdKaw_ijXoQGT6DR6Sk7yILn7gELAFEObaXbMTB355taDwB-yXA Aug 31 17:09:08.587423 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 17:09:08.587423 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 17:09:08.587423 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 17:09:08.587423 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 17:09:08.587423 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 17:09:08.587423 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 17:09:08.587423 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 35aeac1bc04346f8b7e3f04bb62038b5 Aug 31 17:09:08.587423 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-ServersNegativeTestJSON-913757076 Aug 31 17:09:08.587423 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 17:09:08.587423 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 17:09:08.587423 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/35aeac1bc04346f8b7e3f04bb62038b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/35aeac1bc04346f8b7e3f04bb62038b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_35aeac1bc04346f8b7e3f04bb62038b5", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/35aeac1bc04346f8b7e3f04bb62038b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 17:09:08.587423 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-ServersNegativeTestJSON-913757076 Aug 31 17:09:08.587423 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 35aeac1bc04346f8b7e3f04bb62038b5 Aug 31 17:09:08.587423 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-ServersNegativeTestJSON-913757076 Aug 31 17:09:08.587423 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-ServersNegativeTestJSON-913757076-project Aug 31 17:09:08.587423 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 17:09:08.587423 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 17:09:08.587423 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 7d865bc8e6c24be8933711243c693084 Aug 31 17:09:08.587423 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-ServersNegativeTestJSON-913757076-project Aug 31 17:09:08.587423 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 17:09:08.587423 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance 3a883a82-d992-4428-befc-9e667cee0d5c could not be found. Aug 31 17:09:08.587423 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '3a883a82-d992-4428-befc-9e667cee0d5c'} Aug 31 17:09:08.587423 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 17:09:08.587423 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:09:08.587423 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 17:09:08.587423 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 17:09:08.587423 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 17:09:08.587423 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 17:09:08.587423 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 17:09:08.587423 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 17:09:08.587423 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 17:09:08.587423 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 17:09:08.587423 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a883a82-d992-4428-befc-9e667cee0d5c could not be found. Aug 31 17:09:08.587423 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 17:09:08.587423 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:09:08.587423 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 17:09:08.587423 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:09:08.587423 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:09:08.587423 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:09:08.587423 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 17:09:08.587423 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 17:09:08.587423 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 17:09:08.587423 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 17:09:08.587423 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 17:09:08.587423 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 17:09:08.587423 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 17:09:08.587423 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 17:09:08.587423 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 17:09:08.587423 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 17:09:08.587423 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a883a82-d992-4428-befc-9e667cee0d5c could not be found. Aug 31 17:09:08.587423 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 17:09:08.587423 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:09:08.587423 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 17:09:08.592179 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:09:08.592179 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:09:08.592179 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:09:08.592179 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 17:09:08.592179 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 17:09:08.592179 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a883a82-d992-4428-befc-9e667cee0d5c could not be found. Aug 31 17:09:08.592179 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 17:09:08.592179 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5c1571e9-d95e-462b-94b2-d06a909629cc tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] Returning 404 to user: Instance 3a883a82-d992-4428-befc-9e667cee0d5c could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 17:09:08.592179 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5c1571e9-d95e-462b-94b2-d06a909629cc tempest-ServersNegativeTestJSON-913757076 tempest-ServersNegativeTestJSON-913757076-project] 10.222.0.61 "GET /compute/v2.1/servers/3a883a82-d992-4428-befc-9e667cee0d5c" status: 404 len: 111 microversion: 2.1 time: 0.032292 Aug 31 17:09:08.592179 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3838/7659] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:09:08 2022] GET /compute/v2.1/servers/3a883a82-d992-4428-befc-9e667cee0d5c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 17:09:42.507015 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:09:42.508275 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=11,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:09:42.782667 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-70d7fe98-f591-4281-85e7-028a55d04651 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Action: 'create', calling method: .version_select at 0x7f5ae828e9d0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-271966325", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE9BBKQScbHRIWercD2pCnnDtkQBJKfdzONSjihVeoIsZM0z+VmKpHdCKAHskoKycGc6FyJQN6hrQNdE4cXBYgXpX0lhMwz4yURRKUADW8R4Df/6NxHyx/nHys6O8h+oeQ=="}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:09:42.801875 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-70d7fe98-f591-4281-85e7-028a55d04651 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Getting quotas for project dc8f33c33f1f43319c2e92431394bcd5. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 17:09:42.808117 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-70d7fe98-f591-4281-85e7-028a55d04651 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Getting quotas for user 4fea615ea5074760833d02cf7e7b9fd5 and project dc8f33c33f1f43319c2e92431394bcd5. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 17:09:42.859193 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-70d7fe98-f591-4281-85e7-028a55d04651 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.355228 Aug 31 17:09:42.859898 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3822/7660] 10.222.0.61 () {60 vars in 1159 bytes} [Wed Aug 31 17:09:42 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:09:42.918995 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-571f6f33-6ca1-4989-85dd-2be5fc73f4a1 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1881887821", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-271966325", "networks": [{"uuid": "66777fc5-2971-41c8-ae03-426d8b705797"}]}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:09:42.930826 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=3 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:09:42.931608 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=36 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:09:42.993493 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-571f6f33-6ca1-4989-85dd-2be5fc73f4a1 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] validate_networks() for [('66777fc5-2971-41c8-ae03-426d8b705797', None, None, None, None, None)] {{(pid=122257) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 17:09:43.417334 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-571f6f33-6ca1-4989-85dd-2be5fc73f4a1 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 17:09:43.417918 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-571f6f33-6ca1-4989-85dd-2be5fc73f4a1 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 17:09:43.418563 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-571f6f33-6ca1-4989-85dd-2be5fc73f4a1 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 17:09:43.419053 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-571f6f33-6ca1-4989-85dd-2be5fc73f4a1 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 17:09:43.419599 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-571f6f33-6ca1-4989-85dd-2be5fc73f4a1 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 17:09:43.430876 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-571f6f33-6ca1-4989-85dd-2be5fc73f4a1 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:09:43.431436 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-571f6f33-6ca1-4989-85dd-2be5fc73f4a1 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:09:43.432031 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-571f6f33-6ca1-4989-85dd-2be5fc73f4a1 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:09:43.432878 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-571f6f33-6ca1-4989-85dd-2be5fc73f4a1 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:09:43.433358 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-571f6f33-6ca1-4989-85dd-2be5fc73f4a1 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:09:43.433977 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-571f6f33-6ca1-4989-85dd-2be5fc73f4a1 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:09:43.455600 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-571f6f33-6ca1-4989-85dd-2be5fc73f4a1 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Getting quotas for project dc8f33c33f1f43319c2e92431394bcd5. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 17:09:43.461268 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-571f6f33-6ca1-4989-85dd-2be5fc73f4a1 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Getting quotas for user 4fea615ea5074760833d02cf7e7b9fd5 and project dc8f33c33f1f43319c2e92431394bcd5. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 17:09:43.474971 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-571f6f33-6ca1-4989-85dd-2be5fc73f4a1 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Going to run 1 instances... {{(pid=122257) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 17:09:43.477459 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-571f6f33-6ca1-4989-85dd-2be5fc73f4a1 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] [instance: 5dcf5ed7-674e-4286-b880-ee1e6a69c801] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 17:09:43.529701 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-571f6f33-6ca1-4989-85dd-2be5fc73f4a1 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.615253 Aug 31 17:09:43.530593 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3839/7661] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 17:09:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 617 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 17:09:43.543381 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1942a1d8-0ab5-408d-93a7-9f9adfd4f867 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:09:43.544367 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1942a1d8-0ab5-408d-93a7-9f9adfd4f867 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] [instance: 5dcf5ed7-674e-4286-b880-ee1e6a69c801] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:09:43.603253 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1942a1d8-0ab5-408d-93a7-9f9adfd4f867 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fea615ea5074760833d02cf7e7b9fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8f33c33f1f43319c2e92431394bcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:09:43.611045 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1942a1d8-0ab5-408d-93a7-9f9adfd4f867 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] 10.222.0.61 "GET /compute/v2.1/servers/5dcf5ed7-674e-4286-b880-ee1e6a69c801" status: 200 len: 1262 microversion: 2.1 time: 0.072887 Aug 31 17:09:43.611670 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3823/7662] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:09:43 2022] GET /compute/v2.1/servers/5dcf5ed7-674e-4286-b880-ee1e6a69c801 => generated 1262 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:09:44.636112 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-63a625c7-46af-4142-930d-855f3c806443 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:09:44.636745 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-63a625c7-46af-4142-930d-855f3c806443 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] [instance: 5dcf5ed7-674e-4286-b880-ee1e6a69c801] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:09:44.649239 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-63a625c7-46af-4142-930d-855f3c806443 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:09:44.649950 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-63a625c7-46af-4142-930d-855f3c806443 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:09:44.650725 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-63a625c7-46af-4142-930d-855f3c806443 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:09:44.651589 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-63a625c7-46af-4142-930d-855f3c806443 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:09:44.652488 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-63a625c7-46af-4142-930d-855f3c806443 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:09:44.653160 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-63a625c7-46af-4142-930d-855f3c806443 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:09:44.833093 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-63a625c7-46af-4142-930d-855f3c806443 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fea615ea5074760833d02cf7e7b9fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8f33c33f1f43319c2e92431394bcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:09:44.852424 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-63a625c7-46af-4142-930d-855f3c806443 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] 10.222.0.61 "GET /compute/v2.1/servers/5dcf5ed7-674e-4286-b880-ee1e6a69c801" status: 200 len: 1322 microversion: 2.1 time: 0.217014 Aug 31 17:09:44.853101 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3840/7663] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:09:44 2022] GET /compute/v2.1/servers/5dcf5ed7-674e-4286-b880-ee1e6a69c801 => generated 1322 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:09:45.874718 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b61b87d7-c063-41a9-b97f-c53eade7a95b tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:09:45.875366 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b61b87d7-c063-41a9-b97f-c53eade7a95b tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] [instance: 5dcf5ed7-674e-4286-b880-ee1e6a69c801] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:09:45.892154 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b61b87d7-c063-41a9-b97f-c53eade7a95b tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:09:45.892967 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b61b87d7-c063-41a9-b97f-c53eade7a95b tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:09:45.894037 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b61b87d7-c063-41a9-b97f-c53eade7a95b tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:09:45.894218 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b61b87d7-c063-41a9-b97f-c53eade7a95b tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:09:45.894935 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b61b87d7-c063-41a9-b97f-c53eade7a95b tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:09:45.895384 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b61b87d7-c063-41a9-b97f-c53eade7a95b tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:09:46.147056 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b61b87d7-c063-41a9-b97f-c53eade7a95b tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fea615ea5074760833d02cf7e7b9fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8f33c33f1f43319c2e92431394bcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:09:46.155376 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b61b87d7-c063-41a9-b97f-c53eade7a95b tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] 10.222.0.61 "GET /compute/v2.1/servers/5dcf5ed7-674e-4286-b880-ee1e6a69c801" status: 200 len: 1362 microversion: 2.1 time: 0.285027 Aug 31 17:09:46.156312 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3824/7664] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:09:45 2022] GET /compute/v2.1/servers/5dcf5ed7-674e-4286-b880-ee1e6a69c801 => generated 1362 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:09:46.312643 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-16b71a93-ccc5-4192-b65e-6a9d221e0854 req-05b90bba-c20b-46ef-88a6-136979af4d17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5dcf5ed7-674e-4286-b880-ee1e6a69c801", "tag": "42fd563e-aae1-47e6-9a7b-192d28d35347"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:09:46.332454 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-16b71a93-ccc5-4192-b65e-6a9d221e0854 req-05b90bba-c20b-46ef-88a6-136979af4d17 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:09:46.333581 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-16b71a93-ccc5-4192-b65e-6a9d221e0854 req-05b90bba-c20b-46ef-88a6-136979af4d17 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:09:46.334069 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-16b71a93-ccc5-4192-b65e-6a9d221e0854 req-05b90bba-c20b-46ef-88a6-136979af4d17 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:09:46.346784 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-16b71a93-ccc5-4192-b65e-6a9d221e0854 req-05b90bba-c20b-46ef-88a6-136979af4d17 service nova] Creating event network-changed:42fd563e-aae1-47e6-9a7b-192d28d35347 for instance 5dcf5ed7-674e-4286-b880-ee1e6a69c801 on n-h1-850499-9 Aug 31 17:09:46.353131 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-16b71a93-ccc5-4192-b65e-6a9d221e0854 req-05b90bba-c20b-46ef-88a6-136979af4d17 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049213 Aug 31 17:09:46.353967 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3841/7665] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:09:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:09:47.178414 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8f52bbc5-f788-4532-a265-bafe804b115f tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:09:47.179041 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8f52bbc5-f788-4532-a265-bafe804b115f tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] [instance: 5dcf5ed7-674e-4286-b880-ee1e6a69c801] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:09:47.185327 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8f52bbc5-f788-4532-a265-bafe804b115f tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:09:47.185837 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8f52bbc5-f788-4532-a265-bafe804b115f tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:09:47.186285 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8f52bbc5-f788-4532-a265-bafe804b115f tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:09:47.187008 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8f52bbc5-f788-4532-a265-bafe804b115f tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:09:47.187480 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8f52bbc5-f788-4532-a265-bafe804b115f tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:09:47.187940 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8f52bbc5-f788-4532-a265-bafe804b115f tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:09:47.346945 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8f52bbc5-f788-4532-a265-bafe804b115f tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fea615ea5074760833d02cf7e7b9fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8f33c33f1f43319c2e92431394bcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:09:47.355239 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8f52bbc5-f788-4532-a265-bafe804b115f tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] 10.222.0.61 "GET /compute/v2.1/servers/5dcf5ed7-674e-4286-b880-ee1e6a69c801" status: 200 len: 1362 microversion: 2.1 time: 0.181802 Aug 31 17:09:47.355891 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3825/7666] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:09:47 2022] GET /compute/v2.1/servers/5dcf5ed7-674e-4286-b880-ee1e6a69c801 => generated 1362 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:09:48.379084 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-25e83982-4e32-4519-a9a7-144ab6d24926 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:09:48.379755 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-25e83982-4e32-4519-a9a7-144ab6d24926 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] [instance: 5dcf5ed7-674e-4286-b880-ee1e6a69c801] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:09:48.386162 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-25e83982-4e32-4519-a9a7-144ab6d24926 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:09:48.386673 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-25e83982-4e32-4519-a9a7-144ab6d24926 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:09:48.387139 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-25e83982-4e32-4519-a9a7-144ab6d24926 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:09:48.387893 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-25e83982-4e32-4519-a9a7-144ab6d24926 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:09:48.388380 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-25e83982-4e32-4519-a9a7-144ab6d24926 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:09:48.388861 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-25e83982-4e32-4519-a9a7-144ab6d24926 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:09:48.533970 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-25e83982-4e32-4519-a9a7-144ab6d24926 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fea615ea5074760833d02cf7e7b9fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8f33c33f1f43319c2e92431394bcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:09:48.542503 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-25e83982-4e32-4519-a9a7-144ab6d24926 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] 10.222.0.61 "GET /compute/v2.1/servers/5dcf5ed7-674e-4286-b880-ee1e6a69c801" status: 200 len: 1362 microversion: 2.1 time: 0.169357 Aug 31 17:09:48.543326 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3842/7667] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:09:48 2022] GET /compute/v2.1/servers/5dcf5ed7-674e-4286-b880-ee1e6a69c801 => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:09:49.564532 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3024b86e-02ec-4eb1-9800-2031942a45c4 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:09:49.565307 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3024b86e-02ec-4eb1-9800-2031942a45c4 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] [instance: 5dcf5ed7-674e-4286-b880-ee1e6a69c801] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:09:49.573073 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3024b86e-02ec-4eb1-9800-2031942a45c4 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:09:49.573582 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3024b86e-02ec-4eb1-9800-2031942a45c4 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:09:49.574032 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3024b86e-02ec-4eb1-9800-2031942a45c4 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:09:49.574763 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3024b86e-02ec-4eb1-9800-2031942a45c4 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:09:49.575533 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3024b86e-02ec-4eb1-9800-2031942a45c4 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:09:49.575979 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3024b86e-02ec-4eb1-9800-2031942a45c4 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:09:49.730881 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3024b86e-02ec-4eb1-9800-2031942a45c4 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fea615ea5074760833d02cf7e7b9fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8f33c33f1f43319c2e92431394bcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:09:49.739848 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3024b86e-02ec-4eb1-9800-2031942a45c4 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] 10.222.0.61 "GET /compute/v2.1/servers/5dcf5ed7-674e-4286-b880-ee1e6a69c801" status: 200 len: 1362 microversion: 2.1 time: 0.179468 Aug 31 17:09:49.740437 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3826/7668] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:09:49 2022] GET /compute/v2.1/servers/5dcf5ed7-674e-4286-b880-ee1e6a69c801 => generated 1362 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:09:50.761107 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-608c9aea-942f-4dee-b2b9-e1c77f8ee128 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:09:50.761866 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-608c9aea-942f-4dee-b2b9-e1c77f8ee128 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] [instance: 5dcf5ed7-674e-4286-b880-ee1e6a69c801] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:09:50.769374 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-608c9aea-942f-4dee-b2b9-e1c77f8ee128 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:09:50.769895 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-608c9aea-942f-4dee-b2b9-e1c77f8ee128 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:09:50.770378 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-608c9aea-942f-4dee-b2b9-e1c77f8ee128 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:09:50.771113 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-608c9aea-942f-4dee-b2b9-e1c77f8ee128 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:09:50.771661 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-608c9aea-942f-4dee-b2b9-e1c77f8ee128 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:09:50.772332 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-608c9aea-942f-4dee-b2b9-e1c77f8ee128 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:09:50.926750 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-608c9aea-942f-4dee-b2b9-e1c77f8ee128 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fea615ea5074760833d02cf7e7b9fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8f33c33f1f43319c2e92431394bcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:09:50.936491 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-608c9aea-942f-4dee-b2b9-e1c77f8ee128 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] 10.222.0.61 "GET /compute/v2.1/servers/5dcf5ed7-674e-4286-b880-ee1e6a69c801" status: 200 len: 1362 microversion: 2.1 time: 0.178982 Aug 31 17:09:50.937090 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3843/7669] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:09:50 2022] GET /compute/v2.1/servers/5dcf5ed7-674e-4286-b880-ee1e6a69c801 => generated 1362 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:09:51.957144 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8ced18ac-7e47-46da-8677-a47c28b9e610 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:09:51.957808 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8ced18ac-7e47-46da-8677-a47c28b9e610 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] [instance: 5dcf5ed7-674e-4286-b880-ee1e6a69c801] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:09:51.965408 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8ced18ac-7e47-46da-8677-a47c28b9e610 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:09:51.965817 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8ced18ac-7e47-46da-8677-a47c28b9e610 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:09:51.966269 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8ced18ac-7e47-46da-8677-a47c28b9e610 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:09:51.967027 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8ced18ac-7e47-46da-8677-a47c28b9e610 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:09:51.967435 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8ced18ac-7e47-46da-8677-a47c28b9e610 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:09:51.967924 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8ced18ac-7e47-46da-8677-a47c28b9e610 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:09:52.205852 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8ced18ac-7e47-46da-8677-a47c28b9e610 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fea615ea5074760833d02cf7e7b9fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8f33c33f1f43319c2e92431394bcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:09:52.214143 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8ced18ac-7e47-46da-8677-a47c28b9e610 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] 10.222.0.61 "GET /compute/v2.1/servers/5dcf5ed7-674e-4286-b880-ee1e6a69c801" status: 200 len: 1362 microversion: 2.1 time: 0.261031 Aug 31 17:09:52.214734 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3827/7670] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:09:51 2022] GET /compute/v2.1/servers/5dcf5ed7-674e-4286-b880-ee1e6a69c801 => generated 1362 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 17:09:52.303971 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-3c980417-cd63-41ea-8ba4-3c761ccf3ae4 req-b6bb6e67-6de5-4e14-a383-9d396fc89b85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dcf5ed7-674e-4286-b880-ee1e6a69c801", "name": "network-vif-plugged", "status": "completed", "tag": "42fd563e-aae1-47e6-9a7b-192d28d35347"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:09:52.315087 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-3c980417-cd63-41ea-8ba4-3c761ccf3ae4 req-b6bb6e67-6de5-4e14-a383-9d396fc89b85 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:09:52.315760 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-3c980417-cd63-41ea-8ba4-3c761ccf3ae4 req-b6bb6e67-6de5-4e14-a383-9d396fc89b85 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:09:52.316523 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-3c980417-cd63-41ea-8ba4-3c761ccf3ae4 req-b6bb6e67-6de5-4e14-a383-9d396fc89b85 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:09:52.332675 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-3c980417-cd63-41ea-8ba4-3c761ccf3ae4 req-b6bb6e67-6de5-4e14-a383-9d396fc89b85 service nova] Creating event network-vif-plugged:42fd563e-aae1-47e6-9a7b-192d28d35347 for instance 5dcf5ed7-674e-4286-b880-ee1e6a69c801 on n-h1-850499-9 Aug 31 17:09:52.339154 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-3c980417-cd63-41ea-8ba4-3c761ccf3ae4 req-b6bb6e67-6de5-4e14-a383-9d396fc89b85 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039194 Aug 31 17:09:52.339822 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3844/7671] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:09:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:09:53.236699 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c3098263-f11b-4b6e-9aa7-7551710cf6fc tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:09:53.237249 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c3098263-f11b-4b6e-9aa7-7551710cf6fc tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] [instance: 5dcf5ed7-674e-4286-b880-ee1e6a69c801] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:09:53.244417 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c3098263-f11b-4b6e-9aa7-7551710cf6fc tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:09:53.244914 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c3098263-f11b-4b6e-9aa7-7551710cf6fc tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:09:53.245363 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c3098263-f11b-4b6e-9aa7-7551710cf6fc tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:09:53.246072 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c3098263-f11b-4b6e-9aa7-7551710cf6fc tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:09:53.246537 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c3098263-f11b-4b6e-9aa7-7551710cf6fc tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:09:53.246976 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c3098263-f11b-4b6e-9aa7-7551710cf6fc tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:09:53.388568 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c3098263-f11b-4b6e-9aa7-7551710cf6fc tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fea615ea5074760833d02cf7e7b9fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8f33c33f1f43319c2e92431394bcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:09:53.399162 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c3098263-f11b-4b6e-9aa7-7551710cf6fc tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] 10.222.0.61 "GET /compute/v2.1/servers/5dcf5ed7-674e-4286-b880-ee1e6a69c801" status: 200 len: 1362 microversion: 2.1 time: 0.167001 Aug 31 17:09:53.399770 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3828/7672] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:09:53 2022] GET /compute/v2.1/servers/5dcf5ed7-674e-4286-b880-ee1e6a69c801 => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 17:09:54.420204 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:09:54.421015 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=6 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:09:54.425988 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7b127ad6-ea6c-4e1d-be3a-d784e8ef6491 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:09:54.426743 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7b127ad6-ea6c-4e1d-be3a-d784e8ef6491 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] [instance: 5dcf5ed7-674e-4286-b880-ee1e6a69c801] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:09:54.434167 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7b127ad6-ea6c-4e1d-be3a-d784e8ef6491 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:09:54.434665 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7b127ad6-ea6c-4e1d-be3a-d784e8ef6491 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:09:54.435116 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7b127ad6-ea6c-4e1d-be3a-d784e8ef6491 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:09:54.435843 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7b127ad6-ea6c-4e1d-be3a-d784e8ef6491 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:09:54.436312 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7b127ad6-ea6c-4e1d-be3a-d784e8ef6491 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:09:54.436750 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7b127ad6-ea6c-4e1d-be3a-d784e8ef6491 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:09:54.620871 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7b127ad6-ea6c-4e1d-be3a-d784e8ef6491 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fea615ea5074760833d02cf7e7b9fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8f33c33f1f43319c2e92431394bcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:09:54.630232 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7b127ad6-ea6c-4e1d-be3a-d784e8ef6491 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] 10.222.0.61 "GET /compute/v2.1/servers/5dcf5ed7-674e-4286-b880-ee1e6a69c801" status: 200 len: 1553 microversion: 2.1 time: 0.211900 Aug 31 17:09:54.630953 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3845/7673] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:09:54 2022] GET /compute/v2.1/servers/5dcf5ed7-674e-4286-b880-ee1e6a69c801 => generated 1553 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:09:54.650531 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-fc3c7e94-a5b7-4ded-ab49-d2d75e456f12 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:09:54.651176 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-fc3c7e94-a5b7-4ded-ab49-d2d75e456f12 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] [instance: 5dcf5ed7-674e-4286-b880-ee1e6a69c801] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:09:54.653036 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=6 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:09:54.659321 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fc3c7e94-a5b7-4ded-ab49-d2d75e456f12 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:09:54.659841 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fc3c7e94-a5b7-4ded-ab49-d2d75e456f12 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:09:54.660282 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fc3c7e94-a5b7-4ded-ab49-d2d75e456f12 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:09:54.660972 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fc3c7e94-a5b7-4ded-ab49-d2d75e456f12 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:09:54.661426 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fc3c7e94-a5b7-4ded-ab49-d2d75e456f12 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:09:54.661853 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fc3c7e94-a5b7-4ded-ab49-d2d75e456f12 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:09:54.801003 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-fc3c7e94-a5b7-4ded-ab49-d2d75e456f12 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fea615ea5074760833d02cf7e7b9fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8f33c33f1f43319c2e92431394bcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:09:54.809412 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-fc3c7e94-a5b7-4ded-ab49-d2d75e456f12 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] 10.222.0.61 "GET /compute/v2.1/servers/5dcf5ed7-674e-4286-b880-ee1e6a69c801" status: 200 len: 1553 microversion: 2.1 time: 0.162705 Aug 31 17:09:54.809923 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3829/7674] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:09:54 2022] GET /compute/v2.1/servers/5dcf5ed7-674e-4286-b880-ee1e6a69c801 => generated 1553 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:09:56.445623 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c31ad03d-3f71-4059-bc54-05db4b4fcc7b tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "be761a3e-0e5c-4225-a2a8-37570db5dc50"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:09:56.448080 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c31ad03d-3f71-4059-bc54-05db4b4fcc7b tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] [instance: 5dcf5ed7-674e-4286-b880-ee1e6a69c801] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:09:56.455141 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c31ad03d-3f71-4059-bc54-05db4b4fcc7b tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:09:56.455695 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c31ad03d-3f71-4059-bc54-05db4b4fcc7b tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:09:56.456156 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c31ad03d-3f71-4059-bc54-05db4b4fcc7b tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:09:56.456872 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c31ad03d-3f71-4059-bc54-05db4b4fcc7b tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:09:56.457351 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c31ad03d-3f71-4059-bc54-05db4b4fcc7b tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:09:56.457794 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c31ad03d-3f71-4059-bc54-05db4b4fcc7b tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:09:56.724606 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c31ad03d-3f71-4059-bc54-05db4b4fcc7b tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] 10.222.0.61 "POST /compute/v2.1/servers/5dcf5ed7-674e-4286-b880-ee1e6a69c801/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.282891 Aug 31 17:09:56.725265 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3846/7675] 10.222.0.61 () {60 vars in 1323 bytes} [Wed Aug 31 17:09:56 2022] POST /compute/v2.1/servers/5dcf5ed7-674e-4286-b880-ee1e6a69c801/os-volume_attachments => generated 194 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:10:07.436641 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-49996cb7-3aa7-4c52-a941-c4e132b84b1d tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:10:07.437207 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-49996cb7-3aa7-4c52-a941-c4e132b84b1d tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] [instance: 5dcf5ed7-674e-4286-b880-ee1e6a69c801] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:10:07.441251 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:10:07.442030 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=36 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:10:07.448425 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-49996cb7-3aa7-4c52-a941-c4e132b84b1d tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:07.448867 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-49996cb7-3aa7-4c52-a941-c4e132b84b1d tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:07.449318 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-49996cb7-3aa7-4c52-a941-c4e132b84b1d tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:07.450037 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-49996cb7-3aa7-4c52-a941-c4e132b84b1d tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:07.450503 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-49996cb7-3aa7-4c52-a941-c4e132b84b1d tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:07.450938 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-49996cb7-3aa7-4c52-a941-c4e132b84b1d tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:07.537881 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-49996cb7-3aa7-4c52-a941-c4e132b84b1d tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lazy-loading 'services' on Instance uuid 5dcf5ed7-674e-4286-b880-ee1e6a69c801 {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 17:10:07.611587 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-49996cb7-3aa7-4c52-a941-c4e132b84b1d tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] 10.222.0.61 "DELETE /compute/v2.1/servers/5dcf5ed7-674e-4286-b880-ee1e6a69c801/os-volume_attachments/be761a3e-0e5c-4225-a2a8-37570db5dc50" status: 202 len: 0 microversion: 2.1 time: 0.178743 Aug 31 17:10:07.612207 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3830/7676] 10.222.0.61 () {58 vars in 1416 bytes} [Wed Aug 31 17:10:07 2022] DELETE /compute/v2.1/servers/5dcf5ed7-674e-4286-b880-ee1e6a69c801/os-volume_attachments/be761a3e-0e5c-4225-a2a8-37570db5dc50 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 17:10:07.618861 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:10:07.619825 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:10:07.624119 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7d9ec7b3-0483-47f9-bcb6-38e32220d2fb tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:10:07.626520 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7d9ec7b3-0483-47f9-bcb6-38e32220d2fb tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] [instance: 5dcf5ed7-674e-4286-b880-ee1e6a69c801] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:10:07.634697 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7d9ec7b3-0483-47f9-bcb6-38e32220d2fb tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:07.635590 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7d9ec7b3-0483-47f9-bcb6-38e32220d2fb tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:07.635724 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7d9ec7b3-0483-47f9-bcb6-38e32220d2fb tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:07.636423 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7d9ec7b3-0483-47f9-bcb6-38e32220d2fb tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:07.637088 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7d9ec7b3-0483-47f9-bcb6-38e32220d2fb tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:07.637355 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7d9ec7b3-0483-47f9-bcb6-38e32220d2fb tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:07.670459 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7d9ec7b3-0483-47f9-bcb6-38e32220d2fb tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] 10.222.0.61 "GET /compute/v2.1/servers/5dcf5ed7-674e-4286-b880-ee1e6a69c801/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053622 Aug 31 17:10:07.671038 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3847/7677] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 17:10:07 2022] GET /compute/v2.1/servers/5dcf5ed7-674e-4286-b880-ee1e6a69c801/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:10:08.684291 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0a447257-1243-459e-8d72-c5eddb600feb tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:10:08.686657 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0a447257-1243-459e-8d72-c5eddb600feb tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] [instance: 5dcf5ed7-674e-4286-b880-ee1e6a69c801] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:10:08.695524 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0a447257-1243-459e-8d72-c5eddb600feb tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:08.696024 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0a447257-1243-459e-8d72-c5eddb600feb tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:08.696476 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0a447257-1243-459e-8d72-c5eddb600feb tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:08.697193 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0a447257-1243-459e-8d72-c5eddb600feb tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:08.697654 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0a447257-1243-459e-8d72-c5eddb600feb tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:08.698091 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0a447257-1243-459e-8d72-c5eddb600feb tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:08.733122 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0a447257-1243-459e-8d72-c5eddb600feb tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] 10.222.0.61 "GET /compute/v2.1/servers/5dcf5ed7-674e-4286-b880-ee1e6a69c801/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053271 Aug 31 17:10:08.733709 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3831/7678] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 17:10:08 2022] GET /compute/v2.1/servers/5dcf5ed7-674e-4286-b880-ee1e6a69c801/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:10:09.746600 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3cabf204-1fc8-442e-be4d-ac9fe652281e tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:10:09.748836 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3cabf204-1fc8-442e-be4d-ac9fe652281e tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] [instance: 5dcf5ed7-674e-4286-b880-ee1e6a69c801] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:10:09.756444 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3cabf204-1fc8-442e-be4d-ac9fe652281e tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:09.756945 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3cabf204-1fc8-442e-be4d-ac9fe652281e tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:09.757400 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3cabf204-1fc8-442e-be4d-ac9fe652281e tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:09.758127 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3cabf204-1fc8-442e-be4d-ac9fe652281e tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:09.758604 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3cabf204-1fc8-442e-be4d-ac9fe652281e tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:09.759051 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3cabf204-1fc8-442e-be4d-ac9fe652281e tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:09.792151 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3cabf204-1fc8-442e-be4d-ac9fe652281e tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] 10.222.0.61 "GET /compute/v2.1/servers/5dcf5ed7-674e-4286-b880-ee1e6a69c801/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049448 Aug 31 17:10:09.793682 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3848/7679] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 17:10:09 2022] GET /compute/v2.1/servers/5dcf5ed7-674e-4286-b880-ee1e6a69c801/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:10:10.804694 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d57b33a0-348e-4fc0-98a3-52c8c1fe5755 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:10:10.806989 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d57b33a0-348e-4fc0-98a3-52c8c1fe5755 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] [instance: 5dcf5ed7-674e-4286-b880-ee1e6a69c801] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:10:10.814188 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d57b33a0-348e-4fc0-98a3-52c8c1fe5755 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:10.814689 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d57b33a0-348e-4fc0-98a3-52c8c1fe5755 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:10.815140 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d57b33a0-348e-4fc0-98a3-52c8c1fe5755 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:10.815893 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d57b33a0-348e-4fc0-98a3-52c8c1fe5755 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:10.816361 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d57b33a0-348e-4fc0-98a3-52c8c1fe5755 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:10.816796 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d57b33a0-348e-4fc0-98a3-52c8c1fe5755 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:10.848923 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d57b33a0-348e-4fc0-98a3-52c8c1fe5755 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] 10.222.0.61 "GET /compute/v2.1/servers/5dcf5ed7-674e-4286-b880-ee1e6a69c801/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048148 Aug 31 17:10:10.849429 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3832/7680] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 17:10:10 2022] GET /compute/v2.1/servers/5dcf5ed7-674e-4286-b880-ee1e6a69c801/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 17:10:11.861896 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d2138049-93f1-4669-9ec8-4b70b7b57d51 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:10:11.864172 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d2138049-93f1-4669-9ec8-4b70b7b57d51 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] [instance: 5dcf5ed7-674e-4286-b880-ee1e6a69c801] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:10:11.871305 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d2138049-93f1-4669-9ec8-4b70b7b57d51 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:11.871853 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d2138049-93f1-4669-9ec8-4b70b7b57d51 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:11.872319 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d2138049-93f1-4669-9ec8-4b70b7b57d51 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:11.873045 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d2138049-93f1-4669-9ec8-4b70b7b57d51 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:11.873524 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d2138049-93f1-4669-9ec8-4b70b7b57d51 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:11.873970 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d2138049-93f1-4669-9ec8-4b70b7b57d51 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:11.906108 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d2138049-93f1-4669-9ec8-4b70b7b57d51 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] 10.222.0.61 "GET /compute/v2.1/servers/5dcf5ed7-674e-4286-b880-ee1e6a69c801/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048954 Aug 31 17:10:11.907294 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3849/7681] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 17:10:11 2022] GET /compute/v2.1/servers/5dcf5ed7-674e-4286-b880-ee1e6a69c801/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:10:12.919320 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ad919938-b9dd-4204-b02b-29f1467f1655 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:10:12.921521 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ad919938-b9dd-4204-b02b-29f1467f1655 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] [instance: 5dcf5ed7-674e-4286-b880-ee1e6a69c801] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:10:12.928793 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ad919938-b9dd-4204-b02b-29f1467f1655 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:12.929292 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ad919938-b9dd-4204-b02b-29f1467f1655 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:12.929738 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ad919938-b9dd-4204-b02b-29f1467f1655 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:12.930444 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ad919938-b9dd-4204-b02b-29f1467f1655 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:12.930910 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ad919938-b9dd-4204-b02b-29f1467f1655 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:12.931375 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ad919938-b9dd-4204-b02b-29f1467f1655 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:12.965637 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ad919938-b9dd-4204-b02b-29f1467f1655 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] 10.222.0.61 "GET /compute/v2.1/servers/5dcf5ed7-674e-4286-b880-ee1e6a69c801/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050393 Aug 31 17:10:12.966217 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3833/7682] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 17:10:12 2022] GET /compute/v2.1/servers/5dcf5ed7-674e-4286-b880-ee1e6a69c801/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 17:10:12.977377 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-838fd22c-5b03-48e0-8e99-d3ce6e9d3d1c tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:10:12.977907 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-838fd22c-5b03-48e0-8e99-d3ce6e9d3d1c tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] [instance: 5dcf5ed7-674e-4286-b880-ee1e6a69c801] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:10:12.984938 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-838fd22c-5b03-48e0-8e99-d3ce6e9d3d1c tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:12.985443 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-838fd22c-5b03-48e0-8e99-d3ce6e9d3d1c tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:12.985904 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-838fd22c-5b03-48e0-8e99-d3ce6e9d3d1c tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:12.986616 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-838fd22c-5b03-48e0-8e99-d3ce6e9d3d1c tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:12.987099 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-838fd22c-5b03-48e0-8e99-d3ce6e9d3d1c tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:12.987568 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-838fd22c-5b03-48e0-8e99-d3ce6e9d3d1c tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:13.069212 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-838fd22c-5b03-48e0-8e99-d3ce6e9d3d1c tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] HTTP exception thrown: Instance 5dcf5ed7-674e-4286-b880-ee1e6a69c801 is not attached to volume be761a3e-0e5c-4225-a2a8-37570db5dc50 Aug 31 17:10:13.076003 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-838fd22c-5b03-48e0-8e99-d3ce6e9d3d1c tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Request method failure captured: Aug 31 17:10:13.076003 n-d-850499-9 devstack@n-api.service[122257]: request: DELETE /compute/v2.1/servers/5dcf5ed7-674e-4286-b880-ee1e6a69c801/os-volume_attachments/be761a3e-0e5c-4225-a2a8-37570db5dc50 HTTP/1.1 Aug 31 17:10:13.076003 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 17:10:13.076003 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 17:10:13.076003 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 17:10:13.076003 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 17:10:13.076003 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 17:10:13.076003 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 17:10:13.076003 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 17:10:13.076003 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 17:10:13.076003 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD5XRkdZ__uT4Z9QcRA2ruMK4v78lmsJYIj7UIC254LgiJAezvVopDuetEwbUVXmx0M_IqOldthIYIwPRcNmNz9iqFIiI5pMYxdU-aX5gitLtW4a4zzYflv9ko-bqp9QqhD_5_7O6o69C5yaFtbo4npzEN3wDxeP3Mn8TVuhk7Hg1HXY Aug 31 17:10:13.076003 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 17:10:13.076003 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 17:10:13.076003 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 17:10:13.076003 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 17:10:13.076003 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 17:10:13.076003 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 17:10:13.076003 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: dc8f33c33f1f43319c2e92431394bcd5 Aug 31 17:10:13.076003 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-TestEncryptedCinderVolumes-828494074 Aug 31 17:10:13.076003 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 17:10:13.076003 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 17:10:13.076003 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/dc8f33c33f1f43319c2e92431394bcd5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/dc8f33c33f1f43319c2e92431394bcd5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_dc8f33c33f1f43319c2e92431394bcd5", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/dc8f33c33f1f43319c2e92431394bcd5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 17:10:13.076003 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-TestEncryptedCinderVolumes-828494074 Aug 31 17:10:13.076003 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: dc8f33c33f1f43319c2e92431394bcd5 Aug 31 17:10:13.076003 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-828494074 Aug 31 17:10:13.076003 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-TestEncryptedCinderVolumes-828494074-project Aug 31 17:10:13.076003 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 17:10:13.076003 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 17:10:13.076003 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 4fea615ea5074760833d02cf7e7b9fd5 Aug 31 17:10:13.076003 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-TestEncryptedCinderVolumes-828494074-project Aug 31 17:10:13.076003 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 17:10:13.076003 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance 5dcf5ed7-674e-4286-b880-ee1e6a69c801 is not attached to volume be761a3e-0e5c-4225-a2a8-37570db5dc50 Aug 31 17:10:13.076003 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'server_id': '5dcf5ed7-674e-4286-b880-ee1e6a69c801', 'id': 'be761a3e-0e5c-4225-a2a8-37570db5dc50'} Aug 31 17:10:13.076003 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 17:10:13.076003 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:10:13.076003 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 31 17:10:13.076003 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 31 17:10:13.076003 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 17:10:13.076003 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 17:10:13.076003 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 31 17:10:13.076003 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 31 17:10:13.076003 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id be761a3e-0e5c-4225-a2a8-37570db5dc50. Aug 31 17:10:13.076003 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 17:10:13.076003 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:10:13.076003 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 17:10:13.076003 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:10:13.076003 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:10:13.076003 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:10:13.076003 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 17:10:13.076003 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 17:10:13.076003 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 17:10:13.076003 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 17:10:13.076003 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 31 17:10:13.076003 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 31 17:10:13.076003 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5dcf5ed7-674e-4286-b880-ee1e6a69c801 is not attached to volume be761a3e-0e5c-4225-a2a8-37570db5dc50 Aug 31 17:10:13.076003 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 17:10:13.076003 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:10:13.076003 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 17:10:13.076003 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:10:13.076003 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:10:13.076003 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:10:13.081308 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 17:10:13.081308 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 17:10:13.081308 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5dcf5ed7-674e-4286-b880-ee1e6a69c801 is not attached to volume be761a3e-0e5c-4225-a2a8-37570db5dc50 Aug 31 17:10:13.081308 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 17:10:13.081308 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-838fd22c-5b03-48e0-8e99-d3ce6e9d3d1c tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Returning 404 to user: Instance 5dcf5ed7-674e-4286-b880-ee1e6a69c801 is not attached to volume be761a3e-0e5c-4225-a2a8-37570db5dc50 {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 17:10:13.081308 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-838fd22c-5b03-48e0-8e99-d3ce6e9d3d1c tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] 10.222.0.61 "DELETE /compute/v2.1/servers/5dcf5ed7-674e-4286-b880-ee1e6a69c801/os-volume_attachments/be761a3e-0e5c-4225-a2a8-37570db5dc50" status: 404 len: 154 microversion: 2.1 time: 0.104243 Aug 31 17:10:13.081308 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3850/7683] 10.222.0.61 () {58 vars in 1416 bytes} [Wed Aug 31 17:10:12 2022] DELETE /compute/v2.1/servers/5dcf5ed7-674e-4286-b880-ee1e6a69c801/os-volume_attachments/be761a3e-0e5c-4225-a2a8-37570db5dc50 => generated 154 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 17:10:16.427558 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2b87f712-6c97-4a0b-93d6-14471bb6d846 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:10:16.428093 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2b87f712-6c97-4a0b-93d6-14471bb6d846 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] [instance: 5dcf5ed7-674e-4286-b880-ee1e6a69c801] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:10:16.434801 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2b87f712-6c97-4a0b-93d6-14471bb6d846 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:16.435297 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2b87f712-6c97-4a0b-93d6-14471bb6d846 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:16.435779 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2b87f712-6c97-4a0b-93d6-14471bb6d846 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:16.436499 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2b87f712-6c97-4a0b-93d6-14471bb6d846 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:16.436965 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2b87f712-6c97-4a0b-93d6-14471bb6d846 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:16.438576 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2b87f712-6c97-4a0b-93d6-14471bb6d846 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:16.473164 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2b87f712-6c97-4a0b-93d6-14471bb6d846 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] [instance: 5dcf5ed7-674e-4286-b880-ee1e6a69c801] Going to try to terminate instance {{(pid=122256) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 17:10:16.563220 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2b87f712-6c97-4a0b-93d6-14471bb6d846 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] 10.222.0.61 "DELETE /compute/v2.1/servers/5dcf5ed7-674e-4286-b880-ee1e6a69c801" status: 204 len: 0 microversion: 2.1 time: 0.140959 Aug 31 17:10:16.564196 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3834/7684] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 17:10:16 2022] DELETE /compute/v2.1/servers/5dcf5ed7-674e-4286-b880-ee1e6a69c801 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 17:10:16.572385 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a8d6f833-7461-498e-8804-94ea4d38abe3 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:10:16.573051 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a8d6f833-7461-498e-8804-94ea4d38abe3 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] [instance: 5dcf5ed7-674e-4286-b880-ee1e6a69c801] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:10:16.581997 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a8d6f833-7461-498e-8804-94ea4d38abe3 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:16.582496 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a8d6f833-7461-498e-8804-94ea4d38abe3 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:16.582953 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a8d6f833-7461-498e-8804-94ea4d38abe3 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:16.583716 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a8d6f833-7461-498e-8804-94ea4d38abe3 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:16.584192 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a8d6f833-7461-498e-8804-94ea4d38abe3 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:16.584647 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a8d6f833-7461-498e-8804-94ea4d38abe3 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:16.726221 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a8d6f833-7461-498e-8804-94ea4d38abe3 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fea615ea5074760833d02cf7e7b9fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8f33c33f1f43319c2e92431394bcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:10:16.734824 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a8d6f833-7461-498e-8804-94ea4d38abe3 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] 10.222.0.61 "GET /compute/v2.1/servers/5dcf5ed7-674e-4286-b880-ee1e6a69c801" status: 200 len: 1559 microversion: 2.1 time: 0.165679 Aug 31 17:10:16.735414 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3851/7685] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:10:16 2022] GET /compute/v2.1/servers/5dcf5ed7-674e-4286-b880-ee1e6a69c801 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:10:17.756939 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-142294b1-c8eb-4637-b3e8-59f70956fc44 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:10:17.757581 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-142294b1-c8eb-4637-b3e8-59f70956fc44 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] [instance: 5dcf5ed7-674e-4286-b880-ee1e6a69c801] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:10:17.764626 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-142294b1-c8eb-4637-b3e8-59f70956fc44 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:17.765116 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-142294b1-c8eb-4637-b3e8-59f70956fc44 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:17.766053 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-142294b1-c8eb-4637-b3e8-59f70956fc44 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:17.766741 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-142294b1-c8eb-4637-b3e8-59f70956fc44 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:17.767195 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-142294b1-c8eb-4637-b3e8-59f70956fc44 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:17.767644 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-142294b1-c8eb-4637-b3e8-59f70956fc44 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:17.903074 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-142294b1-c8eb-4637-b3e8-59f70956fc44 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fea615ea5074760833d02cf7e7b9fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8f33c33f1f43319c2e92431394bcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:10:17.911738 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-142294b1-c8eb-4637-b3e8-59f70956fc44 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] 10.222.0.61 "GET /compute/v2.1/servers/5dcf5ed7-674e-4286-b880-ee1e6a69c801" status: 200 len: 1559 microversion: 2.1 time: 0.159340 Aug 31 17:10:17.912313 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3835/7686] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:10:17 2022] GET /compute/v2.1/servers/5dcf5ed7-674e-4286-b880-ee1e6a69c801 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:10:18.769307 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-d44b6b91-e73a-425a-ae5f-cb7a30f05aea req-f3ac8fc3-8627-4ab2-aff0-c87025e50837 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dcf5ed7-674e-4286-b880-ee1e6a69c801", "name": "network-vif-deleted", "tag": "42fd563e-aae1-47e6-9a7b-192d28d35347"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:10:18.780274 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-d44b6b91-e73a-425a-ae5f-cb7a30f05aea req-f3ac8fc3-8627-4ab2-aff0-c87025e50837 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:18.781678 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-d44b6b91-e73a-425a-ae5f-cb7a30f05aea req-f3ac8fc3-8627-4ab2-aff0-c87025e50837 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:18.782728 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-d44b6b91-e73a-425a-ae5f-cb7a30f05aea req-f3ac8fc3-8627-4ab2-aff0-c87025e50837 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:18.795048 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-d44b6b91-e73a-425a-ae5f-cb7a30f05aea req-f3ac8fc3-8627-4ab2-aff0-c87025e50837 service nova] Creating event network-vif-deleted:42fd563e-aae1-47e6-9a7b-192d28d35347 for instance 5dcf5ed7-674e-4286-b880-ee1e6a69c801 on n-h1-850499-9 Aug 31 17:10:18.801040 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-d44b6b91-e73a-425a-ae5f-cb7a30f05aea req-f3ac8fc3-8627-4ab2-aff0-c87025e50837 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035563 Aug 31 17:10:18.801879 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3852/7687] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:10:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:10:18.933429 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b2cb3bdb-1543-46e7-b92f-ad09f54107d5 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:10:18.934159 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b2cb3bdb-1543-46e7-b92f-ad09f54107d5 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] [instance: 5dcf5ed7-674e-4286-b880-ee1e6a69c801] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:10:18.942844 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b2cb3bdb-1543-46e7-b92f-ad09f54107d5 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:18.943597 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b2cb3bdb-1543-46e7-b92f-ad09f54107d5 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:18.944050 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b2cb3bdb-1543-46e7-b92f-ad09f54107d5 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:18.944954 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b2cb3bdb-1543-46e7-b92f-ad09f54107d5 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:18.945425 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b2cb3bdb-1543-46e7-b92f-ad09f54107d5 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:18.945864 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b2cb3bdb-1543-46e7-b92f-ad09f54107d5 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:18.979773 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b2cb3bdb-1543-46e7-b92f-ad09f54107d5 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:18.980276 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b2cb3bdb-1543-46e7-b92f-ad09f54107d5 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:18.980719 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b2cb3bdb-1543-46e7-b92f-ad09f54107d5 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:18.981180 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-b2cb3bdb-1543-46e7-b92f-ad09f54107d5 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lazy-loading 'fault' on Instance uuid 5dcf5ed7-674e-4286-b880-ee1e6a69c801 {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 17:10:19.027402 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b2cb3bdb-1543-46e7-b92f-ad09f54107d5 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fea615ea5074760833d02cf7e7b9fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8f33c33f1f43319c2e92431394bcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:10:19.035861 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b2cb3bdb-1543-46e7-b92f-ad09f54107d5 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] 10.222.0.61 "GET /compute/v2.1/servers/5dcf5ed7-674e-4286-b880-ee1e6a69c801" status: 200 len: 1352 microversion: 2.1 time: 0.106446 Aug 31 17:10:19.036482 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3836/7688] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:10:18 2022] GET /compute/v2.1/servers/5dcf5ed7-674e-4286-b880-ee1e6a69c801 => generated 1352 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:10:20.059059 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7ea6e5ff-85c7-4384-9cf0-ce6171c933d3 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:10:20.059865 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7ea6e5ff-85c7-4384-9cf0-ce6171c933d3 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] [instance: 5dcf5ed7-674e-4286-b880-ee1e6a69c801] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:10:20.066158 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7ea6e5ff-85c7-4384-9cf0-ce6171c933d3 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:20.066670 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7ea6e5ff-85c7-4384-9cf0-ce6171c933d3 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:20.067125 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7ea6e5ff-85c7-4384-9cf0-ce6171c933d3 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:20.067867 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7ea6e5ff-85c7-4384-9cf0-ce6171c933d3 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:20.068343 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7ea6e5ff-85c7-4384-9cf0-ce6171c933d3 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:20.068789 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7ea6e5ff-85c7-4384-9cf0-ce6171c933d3 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:20.082653 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-7ea6e5ff-85c7-4384-9cf0-ce6171c933d3 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] HTTP exception thrown: Instance 5dcf5ed7-674e-4286-b880-ee1e6a69c801 could not be found. Aug 31 17:10:20.084371 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7ea6e5ff-85c7-4384-9cf0-ce6171c933d3 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Request method failure captured: Aug 31 17:10:20.084371 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/5dcf5ed7-674e-4286-b880-ee1e6a69c801 HTTP/1.1 Aug 31 17:10:20.084371 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 17:10:20.084371 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 17:10:20.084371 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 17:10:20.084371 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 17:10:20.084371 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 17:10:20.084371 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 17:10:20.084371 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 17:10:20.084371 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 17:10:20.084371 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD5XRkdZ__uT4Z9QcRA2ruMK4v78lmsJYIj7UIC254LgiJAezvVopDuetEwbUVXmx0M_IqOldthIYIwPRcNmNz9iqFIiI5pMYxdU-aX5gitLtW4a4zzYflv9ko-bqp9QqhD_5_7O6o69C5yaFtbo4npzEN3wDxeP3Mn8TVuhk7Hg1HXY Aug 31 17:10:20.084371 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 17:10:20.084371 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 17:10:20.084371 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 17:10:20.084371 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 17:10:20.084371 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 17:10:20.084371 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 17:10:20.084371 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: dc8f33c33f1f43319c2e92431394bcd5 Aug 31 17:10:20.084371 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-TestEncryptedCinderVolumes-828494074 Aug 31 17:10:20.084371 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 17:10:20.084371 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 17:10:20.084371 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/dc8f33c33f1f43319c2e92431394bcd5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/dc8f33c33f1f43319c2e92431394bcd5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_dc8f33c33f1f43319c2e92431394bcd5", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/dc8f33c33f1f43319c2e92431394bcd5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 17:10:20.084371 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-TestEncryptedCinderVolumes-828494074 Aug 31 17:10:20.084371 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: dc8f33c33f1f43319c2e92431394bcd5 Aug 31 17:10:20.084371 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-828494074 Aug 31 17:10:20.084371 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-TestEncryptedCinderVolumes-828494074-project Aug 31 17:10:20.084371 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 17:10:20.084371 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 17:10:20.084371 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 4fea615ea5074760833d02cf7e7b9fd5 Aug 31 17:10:20.084371 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-TestEncryptedCinderVolumes-828494074-project Aug 31 17:10:20.084371 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 17:10:20.084371 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance 5dcf5ed7-674e-4286-b880-ee1e6a69c801 could not be found. Aug 31 17:10:20.084371 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '5dcf5ed7-674e-4286-b880-ee1e6a69c801'} Aug 31 17:10:20.084371 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 17:10:20.084371 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:10:20.084371 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 17:10:20.084371 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 17:10:20.084371 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 17:10:20.084371 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 17:10:20.084371 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 17:10:20.084371 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 17:10:20.084371 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 17:10:20.084371 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 17:10:20.084371 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5dcf5ed7-674e-4286-b880-ee1e6a69c801 could not be found. Aug 31 17:10:20.084371 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 17:10:20.084371 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:10:20.084371 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 17:10:20.084371 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:10:20.084371 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:10:20.084371 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:10:20.084371 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 17:10:20.084371 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 17:10:20.084371 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 17:10:20.084371 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 17:10:20.084371 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 17:10:20.084371 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 17:10:20.084371 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 17:10:20.084371 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 17:10:20.084371 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 17:10:20.084371 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 17:10:20.084371 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5dcf5ed7-674e-4286-b880-ee1e6a69c801 could not be found. Aug 31 17:10:20.084371 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 17:10:20.084371 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:10:20.084371 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 17:10:20.090332 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:10:20.090332 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:10:20.090332 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:10:20.090332 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 17:10:20.090332 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 17:10:20.090332 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5dcf5ed7-674e-4286-b880-ee1e6a69c801 could not be found. Aug 31 17:10:20.090332 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 17:10:20.090332 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7ea6e5ff-85c7-4384-9cf0-ce6171c933d3 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Returning 404 to user: Instance 5dcf5ed7-674e-4286-b880-ee1e6a69c801 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 17:10:20.090332 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7ea6e5ff-85c7-4384-9cf0-ce6171c933d3 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] 10.222.0.61 "GET /compute/v2.1/servers/5dcf5ed7-674e-4286-b880-ee1e6a69c801" status: 404 len: 111 microversion: 2.1 time: 0.031917 Aug 31 17:10:20.090332 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3853/7689] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:10:20 2022] GET /compute/v2.1/servers/5dcf5ed7-674e-4286-b880-ee1e6a69c801 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 17:10:20.095658 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1fec2deb-d825-4b05-aee6-de7be3f33414 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Calling method '.version_select at 0x7f5ae3c85280>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:10:20.116050 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1fec2deb-d825-4b05-aee6-de7be3f33414 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-271966325" status: 202 len: 0 microversion: 2.1 time: 0.025226 Aug 31 17:10:20.116648 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3837/7690] 10.222.0.61 () {58 vars in 1275 bytes} [Wed Aug 31 17:10:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-271966325 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 17:10:20.135289 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-334d523d-6b78-4d57-9b05-8251feeb702a tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Action: 'create', calling method: .version_select at 0x7f5ae844f550>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1647460696", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLK+1lyJl4tVztdra7qmDZZWoUe5KigYIz4WrFxRnVeue/8HQv0NpUG8DY5NbVnmIlg11b7fhnTpmu8Cd82zvyOsOIBYTlOJKJ0mo5cc8yLA8Yf2/rpGbG4RVCfx0FRCbA=="}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:10:20.152057 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-334d523d-6b78-4d57-9b05-8251feeb702a tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Getting quotas for project dc8f33c33f1f43319c2e92431394bcd5. Resources: {'key_pairs'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 17:10:20.158175 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-334d523d-6b78-4d57-9b05-8251feeb702a tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Getting quotas for user 4fea615ea5074760833d02cf7e7b9fd5 and project dc8f33c33f1f43319c2e92431394bcd5. Resources: {'key_pairs'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 17:10:20.181558 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-334d523d-6b78-4d57-9b05-8251feeb702a tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.050155 Aug 31 17:10:20.182182 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3854/7691] 10.222.0.61 () {60 vars in 1159 bytes} [Wed Aug 31 17:10:20 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:10:20.233861 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-aed635fb-c172-419a-8eb9-738d3339f9a7 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-66456205", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1647460696", "networks": [{"uuid": "66777fc5-2971-41c8-ae03-426d8b705797"}]}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:10:20.293884 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-aed635fb-c172-419a-8eb9-738d3339f9a7 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] validate_networks() for [('66777fc5-2971-41c8-ae03-426d8b705797', None, None, None, None, None)] {{(pid=122256) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 17:10:20.682889 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-aed635fb-c172-419a-8eb9-738d3339f9a7 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 17:10:20.683457 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-aed635fb-c172-419a-8eb9-738d3339f9a7 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 17:10:20.684237 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-aed635fb-c172-419a-8eb9-738d3339f9a7 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 17:10:20.684728 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-aed635fb-c172-419a-8eb9-738d3339f9a7 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 17:10:20.685243 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-aed635fb-c172-419a-8eb9-738d3339f9a7 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 17:10:20.695241 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aed635fb-c172-419a-8eb9-738d3339f9a7 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:20.695766 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aed635fb-c172-419a-8eb9-738d3339f9a7 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:20.696218 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aed635fb-c172-419a-8eb9-738d3339f9a7 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:20.696990 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aed635fb-c172-419a-8eb9-738d3339f9a7 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:20.697457 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aed635fb-c172-419a-8eb9-738d3339f9a7 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:20.697892 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aed635fb-c172-419a-8eb9-738d3339f9a7 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:20.715863 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-aed635fb-c172-419a-8eb9-738d3339f9a7 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Getting quotas for project dc8f33c33f1f43319c2e92431394bcd5. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 17:10:20.722093 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-aed635fb-c172-419a-8eb9-738d3339f9a7 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Getting quotas for user 4fea615ea5074760833d02cf7e7b9fd5 and project dc8f33c33f1f43319c2e92431394bcd5. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 17:10:20.734707 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-aed635fb-c172-419a-8eb9-738d3339f9a7 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Going to run 1 instances... {{(pid=122256) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 17:10:20.737083 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-aed635fb-c172-419a-8eb9-738d3339f9a7 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] [instance: d424c44e-1b2f-4d77-bb81-f7e0c9660389] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 17:10:20.784138 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-aed635fb-c172-419a-8eb9-738d3339f9a7 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.554262 Aug 31 17:10:20.784797 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3838/7692] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 17:10:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 556 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 17:10:20.795706 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d4deb597-8630-422e-8d0c-43dbea2e154a tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:10:20.796743 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d4deb597-8630-422e-8d0c-43dbea2e154a tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] [instance: d424c44e-1b2f-4d77-bb81-f7e0c9660389] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:10:20.858757 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d4deb597-8630-422e-8d0c-43dbea2e154a tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fea615ea5074760833d02cf7e7b9fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8f33c33f1f43319c2e92431394bcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:10:20.868509 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d4deb597-8630-422e-8d0c-43dbea2e154a tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] 10.222.0.61 "GET /compute/v2.1/servers/d424c44e-1b2f-4d77-bb81-f7e0c9660389" status: 200 len: 1261 microversion: 2.1 time: 0.076894 Aug 31 17:10:20.869492 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3855/7693] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:10:20 2022] GET /compute/v2.1/servers/d424c44e-1b2f-4d77-bb81-f7e0c9660389 => generated 1261 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:10:21.892166 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-82cab0a2-16ba-4495-92e3-3d7e6b6f751f tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:10:21.894264 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-82cab0a2-16ba-4495-92e3-3d7e6b6f751f tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] [instance: d424c44e-1b2f-4d77-bb81-f7e0c9660389] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:10:21.904997 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-82cab0a2-16ba-4495-92e3-3d7e6b6f751f tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:21.904997 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-82cab0a2-16ba-4495-92e3-3d7e6b6f751f tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:21.904997 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-82cab0a2-16ba-4495-92e3-3d7e6b6f751f tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:21.904997 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-82cab0a2-16ba-4495-92e3-3d7e6b6f751f tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:21.904997 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-82cab0a2-16ba-4495-92e3-3d7e6b6f751f tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:21.904997 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-82cab0a2-16ba-4495-92e3-3d7e6b6f751f tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:21.996369 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-82cab0a2-16ba-4495-92e3-3d7e6b6f751f tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fea615ea5074760833d02cf7e7b9fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8f33c33f1f43319c2e92431394bcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:10:22.007887 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-82cab0a2-16ba-4495-92e3-3d7e6b6f751f tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] 10.222.0.61 "GET /compute/v2.1/servers/d424c44e-1b2f-4d77-bb81-f7e0c9660389" status: 200 len: 1321 microversion: 2.1 time: 0.121503 Aug 31 17:10:22.008747 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3839/7694] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:10:21 2022] GET /compute/v2.1/servers/d424c44e-1b2f-4d77-bb81-f7e0c9660389 => generated 1321 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:10:23.030338 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c0ec3122-baa8-4dbe-bab6-347a0df30a57 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:10:23.031049 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c0ec3122-baa8-4dbe-bab6-347a0df30a57 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] [instance: d424c44e-1b2f-4d77-bb81-f7e0c9660389] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:10:23.038307 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c0ec3122-baa8-4dbe-bab6-347a0df30a57 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:23.038818 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c0ec3122-baa8-4dbe-bab6-347a0df30a57 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:23.039277 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c0ec3122-baa8-4dbe-bab6-347a0df30a57 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:23.040122 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c0ec3122-baa8-4dbe-bab6-347a0df30a57 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:23.040601 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c0ec3122-baa8-4dbe-bab6-347a0df30a57 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:23.041045 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c0ec3122-baa8-4dbe-bab6-347a0df30a57 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:23.252564 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c0ec3122-baa8-4dbe-bab6-347a0df30a57 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fea615ea5074760833d02cf7e7b9fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8f33c33f1f43319c2e92431394bcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:10:23.260766 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c0ec3122-baa8-4dbe-bab6-347a0df30a57 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] 10.222.0.61 "GET /compute/v2.1/servers/d424c44e-1b2f-4d77-bb81-f7e0c9660389" status: 200 len: 1361 microversion: 2.1 time: 0.234422 Aug 31 17:10:23.261359 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3856/7695] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:10:23 2022] GET /compute/v2.1/servers/d424c44e-1b2f-4d77-bb81-f7e0c9660389 => generated 1361 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:10:23.426105 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-c657e60b-8a1c-4c82-beed-b9e2786a6e1c req-c179649e-d0b9-45a1-8a2e-1dcb7770b601 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d424c44e-1b2f-4d77-bb81-f7e0c9660389", "tag": "9b9b4f0d-4dc4-4456-9f2f-4edbc91cb3ec"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:10:23.437341 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-c657e60b-8a1c-4c82-beed-b9e2786a6e1c req-c179649e-d0b9-45a1-8a2e-1dcb7770b601 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:23.438195 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-c657e60b-8a1c-4c82-beed-b9e2786a6e1c req-c179649e-d0b9-45a1-8a2e-1dcb7770b601 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:23.438713 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-c657e60b-8a1c-4c82-beed-b9e2786a6e1c req-c179649e-d0b9-45a1-8a2e-1dcb7770b601 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:23.450371 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-c657e60b-8a1c-4c82-beed-b9e2786a6e1c req-c179649e-d0b9-45a1-8a2e-1dcb7770b601 service nova] Creating event network-changed:9b9b4f0d-4dc4-4456-9f2f-4edbc91cb3ec for instance d424c44e-1b2f-4d77-bb81-f7e0c9660389 on n-h2-850499-9 Aug 31 17:10:23.456280 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-c657e60b-8a1c-4c82-beed-b9e2786a6e1c req-c179649e-d0b9-45a1-8a2e-1dcb7770b601 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035330 Aug 31 17:10:23.457051 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3840/7696] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:10:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:10:24.282790 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-625cbeed-9b6f-4239-aebb-865d6bd478ef tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:10:24.283409 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-625cbeed-9b6f-4239-aebb-865d6bd478ef tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] [instance: d424c44e-1b2f-4d77-bb81-f7e0c9660389] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:10:24.290341 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-625cbeed-9b6f-4239-aebb-865d6bd478ef tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:24.290841 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-625cbeed-9b6f-4239-aebb-865d6bd478ef tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:24.291292 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-625cbeed-9b6f-4239-aebb-865d6bd478ef tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:24.292040 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-625cbeed-9b6f-4239-aebb-865d6bd478ef tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:24.292509 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-625cbeed-9b6f-4239-aebb-865d6bd478ef tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:24.292945 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-625cbeed-9b6f-4239-aebb-865d6bd478ef tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:24.434440 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-625cbeed-9b6f-4239-aebb-865d6bd478ef tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fea615ea5074760833d02cf7e7b9fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8f33c33f1f43319c2e92431394bcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:10:24.443077 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-625cbeed-9b6f-4239-aebb-865d6bd478ef tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] 10.222.0.61 "GET /compute/v2.1/servers/d424c44e-1b2f-4d77-bb81-f7e0c9660389" status: 200 len: 1361 microversion: 2.1 time: 0.164705 Aug 31 17:10:24.443675 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3857/7697] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:10:24 2022] GET /compute/v2.1/servers/d424c44e-1b2f-4d77-bb81-f7e0c9660389 => generated 1361 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:10:25.465249 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0fbdb1bf-7944-4ad8-bc0d-eb7d75cf1c92 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:10:25.465959 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0fbdb1bf-7944-4ad8-bc0d-eb7d75cf1c92 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] [instance: d424c44e-1b2f-4d77-bb81-f7e0c9660389] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:10:25.472925 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0fbdb1bf-7944-4ad8-bc0d-eb7d75cf1c92 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:25.473412 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0fbdb1bf-7944-4ad8-bc0d-eb7d75cf1c92 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:25.473854 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0fbdb1bf-7944-4ad8-bc0d-eb7d75cf1c92 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:25.474553 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0fbdb1bf-7944-4ad8-bc0d-eb7d75cf1c92 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:25.475014 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0fbdb1bf-7944-4ad8-bc0d-eb7d75cf1c92 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:25.475444 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0fbdb1bf-7944-4ad8-bc0d-eb7d75cf1c92 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:25.608805 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-0fbdb1bf-7944-4ad8-bc0d-eb7d75cf1c92 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fea615ea5074760833d02cf7e7b9fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8f33c33f1f43319c2e92431394bcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:10:25.616920 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0fbdb1bf-7944-4ad8-bc0d-eb7d75cf1c92 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] 10.222.0.61 "GET /compute/v2.1/servers/d424c44e-1b2f-4d77-bb81-f7e0c9660389" status: 200 len: 1361 microversion: 2.1 time: 0.156781 Aug 31 17:10:25.617496 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3841/7698] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:10:25 2022] GET /compute/v2.1/servers/d424c44e-1b2f-4d77-bb81-f7e0c9660389 => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:10:26.638163 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a7648def-72ca-4bb2-b730-a5ed42a9902f tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:10:26.638800 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a7648def-72ca-4bb2-b730-a5ed42a9902f tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] [instance: d424c44e-1b2f-4d77-bb81-f7e0c9660389] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:10:26.646142 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a7648def-72ca-4bb2-b730-a5ed42a9902f tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:26.646651 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a7648def-72ca-4bb2-b730-a5ed42a9902f tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:26.647103 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a7648def-72ca-4bb2-b730-a5ed42a9902f tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:26.647849 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a7648def-72ca-4bb2-b730-a5ed42a9902f tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:26.648324 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a7648def-72ca-4bb2-b730-a5ed42a9902f tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:26.648767 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a7648def-72ca-4bb2-b730-a5ed42a9902f tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:26.786947 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a7648def-72ca-4bb2-b730-a5ed42a9902f tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fea615ea5074760833d02cf7e7b9fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8f33c33f1f43319c2e92431394bcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:10:26.794751 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a7648def-72ca-4bb2-b730-a5ed42a9902f tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] 10.222.0.61 "GET /compute/v2.1/servers/d424c44e-1b2f-4d77-bb81-f7e0c9660389" status: 200 len: 1361 microversion: 2.1 time: 0.160475 Aug 31 17:10:26.795333 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3858/7699] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:10:26 2022] GET /compute/v2.1/servers/d424c44e-1b2f-4d77-bb81-f7e0c9660389 => generated 1361 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:10:27.816280 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-aa02d55d-4c35-4442-a660-419b17d476b8 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:10:27.816908 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-aa02d55d-4c35-4442-a660-419b17d476b8 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] [instance: d424c44e-1b2f-4d77-bb81-f7e0c9660389] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:10:27.823970 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aa02d55d-4c35-4442-a660-419b17d476b8 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:27.824468 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aa02d55d-4c35-4442-a660-419b17d476b8 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:27.824913 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aa02d55d-4c35-4442-a660-419b17d476b8 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:27.825621 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aa02d55d-4c35-4442-a660-419b17d476b8 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:27.826106 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aa02d55d-4c35-4442-a660-419b17d476b8 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:27.826546 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-aa02d55d-4c35-4442-a660-419b17d476b8 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:27.959334 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-aa02d55d-4c35-4442-a660-419b17d476b8 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fea615ea5074760833d02cf7e7b9fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8f33c33f1f43319c2e92431394bcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:10:27.967281 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-aa02d55d-4c35-4442-a660-419b17d476b8 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] 10.222.0.61 "GET /compute/v2.1/servers/d424c44e-1b2f-4d77-bb81-f7e0c9660389" status: 200 len: 1361 microversion: 2.1 time: 0.155334 Aug 31 17:10:27.967900 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3842/7700] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:10:27 2022] GET /compute/v2.1/servers/d424c44e-1b2f-4d77-bb81-f7e0c9660389 => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:10:28.907455 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-dfc14a88-a241-449b-b521-dbb6d2da6f68 req-8d0be4e7-3e66-4193-bc84-92d1e391c8ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d424c44e-1b2f-4d77-bb81-f7e0c9660389", "name": "network-vif-plugged", "status": "completed", "tag": "9b9b4f0d-4dc4-4456-9f2f-4edbc91cb3ec"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:10:28.916963 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-dfc14a88-a241-449b-b521-dbb6d2da6f68 req-8d0be4e7-3e66-4193-bc84-92d1e391c8ae service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:28.917460 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-dfc14a88-a241-449b-b521-dbb6d2da6f68 req-8d0be4e7-3e66-4193-bc84-92d1e391c8ae service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:28.917903 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-dfc14a88-a241-449b-b521-dbb6d2da6f68 req-8d0be4e7-3e66-4193-bc84-92d1e391c8ae service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:28.930154 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-dfc14a88-a241-449b-b521-dbb6d2da6f68 req-8d0be4e7-3e66-4193-bc84-92d1e391c8ae service nova] Creating event network-vif-plugged:9b9b4f0d-4dc4-4456-9f2f-4edbc91cb3ec for instance d424c44e-1b2f-4d77-bb81-f7e0c9660389 on n-h2-850499-9 Aug 31 17:10:28.937958 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-dfc14a88-a241-449b-b521-dbb6d2da6f68 req-8d0be4e7-3e66-4193-bc84-92d1e391c8ae service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100834 Aug 31 17:10:28.938596 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3859/7701] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:10:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:10:28.989204 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5dce1965-7184-4e6b-94f6-4b50ed67853e tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:10:28.989742 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5dce1965-7184-4e6b-94f6-4b50ed67853e tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] [instance: d424c44e-1b2f-4d77-bb81-f7e0c9660389] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:10:28.996707 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5dce1965-7184-4e6b-94f6-4b50ed67853e tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:28.997201 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5dce1965-7184-4e6b-94f6-4b50ed67853e tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:28.997647 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5dce1965-7184-4e6b-94f6-4b50ed67853e tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:28.998357 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5dce1965-7184-4e6b-94f6-4b50ed67853e tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:28.998818 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5dce1965-7184-4e6b-94f6-4b50ed67853e tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:28.999256 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5dce1965-7184-4e6b-94f6-4b50ed67853e tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:29.201201 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5dce1965-7184-4e6b-94f6-4b50ed67853e tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fea615ea5074760833d02cf7e7b9fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8f33c33f1f43319c2e92431394bcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:10:29.209392 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5dce1965-7184-4e6b-94f6-4b50ed67853e tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] 10.222.0.61 "GET /compute/v2.1/servers/d424c44e-1b2f-4d77-bb81-f7e0c9660389" status: 200 len: 1361 microversion: 2.1 time: 0.224757 Aug 31 17:10:29.209972 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3843/7702] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:10:28 2022] GET /compute/v2.1/servers/d424c44e-1b2f-4d77-bb81-f7e0c9660389 => generated 1361 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:10:30.231699 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8315fb00-f32a-49f4-96e4-4d756a0d0b9a tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:10:30.232474 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8315fb00-f32a-49f4-96e4-4d756a0d0b9a tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] [instance: d424c44e-1b2f-4d77-bb81-f7e0c9660389] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:10:30.240120 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8315fb00-f32a-49f4-96e4-4d756a0d0b9a tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:30.240632 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8315fb00-f32a-49f4-96e4-4d756a0d0b9a tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:30.241092 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8315fb00-f32a-49f4-96e4-4d756a0d0b9a tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:30.241818 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8315fb00-f32a-49f4-96e4-4d756a0d0b9a tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:30.242296 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8315fb00-f32a-49f4-96e4-4d756a0d0b9a tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:30.242748 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8315fb00-f32a-49f4-96e4-4d756a0d0b9a tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:30.383518 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8315fb00-f32a-49f4-96e4-4d756a0d0b9a tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fea615ea5074760833d02cf7e7b9fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8f33c33f1f43319c2e92431394bcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:10:30.391400 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8315fb00-f32a-49f4-96e4-4d756a0d0b9a tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] 10.222.0.61 "GET /compute/v2.1/servers/d424c44e-1b2f-4d77-bb81-f7e0c9660389" status: 200 len: 1361 microversion: 2.1 time: 0.164901 Aug 31 17:10:30.392052 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3860/7703] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:10:30 2022] GET /compute/v2.1/servers/d424c44e-1b2f-4d77-bb81-f7e0c9660389 => generated 1361 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:10:31.409919 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:10:31.410703 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=6 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:10:31.414957 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f8f662d3-a1ac-46bb-83c7-959d7765d7e2 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:10:31.415601 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f8f662d3-a1ac-46bb-83c7-959d7765d7e2 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] [instance: d424c44e-1b2f-4d77-bb81-f7e0c9660389] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:10:31.422410 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f8f662d3-a1ac-46bb-83c7-959d7765d7e2 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:31.422900 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f8f662d3-a1ac-46bb-83c7-959d7765d7e2 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:31.423338 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f8f662d3-a1ac-46bb-83c7-959d7765d7e2 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:31.424162 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f8f662d3-a1ac-46bb-83c7-959d7765d7e2 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:31.424629 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f8f662d3-a1ac-46bb-83c7-959d7765d7e2 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:31.425103 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f8f662d3-a1ac-46bb-83c7-959d7765d7e2 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:31.554884 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f8f662d3-a1ac-46bb-83c7-959d7765d7e2 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fea615ea5074760833d02cf7e7b9fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8f33c33f1f43319c2e92431394bcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:10:31.562561 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f8f662d3-a1ac-46bb-83c7-959d7765d7e2 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] 10.222.0.61 "GET /compute/v2.1/servers/d424c44e-1b2f-4d77-bb81-f7e0c9660389" status: 200 len: 1552 microversion: 2.1 time: 0.154966 Aug 31 17:10:31.563131 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3844/7704] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:10:31 2022] GET /compute/v2.1/servers/d424c44e-1b2f-4d77-bb81-f7e0c9660389 => generated 1552 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:10:31.584528 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-14aadc5d-3390-4958-99e2-95dc28c4d668 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:10:31.585192 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-14aadc5d-3390-4958-99e2-95dc28c4d668 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] [instance: d424c44e-1b2f-4d77-bb81-f7e0c9660389] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:10:31.587174 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=6 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:10:31.594431 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-14aadc5d-3390-4958-99e2-95dc28c4d668 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:31.594943 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-14aadc5d-3390-4958-99e2-95dc28c4d668 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:31.596696 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-14aadc5d-3390-4958-99e2-95dc28c4d668 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:31.597427 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-14aadc5d-3390-4958-99e2-95dc28c4d668 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:31.597910 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-14aadc5d-3390-4958-99e2-95dc28c4d668 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:31.598363 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-14aadc5d-3390-4958-99e2-95dc28c4d668 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:31.733133 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-14aadc5d-3390-4958-99e2-95dc28c4d668 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fea615ea5074760833d02cf7e7b9fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8f33c33f1f43319c2e92431394bcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:10:31.741087 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-14aadc5d-3390-4958-99e2-95dc28c4d668 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] 10.222.0.61 "GET /compute/v2.1/servers/d424c44e-1b2f-4d77-bb81-f7e0c9660389" status: 200 len: 1552 microversion: 2.1 time: 0.161515 Aug 31 17:10:31.741661 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3861/7705] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:10:31 2022] GET /compute/v2.1/servers/d424c44e-1b2f-4d77-bb81-f7e0c9660389 => generated 1552 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:10:33.257415 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4139d92b-d365-41c3-9958-41b577368e98 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0dc949cc-bd3c-4fc3-a648-cfef64ba326f"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:10:33.259925 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4139d92b-d365-41c3-9958-41b577368e98 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] [instance: d424c44e-1b2f-4d77-bb81-f7e0c9660389] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:10:33.269128 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4139d92b-d365-41c3-9958-41b577368e98 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:33.269128 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4139d92b-d365-41c3-9958-41b577368e98 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:33.269128 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4139d92b-d365-41c3-9958-41b577368e98 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:33.269896 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4139d92b-d365-41c3-9958-41b577368e98 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:33.271013 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4139d92b-d365-41c3-9958-41b577368e98 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:33.271013 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4139d92b-d365-41c3-9958-41b577368e98 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:33.448576 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:10:33.573483 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4139d92b-d365-41c3-9958-41b577368e98 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] 10.222.0.61 "POST /compute/v2.1/servers/d424c44e-1b2f-4d77-bb81-f7e0c9660389/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.320190 Aug 31 17:10:33.574157 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3845/7706] 10.222.0.61 () {60 vars in 1323 bytes} [Wed Aug 31 17:10:33 2022] POST /compute/v2.1/servers/d424c44e-1b2f-4d77-bb81-f7e0c9660389/os-volume_attachments => generated 194 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:10:45.372557 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-577586bb-f7a0-43a7-98a5-00ca0938649f tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:10:45.373094 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-577586bb-f7a0-43a7-98a5-00ca0938649f tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] [instance: d424c44e-1b2f-4d77-bb81-f7e0c9660389] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:10:45.375925 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:10:45.377657 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=66 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:10:45.384156 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-577586bb-f7a0-43a7-98a5-00ca0938649f tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:45.384668 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-577586bb-f7a0-43a7-98a5-00ca0938649f tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:45.385132 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-577586bb-f7a0-43a7-98a5-00ca0938649f tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:45.385854 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-577586bb-f7a0-43a7-98a5-00ca0938649f tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:45.386337 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-577586bb-f7a0-43a7-98a5-00ca0938649f tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:45.386793 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-577586bb-f7a0-43a7-98a5-00ca0938649f tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:45.470504 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-577586bb-f7a0-43a7-98a5-00ca0938649f tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lazy-loading 'services' on Instance uuid d424c44e-1b2f-4d77-bb81-f7e0c9660389 {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 17:10:45.544476 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-577586bb-f7a0-43a7-98a5-00ca0938649f tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] 10.222.0.61 "DELETE /compute/v2.1/servers/d424c44e-1b2f-4d77-bb81-f7e0c9660389/os-volume_attachments/0dc949cc-bd3c-4fc3-a648-cfef64ba326f" status: 202 len: 0 microversion: 2.1 time: 0.175318 Aug 31 17:10:45.545085 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3862/7707] 10.222.0.61 () {58 vars in 1416 bytes} [Wed Aug 31 17:10:45 2022] DELETE /compute/v2.1/servers/d424c44e-1b2f-4d77-bb81-f7e0c9660389/os-volume_attachments/0dc949cc-bd3c-4fc3-a648-cfef64ba326f => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 17:10:45.552271 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:10:45.553498 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=4,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:10:45.558244 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f7e871d5-ff6c-4c7e-9c85-78a5325e9e8e tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:10:45.560958 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f7e871d5-ff6c-4c7e-9c85-78a5325e9e8e tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] [instance: d424c44e-1b2f-4d77-bb81-f7e0c9660389] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:10:45.570251 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f7e871d5-ff6c-4c7e-9c85-78a5325e9e8e tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:45.570843 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f7e871d5-ff6c-4c7e-9c85-78a5325e9e8e tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:45.571404 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f7e871d5-ff6c-4c7e-9c85-78a5325e9e8e tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:45.572271 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f7e871d5-ff6c-4c7e-9c85-78a5325e9e8e tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:45.572736 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f7e871d5-ff6c-4c7e-9c85-78a5325e9e8e tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:45.573198 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f7e871d5-ff6c-4c7e-9c85-78a5325e9e8e tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:45.608589 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f7e871d5-ff6c-4c7e-9c85-78a5325e9e8e tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] 10.222.0.61 "GET /compute/v2.1/servers/d424c44e-1b2f-4d77-bb81-f7e0c9660389/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058361 Aug 31 17:10:45.609231 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3846/7708] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 17:10:45 2022] GET /compute/v2.1/servers/d424c44e-1b2f-4d77-bb81-f7e0c9660389/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 17:10:46.621595 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f1691dc6-8221-4b82-a535-0512747357a7 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:10:46.624088 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f1691dc6-8221-4b82-a535-0512747357a7 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] [instance: d424c44e-1b2f-4d77-bb81-f7e0c9660389] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:10:46.632104 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f1691dc6-8221-4b82-a535-0512747357a7 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:46.632608 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f1691dc6-8221-4b82-a535-0512747357a7 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:46.633059 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f1691dc6-8221-4b82-a535-0512747357a7 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:46.633770 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f1691dc6-8221-4b82-a535-0512747357a7 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:46.634240 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f1691dc6-8221-4b82-a535-0512747357a7 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:46.634679 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f1691dc6-8221-4b82-a535-0512747357a7 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:46.666391 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f1691dc6-8221-4b82-a535-0512747357a7 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] 10.222.0.61 "GET /compute/v2.1/servers/d424c44e-1b2f-4d77-bb81-f7e0c9660389/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049130 Aug 31 17:10:46.666969 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3863/7709] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 17:10:46 2022] GET /compute/v2.1/servers/d424c44e-1b2f-4d77-bb81-f7e0c9660389/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:10:47.678462 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1b9c9ae0-0416-4a59-b0ab-da11599dba34 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:10:47.680775 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1b9c9ae0-0416-4a59-b0ab-da11599dba34 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] [instance: d424c44e-1b2f-4d77-bb81-f7e0c9660389] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:10:47.687747 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1b9c9ae0-0416-4a59-b0ab-da11599dba34 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:47.688241 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1b9c9ae0-0416-4a59-b0ab-da11599dba34 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:47.688686 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1b9c9ae0-0416-4a59-b0ab-da11599dba34 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:47.690467 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1b9c9ae0-0416-4a59-b0ab-da11599dba34 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:47.690467 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1b9c9ae0-0416-4a59-b0ab-da11599dba34 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:47.690852 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1b9c9ae0-0416-4a59-b0ab-da11599dba34 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:47.724077 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1b9c9ae0-0416-4a59-b0ab-da11599dba34 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] 10.222.0.61 "GET /compute/v2.1/servers/d424c44e-1b2f-4d77-bb81-f7e0c9660389/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049395 Aug 31 17:10:47.724588 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3847/7710] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 17:10:47 2022] GET /compute/v2.1/servers/d424c44e-1b2f-4d77-bb81-f7e0c9660389/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 17:10:48.736797 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0b356138-76de-4ca5-a954-188c88898cba tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:10:48.739230 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0b356138-76de-4ca5-a954-188c88898cba tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] [instance: d424c44e-1b2f-4d77-bb81-f7e0c9660389] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:10:48.745764 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0b356138-76de-4ca5-a954-188c88898cba tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:48.746254 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0b356138-76de-4ca5-a954-188c88898cba tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:48.746725 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0b356138-76de-4ca5-a954-188c88898cba tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:48.747426 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0b356138-76de-4ca5-a954-188c88898cba tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:48.748050 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0b356138-76de-4ca5-a954-188c88898cba tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:48.748507 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0b356138-76de-4ca5-a954-188c88898cba tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:48.780638 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0b356138-76de-4ca5-a954-188c88898cba tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] 10.222.0.61 "GET /compute/v2.1/servers/d424c44e-1b2f-4d77-bb81-f7e0c9660389/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048168 Aug 31 17:10:48.781213 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3864/7711] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 17:10:48 2022] GET /compute/v2.1/servers/d424c44e-1b2f-4d77-bb81-f7e0c9660389/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:10:49.793524 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7ba56e35-d08e-4f42-8522-6dc4cf8b7a0b tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:10:49.795742 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7ba56e35-d08e-4f42-8522-6dc4cf8b7a0b tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] [instance: d424c44e-1b2f-4d77-bb81-f7e0c9660389] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:10:49.802930 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7ba56e35-d08e-4f42-8522-6dc4cf8b7a0b tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:49.803424 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7ba56e35-d08e-4f42-8522-6dc4cf8b7a0b tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:49.803898 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7ba56e35-d08e-4f42-8522-6dc4cf8b7a0b tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:49.804605 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7ba56e35-d08e-4f42-8522-6dc4cf8b7a0b tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:49.805065 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7ba56e35-d08e-4f42-8522-6dc4cf8b7a0b tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:49.805495 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7ba56e35-d08e-4f42-8522-6dc4cf8b7a0b tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:49.843280 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7ba56e35-d08e-4f42-8522-6dc4cf8b7a0b tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] 10.222.0.61 "GET /compute/v2.1/servers/d424c44e-1b2f-4d77-bb81-f7e0c9660389/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053455 Aug 31 17:10:49.843882 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3848/7712] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 17:10:49 2022] GET /compute/v2.1/servers/d424c44e-1b2f-4d77-bb81-f7e0c9660389/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:10:50.856016 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a7246fec-fc06-4f6f-82e0-78a561885de7 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:10:50.858684 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a7246fec-fc06-4f6f-82e0-78a561885de7 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] [instance: d424c44e-1b2f-4d77-bb81-f7e0c9660389] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:10:50.866347 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a7246fec-fc06-4f6f-82e0-78a561885de7 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:50.866848 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a7246fec-fc06-4f6f-82e0-78a561885de7 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:50.867300 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a7246fec-fc06-4f6f-82e0-78a561885de7 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:50.868039 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a7246fec-fc06-4f6f-82e0-78a561885de7 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:50.868507 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a7246fec-fc06-4f6f-82e0-78a561885de7 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:50.868946 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a7246fec-fc06-4f6f-82e0-78a561885de7 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:50.902413 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a7246fec-fc06-4f6f-82e0-78a561885de7 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] 10.222.0.61 "GET /compute/v2.1/servers/d424c44e-1b2f-4d77-bb81-f7e0c9660389/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050797 Aug 31 17:10:50.902990 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3865/7713] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 17:10:50 2022] GET /compute/v2.1/servers/d424c44e-1b2f-4d77-bb81-f7e0c9660389/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 17:10:50.914055 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-fd663fb4-9db7-4cb6-961c-fd1504f45db6 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:10:50.914569 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-fd663fb4-9db7-4cb6-961c-fd1504f45db6 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] [instance: d424c44e-1b2f-4d77-bb81-f7e0c9660389] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:10:50.921393 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fd663fb4-9db7-4cb6-961c-fd1504f45db6 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:50.921880 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fd663fb4-9db7-4cb6-961c-fd1504f45db6 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:50.922324 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fd663fb4-9db7-4cb6-961c-fd1504f45db6 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:50.923020 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fd663fb4-9db7-4cb6-961c-fd1504f45db6 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:50.923849 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fd663fb4-9db7-4cb6-961c-fd1504f45db6 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:50.924017 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fd663fb4-9db7-4cb6-961c-fd1504f45db6 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:50.999952 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-fd663fb4-9db7-4cb6-961c-fd1504f45db6 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] HTTP exception thrown: Instance d424c44e-1b2f-4d77-bb81-f7e0c9660389 is not attached to volume 0dc949cc-bd3c-4fc3-a648-cfef64ba326f Aug 31 17:10:51.002466 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-fd663fb4-9db7-4cb6-961c-fd1504f45db6 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Request method failure captured: Aug 31 17:10:51.002466 n-d-850499-9 devstack@n-api.service[122256]: request: DELETE /compute/v2.1/servers/d424c44e-1b2f-4d77-bb81-f7e0c9660389/os-volume_attachments/0dc949cc-bd3c-4fc3-a648-cfef64ba326f HTTP/1.1 Aug 31 17:10:51.002466 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 17:10:51.002466 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 17:10:51.002466 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 17:10:51.002466 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 17:10:51.002466 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 17:10:51.002466 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 17:10:51.002466 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 17:10:51.002466 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 17:10:51.002466 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD5XRkdZ__uT4Z9QcRA2ruMK4v78lmsJYIj7UIC254LgiJAezvVopDuetEwbUVXmx0M_IqOldthIYIwPRcNmNz9iqFIiI5pMYxdU-aX5gitLtW4a4zzYflv9ko-bqp9QqhD_5_7O6o69C5yaFtbo4npzEN3wDxeP3Mn8TVuhk7Hg1HXY Aug 31 17:10:51.002466 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 17:10:51.002466 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 17:10:51.002466 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 17:10:51.002466 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 17:10:51.002466 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 17:10:51.002466 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 17:10:51.002466 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: dc8f33c33f1f43319c2e92431394bcd5 Aug 31 17:10:51.002466 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-TestEncryptedCinderVolumes-828494074 Aug 31 17:10:51.002466 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 17:10:51.002466 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 17:10:51.002466 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/dc8f33c33f1f43319c2e92431394bcd5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/dc8f33c33f1f43319c2e92431394bcd5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_dc8f33c33f1f43319c2e92431394bcd5", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/dc8f33c33f1f43319c2e92431394bcd5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 17:10:51.002466 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-TestEncryptedCinderVolumes-828494074 Aug 31 17:10:51.002466 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: dc8f33c33f1f43319c2e92431394bcd5 Aug 31 17:10:51.002466 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-828494074 Aug 31 17:10:51.002466 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-TestEncryptedCinderVolumes-828494074-project Aug 31 17:10:51.002466 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 17:10:51.002466 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 17:10:51.002466 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 4fea615ea5074760833d02cf7e7b9fd5 Aug 31 17:10:51.002466 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-TestEncryptedCinderVolumes-828494074-project Aug 31 17:10:51.002466 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 17:10:51.002466 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance d424c44e-1b2f-4d77-bb81-f7e0c9660389 is not attached to volume 0dc949cc-bd3c-4fc3-a648-cfef64ba326f Aug 31 17:10:51.002466 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'server_id': 'd424c44e-1b2f-4d77-bb81-f7e0c9660389', 'id': '0dc949cc-bd3c-4fc3-a648-cfef64ba326f'} Aug 31 17:10:51.002466 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 17:10:51.002466 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:10:51.002466 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 31 17:10:51.002466 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 31 17:10:51.002466 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 17:10:51.002466 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 17:10:51.002466 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 31 17:10:51.002466 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 31 17:10:51.002466 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 0dc949cc-bd3c-4fc3-a648-cfef64ba326f. Aug 31 17:10:51.002466 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:10:51.002466 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:10:51.002466 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:10:51.002466 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:10:51.002466 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:10:51.002466 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:10:51.002466 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 17:10:51.002466 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 17:10:51.002466 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 17:10:51.002466 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 17:10:51.002466 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 31 17:10:51.002466 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 31 17:10:51.002466 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d424c44e-1b2f-4d77-bb81-f7e0c9660389 is not attached to volume 0dc949cc-bd3c-4fc3-a648-cfef64ba326f Aug 31 17:10:51.002466 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:10:51.002466 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:10:51.002466 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:10:51.002466 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:10:51.002466 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:10:51.002466 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:10:51.007079 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 17:10:51.007079 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 17:10:51.007079 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d424c44e-1b2f-4d77-bb81-f7e0c9660389 is not attached to volume 0dc949cc-bd3c-4fc3-a648-cfef64ba326f Aug 31 17:10:51.007079 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:10:51.007079 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-fd663fb4-9db7-4cb6-961c-fd1504f45db6 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Returning 404 to user: Instance d424c44e-1b2f-4d77-bb81-f7e0c9660389 is not attached to volume 0dc949cc-bd3c-4fc3-a648-cfef64ba326f {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 17:10:51.007079 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-fd663fb4-9db7-4cb6-961c-fd1504f45db6 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] 10.222.0.61 "DELETE /compute/v2.1/servers/d424c44e-1b2f-4d77-bb81-f7e0c9660389/os-volume_attachments/0dc949cc-bd3c-4fc3-a648-cfef64ba326f" status: 404 len: 154 microversion: 2.1 time: 0.094283 Aug 31 17:10:51.007079 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3849/7714] 10.222.0.61 () {58 vars in 1416 bytes} [Wed Aug 31 17:10:50 2022] DELETE /compute/v2.1/servers/d424c44e-1b2f-4d77-bb81-f7e0c9660389/os-volume_attachments/0dc949cc-bd3c-4fc3-a648-cfef64ba326f => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 17:10:54.354960 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1f615bb0-3dc3-4de1-adc6-ecaae0d93176 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:10:54.355649 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1f615bb0-3dc3-4de1-adc6-ecaae0d93176 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] [instance: d424c44e-1b2f-4d77-bb81-f7e0c9660389] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:10:54.363118 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1f615bb0-3dc3-4de1-adc6-ecaae0d93176 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:54.363674 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1f615bb0-3dc3-4de1-adc6-ecaae0d93176 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:54.364272 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1f615bb0-3dc3-4de1-adc6-ecaae0d93176 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:54.365142 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1f615bb0-3dc3-4de1-adc6-ecaae0d93176 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:54.365635 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1f615bb0-3dc3-4de1-adc6-ecaae0d93176 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:54.366081 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1f615bb0-3dc3-4de1-adc6-ecaae0d93176 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:54.399661 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1f615bb0-3dc3-4de1-adc6-ecaae0d93176 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] [instance: d424c44e-1b2f-4d77-bb81-f7e0c9660389] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 17:10:54.487283 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1f615bb0-3dc3-4de1-adc6-ecaae0d93176 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] 10.222.0.61 "DELETE /compute/v2.1/servers/d424c44e-1b2f-4d77-bb81-f7e0c9660389" status: 204 len: 0 microversion: 2.1 time: 0.136005 Aug 31 17:10:54.488153 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3866/7715] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 17:10:54 2022] DELETE /compute/v2.1/servers/d424c44e-1b2f-4d77-bb81-f7e0c9660389 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 17:10:54.496791 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-cf44bbbe-d408-46f3-afc5-ece307ca18cd tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:10:54.497407 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-cf44bbbe-d408-46f3-afc5-ece307ca18cd tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] [instance: d424c44e-1b2f-4d77-bb81-f7e0c9660389] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:10:54.506277 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cf44bbbe-d408-46f3-afc5-ece307ca18cd tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:54.506861 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cf44bbbe-d408-46f3-afc5-ece307ca18cd tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:54.507375 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cf44bbbe-d408-46f3-afc5-ece307ca18cd tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:54.508218 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cf44bbbe-d408-46f3-afc5-ece307ca18cd tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:54.508820 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cf44bbbe-d408-46f3-afc5-ece307ca18cd tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:54.509348 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cf44bbbe-d408-46f3-afc5-ece307ca18cd tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:54.646311 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-cf44bbbe-d408-46f3-afc5-ece307ca18cd tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fea615ea5074760833d02cf7e7b9fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8f33c33f1f43319c2e92431394bcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:10:54.654313 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-cf44bbbe-d408-46f3-afc5-ece307ca18cd tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] 10.222.0.61 "GET /compute/v2.1/servers/d424c44e-1b2f-4d77-bb81-f7e0c9660389" status: 200 len: 1558 microversion: 2.1 time: 0.161813 Aug 31 17:10:54.654905 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3850/7716] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:10:54 2022] GET /compute/v2.1/servers/d424c44e-1b2f-4d77-bb81-f7e0c9660389 => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:10:55.677081 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c7bff027-e448-401c-a824-4e4626c07f2c tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:10:55.677852 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c7bff027-e448-401c-a824-4e4626c07f2c tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] [instance: d424c44e-1b2f-4d77-bb81-f7e0c9660389] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:10:55.685107 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c7bff027-e448-401c-a824-4e4626c07f2c tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:55.685619 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c7bff027-e448-401c-a824-4e4626c07f2c tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:55.686081 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c7bff027-e448-401c-a824-4e4626c07f2c tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:55.686812 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c7bff027-e448-401c-a824-4e4626c07f2c tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:55.687291 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c7bff027-e448-401c-a824-4e4626c07f2c tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:55.687765 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c7bff027-e448-401c-a824-4e4626c07f2c tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:55.834166 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c7bff027-e448-401c-a824-4e4626c07f2c tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fea615ea5074760833d02cf7e7b9fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8f33c33f1f43319c2e92431394bcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:10:55.842119 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c7bff027-e448-401c-a824-4e4626c07f2c tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] 10.222.0.61 "GET /compute/v2.1/servers/d424c44e-1b2f-4d77-bb81-f7e0c9660389" status: 200 len: 1558 microversion: 2.1 time: 0.170030 Aug 31 17:10:55.842703 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3867/7717] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:10:55 2022] GET /compute/v2.1/servers/d424c44e-1b2f-4d77-bb81-f7e0c9660389 => generated 1558 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:10:56.844568 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-b925dad9-e1dc-4e96-873c-993b7167e357 req-b2ba7e60-bfa3-4997-996e-09dfc85cdc5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d424c44e-1b2f-4d77-bb81-f7e0c9660389", "name": "network-vif-deleted", "tag": "9b9b4f0d-4dc4-4456-9f2f-4edbc91cb3ec"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:10:56.858603 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-b925dad9-e1dc-4e96-873c-993b7167e357 req-b2ba7e60-bfa3-4997-996e-09dfc85cdc5d service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:56.859105 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-b925dad9-e1dc-4e96-873c-993b7167e357 req-b2ba7e60-bfa3-4997-996e-09dfc85cdc5d service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:56.859571 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-b925dad9-e1dc-4e96-873c-993b7167e357 req-b2ba7e60-bfa3-4997-996e-09dfc85cdc5d service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:56.864999 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-665750cc-9181-4275-864f-baaf526ff3b4 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:10:56.865810 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-665750cc-9181-4275-864f-baaf526ff3b4 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] [instance: d424c44e-1b2f-4d77-bb81-f7e0c9660389] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:10:56.875791 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-665750cc-9181-4275-864f-baaf526ff3b4 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:56.877338 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-665750cc-9181-4275-864f-baaf526ff3b4 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:56.878364 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-665750cc-9181-4275-864f-baaf526ff3b4 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:56.879820 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-665750cc-9181-4275-864f-baaf526ff3b4 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:56.880687 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-665750cc-9181-4275-864f-baaf526ff3b4 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:56.881337 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-665750cc-9181-4275-864f-baaf526ff3b4 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:56.883743 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-b925dad9-e1dc-4e96-873c-993b7167e357 req-b2ba7e60-bfa3-4997-996e-09dfc85cdc5d service nova] Creating event network-vif-deleted:9b9b4f0d-4dc4-4456-9f2f-4edbc91cb3ec for instance d424c44e-1b2f-4d77-bb81-f7e0c9660389 on n-h2-850499-9 Aug 31 17:10:56.892595 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-b925dad9-e1dc-4e96-873c-993b7167e357 req-b2ba7e60-bfa3-4997-996e-09dfc85cdc5d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050904 Aug 31 17:10:56.893849 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3851/7718] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:10:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 17:10:56.958001 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-665750cc-9181-4275-864f-baaf526ff3b4 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fea615ea5074760833d02cf7e7b9fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8f33c33f1f43319c2e92431394bcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:10:56.966073 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-665750cc-9181-4275-864f-baaf526ff3b4 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] 10.222.0.61 "GET /compute/v2.1/servers/d424c44e-1b2f-4d77-bb81-f7e0c9660389" status: 200 len: 1346 microversion: 2.1 time: 0.106529 Aug 31 17:10:56.966663 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3868/7719] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:10:56 2022] GET /compute/v2.1/servers/d424c44e-1b2f-4d77-bb81-f7e0c9660389 => generated 1346 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 17:10:57.989632 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e74e9d13-8921-456a-9780-a943c2a0a5be tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:10:57.990340 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e74e9d13-8921-456a-9780-a943c2a0a5be tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] [instance: d424c44e-1b2f-4d77-bb81-f7e0c9660389] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:10:57.996550 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e74e9d13-8921-456a-9780-a943c2a0a5be tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:57.997042 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e74e9d13-8921-456a-9780-a943c2a0a5be tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:57.997487 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e74e9d13-8921-456a-9780-a943c2a0a5be tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:57.998182 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e74e9d13-8921-456a-9780-a943c2a0a5be tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:57.998642 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e74e9d13-8921-456a-9780-a943c2a0a5be tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:57.999104 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e74e9d13-8921-456a-9780-a943c2a0a5be tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:58.013838 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-e74e9d13-8921-456a-9780-a943c2a0a5be tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] HTTP exception thrown: Instance d424c44e-1b2f-4d77-bb81-f7e0c9660389 could not be found. Aug 31 17:10:58.015521 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e74e9d13-8921-456a-9780-a943c2a0a5be tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Request method failure captured: Aug 31 17:10:58.015521 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/d424c44e-1b2f-4d77-bb81-f7e0c9660389 HTTP/1.1 Aug 31 17:10:58.015521 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 17:10:58.015521 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 17:10:58.015521 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 17:10:58.015521 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 17:10:58.015521 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 17:10:58.015521 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 17:10:58.015521 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 17:10:58.015521 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 17:10:58.015521 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD5XRkdZ__uT4Z9QcRA2ruMK4v78lmsJYIj7UIC254LgiJAezvVopDuetEwbUVXmx0M_IqOldthIYIwPRcNmNz9iqFIiI5pMYxdU-aX5gitLtW4a4zzYflv9ko-bqp9QqhD_5_7O6o69C5yaFtbo4npzEN3wDxeP3Mn8TVuhk7Hg1HXY Aug 31 17:10:58.015521 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 17:10:58.015521 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 17:10:58.015521 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 17:10:58.015521 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 17:10:58.015521 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 17:10:58.015521 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 17:10:58.015521 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: dc8f33c33f1f43319c2e92431394bcd5 Aug 31 17:10:58.015521 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-TestEncryptedCinderVolumes-828494074 Aug 31 17:10:58.015521 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 17:10:58.015521 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 17:10:58.015521 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/dc8f33c33f1f43319c2e92431394bcd5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/dc8f33c33f1f43319c2e92431394bcd5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_dc8f33c33f1f43319c2e92431394bcd5", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/dc8f33c33f1f43319c2e92431394bcd5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 17:10:58.015521 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-TestEncryptedCinderVolumes-828494074 Aug 31 17:10:58.015521 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: dc8f33c33f1f43319c2e92431394bcd5 Aug 31 17:10:58.015521 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-828494074 Aug 31 17:10:58.015521 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-TestEncryptedCinderVolumes-828494074-project Aug 31 17:10:58.015521 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 17:10:58.015521 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 17:10:58.015521 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 4fea615ea5074760833d02cf7e7b9fd5 Aug 31 17:10:58.015521 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-TestEncryptedCinderVolumes-828494074-project Aug 31 17:10:58.015521 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 17:10:58.015521 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance d424c44e-1b2f-4d77-bb81-f7e0c9660389 could not be found. Aug 31 17:10:58.015521 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': 'd424c44e-1b2f-4d77-bb81-f7e0c9660389'} Aug 31 17:10:58.015521 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 17:10:58.015521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:10:58.015521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 17:10:58.015521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 17:10:58.015521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 17:10:58.015521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 17:10:58.015521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 17:10:58.015521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 17:10:58.015521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 17:10:58.015521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 17:10:58.015521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d424c44e-1b2f-4d77-bb81-f7e0c9660389 could not be found. Aug 31 17:10:58.015521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:10:58.015521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:10:58.015521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:10:58.015521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:10:58.015521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:10:58.015521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:10:58.015521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 17:10:58.015521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 17:10:58.015521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 17:10:58.015521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 17:10:58.015521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 17:10:58.015521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 17:10:58.015521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 17:10:58.015521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 17:10:58.015521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 17:10:58.015521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 17:10:58.015521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d424c44e-1b2f-4d77-bb81-f7e0c9660389 could not be found. Aug 31 17:10:58.015521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:10:58.015521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:10:58.015521 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:10:58.020788 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:10:58.020788 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:10:58.020788 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:10:58.020788 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 17:10:58.020788 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 17:10:58.020788 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d424c44e-1b2f-4d77-bb81-f7e0c9660389 could not be found. Aug 31 17:10:58.020788 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:10:58.020788 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e74e9d13-8921-456a-9780-a943c2a0a5be tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Returning 404 to user: Instance d424c44e-1b2f-4d77-bb81-f7e0c9660389 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 17:10:58.020788 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e74e9d13-8921-456a-9780-a943c2a0a5be tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] 10.222.0.61 "GET /compute/v2.1/servers/d424c44e-1b2f-4d77-bb81-f7e0c9660389" status: 404 len: 111 microversion: 2.1 time: 0.033310 Aug 31 17:10:58.020788 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3852/7720] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:10:57 2022] GET /compute/v2.1/servers/d424c44e-1b2f-4d77-bb81-f7e0c9660389 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 17:10:58.025889 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-55180d62-86ac-4f79-b0de-8c1cdfd64b17 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Calling method '.version_select at 0x7f5ae3bbee50>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:10:58.046437 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-55180d62-86ac-4f79-b0de-8c1cdfd64b17 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1647460696" status: 202 len: 0 microversion: 2.1 time: 0.024335 Aug 31 17:10:58.047006 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3869/7721] 10.222.0.61 () {58 vars in 1278 bytes} [Wed Aug 31 17:10:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1647460696 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 17:10:58.065580 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8b44d9ac-6e6c-4063-a3a8-a16d57caae1c tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Action: 'create', calling method: .version_select at 0x7f5ae3c85430>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-696312881", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDYdue0l7JeRAaEsTBVNC/qKFxHJYMod4dJgrlLyQaX/b070PSmBztzqSpTw1EeyiXtDzCT3dwrrjDQGdAaCScIC2zXSCAB2F88JZeQ0X9+ZFwr0njuLQXOnwJDlkElkWA=="}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:10:58.081579 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-8b44d9ac-6e6c-4063-a3a8-a16d57caae1c tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Getting quotas for project dc8f33c33f1f43319c2e92431394bcd5. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 17:10:58.086964 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-8b44d9ac-6e6c-4063-a3a8-a16d57caae1c tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Getting quotas for user 4fea615ea5074760833d02cf7e7b9fd5 and project dc8f33c33f1f43319c2e92431394bcd5. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 17:10:58.111774 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8b44d9ac-6e6c-4063-a3a8-a16d57caae1c tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.049091 Aug 31 17:10:58.112354 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3853/7722] 10.222.0.61 () {60 vars in 1159 bytes} [Wed Aug 31 17:10:58 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:10:58.162405 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-253c5d26-3454-46ea-8526-19ceec784c1a tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-914717657", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-696312881", "networks": [{"uuid": "66777fc5-2971-41c8-ae03-426d8b705797"}]}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:10:58.216915 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-253c5d26-3454-46ea-8526-19ceec784c1a tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] validate_networks() for [('66777fc5-2971-41c8-ae03-426d8b705797', None, None, None, None, None)] {{(pid=122257) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 17:10:58.640244 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-253c5d26-3454-46ea-8526-19ceec784c1a tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 17:10:58.640690 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-253c5d26-3454-46ea-8526-19ceec784c1a tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 17:10:58.641189 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-253c5d26-3454-46ea-8526-19ceec784c1a tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 17:10:58.642181 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-253c5d26-3454-46ea-8526-19ceec784c1a tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 17:10:58.642687 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-253c5d26-3454-46ea-8526-19ceec784c1a tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 17:10:58.651730 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-253c5d26-3454-46ea-8526-19ceec784c1a tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:58.652237 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-253c5d26-3454-46ea-8526-19ceec784c1a tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:58.652695 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-253c5d26-3454-46ea-8526-19ceec784c1a tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:58.653443 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-253c5d26-3454-46ea-8526-19ceec784c1a tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:58.653918 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-253c5d26-3454-46ea-8526-19ceec784c1a tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:58.654363 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-253c5d26-3454-46ea-8526-19ceec784c1a tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:58.672440 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-253c5d26-3454-46ea-8526-19ceec784c1a tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Getting quotas for project dc8f33c33f1f43319c2e92431394bcd5. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 17:10:58.677982 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-253c5d26-3454-46ea-8526-19ceec784c1a tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Getting quotas for user 4fea615ea5074760833d02cf7e7b9fd5 and project dc8f33c33f1f43319c2e92431394bcd5. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 17:10:58.690356 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-253c5d26-3454-46ea-8526-19ceec784c1a tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Going to run 1 instances... {{(pid=122257) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 17:10:58.692851 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-253c5d26-3454-46ea-8526-19ceec784c1a tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] [instance: d486e169-8a86-4fca-823a-ec822b829dcd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 17:10:58.740959 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-253c5d26-3454-46ea-8526-19ceec784c1a tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.583375 Aug 31 17:10:58.741620 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3870/7723] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 17:10:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 585 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 17:10:58.752629 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-10394299-f7a7-4a68-9b6e-9c97a334cf54 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:10:58.753522 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-10394299-f7a7-4a68-9b6e-9c97a334cf54 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] [instance: d486e169-8a86-4fca-823a-ec822b829dcd] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:10:58.807871 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-10394299-f7a7-4a68-9b6e-9c97a334cf54 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fea615ea5074760833d02cf7e7b9fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8f33c33f1f43319c2e92431394bcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:10:58.816442 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-10394299-f7a7-4a68-9b6e-9c97a334cf54 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] 10.222.0.61 "GET /compute/v2.1/servers/d486e169-8a86-4fca-823a-ec822b829dcd" status: 200 len: 1261 microversion: 2.1 time: 0.068000 Aug 31 17:10:58.817020 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3854/7724] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:10:58 2022] GET /compute/v2.1/servers/d486e169-8a86-4fca-823a-ec822b829dcd => generated 1261 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:10:59.838053 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a632a615-bb8f-4ce6-a18e-a93000457c34 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:10:59.838720 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a632a615-bb8f-4ce6-a18e-a93000457c34 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] [instance: d486e169-8a86-4fca-823a-ec822b829dcd] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:10:59.847179 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a632a615-bb8f-4ce6-a18e-a93000457c34 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:59.847721 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a632a615-bb8f-4ce6-a18e-a93000457c34 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:59.848185 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a632a615-bb8f-4ce6-a18e-a93000457c34 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:59.848906 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a632a615-bb8f-4ce6-a18e-a93000457c34 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:59.849386 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a632a615-bb8f-4ce6-a18e-a93000457c34 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:59.849836 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a632a615-bb8f-4ce6-a18e-a93000457c34 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:59.920506 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a632a615-bb8f-4ce6-a18e-a93000457c34 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fea615ea5074760833d02cf7e7b9fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8f33c33f1f43319c2e92431394bcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:10:59.928610 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a632a615-bb8f-4ce6-a18e-a93000457c34 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] 10.222.0.61 "GET /compute/v2.1/servers/d486e169-8a86-4fca-823a-ec822b829dcd" status: 200 len: 1321 microversion: 2.1 time: 0.094798 Aug 31 17:10:59.929189 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3871/7725] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:10:59 2022] GET /compute/v2.1/servers/d486e169-8a86-4fca-823a-ec822b829dcd => generated 1321 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:11:00.950007 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1037ff55-a7c2-4293-84ba-ee3014941c5b tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:11:00.950788 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1037ff55-a7c2-4293-84ba-ee3014941c5b tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] [instance: d486e169-8a86-4fca-823a-ec822b829dcd] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:11:00.961772 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1037ff55-a7c2-4293-84ba-ee3014941c5b tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:11:00.961772 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1037ff55-a7c2-4293-84ba-ee3014941c5b tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:11:00.961772 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1037ff55-a7c2-4293-84ba-ee3014941c5b tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:11:00.962880 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1037ff55-a7c2-4293-84ba-ee3014941c5b tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:11:00.962880 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1037ff55-a7c2-4293-84ba-ee3014941c5b tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:11:00.962880 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1037ff55-a7c2-4293-84ba-ee3014941c5b tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:11:01.223045 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1037ff55-a7c2-4293-84ba-ee3014941c5b tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fea615ea5074760833d02cf7e7b9fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8f33c33f1f43319c2e92431394bcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:11:01.230806 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1037ff55-a7c2-4293-84ba-ee3014941c5b tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] 10.222.0.61 "GET /compute/v2.1/servers/d486e169-8a86-4fca-823a-ec822b829dcd" status: 200 len: 1361 microversion: 2.1 time: 0.284715 Aug 31 17:11:01.231391 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3855/7726] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:11:00 2022] GET /compute/v2.1/servers/d486e169-8a86-4fca-823a-ec822b829dcd => generated 1361 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:11:01.542154 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-45de7c5f-064d-4956-81af-39ec34c48514 req-43b88ac1-fc6a-48d9-9886-a7cd5db555a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d486e169-8a86-4fca-823a-ec822b829dcd", "tag": "054cc552-c35a-498e-ab75-d687af42583a"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:11:01.554382 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-45de7c5f-064d-4956-81af-39ec34c48514 req-43b88ac1-fc6a-48d9-9886-a7cd5db555a9 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:11:01.554919 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-45de7c5f-064d-4956-81af-39ec34c48514 req-43b88ac1-fc6a-48d9-9886-a7cd5db555a9 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:11:01.555353 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-45de7c5f-064d-4956-81af-39ec34c48514 req-43b88ac1-fc6a-48d9-9886-a7cd5db555a9 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:11:01.566783 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-45de7c5f-064d-4956-81af-39ec34c48514 req-43b88ac1-fc6a-48d9-9886-a7cd5db555a9 service nova] Creating event network-changed:054cc552-c35a-498e-ab75-d687af42583a for instance d486e169-8a86-4fca-823a-ec822b829dcd on n-h2-850499-9 Aug 31 17:11:01.572104 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-45de7c5f-064d-4956-81af-39ec34c48514 req-43b88ac1-fc6a-48d9-9886-a7cd5db555a9 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034983 Aug 31 17:11:01.573037 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3872/7727] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:11:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:11:02.253524 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5047ace7-cc17-439f-983a-e4b84e423ea1 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:11:02.254440 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5047ace7-cc17-439f-983a-e4b84e423ea1 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] [instance: d486e169-8a86-4fca-823a-ec822b829dcd] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:11:02.261429 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5047ace7-cc17-439f-983a-e4b84e423ea1 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:11:02.261933 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5047ace7-cc17-439f-983a-e4b84e423ea1 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:11:02.262384 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5047ace7-cc17-439f-983a-e4b84e423ea1 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:11:02.263097 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5047ace7-cc17-439f-983a-e4b84e423ea1 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:11:02.263586 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5047ace7-cc17-439f-983a-e4b84e423ea1 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:11:02.264022 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5047ace7-cc17-439f-983a-e4b84e423ea1 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:11:02.413767 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5047ace7-cc17-439f-983a-e4b84e423ea1 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fea615ea5074760833d02cf7e7b9fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8f33c33f1f43319c2e92431394bcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:11:02.421495 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5047ace7-cc17-439f-983a-e4b84e423ea1 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] 10.222.0.61 "GET /compute/v2.1/servers/d486e169-8a86-4fca-823a-ec822b829dcd" status: 200 len: 1361 microversion: 2.1 time: 0.172444 Aug 31 17:11:02.422066 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3856/7728] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:11:02 2022] GET /compute/v2.1/servers/d486e169-8a86-4fca-823a-ec822b829dcd => generated 1361 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:11:03.444182 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d9750ea6-b981-4bd1-ad84-108137df2c27 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:11:03.444906 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d9750ea6-b981-4bd1-ad84-108137df2c27 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] [instance: d486e169-8a86-4fca-823a-ec822b829dcd] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:11:03.451431 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d9750ea6-b981-4bd1-ad84-108137df2c27 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:11:03.451981 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d9750ea6-b981-4bd1-ad84-108137df2c27 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:11:03.452444 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d9750ea6-b981-4bd1-ad84-108137df2c27 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:11:03.453170 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d9750ea6-b981-4bd1-ad84-108137df2c27 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:11:03.453649 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d9750ea6-b981-4bd1-ad84-108137df2c27 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:11:03.455177 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d9750ea6-b981-4bd1-ad84-108137df2c27 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:11:03.589867 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d9750ea6-b981-4bd1-ad84-108137df2c27 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fea615ea5074760833d02cf7e7b9fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8f33c33f1f43319c2e92431394bcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:11:03.598305 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d9750ea6-b981-4bd1-ad84-108137df2c27 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] 10.222.0.61 "GET /compute/v2.1/servers/d486e169-8a86-4fca-823a-ec822b829dcd" status: 200 len: 1361 microversion: 2.1 time: 0.159817 Aug 31 17:11:03.598884 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3873/7729] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:11:03 2022] GET /compute/v2.1/servers/d486e169-8a86-4fca-823a-ec822b829dcd => generated 1361 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:11:04.618731 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-07ebe528-2b0d-463f-baf6-fc9a4ab6f1a1 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:11:04.619446 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-07ebe528-2b0d-463f-baf6-fc9a4ab6f1a1 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] [instance: d486e169-8a86-4fca-823a-ec822b829dcd] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:11:04.627056 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-07ebe528-2b0d-463f-baf6-fc9a4ab6f1a1 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:11:04.627423 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-07ebe528-2b0d-463f-baf6-fc9a4ab6f1a1 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:11:04.628159 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-07ebe528-2b0d-463f-baf6-fc9a4ab6f1a1 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:11:04.628878 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-07ebe528-2b0d-463f-baf6-fc9a4ab6f1a1 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:11:04.629364 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-07ebe528-2b0d-463f-baf6-fc9a4ab6f1a1 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:11:04.629800 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-07ebe528-2b0d-463f-baf6-fc9a4ab6f1a1 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:11:04.866570 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-07ebe528-2b0d-463f-baf6-fc9a4ab6f1a1 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fea615ea5074760833d02cf7e7b9fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8f33c33f1f43319c2e92431394bcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:11:04.874531 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-07ebe528-2b0d-463f-baf6-fc9a4ab6f1a1 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] 10.222.0.61 "GET /compute/v2.1/servers/d486e169-8a86-4fca-823a-ec822b829dcd" status: 200 len: 1361 microversion: 2.1 time: 0.259714 Aug 31 17:11:04.875116 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3857/7730] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:11:04 2022] GET /compute/v2.1/servers/d486e169-8a86-4fca-823a-ec822b829dcd => generated 1361 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:11:05.897204 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-58096440-decb-4954-96c6-414e04c692e4 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:11:05.897837 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-58096440-decb-4954-96c6-414e04c692e4 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] [instance: d486e169-8a86-4fca-823a-ec822b829dcd] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:11:05.905047 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-58096440-decb-4954-96c6-414e04c692e4 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:11:05.905553 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-58096440-decb-4954-96c6-414e04c692e4 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:11:05.906012 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-58096440-decb-4954-96c6-414e04c692e4 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:11:05.906728 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-58096440-decb-4954-96c6-414e04c692e4 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:11:05.907202 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-58096440-decb-4954-96c6-414e04c692e4 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:11:05.908260 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-58096440-decb-4954-96c6-414e04c692e4 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:11:06.042606 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-58096440-decb-4954-96c6-414e04c692e4 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fea615ea5074760833d02cf7e7b9fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8f33c33f1f43319c2e92431394bcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:11:06.050691 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-58096440-decb-4954-96c6-414e04c692e4 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] 10.222.0.61 "GET /compute/v2.1/servers/d486e169-8a86-4fca-823a-ec822b829dcd" status: 200 len: 1361 microversion: 2.1 time: 0.157536 Aug 31 17:11:06.051270 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3874/7731] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:11:05 2022] GET /compute/v2.1/servers/d486e169-8a86-4fca-823a-ec822b829dcd => generated 1361 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:11:06.987251 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-5196f3fa-7434-4365-a275-2c98b4c83b8d req-6524e946-8d4b-461e-97a6-275df6ba772f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d486e169-8a86-4fca-823a-ec822b829dcd", "name": "network-vif-plugged", "status": "completed", "tag": "054cc552-c35a-498e-ab75-d687af42583a"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:11:06.998262 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-5196f3fa-7434-4365-a275-2c98b4c83b8d req-6524e946-8d4b-461e-97a6-275df6ba772f service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:11:06.998757 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-5196f3fa-7434-4365-a275-2c98b4c83b8d req-6524e946-8d4b-461e-97a6-275df6ba772f service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:11:06.999317 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-5196f3fa-7434-4365-a275-2c98b4c83b8d req-6524e946-8d4b-461e-97a6-275df6ba772f service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:11:07.013487 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-5196f3fa-7434-4365-a275-2c98b4c83b8d req-6524e946-8d4b-461e-97a6-275df6ba772f service nova] Creating event network-vif-plugged:054cc552-c35a-498e-ab75-d687af42583a for instance d486e169-8a86-4fca-823a-ec822b829dcd on n-h2-850499-9 Aug 31 17:11:07.019937 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-5196f3fa-7434-4365-a275-2c98b4c83b8d req-6524e946-8d4b-461e-97a6-275df6ba772f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037106 Aug 31 17:11:07.020755 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3858/7732] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:11:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:11:07.074283 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-66a0e096-cf56-47be-96d6-b1ce1676a6c0 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:11:07.075096 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-66a0e096-cf56-47be-96d6-b1ce1676a6c0 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] [instance: d486e169-8a86-4fca-823a-ec822b829dcd] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:11:07.083538 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-66a0e096-cf56-47be-96d6-b1ce1676a6c0 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:11:07.083975 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-66a0e096-cf56-47be-96d6-b1ce1676a6c0 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:11:07.084427 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-66a0e096-cf56-47be-96d6-b1ce1676a6c0 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:11:07.085150 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-66a0e096-cf56-47be-96d6-b1ce1676a6c0 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:11:07.085620 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-66a0e096-cf56-47be-96d6-b1ce1676a6c0 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:11:07.086220 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-66a0e096-cf56-47be-96d6-b1ce1676a6c0 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:11:07.299762 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-66a0e096-cf56-47be-96d6-b1ce1676a6c0 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fea615ea5074760833d02cf7e7b9fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8f33c33f1f43319c2e92431394bcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:11:07.307511 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-66a0e096-cf56-47be-96d6-b1ce1676a6c0 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] 10.222.0.61 "GET /compute/v2.1/servers/d486e169-8a86-4fca-823a-ec822b829dcd" status: 200 len: 1361 microversion: 2.1 time: 0.237169 Aug 31 17:11:07.308098 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3875/7733] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:11:07 2022] GET /compute/v2.1/servers/d486e169-8a86-4fca-823a-ec822b829dcd => generated 1361 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:11:08.330392 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5de1a4ba-d8cf-4053-ad5c-235f7325c1ee tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:11:08.331133 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5de1a4ba-d8cf-4053-ad5c-235f7325c1ee tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] [instance: d486e169-8a86-4fca-823a-ec822b829dcd] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:11:08.337546 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5de1a4ba-d8cf-4053-ad5c-235f7325c1ee tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:11:08.338043 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5de1a4ba-d8cf-4053-ad5c-235f7325c1ee tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:11:08.338492 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5de1a4ba-d8cf-4053-ad5c-235f7325c1ee tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:11:08.339198 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5de1a4ba-d8cf-4053-ad5c-235f7325c1ee tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:11:08.339733 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5de1a4ba-d8cf-4053-ad5c-235f7325c1ee tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:11:08.340171 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5de1a4ba-d8cf-4053-ad5c-235f7325c1ee tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:11:08.472085 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5de1a4ba-d8cf-4053-ad5c-235f7325c1ee tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fea615ea5074760833d02cf7e7b9fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8f33c33f1f43319c2e92431394bcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:11:08.480799 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5de1a4ba-d8cf-4053-ad5c-235f7325c1ee tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] 10.222.0.61 "GET /compute/v2.1/servers/d486e169-8a86-4fca-823a-ec822b829dcd" status: 200 len: 1361 microversion: 2.1 time: 0.156378 Aug 31 17:11:08.481592 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3859/7734] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:11:08 2022] GET /compute/v2.1/servers/d486e169-8a86-4fca-823a-ec822b829dcd => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:11:09.502510 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-194a4380-db95-485d-9103-f997edd2e97e tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:11:09.503386 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-194a4380-db95-485d-9103-f997edd2e97e tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] [instance: d486e169-8a86-4fca-823a-ec822b829dcd] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:11:09.506225 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:11:09.507018 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=6 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:11:09.512896 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-194a4380-db95-485d-9103-f997edd2e97e tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:11:09.513395 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-194a4380-db95-485d-9103-f997edd2e97e tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:11:09.513845 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-194a4380-db95-485d-9103-f997edd2e97e tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:11:09.514548 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-194a4380-db95-485d-9103-f997edd2e97e tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:11:09.515017 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-194a4380-db95-485d-9103-f997edd2e97e tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:11:09.515455 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-194a4380-db95-485d-9103-f997edd2e97e tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:11:09.654806 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-194a4380-db95-485d-9103-f997edd2e97e tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fea615ea5074760833d02cf7e7b9fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8f33c33f1f43319c2e92431394bcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:11:09.662767 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-194a4380-db95-485d-9103-f997edd2e97e tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] 10.222.0.61 "GET /compute/v2.1/servers/d486e169-8a86-4fca-823a-ec822b829dcd" status: 200 len: 1552 microversion: 2.1 time: 0.164722 Aug 31 17:11:09.663350 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3876/7735] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:11:09 2022] GET /compute/v2.1/servers/d486e169-8a86-4fca-823a-ec822b829dcd => generated 1552 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:11:09.683007 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-577e485e-9ba7-460e-82a9-cd52b9e976f3 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:11:09.683651 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-577e485e-9ba7-460e-82a9-cd52b9e976f3 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] [instance: d486e169-8a86-4fca-823a-ec822b829dcd] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:11:09.685603 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=6 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:11:09.692519 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-577e485e-9ba7-460e-82a9-cd52b9e976f3 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:11:09.693014 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-577e485e-9ba7-460e-82a9-cd52b9e976f3 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:11:09.693455 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-577e485e-9ba7-460e-82a9-cd52b9e976f3 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:11:09.694160 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-577e485e-9ba7-460e-82a9-cd52b9e976f3 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:11:09.694624 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-577e485e-9ba7-460e-82a9-cd52b9e976f3 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:11:09.695059 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-577e485e-9ba7-460e-82a9-cd52b9e976f3 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:11:09.827016 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-577e485e-9ba7-460e-82a9-cd52b9e976f3 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fea615ea5074760833d02cf7e7b9fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8f33c33f1f43319c2e92431394bcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:11:09.834923 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-577e485e-9ba7-460e-82a9-cd52b9e976f3 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] 10.222.0.61 "GET /compute/v2.1/servers/d486e169-8a86-4fca-823a-ec822b829dcd" status: 200 len: 1552 microversion: 2.1 time: 0.155761 Aug 31 17:11:09.835526 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3860/7736] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:11:09 2022] GET /compute/v2.1/servers/d486e169-8a86-4fca-823a-ec822b829dcd => generated 1552 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:11:11.328079 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-fa819dad-c6d8-41e2-81dd-3480d8df308d tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6c9f7d26-7446-4aa6-9f09-e2a0d3ec5a77"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:11:11.330842 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-fa819dad-c6d8-41e2-81dd-3480d8df308d tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] [instance: d486e169-8a86-4fca-823a-ec822b829dcd] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:11:11.337844 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fa819dad-c6d8-41e2-81dd-3480d8df308d tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:11:11.338351 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fa819dad-c6d8-41e2-81dd-3480d8df308d tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:11:11.338815 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fa819dad-c6d8-41e2-81dd-3480d8df308d tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:11:11.339551 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fa819dad-c6d8-41e2-81dd-3480d8df308d tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:11:11.340029 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fa819dad-c6d8-41e2-81dd-3480d8df308d tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:11:11.340474 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fa819dad-c6d8-41e2-81dd-3480d8df308d tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:11:11.590626 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:11:11.610901 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-fa819dad-c6d8-41e2-81dd-3480d8df308d tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] 10.222.0.61 "POST /compute/v2.1/servers/d486e169-8a86-4fca-823a-ec822b829dcd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.286844 Aug 31 17:11:11.612356 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3877/7737] 10.222.0.61 () {60 vars in 1323 bytes} [Wed Aug 31 17:11:11 2022] POST /compute/v2.1/servers/d486e169-8a86-4fca-823a-ec822b829dcd/os-volume_attachments => generated 194 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:11:22.331947 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5852adb3-7c6a-4338-a989-d650b8de8353 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:11:22.332496 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5852adb3-7c6a-4338-a989-d650b8de8353 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] [instance: d486e169-8a86-4fca-823a-ec822b829dcd] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:11:22.334363 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:11:22.335076 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=66 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:11:22.340932 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5852adb3-7c6a-4338-a989-d650b8de8353 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:11:22.341426 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5852adb3-7c6a-4338-a989-d650b8de8353 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:11:22.341870 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5852adb3-7c6a-4338-a989-d650b8de8353 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:11:22.342571 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5852adb3-7c6a-4338-a989-d650b8de8353 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:11:22.343032 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5852adb3-7c6a-4338-a989-d650b8de8353 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:11:22.343462 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5852adb3-7c6a-4338-a989-d650b8de8353 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:11:22.425857 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-5852adb3-7c6a-4338-a989-d650b8de8353 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lazy-loading 'services' on Instance uuid d486e169-8a86-4fca-823a-ec822b829dcd {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 17:11:22.499748 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5852adb3-7c6a-4338-a989-d650b8de8353 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] 10.222.0.61 "DELETE /compute/v2.1/servers/d486e169-8a86-4fca-823a-ec822b829dcd/os-volume_attachments/6c9f7d26-7446-4aa6-9f09-e2a0d3ec5a77" status: 202 len: 0 microversion: 2.1 time: 0.172177 Aug 31 17:11:22.500347 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3861/7738] 10.222.0.61 () {58 vars in 1416 bytes} [Wed Aug 31 17:11:22 2022] DELETE /compute/v2.1/servers/d486e169-8a86-4fca-823a-ec822b829dcd/os-volume_attachments/6c9f7d26-7446-4aa6-9f09-e2a0d3ec5a77 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 17:11:22.507378 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:11:22.508212 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=2,nova_cell1:INSERT=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:11:22.512619 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1883d2d3-6cfe-44c8-880d-f0b78a85e1f2 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:11:22.514971 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1883d2d3-6cfe-44c8-880d-f0b78a85e1f2 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] [instance: d486e169-8a86-4fca-823a-ec822b829dcd] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:11:22.524123 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1883d2d3-6cfe-44c8-880d-f0b78a85e1f2 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:11:22.524631 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1883d2d3-6cfe-44c8-880d-f0b78a85e1f2 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:11:22.525090 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1883d2d3-6cfe-44c8-880d-f0b78a85e1f2 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:11:22.526018 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1883d2d3-6cfe-44c8-880d-f0b78a85e1f2 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:11:22.526545 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1883d2d3-6cfe-44c8-880d-f0b78a85e1f2 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:11:22.526937 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1883d2d3-6cfe-44c8-880d-f0b78a85e1f2 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:11:22.560507 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1883d2d3-6cfe-44c8-880d-f0b78a85e1f2 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] 10.222.0.61 "GET /compute/v2.1/servers/d486e169-8a86-4fca-823a-ec822b829dcd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055102 Aug 31 17:11:22.561428 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3878/7739] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 17:11:22 2022] GET /compute/v2.1/servers/d486e169-8a86-4fca-823a-ec822b829dcd/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:11:23.575588 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7ec2d338-395b-40c3-b7dc-3ca0479d24fc tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:11:23.577983 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7ec2d338-395b-40c3-b7dc-3ca0479d24fc tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] [instance: d486e169-8a86-4fca-823a-ec822b829dcd] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:11:23.584587 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7ec2d338-395b-40c3-b7dc-3ca0479d24fc tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:11:23.585083 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7ec2d338-395b-40c3-b7dc-3ca0479d24fc tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:11:23.585528 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7ec2d338-395b-40c3-b7dc-3ca0479d24fc tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:11:23.586232 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7ec2d338-395b-40c3-b7dc-3ca0479d24fc tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:11:23.586697 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7ec2d338-395b-40c3-b7dc-3ca0479d24fc tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:11:23.587132 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7ec2d338-395b-40c3-b7dc-3ca0479d24fc tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:11:23.620264 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7ec2d338-395b-40c3-b7dc-3ca0479d24fc tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] 10.222.0.61 "GET /compute/v2.1/servers/d486e169-8a86-4fca-823a-ec822b829dcd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049878 Aug 31 17:11:23.620841 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3862/7740] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 17:11:23 2022] GET /compute/v2.1/servers/d486e169-8a86-4fca-823a-ec822b829dcd/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:11:24.633006 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ca98979c-f29e-4525-8e16-a57a268e7648 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:11:24.635176 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ca98979c-f29e-4525-8e16-a57a268e7648 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] [instance: d486e169-8a86-4fca-823a-ec822b829dcd] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:11:24.642947 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ca98979c-f29e-4525-8e16-a57a268e7648 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:11:24.643425 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ca98979c-f29e-4525-8e16-a57a268e7648 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:11:24.644042 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ca98979c-f29e-4525-8e16-a57a268e7648 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:11:24.644904 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ca98979c-f29e-4525-8e16-a57a268e7648 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:11:24.645491 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ca98979c-f29e-4525-8e16-a57a268e7648 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:11:24.646047 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ca98979c-f29e-4525-8e16-a57a268e7648 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:11:24.679457 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ca98979c-f29e-4525-8e16-a57a268e7648 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] 10.222.0.61 "GET /compute/v2.1/servers/d486e169-8a86-4fca-823a-ec822b829dcd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050438 Aug 31 17:11:24.680304 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3879/7741] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 17:11:24 2022] GET /compute/v2.1/servers/d486e169-8a86-4fca-823a-ec822b829dcd/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:11:25.691910 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a48f8473-368e-4e30-ab14-8818180fdebc tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:11:25.694132 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a48f8473-368e-4e30-ab14-8818180fdebc tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] [instance: d486e169-8a86-4fca-823a-ec822b829dcd] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:11:25.701168 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a48f8473-368e-4e30-ab14-8818180fdebc tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:11:25.701660 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a48f8473-368e-4e30-ab14-8818180fdebc tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:11:25.702101 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a48f8473-368e-4e30-ab14-8818180fdebc tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:11:25.702800 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a48f8473-368e-4e30-ab14-8818180fdebc tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:11:25.703262 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a48f8473-368e-4e30-ab14-8818180fdebc tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:11:25.703771 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a48f8473-368e-4e30-ab14-8818180fdebc tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:11:25.735796 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a48f8473-368e-4e30-ab14-8818180fdebc tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] 10.222.0.61 "GET /compute/v2.1/servers/d486e169-8a86-4fca-823a-ec822b829dcd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047952 Aug 31 17:11:25.736858 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3863/7742] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 17:11:25 2022] GET /compute/v2.1/servers/d486e169-8a86-4fca-823a-ec822b829dcd/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:11:26.748458 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d200a27f-6489-4adb-8e7d-7967cb81737d tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:11:26.750538 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d200a27f-6489-4adb-8e7d-7967cb81737d tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] [instance: d486e169-8a86-4fca-823a-ec822b829dcd] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:11:26.762115 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d200a27f-6489-4adb-8e7d-7967cb81737d tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:11:26.762637 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d200a27f-6489-4adb-8e7d-7967cb81737d tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:11:26.763098 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d200a27f-6489-4adb-8e7d-7967cb81737d tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:11:26.763846 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d200a27f-6489-4adb-8e7d-7967cb81737d tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:11:26.764319 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d200a27f-6489-4adb-8e7d-7967cb81737d tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:11:26.764764 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d200a27f-6489-4adb-8e7d-7967cb81737d tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:11:26.797400 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d200a27f-6489-4adb-8e7d-7967cb81737d tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] 10.222.0.61 "GET /compute/v2.1/servers/d486e169-8a86-4fca-823a-ec822b829dcd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053083 Aug 31 17:11:26.797997 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3880/7743] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 17:11:26 2022] GET /compute/v2.1/servers/d486e169-8a86-4fca-823a-ec822b829dcd/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:11:27.810505 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-db3c1bd5-6a20-48aa-aa9f-5cdb774f9a66 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:11:27.812725 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-db3c1bd5-6a20-48aa-aa9f-5cdb774f9a66 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] [instance: d486e169-8a86-4fca-823a-ec822b829dcd] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:11:27.820415 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-db3c1bd5-6a20-48aa-aa9f-5cdb774f9a66 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:11:27.820910 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-db3c1bd5-6a20-48aa-aa9f-5cdb774f9a66 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:11:27.821359 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-db3c1bd5-6a20-48aa-aa9f-5cdb774f9a66 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:11:27.822064 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-db3c1bd5-6a20-48aa-aa9f-5cdb774f9a66 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:11:27.822541 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-db3c1bd5-6a20-48aa-aa9f-5cdb774f9a66 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:11:27.822971 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-db3c1bd5-6a20-48aa-aa9f-5cdb774f9a66 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:11:27.856447 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-db3c1bd5-6a20-48aa-aa9f-5cdb774f9a66 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] 10.222.0.61 "GET /compute/v2.1/servers/d486e169-8a86-4fca-823a-ec822b829dcd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050022 Aug 31 17:11:27.857021 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3864/7744] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 17:11:27 2022] GET /compute/v2.1/servers/d486e169-8a86-4fca-823a-ec822b829dcd/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 17:11:27.868180 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-461131d8-92fb-417b-82b3-0b44dfd65d2c tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:11:27.868719 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-461131d8-92fb-417b-82b3-0b44dfd65d2c tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] [instance: d486e169-8a86-4fca-823a-ec822b829dcd] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:11:27.875672 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-461131d8-92fb-417b-82b3-0b44dfd65d2c tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:11:27.876209 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-461131d8-92fb-417b-82b3-0b44dfd65d2c tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:11:27.877299 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-461131d8-92fb-417b-82b3-0b44dfd65d2c tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:11:27.878262 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-461131d8-92fb-417b-82b3-0b44dfd65d2c tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:11:27.878737 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-461131d8-92fb-417b-82b3-0b44dfd65d2c tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:11:27.879180 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-461131d8-92fb-417b-82b3-0b44dfd65d2c tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:11:27.955935 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-461131d8-92fb-417b-82b3-0b44dfd65d2c tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] HTTP exception thrown: Instance d486e169-8a86-4fca-823a-ec822b829dcd is not attached to volume 6c9f7d26-7446-4aa6-9f09-e2a0d3ec5a77 Aug 31 17:11:27.957585 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-461131d8-92fb-417b-82b3-0b44dfd65d2c tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Request method failure captured: Aug 31 17:11:27.957585 n-d-850499-9 devstack@n-api.service[122257]: request: DELETE /compute/v2.1/servers/d486e169-8a86-4fca-823a-ec822b829dcd/os-volume_attachments/6c9f7d26-7446-4aa6-9f09-e2a0d3ec5a77 HTTP/1.1 Aug 31 17:11:27.957585 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 17:11:27.957585 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 17:11:27.957585 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 17:11:27.957585 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 17:11:27.957585 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 17:11:27.957585 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 17:11:27.957585 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 17:11:27.957585 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 17:11:27.957585 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD5XRkdZ__uT4Z9QcRA2ruMK4v78lmsJYIj7UIC254LgiJAezvVopDuetEwbUVXmx0M_IqOldthIYIwPRcNmNz9iqFIiI5pMYxdU-aX5gitLtW4a4zzYflv9ko-bqp9QqhD_5_7O6o69C5yaFtbo4npzEN3wDxeP3Mn8TVuhk7Hg1HXY Aug 31 17:11:27.957585 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 17:11:27.957585 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 17:11:27.957585 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 17:11:27.957585 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 17:11:27.957585 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 17:11:27.957585 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 17:11:27.957585 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: dc8f33c33f1f43319c2e92431394bcd5 Aug 31 17:11:27.957585 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-TestEncryptedCinderVolumes-828494074 Aug 31 17:11:27.957585 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 17:11:27.957585 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 17:11:27.957585 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/dc8f33c33f1f43319c2e92431394bcd5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/dc8f33c33f1f43319c2e92431394bcd5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_dc8f33c33f1f43319c2e92431394bcd5", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/dc8f33c33f1f43319c2e92431394bcd5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 17:11:27.957585 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-TestEncryptedCinderVolumes-828494074 Aug 31 17:11:27.957585 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: dc8f33c33f1f43319c2e92431394bcd5 Aug 31 17:11:27.957585 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-828494074 Aug 31 17:11:27.957585 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-TestEncryptedCinderVolumes-828494074-project Aug 31 17:11:27.957585 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 17:11:27.957585 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 17:11:27.957585 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 4fea615ea5074760833d02cf7e7b9fd5 Aug 31 17:11:27.957585 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-TestEncryptedCinderVolumes-828494074-project Aug 31 17:11:27.957585 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 17:11:27.957585 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance d486e169-8a86-4fca-823a-ec822b829dcd is not attached to volume 6c9f7d26-7446-4aa6-9f09-e2a0d3ec5a77 Aug 31 17:11:27.957585 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'server_id': 'd486e169-8a86-4fca-823a-ec822b829dcd', 'id': '6c9f7d26-7446-4aa6-9f09-e2a0d3ec5a77'} Aug 31 17:11:27.957585 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 17:11:27.957585 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:11:27.957585 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 31 17:11:27.957585 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 31 17:11:27.957585 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 17:11:27.957585 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 17:11:27.957585 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 31 17:11:27.957585 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 31 17:11:27.957585 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 6c9f7d26-7446-4aa6-9f09-e2a0d3ec5a77. Aug 31 17:11:27.957585 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 17:11:27.957585 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:11:27.957585 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 17:11:27.957585 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:11:27.957585 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:11:27.957585 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:11:27.957585 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 17:11:27.957585 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 17:11:27.957585 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 17:11:27.957585 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 17:11:27.957585 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 31 17:11:27.957585 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 31 17:11:27.957585 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d486e169-8a86-4fca-823a-ec822b829dcd is not attached to volume 6c9f7d26-7446-4aa6-9f09-e2a0d3ec5a77 Aug 31 17:11:27.957585 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 17:11:27.957585 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:11:27.957585 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 17:11:27.957585 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:11:27.957585 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:11:27.957585 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:11:27.962221 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 17:11:27.962221 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 17:11:27.962221 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d486e169-8a86-4fca-823a-ec822b829dcd is not attached to volume 6c9f7d26-7446-4aa6-9f09-e2a0d3ec5a77 Aug 31 17:11:27.962221 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 17:11:27.962221 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-461131d8-92fb-417b-82b3-0b44dfd65d2c tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Returning 404 to user: Instance d486e169-8a86-4fca-823a-ec822b829dcd is not attached to volume 6c9f7d26-7446-4aa6-9f09-e2a0d3ec5a77 {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 17:11:27.962221 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-461131d8-92fb-417b-82b3-0b44dfd65d2c tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] 10.222.0.61 "DELETE /compute/v2.1/servers/d486e169-8a86-4fca-823a-ec822b829dcd/os-volume_attachments/6c9f7d26-7446-4aa6-9f09-e2a0d3ec5a77" status: 404 len: 154 microversion: 2.1 time: 0.094969 Aug 31 17:11:27.962221 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3881/7745] 10.222.0.61 () {58 vars in 1416 bytes} [Wed Aug 31 17:11:27 2022] DELETE /compute/v2.1/servers/d486e169-8a86-4fca-823a-ec822b829dcd/os-volume_attachments/6c9f7d26-7446-4aa6-9f09-e2a0d3ec5a77 => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 17:11:31.312247 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d8622119-2cfd-47e2-868f-cc4a3150f4f7 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:11:31.313330 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d8622119-2cfd-47e2-868f-cc4a3150f4f7 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] [instance: d486e169-8a86-4fca-823a-ec822b829dcd] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:11:31.321944 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d8622119-2cfd-47e2-868f-cc4a3150f4f7 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:11:31.323031 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d8622119-2cfd-47e2-868f-cc4a3150f4f7 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:11:31.324155 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d8622119-2cfd-47e2-868f-cc4a3150f4f7 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:11:31.324819 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d8622119-2cfd-47e2-868f-cc4a3150f4f7 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:11:31.325387 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d8622119-2cfd-47e2-868f-cc4a3150f4f7 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:11:31.325906 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d8622119-2cfd-47e2-868f-cc4a3150f4f7 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:11:31.357556 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d8622119-2cfd-47e2-868f-cc4a3150f4f7 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] [instance: d486e169-8a86-4fca-823a-ec822b829dcd] Going to try to terminate instance {{(pid=122256) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 17:11:31.443538 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d8622119-2cfd-47e2-868f-cc4a3150f4f7 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] 10.222.0.61 "DELETE /compute/v2.1/servers/d486e169-8a86-4fca-823a-ec822b829dcd" status: 204 len: 0 microversion: 2.1 time: 0.134975 Aug 31 17:11:31.443820 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3865/7746] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 17:11:31 2022] DELETE /compute/v2.1/servers/d486e169-8a86-4fca-823a-ec822b829dcd => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 17:11:31.455150 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-59dd222a-1571-4b46-ad84-e30e8bbce8bd tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:11:31.455788 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-59dd222a-1571-4b46-ad84-e30e8bbce8bd tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] [instance: d486e169-8a86-4fca-823a-ec822b829dcd] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:11:31.464379 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-59dd222a-1571-4b46-ad84-e30e8bbce8bd tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:11:31.464893 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-59dd222a-1571-4b46-ad84-e30e8bbce8bd tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:11:31.465355 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-59dd222a-1571-4b46-ad84-e30e8bbce8bd tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:11:31.466074 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-59dd222a-1571-4b46-ad84-e30e8bbce8bd tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:11:31.466747 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-59dd222a-1571-4b46-ad84-e30e8bbce8bd tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:11:31.467199 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-59dd222a-1571-4b46-ad84-e30e8bbce8bd tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:11:31.602294 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-59dd222a-1571-4b46-ad84-e30e8bbce8bd tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fea615ea5074760833d02cf7e7b9fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8f33c33f1f43319c2e92431394bcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:11:31.610410 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-59dd222a-1571-4b46-ad84-e30e8bbce8bd tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] 10.222.0.61 "GET /compute/v2.1/servers/d486e169-8a86-4fca-823a-ec822b829dcd" status: 200 len: 1558 microversion: 2.1 time: 0.161097 Aug 31 17:11:31.611453 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3882/7747] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:11:31 2022] GET /compute/v2.1/servers/d486e169-8a86-4fca-823a-ec822b829dcd => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:11:32.632899 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-65d9f30d-c98d-4407-8722-fe1a7f717f08 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:11:32.633620 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-65d9f30d-c98d-4407-8722-fe1a7f717f08 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] [instance: d486e169-8a86-4fca-823a-ec822b829dcd] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:11:32.640655 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-65d9f30d-c98d-4407-8722-fe1a7f717f08 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:11:32.641147 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-65d9f30d-c98d-4407-8722-fe1a7f717f08 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:11:32.641586 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-65d9f30d-c98d-4407-8722-fe1a7f717f08 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:11:32.642280 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-65d9f30d-c98d-4407-8722-fe1a7f717f08 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:11:32.642738 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-65d9f30d-c98d-4407-8722-fe1a7f717f08 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:11:32.643165 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-65d9f30d-c98d-4407-8722-fe1a7f717f08 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:11:32.779758 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-65d9f30d-c98d-4407-8722-fe1a7f717f08 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fea615ea5074760833d02cf7e7b9fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8f33c33f1f43319c2e92431394bcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:11:32.788305 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-65d9f30d-c98d-4407-8722-fe1a7f717f08 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] 10.222.0.61 "GET /compute/v2.1/servers/d486e169-8a86-4fca-823a-ec822b829dcd" status: 200 len: 1558 microversion: 2.1 time: 0.159968 Aug 31 17:11:32.788988 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3866/7748] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:11:32 2022] GET /compute/v2.1/servers/d486e169-8a86-4fca-823a-ec822b829dcd => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:11:33.800167 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-d8cd2a6c-59aa-4d81-926a-5efcd9018456 req-a2e6dcfe-7928-4618-b714-76e4718cddc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d486e169-8a86-4fca-823a-ec822b829dcd", "name": "network-vif-deleted", "tag": "054cc552-c35a-498e-ab75-d687af42583a"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:11:33.811275 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3da4b5eb-e0f6-4b50-aa92-e86dd94b4a09 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:11:33.811881 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-d8cd2a6c-59aa-4d81-926a-5efcd9018456 req-a2e6dcfe-7928-4618-b714-76e4718cddc6 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:11:33.812275 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-d8cd2a6c-59aa-4d81-926a-5efcd9018456 req-a2e6dcfe-7928-4618-b714-76e4718cddc6 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:11:33.812731 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-d8cd2a6c-59aa-4d81-926a-5efcd9018456 req-a2e6dcfe-7928-4618-b714-76e4718cddc6 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:11:33.813000 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3da4b5eb-e0f6-4b50-aa92-e86dd94b4a09 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] [instance: d486e169-8a86-4fca-823a-ec822b829dcd] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:11:33.823857 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3da4b5eb-e0f6-4b50-aa92-e86dd94b4a09 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:11:33.824365 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3da4b5eb-e0f6-4b50-aa92-e86dd94b4a09 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:11:33.825753 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3da4b5eb-e0f6-4b50-aa92-e86dd94b4a09 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:11:33.826907 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3da4b5eb-e0f6-4b50-aa92-e86dd94b4a09 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:11:33.827215 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-d8cd2a6c-59aa-4d81-926a-5efcd9018456 req-a2e6dcfe-7928-4618-b714-76e4718cddc6 service nova] Creating event network-vif-deleted:054cc552-c35a-498e-ab75-d687af42583a for instance d486e169-8a86-4fca-823a-ec822b829dcd on n-h2-850499-9 Aug 31 17:11:33.827439 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3da4b5eb-e0f6-4b50-aa92-e86dd94b4a09 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:11:33.828154 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3da4b5eb-e0f6-4b50-aa92-e86dd94b4a09 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:11:33.833757 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-d8cd2a6c-59aa-4d81-926a-5efcd9018456 req-a2e6dcfe-7928-4618-b714-76e4718cddc6 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038480 Aug 31 17:11:33.835676 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3883/7749] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:11:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 17:11:33.902666 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3da4b5eb-e0f6-4b50-aa92-e86dd94b4a09 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fea615ea5074760833d02cf7e7b9fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc8f33c33f1f43319c2e92431394bcd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:11:33.913030 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3da4b5eb-e0f6-4b50-aa92-e86dd94b4a09 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] 10.222.0.61 "GET /compute/v2.1/servers/d486e169-8a86-4fca-823a-ec822b829dcd" status: 200 len: 1516 microversion: 2.1 time: 0.106302 Aug 31 17:11:33.913837 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3867/7750] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:11:33 2022] GET /compute/v2.1/servers/d486e169-8a86-4fca-823a-ec822b829dcd => generated 1516 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 17:11:34.938001 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0261a516-fc54-46e6-93db-c98ec23ff182 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:11:34.938628 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0261a516-fc54-46e6-93db-c98ec23ff182 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] [instance: d486e169-8a86-4fca-823a-ec822b829dcd] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:11:34.944977 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0261a516-fc54-46e6-93db-c98ec23ff182 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:11:34.945481 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0261a516-fc54-46e6-93db-c98ec23ff182 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:11:34.945929 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0261a516-fc54-46e6-93db-c98ec23ff182 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:11:34.946634 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0261a516-fc54-46e6-93db-c98ec23ff182 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:11:34.947104 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0261a516-fc54-46e6-93db-c98ec23ff182 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:11:34.947569 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0261a516-fc54-46e6-93db-c98ec23ff182 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:11:34.960901 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-0261a516-fc54-46e6-93db-c98ec23ff182 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] HTTP exception thrown: Instance d486e169-8a86-4fca-823a-ec822b829dcd could not be found. Aug 31 17:11:34.962557 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0261a516-fc54-46e6-93db-c98ec23ff182 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Request method failure captured: Aug 31 17:11:34.962557 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/d486e169-8a86-4fca-823a-ec822b829dcd HTTP/1.1 Aug 31 17:11:34.962557 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 17:11:34.962557 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 17:11:34.962557 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 17:11:34.962557 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 17:11:34.962557 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 17:11:34.962557 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 17:11:34.962557 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 17:11:34.962557 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 17:11:34.962557 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD5XRkdZ__uT4Z9QcRA2ruMK4v78lmsJYIj7UIC254LgiJAezvVopDuetEwbUVXmx0M_IqOldthIYIwPRcNmNz9iqFIiI5pMYxdU-aX5gitLtW4a4zzYflv9ko-bqp9QqhD_5_7O6o69C5yaFtbo4npzEN3wDxeP3Mn8TVuhk7Hg1HXY Aug 31 17:11:34.962557 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 17:11:34.962557 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 17:11:34.962557 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 17:11:34.962557 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 17:11:34.962557 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 17:11:34.962557 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 17:11:34.962557 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: dc8f33c33f1f43319c2e92431394bcd5 Aug 31 17:11:34.962557 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-TestEncryptedCinderVolumes-828494074 Aug 31 17:11:34.962557 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 17:11:34.962557 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 17:11:34.962557 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/dc8f33c33f1f43319c2e92431394bcd5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/dc8f33c33f1f43319c2e92431394bcd5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_dc8f33c33f1f43319c2e92431394bcd5", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/dc8f33c33f1f43319c2e92431394bcd5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 17:11:34.962557 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-TestEncryptedCinderVolumes-828494074 Aug 31 17:11:34.962557 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: dc8f33c33f1f43319c2e92431394bcd5 Aug 31 17:11:34.962557 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-828494074 Aug 31 17:11:34.962557 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-TestEncryptedCinderVolumes-828494074-project Aug 31 17:11:34.962557 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 17:11:34.962557 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 17:11:34.962557 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 4fea615ea5074760833d02cf7e7b9fd5 Aug 31 17:11:34.962557 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-TestEncryptedCinderVolumes-828494074-project Aug 31 17:11:34.962557 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 17:11:34.962557 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance d486e169-8a86-4fca-823a-ec822b829dcd could not be found. Aug 31 17:11:34.962557 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': 'd486e169-8a86-4fca-823a-ec822b829dcd'} Aug 31 17:11:34.962557 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 17:11:34.962557 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:11:34.962557 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 17:11:34.962557 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 17:11:34.962557 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 17:11:34.962557 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 17:11:34.962557 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 17:11:34.962557 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 17:11:34.962557 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 17:11:34.962557 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 17:11:34.962557 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d486e169-8a86-4fca-823a-ec822b829dcd could not be found. Aug 31 17:11:34.962557 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 17:11:34.962557 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:11:34.962557 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 17:11:34.962557 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:11:34.962557 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:11:34.962557 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:11:34.962557 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 17:11:34.962557 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 17:11:34.962557 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 17:11:34.962557 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 17:11:34.962557 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 17:11:34.962557 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 17:11:34.962557 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 17:11:34.962557 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 17:11:34.962557 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 17:11:34.962557 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 17:11:34.962557 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d486e169-8a86-4fca-823a-ec822b829dcd could not be found. Aug 31 17:11:34.962557 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 17:11:34.962557 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:11:34.962557 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 17:11:34.969379 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:11:34.969379 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:11:34.969379 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:11:34.969379 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 17:11:34.969379 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 17:11:34.969379 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d486e169-8a86-4fca-823a-ec822b829dcd could not be found. Aug 31 17:11:34.969379 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 17:11:34.969379 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0261a516-fc54-46e6-93db-c98ec23ff182 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Returning 404 to user: Instance d486e169-8a86-4fca-823a-ec822b829dcd could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 17:11:34.969379 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0261a516-fc54-46e6-93db-c98ec23ff182 tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] 10.222.0.61 "GET /compute/v2.1/servers/d486e169-8a86-4fca-823a-ec822b829dcd" status: 404 len: 111 microversion: 2.1 time: 0.031233 Aug 31 17:11:34.969379 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3884/7751] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:11:34 2022] GET /compute/v2.1/servers/d486e169-8a86-4fca-823a-ec822b829dcd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 17:11:34.973817 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3b788e0a-ba38-4b32-b5f7-d40452fdc34d tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] Calling method '.version_select at 0x7f5ae3e77af0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:11:34.993714 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3b788e0a-ba38-4b32-b5f7-d40452fdc34d tempest-TestEncryptedCinderVolumes-828494074 tempest-TestEncryptedCinderVolumes-828494074-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-696312881" status: 202 len: 0 microversion: 2.1 time: 0.024631 Aug 31 17:11:34.994291 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3868/7752] 10.222.0.61 () {58 vars in 1275 bytes} [Wed Aug 31 17:11:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-696312881 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 17:12:02.386038 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2b3fd6cd-5fde-4a8d-bd33-c6ed7c417c08 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Action: 'create', calling method: .version_select at 0x7f5ae3adb8b0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1391467875", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCaAwJhGdVfiMkYflEJxjKUoZcqnpK8bNBKDe3MsVpzOsc9SZtMUwxfjas9k2lXJ2aP4tERAaLqC4cW2VEsQlX3cfbGCm3Fx24cayBH1Ti/tzDl83N0L5agL+Yb7j4ZWKg=="}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:12:02.393504 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=14 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:12:02.394271 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=34 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:12:02.409864 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-2b3fd6cd-5fde-4a8d-bd33-c6ed7c417c08 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Getting quotas for project 880c2f00b7ee4da0a2b8ad7de99e5cb2. Resources: {'key_pairs'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 17:12:02.415020 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-2b3fd6cd-5fde-4a8d-bd33-c6ed7c417c08 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Getting quotas for user 415f3980641e47aa83029a3d94a5d905 and project 880c2f00b7ee4da0a2b8ad7de99e5cb2. Resources: {'key_pairs'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 17:12:02.439271 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2b3fd6cd-5fde-4a8d-bd33-c6ed7c417c08 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.056991 Aug 31 17:12:02.439934 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3885/7753] 10.222.0.61 () {60 vars in 1159 bytes} [Wed Aug 31 17:12:02 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:12:02.488806 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=53,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:12:02.489554 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:12:02.494098 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-288b5d7b-9d98-48ca-ab19-d484a196344d tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2038099985", "imageRef": "98d9860e-175f-4ed2-b676-af14a90f03d2", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1391467875", "networks": [{"uuid": "9e9abe02-83e9-4384-aa3b-d466f6328e87"}]}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:12:02.549171 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-288b5d7b-9d98-48ca-ab19-d484a196344d tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] validate_networks() for [('9e9abe02-83e9-4384-aa3b-d466f6328e87', None, None, None, None, None)] {{(pid=122256) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 17:12:02.940087 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-288b5d7b-9d98-48ca-ab19-d484a196344d tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 17:12:02.940511 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-288b5d7b-9d98-48ca-ab19-d484a196344d tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 17:12:02.940987 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-288b5d7b-9d98-48ca-ab19-d484a196344d tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 17:12:02.941394 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-288b5d7b-9d98-48ca-ab19-d484a196344d tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 17:12:02.941804 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-288b5d7b-9d98-48ca-ab19-d484a196344d tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 17:12:02.950666 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-288b5d7b-9d98-48ca-ab19-d484a196344d tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:12:02.951149 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-288b5d7b-9d98-48ca-ab19-d484a196344d tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:12:02.951627 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-288b5d7b-9d98-48ca-ab19-d484a196344d tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:12:02.952352 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-288b5d7b-9d98-48ca-ab19-d484a196344d tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:12:02.952812 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-288b5d7b-9d98-48ca-ab19-d484a196344d tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:12:02.953237 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-288b5d7b-9d98-48ca-ab19-d484a196344d tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:12:02.971249 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-288b5d7b-9d98-48ca-ab19-d484a196344d tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Getting quotas for project 880c2f00b7ee4da0a2b8ad7de99e5cb2. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 17:12:02.976587 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-288b5d7b-9d98-48ca-ab19-d484a196344d tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Getting quotas for user 415f3980641e47aa83029a3d94a5d905 and project 880c2f00b7ee4da0a2b8ad7de99e5cb2. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 17:12:02.988666 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-288b5d7b-9d98-48ca-ab19-d484a196344d tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Going to run 1 instances... {{(pid=122256) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 17:12:02.990875 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-288b5d7b-9d98-48ca-ab19-d484a196344d tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] [instance: c1e5f5df-5d66-4439-90eb-bf181c2009f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='98d9860e-175f-4ed2-b676-af14a90f03d2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 17:12:03.037931 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-288b5d7b-9d98-48ca-ab19-d484a196344d tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.551079 Aug 31 17:12:03.038797 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3869/7754] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 17:12:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 553 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 17:12:03.049378 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-84bd7e1c-e419-42cb-98d2-33efaf826131 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:12:03.050003 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-84bd7e1c-e419-42cb-98d2-33efaf826131 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] [instance: c1e5f5df-5d66-4439-90eb-bf181c2009f8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:12:03.106477 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-84bd7e1c-e419-42cb-98d2-33efaf826131 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f3980641e47aa83029a3d94a5d905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880c2f00b7ee4da0a2b8ad7de99e5cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:12:03.113581 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-84bd7e1c-e419-42cb-98d2-33efaf826131 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] 10.222.0.61 "GET /compute/v2.1/servers/c1e5f5df-5d66-4439-90eb-bf181c2009f8" status: 200 len: 1259 microversion: 2.1 time: 0.068182 Aug 31 17:12:03.114175 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3886/7755] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:12:03 2022] GET /compute/v2.1/servers/c1e5f5df-5d66-4439-90eb-bf181c2009f8 => generated 1259 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:12:04.135384 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b9ac19c4-5db1-4c0d-bfd4-178966173215 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:12:04.136052 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b9ac19c4-5db1-4c0d-bfd4-178966173215 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] [instance: c1e5f5df-5d66-4439-90eb-bf181c2009f8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:12:04.143387 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b9ac19c4-5db1-4c0d-bfd4-178966173215 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:12:04.143914 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b9ac19c4-5db1-4c0d-bfd4-178966173215 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:12:04.144363 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b9ac19c4-5db1-4c0d-bfd4-178966173215 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:12:04.145065 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b9ac19c4-5db1-4c0d-bfd4-178966173215 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:12:04.146105 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b9ac19c4-5db1-4c0d-bfd4-178966173215 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:12:04.146669 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b9ac19c4-5db1-4c0d-bfd4-178966173215 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:12:04.238743 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b9ac19c4-5db1-4c0d-bfd4-178966173215 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f3980641e47aa83029a3d94a5d905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880c2f00b7ee4da0a2b8ad7de99e5cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:12:04.246691 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b9ac19c4-5db1-4c0d-bfd4-178966173215 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] 10.222.0.61 "GET /compute/v2.1/servers/c1e5f5df-5d66-4439-90eb-bf181c2009f8" status: 200 len: 1319 microversion: 2.1 time: 0.116140 Aug 31 17:12:04.247630 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3870/7756] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:12:04 2022] GET /compute/v2.1/servers/c1e5f5df-5d66-4439-90eb-bf181c2009f8 => generated 1319 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:12:05.271742 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0af8db00-dba6-4837-9ce4-85322cf46df5 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:12:05.273010 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0af8db00-dba6-4837-9ce4-85322cf46df5 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] [instance: c1e5f5df-5d66-4439-90eb-bf181c2009f8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:12:05.303928 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0af8db00-dba6-4837-9ce4-85322cf46df5 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:12:05.304712 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0af8db00-dba6-4837-9ce4-85322cf46df5 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:12:05.305390 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0af8db00-dba6-4837-9ce4-85322cf46df5 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:12:05.307484 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0af8db00-dba6-4837-9ce4-85322cf46df5 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:12:05.308224 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0af8db00-dba6-4837-9ce4-85322cf46df5 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:12:05.308830 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0af8db00-dba6-4837-9ce4-85322cf46df5 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:12:05.566280 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0af8db00-dba6-4837-9ce4-85322cf46df5 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f3980641e47aa83029a3d94a5d905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880c2f00b7ee4da0a2b8ad7de99e5cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:12:05.575080 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0af8db00-dba6-4837-9ce4-85322cf46df5 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] 10.222.0.61 "GET /compute/v2.1/servers/c1e5f5df-5d66-4439-90eb-bf181c2009f8" status: 200 len: 1359 microversion: 2.1 time: 0.311326 Aug 31 17:12:05.588326 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3887/7757] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:12:05 2022] GET /compute/v2.1/servers/c1e5f5df-5d66-4439-90eb-bf181c2009f8 => generated 1359 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:12:06.599293 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6d2dd448-c2a1-499a-92d4-adc7f763ea5a tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:12:06.600416 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6d2dd448-c2a1-499a-92d4-adc7f763ea5a tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] [instance: c1e5f5df-5d66-4439-90eb-bf181c2009f8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:12:06.607717 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6d2dd448-c2a1-499a-92d4-adc7f763ea5a tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:12:06.608310 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6d2dd448-c2a1-499a-92d4-adc7f763ea5a tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:12:06.608837 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6d2dd448-c2a1-499a-92d4-adc7f763ea5a tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:12:06.610158 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6d2dd448-c2a1-499a-92d4-adc7f763ea5a tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:12:06.611057 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6d2dd448-c2a1-499a-92d4-adc7f763ea5a tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:12:06.612220 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6d2dd448-c2a1-499a-92d4-adc7f763ea5a tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:12:06.766602 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-6d2dd448-c2a1-499a-92d4-adc7f763ea5a tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f3980641e47aa83029a3d94a5d905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880c2f00b7ee4da0a2b8ad7de99e5cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:12:06.775253 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6d2dd448-c2a1-499a-92d4-adc7f763ea5a tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] 10.222.0.61 "GET /compute/v2.1/servers/c1e5f5df-5d66-4439-90eb-bf181c2009f8" status: 200 len: 1359 microversion: 2.1 time: 0.180610 Aug 31 17:12:06.779605 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3871/7758] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:12:06 2022] GET /compute/v2.1/servers/c1e5f5df-5d66-4439-90eb-bf181c2009f8 => generated 1359 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:12:07.800920 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7ab75fda-38f3-4698-99a2-b230074162e5 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:12:07.802485 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7ab75fda-38f3-4698-99a2-b230074162e5 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] [instance: c1e5f5df-5d66-4439-90eb-bf181c2009f8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:12:07.811770 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7ab75fda-38f3-4698-99a2-b230074162e5 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:12:07.812760 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7ab75fda-38f3-4698-99a2-b230074162e5 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:12:07.813967 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7ab75fda-38f3-4698-99a2-b230074162e5 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:12:07.815395 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7ab75fda-38f3-4698-99a2-b230074162e5 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:12:07.816419 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7ab75fda-38f3-4698-99a2-b230074162e5 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:12:07.817331 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7ab75fda-38f3-4698-99a2-b230074162e5 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:12:07.970932 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7ab75fda-38f3-4698-99a2-b230074162e5 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f3980641e47aa83029a3d94a5d905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880c2f00b7ee4da0a2b8ad7de99e5cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:12:07.980939 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7ab75fda-38f3-4698-99a2-b230074162e5 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] 10.222.0.61 "GET /compute/v2.1/servers/c1e5f5df-5d66-4439-90eb-bf181c2009f8" status: 200 len: 1359 microversion: 2.1 time: 0.186052 Aug 31 17:12:07.991720 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3888/7759] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:12:07 2022] GET /compute/v2.1/servers/c1e5f5df-5d66-4439-90eb-bf181c2009f8 => generated 1359 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:12:09.003344 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-77b222f3-583a-457e-a2bb-a46e7722421a tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:12:09.004005 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-77b222f3-583a-457e-a2bb-a46e7722421a tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] [instance: c1e5f5df-5d66-4439-90eb-bf181c2009f8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:12:09.011025 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-77b222f3-583a-457e-a2bb-a46e7722421a tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:12:09.011544 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-77b222f3-583a-457e-a2bb-a46e7722421a tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:12:09.011998 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-77b222f3-583a-457e-a2bb-a46e7722421a tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:12:09.012711 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-77b222f3-583a-457e-a2bb-a46e7722421a tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:12:09.013183 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-77b222f3-583a-457e-a2bb-a46e7722421a tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:12:09.013622 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-77b222f3-583a-457e-a2bb-a46e7722421a tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:12:09.163299 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-77b222f3-583a-457e-a2bb-a46e7722421a tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f3980641e47aa83029a3d94a5d905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880c2f00b7ee4da0a2b8ad7de99e5cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:12:09.171526 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-77b222f3-583a-457e-a2bb-a46e7722421a tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] 10.222.0.61 "GET /compute/v2.1/servers/c1e5f5df-5d66-4439-90eb-bf181c2009f8" status: 200 len: 1359 microversion: 2.1 time: 0.172857 Aug 31 17:12:09.172223 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3872/7760] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:12:08 2022] GET /compute/v2.1/servers/c1e5f5df-5d66-4439-90eb-bf181c2009f8 => generated 1359 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:12:10.194750 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d9faffa4-ec72-4463-9ddd-5c051d357328 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:12:10.195960 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d9faffa4-ec72-4463-9ddd-5c051d357328 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] [instance: c1e5f5df-5d66-4439-90eb-bf181c2009f8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:12:10.207240 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d9faffa4-ec72-4463-9ddd-5c051d357328 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:12:10.207848 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d9faffa4-ec72-4463-9ddd-5c051d357328 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:12:10.208307 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d9faffa4-ec72-4463-9ddd-5c051d357328 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:12:10.209041 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d9faffa4-ec72-4463-9ddd-5c051d357328 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:12:10.209518 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d9faffa4-ec72-4463-9ddd-5c051d357328 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:12:10.209968 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d9faffa4-ec72-4463-9ddd-5c051d357328 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:12:10.362732 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d9faffa4-ec72-4463-9ddd-5c051d357328 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f3980641e47aa83029a3d94a5d905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880c2f00b7ee4da0a2b8ad7de99e5cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:12:10.373050 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d9faffa4-ec72-4463-9ddd-5c051d357328 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] 10.222.0.61 "GET /compute/v2.1/servers/c1e5f5df-5d66-4439-90eb-bf181c2009f8" status: 200 len: 1359 microversion: 2.1 time: 0.185385 Aug 31 17:12:10.373642 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3889/7761] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:12:10 2022] GET /compute/v2.1/servers/c1e5f5df-5d66-4439-90eb-bf181c2009f8 => generated 1359 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:12:11.395037 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a14d22c4-aa4e-48ab-99e6-4d8bc1385a91 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:12:11.395871 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a14d22c4-aa4e-48ab-99e6-4d8bc1385a91 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] [instance: c1e5f5df-5d66-4439-90eb-bf181c2009f8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:12:11.402956 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a14d22c4-aa4e-48ab-99e6-4d8bc1385a91 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:12:11.403448 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a14d22c4-aa4e-48ab-99e6-4d8bc1385a91 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:12:11.403915 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a14d22c4-aa4e-48ab-99e6-4d8bc1385a91 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:12:11.404626 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a14d22c4-aa4e-48ab-99e6-4d8bc1385a91 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:12:11.405080 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a14d22c4-aa4e-48ab-99e6-4d8bc1385a91 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:12:11.405528 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a14d22c4-aa4e-48ab-99e6-4d8bc1385a91 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:12:11.544673 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a14d22c4-aa4e-48ab-99e6-4d8bc1385a91 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f3980641e47aa83029a3d94a5d905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880c2f00b7ee4da0a2b8ad7de99e5cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:12:11.553234 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a14d22c4-aa4e-48ab-99e6-4d8bc1385a91 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] 10.222.0.61 "GET /compute/v2.1/servers/c1e5f5df-5d66-4439-90eb-bf181c2009f8" status: 200 len: 1359 microversion: 2.1 time: 0.162804 Aug 31 17:12:11.553805 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3873/7762] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:12:11 2022] GET /compute/v2.1/servers/c1e5f5df-5d66-4439-90eb-bf181c2009f8 => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:12:12.574174 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7bc7cbb6-7d5c-48e8-8fa2-4d3234e0d97d tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:12:12.574808 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7bc7cbb6-7d5c-48e8-8fa2-4d3234e0d97d tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] [instance: c1e5f5df-5d66-4439-90eb-bf181c2009f8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:12:12.583045 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7bc7cbb6-7d5c-48e8-8fa2-4d3234e0d97d tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:12:12.583576 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7bc7cbb6-7d5c-48e8-8fa2-4d3234e0d97d tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:12:12.584034 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7bc7cbb6-7d5c-48e8-8fa2-4d3234e0d97d tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:12:12.584751 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7bc7cbb6-7d5c-48e8-8fa2-4d3234e0d97d tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:12:12.585225 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7bc7cbb6-7d5c-48e8-8fa2-4d3234e0d97d tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:12:12.585670 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7bc7cbb6-7d5c-48e8-8fa2-4d3234e0d97d tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:12:12.718413 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7bc7cbb6-7d5c-48e8-8fa2-4d3234e0d97d tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f3980641e47aa83029a3d94a5d905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880c2f00b7ee4da0a2b8ad7de99e5cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:12:12.727733 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7bc7cbb6-7d5c-48e8-8fa2-4d3234e0d97d tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] 10.222.0.61 "GET /compute/v2.1/servers/c1e5f5df-5d66-4439-90eb-bf181c2009f8" status: 200 len: 1359 microversion: 2.1 time: 0.157316 Aug 31 17:12:12.728759 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3890/7763] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:12:12 2022] GET /compute/v2.1/servers/c1e5f5df-5d66-4439-90eb-bf181c2009f8 => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 17:12:13.750457 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ccf3c81e-f856-4b4c-82fb-45b731a281b3 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:12:13.751015 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ccf3c81e-f856-4b4c-82fb-45b731a281b3 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] [instance: c1e5f5df-5d66-4439-90eb-bf181c2009f8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:12:13.755362 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:12:13.756290 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=6 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:12:13.763194 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ccf3c81e-f856-4b4c-82fb-45b731a281b3 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:12:13.763718 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ccf3c81e-f856-4b4c-82fb-45b731a281b3 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:12:13.764167 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ccf3c81e-f856-4b4c-82fb-45b731a281b3 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:12:13.764878 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ccf3c81e-f856-4b4c-82fb-45b731a281b3 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:12:13.765344 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ccf3c81e-f856-4b4c-82fb-45b731a281b3 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:12:13.765782 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ccf3c81e-f856-4b4c-82fb-45b731a281b3 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:12:13.903738 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ccf3c81e-f856-4b4c-82fb-45b731a281b3 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f3980641e47aa83029a3d94a5d905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880c2f00b7ee4da0a2b8ad7de99e5cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:12:13.911839 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ccf3c81e-f856-4b4c-82fb-45b731a281b3 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] 10.222.0.61 "GET /compute/v2.1/servers/c1e5f5df-5d66-4439-90eb-bf181c2009f8" status: 200 len: 1359 microversion: 2.1 time: 0.165344 Aug 31 17:12:13.912426 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3874/7764] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:12:13 2022] GET /compute/v2.1/servers/c1e5f5df-5d66-4439-90eb-bf181c2009f8 => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:12:14.932624 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4e419fc4-5759-4a27-a7a8-4401db1d3097 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:12:14.933262 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4e419fc4-5759-4a27-a7a8-4401db1d3097 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] [instance: c1e5f5df-5d66-4439-90eb-bf181c2009f8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:12:14.935159 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=6 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:12:14.941477 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4e419fc4-5759-4a27-a7a8-4401db1d3097 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:12:14.942017 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4e419fc4-5759-4a27-a7a8-4401db1d3097 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:12:14.942489 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4e419fc4-5759-4a27-a7a8-4401db1d3097 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:12:14.943214 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4e419fc4-5759-4a27-a7a8-4401db1d3097 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:12:14.943731 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4e419fc4-5759-4a27-a7a8-4401db1d3097 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:12:14.944301 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4e419fc4-5759-4a27-a7a8-4401db1d3097 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:12:15.079472 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-4e419fc4-5759-4a27-a7a8-4401db1d3097 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f3980641e47aa83029a3d94a5d905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880c2f00b7ee4da0a2b8ad7de99e5cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:12:15.087850 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4e419fc4-5759-4a27-a7a8-4401db1d3097 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] 10.222.0.61 "GET /compute/v2.1/servers/c1e5f5df-5d66-4439-90eb-bf181c2009f8" status: 200 len: 1359 microversion: 2.1 time: 0.159209 Aug 31 17:12:15.088442 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3891/7765] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:12:14 2022] GET /compute/v2.1/servers/c1e5f5df-5d66-4439-90eb-bf181c2009f8 => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:12:16.037293 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-9209d59e-5f4c-43bc-abf7-8713a656b530 req-4c1b340a-08b9-41e1-b6a3-22e7af455931 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1e5f5df-5d66-4439-90eb-bf181c2009f8", "tag": "3fc3c70f-deeb-4f86-9471-d678e327228b"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:12:16.048620 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-9209d59e-5f4c-43bc-abf7-8713a656b530 req-4c1b340a-08b9-41e1-b6a3-22e7af455931 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:12:16.049058 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-9209d59e-5f4c-43bc-abf7-8713a656b530 req-4c1b340a-08b9-41e1-b6a3-22e7af455931 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:12:16.049499 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-9209d59e-5f4c-43bc-abf7-8713a656b530 req-4c1b340a-08b9-41e1-b6a3-22e7af455931 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:12:16.061821 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-9209d59e-5f4c-43bc-abf7-8713a656b530 req-4c1b340a-08b9-41e1-b6a3-22e7af455931 service nova] Creating event network-changed:3fc3c70f-deeb-4f86-9471-d678e327228b for instance c1e5f5df-5d66-4439-90eb-bf181c2009f8 on n-h2-850499-9 Aug 31 17:12:16.067270 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-9209d59e-5f4c-43bc-abf7-8713a656b530 req-4c1b340a-08b9-41e1-b6a3-22e7af455931 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035479 Aug 31 17:12:16.068081 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3875/7766] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:12:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:12:16.108528 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-acad3f68-5ede-4965-9694-b0b40eaa3ed5 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:12:16.109170 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-acad3f68-5ede-4965-9694-b0b40eaa3ed5 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] [instance: c1e5f5df-5d66-4439-90eb-bf181c2009f8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:12:16.117135 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-acad3f68-5ede-4965-9694-b0b40eaa3ed5 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:12:16.117644 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-acad3f68-5ede-4965-9694-b0b40eaa3ed5 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:12:16.118107 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-acad3f68-5ede-4965-9694-b0b40eaa3ed5 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:12:16.118829 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-acad3f68-5ede-4965-9694-b0b40eaa3ed5 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:12:16.119312 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-acad3f68-5ede-4965-9694-b0b40eaa3ed5 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:12:16.119888 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-acad3f68-5ede-4965-9694-b0b40eaa3ed5 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:12:16.660804 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-acad3f68-5ede-4965-9694-b0b40eaa3ed5 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f3980641e47aa83029a3d94a5d905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880c2f00b7ee4da0a2b8ad7de99e5cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:12:16.668572 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-acad3f68-5ede-4965-9694-b0b40eaa3ed5 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] 10.222.0.61 "GET /compute/v2.1/servers/c1e5f5df-5d66-4439-90eb-bf181c2009f8" status: 200 len: 1359 microversion: 2.1 time: 0.563980 Aug 31 17:12:16.669175 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3892/7767] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:12:16 2022] GET /compute/v2.1/servers/c1e5f5df-5d66-4439-90eb-bf181c2009f8 => generated 1359 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:12:17.690428 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8f98c470-ccfe-48b6-90d3-4d8982238595 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:12:17.691950 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8f98c470-ccfe-48b6-90d3-4d8982238595 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] [instance: c1e5f5df-5d66-4439-90eb-bf181c2009f8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:12:17.699605 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8f98c470-ccfe-48b6-90d3-4d8982238595 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:12:17.700102 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8f98c470-ccfe-48b6-90d3-4d8982238595 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:12:17.700550 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8f98c470-ccfe-48b6-90d3-4d8982238595 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:12:17.701253 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8f98c470-ccfe-48b6-90d3-4d8982238595 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:12:17.701717 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8f98c470-ccfe-48b6-90d3-4d8982238595 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:12:17.702152 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8f98c470-ccfe-48b6-90d3-4d8982238595 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:12:17.836580 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8f98c470-ccfe-48b6-90d3-4d8982238595 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f3980641e47aa83029a3d94a5d905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880c2f00b7ee4da0a2b8ad7de99e5cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:12:17.844446 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8f98c470-ccfe-48b6-90d3-4d8982238595 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] 10.222.0.61 "GET /compute/v2.1/servers/c1e5f5df-5d66-4439-90eb-bf181c2009f8" status: 200 len: 1359 microversion: 2.1 time: 0.158372 Aug 31 17:12:17.845035 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3876/7768] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:12:17 2022] GET /compute/v2.1/servers/c1e5f5df-5d66-4439-90eb-bf181c2009f8 => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:12:18.866410 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-58c3ae6a-1025-4c57-b197-938083308202 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:12:18.867042 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-58c3ae6a-1025-4c57-b197-938083308202 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] [instance: c1e5f5df-5d66-4439-90eb-bf181c2009f8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:12:18.873111 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-58c3ae6a-1025-4c57-b197-938083308202 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:12:18.873609 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-58c3ae6a-1025-4c57-b197-938083308202 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:12:18.874060 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-58c3ae6a-1025-4c57-b197-938083308202 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:12:18.874765 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-58c3ae6a-1025-4c57-b197-938083308202 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:12:18.875236 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-58c3ae6a-1025-4c57-b197-938083308202 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:12:18.875703 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-58c3ae6a-1025-4c57-b197-938083308202 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:12:19.009734 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-58c3ae6a-1025-4c57-b197-938083308202 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f3980641e47aa83029a3d94a5d905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880c2f00b7ee4da0a2b8ad7de99e5cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:12:19.017400 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-58c3ae6a-1025-4c57-b197-938083308202 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] 10.222.0.61 "GET /compute/v2.1/servers/c1e5f5df-5d66-4439-90eb-bf181c2009f8" status: 200 len: 1359 microversion: 2.1 time: 0.155514 Aug 31 17:12:19.017976 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3893/7769] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:12:18 2022] GET /compute/v2.1/servers/c1e5f5df-5d66-4439-90eb-bf181c2009f8 => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:12:20.039473 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-90e51284-ae37-499b-887e-5343b9c53f65 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:12:20.040130 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-90e51284-ae37-499b-887e-5343b9c53f65 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] [instance: c1e5f5df-5d66-4439-90eb-bf181c2009f8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:12:20.047034 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-90e51284-ae37-499b-887e-5343b9c53f65 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:12:20.047559 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-90e51284-ae37-499b-887e-5343b9c53f65 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:12:20.048012 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-90e51284-ae37-499b-887e-5343b9c53f65 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:12:20.048716 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-90e51284-ae37-499b-887e-5343b9c53f65 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:12:20.049180 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-90e51284-ae37-499b-887e-5343b9c53f65 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:12:20.049616 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-90e51284-ae37-499b-887e-5343b9c53f65 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:12:20.184134 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-90e51284-ae37-499b-887e-5343b9c53f65 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f3980641e47aa83029a3d94a5d905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880c2f00b7ee4da0a2b8ad7de99e5cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:12:20.192794 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-90e51284-ae37-499b-887e-5343b9c53f65 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] 10.222.0.61 "GET /compute/v2.1/servers/c1e5f5df-5d66-4439-90eb-bf181c2009f8" status: 200 len: 1359 microversion: 2.1 time: 0.157251 Aug 31 17:12:20.193755 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3877/7770] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:12:20 2022] GET /compute/v2.1/servers/c1e5f5df-5d66-4439-90eb-bf181c2009f8 => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:12:21.213955 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-cd7bd37c-0811-4cfa-9e00-808b2db14187 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:12:21.214501 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-cd7bd37c-0811-4cfa-9e00-808b2db14187 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] [instance: c1e5f5df-5d66-4439-90eb-bf181c2009f8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:12:21.221605 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cd7bd37c-0811-4cfa-9e00-808b2db14187 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:12:21.222117 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cd7bd37c-0811-4cfa-9e00-808b2db14187 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:12:21.222932 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cd7bd37c-0811-4cfa-9e00-808b2db14187 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:12:21.223437 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cd7bd37c-0811-4cfa-9e00-808b2db14187 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:12:21.223961 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cd7bd37c-0811-4cfa-9e00-808b2db14187 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:12:21.224390 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cd7bd37c-0811-4cfa-9e00-808b2db14187 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:12:21.361993 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-cd7bd37c-0811-4cfa-9e00-808b2db14187 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f3980641e47aa83029a3d94a5d905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880c2f00b7ee4da0a2b8ad7de99e5cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:12:21.370382 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-cd7bd37c-0811-4cfa-9e00-808b2db14187 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] 10.222.0.61 "GET /compute/v2.1/servers/c1e5f5df-5d66-4439-90eb-bf181c2009f8" status: 200 len: 1359 microversion: 2.1 time: 0.160475 Aug 31 17:12:21.371064 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3894/7771] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:12:21 2022] GET /compute/v2.1/servers/c1e5f5df-5d66-4439-90eb-bf181c2009f8 => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:12:22.392581 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e4bfad2e-8ab5-4147-86a4-35560113943b tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:12:22.393207 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e4bfad2e-8ab5-4147-86a4-35560113943b tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] [instance: c1e5f5df-5d66-4439-90eb-bf181c2009f8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:12:22.400563 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e4bfad2e-8ab5-4147-86a4-35560113943b tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:12:22.401060 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e4bfad2e-8ab5-4147-86a4-35560113943b tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:12:22.401506 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e4bfad2e-8ab5-4147-86a4-35560113943b tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:12:22.402220 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e4bfad2e-8ab5-4147-86a4-35560113943b tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:12:22.402695 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e4bfad2e-8ab5-4147-86a4-35560113943b tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:12:22.403131 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e4bfad2e-8ab5-4147-86a4-35560113943b tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:12:22.545960 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e4bfad2e-8ab5-4147-86a4-35560113943b tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f3980641e47aa83029a3d94a5d905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880c2f00b7ee4da0a2b8ad7de99e5cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:12:22.553970 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e4bfad2e-8ab5-4147-86a4-35560113943b tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] 10.222.0.61 "GET /compute/v2.1/servers/c1e5f5df-5d66-4439-90eb-bf181c2009f8" status: 200 len: 1359 microversion: 2.1 time: 0.165296 Aug 31 17:12:22.554748 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3878/7772] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:12:22 2022] GET /compute/v2.1/servers/c1e5f5df-5d66-4439-90eb-bf181c2009f8 => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 17:12:23.569588 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-9f289c70-88b0-4e2f-b424-2f07e7fee86a req-cf67f941-a382-4ebc-b112-6e52d84b914c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1e5f5df-5d66-4439-90eb-bf181c2009f8", "name": "network-vif-plugged", "status": "completed", "tag": "3fc3c70f-deeb-4f86-9471-d678e327228b"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:12:23.575370 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-093ddbb9-6ec1-4326-8de6-05fe3ab97c38 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:12:23.576255 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-093ddbb9-6ec1-4326-8de6-05fe3ab97c38 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] [instance: c1e5f5df-5d66-4439-90eb-bf181c2009f8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:12:23.580435 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-9f289c70-88b0-4e2f-b424-2f07e7fee86a req-cf67f941-a382-4ebc-b112-6e52d84b914c service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:12:23.580947 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-9f289c70-88b0-4e2f-b424-2f07e7fee86a req-cf67f941-a382-4ebc-b112-6e52d84b914c service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:12:23.581400 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-9f289c70-88b0-4e2f-b424-2f07e7fee86a req-cf67f941-a382-4ebc-b112-6e52d84b914c service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:12:23.584476 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-093ddbb9-6ec1-4326-8de6-05fe3ab97c38 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:12:23.585204 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-093ddbb9-6ec1-4326-8de6-05fe3ab97c38 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:12:23.585721 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-093ddbb9-6ec1-4326-8de6-05fe3ab97c38 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:12:23.586551 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-093ddbb9-6ec1-4326-8de6-05fe3ab97c38 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:12:23.587081 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-093ddbb9-6ec1-4326-8de6-05fe3ab97c38 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:12:23.587673 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-093ddbb9-6ec1-4326-8de6-05fe3ab97c38 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:12:23.595314 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-9f289c70-88b0-4e2f-b424-2f07e7fee86a req-cf67f941-a382-4ebc-b112-6e52d84b914c service nova] Creating event network-vif-plugged:3fc3c70f-deeb-4f86-9471-d678e327228b for instance c1e5f5df-5d66-4439-90eb-bf181c2009f8 on n-h2-850499-9 Aug 31 17:12:23.603984 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-9f289c70-88b0-4e2f-b424-2f07e7fee86a req-cf67f941-a382-4ebc-b112-6e52d84b914c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038238 Aug 31 17:12:23.605525 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3895/7773] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:12:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:12:23.767221 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-093ddbb9-6ec1-4326-8de6-05fe3ab97c38 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f3980641e47aa83029a3d94a5d905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880c2f00b7ee4da0a2b8ad7de99e5cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:12:23.776195 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-093ddbb9-6ec1-4326-8de6-05fe3ab97c38 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] 10.222.0.61 "GET /compute/v2.1/servers/c1e5f5df-5d66-4439-90eb-bf181c2009f8" status: 200 len: 1359 microversion: 2.1 time: 0.204920 Aug 31 17:12:23.776816 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3879/7774] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:12:23 2022] GET /compute/v2.1/servers/c1e5f5df-5d66-4439-90eb-bf181c2009f8 => generated 1359 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 17:12:24.798312 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6ec978d0-afac-44c3-8b84-a55f6aea6025 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:12:24.799045 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6ec978d0-afac-44c3-8b84-a55f6aea6025 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] [instance: c1e5f5df-5d66-4439-90eb-bf181c2009f8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:12:24.806005 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6ec978d0-afac-44c3-8b84-a55f6aea6025 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:12:24.806518 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6ec978d0-afac-44c3-8b84-a55f6aea6025 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:12:24.806980 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6ec978d0-afac-44c3-8b84-a55f6aea6025 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:12:24.807728 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6ec978d0-afac-44c3-8b84-a55f6aea6025 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:12:24.808208 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6ec978d0-afac-44c3-8b84-a55f6aea6025 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:12:24.808656 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6ec978d0-afac-44c3-8b84-a55f6aea6025 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:12:24.947313 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-6ec978d0-afac-44c3-8b84-a55f6aea6025 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f3980641e47aa83029a3d94a5d905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880c2f00b7ee4da0a2b8ad7de99e5cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:12:24.955648 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6ec978d0-afac-44c3-8b84-a55f6aea6025 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] 10.222.0.61 "GET /compute/v2.1/servers/c1e5f5df-5d66-4439-90eb-bf181c2009f8" status: 200 len: 1359 microversion: 2.1 time: 0.162277 Aug 31 17:12:24.956864 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3896/7775] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:12:24 2022] GET /compute/v2.1/servers/c1e5f5df-5d66-4439-90eb-bf181c2009f8 => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:12:25.977249 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8daecc0e-9b81-48af-a26a-18891feb1d3e tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:12:25.977844 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8daecc0e-9b81-48af-a26a-18891feb1d3e tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] [instance: c1e5f5df-5d66-4439-90eb-bf181c2009f8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:12:25.985068 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8daecc0e-9b81-48af-a26a-18891feb1d3e tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:12:25.985561 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8daecc0e-9b81-48af-a26a-18891feb1d3e tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:12:25.986008 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8daecc0e-9b81-48af-a26a-18891feb1d3e tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:12:25.986718 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8daecc0e-9b81-48af-a26a-18891feb1d3e tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:12:25.987186 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8daecc0e-9b81-48af-a26a-18891feb1d3e tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:12:25.987685 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8daecc0e-9b81-48af-a26a-18891feb1d3e tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:12:26.125517 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8daecc0e-9b81-48af-a26a-18891feb1d3e tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f3980641e47aa83029a3d94a5d905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880c2f00b7ee4da0a2b8ad7de99e5cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:12:26.133958 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8daecc0e-9b81-48af-a26a-18891feb1d3e tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] 10.222.0.61 "GET /compute/v2.1/servers/c1e5f5df-5d66-4439-90eb-bf181c2009f8" status: 200 len: 1548 microversion: 2.1 time: 0.161101 Aug 31 17:12:26.134550 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3880/7776] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:12:25 2022] GET /compute/v2.1/servers/c1e5f5df-5d66-4439-90eb-bf181c2009f8 => generated 1548 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:12:26.157805 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5964d994-8e8c-4ae4-a525-a9d240cda2f4 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:12:26.158952 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5964d994-8e8c-4ae4-a525-a9d240cda2f4 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] [instance: c1e5f5df-5d66-4439-90eb-bf181c2009f8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:12:26.168258 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5964d994-8e8c-4ae4-a525-a9d240cda2f4 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:12:26.168769 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5964d994-8e8c-4ae4-a525-a9d240cda2f4 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:12:26.169302 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5964d994-8e8c-4ae4-a525-a9d240cda2f4 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:12:26.169952 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5964d994-8e8c-4ae4-a525-a9d240cda2f4 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:12:26.170427 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5964d994-8e8c-4ae4-a525-a9d240cda2f4 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:12:26.170871 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5964d994-8e8c-4ae4-a525-a9d240cda2f4 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:12:26.310039 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5964d994-8e8c-4ae4-a525-a9d240cda2f4 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f3980641e47aa83029a3d94a5d905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880c2f00b7ee4da0a2b8ad7de99e5cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:12:26.318044 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5964d994-8e8c-4ae4-a525-a9d240cda2f4 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] 10.222.0.61 "GET /compute/v2.1/servers/c1e5f5df-5d66-4439-90eb-bf181c2009f8" status: 200 len: 1548 microversion: 2.1 time: 0.166854 Aug 31 17:12:26.319364 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3897/7777] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:12:26 2022] GET /compute/v2.1/servers/c1e5f5df-5d66-4439-90eb-bf181c2009f8 => generated 1548 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:12:26.339330 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1924fbf6-24f5-4ffc-8a80-588184e14ae9 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:12:26.344178 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1924fbf6-24f5-4ffc-8a80-588184e14ae9 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '415f3980641e47aa83029a3d94a5d905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880c2f00b7ee4da0a2b8ad7de99e5cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:12:26.344948 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1924fbf6-24f5-4ffc-8a80-588184e14ae9 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Searching by: {'deleted': False, 'project_id': '880c2f00b7ee4da0a2b8ad7de99e5cb2'} {{(pid=122256) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 17:12:26.351403 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1924fbf6-24f5-4ffc-8a80-588184e14ae9 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:12:26.351929 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1924fbf6-24f5-4ffc-8a80-588184e14ae9 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:12:26.352371 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1924fbf6-24f5-4ffc-8a80-588184e14ae9 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:12:26.353106 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1924fbf6-24f5-4ffc-8a80-588184e14ae9 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:12:26.353569 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1924fbf6-24f5-4ffc-8a80-588184e14ae9 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:12:26.354004 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1924fbf6-24f5-4ffc-8a80-588184e14ae9 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:12:26.379394 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.multi_cell_list [None req-1924fbf6-24f5-4ffc-8a80-588184e14ae9 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122256) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 31 17:12:26.408960 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1924fbf6-24f5-4ffc-8a80-588184e14ae9 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] 10.222.0.61 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.073381 Aug 31 17:12:26.409553 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3881/7778] 10.222.0.61 () {58 vars in 1125 bytes} [Wed Aug 31 17:12:26 2022] GET /compute/v2.1/servers => generated 343 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:12:26.421415 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-100cc025-78dc-474d-9810-d65f509795e5 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:12:26.422039 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-100cc025-78dc-474d-9810-d65f509795e5 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] [instance: c1e5f5df-5d66-4439-90eb-bf181c2009f8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:12:26.428728 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-100cc025-78dc-474d-9810-d65f509795e5 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:12:26.429224 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-100cc025-78dc-474d-9810-d65f509795e5 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:12:26.429674 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-100cc025-78dc-474d-9810-d65f509795e5 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:12:26.430375 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-100cc025-78dc-474d-9810-d65f509795e5 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:12:26.430845 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-100cc025-78dc-474d-9810-d65f509795e5 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:12:26.431284 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-100cc025-78dc-474d-9810-d65f509795e5 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:12:26.567126 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-100cc025-78dc-474d-9810-d65f509795e5 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f3980641e47aa83029a3d94a5d905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880c2f00b7ee4da0a2b8ad7de99e5cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:12:26.575168 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-100cc025-78dc-474d-9810-d65f509795e5 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] 10.222.0.61 "GET /compute/v2.1/servers/c1e5f5df-5d66-4439-90eb-bf181c2009f8" status: 200 len: 1548 microversion: 2.1 time: 0.157727 Aug 31 17:12:26.575781 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3898/7779] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:12:26 2022] GET /compute/v2.1/servers/c1e5f5df-5d66-4439-90eb-bf181c2009f8 => generated 1548 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:12:28.134562 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1d0f1d3c-1a48-4166-bf8c-001856298416 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3fa14aa3-e7d8-420c-8646-0a78d8ad019e"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:12:28.136950 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1d0f1d3c-1a48-4166-bf8c-001856298416 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] [instance: c1e5f5df-5d66-4439-90eb-bf181c2009f8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:12:28.143802 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1d0f1d3c-1a48-4166-bf8c-001856298416 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:12:28.144288 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1d0f1d3c-1a48-4166-bf8c-001856298416 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:12:28.144727 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1d0f1d3c-1a48-4166-bf8c-001856298416 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:12:28.145419 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1d0f1d3c-1a48-4166-bf8c-001856298416 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:12:28.145876 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1d0f1d3c-1a48-4166-bf8c-001856298416 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:12:28.146343 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1d0f1d3c-1a48-4166-bf8c-001856298416 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:12:28.418557 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1d0f1d3c-1a48-4166-bf8c-001856298416 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] 10.222.0.61 "POST /compute/v2.1/servers/c1e5f5df-5d66-4439-90eb-bf181c2009f8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.287758 Aug 31 17:12:28.419405 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3882/7780] 10.222.0.61 () {60 vars in 1323 bytes} [Wed Aug 31 17:12:28 2022] POST /compute/v2.1/servers/c1e5f5df-5d66-4439-90eb-bf181c2009f8/os-volume_attachments => generated 194 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:12:41.487292 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-df68eaae-7225-4e14-91fe-51f37a6cfb2e tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:12:41.487947 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-df68eaae-7225-4e14-91fe-51f37a6cfb2e tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] [instance: c1e5f5df-5d66-4439-90eb-bf181c2009f8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:12:41.491089 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:12:41.491865 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=68 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:12:41.498200 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-df68eaae-7225-4e14-91fe-51f37a6cfb2e tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:12:41.498708 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-df68eaae-7225-4e14-91fe-51f37a6cfb2e tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:12:41.499198 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-df68eaae-7225-4e14-91fe-51f37a6cfb2e tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:12:41.499954 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-df68eaae-7225-4e14-91fe-51f37a6cfb2e tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:12:41.500426 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-df68eaae-7225-4e14-91fe-51f37a6cfb2e tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:12:41.500878 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-df68eaae-7225-4e14-91fe-51f37a6cfb2e tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:12:41.634072 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-df68eaae-7225-4e14-91fe-51f37a6cfb2e tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f3980641e47aa83029a3d94a5d905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880c2f00b7ee4da0a2b8ad7de99e5cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:12:41.642449 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-df68eaae-7225-4e14-91fe-51f37a6cfb2e tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] 10.222.0.61 "GET /compute/v2.1/servers/c1e5f5df-5d66-4439-90eb-bf181c2009f8" status: 200 len: 1594 microversion: 2.1 time: 0.159151 Aug 31 17:12:41.643023 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3899/7781] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:12:41 2022] GET /compute/v2.1/servers/c1e5f5df-5d66-4439-90eb-bf181c2009f8 => generated 1594 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:12:43.327382 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:12:43.328400 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:12:43.329525 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:12:43.502719 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-951039c1-80b6-42f1-85ad-3c55dac845fa req-96716300-8c74-49de-bd0e-bc6f888d744c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1e5f5df-5d66-4439-90eb-bf181c2009f8", "tag": "3fc3c70f-deeb-4f86-9471-d678e327228b"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:12:43.516129 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-951039c1-80b6-42f1-85ad-3c55dac845fa req-96716300-8c74-49de-bd0e-bc6f888d744c service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:12:43.516632 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-951039c1-80b6-42f1-85ad-3c55dac845fa req-96716300-8c74-49de-bd0e-bc6f888d744c service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:12:43.517345 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-951039c1-80b6-42f1-85ad-3c55dac845fa req-96716300-8c74-49de-bd0e-bc6f888d744c service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:12:43.532482 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-951039c1-80b6-42f1-85ad-3c55dac845fa req-96716300-8c74-49de-bd0e-bc6f888d744c service nova] Creating event network-changed:3fc3c70f-deeb-4f86-9471-d678e327228b for instance c1e5f5df-5d66-4439-90eb-bf181c2009f8 on n-h2-850499-9 Aug 31 17:12:43.539369 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-951039c1-80b6-42f1-85ad-3c55dac845fa req-96716300-8c74-49de-bd0e-bc6f888d744c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.213634 Aug 31 17:12:43.540318 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3883/7782] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:12:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:12:44.460059 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4081a7a0-9eff-4134-94a4-086301b86d01 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-646818988"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:12:44.461218 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4081a7a0-9eff-4134-94a4-086301b86d01 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] [instance: c1e5f5df-5d66-4439-90eb-bf181c2009f8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:12:44.469260 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4081a7a0-9eff-4134-94a4-086301b86d01 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:12:44.470201 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4081a7a0-9eff-4134-94a4-086301b86d01 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:12:44.471006 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4081a7a0-9eff-4134-94a4-086301b86d01 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:12:44.472389 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4081a7a0-9eff-4134-94a4-086301b86d01 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:12:44.473121 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4081a7a0-9eff-4134-94a4-086301b86d01 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:12:44.474870 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4081a7a0-9eff-4134-94a4-086301b86d01 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:12:44.661058 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.network.security_group_api [None req-4081a7a0-9eff-4134-94a4-086301b86d01 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Adding security group f396fe62-3733-4e7b-be10-ab3bff0bb0d5 to port 3fc3c70f-deeb-4f86-9471-d678e327228b Aug 31 17:12:45.064325 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4081a7a0-9eff-4134-94a4-086301b86d01 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] 10.222.0.61 "POST /compute/v2.1/servers/c1e5f5df-5d66-4439-90eb-bf181c2009f8/action" status: 202 len: 0 microversion: 2.1 time: 0.608171 Aug 31 17:12:45.065168 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3900/7783] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 17:12:44 2022] POST /compute/v2.1/servers/c1e5f5df-5d66-4439-90eb-bf181c2009f8/action => generated 0 bytes in 611 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 17:12:45.080802 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1e39fa73-2000-4c35-b208-864303309ea0 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:12:45.081445 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1e39fa73-2000-4c35-b208-864303309ea0 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] [instance: c1e5f5df-5d66-4439-90eb-bf181c2009f8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:12:45.089654 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1e39fa73-2000-4c35-b208-864303309ea0 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:12:45.090173 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1e39fa73-2000-4c35-b208-864303309ea0 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:12:45.090675 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1e39fa73-2000-4c35-b208-864303309ea0 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:12:45.091873 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1e39fa73-2000-4c35-b208-864303309ea0 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:12:45.092304 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1e39fa73-2000-4c35-b208-864303309ea0 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:12:45.092967 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1e39fa73-2000-4c35-b208-864303309ea0 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:12:45.182726 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-0e415edc-411f-48e8-9d99-caee81161bb8 req-5823a8bb-0cf9-44d6-930d-99d47a9cd4a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1e5f5df-5d66-4439-90eb-bf181c2009f8", "tag": "3fc3c70f-deeb-4f86-9471-d678e327228b"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:12:45.192928 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-0e415edc-411f-48e8-9d99-caee81161bb8 req-5823a8bb-0cf9-44d6-930d-99d47a9cd4a3 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:12:45.194926 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-0e415edc-411f-48e8-9d99-caee81161bb8 req-5823a8bb-0cf9-44d6-930d-99d47a9cd4a3 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:12:45.195386 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-0e415edc-411f-48e8-9d99-caee81161bb8 req-5823a8bb-0cf9-44d6-930d-99d47a9cd4a3 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:12:45.215315 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-0e415edc-411f-48e8-9d99-caee81161bb8 req-5823a8bb-0cf9-44d6-930d-99d47a9cd4a3 service nova] Creating event network-changed:3fc3c70f-deeb-4f86-9471-d678e327228b for instance c1e5f5df-5d66-4439-90eb-bf181c2009f8 on n-h2-850499-9 Aug 31 17:12:45.222692 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-0e415edc-411f-48e8-9d99-caee81161bb8 req-5823a8bb-0cf9-44d6-930d-99d47a9cd4a3 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.151842 Aug 31 17:12:45.223329 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3884/7784] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:12:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:12:45.357600 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-1e39fa73-2000-4c35-b208-864303309ea0 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f3980641e47aa83029a3d94a5d905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880c2f00b7ee4da0a2b8ad7de99e5cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:12:45.371859 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1e39fa73-2000-4c35-b208-864303309ea0 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] 10.222.0.61 "GET /compute/v2.1/servers/c1e5f5df-5d66-4439-90eb-bf181c2009f8" status: 200 len: 1759 microversion: 2.1 time: 0.294686 Aug 31 17:12:45.372669 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3901/7785] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:12:45 2022] GET /compute/v2.1/servers/c1e5f5df-5d66-4439-90eb-bf181c2009f8 => generated 1759 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:15:06.786306 n-d-850499-9 devstack@n-api.service[122256]: ERROR oslo.messaging._drivers.impl_rabbit [-] [46519162-dc0d-41cb-af5d-7b19f3bd0573] AMQP server on 10.222.0.61:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 31 17:15:06.787378 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=4 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:15:06.788139 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=4 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:15:06.789396 n-d-850499-9 devstack@n-api.service[122256]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 17:15:06.789558 n-d-850499-9 devstack@n-api.service[122256]: Wed Aug 31 17:15:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c1e5f5df-5d66-4439-90eb-bf181c2009f8/action (ip 10.222.0.61) !!! Aug 31 17:15:06.792085 n-d-850499-9 devstack@n-api.service[122256]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 31 17:15:06.792253 n-d-850499-9 devstack@n-api.service[122256]: Wed Aug 31 17:15:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c1e5f5df-5d66-4439-90eb-bf181c2009f8/action (ip 10.222.0.61) !!! Aug 31 17:15:06.804461 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-17e00f18-9829-4b43-b330-cdf995b126bd tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:15:06.806890 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-17e00f18-9829-4b43-b330-cdf995b126bd tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] [instance: c1e5f5df-5d66-4439-90eb-bf181c2009f8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:15:06.815493 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-17e00f18-9829-4b43-b330-cdf995b126bd tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:15:06.816010 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-17e00f18-9829-4b43-b330-cdf995b126bd tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:15:06.816455 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-17e00f18-9829-4b43-b330-cdf995b126bd tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:15:06.817194 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-17e00f18-9829-4b43-b330-cdf995b126bd tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:15:06.817664 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-17e00f18-9829-4b43-b330-cdf995b126bd tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:15:06.818097 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-17e00f18-9829-4b43-b330-cdf995b126bd tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:15:06.898935 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-17e00f18-9829-4b43-b330-cdf995b126bd tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] 10.222.0.61 "POST /compute/v2.1/servers/c1e5f5df-5d66-4439-90eb-bf181c2009f8/action" status: 202 len: 0 microversion: 2.1 time: 0.114324 Aug 31 17:15:06.899772 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3885/7786] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 17:15:06 2022] POST /compute/v2.1/servers/c1e5f5df-5d66-4439-90eb-bf181c2009f8/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 17:15:06.908964 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-58811332-8fbe-458e-b3ae-7a6677819278 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:15:06.909726 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-58811332-8fbe-458e-b3ae-7a6677819278 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] [instance: c1e5f5df-5d66-4439-90eb-bf181c2009f8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:15:06.913177 n-d-850499-9 devstack@n-api.service[122257]: ERROR oslo.messaging._drivers.impl_rabbit [-] [400e2b90-e189-478a-9cc4-4b0bfcefc34a] AMQP server on 10.222.0.61:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 31 17:15:06.914505 n-d-850499-9 devstack@n-api.service[122257]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8b198bdc-d1f7-4259-9144-ce56665d9587] AMQP server on 10.222.0.61:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 31 17:15:06.915226 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=6 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:15:06.916284 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=16 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:15:06.918103 n-d-850499-9 devstack@n-api.service[122257]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 17:15:06.918509 n-d-850499-9 devstack@n-api.service[122257]: Wed Aug 31 17:15:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c1e5f5df-5d66-4439-90eb-bf181c2009f8 (ip 10.222.0.61) !!! Aug 31 17:15:06.920385 n-d-850499-9 devstack@n-api.service[122257]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 31 17:15:06.920566 n-d-850499-9 devstack@n-api.service[122257]: Wed Aug 31 17:15:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c1e5f5df-5d66-4439-90eb-bf181c2009f8 (ip 10.222.0.61) !!! Aug 31 17:15:06.931282 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-58811332-8fbe-458e-b3ae-7a6677819278 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:15:06.931938 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-58811332-8fbe-458e-b3ae-7a6677819278 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:15:06.932454 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-58811332-8fbe-458e-b3ae-7a6677819278 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:15:06.933260 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-58811332-8fbe-458e-b3ae-7a6677819278 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:15:06.933779 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-58811332-8fbe-458e-b3ae-7a6677819278 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:15:06.934293 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-58811332-8fbe-458e-b3ae-7a6677819278 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:15:07.289232 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-58811332-8fbe-458e-b3ae-7a6677819278 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f3980641e47aa83029a3d94a5d905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880c2f00b7ee4da0a2b8ad7de99e5cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:15:07.298699 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-58811332-8fbe-458e-b3ae-7a6677819278 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] 10.222.0.61 "GET /compute/v2.1/servers/c1e5f5df-5d66-4439-90eb-bf181c2009f8" status: 200 len: 1761 microversion: 2.1 time: 0.394735 Aug 31 17:15:07.299300 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3902/7787] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:15:06 2022] GET /compute/v2.1/servers/c1e5f5df-5d66-4439-90eb-bf181c2009f8 => generated 1761 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:15:08.327770 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2d852e0c-2240-4edd-ac17-8f8f84a26857 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:15:08.329223 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2d852e0c-2240-4edd-ac17-8f8f84a26857 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] [instance: c1e5f5df-5d66-4439-90eb-bf181c2009f8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:15:08.340575 n-d-850499-9 devstack@n-api.service[122256]: INFO oslo.messaging._drivers.impl_rabbit [-] [46519162-dc0d-41cb-af5d-7b19f3bd0573] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 38804. Aug 31 17:15:08.342383 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2d852e0c-2240-4edd-ac17-8f8f84a26857 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:15:08.342918 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2d852e0c-2240-4edd-ac17-8f8f84a26857 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:15:08.343363 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2d852e0c-2240-4edd-ac17-8f8f84a26857 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:15:08.344112 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2d852e0c-2240-4edd-ac17-8f8f84a26857 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:15:08.344585 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2d852e0c-2240-4edd-ac17-8f8f84a26857 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:15:08.345018 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2d852e0c-2240-4edd-ac17-8f8f84a26857 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:15:08.556093 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-2d852e0c-2240-4edd-ac17-8f8f84a26857 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f3980641e47aa83029a3d94a5d905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880c2f00b7ee4da0a2b8ad7de99e5cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:15:08.567229 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2d852e0c-2240-4edd-ac17-8f8f84a26857 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] 10.222.0.61 "GET /compute/v2.1/servers/c1e5f5df-5d66-4439-90eb-bf181c2009f8" status: 200 len: 1759 microversion: 2.1 time: 0.248437 Aug 31 17:15:08.567865 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3886/7788] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:15:08 2022] GET /compute/v2.1/servers/c1e5f5df-5d66-4439-90eb-bf181c2009f8 => generated 1759 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:16:48.824302 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:16:48.825077 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=6 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:16:48.825887 n-d-850499-9 devstack@n-api.service[122257]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 17:16:48.826018 n-d-850499-9 devstack@n-api.service[122257]: Wed Aug 31 17:16:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c1e5f5df-5d66-4439-90eb-bf181c2009f8/action (ip 10.222.0.61) !!! Aug 31 17:16:48.832869 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-79496822-7044-48dc-9082-c07526e7faac tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-646818988"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:16:48.833755 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-79496822-7044-48dc-9082-c07526e7faac tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] [instance: c1e5f5df-5d66-4439-90eb-bf181c2009f8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:16:48.845735 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-79496822-7044-48dc-9082-c07526e7faac tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:16:48.846244 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-79496822-7044-48dc-9082-c07526e7faac tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:16:48.846708 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-79496822-7044-48dc-9082-c07526e7faac tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:16:48.847428 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-79496822-7044-48dc-9082-c07526e7faac tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:16:48.847937 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-79496822-7044-48dc-9082-c07526e7faac tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:16:48.849075 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-79496822-7044-48dc-9082-c07526e7faac tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:16:48.849990 n-d-850499-9 devstack@n-api.service[122257]: INFO oslo.messaging._drivers.impl_rabbit [-] [8b198bdc-d1f7-4259-9144-ce56665d9587] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 38848. Aug 31 17:16:48.853567 n-d-850499-9 devstack@n-api.service[122257]: INFO oslo.messaging._drivers.impl_rabbit [-] [400e2b90-e189-478a-9cc4-4b0bfcefc34a] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 38846. Aug 31 17:16:48.979269 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.network.security_group_api [None req-79496822-7044-48dc-9082-c07526e7faac tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Removing security group f396fe62-3733-4e7b-be10-ab3bff0bb0d5 from port 3fc3c70f-deeb-4f86-9471-d678e327228b Aug 31 17:16:49.284844 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-79496822-7044-48dc-9082-c07526e7faac tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] 10.222.0.61 "POST /compute/v2.1/servers/c1e5f5df-5d66-4439-90eb-bf181c2009f8/action" status: 202 len: 0 microversion: 2.1 time: 0.463215 Aug 31 17:16:49.285470 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3903/7789] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 17:16:48 2022] POST /compute/v2.1/servers/c1e5f5df-5d66-4439-90eb-bf181c2009f8/action => generated 0 bytes in 465 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 17:16:49.302327 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=4 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:16:49.304789 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:16:49.310539 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-a1096db6-46c6-4837-9887-09af91ce9f7f req-9de76aa2-db04-4269-965c-80224acaab68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1e5f5df-5d66-4439-90eb-bf181c2009f8", "tag": "3fc3c70f-deeb-4f86-9471-d678e327228b"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:16:49.322093 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-a1096db6-46c6-4837-9887-09af91ce9f7f req-9de76aa2-db04-4269-965c-80224acaab68 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:16:49.322882 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-a1096db6-46c6-4837-9887-09af91ce9f7f req-9de76aa2-db04-4269-965c-80224acaab68 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:16:49.323283 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-a1096db6-46c6-4837-9887-09af91ce9f7f req-9de76aa2-db04-4269-965c-80224acaab68 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:16:49.337439 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-a1096db6-46c6-4837-9887-09af91ce9f7f req-9de76aa2-db04-4269-965c-80224acaab68 service nova] Creating event network-changed:3fc3c70f-deeb-4f86-9471-d678e327228b for instance c1e5f5df-5d66-4439-90eb-bf181c2009f8 on n-h2-850499-9 Aug 31 17:16:49.343020 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-a1096db6-46c6-4837-9887-09af91ce9f7f req-9de76aa2-db04-4269-965c-80224acaab68 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053605 Aug 31 17:16:49.344046 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3887/7790] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:16:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:16:50.494425 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-015a89f4-731f-449b-98ea-3cacc83621d1 req-364a36d2-ac61-41cc-8a90-7d6adc5329ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1e5f5df-5d66-4439-90eb-bf181c2009f8", "tag": "3fc3c70f-deeb-4f86-9471-d678e327228b"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:16:50.504633 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-015a89f4-731f-449b-98ea-3cacc83621d1 req-364a36d2-ac61-41cc-8a90-7d6adc5329ca service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:16:50.505125 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-015a89f4-731f-449b-98ea-3cacc83621d1 req-364a36d2-ac61-41cc-8a90-7d6adc5329ca service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:16:50.505664 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-015a89f4-731f-449b-98ea-3cacc83621d1 req-364a36d2-ac61-41cc-8a90-7d6adc5329ca service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:16:50.518496 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-015a89f4-731f-449b-98ea-3cacc83621d1 req-364a36d2-ac61-41cc-8a90-7d6adc5329ca service nova] Creating event network-changed:3fc3c70f-deeb-4f86-9471-d678e327228b for instance c1e5f5df-5d66-4439-90eb-bf181c2009f8 on n-h2-850499-9 Aug 31 17:16:50.525856 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-015a89f4-731f-449b-98ea-3cacc83621d1 req-364a36d2-ac61-41cc-8a90-7d6adc5329ca service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036514 Aug 31 17:16:50.526484 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3904/7791] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:16:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:16:50.542676 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8635cd33-8816-4232-bebb-66f569a9876b tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:16:50.543720 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8635cd33-8816-4232-bebb-66f569a9876b tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] [instance: c1e5f5df-5d66-4439-90eb-bf181c2009f8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:16:50.551738 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8635cd33-8816-4232-bebb-66f569a9876b tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:16:50.552237 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8635cd33-8816-4232-bebb-66f569a9876b tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:16:50.553632 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8635cd33-8816-4232-bebb-66f569a9876b tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:16:50.554061 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8635cd33-8816-4232-bebb-66f569a9876b tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:16:50.554528 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8635cd33-8816-4232-bebb-66f569a9876b tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:16:50.554958 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8635cd33-8816-4232-bebb-66f569a9876b tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:16:50.651548 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-8635cd33-8816-4232-bebb-66f569a9876b tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lazy-loading 'services' on Instance uuid c1e5f5df-5d66-4439-90eb-bf181c2009f8 {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 17:16:50.739309 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8635cd33-8816-4232-bebb-66f569a9876b tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] 10.222.0.61 "DELETE /compute/v2.1/servers/c1e5f5df-5d66-4439-90eb-bf181c2009f8/os-volume_attachments/3fa14aa3-e7d8-420c-8646-0a78d8ad019e" status: 202 len: 0 microversion: 2.1 time: 0.201929 Aug 31 17:16:50.741006 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3888/7792] 10.222.0.61 () {58 vars in 1416 bytes} [Wed Aug 31 17:16:50 2022] DELETE /compute/v2.1/servers/c1e5f5df-5d66-4439-90eb-bf181c2009f8/os-volume_attachments/3fa14aa3-e7d8-420c-8646-0a78d8ad019e => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 17:16:50.751739 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f52fd3a6-5a8f-4937-9398-846332857797 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:16:50.755100 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f52fd3a6-5a8f-4937-9398-846332857797 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] [instance: c1e5f5df-5d66-4439-90eb-bf181c2009f8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:16:50.764189 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f52fd3a6-5a8f-4937-9398-846332857797 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:16:50.765392 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f52fd3a6-5a8f-4937-9398-846332857797 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:16:50.766039 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f52fd3a6-5a8f-4937-9398-846332857797 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:16:50.767008 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f52fd3a6-5a8f-4937-9398-846332857797 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:16:50.767683 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f52fd3a6-5a8f-4937-9398-846332857797 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:16:50.768296 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f52fd3a6-5a8f-4937-9398-846332857797 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:16:50.819630 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f52fd3a6-5a8f-4937-9398-846332857797 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] 10.222.0.61 "GET /compute/v2.1/servers/c1e5f5df-5d66-4439-90eb-bf181c2009f8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072821 Aug 31 17:16:50.825011 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3905/7793] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 17:16:50 2022] GET /compute/v2.1/servers/c1e5f5df-5d66-4439-90eb-bf181c2009f8/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 17:16:51.832867 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4b8ad0cc-4c16-4abc-b05c-b8be03223072 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:16:51.836062 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4b8ad0cc-4c16-4abc-b05c-b8be03223072 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] [instance: c1e5f5df-5d66-4439-90eb-bf181c2009f8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:16:51.842392 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4b8ad0cc-4c16-4abc-b05c-b8be03223072 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:16:51.842886 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4b8ad0cc-4c16-4abc-b05c-b8be03223072 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:16:51.843330 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4b8ad0cc-4c16-4abc-b05c-b8be03223072 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:16:51.844089 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4b8ad0cc-4c16-4abc-b05c-b8be03223072 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:16:51.844547 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4b8ad0cc-4c16-4abc-b05c-b8be03223072 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:16:51.844981 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4b8ad0cc-4c16-4abc-b05c-b8be03223072 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:16:51.877423 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4b8ad0cc-4c16-4abc-b05c-b8be03223072 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] 10.222.0.61 "GET /compute/v2.1/servers/c1e5f5df-5d66-4439-90eb-bf181c2009f8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049728 Aug 31 17:16:51.878002 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3889/7794] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 17:16:51 2022] GET /compute/v2.1/servers/c1e5f5df-5d66-4439-90eb-bf181c2009f8/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:16:52.944824 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d81227ed-dbed-4bc5-8628-50f70fce60b0 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:16:52.947271 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d81227ed-dbed-4bc5-8628-50f70fce60b0 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] [instance: c1e5f5df-5d66-4439-90eb-bf181c2009f8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:16:52.953860 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d81227ed-dbed-4bc5-8628-50f70fce60b0 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:16:52.954460 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d81227ed-dbed-4bc5-8628-50f70fce60b0 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:16:52.954991 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d81227ed-dbed-4bc5-8628-50f70fce60b0 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:16:52.955841 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d81227ed-dbed-4bc5-8628-50f70fce60b0 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:16:52.956427 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d81227ed-dbed-4bc5-8628-50f70fce60b0 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:16:52.956977 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d81227ed-dbed-4bc5-8628-50f70fce60b0 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:16:52.990461 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d81227ed-dbed-4bc5-8628-50f70fce60b0 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] 10.222.0.61 "GET /compute/v2.1/servers/c1e5f5df-5d66-4439-90eb-bf181c2009f8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.104074 Aug 31 17:16:52.991264 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3906/7795] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 17:16:52 2022] GET /compute/v2.1/servers/c1e5f5df-5d66-4439-90eb-bf181c2009f8/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:16:54.002573 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-afd35618-7cd8-41c9-bf5b-1346c6647975 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:16:54.004803 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-afd35618-7cd8-41c9-bf5b-1346c6647975 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] [instance: c1e5f5df-5d66-4439-90eb-bf181c2009f8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:16:54.012974 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-afd35618-7cd8-41c9-bf5b-1346c6647975 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:16:54.013465 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-afd35618-7cd8-41c9-bf5b-1346c6647975 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:16:54.013907 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-afd35618-7cd8-41c9-bf5b-1346c6647975 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:16:54.014613 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-afd35618-7cd8-41c9-bf5b-1346c6647975 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:16:54.015077 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-afd35618-7cd8-41c9-bf5b-1346c6647975 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:16:54.015534 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-afd35618-7cd8-41c9-bf5b-1346c6647975 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:16:54.046668 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-afd35618-7cd8-41c9-bf5b-1346c6647975 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] 10.222.0.61 "GET /compute/v2.1/servers/c1e5f5df-5d66-4439-90eb-bf181c2009f8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048181 Aug 31 17:16:54.047255 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3890/7796] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 17:16:53 2022] GET /compute/v2.1/servers/c1e5f5df-5d66-4439-90eb-bf181c2009f8/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:16:55.059055 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c82856d4-de14-4ceb-bb63-5bf2c8ceceb3 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:16:55.061283 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c82856d4-de14-4ceb-bb63-5bf2c8ceceb3 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] [instance: c1e5f5df-5d66-4439-90eb-bf181c2009f8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:16:55.069002 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c82856d4-de14-4ceb-bb63-5bf2c8ceceb3 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:16:55.069776 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c82856d4-de14-4ceb-bb63-5bf2c8ceceb3 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:16:55.070259 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c82856d4-de14-4ceb-bb63-5bf2c8ceceb3 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:16:55.070989 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c82856d4-de14-4ceb-bb63-5bf2c8ceceb3 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:16:55.071470 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c82856d4-de14-4ceb-bb63-5bf2c8ceceb3 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:16:55.071945 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c82856d4-de14-4ceb-bb63-5bf2c8ceceb3 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:16:55.102910 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c82856d4-de14-4ceb-bb63-5bf2c8ceceb3 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] 10.222.0.61 "GET /compute/v2.1/servers/c1e5f5df-5d66-4439-90eb-bf181c2009f8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047833 Aug 31 17:16:55.103525 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3907/7797] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 17:16:55 2022] GET /compute/v2.1/servers/c1e5f5df-5d66-4439-90eb-bf181c2009f8/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:16:56.115817 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-162678d6-477b-4ef4-99bf-89114bd3fe63 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:16:56.117989 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-162678d6-477b-4ef4-99bf-89114bd3fe63 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] [instance: c1e5f5df-5d66-4439-90eb-bf181c2009f8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:16:56.124895 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-162678d6-477b-4ef4-99bf-89114bd3fe63 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:16:56.125392 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-162678d6-477b-4ef4-99bf-89114bd3fe63 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:16:56.125838 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-162678d6-477b-4ef4-99bf-89114bd3fe63 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:16:56.126539 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-162678d6-477b-4ef4-99bf-89114bd3fe63 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:16:56.126999 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-162678d6-477b-4ef4-99bf-89114bd3fe63 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:16:56.127430 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-162678d6-477b-4ef4-99bf-89114bd3fe63 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:16:56.160521 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-162678d6-477b-4ef4-99bf-89114bd3fe63 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] 10.222.0.61 "GET /compute/v2.1/servers/c1e5f5df-5d66-4439-90eb-bf181c2009f8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049036 Aug 31 17:16:56.161101 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3891/7798] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 17:16:56 2022] GET /compute/v2.1/servers/c1e5f5df-5d66-4439-90eb-bf181c2009f8/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 17:16:56.172327 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-abfed812-bef4-4c3c-8cd2-524bfd5205be tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:16:56.172840 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-abfed812-bef4-4c3c-8cd2-524bfd5205be tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] [instance: c1e5f5df-5d66-4439-90eb-bf181c2009f8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:16:56.179630 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-abfed812-bef4-4c3c-8cd2-524bfd5205be tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:16:56.180130 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-abfed812-bef4-4c3c-8cd2-524bfd5205be tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:16:56.180579 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-abfed812-bef4-4c3c-8cd2-524bfd5205be tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:16:56.181285 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-abfed812-bef4-4c3c-8cd2-524bfd5205be tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:16:56.181750 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-abfed812-bef4-4c3c-8cd2-524bfd5205be tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:16:56.182186 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-abfed812-bef4-4c3c-8cd2-524bfd5205be tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:16:56.260663 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-abfed812-bef4-4c3c-8cd2-524bfd5205be tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] HTTP exception thrown: Instance c1e5f5df-5d66-4439-90eb-bf181c2009f8 is not attached to volume 3fa14aa3-e7d8-420c-8646-0a78d8ad019e Aug 31 17:16:56.262675 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-abfed812-bef4-4c3c-8cd2-524bfd5205be tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Request method failure captured: Aug 31 17:16:56.262675 n-d-850499-9 devstack@n-api.service[122257]: request: DELETE /compute/v2.1/servers/c1e5f5df-5d66-4439-90eb-bf181c2009f8/os-volume_attachments/3fa14aa3-e7d8-420c-8646-0a78d8ad019e HTTP/1.1 Aug 31 17:16:56.262675 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 17:16:56.262675 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 17:16:56.262675 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 17:16:56.262675 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 17:16:56.262675 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 17:16:56.262675 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 17:16:56.262675 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 17:16:56.262675 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 17:16:56.262675 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD5ZTWlsUOViYbuoFWX00IoDHIoR7wiVbj9nZWwE8RDWKHFQGffglz5zLRbY5vUCGvRv2pHB0ndlbXYXyEwkMqNU0MuJK0umo0NZNNDn2HkNLAgy4-1kL5h-NL61_PLB1dUxdcodRWgXBdv0yMH2dIHyNJg-WudcyHiEM_Vn20czKwE4 Aug 31 17:16:56.262675 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 17:16:56.262675 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 17:16:56.262675 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 17:16:56.262675 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 17:16:56.262675 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 17:16:56.262675 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 17:16:56.262675 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 880c2f00b7ee4da0a2b8ad7de99e5cb2 Aug 31 17:16:56.262675 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-TestMinimumBasicScenario-852220423 Aug 31 17:16:56.262675 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 17:16:56.262675 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 17:16:56.262675 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/880c2f00b7ee4da0a2b8ad7de99e5cb2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/880c2f00b7ee4da0a2b8ad7de99e5cb2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_880c2f00b7ee4da0a2b8ad7de99e5cb2", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/880c2f00b7ee4da0a2b8ad7de99e5cb2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 17:16:56.262675 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-TestMinimumBasicScenario-852220423 Aug 31 17:16:56.262675 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 880c2f00b7ee4da0a2b8ad7de99e5cb2 Aug 31 17:16:56.262675 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-TestMinimumBasicScenario-852220423 Aug 31 17:16:56.262675 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-TestMinimumBasicScenario-852220423-project Aug 31 17:16:56.262675 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 17:16:56.262675 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 17:16:56.262675 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 415f3980641e47aa83029a3d94a5d905 Aug 31 17:16:56.262675 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-TestMinimumBasicScenario-852220423-project Aug 31 17:16:56.262675 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 17:16:56.262675 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance c1e5f5df-5d66-4439-90eb-bf181c2009f8 is not attached to volume 3fa14aa3-e7d8-420c-8646-0a78d8ad019e Aug 31 17:16:56.262675 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'server_id': 'c1e5f5df-5d66-4439-90eb-bf181c2009f8', 'id': '3fa14aa3-e7d8-420c-8646-0a78d8ad019e'} Aug 31 17:16:56.262675 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 17:16:56.262675 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:16:56.262675 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 31 17:16:56.262675 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 31 17:16:56.262675 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 17:16:56.262675 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 17:16:56.262675 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 31 17:16:56.262675 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 31 17:16:56.262675 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 3fa14aa3-e7d8-420c-8646-0a78d8ad019e. Aug 31 17:16:56.262675 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 17:16:56.262675 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:16:56.262675 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 17:16:56.262675 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:16:56.262675 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:16:56.262675 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:16:56.262675 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 17:16:56.262675 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 17:16:56.262675 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 17:16:56.262675 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 17:16:56.262675 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 31 17:16:56.262675 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 31 17:16:56.262675 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1e5f5df-5d66-4439-90eb-bf181c2009f8 is not attached to volume 3fa14aa3-e7d8-420c-8646-0a78d8ad019e Aug 31 17:16:56.262675 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 17:16:56.262675 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:16:56.262675 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 17:16:56.262675 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:16:56.262675 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:16:56.262675 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:16:56.267425 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 17:16:56.267425 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 17:16:56.267425 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1e5f5df-5d66-4439-90eb-bf181c2009f8 is not attached to volume 3fa14aa3-e7d8-420c-8646-0a78d8ad019e Aug 31 17:16:56.267425 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 17:16:56.267425 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-abfed812-bef4-4c3c-8cd2-524bfd5205be tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Returning 404 to user: Instance c1e5f5df-5d66-4439-90eb-bf181c2009f8 is not attached to volume 3fa14aa3-e7d8-420c-8646-0a78d8ad019e {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 17:16:56.267425 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-abfed812-bef4-4c3c-8cd2-524bfd5205be tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] 10.222.0.61 "DELETE /compute/v2.1/servers/c1e5f5df-5d66-4439-90eb-bf181c2009f8/os-volume_attachments/3fa14aa3-e7d8-420c-8646-0a78d8ad019e" status: 404 len: 154 microversion: 2.1 time: 0.095890 Aug 31 17:16:56.267425 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3908/7799] 10.222.0.61 () {58 vars in 1416 bytes} [Wed Aug 31 17:16:56 2022] DELETE /compute/v2.1/servers/c1e5f5df-5d66-4439-90eb-bf181c2009f8/os-volume_attachments/3fa14aa3-e7d8-420c-8646-0a78d8ad019e => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 17:16:59.531197 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8e3f89db-bad1-43ce-87b0-34da843e3a7e tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:16:59.531778 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8e3f89db-bad1-43ce-87b0-34da843e3a7e tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] [instance: c1e5f5df-5d66-4439-90eb-bf181c2009f8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:16:59.539313 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8e3f89db-bad1-43ce-87b0-34da843e3a7e tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:16:59.539835 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8e3f89db-bad1-43ce-87b0-34da843e3a7e tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:16:59.540276 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8e3f89db-bad1-43ce-87b0-34da843e3a7e tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:16:59.540972 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8e3f89db-bad1-43ce-87b0-34da843e3a7e tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:16:59.541435 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8e3f89db-bad1-43ce-87b0-34da843e3a7e tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:16:59.541864 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8e3f89db-bad1-43ce-87b0-34da843e3a7e tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:16:59.567656 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8e3f89db-bad1-43ce-87b0-34da843e3a7e tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] [instance: c1e5f5df-5d66-4439-90eb-bf181c2009f8] Going to try to terminate instance {{(pid=122256) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 17:16:59.649778 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8e3f89db-bad1-43ce-87b0-34da843e3a7e tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] 10.222.0.61 "DELETE /compute/v2.1/servers/c1e5f5df-5d66-4439-90eb-bf181c2009f8" status: 204 len: 0 microversion: 2.1 time: 0.122089 Aug 31 17:16:59.650338 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3892/7800] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 17:16:59 2022] DELETE /compute/v2.1/servers/c1e5f5df-5d66-4439-90eb-bf181c2009f8 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 17:16:59.659435 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1beffc77-307a-44b6-a016-267749cf6b98 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:16:59.660268 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1beffc77-307a-44b6-a016-267749cf6b98 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] [instance: c1e5f5df-5d66-4439-90eb-bf181c2009f8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:16:59.668241 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1beffc77-307a-44b6-a016-267749cf6b98 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:16:59.668763 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1beffc77-307a-44b6-a016-267749cf6b98 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:16:59.669225 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1beffc77-307a-44b6-a016-267749cf6b98 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:16:59.669964 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1beffc77-307a-44b6-a016-267749cf6b98 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:16:59.670449 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1beffc77-307a-44b6-a016-267749cf6b98 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:16:59.670907 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1beffc77-307a-44b6-a016-267749cf6b98 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:16:59.813630 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-1beffc77-307a-44b6-a016-267749cf6b98 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f3980641e47aa83029a3d94a5d905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880c2f00b7ee4da0a2b8ad7de99e5cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:16:59.823033 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1beffc77-307a-44b6-a016-267749cf6b98 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] 10.222.0.61 "GET /compute/v2.1/servers/c1e5f5df-5d66-4439-90eb-bf181c2009f8" status: 200 len: 1554 microversion: 2.1 time: 0.168212 Aug 31 17:16:59.823644 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3909/7801] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:16:59 2022] GET /compute/v2.1/servers/c1e5f5df-5d66-4439-90eb-bf181c2009f8 => generated 1554 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:17:00.845512 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e2db5bfa-8d99-46f0-b50e-488b732ee690 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:17:00.846251 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e2db5bfa-8d99-46f0-b50e-488b732ee690 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] [instance: c1e5f5df-5d66-4439-90eb-bf181c2009f8] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:17:00.853927 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e2db5bfa-8d99-46f0-b50e-488b732ee690 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:17:00.854426 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e2db5bfa-8d99-46f0-b50e-488b732ee690 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:17:00.854864 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e2db5bfa-8d99-46f0-b50e-488b732ee690 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:17:00.855591 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e2db5bfa-8d99-46f0-b50e-488b732ee690 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:17:00.856053 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e2db5bfa-8d99-46f0-b50e-488b732ee690 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:17:00.856487 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e2db5bfa-8d99-46f0-b50e-488b732ee690 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:17:00.992906 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e2db5bfa-8d99-46f0-b50e-488b732ee690 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f3980641e47aa83029a3d94a5d905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880c2f00b7ee4da0a2b8ad7de99e5cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:17:01.000758 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e2db5bfa-8d99-46f0-b50e-488b732ee690 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] 10.222.0.61 "GET /compute/v2.1/servers/c1e5f5df-5d66-4439-90eb-bf181c2009f8" status: 200 len: 1554 microversion: 2.1 time: 0.159550 Aug 31 17:17:01.001336 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3893/7802] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:17:00 2022] GET /compute/v2.1/servers/c1e5f5df-5d66-4439-90eb-bf181c2009f8 => generated 1554 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:17:02.023182 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8bfab616-9680-4d6b-9c56-9b7d8aafe06d tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:17:02.023853 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8bfab616-9680-4d6b-9c56-9b7d8aafe06d tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] [instance: c1e5f5df-5d66-4439-90eb-bf181c2009f8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:17:02.030798 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8bfab616-9680-4d6b-9c56-9b7d8aafe06d tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:17:02.031407 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8bfab616-9680-4d6b-9c56-9b7d8aafe06d tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:17:02.031921 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8bfab616-9680-4d6b-9c56-9b7d8aafe06d tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:17:02.032649 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8bfab616-9680-4d6b-9c56-9b7d8aafe06d tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:17:02.033122 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8bfab616-9680-4d6b-9c56-9b7d8aafe06d tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:17:02.033564 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8bfab616-9680-4d6b-9c56-9b7d8aafe06d tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:17:02.259013 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-c3386c6d-af50-46e5-93bd-d3afcf890328 req-4c90daf6-fdca-4177-b18c-97bf6f22326f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1e5f5df-5d66-4439-90eb-bf181c2009f8", "name": "network-vif-deleted", "tag": "3fc3c70f-deeb-4f86-9471-d678e327228b"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:17:02.263944 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8bfab616-9680-4d6b-9c56-9b7d8aafe06d tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f3980641e47aa83029a3d94a5d905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880c2f00b7ee4da0a2b8ad7de99e5cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:17:02.272727 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8bfab616-9680-4d6b-9c56-9b7d8aafe06d tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] 10.222.0.61 "GET /compute/v2.1/servers/c1e5f5df-5d66-4439-90eb-bf181c2009f8" status: 200 len: 1554 microversion: 2.1 time: 0.253437 Aug 31 17:17:02.273370 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3910/7803] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:17:02 2022] GET /compute/v2.1/servers/c1e5f5df-5d66-4439-90eb-bf181c2009f8 => generated 1554 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:17:02.274191 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-c3386c6d-af50-46e5-93bd-d3afcf890328 req-4c90daf6-fdca-4177-b18c-97bf6f22326f service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:17:02.275075 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-c3386c6d-af50-46e5-93bd-d3afcf890328 req-4c90daf6-fdca-4177-b18c-97bf6f22326f service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:17:02.275548 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-c3386c6d-af50-46e5-93bd-d3afcf890328 req-4c90daf6-fdca-4177-b18c-97bf6f22326f service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:17:02.289147 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-c3386c6d-af50-46e5-93bd-d3afcf890328 req-4c90daf6-fdca-4177-b18c-97bf6f22326f service nova] Creating event network-vif-deleted:3fc3c70f-deeb-4f86-9471-d678e327228b for instance c1e5f5df-5d66-4439-90eb-bf181c2009f8 on n-h2-850499-9 Aug 31 17:17:02.295679 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-c3386c6d-af50-46e5-93bd-d3afcf890328 req-4c90daf6-fdca-4177-b18c-97bf6f22326f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041560 Aug 31 17:17:02.296295 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3894/7804] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:17:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 17:17:03.294277 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-15149062-3457-4328-b4dc-83a255968ee4 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:17:03.294942 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-15149062-3457-4328-b4dc-83a255968ee4 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] [instance: c1e5f5df-5d66-4439-90eb-bf181c2009f8] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:17:03.302037 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-15149062-3457-4328-b4dc-83a255968ee4 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:17:03.303188 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-15149062-3457-4328-b4dc-83a255968ee4 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:17:03.303654 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-15149062-3457-4328-b4dc-83a255968ee4 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:17:03.304378 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-15149062-3457-4328-b4dc-83a255968ee4 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:17:03.304856 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-15149062-3457-4328-b4dc-83a255968ee4 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:17:03.305303 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-15149062-3457-4328-b4dc-83a255968ee4 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:17:03.319043 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-15149062-3457-4328-b4dc-83a255968ee4 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] HTTP exception thrown: Instance c1e5f5df-5d66-4439-90eb-bf181c2009f8 could not be found. Aug 31 17:17:03.320689 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-15149062-3457-4328-b4dc-83a255968ee4 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Request method failure captured: Aug 31 17:17:03.320689 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/c1e5f5df-5d66-4439-90eb-bf181c2009f8 HTTP/1.1 Aug 31 17:17:03.320689 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 17:17:03.320689 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 17:17:03.320689 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 17:17:03.320689 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 17:17:03.320689 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 17:17:03.320689 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 17:17:03.320689 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 17:17:03.320689 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 17:17:03.320689 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD5ZTWlsUOViYbuoFWX00IoDHIoR7wiVbj9nZWwE8RDWKHFQGffglz5zLRbY5vUCGvRv2pHB0ndlbXYXyEwkMqNU0MuJK0umo0NZNNDn2HkNLAgy4-1kL5h-NL61_PLB1dUxdcodRWgXBdv0yMH2dIHyNJg-WudcyHiEM_Vn20czKwE4 Aug 31 17:17:03.320689 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 17:17:03.320689 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 17:17:03.320689 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 17:17:03.320689 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 17:17:03.320689 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 17:17:03.320689 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 17:17:03.320689 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 880c2f00b7ee4da0a2b8ad7de99e5cb2 Aug 31 17:17:03.320689 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-TestMinimumBasicScenario-852220423 Aug 31 17:17:03.320689 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 17:17:03.320689 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 17:17:03.320689 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/880c2f00b7ee4da0a2b8ad7de99e5cb2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/880c2f00b7ee4da0a2b8ad7de99e5cb2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_880c2f00b7ee4da0a2b8ad7de99e5cb2", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/880c2f00b7ee4da0a2b8ad7de99e5cb2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 17:17:03.320689 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-TestMinimumBasicScenario-852220423 Aug 31 17:17:03.320689 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 880c2f00b7ee4da0a2b8ad7de99e5cb2 Aug 31 17:17:03.320689 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-TestMinimumBasicScenario-852220423 Aug 31 17:17:03.320689 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-TestMinimumBasicScenario-852220423-project Aug 31 17:17:03.320689 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 17:17:03.320689 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 17:17:03.320689 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 415f3980641e47aa83029a3d94a5d905 Aug 31 17:17:03.320689 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-TestMinimumBasicScenario-852220423-project Aug 31 17:17:03.320689 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 17:17:03.320689 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance c1e5f5df-5d66-4439-90eb-bf181c2009f8 could not be found. Aug 31 17:17:03.320689 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': 'c1e5f5df-5d66-4439-90eb-bf181c2009f8'} Aug 31 17:17:03.320689 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 17:17:03.320689 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:17:03.320689 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 17:17:03.320689 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 17:17:03.320689 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 17:17:03.320689 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 17:17:03.320689 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 17:17:03.320689 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 17:17:03.320689 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 17:17:03.320689 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 17:17:03.320689 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1e5f5df-5d66-4439-90eb-bf181c2009f8 could not be found. Aug 31 17:17:03.320689 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 17:17:03.320689 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:17:03.320689 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 17:17:03.320689 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:17:03.320689 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:17:03.320689 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:17:03.320689 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 17:17:03.320689 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 17:17:03.320689 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 17:17:03.320689 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 17:17:03.320689 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 17:17:03.320689 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 17:17:03.320689 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 17:17:03.320689 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 17:17:03.320689 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 17:17:03.320689 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 17:17:03.320689 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1e5f5df-5d66-4439-90eb-bf181c2009f8 could not be found. Aug 31 17:17:03.320689 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 17:17:03.320689 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:17:03.320689 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 17:17:03.325197 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:17:03.325197 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:17:03.325197 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:17:03.325197 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 17:17:03.325197 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 17:17:03.325197 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1e5f5df-5d66-4439-90eb-bf181c2009f8 could not be found. Aug 31 17:17:03.325197 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 17:17:03.325197 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-15149062-3457-4328-b4dc-83a255968ee4 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Returning 404 to user: Instance c1e5f5df-5d66-4439-90eb-bf181c2009f8 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 17:17:03.325197 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-15149062-3457-4328-b4dc-83a255968ee4 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] 10.222.0.61 "GET /compute/v2.1/servers/c1e5f5df-5d66-4439-90eb-bf181c2009f8" status: 404 len: 111 microversion: 2.1 time: 0.031891 Aug 31 17:17:03.325197 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3911/7805] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:17:03 2022] GET /compute/v2.1/servers/c1e5f5df-5d66-4439-90eb-bf181c2009f8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 17:17:03.331441 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-bd3a9832-4061-46e2-b26c-b42a2c0c8e9a tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Calling method '.version_select at 0x7f5ae3c8d430>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:17:03.355573 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-bd3a9832-4061-46e2-b26c-b42a2c0c8e9a tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1391467875" status: 202 len: 0 microversion: 2.1 time: 0.028212 Aug 31 17:17:03.356163 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3895/7806] 10.222.0.61 () {58 vars in 1272 bytes} [Wed Aug 31 17:17:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1391467875 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 17:17:12.369386 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ac040633-0aa7-4e61-8a67-de3c8943a956 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Action: 'create', calling method: .version_select at 0x7f5ae3b1f820>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-419807862", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFQd8AB6r/LoRxLjYIhI9Cf5HeCWx1fTstpq+2R9J9UNkmuofysP4nD6ArBE/iQoM9r4O4mL+5MHSNOr3imCTx8EVFcn8tnz0xXhiaOZLaRL+cvG2x9iCfVa8+FfowrEqA=="}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:17:12.388646 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-ac040633-0aa7-4e61-8a67-de3c8943a956 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Getting quotas for project 880c2f00b7ee4da0a2b8ad7de99e5cb2. Resources: {'key_pairs'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 17:17:12.397116 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-ac040633-0aa7-4e61-8a67-de3c8943a956 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Getting quotas for user 415f3980641e47aa83029a3d94a5d905 and project 880c2f00b7ee4da0a2b8ad7de99e5cb2. Resources: {'key_pairs'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 17:17:12.428367 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ac040633-0aa7-4e61-8a67-de3c8943a956 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.064223 Aug 31 17:17:12.429007 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3912/7807] 10.222.0.61 () {60 vars in 1159 bytes} [Wed Aug 31 17:17:12 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:17:12.481520 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=51,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:17:12.485687 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-563845bf-2da3-4a46-a429-3597b2db4972 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-291358513", "imageRef": "7c8ee9e9-fe04-45d5-992e-1bfcd2b93fde", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-419807862", "networks": [{"uuid": "9e9abe02-83e9-4384-aa3b-d466f6328e87"}]}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:17:12.543758 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-563845bf-2da3-4a46-a429-3597b2db4972 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] validate_networks() for [('9e9abe02-83e9-4384-aa3b-d466f6328e87', None, None, None, None, None)] {{(pid=122256) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 17:17:12.974727 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-563845bf-2da3-4a46-a429-3597b2db4972 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 17:17:12.975185 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-563845bf-2da3-4a46-a429-3597b2db4972 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 17:17:12.975687 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-563845bf-2da3-4a46-a429-3597b2db4972 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 17:17:12.976102 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-563845bf-2da3-4a46-a429-3597b2db4972 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 17:17:12.976515 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-563845bf-2da3-4a46-a429-3597b2db4972 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 17:17:12.985484 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-563845bf-2da3-4a46-a429-3597b2db4972 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:17:12.985969 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-563845bf-2da3-4a46-a429-3597b2db4972 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:17:12.986404 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-563845bf-2da3-4a46-a429-3597b2db4972 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:17:12.987129 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-563845bf-2da3-4a46-a429-3597b2db4972 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:17:12.987734 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-563845bf-2da3-4a46-a429-3597b2db4972 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:17:12.988046 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-563845bf-2da3-4a46-a429-3597b2db4972 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:17:13.006201 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-563845bf-2da3-4a46-a429-3597b2db4972 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Getting quotas for project 880c2f00b7ee4da0a2b8ad7de99e5cb2. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 17:17:13.012345 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-563845bf-2da3-4a46-a429-3597b2db4972 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Getting quotas for user 415f3980641e47aa83029a3d94a5d905 and project 880c2f00b7ee4da0a2b8ad7de99e5cb2. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 17:17:13.025906 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-563845bf-2da3-4a46-a429-3597b2db4972 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Going to run 1 instances... {{(pid=122256) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 17:17:13.028271 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-563845bf-2da3-4a46-a429-3597b2db4972 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] [instance: 4df00db4-ce79-4e85-9837-41425c3e02a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7c8ee9e9-fe04-45d5-992e-1bfcd2b93fde',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 17:17:13.075554 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-563845bf-2da3-4a46-a429-3597b2db4972 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.595837 Aug 31 17:17:13.078355 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3896/7808] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 17:17:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 597 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 17:17:13.088251 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c97b9add-7216-42f4-8671-6009428993de tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:17:13.088928 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c97b9add-7216-42f4-8671-6009428993de tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] [instance: 4df00db4-ce79-4e85-9837-41425c3e02a5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:17:13.145464 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c97b9add-7216-42f4-8671-6009428993de tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f3980641e47aa83029a3d94a5d905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880c2f00b7ee4da0a2b8ad7de99e5cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:17:13.153857 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c97b9add-7216-42f4-8671-6009428993de tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] 10.222.0.61 "GET /compute/v2.1/servers/4df00db4-ce79-4e85-9837-41425c3e02a5" status: 200 len: 1257 microversion: 2.1 time: 0.070352 Aug 31 17:17:13.154449 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3913/7809] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:17:13 2022] GET /compute/v2.1/servers/4df00db4-ce79-4e85-9837-41425c3e02a5 => generated 1257 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:17:14.176646 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-27cf209a-e4cf-48d1-b06b-d17117e3c898 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:17:14.178325 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-27cf209a-e4cf-48d1-b06b-d17117e3c898 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] [instance: 4df00db4-ce79-4e85-9837-41425c3e02a5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:17:14.186157 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-27cf209a-e4cf-48d1-b06b-d17117e3c898 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:17:14.186657 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-27cf209a-e4cf-48d1-b06b-d17117e3c898 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:17:14.187109 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-27cf209a-e4cf-48d1-b06b-d17117e3c898 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:17:14.188704 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-27cf209a-e4cf-48d1-b06b-d17117e3c898 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:17:14.189526 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-27cf209a-e4cf-48d1-b06b-d17117e3c898 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:17:14.189984 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-27cf209a-e4cf-48d1-b06b-d17117e3c898 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:17:14.291749 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-27cf209a-e4cf-48d1-b06b-d17117e3c898 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f3980641e47aa83029a3d94a5d905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880c2f00b7ee4da0a2b8ad7de99e5cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:17:14.299717 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-27cf209a-e4cf-48d1-b06b-d17117e3c898 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] 10.222.0.61 "GET /compute/v2.1/servers/4df00db4-ce79-4e85-9837-41425c3e02a5" status: 200 len: 1317 microversion: 2.1 time: 0.128755 Aug 31 17:17:14.300556 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3897/7810] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:17:14 2022] GET /compute/v2.1/servers/4df00db4-ce79-4e85-9837-41425c3e02a5 => generated 1317 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:17:15.323719 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-795bd21c-0bbe-4f7a-a3f9-03208eecb1fe tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:17:15.325050 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-795bd21c-0bbe-4f7a-a3f9-03208eecb1fe tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] [instance: 4df00db4-ce79-4e85-9837-41425c3e02a5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:17:15.327841 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=44 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:17:15.338170 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-795bd21c-0bbe-4f7a-a3f9-03208eecb1fe tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:17:15.339082 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-795bd21c-0bbe-4f7a-a3f9-03208eecb1fe tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:17:15.339815 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-795bd21c-0bbe-4f7a-a3f9-03208eecb1fe tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:17:15.340792 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-795bd21c-0bbe-4f7a-a3f9-03208eecb1fe tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:17:15.341500 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-795bd21c-0bbe-4f7a-a3f9-03208eecb1fe tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:17:15.342176 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-795bd21c-0bbe-4f7a-a3f9-03208eecb1fe tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:17:15.581077 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-795bd21c-0bbe-4f7a-a3f9-03208eecb1fe tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f3980641e47aa83029a3d94a5d905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880c2f00b7ee4da0a2b8ad7de99e5cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:17:15.590500 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-795bd21c-0bbe-4f7a-a3f9-03208eecb1fe tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] 10.222.0.61 "GET /compute/v2.1/servers/4df00db4-ce79-4e85-9837-41425c3e02a5" status: 200 len: 1357 microversion: 2.1 time: 0.272398 Aug 31 17:17:15.596547 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3914/7811] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:17:15 2022] GET /compute/v2.1/servers/4df00db4-ce79-4e85-9837-41425c3e02a5 => generated 1357 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:17:16.617199 n-d-850499-9 devstack@n-api.service[122256]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0cd6dd6f-a50d-4cf4-8d95-237d76a72b0e] AMQP server on 10.222.0.61:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 31 17:17:16.620647 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f2fc890a-6e50-4ed7-8e89-b122d0c431e5 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:17:16.621274 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f2fc890a-6e50-4ed7-8e89-b122d0c431e5 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] [instance: 4df00db4-ce79-4e85-9837-41425c3e02a5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:17:16.627911 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f2fc890a-6e50-4ed7-8e89-b122d0c431e5 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:17:16.628727 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f2fc890a-6e50-4ed7-8e89-b122d0c431e5 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:17:16.629394 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f2fc890a-6e50-4ed7-8e89-b122d0c431e5 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:17:16.630115 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f2fc890a-6e50-4ed7-8e89-b122d0c431e5 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:17:16.631285 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f2fc890a-6e50-4ed7-8e89-b122d0c431e5 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:17:16.631836 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f2fc890a-6e50-4ed7-8e89-b122d0c431e5 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:17:16.822462 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f2fc890a-6e50-4ed7-8e89-b122d0c431e5 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f3980641e47aa83029a3d94a5d905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880c2f00b7ee4da0a2b8ad7de99e5cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:17:16.831668 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f2fc890a-6e50-4ed7-8e89-b122d0c431e5 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] 10.222.0.61 "GET /compute/v2.1/servers/4df00db4-ce79-4e85-9837-41425c3e02a5" status: 200 len: 1357 microversion: 2.1 time: 0.216741 Aug 31 17:17:16.832611 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3898/7812] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:17:16 2022] GET /compute/v2.1/servers/4df00db4-ce79-4e85-9837-41425c3e02a5 => generated 1357 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 17:17:17.853365 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-050783cb-d616-4e09-89c3-6b89ecc8564b tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:17:17.854606 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-050783cb-d616-4e09-89c3-6b89ecc8564b tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] [instance: 4df00db4-ce79-4e85-9837-41425c3e02a5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:17:17.861507 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-050783cb-d616-4e09-89c3-6b89ecc8564b tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:17:17.862022 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-050783cb-d616-4e09-89c3-6b89ecc8564b tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:17:17.862482 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-050783cb-d616-4e09-89c3-6b89ecc8564b tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:17:17.863214 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-050783cb-d616-4e09-89c3-6b89ecc8564b tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:17:17.863733 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-050783cb-d616-4e09-89c3-6b89ecc8564b tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:17:17.864196 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-050783cb-d616-4e09-89c3-6b89ecc8564b tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:17:18.026592 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-050783cb-d616-4e09-89c3-6b89ecc8564b tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f3980641e47aa83029a3d94a5d905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880c2f00b7ee4da0a2b8ad7de99e5cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:17:18.035120 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-050783cb-d616-4e09-89c3-6b89ecc8564b tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] 10.222.0.61 "GET /compute/v2.1/servers/4df00db4-ce79-4e85-9837-41425c3e02a5" status: 200 len: 1357 microversion: 2.1 time: 0.185925 Aug 31 17:17:18.035743 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3915/7813] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:17:17 2022] GET /compute/v2.1/servers/4df00db4-ce79-4e85-9837-41425c3e02a5 => generated 1357 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:17:19.057984 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-556abc5a-9772-43eb-b137-ab0cf8476f8e tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:17:19.059320 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-556abc5a-9772-43eb-b137-ab0cf8476f8e tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] [instance: 4df00db4-ce79-4e85-9837-41425c3e02a5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:17:19.073729 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-556abc5a-9772-43eb-b137-ab0cf8476f8e tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:17:19.074235 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-556abc5a-9772-43eb-b137-ab0cf8476f8e tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:17:19.074892 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-556abc5a-9772-43eb-b137-ab0cf8476f8e tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:17:19.075654 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-556abc5a-9772-43eb-b137-ab0cf8476f8e tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:17:19.076264 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-556abc5a-9772-43eb-b137-ab0cf8476f8e tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:17:19.076713 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-556abc5a-9772-43eb-b137-ab0cf8476f8e tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:17:19.078857 n-d-850499-9 devstack@n-api.service[122256]: INFO oslo.messaging._drivers.impl_rabbit [-] [0cd6dd6f-a50d-4cf4-8d95-237d76a72b0e] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 39060. Aug 31 17:17:19.235083 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-556abc5a-9772-43eb-b137-ab0cf8476f8e tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f3980641e47aa83029a3d94a5d905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880c2f00b7ee4da0a2b8ad7de99e5cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:17:19.245256 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-556abc5a-9772-43eb-b137-ab0cf8476f8e tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] 10.222.0.61 "GET /compute/v2.1/servers/4df00db4-ce79-4e85-9837-41425c3e02a5" status: 200 len: 1357 microversion: 2.1 time: 0.191274 Aug 31 17:17:19.246381 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3899/7814] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:17:19 2022] GET /compute/v2.1/servers/4df00db4-ce79-4e85-9837-41425c3e02a5 => generated 1357 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:17:20.270004 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-14ce450d-022a-4b12-be62-21519c5448a4 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:17:20.272159 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-14ce450d-022a-4b12-be62-21519c5448a4 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] [instance: 4df00db4-ce79-4e85-9837-41425c3e02a5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:17:20.275771 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:17:20.281301 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-14ce450d-022a-4b12-be62-21519c5448a4 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:17:20.281947 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-14ce450d-022a-4b12-be62-21519c5448a4 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:17:20.282868 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-14ce450d-022a-4b12-be62-21519c5448a4 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:17:20.283486 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-14ce450d-022a-4b12-be62-21519c5448a4 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:17:20.283898 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-14ce450d-022a-4b12-be62-21519c5448a4 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:17:20.284466 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-14ce450d-022a-4b12-be62-21519c5448a4 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:17:20.471819 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-14ce450d-022a-4b12-be62-21519c5448a4 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f3980641e47aa83029a3d94a5d905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880c2f00b7ee4da0a2b8ad7de99e5cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:17:20.481242 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-14ce450d-022a-4b12-be62-21519c5448a4 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] 10.222.0.61 "GET /compute/v2.1/servers/4df00db4-ce79-4e85-9837-41425c3e02a5" status: 200 len: 1357 microversion: 2.1 time: 0.215759 Aug 31 17:17:20.497502 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3916/7815] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:17:20 2022] GET /compute/v2.1/servers/4df00db4-ce79-4e85-9837-41425c3e02a5 => generated 1357 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:17:21.507004 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7b4b14ae-c618-425d-8ea0-76c23ce9454d tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:17:21.507810 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7b4b14ae-c618-425d-8ea0-76c23ce9454d tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] [instance: 4df00db4-ce79-4e85-9837-41425c3e02a5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:17:21.510601 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:17:21.516404 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7b4b14ae-c618-425d-8ea0-76c23ce9454d tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:17:21.516941 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7b4b14ae-c618-425d-8ea0-76c23ce9454d tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:17:21.517391 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7b4b14ae-c618-425d-8ea0-76c23ce9454d tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:17:21.518147 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7b4b14ae-c618-425d-8ea0-76c23ce9454d tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:17:21.518613 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7b4b14ae-c618-425d-8ea0-76c23ce9454d tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:17:21.519046 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7b4b14ae-c618-425d-8ea0-76c23ce9454d tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:17:21.660535 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7b4b14ae-c618-425d-8ea0-76c23ce9454d tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f3980641e47aa83029a3d94a5d905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880c2f00b7ee4da0a2b8ad7de99e5cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:17:21.669558 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7b4b14ae-c618-425d-8ea0-76c23ce9454d tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] 10.222.0.61 "GET /compute/v2.1/servers/4df00db4-ce79-4e85-9837-41425c3e02a5" status: 200 len: 1357 microversion: 2.1 time: 0.168275 Aug 31 17:17:21.670186 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3900/7816] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:17:21 2022] GET /compute/v2.1/servers/4df00db4-ce79-4e85-9837-41425c3e02a5 => generated 1357 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:17:22.691262 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-bf572bac-cdad-434a-8471-3995fa3ec390 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:17:22.691917 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-bf572bac-cdad-434a-8471-3995fa3ec390 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] [instance: 4df00db4-ce79-4e85-9837-41425c3e02a5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:17:22.699678 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bf572bac-cdad-434a-8471-3995fa3ec390 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:17:22.700189 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bf572bac-cdad-434a-8471-3995fa3ec390 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:17:22.700652 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bf572bac-cdad-434a-8471-3995fa3ec390 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:17:22.701373 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bf572bac-cdad-434a-8471-3995fa3ec390 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:17:22.701851 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bf572bac-cdad-434a-8471-3995fa3ec390 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:17:22.702300 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bf572bac-cdad-434a-8471-3995fa3ec390 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:17:22.842311 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-bf572bac-cdad-434a-8471-3995fa3ec390 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f3980641e47aa83029a3d94a5d905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880c2f00b7ee4da0a2b8ad7de99e5cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:17:22.851473 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-bf572bac-cdad-434a-8471-3995fa3ec390 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] 10.222.0.61 "GET /compute/v2.1/servers/4df00db4-ce79-4e85-9837-41425c3e02a5" status: 200 len: 1357 microversion: 2.1 time: 0.164051 Aug 31 17:17:22.852091 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3917/7817] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:17:22 2022] GET /compute/v2.1/servers/4df00db4-ce79-4e85-9837-41425c3e02a5 => generated 1357 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:17:23.874391 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-66b124b3-5b2b-4279-9f57-7f891067997e tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:17:23.875069 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-66b124b3-5b2b-4279-9f57-7f891067997e tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] [instance: 4df00db4-ce79-4e85-9837-41425c3e02a5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:17:23.877969 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:17:23.878677 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=6 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:17:23.886124 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-66b124b3-5b2b-4279-9f57-7f891067997e tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:17:23.886632 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-66b124b3-5b2b-4279-9f57-7f891067997e tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:17:23.887076 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-66b124b3-5b2b-4279-9f57-7f891067997e tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:17:23.887818 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-66b124b3-5b2b-4279-9f57-7f891067997e tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:17:23.888536 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-66b124b3-5b2b-4279-9f57-7f891067997e tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:17:23.888973 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-66b124b3-5b2b-4279-9f57-7f891067997e tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:17:24.050606 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-66b124b3-5b2b-4279-9f57-7f891067997e tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f3980641e47aa83029a3d94a5d905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880c2f00b7ee4da0a2b8ad7de99e5cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:17:24.059656 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-66b124b3-5b2b-4279-9f57-7f891067997e tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] 10.222.0.61 "GET /compute/v2.1/servers/4df00db4-ce79-4e85-9837-41425c3e02a5" status: 200 len: 1357 microversion: 2.1 time: 0.189312 Aug 31 17:17:24.060260 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3901/7818] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:17:23 2022] GET /compute/v2.1/servers/4df00db4-ce79-4e85-9837-41425c3e02a5 => generated 1357 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:17:24.651461 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-8e1da59f-29c0-48f4-baa5-92983666bdb7 req-aee62b82-b550-4e5d-a577-40d988b0118a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4df00db4-ce79-4e85-9837-41425c3e02a5", "tag": "a53da882-8794-4b13-8010-f298e704ee26"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:17:24.659140 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=6 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:17:24.665393 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-8e1da59f-29c0-48f4-baa5-92983666bdb7 req-aee62b82-b550-4e5d-a577-40d988b0118a service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:17:24.665898 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-8e1da59f-29c0-48f4-baa5-92983666bdb7 req-aee62b82-b550-4e5d-a577-40d988b0118a service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:17:24.666346 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-8e1da59f-29c0-48f4-baa5-92983666bdb7 req-aee62b82-b550-4e5d-a577-40d988b0118a service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:17:24.682451 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-8e1da59f-29c0-48f4-baa5-92983666bdb7 req-aee62b82-b550-4e5d-a577-40d988b0118a service nova] Creating event network-changed:a53da882-8794-4b13-8010-f298e704ee26 for instance 4df00db4-ce79-4e85-9837-41425c3e02a5 on n-h2-850499-9 Aug 31 17:17:24.696946 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-8e1da59f-29c0-48f4-baa5-92983666bdb7 req-aee62b82-b550-4e5d-a577-40d988b0118a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050277 Aug 31 17:17:24.698402 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3918/7819] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:17:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:17:25.082158 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f550d77f-07b7-40a1-bc95-175293419df8 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:17:25.082776 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f550d77f-07b7-40a1-bc95-175293419df8 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] [instance: 4df00db4-ce79-4e85-9837-41425c3e02a5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:17:25.090506 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f550d77f-07b7-40a1-bc95-175293419df8 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:17:25.091009 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f550d77f-07b7-40a1-bc95-175293419df8 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:17:25.091459 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f550d77f-07b7-40a1-bc95-175293419df8 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:17:25.092220 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f550d77f-07b7-40a1-bc95-175293419df8 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:17:25.092685 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f550d77f-07b7-40a1-bc95-175293419df8 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:17:25.093120 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f550d77f-07b7-40a1-bc95-175293419df8 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:17:25.229290 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f550d77f-07b7-40a1-bc95-175293419df8 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f3980641e47aa83029a3d94a5d905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880c2f00b7ee4da0a2b8ad7de99e5cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:17:25.237073 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f550d77f-07b7-40a1-bc95-175293419df8 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] 10.222.0.61 "GET /compute/v2.1/servers/4df00db4-ce79-4e85-9837-41425c3e02a5" status: 200 len: 1357 microversion: 2.1 time: 0.158916 Aug 31 17:17:25.237651 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3902/7820] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:17:25 2022] GET /compute/v2.1/servers/4df00db4-ce79-4e85-9837-41425c3e02a5 => generated 1357 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:17:26.260634 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-158bd209-c79a-4ac4-9227-751f13965473 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:17:26.261352 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-158bd209-c79a-4ac4-9227-751f13965473 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] [instance: 4df00db4-ce79-4e85-9837-41425c3e02a5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:17:26.268018 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-158bd209-c79a-4ac4-9227-751f13965473 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:17:26.268511 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-158bd209-c79a-4ac4-9227-751f13965473 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:17:26.268964 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-158bd209-c79a-4ac4-9227-751f13965473 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:17:26.269679 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-158bd209-c79a-4ac4-9227-751f13965473 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:17:26.270152 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-158bd209-c79a-4ac4-9227-751f13965473 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:17:26.270597 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-158bd209-c79a-4ac4-9227-751f13965473 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:17:26.409225 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-158bd209-c79a-4ac4-9227-751f13965473 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f3980641e47aa83029a3d94a5d905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880c2f00b7ee4da0a2b8ad7de99e5cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:17:26.418514 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-158bd209-c79a-4ac4-9227-751f13965473 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] 10.222.0.61 "GET /compute/v2.1/servers/4df00db4-ce79-4e85-9837-41425c3e02a5" status: 200 len: 1357 microversion: 2.1 time: 0.163157 Aug 31 17:17:26.419145 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3919/7821] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:17:26 2022] GET /compute/v2.1/servers/4df00db4-ce79-4e85-9837-41425c3e02a5 => generated 1357 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 17:17:27.439780 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e3c0325b-2de7-48f0-b40e-be0b0248ee2f tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:17:27.440418 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e3c0325b-2de7-48f0-b40e-be0b0248ee2f tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] [instance: 4df00db4-ce79-4e85-9837-41425c3e02a5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:17:27.449708 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e3c0325b-2de7-48f0-b40e-be0b0248ee2f tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:17:27.450282 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e3c0325b-2de7-48f0-b40e-be0b0248ee2f tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:17:27.450668 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e3c0325b-2de7-48f0-b40e-be0b0248ee2f tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:17:27.451396 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e3c0325b-2de7-48f0-b40e-be0b0248ee2f tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:17:27.451890 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e3c0325b-2de7-48f0-b40e-be0b0248ee2f tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:17:27.452324 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e3c0325b-2de7-48f0-b40e-be0b0248ee2f tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:17:27.680244 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e3c0325b-2de7-48f0-b40e-be0b0248ee2f tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f3980641e47aa83029a3d94a5d905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880c2f00b7ee4da0a2b8ad7de99e5cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:17:27.688313 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e3c0325b-2de7-48f0-b40e-be0b0248ee2f tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] 10.222.0.61 "GET /compute/v2.1/servers/4df00db4-ce79-4e85-9837-41425c3e02a5" status: 200 len: 1357 microversion: 2.1 time: 0.252641 Aug 31 17:17:27.688905 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3903/7822] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:17:27 2022] GET /compute/v2.1/servers/4df00db4-ce79-4e85-9837-41425c3e02a5 => generated 1357 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:17:28.710388 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-38e89617-24bf-4b10-8e43-fbf41e494aca tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:17:28.710947 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-38e89617-24bf-4b10-8e43-fbf41e494aca tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] [instance: 4df00db4-ce79-4e85-9837-41425c3e02a5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:17:28.718009 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-38e89617-24bf-4b10-8e43-fbf41e494aca tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:17:28.718516 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-38e89617-24bf-4b10-8e43-fbf41e494aca tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:17:28.718973 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-38e89617-24bf-4b10-8e43-fbf41e494aca tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:17:28.719790 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-38e89617-24bf-4b10-8e43-fbf41e494aca tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:17:28.720271 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-38e89617-24bf-4b10-8e43-fbf41e494aca tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:17:28.720714 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-38e89617-24bf-4b10-8e43-fbf41e494aca tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:17:28.854478 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-38e89617-24bf-4b10-8e43-fbf41e494aca tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f3980641e47aa83029a3d94a5d905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880c2f00b7ee4da0a2b8ad7de99e5cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:17:28.862261 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-38e89617-24bf-4b10-8e43-fbf41e494aca tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] 10.222.0.61 "GET /compute/v2.1/servers/4df00db4-ce79-4e85-9837-41425c3e02a5" status: 200 len: 1357 microversion: 2.1 time: 0.156306 Aug 31 17:17:28.862839 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3920/7823] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:17:28 2022] GET /compute/v2.1/servers/4df00db4-ce79-4e85-9837-41425c3e02a5 => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:17:29.090257 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-90be4799-c797-4957-b4fa-0bf61f80b9a6 req-ff4dbf36-0e28-42a3-885c-687bfd2b821c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4df00db4-ce79-4e85-9837-41425c3e02a5", "name": "network-vif-plugged", "status": "completed", "tag": "a53da882-8794-4b13-8010-f298e704ee26"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:17:29.101380 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-90be4799-c797-4957-b4fa-0bf61f80b9a6 req-ff4dbf36-0e28-42a3-885c-687bfd2b821c service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:17:29.101891 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-90be4799-c797-4957-b4fa-0bf61f80b9a6 req-ff4dbf36-0e28-42a3-885c-687bfd2b821c service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:17:29.102335 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-90be4799-c797-4957-b4fa-0bf61f80b9a6 req-ff4dbf36-0e28-42a3-885c-687bfd2b821c service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:17:29.114647 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-90be4799-c797-4957-b4fa-0bf61f80b9a6 req-ff4dbf36-0e28-42a3-885c-687bfd2b821c service nova] Creating event network-vif-plugged:a53da882-8794-4b13-8010-f298e704ee26 for instance 4df00db4-ce79-4e85-9837-41425c3e02a5 on n-h2-850499-9 Aug 31 17:17:29.120523 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-90be4799-c797-4957-b4fa-0bf61f80b9a6 req-ff4dbf36-0e28-42a3-885c-687bfd2b821c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092468 Aug 31 17:17:29.121279 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3904/7824] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:17:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:17:29.886289 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-03d2062b-f193-4311-8f8c-48125dbdb9a4 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:17:29.887019 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-03d2062b-f193-4311-8f8c-48125dbdb9a4 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] [instance: 4df00db4-ce79-4e85-9837-41425c3e02a5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:17:29.894764 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-03d2062b-f193-4311-8f8c-48125dbdb9a4 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:17:29.897231 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-03d2062b-f193-4311-8f8c-48125dbdb9a4 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:17:29.897231 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-03d2062b-f193-4311-8f8c-48125dbdb9a4 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:17:29.897506 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-03d2062b-f193-4311-8f8c-48125dbdb9a4 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:17:29.897791 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-03d2062b-f193-4311-8f8c-48125dbdb9a4 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:17:29.898285 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-03d2062b-f193-4311-8f8c-48125dbdb9a4 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:17:30.039110 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-03d2062b-f193-4311-8f8c-48125dbdb9a4 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f3980641e47aa83029a3d94a5d905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880c2f00b7ee4da0a2b8ad7de99e5cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:17:30.048270 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-03d2062b-f193-4311-8f8c-48125dbdb9a4 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] 10.222.0.61 "GET /compute/v2.1/servers/4df00db4-ce79-4e85-9837-41425c3e02a5" status: 200 len: 1357 microversion: 2.1 time: 0.166194 Aug 31 17:17:30.048857 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3921/7825] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:17:29 2022] GET /compute/v2.1/servers/4df00db4-ce79-4e85-9837-41425c3e02a5 => generated 1357 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:17:31.072446 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e489dd26-a16a-4c0f-b847-160d3e1f96ad tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:17:31.073155 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e489dd26-a16a-4c0f-b847-160d3e1f96ad tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] [instance: 4df00db4-ce79-4e85-9837-41425c3e02a5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:17:31.079432 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e489dd26-a16a-4c0f-b847-160d3e1f96ad tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:17:31.079954 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e489dd26-a16a-4c0f-b847-160d3e1f96ad tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:17:31.080397 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e489dd26-a16a-4c0f-b847-160d3e1f96ad tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:17:31.081100 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e489dd26-a16a-4c0f-b847-160d3e1f96ad tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:17:31.081559 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e489dd26-a16a-4c0f-b847-160d3e1f96ad tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:17:31.081990 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e489dd26-a16a-4c0f-b847-160d3e1f96ad tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:17:31.216470 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e489dd26-a16a-4c0f-b847-160d3e1f96ad tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f3980641e47aa83029a3d94a5d905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880c2f00b7ee4da0a2b8ad7de99e5cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:17:31.225389 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e489dd26-a16a-4c0f-b847-160d3e1f96ad tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] 10.222.0.61 "GET /compute/v2.1/servers/4df00db4-ce79-4e85-9837-41425c3e02a5" status: 200 len: 1546 microversion: 2.1 time: 0.158388 Aug 31 17:17:31.226123 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3905/7826] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:17:31 2022] GET /compute/v2.1/servers/4df00db4-ce79-4e85-9837-41425c3e02a5 => generated 1546 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:17:31.245525 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ea14740c-1266-4720-bf78-a6f861ea380f tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:17:31.246156 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ea14740c-1266-4720-bf78-a6f861ea380f tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] [instance: 4df00db4-ce79-4e85-9837-41425c3e02a5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:17:31.252999 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ea14740c-1266-4720-bf78-a6f861ea380f tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:17:31.253497 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ea14740c-1266-4720-bf78-a6f861ea380f tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:17:31.253946 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ea14740c-1266-4720-bf78-a6f861ea380f tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:17:31.254647 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ea14740c-1266-4720-bf78-a6f861ea380f tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:17:31.255114 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ea14740c-1266-4720-bf78-a6f861ea380f tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:17:31.256187 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ea14740c-1266-4720-bf78-a6f861ea380f tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:17:31.389419 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ea14740c-1266-4720-bf78-a6f861ea380f tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f3980641e47aa83029a3d94a5d905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880c2f00b7ee4da0a2b8ad7de99e5cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:17:31.398264 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ea14740c-1266-4720-bf78-a6f861ea380f tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] 10.222.0.61 "GET /compute/v2.1/servers/4df00db4-ce79-4e85-9837-41425c3e02a5" status: 200 len: 1546 microversion: 2.1 time: 0.156606 Aug 31 17:17:31.398857 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3922/7827] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:17:31 2022] GET /compute/v2.1/servers/4df00db4-ce79-4e85-9837-41425c3e02a5 => generated 1546 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:17:31.417968 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-445374c6-c1f8-48a4-9b62-28654bde741a tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:17:31.422710 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-445374c6-c1f8-48a4-9b62-28654bde741a tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '415f3980641e47aa83029a3d94a5d905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880c2f00b7ee4da0a2b8ad7de99e5cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:17:31.423475 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-445374c6-c1f8-48a4-9b62-28654bde741a tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Searching by: {'deleted': False, 'project_id': '880c2f00b7ee4da0a2b8ad7de99e5cb2'} {{(pid=122256) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 17:17:31.429637 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-445374c6-c1f8-48a4-9b62-28654bde741a tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:17:31.430122 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-445374c6-c1f8-48a4-9b62-28654bde741a tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:17:31.430563 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-445374c6-c1f8-48a4-9b62-28654bde741a tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:17:31.431291 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-445374c6-c1f8-48a4-9b62-28654bde741a tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:17:31.431769 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-445374c6-c1f8-48a4-9b62-28654bde741a tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:17:31.432202 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-445374c6-c1f8-48a4-9b62-28654bde741a tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:17:31.456876 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.multi_cell_list [None req-445374c6-c1f8-48a4-9b62-28654bde741a tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122256) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 31 17:17:31.484339 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-445374c6-c1f8-48a4-9b62-28654bde741a tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] 10.222.0.61 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.070127 Aug 31 17:17:31.484927 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3906/7828] 10.222.0.61 () {58 vars in 1125 bytes} [Wed Aug 31 17:17:31 2022] GET /compute/v2.1/servers => generated 342 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:17:31.496862 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-517cb8be-1373-4319-99a9-643d0a7b0800 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:17:31.497525 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-517cb8be-1373-4319-99a9-643d0a7b0800 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] [instance: 4df00db4-ce79-4e85-9837-41425c3e02a5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:17:31.503586 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-517cb8be-1373-4319-99a9-643d0a7b0800 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:17:31.504096 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-517cb8be-1373-4319-99a9-643d0a7b0800 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:17:31.504555 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-517cb8be-1373-4319-99a9-643d0a7b0800 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:17:31.505345 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-517cb8be-1373-4319-99a9-643d0a7b0800 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:17:31.506878 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-517cb8be-1373-4319-99a9-643d0a7b0800 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:17:31.507334 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-517cb8be-1373-4319-99a9-643d0a7b0800 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:17:31.639525 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-517cb8be-1373-4319-99a9-643d0a7b0800 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f3980641e47aa83029a3d94a5d905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880c2f00b7ee4da0a2b8ad7de99e5cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:17:31.647441 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-517cb8be-1373-4319-99a9-643d0a7b0800 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] 10.222.0.61 "GET /compute/v2.1/servers/4df00db4-ce79-4e85-9837-41425c3e02a5" status: 200 len: 1546 microversion: 2.1 time: 0.154533 Aug 31 17:17:31.648056 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3923/7829] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:17:31 2022] GET /compute/v2.1/servers/4df00db4-ce79-4e85-9837-41425c3e02a5 => generated 1546 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:17:33.162997 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8a31c81d-cdbc-4d9a-a109-8c596ea0fdf4 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "88e281f2-e3f4-42a5-99b1-c3de1756a11d"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:17:33.165399 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8a31c81d-cdbc-4d9a-a109-8c596ea0fdf4 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] [instance: 4df00db4-ce79-4e85-9837-41425c3e02a5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:17:33.172389 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8a31c81d-cdbc-4d9a-a109-8c596ea0fdf4 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:17:33.172866 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8a31c81d-cdbc-4d9a-a109-8c596ea0fdf4 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:17:33.173312 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8a31c81d-cdbc-4d9a-a109-8c596ea0fdf4 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:17:33.174020 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8a31c81d-cdbc-4d9a-a109-8c596ea0fdf4 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:17:33.174514 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8a31c81d-cdbc-4d9a-a109-8c596ea0fdf4 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:17:33.174950 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8a31c81d-cdbc-4d9a-a109-8c596ea0fdf4 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:17:33.441238 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8a31c81d-cdbc-4d9a-a109-8c596ea0fdf4 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] 10.222.0.61 "POST /compute/v2.1/servers/4df00db4-ce79-4e85-9837-41425c3e02a5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.282343 Aug 31 17:17:33.441870 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3907/7830] 10.222.0.61 () {60 vars in 1323 bytes} [Wed Aug 31 17:17:33 2022] POST /compute/v2.1/servers/4df00db4-ce79-4e85-9837-41425c3e02a5/os-volume_attachments => generated 194 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:17:44.218389 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-698663d7-7fd6-4ad9-b306-fd5cd5c5d394 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:17:44.219019 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-698663d7-7fd6-4ad9-b306-fd5cd5c5d394 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] [instance: 4df00db4-ce79-4e85-9837-41425c3e02a5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:17:44.222083 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=15 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:17:44.222799 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=56 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:17:44.229564 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-698663d7-7fd6-4ad9-b306-fd5cd5c5d394 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:17:44.230076 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-698663d7-7fd6-4ad9-b306-fd5cd5c5d394 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:17:44.230530 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-698663d7-7fd6-4ad9-b306-fd5cd5c5d394 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:17:44.231252 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-698663d7-7fd6-4ad9-b306-fd5cd5c5d394 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:17:44.231754 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-698663d7-7fd6-4ad9-b306-fd5cd5c5d394 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:17:44.232202 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-698663d7-7fd6-4ad9-b306-fd5cd5c5d394 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:17:44.695437 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-698663d7-7fd6-4ad9-b306-fd5cd5c5d394 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f3980641e47aa83029a3d94a5d905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880c2f00b7ee4da0a2b8ad7de99e5cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:17:44.704156 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-698663d7-7fd6-4ad9-b306-fd5cd5c5d394 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] 10.222.0.61 "GET /compute/v2.1/servers/4df00db4-ce79-4e85-9837-41425c3e02a5" status: 200 len: 1592 microversion: 2.1 time: 0.489626 Aug 31 17:17:44.704750 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3924/7831] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:17:44 2022] GET /compute/v2.1/servers/4df00db4-ce79-4e85-9837-41425c3e02a5 => generated 1592 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 17:17:46.364362 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:17:46.366549 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=15 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:17:46.367679 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:17:46.440681 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-064d3ad2-125e-467b-9daf-ae463eecc116 req-1bc703af-70f4-4f2c-a0af-c85d4d944b5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4df00db4-ce79-4e85-9837-41425c3e02a5", "tag": "a53da882-8794-4b13-8010-f298e704ee26"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:17:46.451665 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-064d3ad2-125e-467b-9daf-ae463eecc116 req-1bc703af-70f4-4f2c-a0af-c85d4d944b5f service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:17:46.452210 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-064d3ad2-125e-467b-9daf-ae463eecc116 req-1bc703af-70f4-4f2c-a0af-c85d4d944b5f service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:17:46.452965 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-064d3ad2-125e-467b-9daf-ae463eecc116 req-1bc703af-70f4-4f2c-a0af-c85d4d944b5f service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:17:46.467641 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-064d3ad2-125e-467b-9daf-ae463eecc116 req-1bc703af-70f4-4f2c-a0af-c85d4d944b5f service nova] Creating event network-changed:a53da882-8794-4b13-8010-f298e704ee26 for instance 4df00db4-ce79-4e85-9837-41425c3e02a5 on n-h2-850499-9 Aug 31 17:17:46.473504 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-064d3ad2-125e-467b-9daf-ae463eecc116 req-1bc703af-70f4-4f2c-a0af-c85d4d944b5f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115685 Aug 31 17:17:46.474560 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3908/7832] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:17:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:17:47.418180 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-cf62b8b7-28fd-404b-98d1-4766a2db5707 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-953349863"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:17:47.418728 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-cf62b8b7-28fd-404b-98d1-4766a2db5707 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] [instance: 4df00db4-ce79-4e85-9837-41425c3e02a5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:17:47.425858 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cf62b8b7-28fd-404b-98d1-4766a2db5707 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:17:47.426365 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cf62b8b7-28fd-404b-98d1-4766a2db5707 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:17:47.426815 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cf62b8b7-28fd-404b-98d1-4766a2db5707 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:17:47.427643 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cf62b8b7-28fd-404b-98d1-4766a2db5707 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:17:47.428717 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cf62b8b7-28fd-404b-98d1-4766a2db5707 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:17:47.429399 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cf62b8b7-28fd-404b-98d1-4766a2db5707 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:17:47.570604 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.network.security_group_api [None req-cf62b8b7-28fd-404b-98d1-4766a2db5707 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Adding security group 1cd9fbaf-2c59-4a0b-be76-266339666104 to port a53da882-8794-4b13-8010-f298e704ee26 Aug 31 17:17:47.899832 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-cf62b8b7-28fd-404b-98d1-4766a2db5707 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] 10.222.0.61 "POST /compute/v2.1/servers/4df00db4-ce79-4e85-9837-41425c3e02a5/action" status: 202 len: 0 microversion: 2.1 time: 0.487869 Aug 31 17:17:47.900487 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3925/7833] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 17:17:47 2022] POST /compute/v2.1/servers/4df00db4-ce79-4e85-9837-41425c3e02a5/action => generated 0 bytes in 489 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 17:17:47.910070 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-fc61b879-7d56-4dec-af91-0e116e9968a2 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:17:47.910778 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-fc61b879-7d56-4dec-af91-0e116e9968a2 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] [instance: 4df00db4-ce79-4e85-9837-41425c3e02a5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:17:47.917300 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fc61b879-7d56-4dec-af91-0e116e9968a2 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:17:47.917805 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fc61b879-7d56-4dec-af91-0e116e9968a2 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:17:47.918245 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fc61b879-7d56-4dec-af91-0e116e9968a2 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:17:47.918953 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fc61b879-7d56-4dec-af91-0e116e9968a2 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:17:47.919413 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fc61b879-7d56-4dec-af91-0e116e9968a2 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:17:47.919868 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fc61b879-7d56-4dec-af91-0e116e9968a2 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:17:48.077988 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-fc61b879-7d56-4dec-af91-0e116e9968a2 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f3980641e47aa83029a3d94a5d905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880c2f00b7ee4da0a2b8ad7de99e5cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:17:48.086778 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-fc61b879-7d56-4dec-af91-0e116e9968a2 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] 10.222.0.61 "GET /compute/v2.1/servers/4df00db4-ce79-4e85-9837-41425c3e02a5" status: 200 len: 1756 microversion: 2.1 time: 0.181715 Aug 31 17:17:48.087406 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3909/7834] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:17:47 2022] GET /compute/v2.1/servers/4df00db4-ce79-4e85-9837-41425c3e02a5 => generated 1756 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:17:48.495098 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-36c3f719-c1a6-408c-a7e0-c02da27f380a req-be3d8314-d470-4d33-bf42-674011d8fc9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4df00db4-ce79-4e85-9837-41425c3e02a5", "tag": "a53da882-8794-4b13-8010-f298e704ee26"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:17:48.505518 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-36c3f719-c1a6-408c-a7e0-c02da27f380a req-be3d8314-d470-4d33-bf42-674011d8fc9b service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:17:48.506059 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-36c3f719-c1a6-408c-a7e0-c02da27f380a req-be3d8314-d470-4d33-bf42-674011d8fc9b service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:17:48.506561 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-36c3f719-c1a6-408c-a7e0-c02da27f380a req-be3d8314-d470-4d33-bf42-674011d8fc9b service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:17:48.518653 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-36c3f719-c1a6-408c-a7e0-c02da27f380a req-be3d8314-d470-4d33-bf42-674011d8fc9b service nova] Creating event network-changed:a53da882-8794-4b13-8010-f298e704ee26 for instance 4df00db4-ce79-4e85-9837-41425c3e02a5 on n-h2-850499-9 Aug 31 17:17:48.524173 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-36c3f719-c1a6-408c-a7e0-c02da27f380a req-be3d8314-d470-4d33-bf42-674011d8fc9b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035728 Aug 31 17:17:48.524856 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3926/7835] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:17:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:18:46.563064 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7fc45312-8ca6-400a-8fa2-29923f65aff1 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:18:46.566008 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7fc45312-8ca6-400a-8fa2-29923f65aff1 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] [instance: 4df00db4-ce79-4e85-9837-41425c3e02a5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:18:46.568161 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=4 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:18:46.568823 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=8 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:18:46.575766 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7fc45312-8ca6-400a-8fa2-29923f65aff1 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:18:46.576265 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7fc45312-8ca6-400a-8fa2-29923f65aff1 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:18:46.576714 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7fc45312-8ca6-400a-8fa2-29923f65aff1 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:18:46.577420 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7fc45312-8ca6-400a-8fa2-29923f65aff1 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:18:46.577883 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7fc45312-8ca6-400a-8fa2-29923f65aff1 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:18:46.578315 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7fc45312-8ca6-400a-8fa2-29923f65aff1 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:18:46.654015 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7fc45312-8ca6-400a-8fa2-29923f65aff1 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] 10.222.0.61 "POST /compute/v2.1/servers/4df00db4-ce79-4e85-9837-41425c3e02a5/action" status: 202 len: 0 microversion: 2.1 time: 0.095054 Aug 31 17:18:46.655548 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3910/7836] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 17:18:46 2022] POST /compute/v2.1/servers/4df00db4-ce79-4e85-9837-41425c3e02a5/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 17:18:46.662713 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=6 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:18:46.663482 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=12 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:18:46.664413 n-d-850499-9 devstack@n-api.service[122257]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 17:18:46.664546 n-d-850499-9 devstack@n-api.service[122257]: Wed Aug 31 17:18:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4df00db4-ce79-4e85-9837-41425c3e02a5 (ip 10.222.0.61) !!! Aug 31 17:18:46.672767 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ff608982-dc8a-4135-b3a9-28f602f88864 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:18:46.673716 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ff608982-dc8a-4135-b3a9-28f602f88864 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] [instance: 4df00db4-ce79-4e85-9837-41425c3e02a5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:18:46.689629 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ff608982-dc8a-4135-b3a9-28f602f88864 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:18:46.690136 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ff608982-dc8a-4135-b3a9-28f602f88864 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:18:46.690597 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ff608982-dc8a-4135-b3a9-28f602f88864 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:18:46.691319 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ff608982-dc8a-4135-b3a9-28f602f88864 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:18:46.691822 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ff608982-dc8a-4135-b3a9-28f602f88864 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:18:46.692269 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ff608982-dc8a-4135-b3a9-28f602f88864 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:18:46.940171 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ff608982-dc8a-4135-b3a9-28f602f88864 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f3980641e47aa83029a3d94a5d905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880c2f00b7ee4da0a2b8ad7de99e5cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:18:46.949346 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ff608982-dc8a-4135-b3a9-28f602f88864 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] 10.222.0.61 "GET /compute/v2.1/servers/4df00db4-ce79-4e85-9837-41425c3e02a5" status: 200 len: 1748 microversion: 2.1 time: 0.289114 Aug 31 17:18:46.949940 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3927/7837] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:18:46 2022] GET /compute/v2.1/servers/4df00db4-ce79-4e85-9837-41425c3e02a5 => generated 1748 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:18:47.971683 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-16b543ae-714f-4e5c-9cba-0afc7c646b6b tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:18:47.972307 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-16b543ae-714f-4e5c-9cba-0afc7c646b6b tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] [instance: 4df00db4-ce79-4e85-9837-41425c3e02a5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:18:47.978993 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-16b543ae-714f-4e5c-9cba-0afc7c646b6b tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:18:47.979507 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-16b543ae-714f-4e5c-9cba-0afc7c646b6b tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:18:47.979971 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-16b543ae-714f-4e5c-9cba-0afc7c646b6b tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:18:47.980697 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-16b543ae-714f-4e5c-9cba-0afc7c646b6b tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:18:47.981163 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-16b543ae-714f-4e5c-9cba-0afc7c646b6b tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:18:47.981602 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-16b543ae-714f-4e5c-9cba-0afc7c646b6b tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:18:48.131154 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-16b543ae-714f-4e5c-9cba-0afc7c646b6b tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f3980641e47aa83029a3d94a5d905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880c2f00b7ee4da0a2b8ad7de99e5cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:18:48.142158 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-16b543ae-714f-4e5c-9cba-0afc7c646b6b tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] 10.222.0.61 "GET /compute/v2.1/servers/4df00db4-ce79-4e85-9837-41425c3e02a5" status: 200 len: 1753 microversion: 2.1 time: 0.175846 Aug 31 17:18:48.142747 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3911/7838] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:18:47 2022] GET /compute/v2.1/servers/4df00db4-ce79-4e85-9837-41425c3e02a5 => generated 1753 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:18:49.164269 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a21c10b9-d159-4213-9ae2-7c4e0893f177 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:18:49.164872 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a21c10b9-d159-4213-9ae2-7c4e0893f177 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] [instance: 4df00db4-ce79-4e85-9837-41425c3e02a5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:18:49.171885 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a21c10b9-d159-4213-9ae2-7c4e0893f177 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:18:49.172404 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a21c10b9-d159-4213-9ae2-7c4e0893f177 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:18:49.172866 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a21c10b9-d159-4213-9ae2-7c4e0893f177 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:18:49.173600 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a21c10b9-d159-4213-9ae2-7c4e0893f177 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:18:49.174081 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a21c10b9-d159-4213-9ae2-7c4e0893f177 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:18:49.174534 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a21c10b9-d159-4213-9ae2-7c4e0893f177 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:18:49.330877 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a21c10b9-d159-4213-9ae2-7c4e0893f177 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f3980641e47aa83029a3d94a5d905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880c2f00b7ee4da0a2b8ad7de99e5cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:18:49.340343 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a21c10b9-d159-4213-9ae2-7c4e0893f177 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] 10.222.0.61 "GET /compute/v2.1/servers/4df00db4-ce79-4e85-9837-41425c3e02a5" status: 200 len: 1753 microversion: 2.1 time: 0.180485 Aug 31 17:18:49.340931 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3928/7839] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:18:49 2022] GET /compute/v2.1/servers/4df00db4-ce79-4e85-9837-41425c3e02a5 => generated 1753 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:18:50.361994 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-75a318c9-3d5e-4b84-8cd1-06e19a8d2bda tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:18:50.362607 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-75a318c9-3d5e-4b84-8cd1-06e19a8d2bda tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] [instance: 4df00db4-ce79-4e85-9837-41425c3e02a5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:18:50.369126 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-75a318c9-3d5e-4b84-8cd1-06e19a8d2bda tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:18:50.369609 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-75a318c9-3d5e-4b84-8cd1-06e19a8d2bda tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:18:50.370047 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-75a318c9-3d5e-4b84-8cd1-06e19a8d2bda tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:18:50.370747 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-75a318c9-3d5e-4b84-8cd1-06e19a8d2bda tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:18:50.371198 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-75a318c9-3d5e-4b84-8cd1-06e19a8d2bda tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:18:50.371649 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-75a318c9-3d5e-4b84-8cd1-06e19a8d2bda tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:18:50.545684 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-75a318c9-3d5e-4b84-8cd1-06e19a8d2bda tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f3980641e47aa83029a3d94a5d905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880c2f00b7ee4da0a2b8ad7de99e5cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:18:50.554401 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-75a318c9-3d5e-4b84-8cd1-06e19a8d2bda tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] 10.222.0.61 "GET /compute/v2.1/servers/4df00db4-ce79-4e85-9837-41425c3e02a5" status: 200 len: 1753 microversion: 2.1 time: 0.196481 Aug 31 17:18:50.554994 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3912/7840] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:18:50 2022] GET /compute/v2.1/servers/4df00db4-ce79-4e85-9837-41425c3e02a5 => generated 1753 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:18:51.577679 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d649f9ee-961a-4fea-96af-578503db391d tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:18:51.578306 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d649f9ee-961a-4fea-96af-578503db391d tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] [instance: 4df00db4-ce79-4e85-9837-41425c3e02a5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:18:51.585324 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d649f9ee-961a-4fea-96af-578503db391d tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:18:51.585831 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d649f9ee-961a-4fea-96af-578503db391d tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:18:51.586289 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d649f9ee-961a-4fea-96af-578503db391d tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:18:51.586997 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d649f9ee-961a-4fea-96af-578503db391d tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:18:51.587473 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d649f9ee-961a-4fea-96af-578503db391d tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:18:51.587938 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d649f9ee-961a-4fea-96af-578503db391d tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:18:51.733707 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d649f9ee-961a-4fea-96af-578503db391d tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f3980641e47aa83029a3d94a5d905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880c2f00b7ee4da0a2b8ad7de99e5cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:18:51.742520 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d649f9ee-961a-4fea-96af-578503db391d tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] 10.222.0.61 "GET /compute/v2.1/servers/4df00db4-ce79-4e85-9837-41425c3e02a5" status: 200 len: 1753 microversion: 2.1 time: 0.168805 Aug 31 17:18:51.743133 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3929/7841] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:18:51 2022] GET /compute/v2.1/servers/4df00db4-ce79-4e85-9837-41425c3e02a5 => generated 1753 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:18:52.764132 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-bb5549fe-3036-43c0-89e5-e8e300e9dd5d tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:18:52.764732 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-bb5549fe-3036-43c0-89e5-e8e300e9dd5d tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] [instance: 4df00db4-ce79-4e85-9837-41425c3e02a5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:18:52.771963 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bb5549fe-3036-43c0-89e5-e8e300e9dd5d tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:18:52.772458 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bb5549fe-3036-43c0-89e5-e8e300e9dd5d tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:18:52.772896 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bb5549fe-3036-43c0-89e5-e8e300e9dd5d tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:18:52.773881 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bb5549fe-3036-43c0-89e5-e8e300e9dd5d tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:18:52.774340 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bb5549fe-3036-43c0-89e5-e8e300e9dd5d tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:18:52.774768 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bb5549fe-3036-43c0-89e5-e8e300e9dd5d tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:18:52.934805 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-bb5549fe-3036-43c0-89e5-e8e300e9dd5d tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f3980641e47aa83029a3d94a5d905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880c2f00b7ee4da0a2b8ad7de99e5cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:18:52.943914 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-bb5549fe-3036-43c0-89e5-e8e300e9dd5d tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] 10.222.0.61 "GET /compute/v2.1/servers/4df00db4-ce79-4e85-9837-41425c3e02a5" status: 200 len: 1753 microversion: 2.1 time: 0.183741 Aug 31 17:18:52.944503 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3913/7842] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:18:52 2022] GET /compute/v2.1/servers/4df00db4-ce79-4e85-9837-41425c3e02a5 => generated 1753 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:18:53.967244 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-637e9729-826e-43d2-abee-eef6072138f1 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:18:53.967918 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-637e9729-826e-43d2-abee-eef6072138f1 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] [instance: 4df00db4-ce79-4e85-9837-41425c3e02a5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:18:53.974792 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-637e9729-826e-43d2-abee-eef6072138f1 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:18:53.975305 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-637e9729-826e-43d2-abee-eef6072138f1 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:18:53.975796 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-637e9729-826e-43d2-abee-eef6072138f1 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:18:53.976512 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-637e9729-826e-43d2-abee-eef6072138f1 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:18:53.976986 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-637e9729-826e-43d2-abee-eef6072138f1 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:18:53.977431 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-637e9729-826e-43d2-abee-eef6072138f1 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:18:54.122719 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-637e9729-826e-43d2-abee-eef6072138f1 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f3980641e47aa83029a3d94a5d905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880c2f00b7ee4da0a2b8ad7de99e5cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:18:54.130937 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-637e9729-826e-43d2-abee-eef6072138f1 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] 10.222.0.61 "GET /compute/v2.1/servers/4df00db4-ce79-4e85-9837-41425c3e02a5" status: 200 len: 1753 microversion: 2.1 time: 0.168352 Aug 31 17:18:54.131520 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3930/7843] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:18:53 2022] GET /compute/v2.1/servers/4df00db4-ce79-4e85-9837-41425c3e02a5 => generated 1753 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:18:55.154760 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-33612085-8099-4928-af50-f9843d808804 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:18:55.155435 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-33612085-8099-4928-af50-f9843d808804 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] [instance: 4df00db4-ce79-4e85-9837-41425c3e02a5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:18:55.162327 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-33612085-8099-4928-af50-f9843d808804 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:18:55.162824 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-33612085-8099-4928-af50-f9843d808804 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:18:55.163266 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-33612085-8099-4928-af50-f9843d808804 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:18:55.164028 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-33612085-8099-4928-af50-f9843d808804 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:18:55.164499 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-33612085-8099-4928-af50-f9843d808804 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:18:55.164932 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-33612085-8099-4928-af50-f9843d808804 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:18:55.312052 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-33612085-8099-4928-af50-f9843d808804 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f3980641e47aa83029a3d94a5d905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880c2f00b7ee4da0a2b8ad7de99e5cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:18:55.320530 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-33612085-8099-4928-af50-f9843d808804 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] 10.222.0.61 "GET /compute/v2.1/servers/4df00db4-ce79-4e85-9837-41425c3e02a5" status: 200 len: 1753 microversion: 2.1 time: 0.170727 Aug 31 17:18:55.321161 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3914/7844] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:18:55 2022] GET /compute/v2.1/servers/4df00db4-ce79-4e85-9837-41425c3e02a5 => generated 1753 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 17:18:56.344913 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-59b92ced-60bd-4aca-abec-1958416b83ab tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:18:56.345578 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-59b92ced-60bd-4aca-abec-1958416b83ab tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] [instance: 4df00db4-ce79-4e85-9837-41425c3e02a5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:18:56.352507 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-59b92ced-60bd-4aca-abec-1958416b83ab tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:18:56.353016 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-59b92ced-60bd-4aca-abec-1958416b83ab tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:18:56.353477 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-59b92ced-60bd-4aca-abec-1958416b83ab tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:18:56.354193 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-59b92ced-60bd-4aca-abec-1958416b83ab tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:18:56.355830 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-59b92ced-60bd-4aca-abec-1958416b83ab tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:18:56.356291 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-59b92ced-60bd-4aca-abec-1958416b83ab tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:18:56.507683 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-59b92ced-60bd-4aca-abec-1958416b83ab tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f3980641e47aa83029a3d94a5d905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880c2f00b7ee4da0a2b8ad7de99e5cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:18:56.516521 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-59b92ced-60bd-4aca-abec-1958416b83ab tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] 10.222.0.61 "GET /compute/v2.1/servers/4df00db4-ce79-4e85-9837-41425c3e02a5" status: 200 len: 1753 microversion: 2.1 time: 0.175561 Aug 31 17:18:56.517123 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3931/7845] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:18:56 2022] GET /compute/v2.1/servers/4df00db4-ce79-4e85-9837-41425c3e02a5 => generated 1753 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 17:18:57.537567 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-28ade06e-474e-4aae-b5fa-efd2c323ab1c tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:18:57.538195 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-28ade06e-474e-4aae-b5fa-efd2c323ab1c tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] [instance: 4df00db4-ce79-4e85-9837-41425c3e02a5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:18:57.545781 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-28ade06e-474e-4aae-b5fa-efd2c323ab1c tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:18:57.546270 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-28ade06e-474e-4aae-b5fa-efd2c323ab1c tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:18:57.546712 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-28ade06e-474e-4aae-b5fa-efd2c323ab1c tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:18:57.547411 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-28ade06e-474e-4aae-b5fa-efd2c323ab1c tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:18:57.547900 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-28ade06e-474e-4aae-b5fa-efd2c323ab1c tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:18:57.548334 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-28ade06e-474e-4aae-b5fa-efd2c323ab1c tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:18:57.690411 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-28ade06e-474e-4aae-b5fa-efd2c323ab1c tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f3980641e47aa83029a3d94a5d905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880c2f00b7ee4da0a2b8ad7de99e5cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:18:57.699436 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-28ade06e-474e-4aae-b5fa-efd2c323ab1c tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] 10.222.0.61 "GET /compute/v2.1/servers/4df00db4-ce79-4e85-9837-41425c3e02a5" status: 200 len: 1753 microversion: 2.1 time: 0.165734 Aug 31 17:18:57.700043 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3915/7846] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:18:57 2022] GET /compute/v2.1/servers/4df00db4-ce79-4e85-9837-41425c3e02a5 => generated 1753 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:18:58.721094 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-86664cd7-5d70-41dc-b91a-25d802b8d079 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:18:58.721637 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-86664cd7-5d70-41dc-b91a-25d802b8d079 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] [instance: 4df00db4-ce79-4e85-9837-41425c3e02a5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:18:58.728780 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-86664cd7-5d70-41dc-b91a-25d802b8d079 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:18:58.729283 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-86664cd7-5d70-41dc-b91a-25d802b8d079 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:18:58.730355 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-86664cd7-5d70-41dc-b91a-25d802b8d079 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:18:58.731072 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-86664cd7-5d70-41dc-b91a-25d802b8d079 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:18:58.731573 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-86664cd7-5d70-41dc-b91a-25d802b8d079 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:18:58.732052 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-86664cd7-5d70-41dc-b91a-25d802b8d079 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:18:58.881405 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-86664cd7-5d70-41dc-b91a-25d802b8d079 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f3980641e47aa83029a3d94a5d905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880c2f00b7ee4da0a2b8ad7de99e5cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:18:58.889799 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-86664cd7-5d70-41dc-b91a-25d802b8d079 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] 10.222.0.61 "GET /compute/v2.1/servers/4df00db4-ce79-4e85-9837-41425c3e02a5" status: 200 len: 1756 microversion: 2.1 time: 0.172739 Aug 31 17:18:58.890638 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3932/7847] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:18:58 2022] GET /compute/v2.1/servers/4df00db4-ce79-4e85-9837-41425c3e02a5 => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:20:02.290794 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=12 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:20:02.291727 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:20:02.296832 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b56c13a3-8110-4a3b-87bd-34701cba27e8 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-953349863"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:20:02.297413 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b56c13a3-8110-4a3b-87bd-34701cba27e8 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] [instance: 4df00db4-ce79-4e85-9837-41425c3e02a5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:20:02.305249 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b56c13a3-8110-4a3b-87bd-34701cba27e8 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:20:02.305743 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b56c13a3-8110-4a3b-87bd-34701cba27e8 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:20:02.306186 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b56c13a3-8110-4a3b-87bd-34701cba27e8 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:20:02.306894 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b56c13a3-8110-4a3b-87bd-34701cba27e8 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:20:02.307358 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b56c13a3-8110-4a3b-87bd-34701cba27e8 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:20:02.307818 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b56c13a3-8110-4a3b-87bd-34701cba27e8 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:20:02.442406 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.network.security_group_api [None req-b56c13a3-8110-4a3b-87bd-34701cba27e8 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Removing security group 1cd9fbaf-2c59-4a0b-be76-266339666104 from port a53da882-8794-4b13-8010-f298e704ee26 Aug 31 17:20:02.770017 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b56c13a3-8110-4a3b-87bd-34701cba27e8 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] 10.222.0.61 "POST /compute/v2.1/servers/4df00db4-ce79-4e85-9837-41425c3e02a5/action" status: 202 len: 0 microversion: 2.1 time: 0.480760 Aug 31 17:20:02.770654 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3916/7848] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 17:20:02 2022] POST /compute/v2.1/servers/4df00db4-ce79-4e85-9837-41425c3e02a5/action => generated 0 bytes in 483 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 17:20:02.778882 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=12 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:20:02.779731 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=36 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:20:02.783847 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-f9e7aae0-29c3-4178-8731-d1ed13bb89a3 req-8f63a7e0-815c-47b7-a9e1-a8b7336f526b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4df00db4-ce79-4e85-9837-41425c3e02a5", "tag": "a53da882-8794-4b13-8010-f298e704ee26"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:20:02.793933 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-f9e7aae0-29c3-4178-8731-d1ed13bb89a3 req-8f63a7e0-815c-47b7-a9e1-a8b7336f526b service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:20:02.794519 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-f9e7aae0-29c3-4178-8731-d1ed13bb89a3 req-8f63a7e0-815c-47b7-a9e1-a8b7336f526b service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:20:02.795026 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-f9e7aae0-29c3-4178-8731-d1ed13bb89a3 req-8f63a7e0-815c-47b7-a9e1-a8b7336f526b service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:20:02.808545 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-f9e7aae0-29c3-4178-8731-d1ed13bb89a3 req-8f63a7e0-815c-47b7-a9e1-a8b7336f526b service nova] Creating event network-changed:a53da882-8794-4b13-8010-f298e704ee26 for instance 4df00db4-ce79-4e85-9837-41425c3e02a5 on n-h2-850499-9 Aug 31 17:20:02.812800 n-d-850499-9 devstack@n-api.service[122257]: ERROR oslo.messaging._drivers.impl_rabbit [req-f9e7aae0-29c3-4178-8731-d1ed13bb89a3 req-8f63a7e0-815c-47b7-a9e1-a8b7336f526b service nova] [42f18c4e-2449-489c-a1df-12d323f2fd39] AMQP server on 10.222.0.61:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 31 17:20:03.820491 n-d-850499-9 devstack@n-api.service[122257]: INFO oslo.messaging._drivers.impl_rabbit [req-f9e7aae0-29c3-4178-8731-d1ed13bb89a3 req-8f63a7e0-815c-47b7-a9e1-a8b7336f526b service nova] [42f18c4e-2449-489c-a1df-12d323f2fd39] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 39258. Aug 31 17:20:03.826473 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-f9e7aae0-29c3-4178-8731-d1ed13bb89a3 req-8f63a7e0-815c-47b7-a9e1-a8b7336f526b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.050088 Aug 31 17:20:03.827186 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3933/7849] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:20:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:20:03.861968 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f063e766-3b13-4d2e-906f-ce0915b5332d tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:20:03.862566 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f063e766-3b13-4d2e-906f-ce0915b5332d tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] [instance: 4df00db4-ce79-4e85-9837-41425c3e02a5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:20:03.868902 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f063e766-3b13-4d2e-906f-ce0915b5332d tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:20:03.869406 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f063e766-3b13-4d2e-906f-ce0915b5332d tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:20:03.869871 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f063e766-3b13-4d2e-906f-ce0915b5332d tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:20:03.871111 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f063e766-3b13-4d2e-906f-ce0915b5332d tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:20:03.871607 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f063e766-3b13-4d2e-906f-ce0915b5332d tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:20:03.872041 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f063e766-3b13-4d2e-906f-ce0915b5332d tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:20:03.970206 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-f063e766-3b13-4d2e-906f-ce0915b5332d tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lazy-loading 'services' on Instance uuid 4df00db4-ce79-4e85-9837-41425c3e02a5 {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 17:20:04.076016 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f063e766-3b13-4d2e-906f-ce0915b5332d tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] 10.222.0.61 "DELETE /compute/v2.1/servers/4df00db4-ce79-4e85-9837-41425c3e02a5/os-volume_attachments/88e281f2-e3f4-42a5-99b1-c3de1756a11d" status: 202 len: 0 microversion: 2.1 time: 0.217104 Aug 31 17:20:04.076796 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3917/7850] 10.222.0.61 () {58 vars in 1416 bytes} [Wed Aug 31 17:20:03 2022] DELETE /compute/v2.1/servers/4df00db4-ce79-4e85-9837-41425c3e02a5/os-volume_attachments/88e281f2-e3f4-42a5-99b1-c3de1756a11d => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 17:20:04.085961 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-12793b1d-1290-4392-88b3-4b9f52893152 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:20:04.088734 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-12793b1d-1290-4392-88b3-4b9f52893152 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] [instance: 4df00db4-ce79-4e85-9837-41425c3e02a5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:20:04.096043 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-12793b1d-1290-4392-88b3-4b9f52893152 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:20:04.096931 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-12793b1d-1290-4392-88b3-4b9f52893152 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:20:04.097641 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-12793b1d-1290-4392-88b3-4b9f52893152 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:20:04.098571 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-12793b1d-1290-4392-88b3-4b9f52893152 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:20:04.099381 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-12793b1d-1290-4392-88b3-4b9f52893152 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:20:04.100069 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-12793b1d-1290-4392-88b3-4b9f52893152 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:20:04.145718 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-12793b1d-1290-4392-88b3-4b9f52893152 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] 10.222.0.61 "GET /compute/v2.1/servers/4df00db4-ce79-4e85-9837-41425c3e02a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063978 Aug 31 17:20:04.146700 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3934/7851] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 17:20:04 2022] GET /compute/v2.1/servers/4df00db4-ce79-4e85-9837-41425c3e02a5/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:20:05.161516 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c2c7ec64-4984-4064-8b41-cd8f0d2503af tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:20:05.163933 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c2c7ec64-4984-4064-8b41-cd8f0d2503af tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] [instance: 4df00db4-ce79-4e85-9837-41425c3e02a5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:20:05.170596 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c2c7ec64-4984-4064-8b41-cd8f0d2503af tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:20:05.171328 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c2c7ec64-4984-4064-8b41-cd8f0d2503af tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:20:05.171818 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c2c7ec64-4984-4064-8b41-cd8f0d2503af tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:20:05.172577 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c2c7ec64-4984-4064-8b41-cd8f0d2503af tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:20:05.173044 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c2c7ec64-4984-4064-8b41-cd8f0d2503af tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:20:05.173478 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c2c7ec64-4984-4064-8b41-cd8f0d2503af tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:20:05.207325 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c2c7ec64-4984-4064-8b41-cd8f0d2503af tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] 10.222.0.61 "GET /compute/v2.1/servers/4df00db4-ce79-4e85-9837-41425c3e02a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051460 Aug 31 17:20:05.208005 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3918/7852] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 17:20:05 2022] GET /compute/v2.1/servers/4df00db4-ce79-4e85-9837-41425c3e02a5/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:20:05.848484 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-394f6c14-82ca-4b58-8632-fae06883b81e req-e017bced-15d6-45c4-87aa-37400a5e2209 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4df00db4-ce79-4e85-9837-41425c3e02a5", "tag": "a53da882-8794-4b13-8010-f298e704ee26"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:20:05.860612 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-394f6c14-82ca-4b58-8632-fae06883b81e req-e017bced-15d6-45c4-87aa-37400a5e2209 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:20:05.861269 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-394f6c14-82ca-4b58-8632-fae06883b81e req-e017bced-15d6-45c4-87aa-37400a5e2209 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:20:05.861870 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-394f6c14-82ca-4b58-8632-fae06883b81e req-e017bced-15d6-45c4-87aa-37400a5e2209 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:20:05.874924 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-394f6c14-82ca-4b58-8632-fae06883b81e req-e017bced-15d6-45c4-87aa-37400a5e2209 service nova] Creating event network-changed:a53da882-8794-4b13-8010-f298e704ee26 for instance 4df00db4-ce79-4e85-9837-41425c3e02a5 on n-h2-850499-9 Aug 31 17:20:05.880279 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-394f6c14-82ca-4b58-8632-fae06883b81e req-e017bced-15d6-45c4-87aa-37400a5e2209 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035506 Aug 31 17:20:05.880988 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3935/7853] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:20:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:20:06.221443 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-febe38b9-d88e-4d38-9c5b-abc94e2289a7 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:20:06.223808 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-febe38b9-d88e-4d38-9c5b-abc94e2289a7 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] [instance: 4df00db4-ce79-4e85-9837-41425c3e02a5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:20:06.233791 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-febe38b9-d88e-4d38-9c5b-abc94e2289a7 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:20:06.234565 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-febe38b9-d88e-4d38-9c5b-abc94e2289a7 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:20:06.235013 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-febe38b9-d88e-4d38-9c5b-abc94e2289a7 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:20:06.235830 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-febe38b9-d88e-4d38-9c5b-abc94e2289a7 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:20:06.236301 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-febe38b9-d88e-4d38-9c5b-abc94e2289a7 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:20:06.236742 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-febe38b9-d88e-4d38-9c5b-abc94e2289a7 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:20:06.271430 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-febe38b9-d88e-4d38-9c5b-abc94e2289a7 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] 10.222.0.61 "GET /compute/v2.1/servers/4df00db4-ce79-4e85-9837-41425c3e02a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053998 Aug 31 17:20:06.276738 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3919/7854] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 17:20:06 2022] GET /compute/v2.1/servers/4df00db4-ce79-4e85-9837-41425c3e02a5/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:20:07.286878 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a074d117-d789-478e-a61a-14d8333ef085 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:20:07.289205 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a074d117-d789-478e-a61a-14d8333ef085 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] [instance: 4df00db4-ce79-4e85-9837-41425c3e02a5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:20:07.295689 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a074d117-d789-478e-a61a-14d8333ef085 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:20:07.296201 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a074d117-d789-478e-a61a-14d8333ef085 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:20:07.296666 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a074d117-d789-478e-a61a-14d8333ef085 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:20:07.297582 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a074d117-d789-478e-a61a-14d8333ef085 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:20:07.298062 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a074d117-d789-478e-a61a-14d8333ef085 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:20:07.298507 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a074d117-d789-478e-a61a-14d8333ef085 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:20:07.331135 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a074d117-d789-478e-a61a-14d8333ef085 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] 10.222.0.61 "GET /compute/v2.1/servers/4df00db4-ce79-4e85-9837-41425c3e02a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049926 Aug 31 17:20:07.331769 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3936/7855] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 17:20:07 2022] GET /compute/v2.1/servers/4df00db4-ce79-4e85-9837-41425c3e02a5/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:20:08.344308 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-35302484-2ec3-451f-b1f3-c3bfafa5ca7d tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:20:08.346523 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-35302484-2ec3-451f-b1f3-c3bfafa5ca7d tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] [instance: 4df00db4-ce79-4e85-9837-41425c3e02a5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:20:08.353985 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-35302484-2ec3-451f-b1f3-c3bfafa5ca7d tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:20:08.354487 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-35302484-2ec3-451f-b1f3-c3bfafa5ca7d tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:20:08.355554 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-35302484-2ec3-451f-b1f3-c3bfafa5ca7d tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:20:08.356460 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-35302484-2ec3-451f-b1f3-c3bfafa5ca7d tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:20:08.356925 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-35302484-2ec3-451f-b1f3-c3bfafa5ca7d tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:20:08.357358 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-35302484-2ec3-451f-b1f3-c3bfafa5ca7d tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:20:08.390080 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-35302484-2ec3-451f-b1f3-c3bfafa5ca7d tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] 10.222.0.61 "GET /compute/v2.1/servers/4df00db4-ce79-4e85-9837-41425c3e02a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050419 Aug 31 17:20:08.390877 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3920/7856] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 17:20:08 2022] GET /compute/v2.1/servers/4df00db4-ce79-4e85-9837-41425c3e02a5/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:20:09.402930 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-99bc9196-552b-4522-8e70-d8a0ebdeda8b tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:20:09.405149 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-99bc9196-552b-4522-8e70-d8a0ebdeda8b tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] [instance: 4df00db4-ce79-4e85-9837-41425c3e02a5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:20:09.412096 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-99bc9196-552b-4522-8e70-d8a0ebdeda8b tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:20:09.412600 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-99bc9196-552b-4522-8e70-d8a0ebdeda8b tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:20:09.413059 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-99bc9196-552b-4522-8e70-d8a0ebdeda8b tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:20:09.413782 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-99bc9196-552b-4522-8e70-d8a0ebdeda8b tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:20:09.414255 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-99bc9196-552b-4522-8e70-d8a0ebdeda8b tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:20:09.414703 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-99bc9196-552b-4522-8e70-d8a0ebdeda8b tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:20:09.445290 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-99bc9196-552b-4522-8e70-d8a0ebdeda8b tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] 10.222.0.61 "GET /compute/v2.1/servers/4df00db4-ce79-4e85-9837-41425c3e02a5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046567 Aug 31 17:20:09.445872 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3937/7857] 10.222.0.61 () {58 vars in 1302 bytes} [Wed Aug 31 17:20:09 2022] GET /compute/v2.1/servers/4df00db4-ce79-4e85-9837-41425c3e02a5/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 17:20:09.458643 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4a9a274c-f1dd-4693-b9bf-db73238f0f3d tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:20:09.459143 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4a9a274c-f1dd-4693-b9bf-db73238f0f3d tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] [instance: 4df00db4-ce79-4e85-9837-41425c3e02a5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:20:09.466323 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4a9a274c-f1dd-4693-b9bf-db73238f0f3d tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:20:09.466809 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4a9a274c-f1dd-4693-b9bf-db73238f0f3d tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:20:09.467245 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4a9a274c-f1dd-4693-b9bf-db73238f0f3d tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:20:09.467978 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4a9a274c-f1dd-4693-b9bf-db73238f0f3d tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:20:09.468437 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4a9a274c-f1dd-4693-b9bf-db73238f0f3d tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:20:09.468867 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4a9a274c-f1dd-4693-b9bf-db73238f0f3d tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:20:09.737635 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-4a9a274c-f1dd-4693-b9bf-db73238f0f3d tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] HTTP exception thrown: Instance 4df00db4-ce79-4e85-9837-41425c3e02a5 is not attached to volume 88e281f2-e3f4-42a5-99b1-c3de1756a11d Aug 31 17:20:09.739523 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4a9a274c-f1dd-4693-b9bf-db73238f0f3d tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Request method failure captured: Aug 31 17:20:09.739523 n-d-850499-9 devstack@n-api.service[122256]: request: DELETE /compute/v2.1/servers/4df00db4-ce79-4e85-9837-41425c3e02a5/os-volume_attachments/88e281f2-e3f4-42a5-99b1-c3de1756a11d HTTP/1.1 Aug 31 17:20:09.739523 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 17:20:09.739523 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 17:20:09.739523 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 17:20:09.739523 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 17:20:09.739523 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 17:20:09.739523 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 17:20:09.739523 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 17:20:09.739523 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 17:20:09.739523 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD5ZTWlsUOViYbuoFWX00IoDHIoR7wiVbj9nZWwE8RDWKHFQGffglz5zLRbY5vUCGvRv2pHB0ndlbXYXyEwkMqNU0MuJK0umo0NZNNDn2HkNLAgy4-1kL5h-NL61_PLB1dUxdcodRWgXBdv0yMH2dIHyNJg-WudcyHiEM_Vn20czKwE4 Aug 31 17:20:09.739523 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 17:20:09.739523 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 17:20:09.739523 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 17:20:09.739523 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 17:20:09.739523 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 17:20:09.739523 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 17:20:09.739523 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 880c2f00b7ee4da0a2b8ad7de99e5cb2 Aug 31 17:20:09.739523 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-TestMinimumBasicScenario-852220423 Aug 31 17:20:09.739523 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 17:20:09.739523 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 17:20:09.739523 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/880c2f00b7ee4da0a2b8ad7de99e5cb2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/880c2f00b7ee4da0a2b8ad7de99e5cb2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_880c2f00b7ee4da0a2b8ad7de99e5cb2", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/880c2f00b7ee4da0a2b8ad7de99e5cb2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 17:20:09.739523 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-TestMinimumBasicScenario-852220423 Aug 31 17:20:09.739523 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 880c2f00b7ee4da0a2b8ad7de99e5cb2 Aug 31 17:20:09.739523 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-TestMinimumBasicScenario-852220423 Aug 31 17:20:09.739523 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-TestMinimumBasicScenario-852220423-project Aug 31 17:20:09.739523 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 17:20:09.739523 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 17:20:09.739523 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 415f3980641e47aa83029a3d94a5d905 Aug 31 17:20:09.739523 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-TestMinimumBasicScenario-852220423-project Aug 31 17:20:09.739523 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 17:20:09.739523 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance 4df00db4-ce79-4e85-9837-41425c3e02a5 is not attached to volume 88e281f2-e3f4-42a5-99b1-c3de1756a11d Aug 31 17:20:09.739523 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'server_id': '4df00db4-ce79-4e85-9837-41425c3e02a5', 'id': '88e281f2-e3f4-42a5-99b1-c3de1756a11d'} Aug 31 17:20:09.739523 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 17:20:09.739523 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:20:09.739523 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 31 17:20:09.739523 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 31 17:20:09.739523 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 17:20:09.739523 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 17:20:09.739523 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 31 17:20:09.739523 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 31 17:20:09.739523 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 88e281f2-e3f4-42a5-99b1-c3de1756a11d. Aug 31 17:20:09.739523 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:20:09.739523 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:20:09.739523 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:20:09.739523 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:20:09.739523 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:20:09.739523 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:20:09.739523 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 17:20:09.739523 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 17:20:09.739523 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 17:20:09.739523 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 17:20:09.739523 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 31 17:20:09.739523 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 31 17:20:09.739523 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4df00db4-ce79-4e85-9837-41425c3e02a5 is not attached to volume 88e281f2-e3f4-42a5-99b1-c3de1756a11d Aug 31 17:20:09.739523 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:20:09.739523 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:20:09.739523 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:20:09.739523 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:20:09.739523 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:20:09.739523 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:20:09.744626 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 17:20:09.744626 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 17:20:09.744626 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4df00db4-ce79-4e85-9837-41425c3e02a5 is not attached to volume 88e281f2-e3f4-42a5-99b1-c3de1756a11d Aug 31 17:20:09.744626 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:20:09.744626 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4a9a274c-f1dd-4693-b9bf-db73238f0f3d tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Returning 404 to user: Instance 4df00db4-ce79-4e85-9837-41425c3e02a5 is not attached to volume 88e281f2-e3f4-42a5-99b1-c3de1756a11d {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 17:20:09.744626 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4a9a274c-f1dd-4693-b9bf-db73238f0f3d tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] 10.222.0.61 "DELETE /compute/v2.1/servers/4df00db4-ce79-4e85-9837-41425c3e02a5/os-volume_attachments/88e281f2-e3f4-42a5-99b1-c3de1756a11d" status: 404 len: 154 microversion: 2.1 time: 0.286899 Aug 31 17:20:09.744626 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3921/7858] 10.222.0.61 () {58 vars in 1416 bytes} [Wed Aug 31 17:20:09 2022] DELETE /compute/v2.1/servers/4df00db4-ce79-4e85-9837-41425c3e02a5/os-volume_attachments/88e281f2-e3f4-42a5-99b1-c3de1756a11d => generated 154 bytes in 288 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 17:20:13.020958 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f48fc1dd-2c2f-4f44-b9b7-fd9813d1fdd5 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:20:13.021488 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f48fc1dd-2c2f-4f44-b9b7-fd9813d1fdd5 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] [instance: 4df00db4-ce79-4e85-9837-41425c3e02a5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:20:13.029202 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f48fc1dd-2c2f-4f44-b9b7-fd9813d1fdd5 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:20:13.029719 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f48fc1dd-2c2f-4f44-b9b7-fd9813d1fdd5 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:20:13.030180 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f48fc1dd-2c2f-4f44-b9b7-fd9813d1fdd5 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:20:13.030909 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f48fc1dd-2c2f-4f44-b9b7-fd9813d1fdd5 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:20:13.031423 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f48fc1dd-2c2f-4f44-b9b7-fd9813d1fdd5 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:20:13.032102 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f48fc1dd-2c2f-4f44-b9b7-fd9813d1fdd5 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:20:13.061142 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f48fc1dd-2c2f-4f44-b9b7-fd9813d1fdd5 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] [instance: 4df00db4-ce79-4e85-9837-41425c3e02a5] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 17:20:13.145406 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f48fc1dd-2c2f-4f44-b9b7-fd9813d1fdd5 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] 10.222.0.61 "DELETE /compute/v2.1/servers/4df00db4-ce79-4e85-9837-41425c3e02a5" status: 204 len: 0 microversion: 2.1 time: 0.128221 Aug 31 17:20:13.145951 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3938/7859] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 17:20:13 2022] DELETE /compute/v2.1/servers/4df00db4-ce79-4e85-9837-41425c3e02a5 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 17:20:13.154394 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e10803df-aaad-4dab-9e08-c5f6f374e66e tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:20:13.155009 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e10803df-aaad-4dab-9e08-c5f6f374e66e tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] [instance: 4df00db4-ce79-4e85-9837-41425c3e02a5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:20:13.162514 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e10803df-aaad-4dab-9e08-c5f6f374e66e tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:20:13.162999 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e10803df-aaad-4dab-9e08-c5f6f374e66e tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:20:13.163435 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e10803df-aaad-4dab-9e08-c5f6f374e66e tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:20:13.164142 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e10803df-aaad-4dab-9e08-c5f6f374e66e tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:20:13.164599 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e10803df-aaad-4dab-9e08-c5f6f374e66e tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:20:13.165024 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e10803df-aaad-4dab-9e08-c5f6f374e66e tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:20:13.310572 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e10803df-aaad-4dab-9e08-c5f6f374e66e tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f3980641e47aa83029a3d94a5d905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880c2f00b7ee4da0a2b8ad7de99e5cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:20:13.318461 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e10803df-aaad-4dab-9e08-c5f6f374e66e tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] 10.222.0.61 "GET /compute/v2.1/servers/4df00db4-ce79-4e85-9837-41425c3e02a5" status: 200 len: 1552 microversion: 2.1 time: 0.168028 Aug 31 17:20:13.319038 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3922/7860] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:20:13 2022] GET /compute/v2.1/servers/4df00db4-ce79-4e85-9837-41425c3e02a5 => generated 1552 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:20:14.340654 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d509f96c-f249-4f04-9efa-4a53b3319f24 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:20:14.341392 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d509f96c-f249-4f04-9efa-4a53b3319f24 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] [instance: 4df00db4-ce79-4e85-9837-41425c3e02a5] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:20:14.348338 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d509f96c-f249-4f04-9efa-4a53b3319f24 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:20:14.348842 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d509f96c-f249-4f04-9efa-4a53b3319f24 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:20:14.349300 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d509f96c-f249-4f04-9efa-4a53b3319f24 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:20:14.350014 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d509f96c-f249-4f04-9efa-4a53b3319f24 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:20:14.350490 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d509f96c-f249-4f04-9efa-4a53b3319f24 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:20:14.350939 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d509f96c-f249-4f04-9efa-4a53b3319f24 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:20:14.531119 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d509f96c-f249-4f04-9efa-4a53b3319f24 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f3980641e47aa83029a3d94a5d905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880c2f00b7ee4da0a2b8ad7de99e5cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:20:14.539221 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d509f96c-f249-4f04-9efa-4a53b3319f24 tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] 10.222.0.61 "GET /compute/v2.1/servers/4df00db4-ce79-4e85-9837-41425c3e02a5" status: 200 len: 1552 microversion: 2.1 time: 0.203932 Aug 31 17:20:14.539868 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3939/7861] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:20:14 2022] GET /compute/v2.1/servers/4df00db4-ce79-4e85-9837-41425c3e02a5 => generated 1552 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:20:15.561208 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4ab22329-d2b7-422b-ba0a-5089490369dc tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:20:15.561879 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4ab22329-d2b7-422b-ba0a-5089490369dc tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] [instance: 4df00db4-ce79-4e85-9837-41425c3e02a5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:20:15.569107 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4ab22329-d2b7-422b-ba0a-5089490369dc tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:20:15.569609 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4ab22329-d2b7-422b-ba0a-5089490369dc tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:20:15.570061 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4ab22329-d2b7-422b-ba0a-5089490369dc tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:20:15.570786 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4ab22329-d2b7-422b-ba0a-5089490369dc tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:20:15.571366 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4ab22329-d2b7-422b-ba0a-5089490369dc tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:20:15.571700 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4ab22329-d2b7-422b-ba0a-5089490369dc tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:20:15.780304 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-4ab22329-d2b7-422b-ba0a-5089490369dc tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '415f3980641e47aa83029a3d94a5d905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880c2f00b7ee4da0a2b8ad7de99e5cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:20:15.787956 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4ab22329-d2b7-422b-ba0a-5089490369dc tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] 10.222.0.61 "GET /compute/v2.1/servers/4df00db4-ce79-4e85-9837-41425c3e02a5" status: 200 len: 1552 microversion: 2.1 time: 0.231396 Aug 31 17:20:15.788531 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3923/7862] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:20:15 2022] GET /compute/v2.1/servers/4df00db4-ce79-4e85-9837-41425c3e02a5 => generated 1552 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:20:15.900220 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-09cabe2c-ccdc-429b-9cb8-43ff1b7271bd req-3d21ed20-b350-4eb5-9e2d-c774fbb9b370 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4df00db4-ce79-4e85-9837-41425c3e02a5", "name": "network-vif-deleted", "tag": "a53da882-8794-4b13-8010-f298e704ee26"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:20:15.912949 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-09cabe2c-ccdc-429b-9cb8-43ff1b7271bd req-3d21ed20-b350-4eb5-9e2d-c774fbb9b370 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:20:15.913442 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-09cabe2c-ccdc-429b-9cb8-43ff1b7271bd req-3d21ed20-b350-4eb5-9e2d-c774fbb9b370 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:20:15.913898 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-09cabe2c-ccdc-429b-9cb8-43ff1b7271bd req-3d21ed20-b350-4eb5-9e2d-c774fbb9b370 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:20:15.929225 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-09cabe2c-ccdc-429b-9cb8-43ff1b7271bd req-3d21ed20-b350-4eb5-9e2d-c774fbb9b370 service nova] Creating event network-vif-deleted:a53da882-8794-4b13-8010-f298e704ee26 for instance 4df00db4-ce79-4e85-9837-41425c3e02a5 on n-h2-850499-9 Aug 31 17:20:15.937157 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-09cabe2c-ccdc-429b-9cb8-43ff1b7271bd req-3d21ed20-b350-4eb5-9e2d-c774fbb9b370 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040290 Aug 31 17:20:15.939156 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3940/7863] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:20:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:20:16.810095 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3fe9a1b6-e9f6-45ce-97ba-17a0a690eece tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:20:16.810740 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3fe9a1b6-e9f6-45ce-97ba-17a0a690eece tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] [instance: 4df00db4-ce79-4e85-9837-41425c3e02a5] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:20:16.817671 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3fe9a1b6-e9f6-45ce-97ba-17a0a690eece tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:20:16.818146 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3fe9a1b6-e9f6-45ce-97ba-17a0a690eece tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:20:16.818582 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3fe9a1b6-e9f6-45ce-97ba-17a0a690eece tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:20:16.819277 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3fe9a1b6-e9f6-45ce-97ba-17a0a690eece tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:20:16.819767 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3fe9a1b6-e9f6-45ce-97ba-17a0a690eece tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:20:16.820199 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3fe9a1b6-e9f6-45ce-97ba-17a0a690eece tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:20:16.834352 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-3fe9a1b6-e9f6-45ce-97ba-17a0a690eece tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] HTTP exception thrown: Instance 4df00db4-ce79-4e85-9837-41425c3e02a5 could not be found. Aug 31 17:20:16.835957 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3fe9a1b6-e9f6-45ce-97ba-17a0a690eece tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Request method failure captured: Aug 31 17:20:16.835957 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/4df00db4-ce79-4e85-9837-41425c3e02a5 HTTP/1.1 Aug 31 17:20:16.835957 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 17:20:16.835957 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 17:20:16.835957 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 17:20:16.835957 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 17:20:16.835957 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 17:20:16.835957 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 17:20:16.835957 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 17:20:16.835957 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 17:20:16.835957 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD5ZTWlsUOViYbuoFWX00IoDHIoR7wiVbj9nZWwE8RDWKHFQGffglz5zLRbY5vUCGvRv2pHB0ndlbXYXyEwkMqNU0MuJK0umo0NZNNDn2HkNLAgy4-1kL5h-NL61_PLB1dUxdcodRWgXBdv0yMH2dIHyNJg-WudcyHiEM_Vn20czKwE4 Aug 31 17:20:16.835957 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 17:20:16.835957 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 17:20:16.835957 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 17:20:16.835957 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 17:20:16.835957 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 17:20:16.835957 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 17:20:16.835957 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 880c2f00b7ee4da0a2b8ad7de99e5cb2 Aug 31 17:20:16.835957 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-TestMinimumBasicScenario-852220423 Aug 31 17:20:16.835957 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 17:20:16.835957 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 17:20:16.835957 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/880c2f00b7ee4da0a2b8ad7de99e5cb2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/880c2f00b7ee4da0a2b8ad7de99e5cb2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_880c2f00b7ee4da0a2b8ad7de99e5cb2", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/880c2f00b7ee4da0a2b8ad7de99e5cb2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 17:20:16.835957 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-TestMinimumBasicScenario-852220423 Aug 31 17:20:16.835957 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 880c2f00b7ee4da0a2b8ad7de99e5cb2 Aug 31 17:20:16.835957 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-TestMinimumBasicScenario-852220423 Aug 31 17:20:16.835957 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-TestMinimumBasicScenario-852220423-project Aug 31 17:20:16.835957 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 17:20:16.835957 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 17:20:16.835957 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 415f3980641e47aa83029a3d94a5d905 Aug 31 17:20:16.835957 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-TestMinimumBasicScenario-852220423-project Aug 31 17:20:16.835957 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 17:20:16.835957 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance 4df00db4-ce79-4e85-9837-41425c3e02a5 could not be found. Aug 31 17:20:16.835957 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '4df00db4-ce79-4e85-9837-41425c3e02a5'} Aug 31 17:20:16.835957 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 17:20:16.835957 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:20:16.835957 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 17:20:16.835957 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 17:20:16.835957 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 17:20:16.835957 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 17:20:16.835957 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 17:20:16.835957 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 17:20:16.835957 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 17:20:16.835957 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 17:20:16.835957 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4df00db4-ce79-4e85-9837-41425c3e02a5 could not be found. Aug 31 17:20:16.835957 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:20:16.835957 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:20:16.835957 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:20:16.835957 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:20:16.835957 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:20:16.835957 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:20:16.835957 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 17:20:16.835957 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 17:20:16.835957 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 17:20:16.835957 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 17:20:16.835957 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 17:20:16.835957 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 17:20:16.835957 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 17:20:16.835957 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 17:20:16.835957 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 17:20:16.835957 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 17:20:16.835957 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4df00db4-ce79-4e85-9837-41425c3e02a5 could not be found. Aug 31 17:20:16.835957 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:20:16.835957 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:20:16.835957 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:20:16.841224 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:20:16.841224 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:20:16.841224 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:20:16.841224 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 17:20:16.841224 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 17:20:16.841224 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4df00db4-ce79-4e85-9837-41425c3e02a5 could not be found. Aug 31 17:20:16.841224 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:20:16.841224 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3fe9a1b6-e9f6-45ce-97ba-17a0a690eece tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Returning 404 to user: Instance 4df00db4-ce79-4e85-9837-41425c3e02a5 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 17:20:16.841224 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3fe9a1b6-e9f6-45ce-97ba-17a0a690eece tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] 10.222.0.61 "GET /compute/v2.1/servers/4df00db4-ce79-4e85-9837-41425c3e02a5" status: 404 len: 111 microversion: 2.1 time: 0.031756 Aug 31 17:20:16.841224 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3924/7864] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:20:16 2022] GET /compute/v2.1/servers/4df00db4-ce79-4e85-9837-41425c3e02a5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 17:20:16.847253 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-56f4fc63-3e4a-433c-a9c4-eee92142237e tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] Calling method '.version_select at 0x7f5ae9054280>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:20:16.851808 n-d-850499-9 devstack@n-api.service[122257]: ERROR oslo.messaging._drivers.impl_rabbit [None req-56f4fc63-3e4a-433c-a9c4-eee92142237e tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] [71efe5ec-3448-444a-b5c7-a9d033d02814] AMQP server on 10.222.0.61:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 31 17:20:17.859581 n-d-850499-9 devstack@n-api.service[122257]: INFO oslo.messaging._drivers.impl_rabbit [None req-56f4fc63-3e4a-433c-a9c4-eee92142237e tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] [71efe5ec-3448-444a-b5c7-a9d033d02814] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 39318. Aug 31 17:20:17.880142 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-56f4fc63-3e4a-433c-a9c4-eee92142237e tempest-TestMinimumBasicScenario-852220423 tempest-TestMinimumBasicScenario-852220423-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-419807862" status: 202 len: 0 microversion: 2.1 time: 1.037030 Aug 31 17:20:17.881432 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3941/7865] 10.222.0.61 () {58 vars in 1269 bytes} [Wed Aug 31 17:20:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-419807862 => generated 0 bytes in 1039 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 17:20:27.145386 n-d-850499-9 devstack@n-api.service[122256]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 17:20:27.146164 n-d-850499-9 devstack@n-api.service[122256]: Wed Aug 31 17:20:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.61) !!! Aug 31 17:20:27.146675 n-d-850499-9 devstack@n-api.service[122256]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 17:20:27.146902 n-d-850499-9 devstack@n-api.service[122256]: Wed Aug 31 17:20:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.61) !!! Aug 31 17:20:27.147790 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=18 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:20:27.148527 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=51,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:20:27.357429 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e6e497ce-dbf1-4559-9959-a80708e9082e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Action: 'create', calling method: .version_select at 0x7f5ae3f37820>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1897253794", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEgP9HDeTJtO6F0iqNBkKKb0wNPgFsbiwB1Pe4VdM3cRKWVF1985pAW0xX5lamgjIfCl1BUX3YgPJhV1oaMVsmdmvBUOgtKEExEqXGAYc11t1FGdf31R8N9YHncvkyGXMw=="}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:20:27.378912 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-e6e497ce-dbf1-4559-9959-a80708e9082e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Getting quotas for project dc47c533fa344b1caa1082a8caf19e36. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 17:20:27.385332 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-e6e497ce-dbf1-4559-9959-a80708e9082e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Getting quotas for user 684d0544424b41fe951feb12dae6b1c2 and project dc47c533fa344b1caa1082a8caf19e36. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 17:20:27.424514 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e6e497ce-dbf1-4559-9959-a80708e9082e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.284681 Aug 31 17:20:27.425580 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3925/7866] 10.222.0.61 () {60 vars in 1159 bytes} [Wed Aug 31 17:20:27 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:20:33.434848 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:20:33.436502 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:20:33.441653 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d8be55eb-3580-4df6-9de6-a5ebe8cec219 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-564088249", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "networks": [{"uuid": "12550fcd-128f-4dc4-bf4a-d9f8c752658c"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1897253794", "security_groups": [{"name": "tempest-secgroup-smoke-740465610"}]}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:20:33.560679 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-d8be55eb-3580-4df6-9de6-a5ebe8cec219 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] validate_networks() for [('12550fcd-128f-4dc4-bf4a-d9f8c752658c', None, None, None, None, None)] {{(pid=122257) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 17:20:34.056081 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-d8be55eb-3580-4df6-9de6-a5ebe8cec219 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 17:20:34.056858 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-d8be55eb-3580-4df6-9de6-a5ebe8cec219 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 17:20:34.057438 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-d8be55eb-3580-4df6-9de6-a5ebe8cec219 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 17:20:34.057919 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-d8be55eb-3580-4df6-9de6-a5ebe8cec219 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 17:20:34.058595 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-d8be55eb-3580-4df6-9de6-a5ebe8cec219 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 17:20:34.068333 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d8be55eb-3580-4df6-9de6-a5ebe8cec219 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:20:34.068850 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d8be55eb-3580-4df6-9de6-a5ebe8cec219 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:20:34.069312 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d8be55eb-3580-4df6-9de6-a5ebe8cec219 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:20:34.070067 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d8be55eb-3580-4df6-9de6-a5ebe8cec219 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:20:34.070569 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d8be55eb-3580-4df6-9de6-a5ebe8cec219 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:20:34.071022 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d8be55eb-3580-4df6-9de6-a5ebe8cec219 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:20:34.090676 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-d8be55eb-3580-4df6-9de6-a5ebe8cec219 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Getting quotas for project dc47c533fa344b1caa1082a8caf19e36. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 17:20:34.098301 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-d8be55eb-3580-4df6-9de6-a5ebe8cec219 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Getting quotas for user 684d0544424b41fe951feb12dae6b1c2 and project dc47c533fa344b1caa1082a8caf19e36. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 17:20:34.113054 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d8be55eb-3580-4df6-9de6-a5ebe8cec219 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Going to run 1 instances... {{(pid=122257) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 17:20:34.116645 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d8be55eb-3580-4df6-9de6-a5ebe8cec219 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 495e2a65-0042-4ae1-bfeb-0cfcb6b0f45b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 17:20:34.175332 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d8be55eb-3580-4df6-9de6-a5ebe8cec219 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.742502 Aug 31 17:20:34.176163 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3942/7867] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 17:20:33 2022] POST /compute/v2.1/servers => generated 405 bytes in 744 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 17:20:34.188768 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2f2f25d5-56ce-4c23-8744-367c5bdfd7bc tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:20:34.189395 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2f2f25d5-56ce-4c23-8744-367c5bdfd7bc tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 495e2a65-0042-4ae1-bfeb-0cfcb6b0f45b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:20:34.270385 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-2f2f25d5-56ce-4c23-8744-367c5bdfd7bc tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:20:34.282248 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2f2f25d5-56ce-4c23-8744-367c5bdfd7bc tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/495e2a65-0042-4ae1-bfeb-0cfcb6b0f45b" status: 200 len: 1266 microversion: 2.1 time: 0.098633 Aug 31 17:20:34.284305 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3926/7868] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:20:34 2022] GET /compute/v2.1/servers/495e2a65-0042-4ae1-bfeb-0cfcb6b0f45b => generated 1266 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:20:35.304793 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-bb140689-c955-4c5a-a582-f4e916048187 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:20:35.305336 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-bb140689-c955-4c5a-a582-f4e916048187 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 495e2a65-0042-4ae1-bfeb-0cfcb6b0f45b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:20:35.312539 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bb140689-c955-4c5a-a582-f4e916048187 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:20:35.313043 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bb140689-c955-4c5a-a582-f4e916048187 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:20:35.313496 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bb140689-c955-4c5a-a582-f4e916048187 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:20:35.314228 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bb140689-c955-4c5a-a582-f4e916048187 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:20:35.314705 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bb140689-c955-4c5a-a582-f4e916048187 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:20:35.315140 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bb140689-c955-4c5a-a582-f4e916048187 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:20:35.378443 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-bb140689-c955-4c5a-a582-f4e916048187 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:20:35.387575 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-bb140689-c955-4c5a-a582-f4e916048187 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/495e2a65-0042-4ae1-bfeb-0cfcb6b0f45b" status: 200 len: 1318 microversion: 2.1 time: 0.087195 Aug 31 17:20:35.388537 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3943/7869] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:20:35 2022] GET /compute/v2.1/servers/495e2a65-0042-4ae1-bfeb-0cfcb6b0f45b => generated 1318 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:20:36.410383 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9bac109a-9314-41e6-88a0-f1a94ff6adbc tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:20:36.411168 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9bac109a-9314-41e6-88a0-f1a94ff6adbc tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 495e2a65-0042-4ae1-bfeb-0cfcb6b0f45b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:20:36.420403 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9bac109a-9314-41e6-88a0-f1a94ff6adbc tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:20:36.420943 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9bac109a-9314-41e6-88a0-f1a94ff6adbc tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:20:36.421580 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9bac109a-9314-41e6-88a0-f1a94ff6adbc tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:20:36.422308 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9bac109a-9314-41e6-88a0-f1a94ff6adbc tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:20:36.422951 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9bac109a-9314-41e6-88a0-f1a94ff6adbc tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:20:36.423386 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9bac109a-9314-41e6-88a0-f1a94ff6adbc tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:20:36.519638 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-9bac109a-9314-41e6-88a0-f1a94ff6adbc tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:20:36.528051 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9bac109a-9314-41e6-88a0-f1a94ff6adbc tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/495e2a65-0042-4ae1-bfeb-0cfcb6b0f45b" status: 200 len: 1324 microversion: 2.1 time: 0.121549 Aug 31 17:20:36.528644 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3927/7870] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:20:36 2022] GET /compute/v2.1/servers/495e2a65-0042-4ae1-bfeb-0cfcb6b0f45b => generated 1324 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:20:37.416876 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-7bf84d6a-2ca6-4e2c-9d02-468a8fc6bb78 req-48b4d0b6-1e9c-4ff3-8e35-c2c5f8137432 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "495e2a65-0042-4ae1-bfeb-0cfcb6b0f45b", "tag": "916722ee-43a9-47c5-a50a-d484a15ec7a4"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:20:37.430018 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-7bf84d6a-2ca6-4e2c-9d02-468a8fc6bb78 req-48b4d0b6-1e9c-4ff3-8e35-c2c5f8137432 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:20:37.430623 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-7bf84d6a-2ca6-4e2c-9d02-468a8fc6bb78 req-48b4d0b6-1e9c-4ff3-8e35-c2c5f8137432 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:20:37.431424 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-7bf84d6a-2ca6-4e2c-9d02-468a8fc6bb78 req-48b4d0b6-1e9c-4ff3-8e35-c2c5f8137432 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:20:37.443821 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-7bf84d6a-2ca6-4e2c-9d02-468a8fc6bb78 req-48b4d0b6-1e9c-4ff3-8e35-c2c5f8137432 service nova] Creating event network-changed:916722ee-43a9-47c5-a50a-d484a15ec7a4 for instance 495e2a65-0042-4ae1-bfeb-0cfcb6b0f45b on n-h1-850499-9 Aug 31 17:20:37.454802 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-7bf84d6a-2ca6-4e2c-9d02-468a8fc6bb78 req-48b4d0b6-1e9c-4ff3-8e35-c2c5f8137432 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042573 Aug 31 17:20:37.455428 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3944/7871] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:20:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:20:37.549220 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-04a13484-14e7-45ab-9c1d-31669d1587db tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:20:37.549922 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-04a13484-14e7-45ab-9c1d-31669d1587db tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 495e2a65-0042-4ae1-bfeb-0cfcb6b0f45b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:20:37.556960 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-04a13484-14e7-45ab-9c1d-31669d1587db tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:20:37.557553 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-04a13484-14e7-45ab-9c1d-31669d1587db tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:20:37.558638 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-04a13484-14e7-45ab-9c1d-31669d1587db tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:20:37.559415 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-04a13484-14e7-45ab-9c1d-31669d1587db tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:20:37.559969 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-04a13484-14e7-45ab-9c1d-31669d1587db tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:20:37.560473 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-04a13484-14e7-45ab-9c1d-31669d1587db tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:20:37.769807 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-04a13484-14e7-45ab-9c1d-31669d1587db tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:20:37.779190 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-04a13484-14e7-45ab-9c1d-31669d1587db tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/495e2a65-0042-4ae1-bfeb-0cfcb6b0f45b" status: 200 len: 1391 microversion: 2.1 time: 0.233810 Aug 31 17:20:37.779825 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3928/7872] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:20:37 2022] GET /compute/v2.1/servers/495e2a65-0042-4ae1-bfeb-0cfcb6b0f45b => generated 1391 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:20:38.801417 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d22e849d-8a98-462e-965d-cb0c5b4d7e33 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:20:38.802145 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d22e849d-8a98-462e-965d-cb0c5b4d7e33 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 495e2a65-0042-4ae1-bfeb-0cfcb6b0f45b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:20:38.810033 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d22e849d-8a98-462e-965d-cb0c5b4d7e33 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:20:38.810535 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d22e849d-8a98-462e-965d-cb0c5b4d7e33 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:20:38.810991 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d22e849d-8a98-462e-965d-cb0c5b4d7e33 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:20:38.811746 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d22e849d-8a98-462e-965d-cb0c5b4d7e33 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:20:38.812223 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d22e849d-8a98-462e-965d-cb0c5b4d7e33 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:20:38.812670 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d22e849d-8a98-462e-965d-cb0c5b4d7e33 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:20:38.969325 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d22e849d-8a98-462e-965d-cb0c5b4d7e33 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:20:38.977138 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d22e849d-8a98-462e-965d-cb0c5b4d7e33 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/495e2a65-0042-4ae1-bfeb-0cfcb6b0f45b" status: 200 len: 1391 microversion: 2.1 time: 0.180014 Aug 31 17:20:38.977713 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3945/7873] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:20:38 2022] GET /compute/v2.1/servers/495e2a65-0042-4ae1-bfeb-0cfcb6b0f45b => generated 1391 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:20:39.998910 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-261b65dc-012e-42f6-b321-60f52e3ceb75 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:20:39.999890 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-261b65dc-012e-42f6-b321-60f52e3ceb75 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 495e2a65-0042-4ae1-bfeb-0cfcb6b0f45b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:20:40.009256 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-261b65dc-012e-42f6-b321-60f52e3ceb75 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:20:40.009755 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-261b65dc-012e-42f6-b321-60f52e3ceb75 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:20:40.010199 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-261b65dc-012e-42f6-b321-60f52e3ceb75 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:20:40.010910 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-261b65dc-012e-42f6-b321-60f52e3ceb75 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:20:40.011367 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-261b65dc-012e-42f6-b321-60f52e3ceb75 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:20:40.011822 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-261b65dc-012e-42f6-b321-60f52e3ceb75 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:20:40.169948 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-261b65dc-012e-42f6-b321-60f52e3ceb75 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:20:40.180332 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-261b65dc-012e-42f6-b321-60f52e3ceb75 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/495e2a65-0042-4ae1-bfeb-0cfcb6b0f45b" status: 200 len: 1391 microversion: 2.1 time: 0.185431 Aug 31 17:20:40.180929 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3929/7874] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:20:39 2022] GET /compute/v2.1/servers/495e2a65-0042-4ae1-bfeb-0cfcb6b0f45b => generated 1391 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:20:41.201622 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-17976e14-0dfa-4ca8-95ef-f4f41802da74 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:20:41.202219 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-17976e14-0dfa-4ca8-95ef-f4f41802da74 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 495e2a65-0042-4ae1-bfeb-0cfcb6b0f45b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:20:41.209148 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-17976e14-0dfa-4ca8-95ef-f4f41802da74 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:20:41.209652 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-17976e14-0dfa-4ca8-95ef-f4f41802da74 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:20:41.210143 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-17976e14-0dfa-4ca8-95ef-f4f41802da74 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:20:41.210854 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-17976e14-0dfa-4ca8-95ef-f4f41802da74 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:20:41.211329 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-17976e14-0dfa-4ca8-95ef-f4f41802da74 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:20:41.211805 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-17976e14-0dfa-4ca8-95ef-f4f41802da74 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:20:41.356733 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-17976e14-0dfa-4ca8-95ef-f4f41802da74 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:20:41.364591 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-17976e14-0dfa-4ca8-95ef-f4f41802da74 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/495e2a65-0042-4ae1-bfeb-0cfcb6b0f45b" status: 200 len: 1391 microversion: 2.1 time: 0.167688 Aug 31 17:20:41.365189 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3946/7875] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:20:41 2022] GET /compute/v2.1/servers/495e2a65-0042-4ae1-bfeb-0cfcb6b0f45b => generated 1391 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 17:20:42.386549 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-44c614a6-8c51-46bb-a929-816f1af6f4ca tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:20:42.387158 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-44c614a6-8c51-46bb-a929-816f1af6f4ca tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 495e2a65-0042-4ae1-bfeb-0cfcb6b0f45b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:20:42.394671 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-44c614a6-8c51-46bb-a929-816f1af6f4ca tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:20:42.395171 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-44c614a6-8c51-46bb-a929-816f1af6f4ca tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:20:42.395645 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-44c614a6-8c51-46bb-a929-816f1af6f4ca tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:20:42.396367 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-44c614a6-8c51-46bb-a929-816f1af6f4ca tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:20:42.396842 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-44c614a6-8c51-46bb-a929-816f1af6f4ca tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:20:42.397279 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-44c614a6-8c51-46bb-a929-816f1af6f4ca tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:20:42.539875 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-44c614a6-8c51-46bb-a929-816f1af6f4ca tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:20:42.548083 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-44c614a6-8c51-46bb-a929-816f1af6f4ca tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/495e2a65-0042-4ae1-bfeb-0cfcb6b0f45b" status: 200 len: 1391 microversion: 2.1 time: 0.165714 Aug 31 17:20:42.548687 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3930/7876] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:20:42 2022] GET /compute/v2.1/servers/495e2a65-0042-4ae1-bfeb-0cfcb6b0f45b => generated 1391 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:20:43.569788 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-fc79320d-bba5-4062-8f92-a119ec05c9d7 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:20:43.570499 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-fc79320d-bba5-4062-8f92-a119ec05c9d7 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 495e2a65-0042-4ae1-bfeb-0cfcb6b0f45b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:20:43.579839 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fc79320d-bba5-4062-8f92-a119ec05c9d7 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:20:43.580392 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fc79320d-bba5-4062-8f92-a119ec05c9d7 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:20:43.580863 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fc79320d-bba5-4062-8f92-a119ec05c9d7 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:20:43.581606 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fc79320d-bba5-4062-8f92-a119ec05c9d7 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:20:43.582798 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fc79320d-bba5-4062-8f92-a119ec05c9d7 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:20:43.583280 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fc79320d-bba5-4062-8f92-a119ec05c9d7 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:20:43.684349 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-c08ca0f0-afbc-45a8-93ae-1b1cd9ace75f req-1490e9f5-6980-4f13-8211-73fed6d3d83e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "495e2a65-0042-4ae1-bfeb-0cfcb6b0f45b", "name": "network-vif-plugged", "status": "completed", "tag": "916722ee-43a9-47c5-a50a-d484a15ec7a4"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:20:43.696261 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-c08ca0f0-afbc-45a8-93ae-1b1cd9ace75f req-1490e9f5-6980-4f13-8211-73fed6d3d83e service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:20:43.696261 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-c08ca0f0-afbc-45a8-93ae-1b1cd9ace75f req-1490e9f5-6980-4f13-8211-73fed6d3d83e service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:20:43.696779 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-c08ca0f0-afbc-45a8-93ae-1b1cd9ace75f req-1490e9f5-6980-4f13-8211-73fed6d3d83e service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:20:43.709679 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-c08ca0f0-afbc-45a8-93ae-1b1cd9ace75f req-1490e9f5-6980-4f13-8211-73fed6d3d83e service nova] Creating event network-vif-plugged:916722ee-43a9-47c5-a50a-d484a15ec7a4 for instance 495e2a65-0042-4ae1-bfeb-0cfcb6b0f45b on n-h1-850499-9 Aug 31 17:20:43.716003 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-c08ca0f0-afbc-45a8-93ae-1b1cd9ace75f req-1490e9f5-6980-4f13-8211-73fed6d3d83e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035309 Aug 31 17:20:43.716631 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3931/7877] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:20:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 17:20:43.735397 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-fc79320d-bba5-4062-8f92-a119ec05c9d7 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:20:43.743358 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-fc79320d-bba5-4062-8f92-a119ec05c9d7 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/495e2a65-0042-4ae1-bfeb-0cfcb6b0f45b" status: 200 len: 1391 microversion: 2.1 time: 0.177870 Aug 31 17:20:43.744055 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3947/7878] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:20:43 2022] GET /compute/v2.1/servers/495e2a65-0042-4ae1-bfeb-0cfcb6b0f45b => generated 1391 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:20:44.762005 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=6 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:20:44.767765 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-466524c4-b3ff-499b-8c01-d63a1905a4b4 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:20:44.768511 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-466524c4-b3ff-499b-8c01-d63a1905a4b4 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 495e2a65-0042-4ae1-bfeb-0cfcb6b0f45b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:20:44.775192 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-466524c4-b3ff-499b-8c01-d63a1905a4b4 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:20:44.775732 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-466524c4-b3ff-499b-8c01-d63a1905a4b4 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:20:44.776184 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-466524c4-b3ff-499b-8c01-d63a1905a4b4 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:20:44.777465 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-466524c4-b3ff-499b-8c01-d63a1905a4b4 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:20:44.777935 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-466524c4-b3ff-499b-8c01-d63a1905a4b4 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:20:44.778378 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-466524c4-b3ff-499b-8c01-d63a1905a4b4 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:20:44.919239 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-466524c4-b3ff-499b-8c01-d63a1905a4b4 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:20:44.927038 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-466524c4-b3ff-499b-8c01-d63a1905a4b4 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/495e2a65-0042-4ae1-bfeb-0cfcb6b0f45b" status: 200 len: 1391 microversion: 2.1 time: 0.166585 Aug 31 17:20:44.927632 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3932/7879] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:20:44 2022] GET /compute/v2.1/servers/495e2a65-0042-4ae1-bfeb-0cfcb6b0f45b => generated 1391 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:20:45.949847 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-817daaee-398b-485e-b254-9f6ae28cb4e3 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:20:45.950510 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-817daaee-398b-485e-b254-9f6ae28cb4e3 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 495e2a65-0042-4ae1-bfeb-0cfcb6b0f45b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:20:45.952605 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:20:45.953319 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=6 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:20:45.960406 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-817daaee-398b-485e-b254-9f6ae28cb4e3 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:20:45.960921 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-817daaee-398b-485e-b254-9f6ae28cb4e3 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:20:45.961383 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-817daaee-398b-485e-b254-9f6ae28cb4e3 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:20:45.962108 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-817daaee-398b-485e-b254-9f6ae28cb4e3 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:20:45.962590 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-817daaee-398b-485e-b254-9f6ae28cb4e3 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:20:45.963043 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-817daaee-398b-485e-b254-9f6ae28cb4e3 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:20:46.101973 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-817daaee-398b-485e-b254-9f6ae28cb4e3 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:20:46.109917 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-817daaee-398b-485e-b254-9f6ae28cb4e3 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/495e2a65-0042-4ae1-bfeb-0cfcb6b0f45b" status: 200 len: 1562 microversion: 2.1 time: 0.165270 Aug 31 17:20:46.110487 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3948/7880] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:20:45 2022] GET /compute/v2.1/servers/495e2a65-0042-4ae1-bfeb-0cfcb6b0f45b => generated 1562 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:20:46.130834 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c4e05201-d199-4bd7-9d6c-f69c171bfb4e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:20:46.131450 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c4e05201-d199-4bd7-9d6c-f69c171bfb4e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 495e2a65-0042-4ae1-bfeb-0cfcb6b0f45b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:20:46.139259 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c4e05201-d199-4bd7-9d6c-f69c171bfb4e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:20:46.139765 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c4e05201-d199-4bd7-9d6c-f69c171bfb4e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:20:46.140202 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c4e05201-d199-4bd7-9d6c-f69c171bfb4e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:20:46.140909 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c4e05201-d199-4bd7-9d6c-f69c171bfb4e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:20:46.141368 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c4e05201-d199-4bd7-9d6c-f69c171bfb4e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:20:46.141800 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c4e05201-d199-4bd7-9d6c-f69c171bfb4e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:20:46.282490 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c4e05201-d199-4bd7-9d6c-f69c171bfb4e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:20:46.290235 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c4e05201-d199-4bd7-9d6c-f69c171bfb4e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/495e2a65-0042-4ae1-bfeb-0cfcb6b0f45b" status: 200 len: 1562 microversion: 2.1 time: 0.163221 Aug 31 17:20:46.290828 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3933/7881] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:20:46 2022] GET /compute/v2.1/servers/495e2a65-0042-4ae1-bfeb-0cfcb6b0f45b => generated 1562 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:20:47.940153 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-b073aeb1-787f-4d71-b0c7-ff20ea4aadd9 req-709f10b8-d812-4833-8b88-3d8518d167f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "495e2a65-0042-4ae1-bfeb-0cfcb6b0f45b", "tag": "916722ee-43a9-47c5-a50a-d484a15ec7a4"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:20:47.951240 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-143a8231-1633-4dc2-b47b-54759e9e976f tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:20:47.951825 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-b073aeb1-787f-4d71-b0c7-ff20ea4aadd9 req-709f10b8-d812-4833-8b88-3d8518d167f7 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:20:47.951919 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-143a8231-1633-4dc2-b47b-54759e9e976f tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 495e2a65-0042-4ae1-bfeb-0cfcb6b0f45b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:20:47.952315 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-b073aeb1-787f-4d71-b0c7-ff20ea4aadd9 req-709f10b8-d812-4833-8b88-3d8518d167f7 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:20:47.953015 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-b073aeb1-787f-4d71-b0c7-ff20ea4aadd9 req-709f10b8-d812-4833-8b88-3d8518d167f7 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:20:47.959242 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-143a8231-1633-4dc2-b47b-54759e9e976f tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:20:47.959784 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-143a8231-1633-4dc2-b47b-54759e9e976f tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:20:47.960242 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-143a8231-1633-4dc2-b47b-54759e9e976f tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:20:47.960960 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-143a8231-1633-4dc2-b47b-54759e9e976f tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:20:47.961438 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-143a8231-1633-4dc2-b47b-54759e9e976f tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:20:47.961878 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-143a8231-1633-4dc2-b47b-54759e9e976f tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:20:47.965339 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-b073aeb1-787f-4d71-b0c7-ff20ea4aadd9 req-709f10b8-d812-4833-8b88-3d8518d167f7 service nova] Creating event network-changed:916722ee-43a9-47c5-a50a-d484a15ec7a4 for instance 495e2a65-0042-4ae1-bfeb-0cfcb6b0f45b on n-h1-850499-9 Aug 31 17:20:47.970550 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-b073aeb1-787f-4d71-b0c7-ff20ea4aadd9 req-709f10b8-d812-4833-8b88-3d8518d167f7 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034038 Aug 31 17:20:47.971167 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3934/7882] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:20:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:20:48.195687 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-143a8231-1633-4dc2-b47b-54759e9e976f tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:20:48.206328 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-143a8231-1633-4dc2-b47b-54759e9e976f tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/495e2a65-0042-4ae1-bfeb-0cfcb6b0f45b" status: 200 len: 1562 microversion: 2.1 time: 0.272174 Aug 31 17:20:48.207027 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3949/7883] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:20:47 2022] GET /compute/v2.1/servers/495e2a65-0042-4ae1-bfeb-0cfcb6b0f45b => generated 1562 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:21:23.516428 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:21:23.517213 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=40 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:21:23.522417 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c8f63033-c7b4-44a1-aebe-e51d4865e4e3 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:21:23.524774 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c8f63033-c7b4-44a1-aebe-e51d4865e4e3 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 495e2a65-0042-4ae1-bfeb-0cfcb6b0f45b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:21:23.532367 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c8f63033-c7b4-44a1-aebe-e51d4865e4e3 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:21:23.532858 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c8f63033-c7b4-44a1-aebe-e51d4865e4e3 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:21:23.533304 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c8f63033-c7b4-44a1-aebe-e51d4865e4e3 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:21:23.534030 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c8f63033-c7b4-44a1-aebe-e51d4865e4e3 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:21:23.534479 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c8f63033-c7b4-44a1-aebe-e51d4865e4e3 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:21:23.534920 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c8f63033-c7b4-44a1-aebe-e51d4865e4e3 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:21:23.602839 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c8f63033-c7b4-44a1-aebe-e51d4865e4e3 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "POST /compute/v2.1/servers/495e2a65-0042-4ae1-bfeb-0cfcb6b0f45b/action" status: 200 len: 24568 microversion: 2.1 time: 0.088565 Aug 31 17:21:23.603503 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3935/7884] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 17:21:23 2022] POST /compute/v2.1/servers/495e2a65-0042-4ae1-bfeb-0cfcb6b0f45b/action => generated 24568 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 17:22:02.354655 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:22:02.355992 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=40 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:22:02.360604 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9aa82f8a-806e-43fe-9e47-a60267a7ef2a tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:22:02.361160 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9aa82f8a-806e-43fe-9e47-a60267a7ef2a tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 495e2a65-0042-4ae1-bfeb-0cfcb6b0f45b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:22:02.368581 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9aa82f8a-806e-43fe-9e47-a60267a7ef2a tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:22:02.369125 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9aa82f8a-806e-43fe-9e47-a60267a7ef2a tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:22:02.369584 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9aa82f8a-806e-43fe-9e47-a60267a7ef2a tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:22:02.370303 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9aa82f8a-806e-43fe-9e47-a60267a7ef2a tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:22:02.370780 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9aa82f8a-806e-43fe-9e47-a60267a7ef2a tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:22:02.371227 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9aa82f8a-806e-43fe-9e47-a60267a7ef2a tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:22:02.442063 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9aa82f8a-806e-43fe-9e47-a60267a7ef2a tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "POST /compute/v2.1/servers/495e2a65-0042-4ae1-bfeb-0cfcb6b0f45b/action" status: 202 len: 0 microversion: 2.1 time: 0.089080 Aug 31 17:22:02.442719 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3950/7885] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 17:22:02 2022] POST /compute/v2.1/servers/495e2a65-0042-4ae1-bfeb-0cfcb6b0f45b/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 17:22:02.453033 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ff165c2c-3624-4885-9c26-36c148a7f875 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:22:02.453608 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ff165c2c-3624-4885-9c26-36c148a7f875 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 495e2a65-0042-4ae1-bfeb-0cfcb6b0f45b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:22:02.457757 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:22:02.458390 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=4 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:22:02.462690 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ff165c2c-3624-4885-9c26-36c148a7f875 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:22:02.463281 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ff165c2c-3624-4885-9c26-36c148a7f875 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:22:02.463754 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ff165c2c-3624-4885-9c26-36c148a7f875 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:22:02.464501 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ff165c2c-3624-4885-9c26-36c148a7f875 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:22:02.464969 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ff165c2c-3624-4885-9c26-36c148a7f875 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:22:02.465401 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ff165c2c-3624-4885-9c26-36c148a7f875 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:22:02.625325 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ff165c2c-3624-4885-9c26-36c148a7f875 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:22:02.633981 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ff165c2c-3624-4885-9c26-36c148a7f875 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/495e2a65-0042-4ae1-bfeb-0cfcb6b0f45b" status: 200 len: 1686 microversion: 2.1 time: 0.186640 Aug 31 17:22:02.634557 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3936/7886] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:22:02 2022] GET /compute/v2.1/servers/495e2a65-0042-4ae1-bfeb-0cfcb6b0f45b => generated 1686 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:22:03.658376 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4881f327-037d-41fb-9abf-13ccf1497140 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:22:03.659088 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4881f327-037d-41fb-9abf-13ccf1497140 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 495e2a65-0042-4ae1-bfeb-0cfcb6b0f45b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:22:03.665344 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4881f327-037d-41fb-9abf-13ccf1497140 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:22:03.665852 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4881f327-037d-41fb-9abf-13ccf1497140 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:22:03.666305 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4881f327-037d-41fb-9abf-13ccf1497140 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:22:03.667011 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4881f327-037d-41fb-9abf-13ccf1497140 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:22:03.667486 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4881f327-037d-41fb-9abf-13ccf1497140 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:22:03.667952 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4881f327-037d-41fb-9abf-13ccf1497140 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:22:03.803126 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-4881f327-037d-41fb-9abf-13ccf1497140 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:22:03.811809 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4881f327-037d-41fb-9abf-13ccf1497140 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/495e2a65-0042-4ae1-bfeb-0cfcb6b0f45b" status: 200 len: 1666 microversion: 2.1 time: 0.158620 Aug 31 17:22:03.812413 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3951/7887] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:22:03 2022] GET /compute/v2.1/servers/495e2a65-0042-4ae1-bfeb-0cfcb6b0f45b => generated 1666 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:22:04.908039 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d87892ea-5b9b-4404-97f5-00c75a02b15d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:22:04.910271 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d87892ea-5b9b-4404-97f5-00c75a02b15d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 495e2a65-0042-4ae1-bfeb-0cfcb6b0f45b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:22:04.918012 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d87892ea-5b9b-4404-97f5-00c75a02b15d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:22:04.918511 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d87892ea-5b9b-4404-97f5-00c75a02b15d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:22:04.918960 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d87892ea-5b9b-4404-97f5-00c75a02b15d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:22:04.919702 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d87892ea-5b9b-4404-97f5-00c75a02b15d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:22:04.920778 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d87892ea-5b9b-4404-97f5-00c75a02b15d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:22:04.921230 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d87892ea-5b9b-4404-97f5-00c75a02b15d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:22:04.988328 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d87892ea-5b9b-4404-97f5-00c75a02b15d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "POST /compute/v2.1/servers/495e2a65-0042-4ae1-bfeb-0cfcb6b0f45b/action" status: 200 len: 32643 microversion: 2.1 time: 0.085225 Aug 31 17:22:04.988991 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3937/7888] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 17:22:04 2022] POST /compute/v2.1/servers/495e2a65-0042-4ae1-bfeb-0cfcb6b0f45b/action => generated 32643 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 17:22:05.002143 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8f1a024c-56c8-4708-9a23-4c81eb0b2e93 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:22:05.002786 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8f1a024c-56c8-4708-9a23-4c81eb0b2e93 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 495e2a65-0042-4ae1-bfeb-0cfcb6b0f45b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:22:05.010182 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8f1a024c-56c8-4708-9a23-4c81eb0b2e93 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:22:05.010691 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8f1a024c-56c8-4708-9a23-4c81eb0b2e93 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:22:05.011181 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8f1a024c-56c8-4708-9a23-4c81eb0b2e93 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:22:05.011946 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8f1a024c-56c8-4708-9a23-4c81eb0b2e93 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:22:05.012421 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8f1a024c-56c8-4708-9a23-4c81eb0b2e93 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:22:05.012866 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8f1a024c-56c8-4708-9a23-4c81eb0b2e93 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:22:05.085454 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8f1a024c-56c8-4708-9a23-4c81eb0b2e93 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "POST /compute/v2.1/servers/495e2a65-0042-4ae1-bfeb-0cfcb6b0f45b/action" status: 202 len: 0 microversion: 2.1 time: 0.088167 Aug 31 17:22:05.086098 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3952/7889] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 17:22:04 2022] POST /compute/v2.1/servers/495e2a65-0042-4ae1-bfeb-0cfcb6b0f45b/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 17:22:05.095962 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d2f57211-05ab-4497-9491-be2a99622bf5 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:22:05.096773 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d2f57211-05ab-4497-9491-be2a99622bf5 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 495e2a65-0042-4ae1-bfeb-0cfcb6b0f45b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:22:05.104230 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d2f57211-05ab-4497-9491-be2a99622bf5 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:22:05.104774 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d2f57211-05ab-4497-9491-be2a99622bf5 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:22:05.105287 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d2f57211-05ab-4497-9491-be2a99622bf5 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:22:05.106008 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d2f57211-05ab-4497-9491-be2a99622bf5 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:22:05.106478 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d2f57211-05ab-4497-9491-be2a99622bf5 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:22:05.106916 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d2f57211-05ab-4497-9491-be2a99622bf5 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:22:05.247687 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d2f57211-05ab-4497-9491-be2a99622bf5 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:22:05.256501 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d2f57211-05ab-4497-9491-be2a99622bf5 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/495e2a65-0042-4ae1-bfeb-0cfcb6b0f45b" status: 200 len: 1673 microversion: 2.1 time: 0.165575 Aug 31 17:22:05.257080 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3938/7890] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:22:05 2022] GET /compute/v2.1/servers/495e2a65-0042-4ae1-bfeb-0cfcb6b0f45b => generated 1673 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:22:06.279637 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5d13523a-28e3-4d2b-9780-856531e272db tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:22:06.280740 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5d13523a-28e3-4d2b-9780-856531e272db tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 495e2a65-0042-4ae1-bfeb-0cfcb6b0f45b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:22:06.287713 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5d13523a-28e3-4d2b-9780-856531e272db tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:22:06.288229 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5d13523a-28e3-4d2b-9780-856531e272db tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:22:06.288693 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5d13523a-28e3-4d2b-9780-856531e272db tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:22:06.289444 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5d13523a-28e3-4d2b-9780-856531e272db tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:22:06.289924 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5d13523a-28e3-4d2b-9780-856531e272db tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:22:06.290372 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5d13523a-28e3-4d2b-9780-856531e272db tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:22:06.430625 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-5d13523a-28e3-4d2b-9780-856531e272db tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:22:06.439133 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5d13523a-28e3-4d2b-9780-856531e272db tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/495e2a65-0042-4ae1-bfeb-0cfcb6b0f45b" status: 200 len: 1681 microversion: 2.1 time: 0.163815 Aug 31 17:22:06.439745 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3953/7891] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:22:06 2022] GET /compute/v2.1/servers/495e2a65-0042-4ae1-bfeb-0cfcb6b0f45b => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:22:06.533469 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5b7b4e34-9253-4840-af6e-b60efaf4b02b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:22:06.535847 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5b7b4e34-9253-4840-af6e-b60efaf4b02b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 495e2a65-0042-4ae1-bfeb-0cfcb6b0f45b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:22:06.543873 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5b7b4e34-9253-4840-af6e-b60efaf4b02b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:22:06.544375 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5b7b4e34-9253-4840-af6e-b60efaf4b02b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:22:06.544823 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5b7b4e34-9253-4840-af6e-b60efaf4b02b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:22:06.546325 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5b7b4e34-9253-4840-af6e-b60efaf4b02b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:22:06.546724 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5b7b4e34-9253-4840-af6e-b60efaf4b02b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:22:06.547189 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5b7b4e34-9253-4840-af6e-b60efaf4b02b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:22:06.610168 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5b7b4e34-9253-4840-af6e-b60efaf4b02b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "POST /compute/v2.1/servers/495e2a65-0042-4ae1-bfeb-0cfcb6b0f45b/action" status: 200 len: 38469 microversion: 2.1 time: 0.080542 Aug 31 17:22:06.610826 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3939/7892] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 17:22:06 2022] POST /compute/v2.1/servers/495e2a65-0042-4ae1-bfeb-0cfcb6b0f45b/action => generated 38469 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 17:22:07.941798 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-91b11071-3b80-467e-89de-c8e6e60d1f1c tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:22:07.942886 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-91b11071-3b80-467e-89de-c8e6e60d1f1c tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 495e2a65-0042-4ae1-bfeb-0cfcb6b0f45b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:22:07.951854 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-91b11071-3b80-467e-89de-c8e6e60d1f1c tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:22:07.952741 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-91b11071-3b80-467e-89de-c8e6e60d1f1c tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:22:07.953214 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-91b11071-3b80-467e-89de-c8e6e60d1f1c tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:22:07.953952 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-91b11071-3b80-467e-89de-c8e6e60d1f1c tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:22:07.954424 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-91b11071-3b80-467e-89de-c8e6e60d1f1c tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:22:07.954871 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-91b11071-3b80-467e-89de-c8e6e60d1f1c tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:22:07.983554 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-91b11071-3b80-467e-89de-c8e6e60d1f1c tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 495e2a65-0042-4ae1-bfeb-0cfcb6b0f45b] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 17:22:08.010376 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-f9124da8-9046-4030-a381-900939531611 req-88f6c908-c4df-48b3-9afc-1ac4ac6423c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "495e2a65-0042-4ae1-bfeb-0cfcb6b0f45b", "tag": "916722ee-43a9-47c5-a50a-d484a15ec7a4"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:22:08.022380 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-f9124da8-9046-4030-a381-900939531611 req-88f6c908-c4df-48b3-9afc-1ac4ac6423c2 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:22:08.022867 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-f9124da8-9046-4030-a381-900939531611 req-88f6c908-c4df-48b3-9afc-1ac4ac6423c2 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:22:08.023528 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-f9124da8-9046-4030-a381-900939531611 req-88f6c908-c4df-48b3-9afc-1ac4ac6423c2 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:22:08.035781 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-f9124da8-9046-4030-a381-900939531611 req-88f6c908-c4df-48b3-9afc-1ac4ac6423c2 service nova] Creating event network-changed:916722ee-43a9-47c5-a50a-d484a15ec7a4 for instance 495e2a65-0042-4ae1-bfeb-0cfcb6b0f45b on n-h1-850499-9 Aug 31 17:22:08.040981 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-f9124da8-9046-4030-a381-900939531611 req-88f6c908-c4df-48b3-9afc-1ac4ac6423c2 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100587 Aug 31 17:22:08.042056 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3940/7893] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:22:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 17:22:08.075759 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-91b11071-3b80-467e-89de-c8e6e60d1f1c tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "DELETE /compute/v2.1/servers/495e2a65-0042-4ae1-bfeb-0cfcb6b0f45b" status: 204 len: 0 microversion: 2.1 time: 0.136950 Aug 31 17:22:08.076891 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3954/7894] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 17:22:07 2022] DELETE /compute/v2.1/servers/495e2a65-0042-4ae1-bfeb-0cfcb6b0f45b => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 17:22:08.085699 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-fae16c9e-34bc-454c-ac36-d43c14be585e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:22:08.086593 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-fae16c9e-34bc-454c-ac36-d43c14be585e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 495e2a65-0042-4ae1-bfeb-0cfcb6b0f45b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:22:08.095198 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fae16c9e-34bc-454c-ac36-d43c14be585e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:22:08.096100 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fae16c9e-34bc-454c-ac36-d43c14be585e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:22:08.096795 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fae16c9e-34bc-454c-ac36-d43c14be585e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:22:08.097851 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fae16c9e-34bc-454c-ac36-d43c14be585e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:22:08.098586 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fae16c9e-34bc-454c-ac36-d43c14be585e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:22:08.099458 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fae16c9e-34bc-454c-ac36-d43c14be585e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:22:08.253021 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-fae16c9e-34bc-454c-ac36-d43c14be585e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:22:08.261230 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-fae16c9e-34bc-454c-ac36-d43c14be585e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/495e2a65-0042-4ae1-bfeb-0cfcb6b0f45b" status: 200 len: 1687 microversion: 2.1 time: 0.179812 Aug 31 17:22:08.262019 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3941/7895] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:22:08 2022] GET /compute/v2.1/servers/495e2a65-0042-4ae1-bfeb-0cfcb6b0f45b => generated 1687 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:22:09.285331 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1567eb09-0ebc-4029-b64c-7ef8002f8c1e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:22:09.286045 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1567eb09-0ebc-4029-b64c-7ef8002f8c1e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 495e2a65-0042-4ae1-bfeb-0cfcb6b0f45b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:22:09.292846 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1567eb09-0ebc-4029-b64c-7ef8002f8c1e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:22:09.293929 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1567eb09-0ebc-4029-b64c-7ef8002f8c1e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:22:09.293929 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1567eb09-0ebc-4029-b64c-7ef8002f8c1e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:22:09.294709 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1567eb09-0ebc-4029-b64c-7ef8002f8c1e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:22:09.295789 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1567eb09-0ebc-4029-b64c-7ef8002f8c1e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:22:09.296218 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1567eb09-0ebc-4029-b64c-7ef8002f8c1e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:22:09.499029 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-1567eb09-0ebc-4029-b64c-7ef8002f8c1e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:22:09.507672 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1567eb09-0ebc-4029-b64c-7ef8002f8c1e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/495e2a65-0042-4ae1-bfeb-0cfcb6b0f45b" status: 200 len: 1687 microversion: 2.1 time: 0.226553 Aug 31 17:22:09.508266 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3955/7896] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:22:09 2022] GET /compute/v2.1/servers/495e2a65-0042-4ae1-bfeb-0cfcb6b0f45b => generated 1687 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:22:10.524729 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-2f95fdbc-db2a-4284-8a3f-b8421ef95b8a req-db0e2852-ca2f-463f-88b9-c18cfa3ed91e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "495e2a65-0042-4ae1-bfeb-0cfcb6b0f45b", "name": "network-vif-deleted", "tag": "916722ee-43a9-47c5-a50a-d484a15ec7a4"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:22:10.531750 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b62a57d6-9855-4c4a-8d9f-a5b2ebd0a20b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:22:10.532395 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b62a57d6-9855-4c4a-8d9f-a5b2ebd0a20b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 495e2a65-0042-4ae1-bfeb-0cfcb6b0f45b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:22:10.537444 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-2f95fdbc-db2a-4284-8a3f-b8421ef95b8a req-db0e2852-ca2f-463f-88b9-c18cfa3ed91e service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:22:10.538203 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-2f95fdbc-db2a-4284-8a3f-b8421ef95b8a req-db0e2852-ca2f-463f-88b9-c18cfa3ed91e service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:22:10.538990 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-2f95fdbc-db2a-4284-8a3f-b8421ef95b8a req-db0e2852-ca2f-463f-88b9-c18cfa3ed91e service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:22:10.541433 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b62a57d6-9855-4c4a-8d9f-a5b2ebd0a20b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:22:10.542572 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b62a57d6-9855-4c4a-8d9f-a5b2ebd0a20b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:22:10.543226 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b62a57d6-9855-4c4a-8d9f-a5b2ebd0a20b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:22:10.543989 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b62a57d6-9855-4c4a-8d9f-a5b2ebd0a20b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:22:10.545124 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b62a57d6-9855-4c4a-8d9f-a5b2ebd0a20b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:22:10.546227 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b62a57d6-9855-4c4a-8d9f-a5b2ebd0a20b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:22:10.552020 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-2f95fdbc-db2a-4284-8a3f-b8421ef95b8a req-db0e2852-ca2f-463f-88b9-c18cfa3ed91e service nova] Creating event network-vif-deleted:916722ee-43a9-47c5-a50a-d484a15ec7a4 for instance 495e2a65-0042-4ae1-bfeb-0cfcb6b0f45b on n-h1-850499-9 Aug 31 17:22:10.557517 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-2f95fdbc-db2a-4284-8a3f-b8421ef95b8a req-db0e2852-ca2f-463f-88b9-c18cfa3ed91e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037161 Aug 31 17:22:10.558402 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3942/7897] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:22:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:22:10.614211 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b62a57d6-9855-4c4a-8d9f-a5b2ebd0a20b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:22:10.622302 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b62a57d6-9855-4c4a-8d9f-a5b2ebd0a20b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/495e2a65-0042-4ae1-bfeb-0cfcb6b0f45b" status: 200 len: 1501 microversion: 2.1 time: 0.095678 Aug 31 17:22:10.622877 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3956/7898] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:22:10 2022] GET /compute/v2.1/servers/495e2a65-0042-4ae1-bfeb-0cfcb6b0f45b => generated 1501 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:22:11.647690 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5f1d3728-d632-472b-80c5-a9b2c9753512 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:22:11.648315 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5f1d3728-d632-472b-80c5-a9b2c9753512 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 495e2a65-0042-4ae1-bfeb-0cfcb6b0f45b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:22:11.654645 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5f1d3728-d632-472b-80c5-a9b2c9753512 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:22:11.655142 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5f1d3728-d632-472b-80c5-a9b2c9753512 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:22:11.655609 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5f1d3728-d632-472b-80c5-a9b2c9753512 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:22:11.656351 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5f1d3728-d632-472b-80c5-a9b2c9753512 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:22:11.656814 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5f1d3728-d632-472b-80c5-a9b2c9753512 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:22:11.657248 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5f1d3728-d632-472b-80c5-a9b2c9753512 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:22:11.671251 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-5f1d3728-d632-472b-80c5-a9b2c9753512 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] HTTP exception thrown: Instance 495e2a65-0042-4ae1-bfeb-0cfcb6b0f45b could not be found. Aug 31 17:22:11.672938 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5f1d3728-d632-472b-80c5-a9b2c9753512 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Request method failure captured: Aug 31 17:22:11.672938 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/495e2a65-0042-4ae1-bfeb-0cfcb6b0f45b HTTP/1.1 Aug 31 17:22:11.672938 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 17:22:11.672938 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 17:22:11.672938 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 17:22:11.672938 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 17:22:11.672938 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 17:22:11.672938 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 17:22:11.672938 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 17:22:11.672938 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 17:22:11.672938 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD5hakwX2sXsbALOgVo9PPyLePH0fvR7L2xAV9ui8HTcLnBw3oZI1M7wF3mkEoqVA9fsecKEAxd9W333iMdsO8-IzHDYJUM0nEaJnVkZbE7IkWX3bqA3p9FNp7cLB3haZsSOX7PxhWli3RU37vvA4Rc8W5sIFHQE1dXFZWX5L9iGDZKs Aug 31 17:22:11.672938 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 17:22:11.672938 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 17:22:11.672938 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 17:22:11.672938 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 17:22:11.672938 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 17:22:11.672938 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 17:22:11.672938 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: dc47c533fa344b1caa1082a8caf19e36 Aug 31 17:22:11.672938 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-489466368 Aug 31 17:22:11.672938 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 17:22:11.672938 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 17:22:11.672938 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/dc47c533fa344b1caa1082a8caf19e36"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/dc47c533fa344b1caa1082a8caf19e36"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_dc47c533fa344b1caa1082a8caf19e36", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/dc47c533fa344b1caa1082a8caf19e36"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 17:22:11.672938 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-TestNetworkAdvancedServerOps-489466368 Aug 31 17:22:11.672938 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: dc47c533fa344b1caa1082a8caf19e36 Aug 31 17:22:11.672938 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-489466368 Aug 31 17:22:11.672938 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-TestNetworkAdvancedServerOps-489466368-project Aug 31 17:22:11.672938 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 17:22:11.672938 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 17:22:11.672938 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 684d0544424b41fe951feb12dae6b1c2 Aug 31 17:22:11.672938 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-TestNetworkAdvancedServerOps-489466368-project Aug 31 17:22:11.672938 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 17:22:11.672938 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance 495e2a65-0042-4ae1-bfeb-0cfcb6b0f45b could not be found. Aug 31 17:22:11.672938 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '495e2a65-0042-4ae1-bfeb-0cfcb6b0f45b'} Aug 31 17:22:11.672938 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 17:22:11.672938 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:22:11.672938 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 17:22:11.672938 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 17:22:11.672938 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 17:22:11.672938 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 17:22:11.672938 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 17:22:11.672938 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 17:22:11.672938 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 17:22:11.672938 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 17:22:11.672938 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 495e2a65-0042-4ae1-bfeb-0cfcb6b0f45b could not be found. Aug 31 17:22:11.672938 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:22:11.672938 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:22:11.672938 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:22:11.672938 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:22:11.672938 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:22:11.672938 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:22:11.672938 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 17:22:11.672938 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 17:22:11.672938 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 17:22:11.672938 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 17:22:11.672938 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 17:22:11.672938 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 17:22:11.672938 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 17:22:11.672938 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 17:22:11.672938 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 17:22:11.672938 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 17:22:11.672938 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 495e2a65-0042-4ae1-bfeb-0cfcb6b0f45b could not be found. Aug 31 17:22:11.672938 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:22:11.672938 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:22:11.677919 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:22:11.677919 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:22:11.677919 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:22:11.677919 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:22:11.677919 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 17:22:11.677919 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 17:22:11.677919 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 495e2a65-0042-4ae1-bfeb-0cfcb6b0f45b could not be found. Aug 31 17:22:11.677919 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:22:11.677919 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5f1d3728-d632-472b-80c5-a9b2c9753512 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Returning 404 to user: Instance 495e2a65-0042-4ae1-bfeb-0cfcb6b0f45b could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 17:22:11.677919 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5f1d3728-d632-472b-80c5-a9b2c9753512 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/495e2a65-0042-4ae1-bfeb-0cfcb6b0f45b" status: 404 len: 111 microversion: 2.1 time: 0.032125 Aug 31 17:22:11.677919 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3943/7899] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:22:11 2022] GET /compute/v2.1/servers/495e2a65-0042-4ae1-bfeb-0cfcb6b0f45b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 17:22:14.871032 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d7a3ebce-4242-42f1-a6a3-b717e849bdbe tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '.version_select at 0x7f5ae3a4f1f0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:22:14.904055 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d7a3ebce-4242-42f1-a6a3-b717e849bdbe tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1897253794" status: 202 len: 0 microversion: 2.1 time: 0.039706 Aug 31 17:22:14.905787 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3957/7900] 10.222.0.61 () {58 vars in 1284 bytes} [Wed Aug 31 17:22:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1897253794 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 17:22:14.933484 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-091919a4-66bc-4bee-b589-0086b6afc1ec tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Action: 'create', calling method: .version_select at 0x7f5ae8667ee0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-98044150", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIA+qkd4SDqasK/4RAwmvT29YJ2gaOnpAg1FbL8nHj3wiYG9dsx01JSYhdGsxC4kQm1186QJTi3mixgENF+Ux3u1G/nOcb3pq8Ut7Tv68+kOkrKrR4P5HU7kA7HVOHPpPA=="}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:22:14.951879 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-091919a4-66bc-4bee-b589-0086b6afc1ec tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Getting quotas for project dc47c533fa344b1caa1082a8caf19e36. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 17:22:14.959562 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-091919a4-66bc-4bee-b589-0086b6afc1ec tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Getting quotas for user 684d0544424b41fe951feb12dae6b1c2 and project dc47c533fa344b1caa1082a8caf19e36. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 17:22:14.987458 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-091919a4-66bc-4bee-b589-0086b6afc1ec tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.058088 Aug 31 17:22:14.988274 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3944/7901] 10.222.0.61 () {60 vars in 1159 bytes} [Wed Aug 31 17:22:14 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 17:22:20.583477 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a8afef34-b3b9-40e6-8cd8-bb25af515c00 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1380994345", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "networks": [{"uuid": "5f903a39-64fa-40cb-88fb-13092933a435"}], "key_name": "tempest-TestNetworkAdvancedServerOps-98044150", "security_groups": [{"name": "tempest-secgroup-smoke-774888764"}]}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:22:20.633356 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:22:20.743459 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-a8afef34-b3b9-40e6-8cd8-bb25af515c00 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] validate_networks() for [('5f903a39-64fa-40cb-88fb-13092933a435', None, None, None, None, None)] {{(pid=122257) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 17:22:21.224577 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-a8afef34-b3b9-40e6-8cd8-bb25af515c00 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 17:22:21.225748 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-a8afef34-b3b9-40e6-8cd8-bb25af515c00 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 17:22:21.226663 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-a8afef34-b3b9-40e6-8cd8-bb25af515c00 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 17:22:21.227732 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-a8afef34-b3b9-40e6-8cd8-bb25af515c00 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 17:22:21.228516 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-a8afef34-b3b9-40e6-8cd8-bb25af515c00 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 17:22:21.245498 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a8afef34-b3b9-40e6-8cd8-bb25af515c00 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:22:21.246394 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a8afef34-b3b9-40e6-8cd8-bb25af515c00 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:22:21.247467 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a8afef34-b3b9-40e6-8cd8-bb25af515c00 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:22:21.249685 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a8afef34-b3b9-40e6-8cd8-bb25af515c00 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:22:21.250536 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a8afef34-b3b9-40e6-8cd8-bb25af515c00 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:22:21.251337 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a8afef34-b3b9-40e6-8cd8-bb25af515c00 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:22:21.284450 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-a8afef34-b3b9-40e6-8cd8-bb25af515c00 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Getting quotas for project dc47c533fa344b1caa1082a8caf19e36. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 17:22:21.300994 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-a8afef34-b3b9-40e6-8cd8-bb25af515c00 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Getting quotas for user 684d0544424b41fe951feb12dae6b1c2 and project dc47c533fa344b1caa1082a8caf19e36. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 17:22:21.318923 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a8afef34-b3b9-40e6-8cd8-bb25af515c00 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Going to run 1 instances... {{(pid=122257) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 17:22:21.321552 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a8afef34-b3b9-40e6-8cd8-bb25af515c00 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: b34905c9-38ea-4885-b577-ea59db536696] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 17:22:21.380461 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a8afef34-b3b9-40e6-8cd8-bb25af515c00 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.802212 Aug 31 17:22:21.381497 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3958/7902] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 17:22:20 2022] POST /compute/v2.1/servers => generated 405 bytes in 804 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 17:22:21.393306 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-79b8c9cd-11a6-4d58-9dda-714e364fb757 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:22:21.393921 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-79b8c9cd-11a6-4d58-9dda-714e364fb757 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: b34905c9-38ea-4885-b577-ea59db536696] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:22:21.458230 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-79b8c9cd-11a6-4d58-9dda-714e364fb757 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:22:21.467515 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-79b8c9cd-11a6-4d58-9dda-714e364fb757 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/b34905c9-38ea-4885-b577-ea59db536696" status: 200 len: 1265 microversion: 2.1 time: 0.078417 Aug 31 17:22:21.468430 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3945/7903] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:22:21 2022] GET /compute/v2.1/servers/b34905c9-38ea-4885-b577-ea59db536696 => generated 1265 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:22:22.489425 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-00a88b2c-4e71-4ba3-a8cc-927ff33513ce tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:22:22.490056 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-00a88b2c-4e71-4ba3-a8cc-927ff33513ce tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: b34905c9-38ea-4885-b577-ea59db536696] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:22:22.553453 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-00a88b2c-4e71-4ba3-a8cc-927ff33513ce tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:22:22.561418 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-00a88b2c-4e71-4ba3-a8cc-927ff33513ce tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/b34905c9-38ea-4885-b577-ea59db536696" status: 200 len: 1265 microversion: 2.1 time: 0.075242 Aug 31 17:22:22.562483 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3959/7904] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:22:22 2022] GET /compute/v2.1/servers/b34905c9-38ea-4885-b577-ea59db536696 => generated 1265 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:22:23.590388 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-fcfb2472-c7ab-42ac-a4dc-152f7648ad6b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:22:23.591124 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-fcfb2472-c7ab-42ac-a4dc-152f7648ad6b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: b34905c9-38ea-4885-b577-ea59db536696] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:22:23.593885 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=32 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:22:23.660601 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-fcfb2472-c7ab-42ac-a4dc-152f7648ad6b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:22:23.667942 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-fcfb2472-c7ab-42ac-a4dc-152f7648ad6b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/b34905c9-38ea-4885-b577-ea59db536696" status: 200 len: 1265 microversion: 2.1 time: 0.088354 Aug 31 17:22:23.668694 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3946/7905] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:22:23 2022] GET /compute/v2.1/servers/b34905c9-38ea-4885-b577-ea59db536696 => generated 1265 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:22:24.691042 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3a5c251c-079f-4595-8391-481d9f48e296 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:22:24.691764 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3a5c251c-079f-4595-8391-481d9f48e296 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: b34905c9-38ea-4885-b577-ea59db536696] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:22:24.751901 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3a5c251c-079f-4595-8391-481d9f48e296 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:22:24.759112 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3a5c251c-079f-4595-8391-481d9f48e296 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/b34905c9-38ea-4885-b577-ea59db536696" status: 200 len: 1265 microversion: 2.1 time: 0.073731 Aug 31 17:22:24.759744 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3960/7906] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:22:24 2022] GET /compute/v2.1/servers/b34905c9-38ea-4885-b577-ea59db536696 => generated 1265 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:22:25.781048 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e9312a89-b59a-4f97-8863-e0d58e514d0e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:22:25.781781 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e9312a89-b59a-4f97-8863-e0d58e514d0e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: b34905c9-38ea-4885-b577-ea59db536696] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:22:25.788811 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e9312a89-b59a-4f97-8863-e0d58e514d0e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:22:25.789320 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e9312a89-b59a-4f97-8863-e0d58e514d0e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:22:25.789774 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e9312a89-b59a-4f97-8863-e0d58e514d0e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:22:25.790505 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e9312a89-b59a-4f97-8863-e0d58e514d0e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:22:25.790992 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e9312a89-b59a-4f97-8863-e0d58e514d0e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:22:25.791417 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e9312a89-b59a-4f97-8863-e0d58e514d0e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:22:25.856377 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e9312a89-b59a-4f97-8863-e0d58e514d0e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:22:25.865326 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e9312a89-b59a-4f97-8863-e0d58e514d0e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/b34905c9-38ea-4885-b577-ea59db536696" status: 200 len: 1269 microversion: 2.1 time: 0.088356 Aug 31 17:22:25.865939 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3947/7907] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:22:25 2022] GET /compute/v2.1/servers/b34905c9-38ea-4885-b577-ea59db536696 => generated 1269 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:22:26.886563 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f0c20dad-63a5-4ef7-907f-a3c0e578004f tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:22:26.887309 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f0c20dad-63a5-4ef7-907f-a3c0e578004f tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: b34905c9-38ea-4885-b577-ea59db536696] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:22:26.897074 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f0c20dad-63a5-4ef7-907f-a3c0e578004f tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:22:26.897594 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f0c20dad-63a5-4ef7-907f-a3c0e578004f tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:22:26.898189 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f0c20dad-63a5-4ef7-907f-a3c0e578004f tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:22:26.899044 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f0c20dad-63a5-4ef7-907f-a3c0e578004f tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:22:26.899589 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f0c20dad-63a5-4ef7-907f-a3c0e578004f tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:22:26.900055 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f0c20dad-63a5-4ef7-907f-a3c0e578004f tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:22:26.973725 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f0c20dad-63a5-4ef7-907f-a3c0e578004f tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:22:26.983649 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f0c20dad-63a5-4ef7-907f-a3c0e578004f tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/b34905c9-38ea-4885-b577-ea59db536696" status: 200 len: 1323 microversion: 2.1 time: 0.100914 Aug 31 17:22:26.984415 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3961/7908] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:22:26 2022] GET /compute/v2.1/servers/b34905c9-38ea-4885-b577-ea59db536696 => generated 1323 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:22:28.006491 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6209ae53-5150-4e02-b018-e30813ad5ba7 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:22:28.007168 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6209ae53-5150-4e02-b018-e30813ad5ba7 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: b34905c9-38ea-4885-b577-ea59db536696] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:22:28.014523 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6209ae53-5150-4e02-b018-e30813ad5ba7 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:22:28.015145 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6209ae53-5150-4e02-b018-e30813ad5ba7 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:22:28.017105 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6209ae53-5150-4e02-b018-e30813ad5ba7 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:22:28.017939 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6209ae53-5150-4e02-b018-e30813ad5ba7 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:22:28.018492 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6209ae53-5150-4e02-b018-e30813ad5ba7 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:22:28.019001 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6209ae53-5150-4e02-b018-e30813ad5ba7 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:22:28.170892 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-6209ae53-5150-4e02-b018-e30813ad5ba7 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:22:28.180070 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6209ae53-5150-4e02-b018-e30813ad5ba7 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/b34905c9-38ea-4885-b577-ea59db536696" status: 200 len: 1390 microversion: 2.1 time: 0.177441 Aug 31 17:22:28.180667 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3948/7909] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:22:28 2022] GET /compute/v2.1/servers/b34905c9-38ea-4885-b577-ea59db536696 => generated 1390 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:22:28.496214 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-dbf6f181-eb03-4671-b9a9-11c906a29f03 req-94166179-d45e-4654-966a-811a27385bf4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b34905c9-38ea-4885-b577-ea59db536696", "tag": "22d1f752-c3a6-435c-b338-e610007b858f"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:22:28.508462 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-dbf6f181-eb03-4671-b9a9-11c906a29f03 req-94166179-d45e-4654-966a-811a27385bf4 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:22:28.509013 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-dbf6f181-eb03-4671-b9a9-11c906a29f03 req-94166179-d45e-4654-966a-811a27385bf4 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:22:28.509537 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-dbf6f181-eb03-4671-b9a9-11c906a29f03 req-94166179-d45e-4654-966a-811a27385bf4 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:22:28.523589 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-dbf6f181-eb03-4671-b9a9-11c906a29f03 req-94166179-d45e-4654-966a-811a27385bf4 service nova] Creating event network-changed:22d1f752-c3a6-435c-b338-e610007b858f for instance b34905c9-38ea-4885-b577-ea59db536696 on n-h1-850499-9 Aug 31 17:22:28.528608 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-dbf6f181-eb03-4671-b9a9-11c906a29f03 req-94166179-d45e-4654-966a-811a27385bf4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036204 Aug 31 17:22:28.529400 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3962/7910] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:22:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:22:29.201923 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c1f16032-3b61-4ca7-82d8-38e5c5a08b70 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:22:29.202483 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c1f16032-3b61-4ca7-82d8-38e5c5a08b70 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: b34905c9-38ea-4885-b577-ea59db536696] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:22:29.210351 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c1f16032-3b61-4ca7-82d8-38e5c5a08b70 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:22:29.210786 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c1f16032-3b61-4ca7-82d8-38e5c5a08b70 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:22:29.211234 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c1f16032-3b61-4ca7-82d8-38e5c5a08b70 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:22:29.212017 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c1f16032-3b61-4ca7-82d8-38e5c5a08b70 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:22:29.212546 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c1f16032-3b61-4ca7-82d8-38e5c5a08b70 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:22:29.212990 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c1f16032-3b61-4ca7-82d8-38e5c5a08b70 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:22:29.357598 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c1f16032-3b61-4ca7-82d8-38e5c5a08b70 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:22:29.367129 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c1f16032-3b61-4ca7-82d8-38e5c5a08b70 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/b34905c9-38ea-4885-b577-ea59db536696" status: 200 len: 1390 microversion: 2.1 time: 0.169231 Aug 31 17:22:29.367778 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3949/7911] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:22:29 2022] GET /compute/v2.1/servers/b34905c9-38ea-4885-b577-ea59db536696 => generated 1390 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:22:30.389708 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-da7f2e22-8c5f-4b16-b784-99cb0a79c723 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:22:30.390430 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-da7f2e22-8c5f-4b16-b784-99cb0a79c723 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: b34905c9-38ea-4885-b577-ea59db536696] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:22:30.397155 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-da7f2e22-8c5f-4b16-b784-99cb0a79c723 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:22:30.397657 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-da7f2e22-8c5f-4b16-b784-99cb0a79c723 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:22:30.398113 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-da7f2e22-8c5f-4b16-b784-99cb0a79c723 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:22:30.398829 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-da7f2e22-8c5f-4b16-b784-99cb0a79c723 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:22:30.399305 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-da7f2e22-8c5f-4b16-b784-99cb0a79c723 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:22:30.399776 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-da7f2e22-8c5f-4b16-b784-99cb0a79c723 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:22:30.539358 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-da7f2e22-8c5f-4b16-b784-99cb0a79c723 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:22:30.549011 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-da7f2e22-8c5f-4b16-b784-99cb0a79c723 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/b34905c9-38ea-4885-b577-ea59db536696" status: 200 len: 1390 microversion: 2.1 time: 0.164359 Aug 31 17:22:30.549610 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3963/7912] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:22:30 2022] GET /compute/v2.1/servers/b34905c9-38ea-4885-b577-ea59db536696 => generated 1390 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:22:31.649420 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6228f398-15a7-4dea-b667-70380f5a9aa2 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:22:31.650119 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6228f398-15a7-4dea-b667-70380f5a9aa2 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: b34905c9-38ea-4885-b577-ea59db536696] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:22:31.658205 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6228f398-15a7-4dea-b667-70380f5a9aa2 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:22:31.658695 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6228f398-15a7-4dea-b667-70380f5a9aa2 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:22:31.659162 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6228f398-15a7-4dea-b667-70380f5a9aa2 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:22:31.660097 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6228f398-15a7-4dea-b667-70380f5a9aa2 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:22:31.660560 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6228f398-15a7-4dea-b667-70380f5a9aa2 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:22:31.660991 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6228f398-15a7-4dea-b667-70380f5a9aa2 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:22:31.797097 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-6228f398-15a7-4dea-b667-70380f5a9aa2 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:22:31.805571 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6228f398-15a7-4dea-b667-70380f5a9aa2 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/b34905c9-38ea-4885-b577-ea59db536696" status: 200 len: 1390 microversion: 2.1 time: 0.160179 Aug 31 17:22:31.806153 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3950/7913] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:22:31 2022] GET /compute/v2.1/servers/b34905c9-38ea-4885-b577-ea59db536696 => generated 1390 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:22:32.828241 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7793e249-5704-46ee-a946-faa5bd0fc71f tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:22:32.829074 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7793e249-5704-46ee-a946-faa5bd0fc71f tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: b34905c9-38ea-4885-b577-ea59db536696] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:22:32.831446 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:22:32.833230 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:22:32.841496 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7793e249-5704-46ee-a946-faa5bd0fc71f tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:22:32.842301 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7793e249-5704-46ee-a946-faa5bd0fc71f tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:22:32.842874 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7793e249-5704-46ee-a946-faa5bd0fc71f tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:22:32.844654 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7793e249-5704-46ee-a946-faa5bd0fc71f tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:22:32.845256 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7793e249-5704-46ee-a946-faa5bd0fc71f tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:22:32.845856 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7793e249-5704-46ee-a946-faa5bd0fc71f tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:22:32.991128 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7793e249-5704-46ee-a946-faa5bd0fc71f tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:22:32.999071 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7793e249-5704-46ee-a946-faa5bd0fc71f tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/b34905c9-38ea-4885-b577-ea59db536696" status: 200 len: 1390 microversion: 2.1 time: 0.176316 Aug 31 17:22:33.000230 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3964/7914] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:22:32 2022] GET /compute/v2.1/servers/b34905c9-38ea-4885-b577-ea59db536696 => generated 1390 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:22:34.021825 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0725e5a3-64c8-4302-a072-00f8f263e996 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:22:34.022436 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0725e5a3-64c8-4302-a072-00f8f263e996 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: b34905c9-38ea-4885-b577-ea59db536696] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:22:34.025195 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=8 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:22:34.025955 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:22:34.032065 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0725e5a3-64c8-4302-a072-00f8f263e996 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:22:34.032556 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0725e5a3-64c8-4302-a072-00f8f263e996 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:22:34.033005 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0725e5a3-64c8-4302-a072-00f8f263e996 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:22:34.033716 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0725e5a3-64c8-4302-a072-00f8f263e996 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:22:34.034176 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0725e5a3-64c8-4302-a072-00f8f263e996 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:22:34.034628 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0725e5a3-64c8-4302-a072-00f8f263e996 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:22:34.184165 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-0725e5a3-64c8-4302-a072-00f8f263e996 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:22:34.193901 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0725e5a3-64c8-4302-a072-00f8f263e996 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/b34905c9-38ea-4885-b577-ea59db536696" status: 200 len: 1390 microversion: 2.1 time: 0.176221 Aug 31 17:22:34.194506 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3951/7915] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:22:34 2022] GET /compute/v2.1/servers/b34905c9-38ea-4885-b577-ea59db536696 => generated 1390 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:22:34.293194 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-8f4d5168-d87c-468d-9283-25edc2c930f9 req-ae84dbce-f685-4e3b-9440-fd0d646e6bea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b34905c9-38ea-4885-b577-ea59db536696", "name": "network-vif-plugged", "status": "completed", "tag": "22d1f752-c3a6-435c-b338-e610007b858f"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:22:34.303201 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-8f4d5168-d87c-468d-9283-25edc2c930f9 req-ae84dbce-f685-4e3b-9440-fd0d646e6bea service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:22:34.303751 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-8f4d5168-d87c-468d-9283-25edc2c930f9 req-ae84dbce-f685-4e3b-9440-fd0d646e6bea service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:22:34.304206 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-8f4d5168-d87c-468d-9283-25edc2c930f9 req-ae84dbce-f685-4e3b-9440-fd0d646e6bea service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:22:34.316036 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-8f4d5168-d87c-468d-9283-25edc2c930f9 req-ae84dbce-f685-4e3b-9440-fd0d646e6bea service nova] Creating event network-vif-plugged:22d1f752-c3a6-435c-b338-e610007b858f for instance b34905c9-38ea-4885-b577-ea59db536696 on n-h1-850499-9 Aug 31 17:22:34.321259 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-8f4d5168-d87c-468d-9283-25edc2c930f9 req-ae84dbce-f685-4e3b-9440-fd0d646e6bea service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106031 Aug 31 17:22:34.321909 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3965/7916] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:22:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:22:35.217108 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-060e999f-a736-4f41-b7b8-e958d2e0817c tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:22:35.217636 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-060e999f-a736-4f41-b7b8-e958d2e0817c tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: b34905c9-38ea-4885-b577-ea59db536696] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:22:35.225590 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-060e999f-a736-4f41-b7b8-e958d2e0817c tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:22:35.226095 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-060e999f-a736-4f41-b7b8-e958d2e0817c tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:22:35.226544 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-060e999f-a736-4f41-b7b8-e958d2e0817c tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:22:35.227256 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-060e999f-a736-4f41-b7b8-e958d2e0817c tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:22:35.227753 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-060e999f-a736-4f41-b7b8-e958d2e0817c tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:22:35.228190 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-060e999f-a736-4f41-b7b8-e958d2e0817c tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:22:35.367983 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-060e999f-a736-4f41-b7b8-e958d2e0817c tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:22:35.376278 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-060e999f-a736-4f41-b7b8-e958d2e0817c tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/b34905c9-38ea-4885-b577-ea59db536696" status: 200 len: 1390 microversion: 2.1 time: 0.163327 Aug 31 17:22:35.376863 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3952/7917] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:22:35 2022] GET /compute/v2.1/servers/b34905c9-38ea-4885-b577-ea59db536696 => generated 1390 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 17:22:36.394609 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=10 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:22:36.399791 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-cd7e753f-c266-42df-8a1a-2814df847b2d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:22:36.400536 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-cd7e753f-c266-42df-8a1a-2814df847b2d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: b34905c9-38ea-4885-b577-ea59db536696] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:22:36.407163 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cd7e753f-c266-42df-8a1a-2814df847b2d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:22:36.407697 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cd7e753f-c266-42df-8a1a-2814df847b2d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:22:36.408157 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cd7e753f-c266-42df-8a1a-2814df847b2d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:22:36.408865 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cd7e753f-c266-42df-8a1a-2814df847b2d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:22:36.409359 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cd7e753f-c266-42df-8a1a-2814df847b2d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:22:36.409810 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cd7e753f-c266-42df-8a1a-2814df847b2d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:22:36.550411 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-cd7e753f-c266-42df-8a1a-2814df847b2d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:22:36.558416 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-cd7e753f-c266-42df-8a1a-2814df847b2d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/b34905c9-38ea-4885-b577-ea59db536696" status: 200 len: 1563 microversion: 2.1 time: 0.165035 Aug 31 17:22:36.558993 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3966/7918] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:22:36 2022] GET /compute/v2.1/servers/b34905c9-38ea-4885-b577-ea59db536696 => generated 1563 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:22:36.580379 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-358742fb-10c2-46b4-a74b-a8df2d9e9023 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:22:36.581000 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-358742fb-10c2-46b4-a74b-a8df2d9e9023 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: b34905c9-38ea-4885-b577-ea59db536696] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:22:36.588078 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-358742fb-10c2-46b4-a74b-a8df2d9e9023 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:22:36.588578 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-358742fb-10c2-46b4-a74b-a8df2d9e9023 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:22:36.589027 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-358742fb-10c2-46b4-a74b-a8df2d9e9023 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:22:36.589737 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-358742fb-10c2-46b4-a74b-a8df2d9e9023 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:22:36.590205 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-358742fb-10c2-46b4-a74b-a8df2d9e9023 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:22:36.590644 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-358742fb-10c2-46b4-a74b-a8df2d9e9023 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:22:36.728223 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-358742fb-10c2-46b4-a74b-a8df2d9e9023 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:22:36.736656 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-358742fb-10c2-46b4-a74b-a8df2d9e9023 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/b34905c9-38ea-4885-b577-ea59db536696" status: 200 len: 1563 microversion: 2.1 time: 0.160611 Aug 31 17:22:36.737235 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3953/7919] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:22:36 2022] GET /compute/v2.1/servers/b34905c9-38ea-4885-b577-ea59db536696 => generated 1563 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:22:38.718072 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-79cab07a-918b-4136-9605-d88cf5e3bd2b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:22:38.719191 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-79cab07a-918b-4136-9605-d88cf5e3bd2b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: b34905c9-38ea-4885-b577-ea59db536696] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:22:38.720750 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-27d07a2f-804d-407d-a1ce-57323b6f1836 req-f6609256-588c-4b26-93f7-e93ac8b432cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b34905c9-38ea-4885-b577-ea59db536696", "tag": "22d1f752-c3a6-435c-b338-e610007b858f"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:22:38.727322 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-79cab07a-918b-4136-9605-d88cf5e3bd2b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:22:38.728275 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-79cab07a-918b-4136-9605-d88cf5e3bd2b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:22:38.729035 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-79cab07a-918b-4136-9605-d88cf5e3bd2b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:22:38.730031 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-79cab07a-918b-4136-9605-d88cf5e3bd2b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:22:38.730518 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-79cab07a-918b-4136-9605-d88cf5e3bd2b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:22:38.730974 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-79cab07a-918b-4136-9605-d88cf5e3bd2b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:22:38.732020 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-27d07a2f-804d-407d-a1ce-57323b6f1836 req-f6609256-588c-4b26-93f7-e93ac8b432cb service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:22:38.732522 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-27d07a2f-804d-407d-a1ce-57323b6f1836 req-f6609256-588c-4b26-93f7-e93ac8b432cb service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:22:38.732999 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-27d07a2f-804d-407d-a1ce-57323b6f1836 req-f6609256-588c-4b26-93f7-e93ac8b432cb service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:22:38.746292 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-27d07a2f-804d-407d-a1ce-57323b6f1836 req-f6609256-588c-4b26-93f7-e93ac8b432cb service nova] Creating event network-changed:22d1f752-c3a6-435c-b338-e610007b858f for instance b34905c9-38ea-4885-b577-ea59db536696 on n-h1-850499-9 Aug 31 17:22:38.752279 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-27d07a2f-804d-407d-a1ce-57323b6f1836 req-f6609256-588c-4b26-93f7-e93ac8b432cb service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035990 Aug 31 17:22:38.753098 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3954/7920] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:22:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 17:22:38.881987 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-79cab07a-918b-4136-9605-d88cf5e3bd2b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:22:38.891291 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-79cab07a-918b-4136-9605-d88cf5e3bd2b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/b34905c9-38ea-4885-b577-ea59db536696" status: 200 len: 1563 microversion: 2.1 time: 0.176679 Aug 31 17:22:38.891291 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3967/7921] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:22:38 2022] GET /compute/v2.1/servers/b34905c9-38ea-4885-b577-ea59db536696 => generated 1563 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:23:12.178687 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=7 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:23:12.179444 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=44 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:23:12.183738 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b7c20d31-5171-452a-b4b9-35b8e342d8b1 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:23:12.186015 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b7c20d31-5171-452a-b4b9-35b8e342d8b1 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: b34905c9-38ea-4885-b577-ea59db536696] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:23:12.193078 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b7c20d31-5171-452a-b4b9-35b8e342d8b1 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:23:12.193564 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b7c20d31-5171-452a-b4b9-35b8e342d8b1 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:23:12.194002 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b7c20d31-5171-452a-b4b9-35b8e342d8b1 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:23:12.194703 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b7c20d31-5171-452a-b4b9-35b8e342d8b1 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:23:12.195160 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b7c20d31-5171-452a-b4b9-35b8e342d8b1 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:23:12.195611 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b7c20d31-5171-452a-b4b9-35b8e342d8b1 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:23:12.264419 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b7c20d31-5171-452a-b4b9-35b8e342d8b1 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "POST /compute/v2.1/servers/b34905c9-38ea-4885-b577-ea59db536696/action" status: 200 len: 24570 microversion: 2.1 time: 0.087902 Aug 31 17:23:12.265379 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3955/7922] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 17:23:12 2022] POST /compute/v2.1/servers/b34905c9-38ea-4885-b577-ea59db536696/action => generated 24570 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 17:23:42.685857 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=7 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:23:42.686847 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=36 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:23:42.696479 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a40a56e8-ea23-4c89-b0d8-ecabf31190e1 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:23:42.696479 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a40a56e8-ea23-4c89-b0d8-ecabf31190e1 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: b34905c9-38ea-4885-b577-ea59db536696] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:23:42.701455 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a40a56e8-ea23-4c89-b0d8-ecabf31190e1 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:23:42.701961 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a40a56e8-ea23-4c89-b0d8-ecabf31190e1 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:23:42.702417 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a40a56e8-ea23-4c89-b0d8-ecabf31190e1 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:23:42.703675 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a40a56e8-ea23-4c89-b0d8-ecabf31190e1 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:23:42.704199 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a40a56e8-ea23-4c89-b0d8-ecabf31190e1 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:23:42.704589 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a40a56e8-ea23-4c89-b0d8-ecabf31190e1 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:23:42.786709 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a40a56e8-ea23-4c89-b0d8-ecabf31190e1 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "POST /compute/v2.1/servers/b34905c9-38ea-4885-b577-ea59db536696/action" status: 202 len: 0 microversion: 2.1 time: 0.102461 Aug 31 17:23:42.787373 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3968/7923] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 17:23:42 2022] POST /compute/v2.1/servers/b34905c9-38ea-4885-b577-ea59db536696/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 17:23:42.797633 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-03748670-b6e4-41f1-aec9-8870d5915b65 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:23:42.798436 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-03748670-b6e4-41f1-aec9-8870d5915b65 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: b34905c9-38ea-4885-b577-ea59db536696] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:23:42.802639 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:23:42.803465 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=4 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:23:42.809556 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-03748670-b6e4-41f1-aec9-8870d5915b65 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:23:42.810118 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-03748670-b6e4-41f1-aec9-8870d5915b65 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:23:42.810548 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-03748670-b6e4-41f1-aec9-8870d5915b65 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:23:42.811630 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-03748670-b6e4-41f1-aec9-8870d5915b65 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:23:42.812005 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-03748670-b6e4-41f1-aec9-8870d5915b65 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:23:42.812439 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-03748670-b6e4-41f1-aec9-8870d5915b65 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:23:42.981333 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-03748670-b6e4-41f1-aec9-8870d5915b65 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:23:42.990355 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-03748670-b6e4-41f1-aec9-8870d5915b65 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/b34905c9-38ea-4885-b577-ea59db536696" status: 200 len: 1673 microversion: 2.1 time: 0.197767 Aug 31 17:23:42.990947 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3956/7924] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:23:42 2022] GET /compute/v2.1/servers/b34905c9-38ea-4885-b577-ea59db536696 => generated 1673 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 17:23:44.015113 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-20521723-e693-4ddd-97e4-c8b4bb00f658 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:23:44.015851 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-20521723-e693-4ddd-97e4-c8b4bb00f658 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: b34905c9-38ea-4885-b577-ea59db536696] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:23:44.022910 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-20521723-e693-4ddd-97e4-c8b4bb00f658 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:23:44.023670 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-20521723-e693-4ddd-97e4-c8b4bb00f658 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:23:44.024143 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-20521723-e693-4ddd-97e4-c8b4bb00f658 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:23:44.024874 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-20521723-e693-4ddd-97e4-c8b4bb00f658 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:23:44.025360 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-20521723-e693-4ddd-97e4-c8b4bb00f658 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:23:44.025810 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-20521723-e693-4ddd-97e4-c8b4bb00f658 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:23:44.162846 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-20521723-e693-4ddd-97e4-c8b4bb00f658 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:23:44.171370 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-20521723-e693-4ddd-97e4-c8b4bb00f658 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/b34905c9-38ea-4885-b577-ea59db536696" status: 200 len: 1678 microversion: 2.1 time: 0.162392 Aug 31 17:23:44.171981 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3969/7925] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:23:44 2022] GET /compute/v2.1/servers/b34905c9-38ea-4885-b577-ea59db536696 => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:23:45.193649 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-87530c86-de8e-4331-942e-5218f451c57e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:23:45.194199 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-87530c86-de8e-4331-942e-5218f451c57e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: b34905c9-38ea-4885-b577-ea59db536696] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:23:45.201387 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-87530c86-de8e-4331-942e-5218f451c57e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:23:45.201885 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-87530c86-de8e-4331-942e-5218f451c57e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:23:45.202327 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-87530c86-de8e-4331-942e-5218f451c57e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:23:45.203028 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-87530c86-de8e-4331-942e-5218f451c57e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:23:45.203486 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-87530c86-de8e-4331-942e-5218f451c57e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:23:45.203947 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-87530c86-de8e-4331-942e-5218f451c57e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:23:45.336153 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-87530c86-de8e-4331-942e-5218f451c57e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:23:45.343978 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-87530c86-de8e-4331-942e-5218f451c57e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/b34905c9-38ea-4885-b577-ea59db536696" status: 200 len: 1678 microversion: 2.1 time: 0.154506 Aug 31 17:23:45.344532 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3957/7926] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:23:45 2022] GET /compute/v2.1/servers/b34905c9-38ea-4885-b577-ea59db536696 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:23:46.366435 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d5644be7-3759-4a9d-94f4-91ce33cf0178 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:23:46.367058 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d5644be7-3759-4a9d-94f4-91ce33cf0178 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: b34905c9-38ea-4885-b577-ea59db536696] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:23:46.374073 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d5644be7-3759-4a9d-94f4-91ce33cf0178 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:23:46.374581 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d5644be7-3759-4a9d-94f4-91ce33cf0178 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:23:46.375033 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d5644be7-3759-4a9d-94f4-91ce33cf0178 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:23:46.375771 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d5644be7-3759-4a9d-94f4-91ce33cf0178 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:23:46.376243 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d5644be7-3759-4a9d-94f4-91ce33cf0178 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:23:46.376682 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d5644be7-3759-4a9d-94f4-91ce33cf0178 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:23:46.535806 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d5644be7-3759-4a9d-94f4-91ce33cf0178 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:23:46.544618 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d5644be7-3759-4a9d-94f4-91ce33cf0178 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/b34905c9-38ea-4885-b577-ea59db536696" status: 200 len: 1678 microversion: 2.1 time: 0.182051 Aug 31 17:23:46.545208 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3970/7927] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:23:46 2022] GET /compute/v2.1/servers/b34905c9-38ea-4885-b577-ea59db536696 => generated 1678 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:23:47.566993 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9bc7ad83-259b-4dbc-8cc3-d02d80221e82 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:23:47.567660 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9bc7ad83-259b-4dbc-8cc3-d02d80221e82 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: b34905c9-38ea-4885-b577-ea59db536696] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:23:47.576317 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9bc7ad83-259b-4dbc-8cc3-d02d80221e82 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:23:47.576815 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9bc7ad83-259b-4dbc-8cc3-d02d80221e82 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:23:47.577266 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9bc7ad83-259b-4dbc-8cc3-d02d80221e82 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:23:47.577988 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9bc7ad83-259b-4dbc-8cc3-d02d80221e82 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:23:47.578459 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9bc7ad83-259b-4dbc-8cc3-d02d80221e82 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:23:47.578898 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9bc7ad83-259b-4dbc-8cc3-d02d80221e82 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:23:47.718708 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-9bc7ad83-259b-4dbc-8cc3-d02d80221e82 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:23:47.726520 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9bc7ad83-259b-4dbc-8cc3-d02d80221e82 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/b34905c9-38ea-4885-b577-ea59db536696" status: 200 len: 1678 microversion: 2.1 time: 0.164415 Aug 31 17:23:47.727109 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3958/7928] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:23:47 2022] GET /compute/v2.1/servers/b34905c9-38ea-4885-b577-ea59db536696 => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:23:48.749003 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-db128c9e-735c-471f-a6ad-99ba36aba99f tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:23:48.749555 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-db128c9e-735c-471f-a6ad-99ba36aba99f tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: b34905c9-38ea-4885-b577-ea59db536696] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:23:48.756607 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-db128c9e-735c-471f-a6ad-99ba36aba99f tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:23:48.757118 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-db128c9e-735c-471f-a6ad-99ba36aba99f tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:23:48.757578 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-db128c9e-735c-471f-a6ad-99ba36aba99f tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:23:48.758295 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-db128c9e-735c-471f-a6ad-99ba36aba99f tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:23:48.758832 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-db128c9e-735c-471f-a6ad-99ba36aba99f tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:23:48.759276 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-db128c9e-735c-471f-a6ad-99ba36aba99f tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:23:48.895317 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-db128c9e-735c-471f-a6ad-99ba36aba99f tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:23:48.903940 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-db128c9e-735c-471f-a6ad-99ba36aba99f tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/b34905c9-38ea-4885-b577-ea59db536696" status: 200 len: 1678 microversion: 2.1 time: 0.159810 Aug 31 17:23:48.904525 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3971/7929] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:23:48 2022] GET /compute/v2.1/servers/b34905c9-38ea-4885-b577-ea59db536696 => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:23:49.926063 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e9a21736-4aa1-4c3f-9486-8f7c8a589fcf tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:23:49.926696 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e9a21736-4aa1-4c3f-9486-8f7c8a589fcf tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: b34905c9-38ea-4885-b577-ea59db536696] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:23:49.928890 n-d-850499-9 devstack@n-api.service[122256]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 17:23:49.929043 n-d-850499-9 devstack@n-api.service[122256]: Wed Aug 31 17:23:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b34905c9-38ea-4885-b577-ea59db536696 (ip 10.222.0.61) !!! Aug 31 17:23:49.936772 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e9a21736-4aa1-4c3f-9486-8f7c8a589fcf tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:23:49.937271 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e9a21736-4aa1-4c3f-9486-8f7c8a589fcf tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:23:49.937721 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e9a21736-4aa1-4c3f-9486-8f7c8a589fcf tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:23:49.938435 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e9a21736-4aa1-4c3f-9486-8f7c8a589fcf tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:23:49.938904 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e9a21736-4aa1-4c3f-9486-8f7c8a589fcf tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:23:49.939342 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e9a21736-4aa1-4c3f-9486-8f7c8a589fcf tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:23:50.074454 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e9a21736-4aa1-4c3f-9486-8f7c8a589fcf tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:23:50.082304 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e9a21736-4aa1-4c3f-9486-8f7c8a589fcf tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/b34905c9-38ea-4885-b577-ea59db536696" status: 200 len: 1678 microversion: 2.1 time: 0.160368 Aug 31 17:23:50.082880 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3959/7930] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:23:49 2022] GET /compute/v2.1/servers/b34905c9-38ea-4885-b577-ea59db536696 => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:23:51.103316 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e02d001b-b313-4ce8-b743-9cc00ac69827 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:23:51.104015 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e02d001b-b313-4ce8-b743-9cc00ac69827 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: b34905c9-38ea-4885-b577-ea59db536696] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:23:51.111618 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e02d001b-b313-4ce8-b743-9cc00ac69827 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:23:51.112125 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e02d001b-b313-4ce8-b743-9cc00ac69827 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:23:51.112585 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e02d001b-b313-4ce8-b743-9cc00ac69827 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:23:51.113296 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e02d001b-b313-4ce8-b743-9cc00ac69827 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:23:51.113769 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e02d001b-b313-4ce8-b743-9cc00ac69827 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:23:51.114212 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e02d001b-b313-4ce8-b743-9cc00ac69827 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:23:51.250117 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e02d001b-b313-4ce8-b743-9cc00ac69827 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:23:51.257902 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e02d001b-b313-4ce8-b743-9cc00ac69827 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/b34905c9-38ea-4885-b577-ea59db536696" status: 200 len: 1678 microversion: 2.1 time: 0.158542 Aug 31 17:23:51.258477 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3972/7931] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:23:51 2022] GET /compute/v2.1/servers/b34905c9-38ea-4885-b577-ea59db536696 => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:23:52.280038 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c50ac96e-f0cb-425a-9ea1-fe197dd76d8e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:23:52.280705 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c50ac96e-f0cb-425a-9ea1-fe197dd76d8e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: b34905c9-38ea-4885-b577-ea59db536696] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:23:52.287744 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c50ac96e-f0cb-425a-9ea1-fe197dd76d8e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:23:52.288238 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c50ac96e-f0cb-425a-9ea1-fe197dd76d8e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:23:52.288684 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c50ac96e-f0cb-425a-9ea1-fe197dd76d8e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:23:52.289393 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c50ac96e-f0cb-425a-9ea1-fe197dd76d8e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:23:52.289855 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c50ac96e-f0cb-425a-9ea1-fe197dd76d8e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:23:52.290287 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c50ac96e-f0cb-425a-9ea1-fe197dd76d8e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:23:52.428868 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c50ac96e-f0cb-425a-9ea1-fe197dd76d8e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:23:52.437303 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c50ac96e-f0cb-425a-9ea1-fe197dd76d8e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/b34905c9-38ea-4885-b577-ea59db536696" status: 200 len: 1678 microversion: 2.1 time: 0.161382 Aug 31 17:23:52.437875 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3960/7932] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:23:52 2022] GET /compute/v2.1/servers/b34905c9-38ea-4885-b577-ea59db536696 => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:23:53.459346 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-bad30302-d5d2-4342-8dfe-d98bf4d39e4d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:23:53.460018 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-bad30302-d5d2-4342-8dfe-d98bf4d39e4d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: b34905c9-38ea-4885-b577-ea59db536696] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:23:53.467747 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bad30302-d5d2-4342-8dfe-d98bf4d39e4d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:23:53.468257 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bad30302-d5d2-4342-8dfe-d98bf4d39e4d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:23:53.468718 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bad30302-d5d2-4342-8dfe-d98bf4d39e4d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:23:53.469465 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bad30302-d5d2-4342-8dfe-d98bf4d39e4d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:23:53.469945 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bad30302-d5d2-4342-8dfe-d98bf4d39e4d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:23:53.470398 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bad30302-d5d2-4342-8dfe-d98bf4d39e4d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:23:53.612249 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-bad30302-d5d2-4342-8dfe-d98bf4d39e4d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:23:53.620104 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-bad30302-d5d2-4342-8dfe-d98bf4d39e4d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/b34905c9-38ea-4885-b577-ea59db536696" status: 200 len: 1678 microversion: 2.1 time: 0.164724 Aug 31 17:23:53.621082 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3973/7933] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:23:53 2022] GET /compute/v2.1/servers/b34905c9-38ea-4885-b577-ea59db536696 => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:23:54.642902 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f40cc3f4-66b4-4e5f-bbde-a4bac62276de tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:23:54.643490 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f40cc3f4-66b4-4e5f-bbde-a4bac62276de tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: b34905c9-38ea-4885-b577-ea59db536696] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:23:54.650738 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f40cc3f4-66b4-4e5f-bbde-a4bac62276de tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:23:54.651628 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f40cc3f4-66b4-4e5f-bbde-a4bac62276de tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:23:54.652270 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f40cc3f4-66b4-4e5f-bbde-a4bac62276de tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:23:54.653081 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f40cc3f4-66b4-4e5f-bbde-a4bac62276de tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:23:54.653552 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f40cc3f4-66b4-4e5f-bbde-a4bac62276de tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:23:54.653983 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f40cc3f4-66b4-4e5f-bbde-a4bac62276de tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:23:54.797634 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f40cc3f4-66b4-4e5f-bbde-a4bac62276de tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:23:54.805596 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f40cc3f4-66b4-4e5f-bbde-a4bac62276de tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/b34905c9-38ea-4885-b577-ea59db536696" status: 200 len: 1678 microversion: 2.1 time: 0.166568 Aug 31 17:23:54.806169 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3961/7934] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:23:54 2022] GET /compute/v2.1/servers/b34905c9-38ea-4885-b577-ea59db536696 => generated 1678 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:23:55.829085 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-04a017ec-dde5-421a-8ba2-c64c0758428b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:23:55.829797 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-04a017ec-dde5-421a-8ba2-c64c0758428b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: b34905c9-38ea-4885-b577-ea59db536696] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:23:55.837252 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-04a017ec-dde5-421a-8ba2-c64c0758428b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:23:55.837755 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-04a017ec-dde5-421a-8ba2-c64c0758428b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:23:55.838208 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-04a017ec-dde5-421a-8ba2-c64c0758428b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:23:55.839562 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-04a017ec-dde5-421a-8ba2-c64c0758428b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:23:55.840049 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-04a017ec-dde5-421a-8ba2-c64c0758428b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:23:55.840489 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-04a017ec-dde5-421a-8ba2-c64c0758428b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:23:55.980728 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-04a017ec-dde5-421a-8ba2-c64c0758428b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:23:55.988872 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-04a017ec-dde5-421a-8ba2-c64c0758428b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/b34905c9-38ea-4885-b577-ea59db536696" status: 200 len: 1678 microversion: 2.1 time: 0.163738 Aug 31 17:23:55.989456 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3974/7935] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:23:55 2022] GET /compute/v2.1/servers/b34905c9-38ea-4885-b577-ea59db536696 => generated 1678 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:23:57.015302 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-07019bb9-2285-4886-bd8e-edc51d19cc62 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:23:57.015945 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-07019bb9-2285-4886-bd8e-edc51d19cc62 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: b34905c9-38ea-4885-b577-ea59db536696] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:23:57.023297 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-07019bb9-2285-4886-bd8e-edc51d19cc62 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:23:57.023820 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-07019bb9-2285-4886-bd8e-edc51d19cc62 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:23:57.024261 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-07019bb9-2285-4886-bd8e-edc51d19cc62 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:23:57.024955 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-07019bb9-2285-4886-bd8e-edc51d19cc62 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:23:57.025413 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-07019bb9-2285-4886-bd8e-edc51d19cc62 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:23:57.025836 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-07019bb9-2285-4886-bd8e-edc51d19cc62 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:23:57.182868 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-07019bb9-2285-4886-bd8e-edc51d19cc62 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:23:57.192222 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-07019bb9-2285-4886-bd8e-edc51d19cc62 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/b34905c9-38ea-4885-b577-ea59db536696" status: 200 len: 1678 microversion: 2.1 time: 0.183502 Aug 31 17:23:57.192822 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3962/7936] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:23:57 2022] GET /compute/v2.1/servers/b34905c9-38ea-4885-b577-ea59db536696 => generated 1678 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:23:58.215949 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9bf0219b-9f5a-4ec3-bc92-a21a01107bd5 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:23:58.216576 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9bf0219b-9f5a-4ec3-bc92-a21a01107bd5 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: b34905c9-38ea-4885-b577-ea59db536696] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:23:58.223417 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9bf0219b-9f5a-4ec3-bc92-a21a01107bd5 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:23:58.223953 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9bf0219b-9f5a-4ec3-bc92-a21a01107bd5 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:23:58.224404 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9bf0219b-9f5a-4ec3-bc92-a21a01107bd5 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:23:58.225108 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9bf0219b-9f5a-4ec3-bc92-a21a01107bd5 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:23:58.225581 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9bf0219b-9f5a-4ec3-bc92-a21a01107bd5 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:23:58.226020 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9bf0219b-9f5a-4ec3-bc92-a21a01107bd5 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:23:58.362078 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9bf0219b-9f5a-4ec3-bc92-a21a01107bd5 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:23:58.371673 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9bf0219b-9f5a-4ec3-bc92-a21a01107bd5 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/b34905c9-38ea-4885-b577-ea59db536696" status: 200 len: 1678 microversion: 2.1 time: 0.160932 Aug 31 17:23:58.372339 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3975/7937] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:23:58 2022] GET /compute/v2.1/servers/b34905c9-38ea-4885-b577-ea59db536696 => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:23:59.396408 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7806c394-b42c-4165-b120-7890e2ab9207 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:23:59.397516 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7806c394-b42c-4165-b120-7890e2ab9207 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: b34905c9-38ea-4885-b577-ea59db536696] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:23:59.405141 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7806c394-b42c-4165-b120-7890e2ab9207 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:23:59.405639 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7806c394-b42c-4165-b120-7890e2ab9207 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:23:59.406086 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7806c394-b42c-4165-b120-7890e2ab9207 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:23:59.406795 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7806c394-b42c-4165-b120-7890e2ab9207 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:23:59.407265 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7806c394-b42c-4165-b120-7890e2ab9207 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:23:59.407744 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7806c394-b42c-4165-b120-7890e2ab9207 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:23:59.551946 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7806c394-b42c-4165-b120-7890e2ab9207 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:23:59.560381 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7806c394-b42c-4165-b120-7890e2ab9207 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/b34905c9-38ea-4885-b577-ea59db536696" status: 200 len: 1678 microversion: 2.1 time: 0.170907 Aug 31 17:23:59.560953 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3963/7938] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:23:59 2022] GET /compute/v2.1/servers/b34905c9-38ea-4885-b577-ea59db536696 => generated 1678 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:24:00.581671 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8b3ab750-0b38-4b79-9497-13a25102e185 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:24:00.582300 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8b3ab750-0b38-4b79-9497-13a25102e185 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: b34905c9-38ea-4885-b577-ea59db536696] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:24:00.589934 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b3ab750-0b38-4b79-9497-13a25102e185 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:24:00.590440 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b3ab750-0b38-4b79-9497-13a25102e185 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:24:00.590898 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b3ab750-0b38-4b79-9497-13a25102e185 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:24:00.591634 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b3ab750-0b38-4b79-9497-13a25102e185 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:24:00.592140 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b3ab750-0b38-4b79-9497-13a25102e185 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:24:00.592579 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b3ab750-0b38-4b79-9497-13a25102e185 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:24:00.732695 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8b3ab750-0b38-4b79-9497-13a25102e185 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:24:00.740742 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8b3ab750-0b38-4b79-9497-13a25102e185 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/b34905c9-38ea-4885-b577-ea59db536696" status: 200 len: 1681 microversion: 2.1 time: 0.163020 Aug 31 17:24:00.741321 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3976/7939] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:24:00 2022] GET /compute/v2.1/servers/b34905c9-38ea-4885-b577-ea59db536696 => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:24:34.971826 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-35643270-b0bb-42c7-93a1-4b0b3e0731c2 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:24:34.974013 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-35643270-b0bb-42c7-93a1-4b0b3e0731c2 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: b34905c9-38ea-4885-b577-ea59db536696] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:24:34.976404 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=16 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:24:34.977063 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=48 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:24:34.982814 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-35643270-b0bb-42c7-93a1-4b0b3e0731c2 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:24:34.983314 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-35643270-b0bb-42c7-93a1-4b0b3e0731c2 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:24:34.983862 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-35643270-b0bb-42c7-93a1-4b0b3e0731c2 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:24:34.984572 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-35643270-b0bb-42c7-93a1-4b0b3e0731c2 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:24:34.985092 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-35643270-b0bb-42c7-93a1-4b0b3e0731c2 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:24:34.985530 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-35643270-b0bb-42c7-93a1-4b0b3e0731c2 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:24:35.065254 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-35643270-b0bb-42c7-93a1-4b0b3e0731c2 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "POST /compute/v2.1/servers/b34905c9-38ea-4885-b577-ea59db536696/action" status: 200 len: 69094 microversion: 2.1 time: 0.097211 Aug 31 17:24:35.065936 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3964/7940] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 17:24:34 2022] POST /compute/v2.1/servers/b34905c9-38ea-4885-b577-ea59db536696/action => generated 69094 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 17:24:52.324741 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-61eed054-284c-4b2a-ae80-1c811ccb1001 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:24:52.330653 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-4dcf0da3-b3df-444b-886f-6114464ef81d req-2250806a-7d1d-4630-9042-f5f6d1b41e70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b34905c9-38ea-4885-b577-ea59db536696", "tag": "22d1f752-c3a6-435c-b338-e610007b858f"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:24:52.331785 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-61eed054-284c-4b2a-ae80-1c811ccb1001 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: b34905c9-38ea-4885-b577-ea59db536696] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:24:52.337448 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=18 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:24:52.338134 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:24:52.343130 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:24:52.343582 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-61eed054-284c-4b2a-ae80-1c811ccb1001 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:24:52.344118 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-61eed054-284c-4b2a-ae80-1c811ccb1001 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:24:52.344458 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=4 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:24:52.344630 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-61eed054-284c-4b2a-ae80-1c811ccb1001 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:24:52.346202 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-61eed054-284c-4b2a-ae80-1c811ccb1001 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:24:52.346666 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-61eed054-284c-4b2a-ae80-1c811ccb1001 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:24:52.347186 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-61eed054-284c-4b2a-ae80-1c811ccb1001 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:24:52.351034 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-4dcf0da3-b3df-444b-886f-6114464ef81d req-2250806a-7d1d-4630-9042-f5f6d1b41e70 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:24:52.351620 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-4dcf0da3-b3df-444b-886f-6114464ef81d req-2250806a-7d1d-4630-9042-f5f6d1b41e70 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:24:52.352071 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-4dcf0da3-b3df-444b-886f-6114464ef81d req-2250806a-7d1d-4630-9042-f5f6d1b41e70 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:24:52.366400 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-4dcf0da3-b3df-444b-886f-6114464ef81d req-2250806a-7d1d-4630-9042-f5f6d1b41e70 service nova] Creating event network-changed:22d1f752-c3a6-435c-b338-e610007b858f for instance b34905c9-38ea-4885-b577-ea59db536696 on n-h1-850499-9 Aug 31 17:24:52.373072 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-4dcf0da3-b3df-444b-886f-6114464ef81d req-2250806a-7d1d-4630-9042-f5f6d1b41e70 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045763 Aug 31 17:24:52.374446 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3965/7941] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:24:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:24:52.376783 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-61eed054-284c-4b2a-ae80-1c811ccb1001 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: b34905c9-38ea-4885-b577-ea59db536696] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 17:24:52.479119 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-61eed054-284c-4b2a-ae80-1c811ccb1001 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "DELETE /compute/v2.1/servers/b34905c9-38ea-4885-b577-ea59db536696" status: 204 len: 0 microversion: 2.1 time: 0.158545 Aug 31 17:24:52.480010 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3977/7942] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 17:24:52 2022] DELETE /compute/v2.1/servers/b34905c9-38ea-4885-b577-ea59db536696 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 17:24:52.491822 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-27cc2980-ea59-48b6-8ca4-9baf878629ae tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:24:52.492929 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-27cc2980-ea59-48b6-8ca4-9baf878629ae tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: b34905c9-38ea-4885-b577-ea59db536696] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:24:52.500112 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-27cc2980-ea59-48b6-8ca4-9baf878629ae tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:24:52.501336 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-27cc2980-ea59-48b6-8ca4-9baf878629ae tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:24:52.502552 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-27cc2980-ea59-48b6-8ca4-9baf878629ae tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:24:52.502873 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-27cc2980-ea59-48b6-8ca4-9baf878629ae tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:24:52.503649 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-27cc2980-ea59-48b6-8ca4-9baf878629ae tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:24:52.505133 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-27cc2980-ea59-48b6-8ca4-9baf878629ae tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:24:52.664345 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-27cc2980-ea59-48b6-8ca4-9baf878629ae tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:24:52.673135 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-27cc2980-ea59-48b6-8ca4-9baf878629ae tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/b34905c9-38ea-4885-b577-ea59db536696" status: 200 len: 1687 microversion: 2.1 time: 0.186682 Aug 31 17:24:52.673728 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3966/7943] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:24:52 2022] GET /compute/v2.1/servers/b34905c9-38ea-4885-b577-ea59db536696 => generated 1687 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:24:53.695225 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e643e377-ea4f-4566-8ff6-647d4dc5d2ab tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:24:53.695974 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e643e377-ea4f-4566-8ff6-647d4dc5d2ab tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: b34905c9-38ea-4885-b577-ea59db536696] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:24:53.704283 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e643e377-ea4f-4566-8ff6-647d4dc5d2ab tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:24:53.704789 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e643e377-ea4f-4566-8ff6-647d4dc5d2ab tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:24:53.705245 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e643e377-ea4f-4566-8ff6-647d4dc5d2ab tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:24:53.705964 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e643e377-ea4f-4566-8ff6-647d4dc5d2ab tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:24:53.706443 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e643e377-ea4f-4566-8ff6-647d4dc5d2ab tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:24:53.706890 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e643e377-ea4f-4566-8ff6-647d4dc5d2ab tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:24:53.851139 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e643e377-ea4f-4566-8ff6-647d4dc5d2ab tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:24:53.859847 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e643e377-ea4f-4566-8ff6-647d4dc5d2ab tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/b34905c9-38ea-4885-b577-ea59db536696" status: 200 len: 1687 microversion: 2.1 time: 0.168909 Aug 31 17:24:53.860439 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3978/7944] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:24:53 2022] GET /compute/v2.1/servers/b34905c9-38ea-4885-b577-ea59db536696 => generated 1687 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:24:54.760769 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-6f8370ed-ab60-413a-b6d5-6c7bd762f6b7 req-57b105b3-6f92-4dac-8194-396222f46f67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b34905c9-38ea-4885-b577-ea59db536696", "name": "network-vif-deleted", "tag": "22d1f752-c3a6-435c-b338-e610007b858f"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:24:54.771289 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-6f8370ed-ab60-413a-b6d5-6c7bd762f6b7 req-57b105b3-6f92-4dac-8194-396222f46f67 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:24:54.772099 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-6f8370ed-ab60-413a-b6d5-6c7bd762f6b7 req-57b105b3-6f92-4dac-8194-396222f46f67 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:24:54.772583 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-6f8370ed-ab60-413a-b6d5-6c7bd762f6b7 req-57b105b3-6f92-4dac-8194-396222f46f67 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:24:54.786612 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-6f8370ed-ab60-413a-b6d5-6c7bd762f6b7 req-57b105b3-6f92-4dac-8194-396222f46f67 service nova] Creating event network-vif-deleted:22d1f752-c3a6-435c-b338-e610007b858f for instance b34905c9-38ea-4885-b577-ea59db536696 on n-h1-850499-9 Aug 31 17:24:54.791747 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-6f8370ed-ab60-413a-b6d5-6c7bd762f6b7 req-57b105b3-6f92-4dac-8194-396222f46f67 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034686 Aug 31 17:24:54.792360 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3967/7945] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:24:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:24:54.881848 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-db346c57-788e-4c68-9615-c5d913ad075c tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:24:54.882483 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-db346c57-788e-4c68-9615-c5d913ad075c tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: b34905c9-38ea-4885-b577-ea59db536696] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:24:54.890050 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-db346c57-788e-4c68-9615-c5d913ad075c tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:24:54.890568 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-db346c57-788e-4c68-9615-c5d913ad075c tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:24:54.891015 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-db346c57-788e-4c68-9615-c5d913ad075c tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:24:54.891775 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-db346c57-788e-4c68-9615-c5d913ad075c tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:24:54.892260 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-db346c57-788e-4c68-9615-c5d913ad075c tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:24:54.892729 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-db346c57-788e-4c68-9615-c5d913ad075c tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:24:54.930133 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-db346c57-788e-4c68-9615-c5d913ad075c tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:24:54.930651 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-db346c57-788e-4c68-9615-c5d913ad075c tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:24:54.931105 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-db346c57-788e-4c68-9615-c5d913ad075c tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:24:54.931680 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-db346c57-788e-4c68-9615-c5d913ad075c tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lazy-loading 'fault' on Instance uuid b34905c9-38ea-4885-b577-ea59db536696 {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 17:24:54.979918 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-db346c57-788e-4c68-9615-c5d913ad075c tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:24:54.988707 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-db346c57-788e-4c68-9615-c5d913ad075c tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/b34905c9-38ea-4885-b577-ea59db536696" status: 200 len: 1355 microversion: 2.1 time: 0.110779 Aug 31 17:24:54.989289 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3979/7946] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:24:54 2022] GET /compute/v2.1/servers/b34905c9-38ea-4885-b577-ea59db536696 => generated 1355 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:24:56.011336 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5f0181c7-969b-46f9-9dbd-4e17c9471ad6 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:24:56.012051 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5f0181c7-969b-46f9-9dbd-4e17c9471ad6 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: b34905c9-38ea-4885-b577-ea59db536696] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:24:56.019262 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5f0181c7-969b-46f9-9dbd-4e17c9471ad6 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:24:56.019804 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5f0181c7-969b-46f9-9dbd-4e17c9471ad6 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:24:56.020255 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5f0181c7-969b-46f9-9dbd-4e17c9471ad6 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:24:56.020962 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5f0181c7-969b-46f9-9dbd-4e17c9471ad6 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:24:56.021428 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5f0181c7-969b-46f9-9dbd-4e17c9471ad6 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:24:56.022122 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5f0181c7-969b-46f9-9dbd-4e17c9471ad6 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:24:56.036234 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-5f0181c7-969b-46f9-9dbd-4e17c9471ad6 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] HTTP exception thrown: Instance b34905c9-38ea-4885-b577-ea59db536696 could not be found. Aug 31 17:24:56.037901 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5f0181c7-969b-46f9-9dbd-4e17c9471ad6 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Request method failure captured: Aug 31 17:24:56.037901 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/b34905c9-38ea-4885-b577-ea59db536696 HTTP/1.1 Aug 31 17:24:56.037901 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 17:24:56.037901 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 17:24:56.037901 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 17:24:56.037901 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 17:24:56.037901 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 17:24:56.037901 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 17:24:56.037901 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 17:24:56.037901 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 17:24:56.037901 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD5hakwX2sXsbALOgVo9PPyLePH0fvR7L2xAV9ui8HTcLnBw3oZI1M7wF3mkEoqVA9fsecKEAxd9W333iMdsO8-IzHDYJUM0nEaJnVkZbE7IkWX3bqA3p9FNp7cLB3haZsSOX7PxhWli3RU37vvA4Rc8W5sIFHQE1dXFZWX5L9iGDZKs Aug 31 17:24:56.037901 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 17:24:56.037901 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 17:24:56.037901 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 17:24:56.037901 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 17:24:56.037901 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 17:24:56.037901 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 17:24:56.037901 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: dc47c533fa344b1caa1082a8caf19e36 Aug 31 17:24:56.037901 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-489466368 Aug 31 17:24:56.037901 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 17:24:56.037901 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 17:24:56.037901 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/dc47c533fa344b1caa1082a8caf19e36"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/dc47c533fa344b1caa1082a8caf19e36"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_dc47c533fa344b1caa1082a8caf19e36", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/dc47c533fa344b1caa1082a8caf19e36"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 17:24:56.037901 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-TestNetworkAdvancedServerOps-489466368 Aug 31 17:24:56.037901 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: dc47c533fa344b1caa1082a8caf19e36 Aug 31 17:24:56.037901 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-489466368 Aug 31 17:24:56.037901 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-TestNetworkAdvancedServerOps-489466368-project Aug 31 17:24:56.037901 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 17:24:56.037901 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 17:24:56.037901 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 684d0544424b41fe951feb12dae6b1c2 Aug 31 17:24:56.037901 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-TestNetworkAdvancedServerOps-489466368-project Aug 31 17:24:56.037901 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 17:24:56.037901 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance b34905c9-38ea-4885-b577-ea59db536696 could not be found. Aug 31 17:24:56.037901 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': 'b34905c9-38ea-4885-b577-ea59db536696'} Aug 31 17:24:56.037901 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 17:24:56.037901 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:24:56.037901 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 17:24:56.037901 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 17:24:56.037901 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 17:24:56.037901 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 17:24:56.037901 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 17:24:56.037901 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 17:24:56.037901 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 17:24:56.037901 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 17:24:56.037901 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b34905c9-38ea-4885-b577-ea59db536696 could not be found. Aug 31 17:24:56.037901 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:24:56.037901 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:24:56.037901 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:24:56.037901 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:24:56.037901 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:24:56.037901 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:24:56.037901 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 17:24:56.037901 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 17:24:56.037901 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 17:24:56.037901 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 17:24:56.037901 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 17:24:56.037901 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 17:24:56.037901 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 17:24:56.037901 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 17:24:56.037901 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 17:24:56.037901 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 17:24:56.037901 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b34905c9-38ea-4885-b577-ea59db536696 could not be found. Aug 31 17:24:56.037901 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:24:56.037901 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:24:56.042677 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:24:56.042677 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:24:56.042677 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:24:56.042677 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:24:56.042677 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 17:24:56.042677 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 17:24:56.042677 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b34905c9-38ea-4885-b577-ea59db536696 could not be found. Aug 31 17:24:56.042677 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:24:56.042677 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5f0181c7-969b-46f9-9dbd-4e17c9471ad6 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Returning 404 to user: Instance b34905c9-38ea-4885-b577-ea59db536696 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 17:24:56.042677 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5f0181c7-969b-46f9-9dbd-4e17c9471ad6 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/b34905c9-38ea-4885-b577-ea59db536696" status: 404 len: 111 microversion: 2.1 time: 0.033579 Aug 31 17:24:56.042677 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3968/7947] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:24:56 2022] GET /compute/v2.1/servers/b34905c9-38ea-4885-b577-ea59db536696 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 17:24:59.565188 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e257a7ab-c5a2-4064-8004-56ce9249271d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '.version_select at 0x7f5ae3a4f160>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:24:59.570421 n-d-850499-9 devstack@n-api.service[122257]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e257a7ab-c5a2-4064-8004-56ce9249271d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [71efe5ec-3448-444a-b5c7-a9d033d02814] AMQP server on 10.222.0.61:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 31 17:25:00.579878 n-d-850499-9 devstack@n-api.service[122257]: INFO oslo.messaging._drivers.impl_rabbit [None req-e257a7ab-c5a2-4064-8004-56ce9249271d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [71efe5ec-3448-444a-b5c7-a9d033d02814] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 39858. Aug 31 17:25:00.601495 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e257a7ab-c5a2-4064-8004-56ce9249271d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-98044150" status: 202 len: 0 microversion: 2.1 time: 1.040299 Aug 31 17:25:00.602095 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3980/7948] 10.222.0.61 () {58 vars in 1278 bytes} [Wed Aug 31 17:24:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-98044150 => generated 0 bytes in 1042 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 17:25:00.634697 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c782d801-b159-482b-9cd3-61afb8b5f51e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Action: 'create', calling method: .version_select at 0x7f5ae9851550>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-10982857", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAMZKCNRtMHqoM+E69aFQCcjD6vCXx15qOBMdHdr5MMXAbzAV+K8VqmphejlfuYDGtMi2NDrfC0S+kUTcjzex/jb1h9ZC0jgkq8dNz+k+6Flvt0oRv+quG1OMx8dq/V+Nw=="}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:25:00.652269 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-c782d801-b159-482b-9cd3-61afb8b5f51e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Getting quotas for project dc47c533fa344b1caa1082a8caf19e36. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 17:25:00.658150 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-c782d801-b159-482b-9cd3-61afb8b5f51e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Getting quotas for user 684d0544424b41fe951feb12dae6b1c2 and project dc47c533fa344b1caa1082a8caf19e36. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 17:25:00.671952 n-d-850499-9 devstack@n-api.service[122256]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c782d801-b159-482b-9cd3-61afb8b5f51e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [1ec33fc2-e14a-42ed-8921-718494e3d541] AMQP server on 10.222.0.61:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 31 17:25:01.679181 n-d-850499-9 devstack@n-api.service[122256]: INFO oslo.messaging._drivers.impl_rabbit [None req-c782d801-b159-482b-9cd3-61afb8b5f51e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [1ec33fc2-e14a-42ed-8921-718494e3d541] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 39862. Aug 31 17:25:01.694953 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c782d801-b159-482b-9cd3-61afb8b5f51e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 1.064189 Aug 31 17:25:01.695588 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3969/7949] 10.222.0.61 () {60 vars in 1159 bytes} [Wed Aug 31 17:25:00 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 17:25:07.475242 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:25:07.479837 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-17ff720b-98b2-41d9-9eea-0c796ac309ae tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1227543587", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "networks": [{"uuid": "a4f0f2b8-8215-4408-a799-1c12c5b525d6"}], "key_name": "tempest-TestNetworkAdvancedServerOps-10982857", "security_groups": [{"name": "tempest-secgroup-smoke-531543438"}]}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:25:07.609095 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-17ff720b-98b2-41d9-9eea-0c796ac309ae tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] validate_networks() for [('a4f0f2b8-8215-4408-a799-1c12c5b525d6', None, None, None, None, None)] {{(pid=122257) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 17:25:08.119957 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-17ff720b-98b2-41d9-9eea-0c796ac309ae tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 17:25:08.120862 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-17ff720b-98b2-41d9-9eea-0c796ac309ae tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 17:25:08.121561 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-17ff720b-98b2-41d9-9eea-0c796ac309ae tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 17:25:08.122153 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-17ff720b-98b2-41d9-9eea-0c796ac309ae tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 17:25:08.122763 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-17ff720b-98b2-41d9-9eea-0c796ac309ae tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 17:25:08.133123 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-17ff720b-98b2-41d9-9eea-0c796ac309ae tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:25:08.133764 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-17ff720b-98b2-41d9-9eea-0c796ac309ae tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:25:08.134180 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-17ff720b-98b2-41d9-9eea-0c796ac309ae tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:25:08.135022 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-17ff720b-98b2-41d9-9eea-0c796ac309ae tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:25:08.135526 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-17ff720b-98b2-41d9-9eea-0c796ac309ae tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:25:08.136201 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-17ff720b-98b2-41d9-9eea-0c796ac309ae tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:25:08.154649 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-17ff720b-98b2-41d9-9eea-0c796ac309ae tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Getting quotas for project dc47c533fa344b1caa1082a8caf19e36. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 17:25:08.160298 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-17ff720b-98b2-41d9-9eea-0c796ac309ae tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Getting quotas for user 684d0544424b41fe951feb12dae6b1c2 and project dc47c533fa344b1caa1082a8caf19e36. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 17:25:08.175137 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-17ff720b-98b2-41d9-9eea-0c796ac309ae tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Going to run 1 instances... {{(pid=122257) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 17:25:08.177819 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-17ff720b-98b2-41d9-9eea-0c796ac309ae tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 9059a365-9c01-48cf-b320-3a762376705f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 17:25:08.226259 n-d-850499-9 devstack@n-api.service[122257]: ERROR oslo.messaging._drivers.impl_rabbit [None req-17ff720b-98b2-41d9-9eea-0c796ac309ae tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [08cd7b35-3bf6-4e68-8f61-cc4146940754] AMQP server on 10.222.0.61:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 31 17:25:09.234507 n-d-850499-9 devstack@n-api.service[122257]: INFO oslo.messaging._drivers.impl_rabbit [None req-17ff720b-98b2-41d9-9eea-0c796ac309ae tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [08cd7b35-3bf6-4e68-8f61-cc4146940754] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 39908. Aug 31 17:25:09.248611 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-17ff720b-98b2-41d9-9eea-0c796ac309ae tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.775069 Aug 31 17:25:09.249284 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3981/7950] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 17:25:07 2022] POST /compute/v2.1/servers => generated 405 bytes in 1777 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 17:25:09.272014 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8353c55f-135f-4795-838b-d758f255c1dc tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:25:09.272862 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8353c55f-135f-4795-838b-d758f255c1dc tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 9059a365-9c01-48cf-b320-3a762376705f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:25:09.276154 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=12 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:25:09.498115 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8353c55f-135f-4795-838b-d758f255c1dc tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:25:09.508791 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8353c55f-135f-4795-838b-d758f255c1dc tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/9059a365-9c01-48cf-b320-3a762376705f" status: 200 len: 1265 microversion: 2.1 time: 0.251063 Aug 31 17:25:09.509848 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3970/7951] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:25:09 2022] GET /compute/v2.1/servers/9059a365-9c01-48cf-b320-3a762376705f => generated 1265 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:25:10.533749 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-eabc733e-7f2c-41fa-b276-b6f502b86c09 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:25:10.534309 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-eabc733e-7f2c-41fa-b276-b6f502b86c09 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 9059a365-9c01-48cf-b320-3a762376705f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:25:10.541003 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eabc733e-7f2c-41fa-b276-b6f502b86c09 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:25:10.541443 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eabc733e-7f2c-41fa-b276-b6f502b86c09 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:25:10.541943 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eabc733e-7f2c-41fa-b276-b6f502b86c09 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:25:10.542700 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eabc733e-7f2c-41fa-b276-b6f502b86c09 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:25:10.543194 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eabc733e-7f2c-41fa-b276-b6f502b86c09 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:25:10.544451 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eabc733e-7f2c-41fa-b276-b6f502b86c09 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:25:10.611386 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-eabc733e-7f2c-41fa-b276-b6f502b86c09 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:25:10.619447 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-eabc733e-7f2c-41fa-b276-b6f502b86c09 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/9059a365-9c01-48cf-b320-3a762376705f" status: 200 len: 1323 microversion: 2.1 time: 0.091767 Aug 31 17:25:10.620149 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3982/7952] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:25:10 2022] GET /compute/v2.1/servers/9059a365-9c01-48cf-b320-3a762376705f => generated 1323 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:25:11.642305 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-537aa0f7-ce75-4a57-aec0-478d0356d9d4 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:25:11.642939 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-537aa0f7-ce75-4a57-aec0-478d0356d9d4 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 9059a365-9c01-48cf-b320-3a762376705f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:25:11.650129 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-537aa0f7-ce75-4a57-aec0-478d0356d9d4 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:25:11.650623 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-537aa0f7-ce75-4a57-aec0-478d0356d9d4 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:25:11.651071 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-537aa0f7-ce75-4a57-aec0-478d0356d9d4 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:25:11.652437 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-537aa0f7-ce75-4a57-aec0-478d0356d9d4 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:25:11.653572 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-537aa0f7-ce75-4a57-aec0-478d0356d9d4 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:25:11.654017 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-537aa0f7-ce75-4a57-aec0-478d0356d9d4 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:25:11.891489 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-537aa0f7-ce75-4a57-aec0-478d0356d9d4 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:25:11.899886 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-537aa0f7-ce75-4a57-aec0-478d0356d9d4 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/9059a365-9c01-48cf-b320-3a762376705f" status: 200 len: 1390 microversion: 2.1 time: 0.261605 Aug 31 17:25:11.900413 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3971/7953] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:25:11 2022] GET /compute/v2.1/servers/9059a365-9c01-48cf-b320-3a762376705f => generated 1390 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:25:12.078009 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-bac63bfe-f4f9-4068-ac13-d2ef3f80b22b req-d8e4bc51-bedd-4bfc-8c0b-4b573d3a843b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9059a365-9c01-48cf-b320-3a762376705f", "tag": "f52d4558-50e5-4318-8403-6a9469b58639"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:25:12.087934 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-bac63bfe-f4f9-4068-ac13-d2ef3f80b22b req-d8e4bc51-bedd-4bfc-8c0b-4b573d3a843b service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:25:12.088607 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-bac63bfe-f4f9-4068-ac13-d2ef3f80b22b req-d8e4bc51-bedd-4bfc-8c0b-4b573d3a843b service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:25:12.089129 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-bac63bfe-f4f9-4068-ac13-d2ef3f80b22b req-d8e4bc51-bedd-4bfc-8c0b-4b573d3a843b service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:25:12.101510 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-bac63bfe-f4f9-4068-ac13-d2ef3f80b22b req-d8e4bc51-bedd-4bfc-8c0b-4b573d3a843b service nova] Creating event network-changed:f52d4558-50e5-4318-8403-6a9469b58639 for instance 9059a365-9c01-48cf-b320-3a762376705f on n-h2-850499-9 Aug 31 17:25:12.107463 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-bac63bfe-f4f9-4068-ac13-d2ef3f80b22b req-d8e4bc51-bedd-4bfc-8c0b-4b573d3a843b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095374 Aug 31 17:25:12.108193 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3983/7954] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:25:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:25:12.921006 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e33d8ba7-e25b-4a4b-93f3-e8f5309b200d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:25:12.921633 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e33d8ba7-e25b-4a4b-93f3-e8f5309b200d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 9059a365-9c01-48cf-b320-3a762376705f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:25:12.928578 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e33d8ba7-e25b-4a4b-93f3-e8f5309b200d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:25:12.929063 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e33d8ba7-e25b-4a4b-93f3-e8f5309b200d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:25:12.929512 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e33d8ba7-e25b-4a4b-93f3-e8f5309b200d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:25:12.930220 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e33d8ba7-e25b-4a4b-93f3-e8f5309b200d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:25:12.930686 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e33d8ba7-e25b-4a4b-93f3-e8f5309b200d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:25:12.931125 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e33d8ba7-e25b-4a4b-93f3-e8f5309b200d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:25:13.066558 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e33d8ba7-e25b-4a4b-93f3-e8f5309b200d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:25:13.074358 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e33d8ba7-e25b-4a4b-93f3-e8f5309b200d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/9059a365-9c01-48cf-b320-3a762376705f" status: 200 len: 1390 microversion: 2.1 time: 0.157448 Aug 31 17:25:13.075556 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3972/7955] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:25:12 2022] GET /compute/v2.1/servers/9059a365-9c01-48cf-b320-3a762376705f => generated 1390 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:25:14.096670 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-962a2dc9-f847-417e-ae17-aebfa727b442 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:25:14.097490 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-962a2dc9-f847-417e-ae17-aebfa727b442 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 9059a365-9c01-48cf-b320-3a762376705f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:25:14.104561 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-962a2dc9-f847-417e-ae17-aebfa727b442 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:25:14.105062 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-962a2dc9-f847-417e-ae17-aebfa727b442 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:25:14.105520 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-962a2dc9-f847-417e-ae17-aebfa727b442 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:25:14.106396 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-962a2dc9-f847-417e-ae17-aebfa727b442 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:25:14.106705 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-962a2dc9-f847-417e-ae17-aebfa727b442 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:25:14.107158 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-962a2dc9-f847-417e-ae17-aebfa727b442 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:25:14.239643 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-962a2dc9-f847-417e-ae17-aebfa727b442 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:25:14.247348 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-962a2dc9-f847-417e-ae17-aebfa727b442 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/9059a365-9c01-48cf-b320-3a762376705f" status: 200 len: 1390 microversion: 2.1 time: 0.154999 Aug 31 17:25:14.248036 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3984/7956] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:25:14 2022] GET /compute/v2.1/servers/9059a365-9c01-48cf-b320-3a762376705f => generated 1390 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:25:15.269210 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-807601e9-e5ae-4891-8ffd-b7c37b8b26b3 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:25:15.269838 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-807601e9-e5ae-4891-8ffd-b7c37b8b26b3 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 9059a365-9c01-48cf-b320-3a762376705f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:25:15.276992 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-807601e9-e5ae-4891-8ffd-b7c37b8b26b3 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:25:15.277495 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-807601e9-e5ae-4891-8ffd-b7c37b8b26b3 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:25:15.278529 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-807601e9-e5ae-4891-8ffd-b7c37b8b26b3 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:25:15.279232 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-807601e9-e5ae-4891-8ffd-b7c37b8b26b3 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:25:15.279732 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-807601e9-e5ae-4891-8ffd-b7c37b8b26b3 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:25:15.280294 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-807601e9-e5ae-4891-8ffd-b7c37b8b26b3 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:25:15.784718 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-807601e9-e5ae-4891-8ffd-b7c37b8b26b3 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:25:15.792778 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-807601e9-e5ae-4891-8ffd-b7c37b8b26b3 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/9059a365-9c01-48cf-b320-3a762376705f" status: 200 len: 1390 microversion: 2.1 time: 0.527526 Aug 31 17:25:15.793855 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3973/7957] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:25:15 2022] GET /compute/v2.1/servers/9059a365-9c01-48cf-b320-3a762376705f => generated 1390 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:25:16.815104 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-658393a4-5ef5-4a18-8f98-cd2620cbd573 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:25:16.815784 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-658393a4-5ef5-4a18-8f98-cd2620cbd573 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 9059a365-9c01-48cf-b320-3a762376705f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:25:16.822570 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-658393a4-5ef5-4a18-8f98-cd2620cbd573 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:25:16.823080 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-658393a4-5ef5-4a18-8f98-cd2620cbd573 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:25:16.823558 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-658393a4-5ef5-4a18-8f98-cd2620cbd573 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:25:16.824276 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-658393a4-5ef5-4a18-8f98-cd2620cbd573 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:25:16.825292 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-658393a4-5ef5-4a18-8f98-cd2620cbd573 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:25:16.825834 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-658393a4-5ef5-4a18-8f98-cd2620cbd573 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:25:17.012745 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-658393a4-5ef5-4a18-8f98-cd2620cbd573 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:25:17.020620 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-658393a4-5ef5-4a18-8f98-cd2620cbd573 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/9059a365-9c01-48cf-b320-3a762376705f" status: 200 len: 1390 microversion: 2.1 time: 0.210232 Aug 31 17:25:17.021218 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3985/7958] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:25:16 2022] GET /compute/v2.1/servers/9059a365-9c01-48cf-b320-3a762376705f => generated 1390 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:25:18.042389 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-425cd4ac-9a2b-4a48-91e5-8844aac4ca50 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:25:18.043015 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-425cd4ac-9a2b-4a48-91e5-8844aac4ca50 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 9059a365-9c01-48cf-b320-3a762376705f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:25:18.050931 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-425cd4ac-9a2b-4a48-91e5-8844aac4ca50 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:25:18.051429 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-425cd4ac-9a2b-4a48-91e5-8844aac4ca50 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:25:18.051906 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-425cd4ac-9a2b-4a48-91e5-8844aac4ca50 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:25:18.052617 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-425cd4ac-9a2b-4a48-91e5-8844aac4ca50 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:25:18.053452 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-425cd4ac-9a2b-4a48-91e5-8844aac4ca50 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:25:18.053900 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-425cd4ac-9a2b-4a48-91e5-8844aac4ca50 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:25:18.188467 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-425cd4ac-9a2b-4a48-91e5-8844aac4ca50 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:25:18.196171 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-425cd4ac-9a2b-4a48-91e5-8844aac4ca50 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/9059a365-9c01-48cf-b320-3a762376705f" status: 200 len: 1390 microversion: 2.1 time: 0.157749 Aug 31 17:25:18.196751 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3974/7959] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:25:18 2022] GET /compute/v2.1/servers/9059a365-9c01-48cf-b320-3a762376705f => generated 1390 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:25:19.218014 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a221a6ca-bcca-4900-ba47-1ff0f80f3ad5 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:25:19.218791 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a221a6ca-bcca-4900-ba47-1ff0f80f3ad5 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 9059a365-9c01-48cf-b320-3a762376705f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:25:19.220908 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:25:19.221619 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=6 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:25:19.227465 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a221a6ca-bcca-4900-ba47-1ff0f80f3ad5 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:25:19.228005 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a221a6ca-bcca-4900-ba47-1ff0f80f3ad5 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:25:19.228465 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a221a6ca-bcca-4900-ba47-1ff0f80f3ad5 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:25:19.229338 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a221a6ca-bcca-4900-ba47-1ff0f80f3ad5 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:25:19.229824 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a221a6ca-bcca-4900-ba47-1ff0f80f3ad5 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:25:19.230273 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a221a6ca-bcca-4900-ba47-1ff0f80f3ad5 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:25:19.254071 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-3d491d75-5233-4bf9-b2c3-3c10d61c256f req-8bd0ee43-8fd0-46cd-9781-7b33ea2bc80d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9059a365-9c01-48cf-b320-3a762376705f", "name": "network-vif-plugged", "status": "completed", "tag": "f52d4558-50e5-4318-8403-6a9469b58639"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:25:19.265956 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-3d491d75-5233-4bf9-b2c3-3c10d61c256f req-8bd0ee43-8fd0-46cd-9781-7b33ea2bc80d service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:25:19.266657 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-3d491d75-5233-4bf9-b2c3-3c10d61c256f req-8bd0ee43-8fd0-46cd-9781-7b33ea2bc80d service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:25:19.267146 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-3d491d75-5233-4bf9-b2c3-3c10d61c256f req-8bd0ee43-8fd0-46cd-9781-7b33ea2bc80d service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:25:19.283604 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-3d491d75-5233-4bf9-b2c3-3c10d61c256f req-8bd0ee43-8fd0-46cd-9781-7b33ea2bc80d service nova] Creating event network-vif-plugged:f52d4558-50e5-4318-8403-6a9469b58639 for instance 9059a365-9c01-48cf-b320-3a762376705f on n-h2-850499-9 Aug 31 17:25:19.288929 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-3d491d75-5233-4bf9-b2c3-3c10d61c256f req-8bd0ee43-8fd0-46cd-9781-7b33ea2bc80d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038552 Aug 31 17:25:19.290272 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3975/7960] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:25:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:25:19.380659 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a221a6ca-bcca-4900-ba47-1ff0f80f3ad5 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:25:19.388682 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a221a6ca-bcca-4900-ba47-1ff0f80f3ad5 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/9059a365-9c01-48cf-b320-3a762376705f" status: 200 len: 1390 microversion: 2.1 time: 0.175274 Aug 31 17:25:19.389283 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3986/7961] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:25:19 2022] GET /compute/v2.1/servers/9059a365-9c01-48cf-b320-3a762376705f => generated 1390 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:25:20.407855 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=6 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:25:20.413331 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-3efaeb07-4764-4fc6-8c56-bd551b84351f tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:25:20.414045 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-3efaeb07-4764-4fc6-8c56-bd551b84351f tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 9059a365-9c01-48cf-b320-3a762376705f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:25:20.421845 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3efaeb07-4764-4fc6-8c56-bd551b84351f tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:25:20.422349 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3efaeb07-4764-4fc6-8c56-bd551b84351f tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:25:20.422800 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3efaeb07-4764-4fc6-8c56-bd551b84351f tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:25:20.423539 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3efaeb07-4764-4fc6-8c56-bd551b84351f tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:25:20.424009 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3efaeb07-4764-4fc6-8c56-bd551b84351f tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:25:20.424447 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-3efaeb07-4764-4fc6-8c56-bd551b84351f tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:25:20.565824 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-3efaeb07-4764-4fc6-8c56-bd551b84351f tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:25:20.573645 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-3efaeb07-4764-4fc6-8c56-bd551b84351f tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/9059a365-9c01-48cf-b320-3a762376705f" status: 200 len: 1390 microversion: 2.1 time: 0.166825 Aug 31 17:25:20.574217 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3976/7962] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:25:20 2022] GET /compute/v2.1/servers/9059a365-9c01-48cf-b320-3a762376705f => generated 1390 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:25:21.595416 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3ebbdfa8-4ba1-4370-8625-5effbb8fa8b9 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:25:21.596082 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3ebbdfa8-4ba1-4370-8625-5effbb8fa8b9 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 9059a365-9c01-48cf-b320-3a762376705f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:25:21.602994 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3ebbdfa8-4ba1-4370-8625-5effbb8fa8b9 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:25:21.603577 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3ebbdfa8-4ba1-4370-8625-5effbb8fa8b9 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:25:21.603995 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3ebbdfa8-4ba1-4370-8625-5effbb8fa8b9 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:25:21.604711 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3ebbdfa8-4ba1-4370-8625-5effbb8fa8b9 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:25:21.605192 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3ebbdfa8-4ba1-4370-8625-5effbb8fa8b9 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:25:21.605639 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3ebbdfa8-4ba1-4370-8625-5effbb8fa8b9 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:25:21.740556 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3ebbdfa8-4ba1-4370-8625-5effbb8fa8b9 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:25:21.749543 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3ebbdfa8-4ba1-4370-8625-5effbb8fa8b9 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/9059a365-9c01-48cf-b320-3a762376705f" status: 200 len: 1562 microversion: 2.1 time: 0.158776 Aug 31 17:25:21.750133 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3987/7963] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:25:21 2022] GET /compute/v2.1/servers/9059a365-9c01-48cf-b320-3a762376705f => generated 1562 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 17:25:21.770458 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7f6a15aa-cf33-488f-8c34-aa49757f825e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:25:21.771071 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7f6a15aa-cf33-488f-8c34-aa49757f825e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 9059a365-9c01-48cf-b320-3a762376705f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:25:21.778125 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7f6a15aa-cf33-488f-8c34-aa49757f825e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:25:21.778701 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7f6a15aa-cf33-488f-8c34-aa49757f825e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:25:21.779150 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7f6a15aa-cf33-488f-8c34-aa49757f825e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:25:21.779875 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7f6a15aa-cf33-488f-8c34-aa49757f825e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:25:21.780332 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7f6a15aa-cf33-488f-8c34-aa49757f825e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:25:21.780756 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7f6a15aa-cf33-488f-8c34-aa49757f825e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:25:21.922697 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7f6a15aa-cf33-488f-8c34-aa49757f825e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:25:21.930554 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7f6a15aa-cf33-488f-8c34-aa49757f825e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/9059a365-9c01-48cf-b320-3a762376705f" status: 200 len: 1562 microversion: 2.1 time: 0.163900 Aug 31 17:25:21.931132 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3977/7964] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:25:21 2022] GET /compute/v2.1/servers/9059a365-9c01-48cf-b320-3a762376705f => generated 1562 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:25:23.548969 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c4dc4dac-34d6-4a77-9719-eb827e254822 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:25:23.549617 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c4dc4dac-34d6-4a77-9719-eb827e254822 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 9059a365-9c01-48cf-b320-3a762376705f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:25:23.553506 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-fd836129-eb28-44ed-a670-6bfa5b437d2a req-25af38a7-4491-4167-9f45-8e2c8fcf474a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9059a365-9c01-48cf-b320-3a762376705f", "tag": "f52d4558-50e5-4318-8403-6a9469b58639"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:25:23.553938 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:25:23.557324 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c4dc4dac-34d6-4a77-9719-eb827e254822 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:25:23.557838 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c4dc4dac-34d6-4a77-9719-eb827e254822 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:25:23.558298 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c4dc4dac-34d6-4a77-9719-eb827e254822 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:25:23.559320 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c4dc4dac-34d6-4a77-9719-eb827e254822 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:25:23.560909 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c4dc4dac-34d6-4a77-9719-eb827e254822 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:25:23.561391 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c4dc4dac-34d6-4a77-9719-eb827e254822 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:25:23.563349 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:25:23.567724 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-fd836129-eb28-44ed-a670-6bfa5b437d2a req-25af38a7-4491-4167-9f45-8e2c8fcf474a service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:25:23.568530 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-fd836129-eb28-44ed-a670-6bfa5b437d2a req-25af38a7-4491-4167-9f45-8e2c8fcf474a service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:25:23.569061 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-fd836129-eb28-44ed-a670-6bfa5b437d2a req-25af38a7-4491-4167-9f45-8e2c8fcf474a service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:25:23.583193 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-fd836129-eb28-44ed-a670-6bfa5b437d2a req-25af38a7-4491-4167-9f45-8e2c8fcf474a service nova] Creating event network-changed:f52d4558-50e5-4318-8403-6a9469b58639 for instance 9059a365-9c01-48cf-b320-3a762376705f on n-h2-850499-9 Aug 31 17:25:23.590060 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-fd836129-eb28-44ed-a670-6bfa5b437d2a req-25af38a7-4491-4167-9f45-8e2c8fcf474a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041795 Aug 31 17:25:23.591476 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3978/7965] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:25:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:25:23.749952 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c4dc4dac-34d6-4a77-9719-eb827e254822 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:25:23.758903 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c4dc4dac-34d6-4a77-9719-eb827e254822 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/9059a365-9c01-48cf-b320-3a762376705f" status: 200 len: 1562 microversion: 2.1 time: 0.214284 Aug 31 17:25:23.759535 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3988/7966] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:25:23 2022] GET /compute/v2.1/servers/9059a365-9c01-48cf-b320-3a762376705f => generated 1562 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:26:03.074862 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=40 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:26:03.076537 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:26:03.132006 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-89b2e15d-7789-43ca-85b8-84d0fb37c833 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:26:03.134422 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-89b2e15d-7789-43ca-85b8-84d0fb37c833 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 9059a365-9c01-48cf-b320-3a762376705f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:26:03.141237 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-89b2e15d-7789-43ca-85b8-84d0fb37c833 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:26:03.141728 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-89b2e15d-7789-43ca-85b8-84d0fb37c833 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:26:03.142279 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-89b2e15d-7789-43ca-85b8-84d0fb37c833 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:26:03.142973 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-89b2e15d-7789-43ca-85b8-84d0fb37c833 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:26:03.143456 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-89b2e15d-7789-43ca-85b8-84d0fb37c833 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:26:03.144074 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-89b2e15d-7789-43ca-85b8-84d0fb37c833 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:26:03.224640 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-89b2e15d-7789-43ca-85b8-84d0fb37c833 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "POST /compute/v2.1/servers/9059a365-9c01-48cf-b320-3a762376705f/action" status: 200 len: 24562 microversion: 2.1 time: 0.155045 Aug 31 17:26:03.225285 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3979/7967] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 17:26:03 2022] POST /compute/v2.1/servers/9059a365-9c01-48cf-b320-3a762376705f/action => generated 24562 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 17:26:41.990033 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:26:41.990786 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=40 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:26:41.995835 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f632f1af-ac8b-4a1c-be8a-19b5bc084ae0 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:26:41.998126 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f632f1af-ac8b-4a1c-be8a-19b5bc084ae0 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 9059a365-9c01-48cf-b320-3a762376705f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:26:42.006235 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f632f1af-ac8b-4a1c-be8a-19b5bc084ae0 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:26:42.006744 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f632f1af-ac8b-4a1c-be8a-19b5bc084ae0 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:26:42.007198 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f632f1af-ac8b-4a1c-be8a-19b5bc084ae0 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:26:42.007948 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f632f1af-ac8b-4a1c-be8a-19b5bc084ae0 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:26:42.008417 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f632f1af-ac8b-4a1c-be8a-19b5bc084ae0 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:26:42.008857 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f632f1af-ac8b-4a1c-be8a-19b5bc084ae0 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:26:42.093175 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f632f1af-ac8b-4a1c-be8a-19b5bc084ae0 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:26:42.100919 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f632f1af-ac8b-4a1c-be8a-19b5bc084ae0 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 9059a365-9c01-48cf-b320-3a762376705f] Old instance type m1.heat2, new instance type m1.heat {{(pid=122257) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 31 17:26:42.108123 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-f632f1af-ac8b-4a1c-be8a-19b5bc084ae0 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 17:26:42.108569 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-f632f1af-ac8b-4a1c-be8a-19b5bc084ae0 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 17:26:42.109065 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-f632f1af-ac8b-4a1c-be8a-19b5bc084ae0 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 17:26:42.109501 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-f632f1af-ac8b-4a1c-be8a-19b5bc084ae0 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 17:26:42.109936 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-f632f1af-ac8b-4a1c-be8a-19b5bc084ae0 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 17:26:42.180982 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f632f1af-ac8b-4a1c-be8a-19b5bc084ae0 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "POST /compute/v2.1/servers/9059a365-9c01-48cf-b320-3a762376705f/action" status: 202 len: 0 microversion: 2.1 time: 0.192579 Aug 31 17:26:42.181624 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3989/7968] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 17:26:41 2022] POST /compute/v2.1/servers/9059a365-9c01-48cf-b320-3a762376705f/action => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 17:26:42.190726 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-bf4ccd57-5201-4868-9de5-c44d34fd59bb tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:26:42.191566 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-bf4ccd57-5201-4868-9de5-c44d34fd59bb tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 9059a365-9c01-48cf-b320-3a762376705f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:26:42.194302 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:26:42.195474 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=4 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:26:42.202456 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bf4ccd57-5201-4868-9de5-c44d34fd59bb tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:26:42.203049 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bf4ccd57-5201-4868-9de5-c44d34fd59bb tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:26:42.203615 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bf4ccd57-5201-4868-9de5-c44d34fd59bb tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:26:42.204484 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bf4ccd57-5201-4868-9de5-c44d34fd59bb tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:26:42.205170 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bf4ccd57-5201-4868-9de5-c44d34fd59bb tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:26:42.205713 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bf4ccd57-5201-4868-9de5-c44d34fd59bb tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:26:42.355893 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-bf4ccd57-5201-4868-9de5-c44d34fd59bb tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:26:42.364103 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-bf4ccd57-5201-4868-9de5-c44d34fd59bb tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/9059a365-9c01-48cf-b320-3a762376705f" status: 200 len: 1690 microversion: 2.1 time: 0.177789 Aug 31 17:26:42.364695 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3980/7969] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:26:42 2022] GET /compute/v2.1/servers/9059a365-9c01-48cf-b320-3a762376705f => generated 1690 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 17:26:43.386829 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6f97bb45-7b60-472f-860c-f4fa22fb6066 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:26:43.387595 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6f97bb45-7b60-472f-860c-f4fa22fb6066 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 9059a365-9c01-48cf-b320-3a762376705f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:26:43.395942 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6f97bb45-7b60-472f-860c-f4fa22fb6066 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:26:43.396459 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6f97bb45-7b60-472f-860c-f4fa22fb6066 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:26:43.396915 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6f97bb45-7b60-472f-860c-f4fa22fb6066 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:26:43.397640 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6f97bb45-7b60-472f-860c-f4fa22fb6066 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:26:43.398416 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6f97bb45-7b60-472f-860c-f4fa22fb6066 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:26:43.398866 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6f97bb45-7b60-472f-860c-f4fa22fb6066 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:26:43.537030 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-6f97bb45-7b60-472f-860c-f4fa22fb6066 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:26:43.544983 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6f97bb45-7b60-472f-860c-f4fa22fb6066 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/9059a365-9c01-48cf-b320-3a762376705f" status: 200 len: 1690 microversion: 2.1 time: 0.162297 Aug 31 17:26:43.545564 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3990/7970] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:26:43 2022] GET /compute/v2.1/servers/9059a365-9c01-48cf-b320-3a762376705f => generated 1690 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:26:44.566925 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-202eb62e-29e0-47de-bb6e-7590db5f1b1e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:26:44.567566 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-202eb62e-29e0-47de-bb6e-7590db5f1b1e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 9059a365-9c01-48cf-b320-3a762376705f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:26:44.574579 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-202eb62e-29e0-47de-bb6e-7590db5f1b1e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:26:44.575107 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-202eb62e-29e0-47de-bb6e-7590db5f1b1e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:26:44.575580 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-202eb62e-29e0-47de-bb6e-7590db5f1b1e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:26:44.576284 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-202eb62e-29e0-47de-bb6e-7590db5f1b1e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:26:44.576750 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-202eb62e-29e0-47de-bb6e-7590db5f1b1e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:26:44.577184 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-202eb62e-29e0-47de-bb6e-7590db5f1b1e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:26:44.711233 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-202eb62e-29e0-47de-bb6e-7590db5f1b1e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:26:44.719004 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-202eb62e-29e0-47de-bb6e-7590db5f1b1e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/9059a365-9c01-48cf-b320-3a762376705f" status: 200 len: 1695 microversion: 2.1 time: 0.156114 Aug 31 17:26:44.719598 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3981/7971] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:26:44 2022] GET /compute/v2.1/servers/9059a365-9c01-48cf-b320-3a762376705f => generated 1695 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:26:45.742071 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-06d7860c-e01b-4f8b-a032-c9c7eaf6ff45 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:26:45.742653 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-06d7860c-e01b-4f8b-a032-c9c7eaf6ff45 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 9059a365-9c01-48cf-b320-3a762376705f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:26:45.749622 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-06d7860c-e01b-4f8b-a032-c9c7eaf6ff45 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:26:45.750141 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-06d7860c-e01b-4f8b-a032-c9c7eaf6ff45 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:26:45.750601 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-06d7860c-e01b-4f8b-a032-c9c7eaf6ff45 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:26:45.751418 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-06d7860c-e01b-4f8b-a032-c9c7eaf6ff45 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:26:45.751937 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-06d7860c-e01b-4f8b-a032-c9c7eaf6ff45 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:26:45.752390 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-06d7860c-e01b-4f8b-a032-c9c7eaf6ff45 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:26:45.886973 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-06d7860c-e01b-4f8b-a032-c9c7eaf6ff45 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:26:45.894908 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-06d7860c-e01b-4f8b-a032-c9c7eaf6ff45 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/9059a365-9c01-48cf-b320-3a762376705f" status: 200 len: 1695 microversion: 2.1 time: 0.157172 Aug 31 17:26:45.895475 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3991/7972] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:26:45 2022] GET /compute/v2.1/servers/9059a365-9c01-48cf-b320-3a762376705f => generated 1695 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:26:46.917480 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-923de255-38b6-4127-a4ff-7174672b8677 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:26:46.918074 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-923de255-38b6-4127-a4ff-7174672b8677 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 9059a365-9c01-48cf-b320-3a762376705f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:26:46.926278 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-923de255-38b6-4127-a4ff-7174672b8677 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:26:46.926762 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-923de255-38b6-4127-a4ff-7174672b8677 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:26:46.927235 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-923de255-38b6-4127-a4ff-7174672b8677 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:26:46.927964 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-923de255-38b6-4127-a4ff-7174672b8677 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:26:46.928423 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-923de255-38b6-4127-a4ff-7174672b8677 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:26:46.928846 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-923de255-38b6-4127-a4ff-7174672b8677 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:26:47.059366 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-923de255-38b6-4127-a4ff-7174672b8677 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:26:47.067120 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-923de255-38b6-4127-a4ff-7174672b8677 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/9059a365-9c01-48cf-b320-3a762376705f" status: 200 len: 1695 microversion: 2.1 time: 0.153606 Aug 31 17:26:47.067724 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3982/7973] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:26:46 2022] GET /compute/v2.1/servers/9059a365-9c01-48cf-b320-3a762376705f => generated 1695 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:26:48.091881 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0b43a4a9-b011-4f32-8423-912d6847b8ce tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:26:48.092525 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0b43a4a9-b011-4f32-8423-912d6847b8ce tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 9059a365-9c01-48cf-b320-3a762376705f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:26:48.100300 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0b43a4a9-b011-4f32-8423-912d6847b8ce tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:26:48.100811 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0b43a4a9-b011-4f32-8423-912d6847b8ce tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:26:48.101274 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0b43a4a9-b011-4f32-8423-912d6847b8ce tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:26:48.102001 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0b43a4a9-b011-4f32-8423-912d6847b8ce tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:26:48.102481 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0b43a4a9-b011-4f32-8423-912d6847b8ce tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:26:48.102931 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0b43a4a9-b011-4f32-8423-912d6847b8ce tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:26:48.247989 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0b43a4a9-b011-4f32-8423-912d6847b8ce tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:26:48.257100 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0b43a4a9-b011-4f32-8423-912d6847b8ce tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/9059a365-9c01-48cf-b320-3a762376705f" status: 200 len: 1695 microversion: 2.1 time: 0.170537 Aug 31 17:26:48.258128 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3992/7974] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:26:48 2022] GET /compute/v2.1/servers/9059a365-9c01-48cf-b320-3a762376705f => generated 1695 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:26:49.279858 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-03284822-e825-447a-8cab-81b41af5ebac tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:26:49.280497 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-03284822-e825-447a-8cab-81b41af5ebac tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 9059a365-9c01-48cf-b320-3a762376705f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:26:49.287223 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-03284822-e825-447a-8cab-81b41af5ebac tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:26:49.287744 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-03284822-e825-447a-8cab-81b41af5ebac tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:26:49.288182 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-03284822-e825-447a-8cab-81b41af5ebac tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:26:49.288897 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-03284822-e825-447a-8cab-81b41af5ebac tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:26:49.289486 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-03284822-e825-447a-8cab-81b41af5ebac tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:26:49.289864 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-03284822-e825-447a-8cab-81b41af5ebac tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:26:49.424489 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-03284822-e825-447a-8cab-81b41af5ebac tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:26:49.432691 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-03284822-e825-447a-8cab-81b41af5ebac tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/9059a365-9c01-48cf-b320-3a762376705f" status: 200 len: 1695 microversion: 2.1 time: 0.156949 Aug 31 17:26:49.433272 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3983/7975] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:26:49 2022] GET /compute/v2.1/servers/9059a365-9c01-48cf-b320-3a762376705f => generated 1695 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:26:50.455412 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-59bbfb80-6312-44a4-93be-215056796abd tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:26:50.455862 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-59bbfb80-6312-44a4-93be-215056796abd tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 9059a365-9c01-48cf-b320-3a762376705f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:26:50.462188 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-59bbfb80-6312-44a4-93be-215056796abd tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:26:50.462693 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-59bbfb80-6312-44a4-93be-215056796abd tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:26:50.463146 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-59bbfb80-6312-44a4-93be-215056796abd tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:26:50.463957 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-59bbfb80-6312-44a4-93be-215056796abd tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:26:50.464430 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-59bbfb80-6312-44a4-93be-215056796abd tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:26:50.464873 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-59bbfb80-6312-44a4-93be-215056796abd tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:26:50.602482 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-59bbfb80-6312-44a4-93be-215056796abd tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:26:50.610868 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-59bbfb80-6312-44a4-93be-215056796abd tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/9059a365-9c01-48cf-b320-3a762376705f" status: 200 len: 1695 microversion: 2.1 time: 0.160486 Aug 31 17:26:50.611990 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3993/7976] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:26:50 2022] GET /compute/v2.1/servers/9059a365-9c01-48cf-b320-3a762376705f => generated 1695 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:26:51.632918 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2a31684d-e038-4c48-9d72-25494e2f96dc tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:26:51.633536 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2a31684d-e038-4c48-9d72-25494e2f96dc tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 9059a365-9c01-48cf-b320-3a762376705f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:26:51.640429 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2a31684d-e038-4c48-9d72-25494e2f96dc tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:26:51.640926 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2a31684d-e038-4c48-9d72-25494e2f96dc tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:26:51.641387 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2a31684d-e038-4c48-9d72-25494e2f96dc tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:26:51.642798 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2a31684d-e038-4c48-9d72-25494e2f96dc tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:26:51.643428 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2a31684d-e038-4c48-9d72-25494e2f96dc tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:26:51.643887 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2a31684d-e038-4c48-9d72-25494e2f96dc tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:26:51.786423 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-2a31684d-e038-4c48-9d72-25494e2f96dc tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:26:51.794332 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2a31684d-e038-4c48-9d72-25494e2f96dc tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/9059a365-9c01-48cf-b320-3a762376705f" status: 200 len: 1695 microversion: 2.1 time: 0.165332 Aug 31 17:26:51.794928 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3984/7977] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:26:51 2022] GET /compute/v2.1/servers/9059a365-9c01-48cf-b320-3a762376705f => generated 1695 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:26:52.820606 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-85fa68f9-8bca-4c55-80d4-e081db18b866 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:26:52.821229 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-85fa68f9-8bca-4c55-80d4-e081db18b866 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 9059a365-9c01-48cf-b320-3a762376705f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:26:52.828447 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-85fa68f9-8bca-4c55-80d4-e081db18b866 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:26:52.828950 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-85fa68f9-8bca-4c55-80d4-e081db18b866 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:26:52.829682 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-85fa68f9-8bca-4c55-80d4-e081db18b866 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:26:52.830455 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-85fa68f9-8bca-4c55-80d4-e081db18b866 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:26:52.830924 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-85fa68f9-8bca-4c55-80d4-e081db18b866 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:26:52.831366 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-85fa68f9-8bca-4c55-80d4-e081db18b866 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:26:52.965205 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-85fa68f9-8bca-4c55-80d4-e081db18b866 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:26:52.973821 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-85fa68f9-8bca-4c55-80d4-e081db18b866 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/9059a365-9c01-48cf-b320-3a762376705f" status: 200 len: 1695 microversion: 2.1 time: 0.157150 Aug 31 17:26:52.974399 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3994/7978] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:26:52 2022] GET /compute/v2.1/servers/9059a365-9c01-48cf-b320-3a762376705f => generated 1695 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:26:53.995951 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d31ba00a-5490-4d5a-b551-e52c7b621469 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:26:54.006244 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d31ba00a-5490-4d5a-b551-e52c7b621469 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 9059a365-9c01-48cf-b320-3a762376705f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:26:54.013154 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d31ba00a-5490-4d5a-b551-e52c7b621469 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:26:54.013660 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d31ba00a-5490-4d5a-b551-e52c7b621469 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:26:54.014104 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d31ba00a-5490-4d5a-b551-e52c7b621469 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:26:54.014817 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d31ba00a-5490-4d5a-b551-e52c7b621469 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:26:54.015277 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d31ba00a-5490-4d5a-b551-e52c7b621469 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:26:54.015814 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d31ba00a-5490-4d5a-b551-e52c7b621469 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:26:54.161465 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d31ba00a-5490-4d5a-b551-e52c7b621469 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:26:54.169591 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d31ba00a-5490-4d5a-b551-e52c7b621469 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/9059a365-9c01-48cf-b320-3a762376705f" status: 200 len: 1695 microversion: 2.1 time: 0.177900 Aug 31 17:26:54.170370 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3985/7979] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:26:53 2022] GET /compute/v2.1/servers/9059a365-9c01-48cf-b320-3a762376705f => generated 1695 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:26:55.192917 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c4beb465-1fb6-4bba-91db-787caba749c0 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:26:55.193498 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c4beb465-1fb6-4bba-91db-787caba749c0 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 9059a365-9c01-48cf-b320-3a762376705f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:26:55.200478 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c4beb465-1fb6-4bba-91db-787caba749c0 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:26:55.200989 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c4beb465-1fb6-4bba-91db-787caba749c0 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:26:55.201456 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c4beb465-1fb6-4bba-91db-787caba749c0 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:26:55.202171 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c4beb465-1fb6-4bba-91db-787caba749c0 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:26:55.202649 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c4beb465-1fb6-4bba-91db-787caba749c0 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:26:55.203100 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c4beb465-1fb6-4bba-91db-787caba749c0 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:26:55.336989 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c4beb465-1fb6-4bba-91db-787caba749c0 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:26:55.345039 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c4beb465-1fb6-4bba-91db-787caba749c0 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/9059a365-9c01-48cf-b320-3a762376705f" status: 200 len: 1695 microversion: 2.1 time: 0.156653 Aug 31 17:26:55.345630 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3995/7980] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:26:55 2022] GET /compute/v2.1/servers/9059a365-9c01-48cf-b320-3a762376705f => generated 1695 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 17:26:56.367916 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-26d88f45-3745-4ac4-a2cc-386ffad839e8 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:26:56.367916 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-26d88f45-3745-4ac4-a2cc-386ffad839e8 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 9059a365-9c01-48cf-b320-3a762376705f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:26:56.374909 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-26d88f45-3745-4ac4-a2cc-386ffad839e8 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:26:56.375132 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-26d88f45-3745-4ac4-a2cc-386ffad839e8 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:26:56.375709 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-26d88f45-3745-4ac4-a2cc-386ffad839e8 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:26:56.376645 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-26d88f45-3745-4ac4-a2cc-386ffad839e8 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:26:56.377279 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-26d88f45-3745-4ac4-a2cc-386ffad839e8 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:26:56.377798 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-26d88f45-3745-4ac4-a2cc-386ffad839e8 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:26:56.526847 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-26d88f45-3745-4ac4-a2cc-386ffad839e8 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:26:56.539340 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-26d88f45-3745-4ac4-a2cc-386ffad839e8 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/9059a365-9c01-48cf-b320-3a762376705f" status: 200 len: 1695 microversion: 2.1 time: 0.176067 Aug 31 17:26:56.539963 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3986/7981] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:26:56 2022] GET /compute/v2.1/servers/9059a365-9c01-48cf-b320-3a762376705f => generated 1695 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:26:57.009011 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-b446f69a-4f21-4873-aaec-99553247dddb req-7c3b66be-1402-4aab-8799-0be4d8d79cc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9059a365-9c01-48cf-b320-3a762376705f", "name": "network-vif-unplugged", "status": "completed", "tag": "f52d4558-50e5-4318-8403-6a9469b58639"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:26:57.020382 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-b446f69a-4f21-4873-aaec-99553247dddb req-7c3b66be-1402-4aab-8799-0be4d8d79cc1 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:26:57.020986 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-b446f69a-4f21-4873-aaec-99553247dddb req-7c3b66be-1402-4aab-8799-0be4d8d79cc1 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:26:57.021484 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-b446f69a-4f21-4873-aaec-99553247dddb req-7c3b66be-1402-4aab-8799-0be4d8d79cc1 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:26:57.034690 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-b446f69a-4f21-4873-aaec-99553247dddb req-7c3b66be-1402-4aab-8799-0be4d8d79cc1 service nova] Creating event network-vif-unplugged:f52d4558-50e5-4318-8403-6a9469b58639 for instance 9059a365-9c01-48cf-b320-3a762376705f on n-h1-850499-9 Aug 31 17:26:57.040269 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [req-b446f69a-4f21-4873-aaec-99553247dddb req-7c3b66be-1402-4aab-8799-0be4d8d79cc1 service nova] Instance 9059a365-9c01-48cf-b320-3a762376705f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850499-9', 'n-h2-850499-9'} {{(pid=122257) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 31 17:26:57.053728 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-b446f69a-4f21-4873-aaec-99553247dddb req-7c3b66be-1402-4aab-8799-0be4d8d79cc1 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048512 Aug 31 17:26:57.054441 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3996/7982] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:26:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 17:26:57.560900 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-40e15636-5ef5-482c-866e-44b195fc41ef tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:26:57.561552 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-40e15636-5ef5-482c-866e-44b195fc41ef tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 9059a365-9c01-48cf-b320-3a762376705f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:26:57.570464 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-40e15636-5ef5-482c-866e-44b195fc41ef tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:26:57.570966 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-40e15636-5ef5-482c-866e-44b195fc41ef tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:26:57.571414 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-40e15636-5ef5-482c-866e-44b195fc41ef tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:26:57.572158 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-40e15636-5ef5-482c-866e-44b195fc41ef tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:26:57.572624 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-40e15636-5ef5-482c-866e-44b195fc41ef tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:26:57.573060 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-40e15636-5ef5-482c-866e-44b195fc41ef tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:26:57.726367 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-40e15636-5ef5-482c-866e-44b195fc41ef tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:26:57.737309 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-40e15636-5ef5-482c-866e-44b195fc41ef tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/9059a365-9c01-48cf-b320-3a762376705f" status: 200 len: 1694 microversion: 2.1 time: 0.177312 Aug 31 17:26:57.737309 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3987/7983] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:26:57 2022] GET /compute/v2.1/servers/9059a365-9c01-48cf-b320-3a762376705f => generated 1694 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:26:58.759463 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6ab4a252-562d-4071-a5a2-e406f82ced77 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:26:58.760132 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6ab4a252-562d-4071-a5a2-e406f82ced77 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 9059a365-9c01-48cf-b320-3a762376705f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:26:58.766481 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6ab4a252-562d-4071-a5a2-e406f82ced77 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:26:58.767910 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6ab4a252-562d-4071-a5a2-e406f82ced77 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:26:58.768419 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6ab4a252-562d-4071-a5a2-e406f82ced77 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:26:58.769138 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6ab4a252-562d-4071-a5a2-e406f82ced77 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:26:58.769611 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6ab4a252-562d-4071-a5a2-e406f82ced77 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:26:58.770054 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6ab4a252-562d-4071-a5a2-e406f82ced77 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:26:58.922393 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-6ab4a252-562d-4071-a5a2-e406f82ced77 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:26:58.931481 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6ab4a252-562d-4071-a5a2-e406f82ced77 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/9059a365-9c01-48cf-b320-3a762376705f" status: 200 len: 1692 microversion: 2.1 time: 0.177438 Aug 31 17:26:58.932343 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3997/7984] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:26:58 2022] GET /compute/v2.1/servers/9059a365-9c01-48cf-b320-3a762376705f => generated 1692 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:26:59.091832 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-b49d2a08-22d2-483d-b0d0-c0be841c2054 req-653c4392-9c7c-471d-a8dd-b9be47649c8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9059a365-9c01-48cf-b320-3a762376705f", "tag": "f52d4558-50e5-4318-8403-6a9469b58639"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:26:59.102834 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-b49d2a08-22d2-483d-b0d0-c0be841c2054 req-653c4392-9c7c-471d-a8dd-b9be47649c8d service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:26:59.103316 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-b49d2a08-22d2-483d-b0d0-c0be841c2054 req-653c4392-9c7c-471d-a8dd-b9be47649c8d service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:26:59.103771 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-b49d2a08-22d2-483d-b0d0-c0be841c2054 req-653c4392-9c7c-471d-a8dd-b9be47649c8d service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:26:59.116618 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-b49d2a08-22d2-483d-b0d0-c0be841c2054 req-653c4392-9c7c-471d-a8dd-b9be47649c8d service nova] Creating event network-changed:f52d4558-50e5-4318-8403-6a9469b58639 for instance 9059a365-9c01-48cf-b320-3a762376705f on n-h1-850499-9 Aug 31 17:26:59.122280 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [req-b49d2a08-22d2-483d-b0d0-c0be841c2054 req-653c4392-9c7c-471d-a8dd-b9be47649c8d service nova] Instance 9059a365-9c01-48cf-b320-3a762376705f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850499-9', 'n-h2-850499-9'} {{(pid=122256) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 31 17:26:59.136861 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-b49d2a08-22d2-483d-b0d0-c0be841c2054 req-653c4392-9c7c-471d-a8dd-b9be47649c8d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048616 Aug 31 17:26:59.137486 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3988/7985] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:26:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 17:26:59.956851 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e3ef3477-04fb-46d2-8b52-889295d4dcdd tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:26:59.958306 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e3ef3477-04fb-46d2-8b52-889295d4dcdd tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 9059a365-9c01-48cf-b320-3a762376705f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:26:59.967003 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e3ef3477-04fb-46d2-8b52-889295d4dcdd tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:26:59.967558 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e3ef3477-04fb-46d2-8b52-889295d4dcdd tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:26:59.968175 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e3ef3477-04fb-46d2-8b52-889295d4dcdd tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:26:59.969495 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e3ef3477-04fb-46d2-8b52-889295d4dcdd tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:26:59.971150 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e3ef3477-04fb-46d2-8b52-889295d4dcdd tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:26:59.972033 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e3ef3477-04fb-46d2-8b52-889295d4dcdd tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:27:00.138209 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-e3ef3477-04fb-46d2-8b52-889295d4dcdd tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:27:00.146539 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e3ef3477-04fb-46d2-8b52-889295d4dcdd tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/9059a365-9c01-48cf-b320-3a762376705f" status: 200 len: 1692 microversion: 2.1 time: 0.195754 Aug 31 17:27:00.147134 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3998/7986] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:26:59 2022] GET /compute/v2.1/servers/9059a365-9c01-48cf-b320-3a762376705f => generated 1692 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:27:01.171696 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-416aa15d-0d89-4e71-b910-8d7fa48a940d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:27:01.172411 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-416aa15d-0d89-4e71-b910-8d7fa48a940d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 9059a365-9c01-48cf-b320-3a762376705f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:27:01.180315 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-416aa15d-0d89-4e71-b910-8d7fa48a940d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:27:01.180821 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-416aa15d-0d89-4e71-b910-8d7fa48a940d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:27:01.181268 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-416aa15d-0d89-4e71-b910-8d7fa48a940d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:27:01.181984 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-416aa15d-0d89-4e71-b910-8d7fa48a940d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:27:01.182450 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-416aa15d-0d89-4e71-b910-8d7fa48a940d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:27:01.183350 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-416aa15d-0d89-4e71-b910-8d7fa48a940d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:27:01.670369 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-416aa15d-0d89-4e71-b910-8d7fa48a940d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:27:01.679167 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-416aa15d-0d89-4e71-b910-8d7fa48a940d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/9059a365-9c01-48cf-b320-3a762376705f" status: 200 len: 1689 microversion: 2.1 time: 0.512654 Aug 31 17:27:01.679776 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3989/7987] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:27:01 2022] GET /compute/v2.1/servers/9059a365-9c01-48cf-b320-3a762376705f => generated 1689 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:27:01.700208 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-027935ec-c6a0-485d-b446-e5367598e65b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:27:01.700749 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-027935ec-c6a0-485d-b446-e5367598e65b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 9059a365-9c01-48cf-b320-3a762376705f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:27:01.708344 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-027935ec-c6a0-485d-b446-e5367598e65b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:27:01.708862 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-027935ec-c6a0-485d-b446-e5367598e65b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:27:01.709326 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-027935ec-c6a0-485d-b446-e5367598e65b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:27:01.710051 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-027935ec-c6a0-485d-b446-e5367598e65b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:27:01.710565 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-027935ec-c6a0-485d-b446-e5367598e65b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:27:01.711020 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-027935ec-c6a0-485d-b446-e5367598e65b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:27:01.773814 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-027935ec-c6a0-485d-b446-e5367598e65b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "POST /compute/v2.1/servers/9059a365-9c01-48cf-b320-3a762376705f/action" status: 204 len: 0 microversion: 2.1 time: 0.077124 Aug 31 17:27:01.774471 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 3999/7988] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 17:27:01 2022] POST /compute/v2.1/servers/9059a365-9c01-48cf-b320-3a762376705f/action => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 17:27:01.783733 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c955cf3d-0f92-4468-a703-3ddfd31f75b0 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:27:01.784368 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c955cf3d-0f92-4468-a703-3ddfd31f75b0 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 9059a365-9c01-48cf-b320-3a762376705f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:27:01.790345 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c955cf3d-0f92-4468-a703-3ddfd31f75b0 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:27:01.790846 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c955cf3d-0f92-4468-a703-3ddfd31f75b0 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:27:01.791428 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c955cf3d-0f92-4468-a703-3ddfd31f75b0 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:27:01.792344 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c955cf3d-0f92-4468-a703-3ddfd31f75b0 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:27:01.792906 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c955cf3d-0f92-4468-a703-3ddfd31f75b0 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:27:01.793429 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c955cf3d-0f92-4468-a703-3ddfd31f75b0 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:27:02.016597 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c955cf3d-0f92-4468-a703-3ddfd31f75b0 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:27:02.025067 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c955cf3d-0f92-4468-a703-3ddfd31f75b0 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/9059a365-9c01-48cf-b320-3a762376705f" status: 200 len: 1689 microversion: 2.1 time: 0.246301 Aug 31 17:27:02.025665 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3990/7989] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:27:01 2022] GET /compute/v2.1/servers/9059a365-9c01-48cf-b320-3a762376705f => generated 1689 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 17:27:02.046753 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-663dc35c-eea6-47f9-a9fe-5de2cc1b03d7 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:27:02.048176 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-663dc35c-eea6-47f9-a9fe-5de2cc1b03d7 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 9059a365-9c01-48cf-b320-3a762376705f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:27:02.054705 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-663dc35c-eea6-47f9-a9fe-5de2cc1b03d7 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:27:02.055210 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-663dc35c-eea6-47f9-a9fe-5de2cc1b03d7 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:27:02.055703 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-663dc35c-eea6-47f9-a9fe-5de2cc1b03d7 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:27:02.056456 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-663dc35c-eea6-47f9-a9fe-5de2cc1b03d7 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:27:02.056928 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-663dc35c-eea6-47f9-a9fe-5de2cc1b03d7 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:27:02.057371 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-663dc35c-eea6-47f9-a9fe-5de2cc1b03d7 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:27:02.275969 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-663dc35c-eea6-47f9-a9fe-5de2cc1b03d7 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:27:02.284597 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-663dc35c-eea6-47f9-a9fe-5de2cc1b03d7 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/9059a365-9c01-48cf-b320-3a762376705f" status: 200 len: 1689 microversion: 2.1 time: 0.242452 Aug 31 17:27:02.285192 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4000/7990] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:27:02 2022] GET /compute/v2.1/servers/9059a365-9c01-48cf-b320-3a762376705f => generated 1689 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:27:03.306552 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-244bc2bd-cc07-4de4-9473-2791e7f37524 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:27:03.307099 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-244bc2bd-cc07-4de4-9473-2791e7f37524 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 9059a365-9c01-48cf-b320-3a762376705f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:27:03.315123 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-244bc2bd-cc07-4de4-9473-2791e7f37524 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:27:03.315734 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-244bc2bd-cc07-4de4-9473-2791e7f37524 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:27:03.316200 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-244bc2bd-cc07-4de4-9473-2791e7f37524 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:27:03.317114 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-244bc2bd-cc07-4de4-9473-2791e7f37524 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:27:03.317586 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-244bc2bd-cc07-4de4-9473-2791e7f37524 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:27:03.318026 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-244bc2bd-cc07-4de4-9473-2791e7f37524 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:27:03.445661 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-e6dcc6ac-8e80-4f23-8b85-0620fec31246 req-2eb9ceaa-0112-45fa-951c-2b668c4c018c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9059a365-9c01-48cf-b320-3a762376705f", "name": "network-vif-plugged", "status": "completed", "tag": "f52d4558-50e5-4318-8403-6a9469b58639"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:27:03.458175 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-e6dcc6ac-8e80-4f23-8b85-0620fec31246 req-2eb9ceaa-0112-45fa-951c-2b668c4c018c service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:27:03.459251 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-e6dcc6ac-8e80-4f23-8b85-0620fec31246 req-2eb9ceaa-0112-45fa-951c-2b668c4c018c service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:27:03.460078 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-e6dcc6ac-8e80-4f23-8b85-0620fec31246 req-2eb9ceaa-0112-45fa-951c-2b668c4c018c service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:27:03.473547 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-e6dcc6ac-8e80-4f23-8b85-0620fec31246 req-2eb9ceaa-0112-45fa-951c-2b668c4c018c service nova] Creating event network-vif-plugged:f52d4558-50e5-4318-8403-6a9469b58639 for instance 9059a365-9c01-48cf-b320-3a762376705f on n-h1-850499-9 Aug 31 17:27:03.479070 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-e6dcc6ac-8e80-4f23-8b85-0620fec31246 req-2eb9ceaa-0112-45fa-951c-2b668c4c018c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037178 Aug 31 17:27:03.479873 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4001/7991] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:27:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 17:27:03.481396 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-244bc2bd-cc07-4de4-9473-2791e7f37524 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:27:03.489773 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-244bc2bd-cc07-4de4-9473-2791e7f37524 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/9059a365-9c01-48cf-b320-3a762376705f" status: 200 len: 1681 microversion: 2.1 time: 0.187181 Aug 31 17:27:03.490354 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3991/7992] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:27:03 2022] GET /compute/v2.1/servers/9059a365-9c01-48cf-b320-3a762376705f => generated 1681 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 17:27:35.711074 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=30 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:27:35.711898 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:27:35.716283 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-41fc567c-8617-43c6-8cef-f9c885e0032b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:27:35.718594 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-41fc567c-8617-43c6-8cef-f9c885e0032b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 9059a365-9c01-48cf-b320-3a762376705f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:27:35.725919 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-41fc567c-8617-43c6-8cef-f9c885e0032b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:27:35.726423 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-41fc567c-8617-43c6-8cef-f9c885e0032b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:27:35.726878 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-41fc567c-8617-43c6-8cef-f9c885e0032b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:27:35.727606 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-41fc567c-8617-43c6-8cef-f9c885e0032b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:27:35.728081 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-41fc567c-8617-43c6-8cef-f9c885e0032b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:27:35.728523 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-41fc567c-8617-43c6-8cef-f9c885e0032b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:27:35.799314 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-41fc567c-8617-43c6-8cef-f9c885e0032b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "POST /compute/v2.1/servers/9059a365-9c01-48cf-b320-3a762376705f/action" status: 200 len: 24571 microversion: 2.1 time: 0.090763 Aug 31 17:27:35.799972 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4002/7993] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 17:27:35 2022] POST /compute/v2.1/servers/9059a365-9c01-48cf-b320-3a762376705f/action => generated 24571 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 17:27:53.429950 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6bd3ad11-bc4e-492a-8f42-108554dfdc96 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:27:53.430513 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6bd3ad11-bc4e-492a-8f42-108554dfdc96 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 9059a365-9c01-48cf-b320-3a762376705f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:27:53.438517 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:27:53.439286 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=4 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:27:53.446955 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=24 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:27:53.447723 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=70 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:27:53.450917 n-d-850499-9 devstack@n-api.service[122256]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 17:27:53.450917 n-d-850499-9 devstack@n-api.service[122256]: Wed Aug 31 17:27:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9059a365-9c01-48cf-b320-3a762376705f (ip 10.222.0.61) !!! Aug 31 17:27:53.457481 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6bd3ad11-bc4e-492a-8f42-108554dfdc96 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:27:53.458998 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6bd3ad11-bc4e-492a-8f42-108554dfdc96 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:27:53.460186 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6bd3ad11-bc4e-492a-8f42-108554dfdc96 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:27:53.460953 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6bd3ad11-bc4e-492a-8f42-108554dfdc96 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:27:53.461609 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6bd3ad11-bc4e-492a-8f42-108554dfdc96 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:27:53.462054 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6bd3ad11-bc4e-492a-8f42-108554dfdc96 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:27:53.493452 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6bd3ad11-bc4e-492a-8f42-108554dfdc96 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 9059a365-9c01-48cf-b320-3a762376705f] Going to try to terminate instance {{(pid=122256) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 17:27:53.505332 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-db2f9260-6997-441d-b714-aabfd84f471f req-96565ed2-0def-4c13-b1e0-2a055a4f36c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9059a365-9c01-48cf-b320-3a762376705f", "tag": "f52d4558-50e5-4318-8403-6a9469b58639"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:27:53.518092 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-db2f9260-6997-441d-b714-aabfd84f471f req-96565ed2-0def-4c13-b1e0-2a055a4f36c5 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:27:53.518956 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-db2f9260-6997-441d-b714-aabfd84f471f req-96565ed2-0def-4c13-b1e0-2a055a4f36c5 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:27:53.519775 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-db2f9260-6997-441d-b714-aabfd84f471f req-96565ed2-0def-4c13-b1e0-2a055a4f36c5 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:27:53.532324 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-db2f9260-6997-441d-b714-aabfd84f471f req-96565ed2-0def-4c13-b1e0-2a055a4f36c5 service nova] Creating event network-changed:f52d4558-50e5-4318-8403-6a9469b58639 for instance 9059a365-9c01-48cf-b320-3a762376705f on n-h1-850499-9 Aug 31 17:27:53.538650 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-db2f9260-6997-441d-b714-aabfd84f471f req-96565ed2-0def-4c13-b1e0-2a055a4f36c5 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105380 Aug 31 17:27:53.539845 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4003/7994] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:27:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:27:53.588440 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6bd3ad11-bc4e-492a-8f42-108554dfdc96 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "DELETE /compute/v2.1/servers/9059a365-9c01-48cf-b320-3a762376705f" status: 204 len: 0 microversion: 2.1 time: 0.162008 Aug 31 17:27:53.589231 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3992/7995] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 17:27:53 2022] DELETE /compute/v2.1/servers/9059a365-9c01-48cf-b320-3a762376705f => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 17:27:53.600936 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-033cd9e5-d1b7-4e6d-95b6-adea71f957f6 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:27:53.602109 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-033cd9e5-d1b7-4e6d-95b6-adea71f957f6 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 9059a365-9c01-48cf-b320-3a762376705f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:27:53.612231 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-033cd9e5-d1b7-4e6d-95b6-adea71f957f6 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:27:53.612910 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-033cd9e5-d1b7-4e6d-95b6-adea71f957f6 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:27:53.613716 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-033cd9e5-d1b7-4e6d-95b6-adea71f957f6 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:27:53.614741 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-033cd9e5-d1b7-4e6d-95b6-adea71f957f6 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:27:53.615391 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-033cd9e5-d1b7-4e6d-95b6-adea71f957f6 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:27:53.615996 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-033cd9e5-d1b7-4e6d-95b6-adea71f957f6 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:27:53.769095 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-033cd9e5-d1b7-4e6d-95b6-adea71f957f6 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:27:53.779103 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-033cd9e5-d1b7-4e6d-95b6-adea71f957f6 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/9059a365-9c01-48cf-b320-3a762376705f" status: 200 len: 1687 microversion: 2.1 time: 0.184575 Aug 31 17:27:53.779754 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4004/7996] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:27:53 2022] GET /compute/v2.1/servers/9059a365-9c01-48cf-b320-3a762376705f => generated 1687 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:27:54.803361 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-19d400a5-3d95-4d85-a90a-11260b96d019 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:27:54.804124 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-19d400a5-3d95-4d85-a90a-11260b96d019 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 9059a365-9c01-48cf-b320-3a762376705f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:27:54.811234 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-19d400a5-3d95-4d85-a90a-11260b96d019 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:27:54.812043 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-19d400a5-3d95-4d85-a90a-11260b96d019 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:27:54.812499 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-19d400a5-3d95-4d85-a90a-11260b96d019 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:27:54.813355 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-19d400a5-3d95-4d85-a90a-11260b96d019 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:27:54.813827 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-19d400a5-3d95-4d85-a90a-11260b96d019 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:27:54.814267 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-19d400a5-3d95-4d85-a90a-11260b96d019 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:27:54.961931 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-19d400a5-3d95-4d85-a90a-11260b96d019 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:27:54.969983 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-19d400a5-3d95-4d85-a90a-11260b96d019 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/9059a365-9c01-48cf-b320-3a762376705f" status: 200 len: 1687 microversion: 2.1 time: 0.171556 Aug 31 17:27:54.970561 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3993/7997] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:27:54 2022] GET /compute/v2.1/servers/9059a365-9c01-48cf-b320-3a762376705f => generated 1687 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:27:55.661711 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-33b034b0-99cb-4be5-b979-990a7eb37c35 req-0c7f7276-b39f-4e00-aecc-5c6e06ac40e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9059a365-9c01-48cf-b320-3a762376705f", "name": "network-vif-deleted", "tag": "f52d4558-50e5-4318-8403-6a9469b58639"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:27:55.676937 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-33b034b0-99cb-4be5-b979-990a7eb37c35 req-0c7f7276-b39f-4e00-aecc-5c6e06ac40e4 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:27:55.677725 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-33b034b0-99cb-4be5-b979-990a7eb37c35 req-0c7f7276-b39f-4e00-aecc-5c6e06ac40e4 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:27:55.678290 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-33b034b0-99cb-4be5-b979-990a7eb37c35 req-0c7f7276-b39f-4e00-aecc-5c6e06ac40e4 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:27:55.693898 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-33b034b0-99cb-4be5-b979-990a7eb37c35 req-0c7f7276-b39f-4e00-aecc-5c6e06ac40e4 service nova] Creating event network-vif-deleted:f52d4558-50e5-4318-8403-6a9469b58639 for instance 9059a365-9c01-48cf-b320-3a762376705f on n-h1-850499-9 Aug 31 17:27:55.699455 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-33b034b0-99cb-4be5-b979-990a7eb37c35 req-0c7f7276-b39f-4e00-aecc-5c6e06ac40e4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042110 Aug 31 17:27:55.700121 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4005/7998] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:27:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:27:55.993018 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8bf5a16d-3d48-49ea-ae4e-4ee699c1bc5f tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:27:55.993778 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8bf5a16d-3d48-49ea-ae4e-4ee699c1bc5f tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 9059a365-9c01-48cf-b320-3a762376705f] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:27:56.001338 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8bf5a16d-3d48-49ea-ae4e-4ee699c1bc5f tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:27:56.001956 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8bf5a16d-3d48-49ea-ae4e-4ee699c1bc5f tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:27:56.002472 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8bf5a16d-3d48-49ea-ae4e-4ee699c1bc5f tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:27:56.003248 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8bf5a16d-3d48-49ea-ae4e-4ee699c1bc5f tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:27:56.003816 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8bf5a16d-3d48-49ea-ae4e-4ee699c1bc5f tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:27:56.004463 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8bf5a16d-3d48-49ea-ae4e-4ee699c1bc5f tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:27:56.038976 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8bf5a16d-3d48-49ea-ae4e-4ee699c1bc5f tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:27:56.039469 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8bf5a16d-3d48-49ea-ae4e-4ee699c1bc5f tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:27:56.039951 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8bf5a16d-3d48-49ea-ae4e-4ee699c1bc5f tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:27:56.040412 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-8bf5a16d-3d48-49ea-ae4e-4ee699c1bc5f tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lazy-loading 'fault' on Instance uuid 9059a365-9c01-48cf-b320-3a762376705f {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 17:27:56.088145 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8bf5a16d-3d48-49ea-ae4e-4ee699c1bc5f tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:27:56.095920 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8bf5a16d-3d48-49ea-ae4e-4ee699c1bc5f tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/9059a365-9c01-48cf-b320-3a762376705f" status: 200 len: 1355 microversion: 2.1 time: 0.107600 Aug 31 17:27:56.096498 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3994/7999] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:27:55 2022] GET /compute/v2.1/servers/9059a365-9c01-48cf-b320-3a762376705f => generated 1355 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:27:57.117969 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-73ceec4b-cf74-4673-b7d6-663d0a18d108 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:27:57.118685 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-73ceec4b-cf74-4673-b7d6-663d0a18d108 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 9059a365-9c01-48cf-b320-3a762376705f] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:27:57.125880 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-73ceec4b-cf74-4673-b7d6-663d0a18d108 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:27:57.126391 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-73ceec4b-cf74-4673-b7d6-663d0a18d108 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:27:57.126846 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-73ceec4b-cf74-4673-b7d6-663d0a18d108 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:27:57.127597 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-73ceec4b-cf74-4673-b7d6-663d0a18d108 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:27:57.128069 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-73ceec4b-cf74-4673-b7d6-663d0a18d108 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:27:57.128513 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-73ceec4b-cf74-4673-b7d6-663d0a18d108 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:27:57.142441 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-73ceec4b-cf74-4673-b7d6-663d0a18d108 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] HTTP exception thrown: Instance 9059a365-9c01-48cf-b320-3a762376705f could not be found. Aug 31 17:27:57.144159 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-73ceec4b-cf74-4673-b7d6-663d0a18d108 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Request method failure captured: Aug 31 17:27:57.144159 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/9059a365-9c01-48cf-b320-3a762376705f HTTP/1.1 Aug 31 17:27:57.144159 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 17:27:57.144159 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 17:27:57.144159 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 17:27:57.144159 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 17:27:57.144159 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 17:27:57.144159 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 17:27:57.144159 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 17:27:57.144159 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 17:27:57.144159 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD5hakwX2sXsbALOgVo9PPyLePH0fvR7L2xAV9ui8HTcLnBw3oZI1M7wF3mkEoqVA9fsecKEAxd9W333iMdsO8-IzHDYJUM0nEaJnVkZbE7IkWX3bqA3p9FNp7cLB3haZsSOX7PxhWli3RU37vvA4Rc8W5sIFHQE1dXFZWX5L9iGDZKs Aug 31 17:27:57.144159 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 17:27:57.144159 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 17:27:57.144159 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 17:27:57.144159 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 17:27:57.144159 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 17:27:57.144159 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 17:27:57.144159 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: dc47c533fa344b1caa1082a8caf19e36 Aug 31 17:27:57.144159 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-489466368 Aug 31 17:27:57.144159 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 17:27:57.144159 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 17:27:57.144159 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/dc47c533fa344b1caa1082a8caf19e36"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/dc47c533fa344b1caa1082a8caf19e36"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_dc47c533fa344b1caa1082a8caf19e36", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/dc47c533fa344b1caa1082a8caf19e36"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 17:27:57.144159 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-TestNetworkAdvancedServerOps-489466368 Aug 31 17:27:57.144159 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: dc47c533fa344b1caa1082a8caf19e36 Aug 31 17:27:57.144159 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-489466368 Aug 31 17:27:57.144159 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-TestNetworkAdvancedServerOps-489466368-project Aug 31 17:27:57.144159 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 17:27:57.144159 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 17:27:57.144159 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 684d0544424b41fe951feb12dae6b1c2 Aug 31 17:27:57.144159 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-TestNetworkAdvancedServerOps-489466368-project Aug 31 17:27:57.144159 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 17:27:57.144159 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance 9059a365-9c01-48cf-b320-3a762376705f could not be found. Aug 31 17:27:57.144159 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '9059a365-9c01-48cf-b320-3a762376705f'} Aug 31 17:27:57.144159 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 17:27:57.144159 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:27:57.144159 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 17:27:57.144159 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 17:27:57.144159 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 17:27:57.144159 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 17:27:57.144159 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 17:27:57.144159 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 17:27:57.144159 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 17:27:57.144159 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 17:27:57.144159 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9059a365-9c01-48cf-b320-3a762376705f could not be found. Aug 31 17:27:57.144159 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 17:27:57.144159 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:27:57.144159 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 17:27:57.144159 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:27:57.144159 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:27:57.144159 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:27:57.144159 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 17:27:57.144159 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 17:27:57.144159 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 17:27:57.144159 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 17:27:57.144159 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 17:27:57.144159 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 17:27:57.144159 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 17:27:57.144159 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 17:27:57.144159 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 17:27:57.144159 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 17:27:57.144159 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9059a365-9c01-48cf-b320-3a762376705f could not be found. Aug 31 17:27:57.144159 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 17:27:57.144159 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:27:57.150349 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 17:27:57.150349 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:27:57.150349 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:27:57.150349 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:27:57.150349 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 17:27:57.150349 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 17:27:57.150349 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9059a365-9c01-48cf-b320-3a762376705f could not be found. Aug 31 17:27:57.150349 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 17:27:57.150349 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-73ceec4b-cf74-4673-b7d6-663d0a18d108 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Returning 404 to user: Instance 9059a365-9c01-48cf-b320-3a762376705f could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 17:27:57.150349 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-73ceec4b-cf74-4673-b7d6-663d0a18d108 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/9059a365-9c01-48cf-b320-3a762376705f" status: 404 len: 111 microversion: 2.1 time: 0.032577 Aug 31 17:27:57.150349 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4006/8000] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:27:57 2022] GET /compute/v2.1/servers/9059a365-9c01-48cf-b320-3a762376705f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 17:28:00.497961 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d733bc02-12ff-4b8b-9f2c-37b5b0c92fdc tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '.version_select at 0x7f5ae829dc10>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:28:00.525454 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d733bc02-12ff-4b8b-9f2c-37b5b0c92fdc tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-10982857" status: 202 len: 0 microversion: 2.1 time: 0.031238 Aug 31 17:28:00.526040 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3995/8001] 10.222.0.61 () {58 vars in 1278 bytes} [Wed Aug 31 17:28:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-10982857 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 17:28:00.557951 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-43d636a4-9843-4ace-a2a9-002460248416 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Action: 'create', calling method: .version_select at 0x7f5ae84cd040>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1750360688", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCpFvtcyjQLynv+KGh69EmFFqXDLN404BMvMNt4q6UROz+MoC84q7vXNghjMzRxLKoTP9i9IV8Oj2T7PNdNxih0oK7vm7o2MUyA9ZYuzdfYAH9y/VuDYBWav2TTHIBzojQ=="}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:28:00.590397 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-43d636a4-9843-4ace-a2a9-002460248416 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Getting quotas for project dc47c533fa344b1caa1082a8caf19e36. Resources: {'key_pairs'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 17:28:00.596808 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-43d636a4-9843-4ace-a2a9-002460248416 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Getting quotas for user 684d0544424b41fe951feb12dae6b1c2 and project dc47c533fa344b1caa1082a8caf19e36. Resources: {'key_pairs'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 17:28:00.615772 n-d-850499-9 devstack@n-api.service[122257]: ERROR oslo.messaging._drivers.impl_rabbit [None req-43d636a4-9843-4ace-a2a9-002460248416 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [71efe5ec-3448-444a-b5c7-a9d033d02814] AMQP server on 10.222.0.61:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 31 17:28:01.623832 n-d-850499-9 devstack@n-api.service[122257]: INFO oslo.messaging._drivers.impl_rabbit [None req-43d636a4-9843-4ace-a2a9-002460248416 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [71efe5ec-3448-444a-b5c7-a9d033d02814] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 40138. Aug 31 17:28:01.638627 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-43d636a4-9843-4ace-a2a9-002460248416 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 1.085859 Aug 31 17:28:01.639230 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4007/8002] 10.222.0.61 () {60 vars in 1159 bytes} [Wed Aug 31 17:28:00 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:28:07.610412 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:28:07.616046 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f80b1bc5-702c-48ec-813f-fda043beb06d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1543132620", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "networks": [{"uuid": "92736e81-d29a-4267-89a2-bb382355e737"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1750360688", "security_groups": [{"name": "tempest-secgroup-smoke-1520887532"}]}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:28:07.775664 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-f80b1bc5-702c-48ec-813f-fda043beb06d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] validate_networks() for [('92736e81-d29a-4267-89a2-bb382355e737', None, None, None, None, None)] {{(pid=122256) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 17:28:08.246440 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-f80b1bc5-702c-48ec-813f-fda043beb06d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 17:28:08.246875 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-f80b1bc5-702c-48ec-813f-fda043beb06d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 17:28:08.247381 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-f80b1bc5-702c-48ec-813f-fda043beb06d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 17:28:08.247818 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-f80b1bc5-702c-48ec-813f-fda043beb06d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 17:28:08.248260 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-f80b1bc5-702c-48ec-813f-fda043beb06d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 17:28:08.257690 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f80b1bc5-702c-48ec-813f-fda043beb06d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:28:08.258183 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f80b1bc5-702c-48ec-813f-fda043beb06d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:28:08.258618 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f80b1bc5-702c-48ec-813f-fda043beb06d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:28:08.259380 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f80b1bc5-702c-48ec-813f-fda043beb06d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:28:08.259977 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f80b1bc5-702c-48ec-813f-fda043beb06d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:28:08.260412 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f80b1bc5-702c-48ec-813f-fda043beb06d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:28:08.282488 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-f80b1bc5-702c-48ec-813f-fda043beb06d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Getting quotas for project dc47c533fa344b1caa1082a8caf19e36. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 17:28:08.289410 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-f80b1bc5-702c-48ec-813f-fda043beb06d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Getting quotas for user 684d0544424b41fe951feb12dae6b1c2 and project dc47c533fa344b1caa1082a8caf19e36. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 17:28:08.302729 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f80b1bc5-702c-48ec-813f-fda043beb06d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Going to run 1 instances... {{(pid=122256) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 17:28:08.305192 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f80b1bc5-702c-48ec-813f-fda043beb06d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 417c16d2-470a-45a7-b693-3a379c5ac2a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 17:28:08.361867 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f80b1bc5-702c-48ec-813f-fda043beb06d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.753163 Aug 31 17:28:08.363691 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3996/8003] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 17:28:07 2022] POST /compute/v2.1/servers => generated 406 bytes in 756 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 17:28:08.372816 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=12 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:28:08.377365 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9e82752f-5a2e-4425-b299-29e5b544c19d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:28:08.378089 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9e82752f-5a2e-4425-b299-29e5b544c19d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 417c16d2-470a-45a7-b693-3a379c5ac2a3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:28:08.453964 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9e82752f-5a2e-4425-b299-29e5b544c19d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:28:08.462813 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9e82752f-5a2e-4425-b299-29e5b544c19d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/417c16d2-470a-45a7-b693-3a379c5ac2a3" status: 200 len: 1267 microversion: 2.1 time: 0.091502 Aug 31 17:28:08.468535 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4008/8004] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:28:08 2022] GET /compute/v2.1/servers/417c16d2-470a-45a7-b693-3a379c5ac2a3 => generated 1267 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:28:09.487131 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-149fea64-fab8-4bab-9462-53527211f10d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:28:09.489657 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-149fea64-fab8-4bab-9462-53527211f10d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 417c16d2-470a-45a7-b693-3a379c5ac2a3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:28:09.497127 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-149fea64-fab8-4bab-9462-53527211f10d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:28:09.497897 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-149fea64-fab8-4bab-9462-53527211f10d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:28:09.498799 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-149fea64-fab8-4bab-9462-53527211f10d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:28:09.499835 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-149fea64-fab8-4bab-9462-53527211f10d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:28:09.500460 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-149fea64-fab8-4bab-9462-53527211f10d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:28:09.501053 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-149fea64-fab8-4bab-9462-53527211f10d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:28:09.599687 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-149fea64-fab8-4bab-9462-53527211f10d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:28:09.613695 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-149fea64-fab8-4bab-9462-53527211f10d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/417c16d2-470a-45a7-b693-3a379c5ac2a3" status: 200 len: 1319 microversion: 2.1 time: 0.130498 Aug 31 17:28:09.615059 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3997/8005] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:28:09 2022] GET /compute/v2.1/servers/417c16d2-470a-45a7-b693-3a379c5ac2a3 => generated 1319 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:28:10.637825 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-fbd09db3-c186-4e34-a824-0c8ea3b3be00 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:28:10.638718 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-fbd09db3-c186-4e34-a824-0c8ea3b3be00 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 417c16d2-470a-45a7-b693-3a379c5ac2a3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:28:10.646425 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fbd09db3-c186-4e34-a824-0c8ea3b3be00 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:28:10.647029 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fbd09db3-c186-4e34-a824-0c8ea3b3be00 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:28:10.647678 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fbd09db3-c186-4e34-a824-0c8ea3b3be00 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:28:10.648429 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fbd09db3-c186-4e34-a824-0c8ea3b3be00 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:28:10.649003 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fbd09db3-c186-4e34-a824-0c8ea3b3be00 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:28:10.649778 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fbd09db3-c186-4e34-a824-0c8ea3b3be00 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:28:10.887445 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-fbd09db3-c186-4e34-a824-0c8ea3b3be00 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:28:10.895397 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-fbd09db3-c186-4e34-a824-0c8ea3b3be00 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/417c16d2-470a-45a7-b693-3a379c5ac2a3" status: 200 len: 1393 microversion: 2.1 time: 0.261735 Aug 31 17:28:10.896012 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4009/8006] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:28:10 2022] GET /compute/v2.1/servers/417c16d2-470a-45a7-b693-3a379c5ac2a3 => generated 1393 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:28:11.205602 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-3b6870c4-a257-4d3b-9cd6-48b512b9d78a req-04c1cb1e-53aa-4863-8d9f-951525799bcf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "417c16d2-470a-45a7-b693-3a379c5ac2a3", "tag": "9db506be-3c95-4173-9c73-79e8765092f6"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:28:11.232110 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-3b6870c4-a257-4d3b-9cd6-48b512b9d78a req-04c1cb1e-53aa-4863-8d9f-951525799bcf service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:28:11.233007 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-3b6870c4-a257-4d3b-9cd6-48b512b9d78a req-04c1cb1e-53aa-4863-8d9f-951525799bcf service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:28:11.233449 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-3b6870c4-a257-4d3b-9cd6-48b512b9d78a req-04c1cb1e-53aa-4863-8d9f-951525799bcf service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:28:11.247084 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-3b6870c4-a257-4d3b-9cd6-48b512b9d78a req-04c1cb1e-53aa-4863-8d9f-951525799bcf service nova] Creating event network-changed:9db506be-3c95-4173-9c73-79e8765092f6 for instance 417c16d2-470a-45a7-b693-3a379c5ac2a3 on n-h2-850499-9 Aug 31 17:28:11.252312 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-3b6870c4-a257-4d3b-9cd6-48b512b9d78a req-04c1cb1e-53aa-4863-8d9f-951525799bcf service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050384 Aug 31 17:28:11.253708 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3998/8007] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:28:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:28:11.918026 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0bed048a-71c1-4566-b95b-aa4f5a3b55d2 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:28:11.918655 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0bed048a-71c1-4566-b95b-aa4f5a3b55d2 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 417c16d2-470a-45a7-b693-3a379c5ac2a3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:28:11.925853 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0bed048a-71c1-4566-b95b-aa4f5a3b55d2 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:28:11.926946 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0bed048a-71c1-4566-b95b-aa4f5a3b55d2 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:28:11.927602 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0bed048a-71c1-4566-b95b-aa4f5a3b55d2 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:28:11.928312 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0bed048a-71c1-4566-b95b-aa4f5a3b55d2 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:28:11.928785 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0bed048a-71c1-4566-b95b-aa4f5a3b55d2 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:28:11.929231 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0bed048a-71c1-4566-b95b-aa4f5a3b55d2 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:28:12.073068 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0bed048a-71c1-4566-b95b-aa4f5a3b55d2 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:28:12.081149 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0bed048a-71c1-4566-b95b-aa4f5a3b55d2 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/417c16d2-470a-45a7-b693-3a379c5ac2a3" status: 200 len: 1393 microversion: 2.1 time: 0.167149 Aug 31 17:28:12.081724 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4010/8008] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:28:11 2022] GET /compute/v2.1/servers/417c16d2-470a-45a7-b693-3a379c5ac2a3 => generated 1393 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:28:13.105239 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5bcd4858-ea5b-48d9-b771-e1c5cec9f3ae tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:28:13.106101 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5bcd4858-ea5b-48d9-b771-e1c5cec9f3ae tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 417c16d2-470a-45a7-b693-3a379c5ac2a3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:28:13.113274 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5bcd4858-ea5b-48d9-b771-e1c5cec9f3ae tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:28:13.113961 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5bcd4858-ea5b-48d9-b771-e1c5cec9f3ae tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:28:13.114532 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5bcd4858-ea5b-48d9-b771-e1c5cec9f3ae tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:28:13.115095 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5bcd4858-ea5b-48d9-b771-e1c5cec9f3ae tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:28:13.115582 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5bcd4858-ea5b-48d9-b771-e1c5cec9f3ae tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:28:13.116020 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5bcd4858-ea5b-48d9-b771-e1c5cec9f3ae tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:28:13.261034 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5bcd4858-ea5b-48d9-b771-e1c5cec9f3ae tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:28:13.269109 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5bcd4858-ea5b-48d9-b771-e1c5cec9f3ae tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/417c16d2-470a-45a7-b693-3a379c5ac2a3" status: 200 len: 1393 microversion: 2.1 time: 0.168334 Aug 31 17:28:13.269757 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 3999/8009] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:28:13 2022] GET /compute/v2.1/servers/417c16d2-470a-45a7-b693-3a379c5ac2a3 => generated 1393 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:28:14.291181 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-16875913-5eed-4187-9073-4d856c72de00 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:28:14.291843 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-16875913-5eed-4187-9073-4d856c72de00 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 417c16d2-470a-45a7-b693-3a379c5ac2a3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:28:14.298906 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-16875913-5eed-4187-9073-4d856c72de00 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:28:14.299623 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-16875913-5eed-4187-9073-4d856c72de00 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:28:14.300078 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-16875913-5eed-4187-9073-4d856c72de00 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:28:14.301087 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-16875913-5eed-4187-9073-4d856c72de00 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:28:14.301567 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-16875913-5eed-4187-9073-4d856c72de00 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:28:14.302128 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-16875913-5eed-4187-9073-4d856c72de00 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:28:14.559317 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-16875913-5eed-4187-9073-4d856c72de00 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:28:14.568098 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-16875913-5eed-4187-9073-4d856c72de00 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/417c16d2-470a-45a7-b693-3a379c5ac2a3" status: 200 len: 1393 microversion: 2.1 time: 0.280156 Aug 31 17:28:14.568707 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4011/8010] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:28:14 2022] GET /compute/v2.1/servers/417c16d2-470a-45a7-b693-3a379c5ac2a3 => generated 1393 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:28:15.589935 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5f891b15-b6de-4baf-bb0e-33862dad3448 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:28:15.590721 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5f891b15-b6de-4baf-bb0e-33862dad3448 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 417c16d2-470a-45a7-b693-3a379c5ac2a3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:28:15.598325 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5f891b15-b6de-4baf-bb0e-33862dad3448 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:28:15.598768 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5f891b15-b6de-4baf-bb0e-33862dad3448 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:28:15.599236 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5f891b15-b6de-4baf-bb0e-33862dad3448 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:28:15.599979 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5f891b15-b6de-4baf-bb0e-33862dad3448 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:28:15.601250 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5f891b15-b6de-4baf-bb0e-33862dad3448 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:28:15.601926 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5f891b15-b6de-4baf-bb0e-33862dad3448 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:28:15.744304 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5f891b15-b6de-4baf-bb0e-33862dad3448 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:28:15.752035 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5f891b15-b6de-4baf-bb0e-33862dad3448 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/417c16d2-470a-45a7-b693-3a379c5ac2a3" status: 200 len: 1393 microversion: 2.1 time: 0.166045 Aug 31 17:28:15.752625 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4000/8011] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:28:15 2022] GET /compute/v2.1/servers/417c16d2-470a-45a7-b693-3a379c5ac2a3 => generated 1393 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:28:16.773378 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-faa7ceee-09ee-4ffe-ad7d-77ca08a1d779 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:28:16.774171 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-faa7ceee-09ee-4ffe-ad7d-77ca08a1d779 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 417c16d2-470a-45a7-b693-3a379c5ac2a3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:28:16.781392 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-faa7ceee-09ee-4ffe-ad7d-77ca08a1d779 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:28:16.781902 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-faa7ceee-09ee-4ffe-ad7d-77ca08a1d779 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:28:16.782355 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-faa7ceee-09ee-4ffe-ad7d-77ca08a1d779 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:28:16.783067 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-faa7ceee-09ee-4ffe-ad7d-77ca08a1d779 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:28:16.783759 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-faa7ceee-09ee-4ffe-ad7d-77ca08a1d779 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:28:16.784231 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-faa7ceee-09ee-4ffe-ad7d-77ca08a1d779 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:28:16.919209 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-faa7ceee-09ee-4ffe-ad7d-77ca08a1d779 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:28:16.927765 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-faa7ceee-09ee-4ffe-ad7d-77ca08a1d779 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/417c16d2-470a-45a7-b693-3a379c5ac2a3" status: 200 len: 1393 microversion: 2.1 time: 0.158423 Aug 31 17:28:16.928363 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4012/8012] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:28:16 2022] GET /compute/v2.1/servers/417c16d2-470a-45a7-b693-3a379c5ac2a3 => generated 1393 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:28:17.949268 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b8b60568-f127-4a9f-b7ac-466507bd0143 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:28:17.949946 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b8b60568-f127-4a9f-b7ac-466507bd0143 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 417c16d2-470a-45a7-b693-3a379c5ac2a3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:28:17.957244 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b8b60568-f127-4a9f-b7ac-466507bd0143 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:28:17.957774 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b8b60568-f127-4a9f-b7ac-466507bd0143 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:28:17.958218 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b8b60568-f127-4a9f-b7ac-466507bd0143 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:28:17.958936 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b8b60568-f127-4a9f-b7ac-466507bd0143 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:28:17.959398 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b8b60568-f127-4a9f-b7ac-466507bd0143 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:28:17.959888 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b8b60568-f127-4a9f-b7ac-466507bd0143 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:28:18.108399 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b8b60568-f127-4a9f-b7ac-466507bd0143 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:28:18.117856 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b8b60568-f127-4a9f-b7ac-466507bd0143 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/417c16d2-470a-45a7-b693-3a379c5ac2a3" status: 200 len: 1393 microversion: 2.1 time: 0.172214 Aug 31 17:28:18.118244 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4001/8013] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:28:17 2022] GET /compute/v2.1/servers/417c16d2-470a-45a7-b693-3a379c5ac2a3 => generated 1393 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:28:18.137626 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-938a7949-be29-45b1-b9c9-ff9a90abce41 req-de4d40d3-cf95-4fb3-b3e0-acc857a554b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "417c16d2-470a-45a7-b693-3a379c5ac2a3", "name": "network-vif-plugged", "status": "completed", "tag": "9db506be-3c95-4173-9c73-79e8765092f6"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:28:18.148066 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-938a7949-be29-45b1-b9c9-ff9a90abce41 req-de4d40d3-cf95-4fb3-b3e0-acc857a554b0 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:28:18.148495 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-938a7949-be29-45b1-b9c9-ff9a90abce41 req-de4d40d3-cf95-4fb3-b3e0-acc857a554b0 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:28:18.148943 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-938a7949-be29-45b1-b9c9-ff9a90abce41 req-de4d40d3-cf95-4fb3-b3e0-acc857a554b0 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:28:18.161167 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-938a7949-be29-45b1-b9c9-ff9a90abce41 req-de4d40d3-cf95-4fb3-b3e0-acc857a554b0 service nova] Creating event network-vif-plugged:9db506be-3c95-4173-9c73-79e8765092f6 for instance 417c16d2-470a-45a7-b693-3a379c5ac2a3 on n-h2-850499-9 Aug 31 17:28:18.166207 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-938a7949-be29-45b1-b9c9-ff9a90abce41 req-de4d40d3-cf95-4fb3-b3e0-acc857a554b0 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102137 Aug 31 17:28:18.166827 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4013/8014] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:28:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:28:19.141920 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-74d30472-49e9-4083-8aa1-b2b9c59c4d49 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:28:19.142544 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-74d30472-49e9-4083-8aa1-b2b9c59c4d49 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 417c16d2-470a-45a7-b693-3a379c5ac2a3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:28:19.144732 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:28:19.145406 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=6 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:28:19.152454 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-74d30472-49e9-4083-8aa1-b2b9c59c4d49 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:28:19.152962 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-74d30472-49e9-4083-8aa1-b2b9c59c4d49 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:28:19.153416 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-74d30472-49e9-4083-8aa1-b2b9c59c4d49 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:28:19.154141 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-74d30472-49e9-4083-8aa1-b2b9c59c4d49 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:28:19.154607 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-74d30472-49e9-4083-8aa1-b2b9c59c4d49 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:28:19.155044 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-74d30472-49e9-4083-8aa1-b2b9c59c4d49 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:28:19.300913 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-74d30472-49e9-4083-8aa1-b2b9c59c4d49 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:28:19.309670 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-74d30472-49e9-4083-8aa1-b2b9c59c4d49 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/417c16d2-470a-45a7-b693-3a379c5ac2a3" status: 200 len: 1393 microversion: 2.1 time: 0.172168 Aug 31 17:28:19.310259 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4002/8015] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:28:19 2022] GET /compute/v2.1/servers/417c16d2-470a-45a7-b693-3a379c5ac2a3 => generated 1393 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:28:20.328850 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=6 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:28:20.336545 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-df7400b7-333f-431f-8e15-1ec14d2faf7f tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:28:20.337281 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-df7400b7-333f-431f-8e15-1ec14d2faf7f tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 417c16d2-470a-45a7-b693-3a379c5ac2a3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:28:20.343991 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-df7400b7-333f-431f-8e15-1ec14d2faf7f tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:28:20.344504 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-df7400b7-333f-431f-8e15-1ec14d2faf7f tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:28:20.344964 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-df7400b7-333f-431f-8e15-1ec14d2faf7f tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:28:20.345690 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-df7400b7-333f-431f-8e15-1ec14d2faf7f tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:28:20.346165 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-df7400b7-333f-431f-8e15-1ec14d2faf7f tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:28:20.346613 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-df7400b7-333f-431f-8e15-1ec14d2faf7f tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:28:20.487737 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-df7400b7-333f-431f-8e15-1ec14d2faf7f tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:28:20.496390 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-df7400b7-333f-431f-8e15-1ec14d2faf7f tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/417c16d2-470a-45a7-b693-3a379c5ac2a3" status: 200 len: 1565 microversion: 2.1 time: 0.169193 Aug 31 17:28:20.496982 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4014/8016] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:28:20 2022] GET /compute/v2.1/servers/417c16d2-470a-45a7-b693-3a379c5ac2a3 => generated 1565 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:28:20.516544 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a23c78ee-99e9-4d93-a9f4-750bfdf02665 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:28:20.517206 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a23c78ee-99e9-4d93-a9f4-750bfdf02665 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 417c16d2-470a-45a7-b693-3a379c5ac2a3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:28:20.525058 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a23c78ee-99e9-4d93-a9f4-750bfdf02665 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:28:20.525599 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a23c78ee-99e9-4d93-a9f4-750bfdf02665 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:28:20.526043 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a23c78ee-99e9-4d93-a9f4-750bfdf02665 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:28:20.526779 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a23c78ee-99e9-4d93-a9f4-750bfdf02665 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:28:20.527237 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a23c78ee-99e9-4d93-a9f4-750bfdf02665 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:28:20.527701 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a23c78ee-99e9-4d93-a9f4-750bfdf02665 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:28:20.669761 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a23c78ee-99e9-4d93-a9f4-750bfdf02665 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:28:20.678396 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a23c78ee-99e9-4d93-a9f4-750bfdf02665 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/417c16d2-470a-45a7-b693-3a379c5ac2a3" status: 200 len: 1565 microversion: 2.1 time: 0.165040 Aug 31 17:28:20.678979 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4003/8017] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:28:20 2022] GET /compute/v2.1/servers/417c16d2-470a-45a7-b693-3a379c5ac2a3 => generated 1565 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:28:22.387933 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-af08867b-3bbc-469e-ba78-d3f1ed1cf889 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:28:22.388573 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-af08867b-3bbc-469e-ba78-d3f1ed1cf889 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 417c16d2-470a-45a7-b693-3a379c5ac2a3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:28:22.395879 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-58305d39-a51e-4d1f-a799-399939c588ac req-4d32aec4-6b8a-45dd-8bb0-5f38963be3c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "417c16d2-470a-45a7-b693-3a379c5ac2a3", "tag": "9db506be-3c95-4173-9c73-79e8765092f6"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:28:22.409075 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-af08867b-3bbc-469e-ba78-d3f1ed1cf889 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:28:22.409607 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-af08867b-3bbc-469e-ba78-d3f1ed1cf889 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:28:22.410062 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-af08867b-3bbc-469e-ba78-d3f1ed1cf889 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:28:22.410785 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-af08867b-3bbc-469e-ba78-d3f1ed1cf889 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:28:22.411086 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-58305d39-a51e-4d1f-a799-399939c588ac req-4d32aec4-6b8a-45dd-8bb0-5f38963be3c5 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:28:22.411257 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-af08867b-3bbc-469e-ba78-d3f1ed1cf889 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:28:22.411618 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-58305d39-a51e-4d1f-a799-399939c588ac req-4d32aec4-6b8a-45dd-8bb0-5f38963be3c5 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:28:22.411738 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-af08867b-3bbc-469e-ba78-d3f1ed1cf889 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:28:22.412286 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-58305d39-a51e-4d1f-a799-399939c588ac req-4d32aec4-6b8a-45dd-8bb0-5f38963be3c5 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:28:22.426540 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-58305d39-a51e-4d1f-a799-399939c588ac req-4d32aec4-6b8a-45dd-8bb0-5f38963be3c5 service nova] Creating event network-changed:9db506be-3c95-4173-9c73-79e8765092f6 for instance 417c16d2-470a-45a7-b693-3a379c5ac2a3 on n-h2-850499-9 Aug 31 17:28:22.432762 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-58305d39-a51e-4d1f-a799-399939c588ac req-4d32aec4-6b8a-45dd-8bb0-5f38963be3c5 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040518 Aug 31 17:28:22.433805 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4004/8018] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:28:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:28:23.010081 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-af08867b-3bbc-469e-ba78-d3f1ed1cf889 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:28:23.019272 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-af08867b-3bbc-469e-ba78-d3f1ed1cf889 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/417c16d2-470a-45a7-b693-3a379c5ac2a3" status: 200 len: 1565 microversion: 2.1 time: 0.635276 Aug 31 17:28:23.032107 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4015/8019] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:28:22 2022] GET /compute/v2.1/servers/417c16d2-470a-45a7-b693-3a379c5ac2a3 => generated 1565 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:28:58.323488 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:28:58.324281 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=42 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:28:58.328634 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-878cd03b-8112-4c28-8166-6c43a63bb7fe tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:28:58.330865 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-878cd03b-8112-4c28-8166-6c43a63bb7fe tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 417c16d2-470a-45a7-b693-3a379c5ac2a3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:28:58.338610 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-878cd03b-8112-4c28-8166-6c43a63bb7fe tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:28:58.339099 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-878cd03b-8112-4c28-8166-6c43a63bb7fe tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:28:58.339563 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-878cd03b-8112-4c28-8166-6c43a63bb7fe tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:28:58.340259 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-878cd03b-8112-4c28-8166-6c43a63bb7fe tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:28:58.340715 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-878cd03b-8112-4c28-8166-6c43a63bb7fe tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:28:58.341202 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-878cd03b-8112-4c28-8166-6c43a63bb7fe tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:28:58.410600 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-878cd03b-8112-4c28-8166-6c43a63bb7fe tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "POST /compute/v2.1/servers/417c16d2-470a-45a7-b693-3a379c5ac2a3/action" status: 200 len: 24569 microversion: 2.1 time: 0.089018 Aug 31 17:28:58.411258 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4005/8020] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 17:28:58 2022] POST /compute/v2.1/servers/417c16d2-470a-45a7-b693-3a379c5ac2a3/action => generated 24569 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 17:29:37.139182 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:29:37.140255 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=38 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:29:37.145720 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-596bc388-335c-485b-8c85-fe591e91ba4f tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:29:37.153553 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-596bc388-335c-485b-8c85-fe591e91ba4f tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:29:37.154062 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-596bc388-335c-485b-8c85-fe591e91ba4f tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:29:37.154519 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-596bc388-335c-485b-8c85-fe591e91ba4f tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:29:37.179296 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-596bc388-335c-485b-8c85-fe591e91ba4f tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 417c16d2-470a-45a7-b693-3a379c5ac2a3] Going to try to stop instance {{(pid=122257) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 31 17:29:37.226219 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-596bc388-335c-485b-8c85-fe591e91ba4f tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "POST /compute/v2.1/servers/417c16d2-470a-45a7-b693-3a379c5ac2a3/action" status: 202 len: 0 microversion: 2.1 time: 0.088366 Aug 31 17:29:37.226975 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4016/8021] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 17:29:37 2022] POST /compute/v2.1/servers/417c16d2-470a-45a7-b693-3a379c5ac2a3/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 17:29:37.236324 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-50259b88-37a0-4ce3-b0a3-6a2bc461af3b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:29:37.237028 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-50259b88-37a0-4ce3-b0a3-6a2bc461af3b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 417c16d2-470a-45a7-b693-3a379c5ac2a3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:29:37.239780 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:29:37.240452 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=4 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:29:37.247279 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-50259b88-37a0-4ce3-b0a3-6a2bc461af3b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:29:37.247809 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-50259b88-37a0-4ce3-b0a3-6a2bc461af3b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:29:37.248257 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-50259b88-37a0-4ce3-b0a3-6a2bc461af3b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:29:37.248978 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-50259b88-37a0-4ce3-b0a3-6a2bc461af3b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:29:37.249440 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-50259b88-37a0-4ce3-b0a3-6a2bc461af3b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:29:37.249992 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-50259b88-37a0-4ce3-b0a3-6a2bc461af3b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:29:37.397568 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-50259b88-37a0-4ce3-b0a3-6a2bc461af3b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:29:37.405860 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-50259b88-37a0-4ce3-b0a3-6a2bc461af3b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/417c16d2-470a-45a7-b693-3a379c5ac2a3" status: 200 len: 1694 microversion: 2.1 time: 0.173832 Aug 31 17:29:37.407102 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4006/8022] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:29:37 2022] GET /compute/v2.1/servers/417c16d2-470a-45a7-b693-3a379c5ac2a3 => generated 1694 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 17:29:38.431275 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3052a7fc-9d5c-472c-8c0f-df33bb1a6e1e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:29:38.432066 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3052a7fc-9d5c-472c-8c0f-df33bb1a6e1e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 417c16d2-470a-45a7-b693-3a379c5ac2a3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:29:38.438555 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3052a7fc-9d5c-472c-8c0f-df33bb1a6e1e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:29:38.439068 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3052a7fc-9d5c-472c-8c0f-df33bb1a6e1e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:29:38.439551 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3052a7fc-9d5c-472c-8c0f-df33bb1a6e1e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:29:38.440292 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3052a7fc-9d5c-472c-8c0f-df33bb1a6e1e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:29:38.440769 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3052a7fc-9d5c-472c-8c0f-df33bb1a6e1e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:29:38.441220 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3052a7fc-9d5c-472c-8c0f-df33bb1a6e1e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:29:38.583738 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3052a7fc-9d5c-472c-8c0f-df33bb1a6e1e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:29:38.591617 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3052a7fc-9d5c-472c-8c0f-df33bb1a6e1e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/417c16d2-470a-45a7-b693-3a379c5ac2a3" status: 200 len: 1694 microversion: 2.1 time: 0.165747 Aug 31 17:29:38.592200 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4017/8023] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:29:38 2022] GET /compute/v2.1/servers/417c16d2-470a-45a7-b693-3a379c5ac2a3 => generated 1694 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:29:39.614427 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c6528be0-f530-437f-9299-4466aa3a99c5 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:29:39.615066 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c6528be0-f530-437f-9299-4466aa3a99c5 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 417c16d2-470a-45a7-b693-3a379c5ac2a3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:29:39.621558 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c6528be0-f530-437f-9299-4466aa3a99c5 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:29:39.622048 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c6528be0-f530-437f-9299-4466aa3a99c5 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:29:39.622489 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c6528be0-f530-437f-9299-4466aa3a99c5 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:29:39.623189 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c6528be0-f530-437f-9299-4466aa3a99c5 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:29:39.623678 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c6528be0-f530-437f-9299-4466aa3a99c5 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:29:39.624113 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c6528be0-f530-437f-9299-4466aa3a99c5 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:29:39.758253 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c6528be0-f530-437f-9299-4466aa3a99c5 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:29:39.766250 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c6528be0-f530-437f-9299-4466aa3a99c5 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/417c16d2-470a-45a7-b693-3a379c5ac2a3" status: 200 len: 1694 microversion: 2.1 time: 0.155843 Aug 31 17:29:39.766832 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4007/8024] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:29:39 2022] GET /compute/v2.1/servers/417c16d2-470a-45a7-b693-3a379c5ac2a3 => generated 1694 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:29:40.788712 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-55bc2dc0-e667-4927-acd3-b968696c5a8f tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:29:40.789354 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-55bc2dc0-e667-4927-acd3-b968696c5a8f tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 417c16d2-470a-45a7-b693-3a379c5ac2a3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:29:40.796560 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-55bc2dc0-e667-4927-acd3-b968696c5a8f tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:29:40.797101 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-55bc2dc0-e667-4927-acd3-b968696c5a8f tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:29:40.797554 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-55bc2dc0-e667-4927-acd3-b968696c5a8f tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:29:40.798279 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-55bc2dc0-e667-4927-acd3-b968696c5a8f tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:29:40.798756 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-55bc2dc0-e667-4927-acd3-b968696c5a8f tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:29:40.799204 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-55bc2dc0-e667-4927-acd3-b968696c5a8f tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:29:40.947244 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-55bc2dc0-e667-4927-acd3-b968696c5a8f tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:29:40.955679 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-55bc2dc0-e667-4927-acd3-b968696c5a8f tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/417c16d2-470a-45a7-b693-3a379c5ac2a3" status: 200 len: 1694 microversion: 2.1 time: 0.171061 Aug 31 17:29:40.956261 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4018/8025] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:29:40 2022] GET /compute/v2.1/servers/417c16d2-470a-45a7-b693-3a379c5ac2a3 => generated 1694 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:29:41.979087 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-99db94da-64d3-4596-8a02-b728a41a57b6 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:29:41.979766 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-99db94da-64d3-4596-8a02-b728a41a57b6 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 417c16d2-470a-45a7-b693-3a379c5ac2a3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:29:41.986823 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-99db94da-64d3-4596-8a02-b728a41a57b6 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:29:41.987296 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-99db94da-64d3-4596-8a02-b728a41a57b6 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:29:41.987766 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-99db94da-64d3-4596-8a02-b728a41a57b6 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:29:41.988472 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-99db94da-64d3-4596-8a02-b728a41a57b6 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:29:41.988949 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-99db94da-64d3-4596-8a02-b728a41a57b6 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:29:41.989366 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-99db94da-64d3-4596-8a02-b728a41a57b6 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:29:42.124114 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-99db94da-64d3-4596-8a02-b728a41a57b6 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:29:42.132738 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-99db94da-64d3-4596-8a02-b728a41a57b6 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/417c16d2-470a-45a7-b693-3a379c5ac2a3" status: 200 len: 1694 microversion: 2.1 time: 0.157776 Aug 31 17:29:42.133336 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4008/8026] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:29:41 2022] GET /compute/v2.1/servers/417c16d2-470a-45a7-b693-3a379c5ac2a3 => generated 1694 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:29:43.157676 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ea71178e-d9bd-43dd-8869-b52997ff8a5d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:29:43.158339 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ea71178e-d9bd-43dd-8869-b52997ff8a5d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 417c16d2-470a-45a7-b693-3a379c5ac2a3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:29:43.165256 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ea71178e-d9bd-43dd-8869-b52997ff8a5d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:29:43.165762 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ea71178e-d9bd-43dd-8869-b52997ff8a5d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:29:43.166220 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ea71178e-d9bd-43dd-8869-b52997ff8a5d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:29:43.166937 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ea71178e-d9bd-43dd-8869-b52997ff8a5d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:29:43.167408 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ea71178e-d9bd-43dd-8869-b52997ff8a5d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:29:43.167877 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ea71178e-d9bd-43dd-8869-b52997ff8a5d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:29:43.311949 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ea71178e-d9bd-43dd-8869-b52997ff8a5d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:29:43.319854 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ea71178e-d9bd-43dd-8869-b52997ff8a5d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/417c16d2-470a-45a7-b693-3a379c5ac2a3" status: 200 len: 1694 microversion: 2.1 time: 0.166871 Aug 31 17:29:43.320432 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4019/8027] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:29:43 2022] GET /compute/v2.1/servers/417c16d2-470a-45a7-b693-3a379c5ac2a3 => generated 1694 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:29:44.340836 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6464dc42-007f-4c52-ac39-a8b27ebd4564 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:29:44.341427 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6464dc42-007f-4c52-ac39-a8b27ebd4564 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 417c16d2-470a-45a7-b693-3a379c5ac2a3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:29:44.349027 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6464dc42-007f-4c52-ac39-a8b27ebd4564 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:29:44.349513 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6464dc42-007f-4c52-ac39-a8b27ebd4564 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:29:44.349953 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6464dc42-007f-4c52-ac39-a8b27ebd4564 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:29:44.350643 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6464dc42-007f-4c52-ac39-a8b27ebd4564 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:29:44.351100 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6464dc42-007f-4c52-ac39-a8b27ebd4564 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:29:44.351559 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6464dc42-007f-4c52-ac39-a8b27ebd4564 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:29:44.492283 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-6464dc42-007f-4c52-ac39-a8b27ebd4564 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:29:44.500404 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6464dc42-007f-4c52-ac39-a8b27ebd4564 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/417c16d2-470a-45a7-b693-3a379c5ac2a3" status: 200 len: 1694 microversion: 2.1 time: 0.163423 Aug 31 17:29:44.500994 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4009/8028] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:29:44 2022] GET /compute/v2.1/servers/417c16d2-470a-45a7-b693-3a379c5ac2a3 => generated 1694 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:29:45.521674 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d2991a30-a5d0-4455-a031-5061af51495b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:29:45.522303 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d2991a30-a5d0-4455-a031-5061af51495b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 417c16d2-470a-45a7-b693-3a379c5ac2a3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:29:45.530133 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d2991a30-a5d0-4455-a031-5061af51495b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:29:45.530646 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d2991a30-a5d0-4455-a031-5061af51495b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:29:45.531250 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d2991a30-a5d0-4455-a031-5061af51495b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:29:45.532184 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d2991a30-a5d0-4455-a031-5061af51495b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:29:45.532582 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d2991a30-a5d0-4455-a031-5061af51495b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:29:45.533024 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d2991a30-a5d0-4455-a031-5061af51495b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:29:45.677191 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d2991a30-a5d0-4455-a031-5061af51495b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:29:45.685475 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d2991a30-a5d0-4455-a031-5061af51495b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/417c16d2-470a-45a7-b693-3a379c5ac2a3" status: 200 len: 1694 microversion: 2.1 time: 0.167618 Aug 31 17:29:45.686074 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4020/8029] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:29:45 2022] GET /compute/v2.1/servers/417c16d2-470a-45a7-b693-3a379c5ac2a3 => generated 1694 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:29:46.708434 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-bb8d6a99-00f7-40a7-9ee0-5662553c9f40 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:29:46.708952 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-bb8d6a99-00f7-40a7-9ee0-5662553c9f40 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 417c16d2-470a-45a7-b693-3a379c5ac2a3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:29:46.715792 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bb8d6a99-00f7-40a7-9ee0-5662553c9f40 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:29:46.716280 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bb8d6a99-00f7-40a7-9ee0-5662553c9f40 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:29:46.716718 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bb8d6a99-00f7-40a7-9ee0-5662553c9f40 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:29:46.717411 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bb8d6a99-00f7-40a7-9ee0-5662553c9f40 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:29:46.717868 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bb8d6a99-00f7-40a7-9ee0-5662553c9f40 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:29:46.718290 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bb8d6a99-00f7-40a7-9ee0-5662553c9f40 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:29:46.855715 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-bb8d6a99-00f7-40a7-9ee0-5662553c9f40 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:29:46.864574 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-bb8d6a99-00f7-40a7-9ee0-5662553c9f40 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/417c16d2-470a-45a7-b693-3a379c5ac2a3" status: 200 len: 1694 microversion: 2.1 time: 0.160739 Aug 31 17:29:46.865150 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4010/8030] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:29:46 2022] GET /compute/v2.1/servers/417c16d2-470a-45a7-b693-3a379c5ac2a3 => generated 1694 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:29:47.886330 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-fb681136-f392-440a-a047-9efa35d0a743 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:29:47.886961 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-fb681136-f392-440a-a047-9efa35d0a743 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 417c16d2-470a-45a7-b693-3a379c5ac2a3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:29:47.895015 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fb681136-f392-440a-a047-9efa35d0a743 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:29:47.895540 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fb681136-f392-440a-a047-9efa35d0a743 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:29:47.895998 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fb681136-f392-440a-a047-9efa35d0a743 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:29:47.896710 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fb681136-f392-440a-a047-9efa35d0a743 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:29:47.897187 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fb681136-f392-440a-a047-9efa35d0a743 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:29:47.897632 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fb681136-f392-440a-a047-9efa35d0a743 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:29:48.036728 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-fb681136-f392-440a-a047-9efa35d0a743 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:29:48.044548 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-fb681136-f392-440a-a047-9efa35d0a743 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/417c16d2-470a-45a7-b693-3a379c5ac2a3" status: 200 len: 1694 microversion: 2.1 time: 0.162186 Aug 31 17:29:48.045133 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4021/8031] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:29:47 2022] GET /compute/v2.1/servers/417c16d2-470a-45a7-b693-3a379c5ac2a3 => generated 1694 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:29:49.066048 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6882d3be-43c5-403e-8bcf-9d59031a486b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:29:49.066641 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6882d3be-43c5-403e-8bcf-9d59031a486b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 417c16d2-470a-45a7-b693-3a379c5ac2a3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:29:49.073893 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6882d3be-43c5-403e-8bcf-9d59031a486b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:29:49.074387 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6882d3be-43c5-403e-8bcf-9d59031a486b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:29:49.074830 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6882d3be-43c5-403e-8bcf-9d59031a486b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:29:49.075555 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6882d3be-43c5-403e-8bcf-9d59031a486b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:29:49.076017 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6882d3be-43c5-403e-8bcf-9d59031a486b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:29:49.076449 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6882d3be-43c5-403e-8bcf-9d59031a486b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:29:49.213971 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-6882d3be-43c5-403e-8bcf-9d59031a486b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:29:49.222930 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6882d3be-43c5-403e-8bcf-9d59031a486b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/417c16d2-470a-45a7-b693-3a379c5ac2a3" status: 200 len: 1694 microversion: 2.1 time: 0.161189 Aug 31 17:29:49.223523 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4011/8032] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:29:49 2022] GET /compute/v2.1/servers/417c16d2-470a-45a7-b693-3a379c5ac2a3 => generated 1694 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:29:50.244895 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-dfbeffad-63f3-4ce0-8449-3ece7c3904b9 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:29:50.245528 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-dfbeffad-63f3-4ce0-8449-3ece7c3904b9 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 417c16d2-470a-45a7-b693-3a379c5ac2a3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:29:50.251635 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dfbeffad-63f3-4ce0-8449-3ece7c3904b9 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:29:50.252145 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dfbeffad-63f3-4ce0-8449-3ece7c3904b9 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:29:50.252601 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dfbeffad-63f3-4ce0-8449-3ece7c3904b9 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:29:50.253318 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dfbeffad-63f3-4ce0-8449-3ece7c3904b9 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:29:50.253796 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dfbeffad-63f3-4ce0-8449-3ece7c3904b9 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:29:50.254242 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dfbeffad-63f3-4ce0-8449-3ece7c3904b9 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:29:50.387834 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-dfbeffad-63f3-4ce0-8449-3ece7c3904b9 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:29:50.396006 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-dfbeffad-63f3-4ce0-8449-3ece7c3904b9 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/417c16d2-470a-45a7-b693-3a379c5ac2a3" status: 200 len: 1694 microversion: 2.1 time: 0.155345 Aug 31 17:29:50.396600 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4022/8033] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:29:50 2022] GET /compute/v2.1/servers/417c16d2-470a-45a7-b693-3a379c5ac2a3 => generated 1694 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:29:51.418737 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7316223f-8c98-49cc-bd58-7a7def371f5e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:29:51.419279 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-7316223f-8c98-49cc-bd58-7a7def371f5e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 417c16d2-470a-45a7-b693-3a379c5ac2a3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:29:51.427092 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7316223f-8c98-49cc-bd58-7a7def371f5e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:29:51.427648 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7316223f-8c98-49cc-bd58-7a7def371f5e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:29:51.428122 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7316223f-8c98-49cc-bd58-7a7def371f5e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:29:51.428821 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7316223f-8c98-49cc-bd58-7a7def371f5e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:29:51.429308 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7316223f-8c98-49cc-bd58-7a7def371f5e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:29:51.429741 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-7316223f-8c98-49cc-bd58-7a7def371f5e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:29:51.568614 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-7316223f-8c98-49cc-bd58-7a7def371f5e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:29:51.576425 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7316223f-8c98-49cc-bd58-7a7def371f5e tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/417c16d2-470a-45a7-b693-3a379c5ac2a3" status: 200 len: 1694 microversion: 2.1 time: 0.161682 Aug 31 17:29:51.577009 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4012/8034] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:29:51 2022] GET /compute/v2.1/servers/417c16d2-470a-45a7-b693-3a379c5ac2a3 => generated 1694 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:29:52.596912 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-bfab88f3-9d28-4fe1-88ef-8f35276f5333 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:29:52.597584 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-bfab88f3-9d28-4fe1-88ef-8f35276f5333 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 417c16d2-470a-45a7-b693-3a379c5ac2a3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:29:52.604603 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bfab88f3-9d28-4fe1-88ef-8f35276f5333 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:29:52.605104 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bfab88f3-9d28-4fe1-88ef-8f35276f5333 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:29:52.605552 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bfab88f3-9d28-4fe1-88ef-8f35276f5333 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:29:52.606260 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bfab88f3-9d28-4fe1-88ef-8f35276f5333 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:29:52.606727 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bfab88f3-9d28-4fe1-88ef-8f35276f5333 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:29:52.607165 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bfab88f3-9d28-4fe1-88ef-8f35276f5333 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:29:52.742067 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-bfab88f3-9d28-4fe1-88ef-8f35276f5333 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:29:52.749878 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-bfab88f3-9d28-4fe1-88ef-8f35276f5333 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/417c16d2-470a-45a7-b693-3a379c5ac2a3" status: 200 len: 1694 microversion: 2.1 time: 0.157071 Aug 31 17:29:52.750455 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4023/8035] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:29:52 2022] GET /compute/v2.1/servers/417c16d2-470a-45a7-b693-3a379c5ac2a3 => generated 1694 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:29:53.773080 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a09b4672-f0c6-42cb-9bd0-9d0f7f2061a8 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:29:53.773700 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a09b4672-f0c6-42cb-9bd0-9d0f7f2061a8 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 417c16d2-470a-45a7-b693-3a379c5ac2a3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:29:53.780918 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a09b4672-f0c6-42cb-9bd0-9d0f7f2061a8 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:29:53.781411 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a09b4672-f0c6-42cb-9bd0-9d0f7f2061a8 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:29:53.781856 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a09b4672-f0c6-42cb-9bd0-9d0f7f2061a8 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:29:53.783388 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a09b4672-f0c6-42cb-9bd0-9d0f7f2061a8 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:29:53.783948 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a09b4672-f0c6-42cb-9bd0-9d0f7f2061a8 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:29:53.784461 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a09b4672-f0c6-42cb-9bd0-9d0f7f2061a8 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:29:53.916326 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a09b4672-f0c6-42cb-9bd0-9d0f7f2061a8 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:29:53.924208 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a09b4672-f0c6-42cb-9bd0-9d0f7f2061a8 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/417c16d2-470a-45a7-b693-3a379c5ac2a3" status: 200 len: 1671 microversion: 2.1 time: 0.155160 Aug 31 17:29:53.924979 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4013/8036] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:29:53 2022] GET /compute/v2.1/servers/417c16d2-470a-45a7-b693-3a379c5ac2a3 => generated 1671 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 17:29:55.021598 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-cffe30e7-2e11-4b0a-90c9-55e10fcf2aeb tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:29:55.023959 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-cffe30e7-2e11-4b0a-90c9-55e10fcf2aeb tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 417c16d2-470a-45a7-b693-3a379c5ac2a3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:29:55.031023 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cffe30e7-2e11-4b0a-90c9-55e10fcf2aeb tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:29:55.031557 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cffe30e7-2e11-4b0a-90c9-55e10fcf2aeb tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:29:55.032018 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cffe30e7-2e11-4b0a-90c9-55e10fcf2aeb tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:29:55.032737 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cffe30e7-2e11-4b0a-90c9-55e10fcf2aeb tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:29:55.033280 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cffe30e7-2e11-4b0a-90c9-55e10fcf2aeb tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:29:55.033708 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cffe30e7-2e11-4b0a-90c9-55e10fcf2aeb tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:29:55.095742 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-cffe30e7-2e11-4b0a-90c9-55e10fcf2aeb tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "POST /compute/v2.1/servers/417c16d2-470a-45a7-b693-3a379c5ac2a3/action" status: 200 len: 38202 microversion: 2.1 time: 0.078462 Aug 31 17:29:55.096328 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4024/8037] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 17:29:55 2022] POST /compute/v2.1/servers/417c16d2-470a-45a7-b693-3a379c5ac2a3/action => generated 38202 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 17:29:55.109026 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-490bafb5-2267-4589-b3cd-c0b6c170d4e8 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:29:55.116848 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-490bafb5-2267-4589-b3cd-c0b6c170d4e8 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:29:55.117349 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-490bafb5-2267-4589-b3cd-c0b6c170d4e8 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:29:55.117799 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-490bafb5-2267-4589-b3cd-c0b6c170d4e8 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:29:55.140667 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-490bafb5-2267-4589-b3cd-c0b6c170d4e8 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 417c16d2-470a-45a7-b693-3a379c5ac2a3] Going to try to start instance {{(pid=122256) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 31 17:29:55.184767 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-490bafb5-2267-4589-b3cd-c0b6c170d4e8 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "POST /compute/v2.1/servers/417c16d2-470a-45a7-b693-3a379c5ac2a3/action" status: 202 len: 0 microversion: 2.1 time: 0.079445 Aug 31 17:29:55.185716 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4014/8038] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 17:29:55 2022] POST /compute/v2.1/servers/417c16d2-470a-45a7-b693-3a379c5ac2a3/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 17:29:55.194674 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8d84258b-bc61-41a3-81e3-bac87d6ea670 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:29:55.195397 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8d84258b-bc61-41a3-81e3-bac87d6ea670 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 417c16d2-470a-45a7-b693-3a379c5ac2a3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:29:55.202843 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8d84258b-bc61-41a3-81e3-bac87d6ea670 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:29:55.203708 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8d84258b-bc61-41a3-81e3-bac87d6ea670 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:29:55.204189 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8d84258b-bc61-41a3-81e3-bac87d6ea670 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:29:55.204974 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8d84258b-bc61-41a3-81e3-bac87d6ea670 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:29:55.205628 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8d84258b-bc61-41a3-81e3-bac87d6ea670 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:29:55.206979 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8d84258b-bc61-41a3-81e3-bac87d6ea670 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:29:55.404101 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8d84258b-bc61-41a3-81e3-bac87d6ea670 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:29:55.412496 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8d84258b-bc61-41a3-81e3-bac87d6ea670 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/417c16d2-470a-45a7-b693-3a379c5ac2a3" status: 200 len: 1680 microversion: 2.1 time: 0.222100 Aug 31 17:29:55.413086 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4025/8039] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:29:55 2022] GET /compute/v2.1/servers/417c16d2-470a-45a7-b693-3a379c5ac2a3 => generated 1680 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:29:56.436498 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e934596e-1d03-4784-8344-8d2a93a4cf33 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:29:56.437323 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e934596e-1d03-4784-8344-8d2a93a4cf33 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 417c16d2-470a-45a7-b693-3a379c5ac2a3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:29:56.447047 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e934596e-1d03-4784-8344-8d2a93a4cf33 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:29:56.447635 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e934596e-1d03-4784-8344-8d2a93a4cf33 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:29:56.448089 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e934596e-1d03-4784-8344-8d2a93a4cf33 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:29:56.448816 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e934596e-1d03-4784-8344-8d2a93a4cf33 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:29:56.449284 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e934596e-1d03-4784-8344-8d2a93a4cf33 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:29:56.449721 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e934596e-1d03-4784-8344-8d2a93a4cf33 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:29:56.587582 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e934596e-1d03-4784-8344-8d2a93a4cf33 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:29:56.595371 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e934596e-1d03-4784-8344-8d2a93a4cf33 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/417c16d2-470a-45a7-b693-3a379c5ac2a3" status: 200 len: 1684 microversion: 2.1 time: 0.163558 Aug 31 17:29:56.596191 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4015/8040] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:29:56 2022] GET /compute/v2.1/servers/417c16d2-470a-45a7-b693-3a379c5ac2a3 => generated 1684 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:30:32.833688 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-11f5741d-7799-4603-9861-76ce3862ba35 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:30:32.836409 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-11f5741d-7799-4603-9861-76ce3862ba35 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 417c16d2-470a-45a7-b693-3a379c5ac2a3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:30:32.839483 n-d-850499-9 devstack@n-api.service[122257]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Aug 31 17:30:32.841749 n-d-850499-9 devstack@n-api.service[122257]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 17:30:32.842716 n-d-850499-9 devstack@n-api.service[122257]: Wed Aug 31 17:30:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/417c16d2-470a-45a7-b693-3a379c5ac2a3/action (ip 10.222.0.61) !!! Aug 31 17:30:32.843795 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=20 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:30:32.844539 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:30:32.854032 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-11f5741d-7799-4603-9861-76ce3862ba35 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:30:32.854602 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-11f5741d-7799-4603-9861-76ce3862ba35 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:30:32.855064 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-11f5741d-7799-4603-9861-76ce3862ba35 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:30:32.855815 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-11f5741d-7799-4603-9861-76ce3862ba35 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:30:32.856323 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-11f5741d-7799-4603-9861-76ce3862ba35 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:30:32.856772 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-11f5741d-7799-4603-9861-76ce3862ba35 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:30:32.937709 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-11f5741d-7799-4603-9861-76ce3862ba35 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "POST /compute/v2.1/servers/417c16d2-470a-45a7-b693-3a379c5ac2a3/action" status: 200 len: 62764 microversion: 2.1 time: 0.108072 Aug 31 17:30:32.938376 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4026/8041] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 17:30:32 2022] POST /compute/v2.1/servers/417c16d2-470a-45a7-b693-3a379c5ac2a3/action => generated 62764 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 17:30:56.484450 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=20 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:30:56.485391 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:30:56.489403 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6a2574ce-e0a8-4829-99e3-80a32b9123c2 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:30:56.489643 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-b5f7fc7c-7331-4acc-8857-7117c8fadf56 req-2d448eef-bb76-48fd-8744-a5f6cf6faf3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "417c16d2-470a-45a7-b693-3a379c5ac2a3", "tag": "9db506be-3c95-4173-9c73-79e8765092f6"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:30:56.490630 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6a2574ce-e0a8-4829-99e3-80a32b9123c2 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 417c16d2-470a-45a7-b693-3a379c5ac2a3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:30:56.497615 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:30:56.498605 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=4 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:30:56.498744 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6a2574ce-e0a8-4829-99e3-80a32b9123c2 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:30:56.499294 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6a2574ce-e0a8-4829-99e3-80a32b9123c2 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:30:56.499727 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6a2574ce-e0a8-4829-99e3-80a32b9123c2 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:30:56.500434 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6a2574ce-e0a8-4829-99e3-80a32b9123c2 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:30:56.500904 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6a2574ce-e0a8-4829-99e3-80a32b9123c2 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:30:56.501474 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6a2574ce-e0a8-4829-99e3-80a32b9123c2 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:30:56.505364 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-b5f7fc7c-7331-4acc-8857-7117c8fadf56 req-2d448eef-bb76-48fd-8744-a5f6cf6faf3d service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:30:56.506010 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-b5f7fc7c-7331-4acc-8857-7117c8fadf56 req-2d448eef-bb76-48fd-8744-a5f6cf6faf3d service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:30:56.506711 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-b5f7fc7c-7331-4acc-8857-7117c8fadf56 req-2d448eef-bb76-48fd-8744-a5f6cf6faf3d service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:30:56.521213 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-b5f7fc7c-7331-4acc-8857-7117c8fadf56 req-2d448eef-bb76-48fd-8744-a5f6cf6faf3d service nova] Creating event network-changed:9db506be-3c95-4173-9c73-79e8765092f6 for instance 417c16d2-470a-45a7-b693-3a379c5ac2a3 on n-h2-850499-9 Aug 31 17:30:56.527121 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-b5f7fc7c-7331-4acc-8857-7117c8fadf56 req-2d448eef-bb76-48fd-8744-a5f6cf6faf3d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042392 Aug 31 17:30:56.528412 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4027/8042] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:30:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 17:30:56.534227 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6a2574ce-e0a8-4829-99e3-80a32b9123c2 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 417c16d2-470a-45a7-b693-3a379c5ac2a3] Going to try to terminate instance {{(pid=122256) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 17:30:56.626429 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6a2574ce-e0a8-4829-99e3-80a32b9123c2 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "DELETE /compute/v2.1/servers/417c16d2-470a-45a7-b693-3a379c5ac2a3" status: 204 len: 0 microversion: 2.1 time: 0.143923 Aug 31 17:30:56.630335 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4016/8043] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 17:30:56 2022] DELETE /compute/v2.1/servers/417c16d2-470a-45a7-b693-3a379c5ac2a3 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 17:30:56.638328 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-04a1a7ee-3070-45fa-807e-00e6005ba62d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:30:56.639207 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-04a1a7ee-3070-45fa-807e-00e6005ba62d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 417c16d2-470a-45a7-b693-3a379c5ac2a3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:30:56.646230 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-04a1a7ee-3070-45fa-807e-00e6005ba62d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:30:56.646747 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-04a1a7ee-3070-45fa-807e-00e6005ba62d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:30:56.647208 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-04a1a7ee-3070-45fa-807e-00e6005ba62d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:30:56.647977 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-04a1a7ee-3070-45fa-807e-00e6005ba62d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:30:56.648443 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-04a1a7ee-3070-45fa-807e-00e6005ba62d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:30:56.648894 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-04a1a7ee-3070-45fa-807e-00e6005ba62d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:30:56.961983 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-04a1a7ee-3070-45fa-807e-00e6005ba62d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:30:56.970198 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-04a1a7ee-3070-45fa-807e-00e6005ba62d tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/417c16d2-470a-45a7-b693-3a379c5ac2a3" status: 200 len: 1690 microversion: 2.1 time: 0.337237 Aug 31 17:30:56.970775 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4028/8044] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:30:56 2022] GET /compute/v2.1/servers/417c16d2-470a-45a7-b693-3a379c5ac2a3 => generated 1690 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:30:57.992878 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-68bf54f1-7b2a-44ff-ab98-d60cfec376cd tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:30:57.993586 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-68bf54f1-7b2a-44ff-ab98-d60cfec376cd tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 417c16d2-470a-45a7-b693-3a379c5ac2a3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:30:58.001621 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-68bf54f1-7b2a-44ff-ab98-d60cfec376cd tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:30:58.002127 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-68bf54f1-7b2a-44ff-ab98-d60cfec376cd tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:30:58.002574 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-68bf54f1-7b2a-44ff-ab98-d60cfec376cd tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:30:58.003283 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-68bf54f1-7b2a-44ff-ab98-d60cfec376cd tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:30:58.003782 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-68bf54f1-7b2a-44ff-ab98-d60cfec376cd tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:30:58.004223 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-68bf54f1-7b2a-44ff-ab98-d60cfec376cd tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:30:58.261802 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-68bf54f1-7b2a-44ff-ab98-d60cfec376cd tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:30:58.269613 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-68bf54f1-7b2a-44ff-ab98-d60cfec376cd tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/417c16d2-470a-45a7-b693-3a379c5ac2a3" status: 200 len: 1690 microversion: 2.1 time: 0.280956 Aug 31 17:30:58.270194 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4017/8045] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:30:57 2022] GET /compute/v2.1/servers/417c16d2-470a-45a7-b693-3a379c5ac2a3 => generated 1690 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:30:58.979619 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-6061259c-12c9-4b79-9f5b-82586cc885a2 req-acee0889-5e0c-4c91-a403-b13d260b4052 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "417c16d2-470a-45a7-b693-3a379c5ac2a3", "name": "network-vif-deleted", "tag": "9db506be-3c95-4173-9c73-79e8765092f6"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:30:58.991834 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-6061259c-12c9-4b79-9f5b-82586cc885a2 req-acee0889-5e0c-4c91-a403-b13d260b4052 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:30:58.992341 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-6061259c-12c9-4b79-9f5b-82586cc885a2 req-acee0889-5e0c-4c91-a403-b13d260b4052 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:30:58.992794 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-6061259c-12c9-4b79-9f5b-82586cc885a2 req-acee0889-5e0c-4c91-a403-b13d260b4052 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:30:59.004528 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-6061259c-12c9-4b79-9f5b-82586cc885a2 req-acee0889-5e0c-4c91-a403-b13d260b4052 service nova] Creating event network-vif-deleted:9db506be-3c95-4173-9c73-79e8765092f6 for instance 417c16d2-470a-45a7-b693-3a379c5ac2a3 on n-h2-850499-9 Aug 31 17:30:59.010539 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-6061259c-12c9-4b79-9f5b-82586cc885a2 req-acee0889-5e0c-4c91-a403-b13d260b4052 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034741 Aug 31 17:30:59.011315 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4029/8046] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:30:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:30:59.292121 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-810ae5c1-20af-431b-a327-211e1688eeb7 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:30:59.292738 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-810ae5c1-20af-431b-a327-211e1688eeb7 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 417c16d2-470a-45a7-b693-3a379c5ac2a3] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:30:59.300078 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-810ae5c1-20af-431b-a327-211e1688eeb7 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:30:59.300584 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-810ae5c1-20af-431b-a327-211e1688eeb7 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:30:59.301034 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-810ae5c1-20af-431b-a327-211e1688eeb7 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:30:59.301761 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-810ae5c1-20af-431b-a327-211e1688eeb7 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:30:59.302226 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-810ae5c1-20af-431b-a327-211e1688eeb7 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:30:59.302661 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-810ae5c1-20af-431b-a327-211e1688eeb7 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:30:59.337566 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-810ae5c1-20af-431b-a327-211e1688eeb7 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:30:59.338099 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-810ae5c1-20af-431b-a327-211e1688eeb7 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:30:59.338698 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-810ae5c1-20af-431b-a327-211e1688eeb7 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:30:59.339346 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-810ae5c1-20af-431b-a327-211e1688eeb7 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lazy-loading 'fault' on Instance uuid 417c16d2-470a-45a7-b693-3a379c5ac2a3 {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 17:30:59.380790 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-810ae5c1-20af-431b-a327-211e1688eeb7 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:30:59.390799 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-810ae5c1-20af-431b-a327-211e1688eeb7 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/417c16d2-470a-45a7-b693-3a379c5ac2a3" status: 200 len: 1357 microversion: 2.1 time: 0.102491 Aug 31 17:30:59.391399 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4018/8047] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:30:59 2022] GET /compute/v2.1/servers/417c16d2-470a-45a7-b693-3a379c5ac2a3 => generated 1357 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:31:00.413787 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-bd47b1fc-2a93-4d46-83fd-4180c9d076ee tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:31:00.414512 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-bd47b1fc-2a93-4d46-83fd-4180c9d076ee tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 417c16d2-470a-45a7-b693-3a379c5ac2a3] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:31:00.421742 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bd47b1fc-2a93-4d46-83fd-4180c9d076ee tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:31:00.422247 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bd47b1fc-2a93-4d46-83fd-4180c9d076ee tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:31:00.422716 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bd47b1fc-2a93-4d46-83fd-4180c9d076ee tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:31:00.423434 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bd47b1fc-2a93-4d46-83fd-4180c9d076ee tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:31:00.423948 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bd47b1fc-2a93-4d46-83fd-4180c9d076ee tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:31:00.424399 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bd47b1fc-2a93-4d46-83fd-4180c9d076ee tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:31:00.439087 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-bd47b1fc-2a93-4d46-83fd-4180c9d076ee tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] HTTP exception thrown: Instance 417c16d2-470a-45a7-b693-3a379c5ac2a3 could not be found. Aug 31 17:31:00.440780 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-bd47b1fc-2a93-4d46-83fd-4180c9d076ee tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Request method failure captured: Aug 31 17:31:00.440780 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/417c16d2-470a-45a7-b693-3a379c5ac2a3 HTTP/1.1 Aug 31 17:31:00.440780 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 17:31:00.440780 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 17:31:00.440780 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 17:31:00.440780 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 17:31:00.440780 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 17:31:00.440780 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 17:31:00.440780 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 17:31:00.440780 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 17:31:00.440780 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD5hakwX2sXsbALOgVo9PPyLePH0fvR7L2xAV9ui8HTcLnBw3oZI1M7wF3mkEoqVA9fsecKEAxd9W333iMdsO8-IzHDYJUM0nEaJnVkZbE7IkWX3bqA3p9FNp7cLB3haZsSOX7PxhWli3RU37vvA4Rc8W5sIFHQE1dXFZWX5L9iGDZKs Aug 31 17:31:00.440780 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 17:31:00.440780 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 17:31:00.440780 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 17:31:00.440780 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 17:31:00.440780 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 17:31:00.440780 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 17:31:00.440780 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: dc47c533fa344b1caa1082a8caf19e36 Aug 31 17:31:00.440780 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-489466368 Aug 31 17:31:00.440780 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 17:31:00.440780 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 17:31:00.440780 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/dc47c533fa344b1caa1082a8caf19e36"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/dc47c533fa344b1caa1082a8caf19e36"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_dc47c533fa344b1caa1082a8caf19e36", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/dc47c533fa344b1caa1082a8caf19e36"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 17:31:00.440780 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-TestNetworkAdvancedServerOps-489466368 Aug 31 17:31:00.440780 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: dc47c533fa344b1caa1082a8caf19e36 Aug 31 17:31:00.440780 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-489466368 Aug 31 17:31:00.440780 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-TestNetworkAdvancedServerOps-489466368-project Aug 31 17:31:00.440780 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 17:31:00.440780 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 17:31:00.440780 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: 684d0544424b41fe951feb12dae6b1c2 Aug 31 17:31:00.440780 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-TestNetworkAdvancedServerOps-489466368-project Aug 31 17:31:00.440780 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 17:31:00.440780 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance 417c16d2-470a-45a7-b693-3a379c5ac2a3 could not be found. Aug 31 17:31:00.440780 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '417c16d2-470a-45a7-b693-3a379c5ac2a3'} Aug 31 17:31:00.440780 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 17:31:00.440780 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:31:00.440780 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 17:31:00.440780 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 17:31:00.440780 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 17:31:00.440780 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 17:31:00.440780 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 17:31:00.440780 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 17:31:00.440780 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 17:31:00.440780 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 17:31:00.440780 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 417c16d2-470a-45a7-b693-3a379c5ac2a3 could not be found. Aug 31 17:31:00.440780 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 17:31:00.440780 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:31:00.440780 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 17:31:00.440780 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:31:00.440780 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:31:00.440780 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:31:00.440780 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 17:31:00.440780 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 17:31:00.440780 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 17:31:00.440780 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 17:31:00.440780 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 17:31:00.440780 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 17:31:00.440780 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 17:31:00.440780 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 17:31:00.440780 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 17:31:00.440780 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 17:31:00.440780 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 417c16d2-470a-45a7-b693-3a379c5ac2a3 could not be found. Aug 31 17:31:00.440780 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 17:31:00.440780 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:31:00.446151 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 17:31:00.446151 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:31:00.446151 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:31:00.446151 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:31:00.446151 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 17:31:00.446151 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 17:31:00.446151 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 417c16d2-470a-45a7-b693-3a379c5ac2a3 could not be found. Aug 31 17:31:00.446151 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 17:31:00.446151 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-bd47b1fc-2a93-4d46-83fd-4180c9d076ee tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Returning 404 to user: Instance 417c16d2-470a-45a7-b693-3a379c5ac2a3 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 17:31:00.446151 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-bd47b1fc-2a93-4d46-83fd-4180c9d076ee tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/417c16d2-470a-45a7-b693-3a379c5ac2a3" status: 404 len: 111 microversion: 2.1 time: 0.033560 Aug 31 17:31:00.446151 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4030/8048] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:31:00 2022] GET /compute/v2.1/servers/417c16d2-470a-45a7-b693-3a379c5ac2a3 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 17:31:04.034075 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-710088c2-6e75-4b14-b2d3-3b336fe7cb1c tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '.version_select at 0x7f5ae855d9d0>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:31:04.038706 n-d-850499-9 devstack@n-api.service[122256]: ERROR oslo.messaging._drivers.impl_rabbit [None req-710088c2-6e75-4b14-b2d3-3b336fe7cb1c tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [1ec33fc2-e14a-42ed-8921-718494e3d541] AMQP server on 10.222.0.61:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 31 17:31:05.046519 n-d-850499-9 devstack@n-api.service[122256]: INFO oslo.messaging._drivers.impl_rabbit [None req-710088c2-6e75-4b14-b2d3-3b336fe7cb1c tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [1ec33fc2-e14a-42ed-8921-718494e3d541] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 40394. Aug 31 17:31:05.067378 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-710088c2-6e75-4b14-b2d3-3b336fe7cb1c tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1750360688" status: 202 len: 0 microversion: 2.1 time: 1.037164 Aug 31 17:31:05.067996 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4019/8049] 10.222.0.61 () {58 vars in 1284 bytes} [Wed Aug 31 17:31:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1750360688 => generated 0 bytes in 1039 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 17:31:05.103107 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-38876d6e-9fad-46cf-8aae-c3735a9271b0 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Action: 'create', calling method: .version_select at 0x7f5ae84cd700>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1211192928", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBOBSeQK+n9e7CcnOzNUYtCBY/ZScYY+HkhbP9OZTQbL7NKQeSCsegOA3lIS21I17gK11xEP17fBD0BVDKwO5kZdfy6D+fibGwDbuQqe6yoI+Xw+ukEJDCxDfZtDEoSEhw=="}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:31:05.120494 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-38876d6e-9fad-46cf-8aae-c3735a9271b0 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Getting quotas for project dc47c533fa344b1caa1082a8caf19e36. Resources: {'key_pairs'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 17:31:05.126504 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-38876d6e-9fad-46cf-8aae-c3735a9271b0 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Getting quotas for user 684d0544424b41fe951feb12dae6b1c2 and project dc47c533fa344b1caa1082a8caf19e36. Resources: {'key_pairs'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 17:31:05.155275 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-38876d6e-9fad-46cf-8aae-c3735a9271b0 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.056155 Aug 31 17:31:05.155921 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4031/8050] 10.222.0.61 () {60 vars in 1159 bytes} [Wed Aug 31 17:31:05 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:31:11.250722 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:31:11.257264 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-dd29f94d-5ea7-4028-b656-bb1e69a79226 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1211588417", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "networks": [{"uuid": "0eefed69-aa6e-476d-be9a-979b914dd2a5"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1211192928", "security_groups": [{"name": "tempest-secgroup-smoke-1871030458"}]}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:31:11.424624 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-dd29f94d-5ea7-4028-b656-bb1e69a79226 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] validate_networks() for [('0eefed69-aa6e-476d-be9a-979b914dd2a5', None, None, None, None, None)] {{(pid=122256) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 17:31:11.922308 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-dd29f94d-5ea7-4028-b656-bb1e69a79226 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 17:31:11.923035 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-dd29f94d-5ea7-4028-b656-bb1e69a79226 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 17:31:11.923787 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-dd29f94d-5ea7-4028-b656-bb1e69a79226 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 17:31:11.924274 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-dd29f94d-5ea7-4028-b656-bb1e69a79226 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 17:31:11.924800 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-dd29f94d-5ea7-4028-b656-bb1e69a79226 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 17:31:11.942517 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dd29f94d-5ea7-4028-b656-bb1e69a79226 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:31:11.943078 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dd29f94d-5ea7-4028-b656-bb1e69a79226 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:31:11.943589 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dd29f94d-5ea7-4028-b656-bb1e69a79226 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:31:11.944508 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dd29f94d-5ea7-4028-b656-bb1e69a79226 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:31:11.945137 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dd29f94d-5ea7-4028-b656-bb1e69a79226 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:31:11.945745 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dd29f94d-5ea7-4028-b656-bb1e69a79226 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:31:11.966735 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-dd29f94d-5ea7-4028-b656-bb1e69a79226 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Getting quotas for project dc47c533fa344b1caa1082a8caf19e36. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 17:31:11.972172 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-dd29f94d-5ea7-4028-b656-bb1e69a79226 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Getting quotas for user 684d0544424b41fe951feb12dae6b1c2 and project dc47c533fa344b1caa1082a8caf19e36. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 17:31:11.985028 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-dd29f94d-5ea7-4028-b656-bb1e69a79226 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Going to run 1 instances... {{(pid=122256) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 17:31:11.987343 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-dd29f94d-5ea7-4028-b656-bb1e69a79226 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 577b050d-93a3-4614-9018-4f936648d40b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 17:31:12.033784 n-d-850499-9 devstack@n-api.service[122256]: ERROR oslo.messaging._drivers.impl_rabbit [None req-dd29f94d-5ea7-4028-b656-bb1e69a79226 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [da407648-8e01-4692-9fea-e04810c81804] AMQP server on 10.222.0.61:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 31 17:31:13.043049 n-d-850499-9 devstack@n-api.service[122256]: INFO oslo.messaging._drivers.impl_rabbit [None req-dd29f94d-5ea7-4028-b656-bb1e69a79226 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [da407648-8e01-4692-9fea-e04810c81804] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 40442. Aug 31 17:31:13.047950 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-dd29f94d-5ea7-4028-b656-bb1e69a79226 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.798988 Aug 31 17:31:13.057009 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4020/8051] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 17:31:11 2022] POST /compute/v2.1/servers => generated 406 bytes in 1803 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 17:31:13.060338 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=12 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:31:13.076238 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-612e8588-71b7-4c40-9889-7839dda51470 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:31:13.076891 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-612e8588-71b7-4c40-9889-7839dda51470 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 577b050d-93a3-4614-9018-4f936648d40b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:31:13.139634 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-612e8588-71b7-4c40-9889-7839dda51470 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:31:13.148022 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-612e8588-71b7-4c40-9889-7839dda51470 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/577b050d-93a3-4614-9018-4f936648d40b" status: 200 len: 1267 microversion: 2.1 time: 0.089424 Aug 31 17:31:13.148626 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4032/8052] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:31:13 2022] GET /compute/v2.1/servers/577b050d-93a3-4614-9018-4f936648d40b => generated 1267 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:31:14.175330 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b5d97377-f5e3-478c-abb1-326dd0989982 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:31:14.175989 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b5d97377-f5e3-478c-abb1-326dd0989982 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 577b050d-93a3-4614-9018-4f936648d40b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:31:14.183180 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b5d97377-f5e3-478c-abb1-326dd0989982 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:31:14.183769 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b5d97377-f5e3-478c-abb1-326dd0989982 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:31:14.184237 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b5d97377-f5e3-478c-abb1-326dd0989982 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:31:14.185057 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b5d97377-f5e3-478c-abb1-326dd0989982 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:31:14.185523 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b5d97377-f5e3-478c-abb1-326dd0989982 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:31:14.185960 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b5d97377-f5e3-478c-abb1-326dd0989982 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:31:14.250391 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b5d97377-f5e3-478c-abb1-326dd0989982 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:31:14.258111 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b5d97377-f5e3-478c-abb1-326dd0989982 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/577b050d-93a3-4614-9018-4f936648d40b" status: 200 len: 1319 microversion: 2.1 time: 0.090830 Aug 31 17:31:14.258930 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4021/8053] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:31:14 2022] GET /compute/v2.1/servers/577b050d-93a3-4614-9018-4f936648d40b => generated 1319 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:31:15.280820 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-212cc9a2-bd38-4a13-84e5-de8728de7bb6 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:31:15.282064 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-212cc9a2-bd38-4a13-84e5-de8728de7bb6 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 577b050d-93a3-4614-9018-4f936648d40b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:31:15.289362 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-212cc9a2-bd38-4a13-84e5-de8728de7bb6 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:31:15.290145 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-212cc9a2-bd38-4a13-84e5-de8728de7bb6 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:31:15.290790 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-212cc9a2-bd38-4a13-84e5-de8728de7bb6 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:31:15.293474 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-212cc9a2-bd38-4a13-84e5-de8728de7bb6 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:31:15.294145 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-212cc9a2-bd38-4a13-84e5-de8728de7bb6 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:31:15.294800 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-212cc9a2-bd38-4a13-84e5-de8728de7bb6 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:31:15.545529 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-212cc9a2-bd38-4a13-84e5-de8728de7bb6 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:31:15.557730 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-212cc9a2-bd38-4a13-84e5-de8728de7bb6 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/577b050d-93a3-4614-9018-4f936648d40b" status: 200 len: 1393 microversion: 2.1 time: 0.280686 Aug 31 17:31:15.558406 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4033/8054] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:31:15 2022] GET /compute/v2.1/servers/577b050d-93a3-4614-9018-4f936648d40b => generated 1393 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:31:16.205061 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-b65d395a-66e7-464a-811a-700294fc0638 req-07651947-04aa-4d24-997a-a9068d6dc1c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "577b050d-93a3-4614-9018-4f936648d40b", "tag": "2a33e5c3-35bf-48d2-b92e-5b434cd96ecb"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:31:16.216358 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-b65d395a-66e7-464a-811a-700294fc0638 req-07651947-04aa-4d24-997a-a9068d6dc1c0 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:31:16.216857 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-b65d395a-66e7-464a-811a-700294fc0638 req-07651947-04aa-4d24-997a-a9068d6dc1c0 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:31:16.217296 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-b65d395a-66e7-464a-811a-700294fc0638 req-07651947-04aa-4d24-997a-a9068d6dc1c0 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:31:16.230329 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-b65d395a-66e7-464a-811a-700294fc0638 req-07651947-04aa-4d24-997a-a9068d6dc1c0 service nova] Creating event network-changed:2a33e5c3-35bf-48d2-b92e-5b434cd96ecb for instance 577b050d-93a3-4614-9018-4f936648d40b on n-h1-850499-9 Aug 31 17:31:16.235386 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-b65d395a-66e7-464a-811a-700294fc0638 req-07651947-04aa-4d24-997a-a9068d6dc1c0 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120815 Aug 31 17:31:16.236062 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4022/8055] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:31:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:31:16.579557 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-eefc7ed1-2f2e-4861-8fb3-12a067d499b6 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:31:16.580195 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-eefc7ed1-2f2e-4861-8fb3-12a067d499b6 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 577b050d-93a3-4614-9018-4f936648d40b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:31:16.587396 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eefc7ed1-2f2e-4861-8fb3-12a067d499b6 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:31:16.587984 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eefc7ed1-2f2e-4861-8fb3-12a067d499b6 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:31:16.588444 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eefc7ed1-2f2e-4861-8fb3-12a067d499b6 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:31:16.589172 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eefc7ed1-2f2e-4861-8fb3-12a067d499b6 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:31:16.589654 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eefc7ed1-2f2e-4861-8fb3-12a067d499b6 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:31:16.590099 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eefc7ed1-2f2e-4861-8fb3-12a067d499b6 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:31:16.743934 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-eefc7ed1-2f2e-4861-8fb3-12a067d499b6 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:31:16.753287 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-eefc7ed1-2f2e-4861-8fb3-12a067d499b6 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/577b050d-93a3-4614-9018-4f936648d40b" status: 200 len: 1393 microversion: 2.1 time: 0.177638 Aug 31 17:31:16.753888 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4034/8056] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:31:16 2022] GET /compute/v2.1/servers/577b050d-93a3-4614-9018-4f936648d40b => generated 1393 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 17:31:17.777407 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c546cf18-0d0d-4a6e-af03-14926356887b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:31:17.778114 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c546cf18-0d0d-4a6e-af03-14926356887b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 577b050d-93a3-4614-9018-4f936648d40b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:31:17.785167 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c546cf18-0d0d-4a6e-af03-14926356887b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:31:17.785674 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c546cf18-0d0d-4a6e-af03-14926356887b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:31:17.786109 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c546cf18-0d0d-4a6e-af03-14926356887b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:31:17.786818 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c546cf18-0d0d-4a6e-af03-14926356887b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:31:17.787278 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c546cf18-0d0d-4a6e-af03-14926356887b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:31:17.787745 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c546cf18-0d0d-4a6e-af03-14926356887b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:31:17.945337 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c546cf18-0d0d-4a6e-af03-14926356887b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:31:17.954806 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c546cf18-0d0d-4a6e-af03-14926356887b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/577b050d-93a3-4614-9018-4f936648d40b" status: 200 len: 1393 microversion: 2.1 time: 0.184114 Aug 31 17:31:17.955413 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4023/8057] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:31:17 2022] GET /compute/v2.1/servers/577b050d-93a3-4614-9018-4f936648d40b => generated 1393 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:31:18.977321 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d7d0c032-7ed7-4de8-86d1-7ae967403713 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:31:18.977975 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d7d0c032-7ed7-4de8-86d1-7ae967403713 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 577b050d-93a3-4614-9018-4f936648d40b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:31:18.985180 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d7d0c032-7ed7-4de8-86d1-7ae967403713 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:31:18.985698 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d7d0c032-7ed7-4de8-86d1-7ae967403713 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:31:18.986159 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d7d0c032-7ed7-4de8-86d1-7ae967403713 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:31:18.986887 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d7d0c032-7ed7-4de8-86d1-7ae967403713 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:31:18.987364 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d7d0c032-7ed7-4de8-86d1-7ae967403713 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:31:18.987843 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d7d0c032-7ed7-4de8-86d1-7ae967403713 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:31:19.233982 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d7d0c032-7ed7-4de8-86d1-7ae967403713 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:31:19.241652 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d7d0c032-7ed7-4de8-86d1-7ae967403713 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/577b050d-93a3-4614-9018-4f936648d40b" status: 200 len: 1393 microversion: 2.1 time: 0.268421 Aug 31 17:31:19.242338 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4035/8058] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:31:18 2022] GET /compute/v2.1/servers/577b050d-93a3-4614-9018-4f936648d40b => generated 1393 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:31:20.265804 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c387a67c-86c5-4f94-9ddf-21fef54b7350 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:31:20.266449 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c387a67c-86c5-4f94-9ddf-21fef54b7350 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 577b050d-93a3-4614-9018-4f936648d40b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:31:20.273189 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c387a67c-86c5-4f94-9ddf-21fef54b7350 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:31:20.273677 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c387a67c-86c5-4f94-9ddf-21fef54b7350 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:31:20.274110 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c387a67c-86c5-4f94-9ddf-21fef54b7350 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:31:20.274803 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c387a67c-86c5-4f94-9ddf-21fef54b7350 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:31:20.275337 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c387a67c-86c5-4f94-9ddf-21fef54b7350 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:31:20.275796 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c387a67c-86c5-4f94-9ddf-21fef54b7350 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:31:20.425469 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c387a67c-86c5-4f94-9ddf-21fef54b7350 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:31:20.434919 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c387a67c-86c5-4f94-9ddf-21fef54b7350 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/577b050d-93a3-4614-9018-4f936648d40b" status: 200 len: 1393 microversion: 2.1 time: 0.173867 Aug 31 17:31:20.435563 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4024/8059] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:31:20 2022] GET /compute/v2.1/servers/577b050d-93a3-4614-9018-4f936648d40b => generated 1393 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:31:21.457252 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-efb70cbb-d8f7-454e-b61c-bba78cdf09bb tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:31:21.457883 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-efb70cbb-d8f7-454e-b61c-bba78cdf09bb tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 577b050d-93a3-4614-9018-4f936648d40b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:31:21.465466 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-efb70cbb-d8f7-454e-b61c-bba78cdf09bb tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:31:21.465977 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-efb70cbb-d8f7-454e-b61c-bba78cdf09bb tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:31:21.466438 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-efb70cbb-d8f7-454e-b61c-bba78cdf09bb tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:31:21.467168 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-efb70cbb-d8f7-454e-b61c-bba78cdf09bb tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:31:21.467680 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-efb70cbb-d8f7-454e-b61c-bba78cdf09bb tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:31:21.468132 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-efb70cbb-d8f7-454e-b61c-bba78cdf09bb tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:31:21.620268 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-efb70cbb-d8f7-454e-b61c-bba78cdf09bb tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:31:21.628157 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-efb70cbb-d8f7-454e-b61c-bba78cdf09bb tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/577b050d-93a3-4614-9018-4f936648d40b" status: 200 len: 1393 microversion: 2.1 time: 0.174830 Aug 31 17:31:21.628739 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4036/8060] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:31:21 2022] GET /compute/v2.1/servers/577b050d-93a3-4614-9018-4f936648d40b => generated 1393 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:31:22.622069 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-e3677534-7dc9-40cc-9cd9-4b55767dd61c req-e23ea58c-349a-4407-a643-70f867bceca4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "577b050d-93a3-4614-9018-4f936648d40b", "name": "network-vif-plugged", "status": "completed", "tag": "2a33e5c3-35bf-48d2-b92e-5b434cd96ecb"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:31:22.629132 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:31:22.629753 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=6 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:31:22.636799 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-e3677534-7dc9-40cc-9cd9-4b55767dd61c req-e23ea58c-349a-4407-a643-70f867bceca4 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:31:22.637293 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-e3677534-7dc9-40cc-9cd9-4b55767dd61c req-e23ea58c-349a-4407-a643-70f867bceca4 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:31:22.637728 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-e3677534-7dc9-40cc-9cd9-4b55767dd61c req-e23ea58c-349a-4407-a643-70f867bceca4 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:31:22.650138 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-bf094c0e-e1cf-43b4-afde-6da2d63b9d48 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:31:22.651125 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-bf094c0e-e1cf-43b4-afde-6da2d63b9d48 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 577b050d-93a3-4614-9018-4f936648d40b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:31:22.651243 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-e3677534-7dc9-40cc-9cd9-4b55767dd61c req-e23ea58c-349a-4407-a643-70f867bceca4 service nova] Creating event network-vif-plugged:2a33e5c3-35bf-48d2-b92e-5b434cd96ecb for instance 577b050d-93a3-4614-9018-4f936648d40b on n-h1-850499-9 Aug 31 17:31:22.657240 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-e3677534-7dc9-40cc-9cd9-4b55767dd61c req-e23ea58c-349a-4407-a643-70f867bceca4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039893 Aug 31 17:31:22.658667 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4025/8061] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:31:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:31:22.658811 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bf094c0e-e1cf-43b4-afde-6da2d63b9d48 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:31:22.659237 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bf094c0e-e1cf-43b4-afde-6da2d63b9d48 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:31:22.659737 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bf094c0e-e1cf-43b4-afde-6da2d63b9d48 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:31:22.660463 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bf094c0e-e1cf-43b4-afde-6da2d63b9d48 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:31:22.660971 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bf094c0e-e1cf-43b4-afde-6da2d63b9d48 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:31:22.661452 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bf094c0e-e1cf-43b4-afde-6da2d63b9d48 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:31:22.841698 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-bf094c0e-e1cf-43b4-afde-6da2d63b9d48 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:31:22.849685 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-bf094c0e-e1cf-43b4-afde-6da2d63b9d48 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/577b050d-93a3-4614-9018-4f936648d40b" status: 200 len: 1393 microversion: 2.1 time: 0.203545 Aug 31 17:31:22.850297 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4037/8062] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:31:22 2022] GET /compute/v2.1/servers/577b050d-93a3-4614-9018-4f936648d40b => generated 1393 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:31:23.872768 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2f6fd26c-9ed9-4d9c-a838-d5a8fee24c73 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:31:23.873479 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2f6fd26c-9ed9-4d9c-a838-d5a8fee24c73 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 577b050d-93a3-4614-9018-4f936648d40b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:31:23.880542 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2f6fd26c-9ed9-4d9c-a838-d5a8fee24c73 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:31:23.881026 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2f6fd26c-9ed9-4d9c-a838-d5a8fee24c73 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:31:23.881465 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2f6fd26c-9ed9-4d9c-a838-d5a8fee24c73 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:31:23.882156 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2f6fd26c-9ed9-4d9c-a838-d5a8fee24c73 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:31:23.882610 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2f6fd26c-9ed9-4d9c-a838-d5a8fee24c73 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:31:23.883048 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2f6fd26c-9ed9-4d9c-a838-d5a8fee24c73 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:31:24.019914 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-2f6fd26c-9ed9-4d9c-a838-d5a8fee24c73 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:31:24.029453 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2f6fd26c-9ed9-4d9c-a838-d5a8fee24c73 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/577b050d-93a3-4614-9018-4f936648d40b" status: 200 len: 1393 microversion: 2.1 time: 0.161912 Aug 31 17:31:24.030062 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4026/8063] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:31:23 2022] GET /compute/v2.1/servers/577b050d-93a3-4614-9018-4f936648d40b => generated 1393 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:31:25.052651 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-3932e8e6-ae01-4a2e-8965-535f3e9b1702 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:31:25.053274 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-3932e8e6-ae01-4a2e-8965-535f3e9b1702 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 577b050d-93a3-4614-9018-4f936648d40b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:31:25.055185 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=6 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:31:25.061672 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3932e8e6-ae01-4a2e-8965-535f3e9b1702 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:31:25.062182 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3932e8e6-ae01-4a2e-8965-535f3e9b1702 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:31:25.062638 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3932e8e6-ae01-4a2e-8965-535f3e9b1702 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:31:25.063359 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3932e8e6-ae01-4a2e-8965-535f3e9b1702 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:31:25.063861 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3932e8e6-ae01-4a2e-8965-535f3e9b1702 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:31:25.064304 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-3932e8e6-ae01-4a2e-8965-535f3e9b1702 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:31:25.211792 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-3932e8e6-ae01-4a2e-8965-535f3e9b1702 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:31:25.220115 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-3932e8e6-ae01-4a2e-8965-535f3e9b1702 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/577b050d-93a3-4614-9018-4f936648d40b" status: 200 len: 1566 microversion: 2.1 time: 0.171439 Aug 31 17:31:25.220707 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4038/8064] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:31:25 2022] GET /compute/v2.1/servers/577b050d-93a3-4614-9018-4f936648d40b => generated 1566 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:31:25.241581 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-00d93d79-d470-4c74-802a-9ef782024b2f tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:31:25.242194 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-00d93d79-d470-4c74-802a-9ef782024b2f tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 577b050d-93a3-4614-9018-4f936648d40b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:31:25.250110 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-00d93d79-d470-4c74-802a-9ef782024b2f tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:31:25.250605 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-00d93d79-d470-4c74-802a-9ef782024b2f tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:31:25.251050 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-00d93d79-d470-4c74-802a-9ef782024b2f tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:31:25.251792 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-00d93d79-d470-4c74-802a-9ef782024b2f tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:31:25.252252 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-00d93d79-d470-4c74-802a-9ef782024b2f tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:31:25.252676 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-00d93d79-d470-4c74-802a-9ef782024b2f tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:31:25.416356 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-00d93d79-d470-4c74-802a-9ef782024b2f tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:31:25.424101 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-00d93d79-d470-4c74-802a-9ef782024b2f tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/577b050d-93a3-4614-9018-4f936648d40b" status: 200 len: 1566 microversion: 2.1 time: 0.186428 Aug 31 17:31:25.424668 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4027/8065] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:31:25 2022] GET /compute/v2.1/servers/577b050d-93a3-4614-9018-4f936648d40b => generated 1566 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:31:27.291032 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-bb950495-f7ff-49dd-bcb3-bbdbfd66dc3b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:31:27.291697 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-bb950495-f7ff-49dd-bcb3-bbdbfd66dc3b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 577b050d-93a3-4614-9018-4f936648d40b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:31:27.294438 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:31:27.300628 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-c4dbd115-853f-4c53-b37c-00a7f1b1be83 req-ca717541-2b9a-466a-9217-a53d6537e60e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "577b050d-93a3-4614-9018-4f936648d40b", "tag": "2a33e5c3-35bf-48d2-b92e-5b434cd96ecb"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:31:27.311412 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:31:27.313857 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bb950495-f7ff-49dd-bcb3-bbdbfd66dc3b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:31:27.314376 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bb950495-f7ff-49dd-bcb3-bbdbfd66dc3b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:31:27.314831 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bb950495-f7ff-49dd-bcb3-bbdbfd66dc3b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:31:27.315580 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bb950495-f7ff-49dd-bcb3-bbdbfd66dc3b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:31:27.316257 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bb950495-f7ff-49dd-bcb3-bbdbfd66dc3b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:31:27.316696 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bb950495-f7ff-49dd-bcb3-bbdbfd66dc3b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:31:27.318323 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-c4dbd115-853f-4c53-b37c-00a7f1b1be83 req-ca717541-2b9a-466a-9217-a53d6537e60e service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:31:27.318991 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-c4dbd115-853f-4c53-b37c-00a7f1b1be83 req-ca717541-2b9a-466a-9217-a53d6537e60e service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:31:27.319527 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-c4dbd115-853f-4c53-b37c-00a7f1b1be83 req-ca717541-2b9a-466a-9217-a53d6537e60e service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:31:27.333029 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-c4dbd115-853f-4c53-b37c-00a7f1b1be83 req-ca717541-2b9a-466a-9217-a53d6537e60e service nova] Creating event network-changed:2a33e5c3-35bf-48d2-b92e-5b434cd96ecb for instance 577b050d-93a3-4614-9018-4f936648d40b on n-h1-850499-9 Aug 31 17:31:27.338922 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-c4dbd115-853f-4c53-b37c-00a7f1b1be83 req-ca717541-2b9a-466a-9217-a53d6537e60e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041898 Aug 31 17:31:27.339862 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4028/8066] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:31:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:31:27.581560 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-bb950495-f7ff-49dd-bcb3-bbdbfd66dc3b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:31:27.589978 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-bb950495-f7ff-49dd-bcb3-bbdbfd66dc3b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/577b050d-93a3-4614-9018-4f936648d40b" status: 200 len: 1566 microversion: 2.1 time: 0.302964 Aug 31 17:31:27.590668 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4039/8067] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:31:27 2022] GET /compute/v2.1/servers/577b050d-93a3-4614-9018-4f936648d40b => generated 1566 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 17:32:01.966454 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=38 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:32:01.971124 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5105d8b5-f288-4c2f-8aa0-384d54defa31 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:32:01.973471 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5105d8b5-f288-4c2f-8aa0-384d54defa31 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 577b050d-93a3-4614-9018-4f936648d40b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:32:01.981768 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5105d8b5-f288-4c2f-8aa0-384d54defa31 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:32:01.982260 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5105d8b5-f288-4c2f-8aa0-384d54defa31 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:32:01.982705 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5105d8b5-f288-4c2f-8aa0-384d54defa31 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:32:01.983403 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5105d8b5-f288-4c2f-8aa0-384d54defa31 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:32:01.983958 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5105d8b5-f288-4c2f-8aa0-384d54defa31 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:32:01.984383 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5105d8b5-f288-4c2f-8aa0-384d54defa31 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:32:02.051607 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5105d8b5-f288-4c2f-8aa0-384d54defa31 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "POST /compute/v2.1/servers/577b050d-93a3-4614-9018-4f936648d40b/action" status: 200 len: 24561 microversion: 2.1 time: 0.087071 Aug 31 17:32:02.052289 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4029/8068] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 17:32:01 2022] POST /compute/v2.1/servers/577b050d-93a3-4614-9018-4f936648d40b/action => generated 24561 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 17:32:32.491080 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:32:32.492329 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=42 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:32:32.497607 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-5ce0e0f6-9b0f-4cf5-b407-1a8d352ed596 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:32:32.498159 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-5ce0e0f6-9b0f-4cf5-b407-1a8d352ed596 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 577b050d-93a3-4614-9018-4f936648d40b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:32:32.505239 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5ce0e0f6-9b0f-4cf5-b407-1a8d352ed596 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:32:32.505737 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5ce0e0f6-9b0f-4cf5-b407-1a8d352ed596 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:32:32.506187 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5ce0e0f6-9b0f-4cf5-b407-1a8d352ed596 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:32:32.506893 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5ce0e0f6-9b0f-4cf5-b407-1a8d352ed596 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:32:32.507366 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5ce0e0f6-9b0f-4cf5-b407-1a8d352ed596 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:32:32.507844 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-5ce0e0f6-9b0f-4cf5-b407-1a8d352ed596 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:32:32.531953 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-5ce0e0f6-9b0f-4cf5-b407-1a8d352ed596 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lazy-loading 'flavor' on Instance uuid 577b050d-93a3-4614-9018-4f936648d40b {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 17:32:32.600602 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-5ce0e0f6-9b0f-4cf5-b407-1a8d352ed596 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "POST /compute/v2.1/servers/577b050d-93a3-4614-9018-4f936648d40b/action" status: 202 len: 0 microversion: 2.1 time: 0.111163 Aug 31 17:32:32.601259 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4040/8069] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 17:32:32 2022] POST /compute/v2.1/servers/577b050d-93a3-4614-9018-4f936648d40b/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 17:32:32.610242 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-77e52481-579b-48a5-889f-8d9fe33fcbe7 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:32:32.610951 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-77e52481-579b-48a5-889f-8d9fe33fcbe7 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 577b050d-93a3-4614-9018-4f936648d40b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:32:32.613559 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=3 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:32:32.614209 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=4 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:32:32.620292 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-77e52481-579b-48a5-889f-8d9fe33fcbe7 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:32:32.620786 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-77e52481-579b-48a5-889f-8d9fe33fcbe7 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:32:32.621233 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-77e52481-579b-48a5-889f-8d9fe33fcbe7 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:32:32.621983 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-77e52481-579b-48a5-889f-8d9fe33fcbe7 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:32:32.622540 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-77e52481-579b-48a5-889f-8d9fe33fcbe7 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:32:32.622975 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-77e52481-579b-48a5-889f-8d9fe33fcbe7 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:32:32.763014 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-77e52481-579b-48a5-889f-8d9fe33fcbe7 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:32:32.770895 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-77e52481-579b-48a5-889f-8d9fe33fcbe7 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/577b050d-93a3-4614-9018-4f936648d40b" status: 200 len: 1693 microversion: 2.1 time: 0.165107 Aug 31 17:32:32.771465 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4030/8070] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:32:32 2022] GET /compute/v2.1/servers/577b050d-93a3-4614-9018-4f936648d40b => generated 1693 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:32:33.795472 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-46fcc3ef-51a4-4930-ade7-719c410a90b0 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:32:33.796219 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-46fcc3ef-51a4-4930-ade7-719c410a90b0 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 577b050d-93a3-4614-9018-4f936648d40b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:32:33.802493 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-46fcc3ef-51a4-4930-ade7-719c410a90b0 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:32:33.803000 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-46fcc3ef-51a4-4930-ade7-719c410a90b0 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:32:33.803488 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-46fcc3ef-51a4-4930-ade7-719c410a90b0 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:32:33.804205 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-46fcc3ef-51a4-4930-ade7-719c410a90b0 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:32:33.804684 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-46fcc3ef-51a4-4930-ade7-719c410a90b0 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:32:33.805139 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-46fcc3ef-51a4-4930-ade7-719c410a90b0 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:32:33.944033 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-46fcc3ef-51a4-4930-ade7-719c410a90b0 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:32:33.952559 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-46fcc3ef-51a4-4930-ade7-719c410a90b0 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/577b050d-93a3-4614-9018-4f936648d40b" status: 200 len: 1693 microversion: 2.1 time: 0.163126 Aug 31 17:32:33.953136 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4041/8071] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:32:33 2022] GET /compute/v2.1/servers/577b050d-93a3-4614-9018-4f936648d40b => generated 1693 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:32:34.975884 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e1f49db4-a412-444a-ba71-5706828edea4 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:32:34.976590 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e1f49db4-a412-444a-ba71-5706828edea4 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 577b050d-93a3-4614-9018-4f936648d40b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:32:34.983059 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e1f49db4-a412-444a-ba71-5706828edea4 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:32:34.983576 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e1f49db4-a412-444a-ba71-5706828edea4 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:32:34.984023 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e1f49db4-a412-444a-ba71-5706828edea4 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:32:34.984725 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e1f49db4-a412-444a-ba71-5706828edea4 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:32:34.985188 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e1f49db4-a412-444a-ba71-5706828edea4 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:32:34.985666 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e1f49db4-a412-444a-ba71-5706828edea4 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:32:35.123369 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e1f49db4-a412-444a-ba71-5706828edea4 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:32:35.131276 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e1f49db4-a412-444a-ba71-5706828edea4 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/577b050d-93a3-4614-9018-4f936648d40b" status: 200 len: 1676 microversion: 2.1 time: 0.160883 Aug 31 17:32:35.131891 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4031/8072] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:32:34 2022] GET /compute/v2.1/servers/577b050d-93a3-4614-9018-4f936648d40b => generated 1676 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:32:36.232012 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ef38b53d-55a4-4476-86ab-96adb4a1d669 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:32:36.234189 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ef38b53d-55a4-4476-86ab-96adb4a1d669 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 577b050d-93a3-4614-9018-4f936648d40b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:32:36.241060 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ef38b53d-55a4-4476-86ab-96adb4a1d669 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:32:36.241559 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ef38b53d-55a4-4476-86ab-96adb4a1d669 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:32:36.242010 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ef38b53d-55a4-4476-86ab-96adb4a1d669 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:32:36.242713 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ef38b53d-55a4-4476-86ab-96adb4a1d669 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:32:36.243182 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ef38b53d-55a4-4476-86ab-96adb4a1d669 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:32:36.243659 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ef38b53d-55a4-4476-86ab-96adb4a1d669 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:32:36.307280 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ef38b53d-55a4-4476-86ab-96adb4a1d669 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "POST /compute/v2.1/servers/577b050d-93a3-4614-9018-4f936648d40b/action" status: 200 len: 36344 microversion: 2.1 time: 0.080098 Aug 31 17:32:36.307964 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4042/8073] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 17:32:36 2022] POST /compute/v2.1/servers/577b050d-93a3-4614-9018-4f936648d40b/action => generated 36344 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 17:32:36.319807 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6bf6f468-515f-484b-810b-06900e70f7c5 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:32:36.321442 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6bf6f468-515f-484b-810b-06900e70f7c5 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 577b050d-93a3-4614-9018-4f936648d40b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:32:36.329594 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6bf6f468-515f-484b-810b-06900e70f7c5 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:32:36.330086 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6bf6f468-515f-484b-810b-06900e70f7c5 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:32:36.330524 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6bf6f468-515f-484b-810b-06900e70f7c5 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:32:36.331219 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6bf6f468-515f-484b-810b-06900e70f7c5 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:32:36.331704 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6bf6f468-515f-484b-810b-06900e70f7c5 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:32:36.332132 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6bf6f468-515f-484b-810b-06900e70f7c5 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:32:36.399245 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6bf6f468-515f-484b-810b-06900e70f7c5 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "POST /compute/v2.1/servers/577b050d-93a3-4614-9018-4f936648d40b/action" status: 202 len: 0 microversion: 2.1 time: 0.083235 Aug 31 17:32:36.400099 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4032/8074] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 17:32:36 2022] POST /compute/v2.1/servers/577b050d-93a3-4614-9018-4f936648d40b/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 17:32:36.410171 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-37d754cb-7a50-4551-8338-9f99ef208dca tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:32:36.410936 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-37d754cb-7a50-4551-8338-9f99ef208dca tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 577b050d-93a3-4614-9018-4f936648d40b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:32:36.419243 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-37d754cb-7a50-4551-8338-9f99ef208dca tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:32:36.419763 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-37d754cb-7a50-4551-8338-9f99ef208dca tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:32:36.420275 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-37d754cb-7a50-4551-8338-9f99ef208dca tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:32:36.421004 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-37d754cb-7a50-4551-8338-9f99ef208dca tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:32:36.421480 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-37d754cb-7a50-4551-8338-9f99ef208dca tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:32:36.421925 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-37d754cb-7a50-4551-8338-9f99ef208dca tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:32:36.609849 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-37d754cb-7a50-4551-8338-9f99ef208dca tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:32:36.618397 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-37d754cb-7a50-4551-8338-9f99ef208dca tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/577b050d-93a3-4614-9018-4f936648d40b" status: 200 len: 1682 microversion: 2.1 time: 0.212817 Aug 31 17:32:36.618985 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4043/8075] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:32:36 2022] GET /compute/v2.1/servers/577b050d-93a3-4614-9018-4f936648d40b => generated 1682 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:32:37.642833 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-45b1bded-469e-43ae-96a1-5a1c8c010727 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:32:37.643557 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-45b1bded-469e-43ae-96a1-5a1c8c010727 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 577b050d-93a3-4614-9018-4f936648d40b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:32:37.650513 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-45b1bded-469e-43ae-96a1-5a1c8c010727 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:32:37.651016 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-45b1bded-469e-43ae-96a1-5a1c8c010727 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:32:37.651459 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-45b1bded-469e-43ae-96a1-5a1c8c010727 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:32:37.652215 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-45b1bded-469e-43ae-96a1-5a1c8c010727 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:32:37.652975 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-45b1bded-469e-43ae-96a1-5a1c8c010727 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:32:37.653415 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-45b1bded-469e-43ae-96a1-5a1c8c010727 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:32:37.790027 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-45b1bded-469e-43ae-96a1-5a1c8c010727 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:32:37.798524 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-45b1bded-469e-43ae-96a1-5a1c8c010727 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/577b050d-93a3-4614-9018-4f936648d40b" status: 200 len: 1682 microversion: 2.1 time: 0.161698 Aug 31 17:32:37.799557 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4033/8076] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:32:37 2022] GET /compute/v2.1/servers/577b050d-93a3-4614-9018-4f936648d40b => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:32:38.821425 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d7b2f066-4ed0-4a8b-9ad7-e2d596329712 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:32:38.822054 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d7b2f066-4ed0-4a8b-9ad7-e2d596329712 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 577b050d-93a3-4614-9018-4f936648d40b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:32:38.829204 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d7b2f066-4ed0-4a8b-9ad7-e2d596329712 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:32:38.829712 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d7b2f066-4ed0-4a8b-9ad7-e2d596329712 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:32:38.830187 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d7b2f066-4ed0-4a8b-9ad7-e2d596329712 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:32:38.830905 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d7b2f066-4ed0-4a8b-9ad7-e2d596329712 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:32:38.831380 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d7b2f066-4ed0-4a8b-9ad7-e2d596329712 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:32:38.831858 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d7b2f066-4ed0-4a8b-9ad7-e2d596329712 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:32:38.968533 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d7b2f066-4ed0-4a8b-9ad7-e2d596329712 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:32:38.976902 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d7b2f066-4ed0-4a8b-9ad7-e2d596329712 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/577b050d-93a3-4614-9018-4f936648d40b" status: 200 len: 1685 microversion: 2.1 time: 0.159395 Aug 31 17:32:38.977488 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4044/8077] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:32:38 2022] GET /compute/v2.1/servers/577b050d-93a3-4614-9018-4f936648d40b => generated 1685 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:32:39.073316 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a49d809d-c034-460f-b9bb-a8ff54a9489b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:32:39.075458 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a49d809d-c034-460f-b9bb-a8ff54a9489b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 577b050d-93a3-4614-9018-4f936648d40b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:32:39.082153 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a49d809d-c034-460f-b9bb-a8ff54a9489b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:32:39.082636 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a49d809d-c034-460f-b9bb-a8ff54a9489b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:32:39.083081 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a49d809d-c034-460f-b9bb-a8ff54a9489b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:32:39.083799 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a49d809d-c034-460f-b9bb-a8ff54a9489b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:32:39.084261 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a49d809d-c034-460f-b9bb-a8ff54a9489b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:32:39.084692 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a49d809d-c034-460f-b9bb-a8ff54a9489b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:32:39.147812 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a49d809d-c034-460f-b9bb-a8ff54a9489b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "POST /compute/v2.1/servers/577b050d-93a3-4614-9018-4f936648d40b/action" status: 200 len: 36344 microversion: 2.1 time: 0.078298 Aug 31 17:32:39.148491 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4034/8078] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 17:32:39 2022] POST /compute/v2.1/servers/577b050d-93a3-4614-9018-4f936648d40b/action => generated 36344 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 17:32:40.459244 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-43fb5e83-df38-49fb-bb91-2f53f6a87572 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:32:40.459871 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-43fb5e83-df38-49fb-bb91-2f53f6a87572 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 577b050d-93a3-4614-9018-4f936648d40b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:32:40.465119 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-c0b75def-3c89-42be-b7cf-5150dadbb20c req-65edea0e-3f76-4c53-b1ec-9855a77ac973 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "577b050d-93a3-4614-9018-4f936648d40b", "tag": "2a33e5c3-35bf-48d2-b92e-5b434cd96ecb"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:32:40.467482 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-43fb5e83-df38-49fb-bb91-2f53f6a87572 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:32:40.468082 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-43fb5e83-df38-49fb-bb91-2f53f6a87572 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:32:40.468608 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-43fb5e83-df38-49fb-bb91-2f53f6a87572 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:32:40.469432 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-43fb5e83-df38-49fb-bb91-2f53f6a87572 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:32:40.470070 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-43fb5e83-df38-49fb-bb91-2f53f6a87572 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:32:40.470667 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-43fb5e83-df38-49fb-bb91-2f53f6a87572 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:32:40.476447 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-c0b75def-3c89-42be-b7cf-5150dadbb20c req-65edea0e-3f76-4c53-b1ec-9855a77ac973 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:32:40.476934 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-c0b75def-3c89-42be-b7cf-5150dadbb20c req-65edea0e-3f76-4c53-b1ec-9855a77ac973 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:32:40.477558 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-c0b75def-3c89-42be-b7cf-5150dadbb20c req-65edea0e-3f76-4c53-b1ec-9855a77ac973 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:32:40.489913 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-c0b75def-3c89-42be-b7cf-5150dadbb20c req-65edea0e-3f76-4c53-b1ec-9855a77ac973 service nova] Creating event network-changed:2a33e5c3-35bf-48d2-b92e-5b434cd96ecb for instance 577b050d-93a3-4614-9018-4f936648d40b on n-h1-850499-9 Aug 31 17:32:40.495137 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-c0b75def-3c89-42be-b7cf-5150dadbb20c req-65edea0e-3f76-4c53-b1ec-9855a77ac973 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033878 Aug 31 17:32:40.495803 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4035/8079] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:32:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 17:32:40.500519 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-43fb5e83-df38-49fb-bb91-2f53f6a87572 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 577b050d-93a3-4614-9018-4f936648d40b] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 17:32:40.589779 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-43fb5e83-df38-49fb-bb91-2f53f6a87572 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "DELETE /compute/v2.1/servers/577b050d-93a3-4614-9018-4f936648d40b" status: 204 len: 0 microversion: 2.1 time: 0.134284 Aug 31 17:32:40.591409 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4045/8080] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 17:32:40 2022] DELETE /compute/v2.1/servers/577b050d-93a3-4614-9018-4f936648d40b => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 17:32:40.602233 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-dd97b7db-017c-4e6a-a881-2c7ec3b5146b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:32:40.603102 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-dd97b7db-017c-4e6a-a881-2c7ec3b5146b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 577b050d-93a3-4614-9018-4f936648d40b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:32:40.611366 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dd97b7db-017c-4e6a-a881-2c7ec3b5146b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:32:40.611954 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dd97b7db-017c-4e6a-a881-2c7ec3b5146b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:32:40.612461 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dd97b7db-017c-4e6a-a881-2c7ec3b5146b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:32:40.613174 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dd97b7db-017c-4e6a-a881-2c7ec3b5146b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:32:40.613629 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dd97b7db-017c-4e6a-a881-2c7ec3b5146b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:32:40.614053 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dd97b7db-017c-4e6a-a881-2c7ec3b5146b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:32:40.758608 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-dd97b7db-017c-4e6a-a881-2c7ec3b5146b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:32:40.767062 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-dd97b7db-017c-4e6a-a881-2c7ec3b5146b tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/577b050d-93a3-4614-9018-4f936648d40b" status: 200 len: 1691 microversion: 2.1 time: 0.170920 Aug 31 17:32:40.767665 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4036/8081] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:32:40 2022] GET /compute/v2.1/servers/577b050d-93a3-4614-9018-4f936648d40b => generated 1691 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:32:41.792766 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-84c96896-4b94-4690-a194-754635efe9e1 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:32:41.794048 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-84c96896-4b94-4690-a194-754635efe9e1 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 577b050d-93a3-4614-9018-4f936648d40b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:32:41.801238 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-84c96896-4b94-4690-a194-754635efe9e1 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:32:41.801737 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-84c96896-4b94-4690-a194-754635efe9e1 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:32:41.802191 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-84c96896-4b94-4690-a194-754635efe9e1 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:32:41.802902 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-84c96896-4b94-4690-a194-754635efe9e1 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:32:41.803368 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-84c96896-4b94-4690-a194-754635efe9e1 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:32:41.803829 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-84c96896-4b94-4690-a194-754635efe9e1 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:32:42.004646 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-84c96896-4b94-4690-a194-754635efe9e1 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:32:42.012930 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-84c96896-4b94-4690-a194-754635efe9e1 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/577b050d-93a3-4614-9018-4f936648d40b" status: 200 len: 1691 microversion: 2.1 time: 0.224297 Aug 31 17:32:42.013564 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4046/8082] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:32:41 2022] GET /compute/v2.1/servers/577b050d-93a3-4614-9018-4f936648d40b => generated 1691 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:32:42.986956 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-15ece89c-afdd-47b9-b295-cb8006099193 req-70a49577-5168-4c18-b7d9-f44d85f15acb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "577b050d-93a3-4614-9018-4f936648d40b", "name": "network-vif-deleted", "tag": "2a33e5c3-35bf-48d2-b92e-5b434cd96ecb"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:32:42.998809 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-15ece89c-afdd-47b9-b295-cb8006099193 req-70a49577-5168-4c18-b7d9-f44d85f15acb service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:32:42.999348 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-15ece89c-afdd-47b9-b295-cb8006099193 req-70a49577-5168-4c18-b7d9-f44d85f15acb service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:32:42.999981 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-15ece89c-afdd-47b9-b295-cb8006099193 req-70a49577-5168-4c18-b7d9-f44d85f15acb service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:32:43.011805 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-15ece89c-afdd-47b9-b295-cb8006099193 req-70a49577-5168-4c18-b7d9-f44d85f15acb service nova] Creating event network-vif-deleted:2a33e5c3-35bf-48d2-b92e-5b434cd96ecb for instance 577b050d-93a3-4614-9018-4f936648d40b on n-h1-850499-9 Aug 31 17:32:43.018027 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-15ece89c-afdd-47b9-b295-cb8006099193 req-70a49577-5168-4c18-b7d9-f44d85f15acb service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034588 Aug 31 17:32:43.018716 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4037/8083] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:32:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:32:43.034261 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c4f0ffe6-8ed7-4eca-b304-90f81b9000a3 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:32:43.034897 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c4f0ffe6-8ed7-4eca-b304-90f81b9000a3 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 577b050d-93a3-4614-9018-4f936648d40b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:32:43.042745 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c4f0ffe6-8ed7-4eca-b304-90f81b9000a3 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:32:43.043253 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c4f0ffe6-8ed7-4eca-b304-90f81b9000a3 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:32:43.044342 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c4f0ffe6-8ed7-4eca-b304-90f81b9000a3 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:32:43.045099 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c4f0ffe6-8ed7-4eca-b304-90f81b9000a3 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:32:43.045574 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c4f0ffe6-8ed7-4eca-b304-90f81b9000a3 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:32:43.046019 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c4f0ffe6-8ed7-4eca-b304-90f81b9000a3 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:32:43.111981 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c4f0ffe6-8ed7-4eca-b304-90f81b9000a3 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d0544424b41fe951feb12dae6b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc47c533fa344b1caa1082a8caf19e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:32:43.120589 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c4f0ffe6-8ed7-4eca-b304-90f81b9000a3 tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/577b050d-93a3-4614-9018-4f936648d40b" status: 200 len: 1352 microversion: 2.1 time: 0.090220 Aug 31 17:32:43.121189 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4047/8084] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:32:43 2022] GET /compute/v2.1/servers/577b050d-93a3-4614-9018-4f936648d40b => generated 1352 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:32:44.143879 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b4e98104-de1e-4c13-aced-851b06966dac tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:32:44.144586 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b4e98104-de1e-4c13-aced-851b06966dac tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] [instance: 577b050d-93a3-4614-9018-4f936648d40b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:32:44.150796 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b4e98104-de1e-4c13-aced-851b06966dac tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:32:44.151288 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b4e98104-de1e-4c13-aced-851b06966dac tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:32:44.151759 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b4e98104-de1e-4c13-aced-851b06966dac tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:32:44.153249 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b4e98104-de1e-4c13-aced-851b06966dac tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:32:44.153754 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b4e98104-de1e-4c13-aced-851b06966dac tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:32:44.154188 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b4e98104-de1e-4c13-aced-851b06966dac tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:32:44.171138 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-b4e98104-de1e-4c13-aced-851b06966dac tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] HTTP exception thrown: Instance 577b050d-93a3-4614-9018-4f936648d40b could not be found. Aug 31 17:32:44.172742 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b4e98104-de1e-4c13-aced-851b06966dac tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Request method failure captured: Aug 31 17:32:44.172742 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/577b050d-93a3-4614-9018-4f936648d40b HTTP/1.1 Aug 31 17:32:44.172742 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 17:32:44.172742 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 17:32:44.172742 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 17:32:44.172742 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 17:32:44.172742 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 17:32:44.172742 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 17:32:44.172742 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 17:32:44.172742 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 17:32:44.172742 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD5hakwX2sXsbALOgVo9PPyLePH0fvR7L2xAV9ui8HTcLnBw3oZI1M7wF3mkEoqVA9fsecKEAxd9W333iMdsO8-IzHDYJUM0nEaJnVkZbE7IkWX3bqA3p9FNp7cLB3haZsSOX7PxhWli3RU37vvA4Rc8W5sIFHQE1dXFZWX5L9iGDZKs Aug 31 17:32:44.172742 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 17:32:44.172742 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 17:32:44.172742 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 17:32:44.172742 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 17:32:44.172742 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 17:32:44.172742 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 17:32:44.172742 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: dc47c533fa344b1caa1082a8caf19e36 Aug 31 17:32:44.172742 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-489466368 Aug 31 17:32:44.172742 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 17:32:44.172742 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 17:32:44.172742 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/dc47c533fa344b1caa1082a8caf19e36"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/dc47c533fa344b1caa1082a8caf19e36"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_dc47c533fa344b1caa1082a8caf19e36", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/dc47c533fa344b1caa1082a8caf19e36"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 17:32:44.172742 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-TestNetworkAdvancedServerOps-489466368 Aug 31 17:32:44.172742 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: dc47c533fa344b1caa1082a8caf19e36 Aug 31 17:32:44.172742 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-489466368 Aug 31 17:32:44.172742 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-TestNetworkAdvancedServerOps-489466368-project Aug 31 17:32:44.172742 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 17:32:44.172742 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 17:32:44.172742 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 684d0544424b41fe951feb12dae6b1c2 Aug 31 17:32:44.172742 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-TestNetworkAdvancedServerOps-489466368-project Aug 31 17:32:44.172742 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 17:32:44.172742 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance 577b050d-93a3-4614-9018-4f936648d40b could not be found. Aug 31 17:32:44.172742 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '577b050d-93a3-4614-9018-4f936648d40b'} Aug 31 17:32:44.172742 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 17:32:44.172742 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:32:44.172742 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 17:32:44.172742 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 17:32:44.172742 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 17:32:44.172742 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 17:32:44.172742 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 17:32:44.172742 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 17:32:44.172742 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 17:32:44.172742 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 17:32:44.172742 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 577b050d-93a3-4614-9018-4f936648d40b could not be found. Aug 31 17:32:44.172742 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:32:44.172742 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:32:44.172742 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:32:44.172742 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:32:44.172742 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:32:44.172742 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:32:44.172742 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 17:32:44.172742 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 17:32:44.172742 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 17:32:44.172742 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 17:32:44.172742 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 17:32:44.172742 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 17:32:44.172742 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 17:32:44.172742 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 17:32:44.172742 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 17:32:44.172742 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 17:32:44.172742 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 577b050d-93a3-4614-9018-4f936648d40b could not be found. Aug 31 17:32:44.172742 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:32:44.172742 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:32:44.177686 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:32:44.177686 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:32:44.177686 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:32:44.177686 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:32:44.177686 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 17:32:44.177686 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 17:32:44.177686 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 577b050d-93a3-4614-9018-4f936648d40b could not be found. Aug 31 17:32:44.177686 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:32:44.177686 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b4e98104-de1e-4c13-aced-851b06966dac tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Returning 404 to user: Instance 577b050d-93a3-4614-9018-4f936648d40b could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 17:32:44.177686 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b4e98104-de1e-4c13-aced-851b06966dac tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "GET /compute/v2.1/servers/577b050d-93a3-4614-9018-4f936648d40b" status: 404 len: 111 microversion: 2.1 time: 0.035436 Aug 31 17:32:44.177686 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4038/8085] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:32:44 2022] GET /compute/v2.1/servers/577b050d-93a3-4614-9018-4f936648d40b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 17:32:47.574177 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1e4dc59f-4bdc-4768-bd11-1008a50635cc tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] Calling method '.version_select at 0x7f5aed19c940>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:32:47.599946 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1e4dc59f-4bdc-4768-bd11-1008a50635cc tempest-TestNetworkAdvancedServerOps-489466368 tempest-TestNetworkAdvancedServerOps-489466368-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1211192928" status: 202 len: 0 microversion: 2.1 time: 0.030449 Aug 31 17:32:47.600662 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4048/8086] 10.222.0.61 () {58 vars in 1284 bytes} [Wed Aug 31 17:32:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1211192928 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 17:32:59.155816 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=18 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:32:59.156573 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:32:59.345088 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-7d6a074c-9b5a-434f-8ad7-07feb671967f tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Action: 'create', calling method: .version_select at 0x7f5ae3acbca0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1503139623", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCfPgZkJvM54sjBYyuo7bVv20uBJdie15Us15Na6yo/ufDzYCeViXHdss8P0ijbrDQx8fhAqlkVd3ePutBvN9fHV1CbXxAY31Ve/Yck1yRxBfinu3s4RwOIFp0q8O2ZuTQ=="}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:32:59.362023 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-7d6a074c-9b5a-434f-8ad7-07feb671967f tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Getting quotas for project 5f084d7d088e4d8e87c62bdcc287b936. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 17:32:59.369358 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-7d6a074c-9b5a-434f-8ad7-07feb671967f tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Getting quotas for user bd916293046b465d9c14870bf8887cbc and project 5f084d7d088e4d8e87c62bdcc287b936. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 17:32:59.398930 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-7d6a074c-9b5a-434f-8ad7-07feb671967f tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.249973 Aug 31 17:32:59.400894 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4039/8087] 10.222.0.61 () {60 vars in 1159 bytes} [Wed Aug 31 17:32:59 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:33:00.432410 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7433c250-47c8-44f2-8bea-3df2ee820172 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1459270037", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1503139623", "security_groups": [{"name": "tempest-secgroup-smoke-1842782992"}], "networks": [{"uuid": "2e66078f-cfb6-4cf5-8ff2-11d97730b9dd"}]}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:33:00.443397 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:33:00.444417 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:33:00.552369 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-7433c250-47c8-44f2-8bea-3df2ee820172 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] validate_networks() for [('2e66078f-cfb6-4cf5-8ff2-11d97730b9dd', None, None, None, None, None)] {{(pid=122257) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 17:33:01.045384 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-7433c250-47c8-44f2-8bea-3df2ee820172 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 17:33:01.045898 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-7433c250-47c8-44f2-8bea-3df2ee820172 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 17:33:01.046395 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-7433c250-47c8-44f2-8bea-3df2ee820172 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 17:33:01.046895 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-7433c250-47c8-44f2-8bea-3df2ee820172 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 17:33:01.047427 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-7433c250-47c8-44f2-8bea-3df2ee820172 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 17:33:01.056491 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7433c250-47c8-44f2-8bea-3df2ee820172 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:33:01.057003 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7433c250-47c8-44f2-8bea-3df2ee820172 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:33:01.057445 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7433c250-47c8-44f2-8bea-3df2ee820172 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:33:01.058186 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7433c250-47c8-44f2-8bea-3df2ee820172 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:33:01.058740 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7433c250-47c8-44f2-8bea-3df2ee820172 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:33:01.059866 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7433c250-47c8-44f2-8bea-3df2ee820172 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:33:01.076728 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-7433c250-47c8-44f2-8bea-3df2ee820172 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Getting quotas for project 5f084d7d088e4d8e87c62bdcc287b936. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 17:33:01.082042 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-7433c250-47c8-44f2-8bea-3df2ee820172 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Getting quotas for user bd916293046b465d9c14870bf8887cbc and project 5f084d7d088e4d8e87c62bdcc287b936. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 17:33:01.094896 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7433c250-47c8-44f2-8bea-3df2ee820172 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Going to run 1 instances... {{(pid=122257) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 17:33:01.097269 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7433c250-47c8-44f2-8bea-3df2ee820172 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: 978a6f77-1a3d-4920-84dc-c786aeec4016] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 17:33:01.149805 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7433c250-47c8-44f2-8bea-3df2ee820172 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.721507 Aug 31 17:33:01.150693 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4049/8088] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 17:33:00 2022] POST /compute/v2.1/servers => generated 406 bytes in 723 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 17:33:01.161554 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-fc0b8454-9628-481b-be42-9c861507993b tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:33:01.162208 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-fc0b8454-9628-481b-be42-9c861507993b tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: 978a6f77-1a3d-4920-84dc-c786aeec4016] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:33:01.233265 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-fc0b8454-9628-481b-be42-9c861507993b tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:33:01.242544 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-fc0b8454-9628-481b-be42-9c861507993b tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016" status: 200 len: 1247 microversion: 2.1 time: 0.084321 Aug 31 17:33:01.243145 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4040/8089] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:33:01 2022] GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016 => generated 1247 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:33:02.264715 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-675d8fb3-997f-42ae-9d42-157ef55a1995 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:33:02.265403 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-675d8fb3-997f-42ae-9d42-157ef55a1995 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: 978a6f77-1a3d-4920-84dc-c786aeec4016] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:33:02.271740 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-675d8fb3-997f-42ae-9d42-157ef55a1995 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:33:02.272533 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-675d8fb3-997f-42ae-9d42-157ef55a1995 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:33:02.273154 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-675d8fb3-997f-42ae-9d42-157ef55a1995 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:33:02.274026 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-675d8fb3-997f-42ae-9d42-157ef55a1995 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:33:02.274899 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-675d8fb3-997f-42ae-9d42-157ef55a1995 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:33:02.275616 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-675d8fb3-997f-42ae-9d42-157ef55a1995 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:33:02.379852 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-675d8fb3-997f-42ae-9d42-157ef55a1995 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:33:02.396544 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-675d8fb3-997f-42ae-9d42-157ef55a1995 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016" status: 200 len: 1307 microversion: 2.1 time: 0.136578 Aug 31 17:33:02.398516 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4050/8090] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:33:02 2022] GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016 => generated 1307 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:33:03.422397 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e0fdb8a3-1918-43a2-b150-9e15c9c55357 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:33:03.423773 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e0fdb8a3-1918-43a2-b150-9e15c9c55357 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: 978a6f77-1a3d-4920-84dc-c786aeec4016] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:33:03.439873 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e0fdb8a3-1918-43a2-b150-9e15c9c55357 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:33:03.440779 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e0fdb8a3-1918-43a2-b150-9e15c9c55357 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:33:03.441456 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e0fdb8a3-1918-43a2-b150-9e15c9c55357 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:33:03.442425 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e0fdb8a3-1918-43a2-b150-9e15c9c55357 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:33:03.443225 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e0fdb8a3-1918-43a2-b150-9e15c9c55357 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:33:03.443915 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e0fdb8a3-1918-43a2-b150-9e15c9c55357 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:33:03.595922 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e0fdb8a3-1918-43a2-b150-9e15c9c55357 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:33:03.604271 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e0fdb8a3-1918-43a2-b150-9e15c9c55357 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016" status: 200 len: 1373 microversion: 2.1 time: 0.189697 Aug 31 17:33:03.604867 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4041/8091] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:33:03 2022] GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016 => generated 1373 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:33:03.901061 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-7a0a1eb5-fe9b-447e-9e5e-b95b5433ac40 req-f3597464-f11f-4786-92d7-8bc9aa80a642 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "978a6f77-1a3d-4920-84dc-c786aeec4016", "tag": "24b0ae69-a238-44af-822b-b4554d887bc4"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:33:03.911724 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-7a0a1eb5-fe9b-447e-9e5e-b95b5433ac40 req-f3597464-f11f-4786-92d7-8bc9aa80a642 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:33:03.912224 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-7a0a1eb5-fe9b-447e-9e5e-b95b5433ac40 req-f3597464-f11f-4786-92d7-8bc9aa80a642 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:33:03.912675 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-7a0a1eb5-fe9b-447e-9e5e-b95b5433ac40 req-f3597464-f11f-4786-92d7-8bc9aa80a642 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:33:03.924129 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-7a0a1eb5-fe9b-447e-9e5e-b95b5433ac40 req-f3597464-f11f-4786-92d7-8bc9aa80a642 service nova] Creating event network-changed:24b0ae69-a238-44af-822b-b4554d887bc4 for instance 978a6f77-1a3d-4920-84dc-c786aeec4016 on n-h2-850499-9 Aug 31 17:33:03.929134 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-7a0a1eb5-fe9b-447e-9e5e-b95b5433ac40 req-f3597464-f11f-4786-92d7-8bc9aa80a642 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103497 Aug 31 17:33:03.929745 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4051/8092] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:33:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 17:33:04.627258 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f13d6975-ed8c-4043-8f32-fda493c01a40 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:33:04.627934 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f13d6975-ed8c-4043-8f32-fda493c01a40 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: 978a6f77-1a3d-4920-84dc-c786aeec4016] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:33:04.635482 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f13d6975-ed8c-4043-8f32-fda493c01a40 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:33:04.636017 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f13d6975-ed8c-4043-8f32-fda493c01a40 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:33:04.636454 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f13d6975-ed8c-4043-8f32-fda493c01a40 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:33:04.637300 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f13d6975-ed8c-4043-8f32-fda493c01a40 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:33:04.637868 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f13d6975-ed8c-4043-8f32-fda493c01a40 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:33:04.638415 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f13d6975-ed8c-4043-8f32-fda493c01a40 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:33:04.806020 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f13d6975-ed8c-4043-8f32-fda493c01a40 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:33:04.814280 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f13d6975-ed8c-4043-8f32-fda493c01a40 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016" status: 200 len: 1373 microversion: 2.1 time: 0.191300 Aug 31 17:33:04.814875 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4042/8093] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:33:04 2022] GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016 => generated 1373 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:33:05.837413 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-19d4f9b6-ae15-4c53-824d-25409ae31400 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:33:05.838058 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-19d4f9b6-ae15-4c53-824d-25409ae31400 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: 978a6f77-1a3d-4920-84dc-c786aeec4016] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:33:05.844521 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-19d4f9b6-ae15-4c53-824d-25409ae31400 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:33:05.845118 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-19d4f9b6-ae15-4c53-824d-25409ae31400 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:33:05.845577 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-19d4f9b6-ae15-4c53-824d-25409ae31400 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:33:05.846296 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-19d4f9b6-ae15-4c53-824d-25409ae31400 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:33:05.846773 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-19d4f9b6-ae15-4c53-824d-25409ae31400 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:33:05.847218 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-19d4f9b6-ae15-4c53-824d-25409ae31400 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:33:05.989865 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-19d4f9b6-ae15-4c53-824d-25409ae31400 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:33:05.998394 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-19d4f9b6-ae15-4c53-824d-25409ae31400 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016" status: 200 len: 1373 microversion: 2.1 time: 0.166090 Aug 31 17:33:05.998981 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4052/8094] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:33:05 2022] GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016 => generated 1373 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:33:07.018955 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4fa84357-a2a8-43b7-9c59-249dc24a437f tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:33:07.019621 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4fa84357-a2a8-43b7-9c59-249dc24a437f tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: 978a6f77-1a3d-4920-84dc-c786aeec4016] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:33:07.026504 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4fa84357-a2a8-43b7-9c59-249dc24a437f tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:33:07.027004 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4fa84357-a2a8-43b7-9c59-249dc24a437f tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:33:07.028730 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4fa84357-a2a8-43b7-9c59-249dc24a437f tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:33:07.029446 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4fa84357-a2a8-43b7-9c59-249dc24a437f tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:33:07.029919 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4fa84357-a2a8-43b7-9c59-249dc24a437f tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:33:07.030358 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4fa84357-a2a8-43b7-9c59-249dc24a437f tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:33:07.167208 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-4fa84357-a2a8-43b7-9c59-249dc24a437f tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:33:07.175262 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4fa84357-a2a8-43b7-9c59-249dc24a437f tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016" status: 200 len: 1373 microversion: 2.1 time: 0.160328 Aug 31 17:33:07.175873 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4043/8095] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:33:07 2022] GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016 => generated 1373 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:33:08.196641 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1f581544-c9b3-40b4-a3f0-1f50dc23b5e5 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:33:08.197262 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1f581544-c9b3-40b4-a3f0-1f50dc23b5e5 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: 978a6f77-1a3d-4920-84dc-c786aeec4016] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:33:08.205053 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1f581544-c9b3-40b4-a3f0-1f50dc23b5e5 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:33:08.205556 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1f581544-c9b3-40b4-a3f0-1f50dc23b5e5 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:33:08.206001 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1f581544-c9b3-40b4-a3f0-1f50dc23b5e5 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:33:08.206706 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1f581544-c9b3-40b4-a3f0-1f50dc23b5e5 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:33:08.207177 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1f581544-c9b3-40b4-a3f0-1f50dc23b5e5 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:33:08.207639 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1f581544-c9b3-40b4-a3f0-1f50dc23b5e5 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:33:08.342204 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-1f581544-c9b3-40b4-a3f0-1f50dc23b5e5 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:33:08.350005 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1f581544-c9b3-40b4-a3f0-1f50dc23b5e5 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016" status: 200 len: 1373 microversion: 2.1 time: 0.157269 Aug 31 17:33:08.350579 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4053/8096] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:33:08 2022] GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016 => generated 1373 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:33:09.372222 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-944c030f-bf96-4927-8469-77d7b74f6e78 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:33:09.373037 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-944c030f-bf96-4927-8469-77d7b74f6e78 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: 978a6f77-1a3d-4920-84dc-c786aeec4016] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:33:09.380066 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-944c030f-bf96-4927-8469-77d7b74f6e78 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:33:09.380563 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-944c030f-bf96-4927-8469-77d7b74f6e78 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:33:09.381009 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-944c030f-bf96-4927-8469-77d7b74f6e78 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:33:09.381718 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-944c030f-bf96-4927-8469-77d7b74f6e78 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:33:09.382183 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-944c030f-bf96-4927-8469-77d7b74f6e78 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:33:09.382618 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-944c030f-bf96-4927-8469-77d7b74f6e78 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:33:09.440847 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-fab1a089-03fa-4e57-800e-5f68672b28cf req-7c9cc6df-db91-4232-bcf2-4ea414182593 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "978a6f77-1a3d-4920-84dc-c786aeec4016", "name": "network-vif-plugged", "status": "completed", "tag": "24b0ae69-a238-44af-822b-b4554d887bc4"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:33:09.453894 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-fab1a089-03fa-4e57-800e-5f68672b28cf req-7c9cc6df-db91-4232-bcf2-4ea414182593 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:33:09.455086 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-fab1a089-03fa-4e57-800e-5f68672b28cf req-7c9cc6df-db91-4232-bcf2-4ea414182593 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:33:09.455959 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-fab1a089-03fa-4e57-800e-5f68672b28cf req-7c9cc6df-db91-4232-bcf2-4ea414182593 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:33:09.476499 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-fab1a089-03fa-4e57-800e-5f68672b28cf req-7c9cc6df-db91-4232-bcf2-4ea414182593 service nova] Creating event network-vif-plugged:24b0ae69-a238-44af-822b-b4554d887bc4 for instance 978a6f77-1a3d-4920-84dc-c786aeec4016 on n-h2-850499-9 Aug 31 17:33:09.484977 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-fab1a089-03fa-4e57-800e-5f68672b28cf req-7c9cc6df-db91-4232-bcf2-4ea414182593 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047732 Aug 31 17:33:09.486013 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4054/8097] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:33:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 17:33:09.536468 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-944c030f-bf96-4927-8469-77d7b74f6e78 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:33:09.544930 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-944c030f-bf96-4927-8469-77d7b74f6e78 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016" status: 200 len: 1373 microversion: 2.1 time: 0.177316 Aug 31 17:33:09.545570 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4044/8098] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:33:09 2022] GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016 => generated 1373 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:33:10.567801 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-098c0fbd-0440-4dc4-aec3-9165266b8732 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:33:10.568520 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-098c0fbd-0440-4dc4-aec3-9165266b8732 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: 978a6f77-1a3d-4920-84dc-c786aeec4016] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:33:10.575346 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-098c0fbd-0440-4dc4-aec3-9165266b8732 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:33:10.575876 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-098c0fbd-0440-4dc4-aec3-9165266b8732 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:33:10.576327 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-098c0fbd-0440-4dc4-aec3-9165266b8732 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:33:10.577030 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-098c0fbd-0440-4dc4-aec3-9165266b8732 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:33:10.577498 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-098c0fbd-0440-4dc4-aec3-9165266b8732 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:33:10.577940 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-098c0fbd-0440-4dc4-aec3-9165266b8732 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:33:10.711575 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-098c0fbd-0440-4dc4-aec3-9165266b8732 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:33:10.719675 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-098c0fbd-0440-4dc4-aec3-9165266b8732 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016" status: 200 len: 1373 microversion: 2.1 time: 0.157016 Aug 31 17:33:10.720275 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4055/8099] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:33:10 2022] GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016 => generated 1373 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:33:11.741010 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-52b8a34f-8e28-4fdd-87d7-5c98f2d1eb2f tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:33:11.741633 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-52b8a34f-8e28-4fdd-87d7-5c98f2d1eb2f tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: 978a6f77-1a3d-4920-84dc-c786aeec4016] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:33:11.744332 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=6 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:33:11.750481 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-52b8a34f-8e28-4fdd-87d7-5c98f2d1eb2f tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:33:11.751113 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-52b8a34f-8e28-4fdd-87d7-5c98f2d1eb2f tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:33:11.751583 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-52b8a34f-8e28-4fdd-87d7-5c98f2d1eb2f tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:33:11.752297 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-52b8a34f-8e28-4fdd-87d7-5c98f2d1eb2f tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:33:11.752761 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-52b8a34f-8e28-4fdd-87d7-5c98f2d1eb2f tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:33:11.753196 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-52b8a34f-8e28-4fdd-87d7-5c98f2d1eb2f tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:33:11.889986 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-52b8a34f-8e28-4fdd-87d7-5c98f2d1eb2f tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:33:11.899663 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-52b8a34f-8e28-4fdd-87d7-5c98f2d1eb2f tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016" status: 200 len: 1557 microversion: 2.1 time: 0.162585 Aug 31 17:33:11.900248 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4045/8100] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:33:11 2022] GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016 => generated 1557 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:33:11.921097 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-637dfbe3-5075-4dd3-a099-e001aa5fe240 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:33:11.922103 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-637dfbe3-5075-4dd3-a099-e001aa5fe240 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: 978a6f77-1a3d-4920-84dc-c786aeec4016] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:33:11.924224 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:33:11.924903 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=6 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:33:11.931646 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-637dfbe3-5075-4dd3-a099-e001aa5fe240 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:33:11.932145 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-637dfbe3-5075-4dd3-a099-e001aa5fe240 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:33:11.932592 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-637dfbe3-5075-4dd3-a099-e001aa5fe240 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:33:11.933298 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-637dfbe3-5075-4dd3-a099-e001aa5fe240 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:33:11.933768 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-637dfbe3-5075-4dd3-a099-e001aa5fe240 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:33:11.934209 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-637dfbe3-5075-4dd3-a099-e001aa5fe240 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:33:12.070496 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-637dfbe3-5075-4dd3-a099-e001aa5fe240 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:33:12.078582 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-637dfbe3-5075-4dd3-a099-e001aa5fe240 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016" status: 200 len: 1557 microversion: 2.1 time: 0.162043 Aug 31 17:33:12.079199 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4056/8101] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:33:11 2022] GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016 => generated 1557 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:33:14.121380 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-b9021f4e-86a7-44ba-9b62-986992db636b req-4512b22a-7255-4c1f-8fee-63642c885bf8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "978a6f77-1a3d-4920-84dc-c786aeec4016", "tag": "24b0ae69-a238-44af-822b-b4554d887bc4"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:33:14.132829 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-b9021f4e-86a7-44ba-9b62-986992db636b req-4512b22a-7255-4c1f-8fee-63642c885bf8 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:33:14.133618 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-b9021f4e-86a7-44ba-9b62-986992db636b req-4512b22a-7255-4c1f-8fee-63642c885bf8 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:33:14.134059 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-b9021f4e-86a7-44ba-9b62-986992db636b req-4512b22a-7255-4c1f-8fee-63642c885bf8 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:33:14.149406 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-b9021f4e-86a7-44ba-9b62-986992db636b req-4512b22a-7255-4c1f-8fee-63642c885bf8 service nova] Creating event network-changed:24b0ae69-a238-44af-822b-b4554d887bc4 for instance 978a6f77-1a3d-4920-84dc-c786aeec4016 on n-h2-850499-9 Aug 31 17:33:14.155915 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-b9021f4e-86a7-44ba-9b62-986992db636b req-4512b22a-7255-4c1f-8fee-63642c885bf8 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038040 Aug 31 17:33:14.157040 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4046/8102] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:33:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:35:50.812990 n-d-850499-9 devstack@n-api.service[122257]: ERROR oslo.messaging._drivers.impl_rabbit [-] [400e2b90-e189-478a-9cc4-4b0bfcefc34a] AMQP server on 10.222.0.61:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 31 17:35:50.814770 n-d-850499-9 devstack@n-api.service[122257]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8b198bdc-d1f7-4259-9144-ce56665d9587] AMQP server on 10.222.0.61:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 31 17:35:50.815649 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:35:50.816606 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=36 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:35:50.818089 n-d-850499-9 devstack@n-api.service[122257]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 31 17:35:50.818324 n-d-850499-9 devstack@n-api.service[122257]: Wed Aug 31 17:35:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016/action (ip 10.222.0.61) !!! Aug 31 17:35:50.820927 n-d-850499-9 devstack@n-api.service[122257]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 31 17:35:50.821059 n-d-850499-9 devstack@n-api.service[122257]: Wed Aug 31 17:35:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016/action (ip 10.222.0.61) !!! Aug 31 17:35:50.827890 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c7e029e1-f728-4b76-9e7e-8a7d437a9f6a tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:35:50.828439 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c7e029e1-f728-4b76-9e7e-8a7d437a9f6a tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: 978a6f77-1a3d-4920-84dc-c786aeec4016] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:35:50.841630 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c7e029e1-f728-4b76-9e7e-8a7d437a9f6a tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:35:50.842272 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c7e029e1-f728-4b76-9e7e-8a7d437a9f6a tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:35:50.842734 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c7e029e1-f728-4b76-9e7e-8a7d437a9f6a tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:35:50.843515 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c7e029e1-f728-4b76-9e7e-8a7d437a9f6a tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:35:50.844119 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c7e029e1-f728-4b76-9e7e-8a7d437a9f6a tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:35:50.844572 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c7e029e1-f728-4b76-9e7e-8a7d437a9f6a tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:35:50.869909 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-c7e029e1-f728-4b76-9e7e-8a7d437a9f6a tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lazy-loading 'flavor' on Instance uuid 978a6f77-1a3d-4920-84dc-c786aeec4016 {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 17:35:51.055929 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c7e029e1-f728-4b76-9e7e-8a7d437a9f6a tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "POST /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016/action" status: 202 len: 0 microversion: 2.1 time: 0.244485 Aug 31 17:35:51.056566 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4057/8103] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 17:35:50 2022] POST /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016/action => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 17:35:51.064100 n-d-850499-9 devstack@n-api.service[122256]: ERROR oslo.messaging._drivers.impl_rabbit [-] [46519162-dc0d-41cb-af5d-7b19f3bd0573] AMQP server on 10.222.0.61:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 31 17:35:51.065219 n-d-850499-9 devstack@n-api.service[122256]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0cd6dd6f-a50d-4cf4-8d95-237d76a72b0e] AMQP server on 10.222.0.61:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 31 17:35:51.066108 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:35:51.066847 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=32 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:35:51.067877 n-d-850499-9 devstack@n-api.service[122256]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 31 17:35:51.068066 n-d-850499-9 devstack@n-api.service[122256]: Wed Aug 31 17:35:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016 (ip 10.222.0.61) !!! Aug 31 17:35:51.069349 n-d-850499-9 devstack@n-api.service[122256]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 31 17:35:51.069478 n-d-850499-9 devstack@n-api.service[122256]: Wed Aug 31 17:35:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016 (ip 10.222.0.61) !!! Aug 31 17:35:51.070552 n-d-850499-9 devstack@n-api.service[122256]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 31 17:35:51.070678 n-d-850499-9 devstack@n-api.service[122256]: Wed Aug 31 17:35:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016 (ip 10.222.0.61) !!! Aug 31 17:35:51.077015 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c463441b-ac4d-4365-b329-c6019e08f348 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:35:51.077768 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c463441b-ac4d-4365-b329-c6019e08f348 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: 978a6f77-1a3d-4920-84dc-c786aeec4016] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:35:51.090031 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c463441b-ac4d-4365-b329-c6019e08f348 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:35:51.090525 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c463441b-ac4d-4365-b329-c6019e08f348 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:35:51.090975 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c463441b-ac4d-4365-b329-c6019e08f348 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:35:51.091693 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c463441b-ac4d-4365-b329-c6019e08f348 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:35:51.092152 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c463441b-ac4d-4365-b329-c6019e08f348 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:35:51.092578 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c463441b-ac4d-4365-b329-c6019e08f348 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:35:51.233525 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c463441b-ac4d-4365-b329-c6019e08f348 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:35:51.241515 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c463441b-ac4d-4365-b329-c6019e08f348 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016" status: 200 len: 1681 microversion: 2.1 time: 0.180211 Aug 31 17:35:51.242098 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4047/8104] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:35:51 2022] GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016 => generated 1681 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:35:52.265547 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-abcefe80-00d4-4b2e-a880-8a815f7bf4e7 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:35:52.266275 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-abcefe80-00d4-4b2e-a880-8a815f7bf4e7 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: 978a6f77-1a3d-4920-84dc-c786aeec4016] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:35:52.276394 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-abcefe80-00d4-4b2e-a880-8a815f7bf4e7 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:35:52.276904 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-abcefe80-00d4-4b2e-a880-8a815f7bf4e7 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:35:52.277366 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-abcefe80-00d4-4b2e-a880-8a815f7bf4e7 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:35:52.278091 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-abcefe80-00d4-4b2e-a880-8a815f7bf4e7 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:35:52.278576 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-abcefe80-00d4-4b2e-a880-8a815f7bf4e7 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:35:52.279026 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-abcefe80-00d4-4b2e-a880-8a815f7bf4e7 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:35:52.285791 n-d-850499-9 devstack@n-api.service[122257]: INFO oslo.messaging._drivers.impl_rabbit [-] [8b198bdc-d1f7-4259-9144-ce56665d9587] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 40812. Aug 31 17:35:52.296139 n-d-850499-9 devstack@n-api.service[122257]: INFO oslo.messaging._drivers.impl_rabbit [-] [400e2b90-e189-478a-9cc4-4b0bfcefc34a] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 40810. Aug 31 17:35:52.422634 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-abcefe80-00d4-4b2e-a880-8a815f7bf4e7 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:35:52.430563 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-abcefe80-00d4-4b2e-a880-8a815f7bf4e7 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016" status: 200 len: 1681 microversion: 2.1 time: 0.170913 Aug 31 17:35:52.431148 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4058/8105] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:35:52 2022] GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016 => generated 1681 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:35:53.452243 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-08ac9eee-99bb-46ee-989e-b60f30167c3d tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:35:53.452860 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-08ac9eee-99bb-46ee-989e-b60f30167c3d tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: 978a6f77-1a3d-4920-84dc-c786aeec4016] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:35:53.462826 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-08ac9eee-99bb-46ee-989e-b60f30167c3d tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:35:53.463334 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-08ac9eee-99bb-46ee-989e-b60f30167c3d tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:35:53.463803 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-08ac9eee-99bb-46ee-989e-b60f30167c3d tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:35:53.464522 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-08ac9eee-99bb-46ee-989e-b60f30167c3d tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:35:53.464991 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-08ac9eee-99bb-46ee-989e-b60f30167c3d tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:35:53.465495 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-08ac9eee-99bb-46ee-989e-b60f30167c3d tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:35:53.472570 n-d-850499-9 devstack@n-api.service[122256]: INFO oslo.messaging._drivers.impl_rabbit [-] [46519162-dc0d-41cb-af5d-7b19f3bd0573] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 40816. Aug 31 17:35:53.484055 n-d-850499-9 devstack@n-api.service[122256]: INFO oslo.messaging._drivers.impl_rabbit [-] [0cd6dd6f-a50d-4cf4-8d95-237d76a72b0e] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 40818. Aug 31 17:35:53.608975 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-08ac9eee-99bb-46ee-989e-b60f30167c3d tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:35:53.618416 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-08ac9eee-99bb-46ee-989e-b60f30167c3d tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016" status: 200 len: 1681 microversion: 2.1 time: 0.170035 Aug 31 17:35:53.619017 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4048/8106] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:35:53 2022] GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016 => generated 1681 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:35:54.639947 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7fac9a30-0995-4084-86ef-20dd3aeed12c tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:35:54.640872 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7fac9a30-0995-4084-86ef-20dd3aeed12c tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: 978a6f77-1a3d-4920-84dc-c786aeec4016] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:35:54.650708 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7fac9a30-0995-4084-86ef-20dd3aeed12c tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:35:54.651325 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7fac9a30-0995-4084-86ef-20dd3aeed12c tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:35:54.651835 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7fac9a30-0995-4084-86ef-20dd3aeed12c tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:35:54.652585 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7fac9a30-0995-4084-86ef-20dd3aeed12c tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:35:54.653074 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7fac9a30-0995-4084-86ef-20dd3aeed12c tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:35:54.653554 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7fac9a30-0995-4084-86ef-20dd3aeed12c tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:35:54.795936 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7fac9a30-0995-4084-86ef-20dd3aeed12c tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:35:54.804110 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7fac9a30-0995-4084-86ef-20dd3aeed12c tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016" status: 200 len: 1681 microversion: 2.1 time: 0.168584 Aug 31 17:35:54.804685 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4059/8107] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:35:54 2022] GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016 => generated 1681 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:35:55.826183 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-11059fb3-dc10-4fd4-b817-693514f2e7c8 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:35:55.826799 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-11059fb3-dc10-4fd4-b817-693514f2e7c8 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: 978a6f77-1a3d-4920-84dc-c786aeec4016] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:35:55.833790 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-11059fb3-dc10-4fd4-b817-693514f2e7c8 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:35:55.834280 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-11059fb3-dc10-4fd4-b817-693514f2e7c8 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:35:55.834777 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-11059fb3-dc10-4fd4-b817-693514f2e7c8 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:35:55.835426 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-11059fb3-dc10-4fd4-b817-693514f2e7c8 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:35:55.835910 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-11059fb3-dc10-4fd4-b817-693514f2e7c8 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:35:55.836338 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-11059fb3-dc10-4fd4-b817-693514f2e7c8 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:35:55.969719 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-11059fb3-dc10-4fd4-b817-693514f2e7c8 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:35:55.978278 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-11059fb3-dc10-4fd4-b817-693514f2e7c8 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016" status: 200 len: 1681 microversion: 2.1 time: 0.156070 Aug 31 17:35:55.978850 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4049/8108] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:35:55 2022] GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:35:57.000519 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c2705a7a-64ed-45c5-95bd-2fddb875a6f1 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:35:57.001446 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c2705a7a-64ed-45c5-95bd-2fddb875a6f1 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: 978a6f77-1a3d-4920-84dc-c786aeec4016] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:35:57.009697 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c2705a7a-64ed-45c5-95bd-2fddb875a6f1 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:35:57.010216 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c2705a7a-64ed-45c5-95bd-2fddb875a6f1 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:35:57.011467 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c2705a7a-64ed-45c5-95bd-2fddb875a6f1 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:35:57.012232 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c2705a7a-64ed-45c5-95bd-2fddb875a6f1 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:35:57.012855 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c2705a7a-64ed-45c5-95bd-2fddb875a6f1 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:35:57.013807 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c2705a7a-64ed-45c5-95bd-2fddb875a6f1 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:35:57.246703 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c2705a7a-64ed-45c5-95bd-2fddb875a6f1 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:35:57.254906 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c2705a7a-64ed-45c5-95bd-2fddb875a6f1 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016" status: 200 len: 1681 microversion: 2.1 time: 0.259382 Aug 31 17:35:57.255423 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4060/8109] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:35:56 2022] GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016 => generated 1681 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:35:58.276647 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1d664844-9026-4945-873c-ffb9db37a87a tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:35:58.277268 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1d664844-9026-4945-873c-ffb9db37a87a tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: 978a6f77-1a3d-4920-84dc-c786aeec4016] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:35:58.284538 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1d664844-9026-4945-873c-ffb9db37a87a tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:35:58.285031 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1d664844-9026-4945-873c-ffb9db37a87a tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:35:58.285475 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1d664844-9026-4945-873c-ffb9db37a87a tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:35:58.286788 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1d664844-9026-4945-873c-ffb9db37a87a tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:35:58.287258 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1d664844-9026-4945-873c-ffb9db37a87a tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:35:58.287728 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1d664844-9026-4945-873c-ffb9db37a87a tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:35:58.475359 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1d664844-9026-4945-873c-ffb9db37a87a tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:35:58.483293 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1d664844-9026-4945-873c-ffb9db37a87a tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016" status: 200 len: 1681 microversion: 2.1 time: 0.210658 Aug 31 17:35:58.483900 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4050/8110] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:35:58 2022] GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016 => generated 1681 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:35:59.505948 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-cef817a8-bf48-41ab-b599-104f3a82261e tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:35:59.506621 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-cef817a8-bf48-41ab-b599-104f3a82261e tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: 978a6f77-1a3d-4920-84dc-c786aeec4016] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:35:59.513573 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cef817a8-bf48-41ab-b599-104f3a82261e tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:35:59.514074 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cef817a8-bf48-41ab-b599-104f3a82261e tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:35:59.514527 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cef817a8-bf48-41ab-b599-104f3a82261e tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:35:59.515233 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cef817a8-bf48-41ab-b599-104f3a82261e tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:35:59.515744 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cef817a8-bf48-41ab-b599-104f3a82261e tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:35:59.516191 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cef817a8-bf48-41ab-b599-104f3a82261e tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:35:59.653494 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-cef817a8-bf48-41ab-b599-104f3a82261e tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:35:59.662711 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-cef817a8-bf48-41ab-b599-104f3a82261e tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016" status: 200 len: 1681 microversion: 2.1 time: 0.161757 Aug 31 17:35:59.663298 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4061/8111] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:35:59 2022] GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016 => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:36:00.684464 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1d0fa0a2-31a8-4e97-b4c1-9169d9dbe376 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:36:00.685110 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1d0fa0a2-31a8-4e97-b4c1-9169d9dbe376 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: 978a6f77-1a3d-4920-84dc-c786aeec4016] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:36:00.692424 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1d0fa0a2-31a8-4e97-b4c1-9169d9dbe376 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:36:00.693169 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1d0fa0a2-31a8-4e97-b4c1-9169d9dbe376 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:36:00.693618 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1d0fa0a2-31a8-4e97-b4c1-9169d9dbe376 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:36:00.694324 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1d0fa0a2-31a8-4e97-b4c1-9169d9dbe376 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:36:00.694813 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1d0fa0a2-31a8-4e97-b4c1-9169d9dbe376 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:36:00.695249 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1d0fa0a2-31a8-4e97-b4c1-9169d9dbe376 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:36:00.831418 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1d0fa0a2-31a8-4e97-b4c1-9169d9dbe376 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:36:00.840030 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1d0fa0a2-31a8-4e97-b4c1-9169d9dbe376 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016" status: 200 len: 1681 microversion: 2.1 time: 0.159793 Aug 31 17:36:00.840611 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4051/8112] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:36:00 2022] GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016 => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:36:01.861232 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-eeea7b3b-40db-4aab-a852-ac1b4fdb402e tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:36:01.861863 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-eeea7b3b-40db-4aab-a852-ac1b4fdb402e tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: 978a6f77-1a3d-4920-84dc-c786aeec4016] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:36:01.869635 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eeea7b3b-40db-4aab-a852-ac1b4fdb402e tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:36:01.870140 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eeea7b3b-40db-4aab-a852-ac1b4fdb402e tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:36:01.870626 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eeea7b3b-40db-4aab-a852-ac1b4fdb402e tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:36:01.871369 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eeea7b3b-40db-4aab-a852-ac1b4fdb402e tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:36:01.871869 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eeea7b3b-40db-4aab-a852-ac1b4fdb402e tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:36:01.872333 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-eeea7b3b-40db-4aab-a852-ac1b4fdb402e tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:36:02.019790 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-eeea7b3b-40db-4aab-a852-ac1b4fdb402e tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:36:02.028185 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-eeea7b3b-40db-4aab-a852-ac1b4fdb402e tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016" status: 200 len: 1681 microversion: 2.1 time: 0.170912 Aug 31 17:36:02.028761 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4062/8113] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:36:01 2022] GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016 => generated 1681 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:36:03.050093 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f660136c-a09c-4d5f-9064-4fb3cb6a2812 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:36:03.050721 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f660136c-a09c-4d5f-9064-4fb3cb6a2812 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: 978a6f77-1a3d-4920-84dc-c786aeec4016] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:36:03.058992 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f660136c-a09c-4d5f-9064-4fb3cb6a2812 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:36:03.059493 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f660136c-a09c-4d5f-9064-4fb3cb6a2812 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:36:03.059964 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f660136c-a09c-4d5f-9064-4fb3cb6a2812 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:36:03.060669 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f660136c-a09c-4d5f-9064-4fb3cb6a2812 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:36:03.061156 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f660136c-a09c-4d5f-9064-4fb3cb6a2812 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:36:03.061586 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f660136c-a09c-4d5f-9064-4fb3cb6a2812 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:36:03.204164 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f660136c-a09c-4d5f-9064-4fb3cb6a2812 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:36:03.213278 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f660136c-a09c-4d5f-9064-4fb3cb6a2812 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016" status: 200 len: 1702 microversion: 2.1 time: 0.167073 Aug 31 17:36:03.213869 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4052/8114] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:36:03 2022] GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016 => generated 1702 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:36:04.235768 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-17e1e91e-5165-498a-bfc4-654a6de36078 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:36:04.236344 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-17e1e91e-5165-498a-bfc4-654a6de36078 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: 978a6f77-1a3d-4920-84dc-c786aeec4016] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:36:04.243199 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-17e1e91e-5165-498a-bfc4-654a6de36078 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:36:04.243742 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-17e1e91e-5165-498a-bfc4-654a6de36078 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:36:04.244200 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-17e1e91e-5165-498a-bfc4-654a6de36078 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:36:04.244905 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-17e1e91e-5165-498a-bfc4-654a6de36078 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:36:04.245377 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-17e1e91e-5165-498a-bfc4-654a6de36078 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:36:04.245819 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-17e1e91e-5165-498a-bfc4-654a6de36078 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:36:04.377996 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-17e1e91e-5165-498a-bfc4-654a6de36078 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:36:04.386578 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-17e1e91e-5165-498a-bfc4-654a6de36078 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016" status: 200 len: 1702 microversion: 2.1 time: 0.154777 Aug 31 17:36:04.387169 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4063/8115] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:36:04 2022] GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016 => generated 1702 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 17:36:05.410047 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0aa2528d-2b8a-4e82-95ad-fd2c685e7b11 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:36:05.410669 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0aa2528d-2b8a-4e82-95ad-fd2c685e7b11 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: 978a6f77-1a3d-4920-84dc-c786aeec4016] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:36:05.418182 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0aa2528d-2b8a-4e82-95ad-fd2c685e7b11 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:36:05.418674 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0aa2528d-2b8a-4e82-95ad-fd2c685e7b11 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:36:05.419122 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0aa2528d-2b8a-4e82-95ad-fd2c685e7b11 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:36:05.419865 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0aa2528d-2b8a-4e82-95ad-fd2c685e7b11 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:36:05.420331 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0aa2528d-2b8a-4e82-95ad-fd2c685e7b11 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:36:05.420762 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0aa2528d-2b8a-4e82-95ad-fd2c685e7b11 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:36:05.555706 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-0aa2528d-2b8a-4e82-95ad-fd2c685e7b11 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:36:05.563961 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0aa2528d-2b8a-4e82-95ad-fd2c685e7b11 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016" status: 200 len: 1702 microversion: 2.1 time: 0.159570 Aug 31 17:36:05.564542 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4053/8116] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:36:05 2022] GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016 => generated 1702 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:36:06.585507 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-09b6f3ae-b01d-49ac-8678-2af659f717c1 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:36:06.586128 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-09b6f3ae-b01d-49ac-8678-2af659f717c1 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: 978a6f77-1a3d-4920-84dc-c786aeec4016] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:36:06.592981 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-09b6f3ae-b01d-49ac-8678-2af659f717c1 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:36:06.593479 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-09b6f3ae-b01d-49ac-8678-2af659f717c1 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:36:06.593931 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-09b6f3ae-b01d-49ac-8678-2af659f717c1 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:36:06.594633 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-09b6f3ae-b01d-49ac-8678-2af659f717c1 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:36:06.595100 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-09b6f3ae-b01d-49ac-8678-2af659f717c1 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:36:06.595593 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-09b6f3ae-b01d-49ac-8678-2af659f717c1 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:36:06.742403 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-09b6f3ae-b01d-49ac-8678-2af659f717c1 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:36:06.750455 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-09b6f3ae-b01d-49ac-8678-2af659f717c1 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016" status: 200 len: 1702 microversion: 2.1 time: 0.169422 Aug 31 17:36:06.751039 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4064/8117] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:36:06 2022] GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016 => generated 1702 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:36:07.773387 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-69113af5-3750-46d6-a4d7-9ca71f633f8d tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:36:07.774008 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-69113af5-3750-46d6-a4d7-9ca71f633f8d tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: 978a6f77-1a3d-4920-84dc-c786aeec4016] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:36:07.781139 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-69113af5-3750-46d6-a4d7-9ca71f633f8d tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:36:07.781633 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-69113af5-3750-46d6-a4d7-9ca71f633f8d tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:36:07.782078 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-69113af5-3750-46d6-a4d7-9ca71f633f8d tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:36:07.782778 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-69113af5-3750-46d6-a4d7-9ca71f633f8d tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:36:07.783240 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-69113af5-3750-46d6-a4d7-9ca71f633f8d tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:36:07.783716 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-69113af5-3750-46d6-a4d7-9ca71f633f8d tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:36:07.917630 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-69113af5-3750-46d6-a4d7-9ca71f633f8d tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:36:07.925374 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-69113af5-3750-46d6-a4d7-9ca71f633f8d tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016" status: 200 len: 1702 microversion: 2.1 time: 0.156585 Aug 31 17:36:07.925946 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4054/8118] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:36:07 2022] GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016 => generated 1702 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:36:08.509290 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-35951c81-9e12-4eff-97e6-2f91fee48b54 req-4f012aba-d1fc-443d-9a80-5a6c72b21640 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "978a6f77-1a3d-4920-84dc-c786aeec4016", "name": "network-vif-plugged", "status": "completed", "tag": "24b0ae69-a238-44af-822b-b4554d887bc4"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:36:08.519778 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-35951c81-9e12-4eff-97e6-2f91fee48b54 req-4f012aba-d1fc-443d-9a80-5a6c72b21640 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:36:08.520279 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-35951c81-9e12-4eff-97e6-2f91fee48b54 req-4f012aba-d1fc-443d-9a80-5a6c72b21640 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:36:08.520729 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-35951c81-9e12-4eff-97e6-2f91fee48b54 req-4f012aba-d1fc-443d-9a80-5a6c72b21640 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:36:08.532966 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-35951c81-9e12-4eff-97e6-2f91fee48b54 req-4f012aba-d1fc-443d-9a80-5a6c72b21640 service nova] Creating event network-vif-plugged:24b0ae69-a238-44af-822b-b4554d887bc4 for instance 978a6f77-1a3d-4920-84dc-c786aeec4016 on n-h2-850499-9 Aug 31 17:36:08.538903 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-35951c81-9e12-4eff-97e6-2f91fee48b54 req-4f012aba-d1fc-443d-9a80-5a6c72b21640 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090330 Aug 31 17:36:08.539555 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4065/8119] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:36:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:36:08.949377 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9e9342d0-0395-4a95-a500-de5741a00b34 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:36:08.950088 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9e9342d0-0395-4a95-a500-de5741a00b34 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: 978a6f77-1a3d-4920-84dc-c786aeec4016] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:36:08.958614 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9e9342d0-0395-4a95-a500-de5741a00b34 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:36:08.959198 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9e9342d0-0395-4a95-a500-de5741a00b34 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:36:08.959700 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9e9342d0-0395-4a95-a500-de5741a00b34 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:36:08.960470 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9e9342d0-0395-4a95-a500-de5741a00b34 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:36:08.960925 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9e9342d0-0395-4a95-a500-de5741a00b34 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:36:08.961349 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9e9342d0-0395-4a95-a500-de5741a00b34 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:36:09.139752 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-9e9342d0-0395-4a95-a500-de5741a00b34 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:36:09.149048 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9e9342d0-0395-4a95-a500-de5741a00b34 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016" status: 200 len: 1697 microversion: 2.1 time: 0.205355 Aug 31 17:36:09.149048 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4055/8120] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:36:08 2022] GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016 => generated 1697 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:36:10.171935 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-70553b80-f036-486e-b436-f0656e2a1a9e tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:36:10.173379 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-70553b80-f036-486e-b436-f0656e2a1a9e tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: 978a6f77-1a3d-4920-84dc-c786aeec4016] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:36:10.184136 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-70553b80-f036-486e-b436-f0656e2a1a9e tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:36:10.185040 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-70553b80-f036-486e-b436-f0656e2a1a9e tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:36:10.185621 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-70553b80-f036-486e-b436-f0656e2a1a9e tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:36:10.186607 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-70553b80-f036-486e-b436-f0656e2a1a9e tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:36:10.187323 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-70553b80-f036-486e-b436-f0656e2a1a9e tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:36:10.187913 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-70553b80-f036-486e-b436-f0656e2a1a9e tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:36:10.336472 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-70553b80-f036-486e-b436-f0656e2a1a9e tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:36:10.344762 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-70553b80-f036-486e-b436-f0656e2a1a9e tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016" status: 200 len: 1697 microversion: 2.1 time: 0.178096 Aug 31 17:36:10.345339 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4066/8121] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:36:10 2022] GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016 => generated 1697 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:36:11.369045 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-396319bd-8cce-4b4e-825e-18081d39faf2 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:36:11.370525 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-396319bd-8cce-4b4e-825e-18081d39faf2 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: 978a6f77-1a3d-4920-84dc-c786aeec4016] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:36:11.380584 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-396319bd-8cce-4b4e-825e-18081d39faf2 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:36:11.381285 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-396319bd-8cce-4b4e-825e-18081d39faf2 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:36:11.382060 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-396319bd-8cce-4b4e-825e-18081d39faf2 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:36:11.382956 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-396319bd-8cce-4b4e-825e-18081d39faf2 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:36:11.383432 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-396319bd-8cce-4b4e-825e-18081d39faf2 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:36:11.383898 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-396319bd-8cce-4b4e-825e-18081d39faf2 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:36:11.573950 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-396319bd-8cce-4b4e-825e-18081d39faf2 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:36:11.596747 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-396319bd-8cce-4b4e-825e-18081d39faf2 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016" status: 200 len: 1697 microversion: 2.1 time: 0.232594 Aug 31 17:36:11.597693 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4056/8122] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:36:11 2022] GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016 => generated 1697 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:36:12.627376 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-701df35d-4969-435a-9c94-0f6ebc22c871 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:36:12.628067 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-701df35d-4969-435a-9c94-0f6ebc22c871 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: 978a6f77-1a3d-4920-84dc-c786aeec4016] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:36:12.636471 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-701df35d-4969-435a-9c94-0f6ebc22c871 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:36:12.637273 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-701df35d-4969-435a-9c94-0f6ebc22c871 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:36:12.637734 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-701df35d-4969-435a-9c94-0f6ebc22c871 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:36:12.638464 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-701df35d-4969-435a-9c94-0f6ebc22c871 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:36:12.639117 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-701df35d-4969-435a-9c94-0f6ebc22c871 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:36:12.639595 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-701df35d-4969-435a-9c94-0f6ebc22c871 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:36:12.820850 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-701df35d-4969-435a-9c94-0f6ebc22c871 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:36:12.830078 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-701df35d-4969-435a-9c94-0f6ebc22c871 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016" status: 200 len: 1697 microversion: 2.1 time: 0.207263 Aug 31 17:36:12.830705 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4067/8123] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:36:12 2022] GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016 => generated 1697 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:36:13.858349 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a8ac5acc-65c5-48f9-b9e5-201dceb738d2 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:36:13.859062 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a8ac5acc-65c5-48f9-b9e5-201dceb738d2 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: 978a6f77-1a3d-4920-84dc-c786aeec4016] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:36:13.867734 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a8ac5acc-65c5-48f9-b9e5-201dceb738d2 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:36:13.868223 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a8ac5acc-65c5-48f9-b9e5-201dceb738d2 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:36:13.868880 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a8ac5acc-65c5-48f9-b9e5-201dceb738d2 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:36:13.869956 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a8ac5acc-65c5-48f9-b9e5-201dceb738d2 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:36:13.870687 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a8ac5acc-65c5-48f9-b9e5-201dceb738d2 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:36:13.871166 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a8ac5acc-65c5-48f9-b9e5-201dceb738d2 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:36:14.086177 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a8ac5acc-65c5-48f9-b9e5-201dceb738d2 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:36:14.097139 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a8ac5acc-65c5-48f9-b9e5-201dceb738d2 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016" status: 200 len: 1697 microversion: 2.1 time: 0.246258 Aug 31 17:36:14.097771 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4057/8124] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:36:13 2022] GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016 => generated 1697 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:36:15.123181 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-78433312-fbd6-4ac7-baad-50e7c0dfee68 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:36:15.123798 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-78433312-fbd6-4ac7-baad-50e7c0dfee68 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: 978a6f77-1a3d-4920-84dc-c786aeec4016] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:36:15.132167 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-78433312-fbd6-4ac7-baad-50e7c0dfee68 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:36:15.133638 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-78433312-fbd6-4ac7-baad-50e7c0dfee68 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:36:15.134141 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-78433312-fbd6-4ac7-baad-50e7c0dfee68 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:36:15.134976 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-78433312-fbd6-4ac7-baad-50e7c0dfee68 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:36:15.135476 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-78433312-fbd6-4ac7-baad-50e7c0dfee68 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:36:15.136599 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-78433312-fbd6-4ac7-baad-50e7c0dfee68 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:36:15.317480 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-78433312-fbd6-4ac7-baad-50e7c0dfee68 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:36:15.330328 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-78433312-fbd6-4ac7-baad-50e7c0dfee68 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016" status: 200 len: 1697 microversion: 2.1 time: 0.212185 Aug 31 17:36:15.330926 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4068/8125] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:36:15 2022] GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016 => generated 1697 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:36:16.357931 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6fb45109-ff38-4cd7-bd3c-1e7d364af7e2 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:36:16.358746 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6fb45109-ff38-4cd7-bd3c-1e7d364af7e2 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: 978a6f77-1a3d-4920-84dc-c786aeec4016] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:36:16.367208 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6fb45109-ff38-4cd7-bd3c-1e7d364af7e2 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:36:16.367741 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6fb45109-ff38-4cd7-bd3c-1e7d364af7e2 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:36:16.368196 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6fb45109-ff38-4cd7-bd3c-1e7d364af7e2 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:36:16.368901 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6fb45109-ff38-4cd7-bd3c-1e7d364af7e2 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:36:16.369359 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6fb45109-ff38-4cd7-bd3c-1e7d364af7e2 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:36:16.369786 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6fb45109-ff38-4cd7-bd3c-1e7d364af7e2 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:36:16.552220 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-6fb45109-ff38-4cd7-bd3c-1e7d364af7e2 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:36:16.567063 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6fb45109-ff38-4cd7-bd3c-1e7d364af7e2 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016" status: 200 len: 1697 microversion: 2.1 time: 0.213060 Aug 31 17:36:16.568502 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4058/8126] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:36:16 2022] GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016 => generated 1697 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:36:17.590163 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-13b4873f-a509-4682-9a6f-a5da03afcad7 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:36:17.590846 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-13b4873f-a509-4682-9a6f-a5da03afcad7 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: 978a6f77-1a3d-4920-84dc-c786aeec4016] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:36:17.598322 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-13b4873f-a509-4682-9a6f-a5da03afcad7 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:36:17.598846 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-13b4873f-a509-4682-9a6f-a5da03afcad7 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:36:17.599309 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-13b4873f-a509-4682-9a6f-a5da03afcad7 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:36:17.600568 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-13b4873f-a509-4682-9a6f-a5da03afcad7 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:36:17.600986 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-13b4873f-a509-4682-9a6f-a5da03afcad7 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:36:17.601441 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-13b4873f-a509-4682-9a6f-a5da03afcad7 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:36:17.780897 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-13b4873f-a509-4682-9a6f-a5da03afcad7 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:36:17.790558 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-13b4873f-a509-4682-9a6f-a5da03afcad7 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016" status: 200 len: 1697 microversion: 2.1 time: 0.204216 Aug 31 17:36:17.791167 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4069/8127] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:36:17 2022] GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016 => generated 1697 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 17:36:18.813494 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ec3c38ab-0562-4203-afd6-5727cdbe40a4 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:36:18.814115 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ec3c38ab-0562-4203-afd6-5727cdbe40a4 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: 978a6f77-1a3d-4920-84dc-c786aeec4016] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:36:18.822505 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ec3c38ab-0562-4203-afd6-5727cdbe40a4 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:36:18.823007 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ec3c38ab-0562-4203-afd6-5727cdbe40a4 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:36:18.823449 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ec3c38ab-0562-4203-afd6-5727cdbe40a4 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:36:18.824200 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ec3c38ab-0562-4203-afd6-5727cdbe40a4 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:36:18.824656 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ec3c38ab-0562-4203-afd6-5727cdbe40a4 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:36:18.825085 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ec3c38ab-0562-4203-afd6-5727cdbe40a4 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:36:18.959420 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ec3c38ab-0562-4203-afd6-5727cdbe40a4 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:36:18.966950 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ec3c38ab-0562-4203-afd6-5727cdbe40a4 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016" status: 200 len: 1697 microversion: 2.1 time: 0.157410 Aug 31 17:36:18.967550 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4059/8128] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:36:18 2022] GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016 => generated 1697 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:36:19.989185 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-864f03af-f544-4ff0-814c-29c3eaa27738 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:36:19.989813 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-864f03af-f544-4ff0-814c-29c3eaa27738 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: 978a6f77-1a3d-4920-84dc-c786aeec4016] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:36:19.996935 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-864f03af-f544-4ff0-814c-29c3eaa27738 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:36:19.997442 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-864f03af-f544-4ff0-814c-29c3eaa27738 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:36:19.997895 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-864f03af-f544-4ff0-814c-29c3eaa27738 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:36:19.998610 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-864f03af-f544-4ff0-814c-29c3eaa27738 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:36:19.999087 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-864f03af-f544-4ff0-814c-29c3eaa27738 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:36:19.999568 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-864f03af-f544-4ff0-814c-29c3eaa27738 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:36:20.132522 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-864f03af-f544-4ff0-814c-29c3eaa27738 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:36:20.140468 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-864f03af-f544-4ff0-814c-29c3eaa27738 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016" status: 200 len: 1679 microversion: 2.1 time: 0.155252 Aug 31 17:36:20.140990 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4070/8129] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:36:19 2022] GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:36:21.168718 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-106dd58e-a158-4829-8fa9-b940d9e14378 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:36:21.169276 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-106dd58e-a158-4829-8fa9-b940d9e14378 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: 978a6f77-1a3d-4920-84dc-c786aeec4016] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:36:21.172089 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=27 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:36:21.178115 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-106dd58e-a158-4829-8fa9-b940d9e14378 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:36:21.178692 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-106dd58e-a158-4829-8fa9-b940d9e14378 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:36:21.179121 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-106dd58e-a158-4829-8fa9-b940d9e14378 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:36:21.179853 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-106dd58e-a158-4829-8fa9-b940d9e14378 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:36:21.180331 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-106dd58e-a158-4829-8fa9-b940d9e14378 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:36:21.180785 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-106dd58e-a158-4829-8fa9-b940d9e14378 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:36:21.184039 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=79 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:36:21.322002 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-106dd58e-a158-4829-8fa9-b940d9e14378 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:36:21.330022 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-106dd58e-a158-4829-8fa9-b940d9e14378 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016" status: 200 len: 1679 microversion: 2.1 time: 0.165486 Aug 31 17:36:21.330608 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4060/8130] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:36:21 2022] GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016 => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:36:22.352235 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9531be3a-4bb4-48d7-924f-c9ceaaec378b tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:36:22.352869 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9531be3a-4bb4-48d7-924f-c9ceaaec378b tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: 978a6f77-1a3d-4920-84dc-c786aeec4016] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:36:22.355182 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=29 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:36:22.360844 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9531be3a-4bb4-48d7-924f-c9ceaaec378b tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:36:22.361340 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9531be3a-4bb4-48d7-924f-c9ceaaec378b tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:36:22.361803 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9531be3a-4bb4-48d7-924f-c9ceaaec378b tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:36:22.362537 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9531be3a-4bb4-48d7-924f-c9ceaaec378b tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:36:22.363022 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9531be3a-4bb4-48d7-924f-c9ceaaec378b tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:36:22.363472 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9531be3a-4bb4-48d7-924f-c9ceaaec378b tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:36:22.366468 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:36:22.478089 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-ac697e8d-f0ad-4ef3-a2f1-1e0f93089198 req-6cf0eb6d-a2b2-48a4-9bdd-b0cca85f7db3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "978a6f77-1a3d-4920-84dc-c786aeec4016", "name": "network-vif-unplugged", "status": "completed", "tag": "24b0ae69-a238-44af-822b-b4554d887bc4"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:36:22.488546 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-ac697e8d-f0ad-4ef3-a2f1-1e0f93089198 req-6cf0eb6d-a2b2-48a4-9bdd-b0cca85f7db3 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:36:22.489111 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-ac697e8d-f0ad-4ef3-a2f1-1e0f93089198 req-6cf0eb6d-a2b2-48a4-9bdd-b0cca85f7db3 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:36:22.489612 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-ac697e8d-f0ad-4ef3-a2f1-1e0f93089198 req-6cf0eb6d-a2b2-48a4-9bdd-b0cca85f7db3 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:36:22.502048 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.compute.server_external_events [req-ac697e8d-f0ad-4ef3-a2f1-1e0f93089198 req-6cf0eb6d-a2b2-48a4-9bdd-b0cca85f7db3 service nova] Unable to find a host for instance 978a6f77-1a3d-4920-84dc-c786aeec4016. Dropping event network-vif-unplugged {{(pid=122256) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 31 17:36:22.502943 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-ac697e8d-f0ad-4ef3-a2f1-1e0f93089198 req-6cf0eb6d-a2b2-48a4-9bdd-b0cca85f7db3 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029803 Aug 31 17:36:22.503908 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4061/8131] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:36:22 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 31 17:36:22.505129 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9531be3a-4bb4-48d7-924f-c9ceaaec378b tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:36:22.513983 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9531be3a-4bb4-48d7-924f-c9ceaaec378b tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016" status: 200 len: 1622 microversion: 2.1 time: 0.166526 Aug 31 17:36:22.514725 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4071/8132] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:36:22 2022] GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016 => generated 1622 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:36:22.534959 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1d2ae7d8-0027-4df1-89c6-0ba9e97c227e tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:36:22.535614 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1d2ae7d8-0027-4df1-89c6-0ba9e97c227e tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: 978a6f77-1a3d-4920-84dc-c786aeec4016] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:36:22.542316 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1d2ae7d8-0027-4df1-89c6-0ba9e97c227e tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:36:22.542820 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1d2ae7d8-0027-4df1-89c6-0ba9e97c227e tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:36:22.543264 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1d2ae7d8-0027-4df1-89c6-0ba9e97c227e tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:36:22.544005 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1d2ae7d8-0027-4df1-89c6-0ba9e97c227e tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:36:22.544479 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1d2ae7d8-0027-4df1-89c6-0ba9e97c227e tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:36:22.544905 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1d2ae7d8-0027-4df1-89c6-0ba9e97c227e tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:36:22.633184 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1d2ae7d8-0027-4df1-89c6-0ba9e97c227e tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: 978a6f77-1a3d-4920-84dc-c786aeec4016] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122256) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 31 17:36:22.702688 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1d2ae7d8-0027-4df1-89c6-0ba9e97c227e tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "POST /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016/action" status: 202 len: 0 microversion: 2.1 time: 0.171669 Aug 31 17:36:22.703316 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4062/8133] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 17:36:22 2022] POST /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 17:36:22.712253 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-db96b411-cfe3-48e6-849d-79fbffee06b2 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:36:22.712880 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-db96b411-cfe3-48e6-849d-79fbffee06b2 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: 978a6f77-1a3d-4920-84dc-c786aeec4016] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:36:22.718991 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-db96b411-cfe3-48e6-849d-79fbffee06b2 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:36:22.719513 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-db96b411-cfe3-48e6-849d-79fbffee06b2 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:36:22.719988 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-db96b411-cfe3-48e6-849d-79fbffee06b2 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:36:22.720684 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-db96b411-cfe3-48e6-849d-79fbffee06b2 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:36:22.721150 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-db96b411-cfe3-48e6-849d-79fbffee06b2 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:36:22.721586 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-db96b411-cfe3-48e6-849d-79fbffee06b2 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:36:22.866267 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-db96b411-cfe3-48e6-849d-79fbffee06b2 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:36:22.874257 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-db96b411-cfe3-48e6-849d-79fbffee06b2 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016" status: 200 len: 1630 microversion: 2.1 time: 0.166467 Aug 31 17:36:22.874838 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4072/8134] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:36:22 2022] GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016 => generated 1630 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:36:23.899211 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f8bf2a52-4f3b-4802-8c19-b163bc96643d tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:36:23.899869 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f8bf2a52-4f3b-4802-8c19-b163bc96643d tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: 978a6f77-1a3d-4920-84dc-c786aeec4016] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:36:23.906246 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f8bf2a52-4f3b-4802-8c19-b163bc96643d tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:36:23.906687 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f8bf2a52-4f3b-4802-8c19-b163bc96643d tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:36:23.907150 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f8bf2a52-4f3b-4802-8c19-b163bc96643d tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:36:23.907894 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f8bf2a52-4f3b-4802-8c19-b163bc96643d tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:36:23.908358 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f8bf2a52-4f3b-4802-8c19-b163bc96643d tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:36:23.908790 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f8bf2a52-4f3b-4802-8c19-b163bc96643d tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:36:24.045547 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f8bf2a52-4f3b-4802-8c19-b163bc96643d tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:36:24.053635 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f8bf2a52-4f3b-4802-8c19-b163bc96643d tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016" status: 200 len: 1688 microversion: 2.1 time: 0.160707 Aug 31 17:36:24.054339 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4063/8135] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:36:23 2022] GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016 => generated 1688 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:36:24.962012 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-9bdaa2ad-97e9-4baf-ab93-10e73ffeb414 req-4400bfef-0af0-44c4-8311-4ae433974a55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "978a6f77-1a3d-4920-84dc-c786aeec4016", "tag": "24b0ae69-a238-44af-822b-b4554d887bc4"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:36:24.974661 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-9bdaa2ad-97e9-4baf-ab93-10e73ffeb414 req-4400bfef-0af0-44c4-8311-4ae433974a55 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:36:24.975172 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-9bdaa2ad-97e9-4baf-ab93-10e73ffeb414 req-4400bfef-0af0-44c4-8311-4ae433974a55 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:36:24.975651 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-9bdaa2ad-97e9-4baf-ab93-10e73ffeb414 req-4400bfef-0af0-44c4-8311-4ae433974a55 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:36:24.988484 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-9bdaa2ad-97e9-4baf-ab93-10e73ffeb414 req-4400bfef-0af0-44c4-8311-4ae433974a55 service nova] Creating event network-changed:24b0ae69-a238-44af-822b-b4554d887bc4 for instance 978a6f77-1a3d-4920-84dc-c786aeec4016 on n-h1-850499-9 Aug 31 17:36:24.993804 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-9bdaa2ad-97e9-4baf-ab93-10e73ffeb414 req-4400bfef-0af0-44c4-8311-4ae433974a55 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097790 Aug 31 17:36:24.994420 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4073/8136] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:36:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:36:25.078549 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c139d1e4-cc1b-4390-a308-3099784f1888 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:36:25.079108 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c139d1e4-cc1b-4390-a308-3099784f1888 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: 978a6f77-1a3d-4920-84dc-c786aeec4016] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:36:25.086975 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c139d1e4-cc1b-4390-a308-3099784f1888 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:36:25.087476 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c139d1e4-cc1b-4390-a308-3099784f1888 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:36:25.088048 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c139d1e4-cc1b-4390-a308-3099784f1888 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:36:25.088762 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c139d1e4-cc1b-4390-a308-3099784f1888 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:36:25.089223 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c139d1e4-cc1b-4390-a308-3099784f1888 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:36:25.089680 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c139d1e4-cc1b-4390-a308-3099784f1888 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:36:25.310409 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c139d1e4-cc1b-4390-a308-3099784f1888 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:36:25.319326 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c139d1e4-cc1b-4390-a308-3099784f1888 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016" status: 200 len: 1688 microversion: 2.1 time: 0.244728 Aug 31 17:36:25.319957 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4064/8137] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:36:25 2022] GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016 => generated 1688 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 17:36:26.341492 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-94c7cb7c-b0cb-4ec3-8059-0a05908ea06a tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:36:26.342228 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-94c7cb7c-b0cb-4ec3-8059-0a05908ea06a tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: 978a6f77-1a3d-4920-84dc-c786aeec4016] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:36:26.351679 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-94c7cb7c-b0cb-4ec3-8059-0a05908ea06a tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:36:26.352525 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-94c7cb7c-b0cb-4ec3-8059-0a05908ea06a tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:36:26.353218 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-94c7cb7c-b0cb-4ec3-8059-0a05908ea06a tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:36:26.354178 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-94c7cb7c-b0cb-4ec3-8059-0a05908ea06a tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:36:26.354910 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-94c7cb7c-b0cb-4ec3-8059-0a05908ea06a tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:36:26.355748 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-94c7cb7c-b0cb-4ec3-8059-0a05908ea06a tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:36:26.536253 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-94c7cb7c-b0cb-4ec3-8059-0a05908ea06a tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:36:26.545889 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-94c7cb7c-b0cb-4ec3-8059-0a05908ea06a tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016" status: 200 len: 1688 microversion: 2.1 time: 0.208645 Aug 31 17:36:26.562840 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4074/8138] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:36:26 2022] GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016 => generated 1688 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:36:27.570701 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b1c1dbbb-800f-4da7-ad8f-ce43eb13f1ce tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:36:27.571602 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b1c1dbbb-800f-4da7-ad8f-ce43eb13f1ce tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: 978a6f77-1a3d-4920-84dc-c786aeec4016] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:36:27.578958 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b1c1dbbb-800f-4da7-ad8f-ce43eb13f1ce tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:36:27.579465 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b1c1dbbb-800f-4da7-ad8f-ce43eb13f1ce tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:36:27.579951 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b1c1dbbb-800f-4da7-ad8f-ce43eb13f1ce tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:36:27.580673 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b1c1dbbb-800f-4da7-ad8f-ce43eb13f1ce tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:36:27.581405 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b1c1dbbb-800f-4da7-ad8f-ce43eb13f1ce tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:36:27.581843 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b1c1dbbb-800f-4da7-ad8f-ce43eb13f1ce tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:36:27.752506 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b1c1dbbb-800f-4da7-ad8f-ce43eb13f1ce tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:36:27.763869 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b1c1dbbb-800f-4da7-ad8f-ce43eb13f1ce tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016" status: 200 len: 1688 microversion: 2.1 time: 0.197312 Aug 31 17:36:27.770825 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4065/8139] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:36:27 2022] GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016 => generated 1688 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:36:28.786487 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a652c19c-be49-422c-89e1-149a931fd156 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:36:28.788401 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a652c19c-be49-422c-89e1-149a931fd156 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: 978a6f77-1a3d-4920-84dc-c786aeec4016] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:36:28.795448 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a652c19c-be49-422c-89e1-149a931fd156 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:36:28.795994 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a652c19c-be49-422c-89e1-149a931fd156 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:36:28.796453 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a652c19c-be49-422c-89e1-149a931fd156 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:36:28.797182 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a652c19c-be49-422c-89e1-149a931fd156 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:36:28.797670 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a652c19c-be49-422c-89e1-149a931fd156 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:36:28.798104 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a652c19c-be49-422c-89e1-149a931fd156 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:36:28.954367 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a652c19c-be49-422c-89e1-149a931fd156 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:36:28.963476 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a652c19c-be49-422c-89e1-149a931fd156 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016" status: 200 len: 1688 microversion: 2.1 time: 0.180815 Aug 31 17:36:28.964105 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4075/8140] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:36:28 2022] GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016 => generated 1688 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 17:36:29.984747 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-31ef5f60-e7d6-4289-a269-71421a82be99 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:36:29.985507 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-31ef5f60-e7d6-4289-a269-71421a82be99 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: 978a6f77-1a3d-4920-84dc-c786aeec4016] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:36:29.996452 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-31ef5f60-e7d6-4289-a269-71421a82be99 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:36:29.996988 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-31ef5f60-e7d6-4289-a269-71421a82be99 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:36:29.997431 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-31ef5f60-e7d6-4289-a269-71421a82be99 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:36:29.998156 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-31ef5f60-e7d6-4289-a269-71421a82be99 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:36:29.998621 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-31ef5f60-e7d6-4289-a269-71421a82be99 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:36:29.999060 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-31ef5f60-e7d6-4289-a269-71421a82be99 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:36:30.178840 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-31ef5f60-e7d6-4289-a269-71421a82be99 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:36:30.187024 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-31ef5f60-e7d6-4289-a269-71421a82be99 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016" status: 200 len: 1688 microversion: 2.1 time: 0.206717 Aug 31 17:36:30.187645 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4066/8141] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:36:29 2022] GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016 => generated 1688 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:36:31.211354 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1b1813cb-4636-4316-9103-6de2386fed83 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:36:31.212148 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1b1813cb-4636-4316-9103-6de2386fed83 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: 978a6f77-1a3d-4920-84dc-c786aeec4016] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:36:31.219374 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1b1813cb-4636-4316-9103-6de2386fed83 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:36:31.220108 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1b1813cb-4636-4316-9103-6de2386fed83 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:36:31.220608 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1b1813cb-4636-4316-9103-6de2386fed83 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:36:31.221310 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1b1813cb-4636-4316-9103-6de2386fed83 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:36:31.221857 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1b1813cb-4636-4316-9103-6de2386fed83 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:36:31.222315 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1b1813cb-4636-4316-9103-6de2386fed83 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:36:31.400171 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-1b1813cb-4636-4316-9103-6de2386fed83 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:36:31.409753 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1b1813cb-4636-4316-9103-6de2386fed83 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016" status: 200 len: 1688 microversion: 2.1 time: 0.204039 Aug 31 17:36:31.416744 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4076/8142] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:36:31 2022] GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016 => generated 1688 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:36:32.435424 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-dc3fb7f2-2f9b-4118-b8ad-0a564a408ece tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:36:32.436205 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-dc3fb7f2-2f9b-4118-b8ad-0a564a408ece tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: 978a6f77-1a3d-4920-84dc-c786aeec4016] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:36:32.443630 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dc3fb7f2-2f9b-4118-b8ad-0a564a408ece tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:36:32.444268 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dc3fb7f2-2f9b-4118-b8ad-0a564a408ece tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:36:32.444788 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dc3fb7f2-2f9b-4118-b8ad-0a564a408ece tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:36:32.445582 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dc3fb7f2-2f9b-4118-b8ad-0a564a408ece tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:36:32.446204 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dc3fb7f2-2f9b-4118-b8ad-0a564a408ece tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:36:32.451784 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-dc3fb7f2-2f9b-4118-b8ad-0a564a408ece tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:36:32.599013 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-dc3fb7f2-2f9b-4118-b8ad-0a564a408ece tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:36:32.608215 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-dc3fb7f2-2f9b-4118-b8ad-0a564a408ece tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016" status: 200 len: 1688 microversion: 2.1 time: 0.177253 Aug 31 17:36:32.611301 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4067/8143] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:36:32 2022] GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016 => generated 1688 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:36:33.632197 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d886d134-4bee-4145-bb34-fbd2404428b7 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:36:33.632853 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d886d134-4bee-4145-bb34-fbd2404428b7 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: 978a6f77-1a3d-4920-84dc-c786aeec4016] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:36:33.640069 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d886d134-4bee-4145-bb34-fbd2404428b7 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:36:33.640759 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d886d134-4bee-4145-bb34-fbd2404428b7 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:36:33.641403 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d886d134-4bee-4145-bb34-fbd2404428b7 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:36:33.642313 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d886d134-4bee-4145-bb34-fbd2404428b7 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:36:33.642894 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d886d134-4bee-4145-bb34-fbd2404428b7 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:36:33.643433 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d886d134-4bee-4145-bb34-fbd2404428b7 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:36:33.789777 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d886d134-4bee-4145-bb34-fbd2404428b7 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:36:33.797644 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d886d134-4bee-4145-bb34-fbd2404428b7 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016" status: 200 len: 1688 microversion: 2.1 time: 0.170206 Aug 31 17:36:33.798231 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4077/8144] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:36:33 2022] GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016 => generated 1688 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:36:34.820112 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2c090a3a-faca-490d-8abe-456bd91c2670 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:36:34.820746 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2c090a3a-faca-490d-8abe-456bd91c2670 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: 978a6f77-1a3d-4920-84dc-c786aeec4016] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:36:34.827886 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2c090a3a-faca-490d-8abe-456bd91c2670 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:36:34.828380 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2c090a3a-faca-490d-8abe-456bd91c2670 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:36:34.828822 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2c090a3a-faca-490d-8abe-456bd91c2670 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:36:34.829525 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2c090a3a-faca-490d-8abe-456bd91c2670 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:36:34.829994 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2c090a3a-faca-490d-8abe-456bd91c2670 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:36:34.830428 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2c090a3a-faca-490d-8abe-456bd91c2670 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:36:34.972063 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-2c090a3a-faca-490d-8abe-456bd91c2670 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:36:34.980658 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2c090a3a-faca-490d-8abe-456bd91c2670 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016" status: 200 len: 1688 microversion: 2.1 time: 0.165035 Aug 31 17:36:34.981255 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4068/8145] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:36:34 2022] GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016 => generated 1688 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:36:36.004594 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-19e4254d-2e64-4c9e-b113-d650bc50c350 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:36:36.005833 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-19e4254d-2e64-4c9e-b113-d650bc50c350 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: 978a6f77-1a3d-4920-84dc-c786aeec4016] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:36:36.013339 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-19e4254d-2e64-4c9e-b113-d650bc50c350 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:36:36.013845 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-19e4254d-2e64-4c9e-b113-d650bc50c350 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:36:36.014295 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-19e4254d-2e64-4c9e-b113-d650bc50c350 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:36:36.015159 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-19e4254d-2e64-4c9e-b113-d650bc50c350 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:36:36.015658 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-19e4254d-2e64-4c9e-b113-d650bc50c350 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:36:36.016096 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-19e4254d-2e64-4c9e-b113-d650bc50c350 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:36:36.164872 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-19e4254d-2e64-4c9e-b113-d650bc50c350 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:36:36.173050 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-19e4254d-2e64-4c9e-b113-d650bc50c350 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016" status: 200 len: 1688 microversion: 2.1 time: 0.174395 Aug 31 17:36:36.173670 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4078/8146] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:36:35 2022] GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016 => generated 1688 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:36:37.196671 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-81f98eab-966f-4871-93a9-efe7e9615e06 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:36:37.197283 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-81f98eab-966f-4871-93a9-efe7e9615e06 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: 978a6f77-1a3d-4920-84dc-c786aeec4016] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:36:37.204583 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-81f98eab-966f-4871-93a9-efe7e9615e06 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:36:37.205009 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-81f98eab-966f-4871-93a9-efe7e9615e06 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:36:37.205501 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-81f98eab-966f-4871-93a9-efe7e9615e06 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:36:37.206216 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-81f98eab-966f-4871-93a9-efe7e9615e06 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:36:37.206685 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-81f98eab-966f-4871-93a9-efe7e9615e06 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:36:37.207126 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-81f98eab-966f-4871-93a9-efe7e9615e06 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:36:37.352727 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-81f98eab-966f-4871-93a9-efe7e9615e06 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:36:37.360649 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-81f98eab-966f-4871-93a9-efe7e9615e06 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016" status: 200 len: 1688 microversion: 2.1 time: 0.168658 Aug 31 17:36:37.366215 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4069/8147] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:36:37 2022] GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016 => generated 1688 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:36:38.383080 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-afc10a1a-4e7c-47a5-8d5c-c111415cf84c tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:36:38.383806 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-afc10a1a-4e7c-47a5-8d5c-c111415cf84c tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: 978a6f77-1a3d-4920-84dc-c786aeec4016] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:36:38.392529 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-afc10a1a-4e7c-47a5-8d5c-c111415cf84c tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:36:38.393044 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-afc10a1a-4e7c-47a5-8d5c-c111415cf84c tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:36:38.393543 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-afc10a1a-4e7c-47a5-8d5c-c111415cf84c tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:36:38.394746 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-afc10a1a-4e7c-47a5-8d5c-c111415cf84c tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:36:38.395800 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-afc10a1a-4e7c-47a5-8d5c-c111415cf84c tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:36:38.396671 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-afc10a1a-4e7c-47a5-8d5c-c111415cf84c tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:36:38.546834 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-afc10a1a-4e7c-47a5-8d5c-c111415cf84c tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:36:38.555864 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-afc10a1a-4e7c-47a5-8d5c-c111415cf84c tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016" status: 200 len: 1688 microversion: 2.1 time: 0.177584 Aug 31 17:36:38.556864 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4079/8148] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:36:38 2022] GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016 => generated 1688 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:36:39.578940 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-56b0f6ac-6198-493f-823b-7fcf0d8431c5 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:36:39.579613 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-56b0f6ac-6198-493f-823b-7fcf0d8431c5 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: 978a6f77-1a3d-4920-84dc-c786aeec4016] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:36:39.587796 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-56b0f6ac-6198-493f-823b-7fcf0d8431c5 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:36:39.588297 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-56b0f6ac-6198-493f-823b-7fcf0d8431c5 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:36:39.588740 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-56b0f6ac-6198-493f-823b-7fcf0d8431c5 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:36:39.589456 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-56b0f6ac-6198-493f-823b-7fcf0d8431c5 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:36:39.589919 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-56b0f6ac-6198-493f-823b-7fcf0d8431c5 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:36:39.590350 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-56b0f6ac-6198-493f-823b-7fcf0d8431c5 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:36:39.729331 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-56b0f6ac-6198-493f-823b-7fcf0d8431c5 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:36:39.737321 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-56b0f6ac-6198-493f-823b-7fcf0d8431c5 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016" status: 200 len: 1688 microversion: 2.1 time: 0.162322 Aug 31 17:36:39.737901 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4070/8149] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:36:39 2022] GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016 => generated 1688 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:36:40.762239 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c922e15f-06b6-4ebd-b343-23df4a5e04a8 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:36:40.762872 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c922e15f-06b6-4ebd-b343-23df4a5e04a8 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: 978a6f77-1a3d-4920-84dc-c786aeec4016] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:36:40.769895 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c922e15f-06b6-4ebd-b343-23df4a5e04a8 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:36:40.770399 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c922e15f-06b6-4ebd-b343-23df4a5e04a8 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:36:40.771577 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c922e15f-06b6-4ebd-b343-23df4a5e04a8 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:36:40.772448 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c922e15f-06b6-4ebd-b343-23df4a5e04a8 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:36:40.772919 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c922e15f-06b6-4ebd-b343-23df4a5e04a8 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:36:40.773359 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c922e15f-06b6-4ebd-b343-23df4a5e04a8 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:36:40.918498 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c922e15f-06b6-4ebd-b343-23df4a5e04a8 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:36:40.926610 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c922e15f-06b6-4ebd-b343-23df4a5e04a8 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016" status: 200 len: 1688 microversion: 2.1 time: 0.169881 Aug 31 17:36:40.927475 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4080/8150] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:36:40 2022] GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016 => generated 1688 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:36:41.948689 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-47e85b17-9af7-4389-879c-4e898824e7da tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:36:41.949325 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-47e85b17-9af7-4389-879c-4e898824e7da tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: 978a6f77-1a3d-4920-84dc-c786aeec4016] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:36:41.956308 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-47e85b17-9af7-4389-879c-4e898824e7da tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:36:41.956794 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-47e85b17-9af7-4389-879c-4e898824e7da tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:36:41.957227 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-47e85b17-9af7-4389-879c-4e898824e7da tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:36:41.957919 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-47e85b17-9af7-4389-879c-4e898824e7da tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:36:41.958930 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-47e85b17-9af7-4389-879c-4e898824e7da tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:36:41.959357 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-47e85b17-9af7-4389-879c-4e898824e7da tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:36:42.096748 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-47e85b17-9af7-4389-879c-4e898824e7da tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:36:42.105549 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-47e85b17-9af7-4389-879c-4e898824e7da tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016" status: 200 len: 1688 microversion: 2.1 time: 0.160681 Aug 31 17:36:42.106176 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4071/8151] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:36:41 2022] GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016 => generated 1688 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:36:43.127238 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-14901d4b-7872-4a7a-8930-4e52fe2592b8 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:36:43.127903 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-14901d4b-7872-4a7a-8930-4e52fe2592b8 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: 978a6f77-1a3d-4920-84dc-c786aeec4016] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:36:43.134988 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-14901d4b-7872-4a7a-8930-4e52fe2592b8 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:36:43.135513 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-14901d4b-7872-4a7a-8930-4e52fe2592b8 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:36:43.135981 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-14901d4b-7872-4a7a-8930-4e52fe2592b8 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:36:43.136697 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-14901d4b-7872-4a7a-8930-4e52fe2592b8 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:36:43.137171 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-14901d4b-7872-4a7a-8930-4e52fe2592b8 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:36:43.137618 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-14901d4b-7872-4a7a-8930-4e52fe2592b8 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:36:43.292116 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-14901d4b-7872-4a7a-8930-4e52fe2592b8 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:36:43.300040 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-14901d4b-7872-4a7a-8930-4e52fe2592b8 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016" status: 200 len: 1688 microversion: 2.1 time: 0.176722 Aug 31 17:36:43.300646 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4081/8152] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:36:43 2022] GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016 => generated 1688 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:36:44.264310 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-6faecdbb-c79d-4395-95a8-01621c101bed req-35ad5789-21d1-4f1c-a3b0-b89867316f3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "978a6f77-1a3d-4920-84dc-c786aeec4016", "name": "network-vif-plugged", "status": "completed", "tag": "24b0ae69-a238-44af-822b-b4554d887bc4"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:36:44.276373 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-6faecdbb-c79d-4395-95a8-01621c101bed req-35ad5789-21d1-4f1c-a3b0-b89867316f3d service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:36:44.276636 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-6faecdbb-c79d-4395-95a8-01621c101bed req-35ad5789-21d1-4f1c-a3b0-b89867316f3d service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:36:44.276877 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-6faecdbb-c79d-4395-95a8-01621c101bed req-35ad5789-21d1-4f1c-a3b0-b89867316f3d service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:36:44.290692 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-6faecdbb-c79d-4395-95a8-01621c101bed req-35ad5789-21d1-4f1c-a3b0-b89867316f3d service nova] Creating event network-vif-plugged:24b0ae69-a238-44af-822b-b4554d887bc4 for instance 978a6f77-1a3d-4920-84dc-c786aeec4016 on n-h1-850499-9 Aug 31 17:36:44.297227 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-6faecdbb-c79d-4395-95a8-01621c101bed req-35ad5789-21d1-4f1c-a3b0-b89867316f3d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038298 Aug 31 17:36:44.298509 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4072/8153] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:36:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:36:44.324149 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-cc7c3c35-2ae8-4030-b6bd-18e144716907 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:36:44.325851 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-cc7c3c35-2ae8-4030-b6bd-18e144716907 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: 978a6f77-1a3d-4920-84dc-c786aeec4016] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:36:44.332321 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cc7c3c35-2ae8-4030-b6bd-18e144716907 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:36:44.332840 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cc7c3c35-2ae8-4030-b6bd-18e144716907 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:36:44.333299 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cc7c3c35-2ae8-4030-b6bd-18e144716907 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:36:44.334538 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cc7c3c35-2ae8-4030-b6bd-18e144716907 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:36:44.335025 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cc7c3c35-2ae8-4030-b6bd-18e144716907 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:36:44.335480 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cc7c3c35-2ae8-4030-b6bd-18e144716907 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:36:44.495180 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-cc7c3c35-2ae8-4030-b6bd-18e144716907 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:36:44.503762 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-cc7c3c35-2ae8-4030-b6bd-18e144716907 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016" status: 200 len: 1688 microversion: 2.1 time: 0.185686 Aug 31 17:36:44.504354 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4082/8154] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:36:44 2022] GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016 => generated 1688 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:36:45.528087 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-bba123ea-4642-46f9-8e88-76187bc8f379 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:36:45.528916 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-bba123ea-4642-46f9-8e88-76187bc8f379 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: 978a6f77-1a3d-4920-84dc-c786aeec4016] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:36:45.535740 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bba123ea-4642-46f9-8e88-76187bc8f379 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:36:45.536229 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bba123ea-4642-46f9-8e88-76187bc8f379 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:36:45.537741 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bba123ea-4642-46f9-8e88-76187bc8f379 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:36:45.538579 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bba123ea-4642-46f9-8e88-76187bc8f379 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:36:45.539079 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bba123ea-4642-46f9-8e88-76187bc8f379 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:36:45.539530 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bba123ea-4642-46f9-8e88-76187bc8f379 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:36:45.679899 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-bba123ea-4642-46f9-8e88-76187bc8f379 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:36:45.689397 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-bba123ea-4642-46f9-8e88-76187bc8f379 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016" status: 200 len: 1688 microversion: 2.1 time: 0.166701 Aug 31 17:36:45.689984 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4073/8155] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:36:45 2022] GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016 => generated 1688 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:36:46.712419 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-92adb24d-0332-4557-a709-939c5604575d tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:36:46.713084 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-92adb24d-0332-4557-a709-939c5604575d tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: 978a6f77-1a3d-4920-84dc-c786aeec4016] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:36:46.720062 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-92adb24d-0332-4557-a709-939c5604575d tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:36:46.720577 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-92adb24d-0332-4557-a709-939c5604575d tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:36:46.721043 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-92adb24d-0332-4557-a709-939c5604575d tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:36:46.721786 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-92adb24d-0332-4557-a709-939c5604575d tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:36:46.722247 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-92adb24d-0332-4557-a709-939c5604575d tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:36:46.722713 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-92adb24d-0332-4557-a709-939c5604575d tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:36:46.859655 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-92adb24d-0332-4557-a709-939c5604575d tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:36:46.868899 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-92adb24d-0332-4557-a709-939c5604575d tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016" status: 200 len: 1675 microversion: 2.1 time: 0.160629 Aug 31 17:36:46.869503 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4083/8156] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:36:46 2022] GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016 => generated 1675 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:38:35.139689 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:38:35.140454 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:38:35.145394 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0fadad07-8389-4a4d-952c-008365d2bdc3 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:38:35.145894 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0fadad07-8389-4a4d-952c-008365d2bdc3 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: 978a6f77-1a3d-4920-84dc-c786aeec4016] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:38:35.150731 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=25 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:38:35.151657 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=73 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:38:35.157813 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-0ee49463-201c-497e-8d75-ac383c8345fa req-687dad61-461a-4cbe-be7e-6036643acb55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "978a6f77-1a3d-4920-84dc-c786aeec4016", "tag": "24b0ae69-a238-44af-822b-b4554d887bc4"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:38:35.159806 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0fadad07-8389-4a4d-952c-008365d2bdc3 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:38:35.160952 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0fadad07-8389-4a4d-952c-008365d2bdc3 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:38:35.161179 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0fadad07-8389-4a4d-952c-008365d2bdc3 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:38:35.161966 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0fadad07-8389-4a4d-952c-008365d2bdc3 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:38:35.162504 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0fadad07-8389-4a4d-952c-008365d2bdc3 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:38:35.163003 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0fadad07-8389-4a4d-952c-008365d2bdc3 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:38:35.168728 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-0ee49463-201c-497e-8d75-ac383c8345fa req-687dad61-461a-4cbe-be7e-6036643acb55 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:38:35.169224 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-0ee49463-201c-497e-8d75-ac383c8345fa req-687dad61-461a-4cbe-be7e-6036643acb55 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:38:35.169673 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-0ee49463-201c-497e-8d75-ac383c8345fa req-687dad61-461a-4cbe-be7e-6036643acb55 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:38:35.182514 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-0ee49463-201c-497e-8d75-ac383c8345fa req-687dad61-461a-4cbe-be7e-6036643acb55 service nova] Creating event network-changed:24b0ae69-a238-44af-822b-b4554d887bc4 for instance 978a6f77-1a3d-4920-84dc-c786aeec4016 on n-h1-850499-9 Aug 31 17:38:35.187818 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-0ee49463-201c-497e-8d75-ac383c8345fa req-687dad61-461a-4cbe-be7e-6036643acb55 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038961 Aug 31 17:38:35.188431 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4084/8157] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:38:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:38:35.194792 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0fadad07-8389-4a4d-952c-008365d2bdc3 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: 978a6f77-1a3d-4920-84dc-c786aeec4016] Going to try to terminate instance {{(pid=122256) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 17:38:35.291998 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0fadad07-8389-4a4d-952c-008365d2bdc3 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "DELETE /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016" status: 204 len: 0 microversion: 2.1 time: 0.154186 Aug 31 17:38:35.296934 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4074/8158] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 17:38:35 2022] DELETE /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 17:38:35.304505 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c86c6987-f091-4498-8779-6ef20efb37b2 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:38:35.305556 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c86c6987-f091-4498-8779-6ef20efb37b2 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: 978a6f77-1a3d-4920-84dc-c786aeec4016] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:38:35.314436 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c86c6987-f091-4498-8779-6ef20efb37b2 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:38:35.315444 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c86c6987-f091-4498-8779-6ef20efb37b2 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:38:35.316143 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c86c6987-f091-4498-8779-6ef20efb37b2 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:38:35.317116 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c86c6987-f091-4498-8779-6ef20efb37b2 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:38:35.318517 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c86c6987-f091-4498-8779-6ef20efb37b2 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:38:35.319306 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c86c6987-f091-4498-8779-6ef20efb37b2 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:38:35.485697 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c86c6987-f091-4498-8779-6ef20efb37b2 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:38:35.493934 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c86c6987-f091-4498-8779-6ef20efb37b2 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016" status: 200 len: 1681 microversion: 2.1 time: 0.194618 Aug 31 17:38:35.494422 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4085/8159] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:38:35 2022] GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016 => generated 1681 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:38:36.517579 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e8c462d5-721c-4e44-9fe1-e88462624d6f tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:38:36.520949 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e8c462d5-721c-4e44-9fe1-e88462624d6f tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: 978a6f77-1a3d-4920-84dc-c786aeec4016] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:38:36.535756 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e8c462d5-721c-4e44-9fe1-e88462624d6f tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:38:36.536261 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e8c462d5-721c-4e44-9fe1-e88462624d6f tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:38:36.536711 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e8c462d5-721c-4e44-9fe1-e88462624d6f tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:38:36.537433 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e8c462d5-721c-4e44-9fe1-e88462624d6f tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:38:36.537899 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e8c462d5-721c-4e44-9fe1-e88462624d6f tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:38:36.538336 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e8c462d5-721c-4e44-9fe1-e88462624d6f tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:38:36.749282 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e8c462d5-721c-4e44-9fe1-e88462624d6f tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:38:36.757374 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e8c462d5-721c-4e44-9fe1-e88462624d6f tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016" status: 200 len: 1681 microversion: 2.1 time: 0.244626 Aug 31 17:38:36.767635 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4075/8160] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:38:36 2022] GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016 => generated 1681 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:38:37.609572 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-173a2422-7d8b-4f86-9186-c6449429fed8 req-7fa137f6-fdc0-4e12-8d2b-d5751e60bc84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "978a6f77-1a3d-4920-84dc-c786aeec4016", "name": "network-vif-deleted", "tag": "24b0ae69-a238-44af-822b-b4554d887bc4"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:38:37.620761 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-173a2422-7d8b-4f86-9186-c6449429fed8 req-7fa137f6-fdc0-4e12-8d2b-d5751e60bc84 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:38:37.621267 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-173a2422-7d8b-4f86-9186-c6449429fed8 req-7fa137f6-fdc0-4e12-8d2b-d5751e60bc84 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:38:37.621734 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-173a2422-7d8b-4f86-9186-c6449429fed8 req-7fa137f6-fdc0-4e12-8d2b-d5751e60bc84 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:38:37.633634 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-173a2422-7d8b-4f86-9186-c6449429fed8 req-7fa137f6-fdc0-4e12-8d2b-d5751e60bc84 service nova] Creating event network-vif-deleted:24b0ae69-a238-44af-822b-b4554d887bc4 for instance 978a6f77-1a3d-4920-84dc-c786aeec4016 on n-h1-850499-9 Aug 31 17:38:37.640189 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-173a2422-7d8b-4f86-9186-c6449429fed8 req-7fa137f6-fdc0-4e12-8d2b-d5751e60bc84 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036663 Aug 31 17:38:37.640994 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4086/8161] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:38:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:38:37.781794 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9a3aa39f-2338-4fd9-8e0b-74a442bedf36 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:38:37.782418 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9a3aa39f-2338-4fd9-8e0b-74a442bedf36 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: 978a6f77-1a3d-4920-84dc-c786aeec4016] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:38:37.789790 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9a3aa39f-2338-4fd9-8e0b-74a442bedf36 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:38:37.790321 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9a3aa39f-2338-4fd9-8e0b-74a442bedf36 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:38:37.790762 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9a3aa39f-2338-4fd9-8e0b-74a442bedf36 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:38:37.791574 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9a3aa39f-2338-4fd9-8e0b-74a442bedf36 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:38:37.792039 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9a3aa39f-2338-4fd9-8e0b-74a442bedf36 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:38:37.792468 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9a3aa39f-2338-4fd9-8e0b-74a442bedf36 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:38:37.833066 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9a3aa39f-2338-4fd9-8e0b-74a442bedf36 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:38:37.833887 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9a3aa39f-2338-4fd9-8e0b-74a442bedf36 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:38:37.834567 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9a3aa39f-2338-4fd9-8e0b-74a442bedf36 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:38:37.835288 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-9a3aa39f-2338-4fd9-8e0b-74a442bedf36 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lazy-loading 'fault' on Instance uuid 978a6f77-1a3d-4920-84dc-c786aeec4016 {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 17:38:37.886674 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-9a3aa39f-2338-4fd9-8e0b-74a442bedf36 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:38:37.895397 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9a3aa39f-2338-4fd9-8e0b-74a442bedf36 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016" status: 200 len: 1337 microversion: 2.1 time: 0.119536 Aug 31 17:38:37.896304 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4076/8162] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:38:37 2022] GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016 => generated 1337 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 17:38:38.918700 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e1adf0b8-5876-4bb5-b6a1-b9a51453c129 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:38:38.919573 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-e1adf0b8-5876-4bb5-b6a1-b9a51453c129 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: 978a6f77-1a3d-4920-84dc-c786aeec4016] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:38:38.927760 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e1adf0b8-5876-4bb5-b6a1-b9a51453c129 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:38:38.928343 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e1adf0b8-5876-4bb5-b6a1-b9a51453c129 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:38:38.928803 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e1adf0b8-5876-4bb5-b6a1-b9a51453c129 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:38:38.929526 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e1adf0b8-5876-4bb5-b6a1-b9a51453c129 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:38:38.930004 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e1adf0b8-5876-4bb5-b6a1-b9a51453c129 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:38:38.930449 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-e1adf0b8-5876-4bb5-b6a1-b9a51453c129 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:38:38.945046 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.wsgi [None req-e1adf0b8-5876-4bb5-b6a1-b9a51453c129 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] HTTP exception thrown: Instance 978a6f77-1a3d-4920-84dc-c786aeec4016 could not be found. Aug 31 17:38:38.946738 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e1adf0b8-5876-4bb5-b6a1-b9a51453c129 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Request method failure captured: Aug 31 17:38:38.946738 n-d-850499-9 devstack@n-api.service[122257]: request: GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016 HTTP/1.1 Aug 31 17:38:38.946738 n-d-850499-9 devstack@n-api.service[122257]: Accept: application/json Aug 31 17:38:38.946738 n-d-850499-9 devstack@n-api.service[122257]: Accept-Encoding: identity Aug 31 17:38:38.946738 n-d-850499-9 devstack@n-api.service[122257]: Connection: close Aug 31 17:38:38.946738 n-d-850499-9 devstack@n-api.service[122257]: Content-Length: 0 Aug 31 17:38:38.946738 n-d-850499-9 devstack@n-api.service[122257]: Content-Type: application/json Aug 31 17:38:38.946738 n-d-850499-9 devstack@n-api.service[122257]: Host: 10.222.0.61 Aug 31 17:38:38.946738 n-d-850499-9 devstack@n-api.service[122257]: Openstack-System-Scope: None Aug 31 17:38:38.946738 n-d-850499-9 devstack@n-api.service[122257]: User-Agent: python-urllib3/1.26.12 Aug 31 17:38:38.946738 n-d-850499-9 devstack@n-api.service[122257]: X-Auth-Token: gAAAAABjD5tFiO-MohS1zjghaZbeewzgg_qt9pZdL7UnzDnqlJmrzm0mDXpBkLIlM4FyZRni0V-LGxBcFwMpSz7FE0Exx7R-D9wa36pjTL_JEHI353HE1ODIfpAOYFCHXjF6IPq6o7y8mAW9ufzaGIX7y1koYKwsqRWKdXyyniFtMc95TqQfe8A Aug 31 17:38:38.946738 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Id: None Aug 31 17:38:38.946738 n-d-850499-9 devstack@n-api.service[122257]: X-Domain-Name: None Aug 31 17:38:38.946738 n-d-850499-9 devstack@n-api.service[122257]: X-Identity-Status: Confirmed Aug 31 17:38:38.946738 n-d-850499-9 devstack@n-api.service[122257]: X-Is-Admin-Project: True Aug 31 17:38:38.946738 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Id: default Aug 31 17:38:38.946738 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Domain-Name: Default Aug 31 17:38:38.946738 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Id: 5f084d7d088e4d8e87c62bdcc287b936 Aug 31 17:38:38.946738 n-d-850499-9 devstack@n-api.service[122257]: X-Project-Name: tempest-TestShelveInstance-1982875220 Aug 31 17:38:38.946738 n-d-850499-9 devstack@n-api.service[122257]: X-Role: reader,member Aug 31 17:38:38.946738 n-d-850499-9 devstack@n-api.service[122257]: X-Roles: reader,member Aug 31 17:38:38.946738 n-d-850499-9 devstack@n-api.service[122257]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5f084d7d088e4d8e87c62bdcc287b936"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5f084d7d088e4d8e87c62bdcc287b936"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5f084d7d088e4d8e87c62bdcc287b936", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5f084d7d088e4d8e87c62bdcc287b936"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 17:38:38.946738 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant: tempest-TestShelveInstance-1982875220 Aug 31 17:38:38.946738 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Id: 5f084d7d088e4d8e87c62bdcc287b936 Aug 31 17:38:38.946738 n-d-850499-9 devstack@n-api.service[122257]: X-Tenant-Name: tempest-TestShelveInstance-1982875220 Aug 31 17:38:38.946738 n-d-850499-9 devstack@n-api.service[122257]: X-User: tempest-TestShelveInstance-1982875220-project Aug 31 17:38:38.946738 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Id: default Aug 31 17:38:38.946738 n-d-850499-9 devstack@n-api.service[122257]: X-User-Domain-Name: Default Aug 31 17:38:38.946738 n-d-850499-9 devstack@n-api.service[122257]: X-User-Id: bd916293046b465d9c14870bf8887cbc Aug 31 17:38:38.946738 n-d-850499-9 devstack@n-api.service[122257]: X-User-Name: tempest-TestShelveInstance-1982875220-project Aug 31 17:38:38.946738 n-d-850499-9 devstack@n-api.service[122257]: method: > Aug 31 17:38:38.946738 n-d-850499-9 devstack@n-api.service[122257]: exception: Instance 978a6f77-1a3d-4920-84dc-c786aeec4016 could not be found. Aug 31 17:38:38.946738 n-d-850499-9 devstack@n-api.service[122257]: action_args: {'id': '978a6f77-1a3d-4920-84dc-c786aeec4016'} Aug 31 17:38:38.946738 n-d-850499-9 devstack@n-api.service[122257]: {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 17:38:38.946738 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:38:38.946738 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 17:38:38.946738 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 17:38:38.946738 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 17:38:38.946738 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 17:38:38.946738 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 17:38:38.946738 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 17:38:38.946738 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 17:38:38.946738 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 17:38:38.946738 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 978a6f77-1a3d-4920-84dc-c786aeec4016 could not be found. Aug 31 17:38:38.946738 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 17:38:38.946738 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:38:38.946738 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 17:38:38.946738 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:38:38.946738 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:38:38.946738 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:38:38.946738 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 17:38:38.946738 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 17:38:38.946738 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 17:38:38.946738 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 17:38:38.946738 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 17:38:38.946738 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 17:38:38.946738 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 17:38:38.946738 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 17:38:38.946738 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 17:38:38.946738 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 17:38:38.946738 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 978a6f77-1a3d-4920-84dc-c786aeec4016 could not be found. Aug 31 17:38:38.946738 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 17:38:38.946738 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:38:38.946738 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 17:38:38.952407 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:38:38.952407 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:38:38.952407 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:38:38.952407 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 17:38:38.952407 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 17:38:38.952407 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 978a6f77-1a3d-4920-84dc-c786aeec4016 could not be found. Aug 31 17:38:38.952407 n-d-850499-9 devstack@n-api.service[122257]: ERROR nova.api.openstack.wsgi Aug 31 17:38:38.952407 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-e1adf0b8-5876-4bb5-b6a1-b9a51453c129 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Returning 404 to user: Instance 978a6f77-1a3d-4920-84dc-c786aeec4016 could not be found. {{(pid=122257) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 17:38:38.952407 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-e1adf0b8-5876-4bb5-b6a1-b9a51453c129 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016" status: 404 len: 111 microversion: 2.1 time: 0.033776 Aug 31 17:38:38.952407 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4087/8163] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:38:38 2022] GET /compute/v2.1/servers/978a6f77-1a3d-4920-84dc-c786aeec4016 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 17:38:39.133055 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c58c7899-58a9-47b2-9379-4ef12c258f17 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '.version_select at 0x7f5ae3d15790>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:38:39.179842 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c58c7899-58a9-47b2-9379-4ef12c258f17 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1503139623" status: 202 len: 0 microversion: 2.1 time: 0.050734 Aug 31 17:38:39.188301 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4077/8164] 10.222.0.61 () {58 vars in 1254 bytes} [Wed Aug 31 17:38:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1503139623 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 17:38:39.205114 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-36a69daf-ede0-4069-b3b4-67729bbd01a6 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Action: 'create', calling method: .version_select at 0x7f5ae3a44280>, body: {"keypair": {"name": "tempest-TestShelveInstance-1831960284", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMTq1qZrKgt3K0hFwLtLPXS44TOEoO4BZYiorJ9XRLujxGFDeTaY/6ZMtFtij6Oh1GxomQYovWhPmHMTfLreJDnZ5ifnABFreAlDuqoqXSpDISet57Ma9i2rbB2LaeQlWQ=="}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:38:39.221643 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-36a69daf-ede0-4069-b3b4-67729bbd01a6 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Getting quotas for project 5f084d7d088e4d8e87c62bdcc287b936. Resources: {'key_pairs'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 17:38:39.226909 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-36a69daf-ede0-4069-b3b4-67729bbd01a6 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Getting quotas for user bd916293046b465d9c14870bf8887cbc and project 5f084d7d088e4d8e87c62bdcc287b936. Resources: {'key_pairs'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 17:38:39.255434 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-36a69daf-ede0-4069-b3b4-67729bbd01a6 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.054666 Aug 31 17:38:39.256108 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4088/8165] 10.222.0.61 () {60 vars in 1159 bytes} [Wed Aug 31 17:38:39 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:38:56.640509 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:38:56.641336 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:38:56.646450 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-01c409fd-b522-4ebd-b85f-1d000851ae3a tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1200426103", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1831960284", "security_groups": [{"name": "tempest-secgroup-smoke-2062643936"}], "networks": [{"uuid": "2e66078f-cfb6-4cf5-8ff2-11d97730b9dd"}], "block_device_mapping_v2": [{"uuid": "555f8fe1-f4f2-47a7-9953-904c1e373e5d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:38:56.769159 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-01c409fd-b522-4ebd-b85f-1d000851ae3a tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] validate_networks() for [('2e66078f-cfb6-4cf5-8ff2-11d97730b9dd', None, None, None, None, None)] {{(pid=122256) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 17:38:57.165627 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-01c409fd-b522-4ebd-b85f-1d000851ae3a tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 17:38:57.166063 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-01c409fd-b522-4ebd-b85f-1d000851ae3a tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 17:38:57.166546 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-01c409fd-b522-4ebd-b85f-1d000851ae3a tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 17:38:57.166993 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-01c409fd-b522-4ebd-b85f-1d000851ae3a tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 17:38:57.167446 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-01c409fd-b522-4ebd-b85f-1d000851ae3a tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 17:38:57.176978 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-01c409fd-b522-4ebd-b85f-1d000851ae3a tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:38:57.177478 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-01c409fd-b522-4ebd-b85f-1d000851ae3a tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:38:57.177930 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-01c409fd-b522-4ebd-b85f-1d000851ae3a tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:38:57.178664 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-01c409fd-b522-4ebd-b85f-1d000851ae3a tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:38:57.179129 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-01c409fd-b522-4ebd-b85f-1d000851ae3a tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:38:57.179588 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-01c409fd-b522-4ebd-b85f-1d000851ae3a tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:38:57.200606 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-01c409fd-b522-4ebd-b85f-1d000851ae3a tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Getting quotas for project 5f084d7d088e4d8e87c62bdcc287b936. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 17:38:57.207121 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-01c409fd-b522-4ebd-b85f-1d000851ae3a tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Getting quotas for user bd916293046b465d9c14870bf8887cbc and project 5f084d7d088e4d8e87c62bdcc287b936. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 17:38:57.269035 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-01c409fd-b522-4ebd-b85f-1d000851ae3a tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Going to run 1 instances... {{(pid=122256) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 17:38:57.271212 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-01c409fd-b522-4ebd-b85f-1d000851ae3a tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='555f8fe1-f4f2-47a7-9953-904c1e373e5d',volume_size=None,volume_type=None)] {{(pid=122256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 17:38:57.406211 n-d-850499-9 devstack@n-api.service[122256]: ERROR oslo.messaging._drivers.impl_rabbit [None req-01c409fd-b522-4ebd-b85f-1d000851ae3a tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [da407648-8e01-4692-9fea-e04810c81804] AMQP server on 10.222.0.61:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 31 17:38:58.414259 n-d-850499-9 devstack@n-api.service[122256]: INFO oslo.messaging._drivers.impl_rabbit [None req-01c409fd-b522-4ebd-b85f-1d000851ae3a tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [da407648-8e01-4692-9fea-e04810c81804] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 41286. Aug 31 17:38:58.418603 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-01c409fd-b522-4ebd-b85f-1d000851ae3a tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.780721 Aug 31 17:38:58.419297 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4078/8166] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 17:38:56 2022] POST /compute/v2.1/servers => generated 406 bytes in 1782 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 17:38:58.429268 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=12 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:38:58.430056 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=4 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:38:58.430726 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:38:58.434600 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f02130d1-3967-4521-a11a-f229041f961a tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:38:58.435238 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f02130d1-3967-4521-a11a-f229041f961a tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:38:58.500212 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f02130d1-3967-4521-a11a-f229041f961a tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:38:58.507062 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f02130d1-3967-4521-a11a-f229041f961a tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b" status: 200 len: 1089 microversion: 2.1 time: 0.079606 Aug 31 17:38:58.507667 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4089/8167] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:38:58 2022] GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b => generated 1089 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:38:59.529479 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-a70736a8-547a-4351-b619-0e85d0b8eb56 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:38:59.530727 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-a70736a8-547a-4351-b619-0e85d0b8eb56 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:38:59.538345 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a70736a8-547a-4351-b619-0e85d0b8eb56 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:38:59.538924 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a70736a8-547a-4351-b619-0e85d0b8eb56 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:38:59.539438 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a70736a8-547a-4351-b619-0e85d0b8eb56 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:38:59.540281 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a70736a8-547a-4351-b619-0e85d0b8eb56 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:38:59.540811 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a70736a8-547a-4351-b619-0e85d0b8eb56 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:38:59.541455 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-a70736a8-547a-4351-b619-0e85d0b8eb56 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:38:59.613838 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-a70736a8-547a-4351-b619-0e85d0b8eb56 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:38:59.622682 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-a70736a8-547a-4351-b619-0e85d0b8eb56 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b" status: 200 len: 1195 microversion: 2.1 time: 0.097910 Aug 31 17:38:59.623984 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4079/8168] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:38:59 2022] GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b => generated 1195 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:39:00.645629 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0af7d9dc-ac99-4a39-bd18-649cb95cd495 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:39:00.646408 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0af7d9dc-ac99-4a39-bd18-649cb95cd495 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:39:00.654662 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0af7d9dc-ac99-4a39-bd18-649cb95cd495 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:39:00.656390 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0af7d9dc-ac99-4a39-bd18-649cb95cd495 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:39:00.656857 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0af7d9dc-ac99-4a39-bd18-649cb95cd495 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:39:00.657740 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0af7d9dc-ac99-4a39-bd18-649cb95cd495 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:39:00.658224 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0af7d9dc-ac99-4a39-bd18-649cb95cd495 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:39:00.658676 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0af7d9dc-ac99-4a39-bd18-649cb95cd495 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:39:00.809516 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-0af7d9dc-ac99-4a39-bd18-649cb95cd495 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:39:00.818307 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0af7d9dc-ac99-4a39-bd18-649cb95cd495 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b" status: 200 len: 1273 microversion: 2.1 time: 0.176612 Aug 31 17:39:00.819822 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4090/8169] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:39:00 2022] GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b => generated 1273 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:39:01.016800 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-89da7bae-441d-4d97-b10f-25416ae15b08 req-ee61c4b4-ab83-478a-98db-90a5dc53a667 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b", "tag": "d6f252be-a5e6-467d-91ec-71c82e8f16a7"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:39:01.026736 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-89da7bae-441d-4d97-b10f-25416ae15b08 req-ee61c4b4-ab83-478a-98db-90a5dc53a667 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:39:01.027348 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-89da7bae-441d-4d97-b10f-25416ae15b08 req-ee61c4b4-ab83-478a-98db-90a5dc53a667 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:39:01.027906 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-89da7bae-441d-4d97-b10f-25416ae15b08 req-ee61c4b4-ab83-478a-98db-90a5dc53a667 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:39:01.040901 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-89da7bae-441d-4d97-b10f-25416ae15b08 req-ee61c4b4-ab83-478a-98db-90a5dc53a667 service nova] Creating event network-changed:d6f252be-a5e6-467d-91ec-71c82e8f16a7 for instance b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b on n-h2-850499-9 Aug 31 17:39:01.046229 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-89da7bae-441d-4d97-b10f-25416ae15b08 req-ee61c4b4-ab83-478a-98db-90a5dc53a667 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117492 Aug 31 17:39:01.047123 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4080/8170] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:39:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:39:01.841343 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b77f8c57-60d6-4f16-ac7a-a236730c623d tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:39:01.842890 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b77f8c57-60d6-4f16-ac7a-a236730c623d tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:39:01.851105 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b77f8c57-60d6-4f16-ac7a-a236730c623d tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:39:01.851641 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b77f8c57-60d6-4f16-ac7a-a236730c623d tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:39:01.852360 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b77f8c57-60d6-4f16-ac7a-a236730c623d tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:39:01.853092 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b77f8c57-60d6-4f16-ac7a-a236730c623d tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:39:01.853597 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b77f8c57-60d6-4f16-ac7a-a236730c623d tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:39:01.854040 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b77f8c57-60d6-4f16-ac7a-a236730c623d tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:39:02.005430 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b77f8c57-60d6-4f16-ac7a-a236730c623d tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:39:02.015239 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b77f8c57-60d6-4f16-ac7a-a236730c623d tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b" status: 200 len: 1273 microversion: 2.1 time: 0.177161 Aug 31 17:39:02.016262 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4091/8171] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:39:01 2022] GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b => generated 1273 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:39:03.038677 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-daad583b-394f-4144-aa06-9281f9ceb7d6 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:39:03.039510 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-daad583b-394f-4144-aa06-9281f9ceb7d6 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:39:03.046496 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-daad583b-394f-4144-aa06-9281f9ceb7d6 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:39:03.046983 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-daad583b-394f-4144-aa06-9281f9ceb7d6 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:39:03.047417 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-daad583b-394f-4144-aa06-9281f9ceb7d6 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:39:03.048135 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-daad583b-394f-4144-aa06-9281f9ceb7d6 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:39:03.048591 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-daad583b-394f-4144-aa06-9281f9ceb7d6 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:39:03.049014 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-daad583b-394f-4144-aa06-9281f9ceb7d6 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:39:03.190679 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-daad583b-394f-4144-aa06-9281f9ceb7d6 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:39:03.198437 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-daad583b-394f-4144-aa06-9281f9ceb7d6 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b" status: 200 len: 1273 microversion: 2.1 time: 0.165056 Aug 31 17:39:03.199006 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4081/8172] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:39:03 2022] GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b => generated 1273 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:39:04.220276 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f010ae94-6d4d-4165-85af-913b86865ada tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:39:04.220946 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f010ae94-6d4d-4165-85af-913b86865ada tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:39:04.228170 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f010ae94-6d4d-4165-85af-913b86865ada tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:39:04.228688 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f010ae94-6d4d-4165-85af-913b86865ada tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:39:04.229161 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f010ae94-6d4d-4165-85af-913b86865ada tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:39:04.229889 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f010ae94-6d4d-4165-85af-913b86865ada tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:39:04.230368 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f010ae94-6d4d-4165-85af-913b86865ada tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:39:04.230818 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f010ae94-6d4d-4165-85af-913b86865ada tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:39:04.366891 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f010ae94-6d4d-4165-85af-913b86865ada tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:39:04.376202 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f010ae94-6d4d-4165-85af-913b86865ada tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b" status: 200 len: 1273 microversion: 2.1 time: 0.160436 Aug 31 17:39:04.376807 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4092/8173] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:39:04 2022] GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b => generated 1273 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:39:05.398350 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8441dacd-0d03-4fc1-8ba2-c35d55b0323f tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:39:05.398949 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8441dacd-0d03-4fc1-8ba2-c35d55b0323f tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:39:05.406001 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8441dacd-0d03-4fc1-8ba2-c35d55b0323f tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:39:05.406748 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8441dacd-0d03-4fc1-8ba2-c35d55b0323f tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:39:05.407188 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8441dacd-0d03-4fc1-8ba2-c35d55b0323f tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:39:05.407989 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8441dacd-0d03-4fc1-8ba2-c35d55b0323f tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:39:05.408448 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8441dacd-0d03-4fc1-8ba2-c35d55b0323f tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:39:05.408877 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8441dacd-0d03-4fc1-8ba2-c35d55b0323f tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:39:05.543330 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8441dacd-0d03-4fc1-8ba2-c35d55b0323f tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:39:05.551284 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8441dacd-0d03-4fc1-8ba2-c35d55b0323f tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b" status: 200 len: 1261 microversion: 2.1 time: 0.156857 Aug 31 17:39:05.551886 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4082/8174] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:39:05 2022] GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b => generated 1261 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:39:06.572858 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-442801d6-4ffc-498b-948a-bf44376182d0 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:39:06.573467 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-442801d6-4ffc-498b-948a-bf44376182d0 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:39:06.581341 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-442801d6-4ffc-498b-948a-bf44376182d0 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:39:06.581839 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-442801d6-4ffc-498b-948a-bf44376182d0 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:39:06.582289 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-442801d6-4ffc-498b-948a-bf44376182d0 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:39:06.582994 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-442801d6-4ffc-498b-948a-bf44376182d0 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:39:06.583463 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-442801d6-4ffc-498b-948a-bf44376182d0 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:39:06.583929 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-442801d6-4ffc-498b-948a-bf44376182d0 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:39:06.720026 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-442801d6-4ffc-498b-948a-bf44376182d0 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:39:06.727833 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-442801d6-4ffc-498b-948a-bf44376182d0 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b" status: 200 len: 1261 microversion: 2.1 time: 0.158828 Aug 31 17:39:06.728422 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4093/8175] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:39:06 2022] GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b => generated 1261 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:39:07.750901 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f55e292d-05e2-4198-9951-097ad1067a3a tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:39:07.751660 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f55e292d-05e2-4198-9951-097ad1067a3a tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:39:07.756238 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:39:07.757401 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=6 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:39:07.767009 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f55e292d-05e2-4198-9951-097ad1067a3a tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:39:07.768192 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f55e292d-05e2-4198-9951-097ad1067a3a tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:39:07.768634 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f55e292d-05e2-4198-9951-097ad1067a3a tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:39:07.769407 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f55e292d-05e2-4198-9951-097ad1067a3a tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:39:07.769872 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f55e292d-05e2-4198-9951-097ad1067a3a tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:39:07.770301 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f55e292d-05e2-4198-9951-097ad1067a3a tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:39:07.947414 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f55e292d-05e2-4198-9951-097ad1067a3a tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:39:07.956091 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f55e292d-05e2-4198-9951-097ad1067a3a tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b" status: 200 len: 1261 microversion: 2.1 time: 0.210321 Aug 31 17:39:07.956676 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4083/8176] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:39:07 2022] GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b => generated 1261 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:39:08.981544 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-92876624-79c0-41cb-8048-2c2091c8ca8f tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:39:08.982189 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-92876624-79c0-41cb-8048-2c2091c8ca8f tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:39:08.985065 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:39:08.990669 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-92876624-79c0-41cb-8048-2c2091c8ca8f tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:39:08.991176 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-92876624-79c0-41cb-8048-2c2091c8ca8f tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:39:08.991669 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-92876624-79c0-41cb-8048-2c2091c8ca8f tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:39:08.992391 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-92876624-79c0-41cb-8048-2c2091c8ca8f tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:39:08.992869 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-92876624-79c0-41cb-8048-2c2091c8ca8f tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:39:08.993321 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-92876624-79c0-41cb-8048-2c2091c8ca8f tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:39:09.132075 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-92876624-79c0-41cb-8048-2c2091c8ca8f tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:39:09.140093 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-92876624-79c0-41cb-8048-2c2091c8ca8f tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b" status: 200 len: 1261 microversion: 2.1 time: 0.162365 Aug 31 17:39:09.140879 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4094/8177] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:39:08 2022] GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b => generated 1261 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:39:10.161600 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ce0e5206-e66a-408f-bbc3-6d0cb640ef03 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:39:10.162222 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ce0e5206-e66a-408f-bbc3-6d0cb640ef03 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:39:10.169133 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ce0e5206-e66a-408f-bbc3-6d0cb640ef03 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:39:10.169628 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ce0e5206-e66a-408f-bbc3-6d0cb640ef03 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:39:10.170077 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ce0e5206-e66a-408f-bbc3-6d0cb640ef03 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:39:10.170802 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ce0e5206-e66a-408f-bbc3-6d0cb640ef03 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:39:10.171424 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ce0e5206-e66a-408f-bbc3-6d0cb640ef03 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:39:10.172108 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ce0e5206-e66a-408f-bbc3-6d0cb640ef03 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:39:10.302447 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ce0e5206-e66a-408f-bbc3-6d0cb640ef03 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:39:10.310221 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ce0e5206-e66a-408f-bbc3-6d0cb640ef03 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b" status: 200 len: 1261 microversion: 2.1 time: 0.152650 Aug 31 17:39:10.310793 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4084/8178] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:39:10 2022] GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b => generated 1261 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 17:39:11.331155 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-274a5fe2-c2b3-4821-9f56-fc8a4e7cc1f1 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:39:11.331799 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-274a5fe2-c2b3-4821-9f56-fc8a4e7cc1f1 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:39:11.338713 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-274a5fe2-c2b3-4821-9f56-fc8a4e7cc1f1 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:39:11.339218 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-274a5fe2-c2b3-4821-9f56-fc8a4e7cc1f1 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:39:11.339721 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-274a5fe2-c2b3-4821-9f56-fc8a4e7cc1f1 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:39:11.340434 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-274a5fe2-c2b3-4821-9f56-fc8a4e7cc1f1 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:39:11.340910 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-274a5fe2-c2b3-4821-9f56-fc8a4e7cc1f1 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:39:11.341355 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-274a5fe2-c2b3-4821-9f56-fc8a4e7cc1f1 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:39:11.480159 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-274a5fe2-c2b3-4821-9f56-fc8a4e7cc1f1 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:39:11.488527 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-274a5fe2-c2b3-4821-9f56-fc8a4e7cc1f1 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b" status: 200 len: 1261 microversion: 2.1 time: 0.161342 Aug 31 17:39:11.489101 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4095/8179] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:39:11 2022] GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b => generated 1261 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:39:12.513483 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-fbc43917-398d-48c0-8956-5e2c6d6e9e1f tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:39:12.514199 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-fbc43917-398d-48c0-8956-5e2c6d6e9e1f tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:39:12.521792 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fbc43917-398d-48c0-8956-5e2c6d6e9e1f tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:39:12.522288 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fbc43917-398d-48c0-8956-5e2c6d6e9e1f tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:39:12.522731 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fbc43917-398d-48c0-8956-5e2c6d6e9e1f tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:39:12.523425 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fbc43917-398d-48c0-8956-5e2c6d6e9e1f tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:39:12.523915 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fbc43917-398d-48c0-8956-5e2c6d6e9e1f tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:39:12.524345 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fbc43917-398d-48c0-8956-5e2c6d6e9e1f tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:39:12.659997 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-fbc43917-398d-48c0-8956-5e2c6d6e9e1f tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:39:12.667728 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-fbc43917-398d-48c0-8956-5e2c6d6e9e1f tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b" status: 200 len: 1261 microversion: 2.1 time: 0.158425 Aug 31 17:39:12.668313 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4085/8180] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:39:12 2022] GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b => generated 1261 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:39:13.688409 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-fc2b3096-caf3-46be-a10a-12bb8fce918e tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:39:13.688941 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-fc2b3096-caf3-46be-a10a-12bb8fce918e tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:39:13.695869 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fc2b3096-caf3-46be-a10a-12bb8fce918e tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:39:13.696366 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fc2b3096-caf3-46be-a10a-12bb8fce918e tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:39:13.696814 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fc2b3096-caf3-46be-a10a-12bb8fce918e tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:39:13.697513 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fc2b3096-caf3-46be-a10a-12bb8fce918e tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:39:13.697979 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fc2b3096-caf3-46be-a10a-12bb8fce918e tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:39:13.698414 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-fc2b3096-caf3-46be-a10a-12bb8fce918e tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:39:13.833033 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-fc2b3096-caf3-46be-a10a-12bb8fce918e tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:39:13.840987 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-fc2b3096-caf3-46be-a10a-12bb8fce918e tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b" status: 200 len: 1261 microversion: 2.1 time: 0.156577 Aug 31 17:39:13.841628 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4096/8181] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:39:13 2022] GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b => generated 1261 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:39:14.863660 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b8d4d4ca-4880-4f32-8a9c-8210b0683cd5 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:39:14.864261 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b8d4d4ca-4880-4f32-8a9c-8210b0683cd5 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:39:14.871350 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b8d4d4ca-4880-4f32-8a9c-8210b0683cd5 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:39:14.871869 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b8d4d4ca-4880-4f32-8a9c-8210b0683cd5 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:39:14.872315 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b8d4d4ca-4880-4f32-8a9c-8210b0683cd5 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:39:14.873014 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b8d4d4ca-4880-4f32-8a9c-8210b0683cd5 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:39:14.873476 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b8d4d4ca-4880-4f32-8a9c-8210b0683cd5 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:39:14.873905 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b8d4d4ca-4880-4f32-8a9c-8210b0683cd5 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:39:15.007451 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b8d4d4ca-4880-4f32-8a9c-8210b0683cd5 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:39:15.015467 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b8d4d4ca-4880-4f32-8a9c-8210b0683cd5 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b" status: 200 len: 1261 microversion: 2.1 time: 0.156592 Aug 31 17:39:15.016075 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4086/8182] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:39:14 2022] GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b => generated 1261 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:39:16.036462 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-696308f1-605c-4691-b629-365f60ef5438 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:39:16.037097 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-696308f1-605c-4691-b629-365f60ef5438 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:39:16.044349 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-696308f1-605c-4691-b629-365f60ef5438 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:39:16.044863 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-696308f1-605c-4691-b629-365f60ef5438 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:39:16.045324 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-696308f1-605c-4691-b629-365f60ef5438 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:39:16.046042 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-696308f1-605c-4691-b629-365f60ef5438 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:39:16.046558 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-696308f1-605c-4691-b629-365f60ef5438 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:39:16.047006 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-696308f1-605c-4691-b629-365f60ef5438 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:39:16.181303 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-696308f1-605c-4691-b629-365f60ef5438 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:39:16.189905 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-696308f1-605c-4691-b629-365f60ef5438 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b" status: 200 len: 1261 microversion: 2.1 time: 0.157321 Aug 31 17:39:16.190495 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4097/8183] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:39:16 2022] GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b => generated 1261 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:39:17.210486 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d7b14d7f-a0ec-4666-b80f-1033e8165cf7 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:39:17.211157 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d7b14d7f-a0ec-4666-b80f-1033e8165cf7 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:39:17.218258 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d7b14d7f-a0ec-4666-b80f-1033e8165cf7 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:39:17.219320 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d7b14d7f-a0ec-4666-b80f-1033e8165cf7 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:39:17.219840 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d7b14d7f-a0ec-4666-b80f-1033e8165cf7 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:39:17.220609 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d7b14d7f-a0ec-4666-b80f-1033e8165cf7 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:39:17.221099 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d7b14d7f-a0ec-4666-b80f-1033e8165cf7 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:39:17.221522 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d7b14d7f-a0ec-4666-b80f-1033e8165cf7 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:39:17.362678 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-d7b14d7f-a0ec-4666-b80f-1033e8165cf7 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:39:17.371576 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d7b14d7f-a0ec-4666-b80f-1033e8165cf7 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b" status: 200 len: 1261 microversion: 2.1 time: 0.164920 Aug 31 17:39:17.372257 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4087/8184] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:39:17 2022] GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b => generated 1261 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:39:17.451664 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-dbb23242-3758-4c50-957b-c4a0a9621c2c req-83f3f9bd-51da-45dd-b5d9-8b61765bee18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b", "name": "network-vif-plugged", "status": "completed", "tag": "d6f252be-a5e6-467d-91ec-71c82e8f16a7"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:39:17.463320 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-dbb23242-3758-4c50-957b-c4a0a9621c2c req-83f3f9bd-51da-45dd-b5d9-8b61765bee18 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:39:17.463861 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-dbb23242-3758-4c50-957b-c4a0a9621c2c req-83f3f9bd-51da-45dd-b5d9-8b61765bee18 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:39:17.464315 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-dbb23242-3758-4c50-957b-c4a0a9621c2c req-83f3f9bd-51da-45dd-b5d9-8b61765bee18 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:39:17.476492 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-dbb23242-3758-4c50-957b-c4a0a9621c2c req-83f3f9bd-51da-45dd-b5d9-8b61765bee18 service nova] Creating event network-vif-plugged:d6f252be-a5e6-467d-91ec-71c82e8f16a7 for instance b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b on n-h2-850499-9 Aug 31 17:39:17.481511 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-dbb23242-3758-4c50-957b-c4a0a9621c2c req-83f3f9bd-51da-45dd-b5d9-8b61765bee18 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034144 Aug 31 17:39:17.482093 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4098/8185] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:39:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:39:18.394337 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-cfaf1eed-1abf-45c6-81d9-1cf9ffd8e055 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:39:18.394939 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-cfaf1eed-1abf-45c6-81d9-1cf9ffd8e055 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:39:18.402356 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cfaf1eed-1abf-45c6-81d9-1cf9ffd8e055 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:39:18.402856 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cfaf1eed-1abf-45c6-81d9-1cf9ffd8e055 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:39:18.403304 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cfaf1eed-1abf-45c6-81d9-1cf9ffd8e055 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:39:18.404041 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cfaf1eed-1abf-45c6-81d9-1cf9ffd8e055 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:39:18.404506 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cfaf1eed-1abf-45c6-81d9-1cf9ffd8e055 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:39:18.404939 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-cfaf1eed-1abf-45c6-81d9-1cf9ffd8e055 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:39:18.550305 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-cfaf1eed-1abf-45c6-81d9-1cf9ffd8e055 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:39:18.558197 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-cfaf1eed-1abf-45c6-81d9-1cf9ffd8e055 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b" status: 200 len: 1261 microversion: 2.1 time: 0.168461 Aug 31 17:39:18.558777 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4088/8186] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:39:18 2022] GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b => generated 1261 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:39:19.581200 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6d778da6-92f2-4241-a370-8425c28f1c30 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:39:19.581926 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6d778da6-92f2-4241-a370-8425c28f1c30 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:39:19.588237 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6d778da6-92f2-4241-a370-8425c28f1c30 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:39:19.588786 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6d778da6-92f2-4241-a370-8425c28f1c30 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:39:19.589230 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6d778da6-92f2-4241-a370-8425c28f1c30 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:39:19.589942 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6d778da6-92f2-4241-a370-8425c28f1c30 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:39:19.590416 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6d778da6-92f2-4241-a370-8425c28f1c30 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:39:19.590862 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6d778da6-92f2-4241-a370-8425c28f1c30 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:39:19.724444 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-6d778da6-92f2-4241-a370-8425c28f1c30 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:39:19.732203 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6d778da6-92f2-4241-a370-8425c28f1c30 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b" status: 200 len: 1445 microversion: 2.1 time: 0.157126 Aug 31 17:39:19.732779 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4099/8187] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:39:19 2022] GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b => generated 1445 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:39:19.752846 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-76d381d9-92dd-4a44-a1dd-c3ef70294621 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:39:19.753467 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-76d381d9-92dd-4a44-a1dd-c3ef70294621 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:39:19.760315 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-76d381d9-92dd-4a44-a1dd-c3ef70294621 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:39:19.760806 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-76d381d9-92dd-4a44-a1dd-c3ef70294621 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:39:19.761243 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-76d381d9-92dd-4a44-a1dd-c3ef70294621 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:39:19.761935 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-76d381d9-92dd-4a44-a1dd-c3ef70294621 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:39:19.762396 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-76d381d9-92dd-4a44-a1dd-c3ef70294621 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:39:19.762823 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-76d381d9-92dd-4a44-a1dd-c3ef70294621 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:39:19.908057 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-76d381d9-92dd-4a44-a1dd-c3ef70294621 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:39:19.915936 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-76d381d9-92dd-4a44-a1dd-c3ef70294621 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b" status: 200 len: 1445 microversion: 2.1 time: 0.167042 Aug 31 17:39:19.916518 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4089/8188] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:39:19 2022] GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b => generated 1445 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:39:21.957609 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-8129abec-0994-4a38-a0e0-7047dbb4b511 req-270fddbb-9e30-423d-bce5-9d497ff73505 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b", "tag": "d6f252be-a5e6-467d-91ec-71c82e8f16a7"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:39:21.967832 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-8129abec-0994-4a38-a0e0-7047dbb4b511 req-270fddbb-9e30-423d-bce5-9d497ff73505 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:39:21.968328 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-8129abec-0994-4a38-a0e0-7047dbb4b511 req-270fddbb-9e30-423d-bce5-9d497ff73505 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:39:21.968769 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-8129abec-0994-4a38-a0e0-7047dbb4b511 req-270fddbb-9e30-423d-bce5-9d497ff73505 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:39:21.980760 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-8129abec-0994-4a38-a0e0-7047dbb4b511 req-270fddbb-9e30-423d-bce5-9d497ff73505 service nova] Creating event network-changed:d6f252be-a5e6-467d-91ec-71c82e8f16a7 for instance b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b on n-h2-850499-9 Aug 31 17:39:21.986774 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-8129abec-0994-4a38-a0e0-7047dbb4b511 req-270fddbb-9e30-423d-bce5-9d497ff73505 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033427 Aug 31 17:39:21.987380 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4100/8189] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:39:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 17:41:14.269819 n-d-850499-9 devstack@n-api.service[122256]: ERROR oslo.messaging._drivers.impl_rabbit [-] [46519162-dc0d-41cb-af5d-7b19f3bd0573] AMQP server on 10.222.0.61:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 31 17:41:14.271018 n-d-850499-9 devstack@n-api.service[122256]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0cd6dd6f-a50d-4cf4-8d95-237d76a72b0e] AMQP server on 10.222.0.61:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 31 17:41:14.271602 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:41:14.272338 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=64 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:41:14.273772 n-d-850499-9 devstack@n-api.service[122256]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 31 17:41:14.273941 n-d-850499-9 devstack@n-api.service[122256]: Wed Aug 31 17:41:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b/action (ip 10.222.0.61) !!! Aug 31 17:41:14.279691 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5256ca8b-022a-40ab-be9d-160161acd114 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:41:14.280222 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5256ca8b-022a-40ab-be9d-160161acd114 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:41:14.290256 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5256ca8b-022a-40ab-be9d-160161acd114 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:41:14.290745 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5256ca8b-022a-40ab-be9d-160161acd114 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:41:14.291274 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5256ca8b-022a-40ab-be9d-160161acd114 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:41:14.292013 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5256ca8b-022a-40ab-be9d-160161acd114 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:41:14.292463 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5256ca8b-022a-40ab-be9d-160161acd114 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:41:14.293600 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5256ca8b-022a-40ab-be9d-160161acd114 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:41:14.318591 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.objects.instance [None req-5256ca8b-022a-40ab-be9d-160161acd114 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lazy-loading 'flavor' on Instance uuid b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b {{(pid=122256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 17:41:14.394146 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5256ca8b-022a-40ab-be9d-160161acd114 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "POST /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b/action" status: 202 len: 0 microversion: 2.1 time: 0.125919 Aug 31 17:41:14.394811 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4090/8190] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 17:41:14 2022] POST /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 17:41:14.401879 n-d-850499-9 devstack@n-api.service[122257]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8b198bdc-d1f7-4259-9144-ce56665d9587] AMQP server on 10.222.0.61:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 31 17:41:14.403889 n-d-850499-9 devstack@n-api.service[122257]: ERROR oslo.messaging._drivers.impl_rabbit [-] [400e2b90-e189-478a-9cc4-4b0bfcefc34a] AMQP server on 10.222.0.61:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 31 17:41:14.404846 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=26 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:41:14.405613 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=58 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:41:14.407548 n-d-850499-9 devstack@n-api.service[122257]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 31 17:41:14.407880 n-d-850499-9 devstack@n-api.service[122257]: Wed Aug 31 17:41:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b (ip 10.222.0.61) !!! Aug 31 17:41:14.410110 n-d-850499-9 devstack@n-api.service[122257]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 17:41:14.410317 n-d-850499-9 devstack@n-api.service[122257]: Wed Aug 31 17:41:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b (ip 10.222.0.61) !!! Aug 31 17:41:14.417552 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-17675c91-d39a-4256-af8d-b6eee33d5dc2 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:41:14.418650 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-17675c91-d39a-4256-af8d-b6eee33d5dc2 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:41:14.430002 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-17675c91-d39a-4256-af8d-b6eee33d5dc2 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:41:14.430513 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-17675c91-d39a-4256-af8d-b6eee33d5dc2 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:41:14.430966 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-17675c91-d39a-4256-af8d-b6eee33d5dc2 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:41:14.431742 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-17675c91-d39a-4256-af8d-b6eee33d5dc2 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:41:14.432217 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-17675c91-d39a-4256-af8d-b6eee33d5dc2 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:41:14.432665 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-17675c91-d39a-4256-af8d-b6eee33d5dc2 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:41:14.624746 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-17675c91-d39a-4256-af8d-b6eee33d5dc2 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:41:14.632594 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-17675c91-d39a-4256-af8d-b6eee33d5dc2 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b" status: 200 len: 1570 microversion: 2.1 time: 0.232887 Aug 31 17:41:14.633190 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4101/8191] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:41:14 2022] GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b => generated 1570 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:41:15.655430 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-edb62d95-c7b3-439d-8e65-fd9b3cf7df47 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:41:15.656169 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-edb62d95-c7b3-439d-8e65-fd9b3cf7df47 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:41:15.666391 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-edb62d95-c7b3-439d-8e65-fd9b3cf7df47 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:41:15.666817 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-edb62d95-c7b3-439d-8e65-fd9b3cf7df47 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:41:15.667258 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-edb62d95-c7b3-439d-8e65-fd9b3cf7df47 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:41:15.668586 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-edb62d95-c7b3-439d-8e65-fd9b3cf7df47 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:41:15.669047 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-edb62d95-c7b3-439d-8e65-fd9b3cf7df47 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:41:15.669468 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-edb62d95-c7b3-439d-8e65-fd9b3cf7df47 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:41:15.676979 n-d-850499-9 devstack@n-api.service[122256]: INFO oslo.messaging._drivers.impl_rabbit [-] [46519162-dc0d-41cb-af5d-7b19f3bd0573] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 41412. Aug 31 17:41:15.680188 n-d-850499-9 devstack@n-api.service[122256]: INFO oslo.messaging._drivers.impl_rabbit [-] [0cd6dd6f-a50d-4cf4-8d95-237d76a72b0e] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 41414. Aug 31 17:41:15.857351 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-edb62d95-c7b3-439d-8e65-fd9b3cf7df47 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:41:15.865372 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-edb62d95-c7b3-439d-8e65-fd9b3cf7df47 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b" status: 200 len: 1570 microversion: 2.1 time: 0.214849 Aug 31 17:41:15.865945 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4091/8192] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:41:15 2022] GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b => generated 1570 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:41:16.886594 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c91a1ed0-c5c8-42e8-8146-de6aba9cc802 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:41:16.887555 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c91a1ed0-c5c8-42e8-8146-de6aba9cc802 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:41:16.901871 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c91a1ed0-c5c8-42e8-8146-de6aba9cc802 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:41:16.902449 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c91a1ed0-c5c8-42e8-8146-de6aba9cc802 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:41:16.903101 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c91a1ed0-c5c8-42e8-8146-de6aba9cc802 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:41:16.903865 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c91a1ed0-c5c8-42e8-8146-de6aba9cc802 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:41:16.904342 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c91a1ed0-c5c8-42e8-8146-de6aba9cc802 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:41:16.904790 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c91a1ed0-c5c8-42e8-8146-de6aba9cc802 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:41:16.912039 n-d-850499-9 devstack@n-api.service[122257]: INFO oslo.messaging._drivers.impl_rabbit [-] [400e2b90-e189-478a-9cc4-4b0bfcefc34a] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 41422. Aug 31 17:41:16.915185 n-d-850499-9 devstack@n-api.service[122257]: INFO oslo.messaging._drivers.impl_rabbit [-] [8b198bdc-d1f7-4259-9144-ce56665d9587] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 41420. Aug 31 17:41:17.043653 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-c91a1ed0-c5c8-42e8-8146-de6aba9cc802 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:41:17.051736 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c91a1ed0-c5c8-42e8-8146-de6aba9cc802 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b" status: 200 len: 1570 microversion: 2.1 time: 0.169151 Aug 31 17:41:17.052326 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4102/8193] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:41:16 2022] GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b => generated 1570 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:41:18.074128 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-8d899b41-6f29-4451-807b-a7d726670da7 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:41:18.075250 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-8d899b41-6f29-4451-807b-a7d726670da7 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:41:18.082028 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8d899b41-6f29-4451-807b-a7d726670da7 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:41:18.082515 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8d899b41-6f29-4451-807b-a7d726670da7 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:41:18.082955 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8d899b41-6f29-4451-807b-a7d726670da7 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:41:18.083673 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8d899b41-6f29-4451-807b-a7d726670da7 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:41:18.084126 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8d899b41-6f29-4451-807b-a7d726670da7 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:41:18.084582 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-8d899b41-6f29-4451-807b-a7d726670da7 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:41:18.218383 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-8d899b41-6f29-4451-807b-a7d726670da7 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:41:18.226233 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-8d899b41-6f29-4451-807b-a7d726670da7 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b" status: 200 len: 1570 microversion: 2.1 time: 0.156451 Aug 31 17:41:18.226815 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4092/8194] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:41:18 2022] GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:41:19.249200 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-cc3a9fa5-cbe9-4519-ad4f-7b9d7c15845a tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:41:19.249727 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-cc3a9fa5-cbe9-4519-ad4f-7b9d7c15845a tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:41:19.256681 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cc3a9fa5-cbe9-4519-ad4f-7b9d7c15845a tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:41:19.257184 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cc3a9fa5-cbe9-4519-ad4f-7b9d7c15845a tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:41:19.257644 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cc3a9fa5-cbe9-4519-ad4f-7b9d7c15845a tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:41:19.258356 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cc3a9fa5-cbe9-4519-ad4f-7b9d7c15845a tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:41:19.258835 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cc3a9fa5-cbe9-4519-ad4f-7b9d7c15845a tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:41:19.259281 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-cc3a9fa5-cbe9-4519-ad4f-7b9d7c15845a tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:41:19.400553 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-cc3a9fa5-cbe9-4519-ad4f-7b9d7c15845a tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:41:19.408896 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-cc3a9fa5-cbe9-4519-ad4f-7b9d7c15845a tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b" status: 200 len: 1570 microversion: 2.1 time: 0.164475 Aug 31 17:41:19.409499 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4103/8195] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:41:19 2022] GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b => generated 1570 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:41:20.429687 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1f04e9e3-108f-4cd7-80e0-4465bd37580d tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:41:20.430290 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1f04e9e3-108f-4cd7-80e0-4465bd37580d tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:41:20.438555 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1f04e9e3-108f-4cd7-80e0-4465bd37580d tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:41:20.439063 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1f04e9e3-108f-4cd7-80e0-4465bd37580d tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:41:20.439534 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1f04e9e3-108f-4cd7-80e0-4465bd37580d tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:41:20.440360 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1f04e9e3-108f-4cd7-80e0-4465bd37580d tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:41:20.440848 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1f04e9e3-108f-4cd7-80e0-4465bd37580d tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:41:20.441290 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1f04e9e3-108f-4cd7-80e0-4465bd37580d tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:41:20.579178 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-1f04e9e3-108f-4cd7-80e0-4465bd37580d tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:41:20.587747 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1f04e9e3-108f-4cd7-80e0-4465bd37580d tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b" status: 200 len: 1570 microversion: 2.1 time: 0.162019 Aug 31 17:41:20.588342 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4093/8196] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:41:20 2022] GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b => generated 1570 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:41:21.608201 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ffac6e45-f21f-4f5f-8d9f-599d6b3ab8f5 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:41:21.608828 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ffac6e45-f21f-4f5f-8d9f-599d6b3ab8f5 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:41:21.616148 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ffac6e45-f21f-4f5f-8d9f-599d6b3ab8f5 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:41:21.616755 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ffac6e45-f21f-4f5f-8d9f-599d6b3ab8f5 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:41:21.617211 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ffac6e45-f21f-4f5f-8d9f-599d6b3ab8f5 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:41:21.617950 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ffac6e45-f21f-4f5f-8d9f-599d6b3ab8f5 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:41:21.618460 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ffac6e45-f21f-4f5f-8d9f-599d6b3ab8f5 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:41:21.618903 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ffac6e45-f21f-4f5f-8d9f-599d6b3ab8f5 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:41:21.757197 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ffac6e45-f21f-4f5f-8d9f-599d6b3ab8f5 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:41:21.765716 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ffac6e45-f21f-4f5f-8d9f-599d6b3ab8f5 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b" status: 200 len: 1570 microversion: 2.1 time: 0.161554 Aug 31 17:41:21.766294 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4104/8197] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:41:21 2022] GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b => generated 1570 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:41:22.786086 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e316cf76-3d70-4f53-826c-a6e46e3ce62e tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:41:22.786704 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e316cf76-3d70-4f53-826c-a6e46e3ce62e tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:41:22.794115 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e316cf76-3d70-4f53-826c-a6e46e3ce62e tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:41:22.794823 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e316cf76-3d70-4f53-826c-a6e46e3ce62e tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:41:22.795277 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e316cf76-3d70-4f53-826c-a6e46e3ce62e tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:41:22.796010 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e316cf76-3d70-4f53-826c-a6e46e3ce62e tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:41:22.796471 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e316cf76-3d70-4f53-826c-a6e46e3ce62e tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:41:22.796904 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e316cf76-3d70-4f53-826c-a6e46e3ce62e tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:41:22.935524 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e316cf76-3d70-4f53-826c-a6e46e3ce62e tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:41:22.943309 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e316cf76-3d70-4f53-826c-a6e46e3ce62e tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b" status: 200 len: 1570 microversion: 2.1 time: 0.161393 Aug 31 17:41:22.943990 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4094/8198] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:41:22 2022] GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b => generated 1570 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:41:23.964751 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-253eb10c-cb03-4e40-9e94-1a176e78cecb tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:41:23.965691 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-253eb10c-cb03-4e40-9e94-1a176e78cecb tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:41:23.972812 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-253eb10c-cb03-4e40-9e94-1a176e78cecb tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:41:23.973398 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-253eb10c-cb03-4e40-9e94-1a176e78cecb tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:41:23.973866 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-253eb10c-cb03-4e40-9e94-1a176e78cecb tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:41:23.974625 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-253eb10c-cb03-4e40-9e94-1a176e78cecb tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:41:23.975105 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-253eb10c-cb03-4e40-9e94-1a176e78cecb tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:41:23.975578 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-253eb10c-cb03-4e40-9e94-1a176e78cecb tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:41:24.119591 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-253eb10c-cb03-4e40-9e94-1a176e78cecb tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:41:24.128410 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-253eb10c-cb03-4e40-9e94-1a176e78cecb tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b" status: 200 len: 1570 microversion: 2.1 time: 0.167589 Aug 31 17:41:24.129000 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4105/8199] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:41:23 2022] GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b => generated 1570 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:41:25.150531 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2a22a616-393a-4c21-ba93-cc5e4f31cd00 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:41:25.151168 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2a22a616-393a-4c21-ba93-cc5e4f31cd00 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:41:25.159014 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2a22a616-393a-4c21-ba93-cc5e4f31cd00 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:41:25.159535 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2a22a616-393a-4c21-ba93-cc5e4f31cd00 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:41:25.159977 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2a22a616-393a-4c21-ba93-cc5e4f31cd00 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:41:25.160684 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2a22a616-393a-4c21-ba93-cc5e4f31cd00 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:41:25.161147 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2a22a616-393a-4c21-ba93-cc5e4f31cd00 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:41:25.161601 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2a22a616-393a-4c21-ba93-cc5e4f31cd00 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:41:25.294323 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-2a22a616-393a-4c21-ba93-cc5e4f31cd00 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:41:25.302442 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2a22a616-393a-4c21-ba93-cc5e4f31cd00 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b" status: 200 len: 1570 microversion: 2.1 time: 0.155866 Aug 31 17:41:25.303019 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4095/8200] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:41:25 2022] GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:41:26.324225 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9c46066c-c391-40b2-8665-3cac42c94942 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:41:26.325073 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9c46066c-c391-40b2-8665-3cac42c94942 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:41:26.332037 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9c46066c-c391-40b2-8665-3cac42c94942 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:41:26.332538 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9c46066c-c391-40b2-8665-3cac42c94942 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:41:26.332985 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9c46066c-c391-40b2-8665-3cac42c94942 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:41:26.333695 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9c46066c-c391-40b2-8665-3cac42c94942 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:41:26.334158 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9c46066c-c391-40b2-8665-3cac42c94942 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:41:26.334593 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9c46066c-c391-40b2-8665-3cac42c94942 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:41:26.468128 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9c46066c-c391-40b2-8665-3cac42c94942 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:41:26.475993 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9c46066c-c391-40b2-8665-3cac42c94942 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b" status: 200 len: 1570 microversion: 2.1 time: 0.155653 Aug 31 17:41:26.476574 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4106/8201] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:41:26 2022] GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:41:27.496214 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b9fe8cb6-9c10-44dc-a4e6-e5fe5db12e11 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:41:27.497811 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b9fe8cb6-9c10-44dc-a4e6-e5fe5db12e11 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:41:27.504922 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b9fe8cb6-9c10-44dc-a4e6-e5fe5db12e11 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:41:27.505411 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b9fe8cb6-9c10-44dc-a4e6-e5fe5db12e11 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:41:27.505861 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b9fe8cb6-9c10-44dc-a4e6-e5fe5db12e11 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:41:27.506573 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b9fe8cb6-9c10-44dc-a4e6-e5fe5db12e11 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:41:27.507064 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b9fe8cb6-9c10-44dc-a4e6-e5fe5db12e11 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:41:27.507524 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b9fe8cb6-9c10-44dc-a4e6-e5fe5db12e11 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:41:27.649791 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b9fe8cb6-9c10-44dc-a4e6-e5fe5db12e11 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:41:27.658033 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b9fe8cb6-9c10-44dc-a4e6-e5fe5db12e11 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b" status: 200 len: 1570 microversion: 2.1 time: 0.165875 Aug 31 17:41:27.658610 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4096/8202] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:41:27 2022] GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b => generated 1570 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:41:28.679630 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-bbf4d95f-640f-4f65-b831-f4d7dd6fa504 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:41:28.680266 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-bbf4d95f-640f-4f65-b831-f4d7dd6fa504 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:41:28.689517 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bbf4d95f-640f-4f65-b831-f4d7dd6fa504 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:41:28.690056 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bbf4d95f-640f-4f65-b831-f4d7dd6fa504 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:41:28.690516 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bbf4d95f-640f-4f65-b831-f4d7dd6fa504 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:41:28.691250 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bbf4d95f-640f-4f65-b831-f4d7dd6fa504 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:41:28.691761 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bbf4d95f-640f-4f65-b831-f4d7dd6fa504 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:41:28.692266 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bbf4d95f-640f-4f65-b831-f4d7dd6fa504 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:41:28.834950 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-bbf4d95f-640f-4f65-b831-f4d7dd6fa504 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:41:28.843745 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-bbf4d95f-640f-4f65-b831-f4d7dd6fa504 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b" status: 200 len: 1570 microversion: 2.1 time: 0.168118 Aug 31 17:41:28.844342 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4107/8203] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:41:28 2022] GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b => generated 1570 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:41:29.865176 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-972f38a5-6fa8-4f8d-b5e2-f807dcf1da7e tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:41:29.865832 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-972f38a5-6fa8-4f8d-b5e2-f807dcf1da7e tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:41:29.873323 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-972f38a5-6fa8-4f8d-b5e2-f807dcf1da7e tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:41:29.873808 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-972f38a5-6fa8-4f8d-b5e2-f807dcf1da7e tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:41:29.874245 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-972f38a5-6fa8-4f8d-b5e2-f807dcf1da7e tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:41:29.874940 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-972f38a5-6fa8-4f8d-b5e2-f807dcf1da7e tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:41:29.875406 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-972f38a5-6fa8-4f8d-b5e2-f807dcf1da7e tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:41:29.875862 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-972f38a5-6fa8-4f8d-b5e2-f807dcf1da7e tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:41:30.023698 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-972f38a5-6fa8-4f8d-b5e2-f807dcf1da7e tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:41:30.031771 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-972f38a5-6fa8-4f8d-b5e2-f807dcf1da7e tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b" status: 200 len: 1511 microversion: 2.1 time: 0.170457 Aug 31 17:41:30.032703 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4097/8204] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:41:29 2022] GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b => generated 1511 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:41:30.052848 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-c5263d8c-4ea0-4169-99e0-e9c4b08aacb8 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:41:30.053463 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c5263d8c-4ea0-4169-99e0-e9c4b08aacb8 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:41:30.061740 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c5263d8c-4ea0-4169-99e0-e9c4b08aacb8 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:41:30.062248 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c5263d8c-4ea0-4169-99e0-e9c4b08aacb8 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:41:30.062698 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c5263d8c-4ea0-4169-99e0-e9c4b08aacb8 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:41:30.063416 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c5263d8c-4ea0-4169-99e0-e9c4b08aacb8 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:41:30.063945 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c5263d8c-4ea0-4169-99e0-e9c4b08aacb8 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:41:30.064385 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-c5263d8c-4ea0-4169-99e0-e9c4b08aacb8 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:41:30.126057 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-c5e0b2f6-8292-4e11-8889-58a505e5c0e4 req-1ff5b56b-d76d-48e5-93df-bcd630ca0bb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b", "name": "network-vif-unplugged", "status": "completed", "tag": "d6f252be-a5e6-467d-91ec-71c82e8f16a7"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:41:30.136988 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-c5e0b2f6-8292-4e11-8889-58a505e5c0e4 req-1ff5b56b-d76d-48e5-93df-bcd630ca0bb7 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:41:30.138244 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-c5e0b2f6-8292-4e11-8889-58a505e5c0e4 req-1ff5b56b-d76d-48e5-93df-bcd630ca0bb7 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:41:30.138883 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-c5e0b2f6-8292-4e11-8889-58a505e5c0e4 req-1ff5b56b-d76d-48e5-93df-bcd630ca0bb7 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:41:30.154188 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.compute.server_external_events [req-c5e0b2f6-8292-4e11-8889-58a505e5c0e4 req-1ff5b56b-d76d-48e5-93df-bcd630ca0bb7 service nova] Unable to find a host for instance b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b. Dropping event network-vif-unplugged {{(pid=122256) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 31 17:41:30.155219 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-c5e0b2f6-8292-4e11-8889-58a505e5c0e4 req-1ff5b56b-d76d-48e5-93df-bcd630ca0bb7 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.085199 Aug 31 17:41:30.155854 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4098/8205] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:41:30 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 88 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 31 17:41:30.167234 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-c5263d8c-4ea0-4169-99e0-e9c4b08aacb8 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122257) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 31 17:41:30.233150 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-c5263d8c-4ea0-4169-99e0-e9c4b08aacb8 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "POST /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b/action" status: 202 len: 0 microversion: 2.1 time: 0.184098 Aug 31 17:41:30.233769 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4108/8206] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 17:41:30 2022] POST /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b/action => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 17:41:30.242035 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-4587a52a-1abe-4b78-a059-8fa24ae7d3f8 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:41:30.242783 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-4587a52a-1abe-4b78-a059-8fa24ae7d3f8 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:41:30.249639 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4587a52a-1abe-4b78-a059-8fa24ae7d3f8 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:41:30.250190 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4587a52a-1abe-4b78-a059-8fa24ae7d3f8 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:41:30.250630 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4587a52a-1abe-4b78-a059-8fa24ae7d3f8 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:41:30.252089 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4587a52a-1abe-4b78-a059-8fa24ae7d3f8 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:41:30.252573 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4587a52a-1abe-4b78-a059-8fa24ae7d3f8 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:41:30.253007 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-4587a52a-1abe-4b78-a059-8fa24ae7d3f8 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:41:30.401174 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-4587a52a-1abe-4b78-a059-8fa24ae7d3f8 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:41:30.409644 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-4587a52a-1abe-4b78-a059-8fa24ae7d3f8 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b" status: 200 len: 1519 microversion: 2.1 time: 0.171447 Aug 31 17:41:30.410227 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4099/8207] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:41:30 2022] GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b => generated 1519 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:41:31.432556 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-bafa7f90-c78e-4582-ba2c-09cd00625fcf tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:41:31.433103 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-bafa7f90-c78e-4582-ba2c-09cd00625fcf tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:41:31.443004 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bafa7f90-c78e-4582-ba2c-09cd00625fcf tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:41:31.443529 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bafa7f90-c78e-4582-ba2c-09cd00625fcf tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:41:31.443981 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bafa7f90-c78e-4582-ba2c-09cd00625fcf tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:41:31.444691 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bafa7f90-c78e-4582-ba2c-09cd00625fcf tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:41:31.445166 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bafa7f90-c78e-4582-ba2c-09cd00625fcf tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:41:31.445603 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bafa7f90-c78e-4582-ba2c-09cd00625fcf tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:41:31.580443 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-bafa7f90-c78e-4582-ba2c-09cd00625fcf tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:41:31.588329 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-bafa7f90-c78e-4582-ba2c-09cd00625fcf tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b" status: 200 len: 1521 microversion: 2.1 time: 0.160592 Aug 31 17:41:31.588894 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4109/8208] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:41:31 2022] GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 17:41:32.610104 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-12f26f72-9fea-4138-b5fb-215247a47eb3 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:41:32.610710 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-12f26f72-9fea-4138-b5fb-215247a47eb3 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:41:32.617301 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-12f26f72-9fea-4138-b5fb-215247a47eb3 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:41:32.617786 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-12f26f72-9fea-4138-b5fb-215247a47eb3 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:41:32.618220 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-12f26f72-9fea-4138-b5fb-215247a47eb3 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:41:32.618911 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-12f26f72-9fea-4138-b5fb-215247a47eb3 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:41:32.619388 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-12f26f72-9fea-4138-b5fb-215247a47eb3 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:41:32.619825 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-12f26f72-9fea-4138-b5fb-215247a47eb3 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:41:32.756578 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-12f26f72-9fea-4138-b5fb-215247a47eb3 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:41:32.765018 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-12f26f72-9fea-4138-b5fb-215247a47eb3 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b" status: 200 len: 1521 microversion: 2.1 time: 0.158854 Aug 31 17:41:32.765600 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4100/8209] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:41:32 2022] GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:41:33.788022 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-816201e8-288e-41e1-a33b-849fbd9dd1f2 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:41:33.788755 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-816201e8-288e-41e1-a33b-849fbd9dd1f2 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:41:33.795932 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-816201e8-288e-41e1-a33b-849fbd9dd1f2 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:41:33.796434 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-816201e8-288e-41e1-a33b-849fbd9dd1f2 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:41:33.796887 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-816201e8-288e-41e1-a33b-849fbd9dd1f2 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:41:33.797596 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-816201e8-288e-41e1-a33b-849fbd9dd1f2 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:41:33.798064 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-816201e8-288e-41e1-a33b-849fbd9dd1f2 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:41:33.798501 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-816201e8-288e-41e1-a33b-849fbd9dd1f2 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:41:33.940068 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-816201e8-288e-41e1-a33b-849fbd9dd1f2 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:41:33.948531 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-816201e8-288e-41e1-a33b-849fbd9dd1f2 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b" status: 200 len: 1521 microversion: 2.1 time: 0.164362 Aug 31 17:41:33.949127 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4110/8210] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:41:33 2022] GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:41:34.971035 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-64d4abdf-62e8-4c23-a50a-a2b444d2aec2 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:41:34.971725 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-64d4abdf-62e8-4c23-a50a-a2b444d2aec2 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:41:34.978659 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-64d4abdf-62e8-4c23-a50a-a2b444d2aec2 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:41:34.979157 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-64d4abdf-62e8-4c23-a50a-a2b444d2aec2 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:41:34.979628 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-64d4abdf-62e8-4c23-a50a-a2b444d2aec2 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:41:34.980340 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-64d4abdf-62e8-4c23-a50a-a2b444d2aec2 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:41:34.980851 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-64d4abdf-62e8-4c23-a50a-a2b444d2aec2 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:41:34.981374 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-64d4abdf-62e8-4c23-a50a-a2b444d2aec2 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:41:35.125197 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-64d4abdf-62e8-4c23-a50a-a2b444d2aec2 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:41:35.134788 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-64d4abdf-62e8-4c23-a50a-a2b444d2aec2 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b" status: 200 len: 1521 microversion: 2.1 time: 0.167620 Aug 31 17:41:35.135371 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4101/8211] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:41:34 2022] GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 17:41:36.156859 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-2896a295-4695-4c3e-b030-fd8d8557bcff tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:41:36.157747 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-2896a295-4695-4c3e-b030-fd8d8557bcff tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:41:36.164781 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2896a295-4695-4c3e-b030-fd8d8557bcff tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:41:36.165282 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2896a295-4695-4c3e-b030-fd8d8557bcff tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:41:36.165733 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2896a295-4695-4c3e-b030-fd8d8557bcff tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:41:36.166434 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2896a295-4695-4c3e-b030-fd8d8557bcff tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:41:36.166903 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2896a295-4695-4c3e-b030-fd8d8557bcff tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:41:36.167342 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-2896a295-4695-4c3e-b030-fd8d8557bcff tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:41:36.305804 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-2896a295-4695-4c3e-b030-fd8d8557bcff tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:41:36.314505 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-2896a295-4695-4c3e-b030-fd8d8557bcff tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b" status: 200 len: 1577 microversion: 2.1 time: 0.161498 Aug 31 17:41:36.315384 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4111/8212] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:41:36 2022] GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b => generated 1577 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:41:37.336159 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-e5a4e1a0-a819-4058-bf35-736098b22844 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:41:37.336786 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-e5a4e1a0-a819-4058-bf35-736098b22844 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:41:37.344557 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e5a4e1a0-a819-4058-bf35-736098b22844 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:41:37.345049 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e5a4e1a0-a819-4058-bf35-736098b22844 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:41:37.345490 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e5a4e1a0-a819-4058-bf35-736098b22844 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:41:37.346190 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e5a4e1a0-a819-4058-bf35-736098b22844 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:41:37.346652 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e5a4e1a0-a819-4058-bf35-736098b22844 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:41:37.347084 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-e5a4e1a0-a819-4058-bf35-736098b22844 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:41:37.486085 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-e5a4e1a0-a819-4058-bf35-736098b22844 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:41:37.493921 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-e5a4e1a0-a819-4058-bf35-736098b22844 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b" status: 200 len: 1577 microversion: 2.1 time: 0.161880 Aug 31 17:41:37.494498 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4102/8213] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:41:37 2022] GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b => generated 1577 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:41:38.515966 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-bdbe43be-a4a1-4343-bff4-28c9dad9581b tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:41:38.516617 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-bdbe43be-a4a1-4343-bff4-28c9dad9581b tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:41:38.523720 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bdbe43be-a4a1-4343-bff4-28c9dad9581b tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:41:38.524251 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bdbe43be-a4a1-4343-bff4-28c9dad9581b tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:41:38.524708 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bdbe43be-a4a1-4343-bff4-28c9dad9581b tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:41:38.525445 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bdbe43be-a4a1-4343-bff4-28c9dad9581b tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:41:38.525920 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bdbe43be-a4a1-4343-bff4-28c9dad9581b tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:41:38.526362 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-bdbe43be-a4a1-4343-bff4-28c9dad9581b tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:41:38.660034 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-bdbe43be-a4a1-4343-bff4-28c9dad9581b tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:41:38.668639 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-bdbe43be-a4a1-4343-bff4-28c9dad9581b tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b" status: 200 len: 1577 microversion: 2.1 time: 0.157280 Aug 31 17:41:38.669353 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4112/8214] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:41:38 2022] GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b => generated 1577 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:41:39.692341 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0e5c7d54-dcdb-4d14-95d7-f533f1b93342 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:41:39.693195 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0e5c7d54-dcdb-4d14-95d7-f533f1b93342 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:41:39.700661 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0e5c7d54-dcdb-4d14-95d7-f533f1b93342 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:41:39.701213 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0e5c7d54-dcdb-4d14-95d7-f533f1b93342 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:41:39.701720 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0e5c7d54-dcdb-4d14-95d7-f533f1b93342 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:41:39.702514 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0e5c7d54-dcdb-4d14-95d7-f533f1b93342 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:41:39.703197 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0e5c7d54-dcdb-4d14-95d7-f533f1b93342 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:41:39.703715 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0e5c7d54-dcdb-4d14-95d7-f533f1b93342 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:41:39.847790 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-0e5c7d54-dcdb-4d14-95d7-f533f1b93342 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:41:39.855974 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0e5c7d54-dcdb-4d14-95d7-f533f1b93342 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b" status: 200 len: 1577 microversion: 2.1 time: 0.168157 Aug 31 17:41:39.857498 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4103/8215] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:41:39 2022] GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b => generated 1577 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:41:40.877561 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-34003f4b-a902-40f9-a83e-51d9274e9cf5 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:41:40.878192 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-34003f4b-a902-40f9-a83e-51d9274e9cf5 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:41:40.885236 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-34003f4b-a902-40f9-a83e-51d9274e9cf5 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:41:40.885738 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-34003f4b-a902-40f9-a83e-51d9274e9cf5 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:41:40.886193 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-34003f4b-a902-40f9-a83e-51d9274e9cf5 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:41:40.886909 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-34003f4b-a902-40f9-a83e-51d9274e9cf5 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:41:40.887951 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-34003f4b-a902-40f9-a83e-51d9274e9cf5 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:41:40.888937 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-34003f4b-a902-40f9-a83e-51d9274e9cf5 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:41:41.025506 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-34003f4b-a902-40f9-a83e-51d9274e9cf5 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:41:41.034923 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-34003f4b-a902-40f9-a83e-51d9274e9cf5 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b" status: 200 len: 1577 microversion: 2.1 time: 0.161387 Aug 31 17:41:41.035523 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4113/8216] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:41:40 2022] GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b => generated 1577 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:41:42.056015 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9e6c8b06-9e44-4c48-930a-43bec93d940a tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:41:42.056610 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9e6c8b06-9e44-4c48-930a-43bec93d940a tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:41:42.063711 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9e6c8b06-9e44-4c48-930a-43bec93d940a tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:41:42.064202 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9e6c8b06-9e44-4c48-930a-43bec93d940a tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:41:42.064644 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9e6c8b06-9e44-4c48-930a-43bec93d940a tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:41:42.065337 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9e6c8b06-9e44-4c48-930a-43bec93d940a tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:41:42.065798 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9e6c8b06-9e44-4c48-930a-43bec93d940a tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:41:42.066229 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9e6c8b06-9e44-4c48-930a-43bec93d940a tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:41:42.197425 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-9e6c8b06-9e44-4c48-930a-43bec93d940a tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:41:42.205497 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9e6c8b06-9e44-4c48-930a-43bec93d940a tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b" status: 200 len: 1577 microversion: 2.1 time: 0.153275 Aug 31 17:41:42.205993 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4104/8217] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:41:42 2022] GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b => generated 1577 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:41:43.227306 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-881e8d79-23d4-4c71-82b5-ac52b83538e2 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:41:43.227994 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-881e8d79-23d4-4c71-82b5-ac52b83538e2 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:41:43.235511 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-881e8d79-23d4-4c71-82b5-ac52b83538e2 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:41:43.236029 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-881e8d79-23d4-4c71-82b5-ac52b83538e2 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:41:43.236491 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-881e8d79-23d4-4c71-82b5-ac52b83538e2 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:41:43.237207 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-881e8d79-23d4-4c71-82b5-ac52b83538e2 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:41:43.237687 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-881e8d79-23d4-4c71-82b5-ac52b83538e2 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:41:43.238416 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-881e8d79-23d4-4c71-82b5-ac52b83538e2 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:41:43.385329 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-881e8d79-23d4-4c71-82b5-ac52b83538e2 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:41:43.394031 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-881e8d79-23d4-4c71-82b5-ac52b83538e2 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b" status: 200 len: 1577 microversion: 2.1 time: 0.170730 Aug 31 17:41:43.394628 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4114/8218] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:41:43 2022] GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b => generated 1577 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:41:44.415282 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-04d0d34b-2bff-4170-b662-f1c358223e8c tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:41:44.415948 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-04d0d34b-2bff-4170-b662-f1c358223e8c tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:41:44.419294 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=31 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:41:44.425002 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-04d0d34b-2bff-4170-b662-f1c358223e8c tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:41:44.425502 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-04d0d34b-2bff-4170-b662-f1c358223e8c tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:41:44.425947 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-04d0d34b-2bff-4170-b662-f1c358223e8c tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:41:44.426870 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-04d0d34b-2bff-4170-b662-f1c358223e8c tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:41:44.427117 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-04d0d34b-2bff-4170-b662-f1c358223e8c tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:41:44.427578 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-04d0d34b-2bff-4170-b662-f1c358223e8c tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:41:44.430207 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:41:44.563215 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-04d0d34b-2bff-4170-b662-f1c358223e8c tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:41:44.570968 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-04d0d34b-2bff-4170-b662-f1c358223e8c tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b" status: 200 len: 1577 microversion: 2.1 time: 0.159621 Aug 31 17:41:44.571564 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4105/8219] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:41:44 2022] GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b => generated 1577 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:41:45.593348 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-23e56fc1-0573-45f0-9b15-1d9e8882f098 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:41:45.594214 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-23e56fc1-0573-45f0-9b15-1d9e8882f098 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:41:45.597022 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:41:45.603123 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-23e56fc1-0573-45f0-9b15-1d9e8882f098 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:41:45.603660 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-23e56fc1-0573-45f0-9b15-1d9e8882f098 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:41:45.604126 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-23e56fc1-0573-45f0-9b15-1d9e8882f098 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:41:45.604859 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-23e56fc1-0573-45f0-9b15-1d9e8882f098 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:41:45.605338 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-23e56fc1-0573-45f0-9b15-1d9e8882f098 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:41:45.605785 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-23e56fc1-0573-45f0-9b15-1d9e8882f098 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:41:45.612412 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:41:45.749517 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-23e56fc1-0573-45f0-9b15-1d9e8882f098 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:41:45.757402 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-23e56fc1-0573-45f0-9b15-1d9e8882f098 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b" status: 200 len: 1577 microversion: 2.1 time: 0.169264 Aug 31 17:41:45.757991 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4115/8220] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:41:45 2022] GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b => generated 1577 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:41:46.780058 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-254305bb-13dd-4525-8b80-b6b44f99be13 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:41:46.780704 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-254305bb-13dd-4525-8b80-b6b44f99be13 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:41:46.786988 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-254305bb-13dd-4525-8b80-b6b44f99be13 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:41:46.787482 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-254305bb-13dd-4525-8b80-b6b44f99be13 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:41:46.787962 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-254305bb-13dd-4525-8b80-b6b44f99be13 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:41:46.788665 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-254305bb-13dd-4525-8b80-b6b44f99be13 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:41:46.789131 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-254305bb-13dd-4525-8b80-b6b44f99be13 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:41:46.789563 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-254305bb-13dd-4525-8b80-b6b44f99be13 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:41:46.926707 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-254305bb-13dd-4525-8b80-b6b44f99be13 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:41:46.935194 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-254305bb-13dd-4525-8b80-b6b44f99be13 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b" status: 200 len: 1577 microversion: 2.1 time: 0.159533 Aug 31 17:41:46.935870 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4106/8221] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:41:46 2022] GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b => generated 1577 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:41:47.956143 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f47eb0f9-e65e-4790-b6b8-2226b6c65a59 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:41:47.956773 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f47eb0f9-e65e-4790-b6b8-2226b6c65a59 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:41:47.963105 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f47eb0f9-e65e-4790-b6b8-2226b6c65a59 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:41:47.963638 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f47eb0f9-e65e-4790-b6b8-2226b6c65a59 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:41:47.964109 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f47eb0f9-e65e-4790-b6b8-2226b6c65a59 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:41:47.964819 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f47eb0f9-e65e-4790-b6b8-2226b6c65a59 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:41:47.966074 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f47eb0f9-e65e-4790-b6b8-2226b6c65a59 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:41:47.966249 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f47eb0f9-e65e-4790-b6b8-2226b6c65a59 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:41:48.102699 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f47eb0f9-e65e-4790-b6b8-2226b6c65a59 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:41:48.111306 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f47eb0f9-e65e-4790-b6b8-2226b6c65a59 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b" status: 200 len: 1577 microversion: 2.1 time: 0.159091 Aug 31 17:41:48.111932 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4116/8222] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:41:47 2022] GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:41:48.190072 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-e59d8ea9-4a6f-4bf4-97f0-f9231cb94a71 req-7d0e5944-13bc-4d0a-93df-f3499a7d850b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b", "name": "network-vif-plugged", "status": "completed", "tag": "d6f252be-a5e6-467d-91ec-71c82e8f16a7"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:41:48.203739 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-e59d8ea9-4a6f-4bf4-97f0-f9231cb94a71 req-7d0e5944-13bc-4d0a-93df-f3499a7d850b service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:41:48.204286 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-e59d8ea9-4a6f-4bf4-97f0-f9231cb94a71 req-7d0e5944-13bc-4d0a-93df-f3499a7d850b service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:41:48.204772 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-e59d8ea9-4a6f-4bf4-97f0-f9231cb94a71 req-7d0e5944-13bc-4d0a-93df-f3499a7d850b service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:41:48.217004 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-e59d8ea9-4a6f-4bf4-97f0-f9231cb94a71 req-7d0e5944-13bc-4d0a-93df-f3499a7d850b service nova] Creating event network-vif-plugged:d6f252be-a5e6-467d-91ec-71c82e8f16a7 for instance b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b on n-h2-850499-9 Aug 31 17:41:48.222439 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-e59d8ea9-4a6f-4bf4-97f0-f9231cb94a71 req-7d0e5944-13bc-4d0a-93df-f3499a7d850b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036909 Aug 31 17:41:48.223118 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4107/8223] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:41:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:41:49.132807 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-dd6cbff4-e387-45c1-a7bb-d05e3bb1ae54 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:41:49.133391 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-dd6cbff4-e387-45c1-a7bb-d05e3bb1ae54 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:41:49.141035 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dd6cbff4-e387-45c1-a7bb-d05e3bb1ae54 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:41:49.141536 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dd6cbff4-e387-45c1-a7bb-d05e3bb1ae54 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:41:49.141985 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dd6cbff4-e387-45c1-a7bb-d05e3bb1ae54 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:41:49.142687 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dd6cbff4-e387-45c1-a7bb-d05e3bb1ae54 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:41:49.143155 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dd6cbff4-e387-45c1-a7bb-d05e3bb1ae54 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:41:49.143627 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-dd6cbff4-e387-45c1-a7bb-d05e3bb1ae54 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:41:49.284868 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-dd6cbff4-e387-45c1-a7bb-d05e3bb1ae54 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:41:49.292779 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-dd6cbff4-e387-45c1-a7bb-d05e3bb1ae54 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b" status: 200 len: 1577 microversion: 2.1 time: 0.164009 Aug 31 17:41:49.293362 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4117/8224] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:41:49 2022] GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b => generated 1577 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:41:50.315207 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-05b2149a-d79c-4230-bd87-6cf2a1fa11eb tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:41:50.315941 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-05b2149a-d79c-4230-bd87-6cf2a1fa11eb tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:41:50.322776 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-05b2149a-d79c-4230-bd87-6cf2a1fa11eb tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:41:50.323259 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-05b2149a-d79c-4230-bd87-6cf2a1fa11eb tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:41:50.323734 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-05b2149a-d79c-4230-bd87-6cf2a1fa11eb tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:41:50.324425 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-05b2149a-d79c-4230-bd87-6cf2a1fa11eb tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:41:50.324925 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-05b2149a-d79c-4230-bd87-6cf2a1fa11eb tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:41:50.325350 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-05b2149a-d79c-4230-bd87-6cf2a1fa11eb tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:41:50.461019 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-05b2149a-d79c-4230-bd87-6cf2a1fa11eb tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:41:50.469912 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-05b2149a-d79c-4230-bd87-6cf2a1fa11eb tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b" status: 200 len: 1564 microversion: 2.1 time: 0.159750 Aug 31 17:41:50.470491 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4108/8225] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:41:50 2022] GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b => generated 1564 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:43:04.608386 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-0be5ba13-b0e2-4466-9586-99e79b7014d6 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:43:04.608966 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0be5ba13-b0e2-4466-9586-99e79b7014d6 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:43:04.611024 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=7 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:43:04.611931 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=19 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:43:04.613369 n-d-850499-9 devstack@n-api.service[122256]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 17:43:04.614033 n-d-850499-9 devstack@n-api.service[122256]: Wed Aug 31 17:43:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.61) !!! Aug 31 17:43:04.615102 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=5 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:43:04.615857 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=17 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:43:04.616826 n-d-850499-9 devstack@n-api.service[122257]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 17:43:04.616955 n-d-850499-9 devstack@n-api.service[122257]: Wed Aug 31 17:43:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b (ip 10.222.0.61) !!! Aug 31 17:43:04.619931 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0be5ba13-b0e2-4466-9586-99e79b7014d6 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:43:04.620643 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0be5ba13-b0e2-4466-9586-99e79b7014d6 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:43:04.621107 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0be5ba13-b0e2-4466-9586-99e79b7014d6 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:43:04.622119 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0be5ba13-b0e2-4466-9586-99e79b7014d6 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:43:04.622330 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0be5ba13-b0e2-4466-9586-99e79b7014d6 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:43:04.622724 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-0be5ba13-b0e2-4466-9586-99e79b7014d6 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:43:04.653858 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-0be5ba13-b0e2-4466-9586-99e79b7014d6 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 17:43:04.747042 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-0be5ba13-b0e2-4466-9586-99e79b7014d6 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "DELETE /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b" status: 204 len: 0 microversion: 2.1 time: 0.143636 Aug 31 17:43:04.750974 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4118/8226] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 17:43:04 2022] DELETE /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 17:43:04.757181 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f5605294-5a94-4204-875d-c43a621fa243 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:43:04.758514 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f5605294-5a94-4204-875d-c43a621fa243 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:43:04.765130 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f5605294-5a94-4204-875d-c43a621fa243 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:43:04.765652 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f5605294-5a94-4204-875d-c43a621fa243 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:43:04.766107 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f5605294-5a94-4204-875d-c43a621fa243 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:43:04.766831 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f5605294-5a94-4204-875d-c43a621fa243 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:43:04.767306 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f5605294-5a94-4204-875d-c43a621fa243 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:43:04.767840 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f5605294-5a94-4204-875d-c43a621fa243 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:43:04.774701 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-20cb5607-68c4-4885-8ea7-5bfd314fc419 req-d6298d16-413a-44fb-a80c-c782ffdde9f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b", "tag": "d6f252be-a5e6-467d-91ec-71c82e8f16a7"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:43:04.784865 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-20cb5607-68c4-4885-8ea7-5bfd314fc419 req-d6298d16-413a-44fb-a80c-c782ffdde9f0 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:43:04.785346 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-20cb5607-68c4-4885-8ea7-5bfd314fc419 req-d6298d16-413a-44fb-a80c-c782ffdde9f0 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:43:04.785774 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-20cb5607-68c4-4885-8ea7-5bfd314fc419 req-d6298d16-413a-44fb-a80c-c782ffdde9f0 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:43:04.797393 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-20cb5607-68c4-4885-8ea7-5bfd314fc419 req-d6298d16-413a-44fb-a80c-c782ffdde9f0 service nova] Creating event network-changed:d6f252be-a5e6-467d-91ec-71c82e8f16a7 for instance b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b on n-h2-850499-9 Aug 31 17:43:04.802510 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-20cb5607-68c4-4885-8ea7-5bfd314fc419 req-d6298d16-413a-44fb-a80c-c782ffdde9f0 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.197088 Aug 31 17:43:04.803465 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4109/8227] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:43:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 17:43:04.907868 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f5605294-5a94-4204-875d-c43a621fa243 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:43:04.916808 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f5605294-5a94-4204-875d-c43a621fa243 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b" status: 200 len: 1570 microversion: 2.1 time: 0.163910 Aug 31 17:43:04.917511 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4119/8228] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:43:04 2022] GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b => generated 1570 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 17:43:05.939909 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-5e495500-f7f8-4ebd-aca3-14b137d1fe0c tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:43:05.940648 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-5e495500-f7f8-4ebd-aca3-14b137d1fe0c tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:43:05.947677 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5e495500-f7f8-4ebd-aca3-14b137d1fe0c tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:43:05.948179 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5e495500-f7f8-4ebd-aca3-14b137d1fe0c tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:43:05.948621 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5e495500-f7f8-4ebd-aca3-14b137d1fe0c tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:43:05.949329 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5e495500-f7f8-4ebd-aca3-14b137d1fe0c tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:43:05.949796 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5e495500-f7f8-4ebd-aca3-14b137d1fe0c tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:43:05.950228 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-5e495500-f7f8-4ebd-aca3-14b137d1fe0c tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:43:06.096486 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-5e495500-f7f8-4ebd-aca3-14b137d1fe0c tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:43:06.104376 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-5e495500-f7f8-4ebd-aca3-14b137d1fe0c tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b" status: 200 len: 1570 microversion: 2.1 time: 0.169809 Aug 31 17:43:06.104959 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4110/8229] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:43:05 2022] GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b => generated 1570 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:43:07.026084 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-2caa76b9-a64b-42dd-b1ca-710abb55fde1 req-f6d0bd97-5b09-4f83-bea7-ff8227cfaeb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b", "name": "network-vif-deleted", "tag": "d6f252be-a5e6-467d-91ec-71c82e8f16a7"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:43:07.039555 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-2caa76b9-a64b-42dd-b1ca-710abb55fde1 req-f6d0bd97-5b09-4f83-bea7-ff8227cfaeb4 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:43:07.041193 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-2caa76b9-a64b-42dd-b1ca-710abb55fde1 req-f6d0bd97-5b09-4f83-bea7-ff8227cfaeb4 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:43:07.041813 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-2caa76b9-a64b-42dd-b1ca-710abb55fde1 req-f6d0bd97-5b09-4f83-bea7-ff8227cfaeb4 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:43:07.054067 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-2caa76b9-a64b-42dd-b1ca-710abb55fde1 req-f6d0bd97-5b09-4f83-bea7-ff8227cfaeb4 service nova] Creating event network-vif-deleted:d6f252be-a5e6-467d-91ec-71c82e8f16a7 for instance b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b on n-h2-850499-9 Aug 31 17:43:07.060338 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-2caa76b9-a64b-42dd-b1ca-710abb55fde1 req-f6d0bd97-5b09-4f83-bea7-ff8227cfaeb4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038456 Aug 31 17:43:07.060943 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4120/8230] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:43:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:43:07.125751 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-ac4e9d6b-6bf7-4f26-9a1f-2ce9517e9908 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:43:07.126365 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-ac4e9d6b-6bf7-4f26-9a1f-2ce9517e9908 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:43:07.133143 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ac4e9d6b-6bf7-4f26-9a1f-2ce9517e9908 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:43:07.133640 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ac4e9d6b-6bf7-4f26-9a1f-2ce9517e9908 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:43:07.134076 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ac4e9d6b-6bf7-4f26-9a1f-2ce9517e9908 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:43:07.135020 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ac4e9d6b-6bf7-4f26-9a1f-2ce9517e9908 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:43:07.135479 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ac4e9d6b-6bf7-4f26-9a1f-2ce9517e9908 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:43:07.135930 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-ac4e9d6b-6bf7-4f26-9a1f-2ce9517e9908 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:43:07.202936 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-ac4e9d6b-6bf7-4f26-9a1f-2ce9517e9908 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:43:07.211049 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-ac4e9d6b-6bf7-4f26-9a1f-2ce9517e9908 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b" status: 200 len: 1220 microversion: 2.1 time: 0.089143 Aug 31 17:43:07.211708 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4111/8231] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:43:07 2022] GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b => generated 1220 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:43:08.235939 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-94759c6b-a74a-4bda-8fd1-36644f7be0d0 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:43:08.236560 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-94759c6b-a74a-4bda-8fd1-36644f7be0d0 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:43:08.249360 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-94759c6b-a74a-4bda-8fd1-36644f7be0d0 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:43:08.249891 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-94759c6b-a74a-4bda-8fd1-36644f7be0d0 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:43:08.250354 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-94759c6b-a74a-4bda-8fd1-36644f7be0d0 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:43:08.251091 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-94759c6b-a74a-4bda-8fd1-36644f7be0d0 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:43:08.251596 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-94759c6b-a74a-4bda-8fd1-36644f7be0d0 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:43:08.252046 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-94759c6b-a74a-4bda-8fd1-36644f7be0d0 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:43:08.319296 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-94759c6b-a74a-4bda-8fd1-36644f7be0d0 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:43:08.328461 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-94759c6b-a74a-4bda-8fd1-36644f7be0d0 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b" status: 200 len: 1220 microversion: 2.1 time: 0.097795 Aug 31 17:43:08.329050 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4121/8232] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:43:08 2022] GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b => generated 1220 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:43:09.350348 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c5e8e1d7-853d-4012-b777-e2bec539e462 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:43:09.350957 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c5e8e1d7-853d-4012-b777-e2bec539e462 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:43:09.358382 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c5e8e1d7-853d-4012-b777-e2bec539e462 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:43:09.358871 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c5e8e1d7-853d-4012-b777-e2bec539e462 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:43:09.359310 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c5e8e1d7-853d-4012-b777-e2bec539e462 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:43:09.360029 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c5e8e1d7-853d-4012-b777-e2bec539e462 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:43:09.360487 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c5e8e1d7-853d-4012-b777-e2bec539e462 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:43:09.360911 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c5e8e1d7-853d-4012-b777-e2bec539e462 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:43:09.426150 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c5e8e1d7-853d-4012-b777-e2bec539e462 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:43:09.435701 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c5e8e1d7-853d-4012-b777-e2bec539e462 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b" status: 200 len: 1220 microversion: 2.1 time: 0.089060 Aug 31 17:43:09.436308 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4112/8233] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:43:09 2022] GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b => generated 1220 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:43:10.457316 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ea2133d3-91b8-4f6c-bc86-e977611f712b tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:43:10.458024 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ea2133d3-91b8-4f6c-bc86-e977611f712b tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:43:10.465487 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ea2133d3-91b8-4f6c-bc86-e977611f712b tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:43:10.465990 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ea2133d3-91b8-4f6c-bc86-e977611f712b tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:43:10.466440 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ea2133d3-91b8-4f6c-bc86-e977611f712b tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:43:10.467151 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ea2133d3-91b8-4f6c-bc86-e977611f712b tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:43:10.467674 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ea2133d3-91b8-4f6c-bc86-e977611f712b tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:43:10.468118 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ea2133d3-91b8-4f6c-bc86-e977611f712b tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:43:10.809560 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ea2133d3-91b8-4f6c-bc86-e977611f712b tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd916293046b465d9c14870bf8887cbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f084d7d088e4d8e87c62bdcc287b936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:43:10.817433 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ea2133d3-91b8-4f6c-bc86-e977611f712b tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b" status: 200 len: 1220 microversion: 2.1 time: 0.364045 Aug 31 17:43:10.818017 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4122/8234] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:43:10 2022] GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b => generated 1220 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:43:11.839434 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d7dc77b8-3a03-4875-a965-e52bb8f3ae32 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:43:11.840060 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-d7dc77b8-3a03-4875-a965-e52bb8f3ae32 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] [instance: b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:43:11.849972 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d7dc77b8-3a03-4875-a965-e52bb8f3ae32 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:43:11.851179 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d7dc77b8-3a03-4875-a965-e52bb8f3ae32 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:43:11.852478 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d7dc77b8-3a03-4875-a965-e52bb8f3ae32 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:43:11.853627 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d7dc77b8-3a03-4875-a965-e52bb8f3ae32 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:43:11.854418 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d7dc77b8-3a03-4875-a965-e52bb8f3ae32 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:43:11.855544 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-d7dc77b8-3a03-4875-a965-e52bb8f3ae32 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:43:11.870659 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-d7dc77b8-3a03-4875-a965-e52bb8f3ae32 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] HTTP exception thrown: Instance b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b could not be found. Aug 31 17:43:11.872640 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d7dc77b8-3a03-4875-a965-e52bb8f3ae32 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Request method failure captured: Aug 31 17:43:11.872640 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b HTTP/1.1 Aug 31 17:43:11.872640 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 17:43:11.872640 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 17:43:11.872640 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 17:43:11.872640 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 17:43:11.872640 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 17:43:11.872640 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 17:43:11.872640 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 17:43:11.872640 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 17:43:11.872640 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD5tFiO-MohS1zjghaZbeewzgg_qt9pZdL7UnzDnqlJmrzm0mDXpBkLIlM4FyZRni0V-LGxBcFwMpSz7FE0Exx7R-D9wa36pjTL_JEHI353HE1ODIfpAOYFCHXjF6IPq6o7y8mAW9ufzaGIX7y1koYKwsqRWKdXyyniFtMc95TqQfe8A Aug 31 17:43:11.872640 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 17:43:11.872640 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 17:43:11.872640 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 17:43:11.872640 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 17:43:11.872640 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 17:43:11.872640 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 17:43:11.872640 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: 5f084d7d088e4d8e87c62bdcc287b936 Aug 31 17:43:11.872640 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-TestShelveInstance-1982875220 Aug 31 17:43:11.872640 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 17:43:11.872640 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 17:43:11.872640 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5f084d7d088e4d8e87c62bdcc287b936"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5f084d7d088e4d8e87c62bdcc287b936"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5f084d7d088e4d8e87c62bdcc287b936", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5f084d7d088e4d8e87c62bdcc287b936"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 17:43:11.872640 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-TestShelveInstance-1982875220 Aug 31 17:43:11.872640 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: 5f084d7d088e4d8e87c62bdcc287b936 Aug 31 17:43:11.872640 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-TestShelveInstance-1982875220 Aug 31 17:43:11.872640 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-TestShelveInstance-1982875220-project Aug 31 17:43:11.872640 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 17:43:11.872640 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 17:43:11.872640 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: bd916293046b465d9c14870bf8887cbc Aug 31 17:43:11.872640 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-TestShelveInstance-1982875220-project Aug 31 17:43:11.872640 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 17:43:11.872640 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b could not be found. Aug 31 17:43:11.872640 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': 'b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b'} Aug 31 17:43:11.872640 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 17:43:11.872640 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:43:11.872640 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 17:43:11.872640 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 17:43:11.872640 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 17:43:11.872640 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 17:43:11.872640 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 17:43:11.872640 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 17:43:11.872640 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 17:43:11.872640 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 17:43:11.872640 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b could not be found. Aug 31 17:43:11.872640 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:43:11.872640 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:43:11.872640 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:43:11.872640 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:43:11.872640 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:43:11.872640 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:43:11.872640 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 17:43:11.872640 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 17:43:11.872640 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 17:43:11.872640 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 17:43:11.872640 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 17:43:11.872640 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 17:43:11.872640 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 17:43:11.872640 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 17:43:11.872640 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 17:43:11.872640 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 17:43:11.872640 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b could not be found. Aug 31 17:43:11.872640 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:43:11.872640 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:43:11.872640 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:43:11.879322 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:43:11.879322 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:43:11.879322 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:43:11.879322 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 17:43:11.879322 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 17:43:11.879322 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b could not be found. Aug 31 17:43:11.879322 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:43:11.879322 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-d7dc77b8-3a03-4875-a965-e52bb8f3ae32 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Returning 404 to user: Instance b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 17:43:11.879322 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-d7dc77b8-3a03-4875-a965-e52bb8f3ae32 tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b" status: 404 len: 111 microversion: 2.1 time: 0.039376 Aug 31 17:43:11.879322 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4113/8235] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:43:11 2022] GET /compute/v2.1/servers/b528fd8d-0fb3-4cd1-a5cc-f18ef42fd65b => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 17:43:12.079519 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-015d4a66-a967-4df2-b431-67ec37768eed tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] Calling method '.version_select at 0x7f5ac078e940>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:43:12.118938 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-015d4a66-a967-4df2-b431-67ec37768eed tempest-TestShelveInstance-1982875220 tempest-TestShelveInstance-1982875220-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1831960284" status: 202 len: 0 microversion: 2.1 time: 0.042895 Aug 31 17:43:12.120211 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4123/8236] 10.222.0.61 () {58 vars in 1254 bytes} [Wed Aug 31 17:43:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1831960284 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 17:43:30.284747 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=10 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:43:30.285991 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=22 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:43:30.486992 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0e4a8739-236a-4ae7-b7c8-2453850809d5 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Action: 'create', calling method: .version_select at 0x7f5ae3aa2ee0>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-31997817", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBApb+AHNYt7Phrr8IAUE2c0r5zPkJfgWkSFFsm2JBP2J0BzUOW51YyITu5USLWFK4ZzA7lBEHduT8SALP3f65cISAncJiwjSQIdlMVL7EAlFTg8imYbq+wGeSitZ+iVBWA=="}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:43:30.503411 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-0e4a8739-236a-4ae7-b7c8-2453850809d5 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Getting quotas for project fc2c5e3f45f844e0a43fbbccb4f88031. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 17:43:30.509497 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-0e4a8739-236a-4ae7-b7c8-2453850809d5 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Getting quotas for user 0b76db43cde640c2bf4970ca4181bf46 and project fc2c5e3f45f844e0a43fbbccb4f88031. Resources: {'key_pairs'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 17:43:30.542334 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0e4a8739-236a-4ae7-b7c8-2453850809d5 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.265547 Aug 31 17:43:30.547134 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4114/8237] 10.222.0.61 () {60 vars in 1159 bytes} [Wed Aug 31 17:43:30 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:43:31.556965 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-46e1b19f-153c-4ced-9206-908714e5706d tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-866589384", "imageRef": "b9c36d42-ed46-4bf5-ad18-1df45cbd0413", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-31997817", "security_groups": [{"name": "tempest-secgroup-smoke-487713621"}], "networks": [{"uuid": "03e21d66-107c-4c30-a1e2-2dfc379f5868"}]}} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:43:31.566791 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:43:31.567349 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:43:31.683463 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.network.neutron [None req-46e1b19f-153c-4ced-9206-908714e5706d tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] validate_networks() for [('03e21d66-107c-4c30-a1e2-2dfc379f5868', None, None, None, None, None)] {{(pid=122257) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 17:43:32.430650 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-46e1b19f-153c-4ced-9206-908714e5706d tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Flavor limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 17:43:32.431215 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-46e1b19f-153c-4ced-9206-908714e5706d tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Image limits 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 17:43:32.431743 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-46e1b19f-153c-4ced-9206-908714e5706d tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Flavor pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 17:43:32.432174 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-46e1b19f-153c-4ced-9206-908714e5706d tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Image pref 0:0:0 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 17:43:32.432633 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.virt.hardware [None req-46e1b19f-153c-4ced-9206-908714e5706d tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122257) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 17:43:32.441770 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-46e1b19f-153c-4ced-9206-908714e5706d tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:43:32.442275 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-46e1b19f-153c-4ced-9206-908714e5706d tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:43:32.442726 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-46e1b19f-153c-4ced-9206-908714e5706d tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:43:32.443468 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-46e1b19f-153c-4ced-9206-908714e5706d tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:43:32.443973 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-46e1b19f-153c-4ced-9206-908714e5706d tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:43:32.444410 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-46e1b19f-153c-4ced-9206-908714e5706d tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:43:32.462201 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-46e1b19f-153c-4ced-9206-908714e5706d tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Getting quotas for project fc2c5e3f45f844e0a43fbbccb4f88031. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 17:43:32.467412 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.quota [None req-46e1b19f-153c-4ced-9206-908714e5706d tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Getting quotas for user 0b76db43cde640c2bf4970ca4181bf46 and project fc2c5e3f45f844e0a43fbbccb4f88031. Resources: {'ram', 'instances', 'cores'} {{(pid=122257) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 17:43:32.480788 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-46e1b19f-153c-4ced-9206-908714e5706d tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Going to run 1 instances... {{(pid=122257) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 17:43:32.483057 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-46e1b19f-153c-4ced-9206-908714e5706d tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] [instance: af7f2521-e02f-471e-8f47-84d9b4542ae6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9c36d42-ed46-4bf5-ad18-1df45cbd0413',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122257) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 17:43:32.530840 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-46e1b19f-153c-4ced-9206-908714e5706d tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.978721 Aug 31 17:43:32.531680 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4124/8238] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 17:43:31 2022] POST /compute/v2.1/servers => generated 405 bytes in 980 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 17:43:32.543593 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-91deced3-a6c1-498f-a057-5fb8a08c7968 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:43:32.544247 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-91deced3-a6c1-498f-a057-5fb8a08c7968 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] [instance: af7f2521-e02f-471e-8f47-84d9b4542ae6] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:43:32.604980 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-91deced3-a6c1-498f-a057-5fb8a08c7968 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b76db43cde640c2bf4970ca4181bf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2c5e3f45f844e0a43fbbccb4f88031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:43:32.612909 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-91deced3-a6c1-498f-a057-5fb8a08c7968 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] 10.222.0.61 "GET /compute/v2.1/servers/af7f2521-e02f-471e-8f47-84d9b4542ae6" status: 200 len: 1246 microversion: 2.1 time: 0.073936 Aug 31 17:43:32.623529 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4115/8239] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:43:32 2022] GET /compute/v2.1/servers/af7f2521-e02f-471e-8f47-84d9b4542ae6 => generated 1246 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:43:33.636353 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a777e9a4-7a22-4235-9340-c79524fb3261 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:43:33.636998 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a777e9a4-7a22-4235-9340-c79524fb3261 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] [instance: af7f2521-e02f-471e-8f47-84d9b4542ae6] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:43:33.644790 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a777e9a4-7a22-4235-9340-c79524fb3261 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:43:33.645305 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a777e9a4-7a22-4235-9340-c79524fb3261 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:43:33.645769 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a777e9a4-7a22-4235-9340-c79524fb3261 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:43:33.646497 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a777e9a4-7a22-4235-9340-c79524fb3261 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:43:33.646976 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a777e9a4-7a22-4235-9340-c79524fb3261 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:43:33.647781 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-a777e9a4-7a22-4235-9340-c79524fb3261 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:43:33.716015 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a777e9a4-7a22-4235-9340-c79524fb3261 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b76db43cde640c2bf4970ca4181bf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2c5e3f45f844e0a43fbbccb4f88031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:43:33.724114 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a777e9a4-7a22-4235-9340-c79524fb3261 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] 10.222.0.61 "GET /compute/v2.1/servers/af7f2521-e02f-471e-8f47-84d9b4542ae6" status: 200 len: 1298 microversion: 2.1 time: 0.092370 Aug 31 17:43:33.724697 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4125/8240] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:43:33 2022] GET /compute/v2.1/servers/af7f2521-e02f-471e-8f47-84d9b4542ae6 => generated 1298 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:43:34.748992 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2e6dac6b-5bc1-45d0-9df6-948dde1d46e7 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:43:34.750293 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2e6dac6b-5bc1-45d0-9df6-948dde1d46e7 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] [instance: af7f2521-e02f-471e-8f47-84d9b4542ae6] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:43:34.758414 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2e6dac6b-5bc1-45d0-9df6-948dde1d46e7 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:43:34.758918 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2e6dac6b-5bc1-45d0-9df6-948dde1d46e7 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:43:34.759362 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2e6dac6b-5bc1-45d0-9df6-948dde1d46e7 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:43:34.760395 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2e6dac6b-5bc1-45d0-9df6-948dde1d46e7 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:43:34.760851 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2e6dac6b-5bc1-45d0-9df6-948dde1d46e7 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:43:34.761471 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2e6dac6b-5bc1-45d0-9df6-948dde1d46e7 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:43:35.014066 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-2e6dac6b-5bc1-45d0-9df6-948dde1d46e7 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b76db43cde640c2bf4970ca4181bf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2c5e3f45f844e0a43fbbccb4f88031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:43:35.021807 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2e6dac6b-5bc1-45d0-9df6-948dde1d46e7 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] 10.222.0.61 "GET /compute/v2.1/servers/af7f2521-e02f-471e-8f47-84d9b4542ae6" status: 200 len: 1371 microversion: 2.1 time: 0.276948 Aug 31 17:43:35.022480 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4116/8241] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:43:34 2022] GET /compute/v2.1/servers/af7f2521-e02f-471e-8f47-84d9b4542ae6 => generated 1371 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:43:35.408234 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-58766fa9-efae-4e22-afac-cd77c8dba6fd req-8398fd4c-6172-4138-99af-77ae4956d7e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af7f2521-e02f-471e-8f47-84d9b4542ae6", "tag": "b1721db2-d432-412f-b40f-87294e04e9f6"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:43:35.422567 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-58766fa9-efae-4e22-afac-cd77c8dba6fd req-8398fd4c-6172-4138-99af-77ae4956d7e1 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:43:35.423095 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-58766fa9-efae-4e22-afac-cd77c8dba6fd req-8398fd4c-6172-4138-99af-77ae4956d7e1 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:43:35.423746 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-58766fa9-efae-4e22-afac-cd77c8dba6fd req-8398fd4c-6172-4138-99af-77ae4956d7e1 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:43:35.435980 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-58766fa9-efae-4e22-afac-cd77c8dba6fd req-8398fd4c-6172-4138-99af-77ae4956d7e1 service nova] Creating event network-changed:b1721db2-d432-412f-b40f-87294e04e9f6 for instance af7f2521-e02f-471e-8f47-84d9b4542ae6 on n-h2-850499-9 Aug 31 17:43:35.441593 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-58766fa9-efae-4e22-afac-cd77c8dba6fd req-8398fd4c-6172-4138-99af-77ae4956d7e1 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043299 Aug 31 17:43:35.442197 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4126/8242] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:43:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:43:36.046083 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-16a346a9-8722-4b62-960c-c74aa8b06683 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:43:36.046748 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-16a346a9-8722-4b62-960c-c74aa8b06683 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] [instance: af7f2521-e02f-471e-8f47-84d9b4542ae6] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:43:36.054658 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-16a346a9-8722-4b62-960c-c74aa8b06683 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:43:36.055337 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-16a346a9-8722-4b62-960c-c74aa8b06683 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:43:36.056024 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-16a346a9-8722-4b62-960c-c74aa8b06683 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:43:36.056959 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-16a346a9-8722-4b62-960c-c74aa8b06683 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:43:36.057587 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-16a346a9-8722-4b62-960c-c74aa8b06683 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:43:36.057887 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-16a346a9-8722-4b62-960c-c74aa8b06683 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:43:36.195139 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-16a346a9-8722-4b62-960c-c74aa8b06683 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b76db43cde640c2bf4970ca4181bf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2c5e3f45f844e0a43fbbccb4f88031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:43:36.203795 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-16a346a9-8722-4b62-960c-c74aa8b06683 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] 10.222.0.61 "GET /compute/v2.1/servers/af7f2521-e02f-471e-8f47-84d9b4542ae6" status: 200 len: 1371 microversion: 2.1 time: 0.163194 Aug 31 17:43:36.204318 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4117/8243] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:43:36 2022] GET /compute/v2.1/servers/af7f2521-e02f-471e-8f47-84d9b4542ae6 => generated 1371 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:43:37.225917 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6b09840a-e5d2-48d0-9e55-231f2ce4a8f3 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:43:37.227029 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6b09840a-e5d2-48d0-9e55-231f2ce4a8f3 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] [instance: af7f2521-e02f-471e-8f47-84d9b4542ae6] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:43:37.232898 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6b09840a-e5d2-48d0-9e55-231f2ce4a8f3 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:43:37.233405 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6b09840a-e5d2-48d0-9e55-231f2ce4a8f3 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:43:37.233863 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6b09840a-e5d2-48d0-9e55-231f2ce4a8f3 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:43:37.234599 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6b09840a-e5d2-48d0-9e55-231f2ce4a8f3 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:43:37.235074 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6b09840a-e5d2-48d0-9e55-231f2ce4a8f3 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:43:37.235531 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6b09840a-e5d2-48d0-9e55-231f2ce4a8f3 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:43:37.373035 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-6b09840a-e5d2-48d0-9e55-231f2ce4a8f3 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b76db43cde640c2bf4970ca4181bf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2c5e3f45f844e0a43fbbccb4f88031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:43:37.381078 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6b09840a-e5d2-48d0-9e55-231f2ce4a8f3 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] 10.222.0.61 "GET /compute/v2.1/servers/af7f2521-e02f-471e-8f47-84d9b4542ae6" status: 200 len: 1371 microversion: 2.1 time: 0.160297 Aug 31 17:43:37.381664 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4127/8244] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:43:37 2022] GET /compute/v2.1/servers/af7f2521-e02f-471e-8f47-84d9b4542ae6 => generated 1371 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:43:38.403126 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-31e5110e-0f6d-4bb9-b2fa-099ae8086a7b tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:43:38.403900 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-31e5110e-0f6d-4bb9-b2fa-099ae8086a7b tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] [instance: af7f2521-e02f-471e-8f47-84d9b4542ae6] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:43:38.411306 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-31e5110e-0f6d-4bb9-b2fa-099ae8086a7b tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:43:38.412355 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-31e5110e-0f6d-4bb9-b2fa-099ae8086a7b tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:43:38.413469 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-31e5110e-0f6d-4bb9-b2fa-099ae8086a7b tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:43:38.414955 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-31e5110e-0f6d-4bb9-b2fa-099ae8086a7b tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:43:38.415607 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-31e5110e-0f6d-4bb9-b2fa-099ae8086a7b tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:43:38.416217 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-31e5110e-0f6d-4bb9-b2fa-099ae8086a7b tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:43:38.648346 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-31e5110e-0f6d-4bb9-b2fa-099ae8086a7b tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b76db43cde640c2bf4970ca4181bf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2c5e3f45f844e0a43fbbccb4f88031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:43:38.657267 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-31e5110e-0f6d-4bb9-b2fa-099ae8086a7b tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] 10.222.0.61 "GET /compute/v2.1/servers/af7f2521-e02f-471e-8f47-84d9b4542ae6" status: 200 len: 1371 microversion: 2.1 time: 0.258710 Aug 31 17:43:38.657860 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4118/8245] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:43:38 2022] GET /compute/v2.1/servers/af7f2521-e02f-471e-8f47-84d9b4542ae6 => generated 1371 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:43:39.679060 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-f979f9b9-fcbf-4f62-bfd7-b3800d4ca423 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:43:39.680451 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-f979f9b9-fcbf-4f62-bfd7-b3800d4ca423 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] [instance: af7f2521-e02f-471e-8f47-84d9b4542ae6] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:43:39.687381 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f979f9b9-fcbf-4f62-bfd7-b3800d4ca423 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:43:39.687925 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f979f9b9-fcbf-4f62-bfd7-b3800d4ca423 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:43:39.688386 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f979f9b9-fcbf-4f62-bfd7-b3800d4ca423 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:43:39.689109 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f979f9b9-fcbf-4f62-bfd7-b3800d4ca423 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:43:39.689674 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f979f9b9-fcbf-4f62-bfd7-b3800d4ca423 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:43:39.690127 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-f979f9b9-fcbf-4f62-bfd7-b3800d4ca423 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:43:39.827830 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-f979f9b9-fcbf-4f62-bfd7-b3800d4ca423 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b76db43cde640c2bf4970ca4181bf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2c5e3f45f844e0a43fbbccb4f88031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:43:39.835443 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-f979f9b9-fcbf-4f62-bfd7-b3800d4ca423 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] 10.222.0.61 "GET /compute/v2.1/servers/af7f2521-e02f-471e-8f47-84d9b4542ae6" status: 200 len: 1371 microversion: 2.1 time: 0.160350 Aug 31 17:43:39.836685 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4128/8246] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:43:39 2022] GET /compute/v2.1/servers/af7f2521-e02f-471e-8f47-84d9b4542ae6 => generated 1371 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:43:40.699236 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-756d2707-3d3c-4805-b5db-d96d3e213c31 req-3a5909f4-1572-4080-9523-dfc692acaf28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af7f2521-e02f-471e-8f47-84d9b4542ae6", "name": "network-vif-plugged", "status": "completed", "tag": "b1721db2-d432-412f-b40f-87294e04e9f6"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:43:40.710981 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-756d2707-3d3c-4805-b5db-d96d3e213c31 req-3a5909f4-1572-4080-9523-dfc692acaf28 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:43:40.711476 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-756d2707-3d3c-4805-b5db-d96d3e213c31 req-3a5909f4-1572-4080-9523-dfc692acaf28 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:43:40.711934 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-756d2707-3d3c-4805-b5db-d96d3e213c31 req-3a5909f4-1572-4080-9523-dfc692acaf28 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:43:40.727791 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-756d2707-3d3c-4805-b5db-d96d3e213c31 req-3a5909f4-1572-4080-9523-dfc692acaf28 service nova] Creating event network-vif-plugged:b1721db2-d432-412f-b40f-87294e04e9f6 for instance af7f2521-e02f-471e-8f47-84d9b4542ae6 on n-h2-850499-9 Aug 31 17:43:40.733028 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-756d2707-3d3c-4805-b5db-d96d3e213c31 req-3a5909f4-1572-4080-9523-dfc692acaf28 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038174 Aug 31 17:43:40.733669 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4119/8247] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:43:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:43:40.857684 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-001cad35-461e-4298-bdef-f9c5948c5055 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:43:40.858322 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-001cad35-461e-4298-bdef-f9c5948c5055 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] [instance: af7f2521-e02f-471e-8f47-84d9b4542ae6] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:43:40.865649 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-001cad35-461e-4298-bdef-f9c5948c5055 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:43:40.866195 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-001cad35-461e-4298-bdef-f9c5948c5055 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:43:40.866660 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-001cad35-461e-4298-bdef-f9c5948c5055 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:43:40.868095 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-001cad35-461e-4298-bdef-f9c5948c5055 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:43:40.868599 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-001cad35-461e-4298-bdef-f9c5948c5055 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:43:40.869052 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-001cad35-461e-4298-bdef-f9c5948c5055 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:43:41.011466 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-001cad35-461e-4298-bdef-f9c5948c5055 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b76db43cde640c2bf4970ca4181bf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2c5e3f45f844e0a43fbbccb4f88031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:43:41.019219 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-001cad35-461e-4298-bdef-f9c5948c5055 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] 10.222.0.61 "GET /compute/v2.1/servers/af7f2521-e02f-471e-8f47-84d9b4542ae6" status: 200 len: 1371 microversion: 2.1 time: 0.165543 Aug 31 17:43:41.019851 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4129/8248] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:43:40 2022] GET /compute/v2.1/servers/af7f2521-e02f-471e-8f47-84d9b4542ae6 => generated 1371 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:43:42.041451 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-fb0ae613-03d0-4379-99e3-d7792f3095e2 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:43:42.042154 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-fb0ae613-03d0-4379-99e3-d7792f3095e2 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] [instance: af7f2521-e02f-471e-8f47-84d9b4542ae6] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:43:42.049242 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fb0ae613-03d0-4379-99e3-d7792f3095e2 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:43:42.049742 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fb0ae613-03d0-4379-99e3-d7792f3095e2 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:43:42.050185 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fb0ae613-03d0-4379-99e3-d7792f3095e2 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:43:42.050958 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fb0ae613-03d0-4379-99e3-d7792f3095e2 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:43:42.051423 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fb0ae613-03d0-4379-99e3-d7792f3095e2 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:43:42.051882 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-fb0ae613-03d0-4379-99e3-d7792f3095e2 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:43:42.191629 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-fb0ae613-03d0-4379-99e3-d7792f3095e2 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b76db43cde640c2bf4970ca4181bf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2c5e3f45f844e0a43fbbccb4f88031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:43:42.200120 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-fb0ae613-03d0-4379-99e3-d7792f3095e2 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] 10.222.0.61 "GET /compute/v2.1/servers/af7f2521-e02f-471e-8f47-84d9b4542ae6" status: 200 len: 1371 microversion: 2.1 time: 0.163647 Aug 31 17:43:42.200745 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4120/8249] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:43:42 2022] GET /compute/v2.1/servers/af7f2521-e02f-471e-8f47-84d9b4542ae6 => generated 1371 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:43:43.222529 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8bd53985-616b-43a4-8071-e196dca398eb tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:43:43.223114 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8bd53985-616b-43a4-8071-e196dca398eb tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] [instance: af7f2521-e02f-471e-8f47-84d9b4542ae6] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:43:43.225892 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:43:43.226574 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=6 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:43:43.232949 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8bd53985-616b-43a4-8071-e196dca398eb tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:43:43.233453 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8bd53985-616b-43a4-8071-e196dca398eb tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:43:43.233911 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8bd53985-616b-43a4-8071-e196dca398eb tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:43:43.234618 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8bd53985-616b-43a4-8071-e196dca398eb tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:43:43.235085 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8bd53985-616b-43a4-8071-e196dca398eb tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:43:43.235540 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8bd53985-616b-43a4-8071-e196dca398eb tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:43:43.368008 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8bd53985-616b-43a4-8071-e196dca398eb tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b76db43cde640c2bf4970ca4181bf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2c5e3f45f844e0a43fbbccb4f88031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:43:43.375901 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8bd53985-616b-43a4-8071-e196dca398eb tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] 10.222.0.61 "GET /compute/v2.1/servers/af7f2521-e02f-471e-8f47-84d9b4542ae6" status: 200 len: 1557 microversion: 2.1 time: 0.157245 Aug 31 17:43:43.376467 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4130/8250] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:43:43 2022] GET /compute/v2.1/servers/af7f2521-e02f-471e-8f47-84d9b4542ae6 => generated 1557 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:43:43.395621 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6215c276-0ef5-4982-916b-3db5feac0fbf tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:43:43.396235 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6215c276-0ef5-4982-916b-3db5feac0fbf tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] [instance: af7f2521-e02f-471e-8f47-84d9b4542ae6] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:43:43.398170 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=6 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:43:43.405317 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6215c276-0ef5-4982-916b-3db5feac0fbf tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:43:43.405808 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6215c276-0ef5-4982-916b-3db5feac0fbf tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:43:43.406240 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6215c276-0ef5-4982-916b-3db5feac0fbf tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:43:43.406937 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6215c276-0ef5-4982-916b-3db5feac0fbf tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:43:43.407392 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6215c276-0ef5-4982-916b-3db5feac0fbf tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:43:43.407848 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6215c276-0ef5-4982-916b-3db5feac0fbf tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:43:43.544795 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-6215c276-0ef5-4982-916b-3db5feac0fbf tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b76db43cde640c2bf4970ca4181bf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2c5e3f45f844e0a43fbbccb4f88031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:43:43.552741 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6215c276-0ef5-4982-916b-3db5feac0fbf tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] 10.222.0.61 "GET /compute/v2.1/servers/af7f2521-e02f-471e-8f47-84d9b4542ae6" status: 200 len: 1557 microversion: 2.1 time: 0.160933 Aug 31 17:43:43.553313 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4121/8251] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:43:43 2022] GET /compute/v2.1/servers/af7f2521-e02f-471e-8f47-84d9b4542ae6 => generated 1557 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:43:45.519548 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-0b156618-78a1-4651-882f-5ae654794323 req-23ca67eb-b557-4707-b4c8-038df1267dc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af7f2521-e02f-471e-8f47-84d9b4542ae6", "tag": "b1721db2-d432-412f-b40f-87294e04e9f6"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:43:45.531268 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-0b156618-78a1-4651-882f-5ae654794323 req-23ca67eb-b557-4707-b4c8-038df1267dc7 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:43:45.531885 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-0b156618-78a1-4651-882f-5ae654794323 req-23ca67eb-b557-4707-b4c8-038df1267dc7 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:43:45.532411 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-0b156618-78a1-4651-882f-5ae654794323 req-23ca67eb-b557-4707-b4c8-038df1267dc7 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:43:45.545520 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-0b156618-78a1-4651-882f-5ae654794323 req-23ca67eb-b557-4707-b4c8-038df1267dc7 service nova] Creating event network-changed:b1721db2-d432-412f-b40f-87294e04e9f6 for instance af7f2521-e02f-471e-8f47-84d9b4542ae6 on n-h2-850499-9 Aug 31 17:43:45.550990 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-0b156618-78a1-4651-882f-5ae654794323 req-23ca67eb-b557-4707-b4c8-038df1267dc7 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035699 Aug 31 17:43:45.551999 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4131/8252] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:43:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 17:46:22.211113 n-d-850499-9 devstack@n-api.service[122256]: ERROR oslo.messaging._drivers.impl_rabbit [-] [46519162-dc0d-41cb-af5d-7b19f3bd0573] AMQP server on 10.222.0.61:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 31 17:46:22.212418 n-d-850499-9 devstack@n-api.service[122256]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0cd6dd6f-a50d-4cf4-8d95-237d76a72b0e] AMQP server on 10.222.0.61:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 31 17:46:22.212932 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:46:22.213758 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=32 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:46:22.214855 n-d-850499-9 devstack@n-api.service[122256]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 31 17:46:22.215131 n-d-850499-9 devstack@n-api.service[122256]: Wed Aug 31 17:46:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/af7f2521-e02f-471e-8f47-84d9b4542ae6/action (ip 10.222.0.61) !!! Aug 31 17:46:22.216483 n-d-850499-9 devstack@n-api.service[122256]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 31 17:46:22.216613 n-d-850499-9 devstack@n-api.service[122256]: Wed Aug 31 17:46:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/af7f2521-e02f-471e-8f47-84d9b4542ae6/action (ip 10.222.0.61) !!! Aug 31 17:46:22.217726 n-d-850499-9 devstack@n-api.service[122256]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 31 17:46:22.217847 n-d-850499-9 devstack@n-api.service[122256]: Wed Aug 31 17:46:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/af7f2521-e02f-471e-8f47-84d9b4542ae6/action (ip 10.222.0.61) !!! Aug 31 17:46:22.224642 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-9aaeeb7c-1181-4bac-8ceb-2b0188340728 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-967079020"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:46:22.227716 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-9aaeeb7c-1181-4bac-8ceb-2b0188340728 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] [instance: af7f2521-e02f-471e-8f47-84d9b4542ae6] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:46:22.239229 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9aaeeb7c-1181-4bac-8ceb-2b0188340728 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:46:22.239750 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9aaeeb7c-1181-4bac-8ceb-2b0188340728 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:46:22.240197 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9aaeeb7c-1181-4bac-8ceb-2b0188340728 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:46:22.240908 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9aaeeb7c-1181-4bac-8ceb-2b0188340728 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:46:22.241377 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9aaeeb7c-1181-4bac-8ceb-2b0188340728 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:46:22.241884 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-9aaeeb7c-1181-4bac-8ceb-2b0188340728 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:46:22.585096 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-9aaeeb7c-1181-4bac-8ceb-2b0188340728 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] 10.222.0.61 "POST /compute/v2.1/servers/af7f2521-e02f-471e-8f47-84d9b4542ae6/action" status: 202 len: 0 microversion: 2.1 time: 0.376233 Aug 31 17:46:22.585784 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4122/8253] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 17:46:22 2022] POST /compute/v2.1/servers/af7f2521-e02f-471e-8f47-84d9b4542ae6/action => generated 0 bytes in 378 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 31 17:46:29.476532 n-d-850499-9 devstack@n-api.service[122257]: ERROR oslo.messaging._drivers.impl_rabbit [-] [400e2b90-e189-478a-9cc4-4b0bfcefc34a] AMQP server on 10.222.0.61:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 31 17:46:29.477530 n-d-850499-9 devstack@n-api.service[122257]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8b198bdc-d1f7-4259-9144-ce56665d9587] AMQP server on 10.222.0.61:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 31 17:46:29.478146 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:46:29.479056 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=36 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:46:29.479878 n-d-850499-9 devstack@n-api.service[122257]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 31 17:46:29.480011 n-d-850499-9 devstack@n-api.service[122257]: Wed Aug 31 17:46:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.61) !!! Aug 31 17:46:29.481527 n-d-850499-9 devstack@n-api.service[122257]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 31 17:46:29.481527 n-d-850499-9 devstack@n-api.service[122257]: Wed Aug 31 17:46:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.61) !!! Aug 31 17:46:29.482676 n-d-850499-9 devstack@n-api.service[122257]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 31 17:46:29.482833 n-d-850499-9 devstack@n-api.service[122257]: Wed Aug 31 17:46:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.61) !!! Aug 31 17:46:29.566918 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-3923494c-366e-4e66-9b4b-716d2e2d0e7f req-69678af1-6853-4530-b10b-28c6ba382ea1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af7f2521-e02f-471e-8f47-84d9b4542ae6", "name": "network-vif-plugged", "status": "completed", "tag": "b1721db2-d432-412f-b40f-87294e04e9f6"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:46:29.577212 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-3923494c-366e-4e66-9b4b-716d2e2d0e7f req-69678af1-6853-4530-b10b-28c6ba382ea1 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:46:29.577629 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-3923494c-366e-4e66-9b4b-716d2e2d0e7f req-69678af1-6853-4530-b10b-28c6ba382ea1 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:46:29.578247 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-3923494c-366e-4e66-9b4b-716d2e2d0e7f req-69678af1-6853-4530-b10b-28c6ba382ea1 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:46:29.589276 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-3923494c-366e-4e66-9b4b-716d2e2d0e7f req-69678af1-6853-4530-b10b-28c6ba382ea1 service nova] Creating event network-vif-plugged:b1721db2-d432-412f-b40f-87294e04e9f6 for instance af7f2521-e02f-471e-8f47-84d9b4542ae6 on n-h2-850499-9 Aug 31 17:46:29.596596 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-3923494c-366e-4e66-9b4b-716d2e2d0e7f req-69678af1-6853-4530-b10b-28c6ba382ea1 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121784 Aug 31 17:46:29.597235 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4132/8254] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:46:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:46:42.315553 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6fe6a833-4fda-4324-9900-fc5c5cb995a9 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-655018639", "imageRef": "d6e9b1eb-3a50-4fb5-8843-49d70fd26d3f", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-31997817", "security_groups": [{"name": "tempest-secgroup-smoke-487713621"}], "networks": [{"uuid": "03e21d66-107c-4c30-a1e2-2dfc379f5868"}]}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:46:42.326907 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:46:42.327691 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:46:42.339077 n-d-850499-9 devstack@n-api.service[122256]: INFO oslo.messaging._drivers.impl_rabbit [-] [46519162-dc0d-41cb-af5d-7b19f3bd0573] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 42002. Aug 31 17:46:42.347480 n-d-850499-9 devstack@n-api.service[122256]: INFO oslo.messaging._drivers.impl_rabbit [-] [0cd6dd6f-a50d-4cf4-8d95-237d76a72b0e] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 42004. Aug 31 17:46:42.453306 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.network.neutron [None req-6fe6a833-4fda-4324-9900-fc5c5cb995a9 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] validate_networks() for [('03e21d66-107c-4c30-a1e2-2dfc379f5868', None, None, None, None, None)] {{(pid=122256) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 17:46:42.881269 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-6fe6a833-4fda-4324-9900-fc5c5cb995a9 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Flavor limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 17:46:42.881707 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-6fe6a833-4fda-4324-9900-fc5c5cb995a9 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Image limits 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 17:46:42.882215 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-6fe6a833-4fda-4324-9900-fc5c5cb995a9 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Flavor pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 17:46:42.882930 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-6fe6a833-4fda-4324-9900-fc5c5cb995a9 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Image pref 0:0:0 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 17:46:42.883337 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.virt.hardware [None req-6fe6a833-4fda-4324-9900-fc5c5cb995a9 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 17:46:42.892464 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6fe6a833-4fda-4324-9900-fc5c5cb995a9 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:46:42.892898 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6fe6a833-4fda-4324-9900-fc5c5cb995a9 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:46:42.893414 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6fe6a833-4fda-4324-9900-fc5c5cb995a9 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:46:42.894102 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6fe6a833-4fda-4324-9900-fc5c5cb995a9 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:46:42.894604 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6fe6a833-4fda-4324-9900-fc5c5cb995a9 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:46:42.895007 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6fe6a833-4fda-4324-9900-fc5c5cb995a9 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:46:42.912943 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-6fe6a833-4fda-4324-9900-fc5c5cb995a9 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Getting quotas for project fc2c5e3f45f844e0a43fbbccb4f88031. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 17:46:42.919013 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.quota [None req-6fe6a833-4fda-4324-9900-fc5c5cb995a9 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Getting quotas for user 0b76db43cde640c2bf4970ca4181bf46 and project fc2c5e3f45f844e0a43fbbccb4f88031. Resources: {'ram', 'instances', 'cores'} {{(pid=122256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 17:46:42.932349 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6fe6a833-4fda-4324-9900-fc5c5cb995a9 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Going to run 1 instances... {{(pid=122256) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 17:46:42.934869 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6fe6a833-4fda-4324-9900-fc5c5cb995a9 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] [instance: 4266f69a-16ba-4372-9868-a4d95990f4cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d6e9b1eb-3a50-4fb5-8843-49d70fd26d3f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 17:46:42.982626 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6fe6a833-4fda-4324-9900-fc5c5cb995a9 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.671764 Aug 31 17:46:42.983561 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4123/8255] 10.222.0.61 () {60 vars in 1147 bytes} [Wed Aug 31 17:46:42 2022] POST /compute/v2.1/servers => generated 405 bytes in 673 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 17:46:42.992701 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:46:42.993459 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:46:42.998508 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-a6a4909d-931e-4eb8-9018-77c1e5853202 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:46:42.999641 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-a6a4909d-931e-4eb8-9018-77c1e5853202 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] [instance: 4266f69a-16ba-4372-9868-a4d95990f4cd] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:46:43.010704 n-d-850499-9 devstack@n-api.service[122257]: INFO oslo.messaging._drivers.impl_rabbit [-] [8b198bdc-d1f7-4259-9144-ce56665d9587] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 42020. Aug 31 17:46:43.028864 n-d-850499-9 devstack@n-api.service[122257]: INFO oslo.messaging._drivers.impl_rabbit [-] [400e2b90-e189-478a-9cc4-4b0bfcefc34a] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 42018. Aug 31 17:46:43.459140 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-a6a4909d-931e-4eb8-9018-77c1e5853202 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b76db43cde640c2bf4970ca4181bf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2c5e3f45f844e0a43fbbccb4f88031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:46:43.467719 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-a6a4909d-931e-4eb8-9018-77c1e5853202 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] 10.222.0.61 "GET /compute/v2.1/servers/4266f69a-16ba-4372-9868-a4d95990f4cd" status: 200 len: 1246 microversion: 2.1 time: 0.477266 Aug 31 17:46:43.468290 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4133/8256] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:46:42 2022] GET /compute/v2.1/servers/4266f69a-16ba-4372-9868-a4d95990f4cd => generated 1246 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:46:44.490431 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b390209c-d805-45c0-a249-62f1f0f91e9f tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:46:44.492326 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b390209c-d805-45c0-a249-62f1f0f91e9f tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] [instance: 4266f69a-16ba-4372-9868-a4d95990f4cd] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:46:44.503802 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b390209c-d805-45c0-a249-62f1f0f91e9f tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:46:44.504768 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b390209c-d805-45c0-a249-62f1f0f91e9f tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:46:44.505478 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b390209c-d805-45c0-a249-62f1f0f91e9f tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:46:44.506756 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b390209c-d805-45c0-a249-62f1f0f91e9f tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:46:44.507617 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b390209c-d805-45c0-a249-62f1f0f91e9f tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:46:44.508620 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b390209c-d805-45c0-a249-62f1f0f91e9f tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:46:44.595677 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b390209c-d805-45c0-a249-62f1f0f91e9f tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b76db43cde640c2bf4970ca4181bf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2c5e3f45f844e0a43fbbccb4f88031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:46:44.604618 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b390209c-d805-45c0-a249-62f1f0f91e9f tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] 10.222.0.61 "GET /compute/v2.1/servers/4266f69a-16ba-4372-9868-a4d95990f4cd" status: 200 len: 1316 microversion: 2.1 time: 0.119217 Aug 31 17:46:44.605415 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4124/8257] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:46:44 2022] GET /compute/v2.1/servers/4266f69a-16ba-4372-9868-a4d95990f4cd => generated 1316 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:46:45.626455 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-879b1029-2c90-41ee-b89f-36b63b0e2445 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:46:45.627918 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-879b1029-2c90-41ee-b89f-36b63b0e2445 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] [instance: 4266f69a-16ba-4372-9868-a4d95990f4cd] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:46:45.640339 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-879b1029-2c90-41ee-b89f-36b63b0e2445 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:46:45.647537 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-879b1029-2c90-41ee-b89f-36b63b0e2445 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:46:45.649204 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-879b1029-2c90-41ee-b89f-36b63b0e2445 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:46:45.650354 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-879b1029-2c90-41ee-b89f-36b63b0e2445 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:46:45.651232 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-879b1029-2c90-41ee-b89f-36b63b0e2445 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:46:45.652151 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-879b1029-2c90-41ee-b89f-36b63b0e2445 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:46:45.841947 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-879b1029-2c90-41ee-b89f-36b63b0e2445 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b76db43cde640c2bf4970ca4181bf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2c5e3f45f844e0a43fbbccb4f88031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:46:45.850219 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-879b1029-2c90-41ee-b89f-36b63b0e2445 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] 10.222.0.61 "GET /compute/v2.1/servers/4266f69a-16ba-4372-9868-a4d95990f4cd" status: 200 len: 1371 microversion: 2.1 time: 0.227848 Aug 31 17:46:45.850924 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4134/8258] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:46:45 2022] GET /compute/v2.1/servers/4266f69a-16ba-4372-9868-a4d95990f4cd => generated 1371 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:46:46.873372 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-2231a11c-5049-4f52-9585-502c43153d02 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:46:46.873989 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-2231a11c-5049-4f52-9585-502c43153d02 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] [instance: 4266f69a-16ba-4372-9868-a4d95990f4cd] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:46:46.880962 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2231a11c-5049-4f52-9585-502c43153d02 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:46:46.881460 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2231a11c-5049-4f52-9585-502c43153d02 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:46:46.881902 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2231a11c-5049-4f52-9585-502c43153d02 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:46:46.882949 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2231a11c-5049-4f52-9585-502c43153d02 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:46:46.883428 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2231a11c-5049-4f52-9585-502c43153d02 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:46:46.883888 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-2231a11c-5049-4f52-9585-502c43153d02 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:46:47.039162 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-2231a11c-5049-4f52-9585-502c43153d02 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b76db43cde640c2bf4970ca4181bf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2c5e3f45f844e0a43fbbccb4f88031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:46:47.049594 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-2231a11c-5049-4f52-9585-502c43153d02 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] 10.222.0.61 "GET /compute/v2.1/servers/4266f69a-16ba-4372-9868-a4d95990f4cd" status: 200 len: 1371 microversion: 2.1 time: 0.179665 Aug 31 17:46:47.051021 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4125/8259] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:46:46 2022] GET /compute/v2.1/servers/4266f69a-16ba-4372-9868-a4d95990f4cd => generated 1371 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:46:47.547035 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-065af392-4d78-405c-9ea4-87c4b497f8a0 req-956dfa2f-ef0c-4f74-b03f-316ec1ae3038 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af7f2521-e02f-471e-8f47-84d9b4542ae6", "name": "network-vif-unplugged", "status": "completed", "tag": "b1721db2-d432-412f-b40f-87294e04e9f6"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:46:47.567989 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-065af392-4d78-405c-9ea4-87c4b497f8a0 req-956dfa2f-ef0c-4f74-b03f-316ec1ae3038 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:46:47.568923 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-065af392-4d78-405c-9ea4-87c4b497f8a0 req-956dfa2f-ef0c-4f74-b03f-316ec1ae3038 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:46:47.569754 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-065af392-4d78-405c-9ea4-87c4b497f8a0 req-956dfa2f-ef0c-4f74-b03f-316ec1ae3038 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:46:47.583683 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-065af392-4d78-405c-9ea4-87c4b497f8a0 req-956dfa2f-ef0c-4f74-b03f-316ec1ae3038 service nova] Creating event network-vif-unplugged:b1721db2-d432-412f-b40f-87294e04e9f6 for instance af7f2521-e02f-471e-8f47-84d9b4542ae6 on n-h2-850499-9 Aug 31 17:46:47.591458 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-065af392-4d78-405c-9ea4-87c4b497f8a0 req-956dfa2f-ef0c-4f74-b03f-316ec1ae3038 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050067 Aug 31 17:46:47.592870 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4135/8260] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:46:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:46:48.071833 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-da72acd4-cf51-452a-9d23-41946c30e9fb tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:46:48.072448 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-da72acd4-cf51-452a-9d23-41946c30e9fb tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] [instance: 4266f69a-16ba-4372-9868-a4d95990f4cd] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:46:48.080492 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-da72acd4-cf51-452a-9d23-41946c30e9fb tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:46:48.081200 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-da72acd4-cf51-452a-9d23-41946c30e9fb tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:46:48.081785 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-da72acd4-cf51-452a-9d23-41946c30e9fb tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:46:48.082635 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-da72acd4-cf51-452a-9d23-41946c30e9fb tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:46:48.083203 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-da72acd4-cf51-452a-9d23-41946c30e9fb tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:46:48.083818 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-da72acd4-cf51-452a-9d23-41946c30e9fb tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:46:48.244960 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-da72acd4-cf51-452a-9d23-41946c30e9fb tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b76db43cde640c2bf4970ca4181bf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2c5e3f45f844e0a43fbbccb4f88031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:46:48.254105 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-da72acd4-cf51-452a-9d23-41946c30e9fb tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] 10.222.0.61 "GET /compute/v2.1/servers/4266f69a-16ba-4372-9868-a4d95990f4cd" status: 200 len: 1371 microversion: 2.1 time: 0.186923 Aug 31 17:46:48.255134 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4126/8261] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:46:48 2022] GET /compute/v2.1/servers/4266f69a-16ba-4372-9868-a4d95990f4cd => generated 1371 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:46:49.279121 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-59133845-6223-456f-9a01-189a5dd81cff tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:46:49.279966 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-59133845-6223-456f-9a01-189a5dd81cff tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] [instance: 4266f69a-16ba-4372-9868-a4d95990f4cd] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:46:49.286493 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-59133845-6223-456f-9a01-189a5dd81cff tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:46:49.287000 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-59133845-6223-456f-9a01-189a5dd81cff tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:46:49.287463 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-59133845-6223-456f-9a01-189a5dd81cff tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:46:49.288203 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-59133845-6223-456f-9a01-189a5dd81cff tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:46:49.289847 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-59133845-6223-456f-9a01-189a5dd81cff tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:46:49.290305 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-59133845-6223-456f-9a01-189a5dd81cff tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:46:49.461427 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-59133845-6223-456f-9a01-189a5dd81cff tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b76db43cde640c2bf4970ca4181bf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2c5e3f45f844e0a43fbbccb4f88031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:46:49.469726 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-59133845-6223-456f-9a01-189a5dd81cff tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] 10.222.0.61 "GET /compute/v2.1/servers/4266f69a-16ba-4372-9868-a4d95990f4cd" status: 200 len: 1371 microversion: 2.1 time: 0.196698 Aug 31 17:46:49.470464 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4136/8262] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:46:49 2022] GET /compute/v2.1/servers/4266f69a-16ba-4372-9868-a4d95990f4cd => generated 1371 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 17:46:50.492827 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-58afaec4-bcdb-48b2-9317-7134ed97f444 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:46:50.493513 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-58afaec4-bcdb-48b2-9317-7134ed97f444 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] [instance: 4266f69a-16ba-4372-9868-a4d95990f4cd] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:46:50.500472 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-58afaec4-bcdb-48b2-9317-7134ed97f444 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:46:50.501042 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-58afaec4-bcdb-48b2-9317-7134ed97f444 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:46:50.501478 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-58afaec4-bcdb-48b2-9317-7134ed97f444 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:46:50.502231 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-58afaec4-bcdb-48b2-9317-7134ed97f444 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:46:50.502687 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-58afaec4-bcdb-48b2-9317-7134ed97f444 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:46:50.503122 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-58afaec4-bcdb-48b2-9317-7134ed97f444 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:46:50.679606 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-58afaec4-bcdb-48b2-9317-7134ed97f444 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b76db43cde640c2bf4970ca4181bf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2c5e3f45f844e0a43fbbccb4f88031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:46:50.689209 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-58afaec4-bcdb-48b2-9317-7134ed97f444 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] 10.222.0.61 "GET /compute/v2.1/servers/4266f69a-16ba-4372-9868-a4d95990f4cd" status: 200 len: 1371 microversion: 2.1 time: 0.201319 Aug 31 17:46:50.690157 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4127/8263] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:46:50 2022] GET /compute/v2.1/servers/4266f69a-16ba-4372-9868-a4d95990f4cd => generated 1371 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:46:51.710577 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-01dc5f2d-9232-439e-a9f6-2cde023ddf90 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:46:51.711263 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-01dc5f2d-9232-439e-a9f6-2cde023ddf90 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] [instance: 4266f69a-16ba-4372-9868-a4d95990f4cd] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:46:51.718189 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-01dc5f2d-9232-439e-a9f6-2cde023ddf90 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:46:51.718689 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-01dc5f2d-9232-439e-a9f6-2cde023ddf90 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:46:51.719135 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-01dc5f2d-9232-439e-a9f6-2cde023ddf90 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:46:51.719865 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-01dc5f2d-9232-439e-a9f6-2cde023ddf90 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:46:51.720333 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-01dc5f2d-9232-439e-a9f6-2cde023ddf90 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:46:51.720769 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-01dc5f2d-9232-439e-a9f6-2cde023ddf90 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:46:51.886558 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-01dc5f2d-9232-439e-a9f6-2cde023ddf90 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b76db43cde640c2bf4970ca4181bf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2c5e3f45f844e0a43fbbccb4f88031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:46:51.897632 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-01dc5f2d-9232-439e-a9f6-2cde023ddf90 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] 10.222.0.61 "GET /compute/v2.1/servers/4266f69a-16ba-4372-9868-a4d95990f4cd" status: 200 len: 1371 microversion: 2.1 time: 0.191061 Aug 31 17:46:51.898266 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4137/8264] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:46:51 2022] GET /compute/v2.1/servers/4266f69a-16ba-4372-9868-a4d95990f4cd => generated 1371 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:46:52.918919 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-62b39c2b-d381-446d-a31f-8f03d30f7e55 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:46:52.919607 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-62b39c2b-d381-446d-a31f-8f03d30f7e55 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] [instance: 4266f69a-16ba-4372-9868-a4d95990f4cd] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:46:52.922265 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:46:52.926144 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell0:SELECT=6 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:46:52.928498 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-62b39c2b-d381-446d-a31f-8f03d30f7e55 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:46:52.929530 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-62b39c2b-d381-446d-a31f-8f03d30f7e55 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:46:52.929975 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-62b39c2b-d381-446d-a31f-8f03d30f7e55 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:46:52.930790 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-62b39c2b-d381-446d-a31f-8f03d30f7e55 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:46:52.931257 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-62b39c2b-d381-446d-a31f-8f03d30f7e55 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:46:52.931721 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-62b39c2b-d381-446d-a31f-8f03d30f7e55 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:46:53.065211 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-62b39c2b-d381-446d-a31f-8f03d30f7e55 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b76db43cde640c2bf4970ca4181bf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2c5e3f45f844e0a43fbbccb4f88031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:46:53.074606 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-62b39c2b-d381-446d-a31f-8f03d30f7e55 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] 10.222.0.61 "GET /compute/v2.1/servers/4266f69a-16ba-4372-9868-a4d95990f4cd" status: 200 len: 1371 microversion: 2.1 time: 0.159735 Aug 31 17:46:53.075206 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4128/8265] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:46:52 2022] GET /compute/v2.1/servers/4266f69a-16ba-4372-9868-a4d95990f4cd => generated 1371 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:46:54.096919 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-4c846990-8e31-4590-9f3a-70d36468cb9b tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:46:54.097609 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-4c846990-8e31-4590-9f3a-70d36468cb9b tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] [instance: 4266f69a-16ba-4372-9868-a4d95990f4cd] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:46:54.100485 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell0:SELECT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:46:54.106497 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4c846990-8e31-4590-9f3a-70d36468cb9b tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:46:54.107012 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4c846990-8e31-4590-9f3a-70d36468cb9b tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:46:54.107473 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4c846990-8e31-4590-9f3a-70d36468cb9b tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:46:54.108220 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4c846990-8e31-4590-9f3a-70d36468cb9b tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:46:54.108698 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4c846990-8e31-4590-9f3a-70d36468cb9b tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:46:54.109149 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-4c846990-8e31-4590-9f3a-70d36468cb9b tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:46:54.251583 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-4c846990-8e31-4590-9f3a-70d36468cb9b tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b76db43cde640c2bf4970ca4181bf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2c5e3f45f844e0a43fbbccb4f88031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:46:54.260303 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-4c846990-8e31-4590-9f3a-70d36468cb9b tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] 10.222.0.61 "GET /compute/v2.1/servers/4266f69a-16ba-4372-9868-a4d95990f4cd" status: 200 len: 1371 microversion: 2.1 time: 0.167345 Aug 31 17:46:54.260941 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4138/8266] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:46:54 2022] GET /compute/v2.1/servers/4266f69a-16ba-4372-9868-a4d95990f4cd => generated 1371 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:46:55.280230 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-0ed02dd5-9f11-4379-82ae-c4d23a8fbfd4 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:46:55.280839 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-0ed02dd5-9f11-4379-82ae-c4d23a8fbfd4 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] [instance: 4266f69a-16ba-4372-9868-a4d95990f4cd] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:46:55.287920 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0ed02dd5-9f11-4379-82ae-c4d23a8fbfd4 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:46:55.288405 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0ed02dd5-9f11-4379-82ae-c4d23a8fbfd4 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:46:55.288845 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0ed02dd5-9f11-4379-82ae-c4d23a8fbfd4 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:46:55.289797 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0ed02dd5-9f11-4379-82ae-c4d23a8fbfd4 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:46:55.290255 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0ed02dd5-9f11-4379-82ae-c4d23a8fbfd4 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:46:55.290677 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-0ed02dd5-9f11-4379-82ae-c4d23a8fbfd4 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:46:55.425767 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-0ed02dd5-9f11-4379-82ae-c4d23a8fbfd4 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b76db43cde640c2bf4970ca4181bf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2c5e3f45f844e0a43fbbccb4f88031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:46:55.434410 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-0ed02dd5-9f11-4379-82ae-c4d23a8fbfd4 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] 10.222.0.61 "GET /compute/v2.1/servers/4266f69a-16ba-4372-9868-a4d95990f4cd" status: 200 len: 1371 microversion: 2.1 time: 0.157989 Aug 31 17:46:55.434997 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4129/8267] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:46:55 2022] GET /compute/v2.1/servers/4266f69a-16ba-4372-9868-a4d95990f4cd => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:46:56.458925 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-53541d84-175e-4690-beef-d43cc438c43a tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:46:56.459584 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-53541d84-175e-4690-beef-d43cc438c43a tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] [instance: 4266f69a-16ba-4372-9868-a4d95990f4cd] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:46:56.467589 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-53541d84-175e-4690-beef-d43cc438c43a tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:46:56.467969 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-53541d84-175e-4690-beef-d43cc438c43a tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:46:56.468453 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-53541d84-175e-4690-beef-d43cc438c43a tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:46:56.469172 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-53541d84-175e-4690-beef-d43cc438c43a tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:46:56.469653 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-53541d84-175e-4690-beef-d43cc438c43a tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:46:56.470100 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-53541d84-175e-4690-beef-d43cc438c43a tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:46:56.690684 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-53541d84-175e-4690-beef-d43cc438c43a tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b76db43cde640c2bf4970ca4181bf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2c5e3f45f844e0a43fbbccb4f88031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:46:56.698424 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-53541d84-175e-4690-beef-d43cc438c43a tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] 10.222.0.61 "GET /compute/v2.1/servers/4266f69a-16ba-4372-9868-a4d95990f4cd" status: 200 len: 1371 microversion: 2.1 time: 0.243764 Aug 31 17:46:56.699712 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4139/8268] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:46:56 2022] GET /compute/v2.1/servers/4266f69a-16ba-4372-9868-a4d95990f4cd => generated 1371 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:46:57.160586 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-970f68a6-5b34-4d84-934b-f55b67c2fd18 req-a4bedf22-c87e-47d1-be30-eaf03e8f06f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4266f69a-16ba-4372-9868-a4d95990f4cd", "tag": "91ae1d70-98ef-4440-b262-75000350faf5"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:46:57.172715 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-970f68a6-5b34-4d84-934b-f55b67c2fd18 req-a4bedf22-c87e-47d1-be30-eaf03e8f06f8 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:46:57.173303 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-970f68a6-5b34-4d84-934b-f55b67c2fd18 req-a4bedf22-c87e-47d1-be30-eaf03e8f06f8 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:46:57.173814 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-970f68a6-5b34-4d84-934b-f55b67c2fd18 req-a4bedf22-c87e-47d1-be30-eaf03e8f06f8 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:46:57.185721 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-970f68a6-5b34-4d84-934b-f55b67c2fd18 req-a4bedf22-c87e-47d1-be30-eaf03e8f06f8 service nova] Creating event network-changed:91ae1d70-98ef-4440-b262-75000350faf5 for instance 4266f69a-16ba-4372-9868-a4d95990f4cd on n-h1-850499-9 Aug 31 17:46:57.191820 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-970f68a6-5b34-4d84-934b-f55b67c2fd18 req-a4bedf22-c87e-47d1-be30-eaf03e8f06f8 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035366 Aug 31 17:46:57.192616 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4130/8269] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:46:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:46:57.720122 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-ac98ecf1-2698-4f7e-a984-70162659025c tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:46:57.720747 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-ac98ecf1-2698-4f7e-a984-70162659025c tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] [instance: 4266f69a-16ba-4372-9868-a4d95990f4cd] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:46:57.727628 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ac98ecf1-2698-4f7e-a984-70162659025c tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:46:57.728174 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ac98ecf1-2698-4f7e-a984-70162659025c tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:46:57.728661 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ac98ecf1-2698-4f7e-a984-70162659025c tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:46:57.729338 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ac98ecf1-2698-4f7e-a984-70162659025c tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:46:57.729797 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ac98ecf1-2698-4f7e-a984-70162659025c tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:46:57.730278 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-ac98ecf1-2698-4f7e-a984-70162659025c tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:46:57.869043 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-ac98ecf1-2698-4f7e-a984-70162659025c tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b76db43cde640c2bf4970ca4181bf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2c5e3f45f844e0a43fbbccb4f88031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:46:57.877542 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-ac98ecf1-2698-4f7e-a984-70162659025c tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] 10.222.0.61 "GET /compute/v2.1/servers/4266f69a-16ba-4372-9868-a4d95990f4cd" status: 200 len: 1371 microversion: 2.1 time: 0.161328 Aug 31 17:46:57.878137 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4140/8270] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:46:57 2022] GET /compute/v2.1/servers/4266f69a-16ba-4372-9868-a4d95990f4cd => generated 1371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:46:58.900688 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-24f96230-9a59-4e54-8108-89273047c991 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:46:58.901425 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-24f96230-9a59-4e54-8108-89273047c991 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] [instance: 4266f69a-16ba-4372-9868-a4d95990f4cd] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:46:58.911146 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-24f96230-9a59-4e54-8108-89273047c991 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:46:58.911666 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-24f96230-9a59-4e54-8108-89273047c991 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:46:58.912114 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-24f96230-9a59-4e54-8108-89273047c991 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:46:58.912815 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-24f96230-9a59-4e54-8108-89273047c991 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:46:58.913937 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-24f96230-9a59-4e54-8108-89273047c991 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:46:58.914333 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-24f96230-9a59-4e54-8108-89273047c991 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:46:59.047822 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-24f96230-9a59-4e54-8108-89273047c991 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b76db43cde640c2bf4970ca4181bf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2c5e3f45f844e0a43fbbccb4f88031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:46:59.055745 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-24f96230-9a59-4e54-8108-89273047c991 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] 10.222.0.61 "GET /compute/v2.1/servers/4266f69a-16ba-4372-9868-a4d95990f4cd" status: 200 len: 1371 microversion: 2.1 time: 0.160631 Aug 31 17:46:59.056317 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4131/8271] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:46:58 2022] GET /compute/v2.1/servers/4266f69a-16ba-4372-9868-a4d95990f4cd => generated 1371 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:47:00.076916 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-d65417bf-5fa2-46a0-875d-50590c86e9f3 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:47:00.077563 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-d65417bf-5fa2-46a0-875d-50590c86e9f3 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] [instance: 4266f69a-16ba-4372-9868-a4d95990f4cd] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:47:00.084968 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d65417bf-5fa2-46a0-875d-50590c86e9f3 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:47:00.086046 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d65417bf-5fa2-46a0-875d-50590c86e9f3 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:47:00.086804 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d65417bf-5fa2-46a0-875d-50590c86e9f3 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:47:00.088102 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d65417bf-5fa2-46a0-875d-50590c86e9f3 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:47:00.088957 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d65417bf-5fa2-46a0-875d-50590c86e9f3 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:47:00.089736 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-d65417bf-5fa2-46a0-875d-50590c86e9f3 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:47:00.229665 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-d65417bf-5fa2-46a0-875d-50590c86e9f3 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b76db43cde640c2bf4970ca4181bf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2c5e3f45f844e0a43fbbccb4f88031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:47:00.237457 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-d65417bf-5fa2-46a0-875d-50590c86e9f3 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] 10.222.0.61 "GET /compute/v2.1/servers/4266f69a-16ba-4372-9868-a4d95990f4cd" status: 200 len: 1371 microversion: 2.1 time: 0.164490 Aug 31 17:47:00.238040 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4141/8272] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:47:00 2022] GET /compute/v2.1/servers/4266f69a-16ba-4372-9868-a4d95990f4cd => generated 1371 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 17:47:01.260391 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-c5b0fb44-f333-4388-a890-5dbb6b33e593 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:47:01.260970 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-c5b0fb44-f333-4388-a890-5dbb6b33e593 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] [instance: 4266f69a-16ba-4372-9868-a4d95990f4cd] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:47:01.267804 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c5b0fb44-f333-4388-a890-5dbb6b33e593 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:47:01.268298 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c5b0fb44-f333-4388-a890-5dbb6b33e593 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:47:01.268742 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c5b0fb44-f333-4388-a890-5dbb6b33e593 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:47:01.269444 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c5b0fb44-f333-4388-a890-5dbb6b33e593 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:47:01.269905 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c5b0fb44-f333-4388-a890-5dbb6b33e593 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:47:01.270332 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-c5b0fb44-f333-4388-a890-5dbb6b33e593 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:47:01.409833 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-c5b0fb44-f333-4388-a890-5dbb6b33e593 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b76db43cde640c2bf4970ca4181bf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2c5e3f45f844e0a43fbbccb4f88031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:47:01.418572 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-c5b0fb44-f333-4388-a890-5dbb6b33e593 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] 10.222.0.61 "GET /compute/v2.1/servers/4266f69a-16ba-4372-9868-a4d95990f4cd" status: 200 len: 1371 microversion: 2.1 time: 0.163005 Aug 31 17:47:01.419165 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4132/8273] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:47:01 2022] GET /compute/v2.1/servers/4266f69a-16ba-4372-9868-a4d95990f4cd => generated 1371 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:47:02.439891 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-23f40c64-9478-4ce5-9640-b99abf0d26ee tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:47:02.440565 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-23f40c64-9478-4ce5-9640-b99abf0d26ee tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] [instance: 4266f69a-16ba-4372-9868-a4d95990f4cd] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:47:02.448960 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-23f40c64-9478-4ce5-9640-b99abf0d26ee tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:47:02.449480 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-23f40c64-9478-4ce5-9640-b99abf0d26ee tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:47:02.449943 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-23f40c64-9478-4ce5-9640-b99abf0d26ee tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:47:02.450673 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-23f40c64-9478-4ce5-9640-b99abf0d26ee tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:47:02.451162 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-23f40c64-9478-4ce5-9640-b99abf0d26ee tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:47:02.451642 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-23f40c64-9478-4ce5-9640-b99abf0d26ee tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:47:02.585363 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-23f40c64-9478-4ce5-9640-b99abf0d26ee tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b76db43cde640c2bf4970ca4181bf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2c5e3f45f844e0a43fbbccb4f88031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:47:02.593232 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-23f40c64-9478-4ce5-9640-b99abf0d26ee tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] 10.222.0.61 "GET /compute/v2.1/servers/4266f69a-16ba-4372-9868-a4d95990f4cd" status: 200 len: 1371 microversion: 2.1 time: 0.157368 Aug 31 17:47:02.593813 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4142/8274] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:47:02 2022] GET /compute/v2.1/servers/4266f69a-16ba-4372-9868-a4d95990f4cd => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:47:03.320084 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-6d4ff9a7-5fc6-47dc-8ff5-3bef26c66ea2 req-08c5ecb3-12f0-471a-bbac-eb2698196bdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4266f69a-16ba-4372-9868-a4d95990f4cd", "name": "network-vif-plugged", "status": "completed", "tag": "91ae1d70-98ef-4440-b262-75000350faf5"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:47:03.333615 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-6d4ff9a7-5fc6-47dc-8ff5-3bef26c66ea2 req-08c5ecb3-12f0-471a-bbac-eb2698196bdd service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:47:03.334466 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-6d4ff9a7-5fc6-47dc-8ff5-3bef26c66ea2 req-08c5ecb3-12f0-471a-bbac-eb2698196bdd service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:47:03.334981 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-6d4ff9a7-5fc6-47dc-8ff5-3bef26c66ea2 req-08c5ecb3-12f0-471a-bbac-eb2698196bdd service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:47:03.347580 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-6d4ff9a7-5fc6-47dc-8ff5-3bef26c66ea2 req-08c5ecb3-12f0-471a-bbac-eb2698196bdd service nova] Creating event network-vif-plugged:91ae1d70-98ef-4440-b262-75000350faf5 for instance 4266f69a-16ba-4372-9868-a4d95990f4cd on n-h1-850499-9 Aug 31 17:47:03.352787 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-6d4ff9a7-5fc6-47dc-8ff5-3bef26c66ea2 req-08c5ecb3-12f0-471a-bbac-eb2698196bdd service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036653 Aug 31 17:47:03.353449 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4133/8275] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:47:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:47:03.614269 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-9d218c15-931e-433d-b590-204521635e61 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:47:03.614913 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-9d218c15-931e-433d-b590-204521635e61 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] [instance: 4266f69a-16ba-4372-9868-a4d95990f4cd] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:47:03.622765 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9d218c15-931e-433d-b590-204521635e61 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:47:03.623596 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9d218c15-931e-433d-b590-204521635e61 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:47:03.624067 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9d218c15-931e-433d-b590-204521635e61 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:47:03.624802 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9d218c15-931e-433d-b590-204521635e61 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:47:03.625283 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9d218c15-931e-433d-b590-204521635e61 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:47:03.625733 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-9d218c15-931e-433d-b590-204521635e61 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:47:03.766318 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-9d218c15-931e-433d-b590-204521635e61 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b76db43cde640c2bf4970ca4181bf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2c5e3f45f844e0a43fbbccb4f88031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:47:03.774672 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-9d218c15-931e-433d-b590-204521635e61 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] 10.222.0.61 "GET /compute/v2.1/servers/4266f69a-16ba-4372-9868-a4d95990f4cd" status: 200 len: 1371 microversion: 2.1 time: 0.164467 Aug 31 17:47:03.775275 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4143/8276] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:47:03 2022] GET /compute/v2.1/servers/4266f69a-16ba-4372-9868-a4d95990f4cd => generated 1371 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:47:04.796507 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-f44b3e2f-c897-4ad8-93f8-6a426c222984 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:47:04.797238 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-f44b3e2f-c897-4ad8-93f8-6a426c222984 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] [instance: 4266f69a-16ba-4372-9868-a4d95990f4cd] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:47:04.803561 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f44b3e2f-c897-4ad8-93f8-6a426c222984 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:47:04.804618 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f44b3e2f-c897-4ad8-93f8-6a426c222984 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:47:04.805055 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f44b3e2f-c897-4ad8-93f8-6a426c222984 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:47:04.805746 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f44b3e2f-c897-4ad8-93f8-6a426c222984 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:47:04.806202 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f44b3e2f-c897-4ad8-93f8-6a426c222984 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:47:04.806634 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-f44b3e2f-c897-4ad8-93f8-6a426c222984 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:47:04.949783 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-f44b3e2f-c897-4ad8-93f8-6a426c222984 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b76db43cde640c2bf4970ca4181bf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2c5e3f45f844e0a43fbbccb4f88031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:47:04.958723 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-f44b3e2f-c897-4ad8-93f8-6a426c222984 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] 10.222.0.61 "GET /compute/v2.1/servers/4266f69a-16ba-4372-9868-a4d95990f4cd" status: 200 len: 1371 microversion: 2.1 time: 0.167294 Aug 31 17:47:04.959591 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4134/8277] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:47:04 2022] GET /compute/v2.1/servers/4266f69a-16ba-4372-9868-a4d95990f4cd => generated 1371 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:47:05.981990 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-1914b067-41fb-4d55-b5ee-efd9c7f379ee tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:47:05.982616 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-1914b067-41fb-4d55-b5ee-efd9c7f379ee tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] [instance: 4266f69a-16ba-4372-9868-a4d95990f4cd] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:47:05.989744 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1914b067-41fb-4d55-b5ee-efd9c7f379ee tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:47:05.990251 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1914b067-41fb-4d55-b5ee-efd9c7f379ee tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:47:05.990710 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1914b067-41fb-4d55-b5ee-efd9c7f379ee tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:47:05.992051 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1914b067-41fb-4d55-b5ee-efd9c7f379ee tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:47:05.992531 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1914b067-41fb-4d55-b5ee-efd9c7f379ee tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:47:05.992984 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-1914b067-41fb-4d55-b5ee-efd9c7f379ee tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:47:06.129725 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-1914b067-41fb-4d55-b5ee-efd9c7f379ee tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b76db43cde640c2bf4970ca4181bf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2c5e3f45f844e0a43fbbccb4f88031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:47:06.138392 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-1914b067-41fb-4d55-b5ee-efd9c7f379ee tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] 10.222.0.61 "GET /compute/v2.1/servers/4266f69a-16ba-4372-9868-a4d95990f4cd" status: 200 len: 1556 microversion: 2.1 time: 0.160363 Aug 31 17:47:06.138979 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4144/8278] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:47:05 2022] GET /compute/v2.1/servers/4266f69a-16ba-4372-9868-a4d95990f4cd => generated 1556 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 17:47:06.158890 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-bccd4fb6-c590-42de-b4e0-8fc69f152f36 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:47:06.159544 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-bccd4fb6-c590-42de-b4e0-8fc69f152f36 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] [instance: 4266f69a-16ba-4372-9868-a4d95990f4cd] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:47:06.167781 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bccd4fb6-c590-42de-b4e0-8fc69f152f36 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:47:06.168280 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bccd4fb6-c590-42de-b4e0-8fc69f152f36 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:47:06.168726 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bccd4fb6-c590-42de-b4e0-8fc69f152f36 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:47:06.169432 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bccd4fb6-c590-42de-b4e0-8fc69f152f36 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:47:06.169899 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bccd4fb6-c590-42de-b4e0-8fc69f152f36 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:47:06.170335 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-bccd4fb6-c590-42de-b4e0-8fc69f152f36 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:47:06.303882 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-bccd4fb6-c590-42de-b4e0-8fc69f152f36 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b76db43cde640c2bf4970ca4181bf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2c5e3f45f844e0a43fbbccb4f88031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:47:06.311616 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-bccd4fb6-c590-42de-b4e0-8fc69f152f36 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] 10.222.0.61 "GET /compute/v2.1/servers/4266f69a-16ba-4372-9868-a4d95990f4cd" status: 200 len: 1556 microversion: 2.1 time: 0.156524 Aug 31 17:47:06.312193 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4135/8279] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:47:06 2022] GET /compute/v2.1/servers/4266f69a-16ba-4372-9868-a4d95990f4cd => generated 1556 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:47:08.032773 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-279c2b68-a86d-4cf4-995e-c36ca26cfc9b req-8b4d10cd-77ff-49a8-8e15-c029e3108ee6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4266f69a-16ba-4372-9868-a4d95990f4cd", "tag": "91ae1d70-98ef-4440-b262-75000350faf5"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:47:08.043826 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-279c2b68-a86d-4cf4-995e-c36ca26cfc9b req-8b4d10cd-77ff-49a8-8e15-c029e3108ee6 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:47:08.044332 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-279c2b68-a86d-4cf4-995e-c36ca26cfc9b req-8b4d10cd-77ff-49a8-8e15-c029e3108ee6 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:47:08.044781 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-279c2b68-a86d-4cf4-995e-c36ca26cfc9b req-8b4d10cd-77ff-49a8-8e15-c029e3108ee6 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:47:08.057343 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-279c2b68-a86d-4cf4-995e-c36ca26cfc9b req-8b4d10cd-77ff-49a8-8e15-c029e3108ee6 service nova] Creating event network-changed:91ae1d70-98ef-4440-b262-75000350faf5 for instance 4266f69a-16ba-4372-9868-a4d95990f4cd on n-h1-850499-9 Aug 31 17:47:08.062775 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-279c2b68-a86d-4cf4-995e-c36ca26cfc9b req-8b4d10cd-77ff-49a8-8e15-c029e3108ee6 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095951 Aug 31 17:47:08.064126 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4145/8280] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:47:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:49:06.923434 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:49:06.924228 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=66 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:49:06.988269 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-1d056375-0b31-4817-a978-4f4947a1708b tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-982239731"}} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:49:06.991075 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-1d056375-0b31-4817-a978-4f4947a1708b tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] [instance: 4266f69a-16ba-4372-9868-a4d95990f4cd] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:49:06.997293 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1d056375-0b31-4817-a978-4f4947a1708b tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:49:06.997792 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1d056375-0b31-4817-a978-4f4947a1708b tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:49:06.998238 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1d056375-0b31-4817-a978-4f4947a1708b tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:49:06.998955 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1d056375-0b31-4817-a978-4f4947a1708b tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:49:06.999611 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1d056375-0b31-4817-a978-4f4947a1708b tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:49:07.000073 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-1d056375-0b31-4817-a978-4f4947a1708b tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:49:07.208191 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-1d056375-0b31-4817-a978-4f4947a1708b tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] 10.222.0.61 "POST /compute/v2.1/servers/4266f69a-16ba-4372-9868-a4d95990f4cd/action" status: 202 len: 0 microversion: 2.1 time: 0.286460 Aug 31 17:49:07.208774 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4136/8281] 10.222.0.61 () {60 vars in 1278 bytes} [Wed Aug 31 17:49:06 2022] POST /compute/v2.1/servers/4266f69a-16ba-4372-9868-a4d95990f4cd/action => generated 0 bytes in 288 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 31 17:49:13.939193 n-d-850499-9 devstack@n-api.service[122257]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8b198bdc-d1f7-4259-9144-ce56665d9587] AMQP server on 10.222.0.61:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 31 17:49:13.941289 n-d-850499-9 devstack@n-api.service[122257]: ERROR oslo.messaging._drivers.impl_rabbit [-] [400e2b90-e189-478a-9cc4-4b0bfcefc34a] AMQP server on 10.222.0.61:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 31 17:49:13.943392 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=30 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:49:13.944301 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=64 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:49:13.952937 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-58022fa9-f672-4c3e-b94f-7d926f22e44a req-12a4dcfb-3eaf-4353-8c0b-d2c32de059ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4266f69a-16ba-4372-9868-a4d95990f4cd", "name": "network-vif-plugged", "status": "completed", "tag": "91ae1d70-98ef-4440-b262-75000350faf5"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:49:13.965124 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-58022fa9-f672-4c3e-b94f-7d926f22e44a req-12a4dcfb-3eaf-4353-8c0b-d2c32de059ea service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:49:13.965626 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-58022fa9-f672-4c3e-b94f-7d926f22e44a req-12a4dcfb-3eaf-4353-8c0b-d2c32de059ea service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:49:13.966080 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-58022fa9-f672-4c3e-b94f-7d926f22e44a req-12a4dcfb-3eaf-4353-8c0b-d2c32de059ea service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:49:13.978831 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-58022fa9-f672-4c3e-b94f-7d926f22e44a req-12a4dcfb-3eaf-4353-8c0b-d2c32de059ea service nova] Creating event network-vif-plugged:91ae1d70-98ef-4440-b262-75000350faf5 for instance 4266f69a-16ba-4372-9868-a4d95990f4cd on n-h1-850499-9 Aug 31 17:49:13.985390 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-58022fa9-f672-4c3e-b94f-7d926f22e44a req-12a4dcfb-3eaf-4353-8c0b-d2c32de059ea service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049407 Aug 31 17:49:13.985946 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4146/8282] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:49:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:49:25.985001 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_api:SELECT=2 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:49:25.986742 n-d-850499-9 devstack@n-api.service[122256]: DEBUG dbcounter [-] [122256] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:49:25.987550 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_api:SELECT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:49:25.988344 n-d-850499-9 devstack@n-api.service[122257]: DEBUG dbcounter [-] [122257] Writing DB stats nova_cell1:SELECT=2 {{(pid=122257) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:49:25.991469 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-294cdf25-cee0-479f-b052-764b415bf1f2 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:49:25.992166 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-294cdf25-cee0-479f-b052-764b415bf1f2 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] [instance: 4266f69a-16ba-4372-9868-a4d95990f4cd] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:49:25.994434 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-972cfd77-e576-4d9a-a6eb-a15890c21b64 req-a69a3f1d-27a7-4db9-b319-b2b43e867fe0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4266f69a-16ba-4372-9868-a4d95990f4cd", "tag": "91ae1d70-98ef-4440-b262-75000350faf5"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:49:25.999389 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-294cdf25-cee0-479f-b052-764b415bf1f2 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:49:25.999944 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-294cdf25-cee0-479f-b052-764b415bf1f2 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:49:26.000365 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-294cdf25-cee0-479f-b052-764b415bf1f2 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:49:26.001084 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-294cdf25-cee0-479f-b052-764b415bf1f2 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:49:26.001548 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-294cdf25-cee0-479f-b052-764b415bf1f2 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:49:26.001982 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-294cdf25-cee0-479f-b052-764b415bf1f2 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:49:26.010752 n-d-850499-9 devstack@n-api.service[122257]: INFO oslo.messaging._drivers.impl_rabbit [-] [8b198bdc-d1f7-4259-9144-ce56665d9587] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 42362. Aug 31 17:49:26.016249 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-972cfd77-e576-4d9a-a6eb-a15890c21b64 req-a69a3f1d-27a7-4db9-b319-b2b43e867fe0 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:49:26.017635 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-972cfd77-e576-4d9a-a6eb-a15890c21b64 req-a69a3f1d-27a7-4db9-b319-b2b43e867fe0 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:49:26.018113 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-972cfd77-e576-4d9a-a6eb-a15890c21b64 req-a69a3f1d-27a7-4db9-b319-b2b43e867fe0 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:49:26.029866 n-d-850499-9 devstack@n-api.service[122257]: INFO oslo.messaging._drivers.impl_rabbit [-] [400e2b90-e189-478a-9cc4-4b0bfcefc34a] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 42364. Aug 31 17:49:26.032142 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-972cfd77-e576-4d9a-a6eb-a15890c21b64 req-a69a3f1d-27a7-4db9-b319-b2b43e867fe0 service nova] Creating event network-changed:91ae1d70-98ef-4440-b262-75000350faf5 for instance 4266f69a-16ba-4372-9868-a4d95990f4cd on n-h1-850499-9 Aug 31 17:49:26.034385 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-294cdf25-cee0-479f-b052-764b415bf1f2 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] [instance: 4266f69a-16ba-4372-9868-a4d95990f4cd] Going to try to terminate instance {{(pid=122256) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 17:49:26.038457 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-972cfd77-e576-4d9a-a6eb-a15890c21b64 req-a69a3f1d-27a7-4db9-b319-b2b43e867fe0 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054204 Aug 31 17:49:26.039521 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4147/8283] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:49:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:49:26.128431 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-294cdf25-cee0-479f-b052-764b415bf1f2 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] 10.222.0.61 "DELETE /compute/v2.1/servers/4266f69a-16ba-4372-9868-a4d95990f4cd" status: 204 len: 0 microversion: 2.1 time: 0.146276 Aug 31 17:49:26.130083 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4137/8284] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 17:49:25 2022] DELETE /compute/v2.1/servers/4266f69a-16ba-4372-9868-a4d95990f4cd => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 17:49:26.140982 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-7e183c19-6d6e-414d-94ca-4b15893e2a3c tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:49:26.141106 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-7e183c19-6d6e-414d-94ca-4b15893e2a3c tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] [instance: 4266f69a-16ba-4372-9868-a4d95990f4cd] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:49:26.148271 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7e183c19-6d6e-414d-94ca-4b15893e2a3c tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:49:26.148960 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7e183c19-6d6e-414d-94ca-4b15893e2a3c tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:49:26.149453 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7e183c19-6d6e-414d-94ca-4b15893e2a3c tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:49:26.150169 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7e183c19-6d6e-414d-94ca-4b15893e2a3c tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:49:26.150643 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7e183c19-6d6e-414d-94ca-4b15893e2a3c tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:49:26.151079 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-7e183c19-6d6e-414d-94ca-4b15893e2a3c tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:49:26.296752 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-7e183c19-6d6e-414d-94ca-4b15893e2a3c tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b76db43cde640c2bf4970ca4181bf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2c5e3f45f844e0a43fbbccb4f88031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:49:26.304848 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-7e183c19-6d6e-414d-94ca-4b15893e2a3c tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] 10.222.0.61 "GET /compute/v2.1/servers/4266f69a-16ba-4372-9868-a4d95990f4cd" status: 200 len: 1680 microversion: 2.1 time: 0.169428 Aug 31 17:49:26.305430 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4148/8285] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:49:26 2022] GET /compute/v2.1/servers/4266f69a-16ba-4372-9868-a4d95990f4cd => generated 1680 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:49:27.327768 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-b4236645-3e0e-4ef1-8ad8-1eb283872265 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:49:27.328634 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-b4236645-3e0e-4ef1-8ad8-1eb283872265 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] [instance: 4266f69a-16ba-4372-9868-a4d95990f4cd] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:49:27.335984 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b4236645-3e0e-4ef1-8ad8-1eb283872265 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:49:27.336472 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b4236645-3e0e-4ef1-8ad8-1eb283872265 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:49:27.336914 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b4236645-3e0e-4ef1-8ad8-1eb283872265 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:49:27.337618 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b4236645-3e0e-4ef1-8ad8-1eb283872265 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:49:27.338077 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b4236645-3e0e-4ef1-8ad8-1eb283872265 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:49:27.338538 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-b4236645-3e0e-4ef1-8ad8-1eb283872265 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:49:27.552291 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-b4236645-3e0e-4ef1-8ad8-1eb283872265 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b76db43cde640c2bf4970ca4181bf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2c5e3f45f844e0a43fbbccb4f88031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:49:27.560197 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-b4236645-3e0e-4ef1-8ad8-1eb283872265 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] 10.222.0.61 "GET /compute/v2.1/servers/4266f69a-16ba-4372-9868-a4d95990f4cd" status: 200 len: 1680 microversion: 2.1 time: 0.237029 Aug 31 17:49:27.560778 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4138/8286] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:49:27 2022] GET /compute/v2.1/servers/4266f69a-16ba-4372-9868-a4d95990f4cd => generated 1680 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:49:27.968315 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [req-8d3ea06b-c119-4848-902a-c416d4a5cdd8 req-86bb8ea4-89dc-467c-8036-502b274e9aea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4266f69a-16ba-4372-9868-a4d95990f4cd", "name": "network-vif-unplugged", "status": "completed", "tag": "91ae1d70-98ef-4440-b262-75000350faf5"}]} {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:49:27.981275 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-8d3ea06b-c119-4848-902a-c416d4a5cdd8 req-86bb8ea4-89dc-467c-8036-502b274e9aea service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:49:27.982194 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-8d3ea06b-c119-4848-902a-c416d4a5cdd8 req-86bb8ea4-89dc-467c-8036-502b274e9aea service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:49:27.982915 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [req-8d3ea06b-c119-4848-902a-c416d4a5cdd8 req-86bb8ea4-89dc-467c-8036-502b274e9aea service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:49:28.003448 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.compute.server_external_events [req-8d3ea06b-c119-4848-902a-c416d4a5cdd8 req-86bb8ea4-89dc-467c-8036-502b274e9aea service nova] Creating event network-vif-unplugged:91ae1d70-98ef-4440-b262-75000350faf5 for instance 4266f69a-16ba-4372-9868-a4d95990f4cd on n-h1-850499-9 Aug 31 17:49:28.014989 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [req-8d3ea06b-c119-4848-902a-c416d4a5cdd8 req-86bb8ea4-89dc-467c-8036-502b274e9aea service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058028 Aug 31 17:49:28.016998 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4149/8287] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:49:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:49:28.398050 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-b1514b6f-f908-4e7b-93d8-b23e770186ac req-ba849e8e-0fa5-45e1-bfc6-96e41a7500c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4266f69a-16ba-4372-9868-a4d95990f4cd", "name": "network-vif-deleted", "tag": "91ae1d70-98ef-4440-b262-75000350faf5"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:49:28.409342 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-b1514b6f-f908-4e7b-93d8-b23e770186ac req-ba849e8e-0fa5-45e1-bfc6-96e41a7500c8 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:49:28.409744 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-b1514b6f-f908-4e7b-93d8-b23e770186ac req-ba849e8e-0fa5-45e1-bfc6-96e41a7500c8 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:49:28.410182 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-b1514b6f-f908-4e7b-93d8-b23e770186ac req-ba849e8e-0fa5-45e1-bfc6-96e41a7500c8 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:49:28.424212 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-b1514b6f-f908-4e7b-93d8-b23e770186ac req-ba849e8e-0fa5-45e1-bfc6-96e41a7500c8 service nova] Creating event network-vif-deleted:91ae1d70-98ef-4440-b262-75000350faf5 for instance 4266f69a-16ba-4372-9868-a4d95990f4cd on n-h1-850499-9 Aug 31 17:49:28.430480 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-b1514b6f-f908-4e7b-93d8-b23e770186ac req-ba849e8e-0fa5-45e1-bfc6-96e41a7500c8 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036571 Aug 31 17:49:28.431091 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4139/8288] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:49:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:49:28.582428 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-8b3069a7-50e7-4bee-96fd-86044258df68 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:49:28.583951 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-8b3069a7-50e7-4bee-96fd-86044258df68 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] [instance: 4266f69a-16ba-4372-9868-a4d95990f4cd] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:49:28.591019 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b3069a7-50e7-4bee-96fd-86044258df68 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:49:28.591564 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b3069a7-50e7-4bee-96fd-86044258df68 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:49:28.592054 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b3069a7-50e7-4bee-96fd-86044258df68 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:49:28.592776 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b3069a7-50e7-4bee-96fd-86044258df68 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:49:28.593250 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b3069a7-50e7-4bee-96fd-86044258df68 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:49:28.593689 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b3069a7-50e7-4bee-96fd-86044258df68 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:49:28.627137 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b3069a7-50e7-4bee-96fd-86044258df68 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:49:28.627677 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b3069a7-50e7-4bee-96fd-86044258df68 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:49:28.628132 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-8b3069a7-50e7-4bee-96fd-86044258df68 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:49:28.628588 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-8b3069a7-50e7-4bee-96fd-86044258df68 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lazy-loading 'fault' on Instance uuid 4266f69a-16ba-4372-9868-a4d95990f4cd {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 17:49:28.674757 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-8b3069a7-50e7-4bee-96fd-86044258df68 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b76db43cde640c2bf4970ca4181bf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2c5e3f45f844e0a43fbbccb4f88031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:49:28.683405 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-8b3069a7-50e7-4bee-96fd-86044258df68 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] 10.222.0.61 "GET /compute/v2.1/servers/4266f69a-16ba-4372-9868-a4d95990f4cd" status: 200 len: 1336 microversion: 2.1 time: 0.105506 Aug 31 17:49:28.684145 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4150/8289] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:49:28 2022] GET /compute/v2.1/servers/4266f69a-16ba-4372-9868-a4d95990f4cd => generated 1336 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:49:29.706073 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-93d000b9-045b-481d-ab0f-5eb3a615a0cd tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:49:29.706697 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-93d000b9-045b-481d-ab0f-5eb3a615a0cd tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] [instance: 4266f69a-16ba-4372-9868-a4d95990f4cd] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:49:29.714550 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-93d000b9-045b-481d-ab0f-5eb3a615a0cd tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:49:29.715041 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-93d000b9-045b-481d-ab0f-5eb3a615a0cd tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:49:29.715535 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-93d000b9-045b-481d-ab0f-5eb3a615a0cd tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:49:29.716244 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-93d000b9-045b-481d-ab0f-5eb3a615a0cd tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:49:29.716712 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-93d000b9-045b-481d-ab0f-5eb3a615a0cd tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:49:29.717148 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-93d000b9-045b-481d-ab0f-5eb3a615a0cd tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:49:29.731690 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-93d000b9-045b-481d-ab0f-5eb3a615a0cd tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] HTTP exception thrown: Instance 4266f69a-16ba-4372-9868-a4d95990f4cd could not be found. Aug 31 17:49:29.733290 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-93d000b9-045b-481d-ab0f-5eb3a615a0cd tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Request method failure captured: Aug 31 17:49:29.733290 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/4266f69a-16ba-4372-9868-a4d95990f4cd HTTP/1.1 Aug 31 17:49:29.733290 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 17:49:29.733290 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 17:49:29.733290 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 17:49:29.733290 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 17:49:29.733290 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 17:49:29.733290 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 17:49:29.733290 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 17:49:29.733290 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 17:49:29.733290 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD52906AeOoaKGs0HF82jlTeUrTF-bwKwNNmIOoxd8RszvuJ_dwUOWjBRmKZWVJ5aXIbvia4zUI5Vmq7A6QAyX8sA3hJdUGzlklijkrJL6SWePsls9s-aWkjTeslchfDf9x81NqdWnVLtav0cVl2I_01qTs2ADg3rf0NfjCEVBNg41RI Aug 31 17:49:29.733290 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 17:49:29.733290 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 17:49:29.733290 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 17:49:29.733290 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 17:49:29.733290 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 17:49:29.733290 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 17:49:29.733290 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: fc2c5e3f45f844e0a43fbbccb4f88031 Aug 31 17:49:29.733290 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-TestSnapshotPattern-1233059296 Aug 31 17:49:29.733290 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 17:49:29.733290 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 17:49:29.733290 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fc2c5e3f45f844e0a43fbbccb4f88031"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/fc2c5e3f45f844e0a43fbbccb4f88031"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_fc2c5e3f45f844e0a43fbbccb4f88031", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fc2c5e3f45f844e0a43fbbccb4f88031"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 17:49:29.733290 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-TestSnapshotPattern-1233059296 Aug 31 17:49:29.733290 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: fc2c5e3f45f844e0a43fbbccb4f88031 Aug 31 17:49:29.733290 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-TestSnapshotPattern-1233059296 Aug 31 17:49:29.733290 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-TestSnapshotPattern-1233059296-project Aug 31 17:49:29.733290 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 17:49:29.733290 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 17:49:29.733290 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 0b76db43cde640c2bf4970ca4181bf46 Aug 31 17:49:29.733290 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-TestSnapshotPattern-1233059296-project Aug 31 17:49:29.733290 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 17:49:29.733290 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance 4266f69a-16ba-4372-9868-a4d95990f4cd could not be found. Aug 31 17:49:29.733290 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': '4266f69a-16ba-4372-9868-a4d95990f4cd'} Aug 31 17:49:29.733290 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 17:49:29.733290 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:49:29.733290 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 17:49:29.733290 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 17:49:29.733290 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 17:49:29.733290 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 17:49:29.733290 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 17:49:29.733290 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 17:49:29.733290 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 17:49:29.733290 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 17:49:29.733290 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4266f69a-16ba-4372-9868-a4d95990f4cd could not be found. Aug 31 17:49:29.733290 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:49:29.733290 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:49:29.733290 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:49:29.733290 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:49:29.733290 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:49:29.733290 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:49:29.733290 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 17:49:29.733290 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 17:49:29.733290 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 17:49:29.733290 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 17:49:29.733290 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 17:49:29.733290 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 17:49:29.733290 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 17:49:29.733290 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 17:49:29.733290 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 17:49:29.733290 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 17:49:29.733290 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4266f69a-16ba-4372-9868-a4d95990f4cd could not be found. Aug 31 17:49:29.733290 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:49:29.733290 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:49:29.733290 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:49:29.738874 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:49:29.738874 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:49:29.738874 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:49:29.738874 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 17:49:29.738874 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 17:49:29.738874 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4266f69a-16ba-4372-9868-a4d95990f4cd could not be found. Aug 31 17:49:29.738874 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:49:29.738874 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-93d000b9-045b-481d-ab0f-5eb3a615a0cd tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Returning 404 to user: Instance 4266f69a-16ba-4372-9868-a4d95990f4cd could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 17:49:29.738874 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-93d000b9-045b-481d-ab0f-5eb3a615a0cd tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] 10.222.0.61 "GET /compute/v2.1/servers/4266f69a-16ba-4372-9868-a4d95990f4cd" status: 404 len: 111 microversion: 2.1 time: 0.033059 Aug 31 17:49:29.738874 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4140/8290] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:49:29 2022] GET /compute/v2.1/servers/4266f69a-16ba-4372-9868-a4d95990f4cd => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 17:49:31.366104 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-044d2f67-1d70-407f-82e2-186f0586a16a tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:49:31.366611 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-044d2f67-1d70-407f-82e2-186f0586a16a tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] [instance: af7f2521-e02f-471e-8f47-84d9b4542ae6] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:49:31.371802 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-64340917-6601-47e4-ae8a-5c4730e91e39 req-7ef489cf-a8ac-4284-8a43-b79602afb472 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af7f2521-e02f-471e-8f47-84d9b4542ae6", "tag": "b1721db2-d432-412f-b40f-87294e04e9f6"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:49:31.373906 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-044d2f67-1d70-407f-82e2-186f0586a16a tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:49:31.374479 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-044d2f67-1d70-407f-82e2-186f0586a16a tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:49:31.375174 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-044d2f67-1d70-407f-82e2-186f0586a16a tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:49:31.376006 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-044d2f67-1d70-407f-82e2-186f0586a16a tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:49:31.376554 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-044d2f67-1d70-407f-82e2-186f0586a16a tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:49:31.377225 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-044d2f67-1d70-407f-82e2-186f0586a16a tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:49:31.383326 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-64340917-6601-47e4-ae8a-5c4730e91e39 req-7ef489cf-a8ac-4284-8a43-b79602afb472 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:49:31.383919 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-64340917-6601-47e4-ae8a-5c4730e91e39 req-7ef489cf-a8ac-4284-8a43-b79602afb472 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:49:31.384417 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-64340917-6601-47e4-ae8a-5c4730e91e39 req-7ef489cf-a8ac-4284-8a43-b79602afb472 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:49:31.396734 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-64340917-6601-47e4-ae8a-5c4730e91e39 req-7ef489cf-a8ac-4284-8a43-b79602afb472 service nova] Creating event network-changed:b1721db2-d432-412f-b40f-87294e04e9f6 for instance af7f2521-e02f-471e-8f47-84d9b4542ae6 on n-h2-850499-9 Aug 31 17:49:31.402469 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-64340917-6601-47e4-ae8a-5c4730e91e39 req-7ef489cf-a8ac-4284-8a43-b79602afb472 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034472 Aug 31 17:49:31.403091 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4141/8291] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:49:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:49:31.408522 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-044d2f67-1d70-407f-82e2-186f0586a16a tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] [instance: af7f2521-e02f-471e-8f47-84d9b4542ae6] Going to try to terminate instance {{(pid=122257) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 17:49:31.499047 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-044d2f67-1d70-407f-82e2-186f0586a16a tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] 10.222.0.61 "DELETE /compute/v2.1/servers/af7f2521-e02f-471e-8f47-84d9b4542ae6" status: 204 len: 0 microversion: 2.1 time: 0.137398 Aug 31 17:49:31.500221 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4151/8292] 10.222.0.61 () {58 vars in 1239 bytes} [Wed Aug 31 17:49:31 2022] DELETE /compute/v2.1/servers/af7f2521-e02f-471e-8f47-84d9b4542ae6 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 17:49:31.510196 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-377b5036-7838-40ca-93e4-cf37a5733c84 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:49:31.510914 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-377b5036-7838-40ca-93e4-cf37a5733c84 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] [instance: af7f2521-e02f-471e-8f47-84d9b4542ae6] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:49:31.517096 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-377b5036-7838-40ca-93e4-cf37a5733c84 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:49:31.517587 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-377b5036-7838-40ca-93e4-cf37a5733c84 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:49:31.518030 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-377b5036-7838-40ca-93e4-cf37a5733c84 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:49:31.518734 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-377b5036-7838-40ca-93e4-cf37a5733c84 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:49:31.519389 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-377b5036-7838-40ca-93e4-cf37a5733c84 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:49:31.519942 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-377b5036-7838-40ca-93e4-cf37a5733c84 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:49:31.667450 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.policy [None req-377b5036-7838-40ca-93e4-cf37a5733c84 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b76db43cde640c2bf4970ca4181bf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2c5e3f45f844e0a43fbbccb4f88031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:49:31.675465 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-377b5036-7838-40ca-93e4-cf37a5733c84 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] 10.222.0.61 "GET /compute/v2.1/servers/af7f2521-e02f-471e-8f47-84d9b4542ae6" status: 200 len: 1681 microversion: 2.1 time: 0.169737 Aug 31 17:49:31.676684 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4142/8293] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:49:31 2022] GET /compute/v2.1/servers/af7f2521-e02f-471e-8f47-84d9b4542ae6 => generated 1681 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:49:32.698367 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-6e82f279-0ea6-4bc4-9022-f79b8e0597a0 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:49:32.699192 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-6e82f279-0ea6-4bc4-9022-f79b8e0597a0 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] [instance: af7f2521-e02f-471e-8f47-84d9b4542ae6] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:49:32.706145 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6e82f279-0ea6-4bc4-9022-f79b8e0597a0 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:49:32.706657 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6e82f279-0ea6-4bc4-9022-f79b8e0597a0 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:49:32.707121 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6e82f279-0ea6-4bc4-9022-f79b8e0597a0 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:49:32.709121 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6e82f279-0ea6-4bc4-9022-f79b8e0597a0 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:49:32.709611 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6e82f279-0ea6-4bc4-9022-f79b8e0597a0 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:49:32.710086 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-6e82f279-0ea6-4bc4-9022-f79b8e0597a0 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:49:32.944068 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-6e82f279-0ea6-4bc4-9022-f79b8e0597a0 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b76db43cde640c2bf4970ca4181bf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2c5e3f45f844e0a43fbbccb4f88031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:49:32.952148 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-6e82f279-0ea6-4bc4-9022-f79b8e0597a0 tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] 10.222.0.61 "GET /compute/v2.1/servers/af7f2521-e02f-471e-8f47-84d9b4542ae6" status: 200 len: 1563 microversion: 2.1 time: 0.258117 Aug 31 17:49:32.952654 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4152/8294] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:49:32 2022] GET /compute/v2.1/servers/af7f2521-e02f-471e-8f47-84d9b4542ae6 => generated 1563 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:49:33.280565 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [req-241885a3-04ba-4cb8-8e24-8f2d4abefbc3 req-b3849291-a2ed-48dc-8a45-a4b4a5be6e17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af7f2521-e02f-471e-8f47-84d9b4542ae6", "name": "network-vif-deleted", "tag": "b1721db2-d432-412f-b40f-87294e04e9f6"}]} {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:49:33.291077 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-241885a3-04ba-4cb8-8e24-8f2d4abefbc3 req-b3849291-a2ed-48dc-8a45-a4b4a5be6e17 service nova] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:49:33.291590 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-241885a3-04ba-4cb8-8e24-8f2d4abefbc3 req-b3849291-a2ed-48dc-8a45-a4b4a5be6e17 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:49:33.292027 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [req-241885a3-04ba-4cb8-8e24-8f2d4abefbc3 req-b3849291-a2ed-48dc-8a45-a4b4a5be6e17 service nova] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:49:33.304352 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.compute.server_external_events [req-241885a3-04ba-4cb8-8e24-8f2d4abefbc3 req-b3849291-a2ed-48dc-8a45-a4b4a5be6e17 service nova] Creating event network-vif-deleted:b1721db2-d432-412f-b40f-87294e04e9f6 for instance af7f2521-e02f-471e-8f47-84d9b4542ae6 on n-h2-850499-9 Aug 31 17:49:33.309803 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [req-241885a3-04ba-4cb8-8e24-8f2d4abefbc3 req-b3849291-a2ed-48dc-8a45-a4b4a5be6e17 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093212 Aug 31 17:49:33.310417 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4143/8295] 10.222.0.61 () {64 vars in 1317 bytes} [Wed Aug 31 17:49:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:49:33.977937 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-b405a4b4-126f-4a67-90f6-035441363e5b tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Calling method '>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:49:33.979576 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.compute.api [None req-b405a4b4-126f-4a67-90f6-035441363e5b tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] [instance: af7f2521-e02f-471e-8f47-84d9b4542ae6] Fetching instance by UUID {{(pid=122257) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:49:33.990860 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b405a4b4-126f-4a67-90f6-035441363e5b tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:49:33.991836 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b405a4b4-126f-4a67-90f6-035441363e5b tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:49:33.992191 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b405a4b4-126f-4a67-90f6-035441363e5b tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:49:33.993177 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b405a4b4-126f-4a67-90f6-035441363e5b tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:49:33.994032 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b405a4b4-126f-4a67-90f6-035441363e5b tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:49:33.994746 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b405a4b4-126f-4a67-90f6-035441363e5b tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:49:34.038074 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b405a4b4-126f-4a67-90f6-035441363e5b tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:49:34.038658 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b405a4b4-126f-4a67-90f6-035441363e5b tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:49:34.039175 n-d-850499-9 devstack@n-api.service[122257]: DEBUG oslo_concurrency.lockutils [None req-b405a4b4-126f-4a67-90f6-035441363e5b tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122257) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:49:34.039879 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.objects.instance [None req-b405a4b4-126f-4a67-90f6-035441363e5b tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lazy-loading 'fault' on Instance uuid af7f2521-e02f-471e-8f47-84d9b4542ae6 {{(pid=122257) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 17:49:34.087016 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.policy [None req-b405a4b4-126f-4a67-90f6-035441363e5b tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b76db43cde640c2bf4970ca4181bf46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2c5e3f45f844e0a43fbbccb4f88031', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122257) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:49:34.094555 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-b405a4b4-126f-4a67-90f6-035441363e5b tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] 10.222.0.61 "GET /compute/v2.1/servers/af7f2521-e02f-471e-8f47-84d9b4542ae6" status: 200 len: 1336 microversion: 2.1 time: 0.123787 Aug 31 17:49:34.095113 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4153/8296] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:49:33 2022] GET /compute/v2.1/servers/af7f2521-e02f-471e-8f47-84d9b4542ae6 => generated 1336 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:49:35.117315 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6b4c2376-6408-493d-a539-51f668a768eb tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Calling method '>' {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:49:35.118022 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.compute.api [None req-6b4c2376-6408-493d-a539-51f668a768eb tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] [instance: af7f2521-e02f-471e-8f47-84d9b4542ae6] Fetching instance by UUID {{(pid=122256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:49:35.124195 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6b4c2376-6408-493d-a539-51f668a768eb tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:49:35.124681 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6b4c2376-6408-493d-a539-51f668a768eb tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:49:35.125118 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6b4c2376-6408-493d-a539-51f668a768eb tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:49:35.125811 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6b4c2376-6408-493d-a539-51f668a768eb tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Acquiring lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:49:35.126273 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6b4c2376-6408-493d-a539-51f668a768eb tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:49:35.126728 n-d-850499-9 devstack@n-api.service[122256]: DEBUG oslo_concurrency.lockutils [None req-6b4c2376-6408-493d-a539-51f668a768eb tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Lock "9f6d6683-96bf-42a7-a78d-78a22f1453ed" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:49:35.140408 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.wsgi [None req-6b4c2376-6408-493d-a539-51f668a768eb tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] HTTP exception thrown: Instance af7f2521-e02f-471e-8f47-84d9b4542ae6 could not be found. Aug 31 17:49:35.142030 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6b4c2376-6408-493d-a539-51f668a768eb tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Request method failure captured: Aug 31 17:49:35.142030 n-d-850499-9 devstack@n-api.service[122256]: request: GET /compute/v2.1/servers/af7f2521-e02f-471e-8f47-84d9b4542ae6 HTTP/1.1 Aug 31 17:49:35.142030 n-d-850499-9 devstack@n-api.service[122256]: Accept: application/json Aug 31 17:49:35.142030 n-d-850499-9 devstack@n-api.service[122256]: Accept-Encoding: identity Aug 31 17:49:35.142030 n-d-850499-9 devstack@n-api.service[122256]: Connection: close Aug 31 17:49:35.142030 n-d-850499-9 devstack@n-api.service[122256]: Content-Length: 0 Aug 31 17:49:35.142030 n-d-850499-9 devstack@n-api.service[122256]: Content-Type: application/json Aug 31 17:49:35.142030 n-d-850499-9 devstack@n-api.service[122256]: Host: 10.222.0.61 Aug 31 17:49:35.142030 n-d-850499-9 devstack@n-api.service[122256]: Openstack-System-Scope: None Aug 31 17:49:35.142030 n-d-850499-9 devstack@n-api.service[122256]: User-Agent: python-urllib3/1.26.12 Aug 31 17:49:35.142030 n-d-850499-9 devstack@n-api.service[122256]: X-Auth-Token: gAAAAABjD52906AeOoaKGs0HF82jlTeUrTF-bwKwNNmIOoxd8RszvuJ_dwUOWjBRmKZWVJ5aXIbvia4zUI5Vmq7A6QAyX8sA3hJdUGzlklijkrJL6SWePsls9s-aWkjTeslchfDf9x81NqdWnVLtav0cVl2I_01qTs2ADg3rf0NfjCEVBNg41RI Aug 31 17:49:35.142030 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Id: None Aug 31 17:49:35.142030 n-d-850499-9 devstack@n-api.service[122256]: X-Domain-Name: None Aug 31 17:49:35.142030 n-d-850499-9 devstack@n-api.service[122256]: X-Identity-Status: Confirmed Aug 31 17:49:35.142030 n-d-850499-9 devstack@n-api.service[122256]: X-Is-Admin-Project: True Aug 31 17:49:35.142030 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Id: default Aug 31 17:49:35.142030 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Domain-Name: Default Aug 31 17:49:35.142030 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Id: fc2c5e3f45f844e0a43fbbccb4f88031 Aug 31 17:49:35.142030 n-d-850499-9 devstack@n-api.service[122256]: X-Project-Name: tempest-TestSnapshotPattern-1233059296 Aug 31 17:49:35.142030 n-d-850499-9 devstack@n-api.service[122256]: X-Role: reader,member Aug 31 17:49:35.142030 n-d-850499-9 devstack@n-api.service[122256]: X-Roles: reader,member Aug 31 17:49:35.142030 n-d-850499-9 devstack@n-api.service[122256]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fc2c5e3f45f844e0a43fbbccb4f88031"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/fc2c5e3f45f844e0a43fbbccb4f88031"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_fc2c5e3f45f844e0a43fbbccb4f88031", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fc2c5e3f45f844e0a43fbbccb4f88031"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Aug 31 17:49:35.142030 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant: tempest-TestSnapshotPattern-1233059296 Aug 31 17:49:35.142030 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Id: fc2c5e3f45f844e0a43fbbccb4f88031 Aug 31 17:49:35.142030 n-d-850499-9 devstack@n-api.service[122256]: X-Tenant-Name: tempest-TestSnapshotPattern-1233059296 Aug 31 17:49:35.142030 n-d-850499-9 devstack@n-api.service[122256]: X-User: tempest-TestSnapshotPattern-1233059296-project Aug 31 17:49:35.142030 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Id: default Aug 31 17:49:35.142030 n-d-850499-9 devstack@n-api.service[122256]: X-User-Domain-Name: Default Aug 31 17:49:35.142030 n-d-850499-9 devstack@n-api.service[122256]: X-User-Id: 0b76db43cde640c2bf4970ca4181bf46 Aug 31 17:49:35.142030 n-d-850499-9 devstack@n-api.service[122256]: X-User-Name: tempest-TestSnapshotPattern-1233059296-project Aug 31 17:49:35.142030 n-d-850499-9 devstack@n-api.service[122256]: method: > Aug 31 17:49:35.142030 n-d-850499-9 devstack@n-api.service[122256]: exception: Instance af7f2521-e02f-471e-8f47-84d9b4542ae6 could not be found. Aug 31 17:49:35.142030 n-d-850499-9 devstack@n-api.service[122256]: action_args: {'id': 'af7f2521-e02f-471e-8f47-84d9b4542ae6'} Aug 31 17:49:35.142030 n-d-850499-9 devstack@n-api.service[122256]: {{(pid=122256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 17:49:35.142030 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:49:35.142030 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 17:49:35.142030 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 17:49:35.142030 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 17:49:35.142030 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 17:49:35.142030 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 17:49:35.142030 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 17:49:35.142030 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 17:49:35.142030 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 17:49:35.142030 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af7f2521-e02f-471e-8f47-84d9b4542ae6 could not be found. Aug 31 17:49:35.142030 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:49:35.142030 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:49:35.142030 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:49:35.142030 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:49:35.142030 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:49:35.142030 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:49:35.142030 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 17:49:35.142030 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 17:49:35.142030 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 17:49:35.142030 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 17:49:35.142030 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 17:49:35.142030 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 17:49:35.142030 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 17:49:35.142030 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 17:49:35.142030 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 17:49:35.142030 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 17:49:35.142030 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af7f2521-e02f-471e-8f47-84d9b4542ae6 could not be found. Aug 31 17:49:35.142030 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:49:35.142030 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:49:35.142030 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:49:35.147921 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:49:35.147921 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:49:35.147921 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:49:35.147921 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 17:49:35.147921 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 17:49:35.147921 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af7f2521-e02f-471e-8f47-84d9b4542ae6 could not be found. Aug 31 17:49:35.147921 n-d-850499-9 devstack@n-api.service[122256]: ERROR nova.api.openstack.wsgi Aug 31 17:49:35.147921 n-d-850499-9 devstack@n-api.service[122256]: DEBUG nova.api.openstack.wsgi [None req-6b4c2376-6408-493d-a539-51f668a768eb tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Returning 404 to user: Instance af7f2521-e02f-471e-8f47-84d9b4542ae6 could not be found. {{(pid=122256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 17:49:35.147921 n-d-850499-9 devstack@n-api.service[122256]: INFO nova.api.openstack.requestlog [None req-6b4c2376-6408-493d-a539-51f668a768eb tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] 10.222.0.61 "GET /compute/v2.1/servers/af7f2521-e02f-471e-8f47-84d9b4542ae6" status: 404 len: 111 microversion: 2.1 time: 0.032033 Aug 31 17:49:35.147921 n-d-850499-9 devstack@n-api.service[122256]: [pid: 122256|app: 0|req: 4144/8297] 10.222.0.61 () {58 vars in 1236 bytes} [Wed Aug 31 17:49:35 2022] GET /compute/v2.1/servers/af7f2521-e02f-471e-8f47-84d9b4542ae6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 17:49:35.309433 n-d-850499-9 devstack@n-api.service[122257]: DEBUG nova.api.openstack.wsgi [None req-82dee89f-c39e-45e2-b179-332278eeb60c tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] Calling method '.version_select at 0x7f5ae005f0d0>' {{(pid=122257) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:49:35.315568 n-d-850499-9 devstack@n-api.service[122257]: ERROR oslo.messaging._drivers.impl_rabbit [None req-82dee89f-c39e-45e2-b179-332278eeb60c tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] [71efe5ec-3448-444a-b5c7-a9d033d02814] AMQP server on 10.222.0.61:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 31 17:49:36.323850 n-d-850499-9 devstack@n-api.service[122257]: INFO oslo.messaging._drivers.impl_rabbit [None req-82dee89f-c39e-45e2-b179-332278eeb60c tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] [71efe5ec-3448-444a-b5c7-a9d033d02814] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 42446. Aug 31 17:49:36.348149 n-d-850499-9 devstack@n-api.service[122257]: INFO nova.api.openstack.requestlog [None req-82dee89f-c39e-45e2-b179-332278eeb60c tempest-TestSnapshotPattern-1233059296 tempest-TestSnapshotPattern-1233059296-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-31997817" status: 202 len: 0 microversion: 2.1 time: 1.042617 Aug 31 17:49:36.348740 n-d-850499-9 devstack@n-api.service[122257]: [pid: 122257|app: 0|req: 4154/8298] 10.222.0.61 () {58 vars in 1251 bytes} [Wed Aug 31 17:49:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-31997817 => generated 0 bytes in 1044 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0)